2024-09-19T05:49:40.494 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T05:49:40.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T05:49:40.624 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911710 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/fs/test_o_trunc}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911710' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - nowsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi003.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDRBJEREezVNMzzwB0hG0+tKFSbShzg/h1uPYnNuW0o7JTJCjxvue5xVK0aJwXJ3nwNQCRVRv/YkGHDpkKBszxA= smithi059.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJk0tAuvN+evZkg293/oOLyQtpjUVCnK8wCGYjrhr5OsPIN79cGvwL943NxBTVQsGsJFhVn0/z84V/vEddrhhbA= smithi071.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFCsXpn8VKwEzRpngvduUlWeVLeJ9xc+pZKUNgnzShtliJuBzirg8PO7VSEOMSeXdvRmcQtMXwsbHW5r/EnzfJs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - fs/test_o_trunc.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T05:49:40.625 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T05:49:40.625 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T05:49:40.626 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T05:49:40.627 INFO:teuthology.task.internal:Checking packages... 2024-09-19T05:49:40.657 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T05:49:40.657 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T05:49:40.657 INFO:teuthology.packaging:ref: None 2024-09-19T05:49:40.658 INFO:teuthology.packaging:tag: None 2024-09-19T05:49:40.658 INFO:teuthology.packaging:branch: squid 2024-09-19T05:49:40.658 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:49:40.658 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T05:49:40.860 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T05:49:40.862 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T05:49:40.888 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T05:49:40.888 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T05:49:40.920 INFO:teuthology.task.internal:Saving configuration 2024-09-19T05:49:40.976 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T05:49:41.003 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T05:49:41.025 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911710', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 05:44:51.800533', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDRBJEREezVNMzzwB0hG0+tKFSbShzg/h1uPYnNuW0o7JTJCjxvue5xVK0aJwXJ3nwNQCRVRv/YkGHDpkKBszxA='} 2024-09-19T05:49:41.049 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911710', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 05:44:51.796408', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJk0tAuvN+evZkg293/oOLyQtpjUVCnK8wCGYjrhr5OsPIN79cGvwL943NxBTVQsGsJFhVn0/z84V/vEddrhhbA='} 2024-09-19T05:49:41.069 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911710', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 05:44:51.798214', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFCsXpn8VKwEzRpngvduUlWeVLeJ9xc+pZKUNgnzShtliJuBzirg8PO7VSEOMSeXdvRmcQtMXwsbHW5r/EnzfJs='} 2024-09-19T05:49:41.069 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T05:49:41.075 INFO:teuthology.task.internal:roles: ubuntu@smithi003.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T05:49:41.075 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T05:49:41.075 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T05:49:41.076 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T05:49:41.153 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0282c87be0>, signals=[15]) 2024-09-19T05:49:41.153 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T05:49:41.159 INFO:teuthology.task.internal:Opening connections... 2024-09-19T05:49:41.159 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi003.front.sepia.ceph.com 2024-09-19T05:49:41.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:49:41.235 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi059.front.sepia.ceph.com 2024-09-19T05:49:41.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:49:41.315 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2024-09-19T05:49:41.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:49:41.391 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T05:49:41.399 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2024-09-19T05:49:41.418 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2024-09-19T05:49:41.418 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2024-09-19T05:49:41.477 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2024-09-19T05:49:41.478 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="9" 2024-09-19T05:49:41.478 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2024-09-19T05:49:41.478 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2024-09-19T05:49:41.478 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="9" 2024-09-19T05:49:41.478 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el9" 2024-09-19T05:49:41.478 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T05:49:41.478 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2024-09-19T05:49:41.478 INFO:teuthology.orchestra.run.smithi003.stdout:LOGO="fedora-logo-icon" 2024-09-19T05:49:41.478 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T05:49:41.478 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2024-09-19T05:49:41.479 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T05:49:41.479 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T05:49:41.479 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T05:49:41.479 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2024-09-19T05:49:41.496 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2024-09-19T05:49:41.515 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2024-09-19T05:49:41.515 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-09-19T05:49:41.572 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2024-09-19T05:49:41.572 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2024-09-19T05:49:41.572 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2024-09-19T05:49:41.573 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2024-09-19T05:49:41.573 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2024-09-19T05:49:41.573 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2024-09-19T05:49:41.573 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T05:49:41.573 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2024-09-19T05:49:41.573 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2024-09-19T05:49:41.573 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T05:49:41.573 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2024-09-19T05:49:41.573 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T05:49:41.573 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T05:49:41.573 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T05:49:41.574 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-09-19T05:49:41.588 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2024-09-19T05:49:41.606 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2024-09-19T05:49:41.606 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-09-19T05:49:41.665 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2024-09-19T05:49:41.665 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9" 2024-09-19T05:49:41.665 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2024-09-19T05:49:41.665 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2024-09-19T05:49:41.665 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9" 2024-09-19T05:49:41.665 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9" 2024-09-19T05:49:41.665 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T05:49:41.665 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2024-09-19T05:49:41.665 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon" 2024-09-19T05:49:41.666 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T05:49:41.666 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2024-09-19T05:49:41.666 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T05:49:41.666 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T05:49:41.666 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T05:49:41.666 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-09-19T05:49:41.688 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T05:49:41.698 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T05:49:41.705 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T05:49:41.706 DEBUG:teuthology.orchestra.run.smithi003:> test '!' -e /home/ubuntu/cephtest 2024-09-19T05:49:41.709 DEBUG:teuthology.orchestra.run.smithi059:> test '!' -e /home/ubuntu/cephtest 2024-09-19T05:49:41.712 DEBUG:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2024-09-19T05:49:41.730 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T05:49:41.736 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T05:49:41.736 DEBUG:teuthology.orchestra.run.smithi003:> test -z $(ls -A /var/lib/ceph) 2024-09-19T05:49:41.766 DEBUG:teuthology.orchestra.run.smithi059:> test -z $(ls -A /var/lib/ceph) 2024-09-19T05:49:41.769 DEBUG:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2024-09-19T05:49:41.792 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T05:49:41.862 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T05:49:41.880 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-19T05:49:41.880 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-19T05:49:41.880 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-19T05:49:41.881 DEBUG:teuthology.orchestra.run.smithi003:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T05:49:41.898 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:49:41.898 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-19T05:49:42.061 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-19T05:49:42.061 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-19T05:49:42.061 DEBUG:teuthology.orchestra.run.smithi003:> uname -r 2024-09-19T05:49:42.079 INFO:teuthology.orchestra.run.smithi003.stdout:5.14.0-503.el9.x86_64 2024-09-19T05:49:42.079 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-19T05:49:42.079 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-19T05:49:42.080 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum upgrade -y linux-firmware 2024-09-19T05:49:45.708 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.3 MB 00:01 2024-09-19T05:49:51.808 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - AppStream 4.1 MB/s | 20 MB 00:04 2024-09-19T05:49:56.075 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - CRB 18 MB/s | 6.5 MB 00:00 2024-09-19T05:49:57.684 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - Extras packages 82 kB/s | 19 kB 00:00 2024-09-19T05:49:58.988 INFO:teuthology.orchestra.run.smithi003.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-19T05:50:04.719 INFO:teuthology.orchestra.run.smithi003.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-19T05:50:06.812 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-19T05:50:06.818 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-19T05:50:06.818 INFO:teuthology.orchestra.run.smithi003.stdout: Package Architecture Version Repository Size 2024-09-19T05:50:06.818 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-19T05:50:06.819 INFO:teuthology.orchestra.run.smithi003.stdout:Upgrading: 2024-09-19T05:50:06.819 INFO:teuthology.orchestra.run.smithi003.stdout: linux-firmware noarch 20240905-146.el9 baseos 388 M 2024-09-19T05:50:06.819 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T05:50:06.819 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-19T05:50:06.819 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-19T05:50:06.819 INFO:teuthology.orchestra.run.smithi003.stdout:Upgrade 1 Package 2024-09-19T05:50:06.819 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T05:50:06.819 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 388 M 2024-09-19T05:50:06.819 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-19T05:50:22.286 INFO:teuthology.orchestra.run.smithi003.stdout:linux-firmware-20240905-146.el9.noarch.rpm 25 MB/s | 388 MB 00:15 2024-09-19T05:50:22.286 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:50:22.286 INFO:teuthology.orchestra.run.smithi003.stdout:Total 25 MB/s | 388 MB 00:15 2024-09-19T05:50:25.563 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-19T05:50:25.657 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-19T05:50:25.657 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-19T05:50:29.095 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-19T05:50:29.096 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-19T05:50:39.029 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-19T05:50:39.410 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-19T05:50:39.494 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-19T05:50:39.971 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: linux-firmware-20240716-145.el9.noarch 2/2 2024-09-19T05:50:39.971 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : linux-firmware-20240905-146.el9.noarch 1/2 2024-09-19T05:50:40.701 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 2/2 2024-09-19T05:50:40.702 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T05:50:40.702 INFO:teuthology.orchestra.run.smithi003.stdout:Upgraded: 2024-09-19T05:50:40.702 INFO:teuthology.orchestra.run.smithi003.stdout: linux-firmware-20240905-146.el9.noarch 2024-09-19T05:50:40.702 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T05:50:40.702 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-19T05:50:41.145 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-19T05:50:41.146 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-19T05:50:41.295 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-19T05:50:41.295 DEBUG:teuthology.orchestra.run.smithi003:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-19T05:50:41.298 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi003.front.sepia.ceph.com to complete... 2024-09-19T05:50:47.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19 05:50:47 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-19T05:50:47.597 INFO:teuthology.orchestra.run.smithi003.stderr:FINISHED --2024-09-19 05:50:47-- 2024-09-19T05:50:47.597 INFO:teuthology.orchestra.run.smithi003.stderr:Total wall clock time: 6.3s 2024-09-19T05:50:47.597 INFO:teuthology.orchestra.run.smithi003.stderr:Downloaded: 1 files, 343M in 6.0s (57.3 MB/s) 2024-09-19T05:50:47.600 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-19T05:50:47.601 DEBUG:teuthology.orchestra.run.smithi003:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-19T05:50:49.761 INFO:teuthology.orchestra.run.smithi003.stdout:Verifying... ######################################## 2024-09-19T05:50:49.819 INFO:teuthology.orchestra.run.smithi003.stdout:Preparing... ######################################## 2024-09-19T05:50:49.882 INFO:teuthology.orchestra.run.smithi003.stdout:Updating / installing... 2024-09-19T05:50:58.250 INFO:teuthology.orchestra.run.smithi003.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-19T05:51:38.396 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi003.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-19T05:51:38.397 DEBUG:teuthology.orchestra.run.smithi003:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-19T05:51:38.478 INFO:teuthology.orchestra.run.smithi003.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-19T05:51:38.478 INFO:teuthology.orchestra.run.smithi003.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-19T05:51:38.478 INFO:teuthology.orchestra.run.smithi003.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-19T05:51:38.478 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-19T05:51:38.479 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-19T05:51:38.479 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-19T05:51:38.479 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-19T05:51:38.479 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-19T05:51:38.479 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-19T05:51:38.479 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-19T05:51:38.479 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-19T05:51:38.479 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-19T05:51:38.479 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-19T05:51:38.479 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-19T05:51:38.479 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-19T05:51:38.480 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-19T05:51:38.480 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-19T05:51:38.480 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-19T05:51:38.480 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-19T05:51:38.480 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-19T05:51:38.480 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-19T05:51:38.480 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-19T05:51:38.480 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-19T05:51:38.480 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-19T05:51:38.480 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-19T05:51:38.480 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-19T05:51:38.480 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-19T05:51:38.481 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-19T05:51:38.481 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-19T05:51:38.481 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-19T05:51:38.481 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-19T05:51:38.481 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-19T05:51:38.481 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-19T05:51:38.481 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-19T05:51:38.481 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-19T05:51:38.481 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-19T05:51:38.481 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-19T05:51:38.482 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-19T05:51:38.482 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-19T05:51:38.482 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-19T05:51:38.482 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-19T05:51:38.482 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-19T05:51:38.482 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-19T05:51:38.482 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-19T05:51:38.482 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-19T05:51:38.482 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-19T05:51:38.482 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-19T05:51:38.482 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-19T05:51:38.482 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-19T05:51:38.482 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-19T05:51:38.483 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-19T05:51:38.483 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-19T05:51:38.483 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-19T05:51:38.483 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-19T05:51:38.483 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-19T05:51:38.483 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-19T05:51:38.483 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-19T05:51:38.483 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-19T05:51:38.483 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-19T05:51:38.484 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-19T05:51:38.484 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-19T05:51:38.484 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-19T05:51:38.484 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-19T05:51:38.484 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-19T05:51:38.484 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-19T05:51:38.484 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-19T05:51:38.484 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-19T05:51:38.484 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-19T05:51:38.484 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-19T05:51:38.484 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-19T05:51:38.484 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-19T05:51:38.484 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-19T05:51:38.485 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-19T05:51:38.485 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-19T05:51:38.485 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-19T05:51:38.485 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-19T05:51:38.485 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-19T05:51:38.485 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-19T05:51:38.485 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-19T05:51:38.485 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-19T05:51:38.485 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-19T05:51:38.485 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-19T05:51:38.485 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-19T05:51:38.485 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-19T05:51:38.485 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-19T05:51:38.485 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-19T05:51:38.486 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-19T05:51:38.486 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-19T05:51:38.486 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-19T05:51:38.486 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-19T05:51:38.486 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-19T05:51:38.486 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-19T05:51:38.486 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-19T05:51:38.486 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-19T05:51:38.486 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-19T05:51:38.486 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-19T05:51:38.486 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-19T05:51:38.486 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-19T05:51:38.486 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-19T05:51:38.486 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-19T05:51:38.487 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-19T05:51:38.487 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-19T05:51:38.487 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-19T05:51:38.487 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-19T05:51:38.487 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-19T05:51:38.487 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-19T05:51:38.487 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-19T05:51:38.487 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-19T05:51:38.487 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-19T05:51:38.487 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-19T05:51:38.487 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-19T05:51:38.487 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-19T05:51:38.487 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-19T05:51:38.487 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-19T05:51:38.488 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-19T05:51:38.488 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-19T05:51:38.488 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-19T05:51:38.488 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-19T05:51:38.488 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-19T05:51:38.488 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-19T05:51:38.488 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-19T05:51:38.488 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-19T05:51:38.488 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-19T05:51:38.488 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-19T05:51:38.488 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-19T05:51:38.488 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-19T05:51:38.488 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-19T05:51:38.489 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-19T05:51:38.489 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-19T05:51:38.489 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-19T05:51:38.489 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-19T05:51:38.489 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-19T05:51:38.489 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-19T05:51:38.489 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-19T05:51:38.489 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-19T05:51:38.489 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-19T05:51:38.490 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-19T05:51:38.490 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-19T05:51:38.490 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-19T05:51:38.490 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-19T05:51:38.490 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-19T05:51:38.490 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-19T05:51:38.490 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-19T05:51:38.490 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-19T05:51:38.490 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-19T05:51:38.490 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-19T05:51:38.490 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-19T05:51:38.490 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-19T05:51:38.491 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-19T05:51:38.491 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-19T05:51:38.491 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-19T05:51:38.491 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-19T05:51:38.491 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-19T05:51:38.491 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-19T05:51:38.491 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-19T05:51:38.491 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-19T05:51:38.491 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-19T05:51:38.491 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-19T05:51:38.491 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-19T05:51:38.492 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-19T05:51:38.492 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-19T05:51:38.492 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-19T05:51:38.492 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-19T05:51:38.492 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-19T05:51:38.492 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-19T05:51:38.492 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-19T05:51:38.492 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-19T05:51:38.492 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-19T05:51:38.492 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-19T05:51:38.492 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-19T05:51:38.493 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-19T05:51:38.493 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-19T05:51:38.493 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-19T05:51:38.493 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-19T05:51:38.493 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-19T05:51:38.493 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-19T05:51:38.493 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-19T05:51:38.493 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-19T05:51:38.493 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-19T05:51:38.493 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-19T05:51:38.494 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-19T05:51:38.494 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-19T05:51:38.494 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-19T05:51:38.494 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-19T05:51:38.494 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-19T05:51:38.494 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-19T05:51:38.494 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-19T05:51:38.494 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-19T05:51:38.495 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-19T05:51:38.495 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-19T05:51:38.495 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-19T05:51:38.495 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-19T05:51:38.495 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-19T05:51:38.495 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-19T05:51:38.495 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-19T05:51:38.495 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-19T05:51:38.496 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-19T05:51:38.496 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-19T05:51:38.496 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-19T05:51:38.496 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-19T05:51:38.496 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-19T05:51:38.496 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-19T05:51:38.496 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-19T05:51:38.496 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-19T05:51:38.496 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-19T05:51:38.496 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-19T05:51:38.496 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-19T05:51:38.497 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-19T05:51:38.497 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-19T05:51:38.497 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-19T05:51:38.497 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-19T05:51:38.497 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-19T05:51:38.497 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-19T05:51:38.497 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-19T05:51:38.497 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-19T05:51:38.497 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-19T05:51:38.497 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-19T05:51:38.497 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-19T05:51:38.498 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-19T05:51:38.498 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-19T05:51:38.498 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-19T05:51:38.498 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-19T05:51:38.498 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-19T05:51:38.498 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-19T05:51:38.498 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-19T05:51:38.498 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-19T05:51:38.498 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-19T05:51:38.498 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-19T05:51:38.498 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-19T05:51:38.498 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-19T05:51:38.499 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-19T05:51:38.499 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-19T05:51:38.499 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-19T05:51:38.499 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-19T05:51:38.499 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-19T05:51:38.499 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-19T05:51:38.499 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-19T05:51:38.499 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-19T05:51:38.499 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-19T05:51:38.499 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-19T05:51:38.499 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-19T05:51:38.500 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-19T05:51:38.500 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-19T05:51:38.500 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-19T05:51:38.500 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-19T05:51:38.500 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-19T05:51:38.500 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-19T05:51:38.500 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-19T05:51:38.500 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-19T05:51:38.500 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-19T05:51:38.500 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-19T05:51:38.500 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-19T05:51:38.501 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-19T05:51:38.501 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-19T05:51:38.501 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-19T05:51:38.501 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-19T05:51:38.501 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-19T05:51:38.501 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-19T05:51:38.501 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-19T05:51:38.501 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-19T05:51:38.501 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-19T05:51:38.501 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-19T05:51:38.501 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-19T05:51:38.502 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-19T05:51:38.502 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-19T05:51:38.502 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-19T05:51:38.502 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-19T05:51:38.502 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-19T05:51:38.502 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-19T05:51:38.502 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-19T05:51:38.502 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-19T05:51:38.502 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-19T05:51:38.502 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-19T05:51:38.502 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-19T05:51:38.502 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-19T05:51:38.503 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-19T05:51:38.503 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-19T05:51:38.503 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-19T05:51:38.503 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-19T05:51:38.503 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-19T05:51:38.503 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-19T05:51:38.503 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-19T05:51:38.503 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-19T05:51:38.503 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-19T05:51:38.503 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-19T05:51:38.504 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-19T05:51:38.504 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-19T05:51:38.504 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-19T05:51:38.504 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-19T05:51:38.504 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-19T05:51:38.504 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-19T05:51:38.504 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-19T05:51:38.504 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-19T05:51:38.504 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-19T05:51:38.504 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-19T05:51:38.504 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-19T05:51:38.505 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-19T05:51:38.505 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-19T05:51:38.505 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-19T05:51:38.505 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-19T05:51:38.505 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-19T05:51:38.505 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-19T05:51:38.505 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-19T05:51:38.505 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-19T05:51:38.505 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-19T05:51:38.505 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-19T05:51:38.505 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-19T05:51:38.506 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-19T05:51:38.506 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-19T05:51:38.506 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-19T05:51:38.506 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-19T05:51:38.506 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-19T05:51:38.506 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-19T05:51:38.506 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-19T05:51:38.506 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-19T05:51:38.506 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-19T05:51:38.506 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-19T05:51:38.506 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-19T05:51:38.507 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-19T05:51:38.507 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-19T05:51:38.507 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-19T05:51:38.507 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-19T05:51:38.507 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-19T05:51:38.507 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-19T05:51:38.507 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-19T05:51:38.507 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-19T05:51:38.507 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-19T05:51:38.507 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-19T05:51:38.507 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-19T05:51:38.507 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-19T05:51:38.508 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-19T05:51:38.508 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-19T05:51:38.508 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-19T05:51:38.508 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-19T05:51:38.508 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-19T05:51:38.508 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-19T05:51:38.508 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-19T05:51:38.508 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-19T05:51:38.508 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-19T05:51:38.508 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-19T05:51:38.508 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-19T05:51:38.508 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-19T05:51:38.509 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-19T05:51:38.509 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-19T05:51:38.509 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-19T05:51:38.509 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-19T05:51:38.509 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-19T05:51:38.509 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-19T05:51:38.509 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-19T05:51:38.509 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-19T05:51:38.509 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-19T05:51:38.509 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-19T05:51:38.509 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-19T05:51:38.510 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-19T05:51:38.510 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-19T05:51:38.510 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-19T05:51:38.510 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-19T05:51:38.510 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-19T05:51:38.510 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-19T05:51:38.510 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-19T05:51:38.510 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-19T05:51:38.510 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-19T05:51:38.510 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-19T05:51:38.510 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-19T05:51:38.510 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-19T05:51:38.511 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-19T05:51:38.511 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-19T05:51:38.511 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-19T05:51:38.511 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-19T05:51:38.511 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-19T05:51:38.511 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-19T05:51:38.511 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-19T05:51:38.511 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-19T05:51:38.511 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-19T05:51:38.511 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-19T05:51:38.511 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-19T05:51:38.511 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-19T05:51:38.512 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-19T05:51:38.512 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-19T05:51:38.512 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-19T05:51:38.512 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-19T05:51:38.512 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-19T05:51:38.512 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-19T05:51:38.512 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-19T05:51:38.512 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-19T05:51:38.512 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-19T05:51:38.512 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-19T05:51:38.512 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-19T05:51:38.513 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-19T05:51:38.513 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-19T05:51:38.513 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-19T05:51:38.513 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-19T05:51:38.513 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-19T05:51:38.513 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-19T05:51:38.513 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-19T05:51:38.513 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-19T05:51:38.513 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-19T05:51:38.513 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-19T05:51:38.513 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-19T05:51:38.513 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-19T05:51:38.514 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-19T05:51:38.514 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-19T05:51:38.514 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-19T05:51:38.514 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-19T05:51:38.514 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-19T05:51:38.514 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-19T05:51:38.514 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-19T05:51:38.514 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-19T05:51:38.514 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-19T05:51:38.514 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-19T05:51:38.514 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-19T05:51:38.514 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-19T05:51:38.515 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-19T05:51:38.515 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-19T05:51:38.515 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-19T05:51:38.515 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-19T05:51:38.515 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-19T05:51:38.515 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-19T05:51:38.515 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-19T05:51:38.515 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-19T05:51:38.515 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-19T05:51:38.515 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-19T05:51:38.515 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-19T05:51:38.515 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-19T05:51:38.516 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-19T05:51:38.516 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-19T05:51:38.516 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-19T05:51:38.516 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-19T05:51:38.516 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-19T05:51:38.516 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-19T05:51:38.516 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-19T05:51:38.516 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-19T05:51:38.516 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-19T05:51:38.516 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-19T05:51:38.516 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-19T05:51:38.517 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-19T05:51:38.517 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-19T05:51:38.517 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-19T05:51:38.517 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-19T05:51:38.517 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-19T05:51:38.517 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-19T05:51:38.517 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-19T05:51:38.517 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-19T05:51:38.517 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-19T05:51:38.517 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-19T05:51:38.517 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-19T05:51:38.517 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-19T05:51:38.518 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-19T05:51:38.518 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-19T05:51:38.518 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-19T05:51:38.518 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-19T05:51:38.518 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-19T05:51:38.518 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-19T05:51:38.518 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-19T05:51:38.518 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-19T05:51:38.518 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-19T05:51:38.518 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-19T05:51:38.518 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-19T05:51:38.519 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-19T05:51:38.519 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-19T05:51:38.519 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-19T05:51:38.519 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-19T05:51:38.519 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-19T05:51:38.519 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-19T05:51:38.519 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-19T05:51:38.519 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-19T05:51:38.519 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-19T05:51:38.519 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-19T05:51:38.519 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-19T05:51:38.520 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-19T05:51:38.520 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-19T05:51:38.520 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-19T05:51:38.520 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-19T05:51:38.520 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-19T05:51:38.520 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-19T05:51:38.520 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-19T05:51:38.520 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-19T05:51:38.520 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-19T05:51:38.520 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-19T05:51:38.520 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-19T05:51:38.521 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-19T05:51:38.521 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-19T05:51:38.521 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-19T05:51:38.521 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-19T05:51:38.521 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-19T05:51:38.521 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-19T05:51:38.521 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-19T05:51:38.521 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-19T05:51:38.521 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-19T05:51:38.521 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-19T05:51:38.521 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-19T05:51:38.521 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-19T05:51:38.522 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-19T05:51:38.522 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-19T05:51:38.522 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-19T05:51:38.522 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-19T05:51:38.522 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-19T05:51:38.522 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-19T05:51:38.522 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-19T05:51:38.522 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-19T05:51:38.522 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-19T05:51:38.522 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-19T05:51:38.522 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-19T05:51:38.522 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-19T05:51:38.523 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-19T05:51:38.523 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-19T05:51:38.523 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-19T05:51:38.523 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-19T05:51:38.523 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-19T05:51:38.523 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-19T05:51:38.523 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-19T05:51:38.523 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-19T05:51:38.524 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-19T05:51:38.524 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-19T05:51:38.524 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-19T05:51:38.524 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-19T05:51:38.524 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-19T05:51:38.524 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-19T05:51:38.524 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-19T05:51:38.524 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-19T05:51:38.524 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-19T05:51:38.524 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-19T05:51:38.524 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-19T05:51:38.525 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-19T05:51:38.525 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-19T05:51:38.525 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-19T05:51:38.525 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-19T05:51:38.525 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-19T05:51:38.525 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-19T05:51:38.525 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-19T05:51:38.525 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-19T05:51:38.525 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-19T05:51:38.525 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-19T05:51:38.525 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-19T05:51:38.525 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-19T05:51:38.526 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-19T05:51:38.526 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-19T05:51:38.526 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-19T05:51:38.526 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-19T05:51:38.526 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-19T05:51:38.526 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-19T05:51:38.526 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-19T05:51:38.526 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-19T05:51:38.527 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-19T05:51:38.527 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-19T05:51:38.527 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-19T05:51:38.527 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-19T05:51:38.527 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-19T05:51:38.527 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-19T05:51:38.527 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-19T05:51:38.527 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-19T05:51:38.527 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-19T05:51:38.527 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-19T05:51:38.527 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-19T05:51:38.528 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-19T05:51:38.528 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-19T05:51:38.528 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-19T05:51:38.528 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-19T05:51:38.528 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-19T05:51:38.528 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-19T05:51:38.528 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-19T05:51:38.528 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-19T05:51:38.528 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-19T05:51:38.528 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-19T05:51:38.528 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-19T05:51:38.528 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-19T05:51:38.529 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-19T05:51:38.529 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-19T05:51:38.529 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-19T05:51:38.529 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-19T05:51:38.529 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-19T05:51:38.529 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-19T05:51:38.529 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-19T05:51:38.529 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-19T05:51:38.529 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-19T05:51:38.529 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-19T05:51:38.529 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-19T05:51:38.530 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-19T05:51:38.530 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-19T05:51:38.530 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-19T05:51:38.530 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-19T05:51:38.530 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-19T05:51:38.530 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-19T05:51:38.530 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-19T05:51:38.530 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-19T05:51:38.530 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-19T05:51:38.530 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-19T05:51:38.530 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-19T05:51:38.530 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-19T05:51:38.531 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-19T05:51:38.531 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-19T05:51:38.531 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-19T05:51:38.531 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-19T05:51:38.531 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-19T05:51:38.531 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-19T05:51:38.531 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-19T05:51:38.531 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-19T05:51:38.532 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-19T05:51:38.532 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-19T05:51:38.532 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-19T05:51:38.532 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-19T05:51:38.532 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-19T05:51:38.532 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-19T05:51:38.532 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-19T05:51:38.532 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-19T05:51:38.532 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-19T05:51:38.532 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-19T05:51:38.532 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-19T05:51:38.533 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-19T05:51:38.533 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-19T05:51:38.533 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-19T05:51:38.533 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-19T05:51:38.533 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-19T05:51:38.533 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-19T05:51:38.533 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-19T05:51:38.534 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-19T05:51:38.535 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-19T05:51:38.535 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-19T05:51:38.535 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-19T05:51:38.535 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-19T05:51:38.535 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-19T05:51:38.535 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-19T05:51:38.535 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-19T05:51:38.535 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-19T05:51:38.536 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-19T05:51:38.536 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-19T05:51:38.536 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-19T05:51:38.536 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-19T05:51:38.536 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-19T05:51:38.536 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-19T05:51:38.536 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-19T05:51:38.536 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-19T05:51:38.536 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-19T05:51:38.536 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-19T05:51:38.536 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-19T05:51:38.537 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-19T05:51:38.537 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-19T05:51:38.537 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-19T05:51:38.537 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-19T05:51:38.537 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-19T05:51:38.537 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-19T05:51:38.537 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-19T05:51:38.537 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-19T05:51:38.537 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-19T05:51:38.537 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-19T05:51:38.537 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-19T05:51:38.537 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-19T05:51:38.537 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-19T05:51:38.537 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-19T05:51:38.538 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-19T05:51:38.538 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-19T05:51:38.538 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-19T05:51:38.538 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-19T05:51:38.538 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-19T05:51:38.538 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-19T05:51:38.538 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-19T05:51:38.538 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-19T05:51:38.538 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-19T05:51:38.538 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-19T05:51:38.538 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-19T05:51:38.538 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-19T05:51:38.538 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-19T05:51:38.539 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-19T05:51:38.539 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-19T05:51:38.539 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-19T05:51:38.539 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-19T05:51:38.539 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-19T05:51:38.539 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-19T05:51:38.539 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-19T05:51:38.539 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-19T05:51:38.539 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-19T05:51:38.539 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-19T05:51:38.539 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-19T05:51:38.539 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-19T05:51:38.539 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-19T05:51:38.540 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-19T05:51:38.540 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-19T05:51:38.540 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-19T05:51:38.540 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-19T05:51:38.540 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-19T05:51:38.540 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-19T05:51:38.540 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-19T05:51:38.540 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-19T05:51:38.540 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-19T05:51:38.540 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-19T05:51:38.540 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-19T05:51:38.541 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-19T05:51:38.541 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-19T05:51:38.541 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-19T05:51:38.541 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-19T05:51:38.541 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-19T05:51:38.541 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-19T05:51:38.541 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-19T05:51:38.541 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-19T05:51:38.541 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-19T05:51:38.541 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-19T05:51:38.541 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-19T05:51:38.541 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-19T05:51:38.541 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-19T05:51:38.542 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-19T05:51:38.542 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-19T05:51:38.542 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-19T05:51:38.542 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-19T05:51:38.542 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-19T05:51:38.542 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-19T05:51:38.542 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-19T05:51:38.542 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-19T05:51:38.542 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-19T05:51:38.542 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-19T05:51:38.542 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-19T05:51:38.542 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-19T05:51:38.543 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-19T05:51:38.543 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-19T05:51:38.543 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-19T05:51:38.543 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-19T05:51:38.543 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-19T05:51:38.543 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-19T05:51:38.543 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-19T05:51:38.543 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-19T05:51:38.543 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-19T05:51:38.543 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-19T05:51:38.544 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-19T05:51:38.544 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-19T05:51:38.544 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-19T05:51:38.544 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-19T05:51:38.544 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-19T05:51:38.544 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-19T05:51:38.544 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-19T05:51:38.545 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-19T05:51:38.545 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-19T05:51:38.545 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-19T05:51:38.545 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-19T05:51:38.545 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-19T05:51:38.545 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-19T05:51:38.545 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-19T05:51:38.545 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-19T05:51:38.545 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-19T05:51:38.545 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-19T05:51:38.545 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-19T05:51:38.546 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-19T05:51:38.546 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-19T05:51:38.546 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-19T05:51:38.546 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-19T05:51:38.546 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-19T05:51:38.546 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-19T05:51:38.546 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-19T05:51:38.546 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-19T05:51:38.546 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-19T05:51:38.546 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-19T05:51:38.546 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-19T05:51:38.546 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-19T05:51:38.547 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-19T05:51:38.547 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-19T05:51:38.547 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-19T05:51:38.547 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-19T05:51:38.547 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-19T05:51:38.547 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-19T05:51:38.547 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-19T05:51:38.547 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-19T05:51:38.547 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-19T05:51:38.547 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-19T05:51:38.547 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-19T05:51:38.548 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-19T05:51:38.548 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-19T05:51:38.548 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-19T05:51:38.548 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-19T05:51:38.548 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-19T05:51:38.548 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-19T05:51:38.548 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-19T05:51:38.548 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-19T05:51:38.548 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-19T05:51:38.548 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-19T05:51:38.548 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-19T05:51:38.549 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-19T05:51:38.549 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-19T05:51:38.549 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-19T05:51:38.549 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-19T05:51:38.549 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-19T05:51:38.549 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-19T05:51:38.549 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-19T05:51:38.549 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-19T05:51:38.549 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-19T05:51:38.549 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-19T05:51:38.549 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-19T05:51:38.550 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-19T05:51:38.550 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-19T05:51:38.550 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-19T05:51:38.550 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-19T05:51:38.550 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-19T05:51:38.550 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-19T05:51:38.550 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-19T05:51:38.550 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-19T05:51:38.550 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-19T05:51:38.550 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-19T05:51:38.550 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-19T05:51:38.551 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-19T05:51:38.551 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-19T05:51:38.551 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-19T05:51:38.551 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-19T05:51:38.551 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-19T05:51:38.551 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-19T05:51:38.551 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-19T05:51:38.551 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-19T05:51:38.551 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-19T05:51:38.551 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-19T05:51:38.551 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-19T05:51:38.551 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-19T05:51:38.552 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-19T05:51:38.552 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-19T05:51:38.552 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-19T05:51:38.552 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-19T05:51:38.552 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-19T05:51:38.552 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-19T05:51:38.552 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-19T05:51:38.552 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-19T05:51:38.552 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-19T05:51:38.552 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-19T05:51:38.552 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-19T05:51:38.553 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-19T05:51:38.553 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-19T05:51:38.553 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-19T05:51:38.553 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-19T05:51:38.553 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-19T05:51:38.553 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-19T05:51:38.553 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-19T05:51:38.553 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-19T05:51:38.553 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-19T05:51:38.553 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-19T05:51:38.553 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-19T05:51:38.554 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-19T05:51:38.554 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-19T05:51:38.554 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-19T05:51:38.554 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-19T05:51:38.554 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-19T05:51:38.554 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-19T05:51:38.554 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-19T05:51:38.554 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-19T05:51:38.554 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-19T05:51:38.554 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-19T05:51:38.554 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-19T05:51:38.555 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-19T05:51:38.555 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-19T05:51:38.555 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-19T05:51:38.555 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-19T05:51:38.555 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-19T05:51:38.555 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-19T05:51:38.555 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-19T05:51:38.555 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-19T05:51:38.555 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-19T05:51:38.555 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-19T05:51:38.555 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-19T05:51:38.555 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-19T05:51:38.556 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-19T05:51:38.556 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-19T05:51:38.556 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-19T05:51:38.556 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-19T05:51:38.556 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-19T05:51:38.556 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-19T05:51:38.556 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-19T05:51:38.556 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-19T05:51:38.556 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-19T05:51:38.556 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-19T05:51:38.556 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-19T05:51:38.556 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-19T05:51:38.557 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-19T05:51:38.557 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-19T05:51:38.557 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-19T05:51:38.557 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-19T05:51:38.557 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-19T05:51:38.557 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-19T05:51:38.557 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-19T05:51:38.557 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-19T05:51:38.557 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-19T05:51:38.557 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-19T05:51:38.557 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-19T05:51:38.558 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-19T05:51:38.558 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-19T05:51:38.558 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-19T05:51:38.558 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-19T05:51:38.558 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-19T05:51:38.558 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-19T05:51:38.558 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-19T05:51:38.558 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-19T05:51:38.558 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-19T05:51:38.558 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-19T05:51:38.558 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-19T05:51:38.558 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-19T05:51:38.558 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-19T05:51:38.558 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-19T05:51:38.559 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-19T05:51:38.559 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-19T05:51:38.559 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-19T05:51:38.559 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-19T05:51:38.559 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-19T05:51:38.559 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-19T05:51:38.559 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-19T05:51:38.559 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-19T05:51:38.559 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-19T05:51:38.559 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-19T05:51:38.559 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-19T05:51:38.559 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-19T05:51:38.560 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-19T05:51:38.560 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-19T05:51:38.560 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-19T05:51:38.560 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-19T05:51:38.560 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-19T05:51:38.560 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-19T05:51:38.560 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-19T05:51:38.560 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-19T05:51:38.560 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-19T05:51:38.560 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-19T05:51:38.560 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-19T05:51:38.560 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-19T05:51:38.560 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-19T05:51:38.560 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-19T05:51:38.561 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-19T05:51:38.561 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-19T05:51:38.561 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-19T05:51:38.563 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-19T05:51:38.564 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-19T05:51:38.564 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-19T05:51:38.564 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-19T05:51:38.564 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-19T05:51:38.564 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-19T05:51:38.564 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-19T05:51:38.564 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-19T05:51:38.564 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-19T05:51:38.564 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-19T05:51:38.564 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-19T05:51:38.564 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-19T05:51:38.564 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-19T05:51:38.564 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-19T05:51:38.564 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-19T05:51:38.565 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-19T05:51:38.565 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-19T05:51:38.565 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-19T05:51:38.565 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-19T05:51:38.565 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-19T05:51:38.565 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-19T05:51:38.565 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-19T05:51:38.565 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-19T05:51:38.565 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-19T05:51:38.565 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-19T05:51:38.565 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-19T05:51:38.565 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-19T05:51:38.566 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-19T05:51:38.566 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-19T05:51:38.566 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-19T05:51:38.566 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-19T05:51:38.566 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-19T05:51:38.566 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-19T05:51:38.566 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-19T05:51:38.566 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-19T05:51:38.566 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-19T05:51:38.566 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-19T05:51:38.566 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-19T05:51:38.567 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-19T05:51:38.567 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-19T05:51:38.567 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-19T05:51:38.567 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-19T05:51:38.567 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-19T05:51:38.567 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-19T05:51:38.567 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-19T05:51:38.567 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-19T05:51:38.567 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-19T05:51:38.567 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-19T05:51:38.567 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-19T05:51:38.567 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-19T05:51:38.567 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-19T05:51:38.567 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-19T05:51:38.568 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-19T05:51:38.568 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-19T05:51:38.568 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-19T05:51:38.568 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-19T05:51:38.568 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-19T05:51:38.568 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-19T05:51:38.568 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-19T05:51:38.568 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-19T05:51:38.568 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-19T05:51:38.568 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-19T05:51:38.568 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-19T05:51:38.568 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-19T05:51:38.568 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-19T05:51:38.569 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-19T05:51:38.569 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-19T05:51:38.569 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-19T05:51:38.569 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-19T05:51:38.569 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-19T05:51:38.569 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-19T05:51:38.569 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-19T05:51:38.569 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-19T05:51:38.569 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-19T05:51:38.569 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-19T05:51:38.569 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-19T05:51:38.569 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-19T05:51:38.569 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-19T05:51:38.570 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-19T05:51:38.570 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-19T05:51:38.570 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-19T05:51:38.570 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-19T05:51:38.570 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-19T05:51:38.570 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-19T05:51:38.570 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-19T05:51:38.570 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-19T05:51:38.570 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-19T05:51:38.570 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-19T05:51:38.570 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-19T05:51:38.570 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-19T05:51:38.571 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-19T05:51:38.571 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-19T05:51:38.571 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-19T05:51:38.571 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-19T05:51:38.571 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-19T05:51:38.571 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-19T05:51:38.571 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-19T05:51:38.571 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-19T05:51:38.571 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-19T05:51:38.571 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-19T05:51:38.571 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-19T05:51:38.572 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-19T05:51:38.572 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-19T05:51:38.572 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-19T05:51:38.572 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-19T05:51:38.572 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-19T05:51:38.572 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-19T05:51:38.572 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-19T05:51:38.572 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-19T05:51:38.572 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-19T05:51:38.572 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-19T05:51:38.572 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-19T05:51:38.573 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-19T05:51:38.573 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-19T05:51:38.573 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-19T05:51:38.573 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-19T05:51:38.573 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-19T05:51:38.573 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-19T05:51:38.573 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-19T05:51:38.573 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-19T05:51:38.573 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-19T05:51:38.573 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-19T05:51:38.574 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-19T05:51:38.574 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-19T05:51:38.574 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-19T05:51:38.574 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-19T05:51:38.574 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-19T05:51:38.574 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-19T05:51:38.574 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-19T05:51:38.574 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-19T05:51:38.574 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-19T05:51:38.574 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-19T05:51:38.574 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-19T05:51:38.574 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-19T05:51:38.575 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-19T05:51:38.575 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-19T05:51:38.575 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-19T05:51:38.575 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-19T05:51:38.575 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-19T05:51:38.575 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-19T05:51:38.575 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-19T05:51:38.575 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-19T05:51:38.575 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-19T05:51:38.575 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-19T05:51:38.575 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-19T05:51:38.576 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-19T05:51:38.576 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-19T05:51:38.576 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-19T05:51:38.576 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-19T05:51:38.576 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-19T05:51:38.576 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-19T05:51:38.576 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-19T05:51:38.576 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-19T05:51:38.576 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-19T05:51:38.576 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-19T05:51:38.576 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-19T05:51:38.577 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-19T05:51:38.577 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-19T05:51:38.577 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-19T05:51:38.577 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-19T05:51:38.577 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-19T05:51:38.577 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-19T05:51:38.577 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-19T05:51:38.577 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-19T05:51:38.577 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-19T05:51:38.577 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-19T05:51:38.577 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-19T05:51:38.577 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-19T05:51:38.578 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-19T05:51:38.578 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-19T05:51:38.578 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-19T05:51:38.578 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-19T05:51:38.578 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-19T05:51:38.578 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-19T05:51:38.578 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-19T05:51:38.578 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-19T05:51:38.578 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-19T05:51:38.578 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-19T05:51:38.578 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-19T05:51:38.578 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-19T05:51:38.579 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-19T05:51:38.579 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-19T05:51:38.579 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-19T05:51:38.579 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-19T05:51:38.579 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-19T05:51:38.579 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-19T05:51:38.579 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-19T05:51:38.579 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-19T05:51:38.579 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-19T05:51:38.579 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-19T05:51:38.579 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-19T05:51:38.579 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-19T05:51:38.580 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-19T05:51:38.580 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-19T05:51:38.580 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-19T05:51:38.580 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-19T05:51:38.580 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-19T05:51:38.580 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-19T05:51:38.580 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-19T05:51:38.580 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-19T05:51:38.580 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-19T05:51:38.580 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-19T05:51:38.580 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-19T05:51:38.581 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-19T05:51:38.581 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-19T05:51:38.581 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-19T05:51:38.581 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-19T05:51:38.581 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-19T05:51:38.581 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-19T05:51:38.581 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-19T05:51:38.581 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-19T05:51:38.581 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-19T05:51:38.581 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-19T05:51:38.581 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-19T05:51:38.582 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-19T05:51:38.582 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-19T05:51:38.582 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-19T05:51:38.582 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-19T05:51:38.582 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-19T05:51:38.582 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-19T05:51:38.582 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-19T05:51:38.582 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-19T05:51:38.582 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-19T05:51:38.582 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-19T05:51:38.582 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-19T05:51:38.583 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-19T05:51:38.583 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-19T05:51:38.583 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-19T05:51:38.583 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-19T05:51:38.583 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-19T05:51:38.583 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-19T05:51:38.583 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-19T05:51:38.583 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-19T05:51:38.583 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-19T05:51:38.583 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-19T05:51:38.583 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-19T05:51:38.584 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-19T05:51:38.584 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-19T05:51:38.584 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-19T05:51:38.584 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-19T05:51:38.584 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-19T05:51:38.584 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-19T05:51:38.584 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-19T05:51:38.584 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-19T05:51:38.584 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-19T05:51:38.584 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-19T05:51:38.584 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-19T05:51:38.584 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-19T05:51:38.584 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-19T05:51:38.585 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-19T05:51:38.585 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-19T05:51:38.585 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-19T05:51:38.585 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-19T05:51:38.585 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-19T05:51:38.585 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-19T05:51:38.585 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-19T05:51:38.585 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-19T05:51:38.585 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-19T05:51:38.585 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-19T05:51:38.585 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-19T05:51:38.585 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-19T05:51:38.585 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-19T05:51:38.585 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-19T05:51:38.586 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-19T05:51:38.586 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-19T05:51:38.586 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-19T05:51:38.586 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-19T05:51:38.586 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-19T05:51:38.586 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-19T05:51:38.586 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-19T05:51:38.586 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-19T05:51:38.586 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-19T05:51:38.586 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-19T05:51:38.586 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-19T05:51:38.586 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-19T05:51:38.586 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-19T05:51:38.586 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-19T05:51:38.586 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-19T05:51:38.587 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-19T05:51:38.587 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-19T05:51:38.587 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-19T05:51:38.587 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-19T05:51:38.587 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-19T05:51:38.587 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-19T05:51:38.587 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-19T05:51:38.587 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-19T05:51:38.587 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-19T05:51:38.587 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-19T05:51:38.588 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-19T05:51:38.588 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-19T05:51:38.588 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-19T05:51:38.588 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-19T05:51:38.588 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-19T05:51:38.588 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-19T05:51:38.588 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-19T05:51:38.588 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-19T05:51:38.588 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-19T05:51:38.588 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-19T05:51:38.588 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-19T05:51:38.588 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-19T05:51:38.588 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-19T05:51:38.589 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-19T05:51:38.589 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-19T05:51:38.589 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-19T05:51:38.589 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-19T05:51:38.589 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-19T05:51:38.589 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-19T05:51:38.589 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-19T05:51:38.589 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-19T05:51:38.589 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-19T05:51:38.589 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-19T05:51:38.589 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-19T05:51:38.589 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-19T05:51:38.589 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-19T05:51:38.590 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-19T05:51:38.590 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-19T05:51:38.590 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-19T05:51:38.590 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-19T05:51:38.590 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-19T05:51:38.590 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-19T05:51:38.590 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-19T05:51:38.590 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-19T05:51:38.590 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-19T05:51:38.590 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-19T05:51:38.590 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-19T05:51:38.590 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-19T05:51:38.590 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-19T05:51:38.590 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-19T05:51:38.590 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-19T05:51:38.591 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-19T05:51:38.591 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-19T05:51:38.591 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-19T05:51:38.591 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-19T05:51:38.591 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-19T05:51:38.591 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-19T05:51:38.591 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-19T05:51:38.591 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-19T05:51:38.591 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-19T05:51:38.591 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-19T05:51:38.591 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-19T05:51:38.591 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-19T05:51:38.591 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-19T05:51:38.591 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-19T05:51:38.592 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-19T05:51:38.592 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-19T05:51:38.592 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-19T05:51:38.592 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-19T05:51:38.592 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-19T05:51:38.592 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-19T05:51:38.592 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-19T05:51:38.592 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-19T05:51:38.592 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-19T05:51:38.592 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-19T05:51:38.592 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-19T05:51:38.592 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-19T05:51:38.592 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-19T05:51:38.592 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-19T05:51:38.592 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-19T05:51:38.593 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-19T05:51:38.593 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-19T05:51:38.593 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-19T05:51:38.593 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-19T05:51:38.593 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-19T05:51:38.593 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-19T05:51:38.593 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-19T05:51:38.593 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-19T05:51:38.593 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-19T05:51:38.593 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-19T05:51:38.593 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-19T05:51:38.593 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-19T05:51:38.593 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-19T05:51:38.593 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-19T05:51:38.594 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-19T05:51:38.594 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-19T05:51:38.594 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-19T05:51:38.594 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-19T05:51:38.594 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-19T05:51:38.594 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-19T05:51:38.594 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-19T05:51:38.594 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-19T05:51:38.594 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-19T05:51:38.594 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-19T05:51:38.594 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-19T05:51:38.594 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-19T05:51:38.594 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-19T05:51:38.594 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-19T05:51:38.595 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-19T05:51:38.595 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-19T05:51:38.595 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-19T05:51:38.595 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-19T05:51:38.595 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-19T05:51:38.595 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-19T05:51:38.595 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-19T05:51:38.595 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-19T05:51:38.595 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-19T05:51:38.596 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-19T05:51:38.596 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-19T05:51:38.596 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-19T05:51:38.596 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-19T05:51:38.596 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-19T05:51:38.596 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-19T05:51:38.596 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-19T05:51:38.596 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-19T05:51:38.596 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-19T05:51:38.596 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-19T05:51:38.596 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-19T05:51:38.596 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-19T05:51:38.597 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-19T05:51:38.597 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-19T05:51:38.597 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-19T05:51:38.597 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-19T05:51:38.597 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-19T05:51:38.597 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-19T05:51:38.597 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-19T05:51:38.597 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-19T05:51:38.597 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-19T05:51:38.597 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-19T05:51:38.597 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-19T05:51:38.597 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-19T05:51:38.597 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-19T05:51:38.597 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-19T05:51:38.598 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-19T05:51:38.598 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-19T05:51:38.598 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-19T05:51:38.598 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-19T05:51:38.598 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-19T05:51:38.598 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-19T05:51:38.598 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-19T05:51:38.598 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-19T05:51:38.598 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-19T05:51:38.598 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-19T05:51:38.598 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-19T05:51:38.598 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-19T05:51:38.598 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-19T05:51:38.599 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-19T05:51:38.599 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-19T05:51:38.599 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-19T05:51:38.599 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-19T05:51:38.599 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-19T05:51:38.599 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-19T05:51:38.599 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-19T05:51:38.599 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-19T05:51:38.599 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-19T05:51:38.599 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-19T05:51:38.599 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-19T05:51:38.599 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-19T05:51:38.599 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-19T05:51:38.599 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-19T05:51:38.600 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-19T05:51:38.600 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-19T05:51:38.600 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-19T05:51:38.600 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-19T05:51:38.600 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-19T05:51:38.600 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-19T05:51:38.600 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-19T05:51:38.600 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-19T05:51:38.600 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-19T05:51:38.600 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-19T05:51:38.600 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-19T05:51:38.600 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-19T05:51:38.601 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-19T05:51:38.601 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-19T05:51:38.601 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-19T05:51:38.601 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-19T05:51:38.601 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-19T05:51:38.601 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-19T05:51:38.601 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-19T05:51:38.601 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-19T05:51:38.601 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-19T05:51:38.601 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-19T05:51:38.601 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-19T05:51:38.601 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-19T05:51:38.601 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-19T05:51:38.601 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-19T05:51:38.602 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-19T05:51:38.602 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-19T05:51:38.602 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-19T05:51:38.602 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-19T05:51:38.602 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-19T05:51:38.602 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-19T05:51:38.602 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-19T05:51:38.602 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-19T05:51:38.602 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-19T05:51:38.602 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-19T05:51:38.602 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-19T05:51:38.602 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-19T05:51:38.602 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-19T05:51:38.603 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-19T05:51:38.603 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-19T05:51:38.603 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-19T05:51:38.603 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-19T05:51:38.603 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-19T05:51:38.603 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-19T05:51:38.603 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-19T05:51:38.603 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-19T05:51:38.603 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-19T05:51:38.603 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-19T05:51:38.603 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-19T05:51:38.603 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-19T05:51:38.604 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-19T05:51:38.604 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-19T05:51:38.604 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-19T05:51:38.604 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-19T05:51:38.604 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-19T05:51:38.604 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-19T05:51:38.604 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-19T05:51:38.604 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-19T05:51:38.604 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-19T05:51:38.604 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-19T05:51:38.604 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-19T05:51:38.604 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-19T05:51:38.604 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-19T05:51:38.605 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-19T05:51:38.605 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-19T05:51:38.605 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-19T05:51:38.605 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-19T05:51:38.605 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-19T05:51:38.605 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-19T05:51:38.605 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-19T05:51:38.605 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-19T05:51:38.605 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-19T05:51:38.605 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-19T05:51:38.605 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-19T05:51:38.605 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-19T05:51:38.606 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-19T05:51:38.606 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-19T05:51:38.606 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-19T05:51:38.606 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-19T05:51:38.606 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-19T05:51:38.606 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-19T05:51:38.606 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-19T05:51:38.606 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-19T05:51:38.606 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-19T05:51:38.606 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-19T05:51:38.607 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-19T05:51:38.607 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-19T05:51:38.607 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-19T05:51:38.607 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-19T05:51:38.607 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-19T05:51:38.607 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-19T05:51:38.607 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-19T05:51:38.607 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-19T05:51:38.607 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-19T05:51:38.607 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-19T05:51:38.607 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-19T05:51:38.608 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-19T05:51:38.608 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-19T05:51:38.608 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-19T05:51:38.608 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-19T05:51:38.608 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-19T05:51:38.608 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-19T05:51:38.608 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-19T05:51:38.608 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-19T05:51:38.608 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-19T05:51:38.608 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-19T05:51:38.608 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-19T05:51:38.609 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-19T05:51:38.609 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-19T05:51:38.609 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-19T05:51:38.609 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-19T05:51:38.609 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-19T05:51:38.609 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-19T05:51:38.609 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-19T05:51:38.609 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-19T05:51:38.609 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-19T05:51:38.609 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-19T05:51:38.609 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-19T05:51:38.610 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-19T05:51:38.610 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-19T05:51:38.610 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-19T05:51:38.610 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-19T05:51:38.610 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-19T05:51:38.610 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-19T05:51:38.610 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-19T05:51:38.610 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-19T05:51:38.610 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-19T05:51:38.610 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-19T05:51:38.610 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-19T05:51:38.610 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-19T05:51:38.611 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-19T05:51:38.611 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-19T05:51:38.611 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-19T05:51:38.611 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-19T05:51:38.611 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-19T05:51:38.611 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-19T05:51:38.611 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-19T05:51:38.611 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-19T05:51:38.611 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-19T05:51:38.611 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-19T05:51:38.612 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-19T05:51:38.612 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-19T05:51:38.612 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-19T05:51:38.612 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-19T05:51:38.612 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-19T05:51:38.612 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-19T05:51:38.612 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-19T05:51:38.612 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-19T05:51:38.612 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-19T05:51:38.612 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-19T05:51:38.613 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-19T05:51:38.613 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-19T05:51:38.613 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-19T05:51:38.613 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-19T05:51:38.613 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-19T05:51:38.613 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-19T05:51:38.613 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-19T05:51:38.613 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-19T05:51:38.613 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-19T05:51:38.613 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-19T05:51:38.613 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-19T05:51:38.614 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-19T05:51:38.614 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-19T05:51:38.614 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-19T05:51:38.614 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-19T05:51:38.614 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-19T05:51:38.614 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-19T05:51:38.614 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-19T05:51:38.614 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-19T05:51:38.614 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-19T05:51:38.614 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-19T05:51:38.615 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-19T05:51:38.615 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-19T05:51:38.615 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-19T05:51:38.615 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-19T05:51:38.615 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-19T05:51:38.615 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-19T05:51:38.615 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-19T05:51:38.615 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-19T05:51:38.615 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-19T05:51:38.615 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-19T05:51:38.616 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-19T05:51:38.616 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-19T05:51:38.616 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-19T05:51:38.616 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-19T05:51:38.616 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-19T05:51:38.616 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-19T05:51:38.616 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-19T05:51:38.616 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-19T05:51:38.616 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-19T05:51:38.616 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-19T05:51:38.616 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-19T05:51:38.616 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-19T05:51:38.617 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-19T05:51:38.617 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-19T05:51:38.617 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-19T05:51:38.617 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-19T05:51:38.617 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-19T05:51:38.617 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-19T05:51:38.617 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-19T05:51:38.617 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-19T05:51:38.617 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-19T05:51:38.617 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-19T05:51:38.617 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-19T05:51:38.618 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-19T05:51:38.618 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-19T05:51:38.618 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-19T05:51:38.618 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-19T05:51:38.618 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-19T05:51:38.618 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-19T05:51:38.618 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-19T05:51:38.618 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-19T05:51:38.618 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-19T05:51:38.618 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-19T05:51:38.618 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-19T05:51:38.618 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-19T05:51:38.619 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-19T05:51:38.619 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-19T05:51:38.619 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-19T05:51:38.619 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-19T05:51:38.619 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-19T05:51:38.619 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-19T05:51:38.619 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-19T05:51:38.619 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-19T05:51:38.619 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-19T05:51:38.619 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-19T05:51:38.619 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-19T05:51:38.619 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-19T05:51:38.620 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-19T05:51:38.620 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-19T05:51:38.620 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-19T05:51:38.620 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-19T05:51:38.620 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-19T05:51:38.620 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-19T05:51:38.620 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-19T05:51:38.620 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-19T05:51:38.620 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-19T05:51:38.620 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-19T05:51:38.620 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-19T05:51:38.621 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-19T05:51:38.621 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-19T05:51:38.621 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-19T05:51:38.621 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-19T05:51:38.621 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-19T05:51:38.621 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-19T05:51:38.621 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-19T05:51:38.621 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-19T05:51:38.621 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-19T05:51:38.621 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-19T05:51:38.621 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-19T05:51:38.621 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-19T05:51:38.621 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-19T05:51:38.622 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-19T05:51:38.622 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-19T05:51:38.622 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-19T05:51:38.622 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-19T05:51:38.622 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-19T05:51:38.622 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-19T05:51:38.622 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-19T05:51:38.622 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-19T05:51:38.622 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-19T05:51:38.622 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-19T05:51:38.622 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-19T05:51:38.622 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-19T05:51:38.622 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-19T05:51:38.622 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-19T05:51:38.623 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-19T05:51:38.623 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-19T05:51:38.623 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-19T05:51:38.623 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-19T05:51:38.623 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-19T05:51:38.623 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-19T05:51:38.623 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-19T05:51:38.623 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-19T05:51:38.623 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-19T05:51:38.623 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-19T05:51:38.623 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-19T05:51:38.623 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-19T05:51:38.623 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-19T05:51:38.623 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-19T05:51:38.624 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-19T05:51:38.624 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-19T05:51:38.624 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-19T05:51:38.624 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-19T05:51:38.624 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-19T05:51:38.624 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-19T05:51:38.624 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-19T05:51:38.624 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-19T05:51:38.624 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-19T05:51:38.624 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-19T05:51:38.624 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-19T05:51:38.624 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-19T05:51:38.624 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-19T05:51:38.625 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-19T05:51:38.625 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-19T05:51:38.625 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-19T05:51:38.625 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-19T05:51:38.625 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-19T05:51:38.625 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-19T05:51:38.625 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-19T05:51:38.625 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-19T05:51:38.625 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-19T05:51:38.625 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-19T05:51:38.625 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-19T05:51:38.625 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-19T05:51:38.625 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-19T05:51:38.626 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-19T05:51:38.626 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-19T05:51:38.626 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-19T05:51:38.626 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-19T05:51:38.626 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-19T05:51:38.626 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-19T05:51:38.626 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-19T05:51:38.626 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-19T05:51:38.626 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-19T05:51:38.626 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-19T05:51:38.626 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-19T05:51:38.626 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-19T05:51:38.626 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-19T05:51:38.626 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-19T05:51:38.627 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-19T05:51:38.627 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-19T05:51:38.627 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-19T05:51:38.627 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-19T05:51:38.627 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-19T05:51:38.627 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-19T05:51:38.627 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-19T05:51:38.627 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-19T05:51:38.627 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-19T05:51:38.627 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-19T05:51:38.627 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-19T05:51:38.627 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-19T05:51:38.627 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-19T05:51:38.627 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-19T05:51:38.628 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-19T05:51:38.628 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-19T05:51:38.628 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-19T05:51:38.628 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-19T05:51:38.628 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-19T05:51:38.628 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-19T05:51:38.628 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-19T05:51:38.628 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-19T05:51:38.628 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-19T05:51:38.628 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-19T05:51:38.628 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-19T05:51:38.628 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-19T05:51:38.628 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-19T05:51:38.629 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-19T05:51:38.629 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-19T05:51:38.629 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-19T05:51:38.629 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-19T05:51:38.629 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-19T05:51:38.629 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-19T05:51:38.629 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-19T05:51:38.629 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-19T05:51:38.629 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-19T05:51:38.629 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-19T05:51:38.629 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-19T05:51:38.629 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-19T05:51:38.629 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-19T05:51:38.629 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-19T05:51:38.630 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-19T05:51:38.630 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-19T05:51:38.630 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-19T05:51:38.630 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-19T05:51:38.630 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-19T05:51:38.630 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-19T05:51:38.630 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-19T05:51:38.630 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-19T05:51:38.630 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-19T05:51:38.630 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-19T05:51:38.630 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-19T05:51:38.630 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-19T05:51:38.630 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-19T05:51:38.630 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-19T05:51:38.631 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-19T05:51:38.631 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-19T05:51:38.631 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-19T05:51:38.631 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-19T05:51:38.631 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-19T05:51:38.631 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-19T05:51:38.631 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-19T05:51:38.631 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-19T05:51:38.631 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-19T05:51:38.631 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-19T05:51:38.631 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-19T05:51:38.631 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-19T05:51:38.631 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-19T05:51:38.632 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-19T05:51:38.632 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-19T05:51:38.632 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-19T05:51:38.632 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-19T05:51:38.632 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-19T05:51:38.632 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-19T05:51:38.632 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-19T05:51:38.632 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-19T05:51:38.632 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-19T05:51:38.632 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-19T05:51:38.632 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-19T05:51:38.632 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-19T05:51:38.633 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-19T05:51:38.633 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-19T05:51:38.633 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-19T05:51:38.633 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-19T05:51:38.633 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-19T05:51:38.633 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-19T05:51:38.633 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-19T05:51:38.633 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-19T05:51:38.633 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-19T05:51:38.633 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-19T05:51:38.633 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-19T05:51:38.633 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-19T05:51:38.634 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-19T05:51:38.634 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-19T05:51:38.634 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-19T05:51:38.634 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-19T05:51:38.634 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-19T05:51:38.634 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-19T05:51:38.634 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-19T05:51:38.634 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-19T05:51:38.634 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-19T05:51:38.634 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-19T05:51:38.634 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-19T05:51:38.634 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-19T05:51:38.634 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-19T05:51:38.635 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-19T05:51:38.635 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-19T05:51:38.635 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-19T05:51:38.635 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-19T05:51:38.635 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-19T05:51:38.635 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-19T05:51:38.635 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-19T05:51:38.635 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-19T05:51:38.635 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-19T05:51:38.635 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-19T05:51:38.635 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-19T05:51:38.636 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-19T05:51:38.636 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-19T05:51:38.636 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-19T05:51:38.636 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-19T05:51:38.636 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-19T05:51:38.636 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-19T05:51:38.636 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-19T05:51:38.636 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-19T05:51:38.636 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-19T05:51:38.636 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-19T05:51:38.636 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-19T05:51:38.637 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-19T05:51:38.637 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-19T05:51:38.637 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-19T05:51:38.637 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-19T05:51:38.637 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-19T05:51:38.637 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-19T05:51:38.637 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-19T05:51:38.637 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-19T05:51:38.637 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-19T05:51:38.637 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-19T05:51:38.637 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-19T05:51:38.637 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-19T05:51:38.638 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-19T05:51:38.638 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-19T05:51:38.638 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-19T05:51:38.638 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-19T05:51:38.638 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-19T05:51:38.638 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-19T05:51:38.638 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-19T05:51:38.638 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-19T05:51:38.638 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-19T05:51:38.638 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-19T05:51:38.638 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-19T05:51:38.639 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-19T05:51:38.639 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-19T05:51:38.639 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-19T05:51:38.639 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-19T05:51:38.639 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-19T05:51:38.639 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-19T05:51:38.639 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-19T05:51:38.639 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-19T05:51:38.639 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-19T05:51:38.639 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-19T05:51:38.639 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-19T05:51:38.640 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-19T05:51:38.640 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-19T05:51:38.640 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-19T05:51:38.640 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-19T05:51:38.640 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-19T05:51:38.640 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-19T05:51:38.640 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-19T05:51:38.640 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-19T05:51:38.640 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-19T05:51:38.640 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-19T05:51:38.640 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-19T05:51:38.640 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-19T05:51:38.641 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-19T05:51:38.641 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-19T05:51:38.641 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-19T05:51:38.641 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-19T05:51:38.641 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-19T05:51:38.641 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-19T05:51:38.641 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-19T05:51:38.641 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-19T05:51:38.641 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-19T05:51:38.641 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-19T05:51:38.642 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-19T05:51:38.642 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-19T05:51:38.642 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-19T05:51:38.642 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-19T05:51:38.642 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-19T05:51:38.642 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-19T05:51:38.642 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-19T05:51:38.642 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-19T05:51:38.642 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-19T05:51:38.642 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-19T05:51:38.642 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-19T05:51:38.642 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-19T05:51:38.643 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-19T05:51:38.643 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-19T05:51:38.643 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-19T05:51:38.643 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-19T05:51:38.643 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-19T05:51:38.643 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-19T05:51:38.643 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-19T05:51:38.643 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-19T05:51:38.643 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-19T05:51:38.643 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-19T05:51:38.643 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-19T05:51:38.644 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-19T05:51:38.644 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-19T05:51:38.644 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-19T05:51:38.644 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-19T05:51:38.644 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-19T05:51:38.644 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-19T05:51:38.644 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-19T05:51:38.644 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-19T05:51:38.644 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-19T05:51:38.644 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-19T05:51:38.644 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-19T05:51:38.645 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-19T05:51:38.645 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-19T05:51:38.645 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-19T05:51:38.645 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-19T05:51:38.645 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-19T05:51:38.645 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-19T05:51:38.645 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-19T05:51:38.645 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-19T05:51:38.645 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-19T05:51:38.645 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-19T05:51:38.645 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-19T05:51:38.646 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-19T05:51:38.646 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-19T05:51:38.646 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-19T05:51:38.646 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-19T05:51:38.646 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-19T05:51:38.646 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-19T05:51:38.646 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-19T05:51:38.646 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-19T05:51:38.646 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-19T05:51:38.646 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-19T05:51:38.646 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-19T05:51:38.646 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-19T05:51:38.647 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-19T05:51:38.647 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-19T05:51:38.647 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-19T05:51:38.647 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-19T05:51:38.647 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-19T05:51:38.647 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-19T05:51:38.647 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-19T05:51:38.647 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-19T05:51:38.647 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-19T05:51:38.647 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-19T05:51:38.648 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-19T05:51:38.648 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-19T05:51:38.648 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-19T05:51:38.648 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-19T05:51:38.648 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-19T05:51:38.648 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-19T05:51:38.648 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-19T05:51:38.648 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-19T05:51:38.648 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-19T05:51:38.648 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-19T05:51:38.648 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-19T05:51:38.649 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-19T05:51:38.649 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-19T05:51:38.649 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-19T05:51:38.649 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-19T05:51:38.649 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-19T05:51:38.649 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-19T05:51:38.649 INFO:teuthology.orchestra.run.smithi003.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-19T05:51:38.653 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-19T05:51:38.653 DEBUG:teuthology.orchestra.run.smithi003:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-19T05:51:38.678 INFO:teuthology.orchestra.run.smithi003.stdout:postinstall scriptlet (using /bin/sh): 2024-09-19T05:51:38.678 INFO:teuthology.orchestra.run.smithi003.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-19T05:51:38.678 INFO:teuthology.orchestra.run.smithi003.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-19T05:51:38.679 INFO:teuthology.orchestra.run.smithi003.stdout:fi 2024-09-19T05:51:38.679 INFO:teuthology.orchestra.run.smithi003.stdout:for file in vmlinuz System.map config; do 2024-09-19T05:51:38.679 INFO:teuthology.orchestra.run.smithi003.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-19T05:51:38.679 INFO:teuthology.orchestra.run.smithi003.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-19T05:51:38.679 INFO:teuthology.orchestra.run.smithi003.stdout: fi 2024-09-19T05:51:38.679 INFO:teuthology.orchestra.run.smithi003.stdout:done 2024-09-19T05:51:38.679 INFO:teuthology.orchestra.run.smithi003.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-19T05:51:38.679 INFO:teuthology.orchestra.run.smithi003.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-19T05:51:38.679 INFO:teuthology.orchestra.run.smithi003.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-19T05:51:38.679 INFO:teuthology.orchestra.run.smithi003.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-19T05:51:38.679 INFO:teuthology.orchestra.run.smithi003.stdout:fi 2024-09-19T05:51:38.680 INFO:teuthology.orchestra.run.smithi003.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-19T05:51:38.680 INFO:teuthology.orchestra.run.smithi003.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-19T05:51:38.680 INFO:teuthology.orchestra.run.smithi003.stdout:fi 2024-09-19T05:51:38.680 INFO:teuthology.orchestra.run.smithi003.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-19T05:51:38.680 INFO:teuthology.orchestra.run.smithi003.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-19T05:51:38.680 INFO:teuthology.orchestra.run.smithi003.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-19T05:51:38.680 INFO:teuthology.orchestra.run.smithi003.stdout:fi 2024-09-19T05:51:38.681 DEBUG:teuthology.orchestra.run.smithi003:> sudo rpm -qi grub2-tools 2024-09-19T05:51:38.757 INFO:teuthology.orchestra.run.smithi003.stdout:Name : grub2-tools 2024-09-19T05:51:38.757 INFO:teuthology.orchestra.run.smithi003.stdout:Epoch : 1 2024-09-19T05:51:38.758 INFO:teuthology.orchestra.run.smithi003.stdout:Version : 2.06 2024-09-19T05:51:38.758 INFO:teuthology.orchestra.run.smithi003.stdout:Release : 82.el9 2024-09-19T05:51:38.758 INFO:teuthology.orchestra.run.smithi003.stdout:Architecture: x86_64 2024-09-19T05:51:38.758 INFO:teuthology.orchestra.run.smithi003.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T05:51:38.758 INFO:teuthology.orchestra.run.smithi003.stdout:Group : Unspecified 2024-09-19T05:51:38.758 INFO:teuthology.orchestra.run.smithi003.stdout:Size : 8274670 2024-09-19T05:51:38.758 INFO:teuthology.orchestra.run.smithi003.stdout:License : GPLv3+ 2024-09-19T05:51:38.758 INFO:teuthology.orchestra.run.smithi003.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T05:51:38.758 INFO:teuthology.orchestra.run.smithi003.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T05:51:38.758 INFO:teuthology.orchestra.run.smithi003.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T05:51:38.759 INFO:teuthology.orchestra.run.smithi003.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T05:51:38.759 INFO:teuthology.orchestra.run.smithi003.stdout:Packager : builder@centos.org 2024-09-19T05:51:38.759 INFO:teuthology.orchestra.run.smithi003.stdout:Vendor : CentOS 2024-09-19T05:51:38.759 INFO:teuthology.orchestra.run.smithi003.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T05:51:38.759 INFO:teuthology.orchestra.run.smithi003.stdout:Summary : Support tools for GRUB. 2024-09-19T05:51:38.759 INFO:teuthology.orchestra.run.smithi003.stdout:Description : 2024-09-19T05:51:38.759 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T05:51:38.759 INFO:teuthology.orchestra.run.smithi003.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T05:51:38.759 INFO:teuthology.orchestra.run.smithi003.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T05:51:38.759 INFO:teuthology.orchestra.run.smithi003.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T05:51:38.759 INFO:teuthology.orchestra.run.smithi003.stdout:hardware devices. 2024-09-19T05:51:38.759 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T05:51:38.759 INFO:teuthology.orchestra.run.smithi003.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T05:51:38.761 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T05:51:38.761 INFO:teuthology.task.kernel:Updating grub on smithi003 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-19T05:51:38.761 DEBUG:teuthology.orchestra.run.smithi003:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T05:51:39.395 INFO:teuthology.orchestra.run.smithi003.stderr:Generating grub configuration file ... 2024-09-19T05:51:40.716 INFO:teuthology.orchestra.run.smithi003.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T05:51:40.747 INFO:teuthology.orchestra.run.smithi003.stderr:done 2024-09-19T05:51:40.749 DEBUG:teuthology.orchestra.run.smithi003:> mktemp 2024-09-19T05:51:40.782 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.QLSs1YtbUO 2024-09-19T05:51:40.782 DEBUG:teuthology.orchestra.run.smithi003:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QLSs1YtbUO 2024-09-19T05:51:40.848 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.QLSs1YtbUO 2024-09-19T05:51:40.993 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.QLSs1YtbUO is 6KB 2024-09-19T05:51:41.043 DEBUG:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.QLSs1YtbUO 2024-09-19T05:51:41.060 DEBUG:teuthology.orchestra.run.smithi003:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T05:51:41.121 INFO:teuthology.orchestra.run.smithi003.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T05:51:41.121 INFO:teuthology.orchestra.run.smithi003.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T05:51:41.121 INFO:teuthology.orchestra.run.smithi003.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T05:51:41.121 INFO:teuthology.orchestra.run.smithi003.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-19T05:51:41.123 DEBUG:teuthology.orchestra.run.smithi003:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-19T05:51:41.277 DEBUG:teuthology.orchestra.run.smithi003:> sudo shutdown -r now 2024-09-19T05:52:11.279 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-19T05:52:11.280 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-09-19T05:52:11.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:52:29.757 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-09-19T05:52:38.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-09-19T05:52:38.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:53:38.761 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T05:53:50.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-09-19T05:53:50.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:53:51.124 DEBUG:teuthology.orchestra.run.smithi003:> true 2024-09-19T05:53:51.617 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-09-19T05:53:51.617 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-19T05:53:51.617 DEBUG:teuthology.orchestra.run.smithi003:> uname -r 2024-09-19T05:53:51.651 INFO:teuthology.orchestra.run.smithi003.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-19T05:53:51.651 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-19T05:53:51.652 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T05:53:51.652 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T05:53:52.652 DEBUG:teuthology.parallel:result is None 2024-09-19T05:53:52.653 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T05:53:52.665 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T05:53:52.665 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T05:53:52.669 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T05:53:52.672 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T05:53:52.703 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T05:53:52.713 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T05:53:52.727 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T05:53:52.727 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T05:53:52.748 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T05:53:52.750 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T05:53:52.866 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T05:53:52.878 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T05:53:52.878 DEBUG:teuthology.orchestra.run.smithi059:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T05:53:52.895 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:53:52.896 DEBUG:teuthology.orchestra.run.smithi071:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T05:53:52.913 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:53:52.913 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T05:53:52.918 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T05:53:52.939 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T05:53:52.990 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:53:53.005 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:53:53.009 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:53:53.028 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:53:53.039 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:53:53.049 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:53:53.051 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T05:53:53.059 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T05:53:53.059 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T05:53:53.063 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T05:53:53.066 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T05:53:53.117 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T05:53:53.129 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T05:53:53.129 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T05:53:53.133 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T05:53:53.136 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T05:53:53.164 DEBUG:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:53:53.267 DEBUG:teuthology.orchestra.run.smithi003:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:53:53.349 DEBUG:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:53:53.412 DEBUG:teuthology.orchestra.run.smithi003:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:53:53.482 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-19T05:53:53.483 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T05:53:53.538 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:53:53.584 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:53:53.640 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:53:53.728 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:53:53.770 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-19T05:53:53.771 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T05:53:53.839 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:53:53.885 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:53:53.942 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:53:54.025 DEBUG:teuthology.orchestra.run.smithi071:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:53:54.070 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-19T05:53:54.070 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T05:53:54.137 DEBUG:teuthology.orchestra.run.smithi003:> sudo service rsyslog restart 2024-09-19T05:53:54.141 DEBUG:teuthology.orchestra.run.smithi059:> sudo service rsyslog restart 2024-09-19T05:53:54.146 DEBUG:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2024-09-19T05:53:54.186 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:53:54.218 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:53:54.220 INFO:teuthology.orchestra.run.smithi003.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:53:54.650 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T05:53:54.657 INFO:teuthology.task.internal:Starting timer... 2024-09-19T05:53:54.657 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T05:53:54.680 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T05:53:54.693 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T05:53:54.694 DEBUG:teuthology.orchestra.run.smithi003:> sudo service auditd rotate 2024-09-19T05:53:54.782 INFO:teuthology.orchestra.run.smithi003.stdout:Rotating logs: 2024-09-19T05:53:54.785 DEBUG:teuthology.orchestra.run.smithi059:> sudo service auditd rotate 2024-09-19T05:53:54.848 INFO:teuthology.orchestra.run.smithi059.stdout:Rotating logs: 2024-09-19T05:53:54.851 DEBUG:teuthology.orchestra.run.smithi071:> sudo service auditd rotate 2024-09-19T05:53:54.903 INFO:teuthology.orchestra.run.smithi071.stdout:Rotating logs: 2024-09-19T05:53:54.905 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T05:53:54.905 DEBUG:teuthology.orchestra.run.smithi003:> /usr/sbin/getenforce 2024-09-19T05:53:54.953 INFO:teuthology.orchestra.run.smithi003.stdout:Permissive 2024-09-19T05:53:54.954 DEBUG:teuthology.orchestra.run.smithi059:> /usr/sbin/getenforce 2024-09-19T05:53:54.977 INFO:teuthology.orchestra.run.smithi059.stdout:Permissive 2024-09-19T05:53:54.977 DEBUG:teuthology.orchestra.run.smithi071:> /usr/sbin/getenforce 2024-09-19T05:53:54.999 INFO:teuthology.orchestra.run.smithi071.stdout:Permissive 2024-09-19T05:53:54.999 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi003.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi059.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi071.front.sepia.ceph.com': 'permissive'} 2024-09-19T05:53:54.999 DEBUG:teuthology.orchestra.run.smithi003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:53:55.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:53:55.057 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:53:55.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:53:55.085 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:53:55.114 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:53:55.115 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T05:53:55.115 DEBUG:teuthology.orchestra.run.smithi003:> sudo /usr/sbin/setenforce permissive 2024-09-19T05:53:55.192 DEBUG:teuthology.orchestra.run.smithi059:> sudo /usr/sbin/setenforce permissive 2024-09-19T05:53:55.228 DEBUG:teuthology.orchestra.run.smithi071:> sudo /usr/sbin/setenforce permissive 2024-09-19T05:53:55.261 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T05:53:55.274 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T05:53:55.285 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T05:53:55.286 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi003.front.sepia.ceph.com,smithi059.front.sepia.ceph.com,smithi071.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T05:58:34.542 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi003.front.sepia.ceph.com'), Remote(name='ubuntu@smithi059.front.sepia.ceph.com'), Remote(name='ubuntu@smithi071.front.sepia.ceph.com')] 2024-09-19T05:58:34.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-09-19T05:58:34.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:58:34.633 DEBUG:teuthology.orchestra.run.smithi003:> true 2024-09-19T05:58:34.750 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-09-19T05:58:34.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-19T05:58:34.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:58:34.826 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-09-19T05:58:34.909 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-09-19T05:58:34.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-19T05:58:34.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:58:34.983 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-09-19T05:58:35.060 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-09-19T05:58:35.060 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T05:58:35.073 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T05:58:35.073 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T05:58:35.074 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:58:35.078 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T05:58:35.078 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:58:35.080 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T05:58:35.080 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:58:35.109 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T05:58:35.124 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T05:58:35.129 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T05:58:35.137 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T05:58:35.143 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T05:58:35.149 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: ntpd: command not found 2024-09-19T05:58:35.161 INFO:teuthology.orchestra.run.smithi059.stdout:506 Cannot talk to daemon 2024-09-19T05:58:35.167 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: ntpd: command not found 2024-09-19T05:58:35.168 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T05:58:35.175 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T05:58:35.178 INFO:teuthology.orchestra.run.smithi071.stdout:506 Cannot talk to daemon 2024-09-19T05:58:35.189 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T05:58:35.192 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T05:58:35.206 INFO:teuthology.orchestra.run.smithi071.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T05:58:35.219 INFO:teuthology.orchestra.run.smithi003.stderr:sudo: ntpd: command not found 2024-09-19T05:58:35.243 INFO:teuthology.orchestra.run.smithi003.stdout:506 Cannot talk to daemon 2024-09-19T05:58:35.244 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:58:35.248 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:58:35.248 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2024-09-19T05:58:35.248 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:58:35.248 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:58:35.248 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:58:35.249 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:58:35.267 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:58:35.270 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:58:35.271 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-09-19T05:58:35.271 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:58:35.271 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:58:35.271 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:58:35.271 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:58:35.272 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T05:58:35.302 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T05:58:35.395 INFO:teuthology.orchestra.run.smithi003.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:58:35.402 INFO:teuthology.orchestra.run.smithi003.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:58:35.402 INFO:teuthology.orchestra.run.smithi003.stdout:=============================================================================== 2024-09-19T05:58:35.402 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:58:35.402 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:58:35.402 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:58:35.402 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:58:35.403 INFO:teuthology.run_tasks:Running task install... 2024-09-19T05:58:35.411 DEBUG:teuthology.task.install:project ceph 2024-09-19T05:58:35.411 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T05:58:35.411 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T05:58:35.411 INFO:teuthology.task.install:Using flavor: default 2024-09-19T05:58:35.417 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T05:58:35.417 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T05:58:35.417 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T05:58:35.418 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:58:35.420 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T05:58:35.420 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:58:35.421 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T05:58:35.421 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:58:35.564 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T05:58:35.564 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T05:58:35.571 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T05:58:35.571 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T05:58:35.574 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T05:58:35.575 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T05:58:35.673 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T05:58:35.673 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-19T05:58:35.673 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T05:58:35.685 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T05:58:35.685 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-19T05:58:35.685 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T05:58:35.690 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T05:58:35.690 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-19T05:58:35.690 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T05:58:35.711 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T05:58:35.711 DEBUG:teuthology.orchestra.run.smithi071:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T05:58:35.716 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T05:58:35.716 DEBUG:teuthology.orchestra.run.smithi059:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T05:58:35.731 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T05:58:35.731 DEBUG:teuthology.orchestra.run.smithi003:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T05:58:35.777 DEBUG:teuthology.orchestra.run.smithi071:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T05:58:35.782 DEBUG:teuthology.orchestra.run.smithi059:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T05:58:35.829 DEBUG:teuthology.orchestra.run.smithi003:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T05:58:35.852 DEBUG:teuthology.orchestra.run.smithi071:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T05:58:35.857 DEBUG:teuthology.orchestra.run.smithi059:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T05:58:35.908 DEBUG:teuthology.orchestra.run.smithi003:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T05:58:35.916 INFO:teuthology.orchestra.run.smithi071.stdout:check_obsoletes = 1 2024-09-19T05:58:35.918 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum clean all 2024-09-19T05:58:35.921 INFO:teuthology.orchestra.run.smithi059.stdout:check_obsoletes = 1 2024-09-19T05:58:35.923 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum clean all 2024-09-19T05:58:35.964 INFO:teuthology.orchestra.run.smithi003.stdout:check_obsoletes = 1 2024-09-19T05:58:35.967 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum clean all 2024-09-19T05:58:36.142 INFO:teuthology.orchestra.run.smithi071.stdout:45 files removed 2024-09-19T05:58:36.155 INFO:teuthology.orchestra.run.smithi059.stdout:45 files removed 2024-09-19T05:58:36.169 DEBUG:teuthology.orchestra.run.smithi071:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T05:58:36.182 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T05:58:36.253 INFO:teuthology.orchestra.run.smithi003.stdout:45 files removed 2024-09-19T05:58:36.286 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T05:58:36.708 INFO:teuthology.orchestra.run.smithi071.stdout:ceph packages for x86_64 316 kB/s | 84 kB 00:00 2024-09-19T05:58:36.737 INFO:teuthology.orchestra.run.smithi059.stdout:ceph packages for x86_64 308 kB/s | 84 kB 00:00 2024-09-19T05:58:36.984 INFO:teuthology.orchestra.run.smithi003.stdout:ceph packages for x86_64 288 kB/s | 84 kB 00:00 2024-09-19T05:58:36.991 INFO:teuthology.orchestra.run.smithi071.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T05:58:37.030 INFO:teuthology.orchestra.run.smithi059.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-19T05:58:37.267 INFO:teuthology.orchestra.run.smithi071.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-19T05:58:37.284 INFO:teuthology.orchestra.run.smithi003.stdout:ceph noarch packages 46 kB/s | 12 kB 00:00 2024-09-19T05:58:37.305 INFO:teuthology.orchestra.run.smithi059.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T05:58:37.568 INFO:teuthology.orchestra.run.smithi003.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-19T05:58:37.936 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.3 MB 00:00 2024-09-19T05:58:38.189 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - BaseOS 9.7 MB/s | 8.3 MB 00:00 2024-09-19T05:58:38.291 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.3 MB 00:00 2024-09-19T05:58:39.893 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-19T05:58:40.103 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-19T05:58:40.123 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-19T05:58:44.524 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-19T05:58:44.954 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-19T05:58:45.301 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-19T05:58:45.991 INFO:teuthology.orchestra.run.smithi059.stdout:CentOS Stream 9 - Extras packages 91 kB/s | 19 kB 00:00 2024-09-19T05:58:46.521 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - Extras packages 102 kB/s | 19 kB 00:00 2024-09-19T05:58:46.828 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-19T05:58:47.127 INFO:teuthology.orchestra.run.smithi071.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 19 kB 00:00 2024-09-19T05:58:47.459 INFO:teuthology.orchestra.run.smithi003.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-19T05:58:48.081 INFO:teuthology.orchestra.run.smithi071.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-19T05:58:52.526 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-19T05:58:53.537 INFO:teuthology.orchestra.run.smithi071.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-19T05:58:54.014 INFO:teuthology.orchestra.run.smithi003.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-19T05:58:54.745 INFO:teuthology.orchestra.run.smithi059.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:58:54.746 INFO:teuthology.orchestra.run.smithi059.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:58:54.758 INFO:teuthology.orchestra.run.smithi059.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T05:58:54.758 INFO:teuthology.orchestra.run.smithi059.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T05:58:54.759 INFO:teuthology.orchestra.run.smithi059.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T05:58:54.760 INFO:teuthology.orchestra.run.smithi059.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T05:58:54.762 INFO:teuthology.orchestra.run.smithi059.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T05:58:54.764 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T05:58:54.765 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T05:58:54.832 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2024-09-19T05:58:54.851 INFO:teuthology.orchestra.run.smithi059.stdout:====================================================================================== 2024-09-19T05:58:54.851 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2024-09-19T05:58:54.852 INFO:teuthology.orchestra.run.smithi059.stdout:====================================================================================== 2024-09-19T05:58:54.852 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2024-09-19T05:58:54.852 INFO:teuthology.orchestra.run.smithi059.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T05:58:54.852 INFO:teuthology.orchestra.run.smithi059.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T05:58:54.852 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T05:58:54.852 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T05:58:54.852 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T05:58:54.852 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T05:58:54.852 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T05:58:54.852 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T05:58:54.852 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T05:58:54.853 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T05:58:54.853 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T05:58:54.853 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T05:58:54.853 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T05:58:54.853 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T05:58:54.853 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T05:58:54.853 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T05:58:54.853 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T05:58:54.853 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T05:58:54.853 INFO:teuthology.orchestra.run.smithi059.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T05:58:54.853 INFO:teuthology.orchestra.run.smithi059.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T05:58:54.853 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T05:58:54.854 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T05:58:54.854 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T05:58:54.854 INFO:teuthology.orchestra.run.smithi059.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T05:58:54.854 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T05:58:54.854 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T05:58:54.854 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T05:58:54.854 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T05:58:54.854 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T05:58:54.854 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T05:58:54.854 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T05:58:54.854 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T05:58:54.854 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T05:58:54.854 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T05:58:54.855 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T05:58:54.855 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T05:58:54.855 INFO:teuthology.orchestra.run.smithi059.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T05:58:54.855 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrading: 2024-09-19T05:58:54.855 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T05:58:54.855 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T05:58:54.855 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T05:58:54.855 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T05:58:54.855 INFO:teuthology.orchestra.run.smithi059.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T05:58:54.855 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T05:58:54.855 INFO:teuthology.orchestra.run.smithi059.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T05:58:54.855 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T05:58:54.855 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2024-09-19T05:58:54.856 INFO:teuthology.orchestra.run.smithi059.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T05:58:54.856 INFO:teuthology.orchestra.run.smithi059.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T05:58:54.856 INFO:teuthology.orchestra.run.smithi059.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T05:58:54.856 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T05:58:54.856 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T05:58:54.856 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T05:58:54.856 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T05:58:54.856 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T05:58:54.856 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T05:58:54.856 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T05:58:54.856 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T05:58:54.856 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T05:58:54.856 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T05:58:54.857 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T05:58:54.857 INFO:teuthology.orchestra.run.smithi059.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T05:58:54.857 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T05:58:54.857 INFO:teuthology.orchestra.run.smithi059.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T05:58:54.857 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T05:58:54.857 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T05:58:54.857 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T05:58:54.857 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T05:58:54.857 INFO:teuthology.orchestra.run.smithi059.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T05:58:54.858 INFO:teuthology.orchestra.run.smithi059.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T05:58:54.858 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T05:58:54.858 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T05:58:54.858 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T05:58:54.858 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T05:58:54.858 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T05:58:54.858 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T05:58:54.858 INFO:teuthology.orchestra.run.smithi059.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T05:58:54.858 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T05:58:54.858 INFO:teuthology.orchestra.run.smithi059.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T05:58:54.859 INFO:teuthology.orchestra.run.smithi059.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T05:58:54.859 INFO:teuthology.orchestra.run.smithi059.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T05:58:54.859 INFO:teuthology.orchestra.run.smithi059.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T05:58:54.859 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T05:58:54.859 INFO:teuthology.orchestra.run.smithi059.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T05:58:54.859 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T05:58:54.859 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T05:58:54.859 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T05:58:54.859 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T05:58:54.859 INFO:teuthology.orchestra.run.smithi059.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T05:58:54.859 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T05:58:54.859 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T05:58:54.859 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T05:58:54.860 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T05:58:54.860 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T05:58:54.860 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T05:58:54.860 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T05:58:54.860 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T05:58:54.860 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T05:58:54.860 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T05:58:54.860 INFO:teuthology.orchestra.run.smithi059.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T05:58:54.860 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T05:58:54.860 INFO:teuthology.orchestra.run.smithi059.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T05:58:54.861 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T05:58:54.861 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T05:58:54.861 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T05:58:54.861 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T05:58:54.861 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T05:58:54.861 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T05:58:54.861 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T05:58:54.861 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T05:58:54.861 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T05:58:54.861 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T05:58:54.861 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T05:58:54.861 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T05:58:54.861 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T05:58:54.862 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T05:58:54.862 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T05:58:54.862 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T05:58:54.862 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T05:58:54.862 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T05:58:54.862 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T05:58:54.862 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T05:58:54.862 INFO:teuthology.orchestra.run.smithi059.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T05:58:54.862 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T05:58:54.862 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T05:58:54.862 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T05:58:54.862 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T05:58:54.863 INFO:teuthology.orchestra.run.smithi059.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T05:58:54.863 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T05:58:54.863 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T05:58:54.863 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T05:58:54.863 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T05:58:54.863 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T05:58:54.863 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T05:58:54.863 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T05:58:54.863 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T05:58:54.863 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T05:58:54.863 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T05:58:54.863 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T05:58:54.863 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T05:58:54.864 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T05:58:54.864 INFO:teuthology.orchestra.run.smithi059.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T05:58:54.864 INFO:teuthology.orchestra.run.smithi059.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T05:58:54.864 INFO:teuthology.orchestra.run.smithi059.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T05:58:54.864 INFO:teuthology.orchestra.run.smithi059.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T05:58:54.864 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T05:58:54.864 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T05:58:54.864 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T05:58:54.864 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T05:58:54.864 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T05:58:54.864 INFO:teuthology.orchestra.run.smithi059.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T05:58:54.864 INFO:teuthology.orchestra.run.smithi059.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T05:58:54.864 INFO:teuthology.orchestra.run.smithi059.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T05:58:54.865 INFO:teuthology.orchestra.run.smithi059.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T05:58:54.865 INFO:teuthology.orchestra.run.smithi059.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T05:58:54.865 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T05:58:54.865 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T05:58:54.865 INFO:teuthology.orchestra.run.smithi059.stdout:Installing weak dependencies: 2024-09-19T05:58:54.865 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T05:58:54.865 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-19T05:58:54.865 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2024-09-19T05:58:54.865 INFO:teuthology.orchestra.run.smithi059.stdout:====================================================================================== 2024-09-19T05:58:54.865 INFO:teuthology.orchestra.run.smithi059.stdout:Install 148 Packages 2024-09-19T05:58:54.865 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrade 8 Packages 2024-09-19T05:58:54.865 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-19T05:58:54.866 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 226 M 2024-09-19T05:58:54.866 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2024-09-19T05:58:55.654 INFO:teuthology.orchestra.run.smithi071.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:58:55.655 INFO:teuthology.orchestra.run.smithi071.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:58:55.666 INFO:teuthology.orchestra.run.smithi071.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T05:58:55.667 INFO:teuthology.orchestra.run.smithi071.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T05:58:55.668 INFO:teuthology.orchestra.run.smithi071.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T05:58:55.669 INFO:teuthology.orchestra.run.smithi071.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T05:58:55.670 INFO:teuthology.orchestra.run.smithi071.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T05:58:55.673 INFO:teuthology.orchestra.run.smithi071.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T05:58:55.673 INFO:teuthology.orchestra.run.smithi071.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T05:58:55.736 INFO:teuthology.orchestra.run.smithi071.stdout:Dependencies resolved. 2024-09-19T05:58:55.758 INFO:teuthology.orchestra.run.smithi071.stdout:====================================================================================== 2024-09-19T05:58:55.758 INFO:teuthology.orchestra.run.smithi071.stdout: Package Arch Version Repository Size 2024-09-19T05:58:55.758 INFO:teuthology.orchestra.run.smithi071.stdout:====================================================================================== 2024-09-19T05:58:55.758 INFO:teuthology.orchestra.run.smithi071.stdout:Installing: 2024-09-19T05:58:55.758 INFO:teuthology.orchestra.run.smithi071.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T05:58:55.758 INFO:teuthology.orchestra.run.smithi071.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T05:58:55.758 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T05:58:55.758 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T05:58:55.758 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T05:58:55.759 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T05:58:55.759 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T05:58:55.759 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T05:58:55.759 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T05:58:55.759 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T05:58:55.759 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T05:58:55.759 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T05:58:55.759 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T05:58:55.759 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T05:58:55.759 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T05:58:55.759 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T05:58:55.759 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T05:58:55.759 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T05:58:55.760 INFO:teuthology.orchestra.run.smithi071.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T05:58:55.760 INFO:teuthology.orchestra.run.smithi071.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T05:58:55.760 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T05:58:55.760 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T05:58:55.760 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T05:58:55.760 INFO:teuthology.orchestra.run.smithi071.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T05:58:55.760 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T05:58:55.760 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T05:58:55.760 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T05:58:55.760 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T05:58:55.760 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T05:58:55.760 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T05:58:55.760 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T05:58:55.761 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T05:58:55.761 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T05:58:55.761 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T05:58:55.761 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T05:58:55.761 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T05:58:55.761 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T05:58:55.761 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrading: 2024-09-19T05:58:55.761 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T05:58:55.761 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T05:58:55.761 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T05:58:55.761 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T05:58:55.761 INFO:teuthology.orchestra.run.smithi071.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T05:58:55.762 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T05:58:55.762 INFO:teuthology.orchestra.run.smithi071.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T05:58:55.762 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T05:58:55.762 INFO:teuthology.orchestra.run.smithi071.stdout:Installing dependencies: 2024-09-19T05:58:55.762 INFO:teuthology.orchestra.run.smithi071.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T05:58:55.762 INFO:teuthology.orchestra.run.smithi071.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T05:58:55.762 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T05:58:55.762 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T05:58:55.762 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T05:58:55.762 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T05:58:55.762 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T05:58:55.762 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T05:58:55.762 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T05:58:55.763 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T05:58:55.763 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T05:58:55.763 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T05:58:55.763 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T05:58:55.763 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T05:58:55.763 INFO:teuthology.orchestra.run.smithi071.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T05:58:55.763 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T05:58:55.763 INFO:teuthology.orchestra.run.smithi071.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T05:58:55.763 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T05:58:55.763 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T05:58:55.763 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T05:58:55.763 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T05:58:55.764 INFO:teuthology.orchestra.run.smithi071.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T05:58:55.764 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T05:58:55.764 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T05:58:55.764 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T05:58:55.764 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T05:58:55.764 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T05:58:55.764 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T05:58:55.764 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T05:58:55.764 INFO:teuthology.orchestra.run.smithi071.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T05:58:55.764 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T05:58:55.764 INFO:teuthology.orchestra.run.smithi071.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T05:58:55.765 INFO:teuthology.orchestra.run.smithi071.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T05:58:55.765 INFO:teuthology.orchestra.run.smithi071.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T05:58:55.765 INFO:teuthology.orchestra.run.smithi071.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T05:58:55.765 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T05:58:55.765 INFO:teuthology.orchestra.run.smithi071.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T05:58:55.765 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T05:58:55.765 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T05:58:55.765 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T05:58:55.765 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T05:58:55.765 INFO:teuthology.orchestra.run.smithi071.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T05:58:55.765 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T05:58:55.766 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T05:58:55.766 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T05:58:55.766 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T05:58:55.766 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T05:58:55.766 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T05:58:55.766 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T05:58:55.766 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T05:58:55.766 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T05:58:55.766 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T05:58:55.766 INFO:teuthology.orchestra.run.smithi071.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T05:58:55.766 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T05:58:55.766 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T05:58:55.766 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T05:58:55.766 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T05:58:55.767 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T05:58:55.767 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T05:58:55.767 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T05:58:55.767 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T05:58:55.767 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T05:58:55.767 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T05:58:55.767 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T05:58:55.767 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T05:58:55.767 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T05:58:55.767 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T05:58:55.767 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T05:58:55.767 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T05:58:55.767 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T05:58:55.768 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T05:58:55.768 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T05:58:55.768 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T05:58:55.768 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T05:58:55.768 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T05:58:55.768 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T05:58:55.768 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T05:58:55.768 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T05:58:55.768 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T05:58:55.768 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T05:58:55.768 INFO:teuthology.orchestra.run.smithi071.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T05:58:55.768 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T05:58:55.769 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T05:58:55.769 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T05:58:55.769 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T05:58:55.769 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T05:58:55.769 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T05:58:55.769 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T05:58:55.769 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T05:58:55.769 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T05:58:55.769 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T05:58:55.769 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T05:58:55.769 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T05:58:55.769 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T05:58:55.770 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T05:58:55.770 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T05:58:55.770 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T05:58:55.770 INFO:teuthology.orchestra.run.smithi071.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T05:58:55.770 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T05:58:55.770 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T05:58:55.770 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T05:58:55.770 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T05:58:55.770 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T05:58:55.770 INFO:teuthology.orchestra.run.smithi071.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T05:58:55.770 INFO:teuthology.orchestra.run.smithi071.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T05:58:55.770 INFO:teuthology.orchestra.run.smithi071.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T05:58:55.770 INFO:teuthology.orchestra.run.smithi071.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T05:58:55.771 INFO:teuthology.orchestra.run.smithi071.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T05:58:55.771 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T05:58:55.771 INFO:teuthology.orchestra.run.smithi071.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T05:58:55.771 INFO:teuthology.orchestra.run.smithi071.stdout:Installing weak dependencies: 2024-09-19T05:58:55.771 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T05:58:55.771 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-19T05:58:55.771 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction Summary 2024-09-19T05:58:55.771 INFO:teuthology.orchestra.run.smithi071.stdout:====================================================================================== 2024-09-19T05:58:55.771 INFO:teuthology.orchestra.run.smithi071.stdout:Install 148 Packages 2024-09-19T05:58:55.771 INFO:teuthology.orchestra.run.smithi071.stdout:Upgrade 8 Packages 2024-09-19T05:58:55.771 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-19T05:58:55.772 INFO:teuthology.orchestra.run.smithi071.stdout:Total download size: 226 M 2024-09-19T05:58:55.772 INFO:teuthology.orchestra.run.smithi071.stdout:Downloading Packages: 2024-09-19T05:58:55.811 INFO:teuthology.orchestra.run.smithi059.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 54 kB/s | 6.6 kB 00:00 2024-09-19T05:58:55.986 INFO:teuthology.orchestra.run.smithi059.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 5.0 MB/s | 896 kB 00:00 2024-09-19T05:58:56.078 INFO:teuthology.orchestra.run.smithi059.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.6 MB/s | 145 kB 00:00 2024-09-19T05:58:56.178 INFO:teuthology.orchestra.run.smithi059.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-19T05:58:56.321 INFO:teuthology.orchestra.run.smithi059.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 9.9 MB/s | 2.4 MB 00:00 2024-09-19T05:58:56.354 INFO:teuthology.orchestra.run.smithi059.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 8.7 MB/s | 1.5 MB 00:00 2024-09-19T05:58:56.486 INFO:teuthology.orchestra.run.smithi003.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:58:56.486 INFO:teuthology.orchestra.run.smithi003.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:58:56.499 INFO:teuthology.orchestra.run.smithi003.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T05:58:56.500 INFO:teuthology.orchestra.run.smithi003.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T05:58:56.501 INFO:teuthology.orchestra.run.smithi003.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T05:58:56.501 INFO:teuthology.orchestra.run.smithi003.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T05:58:56.503 INFO:teuthology.orchestra.run.smithi003.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T05:58:56.506 INFO:teuthology.orchestra.run.smithi003.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T05:58:56.507 INFO:teuthology.orchestra.run.smithi003.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T05:58:56.577 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-19T05:58:56.597 INFO:teuthology.orchestra.run.smithi003.stdout:====================================================================================== 2024-09-19T05:58:56.597 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-09-19T05:58:56.597 INFO:teuthology.orchestra.run.smithi003.stdout:====================================================================================== 2024-09-19T05:58:56.597 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-19T05:58:56.597 INFO:teuthology.orchestra.run.smithi003.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T05:58:56.598 INFO:teuthology.orchestra.run.smithi003.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T05:58:56.598 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T05:58:56.598 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T05:58:56.598 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T05:58:56.598 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T05:58:56.598 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T05:58:56.598 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T05:58:56.598 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T05:58:56.598 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T05:58:56.598 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T05:58:56.598 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T05:58:56.599 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T05:58:56.599 INFO:teuthology.orchestra.run.smithi003.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T05:58:56.599 INFO:teuthology.orchestra.run.smithi003.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T05:58:56.599 INFO:teuthology.orchestra.run.smithi003.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T05:58:56.599 INFO:teuthology.orchestra.run.smithi003.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T05:58:56.599 INFO:teuthology.orchestra.run.smithi003.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T05:58:56.599 INFO:teuthology.orchestra.run.smithi003.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T05:58:56.599 INFO:teuthology.orchestra.run.smithi003.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T05:58:56.599 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T05:58:56.599 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T05:58:56.599 INFO:teuthology.orchestra.run.smithi003.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T05:58:56.599 INFO:teuthology.orchestra.run.smithi003.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T05:58:56.599 INFO:teuthology.orchestra.run.smithi003.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T05:58:56.600 INFO:teuthology.orchestra.run.smithi003.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T05:58:56.600 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T05:58:56.600 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T05:58:56.600 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T05:58:56.600 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T05:58:56.600 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T05:58:56.600 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T05:58:56.600 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T05:58:56.600 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T05:58:56.600 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T05:58:56.600 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T05:58:56.600 INFO:teuthology.orchestra.run.smithi003.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T05:58:56.601 INFO:teuthology.orchestra.run.smithi003.stdout:Upgrading: 2024-09-19T05:58:56.601 INFO:teuthology.orchestra.run.smithi003.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T05:58:56.601 INFO:teuthology.orchestra.run.smithi003.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T05:58:56.601 INFO:teuthology.orchestra.run.smithi003.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T05:58:56.601 INFO:teuthology.orchestra.run.smithi003.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T05:58:56.601 INFO:teuthology.orchestra.run.smithi003.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T05:58:56.601 INFO:teuthology.orchestra.run.smithi003.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T05:58:56.601 INFO:teuthology.orchestra.run.smithi003.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T05:58:56.602 INFO:teuthology.orchestra.run.smithi003.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T05:58:56.602 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-09-19T05:58:56.602 INFO:teuthology.orchestra.run.smithi003.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T05:58:56.602 INFO:teuthology.orchestra.run.smithi003.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T05:58:56.602 INFO:teuthology.orchestra.run.smithi003.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T05:58:56.603 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T05:58:56.603 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T05:58:56.603 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T05:58:56.603 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T05:58:56.603 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T05:58:56.603 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T05:58:56.604 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T05:58:56.604 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T05:58:56.604 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T05:58:56.604 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T05:58:56.604 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T05:58:56.605 INFO:teuthology.orchestra.run.smithi003.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T05:58:56.605 INFO:teuthology.orchestra.run.smithi003.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T05:58:56.605 INFO:teuthology.orchestra.run.smithi003.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T05:58:56.605 INFO:teuthology.orchestra.run.smithi003.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T05:58:56.605 INFO:teuthology.orchestra.run.smithi003.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T05:58:56.605 INFO:teuthology.orchestra.run.smithi003.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T05:58:56.606 INFO:teuthology.orchestra.run.smithi003.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T05:58:56.606 INFO:teuthology.orchestra.run.smithi003.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T05:58:56.606 INFO:teuthology.orchestra.run.smithi003.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T05:58:56.606 INFO:teuthology.orchestra.run.smithi003.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T05:58:56.606 INFO:teuthology.orchestra.run.smithi003.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T05:58:56.606 INFO:teuthology.orchestra.run.smithi003.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T05:58:56.607 INFO:teuthology.orchestra.run.smithi003.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T05:58:56.607 INFO:teuthology.orchestra.run.smithi003.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T05:58:56.607 INFO:teuthology.orchestra.run.smithi003.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T05:58:56.607 INFO:teuthology.orchestra.run.smithi003.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T05:58:56.607 INFO:teuthology.orchestra.run.smithi003.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T05:58:56.607 INFO:teuthology.orchestra.run.smithi003.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T05:58:56.607 INFO:teuthology.orchestra.run.smithi003.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T05:58:56.607 INFO:teuthology.orchestra.run.smithi003.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T05:58:56.607 INFO:teuthology.orchestra.run.smithi003.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T05:58:56.607 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T05:58:56.607 INFO:teuthology.orchestra.run.smithi003.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T05:58:56.607 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T05:58:56.608 INFO:teuthology.orchestra.run.smithi003.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T05:58:56.608 INFO:teuthology.orchestra.run.smithi003.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T05:58:56.608 INFO:teuthology.orchestra.run.smithi003.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T05:58:56.608 INFO:teuthology.orchestra.run.smithi003.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T05:58:56.608 INFO:teuthology.orchestra.run.smithi003.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T05:58:56.608 INFO:teuthology.orchestra.run.smithi003.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T05:58:56.608 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T05:58:56.608 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T05:58:56.608 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T05:58:56.608 INFO:teuthology.orchestra.run.smithi003.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T05:58:56.608 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T05:58:56.608 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T05:58:56.609 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T05:58:56.609 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T05:58:56.609 INFO:teuthology.orchestra.run.smithi003.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T05:58:56.609 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T05:58:56.609 INFO:teuthology.orchestra.run.smithi003.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T05:58:56.609 INFO:teuthology.orchestra.run.smithi003.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T05:58:56.609 INFO:teuthology.orchestra.run.smithi003.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T05:58:56.609 INFO:teuthology.orchestra.run.smithi003.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T05:58:56.609 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T05:58:56.609 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T05:58:56.609 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T05:58:56.609 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T05:58:56.610 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T05:58:56.610 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T05:58:56.610 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T05:58:56.610 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T05:58:56.610 INFO:teuthology.orchestra.run.smithi003.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T05:58:56.610 INFO:teuthology.orchestra.run.smithi003.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T05:58:56.610 INFO:teuthology.orchestra.run.smithi003.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T05:58:56.610 INFO:teuthology.orchestra.run.smithi003.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T05:58:56.610 INFO:teuthology.orchestra.run.smithi003.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T05:58:56.610 INFO:teuthology.orchestra.run.smithi003.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T05:58:56.610 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T05:58:56.610 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T05:58:56.611 INFO:teuthology.orchestra.run.smithi003.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T05:58:56.611 INFO:teuthology.orchestra.run.smithi003.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T05:58:56.611 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T05:58:56.611 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T05:58:56.611 INFO:teuthology.orchestra.run.smithi003.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T05:58:56.611 INFO:teuthology.orchestra.run.smithi003.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T05:58:56.612 INFO:teuthology.orchestra.run.smithi003.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T05:58:56.612 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T05:58:56.612 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T05:58:56.612 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T05:58:56.612 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T05:58:56.612 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T05:58:56.612 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T05:58:56.612 INFO:teuthology.orchestra.run.smithi003.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T05:58:56.612 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T05:58:56.612 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T05:58:56.613 INFO:teuthology.orchestra.run.smithi003.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T05:58:56.613 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T05:58:56.613 INFO:teuthology.orchestra.run.smithi003.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T05:58:56.613 INFO:teuthology.orchestra.run.smithi003.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T05:58:56.613 INFO:teuthology.orchestra.run.smithi003.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T05:58:56.613 INFO:teuthology.orchestra.run.smithi003.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T05:58:56.613 INFO:teuthology.orchestra.run.smithi003.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T05:58:56.613 INFO:teuthology.orchestra.run.smithi003.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T05:58:56.613 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T05:58:56.613 INFO:teuthology.orchestra.run.smithi003.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T05:58:56.613 INFO:teuthology.orchestra.run.smithi003.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T05:58:56.614 INFO:teuthology.orchestra.run.smithi003.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T05:58:56.614 INFO:teuthology.orchestra.run.smithi003.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T05:58:56.614 INFO:teuthology.orchestra.run.smithi003.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T05:58:56.614 INFO:teuthology.orchestra.run.smithi003.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T05:58:56.614 INFO:teuthology.orchestra.run.smithi003.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T05:58:56.614 INFO:teuthology.orchestra.run.smithi003.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T05:58:56.614 INFO:teuthology.orchestra.run.smithi003.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T05:58:56.614 INFO:teuthology.orchestra.run.smithi003.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T05:58:56.614 INFO:teuthology.orchestra.run.smithi003.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T05:58:56.614 INFO:teuthology.orchestra.run.smithi003.stdout:Installing weak dependencies: 2024-09-19T05:58:56.614 INFO:teuthology.orchestra.run.smithi003.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T05:58:56.614 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T05:58:56.615 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-19T05:58:56.615 INFO:teuthology.orchestra.run.smithi003.stdout:====================================================================================== 2024-09-19T05:58:56.615 INFO:teuthology.orchestra.run.smithi003.stdout:Install 148 Packages 2024-09-19T05:58:56.615 INFO:teuthology.orchestra.run.smithi003.stdout:Upgrade 8 Packages 2024-09-19T05:58:56.615 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T05:58:56.615 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 226 M 2024-09-19T05:58:56.615 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-19T05:58:56.638 INFO:teuthology.orchestra.run.smithi071.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 21 kB/s | 6.6 kB 00:00 2024-09-19T05:58:56.746 INFO:teuthology.orchestra.run.smithi059.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-09-19T05:58:56.963 INFO:teuthology.orchestra.run.smithi059.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 17 MB/s | 21 MB 00:01 2024-09-19T05:58:57.022 INFO:teuthology.orchestra.run.smithi059.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 433 kB/s | 25 kB 00:00 2024-09-19T05:58:57.063 INFO:teuthology.orchestra.run.smithi071.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 2.1 MB/s | 896 kB 00:00 2024-09-19T05:58:57.205 INFO:teuthology.orchestra.run.smithi071.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.0 MB/s | 145 kB 00:00 2024-09-19T05:58:57.299 INFO:teuthology.orchestra.run.smithi003.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 25 kB/s | 6.6 kB 00:00 2024-09-19T05:58:57.330 INFO:teuthology.orchestra.run.smithi059.stdout:(10/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 17 MB/s | 17 MB 00:00 2024-09-19T05:58:57.389 INFO:teuthology.orchestra.run.smithi059.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.8 MB/s | 228 kB 00:00 2024-09-19T05:58:57.547 INFO:teuthology.orchestra.run.smithi059.stdout:(12/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 13 MB/s | 11 MB 00:00 2024-09-19T05:58:57.573 INFO:teuthology.orchestra.run.smithi059.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 147 kB/s | 27 kB 00:00 2024-09-19T05:58:57.606 INFO:teuthology.orchestra.run.smithi059.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 542 kB/s | 32 kB 00:00 2024-09-19T05:58:57.656 INFO:teuthology.orchestra.run.smithi059.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 8.8 MB/s | 751 kB 00:00 2024-09-19T05:58:57.698 INFO:teuthology.orchestra.run.smithi059.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 1.7 MB/s | 163 kB 00:00 2024-09-19T05:58:57.740 INFO:teuthology.orchestra.run.smithi059.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 1.5 MB/s | 127 kB 00:00 2024-09-19T05:58:57.749 INFO:teuthology.orchestra.run.smithi003.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 1.9 MB/s | 896 kB 00:00 2024-09-19T05:58:57.782 INFO:teuthology.orchestra.run.smithi059.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 5.9 MB/s | 506 kB 00:00 2024-09-19T05:58:57.805 INFO:teuthology.orchestra.run.smithi071.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 3.6 MB/s | 5.4 MB 00:01 2024-09-19T05:58:57.872 INFO:teuthology.orchestra.run.smithi071.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 3.6 MB/s | 2.4 MB 00:00 2024-09-19T05:58:57.891 INFO:teuthology.orchestra.run.smithi059.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 417 kB/s | 45 kB 00:00 2024-09-19T05:58:57.924 INFO:teuthology.orchestra.run.smithi003.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 831 kB/s | 145 kB 00:00 2024-09-19T05:58:57.999 INFO:teuthology.orchestra.run.smithi059.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.2 MB/s | 136 kB 00:00 2024-09-19T05:58:58.100 INFO:teuthology.orchestra.run.smithi059.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.6 MB/s | 161 kB 00:00 2024-09-19T05:58:58.130 INFO:teuthology.orchestra.run.smithi071.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 4.7 MB/s | 1.5 MB 00:00 2024-09-19T05:58:58.200 INFO:teuthology.orchestra.run.smithi059.stdout:(22/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 12 MB/s | 5.3 MB 00:00 2024-09-19T05:58:58.234 INFO:teuthology.orchestra.run.smithi059.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 2.3 MB/s | 320 kB 00:00 2024-09-19T05:58:58.276 INFO:teuthology.orchestra.run.smithi059.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 3.9 MB/s | 300 kB 00:00 2024-09-19T05:58:58.318 INFO:teuthology.orchestra.run.smithi059.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.2 MB/s | 99 kB 00:00 2024-09-19T05:58:58.351 INFO:teuthology.orchestra.run.smithi059.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-19T05:58:58.452 INFO:teuthology.orchestra.run.smithi059.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 1.7 MB/s | 171 kB 00:00 2024-09-19T05:58:58.544 INFO:teuthology.orchestra.run.smithi059.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 347 kB/s | 32 kB 00:00 2024-09-19T05:58:58.669 INFO:teuthology.orchestra.run.smithi059.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 8.8 MB/s | 3.1 MB 00:00 2024-09-19T05:58:58.694 INFO:teuthology.orchestra.run.smithi059.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 975 kB/s | 146 kB 00:00 2024-09-19T05:58:58.733 INFO:teuthology.orchestra.run.smithi003.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 3.2 MB/s | 5.4 MB 00:01 2024-09-19T05:58:58.772 INFO:teuthology.orchestra.run.smithi071.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 5.2 MB/s | 4.7 MB 00:00 2024-09-19T05:58:59.069 INFO:teuthology.orchestra.run.smithi059.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 8.9 MB/s | 3.6 MB 00:00 2024-09-19T05:58:59.161 INFO:teuthology.orchestra.run.smithi059.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.7 MB/s | 249 kB 00:00 2024-09-19T05:58:59.245 INFO:teuthology.orchestra.run.smithi059.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 592 kB/s | 49 kB 00:00 2024-09-19T05:58:59.266 INFO:teuthology.orchestra.run.smithi003.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 1.5 MB 00:00 2024-09-19T05:58:59.320 INFO:teuthology.orchestra.run.smithi059.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 219 kB/s | 16 kB 00:00 2024-09-19T05:58:59.412 INFO:teuthology.orchestra.run.smithi059.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 3.0 MB/s | 285 kB 00:00 2024-09-19T05:58:59.511 INFO:teuthology.orchestra.run.smithi059.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 9.1 MB/s | 7.4 MB 00:00 2024-09-19T05:58:59.575 INFO:teuthology.orchestra.run.smithi003.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 1.4 MB/s | 2.4 MB 00:01 2024-09-19T05:58:59.578 INFO:teuthology.orchestra.run.smithi059.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 4.5 MB/s | 765 kB 00:00 2024-09-19T05:58:59.603 INFO:teuthology.orchestra.run.smithi059.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 199 kB/s | 18 kB 00:00 2024-09-19T05:58:59.931 INFO:teuthology.orchestra.run.smithi071.stdout:(8/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86_ 9.4 MB/s | 17 MB 00:01 2024-09-19T05:58:59.973 INFO:teuthology.orchestra.run.smithi071.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 608 kB/s | 25 kB 00:00 2024-09-19T05:59:00.087 INFO:teuthology.orchestra.run.smithi059.stdout:(39/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 16 MB/s | 49 MB 00:03 2024-09-19T05:59:00.112 INFO:teuthology.orchestra.run.smithi059.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 149 kB/s | 80 kB 00:00 2024-09-19T05:59:00.200 INFO:teuthology.orchestra.run.smithi003.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 5.0 MB/s | 4.7 MB 00:00 2024-09-19T05:59:00.229 INFO:teuthology.orchestra.run.smithi059.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-19T05:59:00.254 INFO:teuthology.orchestra.run.smithi059.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-19T05:59:00.273 INFO:teuthology.orchestra.run.smithi071.stdout:(10/156): ceph-common-19.1.1-361.g2f599a46.el9. 5.4 MB/s | 21 MB 00:03 2024-09-19T05:59:00.321 INFO:teuthology.orchestra.run.smithi059.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-19T05:59:00.355 INFO:teuthology.orchestra.run.smithi059.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-09-19T05:59:00.365 INFO:teuthology.orchestra.run.smithi071.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 2.4 MB/s | 228 kB 00:00 2024-09-19T05:59:00.380 INFO:teuthology.orchestra.run.smithi059.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-19T05:59:00.414 INFO:teuthology.orchestra.run.smithi059.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-19T05:59:00.447 INFO:teuthology.orchestra.run.smithi059.stdout:(47/156): libgfortran-11.5.0-2.el9.x86_64.rpm 949 kB/s | 801 kB 00:00 2024-09-19T05:59:00.473 INFO:teuthology.orchestra.run.smithi059.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-19T05:59:00.498 INFO:teuthology.orchestra.run.smithi071.stdout:(12/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 6.1 MB/s | 11 MB 00:01 2024-09-19T05:59:00.523 INFO:teuthology.orchestra.run.smithi071.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 171 kB/s | 27 kB 00:00 2024-09-19T05:59:00.548 INFO:teuthology.orchestra.run.smithi071.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 637 kB/s | 32 kB 00:00 2024-09-19T05:59:00.607 INFO:teuthology.orchestra.run.smithi071.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.7 MB/s | 163 kB 00:00 2024-09-19T05:59:00.632 INFO:teuthology.orchestra.run.smithi059.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 675 kB/s | 107 kB 00:00 2024-09-19T05:59:00.633 INFO:teuthology.orchestra.run.smithi071.stdout:(16/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 6.8 MB/s | 751 kB 00:00 2024-09-19T05:59:00.651 INFO:teuthology.orchestra.run.smithi003.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 5.9 MB/s | 21 MB 00:03 2024-09-19T05:59:00.658 INFO:teuthology.orchestra.run.smithi071.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T05:59:00.682 INFO:teuthology.orchestra.run.smithi059.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 435 kB/s | 22 kB 00:00 2024-09-19T05:59:00.708 INFO:teuthology.orchestra.run.smithi071.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 6.5 MB/s | 506 kB 00:00 2024-09-19T05:59:00.730 INFO:teuthology.orchestra.run.smithi003.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 316 kB/s | 25 kB 00:00 2024-09-19T05:59:00.759 INFO:teuthology.orchestra.run.smithi071.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 904 kB/s | 45 kB 00:00 2024-09-19T05:59:00.790 INFO:teuthology.orchestra.run.smithi059.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 689 kB 00:00 2024-09-19T05:59:00.817 INFO:teuthology.orchestra.run.smithi071.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.3 MB/s | 136 kB 00:00 2024-09-19T05:59:00.849 INFO:teuthology.orchestra.run.smithi059.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 1.8 MB/s | 313 kB 00:00 2024-09-19T05:59:00.874 INFO:teuthology.orchestra.run.smithi059.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 392 kB/s | 33 kB 00:00 2024-09-19T05:59:00.876 INFO:teuthology.orchestra.run.smithi071.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.7 MB/s | 161 kB 00:00 2024-09-19T05:59:00.916 INFO:teuthology.orchestra.run.smithi059.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 2.0 MB/s | 943 kB 00:00 2024-09-19T05:59:00.934 INFO:teuthology.orchestra.run.smithi071.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 5.4 MB/s | 320 kB 00:00 2024-09-19T05:59:00.941 INFO:teuthology.orchestra.run.smithi059.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-09-19T05:59:00.967 INFO:teuthology.orchestra.run.smithi059.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-19T05:59:00.993 INFO:teuthology.orchestra.run.smithi071.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.0 MB/s | 300 kB 00:00 2024-09-19T05:59:01.017 INFO:teuthology.orchestra.run.smithi059.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 910 kB/s | 45 kB 00:00 2024-09-19T05:59:01.042 INFO:teuthology.orchestra.run.smithi059.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-09-19T05:59:01.043 INFO:teuthology.orchestra.run.smithi071.stdout:(24/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T05:59:01.094 INFO:teuthology.orchestra.run.smithi071.stdout:(25/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T05:59:01.202 INFO:teuthology.orchestra.run.smithi071.stdout:(26/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 9.8 MB/s | 5.3 MB 00:00 2024-09-19T05:59:01.234 INFO:teuthology.orchestra.run.smithi059.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 3.0 MB/s | 581 kB 00:00 2024-09-19T05:59:01.253 INFO:teuthology.orchestra.run.smithi071.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-19T05:59:01.268 INFO:teuthology.orchestra.run.smithi059.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.6 MB/s | 662 kB 00:00 2024-09-19T05:59:01.293 INFO:teuthology.orchestra.run.smithi059.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-19T05:59:01.303 INFO:teuthology.orchestra.run.smithi071.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 639 kB/s | 32 kB 00:00 2024-09-19T05:59:01.335 INFO:teuthology.orchestra.run.smithi059.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 711 kB/s | 47 kB 00:00 2024-09-19T05:59:01.361 INFO:teuthology.orchestra.run.smithi071.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.5 MB/s | 146 kB 00:00 2024-09-19T05:59:01.419 INFO:teuthology.orchestra.run.smithi059.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-19T05:59:01.437 INFO:teuthology.orchestra.run.smithi071.stdout:(30/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 9.1 MB/s | 3.1 MB 00:00 2024-09-19T05:59:01.444 INFO:teuthology.orchestra.run.smithi059.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-19T05:59:01.469 INFO:teuthology.orchestra.run.smithi059.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-19T05:59:01.737 INFO:teuthology.orchestra.run.smithi071.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 9.5 MB/s | 3.6 MB 00:00 2024-09-19T05:59:01.787 INFO:teuthology.orchestra.run.smithi071.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 4.9 MB/s | 249 kB 00:00 2024-09-19T05:59:01.795 INFO:teuthology.orchestra.run.smithi059.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.2 MB/s | 3.0 MB 00:00 2024-09-19T05:59:01.829 INFO:teuthology.orchestra.run.smithi071.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 1.2 MB/s | 49 kB 00:00 2024-09-19T05:59:01.834 INFO:teuthology.orchestra.run.smithi003.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 6.5 MB/s | 11 MB 00:01 2024-09-19T05:59:01.871 INFO:teuthology.orchestra.run.smithi071.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 396 kB/s | 16 kB 00:00 2024-09-19T05:59:01.918 INFO:teuthology.orchestra.run.smithi003.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 2.7 MB/s | 228 kB 00:00 2024-09-19T05:59:01.931 INFO:teuthology.orchestra.run.smithi071.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 4.8 MB/s | 285 kB 00:00 2024-09-19T05:59:01.968 INFO:teuthology.orchestra.run.smithi003.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 542 kB/s | 27 kB 00:00 2024-09-19T05:59:02.027 INFO:teuthology.orchestra.run.smithi003.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 543 kB/s | 32 kB 00:00 2024-09-19T05:59:02.029 INFO:teuthology.orchestra.run.smithi071.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 7.5 MB/s | 765 kB 00:00 2024-09-19T05:59:02.130 INFO:teuthology.orchestra.run.smithi071.stdout:(37/156): ceph-mgr-diskprediction-local-19.1.1- 11 MB/s | 7.4 MB 00:00 2024-09-19T05:59:02.147 INFO:teuthology.orchestra.run.smithi071.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 156 kB/s | 18 kB 00:00 2024-09-19T05:59:02.152 INFO:teuthology.orchestra.run.smithi003.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 5.9 MB/s | 751 kB 00:00 2024-09-19T05:59:02.161 INFO:teuthology.orchestra.run.smithi059.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 4.3 MB/s | 1.6 MB 00:00 2024-09-19T05:59:02.219 INFO:teuthology.orchestra.run.smithi003.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.4 MB/s | 163 kB 00:00 2024-09-19T05:59:02.269 INFO:teuthology.orchestra.run.smithi003.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T05:59:02.281 INFO:teuthology.orchestra.run.smithi071.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 532 kB/s | 80 kB 00:00 2024-09-19T05:59:02.361 INFO:teuthology.orchestra.run.smithi003.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 5.4 MB/s | 506 kB 00:00 2024-09-19T05:59:02.372 INFO:teuthology.orchestra.run.smithi071.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-19T05:59:02.387 INFO:teuthology.orchestra.run.smithi059.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 4.0 MB/s | 910 kB 00:00 2024-09-19T05:59:02.398 INFO:teuthology.orchestra.run.smithi071.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.1 MB/s | 801 kB 00:00 2024-09-19T05:59:02.440 INFO:teuthology.orchestra.run.smithi071.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-19T05:59:02.445 INFO:teuthology.orchestra.run.smithi059.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-19T05:59:02.490 INFO:teuthology.orchestra.run.smithi071.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.2 MB 00:00 2024-09-19T05:59:02.515 INFO:teuthology.orchestra.run.smithi071.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-19T05:59:02.537 INFO:teuthology.orchestra.run.smithi059.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.1 MB/s | 4.4 MB 00:01 2024-09-19T05:59:02.540 INFO:teuthology.orchestra.run.smithi071.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-19T05:59:02.566 INFO:teuthology.orchestra.run.smithi071.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-19T05:59:02.591 INFO:teuthology.orchestra.run.smithi071.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T05:59:02.745 INFO:teuthology.orchestra.run.smithi059.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.8 MB/s | 4.9 MB 00:01 2024-09-19T05:59:02.762 INFO:teuthology.orchestra.run.smithi003.stdout:(18/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 5.3 MB/s | 17 MB 00:03 2024-09-19T05:59:02.812 INFO:teuthology.orchestra.run.smithi003.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 912 kB/s | 45 kB 00:00 2024-09-19T05:59:02.812 INFO:teuthology.orchestra.run.smithi059.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 3.7 MB/s | 1.0 MB 00:00 2024-09-19T05:59:02.838 INFO:teuthology.orchestra.run.smithi059.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 952 kB/s | 87 kB 00:00 2024-09-19T05:59:02.862 INFO:teuthology.orchestra.run.smithi003.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.7 MB/s | 136 kB 00:00 2024-09-19T05:59:02.880 INFO:teuthology.orchestra.run.smithi059.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-19T05:59:02.912 INFO:teuthology.orchestra.run.smithi003.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 3.2 MB/s | 161 kB 00:00 2024-09-19T05:59:02.963 INFO:teuthology.orchestra.run.smithi059.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-19T05:59:02.979 INFO:teuthology.orchestra.run.smithi003.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 4.7 MB/s | 320 kB 00:00 2024-09-19T05:59:03.056 INFO:teuthology.orchestra.run.smithi059.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-09-19T05:59:03.079 INFO:teuthology.orchestra.run.smithi003.stdout:(23/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 7.4 MB/s | 5.3 MB 00:00 2024-09-19T05:59:03.105 INFO:teuthology.orchestra.run.smithi003.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 2.3 MB/s | 300 kB 00:00 2024-09-19T05:59:03.106 INFO:teuthology.orchestra.run.smithi059.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-09-19T05:59:03.130 INFO:teuthology.orchestra.run.smithi003.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T05:59:03.155 INFO:teuthology.orchestra.run.smithi003.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T05:59:03.156 INFO:teuthology.orchestra.run.smithi059.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-19T05:59:03.205 INFO:teuthology.orchestra.run.smithi003.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-19T05:59:03.240 INFO:teuthology.orchestra.run.smithi059.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-19T05:59:03.264 INFO:teuthology.orchestra.run.smithi003.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 545 kB/s | 32 kB 00:00 2024-09-19T05:59:03.290 INFO:teuthology.orchestra.run.smithi059.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 697 kB/s | 35 kB 00:00 2024-09-19T05:59:03.314 INFO:teuthology.orchestra.run.smithi003.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T05:59:03.325 INFO:teuthology.orchestra.run.smithi071.stdout:(48/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 15 MB/s | 49 MB 00:03 2024-09-19T05:59:03.498 INFO:teuthology.orchestra.run.smithi003.stdout:(30/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 8.4 MB/s | 3.1 MB 00:00 2024-09-19T05:59:03.665 INFO:teuthology.orchestra.run.smithi059.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 4.7 MB/s | 5.8 MB 00:01 2024-09-19T05:59:03.749 INFO:teuthology.orchestra.run.smithi059.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-19T05:59:03.790 INFO:teuthology.orchestra.run.smithi003.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 7.5 MB/s | 3.6 MB 00:00 2024-09-19T05:59:03.825 INFO:teuthology.orchestra.run.smithi071.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 547 kB/s | 689 kB 00:01 2024-09-19T05:59:03.832 INFO:teuthology.orchestra.run.smithi059.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-19T05:59:03.857 INFO:teuthology.orchestra.run.smithi003.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 3.7 MB/s | 249 kB 00:00 2024-09-19T05:59:03.883 INFO:teuthology.orchestra.run.smithi059.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T05:59:03.907 INFO:teuthology.orchestra.run.smithi003.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 990 kB/s | 49 kB 00:00 2024-09-19T05:59:03.933 INFO:teuthology.orchestra.run.smithi059.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 849 kB/s | 42 kB 00:00 2024-09-19T05:59:03.942 INFO:teuthology.orchestra.run.smithi071.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 698 kB/s | 943 kB 00:01 2024-09-19T05:59:03.958 INFO:teuthology.orchestra.run.smithi003.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 330 kB/s | 16 kB 00:00 2024-09-19T05:59:04.025 INFO:teuthology.orchestra.run.smithi003.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 4.2 MB/s | 285 kB 00:00 2024-09-19T05:59:04.025 INFO:teuthology.orchestra.run.smithi059.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-09-19T05:59:04.050 INFO:teuthology.orchestra.run.smithi071.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 148 kB/s | 107 kB 00:00 2024-09-19T05:59:04.083 INFO:teuthology.orchestra.run.smithi059.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-19T05:59:04.167 INFO:teuthology.orchestra.run.smithi059.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-09-19T05:59:04.173 INFO:teuthology.orchestra.run.smithi003.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 5.0 MB/s | 765 kB 00:00 2024-09-19T05:59:04.217 INFO:teuthology.orchestra.run.smithi003.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 420 kB/s | 18 kB 00:00 2024-09-19T05:59:04.217 INFO:teuthology.orchestra.run.smithi059.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T05:59:04.267 INFO:teuthology.orchestra.run.smithi059.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-09-19T05:59:04.317 INFO:teuthology.orchestra.run.smithi003.stdout:(38/156): ceph-mgr-diskprediction-local-19.1.1- 9.0 MB/s | 7.4 MB 00:00 2024-09-19T05:59:04.334 INFO:teuthology.orchestra.run.smithi059.stdout:(91/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.9 MB/s | 5.1 MB 00:01 2024-09-19T05:59:04.367 INFO:teuthology.orchestra.run.smithi071.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 40 kB/s | 22 kB 00:00 2024-09-19T05:59:04.384 INFO:teuthology.orchestra.run.smithi059.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 836 kB/s | 42 kB 00:00 2024-09-19T05:59:04.401 INFO:teuthology.orchestra.run.smithi003.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 435 kB/s | 80 kB 00:00 2024-09-19T05:59:04.435 INFO:teuthology.orchestra.run.smithi059.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 884 kB/s | 44 kB 00:00 2024-09-19T05:59:04.460 INFO:teuthology.orchestra.run.smithi003.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T05:59:04.493 INFO:teuthology.orchestra.run.smithi003.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 801 kB 00:00 2024-09-19T05:59:04.519 INFO:teuthology.orchestra.run.smithi059.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-19T05:59:04.526 INFO:teuthology.orchestra.run.smithi003.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-19T05:59:04.569 INFO:teuthology.orchestra.run.smithi059.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 720 kB/s | 36 kB 00:00 2024-09-19T05:59:04.569 INFO:teuthology.orchestra.run.smithi003.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-19T05:59:04.610 INFO:teuthology.orchestra.run.smithi003.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-19T05:59:04.619 INFO:teuthology.orchestra.run.smithi059.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 949 kB/s | 47 kB 00:00 2024-09-19T05:59:04.626 INFO:teuthology.orchestra.run.smithi071.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 58 kB/s | 33 kB 00:00 2024-09-19T05:59:04.636 INFO:teuthology.orchestra.run.smithi003.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-19T05:59:04.661 INFO:teuthology.orchestra.run.smithi003.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-19T05:59:04.686 INFO:teuthology.orchestra.run.smithi003.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T05:59:04.703 INFO:teuthology.orchestra.run.smithi059.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-09-19T05:59:04.778 INFO:teuthology.orchestra.run.smithi059.stdout:(98/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.0 MB/s | 6.0 MB 00:01 2024-09-19T05:59:04.793 INFO:teuthology.orchestra.run.smithi071.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 369 kB/s | 313 kB 00:00 2024-09-19T05:59:04.803 INFO:teuthology.orchestra.run.smithi059.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 576 kB/s | 58 kB 00:00 2024-09-19T05:59:04.829 INFO:teuthology.orchestra.run.smithi059.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T05:59:04.854 INFO:teuthology.orchestra.run.smithi059.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T05:59:04.879 INFO:teuthology.orchestra.run.smithi059.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-19T05:59:04.963 INFO:teuthology.orchestra.run.smithi059.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-19T05:59:05.013 INFO:teuthology.orchestra.run.smithi059.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T05:59:05.047 INFO:teuthology.orchestra.run.smithi059.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-19T05:59:05.072 INFO:teuthology.orchestra.run.smithi059.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 784 kB/s | 19 kB 00:00 2024-09-19T05:59:05.135 INFO:teuthology.orchestra.run.smithi071.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 36 kB/s | 18 kB 00:00 2024-09-19T05:59:05.145 INFO:teuthology.orchestra.run.smithi003.stdout:(48/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 11 MB/s | 49 MB 00:04 2024-09-19T05:59:05.156 INFO:teuthology.orchestra.run.smithi059.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.1 MB/s | 863 kB 00:00 2024-09-19T05:59:05.198 INFO:teuthology.orchestra.run.smithi059.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 624 kB/s | 26 kB 00:00 2024-09-19T05:59:05.223 INFO:teuthology.orchestra.run.smithi059.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T05:59:05.245 INFO:teuthology.orchestra.run.smithi003.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-09-19T05:59:05.257 INFO:teuthology.orchestra.run.smithi059.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-19T05:59:05.271 INFO:teuthology.orchestra.run.smithi003.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 1.1 MB/s | 689 kB 00:00 2024-09-19T05:59:05.315 INFO:teuthology.orchestra.run.smithi059.stdout:(111/156): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-19T05:59:05.321 INFO:teuthology.orchestra.run.smithi003.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 289 kB/s | 22 kB 00:00 2024-09-19T05:59:05.335 INFO:teuthology.orchestra.run.smithi071.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 21 kB/s | 11 kB 00:00 2024-09-19T05:59:05.340 INFO:teuthology.orchestra.run.smithi059.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-09-19T05:59:05.380 INFO:teuthology.orchestra.run.smithi003.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 1.3 MB/s | 943 kB 00:00 2024-09-19T05:59:05.382 INFO:teuthology.orchestra.run.smithi059.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-19T05:59:05.399 INFO:teuthology.orchestra.run.smithi059.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-19T05:59:05.402 INFO:teuthology.orchestra.run.smithi071.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.9 MB/s | 3.0 MB 00:01 2024-09-19T05:59:05.405 INFO:teuthology.orchestra.run.smithi003.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 392 kB/s | 33 kB 00:00 2024-09-19T05:59:05.430 INFO:teuthology.orchestra.run.smithi003.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 1.9 MB/s | 313 kB 00:00 2024-09-19T05:59:05.433 INFO:teuthology.orchestra.run.smithi059.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-09-19T05:59:05.450 INFO:teuthology.orchestra.run.smithi059.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 643 kB/s | 32 kB 00:00 2024-09-19T05:59:05.464 INFO:teuthology.orchestra.run.smithi003.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 310 kB/s | 18 kB 00:00 2024-09-19T05:59:05.467 INFO:teuthology.orchestra.run.smithi059.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 420 kB/s | 14 kB 00:00 2024-09-19T05:59:05.489 INFO:teuthology.orchestra.run.smithi003.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-09-19T05:59:05.492 INFO:teuthology.orchestra.run.smithi059.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-19T05:59:05.517 INFO:teuthology.orchestra.run.smithi059.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-19T05:59:05.531 INFO:teuthology.orchestra.run.smithi003.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-19T05:59:05.543 INFO:teuthology.orchestra.run.smithi059.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-19T05:59:05.556 INFO:teuthology.orchestra.run.smithi003.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-19T05:59:05.568 INFO:teuthology.orchestra.run.smithi059.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T05:59:05.602 INFO:teuthology.orchestra.run.smithi059.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-19T05:59:05.627 INFO:teuthology.orchestra.run.smithi059.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-19T05:59:05.632 INFO:teuthology.orchestra.run.smithi003.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 662 kB 00:00 2024-09-19T05:59:05.652 INFO:teuthology.orchestra.run.smithi059.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 712 kB/s | 18 kB 00:00 2024-09-19T05:59:05.673 INFO:teuthology.orchestra.run.smithi003.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 591 kB/s | 24 kB 00:00 2024-09-19T05:59:05.677 INFO:teuthology.orchestra.run.smithi059.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 930 kB/s | 23 kB 00:00 2024-09-19T05:59:05.703 INFO:teuthology.orchestra.run.smithi059.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 786 kB/s | 19 kB 00:00 2024-09-19T05:59:05.715 INFO:teuthology.orchestra.run.smithi003.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-19T05:59:05.728 INFO:teuthology.orchestra.run.smithi059.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 795 kB/s | 20 kB 00:00 2024-09-19T05:59:05.741 INFO:teuthology.orchestra.run.smithi003.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 3.1 MB/s | 581 kB 00:00 2024-09-19T05:59:05.786 INFO:teuthology.orchestra.run.smithi059.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 18 MB/s | 1.0 MB 00:00 2024-09-19T05:59:05.812 INFO:teuthology.orchestra.run.smithi059.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T05:59:05.816 INFO:teuthology.orchestra.run.smithi003.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-09-19T05:59:05.841 INFO:teuthology.orchestra.run.smithi003.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-19T05:59:05.854 INFO:teuthology.orchestra.run.smithi059.stdout:(130/156): python3-grpcio-1.46.7-10.el9.x86_64. 6.6 MB/s | 2.0 MB 00:00 2024-09-19T05:59:05.866 INFO:teuthology.orchestra.run.smithi003.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 767 kB/s | 38 kB 00:00 2024-09-19T05:59:05.879 INFO:teuthology.orchestra.run.smithi059.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-09-19T05:59:05.904 INFO:teuthology.orchestra.run.smithi059.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-19T05:59:05.918 INFO:teuthology.orchestra.run.smithi071.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 78 kB/s | 45 kB 00:00 2024-09-19T05:59:05.952 INFO:teuthology.orchestra.run.smithi071.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 196 kB/s | 160 kB 00:00 2024-09-19T05:59:06.038 INFO:teuthology.orchestra.run.smithi059.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 123 kB/s | 16 kB 00:00 2024-09-19T05:59:06.063 INFO:teuthology.orchestra.run.smithi059.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T05:59:06.088 INFO:teuthology.orchestra.run.smithi059.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T05:59:06.114 INFO:teuthology.orchestra.run.smithi059.stdout:(136/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.1 MB/s | 272 kB 00:00 2024-09-19T05:59:06.139 INFO:teuthology.orchestra.run.smithi059.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 608 kB/s | 31 kB 00:00 2024-09-19T05:59:06.165 INFO:teuthology.orchestra.run.smithi059.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T05:59:06.190 INFO:teuthology.orchestra.run.smithi059.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-19T05:59:06.215 INFO:teuthology.orchestra.run.smithi059.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-19T05:59:06.240 INFO:teuthology.orchestra.run.smithi059.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-19T05:59:06.250 INFO:teuthology.orchestra.run.smithi003.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.4 MB/s | 3.0 MB 00:00 2024-09-19T05:59:06.265 INFO:teuthology.orchestra.run.smithi059.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T05:59:06.277 INFO:teuthology.orchestra.run.smithi071.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 764 kB/s | 662 kB 00:00 2024-09-19T05:59:06.291 INFO:teuthology.orchestra.run.smithi059.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-19T05:59:06.316 INFO:teuthology.orchestra.run.smithi059.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 805 kB/s | 20 kB 00:00 2024-09-19T05:59:06.341 INFO:teuthology.orchestra.run.smithi059.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-19T05:59:06.367 INFO:teuthology.orchestra.run.smithi059.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-19T05:59:06.434 INFO:teuthology.orchestra.run.smithi059.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-19T05:59:06.528 INFO:teuthology.orchestra.run.smithi071.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 43 kB/s | 24 kB 00:00 2024-09-19T05:59:06.684 INFO:teuthology.orchestra.run.smithi003.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-09-19T05:59:06.743 INFO:teuthology.orchestra.run.smithi059.stdout:(148/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.6 MB/s | 16 MB 00:02 2024-09-19T05:59:06.761 INFO:teuthology.orchestra.run.smithi071.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 690 kB/s | 581 kB 00:00 2024-09-19T05:59:06.809 INFO:teuthology.orchestra.run.smithi059.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 7.7 MB/s | 3.4 MB 00:00 2024-09-19T05:59:06.877 INFO:teuthology.orchestra.run.smithi059.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 7.1 MB/s | 3.2 MB 00:00 2024-09-19T05:59:06.903 INFO:teuthology.orchestra.run.smithi071.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 76 kB/s | 47 kB 00:00 2024-09-19T05:59:06.976 INFO:teuthology.orchestra.run.smithi003.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.0 MB/s | 4.4 MB 00:01 2024-09-19T05:59:06.993 INFO:teuthology.orchestra.run.smithi059.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 351 kB/s | 41 kB 00:00 2024-09-19T05:59:07.009 INFO:teuthology.orchestra.run.smithi003.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 2.7 MB/s | 910 kB 00:00 2024-09-19T05:59:07.068 INFO:teuthology.orchestra.run.smithi003.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-19T05:59:07.085 INFO:teuthology.orchestra.run.smithi059.stdout:(152/156): NetworkManager-1.51.0-1.el9.x86_64.r 6.8 MB/s | 2.3 MB 00:00 2024-09-19T05:59:07.135 INFO:teuthology.orchestra.run.smithi059.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 5.6 MB/s | 1.8 MB 00:00 2024-09-19T05:59:07.161 INFO:teuthology.orchestra.run.smithi059.stdout:(154/156): NetworkManager-tui-1.51.0-1.el9.x86_ 1.5 MB/s | 249 kB 00:00 2024-09-19T05:59:07.177 INFO:teuthology.orchestra.run.smithi003.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.7 MB/s | 4.9 MB 00:01 2024-09-19T05:59:07.202 INFO:teuthology.orchestra.run.smithi059.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-19T05:59:07.235 INFO:teuthology.orchestra.run.smithi003.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-19T05:59:07.253 INFO:teuthology.orchestra.run.smithi059.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 20 MB/s | 2.4 MB 00:00 2024-09-19T05:59:07.258 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:59:07.258 INFO:teuthology.orchestra.run.smithi059.stdout:Total 18 MB/s | 226 MB 00:12 2024-09-19T05:59:07.320 INFO:teuthology.orchestra.run.smithi071.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 373 kB/s | 292 kB 00:00 2024-09-19T05:59:07.436 INFO:teuthology.orchestra.run.smithi003.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.7 MB/s | 1.0 MB 00:00 2024-09-19T05:59:07.469 INFO:teuthology.orchestra.run.smithi003.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.8 MB/s | 61 kB 00:00 2024-09-19T05:59:07.470 INFO:teuthology.orchestra.run.smithi071.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 68 kB/s | 38 kB 00:00 2024-09-19T05:59:07.553 INFO:teuthology.orchestra.run.smithi003.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-19T05:59:07.570 INFO:teuthology.orchestra.run.smithi071.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 235 kB/s | 188 kB 00:00 2024-09-19T05:59:07.653 INFO:teuthology.orchestra.run.smithi003.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-19T05:59:07.695 INFO:teuthology.orchestra.run.smithi003.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 617 kB/s | 26 kB 00:00 2024-09-19T05:59:07.737 INFO:teuthology.orchestra.run.smithi003.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 461 kB/s | 19 kB 00:00 2024-09-19T05:59:07.812 INFO:teuthology.orchestra.run.smithi003.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-19T05:59:07.854 INFO:teuthology.orchestra.run.smithi003.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 836 kB/s | 35 kB 00:00 2024-09-19T05:59:08.506 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2024-09-19T05:59:08.571 INFO:teuthology.orchestra.run.smithi071.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.0 MB/s | 4.9 MB 00:01 2024-09-19T05:59:08.596 INFO:teuthology.orchestra.run.smithi003.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 3.6 MB/s | 5.8 MB 00:01 2024-09-19T05:59:08.612 INFO:teuthology.orchestra.run.smithi071.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-09-19T05:59:08.678 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2024-09-19T05:59:08.678 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2024-09-19T05:59:08.679 INFO:teuthology.orchestra.run.smithi003.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-19T05:59:08.721 INFO:teuthology.orchestra.run.smithi071.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 4.4 MB 00:01 2024-09-19T05:59:08.897 INFO:teuthology.orchestra.run.smithi003.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.0 MB/s | 222 kB 00:00 2024-09-19T05:59:08.955 INFO:teuthology.orchestra.run.smithi003.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-19T05:59:08.997 INFO:teuthology.orchestra.run.smithi003.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-19T05:59:09.123 INFO:teuthology.orchestra.run.smithi003.stdout:(86/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.2 MB/s | 6.0 MB 00:01 2024-09-19T05:59:09.181 INFO:teuthology.orchestra.run.smithi003.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 1.4 MB/s | 269 kB 00:00 2024-09-19T05:59:09.223 INFO:teuthology.orchestra.run.smithi003.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-09-19T05:59:09.265 INFO:teuthology.orchestra.run.smithi003.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-19T05:59:09.307 INFO:teuthology.orchestra.run.smithi003.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-09-19T05:59:09.359 INFO:teuthology.orchestra.run.smithi003.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.5 MB/s | 279 kB 00:00 2024-09-19T05:59:09.407 INFO:teuthology.orchestra.run.smithi003.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 861 kB/s | 42 kB 00:00 2024-09-19T05:59:09.413 INFO:teuthology.orchestra.run.smithi071.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 172 kB/s | 137 kB 00:00 2024-09-19T05:59:09.449 INFO:teuthology.orchestra.run.smithi003.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-19T05:59:09.472 INFO:teuthology.orchestra.run.smithi071.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 1.0 MB/s | 910 kB 00:00 2024-09-19T05:59:09.591 INFO:teuthology.orchestra.run.smithi003.stdout:(94/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.9 MB/s | 5.1 MB 00:01 2024-09-19T05:59:09.616 INFO:teuthology.orchestra.run.smithi003.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.3 MB/s | 221 kB 00:00 2024-09-19T05:59:09.642 INFO:teuthology.orchestra.run.smithi003.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 718 kB/s | 36 kB 00:00 2024-09-19T05:59:09.667 INFO:teuthology.orchestra.run.smithi003.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 950 kB/s | 47 kB 00:00 2024-09-19T05:59:09.709 INFO:teuthology.orchestra.run.smithi003.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-19T05:59:09.768 INFO:teuthology.orchestra.run.smithi003.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-19T05:59:09.793 INFO:teuthology.orchestra.run.smithi003.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-19T05:59:09.835 INFO:teuthology.orchestra.run.smithi003.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 955 kB/s | 64 kB 00:00 2024-09-19T05:59:09.860 INFO:teuthology.orchestra.run.smithi003.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 671 kB/s | 45 kB 00:00 2024-09-19T05:59:09.977 INFO:teuthology.orchestra.run.smithi003.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 157 kB/s | 22 kB 00:00 2024-09-19T05:59:09.980 INFO:teuthology.orchestra.run.smithi071.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 4.6 MB/s | 5.8 MB 00:01 2024-09-19T05:59:10.044 INFO:teuthology.orchestra.run.smithi003.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-19T05:59:10.078 INFO:teuthology.orchestra.run.smithi003.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-19T05:59:10.103 INFO:teuthology.orchestra.run.smithi003.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 785 kB/s | 19 kB 00:00 2024-09-19T05:59:10.170 INFO:teuthology.orchestra.run.smithi003.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.7 MB/s | 863 kB 00:00 2024-09-19T05:59:10.206 INFO:teuthology.orchestra.run.smithi071.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 119 kB/s | 87 kB 00:00 2024-09-19T05:59:10.220 INFO:teuthology.orchestra.run.smithi003.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 525 kB/s | 26 kB 00:00 2024-09-19T05:59:10.245 INFO:teuthology.orchestra.run.smithi003.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T05:59:10.271 INFO:teuthology.orchestra.run.smithi003.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-19T05:59:10.304 INFO:teuthology.orchestra.run.smithi003.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-19T05:59:10.346 INFO:teuthology.orchestra.run.smithi003.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-19T05:59:10.364 INFO:teuthology.orchestra.run.smithi071.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-09-19T05:59:10.421 INFO:teuthology.orchestra.run.smithi003.stdout:(113/156): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-19T05:59:10.472 INFO:teuthology.orchestra.run.smithi003.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-09-19T05:59:10.514 INFO:teuthology.orchestra.run.smithi003.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 819 kB/s | 32 kB 00:00 2024-09-19T05:59:10.531 INFO:teuthology.orchestra.run.smithi003.stdout:(116/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 401 kB/s | 43 kB 00:00 2024-09-19T05:59:10.548 INFO:teuthology.orchestra.run.smithi003.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 423 kB/s | 14 kB 00:00 2024-09-19T05:59:10.573 INFO:teuthology.orchestra.run.smithi003.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-19T05:59:10.580 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2024-09-19T05:59:10.581 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2024-09-19T05:59:10.607 INFO:teuthology.orchestra.run.smithi003.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-19T05:59:10.632 INFO:teuthology.orchestra.run.smithi003.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-19T05:59:10.666 INFO:teuthology.orchestra.run.smithi003.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-19T05:59:10.692 INFO:teuthology.orchestra.run.smithi003.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-19T05:59:10.716 INFO:teuthology.orchestra.run.smithi003.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-19T05:59:10.741 INFO:teuthology.orchestra.run.smithi003.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 714 kB/s | 18 kB 00:00 2024-09-19T05:59:10.767 INFO:teuthology.orchestra.run.smithi003.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 933 kB/s | 23 kB 00:00 2024-09-19T05:59:10.792 INFO:teuthology.orchestra.run.smithi003.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 783 kB/s | 19 kB 00:00 2024-09-19T05:59:10.817 INFO:teuthology.orchestra.run.smithi003.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 795 kB/s | 20 kB 00:00 2024-09-19T05:59:10.822 INFO:teuthology.orchestra.run.smithi071.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 99 kB/s | 61 kB 00:00 2024-09-19T05:59:10.876 INFO:teuthology.orchestra.run.smithi003.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 18 MB/s | 1.0 MB 00:00 2024-09-19T05:59:10.902 INFO:teuthology.orchestra.run.smithi003.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T05:59:10.926 INFO:teuthology.orchestra.run.smithi003.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T05:59:10.951 INFO:teuthology.orchestra.run.smithi003.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T05:59:11.002 INFO:teuthology.orchestra.run.smithi003.stdout:(132/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.5 MB/s | 2.0 MB 00:00 2024-09-19T05:59:11.027 INFO:teuthology.orchestra.run.smithi003.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-19T05:59:11.096 INFO:teuthology.orchestra.run.smithi003.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-19T05:59:11.128 INFO:teuthology.orchestra.run.smithi003.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 900 kB/s | 90 kB 00:00 2024-09-19T05:59:11.153 INFO:teuthology.orchestra.run.smithi003.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 501 kB/s | 28 kB 00:00 2024-09-19T05:59:11.178 INFO:teuthology.orchestra.run.smithi003.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-09-19T05:59:11.203 INFO:teuthology.orchestra.run.smithi003.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T05:59:11.228 INFO:teuthology.orchestra.run.smithi003.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-19T05:59:11.231 INFO:teuthology.orchestra.run.smithi071.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.8 MB/s | 6.0 MB 00:01 2024-09-19T05:59:11.254 INFO:teuthology.orchestra.run.smithi003.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-19T05:59:11.256 INFO:teuthology.orchestra.run.smithi071.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 274 kB/s | 245 kB 00:00 2024-09-19T05:59:11.279 INFO:teuthology.orchestra.run.smithi003.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-19T05:59:11.304 INFO:teuthology.orchestra.run.smithi003.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T05:59:11.330 INFO:teuthology.orchestra.run.smithi003.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-19T05:59:11.355 INFO:teuthology.orchestra.run.smithi003.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 805 kB/s | 20 kB 00:00 2024-09-19T05:59:11.380 INFO:teuthology.orchestra.run.smithi003.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-19T05:59:11.406 INFO:teuthology.orchestra.run.smithi003.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-19T05:59:11.464 INFO:teuthology.orchestra.run.smithi003.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-19T05:59:11.631 INFO:teuthology.orchestra.run.smithi071.stdout:(78/156): python3-jinja2-2.11.3-6.el9.noarch.rp 307 kB/s | 248 kB 00:00 2024-09-19T05:59:11.790 INFO:teuthology.orchestra.run.smithi071.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 36 kB/s | 19 kB 00:00 2024-09-19T05:59:11.807 INFO:teuthology.orchestra.run.smithi071.stdout:(80/156): python3-jsonpatch-1.21-16.el9.noarch. 45 kB/s | 26 kB 00:00 2024-09-19T05:59:11.936 INFO:teuthology.orchestra.run.smithi003.stdout:(148/156): librbd1-19.1.1-361.g2f599a46.el9.x86 6.7 MB/s | 3.2 MB 00:00 2024-09-19T05:59:12.024 INFO:teuthology.orchestra.run.smithi003.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 5.5 MB/s | 3.4 MB 00:00 2024-09-19T05:59:12.157 INFO:teuthology.orchestra.run.smithi003.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 11 MB/s | 2.3 MB 00:00 2024-09-19T05:59:12.199 INFO:teuthology.orchestra.run.smithi003.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 983 kB/s | 41 kB 00:00 2024-09-19T05:59:12.258 INFO:teuthology.orchestra.run.smithi003.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 4.2 MB/s | 249 kB 00:00 2024-09-19T05:59:12.316 INFO:teuthology.orchestra.run.smithi003.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 6.2 MB/s | 1.8 MB 00:00 2024-09-19T05:59:12.349 INFO:teuthology.orchestra.run.smithi071.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 62 kB/s | 35 kB 00:00 2024-09-19T05:59:12.367 INFO:teuthology.orchestra.run.smithi003.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-19T05:59:12.374 INFO:teuthology.orchestra.run.smithi071.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 232 kB/s | 172 kB 00:00 2024-09-19T05:59:12.542 INFO:teuthology.orchestra.run.smithi003.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-09-19T05:59:12.991 INFO:teuthology.orchestra.run.smithi071.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.3 MB/s | 5.1 MB 00:01 2024-09-19T05:59:13.116 INFO:teuthology.orchestra.run.smithi071.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 300 kB/s | 222 kB 00:00 2024-09-19T05:59:13.141 INFO:teuthology.orchestra.run.smithi071.stdout:(85/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 316 kB/s | 250 kB 00:00 2024-09-19T05:59:13.634 INFO:teuthology.orchestra.run.smithi071.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 120 kB/s | 77 kB 00:00 2024-09-19T05:59:13.700 INFO:teuthology.orchestra.run.smithi071.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 73 kB/s | 42 kB 00:00 2024-09-19T05:59:13.909 INFO:teuthology.orchestra.run.smithi071.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 351 kB/s | 269 kB 00:00 2024-09-19T05:59:14.334 INFO:teuthology.orchestra.run.smithi071.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 227 kB/s | 159 kB 00:00 2024-09-19T05:59:14.459 INFO:teuthology.orchestra.run.smithi071.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 368 kB/s | 279 kB 00:00 2024-09-19T05:59:14.501 INFO:teuthology.orchestra.run.smithi071.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 86 kB/s | 51 kB 00:00 2024-09-19T05:59:14.775 INFO:teuthology.orchestra.run.smithi003.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.0 MB/s | 16 MB 00:05 2024-09-19T05:59:14.781 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:59:14.781 INFO:teuthology.orchestra.run.smithi003.stdout:Total 12 MB/s | 226 MB 00:18 2024-09-19T05:59:14.935 INFO:teuthology.orchestra.run.smithi071.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 89 kB/s | 54 kB 00:00 2024-09-19T05:59:15.060 INFO:teuthology.orchestra.run.smithi071.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 75 kB/s | 42 kB 00:00 2024-09-19T05:59:15.502 INFO:teuthology.orchestra.run.smithi071.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 78 kB/s | 44 kB 00:00 2024-09-19T05:59:15.877 INFO:teuthology.orchestra.run.smithi071.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-19T05:59:15.902 INFO:teuthology.orchestra.run.smithi071.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 262 kB/s | 221 kB 00:00 2024-09-19T05:59:16.153 INFO:teuthology.orchestra.run.smithi071.stdout:(97/156): qatlib-service-24.02.0-1.el9.x86_64.r 55 kB/s | 36 kB 00:00 2024-09-19T05:59:16.494 INFO:teuthology.orchestra.run.smithi071.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 77 kB/s | 47 kB 00:00 2024-09-19T05:59:16.678 INFO:teuthology.orchestra.run.smithi071.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 392 kB/s | 304 kB 00:00 2024-09-19T05:59:16.770 INFO:teuthology.orchestra.run.smithi071.stdout:(100/156): uuid-1.6.2-55.el9.x86_64.rpm 94 kB/s | 58 kB 00:00 2024-09-19T05:59:16.888 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-19T05:59:17.086 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-19T05:59:17.086 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-19T05:59:17.153 INFO:teuthology.orchestra.run.smithi071.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 145 kB/s | 96 kB 00:00 2024-09-19T05:59:17.320 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2024-09-19T05:59:17.362 INFO:teuthology.orchestra.run.smithi071.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 93 kB/s | 64 kB 00:00 2024-09-19T05:59:17.387 INFO:teuthology.orchestra.run.smithi071.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 73 kB/s | 45 kB 00:00 2024-09-19T05:59:17.398 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T05:59:17.438 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T05:59:17.438 INFO:teuthology.orchestra.run.smithi071.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 79 kB/s | 22 kB 00:00 2024-09-19T05:59:17.463 INFO:teuthology.orchestra.run.smithi071.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-09-19T05:59:17.496 INFO:teuthology.orchestra.run.smithi071.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 759 kB/s | 19 kB 00:00 2024-09-19T05:59:17.500 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T05:59:17.542 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T05:59:17.547 INFO:teuthology.orchestra.run.smithi071.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-19T05:59:17.566 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T05:59:17.572 INFO:teuthology.orchestra.run.smithi071.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T05:59:17.605 INFO:teuthology.orchestra.run.smithi071.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-19T05:59:17.610 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T05:59:17.639 INFO:teuthology.orchestra.run.smithi071.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-19T05:59:17.681 INFO:teuthology.orchestra.run.smithi071.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-19T05:59:17.740 INFO:teuthology.orchestra.run.smithi071.stdout:(112/156): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-19T05:59:17.782 INFO:teuthology.orchestra.run.smithi071.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-19T05:59:17.807 INFO:teuthology.orchestra.run.smithi071.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T05:59:17.832 INFO:teuthology.orchestra.run.smithi071.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T05:59:17.857 INFO:teuthology.orchestra.run.smithi071.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-19T05:59:17.891 INFO:teuthology.orchestra.run.smithi071.stdout:(117/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.9 MB/s | 839 kB 00:00 2024-09-19T05:59:17.916 INFO:teuthology.orchestra.run.smithi071.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-19T05:59:17.942 INFO:teuthology.orchestra.run.smithi071.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-19T05:59:17.957 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T05:59:17.967 INFO:teuthology.orchestra.run.smithi071.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-19T05:59:17.992 INFO:teuthology.orchestra.run.smithi071.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T05:59:18.026 INFO:teuthology.orchestra.run.smithi071.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-19T05:59:18.051 INFO:teuthology.orchestra.run.smithi071.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-19T05:59:18.068 INFO:teuthology.orchestra.run.smithi071.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-19T05:59:18.083 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:59:18.085 INFO:teuthology.orchestra.run.smithi071.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-19T05:59:18.102 INFO:teuthology.orchestra.run.smithi071.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.2 MB/s | 19 kB 00:00 2024-09-19T05:59:18.119 INFO:teuthology.orchestra.run.smithi071.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-19T05:59:18.169 INFO:teuthology.orchestra.run.smithi071.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 10 MB/s | 2.0 MB 00:00 2024-09-19T05:59:18.186 INFO:teuthology.orchestra.run.smithi071.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-19T05:59:18.208 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:59:18.211 INFO:teuthology.orchestra.run.smithi071.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T05:59:18.228 INFO:teuthology.orchestra.run.smithi071.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-19T05:59:18.243 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:59:18.262 INFO:teuthology.orchestra.run.smithi071.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-19T05:59:18.296 INFO:teuthology.orchestra.run.smithi071.stdout:(133/156): protobuf-compiler-3.14.0-13.el9.x86_ 926 kB/s | 863 kB 00:00 2024-09-19T05:59:18.321 INFO:teuthology.orchestra.run.smithi071.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-09-19T05:59:18.335 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:59:18.354 INFO:teuthology.orchestra.run.smithi071.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-09-19T05:59:18.364 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:59:18.388 INFO:teuthology.orchestra.run.smithi071.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-19T05:59:18.413 INFO:teuthology.orchestra.run.smithi071.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 603 kB/s | 31 kB 00:00 2024-09-19T05:59:18.439 INFO:teuthology.orchestra.run.smithi071.stdout:(138/156): python3-pyperclip-1.8.2-2.el9.noarch 241 kB/s | 28 kB 00:00 2024-09-19T05:59:18.464 INFO:teuthology.orchestra.run.smithi071.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-19T05:59:18.489 INFO:teuthology.orchestra.run.smithi071.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-19T05:59:18.514 INFO:teuthology.orchestra.run.smithi071.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-19T05:59:18.527 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T05:59:18.539 INFO:teuthology.orchestra.run.smithi071.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 989 kB/s | 74 kB 00:00 2024-09-19T05:59:18.565 INFO:teuthology.orchestra.run.smithi071.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T05:59:18.586 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T05:59:18.599 INFO:teuthology.orchestra.run.smithi071.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 597 kB/s | 20 kB 00:00 2024-09-19T05:59:18.622 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:59:18.632 INFO:teuthology.orchestra.run.smithi071.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-09-19T05:59:18.666 INFO:teuthology.orchestra.run.smithi071.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-19T05:59:18.691 INFO:teuthology.orchestra.run.smithi071.stdout:(147/156): re2-20211101-20.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-19T05:59:18.727 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:59:18.741 INFO:teuthology.orchestra.run.smithi071.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T05:59:18.756 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:59:18.819 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:59:18.841 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:59:18.863 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:59:18.975 INFO:teuthology.orchestra.run.smithi071.stdout:(149/156): librbd1-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-19T05:59:19.033 INFO:teuthology.orchestra.run.smithi071.stdout:(150/156): librados2-19.1.1-361.g2f599a46.el9.x 9.3 MB/s | 3.4 MB 00:00 2024-09-19T05:59:19.051 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:59:19.084 INFO:teuthology.orchestra.run.smithi071.stdout:(151/156): NetworkManager-1.51.0-1.el9.x86_64.r 6.8 MB/s | 2.3 MB 00:00 2024-09-19T05:59:19.134 INFO:teuthology.orchestra.run.smithi071.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 4.9 MB/s | 249 kB 00:00 2024-09-19T05:59:19.167 INFO:teuthology.orchestra.run.smithi071.stdout:(153/156): NetworkManager-team-1.51.0-1.el9.x86 306 kB/s | 41 kB 00:00 2024-09-19T05:59:19.206 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:59:19.210 INFO:teuthology.orchestra.run.smithi071.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 18 MB/s | 1.4 MB 00:00 2024-09-19T05:59:19.285 INFO:teuthology.orchestra.run.smithi071.stdout:(155/156): NetworkManager-libnm-1.51.0-1.el9.x8 5.8 MB/s | 1.8 MB 00:00 2024-09-19T05:59:19.338 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T05:59:19.360 INFO:teuthology.orchestra.run.smithi071.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-09-19T05:59:19.366 INFO:teuthology.orchestra.run.smithi071.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:59:19.367 INFO:teuthology.orchestra.run.smithi071.stdout:Total 9.6 MB/s | 226 MB 00:23 2024-09-19T05:59:19.445 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:59:19.541 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-19T05:59:19.565 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:59:19.571 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-19T05:59:19.795 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:59:19.908 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T05:59:20.005 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T05:59:20.036 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T05:59:20.080 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T05:59:20.159 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T05:59:20.211 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T05:59:20.262 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T05:59:20.319 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T05:59:20.359 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T05:59:20.386 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T05:59:20.458 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T05:59:20.510 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T05:59:20.539 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T05:59:20.583 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T05:59:20.610 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction check 2024-09-19T05:59:20.662 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T05:59:20.694 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T05:59:20.746 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T05:59:20.763 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction check succeeded. 2024-09-19T05:59:20.763 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction test 2024-09-19T05:59:20.782 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T05:59:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T05:59:20.906 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T05:59:20.992 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T05:59:21.139 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T05:59:21.193 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T05:59:21.764 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T05:59:21.849 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T05:59:21.882 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T05:59:21.926 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T05:59:21.964 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T05:59:22.006 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T05:59:22.169 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T05:59:22.241 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T05:59:22.305 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T05:59:22.380 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T05:59:22.416 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T05:59:22.452 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T05:59:22.500 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T05:59:22.535 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T05:59:22.563 INFO:teuthology.orchestra.run.smithi071.stdout:Transaction test succeeded. 2024-09-19T05:59:22.566 INFO:teuthology.orchestra.run.smithi071.stdout:Running transaction 2024-09-19T05:59:22.579 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T05:59:22.621 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T05:59:22.772 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T05:59:22.888 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T05:59:23.306 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T05:59:23.427 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T05:59:23.463 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T05:59:23.503 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T05:59:23.529 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T05:59:23.553 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T05:59:23.633 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T05:59:23.886 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T05:59:23.927 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T05:59:23.955 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T05:59:23.989 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T05:59:24.037 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T05:59:24.085 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T05:59:24.115 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T05:59:24.149 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T05:59:24.182 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T05:59:24.224 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T05:59:24.259 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T05:59:24.349 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T05:59:24.406 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T05:59:24.445 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T05:59:24.554 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T05:59:24.606 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T05:59:25.388 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T05:59:25.435 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T05:59:25.468 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T05:59:25.583 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T05:59:25.632 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T05:59:25.678 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T05:59:25.769 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T05:59:25.804 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T05:59:25.997 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T05:59:26.028 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T05:59:26.108 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T05:59:26.537 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-19T05:59:26.713 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T05:59:26.799 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T05:59:26.894 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T05:59:26.914 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T05:59:27.073 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T05:59:27.116 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T05:59:27.147 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T05:59:27.205 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T05:59:27.589 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T05:59:27.706 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:59:27.845 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:59:27.873 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:59:27.979 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:59:28.018 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:59:28.230 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T05:59:28.234 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T05:59:28.306 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T05:59:28.322 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T05:59:28.335 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:59:28.351 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T05:59:28.384 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T05:59:28.496 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:59:28.528 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:59:28.611 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:59:28.638 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:59:28.678 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:59:28.709 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T05:59:28.747 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:59:28.838 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:59:28.876 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T05:59:28.898 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:59:28.913 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T05:59:28.952 INFO:teuthology.orchestra.run.smithi071.stdout: Preparing : 1/1 2024-09-19T05:59:29.088 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T05:59:29.093 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:59:29.126 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T05:59:29.180 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T05:59:29.221 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T05:59:29.256 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T05:59:29.294 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T05:59:29.298 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T05:59:29.411 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:59:29.420 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T05:59:29.458 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:59:29.503 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:59:29.512 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:59:29.534 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T05:59:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T05:59:29.731 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:59:29.806 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:59:29.853 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:59:29.882 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:59:29.954 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T05:59:29.974 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:59:30.003 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:59:30.077 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T05:59:30.122 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T05:59:30.150 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T05:59:30.189 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T05:59:30.208 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T05:59:30.236 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:59:30.273 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T05:59:30.324 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:59:30.325 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T05:59:30.354 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:59:30.364 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T05:59:30.400 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:59:30.422 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:59:30.426 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T05:59:30.443 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:59:30.473 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T05:59:30.506 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T05:59:30.598 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T05:59:30.631 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:59:30.660 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T05:59:30.697 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T05:59:30.759 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:59:30.764 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T05:59:30.849 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T05:59:30.869 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T05:59:30.889 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T05:59:30.933 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T05:59:30.969 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T05:59:30.972 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:59:31.046 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:59:31.072 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T05:59:31.138 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T05:59:31.234 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T05:59:31.295 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:59:31.403 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T05:59:31.406 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T05:59:31.466 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T05:59:31.497 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T05:59:31.534 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T05:59:31.568 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T05:59:31.634 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T05:59:31.690 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T05:59:31.721 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T05:59:31.765 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T05:59:31.797 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T05:59:31.826 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T05:59:31.894 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T05:59:31.897 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:59:31.930 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:59:31.948 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T05:59:31.987 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T05:59:32.030 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T05:59:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T05:59:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T05:59:32.155 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T05:59:32.184 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T05:59:32.213 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T05:59:32.260 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T05:59:32.283 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T05:59:32.302 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T05:59:32.327 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T05:59:32.346 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T05:59:32.384 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T05:59:32.403 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T05:59:32.441 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T05:59:32.504 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:59:32.542 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:59:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T05:59:32.597 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T05:59:32.627 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:59:32.627 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T05:59:32.627 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T05:59:32.627 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-19T05:59:32.636 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T05:59:32.651 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:59:32.704 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T05:59:32.774 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T05:59:32.860 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T05:59:32.904 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T05:59:32.940 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T05:59:33.000 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T05:59:33.064 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T05:59:33.110 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T05:59:33.124 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T05:59:33.161 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T05:59:33.209 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T05:59:33.246 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T05:59:33.289 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T05:59:33.327 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T05:59:33.348 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T05:59:33.368 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T05:59:33.401 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T05:59:33.448 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T05:59:33.541 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T05:59:33.587 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T05:59:33.595 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T05:59:33.650 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T05:59:33.655 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T05:59:33.697 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T05:59:33.726 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T05:59:33.731 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T05:59:33.751 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T05:59:33.763 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T05:59:33.808 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T05:59:33.854 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T05:59:33.869 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T05:59:33.890 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T05:59:33.933 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T05:59:33.975 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T05:59:34.034 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T05:59:34.076 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T05:59:34.111 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T05:59:34.112 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T05:59:34.147 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T05:59:34.152 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T05:59:34.201 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T05:59:34.229 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T05:59:34.269 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T05:59:34.304 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T05:59:34.306 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T05:59:34.335 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T05:59:34.341 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T05:59:34.375 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T05:59:34.390 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T05:59:34.401 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T05:59:34.425 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T05:59:34.434 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T05:59:34.466 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T05:59:34.500 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T05:59:34.571 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T05:59:34.626 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T05:59:34.628 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T05:59:34.662 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T05:59:34.674 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T05:59:34.710 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T05:59:34.744 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T05:59:34.784 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T05:59:34.798 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T05:59:34.815 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T05:59:34.845 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T05:59:34.885 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T05:59:34.888 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T05:59:34.921 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T05:59:34.963 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T05:59:34.997 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T05:59:35.084 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T05:59:35.136 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T05:59:35.167 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T05:59:35.272 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T05:59:35.318 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T05:59:35.832 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T05:59:35.886 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T05:59:35.954 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T05:59:36.043 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T05:59:36.070 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T05:59:36.092 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T05:59:36.123 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T05:59:36.136 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T05:59:36.191 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T05:59:36.222 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T05:59:36.270 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T05:59:36.308 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T05:59:36.315 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T05:59:36.355 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T05:59:36.402 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T05:59:36.442 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T05:59:36.609 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T05:59:36.626 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T05:59:36.644 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T05:59:36.657 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T05:59:36.735 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T05:59:36.743 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T05:59:37.384 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T05:59:37.496 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T05:59:37.607 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T05:59:37.769 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T05:59:38.735 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T05:59:38.811 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T05:59:38.839 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T05:59:38.872 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T05:59:39.182 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T05:59:39.227 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:59:39.317 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:59:39.348 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T05:59:39.384 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T05:59:39.413 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T05:59:39.522 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T05:59:39.568 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T05:59:39.600 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T05:59:39.873 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T05:59:39.905 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:59:39.961 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T05:59:39.976 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:59:40.006 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T05:59:40.053 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:59:40.566 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:59:40.601 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T05:59:40.649 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T05:59:41.203 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T05:59:41.247 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:59:41.322 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:59:41.349 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T05:59:42.273 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:59:42.310 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:59:42.853 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:59:42.889 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:59:42.966 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:59:42.966 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T05:59:42.966 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T05:59:42.966 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-19T05:59:42.998 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:59:43.948 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:59:43.995 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:59:44.635 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:59:44.737 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /sys 2024-09-19T05:59:44.737 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /proc 2024-09-19T05:59:44.737 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /mnt 2024-09-19T05:59:44.737 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /var/tmp 2024-09-19T05:59:44.737 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /home 2024-09-19T05:59:44.737 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /root 2024-09-19T05:59:44.737 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /tmp 2024-09-19T05:59:44.737 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-19T05:59:44.738 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:59:44.738 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:59:44.812 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:59:44.822 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:59:44.822 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T05:59:44.822 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T05:59:44.822 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T05:59:44.827 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:59:44.828 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:59:44.828 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T05:59:44.828 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-19T05:59:44.866 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:59:46.356 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:59:46.383 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:59:46.383 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:59:46.383 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T05:59:46.383 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:59:46.383 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:59:46.383 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-19T05:59:46.623 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:59:46.647 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:59:46.647 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:59:46.647 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T05:59:46.647 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:59:46.647 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:59:46.648 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-19T05:59:47.107 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:59:47.131 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:59:47.131 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:59:47.131 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T05:59:47.131 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:59:47.131 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:59:47.132 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-19T05:59:47.247 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T05:59:47.305 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T05:59:47.370 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T05:59:47.592 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T05:59:47.642 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T05:59:47.724 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T05:59:47.812 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T05:59:47.956 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T05:59:48.009 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T05:59:48.040 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T05:59:48.067 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T05:59:48.480 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:59:48.508 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:59:48.540 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T05:59:48.605 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T05:59:48.630 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:59:49.741 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:59:49.774 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:59:50.789 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:59:50.816 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:59:50.926 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:59:51.093 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T05:59:51.118 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:59:51.141 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:59:51.142 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:59:51.142 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T05:59:51.142 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:59:51.142 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:59:51.142 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-19T05:59:51.193 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:59:51.205 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:59:51.307 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T05:59:51.359 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T05:59:52.335 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T05:59:52.371 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:59:52.395 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:59:52.395 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:59:52.395 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T05:59:52.395 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:59:52.395 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:59:52.395 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-19T05:59:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:59:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:59:52.461 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:59:52.462 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T05:59:52.462 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-19T05:59:52.514 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:59:52.537 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:59:52.537 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:59:52.537 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T05:59:52.537 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:59:52.537 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:59:52.537 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-19T05:59:52.848 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:59:52.871 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:59:52.871 INFO:teuthology.orchestra.run.smithi059.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:59:52.871 INFO:teuthology.orchestra.run.smithi059.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T05:59:52.871 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:59:52.871 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:59:52.872 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-19T05:59:54.953 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:59:54.953 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /sys 2024-09-19T05:59:54.953 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /proc 2024-09-19T05:59:54.953 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /mnt 2024-09-19T05:59:54.954 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /var/tmp 2024-09-19T05:59:54.954 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /home 2024-09-19T05:59:54.954 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /root 2024-09-19T05:59:54.954 INFO:teuthology.orchestra.run.smithi071.stdout:skipping the directory /tmp 2024-09-19T05:59:54.954 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-19T05:59:55.141 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:59:55.157 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:59:55.157 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:59:55.157 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T05:59:55.157 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-19T05:59:56.618 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:59:56.645 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:59:56.645 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:59:56.645 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T05:59:56.646 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:59:56.646 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:59:56.646 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-19T05:59:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:59:56.893 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:59:56.893 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:59:56.893 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T05:59:56.893 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:59:56.893 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:59:56.893 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-19T05:59:57.328 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:59:57.352 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:59:57.352 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:59:57.352 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T05:59:57.352 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:59:57.352 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:59:57.352 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-19T05:59:57.466 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T05:59:57.515 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T05:59:57.569 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T05:59:57.677 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T05:59:57.718 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T05:59:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T05:59:57.759 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T05:59:57.791 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T05:59:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T05:59:57.818 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T05:59:57.881 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T05:59:57.969 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T05:59:58.013 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T05:59:58.056 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T05:59:58.058 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:59:58.059 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /sys 2024-09-19T05:59:58.059 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /proc 2024-09-19T05:59:58.059 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /mnt 2024-09-19T05:59:58.059 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /var/tmp 2024-09-19T05:59:58.059 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /home 2024-09-19T05:59:58.059 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /root 2024-09-19T05:59:58.059 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /tmp 2024-09-19T05:59:58.059 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T05:59:58.086 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T05:59:58.108 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T05:59:58.116 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T05:59:58.153 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T05:59:58.162 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T05:59:58.185 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T05:59:58.213 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T05:59:58.276 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:59:58.312 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:59:58.312 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:59:58.313 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T05:59:58.313 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T05:59:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:59:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:59:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T05:59:58.746 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:59:58.779 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T05:59:58.792 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:59:58.809 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:59:58.813 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:59:59.717 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T05:59:59.857 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:59:59.894 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:59:59.946 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T05:59:59.953 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:59:59.989 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T06:00:00.011 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T06:00:00.012 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:00:00.012 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T06:00:00.012 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:00:00.012 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:00:00.012 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:00:00.074 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T06:00:00.107 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T06:00:00.149 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T06:00:00.175 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T06:00:00.176 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:00:00.259 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:00:00.259 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:00:00.270 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:00:00.322 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T06:00:00.322 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:00:00.323 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T06:00:00.323 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:00:00.323 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:00:00.323 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:00:00.344 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:00:00.368 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T06:00:00.374 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:00:00.374 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:00:00.554 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:00:00.554 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:00:00.638 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:00:00.703 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:00:00.829 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:00:00.854 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:00:00.879 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:00:00.880 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T06:00:00.880 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:00:00.880 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T06:00:00.880 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:00:00.880 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:00:00.880 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:00:00.994 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:00:01.013 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T06:00:01.075 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T06:00:01.148 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T06:00:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T06:00:01.188 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:00:01.213 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:00:01.213 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:00:01.213 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T06:00:01.213 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:00:01.213 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:00:01.213 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-19T06:00:01.264 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:00:01.276 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:00:01.373 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T06:00:01.426 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T06:00:01.428 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T06:00:01.484 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T06:00:01.573 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T06:00:01.691 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T06:00:01.878 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T06:00:01.936 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T06:00:01.973 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T06:00:01.998 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T06:00:02.347 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T06:00:02.375 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:00:02.398 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:00:02.399 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:00:02.399 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T06:00:02.399 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:00:02.399 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:00:02.399 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-19T06:00:02.442 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:00:02.465 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:00:02.465 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:00:02.465 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T06:00:02.465 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-19T06:00:02.471 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:00:02.514 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T06:00:02.517 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:00:02.541 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:00:02.541 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:00:02.541 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T06:00:02.541 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:00:02.541 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:00:02.541 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-19T06:00:02.581 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T06:00:02.667 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T06:00:02.703 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:00:02.843 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:00:02.866 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:00:02.866 INFO:teuthology.orchestra.run.smithi071.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:00:02.867 INFO:teuthology.orchestra.run.smithi071.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T06:00:02.867 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:00:02.867 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:00:02.867 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-19T06:00:04.006 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T06:00:04.071 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:00:05.221 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T06:00:05.254 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:00:05.399 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T06:00:05.578 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T06:00:05.607 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:00:05.658 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T06:00:05.658 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:00:05.658 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T06:00:05.658 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:00:05.658 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:00:05.658 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:00:05.724 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:00:05.751 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T06:00:05.894 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T06:00:05.969 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T06:00:06.254 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:00:06.254 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T06:00:06.254 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T06:00:06.254 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T06:00:06.255 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T06:00:06.255 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T06:00:06.255 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T06:00:06.255 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T06:00:06.255 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:00:06.255 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:00:06.255 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:00:06.255 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T06:00:06.255 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T06:00:06.255 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:00:06.255 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T06:00:06.255 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T06:00:06.256 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T06:00:06.256 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T06:00:06.256 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T06:00:06.256 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T06:00:06.256 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T06:00:06.256 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T06:00:06.256 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T06:00:06.256 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T06:00:06.256 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T06:00:06.256 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T06:00:06.256 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T06:00:06.257 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T06:00:06.257 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T06:00:06.257 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T06:00:06.257 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T06:00:06.257 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T06:00:06.257 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T06:00:06.257 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T06:00:06.257 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T06:00:06.257 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T06:00:06.257 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T06:00:06.257 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T06:00:06.257 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T06:00:06.258 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T06:00:06.258 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T06:00:06.258 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T06:00:06.258 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T06:00:06.258 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T06:00:06.258 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T06:00:06.258 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T06:00:06.258 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T06:00:06.258 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T06:00:06.258 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T06:00:06.258 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T06:00:06.258 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T06:00:06.258 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T06:00:06.259 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T06:00:06.259 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T06:00:06.259 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T06:00:06.259 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T06:00:06.259 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T06:00:06.259 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T06:00:06.259 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T06:00:06.259 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T06:00:06.259 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T06:00:06.259 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T06:00:06.259 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T06:00:06.259 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T06:00:06.260 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T06:00:06.260 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T06:00:06.260 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T06:00:06.260 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T06:00:06.260 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T06:00:06.260 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T06:00:06.260 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T06:00:06.260 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T06:00:06.260 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T06:00:06.260 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T06:00:06.260 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T06:00:06.260 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T06:00:06.261 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T06:00:06.261 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T06:00:06.261 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T06:00:06.261 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T06:00:06.261 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T06:00:06.261 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T06:00:06.261 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T06:00:06.261 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T06:00:06.261 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T06:00:06.261 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T06:00:06.261 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T06:00:06.261 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T06:00:06.262 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T06:00:06.262 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T06:00:06.262 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T06:00:06.262 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T06:00:06.262 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T06:00:06.262 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T06:00:06.262 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T06:00:06.262 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T06:00:06.262 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T06:00:06.262 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T06:00:06.262 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T06:00:06.263 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T06:00:06.263 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T06:00:06.263 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T06:00:06.263 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T06:00:06.263 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T06:00:06.263 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T06:00:06.263 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T06:00:06.263 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T06:00:06.263 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T06:00:06.263 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T06:00:06.263 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T06:00:06.264 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T06:00:06.264 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T06:00:06.264 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T06:00:06.264 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T06:00:06.264 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T06:00:06.264 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T06:00:06.264 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T06:00:06.264 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T06:00:06.264 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T06:00:06.264 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T06:00:06.264 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T06:00:06.264 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T06:00:06.265 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T06:00:06.265 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T06:00:06.265 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T06:00:06.265 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T06:00:06.265 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T06:00:06.265 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T06:00:06.265 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T06:00:06.265 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T06:00:06.265 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T06:00:06.265 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T06:00:06.265 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T06:00:06.265 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T06:00:06.265 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T06:00:06.266 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T06:00:06.266 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T06:00:06.266 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T06:00:06.266 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T06:00:06.266 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T06:00:06.266 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T06:00:06.266 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T06:00:06.266 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T06:00:06.266 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T06:00:06.266 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T06:00:06.266 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T06:00:06.266 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T06:00:06.266 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T06:00:06.267 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T06:00:06.267 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T06:00:06.267 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T06:00:06.267 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T06:00:06.267 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T06:00:06.267 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T06:00:06.267 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T06:00:06.267 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T06:00:06.267 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T06:00:06.267 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T06:00:06.267 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T06:00:06.267 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T06:00:06.267 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T06:00:06.268 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T06:00:06.268 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T06:00:06.268 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T06:00:07.033 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T06:00:07.085 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:00:07.138 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T06:00:07.138 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:00:07.138 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T06:00:07.138 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:00:07.138 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:00:07.138 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:00:07.186 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:00:07.236 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T06:00:07.236 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:00:07.236 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T06:00:07.236 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:00:07.295 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:00:07.345 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T06:00:07.346 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:00:07.346 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T06:00:07.346 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:00:07.346 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T06:00:07.346 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:00:07.388 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T06:00:07.429 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T06:00:07.470 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T06:00:07.502 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T06:00:07.530 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T06:00:07.695 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:00:07.710 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T06:00:07.746 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T06:00:07.747 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:00:07.747 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T06:00:07.747 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:00:07.747 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:00:07.747 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:00:07.751 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T06:00:07.781 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T06:00:07.810 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T06:00:07.849 INFO:teuthology.orchestra.run.smithi071.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T06:00:08.480 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:00:08.521 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:00:08.542 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:00:08.787 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:00:08.788 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-19T06:00:08.788 INFO:teuthology.orchestra.run.smithi059.stdout:Upgraded: 2024-09-19T06:00:08.788 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T06:00:08.788 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T06:00:08.788 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T06:00:08.788 INFO:teuthology.orchestra.run.smithi059.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T06:00:08.788 INFO:teuthology.orchestra.run.smithi059.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.788 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.788 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T06:00:08.788 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T06:00:08.788 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2024-09-19T06:00:08.789 INFO:teuthology.orchestra.run.smithi059.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T06:00:08.789 INFO:teuthology.orchestra.run.smithi059.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T06:00:08.789 INFO:teuthology.orchestra.run.smithi059.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T06:00:08.789 INFO:teuthology.orchestra.run.smithi059.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T06:00:08.789 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.789 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.789 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.789 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.789 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:08.789 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.789 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.789 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.790 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:08.790 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:08.790 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:08.790 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:08.790 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:08.790 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.790 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.790 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:08.790 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.790 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.790 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.790 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:08.790 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:08.791 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.791 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.791 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:08.791 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T06:00:08.791 INFO:teuthology.orchestra.run.smithi059.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T06:00:08.791 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T06:00:08.791 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T06:00:08.791 INFO:teuthology.orchestra.run.smithi059.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T06:00:08.791 INFO:teuthology.orchestra.run.smithi059.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T06:00:08.791 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T06:00:08.791 INFO:teuthology.orchestra.run.smithi059.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T06:00:08.791 INFO:teuthology.orchestra.run.smithi059.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T06:00:08.791 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T06:00:08.792 INFO:teuthology.orchestra.run.smithi059.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T06:00:08.792 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.792 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.792 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.792 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T06:00:08.792 INFO:teuthology.orchestra.run.smithi059.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T06:00:08.792 INFO:teuthology.orchestra.run.smithi059.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T06:00:08.792 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T06:00:08.792 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T06:00:08.792 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.792 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.792 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T06:00:08.793 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.793 INFO:teuthology.orchestra.run.smithi059.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T06:00:08.793 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T06:00:08.793 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T06:00:08.793 INFO:teuthology.orchestra.run.smithi059.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T06:00:08.793 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T06:00:08.793 INFO:teuthology.orchestra.run.smithi059.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T06:00:08.793 INFO:teuthology.orchestra.run.smithi059.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T06:00:08.793 INFO:teuthology.orchestra.run.smithi059.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T06:00:08.793 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T06:00:08.793 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T06:00:08.793 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T06:00:08.793 INFO:teuthology.orchestra.run.smithi059.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T06:00:08.794 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T06:00:08.794 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T06:00:08.794 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T06:00:08.794 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T06:00:08.794 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T06:00:08.794 INFO:teuthology.orchestra.run.smithi059.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T06:00:08.794 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T06:00:08.794 INFO:teuthology.orchestra.run.smithi059.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T06:00:08.794 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T06:00:08.794 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T06:00:08.794 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T06:00:08.794 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.795 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.795 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.795 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T06:00:08.795 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T06:00:08.795 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T06:00:08.795 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T06:00:08.795 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T06:00:08.795 INFO:teuthology.orchestra.run.smithi059.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T06:00:08.795 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T06:00:08.795 INFO:teuthology.orchestra.run.smithi059.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T06:00:08.795 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T06:00:08.795 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T06:00:08.795 INFO:teuthology.orchestra.run.smithi059.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T06:00:08.796 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T06:00:08.796 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T06:00:08.796 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T06:00:08.796 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T06:00:08.796 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T06:00:08.796 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T06:00:08.796 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T06:00:08.797 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T06:00:08.797 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T06:00:08.797 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T06:00:08.797 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T06:00:08.797 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T06:00:08.797 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T06:00:08.797 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T06:00:08.797 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T06:00:08.797 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T06:00:08.797 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T06:00:08.797 INFO:teuthology.orchestra.run.smithi059.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T06:00:08.797 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T06:00:08.797 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T06:00:08.798 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T06:00:08.798 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T06:00:08.798 INFO:teuthology.orchestra.run.smithi059.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T06:00:08.798 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T06:00:08.798 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T06:00:08.798 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T06:00:08.798 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T06:00:08.798 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T06:00:08.798 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T06:00:08.798 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.798 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.798 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T06:00:08.798 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T06:00:08.798 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T06:00:08.799 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.799 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T06:00:08.799 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T06:00:08.799 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T06:00:08.799 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T06:00:08.799 INFO:teuthology.orchestra.run.smithi059.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T06:00:08.799 INFO:teuthology.orchestra.run.smithi059.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T06:00:08.799 INFO:teuthology.orchestra.run.smithi059.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T06:00:08.799 INFO:teuthology.orchestra.run.smithi059.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T06:00:08.799 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T06:00:08.799 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T06:00:08.799 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T06:00:08.799 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T06:00:08.799 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T06:00:08.799 INFO:teuthology.orchestra.run.smithi059.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T06:00:08.800 INFO:teuthology.orchestra.run.smithi059.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T06:00:08.800 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.800 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.800 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:08.800 INFO:teuthology.orchestra.run.smithi059.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T06:00:08.800 INFO:teuthology.orchestra.run.smithi059.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T06:00:08.800 INFO:teuthology.orchestra.run.smithi059.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T06:00:08.800 INFO:teuthology.orchestra.run.smithi059.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T06:00:08.800 INFO:teuthology.orchestra.run.smithi059.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T06:00:08.800 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T06:00:08.800 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T06:00:08.801 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-19T06:00:08.801 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2024-09-19T06:00:09.355 DEBUG:teuthology.parallel:result is None 2024-09-19T06:00:09.377 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T06:00:09.467 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T06:00:09.508 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T06:00:09.589 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T06:00:09.620 INFO:teuthology.orchestra.run.smithi071.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T06:00:09.645 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T06:00:09.671 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T06:00:09.671 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:00:09.755 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:00:09.755 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:00:09.839 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:00:09.864 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T06:00:09.870 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:00:09.870 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:00:10.050 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:00:10.050 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:00:10.133 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:00:10.204 INFO:teuthology.orchestra.run.smithi071.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:00:12.992 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T06:00:13.034 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T06:00:13.087 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T06:00:13.123 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T06:00:13.158 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T06:00:13.416 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T06:00:13.463 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T06:00:13.492 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T06:00:13.527 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T06:00:13.568 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T06:00:14.603 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:00:14.657 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:00:14.699 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T06:00:16.081 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T06:00:16.150 INFO:teuthology.orchestra.run.smithi071.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:00:16.150 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T06:00:16.150 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T06:00:16.150 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T06:00:16.151 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T06:00:16.151 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T06:00:16.151 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T06:00:16.151 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T06:00:16.151 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:00:16.151 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:00:16.151 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:00:16.151 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T06:00:16.151 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T06:00:16.151 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:00:16.151 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T06:00:16.151 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T06:00:16.151 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T06:00:16.152 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T06:00:16.152 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T06:00:16.152 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T06:00:16.152 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T06:00:16.152 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T06:00:16.152 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T06:00:16.152 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T06:00:16.152 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T06:00:16.152 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T06:00:16.152 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T06:00:16.152 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T06:00:16.164 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T06:00:16.164 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T06:00:16.164 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T06:00:16.164 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T06:00:16.164 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T06:00:16.164 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T06:00:16.164 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T06:00:16.164 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T06:00:16.165 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T06:00:16.165 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T06:00:16.165 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T06:00:16.165 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T06:00:16.165 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T06:00:16.165 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T06:00:16.165 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T06:00:16.165 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T06:00:16.165 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T06:00:16.165 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T06:00:16.165 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T06:00:16.165 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T06:00:16.166 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T06:00:16.166 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T06:00:16.166 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T06:00:16.166 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T06:00:16.166 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T06:00:16.166 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T06:00:16.166 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T06:00:16.166 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T06:00:16.166 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T06:00:16.166 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T06:00:16.166 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T06:00:16.166 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T06:00:16.166 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T06:00:16.166 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T06:00:16.167 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T06:00:16.167 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T06:00:16.167 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T06:00:16.167 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T06:00:16.167 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T06:00:16.167 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T06:00:16.167 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T06:00:16.167 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T06:00:16.167 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T06:00:16.167 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T06:00:16.167 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T06:00:16.167 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T06:00:16.168 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T06:00:16.168 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T06:00:16.168 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T06:00:16.168 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T06:00:16.168 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T06:00:16.168 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T06:00:16.168 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T06:00:16.168 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T06:00:16.168 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T06:00:16.168 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T06:00:16.168 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T06:00:16.168 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T06:00:16.168 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T06:00:16.169 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T06:00:16.169 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T06:00:16.169 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T06:00:16.169 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T06:00:16.169 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T06:00:16.169 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T06:00:16.169 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T06:00:16.169 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T06:00:16.169 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T06:00:16.169 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T06:00:16.169 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T06:00:16.169 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T06:00:16.169 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T06:00:16.170 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T06:00:16.170 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T06:00:16.170 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T06:00:16.170 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T06:00:16.170 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T06:00:16.170 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T06:00:16.170 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T06:00:16.170 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T06:00:16.170 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T06:00:16.170 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T06:00:16.170 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T06:00:16.170 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T06:00:16.170 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T06:00:16.170 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T06:00:16.171 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T06:00:16.171 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T06:00:16.171 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T06:00:16.171 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T06:00:16.171 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T06:00:16.171 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T06:00:16.171 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T06:00:16.171 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T06:00:16.171 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T06:00:16.171 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T06:00:16.171 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T06:00:16.171 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T06:00:16.171 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T06:00:16.172 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T06:00:16.172 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T06:00:16.172 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T06:00:16.172 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T06:00:16.172 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T06:00:16.172 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T06:00:16.172 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T06:00:16.172 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T06:00:16.172 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T06:00:16.172 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T06:00:16.172 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T06:00:16.172 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T06:00:16.172 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T06:00:16.173 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T06:00:16.173 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T06:00:16.173 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T06:00:16.173 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T06:00:16.173 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T06:00:16.173 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T06:00:16.173 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T06:00:16.173 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T06:00:16.173 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T06:00:16.173 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T06:00:16.173 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T06:00:16.173 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T06:00:16.173 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T06:00:16.174 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T06:00:16.174 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T06:00:16.174 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T06:00:16.174 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T06:00:16.174 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T06:00:16.174 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T06:00:16.174 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T06:00:16.174 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T06:00:16.174 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T06:00:16.174 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T06:00:16.174 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T06:00:16.197 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T06:00:16.283 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T06:00:16.395 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T06:00:16.432 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T06:00:16.457 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T06:00:16.502 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T06:00:16.503 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:00:16.627 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T06:00:16.627 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:00:16.744 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T06:00:16.768 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T06:00:16.784 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:00:16.784 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:00:17.029 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T06:00:17.029 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:00:17.131 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T06:00:17.207 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:00:17.417 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:00:17.417 INFO:teuthology.orchestra.run.smithi003.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-19T06:00:17.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:00:18.792 INFO:teuthology.orchestra.run.smithi071.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:00:18.792 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-19T06:00:18.793 INFO:teuthology.orchestra.run.smithi071.stdout:Upgraded: 2024-09-19T06:00:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T06:00:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T06:00:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T06:00:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T06:00:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T06:00:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T06:00:18.793 INFO:teuthology.orchestra.run.smithi071.stdout:Installed: 2024-09-19T06:00:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T06:00:18.793 INFO:teuthology.orchestra.run.smithi071.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T06:00:18.794 INFO:teuthology.orchestra.run.smithi071.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T06:00:18.794 INFO:teuthology.orchestra.run.smithi071.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T06:00:18.794 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.794 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.794 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.794 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.794 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:18.794 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.794 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.794 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.794 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:18.794 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:18.794 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:18.795 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:18.795 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:18.795 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.795 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.795 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:18.795 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.795 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.795 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.795 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:18.795 INFO:teuthology.orchestra.run.smithi071.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:18.795 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.795 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.795 INFO:teuthology.orchestra.run.smithi071.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:18.796 INFO:teuthology.orchestra.run.smithi071.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T06:00:18.796 INFO:teuthology.orchestra.run.smithi071.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T06:00:18.796 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T06:00:18.796 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T06:00:18.796 INFO:teuthology.orchestra.run.smithi071.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T06:00:18.796 INFO:teuthology.orchestra.run.smithi071.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T06:00:18.796 INFO:teuthology.orchestra.run.smithi071.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T06:00:18.796 INFO:teuthology.orchestra.run.smithi071.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T06:00:18.796 INFO:teuthology.orchestra.run.smithi071.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T06:00:18.796 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T06:00:18.796 INFO:teuthology.orchestra.run.smithi071.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T06:00:18.796 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.797 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.797 INFO:teuthology.orchestra.run.smithi071.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.797 INFO:teuthology.orchestra.run.smithi071.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T06:00:18.797 INFO:teuthology.orchestra.run.smithi071.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T06:00:18.797 INFO:teuthology.orchestra.run.smithi071.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T06:00:18.797 INFO:teuthology.orchestra.run.smithi071.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T06:00:18.797 INFO:teuthology.orchestra.run.smithi071.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T06:00:18.797 INFO:teuthology.orchestra.run.smithi071.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.797 INFO:teuthology.orchestra.run.smithi071.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.797 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T06:00:18.797 INFO:teuthology.orchestra.run.smithi071.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.797 INFO:teuthology.orchestra.run.smithi071.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T06:00:18.797 INFO:teuthology.orchestra.run.smithi071.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T06:00:18.798 INFO:teuthology.orchestra.run.smithi071.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T06:00:18.798 INFO:teuthology.orchestra.run.smithi071.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T06:00:18.798 INFO:teuthology.orchestra.run.smithi071.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T06:00:18.798 INFO:teuthology.orchestra.run.smithi071.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T06:00:18.798 INFO:teuthology.orchestra.run.smithi071.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T06:00:18.798 INFO:teuthology.orchestra.run.smithi071.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T06:00:18.798 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T06:00:18.798 INFO:teuthology.orchestra.run.smithi071.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T06:00:18.798 INFO:teuthology.orchestra.run.smithi071.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T06:00:18.798 INFO:teuthology.orchestra.run.smithi071.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T06:00:18.798 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T06:00:18.798 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T06:00:18.798 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T06:00:18.798 INFO:teuthology.orchestra.run.smithi071.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T06:00:18.799 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T06:00:18.799 INFO:teuthology.orchestra.run.smithi071.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T06:00:18.799 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T06:00:18.799 INFO:teuthology.orchestra.run.smithi071.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T06:00:18.799 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T06:00:18.799 INFO:teuthology.orchestra.run.smithi071.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T06:00:18.799 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T06:00:18.799 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.799 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.799 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.799 INFO:teuthology.orchestra.run.smithi071.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T06:00:18.799 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T06:00:18.799 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T06:00:18.800 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T06:00:18.800 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T06:00:18.800 INFO:teuthology.orchestra.run.smithi071.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T06:00:18.800 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T06:00:18.800 INFO:teuthology.orchestra.run.smithi071.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T06:00:18.800 INFO:teuthology.orchestra.run.smithi071.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T06:00:18.800 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T06:00:18.800 INFO:teuthology.orchestra.run.smithi071.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T06:00:18.800 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T06:00:18.800 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T06:00:18.800 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T06:00:18.800 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T06:00:18.800 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T06:00:18.801 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T06:00:18.801 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T06:00:18.801 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T06:00:18.801 INFO:teuthology.orchestra.run.smithi071.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T06:00:18.801 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T06:00:18.801 INFO:teuthology.orchestra.run.smithi071.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T06:00:18.801 INFO:teuthology.orchestra.run.smithi071.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T06:00:18.801 INFO:teuthology.orchestra.run.smithi071.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T06:00:18.801 INFO:teuthology.orchestra.run.smithi071.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T06:00:18.801 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T06:00:18.801 INFO:teuthology.orchestra.run.smithi071.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T06:00:18.801 INFO:teuthology.orchestra.run.smithi071.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T06:00:18.801 INFO:teuthology.orchestra.run.smithi071.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T06:00:18.802 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T06:00:18.802 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T06:00:18.802 INFO:teuthology.orchestra.run.smithi071.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T06:00:18.802 INFO:teuthology.orchestra.run.smithi071.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T06:00:18.802 INFO:teuthology.orchestra.run.smithi071.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T06:00:18.802 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T06:00:18.802 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T06:00:18.802 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T06:00:18.802 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T06:00:18.802 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T06:00:18.802 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T06:00:18.802 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.802 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.803 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T06:00:18.803 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T06:00:18.803 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T06:00:18.803 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.803 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T06:00:18.803 INFO:teuthology.orchestra.run.smithi071.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T06:00:18.803 INFO:teuthology.orchestra.run.smithi071.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T06:00:18.803 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T06:00:18.803 INFO:teuthology.orchestra.run.smithi071.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T06:00:18.803 INFO:teuthology.orchestra.run.smithi071.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T06:00:18.803 INFO:teuthology.orchestra.run.smithi071.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T06:00:18.803 INFO:teuthology.orchestra.run.smithi071.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T06:00:18.803 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T06:00:18.804 INFO:teuthology.orchestra.run.smithi071.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T06:00:18.804 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T06:00:18.804 INFO:teuthology.orchestra.run.smithi071.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T06:00:18.804 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T06:00:18.804 INFO:teuthology.orchestra.run.smithi071.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T06:00:18.804 INFO:teuthology.orchestra.run.smithi071.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T06:00:18.804 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.804 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.804 INFO:teuthology.orchestra.run.smithi071.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:18.804 INFO:teuthology.orchestra.run.smithi071.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T06:00:18.804 INFO:teuthology.orchestra.run.smithi071.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T06:00:18.804 INFO:teuthology.orchestra.run.smithi071.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T06:00:18.804 INFO:teuthology.orchestra.run.smithi071.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T06:00:18.805 INFO:teuthology.orchestra.run.smithi071.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T06:00:18.805 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T06:00:18.805 INFO:teuthology.orchestra.run.smithi071.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T06:00:18.805 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-19T06:00:18.805 INFO:teuthology.orchestra.run.smithi071.stdout:Complete! 2024-09-19T06:00:19.226 DEBUG:teuthology.parallel:result is None 2024-09-19T06:00:22.954 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T06:00:22.954 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T06:00:22.954 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T06:00:22.954 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T06:00:22.954 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T06:00:22.954 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T06:00:22.954 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T06:00:22.954 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T06:00:22.954 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T06:00:22.954 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T06:00:22.955 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T06:00:22.955 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T06:00:22.955 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T06:00:22.955 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T06:00:22.955 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T06:00:22.955 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T06:00:22.955 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T06:00:22.955 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T06:00:22.955 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T06:00:22.955 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T06:00:22.955 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T06:00:22.955 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T06:00:22.955 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T06:00:22.956 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T06:00:22.956 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T06:00:22.956 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T06:00:22.956 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T06:00:22.967 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T06:00:22.968 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T06:00:22.968 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T06:00:22.968 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T06:00:22.968 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T06:00:22.968 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T06:00:22.968 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T06:00:22.968 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T06:00:22.968 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T06:00:22.968 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T06:00:22.968 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T06:00:22.968 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T06:00:22.968 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T06:00:22.969 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T06:00:22.969 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T06:00:22.969 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T06:00:22.969 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T06:00:22.969 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T06:00:22.969 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T06:00:22.969 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T06:00:22.969 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T06:00:22.969 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T06:00:22.969 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T06:00:22.969 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T06:00:22.969 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T06:00:22.969 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T06:00:22.970 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T06:00:22.970 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T06:00:22.970 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T06:00:22.970 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T06:00:22.970 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T06:00:22.970 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T06:00:22.970 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T06:00:22.970 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T06:00:22.970 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T06:00:22.970 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T06:00:22.970 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T06:00:22.970 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T06:00:22.970 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T06:00:22.971 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T06:00:22.971 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T06:00:22.971 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T06:00:22.971 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T06:00:22.971 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T06:00:22.971 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T06:00:22.971 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T06:00:22.971 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T06:00:22.971 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T06:00:22.971 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T06:00:22.971 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T06:00:22.971 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T06:00:22.971 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T06:00:22.972 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T06:00:22.972 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T06:00:22.972 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T06:00:22.972 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T06:00:22.972 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T06:00:22.972 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T06:00:22.972 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T06:00:22.972 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T06:00:22.972 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T06:00:22.972 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T06:00:22.972 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T06:00:22.972 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T06:00:22.972 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T06:00:22.973 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T06:00:22.973 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T06:00:22.973 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T06:00:22.973 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T06:00:22.973 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T06:00:22.973 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T06:00:22.973 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T06:00:22.973 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T06:00:22.973 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T06:00:22.973 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T06:00:22.973 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T06:00:22.973 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T06:00:22.973 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T06:00:22.973 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T06:00:22.974 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T06:00:22.974 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T06:00:22.974 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T06:00:22.974 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T06:00:22.974 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T06:00:22.974 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T06:00:22.974 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T06:00:22.974 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T06:00:22.974 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T06:00:22.974 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T06:00:22.974 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T06:00:22.974 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T06:00:22.974 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T06:00:22.974 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T06:00:22.975 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T06:00:22.975 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T06:00:22.975 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T06:00:22.975 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T06:00:22.975 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T06:00:22.975 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T06:00:22.975 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T06:00:22.975 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T06:00:22.975 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T06:00:22.975 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T06:00:22.975 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T06:00:22.975 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T06:00:22.976 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T06:00:22.976 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T06:00:22.976 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T06:00:22.976 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T06:00:22.976 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T06:00:22.976 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T06:00:22.976 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T06:00:22.976 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T06:00:22.976 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T06:00:22.976 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T06:00:22.976 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T06:00:22.976 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T06:00:22.976 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T06:00:22.977 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T06:00:22.977 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T06:00:22.977 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T06:00:22.977 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T06:00:22.977 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T06:00:22.977 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T06:00:22.977 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T06:00:22.977 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T06:00:22.977 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T06:00:22.977 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T06:00:22.977 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T06:00:22.977 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T06:00:22.977 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T06:00:22.978 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T06:00:22.978 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T06:00:22.978 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T06:00:22.978 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T06:00:22.978 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T06:00:25.298 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T06:00:25.298 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:00:25.298 INFO:teuthology.orchestra.run.smithi003.stdout:Upgraded: 2024-09-19T06:00:25.298 INFO:teuthology.orchestra.run.smithi003.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T06:00:25.298 INFO:teuthology.orchestra.run.smithi003.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T06:00:25.298 INFO:teuthology.orchestra.run.smithi003.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T06:00:25.298 INFO:teuthology.orchestra.run.smithi003.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T06:00:25.298 INFO:teuthology.orchestra.run.smithi003.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.299 INFO:teuthology.orchestra.run.smithi003.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.299 INFO:teuthology.orchestra.run.smithi003.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T06:00:25.299 INFO:teuthology.orchestra.run.smithi003.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T06:00:25.299 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-19T06:00:25.299 INFO:teuthology.orchestra.run.smithi003.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T06:00:25.299 INFO:teuthology.orchestra.run.smithi003.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T06:00:25.299 INFO:teuthology.orchestra.run.smithi003.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T06:00:25.299 INFO:teuthology.orchestra.run.smithi003.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T06:00:25.299 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.299 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.299 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.299 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.300 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:25.300 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.300 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.300 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.300 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:25.300 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:25.300 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:25.300 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:25.300 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:25.300 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.300 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.300 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:25.300 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.301 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.301 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.301 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:25.301 INFO:teuthology.orchestra.run.smithi003.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:25.301 INFO:teuthology.orchestra.run.smithi003.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.301 INFO:teuthology.orchestra.run.smithi003.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.301 INFO:teuthology.orchestra.run.smithi003.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T06:00:25.301 INFO:teuthology.orchestra.run.smithi003.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T06:00:25.301 INFO:teuthology.orchestra.run.smithi003.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T06:00:25.301 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T06:00:25.301 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T06:00:25.301 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T06:00:25.301 INFO:teuthology.orchestra.run.smithi003.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T06:00:25.302 INFO:teuthology.orchestra.run.smithi003.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T06:00:25.302 INFO:teuthology.orchestra.run.smithi003.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T06:00:25.302 INFO:teuthology.orchestra.run.smithi003.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T06:00:25.302 INFO:teuthology.orchestra.run.smithi003.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T06:00:25.302 INFO:teuthology.orchestra.run.smithi003.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T06:00:25.302 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.302 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.302 INFO:teuthology.orchestra.run.smithi003.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.302 INFO:teuthology.orchestra.run.smithi003.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T06:00:25.302 INFO:teuthology.orchestra.run.smithi003.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T06:00:25.302 INFO:teuthology.orchestra.run.smithi003.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T06:00:25.302 INFO:teuthology.orchestra.run.smithi003.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T06:00:25.302 INFO:teuthology.orchestra.run.smithi003.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T06:00:25.303 INFO:teuthology.orchestra.run.smithi003.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.303 INFO:teuthology.orchestra.run.smithi003.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.303 INFO:teuthology.orchestra.run.smithi003.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T06:00:25.303 INFO:teuthology.orchestra.run.smithi003.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.303 INFO:teuthology.orchestra.run.smithi003.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T06:00:25.303 INFO:teuthology.orchestra.run.smithi003.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T06:00:25.303 INFO:teuthology.orchestra.run.smithi003.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T06:00:25.303 INFO:teuthology.orchestra.run.smithi003.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T06:00:25.303 INFO:teuthology.orchestra.run.smithi003.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T06:00:25.303 INFO:teuthology.orchestra.run.smithi003.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T06:00:25.303 INFO:teuthology.orchestra.run.smithi003.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T06:00:25.303 INFO:teuthology.orchestra.run.smithi003.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T06:00:25.304 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T06:00:25.304 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T06:00:25.304 INFO:teuthology.orchestra.run.smithi003.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T06:00:25.304 INFO:teuthology.orchestra.run.smithi003.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T06:00:25.304 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T06:00:25.304 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T06:00:25.304 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T06:00:25.304 INFO:teuthology.orchestra.run.smithi003.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T06:00:25.304 INFO:teuthology.orchestra.run.smithi003.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T06:00:25.304 INFO:teuthology.orchestra.run.smithi003.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T06:00:25.304 INFO:teuthology.orchestra.run.smithi003.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T06:00:25.304 INFO:teuthology.orchestra.run.smithi003.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T06:00:25.305 INFO:teuthology.orchestra.run.smithi003.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T06:00:25.305 INFO:teuthology.orchestra.run.smithi003.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T06:00:25.305 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T06:00:25.305 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.305 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.305 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.305 INFO:teuthology.orchestra.run.smithi003.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T06:00:25.305 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T06:00:25.305 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T06:00:25.305 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T06:00:25.305 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T06:00:25.305 INFO:teuthology.orchestra.run.smithi003.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T06:00:25.306 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T06:00:25.306 INFO:teuthology.orchestra.run.smithi003.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T06:00:25.306 INFO:teuthology.orchestra.run.smithi003.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T06:00:25.306 INFO:teuthology.orchestra.run.smithi003.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T06:00:25.306 INFO:teuthology.orchestra.run.smithi003.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T06:00:25.306 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T06:00:25.306 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T06:00:25.306 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T06:00:25.306 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T06:00:25.306 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T06:00:25.306 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T06:00:25.306 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T06:00:25.306 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T06:00:25.307 INFO:teuthology.orchestra.run.smithi003.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T06:00:25.307 INFO:teuthology.orchestra.run.smithi003.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T06:00:25.307 INFO:teuthology.orchestra.run.smithi003.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T06:00:25.307 INFO:teuthology.orchestra.run.smithi003.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T06:00:25.307 INFO:teuthology.orchestra.run.smithi003.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T06:00:25.307 INFO:teuthology.orchestra.run.smithi003.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T06:00:25.307 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T06:00:25.307 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T06:00:25.307 INFO:teuthology.orchestra.run.smithi003.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T06:00:25.307 INFO:teuthology.orchestra.run.smithi003.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T06:00:25.307 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T06:00:25.307 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T06:00:25.307 INFO:teuthology.orchestra.run.smithi003.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T06:00:25.308 INFO:teuthology.orchestra.run.smithi003.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T06:00:25.308 INFO:teuthology.orchestra.run.smithi003.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T06:00:25.308 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T06:00:25.308 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T06:00:25.308 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T06:00:25.308 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T06:00:25.308 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T06:00:25.308 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T06:00:25.308 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.308 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.308 INFO:teuthology.orchestra.run.smithi003.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T06:00:25.308 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T06:00:25.308 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T06:00:25.309 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.309 INFO:teuthology.orchestra.run.smithi003.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T06:00:25.309 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T06:00:25.309 INFO:teuthology.orchestra.run.smithi003.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T06:00:25.309 INFO:teuthology.orchestra.run.smithi003.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T06:00:25.309 INFO:teuthology.orchestra.run.smithi003.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T06:00:25.309 INFO:teuthology.orchestra.run.smithi003.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T06:00:25.309 INFO:teuthology.orchestra.run.smithi003.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T06:00:25.309 INFO:teuthology.orchestra.run.smithi003.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T06:00:25.309 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T06:00:25.309 INFO:teuthology.orchestra.run.smithi003.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T06:00:25.309 INFO:teuthology.orchestra.run.smithi003.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T06:00:25.309 INFO:teuthology.orchestra.run.smithi003.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T06:00:25.310 INFO:teuthology.orchestra.run.smithi003.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T06:00:25.310 INFO:teuthology.orchestra.run.smithi003.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T06:00:25.310 INFO:teuthology.orchestra.run.smithi003.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T06:00:25.310 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.310 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.310 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T06:00:25.310 INFO:teuthology.orchestra.run.smithi003.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T06:00:25.310 INFO:teuthology.orchestra.run.smithi003.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T06:00:25.310 INFO:teuthology.orchestra.run.smithi003.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T06:00:25.310 INFO:teuthology.orchestra.run.smithi003.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T06:00:25.310 INFO:teuthology.orchestra.run.smithi003.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T06:00:25.310 INFO:teuthology.orchestra.run.smithi003.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T06:00:25.311 INFO:teuthology.orchestra.run.smithi003.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T06:00:25.311 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:00:25.311 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-19T06:00:25.941 DEBUG:teuthology.parallel:result is None 2024-09-19T06:00:25.942 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:00:26.087 DEBUG:teuthology.orchestra.run.smithi003:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T06:00:26.133 INFO:teuthology.orchestra.run.smithi003.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T06:00:26.133 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T06:00:26.133 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T06:00:26.135 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:00:26.275 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T06:00:26.302 INFO:teuthology.orchestra.run.smithi059.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T06:00:26.302 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T06:00:26.302 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T06:00:26.304 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:00:26.452 DEBUG:teuthology.orchestra.run.smithi071:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T06:00:26.479 INFO:teuthology.orchestra.run.smithi071.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T06:00:26.479 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T06:00:26.479 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T06:00:26.481 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T06:00:26.481 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-19T06:00:26.481 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T06:00:26.540 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-19T06:00:26.540 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T06:00:26.572 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-19T06:00:26.572 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T06:00:26.604 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T06:00:26.604 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-19T06:00:26.604 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T06:00:26.661 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T06:00:26.757 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-19T06:00:26.757 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T06:00:26.787 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T06:00:26.857 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-19T06:00:26.857 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T06:00:26.886 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T06:00:26.954 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T06:00:26.955 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-19T06:00:26.955 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T06:00:27.011 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T06:00:27.109 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-19T06:00:27.109 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T06:00:27.135 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T06:00:27.199 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-19T06:00:27.199 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T06:00:27.228 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T06:00:27.296 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T06:00:27.297 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-19T06:00:27.297 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T06:00:27.353 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T06:00:27.450 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-19T06:00:27.450 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T06:00:27.475 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T06:00:27.539 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-19T06:00:27.539 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T06:00:27.569 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T06:00:27.638 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T06:00:27.739 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-19T06:00:27.740 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:00:27.740 INFO:tasks.cephadm:Cluster fsid is 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:00:27.741 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T06:00:27.741 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.3', 'mon.b': '172.21.15.59', 'mon.c': '172.21.15.71'} 2024-09-19T06:00:27.741 INFO:tasks.cephadm:First mon is mon.a on smithi003 2024-09-19T06:00:27.741 INFO:tasks.cephadm:First mgr is x 2024-09-19T06:00:27.741 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T06:00:27.741 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname $(hostname -s) 2024-09-19T06:00:27.798 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname $(hostname -s) 2024-09-19T06:00:27.822 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname $(hostname -s) 2024-09-19T06:00:27.853 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T06:00:27.854 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:00:27.993 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T06:00:28.149 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:00:28.151 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T06:00:28.151 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T06:00:28.151 DEBUG:teuthology.orchestra.run.smithi003:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T06:00:28.571 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 06:00 /home/ubuntu/cephtest/cephadm 2024-09-19T06:00:28.571 DEBUG:teuthology.orchestra.run.smithi059:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T06:00:28.950 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 06:00 /home/ubuntu/cephtest/cephadm 2024-09-19T06:00:28.950 DEBUG:teuthology.orchestra.run.smithi071:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T06:00:29.331 INFO:teuthology.orchestra.run.smithi071.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 06:00 /home/ubuntu/cephtest/cephadm 2024-09-19T06:00:29.331 DEBUG:teuthology.orchestra.run.smithi003:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T06:00:29.373 DEBUG:teuthology.orchestra.run.smithi059:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T06:00:29.392 DEBUG:teuthology.orchestra.run.smithi071:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T06:00:29.428 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T06:00:29.428 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T06:00:29.432 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T06:00:29.435 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T06:00:31.054 INFO:teuthology.orchestra.run.smithi059.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:00:31.112 INFO:teuthology.orchestra.run.smithi071.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:00:31.291 INFO:teuthology.orchestra.run.smithi003.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:01:06.273 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:01:06.273 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T06:01:06.273 INFO:teuthology.orchestra.run.smithi003.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T06:01:06.274 INFO:teuthology.orchestra.run.smithi003.stdout: "repo_digests": [ 2024-09-19T06:01:06.274 INFO:teuthology.orchestra.run.smithi003.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T06:01:06.274 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-19T06:01:06.274 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:01:22.551 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-19T06:01:22.551 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T06:01:22.552 INFO:teuthology.orchestra.run.smithi071.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T06:01:22.552 INFO:teuthology.orchestra.run.smithi071.stdout: "repo_digests": [ 2024-09-19T06:01:22.552 INFO:teuthology.orchestra.run.smithi071.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T06:01:22.552 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-09-19T06:01:22.552 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-19T06:01:23.256 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-19T06:01:23.257 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T06:01:23.257 INFO:teuthology.orchestra.run.smithi059.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T06:01:23.257 INFO:teuthology.orchestra.run.smithi059.stdout: "repo_digests": [ 2024-09-19T06:01:23.257 INFO:teuthology.orchestra.run.smithi059.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T06:01:23.257 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-09-19T06:01:23.257 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-19T06:01:23.283 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /etc/ceph 2024-09-19T06:01:23.349 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph 2024-09-19T06:01:23.378 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph 2024-09-19T06:01:23.412 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 777 /etc/ceph 2024-09-19T06:01:23.471 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 777 /etc/ceph 2024-09-19T06:01:23.497 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 777 /etc/ceph 2024-09-19T06:01:23.527 INFO:tasks.cephadm:Writing seed config... 2024-09-19T06:01:23.528 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T06:01:23.528 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T06:01:23.529 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T06:01:23.529 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T06:01:23.529 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T06:01:23.529 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-19T06:01:23.529 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T06:01:23.529 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T06:01:23.529 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T06:01:23.529 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T06:01:23.529 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T06:01:23.529 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T06:01:23.529 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T06:01:23.529 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T06:01:23.530 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T06:01:23.530 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T06:01:23.530 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T06:01:23.530 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-19T06:01:23.530 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T06:01:23.530 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T06:01:23.530 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T06:01:23.530 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T06:01:23.530 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-19T06:01:23.530 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T06:01:23.530 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T06:01:23.530 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T06:01:23.530 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T06:01:23.530 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T06:01:23.530 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T06:01:23.531 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T06:01:23.531 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T06:01:23.531 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T06:01:23.531 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T06:01:23.531 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-19T06:01:23.531 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T06:01:23.531 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-19T06:01:23.531 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-19T06:01:23.531 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T06:01:23.531 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T06:01:23.531 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-19T06:01:23.531 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T06:01:23.531 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T06:01:23.531 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T06:01:23.532 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T06:01:23.532 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T06:01:23.532 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T06:01:23.532 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T06:01:23.532 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-19T06:01:23.533 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-19T06:01:23.533 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T06:01:23.568 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 782a5144-764c-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T06:01:23.569 DEBUG:teuthology.orchestra.run.smithi003:mon.a> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T06:01:23.613 DEBUG:teuthology.orchestra.run.smithi003:mgr.x> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T06:01:23.658 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T06:01:23.659 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid 782a5144-764c-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.3 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:01:23.928 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:01:23.928 INFO:teuthology.orchestra.run.smithi003.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', '782a5144-764c-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.3', '--skip-admin-label'] 2024-09-19T06:01:23.928 INFO:teuthology.orchestra.run.smithi003.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T06:01:23.928 INFO:teuthology.orchestra.run.smithi003.stdout:Verifying podman|docker is present... 2024-09-19T06:01:23.976 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stdout 5.2.2 2024-09-19T06:01:23.976 INFO:teuthology.orchestra.run.smithi003.stdout:Verifying lvm2 is present... 2024-09-19T06:01:23.976 INFO:teuthology.orchestra.run.smithi003.stdout:Verifying time synchronization is in place... 2024-09-19T06:01:23.991 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T06:01:23.991 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T06:01:24.006 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T06:01:24.006 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout inactive 2024-09-19T06:01:24.022 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout enabled 2024-09-19T06:01:24.037 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout active 2024-09-19T06:01:24.037 INFO:teuthology.orchestra.run.smithi003.stdout:Unit chronyd.service is enabled and running 2024-09-19T06:01:24.037 INFO:teuthology.orchestra.run.smithi003.stdout:Repeating the final host check... 2024-09-19T06:01:24.092 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stdout 5.2.2 2024-09-19T06:01:24.092 INFO:teuthology.orchestra.run.smithi003.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T06:01:24.092 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl is present 2024-09-19T06:01:24.092 INFO:teuthology.orchestra.run.smithi003.stdout:lvcreate is present 2024-09-19T06:01:24.105 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T06:01:24.105 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T06:01:24.118 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T06:01:24.118 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout inactive 2024-09-19T06:01:24.131 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout enabled 2024-09-19T06:01:24.145 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout active 2024-09-19T06:01:24.145 INFO:teuthology.orchestra.run.smithi003.stdout:Unit chronyd.service is enabled and running 2024-09-19T06:01:24.145 INFO:teuthology.orchestra.run.smithi003.stdout:Host looks OK 2024-09-19T06:01:24.145 INFO:teuthology.orchestra.run.smithi003.stdout:Cluster fsid: 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:01:24.145 INFO:teuthology.orchestra.run.smithi003.stdout:Acquiring lock 140151062897520 on /run/cephadm/782a5144-764c-11ef-bceb-c7b262605968.lock 2024-09-19T06:01:24.145 INFO:teuthology.orchestra.run.smithi003.stdout:Lock 140151062897520 acquired on /run/cephadm/782a5144-764c-11ef-bceb-c7b262605968.lock 2024-09-19T06:01:24.146 INFO:teuthology.orchestra.run.smithi003.stdout:Verifying IP 172.21.15.3 port 3300 ... 2024-09-19T06:01:24.146 INFO:teuthology.orchestra.run.smithi003.stdout:Verifying IP 172.21.15.3 port 6789 ... 2024-09-19T06:01:24.146 INFO:teuthology.orchestra.run.smithi003.stdout:Base mon IP(s) is [172.21.15.3:3300, 172.21.15.3:6789], mon addrv is [v2:172.21.15.3:3300,v1:172.21.15.3:6789] 2024-09-19T06:01:24.153 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.3 metric 100 2024-09-19T06:01:24.153 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.3 metric 100 2024-09-19T06:01:24.160 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T06:01:24.160 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-19T06:01:24.160 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1794sec hoplimit 64 pref medium 2024-09-19T06:01:24.166 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T06:01:24.166 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T06:01:24.166 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T06:01:24.166 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-19T06:01:24.166 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15dc/64 scope link 2024-09-19T06:01:24.166 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T06:01:24.167 INFO:teuthology.orchestra.run.smithi003.stdout:Mon IP `172.21.15.3` is in CIDR network `172.21.0.0/20` 2024-09-19T06:01:24.167 INFO:teuthology.orchestra.run.smithi003.stdout:Mon IP `172.21.15.3` is in CIDR network `172.21.0.0/20` 2024-09-19T06:01:24.167 INFO:teuthology.orchestra.run.smithi003.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T06:01:24.168 INFO:teuthology.orchestra.run.smithi003.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T06:01:24.169 INFO:teuthology.orchestra.run.smithi003.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:01:25.844 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T06:01:25.844 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T06:01:25.844 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T06:01:25.844 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T06:01:25.844 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T06:01:25.844 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T06:01:25.845 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T06:01:26.955 INFO:teuthology.orchestra.run.smithi003.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T06:01:26.955 INFO:teuthology.orchestra.run.smithi003.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T06:01:26.955 INFO:teuthology.orchestra.run.smithi003.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T06:01:28.034 INFO:teuthology.orchestra.run.smithi003.stdout:stat: stdout 167 167 2024-09-19T06:01:28.034 INFO:teuthology.orchestra.run.smithi003.stdout:Creating initial keys... 2024-09-19T06:01:29.006 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph-authtool: stdout AQA4vutmGlz/FxAAXaxiqcYgjB0V/TX8yHM/EA== 2024-09-19T06:01:29.987 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph-authtool: stdout AQA5vutm12YXGRAAUR0QaJnxQxqpObW0H1lyhQ== 2024-09-19T06:01:31.030 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph-authtool: stdout AQA6vutmVor5FBAAElwXGV9Re2L8fj451fm/hg== 2024-09-19T06:01:31.032 INFO:teuthology.orchestra.run.smithi003.stdout:Creating initial monmap... 2024-09-19T06:01:32.049 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T06:01:32.049 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T06:01:32.049 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:01:32.049 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T06:01:32.049 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool for a [v2:172.21.15.3:3300,v1:172.21.15.3:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T06:01:32.049 INFO:teuthology.orchestra.run.smithi003.stdout:setting min_mon_release = quincy 2024-09-19T06:01:32.050 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/monmaptool: set fsid to 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:01:32.050 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T06:01:32.050 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:01:32.050 INFO:teuthology.orchestra.run.smithi003.stdout:Creating mon... 2024-09-19T06:01:33.099 INFO:teuthology.orchestra.run.smithi003.stdout:create mon.a on 2024-09-19T06:01:33.412 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T06:01:33.638 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T06:01:33.912 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-782a5144-764c-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-782a5144-764c-11ef-bceb-c7b262605968.target. 2024-09-19T06:01:33.913 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-782a5144-764c-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-782a5144-764c-11ef-bceb-c7b262605968.target. 2024-09-19T06:01:34.270 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-782a5144-764c-11ef-bceb-c7b262605968@mon.a 2024-09-19T06:01:34.271 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Failed to reset failed state of unit ceph-782a5144-764c-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-782a5144-764c-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T06:01:34.547 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-782a5144-764c-11ef-bceb-c7b262605968.target.wants/ceph-782a5144-764c-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-782a5144-764c-11ef-bceb-c7b262605968@.service. 2024-09-19T06:01:35.159 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:34 smithi003 podman[30500]: 2024-09-19 06:01:34.908510047 +0000 UTC m=+0.130227633 container create e2a25acaa3429f647c801fb9d1d04d1fa68c9cce287c8b1f7568150feac71cd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:01:35.159 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:35 smithi003 podman[30500]: 2024-09-19 06:01:35.157668503 +0000 UTC m=+0.379386054 container init e2a25acaa3429f647c801fb9d1d04d1fa68c9cce287c8b1f7568150feac71cd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:01:35.291 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T06:01:35.292 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout disabled 2024-09-19T06:01:35.306 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T06:01:35.306 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout inactive 2024-09-19T06:01:35.306 INFO:teuthology.orchestra.run.smithi003.stdout:firewalld.service is not enabled 2024-09-19T06:01:35.306 INFO:teuthology.orchestra.run.smithi003.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T06:01:35.306 INFO:teuthology.orchestra.run.smithi003.stdout:Waiting for mon to start... 2024-09-19T06:01:35.306 INFO:teuthology.orchestra.run.smithi003.stdout:Waiting for mon... 2024-09-19T06:01:35.447 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:35 smithi003 podman[30500]: 2024-09-19 06:01:35.164940585 +0000 UTC m=+0.386658131 container start e2a25acaa3429f647c801fb9d1d04d1fa68c9cce287c8b1f7568150feac71cd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T06:01:35.447 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:35 smithi003 ceph-mon[30519]: mkfs 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:01:35.447 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:35 smithi003 ceph-mon[30519]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T06:01:35.447 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:35 smithi003 bash[30500]: e2a25acaa3429f647c801fb9d1d04d1fa68c9cce287c8b1f7568150feac71cd5 2024-09-19T06:01:35.448 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:35 smithi003 systemd[1]: Started Ceph mon.a for 782a5144-764c-11ef-bceb-c7b262605968. 2024-09-19T06:01:36.477 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:36 smithi003 ceph-mon[30519]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T06:01:36.477 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:36 smithi003 ceph-mon[30519]: monmap epoch 1 2024-09-19T06:01:36.477 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:36 smithi003 ceph-mon[30519]: fsid 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:01:36.477 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:36 smithi003 ceph-mon[30519]: last_changed 2024-09-19T06:01:31.421310+0000 2024-09-19T06:01:36.477 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:36 smithi003 ceph-mon[30519]: created 2024-09-19T06:01:31.421310+0000 2024-09-19T06:01:36.478 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:36 smithi003 ceph-mon[30519]: min_mon_release 19 (squid) 2024-09-19T06:01:36.478 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:36 smithi003 ceph-mon[30519]: election_strategy: 1 2024-09-19T06:01:36.478 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:36 smithi003 ceph-mon[30519]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2024-09-19T06:01:36.478 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:36 smithi003 ceph-mon[30519]: fsmap 2024-09-19T06:01:36.478 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:36 smithi003 ceph-mon[30519]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T06:01:36.478 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:36 smithi003 ceph-mon[30519]: mgrmap e1: no daemons active 2024-09-19T06:01:36.478 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:36 smithi003 ceph-mon[30519]: from='client.? 172.21.15.3:0/808344060' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T06:01:36.484 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T06:01:36.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout id: 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:01:36.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T06:01:36.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-19T06:01:36.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout services: 2024-09-19T06:01:36.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.629591s) 2024-09-19T06:01:36.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T06:01:36.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T06:01:36.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-19T06:01:36.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout data: 2024-09-19T06:01:36.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T06:01:36.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T06:01:36.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T06:01:36.491 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T06:01:36.491 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-19T06:01:36.491 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.772+0000 7f726f400640 1 Processor -- start 2024-09-19T06:01:36.491 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.772+0000 7f726f400640 1 -- start start 2024-09-19T06:01:36.491 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.773+0000 7f726f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726807dea0 0x7f726807c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:36.491 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.773+0000 7f726f400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f726807c8d0 con 0x7f726807dea0 2024-09-19T06:01:36.491 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.774+0000 7f726ca00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726807dea0 0x7f726807c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:36.491 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.774+0000 7f726ca00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726807dea0 0x7f726807c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33616/0 (socket says 172.21.15.3:33616) 2024-09-19T06:01:36.491 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.774+0000 7f726ca00640 1 -- 172.21.15.3:0/4256836425 learned_addr learned my addr 172.21.15.3:0/4256836425 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:01:36.491 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.774+0000 7f726ca00640 1 -- 172.21.15.3:0/4256836425 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726807ca50 con 0x7f726807dea0 2024-09-19T06:01:36.491 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.777+0000 7f726ca00640 1 --2- 172.21.15.3:0/4256836425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726807dea0 0x7f726807c300 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f725c009820 tx=0x7f725c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d850eecdf4c9d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:36.491 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.777+0000 7f7267400640 1 -- 172.21.15.3:0/4256836425 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f725c037070 con 0x7f726807dea0 2024-09-19T06:01:36.491 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.777+0000 7f7267400640 1 -- 172.21.15.3:0/4256836425 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f725c032440 con 0x7f726807dea0 2024-09-19T06:01:36.492 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.777+0000 7f7267400640 1 -- 172.21.15.3:0/4256836425 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f725c032740 con 0x7f726807dea0 2024-09-19T06:01:36.492 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.778+0000 7f726f400640 1 -- 172.21.15.3:0/4256836425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726807dea0 msgr2=0x7f726807c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:36.492 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.778+0000 7f726f400640 1 --2- 172.21.15.3:0/4256836425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726807dea0 0x7f726807c300 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f725c009820 tx=0x7f725c02a270 comp rx=0 tx=0).stop 2024-09-19T06:01:36.492 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.778+0000 7f726f400640 1 -- 172.21.15.3:0/4256836425 shutdown_connections 2024-09-19T06:01:36.492 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.778+0000 7f726f400640 1 --2- 172.21.15.3:0/4256836425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726807dea0 0x7f726807c300 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:36.492 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.778+0000 7f726f400640 1 -- 172.21.15.3:0/4256836425 >> 172.21.15.3:0/4256836425 conn(0x7f7268102e60 msgr2=0x7f72681052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:36.492 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.778+0000 7f726f400640 1 -- 172.21.15.3:0/4256836425 shutdown_connections 2024-09-19T06:01:36.492 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.778+0000 7f726f400640 1 -- 172.21.15.3:0/4256836425 wait complete. 2024-09-19T06:01:36.492 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.779+0000 7f726f400640 1 Processor -- start 2024-09-19T06:01:36.492 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.779+0000 7f726f400640 1 -- start start 2024-09-19T06:01:36.492 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.779+0000 7f726f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726807dea0 0x7f726819d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:36.492 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.779+0000 7f726f400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f726807cff0 con 0x7f726807dea0 2024-09-19T06:01:36.493 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.780+0000 7f726ca00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726807dea0 0x7f726819d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:36.493 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.780+0000 7f726ca00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726807dea0 0x7f726819d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33630/0 (socket says 172.21.15.3:33630) 2024-09-19T06:01:36.493 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.780+0000 7f726ca00640 1 -- 172.21.15.3:0/808344060 learned_addr learned my addr 172.21.15.3:0/808344060 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:01:36.493 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.780+0000 7f726ca00640 1 -- 172.21.15.3:0/808344060 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726819d5c0 con 0x7f726807dea0 2024-09-19T06:01:36.493 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.780+0000 7f726ca00640 1 --2- 172.21.15.3:0/808344060 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726807dea0 0x7f726819d080 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f725c0090b0 tx=0x7f725c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:36.493 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.781+0000 7f7265600640 1 -- 172.21.15.3:0/808344060 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f725c041070 con 0x7f726807dea0 2024-09-19T06:01:36.493 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.781+0000 7f7265600640 1 -- 172.21.15.3:0/808344060 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f725c03c7a0 con 0x7f726807dea0 2024-09-19T06:01:36.493 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.781+0000 7f7265600640 1 -- 172.21.15.3:0/808344060 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f725c037040 con 0x7f726807dea0 2024-09-19T06:01:36.493 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.781+0000 7f726f400640 1 -- 172.21.15.3:0/808344060 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f726819d850 con 0x7f726807dea0 2024-09-19T06:01:36.493 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.781+0000 7f726f400640 1 -- 172.21.15.3:0/808344060 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72681a0540 con 0x7f726807dea0 2024-09-19T06:01:36.493 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.781+0000 7f7265600640 1 -- 172.21.15.3:0/808344060 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f725c044070 con 0x7f726807dea0 2024-09-19T06:01:36.494 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.781+0000 7f7265600640 1 -- 172.21.15.3:0/808344060 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f725c03d730 con 0x7f726807dea0 2024-09-19T06:01:36.494 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.782+0000 7f726f400640 1 -- 172.21.15.3:0/808344060 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f726807c380 con 0x7f726807dea0 2024-09-19T06:01:36.494 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.785+0000 7f7265600640 1 -- 172.21.15.3:0/808344060 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f725c03cc30 con 0x7f726807dea0 2024-09-19T06:01:36.494 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.852+0000 7f726f400640 1 -- 172.21.15.3:0/808344060 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f726802d910 con 0x7f726807dea0 2024-09-19T06:01:36.494 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.853+0000 7f7265600640 1 -- 172.21.15.3:0/808344060 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f725c03d930 con 0x7f726807dea0 2024-09-19T06:01:36.494 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.854+0000 7f726f400640 1 -- 172.21.15.3:0/808344060 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726807dea0 msgr2=0x7f726819d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:36.494 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.854+0000 7f726f400640 1 --2- 172.21.15.3:0/808344060 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726807dea0 0x7f726819d080 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f725c0090b0 tx=0x7f725c0046c0 comp rx=0 tx=0).stop 2024-09-19T06:01:36.494 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.854+0000 7f726f400640 1 -- 172.21.15.3:0/808344060 shutdown_connections 2024-09-19T06:01:36.494 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.854+0000 7f726f400640 1 --2- 172.21.15.3:0/808344060 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f726807dea0 0x7f726819d080 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:36.494 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.854+0000 7f726f400640 1 -- 172.21.15.3:0/808344060 >> 172.21.15.3:0/808344060 conn(0x7f7268102e60 msgr2=0x7f7268103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:36.495 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.854+0000 7f726f400640 1 -- 172.21.15.3:0/808344060 shutdown_connections 2024-09-19T06:01:36.495 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:35.854+0000 7f726f400640 1 -- 172.21.15.3:0/808344060 wait complete. 2024-09-19T06:01:36.495 INFO:teuthology.orchestra.run.smithi003.stdout:mon is available 2024-09-19T06:01:36.495 INFO:teuthology.orchestra.run.smithi003.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T06:01:37.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:37 smithi003 ceph-mon[30519]: from='client.? 172.21.15.3:0/1918048523' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T06:01:37.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:37 smithi003 ceph-mon[30519]: from='client.? 172.21.15.3:0/1918048523' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T06:01:37.695 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-19T06:01:37.695 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T06:01:37.695 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout fsid = 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:01:37.695 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.3:3300,v1:172.21.15.3:6789] 2024-09-19T06:01:37.695 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T06:01:37.695 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T06:01:37.695 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T06:01:37.695 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T06:01:37.696 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-19T06:01:37.696 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T06:01:37.696 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T06:01:37.696 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-19T06:01:37.696 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T06:01:37.696 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T06:01:37.696 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T06:01:37.696 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T06:01:37.696 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T06:01:37.696 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T06:01:37.696 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.984+0000 7f6ebfe00640 1 Processor -- start 2024-09-19T06:01:37.696 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.984+0000 7f6ebfe00640 1 -- start start 2024-09-19T06:01:37.696 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.985+0000 7f6ebfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6eb8107740 0x7f6eb8107b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:37.697 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.985+0000 7f6ebfe00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb8108110 con 0x7f6eb8107740 2024-09-19T06:01:37.697 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.985+0000 7f6ebd400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6eb8107740 0x7f6eb8107b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:37.697 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.985+0000 7f6ebd400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6eb8107740 0x7f6eb8107b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33640/0 (socket says 172.21.15.3:33640) 2024-09-19T06:01:37.697 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.985+0000 7f6ebd400640 1 -- 172.21.15.3:0/1616028098 learned_addr learned my addr 172.21.15.3:0/1616028098 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:01:37.697 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.985+0000 7f6ebd400640 1 -- 172.21.15.3:0/1616028098 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb81088f0 con 0x7f6eb8107740 2024-09-19T06:01:37.697 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.986+0000 7f6ebd400640 1 --2- 172.21.15.3:0/1616028098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6eb8107740 0x7f6eb8107b40 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6eac009820 tx=0x7f6eac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33ce16bd6f6e6cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:37.697 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.987+0000 7f6eb7e00640 1 -- 172.21.15.3:0/1616028098 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6eac037070 con 0x7f6eb8107740 2024-09-19T06:01:37.697 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.987+0000 7f6eb7e00640 1 -- 172.21.15.3:0/1616028098 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eac032440 con 0x7f6eb8107740 2024-09-19T06:01:37.697 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.987+0000 7f6eb7e00640 1 -- 172.21.15.3:0/1616028098 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6eac032740 con 0x7f6eb8107740 2024-09-19T06:01:37.697 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.987+0000 7f6ebfe00640 1 -- 172.21.15.3:0/1616028098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6eb8107740 msgr2=0x7f6eb8107b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:37.697 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.987+0000 7f6ebfe00640 1 --2- 172.21.15.3:0/1616028098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6eb8107740 0x7f6eb8107b40 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6eac009820 tx=0x7f6eac02a270 comp rx=0 tx=0).stop 2024-09-19T06:01:37.697 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.987+0000 7f6ebfe00640 1 -- 172.21.15.3:0/1616028098 shutdown_connections 2024-09-19T06:01:37.698 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.987+0000 7f6ebfe00640 1 --2- 172.21.15.3:0/1616028098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6eb8107740 0x7f6eb8107b40 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:37.698 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.987+0000 7f6ebfe00640 1 -- 172.21.15.3:0/1616028098 >> 172.21.15.3:0/1616028098 conn(0x7f6eb8102ef0 msgr2=0x7f6eb8105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:37.698 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.988+0000 7f6ebfe00640 1 -- 172.21.15.3:0/1616028098 shutdown_connections 2024-09-19T06:01:37.698 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.988+0000 7f6ebfe00640 1 -- 172.21.15.3:0/1616028098 wait complete. 2024-09-19T06:01:37.698 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.988+0000 7f6ebfe00640 1 Processor -- start 2024-09-19T06:01:37.698 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.989+0000 7f6ebfe00640 1 -- start start 2024-09-19T06:01:37.698 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.989+0000 7f6ebfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6eb8107740 0x7f6eb819d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:37.698 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.989+0000 7f6ebfe00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb8108e90 con 0x7f6eb8107740 2024-09-19T06:01:37.698 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.989+0000 7f6ebd400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6eb8107740 0x7f6eb819d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:37.698 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.989+0000 7f6ebd400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6eb8107740 0x7f6eb819d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33642/0 (socket says 172.21.15.3:33642) 2024-09-19T06:01:37.698 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.989+0000 7f6ebd400640 1 -- 172.21.15.3:0/1918048523 learned_addr learned my addr 172.21.15.3:0/1918048523 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:01:37.698 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.990+0000 7f6ebd400640 1 -- 172.21.15.3:0/1918048523 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb819d5f0 con 0x7f6eb8107740 2024-09-19T06:01:37.698 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.990+0000 7f6ebd400640 1 --2- 172.21.15.3:0/1918048523 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6eb8107740 0x7f6eb819d0b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0090b0 tx=0x7f6eac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:37.699 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.990+0000 7f6eb6000640 1 -- 172.21.15.3:0/1918048523 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6eac041070 con 0x7f6eb8107740 2024-09-19T06:01:37.699 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.990+0000 7f6eb6000640 1 -- 172.21.15.3:0/1918048523 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eac03c7a0 con 0x7f6eb8107740 2024-09-19T06:01:37.699 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.990+0000 7f6eb6000640 1 -- 172.21.15.3:0/1918048523 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6eac037040 con 0x7f6eb8107740 2024-09-19T06:01:37.699 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.990+0000 7f6ebfe00640 1 -- 172.21.15.3:0/1918048523 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb819d880 con 0x7f6eb8107740 2024-09-19T06:01:37.699 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.990+0000 7f6ebfe00640 1 -- 172.21.15.3:0/1918048523 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eb81a0570 con 0x7f6eb8107740 2024-09-19T06:01:37.699 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.991+0000 7f6eb6000640 1 -- 172.21.15.3:0/1918048523 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6eac044070 con 0x7f6eb8107740 2024-09-19T06:01:37.699 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.991+0000 7f6eb6000640 1 -- 172.21.15.3:0/1918048523 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6eac03d3f0 con 0x7f6eb8107740 2024-09-19T06:01:37.699 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.991+0000 7f6ebfe00640 1 -- 172.21.15.3:0/1918048523 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eb81094e0 con 0x7f6eb8107740 2024-09-19T06:01:37.699 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:36.994+0000 7f6eb6000640 1 -- 172.21.15.3:0/1918048523 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6eac046450 con 0x7f6eb8107740 2024-09-19T06:01:37.699 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:37.056+0000 7f6ebfe00640 1 -- 172.21.15.3:0/1918048523 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f6eb802d910 con 0x7f6eb8107740 2024-09-19T06:01:37.699 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:37.060+0000 7f6eb6000640 1 -- 172.21.15.3:0/1918048523 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+427 (secure 0 0 0) 0x7f6eac046630 con 0x7f6eb8107740 2024-09-19T06:01:37.699 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:37.061+0000 7f6eb6000640 1 -- 172.21.15.3:0/1918048523 <== mon.0 v2:172.21.15.3:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6eac0584b0 con 0x7f6eb8107740 2024-09-19T06:01:37.699 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:37.062+0000 7f6ebfe00640 1 -- 172.21.15.3:0/1918048523 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6eb8107740 msgr2=0x7f6eb819d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:37.700 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:37.062+0000 7f6ebfe00640 1 --2- 172.21.15.3:0/1918048523 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6eb8107740 0x7f6eb819d0b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0090b0 tx=0x7f6eac0046c0 comp rx=0 tx=0).stop 2024-09-19T06:01:37.700 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:37.062+0000 7f6ebfe00640 1 -- 172.21.15.3:0/1918048523 shutdown_connections 2024-09-19T06:01:37.700 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:37.062+0000 7f6ebfe00640 1 --2- 172.21.15.3:0/1918048523 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6eb8107740 0x7f6eb819d0b0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:37.700 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:37.062+0000 7f6ebfe00640 1 -- 172.21.15.3:0/1918048523 >> 172.21.15.3:0/1918048523 conn(0x7f6eb8102ef0 msgr2=0x7f6eb818f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:37.700 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:37.062+0000 7f6ebfe00640 1 -- 172.21.15.3:0/1918048523 shutdown_connections 2024-09-19T06:01:37.700 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:37.062+0000 7f6ebfe00640 1 -- 172.21.15.3:0/1918048523 wait complete. 2024-09-19T06:01:37.700 INFO:teuthology.orchestra.run.smithi003.stdout:Generating new minimal ceph.conf... 2024-09-19T06:01:38.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:38 smithi003 ceph-mon[30519]: from='client.? 172.21.15.3:0/3116643309' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:01:39.208 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.202+0000 7fb7c6000640 1 Processor -- start 2024-09-19T06:01:39.208 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.203+0000 7fb7c6000640 1 -- start start 2024-09-19T06:01:39.208 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.203+0000 7fb7c6000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7c0109960 0x7fb7c0109d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:39.208 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.203+0000 7fb7c6000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c010a330 con 0x7fb7c0109960 2024-09-19T06:01:39.208 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.203+0000 7fb7bf400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7c0109960 0x7fb7c0109d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:39.209 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.203+0000 7fb7bf400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7c0109960 0x7fb7c0109d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33644/0 (socket says 172.21.15.3:33644) 2024-09-19T06:01:39.209 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.203+0000 7fb7bf400640 1 -- 172.21.15.3:0/3661635103 learned_addr learned my addr 172.21.15.3:0/3661635103 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:01:39.209 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.204+0000 7fb7bf400640 1 -- 172.21.15.3:0/3661635103 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7c010aad0 con 0x7fb7c0109960 2024-09-19T06:01:39.209 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.205+0000 7fb7bf400640 1 --2- 172.21.15.3:0/3661635103 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7c0109960 0x7fb7c0109d60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0009820 tx=0x7fb7b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3be3436e9b65486 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:39.209 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.205+0000 7fb7be000640 1 -- 172.21.15.3:0/3661635103 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7b0037070 con 0x7fb7c0109960 2024-09-19T06:01:39.209 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.205+0000 7fb7be000640 1 -- 172.21.15.3:0/3661635103 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb7b0032900 con 0x7fb7c0109960 2024-09-19T06:01:39.209 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.205+0000 7fb7be000640 1 -- 172.21.15.3:0/3661635103 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7b0030850 con 0x7fb7c0109960 2024-09-19T06:01:39.209 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.206+0000 7fb7c6000640 1 -- 172.21.15.3:0/3661635103 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7c0109960 msgr2=0x7fb7c0109d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:39.209 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.206+0000 7fb7c6000640 1 --2- 172.21.15.3:0/3661635103 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7c0109960 0x7fb7c0109d60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0009820 tx=0x7fb7b002a270 comp rx=0 tx=0).stop 2024-09-19T06:01:39.209 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.206+0000 7fb7c6000640 1 -- 172.21.15.3:0/3661635103 shutdown_connections 2024-09-19T06:01:39.210 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.206+0000 7fb7c6000640 1 --2- 172.21.15.3:0/3661635103 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7c0109960 0x7fb7c0109d60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:39.210 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.206+0000 7fb7c6000640 1 -- 172.21.15.3:0/3661635103 >> 172.21.15.3:0/3661635103 conn(0x7fb7c007cf30 msgr2=0x7fb7c007d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:39.210 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.206+0000 7fb7c6000640 1 -- 172.21.15.3:0/3661635103 shutdown_connections 2024-09-19T06:01:39.210 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.206+0000 7fb7c6000640 1 -- 172.21.15.3:0/3661635103 wait complete. 2024-09-19T06:01:39.210 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.207+0000 7fb7c6000640 1 Processor -- start 2024-09-19T06:01:39.210 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.207+0000 7fb7c6000640 1 -- start start 2024-09-19T06:01:39.210 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.208+0000 7fb7c6000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7c0109960 0x7fb7c019d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:39.210 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.208+0000 7fb7c6000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c010de80 con 0x7fb7c0109960 2024-09-19T06:01:39.210 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.208+0000 7fb7bf400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7c0109960 0x7fb7c019d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:39.210 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.208+0000 7fb7bf400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7c0109960 0x7fb7c019d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33652/0 (socket says 172.21.15.3:33652) 2024-09-19T06:01:39.210 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.208+0000 7fb7bf400640 1 -- 172.21.15.3:0/3116643309 learned_addr learned my addr 172.21.15.3:0/3116643309 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:01:39.211 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.208+0000 7fb7bf400640 1 -- 172.21.15.3:0/3116643309 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7c019de40 con 0x7fb7c0109960 2024-09-19T06:01:39.211 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.209+0000 7fb7bf400640 1 --2- 172.21.15.3:0/3116643309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7c0109960 0x7fb7c019d900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0009940 tx=0x7fb7b00326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:39.211 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.209+0000 7fb7b7e00640 1 -- 172.21.15.3:0/3116643309 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7b0042070 con 0x7fb7c0109960 2024-09-19T06:01:39.211 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.209+0000 7fb7b7e00640 1 -- 172.21.15.3:0/3116643309 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb7b0032be0 con 0x7fb7c0109960 2024-09-19T06:01:39.211 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.209+0000 7fb7c6000640 1 -- 172.21.15.3:0/3116643309 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7c019e0d0 con 0x7fb7c0109960 2024-09-19T06:01:39.211 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.209+0000 7fb7b7e00640 1 -- 172.21.15.3:0/3116643309 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7b0037040 con 0x7fb7c0109960 2024-09-19T06:01:39.211 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.209+0000 7fb7c6000640 1 -- 172.21.15.3:0/3116643309 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7c01a0dc0 con 0x7fb7c0109960 2024-09-19T06:01:39.211 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.210+0000 7fb7b7e00640 1 -- 172.21.15.3:0/3116643309 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb7b0045070 con 0x7fb7c0109960 2024-09-19T06:01:39.212 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.210+0000 7fb7b7e00640 1 -- 172.21.15.3:0/3116643309 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb7b0047780 con 0x7fb7c0109960 2024-09-19T06:01:39.212 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.210+0000 7fb7c6000640 1 -- 172.21.15.3:0/3116643309 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7c010e000 con 0x7fb7c0109960 2024-09-19T06:01:39.212 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.215+0000 7fb7b7e00640 1 -- 172.21.15.3:0/3116643309 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb7b0032d90 con 0x7fb7c0109960 2024-09-19T06:01:39.212 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.282+0000 7fb7c6000640 1 -- 172.21.15.3:0/3116643309 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fb7c01a13b0 con 0x7fb7c0109960 2024-09-19T06:01:39.212 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.283+0000 7fb7b7e00640 1 -- 172.21.15.3:0/3116643309 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+173 (secure 0 0 0) 0x7fb7b003d8f0 con 0x7fb7c0109960 2024-09-19T06:01:39.212 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.284+0000 7fb7c6000640 1 -- 172.21.15.3:0/3116643309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7c0109960 msgr2=0x7fb7c019d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:39.212 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.284+0000 7fb7c6000640 1 --2- 172.21.15.3:0/3116643309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7c0109960 0x7fb7c019d900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0009940 tx=0x7fb7b00326e0 comp rx=0 tx=0).stop 2024-09-19T06:01:39.212 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.284+0000 7fb7c6000640 1 -- 172.21.15.3:0/3116643309 shutdown_connections 2024-09-19T06:01:39.212 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.284+0000 7fb7c6000640 1 --2- 172.21.15.3:0/3116643309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7c0109960 0x7fb7c019d900 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:39.213 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.284+0000 7fb7c6000640 1 -- 172.21.15.3:0/3116643309 >> 172.21.15.3:0/3116643309 conn(0x7fb7c007cf30 msgr2=0x7fb7c0107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:39.213 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.284+0000 7fb7c6000640 1 -- 172.21.15.3:0/3116643309 shutdown_connections 2024-09-19T06:01:39.213 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:38.284+0000 7fb7c6000640 1 -- 172.21.15.3:0/3116643309 wait complete. 2024-09-19T06:01:39.213 INFO:teuthology.orchestra.run.smithi003.stdout:Restarting the monitor... 2024-09-19T06:01:39.564 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:39 smithi003 systemd[1]: Stopping Ceph mon.a for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:01:39.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:39 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-a[30515]: 2024-09-19T06:01:39.561+0000 7fefe3800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:01:39.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:39 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-a[30515]: 2024-09-19T06:01:39.561+0000 7fefe3800640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T06:01:39.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:39 smithi003 podman[30770]: 2024-09-19 06:01:39.756897802 +0000 UTC m=+0.320433330 container died e2a25acaa3429f647c801fb9d1d04d1fa68c9cce287c8b1f7568150feac71cd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T06:01:40.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:40 smithi003 podman[30770]: 2024-09-19 06:01:40.165674235 +0000 UTC m=+0.729209763 container cleanup e2a25acaa3429f647c801fb9d1d04d1fa68c9cce287c8b1f7568150feac71cd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T06:01:40.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:40 smithi003 bash[30770]: ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-a 2024-09-19T06:01:40.702 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:40 smithi003 podman[30781]: 2024-09-19 06:01:40.450316728 +0000 UTC m=+0.686395377 container remove e2a25acaa3429f647c801fb9d1d04d1fa68c9cce287c8b1f7568150feac71cd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:01:41.021 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:40 smithi003 systemd[1]: ceph-782a5144-764c-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T06:01:41.021 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:40 smithi003 systemd[1]: Stopped Ceph mon.a for 782a5144-764c-11ef-bceb-c7b262605968. 2024-09-19T06:01:41.021 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:40 smithi003 systemd[1]: ceph-782a5144-764c-11ef-bceb-c7b262605968@mon.a.service: Consumed 1.233s CPU time. 2024-09-19T06:01:41.021 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:40 smithi003 systemd[1]: Starting Ceph mon.a for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:01:41.278 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 podman[30874]: 2024-09-19 06:01:40.925068339 +0000 UTC m=+0.027854110 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:01:41.278 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 podman[30874]: 2024-09-19 06:01:41.061484991 +0000 UTC m=+0.164270739 container create c484d090f876bf3243c8a5eb47ac5d61b40cd72bbed66eb09d7b03ab273bfef4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T06:01:41.278 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 podman[30874]: 2024-09-19 06:01:41.270073582 +0000 UTC m=+0.372859330 container init c484d090f876bf3243c8a5eb47ac5d61b40cd72bbed66eb09d7b03ab273bfef4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T06:01:41.278 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 podman[30874]: 2024-09-19 06:01:41.276545794 +0000 UTC m=+0.379331542 container start c484d090f876bf3243c8a5eb47ac5d61b40cd72bbed66eb09d7b03ab273bfef4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:01:41.370 INFO:teuthology.orchestra.run.smithi003.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T06:01:41.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T06:01:41.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T06:01:41.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: pidfile_write: ignore empty --pid-file 2024-09-19T06:01:41.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: load: jerasure load: lrc 2024-09-19T06:01:41.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: RocksDB version: 7.9.2 2024-09-19T06:01:41.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Git sha 0 2024-09-19T06:01:41.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T06:01:41.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: DB SUMMARY 2024-09-19T06:01:41.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: DB Session ID: 8UGNRYTUNQ0YWGBP6EQ9 2024-09-19T06:01:41.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: CURRENT file: CURRENT 2024-09-19T06:01:41.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T06:01:41.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T06:01:41.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T06:01:41.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105780 ; 2024-09-19T06:01:41.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.error_if_exists: 0 2024-09-19T06:01:41.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.create_if_missing: 0 2024-09-19T06:01:41.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.paranoid_checks: 1 2024-09-19T06:01:41.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T06:01:41.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T06:01:41.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T06:01:41.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.env: 0x559aeb776940 2024-09-19T06:01:41.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T06:01:41.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.info_log: 0x559b0c8576a0 2024-09-19T06:01:41.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T06:01:41.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.statistics: (nil) 2024-09-19T06:01:41.588 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.use_fsync: 0 2024-09-19T06:01:41.588 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_log_file_size: 0 2024-09-19T06:01:41.588 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T06:01:41.588 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T06:01:41.588 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T06:01:41.588 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T06:01:41.588 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.allow_fallocate: 1 2024-09-19T06:01:41.588 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T06:01:41.588 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T06:01:41.588 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.use_direct_reads: 0 2024-09-19T06:01:41.588 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T06:01:41.588 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T06:01:41.588 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.db_log_dir: 2024-09-19T06:01:41.589 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.wal_dir: 2024-09-19T06:01:41.589 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T06:01:41.590 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T06:01:41.590 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T06:01:41.590 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T06:01:41.590 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T06:01:41.590 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T06:01:41.591 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T06:01:41.591 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T06:01:41.591 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.write_buffer_manager: 0x559b0c866dc0 2024-09-19T06:01:41.591 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T06:01:41.591 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T06:01:41.591 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T06:01:41.591 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T06:01:41.591 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T06:01:41.591 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T06:01:41.591 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T06:01:41.591 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T06:01:41.591 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.unordered_write: 0 2024-09-19T06:01:41.592 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T06:01:41.592 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T06:01:41.592 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T06:01:41.592 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T06:01:41.592 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.row_cache: None 2024-09-19T06:01:41.592 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.wal_filter: None 2024-09-19T06:01:41.592 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T06:01:41.592 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T06:01:41.592 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.two_write_queues: 0 2024-09-19T06:01:41.592 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T06:01:41.593 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.wal_compression: 0 2024-09-19T06:01:41.593 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.atomic_flush: 0 2024-09-19T06:01:41.593 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T06:01:41.593 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T06:01:41.593 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T06:01:41.593 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.log_readahead_size: 0 2024-09-19T06:01:41.593 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T06:01:41.593 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T06:01:41.593 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T06:01:41.593 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T06:01:41.593 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T06:01:41.593 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T06:01:41.593 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T06:01:41.594 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_background_jobs: 2 2024-09-19T06:01:41.594 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_background_compactions: -1 2024-09-19T06:01:41.594 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_subcompactions: 1 2024-09-19T06:01:41.594 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T06:01:41.594 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T06:01:41.594 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T06:01:41.594 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T06:01:41.594 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T06:01:41.594 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T06:01:41.595 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T06:01:41.595 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T06:01:41.595 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_open_files: -1 2024-09-19T06:01:41.595 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T06:01:41.595 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T06:01:41.595 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T06:01:41.595 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T06:01:41.595 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_background_flushes: -1 2024-09-19T06:01:41.595 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Compression algorithms supported: 2024-09-19T06:01:41.595 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: kZSTD supported: 0 2024-09-19T06:01:41.595 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: kXpressCompression supported: 0 2024-09-19T06:01:41.595 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: kBZip2Compression supported: 0 2024-09-19T06:01:41.595 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T06:01:41.596 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: kLZ4Compression supported: 1 2024-09-19T06:01:41.596 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: kZlibCompression supported: 1 2024-09-19T06:01:41.596 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T06:01:41.596 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: kSnappyCompression supported: 1 2024-09-19T06:01:41.596 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T06:01:41.596 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T06:01:41.596 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T06:01:41.596 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T06:01:41.596 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T06:01:41.596 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.merge_operator: 2024-09-19T06:01:41.596 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.compaction_filter: None 2024-09-19T06:01:41.596 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T06:01:41.596 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T06:01:41.596 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T06:01:41.597 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T06:01:41.597 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559b0c857300) 2024-09-19T06:01:41.597 INFO:journalctl@ceph.mon.a.smithi003.stdout: cache_index_and_filter_blocks: 1 2024-09-19T06:01:41.597 INFO:journalctl@ceph.mon.a.smithi003.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T06:01:41.597 INFO:journalctl@ceph.mon.a.smithi003.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T06:01:41.597 INFO:journalctl@ceph.mon.a.smithi003.stdout: pin_top_level_index_and_filter: 1 2024-09-19T06:01:41.597 INFO:journalctl@ceph.mon.a.smithi003.stdout: index_type: 0 2024-09-19T06:01:41.597 INFO:journalctl@ceph.mon.a.smithi003.stdout: data_block_index_type: 0 2024-09-19T06:01:41.597 INFO:journalctl@ceph.mon.a.smithi003.stdout: index_shortening: 1 2024-09-19T06:01:41.597 INFO:journalctl@ceph.mon.a.smithi003.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T06:01:41.598 INFO:journalctl@ceph.mon.a.smithi003.stdout: checksum: 4 2024-09-19T06:01:41.598 INFO:journalctl@ceph.mon.a.smithi003.stdout: no_block_cache: 0 2024-09-19T06:01:41.598 INFO:journalctl@ceph.mon.a.smithi003.stdout: block_cache: 0x559b0c84b1f0 2024-09-19T06:01:41.598 INFO:journalctl@ceph.mon.a.smithi003.stdout: block_cache_name: BinnedLRUCache 2024-09-19T06:01:41.598 INFO:journalctl@ceph.mon.a.smithi003.stdout: block_cache_options: 2024-09-19T06:01:41.598 INFO:journalctl@ceph.mon.a.smithi003.stdout: capacity : 536870912 2024-09-19T06:01:41.598 INFO:journalctl@ceph.mon.a.smithi003.stdout: num_shard_bits : 4 2024-09-19T06:01:41.598 INFO:journalctl@ceph.mon.a.smithi003.stdout: strict_capacity_limit : 0 2024-09-19T06:01:41.598 INFO:journalctl@ceph.mon.a.smithi003.stdout: high_pri_pool_ratio: 0.000 2024-09-19T06:01:41.599 INFO:journalctl@ceph.mon.a.smithi003.stdout: block_cache_compressed: (nil) 2024-09-19T06:01:41.599 INFO:journalctl@ceph.mon.a.smithi003.stdout: persistent_cache: (nil) 2024-09-19T06:01:41.599 INFO:journalctl@ceph.mon.a.smithi003.stdout: block_size: 4096 2024-09-19T06:01:41.599 INFO:journalctl@ceph.mon.a.smithi003.stdout: block_size_deviation: 10 2024-09-19T06:01:41.599 INFO:journalctl@ceph.mon.a.smithi003.stdout: block_restart_interval: 16 2024-09-19T06:01:41.599 INFO:journalctl@ceph.mon.a.smithi003.stdout: index_block_restart_interval: 1 2024-09-19T06:01:41.599 INFO:journalctl@ceph.mon.a.smithi003.stdout: metadata_block_size: 4096 2024-09-19T06:01:41.599 INFO:journalctl@ceph.mon.a.smithi003.stdout: partition_filters: 0 2024-09-19T06:01:41.599 INFO:journalctl@ceph.mon.a.smithi003.stdout: use_delta_encoding: 1 2024-09-19T06:01:41.599 INFO:journalctl@ceph.mon.a.smithi003.stdout: filter_policy: bloomfilter 2024-09-19T06:01:41.599 INFO:journalctl@ceph.mon.a.smithi003.stdout: whole_key_filtering: 1 2024-09-19T06:01:41.599 INFO:journalctl@ceph.mon.a.smithi003.stdout: verify_compression: 0 2024-09-19T06:01:41.600 INFO:journalctl@ceph.mon.a.smithi003.stdout: read_amp_bytes_per_bit: 0 2024-09-19T06:01:41.600 INFO:journalctl@ceph.mon.a.smithi003.stdout: format_version: 5 2024-09-19T06:01:41.600 INFO:journalctl@ceph.mon.a.smithi003.stdout: enable_index_compression: 1 2024-09-19T06:01:41.600 INFO:journalctl@ceph.mon.a.smithi003.stdout: block_align: 0 2024-09-19T06:01:41.600 INFO:journalctl@ceph.mon.a.smithi003.stdout: max_auto_readahead_size: 262144 2024-09-19T06:01:41.600 INFO:journalctl@ceph.mon.a.smithi003.stdout: prepopulate_block_cache: 0 2024-09-19T06:01:41.600 INFO:journalctl@ceph.mon.a.smithi003.stdout: initial_auto_readahead_size: 8192 2024-09-19T06:01:41.600 INFO:journalctl@ceph.mon.a.smithi003.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T06:01:41.600 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T06:01:41.600 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T06:01:41.600 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.compression: NoCompression 2024-09-19T06:01:41.600 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T06:01:41.600 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T06:01:41.600 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T06:01:41.601 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.num_levels: 7 2024-09-19T06:01:41.601 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T06:01:41.601 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T06:01:41.601 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T06:01:41.601 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T06:01:41.601 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T06:01:41.601 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T06:01:41.601 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T06:01:41.601 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:01:41.602 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T06:01:41.602 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T06:01:41.602 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:01:41.602 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:01:41.602 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T06:01:41.602 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T06:01:41.602 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T06:01:41.602 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T06:01:41.602 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:01:41.602 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:01:41.602 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T06:01:41.602 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T06:01:41.603 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:01:41.603 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T06:01:41.603 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T06:01:41.603 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T06:01:41.603 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T06:01:41.603 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T06:01:41.603 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T06:01:41.603 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T06:01:41.603 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T06:01:41.603 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T06:01:41.603 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T06:01:41.603 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T06:01:41.604 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T06:01:41.604 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T06:01:41.604 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T06:01:41.604 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T06:01:41.604 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T06:01:41.604 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T06:01:41.604 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T06:01:41.604 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T06:01:41.604 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T06:01:41.605 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T06:01:41.605 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T06:01:41.605 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T06:01:41.605 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T06:01:41.605 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T06:01:41.605 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T06:01:41.605 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T06:01:41.605 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T06:01:41.605 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T06:01:41.605 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T06:01:41.605 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T06:01:41.605 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T06:01:41.605 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T06:01:41.606 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.inplace_update_support: 0 2024-09-19T06:01:41.606 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T06:01:41.606 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T06:01:41.606 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T06:01:41.606 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T06:01:41.606 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.bloom_locality: 0 2024-09-19T06:01:41.606 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.max_successive_merges: 0 2024-09-19T06:01:41.606 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T06:01:41.606 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T06:01:41.606 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T06:01:41.606 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T06:01:41.606 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.ttl: 2592000 2024-09-19T06:01:41.606 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T06:01:41.606 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T06:01:41.607 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T06:01:41.607 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.enable_blob_files: false 2024-09-19T06:01:41.607 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.min_blob_size: 0 2024-09-19T06:01:41.608 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T06:01:41.608 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T06:01:41.608 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T06:01:41.608 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T06:01:41.608 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T06:01:41.608 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T06:01:41.608 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T06:01:41.608 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T06:01:41.608 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T06:01:41.608 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T06:01:41.608 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 89130042-3998-4386-ab9d-4f5c4b848fa8 2024-09-19T06:01:41.609 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726725701318920, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T06:01:41.609 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T06:01:41.609 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726725701320625, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100791, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 330, "table_properties": {"data_size": 98676, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14423, "raw_average_key_size": 49, "raw_value_size": 90882, "raw_average_value_size": 314, "num_data_blocks": 12, "num_entries": 289, "num_filter_entries": 289, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726725701, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "89130042-3998-4386-ab9d-4f5c4b848fa8", "db_session_id": "8UGNRYTUNQ0YWGBP6EQ9", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T06:01:41.609 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726725701320894, "job": 1, "event": "recovery_finished"} 2024-09-19T06:01:41.609 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T06:01:41.609 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T06:01:41.609 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x559b0c87ae00 2024-09-19T06:01:41.609 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: DB pointer 0x559b0c976000 2024-09-19T06:01:41.609 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T06:01:41.609 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T06:01:41.609 INFO:journalctl@ceph.mon.a.smithi003.stdout: ** DB Stats ** 2024-09-19T06:01:41.609 INFO:journalctl@ceph.mon.a.smithi003.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:01:41.609 INFO:journalctl@ceph.mon.a.smithi003.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T06:01:41.609 INFO:journalctl@ceph.mon.a.smithi003.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:01:41.610 INFO:journalctl@ceph.mon.a.smithi003.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:01:41.610 INFO:journalctl@ceph.mon.a.smithi003.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T06:01:41.610 INFO:journalctl@ceph.mon.a.smithi003.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:01:41.610 INFO:journalctl@ceph.mon.a.smithi003.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:01:41.610 INFO:journalctl@ceph.mon.a.smithi003.stdout: 2024-09-19T06:01:41.610 INFO:journalctl@ceph.mon.a.smithi003.stdout: ** Compaction Stats [default] ** 2024-09-19T06:01:41.610 INFO:journalctl@ceph.mon.a.smithi003.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:01:41.610 INFO:journalctl@ceph.mon.a.smithi003.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T06:01:41.610 INFO:journalctl@ceph.mon.a.smithi003.stdout: L0 2/0 100.29 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 91.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T06:01:41.610 INFO:journalctl@ceph.mon.a.smithi003.stdout: Sum 2/0 100.29 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 91.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T06:01:41.610 INFO:journalctl@ceph.mon.a.smithi003.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 91.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T06:01:41.611 INFO:journalctl@ceph.mon.a.smithi003.stdout: 2024-09-19T06:01:41.611 INFO:journalctl@ceph.mon.a.smithi003.stdout: ** Compaction Stats [default] ** 2024-09-19T06:01:41.611 INFO:journalctl@ceph.mon.a.smithi003.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:01:41.611 INFO:journalctl@ceph.mon.a.smithi003.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T06:01:41.611 INFO:journalctl@ceph.mon.a.smithi003.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 91.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T06:01:41.611 INFO:journalctl@ceph.mon.a.smithi003.stdout: 2024-09-19T06:01:41.611 INFO:journalctl@ceph.mon.a.smithi003.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T06:01:41.611 INFO:journalctl@ceph.mon.a.smithi003.stdout: 2024-09-19T06:01:41.611 INFO:journalctl@ceph.mon.a.smithi003.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:01:41.611 INFO:journalctl@ceph.mon.a.smithi003.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T06:01:41.611 INFO:journalctl@ceph.mon.a.smithi003.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T06:01:41.612 INFO:journalctl@ceph.mon.a.smithi003.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T06:01:41.612 INFO:journalctl@ceph.mon.a.smithi003.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T06:01:41.612 INFO:journalctl@ceph.mon.a.smithi003.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T06:01:41.612 INFO:journalctl@ceph.mon.a.smithi003.stdout: Cumulative compaction: 0.00 GB write, 16.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:01:41.612 INFO:journalctl@ceph.mon.a.smithi003.stdout: Interval compaction: 0.00 GB write, 16.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:01:41.612 INFO:journalctl@ceph.mon.a.smithi003.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T06:01:41.612 INFO:journalctl@ceph.mon.a.smithi003.stdout: Block cache BinnedLRUCache@0x559b0c84b1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T06:01:41.612 INFO:journalctl@ceph.mon.a.smithi003.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T06:01:41.612 INFO:journalctl@ceph.mon.a.smithi003.stdout: 2024-09-19T06:01:41.612 INFO:journalctl@ceph.mon.a.smithi003.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T06:01:41.612 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: starting mon.a rank 0 at public addrs [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] at bind addrs [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:01:41.612 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: mon.a@-1(???) e1 preinit fsid 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:01:41.612 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: mon.a@-1(???).mds e1 new map 2024-09-19T06:01:41.613 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: mon.a@-1(???).mds e1 print_map 2024-09-19T06:01:41.613 INFO:journalctl@ceph.mon.a.smithi003.stdout: e1 2024-09-19T06:01:41.613 INFO:journalctl@ceph.mon.a.smithi003.stdout: btime 2024-09-19T06:01:35:224503+0000 2024-09-19T06:01:41.613 INFO:journalctl@ceph.mon.a.smithi003.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:01:41.613 INFO:journalctl@ceph.mon.a.smithi003.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T06:01:41.613 INFO:journalctl@ceph.mon.a.smithi003.stdout: legacy client fscid: -1 2024-09-19T06:01:41.613 INFO:journalctl@ceph.mon.a.smithi003.stdout: 2024-09-19T06:01:41.613 INFO:journalctl@ceph.mon.a.smithi003.stdout: No filesystems configured 2024-09-19T06:01:41.613 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T06:01:41.613 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:01:41.613 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:01:41.614 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:01:41.614 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T06:01:41.614 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 bash[30874]: c484d090f876bf3243c8a5eb47ac5d61b40cd72bbed66eb09d7b03ab273bfef4 2024-09-19T06:01:41.614 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 systemd[1]: Started Ceph mon.a for 782a5144-764c-11ef-bceb-c7b262605968. 2024-09-19T06:01:41.614 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T06:01:41.614 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: monmap epoch 1 2024-09-19T06:01:41.614 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: fsid 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:01:41.614 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: last_changed 2024-09-19T06:01:31.421310+0000 2024-09-19T06:01:41.614 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: created 2024-09-19T06:01:31.421310+0000 2024-09-19T06:01:41.614 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: min_mon_release 19 (squid) 2024-09-19T06:01:41.614 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: election_strategy: 1 2024-09-19T06:01:41.614 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2024-09-19T06:01:41.614 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: fsmap 2024-09-19T06:01:41.615 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T06:01:41.615 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:41 smithi003 ceph-mon[30893]: mgrmap e1: no daemons active 2024-09-19T06:01:42.604 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.877+0000 7fbb74200640 1 Processor -- start 2024-09-19T06:01:42.988 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.877+0000 7fbb74200640 1 -- start start 2024-09-19T06:01:42.988 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.877+0000 7fbb74200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb6c07de70 0x7fbb6c07c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:42.988 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.877+0000 7fbb74200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c07c8f0 con 0x7fbb6c07de70 2024-09-19T06:01:42.988 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.878+0000 7fbb71800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb6c07de70 0x7fbb6c07c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:42.989 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.878+0000 7fbb71800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb6c07de70 0x7fbb6c07c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33660/0 (socket says 172.21.15.3:33660) 2024-09-19T06:01:42.989 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.878+0000 7fbb71800640 1 -- 172.21.15.3:0/714817149 learned_addr learned my addr 172.21.15.3:0/714817149 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:01:42.989 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.878+0000 7fbb71800640 1 -- 172.21.15.3:0/714817149 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6c07ca70 con 0x7fbb6c07de70 2024-09-19T06:01:42.989 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.881+0000 7fbb71800640 1 --2- 172.21.15.3:0/714817149 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb6c07de70 0x7fbb6c07c320 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009820 tx=0x7fbb6002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d2de79d8ccc4443 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:42.989 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.881+0000 7fbb6be00640 1 -- 172.21.15.3:0/714817149 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb60037070 con 0x7fbb6c07de70 2024-09-19T06:01:42.989 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.881+0000 7fbb6be00640 1 -- 172.21.15.3:0/714817149 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb60032900 con 0x7fbb6c07de70 2024-09-19T06:01:42.990 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.881+0000 7fbb6be00640 1 -- 172.21.15.3:0/714817149 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb60030850 con 0x7fbb6c07de70 2024-09-19T06:01:42.990 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.882+0000 7fbb74200640 1 -- 172.21.15.3:0/714817149 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb6c07de70 msgr2=0x7fbb6c07c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:42.990 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.882+0000 7fbb74200640 1 --2- 172.21.15.3:0/714817149 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb6c07de70 0x7fbb6c07c320 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009820 tx=0x7fbb6002a270 comp rx=0 tx=0).stop 2024-09-19T06:01:42.990 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.882+0000 7fbb74200640 1 -- 172.21.15.3:0/714817149 shutdown_connections 2024-09-19T06:01:42.991 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.882+0000 7fbb74200640 1 --2- 172.21.15.3:0/714817149 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb6c07de70 0x7fbb6c07c320 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:42.991 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.882+0000 7fbb74200640 1 -- 172.21.15.3:0/714817149 >> 172.21.15.3:0/714817149 conn(0x7fbb6c102ef0 msgr2=0x7fbb6c105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:42.991 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.882+0000 7fbb74200640 1 -- 172.21.15.3:0/714817149 shutdown_connections 2024-09-19T06:01:42.991 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.882+0000 7fbb74200640 1 -- 172.21.15.3:0/714817149 wait complete. 2024-09-19T06:01:42.991 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.883+0000 7fbb74200640 1 Processor -- start 2024-09-19T06:01:42.991 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.883+0000 7fbb74200640 1 -- start start 2024-09-19T06:01:42.991 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.883+0000 7fbb74200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb6c07de70 0x7fbb6c19d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:42.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.883+0000 7fbb74200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c10dd30 con 0x7fbb6c07de70 2024-09-19T06:01:42.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.884+0000 7fbb71800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb6c07de70 0x7fbb6c19d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:42.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.884+0000 7fbb71800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb6c07de70 0x7fbb6c19d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33676/0 (socket says 172.21.15.3:33676) 2024-09-19T06:01:42.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.884+0000 7fbb71800640 1 -- 172.21.15.3:0/2724795150 learned_addr learned my addr 172.21.15.3:0/2724795150 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:01:42.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.884+0000 7fbb71800640 1 -- 172.21.15.3:0/2724795150 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6c19de40 con 0x7fbb6c07de70 2024-09-19T06:01:42.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.884+0000 7fbb71800640 1 --2- 172.21.15.3:0/2724795150 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb6c07de70 0x7fbb6c19d900 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fbb600097f0 tx=0x7fbb60030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:42.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.884+0000 7fbb6a000640 1 -- 172.21.15.3:0/2724795150 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb60042070 con 0x7fbb6c07de70 2024-09-19T06:01:42.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.885+0000 7fbb6a000640 1 -- 172.21.15.3:0/2724795150 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb60032ca0 con 0x7fbb6c07de70 2024-09-19T06:01:42.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.885+0000 7fbb74200640 1 -- 172.21.15.3:0/2724795150 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb6c19e0d0 con 0x7fbb6c07de70 2024-09-19T06:01:42.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.885+0000 7fbb6a000640 1 -- 172.21.15.3:0/2724795150 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb60037040 con 0x7fbb6c07de70 2024-09-19T06:01:42.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.885+0000 7fbb74200640 1 -- 172.21.15.3:0/2724795150 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb6c1a0dc0 con 0x7fbb6c07de70 2024-09-19T06:01:42.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.885+0000 7fbb6a000640 1 -- 172.21.15.3:0/2724795150 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbb60045070 con 0x7fbb6c07de70 2024-09-19T06:01:42.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.885+0000 7fbb6a000640 1 -- 172.21.15.3:0/2724795150 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbb60047a90 con 0x7fbb6c07de70 2024-09-19T06:01:42.993 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.886+0000 7fbb74200640 1 -- 172.21.15.3:0/2724795150 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb6c07c3a0 con 0x7fbb6c07de70 2024-09-19T06:01:42.993 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.889+0000 7fbb6a000640 1 -- 172.21.15.3:0/2724795150 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fbb6003db10 con 0x7fbb6c07de70 2024-09-19T06:01:42.993 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.951+0000 7fbb74200640 1 -- 172.21.15.3:0/2724795150 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fbb6c1a13a0 con 0x7fbb6c07de70 2024-09-19T06:01:42.993 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.953+0000 7fbb6a000640 1 -- 172.21.15.3:0/2724795150 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fbb6003d430 con 0x7fbb6c07de70 2024-09-19T06:01:42.993 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.955+0000 7fbb74200640 1 -- 172.21.15.3:0/2724795150 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb6c07de70 msgr2=0x7fbb6c19d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:42.993 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.955+0000 7fbb74200640 1 --2- 172.21.15.3:0/2724795150 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb6c07de70 0x7fbb6c19d900 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fbb600097f0 tx=0x7fbb60030ec0 comp rx=0 tx=0).stop 2024-09-19T06:01:42.993 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.955+0000 7fbb74200640 1 -- 172.21.15.3:0/2724795150 shutdown_connections 2024-09-19T06:01:42.993 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.955+0000 7fbb74200640 1 --2- 172.21.15.3:0/2724795150 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb6c07de70 0x7fbb6c19d900 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:42.993 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.955+0000 7fbb74200640 1 -- 172.21.15.3:0/2724795150 >> 172.21.15.3:0/2724795150 conn(0x7fbb6c102ef0 msgr2=0x7fbb6c103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:42.993 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.955+0000 7fbb74200640 1 -- 172.21.15.3:0/2724795150 shutdown_connections 2024-09-19T06:01:42.993 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:41.955+0000 7fbb74200640 1 -- 172.21.15.3:0/2724795150 wait complete. 2024-09-19T06:01:42.993 INFO:teuthology.orchestra.run.smithi003.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T06:01:42.994 INFO:teuthology.orchestra.run.smithi003.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:01:42.994 INFO:teuthology.orchestra.run.smithi003.stdout:Creating mgr... 2024-09-19T06:01:42.994 INFO:teuthology.orchestra.run.smithi003.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T06:01:42.995 INFO:teuthology.orchestra.run.smithi003.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T06:01:43.011 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-782a5144-764c-11ef-bceb-c7b262605968@mgr.x 2024-09-19T06:01:43.011 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Failed to reset failed state of unit ceph-782a5144-764c-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-782a5144-764c-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T06:01:43.244 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-782a5144-764c-11ef-bceb-c7b262605968.target.wants/ceph-782a5144-764c-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-782a5144-764c-11ef-bceb-c7b262605968@.service. 2024-09-19T06:01:43.275 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:42 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2724795150' entity='client.admin' 2024-09-19T06:01:43.585 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:43 smithi003 systemd[1]: Starting Ceph mgr.x for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:01:43.941 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:43 smithi003 podman[31105]: 2024-09-19 06:01:43.586448021 +0000 UTC m=+0.122094359 container create 0f74198e9686a8bed7eb9acadd741dde754cad3fdc08b0479d9154539045864a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T06:01:43.941 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:43 smithi003 podman[31105]: 2024-09-19 06:01:43.491508652 +0000 UTC m=+0.027155000 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:01:43.942 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:43 smithi003 podman[31105]: 2024-09-19 06:01:43.763935331 +0000 UTC m=+0.299581682 container init 0f74198e9686a8bed7eb9acadd741dde754cad3fdc08b0479d9154539045864a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T06:01:43.942 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:43 smithi003 podman[31105]: 2024-09-19 06:01:43.770005982 +0000 UTC m=+0.305652320 container start 0f74198e9686a8bed7eb9acadd741dde754cad3fdc08b0479d9154539045864a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T06:01:44.033 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T06:01:44.033 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout disabled 2024-09-19T06:01:44.047 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T06:01:44.047 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout inactive 2024-09-19T06:01:44.048 INFO:teuthology.orchestra.run.smithi003.stdout:firewalld.service is not enabled 2024-09-19T06:01:44.048 INFO:teuthology.orchestra.run.smithi003.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T06:01:44.065 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T06:01:44.065 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout disabled 2024-09-19T06:01:44.079 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T06:01:44.079 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout inactive 2024-09-19T06:01:44.079 INFO:teuthology.orchestra.run.smithi003.stdout:firewalld.service is not enabled 2024-09-19T06:01:44.079 INFO:teuthology.orchestra.run.smithi003.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T06:01:44.079 INFO:teuthology.orchestra.run.smithi003.stdout:Waiting for mgr to start... 2024-09-19T06:01:44.079 INFO:teuthology.orchestra.run.smithi003.stdout:Waiting for mgr... 2024-09-19T06:01:44.215 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:43 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:43.940+0000 7f311f839040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:01:44.215 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:44 smithi003 bash[31105]: 0f74198e9686a8bed7eb9acadd741dde754cad3fdc08b0479d9154539045864a 2024-09-19T06:01:44.215 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:44 smithi003 systemd[1]: Started Ceph mgr.x for 782a5144-764c-11ef-bceb-c7b262605968. 2024-09-19T06:01:44.215 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:44 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:44.012+0000 7f311f839040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:01:44.215 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:44 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:44.213+0000 7f311f839040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:01:44.487 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:44 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:44.297+0000 7f311f839040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:01:44.487 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:44 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:44.484+0000 7f311f839040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:01:44.757 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:44 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:44.661+0000 7f311f839040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:01:45.066 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:44 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3031754485' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T06:01:45.334 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:45 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:45.064+0000 7f311f839040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:01:45.335 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:45 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:45.139+0000 7f311f839040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:01:45.371 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-19T06:01:45.374 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:01:45.374 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "fsid": "782a5144-764c-11ef-bceb-c7b262605968", 2024-09-19T06:01:45.374 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T06:01:45.374 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T06:01:45.374 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T06:01:45.374 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T06:01:45.374 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:01:45.374 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T06:01:45.374 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T06:01:45.374 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 0 2024-09-19T06:01:45.374 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:01:45.374 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T06:01:45.374 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T06:01:45.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:01:45.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-19T06:01:45.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T06:01:45.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:01:45.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T06:01:45.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T06:01:45.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:01:45.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T06:01:45.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:01:45.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T06:01:45.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T06:01:45.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T06:01:45.383 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T06:01:45.383 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T06:01:45.383 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T06:01:45.383 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:01:45.383 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T06:01:45.383 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T06:01:45.383 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T06:01:45.383 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T06:01:45.383 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T06:01:45.383 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T06:01:45.383 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T06:01:45.384 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T06:01:45.384 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T06:01:45.384 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:01:45.384 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T06:01:45.384 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:01:45.384 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T06:01:35:224503+0000", 2024-09-19T06:01:45.384 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T06:01:45.384 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T06:01:45.384 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:01:45.384 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T06:01:45.384 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T06:01:45.384 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T06:01:45.384 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T06:01:45.384 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T06:01:45.385 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T06:01:45.385 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T06:01:45.385 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:01:45.385 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:01:45.385 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:01:45.385 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T06:01:45.385 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:01:45.385 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T06:01:35.225312+0000", 2024-09-19T06:01:45.385 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:01:45.385 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:01:45.385 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T06:01:45.385 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:01:45.385 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.626+0000 7f62b5c00640 1 Processor -- start 2024-09-19T06:01:45.386 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.626+0000 7f62b5c00640 1 -- start start 2024-09-19T06:01:45.386 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.626+0000 7f62b5c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62b0109960 0x7f62b0109d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:45.386 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.627+0000 7f62b5c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f62b010a330 con 0x7f62b0109960 2024-09-19T06:01:45.386 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.627+0000 7f62aea00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62b0109960 0x7f62b0109d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:45.386 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.627+0000 7f62aea00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62b0109960 0x7f62b0109d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53548/0 (socket says 172.21.15.3:53548) 2024-09-19T06:01:45.386 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.627+0000 7f62aea00640 1 -- 172.21.15.3:0/4028423403 learned_addr learned my addr 172.21.15.3:0/4028423403 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:01:45.386 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.627+0000 7f62aea00640 1 -- 172.21.15.3:0/4028423403 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b010aad0 con 0x7f62b0109960 2024-09-19T06:01:45.386 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.628+0000 7f62aea00640 1 --2- 172.21.15.3:0/4028423403 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62b0109960 0x7f62b0109d60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009820 tx=0x7f62a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756f6221f16b8488 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:45.386 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.629+0000 7f62ad600640 1 -- 172.21.15.3:0/4028423403 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62a0037070 con 0x7f62b0109960 2024-09-19T06:01:45.386 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.629+0000 7f62ad600640 1 -- 172.21.15.3:0/4028423403 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f62a0032900 con 0x7f62b0109960 2024-09-19T06:01:45.386 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.629+0000 7f62ad600640 1 -- 172.21.15.3:0/4028423403 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62a0030850 con 0x7f62b0109960 2024-09-19T06:01:45.386 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.629+0000 7f62b5c00640 1 -- 172.21.15.3:0/4028423403 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62b0109960 msgr2=0x7f62b0109d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:45.386 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.629+0000 7f62b5c00640 1 --2- 172.21.15.3:0/4028423403 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62b0109960 0x7f62b0109d60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009820 tx=0x7f62a002a270 comp rx=0 tx=0).stop 2024-09-19T06:01:45.387 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.630+0000 7f62b5c00640 1 -- 172.21.15.3:0/4028423403 shutdown_connections 2024-09-19T06:01:45.387 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.630+0000 7f62b5c00640 1 --2- 172.21.15.3:0/4028423403 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62b0109960 0x7f62b0109d60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:45.387 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.630+0000 7f62b5c00640 1 -- 172.21.15.3:0/4028423403 >> 172.21.15.3:0/4028423403 conn(0x7f62b007cf30 msgr2=0x7f62b007d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:45.387 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.630+0000 7f62b5c00640 1 -- 172.21.15.3:0/4028423403 shutdown_connections 2024-09-19T06:01:45.387 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.630+0000 7f62b5c00640 1 -- 172.21.15.3:0/4028423403 wait complete. 2024-09-19T06:01:45.387 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.631+0000 7f62b5c00640 1 Processor -- start 2024-09-19T06:01:45.387 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.631+0000 7f62b5c00640 1 -- start start 2024-09-19T06:01:45.387 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.631+0000 7f62b5c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62b0109960 0x7f62b019d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:45.387 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.631+0000 7f62b5c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f62b010de80 con 0x7f62b0109960 2024-09-19T06:01:45.387 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.631+0000 7f62aea00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62b0109960 0x7f62b019d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:45.387 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.631+0000 7f62aea00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62b0109960 0x7f62b019d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53556/0 (socket says 172.21.15.3:53556) 2024-09-19T06:01:45.387 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.631+0000 7f62aea00640 1 -- 172.21.15.3:0/3031754485 learned_addr learned my addr 172.21.15.3:0/3031754485 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:01:45.387 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.632+0000 7f62aea00640 1 -- 172.21.15.3:0/3031754485 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b019de40 con 0x7f62b0109960 2024-09-19T06:01:45.388 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.632+0000 7f62aea00640 1 --2- 172.21.15.3:0/3031754485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62b0109960 0x7f62b019d900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f62a00097f0 tx=0x7f62a0030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:45.388 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.632+0000 7f62a7400640 1 -- 172.21.15.3:0/3031754485 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62a0042070 con 0x7f62b0109960 2024-09-19T06:01:45.388 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.632+0000 7f62a7400640 1 -- 172.21.15.3:0/3031754485 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f62a0032ca0 con 0x7f62b0109960 2024-09-19T06:01:45.388 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.632+0000 7f62a7400640 1 -- 172.21.15.3:0/3031754485 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62a0037040 con 0x7f62b0109960 2024-09-19T06:01:45.388 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.632+0000 7f62b5c00640 1 -- 172.21.15.3:0/3031754485 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62b019e0d0 con 0x7f62b0109960 2024-09-19T06:01:45.388 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.633+0000 7f62b5c00640 1 -- 172.21.15.3:0/3031754485 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62b01a0dc0 con 0x7f62b0109960 2024-09-19T06:01:45.388 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.633+0000 7f62a7400640 1 -- 172.21.15.3:0/3031754485 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f62a0045070 con 0x7f62b0109960 2024-09-19T06:01:45.388 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.633+0000 7f62a7400640 1 -- 172.21.15.3:0/3031754485 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f62a0047a30 con 0x7f62b0109960 2024-09-19T06:01:45.388 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.634+0000 7f62b5c00640 1 -- 172.21.15.3:0/3031754485 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62b010e000 con 0x7f62b0109960 2024-09-19T06:01:45.388 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.636+0000 7f62a7400640 1 -- 172.21.15.3:0/3031754485 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f62a003da60 con 0x7f62b0109960 2024-09-19T06:01:45.388 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.703+0000 7f62b5c00640 1 -- 172.21.15.3:0/3031754485 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f62b01a1350 con 0x7f62b0109960 2024-09-19T06:01:45.388 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.704+0000 7f62a7400640 1 -- 172.21.15.3:0/3031754485 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f62a003d430 con 0x7f62b0109960 2024-09-19T06:01:45.388 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.705+0000 7f62b5c00640 1 -- 172.21.15.3:0/3031754485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62b0109960 msgr2=0x7f62b019d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:45.389 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.705+0000 7f62b5c00640 1 --2- 172.21.15.3:0/3031754485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62b0109960 0x7f62b019d900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f62a00097f0 tx=0x7f62a0030ec0 comp rx=0 tx=0).stop 2024-09-19T06:01:45.389 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.705+0000 7f62b5c00640 1 -- 172.21.15.3:0/3031754485 shutdown_connections 2024-09-19T06:01:45.389 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.705+0000 7f62b5c00640 1 --2- 172.21.15.3:0/3031754485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62b0109960 0x7f62b019d900 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:45.389 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.705+0000 7f62b5c00640 1 -- 172.21.15.3:0/3031754485 >> 172.21.15.3:0/3031754485 conn(0x7f62b007cf30 msgr2=0x7f62b0107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:45.389 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.705+0000 7f62b5c00640 1 -- 172.21.15.3:0/3031754485 shutdown_connections 2024-09-19T06:01:45.389 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:44.705+0000 7f62b5c00640 1 -- 172.21.15.3:0/3031754485 wait complete. 2024-09-19T06:01:45.389 INFO:teuthology.orchestra.run.smithi003.stdout:mgr not available, waiting (1/15)... 2024-09-19T06:01:45.834 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:45 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:45.361+0000 7f311f839040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:01:46.834 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:46 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:46.514+0000 7f311f839040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:01:46.835 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:46 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:46.598+0000 7f311f839040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:01:47.784 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:47 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:47.580+0000 7f311f839040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:01:47.784 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:47 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:47.728+0000 7f311f839040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:01:48.077 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:48 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/492065061' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T06:01:48.078 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:47 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:47.904+0000 7f311f839040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:01:48.078 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:47 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:47.983+0000 7f311f839040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:01:48.334 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:48 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:48.173+0000 7f311f839040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:01:48.335 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:48 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:48.259+0000 7f311f839040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:01:48.608 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:48 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:48.333+0000 7f311f839040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:01:48.608 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:48 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:48.524+0000 7f311f839040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:01:48.827 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-19T06:01:48.828 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:01:48.828 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "fsid": "782a5144-764c-11ef-bceb-c7b262605968", 2024-09-19T06:01:48.828 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T06:01:48.828 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T06:01:48.828 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T06:01:48.828 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T06:01:48.828 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:01:48.828 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T06:01:48.828 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T06:01:48.829 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 0 2024-09-19T06:01:48.829 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:01:48.829 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T06:01:48.829 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T06:01:48.829 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:01:48.829 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-19T06:01:48.829 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T06:01:48.829 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:01:48.829 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T06:01:48.829 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T06:01:48.829 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:01:48.830 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T06:01:48.830 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:01:48.830 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T06:01:48.830 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T06:01:48.830 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T06:01:48.830 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T06:01:48.830 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T06:01:48.830 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T06:01:48.830 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:01:48.830 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T06:01:48.831 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T06:01:48.831 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T06:01:48.831 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T06:01:48.831 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T06:01:48.831 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T06:01:48.831 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T06:01:48.831 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T06:01:48.831 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T06:01:48.831 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:01:48.831 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T06:01:48.831 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:01:48.832 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T06:01:35:224503+0000", 2024-09-19T06:01:48.832 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T06:01:48.832 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T06:01:48.832 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:01:48.832 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T06:01:48.832 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T06:01:48.832 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T06:01:48.832 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T06:01:48.832 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T06:01:48.832 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T06:01:48.832 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T06:01:48.833 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:01:48.833 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:01:48.833 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:01:48.833 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T06:01:48.833 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:01:48.833 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T06:01:35.225312+0000", 2024-09-19T06:01:48.833 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:01:48.833 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:01:48.833 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T06:01:48.833 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:01:48.833 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.889+0000 7f0338e00640 1 Processor -- start 2024-09-19T06:01:48.833 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.889+0000 7f0338e00640 1 -- start start 2024-09-19T06:01:48.834 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.889+0000 7f0338e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0334107560 0x7f0334107960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:48.834 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.889+0000 7f0338e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0334107f30 con 0x7f0334107560 2024-09-19T06:01:48.834 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.889+0000 7f0333400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0334107560 0x7f0334107960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:48.834 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.889+0000 7f0333400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0334107560 0x7f0334107960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53566/0 (socket says 172.21.15.3:53566) 2024-09-19T06:01:48.834 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.889+0000 7f0333400640 1 -- 172.21.15.3:0/2139561388 learned_addr learned my addr 172.21.15.3:0/2139561388 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:01:48.834 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.890+0000 7f0333400640 1 -- 172.21.15.3:0/2139561388 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0334108710 con 0x7f0334107560 2024-09-19T06:01:48.834 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.891+0000 7f0333400640 1 --2- 172.21.15.3:0/2139561388 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0334107560 0x7f0334107960 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0324009820 tx=0x7f032402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8f26f796539348 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:48.834 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.891+0000 7f0332a00640 1 -- 172.21.15.3:0/2139561388 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0324037070 con 0x7f0334107560 2024-09-19T06:01:48.834 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.891+0000 7f0332a00640 1 -- 172.21.15.3:0/2139561388 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0324032900 con 0x7f0334107560 2024-09-19T06:01:48.834 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.891+0000 7f0332a00640 1 -- 172.21.15.3:0/2139561388 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0324030850 con 0x7f0334107560 2024-09-19T06:01:48.834 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.892+0000 7f0338e00640 1 -- 172.21.15.3:0/2139561388 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0334107560 msgr2=0x7f0334107960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:48.835 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.892+0000 7f0338e00640 1 --2- 172.21.15.3:0/2139561388 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0334107560 0x7f0334107960 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0324009820 tx=0x7f032402a270 comp rx=0 tx=0).stop 2024-09-19T06:01:48.835 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.892+0000 7f0338e00640 1 -- 172.21.15.3:0/2139561388 shutdown_connections 2024-09-19T06:01:48.835 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.892+0000 7f0338e00640 1 --2- 172.21.15.3:0/2139561388 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0334107560 0x7f0334107960 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:48.835 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.892+0000 7f0338e00640 1 -- 172.21.15.3:0/2139561388 >> 172.21.15.3:0/2139561388 conn(0x7f0334102cf0 msgr2=0x7f0334105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:48.835 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.892+0000 7f0338e00640 1 -- 172.21.15.3:0/2139561388 shutdown_connections 2024-09-19T06:01:48.835 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.892+0000 7f0338e00640 1 -- 172.21.15.3:0/2139561388 wait complete. 2024-09-19T06:01:48.835 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.893+0000 7f0338e00640 1 Processor -- start 2024-09-19T06:01:48.835 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.893+0000 7f0338e00640 1 -- start start 2024-09-19T06:01:48.835 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.893+0000 7f0338e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0334107560 0x7f033407db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:48.835 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.893+0000 7f0338e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f033410bac0 con 0x7f0334107560 2024-09-19T06:01:48.835 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.893+0000 7f0333400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0334107560 0x7f033407db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:48.836 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.893+0000 7f0333400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0334107560 0x7f033407db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53570/0 (socket says 172.21.15.3:53570) 2024-09-19T06:01:48.836 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.893+0000 7f0333400640 1 -- 172.21.15.3:0/492065061 learned_addr learned my addr 172.21.15.3:0/492065061 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:01:48.836 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.894+0000 7f0333400640 1 -- 172.21.15.3:0/492065061 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033407e0b0 con 0x7f0334107560 2024-09-19T06:01:48.836 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.894+0000 7f0333400640 1 --2- 172.21.15.3:0/492065061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0334107560 0x7f033407db70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f03240097f0 tx=0x7f0324030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:48.836 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.894+0000 7f0330c00640 1 -- 172.21.15.3:0/492065061 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0324037040 con 0x7f0334107560 2024-09-19T06:01:48.836 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.894+0000 7f0330c00640 1 -- 172.21.15.3:0/492065061 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0324040070 con 0x7f0334107560 2024-09-19T06:01:48.836 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.894+0000 7f0338e00640 1 -- 172.21.15.3:0/492065061 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f033407c2a0 con 0x7f0334107560 2024-09-19T06:01:48.836 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.894+0000 7f0330c00640 1 -- 172.21.15.3:0/492065061 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f032403a390 con 0x7f0334107560 2024-09-19T06:01:48.836 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.894+0000 7f0338e00640 1 -- 172.21.15.3:0/492065061 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f033407c780 con 0x7f0334107560 2024-09-19T06:01:48.836 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.895+0000 7f0330c00640 1 -- 172.21.15.3:0/492065061 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f032403a5e0 con 0x7f0334107560 2024-09-19T06:01:48.837 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.895+0000 7f0330c00640 1 -- 172.21.15.3:0/492065061 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0324045950 con 0x7f0334107560 2024-09-19T06:01:48.837 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.896+0000 7f0338e00640 1 -- 172.21.15.3:0/492065061 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f033410bc40 con 0x7f0334107560 2024-09-19T06:01:48.837 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.898+0000 7f0330c00640 1 -- 172.21.15.3:0/492065061 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0324045460 con 0x7f0334107560 2024-09-19T06:01:48.837 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.963+0000 7f0338e00640 1 -- 172.21.15.3:0/492065061 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f033407cac0 con 0x7f0334107560 2024-09-19T06:01:48.837 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.964+0000 7f0330c00640 1 -- 172.21.15.3:0/492065061 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f032403b430 con 0x7f0334107560 2024-09-19T06:01:48.837 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.965+0000 7f0338e00640 1 -- 172.21.15.3:0/492065061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0334107560 msgr2=0x7f033407db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:48.837 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.965+0000 7f0338e00640 1 --2- 172.21.15.3:0/492065061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0334107560 0x7f033407db70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f03240097f0 tx=0x7f0324030d80 comp rx=0 tx=0).stop 2024-09-19T06:01:48.837 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.965+0000 7f0338e00640 1 -- 172.21.15.3:0/492065061 shutdown_connections 2024-09-19T06:01:48.837 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.965+0000 7f0338e00640 1 --2- 172.21.15.3:0/492065061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0334107560 0x7f033407db70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:48.837 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.965+0000 7f0338e00640 1 -- 172.21.15.3:0/492065061 >> 172.21.15.3:0/492065061 conn(0x7f0334102cf0 msgr2=0x7f0334103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:48.838 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.965+0000 7f0338e00640 1 -- 172.21.15.3:0/492065061 shutdown_connections 2024-09-19T06:01:48.838 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:47.966+0000 7f0338e00640 1 -- 172.21.15.3:0/492065061 wait complete. 2024-09-19T06:01:48.838 INFO:teuthology.orchestra.run.smithi003.stdout:mgr not available, waiting (2/15)... 2024-09-19T06:01:48.881 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:48 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:48.606+0000 7f311f839040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:01:48.881 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:48 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:48.699+0000 7f311f839040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:01:48.881 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:48 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:48.801+0000 7f311f839040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:01:48.881 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:48 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:48.878+0000 7f311f839040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:01:49.334 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:48 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:48.951+0000 7f311f839040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:01:50.335 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:49 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:49.909+0000 7f311f839040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:01:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:49 smithi003 ceph-mon[30893]: Activating manager daemon x 2024-09-19T06:01:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:49 smithi003 ceph-mon[30893]: mgrmap e2: x(active, starting, since 0.00398077s) 2024-09-19T06:01:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:49 smithi003 ceph-mon[30893]: from='mgr.14100 172.21.15.3:0/156416041' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:01:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:49 smithi003 ceph-mon[30893]: from='mgr.14100 172.21.15.3:0/156416041' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:01:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:49 smithi003 ceph-mon[30893]: from='mgr.14100 172.21.15.3:0/156416041' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:01:50.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:49 smithi003 ceph-mon[30893]: from='mgr.14100 172.21.15.3:0/156416041' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:01:50.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:49 smithi003 ceph-mon[30893]: from='mgr.14100 172.21.15.3:0/156416041' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:01:50.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:49 smithi003 ceph-mon[30893]: Manager daemon x is now available 2024-09-19T06:01:50.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:49 smithi003 ceph-mon[30893]: from='mgr.14100 172.21.15.3:0/156416041' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:01:50.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:49 smithi003 ceph-mon[30893]: from='mgr.14100 172.21.15.3:0/156416041' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:01:50.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:49 smithi003 ceph-mon[30893]: from='mgr.14100 172.21.15.3:0/156416041' entity='mgr.x' 2024-09-19T06:01:50.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:49 smithi003 ceph-mon[30893]: from='mgr.14100 172.21.15.3:0/156416041' entity='mgr.x' 2024-09-19T06:01:50.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:49 smithi003 ceph-mon[30893]: from='mgr.14100 172.21.15.3:0/156416041' entity='mgr.x' 2024-09-19T06:01:52.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:51 smithi003 ceph-mon[30893]: mgrmap e3: x(active, since 1.00899s) 2024-09-19T06:01:52.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:51 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1323861583' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T06:01:52.353 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-19T06:01:52.353 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:01:52.353 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "fsid": "782a5144-764c-11ef-bceb-c7b262605968", 2024-09-19T06:01:52.353 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T06:01:52.353 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T06:01:52.353 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T06:01:52.353 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T06:01:52.353 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:01:52.354 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T06:01:52.354 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T06:01:52.354 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 0 2024-09-19T06:01:52.354 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:01:52.354 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T06:01:52.354 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T06:01:52.354 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:01:52.354 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-19T06:01:52.354 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T06:01:52.354 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:01:52.354 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T06:01:52.354 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T06:01:52.355 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:01:52.355 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T06:01:52.355 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:01:52.355 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T06:01:52.355 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T06:01:52.355 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T06:01:52.363 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T06:01:52.363 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T06:01:52.363 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T06:01:52.363 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:01:52.363 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T06:01:52.363 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T06:01:52.363 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T06:01:52.363 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T06:01:52.363 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T06:01:52.364 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T06:01:52.364 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T06:01:52.364 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T06:01:52.364 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T06:01:52.364 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:01:52.364 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T06:01:52.364 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:01:52.364 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T06:01:35:224503+0000", 2024-09-19T06:01:52.364 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T06:01:52.364 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T06:01:52.364 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:01:52.364 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T06:01:52.365 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T06:01:52.365 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T06:01:52.365 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T06:01:52.365 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T06:01:52.365 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T06:01:52.365 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T06:01:52.365 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:01:52.365 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:01:52.365 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:01:52.365 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T06:01:52.365 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:01:52.365 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T06:01:35.225312+0000", 2024-09-19T06:01:52.365 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:01:52.365 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:01:52.366 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T06:01:52.366 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:01:52.366 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.343+0000 7f1ce7200640 1 Processor -- start 2024-09-19T06:01:52.366 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.343+0000 7f1ce7200640 1 -- start start 2024-09-19T06:01:52.366 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.344+0000 7f1ce7200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ce007de30 0x7f1ce007c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:52.366 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.344+0000 7f1ce7200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce007c820 con 0x7f1ce007de30 2024-09-19T06:01:52.366 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.344+0000 7f1cdfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ce007de30 0x7f1ce007c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:52.366 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.344+0000 7f1cdfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ce007de30 0x7f1ce007c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53622/0 (socket says 172.21.15.3:53622) 2024-09-19T06:01:52.366 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.344+0000 7f1cdfe00640 1 -- 172.21.15.3:0/137407545 learned_addr learned my addr 172.21.15.3:0/137407545 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:01:52.366 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.344+0000 7f1cdfe00640 1 -- 172.21.15.3:0/137407545 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce007c9a0 con 0x7f1ce007de30 2024-09-19T06:01:52.366 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.345+0000 7f1cdfe00640 1 --2- 172.21.15.3:0/137407545 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ce007de30 0x7f1ce007c2e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009820 tx=0x7f1cd002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98821c02a9f409d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:52.366 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.346+0000 7f1cdf400640 1 -- 172.21.15.3:0/137407545 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd0037070 con 0x7f1ce007de30 2024-09-19T06:01:52.366 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.346+0000 7f1cdf400640 1 -- 172.21.15.3:0/137407545 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1cd0032900 con 0x7f1ce007de30 2024-09-19T06:01:52.367 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.346+0000 7f1cdf400640 1 -- 172.21.15.3:0/137407545 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd0030850 con 0x7f1ce007de30 2024-09-19T06:01:52.367 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.346+0000 7f1ce7200640 1 -- 172.21.15.3:0/137407545 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ce007de30 msgr2=0x7f1ce007c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:52.367 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.346+0000 7f1ce7200640 1 --2- 172.21.15.3:0/137407545 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ce007de30 0x7f1ce007c2e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009820 tx=0x7f1cd002a270 comp rx=0 tx=0).stop 2024-09-19T06:01:52.367 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.346+0000 7f1ce7200640 1 -- 172.21.15.3:0/137407545 shutdown_connections 2024-09-19T06:01:52.367 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.346+0000 7f1ce7200640 1 --2- 172.21.15.3:0/137407545 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ce007de30 0x7f1ce007c2e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:52.367 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.346+0000 7f1ce7200640 1 -- 172.21.15.3:0/137407545 >> 172.21.15.3:0/137407545 conn(0x7f1ce0102ef0 msgr2=0x7f1ce0105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:52.367 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.346+0000 7f1ce7200640 1 -- 172.21.15.3:0/137407545 shutdown_connections 2024-09-19T06:01:52.367 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.346+0000 7f1ce7200640 1 -- 172.21.15.3:0/137407545 wait complete. 2024-09-19T06:01:52.367 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.347+0000 7f1ce7200640 1 Processor -- start 2024-09-19T06:01:52.367 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.347+0000 7f1ce7200640 1 -- start start 2024-09-19T06:01:52.367 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.348+0000 7f1ce7200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ce007de30 0x7f1ce019d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:52.367 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.348+0000 7f1ce7200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce010dd70 con 0x7f1ce007de30 2024-09-19T06:01:52.367 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.348+0000 7f1cdfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ce007de30 0x7f1ce019d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:52.368 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.348+0000 7f1cdfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ce007de30 0x7f1ce019d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53638/0 (socket says 172.21.15.3:53638) 2024-09-19T06:01:52.368 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.348+0000 7f1cdfe00640 1 -- 172.21.15.3:0/1323861583 learned_addr learned my addr 172.21.15.3:0/1323861583 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:01:52.368 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.348+0000 7f1cdfe00640 1 -- 172.21.15.3:0/1323861583 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce019dea0 con 0x7f1ce007de30 2024-09-19T06:01:52.368 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.349+0000 7f1cdfe00640 1 --2- 172.21.15.3:0/1323861583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ce007de30 0x7f1ce019d960 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0031000 tx=0x7f1cd00326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:52.368 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.349+0000 7f1cdd600640 1 -- 172.21.15.3:0/1323861583 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd0042070 con 0x7f1ce007de30 2024-09-19T06:01:52.368 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.349+0000 7f1cdd600640 1 -- 172.21.15.3:0/1323861583 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1cd0032be0 con 0x7f1ce007de30 2024-09-19T06:01:52.368 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.349+0000 7f1cdd600640 1 -- 172.21.15.3:0/1323861583 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd0037040 con 0x7f1ce007de30 2024-09-19T06:01:52.368 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.349+0000 7f1ce7200640 1 -- 172.21.15.3:0/1323861583 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce019e130 con 0x7f1ce007de30 2024-09-19T06:01:52.368 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.349+0000 7f1ce7200640 1 -- 172.21.15.3:0/1323861583 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce01a0e20 con 0x7f1ce007de30 2024-09-19T06:01:52.368 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.350+0000 7f1cdd600640 1 -- 172.21.15.3:0/1323861583 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7f1cd0045070 con 0x7f1ce007de30 2024-09-19T06:01:52.368 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.350+0000 7f1ce7200640 1 -- 172.21.15.3:0/1323861583 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce007c360 con 0x7f1ce007de30 2024-09-19T06:01:52.368 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.351+0000 7f1cdd600640 1 --2- 172.21.15.3:0/1323861583 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f1cc4039050 0x7f1cc403b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:52.368 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.351+0000 7f1cdd600640 1 -- 172.21.15.3:0/1323861583 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1cd006c020 con 0x7f1ce007de30 2024-09-19T06:01:52.369 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.351+0000 7f1cd7e00640 1 --2- 172.21.15.3:0/1323861583 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f1cc4039050 0x7f1cc403b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:52.369 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.352+0000 7f1cd7e00640 1 --2- 172.21.15.3:0/1323861583 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f1cc4039050 0x7f1cc403b510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1cc80098c0 tx=0x7f1cc8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:52.369 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.357+0000 7f1cdd600640 1 -- 172.21.15.3:0/1323861583 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1cd0032d90 con 0x7f1ce007de30 2024-09-19T06:01:52.369 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.609+0000 7f1ce7200640 1 -- 172.21.15.3:0/1323861583 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f1ce01a13f0 con 0x7f1ce007de30 2024-09-19T06:01:52.369 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.610+0000 7f1cdd600640 1 -- 172.21.15.3:0/1323861583 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f1cd003d950 con 0x7f1ce007de30 2024-09-19T06:01:52.369 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.612+0000 7f1ce7200640 1 -- 172.21.15.3:0/1323861583 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f1cc4039050 msgr2=0x7f1cc403b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:52.369 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.612+0000 7f1ce7200640 1 --2- 172.21.15.3:0/1323861583 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f1cc4039050 0x7f1cc403b510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1cc80098c0 tx=0x7f1cc8006db0 comp rx=0 tx=0).stop 2024-09-19T06:01:52.369 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.612+0000 7f1ce7200640 1 -- 172.21.15.3:0/1323861583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ce007de30 msgr2=0x7f1ce019d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:52.369 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.612+0000 7f1ce7200640 1 --2- 172.21.15.3:0/1323861583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ce007de30 0x7f1ce019d960 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0031000 tx=0x7f1cd00326e0 comp rx=0 tx=0).stop 2024-09-19T06:01:52.369 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.612+0000 7f1ce7200640 1 -- 172.21.15.3:0/1323861583 shutdown_connections 2024-09-19T06:01:52.369 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.612+0000 7f1ce7200640 1 --2- 172.21.15.3:0/1323861583 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f1cc4039050 0x7f1cc403b510 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:52.369 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.612+0000 7f1ce7200640 1 --2- 172.21.15.3:0/1323861583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ce007de30 0x7f1ce019d960 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:52.369 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.612+0000 7f1ce7200640 1 -- 172.21.15.3:0/1323861583 >> 172.21.15.3:0/1323861583 conn(0x7f1ce0102ef0 msgr2=0x7f1ce0103a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:52.369 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.612+0000 7f1ce7200640 1 -- 172.21.15.3:0/1323861583 shutdown_connections 2024-09-19T06:01:52.370 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:51.612+0000 7f1ce7200640 1 -- 172.21.15.3:0/1323861583 wait complete. 2024-09-19T06:01:52.370 INFO:teuthology.orchestra.run.smithi003.stdout:mgr is available 2024-09-19T06:01:53.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:52 smithi003 ceph-mon[30893]: mgrmap e4: x(active, since 2s) 2024-09-19T06:01:53.738 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-19T06:01:53.738 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T06:01:53.738 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout fsid = 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:01:53.738 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.3:3300,v1:172.21.15.3:6789] 2024-09-19T06:01:53.738 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T06:01:53.738 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T06:01:53.739 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T06:01:53.739 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T06:01:53.739 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-19T06:01:53.739 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T06:01:53.739 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T06:01:53.739 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-19T06:01:53.739 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T06:01:53.739 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T06:01:53.739 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T06:01:53.739 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T06:01:53.739 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T06:01:53.739 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T06:01:53.739 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.852+0000 7f9762800640 1 Processor -- start 2024-09-19T06:01:53.739 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.852+0000 7f9762800640 1 -- start start 2024-09-19T06:01:53.740 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.852+0000 7f9762800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f975c109960 0x7f975c109d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:53.740 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.852+0000 7f9762800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f975c10a330 con 0x7f975c109960 2024-09-19T06:01:53.740 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.853+0000 7f975b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f975c109960 0x7f975c109d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:53.740 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.853+0000 7f975b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f975c109960 0x7f975c109d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53644/0 (socket says 172.21.15.3:53644) 2024-09-19T06:01:53.740 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.853+0000 7f975b400640 1 -- 172.21.15.3:0/3342580168 learned_addr learned my addr 172.21.15.3:0/3342580168 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:01:53.740 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.853+0000 7f975b400640 1 -- 172.21.15.3:0/3342580168 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975c10aad0 con 0x7f975c109960 2024-09-19T06:01:53.740 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.854+0000 7f975b400640 1 --2- 172.21.15.3:0/3342580168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f975c109960 0x7f975c109d60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f974c009820 tx=0x7f974c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57360447da0af35 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:53.740 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.854+0000 7f975a000640 1 -- 172.21.15.3:0/3342580168 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f974c037070 con 0x7f975c109960 2024-09-19T06:01:53.740 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.854+0000 7f975a000640 1 -- 172.21.15.3:0/3342580168 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f974c032900 con 0x7f975c109960 2024-09-19T06:01:53.740 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.854+0000 7f975a000640 1 -- 172.21.15.3:0/3342580168 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f974c030850 con 0x7f975c109960 2024-09-19T06:01:53.740 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.855+0000 7f9762800640 1 -- 172.21.15.3:0/3342580168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f975c109960 msgr2=0x7f975c109d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:53.740 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.855+0000 7f9762800640 1 --2- 172.21.15.3:0/3342580168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f975c109960 0x7f975c109d60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f974c009820 tx=0x7f974c02a270 comp rx=0 tx=0).stop 2024-09-19T06:01:53.740 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.855+0000 7f9762800640 1 -- 172.21.15.3:0/3342580168 shutdown_connections 2024-09-19T06:01:53.741 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.855+0000 7f9762800640 1 --2- 172.21.15.3:0/3342580168 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f975c109960 0x7f975c109d60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:53.741 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.855+0000 7f9762800640 1 -- 172.21.15.3:0/3342580168 >> 172.21.15.3:0/3342580168 conn(0x7f975c07cf30 msgr2=0x7f975c07d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:53.741 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.855+0000 7f9762800640 1 -- 172.21.15.3:0/3342580168 shutdown_connections 2024-09-19T06:01:53.741 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.855+0000 7f9762800640 1 -- 172.21.15.3:0/3342580168 wait complete. 2024-09-19T06:01:53.741 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.856+0000 7f9762800640 1 Processor -- start 2024-09-19T06:01:53.741 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.856+0000 7f9762800640 1 -- start start 2024-09-19T06:01:53.741 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.856+0000 7f9762800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f975c109960 0x7f975c19d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:53.741 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.856+0000 7f9762800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f975c10de80 con 0x7f975c109960 2024-09-19T06:01:53.742 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.857+0000 7f975b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f975c109960 0x7f975c19d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:53.742 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.857+0000 7f975b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f975c109960 0x7f975c19d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53656/0 (socket says 172.21.15.3:53656) 2024-09-19T06:01:53.742 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.857+0000 7f975b400640 1 -- 172.21.15.3:0/1106235486 learned_addr learned my addr 172.21.15.3:0/1106235486 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:01:53.742 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.857+0000 7f975b400640 1 -- 172.21.15.3:0/1106235486 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975c19de40 con 0x7f975c109960 2024-09-19T06:01:53.742 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.857+0000 7f975b400640 1 --2- 172.21.15.3:0/1106235486 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f975c109960 0x7f975c19d900 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f974c0097f0 tx=0x7f974c030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:53.742 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.858+0000 7f9753e00640 1 -- 172.21.15.3:0/1106235486 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f974c042070 con 0x7f975c109960 2024-09-19T06:01:53.742 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.858+0000 7f9753e00640 1 -- 172.21.15.3:0/1106235486 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f974c032ca0 con 0x7f975c109960 2024-09-19T06:01:53.742 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.858+0000 7f9753e00640 1 -- 172.21.15.3:0/1106235486 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f974c037040 con 0x7f975c109960 2024-09-19T06:01:53.742 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.858+0000 7f9762800640 1 -- 172.21.15.3:0/1106235486 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f975c19e0d0 con 0x7f975c109960 2024-09-19T06:01:53.743 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.858+0000 7f9762800640 1 -- 172.21.15.3:0/1106235486 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f975c1a0dc0 con 0x7f975c109960 2024-09-19T06:01:53.743 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.859+0000 7f9753e00640 1 -- 172.21.15.3:0/1106235486 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f974c045070 con 0x7f975c109960 2024-09-19T06:01:53.743 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.859+0000 7f9762800640 1 -- 172.21.15.3:0/1106235486 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f975c10e000 con 0x7f975c109960 2024-09-19T06:01:53.743 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.860+0000 7f9753e00640 1 --2- 172.21.15.3:0/1106235486 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f97400391b0 0x7f974003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:53.743 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.860+0000 7f9753e00640 1 -- 172.21.15.3:0/1106235486 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f974c06c140 con 0x7f975c109960 2024-09-19T06:01:53.743 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.860+0000 7f975aa00640 1 --2- 172.21.15.3:0/1106235486 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f97400391b0 0x7f974003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:53.743 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.861+0000 7f975aa00640 1 --2- 172.21.15.3:0/1106235486 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f97400391b0 0x7f974003b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f97480098c0 tx=0x7f9748006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:53.743 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:52.865+0000 7f9753e00640 1 -- 172.21.15.3:0/1106235486 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f974c04b170 con 0x7f975c109960 2024-09-19T06:01:53.743 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:53.050+0000 7f9762800640 1 -- 172.21.15.3:0/1106235486 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f975c109de0 con 0x7f975c109960 2024-09-19T06:01:53.743 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:53.051+0000 7f9753e00640 1 -- 172.21.15.3:0/1106235486 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+427 (secure 0 0 0) 0x7f974c06bb60 con 0x7f975c109960 2024-09-19T06:01:53.743 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:53.053+0000 7f9762800640 1 -- 172.21.15.3:0/1106235486 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f97400391b0 msgr2=0x7f974003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:53.743 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:53.053+0000 7f9762800640 1 --2- 172.21.15.3:0/1106235486 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f97400391b0 0x7f974003b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f97480098c0 tx=0x7f9748006db0 comp rx=0 tx=0).stop 2024-09-19T06:01:53.744 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:53.053+0000 7f9762800640 1 -- 172.21.15.3:0/1106235486 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f975c109960 msgr2=0x7f975c19d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:53.744 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:53.053+0000 7f9762800640 1 --2- 172.21.15.3:0/1106235486 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f975c109960 0x7f975c19d900 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f974c0097f0 tx=0x7f974c030ec0 comp rx=0 tx=0).stop 2024-09-19T06:01:53.744 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:53.053+0000 7f9762800640 1 -- 172.21.15.3:0/1106235486 shutdown_connections 2024-09-19T06:01:53.744 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:53.053+0000 7f9762800640 1 --2- 172.21.15.3:0/1106235486 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f97400391b0 0x7f974003b670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:53.744 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:53.053+0000 7f9762800640 1 --2- 172.21.15.3:0/1106235486 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f975c109960 0x7f975c19d900 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:53.744 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:53.053+0000 7f9762800640 1 -- 172.21.15.3:0/1106235486 >> 172.21.15.3:0/1106235486 conn(0x7f975c07cf30 msgr2=0x7f975c107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:53.744 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:53.053+0000 7f9762800640 1 -- 172.21.15.3:0/1106235486 shutdown_connections 2024-09-19T06:01:53.744 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:53.053+0000 7f9762800640 1 -- 172.21.15.3:0/1106235486 wait complete. 2024-09-19T06:01:53.744 INFO:teuthology.orchestra.run.smithi003.stdout:Enabling cephadm module... 2024-09-19T06:01:53.978 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:53 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1106235486' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T06:01:55.210 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:54 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1543716616' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T06:01:55.210 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:55 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: ignoring --setuser ceph since I am not root 2024-09-19T06:01:55.210 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:55 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: ignoring --setgroup ceph since I am not root 2024-09-19T06:01:55.210 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:55 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:55.207+0000 7fed13dd3040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:01:55.496 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:55 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:55.300+0000 7fed13dd3040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:01:55.496 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:55 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:55.493+0000 7fed13dd3040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:01:55.704 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.178+0000 7f0adfa00640 1 Processor -- start 2024-09-19T06:01:55.704 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.178+0000 7f0adfa00640 1 -- start start 2024-09-19T06:01:55.704 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.178+0000 7f0adfa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ad8109960 0x7f0ad8109d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:55.704 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.178+0000 7f0adfa00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad810a330 con 0x7f0ad8109960 2024-09-19T06:01:55.704 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.178+0000 7f0add000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ad8109960 0x7f0ad8109d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:55.704 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.178+0000 7f0add000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ad8109960 0x7f0ad8109d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43578/0 (socket says 172.21.15.3:43578) 2024-09-19T06:01:55.704 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.178+0000 7f0add000640 1 -- 172.21.15.3:0/30394019 learned_addr learned my addr 172.21.15.3:0/30394019 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:01:55.704 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.179+0000 7f0add000640 1 -- 172.21.15.3:0/30394019 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad810aad0 con 0x7f0ad8109960 2024-09-19T06:01:55.704 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.180+0000 7f0add000640 1 --2- 172.21.15.3:0/30394019 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ad8109960 0x7f0ad8109d60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0acc009820 tx=0x7f0acc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bad5f8117fdf283 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:55.704 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.180+0000 7f0ad7400640 1 -- 172.21.15.3:0/30394019 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0acc037070 con 0x7f0ad8109960 2024-09-19T06:01:55.704 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.180+0000 7f0ad7400640 1 -- 172.21.15.3:0/30394019 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0acc032900 con 0x7f0ad8109960 2024-09-19T06:01:55.705 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.180+0000 7f0ad7400640 1 -- 172.21.15.3:0/30394019 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0acc030850 con 0x7f0ad8109960 2024-09-19T06:01:55.705 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.181+0000 7f0adfa00640 1 -- 172.21.15.3:0/30394019 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ad8109960 msgr2=0x7f0ad8109d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:55.705 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.181+0000 7f0adfa00640 1 --2- 172.21.15.3:0/30394019 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ad8109960 0x7f0ad8109d60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0acc009820 tx=0x7f0acc02a270 comp rx=0 tx=0).stop 2024-09-19T06:01:55.705 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.181+0000 7f0adfa00640 1 -- 172.21.15.3:0/30394019 shutdown_connections 2024-09-19T06:01:55.705 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.181+0000 7f0adfa00640 1 --2- 172.21.15.3:0/30394019 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ad8109960 0x7f0ad8109d60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:55.705 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.181+0000 7f0adfa00640 1 -- 172.21.15.3:0/30394019 >> 172.21.15.3:0/30394019 conn(0x7f0ad807cf30 msgr2=0x7f0ad807d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:55.705 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.181+0000 7f0adfa00640 1 -- 172.21.15.3:0/30394019 shutdown_connections 2024-09-19T06:01:55.705 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.181+0000 7f0adfa00640 1 -- 172.21.15.3:0/30394019 wait complete. 2024-09-19T06:01:55.705 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.182+0000 7f0adfa00640 1 Processor -- start 2024-09-19T06:01:55.705 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.182+0000 7f0adfa00640 1 -- start start 2024-09-19T06:01:55.705 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.182+0000 7f0adfa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ad8109960 0x7f0ad819d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:55.705 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.182+0000 7f0adfa00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad810de80 con 0x7f0ad8109960 2024-09-19T06:01:55.705 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.183+0000 7f0add000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ad8109960 0x7f0ad819d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:55.706 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.183+0000 7f0add000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ad8109960 0x7f0ad819d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43588/0 (socket says 172.21.15.3:43588) 2024-09-19T06:01:55.706 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.183+0000 7f0add000640 1 -- 172.21.15.3:0/1543716616 learned_addr learned my addr 172.21.15.3:0/1543716616 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:01:55.706 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.183+0000 7f0add000640 1 -- 172.21.15.3:0/1543716616 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad819de40 con 0x7f0ad8109960 2024-09-19T06:01:55.706 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.183+0000 7f0add000640 1 --2- 172.21.15.3:0/1543716616 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ad8109960 0x7f0ad819d900 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0097f0 tx=0x7f0acc030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:55.706 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.184+0000 7f0ad5600640 1 -- 172.21.15.3:0/1543716616 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0acc042070 con 0x7f0ad8109960 2024-09-19T06:01:55.706 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.184+0000 7f0ad5600640 1 -- 172.21.15.3:0/1543716616 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0acc032ca0 con 0x7f0ad8109960 2024-09-19T06:01:55.706 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.184+0000 7f0ad5600640 1 -- 172.21.15.3:0/1543716616 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0acc037040 con 0x7f0ad8109960 2024-09-19T06:01:55.706 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.184+0000 7f0adfa00640 1 -- 172.21.15.3:0/1543716616 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad819e0d0 con 0x7f0ad8109960 2024-09-19T06:01:55.706 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.184+0000 7f0adfa00640 1 -- 172.21.15.3:0/1543716616 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad81a0dc0 con 0x7f0ad8109960 2024-09-19T06:01:55.706 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.185+0000 7f0ad5600640 1 -- 172.21.15.3:0/1543716616 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f0acc045070 con 0x7f0ad8109960 2024-09-19T06:01:55.706 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.185+0000 7f0adfa00640 1 -- 172.21.15.3:0/1543716616 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ad810e000 con 0x7f0ad8109960 2024-09-19T06:01:55.706 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.185+0000 7f0ad5600640 1 --2- 172.21.15.3:0/1543716616 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f0ac00391b0 0x7f0ac003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:55.706 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.185+0000 7f0ad5600640 1 -- 172.21.15.3:0/1543716616 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0acc06c140 con 0x7f0ad8109960 2024-09-19T06:01:55.707 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.186+0000 7f0ad7e00640 1 --2- 172.21.15.3:0/1543716616 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f0ac00391b0 0x7f0ac003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:55.707 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.186+0000 7f0ad7e00640 1 --2- 172.21.15.3:0/1543716616 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f0ac00391b0 0x7f0ac003b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0ac40098c0 tx=0x7f0ac4006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:55.707 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.190+0000 7f0ad5600640 1 -- 172.21.15.3:0/1543716616 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0acc04b170 con 0x7f0ad8109960 2024-09-19T06:01:55.707 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.422+0000 7f0adfa00640 1 -- 172.21.15.3:0/1543716616 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f0ad81a1430 con 0x7f0ad8109960 2024-09-19T06:01:55.707 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.926+0000 7f0ad5600640 1 -- 172.21.15.3:0/1543716616 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f0acc06bb60 con 0x7f0ad8109960 2024-09-19T06:01:55.707 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.928+0000 7f0ad5600640 1 -- 172.21.15.3:0/1543716616 <== mon.0 v2:172.21.15.3:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f0acc03d430 con 0x7f0ad8109960 2024-09-19T06:01:55.707 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.930+0000 7f0adfa00640 1 -- 172.21.15.3:0/1543716616 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f0ac00391b0 msgr2=0x7f0ac003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:55.707 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.930+0000 7f0adfa00640 1 --2- 172.21.15.3:0/1543716616 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f0ac00391b0 0x7f0ac003b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0ac40098c0 tx=0x7f0ac4006db0 comp rx=0 tx=0).stop 2024-09-19T06:01:55.707 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.930+0000 7f0adfa00640 1 -- 172.21.15.3:0/1543716616 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ad8109960 msgr2=0x7f0ad819d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:55.707 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.930+0000 7f0adfa00640 1 --2- 172.21.15.3:0/1543716616 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ad8109960 0x7f0ad819d900 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0097f0 tx=0x7f0acc030ec0 comp rx=0 tx=0).stop 2024-09-19T06:01:55.707 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.931+0000 7f0adfa00640 1 -- 172.21.15.3:0/1543716616 shutdown_connections 2024-09-19T06:01:55.707 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.931+0000 7f0adfa00640 1 --2- 172.21.15.3:0/1543716616 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f0ac00391b0 0x7f0ac003b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:55.707 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.931+0000 7f0adfa00640 1 --2- 172.21.15.3:0/1543716616 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ad8109960 0x7f0ad819d900 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:55.708 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.931+0000 7f0adfa00640 1 -- 172.21.15.3:0/1543716616 >> 172.21.15.3:0/1543716616 conn(0x7f0ad807cf30 msgr2=0x7f0ad8107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:55.708 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.931+0000 7f0adfa00640 1 -- 172.21.15.3:0/1543716616 shutdown_connections 2024-09-19T06:01:55.708 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:54.931+0000 7f0adfa00640 1 -- 172.21.15.3:0/1543716616 wait complete. 2024-09-19T06:01:55.762 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:55 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:55.576+0000 7fed13dd3040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:01:55.762 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:55 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:55.759+0000 7fed13dd3040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:01:56.019 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:55 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1543716616' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T06:01:56.019 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:55 smithi003 ceph-mon[30893]: mgrmap e5: x(active, since 5s) 2024-09-19T06:01:56.019 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:55 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:55.933+0000 7fed13dd3040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:01:56.585 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:56 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:56.329+0000 7fed13dd3040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:01:56.585 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:56 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:56.405+0000 7fed13dd3040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:01:56.893 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:56 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:56.633+0000 7fed13dd3040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:01:57.307 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:01:56 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/716743979' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T06:01:57.313 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:01:57.319 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T06:01:57.319 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T06:01:57.319 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T06:01:57.319 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T06:01:57.319 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:01:57.320 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.226+0000 7fe5a6200640 1 Processor -- start 2024-09-19T06:01:57.320 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.226+0000 7fe5a6200640 1 -- start start 2024-09-19T06:01:57.320 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.226+0000 7fe5a6200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5a007de40 0x7fe5a007c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:57.320 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.226+0000 7fe5a6200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a007c880 con 0x7fe5a007de40 2024-09-19T06:01:57.320 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.227+0000 7fe5a4e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5a007de40 0x7fe5a007c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:57.320 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.227+0000 7fe5a4e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5a007de40 0x7fe5a007c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43626/0 (socket says 172.21.15.3:43626) 2024-09-19T06:01:57.320 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.227+0000 7fe5a4e00640 1 -- 172.21.15.3:0/375428225 learned_addr learned my addr 172.21.15.3:0/375428225 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:01:57.320 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.227+0000 7fe5a4e00640 1 -- 172.21.15.3:0/375428225 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a007ca00 con 0x7fe5a007de40 2024-09-19T06:01:57.320 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.228+0000 7fe5a4e00640 1 --2- 172.21.15.3:0/375428225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5a007de40 0x7fe5a007c340 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe594009820 tx=0x7fe59402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9728e845a0b097f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:57.320 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.229+0000 7fe59f400640 1 -- 172.21.15.3:0/375428225 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe594037070 con 0x7fe5a007de40 2024-09-19T06:01:57.320 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.229+0000 7fe59f400640 1 -- 172.21.15.3:0/375428225 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe594032900 con 0x7fe5a007de40 2024-09-19T06:01:57.320 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.229+0000 7fe59f400640 1 -- 172.21.15.3:0/375428225 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe594030850 con 0x7fe5a007de40 2024-09-19T06:01:57.321 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.229+0000 7fe5a6200640 1 -- 172.21.15.3:0/375428225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5a007de40 msgr2=0x7fe5a007c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:57.321 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.229+0000 7fe5a6200640 1 --2- 172.21.15.3:0/375428225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5a007de40 0x7fe5a007c340 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe594009820 tx=0x7fe59402a270 comp rx=0 tx=0).stop 2024-09-19T06:01:57.321 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.229+0000 7fe5a6200640 1 -- 172.21.15.3:0/375428225 shutdown_connections 2024-09-19T06:01:57.321 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.229+0000 7fe5a6200640 1 --2- 172.21.15.3:0/375428225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5a007de40 0x7fe5a007c340 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:57.321 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.229+0000 7fe5a6200640 1 -- 172.21.15.3:0/375428225 >> 172.21.15.3:0/375428225 conn(0x7fe5a0102d90 msgr2=0x7fe5a01051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:57.321 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.230+0000 7fe5a6200640 1 -- 172.21.15.3:0/375428225 shutdown_connections 2024-09-19T06:01:57.321 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.230+0000 7fe5a6200640 1 -- 172.21.15.3:0/375428225 wait complete. 2024-09-19T06:01:57.321 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.231+0000 7fe5a6200640 1 Processor -- start 2024-09-19T06:01:57.321 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.231+0000 7fe5a6200640 1 -- start start 2024-09-19T06:01:57.321 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.232+0000 7fe5a6200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5a007de40 0x7fe5a01a1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:57.321 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.232+0000 7fe5a6200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a0109780 con 0x7fe5a007de40 2024-09-19T06:01:57.321 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.232+0000 7fe5a4e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5a007de40 0x7fe5a01a1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:01:57.321 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.232+0000 7fe5a4e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5a007de40 0x7fe5a01a1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43634/0 (socket says 172.21.15.3:43634) 2024-09-19T06:01:57.322 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.232+0000 7fe5a4e00640 1 -- 172.21.15.3:0/716743979 learned_addr learned my addr 172.21.15.3:0/716743979 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:01:57.322 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.232+0000 7fe5a4e00640 1 -- 172.21.15.3:0/716743979 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a01a2050 con 0x7fe5a007de40 2024-09-19T06:01:57.322 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.233+0000 7fe5a4e00640 1 --2- 172.21.15.3:0/716743979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5a007de40 0x7fe5a01a1b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe5940097f0 tx=0x7fe594030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:01:57.322 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.233+0000 7fe59d600640 1 -- 172.21.15.3:0/716743979 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe594037040 con 0x7fe5a007de40 2024-09-19T06:01:57.322 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.233+0000 7fe59d600640 1 -- 172.21.15.3:0/716743979 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe594040070 con 0x7fe5a007de40 2024-09-19T06:01:57.322 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.233+0000 7fe59d600640 1 -- 172.21.15.3:0/716743979 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe59403a390 con 0x7fe5a007de40 2024-09-19T06:01:57.322 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.234+0000 7fe5a6200640 1 -- 172.21.15.3:0/716743979 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5a01a22e0 con 0x7fe5a007de40 2024-09-19T06:01:57.322 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.234+0000 7fe5a6200640 1 -- 172.21.15.3:0/716743979 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5a01a4fd0 con 0x7fe5a007de40 2024-09-19T06:01:57.322 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.235+0000 7fe5a6200640 1 -- 172.21.15.3:0/716743979 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5a007c3c0 con 0x7fe5a007de40 2024-09-19T06:01:57.322 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.235+0000 7fe59d600640 1 -- 172.21.15.3:0/716743979 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fe59403b430 con 0x7fe5a007de40 2024-09-19T06:01:57.322 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.236+0000 7fe59d600640 1 --2- 172.21.15.3:0/716743979 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7fe5880391b0 0x7fe58803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:01:57.322 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.236+0000 7fe59d600640 1 -- 172.21.15.3:0/716743979 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe59406ba30 con 0x7fe5a007de40 2024-09-19T06:01:57.322 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.236+0000 7fe59fe00640 1 -- 172.21.15.3:0/716743979 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7fe5880391b0 msgr2=0x7fe58803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.3:6800/2386230415 2024-09-19T06:01:57.323 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.236+0000 7fe59fe00640 1 --2- 172.21.15.3:0/716743979 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7fe5880391b0 0x7fe58803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:01:57.323 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.245+0000 7fe59d600640 1 -- 172.21.15.3:0/716743979 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe5940313a0 con 0x7fe5a007de40 2024-09-19T06:01:57.323 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.437+0000 7fe59fe00640 1 -- 172.21.15.3:0/716743979 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7fe5880391b0 msgr2=0x7fe58803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.3:6800/2386230415 2024-09-19T06:01:57.323 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.437+0000 7fe59fe00640 1 --2- 172.21.15.3:0/716743979 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7fe5880391b0 0x7fe58803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:01:57.323 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.483+0000 7fe5a6200640 1 -- 172.21.15.3:0/716743979 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fe5a002d9d0 con 0x7fe5a007de40 2024-09-19T06:01:57.323 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.483+0000 7fe59d600640 1 -- 172.21.15.3:0/716743979 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fe594038250 con 0x7fe5a007de40 2024-09-19T06:01:57.323 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.486+0000 7fe5a6200640 1 -- 172.21.15.3:0/716743979 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7fe5880391b0 msgr2=0x7fe58803b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:01:57.323 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.486+0000 7fe5a6200640 1 --2- 172.21.15.3:0/716743979 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7fe5880391b0 0x7fe58803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:57.323 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.486+0000 7fe5a6200640 1 -- 172.21.15.3:0/716743979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5a007de40 msgr2=0x7fe5a01a1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:01:57.323 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.486+0000 7fe5a6200640 1 --2- 172.21.15.3:0/716743979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5a007de40 0x7fe5a01a1b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe5940097f0 tx=0x7fe594030d80 comp rx=0 tx=0).stop 2024-09-19T06:01:57.323 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.487+0000 7fe5a6200640 1 -- 172.21.15.3:0/716743979 shutdown_connections 2024-09-19T06:01:57.323 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.487+0000 7fe5a6200640 1 --2- 172.21.15.3:0/716743979 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7fe5880391b0 0x7fe58803b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:57.323 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.487+0000 7fe5a6200640 1 --2- 172.21.15.3:0/716743979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5a007de40 0x7fe5a01a1b10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:01:57.324 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.487+0000 7fe5a6200640 1 -- 172.21.15.3:0/716743979 >> 172.21.15.3:0/716743979 conn(0x7fe5a0102d90 msgr2=0x7fe5a0105180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:01:57.324 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.487+0000 7fe5a6200640 1 -- 172.21.15.3:0/716743979 shutdown_connections 2024-09-19T06:01:57.324 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:56.487+0000 7fe5a6200640 1 -- 172.21.15.3:0/716743979 wait complete. 2024-09-19T06:01:57.324 INFO:teuthology.orchestra.run.smithi003.stdout:Waiting for the mgr to restart... 2024-09-19T06:01:57.324 INFO:teuthology.orchestra.run.smithi003.stdout:Waiting for mgr epoch 5... 2024-09-19T06:01:58.081 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:57 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:57.820+0000 7fed13dd3040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:01:58.081 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:57 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:57.904+0000 7fed13dd3040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:01:58.998 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:58 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:58.855+0000 7fed13dd3040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:01:58.999 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:58 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:58.996+0000 7fed13dd3040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:01:59.334 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:59 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:59.166+0000 7fed13dd3040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:01:59.335 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:59 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:59.240+0000 7fed13dd3040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:01:59.766 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:59 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:59.419+0000 7fed13dd3040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:01:59.766 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:59 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:59.503+0000 7fed13dd3040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:01:59.766 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:59 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:59.577+0000 7fed13dd3040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:01:59.766 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:59 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:59.763+0000 7fed13dd3040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:02:00.030 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:59 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:59.843+0000 7fed13dd3040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:02:00.030 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:01:59 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:01:59.925+0000 7fed13dd3040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:02:00.030 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:00 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:00.025+0000 7fed13dd3040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:02:00.334 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:00 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:00.098+0000 7fed13dd3040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:02:00.335 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:00 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:00.171+0000 7fed13dd3040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:02:01.585 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:01 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:01.119+0000 7fed13dd3040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:02:01.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:01 smithi003 ceph-mon[30893]: Active manager daemon x restarted 2024-09-19T06:02:01.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:01 smithi003 ceph-mon[30893]: Activating manager daemon x 2024-09-19T06:02:01.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:01 smithi003 ceph-mon[30893]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T06:02:01.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:01 smithi003 ceph-mon[30893]: mgrmap e6: x(active, starting, since 0.00361286s) 2024-09-19T06:02:01.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:01 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:02:01.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:01 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:02:01.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:01 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:02:01.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:01 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:02:01.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:01 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:02:01.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:01 smithi003 ceph-mon[30893]: Manager daemon x is now available 2024-09-19T06:02:01.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:01 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' 2024-09-19T06:02:01.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:01 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' 2024-09-19T06:02:01.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:01 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:01.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:01 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:02.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:02 smithi003 ceph-mon[30893]: Found migration_current of "None". Setting to last migration. 2024-09-19T06:02:02.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:02 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:02:02.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:02 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:02:02.471 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:02 smithi003 ceph-mon[30893]: mgrmap e7: x(active, since 1.00727s) 2024-09-19T06:02:02.810 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:02:02.810 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T06:02:02.811 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T06:02:02.811 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:02:02.811 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.078+0000 7f0053000640 1 Processor -- start 2024-09-19T06:02:02.811 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.078+0000 7f0053000640 1 -- start start 2024-09-19T06:02:02.811 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.079+0000 7f0053000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f004c109960 0x7f004c109d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:02.811 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.079+0000 7f0053000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f004c10a330 con 0x7f004c109960 2024-09-19T06:02:02.811 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.079+0000 7f004be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f004c109960 0x7f004c109d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:02.812 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.079+0000 7f004be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f004c109960 0x7f004c109d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43644/0 (socket says 172.21.15.3:43644) 2024-09-19T06:02:02.812 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.079+0000 7f004be00640 1 -- 172.21.15.3:0/931802627 learned_addr learned my addr 172.21.15.3:0/931802627 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:02.812 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.079+0000 7f004be00640 1 -- 172.21.15.3:0/931802627 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f004c10ab00 con 0x7f004c109960 2024-09-19T06:02:02.812 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.081+0000 7f004be00640 1 --2- 172.21.15.3:0/931802627 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f004c109960 0x7f004c109d60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f003c009820 tx=0x7f003c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8dff85cacf88ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:02.812 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.081+0000 7f004aa00640 1 -- 172.21.15.3:0/931802627 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f003c037070 con 0x7f004c109960 2024-09-19T06:02:02.812 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.081+0000 7f004aa00640 1 -- 172.21.15.3:0/931802627 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f003c032900 con 0x7f004c109960 2024-09-19T06:02:02.812 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.081+0000 7f004aa00640 1 -- 172.21.15.3:0/931802627 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f003c030850 con 0x7f004c109960 2024-09-19T06:02:02.812 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.082+0000 7f0053000640 1 -- 172.21.15.3:0/931802627 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f004c109960 msgr2=0x7f004c109d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:02.812 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.082+0000 7f0053000640 1 --2- 172.21.15.3:0/931802627 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f004c109960 0x7f004c109d60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f003c009820 tx=0x7f003c02a270 comp rx=0 tx=0).stop 2024-09-19T06:02:02.812 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.082+0000 7f0053000640 1 -- 172.21.15.3:0/931802627 shutdown_connections 2024-09-19T06:02:02.812 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.082+0000 7f0053000640 1 --2- 172.21.15.3:0/931802627 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f004c109960 0x7f004c109d60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:02.812 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.082+0000 7f0053000640 1 -- 172.21.15.3:0/931802627 >> 172.21.15.3:0/931802627 conn(0x7f004c07cf80 msgr2=0x7f004c07d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:02.813 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.082+0000 7f0053000640 1 -- 172.21.15.3:0/931802627 shutdown_connections 2024-09-19T06:02:02.813 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.082+0000 7f0053000640 1 -- 172.21.15.3:0/931802627 wait complete. 2024-09-19T06:02:02.813 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.084+0000 7f0053000640 1 Processor -- start 2024-09-19T06:02:02.813 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.085+0000 7f0053000640 1 -- start start 2024-09-19T06:02:02.813 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.085+0000 7f0053000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f004c109960 0x7f004c19d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:02.813 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.085+0000 7f0053000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f004c10deb0 con 0x7f004c109960 2024-09-19T06:02:02.813 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.085+0000 7f004be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f004c109960 0x7f004c19d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:02.813 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.085+0000 7f004be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f004c109960 0x7f004c19d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43646/0 (socket says 172.21.15.3:43646) 2024-09-19T06:02:02.813 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.085+0000 7f004be00640 1 -- 172.21.15.3:0/3094326472 learned_addr learned my addr 172.21.15.3:0/3094326472 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:02.813 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.086+0000 7f004be00640 1 -- 172.21.15.3:0/3094326472 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f004c19de70 con 0x7f004c109960 2024-09-19T06:02:02.813 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.086+0000 7f004be00640 1 --2- 172.21.15.3:0/3094326472 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f004c109960 0x7f004c19d930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f003c0097f0 tx=0x7f003c030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:02.814 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.086+0000 7f0048c00640 1 -- 172.21.15.3:0/3094326472 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f003c042070 con 0x7f004c109960 2024-09-19T06:02:02.814 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.086+0000 7f0053000640 1 -- 172.21.15.3:0/3094326472 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f004c19e100 con 0x7f004c109960 2024-09-19T06:02:02.814 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.086+0000 7f0048c00640 1 -- 172.21.15.3:0/3094326472 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f003c032ca0 con 0x7f004c109960 2024-09-19T06:02:02.814 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.086+0000 7f0048c00640 1 -- 172.21.15.3:0/3094326472 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f003c037040 con 0x7f004c109960 2024-09-19T06:02:02.814 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.086+0000 7f0053000640 1 -- 172.21.15.3:0/3094326472 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f004c1a0df0 con 0x7f004c109960 2024-09-19T06:02:02.814 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.087+0000 7f0048c00640 1 -- 172.21.15.3:0/3094326472 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f003c045070 con 0x7f004c109960 2024-09-19T06:02:02.814 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.088+0000 7f0048c00640 1 --2- 172.21.15.3:0/3094326472 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f00300391b0 0x7f003003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:02.814 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.088+0000 7f0048c00640 1 -- 172.21.15.3:0/3094326472 --> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f003003bd80 con 0x7f00300391b0 2024-09-19T06:02:02.814 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.088+0000 7f0048c00640 1 -- 172.21.15.3:0/3094326472 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f003c06c290 con 0x7f004c109960 2024-09-19T06:02:02.814 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.088+0000 7f004b400640 1 -- 172.21.15.3:0/3094326472 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f00300391b0 msgr2=0x7f003003b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.3:6800/2386230415 2024-09-19T06:02:02.815 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.088+0000 7f004b400640 1 --2- 172.21.15.3:0/3094326472 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f00300391b0 0x7f003003b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:02:02.815 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.289+0000 7f004b400640 1 -- 172.21.15.3:0/3094326472 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f00300391b0 msgr2=0x7f003003b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.3:6800/2386230415 2024-09-19T06:02:02.815 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.289+0000 7f004b400640 1 --2- 172.21.15.3:0/3094326472 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f00300391b0 0x7f003003b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:02:02.815 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.690+0000 7f004b400640 1 -- 172.21.15.3:0/3094326472 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f00300391b0 msgr2=0x7f003003b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.3:6800/2386230415 2024-09-19T06:02:02.815 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:58.690+0000 7f004b400640 1 --2- 172.21.15.3:0/3094326472 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f00300391b0 0x7f003003b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T06:02:02.815 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:59.491+0000 7f004b400640 1 -- 172.21.15.3:0/3094326472 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f00300391b0 msgr2=0x7f003003b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.3:6800/2386230415 2024-09-19T06:02:02.816 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:01:59.491+0000 7f004b400640 1 --2- 172.21.15.3:0/3094326472 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f00300391b0 0x7f003003b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T06:02:02.816 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:01.092+0000 7f004b400640 1 -- 172.21.15.3:0/3094326472 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f00300391b0 msgr2=0x7f003003b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.3:6800/2386230415 2024-09-19T06:02:02.816 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:01.093+0000 7f004b400640 1 --2- 172.21.15.3:0/3094326472 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f00300391b0 0x7f003003b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-19T06:02:02.816 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:01.123+0000 7f0048c00640 1 -- 172.21.15.3:0/3094326472 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7f003c03ccd0 con 0x7f004c109960 2024-09-19T06:02:02.816 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:01.123+0000 7f0048c00640 1 -- 172.21.15.3:0/3094326472 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f00300391b0 msgr2=0x7f003003b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:02:02.817 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:01.123+0000 7f0048c00640 1 --2- 172.21.15.3:0/3094326472 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f00300391b0 0x7f003003b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:02.817 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:02.125+0000 7f0048c00640 1 -- 172.21.15.3:0/3094326472 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f003c06e0d0 con 0x7f004c109960 2024-09-19T06:02:02.817 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:02.125+0000 7f0048c00640 1 --2- 172.21.15.3:0/3094326472 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f003003cae0 0x7f003003eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:02.817 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:02.125+0000 7f0048c00640 1 -- 172.21.15.3:0/3094326472 --> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f003c00af30 con 0x7f003003cae0 2024-09-19T06:02:02.817 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:02.126+0000 7f004b400640 1 --2- 172.21.15.3:0/3094326472 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f003003cae0 0x7f003003eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:02.817 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:02.127+0000 7f004b400640 1 --2- 172.21.15.3:0/3094326472 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f003003cae0 0x7f003003eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0038003980 tx=0x7f0038009290 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:02.818 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:02.128+0000 7f0048c00640 1 -- 172.21.15.3:0/3094326472 <== mgr.14118 v2:172.21.15.3:6800/518259590 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f003c00af30 con 0x7f003003cae0 2024-09-19T06:02:02.818 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:02.141+0000 7f0053000640 1 -- 172.21.15.3:0/3094326472 --> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f004c10e030 con 0x7f003003cae0 2024-09-19T06:02:02.818 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:02.142+0000 7f0048c00640 1 -- 172.21.15.3:0/3094326472 <== mgr.14118 v2:172.21.15.3:6800/518259590 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f004c10e030 con 0x7f003003cae0 2024-09-19T06:02:02.818 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:02.142+0000 7f0053000640 1 -- 172.21.15.3:0/3094326472 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f003003cae0 msgr2=0x7f003003eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:02.818 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:02.142+0000 7f0053000640 1 --2- 172.21.15.3:0/3094326472 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f003003cae0 0x7f003003eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0038003980 tx=0x7f0038009290 comp rx=0 tx=0).stop 2024-09-19T06:02:02.818 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:02.142+0000 7f0053000640 1 -- 172.21.15.3:0/3094326472 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f004c109960 msgr2=0x7f004c19d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:02.818 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:02.142+0000 7f0053000640 1 --2- 172.21.15.3:0/3094326472 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f004c109960 0x7f004c19d930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f003c0097f0 tx=0x7f003c030ec0 comp rx=0 tx=0).stop 2024-09-19T06:02:02.818 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:02.142+0000 7f0053000640 1 -- 172.21.15.3:0/3094326472 shutdown_connections 2024-09-19T06:02:02.818 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:02.142+0000 7f0053000640 1 --2- 172.21.15.3:0/3094326472 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f003003cae0 0x7f003003eed0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:02.818 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:02.142+0000 7f0053000640 1 --2- 172.21.15.3:0/3094326472 >> [v2:172.21.15.3:6800/2386230415,v1:172.21.15.3:6801/2386230415] conn(0x7f00300391b0 0x7f003003b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:02.818 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:02.142+0000 7f0053000640 1 --2- 172.21.15.3:0/3094326472 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f004c109960 0x7f004c19d930 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:02.818 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:02.142+0000 7f0053000640 1 -- 172.21.15.3:0/3094326472 >> 172.21.15.3:0/3094326472 conn(0x7f004c07cf80 msgr2=0x7f004c107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:02.818 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:02.142+0000 7f0053000640 1 -- 172.21.15.3:0/3094326472 shutdown_connections 2024-09-19T06:02:02.819 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:02.143+0000 7f0053000640 1 -- 172.21.15.3:0/3094326472 wait complete. 2024-09-19T06:02:02.819 INFO:teuthology.orchestra.run.smithi003.stdout:mgr epoch 5 is available 2024-09-19T06:02:02.819 INFO:teuthology.orchestra.run.smithi003.stdout:Setting orchestrator backend to cephadm... 2024-09-19T06:02:04.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:03 smithi003 ceph-mon[30893]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T06:02:04.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:03 smithi003 ceph-mon[30893]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T06:02:04.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:03 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' 2024-09-19T06:02:04.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:03 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' 2024-09-19T06:02:04.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:03 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' 2024-09-19T06:02:04.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:03 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:04.188 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.324+0000 7fe70d200640 1 Processor -- start 2024-09-19T06:02:04.188 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.324+0000 7fe70d200640 1 -- start start 2024-09-19T06:02:04.188 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.325+0000 7fe70d200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe70807de80 0x7fe70807c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:04.189 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.325+0000 7fe70d200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe70807c8b0 con 0x7fe70807de80 2024-09-19T06:02:04.189 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.325+0000 7fe705e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe70807de80 0x7fe70807c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:04.189 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.325+0000 7fe705e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe70807de80 0x7fe70807c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43702/0 (socket says 172.21.15.3:43702) 2024-09-19T06:02:04.189 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.325+0000 7fe705e00640 1 -- 172.21.15.3:0/1940296397 learned_addr learned my addr 172.21.15.3:0/1940296397 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:04.189 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.326+0000 7fe705e00640 1 -- 172.21.15.3:0/1940296397 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe70807ca30 con 0x7fe70807de80 2024-09-19T06:02:04.189 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.327+0000 7fe705e00640 1 --2- 172.21.15.3:0/1940296397 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe70807de80 0x7fe70807c2e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009820 tx=0x7fe6f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=903371ce821df0a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:04.189 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.327+0000 7fe704a00640 1 -- 172.21.15.3:0/1940296397 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6f8037070 con 0x7fe70807de80 2024-09-19T06:02:04.189 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.327+0000 7fe704a00640 1 -- 172.21.15.3:0/1940296397 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe6f8032900 con 0x7fe70807de80 2024-09-19T06:02:04.189 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.327+0000 7fe704a00640 1 -- 172.21.15.3:0/1940296397 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6f8030850 con 0x7fe70807de80 2024-09-19T06:02:04.189 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.328+0000 7fe70d200640 1 -- 172.21.15.3:0/1940296397 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe70807de80 msgr2=0x7fe70807c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:04.189 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.328+0000 7fe70d200640 1 --2- 172.21.15.3:0/1940296397 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe70807de80 0x7fe70807c2e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009820 tx=0x7fe6f802a270 comp rx=0 tx=0).stop 2024-09-19T06:02:04.189 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.328+0000 7fe70d200640 1 -- 172.21.15.3:0/1940296397 shutdown_connections 2024-09-19T06:02:04.189 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.328+0000 7fe70d200640 1 --2- 172.21.15.3:0/1940296397 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe70807de80 0x7fe70807c2e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:04.190 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.328+0000 7fe70d200640 1 -- 172.21.15.3:0/1940296397 >> 172.21.15.3:0/1940296397 conn(0x7fe708102ec0 msgr2=0x7fe7081052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:04.190 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.328+0000 7fe70d200640 1 -- 172.21.15.3:0/1940296397 shutdown_connections 2024-09-19T06:02:04.190 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.328+0000 7fe70d200640 1 -- 172.21.15.3:0/1940296397 wait complete. 2024-09-19T06:02:04.190 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.329+0000 7fe70d200640 1 Processor -- start 2024-09-19T06:02:04.190 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.329+0000 7fe70d200640 1 -- start start 2024-09-19T06:02:04.190 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.330+0000 7fe70d200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe70807de80 0x7fe70819d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:04.190 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.330+0000 7fe70d200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe70810dd20 con 0x7fe70807de80 2024-09-19T06:02:04.190 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.330+0000 7fe705e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe70807de80 0x7fe70819d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:04.190 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.330+0000 7fe705e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe70807de80 0x7fe70819d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43706/0 (socket says 172.21.15.3:43706) 2024-09-19T06:02:04.190 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.330+0000 7fe705e00640 1 -- 172.21.15.3:0/1402293694 learned_addr learned my addr 172.21.15.3:0/1402293694 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:04.190 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.330+0000 7fe705e00640 1 -- 172.21.15.3:0/1402293694 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe70819de00 con 0x7fe70807de80 2024-09-19T06:02:04.190 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.331+0000 7fe705e00640 1 --2- 172.21.15.3:0/1402293694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe70807de80 0x7fe70819d8c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80097f0 tx=0x7fe6f8030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:04.190 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.331+0000 7fe6fea00640 1 -- 172.21.15.3:0/1402293694 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6f8037040 con 0x7fe70807de80 2024-09-19T06:02:04.191 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.331+0000 7fe6fea00640 1 -- 172.21.15.3:0/1402293694 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe6f8040070 con 0x7fe70807de80 2024-09-19T06:02:04.191 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.331+0000 7fe6fea00640 1 -- 172.21.15.3:0/1402293694 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6f803a390 con 0x7fe70807de80 2024-09-19T06:02:04.191 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.331+0000 7fe70d200640 1 -- 172.21.15.3:0/1402293694 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe70819e090 con 0x7fe70807de80 2024-09-19T06:02:04.191 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.331+0000 7fe70d200640 1 -- 172.21.15.3:0/1402293694 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7081a0d80 con 0x7fe70807de80 2024-09-19T06:02:04.191 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.332+0000 7fe6fea00640 1 -- 172.21.15.3:0/1402293694 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fe6f803b430 con 0x7fe70807de80 2024-09-19T06:02:04.191 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.332+0000 7fe70d200640 1 -- 172.21.15.3:0/1402293694 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe70807c360 con 0x7fe70807de80 2024-09-19T06:02:04.191 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.333+0000 7fe6fea00640 1 --2- 172.21.15.3:0/1402293694 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fe6ec0390a0 0x7fe6ec03b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:04.191 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.333+0000 7fe6fea00640 1 -- 172.21.15.3:0/1402293694 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe6f806c650 con 0x7fe70807de80 2024-09-19T06:02:04.191 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.333+0000 7fe705400640 1 --2- 172.21.15.3:0/1402293694 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fe6ec0390a0 0x7fe6ec03b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:04.191 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.334+0000 7fe705400640 1 --2- 172.21.15.3:0/1402293694 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fe6ec0390a0 0x7fe6ec03b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40098c0 tx=0x7fe6f4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:04.191 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.338+0000 7fe6fea00640 1 -- 172.21.15.3:0/1402293694 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe6f8032900 con 0x7fe70807de80 2024-09-19T06:02:04.191 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.538+0000 7fe70d200640 1 -- 172.21.15.3:0/1402293694 --> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fe708104130 con 0x7fe6ec0390a0 2024-09-19T06:02:04.191 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.544+0000 7fe6fea00640 1 -- 172.21.15.3:0/1402293694 <== mgr.14118 v2:172.21.15.3:6800/518259590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe708104130 con 0x7fe6ec0390a0 2024-09-19T06:02:04.191 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.546+0000 7fe70d200640 1 -- 172.21.15.3:0/1402293694 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fe6ec0390a0 msgr2=0x7fe6ec03b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:04.192 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.546+0000 7fe70d200640 1 --2- 172.21.15.3:0/1402293694 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fe6ec0390a0 0x7fe6ec03b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40098c0 tx=0x7fe6f4006db0 comp rx=0 tx=0).stop 2024-09-19T06:02:04.192 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.546+0000 7fe70d200640 1 -- 172.21.15.3:0/1402293694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe70807de80 msgr2=0x7fe70819d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:04.192 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.546+0000 7fe70d200640 1 --2- 172.21.15.3:0/1402293694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe70807de80 0x7fe70819d8c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80097f0 tx=0x7fe6f8030d80 comp rx=0 tx=0).stop 2024-09-19T06:02:04.192 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.547+0000 7fe70d200640 1 -- 172.21.15.3:0/1402293694 shutdown_connections 2024-09-19T06:02:04.192 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.547+0000 7fe70d200640 1 --2- 172.21.15.3:0/1402293694 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fe6ec0390a0 0x7fe6ec03b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:04.192 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.547+0000 7fe70d200640 1 --2- 172.21.15.3:0/1402293694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe70807de80 0x7fe70819d8c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:04.192 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.547+0000 7fe70d200640 1 -- 172.21.15.3:0/1402293694 >> 172.21.15.3:0/1402293694 conn(0x7fe708102ec0 msgr2=0x7fe708103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:04.192 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.547+0000 7fe70d200640 1 -- 172.21.15.3:0/1402293694 shutdown_connections 2024-09-19T06:02:04.192 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:03.547+0000 7fe70d200640 1 -- 172.21.15.3:0/1402293694 wait complete. 2024-09-19T06:02:04.416 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:04.156+0000 7fec6b600640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:06:02:04] ENGINE Error in HTTPServer.serve 2024-09-19T06:02:04.416 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: Traceback (most recent call last): 2024-09-19T06:02:04.416 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:02:04.416 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: self._connections.run(self.expiration_interval) 2024-09-19T06:02:04.416 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:02:04.416 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: self._run(expiration_interval) 2024-09-19T06:02:04.417 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:02:04.417 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:02:04.417 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:02:04.417 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:02:04.417 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:02:04.417 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: s = self.context.wrap_socket( 2024-09-19T06:02:04.417 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:02:04.417 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: return self.sslsocket_class._create( 2024-09-19T06:02:04.417 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:02:04.417 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: self.do_handshake() 2024-09-19T06:02:04.417 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:02:04.417 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: self._sslobj.do_handshake() 2024-09-19T06:02:04.417 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:02:04.418 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:05.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-mon[30893]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:05.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-mon[30893]: mgrmap e8: x(active, since 2s) 2024-09-19T06:02:05.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-mon[30893]: [19/Sep/2024:06:02:03] ENGINE Bus STARTING 2024-09-19T06:02:05.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-mon[30893]: [19/Sep/2024:06:02:04] ENGINE Serving on http://172.21.15.3:8765 2024-09-19T06:02:05.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:04 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:05.537 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T06:02:05.537 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.636+0000 7f83ed000640 1 Processor -- start 2024-09-19T06:02:05.537 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.637+0000 7f83ed000640 1 -- start start 2024-09-19T06:02:05.537 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.637+0000 7f83ed000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e810ab40 0x7f83e810af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:05.537 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.637+0000 7f83ed000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f83e810b510 con 0x7f83e810ab40 2024-09-19T06:02:05.537 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.637+0000 7f83e7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e810ab40 0x7f83e810af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:05.537 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.637+0000 7f83e7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e810ab40 0x7f83e810af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54094/0 (socket says 172.21.15.3:54094) 2024-09-19T06:02:05.537 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.637+0000 7f83e7400640 1 -- 172.21.15.3:0/412306838 learned_addr learned my addr 172.21.15.3:0/412306838 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:05.537 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.638+0000 7f83e7400640 1 -- 172.21.15.3:0/412306838 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e810b690 con 0x7f83e810ab40 2024-09-19T06:02:05.537 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.639+0000 7f83e7400640 1 --2- 172.21.15.3:0/412306838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e810ab40 0x7f83e810af40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f83d8009820 tx=0x7f83d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609096b266ea50bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:05.537 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.639+0000 7f83e6a00640 1 -- 172.21.15.3:0/412306838 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83d8037070 con 0x7f83e810ab40 2024-09-19T06:02:05.538 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.639+0000 7f83e6a00640 1 -- 172.21.15.3:0/412306838 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f83d8032900 con 0x7f83e810ab40 2024-09-19T06:02:05.538 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.639+0000 7f83e6a00640 1 -- 172.21.15.3:0/412306838 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83d8030850 con 0x7f83e810ab40 2024-09-19T06:02:05.538 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.640+0000 7f83ed000640 1 -- 172.21.15.3:0/412306838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e810ab40 msgr2=0x7f83e810af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:05.538 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.640+0000 7f83ed000640 1 --2- 172.21.15.3:0/412306838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e810ab40 0x7f83e810af40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f83d8009820 tx=0x7f83d802a270 comp rx=0 tx=0).stop 2024-09-19T06:02:05.538 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.640+0000 7f83ed000640 1 -- 172.21.15.3:0/412306838 shutdown_connections 2024-09-19T06:02:05.538 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.640+0000 7f83ed000640 1 --2- 172.21.15.3:0/412306838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e810ab40 0x7f83e810af40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:05.538 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.640+0000 7f83ed000640 1 -- 172.21.15.3:0/412306838 >> 172.21.15.3:0/412306838 conn(0x7f83e807cd70 msgr2=0x7f83e807d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:05.538 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.640+0000 7f83ed000640 1 -- 172.21.15.3:0/412306838 shutdown_connections 2024-09-19T06:02:05.538 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.640+0000 7f83ed000640 1 -- 172.21.15.3:0/412306838 wait complete. 2024-09-19T06:02:05.538 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.641+0000 7f83ed000640 1 Processor -- start 2024-09-19T06:02:05.538 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.641+0000 7f83ed000640 1 -- start start 2024-09-19T06:02:05.538 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.641+0000 7f83ed000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e810ab40 0x7f83e819d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:05.538 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.641+0000 7f83ed000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f83e810dba0 con 0x7f83e810ab40 2024-09-19T06:02:05.539 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.641+0000 7f83e7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e810ab40 0x7f83e819d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:05.539 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.641+0000 7f83e7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e810ab40 0x7f83e819d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54110/0 (socket says 172.21.15.3:54110) 2024-09-19T06:02:05.539 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.641+0000 7f83e7400640 1 -- 172.21.15.3:0/1270732345 learned_addr learned my addr 172.21.15.3:0/1270732345 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:05.539 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.642+0000 7f83e7400640 1 -- 172.21.15.3:0/1270732345 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e819dc20 con 0x7f83e810ab40 2024-09-19T06:02:05.539 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.642+0000 7f83e7400640 1 --2- 172.21.15.3:0/1270732345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e810ab40 0x7f83e819d6e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f83d8032ce0 tx=0x7f83d8032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:05.539 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.642+0000 7f83e4c00640 1 -- 172.21.15.3:0/1270732345 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83d8042070 con 0x7f83e810ab40 2024-09-19T06:02:05.539 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.642+0000 7f83e4c00640 1 -- 172.21.15.3:0/1270732345 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f83d80308c0 con 0x7f83e810ab40 2024-09-19T06:02:05.539 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.642+0000 7f83ed000640 1 -- 172.21.15.3:0/1270732345 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83e819deb0 con 0x7f83e810ab40 2024-09-19T06:02:05.539 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.642+0000 7f83e4c00640 1 -- 172.21.15.3:0/1270732345 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83d8037040 con 0x7f83e810ab40 2024-09-19T06:02:05.539 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.642+0000 7f83ed000640 1 -- 172.21.15.3:0/1270732345 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83e81a0ba0 con 0x7f83e810ab40 2024-09-19T06:02:05.539 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.643+0000 7f83e4c00640 1 -- 172.21.15.3:0/1270732345 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f83d8045070 con 0x7f83e810ab40 2024-09-19T06:02:05.539 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.643+0000 7f83ed000640 1 -- 172.21.15.3:0/1270732345 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83e810dd20 con 0x7f83e810ab40 2024-09-19T06:02:05.539 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.644+0000 7f83e4c00640 1 --2- 172.21.15.3:0/1270732345 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f83cc0391b0 0x7f83cc03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:05.540 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.644+0000 7f83e4c00640 1 -- 172.21.15.3:0/1270732345 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f83d806c550 con 0x7f83e810ab40 2024-09-19T06:02:05.540 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.644+0000 7f83dfe00640 1 --2- 172.21.15.3:0/1270732345 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f83cc0391b0 0x7f83cc03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:05.540 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.645+0000 7f83dfe00640 1 --2- 172.21.15.3:0/1270732345 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f83cc0391b0 0x7f83cc03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f83d00098c0 tx=0x7f83d0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:05.540 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.649+0000 7f83e4c00640 1 -- 172.21.15.3:0/1270732345 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f83d8045360 con 0x7f83e810ab40 2024-09-19T06:02:05.540 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.837+0000 7f83ed000640 1 -- 172.21.15.3:0/1270732345 --> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f83e8107c90 con 0x7f83cc0391b0 2024-09-19T06:02:05.540 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.838+0000 7f83e4c00640 1 -- 172.21.15.3:0/1270732345 <== mgr.14118 v2:172.21.15.3:6800/518259590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f83e8107c90 con 0x7f83cc0391b0 2024-09-19T06:02:05.540 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.840+0000 7f83ed000640 1 -- 172.21.15.3:0/1270732345 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f83cc0391b0 msgr2=0x7f83cc03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:05.540 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.840+0000 7f83ed000640 1 --2- 172.21.15.3:0/1270732345 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f83cc0391b0 0x7f83cc03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f83d00098c0 tx=0x7f83d0006db0 comp rx=0 tx=0).stop 2024-09-19T06:02:05.540 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.840+0000 7f83ed000640 1 -- 172.21.15.3:0/1270732345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e810ab40 msgr2=0x7f83e819d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:05.540 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.840+0000 7f83ed000640 1 --2- 172.21.15.3:0/1270732345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e810ab40 0x7f83e819d6e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f83d8032ce0 tx=0x7f83d8032d10 comp rx=0 tx=0).stop 2024-09-19T06:02:05.541 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.840+0000 7f83ed000640 1 -- 172.21.15.3:0/1270732345 shutdown_connections 2024-09-19T06:02:05.541 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.840+0000 7f83ed000640 1 --2- 172.21.15.3:0/1270732345 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f83cc0391b0 0x7f83cc03b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:05.541 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.840+0000 7f83ed000640 1 --2- 172.21.15.3:0/1270732345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e810ab40 0x7f83e819d6e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:05.541 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.840+0000 7f83ed000640 1 -- 172.21.15.3:0/1270732345 >> 172.21.15.3:0/1270732345 conn(0x7f83e807cd70 msgr2=0x7f83e8107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:05.541 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.840+0000 7f83ed000640 1 -- 172.21.15.3:0/1270732345 shutdown_connections 2024-09-19T06:02:05.541 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:04.840+0000 7f83ed000640 1 -- 172.21.15.3:0/1270732345 wait complete. 2024-09-19T06:02:05.541 INFO:teuthology.orchestra.run.smithi003.stdout:Generating ssh key... 2024-09-19T06:02:05.818 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:05 smithi003 ceph-mon[30893]: [19/Sep/2024:06:02:04] ENGINE Serving on https://172.21.15.3:7150 2024-09-19T06:02:05.818 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:05 smithi003 ceph-mon[30893]: [19/Sep/2024:06:02:04] ENGINE Bus STARTED 2024-09-19T06:02:05.818 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:05 smithi003 ceph-mon[30893]: [19/Sep/2024:06:02:04] ENGINE Error in HTTPServer.serve 2024-09-19T06:02:05.818 INFO:journalctl@ceph.mon.a.smithi003.stdout: Traceback (most recent call last): 2024-09-19T06:02:05.819 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:02:05.819 INFO:journalctl@ceph.mon.a.smithi003.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:02:05.819 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:02:05.819 INFO:journalctl@ceph.mon.a.smithi003.stdout: self._run(expiration_interval) 2024-09-19T06:02:05.819 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:02:05.819 INFO:journalctl@ceph.mon.a.smithi003.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:02:05.819 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:02:05.819 INFO:journalctl@ceph.mon.a.smithi003.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:02:05.819 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:02:05.819 INFO:journalctl@ceph.mon.a.smithi003.stdout: s = self.context.wrap_socket( 2024-09-19T06:02:05.819 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:02:05.819 INFO:journalctl@ceph.mon.a.smithi003.stdout: return self.sslsocket_class._create( 2024-09-19T06:02:05.819 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:02:05.820 INFO:journalctl@ceph.mon.a.smithi003.stdout: self.do_handshake() 2024-09-19T06:02:05.820 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:02:05.820 INFO:journalctl@ceph.mon.a.smithi003.stdout: self._sslobj.do_handshake() 2024-09-19T06:02:05.820 INFO:journalctl@ceph.mon.a.smithi003.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:02:05.820 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:05 smithi003 ceph-mon[30893]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:06.958 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:06 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: Generating public/private rsa key pair. 2024-09-19T06:02:06.958 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:06 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: Your identification has been saved in /tmp/tmp169zgk0r/key 2024-09-19T06:02:06.958 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:06 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: Your public key has been saved in /tmp/tmp169zgk0r/key.pub 2024-09-19T06:02:06.958 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:06 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: The key fingerprint is: 2024-09-19T06:02:06.958 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:06 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: SHA256:xfr6psxgZqtUXheSRq9Gw7OO09isUdjkA952lIxk3zM ceph-782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:02:06.959 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:06 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: The key's randomart image is: 2024-09-19T06:02:06.959 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:06 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: +---[RSA 3072]----+ 2024-09-19T06:02:06.959 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:06 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: | + | 2024-09-19T06:02:06.959 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:06 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: | = B o | 2024-09-19T06:02:06.959 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:06 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: | . @ X E | 2024-09-19T06:02:06.959 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:06 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: | . X X . o | 2024-09-19T06:02:06.959 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:06 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: | + S o | 2024-09-19T06:02:06.959 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:06 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: | o % = | 2024-09-19T06:02:06.959 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:06 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: | . @ = . | 2024-09-19T06:02:06.959 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:06 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: | . + O .. | 2024-09-19T06:02:06.959 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:06 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: | ..o =+. | 2024-09-19T06:02:06.959 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:06 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: +----[SHA256]-----+ 2024-09-19T06:02:07.269 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.060+0000 7fae2c000640 1 Processor -- start 2024-09-19T06:02:07.269 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.060+0000 7fae2c000640 1 -- start start 2024-09-19T06:02:07.269 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.060+0000 7fae2c000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae2407de70 0x7fae2407c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:07.270 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.060+0000 7fae2c000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fae2407c8f0 con 0x7fae2407de70 2024-09-19T06:02:07.270 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.061+0000 7fae29600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae2407de70 0x7fae2407c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:07.270 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.061+0000 7fae29600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae2407de70 0x7fae2407c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54118/0 (socket says 172.21.15.3:54118) 2024-09-19T06:02:07.270 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.061+0000 7fae29600640 1 -- 172.21.15.3:0/2777312816 learned_addr learned my addr 172.21.15.3:0/2777312816 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:07.270 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.061+0000 7fae29600640 1 -- 172.21.15.3:0/2777312816 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2407ca70 con 0x7fae2407de70 2024-09-19T06:02:07.270 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.062+0000 7fae29600640 1 --2- 172.21.15.3:0/2777312816 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae2407de70 0x7fae2407c320 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fae18009820 tx=0x7fae1802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d810d35b1108176c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:07.270 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.062+0000 7fae23e00640 1 -- 172.21.15.3:0/2777312816 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae18037070 con 0x7fae2407de70 2024-09-19T06:02:07.270 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.062+0000 7fae23e00640 1 -- 172.21.15.3:0/2777312816 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fae18032900 con 0x7fae2407de70 2024-09-19T06:02:07.271 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.062+0000 7fae23e00640 1 -- 172.21.15.3:0/2777312816 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae18030850 con 0x7fae2407de70 2024-09-19T06:02:07.271 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.063+0000 7fae2c000640 1 -- 172.21.15.3:0/2777312816 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae2407de70 msgr2=0x7fae2407c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:07.271 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.063+0000 7fae2c000640 1 --2- 172.21.15.3:0/2777312816 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae2407de70 0x7fae2407c320 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fae18009820 tx=0x7fae1802a270 comp rx=0 tx=0).stop 2024-09-19T06:02:07.271 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.063+0000 7fae2c000640 1 -- 172.21.15.3:0/2777312816 shutdown_connections 2024-09-19T06:02:07.271 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.063+0000 7fae2c000640 1 --2- 172.21.15.3:0/2777312816 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae2407de70 0x7fae2407c320 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:07.271 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.063+0000 7fae2c000640 1 -- 172.21.15.3:0/2777312816 >> 172.21.15.3:0/2777312816 conn(0x7fae24102ef0 msgr2=0x7fae24105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:07.271 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.063+0000 7fae2c000640 1 -- 172.21.15.3:0/2777312816 shutdown_connections 2024-09-19T06:02:07.272 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.063+0000 7fae2c000640 1 -- 172.21.15.3:0/2777312816 wait complete. 2024-09-19T06:02:07.272 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.064+0000 7fae2c000640 1 Processor -- start 2024-09-19T06:02:07.272 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.064+0000 7fae2c000640 1 -- start start 2024-09-19T06:02:07.272 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.065+0000 7fae2c000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae2407de70 0x7fae2419d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:07.272 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.065+0000 7fae2c000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fae2410dd30 con 0x7fae2407de70 2024-09-19T06:02:07.272 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.065+0000 7fae29600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae2407de70 0x7fae2419d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:07.272 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.065+0000 7fae29600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae2407de70 0x7fae2419d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54120/0 (socket says 172.21.15.3:54120) 2024-09-19T06:02:07.273 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.065+0000 7fae29600640 1 -- 172.21.15.3:0/2464567664 learned_addr learned my addr 172.21.15.3:0/2464567664 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:07.273 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.065+0000 7fae29600640 1 -- 172.21.15.3:0/2464567664 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2419de40 con 0x7fae2407de70 2024-09-19T06:02:07.273 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.066+0000 7fae29600640 1 --2- 172.21.15.3:0/2464567664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae2407de70 0x7fae2419d900 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fae180097f0 tx=0x7fae18030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:07.273 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.066+0000 7fae22000640 1 -- 172.21.15.3:0/2464567664 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae18042070 con 0x7fae2407de70 2024-09-19T06:02:07.273 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.066+0000 7fae22000640 1 -- 172.21.15.3:0/2464567664 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fae18032ca0 con 0x7fae2407de70 2024-09-19T06:02:07.273 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.066+0000 7fae22000640 1 -- 172.21.15.3:0/2464567664 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae18037040 con 0x7fae2407de70 2024-09-19T06:02:07.273 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.066+0000 7fae2c000640 1 -- 172.21.15.3:0/2464567664 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae2419e0d0 con 0x7fae2407de70 2024-09-19T06:02:07.273 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.066+0000 7fae2c000640 1 -- 172.21.15.3:0/2464567664 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae241a0dc0 con 0x7fae2407de70 2024-09-19T06:02:07.273 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.067+0000 7fae22000640 1 -- 172.21.15.3:0/2464567664 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fae18045070 con 0x7fae2407de70 2024-09-19T06:02:07.273 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.067+0000 7fae2c000640 1 -- 172.21.15.3:0/2464567664 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae2407c3a0 con 0x7fae2407de70 2024-09-19T06:02:07.273 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.068+0000 7fae22000640 1 --2- 172.21.15.3:0/2464567664 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fae0c039200 0x7fae0c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:07.273 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.068+0000 7fae22000640 1 -- 172.21.15.3:0/2464567664 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fae1806c2b0 con 0x7fae2407de70 2024-09-19T06:02:07.273 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.068+0000 7fae28c00640 1 --2- 172.21.15.3:0/2464567664 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fae0c039200 0x7fae0c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:07.274 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.069+0000 7fae28c00640 1 --2- 172.21.15.3:0/2464567664 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fae0c039200 0x7fae0c03b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fae100098c0 tx=0x7fae10006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:07.274 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.073+0000 7fae22000640 1 -- 172.21.15.3:0/2464567664 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fae18045360 con 0x7fae2407de70 2024-09-19T06:02:07.274 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.261+0000 7fae2c000640 1 -- 172.21.15.3:0/2464567664 --> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fae24104190 con 0x7fae0c039200 2024-09-19T06:02:07.274 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.607+0000 7fae22000640 1 -- 172.21.15.3:0/2464567664 <== mgr.14118 v2:172.21.15.3:6800/518259590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fae24104190 con 0x7fae0c039200 2024-09-19T06:02:07.274 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.609+0000 7fae2c000640 1 -- 172.21.15.3:0/2464567664 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fae0c039200 msgr2=0x7fae0c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:07.274 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.609+0000 7fae2c000640 1 --2- 172.21.15.3:0/2464567664 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fae0c039200 0x7fae0c03b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fae100098c0 tx=0x7fae10006db0 comp rx=0 tx=0).stop 2024-09-19T06:02:07.274 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.609+0000 7fae2c000640 1 -- 172.21.15.3:0/2464567664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae2407de70 msgr2=0x7fae2419d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:07.274 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.609+0000 7fae2c000640 1 --2- 172.21.15.3:0/2464567664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae2407de70 0x7fae2419d900 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fae180097f0 tx=0x7fae18030ec0 comp rx=0 tx=0).stop 2024-09-19T06:02:07.274 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.609+0000 7fae2c000640 1 -- 172.21.15.3:0/2464567664 shutdown_connections 2024-09-19T06:02:07.274 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.609+0000 7fae2c000640 1 --2- 172.21.15.3:0/2464567664 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fae0c039200 0x7fae0c03b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:07.274 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.609+0000 7fae2c000640 1 --2- 172.21.15.3:0/2464567664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fae2407de70 0x7fae2419d900 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:07.274 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.609+0000 7fae2c000640 1 -- 172.21.15.3:0/2464567664 >> 172.21.15.3:0/2464567664 conn(0x7fae24102ef0 msgr2=0x7fae24103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:07.274 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.610+0000 7fae2c000640 1 -- 172.21.15.3:0/2464567664 shutdown_connections 2024-09-19T06:02:07.275 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:06.610+0000 7fae2c000640 1 -- 172.21.15.3:0/2464567664 wait complete. 2024-09-19T06:02:07.829 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:07 smithi003 ceph-mon[30893]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:07.829 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:07 smithi003 ceph-mon[30893]: Generating ssh key... 2024-09-19T06:02:07.829 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:07 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' 2024-09-19T06:02:07.830 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:07 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' 2024-09-19T06:02:08.664 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:08 smithi003 ceph-mon[30893]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:08.669 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9t0Wi4b8rhl199/sSaRf42JK5F6XoWo0RPjsd5EVrknfozCfyNA9G5P3lPbrdEAqMX3/0b5etBLok8amSPl+EL2S5/bMbx648EIb6ZHwJl5w8C0/2lSqEj5J0YfJEct/IR8uHnyAdNPxQ6SjEfKB55YJ7wpsXdUHFAvXMTHIiFJwnmlMDNXCzy9SIWHmh1KENde+9PFn7+R/tqkl/DEFShuyu54BiIRWuhNBtbN9AlyCJzsZqBq5dj8OvUn7r8tnW9kmFIS1hqSFrOIkw/1GeJf+47EmYPIXTzMjfpvbU5gSeftQphG0aNj3xEkUnburQ1QEoQioLGTSzUWb++0rHCT3NLhchclvXByxCkz5mb4xS7ZbWLj3fDXOXMj8JsLAdQo4zQtwplhB0WrUih+MejipDdJMcCKyV+VqgBAJ5dK3PhtvsvMaW2roMGJxHr4VHMp8G9U5xBvXcLh4zS5wTxf83d6Zl8bHLfDN75dBHWjq/vZ39/1a2df9FxzneKbc= ceph-782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:02:08.675 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.827+0000 7fbdcba00640 1 Processor -- start 2024-09-19T06:02:08.675 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.827+0000 7fbdcba00640 1 -- start start 2024-09-19T06:02:08.675 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.827+0000 7fbdcba00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdc4107740 0x7fbdc4107b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:08.675 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.827+0000 7fbdcba00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc4108110 con 0x7fbdc4107740 2024-09-19T06:02:08.675 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.828+0000 7fbdc9000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdc4107740 0x7fbdc4107b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:08.675 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.828+0000 7fbdc9000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdc4107740 0x7fbdc4107b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54124/0 (socket says 172.21.15.3:54124) 2024-09-19T06:02:08.675 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.828+0000 7fbdc9000640 1 -- 172.21.15.3:0/1247451180 learned_addr learned my addr 172.21.15.3:0/1247451180 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:08.676 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.828+0000 7fbdc9000640 1 -- 172.21.15.3:0/1247451180 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc41088f0 con 0x7fbdc4107740 2024-09-19T06:02:08.676 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.829+0000 7fbdc9000640 1 --2- 172.21.15.3:0/1247451180 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdc4107740 0x7fbdc4107b40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8009820 tx=0x7fbdb802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46699cd665ca26ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:08.676 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.829+0000 7fbdc3400640 1 -- 172.21.15.3:0/1247451180 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdb8037070 con 0x7fbdc4107740 2024-09-19T06:02:08.676 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.829+0000 7fbdc3400640 1 -- 172.21.15.3:0/1247451180 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbdb8032900 con 0x7fbdc4107740 2024-09-19T06:02:08.676 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.829+0000 7fbdc3400640 1 -- 172.21.15.3:0/1247451180 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdb8030850 con 0x7fbdc4107740 2024-09-19T06:02:08.676 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.830+0000 7fbdcba00640 1 -- 172.21.15.3:0/1247451180 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdc4107740 msgr2=0x7fbdc4107b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:08.676 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.830+0000 7fbdcba00640 1 --2- 172.21.15.3:0/1247451180 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdc4107740 0x7fbdc4107b40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8009820 tx=0x7fbdb802a270 comp rx=0 tx=0).stop 2024-09-19T06:02:08.676 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.830+0000 7fbdcba00640 1 -- 172.21.15.3:0/1247451180 shutdown_connections 2024-09-19T06:02:08.676 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.830+0000 7fbdcba00640 1 --2- 172.21.15.3:0/1247451180 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdc4107740 0x7fbdc4107b40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:08.676 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.830+0000 7fbdcba00640 1 -- 172.21.15.3:0/1247451180 >> 172.21.15.3:0/1247451180 conn(0x7fbdc4102ef0 msgr2=0x7fbdc4105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:08.676 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.830+0000 7fbdcba00640 1 -- 172.21.15.3:0/1247451180 shutdown_connections 2024-09-19T06:02:08.676 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.830+0000 7fbdcba00640 1 -- 172.21.15.3:0/1247451180 wait complete. 2024-09-19T06:02:08.677 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.831+0000 7fbdcba00640 1 Processor -- start 2024-09-19T06:02:08.677 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.831+0000 7fbdcba00640 1 -- start start 2024-09-19T06:02:08.677 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.831+0000 7fbdcba00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdc4107740 0x7fbdc407db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:08.677 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.832+0000 7fbdcba00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc410bca0 con 0x7fbdc4107740 2024-09-19T06:02:08.677 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.832+0000 7fbdc9000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdc4107740 0x7fbdc407db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:08.677 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.832+0000 7fbdc9000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdc4107740 0x7fbdc407db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54126/0 (socket says 172.21.15.3:54126) 2024-09-19T06:02:08.677 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.832+0000 7fbdc9000640 1 -- 172.21.15.3:0/446676352 learned_addr learned my addr 172.21.15.3:0/446676352 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:08.677 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.832+0000 7fbdc9000640 1 -- 172.21.15.3:0/446676352 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc407e0b0 con 0x7fbdc4107740 2024-09-19T06:02:08.677 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.832+0000 7fbdc9000640 1 --2- 172.21.15.3:0/446676352 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdc4107740 0x7fbdc407db70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80097f0 tx=0x7fbdb8030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:08.677 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.833+0000 7fbdc1600640 1 -- 172.21.15.3:0/446676352 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdb8042070 con 0x7fbdc4107740 2024-09-19T06:02:08.677 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.833+0000 7fbdc1600640 1 -- 172.21.15.3:0/446676352 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbdb8032ca0 con 0x7fbdc4107740 2024-09-19T06:02:08.677 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.833+0000 7fbdc1600640 1 -- 172.21.15.3:0/446676352 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdb8037040 con 0x7fbdc4107740 2024-09-19T06:02:08.677 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.833+0000 7fbdcba00640 1 -- 172.21.15.3:0/446676352 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc407c2a0 con 0x7fbdc4107740 2024-09-19T06:02:08.678 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.833+0000 7fbdcba00640 1 -- 172.21.15.3:0/446676352 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc407c7e0 con 0x7fbdc4107740 2024-09-19T06:02:08.678 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.834+0000 7fbdc1600640 1 -- 172.21.15.3:0/446676352 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fbdb8045070 con 0x7fbdc4107740 2024-09-19T06:02:08.678 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.834+0000 7fbdcba00640 1 -- 172.21.15.3:0/446676352 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdc4107bc0 con 0x7fbdc4107740 2024-09-19T06:02:08.678 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.834+0000 7fbdc1600640 1 --2- 172.21.15.3:0/446676352 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fbdac0391b0 0x7fbdac03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:08.678 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.834+0000 7fbdc1600640 1 -- 172.21.15.3:0/446676352 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbdb806c260 con 0x7fbdc4107740 2024-09-19T06:02:08.678 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.835+0000 7fbdc3e00640 1 --2- 172.21.15.3:0/446676352 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fbdac0391b0 0x7fbdac03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:08.678 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.835+0000 7fbdc3e00640 1 --2- 172.21.15.3:0/446676352 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fbdac0391b0 0x7fbdac03b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbdb00098c0 tx=0x7fbdb0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:08.678 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:07.840+0000 7fbdc1600640 1 -- 172.21.15.3:0/446676352 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbdb804b170 con 0x7fbdc4107740 2024-09-19T06:02:08.678 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:08.025+0000 7fbdcba00640 1 -- 172.21.15.3:0/446676352 --> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fbdc4104190 con 0x7fbdac0391b0 2024-09-19T06:02:08.678 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:08.026+0000 7fbdc1600640 1 -- 172.21.15.3:0/446676352 <== mgr.14118 v2:172.21.15.3:6800/518259590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fbdc4104190 con 0x7fbdac0391b0 2024-09-19T06:02:08.678 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:08.029+0000 7fbdcba00640 1 -- 172.21.15.3:0/446676352 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fbdac0391b0 msgr2=0x7fbdac03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:08.678 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:08.029+0000 7fbdcba00640 1 --2- 172.21.15.3:0/446676352 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fbdac0391b0 0x7fbdac03b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbdb00098c0 tx=0x7fbdb0006db0 comp rx=0 tx=0).stop 2024-09-19T06:02:08.679 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:08.029+0000 7fbdcba00640 1 -- 172.21.15.3:0/446676352 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdc4107740 msgr2=0x7fbdc407db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:08.679 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:08.029+0000 7fbdcba00640 1 --2- 172.21.15.3:0/446676352 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdc4107740 0x7fbdc407db70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80097f0 tx=0x7fbdb8030ec0 comp rx=0 tx=0).stop 2024-09-19T06:02:08.679 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:08.029+0000 7fbdcba00640 1 -- 172.21.15.3:0/446676352 shutdown_connections 2024-09-19T06:02:08.679 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:08.029+0000 7fbdcba00640 1 --2- 172.21.15.3:0/446676352 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fbdac0391b0 0x7fbdac03b670 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:08.679 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:08.029+0000 7fbdcba00640 1 --2- 172.21.15.3:0/446676352 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdc4107740 0x7fbdc407db70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:08.679 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:08.029+0000 7fbdcba00640 1 -- 172.21.15.3:0/446676352 >> 172.21.15.3:0/446676352 conn(0x7fbdc4102ef0 msgr2=0x7fbdc4103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:08.679 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:08.029+0000 7fbdcba00640 1 -- 172.21.15.3:0/446676352 shutdown_connections 2024-09-19T06:02:08.679 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:08.029+0000 7fbdcba00640 1 -- 172.21.15.3:0/446676352 wait complete. 2024-09-19T06:02:08.679 INFO:teuthology.orchestra.run.smithi003.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T06:02:08.679 INFO:teuthology.orchestra.run.smithi003.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T06:02:08.683 INFO:teuthology.orchestra.run.smithi003.stdout:Adding host smithi003... 2024-09-19T06:02:10.571 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:10 smithi003 ceph-mon[30893]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi003", "addr": "172.21.15.3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:11.283 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:11 smithi003 ceph-mon[30893]: Deploying cephadm binary to smithi003 2024-09-19T06:02:14.618 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout Added host 'smithi003' with addr '172.21.15.3' 2024-09-19T06:02:14.618 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.193+0000 7f4110200640 1 Processor -- start 2024-09-19T06:02:14.618 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.193+0000 7f4110200640 1 -- start start 2024-09-19T06:02:14.618 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.194+0000 7f4110200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4108109960 0x7f4108109d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:14.618 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.194+0000 7f4110200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f410810a330 con 0x7f4108109960 2024-09-19T06:02:14.618 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.194+0000 7f410d800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4108109960 0x7f4108109d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:14.618 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.194+0000 7f410d800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4108109960 0x7f4108109d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54138/0 (socket says 172.21.15.3:54138) 2024-09-19T06:02:14.618 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.194+0000 7f410d800640 1 -- 172.21.15.3:0/2483576032 learned_addr learned my addr 172.21.15.3:0/2483576032 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:14.618 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.194+0000 7f410d800640 1 -- 172.21.15.3:0/2483576032 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f410810aad0 con 0x7f4108109960 2024-09-19T06:02:14.619 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.195+0000 7f410d800640 1 --2- 172.21.15.3:0/2483576032 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4108109960 0x7f4108109d60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f40fc009820 tx=0x7f40fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ec7f077b614ca6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:14.619 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.196+0000 7f4107e00640 1 -- 172.21.15.3:0/2483576032 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40fc037070 con 0x7f4108109960 2024-09-19T06:02:14.619 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.196+0000 7f4107e00640 1 -- 172.21.15.3:0/2483576032 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f40fc032900 con 0x7f4108109960 2024-09-19T06:02:14.619 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.196+0000 7f4107e00640 1 -- 172.21.15.3:0/2483576032 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40fc030850 con 0x7f4108109960 2024-09-19T06:02:14.619 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.196+0000 7f4110200640 1 -- 172.21.15.3:0/2483576032 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4108109960 msgr2=0x7f4108109d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:14.619 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.196+0000 7f4110200640 1 --2- 172.21.15.3:0/2483576032 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4108109960 0x7f4108109d60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f40fc009820 tx=0x7f40fc02a270 comp rx=0 tx=0).stop 2024-09-19T06:02:14.619 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.197+0000 7f4110200640 1 -- 172.21.15.3:0/2483576032 shutdown_connections 2024-09-19T06:02:14.619 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.197+0000 7f4110200640 1 --2- 172.21.15.3:0/2483576032 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4108109960 0x7f4108109d60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:14.619 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.197+0000 7f4110200640 1 -- 172.21.15.3:0/2483576032 >> 172.21.15.3:0/2483576032 conn(0x7f410807cf30 msgr2=0x7f410807d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:14.619 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.197+0000 7f4110200640 1 -- 172.21.15.3:0/2483576032 shutdown_connections 2024-09-19T06:02:14.619 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.197+0000 7f4110200640 1 -- 172.21.15.3:0/2483576032 wait complete. 2024-09-19T06:02:14.619 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.198+0000 7f4110200640 1 Processor -- start 2024-09-19T06:02:14.620 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.198+0000 7f4110200640 1 -- start start 2024-09-19T06:02:14.620 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.198+0000 7f4110200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4108109960 0x7f410819d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:14.620 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.198+0000 7f4110200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f410810de80 con 0x7f4108109960 2024-09-19T06:02:14.620 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.199+0000 7f410d800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4108109960 0x7f410819d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:14.620 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.199+0000 7f410d800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4108109960 0x7f410819d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54142/0 (socket says 172.21.15.3:54142) 2024-09-19T06:02:14.620 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.199+0000 7f410d800640 1 -- 172.21.15.3:0/594311041 learned_addr learned my addr 172.21.15.3:0/594311041 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:14.620 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.199+0000 7f410d800640 1 -- 172.21.15.3:0/594311041 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f410819de40 con 0x7f4108109960 2024-09-19T06:02:14.620 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.199+0000 7f410d800640 1 --2- 172.21.15.3:0/594311041 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4108109960 0x7f410819d900 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f40fc0097f0 tx=0x7f40fc030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:14.620 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.200+0000 7f4106000640 1 -- 172.21.15.3:0/594311041 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40fc042070 con 0x7f4108109960 2024-09-19T06:02:14.620 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.200+0000 7f4106000640 1 -- 172.21.15.3:0/594311041 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f40fc032ca0 con 0x7f4108109960 2024-09-19T06:02:14.620 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.200+0000 7f4110200640 1 -- 172.21.15.3:0/594311041 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f410819e0d0 con 0x7f4108109960 2024-09-19T06:02:14.620 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.200+0000 7f4106000640 1 -- 172.21.15.3:0/594311041 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40fc037040 con 0x7f4108109960 2024-09-19T06:02:14.621 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.200+0000 7f4110200640 1 -- 172.21.15.3:0/594311041 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41081a0dc0 con 0x7f4108109960 2024-09-19T06:02:14.621 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.201+0000 7f4106000640 1 -- 172.21.15.3:0/594311041 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f40fc045070 con 0x7f4108109960 2024-09-19T06:02:14.621 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.201+0000 7f4110200640 1 -- 172.21.15.3:0/594311041 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f410810e000 con 0x7f4108109960 2024-09-19T06:02:14.621 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.201+0000 7f4106000640 1 --2- 172.21.15.3:0/594311041 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f40f0039200 0x7f40f003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:14.621 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.201+0000 7f4106000640 1 -- 172.21.15.3:0/594311041 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f40fc06c290 con 0x7f4108109960 2024-09-19T06:02:14.621 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.202+0000 7f410ce00640 1 --2- 172.21.15.3:0/594311041 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f40f0039200 0x7f40f003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:14.621 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.202+0000 7f410ce00640 1 --2- 172.21.15.3:0/594311041 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f40f0039200 0x7f40f003b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f40f40098c0 tx=0x7f40f4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:14.621 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.211+0000 7f4106000640 1 -- 172.21.15.3:0/594311041 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f40fc04b170 con 0x7f4108109960 2024-09-19T06:02:14.621 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:09.402+0000 7f4110200640 1 -- 172.21.15.3:0/594311041 --> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi003", "addr": "172.21.15.3", "target": ["mon-mgr", ""]}) -- 0x7f4108107c20 con 0x7f40f0039200 2024-09-19T06:02:14.621 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:13.898+0000 7f4106000640 1 -- 172.21.15.3:0/594311041 <== mgr.14118 v2:172.21.15.3:6800/518259590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f4108107c20 con 0x7f40f0039200 2024-09-19T06:02:14.621 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:13.900+0000 7f4110200640 1 -- 172.21.15.3:0/594311041 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f40f0039200 msgr2=0x7f40f003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:14.622 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:13.900+0000 7f4110200640 1 --2- 172.21.15.3:0/594311041 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f40f0039200 0x7f40f003b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f40f40098c0 tx=0x7f40f4006db0 comp rx=0 tx=0).stop 2024-09-19T06:02:14.622 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:13.900+0000 7f4110200640 1 -- 172.21.15.3:0/594311041 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4108109960 msgr2=0x7f410819d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:14.622 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:13.900+0000 7f4110200640 1 --2- 172.21.15.3:0/594311041 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4108109960 0x7f410819d900 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f40fc0097f0 tx=0x7f40fc030ec0 comp rx=0 tx=0).stop 2024-09-19T06:02:14.622 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:13.901+0000 7f4110200640 1 -- 172.21.15.3:0/594311041 shutdown_connections 2024-09-19T06:02:14.622 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:13.901+0000 7f4110200640 1 --2- 172.21.15.3:0/594311041 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f40f0039200 0x7f40f003b6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:14.622 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:13.901+0000 7f4110200640 1 --2- 172.21.15.3:0/594311041 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4108109960 0x7f410819d900 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:14.622 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:13.901+0000 7f4110200640 1 -- 172.21.15.3:0/594311041 >> 172.21.15.3:0/594311041 conn(0x7f410807cf30 msgr2=0x7f4108107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:14.622 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:13.901+0000 7f4110200640 1 -- 172.21.15.3:0/594311041 shutdown_connections 2024-09-19T06:02:14.622 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:13.901+0000 7f4110200640 1 -- 172.21.15.3:0/594311041 wait complete. 2024-09-19T06:02:14.622 INFO:teuthology.orchestra.run.smithi003.stdout:Deploying unmanaged mon service... 2024-09-19T06:02:15.210 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:14 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' 2024-09-19T06:02:15.211 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:14 smithi003 ceph-mon[30893]: Added host smithi003 2024-09-19T06:02:15.211 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:14 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:16.402 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T06:02:16.402 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.320+0000 7fca27000640 1 Processor -- start 2024-09-19T06:02:16.402 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.321+0000 7fca27000640 1 -- start start 2024-09-19T06:02:16.403 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.321+0000 7fca27000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca2007de70 0x7fca2007c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:16.403 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.321+0000 7fca27000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fca2007c8f0 con 0x7fca2007de70 2024-09-19T06:02:16.403 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.321+0000 7fca1fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca2007de70 0x7fca2007c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:16.403 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.322+0000 7fca1fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca2007de70 0x7fca2007c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53800/0 (socket says 172.21.15.3:53800) 2024-09-19T06:02:16.403 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.322+0000 7fca1fe00640 1 -- 172.21.15.3:0/2223954001 learned_addr learned my addr 172.21.15.3:0/2223954001 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:16.403 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.322+0000 7fca1fe00640 1 -- 172.21.15.3:0/2223954001 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2007ca70 con 0x7fca2007de70 2024-09-19T06:02:16.403 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.323+0000 7fca1fe00640 1 --2- 172.21.15.3:0/2223954001 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca2007de70 0x7fca2007c320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fca10009820 tx=0x7fca1002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4075d895efe6646e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:16.403 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.323+0000 7fca1f400640 1 -- 172.21.15.3:0/2223954001 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca10037070 con 0x7fca2007de70 2024-09-19T06:02:16.403 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.323+0000 7fca1f400640 1 -- 172.21.15.3:0/2223954001 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fca10032900 con 0x7fca2007de70 2024-09-19T06:02:16.403 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.323+0000 7fca1f400640 1 -- 172.21.15.3:0/2223954001 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca10030850 con 0x7fca2007de70 2024-09-19T06:02:16.403 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.324+0000 7fca27000640 1 -- 172.21.15.3:0/2223954001 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca2007de70 msgr2=0x7fca2007c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:16.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.324+0000 7fca27000640 1 --2- 172.21.15.3:0/2223954001 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca2007de70 0x7fca2007c320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fca10009820 tx=0x7fca1002a270 comp rx=0 tx=0).stop 2024-09-19T06:02:16.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.324+0000 7fca27000640 1 -- 172.21.15.3:0/2223954001 shutdown_connections 2024-09-19T06:02:16.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.324+0000 7fca27000640 1 --2- 172.21.15.3:0/2223954001 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca2007de70 0x7fca2007c320 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:16.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.324+0000 7fca27000640 1 -- 172.21.15.3:0/2223954001 >> 172.21.15.3:0/2223954001 conn(0x7fca20102ef0 msgr2=0x7fca20105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:16.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.324+0000 7fca27000640 1 -- 172.21.15.3:0/2223954001 shutdown_connections 2024-09-19T06:02:16.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.324+0000 7fca27000640 1 -- 172.21.15.3:0/2223954001 wait complete. 2024-09-19T06:02:16.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.325+0000 7fca27000640 1 Processor -- start 2024-09-19T06:02:16.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.325+0000 7fca27000640 1 -- start start 2024-09-19T06:02:16.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.325+0000 7fca27000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca2007de70 0x7fca2019d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:16.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.325+0000 7fca27000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fca2010dd30 con 0x7fca2007de70 2024-09-19T06:02:16.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.325+0000 7fca1fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca2007de70 0x7fca2019d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:16.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.325+0000 7fca1fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca2007de70 0x7fca2019d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53806/0 (socket says 172.21.15.3:53806) 2024-09-19T06:02:16.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.325+0000 7fca1fe00640 1 -- 172.21.15.3:0/4163769611 learned_addr learned my addr 172.21.15.3:0/4163769611 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:16.405 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.326+0000 7fca1fe00640 1 -- 172.21.15.3:0/4163769611 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2019de40 con 0x7fca2007de70 2024-09-19T06:02:16.405 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.326+0000 7fca1fe00640 1 --2- 172.21.15.3:0/4163769611 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca2007de70 0x7fca2019d900 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fca10031000 tx=0x7fca100326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:16.405 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.326+0000 7fca1d600640 1 -- 172.21.15.3:0/4163769611 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca10042070 con 0x7fca2007de70 2024-09-19T06:02:16.405 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.326+0000 7fca1d600640 1 -- 172.21.15.3:0/4163769611 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fca10032be0 con 0x7fca2007de70 2024-09-19T06:02:16.405 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.326+0000 7fca27000640 1 -- 172.21.15.3:0/4163769611 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca2019e0d0 con 0x7fca2007de70 2024-09-19T06:02:16.405 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.326+0000 7fca1d600640 1 -- 172.21.15.3:0/4163769611 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca10037040 con 0x7fca2007de70 2024-09-19T06:02:16.405 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.327+0000 7fca27000640 1 -- 172.21.15.3:0/4163769611 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca201a0dc0 con 0x7fca2007de70 2024-09-19T06:02:16.405 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.328+0000 7fca1d600640 1 -- 172.21.15.3:0/4163769611 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fca10045070 con 0x7fca2007de70 2024-09-19T06:02:16.405 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.327+0000 7fca27000640 1 -- 172.21.15.3:0/4163769611 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca2007c3a0 con 0x7fca2007de70 2024-09-19T06:02:16.405 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.328+0000 7fca1d600640 1 --2- 172.21.15.3:0/4163769611 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fca04039200 0x7fca0403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:16.405 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.328+0000 7fca1d600640 1 -- 172.21.15.3:0/4163769611 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fca1006c310 con 0x7fca2007de70 2024-09-19T06:02:16.406 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.328+0000 7fca17e00640 1 --2- 172.21.15.3:0/4163769611 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fca04039200 0x7fca0403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:16.406 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.329+0000 7fca17e00640 1 --2- 172.21.15.3:0/4163769611 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fca04039200 0x7fca0403b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fca080098c0 tx=0x7fca08006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:16.406 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.333+0000 7fca1d600640 1 -- 172.21.15.3:0/4163769611 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fca1002f2a0 con 0x7fca2007de70 2024-09-19T06:02:16.406 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.548+0000 7fca27000640 1 -- 172.21.15.3:0/4163769611 --> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fca20104190 con 0x7fca04039200 2024-09-19T06:02:16.406 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.554+0000 7fca1d600640 1 -- 172.21.15.3:0/4163769611 <== mgr.14118 v2:172.21.15.3:6800/518259590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fca20104190 con 0x7fca04039200 2024-09-19T06:02:16.406 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.556+0000 7fca27000640 1 -- 172.21.15.3:0/4163769611 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fca04039200 msgr2=0x7fca0403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:16.406 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.556+0000 7fca27000640 1 --2- 172.21.15.3:0/4163769611 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fca04039200 0x7fca0403b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fca080098c0 tx=0x7fca08006db0 comp rx=0 tx=0).stop 2024-09-19T06:02:16.406 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.556+0000 7fca27000640 1 -- 172.21.15.3:0/4163769611 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca2007de70 msgr2=0x7fca2019d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:16.406 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.556+0000 7fca27000640 1 --2- 172.21.15.3:0/4163769611 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca2007de70 0x7fca2019d900 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fca10031000 tx=0x7fca100326e0 comp rx=0 tx=0).stop 2024-09-19T06:02:16.406 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.556+0000 7fca27000640 1 -- 172.21.15.3:0/4163769611 shutdown_connections 2024-09-19T06:02:16.406 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.556+0000 7fca27000640 1 --2- 172.21.15.3:0/4163769611 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fca04039200 0x7fca0403b6c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:16.406 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.556+0000 7fca27000640 1 --2- 172.21.15.3:0/4163769611 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fca2007de70 0x7fca2019d900 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:16.407 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.556+0000 7fca27000640 1 -- 172.21.15.3:0/4163769611 >> 172.21.15.3:0/4163769611 conn(0x7fca20102ef0 msgr2=0x7fca20103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:16.407 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.556+0000 7fca27000640 1 -- 172.21.15.3:0/4163769611 shutdown_connections 2024-09-19T06:02:16.407 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:15.556+0000 7fca27000640 1 -- 172.21.15.3:0/4163769611 wait complete. 2024-09-19T06:02:16.407 INFO:teuthology.orchestra.run.smithi003.stdout:Deploying unmanaged mgr service... 2024-09-19T06:02:16.656 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:16 smithi003 ceph-mon[30893]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:16.656 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:16 smithi003 ceph-mon[30893]: Saving service mon spec with placement count:5 2024-09-19T06:02:16.656 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:16 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' 2024-09-19T06:02:18.762 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:18 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' 2024-09-19T06:02:18.762 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:18 smithi003 ceph-mon[30893]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:18.762 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:18 smithi003 ceph-mon[30893]: Saving service mgr spec with placement count:2 2024-09-19T06:02:18.762 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:18 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' 2024-09-19T06:02:18.762 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:18 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' 2024-09-19T06:02:18.772 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T06:02:18.772 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.789+0000 7f7f5ca00640 1 Processor -- start 2024-09-19T06:02:18.772 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.789+0000 7f7f5ca00640 1 -- start start 2024-09-19T06:02:18.772 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.789+0000 7f7f5ca00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f581075c0 0x7f7f581079c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:18.772 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.789+0000 7f7f5ca00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7f58107f90 con 0x7f7f581075c0 2024-09-19T06:02:18.772 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.790+0000 7f7f57400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f581075c0 0x7f7f581079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:18.772 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.790+0000 7f7f57400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f581075c0 0x7f7f581079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53816/0 (socket says 172.21.15.3:53816) 2024-09-19T06:02:18.772 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.790+0000 7f7f57400640 1 -- 172.21.15.3:0/4232433391 learned_addr learned my addr 172.21.15.3:0/4232433391 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:18.772 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.790+0000 7f7f57400640 1 -- 172.21.15.3:0/4232433391 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f58108720 con 0x7f7f581075c0 2024-09-19T06:02:18.773 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.791+0000 7f7f57400640 1 --2- 172.21.15.3:0/4232433391 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f581075c0 0x7f7f581079c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7f48009820 tx=0x7f7f4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d31fdc4ed4f584e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:18.773 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.791+0000 7f7f56000640 1 -- 172.21.15.3:0/4232433391 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f48037070 con 0x7f7f581075c0 2024-09-19T06:02:18.773 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.791+0000 7f7f56000640 1 -- 172.21.15.3:0/4232433391 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f48032920 con 0x7f7f581075c0 2024-09-19T06:02:18.773 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.791+0000 7f7f56000640 1 -- 172.21.15.3:0/4232433391 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f48030810 con 0x7f7f581075c0 2024-09-19T06:02:18.773 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.792+0000 7f7f5ca00640 1 -- 172.21.15.3:0/4232433391 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f581075c0 msgr2=0x7f7f581079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:18.773 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.792+0000 7f7f5ca00640 1 --2- 172.21.15.3:0/4232433391 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f581075c0 0x7f7f581079c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7f48009820 tx=0x7f7f4802a270 comp rx=0 tx=0).stop 2024-09-19T06:02:18.773 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.792+0000 7f7f5ca00640 1 -- 172.21.15.3:0/4232433391 shutdown_connections 2024-09-19T06:02:18.773 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.792+0000 7f7f5ca00640 1 --2- 172.21.15.3:0/4232433391 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f581075c0 0x7f7f581079c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:18.773 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.792+0000 7f7f5ca00640 1 -- 172.21.15.3:0/4232433391 >> 172.21.15.3:0/4232433391 conn(0x7f7f58102d90 msgr2=0x7f7f581051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:18.773 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.792+0000 7f7f5ca00640 1 -- 172.21.15.3:0/4232433391 shutdown_connections 2024-09-19T06:02:18.773 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.792+0000 7f7f5ca00640 1 -- 172.21.15.3:0/4232433391 wait complete. 2024-09-19T06:02:18.773 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.793+0000 7f7f5ca00640 1 Processor -- start 2024-09-19T06:02:18.773 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.793+0000 7f7f5ca00640 1 -- start start 2024-09-19T06:02:18.774 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.794+0000 7f7f5ca00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f581075c0 0x7f7f5819b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:18.774 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.794+0000 7f7f5ca00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5810bad0 con 0x7f7f581075c0 2024-09-19T06:02:18.774 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.794+0000 7f7f57400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f581075c0 0x7f7f5819b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:18.774 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.794+0000 7f7f57400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f581075c0 0x7f7f5819b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53822/0 (socket says 172.21.15.3:53822) 2024-09-19T06:02:18.774 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.794+0000 7f7f57400640 1 -- 172.21.15.3:0/1592342414 learned_addr learned my addr 172.21.15.3:0/1592342414 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:18.774 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.794+0000 7f7f57400640 1 -- 172.21.15.3:0/1592342414 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5819bb00 con 0x7f7f581075c0 2024-09-19T06:02:18.774 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.795+0000 7f7f57400640 1 --2- 172.21.15.3:0/1592342414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f581075c0 0x7f7f5819b5c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7f480097f0 tx=0x7f7f480327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:18.774 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.795+0000 7f7f4fe00640 1 -- 172.21.15.3:0/1592342414 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f48037040 con 0x7f7f581075c0 2024-09-19T06:02:18.774 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.795+0000 7f7f4fe00640 1 -- 172.21.15.3:0/1592342414 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f48030cc0 con 0x7f7f581075c0 2024-09-19T06:02:18.774 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.795+0000 7f7f5ca00640 1 -- 172.21.15.3:0/1592342414 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f5819bd90 con 0x7f7f581075c0 2024-09-19T06:02:18.774 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.795+0000 7f7f4fe00640 1 -- 172.21.15.3:0/1592342414 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f4803a640 con 0x7f7f581075c0 2024-09-19T06:02:18.774 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.795+0000 7f7f5ca00640 1 -- 172.21.15.3:0/1592342414 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f5819ea80 con 0x7f7f581075c0 2024-09-19T06:02:18.774 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.796+0000 7f7f4fe00640 1 -- 172.21.15.3:0/1592342414 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f7f4803b3f0 con 0x7f7f581075c0 2024-09-19T06:02:18.774 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.796+0000 7f7f5ca00640 1 -- 172.21.15.3:0/1592342414 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f5810bc50 con 0x7f7f581075c0 2024-09-19T06:02:18.775 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.797+0000 7f7f4fe00640 1 --2- 172.21.15.3:0/1592342414 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f7f3c0391b0 0x7f7f3c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:18.775 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.797+0000 7f7f4fe00640 1 -- 172.21.15.3:0/1592342414 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7f4806c7d0 con 0x7f7f581075c0 2024-09-19T06:02:18.775 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.797+0000 7f7f56a00640 1 --2- 172.21.15.3:0/1592342414 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f7f3c0391b0 0x7f7f3c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:18.775 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.798+0000 7f7f56a00640 1 --2- 172.21.15.3:0/1592342414 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f7f3c0391b0 0x7f7f3c03b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7f440098c0 tx=0x7f7f44006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:18.775 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:17.806+0000 7f7f4fe00640 1 -- 172.21.15.3:0/1592342414 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7f480328c0 con 0x7f7f581075c0 2024-09-19T06:02:18.775 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:18.017+0000 7f7f5ca00640 1 -- 172.21.15.3:0/1592342414 --> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f7f58104010 con 0x7f7f3c0391b0 2024-09-19T06:02:18.775 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:18.023+0000 7f7f4fe00640 1 -- 172.21.15.3:0/1592342414 <== mgr.14118 v2:172.21.15.3:6800/518259590 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f7f58104010 con 0x7f7f3c0391b0 2024-09-19T06:02:18.775 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:18.025+0000 7f7f5ca00640 1 -- 172.21.15.3:0/1592342414 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f7f3c0391b0 msgr2=0x7f7f3c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:18.775 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:18.025+0000 7f7f5ca00640 1 --2- 172.21.15.3:0/1592342414 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f7f3c0391b0 0x7f7f3c03b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7f440098c0 tx=0x7f7f44006db0 comp rx=0 tx=0).stop 2024-09-19T06:02:18.775 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:18.025+0000 7f7f5ca00640 1 -- 172.21.15.3:0/1592342414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f581075c0 msgr2=0x7f7f5819b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:18.775 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:18.025+0000 7f7f5ca00640 1 --2- 172.21.15.3:0/1592342414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f581075c0 0x7f7f5819b5c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7f480097f0 tx=0x7f7f480327b0 comp rx=0 tx=0).stop 2024-09-19T06:02:18.775 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:18.025+0000 7f7f5ca00640 1 -- 172.21.15.3:0/1592342414 shutdown_connections 2024-09-19T06:02:18.776 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:18.025+0000 7f7f5ca00640 1 --2- 172.21.15.3:0/1592342414 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f7f3c0391b0 0x7f7f3c03b670 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:18.776 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:18.025+0000 7f7f5ca00640 1 --2- 172.21.15.3:0/1592342414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f581075c0 0x7f7f5819b5c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:18.776 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:18.025+0000 7f7f5ca00640 1 -- 172.21.15.3:0/1592342414 >> 172.21.15.3:0/1592342414 conn(0x7f7f58102d90 msgr2=0x7f7f58103900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:18.776 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:18.025+0000 7f7f5ca00640 1 -- 172.21.15.3:0/1592342414 shutdown_connections 2024-09-19T06:02:18.776 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:18.025+0000 7f7f5ca00640 1 -- 172.21.15.3:0/1592342414 wait complete. 2024-09-19T06:02:20.788 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:20 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3670394349' entity='client.admin' 2024-09-19T06:02:20.797 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.279+0000 7fbb4c200640 1 Processor -- start 2024-09-19T06:02:20.797 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.279+0000 7fbb4c200640 1 -- start start 2024-09-19T06:02:20.797 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.279+0000 7fbb4c200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb44107720 0x7fbb44107b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:20.797 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.279+0000 7fbb4c200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbb441080f0 con 0x7fbb44107720 2024-09-19T06:02:20.797 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.279+0000 7fbb49800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb44107720 0x7fbb44107b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:20.797 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.280+0000 7fbb49800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb44107720 0x7fbb44107b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53836/0 (socket says 172.21.15.3:53836) 2024-09-19T06:02:20.797 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.280+0000 7fbb49800640 1 -- 172.21.15.3:0/1476091862 learned_addr learned my addr 172.21.15.3:0/1476091862 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:20.797 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.280+0000 7fbb49800640 1 -- 172.21.15.3:0/1476091862 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb441088d0 con 0x7fbb44107720 2024-09-19T06:02:20.797 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.281+0000 7fbb49800640 1 --2- 172.21.15.3:0/1476091862 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb44107720 0x7fbb44107b20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009820 tx=0x7fbb3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a1a9e6a8b152a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:20.797 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.281+0000 7fbb43e00640 1 -- 172.21.15.3:0/1476091862 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb38037070 con 0x7fbb44107720 2024-09-19T06:02:20.798 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.281+0000 7fbb43e00640 1 -- 172.21.15.3:0/1476091862 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb38032920 con 0x7fbb44107720 2024-09-19T06:02:20.798 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.281+0000 7fbb43e00640 1 -- 172.21.15.3:0/1476091862 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb38030810 con 0x7fbb44107720 2024-09-19T06:02:20.798 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.282+0000 7fbb4c200640 1 -- 172.21.15.3:0/1476091862 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb44107720 msgr2=0x7fbb44107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:20.798 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.282+0000 7fbb4c200640 1 --2- 172.21.15.3:0/1476091862 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb44107720 0x7fbb44107b20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbb38009820 tx=0x7fbb3802a270 comp rx=0 tx=0).stop 2024-09-19T06:02:20.798 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.282+0000 7fbb4c200640 1 -- 172.21.15.3:0/1476091862 shutdown_connections 2024-09-19T06:02:20.798 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.282+0000 7fbb4c200640 1 --2- 172.21.15.3:0/1476091862 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb44107720 0x7fbb44107b20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:20.798 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.282+0000 7fbb4c200640 1 -- 172.21.15.3:0/1476091862 >> 172.21.15.3:0/1476091862 conn(0x7fbb44102ef0 msgr2=0x7fbb44105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:20.798 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.282+0000 7fbb4c200640 1 -- 172.21.15.3:0/1476091862 shutdown_connections 2024-09-19T06:02:20.798 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.282+0000 7fbb4c200640 1 -- 172.21.15.3:0/1476091862 wait complete. 2024-09-19T06:02:20.798 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.283+0000 7fbb4c200640 1 Processor -- start 2024-09-19T06:02:20.798 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.283+0000 7fbb4c200640 1 -- start start 2024-09-19T06:02:20.798 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.284+0000 7fbb4c200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb44107720 0x7fbb4407db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:20.798 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.284+0000 7fbb4c200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4410bc80 con 0x7fbb44107720 2024-09-19T06:02:20.799 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.284+0000 7fbb49800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb44107720 0x7fbb4407db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:20.799 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.284+0000 7fbb49800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb44107720 0x7fbb4407db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53840/0 (socket says 172.21.15.3:53840) 2024-09-19T06:02:20.799 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.284+0000 7fbb49800640 1 -- 172.21.15.3:0/3670394349 learned_addr learned my addr 172.21.15.3:0/3670394349 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:20.799 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.284+0000 7fbb49800640 1 -- 172.21.15.3:0/3670394349 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4407e0b0 con 0x7fbb44107720 2024-09-19T06:02:20.799 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.285+0000 7fbb49800640 1 --2- 172.21.15.3:0/3670394349 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb44107720 0x7fbb4407db70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbb380097f0 tx=0x7fbb380327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:20.799 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.285+0000 7fbb42000640 1 -- 172.21.15.3:0/3670394349 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb38037040 con 0x7fbb44107720 2024-09-19T06:02:20.799 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.285+0000 7fbb42000640 1 -- 172.21.15.3:0/3670394349 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb38030cc0 con 0x7fbb44107720 2024-09-19T06:02:20.799 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.285+0000 7fbb4c200640 1 -- 172.21.15.3:0/3670394349 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb4407c2a0 con 0x7fbb44107720 2024-09-19T06:02:20.799 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.285+0000 7fbb42000640 1 -- 172.21.15.3:0/3670394349 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb3803a640 con 0x7fbb44107720 2024-09-19T06:02:20.799 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.285+0000 7fbb4c200640 1 -- 172.21.15.3:0/3670394349 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb4407c7e0 con 0x7fbb44107720 2024-09-19T06:02:20.799 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.286+0000 7fbb42000640 1 -- 172.21.15.3:0/3670394349 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fbb3803b3f0 con 0x7fbb44107720 2024-09-19T06:02:20.799 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.286+0000 7fbb4c200640 1 -- 172.21.15.3:0/3670394349 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb44107ba0 con 0x7fbb44107720 2024-09-19T06:02:20.799 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.287+0000 7fbb42000640 1 --2- 172.21.15.3:0/3670394349 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fbb2c0391b0 0x7fbb2c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:20.800 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.287+0000 7fbb42000640 1 -- 172.21.15.3:0/3670394349 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbb3806c890 con 0x7fbb44107720 2024-09-19T06:02:20.800 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.287+0000 7fbb48e00640 1 --2- 172.21.15.3:0/3670394349 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fbb2c0391b0 0x7fbb2c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:20.800 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.288+0000 7fbb48e00640 1 --2- 172.21.15.3:0/3670394349 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fbb2c0391b0 0x7fbb2c03b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbb300098c0 tx=0x7fbb30006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:20.800 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.292+0000 7fbb42000640 1 -- 172.21.15.3:0/3670394349 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbb380328c0 con 0x7fbb44107720 2024-09-19T06:02:20.800 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.487+0000 7fbb4c200640 1 -- 172.21.15.3:0/3670394349 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fbb4407d080 con 0x7fbb44107720 2024-09-19T06:02:20.800 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.489+0000 7fbb42000640 1 -- 172.21.15.3:0/3670394349 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fbb38042dc0 con 0x7fbb44107720 2024-09-19T06:02:20.800 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.492+0000 7fbb4c200640 1 -- 172.21.15.3:0/3670394349 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fbb2c0391b0 msgr2=0x7fbb2c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:20.800 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.492+0000 7fbb4c200640 1 --2- 172.21.15.3:0/3670394349 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fbb2c0391b0 0x7fbb2c03b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbb300098c0 tx=0x7fbb30006db0 comp rx=0 tx=0).stop 2024-09-19T06:02:20.800 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.492+0000 7fbb4c200640 1 -- 172.21.15.3:0/3670394349 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb44107720 msgr2=0x7fbb4407db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:20.800 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.492+0000 7fbb4c200640 1 --2- 172.21.15.3:0/3670394349 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb44107720 0x7fbb4407db70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbb380097f0 tx=0x7fbb380327b0 comp rx=0 tx=0).stop 2024-09-19T06:02:20.800 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.492+0000 7fbb4c200640 1 -- 172.21.15.3:0/3670394349 shutdown_connections 2024-09-19T06:02:20.801 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.492+0000 7fbb4c200640 1 --2- 172.21.15.3:0/3670394349 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fbb2c0391b0 0x7fbb2c03b670 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:20.801 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.492+0000 7fbb4c200640 1 --2- 172.21.15.3:0/3670394349 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb44107720 0x7fbb4407db70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:20.801 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.492+0000 7fbb4c200640 1 -- 172.21.15.3:0/3670394349 >> 172.21.15.3:0/3670394349 conn(0x7fbb44102ef0 msgr2=0x7fbb44103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:20.801 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.492+0000 7fbb4c200640 1 -- 172.21.15.3:0/3670394349 shutdown_connections 2024-09-19T06:02:20.801 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:19.492+0000 7fbb4c200640 1 -- 172.21.15.3:0/3670394349 wait complete. 2024-09-19T06:02:22.036 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:21 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' 2024-09-19T06:02:22.037 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:21 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1307987723' entity='client.admin' 2024-09-19T06:02:22.374 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.423+0000 7fde87e00640 1 Processor -- start 2024-09-19T06:02:22.374 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.423+0000 7fde87e00640 1 -- start start 2024-09-19T06:02:22.374 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.423+0000 7fde87e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde88109870 0x7fde88109c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:22.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.423+0000 7fde87e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fde8810a260 con 0x7fde88109870 2024-09-19T06:02:22.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.423+0000 7fde86a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde88109870 0x7fde88109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:22.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.423+0000 7fde86a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde88109870 0x7fde88109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53848/0 (socket says 172.21.15.3:53848) 2024-09-19T06:02:22.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.424+0000 7fde86a00640 1 -- 172.21.15.3:0/1258177704 learned_addr learned my addr 172.21.15.3:0/1258177704 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:22.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.424+0000 7fde86a00640 1 -- 172.21.15.3:0/1258177704 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8810a930 con 0x7fde88109870 2024-09-19T06:02:22.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.425+0000 7fde86a00640 1 --2- 172.21.15.3:0/1258177704 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde88109870 0x7fde88109c90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fde78009820 tx=0x7fde7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e064c34a6d2efd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:22.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.425+0000 7fde85600640 1 -- 172.21.15.3:0/1258177704 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde78037070 con 0x7fde88109870 2024-09-19T06:02:22.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.425+0000 7fde85600640 1 -- 172.21.15.3:0/1258177704 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde78032920 con 0x7fde88109870 2024-09-19T06:02:22.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.425+0000 7fde85600640 1 -- 172.21.15.3:0/1258177704 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde78030810 con 0x7fde88109870 2024-09-19T06:02:22.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.426+0000 7fde87e00640 1 -- 172.21.15.3:0/1258177704 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde88109870 msgr2=0x7fde88109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:22.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.426+0000 7fde87e00640 1 --2- 172.21.15.3:0/1258177704 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde88109870 0x7fde88109c90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fde78009820 tx=0x7fde7802a270 comp rx=0 tx=0).stop 2024-09-19T06:02:22.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.426+0000 7fde87e00640 1 -- 172.21.15.3:0/1258177704 shutdown_connections 2024-09-19T06:02:22.375 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.426+0000 7fde87e00640 1 --2- 172.21.15.3:0/1258177704 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde88109870 0x7fde88109c90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:22.376 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.426+0000 7fde87e00640 1 -- 172.21.15.3:0/1258177704 >> 172.21.15.3:0/1258177704 conn(0x7fde8807ce50 msgr2=0x7fde8807d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:22.376 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.426+0000 7fde87e00640 1 -- 172.21.15.3:0/1258177704 shutdown_connections 2024-09-19T06:02:22.376 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.426+0000 7fde87e00640 1 -- 172.21.15.3:0/1258177704 wait complete. 2024-09-19T06:02:22.376 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.427+0000 7fde87e00640 1 Processor -- start 2024-09-19T06:02:22.376 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.427+0000 7fde87e00640 1 -- start start 2024-09-19T06:02:22.376 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.427+0000 7fde87e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde88109870 0x7fde8819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:22.376 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.427+0000 7fde87e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fde8810dce0 con 0x7fde88109870 2024-09-19T06:02:22.376 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.428+0000 7fde86a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde88109870 0x7fde8819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:22.376 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.428+0000 7fde86a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde88109870 0x7fde8819d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53852/0 (socket says 172.21.15.3:53852) 2024-09-19T06:02:22.376 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.428+0000 7fde86a00640 1 -- 172.21.15.3:0/1307987723 learned_addr learned my addr 172.21.15.3:0/1307987723 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:22.376 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.428+0000 7fde86a00640 1 -- 172.21.15.3:0/1307987723 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8819dc00 con 0x7fde88109870 2024-09-19T06:02:22.376 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.428+0000 7fde86a00640 1 --2- 172.21.15.3:0/1307987723 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde88109870 0x7fde8819d6c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fde780097f0 tx=0x7fde780327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:22.376 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.429+0000 7fde7f400640 1 -- 172.21.15.3:0/1307987723 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde78037040 con 0x7fde88109870 2024-09-19T06:02:22.377 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.429+0000 7fde7f400640 1 -- 172.21.15.3:0/1307987723 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde78030cc0 con 0x7fde88109870 2024-09-19T06:02:22.377 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.429+0000 7fde87e00640 1 -- 172.21.15.3:0/1307987723 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde8819de90 con 0x7fde88109870 2024-09-19T06:02:22.377 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.429+0000 7fde7f400640 1 -- 172.21.15.3:0/1307987723 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde7803a6b0 con 0x7fde88109870 2024-09-19T06:02:22.377 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.429+0000 7fde87e00640 1 -- 172.21.15.3:0/1307987723 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde881a0b80 con 0x7fde88109870 2024-09-19T06:02:22.377 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.430+0000 7fde7f400640 1 -- 172.21.15.3:0/1307987723 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fde7803baf0 con 0x7fde88109870 2024-09-19T06:02:22.377 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.430+0000 7fde87e00640 1 -- 172.21.15.3:0/1307987723 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde88109c90 con 0x7fde88109870 2024-09-19T06:02:22.377 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.430+0000 7fde7f400640 1 --2- 172.21.15.3:0/1307987723 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fde6c039200 0x7fde6c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:22.377 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.430+0000 7fde7f400640 1 -- 172.21.15.3:0/1307987723 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fde7806c870 con 0x7fde88109870 2024-09-19T06:02:22.377 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.430+0000 7fde86000640 1 --2- 172.21.15.3:0/1307987723 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fde6c039200 0x7fde6c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:22.377 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.431+0000 7fde86000640 1 --2- 172.21.15.3:0/1307987723 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fde6c039200 0x7fde6c03b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fde740098c0 tx=0x7fde74006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:22.377 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.436+0000 7fde7f400640 1 -- 172.21.15.3:0/1307987723 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fde780371e0 con 0x7fde88109870 2024-09-19T06:02:22.377 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.634+0000 7fde87e00640 1 -- 172.21.15.3:0/1307987723 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fde881a0d50 con 0x7fde88109870 2024-09-19T06:02:22.378 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.637+0000 7fde7f400640 1 -- 172.21.15.3:0/1307987723 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fde7806c1c0 con 0x7fde88109870 2024-09-19T06:02:22.378 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.640+0000 7fde87e00640 1 -- 172.21.15.3:0/1307987723 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fde6c039200 msgr2=0x7fde6c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:22.378 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.640+0000 7fde87e00640 1 --2- 172.21.15.3:0/1307987723 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fde6c039200 0x7fde6c03b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fde740098c0 tx=0x7fde74006db0 comp rx=0 tx=0).stop 2024-09-19T06:02:22.378 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.640+0000 7fde87e00640 1 -- 172.21.15.3:0/1307987723 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde88109870 msgr2=0x7fde8819d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:22.378 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.640+0000 7fde87e00640 1 --2- 172.21.15.3:0/1307987723 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde88109870 0x7fde8819d6c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fde780097f0 tx=0x7fde780327b0 comp rx=0 tx=0).stop 2024-09-19T06:02:22.378 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.641+0000 7fde87e00640 1 -- 172.21.15.3:0/1307987723 shutdown_connections 2024-09-19T06:02:22.378 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.641+0000 7fde87e00640 1 --2- 172.21.15.3:0/1307987723 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fde6c039200 0x7fde6c03b6c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:22.378 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.641+0000 7fde87e00640 1 --2- 172.21.15.3:0/1307987723 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde88109870 0x7fde8819d6c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:22.378 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.641+0000 7fde87e00640 1 -- 172.21.15.3:0/1307987723 >> 172.21.15.3:0/1307987723 conn(0x7fde8807ce50 msgr2=0x7fde88107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:22.378 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.641+0000 7fde87e00640 1 -- 172.21.15.3:0/1307987723 shutdown_connections 2024-09-19T06:02:22.378 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:21.641+0000 7fde87e00640 1 -- 172.21.15.3:0/1307987723 wait complete. 2024-09-19T06:02:22.378 INFO:teuthology.orchestra.run.smithi003.stdout:Enabling the dashboard module... 2024-09-19T06:02:22.931 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:22 smithi003 ceph-mon[30893]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:02:22.931 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:22 smithi003 ceph-mon[30893]: from='mgr.14118 172.21.15.3:0/244483016' entity='mgr.x' 2024-09-19T06:02:24.151 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:23 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2045425554' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T06:02:24.151 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: ignoring --setuser ceph since I am not root 2024-09-19T06:02:24.151 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: ignoring --setgroup ceph since I am not root 2024-09-19T06:02:24.151 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:24.148+0000 7fe6c35dc040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:02:24.419 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:24.222+0000 7fe6c35dc040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:02:24.688 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:24.416+0000 7fe6c35dc040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:02:24.688 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:24.504+0000 7fe6c35dc040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:02:24.689 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:24.686+0000 7fe6c35dc040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:02:24.939 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.937+0000 7f258d000640 1 Processor -- start 2024-09-19T06:02:24.939 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.937+0000 7f258d000640 1 -- start start 2024-09-19T06:02:24.939 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.937+0000 7f258d000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f258807de70 0x7f258807c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:24.939 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.937+0000 7f258d000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f258807c8f0 con 0x7f258807de70 2024-09-19T06:02:24.939 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.938+0000 7f2585e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f258807de70 0x7f258807c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:24.939 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.938+0000 7f2585e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f258807de70 0x7f258807c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53868/0 (socket says 172.21.15.3:53868) 2024-09-19T06:02:24.939 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.938+0000 7f2585e00640 1 -- 172.21.15.3:0/597626980 learned_addr learned my addr 172.21.15.3:0/597626980 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:24.939 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.938+0000 7f2585e00640 1 -- 172.21.15.3:0/597626980 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258807ca70 con 0x7f258807de70 2024-09-19T06:02:24.939 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.939+0000 7f2585e00640 1 --2- 172.21.15.3:0/597626980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f258807de70 0x7f258807c320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2578009820 tx=0x7f257802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5f871c69c47acc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:24.939 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.940+0000 7f2584a00640 1 -- 172.21.15.3:0/597626980 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2578037070 con 0x7f258807de70 2024-09-19T06:02:24.939 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.940+0000 7f2584a00640 1 -- 172.21.15.3:0/597626980 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2578032920 con 0x7f258807de70 2024-09-19T06:02:24.940 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.940+0000 7f2584a00640 1 -- 172.21.15.3:0/597626980 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2578030810 con 0x7f258807de70 2024-09-19T06:02:24.940 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.940+0000 7f258d000640 1 -- 172.21.15.3:0/597626980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f258807de70 msgr2=0x7f258807c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:24.940 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.940+0000 7f258d000640 1 --2- 172.21.15.3:0/597626980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f258807de70 0x7f258807c320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2578009820 tx=0x7f257802a270 comp rx=0 tx=0).stop 2024-09-19T06:02:24.940 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.940+0000 7f258d000640 1 -- 172.21.15.3:0/597626980 shutdown_connections 2024-09-19T06:02:24.940 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.940+0000 7f258d000640 1 --2- 172.21.15.3:0/597626980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f258807de70 0x7f258807c320 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:24.940 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.940+0000 7f258d000640 1 -- 172.21.15.3:0/597626980 >> 172.21.15.3:0/597626980 conn(0x7f2588102ef0 msgr2=0x7f2588105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:24.940 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.940+0000 7f258d000640 1 -- 172.21.15.3:0/597626980 shutdown_connections 2024-09-19T06:02:24.940 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.940+0000 7f258d000640 1 -- 172.21.15.3:0/597626980 wait complete. 2024-09-19T06:02:24.940 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.941+0000 7f258d000640 1 Processor -- start 2024-09-19T06:02:24.940 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.941+0000 7f258d000640 1 -- start start 2024-09-19T06:02:24.940 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.942+0000 7f258d000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f258807de70 0x7f258819d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:24.940 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.942+0000 7f258d000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f258810dd90 con 0x7f258807de70 2024-09-19T06:02:24.940 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.942+0000 7f2585e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f258807de70 0x7f258819d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:24.941 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.942+0000 7f2585e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f258807de70 0x7f258819d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53878/0 (socket says 172.21.15.3:53878) 2024-09-19T06:02:24.941 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.942+0000 7f2585e00640 1 -- 172.21.15.3:0/2045425554 learned_addr learned my addr 172.21.15.3:0/2045425554 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:24.941 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.942+0000 7f2585e00640 1 -- 172.21.15.3:0/2045425554 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258819de50 con 0x7f258807de70 2024-09-19T06:02:24.941 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.943+0000 7f2585e00640 1 --2- 172.21.15.3:0/2045425554 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f258807de70 0x7f258819d910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2578030420 tx=0x7f2578032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:24.941 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.943+0000 7f257ea00640 1 -- 172.21.15.3:0/2045425554 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2578037040 con 0x7f258807de70 2024-09-19T06:02:24.941 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.943+0000 7f257ea00640 1 -- 172.21.15.3:0/2045425554 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2578040070 con 0x7f258807de70 2024-09-19T06:02:24.941 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.943+0000 7f257ea00640 1 -- 172.21.15.3:0/2045425554 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f257803a6e0 con 0x7f258807de70 2024-09-19T06:02:24.941 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.943+0000 7f258d000640 1 -- 172.21.15.3:0/2045425554 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f258819e0e0 con 0x7f258807de70 2024-09-19T06:02:24.941 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.943+0000 7f258d000640 1 -- 172.21.15.3:0/2045425554 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25881a0dd0 con 0x7f258807de70 2024-09-19T06:02:24.941 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.944+0000 7f257ea00640 1 -- 172.21.15.3:0/2045425554 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f257803bb20 con 0x7f258807de70 2024-09-19T06:02:24.941 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.944+0000 7f258d000640 1 -- 172.21.15.3:0/2045425554 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f258807c3a0 con 0x7f258807de70 2024-09-19T06:02:24.941 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.944+0000 7f257ea00640 1 --2- 172.21.15.3:0/2045425554 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f256c039200 0x7f256c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:24.941 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.945+0000 7f257ea00640 1 -- 172.21.15.3:0/2045425554 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f257806c900 con 0x7f258807de70 2024-09-19T06:02:24.942 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.945+0000 7f2585400640 1 --2- 172.21.15.3:0/2045425554 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f256c039200 0x7f256c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:24.942 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.945+0000 7f2585400640 1 --2- 172.21.15.3:0/2045425554 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f256c039200 0x7f256c03b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f25740098c0 tx=0x7f2574006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:24.942 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:22.950+0000 7f257ea00640 1 -- 172.21.15.3:0/2045425554 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2578043360 con 0x7f258807de70 2024-09-19T06:02:24.942 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:23.197+0000 7f258d000640 1 -- 172.21.15.3:0/2045425554 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f25881a13c0 con 0x7f258807de70 2024-09-19T06:02:24.942 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:23.879+0000 7f257ea00640 1 -- 172.21.15.3:0/2045425554 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f25780328c0 con 0x7f258807de70 2024-09-19T06:02:24.942 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:23.881+0000 7f257ea00640 1 -- 172.21.15.3:0/2045425554 <== mon.0 v2:172.21.15.3:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f25780313a0 con 0x7f258807de70 2024-09-19T06:02:24.942 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:23.882+0000 7f258d000640 1 -- 172.21.15.3:0/2045425554 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f256c039200 msgr2=0x7f256c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:24.942 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:23.882+0000 7f258d000640 1 --2- 172.21.15.3:0/2045425554 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f256c039200 0x7f256c03b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f25740098c0 tx=0x7f2574006db0 comp rx=0 tx=0).stop 2024-09-19T06:02:24.942 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:23.882+0000 7f258d000640 1 -- 172.21.15.3:0/2045425554 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f258807de70 msgr2=0x7f258819d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:24.942 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:23.882+0000 7f258d000640 1 --2- 172.21.15.3:0/2045425554 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f258807de70 0x7f258819d910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2578030420 tx=0x7f2578032670 comp rx=0 tx=0).stop 2024-09-19T06:02:24.942 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:23.883+0000 7f258d000640 1 -- 172.21.15.3:0/2045425554 shutdown_connections 2024-09-19T06:02:24.942 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:23.883+0000 7f258d000640 1 --2- 172.21.15.3:0/2045425554 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f256c039200 0x7f256c03b6c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:24.943 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:23.883+0000 7f258d000640 1 --2- 172.21.15.3:0/2045425554 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f258807de70 0x7f258819d910 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:24.943 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:23.883+0000 7f258d000640 1 -- 172.21.15.3:0/2045425554 >> 172.21.15.3:0/2045425554 conn(0x7f2588102ef0 msgr2=0x7f2588103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:24.943 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:23.883+0000 7f258d000640 1 -- 172.21.15.3:0/2045425554 shutdown_connections 2024-09-19T06:02:24.943 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:23.883+0000 7f258d000640 1 -- 172.21.15.3:0/2045425554 wait complete. 2024-09-19T06:02:25.079 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:24.862+0000 7fe6c35dc040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:02:25.080 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:24 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2045425554' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T06:02:25.080 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:24 smithi003 ceph-mon[30893]: mgrmap e9: x(active, since 22s) 2024-09-19T06:02:25.334 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:25 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:25.260+0000 7fe6c35dc040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:02:25.724 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:25 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:25.335+0000 7fe6c35dc040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:02:25.724 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:25 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:25.560+0000 7fe6c35dc040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:02:26.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:25 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2232472983' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T06:02:26.480 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:02:26.486 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T06:02:26.486 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T06:02:26.486 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T06:02:26.486 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T06:02:26.486 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:02:26.486 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.512+0000 7f8028200640 1 Processor -- start 2024-09-19T06:02:26.486 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.512+0000 7f8028200640 1 -- start start 2024-09-19T06:02:26.486 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.512+0000 7f8028200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80201076d0 0x7f8020107ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.512+0000 7f8028200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f80201080a0 con 0x7f80201076d0 2024-09-19T06:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.513+0000 7f8025800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80201076d0 0x7f8020107ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.513+0000 7f8025800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80201076d0 0x7f8020107ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58698/0 (socket says 172.21.15.3:58698) 2024-09-19T06:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.513+0000 7f8025800640 1 -- 172.21.15.3:0/1510225386 learned_addr learned my addr 172.21.15.3:0/1510225386 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.513+0000 7f8025800640 1 -- 172.21.15.3:0/1510225386 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80201088d0 con 0x7f80201076d0 2024-09-19T06:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.514+0000 7f8025800640 1 --2- 172.21.15.3:0/1510225386 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80201076d0 0x7f8020107ad0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8014009820 tx=0x7f801402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b805f689bee4abd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.515+0000 7f801fe00640 1 -- 172.21.15.3:0/1510225386 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8014037070 con 0x7f80201076d0 2024-09-19T06:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.515+0000 7f801fe00640 1 -- 172.21.15.3:0/1510225386 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8014032920 con 0x7f80201076d0 2024-09-19T06:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.515+0000 7f801fe00640 1 -- 172.21.15.3:0/1510225386 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8014030810 con 0x7f80201076d0 2024-09-19T06:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.515+0000 7f8028200640 1 -- 172.21.15.3:0/1510225386 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80201076d0 msgr2=0x7f8020107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.515+0000 7f8028200640 1 --2- 172.21.15.3:0/1510225386 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80201076d0 0x7f8020107ad0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8014009820 tx=0x7f801402a270 comp rx=0 tx=0).stop 2024-09-19T06:02:26.487 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.515+0000 7f8028200640 1 -- 172.21.15.3:0/1510225386 shutdown_connections 2024-09-19T06:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.515+0000 7f8028200640 1 --2- 172.21.15.3:0/1510225386 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80201076d0 0x7f8020107ad0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.515+0000 7f8028200640 1 -- 172.21.15.3:0/1510225386 >> 172.21.15.3:0/1510225386 conn(0x7f8020102e60 msgr2=0x7f80201052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.516+0000 7f8028200640 1 -- 172.21.15.3:0/1510225386 shutdown_connections 2024-09-19T06:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.516+0000 7f8028200640 1 -- 172.21.15.3:0/1510225386 wait complete. 2024-09-19T06:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.517+0000 7f8028200640 1 Processor -- start 2024-09-19T06:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.517+0000 7f8028200640 1 -- start start 2024-09-19T06:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.517+0000 7f8028200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80201076d0 0x7f802019d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.517+0000 7f8028200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f802010bc80 con 0x7f80201076d0 2024-09-19T06:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.517+0000 7f8025800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80201076d0 0x7f802019d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.517+0000 7f8025800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80201076d0 0x7f802019d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58704/0 (socket says 172.21.15.3:58704) 2024-09-19T06:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.517+0000 7f8025800640 1 -- 172.21.15.3:0/2232472983 learned_addr learned my addr 172.21.15.3:0/2232472983 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:26.488 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.518+0000 7f8025800640 1 -- 172.21.15.3:0/2232472983 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f802019de40 con 0x7f80201076d0 2024-09-19T06:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.518+0000 7f8025800640 1 --2- 172.21.15.3:0/2232472983 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80201076d0 0x7f802019d900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f80140097f0 tx=0x7f80140327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.518+0000 7f801e000640 1 -- 172.21.15.3:0/2232472983 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8014037040 con 0x7f80201076d0 2024-09-19T06:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.518+0000 7f801e000640 1 -- 172.21.15.3:0/2232472983 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8014030cc0 con 0x7f80201076d0 2024-09-19T06:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.518+0000 7f801e000640 1 -- 172.21.15.3:0/2232472983 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f801403a640 con 0x7f80201076d0 2024-09-19T06:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.518+0000 7f8028200640 1 -- 172.21.15.3:0/2232472983 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f802019e0d0 con 0x7f80201076d0 2024-09-19T06:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.518+0000 7f8028200640 1 -- 172.21.15.3:0/2232472983 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80201a0dc0 con 0x7f80201076d0 2024-09-19T06:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.519+0000 7f8028200640 1 -- 172.21.15.3:0/2232472983 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f802010be00 con 0x7f80201076d0 2024-09-19T06:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.520+0000 7f801e000640 1 -- 172.21.15.3:0/2232472983 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f801403b3f0 con 0x7f80201076d0 2024-09-19T06:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.520+0000 7f801e000640 1 --2- 172.21.15.3:0/2232472983 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f80080392b0 0x7f800803b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.521+0000 7f801e000640 1 -- 172.21.15.3:0/2232472983 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f801406c960 con 0x7f80201076d0 2024-09-19T06:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.521+0000 7f8024e00640 1 -- 172.21.15.3:0/2232472983 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f80080392b0 msgr2=0x7f800803b770 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.3:6800/518259590 2024-09-19T06:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.521+0000 7f8024e00640 1 --2- 172.21.15.3:0/2232472983 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f80080392b0 0x7f800803b770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:02:26.489 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.525+0000 7f801e000640 1 -- 172.21.15.3:0/2232472983 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f80140371e0 con 0x7f80201076d0 2024-09-19T06:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.722+0000 7f8024e00640 1 -- 172.21.15.3:0/2232472983 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f80080392b0 msgr2=0x7f800803b770 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.3:6800/518259590 2024-09-19T06:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.722+0000 7f8024e00640 1 --2- 172.21.15.3:0/2232472983 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f80080392b0 0x7f800803b770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.760+0000 7f8028200640 1 -- 172.21.15.3:0/2232472983 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f80201a0f90 con 0x7f80201076d0 2024-09-19T06:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.761+0000 7f801e000640 1 -- 172.21.15.3:0/2232472983 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f801403b6e0 con 0x7f80201076d0 2024-09-19T06:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.763+0000 7f8028200640 1 -- 172.21.15.3:0/2232472983 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f80080392b0 msgr2=0x7f800803b770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.763+0000 7f8028200640 1 --2- 172.21.15.3:0/2232472983 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f80080392b0 0x7f800803b770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.763+0000 7f8028200640 1 -- 172.21.15.3:0/2232472983 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80201076d0 msgr2=0x7f802019d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.763+0000 7f8028200640 1 --2- 172.21.15.3:0/2232472983 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80201076d0 0x7f802019d900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f80140097f0 tx=0x7f80140327b0 comp rx=0 tx=0).stop 2024-09-19T06:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.763+0000 7f8028200640 1 -- 172.21.15.3:0/2232472983 shutdown_connections 2024-09-19T06:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.763+0000 7f8028200640 1 --2- 172.21.15.3:0/2232472983 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7f80080392b0 0x7f800803b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.763+0000 7f8028200640 1 --2- 172.21.15.3:0/2232472983 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f80201076d0 0x7f802019d900 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.763+0000 7f8028200640 1 -- 172.21.15.3:0/2232472983 >> 172.21.15.3:0/2232472983 conn(0x7f8020102e60 msgr2=0x7f80201039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:26.490 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.763+0000 7f8028200640 1 -- 172.21.15.3:0/2232472983 shutdown_connections 2024-09-19T06:02:26.491 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:25.763+0000 7f8028200640 1 -- 172.21.15.3:0/2232472983 wait complete. 2024-09-19T06:02:26.491 INFO:teuthology.orchestra.run.smithi003.stdout:Waiting for the mgr to restart... 2024-09-19T06:02:26.491 INFO:teuthology.orchestra.run.smithi003.stdout:Waiting for mgr epoch 9... 2024-09-19T06:02:26.753 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:26 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:26.720+0000 7fe6c35dc040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:02:27.039 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:26 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:26.814+0000 7fe6c35dc040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:02:27.908 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:27 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:27.764+0000 7fe6c35dc040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:02:28.330 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:27 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:27.905+0000 7fe6c35dc040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:02:28.331 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:28 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:28.076+0000 7fe6c35dc040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:02:28.331 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:28 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:28.151+0000 7fe6c35dc040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:02:28.331 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:28 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:28.328+0000 7fe6c35dc040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:02:28.584 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:28 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:28.413+0000 7fe6c35dc040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:02:28.585 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:28 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:28.487+0000 7fe6c35dc040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:02:28.941 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:28 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:28.675+0000 7fe6c35dc040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:02:28.941 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:28 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:28.756+0000 7fe6c35dc040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:02:28.941 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:28 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:28.838+0000 7fe6c35dc040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:02:28.941 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:28 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:28.939+0000 7fe6c35dc040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:02:29.334 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:29 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:29.012+0000 7fe6c35dc040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:02:29.335 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:29 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:29.085+0000 7fe6c35dc040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:02:30.305 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:30 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:30.036+0000 7fe6c35dc040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:02:30.305 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:30 smithi003 ceph-mon[30893]: Active manager daemon x restarted 2024-09-19T06:02:30.306 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:30 smithi003 ceph-mon[30893]: Activating manager daemon x 2024-09-19T06:02:30.306 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:30 smithi003 ceph-mon[30893]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T06:02:30.306 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:30 smithi003 ceph-mon[30893]: mgrmap e10: x(active, starting, since 0.00389178s) 2024-09-19T06:02:30.306 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:30 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:02:30.306 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:30 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:02:30.306 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:30 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:02:30.306 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:30 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:02:30.306 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:30 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:02:30.306 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:30 smithi003 ceph-mon[30893]: Manager daemon x is now available 2024-09-19T06:02:30.306 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:30 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:31.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:31 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:02:31.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:31 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:02:31.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:31 smithi003 ceph-mon[30893]: mgrmap e11: x(active, since 1.00862s) 2024-09-19T06:02:32.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:32 smithi003 ceph-mon[30893]: [19/Sep/2024:06:02:31] ENGINE Bus STARTING 2024-09-19T06:02:32.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:32 smithi003 ceph-mon[30893]: [19/Sep/2024:06:02:31] ENGINE Serving on http://172.21.15.3:8765 2024-09-19T06:02:32.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:32 smithi003 ceph-mon[30893]: [19/Sep/2024:06:02:31] ENGINE Serving on https://172.21.15.3:7150 2024-09-19T06:02:32.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:32 smithi003 ceph-mon[30893]: [19/Sep/2024:06:02:31] ENGINE Bus STARTED 2024-09-19T06:02:32.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:32 smithi003 ceph-mon[30893]: [19/Sep/2024:06:02:31] ENGINE Error in HTTPServer.serve 2024-09-19T06:02:32.336 INFO:journalctl@ceph.mon.a.smithi003.stdout: Traceback (most recent call last): 2024-09-19T06:02:32.336 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:02:32.336 INFO:journalctl@ceph.mon.a.smithi003.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:02:32.336 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:02:32.336 INFO:journalctl@ceph.mon.a.smithi003.stdout: self._run(expiration_interval) 2024-09-19T06:02:32.336 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:02:32.336 INFO:journalctl@ceph.mon.a.smithi003.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:02:32.336 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:02:32.336 INFO:journalctl@ceph.mon.a.smithi003.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:02:32.336 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:02:32.336 INFO:journalctl@ceph.mon.a.smithi003.stdout: s = self.context.wrap_socket( 2024-09-19T06:02:32.336 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:02:32.336 INFO:journalctl@ceph.mon.a.smithi003.stdout: return self.sslsocket_class._create( 2024-09-19T06:02:32.337 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:02:32.337 INFO:journalctl@ceph.mon.a.smithi003.stdout: self.do_handshake() 2024-09-19T06:02:32.337 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:02:32.337 INFO:journalctl@ceph.mon.a.smithi003.stdout: self._sslobj.do_handshake() 2024-09-19T06:02:32.337 INFO:journalctl@ceph.mon.a.smithi003.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:02:32.337 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:31 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:31.975+0000 7fe619000640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:06:02:31] ENGINE Error in HTTPServer.serve 2024-09-19T06:02:32.337 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:31 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: Traceback (most recent call last): 2024-09-19T06:02:32.337 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:31 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:02:32.337 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:31 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: self._connections.run(self.expiration_interval) 2024-09-19T06:02:32.337 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:31 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:02:32.337 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:31 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: self._run(expiration_interval) 2024-09-19T06:02:32.338 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:31 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:02:32.338 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:31 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:02:32.338 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:31 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:02:32.338 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:31 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:02:32.338 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:31 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:02:32.338 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:31 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: s = self.context.wrap_socket( 2024-09-19T06:02:32.338 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:31 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:02:32.338 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:31 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: return self.sslsocket_class._create( 2024-09-19T06:02:32.338 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:31 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:02:32.338 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:31 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: self.do_handshake() 2024-09-19T06:02:32.338 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:31 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:02:32.340 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:31 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: self._sslobj.do_handshake() 2024-09-19T06:02:32.340 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:31 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:02:32.340 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:02:31 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:02:32.447 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:02:32.447 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T06:02:32.448 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T06:02:32.448 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:02:32.448 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.037+0000 7fe3fbe00640 1 Processor -- start 2024-09-19T06:02:32.448 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.037+0000 7fe3fbe00640 1 -- start start 2024-09-19T06:02:32.448 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.037+0000 7fe3fbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3fc109870 0x7fe3fc109c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:32.448 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.037+0000 7fe3fbe00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc10a260 con 0x7fe3fc109870 2024-09-19T06:02:32.448 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.037+0000 7fe3faa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3fc109870 0x7fe3fc109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:32.448 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.038+0000 7fe3faa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3fc109870 0x7fe3fc109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58720/0 (socket says 172.21.15.3:58720) 2024-09-19T06:02:32.448 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.038+0000 7fe3faa00640 1 -- 172.21.15.3:0/3964208416 learned_addr learned my addr 172.21.15.3:0/3964208416 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:32.448 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.038+0000 7fe3faa00640 1 -- 172.21.15.3:0/3964208416 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3fc10a930 con 0x7fe3fc109870 2024-09-19T06:02:32.448 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.039+0000 7fe3faa00640 1 --2- 172.21.15.3:0/3964208416 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3fc109870 0x7fe3fc109c90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009820 tx=0x7fe3ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b2e252678866d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:32.448 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.039+0000 7fe3f9600640 1 -- 172.21.15.3:0/3964208416 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3ec037070 con 0x7fe3fc109870 2024-09-19T06:02:32.449 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.039+0000 7fe3f9600640 1 -- 172.21.15.3:0/3964208416 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3ec032920 con 0x7fe3fc109870 2024-09-19T06:02:32.449 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.039+0000 7fe3f9600640 1 -- 172.21.15.3:0/3964208416 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3ec030810 con 0x7fe3fc109870 2024-09-19T06:02:32.449 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.040+0000 7fe3fbe00640 1 -- 172.21.15.3:0/3964208416 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3fc109870 msgr2=0x7fe3fc109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:32.449 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.040+0000 7fe3fbe00640 1 --2- 172.21.15.3:0/3964208416 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3fc109870 0x7fe3fc109c90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009820 tx=0x7fe3ec02a270 comp rx=0 tx=0).stop 2024-09-19T06:02:32.449 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.040+0000 7fe3fbe00640 1 -- 172.21.15.3:0/3964208416 shutdown_connections 2024-09-19T06:02:32.449 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.040+0000 7fe3fbe00640 1 --2- 172.21.15.3:0/3964208416 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3fc109870 0x7fe3fc109c90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:32.449 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.040+0000 7fe3fbe00640 1 -- 172.21.15.3:0/3964208416 >> 172.21.15.3:0/3964208416 conn(0x7fe3fc07ce50 msgr2=0x7fe3fc07d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:32.449 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.040+0000 7fe3fbe00640 1 -- 172.21.15.3:0/3964208416 shutdown_connections 2024-09-19T06:02:32.449 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.040+0000 7fe3fbe00640 1 -- 172.21.15.3:0/3964208416 wait complete. 2024-09-19T06:02:32.449 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.042+0000 7fe3fbe00640 1 Processor -- start 2024-09-19T06:02:32.449 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.042+0000 7fe3fbe00640 1 -- start start 2024-09-19T06:02:32.449 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.042+0000 7fe3fbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3fc109870 0x7fe3fc19d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:32.450 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.042+0000 7fe3fbe00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc10dce0 con 0x7fe3fc109870 2024-09-19T06:02:32.450 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.042+0000 7fe3faa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3fc109870 0x7fe3fc19d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:32.450 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.043+0000 7fe3faa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3fc109870 0x7fe3fc19d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58730/0 (socket says 172.21.15.3:58730) 2024-09-19T06:02:32.450 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.043+0000 7fe3faa00640 1 -- 172.21.15.3:0/4098970048 learned_addr learned my addr 172.21.15.3:0/4098970048 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:32.450 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.043+0000 7fe3faa00640 1 -- 172.21.15.3:0/4098970048 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3fc19dc20 con 0x7fe3fc109870 2024-09-19T06:02:32.450 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.043+0000 7fe3faa00640 1 --2- 172.21.15.3:0/4098970048 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3fc109870 0x7fe3fc19d6e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec0097f0 tx=0x7fe3ec0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:32.450 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.043+0000 7fe3f3400640 1 -- 172.21.15.3:0/4098970048 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3ec037040 con 0x7fe3fc109870 2024-09-19T06:02:32.450 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.043+0000 7fe3f3400640 1 -- 172.21.15.3:0/4098970048 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3ec030cc0 con 0x7fe3fc109870 2024-09-19T06:02:32.450 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.043+0000 7fe3f3400640 1 -- 172.21.15.3:0/4098970048 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3ec03a6b0 con 0x7fe3fc109870 2024-09-19T06:02:32.450 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.043+0000 7fe3fbe00640 1 -- 172.21.15.3:0/4098970048 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3fc19deb0 con 0x7fe3fc109870 2024-09-19T06:02:32.450 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.044+0000 7fe3fbe00640 1 -- 172.21.15.3:0/4098970048 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3fc1a0ba0 con 0x7fe3fc109870 2024-09-19T06:02:32.450 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.045+0000 7fe3f3400640 1 -- 172.21.15.3:0/4098970048 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fe3ec03b3f0 con 0x7fe3fc109870 2024-09-19T06:02:32.450 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.045+0000 7fe3f3400640 1 --2- 172.21.15.3:0/4098970048 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fe3e00392b0 0x7fe3e003b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:32.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.045+0000 7fe3fbe00640 1 -- 172.21.15.3:0/4098970048 --> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe3fc109c90 con 0x7fe3e00392b0 2024-09-19T06:02:32.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.045+0000 7fe3f3400640 1 -- 172.21.15.3:0/4098970048 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe3ec06c870 con 0x7fe3fc109870 2024-09-19T06:02:32.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.045+0000 7fe3fa000640 1 -- 172.21.15.3:0/4098970048 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fe3e00392b0 msgr2=0x7fe3e003b770 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.3:6800/518259590 2024-09-19T06:02:32.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.045+0000 7fe3fa000640 1 --2- 172.21.15.3:0/4098970048 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fe3e00392b0 0x7fe3e003b770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:02:32.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.246+0000 7fe3fa000640 1 -- 172.21.15.3:0/4098970048 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fe3e00392b0 msgr2=0x7fe3e003b770 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.3:6800/518259590 2024-09-19T06:02:32.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.246+0000 7fe3fa000640 1 --2- 172.21.15.3:0/4098970048 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fe3e00392b0 0x7fe3e003b770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:02:32.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.647+0000 7fe3fa000640 1 -- 172.21.15.3:0/4098970048 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fe3e00392b0 msgr2=0x7fe3e003b770 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.3:6800/518259590 2024-09-19T06:02:32.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:27.647+0000 7fe3fa000640 1 --2- 172.21.15.3:0/4098970048 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fe3e00392b0 0x7fe3e003b770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T06:02:32.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:28.448+0000 7fe3fa000640 1 -- 172.21.15.3:0/4098970048 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fe3e00392b0 msgr2=0x7fe3e003b770 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.3:6800/518259590 2024-09-19T06:02:32.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:28.448+0000 7fe3fa000640 1 --2- 172.21.15.3:0/4098970048 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fe3e00392b0 0x7fe3e003b770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T06:02:32.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:30.041+0000 7fe3f3400640 1 -- 172.21.15.3:0/4098970048 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7fe3ec06b260 con 0x7fe3fc109870 2024-09-19T06:02:32.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:30.041+0000 7fe3f3400640 1 -- 172.21.15.3:0/4098970048 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fe3e00392b0 msgr2=0x7fe3e003b770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:02:32.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:30.041+0000 7fe3f3400640 1 --2- 172.21.15.3:0/4098970048 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fe3e00392b0 0x7fe3e003b770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:32.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:31.044+0000 7fe3f3400640 1 -- 172.21.15.3:0/4098970048 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7fe3ec049cc0 con 0x7fe3fc109870 2024-09-19T06:02:32.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:31.044+0000 7fe3f3400640 1 --2- 172.21.15.3:0/4098970048 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe3e003cb80 0x7fe3e003ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:32.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:31.044+0000 7fe3f3400640 1 -- 172.21.15.3:0/4098970048 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe3ec043ca0 con 0x7fe3e003cb80 2024-09-19T06:02:32.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:31.045+0000 7fe3fa000640 1 --2- 172.21.15.3:0/4098970048 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe3e003cb80 0x7fe3e003ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:32.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:31.046+0000 7fe3fa000640 1 --2- 172.21.15.3:0/4098970048 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe3e003cb80 0x7fe3e003ef70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8003980 tx=0x7fe3e80092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:32.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:31.047+0000 7fe3f3400640 1 -- 172.21.15.3:0/4098970048 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fe3ec043ca0 con 0x7fe3e003cb80 2024-09-19T06:02:32.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:31.054+0000 7fe3fbe00640 1 -- 172.21.15.3:0/4098970048 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fe3fc107b90 con 0x7fe3e003cb80 2024-09-19T06:02:32.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:31.055+0000 7fe3f3400640 1 -- 172.21.15.3:0/4098970048 <== mgr.14150 v2:172.21.15.3:6800/1278931596 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7fe3fc107b90 con 0x7fe3e003cb80 2024-09-19T06:02:32.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:31.055+0000 7fe3fbe00640 1 -- 172.21.15.3:0/4098970048 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe3e003cb80 msgr2=0x7fe3e003ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:32.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:31.055+0000 7fe3fbe00640 1 --2- 172.21.15.3:0/4098970048 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe3e003cb80 0x7fe3e003ef70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8003980 tx=0x7fe3e80092b0 comp rx=0 tx=0).stop 2024-09-19T06:02:32.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:31.055+0000 7fe3fbe00640 1 -- 172.21.15.3:0/4098970048 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3fc109870 msgr2=0x7fe3fc19d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:32.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:31.055+0000 7fe3fbe00640 1 --2- 172.21.15.3:0/4098970048 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3fc109870 0x7fe3fc19d6e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec0097f0 tx=0x7fe3ec0327b0 comp rx=0 tx=0).stop 2024-09-19T06:02:32.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:31.055+0000 7fe3fbe00640 1 -- 172.21.15.3:0/4098970048 shutdown_connections 2024-09-19T06:02:32.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:31.055+0000 7fe3fbe00640 1 --2- 172.21.15.3:0/4098970048 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe3e003cb80 0x7fe3e003ef70 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:32.453 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:31.055+0000 7fe3fbe00640 1 --2- 172.21.15.3:0/4098970048 >> [v2:172.21.15.3:6800/518259590,v1:172.21.15.3:6801/518259590] conn(0x7fe3e00392b0 0x7fe3e003b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:32.453 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:31.055+0000 7fe3fbe00640 1 --2- 172.21.15.3:0/4098970048 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3fc109870 0x7fe3fc19d6e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:32.453 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:31.055+0000 7fe3fbe00640 1 -- 172.21.15.3:0/4098970048 >> 172.21.15.3:0/4098970048 conn(0x7fe3fc07ce50 msgr2=0x7fe3fc107480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:32.453 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:31.055+0000 7fe3fbe00640 1 -- 172.21.15.3:0/4098970048 shutdown_connections 2024-09-19T06:02:32.453 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:31.056+0000 7fe3fbe00640 1 -- 172.21.15.3:0/4098970048 wait complete. 2024-09-19T06:02:32.453 INFO:teuthology.orchestra.run.smithi003.stdout:mgr epoch 9 is available 2024-09-19T06:02:32.453 INFO:teuthology.orchestra.run.smithi003.stdout:Generating a dashboard self-signed certificate... 2024-09-19T06:02:33.302 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:33 smithi003 ceph-mon[30893]: mgrmap e12: x(active, since 2s) 2024-09-19T06:02:33.302 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:33 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:33.980 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T06:02:33.980 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.011+0000 7fdf6fc00640 1 Processor -- start 2024-09-19T06:02:33.980 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.011+0000 7fdf6fc00640 1 -- start start 2024-09-19T06:02:33.980 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.011+0000 7fdf6fc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf68107740 0x7fdf68107b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:33.980 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.012+0000 7fdf6fc00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdf68108110 con 0x7fdf68107740 2024-09-19T06:02:33.980 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.012+0000 7fdf6d200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf68107740 0x7fdf68107b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:33.980 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.012+0000 7fdf6d200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf68107740 0x7fdf68107b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58798/0 (socket says 172.21.15.3:58798) 2024-09-19T06:02:33.980 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.012+0000 7fdf6d200640 1 -- 172.21.15.3:0/2546567092 learned_addr learned my addr 172.21.15.3:0/2546567092 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:33.981 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.012+0000 7fdf6d200640 1 -- 172.21.15.3:0/2546567092 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf681088f0 con 0x7fdf68107740 2024-09-19T06:02:33.981 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.013+0000 7fdf6d200640 1 --2- 172.21.15.3:0/2546567092 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf68107740 0x7fdf68107b40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c009820 tx=0x7fdf5c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3eaa80bf5d56ccc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:33.989 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.014+0000 7fdf67400640 1 -- 172.21.15.3:0/2546567092 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf5c037070 con 0x7fdf68107740 2024-09-19T06:02:33.990 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.014+0000 7fdf67400640 1 -- 172.21.15.3:0/2546567092 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf5c032920 con 0x7fdf68107740 2024-09-19T06:02:33.990 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.014+0000 7fdf67400640 1 -- 172.21.15.3:0/2546567092 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf5c030810 con 0x7fdf68107740 2024-09-19T06:02:33.990 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.014+0000 7fdf6fc00640 1 -- 172.21.15.3:0/2546567092 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf68107740 msgr2=0x7fdf68107b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:33.990 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.014+0000 7fdf6fc00640 1 --2- 172.21.15.3:0/2546567092 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf68107740 0x7fdf68107b40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c009820 tx=0x7fdf5c02a270 comp rx=0 tx=0).stop 2024-09-19T06:02:33.990 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.014+0000 7fdf6fc00640 1 -- 172.21.15.3:0/2546567092 shutdown_connections 2024-09-19T06:02:33.990 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.014+0000 7fdf6fc00640 1 --2- 172.21.15.3:0/2546567092 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf68107740 0x7fdf68107b40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:33.990 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.014+0000 7fdf6fc00640 1 -- 172.21.15.3:0/2546567092 >> 172.21.15.3:0/2546567092 conn(0x7fdf68102ef0 msgr2=0x7fdf68105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:33.990 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.014+0000 7fdf6fc00640 1 -- 172.21.15.3:0/2546567092 shutdown_connections 2024-09-19T06:02:33.990 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.015+0000 7fdf6fc00640 1 -- 172.21.15.3:0/2546567092 wait complete. 2024-09-19T06:02:33.990 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.015+0000 7fdf6fc00640 1 Processor -- start 2024-09-19T06:02:33.990 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.016+0000 7fdf6fc00640 1 -- start start 2024-09-19T06:02:33.990 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.016+0000 7fdf6fc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf68107740 0x7fdf6819d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:33.991 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.016+0000 7fdf6fc00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6810bca0 con 0x7fdf68107740 2024-09-19T06:02:33.991 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.016+0000 7fdf6d200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf68107740 0x7fdf6819d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:33.991 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.016+0000 7fdf6d200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf68107740 0x7fdf6819d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58814/0 (socket says 172.21.15.3:58814) 2024-09-19T06:02:33.991 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.016+0000 7fdf6d200640 1 -- 172.21.15.3:0/1664542196 learned_addr learned my addr 172.21.15.3:0/1664542196 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:33.991 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.017+0000 7fdf6d200640 1 -- 172.21.15.3:0/1664542196 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf6819ded0 con 0x7fdf68107740 2024-09-19T06:02:33.991 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.017+0000 7fdf6d200640 1 --2- 172.21.15.3:0/1664542196 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf68107740 0x7fdf6819d990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c0097f0 tx=0x7fdf5c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:33.991 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.017+0000 7fdf65600640 1 -- 172.21.15.3:0/1664542196 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf5c037040 con 0x7fdf68107740 2024-09-19T06:02:33.991 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.017+0000 7fdf65600640 1 -- 172.21.15.3:0/1664542196 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf5c030c40 con 0x7fdf68107740 2024-09-19T06:02:33.991 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.017+0000 7fdf6fc00640 1 -- 172.21.15.3:0/1664542196 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf6819e160 con 0x7fdf68107740 2024-09-19T06:02:33.991 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.017+0000 7fdf65600640 1 -- 172.21.15.3:0/1664542196 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf5c03a5b0 con 0x7fdf68107740 2024-09-19T06:02:33.991 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.017+0000 7fdf6fc00640 1 -- 172.21.15.3:0/1664542196 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf681a0e50 con 0x7fdf68107740 2024-09-19T06:02:33.991 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.018+0000 7fdf6fc00640 1 -- 172.21.15.3:0/1664542196 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf6810be20 con 0x7fdf68107740 2024-09-19T06:02:33.991 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.019+0000 7fdf65600640 1 -- 172.21.15.3:0/1664542196 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fdf5c03a7f0 con 0x7fdf68107740 2024-09-19T06:02:33.991 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.019+0000 7fdf65600640 1 --2- 172.21.15.3:0/1664542196 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fdf50039200 0x7fdf5003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:33.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.019+0000 7fdf65600640 1 -- 172.21.15.3:0/1664542196 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fdf5c06c8a0 con 0x7fdf68107740 2024-09-19T06:02:33.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.019+0000 7fdf67e00640 1 --2- 172.21.15.3:0/1664542196 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fdf50039200 0x7fdf5003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:33.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.020+0000 7fdf67e00640 1 --2- 172.21.15.3:0/1664542196 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fdf50039200 0x7fdf5003b6c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdf540098c0 tx=0x7fdf54006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:33.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.025+0000 7fdf65600640 1 -- 172.21.15.3:0/1664542196 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdf5c0371e0 con 0x7fdf68107740 2024-09-19T06:02:33.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.218+0000 7fdf6fc00640 1 -- 172.21.15.3:0/1664542196 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fdf681041b0 con 0x7fdf50039200 2024-09-19T06:02:33.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.300+0000 7fdf65600640 1 -- 172.21.15.3:0/1664542196 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fdf681041b0 con 0x7fdf50039200 2024-09-19T06:02:33.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.302+0000 7fdf6fc00640 1 -- 172.21.15.3:0/1664542196 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fdf50039200 msgr2=0x7fdf5003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:33.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.302+0000 7fdf6fc00640 1 --2- 172.21.15.3:0/1664542196 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fdf50039200 0x7fdf5003b6c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdf540098c0 tx=0x7fdf54006db0 comp rx=0 tx=0).stop 2024-09-19T06:02:33.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.302+0000 7fdf6fc00640 1 -- 172.21.15.3:0/1664542196 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf68107740 msgr2=0x7fdf6819d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:33.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.302+0000 7fdf6fc00640 1 --2- 172.21.15.3:0/1664542196 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf68107740 0x7fdf6819d990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c0097f0 tx=0x7fdf5c0327b0 comp rx=0 tx=0).stop 2024-09-19T06:02:33.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.302+0000 7fdf6fc00640 1 -- 172.21.15.3:0/1664542196 shutdown_connections 2024-09-19T06:02:33.992 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.302+0000 7fdf6fc00640 1 --2- 172.21.15.3:0/1664542196 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fdf50039200 0x7fdf5003b6c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:33.993 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.302+0000 7fdf6fc00640 1 --2- 172.21.15.3:0/1664542196 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf68107740 0x7fdf6819d990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:33.993 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.302+0000 7fdf6fc00640 1 -- 172.21.15.3:0/1664542196 >> 172.21.15.3:0/1664542196 conn(0x7fdf68102ef0 msgr2=0x7fdf68103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:33.993 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.302+0000 7fdf6fc00640 1 -- 172.21.15.3:0/1664542196 shutdown_connections 2024-09-19T06:02:33.993 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:33.302+0000 7fdf6fc00640 1 -- 172.21.15.3:0/1664542196 wait complete. 2024-09-19T06:02:33.993 INFO:teuthology.orchestra.run.smithi003.stdout:Creating initial admin user... 2024-09-19T06:02:34.528 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:34 smithi003 ceph-mon[30893]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:34.528 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:34 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:34.528 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:34 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:35.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:35 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:35.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:35 smithi003 ceph-mon[30893]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:35.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:35 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:36.212 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$y2UFJhAytDbCUA2WCbCK7uJnDalCWKc02/o.s9wG4KgZwe3FXjl0O", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726725754, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T06:02:36.212 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.526+0000 7f4844200640 1 Processor -- start 2024-09-19T06:02:36.212 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.526+0000 7f4844200640 1 -- start start 2024-09-19T06:02:36.212 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.526+0000 7f4844200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f483c109960 0x7f483c109d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:36.212 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.526+0000 7f4844200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f483c10a330 con 0x7f483c109960 2024-09-19T06:02:36.212 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.526+0000 7f4841800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f483c109960 0x7f483c109d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:36.212 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.526+0000 7f4841800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f483c109960 0x7f483c109d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49988/0 (socket says 172.21.15.3:49988) 2024-09-19T06:02:36.212 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.526+0000 7f4841800640 1 -- 172.21.15.3:0/1658025192 learned_addr learned my addr 172.21.15.3:0/1658025192 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:36.212 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.527+0000 7f4841800640 1 -- 172.21.15.3:0/1658025192 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483c10aad0 con 0x7f483c109960 2024-09-19T06:02:36.212 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.528+0000 7f4841800640 1 --2- 172.21.15.3:0/1658025192 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f483c109960 0x7f483c109d60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4830009820 tx=0x7f483002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275b1526fc27bdf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:36.213 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.528+0000 7f483be00640 1 -- 172.21.15.3:0/1658025192 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4830037070 con 0x7f483c109960 2024-09-19T06:02:36.213 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.528+0000 7f483be00640 1 -- 172.21.15.3:0/1658025192 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4830032920 con 0x7f483c109960 2024-09-19T06:02:36.213 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.528+0000 7f483be00640 1 -- 172.21.15.3:0/1658025192 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4830030810 con 0x7f483c109960 2024-09-19T06:02:36.213 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.529+0000 7f4844200640 1 -- 172.21.15.3:0/1658025192 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f483c109960 msgr2=0x7f483c109d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:36.213 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.529+0000 7f4844200640 1 --2- 172.21.15.3:0/1658025192 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f483c109960 0x7f483c109d60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4830009820 tx=0x7f483002a270 comp rx=0 tx=0).stop 2024-09-19T06:02:36.213 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.529+0000 7f4844200640 1 -- 172.21.15.3:0/1658025192 shutdown_connections 2024-09-19T06:02:36.213 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.529+0000 7f4844200640 1 --2- 172.21.15.3:0/1658025192 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f483c109960 0x7f483c109d60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:36.213 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.529+0000 7f4844200640 1 -- 172.21.15.3:0/1658025192 >> 172.21.15.3:0/1658025192 conn(0x7f483c07ce90 msgr2=0x7f483c07d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:36.213 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.529+0000 7f4844200640 1 -- 172.21.15.3:0/1658025192 shutdown_connections 2024-09-19T06:02:36.213 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.529+0000 7f4844200640 1 -- 172.21.15.3:0/1658025192 wait complete. 2024-09-19T06:02:36.213 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.530+0000 7f4844200640 1 Processor -- start 2024-09-19T06:02:36.213 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.530+0000 7f4844200640 1 -- start start 2024-09-19T06:02:36.214 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.531+0000 7f4844200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f483c109960 0x7f483c19d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:36.214 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.531+0000 7f4844200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f483c10de80 con 0x7f483c109960 2024-09-19T06:02:36.214 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.531+0000 7f4841800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f483c109960 0x7f483c19d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:36.214 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.531+0000 7f4841800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f483c109960 0x7f483c19d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49996/0 (socket says 172.21.15.3:49996) 2024-09-19T06:02:36.214 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.531+0000 7f4841800640 1 -- 172.21.15.3:0/3978403752 learned_addr learned my addr 172.21.15.3:0/3978403752 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:36.214 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.531+0000 7f4841800640 1 -- 172.21.15.3:0/3978403752 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f483c19de80 con 0x7f483c109960 2024-09-19T06:02:36.214 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.531+0000 7f4841800640 1 --2- 172.21.15.3:0/3978403752 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f483c109960 0x7f483c19d940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4830030560 tx=0x7f4830032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:36.214 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.532+0000 7f483a000640 1 -- 172.21.15.3:0/3978403752 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4830037040 con 0x7f483c109960 2024-09-19T06:02:36.214 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.532+0000 7f483a000640 1 -- 172.21.15.3:0/3978403752 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4830040070 con 0x7f483c109960 2024-09-19T06:02:36.214 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.532+0000 7f483a000640 1 -- 172.21.15.3:0/3978403752 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f483003a6d0 con 0x7f483c109960 2024-09-19T06:02:36.214 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.532+0000 7f4844200640 1 -- 172.21.15.3:0/3978403752 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f483c19e110 con 0x7f483c109960 2024-09-19T06:02:36.214 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.532+0000 7f4844200640 1 -- 172.21.15.3:0/3978403752 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f483c1a0e00 con 0x7f483c109960 2024-09-19T06:02:36.214 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.533+0000 7f4844200640 1 -- 172.21.15.3:0/3978403752 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f483c10e000 con 0x7f483c109960 2024-09-19T06:02:36.214 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.533+0000 7f483a000640 1 -- 172.21.15.3:0/3978403752 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f483003bb20 con 0x7f483c109960 2024-09-19T06:02:36.215 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.534+0000 7f483a000640 1 --2- 172.21.15.3:0/3978403752 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f4824039200 0x7f482403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:36.215 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.534+0000 7f483a000640 1 -- 172.21.15.3:0/3978403752 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f483006c9e0 con 0x7f483c109960 2024-09-19T06:02:36.215 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.534+0000 7f4840e00640 1 --2- 172.21.15.3:0/3978403752 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f4824039200 0x7f482403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:36.215 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.535+0000 7f4840e00640 1 --2- 172.21.15.3:0/3978403752 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f4824039200 0x7f482403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f48280098c0 tx=0x7f4828006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:36.215 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.539+0000 7f483a000640 1 -- 172.21.15.3:0/3978403752 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f48300328f0 con 0x7f483c109960 2024-09-19T06:02:36.215 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.742+0000 7f4844200640 1 -- 172.21.15.3:0/3978403752 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f483c109de0 con 0x7f4824039200 2024-09-19T06:02:36.215 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.993+0000 7f483a000640 1 -- 172.21.15.3:0/3978403752 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f483c109de0 con 0x7f4824039200 2024-09-19T06:02:36.215 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.995+0000 7f4844200640 1 -- 172.21.15.3:0/3978403752 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f4824039200 msgr2=0x7f482403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:36.215 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.995+0000 7f4844200640 1 --2- 172.21.15.3:0/3978403752 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f4824039200 0x7f482403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f48280098c0 tx=0x7f4828006db0 comp rx=0 tx=0).stop 2024-09-19T06:02:36.215 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.995+0000 7f4844200640 1 -- 172.21.15.3:0/3978403752 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f483c109960 msgr2=0x7f483c19d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:36.215 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.995+0000 7f4844200640 1 --2- 172.21.15.3:0/3978403752 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f483c109960 0x7f483c19d940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4830030560 tx=0x7f4830032670 comp rx=0 tx=0).stop 2024-09-19T06:02:36.215 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.995+0000 7f4844200640 1 -- 172.21.15.3:0/3978403752 shutdown_connections 2024-09-19T06:02:36.215 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.995+0000 7f4844200640 1 --2- 172.21.15.3:0/3978403752 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f4824039200 0x7f482403b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:36.216 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.995+0000 7f4844200640 1 --2- 172.21.15.3:0/3978403752 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f483c109960 0x7f483c19d940 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:36.216 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.995+0000 7f4844200640 1 -- 172.21.15.3:0/3978403752 >> 172.21.15.3:0/3978403752 conn(0x7f483c07ce90 msgr2=0x7f483c107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:36.216 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.995+0000 7f4844200640 1 -- 172.21.15.3:0/3978403752 shutdown_connections 2024-09-19T06:02:36.216 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:34.995+0000 7f4844200640 1 -- 172.21.15.3:0/3978403752 wait complete. 2024-09-19T06:02:36.216 INFO:teuthology.orchestra.run.smithi003.stdout:Fetching dashboard port number... 2024-09-19T06:02:37.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:37 smithi003 ceph-mon[30893]: mgrmap e13: x(active, since 6s) 2024-09-19T06:02:38.097 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T06:02:38.097 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.203+0000 7f77ca800640 1 Processor -- start 2024-09-19T06:02:38.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.203+0000 7f77ca800640 1 -- start start 2024-09-19T06:02:38.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.204+0000 7f77ca800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77c4107720 0x7f77c4107b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:38.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.204+0000 7f77ca800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f77c41080f0 con 0x7f77c4107720 2024-09-19T06:02:38.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.204+0000 7f77c3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77c4107720 0x7f77c4107b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:38.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.204+0000 7f77c3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77c4107720 0x7f77c4107b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50004/0 (socket says 172.21.15.3:50004) 2024-09-19T06:02:38.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.204+0000 7f77c3400640 1 -- 172.21.15.3:0/3595079313 learned_addr learned my addr 172.21.15.3:0/3595079313 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:38.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.205+0000 7f77c3400640 1 -- 172.21.15.3:0/3595079313 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c41088d0 con 0x7f77c4107720 2024-09-19T06:02:38.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.206+0000 7f77c3400640 1 --2- 172.21.15.3:0/3595079313 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77c4107720 0x7f77c4107b20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f77b4009820 tx=0x7f77b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0f7b601c9f7faa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:38.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.206+0000 7f77c2a00640 1 -- 172.21.15.3:0/3595079313 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b4037070 con 0x7f77c4107720 2024-09-19T06:02:38.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.206+0000 7f77c2a00640 1 -- 172.21.15.3:0/3595079313 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77b4032920 con 0x7f77c4107720 2024-09-19T06:02:38.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.206+0000 7f77c2a00640 1 -- 172.21.15.3:0/3595079313 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b4030810 con 0x7f77c4107720 2024-09-19T06:02:38.098 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.207+0000 7f77ca800640 1 -- 172.21.15.3:0/3595079313 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77c4107720 msgr2=0x7f77c4107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:38.099 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.207+0000 7f77ca800640 1 --2- 172.21.15.3:0/3595079313 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77c4107720 0x7f77c4107b20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f77b4009820 tx=0x7f77b402a270 comp rx=0 tx=0).stop 2024-09-19T06:02:38.099 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.207+0000 7f77ca800640 1 -- 172.21.15.3:0/3595079313 shutdown_connections 2024-09-19T06:02:38.099 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.207+0000 7f77ca800640 1 --2- 172.21.15.3:0/3595079313 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77c4107720 0x7f77c4107b20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:38.099 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.207+0000 7f77ca800640 1 -- 172.21.15.3:0/3595079313 >> 172.21.15.3:0/3595079313 conn(0x7f77c4102ef0 msgr2=0x7f77c4105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:38.099 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.207+0000 7f77ca800640 1 -- 172.21.15.3:0/3595079313 shutdown_connections 2024-09-19T06:02:38.099 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.207+0000 7f77ca800640 1 -- 172.21.15.3:0/3595079313 wait complete. 2024-09-19T06:02:38.099 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.208+0000 7f77ca800640 1 Processor -- start 2024-09-19T06:02:38.099 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.208+0000 7f77ca800640 1 -- start start 2024-09-19T06:02:38.099 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.208+0000 7f77ca800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77c4107720 0x7f77c419d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:38.099 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.208+0000 7f77ca800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f77c410bc80 con 0x7f77c4107720 2024-09-19T06:02:38.099 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.208+0000 7f77c3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77c4107720 0x7f77c419d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:38.099 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.208+0000 7f77c3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77c4107720 0x7f77c419d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50012/0 (socket says 172.21.15.3:50012) 2024-09-19T06:02:38.100 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.208+0000 7f77c3400640 1 -- 172.21.15.3:0/1226688047 learned_addr learned my addr 172.21.15.3:0/1226688047 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:38.100 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.209+0000 7f77c3400640 1 -- 172.21.15.3:0/1226688047 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c419de30 con 0x7f77c4107720 2024-09-19T06:02:38.100 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.209+0000 7f77c3400640 1 --2- 172.21.15.3:0/1226688047 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77c4107720 0x7f77c419d8f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f77b4030560 tx=0x7f77b4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:38.100 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.209+0000 7f77c0c00640 1 -- 172.21.15.3:0/1226688047 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b4037040 con 0x7f77c4107720 2024-09-19T06:02:38.100 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.209+0000 7f77ca800640 1 -- 172.21.15.3:0/1226688047 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77c419e0c0 con 0x7f77c4107720 2024-09-19T06:02:38.100 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.209+0000 7f77c0c00640 1 -- 172.21.15.3:0/1226688047 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77b4040070 con 0x7f77c4107720 2024-09-19T06:02:38.100 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.209+0000 7f77c0c00640 1 -- 172.21.15.3:0/1226688047 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77b403a740 con 0x7f77c4107720 2024-09-19T06:02:38.100 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.209+0000 7f77ca800640 1 -- 172.21.15.3:0/1226688047 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77c41a0db0 con 0x7f77c4107720 2024-09-19T06:02:38.100 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.211+0000 7f77c0c00640 1 -- 172.21.15.3:0/1226688047 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f77b403bb90 con 0x7f77c4107720 2024-09-19T06:02:38.100 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.211+0000 7f77ca800640 1 -- 172.21.15.3:0/1226688047 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77c410be00 con 0x7f77c4107720 2024-09-19T06:02:38.100 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.211+0000 7f77c0c00640 1 --2- 172.21.15.3:0/1226688047 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f77a8039300 0x7f77a803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:38.100 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.211+0000 7f77c0c00640 1 -- 172.21.15.3:0/1226688047 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f77b406cb00 con 0x7f77c4107720 2024-09-19T06:02:38.101 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.212+0000 7f77bbe00640 1 --2- 172.21.15.3:0/1226688047 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f77a8039300 0x7f77a803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:38.101 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.212+0000 7f77bbe00640 1 --2- 172.21.15.3:0/1226688047 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f77a8039300 0x7f77a803b7c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f77ac0098c0 tx=0x7f77ac006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:38.101 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.217+0000 7f77c0c00640 1 -- 172.21.15.3:0/1226688047 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f77b406ee20 con 0x7f77c4107720 2024-09-19T06:02:38.101 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.403+0000 7f77ca800640 1 -- 172.21.15.3:0/1226688047 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f77c41a0f80 con 0x7f77c4107720 2024-09-19T06:02:38.101 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.403+0000 7f77c0c00640 1 -- 172.21.15.3:0/1226688047 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f77b4042960 con 0x7f77c4107720 2024-09-19T06:02:38.101 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.406+0000 7f77ca800640 1 -- 172.21.15.3:0/1226688047 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f77a8039300 msgr2=0x7f77a803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:38.101 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.406+0000 7f77ca800640 1 --2- 172.21.15.3:0/1226688047 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f77a8039300 0x7f77a803b7c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f77ac0098c0 tx=0x7f77ac006db0 comp rx=0 tx=0).stop 2024-09-19T06:02:38.101 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.406+0000 7f77ca800640 1 -- 172.21.15.3:0/1226688047 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77c4107720 msgr2=0x7f77c419d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:38.101 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.406+0000 7f77ca800640 1 --2- 172.21.15.3:0/1226688047 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77c4107720 0x7f77c419d8f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f77b4030560 tx=0x7f77b4032670 comp rx=0 tx=0).stop 2024-09-19T06:02:38.101 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.406+0000 7f77ca800640 1 -- 172.21.15.3:0/1226688047 shutdown_connections 2024-09-19T06:02:38.101 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.406+0000 7f77ca800640 1 --2- 172.21.15.3:0/1226688047 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f77a8039300 0x7f77a803b7c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:38.101 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.406+0000 7f77ca800640 1 --2- 172.21.15.3:0/1226688047 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77c4107720 0x7f77c419d8f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:38.102 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.406+0000 7f77ca800640 1 -- 172.21.15.3:0/1226688047 >> 172.21.15.3:0/1226688047 conn(0x7f77c4102ef0 msgr2=0x7f77c41039e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:38.102 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.406+0000 7f77ca800640 1 -- 172.21.15.3:0/1226688047 shutdown_connections 2024-09-19T06:02:38.102 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:37.406+0000 7f77ca800640 1 -- 172.21.15.3:0/1226688047 wait complete. 2024-09-19T06:02:38.114 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T06:02:38.114 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout disabled 2024-09-19T06:02:38.127 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T06:02:38.127 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout inactive 2024-09-19T06:02:38.127 INFO:teuthology.orchestra.run.smithi003.stdout:firewalld.service is not enabled 2024-09-19T06:02:38.127 INFO:teuthology.orchestra.run.smithi003.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T06:02:38.130 INFO:teuthology.orchestra.run.smithi003.stdout:Ceph Dashboard is now available at: 2024-09-19T06:02:38.130 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:02:38.130 INFO:teuthology.orchestra.run.smithi003.stdout: URL: https://smithi003.front.sepia.ceph.com:8443/ 2024-09-19T06:02:38.130 INFO:teuthology.orchestra.run.smithi003.stdout: User: admin 2024-09-19T06:02:38.130 INFO:teuthology.orchestra.run.smithi003.stdout: Password: es26v6xk8q 2024-09-19T06:02:38.130 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:02:38.131 INFO:teuthology.orchestra.run.smithi003.stdout:Saving cluster configuration to /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config directory 2024-09-19T06:02:38.396 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:38 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1226688047' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T06:02:39.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.639+0000 7f5046000640 1 Processor -- start 2024-09-19T06:02:39.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.639+0000 7f5046000640 1 -- start start 2024-09-19T06:02:39.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.639+0000 7f5046000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5040109870 0x7f5040109c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:39.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.639+0000 7f5046000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f504010a260 con 0x7f5040109870 2024-09-19T06:02:39.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.640+0000 7f5044c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5040109870 0x7f5040109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:39.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.640+0000 7f5044c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5040109870 0x7f5040109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50014/0 (socket says 172.21.15.3:50014) 2024-09-19T06:02:39.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.640+0000 7f5044c00640 1 -- 172.21.15.3:0/2049182864 learned_addr learned my addr 172.21.15.3:0/2049182864 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:39.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.640+0000 7f5044c00640 1 -- 172.21.15.3:0/2049182864 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f504010a930 con 0x7f5040109870 2024-09-19T06:02:39.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.641+0000 7f5044c00640 1 --2- 172.21.15.3:0/2049182864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5040109870 0x7f5040109c90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5034009820 tx=0x7f503402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb6291881b01ed2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:39.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.641+0000 7f503f400640 1 -- 172.21.15.3:0/2049182864 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5034037070 con 0x7f5040109870 2024-09-19T06:02:39.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.641+0000 7f503f400640 1 -- 172.21.15.3:0/2049182864 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5034032920 con 0x7f5040109870 2024-09-19T06:02:39.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.641+0000 7f503f400640 1 -- 172.21.15.3:0/2049182864 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5034030810 con 0x7f5040109870 2024-09-19T06:02:39.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.642+0000 7f5046000640 1 -- 172.21.15.3:0/2049182864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5040109870 msgr2=0x7f5040109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:39.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.642+0000 7f5046000640 1 --2- 172.21.15.3:0/2049182864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5040109870 0x7f5040109c90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5034009820 tx=0x7f503402a270 comp rx=0 tx=0).stop 2024-09-19T06:02:39.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.642+0000 7f5046000640 1 -- 172.21.15.3:0/2049182864 shutdown_connections 2024-09-19T06:02:39.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.642+0000 7f5046000640 1 --2- 172.21.15.3:0/2049182864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5040109870 0x7f5040109c90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:39.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.642+0000 7f5046000640 1 -- 172.21.15.3:0/2049182864 >> 172.21.15.3:0/2049182864 conn(0x7f504007ce50 msgr2=0x7f504007d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:39.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.642+0000 7f5046000640 1 -- 172.21.15.3:0/2049182864 shutdown_connections 2024-09-19T06:02:39.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.642+0000 7f5046000640 1 -- 172.21.15.3:0/2049182864 wait complete. 2024-09-19T06:02:39.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.643+0000 7f5046000640 1 Processor -- start 2024-09-19T06:02:39.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.643+0000 7f5046000640 1 -- start start 2024-09-19T06:02:39.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.643+0000 7f5046000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5040109870 0x7f504019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:39.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.643+0000 7f5046000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f504010dce0 con 0x7f5040109870 2024-09-19T06:02:39.753 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.644+0000 7f5044c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5040109870 0x7f504019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:39.753 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.644+0000 7f5044c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5040109870 0x7f504019d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50020/0 (socket says 172.21.15.3:50020) 2024-09-19T06:02:39.753 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.644+0000 7f5044c00640 1 -- 172.21.15.3:0/448895916 learned_addr learned my addr 172.21.15.3:0/448895916 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:39.753 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.644+0000 7f5044c00640 1 -- 172.21.15.3:0/448895916 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f504019dc00 con 0x7f5040109870 2024-09-19T06:02:39.753 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.644+0000 7f5044c00640 1 --2- 172.21.15.3:0/448895916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5040109870 0x7f504019d6c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f50340097f0 tx=0x7f50340327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:39.753 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.644+0000 7f503d600640 1 -- 172.21.15.3:0/448895916 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5034037040 con 0x7f5040109870 2024-09-19T06:02:39.753 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.644+0000 7f503d600640 1 -- 172.21.15.3:0/448895916 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5034030cc0 con 0x7f5040109870 2024-09-19T06:02:39.753 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.644+0000 7f5046000640 1 -- 172.21.15.3:0/448895916 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f504019de90 con 0x7f5040109870 2024-09-19T06:02:39.753 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.645+0000 7f503d600640 1 -- 172.21.15.3:0/448895916 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f503403a6b0 con 0x7f5040109870 2024-09-19T06:02:39.753 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.645+0000 7f5046000640 1 -- 172.21.15.3:0/448895916 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50401a0b80 con 0x7f5040109870 2024-09-19T06:02:39.753 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.646+0000 7f503d600640 1 -- 172.21.15.3:0/448895916 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f503403baf0 con 0x7f5040109870 2024-09-19T06:02:39.753 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.646+0000 7f5046000640 1 -- 172.21.15.3:0/448895916 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5040109c90 con 0x7f5040109870 2024-09-19T06:02:39.753 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.647+0000 7f503d600640 1 --2- 172.21.15.3:0/448895916 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5028039300 0x7f502803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:39.754 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.647+0000 7f503d600640 1 -- 172.21.15.3:0/448895916 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f503406c9c0 con 0x7f5040109870 2024-09-19T06:02:39.754 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.647+0000 7f503fe00640 1 --2- 172.21.15.3:0/448895916 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5028039300 0x7f502803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:39.754 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.648+0000 7f503fe00640 1 --2- 172.21.15.3:0/448895916 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5028039300 0x7f502803b7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f502c0098c0 tx=0x7f502c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:39.754 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.652+0000 7f503d600640 1 -- 172.21.15.3:0/448895916 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f50340418d0 con 0x7f5040109870 2024-09-19T06:02:39.754 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.936+0000 7f5046000640 1 -- 172.21.15.3:0/448895916 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f50401a1170 con 0x7f5040109870 2024-09-19T06:02:39.754 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.938+0000 7f503d600640 1 -- 172.21.15.3:0/448895916 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f50340371e0 con 0x7f5040109870 2024-09-19T06:02:39.754 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T06:02:39.754 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.941+0000 7f5046000640 1 -- 172.21.15.3:0/448895916 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5028039300 msgr2=0x7f502803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:39.754 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.941+0000 7f5046000640 1 --2- 172.21.15.3:0/448895916 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5028039300 0x7f502803b7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f502c0098c0 tx=0x7f502c006db0 comp rx=0 tx=0).stop 2024-09-19T06:02:39.754 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.941+0000 7f5046000640 1 -- 172.21.15.3:0/448895916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5040109870 msgr2=0x7f504019d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:39.754 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.941+0000 7f5046000640 1 --2- 172.21.15.3:0/448895916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5040109870 0x7f504019d6c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f50340097f0 tx=0x7f50340327b0 comp rx=0 tx=0).stop 2024-09-19T06:02:39.754 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.941+0000 7f5046000640 1 -- 172.21.15.3:0/448895916 shutdown_connections 2024-09-19T06:02:39.754 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.941+0000 7f5046000640 1 --2- 172.21.15.3:0/448895916 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5028039300 0x7f502803b7c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:39.754 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.941+0000 7f5046000640 1 --2- 172.21.15.3:0/448895916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5040109870 0x7f504019d6c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:39.755 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.941+0000 7f5046000640 1 -- 172.21.15.3:0/448895916 >> 172.21.15.3:0/448895916 conn(0x7f504007ce50 msgr2=0x7f5040107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:39.755 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.941+0000 7f5046000640 1 -- 172.21.15.3:0/448895916 shutdown_connections 2024-09-19T06:02:39.755 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr 2024-09-19T06:02:38.941+0000 7f5046000640 1 -- 172.21.15.3:0/448895916 wait complete. 2024-09-19T06:02:39.755 INFO:teuthology.orchestra.run.smithi003.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T06:02:39.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:02:39.755 INFO:teuthology.orchestra.run.smithi003.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:02:39.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:02:39.755 INFO:teuthology.orchestra.run.smithi003.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T06:02:39.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:02:39.755 INFO:teuthology.orchestra.run.smithi003.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T06:02:39.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:02:39.755 INFO:teuthology.orchestra.run.smithi003.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T06:02:39.755 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:02:39.756 INFO:teuthology.orchestra.run.smithi003.stdout: ceph telemetry on 2024-09-19T06:02:39.756 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:02:39.756 INFO:teuthology.orchestra.run.smithi003.stdout:For more information see: 2024-09-19T06:02:39.756 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:02:39.756 INFO:teuthology.orchestra.run.smithi003.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T06:02:39.756 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:02:39.756 INFO:teuthology.orchestra.run.smithi003.stdout:Bootstrap complete. 2024-09-19T06:02:39.811 INFO:tasks.cephadm:Fetching config... 2024-09-19T06:02:39.812 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-19T06:02:39.812 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T06:02:39.850 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T06:02:39.850 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-19T06:02:39.850 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T06:02:39.931 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T06:02:39.931 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-19T06:02:39.931 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T06:02:39.990 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:39 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/448895916' entity='client.admin' 2024-09-19T06:02:40.029 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T06:02:40.029 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-19T06:02:40.029 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T06:02:40.105 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T06:02:40.106 DEBUG:teuthology.orchestra.run.smithi003:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9t0Wi4b8rhl199/sSaRf42JK5F6XoWo0RPjsd5EVrknfozCfyNA9G5P3lPbrdEAqMX3/0b5etBLok8amSPl+EL2S5/bMbx648EIb6ZHwJl5w8C0/2lSqEj5J0YfJEct/IR8uHnyAdNPxQ6SjEfKB55YJ7wpsXdUHFAvXMTHIiFJwnmlMDNXCzy9SIWHmh1KENde+9PFn7+R/tqkl/DEFShuyu54BiIRWuhNBtbN9AlyCJzsZqBq5dj8OvUn7r8tnW9kmFIS1hqSFrOIkw/1GeJf+47EmYPIXTzMjfpvbU5gSeftQphG0aNj3xEkUnburQ1QEoQioLGTSzUWb++0rHCT3NLhchclvXByxCkz5mb4xS7ZbWLj3fDXOXMj8JsLAdQo4zQtwplhB0WrUih+MejipDdJMcCKyV+VqgBAJ5dK3PhtvsvMaW2roMGJxHr4VHMp8G9U5xBvXcLh4zS5wTxf83d6Zl8bHLfDN75dBHWjq/vZ39/1a2df9FxzneKbc= ceph-782a5144-764c-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T06:02:40.235 INFO:teuthology.orchestra.run.smithi003.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9t0Wi4b8rhl199/sSaRf42JK5F6XoWo0RPjsd5EVrknfozCfyNA9G5P3lPbrdEAqMX3/0b5etBLok8amSPl+EL2S5/bMbx648EIb6ZHwJl5w8C0/2lSqEj5J0YfJEct/IR8uHnyAdNPxQ6SjEfKB55YJ7wpsXdUHFAvXMTHIiFJwnmlMDNXCzy9SIWHmh1KENde+9PFn7+R/tqkl/DEFShuyu54BiIRWuhNBtbN9AlyCJzsZqBq5dj8OvUn7r8tnW9kmFIS1hqSFrOIkw/1GeJf+47EmYPIXTzMjfpvbU5gSeftQphG0aNj3xEkUnburQ1QEoQioLGTSzUWb++0rHCT3NLhchclvXByxCkz5mb4xS7ZbWLj3fDXOXMj8JsLAdQo4zQtwplhB0WrUih+MejipDdJMcCKyV+VqgBAJ5dK3PhtvsvMaW2roMGJxHr4VHMp8G9U5xBvXcLh4zS5wTxf83d6Zl8bHLfDN75dBHWjq/vZ39/1a2df9FxzneKbc= ceph-782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:02:40.260 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9t0Wi4b8rhl199/sSaRf42JK5F6XoWo0RPjsd5EVrknfozCfyNA9G5P3lPbrdEAqMX3/0b5etBLok8amSPl+EL2S5/bMbx648EIb6ZHwJl5w8C0/2lSqEj5J0YfJEct/IR8uHnyAdNPxQ6SjEfKB55YJ7wpsXdUHFAvXMTHIiFJwnmlMDNXCzy9SIWHmh1KENde+9PFn7+R/tqkl/DEFShuyu54BiIRWuhNBtbN9AlyCJzsZqBq5dj8OvUn7r8tnW9kmFIS1hqSFrOIkw/1GeJf+47EmYPIXTzMjfpvbU5gSeftQphG0aNj3xEkUnburQ1QEoQioLGTSzUWb++0rHCT3NLhchclvXByxCkz5mb4xS7ZbWLj3fDXOXMj8JsLAdQo4zQtwplhB0WrUih+MejipDdJMcCKyV+VqgBAJ5dK3PhtvsvMaW2roMGJxHr4VHMp8G9U5xBvXcLh4zS5wTxf83d6Zl8bHLfDN75dBHWjq/vZ39/1a2df9FxzneKbc= ceph-782a5144-764c-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T06:02:40.302 INFO:teuthology.orchestra.run.smithi059.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9t0Wi4b8rhl199/sSaRf42JK5F6XoWo0RPjsd5EVrknfozCfyNA9G5P3lPbrdEAqMX3/0b5etBLok8amSPl+EL2S5/bMbx648EIb6ZHwJl5w8C0/2lSqEj5J0YfJEct/IR8uHnyAdNPxQ6SjEfKB55YJ7wpsXdUHFAvXMTHIiFJwnmlMDNXCzy9SIWHmh1KENde+9PFn7+R/tqkl/DEFShuyu54BiIRWuhNBtbN9AlyCJzsZqBq5dj8OvUn7r8tnW9kmFIS1hqSFrOIkw/1GeJf+47EmYPIXTzMjfpvbU5gSeftQphG0aNj3xEkUnburQ1QEoQioLGTSzUWb++0rHCT3NLhchclvXByxCkz5mb4xS7ZbWLj3fDXOXMj8JsLAdQo4zQtwplhB0WrUih+MejipDdJMcCKyV+VqgBAJ5dK3PhtvsvMaW2roMGJxHr4VHMp8G9U5xBvXcLh4zS5wTxf83d6Zl8bHLfDN75dBHWjq/vZ39/1a2df9FxzneKbc= ceph-782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:02:40.315 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9t0Wi4b8rhl199/sSaRf42JK5F6XoWo0RPjsd5EVrknfozCfyNA9G5P3lPbrdEAqMX3/0b5etBLok8amSPl+EL2S5/bMbx648EIb6ZHwJl5w8C0/2lSqEj5J0YfJEct/IR8uHnyAdNPxQ6SjEfKB55YJ7wpsXdUHFAvXMTHIiFJwnmlMDNXCzy9SIWHmh1KENde+9PFn7+R/tqkl/DEFShuyu54BiIRWuhNBtbN9AlyCJzsZqBq5dj8OvUn7r8tnW9kmFIS1hqSFrOIkw/1GeJf+47EmYPIXTzMjfpvbU5gSeftQphG0aNj3xEkUnburQ1QEoQioLGTSzUWb++0rHCT3NLhchclvXByxCkz5mb4xS7ZbWLj3fDXOXMj8JsLAdQo4zQtwplhB0WrUih+MejipDdJMcCKyV+VqgBAJ5dK3PhtvsvMaW2roMGJxHr4VHMp8G9U5xBvXcLh4zS5wTxf83d6Zl8bHLfDN75dBHWjq/vZ39/1a2df9FxzneKbc= ceph-782a5144-764c-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T06:02:40.357 INFO:teuthology.orchestra.run.smithi071.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9t0Wi4b8rhl199/sSaRf42JK5F6XoWo0RPjsd5EVrknfozCfyNA9G5P3lPbrdEAqMX3/0b5etBLok8amSPl+EL2S5/bMbx648EIb6ZHwJl5w8C0/2lSqEj5J0YfJEct/IR8uHnyAdNPxQ6SjEfKB55YJ7wpsXdUHFAvXMTHIiFJwnmlMDNXCzy9SIWHmh1KENde+9PFn7+R/tqkl/DEFShuyu54BiIRWuhNBtbN9AlyCJzsZqBq5dj8OvUn7r8tnW9kmFIS1hqSFrOIkw/1GeJf+47EmYPIXTzMjfpvbU5gSeftQphG0aNj3xEkUnburQ1QEoQioLGTSzUWb++0rHCT3NLhchclvXByxCkz5mb4xS7ZbWLj3fDXOXMj8JsLAdQo4zQtwplhB0WrUih+MejipDdJMcCKyV+VqgBAJ5dK3PhtvsvMaW2roMGJxHr4VHMp8G9U5xBvXcLh4zS5wTxf83d6Zl8bHLfDN75dBHWjq/vZ39/1a2df9FxzneKbc= ceph-782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:02:40.368 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T06:02:40.777 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:02:41.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.508+0000 7f5fc7e00640 1 -- 172.21.15.3:0/761913911 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5fc80761a0 msgr2=0x7f5fc8074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:41.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.508+0000 7f5fc7e00640 1 --2- 172.21.15.3:0/761913911 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5fc80761a0 0x7f5fc8074600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8009880 tx=0x7f5fb802a5d0 comp rx=0 tx=0).stop 2024-09-19T06:02:41.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.508+0000 7f5fc7e00640 1 -- 172.21.15.3:0/761913911 shutdown_connections 2024-09-19T06:02:41.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.508+0000 7f5fc7e00640 1 --2- 172.21.15.3:0/761913911 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5fc80761a0 0x7f5fc8074600 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:41.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.508+0000 7f5fc7e00640 1 -- 172.21.15.3:0/761913911 >> 172.21.15.3:0/761913911 conn(0x7f5fc80fcbd0 msgr2=0x7f5fc80feff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:41.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.508+0000 7f5fc7e00640 1 -- 172.21.15.3:0/761913911 shutdown_connections 2024-09-19T06:02:41.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.508+0000 7f5fc7e00640 1 -- 172.21.15.3:0/761913911 wait complete. 2024-09-19T06:02:41.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.510+0000 7f5fc7e00640 1 Processor -- start 2024-09-19T06:02:41.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.510+0000 7f5fc7e00640 1 -- start start 2024-09-19T06:02:41.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.510+0000 7f5fc7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5fc80761a0 0x7f5fc8198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:41.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.510+0000 7f5fc7e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc8109720 con 0x7f5fc80761a0 2024-09-19T06:02:41.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.510+0000 7f5fc6a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5fc80761a0 0x7f5fc8198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:41.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.511+0000 7f5fc6a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5fc80761a0 0x7f5fc8198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50028/0 (socket says 172.21.15.3:50028) 2024-09-19T06:02:41.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.511+0000 7f5fc6a00640 1 -- 172.21.15.3:0/1347671322 learned_addr learned my addr 172.21.15.3:0/1347671322 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:41.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.511+0000 7f5fc6a00640 1 -- 172.21.15.3:0/1347671322 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc8199260 con 0x7f5fc80761a0 2024-09-19T06:02:41.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.511+0000 7f5fc6a00640 1 --2- 172.21.15.3:0/1347671322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5fc80761a0 0x7f5fc8198d20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8004f60 tx=0x7f5fb80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:41.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.511+0000 7f5fbf400640 1 -- 172.21.15.3:0/1347671322 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fb803f070 con 0x7f5fc80761a0 2024-09-19T06:02:41.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.512+0000 7f5fc7e00640 1 -- 172.21.15.3:0/1347671322 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc81994f0 con 0x7f5fc80761a0 2024-09-19T06:02:41.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.512+0000 7f5fbf400640 1 -- 172.21.15.3:0/1347671322 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fb8003ad0 con 0x7f5fc80761a0 2024-09-19T06:02:41.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.512+0000 7f5fc7e00640 1 -- 172.21.15.3:0/1347671322 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc819c1d0 con 0x7f5fc80761a0 2024-09-19T06:02:41.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.512+0000 7f5fbf400640 1 -- 172.21.15.3:0/1347671322 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fb8049060 con 0x7f5fc80761a0 2024-09-19T06:02:41.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.513+0000 7f5fbf400640 1 -- 172.21.15.3:0/1347671322 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f5fb8042070 con 0x7f5fc80761a0 2024-09-19T06:02:41.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.513+0000 7f5fc7e00640 1 -- 172.21.15.3:0/1347671322 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fc8109ea0 con 0x7f5fc80761a0 2024-09-19T06:02:41.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.513+0000 7f5fbf400640 1 --2- 172.21.15.3:0/1347671322 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5fac0392a0 0x7f5fac03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:41.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.514+0000 7f5fbf400640 1 -- 172.21.15.3:0/1347671322 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5fb806d510 con 0x7f5fc80761a0 2024-09-19T06:02:41.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.514+0000 7f5fc6000640 1 --2- 172.21.15.3:0/1347671322 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5fac0392a0 0x7f5fac03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:41.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.514+0000 7f5fc6000640 1 --2- 172.21.15.3:0/1347671322 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5fac0392a0 0x7f5fac03b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5fb40098c0 tx=0x7f5fb4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:41.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.519+0000 7f5fbf400640 1 -- 172.21.15.3:0/1347671322 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5fb8031b50 con 0x7f5fc80761a0 2024-09-19T06:02:41.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.705+0000 7f5fc7e00640 1 -- 172.21.15.3:0/1347671322 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f5fc802d940 con 0x7f5fc80761a0 2024-09-19T06:02:41.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.708+0000 7f5fbf400640 1 -- 172.21.15.3:0/1347671322 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f5fb8031d30 con 0x7f5fc80761a0 2024-09-19T06:02:41.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.711+0000 7f5fc7e00640 1 -- 172.21.15.3:0/1347671322 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5fac0392a0 msgr2=0x7f5fac03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:41.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.711+0000 7f5fc7e00640 1 --2- 172.21.15.3:0/1347671322 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5fac0392a0 0x7f5fac03b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5fb40098c0 tx=0x7f5fb4006db0 comp rx=0 tx=0).stop 2024-09-19T06:02:41.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.711+0000 7f5fc7e00640 1 -- 172.21.15.3:0/1347671322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5fc80761a0 msgr2=0x7f5fc8198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:41.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.711+0000 7f5fc7e00640 1 --2- 172.21.15.3:0/1347671322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5fc80761a0 0x7f5fc8198d20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8004f60 tx=0x7f5fb80048f0 comp rx=0 tx=0).stop 2024-09-19T06:02:41.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.711+0000 7f5fc7e00640 1 -- 172.21.15.3:0/1347671322 shutdown_connections 2024-09-19T06:02:41.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.711+0000 7f5fc7e00640 1 --2- 172.21.15.3:0/1347671322 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5fac0392a0 0x7f5fac03b760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:41.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.711+0000 7f5fc7e00640 1 --2- 172.21.15.3:0/1347671322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5fc80761a0 0x7f5fc8198d20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:41.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.711+0000 7f5fc7e00640 1 -- 172.21.15.3:0/1347671322 >> 172.21.15.3:0/1347671322 conn(0x7f5fc80fcbd0 msgr2=0x7f5fc80fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:41.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.711+0000 7f5fc7e00640 1 -- 172.21.15.3:0/1347671322 shutdown_connections 2024-09-19T06:02:41.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:41.711+0000 7f5fc7e00640 1 -- 172.21.15.3:0/1347671322 wait complete. 2024-09-19T06:02:42.879 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T06:02:42.880 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T06:02:42.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:42 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1347671322' entity='client.admin' 2024-09-19T06:02:42.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:42 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:42.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:42 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:42.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:42 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi003", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:42.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:42 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:42.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:42 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:42.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:42 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:43.434 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:02:44.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.005+0000 7fa716400640 1 -- 172.21.15.3:0/2980360489 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa710103610 msgr2=0x7fa710103a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:44.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.005+0000 7fa716400640 1 --2- 172.21.15.3:0/2980360489 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa710103610 0x7fa710103a10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa704009880 tx=0x7fa70402a5d0 comp rx=0 tx=0).stop 2024-09-19T06:02:44.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.006+0000 7fa716400640 1 -- 172.21.15.3:0/2980360489 shutdown_connections 2024-09-19T06:02:44.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.006+0000 7fa716400640 1 --2- 172.21.15.3:0/2980360489 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa710103610 0x7fa710103a10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:44.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.006+0000 7fa716400640 1 -- 172.21.15.3:0/2980360489 >> 172.21.15.3:0/2980360489 conn(0x7fa7100feda0 msgr2=0x7fa7101011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:44.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.006+0000 7fa716400640 1 -- 172.21.15.3:0/2980360489 shutdown_connections 2024-09-19T06:02:44.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.006+0000 7fa716400640 1 -- 172.21.15.3:0/2980360489 wait complete. 2024-09-19T06:02:44.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.007+0000 7fa716400640 1 Processor -- start 2024-09-19T06:02:44.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.007+0000 7fa716400640 1 -- start start 2024-09-19T06:02:44.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.007+0000 7fa716400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa710103610 0x7fa710198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:44.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.007+0000 7fa716400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa710109720 con 0x7fa710103610 2024-09-19T06:02:44.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.008+0000 7fa715000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa710103610 0x7fa710198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:44.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.008+0000 7fa715000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa710103610 0x7fa710198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47746/0 (socket says 172.21.15.3:47746) 2024-09-19T06:02:44.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.008+0000 7fa715000640 1 -- 172.21.15.3:0/507951275 learned_addr learned my addr 172.21.15.3:0/507951275 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:44.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.008+0000 7fa715000640 1 -- 172.21.15.3:0/507951275 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa710199310 con 0x7fa710103610 2024-09-19T06:02:44.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.008+0000 7fa715000640 1 --2- 172.21.15.3:0/507951275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa710103610 0x7fa710198dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa704004f60 tx=0x7fa7040048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:44.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.009+0000 7fa70d600640 1 -- 172.21.15.3:0/507951275 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa70403f070 con 0x7fa710103610 2024-09-19T06:02:44.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.009+0000 7fa70d600640 1 -- 172.21.15.3:0/507951275 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa704004cc0 con 0x7fa710103610 2024-09-19T06:02:44.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.009+0000 7fa716400640 1 -- 172.21.15.3:0/507951275 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7101995a0 con 0x7fa710103610 2024-09-19T06:02:44.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.009+0000 7fa70d600640 1 -- 172.21.15.3:0/507951275 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa704035030 con 0x7fa710103610 2024-09-19T06:02:44.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.009+0000 7fa716400640 1 -- 172.21.15.3:0/507951275 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa71019c290 con 0x7fa710103610 2024-09-19T06:02:44.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.010+0000 7fa70d600640 1 -- 172.21.15.3:0/507951275 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fa704042070 con 0x7fa710103610 2024-09-19T06:02:44.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.010+0000 7fa716400640 1 -- 172.21.15.3:0/507951275 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa710109ea0 con 0x7fa710103610 2024-09-19T06:02:44.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.011+0000 7fa70d600640 1 --2- 172.21.15.3:0/507951275 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa6f80392a0 0x7fa6f803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:44.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.011+0000 7fa70d600640 1 -- 172.21.15.3:0/507951275 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa70406d030 con 0x7fa710103610 2024-09-19T06:02:44.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.011+0000 7fa70fe00640 1 --2- 172.21.15.3:0/507951275 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa6f80392a0 0x7fa6f803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:44.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.012+0000 7fa70fe00640 1 --2- 172.21.15.3:0/507951275 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa6f80392a0 0x7fa6f803b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0098c0 tx=0x7fa6fc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:44.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.016+0000 7fa70d600640 1 -- 172.21.15.3:0/507951275 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa7040035f0 con 0x7fa710103610 2024-09-19T06:02:44.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.209+0000 7fa716400640 1 -- 172.21.15.3:0/507951275 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fa71002d830 con 0x7fa6f80392a0 2024-09-19T06:02:44.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.213+0000 7fa70d600640 1 -- 172.21.15.3:0/507951275 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa71002d830 con 0x7fa6f80392a0 2024-09-19T06:02:44.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.216+0000 7fa716400640 1 -- 172.21.15.3:0/507951275 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa6f80392a0 msgr2=0x7fa6f803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:44.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.216+0000 7fa716400640 1 --2- 172.21.15.3:0/507951275 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa6f80392a0 0x7fa6f803b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0098c0 tx=0x7fa6fc006db0 comp rx=0 tx=0).stop 2024-09-19T06:02:44.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.216+0000 7fa716400640 1 -- 172.21.15.3:0/507951275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa710103610 msgr2=0x7fa710198dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:44.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.216+0000 7fa716400640 1 --2- 172.21.15.3:0/507951275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa710103610 0x7fa710198dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa704004f60 tx=0x7fa7040048f0 comp rx=0 tx=0).stop 2024-09-19T06:02:44.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.216+0000 7fa716400640 1 -- 172.21.15.3:0/507951275 shutdown_connections 2024-09-19T06:02:44.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.216+0000 7fa716400640 1 --2- 172.21.15.3:0/507951275 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa6f80392a0 0x7fa6f803b760 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:44.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.216+0000 7fa716400640 1 --2- 172.21.15.3:0/507951275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa710103610 0x7fa710198dd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:44.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.216+0000 7fa716400640 1 -- 172.21.15.3:0/507951275 >> 172.21.15.3:0/507951275 conn(0x7fa7100feda0 msgr2=0x7fa7100ff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:44.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.217+0000 7fa716400640 1 -- 172.21.15.3:0/507951275 shutdown_connections 2024-09-19T06:02:44.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:44.217+0000 7fa716400640 1 -- 172.21.15.3:0/507951275 wait complete. 2024-09-19T06:02:45.091 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi059 2024-09-19T06:02:45.092 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-19T06:02:45.092 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/etc/ceph/ceph.conf 2024-09-19T06:02:45.110 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-19T06:02:45.110 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:02:45.168 INFO:tasks.cephadm:Adding host smithi059 to orchestrator... 2024-09-19T06:02:45.168 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph orch host add smithi059 2024-09-19T06:02:45.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:45 smithi003 ceph-mon[30893]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:45.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:45 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:45.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:45 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:45.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:45 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:45.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:45 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:45.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:45 smithi003 ceph-mon[30893]: Updating smithi003:/etc/ceph/ceph.conf 2024-09-19T06:02:45.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:45 smithi003 ceph-mon[30893]: Updating smithi003:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:02:45.902 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:02:46.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:46 smithi003 ceph-mon[30893]: Updating smithi003:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:02:46.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:46 smithi003 ceph-mon[30893]: Updating smithi003:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:02:46.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:46 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:46.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:46 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:46.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:46 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:46.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.481+0000 7f08b1200640 1 -- 172.21.15.3:0/3662113925 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f08ac107640 msgr2=0x7f08ac107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:46.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.481+0000 7f08b1200640 1 --2- 172.21.15.3:0/3662113925 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f08ac107640 0x7f08ac107a20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f089c009880 tx=0x7f089c02a5d0 comp rx=0 tx=0).stop 2024-09-19T06:02:46.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.482+0000 7f08b1200640 1 -- 172.21.15.3:0/3662113925 shutdown_connections 2024-09-19T06:02:46.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.482+0000 7f08b1200640 1 --2- 172.21.15.3:0/3662113925 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f08ac107640 0x7f08ac107a20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:46.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.482+0000 7f08b1200640 1 -- 172.21.15.3:0/3662113925 >> 172.21.15.3:0/3662113925 conn(0x7f08ac0fd230 msgr2=0x7f08ac0ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:46.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.482+0000 7f08b1200640 1 -- 172.21.15.3:0/3662113925 shutdown_connections 2024-09-19T06:02:46.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.482+0000 7f08b1200640 1 -- 172.21.15.3:0/3662113925 wait complete. 2024-09-19T06:02:46.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.483+0000 7f08b1200640 1 Processor -- start 2024-09-19T06:02:46.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.483+0000 7f08b1200640 1 -- start start 2024-09-19T06:02:46.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.483+0000 7f08b1200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f08ac107640 0x7f08ac0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:46.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.483+0000 7f08b1200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f08ac10bc70 con 0x7f08ac107640 2024-09-19T06:02:46.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.483+0000 7f08a9e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f08ac107640 0x7f08ac0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:46.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.483+0000 7f08a9e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f08ac107640 0x7f08ac0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47772/0 (socket says 172.21.15.3:47772) 2024-09-19T06:02:46.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.483+0000 7f08a9e00640 1 -- 172.21.15.3:0/2463762646 learned_addr learned my addr 172.21.15.3:0/2463762646 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:46.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.484+0000 7f08a9e00640 1 -- 172.21.15.3:0/2463762646 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08ac0763e0 con 0x7f08ac107640 2024-09-19T06:02:46.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.484+0000 7f08a9e00640 1 --2- 172.21.15.3:0/2463762646 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f08ac107640 0x7f08ac0744f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f089c009230 tx=0x7f089c003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:46.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.484+0000 7f08a2a00640 1 -- 172.21.15.3:0/2463762646 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f089c03f070 con 0x7f08ac107640 2024-09-19T06:02:46.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.484+0000 7f08a2a00640 1 -- 172.21.15.3:0/2463762646 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f089c03bd40 con 0x7f08ac107640 2024-09-19T06:02:46.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.484+0000 7f08b1200640 1 -- 172.21.15.3:0/2463762646 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08ac074a30 con 0x7f08ac107640 2024-09-19T06:02:46.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.484+0000 7f08a2a00640 1 -- 172.21.15.3:0/2463762646 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f089c035030 con 0x7f08ac107640 2024-09-19T06:02:46.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.485+0000 7f08b1200640 1 -- 172.21.15.3:0/2463762646 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08ac074ef0 con 0x7f08ac107640 2024-09-19T06:02:46.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.485+0000 7f08a2a00640 1 -- 172.21.15.3:0/2463762646 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f089c042070 con 0x7f08ac107640 2024-09-19T06:02:46.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.486+0000 7f08b1200640 1 -- 172.21.15.3:0/2463762646 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08ac102cb0 con 0x7f08ac107640 2024-09-19T06:02:46.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.486+0000 7f08a2a00640 1 --2- 172.21.15.3:0/2463762646 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f08900392a0 0x7f089003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:46.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.486+0000 7f08a2a00640 1 -- 172.21.15.3:0/2463762646 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f089c06cef0 con 0x7f08ac107640 2024-09-19T06:02:46.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.486+0000 7f08a3e00640 1 --2- 172.21.15.3:0/2463762646 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f08900392a0 0x7f089003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:46.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.487+0000 7f08a3e00640 1 --2- 172.21.15.3:0/2463762646 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f08900392a0 0x7f089003b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f08940098c0 tx=0x7f0894006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:46.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.491+0000 7f08a2a00640 1 -- 172.21.15.3:0/2463762646 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f089c03ac70 con 0x7f08ac107640 2024-09-19T06:02:46.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:46.677+0000 7f08b1200640 1 -- 172.21.15.3:0/2463762646 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi059", "target": ["mon-mgr", ""]}) -- 0x7f08ac075a90 con 0x7f08900392a0 2024-09-19T06:02:47.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:47 smithi003 ceph-mon[30893]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi059", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:48.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:48 smithi003 ceph-mon[30893]: Deploying cephadm binary to smithi059 2024-09-19T06:02:50.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:50.558+0000 7f08a2a00640 1 -- 172.21.15.3:0/2463762646 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f08ac075a90 con 0x7f08900392a0 2024-09-19T06:02:50.560 INFO:teuthology.orchestra.run.smithi003.stdout:Added host 'smithi059' with addr '172.21.15.59' 2024-09-19T06:02:50.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:50.560+0000 7f08b1200640 1 -- 172.21.15.3:0/2463762646 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f08900392a0 msgr2=0x7f089003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:50.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:50.560+0000 7f08b1200640 1 --2- 172.21.15.3:0/2463762646 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f08900392a0 0x7f089003b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f08940098c0 tx=0x7f0894006db0 comp rx=0 tx=0).stop 2024-09-19T06:02:50.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:50.561+0000 7f08b1200640 1 -- 172.21.15.3:0/2463762646 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f08ac107640 msgr2=0x7f08ac0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:50.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:50.561+0000 7f08b1200640 1 --2- 172.21.15.3:0/2463762646 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f08ac107640 0x7f08ac0744f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f089c009230 tx=0x7f089c003d80 comp rx=0 tx=0).stop 2024-09-19T06:02:50.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:50.561+0000 7f08b1200640 1 -- 172.21.15.3:0/2463762646 shutdown_connections 2024-09-19T06:02:50.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:50.561+0000 7f08b1200640 1 --2- 172.21.15.3:0/2463762646 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f08900392a0 0x7f089003b760 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:50.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:50.561+0000 7f08b1200640 1 --2- 172.21.15.3:0/2463762646 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f08ac107640 0x7f08ac0744f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:50.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:50.561+0000 7f08b1200640 1 -- 172.21.15.3:0/2463762646 >> 172.21.15.3:0/2463762646 conn(0x7f08ac0fd230 msgr2=0x7f08ac0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:50.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:50.561+0000 7f08b1200640 1 -- 172.21.15.3:0/2463762646 shutdown_connections 2024-09-19T06:02:50.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:50.561+0000 7f08b1200640 1 -- 172.21.15.3:0/2463762646 wait complete. 2024-09-19T06:02:51.322 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T06:02:51.695 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:02:51.833 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:51 smithi003 ceph-mon[30893]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:02:51.833 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:51 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:51.833 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:51 smithi003 ceph-mon[30893]: Added host smithi059 2024-09-19T06:02:51.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:51 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:51.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:51 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:51.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:51 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:52.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.247+0000 7f2f61400640 1 -- 172.21.15.3:0/3307356132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f5c076720 msgr2=0x7f2f5c076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:52.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.247+0000 7f2f61400640 1 --2- 172.21.15.3:0/3307356132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f5c076720 0x7f2f5c076b00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c009880 tx=0x7f2f4c02a5d0 comp rx=0 tx=0).stop 2024-09-19T06:02:52.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.247+0000 7f2f61400640 1 -- 172.21.15.3:0/3307356132 shutdown_connections 2024-09-19T06:02:52.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.247+0000 7f2f61400640 1 --2- 172.21.15.3:0/3307356132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f5c076720 0x7f2f5c076b00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:52.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.247+0000 7f2f61400640 1 -- 172.21.15.3:0/3307356132 >> 172.21.15.3:0/3307356132 conn(0x7f2f5c0ff2c0 msgr2=0x7f2f5c1016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:52.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.247+0000 7f2f61400640 1 -- 172.21.15.3:0/3307356132 shutdown_connections 2024-09-19T06:02:52.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.247+0000 7f2f61400640 1 -- 172.21.15.3:0/3307356132 wait complete. 2024-09-19T06:02:52.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.248+0000 7f2f61400640 1 Processor -- start 2024-09-19T06:02:52.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.248+0000 7f2f61400640 1 -- start start 2024-09-19T06:02:52.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.248+0000 7f2f61400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f5c076720 0x7f2f5c19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:52.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.248+0000 7f2f61400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c1121d0 con 0x7f2f5c076720 2024-09-19T06:02:52.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.249+0000 7f2f5be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f5c076720 0x7f2f5c19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:52.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.249+0000 7f2f5be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f5c076720 0x7f2f5c19d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47796/0 (socket says 172.21.15.3:47796) 2024-09-19T06:02:52.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.249+0000 7f2f5be00640 1 -- 172.21.15.3:0/2838328683 learned_addr learned my addr 172.21.15.3:0/2838328683 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:52.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.249+0000 7f2f5be00640 1 -- 172.21.15.3:0/2838328683 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c19dbf0 con 0x7f2f5c076720 2024-09-19T06:02:52.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.249+0000 7f2f5be00640 1 --2- 172.21.15.3:0/2838328683 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f5c076720 0x7f2f5c19d6b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c009230 tx=0x7f2f4c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:52.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.250+0000 7f2f58c00640 1 -- 172.21.15.3:0/2838328683 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f4c03f070 con 0x7f2f5c076720 2024-09-19T06:02:52.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.250+0000 7f2f61400640 1 -- 172.21.15.3:0/2838328683 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5c19de80 con 0x7f2f5c076720 2024-09-19T06:02:52.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.250+0000 7f2f58c00640 1 -- 172.21.15.3:0/2838328683 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f4c03bc80 con 0x7f2f5c076720 2024-09-19T06:02:52.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.250+0000 7f2f58c00640 1 -- 172.21.15.3:0/2838328683 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f4c035030 con 0x7f2f5c076720 2024-09-19T06:02:52.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.250+0000 7f2f61400640 1 -- 172.21.15.3:0/2838328683 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f5c19e2e0 con 0x7f2f5c076720 2024-09-19T06:02:52.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.251+0000 7f2f61400640 1 -- 172.21.15.3:0/2838328683 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f5c077e60 con 0x7f2f5c076720 2024-09-19T06:02:52.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.251+0000 7f2f58c00640 1 -- 172.21.15.3:0/2838328683 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f2f4c042070 con 0x7f2f5c076720 2024-09-19T06:02:52.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.251+0000 7f2f58c00640 1 --2- 172.21.15.3:0/2838328683 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f2f400392a0 0x7f2f4003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:52.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.252+0000 7f2f58c00640 1 -- 172.21.15.3:0/2838328683 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2f4c06d090 con 0x7f2f5c076720 2024-09-19T06:02:52.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.252+0000 7f2f5b400640 1 --2- 172.21.15.3:0/2838328683 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f2f400392a0 0x7f2f4003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:52.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.252+0000 7f2f5b400640 1 --2- 172.21.15.3:0/2838328683 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f2f400392a0 0x7f2f4003b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2f480098c0 tx=0x7f2f48006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:52.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.257+0000 7f2f58c00640 1 -- 172.21.15.3:0/2838328683 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2f4c031e20 con 0x7f2f5c076720 2024-09-19T06:02:52.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.446+0000 7f2f61400640 1 -- 172.21.15.3:0/2838328683 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2f5c19ea10 con 0x7f2f400392a0 2024-09-19T06:02:52.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.447+0000 7f2f58c00640 1 -- 172.21.15.3:0/2838328683 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+158 (secure 0 0 0) 0x7f2f5c19ea10 con 0x7f2f400392a0 2024-09-19T06:02:52.448 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:02:52.449 INFO:teuthology.orchestra.run.smithi003.stdout:[{"addr": "172.21.15.3", "hostname": "smithi003", "labels": [], "status": ""}, {"addr": "172.21.15.59", "hostname": "smithi059", "labels": [], "status": ""}] 2024-09-19T06:02:52.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.450+0000 7f2f61400640 1 -- 172.21.15.3:0/2838328683 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f2f400392a0 msgr2=0x7f2f4003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:52.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.450+0000 7f2f61400640 1 --2- 172.21.15.3:0/2838328683 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f2f400392a0 0x7f2f4003b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2f480098c0 tx=0x7f2f48006db0 comp rx=0 tx=0).stop 2024-09-19T06:02:52.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.450+0000 7f2f61400640 1 -- 172.21.15.3:0/2838328683 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f5c076720 msgr2=0x7f2f5c19d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:52.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.450+0000 7f2f61400640 1 --2- 172.21.15.3:0/2838328683 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f5c076720 0x7f2f5c19d6b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c009230 tx=0x7f2f4c003d40 comp rx=0 tx=0).stop 2024-09-19T06:02:52.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.450+0000 7f2f61400640 1 -- 172.21.15.3:0/2838328683 shutdown_connections 2024-09-19T06:02:52.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.450+0000 7f2f61400640 1 --2- 172.21.15.3:0/2838328683 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f2f400392a0 0x7f2f4003b760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:52.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.450+0000 7f2f61400640 1 --2- 172.21.15.3:0/2838328683 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f5c076720 0x7f2f5c19d6b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:52.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.450+0000 7f2f61400640 1 -- 172.21.15.3:0/2838328683 >> 172.21.15.3:0/2838328683 conn(0x7f2f5c0ff2c0 msgr2=0x7f2f5c10dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:52.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.450+0000 7f2f61400640 1 -- 172.21.15.3:0/2838328683 shutdown_connections 2024-09-19T06:02:52.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:52.450+0000 7f2f61400640 1 -- 172.21.15.3:0/2838328683 wait complete. 2024-09-19T06:02:53.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:52 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:53.179 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi071 2024-09-19T06:02:53.180 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-19T06:02:53.180 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/etc/ceph/ceph.conf 2024-09-19T06:02:53.199 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-19T06:02:53.199 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:02:53.257 INFO:tasks.cephadm:Adding host smithi071 to orchestrator... 2024-09-19T06:02:53.258 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph orch host add smithi071 2024-09-19T06:02:53.639 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:02:54.034 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:53 smithi003 ceph-mon[30893]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:02:54.035 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:53 smithi003 ceph-mon[30893]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:02:54.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.147+0000 7f0590c00640 1 -- 172.21.15.3:0/142712935 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f058c101610 msgr2=0x7f058c1019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:54.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.147+0000 7f0590c00640 1 --2- 172.21.15.3:0/142712935 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f058c101610 0x7f058c1019f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f057c009880 tx=0x7f057c02a5d0 comp rx=0 tx=0).stop 2024-09-19T06:02:54.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.147+0000 7f0590c00640 1 -- 172.21.15.3:0/142712935 shutdown_connections 2024-09-19T06:02:54.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.147+0000 7f0590c00640 1 --2- 172.21.15.3:0/142712935 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f058c101610 0x7f058c1019f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:54.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.147+0000 7f0590c00640 1 -- 172.21.15.3:0/142712935 >> 172.21.15.3:0/142712935 conn(0x7f058c0fd0b0 msgr2=0x7f058c0ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:54.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.147+0000 7f0590c00640 1 -- 172.21.15.3:0/142712935 shutdown_connections 2024-09-19T06:02:54.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.147+0000 7f0590c00640 1 -- 172.21.15.3:0/142712935 wait complete. 2024-09-19T06:02:54.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.148+0000 7f0590c00640 1 Processor -- start 2024-09-19T06:02:54.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.148+0000 7f0590c00640 1 -- start start 2024-09-19T06:02:54.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.149+0000 7f0590c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f058c101610 0x7f058c196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:54.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.149+0000 7f0590c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f058c10ba60 con 0x7f058c101610 2024-09-19T06:02:54.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.149+0000 7f058b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f058c101610 0x7f058c196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:54.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.149+0000 7f058b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f058c101610 0x7f058c196f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40624/0 (socket says 172.21.15.3:40624) 2024-09-19T06:02:54.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.149+0000 7f058b400640 1 -- 172.21.15.3:0/1403593870 learned_addr learned my addr 172.21.15.3:0/1403593870 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:54.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.149+0000 7f058b400640 1 -- 172.21.15.3:0/1403593870 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058c1974d0 con 0x7f058c101610 2024-09-19T06:02:54.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.150+0000 7f058b400640 1 --2- 172.21.15.3:0/1403593870 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f058c101610 0x7f058c196f90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f057c009230 tx=0x7f057c003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:54.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.150+0000 7f0588c00640 1 -- 172.21.15.3:0/1403593870 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f057c03f070 con 0x7f058c101610 2024-09-19T06:02:54.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.150+0000 7f0588c00640 1 -- 172.21.15.3:0/1403593870 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f057c03bd40 con 0x7f058c101610 2024-09-19T06:02:54.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.150+0000 7f0590c00640 1 -- 172.21.15.3:0/1403593870 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f058c1977c0 con 0x7f058c101610 2024-09-19T06:02:54.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.150+0000 7f0588c00640 1 -- 172.21.15.3:0/1403593870 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f057c035030 con 0x7f058c101610 2024-09-19T06:02:54.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.150+0000 7f0590c00640 1 -- 172.21.15.3:0/1403593870 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f058c19b860 con 0x7f058c101610 2024-09-19T06:02:54.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.151+0000 7f0590c00640 1 -- 172.21.15.3:0/1403593870 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f058c102af0 con 0x7f058c101610 2024-09-19T06:02:54.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.151+0000 7f0588c00640 1 -- 172.21.15.3:0/1403593870 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f057c042070 con 0x7f058c101610 2024-09-19T06:02:54.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.152+0000 7f0588c00640 1 --2- 172.21.15.3:0/1403593870 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f05700392a0 0x7f057003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:54.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.152+0000 7f0588c00640 1 -- 172.21.15.3:0/1403593870 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f057c06cfb0 con 0x7f058c101610 2024-09-19T06:02:54.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.152+0000 7f0583e00640 1 --2- 172.21.15.3:0/1403593870 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f05700392a0 0x7f057003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:54.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.153+0000 7f0583e00640 1 --2- 172.21.15.3:0/1403593870 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f05700392a0 0x7f057003b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f05740098c0 tx=0x7f0574006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:54.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.157+0000 7f0588c00640 1 -- 172.21.15.3:0/1403593870 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f057c030d60 con 0x7f058c101610 2024-09-19T06:02:54.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:54.344+0000 7f0590c00640 1 -- 172.21.15.3:0/1403593870 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi071", "target": ["mon-mgr", ""]}) -- 0x7f058c1982f0 con 0x7f05700392a0 2024-09-19T06:02:55.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:55 smithi003 ceph-mon[30893]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:02:55.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:55 smithi003 ceph-mon[30893]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi071", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:02:55.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:55 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:55.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:55 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:55.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:55 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:55.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:55 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:55.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:55 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi059", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:02:55.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:55 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:02:55.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:55 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:02:55.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:55 smithi003 ceph-mon[30893]: Updating smithi059:/etc/ceph/ceph.conf 2024-09-19T06:02:55.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:55 smithi003 ceph-mon[30893]: Updating smithi059:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:02:55.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:55 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:55.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:55 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:55.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:55 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:56.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:56 smithi003 ceph-mon[30893]: Updating smithi059:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:02:56.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:56 smithi003 ceph-mon[30893]: Updating smithi059:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:02:56.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:56 smithi003 ceph-mon[30893]: Deploying cephadm binary to smithi071 2024-09-19T06:02:58.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:57 smithi003 ceph-mon[30893]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:02:58.209 INFO:teuthology.orchestra.run.smithi003.stdout:Added host 'smithi071' with addr '172.21.15.71' 2024-09-19T06:02:58.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:58.207+0000 7f0588c00640 1 -- 172.21.15.3:0/1403593870 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f058c1982f0 con 0x7f05700392a0 2024-09-19T06:02:58.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:58.210+0000 7f0590c00640 1 -- 172.21.15.3:0/1403593870 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f05700392a0 msgr2=0x7f057003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:58.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:58.210+0000 7f0590c00640 1 --2- 172.21.15.3:0/1403593870 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f05700392a0 0x7f057003b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f05740098c0 tx=0x7f0574006db0 comp rx=0 tx=0).stop 2024-09-19T06:02:58.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:58.210+0000 7f0590c00640 1 -- 172.21.15.3:0/1403593870 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f058c101610 msgr2=0x7f058c196f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:58.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:58.210+0000 7f0590c00640 1 --2- 172.21.15.3:0/1403593870 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f058c101610 0x7f058c196f90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f057c009230 tx=0x7f057c003d80 comp rx=0 tx=0).stop 2024-09-19T06:02:58.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:58.210+0000 7f0590c00640 1 -- 172.21.15.3:0/1403593870 shutdown_connections 2024-09-19T06:02:58.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:58.210+0000 7f0590c00640 1 --2- 172.21.15.3:0/1403593870 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f05700392a0 0x7f057003b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:58.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:58.210+0000 7f0590c00640 1 --2- 172.21.15.3:0/1403593870 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f058c101610 0x7f058c196f90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:58.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:58.210+0000 7f0590c00640 1 -- 172.21.15.3:0/1403593870 >> 172.21.15.3:0/1403593870 conn(0x7f058c0fd0b0 msgr2=0x7f058c109070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:58.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:58.210+0000 7f0590c00640 1 -- 172.21.15.3:0/1403593870 shutdown_connections 2024-09-19T06:02:58.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:58.210+0000 7f0590c00640 1 -- 172.21.15.3:0/1403593870 wait complete. 2024-09-19T06:02:58.928 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T06:02:59.296 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:02:59.546 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:59 smithi003 ceph-mon[30893]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:02:59.546 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:59 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:59.546 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:59 smithi003 ceph-mon[30893]: Added host smithi071 2024-09-19T06:02:59.546 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:59 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:02:59.546 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:59 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:59.546 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:02:59 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:02:59.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.805+0000 7fad56e00640 1 -- 172.21.15.3:0/1978361955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad50107660 msgr2=0x7fad50107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:02:59.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.805+0000 7fad56e00640 1 --2- 172.21.15.3:0/1978361955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad50107660 0x7fad50107a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fad40009880 tx=0x7fad4002a5d0 comp rx=0 tx=0).stop 2024-09-19T06:02:59.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.805+0000 7fad56e00640 1 -- 172.21.15.3:0/1978361955 shutdown_connections 2024-09-19T06:02:59.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.805+0000 7fad56e00640 1 --2- 172.21.15.3:0/1978361955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad50107660 0x7fad50107a40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:02:59.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.805+0000 7fad56e00640 1 -- 172.21.15.3:0/1978361955 >> 172.21.15.3:0/1978361955 conn(0x7fad500fd290 msgr2=0x7fad500ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:02:59.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.805+0000 7fad56e00640 1 -- 172.21.15.3:0/1978361955 shutdown_connections 2024-09-19T06:02:59.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.805+0000 7fad56e00640 1 -- 172.21.15.3:0/1978361955 wait complete. 2024-09-19T06:02:59.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.806+0000 7fad56e00640 1 Processor -- start 2024-09-19T06:02:59.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.806+0000 7fad56e00640 1 -- start start 2024-09-19T06:02:59.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.807+0000 7fad56e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad50107660 0x7fad500744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:59.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.807+0000 7fad56e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fad5010bc90 con 0x7fad50107660 2024-09-19T06:02:59.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.807+0000 7fad4fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad50107660 0x7fad500744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:59.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.807+0000 7fad4fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad50107660 0x7fad500744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40638/0 (socket says 172.21.15.3:40638) 2024-09-19T06:02:59.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.807+0000 7fad4fe00640 1 -- 172.21.15.3:0/4112345684 learned_addr learned my addr 172.21.15.3:0/4112345684 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:02:59.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.807+0000 7fad4fe00640 1 -- 172.21.15.3:0/4112345684 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad500763e0 con 0x7fad50107660 2024-09-19T06:02:59.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.808+0000 7fad4fe00640 1 --2- 172.21.15.3:0/4112345684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad50107660 0x7fad500744f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fad40009230 tx=0x7fad40003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:59.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.808+0000 7fad4cc00640 1 -- 172.21.15.3:0/4112345684 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad4003f070 con 0x7fad50107660 2024-09-19T06:02:59.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.808+0000 7fad4cc00640 1 -- 172.21.15.3:0/4112345684 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad4003bc80 con 0x7fad50107660 2024-09-19T06:02:59.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.808+0000 7fad56e00640 1 -- 172.21.15.3:0/4112345684 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad50074a30 con 0x7fad50107660 2024-09-19T06:02:59.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.808+0000 7fad4cc00640 1 -- 172.21.15.3:0/4112345684 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad40035030 con 0x7fad50107660 2024-09-19T06:02:59.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.808+0000 7fad56e00640 1 -- 172.21.15.3:0/4112345684 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad50074ef0 con 0x7fad50107660 2024-09-19T06:02:59.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.809+0000 7fad4cc00640 1 -- 172.21.15.3:0/4112345684 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fad40042070 con 0x7fad50107660 2024-09-19T06:02:59.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.810+0000 7fad56e00640 1 -- 172.21.15.3:0/4112345684 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad50102cd0 con 0x7fad50107660 2024-09-19T06:02:59.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.810+0000 7fad4cc00640 1 --2- 172.21.15.3:0/4112345684 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fad340392a0 0x7fad3403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:02:59.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.810+0000 7fad4cc00640 1 -- 172.21.15.3:0/4112345684 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fad4006cd30 con 0x7fad50107660 2024-09-19T06:02:59.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.810+0000 7fad4f400640 1 --2- 172.21.15.3:0/4112345684 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fad340392a0 0x7fad3403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:02:59.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.811+0000 7fad4f400640 1 --2- 172.21.15.3:0/4112345684 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fad340392a0 0x7fad3403b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0098c0 tx=0x7fad3c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:02:59.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:02:59.815+0000 7fad4cc00640 1 -- 172.21.15.3:0/4112345684 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fad40031e20 con 0x7fad50107660 2024-09-19T06:03:00.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:00.005+0000 7fad56e00640 1 -- 172.21.15.3:0/4112345684 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fad50075a90 con 0x7fad340392a0 2024-09-19T06:03:00.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:00.006+0000 7fad4cc00640 1 -- 172.21.15.3:0/4112345684 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+237 (secure 0 0 0) 0x7fad50075a90 con 0x7fad340392a0 2024-09-19T06:03:00.007 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:03:00.007 INFO:teuthology.orchestra.run.smithi003.stdout:[{"addr": "172.21.15.3", "hostname": "smithi003", "labels": [], "status": ""}, {"addr": "172.21.15.59", "hostname": "smithi059", "labels": [], "status": ""}, {"addr": "172.21.15.71", "hostname": "smithi071", "labels": [], "status": ""}] 2024-09-19T06:03:00.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:00.008+0000 7fad56e00640 1 -- 172.21.15.3:0/4112345684 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fad340392a0 msgr2=0x7fad3403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:00.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:00.008+0000 7fad56e00640 1 --2- 172.21.15.3:0/4112345684 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fad340392a0 0x7fad3403b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0098c0 tx=0x7fad3c006db0 comp rx=0 tx=0).stop 2024-09-19T06:03:00.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:00.008+0000 7fad56e00640 1 -- 172.21.15.3:0/4112345684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad50107660 msgr2=0x7fad500744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:00.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:00.008+0000 7fad56e00640 1 --2- 172.21.15.3:0/4112345684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad50107660 0x7fad500744f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fad40009230 tx=0x7fad40003d40 comp rx=0 tx=0).stop 2024-09-19T06:03:00.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:00.008+0000 7fad56e00640 1 -- 172.21.15.3:0/4112345684 shutdown_connections 2024-09-19T06:03:00.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:00.008+0000 7fad56e00640 1 --2- 172.21.15.3:0/4112345684 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fad340392a0 0x7fad3403b760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:00.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:00.008+0000 7fad56e00640 1 --2- 172.21.15.3:0/4112345684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad50107660 0x7fad500744f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:00.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:00.008+0000 7fad56e00640 1 -- 172.21.15.3:0/4112345684 >> 172.21.15.3:0/4112345684 conn(0x7fad500fd290 msgr2=0x7fad500feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:00.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:00.009+0000 7fad56e00640 1 -- 172.21.15.3:0/4112345684 shutdown_connections 2024-09-19T06:03:00.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:00.009+0000 7fad56e00640 1 -- 172.21.15.3:0/4112345684 wait complete. 2024-09-19T06:03:00.643 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:00 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:00.644 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:00 smithi003 ceph-mon[30893]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:03:00.682 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T06:03:00.682 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T06:03:01.046 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:03:01.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.602+0000 7f482c200640 1 -- 172.21.15.3:0/3078199312 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4824074590 msgr2=0x7f4824074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:01.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.602+0000 7f482c200640 1 --2- 172.21.15.3:0/3078199312 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4824074590 0x7f4824074970 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4818009880 tx=0x7f481802a670 comp rx=0 tx=0).stop 2024-09-19T06:03:01.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.602+0000 7f482c200640 1 -- 172.21.15.3:0/3078199312 shutdown_connections 2024-09-19T06:03:01.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.602+0000 7f482c200640 1 --2- 172.21.15.3:0/3078199312 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4824074590 0x7f4824074970 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:01.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.602+0000 7f482c200640 1 -- 172.21.15.3:0/3078199312 >> 172.21.15.3:0/3078199312 conn(0x7f48240fd290 msgr2=0x7f48240ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:01.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.602+0000 7f482c200640 1 -- 172.21.15.3:0/3078199312 shutdown_connections 2024-09-19T06:03:01.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.602+0000 7f482c200640 1 -- 172.21.15.3:0/3078199312 wait complete. 2024-09-19T06:03:01.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.603+0000 7f482c200640 1 Processor -- start 2024-09-19T06:03:01.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.603+0000 7f482c200640 1 -- start start 2024-09-19T06:03:01.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.604+0000 7f482c200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4824074590 0x7f48241a3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:01.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.604+0000 7f482c200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f48241122b0 con 0x7f4824074590 2024-09-19T06:03:01.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.604+0000 7f4829800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4824074590 0x7f48241a3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:01.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.604+0000 7f4829800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4824074590 0x7f48241a3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40646/0 (socket says 172.21.15.3:40646) 2024-09-19T06:03:01.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.604+0000 7f4829800640 1 -- 172.21.15.3:0/3559397547 learned_addr learned my addr 172.21.15.3:0/3559397547 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:03:01.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.604+0000 7f4829800640 1 -- 172.21.15.3:0/3559397547 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48241a3950 con 0x7f4824074590 2024-09-19T06:03:01.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.605+0000 7f4829800640 1 --2- 172.21.15.3:0/3559397547 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4824074590 0x7f48241a3410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4818009230 tx=0x7f4818003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:01.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.605+0000 7f4822000640 1 -- 172.21.15.3:0/3559397547 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f481803f070 con 0x7f4824074590 2024-09-19T06:03:01.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.605+0000 7f4822000640 1 -- 172.21.15.3:0/3559397547 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f481803bc80 con 0x7f4824074590 2024-09-19T06:03:01.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.605+0000 7f482c200640 1 -- 172.21.15.3:0/3559397547 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48241a3be0 con 0x7f4824074590 2024-09-19T06:03:01.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.605+0000 7f4822000640 1 -- 172.21.15.3:0/3559397547 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4818035030 con 0x7f4824074590 2024-09-19T06:03:01.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.605+0000 7f482c200640 1 -- 172.21.15.3:0/3559397547 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f482419d5d0 con 0x7f4824074590 2024-09-19T06:03:01.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.606+0000 7f4822000640 1 -- 172.21.15.3:0/3559397547 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f4818042070 con 0x7f4824074590 2024-09-19T06:03:01.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.606+0000 7f482c200640 1 -- 172.21.15.3:0/3559397547 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4824075cd0 con 0x7f4824074590 2024-09-19T06:03:01.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.607+0000 7f4822000640 1 --2- 172.21.15.3:0/3559397547 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f480c0392a0 0x7f480c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:01.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.607+0000 7f4822000640 1 -- 172.21.15.3:0/3559397547 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f481806d0b0 con 0x7f4824074590 2024-09-19T06:03:01.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.607+0000 7f4828e00640 1 --2- 172.21.15.3:0/3559397547 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f480c0392a0 0x7f480c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:01.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.608+0000 7f4828e00640 1 --2- 172.21.15.3:0/3559397547 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f480c0392a0 0x7f480c03b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f48100098c0 tx=0x7f4810006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:01.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.612+0000 7f4822000640 1 -- 172.21.15.3:0/3559397547 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4818031e20 con 0x7f4824074590 2024-09-19T06:03:01.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:01.803+0000 7f482c200640 1 -- 172.21.15.3:0/3559397547 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f482419eb00 con 0x7f4824074590 2024-09-19T06:03:01.806 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:01 smithi003 ceph-mon[30893]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:02.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:02.560+0000 7f4822000640 1 -- 172.21.15.3:0/3559397547 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f4818031570 con 0x7f4824074590 2024-09-19T06:03:02.563 INFO:teuthology.orchestra.run.smithi003.stderr:adjusted tunables profile to default 2024-09-19T06:03:02.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:02.563+0000 7f482c200640 1 -- 172.21.15.3:0/3559397547 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f480c0392a0 msgr2=0x7f480c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:02.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:02.563+0000 7f482c200640 1 --2- 172.21.15.3:0/3559397547 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f480c0392a0 0x7f480c03b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f48100098c0 tx=0x7f4810006db0 comp rx=0 tx=0).stop 2024-09-19T06:03:02.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:02.563+0000 7f482c200640 1 -- 172.21.15.3:0/3559397547 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4824074590 msgr2=0x7f48241a3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:02.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:02.563+0000 7f482c200640 1 --2- 172.21.15.3:0/3559397547 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4824074590 0x7f48241a3410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4818009230 tx=0x7f4818003d40 comp rx=0 tx=0).stop 2024-09-19T06:03:02.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:02.563+0000 7f482c200640 1 -- 172.21.15.3:0/3559397547 shutdown_connections 2024-09-19T06:03:02.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:02.563+0000 7f482c200640 1 --2- 172.21.15.3:0/3559397547 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f480c0392a0 0x7f480c03b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:02.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:02.563+0000 7f482c200640 1 --2- 172.21.15.3:0/3559397547 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4824074590 0x7f48241a3410 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:02.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:02.563+0000 7f482c200640 1 -- 172.21.15.3:0/3559397547 >> 172.21.15.3:0/3559397547 conn(0x7f48240fd290 msgr2=0x7f48240fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:02.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:02.563+0000 7f482c200640 1 -- 172.21.15.3:0/3559397547 shutdown_connections 2024-09-19T06:03:02.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:02.563+0000 7f482c200640 1 -- 172.21.15.3:0/3559397547 wait complete. 2024-09-19T06:03:02.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:02 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3559397547' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T06:03:02.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:02 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:02.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:02 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:02.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:02 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:02.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:02 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:02.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:02 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi071", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:03:02.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:02 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:02.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:02 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:03.305 INFO:tasks.cephadm:Adding mon.a on smithi003 2024-09-19T06:03:03.305 INFO:tasks.cephadm:Adding mon.b on smithi059 2024-09-19T06:03:03.306 INFO:tasks.cephadm:Adding mon.c on smithi071 2024-09-19T06:03:03.306 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi003:172.21.15.3=a;smithi059:172.21.15.59=b;smithi071:172.21.15.71=c' 2024-09-19T06:03:03.539 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:03:03.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:03 smithi003 ceph-mon[30893]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:03.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:03 smithi003 ceph-mon[30893]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-19T06:03:03.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:03 smithi003 ceph-mon[30893]: Updating smithi071:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:03:03.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:03 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3559397547' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T06:03:03.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:03 smithi003 ceph-mon[30893]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:03:03.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:03 smithi003 ceph-mon[30893]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:03:03.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:03 smithi003 ceph-mon[30893]: Updating smithi071:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:03:03.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:03 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:03.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:03 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:03.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:03 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:03.936 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.932+0000 7f06f1ae2640 1 -- 172.21.15.71:0/661295215 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06ec106570 msgr2=0x7f06ec106950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:03.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.932+0000 7f06f1ae2640 1 --2- 172.21.15.71:0/661295215 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06ec106570 0x7f06ec106950 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f06dc009c20 tx=0x7f06dc02aa90 comp rx=0 tx=0).stop 2024-09-19T06:03:03.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.932+0000 7f06f1ae2640 1 -- 172.21.15.71:0/661295215 shutdown_connections 2024-09-19T06:03:03.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.932+0000 7f06f1ae2640 1 --2- 172.21.15.71:0/661295215 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06ec106570 0x7f06ec106950 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:03.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.932+0000 7f06f1ae2640 1 -- 172.21.15.71:0/661295215 >> 172.21.15.71:0/661295215 conn(0x7f06ec0fc1a0 msgr2=0x7f06ec0fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:03.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.932+0000 7f06f1ae2640 1 -- 172.21.15.71:0/661295215 shutdown_connections 2024-09-19T06:03:03.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.932+0000 7f06f1ae2640 1 -- 172.21.15.71:0/661295215 wait complete. 2024-09-19T06:03:03.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.933+0000 7f06f1ae2640 1 Processor -- start 2024-09-19T06:03:03.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.934+0000 7f06f1ae2640 1 -- start start 2024-09-19T06:03:03.937 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.934+0000 7f06f1ae2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06ec106570 0x7f06ec0fc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:03.938 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.934+0000 7f06f1ae2640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec10aba0 con 0x7f06ec106570 2024-09-19T06:03:03.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.934+0000 7f06eb7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06ec106570 0x7f06ec0fc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:03.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.934+0000 7f06eb7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06ec106570 0x7f06ec0fc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.71:38330/0 (socket says 172.21.15.71:38330) 2024-09-19T06:03:03.940 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.934+0000 7f06eb7fe640 1 -- 172.21.15.71:0/2567662180 learned_addr learned my addr 172.21.15.71:0/2567662180 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-19T06:03:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.935+0000 7f06eb7fe640 1 -- 172.21.15.71:0/2567662180 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ec0fe290 con 0x7f06ec106570 2024-09-19T06:03:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.935+0000 7f06eb7fe640 1 --2- 172.21.15.71:0/2567662180 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06ec106570 0x7f06ec0fc650 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f06dc005e30 tx=0x7f06dc02fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.935+0000 7f06e8ff9640 1 -- 172.21.15.71:0/2567662180 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06dc047070 con 0x7f06ec106570 2024-09-19T06:03:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.935+0000 7f06f1ae2640 1 -- 172.21.15.71:0/2567662180 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06ec0fe520 con 0x7f06ec106570 2024-09-19T06:03:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.935+0000 7f06e8ff9640 1 -- 172.21.15.71:0/2567662180 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06dc003df0 con 0x7f06ec106570 2024-09-19T06:03:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.935+0000 7f06e8ff9640 1 -- 172.21.15.71:0/2567662180 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06dc033050 con 0x7f06ec106570 2024-09-19T06:03:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.935+0000 7f06f1ae2640 1 -- 172.21.15.71:0/2567662180 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06ec0fcd60 con 0x7f06ec106570 2024-09-19T06:03:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.936+0000 7f06e8ff9640 1 -- 172.21.15.71:0/2567662180 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f06dc04a070 con 0x7f06ec106570 2024-09-19T06:03:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.936+0000 7f06e8ff9640 1 --2- 172.21.15.71:0/2567662180 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f06d40392a0 0x7f06d403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.936+0000 7f06f1ae2640 1 -- 172.21.15.71:0/2567662180 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06ec101be0 con 0x7f06ec106570 2024-09-19T06:03:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.936+0000 7f06e8ff9640 1 -- 172.21.15.71:0/2567662180 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f06dc03e030 con 0x7f06ec106570 2024-09-19T06:03:03.941 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.937+0000 7f06eaffd640 1 --2- 172.21.15.71:0/2567662180 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f06d40392a0 0x7f06d403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:03.942 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.937+0000 7f06eaffd640 1 --2- 172.21.15.71:0/2567662180 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f06d40392a0 0x7f06d403b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f06e00098c0 tx=0x7f06e0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:03.945 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:03.942+0000 7f06e8ff9640 1 -- 172.21.15.71:0/2567662180 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f06dc02b860 con 0x7f06ec106570 2024-09-19T06:03:04.121 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:04.118+0000 7f06f1ae2640 1 -- 172.21.15.71:0/2567662180 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi003:172.21.15.3=a;smithi059:172.21.15.59=b;smithi071:172.21.15.71=c", "target": ["mon-mgr", ""]}) -- 0x7f06ec0fdb80 con 0x7f06d40392a0 2024-09-19T06:03:04.128 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:04.125+0000 7f06e8ff9640 1 -- 172.21.15.71:0/2567662180 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f06ec0fdb80 con 0x7f06d40392a0 2024-09-19T06:03:04.128 INFO:teuthology.orchestra.run.smithi071.stdout:Scheduled mon update... 2024-09-19T06:03:04.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:04.127+0000 7f06f1ae2640 1 -- 172.21.15.71:0/2567662180 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f06d40392a0 msgr2=0x7f06d403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:04.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:04.127+0000 7f06f1ae2640 1 --2- 172.21.15.71:0/2567662180 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f06d40392a0 0x7f06d403b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f06e00098c0 tx=0x7f06e0006db0 comp rx=0 tx=0).stop 2024-09-19T06:03:04.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:04.127+0000 7f06f1ae2640 1 -- 172.21.15.71:0/2567662180 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06ec106570 msgr2=0x7f06ec0fc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:04.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:04.127+0000 7f06f1ae2640 1 --2- 172.21.15.71:0/2567662180 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06ec106570 0x7f06ec0fc650 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f06dc005e30 tx=0x7f06dc02fc10 comp rx=0 tx=0).stop 2024-09-19T06:03:04.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:04.127+0000 7f06f1ae2640 1 -- 172.21.15.71:0/2567662180 shutdown_connections 2024-09-19T06:03:04.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:04.127+0000 7f06f1ae2640 1 --2- 172.21.15.71:0/2567662180 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f06d40392a0 0x7f06d403b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:04.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:04.127+0000 7f06f1ae2640 1 --2- 172.21.15.71:0/2567662180 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06ec106570 0x7f06ec0fc650 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:04.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:04.127+0000 7f06f1ae2640 1 -- 172.21.15.71:0/2567662180 >> 172.21.15.71:0/2567662180 conn(0x7f06ec0fc1a0 msgr2=0x7f06ec069eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:04.130 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:04.127+0000 7f06f1ae2640 1 -- 172.21.15.71:0/2567662180 shutdown_connections 2024-09-19T06:03:04.131 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:04.127+0000 7f06f1ae2640 1 -- 172.21.15.71:0/2567662180 wait complete. 2024-09-19T06:03:04.752 DEBUG:teuthology.orchestra.run.smithi059:mon.b> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T06:03:04.755 DEBUG:teuthology.orchestra.run.smithi071:mon.c> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T06:03:04.758 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T06:03:04.758 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:03:05.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:05 smithi003 ceph-mon[30893]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:05.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:05 smithi003 ceph-mon[30893]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi003:172.21.15.3=a;smithi059:172.21.15.59=b;smithi071:172.21.15.71=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:03:05.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:05 smithi003 ceph-mon[30893]: Saving service mon spec with placement smithi003:172.21.15.3=a;smithi059:172.21.15.59=b;smithi071:172.21.15.71=c;count:3 2024-09-19T06:03:05.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:05 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:05.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:05 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:05.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:05 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:05.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:05 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:05.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:05 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:05.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:05 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:03:05.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:05 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:05.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:05 smithi003 ceph-mon[30893]: Deploying daemon mon.c on smithi071 2024-09-19T06:03:06.885 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:03:07.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.427+0000 7f19c9498640 1 -- 172.21.15.71:0/2733536606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19c4106670 msgr2=0x7f19c4106a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:07.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.428+0000 7f19c9498640 1 --2- 172.21.15.71:0/2733536606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19c4106670 0x7f19c4106a50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009880 tx=0x7f19b402a5d0 comp rx=0 tx=0).stop 2024-09-19T06:03:07.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.428+0000 7f19c9498640 1 -- 172.21.15.71:0/2733536606 shutdown_connections 2024-09-19T06:03:07.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.428+0000 7f19c9498640 1 --2- 172.21.15.71:0/2733536606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19c4106670 0x7f19c4106a50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:07.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.428+0000 7f19c9498640 1 -- 172.21.15.71:0/2733536606 >> 172.21.15.71:0/2733536606 conn(0x7f19c40fc280 msgr2=0x7f19c40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:07.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.428+0000 7f19c9498640 1 -- 172.21.15.71:0/2733536606 shutdown_connections 2024-09-19T06:03:07.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.428+0000 7f19c9498640 1 -- 172.21.15.71:0/2733536606 wait complete. 2024-09-19T06:03:07.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.428+0000 7f19c9498640 1 Processor -- start 2024-09-19T06:03:07.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.428+0000 7f19c9498640 1 -- start start 2024-09-19T06:03:07.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.429+0000 7f19c9498640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19c4106670 0x7f19c4198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:07.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.429+0000 7f19c9498640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f19c410aca0 con 0x7f19c4106670 2024-09-19T06:03:07.433 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.429+0000 7f19c2ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19c4106670 0x7f19c4198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:07.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.429+0000 7f19c2ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19c4106670 0x7f19c4198060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.71:38354/0 (socket says 172.21.15.71:38354) 2024-09-19T06:03:07.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.429+0000 7f19c2ffd640 1 -- 172.21.15.71:0/3477442483 learned_addr learned my addr 172.21.15.71:0/3477442483 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-19T06:03:07.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.429+0000 7f19c2ffd640 1 -- 172.21.15.71:0/3477442483 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19c41985a0 con 0x7f19c4106670 2024-09-19T06:03:07.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.430+0000 7f19c2ffd640 1 --2- 172.21.15.71:0/3477442483 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19c4106670 0x7f19c4198060 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009230 tx=0x7f19b4003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:07.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.430+0000 7f19abfff640 1 -- 172.21.15.71:0/3477442483 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b403f070 con 0x7f19c4106670 2024-09-19T06:03:07.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.430+0000 7f19c9498640 1 -- 172.21.15.71:0/3477442483 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19c4198830 con 0x7f19c4106670 2024-09-19T06:03:07.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.430+0000 7f19abfff640 1 -- 172.21.15.71:0/3477442483 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19b403bc80 con 0x7f19c4106670 2024-09-19T06:03:07.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.430+0000 7f19abfff640 1 -- 172.21.15.71:0/3477442483 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19b4035030 con 0x7f19c4106670 2024-09-19T06:03:07.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.430+0000 7f19c9498640 1 -- 172.21.15.71:0/3477442483 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19c4198c90 con 0x7f19c4106670 2024-09-19T06:03:07.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.431+0000 7f19abfff640 1 -- 172.21.15.71:0/3477442483 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f19b4042070 con 0x7f19c4106670 2024-09-19T06:03:07.434 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.431+0000 7f19c9498640 1 -- 172.21.15.71:0/3477442483 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19c4101ce0 con 0x7f19c4106670 2024-09-19T06:03:07.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.431+0000 7f19abfff640 1 --2- 172.21.15.71:0/3477442483 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f19ac039300 0x7f19ac03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:07.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.431+0000 7f19abfff640 1 -- 172.21.15.71:0/3477442483 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f19b406cfb0 con 0x7f19c4106670 2024-09-19T06:03:07.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.431+0000 7f19c27fc640 1 --2- 172.21.15.71:0/3477442483 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f19ac039300 0x7f19ac03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:07.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.432+0000 7f19c27fc640 1 --2- 172.21.15.71:0/3477442483 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f19ac039300 0x7f19ac03b7c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f19b80098c0 tx=0x7f19b8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:07.439 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.437+0000 7f19abfff640 1 -- 172.21.15.71:0/3477442483 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f19b40372d0 con 0x7f19c4106670 2024-09-19T06:03:07.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:07 smithi003 ceph-mon[30893]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:07.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.687+0000 7f19c9498640 1 -- 172.21.15.71:0/3477442483 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f19c4106ad0 con 0x7f19c4106670 2024-09-19T06:03:07.690 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.688+0000 7f19abfff640 1 -- 172.21.15.71:0/3477442483 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7f19b4031dd0 con 0x7f19c4106670 2024-09-19T06:03:07.691 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-19T06:03:07.691 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":1,"fsid":"782a5144-764c-11ef-bceb-c7b262605968","modified":"2024-09-19T06:01:31.421310Z","created":"2024-09-19T06:01:31.421310Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T06:03:07.691 INFO:teuthology.orchestra.run.smithi071.stderr:dumped monmap epoch 1 2024-09-19T06:03:07.692 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.690+0000 7f19c9498640 1 -- 172.21.15.71:0/3477442483 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f19ac039300 msgr2=0x7f19ac03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:07.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.690+0000 7f19c9498640 1 --2- 172.21.15.71:0/3477442483 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f19ac039300 0x7f19ac03b7c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f19b80098c0 tx=0x7f19b8006db0 comp rx=0 tx=0).stop 2024-09-19T06:03:07.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.690+0000 7f19c9498640 1 -- 172.21.15.71:0/3477442483 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19c4106670 msgr2=0x7f19c4198060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:07.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.690+0000 7f19c9498640 1 --2- 172.21.15.71:0/3477442483 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19c4106670 0x7f19c4198060 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009230 tx=0x7f19b4003d40 comp rx=0 tx=0).stop 2024-09-19T06:03:07.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.690+0000 7f19c9498640 1 -- 172.21.15.71:0/3477442483 shutdown_connections 2024-09-19T06:03:07.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.690+0000 7f19c9498640 1 --2- 172.21.15.71:0/3477442483 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f19ac039300 0x7f19ac03b7c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:07.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.690+0000 7f19c9498640 1 --2- 172.21.15.71:0/3477442483 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19c4106670 0x7f19c4198060 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:07.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.690+0000 7f19c9498640 1 -- 172.21.15.71:0/3477442483 >> 172.21.15.71:0/3477442483 conn(0x7f19c40fc280 msgr2=0x7f19c40fdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:07.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.690+0000 7f19c9498640 1 -- 172.21.15.71:0/3477442483 shutdown_connections 2024-09-19T06:03:07.693 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:07.690+0000 7f19c9498640 1 -- 172.21.15.71:0/3477442483 wait complete. 2024-09-19T06:03:08.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:08 smithi003 ceph-mon[30893]: from='client.? 172.21.15.71:0/3477442483' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:03:09.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:08 smithi071 systemd[1]: Started Ceph mon.c for 782a5144-764c-11ef-bceb-c7b262605968. 2024-09-19T06:03:09.297 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T06:03:09.297 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:03:09.543 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:03:14.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:14.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:03:14.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:03:14.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: mon.a calling monitor election 2024-09-19T06:03:14.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:03:14.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:14.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:03:14.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: mon.c calling monitor election 2024-09-19T06:03:14.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:03:14.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:14.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:03:14.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:03:14.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T06:03:14.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: monmap epoch 2 2024-09-19T06:03:14.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: fsid 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:03:14.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: last_changed 2024-09-19T06:03:08.703403+0000 2024-09-19T06:03:14.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: created 2024-09-19T06:01:31.421310+0000 2024-09-19T06:03:14.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: min_mon_release 19 (squid) 2024-09-19T06:03:14.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: election_strategy: 1 2024-09-19T06:03:14.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2024-09-19T06:03:14.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: 1: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.c 2024-09-19T06:03:14.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: fsmap 2024-09-19T06:03:14.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:03:14.087 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: mgrmap e13: x(active, since 43s) 2024-09-19T06:03:14.087 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: overall HEALTH_OK 2024-09-19T06:03:14.087 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:14.087 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:14.087 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:14.087 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:03:14.087 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:13 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:14.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:14.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:03:14.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:03:14.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: mon.a calling monitor election 2024-09-19T06:03:14.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:03:14.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:14.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:03:14.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: mon.c calling monitor election 2024-09-19T06:03:14.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:03:14.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:14.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:03:14.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:03:14.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T06:03:14.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: monmap epoch 2 2024-09-19T06:03:14.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: fsid 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:03:14.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: last_changed 2024-09-19T06:03:08.703403+0000 2024-09-19T06:03:14.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: created 2024-09-19T06:01:31.421310+0000 2024-09-19T06:03:14.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: min_mon_release 19 (squid) 2024-09-19T06:03:14.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: election_strategy: 1 2024-09-19T06:03:14.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2024-09-19T06:03:14.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: 1: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.c 2024-09-19T06:03:14.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: fsmap 2024-09-19T06:03:14.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:03:14.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: mgrmap e13: x(active, since 43s) 2024-09-19T06:03:14.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: overall HEALTH_OK 2024-09-19T06:03:14.090 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:14.090 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:14.090 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:14.090 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:03:14.090 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:13 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:14.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.423+0000 7fb58c32a640 1 -- 172.21.15.71:0/3944733206 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb570003530 msgr2=0x7fb5700059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:14.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.423+0000 7fb58c32a640 1 --2- 172.21.15.71:0/3944733206 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb570003530 0x7fb5700059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb5841016e0 tx=0x7fb58002c490 comp rx=0 tx=0).stop 2024-09-19T06:03:14.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.423+0000 7fb58c32a640 1 -- 172.21.15.71:0/3944733206 shutdown_connections 2024-09-19T06:03:14.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.423+0000 7fb58c32a640 1 --2- 172.21.15.71:0/3944733206 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb570003530 0x7fb5700059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:14.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.423+0000 7fb58c32a640 1 -- 172.21.15.71:0/3944733206 >> 172.21.15.71:0/3944733206 conn(0x7fb5840fc280 msgr2=0x7fb5840fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:14.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.423+0000 7fb58c32a640 1 -- 172.21.15.71:0/3944733206 shutdown_connections 2024-09-19T06:03:14.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.423+0000 7fb58c32a640 1 -- 172.21.15.71:0/3944733206 wait complete. 2024-09-19T06:03:14.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.424+0000 7fb58c32a640 1 Processor -- start 2024-09-19T06:03:14.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.425+0000 7fb58c32a640 1 -- start start 2024-09-19T06:03:14.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.425+0000 7fb58c32a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb570003530 0x7fb5841972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:14.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.425+0000 7fb58c32a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb584197810 0x7fb58419bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:14.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.425+0000 7fb58c32a640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb5841086b0 con 0x7fb570003530 2024-09-19T06:03:14.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.425+0000 7fb58c32a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb584108530 con 0x7fb584197810 2024-09-19T06:03:14.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.425+0000 7fb5898c5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb584197810 0x7fb58419bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:14.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.425+0000 7fb5898c5640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb584197810 0x7fb58419bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58650/0 (socket says 172.21.15.71:58650) 2024-09-19T06:03:14.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.425+0000 7fb5898c5640 1 -- 172.21.15.71:0/2202915607 learned_addr learned my addr 172.21.15.71:0/2202915607 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-19T06:03:14.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.425+0000 7fb5898c5640 1 -- 172.21.15.71:0/2202915607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb584197810 msgr2=0x7fb58419bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T06:03:14.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.425+0000 7fb5898c5640 1 -- 172.21.15.71:0/2202915607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb584197810 msgr2=0x7fb58419bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T06:03:14.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.425+0000 7fb5898c5640 1 --2- 172.21.15.71:0/2202915607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb584197810 0x7fb58419bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T06:03:14.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.425+0000 7fb58a0c6640 1 --2- 172.21.15.71:0/2202915607 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb570003530 0x7fb5841972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.425+0000 7fb5898c5640 1 --2- 172.21.15.71:0/2202915607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb584197810 0x7fb58419bba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:03:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.426+0000 7fb58a0c6640 1 -- 172.21.15.71:0/2202915607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb584197810 msgr2=0x7fb58419bba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:03:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.426+0000 7fb58a0c6640 1 --2- 172.21.15.71:0/2202915607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb584197810 0x7fb58419bba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.426+0000 7fb58a0c6640 1 -- 172.21.15.71:0/2202915607 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb584197e30 con 0x7fb570003530 2024-09-19T06:03:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.426+0000 7fb58a0c6640 1 --2- 172.21.15.71:0/2202915607 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb570003530 0x7fb5841972d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb580005f30 tx=0x7fb580033680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.426+0000 7fb57b7fe640 1 -- 172.21.15.71:0/2202915607 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fb580038040 con 0x7fb570003530 2024-09-19T06:03:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.426+0000 7fb57b7fe640 1 -- 172.21.15.71:0/2202915607 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb580032e00 con 0x7fb570003530 2024-09-19T06:03:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.426+0000 7fb57b7fe640 1 -- 172.21.15.71:0/2202915607 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fb580004a00 con 0x7fb570003530 2024-09-19T06:03:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.426+0000 7fb58c32a640 1 -- 172.21.15.71:0/2202915607 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb58419c0e0 con 0x7fb570003530 2024-09-19T06:03:14.431 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.426+0000 7fb58c32a640 1 -- 172.21.15.71:0/2202915607 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb58419c6a0 con 0x7fb570003530 2024-09-19T06:03:14.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.427+0000 7fb57b7fe640 1 -- 172.21.15.71:0/2202915607 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fb580043020 con 0x7fb570003530 2024-09-19T06:03:14.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.427+0000 7fb58c32a640 1 -- 172.21.15.71:0/2202915607 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb584101ce0 con 0x7fb570003530 2024-09-19T06:03:14.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.428+0000 7fb57b7fe640 1 --2- 172.21.15.71:0/2202915607 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fb568039040 0x7fb56803b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:14.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.428+0000 7fb57b7fe640 1 -- 172.21.15.71:0/2202915607 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb58006e920 con 0x7fb570003530 2024-09-19T06:03:14.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.428+0000 7fb5898c5640 1 --2- 172.21.15.71:0/2202915607 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fb568039040 0x7fb56803b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:14.432 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.429+0000 7fb5898c5640 1 --2- 172.21.15.71:0/2202915607 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fb568039040 0x7fb56803b500 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb574009100 tx=0x7fb574008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:14.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.433+0000 7fb57b7fe640 1 -- 172.21.15.71:0/2202915607 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb58004a020 con 0x7fb570003530 2024-09-19T06:03:14.669 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.667+0000 7fb58c32a640 1 -- 172.21.15.71:0/2202915607 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fb58419c950 con 0x7fb570003530 2024-09-19T06:03:14.670 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.667+0000 7fb57b7fe640 1 -- 172.21.15.71:0/2202915607 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1007 (secure 0 0 0) 0x7fb580045e20 con 0x7fb570003530 2024-09-19T06:03:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-19T06:03:14.671 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":2,"fsid":"782a5144-764c-11ef-bceb-c7b262605968","modified":"2024-09-19T06:03:08.703403Z","created":"2024-09-19T06:01:31.421310Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T06:03:14.671 INFO:teuthology.orchestra.run.smithi071.stderr:dumped monmap epoch 2 2024-09-19T06:03:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.669+0000 7fb58c32a640 1 -- 172.21.15.71:0/2202915607 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fb568039040 msgr2=0x7fb56803b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.669+0000 7fb58c32a640 1 --2- 172.21.15.71:0/2202915607 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fb568039040 0x7fb56803b500 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb574009100 tx=0x7fb574008040 comp rx=0 tx=0).stop 2024-09-19T06:03:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.669+0000 7fb58c32a640 1 -- 172.21.15.71:0/2202915607 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb570003530 msgr2=0x7fb5841972d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.669+0000 7fb58c32a640 1 --2- 172.21.15.71:0/2202915607 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb570003530 0x7fb5841972d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb580005f30 tx=0x7fb580033680 comp rx=0 tx=0).stop 2024-09-19T06:03:14.673 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.669+0000 7fb58c32a640 1 -- 172.21.15.71:0/2202915607 shutdown_connections 2024-09-19T06:03:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.669+0000 7fb58c32a640 1 --2- 172.21.15.71:0/2202915607 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fb568039040 0x7fb56803b500 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.670+0000 7fb58c32a640 1 --2- 172.21.15.71:0/2202915607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb584197810 0x7fb58419bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.670+0000 7fb58c32a640 1 --2- 172.21.15.71:0/2202915607 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb570003530 0x7fb5841972d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.670+0000 7fb58c32a640 1 -- 172.21.15.71:0/2202915607 >> 172.21.15.71:0/2202915607 conn(0x7fb5840fc280 msgr2=0x7fb58406a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.670+0000 7fb58c32a640 1 -- 172.21.15.71:0/2202915607 shutdown_connections 2024-09-19T06:03:14.674 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:14.670+0000 7fb58c32a640 1 -- 172.21.15.71:0/2202915607 wait complete. 2024-09-19T06:03:14.985 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:14 smithi071 ceph-mon[35662]: Deploying daemon mon.b on smithi059 2024-09-19T06:03:14.985 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:14 smithi071 ceph-mon[35662]: from='client.? 172.21.15.71:0/2202915607' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:03:14.985 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:14 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:03:15.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:14 smithi003 ceph-mon[30893]: Deploying daemon mon.b on smithi059 2024-09-19T06:03:15.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:14 smithi003 ceph-mon[30893]: from='client.? 172.21.15.71:0/2202915607' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:03:15.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:14 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:03:16.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:15 smithi003 ceph-mon[30893]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:16.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:15 smithi071 ceph-mon[35662]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:16.255 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T06:03:16.255 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:03:16.506 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:03:16.903 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.899+0000 7f069fe7a640 1 -- 172.21.15.71:0/2505870678 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0698106670 msgr2=0x7f0698106a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:16.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.899+0000 7f069fe7a640 1 --2- 172.21.15.71:0/2505870678 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0698106670 0x7f0698106a50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0688009c20 tx=0x7f068802aa90 comp rx=0 tx=0).stop 2024-09-19T06:03:16.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.899+0000 7f069fe7a640 1 -- 172.21.15.71:0/2505870678 shutdown_connections 2024-09-19T06:03:16.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.899+0000 7f069fe7a640 1 --2- 172.21.15.71:0/2505870678 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0698106670 0x7f0698106a50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:16.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.899+0000 7f069fe7a640 1 -- 172.21.15.71:0/2505870678 >> 172.21.15.71:0/2505870678 conn(0x7f06980fc2c0 msgr2=0x7f06980fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:16.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.899+0000 7f069fe7a640 1 -- 172.21.15.71:0/2505870678 shutdown_connections 2024-09-19T06:03:16.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.899+0000 7f069fe7a640 1 -- 172.21.15.71:0/2505870678 wait complete. 2024-09-19T06:03:16.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.900+0000 7f069fe7a640 1 Processor -- start 2024-09-19T06:03:16.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.900+0000 7f069fe7a640 1 -- start start 2024-09-19T06:03:16.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.900+0000 7f069fe7a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0698106670 0x7f0698198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:16.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.900+0000 7f069fe7a640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06981986c0 0x7f0698198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:16.904 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.900+0000 7f069fe7a640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f069810aca0 con 0x7f0698106670 2024-09-19T06:03:16.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.900+0000 7f069fe7a640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f069810ab20 con 0x7f06981986c0 2024-09-19T06:03:16.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.900+0000 7f069d415640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06981986c0 0x7f0698198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:16.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.900+0000 7f069d415640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06981986c0 0x7f0698198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:58656/0 (socket says 172.21.15.71:58656) 2024-09-19T06:03:16.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.900+0000 7f069d415640 1 -- 172.21.15.71:0/3640406839 learned_addr learned my addr 172.21.15.71:0/3640406839 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-19T06:03:16.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.900+0000 7f069d415640 1 -- 172.21.15.71:0/3640406839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06981986c0 msgr2=0x7f0698198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T06:03:16.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.900+0000 7f069d415640 1 -- 172.21.15.71:0/3640406839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06981986c0 msgr2=0x7f0698198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T06:03:16.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.900+0000 7f069d415640 1 --2- 172.21.15.71:0/3640406839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06981986c0 0x7f0698198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T06:03:16.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.901+0000 7f069d415640 1 --2- 172.21.15.71:0/3640406839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06981986c0 0x7f0698198b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:03:16.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.901+0000 7f069dc16640 1 --2- 172.21.15.71:0/3640406839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0698106670 0x7f0698198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:16.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.901+0000 7f069dc16640 1 -- 172.21.15.71:0/3640406839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06981986c0 msgr2=0x7f0698198b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:03:16.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.901+0000 7f069dc16640 1 --2- 172.21.15.71:0/3640406839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06981986c0 0x7f0698198b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:16.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.901+0000 7f069dc16640 1 -- 172.21.15.71:0/3640406839 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06981a11f0 con 0x7f0698106670 2024-09-19T06:03:16.905 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.901+0000 7f069dc16640 1 --2- 172.21.15.71:0/3640406839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0698106670 0x7f0698198180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0688035000 tx=0x7f068802e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:16.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.901+0000 7f0696ffd640 1 -- 172.21.15.71:0/3640406839 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f0688033040 con 0x7f0698106670 2024-09-19T06:03:16.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.901+0000 7f0696ffd640 1 -- 172.21.15.71:0/3640406839 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f068802e9a0 con 0x7f0698106670 2024-09-19T06:03:16.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.901+0000 7f069fe7a640 1 -- 172.21.15.71:0/3640406839 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06981a13c0 con 0x7f0698106670 2024-09-19T06:03:16.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.901+0000 7f0696ffd640 1 -- 172.21.15.71:0/3640406839 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f06880417d0 con 0x7f0698106670 2024-09-19T06:03:16.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.901+0000 7f069fe7a640 1 -- 172.21.15.71:0/3640406839 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06981a1870 con 0x7f0698106670 2024-09-19T06:03:16.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.902+0000 7f069fe7a640 1 -- 172.21.15.71:0/3640406839 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0698101ce0 con 0x7f0698106670 2024-09-19T06:03:16.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.902+0000 7f0696ffd640 1 -- 172.21.15.71:0/3640406839 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f0688049070 con 0x7f0698106670 2024-09-19T06:03:16.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.903+0000 7f0696ffd640 1 --2- 172.21.15.71:0/3640406839 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0680039040 0x7f068003b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:16.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.903+0000 7f0696ffd640 1 -- 172.21.15.71:0/3640406839 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f068803e070 con 0x7f0698106670 2024-09-19T06:03:16.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.903+0000 7f069d415640 1 --2- 172.21.15.71:0/3640406839 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0680039040 0x7f068003b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:16.907 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.904+0000 7f069d415640 1 --2- 172.21.15.71:0/3640406839 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0680039040 0x7f068003b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f068c009100 tx=0x7f068c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:16.911 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:16.908+0000 7f0696ffd640 1 -- 172.21.15.71:0/3640406839 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0688049360 con 0x7f0698106670 2024-09-19T06:03:17.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:17.137+0000 7f069fe7a640 1 -- 172.21.15.71:0/3640406839 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f06981a1b20 con 0x7f0698106670 2024-09-19T06:03:17.140 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:17.138+0000 7f0696ffd640 1 -- 172.21.15.71:0/3640406839 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1007 (secure 0 0 0) 0x7f0688050090 con 0x7f0698106670 2024-09-19T06:03:17.140 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-19T06:03:17.141 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":2,"fsid":"782a5144-764c-11ef-bceb-c7b262605968","modified":"2024-09-19T06:03:08.703403Z","created":"2024-09-19T06:01:31.421310Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T06:03:17.141 INFO:teuthology.orchestra.run.smithi071.stderr:dumped monmap epoch 2 2024-09-19T06:03:17.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:17.140+0000 7f069fe7a640 1 -- 172.21.15.71:0/3640406839 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0680039040 msgr2=0x7f068003b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:17.142 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:17.140+0000 7f069fe7a640 1 --2- 172.21.15.71:0/3640406839 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0680039040 0x7f068003b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f068c009100 tx=0x7f068c008040 comp rx=0 tx=0).stop 2024-09-19T06:03:17.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:17.140+0000 7f069fe7a640 1 -- 172.21.15.71:0/3640406839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0698106670 msgr2=0x7f0698198180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:17.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:17.140+0000 7f069fe7a640 1 --2- 172.21.15.71:0/3640406839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0698106670 0x7f0698198180 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0688035000 tx=0x7f068802e5f0 comp rx=0 tx=0).stop 2024-09-19T06:03:17.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:17.140+0000 7f069fe7a640 1 -- 172.21.15.71:0/3640406839 shutdown_connections 2024-09-19T06:03:17.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:17.140+0000 7f069fe7a640 1 --2- 172.21.15.71:0/3640406839 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0680039040 0x7f068003b500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:17.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:17.140+0000 7f069fe7a640 1 --2- 172.21.15.71:0/3640406839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06981986c0 0x7f0698198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:17.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:17.140+0000 7f069fe7a640 1 --2- 172.21.15.71:0/3640406839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0698106670 0x7f0698198180 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:17.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:17.140+0000 7f069fe7a640 1 -- 172.21.15.71:0/3640406839 >> 172.21.15.71:0/3640406839 conn(0x7f06980fc2c0 msgr2=0x7f06980fc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:17.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:17.140+0000 7f069fe7a640 1 -- 172.21.15.71:0/3640406839 shutdown_connections 2024-09-19T06:03:17.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:17.140+0000 7f069fe7a640 1 -- 172.21.15.71:0/3640406839 wait complete. 2024-09-19T06:03:18.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:17 smithi059 systemd[1]: Started Ceph mon.b for 782a5144-764c-11ef-bceb-c7b262605968. 2024-09-19T06:03:18.702 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T06:03:18.703 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:03:18.953 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:03:22.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.989+0000 7f72ccf34640 1 -- 172.21.15.71:0/400272019 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f72c8106670 msgr2=0x7f72b4005580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:22.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.989+0000 7f72ccf34640 1 --2- 172.21.15.71:0/400272019 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f72c8106670 0x7f72b4005580 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f72b8014d10 tx=0x7f72b802c570 comp rx=0 tx=0).stop 2024-09-19T06:03:22.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.990+0000 7f72ccf34640 1 -- 172.21.15.71:0/400272019 shutdown_connections 2024-09-19T06:03:22.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.990+0000 7f72ccf34640 1 --2- 172.21.15.71:0/400272019 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f72c8106670 0x7f72b4005580 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:22.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.990+0000 7f72ccf34640 1 -- 172.21.15.71:0/400272019 >> 172.21.15.71:0/400272019 conn(0x7f72c80fc280 msgr2=0x7f72c80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:22.993 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.990+0000 7f72ccf34640 1 -- 172.21.15.71:0/400272019 shutdown_connections 2024-09-19T06:03:22.994 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.990+0000 7f72ccf34640 1 -- 172.21.15.71:0/400272019 wait complete. 2024-09-19T06:03:22.994 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:03:22.994 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: mon.c calling monitor election 2024-09-19T06:03:22.994 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: mon.a calling monitor election 2024-09-19T06:03:22.994 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:03:22.994 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:03:22.994 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:22.994 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:03:22.995 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:03:22.995 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:22.995 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:03:22.995 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:03:22.995 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:03:22.995 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T06:03:22.995 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: monmap epoch 3 2024-09-19T06:03:22.995 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: fsid 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:03:22.995 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: last_changed 2024-09-19T06:03:17.593989+0000 2024-09-19T06:03:22.995 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: created 2024-09-19T06:01:31.421310+0000 2024-09-19T06:03:22.995 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: min_mon_release 19 (squid) 2024-09-19T06:03:22.996 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: election_strategy: 1 2024-09-19T06:03:22.996 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2024-09-19T06:03:22.996 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: 1: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.c 2024-09-19T06:03:22.996 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: 2: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.b 2024-09-19T06:03:22.996 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: fsmap 2024-09-19T06:03:22.996 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:03:22.996 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: mgrmap e13: x(active, since 52s) 2024-09-19T06:03:22.996 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: overall HEALTH_OK 2024-09-19T06:03:22.996 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:22.996 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:22.996 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:22.997 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:22 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:22.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.991+0000 7f72ccf34640 1 Processor -- start 2024-09-19T06:03:22.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.991+0000 7f72ccf34640 1 -- start start 2024-09-19T06:03:22.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.991+0000 7f72ccf34640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f72c8106670 0x7f72c8198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:22.999 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.991+0000 7f72ccf34640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72c8198690 0x7f72c8198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:23.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.991+0000 7f72ccf34640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72c81a11c0 0x7f72c81a35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:23.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.991+0000 7f72ccf34640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f72c81086b0 con 0x7f72c8106670 2024-09-19T06:03:23.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.991+0000 7f72ccf34640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f72c8108530 con 0x7f72c81a11c0 2024-09-19T06:03:23.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.991+0000 7f72ccf34640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f72c8108830 con 0x7f72c8198690 2024-09-19T06:03:23.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.992+0000 7f72bdd9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72c8198690 0x7f72c8198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:23.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.992+0000 7f72bdd9b640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72c8198690 0x7f72c8198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:39062/0 (socket says 172.21.15.71:39062) 2024-09-19T06:03:23.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.992+0000 7f72bdd9b640 1 -- 172.21.15.71:0/1684728307 learned_addr learned my addr 172.21.15.71:0/1684728307 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-19T06:03:23.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.992+0000 7f72c6d9d640 1 --2- 172.21.15.71:0/1684728307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72c81a11c0 0x7f72c81a35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:23.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.992+0000 7f72c659c640 1 --2- 172.21.15.71:0/1684728307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f72c8106670 0x7f72c8198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:23.000 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.992+0000 7f72bdd9b640 1 -- 172.21.15.71:0/1684728307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72c8198690 msgr2=0x7f72c8198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T06:03:23.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.992+0000 7f72bdd9b640 1 -- 172.21.15.71:0/1684728307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72c8198690 msgr2=0x7f72c8198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T06:03:23.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.992+0000 7f72bdd9b640 1 --2- 172.21.15.71:0/1684728307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72c8198690 0x7f72c8198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T06:03:23.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.992+0000 7f72bdd9b640 1 --2- 172.21.15.71:0/1684728307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72c8198690 0x7f72c8198af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:03:23.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.992+0000 7f72c6d9d640 1 -- 172.21.15.71:0/1684728307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72c81a11c0 msgr2=0x7f72c81a35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-19T06:03:23.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.992+0000 7f72c6d9d640 1 -- 172.21.15.71:0/1684728307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72c81a11c0 msgr2=0x7f72c81a35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T06:03:23.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.992+0000 7f72c6d9d640 1 --2- 172.21.15.71:0/1684728307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72c81a11c0 0x7f72c81a35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T06:03:23.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.992+0000 7f72c6d9d640 1 --2- 172.21.15.71:0/1684728307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72c81a11c0 0x7f72c81a35b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:03:23.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.992+0000 7f72c659c640 1 -- 172.21.15.71:0/1684728307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72c8198690 msgr2=0x7f72c8198af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:03:23.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.992+0000 7f72c659c640 1 --2- 172.21.15.71:0/1684728307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72c8198690 0x7f72c8198af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:23.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.992+0000 7f72c659c640 1 -- 172.21.15.71:0/1684728307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72c81a11c0 msgr2=0x7f72c81a35b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:03:23.001 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.992+0000 7f72c659c640 1 --2- 172.21.15.71:0/1684728307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72c81a11c0 0x7f72c81a35b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:23.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.992+0000 7f72c659c640 1 -- 172.21.15.71:0/1684728307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c81a3d50 con 0x7f72c8106670 2024-09-19T06:03:23.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.992+0000 7f72c659c640 1 --2- 172.21.15.71:0/1684728307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f72c8106670 0x7f72c8198150 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f72b8035040 tx=0x7f72b8005290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:23.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.993+0000 7f72bffff640 1 -- 172.21.15.71:0/1684728307 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b8041070 con 0x7f72c8106670 2024-09-19T06:03:23.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.993+0000 7f72bffff640 1 -- 172.21.15.71:0/1684728307 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72b8004d30 con 0x7f72c8106670 2024-09-19T06:03:23.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.993+0000 7f72ccf34640 1 -- 172.21.15.71:0/1684728307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c81a3fe0 con 0x7f72c8106670 2024-09-19T06:03:23.002 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.993+0000 7f72bffff640 1 -- 172.21.15.71:0/1684728307 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b8003dc0 con 0x7f72c8106670 2024-09-19T06:03:23.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.993+0000 7f72ccf34640 1 -- 172.21.15.71:0/1684728307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c81a44e0 con 0x7f72c8106670 2024-09-19T06:03:23.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.994+0000 7f72bffff640 1 -- 172.21.15.71:0/1684728307 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f72b8012450 con 0x7f72c8106670 2024-09-19T06:03:23.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.994+0000 7f72ccf34640 1 -- 172.21.15.71:0/1684728307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c81097e0 con 0x7f72c8106670 2024-09-19T06:03:23.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.994+0000 7f72bffff640 1 --2- 172.21.15.71:0/1684728307 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f72a8039730 0x7f72a803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:23.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.994+0000 7f72bffff640 1 -- 172.21.15.71:0/1684728307 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f72b806e770 con 0x7f72c8106670 2024-09-19T06:03:23.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.994+0000 7f72bdd9b640 1 --2- 172.21.15.71:0/1684728307 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f72a8039730 0x7f72a803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:23.003 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:22.995+0000 7f72bdd9b640 1 --2- 172.21.15.71:0/1684728307 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f72a8039730 0x7f72a803bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009100 tx=0x7f72b0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:23.004 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:23.000+0000 7f72bffff640 1 -- 172.21.15.71:0/1684728307 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f72b803c580 con 0x7f72c8106670 2024-09-19T06:03:23.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:03:23.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: mon.c calling monitor election 2024-09-19T06:03:23.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: mon.a calling monitor election 2024-09-19T06:03:23.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:03:23.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:03:23.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:23.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:03:23.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:03:23.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:23.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:03:23.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:03:23.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:03:23.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T06:03:23.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: monmap epoch 3 2024-09-19T06:03:23.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: fsid 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:03:23.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: last_changed 2024-09-19T06:03:17.593989+0000 2024-09-19T06:03:23.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: created 2024-09-19T06:01:31.421310+0000 2024-09-19T06:03:23.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: min_mon_release 19 (squid) 2024-09-19T06:03:23.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: election_strategy: 1 2024-09-19T06:03:23.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2024-09-19T06:03:23.087 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: 1: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.c 2024-09-19T06:03:23.087 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: 2: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.b 2024-09-19T06:03:23.087 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: fsmap 2024-09-19T06:03:23.087 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:03:23.087 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: mgrmap e13: x(active, since 52s) 2024-09-19T06:03:23.087 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: overall HEALTH_OK 2024-09-19T06:03:23.087 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:23.087 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:23.087 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:23.087 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:22 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:23.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:23.281+0000 7f72ccf34640 1 -- 172.21.15.71:0/1684728307 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f72c802d7c0 con 0x7f72c8106670 2024-09-19T06:03:23.284 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:23.282+0000 7f72bffff640 1 -- 172.21.15.71:0/1684728307 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1271 (secure 0 0 0) 0x7f72b8004290 con 0x7f72c8106670 2024-09-19T06:03:23.285 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-19T06:03:23.285 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":3,"fsid":"782a5144-764c-11ef-bceb-c7b262605968","modified":"2024-09-19T06:03:17.593989Z","created":"2024-09-19T06:01:31.421310Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:3300","nonce":0},{"type":"v1","addr":"172.21.15.71:6789","nonce":0}]},"addr":"172.21.15.71:6789/0","public_addr":"172.21.15.71:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:3300","nonce":0},{"type":"v1","addr":"172.21.15.59:6789","nonce":0}]},"addr":"172.21.15.59:6789/0","public_addr":"172.21.15.59:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T06:03:23.285 INFO:teuthology.orchestra.run.smithi071.stderr:dumped monmap epoch 3 2024-09-19T06:03:23.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:23.284+0000 7f72ccf34640 1 -- 172.21.15.71:0/1684728307 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f72a8039730 msgr2=0x7f72a803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:23.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:23.284+0000 7f72ccf34640 1 --2- 172.21.15.71:0/1684728307 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f72a8039730 0x7f72a803bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009100 tx=0x7f72b0008040 comp rx=0 tx=0).stop 2024-09-19T06:03:23.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:23.284+0000 7f72ccf34640 1 -- 172.21.15.71:0/1684728307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f72c8106670 msgr2=0x7f72c8198150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:23.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:23.284+0000 7f72ccf34640 1 --2- 172.21.15.71:0/1684728307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f72c8106670 0x7f72c8198150 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f72b8035040 tx=0x7f72b8005290 comp rx=0 tx=0).stop 2024-09-19T06:03:23.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:23.284+0000 7f72ccf34640 1 -- 172.21.15.71:0/1684728307 shutdown_connections 2024-09-19T06:03:23.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:23.284+0000 7f72ccf34640 1 --2- 172.21.15.71:0/1684728307 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f72a8039730 0x7f72a803bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:23.287 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:23.284+0000 7f72ccf34640 1 --2- 172.21.15.71:0/1684728307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72c81a11c0 0x7f72c81a35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:23.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:23.284+0000 7f72ccf34640 1 --2- 172.21.15.71:0/1684728307 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f72c8198690 0x7f72c8198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:23.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:23.284+0000 7f72ccf34640 1 --2- 172.21.15.71:0/1684728307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f72c8106670 0x7f72c8198150 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:23.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:23.284+0000 7f72ccf34640 1 -- 172.21.15.71:0/1684728307 >> 172.21.15.71:0/1684728307 conn(0x7f72c80fc280 msgr2=0x7f72c80fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:23.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:23.284+0000 7f72ccf34640 1 -- 172.21.15.71:0/1684728307 shutdown_connections 2024-09-19T06:03:23.288 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:23.284+0000 7f72ccf34640 1 -- 172.21.15.71:0/1684728307 wait complete. 2024-09-19T06:03:23.806 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:23 smithi071 ceph-mon[35662]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:23.806 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:23 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:23.807 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:23 smithi071 ceph-mon[35662]: from='client.? 172.21.15.71:0/1684728307' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:03:23.807 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:23 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:03:24.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:23 smithi003 ceph-mon[30893]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:24.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:23 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:24.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:23 smithi003 ceph-mon[30893]: from='client.? 172.21.15.71:0/1684728307' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:03:24.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:23 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:03:24.094 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T06:03:24.094 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T06:03:24.491 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:03:25.016 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:03:25.017 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: mon.c calling monitor election 2024-09-19T06:03:25.017 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: mon.a calling monitor election 2024-09-19T06:03:25.017 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:03:25.017 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:03:25.017 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:25.017 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:03:25.017 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:03:25.017 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:25.017 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:03:25.017 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:03:25.017 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:03:25.017 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T06:03:25.018 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: monmap epoch 3 2024-09-19T06:03:25.018 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: fsid 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:03:25.018 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: last_changed 2024-09-19T06:03:17.593989+0000 2024-09-19T06:03:25.018 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: created 2024-09-19T06:01:31.421310+0000 2024-09-19T06:03:25.018 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: min_mon_release 19 (squid) 2024-09-19T06:03:25.018 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: election_strategy: 1 2024-09-19T06:03:25.018 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2024-09-19T06:03:25.018 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: 1: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.c 2024-09-19T06:03:25.018 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: 2: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.b 2024-09-19T06:03:25.018 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: fsmap 2024-09-19T06:03:25.018 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:03:25.018 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: mgrmap e13: x(active, since 52s) 2024-09-19T06:03:25.018 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: overall HEALTH_OK 2024-09-19T06:03:25.019 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:25.019 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:25.019 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:25.019 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:25.019 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:25.019 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:25.019 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: from='client.? 172.21.15.71:0/1684728307' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:03:25.019 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:24 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:03:25.125 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.122+0000 7f78f7800640 1 -- 172.21.15.3:0/1913701853 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78f0074590 msgr2=0x7f78f0074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:25.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.122+0000 7f78f7800640 1 --2- 172.21.15.3:0/1913701853 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78f0074590 0x7f78f0074970 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f78e4009880 tx=0x7f78e402a670 comp rx=0 tx=0).stop 2024-09-19T06:03:25.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.122+0000 7f78f7800640 1 -- 172.21.15.3:0/1913701853 shutdown_connections 2024-09-19T06:03:25.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.122+0000 7f78f7800640 1 --2- 172.21.15.3:0/1913701853 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78f0074590 0x7f78f0074970 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:25.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.122+0000 7f78f7800640 1 -- 172.21.15.3:0/1913701853 >> 172.21.15.3:0/1913701853 conn(0x7f78f00fd230 msgr2=0x7f78f00ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:25.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.123+0000 7f78f7800640 1 -- 172.21.15.3:0/1913701853 shutdown_connections 2024-09-19T06:03:25.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.123+0000 7f78f7800640 1 -- 172.21.15.3:0/1913701853 wait complete. 2024-09-19T06:03:25.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.124+0000 7f78f7800640 1 Processor -- start 2024-09-19T06:03:25.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.124+0000 7f78f7800640 1 -- start start 2024-09-19T06:03:25.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.125+0000 7f78f7800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78f0074590 0x7f78f01a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:25.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.125+0000 7f78f7800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78f01a3bd0 0x7f78f019d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:25.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.125+0000 7f78f7800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78f019dd50 0x7f78f019e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:25.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.125+0000 7f78f7800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f78f0112290 con 0x7f78f01a3bd0 2024-09-19T06:03:25.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.125+0000 7f78f7800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f78f0112110 con 0x7f78f019dd50 2024-09-19T06:03:25.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.125+0000 7f78f7800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f78f0112410 con 0x7f78f0074590 2024-09-19T06:03:25.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.125+0000 7f78f4e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78f0074590 0x7f78f01a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:25.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.125+0000 7f78f4e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78f0074590 0x7f78f01a3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:39894/0 (socket says 172.21.15.3:39894) 2024-09-19T06:03:25.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.125+0000 7f78f4e00640 1 -- 172.21.15.3:0/1428600395 learned_addr learned my addr 172.21.15.3:0/1428600395 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:03:25.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.125+0000 7f78efe00640 1 --2- 172.21.15.3:0/1428600395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78f01a3bd0 0x7f78f019d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:25.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.125+0000 7f78f5800640 1 --2- 172.21.15.3:0/1428600395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78f019dd50 0x7f78f019e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:25.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.126+0000 7f78f4e00640 1 -- 172.21.15.3:0/1428600395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78f019dd50 msgr2=0x7f78f019e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:25.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.126+0000 7f78f4e00640 1 --2- 172.21.15.3:0/1428600395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78f019dd50 0x7f78f019e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:25.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.126+0000 7f78f4e00640 1 -- 172.21.15.3:0/1428600395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78f01a3bd0 msgr2=0x7f78f019d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:25.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.126+0000 7f78f4e00640 1 --2- 172.21.15.3:0/1428600395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78f01a3bd0 0x7f78f019d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:25.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.126+0000 7f78f4e00640 1 -- 172.21.15.3:0/1428600395 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f01aa4f0 con 0x7f78f0074590 2024-09-19T06:03:25.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.126+0000 7f78f4e00640 1 --2- 172.21.15.3:0/1428600395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78f0074590 0x7f78f01a3690 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f78e4006010 tx=0x7f78e4003c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:25.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.127+0000 7f78ed600640 1 -- 172.21.15.3:0/1428600395 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e403f070 con 0x7f78f0074590 2024-09-19T06:03:25.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.127+0000 7f78ed600640 1 -- 172.21.15.3:0/1428600395 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78e403b460 con 0x7f78f0074590 2024-09-19T06:03:25.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.127+0000 7f78ed600640 1 -- 172.21.15.3:0/1428600395 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e4035030 con 0x7f78f0074590 2024-09-19T06:03:25.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.127+0000 7f78f7800640 1 -- 172.21.15.3:0/1428600395 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f01aa720 con 0x7f78f0074590 2024-09-19T06:03:25.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.127+0000 7f78f7800640 1 -- 172.21.15.3:0/1428600395 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f01aac10 con 0x7f78f0074590 2024-09-19T06:03:25.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.128+0000 7f78ed600640 1 -- 172.21.15.3:0/1428600395 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f78e4042070 con 0x7f78f0074590 2024-09-19T06:03:25.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.128+0000 7f78f7800640 1 -- 172.21.15.3:0/1428600395 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78f0075cd0 con 0x7f78f0074590 2024-09-19T06:03:25.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.129+0000 7f78ed600640 1 --2- 172.21.15.3:0/1428600395 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f78d8039730 0x7f78d803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:25.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.129+0000 7f78ed600640 1 -- 172.21.15.3:0/1428600395 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f78e406cff0 con 0x7f78f0074590 2024-09-19T06:03:25.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.129+0000 7f78efe00640 1 --2- 172.21.15.3:0/1428600395 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f78d8039730 0x7f78d803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:25.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.130+0000 7f78efe00640 1 --2- 172.21.15.3:0/1428600395 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f78d8039730 0x7f78d803bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009a30 tx=0x7f78dc009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:25.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.134+0000 7f78ed600640 1 -- 172.21.15.3:0/1428600395 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f78e404c350 con 0x7f78f0074590 2024-09-19T06:03:25.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.325+0000 7f78f7800640 1 -- 172.21.15.3:0/1428600395 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f78f01aae70 con 0x7f78f0074590 2024-09-19T06:03:25.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.326+0000 7f78ed600640 1 -- 172.21.15.3:0/1428600395 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+269 (secure 0 0 0) 0x7f78e4036260 con 0x7f78f0074590 2024-09-19T06:03:25.328 INFO:teuthology.orchestra.run.smithi003.stdout:# minimal ceph.conf for 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:03:25.328 INFO:teuthology.orchestra.run.smithi003.stdout:[global] 2024-09-19T06:03:25.329 INFO:teuthology.orchestra.run.smithi003.stdout: fsid = 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:03:25.329 INFO:teuthology.orchestra.run.smithi003.stdout: mon_host = [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] 2024-09-19T06:03:25.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.329+0000 7f78f7800640 1 -- 172.21.15.3:0/1428600395 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f78d8039730 msgr2=0x7f78d803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:25.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.329+0000 7f78f7800640 1 --2- 172.21.15.3:0/1428600395 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f78d8039730 0x7f78d803bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009a30 tx=0x7f78dc009190 comp rx=0 tx=0).stop 2024-09-19T06:03:25.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.329+0000 7f78f7800640 1 -- 172.21.15.3:0/1428600395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78f0074590 msgr2=0x7f78f01a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:25.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.329+0000 7f78f7800640 1 --2- 172.21.15.3:0/1428600395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78f0074590 0x7f78f01a3690 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f78e4006010 tx=0x7f78e4003c00 comp rx=0 tx=0).stop 2024-09-19T06:03:25.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.329+0000 7f78f7800640 1 -- 172.21.15.3:0/1428600395 shutdown_connections 2024-09-19T06:03:25.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.329+0000 7f78f7800640 1 --2- 172.21.15.3:0/1428600395 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f78d8039730 0x7f78d803bbf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:25.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.329+0000 7f78f7800640 1 --2- 172.21.15.3:0/1428600395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78f019dd50 0x7f78f019e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:25.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.329+0000 7f78f7800640 1 --2- 172.21.15.3:0/1428600395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78f01a3bd0 0x7f78f019d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:25.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.329+0000 7f78f7800640 1 --2- 172.21.15.3:0/1428600395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78f0074590 0x7f78f01a3690 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:25.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.329+0000 7f78f7800640 1 -- 172.21.15.3:0/1428600395 >> 172.21.15.3:0/1428600395 conn(0x7f78f00fd230 msgr2=0x7f78f00fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:25.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.330+0000 7f78f7800640 1 -- 172.21.15.3:0/1428600395 shutdown_connections 2024-09-19T06:03:25.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:25.330+0000 7f78f7800640 1 -- 172.21.15.3:0/1428600395 wait complete. 2024-09-19T06:03:25.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: mon.b calling monitor election 2024-09-19T06:03:25.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:25.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: Updating smithi003:/etc/ceph/ceph.conf 2024-09-19T06:03:25.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: Updating smithi059:/etc/ceph/ceph.conf 2024-09-19T06:03:25.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-19T06:03:25.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: mon.b calling monitor election 2024-09-19T06:03:25.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: mon.c calling monitor election 2024-09-19T06:03:25.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: mon.a calling monitor election 2024-09-19T06:03:25.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T06:03:25.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: monmap epoch 3 2024-09-19T06:03:25.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: fsid 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:03:25.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: last_changed 2024-09-19T06:03:17.593989+0000 2024-09-19T06:03:25.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: created 2024-09-19T06:01:31.421310+0000 2024-09-19T06:03:25.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: min_mon_release 19 (squid) 2024-09-19T06:03:25.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: election_strategy: 1 2024-09-19T06:03:25.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2024-09-19T06:03:25.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: 1: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.c 2024-09-19T06:03:25.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: 2: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.b 2024-09-19T06:03:25.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: fsmap 2024-09-19T06:03:25.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:03:25.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: mgrmap e13: x(active, since 54s) 2024-09-19T06:03:25.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: overall HEALTH_OK 2024-09-19T06:03:25.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: Updating smithi071:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:03:25.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: Updating smithi059:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:03:25.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:25.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:25.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:25.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:25.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: Updating smithi003:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:03:25.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:25.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:25 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1428600395' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:25.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: mon.b calling monitor election 2024-09-19T06:03:25.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:25.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: Updating smithi003:/etc/ceph/ceph.conf 2024-09-19T06:03:25.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: Updating smithi059:/etc/ceph/ceph.conf 2024-09-19T06:03:25.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-19T06:03:25.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: mon.b calling monitor election 2024-09-19T06:03:25.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: mon.c calling monitor election 2024-09-19T06:03:25.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: mon.a calling monitor election 2024-09-19T06:03:25.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T06:03:25.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: monmap epoch 3 2024-09-19T06:03:25.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: fsid 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:03:25.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: last_changed 2024-09-19T06:03:17.593989+0000 2024-09-19T06:03:25.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: created 2024-09-19T06:01:31.421310+0000 2024-09-19T06:03:25.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: min_mon_release 19 (squid) 2024-09-19T06:03:25.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: election_strategy: 1 2024-09-19T06:03:25.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2024-09-19T06:03:25.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: 1: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.c 2024-09-19T06:03:25.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: 2: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.b 2024-09-19T06:03:25.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: fsmap 2024-09-19T06:03:25.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:03:25.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: mgrmap e13: x(active, since 54s) 2024-09-19T06:03:25.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: overall HEALTH_OK 2024-09-19T06:03:25.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: Updating smithi071:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:03:25.791 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: Updating smithi059:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:03:25.791 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:25.791 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:25.791 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:25.791 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:25.791 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: Updating smithi003:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:03:25.791 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:25.791 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:25 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1428600395' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:25.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: mon.b calling monitor election 2024-09-19T06:03:25.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:25.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: Updating smithi003:/etc/ceph/ceph.conf 2024-09-19T06:03:25.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: Updating smithi059:/etc/ceph/ceph.conf 2024-09-19T06:03:25.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-19T06:03:25.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: mon.b calling monitor election 2024-09-19T06:03:25.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: mon.c calling monitor election 2024-09-19T06:03:25.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: mon.a calling monitor election 2024-09-19T06:03:25.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T06:03:25.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: monmap epoch 3 2024-09-19T06:03:25.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: fsid 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:03:25.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: last_changed 2024-09-19T06:03:17.593989+0000 2024-09-19T06:03:25.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: created 2024-09-19T06:01:31.421310+0000 2024-09-19T06:03:25.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: min_mon_release 19 (squid) 2024-09-19T06:03:25.838 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: election_strategy: 1 2024-09-19T06:03:25.838 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.a 2024-09-19T06:03:25.838 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: 1: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.c 2024-09-19T06:03:25.838 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: 2: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.b 2024-09-19T06:03:25.838 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: fsmap 2024-09-19T06:03:25.838 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:03:25.838 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: mgrmap e13: x(active, since 54s) 2024-09-19T06:03:25.838 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: overall HEALTH_OK 2024-09-19T06:03:25.838 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: Updating smithi071:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:03:25.838 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: Updating smithi059:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:03:25.838 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:25.838 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:25.838 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:25.838 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:25.839 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: Updating smithi003:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:03:25.839 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:25.839 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:25 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1428600395' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:26.099 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T06:03:26.099 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-19T06:03:26.099 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T06:03:26.159 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-19T06:03:26.159 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:03:26.257 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-19T06:03:26.257 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T06:03:26.289 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-19T06:03:26.289 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:03:26.357 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-19T06:03:26.358 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T06:03:26.388 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-19T06:03:26.388 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:03:26.456 INFO:tasks.cephadm:Adding mgr.x on smithi003 2024-09-19T06:03:26.456 INFO:tasks.cephadm:Adding mgr.y on smithi059 2024-09-19T06:03:26.456 INFO:tasks.cephadm:Adding mgr.z on smithi071 2024-09-19T06:03:26.456 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi003=x;smithi059=y;smithi071=z' 2024-09-19T06:03:26.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:26 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:26.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:26 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:26.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:26 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:26.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:26 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:03:26.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:26 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:26.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:26 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:26.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:26 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:26.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:26 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:26.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:26 smithi059 ceph-mon[35138]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T06:03:26.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:26 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:03:26.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:26 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:03:26.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:26 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:26.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:26 smithi059 ceph-mon[35138]: Reconfiguring daemon mon.a on smithi003 2024-09-19T06:03:26.687 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:03:26 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:03:26.594+0000 7fe660400640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-19T06:03:26.687 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:26 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:26.687 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:26 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:26.687 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:26 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:26.687 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:26 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:03:26.687 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:26 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:26.688 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:26 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:26.688 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:26 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:26.688 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:26 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:26.688 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:26 smithi003 ceph-mon[30893]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T06:03:26.688 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:26 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:03:26.688 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:26 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:03:26.688 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:26 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:26.688 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:26 smithi003 ceph-mon[30893]: Reconfiguring daemon mon.a on smithi003 2024-09-19T06:03:26.740 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:03:26.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:26 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:26.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:26 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:26.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:26 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:26.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:26 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:03:26.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:26 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:26.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:26 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:26.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:26 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:26.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:26 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:26.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:26 smithi071 ceph-mon[35662]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T06:03:26.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:26 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:03:26.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:26 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:03:26.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:26 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:26.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:26 smithi071 ceph-mon[35662]: Reconfiguring daemon mon.a on smithi003 2024-09-19T06:03:27.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.155+0000 7f60860cf640 1 -- 172.21.15.71:0/1692738935 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6080100610 msgr2=0x7f6080100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:27.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.155+0000 7f60860cf640 1 --2- 172.21.15.71:0/1692738935 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6080100610 0x7f6080100a10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6070009880 tx=0x7f607002a5d0 comp rx=0 tx=0).stop 2024-09-19T06:03:27.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.155+0000 7f60860cf640 1 -- 172.21.15.71:0/1692738935 shutdown_connections 2024-09-19T06:03:27.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.155+0000 7f60860cf640 1 --2- 172.21.15.71:0/1692738935 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6080100610 0x7f6080100a10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:27.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.155+0000 7f60860cf640 1 -- 172.21.15.71:0/1692738935 >> 172.21.15.71:0/1692738935 conn(0x7f60800fbdc0 msgr2=0x7f60800fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:27.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.155+0000 7f60860cf640 1 -- 172.21.15.71:0/1692738935 shutdown_connections 2024-09-19T06:03:27.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.155+0000 7f60860cf640 1 -- 172.21.15.71:0/1692738935 wait complete. 2024-09-19T06:03:27.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.156+0000 7f60860cf640 1 Processor -- start 2024-09-19T06:03:27.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.156+0000 7f60860cf640 1 -- start start 2024-09-19T06:03:27.180 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.156+0000 7f60860cf640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6080100610 0x7f6080197000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:27.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.156+0000 7f60860cf640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6080197540 0x7f608019c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:27.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.156+0000 7f60860cf640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60801979c0 0x7f608019eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:27.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.156+0000 7f60860cf640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6080106700 con 0x7f6080197540 2024-09-19T06:03:27.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.156+0000 7f60860cf640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6080106580 con 0x7f6080100610 2024-09-19T06:03:27.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.156+0000 7f60860cf640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6080106880 con 0x7f60801979c0 2024-09-19T06:03:27.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.156+0000 7f607f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6080100610 0x7f6080197000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:27.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.156+0000 7f607f7fe640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6080100610 0x7f6080197000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.71:43610/0 (socket says 172.21.15.71:43610) 2024-09-19T06:03:27.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.156+0000 7f607f7fe640 1 -- 172.21.15.71:0/131198081 learned_addr learned my addr 172.21.15.71:0/131198081 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-19T06:03:27.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.156+0000 7f607ffff640 1 --2- 172.21.15.71:0/131198081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60801979c0 0x7f608019eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:27.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.157+0000 7f6076ffd640 1 --2- 172.21.15.71:0/131198081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6080197540 0x7f608019c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:27.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.157+0000 7f607ffff640 1 -- 172.21.15.71:0/131198081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6080100610 msgr2=0x7f6080197000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:27.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.157+0000 7f607ffff640 1 --2- 172.21.15.71:0/131198081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6080100610 0x7f6080197000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:27.181 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.157+0000 7f607ffff640 1 -- 172.21.15.71:0/131198081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6080197540 msgr2=0x7f608019c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:27.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.157+0000 7f607ffff640 1 --2- 172.21.15.71:0/131198081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6080197540 0x7f608019c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:27.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.157+0000 7f607ffff640 1 -- 172.21.15.71:0/131198081 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f608019f400 con 0x7f60801979c0 2024-09-19T06:03:27.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.157+0000 7f6076ffd640 1 --2- 172.21.15.71:0/131198081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6080197540 0x7f608019c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:03:27.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.157+0000 7f607f7fe640 1 --2- 172.21.15.71:0/131198081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6080100610 0x7f6080197000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:03:27.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.157+0000 7f607ffff640 1 --2- 172.21.15.71:0/131198081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60801979c0 0x7f608019eb40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f607800bd50 tx=0x7f607800be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:27.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.157+0000 7f607d7fa640 1 -- 172.21.15.71:0/131198081 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6078019070 con 0x7f60801979c0 2024-09-19T06:03:27.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.157+0000 7f60860cf640 1 -- 172.21.15.71:0/131198081 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f608019f6f0 con 0x7f60801979c0 2024-09-19T06:03:27.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.157+0000 7f607d7fa640 1 -- 172.21.15.71:0/131198081 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6078014920 con 0x7f60801979c0 2024-09-19T06:03:27.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.157+0000 7f607d7fa640 1 -- 172.21.15.71:0/131198081 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6078012990 con 0x7f60801979c0 2024-09-19T06:03:27.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.157+0000 7f60860cf640 1 -- 172.21.15.71:0/131198081 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f608019fc60 con 0x7f60801979c0 2024-09-19T06:03:27.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.158+0000 7f607d7fa640 1 -- 172.21.15.71:0/131198081 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f607801c070 con 0x7f60801979c0 2024-09-19T06:03:27.182 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.158+0000 7f60860cf640 1 -- 172.21.15.71:0/131198081 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f608019ff20 con 0x7f60801979c0 2024-09-19T06:03:27.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.158+0000 7f607d7fa640 1 --2- 172.21.15.71:0/131198081 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f606c039730 0x7f606c03bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:27.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.158+0000 7f607d7fa640 1 -- 172.21.15.71:0/131198081 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f607804c090 con 0x7f60801979c0 2024-09-19T06:03:27.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.159+0000 7f607f7fe640 1 --2- 172.21.15.71:0/131198081 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f606c039730 0x7f606c03bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:27.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.159+0000 7f607f7fe640 1 --2- 172.21.15.71:0/131198081 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f606c039730 0x7f606c03bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6070009230 tx=0x7f60700058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:27.183 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.163+0000 7f607d7fa640 1 -- 172.21.15.71:0/131198081 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6078013c30 con 0x7f60801979c0 2024-09-19T06:03:27.341 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.339+0000 7f60860cf640 1 -- 172.21.15.71:0/131198081 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi003=x;smithi059=y;smithi071=z", "target": ["mon-mgr", ""]}) -- 0x7f608006ab30 con 0x7f606c039730 2024-09-19T06:03:27.347 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.345+0000 7f607d7fa640 1 -- 172.21.15.71:0/131198081 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f608006ab30 con 0x7f606c039730 2024-09-19T06:03:27.348 INFO:teuthology.orchestra.run.smithi071.stdout:Scheduled mgr update... 2024-09-19T06:03:27.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.347+0000 7f60860cf640 1 -- 172.21.15.71:0/131198081 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f606c039730 msgr2=0x7f606c03bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:27.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.347+0000 7f60860cf640 1 --2- 172.21.15.71:0/131198081 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f606c039730 0x7f606c03bbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6070009230 tx=0x7f60700058d0 comp rx=0 tx=0).stop 2024-09-19T06:03:27.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.347+0000 7f60860cf640 1 -- 172.21.15.71:0/131198081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60801979c0 msgr2=0x7f608019eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:27.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.347+0000 7f60860cf640 1 --2- 172.21.15.71:0/131198081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60801979c0 0x7f608019eb40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f607800bd50 tx=0x7f607800be40 comp rx=0 tx=0).stop 2024-09-19T06:03:27.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.347+0000 7f60860cf640 1 -- 172.21.15.71:0/131198081 shutdown_connections 2024-09-19T06:03:27.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.347+0000 7f60860cf640 1 --2- 172.21.15.71:0/131198081 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f606c039730 0x7f606c03bbf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:27.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.347+0000 7f60860cf640 1 --2- 172.21.15.71:0/131198081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f60801979c0 0x7f608019eb40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:27.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.347+0000 7f60860cf640 1 --2- 172.21.15.71:0/131198081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6080197540 0x7f608019c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:27.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.347+0000 7f60860cf640 1 --2- 172.21.15.71:0/131198081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6080100610 0x7f6080197000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:27.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.347+0000 7f60860cf640 1 -- 172.21.15.71:0/131198081 >> 172.21.15.71:0/131198081 conn(0x7f60800fbdc0 msgr2=0x7f608006a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:27.350 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.347+0000 7f60860cf640 1 -- 172.21.15.71:0/131198081 shutdown_connections 2024-09-19T06:03:27.351 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:03:27.347+0000 7f60860cf640 1 -- 172.21.15.71:0/131198081 wait complete. 2024-09-19T06:03:27.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:27 smithi071 ceph-mon[35662]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:27.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:27 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:27.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:27 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:27.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:27 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:27.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:27 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:03:27.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:27 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:03:27.907 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:27 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:27.935 DEBUG:teuthology.orchestra.run.smithi059:mgr.y> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T06:03:27.938 DEBUG:teuthology.orchestra.run.smithi071:mgr.z> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T06:03:27.940 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T06:03:27.941 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-19T06:03:27.941 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T06:03:27.961 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:27 smithi003 ceph-mon[30893]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:27.961 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:27 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:27.961 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:27 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:27.961 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:27 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:27.961 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:27 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:03:27.961 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:27 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:03:27.961 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:27 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:27.962 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:27 smithi059 ceph-mon[35138]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:27.962 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:27 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:27.962 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:27 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:27.962 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:27 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:27.962 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:27 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:03:27.962 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:27 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:03:27.962 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:27 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:27.978 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T06:03:27.978 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_1 2024-09-19T06:03:28.053 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T06:03:28.053 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:03:28.053 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 638 Links: 1 2024-09-19T06:03:28.053 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:03:28.053 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:03:28.053 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2024-09-19 06:02:43.986228844 +0000 2024-09-19T06:03:28.054 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2024-09-19 05:58:11.549072153 +0000 2024-09-19T06:03:28.054 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2024-09-19 05:58:11.549072153 +0000 2024-09-19T06:03:28.054 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2024-09-19 05:58:11.549072153 +0000 2024-09-19T06:03:28.054 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T06:03:28.150 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2024-09-19T06:03:28.150 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2024-09-19T06:03:28.150 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000357077 s, 1.4 MB/s 2024-09-19T06:03:28.153 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T06:03:28.192 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_2 2024-09-19T06:03:28.269 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T06:03:28.269 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:03:28.269 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 658 Links: 1 2024-09-19T06:03:28.269 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:03:28.270 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:03:28.270 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2024-09-19 06:02:44.041228134 +0000 2024-09-19T06:03:28.270 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2024-09-19 05:58:12.001066314 +0000 2024-09-19T06:03:28.270 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2024-09-19 05:58:12.001066314 +0000 2024-09-19T06:03:28.270 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2024-09-19 05:58:12.001066314 +0000 2024-09-19T06:03:28.270 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T06:03:28.363 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2024-09-19T06:03:28.364 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2024-09-19T06:03:28.364 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000281745 s, 1.8 MB/s 2024-09-19T06:03:28.366 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T06:03:28.403 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_3 2024-09-19T06:03:28.478 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T06:03:28.478 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:03:28.478 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 676 Links: 1 2024-09-19T06:03:28.478 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:03:28.478 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:03:28.478 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2024-09-19 06:02:44.094227450 +0000 2024-09-19T06:03:28.478 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2024-09-19 05:58:12.486060050 +0000 2024-09-19T06:03:28.478 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2024-09-19 05:58:12.486060050 +0000 2024-09-19T06:03:28.478 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2024-09-19 05:58:12.486060050 +0000 2024-09-19T06:03:28.479 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T06:03:28.571 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2024-09-19T06:03:28.571 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2024-09-19T06:03:28.571 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000283959 s, 1.8 MB/s 2024-09-19T06:03:28.573 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T06:03:28.610 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_4 2024-09-19T06:03:28.687 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T06:03:28.687 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:03:28.687 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 6h/6d Inode: 697 Links: 1 2024-09-19T06:03:28.687 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:03:28.687 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:03:28.687 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2024-09-19 06:02:44.147226766 +0000 2024-09-19T06:03:28.687 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2024-09-19 05:58:12.962053902 +0000 2024-09-19T06:03:28.687 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2024-09-19 05:58:12.962053902 +0000 2024-09-19T06:03:28.688 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2024-09-19 05:58:12.962053902 +0000 2024-09-19T06:03:28.688 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T06:03:28.785 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2024-09-19T06:03:28.785 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2024-09-19T06:03:28.785 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.00608385 s, 84.2 kB/s 2024-09-19T06:03:28.788 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T06:03:28.825 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-09-19T06:03:28.825 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T06:03:28.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:28 smithi003 ceph-mon[30893]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi003=x;smithi059=y;smithi071=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:03:28.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:28 smithi003 ceph-mon[30893]: Saving service mgr spec with placement smithi003=x;smithi059=y;smithi071=z;count:3 2024-09-19T06:03:28.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:28 smithi003 ceph-mon[30893]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T06:03:28.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:28 smithi003 ceph-mon[30893]: Reconfiguring daemon mgr.x on smithi003 2024-09-19T06:03:28.844 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T06:03:28.844 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_1 2024-09-19T06:03:28.903 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T06:03:28.904 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:03:28.904 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-19T06:03:28.904 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:03:28.904 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:03:28.904 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-09-19 06:03:17.039280830 +0000 2024-09-19T06:03:28.905 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-09-19 05:57:38.006574428 +0000 2024-09-19T06:03:28.905 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-09-19 05:57:38.006574428 +0000 2024-09-19T06:03:28.905 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-09-19 05:57:38.006574428 +0000 2024-09-19T06:03:28.905 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T06:03:28.968 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:28 smithi059 ceph-mon[35138]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi003=x;smithi059=y;smithi071=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:03:28.968 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:28 smithi059 ceph-mon[35138]: Saving service mgr spec with placement smithi003=x;smithi059=y;smithi071=z;count:3 2024-09-19T06:03:28.968 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:28 smithi059 ceph-mon[35138]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T06:03:28.968 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:28 smithi059 ceph-mon[35138]: Reconfiguring daemon mgr.x on smithi003 2024-09-19T06:03:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-09-19T06:03:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-09-19T06:03:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000219043 s, 2.3 MB/s 2024-09-19T06:03:28.972 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T06:03:29.030 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_2 2024-09-19T06:03:29.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:28 smithi071 ceph-mon[35662]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi003=x;smithi059=y;smithi071=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:03:29.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:28 smithi071 ceph-mon[35662]: Saving service mgr spec with placement smithi003=x;smithi059=y;smithi071=z;count:3 2024-09-19T06:03:29.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:28 smithi071 ceph-mon[35662]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T06:03:29.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:28 smithi071 ceph-mon[35662]: Reconfiguring daemon mgr.x on smithi003 2024-09-19T06:03:29.088 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T06:03:29.088 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:03:29.088 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-19T06:03:29.088 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:03:29.088 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:03:29.088 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-09-19 06:03:17.040280817 +0000 2024-09-19T06:03:29.088 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-09-19 05:57:38.340570005 +0000 2024-09-19T06:03:29.088 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-09-19 05:57:38.340570005 +0000 2024-09-19T06:03:29.088 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-09-19 05:57:38.340570005 +0000 2024-09-19T06:03:29.088 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T06:03:29.154 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-09-19T06:03:29.154 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-09-19T06:03:29.154 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000221398 s, 2.3 MB/s 2024-09-19T06:03:29.155 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T06:03:29.214 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_3 2024-09-19T06:03:29.270 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T06:03:29.270 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:03:29.270 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T06:03:29.270 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:03:29.270 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:03:29.270 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-09-19 06:03:17.040280817 +0000 2024-09-19T06:03:29.270 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-09-19 05:57:38.689565384 +0000 2024-09-19T06:03:29.270 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-09-19 05:57:38.689565384 +0000 2024-09-19T06:03:29.270 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-09-19 05:57:38.689565384 +0000 2024-09-19T06:03:29.271 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T06:03:29.334 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-09-19T06:03:29.334 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-09-19T06:03:29.334 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000186905 s, 2.7 MB/s 2024-09-19T06:03:29.335 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T06:03:29.391 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_4 2024-09-19T06:03:29.448 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T06:03:29.448 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:03:29.448 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-19T06:03:29.448 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:03:29.448 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:03:29.448 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-09-19 06:03:17.041280805 +0000 2024-09-19T06:03:29.448 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-09-19 05:57:39.019561014 +0000 2024-09-19T06:03:29.448 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-09-19 05:57:39.019561014 +0000 2024-09-19T06:03:29.448 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-09-19 05:57:39.019561014 +0000 2024-09-19T06:03:29.449 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T06:03:29.512 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-09-19T06:03:29.512 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-09-19T06:03:29.512 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000212102 s, 2.4 MB/s 2024-09-19T06:03:29.513 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T06:03:29.569 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-09-19T06:03:29.569 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T06:03:29.589 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T06:03:29.589 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_1 2024-09-19T06:03:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T06:03:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:03:29.649 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-19T06:03:29.649 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:03:29.649 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:03:29.649 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-19 06:03:07.768880920 +0000 2024-09-19T06:03:29.649 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-19 05:57:38.008152235 +0000 2024-09-19T06:03:29.649 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-19 05:57:38.008152235 +0000 2024-09-19T06:03:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-19 05:57:38.008152235 +0000 2024-09-19T06:03:29.650 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T06:03:29.718 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-19T06:03:29.718 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-19T06:03:29.718 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000288965 s, 1.8 MB/s 2024-09-19T06:03:29.719 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T06:03:29.779 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_2 2024-09-19T06:03:29.837 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T06:03:29.837 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:03:29.837 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-19T06:03:29.837 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:03:29.837 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:03:29.837 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-19 06:03:07.768880920 +0000 2024-09-19T06:03:29.837 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-19 05:57:38.335152258 +0000 2024-09-19T06:03:29.838 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-19 05:57:38.335152258 +0000 2024-09-19T06:03:29.838 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-19 05:57:38.335152258 +0000 2024-09-19T06:03:29.838 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T06:03:29.887 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:29 smithi059 ceph-mon[35138]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:29.887 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:29 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:29.887 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:29 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:29.887 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:29 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:03:29.887 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:29 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:03:29.888 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:29 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:29.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:29 smithi071 ceph-mon[35662]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:29.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:29 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:29.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:29 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:29.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:29 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:03:29.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:29 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:03:29.901 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:29 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:29.903 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-19T06:03:29.903 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-19T06:03:29.904 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000245026 s, 2.1 MB/s 2024-09-19T06:03:29.905 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T06:03:29.963 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_3 2024-09-19T06:03:30.020 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T06:03:30.020 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:03:30.020 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T06:03:30.020 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:03:30.021 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:03:30.021 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-19 06:03:07.769880920 +0000 2024-09-19T06:03:30.021 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-19 05:57:38.661152281 +0000 2024-09-19T06:03:30.021 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-19 05:57:38.661152281 +0000 2024-09-19T06:03:30.021 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-19 05:57:38.661152281 +0000 2024-09-19T06:03:30.021 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T06:03:30.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:29 smithi003 ceph-mon[30893]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:30.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:29 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:30.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:29 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:30.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:29 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:03:30.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:29 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:03:30.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:29 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:30.085 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-19T06:03:30.085 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-19T06:03:30.086 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.00021263 s, 2.4 MB/s 2024-09-19T06:03:30.086 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T06:03:30.143 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_4 2024-09-19T06:03:30.199 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T06:03:30.200 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:03:30.200 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-09-19T06:03:30.200 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:03:30.200 INFO:teuthology.orchestra.run.smithi071.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:03:30.200 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-09-19 06:03:07.769880920 +0000 2024-09-19T06:03:30.200 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-09-19 05:57:38.986152304 +0000 2024-09-19T06:03:30.200 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-09-19 05:57:38.986152304 +0000 2024-09-19T06:03:30.200 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: 2024-09-19 05:57:38.986152304 +0000 2024-09-19T06:03:30.200 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T06:03:30.263 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-09-19T06:03:30.264 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-09-19T06:03:30.264 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000213177 s, 2.4 MB/s 2024-09-19T06:03:30.265 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T06:03:30.322 INFO:tasks.cephadm:Deploying osd.0 on smithi003 with /dev/vg_nvme/lv_4... 2024-09-19T06:03:30.322 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T06:03:30.701 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:03:30.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:30 smithi059 ceph-mon[35138]: Reconfiguring mon.b (monmap changed)... 2024-09-19T06:03:30.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:30 smithi059 ceph-mon[35138]: Reconfiguring daemon mon.b on smithi059 2024-09-19T06:03:30.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:30 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:30.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:30 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:30.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:30 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:03:30.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:30 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:03:30.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:30 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:30.940 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:30 smithi071 ceph-mon[35662]: Reconfiguring mon.b (monmap changed)... 2024-09-19T06:03:30.940 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:30 smithi071 ceph-mon[35662]: Reconfiguring daemon mon.b on smithi059 2024-09-19T06:03:30.940 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:30 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:30.940 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:30 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:30.940 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:30 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:03:30.940 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:30 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:03:30.940 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:30 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:30.976 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:30 smithi003 ceph-mon[30893]: Reconfiguring mon.b (monmap changed)... 2024-09-19T06:03:30.977 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:30 smithi003 ceph-mon[30893]: Reconfiguring daemon mon.b on smithi059 2024-09-19T06:03:30.977 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:30 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:30.977 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:30 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:30.977 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:30 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:03:30.977 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:30 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:03:30.977 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:30 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:31.852 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:31 smithi071 ceph-mon[35662]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:31.853 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:31 smithi071 ceph-mon[35662]: Reconfiguring mon.c (monmap changed)... 2024-09-19T06:03:31.853 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:31 smithi071 ceph-mon[35662]: Reconfiguring daemon mon.c on smithi071 2024-09-19T06:03:31.928 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:31 smithi003 ceph-mon[30893]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:31.928 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:31 smithi003 ceph-mon[30893]: Reconfiguring mon.c (monmap changed)... 2024-09-19T06:03:31.928 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:31 smithi003 ceph-mon[30893]: Reconfiguring daemon mon.c on smithi071 2024-09-19T06:03:32.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:31 smithi059 ceph-mon[35138]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:32.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:31 smithi059 ceph-mon[35138]: Reconfiguring mon.c (monmap changed)... 2024-09-19T06:03:32.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:31 smithi059 ceph-mon[35138]: Reconfiguring daemon mon.c on smithi071 2024-09-19T06:03:32.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:32 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:32.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:32 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:32.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:32 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:32.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:32 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:32.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:32 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:32.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:32 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:32.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:32 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:03:32.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:32 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:03:32.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:32 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:03:32.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:32 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:32.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:32 smithi003 ceph-mon[30893]: Deploying daemon mgr.z on smithi071 2024-09-19T06:03:32.944 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:32 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:32.944 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:32 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:32.944 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:32 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:32.944 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:32 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:32.944 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:32 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:32.944 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:32 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:32.944 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:32 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:03:32.944 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:32 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:03:32.945 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:32 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:03:32.945 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:32 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:32.945 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:32 smithi071 ceph-mon[35662]: Deploying daemon mgr.z on smithi071 2024-09-19T06:03:33.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:32 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:33.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:32 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:33.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:32 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:33.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:32 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:33.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:32 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:33.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:32 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:33.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:32 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:03:33.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:32 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:03:33.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:32 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:03:33.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:32 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:33.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:32 smithi059 ceph-mon[35138]: Deploying daemon mgr.z on smithi071 2024-09-19T06:03:33.586 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:33 smithi071 podman[37459]: 2024-09-19 06:03:33.502940174 +0000 UTC m=+0.117355604 container create c9c913e309fb94b138b61b8fcc26258caf4f27c77039e0604c51850a800c8a2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T06:03:33.885 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:03:33.902 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:33 smithi071 ceph-mon[35662]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:33.902 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:33 smithi071 podman[37459]: 2024-09-19 06:03:33.713482175 +0000 UTC m=+0.327897598 container init c9c913e309fb94b138b61b8fcc26258caf4f27c77039e0604c51850a800c8a2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-19T06:03:33.903 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:33 smithi071 podman[37459]: 2024-09-19 06:03:33.716321592 +0000 UTC m=+0.330737019 container start c9c913e309fb94b138b61b8fcc26258caf4f27c77039e0604c51850a800c8a2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:03:33.903 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:33 smithi071 ceph-mgr[37478]: -- 172.21.15.71:0/1292641278 <== mon.1 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5558ff1290e0 con 0x5558ff107000 2024-09-19T06:03:33.903 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:33 smithi071 bash[37459]: c9c913e309fb94b138b61b8fcc26258caf4f27c77039e0604c51850a800c8a2b 2024-09-19T06:03:33.903 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:33 smithi071 systemd[1]: Started Ceph mgr.z for 782a5144-764c-11ef-bceb-c7b262605968. 2024-09-19T06:03:33.903 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:33 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:33.839+0000 7f60fe4aa040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:03:33.903 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:33 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:33.899+0000 7f60fe4aa040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:03:33.920 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi003:vg_nvme/lv_4 2024-09-19T06:03:33.972 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:33 smithi003 ceph-mon[30893]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:34.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:33 smithi059 ceph-mon[35138]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:34.262 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:34 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:34.047+0000 7f60fe4aa040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:03:34.262 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:34 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:34.112+0000 7f60fe4aa040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:03:34.262 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:34 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:34.259+0000 7f60fe4aa040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:03:34.291 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:03:34.586 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:34 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:34.398+0000 7f60fe4aa040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:03:34.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.852+0000 7f0b00e00640 1 -- 172.21.15.3:0/781544239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0afc076ba0 msgr2=0x7f0afc076fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:34.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.852+0000 7f0b00e00640 1 --2- 172.21.15.3:0/781544239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0afc076ba0 0x7f0afc076fa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0aec009860 tx=0x7f0aec02a340 comp rx=0 tx=0).stop 2024-09-19T06:03:34.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.852+0000 7f0b00e00640 1 -- 172.21.15.3:0/781544239 shutdown_connections 2024-09-19T06:03:34.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.852+0000 7f0b00e00640 1 --2- 172.21.15.3:0/781544239 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0afc078790 0x7f0afc079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:34.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.852+0000 7f0b00e00640 1 --2- 172.21.15.3:0/781544239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0afc077df0 0x7f0afc078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:34.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.852+0000 7f0b00e00640 1 --2- 172.21.15.3:0/781544239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0afc076ba0 0x7f0afc076fa0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:34.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.852+0000 7f0b00e00640 1 -- 172.21.15.3:0/781544239 >> 172.21.15.3:0/781544239 conn(0x7f0afc0ff5b0 msgr2=0x7f0afc1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:34.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.852+0000 7f0b00e00640 1 -- 172.21.15.3:0/781544239 shutdown_connections 2024-09-19T06:03:34.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.852+0000 7f0b00e00640 1 -- 172.21.15.3:0/781544239 wait complete. 2024-09-19T06:03:34.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.854+0000 7f0b00e00640 1 Processor -- start 2024-09-19T06:03:34.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.854+0000 7f0b00e00640 1 -- start start 2024-09-19T06:03:34.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.854+0000 7f0b00e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0afc076ba0 0x7f0afc19e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:34.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.854+0000 7f0b00e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0afc077df0 0x7f0afc19ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:34.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.854+0000 7f0b00e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0afc078790 0x7f0afc1a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:34.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.854+0000 7f0b00e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0afc113ea0 con 0x7f0afc077df0 2024-09-19T06:03:34.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.854+0000 7f0b00e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0afc113d20 con 0x7f0afc078790 2024-09-19T06:03:34.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.854+0000 7f0b00e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0afc114020 con 0x7f0afc076ba0 2024-09-19T06:03:34.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.854+0000 7f0af9e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0afc076ba0 0x7f0afc19e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:34.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.854+0000 7f0af9e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0afc076ba0 0x7f0afc19e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:50186/0 (socket says 172.21.15.3:50186) 2024-09-19T06:03:34.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.854+0000 7f0af9e00640 1 -- 172.21.15.3:0/2164784656 learned_addr learned my addr 172.21.15.3:0/2164784656 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:03:34.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.855+0000 7f0af3e00640 1 --2- 172.21.15.3:0/2164784656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0afc077df0 0x7f0afc19ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:34.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.855+0000 7f0afa800640 1 --2- 172.21.15.3:0/2164784656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0afc078790 0x7f0afc1a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:34.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.855+0000 7f0af9e00640 1 -- 172.21.15.3:0/2164784656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0afc078790 msgr2=0x7f0afc1a5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:34.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.855+0000 7f0af9e00640 1 --2- 172.21.15.3:0/2164784656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0afc078790 0x7f0afc1a5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:34.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.855+0000 7f0af9e00640 1 -- 172.21.15.3:0/2164784656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0afc077df0 msgr2=0x7f0afc19ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:34.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.855+0000 7f0af9e00640 1 --2- 172.21.15.3:0/2164784656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0afc077df0 0x7f0afc19ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:34.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.855+0000 7f0af9e00640 1 -- 172.21.15.3:0/2164784656 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0afc1a6100 con 0x7f0afc076ba0 2024-09-19T06:03:34.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.855+0000 7f0af9e00640 1 --2- 172.21.15.3:0/2164784656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0afc076ba0 0x7f0afc19e4d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0aec035040 tx=0x7f0aec033d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:34.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.855+0000 7f0af2a00640 1 -- 172.21.15.3:0/2164784656 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec037040 con 0x7f0afc076ba0 2024-09-19T06:03:34.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.855+0000 7f0af2a00640 1 -- 172.21.15.3:0/2164784656 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0aec030850 con 0x7f0afc076ba0 2024-09-19T06:03:34.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.855+0000 7f0b00e00640 1 -- 172.21.15.3:0/2164784656 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0afc1a6390 con 0x7f0afc076ba0 2024-09-19T06:03:34.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.855+0000 7f0af2a00640 1 -- 172.21.15.3:0/2164784656 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec004920 con 0x7f0afc076ba0 2024-09-19T06:03:34.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.856+0000 7f0b00e00640 1 -- 172.21.15.3:0/2164784656 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0afc1a68c0 con 0x7f0afc076ba0 2024-09-19T06:03:34.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.856+0000 7f0af2a00640 1 -- 172.21.15.3:0/2164784656 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f0aec004ac0 con 0x7f0afc076ba0 2024-09-19T06:03:34.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.857+0000 7f0b00e00640 1 -- 172.21.15.3:0/2164784656 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0afc110780 con 0x7f0afc076ba0 2024-09-19T06:03:34.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.857+0000 7f0af2a00640 1 --2- 172.21.15.3:0/2164784656 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0ae0039500 0x7f0ae003b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:03:34.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.857+0000 7f0af2a00640 1 -- 172.21.15.3:0/2164784656 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0aec06c680 con 0x7f0afc076ba0 2024-09-19T06:03:34.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.857+0000 7f0af3e00640 1 --2- 172.21.15.3:0/2164784656 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0ae0039500 0x7f0ae003b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:03:34.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.858+0000 7f0af3e00640 1 --2- 172.21.15.3:0/2164784656 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0ae0039500 0x7f0ae003b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0afc19f9f0 tx=0x7f0ae4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:03:34.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:34.862+0000 7f0af2a00640 1 -- 172.21.15.3:0/2164784656 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0aec004db0 con 0x7f0afc076ba0 2024-09-19T06:03:35.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:34 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:35.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:34 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:35.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:34 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:35.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:34 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:03:35.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:34 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:03:35.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:34 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:03:35.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:34 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:35.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:34 smithi059 ceph-mon[35138]: Deploying daemon mgr.y on smithi059 2024-09-19T06:03:35.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:35.059+0000 7f0b00e00640 1 -- 172.21.15.3:0/2164784656 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f0afc062630 con 0x7f0ae0039500 2024-09-19T06:03:35.063 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:34 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:35.063 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:34 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:35.063 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:34 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:35.063 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:34 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:03:35.063 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:34 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:03:35.063 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:34 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:03:35.063 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:34 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:35.063 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:34 smithi003 ceph-mon[30893]: Deploying daemon mgr.y on smithi059 2024-09-19T06:03:35.086 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:34 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:34.711+0000 7f60fe4aa040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:03:35.086 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:34 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:34.771+0000 7f60fe4aa040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:03:35.086 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:34 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:34.955+0000 7f60fe4aa040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:03:35.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:34 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:35.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:34 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:35.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:34 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:35.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:34 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:03:35.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:34 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:03:35.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:34 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:03:35.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:34 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:35.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:34 smithi071 ceph-mon[35662]: Deploying daemon mgr.y on smithi059 2024-09-19T06:03:35.789 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:35 smithi059 systemd[1]: Starting Ceph mgr.y for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:03:35.966 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:35 smithi003 ceph-mon[30893]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:35.966 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:35 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:03:35.966 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:35 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:03:35.966 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:35 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:36.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:35 smithi071 ceph-mon[35662]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:36.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:35 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:03:36.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:35 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:03:36.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:35 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:36.086 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:35 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:35.825+0000 7f60fe4aa040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:03:36.086 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:35 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:35.892+0000 7f60fe4aa040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:03:36.175 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:35 smithi059 ceph-mon[35138]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:36.176 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:35 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:03:36.176 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:35 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:03:36.176 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:35 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:36.176 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:35 smithi059 podman[36488]: 2024-09-19 06:03:35.789790584 +0000 UTC m=+0.015975484 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:03:36.176 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:35 smithi059 podman[36488]: 2024-09-19 06:03:35.888642229 +0000 UTC m=+0.114827128 container create 98ccaf64235e62b4d34cb1472c5e39d50ef4be0270d3ddfd0261fa3f6d954f84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T06:03:36.176 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:36 smithi059 podman[36488]: 2024-09-19 06:03:36.099327008 +0000 UTC m=+0.325511919 container init 98ccaf64235e62b4d34cb1472c5e39d50ef4be0270d3ddfd0261fa3f6d954f84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T06:03:36.176 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:36 smithi059 podman[36488]: 2024-09-19 06:03:36.102288154 +0000 UTC m=+0.328473062 container start 98ccaf64235e62b4d34cb1472c5e39d50ef4be0270d3ddfd0261fa3f6d954f84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T06:03:36.176 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:36 smithi059 ceph-mgr[36508]: -- 172.21.15.59:0/2430557548 <== mon.2 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bb549c30e0 con 0x55bb549a0800 2024-09-19T06:03:36.176 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:36 smithi059 bash[36488]: 98ccaf64235e62b4d34cb1472c5e39d50ef4be0270d3ddfd0261fa3f6d954f84 2024-09-19T06:03:36.453 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:36 smithi059 systemd[1]: Started Ceph mgr.y for 782a5144-764c-11ef-bceb-c7b262605968. 2024-09-19T06:03:36.453 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:36 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:36.234+0000 7fa272de4040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:03:36.453 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:36 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:36.294+0000 7fa272de4040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:03:36.453 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:36 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:36.451+0000 7fa272de4040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:03:36.788 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:36 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:36.521+0000 7fa272de4040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:03:36.788 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:36 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:36.680+0000 7fa272de4040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:03:36.939 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:36 smithi071 ceph-mon[35662]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:03:36.939 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:36.939 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:36.939 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:36.939 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:36.939 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:36.939 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:36 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:36.658+0000 7f60fe4aa040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:03:36.939 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:36 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:36.786+0000 7f60fe4aa040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:03:36.940 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:36 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:36.936+0000 7f60fe4aa040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:03:37.007 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:36 smithi003 ceph-mon[30893]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:03:37.008 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:37.008 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:37.008 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:37.008 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:37.008 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:37.179 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:36 smithi059 ceph-mon[35138]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:03:37.179 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:37.180 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:37.180 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:37.180 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:37.180 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:37.180 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:36 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:36.842+0000 7fa272de4040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:03:37.180 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:37 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:37.176+0000 7fa272de4040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:03:37.197 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:37 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:37.002+0000 7f60fe4aa040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:03:37.197 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:37 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:37.159+0000 7f60fe4aa040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:03:37.446 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:37 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:37.240+0000 7fa272de4040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:03:37.446 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:37 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:37.443+0000 7fa272de4040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:03:37.461 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:37 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:37.230+0000 7f60fe4aa040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:03:37.461 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:37 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:37.290+0000 7f60fe4aa040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:03:37.461 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:37 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:37.458+0000 7f60fe4aa040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:03:37.739 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:37 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:37.526+0000 7f60fe4aa040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:03:37.740 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:37 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:37.593+0000 7f60fe4aa040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:03:37.740 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:37 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:37.677+0000 7f60fe4aa040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:03:38.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:37 smithi003 ceph-mon[30893]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:38.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:37 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:38.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:37 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:38.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:37 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:38.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:37 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:38.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:37 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:38.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:37 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:38.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:37 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:38.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:37 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:38.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:37 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:38.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:37 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:38.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:37 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:38.086 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:37 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:37.737+0000 7f60fe4aa040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:03:38.086 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:37 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:37.795+0000 7f60fe4aa040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:03:38.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:37 smithi071 ceph-mon[35662]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:38.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:37 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:38.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:37 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:38.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:37 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:38.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:37 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:38.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:37 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:38.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:37 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:38.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:37 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:38.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:37 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:38.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:37 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:38.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:37 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:38.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:37 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:38.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:37 smithi059 ceph-mon[35138]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:38.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:37 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:38.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:37 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:38.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:37 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:38.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:37 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:38.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:37 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:38.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:37 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:38.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:37 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:38.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:37 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:38.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:37 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:38.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:37 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:38.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:37 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:38.788 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:38 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:38.366+0000 7fa272de4040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:03:38.789 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:38 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:38.435+0000 7fa272de4040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:03:38.836 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:03:38 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:03:38.573+0000 7f60fe4aa040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:03:39.186 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:38 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/4263388803' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd89ea4b-a24e-4946-80fc-1776b6d05e24"}]: dispatch 2024-09-19T06:03:39.186 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:38 smithi059 ceph-mon[35138]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd89ea4b-a24e-4946-80fc-1776b6d05e24"}]: dispatch 2024-09-19T06:03:39.186 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:38 smithi059 ceph-mon[35138]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd89ea4b-a24e-4946-80fc-1776b6d05e24"}]': finished 2024-09-19T06:03:39.186 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:38 smithi059 ceph-mon[35138]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T06:03:39.187 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:38 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:03:39.187 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:38 smithi059 ceph-mon[35138]: Standby manager daemon z started 2024-09-19T06:03:39.187 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:38 smithi059 ceph-mon[35138]: from='mgr.? 172.21.15.71:0/1122962855' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:03:39.187 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:38 smithi059 ceph-mon[35138]: from='mgr.? 172.21.15.71:0/1122962855' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:03:39.187 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:38 smithi059 ceph-mon[35138]: from='mgr.? 172.21.15.71:0/1122962855' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:03:39.187 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:38 smithi059 ceph-mon[35138]: from='mgr.? 172.21.15.71:0/1122962855' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:03:39.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:39.266+0000 7f0af2a00640 1 -- 172.21.15.3:0/2164784656 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 14) ==== 92407+0+0 (secure 0 0 0) 0x7f0aec004050 con 0x7f0afc076ba0 2024-09-19T06:03:39.269 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:38 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/4263388803' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd89ea4b-a24e-4946-80fc-1776b6d05e24"}]: dispatch 2024-09-19T06:03:39.269 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:38 smithi003 ceph-mon[30893]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd89ea4b-a24e-4946-80fc-1776b6d05e24"}]: dispatch 2024-09-19T06:03:39.269 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:38 smithi003 ceph-mon[30893]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd89ea4b-a24e-4946-80fc-1776b6d05e24"}]': finished 2024-09-19T06:03:39.269 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:38 smithi003 ceph-mon[30893]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T06:03:39.269 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:38 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:03:39.269 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:38 smithi003 ceph-mon[30893]: Standby manager daemon z started 2024-09-19T06:03:39.269 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:38 smithi003 ceph-mon[30893]: from='mgr.? 172.21.15.71:0/1122962855' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:03:39.269 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:38 smithi003 ceph-mon[30893]: from='mgr.? 172.21.15.71:0/1122962855' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:03:39.269 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:38 smithi003 ceph-mon[30893]: from='mgr.? 172.21.15.71:0/1122962855' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:03:39.269 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:38 smithi003 ceph-mon[30893]: from='mgr.? 172.21.15.71:0/1122962855' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:03:39.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:38 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/4263388803' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd89ea4b-a24e-4946-80fc-1776b6d05e24"}]: dispatch 2024-09-19T06:03:39.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:38 smithi071 ceph-mon[35662]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fd89ea4b-a24e-4946-80fc-1776b6d05e24"}]: dispatch 2024-09-19T06:03:39.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:38 smithi071 ceph-mon[35662]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fd89ea4b-a24e-4946-80fc-1776b6d05e24"}]': finished 2024-09-19T06:03:39.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:38 smithi071 ceph-mon[35662]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T06:03:39.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:38 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:03:39.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:38 smithi071 ceph-mon[35662]: Standby manager daemon z started 2024-09-19T06:03:39.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:38 smithi071 ceph-mon[35662]: from='mgr.? 172.21.15.71:0/1122962855' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:03:39.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:38 smithi071 ceph-mon[35662]: from='mgr.? 172.21.15.71:0/1122962855' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:03:39.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:38 smithi071 ceph-mon[35662]: from='mgr.? 172.21.15.71:0/1122962855' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:03:39.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:38 smithi071 ceph-mon[35662]: from='mgr.? 172.21.15.71:0/1122962855' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:03:39.454 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:39 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:39.183+0000 7fa272de4040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:03:39.454 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:39 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:39.303+0000 7fa272de4040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:03:39.743 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:39 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:39.451+0000 7fa272de4040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:03:39.743 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:39 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:39.514+0000 7fa272de4040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:03:39.743 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:39 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:39.669+0000 7fa272de4040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:03:39.743 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:39 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:39.740+0000 7fa272de4040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:03:40.036 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:39 smithi059 ceph-mon[35138]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:40.037 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:39 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2952071364' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:03:40.037 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:39 smithi059 ceph-mon[35138]: mgrmap e14: x(active, since 69s), standbys: z 2024-09-19T06:03:40.037 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:39 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:03:40.037 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:39 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:39.802+0000 7fa272de4040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:03:40.037 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:39 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:39.966+0000 7fa272de4040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:03:40.037 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:40 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:40.033+0000 7fa272de4040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:03:40.237 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:39 smithi071 ceph-mon[35662]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:40.238 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:39 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2952071364' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:03:40.238 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:39 smithi071 ceph-mon[35662]: mgrmap e14: x(active, since 69s), standbys: z 2024-09-19T06:03:40.238 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:39 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:03:40.288 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:40 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:40.103+0000 7fa272de4040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:03:40.289 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:40 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:40.188+0000 7fa272de4040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:03:40.289 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:40 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:40.250+0000 7fa272de4040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:03:40.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:39 smithi003 ceph-mon[30893]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:40.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:39 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2952071364' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:03:40.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:39 smithi003 ceph-mon[30893]: mgrmap e14: x(active, since 69s), standbys: z 2024-09-19T06:03:40.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:39 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:03:40.788 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:40 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:40.311+0000 7fa272de4040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:03:41.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:41 smithi059 ceph-mon[35138]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:41.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:41 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:41.539 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:03:41 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:03:41.135+0000 7fa272de4040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:03:41.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:41 smithi003 ceph-mon[30893]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:41.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:41 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:41.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:41 smithi071 ceph-mon[35662]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:41.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:41 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:42.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:42.104+0000 7f0af2a00640 1 -- 172.21.15.3:0/2164784656 <== mon.1 v2:172.21.15.71:3300/0 8 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7f0aec06bb70 con 0x7f0afc076ba0 2024-09-19T06:03:42.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:42 smithi059 ceph-mon[35138]: Standby manager daemon y started 2024-09-19T06:03:42.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:42 smithi059 ceph-mon[35138]: from='mgr.? 172.21.15.59:0/269009624' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:03:42.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:42 smithi059 ceph-mon[35138]: from='mgr.? 172.21.15.59:0/269009624' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:03:42.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:42 smithi059 ceph-mon[35138]: from='mgr.? 172.21.15.59:0/269009624' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:03:42.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:42 smithi059 ceph-mon[35138]: from='mgr.? 172.21.15.59:0/269009624' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:03:42.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:42 smithi003 ceph-mon[30893]: Standby manager daemon y started 2024-09-19T06:03:42.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:42 smithi003 ceph-mon[30893]: from='mgr.? 172.21.15.59:0/269009624' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:03:42.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:42 smithi003 ceph-mon[30893]: from='mgr.? 172.21.15.59:0/269009624' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:03:42.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:42 smithi003 ceph-mon[30893]: from='mgr.? 172.21.15.59:0/269009624' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:03:42.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:42 smithi003 ceph-mon[30893]: from='mgr.? 172.21.15.59:0/269009624' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:03:42.588 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:42 smithi071 ceph-mon[35662]: Standby manager daemon y started 2024-09-19T06:03:42.588 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:42 smithi071 ceph-mon[35662]: from='mgr.? 172.21.15.59:0/269009624' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:03:42.589 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:42 smithi071 ceph-mon[35662]: from='mgr.? 172.21.15.59:0/269009624' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:03:42.589 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:42 smithi071 ceph-mon[35662]: from='mgr.? 172.21.15.59:0/269009624' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:03:42.589 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:42 smithi071 ceph-mon[35662]: from='mgr.? 172.21.15.59:0/269009624' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:03:43.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:43 smithi059 ceph-mon[35138]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:43.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:43 smithi059 ceph-mon[35138]: mgrmap e15: x(active, since 72s), standbys: z, y 2024-09-19T06:03:43.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:43 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:03:43.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:43 smithi003 ceph-mon[30893]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:43.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:43 smithi003 ceph-mon[30893]: mgrmap e15: x(active, since 72s), standbys: z, y 2024-09-19T06:03:43.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:43 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:03:43.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:43 smithi071 ceph-mon[35662]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:43.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:43 smithi071 ceph-mon[35662]: mgrmap e15: x(active, since 72s), standbys: z, y 2024-09-19T06:03:43.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:43 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:03:45.266 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:45 smithi003 ceph-mon[30893]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:45.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:45 smithi059 ceph-mon[35138]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:45.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:45 smithi071 ceph-mon[35662]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:47.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:47 smithi003 ceph-mon[30893]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:47.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:47 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T06:03:47.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:47 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:47.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:47 smithi003 ceph-mon[30893]: Deploying daemon osd.0 on smithi003 2024-09-19T06:03:47.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:47 smithi059 ceph-mon[35138]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:47.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:47 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T06:03:47.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:47 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:47.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:47 smithi059 ceph-mon[35138]: Deploying daemon osd.0 on smithi003 2024-09-19T06:03:47.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:47 smithi071 ceph-mon[35662]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:47.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:47 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T06:03:47.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:47 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:47.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:47 smithi071 ceph-mon[35662]: Deploying daemon osd.0 on smithi003 2024-09-19T06:03:49.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:49 smithi003 ceph-mon[30893]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:49.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:49 smithi059 ceph-mon[35138]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:49.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:49 smithi071 ceph-mon[35662]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:51.276 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:51 smithi003 ceph-mon[30893]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:51.419 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:51 smithi071 ceph-mon[35662]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:51.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:51 smithi059 ceph-mon[35138]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:53.464 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:53 smithi003 ceph-mon[30893]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:53.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:53 smithi059 ceph-mon[35138]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:53.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:53 smithi071 ceph-mon[35662]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:55.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:55 smithi059 ceph-mon[35138]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:55.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:55 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:55.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:55 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:55.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:55 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:55.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:55 smithi003 ceph-mon[30893]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:55.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:55 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:55.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:55 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:55.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:55 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:55.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:55 smithi071 ceph-mon[35662]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:55.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:55 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:03:55.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:55 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:55.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:55 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:57.443 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:57 smithi003 ceph-mon[30893]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:57.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:57 smithi059 ceph-mon[35138]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:57.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:57 smithi071 ceph-mon[35662]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:59.783 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:59 smithi003 ceph-mon[30893]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:59.783 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:59 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:59.784 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:59 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:59.784 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:59 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:59.784 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:59 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:59.784 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:03:59 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:59.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:59 smithi059 ceph-mon[35138]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:59.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:59 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:59.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:59 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:59.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:59 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:59.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:59 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:59.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:03:59 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:59.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:59.828+0000 7f0af2a00640 1 -- 172.21.15.3:0/2164784656 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0afc062630 con 0x7f0ae0039500 2024-09-19T06:03:59.831 INFO:teuthology.orchestra.run.smithi003.stdout:Created osd(s) 0 on host 'smithi003' 2024-09-19T06:03:59.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:59.832+0000 7f0b00e00640 1 -- 172.21.15.3:0/2164784656 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0ae0039500 msgr2=0x7f0ae003b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:59.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:59.832+0000 7f0b00e00640 1 --2- 172.21.15.3:0/2164784656 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0ae0039500 0x7f0ae003b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0afc19f9f0 tx=0x7f0ae4005f90 comp rx=0 tx=0).stop 2024-09-19T06:03:59.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:59.832+0000 7f0b00e00640 1 -- 172.21.15.3:0/2164784656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0afc076ba0 msgr2=0x7f0afc19e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:03:59.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:59.832+0000 7f0b00e00640 1 --2- 172.21.15.3:0/2164784656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0afc076ba0 0x7f0afc19e4d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0aec035040 tx=0x7f0aec033d90 comp rx=0 tx=0).stop 2024-09-19T06:03:59.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:59.832+0000 7f0b00e00640 1 -- 172.21.15.3:0/2164784656 shutdown_connections 2024-09-19T06:03:59.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:59.832+0000 7f0b00e00640 1 --2- 172.21.15.3:0/2164784656 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0ae0039500 0x7f0ae003b9c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:59.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:59.832+0000 7f0b00e00640 1 --2- 172.21.15.3:0/2164784656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0afc078790 0x7f0afc1a5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:59.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:59.832+0000 7f0b00e00640 1 --2- 172.21.15.3:0/2164784656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0afc077df0 0x7f0afc19ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:59.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:59.832+0000 7f0b00e00640 1 --2- 172.21.15.3:0/2164784656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0afc076ba0 0x7f0afc19e4d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:03:59.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:59.832+0000 7f0b00e00640 1 -- 172.21.15.3:0/2164784656 >> 172.21.15.3:0/2164784656 conn(0x7f0afc0ff5b0 msgr2=0x7f0afc101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:03:59.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:59.832+0000 7f0b00e00640 1 -- 172.21.15.3:0/2164784656 shutdown_connections 2024-09-19T06:03:59.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:03:59.832+0000 7f0b00e00640 1 -- 172.21.15.3:0/2164784656 wait complete. 2024-09-19T06:03:59.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:59 smithi071 ceph-mon[35662]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:03:59.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:59 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:59.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:59 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:03:59.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:59 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:03:59.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:59 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:03:59.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:03:59 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:00.538 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:00 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:00.539 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:00 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:00.539 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:00 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:00.574 DEBUG:teuthology.orchestra.run.smithi003:osd.0> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T06:04:00.578 INFO:tasks.cephadm:Deploying osd.1 on smithi059 with /dev/vg_nvme/lv_4... 2024-09-19T06:04:00.578 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T06:04:00.609 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:00 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:00.609 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:00 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:00.609 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:00 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:00.817 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:04:00 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-0[45244]: 2024-09-19T06:04:00.697+0000 7f28d760b640 -1 osd.0 0 log_to_monitors true 2024-09-19T06:04:00.835 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:04:00.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:00 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:00.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:00 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:00.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:00 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:01.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:01 smithi059 ceph-mon[35138]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:04:01.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:01 smithi059 ceph-mon[35138]: from='osd.0 [v2:172.21.15.3:6802/2061486638,v1:172.21.15.3:6803/2061486638]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:04:01.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:01 smithi059 ceph-mon[35138]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:04:01.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:01 smithi003 ceph-mon[30893]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:04:01.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:01 smithi003 ceph-mon[30893]: from='osd.0 [v2:172.21.15.3:6802/2061486638,v1:172.21.15.3:6803/2061486638]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:04:01.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:01 smithi003 ceph-mon[30893]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:04:01.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:01 smithi071 ceph-mon[35662]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:04:01.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:01 smithi071 ceph-mon[35662]: from='osd.0 [v2:172.21.15.3:6802/2061486638,v1:172.21.15.3:6803/2061486638]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:04:01.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:01 smithi071 ceph-mon[35662]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:04:02.479 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:02 smithi059 ceph-mon[35138]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T06:04:02.479 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:02 smithi059 ceph-mon[35138]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T06:04:02.479 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:02 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:04:02.479 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:02 smithi059 ceph-mon[35138]: from='osd.0 [v2:172.21.15.3:6802/2061486638,v1:172.21.15.3:6803/2061486638]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]: dispatch 2024-09-19T06:04:02.479 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:02 smithi059 ceph-mon[35138]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]: dispatch 2024-09-19T06:04:02.507 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:02 smithi003 ceph-mon[30893]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T06:04:02.508 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:02 smithi003 ceph-mon[30893]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T06:04:02.508 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:02 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:04:02.508 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:02 smithi003 ceph-mon[30893]: from='osd.0 [v2:172.21.15.3:6802/2061486638,v1:172.21.15.3:6803/2061486638]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]: dispatch 2024-09-19T06:04:02.508 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:02 smithi003 ceph-mon[30893]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]: dispatch 2024-09-19T06:04:02.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:02 smithi071 ceph-mon[35662]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T06:04:02.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:02 smithi071 ceph-mon[35662]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T06:04:02.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:02 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:04:02.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:02 smithi071 ceph-mon[35662]: from='osd.0 [v2:172.21.15.3:6802/2061486638,v1:172.21.15.3:6803/2061486638]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]: dispatch 2024-09-19T06:04:02.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:02 smithi071 ceph-mon[35662]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]: dispatch 2024-09-19T06:04:03.327 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-19T06:04:03.334 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:04:02 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-0[45244]: 2024-09-19T06:04:02.929+0000 7f28d2200640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T06:04:03.334 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:04:02 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-0[45244]: 2024-09-19T06:04:02.946+0000 7f28c8200640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:04:03.354 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi059:vg_nvme/lv_4 2024-09-19T06:04:03.641 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:04:03.762 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:03 smithi059 ceph-mon[35138]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:04:03.762 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:03 smithi059 ceph-mon[35138]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-19T06:04:03.762 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:03 smithi059 ceph-mon[35138]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T06:04:03.762 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:03 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:04:03.762 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:03 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:04:03.762 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:03 smithi059 ceph-mon[35138]: from='osd.0 ' entity='osd.0' 2024-09-19T06:04:03.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:03 smithi003 ceph-mon[30893]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:04:03.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:03 smithi003 ceph-mon[30893]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-19T06:04:03.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:03 smithi003 ceph-mon[30893]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T06:04:03.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:03 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:04:03.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:03 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:04:03.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:03 smithi003 ceph-mon[30893]: from='osd.0 ' entity='osd.0' 2024-09-19T06:04:03.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:03 smithi071 ceph-mon[35662]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:04:03.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:03 smithi071 ceph-mon[35662]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-19T06:04:03.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:03 smithi071 ceph-mon[35662]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T06:04:03.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:03 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:04:03.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:03 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:04:03.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:03 smithi071 ceph-mon[35662]: from='osd.0 ' entity='osd.0' 2024-09-19T06:04:04.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.110+0000 7f9dd44ad640 1 -- 172.21.15.59:0/2798120783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dcc1037c0 msgr2=0x7f9dcc10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:04.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.110+0000 7f9dd44ad640 1 --2- 172.21.15.59:0/2798120783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dcc1037c0 0x7f9dcc10a050 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009ca0 tx=0x7f9dc402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:04:04.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.110+0000 7f9dd44ad640 1 -- 172.21.15.59:0/2798120783 shutdown_connections 2024-09-19T06:04:04.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.110+0000 7f9dd44ad640 1 --2- 172.21.15.59:0/2798120783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dcc1037c0 0x7f9dcc10a050 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:04.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.110+0000 7f9dd44ad640 1 --2- 172.21.15.59:0/2798120783 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dcc102e00 0x7f9dcc103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:04.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.110+0000 7f9dd44ad640 1 --2- 172.21.15.59:0/2798120783 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9dcc101c00 0x7f9dcc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:04.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.110+0000 7f9dd44ad640 1 -- 172.21.15.59:0/2798120783 >> 172.21.15.59:0/2798120783 conn(0x7f9dcc0fd390 msgr2=0x7f9dcc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:04.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.110+0000 7f9dd44ad640 1 -- 172.21.15.59:0/2798120783 shutdown_connections 2024-09-19T06:04:04.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.110+0000 7f9dd44ad640 1 -- 172.21.15.59:0/2798120783 wait complete. 2024-09-19T06:04:04.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.110+0000 7f9dd44ad640 1 Processor -- start 2024-09-19T06:04:04.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.110+0000 7f9dd44ad640 1 -- start start 2024-09-19T06:04:04.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.111+0000 7f9dd44ad640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dcc101c00 0x7f9dcc197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:04.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.111+0000 7f9dd44ad640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dcc102e00 0x7f9dcc198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:04.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.111+0000 7f9dd44ad640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9dcc1037c0 0x7f9dcc19f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:04.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.111+0000 7f9dd44ad640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc10d8e0 con 0x7f9dcc1037c0 2024-09-19T06:04:04.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.111+0000 7f9dd44ad640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc10d760 con 0x7f9dcc102e00 2024-09-19T06:04:04.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.111+0000 7f9dd44ad640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc10da60 con 0x7f9dcc101c00 2024-09-19T06:04:04.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.111+0000 7f9dd1a48640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dcc102e00 0x7f9dcc198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:04.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.111+0000 7f9dd1a48640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dcc102e00 0x7f9dcc198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51244/0 (socket says 172.21.15.59:51244) 2024-09-19T06:04:04.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.111+0000 7f9dd1a48640 1 -- 172.21.15.59:0/1052474004 learned_addr learned my addr 172.21.15.59:0/1052474004 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-19T06:04:04.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.111+0000 7f9dd2249640 1 --2- 172.21.15.59:0/1052474004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dcc101c00 0x7f9dcc197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:04.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.111+0000 7f9dd2a4a640 1 --2- 172.21.15.59:0/1052474004 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9dcc1037c0 0x7f9dcc19f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:04.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.111+0000 7f9dd1a48640 1 -- 172.21.15.59:0/1052474004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dcc101c00 msgr2=0x7f9dcc197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:04.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.111+0000 7f9dd1a48640 1 --2- 172.21.15.59:0/1052474004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dcc101c00 0x7f9dcc197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:04.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.111+0000 7f9dd1a48640 1 -- 172.21.15.59:0/1052474004 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9dcc1037c0 msgr2=0x7f9dcc19f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:04.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.111+0000 7f9dd1a48640 1 --2- 172.21.15.59:0/1052474004 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9dcc1037c0 0x7f9dcc19f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:04.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.111+0000 7f9dd1a48640 1 -- 172.21.15.59:0/1052474004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dcc19fb60 con 0x7f9dcc102e00 2024-09-19T06:04:04.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.111+0000 7f9dd1a48640 1 --2- 172.21.15.59:0/1052474004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dcc102e00 0x7f9dcc198470 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00b4a0 tx=0x7f9dbc00b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:04.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.112+0000 7f9dc37fe640 1 -- 172.21.15.59:0/1052474004 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc014070 con 0x7f9dcc102e00 2024-09-19T06:04:04.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.112+0000 7f9dc37fe640 1 -- 172.21.15.59:0/1052474004 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9dbc010af0 con 0x7f9dcc102e00 2024-09-19T06:04:04.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.112+0000 7f9dd44ad640 1 -- 172.21.15.59:0/1052474004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dcc19fe50 con 0x7f9dcc102e00 2024-09-19T06:04:04.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.112+0000 7f9dc37fe640 1 -- 172.21.15.59:0/1052474004 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc017d10 con 0x7f9dcc102e00 2024-09-19T06:04:04.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.112+0000 7f9dd44ad640 1 -- 172.21.15.59:0/1052474004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dcc1a0380 con 0x7f9dcc102e00 2024-09-19T06:04:04.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.113+0000 7f9dd44ad640 1 -- 172.21.15.59:0/1052474004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dcc108fd0 con 0x7f9dcc102e00 2024-09-19T06:04:04.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.114+0000 7f9dc37fe640 1 -- 172.21.15.59:0/1052474004 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7f9dbc017070 con 0x7f9dcc102e00 2024-09-19T06:04:04.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.114+0000 7f9dc37fe640 1 --2- 172.21.15.59:0/1052474004 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f9db80a32e0 0x7f9db80a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:04.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.115+0000 7f9dc37fe640 1 -- 172.21.15.59:0/1052474004 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1767+0+0 (secure 0 0 0) 0x7f9dbc0cd200 con 0x7f9dcc102e00 2024-09-19T06:04:04.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.115+0000 7f9dd2249640 1 --2- 172.21.15.59:0/1052474004 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f9db80a32e0 0x7f9db80a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:04.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.115+0000 7f9dd2249640 1 --2- 172.21.15.59:0/1052474004 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f9db80a32e0 0x7f9db80a57a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc102c60 tx=0x7f9dc800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:04.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.119+0000 7f9dc37fe640 1 -- 172.21.15.59:0/1052474004 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9dbc09b8f0 con 0x7f9dcc102e00 2024-09-19T06:04:04.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:04.303+0000 7f9dd44ad640 1 -- 172.21.15.59:0/1052474004 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f9dcc062630 con 0x7f9db80a32e0 2024-09-19T06:04:04.711 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:04 smithi059 ceph-mon[35138]: purged_snaps scrub starts 2024-09-19T06:04:04.711 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:04 smithi059 ceph-mon[35138]: purged_snaps scrub ok 2024-09-19T06:04:04.712 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:04 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:04:04.712 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:04 smithi059 ceph-mon[35138]: osd.0 [v2:172.21.15.3:6802/2061486638,v1:172.21.15.3:6803/2061486638] boot 2024-09-19T06:04:04.712 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:04 smithi059 ceph-mon[35138]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T06:04:04.712 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:04 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:04:04.712 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:04 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:04:04.712 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:04 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:04:04.712 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:04 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:04.795 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:04 smithi003 ceph-mon[30893]: purged_snaps scrub starts 2024-09-19T06:04:04.795 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:04 smithi003 ceph-mon[30893]: purged_snaps scrub ok 2024-09-19T06:04:04.795 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:04 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:04:04.795 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:04 smithi003 ceph-mon[30893]: osd.0 [v2:172.21.15.3:6802/2061486638,v1:172.21.15.3:6803/2061486638] boot 2024-09-19T06:04:04.796 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:04 smithi003 ceph-mon[30893]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T06:04:04.796 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:04 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:04:04.796 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:04 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:04:04.796 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:04 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:04:04.796 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:04 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:04.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:04 smithi071 ceph-mon[35662]: purged_snaps scrub starts 2024-09-19T06:04:04.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:04 smithi071 ceph-mon[35662]: purged_snaps scrub ok 2024-09-19T06:04:04.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:04 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:04:04.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:04 smithi071 ceph-mon[35662]: osd.0 [v2:172.21.15.3:6802/2061486638,v1:172.21.15.3:6803/2061486638] boot 2024-09-19T06:04:04.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:04 smithi071 ceph-mon[35662]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T06:04:04.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:04 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:04:04.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:04 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:04:04.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:04 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:04:04.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:04 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:05.941 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:05 smithi059 ceph-mon[35138]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:04:05.941 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:05 smithi059 ceph-mon[35138]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:05.941 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:05 smithi059 ceph-mon[35138]: Detected new or changed devices on smithi003 2024-09-19T06:04:05.941 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:05 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:05.941 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:05 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:05.941 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:05 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:05.941 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:05 smithi059 ceph-mon[35138]: Adjusting osd_memory_target on smithi003 to 17094M 2024-09-19T06:04:05.942 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:05 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:05.942 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:05 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:05.942 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:05 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:05.942 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:05 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:05.942 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:05 smithi059 ceph-mon[35138]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T06:04:06.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:05 smithi003 ceph-mon[30893]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:04:06.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:05 smithi003 ceph-mon[30893]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:06.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:05 smithi003 ceph-mon[30893]: Detected new or changed devices on smithi003 2024-09-19T06:04:06.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:05 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:06.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:05 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:06.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:05 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:06.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:05 smithi003 ceph-mon[30893]: Adjusting osd_memory_target on smithi003 to 17094M 2024-09-19T06:04:06.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:05 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:06.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:05 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:06.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:05 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:06.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:05 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:06.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:05 smithi003 ceph-mon[30893]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T06:04:06.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:05 smithi071 ceph-mon[35662]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:04:06.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:05 smithi071 ceph-mon[35662]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:06.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:05 smithi071 ceph-mon[35662]: Detected new or changed devices on smithi003 2024-09-19T06:04:06.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:05 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:06.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:05 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:06.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:05 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:06.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:05 smithi071 ceph-mon[35662]: Adjusting osd_memory_target on smithi003 to 17094M 2024-09-19T06:04:06.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:05 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:06.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:05 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:06.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:05 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:06.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:05 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:06.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:05 smithi071 ceph-mon[35662]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T06:04:07.181 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:06 smithi059 ceph-mon[35138]: from='client.? 172.21.15.59:0/2752872781' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e03ca275-8da5-402f-9cd2-654ca422b9b0"}]: dispatch 2024-09-19T06:04:07.181 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:06 smithi059 ceph-mon[35138]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e03ca275-8da5-402f-9cd2-654ca422b9b0"}]: dispatch 2024-09-19T06:04:07.181 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:06 smithi059 ceph-mon[35138]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e03ca275-8da5-402f-9cd2-654ca422b9b0"}]': finished 2024-09-19T06:04:07.181 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:06 smithi059 ceph-mon[35138]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T06:04:07.181 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:06 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:04:07.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:06 smithi003 ceph-mon[30893]: from='client.? 172.21.15.59:0/2752872781' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e03ca275-8da5-402f-9cd2-654ca422b9b0"}]: dispatch 2024-09-19T06:04:07.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:06 smithi003 ceph-mon[30893]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e03ca275-8da5-402f-9cd2-654ca422b9b0"}]: dispatch 2024-09-19T06:04:07.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:06 smithi003 ceph-mon[30893]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e03ca275-8da5-402f-9cd2-654ca422b9b0"}]': finished 2024-09-19T06:04:07.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:06 smithi003 ceph-mon[30893]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T06:04:07.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:06 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:04:07.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:06 smithi071 ceph-mon[35662]: from='client.? 172.21.15.59:0/2752872781' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e03ca275-8da5-402f-9cd2-654ca422b9b0"}]: dispatch 2024-09-19T06:04:07.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:06 smithi071 ceph-mon[35662]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e03ca275-8da5-402f-9cd2-654ca422b9b0"}]: dispatch 2024-09-19T06:04:07.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:06 smithi071 ceph-mon[35662]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e03ca275-8da5-402f-9cd2-654ca422b9b0"}]': finished 2024-09-19T06:04:07.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:06 smithi071 ceph-mon[35662]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T06:04:07.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:06 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:04:08.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:07 smithi059 ceph-mon[35138]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:08.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:07 smithi059 ceph-mon[35138]: from='client.? 172.21.15.59:0/1658675013' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:04:08.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:07 smithi003 ceph-mon[30893]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:08.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:07 smithi003 ceph-mon[30893]: from='client.? 172.21.15.59:0/1658675013' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:04:08.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:07 smithi071 ceph-mon[35662]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:08.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:07 smithi071 ceph-mon[35662]: from='client.? 172.21.15.59:0/1658675013' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:04:10.138 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:09 smithi071 ceph-mon[35662]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:10.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:09 smithi059 ceph-mon[35138]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:10.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:09 smithi003 ceph-mon[30893]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:12.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:11 smithi059 ceph-mon[35138]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:12.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:11 smithi003 ceph-mon[30893]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:12.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:11 smithi071 ceph-mon[35662]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:13.939 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:13 smithi059 ceph-mon[35138]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:14.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:13 smithi003 ceph-mon[30893]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:14.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:13 smithi071 ceph-mon[35662]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:16.251 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:15 smithi059 ceph-mon[35138]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:16.251 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:15 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T06:04:16.251 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:15 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:16.251 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:15 smithi059 ceph-mon[35138]: Deploying daemon osd.1 on smithi059 2024-09-19T06:04:16.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:15 smithi003 ceph-mon[30893]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:16.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:15 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T06:04:16.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:15 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:16.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:15 smithi003 ceph-mon[30893]: Deploying daemon osd.1 on smithi059 2024-09-19T06:04:16.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:15 smithi071 ceph-mon[35662]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:16.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:15 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T06:04:16.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:15 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:16.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:15 smithi071 ceph-mon[35662]: Deploying daemon osd.1 on smithi059 2024-09-19T06:04:18.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:17 smithi059 ceph-mon[35138]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:18.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:17 smithi003 ceph-mon[30893]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:18.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:17 smithi071 ceph-mon[35662]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:20.113 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:19 smithi059 ceph-mon[35138]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:20.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:19 smithi003 ceph-mon[30893]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:20.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:19 smithi071 ceph-mon[35662]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:22.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:21 smithi059 ceph-mon[35138]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:22.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:21 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:22.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:21 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:22.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:21 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:22.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:21 smithi003 ceph-mon[30893]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:22.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:21 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:22.337 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:21 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:22.337 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:21 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:22.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:21 smithi071 ceph-mon[35662]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:22.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:21 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:22.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:21 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:22.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:21 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:24.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:23 smithi059 ceph-mon[35138]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:24.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:23 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:24.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:23 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:24.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:23 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:24.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:23 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:24.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:23 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:24.137 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:23 smithi003 ceph-mon[30893]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:24.137 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:23 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:24.137 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:23 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:24.138 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:23 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:24.138 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:23 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:24.138 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:23 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:24.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:23 smithi071 ceph-mon[35662]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:24.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:23 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:24.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:23 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:24.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:23 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:24.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:23 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:24.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:23 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:25.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:25.458+0000 7f9dc37fe640 1 -- 172.21.15.59:0/1052474004 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9dcc062630 con 0x7f9db80a32e0 2024-09-19T06:04:25.460 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 1 on host 'smithi059' 2024-09-19T06:04:25.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:25.460+0000 7f9dd44ad640 1 -- 172.21.15.59:0/1052474004 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f9db80a32e0 msgr2=0x7f9db80a57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:25.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:25.460+0000 7f9dd44ad640 1 --2- 172.21.15.59:0/1052474004 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f9db80a32e0 0x7f9db80a57a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc102c60 tx=0x7f9dc800b390 comp rx=0 tx=0).stop 2024-09-19T06:04:25.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:25.460+0000 7f9dd44ad640 1 -- 172.21.15.59:0/1052474004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dcc102e00 msgr2=0x7f9dcc198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:25.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:25.460+0000 7f9dd44ad640 1 --2- 172.21.15.59:0/1052474004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dcc102e00 0x7f9dcc198470 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00b4a0 tx=0x7f9dbc00b960 comp rx=0 tx=0).stop 2024-09-19T06:04:25.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:25.460+0000 7f9dd44ad640 1 -- 172.21.15.59:0/1052474004 shutdown_connections 2024-09-19T06:04:25.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:25.460+0000 7f9dd44ad640 1 --2- 172.21.15.59:0/1052474004 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f9db80a32e0 0x7f9db80a57a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:25.460+0000 7f9dd44ad640 1 --2- 172.21.15.59:0/1052474004 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9dcc1037c0 0x7f9dcc19f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:25.460+0000 7f9dd44ad640 1 --2- 172.21.15.59:0/1052474004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dcc102e00 0x7f9dcc198470 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:25.460+0000 7f9dd44ad640 1 --2- 172.21.15.59:0/1052474004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9dcc101c00 0x7f9dcc197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:25.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:25.460+0000 7f9dd44ad640 1 -- 172.21.15.59:0/1052474004 >> 172.21.15.59:0/1052474004 conn(0x7f9dcc0fd390 msgr2=0x7f9dcc1061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:25.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:25.460+0000 7f9dd44ad640 1 -- 172.21.15.59:0/1052474004 shutdown_connections 2024-09-19T06:04:25.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:04:25.460+0000 7f9dd44ad640 1 -- 172.21.15.59:0/1052474004 wait complete. 2024-09-19T06:04:26.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:25 smithi059 ceph-mon[35138]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:26.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:25 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:26.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:25 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:26.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:25 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:26.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:25 smithi003 ceph-mon[30893]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:26.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:25 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:26.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:25 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:26.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:25 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:26.101 DEBUG:teuthology.orchestra.run.smithi059:osd.1> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T06:04:26.104 INFO:tasks.cephadm:Deploying osd.2 on smithi071 with /dev/vg_nvme/lv_4... 2024-09-19T06:04:26.104 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T06:04:26.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:25 smithi071 ceph-mon[35662]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:26.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:25 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:26.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:25 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:26.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:25 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:26.355 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:04:27.423 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:04:27 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-1[39588]: 2024-09-19T06:04:27.079+0000 7ff8ce510640 -1 osd.1 0 log_to_monitors true 2024-09-19T06:04:28.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:27 smithi059 ceph-mon[35138]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:28.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:27 smithi059 ceph-mon[35138]: from='osd.1 [v2:172.21.15.59:6800/129318538,v1:172.21.15.59:6801/129318538]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:04:28.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:27 smithi059 ceph-mon[35138]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:04:28.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:27 smithi003 ceph-mon[30893]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:28.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:27 smithi003 ceph-mon[30893]: from='osd.1 [v2:172.21.15.59:6800/129318538,v1:172.21.15.59:6801/129318538]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:04:28.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:27 smithi003 ceph-mon[30893]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:04:28.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:27 smithi071 ceph-mon[35662]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:28.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:27 smithi071 ceph-mon[35662]: from='osd.1 [v2:172.21.15.59:6800/129318538,v1:172.21.15.59:6801/129318538]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:04:28.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:27 smithi071 ceph-mon[35662]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:04:28.667 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-19T06:04:28.694 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_4 2024-09-19T06:04:28.944 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:04:29.012 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:04:28 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-1[39588]: 2024-09-19T06:04:28.915+0000 7ff8ca493640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T06:04:29.012 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:04:28 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-1[39588]: 2024-09-19T06:04:28.919+0000 7ff8c62bb640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:04:29.013 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:28 smithi059 ceph-mon[35138]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T06:04:29.013 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:28 smithi059 ceph-mon[35138]: from='osd.1 [v2:172.21.15.59:6800/129318538,v1:172.21.15.59:6801/129318538]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-19T06:04:29.013 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:28 smithi059 ceph-mon[35138]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T06:04:29.013 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:28 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:04:29.013 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:28 smithi059 ceph-mon[35138]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-19T06:04:29.057 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:28 smithi071 ceph-mon[35662]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T06:04:29.057 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:28 smithi071 ceph-mon[35662]: from='osd.1 [v2:172.21.15.59:6800/129318538,v1:172.21.15.59:6801/129318538]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-19T06:04:29.057 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:28 smithi071 ceph-mon[35662]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T06:04:29.057 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:28 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:04:29.057 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:28 smithi071 ceph-mon[35662]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-19T06:04:29.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:28 smithi003 ceph-mon[30893]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T06:04:29.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:28 smithi003 ceph-mon[30893]: from='osd.1 [v2:172.21.15.59:6800/129318538,v1:172.21.15.59:6801/129318538]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-19T06:04:29.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:28 smithi003 ceph-mon[30893]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T06:04:29.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:28 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:04:29.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:28 smithi003 ceph-mon[30893]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-19T06:04:29.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.399+0000 7f5109027640 1 -- 172.21.15.71:0/1243544212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5104107900 msgr2=0x7f5104109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:29.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.399+0000 7f5109027640 1 --2- 172.21.15.71:0/1243544212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5104107900 0x7f5104109d50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009ca0 tx=0x7f50fc02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:04:29.426 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.399+0000 7f5109027640 1 -- 172.21.15.71:0/1243544212 shutdown_connections 2024-09-19T06:04:29.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.399+0000 7f5109027640 1 --2- 172.21.15.71:0/1243544212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5104107900 0x7f5104109d50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:29.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.399+0000 7f5109027640 1 --2- 172.21.15.71:0/1243544212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5104104fd0 0x7f51041073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:29.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.399+0000 7f5109027640 1 --2- 172.21.15.71:0/1243544212 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51041026a0 0x7f5104104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:29.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.399+0000 7f5109027640 1 -- 172.21.15.71:0/1243544212 >> 172.21.15.71:0/1243544212 conn(0x7f51040fc2a0 msgr2=0x7f51040fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:29.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.399+0000 7f5109027640 1 -- 172.21.15.71:0/1243544212 shutdown_connections 2024-09-19T06:04:29.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.399+0000 7f5109027640 1 -- 172.21.15.71:0/1243544212 wait complete. 2024-09-19T06:04:29.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.400+0000 7f5109027640 1 Processor -- start 2024-09-19T06:04:29.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.400+0000 7f5109027640 1 -- start start 2024-09-19T06:04:29.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.400+0000 7f5109027640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51041026a0 0x7f5104102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:29.427 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.400+0000 7f5109027640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5104104fd0 0x7f5104100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.400+0000 7f5109027640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5104107900 0x7f5104100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.400+0000 7f5109027640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f510410d990 con 0x7f51041026a0 2024-09-19T06:04:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.400+0000 7f5109027640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f510410d810 con 0x7f5104104fd0 2024-09-19T06:04:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.400+0000 7f5109027640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f510410db10 con 0x7f5104107900 2024-09-19T06:04:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.400+0000 7f510359e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5104107900 0x7f5104100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.400+0000 7f510359e640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5104107900 0x7f5104100b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:59800/0 (socket says 172.21.15.71:59800) 2024-09-19T06:04:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.400+0000 7f510359e640 1 -- 172.21.15.71:0/1466283479 learned_addr learned my addr 172.21.15.71:0/1466283479 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-19T06:04:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.400+0000 7f5102d9d640 1 --2- 172.21.15.71:0/1466283479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51041026a0 0x7f5104102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.400+0000 7f510259c640 1 --2- 172.21.15.71:0/1466283479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5104104fd0 0x7f5104100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.400+0000 7f510359e640 1 -- 172.21.15.71:0/1466283479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5104104fd0 msgr2=0x7f5104100650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.400+0000 7f510359e640 1 --2- 172.21.15.71:0/1466283479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5104104fd0 0x7f5104100650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:29.428 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.400+0000 7f510359e640 1 -- 172.21.15.71:0/1466283479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51041026a0 msgr2=0x7f5104102000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.400+0000 7f510359e640 1 --2- 172.21.15.71:0/1466283479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51041026a0 0x7f5104102000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.400+0000 7f510359e640 1 -- 172.21.15.71:0/1466283479 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5104101450 con 0x7f5104107900 2024-09-19T06:04:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.401+0000 7f510359e640 1 --2- 172.21.15.71:0/1466283479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5104107900 0x7f5104100b90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0098d0 tx=0x7f50fc02f840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.401+0000 7f50ebfff640 1 -- 172.21.15.71:0/1466283479 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50fc02fc30 con 0x7f5104107900 2024-09-19T06:04:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.401+0000 7f50ebfff640 1 -- 172.21.15.71:0/1466283479 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50fc003e50 con 0x7f5104107900 2024-09-19T06:04:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.401+0000 7f5109027640 1 -- 172.21.15.71:0/1466283479 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51041a2170 con 0x7f5104107900 2024-09-19T06:04:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.401+0000 7f50ebfff640 1 -- 172.21.15.71:0/1466283479 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50fc0305c0 con 0x7f5104107900 2024-09-19T06:04:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.401+0000 7f5109027640 1 -- 172.21.15.71:0/1466283479 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51041a2700 con 0x7f5104107900 2024-09-19T06:04:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.402+0000 7f5109027640 1 -- 172.21.15.71:0/1466283479 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51040fdd90 con 0x7f5104107900 2024-09-19T06:04:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.403+0000 7f50ebfff640 1 -- 172.21.15.71:0/1466283479 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7f50fc003970 con 0x7f5104107900 2024-09-19T06:04:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.404+0000 7f50ebfff640 1 --2- 172.21.15.71:0/1466283479 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f50ec0a31b0 0x7f50ec0a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:29.429 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.404+0000 7f50ebfff640 1 -- 172.21.15.71:0/1466283479 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f50fc0ef3a0 con 0x7f5104107900 2024-09-19T06:04:29.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.404+0000 7f5102d9d640 1 --2- 172.21.15.71:0/1466283479 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f50ec0a31b0 0x7f50ec0a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:29.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.405+0000 7f5102d9d640 1 --2- 172.21.15.71:0/1466283479 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f50ec0a31b0 0x7f50ec0a5670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f50f4009890 tx=0x7f50f4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:29.430 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.408+0000 7f50ebfff640 1 -- 172.21.15.71:0/1466283479 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f50fc0bdb50 con 0x7f5104107900 2024-09-19T06:04:29.587 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:29.585+0000 7f5109027640 1 -- 172.21.15.71:0/1466283479 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5104062630 con 0x7f50ec0a31b0 2024-09-19T06:04:30.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:29 smithi071 ceph-mon[35662]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:30.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:29 smithi071 ceph-mon[35662]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-19T06:04:30.195 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:29 smithi071 ceph-mon[35662]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T06:04:30.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:29 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:04:30.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:29 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:04:30.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:29 smithi071 ceph-mon[35662]: Detected new or changed devices on smithi059 2024-09-19T06:04:30.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:29 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:30.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:29 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:30.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:29 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:30.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:29 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:30.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:29 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:30.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:29 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:30.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:29 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:30.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:29 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:04:30.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:29 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:04:30.196 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:29 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:30.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:29 smithi059 ceph-mon[35138]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:30.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:29 smithi059 ceph-mon[35138]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-19T06:04:30.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:29 smithi059 ceph-mon[35138]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T06:04:30.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:29 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:04:30.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:29 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:04:30.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:29 smithi059 ceph-mon[35138]: Detected new or changed devices on smithi059 2024-09-19T06:04:30.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:29 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:30.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:29 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:30.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:29 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:30.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:29 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:30.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:29 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:30.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:29 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:30.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:29 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:30.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:29 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:04:30.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:29 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:04:30.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:29 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:30.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:29 smithi003 ceph-mon[30893]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:30.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:29 smithi003 ceph-mon[30893]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-19T06:04:30.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:29 smithi003 ceph-mon[30893]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T06:04:30.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:29 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:04:30.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:29 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:04:30.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:29 smithi003 ceph-mon[30893]: Detected new or changed devices on smithi059 2024-09-19T06:04:30.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:29 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:30.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:29 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:30.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:29 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:30.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:29 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:30.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:29 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:30.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:29 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:30.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:29 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:30.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:29 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:04:30.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:29 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:04:30.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:29 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:31.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:30 smithi071 ceph-mon[35662]: purged_snaps scrub starts 2024-09-19T06:04:31.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:30 smithi071 ceph-mon[35662]: purged_snaps scrub ok 2024-09-19T06:04:31.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:30 smithi071 ceph-mon[35662]: Adjusting osd_memory_target on smithi059 to 17092M 2024-09-19T06:04:31.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:30 smithi071 ceph-mon[35662]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:31.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:30 smithi071 ceph-mon[35662]: osd.1 [v2:172.21.15.59:6800/129318538,v1:172.21.15.59:6801/129318538] boot 2024-09-19T06:04:31.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:30 smithi071 ceph-mon[35662]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T06:04:31.160 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:30 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:04:31.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:30 smithi059 ceph-mon[35138]: purged_snaps scrub starts 2024-09-19T06:04:31.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:30 smithi059 ceph-mon[35138]: purged_snaps scrub ok 2024-09-19T06:04:31.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:30 smithi059 ceph-mon[35138]: Adjusting osd_memory_target on smithi059 to 17092M 2024-09-19T06:04:31.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:30 smithi059 ceph-mon[35138]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:31.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:30 smithi059 ceph-mon[35138]: osd.1 [v2:172.21.15.59:6800/129318538,v1:172.21.15.59:6801/129318538] boot 2024-09-19T06:04:31.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:30 smithi059 ceph-mon[35138]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T06:04:31.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:30 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:04:31.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:30 smithi003 ceph-mon[30893]: purged_snaps scrub starts 2024-09-19T06:04:31.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:30 smithi003 ceph-mon[30893]: purged_snaps scrub ok 2024-09-19T06:04:31.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:30 smithi003 ceph-mon[30893]: Adjusting osd_memory_target on smithi059 to 17092M 2024-09-19T06:04:31.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:30 smithi003 ceph-mon[30893]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:31.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:30 smithi003 ceph-mon[30893]: osd.1 [v2:172.21.15.59:6800/129318538,v1:172.21.15.59:6801/129318538] boot 2024-09-19T06:04:31.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:30 smithi003 ceph-mon[30893]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T06:04:31.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:30 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:04:32.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:31 smithi059 ceph-mon[35138]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:32.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:31 smithi059 ceph-mon[35138]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T06:04:32.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:31 smithi059 ceph-mon[35138]: from='client.? 172.21.15.71:0/4021497751' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62b7d36d-6078-4027-93b2-009be70a6d80"}]: dispatch 2024-09-19T06:04:32.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:31 smithi059 ceph-mon[35138]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62b7d36d-6078-4027-93b2-009be70a6d80"}]: dispatch 2024-09-19T06:04:32.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:31 smithi059 ceph-mon[35138]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62b7d36d-6078-4027-93b2-009be70a6d80"}]': finished 2024-09-19T06:04:32.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:31 smithi059 ceph-mon[35138]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T06:04:32.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:31 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:04:32.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:31 smithi003 ceph-mon[30893]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:32.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:31 smithi003 ceph-mon[30893]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T06:04:32.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:31 smithi003 ceph-mon[30893]: from='client.? 172.21.15.71:0/4021497751' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62b7d36d-6078-4027-93b2-009be70a6d80"}]: dispatch 2024-09-19T06:04:32.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:31 smithi003 ceph-mon[30893]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62b7d36d-6078-4027-93b2-009be70a6d80"}]: dispatch 2024-09-19T06:04:32.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:31 smithi003 ceph-mon[30893]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62b7d36d-6078-4027-93b2-009be70a6d80"}]': finished 2024-09-19T06:04:32.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:31 smithi003 ceph-mon[30893]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T06:04:32.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:31 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:04:32.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:31 smithi071 ceph-mon[35662]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:04:32.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:31 smithi071 ceph-mon[35662]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T06:04:32.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:31 smithi071 ceph-mon[35662]: from='client.? 172.21.15.71:0/4021497751' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62b7d36d-6078-4027-93b2-009be70a6d80"}]: dispatch 2024-09-19T06:04:32.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:31 smithi071 ceph-mon[35662]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "62b7d36d-6078-4027-93b2-009be70a6d80"}]: dispatch 2024-09-19T06:04:32.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:31 smithi071 ceph-mon[35662]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62b7d36d-6078-4027-93b2-009be70a6d80"}]': finished 2024-09-19T06:04:32.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:31 smithi071 ceph-mon[35662]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T06:04:32.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:31 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:04:33.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:32 smithi059 ceph-mon[35138]: from='client.? 172.21.15.71:0/243459328' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:04:33.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:32 smithi003 ceph-mon[30893]: from='client.? 172.21.15.71:0/243459328' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:04:33.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:32 smithi071 ceph-mon[35662]: from='client.? 172.21.15.71:0/243459328' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:04:34.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:33 smithi059 ceph-mon[35138]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:34.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:33 smithi003 ceph-mon[30893]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:34.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:33 smithi071 ceph-mon[35662]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:36.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:35 smithi059 ceph-mon[35138]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:36.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:35 smithi003 ceph-mon[30893]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:36.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:35 smithi071 ceph-mon[35662]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:38.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:37 smithi071 ceph-mon[35662]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:38.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:37 smithi059 ceph-mon[35138]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:38.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:37 smithi003 ceph-mon[30893]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:39 smithi071 ceph-mon[35662]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:40.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:39 smithi059 ceph-mon[35138]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:40.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:39 smithi003 ceph-mon[30893]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:41.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:40 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T06:04:41.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:40 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:41.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:40 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T06:04:41.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:40 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:41.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:40 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T06:04:41.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:40 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:42.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:41 smithi071 ceph-mon[35662]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:42.038 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:41 smithi071 ceph-mon[35662]: Deploying daemon osd.2 on smithi071 2024-09-19T06:04:42.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:41 smithi059 ceph-mon[35138]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:42.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:41 smithi059 ceph-mon[35138]: Deploying daemon osd.2 on smithi071 2024-09-19T06:04:42.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:41 smithi003 ceph-mon[30893]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:42.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:41 smithi003 ceph-mon[30893]: Deploying daemon osd.2 on smithi071 2024-09-19T06:04:44.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:43 smithi059 ceph-mon[35138]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:44.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:43 smithi003 ceph-mon[30893]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:44.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:43 smithi071 ceph-mon[35662]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:46.191 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:45 smithi071 ceph-mon[35662]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:46.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:45 smithi059 ceph-mon[35138]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:46.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:45 smithi003 ceph-mon[30893]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:47.167 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:46 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:47.167 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:46 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:47.167 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:46 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:47.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:46 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:47.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:46 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:47.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:46 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:47.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:46 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:47.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:46 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:47.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:46 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:48.197 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:47 smithi071 ceph-mon[35662]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:48.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:47 smithi059 ceph-mon[35138]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:48.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:47 smithi003 ceph-mon[30893]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:50.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:49 smithi071 ceph-mon[35662]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:50.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:49 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:50.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:49 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:50.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:49 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:50.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:49 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:50.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:49 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:50.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:49 smithi059 ceph-mon[35138]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:50.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:49 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:50.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:49 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:50.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:49 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:50.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:49 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:50.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:49 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:50.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:49 smithi003 ceph-mon[30893]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:49 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:49 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:49 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:49 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:49 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:50.398 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:50.395+0000 7f50ebfff640 1 -- 172.21.15.71:0/1466283479 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5104062630 con 0x7f50ec0a31b0 2024-09-19T06:04:50.399 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 2 on host 'smithi071' 2024-09-19T06:04:50.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:50.397+0000 7f5109027640 1 -- 172.21.15.71:0/1466283479 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f50ec0a31b0 msgr2=0x7f50ec0a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:50.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:50.397+0000 7f5109027640 1 --2- 172.21.15.71:0/1466283479 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f50ec0a31b0 0x7f50ec0a5670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f50f4009890 tx=0x7f50f4008040 comp rx=0 tx=0).stop 2024-09-19T06:04:50.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:50.397+0000 7f5109027640 1 -- 172.21.15.71:0/1466283479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5104107900 msgr2=0x7f5104100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:50.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:50.397+0000 7f5109027640 1 --2- 172.21.15.71:0/1466283479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5104107900 0x7f5104100b90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0098d0 tx=0x7f50fc02f840 comp rx=0 tx=0).stop 2024-09-19T06:04:50.400 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:50.397+0000 7f5109027640 1 -- 172.21.15.71:0/1466283479 shutdown_connections 2024-09-19T06:04:50.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:50.397+0000 7f5109027640 1 --2- 172.21.15.71:0/1466283479 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f50ec0a31b0 0x7f50ec0a5670 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:50.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:50.397+0000 7f5109027640 1 --2- 172.21.15.71:0/1466283479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5104107900 0x7f5104100b90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:50.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:50.397+0000 7f5109027640 1 --2- 172.21.15.71:0/1466283479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5104104fd0 0x7f5104100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:50.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:50.397+0000 7f5109027640 1 --2- 172.21.15.71:0/1466283479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f51041026a0 0x7f5104102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:50.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:50.397+0000 7f5109027640 1 -- 172.21.15.71:0/1466283479 >> 172.21.15.71:0/1466283479 conn(0x7f51040fc2a0 msgr2=0x7f5104102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:50.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:50.398+0000 7f5109027640 1 -- 172.21.15.71:0/1466283479 shutdown_connections 2024-09-19T06:04:50.401 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:04:50.398+0000 7f5109027640 1 -- 172.21.15.71:0/1466283479 wait complete. 2024-09-19T06:04:51.003 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:50 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:51.003 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:50 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:51.003 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:50 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:51.030 DEBUG:teuthology.orchestra.run.smithi071:osd.2> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T06:04:51.032 INFO:tasks.cephadm:Deploying osd.3 on smithi003 with /dev/vg_nvme/lv_3... 2024-09-19T06:04:51.032 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T06:04:51.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:50 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:51.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:50 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:51.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:50 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:51.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:50 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:04:51.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:50 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:51.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:50 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:51.413 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:52.210 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:51 smithi071 ceph-mon[35662]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:52.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:51 smithi059 ceph-mon[35138]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:52.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:51 smithi003 ceph-mon[30893]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:52.507 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:04:52 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-2[40617]: 2024-09-19T06:04:52.236+0000 7f5daf384640 -1 osd.2 0 log_to_monitors true 2024-09-19T06:04:53.024 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:52 smithi003 ceph-mon[30893]: from='osd.2 [v2:172.21.15.71:6800/2436210695,v1:172.21.15.71:6801/2436210695]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:04:53.025 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:52 smithi003 ceph-mon[30893]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:04:53.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:52 smithi071 ceph-mon[35662]: from='osd.2 [v2:172.21.15.71:6800/2436210695,v1:172.21.15.71:6801/2436210695]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:04:53.241 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:52 smithi071 ceph-mon[35662]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:04:53.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:52 smithi059 ceph-mon[35138]: from='osd.2 [v2:172.21.15.71:6800/2436210695,v1:172.21.15.71:6801/2436210695]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:04:53.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:52 smithi059 ceph-mon[35138]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:04:54.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:53 smithi003 ceph-mon[30893]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:54.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:53 smithi003 ceph-mon[30893]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T06:04:54.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:53 smithi003 ceph-mon[30893]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T06:04:54.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:53 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:04:54.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:53 smithi003 ceph-mon[30893]: from='osd.2 [v2:172.21.15.71:6800/2436210695,v1:172.21.15.71:6801/2436210695]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-19T06:04:54.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:53 smithi003 ceph-mon[30893]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-19T06:04:54.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:53 smithi059 ceph-mon[35138]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:54.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:53 smithi059 ceph-mon[35138]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T06:04:54.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:53 smithi059 ceph-mon[35138]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T06:04:54.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:53 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:04:54.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:53 smithi059 ceph-mon[35138]: from='osd.2 [v2:172.21.15.71:6800/2436210695,v1:172.21.15.71:6801/2436210695]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-19T06:04:54.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:53 smithi059 ceph-mon[35138]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-19T06:04:54.336 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:04:53 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-2[40617]: 2024-09-19T06:04:53.894+0000 7f5dab307640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T06:04:54.336 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:04:53 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-2[40617]: 2024-09-19T06:04:53.899+0000 7f5da712f640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:04:54.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:53 smithi071 ceph-mon[35662]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:54.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:53 smithi071 ceph-mon[35662]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T06:04:54.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:53 smithi071 ceph-mon[35662]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T06:04:54.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:53 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:04:54.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:53 smithi071 ceph-mon[35662]: from='osd.2 [v2:172.21.15.71:6800/2436210695,v1:172.21.15.71:6801/2436210695]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-19T06:04:54.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:53 smithi071 ceph-mon[35662]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-19T06:04:54.732 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:04:54.769 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi003:vg_nvme/lv_3 2024-09-19T06:04:55.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:54 smithi003 ceph-mon[30893]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-19T06:04:55.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:54 smithi003 ceph-mon[30893]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T06:04:55.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:54 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:04:55.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:54 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:04:55.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:54 smithi003 ceph-mon[30893]: Detected new or changed devices on smithi071 2024-09-19T06:04:55.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:54 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:55.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:54 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:55.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:54 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:55.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:54 smithi003 ceph-mon[30893]: Adjusting osd_memory_target on smithi071 to 17088M 2024-09-19T06:04:55.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:54 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:55.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:54 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:55.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:54 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:55.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:54 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:55.143 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:04:55.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:54 smithi059 ceph-mon[35138]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-19T06:04:55.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:54 smithi059 ceph-mon[35138]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T06:04:55.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:54 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:04:55.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:54 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:04:55.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:54 smithi059 ceph-mon[35138]: Detected new or changed devices on smithi071 2024-09-19T06:04:55.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:54 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:55.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:54 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:55.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:54 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:55.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:54 smithi059 ceph-mon[35138]: Adjusting osd_memory_target on smithi071 to 17088M 2024-09-19T06:04:55.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:54 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:55.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:54 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:55.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:54 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:55.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:54 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:55.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:54 smithi071 ceph-mon[35662]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-19T06:04:55.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:54 smithi071 ceph-mon[35662]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T06:04:55.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:54 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:04:55.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:54 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:04:55.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:54 smithi071 ceph-mon[35662]: Detected new or changed devices on smithi071 2024-09-19T06:04:55.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:54 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:55.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:54 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:55.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:54 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:04:55.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:54 smithi071 ceph-mon[35662]: Adjusting osd_memory_target on smithi071 to 17088M 2024-09-19T06:04:55.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:54 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:55.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:54 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:55.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:54 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:04:55.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:54 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:04:55.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.787+0000 7f0e06800640 1 -- 172.21.15.3:0/96572965 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e00102e00 msgr2=0x7f0e00103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:55.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.787+0000 7f0e06800640 1 --2- 172.21.15.3:0/96572965 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e00102e00 0x7f0e00103280 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009900 tx=0x7f0dec02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:04:55.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.788+0000 7f0e06800640 1 -- 172.21.15.3:0/96572965 shutdown_connections 2024-09-19T06:04:55.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.788+0000 7f0e06800640 1 --2- 172.21.15.3:0/96572965 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e001037c0 0x7f0e0010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:55.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.788+0000 7f0e06800640 1 --2- 172.21.15.3:0/96572965 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e00102e00 0x7f0e00103280 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:55.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.788+0000 7f0e06800640 1 --2- 172.21.15.3:0/96572965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e00101c00 0x7f0e00102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:55.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.788+0000 7f0e06800640 1 -- 172.21.15.3:0/96572965 >> 172.21.15.3:0/96572965 conn(0x7f0e000fd390 msgr2=0x7f0e000ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:04:55.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.788+0000 7f0e06800640 1 -- 172.21.15.3:0/96572965 shutdown_connections 2024-09-19T06:04:55.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.788+0000 7f0e06800640 1 -- 172.21.15.3:0/96572965 wait complete. 2024-09-19T06:04:55.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.789+0000 7f0e06800640 1 Processor -- start 2024-09-19T06:04:55.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.789+0000 7f0e06800640 1 -- start start 2024-09-19T06:04:55.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.789+0000 7f0e06800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e00101c00 0x7f0e0019a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:55.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.789+0000 7f0e06800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e00102e00 0x7f0e0019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:55.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.789+0000 7f0e06800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e001037c0 0x7f0e001a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:55.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.789+0000 7f0e06800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0010d8b0 con 0x7f0e00102e00 2024-09-19T06:04:55.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.789+0000 7f0e06800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0010d730 con 0x7f0e00101c00 2024-09-19T06:04:55.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.789+0000 7f0e06800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0010da30 con 0x7f0e001037c0 2024-09-19T06:04:55.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.790+0000 7f0dfea00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e00102e00 0x7f0e0019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:55.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.790+0000 7f0dff400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e00101c00 0x7f0e0019a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:55.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.790+0000 7f0dffe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e001037c0 0x7f0e001a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:55.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.790+0000 7f0dffe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e001037c0 0x7f0e001a16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:40640/0 (socket says 172.21.15.3:40640) 2024-09-19T06:04:55.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.790+0000 7f0dffe00640 1 -- 172.21.15.3:0/2819669200 learned_addr learned my addr 172.21.15.3:0/2819669200 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:04:55.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.790+0000 7f0dffe00640 1 -- 172.21.15.3:0/2819669200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e00101c00 msgr2=0x7f0e0019a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:55.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.790+0000 7f0dffe00640 1 --2- 172.21.15.3:0/2819669200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e00101c00 0x7f0e0019a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:55.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.790+0000 7f0dffe00640 1 -- 172.21.15.3:0/2819669200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e00102e00 msgr2=0x7f0e0019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:04:55.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.790+0000 7f0dffe00640 1 --2- 172.21.15.3:0/2819669200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e00102e00 0x7f0e0019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:04:55.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.790+0000 7f0dffe00640 1 -- 172.21.15.3:0/2819669200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e001a1d30 con 0x7f0e001037c0 2024-09-19T06:04:55.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.790+0000 7f0dffe00640 1 --2- 172.21.15.3:0/2819669200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e001037c0 0x7f0e001a16c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0df800eb10 tx=0x7f0df800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:55.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.791+0000 7f0df7e00640 1 -- 172.21.15.3:0/2819669200 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df8004b20 con 0x7f0e001037c0 2024-09-19T06:04:55.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.791+0000 7f0df7e00640 1 -- 172.21.15.3:0/2819669200 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0df8004cc0 con 0x7f0e001037c0 2024-09-19T06:04:55.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.791+0000 7f0df7e00640 1 -- 172.21.15.3:0/2819669200 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df8010760 con 0x7f0e001037c0 2024-09-19T06:04:55.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.791+0000 7f0e06800640 1 -- 172.21.15.3:0/2819669200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e001a1fc0 con 0x7f0e001037c0 2024-09-19T06:04:55.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.791+0000 7f0e06800640 1 -- 172.21.15.3:0/2819669200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e001a24d0 con 0x7f0e001037c0 2024-09-19T06:04:55.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.792+0000 7f0e06800640 1 -- 172.21.15.3:0/2819669200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e001a2760 con 0x7f0e001037c0 2024-09-19T06:04:55.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.794+0000 7f0df7e00640 1 -- 172.21.15.3:0/2819669200 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7f0df8010900 con 0x7f0e001037c0 2024-09-19T06:04:55.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.795+0000 7f0df7e00640 1 --2- 172.21.15.3:0/2819669200 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0de40a3260 0x7f0de40a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:04:55.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.795+0000 7f0df7e00640 1 -- 172.21.15.3:0/2819669200 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2851+0+0 (secure 0 0 0) 0x7f0df80ceb00 con 0x7f0e001037c0 2024-09-19T06:04:55.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.795+0000 7f0dff400640 1 --2- 172.21.15.3:0/2819669200 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0de40a3260 0x7f0de40a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:04:55.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.796+0000 7f0dff400640 1 --2- 172.21.15.3:0/2819669200 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0de40a3260 0x7f0de40a5720 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0e00102c60 tx=0x7f0df0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:04:55.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.797+0000 7f0df7e00640 1 -- 172.21.15.3:0/2819669200 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0df809cdb0 con 0x7f0e001037c0 2024-09-19T06:04:55.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:04:55.992+0000 7f0e06800640 1 -- 172.21.15.3:0/2819669200 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f0e001a2930 con 0x7f0de40a3260 2024-09-19T06:04:56.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:55 smithi003 ceph-mon[30893]: purged_snaps scrub starts 2024-09-19T06:04:56.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:55 smithi003 ceph-mon[30893]: purged_snaps scrub ok 2024-09-19T06:04:56.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:55 smithi003 ceph-mon[30893]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:56.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:55 smithi003 ceph-mon[30893]: osd.2 [v2:172.21.15.71:6800/2436210695,v1:172.21.15.71:6801/2436210695] boot 2024-09-19T06:04:56.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:55 smithi003 ceph-mon[30893]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T06:04:56.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:55 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:04:56.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:55 smithi059 ceph-mon[35138]: purged_snaps scrub starts 2024-09-19T06:04:56.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:55 smithi059 ceph-mon[35138]: purged_snaps scrub ok 2024-09-19T06:04:56.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:55 smithi059 ceph-mon[35138]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:56.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:55 smithi059 ceph-mon[35138]: osd.2 [v2:172.21.15.71:6800/2436210695,v1:172.21.15.71:6801/2436210695] boot 2024-09-19T06:04:56.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:55 smithi059 ceph-mon[35138]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T06:04:56.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:55 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:04:56.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:55 smithi071 ceph-mon[35662]: purged_snaps scrub starts 2024-09-19T06:04:56.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:55 smithi071 ceph-mon[35662]: purged_snaps scrub ok 2024-09-19T06:04:56.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:55 smithi071 ceph-mon[35662]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T06:04:56.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:55 smithi071 ceph-mon[35662]: osd.2 [v2:172.21.15.71:6800/2436210695,v1:172.21.15.71:6801/2436210695] boot 2024-09-19T06:04:56.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:55 smithi071 ceph-mon[35662]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T06:04:56.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:55 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:04:57.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:56 smithi059 ceph-mon[35138]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T06:04:57.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:56 smithi059 ceph-mon[35138]: from='client.24190 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:57.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:56 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:04:57.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:56 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:04:57.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:56 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:57.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:56 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:04:57.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:56 smithi003 ceph-mon[30893]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T06:04:57.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:56 smithi003 ceph-mon[30893]: from='client.24190 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:57.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:56 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:04:57.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:56 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:04:57.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:56 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:57.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:56 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:04:57.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:56 smithi071 ceph-mon[35662]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T06:04:57.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:56 smithi071 ceph-mon[35662]: from='client.24190 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:04:57.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:56 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:04:57.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:56 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:04:57.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:56 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:04:57.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:56 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:04:58.069 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:58 smithi003 ceph-mon[30893]: pgmap v82: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:04:58.069 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:58 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T06:04:58.069 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:58 smithi003 ceph-mon[30893]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T06:04:58.069 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:58 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:04:58.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:58 smithi059 ceph-mon[35138]: pgmap v82: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:04:58.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:58 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T06:04:58.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:58 smithi059 ceph-mon[35138]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T06:04:58.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:58 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:04:58.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:58 smithi071 ceph-mon[35662]: pgmap v82: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:04:58.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:58 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T06:04:58.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:58 smithi071 ceph-mon[35662]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T06:04:58.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:58 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:04:59.008 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:04:58 smithi003 sudo[50070]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:04:59.008 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:04:58 smithi003 sudo[50070]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:04:59.008 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:04:58 smithi003 sudo[50070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:04:59.008 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:04:58 smithi003 sudo[50070]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:04:59.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:59 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:04:59.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:04:59 smithi059 ceph-mon[35138]: osdmap e21: 3 total, 3 up, 3 in 2024-09-19T06:04:59.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:59 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:04:59.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:04:59 smithi003 ceph-mon[30893]: osdmap e21: 3 total, 3 up, 3 in 2024-09-19T06:04:59.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:59 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:04:59.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:04:59 smithi071 ceph-mon[35662]: osdmap e21: 3 total, 3 up, 3 in 2024-09-19T06:04:59.834 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:04:59 smithi003 sudo[50099]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:04:59.835 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:04:59 smithi003 sudo[50099]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:04:59.835 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:04:59 smithi003 sudo[50099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:04:59.835 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:04:59 smithi003 sudo[50099]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:05:00.001 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:04:59 smithi059 sudo[43420]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:05:00.001 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:04:59 smithi059 sudo[43420]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:05:00.001 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:04:59 smithi059 sudo[43420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:05:00.002 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:04:59 smithi059 sudo[43420]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:05:00.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:00 smithi071 ceph-mon[35662]: pgmap v85: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:05:00.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:00 smithi071 ceph-mon[35662]: osdmap e22: 3 total, 3 up, 3 in 2024-09-19T06:05:00.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:00 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/3347877878' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba33cc45-0103-443d-b262-622a505d9806"}]: dispatch 2024-09-19T06:05:00.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:00 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/3347877878' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba33cc45-0103-443d-b262-622a505d9806"}]': finished 2024-09-19T06:05:00.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:00 smithi071 ceph-mon[35662]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T06:05:00.271 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:00 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:05:00.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:00 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:00.272 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:00 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/3189229989' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:05:00.288 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:05:00 smithi059 sudo[43423]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:05:00.289 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:05:00 smithi059 sudo[43423]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:05:00.289 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:05:00 smithi059 sudo[43423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:05:00.289 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:05:00 smithi059 sudo[43423]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:05:00.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:00 smithi059 ceph-mon[35138]: pgmap v85: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:05:00.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:00 smithi059 ceph-mon[35138]: osdmap e22: 3 total, 3 up, 3 in 2024-09-19T06:05:00.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:00 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/3347877878' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba33cc45-0103-443d-b262-622a505d9806"}]: dispatch 2024-09-19T06:05:00.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:00 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/3347877878' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba33cc45-0103-443d-b262-622a505d9806"}]': finished 2024-09-19T06:05:00.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:00 smithi059 ceph-mon[35138]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T06:05:00.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:00 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:05:00.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:00 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:00.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:00 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/3189229989' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:05:00.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:00 smithi003 ceph-mon[30893]: pgmap v85: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:05:00.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:00 smithi003 ceph-mon[30893]: osdmap e22: 3 total, 3 up, 3 in 2024-09-19T06:05:00.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:00 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3347877878' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba33cc45-0103-443d-b262-622a505d9806"}]: dispatch 2024-09-19T06:05:00.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:00 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3347877878' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba33cc45-0103-443d-b262-622a505d9806"}]': finished 2024-09-19T06:05:00.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:00 smithi003 ceph-mon[30893]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T06:05:00.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:00 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:05:00.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:00 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:00.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:00 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3189229989' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:05:00.527 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:05:00 smithi071 sudo[44536]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:05:00.527 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:05:00 smithi071 sudo[44536]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:05:00.527 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:05:00 smithi071 sudo[44536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:05:00.527 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:05:00 smithi071 sudo[44536]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:05:00.836 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:05:00 smithi071 sudo[44539]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:05:00.836 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:05:00 smithi071 sudo[44539]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:05:00.836 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:05:00 smithi071 sudo[44539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:05:00.836 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:05:00 smithi071 sudo[44539]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:05:01.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:01 smithi003 sudo[50547]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:05:01.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:01 smithi003 sudo[50547]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:05:01.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:01 smithi003 sudo[50547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:05:01.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:01 smithi003 sudo[50547]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:05:02.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:01 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:02.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:01 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:02.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:01 smithi059 ceph-mon[35138]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:05:02.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:01 smithi003 sudo[50559]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:05:02.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:01 smithi003 sudo[50559]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:05:02.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:01 smithi003 sudo[50559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:05:02.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:01 smithi003 sudo[50559]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:05:02.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:01 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:02.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:01 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:02.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:01 smithi003 ceph-mon[30893]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:05:02.182 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:01 smithi071 sudo[44542]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:05:02.182 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:01 smithi071 sudo[44542]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:05:02.183 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:01 smithi071 sudo[44542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:05:02.183 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:01 smithi071 sudo[44542]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:05:02.192 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:05:02.190+0000 7f0df7e00640 1 -- 172.21.15.3:0/2819669200 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f0df8098d20 con 0x7f0e001037c0 2024-09-19T06:05:02.591 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:02 smithi071 sudo[44545]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:05:02.591 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:02 smithi071 sudo[44545]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:05:02.591 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:02 smithi071 sudo[44545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:05:02.591 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:02 smithi071 sudo[44545]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:05:02.591 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:02 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:02.591 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:02 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:02.591 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:02 smithi071 ceph-mon[35662]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:05:02.706 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:02 smithi059 sudo[43426]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:05:02.706 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:02 smithi059 sudo[43426]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:05:02.706 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:02 smithi059 sudo[43426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:05:02.706 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:02 smithi059 sudo[43426]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:05:03.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:02 smithi059 sudo[43429]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:05:03.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:02 smithi059 sudo[43429]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:05:03.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:02 smithi059 sudo[43429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:05:03.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:02 smithi059 sudo[43429]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:05:03.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:02 smithi059 ceph-mon[35138]: pgmap v88: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:05:03.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:02 smithi059 ceph-mon[35138]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:05:03.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:02 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:05:03.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:02 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:05:03.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:02 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:05:03.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:02 smithi059 ceph-mon[35138]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:05:03.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:02 smithi059 ceph-mon[35138]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T06:05:03.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:02 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:05:03.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:02 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:05:03.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:02 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:05:03.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:02 smithi059 ceph-mon[35138]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:05:03.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:02 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:05:03.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:02 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:05:03.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:02 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:05:03.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:02 smithi003 ceph-mon[30893]: pgmap v88: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:05:03.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:02 smithi003 ceph-mon[30893]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:05:03.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:02 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:05:03.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:02 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:05:03.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:02 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:05:03.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:02 smithi003 ceph-mon[30893]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:05:03.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:02 smithi003 ceph-mon[30893]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T06:05:03.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:02 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:05:03.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:02 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:05:03.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:02 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:05:03.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:02 smithi003 ceph-mon[30893]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:05:03.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:02 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:05:03.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:02 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:05:03.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:02 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:05:03.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:02 smithi071 ceph-mon[35662]: pgmap v88: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:05:03.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:02 smithi071 ceph-mon[35662]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:05:03.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:02 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:05:03.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:02 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:05:03.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:02 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:05:03.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:02 smithi071 ceph-mon[35662]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:05:03.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:02 smithi071 ceph-mon[35662]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T06:05:03.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:02 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:05:03.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:02 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:05:03.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:02 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:05:03.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:02 smithi071 ceph-mon[35662]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:05:03.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:02 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:05:03.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:02 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:05:03.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:02 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:05:03.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:03 smithi003 ceph-mon[30893]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:05:03.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:03 smithi003 ceph-mon[30893]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:05:03.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:03 smithi003 ceph-mon[30893]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:05:04.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:03 smithi059 ceph-mon[35138]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:05:04.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:03 smithi059 ceph-mon[35138]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:05:04.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:03 smithi059 ceph-mon[35138]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:05:04.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:03 smithi071 ceph-mon[35662]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:05:04.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:03 smithi071 ceph-mon[35662]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:05:04.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:03 smithi071 ceph-mon[35662]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:05:05.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:05 smithi003 ceph-mon[30893]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:05:06.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:05 smithi059 ceph-mon[35138]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:05:06.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:05 smithi071 ceph-mon[35662]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:05:08.017 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:07 smithi003 ceph-mon[30893]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-19T06:05:08.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:07 smithi059 ceph-mon[35138]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-19T06:05:08.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:07 smithi071 ceph-mon[35662]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-19T06:05:09.003 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:08 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T06:05:09.004 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:08 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:09.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:08 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T06:05:09.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:08 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:09.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:08 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T06:05:09.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:08 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:09.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:09 smithi003 ceph-mon[30893]: Deploying daemon osd.3 on smithi003 2024-09-19T06:05:09.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:09 smithi003 ceph-mon[30893]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T06:05:10.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:09 smithi059 ceph-mon[35138]: Deploying daemon osd.3 on smithi003 2024-09-19T06:05:10.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:09 smithi059 ceph-mon[35138]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T06:05:10.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:09 smithi071 ceph-mon[35662]: Deploying daemon osd.3 on smithi003 2024-09-19T06:05:10.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:09 smithi071 ceph-mon[35662]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T06:05:11.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:11 smithi003 ceph-mon[30893]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T06:05:12.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:11 smithi059 ceph-mon[35138]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T06:05:12.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:11 smithi071 ceph-mon[35662]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T06:05:14.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:13 smithi059 ceph-mon[35138]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T06:05:14.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:13 smithi003 ceph-mon[30893]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T06:05:14.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:13 smithi071 ceph-mon[35662]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T06:05:15.827 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:15 smithi003 ceph-mon[30893]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:05:16.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:15 smithi059 ceph-mon[35138]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:05:16.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:15 smithi071 ceph-mon[35662]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:05:17.027 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:16 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:17.028 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:16 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:17.028 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:16 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:17.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:16 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:17.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:16 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:17.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:16 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:17.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:16 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:17.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:16 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:17.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:16 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:18.035 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:17 smithi003 ceph-mon[30893]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:05:18.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:17 smithi059 ceph-mon[35138]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:05:18.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:17 smithi071 ceph-mon[35662]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T06:05:20.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:19 smithi059 ceph-mon[35138]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:05:20.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:19 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:20.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:19 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:20.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:19 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:20.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:19 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:05:20.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:19 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:20.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:19 smithi003 ceph-mon[30893]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:05:20.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:19 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:20.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:19 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:20.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:19 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:20.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:19 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:05:20.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:19 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:20.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:19 smithi071 ceph-mon[35662]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:05:20.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:19 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:20.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:19 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:20.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:19 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:20.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:19 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:05:20.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:19 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:21.252 INFO:teuthology.orchestra.run.smithi003.stdout:Created osd(s) 3 on host 'smithi003' 2024-09-19T06:05:21.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:05:21.250+0000 7f0df7e00640 1 -- 172.21.15.3:0/2819669200 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0e001a2930 con 0x7f0de40a3260 2024-09-19T06:05:21.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:05:21.252+0000 7f0e06800640 1 -- 172.21.15.3:0/2819669200 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0de40a3260 msgr2=0x7f0de40a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:21.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:05:21.252+0000 7f0e06800640 1 --2- 172.21.15.3:0/2819669200 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0de40a3260 0x7f0de40a5720 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0e00102c60 tx=0x7f0df0005f90 comp rx=0 tx=0).stop 2024-09-19T06:05:21.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:05:21.252+0000 7f0e06800640 1 -- 172.21.15.3:0/2819669200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e001037c0 msgr2=0x7f0e001a16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:21.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:05:21.252+0000 7f0e06800640 1 --2- 172.21.15.3:0/2819669200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e001037c0 0x7f0e001a16c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0df800eb10 tx=0x7f0df800c2d0 comp rx=0 tx=0).stop 2024-09-19T06:05:21.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:05:21.253+0000 7f0e06800640 1 -- 172.21.15.3:0/2819669200 shutdown_connections 2024-09-19T06:05:21.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:05:21.253+0000 7f0e06800640 1 --2- 172.21.15.3:0/2819669200 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0de40a3260 0x7f0de40a5720 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:21.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:05:21.253+0000 7f0e06800640 1 --2- 172.21.15.3:0/2819669200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e001037c0 0x7f0e001a16c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:21.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:05:21.253+0000 7f0e06800640 1 --2- 172.21.15.3:0/2819669200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e00102e00 0x7f0e0019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:21.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:05:21.253+0000 7f0e06800640 1 --2- 172.21.15.3:0/2819669200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e00101c00 0x7f0e0019a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:21.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:05:21.253+0000 7f0e06800640 1 -- 172.21.15.3:0/2819669200 >> 172.21.15.3:0/2819669200 conn(0x7f0e000fd390 msgr2=0x7f0e00074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:21.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:05:21.253+0000 7f0e06800640 1 -- 172.21.15.3:0/2819669200 shutdown_connections 2024-09-19T06:05:21.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:05:21.253+0000 7f0e06800640 1 -- 172.21.15.3:0/2819669200 wait complete. 2024-09-19T06:05:22.008 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:21 smithi003 ceph-mon[30893]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:05:22.008 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:21 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:22.008 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:21 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:22.008 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:21 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:22.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:21 smithi059 ceph-mon[35138]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:05:22.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:21 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:22.041 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:21 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:22.041 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:21 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:22.044 DEBUG:teuthology.orchestra.run.smithi003:osd.3> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T06:05:22.048 INFO:tasks.cephadm:Deploying osd.4 on smithi059 with /dev/vg_nvme/lv_3... 2024-09-19T06:05:22.048 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T06:05:22.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:21 smithi071 ceph-mon[35662]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:05:22.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:21 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:22.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:21 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:22.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:21 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:22.307 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:05:22.545 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 19 06:05:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-3[52155]: 2024-09-19T06:05:22.311+0000 7f1a09a1d640 -1 osd.3 0 log_to_monitors true 2024-09-19T06:05:22.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:22 smithi003 ceph-mon[30893]: from='osd.3 [v2:172.21.15.3:6810/3577306700,v1:172.21.15.3:6811/3577306700]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:05:22.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:22 smithi003 ceph-mon[30893]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:05:23.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:22 smithi059 ceph-mon[35138]: from='osd.3 [v2:172.21.15.3:6810/3577306700,v1:172.21.15.3:6811/3577306700]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:05:23.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:22 smithi059 ceph-mon[35138]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:05:23.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:22 smithi071 ceph-mon[35662]: from='osd.3 [v2:172.21.15.3:6810/3577306700,v1:172.21.15.3:6811/3577306700]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:05:23.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:22 smithi071 ceph-mon[35662]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:05:23.986 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:23 smithi003 ceph-mon[30893]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:05:23.987 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:23 smithi003 ceph-mon[30893]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T06:05:23.987 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:23 smithi003 ceph-mon[30893]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T06:05:23.987 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:23 smithi003 ceph-mon[30893]: from='osd.3 [v2:172.21.15.3:6810/3577306700,v1:172.21.15.3:6811/3577306700]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]: dispatch 2024-09-19T06:05:23.987 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:23 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:05:23.987 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:23 smithi003 ceph-mon[30893]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]: dispatch 2024-09-19T06:05:24.011 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:23 smithi059 ceph-mon[35138]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:05:24.011 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:23 smithi059 ceph-mon[35138]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T06:05:24.011 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:23 smithi059 ceph-mon[35138]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T06:05:24.011 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:23 smithi059 ceph-mon[35138]: from='osd.3 [v2:172.21.15.3:6810/3577306700,v1:172.21.15.3:6811/3577306700]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]: dispatch 2024-09-19T06:05:24.012 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:23 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:05:24.012 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:23 smithi059 ceph-mon[35138]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]: dispatch 2024-09-19T06:05:24.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:23 smithi071 ceph-mon[35662]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:05:24.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:23 smithi071 ceph-mon[35662]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T06:05:24.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:23 smithi071 ceph-mon[35662]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T06:05:24.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:23 smithi071 ceph-mon[35662]: from='osd.3 [v2:172.21.15.3:6810/3577306700,v1:172.21.15.3:6811/3577306700]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]: dispatch 2024-09-19T06:05:24.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:23 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:05:24.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:23 smithi071 ceph-mon[35662]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]: dispatch 2024-09-19T06:05:24.585 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 19 06:05:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-3[52155]: 2024-09-19T06:05:24.330+0000 7f1a05000640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T06:05:24.585 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 19 06:05:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-3[52155]: 2024-09-19T06:05:24.345+0000 7f19fa600640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:05:24.793 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-19T06:05:24.820 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi059:vg_nvme/lv_3 2024-09-19T06:05:25.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:24 smithi059 ceph-mon[35138]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-19T06:05:25.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:24 smithi059 ceph-mon[35138]: osdmap e25: 4 total, 3 up, 4 in 2024-09-19T06:05:25.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:24 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:05:25.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:24 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:05:25.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:24 smithi059 ceph-mon[35138]: from='osd.3 ' entity='osd.3' 2024-09-19T06:05:25.069 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:05:25.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:24 smithi003 ceph-mon[30893]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-19T06:05:25.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:24 smithi003 ceph-mon[30893]: osdmap e25: 4 total, 3 up, 4 in 2024-09-19T06:05:25.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:24 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:05:25.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:24 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:05:25.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:24 smithi003 ceph-mon[30893]: from='osd.3 ' entity='osd.3' 2024-09-19T06:05:25.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:24 smithi071 ceph-mon[35662]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-19T06:05:25.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:24 smithi071 ceph-mon[35662]: osdmap e25: 4 total, 3 up, 4 in 2024-09-19T06:05:25.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:24 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:05:25.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:24 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:05:25.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:24 smithi071 ceph-mon[35662]: from='osd.3 ' entity='osd.3' 2024-09-19T06:05:25.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.527+0000 7efe22fa3640 1 -- 172.21.15.59:0/2239325138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe1c102eb0 msgr2=0x7efe1c103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:25.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.527+0000 7efe22fa3640 1 --2- 172.21.15.59:0/2239325138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe1c102eb0 0x7efe1c103330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efe08009890 tx=0x7efe0802a380 comp rx=0 tx=0).stop 2024-09-19T06:05:25.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.527+0000 7efe22fa3640 1 -- 172.21.15.59:0/2239325138 shutdown_connections 2024-09-19T06:05:25.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.527+0000 7efe22fa3640 1 --2- 172.21.15.59:0/2239325138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe1c103870 0x7efe1c10a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.527+0000 7efe22fa3640 1 --2- 172.21.15.59:0/2239325138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe1c102eb0 0x7efe1c103330 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.527+0000 7efe22fa3640 1 --2- 172.21.15.59:0/2239325138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe1c0ffed0 0x7efe1c1002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.527+0000 7efe22fa3640 1 -- 172.21.15.59:0/2239325138 >> 172.21.15.59:0/2239325138 conn(0x7efe1c0fba40 msgr2=0x7efe1c0fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:25.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.527+0000 7efe22fa3640 1 -- 172.21.15.59:0/2239325138 shutdown_connections 2024-09-19T06:05:25.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.528+0000 7efe22fa3640 1 -- 172.21.15.59:0/2239325138 wait complete. 2024-09-19T06:05:25.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.528+0000 7efe22fa3640 1 Processor -- start 2024-09-19T06:05:25.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.528+0000 7efe22fa3640 1 -- start start 2024-09-19T06:05:25.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.528+0000 7efe22fa3640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe1c0ffed0 0x7efe1c102810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:25.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.528+0000 7efe22fa3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe1c102eb0 0x7efe1c100e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:25.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.528+0000 7efe22fa3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe1c103870 0x7efe1c1013a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:25.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.528+0000 7efe22fa3640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7efe1c10d8b0 con 0x7efe1c103870 2024-09-19T06:05:25.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.528+0000 7efe22fa3640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efe1c10d730 con 0x7efe1c102eb0 2024-09-19T06:05:25.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.528+0000 7efe22fa3640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efe1c10da30 con 0x7efe1c0ffed0 2024-09-19T06:05:25.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.528+0000 7efe1bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe1c102eb0 0x7efe1c100e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:25.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.529+0000 7efe1bfff640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe1c102eb0 0x7efe1c100e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35126/0 (socket says 172.21.15.59:35126) 2024-09-19T06:05:25.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.529+0000 7efe1bfff640 1 -- 172.21.15.59:0/2332744277 learned_addr learned my addr 172.21.15.59:0/2332744277 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-19T06:05:25.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.529+0000 7efe21540640 1 --2- 172.21.15.59:0/2332744277 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe1c103870 0x7efe1c1013a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:25.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.529+0000 7efe20d3f640 1 --2- 172.21.15.59:0/2332744277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe1c0ffed0 0x7efe1c102810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:25.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.529+0000 7efe1bfff640 1 -- 172.21.15.59:0/2332744277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe1c0ffed0 msgr2=0x7efe1c102810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:25.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.529+0000 7efe1bfff640 1 --2- 172.21.15.59:0/2332744277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe1c0ffed0 0x7efe1c102810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.529+0000 7efe1bfff640 1 -- 172.21.15.59:0/2332744277 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe1c103870 msgr2=0x7efe1c1013a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:25.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.529+0000 7efe1bfff640 1 --2- 172.21.15.59:0/2332744277 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe1c103870 0x7efe1c1013a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:25.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.529+0000 7efe1bfff640 1 -- 172.21.15.59:0/2332744277 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1c101c60 con 0x7efe1c102eb0 2024-09-19T06:05:25.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.529+0000 7efe21540640 1 --2- 172.21.15.59:0/2332744277 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe1c103870 0x7efe1c1013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:05:25.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.529+0000 7efe1bfff640 1 --2- 172.21.15.59:0/2332744277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe1c102eb0 0x7efe1c100e60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efe08005940 tx=0x7efe08033b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:25.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.529+0000 7efe19ffb640 1 -- 172.21.15.59:0/2332744277 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0803f020 con 0x7efe1c102eb0 2024-09-19T06:05:25.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.529+0000 7efe22fa3640 1 -- 172.21.15.59:0/2332744277 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe1c1a20a0 con 0x7efe1c102eb0 2024-09-19T06:05:25.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.529+0000 7efe19ffb640 1 -- 172.21.15.59:0/2332744277 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe08004040 con 0x7efe1c102eb0 2024-09-19T06:05:25.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.529+0000 7efe19ffb640 1 -- 172.21.15.59:0/2332744277 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe08037040 con 0x7efe1c102eb0 2024-09-19T06:05:25.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.529+0000 7efe22fa3640 1 -- 172.21.15.59:0/2332744277 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe1c1a2550 con 0x7efe1c102eb0 2024-09-19T06:05:25.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.530+0000 7efe22fa3640 1 -- 172.21.15.59:0/2332744277 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe1c1091a0 con 0x7efe1c102eb0 2024-09-19T06:05:25.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.532+0000 7efe19ffb640 1 -- 172.21.15.59:0/2332744277 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7efe08042020 con 0x7efe1c102eb0 2024-09-19T06:05:25.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.532+0000 7efe19ffb640 1 --2- 172.21.15.59:0/2332744277 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7efe0c0a3240 0x7efe0c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:25.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.532+0000 7efe19ffb640 1 -- 172.21.15.59:0/2332744277 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3702+0+0 (secure 0 0 0) 0x7efe080eed40 con 0x7efe1c102eb0 2024-09-19T06:05:25.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.532+0000 7efe20d3f640 1 --2- 172.21.15.59:0/2332744277 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7efe0c0a3240 0x7efe0c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:25.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.533+0000 7efe20d3f640 1 --2- 172.21.15.59:0/2332744277 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7efe0c0a3240 0x7efe0c0a5700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efe100096c0 tx=0x7efe10009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:25.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.536+0000 7efe19ffb640 1 -- 172.21.15.59:0/2332744277 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efe08049020 con 0x7efe1c102eb0 2024-09-19T06:05:25.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:25.718+0000 7efe22fa3640 1 -- 172.21.15.59:0/2332744277 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7efe1c062630 con 0x7efe0c0a3240 2024-09-19T06:05:25.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:25 smithi003 ceph-mon[30893]: purged_snaps scrub starts 2024-09-19T06:05:25.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:25 smithi003 ceph-mon[30893]: purged_snaps scrub ok 2024-09-19T06:05:25.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:25 smithi003 ceph-mon[30893]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:05:25.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:25 smithi003 ceph-mon[30893]: osd.3 [v2:172.21.15.3:6810/3577306700,v1:172.21.15.3:6811/3577306700] boot 2024-09-19T06:05:25.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:25 smithi003 ceph-mon[30893]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T06:05:25.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:25 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:05:25.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:25 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:05:25.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:25 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:05:25.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:25 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:25.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:25 smithi071 ceph-mon[35662]: purged_snaps scrub starts 2024-09-19T06:05:25.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:25 smithi071 ceph-mon[35662]: purged_snaps scrub ok 2024-09-19T06:05:25.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:25 smithi071 ceph-mon[35662]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:05:25.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:25 smithi071 ceph-mon[35662]: osd.3 [v2:172.21.15.3:6810/3577306700,v1:172.21.15.3:6811/3577306700] boot 2024-09-19T06:05:25.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:25 smithi071 ceph-mon[35662]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T06:05:25.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:25 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:05:25.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:25 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:05:25.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:25 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:05:25.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:25 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:26.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:25 smithi059 ceph-mon[35138]: purged_snaps scrub starts 2024-09-19T06:05:26.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:25 smithi059 ceph-mon[35138]: purged_snaps scrub ok 2024-09-19T06:05:26.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:25 smithi059 ceph-mon[35138]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-19T06:05:26.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:25 smithi059 ceph-mon[35138]: osd.3 [v2:172.21.15.3:6810/3577306700,v1:172.21.15.3:6811/3577306700] boot 2024-09-19T06:05:26.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:25 smithi059 ceph-mon[35138]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T06:05:26.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:25 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:05:26.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:25 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:05:26.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:25 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:05:26.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:25 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:27.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:26 smithi059 ceph-mon[35138]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:27.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:26 smithi059 ceph-mon[35138]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T06:05:27.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:26 smithi059 ceph-mon[35138]: Detected new or changed devices on smithi003 2024-09-19T06:05:27.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:26 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:27.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:26 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:27.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:26 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:05:27.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:26 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:05:27.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:26 smithi059 ceph-mon[35138]: Adjusting osd_memory_target on smithi003 to 8547M 2024-09-19T06:05:27.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:26 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:27.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:26 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:27.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:26 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:05:27.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:26 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:27.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:26 smithi003 ceph-mon[30893]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:27.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:26 smithi003 ceph-mon[30893]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T06:05:27.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:26 smithi003 ceph-mon[30893]: Detected new or changed devices on smithi003 2024-09-19T06:05:27.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:26 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:27.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:26 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:27.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:26 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:05:27.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:26 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:05:27.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:26 smithi003 ceph-mon[30893]: Adjusting osd_memory_target on smithi003 to 8547M 2024-09-19T06:05:27.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:26 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:27.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:26 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:27.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:26 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:05:27.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:26 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:27.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:26 smithi071 ceph-mon[35662]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:27.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:26 smithi071 ceph-mon[35662]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T06:05:27.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:26 smithi071 ceph-mon[35662]: Detected new or changed devices on smithi003 2024-09-19T06:05:27.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:26 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:27.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:26 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:27.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:26 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:05:27.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:26 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:05:27.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:26 smithi071 ceph-mon[35662]: Adjusting osd_memory_target on smithi003 to 8547M 2024-09-19T06:05:27.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:26 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:27.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:26 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:27.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:26 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:05:27.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:26 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:28.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:27 smithi059 ceph-mon[35138]: pgmap v105: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:05:28.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:27 smithi059 ceph-mon[35138]: osdmap e28: 4 total, 4 up, 4 in 2024-09-19T06:05:28.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:27 smithi003 ceph-mon[30893]: pgmap v105: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:05:28.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:27 smithi003 ceph-mon[30893]: osdmap e28: 4 total, 4 up, 4 in 2024-09-19T06:05:28.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:27 smithi071 ceph-mon[35662]: pgmap v105: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:05:28.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:27 smithi071 ceph-mon[35662]: osdmap e28: 4 total, 4 up, 4 in 2024-09-19T06:05:29.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:28 smithi059 ceph-mon[35138]: osdmap e29: 4 total, 4 up, 4 in 2024-09-19T06:05:29.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:28 smithi059 ceph-mon[35138]: from='client.? 172.21.15.59:0/3406689017' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40564c0c-6335-4207-a8e0-8078c9bfd015"}]: dispatch 2024-09-19T06:05:29.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:28 smithi059 ceph-mon[35138]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40564c0c-6335-4207-a8e0-8078c9bfd015"}]: dispatch 2024-09-19T06:05:29.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:28 smithi059 ceph-mon[35138]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40564c0c-6335-4207-a8e0-8078c9bfd015"}]': finished 2024-09-19T06:05:29.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:28 smithi059 ceph-mon[35138]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T06:05:29.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:28 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:05:29.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:28 smithi059 ceph-mon[35138]: from='client.? 172.21.15.59:0/719453486' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:05:29.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:28 smithi003 ceph-mon[30893]: osdmap e29: 4 total, 4 up, 4 in 2024-09-19T06:05:29.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:28 smithi003 ceph-mon[30893]: from='client.? 172.21.15.59:0/3406689017' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40564c0c-6335-4207-a8e0-8078c9bfd015"}]: dispatch 2024-09-19T06:05:29.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:28 smithi003 ceph-mon[30893]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40564c0c-6335-4207-a8e0-8078c9bfd015"}]: dispatch 2024-09-19T06:05:29.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:28 smithi003 ceph-mon[30893]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40564c0c-6335-4207-a8e0-8078c9bfd015"}]': finished 2024-09-19T06:05:29.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:28 smithi003 ceph-mon[30893]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T06:05:29.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:28 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:05:29.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:28 smithi003 ceph-mon[30893]: from='client.? 172.21.15.59:0/719453486' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:05:29.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:28 smithi071 ceph-mon[35662]: osdmap e29: 4 total, 4 up, 4 in 2024-09-19T06:05:29.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:28 smithi071 ceph-mon[35662]: from='client.? 172.21.15.59:0/3406689017' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40564c0c-6335-4207-a8e0-8078c9bfd015"}]: dispatch 2024-09-19T06:05:29.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:28 smithi071 ceph-mon[35662]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40564c0c-6335-4207-a8e0-8078c9bfd015"}]: dispatch 2024-09-19T06:05:29.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:28 smithi071 ceph-mon[35662]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40564c0c-6335-4207-a8e0-8078c9bfd015"}]': finished 2024-09-19T06:05:29.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:28 smithi071 ceph-mon[35662]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T06:05:29.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:28 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:05:29.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:28 smithi071 ceph-mon[35662]: from='client.? 172.21.15.59:0/719453486' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:05:30.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:29 smithi059 ceph-mon[35138]: pgmap v108: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:05:30.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:29 smithi003 ceph-mon[30893]: pgmap v108: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:05:30.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:29 smithi071 ceph-mon[35662]: pgmap v108: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:05:32.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:31 smithi059 ceph-mon[35138]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:05:32.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:31 smithi003 ceph-mon[30893]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:05:32.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:31 smithi071 ceph-mon[35662]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:05:34.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:33 smithi059 ceph-mon[35138]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:05:34.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:33 smithi003 ceph-mon[30893]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:05:34.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:33 smithi071 ceph-mon[35662]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:05:36.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:36 smithi059 ceph-mon[35138]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-19T06:05:36.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:36 smithi003 ceph-mon[30893]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-19T06:05:36.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:36 smithi071 ceph-mon[35662]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-19T06:05:37.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:37 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T06:05:37.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:37 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:37.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:37 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T06:05:37.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:37 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:37.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:37 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T06:05:37.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:37 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:38.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:38 smithi059 ceph-mon[35138]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T06:05:38.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:38 smithi059 ceph-mon[35138]: Deploying daemon osd.4 on smithi059 2024-09-19T06:05:38.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:38 smithi003 ceph-mon[30893]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T06:05:38.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:38 smithi003 ceph-mon[30893]: Deploying daemon osd.4 on smithi059 2024-09-19T06:05:38.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:38 smithi071 ceph-mon[35662]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T06:05:38.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:38 smithi071 ceph-mon[35662]: Deploying daemon osd.4 on smithi059 2024-09-19T06:05:40.280 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:40 smithi059 ceph-mon[35138]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:05:40.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:40 smithi003 ceph-mon[30893]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:05:40.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:40 smithi071 ceph-mon[35662]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:05:42.286 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:42 smithi059 ceph-mon[35138]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T06:05:42.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:42 smithi003 ceph-mon[30893]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T06:05:42.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:42 smithi071 ceph-mon[35662]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T06:05:44.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:44 smithi059 ceph-mon[35138]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:05:44.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:44 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:44.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:44 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:44.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:44 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:44.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:44 smithi003 ceph-mon[30893]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:05:44.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:44 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:44.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:44 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:44.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:44 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:44.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:44 smithi071 ceph-mon[35662]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T06:05:44.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:44 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:44.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:44 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:44.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:44 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:46.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:46 smithi059 ceph-mon[35138]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:05:46.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:46 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:46.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:46 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:46.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:46 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:46.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:46 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:05:46.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:46 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:46.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:46 smithi003 ceph-mon[30893]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:05:46.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:46 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:46.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:46 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:46.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:46 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:46.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:46 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:05:46.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:46 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:46.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:46 smithi071 ceph-mon[35662]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:05:46.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:46 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:46.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:46 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:46.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:46 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:46.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:46 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:05:46.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:46 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:47.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:47.407+0000 7efe19ffb640 1 -- 172.21.15.59:0/2332744277 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7efe1c062630 con 0x7efe0c0a3240 2024-09-19T06:05:47.409 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 4 on host 'smithi059' 2024-09-19T06:05:47.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:47.409+0000 7efe22fa3640 1 -- 172.21.15.59:0/2332744277 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7efe0c0a3240 msgr2=0x7efe0c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:47.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:47.409+0000 7efe22fa3640 1 --2- 172.21.15.59:0/2332744277 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7efe0c0a3240 0x7efe0c0a5700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efe100096c0 tx=0x7efe10009260 comp rx=0 tx=0).stop 2024-09-19T06:05:47.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:47.409+0000 7efe22fa3640 1 -- 172.21.15.59:0/2332744277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe1c102eb0 msgr2=0x7efe1c100e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:47.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:47.409+0000 7efe22fa3640 1 --2- 172.21.15.59:0/2332744277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe1c102eb0 0x7efe1c100e60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efe08005940 tx=0x7efe08033b60 comp rx=0 tx=0).stop 2024-09-19T06:05:47.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:47.409+0000 7efe22fa3640 1 -- 172.21.15.59:0/2332744277 shutdown_connections 2024-09-19T06:05:47.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:47.409+0000 7efe22fa3640 1 --2- 172.21.15.59:0/2332744277 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7efe0c0a3240 0x7efe0c0a5700 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:47.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:47.409+0000 7efe22fa3640 1 --2- 172.21.15.59:0/2332744277 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe1c103870 0x7efe1c1013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:47.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:47.409+0000 7efe22fa3640 1 --2- 172.21.15.59:0/2332744277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe1c102eb0 0x7efe1c100e60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:47.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:47.409+0000 7efe22fa3640 1 --2- 172.21.15.59:0/2332744277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe1c0ffed0 0x7efe1c102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:47.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:47.409+0000 7efe22fa3640 1 -- 172.21.15.59:0/2332744277 >> 172.21.15.59:0/2332744277 conn(0x7efe1c0fba40 msgr2=0x7efe1c106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:47.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:47.409+0000 7efe22fa3640 1 -- 172.21.15.59:0/2332744277 shutdown_connections 2024-09-19T06:05:47.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:05:47.410+0000 7efe22fa3640 1 -- 172.21.15.59:0/2332744277 wait complete. 2024-09-19T06:05:48.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:48 smithi059 ceph-mon[35138]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:05:48.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:48 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:48.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:48 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:48.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:48 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:48.122 DEBUG:teuthology.orchestra.run.smithi059:osd.4> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T06:05:48.124 INFO:tasks.cephadm:Deploying osd.5 on smithi071 with /dev/vg_nvme/lv_3... 2024-09-19T06:05:48.124 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T06:05:48.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:48 smithi003 ceph-mon[30893]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:05:48.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:48 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:48.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:48 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:48.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:48 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:48.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:48 smithi071 ceph-mon[35662]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:05:48.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:48 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:05:48.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:48 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:48.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:48 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:48.376 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:05:49.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:49 smithi071 ceph-mon[35662]: from='osd.4 [v2:172.21.15.59:6808/4002980986,v1:172.21.15.59:6809/4002980986]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:05:49.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:49 smithi071 ceph-mon[35662]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:05:49.266 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:49 smithi059 ceph-mon[35138]: from='osd.4 [v2:172.21.15.59:6808/4002980986,v1:172.21.15.59:6809/4002980986]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:05:49.266 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:49 smithi059 ceph-mon[35138]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:05:49.266 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:05:48 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4[46165]: 2024-09-19T06:05:48.789+0000 7f149b1f9640 -1 osd.4 0 log_to_monitors true 2024-09-19T06:05:49.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:49 smithi003 ceph-mon[30893]: from='osd.4 [v2:172.21.15.59:6808/4002980986,v1:172.21.15.59:6809/4002980986]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:05:49.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:49 smithi003 ceph-mon[30893]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:05:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:50 smithi003 ceph-mon[30893]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:05:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:50 smithi003 ceph-mon[30893]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T06:05:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:50 smithi003 ceph-mon[30893]: from='osd.4 [v2:172.21.15.59:6808/4002980986,v1:172.21.15.59:6809/4002980986]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-19T06:05:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:50 smithi003 ceph-mon[30893]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T06:05:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:50 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:05:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:50 smithi003 ceph-mon[30893]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-19T06:05:50.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:50 smithi071 ceph-mon[35662]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:05:50.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:50 smithi071 ceph-mon[35662]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T06:05:50.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:50 smithi071 ceph-mon[35662]: from='osd.4 [v2:172.21.15.59:6808/4002980986,v1:172.21.15.59:6809/4002980986]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-19T06:05:50.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:50 smithi071 ceph-mon[35662]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T06:05:50.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:50 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:05:50.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:50 smithi071 ceph-mon[35662]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-19T06:05:50.397 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:50 smithi059 ceph-mon[35138]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:05:50.398 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:50 smithi059 ceph-mon[35138]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T06:05:50.398 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:50 smithi059 ceph-mon[35138]: from='osd.4 [v2:172.21.15.59:6808/4002980986,v1:172.21.15.59:6809/4002980986]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-19T06:05:50.398 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:50 smithi059 ceph-mon[35138]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T06:05:50.398 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:50 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:05:50.398 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:50 smithi059 ceph-mon[35138]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-19T06:05:50.785 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:05:50 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4[46165]: 2024-09-19T06:05:50.503+0000 7f149717c640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T06:05:50.785 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:05:50 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4[46165]: 2024-09-19T06:05:50.508+0000 7f148ef9c640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:05:50.822 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-19T06:05:50.848 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_3 2024-09-19T06:05:51.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:51 smithi071 ceph-mon[35662]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-19T06:05:51.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:51 smithi071 ceph-mon[35662]: osdmap e32: 5 total, 4 up, 5 in 2024-09-19T06:05:51.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:51 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:05:51.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:51 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:05:51.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:51 smithi071 ceph-mon[35662]: from='osd.4 ' entity='osd.4' 2024-09-19T06:05:51.105 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:05:51.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:51 smithi003 ceph-mon[30893]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-19T06:05:51.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:51 smithi003 ceph-mon[30893]: osdmap e32: 5 total, 4 up, 5 in 2024-09-19T06:05:51.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:51 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:05:51.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:51 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:05:51.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:51 smithi003 ceph-mon[30893]: from='osd.4 ' entity='osd.4' 2024-09-19T06:05:51.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:51 smithi059 ceph-mon[35138]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-19T06:05:51.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:51 smithi059 ceph-mon[35138]: osdmap e32: 5 total, 4 up, 5 in 2024-09-19T06:05:51.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:51 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:05:51.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:51 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:05:51.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:51 smithi059 ceph-mon[35138]: from='osd.4 ' entity='osd.4' 2024-09-19T06:05:51.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.546+0000 7f8885eec640 1 -- 172.21.15.71:0/3883338353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8880101d10 msgr2=0x7f8880102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:51.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.546+0000 7f8885eec640 1 --2- 172.21.15.71:0/3883338353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8880101d10 0x7f8880102190 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8874009900 tx=0x7f887402a410 comp rx=0 tx=0).stop 2024-09-19T06:05:51.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.546+0000 7f8885eec640 1 -- 172.21.15.71:0/3883338353 shutdown_connections 2024-09-19T06:05:51.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.546+0000 7f8885eec640 1 --2- 172.21.15.71:0/3883338353 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88801026d0 0x7f8880108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.546+0000 7f8885eec640 1 --2- 172.21.15.71:0/3883338353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8880101d10 0x7f8880102190 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.546+0000 7f8885eec640 1 --2- 172.21.15.71:0/3883338353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8880100b10 0x7f8880100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.546+0000 7f8885eec640 1 -- 172.21.15.71:0/3883338353 >> 172.21.15.71:0/3883338353 conn(0x7f88800fc2a0 msgr2=0x7f88800fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:05:51.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.546+0000 7f8885eec640 1 -- 172.21.15.71:0/3883338353 shutdown_connections 2024-09-19T06:05:51.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.546+0000 7f8885eec640 1 -- 172.21.15.71:0/3883338353 wait complete. 2024-09-19T06:05:51.581 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.547+0000 7f8885eec640 1 Processor -- start 2024-09-19T06:05:51.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.547+0000 7f8885eec640 1 -- start start 2024-09-19T06:05:51.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.547+0000 7f8885eec640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8880100b10 0x7f8880197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:51.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.547+0000 7f8885eec640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8880101d10 0x7f88801983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:51.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.547+0000 7f8885eec640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88801026d0 0x7f888019f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:51.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.547+0000 7f8885eec640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f888010c770 con 0x7f88801026d0 2024-09-19T06:05:51.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.547+0000 7f8885eec640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f888010c5f0 con 0x7f8880100b10 2024-09-19T06:05:51.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.547+0000 7f8885eec640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f888010c8f0 con 0x7f8880101d10 2024-09-19T06:05:51.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.547+0000 7f887effd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8880101d10 0x7f88801983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:51.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.547+0000 7f887effd640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8880101d10 0x7f88801983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:51658/0 (socket says 172.21.15.71:51658) 2024-09-19T06:05:51.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.547+0000 7f887effd640 1 -- 172.21.15.71:0/2933574548 learned_addr learned my addr 172.21.15.71:0/2933574548 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-19T06:05:51.582 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.547+0000 7f887f7fe640 1 --2- 172.21.15.71:0/2933574548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8880100b10 0x7f8880197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:51.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.548+0000 7f887effd640 1 -- 172.21.15.71:0/2933574548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8880100b10 msgr2=0x7f8880197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:51.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.548+0000 7f887effd640 1 --2- 172.21.15.71:0/2933574548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8880100b10 0x7f8880197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.548+0000 7f887effd640 1 -- 172.21.15.71:0/2933574548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88801026d0 msgr2=0x7f888019f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:05:51.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.548+0000 7f887effd640 1 --2- 172.21.15.71:0/2933574548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88801026d0 0x7f888019f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:05:51.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.548+0000 7f887effd640 1 -- 172.21.15.71:0/2933574548 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f888019fac0 con 0x7f8880101d10 2024-09-19T06:05:51.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.548+0000 7f887effd640 1 --2- 172.21.15.71:0/2933574548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8880101d10 0x7f88801983d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8874009230 tx=0x7f8874004360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:51.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.548+0000 7f887cff9640 1 -- 172.21.15.71:0/2933574548 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887403f030 con 0x7f8880101d10 2024-09-19T06:05:51.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.548+0000 7f8885eec640 1 -- 172.21.15.71:0/2933574548 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f888019fd50 con 0x7f8880101d10 2024-09-19T06:05:51.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.548+0000 7f887cff9640 1 -- 172.21.15.71:0/2933574548 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8874003ce0 con 0x7f8880101d10 2024-09-19T06:05:51.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.548+0000 7f887cff9640 1 -- 172.21.15.71:0/2933574548 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8874035070 con 0x7f8880101d10 2024-09-19T06:05:51.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.548+0000 7f8885eec640 1 -- 172.21.15.71:0/2933574548 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88801a01d0 con 0x7f8880101d10 2024-09-19T06:05:51.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.549+0000 7f8885eec640 1 -- 172.21.15.71:0/2933574548 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88801a0400 con 0x7f8880101d10 2024-09-19T06:05:51.583 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.550+0000 7f887cff9640 1 -- 172.21.15.71:0/2933574548 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f8874042030 con 0x7f8880101d10 2024-09-19T06:05:51.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.551+0000 7f887cff9640 1 --2- 172.21.15.71:0/2933574548 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f88680a3270 0x7f88680a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:05:51.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.551+0000 7f887cff9640 1 -- 172.21.15.71:0/2933574548 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4101+0+0 (secure 0 0 0) 0x7f88740eeeb0 con 0x7f8880101d10 2024-09-19T06:05:51.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.551+0000 7f887f7fe640 1 --2- 172.21.15.71:0/2933574548 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f88680a3270 0x7f88680a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:05:51.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.552+0000 7f887f7fe640 1 --2- 172.21.15.71:0/2933574548 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f88680a3270 0x7f88680a5730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8870005fd0 tx=0x7f887000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:05:51.584 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.555+0000 7f887cff9640 1 -- 172.21.15.71:0/2933574548 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f88740bcc40 con 0x7f8880101d10 2024-09-19T06:05:51.733 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:05:51.731+0000 7f8885eec640 1 -- 172.21.15.71:0/2933574548 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f888006aea0 con 0x7f88680a3270 2024-09-19T06:05:52.302 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:52 smithi071 ceph-mon[35662]: purged_snaps scrub starts 2024-09-19T06:05:52.303 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:52 smithi071 ceph-mon[35662]: purged_snaps scrub ok 2024-09-19T06:05:52.303 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:52 smithi071 ceph-mon[35662]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:05:52.303 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:52 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:05:52.303 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:52 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:52.303 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:52 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:52.303 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:52 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:05:52.303 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:52 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:05:52.303 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:52 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:52.303 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:52 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:52.303 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:52 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:05:52.303 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:52 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:52.303 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:52 smithi071 ceph-mon[35662]: osd.4 [v2:172.21.15.59:6808/4002980986,v1:172.21.15.59:6809/4002980986] boot 2024-09-19T06:05:52.303 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:52 smithi071 ceph-mon[35662]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T06:05:52.303 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:52 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:05:52.304 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:52 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:05:52.304 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:52 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:05:52.304 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:52 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:52.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:52 smithi003 ceph-mon[30893]: purged_snaps scrub starts 2024-09-19T06:05:52.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:52 smithi003 ceph-mon[30893]: purged_snaps scrub ok 2024-09-19T06:05:52.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:52 smithi003 ceph-mon[30893]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:05:52.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:52 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:05:52.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:52 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:52.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:52 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:52.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:52 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:05:52.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:52 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:05:52.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:52 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:52.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:52 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:52.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:52 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:05:52.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:52 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:52.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:52 smithi003 ceph-mon[30893]: osd.4 [v2:172.21.15.59:6808/4002980986,v1:172.21.15.59:6809/4002980986] boot 2024-09-19T06:05:52.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:52 smithi003 ceph-mon[30893]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T06:05:52.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:52 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:05:52.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:52 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:05:52.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:52 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:05:52.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:52 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:52.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:52 smithi059 ceph-mon[35138]: purged_snaps scrub starts 2024-09-19T06:05:52.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:52 smithi059 ceph-mon[35138]: purged_snaps scrub ok 2024-09-19T06:05:52.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:52 smithi059 ceph-mon[35138]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-19T06:05:52.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:52 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:05:52.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:52 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:52.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:52 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:52.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:52 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:05:52.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:52 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:05:52.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:52 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:52.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:52 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:52.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:52 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:05:52.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:52 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:05:52.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:52 smithi059 ceph-mon[35138]: osd.4 [v2:172.21.15.59:6808/4002980986,v1:172.21.15.59:6809/4002980986] boot 2024-09-19T06:05:52.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:52 smithi059 ceph-mon[35138]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T06:05:52.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:52 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:05:52.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:52 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:05:52.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:52 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:05:52.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:52 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:05:53.180 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:53 smithi071 ceph-mon[35662]: Detected new or changed devices on smithi059 2024-09-19T06:05:53.180 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:53 smithi071 ceph-mon[35662]: Adjusting osd_memory_target on smithi059 to 8546M 2024-09-19T06:05:53.180 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:53 smithi071 ceph-mon[35662]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:53.180 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:53 smithi071 ceph-mon[35662]: osdmap e34: 5 total, 5 up, 5 in 2024-09-19T06:05:53.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:53 smithi003 ceph-mon[30893]: Detected new or changed devices on smithi059 2024-09-19T06:05:53.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:53 smithi003 ceph-mon[30893]: Adjusting osd_memory_target on smithi059 to 8546M 2024-09-19T06:05:53.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:53 smithi003 ceph-mon[30893]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:53.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:53 smithi003 ceph-mon[30893]: osdmap e34: 5 total, 5 up, 5 in 2024-09-19T06:05:53.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:53 smithi059 ceph-mon[35138]: Detected new or changed devices on smithi059 2024-09-19T06:05:53.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:53 smithi059 ceph-mon[35138]: Adjusting osd_memory_target on smithi059 to 8546M 2024-09-19T06:05:53.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:53 smithi059 ceph-mon[35138]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:05:53.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:53 smithi059 ceph-mon[35138]: osdmap e34: 5 total, 5 up, 5 in 2024-09-19T06:05:54.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:54 smithi003 ceph-mon[30893]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:05:54.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:54 smithi071 ceph-mon[35662]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:05:54.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:54 smithi059 ceph-mon[35138]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:05:55.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:55 smithi003 ceph-mon[30893]: from='client.? 172.21.15.71:0/3926351919' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4db04b82-3403-4fd5-9eb7-7b81ed6b1d26"}]: dispatch 2024-09-19T06:05:55.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:55 smithi003 ceph-mon[30893]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4db04b82-3403-4fd5-9eb7-7b81ed6b1d26"}]: dispatch 2024-09-19T06:05:55.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:55 smithi003 ceph-mon[30893]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4db04b82-3403-4fd5-9eb7-7b81ed6b1d26"}]': finished 2024-09-19T06:05:55.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:55 smithi003 ceph-mon[30893]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T06:05:55.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:55 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:05:55.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:55 smithi003 ceph-mon[30893]: from='client.? 172.21.15.71:0/1096331709' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:05:55.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:55 smithi071 ceph-mon[35662]: from='client.? 172.21.15.71:0/3926351919' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4db04b82-3403-4fd5-9eb7-7b81ed6b1d26"}]: dispatch 2024-09-19T06:05:55.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:55 smithi071 ceph-mon[35662]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4db04b82-3403-4fd5-9eb7-7b81ed6b1d26"}]: dispatch 2024-09-19T06:05:55.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:55 smithi071 ceph-mon[35662]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4db04b82-3403-4fd5-9eb7-7b81ed6b1d26"}]': finished 2024-09-19T06:05:55.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:55 smithi071 ceph-mon[35662]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T06:05:55.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:55 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:05:55.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:55 smithi071 ceph-mon[35662]: from='client.? 172.21.15.71:0/1096331709' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:05:55.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:55 smithi059 ceph-mon[35138]: from='client.? 172.21.15.71:0/3926351919' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4db04b82-3403-4fd5-9eb7-7b81ed6b1d26"}]: dispatch 2024-09-19T06:05:55.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:55 smithi059 ceph-mon[35138]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4db04b82-3403-4fd5-9eb7-7b81ed6b1d26"}]: dispatch 2024-09-19T06:05:55.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:55 smithi059 ceph-mon[35138]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4db04b82-3403-4fd5-9eb7-7b81ed6b1d26"}]': finished 2024-09-19T06:05:55.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:55 smithi059 ceph-mon[35138]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T06:05:55.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:55 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:05:55.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:55 smithi059 ceph-mon[35138]: from='client.? 172.21.15.71:0/1096331709' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:05:56.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:56 smithi003 ceph-mon[30893]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:05:56.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:56 smithi071 ceph-mon[35662]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:05:56.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:56 smithi059 ceph-mon[35138]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:05:57.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:57 smithi003 ceph-mon[30893]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:05:57.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:57 smithi071 ceph-mon[35662]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:05:57.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:57 smithi059 ceph-mon[35138]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:05:59.321 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:05:59 smithi071 ceph-mon[35662]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:05:59.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:05:59 smithi059 ceph-mon[35138]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:05:59.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:05:59 smithi003 ceph-mon[30893]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:01.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:01 smithi071 ceph-mon[35662]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:01.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:01 smithi059 ceph-mon[35138]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:01.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:01 smithi003 ceph-mon[30893]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:03.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:03 smithi071 ceph-mon[35662]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:03.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:03 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T06:06:03.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:03 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:03.400 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:03 smithi071 ceph-mon[35662]: Deploying daemon osd.5 on smithi071 2024-09-19T06:06:03.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:03 smithi059 ceph-mon[35138]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:03.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:03 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T06:06:03.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:03 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:03.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:03 smithi059 ceph-mon[35138]: Deploying daemon osd.5 on smithi071 2024-09-19T06:06:03.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:03 smithi003 ceph-mon[30893]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:03.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:03 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T06:06:03.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:03 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:03.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:03 smithi003 ceph-mon[30893]: Deploying daemon osd.5 on smithi071 2024-09-19T06:06:05.494 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:05 smithi071 ceph-mon[35662]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:05.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:05 smithi059 ceph-mon[35138]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:05.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:05 smithi003 ceph-mon[30893]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:07.432 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:07 smithi071 ceph-mon[35662]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:07.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:07 smithi059 ceph-mon[35138]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:07.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:07 smithi003 ceph-mon[30893]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:09.460 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:09 smithi071 ceph-mon[35662]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:09.460 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:09 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:06:09.460 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:09 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:09.460 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:09 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:09.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:09 smithi059 ceph-mon[35138]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:09.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:09 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:06:09.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:09 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:09.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:09 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:09.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:09 smithi003 ceph-mon[30893]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:09.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:09 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:06:09.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:09 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:09.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:09 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:11.421 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:11 smithi071 ceph-mon[35662]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:11.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:11 smithi059 ceph-mon[35138]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:11.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:11 smithi003 ceph-mon[30893]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:12.293 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:06:12.291+0000 7f887cff9640 1 -- 172.21.15.71:0/2933574548 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f888006aea0 con 0x7f88680a3270 2024-09-19T06:06:12.294 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 5 on host 'smithi071' 2024-09-19T06:06:12.295 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:06:12.293+0000 7f8885eec640 1 -- 172.21.15.71:0/2933574548 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f88680a3270 msgr2=0x7f88680a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:12.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:06:12.293+0000 7f8885eec640 1 --2- 172.21.15.71:0/2933574548 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f88680a3270 0x7f88680a5730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8870005fd0 tx=0x7f887000b410 comp rx=0 tx=0).stop 2024-09-19T06:06:12.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:06:12.293+0000 7f8885eec640 1 -- 172.21.15.71:0/2933574548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8880101d10 msgr2=0x7f88801983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:12.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:06:12.293+0000 7f8885eec640 1 --2- 172.21.15.71:0/2933574548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8880101d10 0x7f88801983d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8874009230 tx=0x7f8874004360 comp rx=0 tx=0).stop 2024-09-19T06:06:12.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:06:12.293+0000 7f8885eec640 1 -- 172.21.15.71:0/2933574548 shutdown_connections 2024-09-19T06:06:12.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:06:12.293+0000 7f8885eec640 1 --2- 172.21.15.71:0/2933574548 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f88680a3270 0x7f88680a5730 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:12.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:06:12.293+0000 7f8885eec640 1 --2- 172.21.15.71:0/2933574548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88801026d0 0x7f888019f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:12.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:06:12.293+0000 7f8885eec640 1 --2- 172.21.15.71:0/2933574548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8880101d10 0x7f88801983d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:12.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:06:12.293+0000 7f8885eec640 1 --2- 172.21.15.71:0/2933574548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8880100b10 0x7f8880197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:12.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:06:12.293+0000 7f8885eec640 1 -- 172.21.15.71:0/2933574548 >> 172.21.15.71:0/2933574548 conn(0x7f88800fc2a0 msgr2=0x7f888006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:12.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:06:12.293+0000 7f8885eec640 1 -- 172.21.15.71:0/2933574548 shutdown_connections 2024-09-19T06:06:12.296 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:06:12.293+0000 7f8885eec640 1 -- 172.21.15.71:0/2933574548 wait complete. 2024-09-19T06:06:12.907 DEBUG:teuthology.orchestra.run.smithi071:osd.5> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T06:06:12.909 INFO:tasks.cephadm:Deploying osd.6 on smithi003 with /dev/vg_nvme/lv_2... 2024-09-19T06:06:12.909 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T06:06:13.300 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:13.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:13 smithi059 ceph-mon[35138]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:13.541 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:13 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:13.541 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:13 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:13.541 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:13 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:13.541 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:13 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:13.555 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:13 smithi071 ceph-mon[35662]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:13.555 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:13 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:13.555 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:13 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:13.555 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:13 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:13.555 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:13 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:13.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:13 smithi003 ceph-mon[30893]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:13.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:13 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:13.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:13 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:13.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:13 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:13.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:13 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:14.836 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:06:14 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:06:14.727+0000 7fdfb114e640 -1 osd.5 0 log_to_monitors true 2024-09-19T06:06:15.416 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:15 smithi003 ceph-mon[30893]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:15.417 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:15 smithi003 ceph-mon[30893]: from='osd.5 [v2:172.21.15.71:6808/2455500497,v1:172.21.15.71:6809/2455500497]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:06:15.417 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:15 smithi003 ceph-mon[30893]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:06:15.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:15 smithi071 ceph-mon[35662]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:15.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:15 smithi071 ceph-mon[35662]: from='osd.5 [v2:172.21.15.71:6808/2455500497,v1:172.21.15.71:6809/2455500497]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:06:15.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:15 smithi071 ceph-mon[35662]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:06:15.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:15 smithi059 ceph-mon[35138]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:15.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:15 smithi059 ceph-mon[35138]: from='osd.5 [v2:172.21.15.71:6808/2455500497,v1:172.21.15.71:6809/2455500497]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:06:15.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:15 smithi059 ceph-mon[35138]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:06:16.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:16 smithi003 ceph-mon[30893]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T06:06:16.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:16 smithi003 ceph-mon[30893]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T06:06:16.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:16 smithi003 ceph-mon[30893]: from='osd.5 [v2:172.21.15.71:6808/2455500497,v1:172.21.15.71:6809/2455500497]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-19T06:06:16.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:16 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:06:16.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:16 smithi003 ceph-mon[30893]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-19T06:06:16.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:16 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:16.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:16 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:16.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:16 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:06:16.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:16 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:06:16.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:16 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:16.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:16 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:16.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:16 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:06:16.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:16 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:16.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:16 smithi003 ceph-mon[30893]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-19T06:06:16.586 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:06:16 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:06:16.292+0000 7fdfad0d1640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T06:06:16.587 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:06:16 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:06:16.298+0000 7fdfa8ef9640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:06:16.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:16 smithi071 ceph-mon[35662]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T06:06:16.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:16 smithi071 ceph-mon[35662]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T06:06:16.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:16 smithi071 ceph-mon[35662]: from='osd.5 [v2:172.21.15.71:6808/2455500497,v1:172.21.15.71:6809/2455500497]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-19T06:06:16.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:16 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:06:16.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:16 smithi071 ceph-mon[35662]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-19T06:06:16.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:16 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:16.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:16 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:16.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:16 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:06:16.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:16 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:06:16.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:16 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:16.588 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:16 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:16.588 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:16 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:06:16.588 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:16 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:16.588 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:16 smithi071 ceph-mon[35662]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-19T06:06:16.690 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:16 smithi059 ceph-mon[35138]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T06:06:16.690 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:16 smithi059 ceph-mon[35138]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T06:06:16.690 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:16 smithi059 ceph-mon[35138]: from='osd.5 [v2:172.21.15.71:6808/2455500497,v1:172.21.15.71:6809/2455500497]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-19T06:06:16.690 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:16 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:06:16.691 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:16 smithi059 ceph-mon[35138]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-19T06:06:16.691 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:16 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:16.691 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:16 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:16.691 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:16 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:06:16.691 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:16 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:06:16.691 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:16 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:16.691 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:16 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:16.691 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:16 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:06:16.691 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:16 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:16.691 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:16 smithi059 ceph-mon[35138]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-19T06:06:16.761 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:06:16.792 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi003:vg_nvme/lv_2 2024-09-19T06:06:17.163 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:06:17.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:17 smithi003 ceph-mon[30893]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:17.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:17 smithi003 ceph-mon[30893]: Detected new or changed devices on smithi071 2024-09-19T06:06:17.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:17 smithi003 ceph-mon[30893]: Adjusting osd_memory_target on smithi071 to 8544M 2024-09-19T06:06:17.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:17 smithi003 ceph-mon[30893]: osdmap e37: 6 total, 5 up, 6 in 2024-09-19T06:06:17.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:17 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:06:17.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:17 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:06:17.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:17 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:06:17.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:17 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:17.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:17 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:06:17.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:17 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:17.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:17 smithi003 ceph-mon[30893]: osd.5 [v2:172.21.15.71:6808/2455500497,v1:172.21.15.71:6809/2455500497] boot 2024-09-19T06:06:17.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:17 smithi003 ceph-mon[30893]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T06:06:17.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:17 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:06:17.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:17 smithi071 ceph-mon[35662]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:17.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:17 smithi071 ceph-mon[35662]: Detected new or changed devices on smithi071 2024-09-19T06:06:17.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:17 smithi071 ceph-mon[35662]: Adjusting osd_memory_target on smithi071 to 8544M 2024-09-19T06:06:17.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:17 smithi071 ceph-mon[35662]: osdmap e37: 6 total, 5 up, 6 in 2024-09-19T06:06:17.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:17 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:06:17.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:17 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:06:17.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:17 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:06:17.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:17 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:17.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:17 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:06:17.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:17 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:17.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:17 smithi071 ceph-mon[35662]: osd.5 [v2:172.21.15.71:6808/2455500497,v1:172.21.15.71:6809/2455500497] boot 2024-09-19T06:06:17.588 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:17 smithi071 ceph-mon[35662]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T06:06:17.588 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:17 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:06:17.711 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:17 smithi059 ceph-mon[35138]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-19T06:06:17.711 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:17 smithi059 ceph-mon[35138]: Detected new or changed devices on smithi071 2024-09-19T06:06:17.712 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:17 smithi059 ceph-mon[35138]: Adjusting osd_memory_target on smithi071 to 8544M 2024-09-19T06:06:17.712 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:17 smithi059 ceph-mon[35138]: osdmap e37: 6 total, 5 up, 6 in 2024-09-19T06:06:17.712 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:17 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:06:17.712 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:17 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:06:17.712 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:17 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:06:17.712 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:17 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:17.712 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:17 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:06:17.712 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:17 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:17.712 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:17 smithi059 ceph-mon[35138]: osd.5 [v2:172.21.15.71:6808/2455500497,v1:172.21.15.71:6809/2455500497] boot 2024-09-19T06:06:17.712 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:17 smithi059 ceph-mon[35138]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T06:06:17.712 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:17 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:06:17.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.947+0000 7f0bc2800640 1 -- 172.21.15.3:0/799853767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bbc105810 msgr2=0x7f0bbc10c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:17.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.947+0000 7f0bc2800640 1 --2- 172.21.15.3:0/799853767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bbc105810 0x7f0bbc10c0a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009be0 tx=0x7f0bb402a6c0 comp rx=0 tx=0).stop 2024-09-19T06:06:17.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.947+0000 7f0bc2800640 1 -- 172.21.15.3:0/799853767 shutdown_connections 2024-09-19T06:06:17.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.947+0000 7f0bc2800640 1 --2- 172.21.15.3:0/799853767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bbc105810 0x7f0bbc10c0a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:17.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.947+0000 7f0bc2800640 1 --2- 172.21.15.3:0/799853767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bbc104e50 0x7f0bbc1052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:17.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.947+0000 7f0bc2800640 1 --2- 172.21.15.3:0/799853767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bbc103c50 0x7f0bbc104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:17.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.947+0000 7f0bc2800640 1 -- 172.21.15.3:0/799853767 >> 172.21.15.3:0/799853767 conn(0x7f0bbc0ff3e0 msgr2=0x7f0bbc101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:17.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.947+0000 7f0bc2800640 1 -- 172.21.15.3:0/799853767 shutdown_connections 2024-09-19T06:06:17.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.947+0000 7f0bc2800640 1 -- 172.21.15.3:0/799853767 wait complete. 2024-09-19T06:06:17.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.948+0000 7f0bc2800640 1 Processor -- start 2024-09-19T06:06:17.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.948+0000 7f0bc2800640 1 -- start start 2024-09-19T06:06:17.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.949+0000 7f0bc2800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bbc103c50 0x7f0bbc199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:17.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.949+0000 7f0bc2800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bbc104e50 0x7f0bbc19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:17.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.949+0000 7f0bc2800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bbc105810 0x7f0bbc1a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:17.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.949+0000 7f0bc2800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0bbc10f8d0 con 0x7f0bbc105810 2024-09-19T06:06:17.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.949+0000 7f0bc2800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0bbc10f750 con 0x7f0bbc104e50 2024-09-19T06:06:17.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.949+0000 7f0bc2800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0bbc10fa50 con 0x7f0bbc103c50 2024-09-19T06:06:17.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.949+0000 7f0bc0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bbc104e50 0x7f0bbc19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:17.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.949+0000 7f0bc1e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bbc105810 0x7f0bbc1a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:17.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.949+0000 7f0bc0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bbc104e50 0x7f0bbc19a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:51676/0 (socket says 172.21.15.3:51676) 2024-09-19T06:06:17.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.949+0000 7f0bc0a00640 1 -- 172.21.15.3:0/2674776030 learned_addr learned my addr 172.21.15.3:0/2674776030 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:06:17.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.949+0000 7f0bc1400640 1 --2- 172.21.15.3:0/2674776030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bbc103c50 0x7f0bbc199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:17.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.949+0000 7f0bc0a00640 1 -- 172.21.15.3:0/2674776030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bbc103c50 msgr2=0x7f0bbc199ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:17.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.949+0000 7f0bc0a00640 1 --2- 172.21.15.3:0/2674776030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bbc103c50 0x7f0bbc199ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:17.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.949+0000 7f0bc0a00640 1 -- 172.21.15.3:0/2674776030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bbc105810 msgr2=0x7f0bbc1a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:17.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.950+0000 7f0bc0a00640 1 --2- 172.21.15.3:0/2674776030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bbc105810 0x7f0bbc1a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:17.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.950+0000 7f0bc0a00640 1 -- 172.21.15.3:0/2674776030 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bbc1a1ad0 con 0x7f0bbc104e50 2024-09-19T06:06:17.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.950+0000 7f0bc0a00640 1 --2- 172.21.15.3:0/2674776030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bbc104e50 0x7f0bbc19a3e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800e9f0 tx=0x7f0ba800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:17.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.950+0000 7f0bba000640 1 -- 172.21.15.3:0/2674776030 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba800cd80 con 0x7f0bbc104e50 2024-09-19T06:06:17.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.950+0000 7f0bba000640 1 -- 172.21.15.3:0/2674776030 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ba8005500 con 0x7f0bbc104e50 2024-09-19T06:06:17.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.950+0000 7f0bba000640 1 -- 172.21.15.3:0/2674776030 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8010690 con 0x7f0bbc104e50 2024-09-19T06:06:17.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.950+0000 7f0bc2800640 1 -- 172.21.15.3:0/2674776030 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bbc1a1dc0 con 0x7f0bbc104e50 2024-09-19T06:06:17.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.950+0000 7f0bc2800640 1 -- 172.21.15.3:0/2674776030 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bbc1a2220 con 0x7f0bbc104e50 2024-09-19T06:06:17.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.951+0000 7f0bc2800640 1 -- 172.21.15.3:0/2674776030 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bbc10af80 con 0x7f0bbc104e50 2024-09-19T06:06:17.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.953+0000 7f0bba000640 1 -- 172.21.15.3:0/2674776030 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f0ba80046c0 con 0x7f0bbc104e50 2024-09-19T06:06:17.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.954+0000 7f0bba000640 1 --2- 172.21.15.3:0/2674776030 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0ba40a3270 0x7f0ba40a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:17.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.955+0000 7f0bba000640 1 -- 172.21.15.3:0/2674776030 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4562+0+0 (secure 0 0 0) 0x7f0ba80ceeb0 con 0x7f0bbc104e50 2024-09-19T06:06:17.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.955+0000 7f0bc1400640 1 --2- 172.21.15.3:0/2674776030 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0ba40a3270 0x7f0ba40a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:17.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.955+0000 7f0bc1400640 1 --2- 172.21.15.3:0/2674776030 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0ba40a3270 0x7f0ba40a5730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009530 tx=0x7f0bb0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:17.960 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:17.958+0000 7f0bba000640 1 -- 172.21.15.3:0/2674776030 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0ba809c9d0 con 0x7f0bbc104e50 2024-09-19T06:06:18.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:18.151+0000 7f0bc2800640 1 -- 172.21.15.3:0/2674776030 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f0bbc062630 con 0x7f0ba40a3270 2024-09-19T06:06:18.965 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:18 smithi003 ceph-mon[30893]: purged_snaps scrub starts 2024-09-19T06:06:18.965 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:18 smithi003 ceph-mon[30893]: purged_snaps scrub ok 2024-09-19T06:06:18.965 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:18 smithi003 ceph-mon[30893]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T06:06:18.965 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:18 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:06:18.965 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:18 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:06:18.965 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:18 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:18.969 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:18 smithi059 ceph-mon[35138]: purged_snaps scrub starts 2024-09-19T06:06:18.969 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:18 smithi059 ceph-mon[35138]: purged_snaps scrub ok 2024-09-19T06:06:18.969 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:18 smithi059 ceph-mon[35138]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T06:06:18.969 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:18 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:06:18.969 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:18 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:06:18.969 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:18 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:19.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:18 smithi071 ceph-mon[35662]: purged_snaps scrub starts 2024-09-19T06:06:19.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:18 smithi071 ceph-mon[35662]: purged_snaps scrub ok 2024-09-19T06:06:19.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:18 smithi071 ceph-mon[35662]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T06:06:19.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:18 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:06:19.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:18 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:06:19.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:18 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:19.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:19 smithi003 ceph-mon[30893]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:19.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:19 smithi003 ceph-mon[30893]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:19.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:19 smithi003 ceph-mon[30893]: osdmap e40: 6 total, 6 up, 6 in 2024-09-19T06:06:20.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:19 smithi059 ceph-mon[35138]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:20.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:19 smithi059 ceph-mon[35138]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:20.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:19 smithi059 ceph-mon[35138]: osdmap e40: 6 total, 6 up, 6 in 2024-09-19T06:06:20.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:19 smithi071 ceph-mon[35662]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:20.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:19 smithi071 ceph-mon[35662]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:20.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:19 smithi071 ceph-mon[35662]: osdmap e40: 6 total, 6 up, 6 in 2024-09-19T06:06:20.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:20 smithi003 ceph-mon[30893]: osdmap e41: 6 total, 6 up, 6 in 2024-09-19T06:06:21.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:20 smithi059 ceph-mon[35138]: osdmap e41: 6 total, 6 up, 6 in 2024-09-19T06:06:21.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:20 smithi071 ceph-mon[35662]: osdmap e41: 6 total, 6 up, 6 in 2024-09-19T06:06:22.025 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:21 smithi003 ceph-mon[30893]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:22.025 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:21 smithi003 ceph-mon[30893]: osdmap e42: 6 total, 6 up, 6 in 2024-09-19T06:06:22.025 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:21 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/611501659' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42a74f01-c5d0-4fc6-a8ee-a8bd84d4ab4c"}]: dispatch 2024-09-19T06:06:22.025 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:21 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/611501659' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "42a74f01-c5d0-4fc6-a8ee-a8bd84d4ab4c"}]': finished 2024-09-19T06:06:22.025 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:21 smithi003 ceph-mon[30893]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T06:06:22.025 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:21 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:06:22.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:21 smithi059 ceph-mon[35138]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:22.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:21 smithi059 ceph-mon[35138]: osdmap e42: 6 total, 6 up, 6 in 2024-09-19T06:06:22.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:21 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/611501659' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42a74f01-c5d0-4fc6-a8ee-a8bd84d4ab4c"}]: dispatch 2024-09-19T06:06:22.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:21 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/611501659' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "42a74f01-c5d0-4fc6-a8ee-a8bd84d4ab4c"}]': finished 2024-09-19T06:06:22.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:21 smithi059 ceph-mon[35138]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T06:06:22.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:21 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:06:22.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:21 smithi071 ceph-mon[35662]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:22.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:21 smithi071 ceph-mon[35662]: osdmap e42: 6 total, 6 up, 6 in 2024-09-19T06:06:22.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:21 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/611501659' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "42a74f01-c5d0-4fc6-a8ee-a8bd84d4ab4c"}]: dispatch 2024-09-19T06:06:22.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:21 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/611501659' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "42a74f01-c5d0-4fc6-a8ee-a8bd84d4ab4c"}]': finished 2024-09-19T06:06:22.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:21 smithi071 ceph-mon[35662]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T06:06:22.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:21 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:06:23.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:22 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/950496366' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:06:23.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:22 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/950496366' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:06:23.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:22 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/950496366' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:06:24.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:23 smithi059 ceph-mon[35138]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T06:06:24.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:23 smithi003 ceph-mon[30893]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T06:06:24.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:23 smithi071 ceph-mon[35662]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T06:06:26.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:25 smithi059 ceph-mon[35138]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-19T06:06:26.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:25 smithi003 ceph-mon[30893]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-19T06:06:26.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:25 smithi071 ceph-mon[35662]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-19T06:06:28.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:27 smithi059 ceph-mon[35138]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-19T06:06:28.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:27 smithi003 ceph-mon[30893]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-19T06:06:28.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:27 smithi071 ceph-mon[35662]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-19T06:06:29.915 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:29 smithi003 ceph-mon[30893]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:06:30.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:29 smithi059 ceph-mon[35138]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:06:30.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:29 smithi071 ceph-mon[35662]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:06:32.015 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:31 smithi003 ceph-mon[30893]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T06:06:32.015 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:31 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T06:06:32.015 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:31 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:32.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:31 smithi059 ceph-mon[35138]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T06:06:32.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:31 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T06:06:32.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:31 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:32.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:31 smithi071 ceph-mon[35662]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T06:06:32.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:31 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T06:06:32.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:31 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:32.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:32 smithi003 ceph-mon[30893]: Deploying daemon osd.6 on smithi003 2024-09-19T06:06:33.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:32 smithi059 ceph-mon[35138]: Deploying daemon osd.6 on smithi003 2024-09-19T06:06:33.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:32 smithi071 ceph-mon[35662]: Deploying daemon osd.6 on smithi003 2024-09-19T06:06:34.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:33 smithi059 ceph-mon[35138]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:34.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:33 smithi003 ceph-mon[30893]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:34.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:33 smithi071 ceph-mon[35662]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:36.033 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:35 smithi003 ceph-mon[30893]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:36.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:35 smithi059 ceph-mon[35138]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:36.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:35 smithi071 ceph-mon[35662]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:38.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:37 smithi059 ceph-mon[35138]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:38.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:37 smithi003 ceph-mon[30893]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:38.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:37 smithi071 ceph-mon[35662]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:40.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:39 smithi059 ceph-mon[35138]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:40.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:39 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:06:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:39 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:39 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:40.079 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:39 smithi003 ceph-mon[30893]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:40.079 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:39 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:06:40.079 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:39 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:40.079 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:39 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:40.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:39 smithi071 ceph-mon[35662]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:40.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:39 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:06:40.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:39 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:39 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:42.022 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:41 smithi003 ceph-mon[30893]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:42.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:41 smithi059 ceph-mon[35138]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:42.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:41 smithi071 ceph-mon[35662]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:43.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:43 smithi003 ceph-mon[30893]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:43.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:43 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:43.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:43 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:43.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:43 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:43.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:43 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:06:43.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:43 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:43.888 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:43 smithi071 ceph-mon[35662]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:43.888 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:43 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:43.888 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:43 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:43.888 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:43 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:43.888 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:43 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:06:43.888 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:43 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:43.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:43.939+0000 7f0bba000640 1 -- 172.21.15.3:0/2674776030 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0bbc062630 con 0x7f0ba40a3270 2024-09-19T06:06:43.940 INFO:teuthology.orchestra.run.smithi003.stdout:Created osd(s) 6 on host 'smithi003' 2024-09-19T06:06:43.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:43.941+0000 7f0bc2800640 1 -- 172.21.15.3:0/2674776030 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0ba40a3270 msgr2=0x7f0ba40a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:43.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:43.941+0000 7f0bc2800640 1 --2- 172.21.15.3:0/2674776030 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0ba40a3270 0x7f0ba40a5730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009530 tx=0x7f0bb0009260 comp rx=0 tx=0).stop 2024-09-19T06:06:43.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:43.941+0000 7f0bc2800640 1 -- 172.21.15.3:0/2674776030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bbc104e50 msgr2=0x7f0bbc19a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:43.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:43.941+0000 7f0bc2800640 1 --2- 172.21.15.3:0/2674776030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bbc104e50 0x7f0bbc19a3e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800e9f0 tx=0x7f0ba800edf0 comp rx=0 tx=0).stop 2024-09-19T06:06:43.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:43.941+0000 7f0bc2800640 1 -- 172.21.15.3:0/2674776030 shutdown_connections 2024-09-19T06:06:43.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:43.941+0000 7f0bc2800640 1 --2- 172.21.15.3:0/2674776030 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0ba40a3270 0x7f0ba40a5730 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:43.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:43.941+0000 7f0bc2800640 1 --2- 172.21.15.3:0/2674776030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bbc105810 0x7f0bbc1a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:43.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:43.941+0000 7f0bc2800640 1 --2- 172.21.15.3:0/2674776030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bbc104e50 0x7f0bbc19a3e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:43.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:43.941+0000 7f0bc2800640 1 --2- 172.21.15.3:0/2674776030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bbc103c50 0x7f0bbc199ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:43.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:43.941+0000 7f0bc2800640 1 -- 172.21.15.3:0/2674776030 >> 172.21.15.3:0/2674776030 conn(0x7f0bbc0ff3e0 msgr2=0x7f0bbc108150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:43.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:43.941+0000 7f0bc2800640 1 -- 172.21.15.3:0/2674776030 shutdown_connections 2024-09-19T06:06:43.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:06:43.941+0000 7f0bc2800640 1 -- 172.21.15.3:0/2674776030 wait complete. 2024-09-19T06:06:44.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:43 smithi059 ceph-mon[35138]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:44.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:43 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:44.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:43 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:44.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:43 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:44.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:43 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:06:44.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:43 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:44.886 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:44 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:06:44.887 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:44 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:44.887 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:44 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:44.889 DEBUG:teuthology.orchestra.run.smithi003:osd.6> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T06:06:44.896 INFO:tasks.cephadm:Deploying osd.7 on smithi059 with /dev/vg_nvme/lv_2... 2024-09-19T06:06:44.896 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T06:06:44.924 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:44 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:06:44.924 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:44 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:44.924 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:44 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:45.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:44 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:06:45.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:44 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:45.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:44 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:45.158 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:06:45.159 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:06:45 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:06:45.089+0000 7f4dd9443640 -1 osd.6 0 log_to_monitors true 2024-09-19T06:06:46.038 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:45 smithi003 ceph-mon[30893]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:46.038 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:45 smithi003 ceph-mon[30893]: from='osd.6 [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T06:06:46.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:45 smithi059 ceph-mon[35138]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:46.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:45 smithi059 ceph-mon[35138]: from='osd.6 [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T06:06:46.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:45 smithi071 ceph-mon[35662]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:46.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:45 smithi071 ceph-mon[35662]: from='osd.6 [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T06:06:47.191 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:46 smithi059 ceph-mon[35138]: from='osd.6 [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T06:06:47.191 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:46 smithi059 ceph-mon[35138]: osdmap e44: 7 total, 6 up, 7 in 2024-09-19T06:06:47.192 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:46 smithi059 ceph-mon[35138]: from='osd.6 [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]: dispatch 2024-09-19T06:06:47.192 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:46 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:06:47.192 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:46 smithi059 ceph-mon[35138]: from='osd.6 [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-19T06:06:47.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:46 smithi003 ceph-mon[30893]: from='osd.6 [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T06:06:47.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:46 smithi003 ceph-mon[30893]: osdmap e44: 7 total, 6 up, 7 in 2024-09-19T06:06:47.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:46 smithi003 ceph-mon[30893]: from='osd.6 [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]: dispatch 2024-09-19T06:06:47.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:46 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:06:47.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:46 smithi003 ceph-mon[30893]: from='osd.6 [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-19T06:06:47.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:46 smithi071 ceph-mon[35662]: from='osd.6 [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T06:06:47.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:46 smithi071 ceph-mon[35662]: osdmap e44: 7 total, 6 up, 7 in 2024-09-19T06:06:47.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:46 smithi071 ceph-mon[35662]: from='osd.6 [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]: dispatch 2024-09-19T06:06:47.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:46 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:06:47.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:46 smithi071 ceph-mon[35662]: from='osd.6 [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-19T06:06:47.834 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:06:47 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:06:47.455+0000 7f4dd3c00640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T06:06:47.835 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:06:47 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:06:47.487+0000 7f4dc9c00640 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:06:47.962 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-19T06:06:47.988 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi059:vg_nvme/lv_2 2024-09-19T06:06:48.280 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:06:48.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:47 smithi059 ceph-mon[35138]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:48.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:47 smithi059 ceph-mon[35138]: osdmap e45: 7 total, 6 up, 7 in 2024-09-19T06:06:48.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:47 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:06:48.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:47 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:06:48.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:47 smithi059 ceph-mon[35138]: from='osd.6 [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903]' entity='osd.6' 2024-09-19T06:06:48.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:47 smithi003 ceph-mon[30893]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:48.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:47 smithi003 ceph-mon[30893]: osdmap e45: 7 total, 6 up, 7 in 2024-09-19T06:06:48.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:47 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:06:48.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:47 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:06:48.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:47 smithi003 ceph-mon[30893]: from='osd.6 [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903]' entity='osd.6' 2024-09-19T06:06:48.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:47 smithi071 ceph-mon[35662]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:48.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:47 smithi071 ceph-mon[35662]: osdmap e45: 7 total, 6 up, 7 in 2024-09-19T06:06:48.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:47 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:06:48.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:47 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:06:48.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:47 smithi071 ceph-mon[35662]: from='osd.6 [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903]' entity='osd.6' 2024-09-19T06:06:48.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.778+0000 7fe022e17640 1 -- 172.21.15.59:0/2354268835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe01c101d10 msgr2=0x7fe01c102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:48.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.778+0000 7fe022e17640 1 --2- 172.21.15.59:0/2354268835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe01c101d10 0x7fe01c102190 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe008009900 tx=0x7fe00802a410 comp rx=0 tx=0).stop 2024-09-19T06:06:48.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.778+0000 7fe022e17640 1 -- 172.21.15.59:0/2354268835 shutdown_connections 2024-09-19T06:06:48.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.778+0000 7fe022e17640 1 --2- 172.21.15.59:0/2354268835 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe01c1026d0 0x7fe01c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:48.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.778+0000 7fe022e17640 1 --2- 172.21.15.59:0/2354268835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe01c101d10 0x7fe01c102190 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:48.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.778+0000 7fe022e17640 1 --2- 172.21.15.59:0/2354268835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe01c100b10 0x7fe01c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:48.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.778+0000 7fe022e17640 1 -- 172.21.15.59:0/2354268835 >> 172.21.15.59:0/2354268835 conn(0x7fe01c0fc2a0 msgr2=0x7fe01c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:06:48.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.778+0000 7fe022e17640 1 -- 172.21.15.59:0/2354268835 shutdown_connections 2024-09-19T06:06:48.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.779+0000 7fe022e17640 1 -- 172.21.15.59:0/2354268835 wait complete. 2024-09-19T06:06:48.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.779+0000 7fe022e17640 1 Processor -- start 2024-09-19T06:06:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.779+0000 7fe022e17640 1 -- start start 2024-09-19T06:06:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.779+0000 7fe022e17640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe01c100b10 0x7fe01c06b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.779+0000 7fe022e17640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe01c101d10 0x7fe01c19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.779+0000 7fe022e17640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe01c1026d0 0x7fe01c19f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.779+0000 7fe022e17640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe01c10c810 con 0x7fe01c101d10 2024-09-19T06:06:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.779+0000 7fe022e17640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe01c10c690 con 0x7fe01c100b10 2024-09-19T06:06:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.779+0000 7fe022e17640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe01c10c990 con 0x7fe01c1026d0 2024-09-19T06:06:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.779+0000 7fe020bb3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe01c100b10 0x7fe01c06b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.779+0000 7fe020bb3640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe01c100b10 0x7fe01c06b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:49578/0 (socket says 172.21.15.59:49578) 2024-09-19T06:06:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.779+0000 7fe020bb3640 1 -- 172.21.15.59:0/1104269093 learned_addr learned my addr 172.21.15.59:0/1104269093 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-19T06:06:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.780+0000 7fe020bb3640 1 -- 172.21.15.59:0/1104269093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe01c1026d0 msgr2=0x7fe01c19f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:48.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.780+0000 7fe020bb3640 1 --2- 172.21.15.59:0/1104269093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe01c1026d0 0x7fe01c19f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:48.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.780+0000 7fe020bb3640 1 -- 172.21.15.59:0/1104269093 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe01c101d10 msgr2=0x7fe01c19ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:06:48.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.780+0000 7fe020bb3640 1 --2- 172.21.15.59:0/1104269093 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe01c101d10 0x7fe01c19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:06:48.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.780+0000 7fe020bb3640 1 -- 172.21.15.59:0/1104269093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe01c19fc20 con 0x7fe01c100b10 2024-09-19T06:06:48.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.780+0000 7fe020bb3640 1 --2- 172.21.15.59:0/1104269093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe01c100b10 0x7fe01c06b2f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe01000d950 tx=0x7fe01000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:48.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.780+0000 7fe019ffb640 1 -- 172.21.15.59:0/1104269093 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe010017070 con 0x7fe01c100b10 2024-09-19T06:06:48.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.780+0000 7fe019ffb640 1 -- 172.21.15.59:0/1104269093 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe010009c30 con 0x7fe01c100b10 2024-09-19T06:06:48.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.780+0000 7fe022e17640 1 -- 172.21.15.59:0/1104269093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe01c19feb0 con 0x7fe01c100b10 2024-09-19T06:06:48.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.780+0000 7fe019ffb640 1 -- 172.21.15.59:0/1104269093 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01000f600 con 0x7fe01c100b10 2024-09-19T06:06:48.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.780+0000 7fe022e17640 1 -- 172.21.15.59:0/1104269093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe01c1a03c0 con 0x7fe01c100b10 2024-09-19T06:06:48.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.781+0000 7fe022e17640 1 -- 172.21.15.59:0/1104269093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe01c107f60 con 0x7fe01c100b10 2024-09-19T06:06:48.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.782+0000 7fe019ffb640 1 -- 172.21.15.59:0/1104269093 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fe01001a070 con 0x7fe01c100b10 2024-09-19T06:06:48.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.783+0000 7fe019ffb640 1 --2- 172.21.15.59:0/1104269093 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe00c0a3240 0x7fe00c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:06:48.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.783+0000 7fe019ffb640 1 -- 172.21.15.59:0/1104269093 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 4965+0+0 (secure 0 0 0) 0x7fe0100ce7e0 con 0x7fe01c100b10 2024-09-19T06:06:48.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.783+0000 7fe01bfff640 1 --2- 172.21.15.59:0/1104269093 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe00c0a3240 0x7fe00c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:06:48.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.784+0000 7fe01bfff640 1 --2- 172.21.15.59:0/1104269093 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe00c0a3240 0x7fe00c0a5700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe0080096c0 tx=0x7fe008031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:06:48.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.787+0000 7fe019ffb640 1 -- 172.21.15.59:0/1104269093 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe010009de0 con 0x7fe01c100b10 2024-09-19T06:06:48.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:06:48.972+0000 7fe022e17640 1 -- 172.21.15.59:0/1104269093 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe01c062630 con 0x7fe00c0a3240 2024-09-19T06:06:49.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:48 smithi059 ceph-mon[35138]: purged_snaps scrub starts 2024-09-19T06:06:49.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:48 smithi059 ceph-mon[35138]: purged_snaps scrub ok 2024-09-19T06:06:49.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:48 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:06:49.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:48 smithi059 ceph-mon[35138]: osd.6 [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903] boot 2024-09-19T06:06:49.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:48 smithi059 ceph-mon[35138]: osdmap e46: 7 total, 7 up, 7 in 2024-09-19T06:06:49.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:48 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:06:49.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:48 smithi003 ceph-mon[30893]: purged_snaps scrub starts 2024-09-19T06:06:49.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:48 smithi003 ceph-mon[30893]: purged_snaps scrub ok 2024-09-19T06:06:49.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:48 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:06:49.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:48 smithi003 ceph-mon[30893]: osd.6 [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903] boot 2024-09-19T06:06:49.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:48 smithi003 ceph-mon[30893]: osdmap e46: 7 total, 7 up, 7 in 2024-09-19T06:06:49.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:48 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:06:49.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:48 smithi071 ceph-mon[35662]: purged_snaps scrub starts 2024-09-19T06:06:49.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:48 smithi071 ceph-mon[35662]: purged_snaps scrub ok 2024-09-19T06:06:49.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:48 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:06:49.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:48 smithi071 ceph-mon[35662]: osd.6 [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903] boot 2024-09-19T06:06:49.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:48 smithi071 ceph-mon[35662]: osdmap e46: 7 total, 7 up, 7 in 2024-09-19T06:06:49.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:48 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:06:50.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:49 smithi059 ceph-mon[35138]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:50.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:49 smithi059 ceph-mon[35138]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:50.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:49 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:06:50.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:49 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:06:50.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:49 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:50.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:49 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:50.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:49 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:50.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:49 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:06:50.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:49 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:06:50.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:49 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:06:50.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:49 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:50.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:49 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:50.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:49 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:06:50.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:49 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:49 smithi003 ceph-mon[30893]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:49 smithi003 ceph-mon[30893]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:49 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:06:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:49 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:06:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:49 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:49 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:49 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:50.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:49 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:06:50.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:49 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:06:50.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:49 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:06:50.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:49 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:50.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:49 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:50.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:49 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:06:50.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:49 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:50.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:49 smithi071 ceph-mon[35662]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-09-19T06:06:50.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:49 smithi071 ceph-mon[35662]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:06:50.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:49 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:06:50.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:49 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:06:50.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:49 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:50.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:49 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:50.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:49 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:50.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:49 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:06:50.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:49 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:06:50.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:49 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:06:50.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:49 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:50.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:49 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:06:50.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:49 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:06:50.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:49 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:06:51.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:50 smithi059 ceph-mon[35138]: Detected new or changed devices on smithi003 2024-09-19T06:06:51.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:50 smithi059 ceph-mon[35138]: Adjusting osd_memory_target on smithi003 to 5698M 2024-09-19T06:06:51.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:50 smithi059 ceph-mon[35138]: osdmap e47: 7 total, 7 up, 7 in 2024-09-19T06:06:51.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:50 smithi003 ceph-mon[30893]: Detected new or changed devices on smithi003 2024-09-19T06:06:51.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:50 smithi003 ceph-mon[30893]: Adjusting osd_memory_target on smithi003 to 5698M 2024-09-19T06:06:51.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:50 smithi003 ceph-mon[30893]: osdmap e47: 7 total, 7 up, 7 in 2024-09-19T06:06:51.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:50 smithi071 ceph-mon[35662]: Detected new or changed devices on smithi003 2024-09-19T06:06:51.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:50 smithi071 ceph-mon[35662]: Adjusting osd_memory_target on smithi003 to 5698M 2024-09-19T06:06:51.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:50 smithi071 ceph-mon[35662]: osdmap e47: 7 total, 7 up, 7 in 2024-09-19T06:06:51.975 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:51 smithi059 ceph-mon[35138]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:06:51.975 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:51 smithi059 ceph-mon[35138]: from='client.? 172.21.15.59:0/3254017091' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8a9bc2ec-4292-465d-8a0d-dda78521a319"}]: dispatch 2024-09-19T06:06:51.975 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:51 smithi059 ceph-mon[35138]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8a9bc2ec-4292-465d-8a0d-dda78521a319"}]: dispatch 2024-09-19T06:06:51.975 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:51 smithi059 ceph-mon[35138]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8a9bc2ec-4292-465d-8a0d-dda78521a319"}]': finished 2024-09-19T06:06:51.975 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:51 smithi059 ceph-mon[35138]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T06:06:51.976 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:51 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:06:52.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:51 smithi003 ceph-mon[30893]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:06:52.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:51 smithi003 ceph-mon[30893]: from='client.? 172.21.15.59:0/3254017091' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8a9bc2ec-4292-465d-8a0d-dda78521a319"}]: dispatch 2024-09-19T06:06:52.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:51 smithi003 ceph-mon[30893]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8a9bc2ec-4292-465d-8a0d-dda78521a319"}]: dispatch 2024-09-19T06:06:52.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:51 smithi003 ceph-mon[30893]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8a9bc2ec-4292-465d-8a0d-dda78521a319"}]': finished 2024-09-19T06:06:52.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:51 smithi003 ceph-mon[30893]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T06:06:52.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:51 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:06:52.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:51 smithi071 ceph-mon[35662]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:06:52.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:51 smithi071 ceph-mon[35662]: from='client.? 172.21.15.59:0/3254017091' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8a9bc2ec-4292-465d-8a0d-dda78521a319"}]: dispatch 2024-09-19T06:06:52.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:51 smithi071 ceph-mon[35662]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8a9bc2ec-4292-465d-8a0d-dda78521a319"}]: dispatch 2024-09-19T06:06:52.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:51 smithi071 ceph-mon[35662]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8a9bc2ec-4292-465d-8a0d-dda78521a319"}]': finished 2024-09-19T06:06:52.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:51 smithi071 ceph-mon[35662]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T06:06:52.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:51 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:06:53.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:52 smithi059 ceph-mon[35138]: from='client.? 172.21.15.59:0/3046529237' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:06:53.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:52 smithi003 ceph-mon[30893]: from='client.? 172.21.15.59:0/3046529237' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:06:53.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:52 smithi071 ceph-mon[35662]: from='client.? 172.21.15.59:0/3046529237' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:06:54.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:53 smithi059 ceph-mon[35138]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:06:54.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:53 smithi003 ceph-mon[30893]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:06:54.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:53 smithi071 ceph-mon[35662]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:06:56.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:55 smithi059 ceph-mon[35138]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:06:56.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:55 smithi003 ceph-mon[30893]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:06:56.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:55 smithi071 ceph-mon[35662]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:06:58.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:57 smithi059 ceph-mon[35138]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:06:58.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:57 smithi003 ceph-mon[30893]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:06:58.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:57 smithi071 ceph-mon[35662]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:00.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:59 smithi059 ceph-mon[35138]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:00.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:59 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T06:07:00.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:06:59 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:00.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:59 smithi003 ceph-mon[30893]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:00.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:59 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T06:07:00.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:06:59 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:00.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:59 smithi071 ceph-mon[35662]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:00.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:59 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T06:07:00.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:06:59 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:01.216 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:00 smithi059 ceph-mon[35138]: Deploying daemon osd.7 on smithi059 2024-09-19T06:07:01.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:00 smithi003 ceph-mon[30893]: Deploying daemon osd.7 on smithi059 2024-09-19T06:07:01.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:00 smithi071 ceph-mon[35662]: Deploying daemon osd.7 on smithi059 2024-09-19T06:07:02.198 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:01 smithi059 ceph-mon[35138]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:02.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:01 smithi003 ceph-mon[30893]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:02.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:01 smithi071 ceph-mon[35662]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:04.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:04 smithi059 ceph-mon[35138]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:04.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:04 smithi003 ceph-mon[30893]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:04.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:04 smithi071 ceph-mon[35662]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:06.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:06 smithi059 ceph-mon[35138]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:06.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:06 smithi003 ceph-mon[30893]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:06.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:06 smithi071 ceph-mon[35662]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:07.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:07 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:07.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:07 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:07.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:07 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:07.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:07 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:07.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:07 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:07.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:07 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:07.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:07 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:07.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:07 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:07.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:07 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:08.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:08 smithi059 ceph-mon[35138]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:08.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:08 smithi003 ceph-mon[30893]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:08.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:08 smithi071 ceph-mon[35662]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:09.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:07:09.552+0000 7fe019ffb640 1 -- 172.21.15.59:0/1104269093 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe01c062630 con 0x7fe00c0a3240 2024-09-19T06:07:09.555 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 7 on host 'smithi059' 2024-09-19T06:07:09.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:07:09.555+0000 7fe022e17640 1 -- 172.21.15.59:0/1104269093 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe00c0a3240 msgr2=0x7fe00c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:09.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:07:09.555+0000 7fe022e17640 1 --2- 172.21.15.59:0/1104269093 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe00c0a3240 0x7fe00c0a5700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe0080096c0 tx=0x7fe008031400 comp rx=0 tx=0).stop 2024-09-19T06:07:09.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:07:09.555+0000 7fe022e17640 1 -- 172.21.15.59:0/1104269093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe01c100b10 msgr2=0x7fe01c06b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:09.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:07:09.555+0000 7fe022e17640 1 --2- 172.21.15.59:0/1104269093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe01c100b10 0x7fe01c06b2f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe01000d950 tx=0x7fe01000de10 comp rx=0 tx=0).stop 2024-09-19T06:07:09.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:07:09.555+0000 7fe022e17640 1 -- 172.21.15.59:0/1104269093 shutdown_connections 2024-09-19T06:07:09.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:07:09.555+0000 7fe022e17640 1 --2- 172.21.15.59:0/1104269093 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe00c0a3240 0x7fe00c0a5700 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:07:09.555+0000 7fe022e17640 1 --2- 172.21.15.59:0/1104269093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe01c1026d0 0x7fe01c19f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:07:09.555+0000 7fe022e17640 1 --2- 172.21.15.59:0/1104269093 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe01c101d10 0x7fe01c19ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:07:09.555+0000 7fe022e17640 1 --2- 172.21.15.59:0/1104269093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe01c100b10 0x7fe01c06b2f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:09.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:07:09.555+0000 7fe022e17640 1 -- 172.21.15.59:0/1104269093 >> 172.21.15.59:0/1104269093 conn(0x7fe01c0fc2a0 msgr2=0x7fe01c105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:09.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:07:09.555+0000 7fe022e17640 1 -- 172.21.15.59:0/1104269093 shutdown_connections 2024-09-19T06:07:09.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:07:09.555+0000 7fe022e17640 1 -- 172.21.15.59:0/1104269093 wait complete. 2024-09-19T06:07:10.276 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:10 smithi059 ceph-mon[35138]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:10.277 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:10 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:10.277 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:10 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:10.277 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:10 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:10.277 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:10 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:10.302 DEBUG:teuthology.orchestra.run.smithi059:osd.7> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T06:07:10.304 INFO:tasks.cephadm:Deploying osd.8 on smithi071 with /dev/vg_nvme/lv_2... 2024-09-19T06:07:10.304 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T06:07:10.332 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:10 smithi071 ceph-mon[35662]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:10.332 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:10 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:10.332 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:10 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:10.332 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:10 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:10.332 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:10 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:10.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:10 smithi003 ceph-mon[30893]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:10.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:10 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:10.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:10 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:10.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:10 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:10.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:10 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:10.561 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:07:11.788 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:07:11 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:07:11.577+0000 7fa812896640 -1 osd.7 0 log_to_monitors true 2024-09-19T06:07:12.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:12 smithi059 ceph-mon[35138]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:12.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:12 smithi059 ceph-mon[35138]: from='osd.7 [v2:172.21.15.59:6816/2133603853,v1:172.21.15.59:6817/2133603853]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:07:12.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:12 smithi059 ceph-mon[35138]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:07:12.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:12 smithi003 ceph-mon[30893]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:12.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:12 smithi003 ceph-mon[30893]: from='osd.7 [v2:172.21.15.59:6816/2133603853,v1:172.21.15.59:6817/2133603853]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:07:12.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:12 smithi003 ceph-mon[30893]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:07:12.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:12 smithi071 ceph-mon[35662]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:12.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:12 smithi071 ceph-mon[35662]: from='osd.7 [v2:172.21.15.59:6816/2133603853,v1:172.21.15.59:6817/2133603853]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:07:12.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:12 smithi071 ceph-mon[35662]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T06:07:13.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:13 smithi059 ceph-mon[35138]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T06:07:13.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:13 smithi059 ceph-mon[35138]: osdmap e49: 8 total, 7 up, 8 in 2024-09-19T06:07:13.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:13 smithi059 ceph-mon[35138]: from='osd.7 [v2:172.21.15.59:6816/2133603853,v1:172.21.15.59:6817/2133603853]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-19T06:07:13.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:13 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:07:13.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:13 smithi059 ceph-mon[35138]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-19T06:07:13.309 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:13 smithi071 ceph-mon[35662]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T06:07:13.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:13 smithi071 ceph-mon[35662]: osdmap e49: 8 total, 7 up, 8 in 2024-09-19T06:07:13.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:13 smithi071 ceph-mon[35662]: from='osd.7 [v2:172.21.15.59:6816/2133603853,v1:172.21.15.59:6817/2133603853]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-19T06:07:13.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:13 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:07:13.310 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:13 smithi071 ceph-mon[35662]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-19T06:07:13.313 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-19T06:07:13.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:13 smithi003 ceph-mon[30893]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T06:07:13.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:13 smithi003 ceph-mon[30893]: osdmap e49: 8 total, 7 up, 8 in 2024-09-19T06:07:13.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:13 smithi003 ceph-mon[30893]: from='osd.7 [v2:172.21.15.59:6816/2133603853,v1:172.21.15.59:6817/2133603853]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-19T06:07:13.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:13 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:07:13.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:13 smithi003 ceph-mon[30893]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-19T06:07:13.339 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_2 2024-09-19T06:07:13.629 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:07:13.788 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:07:13 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:07:13.450+0000 7fa80f02d640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T06:07:13.788 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:07:13 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:07:13.459+0000 7fa806639640 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:07:14.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.129+0000 7fd7f0d43640 1 -- 172.21.15.71:0/1554377766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7ec1026a0 msgr2=0x7fd7ec104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:14.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.129+0000 7fd7f0d43640 1 --2- 172.21.15.71:0/1554377766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7ec1026a0 0x7fd7ec104a90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009900 tx=0x7fd7e002a410 comp rx=0 tx=0).stop 2024-09-19T06:07:14.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.129+0000 7fd7f0d43640 1 -- 172.21.15.71:0/1554377766 shutdown_connections 2024-09-19T06:07:14.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.129+0000 7fd7f0d43640 1 --2- 172.21.15.71:0/1554377766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7ec107900 0x7fd7ec109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:14.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.129+0000 7fd7f0d43640 1 --2- 172.21.15.71:0/1554377766 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7ec104fd0 0x7fd7ec1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:14.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.129+0000 7fd7f0d43640 1 --2- 172.21.15.71:0/1554377766 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7ec1026a0 0x7fd7ec104a90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:14.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.129+0000 7fd7f0d43640 1 -- 172.21.15.71:0/1554377766 >> 172.21.15.71:0/1554377766 conn(0x7fd7ec0fc2a0 msgr2=0x7fd7ec0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:14.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.129+0000 7fd7f0d43640 1 -- 172.21.15.71:0/1554377766 shutdown_connections 2024-09-19T06:07:14.148 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.129+0000 7fd7f0d43640 1 -- 172.21.15.71:0/1554377766 wait complete. 2024-09-19T06:07:14.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.130+0000 7fd7f0d43640 1 Processor -- start 2024-09-19T06:07:14.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.130+0000 7fd7f0d43640 1 -- start start 2024-09-19T06:07:14.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.130+0000 7fd7f0d43640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7ec1026a0 0x7fd7ec19a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:14.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.130+0000 7fd7f0d43640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7ec104fd0 0x7fd7ec19a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:14.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.130+0000 7fd7f0d43640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7ec107900 0x7fd7ec1a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:14.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.130+0000 7fd7f0d43640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ec10d8b0 con 0x7fd7ec1026a0 2024-09-19T06:07:14.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.130+0000 7fd7f0d43640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ec10d730 con 0x7fd7ec104fd0 2024-09-19T06:07:14.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.130+0000 7fd7f0d43640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd7ec10da30 con 0x7fd7ec107900 2024-09-19T06:07:14.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.130+0000 7fd7ead9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7ec107900 0x7fd7ec1a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:14.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.130+0000 7fd7ead9d640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7ec107900 0x7fd7ec1a1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:41514/0 (socket says 172.21.15.71:41514) 2024-09-19T06:07:14.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.130+0000 7fd7ead9d640 1 -- 172.21.15.71:0/2534063609 learned_addr learned my addr 172.21.15.71:0/2534063609 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-19T06:07:14.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.130+0000 7fd7ea59c640 1 --2- 172.21.15.71:0/2534063609 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7ec1026a0 0x7fd7ec19a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:14.149 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.131+0000 7fd7e9d9b640 1 --2- 172.21.15.71:0/2534063609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7ec104fd0 0x7fd7ec19a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:14.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.131+0000 7fd7ead9d640 1 -- 172.21.15.71:0/2534063609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7ec104fd0 msgr2=0x7fd7ec19a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:14.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.131+0000 7fd7ead9d640 1 --2- 172.21.15.71:0/2534063609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7ec104fd0 0x7fd7ec19a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:14.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.131+0000 7fd7ead9d640 1 -- 172.21.15.71:0/2534063609 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7ec1026a0 msgr2=0x7fd7ec19a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:14.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.131+0000 7fd7ead9d640 1 --2- 172.21.15.71:0/2534063609 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7ec1026a0 0x7fd7ec19a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:14.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.131+0000 7fd7ead9d640 1 -- 172.21.15.71:0/2534063609 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7ec1a1db0 con 0x7fd7ec107900 2024-09-19T06:07:14.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.131+0000 7fd7e9d9b640 1 --2- 172.21.15.71:0/2534063609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7ec104fd0 0x7fd7ec19a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:07:14.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.131+0000 7fd7ea59c640 1 --2- 172.21.15.71:0/2534063609 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7ec1026a0 0x7fd7ec19a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:07:14.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.131+0000 7fd7ead9d640 1 --2- 172.21.15.71:0/2534063609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7ec107900 0x7fd7ec1a1740 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009fd0 tx=0x7fd7e400b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:14.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.131+0000 7fd7db7fe640 1 -- 172.21.15.71:0/2534063609 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4017070 con 0x7fd7ec107900 2024-09-19T06:07:14.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.131+0000 7fd7db7fe640 1 -- 172.21.15.71:0/2534063609 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7e4003e50 con 0x7fd7ec107900 2024-09-19T06:07:14.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.131+0000 7fd7db7fe640 1 -- 172.21.15.71:0/2534063609 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40106c0 con 0x7fd7ec107900 2024-09-19T06:07:14.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.131+0000 7fd7f0d43640 1 -- 172.21.15.71:0/2534063609 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7ec1a20a0 con 0x7fd7ec107900 2024-09-19T06:07:14.150 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.131+0000 7fd7f0d43640 1 -- 172.21.15.71:0/2534063609 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7ec1a2590 con 0x7fd7ec107900 2024-09-19T06:07:14.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.132+0000 7fd7f0d43640 1 -- 172.21.15.71:0/2534063609 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7ec109450 con 0x7fd7ec107900 2024-09-19T06:07:14.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.133+0000 7fd7db7fe640 1 -- 172.21.15.71:0/2534063609 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fd7e4003970 con 0x7fd7ec107900 2024-09-19T06:07:14.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.134+0000 7fd7db7fe640 1 --2- 172.21.15.71:0/2534063609 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd7d40a3270 0x7fd7d40a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:14.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.134+0000 7fd7db7fe640 1 -- 172.21.15.71:0/2534063609 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5430+0+0 (secure 0 0 0) 0x7fd7e40cebe0 con 0x7fd7ec107900 2024-09-19T06:07:14.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.134+0000 7fd7ea59c640 1 --2- 172.21.15.71:0/2534063609 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd7d40a3270 0x7fd7d40a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:14.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.135+0000 7fd7ea59c640 1 --2- 172.21.15.71:0/2534063609 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd7d40a3270 0x7fd7d40a5730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0000c00 tx=0x7fd7e00095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:14.151 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.138+0000 7fd7db7fe640 1 -- 172.21.15.71:0/2534063609 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd7e409c440 con 0x7fd7ec107900 2024-09-19T06:07:14.315 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:14.312+0000 7fd7f0d43640 1 -- 172.21.15.71:0/2534063609 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fd7ec062630 con 0x7fd7d40a3270 2024-09-19T06:07:14.315 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:14 smithi071 ceph-mon[35662]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:14.316 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:14 smithi071 ceph-mon[35662]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-19T06:07:14.316 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:14 smithi071 ceph-mon[35662]: osdmap e50: 8 total, 7 up, 8 in 2024-09-19T06:07:14.316 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:14 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:07:14.316 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:14 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:07:14.316 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:14 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:14.316 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:14 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:14.316 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:14 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:14.316 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:14 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:14.316 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:14 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:14.316 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:14 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:14.316 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:14 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:14.316 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:14 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:14.316 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:14 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:14.317 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:14 smithi071 ceph-mon[35662]: from='osd.7 ' entity='osd.7' 2024-09-19T06:07:14.317 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:14 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:14.317 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:14 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:14.317 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:14 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:14.317 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:14 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:14.317 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:14 smithi071 ceph-mon[35662]: osd.7 [v2:172.21.15.59:6816/2133603853,v1:172.21.15.59:6817/2133603853] boot 2024-09-19T06:07:14.317 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:14 smithi071 ceph-mon[35662]: osdmap e51: 8 total, 8 up, 8 in 2024-09-19T06:07:14.317 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:14 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:07:14.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:14 smithi003 ceph-mon[30893]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:14.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:14 smithi003 ceph-mon[30893]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-19T06:07:14.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:14 smithi003 ceph-mon[30893]: osdmap e50: 8 total, 7 up, 8 in 2024-09-19T06:07:14.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:14 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:07:14.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:14 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:07:14.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:14 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:14.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:14 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:14.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:14 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:14.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:14 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:14.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:14 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:14.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:14 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:14.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:14 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:14.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:14 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:14.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:14 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:14.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:14 smithi003 ceph-mon[30893]: from='osd.7 ' entity='osd.7' 2024-09-19T06:07:14.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:14 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:14.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:14 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:14.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:14 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:14.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:14 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:14.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:14 smithi003 ceph-mon[30893]: osd.7 [v2:172.21.15.59:6816/2133603853,v1:172.21.15.59:6817/2133603853] boot 2024-09-19T06:07:14.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:14 smithi003 ceph-mon[30893]: osdmap e51: 8 total, 8 up, 8 in 2024-09-19T06:07:14.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:14 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:07:14.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:14 smithi059 ceph-mon[35138]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-19T06:07:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:14 smithi059 ceph-mon[35138]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-19T06:07:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:14 smithi059 ceph-mon[35138]: osdmap e50: 8 total, 7 up, 8 in 2024-09-19T06:07:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:14 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:07:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:14 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:07:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:14 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:14 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:14 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:14 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:14 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:14 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:14 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:14 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:14.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:14 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:14.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:14 smithi059 ceph-mon[35138]: from='osd.7 ' entity='osd.7' 2024-09-19T06:07:14.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:14 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:14.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:14 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:14.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:14 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:14.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:14 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:14.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:14 smithi059 ceph-mon[35138]: osd.7 [v2:172.21.15.59:6816/2133603853,v1:172.21.15.59:6817/2133603853] boot 2024-09-19T06:07:14.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:14 smithi059 ceph-mon[35138]: osdmap e51: 8 total, 8 up, 8 in 2024-09-19T06:07:14.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:14 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:07:15.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:15 smithi003 ceph-mon[30893]: purged_snaps scrub starts 2024-09-19T06:07:15.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:15 smithi003 ceph-mon[30893]: purged_snaps scrub ok 2024-09-19T06:07:15.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:15 smithi003 ceph-mon[30893]: Detected new or changed devices on smithi059 2024-09-19T06:07:15.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:15 smithi003 ceph-mon[30893]: Adjusting osd_memory_target on smithi059 to 5697M 2024-09-19T06:07:15.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:15 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:07:15.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:15 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:07:15.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:15 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:15.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:15 smithi071 ceph-mon[35662]: purged_snaps scrub starts 2024-09-19T06:07:15.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:15 smithi071 ceph-mon[35662]: purged_snaps scrub ok 2024-09-19T06:07:15.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:15 smithi071 ceph-mon[35662]: Detected new or changed devices on smithi059 2024-09-19T06:07:15.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:15 smithi071 ceph-mon[35662]: Adjusting osd_memory_target on smithi059 to 5697M 2024-09-19T06:07:15.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:15 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:07:15.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:15 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:07:15.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:15 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:15.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:15 smithi059 ceph-mon[35138]: purged_snaps scrub starts 2024-09-19T06:07:15.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:15 smithi059 ceph-mon[35138]: purged_snaps scrub ok 2024-09-19T06:07:15.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:15 smithi059 ceph-mon[35138]: Detected new or changed devices on smithi059 2024-09-19T06:07:15.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:15 smithi059 ceph-mon[35138]: Adjusting osd_memory_target on smithi059 to 5697M 2024-09-19T06:07:15.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:15 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:07:15.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:15 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:07:15.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:15 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:16.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:16 smithi003 ceph-mon[30893]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:16.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:16 smithi003 ceph-mon[30893]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:16.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:16 smithi003 ceph-mon[30893]: osdmap e52: 8 total, 8 up, 8 in 2024-09-19T06:07:16.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:16 smithi071 ceph-mon[35662]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:16.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:16 smithi071 ceph-mon[35662]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:16.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:16 smithi071 ceph-mon[35662]: osdmap e52: 8 total, 8 up, 8 in 2024-09-19T06:07:16.440 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:16 smithi059 ceph-mon[35138]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:16.440 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:16 smithi059 ceph-mon[35138]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:16.440 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:16 smithi059 ceph-mon[35138]: osdmap e52: 8 total, 8 up, 8 in 2024-09-19T06:07:17.305 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:17 smithi071 ceph-mon[35662]: osdmap e53: 8 total, 8 up, 8 in 2024-09-19T06:07:17.306 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:17 smithi071 ceph-mon[35662]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:17.306 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:17 smithi071 ceph-mon[35662]: osdmap e54: 8 total, 8 up, 8 in 2024-09-19T06:07:17.306 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:17 smithi071 ceph-mon[35662]: from='client.? 172.21.15.71:0/3548472307' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6099a5c4-3504-43ca-8c58-d23f9096cd7b"}]: dispatch 2024-09-19T06:07:17.306 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:17 smithi071 ceph-mon[35662]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6099a5c4-3504-43ca-8c58-d23f9096cd7b"}]: dispatch 2024-09-19T06:07:17.306 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:17 smithi071 ceph-mon[35662]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6099a5c4-3504-43ca-8c58-d23f9096cd7b"}]': finished 2024-09-19T06:07:17.306 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:17 smithi071 ceph-mon[35662]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T06:07:17.306 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:17 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:07:17.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:17 smithi059 ceph-mon[35138]: osdmap e53: 8 total, 8 up, 8 in 2024-09-19T06:07:17.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:17 smithi059 ceph-mon[35138]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:17.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:17 smithi059 ceph-mon[35138]: osdmap e54: 8 total, 8 up, 8 in 2024-09-19T06:07:17.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:17 smithi059 ceph-mon[35138]: from='client.? 172.21.15.71:0/3548472307' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6099a5c4-3504-43ca-8c58-d23f9096cd7b"}]: dispatch 2024-09-19T06:07:17.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:17 smithi059 ceph-mon[35138]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6099a5c4-3504-43ca-8c58-d23f9096cd7b"}]: dispatch 2024-09-19T06:07:17.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:17 smithi059 ceph-mon[35138]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6099a5c4-3504-43ca-8c58-d23f9096cd7b"}]': finished 2024-09-19T06:07:17.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:17 smithi059 ceph-mon[35138]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T06:07:17.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:17 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:07:17.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:17 smithi003 ceph-mon[30893]: osdmap e53: 8 total, 8 up, 8 in 2024-09-19T06:07:17.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:17 smithi003 ceph-mon[30893]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:17.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:17 smithi003 ceph-mon[30893]: osdmap e54: 8 total, 8 up, 8 in 2024-09-19T06:07:17.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:17 smithi003 ceph-mon[30893]: from='client.? 172.21.15.71:0/3548472307' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6099a5c4-3504-43ca-8c58-d23f9096cd7b"}]: dispatch 2024-09-19T06:07:17.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:17 smithi003 ceph-mon[30893]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6099a5c4-3504-43ca-8c58-d23f9096cd7b"}]: dispatch 2024-09-19T06:07:17.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:17 smithi003 ceph-mon[30893]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6099a5c4-3504-43ca-8c58-d23f9096cd7b"}]': finished 2024-09-19T06:07:17.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:17 smithi003 ceph-mon[30893]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T06:07:17.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:17 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:07:18.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:18 smithi059 ceph-mon[35138]: from='client.? 172.21.15.71:0/206694106' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:07:18.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:18 smithi003 ceph-mon[30893]: from='client.? 172.21.15.71:0/206694106' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:07:18.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:18 smithi071 ceph-mon[35662]: from='client.? 172.21.15.71:0/206694106' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:07:19.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:19 smithi059 ceph-mon[35138]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:19.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:19 smithi003 ceph-mon[30893]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:19.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:19 smithi071 ceph-mon[35662]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:21.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:21 smithi059 ceph-mon[35138]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:21.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:21 smithi003 ceph-mon[30893]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:21.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:21 smithi071 ceph-mon[35662]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:23.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:23 smithi071 ceph-mon[35662]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:23.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:23 smithi059 ceph-mon[35138]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:23.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:23 smithi003 ceph-mon[30893]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:25.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:25 smithi071 ceph-mon[35662]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:25.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:25 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T06:07:25.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:25 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:25.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:25 smithi059 ceph-mon[35138]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:25.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:25 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T06:07:25.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:25 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:25.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:25 smithi003 ceph-mon[30893]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:25.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:25 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T06:07:25.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:25 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:26.486 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:26 smithi003 ceph-mon[30893]: Deploying daemon osd.8 on smithi071 2024-09-19T06:07:26.498 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:26 smithi071 ceph-mon[35662]: Deploying daemon osd.8 on smithi071 2024-09-19T06:07:26.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:26 smithi059 ceph-mon[35138]: Deploying daemon osd.8 on smithi071 2024-09-19T06:07:27.397 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:27 smithi071 ceph-mon[35662]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:27.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:27 smithi059 ceph-mon[35138]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:27.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:27 smithi003 ceph-mon[30893]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:29.526 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:29 smithi071 ceph-mon[35662]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:29.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:29 smithi059 ceph-mon[35138]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:29.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:29 smithi003 ceph-mon[30893]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:31.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:31 smithi059 ceph-mon[35138]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:31.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:31 smithi003 ceph-mon[30893]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:31.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:31 smithi071 ceph-mon[35662]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:32.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:32 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:32.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:32 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:32.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:32 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:32.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:32 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:32.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:32 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:32.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:32 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:32.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:32 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:32.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:32 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:32.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:32 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:33.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:33 smithi071 ceph-mon[35662]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:33.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:33 smithi059 ceph-mon[35138]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:33.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:33 smithi003 ceph-mon[30893]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:34.600 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:34.598+0000 7fd7db7fe640 1 -- 172.21.15.71:0/2534063609 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd7ec062630 con 0x7fd7d40a3270 2024-09-19T06:07:34.601 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 8 on host 'smithi071' 2024-09-19T06:07:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:34.600+0000 7fd7f0d43640 1 -- 172.21.15.71:0/2534063609 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd7d40a3270 msgr2=0x7fd7d40a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:34.600+0000 7fd7f0d43640 1 --2- 172.21.15.71:0/2534063609 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd7d40a3270 0x7fd7d40a5730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0000c00 tx=0x7fd7e00095f0 comp rx=0 tx=0).stop 2024-09-19T06:07:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:34.600+0000 7fd7f0d43640 1 -- 172.21.15.71:0/2534063609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7ec107900 msgr2=0x7fd7ec1a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:34.600+0000 7fd7f0d43640 1 --2- 172.21.15.71:0/2534063609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7ec107900 0x7fd7ec1a1740 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009fd0 tx=0x7fd7e400b260 comp rx=0 tx=0).stop 2024-09-19T06:07:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:34.600+0000 7fd7f0d43640 1 -- 172.21.15.71:0/2534063609 shutdown_connections 2024-09-19T06:07:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:34.600+0000 7fd7f0d43640 1 --2- 172.21.15.71:0/2534063609 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd7d40a3270 0x7fd7d40a5730 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:34.600+0000 7fd7f0d43640 1 --2- 172.21.15.71:0/2534063609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7ec107900 0x7fd7ec1a1740 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:34.600+0000 7fd7f0d43640 1 --2- 172.21.15.71:0/2534063609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7ec104fd0 0x7fd7ec19a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:34.600+0000 7fd7f0d43640 1 --2- 172.21.15.71:0/2534063609 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7ec1026a0 0x7fd7ec19a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:34.603 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:34.600+0000 7fd7f0d43640 1 -- 172.21.15.71:0/2534063609 >> 172.21.15.71:0/2534063609 conn(0x7fd7ec0fc2a0 msgr2=0x7fd7ec101d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:34.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:34.600+0000 7fd7f0d43640 1 -- 172.21.15.71:0/2534063609 shutdown_connections 2024-09-19T06:07:34.604 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:07:34.600+0000 7fd7f0d43640 1 -- 172.21.15.71:0/2534063609 wait complete. 2024-09-19T06:07:35.306 DEBUG:teuthology.orchestra.run.smithi071:osd.8> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T06:07:35.309 INFO:tasks.cephadm:Deploying osd.9 on smithi003 with /dev/vg_nvme/lv_1... 2024-09-19T06:07:35.309 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T06:07:35.698 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:35.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:35 smithi003 ceph-mon[30893]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:35.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:35 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:35.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:35 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:35.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:35 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:35.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:35 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:35.898 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:35 smithi071 ceph-mon[35662]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:35.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:35 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:35.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:35 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:35.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:35 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:35.899 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:35 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:36.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:35 smithi059 ceph-mon[35138]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:36.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:35 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:36.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:35 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:36.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:35 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:36.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:35 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:37.336 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:07:37 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:07:37.018+0000 7f7d9aae9640 -1 osd.8 0 log_to_monitors true 2024-09-19T06:07:37.737 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:37 smithi003 ceph-mon[30893]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:37.737 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:37 smithi003 ceph-mon[30893]: from='osd.8 [v2:172.21.15.71:6816/905333117,v1:172.21.15.71:6817/905333117]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:07:37.738 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:37 smithi003 ceph-mon[30893]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:07:38.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:37 smithi059 ceph-mon[35138]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:38.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:37 smithi059 ceph-mon[35138]: from='osd.8 [v2:172.21.15.71:6816/905333117,v1:172.21.15.71:6817/905333117]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:07:38.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:37 smithi059 ceph-mon[35138]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:07:38.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:37 smithi071 ceph-mon[35662]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:38.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:37 smithi071 ceph-mon[35662]: from='osd.8 [v2:172.21.15.71:6816/905333117,v1:172.21.15.71:6817/905333117]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:07:38.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:37 smithi071 ceph-mon[35662]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T06:07:38.725 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:38 smithi003 ceph-mon[30893]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T06:07:38.725 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:38 smithi003 ceph-mon[30893]: osdmap e56: 9 total, 8 up, 9 in 2024-09-19T06:07:38.725 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:38 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:07:38.725 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:38 smithi003 ceph-mon[30893]: from='osd.8 [v2:172.21.15.71:6816/905333117,v1:172.21.15.71:6817/905333117]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-19T06:07:38.725 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:38 smithi003 ceph-mon[30893]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-19T06:07:38.725 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:38 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:38.725 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:38 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:38.725 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:38 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:38.725 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:38 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:38.725 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:38 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:38.726 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:38 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:38.726 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:38 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:38.726 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:38 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:38.726 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:38 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:38.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:38 smithi071 ceph-mon[35662]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T06:07:38.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:38 smithi071 ceph-mon[35662]: osdmap e56: 9 total, 8 up, 9 in 2024-09-19T06:07:38.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:38 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:07:38.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:38 smithi071 ceph-mon[35662]: from='osd.8 [v2:172.21.15.71:6816/905333117,v1:172.21.15.71:6817/905333117]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-19T06:07:38.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:38 smithi071 ceph-mon[35662]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-19T06:07:38.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:38 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:38.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:38 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:38.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:38 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:38.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:38 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:38.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:38 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:38.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:38 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:38.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:38 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:38.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:38 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:38.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:38 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:39.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:38 smithi059 ceph-mon[35138]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T06:07:39.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:38 smithi059 ceph-mon[35138]: osdmap e56: 9 total, 8 up, 9 in 2024-09-19T06:07:39.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:38 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:07:39.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:38 smithi059 ceph-mon[35138]: from='osd.8 [v2:172.21.15.71:6816/905333117,v1:172.21.15.71:6817/905333117]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-19T06:07:39.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:38 smithi059 ceph-mon[35138]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-19T06:07:39.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:38 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:39.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:38 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:39.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:38 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:39.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:38 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:39.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:38 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:07:39.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:38 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:39.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:38 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:39.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:38 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:39.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:38 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:39.225 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:07:39.258 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi003:vg_nvme/lv_1 2024-09-19T06:07:39.336 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:07:38 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:07:38.987+0000 7f7d96a6c640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T06:07:39.336 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:07:39 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:07:38.998+0000 7f7d8e88c640 -1 osd.8 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:07:39.647 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:07:39.930 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:39 smithi003 ceph-mon[30893]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:39.931 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:39 smithi003 ceph-mon[30893]: Detected new or changed devices on smithi071 2024-09-19T06:07:39.931 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:39 smithi003 ceph-mon[30893]: Adjusting osd_memory_target on smithi071 to 5696M 2024-09-19T06:07:39.931 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:39 smithi003 ceph-mon[30893]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-19T06:07:39.931 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:39 smithi003 ceph-mon[30893]: osdmap e57: 9 total, 8 up, 9 in 2024-09-19T06:07:39.931 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:39 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:07:39.931 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:39 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:07:39.931 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:39 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:39.931 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:39 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:39.931 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:39 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:39.931 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:39 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:39.931 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:39 smithi003 ceph-mon[30893]: from='osd.8 ' entity='osd.8' 2024-09-19T06:07:40.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:39 smithi059 ceph-mon[35138]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:39 smithi059 ceph-mon[35138]: Detected new or changed devices on smithi071 2024-09-19T06:07:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:39 smithi059 ceph-mon[35138]: Adjusting osd_memory_target on smithi071 to 5696M 2024-09-19T06:07:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:39 smithi059 ceph-mon[35138]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-19T06:07:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:39 smithi059 ceph-mon[35138]: osdmap e57: 9 total, 8 up, 9 in 2024-09-19T06:07:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:39 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:07:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:39 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:07:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:39 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:39 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:39 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:39 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:39 smithi059 ceph-mon[35138]: from='osd.8 ' entity='osd.8' 2024-09-19T06:07:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:39 smithi071 ceph-mon[35662]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:39 smithi071 ceph-mon[35662]: Detected new or changed devices on smithi071 2024-09-19T06:07:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:39 smithi071 ceph-mon[35662]: Adjusting osd_memory_target on smithi071 to 5696M 2024-09-19T06:07:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:39 smithi071 ceph-mon[35662]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-19T06:07:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:39 smithi071 ceph-mon[35662]: osdmap e57: 9 total, 8 up, 9 in 2024-09-19T06:07:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:39 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:07:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:39 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:07:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:39 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:07:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:39 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:39 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:07:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:39 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:07:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:39 smithi071 ceph-mon[35662]: from='osd.8 ' entity='osd.8' 2024-09-19T06:07:40.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.270+0000 7fbdf0a00640 1 -- 172.21.15.3:0/2875090225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdec102e00 msgr2=0x7fbdec103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:40.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.270+0000 7fbdf0a00640 1 --2- 172.21.15.3:0/2875090225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdec102e00 0x7fbdec103280 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4009900 tx=0x7fbdd402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:07:40.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.270+0000 7fbdf0a00640 1 -- 172.21.15.3:0/2875090225 shutdown_connections 2024-09-19T06:07:40.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.270+0000 7fbdf0a00640 1 --2- 172.21.15.3:0/2875090225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdec1037c0 0x7fbdec10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:40.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.270+0000 7fbdf0a00640 1 --2- 172.21.15.3:0/2875090225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdec102e00 0x7fbdec103280 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:40.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.270+0000 7fbdf0a00640 1 --2- 172.21.15.3:0/2875090225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdec101c00 0x7fbdec102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:40.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.270+0000 7fbdf0a00640 1 -- 172.21.15.3:0/2875090225 >> 172.21.15.3:0/2875090225 conn(0x7fbdec0fd390 msgr2=0x7fbdec0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:07:40.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.270+0000 7fbdf0a00640 1 -- 172.21.15.3:0/2875090225 shutdown_connections 2024-09-19T06:07:40.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.270+0000 7fbdf0a00640 1 -- 172.21.15.3:0/2875090225 wait complete. 2024-09-19T06:07:40.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.271+0000 7fbdf0a00640 1 Processor -- start 2024-09-19T06:07:40.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.271+0000 7fbdf0a00640 1 -- start start 2024-09-19T06:07:40.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.271+0000 7fbdf0a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdec101c00 0x7fbdec197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:40.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.271+0000 7fbdf0a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdec102e00 0x7fbdec198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:40.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.271+0000 7fbdf0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdec1037c0 0x7fbdec19f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:40.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.271+0000 7fbdf0a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbdec10d880 con 0x7fbdec101c00 2024-09-19T06:07:40.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.271+0000 7fbdf0a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbdec10d700 con 0x7fbdec1037c0 2024-09-19T06:07:40.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.271+0000 7fbdf0a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbdec10da00 con 0x7fbdec102e00 2024-09-19T06:07:40.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.272+0000 7fbde9e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdec101c00 0x7fbdec197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:40.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.272+0000 7fbde9e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdec101c00 0x7fbdec197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54160/0 (socket says 172.21.15.3:54160) 2024-09-19T06:07:40.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.272+0000 7fbde9e00640 1 -- 172.21.15.3:0/3198155136 learned_addr learned my addr 172.21.15.3:0/3198155136 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:07:40.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.272+0000 7fbde3e00640 1 --2- 172.21.15.3:0/3198155136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdec102e00 0x7fbdec198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:40.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.272+0000 7fbdea800640 1 --2- 172.21.15.3:0/3198155136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdec1037c0 0x7fbdec19f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:40.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.272+0000 7fbde9e00640 1 -- 172.21.15.3:0/3198155136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdec102e00 msgr2=0x7fbdec198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:40.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.272+0000 7fbde9e00640 1 --2- 172.21.15.3:0/3198155136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdec102e00 0x7fbdec198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:40.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.272+0000 7fbde9e00640 1 -- 172.21.15.3:0/3198155136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdec1037c0 msgr2=0x7fbdec19f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:07:40.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.272+0000 7fbde9e00640 1 --2- 172.21.15.3:0/3198155136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdec1037c0 0x7fbdec19f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:07:40.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.272+0000 7fbde9e00640 1 -- 172.21.15.3:0/3198155136 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdec19fb30 con 0x7fbdec101c00 2024-09-19T06:07:40.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.273+0000 7fbde9e00640 1 --2- 172.21.15.3:0/3198155136 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdec101c00 0x7fbdec197f00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbddc00e9c0 tx=0x7fbddc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:40.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.273+0000 7fbde2a00640 1 -- 172.21.15.3:0/3198155136 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc00cd80 con 0x7fbdec101c00 2024-09-19T06:07:40.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.273+0000 7fbdf0a00640 1 -- 172.21.15.3:0/3198155136 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdec19fe20 con 0x7fbdec101c00 2024-09-19T06:07:40.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.273+0000 7fbde2a00640 1 -- 172.21.15.3:0/3198155136 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbddc0035f0 con 0x7fbdec101c00 2024-09-19T06:07:40.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.273+0000 7fbde2a00640 1 -- 172.21.15.3:0/3198155136 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbddc010690 con 0x7fbdec101c00 2024-09-19T06:07:40.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.273+0000 7fbdf0a00640 1 -- 172.21.15.3:0/3198155136 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdec1a0220 con 0x7fbdec101c00 2024-09-19T06:07:40.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.274+0000 7fbdf0a00640 1 -- 172.21.15.3:0/3198155136 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdec108fa0 con 0x7fbdec101c00 2024-09-19T06:07:40.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.276+0000 7fbde2a00640 1 -- 172.21.15.3:0/3198155136 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fbddc0037a0 con 0x7fbdec101c00 2024-09-19T06:07:40.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.277+0000 7fbde2a00640 1 --2- 172.21.15.3:0/3198155136 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fbdd00a3270 0x7fbdd00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:07:40.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.277+0000 7fbde2a00640 1 -- 172.21.15.3:0/3198155136 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5862+0+0 (secure 0 0 0) 0x7fbddc0cf350 con 0x7fbdec101c00 2024-09-19T06:07:40.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.278+0000 7fbde3e00640 1 --2- 172.21.15.3:0/3198155136 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fbdd00a3270 0x7fbdd00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:07:40.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.278+0000 7fbde3e00640 1 --2- 172.21.15.3:0/3198155136 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fbdd00a3270 0x7fbdd00a5730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40314e0 tx=0x7fbdd4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:07:40.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.282+0000 7fbde2a00640 1 -- 172.21.15.3:0/3198155136 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbddc09c960 con 0x7fbdec101c00 2024-09-19T06:07:40.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:07:40.475+0000 7fbdf0a00640 1 -- 172.21.15.3:0/3198155136 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fbdec062630 con 0x7fbdd00a3270 2024-09-19T06:07:41.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:40 smithi059 ceph-mon[35138]: purged_snaps scrub starts 2024-09-19T06:07:41.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:40 smithi059 ceph-mon[35138]: purged_snaps scrub ok 2024-09-19T06:07:41.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:40 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:07:41.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:40 smithi059 ceph-mon[35138]: osd.8 [v2:172.21.15.71:6816/905333117,v1:172.21.15.71:6817/905333117] boot 2024-09-19T06:07:41.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:40 smithi059 ceph-mon[35138]: osdmap e58: 9 total, 9 up, 9 in 2024-09-19T06:07:41.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:40 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:07:41.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:40 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:07:41.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:40 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:07:41.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:40 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:41.075 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:40 smithi003 ceph-mon[30893]: purged_snaps scrub starts 2024-09-19T06:07:41.075 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:40 smithi003 ceph-mon[30893]: purged_snaps scrub ok 2024-09-19T06:07:41.075 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:40 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:07:41.075 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:40 smithi003 ceph-mon[30893]: osd.8 [v2:172.21.15.71:6816/905333117,v1:172.21.15.71:6817/905333117] boot 2024-09-19T06:07:41.075 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:40 smithi003 ceph-mon[30893]: osdmap e58: 9 total, 9 up, 9 in 2024-09-19T06:07:41.075 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:40 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:07:41.075 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:40 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:07:41.075 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:40 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:07:41.075 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:40 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:41.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:40 smithi071 ceph-mon[35662]: purged_snaps scrub starts 2024-09-19T06:07:41.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:40 smithi071 ceph-mon[35662]: purged_snaps scrub ok 2024-09-19T06:07:41.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:40 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:07:41.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:40 smithi071 ceph-mon[35662]: osd.8 [v2:172.21.15.71:6816/905333117,v1:172.21.15.71:6817/905333117] boot 2024-09-19T06:07:41.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:40 smithi071 ceph-mon[35662]: osdmap e58: 9 total, 9 up, 9 in 2024-09-19T06:07:41.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:40 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:07:41.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:40 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:07:41.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:40 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:07:41.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:40 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:41.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:41 smithi003 ceph-mon[30893]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:41.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:41 smithi003 ceph-mon[30893]: from='client.14343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:41.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:41 smithi003 ceph-mon[30893]: osdmap e59: 9 total, 9 up, 9 in 2024-09-19T06:07:42.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:41 smithi059 ceph-mon[35138]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:42.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:41 smithi059 ceph-mon[35138]: from='client.14343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:42.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:41 smithi059 ceph-mon[35138]: osdmap e59: 9 total, 9 up, 9 in 2024-09-19T06:07:42.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:41 smithi071 ceph-mon[35662]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-19T06:07:42.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:41 smithi071 ceph-mon[35662]: from='client.14343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:07:42.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:41 smithi071 ceph-mon[35662]: osdmap e59: 9 total, 9 up, 9 in 2024-09-19T06:07:42.664 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:42 smithi003 ceph-mon[30893]: osdmap e60: 9 total, 9 up, 9 in 2024-09-19T06:07:42.665 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:42 smithi003 ceph-mon[30893]: osdmap e61: 9 total, 9 up, 9 in 2024-09-19T06:07:43.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:42 smithi059 ceph-mon[35138]: osdmap e60: 9 total, 9 up, 9 in 2024-09-19T06:07:43.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:42 smithi059 ceph-mon[35138]: osdmap e61: 9 total, 9 up, 9 in 2024-09-19T06:07:43.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:42 smithi071 ceph-mon[35662]: osdmap e60: 9 total, 9 up, 9 in 2024-09-19T06:07:43.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:42 smithi071 ceph-mon[35662]: osdmap e61: 9 total, 9 up, 9 in 2024-09-19T06:07:43.987 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:43 smithi071 ceph-mon[35662]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:07:43.987 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:43 smithi071 ceph-mon[35662]: osdmap e62: 9 total, 9 up, 9 in 2024-09-19T06:07:44.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:43 smithi059 ceph-mon[35138]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:07:44.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:43 smithi059 ceph-mon[35138]: osdmap e62: 9 total, 9 up, 9 in 2024-09-19T06:07:44.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:43 smithi003 ceph-mon[30893]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:07:44.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:43 smithi003 ceph-mon[30893]: osdmap e62: 9 total, 9 up, 9 in 2024-09-19T06:07:45.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:44 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2108884325' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5a8aac6-bb10-4db8-a056-25228fbe754c"}]: dispatch 2024-09-19T06:07:45.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:44 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2108884325' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5a8aac6-bb10-4db8-a056-25228fbe754c"}]': finished 2024-09-19T06:07:45.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:44 smithi059 ceph-mon[35138]: osdmap e63: 10 total, 9 up, 10 in 2024-09-19T06:07:45.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:44 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:07:45.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:44 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/3358349348' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:07:45.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:44 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2108884325' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5a8aac6-bb10-4db8-a056-25228fbe754c"}]: dispatch 2024-09-19T06:07:45.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:44 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2108884325' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5a8aac6-bb10-4db8-a056-25228fbe754c"}]': finished 2024-09-19T06:07:45.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:44 smithi003 ceph-mon[30893]: osdmap e63: 10 total, 9 up, 10 in 2024-09-19T06:07:45.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:44 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:07:45.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:44 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3358349348' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:07:45.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:44 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2108884325' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5a8aac6-bb10-4db8-a056-25228fbe754c"}]: dispatch 2024-09-19T06:07:45.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:44 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2108884325' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5a8aac6-bb10-4db8-a056-25228fbe754c"}]': finished 2024-09-19T06:07:45.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:44 smithi071 ceph-mon[35662]: osdmap e63: 10 total, 9 up, 10 in 2024-09-19T06:07:45.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:44 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:07:45.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:44 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/3358349348' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:07:46.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:45 smithi059 ceph-mon[35138]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 166 KiB/s, 0 objects/s recovering 2024-09-19T06:07:46.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:45 smithi003 ceph-mon[30893]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 166 KiB/s, 0 objects/s recovering 2024-09-19T06:07:46.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:45 smithi071 ceph-mon[35662]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 166 KiB/s, 0 objects/s recovering 2024-09-19T06:07:48.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:47 smithi003 ceph-mon[30893]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-09-19T06:07:48.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:47 smithi071 ceph-mon[35662]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-09-19T06:07:48.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:47 smithi059 ceph-mon[35138]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-09-19T06:07:50.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:49 smithi003 ceph-mon[30893]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-19T06:07:50.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:49 smithi071 ceph-mon[35662]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-19T06:07:50.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:49 smithi059 ceph-mon[35138]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-19T06:07:52.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:51 smithi003 ceph-mon[30893]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:07:52.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:51 smithi071 ceph-mon[35662]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:07:52.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:51 smithi059 ceph-mon[35138]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:07:54.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:53 smithi003 ceph-mon[30893]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T06:07:54.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:53 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T06:07:54.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:53 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:54.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:53 smithi071 ceph-mon[35662]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T06:07:54.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:53 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T06:07:54.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:53 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:54.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:53 smithi059 ceph-mon[35138]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T06:07:54.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:53 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T06:07:54.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:53 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:07:55.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:54 smithi003 ceph-mon[30893]: Deploying daemon osd.9 on smithi003 2024-09-19T06:07:55.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:54 smithi071 ceph-mon[35662]: Deploying daemon osd.9 on smithi003 2024-09-19T06:07:55.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:54 smithi059 ceph-mon[35138]: Deploying daemon osd.9 on smithi003 2024-09-19T06:07:55.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:55 smithi003 ceph-mon[30893]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-19T06:07:56.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:55 smithi071 ceph-mon[35662]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-19T06:07:56.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:55 smithi059 ceph-mon[35138]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-19T06:07:57.970 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:57 smithi003 ceph-mon[30893]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:07:58.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:57 smithi071 ceph-mon[35662]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:07:58.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:57 smithi059 ceph-mon[35138]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:08:00.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:07:59 smithi003 ceph-mon[30893]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:08:00.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:07:59 smithi071 ceph-mon[35662]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:08:00.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:07:59 smithi059 ceph-mon[35138]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:08:02.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:01 smithi003 ceph-mon[30893]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:08:02.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:01 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:02.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:01 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:02.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:01 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:02.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:01 smithi071 ceph-mon[35662]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:08:02.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:01 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:02.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:01 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:02.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:01 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:02.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:01 smithi059 ceph-mon[35138]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:08:02.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:01 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:02.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:01 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:02.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:01 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:04.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:03 smithi003 ceph-mon[30893]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:08:04.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:03 smithi071 ceph-mon[35662]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:08:04.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:03 smithi059 ceph-mon[35138]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:08:06.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:05 smithi059 ceph-mon[35138]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:08:06.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:05 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:06.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:05 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:06.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:05 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:06.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:05 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:06.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:05 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:06.054 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:05 smithi003 ceph-mon[30893]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:08:06.055 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:05 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:06.055 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:05 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:06.055 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:05 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:06.055 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:05 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:06.055 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:05 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:06.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:05 smithi071 ceph-mon[35662]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:08:06.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:05 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:06.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:05 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:06.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:05 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:06.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:05 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:06.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:05 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:06.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:06.106+0000 7fbde2a00640 1 -- 172.21.15.3:0/3198155136 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbdec062630 con 0x7fbdd00a3270 2024-09-19T06:08:06.108 INFO:teuthology.orchestra.run.smithi003.stdout:Created osd(s) 9 on host 'smithi003' 2024-09-19T06:08:06.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:06.109+0000 7fbdf0a00640 1 -- 172.21.15.3:0/3198155136 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fbdd00a3270 msgr2=0x7fbdd00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:06.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:06.109+0000 7fbdf0a00640 1 --2- 172.21.15.3:0/3198155136 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fbdd00a3270 0x7fbdd00a5730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40314e0 tx=0x7fbdd4000bc0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:06.109+0000 7fbdf0a00640 1 -- 172.21.15.3:0/3198155136 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdec101c00 msgr2=0x7fbdec197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:06.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:06.109+0000 7fbdf0a00640 1 --2- 172.21.15.3:0/3198155136 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdec101c00 0x7fbdec197f00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbddc00e9c0 tx=0x7fbddc00ee80 comp rx=0 tx=0).stop 2024-09-19T06:08:06.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:06.109+0000 7fbdf0a00640 1 -- 172.21.15.3:0/3198155136 shutdown_connections 2024-09-19T06:08:06.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:06.109+0000 7fbdf0a00640 1 --2- 172.21.15.3:0/3198155136 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fbdd00a3270 0x7fbdd00a5730 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:06.109+0000 7fbdf0a00640 1 --2- 172.21.15.3:0/3198155136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdec1037c0 0x7fbdec19f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:06.109+0000 7fbdf0a00640 1 --2- 172.21.15.3:0/3198155136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbdec102e00 0x7fbdec198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:06.109+0000 7fbdf0a00640 1 --2- 172.21.15.3:0/3198155136 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbdec101c00 0x7fbdec197f00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:06.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:06.109+0000 7fbdf0a00640 1 -- 172.21.15.3:0/3198155136 >> 172.21.15.3:0/3198155136 conn(0x7fbdec0fd390 msgr2=0x7fbdec106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:06.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:06.109+0000 7fbdf0a00640 1 -- 172.21.15.3:0/3198155136 shutdown_connections 2024-09-19T06:08:06.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:06.109+0000 7fbdf0a00640 1 -- 172.21.15.3:0/3198155136 wait complete. 2024-09-19T06:08:06.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:06 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:06.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:06 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:06.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:06 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:06.900 DEBUG:teuthology.orchestra.run.smithi003:osd.9> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T06:08:06.904 INFO:tasks.cephadm:Deploying osd.10 on smithi059 with /dev/vg_nvme/lv_1... 2024-09-19T06:08:06.904 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T06:08:07.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:06 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:07.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:06 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:07.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:06 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:07.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:06 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:07.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:06 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:07.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:06 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:07.166 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:08:08.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:07 smithi059 ceph-mon[35138]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:08:08.052 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:07 smithi003 ceph-mon[30893]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:08:08.052 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:08:07 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:08:07.720+0000 7f05a381d640 -1 osd.9 0 log_to_monitors true 2024-09-19T06:08:08.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:07 smithi071 ceph-mon[35662]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:08:08.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:08 smithi003 ceph-mon[30893]: from='osd.9 [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T06:08:08.887 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:08 smithi059 ceph-mon[35138]: from='osd.9 [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T06:08:09.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:08 smithi071 ceph-mon[35662]: from='osd.9 [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T06:08:09.933 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:09 smithi059 ceph-mon[35138]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:08:09.934 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:09 smithi059 ceph-mon[35138]: from='osd.9 [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T06:08:09.934 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:09 smithi059 ceph-mon[35138]: osdmap e64: 10 total, 9 up, 10 in 2024-09-19T06:08:09.934 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:09 smithi059 ceph-mon[35138]: from='osd.9 [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]: dispatch 2024-09-19T06:08:09.934 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:09 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:08:09.937 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-09-19T06:08:09.966 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi059:vg_nvme/lv_1 2024-09-19T06:08:10.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:09 smithi003 ceph-mon[30893]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:08:10.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:09 smithi003 ceph-mon[30893]: from='osd.9 [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T06:08:10.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:09 smithi003 ceph-mon[30893]: osdmap e64: 10 total, 9 up, 10 in 2024-09-19T06:08:10.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:09 smithi003 ceph-mon[30893]: from='osd.9 [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]: dispatch 2024-09-19T06:08:10.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:09 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:08:10.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:09 smithi071 ceph-mon[35662]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:08:10.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:09 smithi071 ceph-mon[35662]: from='osd.9 [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T06:08:10.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:09 smithi071 ceph-mon[35662]: osdmap e64: 10 total, 9 up, 10 in 2024-09-19T06:08:10.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:09 smithi071 ceph-mon[35662]: from='osd.9 [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]: dispatch 2024-09-19T06:08:10.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:09 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:08:10.218 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:08:10.425 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:08:10 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:08:10.324+0000 7f059ee00640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T06:08:10.425 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:08:10 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:08:10.355+0000 7f0594400640 -1 osd.9 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:08:10.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.702+0000 7f68f2b84640 1 -- 172.21.15.59:0/4216309089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68ec1026d0 msgr2=0x7f68ec108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:10.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.702+0000 7f68f2b84640 1 --2- 172.21.15.59:0/4216309089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68ec1026d0 0x7f68ec108f60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f68e4009ca0 tx=0x7f68e402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.702+0000 7f68f2b84640 1 -- 172.21.15.59:0/4216309089 shutdown_connections 2024-09-19T06:08:10.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.702+0000 7f68f2b84640 1 --2- 172.21.15.59:0/4216309089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68ec1026d0 0x7f68ec108f60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.702+0000 7f68f2b84640 1 --2- 172.21.15.59:0/4216309089 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68ec101d10 0x7f68ec102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.702+0000 7f68f2b84640 1 --2- 172.21.15.59:0/4216309089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68ec100b10 0x7f68ec100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.702+0000 7f68f2b84640 1 -- 172.21.15.59:0/4216309089 >> 172.21.15.59:0/4216309089 conn(0x7f68ec0fc2a0 msgr2=0x7f68ec0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:10.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.702+0000 7f68f2b84640 1 -- 172.21.15.59:0/4216309089 shutdown_connections 2024-09-19T06:08:10.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.702+0000 7f68f2b84640 1 -- 172.21.15.59:0/4216309089 wait complete. 2024-09-19T06:08:10.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.703+0000 7f68f2b84640 1 Processor -- start 2024-09-19T06:08:10.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.703+0000 7f68f2b84640 1 -- start start 2024-09-19T06:08:10.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.703+0000 7f68f2b84640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68ec100b10 0x7f68ec197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:10.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.703+0000 7f68f2b84640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68ec101d10 0x7f68ec1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:10.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.703+0000 7f68f2b84640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68ec1026d0 0x7f68ec19f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:10.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.703+0000 7f68f2b84640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f68ec10c810 con 0x7f68ec101d10 2024-09-19T06:08:10.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.703+0000 7f68f2b84640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f68ec10c690 con 0x7f68ec1026d0 2024-09-19T06:08:10.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.703+0000 7f68f2b84640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f68ec10c990 con 0x7f68ec100b10 2024-09-19T06:08:10.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.703+0000 7f68f1121640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68ec1026d0 0x7f68ec19f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:10.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.703+0000 7f68f1121640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68ec1026d0 0x7f68ec19f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42400/0 (socket says 172.21.15.59:42400) 2024-09-19T06:08:10.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.703+0000 7f68f1121640 1 -- 172.21.15.59:0/1385708366 learned_addr learned my addr 172.21.15.59:0/1385708366 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-09-19T06:08:10.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.703+0000 7f68ebfff640 1 --2- 172.21.15.59:0/1385708366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68ec101d10 0x7f68ec1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:10.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.704+0000 7f68f0920640 1 --2- 172.21.15.59:0/1385708366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68ec100b10 0x7f68ec197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:10.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.704+0000 7f68f1121640 1 -- 172.21.15.59:0/1385708366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68ec100b10 msgr2=0x7f68ec197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:10.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.704+0000 7f68f1121640 1 --2- 172.21.15.59:0/1385708366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68ec100b10 0x7f68ec197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.704+0000 7f68f1121640 1 -- 172.21.15.59:0/1385708366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68ec101d10 msgr2=0x7f68ec1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:10.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.704+0000 7f68f1121640 1 --2- 172.21.15.59:0/1385708366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68ec101d10 0x7f68ec1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:10.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.704+0000 7f68f1121640 1 -- 172.21.15.59:0/1385708366 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68ec19fb90 con 0x7f68ec1026d0 2024-09-19T06:08:10.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.704+0000 7f68f1121640 1 --2- 172.21.15.59:0/1385708366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68ec1026d0 0x7f68ec19f520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f68e4005e30 tx=0x7f68e4031ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:10.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.704+0000 7f68e9ffb640 1 -- 172.21.15.59:0/1385708366 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e4003c30 con 0x7f68ec1026d0 2024-09-19T06:08:10.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.704+0000 7f68f2b84640 1 -- 172.21.15.59:0/1385708366 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68ec19fe20 con 0x7f68ec1026d0 2024-09-19T06:08:10.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.704+0000 7f68e9ffb640 1 -- 172.21.15.59:0/1385708366 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68e4003dd0 con 0x7f68ec1026d0 2024-09-19T06:08:10.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.704+0000 7f68e9ffb640 1 -- 172.21.15.59:0/1385708366 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e402fde0 con 0x7f68ec1026d0 2024-09-19T06:08:10.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.704+0000 7f68f2b84640 1 -- 172.21.15.59:0/1385708366 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68ec1a0350 con 0x7f68ec1026d0 2024-09-19T06:08:10.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.705+0000 7f68f2b84640 1 -- 172.21.15.59:0/1385708366 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68ec1a05b0 con 0x7f68ec1026d0 2024-09-19T06:08:10.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.706+0000 7f68e9ffb640 1 -- 172.21.15.59:0/1385708366 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f68e4004050 con 0x7f68ec1026d0 2024-09-19T06:08:10.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.707+0000 7f68e9ffb640 1 --2- 172.21.15.59:0/1385708366 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f68dc0a3270 0x7f68dc0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:10.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.707+0000 7f68e9ffb640 1 -- 172.21.15.59:0/1385708366 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5981+0+0 (secure 0 0 0) 0x7f68e40f02c0 con 0x7f68ec1026d0 2024-09-19T06:08:10.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.707+0000 7f68f0920640 1 --2- 172.21.15.59:0/1385708366 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f68dc0a3270 0x7f68dc0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:10.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.708+0000 7f68f0920640 1 --2- 172.21.15.59:0/1385708366 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f68dc0a3270 0x7f68dc0a5730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f68ec101b70 tx=0x7f68e0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:10.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.711+0000 7f68e9ffb640 1 -- 172.21.15.59:0/1385708366 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f68e40bd860 con 0x7f68ec1026d0 2024-09-19T06:08:10.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:10.899+0000 7f68f2b84640 1 -- 172.21.15.59:0/1385708366 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f68ec1a0780 con 0x7f68dc0a3270 2024-09-19T06:08:10.901 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:10 smithi059 ceph-mon[35138]: from='osd.9 [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-19T06:08:10.901 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:10 smithi059 ceph-mon[35138]: osdmap e65: 10 total, 9 up, 10 in 2024-09-19T06:08:10.901 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:10 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:08:10.901 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:10 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:08:10.901 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:10 smithi059 ceph-mon[35138]: from='osd.9 [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267]' entity='osd.9' 2024-09-19T06:08:11.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:10 smithi003 ceph-mon[30893]: from='osd.9 [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-19T06:08:11.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:10 smithi003 ceph-mon[30893]: osdmap e65: 10 total, 9 up, 10 in 2024-09-19T06:08:11.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:10 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:08:11.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:10 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:08:11.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:10 smithi003 ceph-mon[30893]: from='osd.9 [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267]' entity='osd.9' 2024-09-19T06:08:11.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:10 smithi071 ceph-mon[35662]: from='osd.9 [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-19T06:08:11.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:10 smithi071 ceph-mon[35662]: osdmap e65: 10 total, 9 up, 10 in 2024-09-19T06:08:11.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:10 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:08:11.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:10 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:08:11.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:10 smithi071 ceph-mon[35662]: from='osd.9 [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267]' entity='osd.9' 2024-09-19T06:08:12.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:11 smithi059 ceph-mon[35138]: purged_snaps scrub starts 2024-09-19T06:08:12.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:11 smithi059 ceph-mon[35138]: purged_snaps scrub ok 2024-09-19T06:08:12.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:11 smithi059 ceph-mon[35138]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:08:12.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:11 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:08:12.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:11 smithi059 ceph-mon[35138]: Detected new or changed devices on smithi003 2024-09-19T06:08:12.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:11 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:12.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:11 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:12.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:11 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:12.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:11 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:12.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:11 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:12.041 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:11 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:12.041 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:11 smithi059 ceph-mon[35138]: Adjusting osd_memory_target on smithi003 to 4273M 2024-09-19T06:08:12.041 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:11 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:12.041 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:11 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:12.041 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:11 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:12.042 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:11 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:12.042 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:11 smithi059 ceph-mon[35138]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:08:12.042 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:11 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:08:12.042 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:11 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:08:12.042 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:11 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:12.042 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:11 smithi059 ceph-mon[35138]: osd.9 [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267] boot 2024-09-19T06:08:12.042 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:11 smithi059 ceph-mon[35138]: osdmap e66: 10 total, 10 up, 10 in 2024-09-19T06:08:12.043 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:11 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:08:12.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:11 smithi003 ceph-mon[30893]: purged_snaps scrub starts 2024-09-19T06:08:12.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:11 smithi003 ceph-mon[30893]: purged_snaps scrub ok 2024-09-19T06:08:12.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:11 smithi003 ceph-mon[30893]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:08:12.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:11 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:08:12.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:11 smithi003 ceph-mon[30893]: Detected new or changed devices on smithi003 2024-09-19T06:08:12.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:11 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:12.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:11 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:12.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:11 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:12.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:11 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:12.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:11 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:12.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:11 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:12.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:11 smithi003 ceph-mon[30893]: Adjusting osd_memory_target on smithi003 to 4273M 2024-09-19T06:08:12.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:11 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:12.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:11 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:12.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:11 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:12.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:11 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:12.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:11 smithi003 ceph-mon[30893]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:08:12.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:11 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:08:12.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:11 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:08:12.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:11 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:12.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:11 smithi003 ceph-mon[30893]: osd.9 [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267] boot 2024-09-19T06:08:12.087 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:11 smithi003 ceph-mon[30893]: osdmap e66: 10 total, 10 up, 10 in 2024-09-19T06:08:12.087 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:11 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:08:12.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:11 smithi071 ceph-mon[35662]: purged_snaps scrub starts 2024-09-19T06:08:12.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:11 smithi071 ceph-mon[35662]: purged_snaps scrub ok 2024-09-19T06:08:12.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:11 smithi071 ceph-mon[35662]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-19T06:08:12.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:11 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:08:12.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:11 smithi071 ceph-mon[35662]: Detected new or changed devices on smithi003 2024-09-19T06:08:12.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:11 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:12.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:11 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:12.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:11 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:12.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:11 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:12.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:11 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:12.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:11 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:12.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:11 smithi071 ceph-mon[35662]: Adjusting osd_memory_target on smithi003 to 4273M 2024-09-19T06:08:12.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:11 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:12.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:11 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:12.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:11 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:12.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:11 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:12.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:11 smithi071 ceph-mon[35662]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi059:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:08:12.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:11 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:08:12.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:11 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:08:12.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:11 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:12.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:11 smithi071 ceph-mon[35662]: osd.9 [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267] boot 2024-09-19T06:08:12.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:11 smithi071 ceph-mon[35662]: osdmap e66: 10 total, 10 up, 10 in 2024-09-19T06:08:12.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:11 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:08:13.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:13 smithi003 ceph-mon[30893]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:13.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:13 smithi003 ceph-mon[30893]: osdmap e67: 10 total, 10 up, 10 in 2024-09-19T06:08:13.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:13 smithi071 ceph-mon[35662]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:13.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:13 smithi071 ceph-mon[35662]: osdmap e67: 10 total, 10 up, 10 in 2024-09-19T06:08:13.716 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:13 smithi059 ceph-mon[35138]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:13.716 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:13 smithi059 ceph-mon[35138]: osdmap e67: 10 total, 10 up, 10 in 2024-09-19T06:08:14.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:14 smithi003 ceph-mon[30893]: from='client.? 172.21.15.59:0/1069580720' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e49f3aab-0804-4aea-ae3f-38f022ab5239"}]: dispatch 2024-09-19T06:08:14.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:14 smithi003 ceph-mon[30893]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e49f3aab-0804-4aea-ae3f-38f022ab5239"}]: dispatch 2024-09-19T06:08:14.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:14 smithi003 ceph-mon[30893]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e49f3aab-0804-4aea-ae3f-38f022ab5239"}]': finished 2024-09-19T06:08:14.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:14 smithi003 ceph-mon[30893]: osdmap e68: 11 total, 10 up, 11 in 2024-09-19T06:08:14.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:14 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:08:14.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:14 smithi003 ceph-mon[30893]: from='client.? 172.21.15.59:0/1242970807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:08:14.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:14 smithi071 ceph-mon[35662]: from='client.? 172.21.15.59:0/1069580720' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e49f3aab-0804-4aea-ae3f-38f022ab5239"}]: dispatch 2024-09-19T06:08:14.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:14 smithi071 ceph-mon[35662]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e49f3aab-0804-4aea-ae3f-38f022ab5239"}]: dispatch 2024-09-19T06:08:14.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:14 smithi071 ceph-mon[35662]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e49f3aab-0804-4aea-ae3f-38f022ab5239"}]': finished 2024-09-19T06:08:14.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:14 smithi071 ceph-mon[35662]: osdmap e68: 11 total, 10 up, 11 in 2024-09-19T06:08:14.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:14 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:08:14.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:14 smithi071 ceph-mon[35662]: from='client.? 172.21.15.59:0/1242970807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:08:14.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:14 smithi059 ceph-mon[35138]: from='client.? 172.21.15.59:0/1069580720' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e49f3aab-0804-4aea-ae3f-38f022ab5239"}]: dispatch 2024-09-19T06:08:14.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:14 smithi059 ceph-mon[35138]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e49f3aab-0804-4aea-ae3f-38f022ab5239"}]: dispatch 2024-09-19T06:08:14.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:14 smithi059 ceph-mon[35138]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e49f3aab-0804-4aea-ae3f-38f022ab5239"}]': finished 2024-09-19T06:08:14.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:14 smithi059 ceph-mon[35138]: osdmap e68: 11 total, 10 up, 11 in 2024-09-19T06:08:14.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:14 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:08:14.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:14 smithi059 ceph-mon[35138]: from='client.? 172.21.15.59:0/1242970807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:08:15.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:15 smithi059 ceph-mon[35138]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:15.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:15 smithi003 ceph-mon[30893]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:15.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:15 smithi071 ceph-mon[35662]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:17.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:17 smithi059 ceph-mon[35138]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:17.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:17 smithi003 ceph-mon[30893]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:17.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:17 smithi071 ceph-mon[35662]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:19.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:19 smithi059 ceph-mon[35138]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:19.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:19 smithi003 ceph-mon[30893]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:19.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:19 smithi071 ceph-mon[35662]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:21.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:21 smithi059 ceph-mon[35138]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:21.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:21 smithi003 ceph-mon[30893]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:21.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:21 smithi071 ceph-mon[35662]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:22.773 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:22 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T06:08:22.776 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:22 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:22.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:22 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T06:08:22.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:22 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:22.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:22 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T06:08:22.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:22 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:23.680 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:23 smithi059 ceph-mon[35138]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:23.680 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:23 smithi059 ceph-mon[35138]: Deploying daemon osd.10 on smithi059 2024-09-19T06:08:23.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:23 smithi003 ceph-mon[30893]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:23.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:23 smithi003 ceph-mon[30893]: Deploying daemon osd.10 on smithi059 2024-09-19T06:08:23.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:23 smithi071 ceph-mon[35662]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:23.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:23 smithi071 ceph-mon[35662]: Deploying daemon osd.10 on smithi059 2024-09-19T06:08:25.743 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:25 smithi059 ceph-mon[35138]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:25.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:25 smithi003 ceph-mon[30893]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:25.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:25 smithi071 ceph-mon[35662]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:27.640 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:27 smithi059 ceph-mon[35138]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:27.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:27 smithi003 ceph-mon[30893]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:27.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:27 smithi071 ceph-mon[35662]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:28.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:28 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:28.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:28 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:28.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:28 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:28.769 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:28 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:28.770 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:28 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:28.770 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:28 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:28.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:28 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:28.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:28 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:28.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:28 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:29.773 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:29 smithi059 ceph-mon[35138]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:29.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:29 smithi003 ceph-mon[30893]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:29.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:29 smithi071 ceph-mon[35662]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:31.765 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:31 smithi059 ceph-mon[35138]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:31.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:31.805+0000 7f68e9ffb640 1 -- 172.21.15.59:0/1385708366 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f68ec1a0780 con 0x7f68dc0a3270 2024-09-19T06:08:31.807 INFO:teuthology.orchestra.run.smithi059.stdout:Created osd(s) 10 on host 'smithi059' 2024-09-19T06:08:31.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:31.807+0000 7f68f2b84640 1 -- 172.21.15.59:0/1385708366 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f68dc0a3270 msgr2=0x7f68dc0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:31.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:31.807+0000 7f68f2b84640 1 --2- 172.21.15.59:0/1385708366 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f68dc0a3270 0x7f68dc0a5730 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f68ec101b70 tx=0x7f68e0008040 comp rx=0 tx=0).stop 2024-09-19T06:08:31.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:31.807+0000 7f68f2b84640 1 -- 172.21.15.59:0/1385708366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68ec1026d0 msgr2=0x7f68ec19f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:31.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:31.807+0000 7f68f2b84640 1 --2- 172.21.15.59:0/1385708366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68ec1026d0 0x7f68ec19f520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f68e4005e30 tx=0x7f68e4031ee0 comp rx=0 tx=0).stop 2024-09-19T06:08:31.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:31.807+0000 7f68f2b84640 1 -- 172.21.15.59:0/1385708366 shutdown_connections 2024-09-19T06:08:31.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:31.807+0000 7f68f2b84640 1 --2- 172.21.15.59:0/1385708366 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f68dc0a3270 0x7f68dc0a5730 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:31.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:31.807+0000 7f68f2b84640 1 --2- 172.21.15.59:0/1385708366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68ec1026d0 0x7f68ec19f520 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:31.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:31.807+0000 7f68f2b84640 1 --2- 172.21.15.59:0/1385708366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68ec101d10 0x7f68ec1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:31.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:31.807+0000 7f68f2b84640 1 --2- 172.21.15.59:0/1385708366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68ec100b10 0x7f68ec197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:31.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:31.807+0000 7f68f2b84640 1 -- 172.21.15.59:0/1385708366 >> 172.21.15.59:0/1385708366 conn(0x7f68ec0fc2a0 msgr2=0x7f68ec0fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:31.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:31.807+0000 7f68f2b84640 1 -- 172.21.15.59:0/1385708366 shutdown_connections 2024-09-19T06:08:31.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-09-19T06:08:31.807+0000 7f68f2b84640 1 -- 172.21.15.59:0/1385708366 wait complete. 2024-09-19T06:08:31.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:31 smithi003 ceph-mon[30893]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:31.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:31 smithi071 ceph-mon[35662]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:32.549 DEBUG:teuthology.orchestra.run.smithi059:osd.10> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T06:08:32.551 INFO:tasks.cephadm:Deploying osd.11 on smithi071 with /dev/vg_nvme/lv_1... 2024-09-19T06:08:32.551 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T06:08:32.809 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:08:32.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:32 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:32.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:32 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:32.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:32 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:32.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:32 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:33.062 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:32 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:33.062 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:32 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:33.062 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:32 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:33.062 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:32 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:33.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:32 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:33.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:32 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:33.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:32 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:33.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:32 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:34.072 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:33 smithi059 ceph-mon[35138]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:34.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:33 smithi003 ceph-mon[30893]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:34.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:33 smithi071 ceph-mon[35662]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:34.362 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:08:34 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:08:34.070+0000 7fc9bb666640 -1 osd.10 0 log_to_monitors true 2024-09-19T06:08:35.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:34 smithi059 ceph-mon[35138]: from='osd.10 [v2:172.21.15.59:6824/784134238,v1:172.21.15.59:6825/784134238]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:08:35.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:34 smithi059 ceph-mon[35138]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:08:35.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:34 smithi003 ceph-mon[30893]: from='osd.10 [v2:172.21.15.59:6824/784134238,v1:172.21.15.59:6825/784134238]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:08:35.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:34 smithi003 ceph-mon[30893]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:08:35.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:34 smithi071 ceph-mon[35662]: from='osd.10 [v2:172.21.15.59:6824/784134238,v1:172.21.15.59:6825/784134238]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:08:35.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:34 smithi071 ceph-mon[35662]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T06:08:35.498 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-09-19T06:08:35.527 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi071:vg_nvme/lv_1 2024-09-19T06:08:35.783 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:08:36.057 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:35 smithi071 ceph-mon[35662]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:36.057 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:35 smithi071 ceph-mon[35662]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T06:08:36.057 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:35 smithi071 ceph-mon[35662]: osdmap e69: 11 total, 10 up, 11 in 2024-09-19T06:08:36.057 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:35 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:08:36.057 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:35 smithi071 ceph-mon[35662]: from='osd.10 [v2:172.21.15.59:6824/784134238,v1:172.21.15.59:6825/784134238]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-19T06:08:36.057 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:35 smithi071 ceph-mon[35662]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-19T06:08:36.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:35 smithi003 ceph-mon[30893]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:36.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:35 smithi003 ceph-mon[30893]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T06:08:36.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:35 smithi003 ceph-mon[30893]: osdmap e69: 11 total, 10 up, 11 in 2024-09-19T06:08:36.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:35 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:08:36.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:35 smithi003 ceph-mon[30893]: from='osd.10 [v2:172.21.15.59:6824/784134238,v1:172.21.15.59:6825/784134238]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-19T06:08:36.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:35 smithi003 ceph-mon[30893]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-19T06:08:36.137 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:08:35 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:08:35.819+0000 7fc9b75e9640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T06:08:36.137 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:08:35 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:08:35.831+0000 7fc9b3411640 -1 osd.10 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:08:36.137 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:35 smithi059 ceph-mon[35138]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:36.138 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:35 smithi059 ceph-mon[35138]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T06:08:36.138 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:35 smithi059 ceph-mon[35138]: osdmap e69: 11 total, 10 up, 11 in 2024-09-19T06:08:36.138 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:35 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:08:36.138 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:35 smithi059 ceph-mon[35138]: from='osd.10 [v2:172.21.15.59:6824/784134238,v1:172.21.15.59:6825/784134238]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-19T06:08:36.138 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:35 smithi059 ceph-mon[35138]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]: dispatch 2024-09-19T06:08:36.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.241+0000 7f9316140640 1 -- 172.21.15.71:0/2126793438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9310105030 msgr2=0x7f9310107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:36.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.241+0000 7f9316140640 1 --2- 172.21.15.71:0/2126793438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9310105030 0x7f9310107420 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f92f8009900 tx=0x7f92f802a410 comp rx=0 tx=0).stop 2024-09-19T06:08:36.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.241+0000 7f9316140640 1 -- 172.21.15.71:0/2126793438 shutdown_connections 2024-09-19T06:08:36.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.241+0000 7f9316140640 1 --2- 172.21.15.71:0/2126793438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9310107960 0x7f9310109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:36.266 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.241+0000 7f9316140640 1 --2- 172.21.15.71:0/2126793438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9310105030 0x7f9310107420 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:36.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.241+0000 7f9316140640 1 --2- 172.21.15.71:0/2126793438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9310102700 0x7f9310104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:36.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.241+0000 7f9316140640 1 -- 172.21.15.71:0/2126793438 >> 172.21.15.71:0/2126793438 conn(0x7f93100fc280 msgr2=0x7f93100fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:36.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.241+0000 7f9316140640 1 -- 172.21.15.71:0/2126793438 shutdown_connections 2024-09-19T06:08:36.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.241+0000 7f9316140640 1 -- 172.21.15.71:0/2126793438 wait complete. 2024-09-19T06:08:36.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.242+0000 7f9316140640 1 Processor -- start 2024-09-19T06:08:36.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.242+0000 7f9316140640 1 -- start start 2024-09-19T06:08:36.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.242+0000 7f9316140640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9310102700 0x7f9310197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:36.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.242+0000 7f9316140640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9310105030 0x7f9310198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:36.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.242+0000 7f9316140640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9310107960 0x7f931019f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:36.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.242+0000 7f9316140640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f931010d850 con 0x7f9310105030 2024-09-19T06:08:36.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.242+0000 7f9316140640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f931010d6d0 con 0x7f9310107960 2024-09-19T06:08:36.267 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.242+0000 7f9316140640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f931010d9d0 con 0x7f9310102700 2024-09-19T06:08:36.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.242+0000 7f930f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9310102700 0x7f9310197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:36.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.242+0000 7f930f7fe640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9310102700 0x7f9310197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:40304/0 (socket says 172.21.15.71:40304) 2024-09-19T06:08:36.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.242+0000 7f930f7fe640 1 -- 172.21.15.71:0/3822991069 learned_addr learned my addr 172.21.15.71:0/3822991069 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-19T06:08:36.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.242+0000 7f9307fff640 1 --2- 172.21.15.71:0/3822991069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9310105030 0x7f9310198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:36.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.242+0000 7f930ffff640 1 --2- 172.21.15.71:0/3822991069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9310107960 0x7f931019f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:36.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.242+0000 7f930f7fe640 1 -- 172.21.15.71:0/3822991069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9310107960 msgr2=0x7f931019f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:36.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.242+0000 7f930f7fe640 1 --2- 172.21.15.71:0/3822991069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9310107960 0x7f931019f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:36.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.242+0000 7f930f7fe640 1 -- 172.21.15.71:0/3822991069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9310105030 msgr2=0x7f9310198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:36.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.242+0000 7f930f7fe640 1 --2- 172.21.15.71:0/3822991069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9310105030 0x7f9310198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:36.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.242+0000 7f930f7fe640 1 -- 172.21.15.71:0/3822991069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931019fb60 con 0x7f9310102700 2024-09-19T06:08:36.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.243+0000 7f930f7fe640 1 --2- 172.21.15.71:0/3822991069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9310102700 0x7f9310197f30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f930000e9f0 tx=0x7f930000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:36.268 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.243+0000 7f930d7fa640 1 -- 172.21.15.71:0/3822991069 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930000cd80 con 0x7f9310102700 2024-09-19T06:08:36.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.243+0000 7f930d7fa640 1 -- 172.21.15.71:0/3822991069 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9300005500 con 0x7f9310102700 2024-09-19T06:08:36.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.243+0000 7f9316140640 1 -- 172.21.15.71:0/3822991069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f931019fe50 con 0x7f9310102700 2024-09-19T06:08:36.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.243+0000 7f930d7fa640 1 -- 172.21.15.71:0/3822991069 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300010690 con 0x7f9310102700 2024-09-19T06:08:36.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.243+0000 7f9316140640 1 -- 172.21.15.71:0/3822991069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93101a0250 con 0x7f9310102700 2024-09-19T06:08:36.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.244+0000 7f9316140640 1 -- 172.21.15.71:0/3822991069 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93100fdd70 con 0x7f9310102700 2024-09-19T06:08:36.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.245+0000 7f930d7fa640 1 -- 172.21.15.71:0/3822991069 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f93000046c0 con 0x7f9310102700 2024-09-19T06:08:36.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.246+0000 7f930d7fa640 1 --2- 172.21.15.71:0/3822991069 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f92fc0a3270 0x7f92fc0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:36.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.246+0000 7f930d7fa640 1 -- 172.21.15.71:0/3822991069 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6414+0+0 (secure 0 0 0) 0x7f93000cf6f0 con 0x7f9310102700 2024-09-19T06:08:36.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.246+0000 7f9307fff640 1 --2- 172.21.15.71:0/3822991069 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f92fc0a3270 0x7f92fc0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:36.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.247+0000 7f9307fff640 1 --2- 172.21.15.71:0/3822991069 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f92fc0a3270 0x7f92fc0a5730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f92f8005ab0 tx=0x7f92f8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:36.269 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.250+0000 7f930d7fa640 1 -- 172.21.15.71:0/3822991069 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f930009cae0 con 0x7f9310102700 2024-09-19T06:08:36.435 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:36.433+0000 7f9316140640 1 -- 172.21.15.71:0/3822991069 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9310062630 con 0x7f92fc0a3270 2024-09-19T06:08:37.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:36 smithi003 ceph-mon[30893]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-19T06:08:37.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:36 smithi003 ceph-mon[30893]: osdmap e70: 11 total, 10 up, 11 in 2024-09-19T06:08:37.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:08:37.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:08:37.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:37.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:37.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:37.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:37.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:37.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:37.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:37.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:37.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:37.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:37.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:37.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:37.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:37.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:37.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:08:37.087 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:08:37.087 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:37.087 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:36 smithi003 ceph-mon[30893]: osd.10 [v2:172.21.15.59:6824/784134238,v1:172.21.15.59:6825/784134238] boot 2024-09-19T06:08:37.087 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:36 smithi003 ceph-mon[30893]: osdmap e71: 11 total, 11 up, 11 in 2024-09-19T06:08:37.087 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:08:37.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:36 smithi071 ceph-mon[35662]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-19T06:08:37.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:36 smithi071 ceph-mon[35662]: osdmap e70: 11 total, 10 up, 11 in 2024-09-19T06:08:37.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:08:37.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:08:37.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:37.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:37.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:37.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:37.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:37.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:37.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:37.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:37.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:37.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:37.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:37.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:37.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:37.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:37.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:08:37.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:08:37.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:37.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:36 smithi071 ceph-mon[35662]: osd.10 [v2:172.21.15.59:6824/784134238,v1:172.21.15.59:6825/784134238] boot 2024-09-19T06:08:37.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:36 smithi071 ceph-mon[35662]: osdmap e71: 11 total, 11 up, 11 in 2024-09-19T06:08:37.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:08:37.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:36 smithi059 ceph-mon[35138]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi059", "root=default"]}]': finished 2024-09-19T06:08:37.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:36 smithi059 ceph-mon[35138]: osdmap e70: 11 total, 10 up, 11 in 2024-09-19T06:08:37.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:08:37.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:08:37.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:37.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:37.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:37.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:37.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:37.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:08:37.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:37.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:37.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:37.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:37.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:37.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:37.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:37.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:37.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:08:37.291 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:08:37.291 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:37.291 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:36 smithi059 ceph-mon[35138]: osd.10 [v2:172.21.15.59:6824/784134238,v1:172.21.15.59:6825/784134238] boot 2024-09-19T06:08:37.291 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:36 smithi059 ceph-mon[35138]: osdmap e71: 11 total, 11 up, 11 in 2024-09-19T06:08:37.291 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:08:37.833 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:37 smithi071 ceph-mon[35662]: purged_snaps scrub starts 2024-09-19T06:08:37.833 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:37 smithi071 ceph-mon[35662]: purged_snaps scrub ok 2024-09-19T06:08:37.833 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:37 smithi071 ceph-mon[35662]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:37.833 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:37 smithi071 ceph-mon[35662]: Detected new or changed devices on smithi059 2024-09-19T06:08:37.833 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:37 smithi071 ceph-mon[35662]: Adjusting osd_memory_target on smithi059 to 4273M 2024-09-19T06:08:38.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:37 smithi003 ceph-mon[30893]: purged_snaps scrub starts 2024-09-19T06:08:38.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:37 smithi003 ceph-mon[30893]: purged_snaps scrub ok 2024-09-19T06:08:38.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:37 smithi003 ceph-mon[30893]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:38.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:37 smithi003 ceph-mon[30893]: Detected new or changed devices on smithi059 2024-09-19T06:08:38.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:37 smithi003 ceph-mon[30893]: Adjusting osd_memory_target on smithi059 to 4273M 2024-09-19T06:08:38.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:37 smithi003 ceph-mon[30893]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:08:38.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:37 smithi003 ceph-mon[30893]: osdmap e72: 11 total, 11 up, 11 in 2024-09-19T06:08:38.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:37 smithi071 ceph-mon[35662]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:08:38.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:37 smithi071 ceph-mon[35662]: osdmap e72: 11 total, 11 up, 11 in 2024-09-19T06:08:38.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:37 smithi059 ceph-mon[35138]: purged_snaps scrub starts 2024-09-19T06:08:38.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:37 smithi059 ceph-mon[35138]: purged_snaps scrub ok 2024-09-19T06:08:38.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:37 smithi059 ceph-mon[35138]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-19T06:08:38.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:37 smithi059 ceph-mon[35138]: Detected new or changed devices on smithi059 2024-09-19T06:08:38.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:37 smithi059 ceph-mon[35138]: Adjusting osd_memory_target on smithi059 to 4273M 2024-09-19T06:08:38.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:37 smithi059 ceph-mon[35138]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi071:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:08:38.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:37 smithi059 ceph-mon[35138]: osdmap e72: 11 total, 11 up, 11 in 2024-09-19T06:08:40.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:39 smithi059 ceph-mon[35138]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:08:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:39 smithi059 ceph-mon[35138]: osdmap e73: 11 total, 11 up, 11 in 2024-09-19T06:08:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:39 smithi059 ceph-mon[35138]: from='client.? 172.21.15.71:0/3049850509' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c6d6c23-bcf7-43e7-94d1-5f2ebaa15441"}]: dispatch 2024-09-19T06:08:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:39 smithi059 ceph-mon[35138]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c6d6c23-bcf7-43e7-94d1-5f2ebaa15441"}]: dispatch 2024-09-19T06:08:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:39 smithi059 ceph-mon[35138]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c6d6c23-bcf7-43e7-94d1-5f2ebaa15441"}]': finished 2024-09-19T06:08:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:39 smithi059 ceph-mon[35138]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T06:08:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:39 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:08:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:39 smithi059 ceph-mon[35138]: from='client.? 172.21.15.71:0/2679897913' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:08:40.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:39 smithi003 ceph-mon[30893]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:08:40.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:39 smithi003 ceph-mon[30893]: osdmap e73: 11 total, 11 up, 11 in 2024-09-19T06:08:40.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:39 smithi003 ceph-mon[30893]: from='client.? 172.21.15.71:0/3049850509' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c6d6c23-bcf7-43e7-94d1-5f2ebaa15441"}]: dispatch 2024-09-19T06:08:40.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:39 smithi003 ceph-mon[30893]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c6d6c23-bcf7-43e7-94d1-5f2ebaa15441"}]: dispatch 2024-09-19T06:08:40.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:39 smithi003 ceph-mon[30893]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c6d6c23-bcf7-43e7-94d1-5f2ebaa15441"}]': finished 2024-09-19T06:08:40.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:39 smithi003 ceph-mon[30893]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T06:08:40.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:39 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:08:40.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:39 smithi003 ceph-mon[30893]: from='client.? 172.21.15.71:0/2679897913' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:08:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:39 smithi071 ceph-mon[35662]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:08:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:39 smithi071 ceph-mon[35662]: osdmap e73: 11 total, 11 up, 11 in 2024-09-19T06:08:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:39 smithi071 ceph-mon[35662]: from='client.? 172.21.15.71:0/3049850509' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c6d6c23-bcf7-43e7-94d1-5f2ebaa15441"}]: dispatch 2024-09-19T06:08:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:39 smithi071 ceph-mon[35662]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c6d6c23-bcf7-43e7-94d1-5f2ebaa15441"}]: dispatch 2024-09-19T06:08:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:39 smithi071 ceph-mon[35662]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c6d6c23-bcf7-43e7-94d1-5f2ebaa15441"}]': finished 2024-09-19T06:08:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:39 smithi071 ceph-mon[35662]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T06:08:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:39 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:08:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:39 smithi071 ceph-mon[35662]: from='client.? 172.21.15.71:0/2679897913' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:08:41.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:40 smithi059 ceph-mon[35138]: osdmap e75: 12 total, 11 up, 12 in 2024-09-19T06:08:41.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:40 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:08:41.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:40 smithi003 ceph-mon[30893]: osdmap e75: 12 total, 11 up, 12 in 2024-09-19T06:08:41.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:40 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:08:41.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:40 smithi071 ceph-mon[35662]: osdmap e75: 12 total, 11 up, 12 in 2024-09-19T06:08:41.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:40 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:08:42.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:41 smithi059 ceph-mon[35138]: pgmap v250: 1 pgs: 1 peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 171 KiB/s, 0 objects/s recovering 2024-09-19T06:08:42.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:41 smithi003 ceph-mon[30893]: pgmap v250: 1 pgs: 1 peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 171 KiB/s, 0 objects/s recovering 2024-09-19T06:08:42.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:41 smithi071 ceph-mon[35662]: pgmap v250: 1 pgs: 1 peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 171 KiB/s, 0 objects/s recovering 2024-09-19T06:08:44.026 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:43 smithi071 ceph-mon[35662]: pgmap v251: 1 pgs: 1 peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 132 KiB/s, 0 objects/s recovering 2024-09-19T06:08:44.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:43 smithi059 ceph-mon[35138]: pgmap v251: 1 pgs: 1 peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 132 KiB/s, 0 objects/s recovering 2024-09-19T06:08:44.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:43 smithi003 ceph-mon[30893]: pgmap v251: 1 pgs: 1 peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 132 KiB/s, 0 objects/s recovering 2024-09-19T06:08:46.202 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:45 smithi071 ceph-mon[35662]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:08:46.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:45 smithi059 ceph-mon[35138]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:08:46.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:45 smithi003 ceph-mon[30893]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T06:08:48.174 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:47 smithi071 ceph-mon[35662]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-19T06:08:48.174 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:47 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T06:08:48.174 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:47 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:48.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:47 smithi059 ceph-mon[35138]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-19T06:08:48.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:47 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T06:08:48.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:47 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:48.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:47 smithi003 ceph-mon[30893]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-19T06:08:48.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:47 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T06:08:48.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:47 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:49.146 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:48 smithi071 ceph-mon[35662]: Deploying daemon osd.11 on smithi071 2024-09-19T06:08:49.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:48 smithi059 ceph-mon[35138]: Deploying daemon osd.11 on smithi071 2024-09-19T06:08:49.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:48 smithi003 ceph-mon[30893]: Deploying daemon osd.11 on smithi071 2024-09-19T06:08:50.239 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:49 smithi071 ceph-mon[35662]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T06:08:50.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:49 smithi059 ceph-mon[35138]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T06:08:50.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:49 smithi003 ceph-mon[30893]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-19T06:08:52.138 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:51 smithi071 ceph-mon[35662]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:08:52.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:51 smithi059 ceph-mon[35138]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:08:52.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:51 smithi003 ceph-mon[30893]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:08:54.224 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:53 smithi071 ceph-mon[35662]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:08:54.224 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:53 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:54.224 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:53 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:54.224 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:53 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:54.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:53 smithi059 ceph-mon[35138]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:08:54.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:53 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:54.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:53 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:54.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:53 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:54.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:53 smithi003 ceph-mon[30893]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:08:54.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:53 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:54.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:53 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:54.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:53 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:56.155 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:55 smithi071 ceph-mon[35662]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:08:56.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:55 smithi059 ceph-mon[35138]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:08:56.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:55 smithi003 ceph-mon[30893]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:08:57.143 INFO:teuthology.orchestra.run.smithi071.stdout:Created osd(s) 11 on host 'smithi071' 2024-09-19T06:08:57.143 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:57.141+0000 7f930d7fa640 1 -- 172.21.15.71:0/3822991069 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f9310062630 con 0x7f92fc0a3270 2024-09-19T06:08:57.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:57.143+0000 7f9316140640 1 -- 172.21.15.71:0/3822991069 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f92fc0a3270 msgr2=0x7f92fc0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:57.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:57.143+0000 7f9316140640 1 --2- 172.21.15.71:0/3822991069 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f92fc0a3270 0x7f92fc0a5730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f92f8005ab0 tx=0x7f92f8000bc0 comp rx=0 tx=0).stop 2024-09-19T06:08:57.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:57.144+0000 7f9316140640 1 -- 172.21.15.71:0/3822991069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9310102700 msgr2=0x7f9310197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:57.145 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:57.144+0000 7f9316140640 1 --2- 172.21.15.71:0/3822991069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9310102700 0x7f9310197f30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f930000e9f0 tx=0x7f930000edf0 comp rx=0 tx=0).stop 2024-09-19T06:08:57.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:57.144+0000 7f9316140640 1 -- 172.21.15.71:0/3822991069 shutdown_connections 2024-09-19T06:08:57.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:57.144+0000 7f9316140640 1 --2- 172.21.15.71:0/3822991069 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f92fc0a3270 0x7f92fc0a5730 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:57.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:57.144+0000 7f9316140640 1 --2- 172.21.15.71:0/3822991069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9310107960 0x7f931019f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:57.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:57.144+0000 7f9316140640 1 --2- 172.21.15.71:0/3822991069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9310105030 0x7f9310198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:57.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:57.144+0000 7f9316140640 1 --2- 172.21.15.71:0/3822991069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9310102700 0x7f9310197f30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:57.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:57.144+0000 7f9316140640 1 -- 172.21.15.71:0/3822991069 >> 172.21.15.71:0/3822991069 conn(0x7f93100fc280 msgr2=0x7f93101031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:57.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:57.144+0000 7f9316140640 1 -- 172.21.15.71:0/3822991069 shutdown_connections 2024-09-19T06:08:57.146 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:08:57.144+0000 7f9316140640 1 -- 172.21.15.71:0/3822991069 wait complete. 2024-09-19T06:08:57.765 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:57 smithi071 ceph-mon[35662]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:08:57.765 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:57 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:57.765 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:57 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:57.765 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:57 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:57.765 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:57 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:57.765 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:57 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:57.766 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:57 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:57.766 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:57 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:57.766 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:57 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:57.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:57 smithi059 ceph-mon[35138]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:08:57.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:57 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:57.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:57 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:57.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:57 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:57.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:57 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:57.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:57 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:57.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:57 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:57.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:57 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:57.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:57 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:57.792 DEBUG:teuthology.orchestra.run.smithi071:osd.11> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T06:08:57.795 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T06:08:57.795 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T06:08:57.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:57 smithi003 ceph-mon[30893]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:08:57.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:57 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:57.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:57 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:57.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:57 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:08:57.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:57 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:08:57.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:57 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:57.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:57 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:08:57.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:57 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:57.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:57 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:08:58.184 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:08:58.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.779+0000 7ff3c9a00640 1 -- 172.21.15.3:0/1818706178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3c4105810 msgr2=0x7ff3c410c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:58.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.779+0000 7ff3c9a00640 1 --2- 172.21.15.3:0/1818706178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3c4105810 0x7ff3c410c0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc009be0 tx=0x7ff3bc02a6c0 comp rx=0 tx=0).stop 2024-09-19T06:08:58.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.779+0000 7ff3c9a00640 1 -- 172.21.15.3:0/1818706178 shutdown_connections 2024-09-19T06:08:58.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.779+0000 7ff3c9a00640 1 --2- 172.21.15.3:0/1818706178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3c4105810 0x7ff3c410c0a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:58.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.779+0000 7ff3c9a00640 1 --2- 172.21.15.3:0/1818706178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3c4104e50 0x7ff3c41052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:58.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.779+0000 7ff3c9a00640 1 --2- 172.21.15.3:0/1818706178 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3c4103c50 0x7ff3c4104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:58.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.779+0000 7ff3c9a00640 1 -- 172.21.15.3:0/1818706178 >> 172.21.15.3:0/1818706178 conn(0x7ff3c40ff3e0 msgr2=0x7ff3c4101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:58.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.779+0000 7ff3c9a00640 1 -- 172.21.15.3:0/1818706178 shutdown_connections 2024-09-19T06:08:58.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.780+0000 7ff3c9a00640 1 -- 172.21.15.3:0/1818706178 wait complete. 2024-09-19T06:08:58.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.781+0000 7ff3c9a00640 1 Processor -- start 2024-09-19T06:08:58.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.781+0000 7ff3c9a00640 1 -- start start 2024-09-19T06:08:58.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.781+0000 7ff3c9a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3c4103c50 0x7ff3c4199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:58.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.781+0000 7ff3c9a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3c4104e50 0x7ff3c419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:58.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.781+0000 7ff3c9a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3c4105810 0x7ff3c41a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:58.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.781+0000 7ff3c9a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c410f880 con 0x7ff3c4104e50 2024-09-19T06:08:58.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.781+0000 7ff3c9a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c410f700 con 0x7ff3c4105810 2024-09-19T06:08:58.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.781+0000 7ff3c9a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c410fa00 con 0x7ff3c4103c50 2024-09-19T06:08:58.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.781+0000 7ff3c3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3c4103c50 0x7ff3c4199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:58.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.781+0000 7ff3c3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3c4103c50 0x7ff3c4199f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:41516/0 (socket says 172.21.15.3:41516) 2024-09-19T06:08:58.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.781+0000 7ff3c3e00640 1 -- 172.21.15.3:0/58654099 learned_addr learned my addr 172.21.15.3:0/58654099 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:08:58.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.782+0000 7ff3c9000640 1 --2- 172.21.15.3:0/58654099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3c4105810 0x7ff3c41a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:58.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.782+0000 7ff3bbe00640 1 --2- 172.21.15.3:0/58654099 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3c4104e50 0x7ff3c419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:58.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.782+0000 7ff3c3e00640 1 -- 172.21.15.3:0/58654099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3c4105810 msgr2=0x7ff3c41a14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:58.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.782+0000 7ff3c3e00640 1 --2- 172.21.15.3:0/58654099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3c4105810 0x7ff3c41a14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:58.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.782+0000 7ff3c3e00640 1 -- 172.21.15.3:0/58654099 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3c4104e50 msgr2=0x7ff3c419a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:58.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.782+0000 7ff3c3e00640 1 --2- 172.21.15.3:0/58654099 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3c4104e50 0x7ff3c419a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:58.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.782+0000 7ff3c3e00640 1 -- 172.21.15.3:0/58654099 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c41a1b30 con 0x7ff3c4103c50 2024-09-19T06:08:58.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.782+0000 7ff3c9000640 1 --2- 172.21.15.3:0/58654099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3c4105810 0x7ff3c41a14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:08:58.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.782+0000 7ff3c3e00640 1 --2- 172.21.15.3:0/58654099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3c4103c50 0x7ff3c4199f00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400e9f0 tx=0x7ff3b400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:58.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.782+0000 7ff3c1600640 1 -- 172.21.15.3:0/58654099 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b400ccc0 con 0x7ff3c4103c50 2024-09-19T06:08:58.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.783+0000 7ff3c1600640 1 -- 172.21.15.3:0/58654099 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3b40035f0 con 0x7ff3c4103c50 2024-09-19T06:08:58.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.783+0000 7ff3c9a00640 1 -- 172.21.15.3:0/58654099 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c41a1e20 con 0x7ff3c4103c50 2024-09-19T06:08:58.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.783+0000 7ff3c1600640 1 -- 172.21.15.3:0/58654099 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b400ce60 con 0x7ff3c4103c50 2024-09-19T06:08:58.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.783+0000 7ff3c9a00640 1 -- 172.21.15.3:0/58654099 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c41a22d0 con 0x7ff3c4103c50 2024-09-19T06:08:58.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.784+0000 7ff3c9a00640 1 -- 172.21.15.3:0/58654099 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c410b0a0 con 0x7ff3c4103c50 2024-09-19T06:08:58.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.786+0000 7ff3c1600640 1 -- 172.21.15.3:0/58654099 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7ff3b40037a0 con 0x7ff3c4103c50 2024-09-19T06:08:58.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.787+0000 7ff3c1600640 1 --2- 172.21.15.3:0/58654099 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff3a80a32f0 0x7ff3a80a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:08:58.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.787+0000 7ff3c1600640 1 -- 172.21.15.3:0/58654099 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6809+0+0 (secure 0 0 0) 0x7ff3b40cf850 con 0x7ff3c4103c50 2024-09-19T06:08:58.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.787+0000 7ff3bbe00640 1 --2- 172.21.15.3:0/58654099 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff3a80a32f0 0x7ff3a80a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:08:58.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.788+0000 7ff3bbe00640 1 --2- 172.21.15.3:0/58654099 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff3a80a32f0 0x7ff3a80a57b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff3c419b420 tx=0x7ff3ac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:08:58.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.789+0000 7ff3c1600640 1 -- 172.21.15.3:0/58654099 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff3b409cab0 con 0x7ff3c4103c50 2024-09-19T06:08:58.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.977+0000 7ff3c9a00640 1 -- 172.21.15.3:0/58654099 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7ff3c402da10 con 0x7ff3c4103c50 2024-09-19T06:08:58.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.978+0000 7ff3c1600640 1 -- 172.21.15.3:0/58654099 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7ff3b409c3b0 con 0x7ff3c4103c50 2024-09-19T06:08:58.980 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:08:58.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.980+0000 7ff3c9a00640 1 -- 172.21.15.3:0/58654099 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff3a80a32f0 msgr2=0x7ff3a80a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.980+0000 7ff3c9a00640 1 --2- 172.21.15.3:0/58654099 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff3a80a32f0 0x7ff3a80a57b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff3c419b420 tx=0x7ff3ac005f90 comp rx=0 tx=0).stop 2024-09-19T06:08:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.980+0000 7ff3c9a00640 1 -- 172.21.15.3:0/58654099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3c4103c50 msgr2=0x7ff3c4199f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:08:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.980+0000 7ff3c9a00640 1 --2- 172.21.15.3:0/58654099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3c4103c50 0x7ff3c4199f00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400e9f0 tx=0x7ff3b400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:08:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.980+0000 7ff3c9a00640 1 -- 172.21.15.3:0/58654099 shutdown_connections 2024-09-19T06:08:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.980+0000 7ff3c9a00640 1 --2- 172.21.15.3:0/58654099 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff3a80a32f0 0x7ff3a80a57b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.980+0000 7ff3c9a00640 1 --2- 172.21.15.3:0/58654099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3c4105810 0x7ff3c41a14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.980+0000 7ff3c9a00640 1 --2- 172.21.15.3:0/58654099 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3c4104e50 0x7ff3c419a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.980+0000 7ff3c9a00640 1 --2- 172.21.15.3:0/58654099 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff3c4103c50 0x7ff3c4199f00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:08:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.980+0000 7ff3c9a00640 1 -- 172.21.15.3:0/58654099 >> 172.21.15.3:0/58654099 conn(0x7ff3c40ff3e0 msgr2=0x7ff3c4108270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:08:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.981+0000 7ff3c9a00640 1 -- 172.21.15.3:0/58654099 shutdown_connections 2024-09-19T06:08:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:08:58.981+0000 7ff3c9a00640 1 -- 172.21.15.3:0/58654099 wait complete. 2024-09-19T06:08:59.584 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:59 smithi071 ceph-mon[35662]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:08:59.584 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:08:59 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/58654099' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:08:59.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:59 smithi059 ceph-mon[35138]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:08:59.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:08:59 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/58654099' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:08:59.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:59 smithi003 ceph-mon[30893]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:08:59.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:08:59 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/58654099' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:08:59.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:08:59 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:08:59.581+0000 7f3493f7d640 -1 osd.11 0 log_to_monitors true 2024-09-19T06:08:59.878 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":75,"num_osds":12,"num_up_osds":11,"osd_up_since":1726726116,"num_in_osds":12,"osd_in_since":1726726118,"num_remapped_pgs":0} 2024-09-19T06:09:00.668 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:00 smithi071 ceph-mon[35662]: from='osd.11 [v2:172.21.15.71:6824/3502550915,v1:172.21.15.71:6825/3502550915]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:09:00.668 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:00 smithi071 ceph-mon[35662]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:09:00.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:00 smithi059 ceph-mon[35138]: from='osd.11 [v2:172.21.15.71:6824/3502550915,v1:172.21.15.71:6825/3502550915]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:09:00.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:00 smithi059 ceph-mon[35138]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:09:00.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:00 smithi003 ceph-mon[30893]: from='osd.11 [v2:172.21.15.71:6824/3502550915,v1:172.21.15.71:6825/3502550915]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:09:00.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:00 smithi003 ceph-mon[30893]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T06:09:00.880 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T06:09:01.257 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:01.763 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:01 smithi003 ceph-mon[30893]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:09:01.763 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:01 smithi003 ceph-mon[30893]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T06:09:01.763 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:01 smithi003 ceph-mon[30893]: from='osd.11 [v2:172.21.15.71:6824/3502550915,v1:172.21.15.71:6825/3502550915]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-19T06:09:01.764 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:01 smithi003 ceph-mon[30893]: osdmap e76: 12 total, 11 up, 12 in 2024-09-19T06:09:01.764 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:01 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:09:01.764 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:01 smithi003 ceph-mon[30893]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-19T06:09:01.764 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:01 smithi003 ceph-mon[30893]: Detected new or changed devices on smithi071 2024-09-19T06:09:01.764 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:01 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:01.764 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:01 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:01.764 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:01 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:09:01.764 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:01 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:09:01.765 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:01 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:09:01.765 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:01 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:09:01.765 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:01 smithi003 ceph-mon[30893]: Adjusting osd_memory_target on smithi071 to 4272M 2024-09-19T06:09:01.765 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:01 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:01.765 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:01 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:01.765 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:01 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:01.765 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:01 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:01.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:01 smithi059 ceph-mon[35138]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:09:01.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:01 smithi059 ceph-mon[35138]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T06:09:01.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:01 smithi059 ceph-mon[35138]: from='osd.11 [v2:172.21.15.71:6824/3502550915,v1:172.21.15.71:6825/3502550915]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-19T06:09:01.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:01 smithi059 ceph-mon[35138]: osdmap e76: 12 total, 11 up, 12 in 2024-09-19T06:09:01.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:01 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:09:01.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:01 smithi059 ceph-mon[35138]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-19T06:09:01.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:01 smithi059 ceph-mon[35138]: Detected new or changed devices on smithi071 2024-09-19T06:09:01.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:01 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:01.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:01 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:01.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:01 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:09:01.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:01 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:09:01.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:01 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:09:01.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:01 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:09:01.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:01 smithi059 ceph-mon[35138]: Adjusting osd_memory_target on smithi071 to 4272M 2024-09-19T06:09:01.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:01 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:01.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:01 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:01.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:01 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:01.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:01 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:01.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:09:01 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:09:01.482+0000 7f348ff00640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T06:09:01.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:09:01 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:09:01.496+0000 7f348bd28640 -1 osd.11 77 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:09:01.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:01 smithi071 ceph-mon[35662]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:09:01.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:01 smithi071 ceph-mon[35662]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T06:09:01.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:01 smithi071 ceph-mon[35662]: from='osd.11 [v2:172.21.15.71:6824/3502550915,v1:172.21.15.71:6825/3502550915]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-19T06:09:01.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:01 smithi071 ceph-mon[35662]: osdmap e76: 12 total, 11 up, 12 in 2024-09-19T06:09:01.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:01 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:09:01.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:01 smithi071 ceph-mon[35662]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]: dispatch 2024-09-19T06:09:01.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:01 smithi071 ceph-mon[35662]: Detected new or changed devices on smithi071 2024-09-19T06:09:01.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:01 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:01.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:01 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:01.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:01 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:09:01.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:01 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:09:01.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:01 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:09:01.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:01 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:09:01.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:01 smithi071 ceph-mon[35662]: Adjusting osd_memory_target on smithi071 to 4272M 2024-09-19T06:09:01.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:01 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:01.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:01 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:01.838 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:01 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:01.838 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:01 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:01.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.877+0000 7fa3ec600640 1 -- 172.21.15.3:0/2321027408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3e4102e00 msgr2=0x7fa3e4103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:01.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.877+0000 7fa3ec600640 1 --2- 172.21.15.3:0/2321027408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3e4102e00 0x7fa3e4103280 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009900 tx=0x7fa3d002a3f0 comp rx=0 tx=0).stop 2024-09-19T06:09:01.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.877+0000 7fa3ec600640 1 -- 172.21.15.3:0/2321027408 shutdown_connections 2024-09-19T06:09:01.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.877+0000 7fa3ec600640 1 --2- 172.21.15.3:0/2321027408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3e41037c0 0x7fa3e410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:01.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.877+0000 7fa3ec600640 1 --2- 172.21.15.3:0/2321027408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3e4102e00 0x7fa3e4103280 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:01.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.877+0000 7fa3ec600640 1 --2- 172.21.15.3:0/2321027408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3e4101c00 0x7fa3e4102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:01.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.877+0000 7fa3ec600640 1 -- 172.21.15.3:0/2321027408 >> 172.21.15.3:0/2321027408 conn(0x7fa3e40fd390 msgr2=0x7fa3e40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:01.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.877+0000 7fa3ec600640 1 -- 172.21.15.3:0/2321027408 shutdown_connections 2024-09-19T06:09:01.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.877+0000 7fa3ec600640 1 -- 172.21.15.3:0/2321027408 wait complete. 2024-09-19T06:09:01.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.878+0000 7fa3ec600640 1 Processor -- start 2024-09-19T06:09:01.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.878+0000 7fa3ec600640 1 -- start start 2024-09-19T06:09:01.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.879+0000 7fa3ec600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3e4101c00 0x7fa3e419a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:01.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.879+0000 7fa3ec600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3e4102e00 0x7fa3e419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:01.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.879+0000 7fa3ec600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3e41037c0 0x7fa3e41a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:01.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.879+0000 7fa3ec600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e410d8b0 con 0x7fa3e4102e00 2024-09-19T06:09:01.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.879+0000 7fa3ec600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e410d730 con 0x7fa3e41037c0 2024-09-19T06:09:01.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.879+0000 7fa3ec600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e410da30 con 0x7fa3e4101c00 2024-09-19T06:09:01.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.879+0000 7fa3e9200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3e4102e00 0x7fa3e419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:01.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.879+0000 7fa3e9200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3e4102e00 0x7fa3e419a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41348/0 (socket says 172.21.15.3:41348) 2024-09-19T06:09:01.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.879+0000 7fa3e9c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3e4101c00 0x7fa3e419a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:01.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.879+0000 7fa3e9200640 1 -- 172.21.15.3:0/4009069224 learned_addr learned my addr 172.21.15.3:0/4009069224 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:09:01.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.879+0000 7fa3ea600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3e41037c0 0x7fa3e41a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:01.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.880+0000 7fa3ea600640 1 -- 172.21.15.3:0/4009069224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3e4101c00 msgr2=0x7fa3e419a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:01.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.880+0000 7fa3ea600640 1 --2- 172.21.15.3:0/4009069224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3e4101c00 0x7fa3e419a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:01.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.880+0000 7fa3ea600640 1 -- 172.21.15.3:0/4009069224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3e4102e00 msgr2=0x7fa3e419a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:01.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.880+0000 7fa3ea600640 1 --2- 172.21.15.3:0/4009069224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3e4102e00 0x7fa3e419a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:01.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.880+0000 7fa3ea600640 1 -- 172.21.15.3:0/4009069224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e41a1d00 con 0x7fa3e41037c0 2024-09-19T06:09:01.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.880+0000 7fa3e9200640 1 --2- 172.21.15.3:0/4009069224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3e4102e00 0x7fa3e419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:01.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.880+0000 7fa3ea600640 1 --2- 172.21.15.3:0/4009069224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3e41037c0 0x7fa3e41a1690 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc00e940 tx=0x7fa3dc00ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:01.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.880+0000 7fa3e2000640 1 -- 172.21.15.3:0/4009069224 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc004d20 con 0x7fa3e41037c0 2024-09-19T06:09:01.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.880+0000 7fa3e2000640 1 -- 172.21.15.3:0/4009069224 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3dc005020 con 0x7fa3e41037c0 2024-09-19T06:09:01.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.881+0000 7fa3ec600640 1 -- 172.21.15.3:0/4009069224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e41a1ff0 con 0x7fa3e41037c0 2024-09-19T06:09:01.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.881+0000 7fa3e2000640 1 -- 172.21.15.3:0/4009069224 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc0116b0 con 0x7fa3e41037c0 2024-09-19T06:09:01.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.881+0000 7fa3ec600640 1 -- 172.21.15.3:0/4009069224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e41a2450 con 0x7fa3e41037c0 2024-09-19T06:09:01.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.882+0000 7fa3ec600640 1 -- 172.21.15.3:0/4009069224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e41a26e0 con 0x7fa3e41037c0 2024-09-19T06:09:01.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.884+0000 7fa3e2000640 1 -- 172.21.15.3:0/4009069224 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fa3dc0054d0 con 0x7fa3e41037c0 2024-09-19T06:09:01.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.886+0000 7fa3e2000640 1 --2- 172.21.15.3:0/4009069224 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa3cc0a3270 0x7fa3cc0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:01.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.886+0000 7fa3e2000640 1 -- 172.21.15.3:0/4009069224 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6847+0+0 (secure 0 0 0) 0x7fa3dc0cf520 con 0x7fa3e41037c0 2024-09-19T06:09:01.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.886+0000 7fa3e9c00640 1 --2- 172.21.15.3:0/4009069224 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa3cc0a3270 0x7fa3cc0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:01.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.887+0000 7fa3e9c00640 1 --2- 172.21.15.3:0/4009069224 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa3cc0a3270 0x7fa3cc0a5730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8005fd0 tx=0x7fa3d800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:01.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:01.887+0000 7fa3e2000640 1 -- 172.21.15.3:0/4009069224 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa3dc016030 con 0x7fa3e41037c0 2024-09-19T06:09:02.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:02.076+0000 7fa3ec600640 1 -- 172.21.15.3:0/4009069224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fa3e41a28b0 con 0x7fa3e41037c0 2024-09-19T06:09:02.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:02.077+0000 7fa3e2000640 1 -- 172.21.15.3:0/4009069224 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v77) ==== 74+0+133 (secure 0 0 0) 0x7fa3dc09c110 con 0x7fa3e41037c0 2024-09-19T06:09:02.079 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:09:02.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:02.080+0000 7fa3ec600640 1 -- 172.21.15.3:0/4009069224 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa3cc0a3270 msgr2=0x7fa3cc0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:02.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:02.080+0000 7fa3ec600640 1 --2- 172.21.15.3:0/4009069224 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa3cc0a3270 0x7fa3cc0a5730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8005fd0 tx=0x7fa3d800b410 comp rx=0 tx=0).stop 2024-09-19T06:09:02.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:02.080+0000 7fa3ec600640 1 -- 172.21.15.3:0/4009069224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3e41037c0 msgr2=0x7fa3e41a1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:02.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:02.080+0000 7fa3ec600640 1 --2- 172.21.15.3:0/4009069224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3e41037c0 0x7fa3e41a1690 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc00e940 tx=0x7fa3dc00ee00 comp rx=0 tx=0).stop 2024-09-19T06:09:02.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:02.080+0000 7fa3ec600640 1 -- 172.21.15.3:0/4009069224 shutdown_connections 2024-09-19T06:09:02.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:02.080+0000 7fa3ec600640 1 --2- 172.21.15.3:0/4009069224 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa3cc0a3270 0x7fa3cc0a5730 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:02.080+0000 7fa3ec600640 1 --2- 172.21.15.3:0/4009069224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3e41037c0 0x7fa3e41a1690 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:02.080+0000 7fa3ec600640 1 --2- 172.21.15.3:0/4009069224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3e4102e00 0x7fa3e419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:02.080+0000 7fa3ec600640 1 --2- 172.21.15.3:0/4009069224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3e4101c00 0x7fa3e419a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:02.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:02.080+0000 7fa3ec600640 1 -- 172.21.15.3:0/4009069224 >> 172.21.15.3:0/4009069224 conn(0x7fa3e40fd390 msgr2=0x7fa3e4074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:02.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:02.080+0000 7fa3ec600640 1 -- 172.21.15.3:0/4009069224 shutdown_connections 2024-09-19T06:09:02.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:02.080+0000 7fa3ec600640 1 -- 172.21.15.3:0/4009069224 wait complete. 2024-09-19T06:09:02.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:02 smithi059 ceph-mon[35138]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-19T06:09:02.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:02 smithi059 ceph-mon[35138]: osdmap e77: 12 total, 11 up, 12 in 2024-09-19T06:09:02.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:02 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:09:02.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:02 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:09:02.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:02 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/4009069224' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:09:02.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:02 smithi003 ceph-mon[30893]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-19T06:09:02.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:02 smithi003 ceph-mon[30893]: osdmap e77: 12 total, 11 up, 12 in 2024-09-19T06:09:02.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:02 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:09:02.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:02 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:09:02.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:02 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/4009069224' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:09:02.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:02 smithi071 ceph-mon[35662]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi071", "root=default"]}]': finished 2024-09-19T06:09:02.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:02 smithi071 ceph-mon[35662]: osdmap e77: 12 total, 11 up, 12 in 2024-09-19T06:09:02.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:02 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:09:02.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:02 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:09:02.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:02 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/4009069224' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:09:03.044 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":77,"num_osds":12,"num_up_osds":11,"osd_up_since":1726726116,"num_in_osds":12,"osd_in_since":1726726118,"num_remapped_pgs":0} 2024-09-19T06:09:03.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:03 smithi059 ceph-mon[35138]: purged_snaps scrub starts 2024-09-19T06:09:03.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:03 smithi059 ceph-mon[35138]: purged_snaps scrub ok 2024-09-19T06:09:03.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:03 smithi059 ceph-mon[35138]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:09:03.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:03 smithi059 ceph-mon[35138]: osd.11 [v2:172.21.15.71:6824/3502550915,v1:172.21.15.71:6825/3502550915] boot 2024-09-19T06:09:03.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:03 smithi059 ceph-mon[35138]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T06:09:03.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:03 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:09:03.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:03 smithi003 ceph-mon[30893]: purged_snaps scrub starts 2024-09-19T06:09:03.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:03 smithi003 ceph-mon[30893]: purged_snaps scrub ok 2024-09-19T06:09:03.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:03 smithi003 ceph-mon[30893]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:09:03.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:03 smithi003 ceph-mon[30893]: osd.11 [v2:172.21.15.71:6824/3502550915,v1:172.21.15.71:6825/3502550915] boot 2024-09-19T06:09:03.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:03 smithi003 ceph-mon[30893]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T06:09:03.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:03 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:09:03.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:03 smithi071 ceph-mon[35662]: purged_snaps scrub starts 2024-09-19T06:09:03.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:03 smithi071 ceph-mon[35662]: purged_snaps scrub ok 2024-09-19T06:09:03.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:03 smithi071 ceph-mon[35662]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-19T06:09:03.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:03 smithi071 ceph-mon[35662]: osd.11 [v2:172.21.15.71:6824/3502550915,v1:172.21.15.71:6825/3502550915] boot 2024-09-19T06:09:03.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:03 smithi071 ceph-mon[35662]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T06:09:03.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:03 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:09:04.045 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T06:09:04.430 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:04.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:04 smithi059 ceph-mon[35138]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T06:09:04.801 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:04 smithi003 ceph-mon[30893]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T06:09:04.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:04 smithi071 ceph-mon[35662]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T06:09:05.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.066+0000 7f9939800640 1 -- 172.21.15.3:0/3937062828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9934103c50 msgr2=0x7f9934104050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:05.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.066+0000 7f9939800640 1 --2- 172.21.15.3:0/3937062828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9934103c50 0x7f9934104050 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9924009900 tx=0x7f992402a410 comp rx=0 tx=0).stop 2024-09-19T06:09:05.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.066+0000 7f9939800640 1 -- 172.21.15.3:0/3937062828 shutdown_connections 2024-09-19T06:09:05.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.066+0000 7f9939800640 1 --2- 172.21.15.3:0/3937062828 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9934105810 0x7f993410c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:05.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.066+0000 7f9939800640 1 --2- 172.21.15.3:0/3937062828 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9934104e50 0x7f99341052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:05.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.066+0000 7f9939800640 1 --2- 172.21.15.3:0/3937062828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9934103c50 0x7f9934104050 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:05.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.066+0000 7f9939800640 1 -- 172.21.15.3:0/3937062828 >> 172.21.15.3:0/3937062828 conn(0x7f99340ff3e0 msgr2=0x7f9934101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:05.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.066+0000 7f9939800640 1 -- 172.21.15.3:0/3937062828 shutdown_connections 2024-09-19T06:09:05.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.066+0000 7f9939800640 1 -- 172.21.15.3:0/3937062828 wait complete. 2024-09-19T06:09:05.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.067+0000 7f9939800640 1 Processor -- start 2024-09-19T06:09:05.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.068+0000 7f9939800640 1 -- start start 2024-09-19T06:09:05.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.068+0000 7f9939800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9934103c50 0x7f9934199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:05.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.068+0000 7f9939800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9934104e50 0x7f993419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:05.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.068+0000 7f9939800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9934105810 0x7f99341a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:05.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.068+0000 7f9939800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f993410f8d0 con 0x7f9934105810 2024-09-19T06:09:05.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.068+0000 7f9939800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f993410f750 con 0x7f9934104e50 2024-09-19T06:09:05.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.068+0000 7f9939800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f993410fa50 con 0x7f9934103c50 2024-09-19T06:09:05.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.068+0000 7f9933400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9934104e50 0x7f993419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:05.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.068+0000 7f9933e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9934103c50 0x7f9934199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:05.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.068+0000 7f9933400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9934104e50 0x7f993419a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:53096/0 (socket says 172.21.15.3:53096) 2024-09-19T06:09:05.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.068+0000 7f9933400640 1 -- 172.21.15.3:0/2832421094 learned_addr learned my addr 172.21.15.3:0/2832421094 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:09:05.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.068+0000 7f9933e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9934103c50 0x7f9934199f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:59010/0 (socket says 172.21.15.3:59010) 2024-09-19T06:09:05.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.068+0000 7f9938e00640 1 --2- 172.21.15.3:0/2832421094 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9934105810 0x7f99341a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:05.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.069+0000 7f9933400640 1 -- 172.21.15.3:0/2832421094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9934103c50 msgr2=0x7f9934199f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:05.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.069+0000 7f9933400640 1 --2- 172.21.15.3:0/2832421094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9934103c50 0x7f9934199f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:05.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.069+0000 7f9933400640 1 -- 172.21.15.3:0/2832421094 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9934105810 msgr2=0x7f99341a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:05.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.069+0000 7f9933400640 1 --2- 172.21.15.3:0/2832421094 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9934105810 0x7f99341a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:05.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.069+0000 7f9933400640 1 -- 172.21.15.3:0/2832421094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99341a1b70 con 0x7f9934104e50 2024-09-19T06:09:05.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.069+0000 7f9933e00640 1 --2- 172.21.15.3:0/2832421094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9934103c50 0x7f9934199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:05.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.069+0000 7f9933400640 1 --2- 172.21.15.3:0/2832421094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9934104e50 0x7f993419a480 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f992000e9f0 tx=0x7f992000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:05.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.069+0000 7f9930c00640 1 -- 172.21.15.3:0/2832421094 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f992000cd80 con 0x7f9934104e50 2024-09-19T06:09:05.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.069+0000 7f9930c00640 1 -- 172.21.15.3:0/2832421094 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9920005500 con 0x7f9934104e50 2024-09-19T06:09:05.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.069+0000 7f9939800640 1 -- 172.21.15.3:0/2832421094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99341a1e60 con 0x7f9934104e50 2024-09-19T06:09:05.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.069+0000 7f9930c00640 1 -- 172.21.15.3:0/2832421094 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9920010690 con 0x7f9934104e50 2024-09-19T06:09:05.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.069+0000 7f9939800640 1 -- 172.21.15.3:0/2832421094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99341a2310 con 0x7f9934104e50 2024-09-19T06:09:05.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.070+0000 7f9939800640 1 -- 172.21.15.3:0/2832421094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f993410b050 con 0x7f9934104e50 2024-09-19T06:09:05.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.072+0000 7f9930c00640 1 -- 172.21.15.3:0/2832421094 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f99200046c0 con 0x7f9934104e50 2024-09-19T06:09:05.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.074+0000 7f9930c00640 1 --2- 172.21.15.3:0/2832421094 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f99180a32f0 0x7f99180a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:05.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.074+0000 7f9930c00640 1 -- 172.21.15.3:0/2832421094 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f99200cfa30 con 0x7f9934104e50 2024-09-19T06:09:05.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.074+0000 7f9933e00640 1 --2- 172.21.15.3:0/2832421094 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f99180a32f0 0x7f99180a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:05.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.074+0000 7f9933e00640 1 --2- 172.21.15.3:0/2832421094 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f99180a32f0 0x7f99180a57b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9924005ab0 tx=0x7f9924000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:05.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.076+0000 7f9930c00640 1 -- 172.21.15.3:0/2832421094 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f992009cb50 con 0x7f9934104e50 2024-09-19T06:09:05.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.261+0000 7f9939800640 1 -- 172.21.15.3:0/2832421094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f993402da10 con 0x7f9934104e50 2024-09-19T06:09:05.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.261+0000 7f9930c00640 1 -- 172.21.15.3:0/2832421094 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) ==== 74+0+133 (secure 0 0 0) 0x7f992009c450 con 0x7f9934104e50 2024-09-19T06:09:05.263 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:09:05.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.263+0000 7f9939800640 1 -- 172.21.15.3:0/2832421094 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f99180a32f0 msgr2=0x7f99180a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:05.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.263+0000 7f9939800640 1 --2- 172.21.15.3:0/2832421094 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f99180a32f0 0x7f99180a57b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9924005ab0 tx=0x7f9924000bc0 comp rx=0 tx=0).stop 2024-09-19T06:09:05.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.263+0000 7f9939800640 1 -- 172.21.15.3:0/2832421094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9934104e50 msgr2=0x7f993419a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:05.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.263+0000 7f9939800640 1 --2- 172.21.15.3:0/2832421094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9934104e50 0x7f993419a480 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f992000e9f0 tx=0x7f992000edf0 comp rx=0 tx=0).stop 2024-09-19T06:09:05.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.263+0000 7f9939800640 1 -- 172.21.15.3:0/2832421094 shutdown_connections 2024-09-19T06:09:05.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.263+0000 7f9939800640 1 --2- 172.21.15.3:0/2832421094 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f99180a32f0 0x7f99180a57b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:05.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.263+0000 7f9939800640 1 --2- 172.21.15.3:0/2832421094 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9934105810 0x7f99341a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:05.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.263+0000 7f9939800640 1 --2- 172.21.15.3:0/2832421094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9934104e50 0x7f993419a480 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:05.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.263+0000 7f9939800640 1 --2- 172.21.15.3:0/2832421094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9934103c50 0x7f9934199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:05.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.263+0000 7f9939800640 1 -- 172.21.15.3:0/2832421094 >> 172.21.15.3:0/2832421094 conn(0x7f99340ff3e0 msgr2=0x7f9934108220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:05.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.264+0000 7f9939800640 1 -- 172.21.15.3:0/2832421094 shutdown_connections 2024-09-19T06:09:05.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:05.264+0000 7f9939800640 1 -- 172.21.15.3:0/2832421094 wait complete. 2024-09-19T06:09:05.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:05 smithi003 ceph-mon[30893]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:05.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:05 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2832421094' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:09:05.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:05 smithi059 ceph-mon[35138]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:05.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:05 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2832421094' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:09:05.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:05 smithi071 ceph-mon[35662]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:05.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:05 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2832421094' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:09:06.173 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":79,"num_osds":12,"num_up_osds":12,"osd_up_since":1726726142,"num_in_osds":12,"osd_in_since":1726726118,"num_remapped_pgs":0} 2024-09-19T06:09:06.174 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:09:06.547 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:07.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.125+0000 7fc3d3c00640 1 -- 172.21.15.3:0/2507948432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3cc103ff0 msgr2=0x7fc3cc1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:07.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.125+0000 7fc3d3c00640 1 --2- 172.21.15.3:0/2507948432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3cc103ff0 0x7fc3cc1043d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009900 tx=0x7fc3c002a3f0 comp rx=0 tx=0).stop 2024-09-19T06:09:07.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.125+0000 7fc3d3c00640 1 -- 172.21.15.3:0/2507948432 shutdown_connections 2024-09-19T06:09:07.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.125+0000 7fc3d3c00640 1 --2- 172.21.15.3:0/2507948432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3cc109120 0x7fc3cc110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:07.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.125+0000 7fc3d3c00640 1 --2- 172.21.15.3:0/2507948432 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3cc1049a0 0x7fc3cc1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:07.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.125+0000 7fc3d3c00640 1 --2- 172.21.15.3:0/2507948432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3cc103ff0 0x7fc3cc1043d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:07.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.125+0000 7fc3d3c00640 1 -- 172.21.15.3:0/2507948432 >> 172.21.15.3:0/2507948432 conn(0x7fc3cc0ffa90 msgr2=0x7fc3cc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:07.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.125+0000 7fc3d3c00640 1 -- 172.21.15.3:0/2507948432 shutdown_connections 2024-09-19T06:09:07.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.125+0000 7fc3d3c00640 1 -- 172.21.15.3:0/2507948432 wait complete. 2024-09-19T06:09:07.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.126+0000 7fc3d3c00640 1 Processor -- start 2024-09-19T06:09:07.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.126+0000 7fc3d3c00640 1 -- start start 2024-09-19T06:09:07.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.127+0000 7fc3d3c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3cc103ff0 0x7fc3cc19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:07.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.127+0000 7fc3d3c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3cc1049a0 0x7fc3cc19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:07.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.127+0000 7fc3d3c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3cc109120 0x7fc3cc19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:07.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.127+0000 7fc3d3c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc114150 con 0x7fc3cc1049a0 2024-09-19T06:09:07.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.127+0000 7fc3d3c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc113fd0 con 0x7fc3cc109120 2024-09-19T06:09:07.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.127+0000 7fc3d3c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc1142d0 con 0x7fc3cc103ff0 2024-09-19T06:09:07.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.127+0000 7fc3cbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3cc1049a0 0x7fc3cc19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:07.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.127+0000 7fc3cbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3cc1049a0 0x7fc3cc19abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54942/0 (socket says 172.21.15.3:54942) 2024-09-19T06:09:07.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.127+0000 7fc3cbe00640 1 -- 172.21.15.3:0/2120569438 learned_addr learned my addr 172.21.15.3:0/2120569438 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:09:07.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.127+0000 7fc3d1200640 1 --2- 172.21.15.3:0/2120569438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3cc103ff0 0x7fc3cc19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:07.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.127+0000 7fc3d1c00640 1 --2- 172.21.15.3:0/2120569438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3cc109120 0x7fc3cc19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:07.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.127+0000 7fc3d1200640 1 -- 172.21.15.3:0/2120569438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3cc109120 msgr2=0x7fc3cc19ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:07.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.127+0000 7fc3d1200640 1 --2- 172.21.15.3:0/2120569438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3cc109120 0x7fc3cc19ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:07.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.127+0000 7fc3d1200640 1 -- 172.21.15.3:0/2120569438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3cc1049a0 msgr2=0x7fc3cc19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:07.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.127+0000 7fc3d1200640 1 --2- 172.21.15.3:0/2120569438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3cc1049a0 0x7fc3cc19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:07.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.127+0000 7fc3d1200640 1 -- 172.21.15.3:0/2120569438 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3cc19f620 con 0x7fc3cc103ff0 2024-09-19T06:09:07.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.127+0000 7fc3cbe00640 1 --2- 172.21.15.3:0/2120569438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3cc1049a0 0x7fc3cc19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:07.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.128+0000 7fc3d1200640 1 --2- 172.21.15.3:0/2120569438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3cc103ff0 0x7fc3cc19a670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0005940 tx=0x7fc3c00040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:07.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.128+0000 7fc3c9600640 1 -- 172.21.15.3:0/2120569438 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c003f030 con 0x7fc3cc103ff0 2024-09-19T06:09:07.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.128+0000 7fc3d3c00640 1 -- 172.21.15.3:0/2120569438 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3cc19f8b0 con 0x7fc3cc103ff0 2024-09-19T06:09:07.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.128+0000 7fc3c9600640 1 -- 172.21.15.3:0/2120569438 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3c00044c0 con 0x7fc3cc103ff0 2024-09-19T06:09:07.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.128+0000 7fc3c9600640 1 -- 172.21.15.3:0/2120569438 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0035070 con 0x7fc3cc103ff0 2024-09-19T06:09:07.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.128+0000 7fc3d3c00640 1 -- 172.21.15.3:0/2120569438 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3cc1a71f0 con 0x7fc3cc103ff0 2024-09-19T06:09:07.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.129+0000 7fc3d3c00640 1 -- 172.21.15.3:0/2120569438 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3cc1054d0 con 0x7fc3cc103ff0 2024-09-19T06:09:07.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.131+0000 7fc3c9600640 1 -- 172.21.15.3:0/2120569438 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fc3c0042030 con 0x7fc3cc103ff0 2024-09-19T06:09:07.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.132+0000 7fc3c9600640 1 --2- 172.21.15.3:0/2120569438 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc3b40a3240 0x7fc3b40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:07.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.133+0000 7fc3c9600640 1 -- 172.21.15.3:0/2120569438 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7fc3c00ef9d0 con 0x7fc3cc103ff0 2024-09-19T06:09:07.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.133+0000 7fc3cbe00640 1 --2- 172.21.15.3:0/2120569438 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc3b40a3240 0x7fc3b40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:07.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.133+0000 7fc3cbe00640 1 --2- 172.21.15.3:0/2120569438 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc3b40a3240 0x7fc3b40a5700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80095f0 tx=0x7fc3b8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:07.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.134+0000 7fc3c9600640 1 -- 172.21.15.3:0/2120569438 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc3c00bc4a0 con 0x7fc3cc103ff0 2024-09-19T06:09:07.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.321+0000 7fc3d3c00640 1 -- 172.21.15.3:0/2120569438 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3cc10c300 con 0x7fc3cc103ff0 2024-09-19T06:09:07.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.322+0000 7fc3c9600640 1 -- 172.21.15.3:0/2120569438 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+18301 (secure 0 0 0) 0x7fc3c00c07a0 con 0x7fc3cc103ff0 2024-09-19T06:09:07.325 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:09:07.325 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":79,"fsid":"782a5144-764c-11ef-bceb-c7b262605968","created":"2024-09-19T06:01:35.224753+0000","modified":"2024-09-19T06:09:03.485966+0000","last_up_change":"2024-09-19T06:09:02.478979+0000","last_in_change":"2024-09-19T06:08:38.865280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:04:56.654478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd89ea4b-a24e-4946-80fc-1776b6d05e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6803","nonce":2061486638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6805","nonce":2061486638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6809","nonce":2061486638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6807","nonce":2061486638}]},"public_addr":"172.21.15.3:6803/2061486638","cluster_addr":"172.21.15.3:6805/2061486638","heartbeat_back_addr":"172.21.15.3:6809/2061486638","heartbeat_front_addr":"172.21.15.3:6807/2061486638","state":["exists","up"]},{"osd":1,"uuid":"e03ca275-8da5-402f-9cd2-654ca422b9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6801","nonce":129318538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6803","nonce":129318538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6807","nonce":129318538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6805","nonce":129318538}]},"public_addr":"172.21.15.59:6801/129318538","cluster_addr":"172.21.15.59:6803/129318538","heartbeat_back_addr":"172.21.15.59:6807/129318538","heartbeat_front_addr":"172.21.15.59:6805/129318538","state":["exists","up"]},{"osd":2,"uuid":"62b7d36d-6078-4027-93b2-009be70a6d80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6801","nonce":2436210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6803","nonce":2436210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6807","nonce":2436210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6805","nonce":2436210695}]},"public_addr":"172.21.15.71:6801/2436210695","cluster_addr":"172.21.15.71:6803/2436210695","heartbeat_back_addr":"172.21.15.71:6807/2436210695","heartbeat_front_addr":"172.21.15.71:6805/2436210695","state":["exists","up"]},{"osd":3,"uuid":"ba33cc45-0103-443d-b262-622a505d9806","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6811","nonce":3577306700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6813","nonce":3577306700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6817","nonce":3577306700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6815","nonce":3577306700}]},"public_addr":"172.21.15.3:6811/3577306700","cluster_addr":"172.21.15.3:6813/3577306700","heartbeat_back_addr":"172.21.15.3:6817/3577306700","heartbeat_front_addr":"172.21.15.3:6815/3577306700","state":["exists","up"]},{"osd":4,"uuid":"40564c0c-6335-4207-a8e0-8078c9bfd015","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6809","nonce":4002980986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6811","nonce":4002980986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6815","nonce":4002980986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6813","nonce":4002980986}]},"public_addr":"172.21.15.59:6809/4002980986","cluster_addr":"172.21.15.59:6811/4002980986","heartbeat_back_addr":"172.21.15.59:6815/4002980986","heartbeat_front_addr":"172.21.15.59:6813/4002980986","state":["exists","up"]},{"osd":5,"uuid":"4db04b82-3403-4fd5-9eb7-7b81ed6b1d26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6809","nonce":2455500497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6811","nonce":2455500497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6815","nonce":2455500497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6813","nonce":2455500497}]},"public_addr":"172.21.15.71:6809/2455500497","cluster_addr":"172.21.15.71:6811/2455500497","heartbeat_back_addr":"172.21.15.71:6815/2455500497","heartbeat_front_addr":"172.21.15.71:6813/2455500497","state":["exists","up"]},{"osd":6,"uuid":"42a74f01-c5d0-4fc6-a8ee-a8bd84d4ab4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6819","nonce":823411903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6821","nonce":823411903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6825","nonce":823411903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6823","nonce":823411903}]},"public_addr":"172.21.15.3:6819/823411903","cluster_addr":"172.21.15.3:6821/823411903","heartbeat_back_addr":"172.21.15.3:6825/823411903","heartbeat_front_addr":"172.21.15.3:6823/823411903","state":["exists","up"]},{"osd":7,"uuid":"8a9bc2ec-4292-465d-8a0d-dda78521a319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6817","nonce":2133603853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6819","nonce":2133603853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6823","nonce":2133603853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6821","nonce":2133603853}]},"public_addr":"172.21.15.59:6817/2133603853","cluster_addr":"172.21.15.59:6819/2133603853","heartbeat_back_addr":"172.21.15.59:6823/2133603853","heartbeat_front_addr":"172.21.15.59:6821/2133603853","state":["exists","up"]},{"osd":8,"uuid":"6099a5c4-3504-43ca-8c58-d23f9096cd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6817","nonce":905333117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6819","nonce":905333117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6823","nonce":905333117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6821","nonce":905333117}]},"public_addr":"172.21.15.71:6817/905333117","cluster_addr":"172.21.15.71:6819/905333117","heartbeat_back_addr":"172.21.15.71:6823/905333117","heartbeat_front_addr":"172.21.15.71:6821/905333117","state":["exists","up"]},{"osd":9,"uuid":"b5a8aac6-bb10-4db8-a056-25228fbe754c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6827","nonce":124909267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6829","nonce":124909267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6833","nonce":124909267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6831","nonce":124909267}]},"public_addr":"172.21.15.3:6827/124909267","cluster_addr":"172.21.15.3:6829/124909267","heartbeat_back_addr":"172.21.15.3:6833/124909267","heartbeat_front_addr":"172.21.15.3:6831/124909267","state":["exists","up"]},{"osd":10,"uuid":"e49f3aab-0804-4aea-ae3f-38f022ab5239","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6825","nonce":784134238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6827","nonce":784134238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6831","nonce":784134238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6829","nonce":784134238}]},"public_addr":"172.21.15.59:6825/784134238","cluster_addr":"172.21.15.59:6827/784134238","heartbeat_back_addr":"172.21.15.59:6831/784134238","heartbeat_front_addr":"172.21.15.59:6829/784134238","state":["exists","up"]},{"osd":11,"uuid":"6c6d6c23-bcf7-43e7-94d1-5f2ebaa15441","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6825","nonce":3502550915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6827","nonce":3502550915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6831","nonce":3502550915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6829","nonce":3502550915}]},"public_addr":"172.21.15.71:6825/3502550915","cluster_addr":"172.21.15.71:6827/3502550915","heartbeat_back_addr":"172.21.15.71:6831/3502550915","heartbeat_front_addr":"172.21.15.71:6829/3502550915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:01.683342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:28.058683+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:53.250819+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:05:23.267377+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:05:49.756289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:06:15.766613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:06:46.054328+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:12.579180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:37.976863+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:08.683966+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:35.120765+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:00.624411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/1458736313":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/2065281908":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/953348594":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6801/518259590":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/1658697906":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6801/2386230415":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6800/2386230415":"2024-09-20T06:02:01.122348+0000","172.21.15.3:0/1616091100":"2024-09-20T06:02:30.039686+0000","172.21.15.3:6800/518259590":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/2122482494":"2024-09-20T06:02:01.122348+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:09:07.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.325+0000 7fc3d3c00640 1 -- 172.21.15.3:0/2120569438 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc3b40a3240 msgr2=0x7fc3b40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:07.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.325+0000 7fc3d3c00640 1 --2- 172.21.15.3:0/2120569438 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc3b40a3240 0x7fc3b40a5700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80095f0 tx=0x7fc3b8005f90 comp rx=0 tx=0).stop 2024-09-19T06:09:07.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.325+0000 7fc3d3c00640 1 -- 172.21.15.3:0/2120569438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3cc103ff0 msgr2=0x7fc3cc19a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:07.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.325+0000 7fc3d3c00640 1 --2- 172.21.15.3:0/2120569438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3cc103ff0 0x7fc3cc19a670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0005940 tx=0x7fc3c00040c0 comp rx=0 tx=0).stop 2024-09-19T06:09:07.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.325+0000 7fc3d3c00640 1 -- 172.21.15.3:0/2120569438 shutdown_connections 2024-09-19T06:09:07.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.325+0000 7fc3d3c00640 1 --2- 172.21.15.3:0/2120569438 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc3b40a3240 0x7fc3b40a5700 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:07.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.325+0000 7fc3d3c00640 1 --2- 172.21.15.3:0/2120569438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3cc109120 0x7fc3cc19ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:07.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.325+0000 7fc3d3c00640 1 --2- 172.21.15.3:0/2120569438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3cc1049a0 0x7fc3cc19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:07.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.325+0000 7fc3d3c00640 1 --2- 172.21.15.3:0/2120569438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3cc103ff0 0x7fc3cc19a670 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:07.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.325+0000 7fc3d3c00640 1 -- 172.21.15.3:0/2120569438 >> 172.21.15.3:0/2120569438 conn(0x7fc3cc0ffa90 msgr2=0x7fc3cc100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:07.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.325+0000 7fc3d3c00640 1 -- 172.21.15.3:0/2120569438 shutdown_connections 2024-09-19T06:09:07.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:07.325+0000 7fc3d3c00640 1 -- 172.21.15.3:0/2120569438 wait complete. 2024-09-19T06:09:07.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:07 smithi003 ceph-mon[30893]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:07.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:07 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2120569438' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:09:07.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:07 smithi059 ceph-mon[35138]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:07.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:07 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2120569438' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:09:07.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:07 smithi071 ceph-mon[35662]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:07.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:07 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2120569438' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:09:08.128 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T06:04:56.654478+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T06:09:08.128 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T06:09:08.501 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:09.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.100+0000 7f311ea00640 1 -- 172.21.15.3:0/3522541546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3118102360 msgr2=0x7f311810e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:09.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.100+0000 7f311ea00640 1 --2- 172.21.15.3:0/3522541546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3118102360 0x7f311810e890 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3110009cd0 tx=0x7f311002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:09:09.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.100+0000 7f311ea00640 1 -- 172.21.15.3:0/3522541546 shutdown_connections 2024-09-19T06:09:09.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.100+0000 7f311ea00640 1 --2- 172.21.15.3:0/3522541546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3118102360 0x7f311810e890 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:09.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.100+0000 7f311ea00640 1 --2- 172.21.15.3:0/3522541546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31181019c0 0x7f3118101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:09.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.100+0000 7f311ea00640 1 --2- 172.21.15.3:0/3522541546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31181079c0 0x7f3118107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:09.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.100+0000 7f311ea00640 1 -- 172.21.15.3:0/3522541546 >> 172.21.15.3:0/3522541546 conn(0x7f31180fd740 msgr2=0x7f31180ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:09.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.100+0000 7f311ea00640 1 -- 172.21.15.3:0/3522541546 shutdown_connections 2024-09-19T06:09:09.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.100+0000 7f311ea00640 1 -- 172.21.15.3:0/3522541546 wait complete. 2024-09-19T06:09:09.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.101+0000 7f311ea00640 1 Processor -- start 2024-09-19T06:09:09.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.102+0000 7f311ea00640 1 -- start start 2024-09-19T06:09:09.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.102+0000 7f311ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31181019c0 0x7f311819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:09.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.102+0000 7f311ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3118102360 0x7f311819a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:09.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.102+0000 7f311ea00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31181079c0 0x7f311819ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:09.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.102+0000 7f311ea00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3118111e10 con 0x7f31181079c0 2024-09-19T06:09:09.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.102+0000 7f311ea00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3118111c90 con 0x7f3118102360 2024-09-19T06:09:09.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.102+0000 7f311ea00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3118111f90 con 0x7f31181019c0 2024-09-19T06:09:09.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.102+0000 7f311e000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31181079c0 0x7f311819ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:09.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.102+0000 7f311cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3118102360 0x7f311819a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:09.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.102+0000 7f311d600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31181019c0 0x7f311819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:09.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.102+0000 7f311cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3118102360 0x7f311819a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:53118/0 (socket says 172.21.15.3:53118) 2024-09-19T06:09:09.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.102+0000 7f311d600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31181019c0 0x7f311819a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:59056/0 (socket says 172.21.15.3:59056) 2024-09-19T06:09:09.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.102+0000 7f311cc00640 1 -- 172.21.15.3:0/2694377373 learned_addr learned my addr 172.21.15.3:0/2694377373 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:09:09.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.102+0000 7f311e000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31181079c0 0x7f311819ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54968/0 (socket says 172.21.15.3:54968) 2024-09-19T06:09:09.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.103+0000 7f311e000640 1 -- 172.21.15.3:0/2694377373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31181019c0 msgr2=0x7f311819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:09.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.103+0000 7f311e000640 1 --2- 172.21.15.3:0/2694377373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31181019c0 0x7f311819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:09.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.103+0000 7f311e000640 1 -- 172.21.15.3:0/2694377373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3118102360 msgr2=0x7f311819a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:09.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.103+0000 7f311e000640 1 --2- 172.21.15.3:0/2694377373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3118102360 0x7f311819a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:09.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.103+0000 7f311e000640 1 -- 172.21.15.3:0/2694377373 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311819f430 con 0x7f31181079c0 2024-09-19T06:09:09.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.103+0000 7f311e000640 1 --2- 172.21.15.3:0/2694377373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31181079c0 0x7f311819ed50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3110009ca0 tx=0x7f3110031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:09.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.103+0000 7f3116000640 1 -- 172.21.15.3:0/2694377373 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3110004040 con 0x7f31181079c0 2024-09-19T06:09:09.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.103+0000 7f3116000640 1 -- 172.21.15.3:0/2694377373 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31100046c0 con 0x7f31181079c0 2024-09-19T06:09:09.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.103+0000 7f311ea00640 1 -- 172.21.15.3:0/2694377373 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f311819f6c0 con 0x7f31181079c0 2024-09-19T06:09:09.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.103+0000 7f3116000640 1 -- 172.21.15.3:0/2694377373 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3110030e90 con 0x7f31181079c0 2024-09-19T06:09:09.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.104+0000 7f311ea00640 1 -- 172.21.15.3:0/2694377373 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31181a7000 con 0x7f31181079c0 2024-09-19T06:09:09.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.105+0000 7f311ea00640 1 -- 172.21.15.3:0/2694377373 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3118101e20 con 0x7f31181079c0 2024-09-19T06:09:09.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.107+0000 7f3116000640 1 -- 172.21.15.3:0/2694377373 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f31100305a0 con 0x7f31181079c0 2024-09-19T06:09:09.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.108+0000 7f3116000640 1 --2- 172.21.15.3:0/2694377373 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f31000a3240 0x7f31000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:09.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.108+0000 7f3116000640 1 -- 172.21.15.3:0/2694377373 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f311002e030 con 0x7f31181079c0 2024-09-19T06:09:09.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.108+0000 7f311d600640 1 --2- 172.21.15.3:0/2694377373 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f31000a3240 0x7f31000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:09.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.109+0000 7f311d600640 1 --2- 172.21.15.3:0/2694377373 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f31000a3240 0x7f31000a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f310c005d00 tx=0x7f310c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:09.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.112+0000 7f3116000640 1 -- 172.21.15.3:0/2694377373 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f311004b060 con 0x7f31181079c0 2024-09-19T06:09:09.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.294+0000 7f311ea00640 1 -- 172.21.15.3:0/2694377373 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f31181a7230 con 0x7f31181079c0 2024-09-19T06:09:09.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.295+0000 7f3116000640 1 -- 172.21.15.3:0/2694377373 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) ==== 93+0+10 (secure 0 0 0) 0x7f31100bd990 con 0x7f31181079c0 2024-09-19T06:09:09.297 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2024-09-19T06:09:09.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.298+0000 7f311ea00640 1 -- 172.21.15.3:0/2694377373 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f31000a3240 msgr2=0x7f31000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:09.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.298+0000 7f311ea00640 1 --2- 172.21.15.3:0/2694377373 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f31000a3240 0x7f31000a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f310c005d00 tx=0x7f310c00b410 comp rx=0 tx=0).stop 2024-09-19T06:09:09.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.298+0000 7f311ea00640 1 -- 172.21.15.3:0/2694377373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31181079c0 msgr2=0x7f311819ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:09.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.298+0000 7f311ea00640 1 --2- 172.21.15.3:0/2694377373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31181079c0 0x7f311819ed50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3110009ca0 tx=0x7f3110031e60 comp rx=0 tx=0).stop 2024-09-19T06:09:09.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.298+0000 7f311ea00640 1 -- 172.21.15.3:0/2694377373 shutdown_connections 2024-09-19T06:09:09.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.298+0000 7f311ea00640 1 --2- 172.21.15.3:0/2694377373 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f31000a3240 0x7f31000a5700 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:09.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.298+0000 7f311ea00640 1 --2- 172.21.15.3:0/2694377373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31181079c0 0x7f311819ed50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:09.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.298+0000 7f311ea00640 1 --2- 172.21.15.3:0/2694377373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3118102360 0x7f311819a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:09.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.298+0000 7f311ea00640 1 --2- 172.21.15.3:0/2694377373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31181019c0 0x7f311819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:09.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.298+0000 7f311ea00640 1 -- 172.21.15.3:0/2694377373 >> 172.21.15.3:0/2694377373 conn(0x7f31180fd740 msgr2=0x7f31180fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:09.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.298+0000 7f311ea00640 1 -- 172.21.15.3:0/2694377373 shutdown_connections 2024-09-19T06:09:09.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:09.299+0000 7f311ea00640 1 -- 172.21.15.3:0/2694377373 wait complete. 2024-09-19T06:09:09.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:09 smithi003 ceph-mon[30893]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:09.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:09 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2694377373' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:09:09.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:09 smithi059 ceph-mon[35138]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:09.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:09 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2694377373' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:09:09.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:09 smithi071 ceph-mon[35662]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:09.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:09 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2694377373' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:09:10.108 INFO:tasks.cephadm:Adding mds.a on smithi003 2024-09-19T06:09:10.108 INFO:tasks.cephadm:Adding mds.d on smithi003 2024-09-19T06:09:10.108 INFO:tasks.cephadm:Adding mds.g on smithi003 2024-09-19T06:09:10.108 INFO:tasks.cephadm:Adding mds.j on smithi003 2024-09-19T06:09:10.109 INFO:tasks.cephadm:Adding mds.b on smithi059 2024-09-19T06:09:10.109 INFO:tasks.cephadm:Adding mds.e on smithi059 2024-09-19T06:09:10.109 INFO:tasks.cephadm:Adding mds.h on smithi059 2024-09-19T06:09:10.109 INFO:tasks.cephadm:Adding mds.k on smithi059 2024-09-19T06:09:10.109 INFO:tasks.cephadm:Adding mds.c on smithi071 2024-09-19T06:09:10.109 INFO:tasks.cephadm:Adding mds.f on smithi071 2024-09-19T06:09:10.109 INFO:tasks.cephadm:Adding mds.i on smithi071 2024-09-19T06:09:10.109 INFO:tasks.cephadm:Adding mds.l on smithi071 2024-09-19T06:09:10.109 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi003=a;smithi003=d;smithi003=g;smithi003=j;smithi059=b;smithi059=e;smithi059=h;smithi059=k;smithi071=c;smithi071=f;smithi071=i;smithi071=l' 2024-09-19T06:09:10.369 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:09:10.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.854+0000 7f9abc037640 1 -- 172.21.15.71:0/1796717468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ab4101cd0 msgr2=0x7f9ab4102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:10.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.854+0000 7f9abc037640 1 --2- 172.21.15.71:0/1796717468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ab4101cd0 0x7f9ab4102150 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0009900 tx=0x7f9ab002a410 comp rx=0 tx=0).stop 2024-09-19T06:09:10.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.854+0000 7f9abc037640 1 -- 172.21.15.71:0/1796717468 shutdown_connections 2024-09-19T06:09:10.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.854+0000 7f9abc037640 1 --2- 172.21.15.71:0/1796717468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ab4102690 0x7f9ab4108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:10.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.854+0000 7f9abc037640 1 --2- 172.21.15.71:0/1796717468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ab4101cd0 0x7f9ab4102150 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:10.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.854+0000 7f9abc037640 1 --2- 172.21.15.71:0/1796717468 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ab4100ad0 0x7f9ab4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:10.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.854+0000 7f9abc037640 1 -- 172.21.15.71:0/1796717468 >> 172.21.15.71:0/1796717468 conn(0x7f9ab40fc280 msgr2=0x7f9ab40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:10.896 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.854+0000 7f9abc037640 1 -- 172.21.15.71:0/1796717468 shutdown_connections 2024-09-19T06:09:10.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.854+0000 7f9abc037640 1 -- 172.21.15.71:0/1796717468 wait complete. 2024-09-19T06:09:10.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.854+0000 7f9abc037640 1 Processor -- start 2024-09-19T06:09:10.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.854+0000 7f9abc037640 1 -- start start 2024-09-19T06:09:10.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.855+0000 7f9abc037640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ab4100ad0 0x7f9ab4197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:10.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.855+0000 7f9abc037640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ab4101cd0 0x7f9ab4198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:10.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.855+0000 7f9abc037640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ab4102690 0x7f9ab419f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:10.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.855+0000 7f9abc037640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab410d880 con 0x7f9ab4100ad0 2024-09-19T06:09:10.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.855+0000 7f9abc037640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab410d700 con 0x7f9ab4102690 2024-09-19T06:09:10.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.855+0000 7f9abc037640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab410da00 con 0x7f9ab4101cd0 2024-09-19T06:09:10.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.855+0000 7f9ab95d2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ab4101cd0 0x7f9ab4198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:10.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.855+0000 7f9ab95d2640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ab4101cd0 0x7f9ab4198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.71:36164/0 (socket says 172.21.15.71:36164) 2024-09-19T06:09:10.897 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.855+0000 7f9ab95d2640 1 -- 172.21.15.71:0/2173998731 learned_addr learned my addr 172.21.15.71:0/2173998731 (peer_addr_for_me v2:172.21.15.71:0/0) 2024-09-19T06:09:10.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.855+0000 7f9aba5d4640 1 --2- 172.21.15.71:0/2173998731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ab4102690 0x7f9ab419f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:10.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.855+0000 7f9ab95d2640 1 -- 172.21.15.71:0/2173998731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ab4102690 msgr2=0x7f9ab419f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:10.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.855+0000 7f9ab95d2640 1 --2- 172.21.15.71:0/2173998731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ab4102690 0x7f9ab419f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:10.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.855+0000 7f9ab95d2640 1 -- 172.21.15.71:0/2173998731 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ab4100ad0 msgr2=0x7f9ab4197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:10.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.855+0000 7f9ab95d2640 1 --2- 172.21.15.71:0/2173998731 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ab4100ad0 0x7f9ab4197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:10.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.855+0000 7f9ab95d2640 1 -- 172.21.15.71:0/2173998731 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab419fb10 con 0x7f9ab4101cd0 2024-09-19T06:09:10.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.855+0000 7f9ab95d2640 1 --2- 172.21.15.71:0/2173998731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ab4101cd0 0x7f9ab4198420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0009230 tx=0x7f9ab0031b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:10.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.855+0000 7f9aaaffd640 1 -- 172.21.15.71:0/2173998731 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab003f030 con 0x7f9ab4101cd0 2024-09-19T06:09:10.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.855+0000 7f9abc037640 1 -- 172.21.15.71:0/2173998731 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab419fda0 con 0x7f9ab4101cd0 2024-09-19T06:09:10.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.855+0000 7f9aaaffd640 1 -- 172.21.15.71:0/2173998731 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ab0003ad0 con 0x7f9ab4101cd0 2024-09-19T06:09:10.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.855+0000 7f9aaaffd640 1 -- 172.21.15.71:0/2173998731 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0035070 con 0x7f9ab4101cd0 2024-09-19T06:09:10.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.855+0000 7f9abc037640 1 -- 172.21.15.71:0/2173998731 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ab41a0270 con 0x7f9ab4101cd0 2024-09-19T06:09:10.898 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.857+0000 7f9abc037640 1 -- 172.21.15.71:0/2173998731 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ab4107e70 con 0x7f9ab4101cd0 2024-09-19T06:09:10.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.858+0000 7f9aaaffd640 1 -- 172.21.15.71:0/2173998731 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f9ab0042030 con 0x7f9ab4101cd0 2024-09-19T06:09:10.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.858+0000 7f9aaaffd640 1 --2- 172.21.15.71:0/2173998731 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f9aa00a3270 0x7f9aa00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:10.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.858+0000 7f9aaaffd640 1 -- 172.21.15.71:0/2173998731 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f9ab00efab0 con 0x7f9ab4101cd0 2024-09-19T06:09:10.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.858+0000 7f9ab9dd3640 1 --2- 172.21.15.71:0/2173998731 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f9aa00a3270 0x7f9aa00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:10.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.859+0000 7f9ab9dd3640 1 --2- 172.21.15.71:0/2173998731 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f9aa00a3270 0x7f9aa00a5730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4101b30 tx=0x7f9aa4005ed0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:10.899 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:10.862+0000 7f9aaaffd640 1 -- 172.21.15.71:0/2173998731 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9ab00bcc70 con 0x7f9ab4101cd0 2024-09-19T06:09:11.045 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:11.043+0000 7f9abc037640 1 -- 172.21.15.71:0/2173998731 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi003=a;smithi003=d;smithi003=g;smithi003=j;smithi059=b;smithi059=e;smithi059=h;smithi059=k;smithi071=c;smithi071=f;smithi071=i;smithi071=l", "target": ["mon-mgr", ""]}) -- 0x7f9ab40627f0 con 0x7f9aa00a3270 2024-09-19T06:09:11.053 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:11.052+0000 7f9aaaffd640 1 -- 172.21.15.71:0/2173998731 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f9ab40627f0 con 0x7f9aa00a3270 2024-09-19T06:09:11.054 INFO:teuthology.orchestra.run.smithi071.stdout:Scheduled mds.all update... 2024-09-19T06:09:11.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:11.054+0000 7f9abc037640 1 -- 172.21.15.71:0/2173998731 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f9aa00a3270 msgr2=0x7f9aa00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:11.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:11.054+0000 7f9abc037640 1 --2- 172.21.15.71:0/2173998731 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f9aa00a3270 0x7f9aa00a5730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4101b30 tx=0x7f9aa4005ed0 comp rx=0 tx=0).stop 2024-09-19T06:09:11.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:11.054+0000 7f9abc037640 1 -- 172.21.15.71:0/2173998731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ab4101cd0 msgr2=0x7f9ab4198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:11.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:11.054+0000 7f9abc037640 1 --2- 172.21.15.71:0/2173998731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ab4101cd0 0x7f9ab4198420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0009230 tx=0x7f9ab0031b60 comp rx=0 tx=0).stop 2024-09-19T06:09:11.056 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:11.054+0000 7f9abc037640 1 -- 172.21.15.71:0/2173998731 shutdown_connections 2024-09-19T06:09:11.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:11.054+0000 7f9abc037640 1 --2- 172.21.15.71:0/2173998731 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f9aa00a3270 0x7f9aa00a5730 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:11.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:11.054+0000 7f9abc037640 1 --2- 172.21.15.71:0/2173998731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ab4102690 0x7f9ab419f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:11.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:11.054+0000 7f9abc037640 1 --2- 172.21.15.71:0/2173998731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ab4101cd0 0x7f9ab4198420 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:11.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:11.054+0000 7f9abc037640 1 --2- 172.21.15.71:0/2173998731 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ab4100ad0 0x7f9ab4197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:11.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:11.054+0000 7f9abc037640 1 -- 172.21.15.71:0/2173998731 >> 172.21.15.71:0/2173998731 conn(0x7f9ab40fc280 msgr2=0x7f9ab4105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:11.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:11.055+0000 7f9abc037640 1 -- 172.21.15.71:0/2173998731 shutdown_connections 2024-09-19T06:09:11.057 INFO:teuthology.orchestra.run.smithi071.stderr:2024-09-19T06:09:11.055+0000 7f9abc037640 1 -- 172.21.15.71:0/2173998731 wait complete. 2024-09-19T06:09:11.809 DEBUG:teuthology.orchestra.run.smithi003:mds.a> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T06:09:11.814 DEBUG:teuthology.orchestra.run.smithi003:mds.d> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T06:09:11.858 DEBUG:teuthology.orchestra.run.smithi003:mds.g> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T06:09:11.903 DEBUG:teuthology.orchestra.run.smithi003:mds.j> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T06:09:11.949 DEBUG:teuthology.orchestra.run.smithi059:mds.b> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T06:09:11.952 DEBUG:teuthology.orchestra.run.smithi059:mds.e> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T06:09:11.995 DEBUG:teuthology.orchestra.run.smithi059:mds.h> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T06:09:12.037 DEBUG:teuthology.orchestra.run.smithi059:mds.k> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T06:09:12.080 DEBUG:teuthology.orchestra.run.smithi071:mds.c> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T06:09:12.083 DEBUG:teuthology.orchestra.run.smithi071:mds.f> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T06:09:12.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:12 smithi071 ceph-mon[35662]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:12.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:12 smithi071 ceph-mon[35662]: from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi003=a;smithi003=d;smithi003=g;smithi003=j;smithi059=b;smithi059=e;smithi059=h;smithi059=k;smithi071=c;smithi071=f;smithi071=i;smithi071=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:09:12.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:12 smithi071 ceph-mon[35662]: Saving service mds.all spec with placement smithi003=a;smithi003=d;smithi003=g;smithi003=j;smithi059=b;smithi059=e;smithi059=h;smithi059=k;smithi071=c;smithi071=f;smithi071=i;smithi071=l;count:12 2024-09-19T06:09:12.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:12 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:12.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:12 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:12.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:12 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:12.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:12 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:12.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:12 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:12.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:12 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:12.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:12 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:12.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:12 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:12.087 DEBUG:teuthology.orchestra.run.smithi071:mds.i> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T06:09:12.129 DEBUG:teuthology.orchestra.run.smithi071:mds.l> sudo journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T06:09:12.173 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T06:09:12.174 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:09:12.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:12 smithi003 ceph-mon[30893]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:12.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:12 smithi003 ceph-mon[30893]: from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi003=a;smithi003=d;smithi003=g;smithi003=j;smithi059=b;smithi059=e;smithi059=h;smithi059=k;smithi071=c;smithi071=f;smithi071=i;smithi071=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:09:12.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:12 smithi003 ceph-mon[30893]: Saving service mds.all spec with placement smithi003=a;smithi003=d;smithi003=g;smithi003=j;smithi059=b;smithi059=e;smithi059=h;smithi059=k;smithi071=c;smithi071=f;smithi071=i;smithi071=l;count:12 2024-09-19T06:09:12.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:12 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:12.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:12 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:12.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:12 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:12.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:12 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:12.224 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:12 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:12.224 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:12 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:12.224 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:12 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:12.224 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:12 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:12.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:12 smithi059 ceph-mon[35138]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:12.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:12 smithi059 ceph-mon[35138]: from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi003=a;smithi003=d;smithi003=g;smithi003=j;smithi059=b;smithi059=e;smithi059=h;smithi059=k;smithi071=c;smithi071=f;smithi071=i;smithi071=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:09:12.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:12 smithi059 ceph-mon[35138]: Saving service mds.all spec with placement smithi003=a;smithi003=d;smithi003=g;smithi003=j;smithi059=b;smithi059=e;smithi059=h;smithi059=k;smithi071=c;smithi071=f;smithi071=i;smithi071=l;count:12 2024-09-19T06:09:12.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:12 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:12.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:12 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:12.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:12 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:12.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:12 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:12.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:12 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:12.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:12 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:12.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:12 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:12.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:12 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:12.542 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:13.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.124+0000 7f68c6800640 1 -- 172.21.15.3:0/397138189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68c01079c0 msgr2=0x7f68c0107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:13.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.124+0000 7f68c6800640 1 --2- 172.21.15.3:0/397138189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68c01079c0 0x7f68c0107da0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009930 tx=0x7f68b402a420 comp rx=0 tx=0).stop 2024-09-19T06:09:13.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.124+0000 7f68c6800640 1 -- 172.21.15.3:0/397138189 shutdown_connections 2024-09-19T06:09:13.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.124+0000 7f68c6800640 1 --2- 172.21.15.3:0/397138189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68c0102360 0x7f68c010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:13.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.124+0000 7f68c6800640 1 --2- 172.21.15.3:0/397138189 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68c01019c0 0x7f68c0101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:13.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.124+0000 7f68c6800640 1 --2- 172.21.15.3:0/397138189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68c01079c0 0x7f68c0107da0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:13.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.124+0000 7f68c6800640 1 -- 172.21.15.3:0/397138189 >> 172.21.15.3:0/397138189 conn(0x7f68c00fd740 msgr2=0x7f68c00ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:13.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.124+0000 7f68c6800640 1 -- 172.21.15.3:0/397138189 shutdown_connections 2024-09-19T06:09:13.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.124+0000 7f68c6800640 1 -- 172.21.15.3:0/397138189 wait complete. 2024-09-19T06:09:13.128 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:13 smithi003 ceph-mon[30893]: Deploying daemon mds.l on smithi071 2024-09-19T06:09:13.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.125+0000 7f68c6800640 1 Processor -- start 2024-09-19T06:09:13.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.125+0000 7f68c6800640 1 -- start start 2024-09-19T06:09:13.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.126+0000 7f68c6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68c01019c0 0x7f68c019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:13.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.126+0000 7f68c6800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68c0102360 0x7f68c019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:13.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.126+0000 7f68c6800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68c01079c0 0x7f68c019edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:13.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.126+0000 7f68c6800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f68c0111dd0 con 0x7f68c0102360 2024-09-19T06:09:13.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.126+0000 7f68c6800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f68c0111c50 con 0x7f68c01019c0 2024-09-19T06:09:13.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.126+0000 7f68c6800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f68c0111f50 con 0x7f68c01079c0 2024-09-19T06:09:13.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.126+0000 7f68c4a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68c0102360 0x7f68c019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:13.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.126+0000 7f68c5400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68c01019c0 0x7f68c019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:13.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.126+0000 7f68c5400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68c01019c0 0x7f68c019a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:53136/0 (socket says 172.21.15.3:53136) 2024-09-19T06:09:13.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.126+0000 7f68c5400640 1 -- 172.21.15.3:0/3600948888 learned_addr learned my addr 172.21.15.3:0/3600948888 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:09:13.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.126+0000 7f68c5e00640 1 --2- 172.21.15.3:0/3600948888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68c01079c0 0x7f68c019edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:13.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.126+0000 7f68c5400640 1 -- 172.21.15.3:0/3600948888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68c01079c0 msgr2=0x7f68c019edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:13.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.126+0000 7f68c5400640 1 --2- 172.21.15.3:0/3600948888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68c01079c0 0x7f68c019edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:13.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.127+0000 7f68c5400640 1 -- 172.21.15.3:0/3600948888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68c0102360 msgr2=0x7f68c019aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:13.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.127+0000 7f68c5400640 1 --2- 172.21.15.3:0/3600948888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68c0102360 0x7f68c019aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:13.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.127+0000 7f68c5400640 1 -- 172.21.15.3:0/3600948888 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c019f490 con 0x7f68c01019c0 2024-09-19T06:09:13.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.127+0000 7f68c4a00640 1 --2- 172.21.15.3:0/3600948888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68c0102360 0x7f68c019aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:13.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.127+0000 7f68c5400640 1 --2- 172.21.15.3:0/3600948888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68c01019c0 0x7f68c019a4e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f68b402a940 tx=0x7f68b4003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:13.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.127+0000 7f68be000640 1 -- 172.21.15.3:0/3600948888 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b403f070 con 0x7f68c01019c0 2024-09-19T06:09:13.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.127+0000 7f68be000640 1 -- 172.21.15.3:0/3600948888 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68b4031c90 con 0x7f68c01019c0 2024-09-19T06:09:13.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.127+0000 7f68be000640 1 -- 172.21.15.3:0/3600948888 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4035030 con 0x7f68c01019c0 2024-09-19T06:09:13.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.127+0000 7f68c6800640 1 -- 172.21.15.3:0/3600948888 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c019f720 con 0x7f68c01019c0 2024-09-19T06:09:13.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.127+0000 7f68c6800640 1 -- 172.21.15.3:0/3600948888 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c019fbb0 con 0x7f68c01019c0 2024-09-19T06:09:13.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.128+0000 7f68c6800640 1 -- 172.21.15.3:0/3600948888 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68c0101e20 con 0x7f68c01019c0 2024-09-19T06:09:13.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.131+0000 7f68be000640 1 -- 172.21.15.3:0/3600948888 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f68b4042070 con 0x7f68c01019c0 2024-09-19T06:09:13.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.132+0000 7f68be000640 1 --2- 172.21.15.3:0/3600948888 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f68a80a3240 0x7f68a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:13.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.132+0000 7f68be000640 1 -- 172.21.15.3:0/3600948888 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f68b40efbc0 con 0x7f68c01019c0 2024-09-19T06:09:13.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.132+0000 7f68c4a00640 1 --2- 172.21.15.3:0/3600948888 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f68a80a3240 0x7f68a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:13.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.133+0000 7f68c4a00640 1 --2- 172.21.15.3:0/3600948888 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f68a80a3240 0x7f68a80a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f68c010e6c0 tx=0x7f68ac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:13.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.136+0000 7f68be000640 1 -- 172.21.15.3:0/3600948888 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f68b40bcce0 con 0x7f68c01019c0 2024-09-19T06:09:13.283 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:13 smithi071 ceph-mon[35662]: Deploying daemon mds.l on smithi071 2024-09-19T06:09:13.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.357+0000 7f68c6800640 1 -- 172.21.15.3:0/3600948888 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68c01a7180 con 0x7f68c01019c0 2024-09-19T06:09:13.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.358+0000 7f68be000640 1 -- 172.21.15.3:0/3600948888 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f68b40bc5e0 con 0x7f68c01019c0 2024-09-19T06:09:13.360 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:09:13.360 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":1,"btime":"2024-09-19T06:01:35:224503+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T06:09:13.361 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 1 2024-09-19T06:09:13.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.360+0000 7f68c6800640 1 -- 172.21.15.3:0/3600948888 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f68a80a3240 msgr2=0x7f68a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:13.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.360+0000 7f68c6800640 1 --2- 172.21.15.3:0/3600948888 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f68a80a3240 0x7f68a80a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f68c010e6c0 tx=0x7f68ac005f90 comp rx=0 tx=0).stop 2024-09-19T06:09:13.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.360+0000 7f68c6800640 1 -- 172.21.15.3:0/3600948888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68c01019c0 msgr2=0x7f68c019a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:13.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.360+0000 7f68c6800640 1 --2- 172.21.15.3:0/3600948888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68c01019c0 0x7f68c019a4e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f68b402a940 tx=0x7f68b4003b20 comp rx=0 tx=0).stop 2024-09-19T06:09:13.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.360+0000 7f68c6800640 1 -- 172.21.15.3:0/3600948888 shutdown_connections 2024-09-19T06:09:13.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.360+0000 7f68c6800640 1 --2- 172.21.15.3:0/3600948888 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f68a80a3240 0x7f68a80a5700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:13.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.360+0000 7f68c6800640 1 --2- 172.21.15.3:0/3600948888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f68c01079c0 0x7f68c019edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:13.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.360+0000 7f68c6800640 1 --2- 172.21.15.3:0/3600948888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f68c0102360 0x7f68c019aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:13.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.360+0000 7f68c6800640 1 --2- 172.21.15.3:0/3600948888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68c01019c0 0x7f68c019a4e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:13.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.360+0000 7f68c6800640 1 -- 172.21.15.3:0/3600948888 >> 172.21.15.3:0/3600948888 conn(0x7f68c00fd740 msgr2=0x7f68c010cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:13.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.360+0000 7f68c6800640 1 -- 172.21.15.3:0/3600948888 shutdown_connections 2024-09-19T06:09:13.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:13.360+0000 7f68c6800640 1 -- 172.21.15.3:0/3600948888 wait complete. 2024-09-19T06:09:13.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:13 smithi059 ceph-mon[35138]: Deploying daemon mds.l on smithi071 2024-09-19T06:09:13.586 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 19 06:09:13 smithi071 systemd[1]: Starting Ceph mds.l for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:09:13.930 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 19 06:09:13 smithi071 podman[65430]: 2024-09-19 06:09:13.578990693 +0000 UTC m=+0.015954470 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:09:13.930 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 19 06:09:13 smithi071 podman[65430]: 2024-09-19 06:09:13.696370165 +0000 UTC m=+0.133333929 container create bf30b1269f5fd06ee4c9b2e0ce14980d523ed06f4b83d6db7296ebf9b50a2dd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-l, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:09:13.930 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 19 06:09:13 smithi071 podman[65430]: 2024-09-19 06:09:13.926084707 +0000 UTC m=+0.363048473 container init bf30b1269f5fd06ee4c9b2e0ce14980d523ed06f4b83d6db7296ebf9b50a2dd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-l, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T06:09:13.930 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 19 06:09:13 smithi071 podman[65430]: 2024-09-19 06:09:13.928761863 +0000 UTC m=+0.365725629 container start bf30b1269f5fd06ee4c9b2e0ce14980d523ed06f4b83d6db7296ebf9b50a2dd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-l, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:09:14.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:14 smithi003 ceph-mon[30893]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:14.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:14 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3600948888' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:14.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:14 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.71:6832/2883963583,v1:172.21.15.71:6833/2883963583] up:boot 2024-09-19T06:09:14.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:14 smithi003 ceph-mon[30893]: fsmap 1 up:standby 2024-09-19T06:09:14.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:14 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:09:14.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:14 smithi071 ceph-mon[35662]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:14.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:14 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/3600948888' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:14.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:14 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.71:6832/2883963583,v1:172.21.15.71:6833/2883963583] up:boot 2024-09-19T06:09:14.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:14 smithi071 ceph-mon[35662]: fsmap 1 up:standby 2024-09-19T06:09:14.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:14 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:09:14.336 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 19 06:09:13 smithi071 ceph-mds[65450]: -- 172.21.15.71:0/2417420467 <== mon.1 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5631e3fdd860 con 0x5631e3fba800 2024-09-19T06:09:14.336 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 19 06:09:13 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-l[65446]: starting mds.l at 2024-09-19T06:09:14.336 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 19 06:09:14 smithi071 bash[65430]: bf30b1269f5fd06ee4c9b2e0ce14980d523ed06f4b83d6db7296ebf9b50a2dd5 2024-09-19T06:09:14.336 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 19 06:09:14 smithi071 systemd[1]: Started Ceph mds.l for 782a5144-764c-11ef-bceb-c7b262605968. 2024-09-19T06:09:14.527 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:14 smithi059 ceph-mon[35138]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:14.527 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:14 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/3600948888' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:14.527 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:14 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.71:6832/2883963583,v1:172.21.15.71:6833/2883963583] up:boot 2024-09-19T06:09:14.527 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:14 smithi059 ceph-mon[35138]: fsmap 1 up:standby 2024-09-19T06:09:14.527 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:14 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:09:15.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:15 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:15.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:15 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:15.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:15 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:15.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:15 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:15.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:15 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:15.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:15 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:15.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:15 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:15.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:15 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:15.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:15 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:15.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:15 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:15.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:15 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:15.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:15 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:15.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:15 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:15.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:15 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:15.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:15 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:15.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:15 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:15.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:15 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:15.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:15 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:16.114 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:09:16.257 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:16 smithi059 ceph-mon[35138]: Deploying daemon mds.k on smithi059 2024-09-19T06:09:16.257 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:16 smithi059 ceph-mon[35138]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:16.257 INFO:journalctl@ceph.mds.k.smithi059.stdout:Sep 19 06:09:16 smithi059 systemd[1]: Starting Ceph mds.k for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:09:16.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:16 smithi003 ceph-mon[30893]: Deploying daemon mds.k on smithi059 2024-09-19T06:09:16.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:16 smithi003 ceph-mon[30893]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:16.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:16 smithi071 ceph-mon[35662]: Deploying daemon mds.k on smithi059 2024-09-19T06:09:16.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:16 smithi071 ceph-mon[35662]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:16.499 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:16.538 INFO:journalctl@ceph.mds.k.smithi059.stdout:Sep 19 06:09:16 smithi059 podman[64393]: 2024-09-19 06:09:16.368611644 +0000 UTC m=+0.016088800 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:09:16.934 INFO:journalctl@ceph.mds.k.smithi059.stdout:Sep 19 06:09:16 smithi059 podman[64393]: 2024-09-19 06:09:16.597105508 +0000 UTC m=+0.244582690 container create 59be01e6c86601f4dc1d8eb07d9a6c23ecc8e94f993d4190a9a918eced04dd0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-k, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:09:17.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.064+0000 7f194a400640 1 -- 172.21.15.3:0/2649135275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1944109120 msgr2=0x7f1944110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:17.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.064+0000 7f194a400640 1 --2- 172.21.15.3:0/2649135275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1944109120 0x7f1944110ca0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f193c009ca0 tx=0x7f193c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:09:17.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.064+0000 7f194a400640 1 -- 172.21.15.3:0/2649135275 shutdown_connections 2024-09-19T06:09:17.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.064+0000 7f194a400640 1 --2- 172.21.15.3:0/2649135275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1944109120 0x7f1944110ca0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:17.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.064+0000 7f194a400640 1 --2- 172.21.15.3:0/2649135275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19441049a0 0x7f19441089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:17.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.064+0000 7f194a400640 1 --2- 172.21.15.3:0/2649135275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1944103ff0 0x7f19441043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:17.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.064+0000 7f194a400640 1 -- 172.21.15.3:0/2649135275 >> 172.21.15.3:0/2649135275 conn(0x7f19440ffa90 msgr2=0x7f1944101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:17.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.064+0000 7f194a400640 1 -- 172.21.15.3:0/2649135275 shutdown_connections 2024-09-19T06:09:17.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.064+0000 7f194a400640 1 -- 172.21.15.3:0/2649135275 wait complete. 2024-09-19T06:09:17.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.065+0000 7f194a400640 1 Processor -- start 2024-09-19T06:09:17.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.065+0000 7f194a400640 1 -- start start 2024-09-19T06:09:17.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.066+0000 7f194a400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1944103ff0 0x7f194419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:17.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.066+0000 7f194a400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19441049a0 0x7f194419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:17.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.066+0000 7f194a400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1944109120 0x7f194419ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:17.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.066+0000 7f194a400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1944114130 con 0x7f1944109120 2024-09-19T06:09:17.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.066+0000 7f194a400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1944113fb0 con 0x7f19441049a0 2024-09-19T06:09:17.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.066+0000 7f194a400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f19441142b0 con 0x7f1944103ff0 2024-09-19T06:09:17.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.066+0000 7f193aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19441049a0 0x7f194419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:17.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.066+0000 7f1943e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1944109120 0x7f194419ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:17.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.066+0000 7f193aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19441049a0 0x7f194419aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55930/0 (socket says 172.21.15.3:55930) 2024-09-19T06:09:17.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.066+0000 7f193aa00640 1 -- 172.21.15.3:0/3207035562 learned_addr learned my addr 172.21.15.3:0/3207035562 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:09:17.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.066+0000 7f1943400640 1 --2- 172.21.15.3:0/3207035562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1944103ff0 0x7f194419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:17.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.066+0000 7f193aa00640 1 -- 172.21.15.3:0/3207035562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1944103ff0 msgr2=0x7f194419a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:17.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.066+0000 7f193aa00640 1 --2- 172.21.15.3:0/3207035562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1944103ff0 0x7f194419a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:17.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.067+0000 7f193aa00640 1 -- 172.21.15.3:0/3207035562 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1944109120 msgr2=0x7f194419ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:17.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.067+0000 7f193aa00640 1 --2- 172.21.15.3:0/3207035562 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1944109120 0x7f194419ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:17.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.067+0000 7f193aa00640 1 -- 172.21.15.3:0/3207035562 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f194419f560 con 0x7f19441049a0 2024-09-19T06:09:17.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.067+0000 7f193aa00640 1 --2- 172.21.15.3:0/3207035562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19441049a0 0x7f194419aaf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f192c00e9f0 tx=0x7f192c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:17.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.067+0000 7f1940c00640 1 -- 172.21.15.3:0/3207035562 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c00cd80 con 0x7f19441049a0 2024-09-19T06:09:17.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.067+0000 7f1940c00640 1 -- 172.21.15.3:0/3207035562 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f192c010910 con 0x7f19441049a0 2024-09-19T06:09:17.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.067+0000 7f194a400640 1 -- 172.21.15.3:0/3207035562 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f194419f850 con 0x7f19441049a0 2024-09-19T06:09:17.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.067+0000 7f1940c00640 1 -- 172.21.15.3:0/3207035562 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192c018990 con 0x7f19441049a0 2024-09-19T06:09:17.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.067+0000 7f194a400640 1 -- 172.21.15.3:0/3207035562 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19441a7130 con 0x7f19441049a0 2024-09-19T06:09:17.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.068+0000 7f194a400640 1 -- 172.21.15.3:0/3207035562 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19441043d0 con 0x7f19441049a0 2024-09-19T06:09:17.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.071+0000 7f1940c00640 1 -- 172.21.15.3:0/3207035562 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f192c010ac0 con 0x7f19441049a0 2024-09-19T06:09:17.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.072+0000 7f1940c00640 1 --2- 172.21.15.3:0/3207035562 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f19280a32c0 0x7f19280a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:17.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.072+0000 7f1940c00640 1 -- 172.21.15.3:0/3207035562 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f192c0cf6e0 con 0x7f19441049a0 2024-09-19T06:09:17.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.072+0000 7f1943400640 1 --2- 172.21.15.3:0/3207035562 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f19280a32c0 0x7f19280a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:17.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.073+0000 7f1943400640 1 --2- 172.21.15.3:0/3207035562 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f19280a32c0 0x7f19280a5780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1934009bd0 tx=0x7f1934005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:17.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.076+0000 7f1940c00640 1 -- 172.21.15.3:0/3207035562 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f192c09c1b0 con 0x7f19441049a0 2024-09-19T06:09:17.289 INFO:journalctl@ceph.mds.k.smithi059.stdout:Sep 19 06:09:16 smithi059 podman[64393]: 2024-09-19 06:09:16.933609307 +0000 UTC m=+0.581086454 container init 59be01e6c86601f4dc1d8eb07d9a6c23ecc8e94f993d4190a9a918eced04dd0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-k, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T06:09:17.289 INFO:journalctl@ceph.mds.k.smithi059.stdout:Sep 19 06:09:16 smithi059 podman[64393]: 2024-09-19 06:09:16.936552922 +0000 UTC m=+0.584030071 container start 59be01e6c86601f4dc1d8eb07d9a6c23ecc8e94f993d4190a9a918eced04dd0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-k, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T06:09:17.289 INFO:journalctl@ceph.mds.k.smithi059.stdout:Sep 19 06:09:16 smithi059 ceph-mds[64412]: -- 172.21.15.59:0/715078063 <== mon.2 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56004d2f9860 con 0x56004d2d7400 2024-09-19T06:09:17.289 INFO:journalctl@ceph.mds.k.smithi059.stdout:Sep 19 06:09:16 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-k[64408]: starting mds.k at 2024-09-19T06:09:17.289 INFO:journalctl@ceph.mds.k.smithi059.stdout:Sep 19 06:09:17 smithi059 bash[64393]: 59be01e6c86601f4dc1d8eb07d9a6c23ecc8e94f993d4190a9a918eced04dd0c 2024-09-19T06:09:17.289 INFO:journalctl@ceph.mds.k.smithi059.stdout:Sep 19 06:09:17 smithi059 systemd[1]: Started Ceph mds.k for 782a5144-764c-11ef-bceb-c7b262605968. 2024-09-19T06:09:17.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.314+0000 7f194a400640 1 -- 172.21.15.3:0/3207035562 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f194402d7c0 con 0x7f19441049a0 2024-09-19T06:09:17.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.315+0000 7f1940c00640 1 -- 172.21.15.3:0/3207035562 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2257 (secure 0 0 0) 0x7f192c0a04b0 con 0x7f19441049a0 2024-09-19T06:09:17.316 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:09:17.317 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":3,"btime":"2024-09-19T06:09:17:080021+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T06:09:17.317 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 3 2024-09-19T06:09:17.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.317+0000 7f194a400640 1 -- 172.21.15.3:0/3207035562 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f19280a32c0 msgr2=0x7f19280a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:17.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.317+0000 7f194a400640 1 --2- 172.21.15.3:0/3207035562 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f19280a32c0 0x7f19280a5780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1934009bd0 tx=0x7f1934005f90 comp rx=0 tx=0).stop 2024-09-19T06:09:17.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.317+0000 7f194a400640 1 -- 172.21.15.3:0/3207035562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19441049a0 msgr2=0x7f194419aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:17.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.317+0000 7f194a400640 1 --2- 172.21.15.3:0/3207035562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19441049a0 0x7f194419aaf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f192c00e9f0 tx=0x7f192c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:09:17.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.318+0000 7f194a400640 1 -- 172.21.15.3:0/3207035562 shutdown_connections 2024-09-19T06:09:17.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.318+0000 7f194a400640 1 --2- 172.21.15.3:0/3207035562 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f19280a32c0 0x7f19280a5780 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:17.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.318+0000 7f194a400640 1 --2- 172.21.15.3:0/3207035562 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1944109120 0x7f194419ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:17.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.318+0000 7f194a400640 1 --2- 172.21.15.3:0/3207035562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19441049a0 0x7f194419aaf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:17.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.318+0000 7f194a400640 1 --2- 172.21.15.3:0/3207035562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1944103ff0 0x7f194419a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:17.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.318+0000 7f194a400640 1 -- 172.21.15.3:0/3207035562 >> 172.21.15.3:0/3207035562 conn(0x7f19440ffa90 msgr2=0x7f1944100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:17.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.318+0000 7f194a400640 1 -- 172.21.15.3:0/3207035562 shutdown_connections 2024-09-19T06:09:17.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:17.318+0000 7f194a400640 1 -- 172.21.15.3:0/3207035562 wait complete. 2024-09-19T06:09:18.378 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:18 smithi059 ceph-mon[35138]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:18.378 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:18 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.59:6832/927949058,v1:172.21.15.59:6833/927949058] up:boot 2024-09-19T06:09:18.378 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:18 smithi059 ceph-mon[35138]: fsmap 2 up:standby 2024-09-19T06:09:18.379 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:18 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:09:18.379 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:18 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:18.379 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:18 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:18.379 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:18 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:18.379 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:18 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:18.379 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:18 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:18.379 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:18 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:18.379 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:18 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/3207035562' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:18.446 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:18 smithi003 ceph-mon[30893]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:18.446 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:18 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.59:6832/927949058,v1:172.21.15.59:6833/927949058] up:boot 2024-09-19T06:09:18.446 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:18 smithi003 ceph-mon[30893]: fsmap 2 up:standby 2024-09-19T06:09:18.447 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:18 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:09:18.447 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:18 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:18.447 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:18 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:18.447 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:18 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:18.447 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:18 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:18.447 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:18 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:18.447 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:18 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:18.447 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:18 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3207035562' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:18.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:18 smithi071 ceph-mon[35662]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:18.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:18 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.59:6832/927949058,v1:172.21.15.59:6833/927949058] up:boot 2024-09-19T06:09:18.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:18 smithi071 ceph-mon[35662]: fsmap 2 up:standby 2024-09-19T06:09:18.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:18 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:09:18.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:18 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:18.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:18 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:18.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:18 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:18.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:18 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:18.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:18 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:18.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:18 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:18.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:18 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/3207035562' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:19.358 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:19 smithi059 ceph-mon[35138]: Deploying daemon mds.j on smithi003 2024-09-19T06:09:19.506 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:19 smithi003 ceph-mon[30893]: Deploying daemon mds.j on smithi003 2024-09-19T06:09:19.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:19 smithi071 ceph-mon[35662]: Deploying daemon mds.j on smithi003 2024-09-19T06:09:20.148 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:09:20.186 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:20 smithi003 ceph-mon[30893]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:20.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:20 smithi059 ceph-mon[35138]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:20.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:20 smithi071 ceph-mon[35662]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:20.804 INFO:journalctl@ceph.mds.j.smithi003.stdout:Sep 19 06:09:20 smithi003 podman[71253]: 2024-09-19 06:09:20.532880846 +0000 UTC m=+0.147430050 container create ec843aefa2aad11fa288cc04869824f1aa562cc56d20b454cfdea5e963ec0afc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-j, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T06:09:20.804 INFO:journalctl@ceph.mds.j.smithi003.stdout:Sep 19 06:09:20 smithi003 podman[71253]: 2024-09-19 06:09:20.802927472 +0000 UTC m=+0.417476687 container init ec843aefa2aad11fa288cc04869824f1aa562cc56d20b454cfdea5e963ec0afc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-j, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T06:09:21.014 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:21.084 INFO:journalctl@ceph.mds.j.smithi003.stdout:Sep 19 06:09:20 smithi003 podman[71253]: 2024-09-19 06:09:20.809662982 +0000 UTC m=+0.424212186 container start ec843aefa2aad11fa288cc04869824f1aa562cc56d20b454cfdea5e963ec0afc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-j, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T06:09:21.085 INFO:journalctl@ceph.mds.j.smithi003.stdout:Sep 19 06:09:20 smithi003 ceph-mds[71296]: -- 172.21.15.3:0/3961841801 <== mon.2 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x565385e23860 con 0x565385e01000 2024-09-19T06:09:21.085 INFO:journalctl@ceph.mds.j.smithi003.stdout:Sep 19 06:09:20 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-j[71282]: starting mds.j at 2024-09-19T06:09:21.085 INFO:journalctl@ceph.mds.j.smithi003.stdout:Sep 19 06:09:20 smithi003 bash[71253]: ec843aefa2aad11fa288cc04869824f1aa562cc56d20b454cfdea5e963ec0afc 2024-09-19T06:09:21.085 INFO:journalctl@ceph.mds.j.smithi003.stdout:Sep 19 06:09:20 smithi003 systemd[1]: Started Ceph mds.j for 782a5144-764c-11ef-bceb-c7b262605968. 2024-09-19T06:09:21.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.655+0000 7fd055e00640 1 -- 172.21.15.3:0/43704113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd050076720 msgr2=0x7fd050076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:21.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.655+0000 7fd055e00640 1 --2- 172.21.15.3:0/43704113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd050076720 0x7fd050076b00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd040009900 tx=0x7fd04002a410 comp rx=0 tx=0).stop 2024-09-19T06:09:21.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.655+0000 7fd055e00640 1 -- 172.21.15.3:0/43704113 shutdown_connections 2024-09-19T06:09:21.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.655+0000 7fd055e00640 1 --2- 172.21.15.3:0/43704113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd050112870 0x7fd050114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:21.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.655+0000 7fd055e00640 1 --2- 172.21.15.3:0/43704113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd050077040 0x7fd050112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:21.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.655+0000 7fd055e00640 1 --2- 172.21.15.3:0/43704113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd050076720 0x7fd050076b00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:21.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.655+0000 7fd055e00640 1 -- 172.21.15.3:0/43704113 >> 172.21.15.3:0/43704113 conn(0x7fd0500ff8d0 msgr2=0x7fd050101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:21.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.655+0000 7fd055e00640 1 -- 172.21.15.3:0/43704113 shutdown_connections 2024-09-19T06:09:21.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.655+0000 7fd055e00640 1 -- 172.21.15.3:0/43704113 wait complete. 2024-09-19T06:09:21.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.656+0000 7fd055e00640 1 Processor -- start 2024-09-19T06:09:21.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.656+0000 7fd055e00640 1 -- start start 2024-09-19T06:09:21.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.657+0000 7fd055e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd050076720 0x7fd0501a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:21.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.657+0000 7fd055e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd050077040 0x7fd0501a4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:21.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.657+0000 7fd055e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd050112870 0x7fd05019e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:21.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.657+0000 7fd055e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd050118450 con 0x7fd050112870 2024-09-19T06:09:21.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.657+0000 7fd055e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd0501182d0 con 0x7fd050077040 2024-09-19T06:09:21.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.657+0000 7fd055e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd0501185d0 con 0x7fd050076720 2024-09-19T06:09:21.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.657+0000 7fd055400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd050112870 0x7fd05019e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:21.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.657+0000 7fd055400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd050112870 0x7fd05019e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32780/0 (socket says 172.21.15.3:32780) 2024-09-19T06:09:21.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.657+0000 7fd055400640 1 -- 172.21.15.3:0/29618172 learned_addr learned my addr 172.21.15.3:0/29618172 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:09:21.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.657+0000 7fd054a00640 1 --2- 172.21.15.3:0/29618172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd050076720 0x7fd0501a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:21.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.657+0000 7fd047e00640 1 --2- 172.21.15.3:0/29618172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd050077040 0x7fd0501a4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:21.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.658+0000 7fd055400640 1 -- 172.21.15.3:0/29618172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd050076720 msgr2=0x7fd0501a4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:21.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.658+0000 7fd055400640 1 --2- 172.21.15.3:0/29618172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd050076720 0x7fd0501a4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:21.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.658+0000 7fd055400640 1 -- 172.21.15.3:0/29618172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd050077040 msgr2=0x7fd0501a4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:21.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.658+0000 7fd055400640 1 --2- 172.21.15.3:0/29618172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd050077040 0x7fd0501a4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:21.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.658+0000 7fd055400640 1 -- 172.21.15.3:0/29618172 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05019ef50 con 0x7fd050112870 2024-09-19T06:09:21.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.658+0000 7fd055400640 1 --2- 172.21.15.3:0/29618172 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd050112870 0x7fd05019e6e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd04800eb10 tx=0x7fd04800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:21.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.658+0000 7fd04e000640 1 -- 172.21.15.3:0/29618172 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048004b20 con 0x7fd050112870 2024-09-19T06:09:21.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.658+0000 7fd04e000640 1 -- 172.21.15.3:0/29618172 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd048004cc0 con 0x7fd050112870 2024-09-19T06:09:21.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.658+0000 7fd04e000640 1 -- 172.21.15.3:0/29618172 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048010790 con 0x7fd050112870 2024-09-19T06:09:21.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.658+0000 7fd055e00640 1 -- 172.21.15.3:0/29618172 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd05019f240 con 0x7fd050112870 2024-09-19T06:09:21.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.658+0000 7fd055e00640 1 -- 172.21.15.3:0/29618172 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0501ab3c0 con 0x7fd050112870 2024-09-19T06:09:21.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.659+0000 7fd055e00640 1 -- 172.21.15.3:0/29618172 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd050077e60 con 0x7fd050112870 2024-09-19T06:09:21.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.661+0000 7fd04e000640 1 -- 172.21.15.3:0/29618172 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fd048010930 con 0x7fd050112870 2024-09-19T06:09:21.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.663+0000 7fd04e000640 1 --2- 172.21.15.3:0/29618172 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd0340a32c0 0x7fd0340a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:21.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.663+0000 7fd04e000640 1 -- 172.21.15.3:0/29618172 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7fd0480cfbd0 con 0x7fd050112870 2024-09-19T06:09:21.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.663+0000 7fd054a00640 1 --2- 172.21.15.3:0/29618172 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd0340a32c0 0x7fd0340a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:21.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.664+0000 7fd054a00640 1 --2- 172.21.15.3:0/29618172 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd0340a32c0 0x7fd0340a5780 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd040000c00 tx=0x7fd040005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:21.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.665+0000 7fd04e000640 1 -- 172.21.15.3:0/29618172 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd04809ccf0 con 0x7fd050112870 2024-09-19T06:09:21.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.911+0000 7fd055e00640 1 -- 172.21.15.3:0/29618172 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd050076b00 con 0x7fd050112870 2024-09-19T06:09:21.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.911+0000 7fd04e000640 1 -- 172.21.15.3:0/29618172 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3076 (secure 0 0 0) 0x7fd050076b00 con 0x7fd050112870 2024-09-19T06:09:21.913 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:09:21.913 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":4,"btime":"2024-09-19T06:09:21:094309+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T06:09:21.913 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 4 2024-09-19T06:09:21.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.914+0000 7fd055e00640 1 -- 172.21.15.3:0/29618172 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd0340a32c0 msgr2=0x7fd0340a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:21.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.914+0000 7fd055e00640 1 --2- 172.21.15.3:0/29618172 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd0340a32c0 0x7fd0340a5780 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd040000c00 tx=0x7fd040005b50 comp rx=0 tx=0).stop 2024-09-19T06:09:21.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.914+0000 7fd055e00640 1 -- 172.21.15.3:0/29618172 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd050112870 msgr2=0x7fd05019e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:21.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.914+0000 7fd055e00640 1 --2- 172.21.15.3:0/29618172 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd050112870 0x7fd05019e6e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd04800eb10 tx=0x7fd04800c2d0 comp rx=0 tx=0).stop 2024-09-19T06:09:21.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.915+0000 7fd055e00640 1 -- 172.21.15.3:0/29618172 shutdown_connections 2024-09-19T06:09:21.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.915+0000 7fd055e00640 1 --2- 172.21.15.3:0/29618172 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd0340a32c0 0x7fd0340a5780 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:21.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.915+0000 7fd055e00640 1 --2- 172.21.15.3:0/29618172 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd050112870 0x7fd05019e6e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:21.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.915+0000 7fd055e00640 1 --2- 172.21.15.3:0/29618172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd050077040 0x7fd0501a4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:21.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.915+0000 7fd055e00640 1 --2- 172.21.15.3:0/29618172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd050076720 0x7fd0501a4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:21.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.915+0000 7fd055e00640 1 -- 172.21.15.3:0/29618172 >> 172.21.15.3:0/29618172 conn(0x7fd0500ff8d0 msgr2=0x7fd050101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:21.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.915+0000 7fd055e00640 1 -- 172.21.15.3:0/29618172 shutdown_connections 2024-09-19T06:09:21.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:21.915+0000 7fd055e00640 1 -- 172.21.15.3:0/29618172 wait complete. 2024-09-19T06:09:22.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:22 smithi059 ceph-mon[35138]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:22.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:22 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:22.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:22 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:22.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:22 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:22.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:22 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:22.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:22 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:22.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:22 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:22.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:22 smithi059 ceph-mon[35138]: Deploying daemon mds.d on smithi003 2024-09-19T06:09:22.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:22 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.3:6834/469648602,v1:172.21.15.3:6835/469648602] up:boot 2024-09-19T06:09:22.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:22 smithi059 ceph-mon[35138]: fsmap 3 up:standby 2024-09-19T06:09:22.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:22 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:09:22.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:22 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/29618172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:22.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:22 smithi003 ceph-mon[30893]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:22.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:22 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:22.337 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:22 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:22.337 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:22 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:22.337 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:22 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:22.337 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:22 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:22.337 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:22 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:22.337 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:22 smithi003 ceph-mon[30893]: Deploying daemon mds.d on smithi003 2024-09-19T06:09:22.337 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:22 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.3:6834/469648602,v1:172.21.15.3:6835/469648602] up:boot 2024-09-19T06:09:22.337 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:22 smithi003 ceph-mon[30893]: fsmap 3 up:standby 2024-09-19T06:09:22.337 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:22 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:09:22.337 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:22 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/29618172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:22.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:22 smithi071 ceph-mon[35662]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:22.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:22 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:22.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:22 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:22.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:22 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:22.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:22 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:22.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:22 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:22.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:22 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:22.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:22 smithi071 ceph-mon[35662]: Deploying daemon mds.d on smithi003 2024-09-19T06:09:22.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:22 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.3:6834/469648602,v1:172.21.15.3:6835/469648602] up:boot 2024-09-19T06:09:22.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:22 smithi071 ceph-mon[35662]: fsmap 3 up:standby 2024-09-19T06:09:22.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:22 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:09:22.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:22 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/29618172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:24.060 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:24 smithi003 ceph-mon[30893]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:24.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:24 smithi059 ceph-mon[35138]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:24.335 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 19 06:09:24 smithi003 systemd[1]: Starting Ceph mds.d for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:09:24.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:24 smithi071 ceph-mon[35662]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:24.784 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 19 06:09:24 smithi003 podman[71647]: 2024-09-19 06:09:24.393973718 +0000 UTC m=+0.027416253 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:09:24.784 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 19 06:09:24 smithi003 podman[71647]: 2024-09-19 06:09:24.513154351 +0000 UTC m=+0.146596884 container create 8fac3f5192b423dbd801641114011fb12236e53d122cda9a29c5b9bd1118e133 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-d, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:09:24.784 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 19 06:09:24 smithi003 podman[71647]: 2024-09-19 06:09:24.782914535 +0000 UTC m=+0.416357072 container init 8fac3f5192b423dbd801641114011fb12236e53d122cda9a29c5b9bd1118e133 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-d, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T06:09:25.085 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 19 06:09:24 smithi003 podman[71647]: 2024-09-19 06:09:24.789564735 +0000 UTC m=+0.423007278 container start 8fac3f5192b423dbd801641114011fb12236e53d122cda9a29c5b9bd1118e133 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-d, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:09:25.085 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 19 06:09:24 smithi003 ceph-mds[71666]: -- 172.21.15.3:0/2024789438 <== mon.2 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5646808d3860 con 0x5646808b0800 2024-09-19T06:09:25.085 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 19 06:09:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-d[71662]: starting mds.d at 2024-09-19T06:09:25.085 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 19 06:09:24 smithi003 bash[71647]: 8fac3f5192b423dbd801641114011fb12236e53d122cda9a29c5b9bd1118e133 2024-09-19T06:09:25.085 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 19 06:09:24 smithi003 systemd[1]: Started Ceph mds.d for 782a5144-764c-11ef-bceb-c7b262605968. 2024-09-19T06:09:26.063 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:09:26.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:25 smithi059 ceph-mon[35138]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:26.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:25 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:26.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:25 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:26.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:25 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:26.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:25 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:26.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:25 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:26.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:25 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:26.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:25 smithi059 ceph-mon[35138]: Deploying daemon mds.e on smithi059 2024-09-19T06:09:26.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:25 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.3:6836/832907982,v1:172.21.15.3:6837/832907982] up:boot 2024-09-19T06:09:26.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:25 smithi059 ceph-mon[35138]: fsmap 4 up:standby 2024-09-19T06:09:26.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:25 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:09:26.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:25 smithi003 ceph-mon[30893]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:26.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:25 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:26.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:25 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:26.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:25 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:26.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:25 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:26.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:25 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:26.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:25 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:26.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:25 smithi003 ceph-mon[30893]: Deploying daemon mds.e on smithi059 2024-09-19T06:09:26.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:25 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.3:6836/832907982,v1:172.21.15.3:6837/832907982] up:boot 2024-09-19T06:09:26.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:25 smithi003 ceph-mon[30893]: fsmap 4 up:standby 2024-09-19T06:09:26.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:25 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:09:26.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:25 smithi071 ceph-mon[35662]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:26.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:25 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:26.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:25 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:26.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:25 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:26.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:25 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:26.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:25 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:26.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:25 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:26.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:25 smithi071 ceph-mon[35662]: Deploying daemon mds.e on smithi059 2024-09-19T06:09:26.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:25 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.3:6836/832907982,v1:172.21.15.3:6837/832907982] up:boot 2024-09-19T06:09:26.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:25 smithi071 ceph-mon[35662]: fsmap 4 up:standby 2024-09-19T06:09:26.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:25 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:09:26.457 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.075+0000 7f5d37200640 1 -- 172.21.15.3:0/2677058190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d38076720 msgr2=0x7f5d38076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.075+0000 7f5d37200640 1 --2- 172.21.15.3:0/2677058190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d38076720 0x7f5d38076b00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009900 tx=0x7f5d2802a410 comp rx=0 tx=0).stop 2024-09-19T06:09:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.075+0000 7f5d37200640 1 -- 172.21.15.3:0/2677058190 shutdown_connections 2024-09-19T06:09:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.075+0000 7f5d37200640 1 --2- 172.21.15.3:0/2677058190 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d38112870 0x7f5d38114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.075+0000 7f5d37200640 1 --2- 172.21.15.3:0/2677058190 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d38077040 0x7f5d38112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.075+0000 7f5d37200640 1 --2- 172.21.15.3:0/2677058190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d38076720 0x7f5d38076b00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.075+0000 7f5d37200640 1 -- 172.21.15.3:0/2677058190 >> 172.21.15.3:0/2677058190 conn(0x7f5d380ff8d0 msgr2=0x7f5d38101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.075+0000 7f5d37200640 1 -- 172.21.15.3:0/2677058190 shutdown_connections 2024-09-19T06:09:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.075+0000 7f5d37200640 1 -- 172.21.15.3:0/2677058190 wait complete. 2024-09-19T06:09:27.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.076+0000 7f5d37200640 1 Processor -- start 2024-09-19T06:09:27.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.076+0000 7f5d37200640 1 -- start start 2024-09-19T06:09:27.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.077+0000 7f5d37200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d38076720 0x7f5d381a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:27.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.077+0000 7f5d37200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d38077040 0x7f5d381a4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:27.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.077+0000 7f5d37200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d38112870 0x7f5d3819e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:27.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.077+0000 7f5d37200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5d38118450 con 0x7f5d38076720 2024-09-19T06:09:27.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.077+0000 7f5d37200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5d381182d0 con 0x7f5d38112870 2024-09-19T06:09:27.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.077+0000 7f5d37200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5d381185d0 con 0x7f5d38077040 2024-09-19T06:09:27.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.077+0000 7f5d35e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d38076720 0x7f5d381a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:27.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.077+0000 7f5d36800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d38112870 0x7f5d3819e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:27.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.077+0000 7f5d36800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d38112870 0x7f5d3819e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:48806/0 (socket says 172.21.15.3:48806) 2024-09-19T06:09:27.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.077+0000 7f5d36800640 1 -- 172.21.15.3:0/4129582103 learned_addr learned my addr 172.21.15.3:0/4129582103 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:09:27.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.077+0000 7f5d35e00640 1 --2- 172.21.15.3:0/4129582103 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d38076720 0x7f5d381a4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35776/0 (socket says 172.21.15.3:35776) 2024-09-19T06:09:27.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.077+0000 7f5d2d400640 1 --2- 172.21.15.3:0/4129582103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d38077040 0x7f5d381a4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:27.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.077+0000 7f5d36800640 1 -- 172.21.15.3:0/4129582103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d38077040 msgr2=0x7f5d381a4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:27.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.077+0000 7f5d36800640 1 --2- 172.21.15.3:0/4129582103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d38077040 0x7f5d381a4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:27.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.077+0000 7f5d36800640 1 -- 172.21.15.3:0/4129582103 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d38076720 msgr2=0x7f5d381a4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:27.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.077+0000 7f5d36800640 1 --2- 172.21.15.3:0/4129582103 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d38076720 0x7f5d381a4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:27.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.077+0000 7f5d36800640 1 -- 172.21.15.3:0/4129582103 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3819ef50 con 0x7f5d38112870 2024-09-19T06:09:27.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.078+0000 7f5d36800640 1 --2- 172.21.15.3:0/4129582103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d38112870 0x7f5d3819e6e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5d3000eb10 tx=0x7f5d3000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:27.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.078+0000 7f5d2f400640 1 -- 172.21.15.3:0/4129582103 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d30004b20 con 0x7f5d38112870 2024-09-19T06:09:27.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.078+0000 7f5d2f400640 1 -- 172.21.15.3:0/4129582103 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d30004cc0 con 0x7f5d38112870 2024-09-19T06:09:27.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.078+0000 7f5d2f400640 1 -- 172.21.15.3:0/4129582103 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d30010790 con 0x7f5d38112870 2024-09-19T06:09:27.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.078+0000 7f5d37200640 1 -- 172.21.15.3:0/4129582103 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3819f240 con 0x7f5d38112870 2024-09-19T06:09:27.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.078+0000 7f5d37200640 1 -- 172.21.15.3:0/4129582103 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d381ab3c0 con 0x7f5d38112870 2024-09-19T06:09:27.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.079+0000 7f5d37200640 1 -- 172.21.15.3:0/4129582103 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d38077e60 con 0x7f5d38112870 2024-09-19T06:09:27.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.081+0000 7f5d2f400640 1 -- 172.21.15.3:0/4129582103 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f5d30010930 con 0x7f5d38112870 2024-09-19T06:09:27.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.082+0000 7f5d2f400640 1 --2- 172.21.15.3:0/4129582103 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5d1c0a32c0 0x7f5d1c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:27.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.083+0000 7f5d2f400640 1 -- 172.21.15.3:0/4129582103 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f5d300cfda0 con 0x7f5d38112870 2024-09-19T06:09:27.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.083+0000 7f5d35e00640 1 --2- 172.21.15.3:0/4129582103 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5d1c0a32c0 0x7f5d1c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:27.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.083+0000 7f5d35e00640 1 --2- 172.21.15.3:0/4129582103 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5d1c0a32c0 0x7f5d1c0a5780 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5d28000c00 tx=0x7f5d28005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:27.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.084+0000 7f5d2f400640 1 -- 172.21.15.3:0/4129582103 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5d3009cec0 con 0x7f5d38112870 2024-09-19T06:09:27.289 INFO:journalctl@ceph.mds.e.smithi059.stdout:Sep 19 06:09:27 smithi059 systemd[1]: Starting Ceph mds.e for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:09:27.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.308+0000 7f5d37200640 1 -- 172.21.15.3:0/4129582103 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d38076b00 con 0x7f5d38112870 2024-09-19T06:09:27.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.309+0000 7f5d2f400640 1 -- 172.21.15.3:0/4129582103 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3895 (secure 0 0 0) 0x7f5d38076b00 con 0x7f5d38112870 2024-09-19T06:09:27.311 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:09:27.311 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":5,"btime":"2024-09-19T06:09:25:023260+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T06:09:27.311 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 5 2024-09-19T06:09:27.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.312+0000 7f5d37200640 1 -- 172.21.15.3:0/4129582103 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5d1c0a32c0 msgr2=0x7f5d1c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:27.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.312+0000 7f5d37200640 1 --2- 172.21.15.3:0/4129582103 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5d1c0a32c0 0x7f5d1c0a5780 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5d28000c00 tx=0x7f5d28005b50 comp rx=0 tx=0).stop 2024-09-19T06:09:27.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.312+0000 7f5d37200640 1 -- 172.21.15.3:0/4129582103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d38112870 msgr2=0x7f5d3819e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:27.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.312+0000 7f5d37200640 1 --2- 172.21.15.3:0/4129582103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d38112870 0x7f5d3819e6e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5d3000eb10 tx=0x7f5d3000c2d0 comp rx=0 tx=0).stop 2024-09-19T06:09:27.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.312+0000 7f5d37200640 1 -- 172.21.15.3:0/4129582103 shutdown_connections 2024-09-19T06:09:27.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.312+0000 7f5d37200640 1 --2- 172.21.15.3:0/4129582103 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5d1c0a32c0 0x7f5d1c0a5780 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:27.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.312+0000 7f5d37200640 1 --2- 172.21.15.3:0/4129582103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d38112870 0x7f5d3819e6e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:27.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.312+0000 7f5d37200640 1 --2- 172.21.15.3:0/4129582103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5d38077040 0x7f5d381a4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:27.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.312+0000 7f5d37200640 1 --2- 172.21.15.3:0/4129582103 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d38076720 0x7f5d381a4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:27.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.312+0000 7f5d37200640 1 -- 172.21.15.3:0/4129582103 >> 172.21.15.3:0/4129582103 conn(0x7f5d380ff8d0 msgr2=0x7f5d38101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:27.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.312+0000 7f5d37200640 1 -- 172.21.15.3:0/4129582103 shutdown_connections 2024-09-19T06:09:27.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:27.312+0000 7f5d37200640 1 -- 172.21.15.3:0/4129582103 wait complete. 2024-09-19T06:09:27.706 INFO:journalctl@ceph.mds.e.smithi059.stdout:Sep 19 06:09:27 smithi059 podman[64704]: 2024-09-19 06:09:27.305710983 +0000 UTC m=+0.016277298 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:09:27.707 INFO:journalctl@ceph.mds.e.smithi059.stdout:Sep 19 06:09:27 smithi059 podman[64704]: 2024-09-19 06:09:27.419731758 +0000 UTC m=+0.130298064 container create c0017ef5992fb49caa670e11f1751a1e89536f50978c869e97da99d0e5a2a8fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:09:27.986 INFO:journalctl@ceph.mds.e.smithi059.stdout:Sep 19 06:09:27 smithi059 podman[64704]: 2024-09-19 06:09:27.705765264 +0000 UTC m=+0.416331566 container init c0017ef5992fb49caa670e11f1751a1e89536f50978c869e97da99d0e5a2a8fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-e, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T06:09:27.986 INFO:journalctl@ceph.mds.e.smithi059.stdout:Sep 19 06:09:27 smithi059 podman[64704]: 2024-09-19 06:09:27.708585227 +0000 UTC m=+0.419151529 container start c0017ef5992fb49caa670e11f1751a1e89536f50978c869e97da99d0e5a2a8fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:09:27.987 INFO:journalctl@ceph.mds.e.smithi059.stdout:Sep 19 06:09:27 smithi059 ceph-mds[64724]: -- 172.21.15.59:0/2421660449 <== mon.2 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56267c667860 con 0x56267c644800 2024-09-19T06:09:27.987 INFO:journalctl@ceph.mds.e.smithi059.stdout:Sep 19 06:09:27 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-e[64720]: starting mds.e at 2024-09-19T06:09:27.987 INFO:journalctl@ceph.mds.e.smithi059.stdout:Sep 19 06:09:27 smithi059 bash[64704]: c0017ef5992fb49caa670e11f1751a1e89536f50978c869e97da99d0e5a2a8fb 2024-09-19T06:09:27.987 INFO:journalctl@ceph.mds.e.smithi059.stdout:Sep 19 06:09:27 smithi059 systemd[1]: Started Ceph mds.e for 782a5144-764c-11ef-bceb-c7b262605968. 2024-09-19T06:09:28.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:27 smithi059 ceph-mon[35138]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:28.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:27 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/4129582103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:28.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:27 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:28.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:27 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:28.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:27 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:28.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:27 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:28.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:27 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:28.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:27 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:28.304 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:27 smithi071 ceph-mon[35662]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:28.304 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:27 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/4129582103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:28.304 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:27 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:28.304 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:27 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:28.305 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:27 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:28.305 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:27 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:28.305 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:27 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:28.305 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:27 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:28.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:27 smithi003 ceph-mon[30893]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:28.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:27 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/4129582103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:28.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:27 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:28.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:27 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:28.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:27 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:28.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:27 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:28.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:27 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:28.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:27 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:29.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:28 smithi059 ceph-mon[35138]: Deploying daemon mds.f on smithi071 2024-09-19T06:09:29.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:28 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.59:6834/3846556695,v1:172.21.15.59:6835/3846556695] up:boot 2024-09-19T06:09:29.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:28 smithi059 ceph-mon[35138]: fsmap 5 up:standby 2024-09-19T06:09:29.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:28 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:09:29.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:28 smithi003 ceph-mon[30893]: Deploying daemon mds.f on smithi071 2024-09-19T06:09:29.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:28 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.59:6834/3846556695,v1:172.21.15.59:6835/3846556695] up:boot 2024-09-19T06:09:29.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:28 smithi003 ceph-mon[30893]: fsmap 5 up:standby 2024-09-19T06:09:29.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:28 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:09:29.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:28 smithi071 ceph-mon[35662]: Deploying daemon mds.f on smithi071 2024-09-19T06:09:29.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:28 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.59:6834/3846556695,v1:172.21.15.59:6835/3846556695] up:boot 2024-09-19T06:09:29.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:28 smithi071 ceph-mon[35662]: fsmap 5 up:standby 2024-09-19T06:09:29.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:28 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:09:29.993 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 19 06:09:29 smithi071 systemd[1]: Starting Ceph mds.f for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:09:30.091 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:09:30.246 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:29 smithi071 ceph-mon[35662]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:30.247 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 19 06:09:30 smithi071 podman[65732]: 2024-09-19 06:09:29.990539002 +0000 UTC m=+0.015921489 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:09:30.247 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 19 06:09:30 smithi071 podman[65732]: 2024-09-19 06:09:30.105046864 +0000 UTC m=+0.130429380 container create 1753bbb0dc9fcc87fb75a0e9dd000b1b7d3134df40c4de5b3ed66cae7a02189b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T06:09:30.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:29 smithi059 ceph-mon[35138]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:30.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:29 smithi003 ceph-mon[30893]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:30.485 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:30.836 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 19 06:09:30 smithi071 podman[65732]: 2024-09-19 06:09:30.366336581 +0000 UTC m=+0.391719059 container init 1753bbb0dc9fcc87fb75a0e9dd000b1b7d3134df40c4de5b3ed66cae7a02189b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-f, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T06:09:30.836 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 19 06:09:30 smithi071 podman[65732]: 2024-09-19 06:09:30.369383097 +0000 UTC m=+0.394765571 container start 1753bbb0dc9fcc87fb75a0e9dd000b1b7d3134df40c4de5b3ed66cae7a02189b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-f, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:09:30.836 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 19 06:09:30 smithi071 ceph-mds[65751]: -- 172.21.15.71:0/1570207853 <== mon.1 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564d76cb9860 con 0x564d76c97000 2024-09-19T06:09:30.836 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 19 06:09:30 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-f[65747]: starting mds.f at 2024-09-19T06:09:30.836 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 19 06:09:30 smithi071 bash[65732]: 1753bbb0dc9fcc87fb75a0e9dd000b1b7d3134df40c4de5b3ed66cae7a02189b 2024-09-19T06:09:30.836 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 19 06:09:30 smithi071 systemd[1]: Started Ceph mds.f for 782a5144-764c-11ef-bceb-c7b262605968. 2024-09-19T06:09:31.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.077+0000 7effd1400640 1 -- 172.21.15.3:0/1723495671 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7effcc108f60 msgr2=0x7effcc110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:31.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.077+0000 7effd1400640 1 --2- 172.21.15.3:0/1723495671 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7effcc108f60 0x7effcc110ae0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7effc4009ca0 tx=0x7effc402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:09:31.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.077+0000 7effd1400640 1 -- 172.21.15.3:0/1723495671 shutdown_connections 2024-09-19T06:09:31.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.077+0000 7effd1400640 1 --2- 172.21.15.3:0/1723495671 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7effcc108f60 0x7effcc110ae0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:31.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.077+0000 7effd1400640 1 --2- 172.21.15.3:0/1723495671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc1047e0 0x7effcc108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:31.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.077+0000 7effd1400640 1 --2- 172.21.15.3:0/1723495671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effcc103e30 0x7effcc104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:31.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.077+0000 7effd1400640 1 -- 172.21.15.3:0/1723495671 >> 172.21.15.3:0/1723495671 conn(0x7effcc0ff910 msgr2=0x7effcc101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:31.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.077+0000 7effd1400640 1 -- 172.21.15.3:0/1723495671 shutdown_connections 2024-09-19T06:09:31.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.078+0000 7effd1400640 1 -- 172.21.15.3:0/1723495671 wait complete. 2024-09-19T06:09:31.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.078+0000 7effd1400640 1 Processor -- start 2024-09-19T06:09:31.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.079+0000 7effd1400640 1 -- start start 2024-09-19T06:09:31.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.079+0000 7effd1400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effcc103e30 0x7effcc19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:31.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.079+0000 7effd1400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc1047e0 0x7effcc19a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:31.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.079+0000 7effd1400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7effcc108f60 0x7effcc19ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:31.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.079+0000 7effd1400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7effcc113fc0 con 0x7effcc108f60 2024-09-19T06:09:31.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.079+0000 7effd1400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7effcc113e40 con 0x7effcc103e30 2024-09-19T06:09:31.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.079+0000 7effd1400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7effcc114140 con 0x7effcc1047e0 2024-09-19T06:09:31.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.079+0000 7effcb400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc1047e0 0x7effcc19a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:31.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.079+0000 7effcb400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc1047e0 0x7effcc19a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:49254/0 (socket says 172.21.15.3:49254) 2024-09-19T06:09:31.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.079+0000 7effcb400640 1 -- 172.21.15.3:0/287546931 learned_addr learned my addr 172.21.15.3:0/287546931 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:09:31.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.079+0000 7effd0a00640 1 --2- 172.21.15.3:0/287546931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7effcc108f60 0x7effcc19ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:31.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.079+0000 7effcbe00640 1 --2- 172.21.15.3:0/287546931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effcc103e30 0x7effcc19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:31.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.080+0000 7effcb400640 1 -- 172.21.15.3:0/287546931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effcc103e30 msgr2=0x7effcc19a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:31.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.080+0000 7effcb400640 1 --2- 172.21.15.3:0/287546931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effcc103e30 0x7effcc19a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:31.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.080+0000 7effcb400640 1 -- 172.21.15.3:0/287546931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7effcc108f60 msgr2=0x7effcc19ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:31.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.080+0000 7effcb400640 1 --2- 172.21.15.3:0/287546931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7effcc108f60 0x7effcc19ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:31.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.080+0000 7effcb400640 1 -- 172.21.15.3:0/287546931 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effcc19f3d0 con 0x7effcc1047e0 2024-09-19T06:09:31.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.080+0000 7effcb400640 1 --2- 172.21.15.3:0/287546931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc1047e0 0x7effcc19a960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7effb800e9f0 tx=0x7effb800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:31.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.080+0000 7effc8c00640 1 -- 172.21.15.3:0/287546931 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb800cd80 con 0x7effcc1047e0 2024-09-19T06:09:31.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.080+0000 7effc8c00640 1 -- 172.21.15.3:0/287546931 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effb8005500 con 0x7effcc1047e0 2024-09-19T06:09:31.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.080+0000 7effc8c00640 1 -- 172.21.15.3:0/287546931 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb8010690 con 0x7effcc1047e0 2024-09-19T06:09:31.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.080+0000 7effd1400640 1 -- 172.21.15.3:0/287546931 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effcc19f6c0 con 0x7effcc1047e0 2024-09-19T06:09:31.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.081+0000 7effd1400640 1 -- 172.21.15.3:0/287546931 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effcc1a6fa0 con 0x7effcc1047e0 2024-09-19T06:09:31.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.082+0000 7effd1400640 1 -- 172.21.15.3:0/287546931 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effcc105310 con 0x7effcc1047e0 2024-09-19T06:09:31.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.084+0000 7effc8c00640 1 -- 172.21.15.3:0/287546931 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7effb80046c0 con 0x7effcc1047e0 2024-09-19T06:09:31.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.085+0000 7effc8c00640 1 --2- 172.21.15.3:0/287546931 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7effb00a32c0 0x7effb00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:31.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.086+0000 7effc8c00640 1 -- 172.21.15.3:0/287546931 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7effb80cf860 con 0x7effcc1047e0 2024-09-19T06:09:31.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.086+0000 7effcbe00640 1 --2- 172.21.15.3:0/287546931 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7effb00a32c0 0x7effb00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:31.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.086+0000 7effcbe00640 1 --2- 172.21.15.3:0/287546931 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7effb00a32c0 0x7effb00a5780 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7effbc005d00 tx=0x7effbc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:31.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.090+0000 7effc8c00640 1 -- 172.21.15.3:0/287546931 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7effb809c980 con 0x7effcc1047e0 2024-09-19T06:09:31.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.316+0000 7effd1400640 1 -- 172.21.15.3:0/287546931 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effcc02d7c0 con 0x7effcc1047e0 2024-09-19T06:09:31.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.316+0000 7effc8c00640 1 -- 172.21.15.3:0/287546931 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5545 (secure 0 0 0) 0x7effb809c280 con 0x7effcc1047e0 2024-09-19T06:09:31.319 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:09:31.319 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":7,"btime":"2024-09-19T06:09:30:992701+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24494,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-19T06:09:31.319 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 7 2024-09-19T06:09:31.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.319+0000 7effd1400640 1 -- 172.21.15.3:0/287546931 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7effb00a32c0 msgr2=0x7effb00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:31.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.319+0000 7effd1400640 1 --2- 172.21.15.3:0/287546931 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7effb00a32c0 0x7effb00a5780 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7effbc005d00 tx=0x7effbc00b410 comp rx=0 tx=0).stop 2024-09-19T06:09:31.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.319+0000 7effd1400640 1 -- 172.21.15.3:0/287546931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc1047e0 msgr2=0x7effcc19a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:31.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.319+0000 7effd1400640 1 --2- 172.21.15.3:0/287546931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc1047e0 0x7effcc19a960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7effb800e9f0 tx=0x7effb800edf0 comp rx=0 tx=0).stop 2024-09-19T06:09:31.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.319+0000 7effd1400640 1 -- 172.21.15.3:0/287546931 shutdown_connections 2024-09-19T06:09:31.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.319+0000 7effd1400640 1 --2- 172.21.15.3:0/287546931 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7effb00a32c0 0x7effb00a5780 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:31.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.319+0000 7effd1400640 1 --2- 172.21.15.3:0/287546931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7effcc108f60 0x7effcc19ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:31.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.319+0000 7effd1400640 1 --2- 172.21.15.3:0/287546931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7effcc1047e0 0x7effcc19a960 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:31.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.319+0000 7effd1400640 1 --2- 172.21.15.3:0/287546931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effcc103e30 0x7effcc19a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:31.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.319+0000 7effd1400640 1 -- 172.21.15.3:0/287546931 >> 172.21.15.3:0/287546931 conn(0x7effcc0ff910 msgr2=0x7effcc100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:31.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.319+0000 7effd1400640 1 -- 172.21.15.3:0/287546931 shutdown_connections 2024-09-19T06:09:31.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:31.319+0000 7effd1400640 1 -- 172.21.15.3:0/287546931 wait complete. 2024-09-19T06:09:31.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:31 smithi003 ceph-mon[30893]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:31.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:31 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:31.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:31 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:31.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:31 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:31.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:31 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:31.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:31 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:31.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:31 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:31.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:31 smithi003 ceph-mon[30893]: Deploying daemon mds.c on smithi071 2024-09-19T06:09:31.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:31 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.71:6834/3322076004,v1:172.21.15.71:6835/3322076004] up:boot 2024-09-19T06:09:31.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:31 smithi003 ceph-mon[30893]: fsmap 6 up:standby 2024-09-19T06:09:31.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:31 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:09:31.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:31 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/287546931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:31.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:31 smithi059 ceph-mon[35138]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:31.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:31 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:31.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:31 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:31.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:31 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:31.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:31 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:31.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:31 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:31.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:31 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:31.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:31 smithi059 ceph-mon[35138]: Deploying daemon mds.c on smithi071 2024-09-19T06:09:31.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:31 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.71:6834/3322076004,v1:172.21.15.71:6835/3322076004] up:boot 2024-09-19T06:09:31.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:31 smithi059 ceph-mon[35138]: fsmap 6 up:standby 2024-09-19T06:09:31.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:31 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:09:31.790 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:31 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/287546931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:31.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:31 smithi071 ceph-mon[35662]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:31.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:31 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:31.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:31 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:31.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:31 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:31.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:31 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:31.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:31 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:31.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:31 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:31.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:31 smithi071 ceph-mon[35662]: Deploying daemon mds.c on smithi071 2024-09-19T06:09:31.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:31 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.71:6834/3322076004,v1:172.21.15.71:6835/3322076004] up:boot 2024-09-19T06:09:31.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:31 smithi071 ceph-mon[35662]: fsmap 6 up:standby 2024-09-19T06:09:31.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:31 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:09:31.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:31 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/287546931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:32.761 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 19 06:09:32 smithi071 systemd[1]: Starting Ceph mds.c for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:09:33.025 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 19 06:09:32 smithi071 podman[66034]: 2024-09-19 06:09:32.661833516 +0000 UTC m=+0.016131774 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:09:33.025 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 19 06:09:32 smithi071 podman[66034]: 2024-09-19 06:09:32.762574458 +0000 UTC m=+0.116872751 container create 1f1909f6bdaa6229370fb34934c7ca0293fc9dbdc035c628fd04b58bb15cafa9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T06:09:33.025 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 19 06:09:33 smithi071 podman[66034]: 2024-09-19 06:09:33.024018027 +0000 UTC m=+0.378316288 container init 1f1909f6bdaa6229370fb34934c7ca0293fc9dbdc035c628fd04b58bb15cafa9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-c, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:09:33.336 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 19 06:09:33 smithi071 podman[66034]: 2024-09-19 06:09:33.026826667 +0000 UTC m=+0.381124917 container start 1f1909f6bdaa6229370fb34934c7ca0293fc9dbdc035c628fd04b58bb15cafa9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-c, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-19T06:09:33.336 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 19 06:09:33 smithi071 ceph-mds[66053]: -- 172.21.15.71:0/2390397645 <== mon.1 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556c4505f860 con 0x556c4503d000 2024-09-19T06:09:33.336 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 19 06:09:33 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-c[66049]: starting mds.c at 2024-09-19T06:09:33.336 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 19 06:09:33 smithi071 bash[66034]: 1f1909f6bdaa6229370fb34934c7ca0293fc9dbdc035c628fd04b58bb15cafa9 2024-09-19T06:09:33.336 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 19 06:09:33 smithi071 systemd[1]: Started Ceph mds.c for 782a5144-764c-11ef-bceb-c7b262605968. 2024-09-19T06:09:33.778 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:33 smithi059 ceph-mon[35138]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:33.778 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:33 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:33.778 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:33 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:33.778 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:33 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:33.778 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:33 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:33.778 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:33 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:33.778 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:33 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:33.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:33 smithi003 ceph-mon[30893]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:33.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:33 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:33.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:33 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:33.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:33 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:33.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:33 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:33.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:33 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:33.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:33 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:33.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:33 smithi071 ceph-mon[35662]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:33.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:33 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:33.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:33 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:33.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:33 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:33.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:33 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:33.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:33 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:33.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:33 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:34.162 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:09:34.553 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:34.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:34 smithi059 ceph-mon[35138]: Deploying daemon mds.h on smithi059 2024-09-19T06:09:34.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:34 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] up:boot 2024-09-19T06:09:34.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:34 smithi059 ceph-mon[35138]: fsmap 7 up:standby 2024-09-19T06:09:34.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:34 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:09:34.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:34 smithi003 ceph-mon[30893]: Deploying daemon mds.h on smithi059 2024-09-19T06:09:34.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:34 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] up:boot 2024-09-19T06:09:34.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:34 smithi003 ceph-mon[30893]: fsmap 7 up:standby 2024-09-19T06:09:34.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:34 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:09:34.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:34 smithi071 ceph-mon[35662]: Deploying daemon mds.h on smithi059 2024-09-19T06:09:34.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:34 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] up:boot 2024-09-19T06:09:34.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:34 smithi071 ceph-mon[35662]: fsmap 7 up:standby 2024-09-19T06:09:34.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:34 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:09:35.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.165+0000 7f2a33c00640 1 -- 172.21.15.3:0/394091985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a2c10e430 msgr2=0x7f2a2c110820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:35.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.165+0000 7f2a33c00640 1 --2- 172.21.15.3:0/394091985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a2c10e430 0x7f2a2c110820 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2a24009be0 tx=0x7f2a2402a750 comp rx=0 tx=0).stop 2024-09-19T06:09:35.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.165+0000 7f2a33c00640 1 -- 172.21.15.3:0/394091985 shutdown_connections 2024-09-19T06:09:35.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.165+0000 7f2a33c00640 1 --2- 172.21.15.3:0/394091985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a2c10e430 0x7f2a2c110820 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:35.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.165+0000 7f2a33c00640 1 --2- 172.21.15.3:0/394091985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2a2c074ee0 0x7f2a2c10def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:35.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.165+0000 7f2a33c00640 1 --2- 172.21.15.3:0/394091985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a2c0745c0 0x7f2a2c0749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:35.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.165+0000 7f2a33c00640 1 -- 172.21.15.3:0/394091985 >> 172.21.15.3:0/394091985 conn(0x7f2a2c0fd8b0 msgr2=0x7f2a2c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:35.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.165+0000 7f2a33c00640 1 -- 172.21.15.3:0/394091985 shutdown_connections 2024-09-19T06:09:35.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.165+0000 7f2a33c00640 1 -- 172.21.15.3:0/394091985 wait complete. 2024-09-19T06:09:35.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.166+0000 7f2a33c00640 1 Processor -- start 2024-09-19T06:09:35.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.167+0000 7f2a33c00640 1 -- start start 2024-09-19T06:09:35.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.167+0000 7f2a33c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a2c0745c0 0x7f2a2c19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:35.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.167+0000 7f2a33c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2a2c074ee0 0x7f2a2c19ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:35.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.167+0000 7f2a33c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a2c10e430 0x7f2a2c19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:35.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.167+0000 7f2a33c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2c114120 con 0x7f2a2c0745c0 2024-09-19T06:09:35.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.167+0000 7f2a33c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2c113fa0 con 0x7f2a2c10e430 2024-09-19T06:09:35.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.167+0000 7f2a33c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2c1142a0 con 0x7f2a2c074ee0 2024-09-19T06:09:35.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.167+0000 7f2a31200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a2c0745c0 0x7f2a2c19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:35.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.168+0000 7f2a31200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a2c0745c0 0x7f2a2c19a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51764/0 (socket says 172.21.15.3:51764) 2024-09-19T06:09:35.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.168+0000 7f2a31200640 1 -- 172.21.15.3:0/1646633064 learned_addr learned my addr 172.21.15.3:0/1646633064 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:09:35.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.168+0000 7f2a31c00640 1 --2- 172.21.15.3:0/1646633064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a2c10e430 0x7f2a2c19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:35.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.168+0000 7f2a2be00640 1 --2- 172.21.15.3:0/1646633064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2a2c074ee0 0x7f2a2c19ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:35.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.168+0000 7f2a31200640 1 -- 172.21.15.3:0/1646633064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2a2c074ee0 msgr2=0x7f2a2c19ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:35.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.168+0000 7f2a31200640 1 --2- 172.21.15.3:0/1646633064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2a2c074ee0 0x7f2a2c19ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:35.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.168+0000 7f2a31200640 1 -- 172.21.15.3:0/1646633064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a2c10e430 msgr2=0x7f2a2c19efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:35.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.168+0000 7f2a31200640 1 --2- 172.21.15.3:0/1646633064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a2c10e430 0x7f2a2c19efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:35.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.168+0000 7f2a31200640 1 -- 172.21.15.3:0/1646633064 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a2c19f690 con 0x7f2a2c0745c0 2024-09-19T06:09:35.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.168+0000 7f2a31200640 1 --2- 172.21.15.3:0/1646633064 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a2c0745c0 0x7f2a2c19a6e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000e9c0 tx=0x7f2a2000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:35.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.168+0000 7f2a29600640 1 -- 172.21.15.3:0/1646633064 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a2000ccc0 con 0x7f2a2c0745c0 2024-09-19T06:09:35.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.169+0000 7f2a33c00640 1 -- 172.21.15.3:0/1646633064 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a2c19f980 con 0x7f2a2c0745c0 2024-09-19T06:09:35.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.169+0000 7f2a29600640 1 -- 172.21.15.3:0/1646633064 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a20005500 con 0x7f2a2c0745c0 2024-09-19T06:09:35.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.169+0000 7f2a29600640 1 -- 172.21.15.3:0/1646633064 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a20010430 con 0x7f2a2c0745c0 2024-09-19T06:09:35.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.169+0000 7f2a33c00640 1 -- 172.21.15.3:0/1646633064 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a2c1a7260 con 0x7f2a2c0745c0 2024-09-19T06:09:35.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.170+0000 7f2a33c00640 1 -- 172.21.15.3:0/1646633064 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a2c0749a0 con 0x7f2a2c0745c0 2024-09-19T06:09:35.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.172+0000 7f2a29600640 1 -- 172.21.15.3:0/1646633064 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f2a200046c0 con 0x7f2a2c0745c0 2024-09-19T06:09:35.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.173+0000 7f2a29600640 1 --2- 172.21.15.3:0/1646633064 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f2a140a3240 0x7f2a140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:35.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.173+0000 7f2a29600640 1 -- 172.21.15.3:0/1646633064 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f2a200cf800 con 0x7f2a2c0745c0 2024-09-19T06:09:35.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.173+0000 7f2a2be00640 1 --2- 172.21.15.3:0/1646633064 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f2a140a3240 0x7f2a140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:35.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.174+0000 7f2a2be00640 1 --2- 172.21.15.3:0/1646633064 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f2a140a3240 0x7f2a140a5700 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c10f7e0 tx=0x7f2a18005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:35.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.178+0000 7f2a29600640 1 -- 172.21.15.3:0/1646633064 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2a2009c920 con 0x7f2a2c0745c0 2024-09-19T06:09:35.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.399+0000 7f2a33c00640 1 -- 172.21.15.3:0/1646633064 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a2c1095e0 con 0x7f2a2c0745c0 2024-09-19T06:09:35.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.399+0000 7f2a29600640 1 -- 172.21.15.3:0/1646633064 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6367 (secure 0 0 0) 0x7f2a2009c220 con 0x7f2a2c0745c0 2024-09-19T06:09:35.402 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:09:35.402 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":8,"btime":"2024-09-19T06:09:33:518932+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24494,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T06:09:35.402 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 8 2024-09-19T06:09:35.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.402+0000 7f2a33c00640 1 -- 172.21.15.3:0/1646633064 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f2a140a3240 msgr2=0x7f2a140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:35.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.402+0000 7f2a33c00640 1 --2- 172.21.15.3:0/1646633064 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f2a140a3240 0x7f2a140a5700 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c10f7e0 tx=0x7f2a18005f90 comp rx=0 tx=0).stop 2024-09-19T06:09:35.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.402+0000 7f2a33c00640 1 -- 172.21.15.3:0/1646633064 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a2c0745c0 msgr2=0x7f2a2c19a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:35.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.402+0000 7f2a33c00640 1 --2- 172.21.15.3:0/1646633064 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a2c0745c0 0x7f2a2c19a6e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000e9c0 tx=0x7f2a2000ee80 comp rx=0 tx=0).stop 2024-09-19T06:09:35.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.402+0000 7f2a33c00640 1 -- 172.21.15.3:0/1646633064 shutdown_connections 2024-09-19T06:09:35.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.402+0000 7f2a33c00640 1 --2- 172.21.15.3:0/1646633064 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f2a140a3240 0x7f2a140a5700 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:35.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.402+0000 7f2a33c00640 1 --2- 172.21.15.3:0/1646633064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a2c10e430 0x7f2a2c19efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:35.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.402+0000 7f2a33c00640 1 --2- 172.21.15.3:0/1646633064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2a2c074ee0 0x7f2a2c19ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:35.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.402+0000 7f2a33c00640 1 --2- 172.21.15.3:0/1646633064 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a2c0745c0 0x7f2a2c19a6e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:35.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.402+0000 7f2a33c00640 1 -- 172.21.15.3:0/1646633064 >> 172.21.15.3:0/1646633064 conn(0x7f2a2c0fd8b0 msgr2=0x7f2a2c0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:35.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.402+0000 7f2a33c00640 1 -- 172.21.15.3:0/1646633064 shutdown_connections 2024-09-19T06:09:35.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:35.402+0000 7f2a33c00640 1 -- 172.21.15.3:0/1646633064 wait complete. 2024-09-19T06:09:35.473 INFO:journalctl@ceph.mds.h.smithi059.stdout:Sep 19 06:09:35 smithi059 systemd[1]: Starting Ceph mds.h for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:09:35.753 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:35 smithi059 ceph-mon[35138]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:35.754 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:35 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1646633064' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:35.754 INFO:journalctl@ceph.mds.h.smithi059.stdout:Sep 19 06:09:35 smithi059 podman[65005]: 2024-09-19 06:09:35.374239165 +0000 UTC m=+0.016286651 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:09:35.754 INFO:journalctl@ceph.mds.h.smithi059.stdout:Sep 19 06:09:35 smithi059 podman[65005]: 2024-09-19 06:09:35.500213566 +0000 UTC m=+0.142261052 container create 531d5cd8bc40aa04bcd9a118f8e7cdecb4b789d51944f88586fadc0097a604b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-h, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T06:09:35.754 INFO:journalctl@ceph.mds.h.smithi059.stdout:Sep 19 06:09:35 smithi059 podman[65005]: 2024-09-19 06:09:35.753014881 +0000 UTC m=+0.395062367 container init 531d5cd8bc40aa04bcd9a118f8e7cdecb4b789d51944f88586fadc0097a604b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T06:09:35.801 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:35 smithi003 ceph-mon[30893]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:35.801 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:35 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1646633064' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:35.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:35 smithi071 ceph-mon[35662]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:35.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:35 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1646633064' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:36.038 INFO:journalctl@ceph.mds.h.smithi059.stdout:Sep 19 06:09:35 smithi059 podman[65005]: 2024-09-19 06:09:35.756074485 +0000 UTC m=+0.398121973 container start 531d5cd8bc40aa04bcd9a118f8e7cdecb4b789d51944f88586fadc0097a604b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-h, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T06:09:36.038 INFO:journalctl@ceph.mds.h.smithi059.stdout:Sep 19 06:09:35 smithi059 ceph-mds[65024]: -- 172.21.15.59:0/1078159930 <== mon.2 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563c81151860 con 0x563c8112f400 2024-09-19T06:09:36.039 INFO:journalctl@ceph.mds.h.smithi059.stdout:Sep 19 06:09:35 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-h[65020]: starting mds.h at 2024-09-19T06:09:36.039 INFO:journalctl@ceph.mds.h.smithi059.stdout:Sep 19 06:09:35 smithi059 bash[65005]: 531d5cd8bc40aa04bcd9a118f8e7cdecb4b789d51944f88586fadc0097a604b8 2024-09-19T06:09:36.039 INFO:journalctl@ceph.mds.h.smithi059.stdout:Sep 19 06:09:35 smithi059 systemd[1]: Started Ceph mds.h for 782a5144-764c-11ef-bceb-c7b262605968. 2024-09-19T06:09:37.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:37.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:37.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:37.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:37.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:37.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:37.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:36 smithi059 ceph-mon[35138]: Deploying daemon mds.i on smithi071 2024-09-19T06:09:37.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:36 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] up:boot 2024-09-19T06:09:37.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:36 smithi059 ceph-mon[35138]: fsmap 8 up:standby 2024-09-19T06:09:37.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:36 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:09:37.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:37.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:37.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:37.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:37.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:37.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:37.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:36 smithi003 ceph-mon[30893]: Deploying daemon mds.i on smithi071 2024-09-19T06:09:37.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:36 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] up:boot 2024-09-19T06:09:37.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:36 smithi003 ceph-mon[30893]: fsmap 8 up:standby 2024-09-19T06:09:37.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:36 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:09:37.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:37.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:37.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:37.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:37.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:37.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:37.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:36 smithi071 ceph-mon[35662]: Deploying daemon mds.i on smithi071 2024-09-19T06:09:37.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:36 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] up:boot 2024-09-19T06:09:37.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:36 smithi071 ceph-mon[35662]: fsmap 8 up:standby 2024-09-19T06:09:37.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:36 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:09:38.060 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:37 smithi071 ceph-mon[35662]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:38.060 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 19 06:09:38 smithi071 systemd[1]: Starting Ceph mds.i for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:09:38.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:37 smithi059 ceph-mon[35138]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:38.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:37 smithi003 ceph-mon[30893]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:38.336 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 19 06:09:38 smithi071 podman[66331]: 2024-09-19 06:09:38.173506905 +0000 UTC m=+0.015771579 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:09:38.336 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 19 06:09:38 smithi071 podman[66331]: 2024-09-19 06:09:38.278122123 +0000 UTC m=+0.120386797 container create 027efa936dc3293098c7493612ad80a3319d33b7150a8309e504a8215a3541a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-i, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T06:09:38.383 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:09:38.771 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:38.836 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 19 06:09:38 smithi071 podman[66331]: 2024-09-19 06:09:38.548459482 +0000 UTC m=+0.390724157 container init 027efa936dc3293098c7493612ad80a3319d33b7150a8309e504a8215a3541a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-i, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T06:09:38.836 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 19 06:09:38 smithi071 podman[66331]: 2024-09-19 06:09:38.551757648 +0000 UTC m=+0.394022323 container start 027efa936dc3293098c7493612ad80a3319d33b7150a8309e504a8215a3541a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-i, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T06:09:38.836 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 19 06:09:38 smithi071 ceph-mds[66350]: -- 172.21.15.71:0/3980508821 <== mon.1 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563213627860 con 0x563213605400 2024-09-19T06:09:38.836 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 19 06:09:38 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-i[66346]: starting mds.i at 2024-09-19T06:09:38.836 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 19 06:09:38 smithi071 bash[66331]: 027efa936dc3293098c7493612ad80a3319d33b7150a8309e504a8215a3541a5 2024-09-19T06:09:38.836 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 19 06:09:38 smithi071 systemd[1]: Started Ceph mds.i for 782a5144-764c-11ef-bceb-c7b262605968. 2024-09-19T06:09:39.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.356+0000 7f7ddcc00640 1 -- 172.21.15.3:0/854122455 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dd8074620 msgr2=0x7f7dd8074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:39.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.356+0000 7f7ddcc00640 1 --2- 172.21.15.3:0/854122455 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dd8074620 0x7f7dd8074a00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8009900 tx=0x7f7dc802a480 comp rx=0 tx=0).stop 2024-09-19T06:09:39.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.356+0000 7f7ddcc00640 1 -- 172.21.15.3:0/854122455 shutdown_connections 2024-09-19T06:09:39.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.356+0000 7f7ddcc00640 1 --2- 172.21.15.3:0/854122455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dd810e3c0 0x7f7dd8110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:39.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.356+0000 7f7ddcc00640 1 --2- 172.21.15.3:0/854122455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dd8074f40 0x7f7dd810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:39.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.356+0000 7f7ddcc00640 1 --2- 172.21.15.3:0/854122455 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dd8074620 0x7f7dd8074a00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:39.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.356+0000 7f7ddcc00640 1 -- 172.21.15.3:0/854122455 >> 172.21.15.3:0/854122455 conn(0x7f7dd80fd8c0 msgr2=0x7f7dd80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:39.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.356+0000 7f7ddcc00640 1 -- 172.21.15.3:0/854122455 shutdown_connections 2024-09-19T06:09:39.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.356+0000 7f7ddcc00640 1 -- 172.21.15.3:0/854122455 wait complete. 2024-09-19T06:09:39.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.357+0000 7f7ddcc00640 1 Processor -- start 2024-09-19T06:09:39.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.357+0000 7f7ddcc00640 1 -- start start 2024-09-19T06:09:39.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.357+0000 7f7ddcc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dd8074620 0x7f7dd819a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:39.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.357+0000 7f7ddcc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dd8074f40 0x7f7dd819aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:39.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.357+0000 7f7ddcc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dd810e3c0 0x7f7dd819df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:39.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.357+0000 7f7ddcc00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd81141a0 con 0x7f7dd8074f40 2024-09-19T06:09:39.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.357+0000 7f7ddcc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd8114020 con 0x7f7dd810e3c0 2024-09-19T06:09:39.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.357+0000 7f7ddcc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd8114320 con 0x7f7dd8074620 2024-09-19T06:09:39.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.358+0000 7f7dcd400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dd8074f40 0x7f7dd819aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:39.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.358+0000 7f7dd5e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dd8074620 0x7f7dd819a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:39.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.358+0000 7f7dd5e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dd8074620 0x7f7dd819a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:45422/0 (socket says 172.21.15.3:45422) 2024-09-19T06:09:39.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.358+0000 7f7dd6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dd810e3c0 0x7f7dd819df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:39.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.358+0000 7f7dd5e00640 1 -- 172.21.15.3:0/2252028416 learned_addr learned my addr 172.21.15.3:0/2252028416 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:09:39.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.358+0000 7f7dd5e00640 1 -- 172.21.15.3:0/2252028416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dd810e3c0 msgr2=0x7f7dd819df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:39.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.358+0000 7f7dd5e00640 1 --2- 172.21.15.3:0/2252028416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dd810e3c0 0x7f7dd819df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:39.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.358+0000 7f7dd5e00640 1 -- 172.21.15.3:0/2252028416 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dd8074f40 msgr2=0x7f7dd819aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:39.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.358+0000 7f7dd5e00640 1 --2- 172.21.15.3:0/2252028416 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dd8074f40 0x7f7dd819aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:39.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.358+0000 7f7dd5e00640 1 -- 172.21.15.3:0/2252028416 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd819e6b0 con 0x7f7dd8074620 2024-09-19T06:09:39.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.358+0000 7f7dd5e00640 1 --2- 172.21.15.3:0/2252028416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dd8074620 0x7f7dd819a760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8004770 tx=0x7f7dc8003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:39.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.359+0000 7f7dcf400640 1 -- 172.21.15.3:0/2252028416 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc803f070 con 0x7f7dd8074620 2024-09-19T06:09:39.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.359+0000 7f7ddcc00640 1 -- 172.21.15.3:0/2252028416 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dd819e940 con 0x7f7dd8074620 2024-09-19T06:09:39.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.359+0000 7f7dcf400640 1 -- 172.21.15.3:0/2252028416 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dc8031ca0 con 0x7f7dd8074620 2024-09-19T06:09:39.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.359+0000 7f7dcf400640 1 -- 172.21.15.3:0/2252028416 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8035030 con 0x7f7dd8074620 2024-09-19T06:09:39.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.359+0000 7f7ddcc00640 1 -- 172.21.15.3:0/2252028416 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dd81a7310 con 0x7f7dd8074620 2024-09-19T06:09:39.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.360+0000 7f7ddcc00640 1 -- 172.21.15.3:0/2252028416 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dd8074a00 con 0x7f7dd8074620 2024-09-19T06:09:39.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.362+0000 7f7dcf400640 1 -- 172.21.15.3:0/2252028416 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f7dc8042070 con 0x7f7dd8074620 2024-09-19T06:09:39.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.363+0000 7f7dcf400640 1 --2- 172.21.15.3:0/2252028416 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f7dbc0a32c0 0x7f7dbc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:39.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.363+0000 7f7dcf400640 1 -- 172.21.15.3:0/2252028416 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f7dc80efa50 con 0x7f7dd8074620 2024-09-19T06:09:39.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.363+0000 7f7dcd400640 1 --2- 172.21.15.3:0/2252028416 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f7dbc0a32c0 0x7f7dbc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:39.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.364+0000 7f7dcd400640 1 --2- 172.21.15.3:0/2252028416 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f7dbc0a32c0 0x7f7dbc0a5780 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7dc00095f0 tx=0x7f7dc0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:39.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.367+0000 7f7dcf400640 1 -- 172.21.15.3:0/2252028416 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7dc80bc5e0 con 0x7f7dd8074620 2024-09-19T06:09:39.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.599+0000 7f7ddcc00640 1 -- 172.21.15.3:0/2252028416 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7dd8109540 con 0x7f7dd8074620 2024-09-19T06:09:39.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.599+0000 7f7dcf400640 1 -- 172.21.15.3:0/2252028416 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8019 (secure 0 0 0) 0x7f7dc80c08e0 con 0x7f7dd8074620 2024-09-19T06:09:39.602 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:09:39.602 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":10,"btime":"2024-09-19T06:09:38:928923+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24494,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24515,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24532,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T06:09:39.602 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 10 2024-09-19T06:09:39.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.602+0000 7f7ddcc00640 1 -- 172.21.15.3:0/2252028416 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f7dbc0a32c0 msgr2=0x7f7dbc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:39.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.602+0000 7f7ddcc00640 1 --2- 172.21.15.3:0/2252028416 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f7dbc0a32c0 0x7f7dbc0a5780 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7dc00095f0 tx=0x7f7dc0005f90 comp rx=0 tx=0).stop 2024-09-19T06:09:39.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.602+0000 7f7ddcc00640 1 -- 172.21.15.3:0/2252028416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dd8074620 msgr2=0x7f7dd819a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:39.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.602+0000 7f7ddcc00640 1 --2- 172.21.15.3:0/2252028416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dd8074620 0x7f7dd819a760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8004770 tx=0x7f7dc8003c10 comp rx=0 tx=0).stop 2024-09-19T06:09:39.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.602+0000 7f7ddcc00640 1 -- 172.21.15.3:0/2252028416 shutdown_connections 2024-09-19T06:09:39.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.602+0000 7f7ddcc00640 1 --2- 172.21.15.3:0/2252028416 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f7dbc0a32c0 0x7f7dbc0a5780 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:39.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.602+0000 7f7ddcc00640 1 --2- 172.21.15.3:0/2252028416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dd810e3c0 0x7f7dd819df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:39.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.602+0000 7f7ddcc00640 1 --2- 172.21.15.3:0/2252028416 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dd8074f40 0x7f7dd819aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:39.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.602+0000 7f7ddcc00640 1 --2- 172.21.15.3:0/2252028416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dd8074620 0x7f7dd819a760 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:39.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.602+0000 7f7ddcc00640 1 -- 172.21.15.3:0/2252028416 >> 172.21.15.3:0/2252028416 conn(0x7f7dd80fd8c0 msgr2=0x7f7dd80fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:39.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.602+0000 7f7ddcc00640 1 -- 172.21.15.3:0/2252028416 shutdown_connections 2024-09-19T06:09:39.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:39.602+0000 7f7ddcc00640 1 -- 172.21.15.3:0/2252028416 wait complete. 2024-09-19T06:09:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:39 smithi059 ceph-mon[35138]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:39 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:39 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:39 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:39 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:39 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:39 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:39 smithi059 ceph-mon[35138]: Deploying daemon mds.g on smithi003 2024-09-19T06:09:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:39 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] up:boot 2024-09-19T06:09:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:39 smithi059 ceph-mon[35138]: fsmap 9 up:standby 2024-09-19T06:09:40.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:39 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:09:40.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:39 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2252028416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:40.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:39 smithi003 ceph-mon[30893]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:40.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:39 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:40.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:39 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:40.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:39 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:40.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:39 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:40.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:39 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:40.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:39 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:40.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:39 smithi003 ceph-mon[30893]: Deploying daemon mds.g on smithi003 2024-09-19T06:09:40.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:39 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] up:boot 2024-09-19T06:09:40.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:39 smithi003 ceph-mon[30893]: fsmap 9 up:standby 2024-09-19T06:09:40.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:39 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:09:40.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:39 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2252028416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:39 smithi071 ceph-mon[35662]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:39 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:39 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:39 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:39 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:39 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:40.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:39 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:40.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:39 smithi071 ceph-mon[35662]: Deploying daemon mds.g on smithi003 2024-09-19T06:09:40.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:39 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] up:boot 2024-09-19T06:09:40.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:39 smithi071 ceph-mon[35662]: fsmap 9 up:standby 2024-09-19T06:09:40.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:39 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:09:40.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:39 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2252028416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:41.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:41 smithi003 ceph-mon[30893]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:42.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:41 smithi059 ceph-mon[35138]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:42.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:41 smithi071 ceph-mon[35662]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:42.556 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:09:42.567 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 19 06:09:42 smithi003 systemd[1]: Starting Ceph mds.g for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:09:42.835 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 19 06:09:42 smithi003 podman[72404]: 2024-09-19 06:09:42.470352251 +0000 UTC m=+0.027560452 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:09:42.835 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 19 06:09:42 smithi003 podman[72404]: 2024-09-19 06:09:42.627626078 +0000 UTC m=+0.184834254 container create 1f73e7768b6c11c9f9e0b6dd1a4089d8cd97b3379eaa0f740eea9ecba06e5e90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-g, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:09:43.086 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:43.219 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 19 06:09:42 smithi003 podman[72404]: 2024-09-19 06:09:42.904128435 +0000 UTC m=+0.461336624 container init 1f73e7768b6c11c9f9e0b6dd1a4089d8cd97b3379eaa0f740eea9ecba06e5e90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-g, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T06:09:43.219 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 19 06:09:42 smithi003 podman[72404]: 2024-09-19 06:09:42.913006518 +0000 UTC m=+0.470214703 container start 1f73e7768b6c11c9f9e0b6dd1a4089d8cd97b3379eaa0f740eea9ecba06e5e90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-g, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T06:09:43.219 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 19 06:09:42 smithi003 ceph-mds[72453]: -- 172.21.15.3:0/1578838389 <== mon.2 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561581dfb860 con 0x561581dd9000 2024-09-19T06:09:43.219 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 19 06:09:42 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-g[72436]: starting mds.g at 2024-09-19T06:09:43.219 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 19 06:09:43 smithi003 bash[72404]: 1f73e7768b6c11c9f9e0b6dd1a4089d8cd97b3379eaa0f740eea9ecba06e5e90 2024-09-19T06:09:43.219 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 19 06:09:43 smithi003 systemd[1]: Started Ceph mds.g for 782a5144-764c-11ef-bceb-c7b262605968. 2024-09-19T06:09:43.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.778+0000 7f37f3a00640 1 -- 172.21.15.3:0/4093955744 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f37ec109140 msgr2=0x7f37ec110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:43.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.778+0000 7f37f3a00640 1 --2- 172.21.15.3:0/4093955744 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f37ec109140 0x7f37ec110cc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f37e4009ca0 tx=0x7f37e402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:09:43.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.778+0000 7f37f3a00640 1 -- 172.21.15.3:0/4093955744 shutdown_connections 2024-09-19T06:09:43.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.778+0000 7f37f3a00640 1 --2- 172.21.15.3:0/4093955744 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f37ec109140 0x7f37ec110cc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:43.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.778+0000 7f37f3a00640 1 --2- 172.21.15.3:0/4093955744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37ec1049c0 0x7f37ec108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:43.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.778+0000 7f37f3a00640 1 --2- 172.21.15.3:0/4093955744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37ec104010 0x7f37ec1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:43.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.778+0000 7f37f3a00640 1 -- 172.21.15.3:0/4093955744 >> 172.21.15.3:0/4093955744 conn(0x7f37ec0ffa50 msgr2=0x7f37ec101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:43.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.778+0000 7f37f3a00640 1 -- 172.21.15.3:0/4093955744 shutdown_connections 2024-09-19T06:09:43.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.778+0000 7f37f3a00640 1 -- 172.21.15.3:0/4093955744 wait complete. 2024-09-19T06:09:43.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.779+0000 7f37f3a00640 1 Processor -- start 2024-09-19T06:09:43.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.780+0000 7f37f3a00640 1 -- start start 2024-09-19T06:09:43.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.780+0000 7f37f3a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37ec104010 0x7f37ec19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:43.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.780+0000 7f37f3a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f37ec1049c0 0x7f37ec19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:43.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.780+0000 7f37f3a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37ec109140 0x7f37ec19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:43.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.780+0000 7f37f3a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec114150 con 0x7f37ec1049c0 2024-09-19T06:09:43.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.780+0000 7f37f3a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec113fd0 con 0x7f37ec109140 2024-09-19T06:09:43.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.780+0000 7f37f3a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec1142d0 con 0x7f37ec104010 2024-09-19T06:09:43.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.780+0000 7f37f1000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37ec104010 0x7f37ec19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:43.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.780+0000 7f37f1000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37ec104010 0x7f37ec19a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:45458/0 (socket says 172.21.15.3:45458) 2024-09-19T06:09:43.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.780+0000 7f37f1000640 1 -- 172.21.15.3:0/2045444656 learned_addr learned my addr 172.21.15.3:0/2045444656 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:09:43.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.781+0000 7f37f1a00640 1 --2- 172.21.15.3:0/2045444656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37ec109140 0x7f37ec19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:43.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.781+0000 7f37e3e00640 1 --2- 172.21.15.3:0/2045444656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f37ec1049c0 0x7f37ec19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:43.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.781+0000 7f37f1000640 1 -- 172.21.15.3:0/2045444656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37ec109140 msgr2=0x7f37ec19ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:43.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.781+0000 7f37f1000640 1 --2- 172.21.15.3:0/2045444656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37ec109140 0x7f37ec19ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:43.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.781+0000 7f37f1000640 1 -- 172.21.15.3:0/2045444656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f37ec1049c0 msgr2=0x7f37ec19abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:43.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.781+0000 7f37f1000640 1 --2- 172.21.15.3:0/2045444656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f37ec1049c0 0x7f37ec19abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:43.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.781+0000 7f37f1000640 1 -- 172.21.15.3:0/2045444656 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37ec19f660 con 0x7f37ec104010 2024-09-19T06:09:43.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.781+0000 7f37f1000640 1 --2- 172.21.15.3:0/2045444656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37ec104010 0x7f37ec19a6b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f37dc00d950 tx=0x7f37dc00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:43.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.781+0000 7f37ea000640 1 -- 172.21.15.3:0/2045444656 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc017030 con 0x7f37ec104010 2024-09-19T06:09:43.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.781+0000 7f37f3a00640 1 -- 172.21.15.3:0/2045444656 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37ec19f950 con 0x7f37ec104010 2024-09-19T06:09:43.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.781+0000 7f37ea000640 1 -- 172.21.15.3:0/2045444656 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37dc004020 con 0x7f37ec104010 2024-09-19T06:09:43.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.782+0000 7f37ea000640 1 -- 172.21.15.3:0/2045444656 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc0047a0 con 0x7f37ec104010 2024-09-19T06:09:43.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.782+0000 7f37f3a00640 1 -- 172.21.15.3:0/2045444656 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37ec1a7230 con 0x7f37ec104010 2024-09-19T06:09:43.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.783+0000 7f37f3a00640 1 -- 172.21.15.3:0/2045444656 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37ec1043f0 con 0x7f37ec104010 2024-09-19T06:09:43.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.785+0000 7f37ea000640 1 -- 172.21.15.3:0/2045444656 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f37dc0041d0 con 0x7f37ec104010 2024-09-19T06:09:43.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.786+0000 7f37ea000640 1 --2- 172.21.15.3:0/2045444656 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f37d00a3240 0x7f37d00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:43.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.786+0000 7f37ea000640 1 -- 172.21.15.3:0/2045444656 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f37dc0cee50 con 0x7f37ec104010 2024-09-19T06:09:43.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.786+0000 7f37e3e00640 1 --2- 172.21.15.3:0/2045444656 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f37d00a3240 0x7f37d00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:43.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.787+0000 7f37e3e00640 1 --2- 172.21.15.3:0/2045444656 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f37d00a3240 0x7f37d00a5700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f37ec10aa00 tx=0x7f37d400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:43.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:43.790+0000 7f37ea000640 1 -- 172.21.15.3:0/2045444656 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f37dc09bf70 con 0x7f37ec104010 2024-09-19T06:09:44.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:44.023+0000 7f37f3a00640 1 -- 172.21.15.3:0/2045444656 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37ec19ba10 con 0x7f37ec104010 2024-09-19T06:09:44.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:44.024+0000 7f37ea000640 1 -- 172.21.15.3:0/2045444656 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8842 (secure 0 0 0) 0x7f37dc09b870 con 0x7f37ec104010 2024-09-19T06:09:44.026 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:09:44.026 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":11,"btime":"2024-09-19T06:09:43:720991+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24494,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24515,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24532,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T06:09:44.026 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 11 2024-09-19T06:09:44.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:44.027+0000 7f37f3a00640 1 -- 172.21.15.3:0/2045444656 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f37d00a3240 msgr2=0x7f37d00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:44.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:44.027+0000 7f37f3a00640 1 --2- 172.21.15.3:0/2045444656 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f37d00a3240 0x7f37d00a5700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f37ec10aa00 tx=0x7f37d400b390 comp rx=0 tx=0).stop 2024-09-19T06:09:44.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:44.027+0000 7f37f3a00640 1 -- 172.21.15.3:0/2045444656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37ec104010 msgr2=0x7f37ec19a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:44.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:44.027+0000 7f37f3a00640 1 --2- 172.21.15.3:0/2045444656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37ec104010 0x7f37ec19a6b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f37dc00d950 tx=0x7f37dc00de10 comp rx=0 tx=0).stop 2024-09-19T06:09:44.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:44.027+0000 7f37f3a00640 1 -- 172.21.15.3:0/2045444656 shutdown_connections 2024-09-19T06:09:44.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:44.027+0000 7f37f3a00640 1 --2- 172.21.15.3:0/2045444656 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f37d00a3240 0x7f37d00a5700 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:44.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:44.027+0000 7f37f3a00640 1 --2- 172.21.15.3:0/2045444656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37ec109140 0x7f37ec19ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:44.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:44.027+0000 7f37f3a00640 1 --2- 172.21.15.3:0/2045444656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f37ec1049c0 0x7f37ec19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:44.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:44.027+0000 7f37f3a00640 1 --2- 172.21.15.3:0/2045444656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f37ec104010 0x7f37ec19a6b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:44.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:44.027+0000 7f37f3a00640 1 -- 172.21.15.3:0/2045444656 >> 172.21.15.3:0/2045444656 conn(0x7f37ec0ffa50 msgr2=0x7f37ec100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:44.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:44.027+0000 7f37f3a00640 1 -- 172.21.15.3:0/2045444656 shutdown_connections 2024-09-19T06:09:44.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:44.027+0000 7f37f3a00640 1 -- 172.21.15.3:0/2045444656 wait complete. 2024-09-19T06:09:44.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:44 smithi003 ceph-mon[30893]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:44.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:44 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:44.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:44 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:44.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:44 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:44.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:44 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:44.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:44 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:44.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:44 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:44.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:44 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.3:6838/2272422067,v1:172.21.15.3:6839/2272422067] up:boot 2024-09-19T06:09:44.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:44 smithi003 ceph-mon[30893]: fsmap 10 up:standby 2024-09-19T06:09:44.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:44 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:09:44.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:44 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2045444656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:44.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:44 smithi059 ceph-mon[35138]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:44.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:44 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:44.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:44 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:44.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:44 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:44.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:44 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:44.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:44 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:44.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:44 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:44.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:44 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.3:6838/2272422067,v1:172.21.15.3:6839/2272422067] up:boot 2024-09-19T06:09:44.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:44 smithi059 ceph-mon[35138]: fsmap 10 up:standby 2024-09-19T06:09:44.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:44 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:09:44.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:44 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2045444656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:44.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:44 smithi071 ceph-mon[35662]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:44.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:44 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:44.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:44 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:44.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:44 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:44.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:44 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:44.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:44 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:44.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:44 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:44.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:44 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.3:6838/2272422067,v1:172.21.15.3:6839/2272422067] up:boot 2024-09-19T06:09:44.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:44 smithi071 ceph-mon[35662]: fsmap 10 up:standby 2024-09-19T06:09:44.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:44 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:09:44.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:44 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2045444656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:45.201 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:45 smithi003 ceph-mon[30893]: Deploying daemon mds.a on smithi003 2024-09-19T06:09:45.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:45 smithi071 ceph-mon[35662]: Deploying daemon mds.a on smithi003 2024-09-19T06:09:45.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:45 smithi059 ceph-mon[35138]: Deploying daemon mds.a on smithi003 2024-09-19T06:09:46.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:46 smithi003 ceph-mon[30893]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:46.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:46 smithi059 ceph-mon[35138]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:46.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:46 smithi071 ceph-mon[35662]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:46.943 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 19 06:09:46 smithi003 systemd[1]: Starting Ceph mds.a for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:09:46.946 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:09:47.252 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 19 06:09:46 smithi003 podman[72819]: 2024-09-19 06:09:46.846716973 +0000 UTC m=+0.027757506 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:09:47.253 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 19 06:09:46 smithi003 podman[72819]: 2024-09-19 06:09:46.981622342 +0000 UTC m=+0.162662883 container create 4d6e68aabb924384ad4cca9063e28e12bc11f3304fa5fae4de32961e69440faa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T06:09:47.253 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 19 06:09:47 smithi003 podman[72819]: 2024-09-19 06:09:47.251493349 +0000 UTC m=+0.432533882 container init 4d6e68aabb924384ad4cca9063e28e12bc11f3304fa5fae4de32961e69440faa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T06:09:47.518 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:47.585 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 19 06:09:47 smithi003 podman[72819]: 2024-09-19 06:09:47.258308328 +0000 UTC m=+0.439348863 container start 4d6e68aabb924384ad4cca9063e28e12bc11f3304fa5fae4de32961e69440faa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-a, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T06:09:47.585 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 19 06:09:47 smithi003 ceph-mds[72868]: -- 172.21.15.3:0/284548857 <== mon.0 v2:172.21.15.3:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ae19fe3c20 con 0x55ae19fc1400 2024-09-19T06:09:47.585 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 19 06:09:47 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-a[72851]: starting mds.a at 2024-09-19T06:09:47.585 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 19 06:09:47 smithi003 bash[72819]: 4d6e68aabb924384ad4cca9063e28e12bc11f3304fa5fae4de32961e69440faa 2024-09-19T06:09:47.586 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 19 06:09:47 smithi003 systemd[1]: Started Ceph mds.a for 782a5144-764c-11ef-bceb-c7b262605968. 2024-09-19T06:09:48.097 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.094+0000 7f863f600640 1 -- 172.21.15.3:0/2531353696 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86381049c0 msgr2=0x7f8638108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:48.097 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.094+0000 7f863f600640 1 --2- 172.21.15.3:0/2531353696 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86381049c0 0x7f8638108a10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8624009900 tx=0x7f862402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:09:48.097 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.094+0000 7f863f600640 1 -- 172.21.15.3:0/2531353696 shutdown_connections 2024-09-19T06:09:48.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.094+0000 7f863f600640 1 --2- 172.21.15.3:0/2531353696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8638109140 0x7f8638110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:48.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.094+0000 7f863f600640 1 --2- 172.21.15.3:0/2531353696 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86381049c0 0x7f8638108a10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:48.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.094+0000 7f863f600640 1 --2- 172.21.15.3:0/2531353696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8638104010 0x7f86381043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:48.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.094+0000 7f863f600640 1 -- 172.21.15.3:0/2531353696 >> 172.21.15.3:0/2531353696 conn(0x7f86380ffa50 msgr2=0x7f8638101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:48.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.094+0000 7f863f600640 1 -- 172.21.15.3:0/2531353696 shutdown_connections 2024-09-19T06:09:48.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.094+0000 7f863f600640 1 -- 172.21.15.3:0/2531353696 wait complete. 2024-09-19T06:09:48.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.095+0000 7f863f600640 1 Processor -- start 2024-09-19T06:09:48.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.095+0000 7f863f600640 1 -- start start 2024-09-19T06:09:48.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.096+0000 7f863f600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8638104010 0x7f863819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:48.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.096+0000 7f863f600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86381049c0 0x7f863819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:48.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.096+0000 7f863f600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8638109140 0x7f863819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:48.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.096+0000 7f863f600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8638114160 con 0x7f8638104010 2024-09-19T06:09:48.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.096+0000 7f863f600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8638113fe0 con 0x7f8638109140 2024-09-19T06:09:48.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.096+0000 7f863f600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f86381142e0 con 0x7f86381049c0 2024-09-19T06:09:48.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.096+0000 7f863cc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8638104010 0x7f863819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:48.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.096+0000 7f863cc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8638104010 0x7f863819a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36894/0 (socket says 172.21.15.3:36894) 2024-09-19T06:09:48.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.096+0000 7f863cc00640 1 -- 172.21.15.3:0/1721494563 learned_addr learned my addr 172.21.15.3:0/1721494563 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:09:48.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.096+0000 7f863d600640 1 --2- 172.21.15.3:0/1721494563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8638109140 0x7f863819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:48.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.096+0000 7f8637e00640 1 --2- 172.21.15.3:0/1721494563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86381049c0 0x7f863819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:48.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.096+0000 7f863cc00640 1 -- 172.21.15.3:0/1721494563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86381049c0 msgr2=0x7f863819ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:48.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.096+0000 7f863cc00640 1 --2- 172.21.15.3:0/1721494563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86381049c0 0x7f863819ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:48.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.096+0000 7f863cc00640 1 -- 172.21.15.3:0/1721494563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8638109140 msgr2=0x7f863819ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:48.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.096+0000 7f863cc00640 1 --2- 172.21.15.3:0/1721494563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8638109140 0x7f863819ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:48.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.096+0000 7f863cc00640 1 -- 172.21.15.3:0/1721494563 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863819f5f0 con 0x7f8638104010 2024-09-19T06:09:48.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.097+0000 7f863cc00640 1 --2- 172.21.15.3:0/1721494563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8638104010 0x7f863819a640 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f862c00e9f0 tx=0x7f862c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:48.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.100+0000 7f8635600640 1 -- 172.21.15.3:0/1721494563 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c00cd80 con 0x7f8638104010 2024-09-19T06:09:48.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.100+0000 7f863f600640 1 -- 172.21.15.3:0/1721494563 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f863819f8e0 con 0x7f8638104010 2024-09-19T06:09:48.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.100+0000 7f8635600640 1 -- 172.21.15.3:0/1721494563 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f862c010910 con 0x7f8638104010 2024-09-19T06:09:48.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.100+0000 7f8635600640 1 -- 172.21.15.3:0/1721494563 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c0188f0 con 0x7f8638104010 2024-09-19T06:09:48.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.100+0000 7f863f600640 1 -- 172.21.15.3:0/1721494563 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86381a71c0 con 0x7f8638104010 2024-09-19T06:09:48.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.102+0000 7f863f600640 1 -- 172.21.15.3:0/1721494563 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86381043f0 con 0x7f8638104010 2024-09-19T06:09:48.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.110+0000 7f8635600640 1 -- 172.21.15.3:0/1721494563 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f862c010ac0 con 0x7f8638104010 2024-09-19T06:09:48.113 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.111+0000 7f8635600640 1 --2- 172.21.15.3:0/1721494563 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f86200a32c0 0x7f86200a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:48.113 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.111+0000 7f8635600640 1 -- 172.21.15.3:0/1721494563 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f862c0cfc00 con 0x7f8638104010 2024-09-19T06:09:48.113 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.111+0000 7f8637e00640 1 --2- 172.21.15.3:0/1721494563 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f86200a32c0 0x7f86200a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:48.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.112+0000 7f8637e00640 1 --2- 172.21.15.3:0/1721494563 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f86200a32c0 0x7f86200a5780 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8624009230 tx=0x7f86240058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:48.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.113+0000 7f8635600640 1 -- 172.21.15.3:0/1721494563 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f862c09c6d0 con 0x7f8638104010 2024-09-19T06:09:48.166 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:48 smithi059 ceph-mon[35138]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:48.166 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:48 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:48.167 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:48 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:48.167 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:48 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:48.167 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:48 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:48.167 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:48 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:48.167 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:48 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:48.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:48 smithi003 ceph-mon[30893]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:48.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:48 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:48.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:48 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:48.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:48 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:48.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:48 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:48.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:48 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:48.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:48 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:48.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.334+0000 7f863f600640 1 -- 172.21.15.3:0/1721494563 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f863810c3b0 con 0x7f8638104010 2024-09-19T06:09:48.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.335+0000 7f8635600640 1 -- 172.21.15.3:0/1721494563 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9665 (secure 0 0 0) 0x7f862c0a09d0 con 0x7f8638104010 2024-09-19T06:09:48.338 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:09:48.338 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":12,"btime":"2024-09-19T06:09:48:097104+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24494,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24515,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24532,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T06:09:48.338 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 12 2024-09-19T06:09:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.337+0000 7f863f600640 1 -- 172.21.15.3:0/1721494563 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f86200a32c0 msgr2=0x7f86200a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.337+0000 7f863f600640 1 --2- 172.21.15.3:0/1721494563 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f86200a32c0 0x7f86200a5780 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8624009230 tx=0x7f86240058d0 comp rx=0 tx=0).stop 2024-09-19T06:09:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.337+0000 7f863f600640 1 -- 172.21.15.3:0/1721494563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8638104010 msgr2=0x7f863819a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.337+0000 7f863f600640 1 --2- 172.21.15.3:0/1721494563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8638104010 0x7f863819a640 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f862c00e9f0 tx=0x7f862c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:09:48.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.338+0000 7f863f600640 1 -- 172.21.15.3:0/1721494563 shutdown_connections 2024-09-19T06:09:48.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.338+0000 7f863f600640 1 --2- 172.21.15.3:0/1721494563 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f86200a32c0 0x7f86200a5780 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:48.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.338+0000 7f863f600640 1 --2- 172.21.15.3:0/1721494563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8638109140 0x7f863819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:48.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.338+0000 7f863f600640 1 --2- 172.21.15.3:0/1721494563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f86381049c0 0x7f863819ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:48.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.338+0000 7f863f600640 1 --2- 172.21.15.3:0/1721494563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8638104010 0x7f863819a640 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:48.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.338+0000 7f863f600640 1 -- 172.21.15.3:0/1721494563 >> 172.21.15.3:0/1721494563 conn(0x7f86380ffa50 msgr2=0x7f8638100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:48.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.338+0000 7f863f600640 1 -- 172.21.15.3:0/1721494563 shutdown_connections 2024-09-19T06:09:48.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:48.338+0000 7f863f600640 1 -- 172.21.15.3:0/1721494563 wait complete. 2024-09-19T06:09:48.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:48 smithi071 ceph-mon[35662]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:48.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:48 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:48.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:48 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:48.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:48 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:48.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:48 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:09:48.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:48 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:09:48.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:48 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:49.246 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:49 smithi059 ceph-mon[35138]: Deploying daemon mds.b on smithi059 2024-09-19T06:09:49.246 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:49 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] up:boot 2024-09-19T06:09:49.246 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:49 smithi059 ceph-mon[35138]: fsmap 11 up:standby 2024-09-19T06:09:49.246 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:49 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:09:49.246 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:49 smithi059 ceph-mon[35138]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:49.246 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:49 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1721494563' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:49.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:49 smithi003 ceph-mon[30893]: Deploying daemon mds.b on smithi059 2024-09-19T06:09:49.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:49 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] up:boot 2024-09-19T06:09:49.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:49 smithi003 ceph-mon[30893]: fsmap 11 up:standby 2024-09-19T06:09:49.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:49 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:09:49.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:49 smithi003 ceph-mon[30893]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:49.586 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:49 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1721494563' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:49.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:49 smithi071 ceph-mon[35662]: Deploying daemon mds.b on smithi059 2024-09-19T06:09:49.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:49 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] up:boot 2024-09-19T06:09:49.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:49 smithi071 ceph-mon[35662]: fsmap 11 up:standby 2024-09-19T06:09:49.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:49 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:09:49.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:49 smithi071 ceph-mon[35662]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:49.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:49 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1721494563' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:50.288 INFO:journalctl@ceph.mds.b.smithi059.stdout:Sep 19 06:09:50 smithi059 systemd[1]: Started Ceph mds.b for 782a5144-764c-11ef-bceb-c7b262605968. 2024-09-19T06:09:51.183 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:09:51.276 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:51 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] up:boot 2024-09-19T06:09:51.276 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:51 smithi059 ceph-mon[35138]: fsmap 12 up:standby 2024-09-19T06:09:51.276 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:51 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:09:51.276 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:51 smithi059 ceph-mon[35138]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:51.277 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:51 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:51.277 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:51 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:51.277 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:51 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:51.277 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:51 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:51.277 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:51 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:51.277 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:51 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:51.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:51 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] up:boot 2024-09-19T06:09:51.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:51 smithi071 ceph-mon[35662]: fsmap 12 up:standby 2024-09-19T06:09:51.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:51 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:09:51.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:51 smithi071 ceph-mon[35662]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:51.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:51 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:51.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:51 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:51.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:51 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:51.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:51 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:51.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:51 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:51.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:51 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:51.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:51 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] up:boot 2024-09-19T06:09:51.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:51 smithi003 ceph-mon[30893]: fsmap 12 up:standby 2024-09-19T06:09:51.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:51 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:09:51.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:51 smithi003 ceph-mon[30893]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:51.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:51 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:51.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:51 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:51.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:51 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:51.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:51 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:51.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:51 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:51.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:51 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:51.811 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:52.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.404+0000 7fc31aa00640 1 -- 172.21.15.3:0/1462959605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc314103ff0 msgr2=0x7fc3141043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:52.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.404+0000 7fc31aa00640 1 --2- 172.21.15.3:0/1462959605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc314103ff0 0x7fc3141043d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc304009860 tx=0x7fc30402a340 comp rx=0 tx=0).stop 2024-09-19T06:09:52.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.404+0000 7fc31aa00640 1 -- 172.21.15.3:0/1462959605 shutdown_connections 2024-09-19T06:09:52.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.404+0000 7fc31aa00640 1 --2- 172.21.15.3:0/1462959605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc314109120 0x7fc314110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.404+0000 7fc31aa00640 1 --2- 172.21.15.3:0/1462959605 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3141049a0 0x7fc3141089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.404+0000 7fc31aa00640 1 --2- 172.21.15.3:0/1462959605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc314103ff0 0x7fc3141043d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.404+0000 7fc31aa00640 1 -- 172.21.15.3:0/1462959605 >> 172.21.15.3:0/1462959605 conn(0x7fc3140ffa90 msgr2=0x7fc314101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:52.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.405+0000 7fc31aa00640 1 -- 172.21.15.3:0/1462959605 shutdown_connections 2024-09-19T06:09:52.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.405+0000 7fc31aa00640 1 -- 172.21.15.3:0/1462959605 wait complete. 2024-09-19T06:09:52.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.405+0000 7fc31aa00640 1 Processor -- start 2024-09-19T06:09:52.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.406+0000 7fc31aa00640 1 -- start start 2024-09-19T06:09:52.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.406+0000 7fc31aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc314103ff0 0x7fc31419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:52.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.406+0000 7fc31aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3141049a0 0x7fc31419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:52.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.406+0000 7fc31aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc314109120 0x7fc31419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:52.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.406+0000 7fc31aa00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc314114140 con 0x7fc3141049a0 2024-09-19T06:09:52.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.406+0000 7fc31aa00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc314113fc0 con 0x7fc314109120 2024-09-19T06:09:52.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.406+0000 7fc31aa00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc3141142c0 con 0x7fc314103ff0 2024-09-19T06:09:52.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.406+0000 7fc313400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3141049a0 0x7fc31419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:52.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.406+0000 7fc313400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3141049a0 0x7fc31419ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36910/0 (socket says 172.21.15.3:36910) 2024-09-19T06:09:52.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.406+0000 7fc313400640 1 -- 172.21.15.3:0/2396310502 learned_addr learned my addr 172.21.15.3:0/2396310502 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:09:52.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.406+0000 7fc318a00640 1 --2- 172.21.15.3:0/2396310502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc314109120 0x7fc31419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:52.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.406+0000 7fc313e00640 1 --2- 172.21.15.3:0/2396310502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc314103ff0 0x7fc31419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:52.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.407+0000 7fc318a00640 1 -- 172.21.15.3:0/2396310502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc314103ff0 msgr2=0x7fc31419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:52.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.407+0000 7fc318a00640 1 --2- 172.21.15.3:0/2396310502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc314103ff0 0x7fc31419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.407+0000 7fc318a00640 1 -- 172.21.15.3:0/2396310502 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3141049a0 msgr2=0x7fc31419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:52.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.407+0000 7fc318a00640 1 --2- 172.21.15.3:0/2396310502 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3141049a0 0x7fc31419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.407+0000 7fc318a00640 1 -- 172.21.15.3:0/2396310502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc31419f5d0 con 0x7fc314109120 2024-09-19T06:09:52.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.407+0000 7fc313e00640 1 --2- 172.21.15.3:0/2396310502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc314103ff0 0x7fc31419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:52.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.407+0000 7fc313400640 1 --2- 172.21.15.3:0/2396310502 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3141049a0 0x7fc31419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:52.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.407+0000 7fc318a00640 1 --2- 172.21.15.3:0/2396310502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc314109120 0x7fc31419eef0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00efc0 tx=0x7fc30c00c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:52.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.407+0000 7fc310c00640 1 -- 172.21.15.3:0/2396310502 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30c003970 con 0x7fc314109120 2024-09-19T06:09:52.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.407+0000 7fc310c00640 1 -- 172.21.15.3:0/2396310502 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc30c004020 con 0x7fc314109120 2024-09-19T06:09:52.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.407+0000 7fc310c00640 1 -- 172.21.15.3:0/2396310502 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30c00b9f0 con 0x7fc314109120 2024-09-19T06:09:52.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.407+0000 7fc31aa00640 1 -- 172.21.15.3:0/2396310502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc31419f8c0 con 0x7fc314109120 2024-09-19T06:09:52.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.408+0000 7fc31aa00640 1 -- 172.21.15.3:0/2396310502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3141a71a0 con 0x7fc314109120 2024-09-19T06:09:52.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.409+0000 7fc31aa00640 1 -- 172.21.15.3:0/2396310502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3141043d0 con 0x7fc314109120 2024-09-19T06:09:52.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.410+0000 7fc310c00640 1 -- 172.21.15.3:0/2396310502 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fc30c01d020 con 0x7fc314109120 2024-09-19T06:09:52.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.412+0000 7fc310c00640 1 --2- 172.21.15.3:0/2396310502 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc2f80a32c0 0x7fc2f80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:52.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.412+0000 7fc310c00640 1 -- 172.21.15.3:0/2396310502 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7fc30c0cf290 con 0x7fc314109120 2024-09-19T06:09:52.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.412+0000 7fc313e00640 1 --2- 172.21.15.3:0/2396310502 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc2f80a32c0 0x7fc2f80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:52.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.413+0000 7fc313e00640 1 --2- 172.21.15.3:0/2396310502 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc2f80a32c0 0x7fc2f80a5780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc30402a930 tx=0x7fc3040056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:52.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.416+0000 7fc310c00640 1 -- 172.21.15.3:0/2396310502 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc30c09c3b0 con 0x7fc314109120 2024-09-19T06:09:52.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.659+0000 7fc31aa00640 1 -- 172.21.15.3:0/2396310502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc31410bd70 con 0x7fc314109120 2024-09-19T06:09:52.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.660+0000 7fc310c00640 1 -- 172.21.15.3:0/2396310502 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10491 (secure 0 0 0) 0x7fc30c09bcb0 con 0x7fc314109120 2024-09-19T06:09:52.663 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:09:52.663 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":13,"btime":"2024-09-19T06:09:50:109262+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24494,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24515,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24532,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24557,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-19T06:09:52.664 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 13 2024-09-19T06:09:52.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.662+0000 7fc31aa00640 1 -- 172.21.15.3:0/2396310502 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc2f80a32c0 msgr2=0x7fc2f80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:52.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.662+0000 7fc31aa00640 1 --2- 172.21.15.3:0/2396310502 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc2f80a32c0 0x7fc2f80a5780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc30402a930 tx=0x7fc3040056d0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.662+0000 7fc31aa00640 1 -- 172.21.15.3:0/2396310502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc314109120 msgr2=0x7fc31419eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:52.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.662+0000 7fc31aa00640 1 --2- 172.21.15.3:0/2396310502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc314109120 0x7fc31419eef0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00efc0 tx=0x7fc30c00c800 comp rx=0 tx=0).stop 2024-09-19T06:09:52.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.663+0000 7fc31aa00640 1 -- 172.21.15.3:0/2396310502 shutdown_connections 2024-09-19T06:09:52.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.663+0000 7fc31aa00640 1 --2- 172.21.15.3:0/2396310502 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc2f80a32c0 0x7fc2f80a5780 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.663+0000 7fc31aa00640 1 --2- 172.21.15.3:0/2396310502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc314109120 0x7fc31419eef0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.663+0000 7fc31aa00640 1 --2- 172.21.15.3:0/2396310502 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3141049a0 0x7fc31419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.663+0000 7fc31aa00640 1 --2- 172.21.15.3:0/2396310502 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc314103ff0 0x7fc31419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:52.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.663+0000 7fc31aa00640 1 -- 172.21.15.3:0/2396310502 >> 172.21.15.3:0/2396310502 conn(0x7fc3140ffa90 msgr2=0x7fc314100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:52.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.663+0000 7fc31aa00640 1 -- 172.21.15.3:0/2396310502 shutdown_connections 2024-09-19T06:09:52.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:52.663+0000 7fc31aa00640 1 -- 172.21.15.3:0/2396310502 wait complete. 2024-09-19T06:09:53.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:52 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:53.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:52 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:53.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:52 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:53.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:52 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:53.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:52 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2396310502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:53.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:52 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:53.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:52 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:53.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:52 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:53.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:52 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:53.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:52 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2396310502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:53.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:52 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:53.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:52 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:53.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:52 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:53.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:52 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:53.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:52 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2396310502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:09:53.799 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T06:09:54.219 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:54.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:54 smithi059 ceph-mon[35138]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:54.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:54 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:54.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:54 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:54.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:54 smithi003 ceph-mon[30893]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:54.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:54 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:54.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:54 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:54.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:54 smithi071 ceph-mon[35662]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:54.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:54 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:54.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:54 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:54.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.830+0000 7f26f3200640 1 -- 172.21.15.3:0/3974732311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26f41079c0 msgr2=0x7f26f4107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:54.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.830+0000 7f26f3200640 1 --2- 172.21.15.3:0/3974732311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26f41079c0 0x7f26f4107da0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f26e4009930 tx=0x7f26e402a420 comp rx=0 tx=0).stop 2024-09-19T06:09:54.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.831+0000 7f26f3200640 1 -- 172.21.15.3:0/3974732311 shutdown_connections 2024-09-19T06:09:54.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.831+0000 7f26f3200640 1 --2- 172.21.15.3:0/3974732311 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f26f4102360 0x7f26f410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.831+0000 7f26f3200640 1 --2- 172.21.15.3:0/3974732311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26f41019c0 0x7f26f4101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.831+0000 7f26f3200640 1 --2- 172.21.15.3:0/3974732311 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26f41079c0 0x7f26f4107da0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.831+0000 7f26f3200640 1 -- 172.21.15.3:0/3974732311 >> 172.21.15.3:0/3974732311 conn(0x7f26f40fd740 msgr2=0x7f26f40ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:54.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.831+0000 7f26f3200640 1 -- 172.21.15.3:0/3974732311 shutdown_connections 2024-09-19T06:09:54.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.831+0000 7f26f3200640 1 -- 172.21.15.3:0/3974732311 wait complete. 2024-09-19T06:09:54.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.832+0000 7f26f3200640 1 Processor -- start 2024-09-19T06:09:54.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.832+0000 7f26f3200640 1 -- start start 2024-09-19T06:09:54.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.832+0000 7f26f3200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26f41019c0 0x7f26f4198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:54.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.832+0000 7f26f3200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f26f4102360 0x7f26f41987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:54.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.832+0000 7f26f3200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26f41079c0 0x7f26f419cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:54.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.832+0000 7f26f3200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f26f4111e10 con 0x7f26f4102360 2024-09-19T06:09:54.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.832+0000 7f26f3200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f26f4111c90 con 0x7f26f41019c0 2024-09-19T06:09:54.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.832+0000 7f26f3200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f26f4111f90 con 0x7f26f41079c0 2024-09-19T06:09:54.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.832+0000 7f26f1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26f41019c0 0x7f26f4198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:54.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.832+0000 7f26f1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26f41019c0 0x7f26f4198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55078/0 (socket says 172.21.15.3:55078) 2024-09-19T06:09:54.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.832+0000 7f26f1e00640 1 -- 172.21.15.3:0/3059949763 learned_addr learned my addr 172.21.15.3:0/3059949763 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:09:54.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.833+0000 7f26f2800640 1 --2- 172.21.15.3:0/3059949763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26f41079c0 0x7f26f419cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:54.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.833+0000 7f26e9400640 1 --2- 172.21.15.3:0/3059949763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f26f4102360 0x7f26f41987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:54.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.833+0000 7f26f1e00640 1 -- 172.21.15.3:0/3059949763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26f41079c0 msgr2=0x7f26f419cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:54.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.833+0000 7f26f1e00640 1 --2- 172.21.15.3:0/3059949763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26f41079c0 0x7f26f419cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.833+0000 7f26f1e00640 1 -- 172.21.15.3:0/3059949763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f26f4102360 msgr2=0x7f26f41987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:54.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.833+0000 7f26f1e00640 1 --2- 172.21.15.3:0/3059949763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f26f4102360 0x7f26f41987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:54.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.833+0000 7f26f1e00640 1 -- 172.21.15.3:0/3059949763 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f419d240 con 0x7f26f41019c0 2024-09-19T06:09:54.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.833+0000 7f26f2800640 1 --2- 172.21.15.3:0/3059949763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26f41079c0 0x7f26f419cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:09:54.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.833+0000 7f26e9400640 1 --2- 172.21.15.3:0/3059949763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f26f4102360 0x7f26f41987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:09:54.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.833+0000 7f26f1e00640 1 --2- 172.21.15.3:0/3059949763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26f41019c0 0x7f26f4198290 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f26e402a940 tx=0x7f26e4003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:54.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.834+0000 7f26eb400640 1 -- 172.21.15.3:0/3059949763 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e403f070 con 0x7f26f41019c0 2024-09-19T06:09:54.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.834+0000 7f26eb400640 1 -- 172.21.15.3:0/3059949763 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26e4031c90 con 0x7f26f41019c0 2024-09-19T06:09:54.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.834+0000 7f26eb400640 1 -- 172.21.15.3:0/3059949763 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e4035030 con 0x7f26f41019c0 2024-09-19T06:09:54.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.834+0000 7f26f3200640 1 -- 172.21.15.3:0/3059949763 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f419d4d0 con 0x7f26f41019c0 2024-09-19T06:09:54.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.834+0000 7f26f3200640 1 -- 172.21.15.3:0/3059949763 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f419d960 con 0x7f26f41019c0 2024-09-19T06:09:54.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.835+0000 7f26f3200640 1 -- 172.21.15.3:0/3059949763 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f4101e20 con 0x7f26f41019c0 2024-09-19T06:09:54.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.838+0000 7f26eb400640 1 -- 172.21.15.3:0/3059949763 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f26e4042070 con 0x7f26f41019c0 2024-09-19T06:09:54.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.839+0000 7f26eb400640 1 --2- 172.21.15.3:0/3059949763 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f26d80a3240 0x7f26d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:54.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.839+0000 7f26eb400640 1 -- 172.21.15.3:0/3059949763 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7f26e40efff0 con 0x7f26f41019c0 2024-09-19T06:09:54.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.839+0000 7f26e9400640 1 --2- 172.21.15.3:0/3059949763 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f26d80a3240 0x7f26d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:54.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.840+0000 7f26e9400640 1 --2- 172.21.15.3:0/3059949763 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f26d80a3240 0x7f26d80a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f26f40ffce0 tx=0x7f26dc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:54.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:54.840+0000 7f26eb400640 1 -- 172.21.15.3:0/3059949763 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f26e40bd150 con 0x7f26f41019c0 2024-09-19T06:09:55.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:55.031+0000 7f26f3200640 1 -- 172.21.15.3:0/3059949763 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f26f41995f0 con 0x7f26f41019c0 2024-09-19T06:09:55.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:55.032+0000 7f26eb400640 1 -- 172.21.15.3:0/3059949763 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) ==== 84+0+65 (secure 0 0 0) 0x7f26f41995f0 con 0x7f26f41019c0 2024-09-19T06:09:55.034 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:09:55.034 INFO:teuthology.orchestra.run.smithi003.stdout:[ 2024-09-19T06:09:55.034 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:09:55.034 INFO:teuthology.orchestra.run.smithi003.stdout: "poolnum": 1, 2024-09-19T06:09:55.034 INFO:teuthology.orchestra.run.smithi003.stdout: "poolname": ".mgr" 2024-09-19T06:09:55.035 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:09:55.035 INFO:teuthology.orchestra.run.smithi003.stdout:] 2024-09-19T06:09:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:55.034+0000 7f26f3200640 1 -- 172.21.15.3:0/3059949763 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f26d80a3240 msgr2=0x7f26d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:55.034+0000 7f26f3200640 1 --2- 172.21.15.3:0/3059949763 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f26d80a3240 0x7f26d80a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f26f40ffce0 tx=0x7f26dc005f90 comp rx=0 tx=0).stop 2024-09-19T06:09:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:55.034+0000 7f26f3200640 1 -- 172.21.15.3:0/3059949763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26f41019c0 msgr2=0x7f26f4198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:55.034+0000 7f26f3200640 1 --2- 172.21.15.3:0/3059949763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26f41019c0 0x7f26f4198290 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f26e402a940 tx=0x7f26e4003b20 comp rx=0 tx=0).stop 2024-09-19T06:09:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:55.034+0000 7f26f3200640 1 -- 172.21.15.3:0/3059949763 shutdown_connections 2024-09-19T06:09:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:55.034+0000 7f26f3200640 1 --2- 172.21.15.3:0/3059949763 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f26d80a3240 0x7f26d80a5700 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:55.034+0000 7f26f3200640 1 --2- 172.21.15.3:0/3059949763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f26f41079c0 0x7f26f419cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:55.034+0000 7f26f3200640 1 --2- 172.21.15.3:0/3059949763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f26f4102360 0x7f26f41987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:55.034+0000 7f26f3200640 1 --2- 172.21.15.3:0/3059949763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26f41019c0 0x7f26f4198290 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:55.034+0000 7f26f3200640 1 -- 172.21.15.3:0/3059949763 >> 172.21.15.3:0/3059949763 conn(0x7f26f40fd740 msgr2=0x7f26f40fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:55.035+0000 7f26f3200640 1 -- 172.21.15.3:0/3059949763 shutdown_connections 2024-09-19T06:09:55.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:55.035+0000 7f26f3200640 1 -- 172.21.15.3:0/3059949763 wait complete. 2024-09-19T06:09:55.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:55 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:55.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:55 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:55.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:55 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:55.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:55 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:55.324 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:55 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:55.324 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:55 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:55.324 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:55 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:55.324 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:55 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:55.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:55 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:55.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:55 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:55.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:55 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:55.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:55 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:09:55.984 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T06:09:55.984 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T06:09:56.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:56 smithi059 ceph-mon[35138]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:56.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:56 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/3059949763' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T06:09:56.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:56 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:56.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:56 smithi003 ceph-mon[30893]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:56.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:56 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3059949763' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T06:09:56.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:56 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:56.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:56 smithi071 ceph-mon[35662]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:56.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:56 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/3059949763' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T06:09:56.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:56 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:56.939 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:09:57.343 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:57 smithi003 ceph-mon[30893]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:57.343 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:57 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:57.343 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:57 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:57.343 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:57 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:57.344 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:57 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:57.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:57 smithi059 ceph-mon[35138]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:57.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:57 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:57.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:57 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:57.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:57 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:57.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:57 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:57.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:57 smithi071 ceph-mon[35662]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:57.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:57 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:57.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:57 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:57.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:57 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:57.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:57 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:57.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.594+0000 7fbd85e00640 1 -- 172.21.15.3:0/3700306379 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd801079c0 msgr2=0x7fbd80107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:57.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.594+0000 7fbd85e00640 1 --2- 172.21.15.3:0/3700306379 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd801079c0 0x7fbd80107da0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009930 tx=0x7fbd7402a420 comp rx=0 tx=0).stop 2024-09-19T06:09:57.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.594+0000 7fbd85e00640 1 -- 172.21.15.3:0/3700306379 shutdown_connections 2024-09-19T06:09:57.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.594+0000 7fbd85e00640 1 --2- 172.21.15.3:0/3700306379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd80102360 0x7fbd8010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:57.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.594+0000 7fbd85e00640 1 --2- 172.21.15.3:0/3700306379 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd801019c0 0x7fbd80101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:57.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.594+0000 7fbd85e00640 1 --2- 172.21.15.3:0/3700306379 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd801079c0 0x7fbd80107da0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:57.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.594+0000 7fbd85e00640 1 -- 172.21.15.3:0/3700306379 >> 172.21.15.3:0/3700306379 conn(0x7fbd800fd740 msgr2=0x7fbd800ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:57.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.594+0000 7fbd85e00640 1 -- 172.21.15.3:0/3700306379 shutdown_connections 2024-09-19T06:09:57.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.594+0000 7fbd85e00640 1 -- 172.21.15.3:0/3700306379 wait complete. 2024-09-19T06:09:57.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.595+0000 7fbd85e00640 1 Processor -- start 2024-09-19T06:09:57.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.595+0000 7fbd85e00640 1 -- start start 2024-09-19T06:09:57.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.596+0000 7fbd85e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd801019c0 0x7fbd80198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:57.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.596+0000 7fbd85e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd80102360 0x7fbd80198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:57.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.596+0000 7fbd85e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd801079c0 0x7fbd8019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:57.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.596+0000 7fbd85e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbd80111e10 con 0x7fbd80102360 2024-09-19T06:09:57.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.596+0000 7fbd85e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbd80111c90 con 0x7fbd801019c0 2024-09-19T06:09:57.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.596+0000 7fbd85e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbd80111f90 con 0x7fbd801079c0 2024-09-19T06:09:57.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.596+0000 7fbd7fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd80102360 0x7fbd80198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:57.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.596+0000 7fbd84a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd801019c0 0x7fbd80198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:57.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.596+0000 7fbd7fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd80102360 0x7fbd80198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57944/0 (socket says 172.21.15.3:57944) 2024-09-19T06:09:57.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.596+0000 7fbd84a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd801019c0 0x7fbd80198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55108/0 (socket says 172.21.15.3:55108) 2024-09-19T06:09:57.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.596+0000 7fbd7fe00640 1 -- 172.21.15.3:0/3655469095 learned_addr learned my addr 172.21.15.3:0/3655469095 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:09:57.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.596+0000 7fbd85400640 1 --2- 172.21.15.3:0/3655469095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd801079c0 0x7fbd8019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:57.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.597+0000 7fbd84a00640 1 -- 172.21.15.3:0/3655469095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd801079c0 msgr2=0x7fbd8019cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:57.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.597+0000 7fbd84a00640 1 --2- 172.21.15.3:0/3655469095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd801079c0 0x7fbd8019cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:57.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.597+0000 7fbd84a00640 1 -- 172.21.15.3:0/3655469095 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd80102360 msgr2=0x7fbd80198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:57.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.597+0000 7fbd84a00640 1 --2- 172.21.15.3:0/3655469095 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd80102360 0x7fbd80198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:57.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.597+0000 7fbd84a00640 1 -- 172.21.15.3:0/3655469095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8019d2c0 con 0x7fbd801019c0 2024-09-19T06:09:57.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.597+0000 7fbd84a00640 1 --2- 172.21.15.3:0/3655469095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd801019c0 0x7fbd80198310 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbd7402a940 tx=0x7fbd74003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:57.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.597+0000 7fbd7d600640 1 -- 172.21.15.3:0/3655469095 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7403f070 con 0x7fbd801019c0 2024-09-19T06:09:57.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.597+0000 7fbd85e00640 1 -- 172.21.15.3:0/3655469095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd8019d550 con 0x7fbd801019c0 2024-09-19T06:09:57.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.597+0000 7fbd7d600640 1 -- 172.21.15.3:0/3655469095 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd74031c90 con 0x7fbd801019c0 2024-09-19T06:09:57.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.598+0000 7fbd7d600640 1 -- 172.21.15.3:0/3655469095 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd74035030 con 0x7fbd801019c0 2024-09-19T06:09:57.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.598+0000 7fbd85e00640 1 -- 172.21.15.3:0/3655469095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd801a4e90 con 0x7fbd801019c0 2024-09-19T06:09:57.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.599+0000 7fbd85e00640 1 -- 172.21.15.3:0/3655469095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd80103100 con 0x7fbd801019c0 2024-09-19T06:09:57.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.601+0000 7fbd7d600640 1 -- 172.21.15.3:0/3655469095 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fbd74042070 con 0x7fbd801019c0 2024-09-19T06:09:57.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.602+0000 7fbd7d600640 1 --2- 172.21.15.3:0/3655469095 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fbd680a3240 0x7fbd680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:09:57.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.602+0000 7fbd7d600640 1 -- 172.21.15.3:0/3655469095 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7127+0+0 (secure 0 0 0) 0x7fbd740f03c0 con 0x7fbd801019c0 2024-09-19T06:09:57.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.602+0000 7fbd7fe00640 1 --2- 172.21.15.3:0/3655469095 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fbd680a3240 0x7fbd680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:09:57.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.603+0000 7fbd7fe00640 1 --2- 172.21.15.3:0/3655469095 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fbd680a3240 0x7fbd680a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbd800ffdd0 tx=0x7fbd6c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:09:57.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.604+0000 7fbd7d600640 1 -- 172.21.15.3:0/3655469095 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbd740bce90 con 0x7fbd801019c0 2024-09-19T06:09:57.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:57.831+0000 7fbd85e00640 1 -- 172.21.15.3:0/3655469095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fbd80101e20 con 0x7fbd801019c0 2024-09-19T06:09:58.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:58.480+0000 7fbd7d600640 1 -- 172.21.15.3:0/3655469095 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) ==== 138+0+0 (secure 0 0 0) 0x7fbd80101e20 con 0x7fbd801019c0 2024-09-19T06:09:58.483 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' created 2024-09-19T06:09:58.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:58.487+0000 7fbd85e00640 1 -- 172.21.15.3:0/3655469095 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fbd680a3240 msgr2=0x7fbd680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:58.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:58.487+0000 7fbd85e00640 1 --2- 172.21.15.3:0/3655469095 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fbd680a3240 0x7fbd680a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbd800ffdd0 tx=0x7fbd6c005f90 comp rx=0 tx=0).stop 2024-09-19T06:09:58.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:58.487+0000 7fbd85e00640 1 -- 172.21.15.3:0/3655469095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd801019c0 msgr2=0x7fbd80198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:09:58.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:58.487+0000 7fbd85e00640 1 --2- 172.21.15.3:0/3655469095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd801019c0 0x7fbd80198310 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbd7402a940 tx=0x7fbd74003b20 comp rx=0 tx=0).stop 2024-09-19T06:09:58.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:58.487+0000 7fbd85e00640 1 -- 172.21.15.3:0/3655469095 shutdown_connections 2024-09-19T06:09:58.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:58.487+0000 7fbd85e00640 1 --2- 172.21.15.3:0/3655469095 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fbd680a3240 0x7fbd680a5700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:58.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:58.487+0000 7fbd85e00640 1 --2- 172.21.15.3:0/3655469095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbd801079c0 0x7fbd8019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:58.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:58.487+0000 7fbd85e00640 1 --2- 172.21.15.3:0/3655469095 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbd80102360 0x7fbd80198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:58.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:58.487+0000 7fbd85e00640 1 --2- 172.21.15.3:0/3655469095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd801019c0 0x7fbd80198310 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:09:58.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:58.488+0000 7fbd85e00640 1 -- 172.21.15.3:0/3655469095 >> 172.21.15.3:0/3655469095 conn(0x7fbd800fd740 msgr2=0x7fbd800fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:09:58.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:58.488+0000 7fbd85e00640 1 -- 172.21.15.3:0/3655469095 shutdown_connections 2024-09-19T06:09:58.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:09:58.488+0000 7fbd85e00640 1 -- 172.21.15.3:0/3655469095 wait complete. 2024-09-19T06:09:58.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:58 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/3655469095' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T06:09:58.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:58 smithi059 ceph-mon[35138]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T06:09:58.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:58 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3655469095' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T06:09:58.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:58 smithi003 ceph-mon[30893]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T06:09:58.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:58 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/3655469095' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T06:09:58.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:58 smithi071 ceph-mon[35662]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T06:09:59.453 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T06:09:59.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:59 smithi059 ceph-mon[35138]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:59.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:59 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:59.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:59 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:59.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:59 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:59.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:59 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:59.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:59 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:59.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:59 smithi059 ceph-mon[35138]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T06:09:59.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:09:59 smithi059 ceph-mon[35138]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T06:09:59.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:59 smithi003 ceph-mon[30893]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:59.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:59 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:59.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:59 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:59.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:59 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:59.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:59 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:59.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:59 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:59.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:59 smithi003 ceph-mon[30893]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T06:09:59.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:09:59 smithi003 ceph-mon[30893]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T06:09:59.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:59 smithi071 ceph-mon[35662]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:09:59.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:59 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:59.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:59 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:59.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:59 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:09:59.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:59 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:09:59.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:59 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:09:59.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:59 smithi071 ceph-mon[35662]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T06:09:59.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:09:59 smithi071 ceph-mon[35662]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T06:09:59.846 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:00.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.489+0000 7f8875200640 1 -- 172.21.15.3:0/1542172031 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8870109140 msgr2=0x7f8870110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:00.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.489+0000 7f8875200640 1 --2- 172.21.15.3:0/1542172031 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8870109140 0x7f8870110cc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8868009ca0 tx=0x7f886802a8b0 comp rx=0 tx=0).stop 2024-09-19T06:10:00.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.489+0000 7f8875200640 1 -- 172.21.15.3:0/1542172031 shutdown_connections 2024-09-19T06:10:00.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.489+0000 7f8875200640 1 --2- 172.21.15.3:0/1542172031 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8870109140 0x7f8870110cc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:00.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.489+0000 7f8875200640 1 --2- 172.21.15.3:0/1542172031 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f88701049c0 0x7f8870108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:00.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.489+0000 7f8875200640 1 --2- 172.21.15.3:0/1542172031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8870104010 0x7f88701043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:00.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.490+0000 7f8875200640 1 -- 172.21.15.3:0/1542172031 >> 172.21.15.3:0/1542172031 conn(0x7f88700ffa50 msgr2=0x7f8870101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:00.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.490+0000 7f8875200640 1 -- 172.21.15.3:0/1542172031 shutdown_connections 2024-09-19T06:10:00.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.490+0000 7f8875200640 1 -- 172.21.15.3:0/1542172031 wait complete. 2024-09-19T06:10:00.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.490+0000 7f8875200640 1 Processor -- start 2024-09-19T06:10:00.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.491+0000 7f8875200640 1 -- start start 2024-09-19T06:10:00.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.491+0000 7f8875200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8870104010 0x7f887019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:00.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.491+0000 7f8875200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88701049c0 0x7f887019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:00.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.491+0000 7f8875200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8870109140 0x7f887019ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:00.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.491+0000 7f8875200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f88701141c0 con 0x7f88701049c0 2024-09-19T06:10:00.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.491+0000 7f8875200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8870114040 con 0x7f8870109140 2024-09-19T06:10:00.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.491+0000 7f8875200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8870114340 con 0x7f8870104010 2024-09-19T06:10:00.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.491+0000 7f886d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88701049c0 0x7f887019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:00.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.491+0000 7f886de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8870104010 0x7f887019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:00.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.491+0000 7f886de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8870104010 0x7f887019a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:49704/0 (socket says 172.21.15.3:49704) 2024-09-19T06:10:00.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.491+0000 7f886de00640 1 -- 172.21.15.3:0/3978671144 learned_addr learned my addr 172.21.15.3:0/3978671144 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:00.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.491+0000 7f886e800640 1 --2- 172.21.15.3:0/3978671144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8870109140 0x7f887019ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:00.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.492+0000 7f886de00640 1 -- 172.21.15.3:0/3978671144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8870109140 msgr2=0x7f887019ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:00.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.492+0000 7f886de00640 1 --2- 172.21.15.3:0/3978671144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8870109140 0x7f887019ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:00.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.492+0000 7f886de00640 1 -- 172.21.15.3:0/3978671144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88701049c0 msgr2=0x7f887019abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:00.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.492+0000 7f886de00640 1 --2- 172.21.15.3:0/3978671144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88701049c0 0x7f887019abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:00.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.492+0000 7f886de00640 1 -- 172.21.15.3:0/3978671144 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887019f650 con 0x7f8870104010 2024-09-19T06:10:00.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.492+0000 7f886de00640 1 --2- 172.21.15.3:0/3978671144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8870104010 0x7f887019a6a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f886000e9f0 tx=0x7f886000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:00.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.492+0000 7f8866a00640 1 -- 172.21.15.3:0/3978671144 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886000cd80 con 0x7f8870104010 2024-09-19T06:10:00.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.492+0000 7f8866a00640 1 -- 172.21.15.3:0/3978671144 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8860010910 con 0x7f8870104010 2024-09-19T06:10:00.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.492+0000 7f8875200640 1 -- 172.21.15.3:0/3978671144 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f887019f940 con 0x7f8870104010 2024-09-19T06:10:00.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.492+0000 7f8866a00640 1 -- 172.21.15.3:0/3978671144 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8860018990 con 0x7f8870104010 2024-09-19T06:10:00.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.492+0000 7f8875200640 1 -- 172.21.15.3:0/3978671144 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88701a7220 con 0x7f8870104010 2024-09-19T06:10:00.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.494+0000 7f8875200640 1 -- 172.21.15.3:0/3978671144 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88701043f0 con 0x7f8870104010 2024-09-19T06:10:00.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.495+0000 7f8866a00640 1 -- 172.21.15.3:0/3978671144 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f8860018b30 con 0x7f8870104010 2024-09-19T06:10:00.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.496+0000 7f8866a00640 1 --2- 172.21.15.3:0/3978671144 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f88540a32c0 0x7f88540a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:00.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.497+0000 7f8866a00640 1 -- 172.21.15.3:0/3978671144 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7497+0+0 (secure 0 0 0) 0x7f88600cf950 con 0x7f8870104010 2024-09-19T06:10:00.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.497+0000 7f886d400640 1 --2- 172.21.15.3:0/3978671144 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f88540a32c0 0x7f88540a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:00.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.497+0000 7f886d400640 1 --2- 172.21.15.3:0/3978671144 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f88540a32c0 0x7f88540a5780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f887010aab0 tx=0x7f885c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:00.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.501+0000 7f8866a00640 1 -- 172.21.15.3:0/3978671144 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f886009c2b0 con 0x7f8870104010 2024-09-19T06:10:00.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:00.685+0000 7f8875200640 1 -- 172.21.15.3:0/3978671144 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f88701a7450 con 0x7f8870104010 2024-09-19T06:10:00.687 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:00 smithi003 ceph-mon[30893]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T06:10:00.687 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:00 smithi003 ceph-mon[30893]: overall HEALTH_OK 2024-09-19T06:10:00.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:00 smithi059 ceph-mon[35138]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T06:10:00.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:00 smithi059 ceph-mon[35138]: overall HEALTH_OK 2024-09-19T06:10:00.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:00 smithi071 ceph-mon[35662]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T06:10:00.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:00 smithi071 ceph-mon[35662]: overall HEALTH_OK 2024-09-19T06:10:01.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:01.498+0000 7f8866a00640 1 -- 172.21.15.3:0/3978671144 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v83) ==== 170+0+0 (secure 0 0 0) 0x7f8860096e20 con 0x7f8870104010 2024-09-19T06:10:01.504 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' created 2024-09-19T06:10:01.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:01.503+0000 7f8875200640 1 -- 172.21.15.3:0/3978671144 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f88540a32c0 msgr2=0x7f88540a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:01.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:01.503+0000 7f8875200640 1 --2- 172.21.15.3:0/3978671144 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f88540a32c0 0x7f88540a5780 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f887010aab0 tx=0x7f885c005f90 comp rx=0 tx=0).stop 2024-09-19T06:10:01.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:01.503+0000 7f8875200640 1 -- 172.21.15.3:0/3978671144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8870104010 msgr2=0x7f887019a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:01.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:01.503+0000 7f8875200640 1 --2- 172.21.15.3:0/3978671144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8870104010 0x7f887019a6a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f886000e9f0 tx=0x7f886000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:10:01.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:01.504+0000 7f8875200640 1 -- 172.21.15.3:0/3978671144 shutdown_connections 2024-09-19T06:10:01.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:01.504+0000 7f8875200640 1 --2- 172.21.15.3:0/3978671144 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f88540a32c0 0x7f88540a5780 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:01.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:01.504+0000 7f8875200640 1 --2- 172.21.15.3:0/3978671144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8870109140 0x7f887019ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:01.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:01.504+0000 7f8875200640 1 --2- 172.21.15.3:0/3978671144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f88701049c0 0x7f887019abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:01.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:01.504+0000 7f8875200640 1 --2- 172.21.15.3:0/3978671144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8870104010 0x7f887019a6a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:01.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:01.504+0000 7f8875200640 1 -- 172.21.15.3:0/3978671144 >> 172.21.15.3:0/3978671144 conn(0x7f88700ffa50 msgr2=0x7f8870101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:01.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:01.505+0000 7f8875200640 1 -- 172.21.15.3:0/3978671144 shutdown_connections 2024-09-19T06:10:01.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:01.505+0000 7f8875200640 1 -- 172.21.15.3:0/3978671144 wait complete. 2024-09-19T06:10:01.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:01 smithi059 ceph-mon[35138]: pgmap v296: 33 pgs: 6 creating+peering, 3 active+clean, 24 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:10:01.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:01 smithi059 ceph-mon[35138]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T06:10:01.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:01 smithi059 ceph-mon[35138]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T06:10:01.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:01 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/3978671144' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T06:10:01.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:01 smithi059 ceph-mon[35138]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T06:10:01.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:01 smithi003 ceph-mon[30893]: pgmap v296: 33 pgs: 6 creating+peering, 3 active+clean, 24 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:10:01.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:01 smithi003 ceph-mon[30893]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T06:10:01.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:01 smithi003 ceph-mon[30893]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T06:10:01.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:01 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3978671144' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T06:10:01.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:01 smithi003 ceph-mon[30893]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T06:10:01.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:01 smithi071 ceph-mon[35662]: pgmap v296: 33 pgs: 6 creating+peering, 3 active+clean, 24 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:10:01.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:01 smithi071 ceph-mon[35662]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T06:10:01.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:01 smithi071 ceph-mon[35662]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T06:10:01.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:01 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/3978671144' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T06:10:01.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:01 smithi071 ceph-mon[35662]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T06:10:02.452 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T06:10:02.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:02 smithi059 ceph-mon[35138]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T06:10:02.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:02 smithi059 ceph-mon[35138]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T06:10:02.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:02 smithi003 ceph-mon[30893]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T06:10:02.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:02 smithi003 ceph-mon[30893]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T06:10:02.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:02 smithi071 ceph-mon[35662]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T06:10:02.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:02 smithi071 ceph-mon[35662]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T06:10:02.853 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:03.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.456+0000 7f8605000640 1 -- 172.21.15.3:0/699534764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8600076720 msgr2=0x7f8600076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:03.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.456+0000 7f8605000640 1 --2- 172.21.15.3:0/699534764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8600076720 0x7f8600076b00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f85f0009900 tx=0x7f85f002a410 comp rx=0 tx=0).stop 2024-09-19T06:10:03.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.456+0000 7f8605000640 1 -- 172.21.15.3:0/699534764 shutdown_connections 2024-09-19T06:10:03.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.456+0000 7f8605000640 1 --2- 172.21.15.3:0/699534764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8600112a30 0x7f8600114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:03.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.456+0000 7f8605000640 1 --2- 172.21.15.3:0/699534764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8600077040 0x7f86001124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:03.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.456+0000 7f8605000640 1 --2- 172.21.15.3:0/699534764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8600076720 0x7f8600076b00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:03.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.456+0000 7f8605000640 1 -- 172.21.15.3:0/699534764 >> 172.21.15.3:0/699534764 conn(0x7f86000ffa90 msgr2=0x7f8600101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:03.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.456+0000 7f8605000640 1 -- 172.21.15.3:0/699534764 shutdown_connections 2024-09-19T06:10:03.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.456+0000 7f8605000640 1 -- 172.21.15.3:0/699534764 wait complete. 2024-09-19T06:10:03.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.457+0000 7f8605000640 1 Processor -- start 2024-09-19T06:10:03.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.458+0000 7f8605000640 1 -- start start 2024-09-19T06:10:03.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.458+0000 7f8605000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8600076720 0x7f86001a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:03.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.458+0000 7f8605000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8600077040 0x7f86001a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:03.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.458+0000 7f8605000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8600112a30 0x7f860019e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:03.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.458+0000 7f8605000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f86001185a0 con 0x7f8600076720 2024-09-19T06:10:03.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.458+0000 7f8605000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8600118420 con 0x7f8600112a30 2024-09-19T06:10:03.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.458+0000 7f8605000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8600118720 con 0x7f8600077040 2024-09-19T06:10:03.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.458+0000 7f85fde00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8600076720 0x7f86001a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:03.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.458+0000 7f85fde00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8600076720 0x7f86001a46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57964/0 (socket says 172.21.15.3:57964) 2024-09-19T06:10:03.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.458+0000 7f85fde00640 1 -- 172.21.15.3:0/2491879939 learned_addr learned my addr 172.21.15.3:0/2491879939 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:03.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.458+0000 7f85f5400640 1 --2- 172.21.15.3:0/2491879939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8600077040 0x7f86001a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:03.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.459+0000 7f85fe800640 1 --2- 172.21.15.3:0/2491879939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8600112a30 0x7f860019e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:03.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.459+0000 7f85f5400640 1 -- 172.21.15.3:0/2491879939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8600112a30 msgr2=0x7f860019e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:03.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.459+0000 7f85f5400640 1 --2- 172.21.15.3:0/2491879939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8600112a30 0x7f860019e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:03.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.459+0000 7f85f5400640 1 -- 172.21.15.3:0/2491879939 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8600076720 msgr2=0x7f86001a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:03.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.459+0000 7f85f5400640 1 --2- 172.21.15.3:0/2491879939 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8600076720 0x7f86001a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:03.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.459+0000 7f85f5400640 1 -- 172.21.15.3:0/2491879939 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f860019efe0 con 0x7f8600077040 2024-09-19T06:10:03.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.459+0000 7f85f5400640 1 --2- 172.21.15.3:0/2491879939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8600077040 0x7f86001a4c30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f85e800e9f0 tx=0x7f85e800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:03.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.459+0000 7f85f7400640 1 -- 172.21.15.3:0/2491879939 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e800ccc0 con 0x7f8600077040 2024-09-19T06:10:03.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.460+0000 7f8605000640 1 -- 172.21.15.3:0/2491879939 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f860019f2d0 con 0x7f8600077040 2024-09-19T06:10:03.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.460+0000 7f85f7400640 1 -- 172.21.15.3:0/2491879939 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85e8010910 con 0x7f8600077040 2024-09-19T06:10:03.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.460+0000 7f85f7400640 1 -- 172.21.15.3:0/2491879939 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e8018960 con 0x7f8600077040 2024-09-19T06:10:03.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.460+0000 7f8605000640 1 -- 172.21.15.3:0/2491879939 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86001ab5c0 con 0x7f8600077040 2024-09-19T06:10:03.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.461+0000 7f8605000640 1 -- 172.21.15.3:0/2491879939 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8600076b00 con 0x7f8600077040 2024-09-19T06:10:03.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.463+0000 7f85f7400640 1 -- 172.21.15.3:0/2491879939 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f85e8010ac0 con 0x7f8600077040 2024-09-19T06:10:03.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.464+0000 7f85f7400640 1 --2- 172.21.15.3:0/2491879939 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f85e40a32c0 0x7f85e40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:03.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.464+0000 7f85f7400640 1 -- 172.21.15.3:0/2491879939 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7879+0+0 (secure 0 0 0) 0x7f85e80cffa0 con 0x7f8600077040 2024-09-19T06:10:03.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.464+0000 7f85fde00640 1 --2- 172.21.15.3:0/2491879939 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f85e40a32c0 0x7f85e40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:03.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.465+0000 7f85fde00640 1 --2- 172.21.15.3:0/2491879939 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f85e40a32c0 0x7f85e40a5780 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f85f00096c0 tx=0x7f85f0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:03.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.466+0000 7f85f7400640 1 -- 172.21.15.3:0/2491879939 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f85e809c780 con 0x7f8600077040 2024-09-19T06:10:03.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:03.690+0000 7f8605000640 1 -- 172.21.15.3:0/2491879939 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f860002d7c0 con 0x7f8600077040 2024-09-19T06:10:03.693 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:03 smithi003 ceph-mon[30893]: pgmap v299: 97 pgs: 14 creating+peering, 22 active+clean, 61 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:10:03.693 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:03 smithi003 ceph-mon[30893]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T06:10:03.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:03 smithi059 ceph-mon[35138]: pgmap v299: 97 pgs: 14 creating+peering, 22 active+clean, 61 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:10:03.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:03 smithi059 ceph-mon[35138]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T06:10:03.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:03 smithi071 ceph-mon[35662]: pgmap v299: 97 pgs: 14 creating+peering, 22 active+clean, 61 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:10:03.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:03 smithi071 ceph-mon[35662]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T06:10:04.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:04.517+0000 7f85f7400640 1 -- 172.21.15.3:0/2491879939 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f85e80a0a80 con 0x7f8600077040 2024-09-19T06:10:04.519 INFO:teuthology.orchestra.run.smithi003.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T06:10:04.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:04.521+0000 7f8605000640 1 -- 172.21.15.3:0/2491879939 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f85e40a32c0 msgr2=0x7f85e40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:04.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:04.521+0000 7f8605000640 1 --2- 172.21.15.3:0/2491879939 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f85e40a32c0 0x7f85e40a5780 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f85f00096c0 tx=0x7f85f0005a20 comp rx=0 tx=0).stop 2024-09-19T06:10:04.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:04.521+0000 7f8605000640 1 -- 172.21.15.3:0/2491879939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8600077040 msgr2=0x7f86001a4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:04.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:04.521+0000 7f8605000640 1 --2- 172.21.15.3:0/2491879939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8600077040 0x7f86001a4c30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f85e800e9f0 tx=0x7f85e800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:10:04.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:04.522+0000 7f8605000640 1 -- 172.21.15.3:0/2491879939 shutdown_connections 2024-09-19T06:10:04.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:04.522+0000 7f8605000640 1 --2- 172.21.15.3:0/2491879939 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f85e40a32c0 0x7f85e40a5780 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:04.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:04.522+0000 7f8605000640 1 --2- 172.21.15.3:0/2491879939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8600112a30 0x7f860019e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:04.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:04.522+0000 7f8605000640 1 --2- 172.21.15.3:0/2491879939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8600077040 0x7f86001a4c30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:04.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:04.522+0000 7f8605000640 1 --2- 172.21.15.3:0/2491879939 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8600076720 0x7f86001a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:04.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:04.522+0000 7f8605000640 1 -- 172.21.15.3:0/2491879939 >> 172.21.15.3:0/2491879939 conn(0x7f86000ffa90 msgr2=0x7f8600101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:04.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:04.522+0000 7f8605000640 1 -- 172.21.15.3:0/2491879939 shutdown_connections 2024-09-19T06:10:04.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:04.523+0000 7f8605000640 1 -- 172.21.15.3:0/2491879939 wait complete. 2024-09-19T06:10:04.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:04 smithi059 ceph-mon[35138]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T06:10:04.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:04 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2491879939' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T06:10:04.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:04 smithi059 ceph-mon[35138]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T06:10:04.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:04 smithi059 ceph-mon[35138]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T06:10:04.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:04 smithi003 ceph-mon[30893]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T06:10:04.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:04 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2491879939' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T06:10:04.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:04 smithi003 ceph-mon[30893]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T06:10:04.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:04 smithi003 ceph-mon[30893]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T06:10:04.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:04 smithi071 ceph-mon[35662]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T06:10:04.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:04 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2491879939' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T06:10:04.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:04 smithi071 ceph-mon[35662]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T06:10:04.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:04 smithi071 ceph-mon[35662]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T06:10:05.476 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:10:05.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:05 smithi059 ceph-mon[35138]: pgmap v302: 97 pgs: 13 creating+peering, 54 active+clean, 30 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:10:05.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:05 smithi059 ceph-mon[35138]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T06:10:05.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:05 smithi059 ceph-mon[35138]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T06:10:05.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:05 smithi059 ceph-mon[35138]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T06:10:05.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:05 smithi059 ceph-mon[35138]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T06:10:05.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:05 smithi003 ceph-mon[30893]: pgmap v302: 97 pgs: 13 creating+peering, 54 active+clean, 30 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:10:05.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:05 smithi003 ceph-mon[30893]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T06:10:05.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:05 smithi003 ceph-mon[30893]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T06:10:05.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:05 smithi003 ceph-mon[30893]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T06:10:05.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:05 smithi003 ceph-mon[30893]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T06:10:05.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:05 smithi071 ceph-mon[35662]: pgmap v302: 97 pgs: 13 creating+peering, 54 active+clean, 30 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:10:05.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:05 smithi071 ceph-mon[35662]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T06:10:05.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:05 smithi071 ceph-mon[35662]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T06:10:05.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:05 smithi071 ceph-mon[35662]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T06:10:05.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:05 smithi071 ceph-mon[35662]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T06:10:05.864 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:06.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.402+0000 7fda00800640 1 -- 172.21.15.3:0/2053988894 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9f8103ff0 msgr2=0x7fd9f81043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:06.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.402+0000 7fda00800640 1 --2- 172.21.15.3:0/2053988894 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9f8103ff0 0x7fd9f81043d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec009860 tx=0x7fd9ec02a340 comp rx=0 tx=0).stop 2024-09-19T06:10:06.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.402+0000 7fda00800640 1 -- 172.21.15.3:0/2053988894 shutdown_connections 2024-09-19T06:10:06.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.402+0000 7fda00800640 1 --2- 172.21.15.3:0/2053988894 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd9f8109120 0x7fd9f8110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:06.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.402+0000 7fda00800640 1 --2- 172.21.15.3:0/2053988894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9f81049a0 0x7fd9f81089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:06.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.402+0000 7fda00800640 1 --2- 172.21.15.3:0/2053988894 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9f8103ff0 0x7fd9f81043d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:06.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.402+0000 7fda00800640 1 -- 172.21.15.3:0/2053988894 >> 172.21.15.3:0/2053988894 conn(0x7fd9f80ffa90 msgr2=0x7fd9f8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:06.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.402+0000 7fda00800640 1 -- 172.21.15.3:0/2053988894 shutdown_connections 2024-09-19T06:10:06.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.402+0000 7fda00800640 1 -- 172.21.15.3:0/2053988894 wait complete. 2024-09-19T06:10:06.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.403+0000 7fda00800640 1 Processor -- start 2024-09-19T06:10:06.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.403+0000 7fda00800640 1 -- start start 2024-09-19T06:10:06.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.404+0000 7fda00800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9f8103ff0 0x7fd9f819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:06.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.404+0000 7fda00800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd9f81049a0 0x7fd9f819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:06.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.404+0000 7fda00800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9f8109120 0x7fd9f819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:06.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.404+0000 7fda00800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f8114140 con 0x7fd9f81049a0 2024-09-19T06:10:06.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.404+0000 7fda00800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f8113fc0 con 0x7fd9f8103ff0 2024-09-19T06:10:06.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.404+0000 7fda00800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f81142c0 con 0x7fd9f8109120 2024-09-19T06:10:06.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.404+0000 7fd9fd400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd9f81049a0 0x7fd9f819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:06.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.404+0000 7fd9fd400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd9f81049a0 0x7fd9f819ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42328/0 (socket says 172.21.15.3:42328) 2024-09-19T06:10:06.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.404+0000 7fd9fd400640 1 -- 172.21.15.3:0/1078590893 learned_addr learned my addr 172.21.15.3:0/1078590893 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:06.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.404+0000 7fd9fe800640 1 --2- 172.21.15.3:0/1078590893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9f8109120 0x7fd9f819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:06.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.404+0000 7fd9fde00640 1 --2- 172.21.15.3:0/1078590893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9f8103ff0 0x7fd9f819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:06.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.405+0000 7fd9fd400640 1 -- 172.21.15.3:0/1078590893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9f8109120 msgr2=0x7fd9f819eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:06.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.405+0000 7fd9fd400640 1 --2- 172.21.15.3:0/1078590893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9f8109120 0x7fd9f819eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:06.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.405+0000 7fd9fd400640 1 -- 172.21.15.3:0/1078590893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9f8103ff0 msgr2=0x7fd9f819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:06.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.405+0000 7fd9fd400640 1 --2- 172.21.15.3:0/1078590893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9f8103ff0 0x7fd9f819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:06.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.405+0000 7fd9fd400640 1 -- 172.21.15.3:0/1078590893 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f819f5b0 con 0x7fd9f81049a0 2024-09-19T06:10:06.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.405+0000 7fd9fe800640 1 --2- 172.21.15.3:0/1078590893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9f8109120 0x7fd9f819eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:06.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.405+0000 7fd9fd400640 1 --2- 172.21.15.3:0/1078590893 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd9f81049a0 0x7fd9f819ab40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd9e800e9f0 tx=0x7fd9e800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:06.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.405+0000 7fd9f2a00640 1 -- 172.21.15.3:0/1078590893 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e800cd80 con 0x7fd9f81049a0 2024-09-19T06:10:06.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.405+0000 7fd9f2a00640 1 -- 172.21.15.3:0/1078590893 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9e8005500 con 0x7fd9f81049a0 2024-09-19T06:10:06.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.405+0000 7fd9f2a00640 1 -- 172.21.15.3:0/1078590893 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8010690 con 0x7fd9f81049a0 2024-09-19T06:10:06.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.405+0000 7fda00800640 1 -- 172.21.15.3:0/1078590893 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9f819f8a0 con 0x7fd9f81049a0 2024-09-19T06:10:06.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.405+0000 7fda00800640 1 -- 172.21.15.3:0/1078590893 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9f81a7180 con 0x7fd9f81049a0 2024-09-19T06:10:06.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.406+0000 7fda00800640 1 -- 172.21.15.3:0/1078590893 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9f81043d0 con 0x7fd9f81049a0 2024-09-19T06:10:06.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.410+0000 7fd9f2a00640 1 -- 172.21.15.3:0/1078590893 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fd9e80046c0 con 0x7fd9f81049a0 2024-09-19T06:10:06.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.411+0000 7fd9f2a00640 1 --2- 172.21.15.3:0/1078590893 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd9e00a3240 0x7fd9e00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:06.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.411+0000 7fd9f2a00640 1 -- 172.21.15.3:0/1078590893 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fd9e80cfe70 con 0x7fd9f81049a0 2024-09-19T06:10:06.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.411+0000 7fd9fde00640 1 --2- 172.21.15.3:0/1078590893 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd9e00a3240 0x7fd9e00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:06.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.412+0000 7fd9fde00640 1 --2- 172.21.15.3:0/1078590893 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd9e00a3240 0x7fd9e00a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec02a930 tx=0x7fd9ec0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:06.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.413+0000 7fd9f2a00640 1 -- 172.21.15.3:0/1078590893 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd9e8054210 con 0x7fd9f81049a0 2024-09-19T06:10:06.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:06 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] up:active 2024-09-19T06:10:06.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:06 smithi003 ceph-mon[30893]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:10:06.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:06 smithi003 ceph-mon[30893]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:10:06.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.605+0000 7fda00800640 1 -- 172.21.15.3:0/1078590893 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9f819b960 con 0x7fd9f81049a0 2024-09-19T06:10:06.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.606+0000 7fd9f2a00640 1 -- 172.21.15.3:0/1078590893 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+22112 (secure 0 0 0) 0x7fd9f819b960 con 0x7fd9f81049a0 2024-09-19T06:10:06.609 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:10:06.609 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":86,"fsid":"782a5144-764c-11ef-bceb-c7b262605968","created":"2024-09-19T06:01:35.224753+0000","modified":"2024-09-19T06:10:03.693010+0000","last_up_change":"2024-09-19T06:09:02.478979+0000","last_in_change":"2024-09-19T06:08:38.865280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:04:56.654478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:09:58.426008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:10:01.215704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd89ea4b-a24e-4946-80fc-1776b6d05e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6803","nonce":2061486638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6805","nonce":2061486638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6809","nonce":2061486638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6807","nonce":2061486638}]},"public_addr":"172.21.15.3:6803/2061486638","cluster_addr":"172.21.15.3:6805/2061486638","heartbeat_back_addr":"172.21.15.3:6809/2061486638","heartbeat_front_addr":"172.21.15.3:6807/2061486638","state":["exists","up"]},{"osd":1,"uuid":"e03ca275-8da5-402f-9cd2-654ca422b9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6801","nonce":129318538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6803","nonce":129318538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6807","nonce":129318538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6805","nonce":129318538}]},"public_addr":"172.21.15.59:6801/129318538","cluster_addr":"172.21.15.59:6803/129318538","heartbeat_back_addr":"172.21.15.59:6807/129318538","heartbeat_front_addr":"172.21.15.59:6805/129318538","state":["exists","up"]},{"osd":2,"uuid":"62b7d36d-6078-4027-93b2-009be70a6d80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6801","nonce":2436210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6803","nonce":2436210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6807","nonce":2436210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6805","nonce":2436210695}]},"public_addr":"172.21.15.71:6801/2436210695","cluster_addr":"172.21.15.71:6803/2436210695","heartbeat_back_addr":"172.21.15.71:6807/2436210695","heartbeat_front_addr":"172.21.15.71:6805/2436210695","state":["exists","up"]},{"osd":3,"uuid":"ba33cc45-0103-443d-b262-622a505d9806","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6811","nonce":3577306700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6813","nonce":3577306700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6817","nonce":3577306700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6815","nonce":3577306700}]},"public_addr":"172.21.15.3:6811/3577306700","cluster_addr":"172.21.15.3:6813/3577306700","heartbeat_back_addr":"172.21.15.3:6817/3577306700","heartbeat_front_addr":"172.21.15.3:6815/3577306700","state":["exists","up"]},{"osd":4,"uuid":"40564c0c-6335-4207-a8e0-8078c9bfd015","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6809","nonce":4002980986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6811","nonce":4002980986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6815","nonce":4002980986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6813","nonce":4002980986}]},"public_addr":"172.21.15.59:6809/4002980986","cluster_addr":"172.21.15.59:6811/4002980986","heartbeat_back_addr":"172.21.15.59:6815/4002980986","heartbeat_front_addr":"172.21.15.59:6813/4002980986","state":["exists","up"]},{"osd":5,"uuid":"4db04b82-3403-4fd5-9eb7-7b81ed6b1d26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6809","nonce":2455500497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6811","nonce":2455500497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6815","nonce":2455500497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6813","nonce":2455500497}]},"public_addr":"172.21.15.71:6809/2455500497","cluster_addr":"172.21.15.71:6811/2455500497","heartbeat_back_addr":"172.21.15.71:6815/2455500497","heartbeat_front_addr":"172.21.15.71:6813/2455500497","state":["exists","up"]},{"osd":6,"uuid":"42a74f01-c5d0-4fc6-a8ee-a8bd84d4ab4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6819","nonce":823411903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6821","nonce":823411903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6825","nonce":823411903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6823","nonce":823411903}]},"public_addr":"172.21.15.3:6819/823411903","cluster_addr":"172.21.15.3:6821/823411903","heartbeat_back_addr":"172.21.15.3:6825/823411903","heartbeat_front_addr":"172.21.15.3:6823/823411903","state":["exists","up"]},{"osd":7,"uuid":"8a9bc2ec-4292-465d-8a0d-dda78521a319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6817","nonce":2133603853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6819","nonce":2133603853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6823","nonce":2133603853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6821","nonce":2133603853}]},"public_addr":"172.21.15.59:6817/2133603853","cluster_addr":"172.21.15.59:6819/2133603853","heartbeat_back_addr":"172.21.15.59:6823/2133603853","heartbeat_front_addr":"172.21.15.59:6821/2133603853","state":["exists","up"]},{"osd":8,"uuid":"6099a5c4-3504-43ca-8c58-d23f9096cd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6817","nonce":905333117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6819","nonce":905333117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6823","nonce":905333117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6821","nonce":905333117}]},"public_addr":"172.21.15.71:6817/905333117","cluster_addr":"172.21.15.71:6819/905333117","heartbeat_back_addr":"172.21.15.71:6823/905333117","heartbeat_front_addr":"172.21.15.71:6821/905333117","state":["exists","up"]},{"osd":9,"uuid":"b5a8aac6-bb10-4db8-a056-25228fbe754c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6827","nonce":124909267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6829","nonce":124909267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6833","nonce":124909267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6831","nonce":124909267}]},"public_addr":"172.21.15.3:6827/124909267","cluster_addr":"172.21.15.3:6829/124909267","heartbeat_back_addr":"172.21.15.3:6833/124909267","heartbeat_front_addr":"172.21.15.3:6831/124909267","state":["exists","up"]},{"osd":10,"uuid":"e49f3aab-0804-4aea-ae3f-38f022ab5239","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6825","nonce":784134238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6827","nonce":784134238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6831","nonce":784134238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6829","nonce":784134238}]},"public_addr":"172.21.15.59:6825/784134238","cluster_addr":"172.21.15.59:6827/784134238","heartbeat_back_addr":"172.21.15.59:6831/784134238","heartbeat_front_addr":"172.21.15.59:6829/784134238","state":["exists","up"]},{"osd":11,"uuid":"6c6d6c23-bcf7-43e7-94d1-5f2ebaa15441","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6825","nonce":3502550915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6827","nonce":3502550915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6831","nonce":3502550915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6829","nonce":3502550915}]},"public_addr":"172.21.15.71:6825/3502550915","cluster_addr":"172.21.15.71:6827/3502550915","heartbeat_back_addr":"172.21.15.71:6831/3502550915","heartbeat_front_addr":"172.21.15.71:6829/3502550915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:01.683342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:28.058683+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:53.250819+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:05:23.267377+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:05:49.756289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:06:15.766613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:06:46.054328+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:12.579180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:37.976863+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:08.683966+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:35.120765+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:00.624411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/1458736313":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/2065281908":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/953348594":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6801/518259590":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/1658697906":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6801/2386230415":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6800/2386230415":"2024-09-20T06:02:01.122348+0000","172.21.15.3:0/1616091100":"2024-09-20T06:02:30.039686+0000","172.21.15.3:6800/518259590":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/2122482494":"2024-09-20T06:02:01.122348+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:10:06.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.609+0000 7fda00800640 1 -- 172.21.15.3:0/1078590893 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd9e00a3240 msgr2=0x7fd9e00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:06.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.609+0000 7fda00800640 1 --2- 172.21.15.3:0/1078590893 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd9e00a3240 0x7fd9e00a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec02a930 tx=0x7fd9ec0058d0 comp rx=0 tx=0).stop 2024-09-19T06:10:06.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.609+0000 7fda00800640 1 -- 172.21.15.3:0/1078590893 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd9f81049a0 msgr2=0x7fd9f819ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:06.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.609+0000 7fda00800640 1 --2- 172.21.15.3:0/1078590893 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd9f81049a0 0x7fd9f819ab40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd9e800e9f0 tx=0x7fd9e800edf0 comp rx=0 tx=0).stop 2024-09-19T06:10:06.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.609+0000 7fda00800640 1 -- 172.21.15.3:0/1078590893 shutdown_connections 2024-09-19T06:10:06.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.609+0000 7fda00800640 1 --2- 172.21.15.3:0/1078590893 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd9e00a3240 0x7fd9e00a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:06.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.609+0000 7fda00800640 1 --2- 172.21.15.3:0/1078590893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd9f8109120 0x7fd9f819eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:06.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.609+0000 7fda00800640 1 --2- 172.21.15.3:0/1078590893 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd9f81049a0 0x7fd9f819ab40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:06.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.609+0000 7fda00800640 1 --2- 172.21.15.3:0/1078590893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9f8103ff0 0x7fd9f819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:06.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.609+0000 7fda00800640 1 -- 172.21.15.3:0/1078590893 >> 172.21.15.3:0/1078590893 conn(0x7fd9f80ffa90 msgr2=0x7fd9f8100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:06.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.609+0000 7fda00800640 1 -- 172.21.15.3:0/1078590893 shutdown_connections 2024-09-19T06:10:06.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:06.609+0000 7fda00800640 1 -- 172.21.15.3:0/1078590893 wait complete. 2024-09-19T06:10:06.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:06 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] up:active 2024-09-19T06:10:06.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:06 smithi059 ceph-mon[35138]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:10:06.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:06 smithi059 ceph-mon[35138]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:10:06.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:06 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] up:active 2024-09-19T06:10:06.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:06 smithi071 ceph-mon[35662]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:10:06.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:06 smithi071 ceph-mon[35662]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:10:07.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:07 smithi059 ceph-mon[35138]: pgmap v304: 97 pgs: 13 creating+peering, 84 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 4 op/s 2024-09-19T06:10:07.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:07 smithi059 ceph-mon[35138]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T06:10:07.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:07 smithi059 ceph-mon[35138]: Cluster is now healthy 2024-09-19T06:10:07.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:07 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1078590893' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:10:07.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:07 smithi003 ceph-mon[30893]: pgmap v304: 97 pgs: 13 creating+peering, 84 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 4 op/s 2024-09-19T06:10:07.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:07 smithi003 ceph-mon[30893]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T06:10:07.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:07 smithi003 ceph-mon[30893]: Cluster is now healthy 2024-09-19T06:10:07.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:07 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1078590893' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:10:07.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:07 smithi071 ceph-mon[35662]: pgmap v304: 97 pgs: 13 creating+peering, 84 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 4 op/s 2024-09-19T06:10:07.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:07 smithi071 ceph-mon[35662]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T06:10:07.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:07 smithi071 ceph-mon[35662]: Cluster is now healthy 2024-09-19T06:10:07.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:07 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1078590893' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:10:07.901 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:10:08.282 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:08.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.886+0000 7fe9ffe00640 1 -- 172.21.15.3:0/829250692 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9f8104010 msgr2=0x7fe9f81043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:08.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.886+0000 7fe9ffe00640 1 --2- 172.21.15.3:0/829250692 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9f8104010 0x7fe9f81043f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec009900 tx=0x7fe9ec02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.886+0000 7fe9ffe00640 1 -- 172.21.15.3:0/829250692 shutdown_connections 2024-09-19T06:10:08.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.886+0000 7fe9ffe00640 1 --2- 172.21.15.3:0/829250692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9f8109140 0x7fe9f8110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.886+0000 7fe9ffe00640 1 --2- 172.21.15.3:0/829250692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9f81049c0 0x7fe9f8108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.886+0000 7fe9ffe00640 1 --2- 172.21.15.3:0/829250692 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9f8104010 0x7fe9f81043f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.886+0000 7fe9ffe00640 1 -- 172.21.15.3:0/829250692 >> 172.21.15.3:0/829250692 conn(0x7fe9f80ffa50 msgr2=0x7fe9f8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:08.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.886+0000 7fe9ffe00640 1 -- 172.21.15.3:0/829250692 shutdown_connections 2024-09-19T06:10:08.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.886+0000 7fe9ffe00640 1 -- 172.21.15.3:0/829250692 wait complete. 2024-09-19T06:10:08.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.887+0000 7fe9ffe00640 1 Processor -- start 2024-09-19T06:10:08.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.887+0000 7fe9ffe00640 1 -- start start 2024-09-19T06:10:08.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.888+0000 7fe9ffe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9f8104010 0x7fe9f819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:08.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.888+0000 7fe9ffe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9f81049c0 0x7fe9f819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:08.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.888+0000 7fe9ffe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9f8109140 0x7fe9f819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:08.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.888+0000 7fe9ffe00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f8114190 con 0x7fe9f8109140 2024-09-19T06:10:08.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.888+0000 7fe9ffe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f8114010 con 0x7fe9f8104010 2024-09-19T06:10:08.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.888+0000 7fe9ffe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f8114310 con 0x7fe9f81049c0 2024-09-19T06:10:08.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.888+0000 7fe9fca00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9f81049c0 0x7fe9f819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:08.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.888+0000 7fe9fca00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9f81049c0 0x7fe9f819ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:44172/0 (socket says 172.21.15.3:44172) 2024-09-19T06:10:08.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.888+0000 7fe9fca00640 1 -- 172.21.15.3:0/1092352706 learned_addr learned my addr 172.21.15.3:0/1092352706 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:08.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.888+0000 7fe9fde00640 1 --2- 172.21.15.3:0/1092352706 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9f8109140 0x7fe9f819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:08.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.888+0000 7fe9fd400640 1 --2- 172.21.15.3:0/1092352706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9f8104010 0x7fe9f819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:08.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.888+0000 7fe9fca00640 1 -- 172.21.15.3:0/1092352706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9f8104010 msgr2=0x7fe9f819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:08.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.888+0000 7fe9fca00640 1 --2- 172.21.15.3:0/1092352706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9f8104010 0x7fe9f819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.888+0000 7fe9fca00640 1 -- 172.21.15.3:0/1092352706 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9f8109140 msgr2=0x7fe9f819eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:08.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.888+0000 7fe9fca00640 1 --2- 172.21.15.3:0/1092352706 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9f8109140 0x7fe9f819eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:08.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.888+0000 7fe9fca00640 1 -- 172.21.15.3:0/1092352706 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f819f5b0 con 0x7fe9f81049c0 2024-09-19T06:10:08.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.889+0000 7fe9fca00640 1 --2- 172.21.15.3:0/1092352706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9f81049c0 0x7fe9f819ab40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400e9f0 tx=0x7fe9e400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:08.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.889+0000 7fe9f6000640 1 -- 172.21.15.3:0/1092352706 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e400cd80 con 0x7fe9f81049c0 2024-09-19T06:10:08.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.889+0000 7fe9f6000640 1 -- 172.21.15.3:0/1092352706 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9e4010910 con 0x7fe9f81049c0 2024-09-19T06:10:08.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.889+0000 7fe9ffe00640 1 -- 172.21.15.3:0/1092352706 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9f819f8a0 con 0x7fe9f81049c0 2024-09-19T06:10:08.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.889+0000 7fe9f6000640 1 -- 172.21.15.3:0/1092352706 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4018990 con 0x7fe9f81049c0 2024-09-19T06:10:08.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.889+0000 7fe9ffe00640 1 -- 172.21.15.3:0/1092352706 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9f81a7180 con 0x7fe9f81049c0 2024-09-19T06:10:08.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.890+0000 7fe9ffe00640 1 -- 172.21.15.3:0/1092352706 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9f81043f0 con 0x7fe9f81049c0 2024-09-19T06:10:08.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.892+0000 7fe9f6000640 1 -- 172.21.15.3:0/1092352706 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fe9e4010ac0 con 0x7fe9f81049c0 2024-09-19T06:10:08.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.893+0000 7fe9f6000640 1 --2- 172.21.15.3:0/1092352706 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe9e00a3240 0x7fe9e00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:08.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.894+0000 7fe9f6000640 1 -- 172.21.15.3:0/1092352706 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fe9e40cff00 con 0x7fe9f81049c0 2024-09-19T06:10:08.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.894+0000 7fe9fd400640 1 --2- 172.21.15.3:0/1092352706 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe9e00a3240 0x7fe9e00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:08.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.894+0000 7fe9fd400640 1 --2- 172.21.15.3:0/1092352706 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe9e00a3240 0x7fe9e00a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec000c00 tx=0x7fe9ec005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:08.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:08.896+0000 7fe9f6000640 1 -- 172.21.15.3:0/1092352706 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe9e409c680 con 0x7fe9f81049c0 2024-09-19T06:10:09.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:09.083+0000 7fe9ffe00640 1 -- 172.21.15.3:0/1092352706 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9f802d7c0 con 0x7fe9f81049c0 2024-09-19T06:10:09.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:09.085+0000 7fe9f6000640 1 -- 172.21.15.3:0/1092352706 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+22112 (secure 0 0 0) 0x7fe9e40a0980 con 0x7fe9f81049c0 2024-09-19T06:10:09.088 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:10:09.088 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":86,"fsid":"782a5144-764c-11ef-bceb-c7b262605968","created":"2024-09-19T06:01:35.224753+0000","modified":"2024-09-19T06:10:03.693010+0000","last_up_change":"2024-09-19T06:09:02.478979+0000","last_in_change":"2024-09-19T06:08:38.865280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:04:56.654478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:09:58.426008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:10:01.215704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd89ea4b-a24e-4946-80fc-1776b6d05e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6803","nonce":2061486638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6805","nonce":2061486638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6809","nonce":2061486638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6807","nonce":2061486638}]},"public_addr":"172.21.15.3:6803/2061486638","cluster_addr":"172.21.15.3:6805/2061486638","heartbeat_back_addr":"172.21.15.3:6809/2061486638","heartbeat_front_addr":"172.21.15.3:6807/2061486638","state":["exists","up"]},{"osd":1,"uuid":"e03ca275-8da5-402f-9cd2-654ca422b9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6801","nonce":129318538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6803","nonce":129318538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6807","nonce":129318538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6805","nonce":129318538}]},"public_addr":"172.21.15.59:6801/129318538","cluster_addr":"172.21.15.59:6803/129318538","heartbeat_back_addr":"172.21.15.59:6807/129318538","heartbeat_front_addr":"172.21.15.59:6805/129318538","state":["exists","up"]},{"osd":2,"uuid":"62b7d36d-6078-4027-93b2-009be70a6d80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6801","nonce":2436210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6803","nonce":2436210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6807","nonce":2436210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6805","nonce":2436210695}]},"public_addr":"172.21.15.71:6801/2436210695","cluster_addr":"172.21.15.71:6803/2436210695","heartbeat_back_addr":"172.21.15.71:6807/2436210695","heartbeat_front_addr":"172.21.15.71:6805/2436210695","state":["exists","up"]},{"osd":3,"uuid":"ba33cc45-0103-443d-b262-622a505d9806","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6811","nonce":3577306700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6813","nonce":3577306700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6817","nonce":3577306700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6815","nonce":3577306700}]},"public_addr":"172.21.15.3:6811/3577306700","cluster_addr":"172.21.15.3:6813/3577306700","heartbeat_back_addr":"172.21.15.3:6817/3577306700","heartbeat_front_addr":"172.21.15.3:6815/3577306700","state":["exists","up"]},{"osd":4,"uuid":"40564c0c-6335-4207-a8e0-8078c9bfd015","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6809","nonce":4002980986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6811","nonce":4002980986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6815","nonce":4002980986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6813","nonce":4002980986}]},"public_addr":"172.21.15.59:6809/4002980986","cluster_addr":"172.21.15.59:6811/4002980986","heartbeat_back_addr":"172.21.15.59:6815/4002980986","heartbeat_front_addr":"172.21.15.59:6813/4002980986","state":["exists","up"]},{"osd":5,"uuid":"4db04b82-3403-4fd5-9eb7-7b81ed6b1d26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6809","nonce":2455500497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6811","nonce":2455500497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6815","nonce":2455500497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6813","nonce":2455500497}]},"public_addr":"172.21.15.71:6809/2455500497","cluster_addr":"172.21.15.71:6811/2455500497","heartbeat_back_addr":"172.21.15.71:6815/2455500497","heartbeat_front_addr":"172.21.15.71:6813/2455500497","state":["exists","up"]},{"osd":6,"uuid":"42a74f01-c5d0-4fc6-a8ee-a8bd84d4ab4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6819","nonce":823411903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6821","nonce":823411903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6825","nonce":823411903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6823","nonce":823411903}]},"public_addr":"172.21.15.3:6819/823411903","cluster_addr":"172.21.15.3:6821/823411903","heartbeat_back_addr":"172.21.15.3:6825/823411903","heartbeat_front_addr":"172.21.15.3:6823/823411903","state":["exists","up"]},{"osd":7,"uuid":"8a9bc2ec-4292-465d-8a0d-dda78521a319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6817","nonce":2133603853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6819","nonce":2133603853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6823","nonce":2133603853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6821","nonce":2133603853}]},"public_addr":"172.21.15.59:6817/2133603853","cluster_addr":"172.21.15.59:6819/2133603853","heartbeat_back_addr":"172.21.15.59:6823/2133603853","heartbeat_front_addr":"172.21.15.59:6821/2133603853","state":["exists","up"]},{"osd":8,"uuid":"6099a5c4-3504-43ca-8c58-d23f9096cd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6817","nonce":905333117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6819","nonce":905333117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6823","nonce":905333117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6821","nonce":905333117}]},"public_addr":"172.21.15.71:6817/905333117","cluster_addr":"172.21.15.71:6819/905333117","heartbeat_back_addr":"172.21.15.71:6823/905333117","heartbeat_front_addr":"172.21.15.71:6821/905333117","state":["exists","up"]},{"osd":9,"uuid":"b5a8aac6-bb10-4db8-a056-25228fbe754c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6827","nonce":124909267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6829","nonce":124909267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6833","nonce":124909267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6831","nonce":124909267}]},"public_addr":"172.21.15.3:6827/124909267","cluster_addr":"172.21.15.3:6829/124909267","heartbeat_back_addr":"172.21.15.3:6833/124909267","heartbeat_front_addr":"172.21.15.3:6831/124909267","state":["exists","up"]},{"osd":10,"uuid":"e49f3aab-0804-4aea-ae3f-38f022ab5239","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6825","nonce":784134238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6827","nonce":784134238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6831","nonce":784134238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6829","nonce":784134238}]},"public_addr":"172.21.15.59:6825/784134238","cluster_addr":"172.21.15.59:6827/784134238","heartbeat_back_addr":"172.21.15.59:6831/784134238","heartbeat_front_addr":"172.21.15.59:6829/784134238","state":["exists","up"]},{"osd":11,"uuid":"6c6d6c23-bcf7-43e7-94d1-5f2ebaa15441","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6825","nonce":3502550915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6827","nonce":3502550915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6831","nonce":3502550915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6829","nonce":3502550915}]},"public_addr":"172.21.15.71:6825/3502550915","cluster_addr":"172.21.15.71:6827/3502550915","heartbeat_back_addr":"172.21.15.71:6831/3502550915","heartbeat_front_addr":"172.21.15.71:6829/3502550915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:01.683342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:28.058683+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:53.250819+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:05:23.267377+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:05:49.756289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:06:15.766613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:06:46.054328+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:12.579180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:37.976863+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:08.683966+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:35.120765+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:00.624411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/1458736313":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/2065281908":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/953348594":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6801/518259590":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/1658697906":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6801/2386230415":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6800/2386230415":"2024-09-20T06:02:01.122348+0000","172.21.15.3:0/1616091100":"2024-09-20T06:02:30.039686+0000","172.21.15.3:6800/518259590":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/2122482494":"2024-09-20T06:02:01.122348+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:10:09.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:09.087+0000 7fe9ffe00640 1 -- 172.21.15.3:0/1092352706 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe9e00a3240 msgr2=0x7fe9e00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:09.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:09.088+0000 7fe9ffe00640 1 --2- 172.21.15.3:0/1092352706 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe9e00a3240 0x7fe9e00a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec000c00 tx=0x7fe9ec005b50 comp rx=0 tx=0).stop 2024-09-19T06:10:09.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:09.088+0000 7fe9ffe00640 1 -- 172.21.15.3:0/1092352706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9f81049c0 msgr2=0x7fe9f819ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:09.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:09.088+0000 7fe9ffe00640 1 --2- 172.21.15.3:0/1092352706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9f81049c0 0x7fe9f819ab40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400e9f0 tx=0x7fe9e400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:10:09.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:09.088+0000 7fe9ffe00640 1 -- 172.21.15.3:0/1092352706 shutdown_connections 2024-09-19T06:10:09.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:09.088+0000 7fe9ffe00640 1 --2- 172.21.15.3:0/1092352706 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe9e00a3240 0x7fe9e00a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:09.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:09.088+0000 7fe9ffe00640 1 --2- 172.21.15.3:0/1092352706 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9f8109140 0x7fe9f819eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:09.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:09.088+0000 7fe9ffe00640 1 --2- 172.21.15.3:0/1092352706 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9f81049c0 0x7fe9f819ab40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:09.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:09.088+0000 7fe9ffe00640 1 --2- 172.21.15.3:0/1092352706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9f8104010 0x7fe9f819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:09.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:09.088+0000 7fe9ffe00640 1 -- 172.21.15.3:0/1092352706 >> 172.21.15.3:0/1092352706 conn(0x7fe9f80ffa50 msgr2=0x7fe9f8100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:09.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:09.088+0000 7fe9ffe00640 1 -- 172.21.15.3:0/1092352706 shutdown_connections 2024-09-19T06:10:09.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:09.088+0000 7fe9ffe00640 1 -- 172.21.15.3:0/1092352706 wait complete. 2024-09-19T06:10:09.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:09 smithi059 ceph-mon[35138]: pgmap v305: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-19T06:10:09.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:09 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1092352706' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:10:09.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:09 smithi003 ceph-mon[30893]: pgmap v305: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-19T06:10:09.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:09 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1092352706' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:10:09.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:09 smithi071 ceph-mon[35662]: pgmap v305: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-19T06:10:09.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:09 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1092352706' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:10:10.054 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T06:10:10.431 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:10.538 INFO:journalctl@ceph.mds.b.smithi059.stdout:Sep 19 06:10:10 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-b[65335]: 2024-09-19T06:10:10.118+0000 7fbe08c3a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T06:10:11.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.023+0000 7fa8fb800640 1 -- 172.21.15.3:0/127581561 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f4101de0 msgr2=0x7fa8f41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:11.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.023+0000 7fa8fb800640 1 --2- 172.21.15.3:0/127581561 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f4101de0 0x7fa8f41021c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009900 tx=0x7fa8e402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:10:11.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.024+0000 7fa8fb800640 1 -- 172.21.15.3:0/127581561 shutdown_connections 2024-09-19T06:10:11.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.024+0000 7fa8fb800640 1 --2- 172.21.15.3:0/127581561 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8f4106f10 0x7fa8f410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:11.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.024+0000 7fa8fb800640 1 --2- 172.21.15.3:0/127581561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8f4102790 0x7fa8f41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:11.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.024+0000 7fa8fb800640 1 --2- 172.21.15.3:0/127581561 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f4101de0 0x7fa8f41021c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:11.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.024+0000 7fa8fb800640 1 -- 172.21.15.3:0/127581561 >> 172.21.15.3:0/127581561 conn(0x7fa8f40fd8c0 msgr2=0x7fa8f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:11.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.024+0000 7fa8fb800640 1 -- 172.21.15.3:0/127581561 shutdown_connections 2024-09-19T06:10:11.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.024+0000 7fa8fb800640 1 -- 172.21.15.3:0/127581561 wait complete. 2024-09-19T06:10:11.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.025+0000 7fa8fb800640 1 Processor -- start 2024-09-19T06:10:11.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.025+0000 7fa8fb800640 1 -- start start 2024-09-19T06:10:11.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.026+0000 7fa8fb800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8f4101de0 0x7fa8f41984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:11.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.026+0000 7fa8fb800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f4102790 0x7fa8f41989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:11.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.026+0000 7fa8fb800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8f4106f10 0x7fa8f419cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:11.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.026+0000 7fa8fb800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f4111fc0 con 0x7fa8f4101de0 2024-09-19T06:10:11.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.026+0000 7fa8fb800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f4111e40 con 0x7fa8f4106f10 2024-09-19T06:10:11.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.026+0000 7fa8fb800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f4112140 con 0x7fa8f4102790 2024-09-19T06:10:11.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.026+0000 7fa8f8e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8f4101de0 0x7fa8f41984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:11.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.026+0000 7fa8f9800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8f4106f10 0x7fa8f419cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:11.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.026+0000 7fa8ebe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f4102790 0x7fa8f41989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:11.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.026+0000 7fa8f9800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8f4106f10 0x7fa8f419cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:46126/0 (socket says 172.21.15.3:46126) 2024-09-19T06:10:11.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.026+0000 7fa8f8e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8f4101de0 0x7fa8f41984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42350/0 (socket says 172.21.15.3:42350) 2024-09-19T06:10:11.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.026+0000 7fa8f9800640 1 -- 172.21.15.3:0/4138363729 learned_addr learned my addr 172.21.15.3:0/4138363729 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:11.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.026+0000 7fa8f9800640 1 -- 172.21.15.3:0/4138363729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f4102790 msgr2=0x7fa8f41989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:11.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.026+0000 7fa8f9800640 1 --2- 172.21.15.3:0/4138363729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f4102790 0x7fa8f41989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:11.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.026+0000 7fa8f9800640 1 -- 172.21.15.3:0/4138363729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8f4101de0 msgr2=0x7fa8f41984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:11.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.026+0000 7fa8f9800640 1 --2- 172.21.15.3:0/4138363729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8f4101de0 0x7fa8f41984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:11.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.026+0000 7fa8f9800640 1 -- 172.21.15.3:0/4138363729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f419d450 con 0x7fa8f4106f10 2024-09-19T06:10:11.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.026+0000 7fa8ebe00640 1 --2- 172.21.15.3:0/4138363729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f4102790 0x7fa8f41989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:11.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.027+0000 7fa8f9800640 1 --2- 172.21.15.3:0/4138363729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8f4106f10 0x7fa8f419cd70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec00eb10 tx=0x7fa8ec00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:11.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.027+0000 7fa8f2000640 1 -- 172.21.15.3:0/4138363729 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec004b20 con 0x7fa8f4106f10 2024-09-19T06:10:11.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.027+0000 7fa8f2000640 1 -- 172.21.15.3:0/4138363729 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8ec004cc0 con 0x7fa8f4106f10 2024-09-19T06:10:11.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.027+0000 7fa8f2000640 1 -- 172.21.15.3:0/4138363729 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec010760 con 0x7fa8f4106f10 2024-09-19T06:10:11.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.027+0000 7fa8fb800640 1 -- 172.21.15.3:0/4138363729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f419d740 con 0x7fa8f4106f10 2024-09-19T06:10:11.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.027+0000 7fa8fb800640 1 -- 172.21.15.3:0/4138363729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f41a5020 con 0x7fa8f4106f10 2024-09-19T06:10:11.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.028+0000 7fa8fb800640 1 -- 172.21.15.3:0/4138363729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8f41021c0 con 0x7fa8f4106f10 2024-09-19T06:10:11.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.030+0000 7fa8f2000640 1 -- 172.21.15.3:0/4138363729 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fa8ec005000 con 0x7fa8f4106f10 2024-09-19T06:10:11.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.032+0000 7fa8f2000640 1 --2- 172.21.15.3:0/4138363729 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa8d80a32c0 0x7fa8d80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:11.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.032+0000 7fa8f2000640 1 -- 172.21.15.3:0/4138363729 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fa8ec0cff00 con 0x7fa8f4106f10 2024-09-19T06:10:11.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.032+0000 7fa8f8e00640 1 --2- 172.21.15.3:0/4138363729 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa8d80a32c0 0x7fa8d80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:11.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.032+0000 7fa8f8e00640 1 --2- 172.21.15.3:0/4138363729 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa8d80a32c0 0x7fa8d80a5780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4000c00 tx=0x7fa8e4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:11.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.034+0000 7fa8f2000640 1 -- 172.21.15.3:0/4138363729 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa8ec054210 con 0x7fa8f4106f10 2024-09-19T06:10:11.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.254+0000 7fa8fb800640 1 -- 172.21.15.3:0/4138363729 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa8f4199800 con 0x7fa8f4106f10 2024-09-19T06:10:11.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.530+0000 7fa8f2000640 1 -- 172.21.15.3:0/4138363729 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fa8f4199800 con 0x7fa8f4106f10 2024-09-19T06:10:11.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.532+0000 7fa8fb800640 1 -- 172.21.15.3:0/4138363729 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa8d80a32c0 msgr2=0x7fa8d80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:11.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.532+0000 7fa8fb800640 1 --2- 172.21.15.3:0/4138363729 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa8d80a32c0 0x7fa8d80a5780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4000c00 tx=0x7fa8e4005b50 comp rx=0 tx=0).stop 2024-09-19T06:10:11.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.532+0000 7fa8fb800640 1 -- 172.21.15.3:0/4138363729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8f4106f10 msgr2=0x7fa8f419cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:11.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.532+0000 7fa8fb800640 1 --2- 172.21.15.3:0/4138363729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8f4106f10 0x7fa8f419cd70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec00eb10 tx=0x7fa8ec00c2d0 comp rx=0 tx=0).stop 2024-09-19T06:10:11.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.532+0000 7fa8fb800640 1 -- 172.21.15.3:0/4138363729 shutdown_connections 2024-09-19T06:10:11.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.532+0000 7fa8fb800640 1 --2- 172.21.15.3:0/4138363729 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa8d80a32c0 0x7fa8d80a5780 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:11.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.532+0000 7fa8fb800640 1 --2- 172.21.15.3:0/4138363729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8f4106f10 0x7fa8f419cd70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:11.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.532+0000 7fa8fb800640 1 --2- 172.21.15.3:0/4138363729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa8f4102790 0x7fa8f41989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:11.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.532+0000 7fa8fb800640 1 --2- 172.21.15.3:0/4138363729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8f4101de0 0x7fa8f41984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:11.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.533+0000 7fa8fb800640 1 -- 172.21.15.3:0/4138363729 >> 172.21.15.3:0/4138363729 conn(0x7fa8f40fd8c0 msgr2=0x7fa8f40febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:11.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.533+0000 7fa8fb800640 1 -- 172.21.15.3:0/4138363729 shutdown_connections 2024-09-19T06:10:11.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:11.533+0000 7fa8fb800640 1 -- 172.21.15.3:0/4138363729 wait complete. 2024-09-19T06:10:11.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:11 smithi059 ceph-mon[35138]: pgmap v306: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T06:10:11.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:11 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/4138363729' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T06:10:11.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:11 smithi059 ceph-mon[35138]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T06:10:11.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:11 smithi003 ceph-mon[30893]: pgmap v306: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T06:10:11.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:11 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/4138363729' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T06:10:11.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:11 smithi003 ceph-mon[30893]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T06:10:11.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:11 smithi071 ceph-mon[35662]: pgmap v306: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T06:10:11.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:11 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/4138363729' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T06:10:11.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:11 smithi071 ceph-mon[35662]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T06:10:12.504 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-19T06:10:12.504 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-19T06:10:12.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:12 smithi059 ceph-mon[35138]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T06:10:12.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:12 smithi059 ceph-mon[35138]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:10:12.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:12 smithi003 ceph-mon[30893]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T06:10:12.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:12 smithi003 ceph-mon[30893]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:10:12.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:12 smithi071 ceph-mon[35662]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T06:10:12.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:12 smithi071 ceph-mon[35662]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:10:12.881 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:13.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.508+0000 7f6e2d200640 1 -- 172.21.15.3:0/773450131 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e28104010 msgr2=0x7f6e281043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:13.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.508+0000 7f6e2d200640 1 --2- 172.21.15.3:0/773450131 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e28104010 0x7f6e281043f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009900 tx=0x7f6e1802a410 comp rx=0 tx=0).stop 2024-09-19T06:10:13.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.508+0000 7f6e2d200640 1 -- 172.21.15.3:0/773450131 shutdown_connections 2024-09-19T06:10:13.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.508+0000 7f6e2d200640 1 --2- 172.21.15.3:0/773450131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e28109140 0x7f6e28110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:13.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.508+0000 7f6e2d200640 1 --2- 172.21.15.3:0/773450131 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e281049c0 0x7f6e28108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:13.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.508+0000 7f6e2d200640 1 --2- 172.21.15.3:0/773450131 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e28104010 0x7f6e281043f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:13.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.508+0000 7f6e2d200640 1 -- 172.21.15.3:0/773450131 >> 172.21.15.3:0/773450131 conn(0x7f6e280ffa50 msgr2=0x7f6e28101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:13.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.508+0000 7f6e2d200640 1 -- 172.21.15.3:0/773450131 shutdown_connections 2024-09-19T06:10:13.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.508+0000 7f6e2d200640 1 -- 172.21.15.3:0/773450131 wait complete. 2024-09-19T06:10:13.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.509+0000 7f6e2d200640 1 Processor -- start 2024-09-19T06:10:13.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.509+0000 7f6e2d200640 1 -- start start 2024-09-19T06:10:13.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.509+0000 7f6e2d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e28104010 0x7f6e2819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:13.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.509+0000 7f6e2d200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e281049c0 0x7f6e2819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:13.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.509+0000 7f6e2d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e28109140 0x7f6e2819ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:13.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.510+0000 7f6e2d200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6e281141b0 con 0x7f6e281049c0 2024-09-19T06:10:13.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.510+0000 7f6e2d200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6e28114030 con 0x7f6e28104010 2024-09-19T06:10:13.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.510+0000 7f6e2d200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6e28114330 con 0x7f6e28109140 2024-09-19T06:10:13.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.510+0000 7f6e1d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e281049c0 0x7f6e2819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:13.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.510+0000 7f6e25e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e28104010 0x7f6e2819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:13.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.510+0000 7f6e25e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e28104010 0x7f6e2819a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:46138/0 (socket says 172.21.15.3:46138) 2024-09-19T06:10:13.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.510+0000 7f6e25e00640 1 -- 172.21.15.3:0/3989103664 learned_addr learned my addr 172.21.15.3:0/3989103664 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:13.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.510+0000 7f6e26800640 1 --2- 172.21.15.3:0/3989103664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e28109140 0x7f6e2819ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:13.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.510+0000 7f6e26800640 1 -- 172.21.15.3:0/3989103664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e28104010 msgr2=0x7f6e2819a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:13.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.510+0000 7f6e26800640 1 --2- 172.21.15.3:0/3989103664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e28104010 0x7f6e2819a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:13.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.510+0000 7f6e26800640 1 -- 172.21.15.3:0/3989103664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e281049c0 msgr2=0x7f6e2819ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:13.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.510+0000 7f6e26800640 1 --2- 172.21.15.3:0/3989103664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e281049c0 0x7f6e2819ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:13.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.510+0000 7f6e26800640 1 -- 172.21.15.3:0/3989103664 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e2819f600 con 0x7f6e28109140 2024-09-19T06:10:13.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.510+0000 7f6e25e00640 1 --2- 172.21.15.3:0/3989103664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e28104010 0x7f6e2819a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:13.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.511+0000 7f6e26800640 1 --2- 172.21.15.3:0/3989103664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e28109140 0x7f6e2819ef20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009fd0 tx=0x7f6e2000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:13.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.511+0000 7f6e1f400640 1 -- 172.21.15.3:0/3989103664 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2000ce20 con 0x7f6e28109140 2024-09-19T06:10:13.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.511+0000 7f6e1f400640 1 -- 172.21.15.3:0/3989103664 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e20005020 con 0x7f6e28109140 2024-09-19T06:10:13.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.511+0000 7f6e1f400640 1 -- 172.21.15.3:0/3989103664 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e20010720 con 0x7f6e28109140 2024-09-19T06:10:13.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.511+0000 7f6e2d200640 1 -- 172.21.15.3:0/3989103664 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e2819f8f0 con 0x7f6e28109140 2024-09-19T06:10:13.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.511+0000 7f6e2d200640 1 -- 172.21.15.3:0/3989103664 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e281a71d0 con 0x7f6e28109140 2024-09-19T06:10:13.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.512+0000 7f6e2d200640 1 -- 172.21.15.3:0/3989103664 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e281043f0 con 0x7f6e28109140 2024-09-19T06:10:13.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.514+0000 7f6e1f400640 1 -- 172.21.15.3:0/3989103664 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f6e20005540 con 0x7f6e28109140 2024-09-19T06:10:13.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.515+0000 7f6e1f400640 1 --2- 172.21.15.3:0/3989103664 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f6e0c0a32c0 0x7f6e0c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:13.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.516+0000 7f6e1f400640 1 -- 172.21.15.3:0/3989103664 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f6e200cffe0 con 0x7f6e28109140 2024-09-19T06:10:13.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.516+0000 7f6e25e00640 1 --2- 172.21.15.3:0/3989103664 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f6e0c0a32c0 0x7f6e0c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:13.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.516+0000 7f6e25e00640 1 --2- 172.21.15.3:0/3989103664 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f6e0c0a32c0 0x7f6e0c0a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6e180096c0 tx=0x7f6e180046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:13.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.517+0000 7f6e1f400640 1 -- 172.21.15.3:0/3989103664 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6e2009ce10 con 0x7f6e28109140 2024-09-19T06:10:13.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:13 smithi003 ceph-mon[30893]: pgmap v307: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-19T06:10:13.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:13.748+0000 7f6e2d200640 1 -- 172.21.15.3:0/3989103664 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f6e2802d7c0 con 0x7f6e28109140 2024-09-19T06:10:13.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:13 smithi071 ceph-mon[35662]: pgmap v307: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-19T06:10:14.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:13 smithi059 ceph-mon[35138]: pgmap v307: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-19T06:10:14.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:14.553+0000 7f6e1f400640 1 -- 172.21.15.3:0/3989103664 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f6e2009c710 con 0x7f6e28109140 2024-09-19T06:10:14.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:14.557+0000 7f6e2d200640 1 -- 172.21.15.3:0/3989103664 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f6e0c0a32c0 msgr2=0x7f6e0c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:14.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:14.557+0000 7f6e2d200640 1 --2- 172.21.15.3:0/3989103664 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f6e0c0a32c0 0x7f6e0c0a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6e180096c0 tx=0x7f6e180046c0 comp rx=0 tx=0).stop 2024-09-19T06:10:14.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:14.557+0000 7f6e2d200640 1 -- 172.21.15.3:0/3989103664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e28109140 msgr2=0x7f6e2819ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:14.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:14.557+0000 7f6e2d200640 1 --2- 172.21.15.3:0/3989103664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e28109140 0x7f6e2819ef20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009fd0 tx=0x7f6e2000ef10 comp rx=0 tx=0).stop 2024-09-19T06:10:14.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:14.557+0000 7f6e2d200640 1 -- 172.21.15.3:0/3989103664 shutdown_connections 2024-09-19T06:10:14.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:14.557+0000 7f6e2d200640 1 --2- 172.21.15.3:0/3989103664 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f6e0c0a32c0 0x7f6e0c0a5780 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:14.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:14.557+0000 7f6e2d200640 1 --2- 172.21.15.3:0/3989103664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6e28109140 0x7f6e2819ef20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:14.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:14.557+0000 7f6e2d200640 1 --2- 172.21.15.3:0/3989103664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e281049c0 0x7f6e2819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:14.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:14.557+0000 7f6e2d200640 1 --2- 172.21.15.3:0/3989103664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e28104010 0x7f6e2819a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:14.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:14.557+0000 7f6e2d200640 1 -- 172.21.15.3:0/3989103664 >> 172.21.15.3:0/3989103664 conn(0x7f6e280ffa50 msgr2=0x7f6e28100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:14.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:14.557+0000 7f6e2d200640 1 -- 172.21.15.3:0/3989103664 shutdown_connections 2024-09-19T06:10:14.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:14.557+0000 7f6e2d200640 1 -- 172.21.15.3:0/3989103664 wait complete. 2024-09-19T06:10:14.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:14 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3989103664' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T06:10:14.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:14 smithi003 ceph-mon[30893]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T06:10:14.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:14 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/3989103664' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T06:10:14.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:14 smithi071 ceph-mon[35662]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T06:10:15.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:14 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/3989103664' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T06:10:15.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:14 smithi059 ceph-mon[35138]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T06:10:15.497 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T06:10:15.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:15 smithi003 ceph-mon[30893]: pgmap v308: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-19T06:10:15.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:15 smithi003 ceph-mon[30893]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T06:10:15.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:15 smithi003 ceph-mon[30893]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-19T06:10:15.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:15 smithi003 ceph-mon[30893]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T06:10:15.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:15 smithi003 ceph-mon[30893]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:10:15.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:15 smithi003 ceph-mon[30893]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T06:10:15.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:15 smithi003 ceph-mon[30893]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T06:10:15.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:15 smithi071 ceph-mon[35662]: pgmap v308: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-19T06:10:15.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:15 smithi071 ceph-mon[35662]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T06:10:15.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:15 smithi071 ceph-mon[35662]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-19T06:10:15.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:15 smithi071 ceph-mon[35662]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T06:10:15.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:15 smithi071 ceph-mon[35662]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:10:15.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:15 smithi071 ceph-mon[35662]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T06:10:15.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:15 smithi071 ceph-mon[35662]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T06:10:15.888 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:16.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:15 smithi059 ceph-mon[35138]: pgmap v308: 97 pgs: 97 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-19T06:10:16.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:15 smithi059 ceph-mon[35138]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T06:10:16.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:15 smithi059 ceph-mon[35138]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-19T06:10:16.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:15 smithi059 ceph-mon[35138]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T06:10:16.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:15 smithi059 ceph-mon[35138]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T06:10:16.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:15 smithi059 ceph-mon[35138]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T06:10:16.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:15 smithi059 ceph-mon[35138]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T06:10:16.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.449+0000 7fcd74c00640 1 -- 172.21.15.3:0/3277478119 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd70076720 msgr2=0x7fcd70076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:16.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.449+0000 7fcd74c00640 1 --2- 172.21.15.3:0/3277478119 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd70076720 0x7fcd70076b00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcd60009900 tx=0x7fcd6002a3f0 comp rx=0 tx=0).stop 2024-09-19T06:10:16.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.449+0000 7fcd74c00640 1 -- 172.21.15.3:0/3277478119 shutdown_connections 2024-09-19T06:10:16.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.449+0000 7fcd74c00640 1 --2- 172.21.15.3:0/3277478119 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd70112a50 0x7fcd70114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:16.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.449+0000 7fcd74c00640 1 --2- 172.21.15.3:0/3277478119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd70077040 0x7fcd70112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:16.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.449+0000 7fcd74c00640 1 --2- 172.21.15.3:0/3277478119 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd70076720 0x7fcd70076b00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:16.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.449+0000 7fcd74c00640 1 -- 172.21.15.3:0/3277478119 >> 172.21.15.3:0/3277478119 conn(0x7fcd700ffa50 msgr2=0x7fcd70101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:16.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.449+0000 7fcd74c00640 1 -- 172.21.15.3:0/3277478119 shutdown_connections 2024-09-19T06:10:16.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.449+0000 7fcd74c00640 1 -- 172.21.15.3:0/3277478119 wait complete. 2024-09-19T06:10:16.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.450+0000 7fcd74c00640 1 Processor -- start 2024-09-19T06:10:16.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.450+0000 7fcd74c00640 1 -- start start 2024-09-19T06:10:16.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.451+0000 7fcd74c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd70076720 0x7fcd701a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:16.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.451+0000 7fcd74c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd70077040 0x7fcd701a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:16.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.451+0000 7fcd74c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd70112a50 0x7fcd7019e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:16.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.451+0000 7fcd74c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcd70118610 con 0x7fcd70077040 2024-09-19T06:10:16.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.451+0000 7fcd74c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcd70118490 con 0x7fcd70076720 2024-09-19T06:10:16.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.451+0000 7fcd74c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcd70118790 con 0x7fcd70112a50 2024-09-19T06:10:16.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.451+0000 7fcd6d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd70077040 0x7fcd701a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:16.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.451+0000 7fcd6de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd70076720 0x7fcd701a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:16.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.451+0000 7fcd6de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd70076720 0x7fcd701a4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:58806/0 (socket says 172.21.15.3:58806) 2024-09-19T06:10:16.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.451+0000 7fcd6de00640 1 -- 172.21.15.3:0/57772874 learned_addr learned my addr 172.21.15.3:0/57772874 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:16.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.451+0000 7fcd6d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd70077040 0x7fcd701a4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55920/0 (socket says 172.21.15.3:55920) 2024-09-19T06:10:16.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.451+0000 7fcd6e800640 1 --2- 172.21.15.3:0/57772874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd70112a50 0x7fcd7019e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:16.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.451+0000 7fcd6de00640 1 -- 172.21.15.3:0/57772874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd70112a50 msgr2=0x7fcd7019e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:16.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.451+0000 7fcd6de00640 1 --2- 172.21.15.3:0/57772874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd70112a50 0x7fcd7019e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:16.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.451+0000 7fcd6de00640 1 -- 172.21.15.3:0/57772874 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd70077040 msgr2=0x7fcd701a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:16.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.452+0000 7fcd6de00640 1 --2- 172.21.15.3:0/57772874 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd70077040 0x7fcd701a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:16.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.452+0000 7fcd6de00640 1 -- 172.21.15.3:0/57772874 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd7019eff0 con 0x7fcd70076720 2024-09-19T06:10:16.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.452+0000 7fcd6de00640 1 --2- 172.21.15.3:0/57772874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd70076720 0x7fcd701a4700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcd60004770 tx=0x7fcd60003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:16.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.452+0000 7fcd66a00640 1 -- 172.21.15.3:0/57772874 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6003f070 con 0x7fcd70076720 2024-09-19T06:10:16.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.452+0000 7fcd74c00640 1 -- 172.21.15.3:0/57772874 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd7019f280 con 0x7fcd70076720 2024-09-19T06:10:16.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.452+0000 7fcd74c00640 1 -- 172.21.15.3:0/57772874 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd701ab5d0 con 0x7fcd70076720 2024-09-19T06:10:16.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.453+0000 7fcd66a00640 1 -- 172.21.15.3:0/57772874 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd60031ca0 con 0x7fcd70076720 2024-09-19T06:10:16.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.453+0000 7fcd66a00640 1 -- 172.21.15.3:0/57772874 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd60049060 con 0x7fcd70076720 2024-09-19T06:10:16.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.454+0000 7fcd74c00640 1 -- 172.21.15.3:0/57772874 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd50005290 con 0x7fcd70076720 2024-09-19T06:10:16.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.456+0000 7fcd66a00640 1 -- 172.21.15.3:0/57772874 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fcd60042070 con 0x7fcd70076720 2024-09-19T06:10:16.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.457+0000 7fcd66a00640 1 --2- 172.21.15.3:0/57772874 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fcd540a3240 0x7fcd540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:16.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.457+0000 7fcd66a00640 1 -- 172.21.15.3:0/57772874 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fcd600efa00 con 0x7fcd70076720 2024-09-19T06:10:16.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.457+0000 7fcd6d400640 1 --2- 172.21.15.3:0/57772874 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fcd540a3240 0x7fcd540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:16.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.458+0000 7fcd6d400640 1 --2- 172.21.15.3:0/57772874 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fcd540a3240 0x7fcd540a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcd700792b0 tx=0x7fcd5c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:16.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.459+0000 7fcd66a00640 1 -- 172.21.15.3:0/57772874 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcd600bc860 con 0x7fcd70076720 2024-09-19T06:10:16.698 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.696+0000 7fcd74c00640 1 -- 172.21.15.3:0/57772874 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fcd50005580 con 0x7fcd70076720 2024-09-19T06:10:16.699 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:16 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] up:active 2024-09-19T06:10:16.699 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:16 smithi003 ceph-mon[30893]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T06:10:16.699 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:16 smithi003 ceph-mon[30893]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T06:10:16.699 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:16 smithi003 ceph-mon[30893]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T06:10:16.699 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:16 smithi003 ceph-mon[30893]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-19T06:10:16.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.759+0000 7fcd66a00640 1 -- 172.21.15.3:0/57772874 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7fcd600bc160 con 0x7fcd70076720 2024-09-19T06:10:16.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.762+0000 7fcd74c00640 1 -- 172.21.15.3:0/57772874 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fcd540a3240 msgr2=0x7fcd540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:16.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.762+0000 7fcd74c00640 1 --2- 172.21.15.3:0/57772874 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fcd540a3240 0x7fcd540a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcd700792b0 tx=0x7fcd5c005f90 comp rx=0 tx=0).stop 2024-09-19T06:10:16.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.762+0000 7fcd74c00640 1 -- 172.21.15.3:0/57772874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd70076720 msgr2=0x7fcd701a4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:16.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.762+0000 7fcd74c00640 1 --2- 172.21.15.3:0/57772874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd70076720 0x7fcd701a4700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcd60004770 tx=0x7fcd60003c10 comp rx=0 tx=0).stop 2024-09-19T06:10:16.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.762+0000 7fcd74c00640 1 -- 172.21.15.3:0/57772874 shutdown_connections 2024-09-19T06:10:16.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.762+0000 7fcd74c00640 1 --2- 172.21.15.3:0/57772874 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fcd540a3240 0x7fcd540a5700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:16.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.762+0000 7fcd74c00640 1 --2- 172.21.15.3:0/57772874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd70112a50 0x7fcd7019e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:16.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.762+0000 7fcd74c00640 1 --2- 172.21.15.3:0/57772874 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd70077040 0x7fcd701a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:16.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.762+0000 7fcd74c00640 1 --2- 172.21.15.3:0/57772874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd70076720 0x7fcd701a4700 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:16.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.762+0000 7fcd74c00640 1 -- 172.21.15.3:0/57772874 >> 172.21.15.3:0/57772874 conn(0x7fcd700ffa50 msgr2=0x7fcd70101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:16.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.763+0000 7fcd74c00640 1 -- 172.21.15.3:0/57772874 shutdown_connections 2024-09-19T06:10:16.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:16.763+0000 7fcd74c00640 1 -- 172.21.15.3:0/57772874 wait complete. 2024-09-19T06:10:16.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:16 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] up:active 2024-09-19T06:10:16.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:16 smithi071 ceph-mon[35662]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T06:10:16.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:16 smithi071 ceph-mon[35662]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T06:10:16.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:16 smithi071 ceph-mon[35662]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T06:10:16.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:16 smithi071 ceph-mon[35662]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-19T06:10:17.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:16 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] up:active 2024-09-19T06:10:17.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:16 smithi059 ceph-mon[35138]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T06:10:17.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:16 smithi059 ceph-mon[35138]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T06:10:17.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:16 smithi059 ceph-mon[35138]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-19T06:10:17.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:16 smithi059 ceph-mon[35138]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-19T06:10:17.641 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T06:10:17.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:17 smithi003 ceph-mon[30893]: pgmap v309: 97 pgs: 97 active+clean; 580 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-19T06:10:17.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:17 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] up:active 2024-09-19T06:10:17.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:17 smithi003 ceph-mon[30893]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-19T06:10:17.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:17 smithi003 ceph-mon[30893]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-19T06:10:17.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:17 smithi003 ceph-mon[30893]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-19T06:10:17.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:17 smithi003 ceph-mon[30893]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-19T06:10:17.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:17 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/57772874' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T06:10:17.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:17 smithi003 ceph-mon[30893]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T06:10:17.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:17 smithi003 ceph-mon[30893]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T06:10:17.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:17 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] up:active 2024-09-19T06:10:17.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:17 smithi003 ceph-mon[30893]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-19T06:10:17.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:17 smithi003 ceph-mon[30893]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T06:10:17.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:17 smithi003 ceph-mon[30893]: Cluster is now healthy 2024-09-19T06:10:17.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:17 smithi003 ceph-mon[30893]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 4 up:standby-replay 4 up:standby 2024-09-19T06:10:17.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:17 smithi003 ceph-mon[30893]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-09-19T06:10:17.836 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:17 smithi003 ceph-mon[30893]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-09-19T06:10:17.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:17 smithi071 ceph-mon[35662]: pgmap v309: 97 pgs: 97 active+clean; 580 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-19T06:10:17.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:17 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] up:active 2024-09-19T06:10:17.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:17 smithi071 ceph-mon[35662]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-19T06:10:17.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:17 smithi071 ceph-mon[35662]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-19T06:10:17.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:17 smithi071 ceph-mon[35662]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-19T06:10:17.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:17 smithi071 ceph-mon[35662]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-19T06:10:17.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:17 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/57772874' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T06:10:17.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:17 smithi071 ceph-mon[35662]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T06:10:17.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:17 smithi071 ceph-mon[35662]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T06:10:17.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:17 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] up:active 2024-09-19T06:10:17.837 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:17 smithi071 ceph-mon[35662]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-19T06:10:17.838 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:17 smithi071 ceph-mon[35662]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T06:10:17.838 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:17 smithi071 ceph-mon[35662]: Cluster is now healthy 2024-09-19T06:10:17.838 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:17 smithi071 ceph-mon[35662]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 4 up:standby-replay 4 up:standby 2024-09-19T06:10:17.838 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:17 smithi071 ceph-mon[35662]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-09-19T06:10:17.838 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:17 smithi071 ceph-mon[35662]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-09-19T06:10:18.026 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:18.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:17 smithi059 ceph-mon[35138]: pgmap v309: 97 pgs: 97 active+clean; 580 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-19T06:10:18.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:17 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] up:active 2024-09-19T06:10:18.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:17 smithi059 ceph-mon[35138]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-19T06:10:18.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:17 smithi059 ceph-mon[35138]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-19T06:10:18.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:17 smithi059 ceph-mon[35138]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-19T06:10:18.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:17 smithi059 ceph-mon[35138]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-19T06:10:18.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:17 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/57772874' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T06:10:18.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:17 smithi059 ceph-mon[35138]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T06:10:18.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:17 smithi059 ceph-mon[35138]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T06:10:18.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:17 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] up:active 2024-09-19T06:10:18.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:17 smithi059 ceph-mon[35138]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-19T06:10:18.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:17 smithi059 ceph-mon[35138]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T06:10:18.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:17 smithi059 ceph-mon[35138]: Cluster is now healthy 2024-09-19T06:10:18.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:17 smithi059 ceph-mon[35138]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 4 up:standby-replay 4 up:standby 2024-09-19T06:10:18.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:17 smithi059 ceph-mon[35138]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-09-19T06:10:18.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:17 smithi059 ceph-mon[35138]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-09-19T06:10:18.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.638+0000 7f1993200640 1 -- 172.21.15.3:0/166096113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1994102360 msgr2=0x7f199410e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:18.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.638+0000 7f1993200640 1 --2- 172.21.15.3:0/166096113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1994102360 0x7f199410e890 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f198c009cd0 tx=0x7f198c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:10:18.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.638+0000 7f1993200640 1 -- 172.21.15.3:0/166096113 shutdown_connections 2024-09-19T06:10:18.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.638+0000 7f1993200640 1 --2- 172.21.15.3:0/166096113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1994102360 0x7f199410e890 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:18.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.638+0000 7f1993200640 1 --2- 172.21.15.3:0/166096113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19941019c0 0x7f1994101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:18.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.638+0000 7f1993200640 1 --2- 172.21.15.3:0/166096113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19941079c0 0x7f1994107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:18.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.638+0000 7f1993200640 1 -- 172.21.15.3:0/166096113 >> 172.21.15.3:0/166096113 conn(0x7f19940fd740 msgr2=0x7f19940ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:18.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.638+0000 7f1993200640 1 -- 172.21.15.3:0/166096113 shutdown_connections 2024-09-19T06:10:18.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.638+0000 7f1993200640 1 -- 172.21.15.3:0/166096113 wait complete. 2024-09-19T06:10:18.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.639+0000 7f1993200640 1 Processor -- start 2024-09-19T06:10:18.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.639+0000 7f1993200640 1 -- start start 2024-09-19T06:10:18.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.639+0000 7f1993200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19941019c0 0x7f199419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:18.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.639+0000 7f1993200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1994102360 0x7f199419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:18.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.640+0000 7f1993200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19941079c0 0x7f199419ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:18.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.640+0000 7f1993200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1994111e10 con 0x7f19941079c0 2024-09-19T06:10:18.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.640+0000 7f1993200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1994111c90 con 0x7f19941019c0 2024-09-19T06:10:18.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.640+0000 7f1993200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1994111f90 con 0x7f1994102360 2024-09-19T06:10:18.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.640+0000 7f1992800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19941079c0 0x7f199419ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:18.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.640+0000 7f1992800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19941079c0 0x7f199419ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55938/0 (socket says 172.21.15.3:55938) 2024-09-19T06:10:18.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.640+0000 7f1992800640 1 -- 172.21.15.3:0/1003942177 learned_addr learned my addr 172.21.15.3:0/1003942177 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:18.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.640+0000 7f1989400640 1 --2- 172.21.15.3:0/1003942177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1994102360 0x7f199419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:18.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.640+0000 7f1991e00640 1 --2- 172.21.15.3:0/1003942177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19941019c0 0x7f199419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:18.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.640+0000 7f1989400640 1 -- 172.21.15.3:0/1003942177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19941019c0 msgr2=0x7f199419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:18.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.640+0000 7f1989400640 1 --2- 172.21.15.3:0/1003942177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19941019c0 0x7f199419a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:18.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.640+0000 7f1989400640 1 -- 172.21.15.3:0/1003942177 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19941079c0 msgr2=0x7f199419ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:18.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.640+0000 7f1989400640 1 --2- 172.21.15.3:0/1003942177 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19941079c0 0x7f199419ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:18.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.640+0000 7f1989400640 1 -- 172.21.15.3:0/1003942177 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f199419f440 con 0x7f1994102360 2024-09-19T06:10:18.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.641+0000 7f1989400640 1 --2- 172.21.15.3:0/1003942177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1994102360 0x7f199419a9d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f197c00e9f0 tx=0x7f197c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:18.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.641+0000 7f198b400640 1 -- 172.21.15.3:0/1003942177 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197c00ccc0 con 0x7f1994102360 2024-09-19T06:10:18.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.641+0000 7f198b400640 1 -- 172.21.15.3:0/1003942177 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f197c010910 con 0x7f1994102360 2024-09-19T06:10:18.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.641+0000 7f1993200640 1 -- 172.21.15.3:0/1003942177 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f199419f730 con 0x7f1994102360 2024-09-19T06:10:18.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.641+0000 7f198b400640 1 -- 172.21.15.3:0/1003942177 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197c018960 con 0x7f1994102360 2024-09-19T06:10:18.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.641+0000 7f1993200640 1 -- 172.21.15.3:0/1003942177 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19941a7010 con 0x7f1994102360 2024-09-19T06:10:18.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.642+0000 7f1993200640 1 -- 172.21.15.3:0/1003942177 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1994101e20 con 0x7f1994102360 2024-09-19T06:10:18.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.644+0000 7f198b400640 1 -- 172.21.15.3:0/1003942177 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f197c010ac0 con 0x7f1994102360 2024-09-19T06:10:18.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.645+0000 7f198b400640 1 --2- 172.21.15.3:0/1003942177 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f19780a3240 0x7f19780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:18.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.646+0000 7f198b400640 1 -- 172.21.15.3:0/1003942177 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f197c0d00b0 con 0x7f1994102360 2024-09-19T06:10:18.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.646+0000 7f1991e00640 1 --2- 172.21.15.3:0/1003942177 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f19780a3240 0x7f19780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:18.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.646+0000 7f1991e00640 1 --2- 172.21.15.3:0/1003942177 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f19780a3240 0x7f19780a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1984009b50 tx=0x7f1984005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:18.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.647+0000 7f198b400640 1 -- 172.21.15.3:0/1003942177 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f197c09c830 con 0x7f1994102360 2024-09-19T06:10:18.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:18 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] up:active 2024-09-19T06:10:18.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:18 smithi003 ceph-mon[30893]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-19T06:10:18.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:18 smithi003 ceph-mon[30893]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:10:18.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:18.875+0000 7f1993200640 1 -- 172.21.15.3:0/1003942177 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f19941a7270 con 0x7f1994102360 2024-09-19T06:10:19.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:18 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] up:active 2024-09-19T06:10:19.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:18 smithi059 ceph-mon[35138]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-19T06:10:19.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:18 smithi059 ceph-mon[35138]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:10:19.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:18 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] up:active 2024-09-19T06:10:19.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:18 smithi071 ceph-mon[35662]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-19T06:10:19.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:18 smithi071 ceph-mon[35662]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:10:19.782 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:19.780+0000 7f198b400640 1 -- 172.21.15.3:0/1003942177 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v28) ==== 115+0+0 (secure 0 0 0) 0x7f197c0a0b30 con 0x7f1994102360 2024-09-19T06:10:19.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:19.783+0000 7f1993200640 1 -- 172.21.15.3:0/1003942177 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f19780a3240 msgr2=0x7f19780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:19.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:19.783+0000 7f1993200640 1 --2- 172.21.15.3:0/1003942177 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f19780a3240 0x7f19780a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1984009b50 tx=0x7f1984005f90 comp rx=0 tx=0).stop 2024-09-19T06:10:19.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:19.783+0000 7f1993200640 1 -- 172.21.15.3:0/1003942177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1994102360 msgr2=0x7f199419a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:19.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:19.783+0000 7f1993200640 1 --2- 172.21.15.3:0/1003942177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1994102360 0x7f199419a9d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f197c00e9f0 tx=0x7f197c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:10:19.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:19.783+0000 7f1993200640 1 -- 172.21.15.3:0/1003942177 shutdown_connections 2024-09-19T06:10:19.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:19.783+0000 7f1993200640 1 --2- 172.21.15.3:0/1003942177 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f19780a3240 0x7f19780a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:19.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:19.783+0000 7f1993200640 1 --2- 172.21.15.3:0/1003942177 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19941079c0 0x7f199419ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:19.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:19.783+0000 7f1993200640 1 --2- 172.21.15.3:0/1003942177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1994102360 0x7f199419a9d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:19.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:19.783+0000 7f1993200640 1 --2- 172.21.15.3:0/1003942177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19941019c0 0x7f199419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:19.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:19.783+0000 7f1993200640 1 -- 172.21.15.3:0/1003942177 >> 172.21.15.3:0/1003942177 conn(0x7f19940fd740 msgr2=0x7f199410cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:19.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:19.783+0000 7f1993200640 1 -- 172.21.15.3:0/1003942177 shutdown_connections 2024-09-19T06:10:19.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:19.783+0000 7f1993200640 1 -- 172.21.15.3:0/1003942177 wait complete. 2024-09-19T06:10:20.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:19 smithi059 ceph-mon[35138]: pgmap v310: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2024-09-19T06:10:20.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:19 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1003942177' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T06:10:20.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:19 smithi059 ceph-mon[35138]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T06:10:20.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:19 smithi003 ceph-mon[30893]: pgmap v310: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2024-09-19T06:10:20.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:19 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1003942177' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T06:10:20.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:19 smithi003 ceph-mon[30893]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T06:10:20.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:19 smithi071 ceph-mon[35662]: pgmap v310: 97 pgs: 97 active+clean; 582 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2024-09-19T06:10:20.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:19 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1003942177' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T06:10:20.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:19 smithi071 ceph-mon[35662]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T06:10:20.538 INFO:journalctl@ceph.mds.b.smithi059.stdout:Sep 19 06:10:20 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-b[65335]: 2024-09-19T06:10:20.119+0000 7fbe08c3a640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-19T06:10:20.539 INFO:journalctl@ceph.mds.b.smithi059.stdout:Sep 19 06:10:20 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-b[65335]: 2024-09-19T06:10:20.119+0000 7fbe08c3a640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-19T06:10:20.539 INFO:journalctl@ceph.mds.b.smithi059.stdout:Sep 19 06:10:20 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-b[65335]: 2024-09-19T06:10:20.119+0000 7fbe08c3a640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-19T06:10:20.539 INFO:journalctl@ceph.mds.b.smithi059.stdout:Sep 19 06:10:20 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-b[65335]: 2024-09-19T06:10:20.119+0000 7fbe08c3a640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-19T06:10:20.931 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-19T06:10:20.931 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T06:10:21.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:20 smithi059 ceph-mon[35138]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T06:10:21.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:20 smithi059 ceph-mon[35138]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:10:21.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:20 smithi003 ceph-mon[30893]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T06:10:21.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:20 smithi003 ceph-mon[30893]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:10:21.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:20 smithi071 ceph-mon[35662]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T06:10:21.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:20 smithi071 ceph-mon[35662]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:10:21.314 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:21.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.878+0000 7f55c0e00640 1 -- 172.21.15.3:0/1142783457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55bc109120 msgr2=0x7f55bc110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:21.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.878+0000 7f55c0e00640 1 --2- 172.21.15.3:0/1142783457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55bc109120 0x7f55bc110ca0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f55b4009900 tx=0x7f55b402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.878+0000 7f55c0e00640 1 -- 172.21.15.3:0/1142783457 shutdown_connections 2024-09-19T06:10:21.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.878+0000 7f55c0e00640 1 --2- 172.21.15.3:0/1142783457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55bc109120 0x7f55bc110ca0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.878+0000 7f55c0e00640 1 --2- 172.21.15.3:0/1142783457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55bc1049a0 0x7f55bc1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.878+0000 7f55c0e00640 1 --2- 172.21.15.3:0/1142783457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55bc103ff0 0x7f55bc1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.878+0000 7f55c0e00640 1 -- 172.21.15.3:0/1142783457 >> 172.21.15.3:0/1142783457 conn(0x7f55bc0ffa90 msgr2=0x7f55bc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:21.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.878+0000 7f55c0e00640 1 -- 172.21.15.3:0/1142783457 shutdown_connections 2024-09-19T06:10:21.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.878+0000 7f55c0e00640 1 -- 172.21.15.3:0/1142783457 wait complete. 2024-09-19T06:10:21.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.879+0000 7f55c0e00640 1 Processor -- start 2024-09-19T06:10:21.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.879+0000 7f55c0e00640 1 -- start start 2024-09-19T06:10:21.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.880+0000 7f55c0e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55bc103ff0 0x7f55bc19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:21.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.880+0000 7f55c0e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55bc1049a0 0x7f55bc19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:21.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.880+0000 7f55c0e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55bc109120 0x7f55bc19eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:21.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.880+0000 7f55c0e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc1141a0 con 0x7f55bc1049a0 2024-09-19T06:10:21.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.880+0000 7f55c0e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc114020 con 0x7f55bc109120 2024-09-19T06:10:21.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.880+0000 7f55c0e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f55bc114320 con 0x7f55bc103ff0 2024-09-19T06:10:21.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.880+0000 7f55b1400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55bc1049a0 0x7f55bc19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:21.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.880+0000 7f55b1400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55bc1049a0 0x7f55bc19ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55956/0 (socket says 172.21.15.3:55956) 2024-09-19T06:10:21.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.880+0000 7f55b1400640 1 -- 172.21.15.3:0/1534223009 learned_addr learned my addr 172.21.15.3:0/1534223009 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:21.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.880+0000 7f55b9e00640 1 --2- 172.21.15.3:0/1534223009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55bc103ff0 0x7f55bc19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:21.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.880+0000 7f55ba800640 1 --2- 172.21.15.3:0/1534223009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55bc109120 0x7f55bc19eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:21.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.880+0000 7f55b1400640 1 -- 172.21.15.3:0/1534223009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55bc103ff0 msgr2=0x7f55bc19a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:21.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.880+0000 7f55b1400640 1 --2- 172.21.15.3:0/1534223009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55bc103ff0 0x7f55bc19a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.880+0000 7f55b1400640 1 -- 172.21.15.3:0/1534223009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55bc109120 msgr2=0x7f55bc19eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:21.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.880+0000 7f55b1400640 1 --2- 172.21.15.3:0/1534223009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55bc109120 0x7f55bc19eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:21.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.880+0000 7f55b1400640 1 -- 172.21.15.3:0/1534223009 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55bc19f590 con 0x7f55bc1049a0 2024-09-19T06:10:21.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.881+0000 7f55b1400640 1 --2- 172.21.15.3:0/1534223009 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55bc1049a0 0x7f55bc19ab20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f55a400e9f0 tx=0x7f55a400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:21.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.881+0000 7f55b3400640 1 -- 172.21.15.3:0/1534223009 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a400cd80 con 0x7f55bc1049a0 2024-09-19T06:10:21.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.881+0000 7f55b3400640 1 -- 172.21.15.3:0/1534223009 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55a4005500 con 0x7f55bc1049a0 2024-09-19T06:10:21.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.881+0000 7f55c0e00640 1 -- 172.21.15.3:0/1534223009 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55bc19f880 con 0x7f55bc1049a0 2024-09-19T06:10:21.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.881+0000 7f55b3400640 1 -- 172.21.15.3:0/1534223009 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a4010690 con 0x7f55bc1049a0 2024-09-19T06:10:21.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.881+0000 7f55c0e00640 1 -- 172.21.15.3:0/1534223009 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55bc1a7160 con 0x7f55bc1049a0 2024-09-19T06:10:21.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.882+0000 7f55c0e00640 1 -- 172.21.15.3:0/1534223009 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55bc1043d0 con 0x7f55bc1049a0 2024-09-19T06:10:21.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.884+0000 7f55b3400640 1 -- 172.21.15.3:0/1534223009 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f55a40046c0 con 0x7f55bc1049a0 2024-09-19T06:10:21.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.885+0000 7f55b3400640 1 --2- 172.21.15.3:0/1534223009 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f55a00a3240 0x7f55a00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:21.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.885+0000 7f55b3400640 1 -- 172.21.15.3:0/1534223009 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f55a40cfc00 con 0x7f55bc1049a0 2024-09-19T06:10:21.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.886+0000 7f55b9e00640 1 --2- 172.21.15.3:0/1534223009 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f55a00a3240 0x7f55a00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:21.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.886+0000 7f55b9e00640 1 --2- 172.21.15.3:0/1534223009 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f55a00a3240 0x7f55a00a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f55ac005fd0 tx=0x7f55ac009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:21.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:21.890+0000 7f55b3400640 1 -- 172.21.15.3:0/1534223009 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f55a409c9d0 con 0x7f55bc1049a0 2024-09-19T06:10:22.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:21 smithi003 ceph-mon[30893]: pgmap v311: 97 pgs: 97 active+clean; 583 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3.6 KiB/s wr, 13 op/s 2024-09-19T06:10:22.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:21 smithi071 ceph-mon[35662]: pgmap v311: 97 pgs: 97 active+clean; 583 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3.6 KiB/s wr, 13 op/s 2024-09-19T06:10:22.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:22.101+0000 7f55c0e00640 1 -- 172.21.15.3:0/1534223009 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f55bc100cc0 con 0x7f55a00a3240 2024-09-19T06:10:22.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:22.132+0000 7f55b3400640 1 -- 172.21.15.3:0/1534223009 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f55bc100cc0 con 0x7f55a00a3240 2024-09-19T06:10:22.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:22.135+0000 7f55c0e00640 1 -- 172.21.15.3:0/1534223009 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f55a00a3240 msgr2=0x7f55a00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:22.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:22.135+0000 7f55c0e00640 1 --2- 172.21.15.3:0/1534223009 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f55a00a3240 0x7f55a00a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f55ac005fd0 tx=0x7f55ac009500 comp rx=0 tx=0).stop 2024-09-19T06:10:22.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:22.135+0000 7f55c0e00640 1 -- 172.21.15.3:0/1534223009 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55bc1049a0 msgr2=0x7f55bc19ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:22.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:22.135+0000 7f55c0e00640 1 --2- 172.21.15.3:0/1534223009 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55bc1049a0 0x7f55bc19ab20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f55a400e9f0 tx=0x7f55a400edf0 comp rx=0 tx=0).stop 2024-09-19T06:10:22.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:22.135+0000 7f55c0e00640 1 -- 172.21.15.3:0/1534223009 shutdown_connections 2024-09-19T06:10:22.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:22.135+0000 7f55c0e00640 1 --2- 172.21.15.3:0/1534223009 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f55a00a3240 0x7f55a00a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:22.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:22.135+0000 7f55c0e00640 1 --2- 172.21.15.3:0/1534223009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55bc109120 0x7f55bc19eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:22.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:22.135+0000 7f55c0e00640 1 --2- 172.21.15.3:0/1534223009 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55bc1049a0 0x7f55bc19ab20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:22.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:22.135+0000 7f55c0e00640 1 --2- 172.21.15.3:0/1534223009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55bc103ff0 0x7f55bc19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:22.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:22.135+0000 7f55c0e00640 1 -- 172.21.15.3:0/1534223009 >> 172.21.15.3:0/1534223009 conn(0x7f55bc0ffa90 msgr2=0x7f55bc1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:22.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:22.135+0000 7f55c0e00640 1 -- 172.21.15.3:0/1534223009 shutdown_connections 2024-09-19T06:10:22.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:22.135+0000 7f55c0e00640 1 -- 172.21.15.3:0/1534223009 wait complete. 2024-09-19T06:10:22.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:21 smithi059 ceph-mon[35138]: pgmap v311: 97 pgs: 97 active+clean; 583 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3.6 KiB/s wr, 13 op/s 2024-09-19T06:10:22.585 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:10:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:10:22.107+0000 7fe620800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:10:22.585 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:10:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:10:22.107+0000 7fe620800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:10:22.585 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:10:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:10:22.107+0000 7fe620800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:10:22.585 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:10:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:10:22.107+0000 7fe620800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:10:22.585 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:10:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:10:22.107+0000 7fe620800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:10:23.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:22 smithi003 ceph-mon[30893]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:10:23.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:22 smithi071 ceph-mon[35662]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:10:23.216 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T06:10:23.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:22 smithi059 ceph-mon[35138]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:10:23.595 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:24.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:23 smithi003 ceph-mon[30893]: pgmap v312: 97 pgs: 97 active+clean; 584 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-09-19T06:10:24.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:23 smithi003 ceph-mon[30893]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T06:10:24.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:23 smithi071 ceph-mon[35662]: pgmap v312: 97 pgs: 97 active+clean; 584 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-09-19T06:10:24.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:23 smithi071 ceph-mon[35662]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T06:10:24.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:23 smithi059 ceph-mon[35138]: pgmap v312: 97 pgs: 97 active+clean; 584 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-09-19T06:10:24.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:23 smithi059 ceph-mon[35138]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T06:10:24.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.280+0000 7f7bdcc00640 1 -- 172.21.15.3:0/2534332243 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7bd81049a0 msgr2=0x7f7bd81089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:24.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.280+0000 7f7bdcc00640 1 --2- 172.21.15.3:0/2534332243 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7bd81049a0 0x7f7bd81089f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009900 tx=0x7f7bc002a3f0 comp rx=0 tx=0).stop 2024-09-19T06:10:24.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.280+0000 7f7bdcc00640 1 -- 172.21.15.3:0/2534332243 shutdown_connections 2024-09-19T06:10:24.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.280+0000 7f7bdcc00640 1 --2- 172.21.15.3:0/2534332243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bd8109120 0x7f7bd8110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:24.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.280+0000 7f7bdcc00640 1 --2- 172.21.15.3:0/2534332243 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7bd81049a0 0x7f7bd81089f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:24.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.280+0000 7f7bdcc00640 1 --2- 172.21.15.3:0/2534332243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7bd8103ff0 0x7f7bd81043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:24.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.280+0000 7f7bdcc00640 1 -- 172.21.15.3:0/2534332243 >> 172.21.15.3:0/2534332243 conn(0x7f7bd80ffa90 msgr2=0x7f7bd8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:24.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.280+0000 7f7bdcc00640 1 -- 172.21.15.3:0/2534332243 shutdown_connections 2024-09-19T06:10:24.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.280+0000 7f7bdcc00640 1 -- 172.21.15.3:0/2534332243 wait complete. 2024-09-19T06:10:24.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.281+0000 7f7bdcc00640 1 Processor -- start 2024-09-19T06:10:24.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.281+0000 7f7bdcc00640 1 -- start start 2024-09-19T06:10:24.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.281+0000 7f7bdcc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7bd8103ff0 0x7f7bd819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:24.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.281+0000 7f7bdcc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bd81049a0 0x7f7bd819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:24.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.281+0000 7f7bdcc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7bd8109120 0x7f7bd819ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:24.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.281+0000 7f7bdcc00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd8114170 con 0x7f7bd8103ff0 2024-09-19T06:10:24.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.281+0000 7f7bdcc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd8113ff0 con 0x7f7bd81049a0 2024-09-19T06:10:24.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.281+0000 7f7bdcc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd81142f0 con 0x7f7bd8109120 2024-09-19T06:10:24.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.282+0000 7f7bd5e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7bd8103ff0 0x7f7bd819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:24.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.282+0000 7f7bd5e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7bd8103ff0 0x7f7bd819a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32826/0 (socket says 172.21.15.3:32826) 2024-09-19T06:10:24.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.282+0000 7f7bd5e00640 1 -- 172.21.15.3:0/3719525414 learned_addr learned my addr 172.21.15.3:0/3719525414 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:24.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.282+0000 7f7bcd400640 1 --2- 172.21.15.3:0/3719525414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bd81049a0 0x7f7bd819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:24.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.282+0000 7f7bd6800640 1 --2- 172.21.15.3:0/3719525414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7bd8109120 0x7f7bd819ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:24.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.282+0000 7f7bd5e00640 1 -- 172.21.15.3:0/3719525414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7bd8109120 msgr2=0x7f7bd819ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:24.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.282+0000 7f7bd5e00640 1 --2- 172.21.15.3:0/3719525414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7bd8109120 0x7f7bd819ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:24.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.282+0000 7f7bd5e00640 1 -- 172.21.15.3:0/3719525414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bd81049a0 msgr2=0x7f7bd819ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:24.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.282+0000 7f7bd5e00640 1 --2- 172.21.15.3:0/3719525414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bd81049a0 0x7f7bd819ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:24.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.282+0000 7f7bd5e00640 1 -- 172.21.15.3:0/3719525414 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd819f600 con 0x7f7bd8103ff0 2024-09-19T06:10:24.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.282+0000 7f7bd5e00640 1 --2- 172.21.15.3:0/3719525414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7bd8103ff0 0x7f7bd819a650 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800eab0 tx=0x7f7bc800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:24.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.283+0000 7f7bcf400640 1 -- 172.21.15.3:0/3719525414 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc800ce40 con 0x7f7bd8103ff0 2024-09-19T06:10:24.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.283+0000 7f7bcf400640 1 -- 172.21.15.3:0/3719525414 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bc8011950 con 0x7f7bd8103ff0 2024-09-19T06:10:24.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.283+0000 7f7bcf400640 1 -- 172.21.15.3:0/3719525414 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8010ae0 con 0x7f7bd8103ff0 2024-09-19T06:10:24.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.283+0000 7f7bdcc00640 1 -- 172.21.15.3:0/3719525414 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd819f8f0 con 0x7f7bd8103ff0 2024-09-19T06:10:24.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.283+0000 7f7bdcc00640 1 -- 172.21.15.3:0/3719525414 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd81a71d0 con 0x7f7bd8103ff0 2024-09-19T06:10:24.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.284+0000 7f7bdcc00640 1 -- 172.21.15.3:0/3719525414 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bd81043d0 con 0x7f7bd8103ff0 2024-09-19T06:10:24.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.286+0000 7f7bcf400640 1 -- 172.21.15.3:0/3719525414 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f7bc8011b00 con 0x7f7bd8103ff0 2024-09-19T06:10:24.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.287+0000 7f7bcf400640 1 --2- 172.21.15.3:0/3719525414 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f7bbc0a32d0 0x7f7bbc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:24.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.288+0000 7f7bcf400640 1 -- 172.21.15.3:0/3719525414 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f7bc80cfff0 con 0x7f7bd8103ff0 2024-09-19T06:10:24.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.288+0000 7f7bcd400640 1 --2- 172.21.15.3:0/3719525414 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f7bbc0a32d0 0x7f7bbc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:24.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.288+0000 7f7bcd400640 1 --2- 172.21.15.3:0/3719525414 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f7bbc0a32d0 0x7f7bbc0a5790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0000c00 tx=0x7f7bc0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:24.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.292+0000 7f7bcf400640 1 -- 172.21.15.3:0/3719525414 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7bc8016030 con 0x7f7bd8103ff0 2024-09-19T06:10:24.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.504+0000 7f7bdcc00640 1 -- 172.21.15.3:0/3719525414 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f7bd8062630 con 0x7f7bbc0a32d0 2024-09-19T06:10:24.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.532+0000 7f7bcf400640 1 -- 172.21.15.3:0/3719525414 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7bd8062630 con 0x7f7bbc0a32d0 2024-09-19T06:10:24.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.534+0000 7f7bdcc00640 1 -- 172.21.15.3:0/3719525414 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f7bbc0a32d0 msgr2=0x7f7bbc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:24.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.534+0000 7f7bdcc00640 1 --2- 172.21.15.3:0/3719525414 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f7bbc0a32d0 0x7f7bbc0a5790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0000c00 tx=0x7f7bc0005b50 comp rx=0 tx=0).stop 2024-09-19T06:10:24.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.534+0000 7f7bdcc00640 1 -- 172.21.15.3:0/3719525414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7bd8103ff0 msgr2=0x7f7bd819a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:24.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.534+0000 7f7bdcc00640 1 --2- 172.21.15.3:0/3719525414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7bd8103ff0 0x7f7bd819a650 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800eab0 tx=0x7f7bc800ef70 comp rx=0 tx=0).stop 2024-09-19T06:10:24.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.535+0000 7f7bdcc00640 1 -- 172.21.15.3:0/3719525414 shutdown_connections 2024-09-19T06:10:24.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.535+0000 7f7bdcc00640 1 --2- 172.21.15.3:0/3719525414 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f7bbc0a32d0 0x7f7bbc0a5790 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:24.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.535+0000 7f7bdcc00640 1 --2- 172.21.15.3:0/3719525414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7bd8109120 0x7f7bd819ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:24.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.535+0000 7f7bdcc00640 1 --2- 172.21.15.3:0/3719525414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7bd81049a0 0x7f7bd819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:24.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.535+0000 7f7bdcc00640 1 --2- 172.21.15.3:0/3719525414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7bd8103ff0 0x7f7bd819a650 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:24.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.535+0000 7f7bdcc00640 1 -- 172.21.15.3:0/3719525414 >> 172.21.15.3:0/3719525414 conn(0x7f7bd80ffa90 msgr2=0x7f7bd8100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:24.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.535+0000 7f7bdcc00640 1 -- 172.21.15.3:0/3719525414 shutdown_connections 2024-09-19T06:10:24.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:24.535+0000 7f7bdcc00640 1 -- 172.21.15.3:0/3719525414 wait complete. 2024-09-19T06:10:25.498 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T06:10:25.882 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:26.061 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:25 smithi003 ceph-mon[30893]: pgmap v313: 97 pgs: 97 active+clean; 585 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.2 KiB/s wr, 21 op/s 2024-09-19T06:10:26.061 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:25 smithi003 ceph-mon[30893]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:10:26.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:25 smithi071 ceph-mon[35662]: pgmap v313: 97 pgs: 97 active+clean; 585 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.2 KiB/s wr, 21 op/s 2024-09-19T06:10:26.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:25 smithi071 ceph-mon[35662]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:10:26.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:25 smithi059 ceph-mon[35138]: pgmap v313: 97 pgs: 97 active+clean; 585 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.2 KiB/s wr, 21 op/s 2024-09-19T06:10:26.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:25 smithi059 ceph-mon[35138]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:10:26.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.504+0000 7fd2e6400640 1 -- 172.21.15.3:0/2885423481 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2e01019c0 msgr2=0x7fd2e0101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:26.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.504+0000 7fd2e6400640 1 --2- 172.21.15.3:0/2885423481 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2e01019c0 0x7fd2e0101e20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009890 tx=0x7fd2c802a360 comp rx=0 tx=0).stop 2024-09-19T06:10:26.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.504+0000 7fd2e6400640 1 -- 172.21.15.3:0/2885423481 shutdown_connections 2024-09-19T06:10:26.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.504+0000 7fd2e6400640 1 --2- 172.21.15.3:0/2885423481 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2e0102360 0x7fd2e010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:26.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.504+0000 7fd2e6400640 1 --2- 172.21.15.3:0/2885423481 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2e01019c0 0x7fd2e0101e20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:26.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.504+0000 7fd2e6400640 1 --2- 172.21.15.3:0/2885423481 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e01079c0 0x7fd2e0107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:26.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.504+0000 7fd2e6400640 1 -- 172.21.15.3:0/2885423481 >> 172.21.15.3:0/2885423481 conn(0x7fd2e00fd740 msgr2=0x7fd2e00ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:26.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.504+0000 7fd2e6400640 1 -- 172.21.15.3:0/2885423481 shutdown_connections 2024-09-19T06:10:26.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.504+0000 7fd2e6400640 1 -- 172.21.15.3:0/2885423481 wait complete. 2024-09-19T06:10:26.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.505+0000 7fd2e6400640 1 Processor -- start 2024-09-19T06:10:26.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.505+0000 7fd2e6400640 1 -- start start 2024-09-19T06:10:26.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.506+0000 7fd2e6400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2e01019c0 0x7fd2e01982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:26.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.506+0000 7fd2e6400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2e0102360 0x7fd2e01987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:26.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.506+0000 7fd2e6400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e01079c0 0x7fd2e019cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:26.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.506+0000 7fd2e6400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e0111dc0 con 0x7fd2e0102360 2024-09-19T06:10:26.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.506+0000 7fd2e6400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e0111c40 con 0x7fd2e01079c0 2024-09-19T06:10:26.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.506+0000 7fd2e6400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e0111f40 con 0x7fd2e01019c0 2024-09-19T06:10:26.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.506+0000 7fd2e5000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2e01019c0 0x7fd2e01982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:26.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.506+0000 7fd2d7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2e0102360 0x7fd2e01987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:26.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.506+0000 7fd2e5000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2e01019c0 0x7fd2e01982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:60612/0 (socket says 172.21.15.3:60612) 2024-09-19T06:10:26.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.506+0000 7fd2e5000640 1 -- 172.21.15.3:0/969899881 learned_addr learned my addr 172.21.15.3:0/969899881 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:26.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.506+0000 7fd2e5a00640 1 --2- 172.21.15.3:0/969899881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e01079c0 0x7fd2e019cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:26.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.507+0000 7fd2e5000640 1 -- 172.21.15.3:0/969899881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e01079c0 msgr2=0x7fd2e019cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:26.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.507+0000 7fd2e5000640 1 --2- 172.21.15.3:0/969899881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e01079c0 0x7fd2e019cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:26.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.507+0000 7fd2e5000640 1 -- 172.21.15.3:0/969899881 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2e0102360 msgr2=0x7fd2e01987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:26.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.507+0000 7fd2e5000640 1 --2- 172.21.15.3:0/969899881 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2e0102360 0x7fd2e01987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:26.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.507+0000 7fd2e5000640 1 -- 172.21.15.3:0/969899881 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e019d250 con 0x7fd2e01019c0 2024-09-19T06:10:26.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.507+0000 7fd2e5a00640 1 --2- 172.21.15.3:0/969899881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e01079c0 0x7fd2e019cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:26.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.507+0000 7fd2d7e00640 1 --2- 172.21.15.3:0/969899881 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2e0102360 0x7fd2e01987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:26.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.507+0000 7fd2e5000640 1 --2- 172.21.15.3:0/969899881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2e01019c0 0x7fd2e01982a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000e9f0 tx=0x7fd2d000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:26.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.507+0000 7fd2de000640 1 -- 172.21.15.3:0/969899881 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d000cd80 con 0x7fd2e01019c0 2024-09-19T06:10:26.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.507+0000 7fd2e6400640 1 -- 172.21.15.3:0/969899881 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e019d540 con 0x7fd2e01019c0 2024-09-19T06:10:26.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.507+0000 7fd2de000640 1 -- 172.21.15.3:0/969899881 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2d0010910 con 0x7fd2e01019c0 2024-09-19T06:10:26.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.507+0000 7fd2de000640 1 -- 172.21.15.3:0/969899881 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d00188f0 con 0x7fd2e01019c0 2024-09-19T06:10:26.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.507+0000 7fd2e6400640 1 -- 172.21.15.3:0/969899881 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e01a4e20 con 0x7fd2e01019c0 2024-09-19T06:10:26.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.508+0000 7fd2e6400640 1 -- 172.21.15.3:0/969899881 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e0101e20 con 0x7fd2e01019c0 2024-09-19T06:10:26.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.510+0000 7fd2de000640 1 -- 172.21.15.3:0/969899881 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fd2d0010ac0 con 0x7fd2e01019c0 2024-09-19T06:10:26.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.512+0000 7fd2de000640 1 --2- 172.21.15.3:0/969899881 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd2c40a3350 0x7fd2c40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:26.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.512+0000 7fd2de000640 1 -- 172.21.15.3:0/969899881 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fd2d00cffd0 con 0x7fd2e01019c0 2024-09-19T06:10:26.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.512+0000 7fd2d7e00640 1 --2- 172.21.15.3:0/969899881 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd2c40a3350 0x7fd2c40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:26.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.513+0000 7fd2d7e00640 1 --2- 172.21.15.3:0/969899881 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd2c40a3350 0x7fd2c40a5810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd2c802a950 tx=0x7fd2c80056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:26.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.514+0000 7fd2de000640 1 -- 172.21.15.3:0/969899881 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd2d009c5f0 con 0x7fd2e01019c0 2024-09-19T06:10:26.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.735+0000 7fd2e6400640 1 -- 172.21.15.3:0/969899881 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fd2e0062630 con 0x7fd2c40a3350 2024-09-19T06:10:26.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.742+0000 7fd2de000640 1 -- 172.21.15.3:0/969899881 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fd2e0062630 con 0x7fd2c40a3350 2024-09-19T06:10:26.744 INFO:teuthology.orchestra.run.smithi003.stdout:/volumes/qa/sv_0/45b00e4e-9fcb-461a-b4bb-d9bbd6dd0755 2024-09-19T06:10:26.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.744+0000 7fd2e6400640 1 -- 172.21.15.3:0/969899881 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd2c40a3350 msgr2=0x7fd2c40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:26.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.744+0000 7fd2e6400640 1 --2- 172.21.15.3:0/969899881 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd2c40a3350 0x7fd2c40a5810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd2c802a950 tx=0x7fd2c80056d0 comp rx=0 tx=0).stop 2024-09-19T06:10:26.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.744+0000 7fd2e6400640 1 -- 172.21.15.3:0/969899881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2e01019c0 msgr2=0x7fd2e01982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:26.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.744+0000 7fd2e6400640 1 --2- 172.21.15.3:0/969899881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2e01019c0 0x7fd2e01982a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000e9f0 tx=0x7fd2d000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:10:26.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.744+0000 7fd2e6400640 1 -- 172.21.15.3:0/969899881 shutdown_connections 2024-09-19T06:10:26.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.744+0000 7fd2e6400640 1 --2- 172.21.15.3:0/969899881 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd2c40a3350 0x7fd2c40a5810 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:26.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.744+0000 7fd2e6400640 1 --2- 172.21.15.3:0/969899881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2e01079c0 0x7fd2e019cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:26.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.744+0000 7fd2e6400640 1 --2- 172.21.15.3:0/969899881 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2e0102360 0x7fd2e01987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:26.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.744+0000 7fd2e6400640 1 --2- 172.21.15.3:0/969899881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2e01019c0 0x7fd2e01982a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:26.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.744+0000 7fd2e6400640 1 -- 172.21.15.3:0/969899881 >> 172.21.15.3:0/969899881 conn(0x7fd2e00fd740 msgr2=0x7fd2e00fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:26.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.744+0000 7fd2e6400640 1 -- 172.21.15.3:0/969899881 shutdown_connections 2024-09-19T06:10:26.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:26.744+0000 7fd2e6400640 1 -- 172.21.15.3:0/969899881 wait complete. 2024-09-19T06:10:27.559 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T06:10:27.941 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:28.080 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:27 smithi003 ceph-mon[30893]: pgmap v314: 97 pgs: 97 active+clean; 585 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.2 KiB/s wr, 21 op/s 2024-09-19T06:10:28.080 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:27 smithi003 ceph-mon[30893]: from='client.24655 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:10:28.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:27 smithi071 ceph-mon[35662]: pgmap v314: 97 pgs: 97 active+clean; 585 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.2 KiB/s wr, 21 op/s 2024-09-19T06:10:28.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:27 smithi071 ceph-mon[35662]: from='client.24655 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:10:28.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:27 smithi059 ceph-mon[35138]: pgmap v314: 97 pgs: 97 active+clean; 585 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.2 KiB/s wr, 21 op/s 2024-09-19T06:10:28.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:27 smithi059 ceph-mon[35138]: from='client.24655 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:10:28.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.523+0000 7fb0c8200640 1 -- 172.21.15.3:0/2571967137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0c0076720 msgr2=0x7fb0c0076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:28.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.523+0000 7fb0c8200640 1 --2- 172.21.15.3:0/2571967137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0c0076720 0x7fb0c0076b00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4009900 tx=0x7fb0b402a410 comp rx=0 tx=0).stop 2024-09-19T06:10:28.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.524+0000 7fb0c8200640 1 -- 172.21.15.3:0/2571967137 shutdown_connections 2024-09-19T06:10:28.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.524+0000 7fb0c8200640 1 --2- 172.21.15.3:0/2571967137 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0c0112a30 0x7fb0c0114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:28.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.524+0000 7fb0c8200640 1 --2- 172.21.15.3:0/2571967137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0c0077040 0x7fb0c01124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:28.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.524+0000 7fb0c8200640 1 --2- 172.21.15.3:0/2571967137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0c0076720 0x7fb0c0076b00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:28.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.524+0000 7fb0c8200640 1 -- 172.21.15.3:0/2571967137 >> 172.21.15.3:0/2571967137 conn(0x7fb0c00ffa90 msgr2=0x7fb0c0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:28.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.524+0000 7fb0c8200640 1 -- 172.21.15.3:0/2571967137 shutdown_connections 2024-09-19T06:10:28.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.524+0000 7fb0c8200640 1 -- 172.21.15.3:0/2571967137 wait complete. 2024-09-19T06:10:28.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.525+0000 7fb0c8200640 1 Processor -- start 2024-09-19T06:10:28.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.525+0000 7fb0c8200640 1 -- start start 2024-09-19T06:10:28.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.525+0000 7fb0c8200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0c0076720 0x7fb0c01a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:28.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.525+0000 7fb0c8200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0c0077040 0x7fb0c01a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:28.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.525+0000 7fb0c8200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0c0112a30 0x7fb0c019e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:28.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.525+0000 7fb0c8200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c01185c0 con 0x7fb0c0077040 2024-09-19T06:10:28.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.525+0000 7fb0c8200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c0118440 con 0x7fb0c0076720 2024-09-19T06:10:28.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.525+0000 7fb0c8200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c0118740 con 0x7fb0c0112a30 2024-09-19T06:10:28.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.525+0000 7fb0c4e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0c0077040 0x7fb0c01a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:28.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.525+0000 7fb0c5800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0c0076720 0x7fb0c01a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:28.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.525+0000 7fb0c5800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0c0076720 0x7fb0c01a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44384/0 (socket says 172.21.15.3:44384) 2024-09-19T06:10:28.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.525+0000 7fb0c4e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0c0077040 0x7fb0c01a4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32868/0 (socket says 172.21.15.3:32868) 2024-09-19T06:10:28.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.527+0000 7fb0c5800640 1 -- 172.21.15.3:0/1942475021 learned_addr learned my addr 172.21.15.3:0/1942475021 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:28.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.527+0000 7fb0c6200640 1 --2- 172.21.15.3:0/1942475021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0c0112a30 0x7fb0c019e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:28.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.527+0000 7fb0c5800640 1 -- 172.21.15.3:0/1942475021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0c0112a30 msgr2=0x7fb0c019e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:28.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.527+0000 7fb0c5800640 1 --2- 172.21.15.3:0/1942475021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0c0112a30 0x7fb0c019e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:28.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.527+0000 7fb0c5800640 1 -- 172.21.15.3:0/1942475021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0c0077040 msgr2=0x7fb0c01a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.527+0000 7fb0c5800640 1 --2- 172.21.15.3:0/1942475021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0c0077040 0x7fb0c01a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.527+0000 7fb0c5800640 1 -- 172.21.15.3:0/1942475021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c019efc0 con 0x7fb0c0076720 2024-09-19T06:10:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.527+0000 7fb0c5800640 1 --2- 172.21.15.3:0/1942475021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0c0076720 0x7fb0c01a46d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4006010 tx=0x7fb0b4004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.527+0000 7fb0be000640 1 -- 172.21.15.3:0/1942475021 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b403f030 con 0x7fb0c0076720 2024-09-19T06:10:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.527+0000 7fb0be000640 1 -- 172.21.15.3:0/1942475021 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0b4004440 con 0x7fb0c0076720 2024-09-19T06:10:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.527+0000 7fb0c8200640 1 -- 172.21.15.3:0/1942475021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0c019f250 con 0x7fb0c0076720 2024-09-19T06:10:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.527+0000 7fb0be000640 1 -- 172.21.15.3:0/1942475021 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b4035070 con 0x7fb0c0076720 2024-09-19T06:10:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.527+0000 7fb0c8200640 1 -- 172.21.15.3:0/1942475021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0c01ab5a0 con 0x7fb0c0076720 2024-09-19T06:10:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.528+0000 7fb0c8200640 1 -- 172.21.15.3:0/1942475021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0c0076b00 con 0x7fb0c0076720 2024-09-19T06:10:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.531+0000 7fb0be000640 1 -- 172.21.15.3:0/1942475021 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fb0b4042030 con 0x7fb0c0076720 2024-09-19T06:10:28.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.532+0000 7fb0be000640 1 --2- 172.21.15.3:0/1942475021 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fb0a80a32d0 0x7fb0a80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:28.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.533+0000 7fb0be000640 1 -- 172.21.15.3:0/1942475021 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fb0b40efc30 con 0x7fb0c0076720 2024-09-19T06:10:28.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.533+0000 7fb0c4e00640 1 --2- 172.21.15.3:0/1942475021 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fb0a80a32d0 0x7fb0a80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:28.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.533+0000 7fb0c4e00640 1 --2- 172.21.15.3:0/1942475021 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fb0a80a32d0 0x7fb0a80a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0079300 tx=0x7fb0ac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:28.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.537+0000 7fb0be000640 1 -- 172.21.15.3:0/1942475021 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb0b40bc8a0 con 0x7fb0c0076720 2024-09-19T06:10:28.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.749+0000 7fb0c8200640 1 -- 172.21.15.3:0/1942475021 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fb0c01146a0 con 0x7fb0a80a32d0 2024-09-19T06:10:28.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.774+0000 7fb0be000640 1 -- 172.21.15.3:0/1942475021 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb0c01146a0 con 0x7fb0a80a32d0 2024-09-19T06:10:28.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.777+0000 7fb0c8200640 1 -- 172.21.15.3:0/1942475021 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fb0a80a32d0 msgr2=0x7fb0a80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:28.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.777+0000 7fb0c8200640 1 --2- 172.21.15.3:0/1942475021 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fb0a80a32d0 0x7fb0a80a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0079300 tx=0x7fb0ac005f90 comp rx=0 tx=0).stop 2024-09-19T06:10:28.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.777+0000 7fb0c8200640 1 -- 172.21.15.3:0/1942475021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0c0076720 msgr2=0x7fb0c01a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:28.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.777+0000 7fb0c8200640 1 --2- 172.21.15.3:0/1942475021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0c0076720 0x7fb0c01a46d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4006010 tx=0x7fb0b4004040 comp rx=0 tx=0).stop 2024-09-19T06:10:28.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.777+0000 7fb0c8200640 1 -- 172.21.15.3:0/1942475021 shutdown_connections 2024-09-19T06:10:28.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.777+0000 7fb0c8200640 1 --2- 172.21.15.3:0/1942475021 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fb0a80a32d0 0x7fb0a80a5790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:28.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.777+0000 7fb0c8200640 1 --2- 172.21.15.3:0/1942475021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb0c0112a30 0x7fb0c019e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:28.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.777+0000 7fb0c8200640 1 --2- 172.21.15.3:0/1942475021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0c0077040 0x7fb0c01a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:28.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.777+0000 7fb0c8200640 1 --2- 172.21.15.3:0/1942475021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0c0076720 0x7fb0c01a46d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:28.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.777+0000 7fb0c8200640 1 -- 172.21.15.3:0/1942475021 >> 172.21.15.3:0/1942475021 conn(0x7fb0c00ffa90 msgr2=0x7fb0c0101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:28.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.777+0000 7fb0c8200640 1 -- 172.21.15.3:0/1942475021 shutdown_connections 2024-09-19T06:10:28.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:28.777+0000 7fb0c8200640 1 -- 172.21.15.3:0/1942475021 wait complete. 2024-09-19T06:10:29.618 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T06:10:29.828 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:29 smithi003 ceph-mon[30893]: pgmap v315: 97 pgs: 97 active+clean; 610 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.9 KiB/s wr, 23 op/s 2024-09-19T06:10:29.829 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:29 smithi003 ceph-mon[30893]: from='client.24653 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:10:30.008 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:30.061 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:29 smithi059 ceph-mon[35138]: pgmap v315: 97 pgs: 97 active+clean; 610 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.9 KiB/s wr, 23 op/s 2024-09-19T06:10:30.061 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:29 smithi059 ceph-mon[35138]: from='client.24653 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:10:30.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:29 smithi071 ceph-mon[35662]: pgmap v315: 97 pgs: 97 active+clean; 610 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.9 KiB/s wr, 23 op/s 2024-09-19T06:10:30.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:29 smithi071 ceph-mon[35662]: from='client.24653 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:10:30.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.582+0000 7f5bba600640 1 -- 172.21.15.3:0/258861179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bb4109140 msgr2=0x7f5bb4110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:30.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.582+0000 7f5bba600640 1 --2- 172.21.15.3:0/258861179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bb4109140 0x7f5bb4110cc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5bac009860 tx=0x7f5bac02a340 comp rx=0 tx=0).stop 2024-09-19T06:10:30.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.582+0000 7f5bba600640 1 -- 172.21.15.3:0/258861179 shutdown_connections 2024-09-19T06:10:30.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.582+0000 7f5bba600640 1 --2- 172.21.15.3:0/258861179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bb4109140 0x7f5bb4110cc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:30.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.582+0000 7f5bba600640 1 --2- 172.21.15.3:0/258861179 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bb41049c0 0x7f5bb4108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:30.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.582+0000 7f5bba600640 1 --2- 172.21.15.3:0/258861179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bb4104010 0x7f5bb41043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:30.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.582+0000 7f5bba600640 1 -- 172.21.15.3:0/258861179 >> 172.21.15.3:0/258861179 conn(0x7f5bb40ffa50 msgr2=0x7f5bb4101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:30.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.582+0000 7f5bba600640 1 -- 172.21.15.3:0/258861179 shutdown_connections 2024-09-19T06:10:30.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.582+0000 7f5bba600640 1 -- 172.21.15.3:0/258861179 wait complete. 2024-09-19T06:10:30.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.583+0000 7f5bba600640 1 Processor -- start 2024-09-19T06:10:30.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.583+0000 7f5bba600640 1 -- start start 2024-09-19T06:10:30.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.583+0000 7f5bba600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bb4104010 0x7f5bb419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:30.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.583+0000 7f5bba600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bb41049c0 0x7f5bb419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:30.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.583+0000 7f5bba600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bb4109140 0x7f5bb419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:30.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.584+0000 7f5bba600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb4114150 con 0x7f5bb41049c0 2024-09-19T06:10:30.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.584+0000 7f5bba600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb4113fd0 con 0x7f5bb4104010 2024-09-19T06:10:30.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.584+0000 7f5bba600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb41142d0 con 0x7f5bb4109140 2024-09-19T06:10:30.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.584+0000 7f5bb3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bb4104010 0x7f5bb419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:30.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.584+0000 7f5baaa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bb41049c0 0x7f5bb419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:30.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.584+0000 7f5bb3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bb4104010 0x7f5bb419a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44400/0 (socket says 172.21.15.3:44400) 2024-09-19T06:10:30.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.584+0000 7f5bb3400640 1 -- 172.21.15.3:0/1683744347 learned_addr learned my addr 172.21.15.3:0/1683744347 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:30.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.584+0000 7f5bb3e00640 1 --2- 172.21.15.3:0/1683744347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bb4109140 0x7f5bb419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:30.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.584+0000 7f5baaa00640 1 -- 172.21.15.3:0/1683744347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bb4109140 msgr2=0x7f5bb419eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:30.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.584+0000 7f5baaa00640 1 --2- 172.21.15.3:0/1683744347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bb4109140 0x7f5bb419eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:30.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.584+0000 7f5baaa00640 1 -- 172.21.15.3:0/1683744347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bb4104010 msgr2=0x7f5bb419a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:30.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.584+0000 7f5baaa00640 1 --2- 172.21.15.3:0/1683744347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bb4104010 0x7f5bb419a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:30.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.584+0000 7f5baaa00640 1 -- 172.21.15.3:0/1683744347 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb419f5c0 con 0x7f5bb41049c0 2024-09-19T06:10:30.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.584+0000 7f5bb3400640 1 --2- 172.21.15.3:0/1683744347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bb4104010 0x7f5bb419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:30.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.584+0000 7f5baaa00640 1 --2- 172.21.15.3:0/1683744347 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bb41049c0 0x7f5bb419ab50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c005fd0 tx=0x7f5b9c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:30.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.585+0000 7f5bb0c00640 1 -- 172.21.15.3:0/1683744347 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c00cd00 con 0x7f5bb41049c0 2024-09-19T06:10:30.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.585+0000 7f5bba600640 1 -- 172.21.15.3:0/1683744347 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb419f8b0 con 0x7f5bb41049c0 2024-09-19T06:10:30.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.585+0000 7f5bb0c00640 1 -- 172.21.15.3:0/1683744347 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b9c0035f0 con 0x7f5bb41049c0 2024-09-19T06:10:30.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.585+0000 7f5bb0c00640 1 -- 172.21.15.3:0/1683744347 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c010670 con 0x7f5bb41049c0 2024-09-19T06:10:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.585+0000 7f5bba600640 1 -- 172.21.15.3:0/1683744347 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb41a7190 con 0x7f5bb41049c0 2024-09-19T06:10:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.586+0000 7f5bba600640 1 -- 172.21.15.3:0/1683744347 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bb41043f0 con 0x7f5bb41049c0 2024-09-19T06:10:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.588+0000 7f5bb0c00640 1 -- 172.21.15.3:0/1683744347 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f5b9c0037a0 con 0x7f5bb41049c0 2024-09-19T06:10:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.589+0000 7f5bb0c00640 1 --2- 172.21.15.3:0/1683744347 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5b980a32d0 0x7f5b980a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.589+0000 7f5bb0c00640 1 -- 172.21.15.3:0/1683744347 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f5b9c0cfb40 con 0x7f5bb41049c0 2024-09-19T06:10:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.589+0000 7f5bb3400640 1 --2- 172.21.15.3:0/1683744347 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5b980a32d0 0x7f5b980a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.590+0000 7f5bb3400640 1 --2- 172.21.15.3:0/1683744347 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5b980a32d0 0x7f5b980a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5ba400f7d0 tx=0x7f5ba4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.593+0000 7f5bb0c00640 1 -- 172.21.15.3:0/1683744347 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5b9c009510 con 0x7f5bb41049c0 2024-09-19T06:10:30.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.808+0000 7f5bba600640 1 -- 172.21.15.3:0/1683744347 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f5bb4062630 con 0x7f5b980a32d0 2024-09-19T06:10:30.817 INFO:teuthology.orchestra.run.smithi003.stdout:/volumes/qa/sv_1/b4db2566-1936-4ff9-9108-adaa0f4d33e3 2024-09-19T06:10:30.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.815+0000 7f5bb0c00640 1 -- 172.21.15.3:0/1683744347 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f5bb4062630 con 0x7f5b980a32d0 2024-09-19T06:10:30.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.818+0000 7f5bba600640 1 -- 172.21.15.3:0/1683744347 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5b980a32d0 msgr2=0x7f5b980a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:30.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.818+0000 7f5bba600640 1 --2- 172.21.15.3:0/1683744347 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5b980a32d0 0x7f5b980a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5ba400f7d0 tx=0x7f5ba4009500 comp rx=0 tx=0).stop 2024-09-19T06:10:30.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.818+0000 7f5bba600640 1 -- 172.21.15.3:0/1683744347 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bb41049c0 msgr2=0x7f5bb419ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:30.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.818+0000 7f5bba600640 1 --2- 172.21.15.3:0/1683744347 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bb41049c0 0x7f5bb419ab50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c005fd0 tx=0x7f5b9c00ee50 comp rx=0 tx=0).stop 2024-09-19T06:10:30.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.819+0000 7f5bba600640 1 -- 172.21.15.3:0/1683744347 shutdown_connections 2024-09-19T06:10:30.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.819+0000 7f5bba600640 1 --2- 172.21.15.3:0/1683744347 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5b980a32d0 0x7f5b980a5790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:30.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.819+0000 7f5bba600640 1 --2- 172.21.15.3:0/1683744347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5bb4109140 0x7f5bb419eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:30.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.819+0000 7f5bba600640 1 --2- 172.21.15.3:0/1683744347 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5bb41049c0 0x7f5bb419ab50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:30.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.819+0000 7f5bba600640 1 --2- 172.21.15.3:0/1683744347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bb4104010 0x7f5bb419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:30.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.819+0000 7f5bba600640 1 -- 172.21.15.3:0/1683744347 >> 172.21.15.3:0/1683744347 conn(0x7f5bb40ffa50 msgr2=0x7f5bb4100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:30.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.820+0000 7f5bba600640 1 -- 172.21.15.3:0/1683744347 shutdown_connections 2024-09-19T06:10:30.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:30.820+0000 7f5bba600640 1 -- 172.21.15.3:0/1683744347 wait complete. 2024-09-19T06:10:31.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:30 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-19T06:10:31.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:30 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-19T06:10:31.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:30 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-09-19T06:10:31.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:30 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]: dispatch 2024-09-19T06:10:31.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:30 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-09-19T06:10:31.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:30 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-19T06:10:31.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:30 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-09-19T06:10:31.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:30 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-19T06:10:31.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:30 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-19T06:10:31.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:30 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-19T06:10:31.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:30 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-19T06:10:31.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:30 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-19T06:10:31.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:30 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-09-19T06:10:31.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:30 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]: dispatch 2024-09-19T06:10:31.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:30 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-09-19T06:10:31.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:30 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-19T06:10:31.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:30 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-09-19T06:10:31.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:30 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-19T06:10:31.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:30 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-19T06:10:31.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:30 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-19T06:10:31.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:30 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-19T06:10:31.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:30 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-19T06:10:31.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:30 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]: dispatch 2024-09-19T06:10:31.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:30 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]: dispatch 2024-09-19T06:10:31.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:30 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-09-19T06:10:31.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:30 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-19T06:10:31.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:30 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-09-19T06:10:31.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:30 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-19T06:10:31.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:30 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-19T06:10:31.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:30 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2024-09-19T06:10:31.594 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:10:31.986 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:32.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:31 smithi003 ceph-mon[30893]: pgmap v316: 97 pgs: 97 active+clean; 610 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.1 KiB/s wr, 17 op/s 2024-09-19T06:10:32.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:31 smithi003 ceph-mon[30893]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:10:32.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:31 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-19T06:10:32.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:31 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-19T06:10:32.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:31 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-19T06:10:32.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:31 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]': finished 2024-09-19T06:10:32.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:31 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-19T06:10:32.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:31 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-19T06:10:32.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:31 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-09-19T06:10:32.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:31 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-19T06:10:32.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:31 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-19T06:10:32.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:31 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-19T06:10:32.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:31 smithi003 ceph-mon[30893]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T06:10:32.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:31 smithi071 ceph-mon[35662]: pgmap v316: 97 pgs: 97 active+clean; 610 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.1 KiB/s wr, 17 op/s 2024-09-19T06:10:32.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:31 smithi071 ceph-mon[35662]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:10:32.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:31 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-19T06:10:32.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:31 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-19T06:10:32.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:31 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-19T06:10:32.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:31 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]': finished 2024-09-19T06:10:32.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:31 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-19T06:10:32.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:31 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-19T06:10:32.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:31 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-09-19T06:10:32.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:31 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-19T06:10:32.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:31 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-19T06:10:32.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:31 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-19T06:10:32.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:31 smithi071 ceph-mon[35662]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T06:10:32.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:31 smithi059 ceph-mon[35138]: pgmap v316: 97 pgs: 97 active+clean; 610 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.1 KiB/s wr, 17 op/s 2024-09-19T06:10:32.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:31 smithi059 ceph-mon[35138]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:10:32.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:31 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-19T06:10:32.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:31 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-19T06:10:32.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:31 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2024-09-19T06:10:32.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:31 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [5, 11]}]': finished 2024-09-19T06:10:32.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:31 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-19T06:10:32.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:31 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-19T06:10:32.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:31 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-09-19T06:10:32.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:31 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-19T06:10:32.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:31 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-19T06:10:32.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:31 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-19T06:10:32.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:31 smithi059 ceph-mon[35138]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T06:10:32.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.670+0000 7fd1a9800640 1 -- 172.21.15.3:0/2547730426 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1a4112870 msgr2=0x7fd1a4114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:32.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.670+0000 7fd1a9800640 1 --2- 172.21.15.3:0/2547730426 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1a4112870 0x7fd1a4114c60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd19c009ca0 tx=0x7fd19c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:10:32.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.670+0000 7fd1a9800640 1 -- 172.21.15.3:0/2547730426 shutdown_connections 2024-09-19T06:10:32.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.670+0000 7fd1a9800640 1 --2- 172.21.15.3:0/2547730426 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1a4112870 0x7fd1a4114c60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:32.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.670+0000 7fd1a9800640 1 --2- 172.21.15.3:0/2547730426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1a4077040 0x7fd1a4112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:32.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.670+0000 7fd1a9800640 1 --2- 172.21.15.3:0/2547730426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1a4076720 0x7fd1a4076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:32.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.670+0000 7fd1a9800640 1 -- 172.21.15.3:0/2547730426 >> 172.21.15.3:0/2547730426 conn(0x7fd1a40ff8d0 msgr2=0x7fd1a4101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:32.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.671+0000 7fd1a9800640 1 -- 172.21.15.3:0/2547730426 shutdown_connections 2024-09-19T06:10:32.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.671+0000 7fd1a9800640 1 -- 172.21.15.3:0/2547730426 wait complete. 2024-09-19T06:10:32.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.672+0000 7fd1a9800640 1 Processor -- start 2024-09-19T06:10:32.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.672+0000 7fd1a9800640 1 -- start start 2024-09-19T06:10:32.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.672+0000 7fd1a9800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1a4076720 0x7fd1a41a45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:32.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.673+0000 7fd1a9800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1a4077040 0x7fd1a41a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:32.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.673+0000 7fd1a9800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1a4112870 0x7fd1a419e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:32.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.673+0000 7fd1a9800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a4118400 con 0x7fd1a4077040 2024-09-19T06:10:32.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.673+0000 7fd1a9800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a4118280 con 0x7fd1a4112870 2024-09-19T06:10:32.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.673+0000 7fd1a9800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a4118580 con 0x7fd1a4076720 2024-09-19T06:10:32.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.673+0000 7fd1a3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1a4077040 0x7fd1a41a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:32.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.673+0000 7fd1a3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1a4077040 0x7fd1a41a4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32924/0 (socket says 172.21.15.3:32924) 2024-09-19T06:10:32.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.673+0000 7fd1a3400640 1 -- 172.21.15.3:0/1868713054 learned_addr learned my addr 172.21.15.3:0/1868713054 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:32.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.673+0000 7fd1a3e00640 1 --2- 172.21.15.3:0/1868713054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1a4076720 0x7fd1a41a45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:32.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.673+0000 7fd1a8e00640 1 --2- 172.21.15.3:0/1868713054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1a4112870 0x7fd1a419e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:32.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.673+0000 7fd1a3400640 1 -- 172.21.15.3:0/1868713054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1a4076720 msgr2=0x7fd1a41a45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:32.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.673+0000 7fd1a3400640 1 --2- 172.21.15.3:0/1868713054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1a4076720 0x7fd1a41a45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:32.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.673+0000 7fd1a3400640 1 -- 172.21.15.3:0/1868713054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1a4112870 msgr2=0x7fd1a419e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:32.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.673+0000 7fd1a3400640 1 --2- 172.21.15.3:0/1868713054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1a4112870 0x7fd1a419e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:32.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.673+0000 7fd1a3400640 1 -- 172.21.15.3:0/1868713054 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a419ef20 con 0x7fd1a4077040 2024-09-19T06:10:32.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.674+0000 7fd1a3400640 1 --2- 172.21.15.3:0/1868713054 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1a4077040 0x7fd1a41a4b20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd19000d950 tx=0x7fd19000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:32.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.674+0000 7fd1a0c00640 1 -- 172.21.15.3:0/1868713054 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd190017070 con 0x7fd1a4077040 2024-09-19T06:10:32.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.674+0000 7fd1a0c00640 1 -- 172.21.15.3:0/1868713054 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd190009c30 con 0x7fd1a4077040 2024-09-19T06:10:32.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.674+0000 7fd1a9800640 1 -- 172.21.15.3:0/1868713054 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1a419f210 con 0x7fd1a4077040 2024-09-19T06:10:32.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.674+0000 7fd1a0c00640 1 -- 172.21.15.3:0/1868713054 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19000f6b0 con 0x7fd1a4077040 2024-09-19T06:10:32.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.674+0000 7fd1a9800640 1 -- 172.21.15.3:0/1868713054 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1a41ab560 con 0x7fd1a4077040 2024-09-19T06:10:32.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.675+0000 7fd1a9800640 1 -- 172.21.15.3:0/1868713054 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1a419f580 con 0x7fd1a4077040 2024-09-19T06:10:32.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.678+0000 7fd1a0c00640 1 -- 172.21.15.3:0/1868713054 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fd1900109d0 con 0x7fd1a4077040 2024-09-19T06:10:32.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.679+0000 7fd1a0c00640 1 --2- 172.21.15.3:0/1868713054 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd1880a32d0 0x7fd1880a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:32.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.679+0000 7fd1a0c00640 1 -- 172.21.15.3:0/1868713054 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fd1900cf9b0 con 0x7fd1a4077040 2024-09-19T06:10:32.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.679+0000 7fd1a3e00640 1 --2- 172.21.15.3:0/1868713054 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd1880a32d0 0x7fd1880a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:32.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.680+0000 7fd1a3e00640 1 --2- 172.21.15.3:0/1868713054 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd1880a32d0 0x7fd1880a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd1940095f0 tx=0x7fd194005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:32.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.684+0000 7fd1a0c00640 1 -- 172.21.15.3:0/1868713054 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd190009de0 con 0x7fd1a4077040 2024-09-19T06:10:32.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.906+0000 7fd1a9800640 1 -- 172.21.15.3:0/1868713054 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd1a4077e60 con 0x7fd1a4077040 2024-09-19T06:10:32.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.908+0000 7fd1a0c00640 1 -- 172.21.15.3:0/1868713054 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11941 (secure 0 0 0) 0x7fd19009bea0 con 0x7fd1a4077040 2024-09-19T06:10:32.910 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:10:32.910 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":28,"btime":"2024-09-19T06:10:19:770544+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:10:18.878479+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[14517,24514,24515,24532,24557]},"id":1}]} 2024-09-19T06:10:32.910 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 28 2024-09-19T06:10:32.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.911+0000 7fd1a9800640 1 -- 172.21.15.3:0/1868713054 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd1880a32d0 msgr2=0x7fd1880a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:32.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.911+0000 7fd1a9800640 1 --2- 172.21.15.3:0/1868713054 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd1880a32d0 0x7fd1880a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd1940095f0 tx=0x7fd194005f90 comp rx=0 tx=0).stop 2024-09-19T06:10:32.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.911+0000 7fd1a9800640 1 -- 172.21.15.3:0/1868713054 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1a4077040 msgr2=0x7fd1a41a4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:32.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.911+0000 7fd1a9800640 1 --2- 172.21.15.3:0/1868713054 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1a4077040 0x7fd1a41a4b20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd19000d950 tx=0x7fd19000de10 comp rx=0 tx=0).stop 2024-09-19T06:10:32.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.911+0000 7fd1a9800640 1 -- 172.21.15.3:0/1868713054 shutdown_connections 2024-09-19T06:10:32.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.911+0000 7fd1a9800640 1 --2- 172.21.15.3:0/1868713054 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd1880a32d0 0x7fd1880a5790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:32.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.911+0000 7fd1a9800640 1 --2- 172.21.15.3:0/1868713054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1a4112870 0x7fd1a419e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:32.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.911+0000 7fd1a9800640 1 --2- 172.21.15.3:0/1868713054 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd1a4077040 0x7fd1a41a4b20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:32.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.911+0000 7fd1a9800640 1 --2- 172.21.15.3:0/1868713054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd1a4076720 0x7fd1a41a45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:32.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.911+0000 7fd1a9800640 1 -- 172.21.15.3:0/1868713054 >> 172.21.15.3:0/1868713054 conn(0x7fd1a40ff8d0 msgr2=0x7fd1a4101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:32.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.911+0000 7fd1a9800640 1 -- 172.21.15.3:0/1868713054 shutdown_connections 2024-09-19T06:10:32.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:32.911+0000 7fd1a9800640 1 -- 172.21.15.3:0/1868713054 wait complete. 2024-09-19T06:10:32.926 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:32 smithi003 ceph-mon[30893]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T06:10:33.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:32 smithi071 ceph-mon[35662]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T06:10:33.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:32 smithi059 ceph-mon[35138]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T06:10:33.732 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:10:34.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:33 smithi003 ceph-mon[30893]: pgmap v319: 97 pgs: 3 peering, 94 active+clean; 633 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 KiB/s wr, 12 op/s; 146 B/s, 0 objects/s recovering 2024-09-19T06:10:34.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:33 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1868713054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:10:34.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:33 smithi071 ceph-mon[35662]: pgmap v319: 97 pgs: 3 peering, 94 active+clean; 633 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 KiB/s wr, 12 op/s; 146 B/s, 0 objects/s recovering 2024-09-19T06:10:34.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:33 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1868713054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:10:34.114 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:34.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:33 smithi059 ceph-mon[35138]: pgmap v319: 97 pgs: 3 peering, 94 active+clean; 633 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 KiB/s wr, 12 op/s; 146 B/s, 0 objects/s recovering 2024-09-19T06:10:34.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:33 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1868713054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:10:34.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.714+0000 7f089fe00640 1 -- 172.21.15.3:0/240545857 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f08a01047e0 msgr2=0x7f08a0108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:34.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.714+0000 7f089fe00640 1 --2- 172.21.15.3:0/240545857 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f08a01047e0 0x7f08a0108830 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0888009900 tx=0x7f088802a410 comp rx=0 tx=0).stop 2024-09-19T06:10:34.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.714+0000 7f089fe00640 1 -- 172.21.15.3:0/240545857 shutdown_connections 2024-09-19T06:10:34.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.714+0000 7f089fe00640 1 --2- 172.21.15.3:0/240545857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08a0108f60 0x7f08a0110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.714+0000 7f089fe00640 1 --2- 172.21.15.3:0/240545857 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f08a01047e0 0x7f08a0108830 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.714+0000 7f089fe00640 1 --2- 172.21.15.3:0/240545857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08a0103e30 0x7f08a0104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.714+0000 7f089fe00640 1 -- 172.21.15.3:0/240545857 >> 172.21.15.3:0/240545857 conn(0x7f08a00ff910 msgr2=0x7f08a0101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:34.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.714+0000 7f089fe00640 1 -- 172.21.15.3:0/240545857 shutdown_connections 2024-09-19T06:10:34.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.714+0000 7f089fe00640 1 -- 172.21.15.3:0/240545857 wait complete. 2024-09-19T06:10:34.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.715+0000 7f089fe00640 1 Processor -- start 2024-09-19T06:10:34.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.715+0000 7f089fe00640 1 -- start start 2024-09-19T06:10:34.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.715+0000 7f089fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08a0103e30 0x7f08a019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:34.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.715+0000 7f089fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08a01047e0 0x7f08a019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:34.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.715+0000 7f089fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f08a0108f60 0x7f08a019ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:34.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.715+0000 7f089fe00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f08a0113fc0 con 0x7f08a0108f60 2024-09-19T06:10:34.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.715+0000 7f089fe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f08a0113e40 con 0x7f08a0103e30 2024-09-19T06:10:34.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.715+0000 7f089fe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f08a0114140 con 0x7f08a01047e0 2024-09-19T06:10:34.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.716+0000 7f089ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08a0103e30 0x7f08a019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:34.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.716+0000 7f089ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08a0103e30 0x7f08a019a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:45190/0 (socket says 172.21.15.3:45190) 2024-09-19T06:10:34.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.716+0000 7f089ea00640 1 -- 172.21.15.3:0/2727207060 learned_addr learned my addr 172.21.15.3:0/2727207060 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:34.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.716+0000 7f089f400640 1 --2- 172.21.15.3:0/2727207060 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f08a0108f60 0x7f08a019ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:34.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.716+0000 7f0897e00640 1 --2- 172.21.15.3:0/2727207060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08a01047e0 0x7f08a019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:34.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.716+0000 7f089ea00640 1 -- 172.21.15.3:0/2727207060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08a01047e0 msgr2=0x7f08a019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:34.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.716+0000 7f089ea00640 1 --2- 172.21.15.3:0/2727207060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08a01047e0 0x7f08a019aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.716+0000 7f089ea00640 1 -- 172.21.15.3:0/2727207060 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f08a0108f60 msgr2=0x7f08a019ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.716+0000 7f089ea00640 1 --2- 172.21.15.3:0/2727207060 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f08a0108f60 0x7f08a019ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.716+0000 7f089ea00640 1 -- 172.21.15.3:0/2727207060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a019f470 con 0x7f08a0103e30 2024-09-19T06:10:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.716+0000 7f089ea00640 1 --2- 172.21.15.3:0/2727207060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08a0103e30 0x7f08a019a4c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f089000e9f0 tx=0x7f089000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.717+0000 7f0897400640 1 -- 172.21.15.3:0/2727207060 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089000cd80 con 0x7f08a0103e30 2024-09-19T06:10:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.717+0000 7f089fe00640 1 -- 172.21.15.3:0/2727207060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a019f760 con 0x7f08a0103e30 2024-09-19T06:10:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.717+0000 7f0897400640 1 -- 172.21.15.3:0/2727207060 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0890010910 con 0x7f08a0103e30 2024-09-19T06:10:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.717+0000 7f0897400640 1 -- 172.21.15.3:0/2727207060 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08900188f0 con 0x7f08a0103e30 2024-09-19T06:10:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.717+0000 7f089fe00640 1 -- 172.21.15.3:0/2727207060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a01a7040 con 0x7f08a0103e30 2024-09-19T06:10:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.718+0000 7f089fe00640 1 -- 172.21.15.3:0/2727207060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08a0105310 con 0x7f08a0103e30 2024-09-19T06:10:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.720+0000 7f0897400640 1 -- 172.21.15.3:0/2727207060 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f0890010ac0 con 0x7f08a0103e30 2024-09-19T06:10:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.721+0000 7f0897400640 1 --2- 172.21.15.3:0/2727207060 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f08840a32d0 0x7f08840a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.721+0000 7f0897400640 1 -- 172.21.15.3:0/2727207060 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f08900d02b0 con 0x7f08a0103e30 2024-09-19T06:10:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.722+0000 7f0897e00640 1 --2- 172.21.15.3:0/2727207060 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f08840a32d0 0x7f08840a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:34.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.722+0000 7f0897e00640 1 --2- 172.21.15.3:0/2727207060 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f08840a32d0 0x7f08840a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0888009230 tx=0x7f08880058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:34.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.723+0000 7f0897400640 1 -- 172.21.15.3:0/2727207060 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f089009c7a0 con 0x7f08a0103e30 2024-09-19T06:10:34.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.912+0000 7f089fe00640 1 -- 172.21.15.3:0/2727207060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f08a0104210 con 0x7f08a0103e30 2024-09-19T06:10:34.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.914+0000 7f0897400640 1 -- 172.21.15.3:0/2727207060 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22583 (secure 0 0 0) 0x7f08900a0aa0 con 0x7f08a0103e30 2024-09-19T06:10:34.915 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:10:34.916 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":88,"fsid":"782a5144-764c-11ef-bceb-c7b262605968","created":"2024-09-19T06:01:35.224753+0000","modified":"2024-09-19T06:10:31.811461+0000","last_up_change":"2024-09-19T06:09:02.478979+0000","last_in_change":"2024-09-19T06:08:38.865280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:04:56.654478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:09:58.426008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:10:01.215704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd89ea4b-a24e-4946-80fc-1776b6d05e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6803","nonce":2061486638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6805","nonce":2061486638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6809","nonce":2061486638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6807","nonce":2061486638}]},"public_addr":"172.21.15.3:6803/2061486638","cluster_addr":"172.21.15.3:6805/2061486638","heartbeat_back_addr":"172.21.15.3:6809/2061486638","heartbeat_front_addr":"172.21.15.3:6807/2061486638","state":["exists","up"]},{"osd":1,"uuid":"e03ca275-8da5-402f-9cd2-654ca422b9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6801","nonce":129318538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6803","nonce":129318538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6807","nonce":129318538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6805","nonce":129318538}]},"public_addr":"172.21.15.59:6801/129318538","cluster_addr":"172.21.15.59:6803/129318538","heartbeat_back_addr":"172.21.15.59:6807/129318538","heartbeat_front_addr":"172.21.15.59:6805/129318538","state":["exists","up"]},{"osd":2,"uuid":"62b7d36d-6078-4027-93b2-009be70a6d80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6801","nonce":2436210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6803","nonce":2436210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6807","nonce":2436210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6805","nonce":2436210695}]},"public_addr":"172.21.15.71:6801/2436210695","cluster_addr":"172.21.15.71:6803/2436210695","heartbeat_back_addr":"172.21.15.71:6807/2436210695","heartbeat_front_addr":"172.21.15.71:6805/2436210695","state":["exists","up"]},{"osd":3,"uuid":"ba33cc45-0103-443d-b262-622a505d9806","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6811","nonce":3577306700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6813","nonce":3577306700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6817","nonce":3577306700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6815","nonce":3577306700}]},"public_addr":"172.21.15.3:6811/3577306700","cluster_addr":"172.21.15.3:6813/3577306700","heartbeat_back_addr":"172.21.15.3:6817/3577306700","heartbeat_front_addr":"172.21.15.3:6815/3577306700","state":["exists","up"]},{"osd":4,"uuid":"40564c0c-6335-4207-a8e0-8078c9bfd015","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6809","nonce":4002980986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6811","nonce":4002980986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6815","nonce":4002980986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6813","nonce":4002980986}]},"public_addr":"172.21.15.59:6809/4002980986","cluster_addr":"172.21.15.59:6811/4002980986","heartbeat_back_addr":"172.21.15.59:6815/4002980986","heartbeat_front_addr":"172.21.15.59:6813/4002980986","state":["exists","up"]},{"osd":5,"uuid":"4db04b82-3403-4fd5-9eb7-7b81ed6b1d26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6809","nonce":2455500497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6811","nonce":2455500497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6815","nonce":2455500497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6813","nonce":2455500497}]},"public_addr":"172.21.15.71:6809/2455500497","cluster_addr":"172.21.15.71:6811/2455500497","heartbeat_back_addr":"172.21.15.71:6815/2455500497","heartbeat_front_addr":"172.21.15.71:6813/2455500497","state":["exists","up"]},{"osd":6,"uuid":"42a74f01-c5d0-4fc6-a8ee-a8bd84d4ab4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6819","nonce":823411903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6821","nonce":823411903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6825","nonce":823411903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6823","nonce":823411903}]},"public_addr":"172.21.15.3:6819/823411903","cluster_addr":"172.21.15.3:6821/823411903","heartbeat_back_addr":"172.21.15.3:6825/823411903","heartbeat_front_addr":"172.21.15.3:6823/823411903","state":["exists","up"]},{"osd":7,"uuid":"8a9bc2ec-4292-465d-8a0d-dda78521a319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6817","nonce":2133603853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6819","nonce":2133603853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6823","nonce":2133603853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6821","nonce":2133603853}]},"public_addr":"172.21.15.59:6817/2133603853","cluster_addr":"172.21.15.59:6819/2133603853","heartbeat_back_addr":"172.21.15.59:6823/2133603853","heartbeat_front_addr":"172.21.15.59:6821/2133603853","state":["exists","up"]},{"osd":8,"uuid":"6099a5c4-3504-43ca-8c58-d23f9096cd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6817","nonce":905333117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6819","nonce":905333117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6823","nonce":905333117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6821","nonce":905333117}]},"public_addr":"172.21.15.71:6817/905333117","cluster_addr":"172.21.15.71:6819/905333117","heartbeat_back_addr":"172.21.15.71:6823/905333117","heartbeat_front_addr":"172.21.15.71:6821/905333117","state":["exists","up"]},{"osd":9,"uuid":"b5a8aac6-bb10-4db8-a056-25228fbe754c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6827","nonce":124909267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6829","nonce":124909267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6833","nonce":124909267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6831","nonce":124909267}]},"public_addr":"172.21.15.3:6827/124909267","cluster_addr":"172.21.15.3:6829/124909267","heartbeat_back_addr":"172.21.15.3:6833/124909267","heartbeat_front_addr":"172.21.15.3:6831/124909267","state":["exists","up"]},{"osd":10,"uuid":"e49f3aab-0804-4aea-ae3f-38f022ab5239","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6825","nonce":784134238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6827","nonce":784134238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6831","nonce":784134238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6829","nonce":784134238}]},"public_addr":"172.21.15.59:6825/784134238","cluster_addr":"172.21.15.59:6827/784134238","heartbeat_back_addr":"172.21.15.59:6831/784134238","heartbeat_front_addr":"172.21.15.59:6829/784134238","state":["exists","up"]},{"osd":11,"uuid":"6c6d6c23-bcf7-43e7-94d1-5f2ebaa15441","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6825","nonce":3502550915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6827","nonce":3502550915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6831","nonce":3502550915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6829","nonce":3502550915}]},"public_addr":"172.21.15.71:6825/3502550915","cluster_addr":"172.21.15.71:6827/3502550915","heartbeat_back_addr":"172.21.15.71:6831/3502550915","heartbeat_front_addr":"172.21.15.71:6829/3502550915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:01.683342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:28.058683+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:53.250819+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:05:23.267377+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:05:49.756289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:06:15.766613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:06:46.054328+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:12.579180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:37.976863+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:08.683966+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:35.120765+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:00.624411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/1458736313":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/2065281908":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/953348594":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6801/518259590":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/1658697906":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6801/2386230415":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6800/2386230415":"2024-09-20T06:02:01.122348+0000","172.21.15.3:0/1616091100":"2024-09-20T06:02:30.039686+0000","172.21.15.3:6800/518259590":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/2122482494":"2024-09-20T06:02:01.122348+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:10:34.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.917+0000 7f089fe00640 1 -- 172.21.15.3:0/2727207060 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f08840a32d0 msgr2=0x7f08840a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:34.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.917+0000 7f089fe00640 1 --2- 172.21.15.3:0/2727207060 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f08840a32d0 0x7f08840a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0888009230 tx=0x7f08880058d0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.917+0000 7f089fe00640 1 -- 172.21.15.3:0/2727207060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08a0103e30 msgr2=0x7f08a019a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:34.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.917+0000 7f089fe00640 1 --2- 172.21.15.3:0/2727207060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08a0103e30 0x7f08a019a4c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f089000e9f0 tx=0x7f089000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.917+0000 7f089fe00640 1 -- 172.21.15.3:0/2727207060 shutdown_connections 2024-09-19T06:10:34.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.917+0000 7f089fe00640 1 --2- 172.21.15.3:0/2727207060 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f08840a32d0 0x7f08840a5790 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.917+0000 7f089fe00640 1 --2- 172.21.15.3:0/2727207060 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f08a0108f60 0x7f08a019ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.917+0000 7f089fe00640 1 --2- 172.21.15.3:0/2727207060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f08a01047e0 0x7f08a019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.917+0000 7f089fe00640 1 --2- 172.21.15.3:0/2727207060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08a0103e30 0x7f08a019a4c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:34.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.917+0000 7f089fe00640 1 -- 172.21.15.3:0/2727207060 >> 172.21.15.3:0/2727207060 conn(0x7f08a00ff910 msgr2=0x7f08a0100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:34.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.917+0000 7f089fe00640 1 -- 172.21.15.3:0/2727207060 shutdown_connections 2024-09-19T06:10:34.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:34.917+0000 7f089fe00640 1 -- 172.21.15.3:0/2727207060 wait complete. 2024-09-19T06:10:35.738 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T06:10:35.738 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:10:36.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:35 smithi003 ceph-mon[30893]: pgmap v320: 97 pgs: 3 peering, 94 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 KiB/s wr, 11 op/s; 273 B/s, 0 objects/s recovering 2024-09-19T06:10:36.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:35 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2727207060' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:10:36.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:35 smithi071 ceph-mon[35662]: pgmap v320: 97 pgs: 3 peering, 94 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 KiB/s wr, 11 op/s; 273 B/s, 0 objects/s recovering 2024-09-19T06:10:36.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:35 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2727207060' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:10:36.116 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:36.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:35 smithi059 ceph-mon[35138]: pgmap v320: 97 pgs: 3 peering, 94 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 KiB/s wr, 11 op/s; 273 B/s, 0 objects/s recovering 2024-09-19T06:10:36.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:35 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2727207060' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:10:36.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.708+0000 7f8448200640 1 -- 172.21.15.3:0/634228454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8440077040 msgr2=0x7f84401124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:36.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.708+0000 7f8448200640 1 --2- 172.21.15.3:0/634228454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8440077040 0x7f84401124f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f842c009900 tx=0x7f842c02a410 comp rx=0 tx=0).stop 2024-09-19T06:10:36.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.708+0000 7f8448200640 1 -- 172.21.15.3:0/634228454 shutdown_connections 2024-09-19T06:10:36.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.708+0000 7f8448200640 1 --2- 172.21.15.3:0/634228454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8440112a30 0x7f8440114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:36.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.708+0000 7f8448200640 1 --2- 172.21.15.3:0/634228454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8440077040 0x7f84401124f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:36.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.708+0000 7f8448200640 1 --2- 172.21.15.3:0/634228454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8440076720 0x7f8440076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:36.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.709+0000 7f8448200640 1 -- 172.21.15.3:0/634228454 >> 172.21.15.3:0/634228454 conn(0x7f84400ffa90 msgr2=0x7f8440101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:36.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.709+0000 7f8448200640 1 -- 172.21.15.3:0/634228454 shutdown_connections 2024-09-19T06:10:36.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.709+0000 7f8448200640 1 -- 172.21.15.3:0/634228454 wait complete. 2024-09-19T06:10:36.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.710+0000 7f8448200640 1 Processor -- start 2024-09-19T06:10:36.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.710+0000 7f8448200640 1 -- start start 2024-09-19T06:10:36.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.710+0000 7f8448200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8440076720 0x7f84401a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:36.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.710+0000 7f8448200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8440077040 0x7f84401a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:36.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.710+0000 7f8448200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8440112a30 0x7f844019e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:36.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.710+0000 7f8448200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8440118600 con 0x7f8440077040 2024-09-19T06:10:36.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.710+0000 7f8448200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8440118480 con 0x7f8440076720 2024-09-19T06:10:36.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.710+0000 7f8448200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8440118780 con 0x7f8440112a30 2024-09-19T06:10:36.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.710+0000 7f8446200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8440112a30 0x7f844019e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:36.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.710+0000 7f8444e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8440077040 0x7f84401a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:36.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.710+0000 7f8446200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8440112a30 0x7f844019e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:48568/0 (socket says 172.21.15.3:48568) 2024-09-19T06:10:36.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.710+0000 7f8446200640 1 -- 172.21.15.3:0/1758181738 learned_addr learned my addr 172.21.15.3:0/1758181738 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:36.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.710+0000 7f8445800640 1 --2- 172.21.15.3:0/1758181738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8440076720 0x7f84401a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:36.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.711+0000 7f8446200640 1 -- 172.21.15.3:0/1758181738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8440076720 msgr2=0x7f84401a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:36.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.711+0000 7f8446200640 1 --2- 172.21.15.3:0/1758181738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8440076720 0x7f84401a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:36.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.711+0000 7f8446200640 1 -- 172.21.15.3:0/1758181738 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8440077040 msgr2=0x7f84401a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:36.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.711+0000 7f8446200640 1 --2- 172.21.15.3:0/1758181738 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8440077040 0x7f84401a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:36.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.711+0000 7f8446200640 1 -- 172.21.15.3:0/1758181738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f844019eff0 con 0x7f8440112a30 2024-09-19T06:10:36.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.711+0000 7f8446200640 1 --2- 172.21.15.3:0/1758181738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8440112a30 0x7f844019e8c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f843800eb10 tx=0x7f843800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:36.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.711+0000 7f843e000640 1 -- 172.21.15.3:0/1758181738 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8438004b20 con 0x7f8440112a30 2024-09-19T06:10:36.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.711+0000 7f843e000640 1 -- 172.21.15.3:0/1758181738 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8438004cc0 con 0x7f8440112a30 2024-09-19T06:10:36.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.711+0000 7f843e000640 1 -- 172.21.15.3:0/1758181738 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8438010790 con 0x7f8440112a30 2024-09-19T06:10:36.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.711+0000 7f8448200640 1 -- 172.21.15.3:0/1758181738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f844019f2e0 con 0x7f8440112a30 2024-09-19T06:10:36.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.712+0000 7f8448200640 1 -- 172.21.15.3:0/1758181738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84401ab5d0 con 0x7f8440112a30 2024-09-19T06:10:36.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.713+0000 7f8448200640 1 -- 172.21.15.3:0/1758181738 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8440076b00 con 0x7f8440112a30 2024-09-19T06:10:36.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.715+0000 7f843e000640 1 -- 172.21.15.3:0/1758181738 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f8438005020 con 0x7f8440112a30 2024-09-19T06:10:36.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.716+0000 7f843e000640 1 --2- 172.21.15.3:0/1758181738 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f84280a3350 0x7f84280a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:36.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.716+0000 7f843e000640 1 -- 172.21.15.3:0/1758181738 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f84380d0170 con 0x7f8440112a30 2024-09-19T06:10:36.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.716+0000 7f8445800640 1 --2- 172.21.15.3:0/1758181738 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f84280a3350 0x7f84280a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:36.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.717+0000 7f8445800640 1 --2- 172.21.15.3:0/1758181738 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f84280a3350 0x7f84280a5810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f844019fa00 tx=0x7f843400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:36.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.720+0000 7f843e000640 1 -- 172.21.15.3:0/1758181738 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f843809ccb0 con 0x7f8440112a30 2024-09-19T06:10:36.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.902+0000 7f8448200640 1 -- 172.21.15.3:0/1758181738 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8440062630 con 0x7f84280a3350 2024-09-19T06:10:36.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.910+0000 7f843e000640 1 -- 172.21.15.3:0/1758181738 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258906 (secure 0 0 0) 0x7f8440062630 con 0x7f84280a3350 2024-09-19T06:10:36.916 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:10:36.918 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-19T06:10:36.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.914+0000 7f8448200640 1 -- 172.21.15.3:0/1758181738 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f84280a3350 msgr2=0x7f84280a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:36.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.914+0000 7f8448200640 1 --2- 172.21.15.3:0/1758181738 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f84280a3350 0x7f84280a5810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f844019fa00 tx=0x7f843400b410 comp rx=0 tx=0).stop 2024-09-19T06:10:36.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.914+0000 7f8448200640 1 -- 172.21.15.3:0/1758181738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8440112a30 msgr2=0x7f844019e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:36.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.914+0000 7f8448200640 1 --2- 172.21.15.3:0/1758181738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8440112a30 0x7f844019e8c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f843800eb10 tx=0x7f843800c2d0 comp rx=0 tx=0).stop 2024-09-19T06:10:36.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.914+0000 7f8448200640 1 -- 172.21.15.3:0/1758181738 shutdown_connections 2024-09-19T06:10:36.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.914+0000 7f8448200640 1 --2- 172.21.15.3:0/1758181738 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f84280a3350 0x7f84280a5810 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:36.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.914+0000 7f8448200640 1 --2- 172.21.15.3:0/1758181738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8440112a30 0x7f844019e8c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:36.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.914+0000 7f8448200640 1 --2- 172.21.15.3:0/1758181738 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8440077040 0x7f84401a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:36.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.914+0000 7f8448200640 1 --2- 172.21.15.3:0/1758181738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8440076720 0x7f84401a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:36.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.914+0000 7f8448200640 1 -- 172.21.15.3:0/1758181738 >> 172.21.15.3:0/1758181738 conn(0x7f84400ffa90 msgr2=0x7f8440101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:36.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.914+0000 7f8448200640 1 -- 172.21.15.3:0/1758181738 shutdown_connections 2024-09-19T06:10:36.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:36.914+0000 7f8448200640 1 -- 172.21.15.3:0/1758181738 wait complete. 2024-09-19T06:10:37.834 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":321,"stamp":"2024-09-19T06:10:36.139060+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":647922,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":294,"num_read_kb":269,"num_write":418,"num_write_kb":3062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":1182921,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":342,"ondisk_log_size":342,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":293,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365280,"kb_used_data":11808,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576544,"statfs":{"total":1151940427776,"available":1151566381056,"internally_reserved":0,"allocated":12091392,"data_stored":7518931,"data_compressed":168291,"data_compressed_allocated":221184,"data_compressed_original":1941504,"omap_allocated":19140,"internal_metadata":361674044},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23282,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":40,"num_write":14,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":2185,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002008"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.821380+0000","last_change":"2024-09-19T06:10:02.531329+0000","last_active":"2024-09-19T06:10:31.821380+0000","last_peered":"2024-09-19T06:10:31.821380+0000","last_clean":"2024-09-19T06:10:31.821380+0000","last_became_active":"2024-09-19T06:10:02.530997+0000","last_became_peered":"2024-09-19T06:10:02.530997+0000","last_unstale":"2024-09-19T06:10:31.821380+0000","last_undegraded":"2024-09-19T06:10:31.821380+0000","last_fullsized":"2024-09-19T06:10:31.821380+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:15.240495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816455+0000","last_change":"2024-09-19T06:10:02.526083+0000","last_active":"2024-09-19T06:10:31.816455+0000","last_peered":"2024-09-19T06:10:31.816455+0000","last_clean":"2024-09-19T06:10:31.816455+0000","last_became_active":"2024-09-19T06:10:02.522889+0000","last_became_peered":"2024-09-19T06:10:02.522889+0000","last_unstale":"2024-09-19T06:10:31.816455+0000","last_undegraded":"2024-09-19T06:10:31.816455+0000","last_fullsized":"2024-09-19T06:10:31.816455+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:19.735866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816994+0000","last_change":"2024-09-19T06:10:02.531779+0000","last_active":"2024-09-19T06:10:31.816994+0000","last_peered":"2024-09-19T06:10:31.816994+0000","last_clean":"2024-09-19T06:10:31.816994+0000","last_became_active":"2024-09-19T06:10:02.526795+0000","last_became_peered":"2024-09-19T06:10:02.526795+0000","last_unstale":"2024-09-19T06:10:31.816994+0000","last_undegraded":"2024-09-19T06:10:31.816994+0000","last_fullsized":"2024-09-19T06:10:31.816994+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:28.800773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819230+0000","last_change":"2024-09-19T06:10:02.518697+0000","last_active":"2024-09-19T06:10:31.819230+0000","last_peered":"2024-09-19T06:10:31.819230+0000","last_clean":"2024-09-19T06:10:31.819230+0000","last_became_active":"2024-09-19T06:10:02.518114+0000","last_became_peered":"2024-09-19T06:10:02.518114+0000","last_unstale":"2024-09-19T06:10:31.819230+0000","last_undegraded":"2024-09-19T06:10:31.819230+0000","last_fullsized":"2024-09-19T06:10:31.819230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:08.172638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823875+0000","last_change":"2024-09-19T06:10:02.520450+0000","last_active":"2024-09-19T06:10:31.823875+0000","last_peered":"2024-09-19T06:10:31.823875+0000","last_clean":"2024-09-19T06:10:31.823875+0000","last_became_active":"2024-09-19T06:10:02.519079+0000","last_became_peered":"2024-09-19T06:10:02.519079+0000","last_unstale":"2024-09-19T06:10:31.823875+0000","last_undegraded":"2024-09-19T06:10:31.823875+0000","last_fullsized":"2024-09-19T06:10:31.823875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:47.502020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815408+0000","last_change":"2024-09-19T06:10:02.518567+0000","last_active":"2024-09-19T06:10:31.815408+0000","last_peered":"2024-09-19T06:10:31.815408+0000","last_clean":"2024-09-19T06:10:31.815408+0000","last_became_active":"2024-09-19T06:10:02.517568+0000","last_became_peered":"2024-09-19T06:10:02.517568+0000","last_unstale":"2024-09-19T06:10:31.815408+0000","last_undegraded":"2024-09-19T06:10:31.815408+0000","last_fullsized":"2024-09-19T06:10:31.815408+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:10.245189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822197+0000","last_change":"2024-09-19T06:10:02.521844+0000","last_active":"2024-09-19T06:10:31.822197+0000","last_peered":"2024-09-19T06:10:31.822197+0000","last_clean":"2024-09-19T06:10:31.822197+0000","last_became_active":"2024-09-19T06:10:02.521522+0000","last_became_peered":"2024-09-19T06:10:02.521522+0000","last_unstale":"2024-09-19T06:10:31.822197+0000","last_undegraded":"2024-09-19T06:10:31.822197+0000","last_fullsized":"2024-09-19T06:10:31.822197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:46.166077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.821465+0000","last_change":"2024-09-19T06:10:02.526977+0000","last_active":"2024-09-19T06:10:31.821465+0000","last_peered":"2024-09-19T06:10:31.821465+0000","last_clean":"2024-09-19T06:10:31.821465+0000","last_became_active":"2024-09-19T06:10:02.526036+0000","last_became_peered":"2024-09-19T06:10:02.526036+0000","last_unstale":"2024-09-19T06:10:31.821465+0000","last_undegraded":"2024-09-19T06:10:31.821465+0000","last_fullsized":"2024-09-19T06:10:31.821465+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:43:28.587020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.950831+0000","last_change":"2024-09-19T06:10:02.524721+0000","last_active":"2024-09-19T06:10:31.950831+0000","last_peered":"2024-09-19T06:10:31.950831+0000","last_clean":"2024-09-19T06:10:31.950831+0000","last_became_active":"2024-09-19T06:10:02.523871+0000","last_became_peered":"2024-09-19T06:10:02.523871+0000","last_unstale":"2024-09-19T06:10:31.950831+0000","last_undegraded":"2024-09-19T06:10:31.950831+0000","last_fullsized":"2024-09-19T06:10:31.950831+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:31.324530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815849+0000","last_change":"2024-09-19T06:10:02.518494+0000","last_active":"2024-09-19T06:10:31.815849+0000","last_peered":"2024-09-19T06:10:31.815849+0000","last_clean":"2024-09-19T06:10:31.815849+0000","last_became_active":"2024-09-19T06:10:02.518140+0000","last_became_peered":"2024-09-19T06:10:02.518140+0000","last_unstale":"2024-09-19T06:10:31.815849+0000","last_undegraded":"2024-09-19T06:10:31.815849+0000","last_fullsized":"2024-09-19T06:10:31.815849+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:42.695222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822993+0000","last_change":"2024-09-19T06:10:02.524697+0000","last_active":"2024-09-19T06:10:31.822993+0000","last_peered":"2024-09-19T06:10:31.822993+0000","last_clean":"2024-09-19T06:10:31.822993+0000","last_became_active":"2024-09-19T06:10:02.524094+0000","last_became_peered":"2024-09-19T06:10:02.524094+0000","last_unstale":"2024-09-19T06:10:31.822993+0000","last_undegraded":"2024-09-19T06:10:31.822993+0000","last_fullsized":"2024-09-19T06:10:31.822993+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:12.591847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819323+0000","last_change":"2024-09-19T06:10:02.515878+0000","last_active":"2024-09-19T06:10:31.819323+0000","last_peered":"2024-09-19T06:10:31.819323+0000","last_clean":"2024-09-19T06:10:31.819323+0000","last_became_active":"2024-09-19T06:10:02.515456+0000","last_became_peered":"2024-09-19T06:10:02.515456+0000","last_unstale":"2024-09-19T06:10:31.819323+0000","last_undegraded":"2024-09-19T06:10:31.819323+0000","last_fullsized":"2024-09-19T06:10:31.819323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:58.687431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824936+0000","last_change":"2024-09-19T06:10:31.824936+0000","last_active":"2024-09-19T06:10:31.824936+0000","last_peered":"2024-09-19T06:10:31.824936+0000","last_clean":"2024-09-19T06:10:31.824936+0000","last_became_active":"2024-09-19T06:10:31.824611+0000","last_became_peered":"2024-09-19T06:10:31.824611+0000","last_unstale":"2024-09-19T06:10:31.824936+0000","last_undegraded":"2024-09-19T06:10:31.824936+0000","last_fullsized":"2024-09-19T06:10:31.824936+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:36.397693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815684+0000","last_change":"2024-09-19T06:10:02.513397+0000","last_active":"2024-09-19T06:10:31.815684+0000","last_peered":"2024-09-19T06:10:31.815684+0000","last_clean":"2024-09-19T06:10:31.815684+0000","last_became_active":"2024-09-19T06:10:02.513011+0000","last_became_peered":"2024-09-19T06:10:02.513011+0000","last_unstale":"2024-09-19T06:10:31.815684+0000","last_undegraded":"2024-09-19T06:10:31.815684+0000","last_fullsized":"2024-09-19T06:10:31.815684+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:06:03.509401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815644+0000","last_change":"2024-09-19T06:10:02.521623+0000","last_active":"2024-09-19T06:10:31.815644+0000","last_peered":"2024-09-19T06:10:31.815644+0000","last_clean":"2024-09-19T06:10:31.815644+0000","last_became_active":"2024-09-19T06:10:02.519371+0000","last_became_peered":"2024-09-19T06:10:02.519371+0000","last_unstale":"2024-09-19T06:10:31.815644+0000","last_undegraded":"2024-09-19T06:10:31.815644+0000","last_fullsized":"2024-09-19T06:10:31.815644+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:10.687026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.949882+0000","last_change":"2024-09-19T06:10:02.520865+0000","last_active":"2024-09-19T06:10:31.949882+0000","last_peered":"2024-09-19T06:10:31.949882+0000","last_clean":"2024-09-19T06:10:31.949882+0000","last_became_active":"2024-09-19T06:10:02.519683+0000","last_became_peered":"2024-09-19T06:10:02.519683+0000","last_unstale":"2024-09-19T06:10:31.949882+0000","last_undegraded":"2024-09-19T06:10:31.949882+0000","last_fullsized":"2024-09-19T06:10:31.949882+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:40.320474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.821336+0000","last_change":"2024-09-19T06:10:02.531552+0000","last_active":"2024-09-19T06:10:31.821336+0000","last_peered":"2024-09-19T06:10:31.821336+0000","last_clean":"2024-09-19T06:10:31.821336+0000","last_became_active":"2024-09-19T06:10:02.531081+0000","last_became_peered":"2024-09-19T06:10:02.531081+0000","last_unstale":"2024-09-19T06:10:31.821336+0000","last_undegraded":"2024-09-19T06:10:31.821336+0000","last_fullsized":"2024-09-19T06:10:31.821336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:07.835754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:10:30.815072+0000","last_change":"2024-09-19T06:10:02.509088+0000","last_active":"2024-09-19T06:10:30.815072+0000","last_peered":"2024-09-19T06:10:30.815072+0000","last_clean":"2024-09-19T06:10:30.815072+0000","last_became_active":"2024-09-19T06:10:02.508752+0000","last_became_peered":"2024-09-19T06:10:02.508752+0000","last_unstale":"2024-09-19T06:10:30.815072+0000","last_undegraded":"2024-09-19T06:10:30.815072+0000","last_fullsized":"2024-09-19T06:10:30.815072+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:36.832952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819925+0000","last_change":"2024-09-19T06:10:02.534694+0000","last_active":"2024-09-19T06:10:31.819925+0000","last_peered":"2024-09-19T06:10:31.819925+0000","last_clean":"2024-09-19T06:10:31.819925+0000","last_became_active":"2024-09-19T06:10:02.534384+0000","last_became_peered":"2024-09-19T06:10:02.534384+0000","last_unstale":"2024-09-19T06:10:31.819925+0000","last_undegraded":"2024-09-19T06:10:31.819925+0000","last_fullsized":"2024-09-19T06:10:31.819925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:48.006128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819900+0000","last_change":"2024-09-19T06:10:02.521104+0000","last_active":"2024-09-19T06:10:31.819900+0000","last_peered":"2024-09-19T06:10:31.819900+0000","last_clean":"2024-09-19T06:10:31.819900+0000","last_became_active":"2024-09-19T06:10:02.520755+0000","last_became_peered":"2024-09-19T06:10:02.520755+0000","last_unstale":"2024-09-19T06:10:31.819900+0000","last_undegraded":"2024-09-19T06:10:31.819900+0000","last_fullsized":"2024-09-19T06:10:31.819900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:46.091297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.817016+0000","last_change":"2024-09-19T06:10:02.522048+0000","last_active":"2024-09-19T06:10:31.817016+0000","last_peered":"2024-09-19T06:10:31.817016+0000","last_clean":"2024-09-19T06:10:31.817016+0000","last_became_active":"2024-09-19T06:10:02.521750+0000","last_became_peered":"2024-09-19T06:10:02.521750+0000","last_unstale":"2024-09-19T06:10:31.817016+0000","last_undegraded":"2024-09-19T06:10:31.817016+0000","last_fullsized":"2024-09-19T06:10:31.817016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:07.780609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.950055+0000","last_change":"2024-09-19T06:10:02.527386+0000","last_active":"2024-09-19T06:10:31.950055+0000","last_peered":"2024-09-19T06:10:31.950055+0000","last_clean":"2024-09-19T06:10:31.950055+0000","last_became_active":"2024-09-19T06:10:02.526804+0000","last_became_peered":"2024-09-19T06:10:02.526804+0000","last_unstale":"2024-09-19T06:10:31.950055+0000","last_undegraded":"2024-09-19T06:10:31.950055+0000","last_fullsized":"2024-09-19T06:10:31.950055+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:15.652068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.821745+0000","last_change":"2024-09-19T06:10:02.528521+0000","last_active":"2024-09-19T06:10:31.821745+0000","last_peered":"2024-09-19T06:10:31.821745+0000","last_clean":"2024-09-19T06:10:31.821745+0000","last_became_active":"2024-09-19T06:10:02.528087+0000","last_became_peered":"2024-09-19T06:10:02.528087+0000","last_unstale":"2024-09-19T06:10:31.821745+0000","last_undegraded":"2024-09-19T06:10:31.821745+0000","last_fullsized":"2024-09-19T06:10:31.821745+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:29.176129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819851+0000","last_change":"2024-09-19T06:10:02.518544+0000","last_active":"2024-09-19T06:10:31.819851+0000","last_peered":"2024-09-19T06:10:31.819851+0000","last_clean":"2024-09-19T06:10:31.819851+0000","last_became_active":"2024-09-19T06:10:02.518230+0000","last_became_peered":"2024-09-19T06:10:02.518230+0000","last_unstale":"2024-09-19T06:10:31.819851+0000","last_undegraded":"2024-09-19T06:10:31.819851+0000","last_fullsized":"2024-09-19T06:10:31.819851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:26:32.116211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822472+0000","last_change":"2024-09-19T06:10:02.531859+0000","last_active":"2024-09-19T06:10:31.822472+0000","last_peered":"2024-09-19T06:10:31.822472+0000","last_clean":"2024-09-19T06:10:31.822472+0000","last_became_active":"2024-09-19T06:10:02.531572+0000","last_became_peered":"2024-09-19T06:10:02.531572+0000","last_unstale":"2024-09-19T06:10:31.822472+0000","last_undegraded":"2024-09-19T06:10:31.822472+0000","last_fullsized":"2024-09-19T06:10:31.822472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:34.314977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819440+0000","last_change":"2024-09-19T06:10:02.521292+0000","last_active":"2024-09-19T06:10:31.819440+0000","last_peered":"2024-09-19T06:10:31.819440+0000","last_clean":"2024-09-19T06:10:31.819440+0000","last_became_active":"2024-09-19T06:10:02.520967+0000","last_became_peered":"2024-09-19T06:10:02.520967+0000","last_unstale":"2024-09-19T06:10:31.819440+0000","last_undegraded":"2024-09-19T06:10:31.819440+0000","last_fullsized":"2024-09-19T06:10:31.819440+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:11.318504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820304+0000","last_change":"2024-09-19T06:10:02.521514+0000","last_active":"2024-09-19T06:10:31.820304+0000","last_peered":"2024-09-19T06:10:31.820304+0000","last_clean":"2024-09-19T06:10:31.820304+0000","last_became_active":"2024-09-19T06:10:02.521203+0000","last_became_peered":"2024-09-19T06:10:02.521203+0000","last_unstale":"2024-09-19T06:10:31.820304+0000","last_undegraded":"2024-09-19T06:10:31.820304+0000","last_fullsized":"2024-09-19T06:10:31.820304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:53.689067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824501+0000","last_change":"2024-09-19T06:10:31.824501+0000","last_active":"2024-09-19T06:10:31.824501+0000","last_peered":"2024-09-19T06:10:31.824501+0000","last_clean":"2024-09-19T06:10:31.824501+0000","last_became_active":"2024-09-19T06:10:31.824161+0000","last_became_peered":"2024-09-19T06:10:31.824161+0000","last_unstale":"2024-09-19T06:10:31.824501+0000","last_undegraded":"2024-09-19T06:10:31.824501+0000","last_fullsized":"2024-09-19T06:10:31.824501+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:28.203581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816369+0000","last_change":"2024-09-19T06:10:02.530351+0000","last_active":"2024-09-19T06:10:31.816369+0000","last_peered":"2024-09-19T06:10:31.816369+0000","last_clean":"2024-09-19T06:10:31.816369+0000","last_became_active":"2024-09-19T06:10:02.529292+0000","last_became_peered":"2024-09-19T06:10:02.529292+0000","last_unstale":"2024-09-19T06:10:31.816369+0000","last_undegraded":"2024-09-19T06:10:31.816369+0000","last_fullsized":"2024-09-19T06:10:31.816369+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:02.324413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819026+0000","last_change":"2024-09-19T06:10:02.534885+0000","last_active":"2024-09-19T06:10:31.819026+0000","last_peered":"2024-09-19T06:10:31.819026+0000","last_clean":"2024-09-19T06:10:31.819026+0000","last_became_active":"2024-09-19T06:10:02.534520+0000","last_became_peered":"2024-09-19T06:10:02.534520+0000","last_unstale":"2024-09-19T06:10:31.819026+0000","last_undegraded":"2024-09-19T06:10:31.819026+0000","last_fullsized":"2024-09-19T06:10:31.819026+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:04.896787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819767+0000","last_change":"2024-09-19T06:10:02.518120+0000","last_active":"2024-09-19T06:10:31.819767+0000","last_peered":"2024-09-19T06:10:31.819767+0000","last_clean":"2024-09-19T06:10:31.819767+0000","last_became_active":"2024-09-19T06:10:02.517595+0000","last_became_peered":"2024-09-19T06:10:02.517595+0000","last_unstale":"2024-09-19T06:10:31.819767+0000","last_undegraded":"2024-09-19T06:10:31.819767+0000","last_fullsized":"2024-09-19T06:10:31.819767+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:00.695783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819720+0000","last_change":"2024-09-19T06:10:02.524413+0000","last_active":"2024-09-19T06:10:31.819720+0000","last_peered":"2024-09-19T06:10:31.819720+0000","last_clean":"2024-09-19T06:10:31.819720+0000","last_became_active":"2024-09-19T06:10:02.523559+0000","last_became_peered":"2024-09-19T06:10:02.523559+0000","last_unstale":"2024-09-19T06:10:31.819720+0000","last_undegraded":"2024-09-19T06:10:31.819720+0000","last_fullsized":"2024-09-19T06:10:31.819720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:04.045759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823856+0000","last_change":"2024-09-19T06:10:02.514572+0000","last_active":"2024-09-19T06:10:31.823856+0000","last_peered":"2024-09-19T06:10:31.823856+0000","last_clean":"2024-09-19T06:10:31.823856+0000","last_became_active":"2024-09-19T06:10:02.513685+0000","last_became_peered":"2024-09-19T06:10:02.513685+0000","last_unstale":"2024-09-19T06:10:31.823856+0000","last_undegraded":"2024-09-19T06:10:31.823856+0000","last_fullsized":"2024-09-19T06:10:31.823856+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:09.108036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:32.828795+0000","last_change":"2024-09-19T06:10:31.829554+0000","last_active":"2024-09-19T06:10:32.828795+0000","last_peered":"2024-09-19T06:10:32.828795+0000","last_clean":"2024-09-19T06:10:32.828795+0000","last_became_active":"2024-09-19T06:10:31.824266+0000","last_became_peered":"2024-09-19T06:10:31.824266+0000","last_unstale":"2024-09-19T06:10:32.828795+0000","last_undegraded":"2024-09-19T06:10:32.828795+0000","last_fullsized":"2024-09-19T06:10:32.828795+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:07.241897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1015,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819853+0000","last_change":"2024-09-19T06:10:02.524271+0000","last_active":"2024-09-19T06:10:31.819853+0000","last_peered":"2024-09-19T06:10:31.819853+0000","last_clean":"2024-09-19T06:10:31.819853+0000","last_became_active":"2024-09-19T06:10:02.523948+0000","last_became_peered":"2024-09-19T06:10:02.523948+0000","last_unstale":"2024-09-19T06:10:31.819853+0000","last_undegraded":"2024-09-19T06:10:31.819853+0000","last_fullsized":"2024-09-19T06:10:31.819853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:46.406652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815443+0000","last_change":"2024-09-19T06:09:59.493186+0000","last_active":"2024-09-19T06:10:31.815443+0000","last_peered":"2024-09-19T06:10:31.815443+0000","last_clean":"2024-09-19T06:10:31.815443+0000","last_became_active":"2024-09-19T06:09:59.492841+0000","last_became_peered":"2024-09-19T06:09:59.492841+0000","last_unstale":"2024-09-19T06:10:31.815443+0000","last_undegraded":"2024-09-19T06:10:31.815443+0000","last_fullsized":"2024-09-19T06:10:31.815443+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:48.557724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816757+0000","last_change":"2024-09-19T06:09:59.493364+0000","last_active":"2024-09-19T06:10:31.816757+0000","last_peered":"2024-09-19T06:10:31.816757+0000","last_clean":"2024-09-19T06:10:31.816757+0000","last_became_active":"2024-09-19T06:09:59.491868+0000","last_became_peered":"2024-09-19T06:09:59.491868+0000","last_unstale":"2024-09-19T06:10:31.816757+0000","last_undegraded":"2024-09-19T06:10:31.816757+0000","last_fullsized":"2024-09-19T06:10:31.816757+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:23.088768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.821572+0000","last_change":"2024-09-19T06:10:02.534453+0000","last_active":"2024-09-19T06:10:31.821572+0000","last_peered":"2024-09-19T06:10:31.821572+0000","last_clean":"2024-09-19T06:10:31.821572+0000","last_became_active":"2024-09-19T06:10:02.532003+0000","last_became_peered":"2024-09-19T06:10:02.532003+0000","last_unstale":"2024-09-19T06:10:31.821572+0000","last_undegraded":"2024-09-19T06:10:31.821572+0000","last_fullsized":"2024-09-19T06:10:31.821572+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:41.609673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820651+0000","last_change":"2024-09-19T06:09:59.493574+0000","last_active":"2024-09-19T06:10:31.820651+0000","last_peered":"2024-09-19T06:10:31.820651+0000","last_clean":"2024-09-19T06:10:31.820651+0000","last_became_active":"2024-09-19T06:09:59.493243+0000","last_became_peered":"2024-09-19T06:09:59.493243+0000","last_unstale":"2024-09-19T06:10:31.820651+0000","last_undegraded":"2024-09-19T06:10:31.820651+0000","last_fullsized":"2024-09-19T06:10:31.820651+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:12:43.491780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:10:30.814548+0000","last_change":"2024-09-19T06:10:02.520122+0000","last_active":"2024-09-19T06:10:30.814548+0000","last_peered":"2024-09-19T06:10:30.814548+0000","last_clean":"2024-09-19T06:10:30.814548+0000","last_became_active":"2024-09-19T06:10:02.519795+0000","last_became_peered":"2024-09-19T06:10:02.519795+0000","last_unstale":"2024-09-19T06:10:30.814548+0000","last_undegraded":"2024-09-19T06:10:30.814548+0000","last_fullsized":"2024-09-19T06:10:30.814548+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:12.384824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":62,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815756+0000","last_change":"2024-09-19T06:09:59.491192+0000","last_active":"2024-09-19T06:10:31.815756+0000","last_peered":"2024-09-19T06:10:31.815756+0000","last_clean":"2024-09-19T06:10:31.815756+0000","last_became_active":"2024-09-19T06:09:59.490774+0000","last_became_peered":"2024-09-19T06:09:59.490774+0000","last_unstale":"2024-09-19T06:10:31.815756+0000","last_undegraded":"2024-09-19T06:10:31.815756+0000","last_fullsized":"2024-09-19T06:10:31.815756+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:30.276512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.950309+0000","last_change":"2024-09-19T06:10:02.516728+0000","last_active":"2024-09-19T06:10:31.950309+0000","last_peered":"2024-09-19T06:10:31.950309+0000","last_clean":"2024-09-19T06:10:31.950309+0000","last_became_active":"2024-09-19T06:10:02.516415+0000","last_became_peered":"2024-09-19T06:10:02.516415+0000","last_unstale":"2024-09-19T06:10:31.950309+0000","last_undegraded":"2024-09-19T06:10:31.950309+0000","last_fullsized":"2024-09-19T06:10:31.950309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:45.012284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822879+0000","last_change":"2024-09-19T06:09:59.499167+0000","last_active":"2024-09-19T06:10:31.822879+0000","last_peered":"2024-09-19T06:10:31.822879+0000","last_clean":"2024-09-19T06:10:31.822879+0000","last_became_active":"2024-09-19T06:09:59.498796+0000","last_became_peered":"2024-09-19T06:09:59.498796+0000","last_unstale":"2024-09-19T06:10:31.822879+0000","last_undegraded":"2024-09-19T06:10:31.822879+0000","last_fullsized":"2024-09-19T06:10:31.822879+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:08.665495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823990+0000","last_change":"2024-09-19T06:10:31.823990+0000","last_active":"2024-09-19T06:10:31.823990+0000","last_peered":"2024-09-19T06:10:31.823990+0000","last_clean":"2024-09-19T06:10:31.823990+0000","last_became_active":"2024-09-19T06:10:31.823448+0000","last_became_peered":"2024-09-19T06:10:31.823448+0000","last_unstale":"2024-09-19T06:10:31.823990+0000","last_undegraded":"2024-09-19T06:10:31.823990+0000","last_fullsized":"2024-09-19T06:10:31.823990+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:33.882448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820128+0000","last_change":"2024-09-19T06:09:59.774875+0000","last_active":"2024-09-19T06:10:31.820128+0000","last_peered":"2024-09-19T06:10:31.820128+0000","last_clean":"2024-09-19T06:10:31.820128+0000","last_became_active":"2024-09-19T06:09:59.774376+0000","last_became_peered":"2024-09-19T06:09:59.774376+0000","last_unstale":"2024-09-19T06:10:31.820128+0000","last_undegraded":"2024-09-19T06:10:31.820128+0000","last_fullsized":"2024-09-19T06:10:31.820128+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:01.283578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.950220+0000","last_change":"2024-09-19T06:10:02.518202+0000","last_active":"2024-09-19T06:10:31.950220+0000","last_peered":"2024-09-19T06:10:31.950220+0000","last_clean":"2024-09-19T06:10:31.950220+0000","last_became_active":"2024-09-19T06:10:02.517865+0000","last_became_peered":"2024-09-19T06:10:02.517865+0000","last_unstale":"2024-09-19T06:10:31.950220+0000","last_undegraded":"2024-09-19T06:10:31.950220+0000","last_fullsized":"2024-09-19T06:10:31.950220+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:28.128891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'27","reported_seq":92,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815693+0000","last_change":"2024-09-19T06:09:59.493139+0000","last_active":"2024-09-19T06:10:31.815693+0000","last_peered":"2024-09-19T06:10:31.815693+0000","last_clean":"2024-09-19T06:10:31.815693+0000","last_became_active":"2024-09-19T06:09:59.492768+0000","last_became_peered":"2024-09-19T06:09:59.492768+0000","last_unstale":"2024-09-19T06:10:31.815693+0000","last_undegraded":"2024-09-19T06:10:31.815693+0000","last_fullsized":"2024-09-19T06:10:31.815693+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:17.872432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50112,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":67,"num_write":29,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824313+0000","last_change":"2024-09-19T06:10:02.516187+0000","last_active":"2024-09-19T06:10:31.824313+0000","last_peered":"2024-09-19T06:10:31.824313+0000","last_clean":"2024-09-19T06:10:31.824313+0000","last_became_active":"2024-09-19T06:10:02.515888+0000","last_became_peered":"2024-09-19T06:10:02.515888+0000","last_unstale":"2024-09-19T06:10:31.824313+0000","last_undegraded":"2024-09-19T06:10:31.824313+0000","last_fullsized":"2024-09-19T06:10:31.824313+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:29.672889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819416+0000","last_change":"2024-09-19T06:09:59.492155+0000","last_active":"2024-09-19T06:10:31.819416+0000","last_peered":"2024-09-19T06:10:31.819416+0000","last_clean":"2024-09-19T06:10:31.819416+0000","last_became_active":"2024-09-19T06:09:59.491730+0000","last_became_peered":"2024-09-19T06:09:59.491730+0000","last_unstale":"2024-09-19T06:10:31.819416+0000","last_undegraded":"2024-09-19T06:10:31.819416+0000","last_fullsized":"2024-09-19T06:10:31.819416+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:30.632665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816446+0000","last_change":"2024-09-19T06:10:02.526214+0000","last_active":"2024-09-19T06:10:31.816446+0000","last_peered":"2024-09-19T06:10:31.816446+0000","last_clean":"2024-09-19T06:10:31.816446+0000","last_became_active":"2024-09-19T06:10:02.525846+0000","last_became_peered":"2024-09-19T06:10:02.525846+0000","last_unstale":"2024-09-19T06:10:31.816446+0000","last_undegraded":"2024-09-19T06:10:31.816446+0000","last_fullsized":"2024-09-19T06:10:31.816446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:14.294741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820233+0000","last_change":"2024-09-19T06:09:59.494814+0000","last_active":"2024-09-19T06:10:31.820233+0000","last_peered":"2024-09-19T06:10:31.820233+0000","last_clean":"2024-09-19T06:10:31.820233+0000","last_became_active":"2024-09-19T06:09:59.494461+0000","last_became_peered":"2024-09-19T06:09:59.494461+0000","last_unstale":"2024-09-19T06:10:31.820233+0000","last_undegraded":"2024-09-19T06:10:31.820233+0000","last_fullsized":"2024-09-19T06:10:31.820233+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:37.730327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823102+0000","last_change":"2024-09-19T06:10:02.518851+0000","last_active":"2024-09-19T06:10:31.823102+0000","last_peered":"2024-09-19T06:10:31.823102+0000","last_clean":"2024-09-19T06:10:31.823102+0000","last_became_active":"2024-09-19T06:10:02.518462+0000","last_became_peered":"2024-09-19T06:10:02.518462+0000","last_unstale":"2024-09-19T06:10:31.823102+0000","last_undegraded":"2024-09-19T06:10:31.823102+0000","last_fullsized":"2024-09-19T06:10:31.823102+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:22.629918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819144+0000","last_change":"2024-09-19T06:09:59.493839+0000","last_active":"2024-09-19T06:10:31.819144+0000","last_peered":"2024-09-19T06:10:31.819144+0000","last_clean":"2024-09-19T06:10:31.819144+0000","last_became_active":"2024-09-19T06:09:59.492323+0000","last_became_peered":"2024-09-19T06:09:59.492323+0000","last_unstale":"2024-09-19T06:10:31.819144+0000","last_undegraded":"2024-09-19T06:10:31.819144+0000","last_fullsized":"2024-09-19T06:10:31.819144+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:12.754030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822340+0000","last_change":"2024-09-19T06:10:02.515957+0000","last_active":"2024-09-19T06:10:31.822340+0000","last_peered":"2024-09-19T06:10:31.822340+0000","last_clean":"2024-09-19T06:10:31.822340+0000","last_became_active":"2024-09-19T06:10:02.515493+0000","last_became_peered":"2024-09-19T06:10:02.515493+0000","last_unstale":"2024-09-19T06:10:31.822340+0000","last_undegraded":"2024-09-19T06:10:31.822340+0000","last_fullsized":"2024-09-19T06:10:31.822340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:06.988155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823601+0000","last_change":"2024-09-19T06:09:59.775131+0000","last_active":"2024-09-19T06:10:31.823601+0000","last_peered":"2024-09-19T06:10:31.823601+0000","last_clean":"2024-09-19T06:10:31.823601+0000","last_became_active":"2024-09-19T06:09:59.774642+0000","last_became_peered":"2024-09-19T06:09:59.774642+0000","last_unstale":"2024-09-19T06:10:31.823601+0000","last_undegraded":"2024-09-19T06:10:31.823601+0000","last_fullsized":"2024-09-19T06:10:31.823601+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:31.722485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819343+0000","last_change":"2024-09-19T06:10:02.522531+0000","last_active":"2024-09-19T06:10:31.819343+0000","last_peered":"2024-09-19T06:10:31.819343+0000","last_clean":"2024-09-19T06:10:31.819343+0000","last_became_active":"2024-09-19T06:10:02.522186+0000","last_became_peered":"2024-09-19T06:10:02.522186+0000","last_unstale":"2024-09-19T06:10:31.819343+0000","last_undegraded":"2024-09-19T06:10:31.819343+0000","last_fullsized":"2024-09-19T06:10:31.819343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:45.689043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824376+0000","last_change":"2024-09-19T06:09:59.494819+0000","last_active":"2024-09-19T06:10:31.824376+0000","last_peered":"2024-09-19T06:10:31.824376+0000","last_clean":"2024-09-19T06:10:31.824376+0000","last_became_active":"2024-09-19T06:09:59.494434+0000","last_became_peered":"2024-09-19T06:09:59.494434+0000","last_unstale":"2024-09-19T06:10:31.824376+0000","last_undegraded":"2024-09-19T06:10:31.824376+0000","last_fullsized":"2024-09-19T06:10:31.824376+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:42.207621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820312+0000","last_change":"2024-09-19T06:10:02.522893+0000","last_active":"2024-09-19T06:10:31.820312+0000","last_peered":"2024-09-19T06:10:31.820312+0000","last_clean":"2024-09-19T06:10:31.820312+0000","last_became_active":"2024-09-19T06:10:02.522596+0000","last_became_peered":"2024-09-19T06:10:02.522596+0000","last_unstale":"2024-09-19T06:10:31.820312+0000","last_undegraded":"2024-09-19T06:10:31.820312+0000","last_fullsized":"2024-09-19T06:10:31.820312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:21.394878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.838085+0000","last_change":"2024-09-19T06:10:31.838085+0000","last_active":"2024-09-19T06:10:31.838085+0000","last_peered":"2024-09-19T06:10:31.838085+0000","last_clean":"2024-09-19T06:10:31.838085+0000","last_became_active":"2024-09-19T06:10:31.826924+0000","last_became_peered":"2024-09-19T06:10:31.826924+0000","last_unstale":"2024-09-19T06:10:31.838085+0000","last_undegraded":"2024-09-19T06:10:31.838085+0000","last_fullsized":"2024-09-19T06:10:31.838085+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:19.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823274+0000","last_change":"2024-09-19T06:10:02.516137+0000","last_active":"2024-09-19T06:10:31.823274+0000","last_peered":"2024-09-19T06:10:31.823274+0000","last_clean":"2024-09-19T06:10:31.823274+0000","last_became_active":"2024-09-19T06:10:02.515769+0000","last_became_peered":"2024-09-19T06:10:02.515769+0000","last_unstale":"2024-09-19T06:10:31.823274+0000","last_undegraded":"2024-09-19T06:10:31.823274+0000","last_fullsized":"2024-09-19T06:10:31.823274+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:56.741950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820246+0000","last_change":"2024-09-19T06:09:59.498177+0000","last_active":"2024-09-19T06:10:31.820246+0000","last_peered":"2024-09-19T06:10:31.820246+0000","last_clean":"2024-09-19T06:10:31.820246+0000","last_became_active":"2024-09-19T06:09:59.497808+0000","last_became_peered":"2024-09-19T06:09:59.497808+0000","last_unstale":"2024-09-19T06:10:31.820246+0000","last_undegraded":"2024-09-19T06:10:31.820246+0000","last_fullsized":"2024-09-19T06:10:31.820246+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:06.473332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822740+0000","last_change":"2024-09-19T06:10:02.526442+0000","last_active":"2024-09-19T06:10:31.822740+0000","last_peered":"2024-09-19T06:10:31.822740+0000","last_clean":"2024-09-19T06:10:31.822740+0000","last_became_active":"2024-09-19T06:10:02.526116+0000","last_became_peered":"2024-09-19T06:10:02.526116+0000","last_unstale":"2024-09-19T06:10:31.822740+0000","last_undegraded":"2024-09-19T06:10:31.822740+0000","last_fullsized":"2024-09-19T06:10:31.822740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:05.000599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.830281+0000","last_change":"2024-09-19T06:10:31.829793+0000","last_active":"2024-09-19T06:10:31.830281+0000","last_peered":"2024-09-19T06:10:31.830281+0000","last_clean":"2024-09-19T06:10:31.830281+0000","last_became_active":"2024-09-19T06:10:31.822044+0000","last_became_peered":"2024-09-19T06:10:31.822044+0000","last_unstale":"2024-09-19T06:10:31.830281+0000","last_undegraded":"2024-09-19T06:10:31.830281+0000","last_fullsized":"2024-09-19T06:10:31.830281+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:45.301315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1170,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823112+0000","last_change":"2024-09-19T06:10:02.524435+0000","last_active":"2024-09-19T06:10:31.823112+0000","last_peered":"2024-09-19T06:10:31.823112+0000","last_clean":"2024-09-19T06:10:31.823112+0000","last_became_active":"2024-09-19T06:10:02.523634+0000","last_became_peered":"2024-09-19T06:10:02.523634+0000","last_unstale":"2024-09-19T06:10:31.823112+0000","last_undegraded":"2024-09-19T06:10:31.823112+0000","last_fullsized":"2024-09-19T06:10:31.823112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:07.679183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":349,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822606+0000","last_change":"2024-09-19T06:08:39.873247+0000","last_active":"2024-09-19T06:10:31.822606+0000","last_peered":"2024-09-19T06:10:31.822606+0000","last_clean":"2024-09-19T06:10:31.822606+0000","last_became_active":"2024-09-19T06:08:39.872647+0000","last_became_peered":"2024-09-19T06:08:39.872647+0000","last_unstale":"2024-09-19T06:10:31.822606+0000","last_undegraded":"2024-09-19T06:10:31.822606+0000","last_fullsized":"2024-09-19T06:10:31.822606+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:56.991890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:56.991890+0000","last_clean_scrub_stamp":"2024-09-19T06:04:56.991890+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:18.835510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.818858+0000","last_change":"2024-09-19T06:09:59.492677+0000","last_active":"2024-09-19T06:10:31.818858+0000","last_peered":"2024-09-19T06:10:31.818858+0000","last_clean":"2024-09-19T06:10:31.818858+0000","last_became_active":"2024-09-19T06:09:59.492235+0000","last_became_peered":"2024-09-19T06:09:59.492235+0000","last_unstale":"2024-09-19T06:10:31.818858+0000","last_undegraded":"2024-09-19T06:10:31.818858+0000","last_fullsized":"2024-09-19T06:10:31.818858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:40.173728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823152+0000","last_change":"2024-09-19T06:10:02.523331+0000","last_active":"2024-09-19T06:10:31.823152+0000","last_peered":"2024-09-19T06:10:31.823152+0000","last_clean":"2024-09-19T06:10:31.823152+0000","last_became_active":"2024-09-19T06:10:02.522896+0000","last_became_peered":"2024-09-19T06:10:02.522896+0000","last_unstale":"2024-09-19T06:10:31.823152+0000","last_undegraded":"2024-09-19T06:10:31.823152+0000","last_fullsized":"2024-09-19T06:10:31.823152+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:56.994375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822479+0000","last_change":"2024-09-19T06:09:59.496407+0000","last_active":"2024-09-19T06:10:31.822479+0000","last_peered":"2024-09-19T06:10:31.822479+0000","last_clean":"2024-09-19T06:10:31.822479+0000","last_became_active":"2024-09-19T06:09:59.496074+0000","last_became_peered":"2024-09-19T06:09:59.496074+0000","last_unstale":"2024-09-19T06:10:31.822479+0000","last_undegraded":"2024-09-19T06:10:31.822479+0000","last_fullsized":"2024-09-19T06:10:31.822479+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:11.257227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815458+0000","last_change":"2024-09-19T06:10:02.515229+0000","last_active":"2024-09-19T06:10:31.815458+0000","last_peered":"2024-09-19T06:10:31.815458+0000","last_clean":"2024-09-19T06:10:31.815458+0000","last_became_active":"2024-09-19T06:10:02.514092+0000","last_became_peered":"2024-09-19T06:10:02.514092+0000","last_unstale":"2024-09-19T06:10:31.815458+0000","last_undegraded":"2024-09-19T06:10:31.815458+0000","last_fullsized":"2024-09-19T06:10:31.815458+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:32:36.805821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:32.788016+0000","last_change":"2024-09-19T06:09:59.777102+0000","last_active":"2024-09-19T06:10:32.788016+0000","last_peered":"2024-09-19T06:10:32.788016+0000","last_clean":"2024-09-19T06:10:32.788016+0000","last_became_active":"2024-09-19T06:09:59.774456+0000","last_became_peered":"2024-09-19T06:09:59.774456+0000","last_unstale":"2024-09-19T06:10:32.788016+0000","last_undegraded":"2024-09-19T06:10:32.788016+0000","last_fullsized":"2024-09-19T06:10:32.788016+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:11.353528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820463+0000","last_change":"2024-09-19T06:10:02.517039+0000","last_active":"2024-09-19T06:10:31.820463+0000","last_peered":"2024-09-19T06:10:31.820463+0000","last_clean":"2024-09-19T06:10:31.820463+0000","last_became_active":"2024-09-19T06:10:02.516291+0000","last_became_peered":"2024-09-19T06:10:02.516291+0000","last_unstale":"2024-09-19T06:10:31.820463+0000","last_undegraded":"2024-09-19T06:10:31.820463+0000","last_fullsized":"2024-09-19T06:10:31.820463+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:27.835967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:32.954501+0000","last_change":"2024-09-19T06:09:59.499496+0000","last_active":"2024-09-19T06:10:32.954501+0000","last_peered":"2024-09-19T06:10:32.954501+0000","last_clean":"2024-09-19T06:10:32.954501+0000","last_became_active":"2024-09-19T06:09:59.499172+0000","last_became_peered":"2024-09-19T06:09:59.499172+0000","last_unstale":"2024-09-19T06:10:32.954501+0000","last_undegraded":"2024-09-19T06:10:32.954501+0000","last_fullsized":"2024-09-19T06:10:32.954501+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:52.062675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815533+0000","last_change":"2024-09-19T06:10:02.523099+0000","last_active":"2024-09-19T06:10:31.815533+0000","last_peered":"2024-09-19T06:10:31.815533+0000","last_clean":"2024-09-19T06:10:31.815533+0000","last_became_active":"2024-09-19T06:10:02.522770+0000","last_became_peered":"2024-09-19T06:10:02.522770+0000","last_unstale":"2024-09-19T06:10:31.815533+0000","last_undegraded":"2024-09-19T06:10:31.815533+0000","last_fullsized":"2024-09-19T06:10:31.815533+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:39.807159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T06:10:30.814855+0000","last_change":"2024-09-19T06:09:59.775371+0000","last_active":"2024-09-19T06:10:30.814855+0000","last_peered":"2024-09-19T06:10:30.814855+0000","last_clean":"2024-09-19T06:10:30.814855+0000","last_became_active":"2024-09-19T06:09:59.774944+0000","last_became_peered":"2024-09-19T06:09:59.774944+0000","last_unstale":"2024-09-19T06:10:30.814855+0000","last_undegraded":"2024-09-19T06:10:30.814855+0000","last_fullsized":"2024-09-19T06:10:30.814855+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:44.305005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815663+0000","last_change":"2024-09-19T06:10:02.521207+0000","last_active":"2024-09-19T06:10:31.815663+0000","last_peered":"2024-09-19T06:10:31.815663+0000","last_clean":"2024-09-19T06:10:31.815663+0000","last_became_active":"2024-09-19T06:10:02.520843+0000","last_became_peered":"2024-09-19T06:10:02.520843+0000","last_unstale":"2024-09-19T06:10:31.815663+0000","last_undegraded":"2024-09-19T06:10:31.815663+0000","last_fullsized":"2024-09-19T06:10:31.815663+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:39.462042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824516+0000","last_change":"2024-09-19T06:09:59.775259+0000","last_active":"2024-09-19T06:10:31.824516+0000","last_peered":"2024-09-19T06:10:31.824516+0000","last_clean":"2024-09-19T06:10:31.824516+0000","last_became_active":"2024-09-19T06:09:59.774393+0000","last_became_peered":"2024-09-19T06:09:59.774393+0000","last_unstale":"2024-09-19T06:10:31.824516+0000","last_undegraded":"2024-09-19T06:10:31.824516+0000","last_fullsized":"2024-09-19T06:10:31.824516+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:39:05.904778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816888+0000","last_change":"2024-09-19T06:10:02.516445+0000","last_active":"2024-09-19T06:10:31.816888+0000","last_peered":"2024-09-19T06:10:31.816888+0000","last_clean":"2024-09-19T06:10:31.816888+0000","last_became_active":"2024-09-19T06:10:02.515524+0000","last_became_peered":"2024-09-19T06:10:02.515524+0000","last_unstale":"2024-09-19T06:10:31.816888+0000","last_undegraded":"2024-09-19T06:10:31.816888+0000","last_fullsized":"2024-09-19T06:10:31.816888+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:42.863526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'12","reported_seq":35,"reported_epoch":86,"state":"peering","last_fresh":"2024-09-19T06:10:30.526161+0000","last_change":"2024-09-19T06:10:30.815586+0000","last_active":"2024-09-19T06:10:30.815586+0000","last_peered":"2024-09-19T06:10:30.526161+0000","last_clean":"2024-09-19T06:10:30.526161+0000","last_became_active":"2024-09-19T06:09:59.492281+0000","last_became_peered":"2024-09-19T06:09:59.492281+0000","last_unstale":"2024-09-19T06:10:30.526161+0000","last_undegraded":"2024-09-19T06:10:30.526161+0000","last_fullsized":"2024-09-19T06:10:30.526161+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3,8,11],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822787+0000","last_change":"2024-09-19T06:10:02.532473+0000","last_active":"2024-09-19T06:10:31.822787+0000","last_peered":"2024-09-19T06:10:31.822787+0000","last_clean":"2024-09-19T06:10:31.822787+0000","last_became_active":"2024-09-19T06:10:02.531745+0000","last_became_peered":"2024-09-19T06:10:02.531745+0000","last_unstale":"2024-09-19T06:10:31.822787+0000","last_undegraded":"2024-09-19T06:10:31.822787+0000","last_fullsized":"2024-09-19T06:10:31.822787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:22.659626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819369+0000","last_change":"2024-09-19T06:10:00.231383+0000","last_active":"2024-09-19T06:10:31.819369+0000","last_peered":"2024-09-19T06:10:31.819369+0000","last_clean":"2024-09-19T06:10:31.819369+0000","last_became_active":"2024-09-19T06:10:00.231016+0000","last_became_peered":"2024-09-19T06:10:00.231016+0000","last_unstale":"2024-09-19T06:10:31.819369+0000","last_undegraded":"2024-09-19T06:10:31.819369+0000","last_fullsized":"2024-09-19T06:10:31.819369+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:39:07.178556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816556+0000","last_change":"2024-09-19T06:10:02.532772+0000","last_active":"2024-09-19T06:10:31.816556+0000","last_peered":"2024-09-19T06:10:31.816556+0000","last_clean":"2024-09-19T06:10:31.816556+0000","last_became_active":"2024-09-19T06:10:02.528187+0000","last_became_peered":"2024-09-19T06:10:02.528187+0000","last_unstale":"2024-09-19T06:10:31.816556+0000","last_undegraded":"2024-09-19T06:10:31.816556+0000","last_fullsized":"2024-09-19T06:10:31.816556+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:35.550221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.950081+0000","last_change":"2024-09-19T06:09:59.774860+0000","last_active":"2024-09-19T06:10:31.950081+0000","last_peered":"2024-09-19T06:10:31.950081+0000","last_clean":"2024-09-19T06:10:31.950081+0000","last_became_active":"2024-09-19T06:09:59.774525+0000","last_became_peered":"2024-09-19T06:09:59.774525+0000","last_unstale":"2024-09-19T06:10:31.950081+0000","last_undegraded":"2024-09-19T06:10:31.950081+0000","last_fullsized":"2024-09-19T06:10:31.950081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:28.480611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823598+0000","last_change":"2024-09-19T06:10:02.514951+0000","last_active":"2024-09-19T06:10:31.823598+0000","last_peered":"2024-09-19T06:10:31.823598+0000","last_clean":"2024-09-19T06:10:31.823598+0000","last_became_active":"2024-09-19T06:10:02.514632+0000","last_became_peered":"2024-09-19T06:10:02.514632+0000","last_unstale":"2024-09-19T06:10:31.823598+0000","last_undegraded":"2024-09-19T06:10:31.823598+0000","last_fullsized":"2024-09-19T06:10:31.823598+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:58.225253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822496+0000","last_change":"2024-09-19T06:09:59.496203+0000","last_active":"2024-09-19T06:10:31.822496+0000","last_peered":"2024-09-19T06:10:31.822496+0000","last_clean":"2024-09-19T06:10:31.822496+0000","last_became_active":"2024-09-19T06:09:59.495854+0000","last_became_peered":"2024-09-19T06:09:59.495854+0000","last_unstale":"2024-09-19T06:10:31.822496+0000","last_undegraded":"2024-09-19T06:10:31.822496+0000","last_fullsized":"2024-09-19T06:10:31.822496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:43.388624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819866+0000","last_change":"2024-09-19T06:10:02.521713+0000","last_active":"2024-09-19T06:10:31.819866+0000","last_peered":"2024-09-19T06:10:31.819866+0000","last_clean":"2024-09-19T06:10:31.819866+0000","last_became_active":"2024-09-19T06:10:02.521389+0000","last_became_peered":"2024-09-19T06:10:02.521389+0000","last_unstale":"2024-09-19T06:10:31.819866+0000","last_undegraded":"2024-09-19T06:10:31.819866+0000","last_fullsized":"2024-09-19T06:10:31.819866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:34.441627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819038+0000","last_change":"2024-09-19T06:09:59.492636+0000","last_active":"2024-09-19T06:10:31.819038+0000","last_peered":"2024-09-19T06:10:31.819038+0000","last_clean":"2024-09-19T06:10:31.819038+0000","last_became_active":"2024-09-19T06:09:59.491801+0000","last_became_peered":"2024-09-19T06:09:59.491801+0000","last_unstale":"2024-09-19T06:10:31.819038+0000","last_undegraded":"2024-09-19T06:10:31.819038+0000","last_fullsized":"2024-09-19T06:10:31.819038+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:27.911582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822238+0000","last_change":"2024-09-19T06:10:02.527073+0000","last_active":"2024-09-19T06:10:31.822238+0000","last_peered":"2024-09-19T06:10:31.822238+0000","last_clean":"2024-09-19T06:10:31.822238+0000","last_became_active":"2024-09-19T06:10:02.525847+0000","last_became_peered":"2024-09-19T06:10:02.525847+0000","last_unstale":"2024-09-19T06:10:31.822238+0000","last_undegraded":"2024-09-19T06:10:31.822238+0000","last_fullsized":"2024-09-19T06:10:31.822238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:22.717353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823978+0000","last_change":"2024-09-19T06:09:59.493905+0000","last_active":"2024-09-19T06:10:31.823978+0000","last_peered":"2024-09-19T06:10:31.823978+0000","last_clean":"2024-09-19T06:10:31.823978+0000","last_became_active":"2024-09-19T06:09:59.493517+0000","last_became_peered":"2024-09-19T06:09:59.493517+0000","last_unstale":"2024-09-19T06:10:31.823978+0000","last_undegraded":"2024-09-19T06:10:31.823978+0000","last_fullsized":"2024-09-19T06:10:31.823978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:22.959756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822361+0000","last_change":"2024-09-19T06:10:02.518002+0000","last_active":"2024-09-19T06:10:31.822361+0000","last_peered":"2024-09-19T06:10:31.822361+0000","last_clean":"2024-09-19T06:10:31.822361+0000","last_became_active":"2024-09-19T06:10:02.517492+0000","last_became_peered":"2024-09-19T06:10:02.517492+0000","last_unstale":"2024-09-19T06:10:31.822361+0000","last_undegraded":"2024-09-19T06:10:31.822361+0000","last_fullsized":"2024-09-19T06:10:31.822361+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:58.935232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.951506+0000","last_change":"2024-09-19T06:10:31.951506+0000","last_active":"2024-09-19T06:10:31.951506+0000","last_peered":"2024-09-19T06:10:31.951506+0000","last_clean":"2024-09-19T06:10:31.951506+0000","last_became_active":"2024-09-19T06:10:31.951079+0000","last_became_peered":"2024-09-19T06:10:31.951079+0000","last_unstale":"2024-09-19T06:10:31.951506+0000","last_undegraded":"2024-09-19T06:10:31.951506+0000","last_fullsized":"2024-09-19T06:10:31.951506+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:53.978445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824216+0000","last_change":"2024-09-19T06:09:59.496546+0000","last_active":"2024-09-19T06:10:31.824216+0000","last_peered":"2024-09-19T06:10:31.824216+0000","last_clean":"2024-09-19T06:10:31.824216+0000","last_became_active":"2024-09-19T06:09:59.496195+0000","last_became_peered":"2024-09-19T06:09:59.496195+0000","last_unstale":"2024-09-19T06:10:31.824216+0000","last_undegraded":"2024-09-19T06:10:31.824216+0000","last_fullsized":"2024-09-19T06:10:31.824216+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:58.443134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.950061+0000","last_change":"2024-09-19T06:10:02.522270+0000","last_active":"2024-09-19T06:10:31.950061+0000","last_peered":"2024-09-19T06:10:31.950061+0000","last_clean":"2024-09-19T06:10:31.950061+0000","last_became_active":"2024-09-19T06:10:02.517109+0000","last_became_peered":"2024-09-19T06:10:02.517109+0000","last_unstale":"2024-09-19T06:10:31.950061+0000","last_undegraded":"2024-09-19T06:10:31.950061+0000","last_fullsized":"2024-09-19T06:10:31.950061+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:56.967980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824448+0000","last_change":"2024-09-19T06:09:59.494016+0000","last_active":"2024-09-19T06:10:31.824448+0000","last_peered":"2024-09-19T06:10:31.824448+0000","last_clean":"2024-09-19T06:10:31.824448+0000","last_became_active":"2024-09-19T06:09:59.493525+0000","last_became_peered":"2024-09-19T06:09:59.493525+0000","last_unstale":"2024-09-19T06:10:31.824448+0000","last_undegraded":"2024-09-19T06:10:31.824448+0000","last_fullsized":"2024-09-19T06:10:31.824448+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:06.650633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.817372+0000","last_change":"2024-09-19T06:10:02.531329+0000","last_active":"2024-09-19T06:10:31.817372+0000","last_peered":"2024-09-19T06:10:31.817372+0000","last_clean":"2024-09-19T06:10:31.817372+0000","last_became_active":"2024-09-19T06:10:02.527107+0000","last_became_peered":"2024-09-19T06:10:02.527107+0000","last_unstale":"2024-09-19T06:10:31.817372+0000","last_undegraded":"2024-09-19T06:10:31.817372+0000","last_fullsized":"2024-09-19T06:10:31.817372+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:25.891416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823419+0000","last_change":"2024-09-19T06:09:59.774966+0000","last_active":"2024-09-19T06:10:31.823419+0000","last_peered":"2024-09-19T06:10:31.823419+0000","last_clean":"2024-09-19T06:10:31.823419+0000","last_became_active":"2024-09-19T06:09:59.774038+0000","last_became_peered":"2024-09-19T06:09:59.774038+0000","last_unstale":"2024-09-19T06:10:31.823419+0000","last_undegraded":"2024-09-19T06:10:31.823419+0000","last_fullsized":"2024-09-19T06:10:31.823419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:54.703512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":2,"reported_epoch":87,"state":"peering","last_fresh":"2024-09-19T06:10:02.510342+0000","last_change":"2024-09-19T06:10:31.736019+0000","last_active":"2024-09-19T06:10:01.486359+0000","last_peered":"2024-09-19T06:10:01.486359+0000","last_clean":"2024-09-19T06:10:01.486359+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T06:10:02.510342+0000","last_undegraded":"2024-09-19T06:10:02.510342+0000","last_fullsized":"2024-09-19T06:10:02.510342+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":51,"reported_epoch":86,"state":"peering","last_fresh":"2024-09-19T06:10:30.799075+0000","last_change":"2024-09-19T06:10:30.815751+0000","last_active":"2024-09-19T06:10:30.815751+0000","last_peered":"2024-09-19T06:10:30.799075+0000","last_clean":"2024-09-19T06:10:30.799075+0000","last_became_active":"2024-09-19T06:09:59.498871+0000","last_became_peered":"2024-09-19T06:09:59.498871+0000","last_unstale":"2024-09-19T06:10:30.799075+0000","last_undegraded":"2024-09-19T06:10:30.799075+0000","last_fullsized":"2024-09-19T06:10:30.799075+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,7,8],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":57320,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":158,"num_read_kb":150,"num_write":235,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":2185,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":180474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282250,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449107,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":970752,"data_stored":468494,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678041,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1097728,"data_stored":1100103,"data_compressed":38784,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841565,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":974848,"data_stored":458892,"data_compressed":2884,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103205,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":974848,"data_stored":467115,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332138,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1036288,"data_stored":1060700,"data_compressed":41671,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495663,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":970752,"data_stored":467519,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757301,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1036288,"data_stored":1051468,"data_compressed":38784,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920826,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":978944,"data_stored":468157,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149759,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":987136,"data_stored":466951,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":521851,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1032192,"data_stored":519216,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":991232,"data_stored":468465,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34250,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34250,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34250,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":57186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":55564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":51848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:10:37.840 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:10:38.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:37 smithi003 ceph-mon[30893]: pgmap v321: 97 pgs: 3 peering, 94 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.5 KiB/s wr, 4 op/s; 273 B/s, 0 objects/s recovering 2024-09-19T06:10:38.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:37 smithi003 ceph-mon[30893]: from='client.24685 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:10:38.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:37 smithi071 ceph-mon[35662]: pgmap v321: 97 pgs: 3 peering, 94 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.5 KiB/s wr, 4 op/s; 273 B/s, 0 objects/s recovering 2024-09-19T06:10:38.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:37 smithi071 ceph-mon[35662]: from='client.24685 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:10:38.221 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:38.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:37 smithi059 ceph-mon[35138]: pgmap v321: 97 pgs: 3 peering, 94 active+clean; 633 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.5 KiB/s wr, 4 op/s; 273 B/s, 0 objects/s recovering 2024-09-19T06:10:38.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:37 smithi059 ceph-mon[35138]: from='client.24685 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:10:38.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.817+0000 7fc669e00640 1 -- 172.21.15.3:0/1488247884 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc664104010 msgr2=0x7fc6641043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:38.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.817+0000 7fc669e00640 1 --2- 172.21.15.3:0/1488247884 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc664104010 0x7fc6641043f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc654009900 tx=0x7fc65402a410 comp rx=0 tx=0).stop 2024-09-19T06:10:38.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.817+0000 7fc669e00640 1 -- 172.21.15.3:0/1488247884 shutdown_connections 2024-09-19T06:10:38.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.817+0000 7fc669e00640 1 --2- 172.21.15.3:0/1488247884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc664109140 0x7fc664110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:38.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.817+0000 7fc669e00640 1 --2- 172.21.15.3:0/1488247884 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc6641049c0 0x7fc664108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:38.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.817+0000 7fc669e00640 1 --2- 172.21.15.3:0/1488247884 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc664104010 0x7fc6641043f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:38.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.817+0000 7fc669e00640 1 -- 172.21.15.3:0/1488247884 >> 172.21.15.3:0/1488247884 conn(0x7fc6640ffa50 msgr2=0x7fc664101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:38.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.817+0000 7fc669e00640 1 -- 172.21.15.3:0/1488247884 shutdown_connections 2024-09-19T06:10:38.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.817+0000 7fc669e00640 1 -- 172.21.15.3:0/1488247884 wait complete. 2024-09-19T06:10:38.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.818+0000 7fc669e00640 1 Processor -- start 2024-09-19T06:10:38.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.819+0000 7fc669e00640 1 -- start start 2024-09-19T06:10:38.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.819+0000 7fc669e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc664104010 0x7fc66419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:38.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.819+0000 7fc669e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6641049c0 0x7fc66419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:38.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.819+0000 7fc669e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc664109140 0x7fc66419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:38.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.819+0000 7fc669e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc664114190 con 0x7fc6641049c0 2024-09-19T06:10:38.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.819+0000 7fc669e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc664114010 con 0x7fc664109140 2024-09-19T06:10:38.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.819+0000 7fc669e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc664114310 con 0x7fc664104010 2024-09-19T06:10:38.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.819+0000 7fc662000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6641049c0 0x7fc66419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:38.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.819+0000 7fc662a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc664104010 0x7fc66419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:38.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.819+0000 7fc662000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6641049c0 0x7fc66419abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45114/0 (socket says 172.21.15.3:45114) 2024-09-19T06:10:38.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.819+0000 7fc662000640 1 -- 172.21.15.3:0/681658404 learned_addr learned my addr 172.21.15.3:0/681658404 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:38.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.819+0000 7fc663400640 1 --2- 172.21.15.3:0/681658404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc664109140 0x7fc66419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:38.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.820+0000 7fc662a00640 1 -- 172.21.15.3:0/681658404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc664109140 msgr2=0x7fc66419ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:38.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.820+0000 7fc662a00640 1 --2- 172.21.15.3:0/681658404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc664109140 0x7fc66419ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:38.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.820+0000 7fc662a00640 1 -- 172.21.15.3:0/681658404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6641049c0 msgr2=0x7fc66419abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:38.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.820+0000 7fc662a00640 1 --2- 172.21.15.3:0/681658404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6641049c0 0x7fc66419abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:38.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.820+0000 7fc662a00640 1 -- 172.21.15.3:0/681658404 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66419f660 con 0x7fc664104010 2024-09-19T06:10:38.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.820+0000 7fc663400640 1 --2- 172.21.15.3:0/681658404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc664109140 0x7fc66419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:10:38.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.820+0000 7fc662000640 1 --2- 172.21.15.3:0/681658404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6641049c0 0x7fc66419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:38.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.820+0000 7fc662a00640 1 --2- 172.21.15.3:0/681658404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc664104010 0x7fc66419a6b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc65402a930 tx=0x7fc654003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:38.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.820+0000 7fc668a00640 1 -- 172.21.15.3:0/681658404 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65403f070 con 0x7fc664104010 2024-09-19T06:10:38.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.820+0000 7fc668a00640 1 -- 172.21.15.3:0/681658404 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc654031c90 con 0x7fc664104010 2024-09-19T06:10:38.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.820+0000 7fc669e00640 1 -- 172.21.15.3:0/681658404 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc66419f8f0 con 0x7fc664104010 2024-09-19T06:10:38.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.820+0000 7fc668a00640 1 -- 172.21.15.3:0/681658404 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc654035030 con 0x7fc664104010 2024-09-19T06:10:38.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.820+0000 7fc669e00640 1 -- 172.21.15.3:0/681658404 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6641a7230 con 0x7fc664104010 2024-09-19T06:10:38.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.821+0000 7fc669e00640 1 -- 172.21.15.3:0/681658404 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6641054f0 con 0x7fc664104010 2024-09-19T06:10:38.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.823+0000 7fc668a00640 1 -- 172.21.15.3:0/681658404 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fc654042070 con 0x7fc664104010 2024-09-19T06:10:38.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.825+0000 7fc668a00640 1 --2- 172.21.15.3:0/681658404 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc6480a32d0 0x7fc6480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:38.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.825+0000 7fc668a00640 1 -- 172.21.15.3:0/681658404 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fc6540f0ab0 con 0x7fc664104010 2024-09-19T06:10:38.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.825+0000 7fc662000640 1 --2- 172.21.15.3:0/681658404 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc6480a32d0 0x7fc6480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:38.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.825+0000 7fc662000640 1 --2- 172.21.15.3:0/681658404 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc6480a32d0 0x7fc6480a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc6640ffe70 tx=0x7fc650005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:38.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:38.827+0000 7fc668a00640 1 -- 172.21.15.3:0/681658404 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc6540bd5f0 con 0x7fc664104010 2024-09-19T06:10:39.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:39.009+0000 7fc669e00640 1 -- 172.21.15.3:0/681658404 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc664062630 con 0x7fc6480a32d0 2024-09-19T06:10:39.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:39.016+0000 7fc668a00640 1 -- 172.21.15.3:0/681658404 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259093 (secure 0 0 0) 0x7fc664062630 con 0x7fc6480a32d0 2024-09-19T06:10:39.019 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:10:39.020 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-19T06:10:39.022 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:39.020+0000 7fc669e00640 1 -- 172.21.15.3:0/681658404 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc6480a32d0 msgr2=0x7fc6480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:39.022 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:39.020+0000 7fc669e00640 1 --2- 172.21.15.3:0/681658404 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc6480a32d0 0x7fc6480a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc6640ffe70 tx=0x7fc650005f90 comp rx=0 tx=0).stop 2024-09-19T06:10:39.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:39.020+0000 7fc669e00640 1 -- 172.21.15.3:0/681658404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc664104010 msgr2=0x7fc66419a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:39.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:39.020+0000 7fc669e00640 1 --2- 172.21.15.3:0/681658404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc664104010 0x7fc66419a6b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc65402a930 tx=0x7fc654003b20 comp rx=0 tx=0).stop 2024-09-19T06:10:39.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:39.020+0000 7fc669e00640 1 -- 172.21.15.3:0/681658404 shutdown_connections 2024-09-19T06:10:39.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:39.020+0000 7fc669e00640 1 --2- 172.21.15.3:0/681658404 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc6480a32d0 0x7fc6480a5790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:39.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:39.020+0000 7fc669e00640 1 --2- 172.21.15.3:0/681658404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc664109140 0x7fc66419ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:39.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:39.020+0000 7fc669e00640 1 --2- 172.21.15.3:0/681658404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc6641049c0 0x7fc66419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:39.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:39.020+0000 7fc669e00640 1 --2- 172.21.15.3:0/681658404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc664104010 0x7fc66419a6b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:39.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:39.020+0000 7fc669e00640 1 -- 172.21.15.3:0/681658404 >> 172.21.15.3:0/681658404 conn(0x7fc6640ffa50 msgr2=0x7fc664100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:39.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:39.020+0000 7fc669e00640 1 -- 172.21.15.3:0/681658404 shutdown_connections 2024-09-19T06:10:39.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:39.020+0000 7fc669e00640 1 -- 172.21.15.3:0/681658404 wait complete. 2024-09-19T06:10:39.866 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2024-09-19T06:10:38.139526+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652179,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":327,"num_read_kb":292,"num_write":425,"num_write_kb":3067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1183593,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":346,"ondisk_log_size":346,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":293,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365308,"kb_used_data":11840,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576516,"statfs":{"total":1151940427776,"available":1151566352384,"internally_reserved":0,"allocated":12124160,"data_stored":7547724,"data_compressed":176952,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19140,"internal_metadata":361674044},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":27422,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":58,"num_write":20,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2857,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001984"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.821380+0000","last_change":"2024-09-19T06:10:02.531329+0000","last_active":"2024-09-19T06:10:31.821380+0000","last_peered":"2024-09-19T06:10:31.821380+0000","last_clean":"2024-09-19T06:10:31.821380+0000","last_became_active":"2024-09-19T06:10:02.530997+0000","last_became_peered":"2024-09-19T06:10:02.530997+0000","last_unstale":"2024-09-19T06:10:31.821380+0000","last_undegraded":"2024-09-19T06:10:31.821380+0000","last_fullsized":"2024-09-19T06:10:31.821380+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:15.240495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816455+0000","last_change":"2024-09-19T06:10:02.526083+0000","last_active":"2024-09-19T06:10:31.816455+0000","last_peered":"2024-09-19T06:10:31.816455+0000","last_clean":"2024-09-19T06:10:31.816455+0000","last_became_active":"2024-09-19T06:10:02.522889+0000","last_became_peered":"2024-09-19T06:10:02.522889+0000","last_unstale":"2024-09-19T06:10:31.816455+0000","last_undegraded":"2024-09-19T06:10:31.816455+0000","last_fullsized":"2024-09-19T06:10:31.816455+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:19.735866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816994+0000","last_change":"2024-09-19T06:10:02.531779+0000","last_active":"2024-09-19T06:10:31.816994+0000","last_peered":"2024-09-19T06:10:31.816994+0000","last_clean":"2024-09-19T06:10:31.816994+0000","last_became_active":"2024-09-19T06:10:02.526795+0000","last_became_peered":"2024-09-19T06:10:02.526795+0000","last_unstale":"2024-09-19T06:10:31.816994+0000","last_undegraded":"2024-09-19T06:10:31.816994+0000","last_fullsized":"2024-09-19T06:10:31.816994+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:28.800773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819230+0000","last_change":"2024-09-19T06:10:02.518697+0000","last_active":"2024-09-19T06:10:31.819230+0000","last_peered":"2024-09-19T06:10:31.819230+0000","last_clean":"2024-09-19T06:10:31.819230+0000","last_became_active":"2024-09-19T06:10:02.518114+0000","last_became_peered":"2024-09-19T06:10:02.518114+0000","last_unstale":"2024-09-19T06:10:31.819230+0000","last_undegraded":"2024-09-19T06:10:31.819230+0000","last_fullsized":"2024-09-19T06:10:31.819230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:08.172638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823875+0000","last_change":"2024-09-19T06:10:02.520450+0000","last_active":"2024-09-19T06:10:31.823875+0000","last_peered":"2024-09-19T06:10:31.823875+0000","last_clean":"2024-09-19T06:10:31.823875+0000","last_became_active":"2024-09-19T06:10:02.519079+0000","last_became_peered":"2024-09-19T06:10:02.519079+0000","last_unstale":"2024-09-19T06:10:31.823875+0000","last_undegraded":"2024-09-19T06:10:31.823875+0000","last_fullsized":"2024-09-19T06:10:31.823875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:47.502020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815408+0000","last_change":"2024-09-19T06:10:02.518567+0000","last_active":"2024-09-19T06:10:31.815408+0000","last_peered":"2024-09-19T06:10:31.815408+0000","last_clean":"2024-09-19T06:10:31.815408+0000","last_became_active":"2024-09-19T06:10:02.517568+0000","last_became_peered":"2024-09-19T06:10:02.517568+0000","last_unstale":"2024-09-19T06:10:31.815408+0000","last_undegraded":"2024-09-19T06:10:31.815408+0000","last_fullsized":"2024-09-19T06:10:31.815408+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:10.245189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822197+0000","last_change":"2024-09-19T06:10:02.521844+0000","last_active":"2024-09-19T06:10:31.822197+0000","last_peered":"2024-09-19T06:10:31.822197+0000","last_clean":"2024-09-19T06:10:31.822197+0000","last_became_active":"2024-09-19T06:10:02.521522+0000","last_became_peered":"2024-09-19T06:10:02.521522+0000","last_unstale":"2024-09-19T06:10:31.822197+0000","last_undegraded":"2024-09-19T06:10:31.822197+0000","last_fullsized":"2024-09-19T06:10:31.822197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:46.166077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.821465+0000","last_change":"2024-09-19T06:10:02.526977+0000","last_active":"2024-09-19T06:10:31.821465+0000","last_peered":"2024-09-19T06:10:31.821465+0000","last_clean":"2024-09-19T06:10:31.821465+0000","last_became_active":"2024-09-19T06:10:02.526036+0000","last_became_peered":"2024-09-19T06:10:02.526036+0000","last_unstale":"2024-09-19T06:10:31.821465+0000","last_undegraded":"2024-09-19T06:10:31.821465+0000","last_fullsized":"2024-09-19T06:10:31.821465+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:43:28.587020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.950831+0000","last_change":"2024-09-19T06:10:02.524721+0000","last_active":"2024-09-19T06:10:31.950831+0000","last_peered":"2024-09-19T06:10:31.950831+0000","last_clean":"2024-09-19T06:10:31.950831+0000","last_became_active":"2024-09-19T06:10:02.523871+0000","last_became_peered":"2024-09-19T06:10:02.523871+0000","last_unstale":"2024-09-19T06:10:31.950831+0000","last_undegraded":"2024-09-19T06:10:31.950831+0000","last_fullsized":"2024-09-19T06:10:31.950831+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:31.324530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815849+0000","last_change":"2024-09-19T06:10:02.518494+0000","last_active":"2024-09-19T06:10:31.815849+0000","last_peered":"2024-09-19T06:10:31.815849+0000","last_clean":"2024-09-19T06:10:31.815849+0000","last_became_active":"2024-09-19T06:10:02.518140+0000","last_became_peered":"2024-09-19T06:10:02.518140+0000","last_unstale":"2024-09-19T06:10:31.815849+0000","last_undegraded":"2024-09-19T06:10:31.815849+0000","last_fullsized":"2024-09-19T06:10:31.815849+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:42.695222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822993+0000","last_change":"2024-09-19T06:10:02.524697+0000","last_active":"2024-09-19T06:10:31.822993+0000","last_peered":"2024-09-19T06:10:31.822993+0000","last_clean":"2024-09-19T06:10:31.822993+0000","last_became_active":"2024-09-19T06:10:02.524094+0000","last_became_peered":"2024-09-19T06:10:02.524094+0000","last_unstale":"2024-09-19T06:10:31.822993+0000","last_undegraded":"2024-09-19T06:10:31.822993+0000","last_fullsized":"2024-09-19T06:10:31.822993+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:12.591847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819323+0000","last_change":"2024-09-19T06:10:02.515878+0000","last_active":"2024-09-19T06:10:31.819323+0000","last_peered":"2024-09-19T06:10:31.819323+0000","last_clean":"2024-09-19T06:10:31.819323+0000","last_became_active":"2024-09-19T06:10:02.515456+0000","last_became_peered":"2024-09-19T06:10:02.515456+0000","last_unstale":"2024-09-19T06:10:31.819323+0000","last_undegraded":"2024-09-19T06:10:31.819323+0000","last_fullsized":"2024-09-19T06:10:31.819323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:58.687431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824936+0000","last_change":"2024-09-19T06:10:31.824936+0000","last_active":"2024-09-19T06:10:31.824936+0000","last_peered":"2024-09-19T06:10:31.824936+0000","last_clean":"2024-09-19T06:10:31.824936+0000","last_became_active":"2024-09-19T06:10:31.824611+0000","last_became_peered":"2024-09-19T06:10:31.824611+0000","last_unstale":"2024-09-19T06:10:31.824936+0000","last_undegraded":"2024-09-19T06:10:31.824936+0000","last_fullsized":"2024-09-19T06:10:31.824936+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:36.397693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815684+0000","last_change":"2024-09-19T06:10:02.513397+0000","last_active":"2024-09-19T06:10:31.815684+0000","last_peered":"2024-09-19T06:10:31.815684+0000","last_clean":"2024-09-19T06:10:31.815684+0000","last_became_active":"2024-09-19T06:10:02.513011+0000","last_became_peered":"2024-09-19T06:10:02.513011+0000","last_unstale":"2024-09-19T06:10:31.815684+0000","last_undegraded":"2024-09-19T06:10:31.815684+0000","last_fullsized":"2024-09-19T06:10:31.815684+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:06:03.509401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815644+0000","last_change":"2024-09-19T06:10:02.521623+0000","last_active":"2024-09-19T06:10:31.815644+0000","last_peered":"2024-09-19T06:10:31.815644+0000","last_clean":"2024-09-19T06:10:31.815644+0000","last_became_active":"2024-09-19T06:10:02.519371+0000","last_became_peered":"2024-09-19T06:10:02.519371+0000","last_unstale":"2024-09-19T06:10:31.815644+0000","last_undegraded":"2024-09-19T06:10:31.815644+0000","last_fullsized":"2024-09-19T06:10:31.815644+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:10.687026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.949882+0000","last_change":"2024-09-19T06:10:02.520865+0000","last_active":"2024-09-19T06:10:31.949882+0000","last_peered":"2024-09-19T06:10:31.949882+0000","last_clean":"2024-09-19T06:10:31.949882+0000","last_became_active":"2024-09-19T06:10:02.519683+0000","last_became_peered":"2024-09-19T06:10:02.519683+0000","last_unstale":"2024-09-19T06:10:31.949882+0000","last_undegraded":"2024-09-19T06:10:31.949882+0000","last_fullsized":"2024-09-19T06:10:31.949882+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:40.320474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.821336+0000","last_change":"2024-09-19T06:10:02.531552+0000","last_active":"2024-09-19T06:10:31.821336+0000","last_peered":"2024-09-19T06:10:31.821336+0000","last_clean":"2024-09-19T06:10:31.821336+0000","last_became_active":"2024-09-19T06:10:02.531081+0000","last_became_peered":"2024-09-19T06:10:02.531081+0000","last_unstale":"2024-09-19T06:10:31.821336+0000","last_undegraded":"2024-09-19T06:10:31.821336+0000","last_fullsized":"2024-09-19T06:10:31.821336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:07.835754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820977+0000","last_change":"2024-09-19T06:10:02.509088+0000","last_active":"2024-09-19T06:10:31.820977+0000","last_peered":"2024-09-19T06:10:31.820977+0000","last_clean":"2024-09-19T06:10:31.820977+0000","last_became_active":"2024-09-19T06:10:02.508752+0000","last_became_peered":"2024-09-19T06:10:02.508752+0000","last_unstale":"2024-09-19T06:10:31.820977+0000","last_undegraded":"2024-09-19T06:10:31.820977+0000","last_fullsized":"2024-09-19T06:10:31.820977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:36.832952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819925+0000","last_change":"2024-09-19T06:10:02.534694+0000","last_active":"2024-09-19T06:10:31.819925+0000","last_peered":"2024-09-19T06:10:31.819925+0000","last_clean":"2024-09-19T06:10:31.819925+0000","last_became_active":"2024-09-19T06:10:02.534384+0000","last_became_peered":"2024-09-19T06:10:02.534384+0000","last_unstale":"2024-09-19T06:10:31.819925+0000","last_undegraded":"2024-09-19T06:10:31.819925+0000","last_fullsized":"2024-09-19T06:10:31.819925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:48.006128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819900+0000","last_change":"2024-09-19T06:10:02.521104+0000","last_active":"2024-09-19T06:10:31.819900+0000","last_peered":"2024-09-19T06:10:31.819900+0000","last_clean":"2024-09-19T06:10:31.819900+0000","last_became_active":"2024-09-19T06:10:02.520755+0000","last_became_peered":"2024-09-19T06:10:02.520755+0000","last_unstale":"2024-09-19T06:10:31.819900+0000","last_undegraded":"2024-09-19T06:10:31.819900+0000","last_fullsized":"2024-09-19T06:10:31.819900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:46.091297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.817016+0000","last_change":"2024-09-19T06:10:02.522048+0000","last_active":"2024-09-19T06:10:31.817016+0000","last_peered":"2024-09-19T06:10:31.817016+0000","last_clean":"2024-09-19T06:10:31.817016+0000","last_became_active":"2024-09-19T06:10:02.521750+0000","last_became_peered":"2024-09-19T06:10:02.521750+0000","last_unstale":"2024-09-19T06:10:31.817016+0000","last_undegraded":"2024-09-19T06:10:31.817016+0000","last_fullsized":"2024-09-19T06:10:31.817016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:07.780609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.950055+0000","last_change":"2024-09-19T06:10:02.527386+0000","last_active":"2024-09-19T06:10:31.950055+0000","last_peered":"2024-09-19T06:10:31.950055+0000","last_clean":"2024-09-19T06:10:31.950055+0000","last_became_active":"2024-09-19T06:10:02.526804+0000","last_became_peered":"2024-09-19T06:10:02.526804+0000","last_unstale":"2024-09-19T06:10:31.950055+0000","last_undegraded":"2024-09-19T06:10:31.950055+0000","last_fullsized":"2024-09-19T06:10:31.950055+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:15.652068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.821745+0000","last_change":"2024-09-19T06:10:02.528521+0000","last_active":"2024-09-19T06:10:31.821745+0000","last_peered":"2024-09-19T06:10:31.821745+0000","last_clean":"2024-09-19T06:10:31.821745+0000","last_became_active":"2024-09-19T06:10:02.528087+0000","last_became_peered":"2024-09-19T06:10:02.528087+0000","last_unstale":"2024-09-19T06:10:31.821745+0000","last_undegraded":"2024-09-19T06:10:31.821745+0000","last_fullsized":"2024-09-19T06:10:31.821745+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:29.176129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819851+0000","last_change":"2024-09-19T06:10:02.518544+0000","last_active":"2024-09-19T06:10:31.819851+0000","last_peered":"2024-09-19T06:10:31.819851+0000","last_clean":"2024-09-19T06:10:31.819851+0000","last_became_active":"2024-09-19T06:10:02.518230+0000","last_became_peered":"2024-09-19T06:10:02.518230+0000","last_unstale":"2024-09-19T06:10:31.819851+0000","last_undegraded":"2024-09-19T06:10:31.819851+0000","last_fullsized":"2024-09-19T06:10:31.819851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:26:32.116211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822472+0000","last_change":"2024-09-19T06:10:02.531859+0000","last_active":"2024-09-19T06:10:31.822472+0000","last_peered":"2024-09-19T06:10:31.822472+0000","last_clean":"2024-09-19T06:10:31.822472+0000","last_became_active":"2024-09-19T06:10:02.531572+0000","last_became_peered":"2024-09-19T06:10:02.531572+0000","last_unstale":"2024-09-19T06:10:31.822472+0000","last_undegraded":"2024-09-19T06:10:31.822472+0000","last_fullsized":"2024-09-19T06:10:31.822472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:34.314977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819440+0000","last_change":"2024-09-19T06:10:02.521292+0000","last_active":"2024-09-19T06:10:31.819440+0000","last_peered":"2024-09-19T06:10:31.819440+0000","last_clean":"2024-09-19T06:10:31.819440+0000","last_became_active":"2024-09-19T06:10:02.520967+0000","last_became_peered":"2024-09-19T06:10:02.520967+0000","last_unstale":"2024-09-19T06:10:31.819440+0000","last_undegraded":"2024-09-19T06:10:31.819440+0000","last_fullsized":"2024-09-19T06:10:31.819440+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:11.318504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820304+0000","last_change":"2024-09-19T06:10:02.521514+0000","last_active":"2024-09-19T06:10:31.820304+0000","last_peered":"2024-09-19T06:10:31.820304+0000","last_clean":"2024-09-19T06:10:31.820304+0000","last_became_active":"2024-09-19T06:10:02.521203+0000","last_became_peered":"2024-09-19T06:10:02.521203+0000","last_unstale":"2024-09-19T06:10:31.820304+0000","last_undegraded":"2024-09-19T06:10:31.820304+0000","last_fullsized":"2024-09-19T06:10:31.820304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:53.689067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824501+0000","last_change":"2024-09-19T06:10:31.824501+0000","last_active":"2024-09-19T06:10:31.824501+0000","last_peered":"2024-09-19T06:10:31.824501+0000","last_clean":"2024-09-19T06:10:31.824501+0000","last_became_active":"2024-09-19T06:10:31.824161+0000","last_became_peered":"2024-09-19T06:10:31.824161+0000","last_unstale":"2024-09-19T06:10:31.824501+0000","last_undegraded":"2024-09-19T06:10:31.824501+0000","last_fullsized":"2024-09-19T06:10:31.824501+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:28.203581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816369+0000","last_change":"2024-09-19T06:10:02.530351+0000","last_active":"2024-09-19T06:10:31.816369+0000","last_peered":"2024-09-19T06:10:31.816369+0000","last_clean":"2024-09-19T06:10:31.816369+0000","last_became_active":"2024-09-19T06:10:02.529292+0000","last_became_peered":"2024-09-19T06:10:02.529292+0000","last_unstale":"2024-09-19T06:10:31.816369+0000","last_undegraded":"2024-09-19T06:10:31.816369+0000","last_fullsized":"2024-09-19T06:10:31.816369+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:02.324413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819026+0000","last_change":"2024-09-19T06:10:02.534885+0000","last_active":"2024-09-19T06:10:31.819026+0000","last_peered":"2024-09-19T06:10:31.819026+0000","last_clean":"2024-09-19T06:10:31.819026+0000","last_became_active":"2024-09-19T06:10:02.534520+0000","last_became_peered":"2024-09-19T06:10:02.534520+0000","last_unstale":"2024-09-19T06:10:31.819026+0000","last_undegraded":"2024-09-19T06:10:31.819026+0000","last_fullsized":"2024-09-19T06:10:31.819026+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:04.896787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819767+0000","last_change":"2024-09-19T06:10:02.518120+0000","last_active":"2024-09-19T06:10:31.819767+0000","last_peered":"2024-09-19T06:10:31.819767+0000","last_clean":"2024-09-19T06:10:31.819767+0000","last_became_active":"2024-09-19T06:10:02.517595+0000","last_became_peered":"2024-09-19T06:10:02.517595+0000","last_unstale":"2024-09-19T06:10:31.819767+0000","last_undegraded":"2024-09-19T06:10:31.819767+0000","last_fullsized":"2024-09-19T06:10:31.819767+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:00.695783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819720+0000","last_change":"2024-09-19T06:10:02.524413+0000","last_active":"2024-09-19T06:10:31.819720+0000","last_peered":"2024-09-19T06:10:31.819720+0000","last_clean":"2024-09-19T06:10:31.819720+0000","last_became_active":"2024-09-19T06:10:02.523559+0000","last_became_peered":"2024-09-19T06:10:02.523559+0000","last_unstale":"2024-09-19T06:10:31.819720+0000","last_undegraded":"2024-09-19T06:10:31.819720+0000","last_fullsized":"2024-09-19T06:10:31.819720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:04.045759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823856+0000","last_change":"2024-09-19T06:10:02.514572+0000","last_active":"2024-09-19T06:10:31.823856+0000","last_peered":"2024-09-19T06:10:31.823856+0000","last_clean":"2024-09-19T06:10:31.823856+0000","last_became_active":"2024-09-19T06:10:02.513685+0000","last_became_peered":"2024-09-19T06:10:02.513685+0000","last_unstale":"2024-09-19T06:10:31.823856+0000","last_undegraded":"2024-09-19T06:10:31.823856+0000","last_fullsized":"2024-09-19T06:10:31.823856+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:09.108036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:32.828795+0000","last_change":"2024-09-19T06:10:31.829554+0000","last_active":"2024-09-19T06:10:32.828795+0000","last_peered":"2024-09-19T06:10:32.828795+0000","last_clean":"2024-09-19T06:10:32.828795+0000","last_became_active":"2024-09-19T06:10:31.824266+0000","last_became_peered":"2024-09-19T06:10:31.824266+0000","last_unstale":"2024-09-19T06:10:32.828795+0000","last_undegraded":"2024-09-19T06:10:32.828795+0000","last_fullsized":"2024-09-19T06:10:32.828795+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:07.241897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1015,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819853+0000","last_change":"2024-09-19T06:10:02.524271+0000","last_active":"2024-09-19T06:10:31.819853+0000","last_peered":"2024-09-19T06:10:31.819853+0000","last_clean":"2024-09-19T06:10:31.819853+0000","last_became_active":"2024-09-19T06:10:02.523948+0000","last_became_peered":"2024-09-19T06:10:02.523948+0000","last_unstale":"2024-09-19T06:10:31.819853+0000","last_undegraded":"2024-09-19T06:10:31.819853+0000","last_fullsized":"2024-09-19T06:10:31.819853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:46.406652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815443+0000","last_change":"2024-09-19T06:09:59.493186+0000","last_active":"2024-09-19T06:10:31.815443+0000","last_peered":"2024-09-19T06:10:31.815443+0000","last_clean":"2024-09-19T06:10:31.815443+0000","last_became_active":"2024-09-19T06:09:59.492841+0000","last_became_peered":"2024-09-19T06:09:59.492841+0000","last_unstale":"2024-09-19T06:10:31.815443+0000","last_undegraded":"2024-09-19T06:10:31.815443+0000","last_fullsized":"2024-09-19T06:10:31.815443+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:48.557724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816757+0000","last_change":"2024-09-19T06:09:59.493364+0000","last_active":"2024-09-19T06:10:31.816757+0000","last_peered":"2024-09-19T06:10:31.816757+0000","last_clean":"2024-09-19T06:10:31.816757+0000","last_became_active":"2024-09-19T06:09:59.491868+0000","last_became_peered":"2024-09-19T06:09:59.491868+0000","last_unstale":"2024-09-19T06:10:31.816757+0000","last_undegraded":"2024-09-19T06:10:31.816757+0000","last_fullsized":"2024-09-19T06:10:31.816757+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:23.088768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.821572+0000","last_change":"2024-09-19T06:10:02.534453+0000","last_active":"2024-09-19T06:10:31.821572+0000","last_peered":"2024-09-19T06:10:31.821572+0000","last_clean":"2024-09-19T06:10:31.821572+0000","last_became_active":"2024-09-19T06:10:02.532003+0000","last_became_peered":"2024-09-19T06:10:02.532003+0000","last_unstale":"2024-09-19T06:10:31.821572+0000","last_undegraded":"2024-09-19T06:10:31.821572+0000","last_fullsized":"2024-09-19T06:10:31.821572+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:41.609673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820651+0000","last_change":"2024-09-19T06:09:59.493574+0000","last_active":"2024-09-19T06:10:31.820651+0000","last_peered":"2024-09-19T06:10:31.820651+0000","last_clean":"2024-09-19T06:10:31.820651+0000","last_became_active":"2024-09-19T06:09:59.493243+0000","last_became_peered":"2024-09-19T06:09:59.493243+0000","last_unstale":"2024-09-19T06:10:31.820651+0000","last_undegraded":"2024-09-19T06:10:31.820651+0000","last_fullsized":"2024-09-19T06:10:31.820651+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:12:43.491780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820035+0000","last_change":"2024-09-19T06:10:02.520122+0000","last_active":"2024-09-19T06:10:31.820035+0000","last_peered":"2024-09-19T06:10:31.820035+0000","last_clean":"2024-09-19T06:10:31.820035+0000","last_became_active":"2024-09-19T06:10:02.519795+0000","last_became_peered":"2024-09-19T06:10:02.519795+0000","last_unstale":"2024-09-19T06:10:31.820035+0000","last_undegraded":"2024-09-19T06:10:31.820035+0000","last_fullsized":"2024-09-19T06:10:31.820035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:12.384824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":71,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:35.831418+0000","last_change":"2024-09-19T06:09:59.491192+0000","last_active":"2024-09-19T06:10:35.831418+0000","last_peered":"2024-09-19T06:10:35.831418+0000","last_clean":"2024-09-19T06:10:35.831418+0000","last_became_active":"2024-09-19T06:09:59.490774+0000","last_became_peered":"2024-09-19T06:09:59.490774+0000","last_unstale":"2024-09-19T06:10:35.831418+0000","last_undegraded":"2024-09-19T06:10:35.831418+0000","last_fullsized":"2024-09-19T06:10:35.831418+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:30.276512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.950309+0000","last_change":"2024-09-19T06:10:02.516728+0000","last_active":"2024-09-19T06:10:31.950309+0000","last_peered":"2024-09-19T06:10:31.950309+0000","last_clean":"2024-09-19T06:10:31.950309+0000","last_became_active":"2024-09-19T06:10:02.516415+0000","last_became_peered":"2024-09-19T06:10:02.516415+0000","last_unstale":"2024-09-19T06:10:31.950309+0000","last_undegraded":"2024-09-19T06:10:31.950309+0000","last_fullsized":"2024-09-19T06:10:31.950309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:45.012284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822879+0000","last_change":"2024-09-19T06:09:59.499167+0000","last_active":"2024-09-19T06:10:31.822879+0000","last_peered":"2024-09-19T06:10:31.822879+0000","last_clean":"2024-09-19T06:10:31.822879+0000","last_became_active":"2024-09-19T06:09:59.498796+0000","last_became_peered":"2024-09-19T06:09:59.498796+0000","last_unstale":"2024-09-19T06:10:31.822879+0000","last_undegraded":"2024-09-19T06:10:31.822879+0000","last_fullsized":"2024-09-19T06:10:31.822879+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:08.665495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823990+0000","last_change":"2024-09-19T06:10:31.823990+0000","last_active":"2024-09-19T06:10:31.823990+0000","last_peered":"2024-09-19T06:10:31.823990+0000","last_clean":"2024-09-19T06:10:31.823990+0000","last_became_active":"2024-09-19T06:10:31.823448+0000","last_became_peered":"2024-09-19T06:10:31.823448+0000","last_unstale":"2024-09-19T06:10:31.823990+0000","last_undegraded":"2024-09-19T06:10:31.823990+0000","last_fullsized":"2024-09-19T06:10:31.823990+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:33.882448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820128+0000","last_change":"2024-09-19T06:09:59.774875+0000","last_active":"2024-09-19T06:10:31.820128+0000","last_peered":"2024-09-19T06:10:31.820128+0000","last_clean":"2024-09-19T06:10:31.820128+0000","last_became_active":"2024-09-19T06:09:59.774376+0000","last_became_peered":"2024-09-19T06:09:59.774376+0000","last_unstale":"2024-09-19T06:10:31.820128+0000","last_undegraded":"2024-09-19T06:10:31.820128+0000","last_fullsized":"2024-09-19T06:10:31.820128+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:01.283578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.950220+0000","last_change":"2024-09-19T06:10:02.518202+0000","last_active":"2024-09-19T06:10:31.950220+0000","last_peered":"2024-09-19T06:10:31.950220+0000","last_clean":"2024-09-19T06:10:31.950220+0000","last_became_active":"2024-09-19T06:10:02.517865+0000","last_became_peered":"2024-09-19T06:10:02.517865+0000","last_unstale":"2024-09-19T06:10:31.950220+0000","last_undegraded":"2024-09-19T06:10:31.950220+0000","last_fullsized":"2024-09-19T06:10:31.950220+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:28.128891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'28","reported_seq":102,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:35.830736+0000","last_change":"2024-09-19T06:09:59.493139+0000","last_active":"2024-09-19T06:10:35.830736+0000","last_peered":"2024-09-19T06:10:35.830736+0000","last_clean":"2024-09-19T06:10:35.830736+0000","last_became_active":"2024-09-19T06:09:59.492768+0000","last_became_peered":"2024-09-19T06:09:59.492768+0000","last_unstale":"2024-09-19T06:10:35.830736+0000","last_undegraded":"2024-09-19T06:10:35.830736+0000","last_fullsized":"2024-09-19T06:10:35.830736+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:17.872432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54369,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":76,"num_write":30,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824313+0000","last_change":"2024-09-19T06:10:02.516187+0000","last_active":"2024-09-19T06:10:31.824313+0000","last_peered":"2024-09-19T06:10:31.824313+0000","last_clean":"2024-09-19T06:10:31.824313+0000","last_became_active":"2024-09-19T06:10:02.515888+0000","last_became_peered":"2024-09-19T06:10:02.515888+0000","last_unstale":"2024-09-19T06:10:31.824313+0000","last_undegraded":"2024-09-19T06:10:31.824313+0000","last_fullsized":"2024-09-19T06:10:31.824313+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:29.672889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819416+0000","last_change":"2024-09-19T06:09:59.492155+0000","last_active":"2024-09-19T06:10:31.819416+0000","last_peered":"2024-09-19T06:10:31.819416+0000","last_clean":"2024-09-19T06:10:31.819416+0000","last_became_active":"2024-09-19T06:09:59.491730+0000","last_became_peered":"2024-09-19T06:09:59.491730+0000","last_unstale":"2024-09-19T06:10:31.819416+0000","last_undegraded":"2024-09-19T06:10:31.819416+0000","last_fullsized":"2024-09-19T06:10:31.819416+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:30.632665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816446+0000","last_change":"2024-09-19T06:10:02.526214+0000","last_active":"2024-09-19T06:10:31.816446+0000","last_peered":"2024-09-19T06:10:31.816446+0000","last_clean":"2024-09-19T06:10:31.816446+0000","last_became_active":"2024-09-19T06:10:02.525846+0000","last_became_peered":"2024-09-19T06:10:02.525846+0000","last_unstale":"2024-09-19T06:10:31.816446+0000","last_undegraded":"2024-09-19T06:10:31.816446+0000","last_fullsized":"2024-09-19T06:10:31.816446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:14.294741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820233+0000","last_change":"2024-09-19T06:09:59.494814+0000","last_active":"2024-09-19T06:10:31.820233+0000","last_peered":"2024-09-19T06:10:31.820233+0000","last_clean":"2024-09-19T06:10:31.820233+0000","last_became_active":"2024-09-19T06:09:59.494461+0000","last_became_peered":"2024-09-19T06:09:59.494461+0000","last_unstale":"2024-09-19T06:10:31.820233+0000","last_undegraded":"2024-09-19T06:10:31.820233+0000","last_fullsized":"2024-09-19T06:10:31.820233+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:37.730327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823102+0000","last_change":"2024-09-19T06:10:02.518851+0000","last_active":"2024-09-19T06:10:31.823102+0000","last_peered":"2024-09-19T06:10:31.823102+0000","last_clean":"2024-09-19T06:10:31.823102+0000","last_became_active":"2024-09-19T06:10:02.518462+0000","last_became_peered":"2024-09-19T06:10:02.518462+0000","last_unstale":"2024-09-19T06:10:31.823102+0000","last_undegraded":"2024-09-19T06:10:31.823102+0000","last_fullsized":"2024-09-19T06:10:31.823102+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:22.629918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:35.793061+0000","last_change":"2024-09-19T06:09:59.493839+0000","last_active":"2024-09-19T06:10:35.793061+0000","last_peered":"2024-09-19T06:10:35.793061+0000","last_clean":"2024-09-19T06:10:35.793061+0000","last_became_active":"2024-09-19T06:09:59.492323+0000","last_became_peered":"2024-09-19T06:09:59.492323+0000","last_unstale":"2024-09-19T06:10:35.793061+0000","last_undegraded":"2024-09-19T06:10:35.793061+0000","last_fullsized":"2024-09-19T06:10:35.793061+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:12.754030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822340+0000","last_change":"2024-09-19T06:10:02.515957+0000","last_active":"2024-09-19T06:10:31.822340+0000","last_peered":"2024-09-19T06:10:31.822340+0000","last_clean":"2024-09-19T06:10:31.822340+0000","last_became_active":"2024-09-19T06:10:02.515493+0000","last_became_peered":"2024-09-19T06:10:02.515493+0000","last_unstale":"2024-09-19T06:10:31.822340+0000","last_undegraded":"2024-09-19T06:10:31.822340+0000","last_fullsized":"2024-09-19T06:10:31.822340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:06.988155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823601+0000","last_change":"2024-09-19T06:09:59.775131+0000","last_active":"2024-09-19T06:10:31.823601+0000","last_peered":"2024-09-19T06:10:31.823601+0000","last_clean":"2024-09-19T06:10:31.823601+0000","last_became_active":"2024-09-19T06:09:59.774642+0000","last_became_peered":"2024-09-19T06:09:59.774642+0000","last_unstale":"2024-09-19T06:10:31.823601+0000","last_undegraded":"2024-09-19T06:10:31.823601+0000","last_fullsized":"2024-09-19T06:10:31.823601+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:31.722485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819343+0000","last_change":"2024-09-19T06:10:02.522531+0000","last_active":"2024-09-19T06:10:31.819343+0000","last_peered":"2024-09-19T06:10:31.819343+0000","last_clean":"2024-09-19T06:10:31.819343+0000","last_became_active":"2024-09-19T06:10:02.522186+0000","last_became_peered":"2024-09-19T06:10:02.522186+0000","last_unstale":"2024-09-19T06:10:31.819343+0000","last_undegraded":"2024-09-19T06:10:31.819343+0000","last_fullsized":"2024-09-19T06:10:31.819343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:45.689043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824376+0000","last_change":"2024-09-19T06:09:59.494819+0000","last_active":"2024-09-19T06:10:31.824376+0000","last_peered":"2024-09-19T06:10:31.824376+0000","last_clean":"2024-09-19T06:10:31.824376+0000","last_became_active":"2024-09-19T06:09:59.494434+0000","last_became_peered":"2024-09-19T06:09:59.494434+0000","last_unstale":"2024-09-19T06:10:31.824376+0000","last_undegraded":"2024-09-19T06:10:31.824376+0000","last_fullsized":"2024-09-19T06:10:31.824376+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:42.207621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820312+0000","last_change":"2024-09-19T06:10:02.522893+0000","last_active":"2024-09-19T06:10:31.820312+0000","last_peered":"2024-09-19T06:10:31.820312+0000","last_clean":"2024-09-19T06:10:31.820312+0000","last_became_active":"2024-09-19T06:10:02.522596+0000","last_became_peered":"2024-09-19T06:10:02.522596+0000","last_unstale":"2024-09-19T06:10:31.820312+0000","last_undegraded":"2024-09-19T06:10:31.820312+0000","last_fullsized":"2024-09-19T06:10:31.820312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:21.394878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.838085+0000","last_change":"2024-09-19T06:10:31.838085+0000","last_active":"2024-09-19T06:10:31.838085+0000","last_peered":"2024-09-19T06:10:31.838085+0000","last_clean":"2024-09-19T06:10:31.838085+0000","last_became_active":"2024-09-19T06:10:31.826924+0000","last_became_peered":"2024-09-19T06:10:31.826924+0000","last_unstale":"2024-09-19T06:10:31.838085+0000","last_undegraded":"2024-09-19T06:10:31.838085+0000","last_fullsized":"2024-09-19T06:10:31.838085+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:19.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823274+0000","last_change":"2024-09-19T06:10:02.516137+0000","last_active":"2024-09-19T06:10:31.823274+0000","last_peered":"2024-09-19T06:10:31.823274+0000","last_clean":"2024-09-19T06:10:31.823274+0000","last_became_active":"2024-09-19T06:10:02.515769+0000","last_became_peered":"2024-09-19T06:10:02.515769+0000","last_unstale":"2024-09-19T06:10:31.823274+0000","last_undegraded":"2024-09-19T06:10:31.823274+0000","last_fullsized":"2024-09-19T06:10:31.823274+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:56.741950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820246+0000","last_change":"2024-09-19T06:09:59.498177+0000","last_active":"2024-09-19T06:10:31.820246+0000","last_peered":"2024-09-19T06:10:31.820246+0000","last_clean":"2024-09-19T06:10:31.820246+0000","last_became_active":"2024-09-19T06:09:59.497808+0000","last_became_peered":"2024-09-19T06:09:59.497808+0000","last_unstale":"2024-09-19T06:10:31.820246+0000","last_undegraded":"2024-09-19T06:10:31.820246+0000","last_fullsized":"2024-09-19T06:10:31.820246+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:06.473332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822740+0000","last_change":"2024-09-19T06:10:02.526442+0000","last_active":"2024-09-19T06:10:31.822740+0000","last_peered":"2024-09-19T06:10:31.822740+0000","last_clean":"2024-09-19T06:10:31.822740+0000","last_became_active":"2024-09-19T06:10:02.526116+0000","last_became_peered":"2024-09-19T06:10:02.526116+0000","last_unstale":"2024-09-19T06:10:31.822740+0000","last_undegraded":"2024-09-19T06:10:31.822740+0000","last_fullsized":"2024-09-19T06:10:31.822740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:05.000599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:35.830842+0000","last_change":"2024-09-19T06:10:31.829793+0000","last_active":"2024-09-19T06:10:35.830842+0000","last_peered":"2024-09-19T06:10:35.830842+0000","last_clean":"2024-09-19T06:10:35.830842+0000","last_became_active":"2024-09-19T06:10:31.822044+0000","last_became_peered":"2024-09-19T06:10:31.822044+0000","last_unstale":"2024-09-19T06:10:35.830842+0000","last_undegraded":"2024-09-19T06:10:35.830842+0000","last_fullsized":"2024-09-19T06:10:35.830842+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:45.301315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1170,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823112+0000","last_change":"2024-09-19T06:10:02.524435+0000","last_active":"2024-09-19T06:10:31.823112+0000","last_peered":"2024-09-19T06:10:31.823112+0000","last_clean":"2024-09-19T06:10:31.823112+0000","last_became_active":"2024-09-19T06:10:02.523634+0000","last_became_peered":"2024-09-19T06:10:02.523634+0000","last_unstale":"2024-09-19T06:10:31.823112+0000","last_undegraded":"2024-09-19T06:10:31.823112+0000","last_fullsized":"2024-09-19T06:10:31.823112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:07.679183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":349,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822606+0000","last_change":"2024-09-19T06:08:39.873247+0000","last_active":"2024-09-19T06:10:31.822606+0000","last_peered":"2024-09-19T06:10:31.822606+0000","last_clean":"2024-09-19T06:10:31.822606+0000","last_became_active":"2024-09-19T06:08:39.872647+0000","last_became_peered":"2024-09-19T06:08:39.872647+0000","last_unstale":"2024-09-19T06:10:31.822606+0000","last_undegraded":"2024-09-19T06:10:31.822606+0000","last_fullsized":"2024-09-19T06:10:31.822606+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:56.991890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:56.991890+0000","last_clean_scrub_stamp":"2024-09-19T06:04:56.991890+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:18.835510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.818858+0000","last_change":"2024-09-19T06:09:59.492677+0000","last_active":"2024-09-19T06:10:31.818858+0000","last_peered":"2024-09-19T06:10:31.818858+0000","last_clean":"2024-09-19T06:10:31.818858+0000","last_became_active":"2024-09-19T06:09:59.492235+0000","last_became_peered":"2024-09-19T06:09:59.492235+0000","last_unstale":"2024-09-19T06:10:31.818858+0000","last_undegraded":"2024-09-19T06:10:31.818858+0000","last_fullsized":"2024-09-19T06:10:31.818858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:40.173728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823152+0000","last_change":"2024-09-19T06:10:02.523331+0000","last_active":"2024-09-19T06:10:31.823152+0000","last_peered":"2024-09-19T06:10:31.823152+0000","last_clean":"2024-09-19T06:10:31.823152+0000","last_became_active":"2024-09-19T06:10:02.522896+0000","last_became_peered":"2024-09-19T06:10:02.522896+0000","last_unstale":"2024-09-19T06:10:31.823152+0000","last_undegraded":"2024-09-19T06:10:31.823152+0000","last_fullsized":"2024-09-19T06:10:31.823152+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:56.994375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822479+0000","last_change":"2024-09-19T06:09:59.496407+0000","last_active":"2024-09-19T06:10:31.822479+0000","last_peered":"2024-09-19T06:10:31.822479+0000","last_clean":"2024-09-19T06:10:31.822479+0000","last_became_active":"2024-09-19T06:09:59.496074+0000","last_became_peered":"2024-09-19T06:09:59.496074+0000","last_unstale":"2024-09-19T06:10:31.822479+0000","last_undegraded":"2024-09-19T06:10:31.822479+0000","last_fullsized":"2024-09-19T06:10:31.822479+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:11.257227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815458+0000","last_change":"2024-09-19T06:10:02.515229+0000","last_active":"2024-09-19T06:10:31.815458+0000","last_peered":"2024-09-19T06:10:31.815458+0000","last_clean":"2024-09-19T06:10:31.815458+0000","last_became_active":"2024-09-19T06:10:02.514092+0000","last_became_peered":"2024-09-19T06:10:02.514092+0000","last_unstale":"2024-09-19T06:10:31.815458+0000","last_undegraded":"2024-09-19T06:10:31.815458+0000","last_fullsized":"2024-09-19T06:10:31.815458+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:32:36.805821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:32.788016+0000","last_change":"2024-09-19T06:09:59.777102+0000","last_active":"2024-09-19T06:10:32.788016+0000","last_peered":"2024-09-19T06:10:32.788016+0000","last_clean":"2024-09-19T06:10:32.788016+0000","last_became_active":"2024-09-19T06:09:59.774456+0000","last_became_peered":"2024-09-19T06:09:59.774456+0000","last_unstale":"2024-09-19T06:10:32.788016+0000","last_undegraded":"2024-09-19T06:10:32.788016+0000","last_fullsized":"2024-09-19T06:10:32.788016+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:11.353528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820463+0000","last_change":"2024-09-19T06:10:02.517039+0000","last_active":"2024-09-19T06:10:31.820463+0000","last_peered":"2024-09-19T06:10:31.820463+0000","last_clean":"2024-09-19T06:10:31.820463+0000","last_became_active":"2024-09-19T06:10:02.516291+0000","last_became_peered":"2024-09-19T06:10:02.516291+0000","last_unstale":"2024-09-19T06:10:31.820463+0000","last_undegraded":"2024-09-19T06:10:31.820463+0000","last_fullsized":"2024-09-19T06:10:31.820463+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:27.835967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:32.954501+0000","last_change":"2024-09-19T06:09:59.499496+0000","last_active":"2024-09-19T06:10:32.954501+0000","last_peered":"2024-09-19T06:10:32.954501+0000","last_clean":"2024-09-19T06:10:32.954501+0000","last_became_active":"2024-09-19T06:09:59.499172+0000","last_became_peered":"2024-09-19T06:09:59.499172+0000","last_unstale":"2024-09-19T06:10:32.954501+0000","last_undegraded":"2024-09-19T06:10:32.954501+0000","last_fullsized":"2024-09-19T06:10:32.954501+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:52.062675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815533+0000","last_change":"2024-09-19T06:10:02.523099+0000","last_active":"2024-09-19T06:10:31.815533+0000","last_peered":"2024-09-19T06:10:31.815533+0000","last_clean":"2024-09-19T06:10:31.815533+0000","last_became_active":"2024-09-19T06:10:02.522770+0000","last_became_peered":"2024-09-19T06:10:02.522770+0000","last_unstale":"2024-09-19T06:10:31.815533+0000","last_undegraded":"2024-09-19T06:10:31.815533+0000","last_fullsized":"2024-09-19T06:10:31.815533+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:39.807159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820720+0000","last_change":"2024-09-19T06:09:59.775371+0000","last_active":"2024-09-19T06:10:31.820720+0000","last_peered":"2024-09-19T06:10:31.820720+0000","last_clean":"2024-09-19T06:10:31.820720+0000","last_became_active":"2024-09-19T06:09:59.774944+0000","last_became_peered":"2024-09-19T06:09:59.774944+0000","last_unstale":"2024-09-19T06:10:31.820720+0000","last_undegraded":"2024-09-19T06:10:31.820720+0000","last_fullsized":"2024-09-19T06:10:31.820720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:44.305005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815663+0000","last_change":"2024-09-19T06:10:02.521207+0000","last_active":"2024-09-19T06:10:31.815663+0000","last_peered":"2024-09-19T06:10:31.815663+0000","last_clean":"2024-09-19T06:10:31.815663+0000","last_became_active":"2024-09-19T06:10:02.520843+0000","last_became_peered":"2024-09-19T06:10:02.520843+0000","last_unstale":"2024-09-19T06:10:31.815663+0000","last_undegraded":"2024-09-19T06:10:31.815663+0000","last_fullsized":"2024-09-19T06:10:31.815663+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:39.462042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824516+0000","last_change":"2024-09-19T06:09:59.775259+0000","last_active":"2024-09-19T06:10:31.824516+0000","last_peered":"2024-09-19T06:10:31.824516+0000","last_clean":"2024-09-19T06:10:31.824516+0000","last_became_active":"2024-09-19T06:09:59.774393+0000","last_became_peered":"2024-09-19T06:09:59.774393+0000","last_unstale":"2024-09-19T06:10:31.824516+0000","last_undegraded":"2024-09-19T06:10:31.824516+0000","last_fullsized":"2024-09-19T06:10:31.824516+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:39:05.904778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816888+0000","last_change":"2024-09-19T06:10:02.516445+0000","last_active":"2024-09-19T06:10:31.816888+0000","last_peered":"2024-09-19T06:10:31.816888+0000","last_clean":"2024-09-19T06:10:31.816888+0000","last_became_active":"2024-09-19T06:10:02.515524+0000","last_became_peered":"2024-09-19T06:10:02.515524+0000","last_unstale":"2024-09-19T06:10:31.816888+0000","last_undegraded":"2024-09-19T06:10:31.816888+0000","last_fullsized":"2024-09-19T06:10:31.816888+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:42.863526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'15","reported_seq":57,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:34.526289+0000","last_change":"2024-09-19T06:10:31.834659+0000","last_active":"2024-09-19T06:10:34.526289+0000","last_peered":"2024-09-19T06:10:34.526289+0000","last_clean":"2024-09-19T06:10:34.526289+0000","last_became_active":"2024-09-19T06:10:31.825992+0000","last_became_peered":"2024-09-19T06:10:31.825992+0000","last_unstale":"2024-09-19T06:10:34.526289+0000","last_undegraded":"2024-09-19T06:10:34.526289+0000","last_fullsized":"2024-09-19T06:10:34.526289+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:16.208213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822787+0000","last_change":"2024-09-19T06:10:02.532473+0000","last_active":"2024-09-19T06:10:31.822787+0000","last_peered":"2024-09-19T06:10:31.822787+0000","last_clean":"2024-09-19T06:10:31.822787+0000","last_became_active":"2024-09-19T06:10:02.531745+0000","last_became_peered":"2024-09-19T06:10:02.531745+0000","last_unstale":"2024-09-19T06:10:31.822787+0000","last_undegraded":"2024-09-19T06:10:31.822787+0000","last_fullsized":"2024-09-19T06:10:31.822787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:22.659626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819369+0000","last_change":"2024-09-19T06:10:00.231383+0000","last_active":"2024-09-19T06:10:31.819369+0000","last_peered":"2024-09-19T06:10:31.819369+0000","last_clean":"2024-09-19T06:10:31.819369+0000","last_became_active":"2024-09-19T06:10:00.231016+0000","last_became_peered":"2024-09-19T06:10:00.231016+0000","last_unstale":"2024-09-19T06:10:31.819369+0000","last_undegraded":"2024-09-19T06:10:31.819369+0000","last_fullsized":"2024-09-19T06:10:31.819369+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:39:07.178556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816556+0000","last_change":"2024-09-19T06:10:02.532772+0000","last_active":"2024-09-19T06:10:31.816556+0000","last_peered":"2024-09-19T06:10:31.816556+0000","last_clean":"2024-09-19T06:10:31.816556+0000","last_became_active":"2024-09-19T06:10:02.528187+0000","last_became_peered":"2024-09-19T06:10:02.528187+0000","last_unstale":"2024-09-19T06:10:31.816556+0000","last_undegraded":"2024-09-19T06:10:31.816556+0000","last_fullsized":"2024-09-19T06:10:31.816556+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:35.550221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.950081+0000","last_change":"2024-09-19T06:09:59.774860+0000","last_active":"2024-09-19T06:10:31.950081+0000","last_peered":"2024-09-19T06:10:31.950081+0000","last_clean":"2024-09-19T06:10:31.950081+0000","last_became_active":"2024-09-19T06:09:59.774525+0000","last_became_peered":"2024-09-19T06:09:59.774525+0000","last_unstale":"2024-09-19T06:10:31.950081+0000","last_undegraded":"2024-09-19T06:10:31.950081+0000","last_fullsized":"2024-09-19T06:10:31.950081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:28.480611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823598+0000","last_change":"2024-09-19T06:10:02.514951+0000","last_active":"2024-09-19T06:10:31.823598+0000","last_peered":"2024-09-19T06:10:31.823598+0000","last_clean":"2024-09-19T06:10:31.823598+0000","last_became_active":"2024-09-19T06:10:02.514632+0000","last_became_peered":"2024-09-19T06:10:02.514632+0000","last_unstale":"2024-09-19T06:10:31.823598+0000","last_undegraded":"2024-09-19T06:10:31.823598+0000","last_fullsized":"2024-09-19T06:10:31.823598+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:58.225253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822496+0000","last_change":"2024-09-19T06:09:59.496203+0000","last_active":"2024-09-19T06:10:31.822496+0000","last_peered":"2024-09-19T06:10:31.822496+0000","last_clean":"2024-09-19T06:10:31.822496+0000","last_became_active":"2024-09-19T06:09:59.495854+0000","last_became_peered":"2024-09-19T06:09:59.495854+0000","last_unstale":"2024-09-19T06:10:31.822496+0000","last_undegraded":"2024-09-19T06:10:31.822496+0000","last_fullsized":"2024-09-19T06:10:31.822496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:43.388624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819866+0000","last_change":"2024-09-19T06:10:02.521713+0000","last_active":"2024-09-19T06:10:31.819866+0000","last_peered":"2024-09-19T06:10:31.819866+0000","last_clean":"2024-09-19T06:10:31.819866+0000","last_became_active":"2024-09-19T06:10:02.521389+0000","last_became_peered":"2024-09-19T06:10:02.521389+0000","last_unstale":"2024-09-19T06:10:31.819866+0000","last_undegraded":"2024-09-19T06:10:31.819866+0000","last_fullsized":"2024-09-19T06:10:31.819866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:34.441627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819038+0000","last_change":"2024-09-19T06:09:59.492636+0000","last_active":"2024-09-19T06:10:31.819038+0000","last_peered":"2024-09-19T06:10:31.819038+0000","last_clean":"2024-09-19T06:10:31.819038+0000","last_became_active":"2024-09-19T06:09:59.491801+0000","last_became_peered":"2024-09-19T06:09:59.491801+0000","last_unstale":"2024-09-19T06:10:31.819038+0000","last_undegraded":"2024-09-19T06:10:31.819038+0000","last_fullsized":"2024-09-19T06:10:31.819038+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:27.911582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822238+0000","last_change":"2024-09-19T06:10:02.527073+0000","last_active":"2024-09-19T06:10:31.822238+0000","last_peered":"2024-09-19T06:10:31.822238+0000","last_clean":"2024-09-19T06:10:31.822238+0000","last_became_active":"2024-09-19T06:10:02.525847+0000","last_became_peered":"2024-09-19T06:10:02.525847+0000","last_unstale":"2024-09-19T06:10:31.822238+0000","last_undegraded":"2024-09-19T06:10:31.822238+0000","last_fullsized":"2024-09-19T06:10:31.822238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:22.717353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823978+0000","last_change":"2024-09-19T06:09:59.493905+0000","last_active":"2024-09-19T06:10:31.823978+0000","last_peered":"2024-09-19T06:10:31.823978+0000","last_clean":"2024-09-19T06:10:31.823978+0000","last_became_active":"2024-09-19T06:09:59.493517+0000","last_became_peered":"2024-09-19T06:09:59.493517+0000","last_unstale":"2024-09-19T06:10:31.823978+0000","last_undegraded":"2024-09-19T06:10:31.823978+0000","last_fullsized":"2024-09-19T06:10:31.823978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:22.959756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822361+0000","last_change":"2024-09-19T06:10:02.518002+0000","last_active":"2024-09-19T06:10:31.822361+0000","last_peered":"2024-09-19T06:10:31.822361+0000","last_clean":"2024-09-19T06:10:31.822361+0000","last_became_active":"2024-09-19T06:10:02.517492+0000","last_became_peered":"2024-09-19T06:10:02.517492+0000","last_unstale":"2024-09-19T06:10:31.822361+0000","last_undegraded":"2024-09-19T06:10:31.822361+0000","last_fullsized":"2024-09-19T06:10:31.822361+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:58.935232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.951506+0000","last_change":"2024-09-19T06:10:31.951506+0000","last_active":"2024-09-19T06:10:31.951506+0000","last_peered":"2024-09-19T06:10:31.951506+0000","last_clean":"2024-09-19T06:10:31.951506+0000","last_became_active":"2024-09-19T06:10:31.951079+0000","last_became_peered":"2024-09-19T06:10:31.951079+0000","last_unstale":"2024-09-19T06:10:31.951506+0000","last_undegraded":"2024-09-19T06:10:31.951506+0000","last_fullsized":"2024-09-19T06:10:31.951506+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:53.978445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824216+0000","last_change":"2024-09-19T06:09:59.496546+0000","last_active":"2024-09-19T06:10:31.824216+0000","last_peered":"2024-09-19T06:10:31.824216+0000","last_clean":"2024-09-19T06:10:31.824216+0000","last_became_active":"2024-09-19T06:09:59.496195+0000","last_became_peered":"2024-09-19T06:09:59.496195+0000","last_unstale":"2024-09-19T06:10:31.824216+0000","last_undegraded":"2024-09-19T06:10:31.824216+0000","last_fullsized":"2024-09-19T06:10:31.824216+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:58.443134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.950061+0000","last_change":"2024-09-19T06:10:02.522270+0000","last_active":"2024-09-19T06:10:31.950061+0000","last_peered":"2024-09-19T06:10:31.950061+0000","last_clean":"2024-09-19T06:10:31.950061+0000","last_became_active":"2024-09-19T06:10:02.517109+0000","last_became_peered":"2024-09-19T06:10:02.517109+0000","last_unstale":"2024-09-19T06:10:31.950061+0000","last_undegraded":"2024-09-19T06:10:31.950061+0000","last_fullsized":"2024-09-19T06:10:31.950061+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:56.967980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824448+0000","last_change":"2024-09-19T06:09:59.494016+0000","last_active":"2024-09-19T06:10:31.824448+0000","last_peered":"2024-09-19T06:10:31.824448+0000","last_clean":"2024-09-19T06:10:31.824448+0000","last_became_active":"2024-09-19T06:09:59.493525+0000","last_became_peered":"2024-09-19T06:09:59.493525+0000","last_unstale":"2024-09-19T06:10:31.824448+0000","last_undegraded":"2024-09-19T06:10:31.824448+0000","last_fullsized":"2024-09-19T06:10:31.824448+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:06.650633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.817372+0000","last_change":"2024-09-19T06:10:02.531329+0000","last_active":"2024-09-19T06:10:31.817372+0000","last_peered":"2024-09-19T06:10:31.817372+0000","last_clean":"2024-09-19T06:10:31.817372+0000","last_became_active":"2024-09-19T06:10:02.527107+0000","last_became_peered":"2024-09-19T06:10:02.527107+0000","last_unstale":"2024-09-19T06:10:31.817372+0000","last_undegraded":"2024-09-19T06:10:31.817372+0000","last_fullsized":"2024-09-19T06:10:31.817372+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:25.891416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823419+0000","last_change":"2024-09-19T06:09:59.774966+0000","last_active":"2024-09-19T06:10:31.823419+0000","last_peered":"2024-09-19T06:10:31.823419+0000","last_clean":"2024-09-19T06:10:31.823419+0000","last_became_active":"2024-09-19T06:09:59.774038+0000","last_became_peered":"2024-09-19T06:09:59.774038+0000","last_unstale":"2024-09-19T06:10:31.823419+0000","last_undegraded":"2024-09-19T06:10:31.823419+0000","last_fullsized":"2024-09-19T06:10:31.823419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:54.703512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824217+0000","last_change":"2024-09-19T06:10:31.824217+0000","last_active":"2024-09-19T06:10:31.824217+0000","last_peered":"2024-09-19T06:10:31.824217+0000","last_clean":"2024-09-19T06:10:31.824217+0000","last_became_active":"2024-09-19T06:10:31.823867+0000","last_became_peered":"2024-09-19T06:10:31.823867+0000","last_unstale":"2024-09-19T06:10:31.824217+0000","last_undegraded":"2024-09-19T06:10:31.824217+0000","last_fullsized":"2024-09-19T06:10:31.824217+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:53.261746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":79,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:34.956636+0000","last_change":"2024-09-19T06:10:31.962041+0000","last_active":"2024-09-19T06:10:34.956636+0000","last_peered":"2024-09-19T06:10:34.956636+0000","last_clean":"2024-09-19T06:10:34.956636+0000","last_became_active":"2024-09-19T06:10:31.952142+0000","last_became_peered":"2024-09-19T06:10:31.952142+0000","last_unstale":"2024-09-19T06:10:34.956636+0000","last_undegraded":"2024-09-19T06:10:34.956636+0000","last_fullsized":"2024-09-19T06:10:34.956636+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:30.304256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61577,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":191,"num_read_kb":173,"num_write":242,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2857,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":184731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282250,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449107,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":970752,"data_stored":468494,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678042,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28112,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717040,"statfs":{"total":95995035648,"available":95966248960,"internally_reserved":0,"allocated":1114112,"data_stored":1112877,"data_compressed":41671,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841566,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":467409,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103205,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":974848,"data_stored":467115,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332138,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1036288,"data_stored":1060700,"data_compressed":41671,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495663,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":970752,"data_stored":467519,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757302,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1040384,"data_stored":1058970,"data_compressed":41671,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920827,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":978944,"data_stored":468157,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149759,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":987136,"data_stored":466951,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":521851,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1032192,"data_stored":519216,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":991232,"data_stored":468465,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34250,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34250,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34250,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":57186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":55564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":56105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:10:39.871 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T06:10:39.871 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T06:10:39.872 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T06:10:40.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:39 smithi003 ceph-mon[30893]: pgmap v322: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 KiB/s wr, 7 op/s; 357 B/s, 1 keys/s, 2 objects/s recovering 2024-09-19T06:10:40.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:39 smithi003 ceph-mon[30893]: from='client.24691 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:10:40.253 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:40.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:39 smithi059 ceph-mon[35138]: pgmap v322: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 KiB/s wr, 7 op/s; 357 B/s, 1 keys/s, 2 objects/s recovering 2024-09-19T06:10:40.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:39 smithi059 ceph-mon[35138]: from='client.24691 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:10:40.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:39 smithi071 ceph-mon[35662]: pgmap v322: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.0 KiB/s wr, 7 op/s; 357 B/s, 1 keys/s, 2 objects/s recovering 2024-09-19T06:10:40.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:39 smithi071 ceph-mon[35662]: from='client.24691 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:10:40.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.861+0000 7f395d600640 1 -- 172.21.15.3:0/2066904219 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3958105920 msgr2=0x7f395810c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:40.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.861+0000 7f395d600640 1 --2- 172.21.15.3:0/2066904219 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3958105920 0x7f395810c240 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3950009ca0 tx=0x7f395002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:10:40.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.861+0000 7f395d600640 1 -- 172.21.15.3:0/2066904219 shutdown_connections 2024-09-19T06:10:40.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.861+0000 7f395d600640 1 --2- 172.21.15.3:0/2066904219 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3958105920 0x7f395810c240 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:40.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.861+0000 7f395d600640 1 --2- 172.21.15.3:0/2066904219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3958104f60 0x7f39581053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:40.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.861+0000 7f395d600640 1 --2- 172.21.15.3:0/2066904219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3958103e00 0x7f3958104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:40.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.861+0000 7f395d600640 1 -- 172.21.15.3:0/2066904219 >> 172.21.15.3:0/2066904219 conn(0x7f39580ff5b0 msgr2=0x7f39581019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:40.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.862+0000 7f395d600640 1 -- 172.21.15.3:0/2066904219 shutdown_connections 2024-09-19T06:10:40.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.862+0000 7f395d600640 1 -- 172.21.15.3:0/2066904219 wait complete. 2024-09-19T06:10:40.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.863+0000 7f395d600640 1 Processor -- start 2024-09-19T06:10:40.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.863+0000 7f395d600640 1 -- start start 2024-09-19T06:10:40.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.863+0000 7f395d600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3958103e00 0x7f395819a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:40.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.863+0000 7f395d600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3958104f60 0x7f395819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:40.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.863+0000 7f395d600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3958105920 0x7f39581a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:40.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.863+0000 7f395d600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f395810fb00 con 0x7f3958105920 2024-09-19T06:10:40.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.863+0000 7f395d600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f395810f980 con 0x7f3958103e00 2024-09-19T06:10:40.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.863+0000 7f395d600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f395810fc80 con 0x7f3958104f60 2024-09-19T06:10:40.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.863+0000 7f3957400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3958105920 0x7f39581a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:40.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.864+0000 7f394e000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3958104f60 0x7f395819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:40.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.864+0000 7f3957400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3958105920 0x7f39581a1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45130/0 (socket says 172.21.15.3:45130) 2024-09-19T06:10:40.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.864+0000 7f3956a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3958103e00 0x7f395819a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:40.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.864+0000 7f3957400640 1 -- 172.21.15.3:0/48998165 learned_addr learned my addr 172.21.15.3:0/48998165 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:40.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.864+0000 7f394e000640 1 -- 172.21.15.3:0/48998165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3958103e00 msgr2=0x7f395819a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:40.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.864+0000 7f394e000640 1 --2- 172.21.15.3:0/48998165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3958103e00 0x7f395819a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:40.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.864+0000 7f394e000640 1 -- 172.21.15.3:0/48998165 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3958105920 msgr2=0x7f39581a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:40.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.864+0000 7f394e000640 1 --2- 172.21.15.3:0/48998165 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3958105920 0x7f39581a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:40.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.864+0000 7f394e000640 1 -- 172.21.15.3:0/48998165 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39581a1ca0 con 0x7f3958104f60 2024-09-19T06:10:40.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.864+0000 7f394e000640 1 --2- 172.21.15.3:0/48998165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3958104f60 0x7f395819a5b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f394000e9c0 tx=0x7f394000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:40.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.864+0000 7f394fe00640 1 -- 172.21.15.3:0/48998165 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394000ccc0 con 0x7f3958104f60 2024-09-19T06:10:40.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.865+0000 7f394fe00640 1 -- 172.21.15.3:0/48998165 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39400035f0 con 0x7f3958104f60 2024-09-19T06:10:40.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.865+0000 7f395d600640 1 -- 172.21.15.3:0/48998165 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39581a1f90 con 0x7f3958104f60 2024-09-19T06:10:40.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.865+0000 7f394fe00640 1 -- 172.21.15.3:0/48998165 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394000ce60 con 0x7f3958104f60 2024-09-19T06:10:40.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.865+0000 7f395d600640 1 -- 172.21.15.3:0/48998165 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39581a2440 con 0x7f3958104f60 2024-09-19T06:10:40.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.866+0000 7f395d600640 1 -- 172.21.15.3:0/48998165 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f395810b1a0 con 0x7f3958104f60 2024-09-19T06:10:40.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.868+0000 7f394fe00640 1 -- 172.21.15.3:0/48998165 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f39400037a0 con 0x7f3958104f60 2024-09-19T06:10:40.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.869+0000 7f394fe00640 1 --2- 172.21.15.3:0/48998165 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f393c0a3300 0x7f393c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:40.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.870+0000 7f394fe00640 1 -- 172.21.15.3:0/48998165 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f39400cfe70 con 0x7f3958104f60 2024-09-19T06:10:40.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.870+0000 7f3956a00640 1 --2- 172.21.15.3:0/48998165 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f393c0a3300 0x7f393c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:40.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.870+0000 7f3956a00640 1 --2- 172.21.15.3:0/48998165 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f393c0a3300 0x7f393c0a57c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3948009bd0 tx=0x7f3948005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:40.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:40.874+0000 7f394fe00640 1 -- 172.21.15.3:0/48998165 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f394009c9b0 con 0x7f3958104f60 2024-09-19T06:10:41.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:41.129+0000 7f395d600640 1 -- 172.21.15.3:0/48998165 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f395802d9c0 con 0x7f3958104f60 2024-09-19T06:10:41.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:41.137+0000 7f394fe00640 1 -- 172.21.15.3:0/48998165 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f3940096e20 con 0x7f3958104f60 2024-09-19T06:10:41.138 INFO:teuthology.orchestra.run.smithi003.stdout:[client.0] 2024-09-19T06:10:41.138 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQBhwOtmIOnHBxAAgbPpLSCS/Hh99QJGTNn8pA== 2024-09-19T06:10:41.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:41.139+0000 7f395d600640 1 -- 172.21.15.3:0/48998165 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f393c0a3300 msgr2=0x7f393c0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:41.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:41.139+0000 7f395d600640 1 --2- 172.21.15.3:0/48998165 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f393c0a3300 0x7f393c0a57c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3948009bd0 tx=0x7f3948005f90 comp rx=0 tx=0).stop 2024-09-19T06:10:41.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:41.139+0000 7f395d600640 1 -- 172.21.15.3:0/48998165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3958104f60 msgr2=0x7f395819a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:41.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:41.139+0000 7f395d600640 1 --2- 172.21.15.3:0/48998165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3958104f60 0x7f395819a5b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f394000e9c0 tx=0x7f394000ee80 comp rx=0 tx=0).stop 2024-09-19T06:10:41.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:41.139+0000 7f395d600640 1 -- 172.21.15.3:0/48998165 shutdown_connections 2024-09-19T06:10:41.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:41.139+0000 7f395d600640 1 --2- 172.21.15.3:0/48998165 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f393c0a3300 0x7f393c0a57c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:41.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:41.139+0000 7f395d600640 1 --2- 172.21.15.3:0/48998165 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3958105920 0x7f39581a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:41.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:41.139+0000 7f395d600640 1 --2- 172.21.15.3:0/48998165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3958104f60 0x7f395819a5b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:41.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:41.139+0000 7f395d600640 1 --2- 172.21.15.3:0/48998165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3958103e00 0x7f395819a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:41.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:41.139+0000 7f395d600640 1 -- 172.21.15.3:0/48998165 >> 172.21.15.3:0/48998165 conn(0x7f39580ff5b0 msgr2=0x7f3958108370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:41.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:41.139+0000 7f395d600640 1 -- 172.21.15.3:0/48998165 shutdown_connections 2024-09-19T06:10:41.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:41.139+0000 7f395d600640 1 -- 172.21.15.3:0/48998165 wait complete. 2024-09-19T06:10:41.900 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-19T06:10:41.901 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T06:10:41.901 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T06:10:41.982 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T06:10:41.982 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T06:10:41.982 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T06:10:42.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:41 smithi059 ceph-mon[35138]: pgmap v323: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.4 KiB/s wr, 8 op/s; 306 B/s, 1 keys/s, 1 objects/s recovering 2024-09-19T06:10:42.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:41 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/48998165' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:10:42.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:41 smithi059 ceph-mon[35138]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:10:42.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:41 smithi059 ceph-mon[35138]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T06:10:42.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:41 smithi003 ceph-mon[30893]: pgmap v323: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.4 KiB/s wr, 8 op/s; 306 B/s, 1 keys/s, 1 objects/s recovering 2024-09-19T06:10:42.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:41 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/48998165' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:10:42.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:41 smithi003 ceph-mon[30893]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:10:42.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:41 smithi003 ceph-mon[30893]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T06:10:42.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:41 smithi071 ceph-mon[35662]: pgmap v323: 97 pgs: 97 active+clean; 637 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.4 KiB/s wr, 8 op/s; 306 B/s, 1 keys/s, 1 objects/s recovering 2024-09-19T06:10:42.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:41 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/48998165' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:10:42.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:41 smithi071 ceph-mon[35662]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:10:42.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:41 smithi071 ceph-mon[35662]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T06:10:42.397 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:42.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.985+0000 7fc39f800640 1 -- 172.21.15.3:0/1943034634 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc398076720 msgr2=0x7fc398076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:42.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.985+0000 7fc39f800640 1 --2- 172.21.15.3:0/1943034634 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc398076720 0x7fc398076b00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc388009900 tx=0x7fc38802a410 comp rx=0 tx=0).stop 2024-09-19T06:10:42.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.985+0000 7fc39f800640 1 -- 172.21.15.3:0/1943034634 shutdown_connections 2024-09-19T06:10:42.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.985+0000 7fc39f800640 1 --2- 172.21.15.3:0/1943034634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc398112a50 0x7fc398114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:42.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.985+0000 7fc39f800640 1 --2- 172.21.15.3:0/1943034634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc398077040 0x7fc398112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:42.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.985+0000 7fc39f800640 1 --2- 172.21.15.3:0/1943034634 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc398076720 0x7fc398076b00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:42.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.985+0000 7fc39f800640 1 -- 172.21.15.3:0/1943034634 >> 172.21.15.3:0/1943034634 conn(0x7fc3980ffa50 msgr2=0x7fc398101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:42.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.985+0000 7fc39f800640 1 -- 172.21.15.3:0/1943034634 shutdown_connections 2024-09-19T06:10:42.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.985+0000 7fc39f800640 1 -- 172.21.15.3:0/1943034634 wait complete. 2024-09-19T06:10:42.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.986+0000 7fc39f800640 1 Processor -- start 2024-09-19T06:10:42.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.986+0000 7fc39f800640 1 -- start start 2024-09-19T06:10:42.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.987+0000 7fc39f800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc398076720 0x7fc3981a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:42.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.987+0000 7fc39f800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc398077040 0x7fc3981a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:42.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.987+0000 7fc39f800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc398112a50 0x7fc39819e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:42.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.987+0000 7fc39f800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc3981185c0 con 0x7fc398076720 2024-09-19T06:10:42.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.987+0000 7fc39f800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc398118440 con 0x7fc398077040 2024-09-19T06:10:42.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.987+0000 7fc39f800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc398118740 con 0x7fc398112a50 2024-09-19T06:10:42.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.987+0000 7fc39ce00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc398076720 0x7fc3981a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:42.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.987+0000 7fc39ce00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc398076720 0x7fc3981a46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45156/0 (socket says 172.21.15.3:45156) 2024-09-19T06:10:42.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.987+0000 7fc39ce00640 1 -- 172.21.15.3:0/2321867822 learned_addr learned my addr 172.21.15.3:0/2321867822 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:42.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.987+0000 7fc39d800640 1 --2- 172.21.15.3:0/2321867822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc398112a50 0x7fc39819e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:42.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.987+0000 7fc38fe00640 1 --2- 172.21.15.3:0/2321867822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc398077040 0x7fc3981a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:42.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.988+0000 7fc39ce00640 1 -- 172.21.15.3:0/2321867822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc398112a50 msgr2=0x7fc39819e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:42.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.988+0000 7fc39ce00640 1 --2- 172.21.15.3:0/2321867822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc398112a50 0x7fc39819e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:42.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.988+0000 7fc39ce00640 1 -- 172.21.15.3:0/2321867822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc398077040 msgr2=0x7fc3981a4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:42.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.988+0000 7fc39ce00640 1 --2- 172.21.15.3:0/2321867822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc398077040 0x7fc3981a4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:42.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.988+0000 7fc39ce00640 1 -- 172.21.15.3:0/2321867822 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc39819efe0 con 0x7fc398076720 2024-09-19T06:10:42.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.988+0000 7fc39ce00640 1 --2- 172.21.15.3:0/2321867822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc398076720 0x7fc3981a46f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc388006010 tx=0x7fc3880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:42.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.988+0000 7fc396000640 1 -- 172.21.15.3:0/2321867822 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38803f030 con 0x7fc398076720 2024-09-19T06:10:42.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.988+0000 7fc396000640 1 -- 172.21.15.3:0/2321867822 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc388003ce0 con 0x7fc398076720 2024-09-19T06:10:42.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.988+0000 7fc39f800640 1 -- 172.21.15.3:0/2321867822 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc39819f270 con 0x7fc398076720 2024-09-19T06:10:42.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.989+0000 7fc396000640 1 -- 172.21.15.3:0/2321867822 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc388035070 con 0x7fc398076720 2024-09-19T06:10:42.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.989+0000 7fc39f800640 1 -- 172.21.15.3:0/2321867822 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3981ab5c0 con 0x7fc398076720 2024-09-19T06:10:42.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.990+0000 7fc39f800640 1 -- 172.21.15.3:0/2321867822 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc398076b00 con 0x7fc398076720 2024-09-19T06:10:42.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.991+0000 7fc396000640 1 -- 172.21.15.3:0/2321867822 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fc388042030 con 0x7fc398076720 2024-09-19T06:10:42.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.993+0000 7fc396000640 1 --2- 172.21.15.3:0/2321867822 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc37c0a32d0 0x7fc37c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:42.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.993+0000 7fc396000640 1 -- 172.21.15.3:0/2321867822 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fc3880efd50 con 0x7fc398076720 2024-09-19T06:10:42.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.993+0000 7fc38fe00640 1 --2- 172.21.15.3:0/2321867822 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc37c0a32d0 0x7fc37c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:42.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.994+0000 7fc38fe00640 1 --2- 172.21.15.3:0/2321867822 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc37c0a32d0 0x7fc37c0a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc398079290 tx=0x7fc38000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:42.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:42.997+0000 7fc396000640 1 -- 172.21.15.3:0/2321867822 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc3880bc300 con 0x7fc398076720 2024-09-19T06:10:43.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:43.229+0000 7fc39f800640 1 -- 172.21.15.3:0/2321867822 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc3981ab790 con 0x7fc398076720 2024-09-19T06:10:43.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:43.234+0000 7fc396000640 1 -- 172.21.15.3:0/2321867822 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264041 (secure 0 0 0) 0x7fc3880c0600 con 0x7fc398076720 2024-09-19T06:10:43.241 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:10:43.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:43.239+0000 7fc39f800640 1 -- 172.21.15.3:0/2321867822 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc37c0a32d0 msgr2=0x7fc37c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:43.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:43.239+0000 7fc39f800640 1 --2- 172.21.15.3:0/2321867822 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc37c0a32d0 0x7fc37c0a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc398079290 tx=0x7fc38000b390 comp rx=0 tx=0).stop 2024-09-19T06:10:43.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:43.239+0000 7fc39f800640 1 -- 172.21.15.3:0/2321867822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc398076720 msgr2=0x7fc3981a46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:43.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:43.239+0000 7fc39f800640 1 --2- 172.21.15.3:0/2321867822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc398076720 0x7fc3981a46f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc388006010 tx=0x7fc3880042f0 comp rx=0 tx=0).stop 2024-09-19T06:10:43.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:43.239+0000 7fc39f800640 1 -- 172.21.15.3:0/2321867822 shutdown_connections 2024-09-19T06:10:43.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:43.239+0000 7fc39f800640 1 --2- 172.21.15.3:0/2321867822 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc37c0a32d0 0x7fc37c0a5790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:43.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:43.239+0000 7fc39f800640 1 --2- 172.21.15.3:0/2321867822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc398112a50 0x7fc39819e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:43.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:43.239+0000 7fc39f800640 1 --2- 172.21.15.3:0/2321867822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc398077040 0x7fc3981a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:43.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:43.239+0000 7fc39f800640 1 --2- 172.21.15.3:0/2321867822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc398076720 0x7fc3981a46f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:43.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:43.239+0000 7fc39f800640 1 -- 172.21.15.3:0/2321867822 >> 172.21.15.3:0/2321867822 conn(0x7fc3980ffa50 msgr2=0x7fc398101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:43.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:43.239+0000 7fc39f800640 1 -- 172.21.15.3:0/2321867822 shutdown_connections 2024-09-19T06:10:43.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:43.239+0000 7fc39f800640 1 -- 172.21.15.3:0/2321867822 wait complete. 2024-09-19T06:10:44.000 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":1278931596},{"type":"v1","addr":"172.21.15.3:6801","nonce":1278931596}]},"active_addr":"172.21.15.3:6801/1278931596","active_change":"2024-09-19T06:02:30.039797+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24122,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.3:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.3:0","nonce":4101082351}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.3:0","nonce":3358701720}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.3:0","nonce":3104337397}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.3:0","nonce":3155841850}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.3:0","nonce":1072156629}]}]} 2024-09-19T06:10:44.005 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T06:10:44.005 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T06:10:44.005 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:10:44.137 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:43 smithi071 ceph-mon[35662]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.7 KiB/s wr, 11 op/s; 276 B/s, 0 keys/s, 1 objects/s recovering 2024-09-19T06:10:44.138 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:43 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2321867822' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T06:10:44.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:43 smithi059 ceph-mon[35138]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.7 KiB/s wr, 11 op/s; 276 B/s, 0 keys/s, 1 objects/s recovering 2024-09-19T06:10:44.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:43 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2321867822' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T06:10:44.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:43 smithi003 ceph-mon[30893]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.7 KiB/s wr, 11 op/s; 276 B/s, 0 keys/s, 1 objects/s recovering 2024-09-19T06:10:44.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:43 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2321867822' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T06:10:44.383 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:44.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.936+0000 7fd711400640 1 -- 172.21.15.3:0/2975758129 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd70c1049a0 msgr2=0x7fd70c1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:44.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.936+0000 7fd711400640 1 --2- 172.21.15.3:0/2975758129 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd70c1049a0 0x7fd70c1089f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8009900 tx=0x7fd6f802a410 comp rx=0 tx=0).stop 2024-09-19T06:10:44.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.937+0000 7fd711400640 1 -- 172.21.15.3:0/2975758129 shutdown_connections 2024-09-19T06:10:44.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.937+0000 7fd711400640 1 --2- 172.21.15.3:0/2975758129 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd70c109120 0x7fd70c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:44.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.937+0000 7fd711400640 1 --2- 172.21.15.3:0/2975758129 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd70c1049a0 0x7fd70c1089f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:44.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.937+0000 7fd711400640 1 --2- 172.21.15.3:0/2975758129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd70c103ff0 0x7fd70c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:44.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.937+0000 7fd711400640 1 -- 172.21.15.3:0/2975758129 >> 172.21.15.3:0/2975758129 conn(0x7fd70c0ffa90 msgr2=0x7fd70c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:44.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.937+0000 7fd711400640 1 -- 172.21.15.3:0/2975758129 shutdown_connections 2024-09-19T06:10:44.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.937+0000 7fd711400640 1 -- 172.21.15.3:0/2975758129 wait complete. 2024-09-19T06:10:44.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.938+0000 7fd711400640 1 Processor -- start 2024-09-19T06:10:44.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.938+0000 7fd711400640 1 -- start start 2024-09-19T06:10:44.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.938+0000 7fd711400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd70c103ff0 0x7fd70c19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:44.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.938+0000 7fd711400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd70c1049a0 0x7fd70c19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:44.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.938+0000 7fd711400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd70c109120 0x7fd70c19ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:44.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.938+0000 7fd711400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c114120 con 0x7fd70c109120 2024-09-19T06:10:44.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.938+0000 7fd711400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c113fa0 con 0x7fd70c103ff0 2024-09-19T06:10:44.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.938+0000 7fd711400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c1142a0 con 0x7fd70c1049a0 2024-09-19T06:10:44.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.938+0000 7fd70b200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd70c109120 0x7fd70c19ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:44.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.938+0000 7fd709e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd70c1049a0 0x7fd70c19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:44.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.938+0000 7fd70a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd70c103ff0 0x7fd70c19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:44.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.938+0000 7fd709e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd70c1049a0 0x7fd70c19abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:36070/0 (socket says 172.21.15.3:36070) 2024-09-19T06:10:44.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.938+0000 7fd709e00640 1 -- 172.21.15.3:0/1177458838 learned_addr learned my addr 172.21.15.3:0/1177458838 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:44.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.939+0000 7fd709e00640 1 -- 172.21.15.3:0/1177458838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd70c103ff0 msgr2=0x7fd70c19a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:44.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.939+0000 7fd709e00640 1 --2- 172.21.15.3:0/1177458838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd70c103ff0 0x7fd70c19a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:44.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.939+0000 7fd709e00640 1 -- 172.21.15.3:0/1177458838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd70c109120 msgr2=0x7fd70c19ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:44.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.939+0000 7fd709e00640 1 --2- 172.21.15.3:0/1177458838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd70c109120 0x7fd70c19ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:44.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.939+0000 7fd709e00640 1 -- 172.21.15.3:0/1177458838 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd70c19f650 con 0x7fd70c1049a0 2024-09-19T06:10:44.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.939+0000 7fd70b200640 1 --2- 172.21.15.3:0/1177458838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd70c109120 0x7fd70c19ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:44.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.939+0000 7fd709e00640 1 --2- 172.21.15.3:0/1177458838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd70c1049a0 0x7fd70c19abe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8006010 tx=0x7fd6f80042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:44.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.940+0000 7fd703400640 1 -- 172.21.15.3:0/1177458838 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f803f030 con 0x7fd70c1049a0 2024-09-19T06:10:44.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.940+0000 7fd711400640 1 -- 172.21.15.3:0/1177458838 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd70c19f8e0 con 0x7fd70c1049a0 2024-09-19T06:10:44.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.940+0000 7fd703400640 1 -- 172.21.15.3:0/1177458838 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6f8003ce0 con 0x7fd70c1049a0 2024-09-19T06:10:44.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.940+0000 7fd711400640 1 -- 172.21.15.3:0/1177458838 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd70c1a7220 con 0x7fd70c1049a0 2024-09-19T06:10:44.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.940+0000 7fd703400640 1 -- 172.21.15.3:0/1177458838 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8035070 con 0x7fd70c1049a0 2024-09-19T06:10:44.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.941+0000 7fd711400640 1 -- 172.21.15.3:0/1177458838 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd70c1043d0 con 0x7fd70c1049a0 2024-09-19T06:10:44.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.943+0000 7fd703400640 1 -- 172.21.15.3:0/1177458838 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fd6f8042030 con 0x7fd70c1049a0 2024-09-19T06:10:44.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.944+0000 7fd703400640 1 --2- 172.21.15.3:0/1177458838 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd6f00a3350 0x7fd6f00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:44.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.944+0000 7fd703400640 1 -- 172.21.15.3:0/1177458838 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fd6f80f0210 con 0x7fd70c1049a0 2024-09-19T06:10:44.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.944+0000 7fd70a800640 1 --2- 172.21.15.3:0/1177458838 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd6f00a3350 0x7fd6f00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:44.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.945+0000 7fd70a800640 1 --2- 172.21.15.3:0/1177458838 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd6f00a3350 0x7fd6f00a5810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00bbe0 tx=0x7fd6fc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:44.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:44.946+0000 7fd703400640 1 -- 172.21.15.3:0/1177458838 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd6f80bc7c0 con 0x7fd70c1049a0 2024-09-19T06:10:45.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:45.132+0000 7fd711400640 1 -- 172.21.15.3:0/1177458838 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd70c10c360 con 0x7fd70c1049a0 2024-09-19T06:10:45.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:45.134+0000 7fd703400640 1 -- 172.21.15.3:0/1177458838 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22583 (secure 0 0 0) 0x7fd6f80c0ac0 con 0x7fd70c1049a0 2024-09-19T06:10:45.135 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:10:45.135 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":88,"fsid":"782a5144-764c-11ef-bceb-c7b262605968","created":"2024-09-19T06:01:35.224753+0000","modified":"2024-09-19T06:10:31.811461+0000","last_up_change":"2024-09-19T06:09:02.478979+0000","last_in_change":"2024-09-19T06:08:38.865280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:04:56.654478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:09:58.426008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:10:01.215704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd89ea4b-a24e-4946-80fc-1776b6d05e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6803","nonce":2061486638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6805","nonce":2061486638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6809","nonce":2061486638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6807","nonce":2061486638}]},"public_addr":"172.21.15.3:6803/2061486638","cluster_addr":"172.21.15.3:6805/2061486638","heartbeat_back_addr":"172.21.15.3:6809/2061486638","heartbeat_front_addr":"172.21.15.3:6807/2061486638","state":["exists","up"]},{"osd":1,"uuid":"e03ca275-8da5-402f-9cd2-654ca422b9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6801","nonce":129318538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6803","nonce":129318538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6807","nonce":129318538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6805","nonce":129318538}]},"public_addr":"172.21.15.59:6801/129318538","cluster_addr":"172.21.15.59:6803/129318538","heartbeat_back_addr":"172.21.15.59:6807/129318538","heartbeat_front_addr":"172.21.15.59:6805/129318538","state":["exists","up"]},{"osd":2,"uuid":"62b7d36d-6078-4027-93b2-009be70a6d80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6801","nonce":2436210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6803","nonce":2436210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6807","nonce":2436210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6805","nonce":2436210695}]},"public_addr":"172.21.15.71:6801/2436210695","cluster_addr":"172.21.15.71:6803/2436210695","heartbeat_back_addr":"172.21.15.71:6807/2436210695","heartbeat_front_addr":"172.21.15.71:6805/2436210695","state":["exists","up"]},{"osd":3,"uuid":"ba33cc45-0103-443d-b262-622a505d9806","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6811","nonce":3577306700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6813","nonce":3577306700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6817","nonce":3577306700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6815","nonce":3577306700}]},"public_addr":"172.21.15.3:6811/3577306700","cluster_addr":"172.21.15.3:6813/3577306700","heartbeat_back_addr":"172.21.15.3:6817/3577306700","heartbeat_front_addr":"172.21.15.3:6815/3577306700","state":["exists","up"]},{"osd":4,"uuid":"40564c0c-6335-4207-a8e0-8078c9bfd015","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6809","nonce":4002980986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6811","nonce":4002980986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6815","nonce":4002980986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6813","nonce":4002980986}]},"public_addr":"172.21.15.59:6809/4002980986","cluster_addr":"172.21.15.59:6811/4002980986","heartbeat_back_addr":"172.21.15.59:6815/4002980986","heartbeat_front_addr":"172.21.15.59:6813/4002980986","state":["exists","up"]},{"osd":5,"uuid":"4db04b82-3403-4fd5-9eb7-7b81ed6b1d26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6809","nonce":2455500497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6811","nonce":2455500497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6815","nonce":2455500497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6813","nonce":2455500497}]},"public_addr":"172.21.15.71:6809/2455500497","cluster_addr":"172.21.15.71:6811/2455500497","heartbeat_back_addr":"172.21.15.71:6815/2455500497","heartbeat_front_addr":"172.21.15.71:6813/2455500497","state":["exists","up"]},{"osd":6,"uuid":"42a74f01-c5d0-4fc6-a8ee-a8bd84d4ab4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6819","nonce":823411903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6821","nonce":823411903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6825","nonce":823411903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6823","nonce":823411903}]},"public_addr":"172.21.15.3:6819/823411903","cluster_addr":"172.21.15.3:6821/823411903","heartbeat_back_addr":"172.21.15.3:6825/823411903","heartbeat_front_addr":"172.21.15.3:6823/823411903","state":["exists","up"]},{"osd":7,"uuid":"8a9bc2ec-4292-465d-8a0d-dda78521a319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6817","nonce":2133603853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6819","nonce":2133603853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6823","nonce":2133603853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6821","nonce":2133603853}]},"public_addr":"172.21.15.59:6817/2133603853","cluster_addr":"172.21.15.59:6819/2133603853","heartbeat_back_addr":"172.21.15.59:6823/2133603853","heartbeat_front_addr":"172.21.15.59:6821/2133603853","state":["exists","up"]},{"osd":8,"uuid":"6099a5c4-3504-43ca-8c58-d23f9096cd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6817","nonce":905333117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6819","nonce":905333117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6823","nonce":905333117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6821","nonce":905333117}]},"public_addr":"172.21.15.71:6817/905333117","cluster_addr":"172.21.15.71:6819/905333117","heartbeat_back_addr":"172.21.15.71:6823/905333117","heartbeat_front_addr":"172.21.15.71:6821/905333117","state":["exists","up"]},{"osd":9,"uuid":"b5a8aac6-bb10-4db8-a056-25228fbe754c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6827","nonce":124909267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6829","nonce":124909267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6833","nonce":124909267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6831","nonce":124909267}]},"public_addr":"172.21.15.3:6827/124909267","cluster_addr":"172.21.15.3:6829/124909267","heartbeat_back_addr":"172.21.15.3:6833/124909267","heartbeat_front_addr":"172.21.15.3:6831/124909267","state":["exists","up"]},{"osd":10,"uuid":"e49f3aab-0804-4aea-ae3f-38f022ab5239","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6825","nonce":784134238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6827","nonce":784134238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6831","nonce":784134238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6829","nonce":784134238}]},"public_addr":"172.21.15.59:6825/784134238","cluster_addr":"172.21.15.59:6827/784134238","heartbeat_back_addr":"172.21.15.59:6831/784134238","heartbeat_front_addr":"172.21.15.59:6829/784134238","state":["exists","up"]},{"osd":11,"uuid":"6c6d6c23-bcf7-43e7-94d1-5f2ebaa15441","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6825","nonce":3502550915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6827","nonce":3502550915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6831","nonce":3502550915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6829","nonce":3502550915}]},"public_addr":"172.21.15.71:6825/3502550915","cluster_addr":"172.21.15.71:6827/3502550915","heartbeat_back_addr":"172.21.15.71:6831/3502550915","heartbeat_front_addr":"172.21.15.71:6829/3502550915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:01.683342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:28.058683+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:53.250819+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:05:23.267377+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:05:49.756289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:06:15.766613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:06:46.054328+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:12.579180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:37.976863+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:08.683966+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:35.120765+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:00.624411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/1458736313":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/2065281908":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/953348594":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6801/518259590":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/1658697906":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6801/2386230415":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6800/2386230415":"2024-09-20T06:02:01.122348+0000","172.21.15.3:0/1616091100":"2024-09-20T06:02:30.039686+0000","172.21.15.3:6800/518259590":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/2122482494":"2024-09-20T06:02:01.122348+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:10:45.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:45.136+0000 7fd711400640 1 -- 172.21.15.3:0/1177458838 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd6f00a3350 msgr2=0x7fd6f00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:45.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:45.136+0000 7fd711400640 1 --2- 172.21.15.3:0/1177458838 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd6f00a3350 0x7fd6f00a5810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00bbe0 tx=0x7fd6fc00b390 comp rx=0 tx=0).stop 2024-09-19T06:10:45.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:45.136+0000 7fd711400640 1 -- 172.21.15.3:0/1177458838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd70c1049a0 msgr2=0x7fd70c19abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:45.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:45.136+0000 7fd711400640 1 --2- 172.21.15.3:0/1177458838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd70c1049a0 0x7fd70c19abe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8006010 tx=0x7fd6f80042f0 comp rx=0 tx=0).stop 2024-09-19T06:10:45.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:45.136+0000 7fd711400640 1 -- 172.21.15.3:0/1177458838 shutdown_connections 2024-09-19T06:10:45.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:45.136+0000 7fd711400640 1 --2- 172.21.15.3:0/1177458838 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd6f00a3350 0x7fd6f00a5810 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:45.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:45.136+0000 7fd711400640 1 --2- 172.21.15.3:0/1177458838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd70c109120 0x7fd70c19ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:45.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:45.136+0000 7fd711400640 1 --2- 172.21.15.3:0/1177458838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd70c1049a0 0x7fd70c19abe0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:45.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:45.136+0000 7fd711400640 1 --2- 172.21.15.3:0/1177458838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd70c103ff0 0x7fd70c19a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:45.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:45.136+0000 7fd711400640 1 -- 172.21.15.3:0/1177458838 >> 172.21.15.3:0/1177458838 conn(0x7fd70c0ffa90 msgr2=0x7fd70c100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:45.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:45.136+0000 7fd711400640 1 -- 172.21.15.3:0/1177458838 shutdown_connections 2024-09-19T06:10:45.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:45.136+0000 7fd711400640 1 -- 172.21.15.3:0/1177458838 wait complete. 2024-09-19T06:10:45.893 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T06:10:45.893 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:10:46.272 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:46.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:45 smithi059 ceph-mon[35138]: pgmap v325: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s; 140 B/s, 0 keys/s, 1 objects/s recovering 2024-09-19T06:10:46.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:45 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1177458838' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:10:46.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:45 smithi003 ceph-mon[30893]: pgmap v325: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s; 140 B/s, 0 keys/s, 1 objects/s recovering 2024-09-19T06:10:46.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:45 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1177458838' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:10:46.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:45 smithi071 ceph-mon[35662]: pgmap v325: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s; 140 B/s, 0 keys/s, 1 objects/s recovering 2024-09-19T06:10:46.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:45 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1177458838' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:10:46.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.854+0000 7fa3e7200640 1 -- 172.21.15.3:0/2768485217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3e0074e30 msgr2=0x7fa3e010df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:46.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.854+0000 7fa3e7200640 1 --2- 172.21.15.3:0/2768485217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3e0074e30 0x7fa3e010df00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009900 tx=0x7fa3c802a480 comp rx=0 tx=0).stop 2024-09-19T06:10:46.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.854+0000 7fa3e7200640 1 -- 172.21.15.3:0/2768485217 shutdown_connections 2024-09-19T06:10:46.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.854+0000 7fa3e7200640 1 --2- 172.21.15.3:0/2768485217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3e010e440 0x7fa3e0110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:46.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.854+0000 7fa3e7200640 1 --2- 172.21.15.3:0/2768485217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3e0074e30 0x7fa3e010df00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:46.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.854+0000 7fa3e7200640 1 --2- 172.21.15.3:0/2768485217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3e0074510 0x7fa3e00748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:46.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.854+0000 7fa3e7200640 1 -- 172.21.15.3:0/2768485217 >> 172.21.15.3:0/2768485217 conn(0x7fa3e00fd8c0 msgr2=0x7fa3e00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:46.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.854+0000 7fa3e7200640 1 -- 172.21.15.3:0/2768485217 shutdown_connections 2024-09-19T06:10:46.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.854+0000 7fa3e7200640 1 -- 172.21.15.3:0/2768485217 wait complete. 2024-09-19T06:10:46.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.855+0000 7fa3e7200640 1 Processor -- start 2024-09-19T06:10:46.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.855+0000 7fa3e7200640 1 -- start start 2024-09-19T06:10:46.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.855+0000 7fa3e7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3e0074510 0x7fa3e019a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:46.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.855+0000 7fa3e7200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3e0074e30 0x7fa3e019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:46.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.855+0000 7fa3e7200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3e010e440 0x7fa3e019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:46.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.855+0000 7fa3e7200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e0114190 con 0x7fa3e010e440 2024-09-19T06:10:46.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.855+0000 7fa3e7200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e0114010 con 0x7fa3e0074510 2024-09-19T06:10:46.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.855+0000 7fa3e7200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e0114310 con 0x7fa3e0074e30 2024-09-19T06:10:46.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.856+0000 7fa3dfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3e0074510 0x7fa3e019a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:46.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.856+0000 7fa3e5200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3e010e440 0x7fa3e019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:46.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.856+0000 7fa3dfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3e0074510 0x7fa3e019a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:50650/0 (socket says 172.21.15.3:50650) 2024-09-19T06:10:46.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.856+0000 7fa3dfe00640 1 -- 172.21.15.3:0/106067758 learned_addr learned my addr 172.21.15.3:0/106067758 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:46.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.856+0000 7fa3d7e00640 1 --2- 172.21.15.3:0/106067758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3e0074e30 0x7fa3e019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:46.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.856+0000 7fa3e5200640 1 -- 172.21.15.3:0/106067758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3e0074e30 msgr2=0x7fa3e019abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:46.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.856+0000 7fa3e5200640 1 --2- 172.21.15.3:0/106067758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3e0074e30 0x7fa3e019abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:46.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.856+0000 7fa3e5200640 1 -- 172.21.15.3:0/106067758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3e0074510 msgr2=0x7fa3e019a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:46.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.856+0000 7fa3e5200640 1 --2- 172.21.15.3:0/106067758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3e0074510 0x7fa3e019a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:46.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.856+0000 7fa3e5200640 1 -- 172.21.15.3:0/106067758 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e019f660 con 0x7fa3e010e440 2024-09-19T06:10:46.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.856+0000 7fa3e5200640 1 --2- 172.21.15.3:0/106067758 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3e010e440 0x7fa3e019ef80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8005fd0 tx=0x7fa3d800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:46.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.857+0000 7fa3dd600640 1 -- 172.21.15.3:0/106067758 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8010630 con 0x7fa3e010e440 2024-09-19T06:10:46.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.857+0000 7fa3dd600640 1 -- 172.21.15.3:0/106067758 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3d8010cb0 con 0x7fa3e010e440 2024-09-19T06:10:46.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.857+0000 7fa3e7200640 1 -- 172.21.15.3:0/106067758 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e019f950 con 0x7fa3e010e440 2024-09-19T06:10:46.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.857+0000 7fa3dd600640 1 -- 172.21.15.3:0/106067758 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8017c80 con 0x7fa3e010e440 2024-09-19T06:10:46.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.857+0000 7fa3e7200640 1 -- 172.21.15.3:0/106067758 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e01a7230 con 0x7fa3e010e440 2024-09-19T06:10:46.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.858+0000 7fa3e7200640 1 -- 172.21.15.3:0/106067758 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e00748f0 con 0x7fa3e010e440 2024-09-19T06:10:46.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.860+0000 7fa3dd600640 1 -- 172.21.15.3:0/106067758 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fa3d80107d0 con 0x7fa3e010e440 2024-09-19T06:10:46.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.861+0000 7fa3dd600640 1 --2- 172.21.15.3:0/106067758 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa3c40a3350 0x7fa3c40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:46.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.861+0000 7fa3dd600640 1 -- 172.21.15.3:0/106067758 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fa3d80d0200 con 0x7fa3e010e440 2024-09-19T06:10:46.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.861+0000 7fa3dfe00640 1 --2- 172.21.15.3:0/106067758 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa3c40a3350 0x7fa3c40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:46.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.862+0000 7fa3dfe00640 1 --2- 172.21.15.3:0/106067758 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa3c40a3350 0x7fa3c40a5810 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009c90 tx=0x7fa3d0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:46.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:46.865+0000 7fa3dd600640 1 -- 172.21.15.3:0/106067758 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa3d809cd40 con 0x7fa3e010e440 2024-09-19T06:10:47.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:47.050+0000 7fa3e7200640 1 -- 172.21.15.3:0/106067758 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3e0109030 con 0x7fa3e010e440 2024-09-19T06:10:47.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:47.052+0000 7fa3dd600640 1 -- 172.21.15.3:0/106067758 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22583 (secure 0 0 0) 0x7fa3d8098070 con 0x7fa3e010e440 2024-09-19T06:10:47.054 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:10:47.054 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":88,"fsid":"782a5144-764c-11ef-bceb-c7b262605968","created":"2024-09-19T06:01:35.224753+0000","modified":"2024-09-19T06:10:31.811461+0000","last_up_change":"2024-09-19T06:09:02.478979+0000","last_in_change":"2024-09-19T06:08:38.865280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:04:56.654478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:09:58.426008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:10:01.215704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd89ea4b-a24e-4946-80fc-1776b6d05e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6803","nonce":2061486638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6805","nonce":2061486638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6809","nonce":2061486638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6807","nonce":2061486638}]},"public_addr":"172.21.15.3:6803/2061486638","cluster_addr":"172.21.15.3:6805/2061486638","heartbeat_back_addr":"172.21.15.3:6809/2061486638","heartbeat_front_addr":"172.21.15.3:6807/2061486638","state":["exists","up"]},{"osd":1,"uuid":"e03ca275-8da5-402f-9cd2-654ca422b9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6801","nonce":129318538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6803","nonce":129318538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6807","nonce":129318538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6805","nonce":129318538}]},"public_addr":"172.21.15.59:6801/129318538","cluster_addr":"172.21.15.59:6803/129318538","heartbeat_back_addr":"172.21.15.59:6807/129318538","heartbeat_front_addr":"172.21.15.59:6805/129318538","state":["exists","up"]},{"osd":2,"uuid":"62b7d36d-6078-4027-93b2-009be70a6d80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6801","nonce":2436210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6803","nonce":2436210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6807","nonce":2436210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6805","nonce":2436210695}]},"public_addr":"172.21.15.71:6801/2436210695","cluster_addr":"172.21.15.71:6803/2436210695","heartbeat_back_addr":"172.21.15.71:6807/2436210695","heartbeat_front_addr":"172.21.15.71:6805/2436210695","state":["exists","up"]},{"osd":3,"uuid":"ba33cc45-0103-443d-b262-622a505d9806","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6811","nonce":3577306700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6813","nonce":3577306700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6817","nonce":3577306700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6815","nonce":3577306700}]},"public_addr":"172.21.15.3:6811/3577306700","cluster_addr":"172.21.15.3:6813/3577306700","heartbeat_back_addr":"172.21.15.3:6817/3577306700","heartbeat_front_addr":"172.21.15.3:6815/3577306700","state":["exists","up"]},{"osd":4,"uuid":"40564c0c-6335-4207-a8e0-8078c9bfd015","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6809","nonce":4002980986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6811","nonce":4002980986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6815","nonce":4002980986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6813","nonce":4002980986}]},"public_addr":"172.21.15.59:6809/4002980986","cluster_addr":"172.21.15.59:6811/4002980986","heartbeat_back_addr":"172.21.15.59:6815/4002980986","heartbeat_front_addr":"172.21.15.59:6813/4002980986","state":["exists","up"]},{"osd":5,"uuid":"4db04b82-3403-4fd5-9eb7-7b81ed6b1d26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6809","nonce":2455500497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6811","nonce":2455500497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6815","nonce":2455500497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6813","nonce":2455500497}]},"public_addr":"172.21.15.71:6809/2455500497","cluster_addr":"172.21.15.71:6811/2455500497","heartbeat_back_addr":"172.21.15.71:6815/2455500497","heartbeat_front_addr":"172.21.15.71:6813/2455500497","state":["exists","up"]},{"osd":6,"uuid":"42a74f01-c5d0-4fc6-a8ee-a8bd84d4ab4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6819","nonce":823411903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6821","nonce":823411903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6825","nonce":823411903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6823","nonce":823411903}]},"public_addr":"172.21.15.3:6819/823411903","cluster_addr":"172.21.15.3:6821/823411903","heartbeat_back_addr":"172.21.15.3:6825/823411903","heartbeat_front_addr":"172.21.15.3:6823/823411903","state":["exists","up"]},{"osd":7,"uuid":"8a9bc2ec-4292-465d-8a0d-dda78521a319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6817","nonce":2133603853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6819","nonce":2133603853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6823","nonce":2133603853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6821","nonce":2133603853}]},"public_addr":"172.21.15.59:6817/2133603853","cluster_addr":"172.21.15.59:6819/2133603853","heartbeat_back_addr":"172.21.15.59:6823/2133603853","heartbeat_front_addr":"172.21.15.59:6821/2133603853","state":["exists","up"]},{"osd":8,"uuid":"6099a5c4-3504-43ca-8c58-d23f9096cd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6817","nonce":905333117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6819","nonce":905333117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6823","nonce":905333117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6821","nonce":905333117}]},"public_addr":"172.21.15.71:6817/905333117","cluster_addr":"172.21.15.71:6819/905333117","heartbeat_back_addr":"172.21.15.71:6823/905333117","heartbeat_front_addr":"172.21.15.71:6821/905333117","state":["exists","up"]},{"osd":9,"uuid":"b5a8aac6-bb10-4db8-a056-25228fbe754c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6827","nonce":124909267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6829","nonce":124909267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6833","nonce":124909267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6831","nonce":124909267}]},"public_addr":"172.21.15.3:6827/124909267","cluster_addr":"172.21.15.3:6829/124909267","heartbeat_back_addr":"172.21.15.3:6833/124909267","heartbeat_front_addr":"172.21.15.3:6831/124909267","state":["exists","up"]},{"osd":10,"uuid":"e49f3aab-0804-4aea-ae3f-38f022ab5239","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6825","nonce":784134238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6827","nonce":784134238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6831","nonce":784134238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6829","nonce":784134238}]},"public_addr":"172.21.15.59:6825/784134238","cluster_addr":"172.21.15.59:6827/784134238","heartbeat_back_addr":"172.21.15.59:6831/784134238","heartbeat_front_addr":"172.21.15.59:6829/784134238","state":["exists","up"]},{"osd":11,"uuid":"6c6d6c23-bcf7-43e7-94d1-5f2ebaa15441","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6825","nonce":3502550915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6827","nonce":3502550915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6831","nonce":3502550915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6829","nonce":3502550915}]},"public_addr":"172.21.15.71:6825/3502550915","cluster_addr":"172.21.15.71:6827/3502550915","heartbeat_back_addr":"172.21.15.71:6831/3502550915","heartbeat_front_addr":"172.21.15.71:6829/3502550915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:01.683342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:28.058683+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:53.250819+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:05:23.267377+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:05:49.756289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:06:15.766613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:06:46.054328+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:12.579180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:37.976863+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:08.683966+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:35.120765+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:00.624411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/1458736313":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/2065281908":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/953348594":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6801/518259590":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/1658697906":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6801/2386230415":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6800/2386230415":"2024-09-20T06:02:01.122348+0000","172.21.15.3:0/1616091100":"2024-09-20T06:02:30.039686+0000","172.21.15.3:6800/518259590":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/2122482494":"2024-09-20T06:02:01.122348+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:10:47.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:47.054+0000 7fa3e7200640 1 -- 172.21.15.3:0/106067758 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa3c40a3350 msgr2=0x7fa3c40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:47.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:47.054+0000 7fa3e7200640 1 --2- 172.21.15.3:0/106067758 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa3c40a3350 0x7fa3c40a5810 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009c90 tx=0x7fa3d0005f90 comp rx=0 tx=0).stop 2024-09-19T06:10:47.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:47.054+0000 7fa3e7200640 1 -- 172.21.15.3:0/106067758 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3e010e440 msgr2=0x7fa3e019ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:47.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:47.054+0000 7fa3e7200640 1 --2- 172.21.15.3:0/106067758 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3e010e440 0x7fa3e019ef80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8005fd0 tx=0x7fa3d800c6a0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:47.054+0000 7fa3e7200640 1 -- 172.21.15.3:0/106067758 shutdown_connections 2024-09-19T06:10:47.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:47.054+0000 7fa3e7200640 1 --2- 172.21.15.3:0/106067758 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa3c40a3350 0x7fa3c40a5810 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:47.054+0000 7fa3e7200640 1 --2- 172.21.15.3:0/106067758 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3e010e440 0x7fa3e019ef80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:47.054+0000 7fa3e7200640 1 --2- 172.21.15.3:0/106067758 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa3e0074e30 0x7fa3e019abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:47.054+0000 7fa3e7200640 1 --2- 172.21.15.3:0/106067758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3e0074510 0x7fa3e019a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:47.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:47.054+0000 7fa3e7200640 1 -- 172.21.15.3:0/106067758 >> 172.21.15.3:0/106067758 conn(0x7fa3e00fd8c0 msgr2=0x7fa3e00fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:47.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:47.054+0000 7fa3e7200640 1 -- 172.21.15.3:0/106067758 shutdown_connections 2024-09-19T06:10:47.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:47.054+0000 7fa3e7200640 1 -- 172.21.15.3:0/106067758 wait complete. 2024-09-19T06:10:47.838 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T06:10:47.838 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T06:10:47.839 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T06:10:47.839 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T06:10:47.840 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T06:10:47.840 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T06:10:47.840 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T06:10:47.841 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T06:10:47.842 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T06:10:47.842 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T06:10:47.842 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T06:10:47.843 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T06:10:48.053 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:47 smithi003 ceph-mon[30893]: pgmap v326: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.1 KiB/s wr, 8 op/s; 55 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:10:48.053 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:47 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/106067758' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:10:48.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:47 smithi059 ceph-mon[35138]: pgmap v326: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.1 KiB/s wr, 8 op/s; 55 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:10:48.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:47 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/106067758' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:10:48.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:47 smithi071 ceph-mon[35662]: pgmap v326: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.1 KiB/s wr, 8 op/s; 55 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:10:48.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:47 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/106067758' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:10:48.852 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:48.891 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:48.921 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:48.954 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:49.934 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:49 smithi003 ceph-mon[30893]: pgmap v327: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.1 KiB/s wr, 11 op/s; 55 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:10:50.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.049+0000 7fd4e9c00640 1 -- 172.21.15.3:0/418528784 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4e4077040 msgr2=0x7fd4e41124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:50.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.049+0000 7fd4e9c00640 1 --2- 172.21.15.3:0/418528784 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4e4077040 0x7fd4e41124f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0009900 tx=0x7fd4d002a410 comp rx=0 tx=0).stop 2024-09-19T06:10:50.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.049+0000 7fd4e9c00640 1 -- 172.21.15.3:0/418528784 shutdown_connections 2024-09-19T06:10:50.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.049+0000 7fd4e9c00640 1 --2- 172.21.15.3:0/418528784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4e4112a30 0x7fd4e4114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:50.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.049+0000 7fd4e9c00640 1 --2- 172.21.15.3:0/418528784 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4e4077040 0x7fd4e41124f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:50.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.049+0000 7fd4e9c00640 1 --2- 172.21.15.3:0/418528784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4e4076720 0x7fd4e4076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:50.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.049+0000 7fd4e9c00640 1 -- 172.21.15.3:0/418528784 >> 172.21.15.3:0/418528784 conn(0x7fd4e40ffa90 msgr2=0x7fd4e4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:50.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.050+0000 7fd4e9c00640 1 -- 172.21.15.3:0/418528784 shutdown_connections 2024-09-19T06:10:50.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.050+0000 7fd4e9c00640 1 -- 172.21.15.3:0/418528784 wait complete. 2024-09-19T06:10:50.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.051+0000 7fd4e9c00640 1 Processor -- start 2024-09-19T06:10:50.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.051+0000 7fd4e9c00640 1 -- start start 2024-09-19T06:10:50.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.051+0000 7fd4e9c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4e4076720 0x7fd4e41a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:50.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.051+0000 7fd4e9c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4e4077040 0x7fd4e41a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:50.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.051+0000 7fd4e9c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4e4112a30 0x7fd4e419e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:50.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.051+0000 7fd4e9c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e4118610 con 0x7fd4e4112a30 2024-09-19T06:10:50.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.051+0000 7fd4e9c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e4118490 con 0x7fd4e4076720 2024-09-19T06:10:50.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.051+0000 7fd4e9c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e4118790 con 0x7fd4e4077040 2024-09-19T06:10:50.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.051+0000 7fd4e2000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4e4077040 0x7fd4e41a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:50.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.051+0000 7fd4e3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4e4112a30 0x7fd4e419e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:50.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.051+0000 7fd4e2000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4e4077040 0x7fd4e41a4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:36138/0 (socket says 172.21.15.3:36138) 2024-09-19T06:10:50.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.051+0000 7fd4e2000640 1 -- 172.21.15.3:0/270931373 learned_addr learned my addr 172.21.15.3:0/270931373 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:50.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.051+0000 7fd4e2a00640 1 --2- 172.21.15.3:0/270931373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4e4076720 0x7fd4e41a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:50.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.052+0000 7fd4e2a00640 1 -- 172.21.15.3:0/270931373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4e4077040 msgr2=0x7fd4e41a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:50.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.052+0000 7fd4e2a00640 1 --2- 172.21.15.3:0/270931373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd4e4077040 0x7fd4e41a4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:50.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.052+0000 7fd4e2a00640 1 -- 172.21.15.3:0/270931373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4e4112a30 msgr2=0x7fd4e419e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:50.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.052+0000 7fd4e2a00640 1 --2- 172.21.15.3:0/270931373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4e4112a30 0x7fd4e419e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:50.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.052+0000 7fd4e2a00640 1 -- 172.21.15.3:0/270931373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e419f050 con 0x7fd4e4076720 2024-09-19T06:10:50.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.052+0000 7fd4e2a00640 1 --2- 172.21.15.3:0/270931373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4e4076720 0x7fd4e41a4760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd4d400e9f0 tx=0x7fd4d400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:50.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.052+0000 7fd4db400640 1 -- 172.21.15.3:0/270931373 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d400ccc0 con 0x7fd4e4076720 2024-09-19T06:10:50.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.052+0000 7fd4db400640 1 -- 172.21.15.3:0/270931373 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4d4005020 con 0x7fd4e4076720 2024-09-19T06:10:50.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.052+0000 7fd4db400640 1 -- 172.21.15.3:0/270931373 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d40049e0 con 0x7fd4e4076720 2024-09-19T06:10:50.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.052+0000 7fd4e9c00640 1 -- 172.21.15.3:0/270931373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e419f340 con 0x7fd4e4076720 2024-09-19T06:10:50.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.053+0000 7fd4e9c00640 1 -- 172.21.15.3:0/270931373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e41ab630 con 0x7fd4e4076720 2024-09-19T06:10:50.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.053+0000 7fd4e9c00640 1 -- 172.21.15.3:0/270931373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd4e4062980 con 0x7fd4e4076720 2024-09-19T06:10:50.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.055+0000 7fd4db400640 1 -- 172.21.15.3:0/270931373 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fd4d4005560 con 0x7fd4e4076720 2024-09-19T06:10:50.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.057+0000 7fd4db400640 1 --2- 172.21.15.3:0/270931373 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd4c80a3350 0x7fd4c80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:50.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.057+0000 7fd4db400640 1 -- 172.21.15.3:0/270931373 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fd4d40cfce0 con 0x7fd4e4076720 2024-09-19T06:10:50.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.057+0000 7fd4e2000640 1 --2- 172.21.15.3:0/270931373 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd4c80a3350 0x7fd4c80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:50.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.057+0000 7fd4db400640 1 --2- 172.21.15.3:0/270931373 >> [v2:172.21.15.71:6800/2436210695,v1:172.21.15.71:6801/2436210695] conn(0x7fd4c80ad000 0x7fd4c80af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:50.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.057+0000 7fd4db400640 1 -- 172.21.15.3:0/270931373 --> [v2:172.21.15.71:6800/2436210695,v1:172.21.15.71:6801/2436210695] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd4c80afb70 con 0x7fd4c80ad000 2024-09-19T06:10:50.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.057+0000 7fd4db400640 1 -- 172.21.15.3:0/270931373 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7fd4d40d0090 con 0x7fd4e4076720 2024-09-19T06:10:50.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.058+0000 7fd4e3400640 1 --2- 172.21.15.3:0/270931373 >> [v2:172.21.15.71:6800/2436210695,v1:172.21.15.71:6801/2436210695] conn(0x7fd4c80ad000 0x7fd4c80af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:50.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.058+0000 7fd4e2000640 1 --2- 172.21.15.3:0/270931373 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd4c80a3350 0x7fd4c80a5810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4079290 tx=0x7fd4d00046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:50.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.058+0000 7fd4e3400640 1 --2- 172.21.15.3:0/270931373 >> [v2:172.21.15.71:6800/2436210695,v1:172.21.15.71:6801/2436210695] conn(0x7fd4c80ad000 0x7fd4c80af4a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:50.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.059+0000 7fd4db400640 1 -- 172.21.15.3:0/270931373 <== osd.2 v2:172.21.15.71:6800/2436210695 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd4c80afb70 con 0x7fd4c80ad000 2024-09-19T06:10:50.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.082+0000 7fd4e9c00640 1 -- 172.21.15.3:0/270931373 --> [v2:172.21.15.71:6800/2436210695,v1:172.21.15.71:6801/2436210695] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd4e4062e00 con 0x7fd4c80ad000 2024-09-19T06:10:50.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.082+0000 7fd4db400640 1 -- 172.21.15.3:0/270931373 <== osd.2 v2:172.21.15.71:6800/2436210695 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd4e4062e00 con 0x7fd4c80ad000 2024-09-19T06:10:50.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.083+0000 7fd4e9c00640 1 -- 172.21.15.3:0/270931373 >> [v2:172.21.15.71:6800/2436210695,v1:172.21.15.71:6801/2436210695] conn(0x7fd4c80ad000 msgr2=0x7fd4c80af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:50.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.083+0000 7fd4e9c00640 1 --2- 172.21.15.3:0/270931373 >> [v2:172.21.15.71:6800/2436210695,v1:172.21.15.71:6801/2436210695] conn(0x7fd4c80ad000 0x7fd4c80af4a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:50.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.083+0000 7fd4e9c00640 1 -- 172.21.15.3:0/270931373 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd4c80a3350 msgr2=0x7fd4c80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:50.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.083+0000 7fd4e9c00640 1 --2- 172.21.15.3:0/270931373 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd4c80a3350 0x7fd4c80a5810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4079290 tx=0x7fd4d00046c0 comp rx=0 tx=0).stop 2024-09-19T06:10:50.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.083+0000 7fd4e9c00640 1 -- 172.21.15.3:0/270931373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4e4076720 msgr2=0x7fd4e41a4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:50.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.083+0000 7fd4e9c00640 1 --2- 172.21.15.3:0/270931373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4e4076720 0x7fd4e41a4760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd4d400e9f0 tx=0x7fd4d400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:10:50.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.083+0000 7fd4e3400640 1 -- 172.21.15.3:0/270931373 reap_dead start 2024-09-19T06:10:50.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.083+0000 7fd4e9c00640 1 -- 172.21.15.3:0/270931373 shutdown_connections 2024-09-19T06:10:50.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.083+0000 7fd4e9c00640 1 -- 172.21.15.3:0/270931373 >> 172.21.15.3:0/270931373 conn(0x7fd4e40ffa90 msgr2=0x7fd4e4101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:50.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.083+0000 7fd4e9c00640 1 -- 172.21.15.3:0/270931373 shutdown_connections 2024-09-19T06:10:50.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:50.083+0000 7fd4e9c00640 1 -- 172.21.15.3:0/270931373 wait complete. 2024-09-19T06:10:50.088 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:50.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.953+0000 7f062e600640 1 -- 172.21.15.3:0/2799981327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06281079c0 msgr2=0x7f0628107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:50.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.953+0000 7f062e600640 1 --2- 172.21.15.3:0/2799981327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06281079c0 0x7f0628107da0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f061c009930 tx=0x7f061c02a420 comp rx=0 tx=0).stop 2024-09-19T06:10:50.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.953+0000 7f062e600640 1 -- 172.21.15.3:0/2799981327 shutdown_connections 2024-09-19T06:10:50.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.953+0000 7f062e600640 1 --2- 172.21.15.3:0/2799981327 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0628102360 0x7f062810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:50.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.953+0000 7f062e600640 1 --2- 172.21.15.3:0/2799981327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06281019c0 0x7f0628101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:50.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.953+0000 7f062e600640 1 --2- 172.21.15.3:0/2799981327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06281079c0 0x7f0628107da0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:50.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.953+0000 7f062e600640 1 -- 172.21.15.3:0/2799981327 >> 172.21.15.3:0/2799981327 conn(0x7f06280fd740 msgr2=0x7f06280ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:50.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.953+0000 7f062e600640 1 -- 172.21.15.3:0/2799981327 shutdown_connections 2024-09-19T06:10:50.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.953+0000 7f062e600640 1 -- 172.21.15.3:0/2799981327 wait complete. 2024-09-19T06:10:50.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.954+0000 7f062e600640 1 Processor -- start 2024-09-19T06:10:50.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.954+0000 7f062e600640 1 -- start start 2024-09-19T06:10:50.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.955+0000 7f062e600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06281019c0 0x7f062819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:50.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.955+0000 7f062e600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0628102360 0x7f062819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:50.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.955+0000 7f062e600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06281079c0 0x7f062819eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:50.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.955+0000 7f062e600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0628111d90 con 0x7f06281079c0 2024-09-19T06:10:50.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.955+0000 7f062e600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0628111c10 con 0x7f06281019c0 2024-09-19T06:10:50.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.955+0000 7f062e600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0628111f10 con 0x7f0628102360 2024-09-19T06:10:50.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.955+0000 7f062dc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06281079c0 0x7f062819eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:50.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.955+0000 7f062dc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06281079c0 0x7f062819eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51268/0 (socket says 172.21.15.3:51268) 2024-09-19T06:10:50.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.955+0000 7f062dc00640 1 -- 172.21.15.3:0/2993231130 learned_addr learned my addr 172.21.15.3:0/2993231130 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:50.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.955+0000 7f062d200640 1 --2- 172.21.15.3:0/2993231130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06281019c0 0x7f062819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:50.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.955+0000 7f0627e00640 1 --2- 172.21.15.3:0/2993231130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0628102360 0x7f062819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:50.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.956+0000 7f062dc00640 1 -- 172.21.15.3:0/2993231130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0628102360 msgr2=0x7f062819aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:50.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.956+0000 7f062dc00640 1 --2- 172.21.15.3:0/2993231130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0628102360 0x7f062819aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:50.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.956+0000 7f062dc00640 1 -- 172.21.15.3:0/2993231130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06281019c0 msgr2=0x7f062819a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:50.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.956+0000 7f062dc00640 1 --2- 172.21.15.3:0/2993231130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06281019c0 0x7f062819a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:50.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.956+0000 7f062dc00640 1 -- 172.21.15.3:0/2993231130 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f062819f480 con 0x7f06281079c0 2024-09-19T06:10:50.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.956+0000 7f062dc00640 1 --2- 172.21.15.3:0/2993231130 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06281079c0 0x7f062819eda0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f062000eb10 tx=0x7f062000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:50.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.956+0000 7f0625600640 1 -- 172.21.15.3:0/2993231130 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0620004b20 con 0x7f06281079c0 2024-09-19T06:10:50.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.956+0000 7f0625600640 1 -- 172.21.15.3:0/2993231130 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0620004cc0 con 0x7f06281079c0 2024-09-19T06:10:50.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.956+0000 7f0625600640 1 -- 172.21.15.3:0/2993231130 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0620010760 con 0x7f06281079c0 2024-09-19T06:10:50.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.956+0000 7f062e600640 1 -- 172.21.15.3:0/2993231130 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f062819f770 con 0x7f06281079c0 2024-09-19T06:10:50.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.956+0000 7f062e600640 1 -- 172.21.15.3:0/2993231130 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06281a7050 con 0x7f06281079c0 2024-09-19T06:10:50.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.957+0000 7f062e600640 1 -- 172.21.15.3:0/2993231130 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f06280fe830 con 0x7f06281079c0 2024-09-19T06:10:50.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.959+0000 7f0625600640 1 -- 172.21.15.3:0/2993231130 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f0620005020 con 0x7f06281079c0 2024-09-19T06:10:50.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.961+0000 7f0625600640 1 --2- 172.21.15.3:0/2993231130 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f06100a32d0 0x7f06100a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:50.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.961+0000 7f0625600640 1 -- 172.21.15.3:0/2993231130 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f06200d0440 con 0x7f06281079c0 2024-09-19T06:10:50.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.961+0000 7f062d200640 1 --2- 172.21.15.3:0/2993231130 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f06100a32d0 0x7f06100a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:50.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.961+0000 7f0625600640 1 --2- 172.21.15.3:0/2993231130 >> [v2:172.21.15.59:6800/129318538,v1:172.21.15.59:6801/129318538] conn(0x7f06100acf80 0x7f06100af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:50.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.961+0000 7f0625600640 1 -- 172.21.15.3:0/2993231130 --> [v2:172.21.15.59:6800/129318538,v1:172.21.15.59:6801/129318538] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f06100afaf0 con 0x7f06100acf80 2024-09-19T06:10:50.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.961+0000 7f0625600640 1 -- 172.21.15.3:0/2993231130 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f06200d07f0 con 0x7f06281079c0 2024-09-19T06:10:50.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.961+0000 7f0627e00640 1 --2- 172.21.15.3:0/2993231130 >> [v2:172.21.15.59:6800/129318538,v1:172.21.15.59:6801/129318538] conn(0x7f06100acf80 0x7f06100af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:50.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.962+0000 7f062d200640 1 --2- 172.21.15.3:0/2993231130 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f06100a32d0 0x7f06100a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f061c009900 tx=0x7f061c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:50.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.962+0000 7f0627e00640 1 --2- 172.21.15.3:0/2993231130 >> [v2:172.21.15.59:6800/129318538,v1:172.21.15.59:6801/129318538] conn(0x7f06100acf80 0x7f06100af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:50.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.963+0000 7f0625600640 1 -- 172.21.15.3:0/2993231130 <== osd.1 v2:172.21.15.59:6800/129318538 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f06100afaf0 con 0x7f06100acf80 2024-09-19T06:10:50.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.977+0000 7f062e600640 1 -- 172.21.15.3:0/2993231130 --> [v2:172.21.15.59:6800/129318538,v1:172.21.15.59:6801/129318538] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0628103100 con 0x7f06100acf80 2024-09-19T06:10:50.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.978+0000 7f0625600640 1 -- 172.21.15.3:0/2993231130 <== osd.1 v2:172.21.15.59:6800/129318538 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0628103100 con 0x7f06100acf80 2024-09-19T06:10:50.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.978+0000 7f062e600640 1 -- 172.21.15.3:0/2993231130 >> [v2:172.21.15.59:6800/129318538,v1:172.21.15.59:6801/129318538] conn(0x7f06100acf80 msgr2=0x7f06100af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:50.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.978+0000 7f062e600640 1 --2- 172.21.15.3:0/2993231130 >> [v2:172.21.15.59:6800/129318538,v1:172.21.15.59:6801/129318538] conn(0x7f06100acf80 0x7f06100af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:50.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.979+0000 7f062e600640 1 -- 172.21.15.3:0/2993231130 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f06100a32d0 msgr2=0x7f06100a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:50.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.979+0000 7f062e600640 1 --2- 172.21.15.3:0/2993231130 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f06100a32d0 0x7f06100a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f061c009900 tx=0x7f061c0058d0 comp rx=0 tx=0).stop 2024-09-19T06:10:50.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.979+0000 7f062e600640 1 -- 172.21.15.3:0/2993231130 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06281079c0 msgr2=0x7f062819eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:50.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.979+0000 7f062e600640 1 --2- 172.21.15.3:0/2993231130 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06281079c0 0x7f062819eda0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f062000eb10 tx=0x7f062000c2d0 comp rx=0 tx=0).stop 2024-09-19T06:10:50.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.979+0000 7f062dc00640 1 -- 172.21.15.3:0/2993231130 reap_dead start 2024-09-19T06:10:50.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.979+0000 7f062e600640 1 -- 172.21.15.3:0/2993231130 shutdown_connections 2024-09-19T06:10:50.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.979+0000 7f062e600640 1 -- 172.21.15.3:0/2993231130 >> 172.21.15.3:0/2993231130 conn(0x7f06280fd740 msgr2=0x7f06280fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:50.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.979+0000 7f062e600640 1 -- 172.21.15.3:0/2993231130 shutdown_connections 2024-09-19T06:10:50.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:49.979+0000 7f062e600640 1 -- 172.21.15.3:0/2993231130 wait complete. 2024-09-19T06:10:50.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:49 smithi059 ceph-mon[35138]: pgmap v327: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.1 KiB/s wr, 11 op/s; 55 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:10:50.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:49 smithi071 ceph-mon[35662]: pgmap v327: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.1 KiB/s wr, 11 op/s; 55 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T06:10:50.626 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:50.627 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:50.627 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:50.631 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:50.632 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:50.633 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:50.633 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:10:51.007 INFO:teuthology.orchestra.run.smithi003.stdout:55834574925 2024-09-19T06:10:51.008 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T06:10:51.952 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:51 smithi003 ceph-mon[30893]: pgmap v328: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-19T06:10:51.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.949+0000 7f78e5400640 1 -- 172.21.15.3:0/1285381600 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e00319b0 con 0x7f78e810e260 2024-09-19T06:10:51.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.950+0000 7f78e7200640 1 -- 172.21.15.3:0/1285381600 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78e810e260 msgr2=0x7f78e8110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:51.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.950+0000 7f78e7200640 1 --2- 172.21.15.3:0/1285381600 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78e810e260 0x7f78e8110650 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f78e0009900 tx=0x7f78e002a480 comp rx=0 tx=0).stop 2024-09-19T06:10:51.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.950+0000 7f78e7200640 1 -- 172.21.15.3:0/1285381600 shutdown_connections 2024-09-19T06:10:51.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.950+0000 7f78e7200640 1 --2- 172.21.15.3:0/1285381600 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78e810e260 0x7f78e8110650 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:51.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.950+0000 7f78e7200640 1 --2- 172.21.15.3:0/1285381600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78e8074ee0 0x7f78e810dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:51.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.950+0000 7f78e7200640 1 --2- 172.21.15.3:0/1285381600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78e80745c0 0x7f78e80749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:51.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.950+0000 7f78e7200640 1 -- 172.21.15.3:0/1285381600 >> 172.21.15.3:0/1285381600 conn(0x7f78e80fd6e0 msgr2=0x7f78e80ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:51.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.950+0000 7f78e7200640 1 -- 172.21.15.3:0/1285381600 shutdown_connections 2024-09-19T06:10:51.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.950+0000 7f78e7200640 1 -- 172.21.15.3:0/1285381600 wait complete. 2024-09-19T06:10:51.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.951+0000 7f78e7200640 1 Processor -- start 2024-09-19T06:10:51.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.951+0000 7f78e7200640 1 -- start start 2024-09-19T06:10:51.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.951+0000 7f78e7200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78e80745c0 0x7f78e819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:51.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.952+0000 7f78e7200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78e8074ee0 0x7f78e819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:51.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.952+0000 7f78e7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78e810e260 0x7f78e819eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:51.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.952+0000 7f78e7200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f78e8113fb0 con 0x7f78e8074ee0 2024-09-19T06:10:51.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.952+0000 7f78e7200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f78e8113e30 con 0x7f78e810e260 2024-09-19T06:10:51.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.952+0000 7f78e7200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f78e8114130 con 0x7f78e80745c0 2024-09-19T06:10:51.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.952+0000 7f78dd400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78e8074ee0 0x7f78e819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:51.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.952+0000 7f78dd400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78e8074ee0 0x7f78e819aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51322/0 (socket says 172.21.15.3:51322) 2024-09-19T06:10:51.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.952+0000 7f78dd400640 1 -- 172.21.15.3:0/2552709808 learned_addr learned my addr 172.21.15.3:0/2552709808 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:51.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.952+0000 7f78e5e00640 1 --2- 172.21.15.3:0/2552709808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78e80745c0 0x7f78e819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:51.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.952+0000 7f78e6800640 1 --2- 172.21.15.3:0/2552709808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78e810e260 0x7f78e819eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:51.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.952+0000 7f78dd400640 1 -- 172.21.15.3:0/2552709808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78e80745c0 msgr2=0x7f78e819a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:51.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.952+0000 7f78dd400640 1 --2- 172.21.15.3:0/2552709808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78e80745c0 0x7f78e819a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:51.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.952+0000 7f78dd400640 1 -- 172.21.15.3:0/2552709808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78e810e260 msgr2=0x7f78e819eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:51.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.952+0000 7f78dd400640 1 --2- 172.21.15.3:0/2552709808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78e810e260 0x7f78e819eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:51.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.952+0000 7f78dd400640 1 -- 172.21.15.3:0/2552709808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e819f480 con 0x7f78e8074ee0 2024-09-19T06:10:51.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.952+0000 7f78e5e00640 1 --2- 172.21.15.3:0/2552709808 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f78e80745c0 0x7f78e819a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:51.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.953+0000 7f78dd400640 1 --2- 172.21.15.3:0/2552709808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78e8074ee0 0x7f78e819aa10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f78d000e9f0 tx=0x7f78d000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:51.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.953+0000 7f78df400640 1 -- 172.21.15.3:0/2552709808 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d000cd80 con 0x7f78e8074ee0 2024-09-19T06:10:51.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.953+0000 7f78df400640 1 -- 172.21.15.3:0/2552709808 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78d0005500 con 0x7f78e8074ee0 2024-09-19T06:10:51.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.953+0000 7f78df400640 1 -- 172.21.15.3:0/2552709808 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0010690 con 0x7f78e8074ee0 2024-09-19T06:10:51.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.953+0000 7f78e7200640 1 -- 172.21.15.3:0/2552709808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78e819f770 con 0x7f78e8074ee0 2024-09-19T06:10:51.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.953+0000 7f78e7200640 1 -- 172.21.15.3:0/2552709808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e81a7050 con 0x7f78e8074ee0 2024-09-19T06:10:51.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.954+0000 7f78e7200640 1 -- 172.21.15.3:0/2552709808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f78e8062900 con 0x7f78e8074ee0 2024-09-19T06:10:51.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.958+0000 7f78df400640 1 -- 172.21.15.3:0/2552709808 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f78d00046c0 con 0x7f78e8074ee0 2024-09-19T06:10:51.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.959+0000 7f78df400640 1 --2- 172.21.15.3:0/2552709808 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f78cc0a3350 0x7f78cc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:51.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.959+0000 7f78df400640 1 -- 172.21.15.3:0/2552709808 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f78d00d0270 con 0x7f78e8074ee0 2024-09-19T06:10:51.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.959+0000 7f78e5e00640 1 --2- 172.21.15.3:0/2552709808 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f78cc0a3350 0x7f78cc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:51.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.959+0000 7f78df400640 1 --2- 172.21.15.3:0/2552709808 >> [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267] conn(0x7f78cc0ad000 0x7f78cc0af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:51.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.959+0000 7f78df400640 1 -- 172.21.15.3:0/2552709808 --> [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f78d001aec0 con 0x7f78cc0ad000 2024-09-19T06:10:51.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.959+0000 7f78df400640 1 -- 172.21.15.3:0/2552709808 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f78d00d0620 con 0x7f78e8074ee0 2024-09-19T06:10:51.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.960+0000 7f78e6800640 1 --2- 172.21.15.3:0/2552709808 >> [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267] conn(0x7f78cc0ad000 0x7f78cc0af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:51.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.960+0000 7f78e5e00640 1 --2- 172.21.15.3:0/2552709808 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f78cc0a3350 0x7f78cc0a5810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f78d8005fd0 tx=0x7f78d8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:51.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.960+0000 7f78e6800640 1 --2- 172.21.15.3:0/2552709808 >> [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267] conn(0x7f78cc0ad000 0x7f78cc0af4a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:51.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.961+0000 7f78df400640 1 -- 172.21.15.3:0/2552709808 <== osd.9 v2:172.21.15.3:6826/124909267 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f78d001aec0 con 0x7f78cc0ad000 2024-09-19T06:10:51.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.977+0000 7f78e7200640 1 -- 172.21.15.3:0/2552709808 --> [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f78e8062d80 con 0x7f78cc0ad000 2024-09-19T06:10:51.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.978+0000 7f78df400640 1 -- 172.21.15.3:0/2552709808 <== osd.9 v2:172.21.15.3:6826/124909267 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f78e8062d80 con 0x7f78cc0ad000 2024-09-19T06:10:51.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.978+0000 7f78e7200640 1 -- 172.21.15.3:0/2552709808 >> [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267] conn(0x7f78cc0ad000 msgr2=0x7f78cc0af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:51.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.978+0000 7f78e7200640 1 --2- 172.21.15.3:0/2552709808 >> [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267] conn(0x7f78cc0ad000 0x7f78cc0af4a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:51.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.978+0000 7f78e7200640 1 -- 172.21.15.3:0/2552709808 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f78cc0a3350 msgr2=0x7f78cc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:51.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.978+0000 7f78e7200640 1 --2- 172.21.15.3:0/2552709808 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f78cc0a3350 0x7f78cc0a5810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f78d8005fd0 tx=0x7f78d8009500 comp rx=0 tx=0).stop 2024-09-19T06:10:51.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.978+0000 7f78e7200640 1 -- 172.21.15.3:0/2552709808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78e8074ee0 msgr2=0x7f78e819aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:51.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.978+0000 7f78e7200640 1 --2- 172.21.15.3:0/2552709808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f78e8074ee0 0x7f78e819aa10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f78d000e9f0 tx=0x7f78d000edf0 comp rx=0 tx=0).stop 2024-09-19T06:10:51.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.979+0000 7f78e6800640 1 -- 172.21.15.3:0/2552709808 reap_dead start 2024-09-19T06:10:51.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.979+0000 7f78e7200640 1 -- 172.21.15.3:0/2552709808 shutdown_connections 2024-09-19T06:10:51.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.979+0000 7f78e7200640 1 -- 172.21.15.3:0/2552709808 >> 172.21.15.3:0/2552709808 conn(0x7f78e80fd6e0 msgr2=0x7f78e80fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:51.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.979+0000 7f78e7200640 1 -- 172.21.15.3:0/2552709808 shutdown_connections 2024-09-19T06:10:51.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:51.979+0000 7f78e7200640 1 -- 172.21.15.3:0/2552709808 wait complete. 2024-09-19T06:10:52.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:51 smithi059 ceph-mon[35138]: pgmap v328: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-19T06:10:52.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:51 smithi071 ceph-mon[35662]: pgmap v328: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-19T06:10:52.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.235+0000 7f1470a00640 1 -- 172.21.15.3:0/1705475217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f146c1049c0 msgr2=0x7f146c108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:52.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.235+0000 7f1470a00640 1 --2- 172.21.15.3:0/1705475217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f146c1049c0 0x7f146c108a10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1458009900 tx=0x7f145802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:10:52.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.235+0000 7f1470a00640 1 -- 172.21.15.3:0/1705475217 shutdown_connections 2024-09-19T06:10:52.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.235+0000 7f1470a00640 1 --2- 172.21.15.3:0/1705475217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f146c109140 0x7f146c110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:52.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.235+0000 7f1470a00640 1 --2- 172.21.15.3:0/1705475217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f146c1049c0 0x7f146c108a10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:52.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.235+0000 7f1470a00640 1 --2- 172.21.15.3:0/1705475217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f146c104010 0x7f146c1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:52.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.235+0000 7f1470a00640 1 -- 172.21.15.3:0/1705475217 >> 172.21.15.3:0/1705475217 conn(0x7f146c0ffa50 msgr2=0x7f146c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:52.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.235+0000 7f1470a00640 1 -- 172.21.15.3:0/1705475217 shutdown_connections 2024-09-19T06:10:52.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.235+0000 7f1470a00640 1 -- 172.21.15.3:0/1705475217 wait complete. 2024-09-19T06:10:52.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.236+0000 7f1470a00640 1 Processor -- start 2024-09-19T06:10:52.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.236+0000 7f1470a00640 1 -- start start 2024-09-19T06:10:52.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.237+0000 7f1470a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f146c104010 0x7f146c19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:52.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.237+0000 7f1470a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f146c1049c0 0x7f146c19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:52.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.237+0000 7f1470a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f146c109140 0x7f146c19ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:52.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.237+0000 7f1470a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f146c114140 con 0x7f146c104010 2024-09-19T06:10:52.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.237+0000 7f1470a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f146c113fc0 con 0x7f146c109140 2024-09-19T06:10:52.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.237+0000 7f1470a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f146c1142c0 con 0x7f146c1049c0 2024-09-19T06:10:52.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.237+0000 7f1469e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f146c104010 0x7f146c19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:52.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.237+0000 7f1469e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f146c104010 0x7f146c19a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51332/0 (socket says 172.21.15.3:51332) 2024-09-19T06:10:52.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.237+0000 7f1469e00640 1 -- 172.21.15.3:0/2376489497 learned_addr learned my addr 172.21.15.3:0/2376489497 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:52.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.237+0000 7f1469400640 1 --2- 172.21.15.3:0/2376489497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f146c1049c0 0x7f146c19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:52.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.237+0000 7f146a800640 1 --2- 172.21.15.3:0/2376489497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f146c109140 0x7f146c19ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:52.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.238+0000 7f1469e00640 1 -- 172.21.15.3:0/2376489497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f146c1049c0 msgr2=0x7f146c19aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:52.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.238+0000 7f1469e00640 1 --2- 172.21.15.3:0/2376489497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f146c1049c0 0x7f146c19aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:52.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.238+0000 7f1469e00640 1 -- 172.21.15.3:0/2376489497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f146c109140 msgr2=0x7f146c19ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:52.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.238+0000 7f1469e00640 1 --2- 172.21.15.3:0/2376489497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f146c109140 0x7f146c19ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:52.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.238+0000 7f1469e00640 1 -- 172.21.15.3:0/2376489497 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f146c19f610 con 0x7f146c104010 2024-09-19T06:10:52.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.238+0000 7f146a800640 1 --2- 172.21.15.3:0/2376489497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f146c109140 0x7f146c19ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:10:52.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.238+0000 7f1469400640 1 --2- 172.21.15.3:0/2376489497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f146c1049c0 0x7f146c19aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:52.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.238+0000 7f1469e00640 1 --2- 172.21.15.3:0/2376489497 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f146c104010 0x7f146c19a660 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f145c00e9f0 tx=0x7f145c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:52.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.238+0000 7f1462a00640 1 -- 172.21.15.3:0/2376489497 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c00cd80 con 0x7f146c104010 2024-09-19T06:10:52.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.238+0000 7f1462a00640 1 -- 172.21.15.3:0/2376489497 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f145c010910 con 0x7f146c104010 2024-09-19T06:10:52.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.238+0000 7f1470a00640 1 -- 172.21.15.3:0/2376489497 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f146c19f900 con 0x7f146c104010 2024-09-19T06:10:52.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.238+0000 7f1462a00640 1 -- 172.21.15.3:0/2376489497 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c018990 con 0x7f146c104010 2024-09-19T06:10:52.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.238+0000 7f1470a00640 1 -- 172.21.15.3:0/2376489497 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f146c1a71e0 con 0x7f146c104010 2024-09-19T06:10:52.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.239+0000 7f1470a00640 1 -- 172.21.15.3:0/2376489497 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f146c062980 con 0x7f146c104010 2024-09-19T06:10:52.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.241+0000 7f1462a00640 1 -- 172.21.15.3:0/2376489497 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f145c010ac0 con 0x7f146c104010 2024-09-19T06:10:52.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.243+0000 7f1462a00640 1 --2- 172.21.15.3:0/2376489497 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f14500a32d0 0x7f14500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:52.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.243+0000 7f1462a00640 1 -- 172.21.15.3:0/2376489497 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f145c0d0550 con 0x7f146c104010 2024-09-19T06:10:52.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.243+0000 7f1469400640 1 --2- 172.21.15.3:0/2376489497 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f14500a32d0 0x7f14500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:52.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.243+0000 7f1462a00640 1 --2- 172.21.15.3:0/2376489497 >> [v2:172.21.15.59:6824/784134238,v1:172.21.15.59:6825/784134238] conn(0x7f14500acf80 0x7f14500af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:52.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.243+0000 7f1462a00640 1 -- 172.21.15.3:0/2376489497 --> [v2:172.21.15.59:6824/784134238,v1:172.21.15.59:6825/784134238] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f145c022e50 con 0x7f14500acf80 2024-09-19T06:10:52.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.243+0000 7f1462a00640 1 -- 172.21.15.3:0/2376489497 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f145c0d0900 con 0x7f146c104010 2024-09-19T06:10:52.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.244+0000 7f146a800640 1 --2- 172.21.15.3:0/2376489497 >> [v2:172.21.15.59:6824/784134238,v1:172.21.15.59:6825/784134238] conn(0x7f14500acf80 0x7f14500af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:52.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.244+0000 7f1469400640 1 --2- 172.21.15.3:0/2376489497 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f14500a32d0 0x7f14500a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1458009230 tx=0x7f14580058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:52.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.244+0000 7f146a800640 1 --2- 172.21.15.3:0/2376489497 >> [v2:172.21.15.59:6824/784134238,v1:172.21.15.59:6825/784134238] conn(0x7f14500acf80 0x7f14500af420 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:52.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.245+0000 7f1462a00640 1 -- 172.21.15.3:0/2376489497 <== osd.10 v2:172.21.15.59:6824/784134238 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f145c022e50 con 0x7f14500acf80 2024-09-19T06:10:52.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.262+0000 7f1470a00640 1 -- 172.21.15.3:0/2376489497 --> [v2:172.21.15.59:6824/784134238,v1:172.21.15.59:6825/784134238] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f146c062d80 con 0x7f14500acf80 2024-09-19T06:10:52.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.262+0000 7f1462a00640 1 -- 172.21.15.3:0/2376489497 <== osd.10 v2:172.21.15.59:6824/784134238 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f146c062d80 con 0x7f14500acf80 2024-09-19T06:10:52.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.263+0000 7f1470a00640 1 -- 172.21.15.3:0/2376489497 >> [v2:172.21.15.59:6824/784134238,v1:172.21.15.59:6825/784134238] conn(0x7f14500acf80 msgr2=0x7f14500af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:52.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.263+0000 7f1470a00640 1 --2- 172.21.15.3:0/2376489497 >> [v2:172.21.15.59:6824/784134238,v1:172.21.15.59:6825/784134238] conn(0x7f14500acf80 0x7f14500af420 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:52.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.263+0000 7f1470a00640 1 -- 172.21.15.3:0/2376489497 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f14500a32d0 msgr2=0x7f14500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:52.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.263+0000 7f1470a00640 1 --2- 172.21.15.3:0/2376489497 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f14500a32d0 0x7f14500a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1458009230 tx=0x7f14580058d0 comp rx=0 tx=0).stop 2024-09-19T06:10:52.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.263+0000 7f1470a00640 1 -- 172.21.15.3:0/2376489497 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f146c104010 msgr2=0x7f146c19a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:52.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.263+0000 7f1470a00640 1 --2- 172.21.15.3:0/2376489497 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f146c104010 0x7f146c19a660 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f145c00e9f0 tx=0x7f145c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:10:52.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.263+0000 7f146a800640 1 -- 172.21.15.3:0/2376489497 reap_dead start 2024-09-19T06:10:52.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.263+0000 7f1470a00640 1 -- 172.21.15.3:0/2376489497 shutdown_connections 2024-09-19T06:10:52.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.263+0000 7f1470a00640 1 -- 172.21.15.3:0/2376489497 >> 172.21.15.3:0/2376489497 conn(0x7f146c0ffa50 msgr2=0x7f146c100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:52.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.263+0000 7f1470a00640 1 -- 172.21.15.3:0/2376489497 shutdown_connections 2024-09-19T06:10:52.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:52.263+0000 7f1470a00640 1 -- 172.21.15.3:0/2376489497 wait complete. 2024-09-19T06:10:53.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.027+0000 7fdf36c00640 1 -- 172.21.15.3:0/3655931902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf30103ff0 msgr2=0x7fdf301043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:53.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.027+0000 7fdf36c00640 1 --2- 172.21.15.3:0/3655931902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf30103ff0 0x7fdf301043d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdf20009900 tx=0x7fdf2002a3f0 comp rx=0 tx=0).stop 2024-09-19T06:10:53.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.027+0000 7fdf36c00640 1 -- 172.21.15.3:0/3655931902 shutdown_connections 2024-09-19T06:10:53.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.027+0000 7fdf36c00640 1 --2- 172.21.15.3:0/3655931902 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf30109120 0x7fdf30110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:53.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.027+0000 7fdf36c00640 1 --2- 172.21.15.3:0/3655931902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf301049a0 0x7fdf301089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:53.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.027+0000 7fdf36c00640 1 --2- 172.21.15.3:0/3655931902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf30103ff0 0x7fdf301043d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:53.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.027+0000 7fdf36c00640 1 -- 172.21.15.3:0/3655931902 >> 172.21.15.3:0/3655931902 conn(0x7fdf300ffa90 msgr2=0x7fdf30101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:53.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.027+0000 7fdf36c00640 1 -- 172.21.15.3:0/3655931902 shutdown_connections 2024-09-19T06:10:53.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.027+0000 7fdf36c00640 1 -- 172.21.15.3:0/3655931902 wait complete. 2024-09-19T06:10:53.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.028+0000 7fdf36c00640 1 Processor -- start 2024-09-19T06:10:53.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.028+0000 7fdf36c00640 1 -- start start 2024-09-19T06:10:53.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.029+0000 7fdf36c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf30103ff0 0x7fdf3019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:53.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.029+0000 7fdf36c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf301049a0 0x7fdf3019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:53.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.029+0000 7fdf36c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf30109120 0x7fdf3019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:53.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.029+0000 7fdf36c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdf30114120 con 0x7fdf30109120 2024-09-19T06:10:53.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.029+0000 7fdf36c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdf30113fa0 con 0x7fdf301049a0 2024-09-19T06:10:53.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.029+0000 7fdf36c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdf301142a0 con 0x7fdf30103ff0 2024-09-19T06:10:53.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.029+0000 7fdf34c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf30109120 0x7fdf3019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:53.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.029+0000 7fdf34c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf30109120 0x7fdf3019eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51364/0 (socket says 172.21.15.3:51364) 2024-09-19T06:10:53.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.029+0000 7fdf34c00640 1 -- 172.21.15.3:0/4007605454 learned_addr learned my addr 172.21.15.3:0/4007605454 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:53.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.029+0000 7fdf2fe00640 1 --2- 172.21.15.3:0/4007605454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf30103ff0 0x7fdf3019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:53.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.029+0000 7fdf2f400640 1 --2- 172.21.15.3:0/4007605454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf301049a0 0x7fdf3019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:53.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.030+0000 7fdf34c00640 1 -- 172.21.15.3:0/4007605454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf30103ff0 msgr2=0x7fdf3019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:53.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.030+0000 7fdf34c00640 1 --2- 172.21.15.3:0/4007605454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf30103ff0 0x7fdf3019a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:53.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.030+0000 7fdf34c00640 1 -- 172.21.15.3:0/4007605454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf301049a0 msgr2=0x7fdf3019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:53.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.030+0000 7fdf34c00640 1 --2- 172.21.15.3:0/4007605454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf301049a0 0x7fdf3019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:53.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.030+0000 7fdf34c00640 1 -- 172.21.15.3:0/4007605454 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf3019f5d0 con 0x7fdf30109120 2024-09-19T06:10:53.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.030+0000 7fdf2fe00640 1 --2- 172.21.15.3:0/4007605454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf30103ff0 0x7fdf3019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:53.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.030+0000 7fdf34c00640 1 --2- 172.21.15.3:0/4007605454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf30109120 0x7fdf3019eef0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800eb10 tx=0x7fdf2800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:53.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.030+0000 7fdf2cc00640 1 -- 172.21.15.3:0/4007605454 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf28004b20 con 0x7fdf30109120 2024-09-19T06:10:53.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.030+0000 7fdf36c00640 1 -- 172.21.15.3:0/4007605454 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf3019f8c0 con 0x7fdf30109120 2024-09-19T06:10:53.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.030+0000 7fdf2cc00640 1 -- 172.21.15.3:0/4007605454 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf28004cc0 con 0x7fdf30109120 2024-09-19T06:10:53.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.030+0000 7fdf2cc00640 1 -- 172.21.15.3:0/4007605454 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf28010760 con 0x7fdf30109120 2024-09-19T06:10:53.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.030+0000 7fdf36c00640 1 -- 172.21.15.3:0/4007605454 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf301a71a0 con 0x7fdf30109120 2024-09-19T06:10:53.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.031+0000 7fdf36c00640 1 -- 172.21.15.3:0/4007605454 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdf30062980 con 0x7fdf30109120 2024-09-19T06:10:53.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.033+0000 7fdf2cc00640 1 -- 172.21.15.3:0/4007605454 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fdf28005020 con 0x7fdf30109120 2024-09-19T06:10:53.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.034+0000 7fdf2cc00640 1 --2- 172.21.15.3:0/4007605454 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fdf140a32d0 0x7fdf140a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:53.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.035+0000 7fdf2cc00640 1 -- 172.21.15.3:0/4007605454 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fdf280d0440 con 0x7fdf30109120 2024-09-19T06:10:53.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.035+0000 7fdf2fe00640 1 --2- 172.21.15.3:0/4007605454 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fdf140a32d0 0x7fdf140a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:53.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.035+0000 7fdf2cc00640 1 --2- 172.21.15.3:0/4007605454 >> [v2:172.21.15.3:6810/3577306700,v1:172.21.15.3:6811/3577306700] conn(0x7fdf140acf80 0x7fdf140af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:53.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.035+0000 7fdf2cc00640 1 -- 172.21.15.3:0/4007605454 --> [v2:172.21.15.3:6810/3577306700,v1:172.21.15.3:6811/3577306700] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf140afaf0 con 0x7fdf140acf80 2024-09-19T06:10:53.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.035+0000 7fdf2cc00640 1 -- 172.21.15.3:0/4007605454 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7fdf280d07f0 con 0x7fdf30109120 2024-09-19T06:10:53.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.035+0000 7fdf2f400640 1 --2- 172.21.15.3:0/4007605454 >> [v2:172.21.15.3:6810/3577306700,v1:172.21.15.3:6811/3577306700] conn(0x7fdf140acf80 0x7fdf140af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:53.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.036+0000 7fdf2fe00640 1 --2- 172.21.15.3:0/4007605454 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fdf140a32d0 0x7fdf140a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdf20009230 tx=0x7fdf200058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:53.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.036+0000 7fdf2f400640 1 --2- 172.21.15.3:0/4007605454 >> [v2:172.21.15.3:6810/3577306700,v1:172.21.15.3:6811/3577306700] conn(0x7fdf140acf80 0x7fdf140af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:53.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.037+0000 7fdf2cc00640 1 -- 172.21.15.3:0/4007605454 <== osd.3 v2:172.21.15.3:6810/3577306700 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdf140afaf0 con 0x7fdf140acf80 2024-09-19T06:10:53.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.052+0000 7fdf36c00640 1 -- 172.21.15.3:0/4007605454 --> [v2:172.21.15.3:6810/3577306700,v1:172.21.15.3:6811/3577306700] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdf30062e00 con 0x7fdf140acf80 2024-09-19T06:10:53.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.052+0000 7fdf2cc00640 1 -- 172.21.15.3:0/4007605454 <== osd.3 v2:172.21.15.3:6810/3577306700 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdf30062e00 con 0x7fdf140acf80 2024-09-19T06:10:53.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.052+0000 7fdf36c00640 1 -- 172.21.15.3:0/4007605454 >> [v2:172.21.15.3:6810/3577306700,v1:172.21.15.3:6811/3577306700] conn(0x7fdf140acf80 msgr2=0x7fdf140af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:53.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.052+0000 7fdf36c00640 1 --2- 172.21.15.3:0/4007605454 >> [v2:172.21.15.3:6810/3577306700,v1:172.21.15.3:6811/3577306700] conn(0x7fdf140acf80 0x7fdf140af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:53.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.052+0000 7fdf36c00640 1 -- 172.21.15.3:0/4007605454 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fdf140a32d0 msgr2=0x7fdf140a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:53.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.052+0000 7fdf36c00640 1 --2- 172.21.15.3:0/4007605454 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fdf140a32d0 0x7fdf140a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdf20009230 tx=0x7fdf200058d0 comp rx=0 tx=0).stop 2024-09-19T06:10:53.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.053+0000 7fdf36c00640 1 -- 172.21.15.3:0/4007605454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf30109120 msgr2=0x7fdf3019eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:53.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.053+0000 7fdf36c00640 1 --2- 172.21.15.3:0/4007605454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf30109120 0x7fdf3019eef0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800eb10 tx=0x7fdf2800c2d0 comp rx=0 tx=0).stop 2024-09-19T06:10:53.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.053+0000 7fdf34c00640 1 -- 172.21.15.3:0/4007605454 reap_dead start 2024-09-19T06:10:53.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.053+0000 7fdf36c00640 1 -- 172.21.15.3:0/4007605454 shutdown_connections 2024-09-19T06:10:53.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.053+0000 7fdf36c00640 1 -- 172.21.15.3:0/4007605454 >> 172.21.15.3:0/4007605454 conn(0x7fdf300ffa90 msgr2=0x7fdf30100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:53.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.053+0000 7fdf36c00640 1 -- 172.21.15.3:0/4007605454 shutdown_connections 2024-09-19T06:10:53.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.053+0000 7fdf36c00640 1 -- 172.21.15.3:0/4007605454 wait complete. 2024-09-19T06:10:54.205 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:53 smithi003 ceph-mon[30893]: pgmap v329: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-19T06:10:54.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:53 smithi059 ceph-mon[35138]: pgmap v329: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-19T06:10:54.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:53 smithi071 ceph-mon[35662]: pgmap v329: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-19T06:10:54.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.421+0000 7fd283800640 1 -- 172.21.15.3:0/2213736024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd27c077040 msgr2=0x7fd27c1124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:54.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.421+0000 7fd283800640 1 --2- 172.21.15.3:0/2213736024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd27c077040 0x7fd27c1124f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd264009900 tx=0x7fd26402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:10:54.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.422+0000 7fd283800640 1 -- 172.21.15.3:0/2213736024 shutdown_connections 2024-09-19T06:10:54.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.422+0000 7fd283800640 1 --2- 172.21.15.3:0/2213736024 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd27c112a30 0x7fd27c114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:54.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.422+0000 7fd283800640 1 --2- 172.21.15.3:0/2213736024 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd27c077040 0x7fd27c1124f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:54.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.422+0000 7fd283800640 1 --2- 172.21.15.3:0/2213736024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd27c076720 0x7fd27c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:54.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.422+0000 7fd283800640 1 -- 172.21.15.3:0/2213736024 >> 172.21.15.3:0/2213736024 conn(0x7fd27c0ffa90 msgr2=0x7fd27c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:54.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.422+0000 7fd283800640 1 -- 172.21.15.3:0/2213736024 shutdown_connections 2024-09-19T06:10:54.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.422+0000 7fd283800640 1 -- 172.21.15.3:0/2213736024 wait complete. 2024-09-19T06:10:54.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.423+0000 7fd283800640 1 Processor -- start 2024-09-19T06:10:54.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.423+0000 7fd283800640 1 -- start start 2024-09-19T06:10:54.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.423+0000 7fd283800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd27c076720 0x7fd27c1a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:54.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.423+0000 7fd283800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd27c077040 0x7fd27c1a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:54.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.423+0000 7fd283800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd27c112a30 0x7fd27c19e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:54.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.423+0000 7fd283800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd27c118600 con 0x7fd27c076720 2024-09-19T06:10:54.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.423+0000 7fd283800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd27c118480 con 0x7fd27c112a30 2024-09-19T06:10:54.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.423+0000 7fd283800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd27c118780 con 0x7fd27c077040 2024-09-19T06:10:54.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.424+0000 7fd280e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd27c076720 0x7fd27c1a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:54.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.424+0000 7fd281800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd27c112a30 0x7fd27c19e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:54.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.424+0000 7fd273e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd27c077040 0x7fd27c1a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:54.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.424+0000 7fd280e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd27c076720 0x7fd27c1a4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40484/0 (socket says 172.21.15.3:40484) 2024-09-19T06:10:54.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.424+0000 7fd281800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd27c112a30 0x7fd27c19e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44296/0 (socket says 172.21.15.3:44296) 2024-09-19T06:10:54.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.424+0000 7fd280e00640 1 -- 172.21.15.3:0/194985722 learned_addr learned my addr 172.21.15.3:0/194985722 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:54.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.424+0000 7fd281800640 1 -- 172.21.15.3:0/194985722 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd27c077040 msgr2=0x7fd27c1a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:54.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.424+0000 7fd281800640 1 --2- 172.21.15.3:0/194985722 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd27c077040 0x7fd27c1a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:54.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.424+0000 7fd281800640 1 -- 172.21.15.3:0/194985722 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd27c076720 msgr2=0x7fd27c1a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:54.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.424+0000 7fd281800640 1 --2- 172.21.15.3:0/194985722 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd27c076720 0x7fd27c1a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:54.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.424+0000 7fd281800640 1 -- 172.21.15.3:0/194985722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd27c19eff0 con 0x7fd27c112a30 2024-09-19T06:10:54.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.424+0000 7fd281800640 1 --2- 172.21.15.3:0/194985722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd27c112a30 0x7fd27c19e8c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd27c07aa10 tx=0x7fd27400edd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:54.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.425+0000 7fd27a000640 1 -- 172.21.15.3:0/194985722 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd274004d20 con 0x7fd27c112a30 2024-09-19T06:10:54.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.425+0000 7fd283800640 1 -- 172.21.15.3:0/194985722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd27c19f2e0 con 0x7fd27c112a30 2024-09-19T06:10:54.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.425+0000 7fd27a000640 1 -- 172.21.15.3:0/194985722 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd274005020 con 0x7fd27c112a30 2024-09-19T06:10:54.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.425+0000 7fd27a000640 1 -- 172.21.15.3:0/194985722 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2740116d0 con 0x7fd27c112a30 2024-09-19T06:10:54.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.425+0000 7fd283800640 1 -- 172.21.15.3:0/194985722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd27c1ab5d0 con 0x7fd27c112a30 2024-09-19T06:10:54.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.426+0000 7fd283800640 1 -- 172.21.15.3:0/194985722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd27c062980 con 0x7fd27c112a30 2024-09-19T06:10:54.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.428+0000 7fd27a000640 1 -- 172.21.15.3:0/194985722 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fd274005540 con 0x7fd27c112a30 2024-09-19T06:10:54.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.429+0000 7fd27a000640 1 --2- 172.21.15.3:0/194985722 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd2600a3350 0x7fd2600a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:54.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.429+0000 7fd27a000640 1 -- 172.21.15.3:0/194985722 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fd2740cfe70 con 0x7fd27c112a30 2024-09-19T06:10:54.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.429+0000 7fd280e00640 1 --2- 172.21.15.3:0/194985722 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd2600a3350 0x7fd2600a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:54.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.429+0000 7fd27a000640 1 --2- 172.21.15.3:0/194985722 >> [v2:172.21.15.3:6802/2061486638,v1:172.21.15.3:6803/2061486638] conn(0x7fd2600ad000 0x7fd2600af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:54.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.429+0000 7fd27a000640 1 -- 172.21.15.3:0/194985722 --> [v2:172.21.15.3:6802/2061486638,v1:172.21.15.3:6803/2061486638] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd274014ec0 con 0x7fd2600ad000 2024-09-19T06:10:54.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.429+0000 7fd27a000640 1 -- 172.21.15.3:0/194985722 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7fd2740d0220 con 0x7fd27c112a30 2024-09-19T06:10:54.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.430+0000 7fd273e00640 1 --2- 172.21.15.3:0/194985722 >> [v2:172.21.15.3:6802/2061486638,v1:172.21.15.3:6803/2061486638] conn(0x7fd2600ad000 0x7fd2600af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:54.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.430+0000 7fd280e00640 1 --2- 172.21.15.3:0/194985722 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd2600a3350 0x7fd2600a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd27c19fa00 tx=0x7fd26c00b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:54.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.430+0000 7fd273e00640 1 --2- 172.21.15.3:0/194985722 >> [v2:172.21.15.3:6802/2061486638,v1:172.21.15.3:6803/2061486638] conn(0x7fd2600ad000 0x7fd2600af4a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:54.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.431+0000 7fd27a000640 1 -- 172.21.15.3:0/194985722 <== osd.0 v2:172.21.15.3:6802/2061486638 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd274014ec0 con 0x7fd2600ad000 2024-09-19T06:10:54.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.445+0000 7fd283800640 1 -- 172.21.15.3:0/194985722 --> [v2:172.21.15.3:6802/2061486638,v1:172.21.15.3:6803/2061486638] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd27c062e00 con 0x7fd2600ad000 2024-09-19T06:10:54.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.446+0000 7fd27a000640 1 -- 172.21.15.3:0/194985722 <== osd.0 v2:172.21.15.3:6802/2061486638 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd27c062e00 con 0x7fd2600ad000 2024-09-19T06:10:54.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.446+0000 7fd283800640 1 -- 172.21.15.3:0/194985722 >> [v2:172.21.15.3:6802/2061486638,v1:172.21.15.3:6803/2061486638] conn(0x7fd2600ad000 msgr2=0x7fd2600af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:54.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.446+0000 7fd283800640 1 --2- 172.21.15.3:0/194985722 >> [v2:172.21.15.3:6802/2061486638,v1:172.21.15.3:6803/2061486638] conn(0x7fd2600ad000 0x7fd2600af4a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:54.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.446+0000 7fd283800640 1 -- 172.21.15.3:0/194985722 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd2600a3350 msgr2=0x7fd2600a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:54.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.446+0000 7fd283800640 1 --2- 172.21.15.3:0/194985722 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd2600a3350 0x7fd2600a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd27c19fa00 tx=0x7fd26c00b4a0 comp rx=0 tx=0).stop 2024-09-19T06:10:54.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.446+0000 7fd283800640 1 -- 172.21.15.3:0/194985722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd27c112a30 msgr2=0x7fd27c19e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:54.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.446+0000 7fd283800640 1 --2- 172.21.15.3:0/194985722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd27c112a30 0x7fd27c19e8c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd27c07aa10 tx=0x7fd27400edd0 comp rx=0 tx=0).stop 2024-09-19T06:10:54.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.446+0000 7fd281800640 1 -- 172.21.15.3:0/194985722 reap_dead start 2024-09-19T06:10:54.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.446+0000 7fd283800640 1 -- 172.21.15.3:0/194985722 shutdown_connections 2024-09-19T06:10:54.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.446+0000 7fd283800640 1 -- 172.21.15.3:0/194985722 >> 172.21.15.3:0/194985722 conn(0x7fd27c0ffa90 msgr2=0x7fd27c101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:54.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.447+0000 7fd283800640 1 -- 172.21.15.3:0/194985722 shutdown_connections 2024-09-19T06:10:54.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:54.447+0000 7fd283800640 1 -- 172.21.15.3:0/194985722 wait complete. 2024-09-19T06:10:55.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.170+0000 7fe393000640 1 -- 172.21.15.3:0/2891667321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe38c1049a0 msgr2=0x7fe38c1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:55.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.170+0000 7fe393000640 1 --2- 172.21.15.3:0/2891667321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe38c1049a0 0x7fe38c1089f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe378009900 tx=0x7fe37802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:10:55.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.170+0000 7fe393000640 1 -- 172.21.15.3:0/2891667321 shutdown_connections 2024-09-19T06:10:55.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.170+0000 7fe393000640 1 --2- 172.21.15.3:0/2891667321 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe38c109120 0x7fe38c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:55.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.170+0000 7fe393000640 1 --2- 172.21.15.3:0/2891667321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe38c1049a0 0x7fe38c1089f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:55.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.170+0000 7fe393000640 1 --2- 172.21.15.3:0/2891667321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe38c103ff0 0x7fe38c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:55.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.170+0000 7fe393000640 1 -- 172.21.15.3:0/2891667321 >> 172.21.15.3:0/2891667321 conn(0x7fe38c0ffa90 msgr2=0x7fe38c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:55.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.170+0000 7fe393000640 1 -- 172.21.15.3:0/2891667321 shutdown_connections 2024-09-19T06:10:55.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.170+0000 7fe393000640 1 -- 172.21.15.3:0/2891667321 wait complete. 2024-09-19T06:10:55.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.171+0000 7fe393000640 1 Processor -- start 2024-09-19T06:10:55.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.172+0000 7fe393000640 1 -- start start 2024-09-19T06:10:55.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.172+0000 7fe393000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe38c103ff0 0x7fe38c19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:55.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.172+0000 7fe393000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe38c1049a0 0x7fe38c19abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:55.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.172+0000 7fe393000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe38c109120 0x7fe38c19ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:55.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.172+0000 7fe393000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe38c114140 con 0x7fe38c1049a0 2024-09-19T06:10:55.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.172+0000 7fe393000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe38c113fc0 con 0x7fe38c109120 2024-09-19T06:10:55.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.172+0000 7fe393000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe38c1142c0 con 0x7fe38c103ff0 2024-09-19T06:10:55.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.172+0000 7fe38b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe38c1049a0 0x7fe38c19abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:55.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.172+0000 7fe38b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe38c1049a0 0x7fe38c19abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40502/0 (socket says 172.21.15.3:40502) 2024-09-19T06:10:55.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.172+0000 7fe38b400640 1 -- 172.21.15.3:0/1992037874 learned_addr learned my addr 172.21.15.3:0/1992037874 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:55.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.172+0000 7fe38be00640 1 --2- 172.21.15.3:0/1992037874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe38c103ff0 0x7fe38c19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:55.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.172+0000 7fe391000640 1 --2- 172.21.15.3:0/1992037874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe38c109120 0x7fe38c19ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:55.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.173+0000 7fe38be00640 1 -- 172.21.15.3:0/1992037874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe38c109120 msgr2=0x7fe38c19ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:55.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.173+0000 7fe38be00640 1 --2- 172.21.15.3:0/1992037874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe38c109120 0x7fe38c19ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:55.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.173+0000 7fe38be00640 1 -- 172.21.15.3:0/1992037874 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe38c1049a0 msgr2=0x7fe38c19abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:55.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.173+0000 7fe38be00640 1 --2- 172.21.15.3:0/1992037874 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe38c1049a0 0x7fe38c19abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:55.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.173+0000 7fe38be00640 1 -- 172.21.15.3:0/1992037874 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38c19f630 con 0x7fe38c103ff0 2024-09-19T06:10:55.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.173+0000 7fe38b400640 1 --2- 172.21.15.3:0/1992037874 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe38c1049a0 0x7fe38c19abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:55.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.173+0000 7fe38be00640 1 --2- 172.21.15.3:0/1992037874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe38c103ff0 0x7fe38c19a680 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe37c00e9f0 tx=0x7fe37c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:55.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.173+0000 7fe388c00640 1 -- 172.21.15.3:0/1992037874 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37c00ccc0 con 0x7fe38c103ff0 2024-09-19T06:10:55.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.173+0000 7fe393000640 1 -- 172.21.15.3:0/1992037874 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe38c19f920 con 0x7fe38c103ff0 2024-09-19T06:10:55.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.173+0000 7fe388c00640 1 -- 172.21.15.3:0/1992037874 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe37c005020 con 0x7fe38c103ff0 2024-09-19T06:10:55.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.174+0000 7fe388c00640 1 -- 172.21.15.3:0/1992037874 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37c004a00 con 0x7fe38c103ff0 2024-09-19T06:10:55.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.174+0000 7fe393000640 1 -- 172.21.15.3:0/1992037874 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe38c1a7200 con 0x7fe38c103ff0 2024-09-19T06:10:55.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.174+0000 7fe393000640 1 -- 172.21.15.3:0/1992037874 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe38c062980 con 0x7fe38c103ff0 2024-09-19T06:10:55.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.177+0000 7fe388c00640 1 -- 172.21.15.3:0/1992037874 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe37c0051d0 con 0x7fe38c103ff0 2024-09-19T06:10:55.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.178+0000 7fe388c00640 1 --2- 172.21.15.3:0/1992037874 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe3700a32d0 0x7fe3700a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:55.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.178+0000 7fe388c00640 1 -- 172.21.15.3:0/1992037874 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fe37c0cfce0 con 0x7fe38c103ff0 2024-09-19T06:10:55.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.178+0000 7fe38b400640 1 --2- 172.21.15.3:0/1992037874 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe3700a32d0 0x7fe3700a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:55.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.179+0000 7fe388c00640 1 --2- 172.21.15.3:0/1992037874 >> [v2:172.21.15.59:6808/4002980986,v1:172.21.15.59:6809/4002980986] conn(0x7fe3700acf80 0x7fe3700af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:55.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.179+0000 7fe388c00640 1 -- 172.21.15.3:0/1992037874 --> [v2:172.21.15.59:6808/4002980986,v1:172.21.15.59:6809/4002980986] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe3700afaf0 con 0x7fe3700acf80 2024-09-19T06:10:55.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.179+0000 7fe388c00640 1 -- 172.21.15.3:0/1992037874 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7fe37c0d0090 con 0x7fe38c103ff0 2024-09-19T06:10:55.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.179+0000 7fe391000640 1 --2- 172.21.15.3:0/1992037874 >> [v2:172.21.15.59:6808/4002980986,v1:172.21.15.59:6809/4002980986] conn(0x7fe3700acf80 0x7fe3700af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:55.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.179+0000 7fe38b400640 1 --2- 172.21.15.3:0/1992037874 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe3700a32d0 0x7fe3700a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe378031550 tx=0x7fe378005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:55.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.180+0000 7fe391000640 1 --2- 172.21.15.3:0/1992037874 >> [v2:172.21.15.59:6808/4002980986,v1:172.21.15.59:6809/4002980986] conn(0x7fe3700acf80 0x7fe3700af420 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:55.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.180+0000 7fe388c00640 1 -- 172.21.15.3:0/1992037874 <== osd.4 v2:172.21.15.59:6808/4002980986 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe3700afaf0 con 0x7fe3700acf80 2024-09-19T06:10:55.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.195+0000 7fe393000640 1 -- 172.21.15.3:0/1992037874 --> [v2:172.21.15.59:6808/4002980986,v1:172.21.15.59:6809/4002980986] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe38c062e00 con 0x7fe3700acf80 2024-09-19T06:10:55.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.195+0000 7fe388c00640 1 -- 172.21.15.3:0/1992037874 <== osd.4 v2:172.21.15.59:6808/4002980986 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe38c062e00 con 0x7fe3700acf80 2024-09-19T06:10:55.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.196+0000 7fe393000640 1 -- 172.21.15.3:0/1992037874 >> [v2:172.21.15.59:6808/4002980986,v1:172.21.15.59:6809/4002980986] conn(0x7fe3700acf80 msgr2=0x7fe3700af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:55.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.196+0000 7fe393000640 1 --2- 172.21.15.3:0/1992037874 >> [v2:172.21.15.59:6808/4002980986,v1:172.21.15.59:6809/4002980986] conn(0x7fe3700acf80 0x7fe3700af420 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:55.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.196+0000 7fe393000640 1 -- 172.21.15.3:0/1992037874 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe3700a32d0 msgr2=0x7fe3700a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:55.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.196+0000 7fe393000640 1 --2- 172.21.15.3:0/1992037874 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe3700a32d0 0x7fe3700a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe378031550 tx=0x7fe378005a20 comp rx=0 tx=0).stop 2024-09-19T06:10:55.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.196+0000 7fe393000640 1 -- 172.21.15.3:0/1992037874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe38c103ff0 msgr2=0x7fe38c19a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:55.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.196+0000 7fe393000640 1 --2- 172.21.15.3:0/1992037874 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe38c103ff0 0x7fe38c19a680 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe37c00e9f0 tx=0x7fe37c00edf0 comp rx=0 tx=0).stop 2024-09-19T06:10:55.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.196+0000 7fe391000640 1 -- 172.21.15.3:0/1992037874 reap_dead start 2024-09-19T06:10:55.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.196+0000 7fe393000640 1 -- 172.21.15.3:0/1992037874 shutdown_connections 2024-09-19T06:10:55.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.196+0000 7fe393000640 1 -- 172.21.15.3:0/1992037874 >> 172.21.15.3:0/1992037874 conn(0x7fe38c0ffa90 msgr2=0x7fe38c100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:55.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.196+0000 7fe393000640 1 -- 172.21.15.3:0/1992037874 shutdown_connections 2024-09-19T06:10:55.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:55.196+0000 7fe393000640 1 -- 172.21.15.3:0/1992037874 wait complete. 2024-09-19T06:10:56.115 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:55 smithi003 ceph-mon[30893]: pgmap v330: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-09-19T06:10:56.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.088+0000 7fad0fa00640 1 -- 172.21.15.3:0/1657397794 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad08104010 msgr2=0x7fad081043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:56.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.088+0000 7fad0fa00640 1 --2- 172.21.15.3:0/1657397794 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad08104010 0x7fad081043f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7facfc009900 tx=0x7facfc02a410 comp rx=0 tx=0).stop 2024-09-19T06:10:56.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.088+0000 7fad0fa00640 1 -- 172.21.15.3:0/1657397794 shutdown_connections 2024-09-19T06:10:56.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.088+0000 7fad0fa00640 1 --2- 172.21.15.3:0/1657397794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad08109140 0x7fad08110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:56.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.088+0000 7fad0fa00640 1 --2- 172.21.15.3:0/1657397794 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad081049c0 0x7fad08108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:56.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.088+0000 7fad0fa00640 1 --2- 172.21.15.3:0/1657397794 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad08104010 0x7fad081043f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:56.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.088+0000 7fad0fa00640 1 -- 172.21.15.3:0/1657397794 >> 172.21.15.3:0/1657397794 conn(0x7fad080ffa50 msgr2=0x7fad08101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:56.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.088+0000 7fad0fa00640 1 -- 172.21.15.3:0/1657397794 shutdown_connections 2024-09-19T06:10:56.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.088+0000 7fad0fa00640 1 -- 172.21.15.3:0/1657397794 wait complete. 2024-09-19T06:10:56.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.089+0000 7fad0fa00640 1 Processor -- start 2024-09-19T06:10:56.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.089+0000 7fad0fa00640 1 -- start start 2024-09-19T06:10:56.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.090+0000 7fad0fa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad08104010 0x7fad0819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:56.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.090+0000 7fad0fa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad081049c0 0x7fad0819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:56.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.090+0000 7fad0fa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad08109140 0x7fad0819ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:56.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.090+0000 7fad0fa00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fad081141b0 con 0x7fad08104010 2024-09-19T06:10:56.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.090+0000 7fad0fa00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fad08114030 con 0x7fad08109140 2024-09-19T06:10:56.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.090+0000 7fad0fa00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fad08114330 con 0x7fad081049c0 2024-09-19T06:10:56.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.090+0000 7fad0d000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad08104010 0x7fad0819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:56.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.090+0000 7fad0d000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad08104010 0x7fad0819a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40514/0 (socket says 172.21.15.3:40514) 2024-09-19T06:10:56.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.090+0000 7fad0d000640 1 -- 172.21.15.3:0/304865207 learned_addr learned my addr 172.21.15.3:0/304865207 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:56.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.090+0000 7fad07e00640 1 --2- 172.21.15.3:0/304865207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad081049c0 0x7fad0819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:56.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.090+0000 7fad0da00640 1 --2- 172.21.15.3:0/304865207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad08109140 0x7fad0819ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:56.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.091+0000 7fad0d000640 1 -- 172.21.15.3:0/304865207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad081049c0 msgr2=0x7fad0819ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:56.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.091+0000 7fad0d000640 1 --2- 172.21.15.3:0/304865207 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fad081049c0 0x7fad0819ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:56.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.091+0000 7fad0d000640 1 -- 172.21.15.3:0/304865207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad08109140 msgr2=0x7fad0819ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:56.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.091+0000 7fad0d000640 1 --2- 172.21.15.3:0/304865207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad08109140 0x7fad0819ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:56.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.091+0000 7fad0d000640 1 -- 172.21.15.3:0/304865207 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0819f5e0 con 0x7fad08104010 2024-09-19T06:10:56.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.091+0000 7fad0da00640 1 --2- 172.21.15.3:0/304865207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad08109140 0x7fad0819ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:10:56.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.091+0000 7fad0d000640 1 --2- 172.21.15.3:0/304865207 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad08104010 0x7fad0819a630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7facfc004770 tx=0x7facfc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:56.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.091+0000 7fad05600640 1 -- 172.21.15.3:0/304865207 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc03f070 con 0x7fad08104010 2024-09-19T06:10:56.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.091+0000 7fad0fa00640 1 -- 172.21.15.3:0/304865207 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad0819f870 con 0x7fad08104010 2024-09-19T06:10:56.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.091+0000 7fad05600640 1 -- 172.21.15.3:0/304865207 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facfc031ca0 con 0x7fad08104010 2024-09-19T06:10:56.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.091+0000 7fad05600640 1 -- 172.21.15.3:0/304865207 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc035030 con 0x7fad08104010 2024-09-19T06:10:56.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.091+0000 7fad0fa00640 1 -- 172.21.15.3:0/304865207 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad081a71b0 con 0x7fad08104010 2024-09-19T06:10:56.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.092+0000 7fad0fa00640 1 -- 172.21.15.3:0/304865207 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fad08062980 con 0x7fad08104010 2024-09-19T06:10:56.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.095+0000 7fad05600640 1 -- 172.21.15.3:0/304865207 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7facfc042070 con 0x7fad08104010 2024-09-19T06:10:56.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.096+0000 7fad05600640 1 --2- 172.21.15.3:0/304865207 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7facf00a32d0 0x7facf00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:56.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.096+0000 7fad05600640 1 -- 172.21.15.3:0/304865207 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7facfc0f0770 con 0x7fad08104010 2024-09-19T06:10:56.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.096+0000 7fad07e00640 1 --2- 172.21.15.3:0/304865207 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7facf00a32d0 0x7facf00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:56.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.096+0000 7fad05600640 1 --2- 172.21.15.3:0/304865207 >> [v2:172.21.15.71:6816/905333117,v1:172.21.15.71:6817/905333117] conn(0x7facf00acf80 0x7facf00af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:56.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.097+0000 7fad05600640 1 -- 172.21.15.3:0/304865207 --> [v2:172.21.15.71:6816/905333117,v1:172.21.15.71:6817/905333117] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7facfc038e90 con 0x7facf00acf80 2024-09-19T06:10:56.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.097+0000 7fad05600640 1 -- 172.21.15.3:0/304865207 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7facfc0f0b20 con 0x7fad08104010 2024-09-19T06:10:56.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.097+0000 7fad0da00640 1 --2- 172.21.15.3:0/304865207 >> [v2:172.21.15.71:6816/905333117,v1:172.21.15.71:6817/905333117] conn(0x7facf00acf80 0x7facf00af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:56.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.097+0000 7fad07e00640 1 --2- 172.21.15.3:0/304865207 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7facf00a32d0 0x7facf00a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fad080ffe70 tx=0x7facf4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:56.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.098+0000 7fad0da00640 1 --2- 172.21.15.3:0/304865207 >> [v2:172.21.15.71:6816/905333117,v1:172.21.15.71:6817/905333117] conn(0x7facf00acf80 0x7facf00af420 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:56.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.098+0000 7fad05600640 1 -- 172.21.15.3:0/304865207 <== osd.8 v2:172.21.15.71:6816/905333117 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7facfc038e90 con 0x7facf00acf80 2024-09-19T06:10:56.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.113+0000 7fad0fa00640 1 -- 172.21.15.3:0/304865207 --> [v2:172.21.15.71:6816/905333117,v1:172.21.15.71:6817/905333117] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fad08062d80 con 0x7facf00acf80 2024-09-19T06:10:56.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.113+0000 7fad05600640 1 -- 172.21.15.3:0/304865207 <== osd.8 v2:172.21.15.71:6816/905333117 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fad08062d80 con 0x7facf00acf80 2024-09-19T06:10:56.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.114+0000 7fad0fa00640 1 -- 172.21.15.3:0/304865207 >> [v2:172.21.15.71:6816/905333117,v1:172.21.15.71:6817/905333117] conn(0x7facf00acf80 msgr2=0x7facf00af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:56.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.114+0000 7fad0fa00640 1 --2- 172.21.15.3:0/304865207 >> [v2:172.21.15.71:6816/905333117,v1:172.21.15.71:6817/905333117] conn(0x7facf00acf80 0x7facf00af420 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:56.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.114+0000 7fad0fa00640 1 -- 172.21.15.3:0/304865207 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7facf00a32d0 msgr2=0x7facf00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:56.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.114+0000 7fad0fa00640 1 --2- 172.21.15.3:0/304865207 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7facf00a32d0 0x7facf00a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fad080ffe70 tx=0x7facf4005f90 comp rx=0 tx=0).stop 2024-09-19T06:10:56.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.114+0000 7fad0fa00640 1 -- 172.21.15.3:0/304865207 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad08104010 msgr2=0x7fad0819a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:56.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.114+0000 7fad0fa00640 1 --2- 172.21.15.3:0/304865207 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fad08104010 0x7fad0819a630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7facfc004770 tx=0x7facfc003c10 comp rx=0 tx=0).stop 2024-09-19T06:10:56.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.114+0000 7fad0da00640 1 -- 172.21.15.3:0/304865207 reap_dead start 2024-09-19T06:10:56.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.114+0000 7fad0fa00640 1 -- 172.21.15.3:0/304865207 shutdown_connections 2024-09-19T06:10:56.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.114+0000 7fad0fa00640 1 -- 172.21.15.3:0/304865207 >> 172.21.15.3:0/304865207 conn(0x7fad080ffa50 msgr2=0x7fad08100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:56.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.114+0000 7fad0fa00640 1 -- 172.21.15.3:0/304865207 shutdown_connections 2024-09-19T06:10:56.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.114+0000 7fad0fa00640 1 -- 172.21.15.3:0/304865207 wait complete. 2024-09-19T06:10:56.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:55 smithi059 ceph-mon[35138]: pgmap v330: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-09-19T06:10:56.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:55 smithi071 ceph-mon[35662]: pgmap v330: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2024-09-19T06:10:56.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.204+0000 7f5dc3a00640 1 -- 172.21.15.3:0/3639518230 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5dbc1049a0 msgr2=0x7f5dbc1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:56.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.204+0000 7f5dc3a00640 1 --2- 172.21.15.3:0/3639518230 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5dbc1049a0 0x7f5dbc1089f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5da4009900 tx=0x7f5da402a410 comp rx=0 tx=0).stop 2024-09-19T06:10:56.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.204+0000 7f5dc3a00640 1 -- 172.21.15.3:0/3639518230 shutdown_connections 2024-09-19T06:10:56.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.204+0000 7f5dc3a00640 1 --2- 172.21.15.3:0/3639518230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dbc109120 0x7f5dbc110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:56.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.204+0000 7f5dc3a00640 1 --2- 172.21.15.3:0/3639518230 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5dbc1049a0 0x7f5dbc1089f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:56.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.204+0000 7f5dc3a00640 1 --2- 172.21.15.3:0/3639518230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5dbc103ff0 0x7f5dbc1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:56.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.204+0000 7f5dc3a00640 1 -- 172.21.15.3:0/3639518230 >> 172.21.15.3:0/3639518230 conn(0x7f5dbc0ffa90 msgr2=0x7f5dbc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:56.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.205+0000 7f5dc3a00640 1 -- 172.21.15.3:0/3639518230 shutdown_connections 2024-09-19T06:10:56.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.205+0000 7f5dc3a00640 1 -- 172.21.15.3:0/3639518230 wait complete. 2024-09-19T06:10:56.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.206+0000 7f5dc3a00640 1 Processor -- start 2024-09-19T06:10:56.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.206+0000 7f5dc3a00640 1 -- start start 2024-09-19T06:10:56.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.206+0000 7f5dc3a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dbc103ff0 0x7f5dbc19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:56.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.206+0000 7f5dc3a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5dbc1049a0 0x7f5dbc19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:56.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.207+0000 7f5dc3a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5dbc109120 0x7f5dbc19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:56.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.207+0000 7f5dc3a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5dbc114120 con 0x7f5dbc109120 2024-09-19T06:10:56.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.207+0000 7f5dc3a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5dbc113fa0 con 0x7f5dbc103ff0 2024-09-19T06:10:56.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.207+0000 7f5dc3a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5dbc1142a0 con 0x7f5dbc1049a0 2024-09-19T06:10:56.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.207+0000 7f5dc1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dbc103ff0 0x7f5dbc19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:56.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.207+0000 7f5dc1a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5dbc109120 0x7f5dbc19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:56.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.207+0000 7f5dc1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dbc103ff0 0x7f5dbc19a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44340/0 (socket says 172.21.15.3:44340) 2024-09-19T06:10:56.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.207+0000 7f5dc1000640 1 -- 172.21.15.3:0/1030292245 learned_addr learned my addr 172.21.15.3:0/1030292245 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:56.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.207+0000 7f5db3e00640 1 --2- 172.21.15.3:0/1030292245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5dbc1049a0 0x7f5dbc19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:56.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.207+0000 7f5dc1000640 1 -- 172.21.15.3:0/1030292245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5dbc1049a0 msgr2=0x7f5dbc19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:56.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.207+0000 7f5dc1000640 1 --2- 172.21.15.3:0/1030292245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5dbc1049a0 0x7f5dbc19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:56.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.207+0000 7f5dc1000640 1 -- 172.21.15.3:0/1030292245 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5dbc109120 msgr2=0x7f5dbc19ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:56.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.207+0000 7f5dc1000640 1 --2- 172.21.15.3:0/1030292245 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5dbc109120 0x7f5dbc19ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:56.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.207+0000 7f5dc1000640 1 -- 172.21.15.3:0/1030292245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dbc19f5f0 con 0x7f5dbc103ff0 2024-09-19T06:10:56.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.208+0000 7f5dc1000640 1 --2- 172.21.15.3:0/1030292245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dbc103ff0 0x7f5dbc19a640 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5dac00e9f0 tx=0x7f5dac00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:56.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.208+0000 7f5dba000640 1 -- 172.21.15.3:0/1030292245 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dac00cd80 con 0x7f5dbc103ff0 2024-09-19T06:10:56.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.208+0000 7f5dc3a00640 1 -- 172.21.15.3:0/1030292245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dbc19f8e0 con 0x7f5dbc103ff0 2024-09-19T06:10:56.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.208+0000 7f5dba000640 1 -- 172.21.15.3:0/1030292245 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dac010910 con 0x7f5dbc103ff0 2024-09-19T06:10:56.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.208+0000 7f5dba000640 1 -- 172.21.15.3:0/1030292245 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dac018980 con 0x7f5dbc103ff0 2024-09-19T06:10:56.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.208+0000 7f5dc3a00640 1 -- 172.21.15.3:0/1030292245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dbc1a71c0 con 0x7f5dbc103ff0 2024-09-19T06:10:56.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.209+0000 7f5dc3a00640 1 -- 172.21.15.3:0/1030292245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5dbc062980 con 0x7f5dbc103ff0 2024-09-19T06:10:56.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.211+0000 7f5dba000640 1 -- 172.21.15.3:0/1030292245 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f5dac010ac0 con 0x7f5dbc103ff0 2024-09-19T06:10:56.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.212+0000 7f5dba000640 1 --2- 172.21.15.3:0/1030292245 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5da00a3350 0x7f5da00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:56.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.212+0000 7f5dba000640 1 -- 172.21.15.3:0/1030292245 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f5dac0d00a0 con 0x7f5dbc103ff0 2024-09-19T06:10:56.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.213+0000 7f5db3e00640 1 --2- 172.21.15.3:0/1030292245 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5da00a3350 0x7f5da00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:56.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.213+0000 7f5dba000640 1 --2- 172.21.15.3:0/1030292245 >> [v2:172.21.15.71:6824/3502550915,v1:172.21.15.71:6825/3502550915] conn(0x7f5da00ad000 0x7f5da00af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:56.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.213+0000 7f5dba000640 1 -- 172.21.15.3:0/1030292245 --> [v2:172.21.15.71:6824/3502550915,v1:172.21.15.71:6825/3502550915] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5da00afb70 con 0x7f5da00ad000 2024-09-19T06:10:56.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.213+0000 7f5dba000640 1 -- 172.21.15.3:0/1030292245 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f5dac0d04f0 con 0x7f5dbc103ff0 2024-09-19T06:10:56.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.213+0000 7f5dc1a00640 1 --2- 172.21.15.3:0/1030292245 >> [v2:172.21.15.71:6824/3502550915,v1:172.21.15.71:6825/3502550915] conn(0x7f5da00ad000 0x7f5da00af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:56.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.213+0000 7f5db3e00640 1 --2- 172.21.15.3:0/1030292245 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5da00a3350 0x7f5da00a5810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5da4009230 tx=0x7f5da40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:56.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.214+0000 7f5dc1a00640 1 --2- 172.21.15.3:0/1030292245 >> [v2:172.21.15.71:6824/3502550915,v1:172.21.15.71:6825/3502550915] conn(0x7f5da00ad000 0x7f5da00af4a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:56.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.215+0000 7f5dba000640 1 -- 172.21.15.3:0/1030292245 <== osd.11 v2:172.21.15.71:6824/3502550915 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5da00afb70 con 0x7f5da00ad000 2024-09-19T06:10:56.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.229+0000 7f5dc3a00640 1 -- 172.21.15.3:0/1030292245 --> [v2:172.21.15.71:6824/3502550915,v1:172.21.15.71:6825/3502550915] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5dbc062e00 con 0x7f5da00ad000 2024-09-19T06:10:56.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.230+0000 7f5dba000640 1 -- 172.21.15.3:0/1030292245 <== osd.11 v2:172.21.15.71:6824/3502550915 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5dbc062e00 con 0x7f5da00ad000 2024-09-19T06:10:56.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.230+0000 7f5dc3a00640 1 -- 172.21.15.3:0/1030292245 >> [v2:172.21.15.71:6824/3502550915,v1:172.21.15.71:6825/3502550915] conn(0x7f5da00ad000 msgr2=0x7f5da00af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:56.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.230+0000 7f5dc3a00640 1 --2- 172.21.15.3:0/1030292245 >> [v2:172.21.15.71:6824/3502550915,v1:172.21.15.71:6825/3502550915] conn(0x7f5da00ad000 0x7f5da00af4a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:56.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.230+0000 7f5dc3a00640 1 -- 172.21.15.3:0/1030292245 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5da00a3350 msgr2=0x7f5da00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:56.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.230+0000 7f5dc3a00640 1 --2- 172.21.15.3:0/1030292245 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f5da00a3350 0x7f5da00a5810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5da4009230 tx=0x7f5da40058d0 comp rx=0 tx=0).stop 2024-09-19T06:10:56.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.230+0000 7f5dc3a00640 1 -- 172.21.15.3:0/1030292245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dbc103ff0 msgr2=0x7f5dbc19a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:56.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.230+0000 7f5dc3a00640 1 --2- 172.21.15.3:0/1030292245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dbc103ff0 0x7f5dbc19a640 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5dac00e9f0 tx=0x7f5dac00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:10:56.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.230+0000 7f5dc1a00640 1 -- 172.21.15.3:0/1030292245 reap_dead start 2024-09-19T06:10:56.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.230+0000 7f5dc3a00640 1 -- 172.21.15.3:0/1030292245 shutdown_connections 2024-09-19T06:10:56.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.230+0000 7f5dc3a00640 1 -- 172.21.15.3:0/1030292245 >> 172.21.15.3:0/1030292245 conn(0x7f5dbc0ffa90 msgr2=0x7f5dbc100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:56.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.231+0000 7f5dc3a00640 1 -- 172.21.15.3:0/1030292245 shutdown_connections 2024-09-19T06:10:56.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:56.231+0000 7f5dc3a00640 1 -- 172.21.15.3:0/1030292245 wait complete. 2024-09-19T06:10:56.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.273+0000 7f0bef000640 1 -- 172.21.15.3:0/1617844599 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0be8102370 msgr2=0x7f0be810e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:56.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.273+0000 7f0bef000640 1 --2- 172.21.15.3:0/1617844599 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0be8102370 0x7f0be810e8a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009cd0 tx=0x7f0be002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:10:56.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.273+0000 7f0bef000640 1 -- 172.21.15.3:0/1617844599 shutdown_connections 2024-09-19T06:10:56.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.273+0000 7f0bef000640 1 --2- 172.21.15.3:0/1617844599 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0be8102370 0x7f0be810e8a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:56.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.273+0000 7f0bef000640 1 --2- 172.21.15.3:0/1617844599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be81019d0 0x7f0be8101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:56.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.273+0000 7f0bef000640 1 --2- 172.21.15.3:0/1617844599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0be81079d0 0x7f0be8107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:56.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.273+0000 7f0bef000640 1 -- 172.21.15.3:0/1617844599 >> 172.21.15.3:0/1617844599 conn(0x7f0be80fd710 msgr2=0x7f0be80ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.273+0000 7f0bef000640 1 -- 172.21.15.3:0/1617844599 shutdown_connections 2024-09-19T06:10:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.273+0000 7f0bef000640 1 -- 172.21.15.3:0/1617844599 wait complete. 2024-09-19T06:10:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.274+0000 7f0bef000640 1 Processor -- start 2024-09-19T06:10:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.274+0000 7f0bef000640 1 -- start start 2024-09-19T06:10:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.275+0000 7f0bef000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be81019d0 0x7f0be8198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.275+0000 7f0bef000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0be8102370 0x7f0be8198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.275+0000 7f0bef000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0be81079d0 0x7f0be819caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.275+0000 7f0bef000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0be8111e20 con 0x7f0be81079d0 2024-09-19T06:10:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.275+0000 7f0bef000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0be8111ca0 con 0x7f0be8102370 2024-09-19T06:10:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.275+0000 7f0bef000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0be8111fa0 con 0x7f0be81019d0 2024-09-19T06:10:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.275+0000 7f0bee600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0be81079d0 0x7f0be819caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.275+0000 7f0bee600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0be81079d0 0x7f0be819caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51384/0 (socket says 172.21.15.3:51384) 2024-09-19T06:10:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.275+0000 7f0bee600640 1 -- 172.21.15.3:0/2576233225 learned_addr learned my addr 172.21.15.3:0/2576233225 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:56.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.275+0000 7f0bed200640 1 --2- 172.21.15.3:0/2576233225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0be8102370 0x7f0be8198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:56.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.275+0000 7f0bedc00640 1 --2- 172.21.15.3:0/2576233225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be81019d0 0x7f0be8198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:56.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.276+0000 7f0bee600640 1 -- 172.21.15.3:0/2576233225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be81019d0 msgr2=0x7f0be8198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:56.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.276+0000 7f0bee600640 1 --2- 172.21.15.3:0/2576233225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0be81019d0 0x7f0be8198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:56.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.276+0000 7f0bee600640 1 -- 172.21.15.3:0/2576233225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0be8102370 msgr2=0x7f0be8198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:56.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.276+0000 7f0bee600640 1 --2- 172.21.15.3:0/2576233225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0be8102370 0x7f0be8198760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:56.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.276+0000 7f0bee600640 1 -- 172.21.15.3:0/2576233225 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be819d1d0 con 0x7f0be81079d0 2024-09-19T06:10:56.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.276+0000 7f0bed200640 1 --2- 172.21.15.3:0/2576233225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0be8102370 0x7f0be8198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:56.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.276+0000 7f0bee600640 1 --2- 172.21.15.3:0/2576233225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0be81079d0 0x7f0be819caf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0be0033040 tx=0x7f0be0031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:56.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.276+0000 7f0be6000640 1 -- 172.21.15.3:0/2576233225 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be0004040 con 0x7f0be81079d0 2024-09-19T06:10:56.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.276+0000 7f0be6000640 1 -- 172.21.15.3:0/2576233225 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0be00046c0 con 0x7f0be81079d0 2024-09-19T06:10:56.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.276+0000 7f0be6000640 1 -- 172.21.15.3:0/2576233225 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be0030e80 con 0x7f0be81079d0 2024-09-19T06:10:56.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.276+0000 7f0bef000640 1 -- 172.21.15.3:0/2576233225 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0be819d460 con 0x7f0be81079d0 2024-09-19T06:10:56.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.277+0000 7f0bef000640 1 -- 172.21.15.3:0/2576233225 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0be81a4da0 con 0x7f0be81079d0 2024-09-19T06:10:56.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.277+0000 7f0bef000640 1 -- 172.21.15.3:0/2576233225 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0be80ff7f0 con 0x7f0be81079d0 2024-09-19T06:10:56.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.279+0000 7f0be6000640 1 -- 172.21.15.3:0/2576233225 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f0be00305a0 con 0x7f0be81079d0 2024-09-19T06:10:56.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.281+0000 7f0be6000640 1 --2- 172.21.15.3:0/2576233225 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0bd00a3350 0x7f0bd00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:56.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.281+0000 7f0be6000640 1 -- 172.21.15.3:0/2576233225 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f0be002e030 con 0x7f0be81079d0 2024-09-19T06:10:56.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.281+0000 7f0bedc00640 1 --2- 172.21.15.3:0/2576233225 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0bd00a3350 0x7f0bd00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:56.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.281+0000 7f0be6000640 1 --2- 172.21.15.3:0/2576233225 >> [v2:172.21.15.71:6808/2455500497,v1:172.21.15.71:6809/2455500497] conn(0x7f0bd00ad000 0x7f0bd00af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:56.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.281+0000 7f0be6000640 1 -- 172.21.15.3:0/2576233225 --> [v2:172.21.15.71:6808/2455500497,v1:172.21.15.71:6809/2455500497] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0be00059a0 con 0x7f0bd00ad000 2024-09-19T06:10:56.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.281+0000 7f0be6000640 1 -- 172.21.15.3:0/2576233225 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f0be00f0ee0 con 0x7f0be81079d0 2024-09-19T06:10:56.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.282+0000 7f0bed200640 1 --2- 172.21.15.3:0/2576233225 >> [v2:172.21.15.71:6808/2455500497,v1:172.21.15.71:6809/2455500497] conn(0x7f0bd00ad000 0x7f0bd00af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:56.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.282+0000 7f0bedc00640 1 --2- 172.21.15.3:0/2576233225 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0bd00a3350 0x7f0bd00a5810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc009b50 tx=0x7f0bdc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:56.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.282+0000 7f0bed200640 1 --2- 172.21.15.3:0/2576233225 >> [v2:172.21.15.71:6808/2455500497,v1:172.21.15.71:6809/2455500497] conn(0x7f0bd00ad000 0x7f0bd00af4a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:56.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.283+0000 7f0be6000640 1 -- 172.21.15.3:0/2576233225 <== osd.5 v2:172.21.15.71:6808/2455500497 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0be00059a0 con 0x7f0bd00ad000 2024-09-19T06:10:56.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.297+0000 7f0bef000640 1 -- 172.21.15.3:0/2576233225 --> [v2:172.21.15.71:6808/2455500497,v1:172.21.15.71:6809/2455500497] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0be8103110 con 0x7f0bd00ad000 2024-09-19T06:10:56.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.298+0000 7f0be6000640 1 -- 172.21.15.3:0/2576233225 <== osd.5 v2:172.21.15.71:6808/2455500497 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0be8103110 con 0x7f0bd00ad000 2024-09-19T06:10:56.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.298+0000 7f0bef000640 1 -- 172.21.15.3:0/2576233225 >> [v2:172.21.15.71:6808/2455500497,v1:172.21.15.71:6809/2455500497] conn(0x7f0bd00ad000 msgr2=0x7f0bd00af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:56.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.298+0000 7f0bef000640 1 --2- 172.21.15.3:0/2576233225 >> [v2:172.21.15.71:6808/2455500497,v1:172.21.15.71:6809/2455500497] conn(0x7f0bd00ad000 0x7f0bd00af4a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:56.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.298+0000 7f0bef000640 1 -- 172.21.15.3:0/2576233225 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0bd00a3350 msgr2=0x7f0bd00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:56.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.298+0000 7f0bef000640 1 --2- 172.21.15.3:0/2576233225 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0bd00a3350 0x7f0bd00a5810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc009b50 tx=0x7f0bdc005f90 comp rx=0 tx=0).stop 2024-09-19T06:10:56.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.298+0000 7f0bef000640 1 -- 172.21.15.3:0/2576233225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0be81079d0 msgr2=0x7f0be819caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:56.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.298+0000 7f0bef000640 1 --2- 172.21.15.3:0/2576233225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0be81079d0 0x7f0be819caf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0be0033040 tx=0x7f0be0031e60 comp rx=0 tx=0).stop 2024-09-19T06:10:56.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.298+0000 7f0bee600640 1 -- 172.21.15.3:0/2576233225 reap_dead start 2024-09-19T06:10:56.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.298+0000 7f0bef000640 1 -- 172.21.15.3:0/2576233225 shutdown_connections 2024-09-19T06:10:56.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.298+0000 7f0bef000640 1 -- 172.21.15.3:0/2576233225 >> 172.21.15.3:0/2576233225 conn(0x7f0be80fd710 msgr2=0x7f0be80fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:56.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.299+0000 7f0bef000640 1 -- 172.21.15.3:0/2576233225 shutdown_connections 2024-09-19T06:10:56.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:53.299+0000 7f0bef000640 1 -- 172.21.15.3:0/2576233225 wait complete. 2024-09-19T06:10:57.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.798+0000 7f6a9f000640 1 -- 172.21.15.3:0/1774178532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a98100930 msgr2=0x7f6a98100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:57.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.798+0000 7f6a9f000640 1 --2- 172.21.15.3:0/1774178532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a98100930 0x7f6a98100d10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009900 tx=0x7f6a8802a410 comp rx=0 tx=0).stop 2024-09-19T06:10:57.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.798+0000 7f6a9f000640 1 -- 172.21.15.3:0/1774178532 shutdown_connections 2024-09-19T06:10:57.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.798+0000 7f6a9f000640 1 --2- 172.21.15.3:0/1774178532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a9810e4e0 0x7f6a981108d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:57.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.798+0000 7f6a9f000640 1 --2- 172.21.15.3:0/1774178532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a981012e0 0x7f6a9810dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:57.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.798+0000 7f6a9f000640 1 --2- 172.21.15.3:0/1774178532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a98100930 0x7f6a98100d10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:57.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.798+0000 7f6a9f000640 1 -- 172.21.15.3:0/1774178532 >> 172.21.15.3:0/1774178532 conn(0x7f6a980fc7a0 msgr2=0x7f6a980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:57.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.798+0000 7f6a9f000640 1 -- 172.21.15.3:0/1774178532 shutdown_connections 2024-09-19T06:10:57.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.798+0000 7f6a9f000640 1 -- 172.21.15.3:0/1774178532 wait complete. 2024-09-19T06:10:57.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.799+0000 7f6a9f000640 1 Processor -- start 2024-09-19T06:10:57.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.799+0000 7f6a9f000640 1 -- start start 2024-09-19T06:10:57.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.800+0000 7f6a9f000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a98100930 0x7f6a9819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:57.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.800+0000 7f6a9f000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a981012e0 0x7f6a9819ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:57.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.800+0000 7f6a9f000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a9810e4e0 0x7f6a9819efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:57.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.800+0000 7f6a9f000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6a981141c0 con 0x7f6a98100930 2024-09-19T06:10:57.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.800+0000 7f6a9f000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6a98114040 con 0x7f6a981012e0 2024-09-19T06:10:57.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.800+0000 7f6a9f000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6a98114340 con 0x7f6a9810e4e0 2024-09-19T06:10:57.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.800+0000 7f6a97e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a98100930 0x7f6a9819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:57.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.800+0000 7f6a97e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a98100930 0x7f6a9819a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40540/0 (socket says 172.21.15.3:40540) 2024-09-19T06:10:57.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.800+0000 7f6a97e00640 1 -- 172.21.15.3:0/3800485860 learned_addr learned my addr 172.21.15.3:0/3800485860 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:57.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.800+0000 7f6a97400640 1 --2- 172.21.15.3:0/3800485860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a981012e0 0x7f6a9819ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:57.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.800+0000 7f6a9d000640 1 --2- 172.21.15.3:0/3800485860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a9810e4e0 0x7f6a9819efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:57.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.801+0000 7f6a97400640 1 -- 172.21.15.3:0/3800485860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a9810e4e0 msgr2=0x7f6a9819efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:57.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.801+0000 7f6a97400640 1 --2- 172.21.15.3:0/3800485860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a9810e4e0 0x7f6a9819efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:57.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.801+0000 7f6a97400640 1 -- 172.21.15.3:0/3800485860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a98100930 msgr2=0x7f6a9819a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:57.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.801+0000 7f6a97400640 1 --2- 172.21.15.3:0/3800485860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a98100930 0x7f6a9819a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:57.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.801+0000 7f6a97400640 1 -- 172.21.15.3:0/3800485860 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9819f690 con 0x7f6a981012e0 2024-09-19T06:10:57.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.801+0000 7f6a9d000640 1 --2- 172.21.15.3:0/3800485860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6a9810e4e0 0x7f6a9819efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:57.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.801+0000 7f6a97e00640 1 --2- 172.21.15.3:0/3800485860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6a98100930 0x7f6a9819a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:10:57.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.801+0000 7f6a97400640 1 --2- 172.21.15.3:0/3800485860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a981012e0 0x7f6a9819ac20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6a8400e9f0 tx=0x7f6a8400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:57.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.801+0000 7f6a94c00640 1 -- 172.21.15.3:0/3800485860 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8400ccc0 con 0x7f6a981012e0 2024-09-19T06:10:57.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.801+0000 7f6a9f000640 1 -- 172.21.15.3:0/3800485860 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a9819f980 con 0x7f6a981012e0 2024-09-19T06:10:57.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.801+0000 7f6a94c00640 1 -- 172.21.15.3:0/3800485860 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a84010910 con 0x7f6a981012e0 2024-09-19T06:10:57.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.801+0000 7f6a94c00640 1 -- 172.21.15.3:0/3800485860 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a84018960 con 0x7f6a981012e0 2024-09-19T06:10:57.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.801+0000 7f6a9f000640 1 -- 172.21.15.3:0/3800485860 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a981a7260 con 0x7f6a981012e0 2024-09-19T06:10:57.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.802+0000 7f6a9f000640 1 -- 172.21.15.3:0/3800485860 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6a98062900 con 0x7f6a981012e0 2024-09-19T06:10:57.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.805+0000 7f6a94c00640 1 -- 172.21.15.3:0/3800485860 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f6a84010ac0 con 0x7f6a981012e0 2024-09-19T06:10:57.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.806+0000 7f6a94c00640 1 --2- 172.21.15.3:0/3800485860 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f6a7c0a32d0 0x7f6a7c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:57.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.807+0000 7f6a94c00640 1 -- 172.21.15.3:0/3800485860 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f6a840d06d0 con 0x7f6a981012e0 2024-09-19T06:10:57.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.807+0000 7f6a97e00640 1 --2- 172.21.15.3:0/3800485860 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f6a7c0a32d0 0x7f6a7c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:57.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.807+0000 7f6a94c00640 1 --2- 172.21.15.3:0/3800485860 >> [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903] conn(0x7f6a7c0acf80 0x7f6a7c0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:57.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.807+0000 7f6a94c00640 1 -- 172.21.15.3:0/3800485860 --> [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6a84028ea0 con 0x7f6a7c0acf80 2024-09-19T06:10:57.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.807+0000 7f6a94c00640 1 -- 172.21.15.3:0/3800485860 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f6a840d0a80 con 0x7f6a981012e0 2024-09-19T06:10:57.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.807+0000 7f6a9d000640 1 --2- 172.21.15.3:0/3800485860 >> [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903] conn(0x7f6a7c0acf80 0x7f6a7c0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:57.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.808+0000 7f6a97e00640 1 --2- 172.21.15.3:0/3800485860 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f6a7c0a32d0 0x7f6a7c0a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6a880096c0 tx=0x7f6a880046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:57.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.808+0000 7f6a9d000640 1 --2- 172.21.15.3:0/3800485860 >> [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903] conn(0x7f6a7c0acf80 0x7f6a7c0af420 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:57.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.809+0000 7f6a94c00640 1 -- 172.21.15.3:0/3800485860 <== osd.6 v2:172.21.15.3:6818/823411903 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6a84028ea0 con 0x7f6a7c0acf80 2024-09-19T06:10:57.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.823+0000 7f6a9f000640 1 -- 172.21.15.3:0/3800485860 --> [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6a98062d00 con 0x7f6a7c0acf80 2024-09-19T06:10:57.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.823+0000 7f6a94c00640 1 -- 172.21.15.3:0/3800485860 <== osd.6 v2:172.21.15.3:6818/823411903 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6a98062d00 con 0x7f6a7c0acf80 2024-09-19T06:10:57.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.824+0000 7f6a9f000640 1 -- 172.21.15.3:0/3800485860 >> [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903] conn(0x7f6a7c0acf80 msgr2=0x7f6a7c0af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:57.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.824+0000 7f6a9f000640 1 --2- 172.21.15.3:0/3800485860 >> [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903] conn(0x7f6a7c0acf80 0x7f6a7c0af420 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:57.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.824+0000 7f6a9f000640 1 -- 172.21.15.3:0/3800485860 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f6a7c0a32d0 msgr2=0x7f6a7c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:57.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.824+0000 7f6a9f000640 1 --2- 172.21.15.3:0/3800485860 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f6a7c0a32d0 0x7f6a7c0a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6a880096c0 tx=0x7f6a880046c0 comp rx=0 tx=0).stop 2024-09-19T06:10:57.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.824+0000 7f6a9f000640 1 -- 172.21.15.3:0/3800485860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a981012e0 msgr2=0x7f6a9819ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:57.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.824+0000 7f6a9f000640 1 --2- 172.21.15.3:0/3800485860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a981012e0 0x7f6a9819ac20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6a8400e9f0 tx=0x7f6a8400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:10:57.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.824+0000 7f6a9d000640 1 -- 172.21.15.3:0/3800485860 reap_dead start 2024-09-19T06:10:57.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.824+0000 7f6a9f000640 1 -- 172.21.15.3:0/3800485860 shutdown_connections 2024-09-19T06:10:57.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.824+0000 7f6a9f000640 1 -- 172.21.15.3:0/3800485860 >> 172.21.15.3:0/3800485860 conn(0x7f6a980fc7a0 msgr2=0x7f6a980feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:57.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.824+0000 7f6a9f000640 1 -- 172.21.15.3:0/3800485860 shutdown_connections 2024-09-19T06:10:57.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:57.824+0000 7f6a9f000640 1 -- 172.21.15.3:0/3800485860 wait complete. 2024-09-19T06:10:58.013 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:57 smithi003 ceph-mon[30893]: pgmap v331: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-09-19T06:10:58.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:57 smithi059 ceph-mon[35138]: pgmap v331: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-09-19T06:10:58.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:57 smithi071 ceph-mon[35662]: pgmap v331: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-09-19T06:10:58.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.125+0000 7f4697200640 1 -- 172.21.15.3:0/1953596606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4698103e30 msgr2=0x7f4698104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:58.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.125+0000 7f4697200640 1 --2- 172.21.15.3:0/1953596606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4698103e30 0x7f4698104210 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4688009900 tx=0x7f468802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:10:58.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.125+0000 7f4697200640 1 -- 172.21.15.3:0/1953596606 shutdown_connections 2024-09-19T06:10:58.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.125+0000 7f4697200640 1 --2- 172.21.15.3:0/1953596606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4698108f60 0x7f4698110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:58.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.125+0000 7f4697200640 1 --2- 172.21.15.3:0/1953596606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46981047e0 0x7f4698108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:58.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.125+0000 7f4697200640 1 --2- 172.21.15.3:0/1953596606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4698103e30 0x7f4698104210 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:58.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.125+0000 7f4697200640 1 -- 172.21.15.3:0/1953596606 >> 172.21.15.3:0/1953596606 conn(0x7f46980ff8d0 msgr2=0x7f4698101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:58.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.125+0000 7f4697200640 1 -- 172.21.15.3:0/1953596606 shutdown_connections 2024-09-19T06:10:58.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.125+0000 7f4697200640 1 -- 172.21.15.3:0/1953596606 wait complete. 2024-09-19T06:10:58.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.126+0000 7f4697200640 1 Processor -- start 2024-09-19T06:10:58.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.126+0000 7f4697200640 1 -- start start 2024-09-19T06:10:58.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.126+0000 7f4697200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4698103e30 0x7f469819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:58.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.126+0000 7f4697200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46981047e0 0x7f469819a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:58.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.126+0000 7f4697200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4698108f60 0x7f469819ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:58.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.126+0000 7f4697200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4698114010 con 0x7f4698103e30 2024-09-19T06:10:58.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.126+0000 7f4697200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4698113e90 con 0x7f46981047e0 2024-09-19T06:10:58.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.126+0000 7f4697200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4698114190 con 0x7f4698108f60 2024-09-19T06:10:58.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.126+0000 7f4695e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4698103e30 0x7f469819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:58.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.126+0000 7f4695400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46981047e0 0x7f469819a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:58.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.126+0000 7f4695e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4698103e30 0x7f469819a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40554/0 (socket says 172.21.15.3:40554) 2024-09-19T06:10:58.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.126+0000 7f4695e00640 1 -- 172.21.15.3:0/724300877 learned_addr learned my addr 172.21.15.3:0/724300877 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:10:58.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.127+0000 7f4696800640 1 --2- 172.21.15.3:0/724300877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4698108f60 0x7f469819ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:58.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.127+0000 7f4695e00640 1 -- 172.21.15.3:0/724300877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4698108f60 msgr2=0x7f469819ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:58.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.127+0000 7f4695e00640 1 --2- 172.21.15.3:0/724300877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4698108f60 0x7f469819ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:58.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.127+0000 7f4695e00640 1 -- 172.21.15.3:0/724300877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46981047e0 msgr2=0x7f469819a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:58.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.127+0000 7f4695e00640 1 --2- 172.21.15.3:0/724300877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46981047e0 0x7f469819a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:58.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.127+0000 7f4695e00640 1 -- 172.21.15.3:0/724300877 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469819f3f0 con 0x7f4698103e30 2024-09-19T06:10:58.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.127+0000 7f4695e00640 1 --2- 172.21.15.3:0/724300877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4698103e30 0x7f469819a440 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4688004770 tx=0x7f4688003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:58.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.127+0000 7f468ea00640 1 -- 172.21.15.3:0/724300877 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468803f070 con 0x7f4698103e30 2024-09-19T06:10:58.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.127+0000 7f468ea00640 1 -- 172.21.15.3:0/724300877 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4688031ca0 con 0x7f4698103e30 2024-09-19T06:10:58.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.127+0000 7f4697200640 1 -- 172.21.15.3:0/724300877 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f469819f680 con 0x7f4698103e30 2024-09-19T06:10:58.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.127+0000 7f468ea00640 1 -- 172.21.15.3:0/724300877 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4688035030 con 0x7f4698103e30 2024-09-19T06:10:58.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.128+0000 7f4697200640 1 -- 172.21.15.3:0/724300877 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46981a6fc0 con 0x7f4698103e30 2024-09-19T06:10:58.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.128+0000 7f4697200640 1 -- 172.21.15.3:0/724300877 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4698062980 con 0x7f4698103e30 2024-09-19T06:10:58.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.130+0000 7f468ea00640 1 -- 172.21.15.3:0/724300877 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f4688042070 con 0x7f4698103e30 2024-09-19T06:10:58.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.132+0000 7f468ea00640 1 --2- 172.21.15.3:0/724300877 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f467c0a3350 0x7f467c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:58.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.132+0000 7f468ea00640 1 -- 172.21.15.3:0/724300877 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f46880f05b0 con 0x7f4698103e30 2024-09-19T06:10:58.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.132+0000 7f4695400640 1 --2- 172.21.15.3:0/724300877 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f467c0a3350 0x7f467c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:58.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.132+0000 7f468ea00640 1 --2- 172.21.15.3:0/724300877 >> [v2:172.21.15.59:6816/2133603853,v1:172.21.15.59:6817/2133603853] conn(0x7f467c0ad000 0x7f467c0af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:10:58.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.132+0000 7f468ea00640 1 -- 172.21.15.3:0/724300877 --> [v2:172.21.15.59:6816/2133603853,v1:172.21.15.59:6817/2133603853] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4688038e90 con 0x7f467c0ad000 2024-09-19T06:10:58.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.132+0000 7f468ea00640 1 -- 172.21.15.3:0/724300877 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f46880f0960 con 0x7f4698103e30 2024-09-19T06:10:58.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.132+0000 7f4696800640 1 --2- 172.21.15.3:0/724300877 >> [v2:172.21.15.59:6816/2133603853,v1:172.21.15.59:6817/2133603853] conn(0x7f467c0ad000 0x7f467c0af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:10:58.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.133+0000 7f4695400640 1 --2- 172.21.15.3:0/724300877 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f467c0a3350 0x7f467c0a5810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f46980ffcf0 tx=0x7f468400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:58.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.133+0000 7f4696800640 1 --2- 172.21.15.3:0/724300877 >> [v2:172.21.15.59:6816/2133603853,v1:172.21.15.59:6817/2133603853] conn(0x7f467c0ad000 0x7f467c0af4a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:10:58.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.134+0000 7f468ea00640 1 -- 172.21.15.3:0/724300877 <== osd.7 v2:172.21.15.59:6816/2133603853 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4688038e90 con 0x7f467c0ad000 2024-09-19T06:10:58.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.148+0000 7f4697200640 1 -- 172.21.15.3:0/724300877 --> [v2:172.21.15.59:6816/2133603853,v1:172.21.15.59:6817/2133603853] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4698062d80 con 0x7f467c0ad000 2024-09-19T06:10:58.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.149+0000 7f468ea00640 1 -- 172.21.15.3:0/724300877 <== osd.7 v2:172.21.15.59:6816/2133603853 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4698062d80 con 0x7f467c0ad000 2024-09-19T06:10:58.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.149+0000 7f4697200640 1 -- 172.21.15.3:0/724300877 >> [v2:172.21.15.59:6816/2133603853,v1:172.21.15.59:6817/2133603853] conn(0x7f467c0ad000 msgr2=0x7f467c0af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:58.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.149+0000 7f4697200640 1 --2- 172.21.15.3:0/724300877 >> [v2:172.21.15.59:6816/2133603853,v1:172.21.15.59:6817/2133603853] conn(0x7f467c0ad000 0x7f467c0af4a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:10:58.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.149+0000 7f4697200640 1 -- 172.21.15.3:0/724300877 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f467c0a3350 msgr2=0x7f467c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:58.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.149+0000 7f4697200640 1 --2- 172.21.15.3:0/724300877 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f467c0a3350 0x7f467c0a5810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f46980ffcf0 tx=0x7f468400b410 comp rx=0 tx=0).stop 2024-09-19T06:10:58.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.149+0000 7f4697200640 1 -- 172.21.15.3:0/724300877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4698103e30 msgr2=0x7f469819a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:10:58.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.149+0000 7f4697200640 1 --2- 172.21.15.3:0/724300877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4698103e30 0x7f469819a440 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4688004770 tx=0x7f4688003c10 comp rx=0 tx=0).stop 2024-09-19T06:10:58.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.149+0000 7f4696800640 1 -- 172.21.15.3:0/724300877 reap_dead start 2024-09-19T06:10:58.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.150+0000 7f4697200640 1 -- 172.21.15.3:0/724300877 shutdown_connections 2024-09-19T06:10:58.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.150+0000 7f4697200640 1 -- 172.21.15.3:0/724300877 >> 172.21.15.3:0/724300877 conn(0x7f46980ff8d0 msgr2=0x7f4698100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:10:58.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.150+0000 7f4697200640 1 -- 172.21.15.3:0/724300877 shutdown_connections 2024-09-19T06:10:58.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:10:58.150+0000 7f4697200640 1 -- 172.21.15.3:0/724300877 wait complete. 2024-09-19T06:10:59.198 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:58 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:59.239 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:58 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:59.270 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:58 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:10:59.622 INFO:teuthology.orchestra.run.smithi003.stdout:219043332143 2024-09-19T06:10:59.622 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T06:11:00.020 INFO:teuthology.orchestra.run.smithi003.stdout:111669149763 2024-09-19T06:11:00.020 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T06:11:00.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:10:59 smithi059 ceph-mon[35138]: pgmap v332: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-09-19T06:11:00.328 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:10:59 smithi003 ceph-mon[30893]: pgmap v332: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-09-19T06:11:00.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:10:59 smithi071 ceph-mon[35662]: pgmap v332: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-09-19T06:11:00.379 INFO:teuthology.orchestra.run.smithi003.stdout:304942678046 2024-09-19T06:11:00.379 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T06:11:00.748 INFO:teuthology.orchestra.run.smithi003.stdout:163208757306 2024-09-19T06:11:00.748 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T06:11:00.890 INFO:teuthology.orchestra.run.smithi003.stdout:34359738453 2024-09-19T06:11:00.891 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T06:11:01.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:01 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:11:01.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:01 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:11:01.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:01 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:11:01.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:01 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:11:01.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:01 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:11:01.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:01 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:11:01.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:01 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:11:01.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:01 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:11:01.395 INFO:teuthology.orchestra.run.smithi003.stdout:141733920831 2024-09-19T06:11:01.395 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T06:11:01.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:01 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:11:01.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:01 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:11:01.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:01 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:11:01.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:01 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:11:02.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:02 smithi003 ceph-mon[30893]: pgmap v333: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:02.462 INFO:teuthology.orchestra.run.smithi003.stdout:283467841570 2024-09-19T06:11:02.462 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T06:11:02.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:02 smithi059 ceph-mon[35138]: pgmap v333: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:02.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:02 smithi071 ceph-mon[35662]: pgmap v333: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:02.793 INFO:teuthology.orchestra.run.smithi003.stdout:77309411402 2024-09-19T06:11:02.793 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T06:11:02.977 INFO:teuthology.orchestra.run.smithi003.stdout:249108103210 2024-09-19T06:11:02.977 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T06:11:03.316 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:03 smithi003 ceph-mon[30893]: pgmap v334: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:03.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:03 smithi059 ceph-mon[35138]: pgmap v334: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:03.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:03 smithi071 ceph-mon[35662]: pgmap v334: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:03.760 INFO:teuthology.orchestra.run.smithi003.stdout:197568495668 2024-09-19T06:11:03.760 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T06:11:04.151 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:04.153 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:04.158 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:04.160 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:04.218 INFO:teuthology.orchestra.run.smithi003.stdout:335007449112 2024-09-19T06:11:04.219 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T06:11:04.279 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:04.283 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:04.285 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:05.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.065+0000 7fba63e00640 1 -- 172.21.15.3:0/2721554312 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba5c102790 msgr2=0x7fba5c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:05.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.065+0000 7fba63e00640 1 --2- 172.21.15.3:0/2721554312 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba5c102790 0x7fba5c1067e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fba48009900 tx=0x7fba4802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:11:05.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.065+0000 7fba63e00640 1 -- 172.21.15.3:0/2721554312 shutdown_connections 2024-09-19T06:11:05.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.065+0000 7fba63e00640 1 --2- 172.21.15.3:0/2721554312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba5c106f10 0x7fba5c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:05.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.065+0000 7fba63e00640 1 --2- 172.21.15.3:0/2721554312 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba5c102790 0x7fba5c1067e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:05.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.065+0000 7fba63e00640 1 --2- 172.21.15.3:0/2721554312 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba5c101de0 0x7fba5c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:05.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.065+0000 7fba63e00640 1 -- 172.21.15.3:0/2721554312 >> 172.21.15.3:0/2721554312 conn(0x7fba5c0fd8c0 msgr2=0x7fba5c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:05.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.065+0000 7fba63e00640 1 -- 172.21.15.3:0/2721554312 shutdown_connections 2024-09-19T06:11:05.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.065+0000 7fba63e00640 1 -- 172.21.15.3:0/2721554312 wait complete. 2024-09-19T06:11:05.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.066+0000 7fba63e00640 1 Processor -- start 2024-09-19T06:11:05.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.066+0000 7fba63e00640 1 -- start start 2024-09-19T06:11:05.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.067+0000 7fba63e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba5c101de0 0x7fba5c19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:05.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.067+0000 7fba63e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba5c102790 0x7fba5c19ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:05.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.067+0000 7fba63e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba5c106f10 0x7fba5c19efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:05.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.067+0000 7fba63e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c111f70 con 0x7fba5c106f10 2024-09-19T06:11:05.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.067+0000 7fba63e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c111df0 con 0x7fba5c101de0 2024-09-19T06:11:05.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.067+0000 7fba63e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c1120f0 con 0x7fba5c102790 2024-09-19T06:11:05.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.067+0000 7fba61e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba5c106f10 0x7fba5c19efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:05.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.067+0000 7fba61e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba5c106f10 0x7fba5c19efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51686/0 (socket says 172.21.15.3:51686) 2024-09-19T06:11:05.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.067+0000 7fba61e00640 1 -- 172.21.15.3:0/979171267 learned_addr learned my addr 172.21.15.3:0/979171267 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:05.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.067+0000 7fba60a00640 1 --2- 172.21.15.3:0/979171267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba5c102790 0x7fba5c19ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:05.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.067+0000 7fba61400640 1 --2- 172.21.15.3:0/979171267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba5c101de0 0x7fba5c19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:05.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.067+0000 7fba61e00640 1 -- 172.21.15.3:0/979171267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba5c102790 msgr2=0x7fba5c19ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:05.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.067+0000 7fba61e00640 1 --2- 172.21.15.3:0/979171267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba5c102790 0x7fba5c19ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:05.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.067+0000 7fba61e00640 1 -- 172.21.15.3:0/979171267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba5c101de0 msgr2=0x7fba5c19a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:05.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.067+0000 7fba61e00640 1 --2- 172.21.15.3:0/979171267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba5c101de0 0x7fba5c19a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:05.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.067+0000 7fba61e00640 1 -- 172.21.15.3:0/979171267 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5c19f680 con 0x7fba5c106f10 2024-09-19T06:11:05.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.067+0000 7fba60a00640 1 --2- 172.21.15.3:0/979171267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba5c102790 0x7fba5c19ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:11:05.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.068+0000 7fba61e00640 1 --2- 172.21.15.3:0/979171267 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba5c106f10 0x7fba5c19efa0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fba5400eb10 tx=0x7fba5400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:05.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.068+0000 7fba5a000640 1 -- 172.21.15.3:0/979171267 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba54004b20 con 0x7fba5c106f10 2024-09-19T06:11:05.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.068+0000 7fba5a000640 1 -- 172.21.15.3:0/979171267 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba54004cc0 con 0x7fba5c106f10 2024-09-19T06:11:05.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.068+0000 7fba63e00640 1 -- 172.21.15.3:0/979171267 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba5c19f970 con 0x7fba5c106f10 2024-09-19T06:11:05.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.068+0000 7fba5a000640 1 -- 172.21.15.3:0/979171267 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba54010760 con 0x7fba5c106f10 2024-09-19T06:11:05.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.068+0000 7fba63e00640 1 -- 172.21.15.3:0/979171267 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba5c1a7250 con 0x7fba5c106f10 2024-09-19T06:11:05.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.069+0000 7fba63e00640 1 -- 172.21.15.3:0/979171267 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba5c1021c0 con 0x7fba5c106f10 2024-09-19T06:11:05.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.071+0000 7fba5a000640 1 -- 172.21.15.3:0/979171267 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fba54005020 con 0x7fba5c106f10 2024-09-19T06:11:05.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.073+0000 7fba5a000640 1 --2- 172.21.15.3:0/979171267 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fba440a32d0 0x7fba440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:05.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.073+0000 7fba5a000640 1 -- 172.21.15.3:0/979171267 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fba540d0060 con 0x7fba5c106f10 2024-09-19T06:11:05.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.073+0000 7fba61400640 1 --2- 172.21.15.3:0/979171267 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fba440a32d0 0x7fba440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:05.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.074+0000 7fba61400640 1 --2- 172.21.15.3:0/979171267 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fba440a32d0 0x7fba440a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fba50009bd0 tx=0x7fba50005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:05.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.077+0000 7fba5a000640 1 -- 172.21.15.3:0/979171267 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fba5409cc00 con 0x7fba5c106f10 2024-09-19T06:11:05.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.268+0000 7fba63e00640 1 -- 172.21.15.3:0/979171267 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fba5c1a74b0 con 0x7fba5c106f10 2024-09-19T06:11:05.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.268+0000 7fba5a000640 1 -- 172.21.15.3:0/979171267 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fba5409c500 con 0x7fba5c106f10 2024-09-19T06:11:05.271 INFO:teuthology.orchestra.run.smithi003.stdout:304942678048 2024-09-19T06:11:05.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.271+0000 7fba63e00640 1 -- 172.21.15.3:0/979171267 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fba440a32d0 msgr2=0x7fba440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:05.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.271+0000 7fba63e00640 1 --2- 172.21.15.3:0/979171267 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fba440a32d0 0x7fba440a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fba50009bd0 tx=0x7fba50005f90 comp rx=0 tx=0).stop 2024-09-19T06:11:05.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.271+0000 7fba63e00640 1 -- 172.21.15.3:0/979171267 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba5c106f10 msgr2=0x7fba5c19efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:05.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.271+0000 7fba63e00640 1 --2- 172.21.15.3:0/979171267 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba5c106f10 0x7fba5c19efa0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fba5400eb10 tx=0x7fba5400c2d0 comp rx=0 tx=0).stop 2024-09-19T06:11:05.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.271+0000 7fba63e00640 1 -- 172.21.15.3:0/979171267 shutdown_connections 2024-09-19T06:11:05.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.271+0000 7fba63e00640 1 --2- 172.21.15.3:0/979171267 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fba440a32d0 0x7fba440a5790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:05.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.271+0000 7fba63e00640 1 --2- 172.21.15.3:0/979171267 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba5c106f10 0x7fba5c19efa0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:05.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.271+0000 7fba63e00640 1 --2- 172.21.15.3:0/979171267 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba5c102790 0x7fba5c19ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:05.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.271+0000 7fba63e00640 1 --2- 172.21.15.3:0/979171267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba5c101de0 0x7fba5c19a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:05.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.271+0000 7fba63e00640 1 -- 172.21.15.3:0/979171267 >> 172.21.15.3:0/979171267 conn(0x7fba5c0fd8c0 msgr2=0x7fba5c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:05.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.271+0000 7fba63e00640 1 -- 172.21.15.3:0/979171267 shutdown_connections 2024-09-19T06:11:05.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:05.271+0000 7fba63e00640 1 -- 172.21.15.3:0/979171267 wait complete. 2024-09-19T06:11:05.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:05 smithi059 ceph-mon[35138]: pgmap v335: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:05.542 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:05.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:05 smithi003 ceph-mon[30893]: pgmap v335: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:05.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:05 smithi071 ceph-mon[35662]: pgmap v335: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:06.424 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:06 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/979171267' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T06:11:06.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:06 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/979171267' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T06:11:06.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:06 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/979171267' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T06:11:06.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.643+0000 7efc0d200640 1 -- 172.21.15.3:0/2709320860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc081079a0 msgr2=0x7efc08107d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:06.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.643+0000 7efc0d200640 1 --2- 172.21.15.3:0/2709320860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc081079a0 0x7efc08107d80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efbf8009930 tx=0x7efbf802a420 comp rx=0 tx=0).stop 2024-09-19T06:11:06.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.643+0000 7efc0d200640 1 -- 172.21.15.3:0/2709320860 shutdown_connections 2024-09-19T06:11:06.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.643+0000 7efc0d200640 1 --2- 172.21.15.3:0/2709320860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc08102340 0x7efc0810e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:06.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.643+0000 7efc0d200640 1 --2- 172.21.15.3:0/2709320860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc081019a0 0x7efc08101e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:06.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.643+0000 7efc0d200640 1 --2- 172.21.15.3:0/2709320860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc081079a0 0x7efc08107d80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:06.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.643+0000 7efc0d200640 1 -- 172.21.15.3:0/2709320860 >> 172.21.15.3:0/2709320860 conn(0x7efc080fd700 msgr2=0x7efc080ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:06.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.643+0000 7efc0d200640 1 -- 172.21.15.3:0/2709320860 shutdown_connections 2024-09-19T06:11:06.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.643+0000 7efc0d200640 1 -- 172.21.15.3:0/2709320860 wait complete. 2024-09-19T06:11:06.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.644+0000 7efc0d200640 1 Processor -- start 2024-09-19T06:11:06.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.644+0000 7efc0d200640 1 -- start start 2024-09-19T06:11:06.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.645+0000 7efc0d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc081019a0 0x7efc0819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:06.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.645+0000 7efc0d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc08102340 0x7efc0819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:06.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.645+0000 7efc0d200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc081079a0 0x7efc0819eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:06.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.645+0000 7efc0d200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7efc08111dc0 con 0x7efc081079a0 2024-09-19T06:11:06.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.645+0000 7efc0d200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efc08111c40 con 0x7efc081019a0 2024-09-19T06:11:06.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.645+0000 7efc0d200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efc08111f40 con 0x7efc08102340 2024-09-19T06:11:06.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.645+0000 7efc07e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc081079a0 0x7efc0819eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:06.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.645+0000 7efc07e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc081079a0 0x7efc0819eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51706/0 (socket says 172.21.15.3:51706) 2024-09-19T06:11:06.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.645+0000 7efc07e00640 1 -- 172.21.15.3:0/1393199492 learned_addr learned my addr 172.21.15.3:0/1393199492 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:06.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.645+0000 7efbffe00640 1 --2- 172.21.15.3:0/1393199492 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc08102340 0x7efc0819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:06.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.645+0000 7efc07400640 1 --2- 172.21.15.3:0/1393199492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc081019a0 0x7efc0819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:06.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.646+0000 7efc07e00640 1 -- 172.21.15.3:0/1393199492 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc08102340 msgr2=0x7efc0819aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:06.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.646+0000 7efc07e00640 1 --2- 172.21.15.3:0/1393199492 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc08102340 0x7efc0819aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:06.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.646+0000 7efc07e00640 1 -- 172.21.15.3:0/1393199492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc081019a0 msgr2=0x7efc0819a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:06.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.646+0000 7efc07e00640 1 --2- 172.21.15.3:0/1393199492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc081019a0 0x7efc0819a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:06.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.646+0000 7efc07e00640 1 -- 172.21.15.3:0/1393199492 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0819f480 con 0x7efc081079a0 2024-09-19T06:11:06.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.646+0000 7efc07e00640 1 --2- 172.21.15.3:0/1393199492 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc081079a0 0x7efc0819eda0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efc0000eb10 tx=0x7efc0000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:06.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.646+0000 7efc04c00640 1 -- 172.21.15.3:0/1393199492 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc00004b20 con 0x7efc081079a0 2024-09-19T06:11:06.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.646+0000 7efc0d200640 1 -- 172.21.15.3:0/1393199492 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc0819f770 con 0x7efc081079a0 2024-09-19T06:11:06.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.646+0000 7efc04c00640 1 -- 172.21.15.3:0/1393199492 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc00004cc0 con 0x7efc081079a0 2024-09-19T06:11:06.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.646+0000 7efc04c00640 1 -- 172.21.15.3:0/1393199492 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc00010760 con 0x7efc081079a0 2024-09-19T06:11:06.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.646+0000 7efc0d200640 1 -- 172.21.15.3:0/1393199492 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc081a7050 con 0x7efc081079a0 2024-09-19T06:11:06.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.647+0000 7efc0d200640 1 -- 172.21.15.3:0/1393199492 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc08101e00 con 0x7efc081079a0 2024-09-19T06:11:06.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.649+0000 7efc04c00640 1 -- 172.21.15.3:0/1393199492 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7efc00005020 con 0x7efc081079a0 2024-09-19T06:11:06.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.651+0000 7efc04c00640 1 --2- 172.21.15.3:0/1393199492 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7efbec0a3350 0x7efbec0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:06.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.651+0000 7efc04c00640 1 -- 172.21.15.3:0/1393199492 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7efc000cffb0 con 0x7efc081079a0 2024-09-19T06:11:06.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.651+0000 7efc07400640 1 --2- 172.21.15.3:0/1393199492 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7efbec0a3350 0x7efbec0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:06.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.652+0000 7efc07400640 1 --2- 172.21.15.3:0/1393199492 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7efbec0a3350 0x7efbec0a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efbf8006010 tx=0x7efbf8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:06.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.655+0000 7efc04c00640 1 -- 172.21.15.3:0/1393199492 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efc0009caf0 con 0x7efc081079a0 2024-09-19T06:11:06.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.846+0000 7efc0d200640 1 -- 172.21.15.3:0/1393199492 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7efc081a7380 con 0x7efc081079a0 2024-09-19T06:11:06.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.847+0000 7efc04c00640 1 -- 172.21.15.3:0/1393199492 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efc0009c3f0 con 0x7efc081079a0 2024-09-19T06:11:06.849 INFO:teuthology.orchestra.run.smithi003.stdout:55834574929 2024-09-19T06:11:06.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.849+0000 7efc0d200640 1 -- 172.21.15.3:0/1393199492 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7efbec0a3350 msgr2=0x7efbec0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:06.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.849+0000 7efc0d200640 1 --2- 172.21.15.3:0/1393199492 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7efbec0a3350 0x7efbec0a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efbf8006010 tx=0x7efbf8000bc0 comp rx=0 tx=0).stop 2024-09-19T06:11:06.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.849+0000 7efc0d200640 1 -- 172.21.15.3:0/1393199492 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc081079a0 msgr2=0x7efc0819eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:06.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.849+0000 7efc0d200640 1 --2- 172.21.15.3:0/1393199492 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc081079a0 0x7efc0819eda0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efc0000eb10 tx=0x7efc0000c2d0 comp rx=0 tx=0).stop 2024-09-19T06:11:06.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.849+0000 7efc0d200640 1 -- 172.21.15.3:0/1393199492 shutdown_connections 2024-09-19T06:11:06.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.849+0000 7efc0d200640 1 --2- 172.21.15.3:0/1393199492 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7efbec0a3350 0x7efbec0a5810 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:06.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.849+0000 7efc0d200640 1 --2- 172.21.15.3:0/1393199492 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc081079a0 0x7efc0819eda0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:06.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.849+0000 7efc0d200640 1 --2- 172.21.15.3:0/1393199492 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc08102340 0x7efc0819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:06.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.849+0000 7efc0d200640 1 --2- 172.21.15.3:0/1393199492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc081019a0 0x7efc0819a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:06.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.849+0000 7efc0d200640 1 -- 172.21.15.3:0/1393199492 >> 172.21.15.3:0/1393199492 conn(0x7efc080fd700 msgr2=0x7efc0810cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:06.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.849+0000 7efc0d200640 1 -- 172.21.15.3:0/1393199492 shutdown_connections 2024-09-19T06:11:06.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.849+0000 7efc0d200640 1 -- 172.21.15.3:0/1393199492 wait complete. 2024-09-19T06:11:06.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.872+0000 7f5969c00640 1 -- 172.21.15.3:0/3410570432 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5964102360 msgr2=0x7f596410e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:06.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.872+0000 7f5969c00640 1 --2- 172.21.15.3:0/3410570432 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5964102360 0x7f596410e890 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f595c009cd0 tx=0x7f595c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:11:06.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.872+0000 7f5969c00640 1 -- 172.21.15.3:0/3410570432 shutdown_connections 2024-09-19T06:11:06.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.872+0000 7f5969c00640 1 --2- 172.21.15.3:0/3410570432 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5964102360 0x7f596410e890 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:06.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.872+0000 7f5969c00640 1 --2- 172.21.15.3:0/3410570432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59641019c0 0x7f5964101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:06.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.872+0000 7f5969c00640 1 --2- 172.21.15.3:0/3410570432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f59641079c0 0x7f5964107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:06.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.872+0000 7f5969c00640 1 -- 172.21.15.3:0/3410570432 >> 172.21.15.3:0/3410570432 conn(0x7f59640fd740 msgr2=0x7f59640ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:06.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.872+0000 7f5969c00640 1 -- 172.21.15.3:0/3410570432 shutdown_connections 2024-09-19T06:11:06.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.872+0000 7f5969c00640 1 -- 172.21.15.3:0/3410570432 wait complete. 2024-09-19T06:11:06.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.874+0000 7f5969c00640 1 Processor -- start 2024-09-19T06:11:06.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.874+0000 7f5969c00640 1 -- start start 2024-09-19T06:11:06.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.874+0000 7f5969c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59641019c0 0x7f596419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:06.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.874+0000 7f5969c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5964102360 0x7f596419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:06.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.874+0000 7f5969c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59641079c0 0x7f596419ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:06.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.875+0000 7f5969c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5964111dc0 con 0x7f59641079c0 2024-09-19T06:11:06.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.875+0000 7f5969c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5964111c40 con 0x7f59641019c0 2024-09-19T06:11:06.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.875+0000 7f5969c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5964111f40 con 0x7f5964102360 2024-09-19T06:11:06.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.875+0000 7f5963400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5964102360 0x7f596419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:06.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.875+0000 7f5963e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59641019c0 0x7f596419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:06.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.875+0000 7f5963400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5964102360 0x7f596419aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:40504/0 (socket says 172.21.15.3:40504) 2024-09-19T06:11:06.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.875+0000 7f5963400640 1 -- 172.21.15.3:0/1254474995 learned_addr learned my addr 172.21.15.3:0/1254474995 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:06.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.875+0000 7f5963e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59641019c0 0x7f596419a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:58250/0 (socket says 172.21.15.3:58250) 2024-09-19T06:11:06.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.875+0000 7f5969200640 1 --2- 172.21.15.3:0/1254474995 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59641079c0 0x7f596419ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:06.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.875+0000 7f5963e00640 1 -- 172.21.15.3:0/1254474995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5964102360 msgr2=0x7f596419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:06.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.875+0000 7f5963e00640 1 --2- 172.21.15.3:0/1254474995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5964102360 0x7f596419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:06.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.875+0000 7f5963e00640 1 -- 172.21.15.3:0/1254474995 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59641079c0 msgr2=0x7f596419ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:06.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.875+0000 7f5963e00640 1 --2- 172.21.15.3:0/1254474995 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59641079c0 0x7f596419ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:06.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.875+0000 7f5963e00640 1 -- 172.21.15.3:0/1254474995 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596419f470 con 0x7f59641019c0 2024-09-19T06:11:06.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.876+0000 7f5963e00640 1 --2- 172.21.15.3:0/1254474995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59641019c0 0x7f596419a4c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f595400e9f0 tx=0x7f595400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:06.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.876+0000 7f5960c00640 1 -- 172.21.15.3:0/1254474995 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595400ccc0 con 0x7f59641019c0 2024-09-19T06:11:06.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.876+0000 7f5960c00640 1 -- 172.21.15.3:0/1254474995 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5954010910 con 0x7f59641019c0 2024-09-19T06:11:06.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.876+0000 7f5969c00640 1 -- 172.21.15.3:0/1254474995 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f596419f760 con 0x7f59641019c0 2024-09-19T06:11:06.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.876+0000 7f5960c00640 1 -- 172.21.15.3:0/1254474995 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5954018960 con 0x7f59641019c0 2024-09-19T06:11:06.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.876+0000 7f5969c00640 1 -- 172.21.15.3:0/1254474995 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59641a7040 con 0x7f59641019c0 2024-09-19T06:11:06.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.877+0000 7f5969c00640 1 -- 172.21.15.3:0/1254474995 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5964101e20 con 0x7f59641019c0 2024-09-19T06:11:06.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.879+0000 7f5960c00640 1 -- 172.21.15.3:0/1254474995 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f5954010ac0 con 0x7f59641019c0 2024-09-19T06:11:06.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.881+0000 7f5960c00640 1 --2- 172.21.15.3:0/1254474995 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f59480a32d0 0x7f59480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:06.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.881+0000 7f5960c00640 1 -- 172.21.15.3:0/1254474995 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f59540d02d0 con 0x7f59641019c0 2024-09-19T06:11:06.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.881+0000 7f5963400640 1 --2- 172.21.15.3:0/1254474995 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f59480a32d0 0x7f59480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:06.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.881+0000 7f5963400640 1 --2- 172.21.15.3:0/1254474995 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f59480a32d0 0x7f59480a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f596410ea80 tx=0x7f5950005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:06.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:06.883+0000 7f5960c00640 1 -- 172.21.15.3:0/1254474995 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f595409c7c0 con 0x7f59641019c0 2024-09-19T06:11:07.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:07.085+0000 7f5969c00640 1 -- 172.21.15.3:0/1254474995 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f59641a72e0 con 0x7f59641019c0 2024-09-19T06:11:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:07.086+0000 7f5960c00640 1 -- 172.21.15.3:0/1254474995 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f59540a0ac0 con 0x7f59641019c0 2024-09-19T06:11:07.088 INFO:teuthology.orchestra.run.smithi003.stdout:111669149766 2024-09-19T06:11:07.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:07.088+0000 7f5969c00640 1 -- 172.21.15.3:0/1254474995 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f59480a32d0 msgr2=0x7f59480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:07.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:07.088+0000 7f5969c00640 1 --2- 172.21.15.3:0/1254474995 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f59480a32d0 0x7f59480a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f596410ea80 tx=0x7f5950005f90 comp rx=0 tx=0).stop 2024-09-19T06:11:07.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:07.088+0000 7f5969c00640 1 -- 172.21.15.3:0/1254474995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59641019c0 msgr2=0x7f596419a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:07.090 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:07.088+0000 7f5969c00640 1 --2- 172.21.15.3:0/1254474995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59641019c0 0x7f596419a4c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f595400e9f0 tx=0x7f595400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:11:07.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:07.088+0000 7f5969c00640 1 -- 172.21.15.3:0/1254474995 shutdown_connections 2024-09-19T06:11:07.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:07.088+0000 7f5969c00640 1 --2- 172.21.15.3:0/1254474995 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f59480a32d0 0x7f59480a5790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:07.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:07.088+0000 7f5969c00640 1 --2- 172.21.15.3:0/1254474995 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59641079c0 0x7f596419ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:07.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:07.088+0000 7f5969c00640 1 --2- 172.21.15.3:0/1254474995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5964102360 0x7f596419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:07.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:07.088+0000 7f5969c00640 1 --2- 172.21.15.3:0/1254474995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59641019c0 0x7f596419a4c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:07.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:07.088+0000 7f5969c00640 1 -- 172.21.15.3:0/1254474995 >> 172.21.15.3:0/1254474995 conn(0x7f59640fd740 msgr2=0x7f596410cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:07.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:07.088+0000 7f5969c00640 1 -- 172.21.15.3:0/1254474995 shutdown_connections 2024-09-19T06:11:07.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:07.088+0000 7f5969c00640 1 -- 172.21.15.3:0/1254474995 wait complete. 2024-09-19T06:11:07.506 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:07 smithi003 ceph-mon[30893]: pgmap v336: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T06:11:07.506 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:07 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1393199492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T06:11:07.506 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:07 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1254474995' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T06:11:07.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:07 smithi059 ceph-mon[35138]: pgmap v336: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T06:11:07.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:07 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1393199492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T06:11:07.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:07 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1254474995' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T06:11:07.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:07 smithi071 ceph-mon[35662]: pgmap v336: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T06:11:07.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:07 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1393199492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T06:11:07.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:07 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1254474995' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T06:11:07.977 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574925 got 55834574929 for osd.1 2024-09-19T06:11:07.977 DEBUG:teuthology.parallel:result is None 2024-09-19T06:11:08.869 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678046 got 304942678048 for osd.10 2024-09-19T06:11:08.869 DEBUG:teuthology.parallel:result is None 2024-09-19T06:11:09.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.042+0000 7f47a2c00640 1 -- 172.21.15.3:0/954821056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f479c109120 msgr2=0x7f479c110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:09.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.042+0000 7f47a2c00640 1 --2- 172.21.15.3:0/954821056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f479c109120 0x7f479c110ca0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4794009ca0 tx=0x7f479402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:11:09.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.042+0000 7f47a2c00640 1 -- 172.21.15.3:0/954821056 shutdown_connections 2024-09-19T06:11:09.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.042+0000 7f47a2c00640 1 --2- 172.21.15.3:0/954821056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f479c109120 0x7f479c110ca0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:09.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.042+0000 7f47a2c00640 1 --2- 172.21.15.3:0/954821056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f479c1049a0 0x7f479c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:09.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.042+0000 7f47a2c00640 1 --2- 172.21.15.3:0/954821056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f479c103ff0 0x7f479c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:09.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.042+0000 7f47a2c00640 1 -- 172.21.15.3:0/954821056 >> 172.21.15.3:0/954821056 conn(0x7f479c0ffa90 msgr2=0x7f479c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:09.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.042+0000 7f47a2c00640 1 -- 172.21.15.3:0/954821056 shutdown_connections 2024-09-19T06:11:09.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.042+0000 7f47a2c00640 1 -- 172.21.15.3:0/954821056 wait complete. 2024-09-19T06:11:09.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.043+0000 7f47a2c00640 1 Processor -- start 2024-09-19T06:11:09.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.043+0000 7f47a2c00640 1 -- start start 2024-09-19T06:11:09.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.043+0000 7f47a2c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f479c103ff0 0x7f479c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:09.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.043+0000 7f47a2c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f479c1049a0 0x7f479c19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:09.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.043+0000 7f47a2c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f479c109120 0x7f479c19ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:09.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.043+0000 7f47a2c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f479c114180 con 0x7f479c109120 2024-09-19T06:11:09.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.043+0000 7f47a2c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f479c114000 con 0x7f479c103ff0 2024-09-19T06:11:09.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.043+0000 7f47a2c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f479c114300 con 0x7f479c1049a0 2024-09-19T06:11:09.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.044+0000 7f47a0c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f479c109120 0x7f479c19ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:09.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.044+0000 7f479be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f479c103ff0 0x7f479c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:09.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.044+0000 7f479be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f479c103ff0 0x7f479c19a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:58268/0 (socket says 172.21.15.3:58268) 2024-09-19T06:11:09.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.044+0000 7f4793e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f479c1049a0 0x7f479c19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:09.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.044+0000 7f47a0c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f479c109120 0x7f479c19ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51746/0 (socket says 172.21.15.3:51746) 2024-09-19T06:11:09.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.044+0000 7f479be00640 1 -- 172.21.15.3:0/4084248779 learned_addr learned my addr 172.21.15.3:0/4084248779 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:09.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.044+0000 7f47a0c00640 1 -- 172.21.15.3:0/4084248779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f479c1049a0 msgr2=0x7f479c19ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:09.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.044+0000 7f47a0c00640 1 --2- 172.21.15.3:0/4084248779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f479c1049a0 0x7f479c19ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:09.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.044+0000 7f47a0c00640 1 -- 172.21.15.3:0/4084248779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f479c103ff0 msgr2=0x7f479c19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:09.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.044+0000 7f47a0c00640 1 --2- 172.21.15.3:0/4084248779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f479c103ff0 0x7f479c19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:09.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.044+0000 7f47a0c00640 1 -- 172.21.15.3:0/4084248779 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f479c19f570 con 0x7f479c109120 2024-09-19T06:11:09.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.044+0000 7f4793e00640 1 --2- 172.21.15.3:0/4084248779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f479c1049a0 0x7f479c19ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:09.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.044+0000 7f479be00640 1 --2- 172.21.15.3:0/4084248779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f479c103ff0 0x7f479c19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:09.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.045+0000 7f47a0c00640 1 --2- 172.21.15.3:0/4084248779 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f479c109120 0x7f479c19ee90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4794005e30 tx=0x7f4794003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:09.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.045+0000 7f4799600640 1 -- 172.21.15.3:0/4084248779 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4794031650 con 0x7f479c109120 2024-09-19T06:11:09.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.045+0000 7f4799600640 1 -- 172.21.15.3:0/4084248779 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47940317f0 con 0x7f479c109120 2024-09-19T06:11:09.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.045+0000 7f4799600640 1 -- 172.21.15.3:0/4084248779 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f479402fa30 con 0x7f479c109120 2024-09-19T06:11:09.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.045+0000 7f47a2c00640 1 -- 172.21.15.3:0/4084248779 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f479c19f800 con 0x7f479c109120 2024-09-19T06:11:09.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.045+0000 7f47a2c00640 1 -- 172.21.15.3:0/4084248779 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f479c1a7140 con 0x7f479c109120 2024-09-19T06:11:09.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.046+0000 7f47a2c00640 1 -- 172.21.15.3:0/4084248779 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f479c1043d0 con 0x7f479c109120 2024-09-19T06:11:09.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.048+0000 7f4799600640 1 -- 172.21.15.3:0/4084248779 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f479402fbd0 con 0x7f479c109120 2024-09-19T06:11:09.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.049+0000 7f4799600640 1 --2- 172.21.15.3:0/4084248779 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f47800a3350 0x7f47800a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:09.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.050+0000 7f4799600640 1 -- 172.21.15.3:0/4084248779 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f47940f0c10 con 0x7f479c109120 2024-09-19T06:11:09.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.050+0000 7f479be00640 1 --2- 172.21.15.3:0/4084248779 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f47800a3350 0x7f47800a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:09.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.051+0000 7f479be00640 1 --2- 172.21.15.3:0/4084248779 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f47800a3350 0x7f47800a5810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f478c011550 tx=0x7f478c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:09.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.054+0000 7f4799600640 1 -- 172.21.15.3:0/4084248779 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f47940bd860 con 0x7f479c109120 2024-09-19T06:11:09.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.241+0000 7f47a2c00640 1 -- 172.21.15.3:0/4084248779 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f479c1a7420 con 0x7f479c109120 2024-09-19T06:11:09.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.241+0000 7f4799600640 1 -- 172.21.15.3:0/4084248779 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f47940319a0 con 0x7f479c109120 2024-09-19T06:11:09.244 INFO:teuthology.orchestra.run.smithi003.stdout:219043332145 2024-09-19T06:11:09.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.244+0000 7f47a2c00640 1 -- 172.21.15.3:0/4084248779 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f47800a3350 msgr2=0x7f47800a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:09.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.244+0000 7f47a2c00640 1 --2- 172.21.15.3:0/4084248779 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f47800a3350 0x7f47800a5810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f478c011550 tx=0x7f478c005f90 comp rx=0 tx=0).stop 2024-09-19T06:11:09.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.244+0000 7f47a2c00640 1 -- 172.21.15.3:0/4084248779 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f479c109120 msgr2=0x7f479c19ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:09.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.244+0000 7f47a2c00640 1 --2- 172.21.15.3:0/4084248779 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f479c109120 0x7f479c19ee90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4794005e30 tx=0x7f4794003f10 comp rx=0 tx=0).stop 2024-09-19T06:11:09.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.244+0000 7f47a2c00640 1 -- 172.21.15.3:0/4084248779 shutdown_connections 2024-09-19T06:11:09.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.244+0000 7f47a2c00640 1 --2- 172.21.15.3:0/4084248779 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f47800a3350 0x7f47800a5810 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:09.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.244+0000 7f47a2c00640 1 --2- 172.21.15.3:0/4084248779 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f479c109120 0x7f479c19ee90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:09.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.244+0000 7f47a2c00640 1 --2- 172.21.15.3:0/4084248779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f479c1049a0 0x7f479c19ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:09.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.244+0000 7f47a2c00640 1 --2- 172.21.15.3:0/4084248779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f479c103ff0 0x7f479c19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:09.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.244+0000 7f47a2c00640 1 -- 172.21.15.3:0/4084248779 >> 172.21.15.3:0/4084248779 conn(0x7f479c0ffa90 msgr2=0x7f479c1004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:09.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.244+0000 7f47a2c00640 1 -- 172.21.15.3:0/4084248779 shutdown_connections 2024-09-19T06:11:09.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.244+0000 7f47a2c00640 1 -- 172.21.15.3:0/4084248779 wait complete. 2024-09-19T06:11:09.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:09 smithi059 ceph-mon[35138]: pgmap v337: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-19T06:11:09.558 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:09 smithi003 ceph-mon[30893]: pgmap v337: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-19T06:11:09.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:09 smithi071 ceph-mon[35662]: pgmap v337: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-19T06:11:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.556+0000 7f9761800640 1 -- 172.21.15.3:0/4196054517 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f975c1049a0 msgr2=0x7f975c1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.556+0000 7f9761800640 1 --2- 172.21.15.3:0/4196054517 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f975c1049a0 0x7f975c1089f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9744009900 tx=0x7f974402a410 comp rx=0 tx=0).stop 2024-09-19T06:11:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.556+0000 7f9761800640 1 -- 172.21.15.3:0/4196054517 shutdown_connections 2024-09-19T06:11:09.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.556+0000 7f9761800640 1 --2- 172.21.15.3:0/4196054517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f975c109120 0x7f975c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:09.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.556+0000 7f9761800640 1 --2- 172.21.15.3:0/4196054517 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f975c1049a0 0x7f975c1089f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:09.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.556+0000 7f9761800640 1 --2- 172.21.15.3:0/4196054517 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f975c103ff0 0x7f975c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:09.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.556+0000 7f9761800640 1 -- 172.21.15.3:0/4196054517 >> 172.21.15.3:0/4196054517 conn(0x7f975c0ffa90 msgr2=0x7f975c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:09.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.556+0000 7f9761800640 1 -- 172.21.15.3:0/4196054517 shutdown_connections 2024-09-19T06:11:09.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.556+0000 7f9761800640 1 -- 172.21.15.3:0/4196054517 wait complete. 2024-09-19T06:11:09.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.558+0000 7f9761800640 1 Processor -- start 2024-09-19T06:11:09.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.558+0000 7f9761800640 1 -- start start 2024-09-19T06:11:09.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.559+0000 7f9761800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f975c103ff0 0x7f975c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:09.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.559+0000 7f9761800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f975c1049a0 0x7f975c19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:09.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.559+0000 7f9761800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f975c109120 0x7f975c19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:09.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.559+0000 7f9761800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f975c114140 con 0x7f975c109120 2024-09-19T06:11:09.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.559+0000 7f9761800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f975c113fc0 con 0x7f975c1049a0 2024-09-19T06:11:09.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.559+0000 7f9761800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f975c1142c0 con 0x7f975c103ff0 2024-09-19T06:11:09.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.559+0000 7f975aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f975c103ff0 0x7f975c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:09.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.559+0000 7f975aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f975c103ff0 0x7f975c19a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:40540/0 (socket says 172.21.15.3:40540) 2024-09-19T06:11:09.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.559+0000 7f975aa00640 1 -- 172.21.15.3:0/2145107594 learned_addr learned my addr 172.21.15.3:0/2145107594 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:09.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.559+0000 7f9753e00640 1 --2- 172.21.15.3:0/2145107594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f975c1049a0 0x7f975c19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:09.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.559+0000 7f975b400640 1 --2- 172.21.15.3:0/2145107594 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f975c109120 0x7f975c19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:09.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.559+0000 7f975aa00640 1 -- 172.21.15.3:0/2145107594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f975c1049a0 msgr2=0x7f975c19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:09.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.559+0000 7f975aa00640 1 --2- 172.21.15.3:0/2145107594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f975c1049a0 0x7f975c19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:09.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.559+0000 7f975aa00640 1 -- 172.21.15.3:0/2145107594 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f975c109120 msgr2=0x7f975c19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:09.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.559+0000 7f975aa00640 1 --2- 172.21.15.3:0/2145107594 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f975c109120 0x7f975c19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:09.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.559+0000 7f975aa00640 1 -- 172.21.15.3:0/2145107594 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975c19f5d0 con 0x7f975c103ff0 2024-09-19T06:11:09.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.559+0000 7f975b400640 1 --2- 172.21.15.3:0/2145107594 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f975c109120 0x7f975c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:11:09.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.560+0000 7f975aa00640 1 --2- 172.21.15.3:0/2145107594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f975c103ff0 0x7f975c19a620 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f974c00e9f0 tx=0x7f974c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:09.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.560+0000 7f9753400640 1 -- 172.21.15.3:0/2145107594 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c00cd80 con 0x7f975c103ff0 2024-09-19T06:11:09.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.560+0000 7f9753400640 1 -- 172.21.15.3:0/2145107594 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f974c005500 con 0x7f975c103ff0 2024-09-19T06:11:09.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.560+0000 7f9761800640 1 -- 172.21.15.3:0/2145107594 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f975c19f8c0 con 0x7f975c103ff0 2024-09-19T06:11:09.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.560+0000 7f9753400640 1 -- 172.21.15.3:0/2145107594 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c010690 con 0x7f975c103ff0 2024-09-19T06:11:09.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.560+0000 7f9761800640 1 -- 172.21.15.3:0/2145107594 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f975c1a71a0 con 0x7f975c103ff0 2024-09-19T06:11:09.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.562+0000 7f9761800640 1 -- 172.21.15.3:0/2145107594 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f975c1043d0 con 0x7f975c103ff0 2024-09-19T06:11:09.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.563+0000 7f9753400640 1 -- 172.21.15.3:0/2145107594 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f974c0046c0 con 0x7f975c103ff0 2024-09-19T06:11:09.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.564+0000 7f9753400640 1 --2- 172.21.15.3:0/2145107594 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f97400a32d0 0x7f97400a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:09.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.565+0000 7f9753400640 1 -- 172.21.15.3:0/2145107594 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f974c0cffb0 con 0x7f975c103ff0 2024-09-19T06:11:09.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.565+0000 7f9753e00640 1 --2- 172.21.15.3:0/2145107594 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f97400a32d0 0x7f97400a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:09.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.565+0000 7f9753e00640 1 --2- 172.21.15.3:0/2145107594 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f97400a32d0 0x7f97400a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9744009230 tx=0x7f97440058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:09.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.568+0000 7f9753400640 1 -- 172.21.15.3:0/2145107594 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f974c09caf0 con 0x7f975c103ff0 2024-09-19T06:11:09.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.760+0000 7f9761800640 1 -- 172.21.15.3:0/2145107594 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f975c10c360 con 0x7f975c103ff0 2024-09-19T06:11:09.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.761+0000 7f9753400640 1 -- 172.21.15.3:0/2145107594 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f974c09c3f0 con 0x7f975c103ff0 2024-09-19T06:11:09.763 INFO:teuthology.orchestra.run.smithi003.stdout:34359738455 2024-09-19T06:11:09.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.763+0000 7f9761800640 1 -- 172.21.15.3:0/2145107594 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f97400a32d0 msgr2=0x7f97400a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:09.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.763+0000 7f9761800640 1 --2- 172.21.15.3:0/2145107594 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f97400a32d0 0x7f97400a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9744009230 tx=0x7f97440058d0 comp rx=0 tx=0).stop 2024-09-19T06:11:09.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.763+0000 7f9761800640 1 -- 172.21.15.3:0/2145107594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f975c103ff0 msgr2=0x7f975c19a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:09.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.763+0000 7f9761800640 1 --2- 172.21.15.3:0/2145107594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f975c103ff0 0x7f975c19a620 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f974c00e9f0 tx=0x7f974c00edf0 comp rx=0 tx=0).stop 2024-09-19T06:11:09.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.763+0000 7f9761800640 1 -- 172.21.15.3:0/2145107594 shutdown_connections 2024-09-19T06:11:09.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.763+0000 7f9761800640 1 --2- 172.21.15.3:0/2145107594 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f97400a32d0 0x7f97400a5790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:09.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.763+0000 7f9761800640 1 --2- 172.21.15.3:0/2145107594 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f975c109120 0x7f975c19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:09.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.763+0000 7f9761800640 1 --2- 172.21.15.3:0/2145107594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f975c1049a0 0x7f975c19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:09.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.763+0000 7f9761800640 1 --2- 172.21.15.3:0/2145107594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f975c103ff0 0x7f975c19a620 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:09.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.763+0000 7f9761800640 1 -- 172.21.15.3:0/2145107594 >> 172.21.15.3:0/2145107594 conn(0x7f975c0ffa90 msgr2=0x7f975c100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:09.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.763+0000 7f9761800640 1 -- 172.21.15.3:0/2145107594 shutdown_connections 2024-09-19T06:11:09.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:09.763+0000 7f9761800640 1 -- 172.21.15.3:0/2145107594 wait complete. 2024-09-19T06:11:10.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:10 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/4084248779' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T06:11:10.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:10 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2145107594' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T06:11:10.541 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:10 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/4084248779' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T06:11:10.541 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:10 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2145107594' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T06:11:10.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:10 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/4084248779' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T06:11:10.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:10 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2145107594' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T06:11:10.591 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149763 got 111669149766 for osd.3 2024-09-19T06:11:10.591 DEBUG:teuthology.parallel:result is None 2024-09-19T06:11:11.298 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738453 got 34359738455 for osd.0 2024-09-19T06:11:11.299 DEBUG:teuthology.parallel:result is None 2024-09-19T06:11:11.380 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:11 smithi003 ceph-mon[30893]: pgmap v338: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-19T06:11:11.380 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:11 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1766420765' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T06:11:11.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:11 smithi059 ceph-mon[35138]: pgmap v338: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-19T06:11:11.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:11 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1766420765' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T06:11:11.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:11 smithi071 ceph-mon[35662]: pgmap v338: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-19T06:11:11.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:11 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1766420765' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T06:11:11.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.926+0000 7fcfada00640 1 -- 172.21.15.3:0/2032474452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfa810e260 msgr2=0x7fcfa8110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:11.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.926+0000 7fcfada00640 1 --2- 172.21.15.3:0/2032474452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfa810e260 0x7fcfa8110650 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0009ca0 tx=0x7fcfa002a950 comp rx=0 tx=0).stop 2024-09-19T06:11:11.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.926+0000 7fcfada00640 1 -- 172.21.15.3:0/2032474452 shutdown_connections 2024-09-19T06:11:11.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.926+0000 7fcfada00640 1 --2- 172.21.15.3:0/2032474452 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfa810e260 0x7fcfa8110650 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:11.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.926+0000 7fcfada00640 1 --2- 172.21.15.3:0/2032474452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfa8074ee0 0x7fcfa810dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:11.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.926+0000 7fcfada00640 1 --2- 172.21.15.3:0/2032474452 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcfa80745c0 0x7fcfa80749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:11.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.926+0000 7fcfada00640 1 -- 172.21.15.3:0/2032474452 >> 172.21.15.3:0/2032474452 conn(0x7fcfa80fd740 msgr2=0x7fcfa80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:11.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.926+0000 7fcfada00640 1 -- 172.21.15.3:0/2032474452 shutdown_connections 2024-09-19T06:11:11.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.926+0000 7fcfada00640 1 -- 172.21.15.3:0/2032474452 wait complete. 2024-09-19T06:11:11.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.927+0000 7fcfada00640 1 Processor -- start 2024-09-19T06:11:11.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.927+0000 7fcfada00640 1 -- start start 2024-09-19T06:11:11.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.928+0000 7fcfada00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcfa80745c0 0x7fcfa819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:11.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.928+0000 7fcfada00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfa8074ee0 0x7fcfa819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:11.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.928+0000 7fcfada00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfa810e260 0x7fcfa819ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:11.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.928+0000 7fcfada00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa8113fc0 con 0x7fcfa80745c0 2024-09-19T06:11:11.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.928+0000 7fcfada00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa8113e40 con 0x7fcfa810e260 2024-09-19T06:11:11.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.928+0000 7fcfada00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa8114140 con 0x7fcfa8074ee0 2024-09-19T06:11:11.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.928+0000 7fcfa7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcfa80745c0 0x7fcfa819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:11.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.928+0000 7fcfa7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcfa80745c0 0x7fcfa819a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51790/0 (socket says 172.21.15.3:51790) 2024-09-19T06:11:11.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.928+0000 7fcfa7e00640 1 -- 172.21.15.3:0/1766420765 learned_addr learned my addr 172.21.15.3:0/1766420765 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:11.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.928+0000 7fcf9f400640 1 --2- 172.21.15.3:0/1766420765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfa8074ee0 0x7fcfa819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:11.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.928+0000 7fcfad000640 1 --2- 172.21.15.3:0/1766420765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfa810e260 0x7fcfa819ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:11.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.928+0000 7fcfa7e00640 1 -- 172.21.15.3:0/1766420765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfa8074ee0 msgr2=0x7fcfa819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:11.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.928+0000 7fcfa7e00640 1 --2- 172.21.15.3:0/1766420765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfa8074ee0 0x7fcfa819aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:11.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.928+0000 7fcfa7e00640 1 -- 172.21.15.3:0/1766420765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfa810e260 msgr2=0x7fcfa819ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:11.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.928+0000 7fcfa7e00640 1 --2- 172.21.15.3:0/1766420765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfa810e260 0x7fcfa819ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:11.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.928+0000 7fcfa7e00640 1 -- 172.21.15.3:0/1766420765 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa819f470 con 0x7fcfa80745c0 2024-09-19T06:11:11.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.929+0000 7fcf9f400640 1 --2- 172.21.15.3:0/1766420765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfa8074ee0 0x7fcfa819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:11.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.929+0000 7fcfa7e00640 1 --2- 172.21.15.3:0/1766420765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcfa80745c0 0x7fcfa819a4c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800ea60 tx=0x7fcf9800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:11.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.929+0000 7fcfa5600640 1 -- 172.21.15.3:0/1766420765 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf9800cde0 con 0x7fcfa80745c0 2024-09-19T06:11:11.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.929+0000 7fcfa5600640 1 -- 172.21.15.3:0/1766420765 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf980035f0 con 0x7fcfa80745c0 2024-09-19T06:11:11.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.929+0000 7fcfada00640 1 -- 172.21.15.3:0/1766420765 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfa819f760 con 0x7fcfa80745c0 2024-09-19T06:11:11.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.929+0000 7fcfa5600640 1 -- 172.21.15.3:0/1766420765 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf98010670 con 0x7fcfa80745c0 2024-09-19T06:11:11.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.929+0000 7fcfada00640 1 -- 172.21.15.3:0/1766420765 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfa81a7040 con 0x7fcfa80745c0 2024-09-19T06:11:11.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.930+0000 7fcfada00640 1 -- 172.21.15.3:0/1766420765 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfa80749a0 con 0x7fcfa80745c0 2024-09-19T06:11:11.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.932+0000 7fcfa5600640 1 -- 172.21.15.3:0/1766420765 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fcf980037a0 con 0x7fcfa80745c0 2024-09-19T06:11:11.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.933+0000 7fcfa5600640 1 --2- 172.21.15.3:0/1766420765 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fcf8c0a32d0 0x7fcf8c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:11.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.934+0000 7fcfa5600640 1 -- 172.21.15.3:0/1766420765 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fcf980cfe50 con 0x7fcfa80745c0 2024-09-19T06:11:11.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.934+0000 7fcf9f400640 1 --2- 172.21.15.3:0/1766420765 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fcf8c0a32d0 0x7fcf8c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:11.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.934+0000 7fcf9f400640 1 --2- 172.21.15.3:0/1766420765 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fcf8c0a32d0 0x7fcf8c0a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8110b20 tx=0x7fcf90005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:11.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:10.938+0000 7fcfa5600640 1 -- 172.21.15.3:0/1766420765 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcf9809c990 con 0x7fcfa80745c0 2024-09-19T06:11:11.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:11.128+0000 7fcfada00640 1 -- 172.21.15.3:0/1766420765 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fcfa819b820 con 0x7fcfa80745c0 2024-09-19T06:11:11.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:11.128+0000 7fcfa5600640 1 -- 172.21.15.3:0/1766420765 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcf9809c290 con 0x7fcfa80745c0 2024-09-19T06:11:11.645 INFO:teuthology.orchestra.run.smithi003.stdout:249108103212 2024-09-19T06:11:11.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:11.130+0000 7fcfada00640 1 -- 172.21.15.3:0/1766420765 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fcf8c0a32d0 msgr2=0x7fcf8c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:11.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:11.130+0000 7fcfada00640 1 --2- 172.21.15.3:0/1766420765 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fcf8c0a32d0 0x7fcf8c0a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8110b20 tx=0x7fcf90005f90 comp rx=0 tx=0).stop 2024-09-19T06:11:11.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:11.130+0000 7fcfada00640 1 -- 172.21.15.3:0/1766420765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcfa80745c0 msgr2=0x7fcfa819a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:11.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:11.130+0000 7fcfada00640 1 --2- 172.21.15.3:0/1766420765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcfa80745c0 0x7fcfa819a4c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800ea60 tx=0x7fcf9800ef20 comp rx=0 tx=0).stop 2024-09-19T06:11:11.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:11.130+0000 7fcfada00640 1 -- 172.21.15.3:0/1766420765 shutdown_connections 2024-09-19T06:11:11.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:11.130+0000 7fcfada00640 1 --2- 172.21.15.3:0/1766420765 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fcf8c0a32d0 0x7fcf8c0a5790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:11.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:11.130+0000 7fcfada00640 1 --2- 172.21.15.3:0/1766420765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfa810e260 0x7fcfa819ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:11.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:11.130+0000 7fcfada00640 1 --2- 172.21.15.3:0/1766420765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcfa8074ee0 0x7fcfa819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:11.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:11.130+0000 7fcfada00640 1 --2- 172.21.15.3:0/1766420765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcfa80745c0 0x7fcfa819a4c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:11.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:11.130+0000 7fcfada00640 1 -- 172.21.15.3:0/1766420765 >> 172.21.15.3:0/1766420765 conn(0x7fcfa80fd740 msgr2=0x7fcfa80fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:11.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:11.130+0000 7fcfada00640 1 -- 172.21.15.3:0/1766420765 shutdown_connections 2024-09-19T06:11:11.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:11.130+0000 7fcfada00640 1 -- 172.21.15.3:0/1766420765 wait complete. 2024-09-19T06:11:12.406 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332143 got 219043332145 for osd.7 2024-09-19T06:11:12.406 DEBUG:teuthology.parallel:result is None 2024-09-19T06:11:13.308 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103210 got 249108103212 for osd.8 2024-09-19T06:11:13.308 DEBUG:teuthology.parallel:result is None 2024-09-19T06:11:13.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.107+0000 7ff75e400640 1 -- 172.21.15.3:0/2251596606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff758109120 msgr2=0x7ff758110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:13.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.107+0000 7ff75e400640 1 --2- 172.21.15.3:0/2251596606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff758109120 0x7ff758110ca0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff750009ca0 tx=0x7ff75002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.107+0000 7ff75e400640 1 -- 172.21.15.3:0/2251596606 shutdown_connections 2024-09-19T06:11:13.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.107+0000 7ff75e400640 1 --2- 172.21.15.3:0/2251596606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff758109120 0x7ff758110ca0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.107+0000 7ff75e400640 1 --2- 172.21.15.3:0/2251596606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7581049a0 0x7ff7581089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.107+0000 7ff75e400640 1 --2- 172.21.15.3:0/2251596606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff758103ff0 0x7ff7581043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.107+0000 7ff75e400640 1 -- 172.21.15.3:0/2251596606 >> 172.21.15.3:0/2251596606 conn(0x7ff7580ffa90 msgr2=0x7ff758101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:13.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.107+0000 7ff75e400640 1 -- 172.21.15.3:0/2251596606 shutdown_connections 2024-09-19T06:11:13.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.107+0000 7ff75e400640 1 -- 172.21.15.3:0/2251596606 wait complete. 2024-09-19T06:11:13.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.109+0000 7ff75e400640 1 Processor -- start 2024-09-19T06:11:13.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.109+0000 7ff75e400640 1 -- start start 2024-09-19T06:11:13.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.109+0000 7ff75e400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff758103ff0 0x7ff75819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:13.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.109+0000 7ff75e400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7581049a0 0x7ff75819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:13.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.109+0000 7ff75e400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff758109120 0x7ff75819eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:13.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.109+0000 7ff75e400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff7581141a0 con 0x7ff758109120 2024-09-19T06:11:13.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.109+0000 7ff75e400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff758114020 con 0x7ff758103ff0 2024-09-19T06:11:13.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.109+0000 7ff75e400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff758114320 con 0x7ff7581049a0 2024-09-19T06:11:13.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.110+0000 7ff756a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7581049a0 0x7ff75819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:13.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.110+0000 7ff756a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7581049a0 0x7ff75819ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:40580/0 (socket says 172.21.15.3:40580) 2024-09-19T06:11:13.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.110+0000 7ff757e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff758109120 0x7ff75819eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:13.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.110+0000 7ff756a00640 1 -- 172.21.15.3:0/2950256133 learned_addr learned my addr 172.21.15.3:0/2950256133 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:13.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.110+0000 7ff757400640 1 --2- 172.21.15.3:0/2950256133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff758103ff0 0x7ff75819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:13.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.110+0000 7ff756a00640 1 -- 172.21.15.3:0/2950256133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff758103ff0 msgr2=0x7ff75819a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:13.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.110+0000 7ff756a00640 1 --2- 172.21.15.3:0/2950256133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff758103ff0 0x7ff75819a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.110+0000 7ff756a00640 1 -- 172.21.15.3:0/2950256133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff758109120 msgr2=0x7ff75819eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:13.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.110+0000 7ff756a00640 1 --2- 172.21.15.3:0/2950256133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff758109120 0x7ff75819eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.110+0000 7ff756a00640 1 -- 172.21.15.3:0/2950256133 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff75819f590 con 0x7ff7581049a0 2024-09-19T06:11:13.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.110+0000 7ff757e00640 1 --2- 172.21.15.3:0/2950256133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff758109120 0x7ff75819eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:13.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.110+0000 7ff756a00640 1 --2- 172.21.15.3:0/2950256133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7581049a0 0x7ff75819ab20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff74400e9f0 tx=0x7ff74400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:13.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.111+0000 7ff74fe00640 1 -- 172.21.15.3:0/2950256133 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74400cd80 con 0x7ff7581049a0 2024-09-19T06:11:13.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.111+0000 7ff75e400640 1 -- 172.21.15.3:0/2950256133 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff75819f880 con 0x7ff7581049a0 2024-09-19T06:11:13.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.111+0000 7ff74fe00640 1 -- 172.21.15.3:0/2950256133 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff744005500 con 0x7ff7581049a0 2024-09-19T06:11:13.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.111+0000 7ff74fe00640 1 -- 172.21.15.3:0/2950256133 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff744010690 con 0x7ff7581049a0 2024-09-19T06:11:13.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.111+0000 7ff75e400640 1 -- 172.21.15.3:0/2950256133 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7581a7160 con 0x7ff7581049a0 2024-09-19T06:11:13.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.112+0000 7ff75e400640 1 -- 172.21.15.3:0/2950256133 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7581043d0 con 0x7ff7581049a0 2024-09-19T06:11:13.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.115+0000 7ff74fe00640 1 -- 172.21.15.3:0/2950256133 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7ff7440046c0 con 0x7ff7581049a0 2024-09-19T06:11:13.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.116+0000 7ff74fe00640 1 --2- 172.21.15.3:0/2950256133 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff73c0a32d0 0x7ff73c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:13.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.116+0000 7ff74fe00640 1 -- 172.21.15.3:0/2950256133 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7ff7440d00a0 con 0x7ff7581049a0 2024-09-19T06:11:13.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.116+0000 7ff757400640 1 --2- 172.21.15.3:0/2950256133 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff73c0a32d0 0x7ff73c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:13.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.117+0000 7ff757400640 1 --2- 172.21.15.3:0/2950256133 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff73c0a32d0 0x7ff73c0a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff748009bd0 tx=0x7ff748005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:13.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.117+0000 7ff74fe00640 1 -- 172.21.15.3:0/2950256133 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff744054210 con 0x7ff7581049a0 2024-09-19T06:11:13.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.304+0000 7ff75e400640 1 -- 172.21.15.3:0/2950256133 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7ff75819b940 con 0x7ff7581049a0 2024-09-19T06:11:13.533 INFO:teuthology.orchestra.run.smithi003.stdout:283467841574 2024-09-19T06:11:13.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.305+0000 7ff74fe00640 1 -- 172.21.15.3:0/2950256133 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff75819b940 con 0x7ff7581049a0 2024-09-19T06:11:13.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.307+0000 7ff75e400640 1 -- 172.21.15.3:0/2950256133 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff73c0a32d0 msgr2=0x7ff73c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:13.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.307+0000 7ff75e400640 1 --2- 172.21.15.3:0/2950256133 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff73c0a32d0 0x7ff73c0a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff748009bd0 tx=0x7ff748005f90 comp rx=0 tx=0).stop 2024-09-19T06:11:13.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.307+0000 7ff75e400640 1 -- 172.21.15.3:0/2950256133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7581049a0 msgr2=0x7ff75819ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:13.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.307+0000 7ff75e400640 1 --2- 172.21.15.3:0/2950256133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7581049a0 0x7ff75819ab20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff74400e9f0 tx=0x7ff74400edf0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.307+0000 7ff75e400640 1 -- 172.21.15.3:0/2950256133 shutdown_connections 2024-09-19T06:11:13.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.307+0000 7ff75e400640 1 --2- 172.21.15.3:0/2950256133 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff73c0a32d0 0x7ff73c0a5790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.307+0000 7ff75e400640 1 --2- 172.21.15.3:0/2950256133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff758109120 0x7ff75819eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.307+0000 7ff75e400640 1 --2- 172.21.15.3:0/2950256133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff7581049a0 0x7ff75819ab20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.307+0000 7ff75e400640 1 --2- 172.21.15.3:0/2950256133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff758103ff0 0x7ff75819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:13.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.307+0000 7ff75e400640 1 -- 172.21.15.3:0/2950256133 >> 172.21.15.3:0/2950256133 conn(0x7ff7580ffa90 msgr2=0x7ff7581004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:13.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.307+0000 7ff75e400640 1 -- 172.21.15.3:0/2950256133 shutdown_connections 2024-09-19T06:11:13.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:12.307+0000 7ff75e400640 1 -- 172.21.15.3:0/2950256133 wait complete. 2024-09-19T06:11:13.535 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:13 smithi003 ceph-mon[30893]: pgmap v339: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:13.535 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:13 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2950256133' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T06:11:13.536 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:13.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:13 smithi059 ceph-mon[35138]: pgmap v339: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:13.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:13 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2950256133' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T06:11:13.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:13 smithi071 ceph-mon[35662]: pgmap v339: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:13.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:13 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2950256133' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T06:11:14.464 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841570 got 283467841574 for osd.9 2024-09-19T06:11:14.465 DEBUG:teuthology.parallel:result is None 2024-09-19T06:11:14.487 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:14 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1719705985' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T06:11:14.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:14 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1719705985' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T06:11:14.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.542+0000 7fdb1d000640 1 -- 172.21.15.3:0/2528413546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb18103ff0 msgr2=0x7fdb181043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:14.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.542+0000 7fdb1d000640 1 --2- 172.21.15.3:0/2528413546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb18103ff0 0x7fdb181043d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdb08009900 tx=0x7fdb0802a410 comp rx=0 tx=0).stop 2024-09-19T06:11:14.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.542+0000 7fdb1d000640 1 -- 172.21.15.3:0/2528413546 shutdown_connections 2024-09-19T06:11:14.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.542+0000 7fdb1d000640 1 --2- 172.21.15.3:0/2528413546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb18109120 0x7fdb18110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:14.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.542+0000 7fdb1d000640 1 --2- 172.21.15.3:0/2528413546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb181049a0 0x7fdb181089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:14.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.542+0000 7fdb1d000640 1 --2- 172.21.15.3:0/2528413546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb18103ff0 0x7fdb181043d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:14.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.542+0000 7fdb1d000640 1 -- 172.21.15.3:0/2528413546 >> 172.21.15.3:0/2528413546 conn(0x7fdb180ffa90 msgr2=0x7fdb18101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:14.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.542+0000 7fdb1d000640 1 -- 172.21.15.3:0/2528413546 shutdown_connections 2024-09-19T06:11:14.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.542+0000 7fdb1d000640 1 -- 172.21.15.3:0/2528413546 wait complete. 2024-09-19T06:11:14.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.543+0000 7fdb1d000640 1 Processor -- start 2024-09-19T06:11:14.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.543+0000 7fdb1d000640 1 -- start start 2024-09-19T06:11:14.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.543+0000 7fdb1d000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb18103ff0 0x7fdb1819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:14.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.544+0000 7fdb1d000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb181049a0 0x7fdb1819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:14.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.544+0000 7fdb1d000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb18109120 0x7fdb1819eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:14.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.544+0000 7fdb1d000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdb18114170 con 0x7fdb181049a0 2024-09-19T06:11:14.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.544+0000 7fdb1d000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdb18113ff0 con 0x7fdb18109120 2024-09-19T06:11:14.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.544+0000 7fdb1d000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdb181142f0 con 0x7fdb18103ff0 2024-09-19T06:11:14.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.544+0000 7fdb15400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb181049a0 0x7fdb1819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:14.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.544+0000 7fdb15400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb181049a0 0x7fdb1819ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51816/0 (socket says 172.21.15.3:51816) 2024-09-19T06:11:14.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.544+0000 7fdb15400640 1 -- 172.21.15.3:0/1719705985 learned_addr learned my addr 172.21.15.3:0/1719705985 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:14.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.544+0000 7fdb15e00640 1 --2- 172.21.15.3:0/1719705985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb18103ff0 0x7fdb1819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:14.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.544+0000 7fdb16800640 1 --2- 172.21.15.3:0/1719705985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb18109120 0x7fdb1819eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:14.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.544+0000 7fdb15400640 1 -- 172.21.15.3:0/1719705985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb18103ff0 msgr2=0x7fdb1819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:14.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.544+0000 7fdb15400640 1 --2- 172.21.15.3:0/1719705985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb18103ff0 0x7fdb1819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:14.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.544+0000 7fdb15400640 1 -- 172.21.15.3:0/1719705985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb18109120 msgr2=0x7fdb1819eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:14.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.544+0000 7fdb15400640 1 --2- 172.21.15.3:0/1719705985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb18109120 0x7fdb1819eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:14.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.544+0000 7fdb15400640 1 -- 172.21.15.3:0/1719705985 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb1819f5b0 con 0x7fdb181049a0 2024-09-19T06:11:14.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.545+0000 7fdb15400640 1 --2- 172.21.15.3:0/1719705985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb181049a0 0x7fdb1819ab40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400d950 tx=0x7fdb0400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:14.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.545+0000 7fdb0ea00640 1 -- 172.21.15.3:0/1719705985 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb04017030 con 0x7fdb181049a0 2024-09-19T06:11:14.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.545+0000 7fdb1d000640 1 -- 172.21.15.3:0/1719705985 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb1819f8a0 con 0x7fdb181049a0 2024-09-19T06:11:14.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.545+0000 7fdb0ea00640 1 -- 172.21.15.3:0/1719705985 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb04004020 con 0x7fdb181049a0 2024-09-19T06:11:14.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.545+0000 7fdb0ea00640 1 -- 172.21.15.3:0/1719705985 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb040047a0 con 0x7fdb181049a0 2024-09-19T06:11:14.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.545+0000 7fdb1d000640 1 -- 172.21.15.3:0/1719705985 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb181a7180 con 0x7fdb181049a0 2024-09-19T06:11:14.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.546+0000 7fdb1d000640 1 -- 172.21.15.3:0/1719705985 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb181043d0 con 0x7fdb181049a0 2024-09-19T06:11:14.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.550+0000 7fdb0ea00640 1 -- 172.21.15.3:0/1719705985 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fdb040041d0 con 0x7fdb181049a0 2024-09-19T06:11:14.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.552+0000 7fdb0ea00640 1 --2- 172.21.15.3:0/1719705985 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fdafc0a32d0 0x7fdafc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:14.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.552+0000 7fdb0ea00640 1 -- 172.21.15.3:0/1719705985 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fdb040cf430 con 0x7fdb181049a0 2024-09-19T06:11:14.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.552+0000 7fdb15e00640 1 --2- 172.21.15.3:0/1719705985 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fdafc0a32d0 0x7fdafc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:14.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.553+0000 7fdb15e00640 1 --2- 172.21.15.3:0/1719705985 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fdafc0a32d0 0x7fdafc0a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdb08000c00 tx=0x7fdb08005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:14.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.560+0000 7fdb0ea00640 1 -- 172.21.15.3:0/1719705985 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdb0409bfd0 con 0x7fdb181049a0 2024-09-19T06:11:14.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.757+0000 7fdb1d000640 1 -- 172.21.15.3:0/1719705985 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fdb1802d7c0 con 0x7fdb181049a0 2024-09-19T06:11:14.573 INFO:teuthology.orchestra.run.smithi003.stdout:141733920835 2024-09-19T06:11:14.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.758+0000 7fdb0ea00640 1 -- 172.21.15.3:0/1719705985 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdb0409b8d0 con 0x7fdb181049a0 2024-09-19T06:11:14.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.761+0000 7fdb1d000640 1 -- 172.21.15.3:0/1719705985 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fdafc0a32d0 msgr2=0x7fdafc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:14.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.761+0000 7fdb1d000640 1 --2- 172.21.15.3:0/1719705985 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fdafc0a32d0 0x7fdafc0a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdb08000c00 tx=0x7fdb08005b50 comp rx=0 tx=0).stop 2024-09-19T06:11:14.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.761+0000 7fdb1d000640 1 -- 172.21.15.3:0/1719705985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb181049a0 msgr2=0x7fdb1819ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:14.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.761+0000 7fdb1d000640 1 --2- 172.21.15.3:0/1719705985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb181049a0 0x7fdb1819ab40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400d950 tx=0x7fdb0400de10 comp rx=0 tx=0).stop 2024-09-19T06:11:14.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.761+0000 7fdb1d000640 1 -- 172.21.15.3:0/1719705985 shutdown_connections 2024-09-19T06:11:14.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.761+0000 7fdb1d000640 1 --2- 172.21.15.3:0/1719705985 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fdafc0a32d0 0x7fdafc0a5790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:14.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.761+0000 7fdb1d000640 1 --2- 172.21.15.3:0/1719705985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb18109120 0x7fdb1819eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:14.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.761+0000 7fdb1d000640 1 --2- 172.21.15.3:0/1719705985 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb181049a0 0x7fdb1819ab40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:14.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.761+0000 7fdb1d000640 1 --2- 172.21.15.3:0/1719705985 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb18103ff0 0x7fdb1819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:14.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.761+0000 7fdb1d000640 1 -- 172.21.15.3:0/1719705985 >> 172.21.15.3:0/1719705985 conn(0x7fdb180ffa90 msgr2=0x7fdb18100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:14.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.761+0000 7fdb1d000640 1 -- 172.21.15.3:0/1719705985 shutdown_connections 2024-09-19T06:11:14.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:13.761+0000 7fdb1d000640 1 -- 172.21.15.3:0/1719705985 wait complete. 2024-09-19T06:11:14.574 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:14 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1719705985' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T06:11:14.806 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:14.806 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:15.332 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:15.350 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920831 got 141733920835 for osd.4 2024-09-19T06:11:15.351 DEBUG:teuthology.parallel:result is None 2024-09-19T06:11:15.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:15 smithi059 ceph-mon[35138]: pgmap v340: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:15.568 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:15 smithi003 ceph-mon[30893]: pgmap v340: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:15.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:15 smithi071 ceph-mon[35662]: pgmap v340: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:16.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.471+0000 7fda4c200640 1 -- 172.21.15.3:0/743298684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda44103ff0 msgr2=0x7fda441043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:16.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.471+0000 7fda4c200640 1 --2- 172.21.15.3:0/743298684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda44103ff0 0x7fda441043d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fda38009860 tx=0x7fda3802a340 comp rx=0 tx=0).stop 2024-09-19T06:11:16.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.472+0000 7fda4c200640 1 -- 172.21.15.3:0/743298684 shutdown_connections 2024-09-19T06:11:16.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.472+0000 7fda4c200640 1 --2- 172.21.15.3:0/743298684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda44109120 0x7fda44110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:16.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.472+0000 7fda4c200640 1 --2- 172.21.15.3:0/743298684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda441049a0 0x7fda441089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:16.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.472+0000 7fda4c200640 1 --2- 172.21.15.3:0/743298684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda44103ff0 0x7fda441043d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:16.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.472+0000 7fda4c200640 1 -- 172.21.15.3:0/743298684 >> 172.21.15.3:0/743298684 conn(0x7fda440ffa90 msgr2=0x7fda44101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:16.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.472+0000 7fda4c200640 1 -- 172.21.15.3:0/743298684 shutdown_connections 2024-09-19T06:11:16.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.472+0000 7fda4c200640 1 -- 172.21.15.3:0/743298684 wait complete. 2024-09-19T06:11:16.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.473+0000 7fda4c200640 1 Processor -- start 2024-09-19T06:11:16.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.473+0000 7fda4c200640 1 -- start start 2024-09-19T06:11:16.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.473+0000 7fda4c200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda44103ff0 0x7fda4419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:16.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.473+0000 7fda4c200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda441049a0 0x7fda4419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:16.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.473+0000 7fda4c200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda44109120 0x7fda4419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:16.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.473+0000 7fda4c200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fda44114120 con 0x7fda44109120 2024-09-19T06:11:16.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.473+0000 7fda4c200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fda44113fa0 con 0x7fda441049a0 2024-09-19T06:11:16.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.473+0000 7fda4c200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fda441142a0 con 0x7fda44103ff0 2024-09-19T06:11:16.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.474+0000 7fda49800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda44103ff0 0x7fda4419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:16.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.474+0000 7fda4a200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda44109120 0x7fda4419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:16.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.474+0000 7fda48e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda441049a0 0x7fda4419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:16.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.474+0000 7fda49800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda44103ff0 0x7fda4419a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:57552/0 (socket says 172.21.15.3:57552) 2024-09-19T06:11:16.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.474+0000 7fda49800640 1 -- 172.21.15.3:0/2684735800 learned_addr learned my addr 172.21.15.3:0/2684735800 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:16.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.474+0000 7fda49800640 1 -- 172.21.15.3:0/2684735800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda441049a0 msgr2=0x7fda4419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:16.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.474+0000 7fda49800640 1 --2- 172.21.15.3:0/2684735800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda441049a0 0x7fda4419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:16.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.474+0000 7fda49800640 1 -- 172.21.15.3:0/2684735800 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda44109120 msgr2=0x7fda4419eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:16.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.474+0000 7fda49800640 1 --2- 172.21.15.3:0/2684735800 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda44109120 0x7fda4419eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:16.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.474+0000 7fda49800640 1 -- 172.21.15.3:0/2684735800 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda4419f5d0 con 0x7fda44103ff0 2024-09-19T06:11:16.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.474+0000 7fda48e00640 1 --2- 172.21.15.3:0/2684735800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda441049a0 0x7fda4419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:16.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.474+0000 7fda49800640 1 --2- 172.21.15.3:0/2684735800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda44103ff0 0x7fda4419a620 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fda38035040 tx=0x7fda38033d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:16.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.475+0000 7fda42000640 1 -- 172.21.15.3:0/2684735800 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda3803f020 con 0x7fda44103ff0 2024-09-19T06:11:16.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.475+0000 7fda4c200640 1 -- 172.21.15.3:0/2684735800 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda4419f860 con 0x7fda44103ff0 2024-09-19T06:11:16.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.475+0000 7fda42000640 1 -- 172.21.15.3:0/2684735800 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda38032770 con 0x7fda44103ff0 2024-09-19T06:11:16.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.475+0000 7fda42000640 1 -- 172.21.15.3:0/2684735800 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda38037040 con 0x7fda44103ff0 2024-09-19T06:11:16.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.475+0000 7fda4c200640 1 -- 172.21.15.3:0/2684735800 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda441a71a0 con 0x7fda44103ff0 2024-09-19T06:11:16.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.476+0000 7fda4c200640 1 -- 172.21.15.3:0/2684735800 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda441043d0 con 0x7fda44103ff0 2024-09-19T06:11:16.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.478+0000 7fda42000640 1 -- 172.21.15.3:0/2684735800 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fda38042020 con 0x7fda44103ff0 2024-09-19T06:11:16.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.479+0000 7fda42000640 1 --2- 172.21.15.3:0/2684735800 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fda2c0a32d0 0x7fda2c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:16.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.479+0000 7fda42000640 1 -- 172.21.15.3:0/2684735800 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fda380ef830 con 0x7fda44103ff0 2024-09-19T06:11:16.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.479+0000 7fda48e00640 1 --2- 172.21.15.3:0/2684735800 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fda2c0a32d0 0x7fda2c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:16.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.480+0000 7fda48e00640 1 --2- 172.21.15.3:0/2684735800 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fda2c0a32d0 0x7fda2c0a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fda300096c0 tx=0x7fda30009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:16.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.481+0000 7fda42000640 1 -- 172.21.15.3:0/2684735800 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fda38049030 con 0x7fda44103ff0 2024-09-19T06:11:16.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.684+0000 7fda4c200640 1 -- 172.21.15.3:0/2684735800 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fda4410c300 con 0x7fda44103ff0 2024-09-19T06:11:16.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.685+0000 7fda42000640 1 -- 172.21.15.3:0/2684735800 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fda380bc500 con 0x7fda44103ff0 2024-09-19T06:11:16.688 INFO:teuthology.orchestra.run.smithi003.stdout:163208757310 2024-09-19T06:11:16.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.688+0000 7fda4c200640 1 -- 172.21.15.3:0/2684735800 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fda2c0a32d0 msgr2=0x7fda2c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:16.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.688+0000 7fda4c200640 1 --2- 172.21.15.3:0/2684735800 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fda2c0a32d0 0x7fda2c0a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fda300096c0 tx=0x7fda30009260 comp rx=0 tx=0).stop 2024-09-19T06:11:16.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.688+0000 7fda4c200640 1 -- 172.21.15.3:0/2684735800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda44103ff0 msgr2=0x7fda4419a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:16.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.688+0000 7fda4c200640 1 --2- 172.21.15.3:0/2684735800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda44103ff0 0x7fda4419a620 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fda38035040 tx=0x7fda38033d90 comp rx=0 tx=0).stop 2024-09-19T06:11:16.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.688+0000 7fda4c200640 1 -- 172.21.15.3:0/2684735800 shutdown_connections 2024-09-19T06:11:16.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.688+0000 7fda4c200640 1 --2- 172.21.15.3:0/2684735800 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fda2c0a32d0 0x7fda2c0a5790 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:16.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.688+0000 7fda4c200640 1 --2- 172.21.15.3:0/2684735800 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda44109120 0x7fda4419eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:16.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.688+0000 7fda4c200640 1 --2- 172.21.15.3:0/2684735800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda441049a0 0x7fda4419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:16.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.688+0000 7fda4c200640 1 --2- 172.21.15.3:0/2684735800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda44103ff0 0x7fda4419a620 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:16.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.688+0000 7fda4c200640 1 -- 172.21.15.3:0/2684735800 >> 172.21.15.3:0/2684735800 conn(0x7fda440ffa90 msgr2=0x7fda44100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:16.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.689+0000 7fda4c200640 1 -- 172.21.15.3:0/2684735800 shutdown_connections 2024-09-19T06:11:16.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.689+0000 7fda4c200640 1 -- 172.21.15.3:0/2684735800 wait complete. 2024-09-19T06:11:16.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.724+0000 7f058ca00640 1 -- 172.21.15.3:0/1215772982 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05880745c0 msgr2=0x7f05880749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:16.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.724+0000 7f058ca00640 1 --2- 172.21.15.3:0/1215772982 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05880745c0 0x7f05880749a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0578009900 tx=0x7f057802a480 comp rx=0 tx=0).stop 2024-09-19T06:11:16.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.725+0000 7f058ca00640 1 -- 172.21.15.3:0/1215772982 shutdown_connections 2024-09-19T06:11:16.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.725+0000 7f058ca00640 1 --2- 172.21.15.3:0/1215772982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058810e260 0x7f0588110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:16.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.725+0000 7f058ca00640 1 --2- 172.21.15.3:0/1215772982 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0588074ee0 0x7f058810dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:16.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.725+0000 7f058ca00640 1 --2- 172.21.15.3:0/1215772982 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f05880745c0 0x7f05880749a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:16.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.725+0000 7f058ca00640 1 -- 172.21.15.3:0/1215772982 >> 172.21.15.3:0/1215772982 conn(0x7f05880fd740 msgr2=0x7f05880ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:16.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.725+0000 7f058ca00640 1 -- 172.21.15.3:0/1215772982 shutdown_connections 2024-09-19T06:11:16.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.725+0000 7f058ca00640 1 -- 172.21.15.3:0/1215772982 wait complete. 2024-09-19T06:11:16.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.726+0000 7f058ca00640 1 Processor -- start 2024-09-19T06:11:16.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.726+0000 7f058ca00640 1 -- start start 2024-09-19T06:11:16.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.726+0000 7f058ca00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f05880745c0 0x7f058819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:16.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.726+0000 7f058ca00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0588074ee0 0x7f058819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:16.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.726+0000 7f058ca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058810e260 0x7f058819ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:16.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.726+0000 7f058ca00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0588114000 con 0x7f05880745c0 2024-09-19T06:11:16.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.726+0000 7f058ca00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0588113e80 con 0x7f058810e260 2024-09-19T06:11:16.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.726+0000 7f058ca00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0588114180 con 0x7f0588074ee0 2024-09-19T06:11:16.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.727+0000 7f057fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0588074ee0 0x7f058819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:16.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.727+0000 7f0587400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f05880745c0 0x7f058819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:16.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.727+0000 7f057fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0588074ee0 0x7f058819aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:57568/0 (socket says 172.21.15.3:57568) 2024-09-19T06:11:16.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.727+0000 7f057fe00640 1 -- 172.21.15.3:0/577492047 learned_addr learned my addr 172.21.15.3:0/577492047 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:16.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.727+0000 7f0587e00640 1 --2- 172.21.15.3:0/577492047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058810e260 0x7f058819ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:16.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.727+0000 7f057fe00640 1 -- 172.21.15.3:0/577492047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058810e260 msgr2=0x7f058819ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:16.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.727+0000 7f057fe00640 1 --2- 172.21.15.3:0/577492047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058810e260 0x7f058819ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:16.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.727+0000 7f057fe00640 1 -- 172.21.15.3:0/577492047 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f05880745c0 msgr2=0x7f058819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:16.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.727+0000 7f057fe00640 1 --2- 172.21.15.3:0/577492047 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f05880745c0 0x7f058819a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:16.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.727+0000 7f057fe00640 1 -- 172.21.15.3:0/577492047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058819f550 con 0x7f0588074ee0 2024-09-19T06:11:16.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.727+0000 7f0587e00640 1 --2- 172.21.15.3:0/577492047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058810e260 0x7f058819ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:11:16.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.727+0000 7f0587400640 1 --2- 172.21.15.3:0/577492047 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f05880745c0 0x7f058819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:16.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.727+0000 7f057fe00640 1 --2- 172.21.15.3:0/577492047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0588074ee0 0x7f058819aae0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f057000e9f0 tx=0x7f057000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:16.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.728+0000 7f0584c00640 1 -- 172.21.15.3:0/577492047 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057000cd80 con 0x7f0588074ee0 2024-09-19T06:11:16.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.728+0000 7f058ca00640 1 -- 172.21.15.3:0/577492047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f058819f840 con 0x7f0588074ee0 2024-09-19T06:11:16.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.728+0000 7f0584c00640 1 -- 172.21.15.3:0/577492047 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0570010910 con 0x7f0588074ee0 2024-09-19T06:11:16.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.728+0000 7f0584c00640 1 -- 172.21.15.3:0/577492047 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05700188f0 con 0x7f0588074ee0 2024-09-19T06:11:16.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.728+0000 7f058ca00640 1 -- 172.21.15.3:0/577492047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05881a7120 con 0x7f0588074ee0 2024-09-19T06:11:16.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.729+0000 7f058ca00640 1 -- 172.21.15.3:0/577492047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05880749a0 con 0x7f0588074ee0 2024-09-19T06:11:16.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.732+0000 7f0584c00640 1 -- 172.21.15.3:0/577492047 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f0570010ac0 con 0x7f0588074ee0 2024-09-19T06:11:16.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.733+0000 7f0584c00640 1 --2- 172.21.15.3:0/577492047 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f056c0a3350 0x7f056c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:16.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.733+0000 7f0584c00640 1 -- 172.21.15.3:0/577492047 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f05700d01d0 con 0x7f0588074ee0 2024-09-19T06:11:16.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.733+0000 7f0587400640 1 --2- 172.21.15.3:0/577492047 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f056c0a3350 0x7f056c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:16.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.734+0000 7f0587400640 1 --2- 172.21.15.3:0/577492047 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f056c0a3350 0x7f056c0a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0578000c00 tx=0x7f0578031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:16.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.734+0000 7f0584c00640 1 -- 172.21.15.3:0/577492047 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f057009cd10 con 0x7f0588074ee0 2024-09-19T06:11:16.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.928+0000 7f058ca00640 1 -- 172.21.15.3:0/577492047 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f058819b900 con 0x7f0588074ee0 2024-09-19T06:11:16.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.929+0000 7f0584c00640 1 -- 172.21.15.3:0/577492047 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f057009c610 con 0x7f0588074ee0 2024-09-19T06:11:16.931 INFO:teuthology.orchestra.run.smithi003.stdout:77309411408 2024-09-19T06:11:16.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.931+0000 7f058ca00640 1 -- 172.21.15.3:0/577492047 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f056c0a3350 msgr2=0x7f056c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:16.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.931+0000 7f058ca00640 1 --2- 172.21.15.3:0/577492047 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f056c0a3350 0x7f056c0a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0578000c00 tx=0x7f0578031510 comp rx=0 tx=0).stop 2024-09-19T06:11:16.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.931+0000 7f058ca00640 1 -- 172.21.15.3:0/577492047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0588074ee0 msgr2=0x7f058819aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:16.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.931+0000 7f058ca00640 1 --2- 172.21.15.3:0/577492047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0588074ee0 0x7f058819aae0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f057000e9f0 tx=0x7f057000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:11:16.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.931+0000 7f058ca00640 1 -- 172.21.15.3:0/577492047 shutdown_connections 2024-09-19T06:11:16.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.931+0000 7f058ca00640 1 --2- 172.21.15.3:0/577492047 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f056c0a3350 0x7f056c0a5810 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:16.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.931+0000 7f058ca00640 1 --2- 172.21.15.3:0/577492047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058810e260 0x7f058819ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:16.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.931+0000 7f058ca00640 1 --2- 172.21.15.3:0/577492047 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0588074ee0 0x7f058819aae0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:16.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.931+0000 7f058ca00640 1 --2- 172.21.15.3:0/577492047 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f05880745c0 0x7f058819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:16.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.931+0000 7f058ca00640 1 -- 172.21.15.3:0/577492047 >> 172.21.15.3:0/577492047 conn(0x7f05880fd740 msgr2=0x7f05880fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:16.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.931+0000 7f058ca00640 1 -- 172.21.15.3:0/577492047 shutdown_connections 2024-09-19T06:11:16.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.931+0000 7f058ca00640 1 -- 172.21.15.3:0/577492047 wait complete. 2024-09-19T06:11:17.517 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:17 smithi003 ceph-mon[30893]: pgmap v341: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:11:17.517 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:17 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2775067845' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T06:11:17.517 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:17 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2684735800' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T06:11:17.517 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:17 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/577492047' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T06:11:17.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:17 smithi059 ceph-mon[35138]: pgmap v341: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:11:17.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:17 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2775067845' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T06:11:17.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:17 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2684735800' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T06:11:17.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:17 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/577492047' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T06:11:17.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:17 smithi071 ceph-mon[35662]: pgmap v341: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:11:17.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:17 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2775067845' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T06:11:17.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:17 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2684735800' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T06:11:17.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:17 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/577492047' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T06:11:17.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.627+0000 7f77c0200640 1 -- 172.21.15.3:0/117353656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77b8103ff0 msgr2=0x7f77b81043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:17.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.627+0000 7f77c0200640 1 --2- 172.21.15.3:0/117353656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77b8103ff0 0x7f77b81043d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009900 tx=0x7f77ac02a410 comp rx=0 tx=0).stop 2024-09-19T06:11:17.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.627+0000 7f77c0200640 1 -- 172.21.15.3:0/117353656 shutdown_connections 2024-09-19T06:11:17.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.627+0000 7f77c0200640 1 --2- 172.21.15.3:0/117353656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77b8109120 0x7f77b8110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:17.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.627+0000 7f77c0200640 1 --2- 172.21.15.3:0/117353656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77b81049a0 0x7f77b81089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:17.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.627+0000 7f77c0200640 1 --2- 172.21.15.3:0/117353656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77b8103ff0 0x7f77b81043d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:17.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.627+0000 7f77c0200640 1 -- 172.21.15.3:0/117353656 >> 172.21.15.3:0/117353656 conn(0x7f77b80ffa90 msgr2=0x7f77b8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:17.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.627+0000 7f77c0200640 1 -- 172.21.15.3:0/117353656 shutdown_connections 2024-09-19T06:11:17.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.627+0000 7f77c0200640 1 -- 172.21.15.3:0/117353656 wait complete. 2024-09-19T06:11:17.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.629+0000 7f77c0200640 1 Processor -- start 2024-09-19T06:11:17.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.629+0000 7f77c0200640 1 -- start start 2024-09-19T06:11:17.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.629+0000 7f77c0200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77b8103ff0 0x7f77b819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:17.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.629+0000 7f77c0200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77b81049a0 0x7f77b819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:17.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.629+0000 7f77c0200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77b8109120 0x7f77b819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:17.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.629+0000 7f77c0200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f77b81141a0 con 0x7f77b8109120 2024-09-19T06:11:17.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.629+0000 7f77c0200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f77b8114020 con 0x7f77b8103ff0 2024-09-19T06:11:17.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.629+0000 7f77c0200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f77b8114320 con 0x7f77b81049a0 2024-09-19T06:11:17.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.629+0000 7f77be200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77b8109120 0x7f77b819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:17.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.629+0000 7f77bce00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77b81049a0 0x7f77b819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:17.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.629+0000 7f77bce00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77b81049a0 0x7f77b819ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:57586/0 (socket says 172.21.15.3:57586) 2024-09-19T06:11:17.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.629+0000 7f77bce00640 1 -- 172.21.15.3:0/670944550 learned_addr learned my addr 172.21.15.3:0/670944550 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:17.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.630+0000 7f77bd800640 1 --2- 172.21.15.3:0/670944550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77b8103ff0 0x7f77b819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:17.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.630+0000 7f77be200640 1 -- 172.21.15.3:0/670944550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77b81049a0 msgr2=0x7f77b819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:17.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.630+0000 7f77be200640 1 --2- 172.21.15.3:0/670944550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77b81049a0 0x7f77b819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:17.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.630+0000 7f77be200640 1 -- 172.21.15.3:0/670944550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77b8103ff0 msgr2=0x7f77b819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:17.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.630+0000 7f77be200640 1 --2- 172.21.15.3:0/670944550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77b8103ff0 0x7f77b819a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:17.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.630+0000 7f77be200640 1 -- 172.21.15.3:0/670944550 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b819f5d0 con 0x7f77b8109120 2024-09-19T06:11:17.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.630+0000 7f77be200640 1 --2- 172.21.15.3:0/670944550 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77b8109120 0x7f77b819eef0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f77b0009fd0 tx=0x7f77b000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:17.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.630+0000 7f77b6000640 1 -- 172.21.15.3:0/670944550 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b000ce20 con 0x7f77b8109120 2024-09-19T06:11:17.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.630+0000 7f77c0200640 1 -- 172.21.15.3:0/670944550 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77b819f8c0 con 0x7f77b8109120 2024-09-19T06:11:17.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.630+0000 7f77b6000640 1 -- 172.21.15.3:0/670944550 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77b0005020 con 0x7f77b8109120 2024-09-19T06:11:17.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.630+0000 7f77b6000640 1 -- 172.21.15.3:0/670944550 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b0010720 con 0x7f77b8109120 2024-09-19T06:11:17.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.631+0000 7f77c0200640 1 -- 172.21.15.3:0/670944550 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77b81a71a0 con 0x7f77b8109120 2024-09-19T06:11:17.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.632+0000 7f77c0200640 1 -- 172.21.15.3:0/670944550 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77b81043d0 con 0x7f77b8109120 2024-09-19T06:11:17.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.633+0000 7f77b6000640 1 -- 172.21.15.3:0/670944550 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f77b0005540 con 0x7f77b8109120 2024-09-19T06:11:17.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.635+0000 7f77b6000640 1 --2- 172.21.15.3:0/670944550 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f77a00a32d0 0x7f77a00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:17.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.635+0000 7f77b6000640 1 -- 172.21.15.3:0/670944550 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f77b00d00b0 con 0x7f77b8109120 2024-09-19T06:11:17.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.635+0000 7f77bd800640 1 --2- 172.21.15.3:0/670944550 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f77a00a32d0 0x7f77a00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:17.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.636+0000 7f77bd800640 1 --2- 172.21.15.3:0/670944550 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f77a00a32d0 0x7f77a00a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f77ac000c00 tx=0x7f77ac005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:17.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.639+0000 7f77b6000640 1 -- 172.21.15.3:0/670944550 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f77b009cbf0 con 0x7f77b8109120 2024-09-19T06:11:17.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.831+0000 7f77c0200640 1 -- 172.21.15.3:0/670944550 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f77b802d7c0 con 0x7f77b8109120 2024-09-19T06:11:17.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.831+0000 7f77b6000640 1 -- 172.21.15.3:0/670944550 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f77b009c4f0 con 0x7f77b8109120 2024-09-19T06:11:17.834 INFO:teuthology.orchestra.run.smithi003.stdout:197568495672 2024-09-19T06:11:17.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.834+0000 7f77c0200640 1 -- 172.21.15.3:0/670944550 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f77a00a32d0 msgr2=0x7f77a00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:17.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.834+0000 7f77c0200640 1 --2- 172.21.15.3:0/670944550 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f77a00a32d0 0x7f77a00a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f77ac000c00 tx=0x7f77ac005b50 comp rx=0 tx=0).stop 2024-09-19T06:11:17.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.834+0000 7f77c0200640 1 -- 172.21.15.3:0/670944550 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77b8109120 msgr2=0x7f77b819eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:17.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.834+0000 7f77c0200640 1 --2- 172.21.15.3:0/670944550 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77b8109120 0x7f77b819eef0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f77b0009fd0 tx=0x7f77b000ef10 comp rx=0 tx=0).stop 2024-09-19T06:11:17.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.834+0000 7f77c0200640 1 -- 172.21.15.3:0/670944550 shutdown_connections 2024-09-19T06:11:17.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.834+0000 7f77c0200640 1 --2- 172.21.15.3:0/670944550 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f77a00a32d0 0x7f77a00a5790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:17.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.834+0000 7f77c0200640 1 --2- 172.21.15.3:0/670944550 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f77b8109120 0x7f77b819eef0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:17.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.834+0000 7f77c0200640 1 --2- 172.21.15.3:0/670944550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f77b81049a0 0x7f77b819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:17.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.834+0000 7f77c0200640 1 --2- 172.21.15.3:0/670944550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77b8103ff0 0x7f77b819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:17.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.834+0000 7f77c0200640 1 -- 172.21.15.3:0/670944550 >> 172.21.15.3:0/670944550 conn(0x7f77b80ffa90 msgr2=0x7f77b8100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:17.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.834+0000 7f77c0200640 1 -- 172.21.15.3:0/670944550 shutdown_connections 2024-09-19T06:11:17.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:17.834+0000 7f77c0200640 1 -- 172.21.15.3:0/670944550 wait complete. 2024-09-19T06:11:18.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.323+0000 7fd24e400640 1 -- 172.21.15.3:0/2815353708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd248102790 msgr2=0x7fd2481067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:18.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.323+0000 7fd24e400640 1 --2- 172.21.15.3:0/2815353708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd248102790 0x7fd2481067e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd234009860 tx=0x7fd23402a340 comp rx=0 tx=0).stop 2024-09-19T06:11:18.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.323+0000 7fd24e400640 1 -- 172.21.15.3:0/2815353708 shutdown_connections 2024-09-19T06:11:18.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.323+0000 7fd24e400640 1 --2- 172.21.15.3:0/2815353708 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd248106f10 0x7fd24810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:18.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.323+0000 7fd24e400640 1 --2- 172.21.15.3:0/2815353708 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd248102790 0x7fd2481067e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:18.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.323+0000 7fd24e400640 1 --2- 172.21.15.3:0/2815353708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd248101de0 0x7fd2481021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:18.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.323+0000 7fd24e400640 1 -- 172.21.15.3:0/2815353708 >> 172.21.15.3:0/2815353708 conn(0x7fd2480fd8c0 msgr2=0x7fd2480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:18.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.323+0000 7fd24e400640 1 -- 172.21.15.3:0/2815353708 shutdown_connections 2024-09-19T06:11:18.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.323+0000 7fd24e400640 1 -- 172.21.15.3:0/2815353708 wait complete. 2024-09-19T06:11:18.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.324+0000 7fd24e400640 1 Processor -- start 2024-09-19T06:11:18.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.324+0000 7fd24e400640 1 -- start start 2024-09-19T06:11:18.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.324+0000 7fd24e400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd248101de0 0x7fd2480744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:18.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.325+0000 7fd24e400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd248102790 0x7fd248074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:18.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.325+0000 7fd24e400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd248106f10 0x7fd248074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:18.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.325+0000 7fd24e400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd248111f70 con 0x7fd248106f10 2024-09-19T06:11:18.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.325+0000 7fd24e400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd248111df0 con 0x7fd248101de0 2024-09-19T06:11:18.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.325+0000 7fd24e400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd2481120f0 con 0x7fd248102790 2024-09-19T06:11:18.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.325+0000 7fd247e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd248106f10 0x7fd248074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:18.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.325+0000 7fd247400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd248101de0 0x7fd2480744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:18.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.325+0000 7fd247e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd248106f10 0x7fd248074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52606/0 (socket says 172.21.15.3:52606) 2024-09-19T06:11:18.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.325+0000 7fd247e00640 1 -- 172.21.15.3:0/2775067845 learned_addr learned my addr 172.21.15.3:0/2775067845 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:18.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.325+0000 7fd246a00640 1 --2- 172.21.15.3:0/2775067845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd248102790 0x7fd248074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:18.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.325+0000 7fd247e00640 1 -- 172.21.15.3:0/2775067845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd248102790 msgr2=0x7fd248074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:18.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.325+0000 7fd247e00640 1 --2- 172.21.15.3:0/2775067845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd248102790 0x7fd248074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:18.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.325+0000 7fd247e00640 1 -- 172.21.15.3:0/2775067845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd248101de0 msgr2=0x7fd2480744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:18.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.325+0000 7fd247e00640 1 --2- 172.21.15.3:0/2775067845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd248101de0 0x7fd2480744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:18.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.325+0000 7fd247e00640 1 -- 172.21.15.3:0/2775067845 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2481a6a00 con 0x7fd248106f10 2024-09-19T06:11:18.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.325+0000 7fd246a00640 1 --2- 172.21.15.3:0/2775067845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd248102790 0x7fd248074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:11:18.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.326+0000 7fd247e00640 1 --2- 172.21.15.3:0/2775067845 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd248106f10 0x7fd248074f70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd24000efc0 tx=0x7fd24000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:18.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.326+0000 7fd23fe00640 1 -- 172.21.15.3:0/2775067845 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd240003970 con 0x7fd248106f10 2024-09-19T06:11:18.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.326+0000 7fd24e400640 1 -- 172.21.15.3:0/2775067845 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2481a6cf0 con 0x7fd248106f10 2024-09-19T06:11:18.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.326+0000 7fd23fe00640 1 -- 172.21.15.3:0/2775067845 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd240004020 con 0x7fd248106f10 2024-09-19T06:11:18.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.326+0000 7fd23fe00640 1 -- 172.21.15.3:0/2775067845 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24000b9f0 con 0x7fd248106f10 2024-09-19T06:11:18.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.326+0000 7fd24e400640 1 -- 172.21.15.3:0/2775067845 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2481a7200 con 0x7fd248106f10 2024-09-19T06:11:18.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.327+0000 7fd24e400640 1 -- 172.21.15.3:0/2775067845 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2481021c0 con 0x7fd248106f10 2024-09-19T06:11:18.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.329+0000 7fd23fe00640 1 -- 172.21.15.3:0/2775067845 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fd24001d020 con 0x7fd248106f10 2024-09-19T06:11:18.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.330+0000 7fd23fe00640 1 --2- 172.21.15.3:0/2775067845 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd22c0a3350 0x7fd22c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:18.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.330+0000 7fd23fe00640 1 -- 172.21.15.3:0/2775067845 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fd2400cf960 con 0x7fd248106f10 2024-09-19T06:11:18.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.330+0000 7fd247400640 1 --2- 172.21.15.3:0/2775067845 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd22c0a3350 0x7fd22c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:18.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.331+0000 7fd247400640 1 --2- 172.21.15.3:0/2775067845 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd22c0a3350 0x7fd22c0a5810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd238009bd0 tx=0x7fd238005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:18.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.334+0000 7fd23fe00640 1 -- 172.21.15.3:0/2775067845 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd24009c4a0 con 0x7fd248106f10 2024-09-19T06:11:18.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.525+0000 7fd24e400640 1 -- 172.21.15.3:0/2775067845 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fd24810a150 con 0x7fd248106f10 2024-09-19T06:11:18.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.526+0000 7fd23fe00640 1 -- 172.21.15.3:0/2775067845 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fd24009bda0 con 0x7fd248106f10 2024-09-19T06:11:18.480 INFO:teuthology.orchestra.run.smithi003.stdout:335007449116 2024-09-19T06:11:18.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.530+0000 7fd24e400640 1 -- 172.21.15.3:0/2775067845 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd22c0a3350 msgr2=0x7fd22c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:18.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.530+0000 7fd24e400640 1 --2- 172.21.15.3:0/2775067845 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd22c0a3350 0x7fd22c0a5810 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd238009bd0 tx=0x7fd238005f90 comp rx=0 tx=0).stop 2024-09-19T06:11:18.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.530+0000 7fd24e400640 1 -- 172.21.15.3:0/2775067845 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd248106f10 msgr2=0x7fd248074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:18.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.530+0000 7fd24e400640 1 --2- 172.21.15.3:0/2775067845 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd248106f10 0x7fd248074f70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd24000efc0 tx=0x7fd24000c800 comp rx=0 tx=0).stop 2024-09-19T06:11:18.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.530+0000 7fd24e400640 1 -- 172.21.15.3:0/2775067845 shutdown_connections 2024-09-19T06:11:18.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.530+0000 7fd24e400640 1 --2- 172.21.15.3:0/2775067845 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd22c0a3350 0x7fd22c0a5810 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:18.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.530+0000 7fd24e400640 1 --2- 172.21.15.3:0/2775067845 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd248106f10 0x7fd248074f70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:18.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.530+0000 7fd24e400640 1 --2- 172.21.15.3:0/2775067845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd248102790 0x7fd248074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:18.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.530+0000 7fd24e400640 1 --2- 172.21.15.3:0/2775067845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd248101de0 0x7fd2480744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:18.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.530+0000 7fd24e400640 1 -- 172.21.15.3:0/2775067845 >> 172.21.15.3:0/2775067845 conn(0x7fd2480fd8c0 msgr2=0x7fd2480fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:18.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.530+0000 7fd24e400640 1 -- 172.21.15.3:0/2775067845 shutdown_connections 2024-09-19T06:11:18.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:16.530+0000 7fd24e400640 1 -- 172.21.15.3:0/2775067845 wait complete. 2024-09-19T06:11:18.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:18 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/670944550' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T06:11:18.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:18 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/670944550' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T06:11:18.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:18 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/670944550' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T06:11:19.345 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495668 got 197568495672 for osd.6 2024-09-19T06:11:19.345 DEBUG:teuthology.parallel:result is None 2024-09-19T06:11:19.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:19 smithi059 ceph-mon[35138]: pgmap v342: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:19.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:19 smithi003 ceph-mon[30893]: pgmap v342: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:19.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:19 smithi071 ceph-mon[35662]: pgmap v342: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:19.963 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411402 got 77309411408 for osd.2 2024-09-19T06:11:19.963 DEBUG:teuthology.parallel:result is None 2024-09-19T06:11:20.348 INFO:tasks.cephadm.ceph_manager.ceph:need seq 335007449112 got 335007449116 for osd.11 2024-09-19T06:11:20.348 DEBUG:teuthology.parallel:result is None 2024-09-19T06:11:20.737 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757306 got 163208757310 for osd.5 2024-09-19T06:11:20.737 DEBUG:teuthology.parallel:result is None 2024-09-19T06:11:20.737 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T06:11:20.738 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:11:21.134 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:21.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.729+0000 7fc118800640 1 -- 172.21.15.3:0/3674945323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1101027a0 msgr2=0x7fc1101067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:21.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.729+0000 7fc118800640 1 --2- 172.21.15.3:0/3674945323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1101027a0 0x7fc1101067f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc100009900 tx=0x7fc10002a410 comp rx=0 tx=0).stop 2024-09-19T06:11:21.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.729+0000 7fc118800640 1 -- 172.21.15.3:0/3674945323 shutdown_connections 2024-09-19T06:11:21.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.729+0000 7fc118800640 1 --2- 172.21.15.3:0/3674945323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc110106f20 0x7fc11010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:21.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.729+0000 7fc118800640 1 --2- 172.21.15.3:0/3674945323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1101027a0 0x7fc1101067f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:21.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.729+0000 7fc118800640 1 --2- 172.21.15.3:0/3674945323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc110101df0 0x7fc1101021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:21.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.729+0000 7fc118800640 1 -- 172.21.15.3:0/3674945323 >> 172.21.15.3:0/3674945323 conn(0x7fc1100fd8b0 msgr2=0x7fc1100ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:21.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.729+0000 7fc118800640 1 -- 172.21.15.3:0/3674945323 shutdown_connections 2024-09-19T06:11:21.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.729+0000 7fc118800640 1 -- 172.21.15.3:0/3674945323 wait complete. 2024-09-19T06:11:21.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.730+0000 7fc118800640 1 Processor -- start 2024-09-19T06:11:21.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.730+0000 7fc118800640 1 -- start start 2024-09-19T06:11:21.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.731+0000 7fc118800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc110101df0 0x7fc1100744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:21.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.731+0000 7fc118800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1101027a0 0x7fc110074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:21.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.731+0000 7fc118800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc110106f20 0x7fc110074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:21.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.731+0000 7fc118800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc110111f80 con 0x7fc1101027a0 2024-09-19T06:11:21.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.731+0000 7fc118800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc110111e00 con 0x7fc110106f20 2024-09-19T06:11:21.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.731+0000 7fc118800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc110112100 con 0x7fc110101df0 2024-09-19T06:11:21.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.731+0000 7fc115400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1101027a0 0x7fc110074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:21.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.731+0000 7fc115400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1101027a0 0x7fc110074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52686/0 (socket says 172.21.15.3:52686) 2024-09-19T06:11:21.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.731+0000 7fc115e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc110101df0 0x7fc1100744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:21.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.731+0000 7fc115400640 1 -- 172.21.15.3:0/3222225390 learned_addr learned my addr 172.21.15.3:0/3222225390 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:21.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.731+0000 7fc116800640 1 --2- 172.21.15.3:0/3222225390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc110106f20 0x7fc110074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:21.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.732+0000 7fc115400640 1 -- 172.21.15.3:0/3222225390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc110101df0 msgr2=0x7fc1100744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:21.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.732+0000 7fc115400640 1 --2- 172.21.15.3:0/3222225390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc110101df0 0x7fc1100744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:21.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.732+0000 7fc115400640 1 -- 172.21.15.3:0/3222225390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc110106f20 msgr2=0x7fc110074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:21.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.732+0000 7fc115400640 1 --2- 172.21.15.3:0/3222225390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc110106f20 0x7fc110074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:21.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.732+0000 7fc115400640 1 -- 172.21.15.3:0/3222225390 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1101a68a0 con 0x7fc1101027a0 2024-09-19T06:11:21.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.732+0000 7fc115e00640 1 --2- 172.21.15.3:0/3222225390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc110101df0 0x7fc1100744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:21.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.732+0000 7fc116800640 1 --2- 172.21.15.3:0/3222225390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc110106f20 0x7fc110074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:21.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.732+0000 7fc115400640 1 --2- 172.21.15.3:0/3222225390 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1101027a0 0x7fc110074a30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc100006010 tx=0x7fc100004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:21.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.732+0000 7fc10aa00640 1 -- 172.21.15.3:0/3222225390 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10003f030 con 0x7fc1101027a0 2024-09-19T06:11:21.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.732+0000 7fc10aa00640 1 -- 172.21.15.3:0/3222225390 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc100004440 con 0x7fc1101027a0 2024-09-19T06:11:21.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.732+0000 7fc118800640 1 -- 172.21.15.3:0/3222225390 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1101a6b30 con 0x7fc1101027a0 2024-09-19T06:11:21.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.733+0000 7fc10aa00640 1 -- 172.21.15.3:0/3222225390 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc100035070 con 0x7fc1101027a0 2024-09-19T06:11:21.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.733+0000 7fc118800640 1 -- 172.21.15.3:0/3222225390 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1101a7010 con 0x7fc1101027a0 2024-09-19T06:11:21.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.734+0000 7fc118800640 1 -- 172.21.15.3:0/3222225390 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1101021d0 con 0x7fc1101027a0 2024-09-19T06:11:21.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.736+0000 7fc10aa00640 1 -- 172.21.15.3:0/3222225390 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fc100042030 con 0x7fc1101027a0 2024-09-19T06:11:21.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.738+0000 7fc10aa00640 1 --2- 172.21.15.3:0/3222225390 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc0f80a32d0 0x7fc0f80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:21.741 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.739+0000 7fc10aa00640 1 -- 172.21.15.3:0/3222225390 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fc1000efb10 con 0x7fc1101027a0 2024-09-19T06:11:21.741 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.739+0000 7fc115e00640 1 --2- 172.21.15.3:0/3222225390 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc0f80a32d0 0x7fc0f80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:21.741 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.739+0000 7fc115e00640 1 --2- 172.21.15.3:0/3222225390 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc0f80a32d0 0x7fc0f80a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc104009fc0 tx=0x7fc104005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:21.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.743+0000 7fc10aa00640 1 -- 172.21.15.3:0/3222225390 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc1000bc000 con 0x7fc1101027a0 2024-09-19T06:11:21.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.927+0000 7fc118800640 1 -- 172.21.15.3:0/3222225390 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc110062630 con 0x7fc0f80a32d0 2024-09-19T06:11:21.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.934+0000 7fc10aa00640 1 -- 172.21.15.3:0/3222225390 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259032 (secure 0 0 0) 0x7fc110062630 con 0x7fc0f80a32d0 2024-09-19T06:11:21.940 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:11:21.941 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-19T06:11:21.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.938+0000 7fc118800640 1 -- 172.21.15.3:0/3222225390 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc0f80a32d0 msgr2=0x7fc0f80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:21.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.938+0000 7fc118800640 1 --2- 172.21.15.3:0/3222225390 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc0f80a32d0 0x7fc0f80a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc104009fc0 tx=0x7fc104005f90 comp rx=0 tx=0).stop 2024-09-19T06:11:21.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.938+0000 7fc118800640 1 -- 172.21.15.3:0/3222225390 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1101027a0 msgr2=0x7fc110074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:21.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.938+0000 7fc118800640 1 --2- 172.21.15.3:0/3222225390 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1101027a0 0x7fc110074a30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc100006010 tx=0x7fc100004040 comp rx=0 tx=0).stop 2024-09-19T06:11:21.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.938+0000 7fc118800640 1 -- 172.21.15.3:0/3222225390 shutdown_connections 2024-09-19T06:11:21.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.938+0000 7fc118800640 1 --2- 172.21.15.3:0/3222225390 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc0f80a32d0 0x7fc0f80a5790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:21.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.938+0000 7fc118800640 1 --2- 172.21.15.3:0/3222225390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc110106f20 0x7fc110074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:21.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.938+0000 7fc118800640 1 --2- 172.21.15.3:0/3222225390 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1101027a0 0x7fc110074a30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:21.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.938+0000 7fc118800640 1 --2- 172.21.15.3:0/3222225390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc110101df0 0x7fc1100744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:21.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.938+0000 7fc118800640 1 -- 172.21.15.3:0/3222225390 >> 172.21.15.3:0/3222225390 conn(0x7fc1100fd8b0 msgr2=0x7fc1100feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:21.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.938+0000 7fc118800640 1 -- 172.21.15.3:0/3222225390 shutdown_connections 2024-09-19T06:11:21.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:21.938+0000 7fc118800640 1 -- 172.21.15.3:0/3222225390 wait complete. 2024-09-19T06:11:22.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:21 smithi059 ceph-mon[35138]: pgmap v343: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:22.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:21 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:11:22.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:21 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:11:22.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:21 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:22.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:21 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:11:22.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:21 smithi059 ceph-mon[35138]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:11:22.289 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:21 smithi003 ceph-mon[30893]: pgmap v343: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:22.289 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:21 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:11:22.290 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:21 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:11:22.290 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:21 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:22.290 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:21 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:11:22.290 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:21 smithi003 ceph-mon[30893]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:11:22.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:21 smithi071 ceph-mon[35662]: pgmap v343: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:22.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:21 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:11:22.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:21 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:11:22.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:21 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:11:22.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:21 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:11:22.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:21 smithi071 ceph-mon[35662]: from='mgr.14150 172.21.15.3:0/1986132315' entity='mgr.x' 2024-09-19T06:11:22.713 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-09-19T06:11:20.150714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657574,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":742,"num_read_kb":502,"num_write":428,"num_write_kb":3075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1183593,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":349,"ondisk_log_size":349,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365308,"kb_used_data":11856,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576516,"statfs":{"total":1151940427776,"available":1151566352384,"internally_reserved":0,"allocated":12140544,"data_stored":7568166,"data_compressed":176952,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19140,"internal_metadata":361674044},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003053"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.821380+0000","last_change":"2024-09-19T06:10:02.531329+0000","last_active":"2024-09-19T06:10:31.821380+0000","last_peered":"2024-09-19T06:10:31.821380+0000","last_clean":"2024-09-19T06:10:31.821380+0000","last_became_active":"2024-09-19T06:10:02.530997+0000","last_became_peered":"2024-09-19T06:10:02.530997+0000","last_unstale":"2024-09-19T06:10:31.821380+0000","last_undegraded":"2024-09-19T06:10:31.821380+0000","last_fullsized":"2024-09-19T06:10:31.821380+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:15.240495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816455+0000","last_change":"2024-09-19T06:10:02.526083+0000","last_active":"2024-09-19T06:10:31.816455+0000","last_peered":"2024-09-19T06:10:31.816455+0000","last_clean":"2024-09-19T06:10:31.816455+0000","last_became_active":"2024-09-19T06:10:02.522889+0000","last_became_peered":"2024-09-19T06:10:02.522889+0000","last_unstale":"2024-09-19T06:10:31.816455+0000","last_undegraded":"2024-09-19T06:10:31.816455+0000","last_fullsized":"2024-09-19T06:10:31.816455+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:19.735866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816994+0000","last_change":"2024-09-19T06:10:02.531779+0000","last_active":"2024-09-19T06:10:31.816994+0000","last_peered":"2024-09-19T06:10:31.816994+0000","last_clean":"2024-09-19T06:10:31.816994+0000","last_became_active":"2024-09-19T06:10:02.526795+0000","last_became_peered":"2024-09-19T06:10:02.526795+0000","last_unstale":"2024-09-19T06:10:31.816994+0000","last_undegraded":"2024-09-19T06:10:31.816994+0000","last_fullsized":"2024-09-19T06:10:31.816994+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:28.800773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819230+0000","last_change":"2024-09-19T06:10:02.518697+0000","last_active":"2024-09-19T06:10:31.819230+0000","last_peered":"2024-09-19T06:10:31.819230+0000","last_clean":"2024-09-19T06:10:31.819230+0000","last_became_active":"2024-09-19T06:10:02.518114+0000","last_became_peered":"2024-09-19T06:10:02.518114+0000","last_unstale":"2024-09-19T06:10:31.819230+0000","last_undegraded":"2024-09-19T06:10:31.819230+0000","last_fullsized":"2024-09-19T06:10:31.819230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:08.172638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823875+0000","last_change":"2024-09-19T06:10:02.520450+0000","last_active":"2024-09-19T06:10:31.823875+0000","last_peered":"2024-09-19T06:10:31.823875+0000","last_clean":"2024-09-19T06:10:31.823875+0000","last_became_active":"2024-09-19T06:10:02.519079+0000","last_became_peered":"2024-09-19T06:10:02.519079+0000","last_unstale":"2024-09-19T06:10:31.823875+0000","last_undegraded":"2024-09-19T06:10:31.823875+0000","last_fullsized":"2024-09-19T06:10:31.823875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:47.502020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815408+0000","last_change":"2024-09-19T06:10:02.518567+0000","last_active":"2024-09-19T06:10:31.815408+0000","last_peered":"2024-09-19T06:10:31.815408+0000","last_clean":"2024-09-19T06:10:31.815408+0000","last_became_active":"2024-09-19T06:10:02.517568+0000","last_became_peered":"2024-09-19T06:10:02.517568+0000","last_unstale":"2024-09-19T06:10:31.815408+0000","last_undegraded":"2024-09-19T06:10:31.815408+0000","last_fullsized":"2024-09-19T06:10:31.815408+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:10.245189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822197+0000","last_change":"2024-09-19T06:10:02.521844+0000","last_active":"2024-09-19T06:10:31.822197+0000","last_peered":"2024-09-19T06:10:31.822197+0000","last_clean":"2024-09-19T06:10:31.822197+0000","last_became_active":"2024-09-19T06:10:02.521522+0000","last_became_peered":"2024-09-19T06:10:02.521522+0000","last_unstale":"2024-09-19T06:10:31.822197+0000","last_undegraded":"2024-09-19T06:10:31.822197+0000","last_fullsized":"2024-09-19T06:10:31.822197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:46.166077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.821465+0000","last_change":"2024-09-19T06:10:02.526977+0000","last_active":"2024-09-19T06:10:31.821465+0000","last_peered":"2024-09-19T06:10:31.821465+0000","last_clean":"2024-09-19T06:10:31.821465+0000","last_became_active":"2024-09-19T06:10:02.526036+0000","last_became_peered":"2024-09-19T06:10:02.526036+0000","last_unstale":"2024-09-19T06:10:31.821465+0000","last_undegraded":"2024-09-19T06:10:31.821465+0000","last_fullsized":"2024-09-19T06:10:31.821465+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:43:28.587020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.950831+0000","last_change":"2024-09-19T06:10:02.524721+0000","last_active":"2024-09-19T06:10:31.950831+0000","last_peered":"2024-09-19T06:10:31.950831+0000","last_clean":"2024-09-19T06:10:31.950831+0000","last_became_active":"2024-09-19T06:10:02.523871+0000","last_became_peered":"2024-09-19T06:10:02.523871+0000","last_unstale":"2024-09-19T06:10:31.950831+0000","last_undegraded":"2024-09-19T06:10:31.950831+0000","last_fullsized":"2024-09-19T06:10:31.950831+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:31.324530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815849+0000","last_change":"2024-09-19T06:10:02.518494+0000","last_active":"2024-09-19T06:10:31.815849+0000","last_peered":"2024-09-19T06:10:31.815849+0000","last_clean":"2024-09-19T06:10:31.815849+0000","last_became_active":"2024-09-19T06:10:02.518140+0000","last_became_peered":"2024-09-19T06:10:02.518140+0000","last_unstale":"2024-09-19T06:10:31.815849+0000","last_undegraded":"2024-09-19T06:10:31.815849+0000","last_fullsized":"2024-09-19T06:10:31.815849+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:42.695222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822993+0000","last_change":"2024-09-19T06:10:02.524697+0000","last_active":"2024-09-19T06:10:31.822993+0000","last_peered":"2024-09-19T06:10:31.822993+0000","last_clean":"2024-09-19T06:10:31.822993+0000","last_became_active":"2024-09-19T06:10:02.524094+0000","last_became_peered":"2024-09-19T06:10:02.524094+0000","last_unstale":"2024-09-19T06:10:31.822993+0000","last_undegraded":"2024-09-19T06:10:31.822993+0000","last_fullsized":"2024-09-19T06:10:31.822993+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:12.591847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819323+0000","last_change":"2024-09-19T06:10:02.515878+0000","last_active":"2024-09-19T06:10:31.819323+0000","last_peered":"2024-09-19T06:10:31.819323+0000","last_clean":"2024-09-19T06:10:31.819323+0000","last_became_active":"2024-09-19T06:10:02.515456+0000","last_became_peered":"2024-09-19T06:10:02.515456+0000","last_unstale":"2024-09-19T06:10:31.819323+0000","last_undegraded":"2024-09-19T06:10:31.819323+0000","last_fullsized":"2024-09-19T06:10:31.819323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:58.687431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824936+0000","last_change":"2024-09-19T06:10:31.824936+0000","last_active":"2024-09-19T06:10:31.824936+0000","last_peered":"2024-09-19T06:10:31.824936+0000","last_clean":"2024-09-19T06:10:31.824936+0000","last_became_active":"2024-09-19T06:10:31.824611+0000","last_became_peered":"2024-09-19T06:10:31.824611+0000","last_unstale":"2024-09-19T06:10:31.824936+0000","last_undegraded":"2024-09-19T06:10:31.824936+0000","last_fullsized":"2024-09-19T06:10:31.824936+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:36.397693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815684+0000","last_change":"2024-09-19T06:10:02.513397+0000","last_active":"2024-09-19T06:10:31.815684+0000","last_peered":"2024-09-19T06:10:31.815684+0000","last_clean":"2024-09-19T06:10:31.815684+0000","last_became_active":"2024-09-19T06:10:02.513011+0000","last_became_peered":"2024-09-19T06:10:02.513011+0000","last_unstale":"2024-09-19T06:10:31.815684+0000","last_undegraded":"2024-09-19T06:10:31.815684+0000","last_fullsized":"2024-09-19T06:10:31.815684+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:06:03.509401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815644+0000","last_change":"2024-09-19T06:10:02.521623+0000","last_active":"2024-09-19T06:10:31.815644+0000","last_peered":"2024-09-19T06:10:31.815644+0000","last_clean":"2024-09-19T06:10:31.815644+0000","last_became_active":"2024-09-19T06:10:02.519371+0000","last_became_peered":"2024-09-19T06:10:02.519371+0000","last_unstale":"2024-09-19T06:10:31.815644+0000","last_undegraded":"2024-09-19T06:10:31.815644+0000","last_fullsized":"2024-09-19T06:10:31.815644+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:10.687026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.949882+0000","last_change":"2024-09-19T06:10:02.520865+0000","last_active":"2024-09-19T06:10:31.949882+0000","last_peered":"2024-09-19T06:10:31.949882+0000","last_clean":"2024-09-19T06:10:31.949882+0000","last_became_active":"2024-09-19T06:10:02.519683+0000","last_became_peered":"2024-09-19T06:10:02.519683+0000","last_unstale":"2024-09-19T06:10:31.949882+0000","last_undegraded":"2024-09-19T06:10:31.949882+0000","last_fullsized":"2024-09-19T06:10:31.949882+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:40.320474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.821336+0000","last_change":"2024-09-19T06:10:02.531552+0000","last_active":"2024-09-19T06:10:31.821336+0000","last_peered":"2024-09-19T06:10:31.821336+0000","last_clean":"2024-09-19T06:10:31.821336+0000","last_became_active":"2024-09-19T06:10:02.531081+0000","last_became_peered":"2024-09-19T06:10:02.531081+0000","last_unstale":"2024-09-19T06:10:31.821336+0000","last_undegraded":"2024-09-19T06:10:31.821336+0000","last_fullsized":"2024-09-19T06:10:31.821336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:07.835754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820977+0000","last_change":"2024-09-19T06:10:02.509088+0000","last_active":"2024-09-19T06:10:31.820977+0000","last_peered":"2024-09-19T06:10:31.820977+0000","last_clean":"2024-09-19T06:10:31.820977+0000","last_became_active":"2024-09-19T06:10:02.508752+0000","last_became_peered":"2024-09-19T06:10:02.508752+0000","last_unstale":"2024-09-19T06:10:31.820977+0000","last_undegraded":"2024-09-19T06:10:31.820977+0000","last_fullsized":"2024-09-19T06:10:31.820977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:36.832952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819925+0000","last_change":"2024-09-19T06:10:02.534694+0000","last_active":"2024-09-19T06:10:31.819925+0000","last_peered":"2024-09-19T06:10:31.819925+0000","last_clean":"2024-09-19T06:10:31.819925+0000","last_became_active":"2024-09-19T06:10:02.534384+0000","last_became_peered":"2024-09-19T06:10:02.534384+0000","last_unstale":"2024-09-19T06:10:31.819925+0000","last_undegraded":"2024-09-19T06:10:31.819925+0000","last_fullsized":"2024-09-19T06:10:31.819925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:48.006128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819900+0000","last_change":"2024-09-19T06:10:02.521104+0000","last_active":"2024-09-19T06:10:31.819900+0000","last_peered":"2024-09-19T06:10:31.819900+0000","last_clean":"2024-09-19T06:10:31.819900+0000","last_became_active":"2024-09-19T06:10:02.520755+0000","last_became_peered":"2024-09-19T06:10:02.520755+0000","last_unstale":"2024-09-19T06:10:31.819900+0000","last_undegraded":"2024-09-19T06:10:31.819900+0000","last_fullsized":"2024-09-19T06:10:31.819900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:46.091297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.817016+0000","last_change":"2024-09-19T06:10:02.522048+0000","last_active":"2024-09-19T06:10:31.817016+0000","last_peered":"2024-09-19T06:10:31.817016+0000","last_clean":"2024-09-19T06:10:31.817016+0000","last_became_active":"2024-09-19T06:10:02.521750+0000","last_became_peered":"2024-09-19T06:10:02.521750+0000","last_unstale":"2024-09-19T06:10:31.817016+0000","last_undegraded":"2024-09-19T06:10:31.817016+0000","last_fullsized":"2024-09-19T06:10:31.817016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:07.780609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.950055+0000","last_change":"2024-09-19T06:10:02.527386+0000","last_active":"2024-09-19T06:10:31.950055+0000","last_peered":"2024-09-19T06:10:31.950055+0000","last_clean":"2024-09-19T06:10:31.950055+0000","last_became_active":"2024-09-19T06:10:02.526804+0000","last_became_peered":"2024-09-19T06:10:02.526804+0000","last_unstale":"2024-09-19T06:10:31.950055+0000","last_undegraded":"2024-09-19T06:10:31.950055+0000","last_fullsized":"2024-09-19T06:10:31.950055+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:15.652068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.821745+0000","last_change":"2024-09-19T06:10:02.528521+0000","last_active":"2024-09-19T06:10:31.821745+0000","last_peered":"2024-09-19T06:10:31.821745+0000","last_clean":"2024-09-19T06:10:31.821745+0000","last_became_active":"2024-09-19T06:10:02.528087+0000","last_became_peered":"2024-09-19T06:10:02.528087+0000","last_unstale":"2024-09-19T06:10:31.821745+0000","last_undegraded":"2024-09-19T06:10:31.821745+0000","last_fullsized":"2024-09-19T06:10:31.821745+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:29.176129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819851+0000","last_change":"2024-09-19T06:10:02.518544+0000","last_active":"2024-09-19T06:10:31.819851+0000","last_peered":"2024-09-19T06:10:31.819851+0000","last_clean":"2024-09-19T06:10:31.819851+0000","last_became_active":"2024-09-19T06:10:02.518230+0000","last_became_peered":"2024-09-19T06:10:02.518230+0000","last_unstale":"2024-09-19T06:10:31.819851+0000","last_undegraded":"2024-09-19T06:10:31.819851+0000","last_fullsized":"2024-09-19T06:10:31.819851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:26:32.116211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822472+0000","last_change":"2024-09-19T06:10:02.531859+0000","last_active":"2024-09-19T06:10:31.822472+0000","last_peered":"2024-09-19T06:10:31.822472+0000","last_clean":"2024-09-19T06:10:31.822472+0000","last_became_active":"2024-09-19T06:10:02.531572+0000","last_became_peered":"2024-09-19T06:10:02.531572+0000","last_unstale":"2024-09-19T06:10:31.822472+0000","last_undegraded":"2024-09-19T06:10:31.822472+0000","last_fullsized":"2024-09-19T06:10:31.822472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:34.314977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819440+0000","last_change":"2024-09-19T06:10:02.521292+0000","last_active":"2024-09-19T06:10:31.819440+0000","last_peered":"2024-09-19T06:10:31.819440+0000","last_clean":"2024-09-19T06:10:31.819440+0000","last_became_active":"2024-09-19T06:10:02.520967+0000","last_became_peered":"2024-09-19T06:10:02.520967+0000","last_unstale":"2024-09-19T06:10:31.819440+0000","last_undegraded":"2024-09-19T06:10:31.819440+0000","last_fullsized":"2024-09-19T06:10:31.819440+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:11.318504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820304+0000","last_change":"2024-09-19T06:10:02.521514+0000","last_active":"2024-09-19T06:10:31.820304+0000","last_peered":"2024-09-19T06:10:31.820304+0000","last_clean":"2024-09-19T06:10:31.820304+0000","last_became_active":"2024-09-19T06:10:02.521203+0000","last_became_peered":"2024-09-19T06:10:02.521203+0000","last_unstale":"2024-09-19T06:10:31.820304+0000","last_undegraded":"2024-09-19T06:10:31.820304+0000","last_fullsized":"2024-09-19T06:10:31.820304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:53.689067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824501+0000","last_change":"2024-09-19T06:10:31.824501+0000","last_active":"2024-09-19T06:10:31.824501+0000","last_peered":"2024-09-19T06:10:31.824501+0000","last_clean":"2024-09-19T06:10:31.824501+0000","last_became_active":"2024-09-19T06:10:31.824161+0000","last_became_peered":"2024-09-19T06:10:31.824161+0000","last_unstale":"2024-09-19T06:10:31.824501+0000","last_undegraded":"2024-09-19T06:10:31.824501+0000","last_fullsized":"2024-09-19T06:10:31.824501+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:28.203581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816369+0000","last_change":"2024-09-19T06:10:02.530351+0000","last_active":"2024-09-19T06:10:31.816369+0000","last_peered":"2024-09-19T06:10:31.816369+0000","last_clean":"2024-09-19T06:10:31.816369+0000","last_became_active":"2024-09-19T06:10:02.529292+0000","last_became_peered":"2024-09-19T06:10:02.529292+0000","last_unstale":"2024-09-19T06:10:31.816369+0000","last_undegraded":"2024-09-19T06:10:31.816369+0000","last_fullsized":"2024-09-19T06:10:31.816369+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:02.324413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819026+0000","last_change":"2024-09-19T06:10:02.534885+0000","last_active":"2024-09-19T06:10:31.819026+0000","last_peered":"2024-09-19T06:10:31.819026+0000","last_clean":"2024-09-19T06:10:31.819026+0000","last_became_active":"2024-09-19T06:10:02.534520+0000","last_became_peered":"2024-09-19T06:10:02.534520+0000","last_unstale":"2024-09-19T06:10:31.819026+0000","last_undegraded":"2024-09-19T06:10:31.819026+0000","last_fullsized":"2024-09-19T06:10:31.819026+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:04.896787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819767+0000","last_change":"2024-09-19T06:10:02.518120+0000","last_active":"2024-09-19T06:10:31.819767+0000","last_peered":"2024-09-19T06:10:31.819767+0000","last_clean":"2024-09-19T06:10:31.819767+0000","last_became_active":"2024-09-19T06:10:02.517595+0000","last_became_peered":"2024-09-19T06:10:02.517595+0000","last_unstale":"2024-09-19T06:10:31.819767+0000","last_undegraded":"2024-09-19T06:10:31.819767+0000","last_fullsized":"2024-09-19T06:10:31.819767+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:00.695783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819720+0000","last_change":"2024-09-19T06:10:02.524413+0000","last_active":"2024-09-19T06:10:31.819720+0000","last_peered":"2024-09-19T06:10:31.819720+0000","last_clean":"2024-09-19T06:10:31.819720+0000","last_became_active":"2024-09-19T06:10:02.523559+0000","last_became_peered":"2024-09-19T06:10:02.523559+0000","last_unstale":"2024-09-19T06:10:31.819720+0000","last_undegraded":"2024-09-19T06:10:31.819720+0000","last_fullsized":"2024-09-19T06:10:31.819720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:04.045759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823856+0000","last_change":"2024-09-19T06:10:02.514572+0000","last_active":"2024-09-19T06:10:31.823856+0000","last_peered":"2024-09-19T06:10:31.823856+0000","last_clean":"2024-09-19T06:10:31.823856+0000","last_became_active":"2024-09-19T06:10:02.513685+0000","last_became_peered":"2024-09-19T06:10:02.513685+0000","last_unstale":"2024-09-19T06:10:31.823856+0000","last_undegraded":"2024-09-19T06:10:31.823856+0000","last_fullsized":"2024-09-19T06:10:31.823856+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:09.108036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:11:16.888669+0000","last_change":"2024-09-19T06:10:31.829554+0000","last_active":"2024-09-19T06:11:16.888669+0000","last_peered":"2024-09-19T06:11:16.888669+0000","last_clean":"2024-09-19T06:11:16.888669+0000","last_became_active":"2024-09-19T06:10:31.824266+0000","last_became_peered":"2024-09-19T06:10:31.824266+0000","last_unstale":"2024-09-19T06:11:16.888669+0000","last_undegraded":"2024-09-19T06:11:16.888669+0000","last_fullsized":"2024-09-19T06:11:16.888669+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:07.241897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":47,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1015,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819853+0000","last_change":"2024-09-19T06:10:02.524271+0000","last_active":"2024-09-19T06:10:31.819853+0000","last_peered":"2024-09-19T06:10:31.819853+0000","last_clean":"2024-09-19T06:10:31.819853+0000","last_became_active":"2024-09-19T06:10:02.523948+0000","last_became_peered":"2024-09-19T06:10:02.523948+0000","last_unstale":"2024-09-19T06:10:31.819853+0000","last_undegraded":"2024-09-19T06:10:31.819853+0000","last_fullsized":"2024-09-19T06:10:31.819853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:46.406652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815443+0000","last_change":"2024-09-19T06:09:59.493186+0000","last_active":"2024-09-19T06:10:31.815443+0000","last_peered":"2024-09-19T06:10:31.815443+0000","last_clean":"2024-09-19T06:10:31.815443+0000","last_became_active":"2024-09-19T06:09:59.492841+0000","last_became_peered":"2024-09-19T06:09:59.492841+0000","last_unstale":"2024-09-19T06:10:31.815443+0000","last_undegraded":"2024-09-19T06:10:31.815443+0000","last_fullsized":"2024-09-19T06:10:31.815443+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:48.557724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816757+0000","last_change":"2024-09-19T06:09:59.493364+0000","last_active":"2024-09-19T06:10:31.816757+0000","last_peered":"2024-09-19T06:10:31.816757+0000","last_clean":"2024-09-19T06:10:31.816757+0000","last_became_active":"2024-09-19T06:09:59.491868+0000","last_became_peered":"2024-09-19T06:09:59.491868+0000","last_unstale":"2024-09-19T06:10:31.816757+0000","last_undegraded":"2024-09-19T06:10:31.816757+0000","last_fullsized":"2024-09-19T06:10:31.816757+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:23.088768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.821572+0000","last_change":"2024-09-19T06:10:02.534453+0000","last_active":"2024-09-19T06:10:31.821572+0000","last_peered":"2024-09-19T06:10:31.821572+0000","last_clean":"2024-09-19T06:10:31.821572+0000","last_became_active":"2024-09-19T06:10:02.532003+0000","last_became_peered":"2024-09-19T06:10:02.532003+0000","last_unstale":"2024-09-19T06:10:31.821572+0000","last_undegraded":"2024-09-19T06:10:31.821572+0000","last_fullsized":"2024-09-19T06:10:31.821572+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:41.609673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820651+0000","last_change":"2024-09-19T06:09:59.493574+0000","last_active":"2024-09-19T06:10:31.820651+0000","last_peered":"2024-09-19T06:10:31.820651+0000","last_clean":"2024-09-19T06:10:31.820651+0000","last_became_active":"2024-09-19T06:09:59.493243+0000","last_became_peered":"2024-09-19T06:09:59.493243+0000","last_unstale":"2024-09-19T06:10:31.820651+0000","last_undegraded":"2024-09-19T06:10:31.820651+0000","last_fullsized":"2024-09-19T06:10:31.820651+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:12:43.491780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820035+0000","last_change":"2024-09-19T06:10:02.520122+0000","last_active":"2024-09-19T06:10:31.820035+0000","last_peered":"2024-09-19T06:10:31.820035+0000","last_clean":"2024-09-19T06:10:31.820035+0000","last_became_active":"2024-09-19T06:10:02.519795+0000","last_became_peered":"2024-09-19T06:10:02.519795+0000","last_unstale":"2024-09-19T06:10:31.820035+0000","last_undegraded":"2024-09-19T06:10:31.820035+0000","last_fullsized":"2024-09-19T06:10:31.820035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:12.384824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":150,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:11:15.886584+0000","last_change":"2024-09-19T06:09:59.491192+0000","last_active":"2024-09-19T06:11:15.886584+0000","last_peered":"2024-09-19T06:11:15.886584+0000","last_clean":"2024-09-19T06:11:15.886584+0000","last_became_active":"2024-09-19T06:09:59.490774+0000","last_became_peered":"2024-09-19T06:09:59.490774+0000","last_unstale":"2024-09-19T06:11:15.886584+0000","last_undegraded":"2024-09-19T06:11:15.886584+0000","last_fullsized":"2024-09-19T06:11:15.886584+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:30.276512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.950309+0000","last_change":"2024-09-19T06:10:02.516728+0000","last_active":"2024-09-19T06:10:31.950309+0000","last_peered":"2024-09-19T06:10:31.950309+0000","last_clean":"2024-09-19T06:10:31.950309+0000","last_became_active":"2024-09-19T06:10:02.516415+0000","last_became_peered":"2024-09-19T06:10:02.516415+0000","last_unstale":"2024-09-19T06:10:31.950309+0000","last_undegraded":"2024-09-19T06:10:31.950309+0000","last_fullsized":"2024-09-19T06:10:31.950309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:45.012284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822879+0000","last_change":"2024-09-19T06:09:59.499167+0000","last_active":"2024-09-19T06:10:31.822879+0000","last_peered":"2024-09-19T06:10:31.822879+0000","last_clean":"2024-09-19T06:10:31.822879+0000","last_became_active":"2024-09-19T06:09:59.498796+0000","last_became_peered":"2024-09-19T06:09:59.498796+0000","last_unstale":"2024-09-19T06:10:31.822879+0000","last_undegraded":"2024-09-19T06:10:31.822879+0000","last_fullsized":"2024-09-19T06:10:31.822879+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:08.665495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823990+0000","last_change":"2024-09-19T06:10:31.823990+0000","last_active":"2024-09-19T06:10:31.823990+0000","last_peered":"2024-09-19T06:10:31.823990+0000","last_clean":"2024-09-19T06:10:31.823990+0000","last_became_active":"2024-09-19T06:10:31.823448+0000","last_became_peered":"2024-09-19T06:10:31.823448+0000","last_unstale":"2024-09-19T06:10:31.823990+0000","last_undegraded":"2024-09-19T06:10:31.823990+0000","last_fullsized":"2024-09-19T06:10:31.823990+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:33.882448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820128+0000","last_change":"2024-09-19T06:09:59.774875+0000","last_active":"2024-09-19T06:10:31.820128+0000","last_peered":"2024-09-19T06:10:31.820128+0000","last_clean":"2024-09-19T06:10:31.820128+0000","last_became_active":"2024-09-19T06:09:59.774376+0000","last_became_peered":"2024-09-19T06:09:59.774376+0000","last_unstale":"2024-09-19T06:10:31.820128+0000","last_undegraded":"2024-09-19T06:10:31.820128+0000","last_fullsized":"2024-09-19T06:10:31.820128+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:01.283578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.950220+0000","last_change":"2024-09-19T06:10:02.518202+0000","last_active":"2024-09-19T06:10:31.950220+0000","last_peered":"2024-09-19T06:10:31.950220+0000","last_clean":"2024-09-19T06:10:31.950220+0000","last_became_active":"2024-09-19T06:10:02.517865+0000","last_became_peered":"2024-09-19T06:10:02.517865+0000","last_unstale":"2024-09-19T06:10:31.950220+0000","last_undegraded":"2024-09-19T06:10:31.950220+0000","last_fullsized":"2024-09-19T06:10:31.950220+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:28.128891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'31","reported_seq":186,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:11:15.886645+0000","last_change":"2024-09-19T06:09:59.493139+0000","last_active":"2024-09-19T06:11:15.886645+0000","last_peered":"2024-09-19T06:11:15.886645+0000","last_clean":"2024-09-19T06:11:15.886645+0000","last_became_active":"2024-09-19T06:09:59.492768+0000","last_became_peered":"2024-09-19T06:09:59.492768+0000","last_unstale":"2024-09-19T06:11:15.886645+0000","last_undegraded":"2024-09-19T06:11:15.886645+0000","last_fullsized":"2024-09-19T06:11:15.886645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:17.872432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":122,"num_write":33,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824313+0000","last_change":"2024-09-19T06:10:02.516187+0000","last_active":"2024-09-19T06:10:31.824313+0000","last_peered":"2024-09-19T06:10:31.824313+0000","last_clean":"2024-09-19T06:10:31.824313+0000","last_became_active":"2024-09-19T06:10:02.515888+0000","last_became_peered":"2024-09-19T06:10:02.515888+0000","last_unstale":"2024-09-19T06:10:31.824313+0000","last_undegraded":"2024-09-19T06:10:31.824313+0000","last_fullsized":"2024-09-19T06:10:31.824313+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:29.672889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819416+0000","last_change":"2024-09-19T06:09:59.492155+0000","last_active":"2024-09-19T06:10:31.819416+0000","last_peered":"2024-09-19T06:10:31.819416+0000","last_clean":"2024-09-19T06:10:31.819416+0000","last_became_active":"2024-09-19T06:09:59.491730+0000","last_became_peered":"2024-09-19T06:09:59.491730+0000","last_unstale":"2024-09-19T06:10:31.819416+0000","last_undegraded":"2024-09-19T06:10:31.819416+0000","last_fullsized":"2024-09-19T06:10:31.819416+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:30.632665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816446+0000","last_change":"2024-09-19T06:10:02.526214+0000","last_active":"2024-09-19T06:10:31.816446+0000","last_peered":"2024-09-19T06:10:31.816446+0000","last_clean":"2024-09-19T06:10:31.816446+0000","last_became_active":"2024-09-19T06:10:02.525846+0000","last_became_peered":"2024-09-19T06:10:02.525846+0000","last_unstale":"2024-09-19T06:10:31.816446+0000","last_undegraded":"2024-09-19T06:10:31.816446+0000","last_fullsized":"2024-09-19T06:10:31.816446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:14.294741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820233+0000","last_change":"2024-09-19T06:09:59.494814+0000","last_active":"2024-09-19T06:10:31.820233+0000","last_peered":"2024-09-19T06:10:31.820233+0000","last_clean":"2024-09-19T06:10:31.820233+0000","last_became_active":"2024-09-19T06:09:59.494461+0000","last_became_peered":"2024-09-19T06:09:59.494461+0000","last_unstale":"2024-09-19T06:10:31.820233+0000","last_undegraded":"2024-09-19T06:10:31.820233+0000","last_fullsized":"2024-09-19T06:10:31.820233+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:37.730327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823102+0000","last_change":"2024-09-19T06:10:02.518851+0000","last_active":"2024-09-19T06:10:31.823102+0000","last_peered":"2024-09-19T06:10:31.823102+0000","last_clean":"2024-09-19T06:10:31.823102+0000","last_became_active":"2024-09-19T06:10:02.518462+0000","last_became_peered":"2024-09-19T06:10:02.518462+0000","last_unstale":"2024-09-19T06:10:31.823102+0000","last_undegraded":"2024-09-19T06:10:31.823102+0000","last_fullsized":"2024-09-19T06:10:31.823102+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:22.629918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":94,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:11:15.852015+0000","last_change":"2024-09-19T06:09:59.493839+0000","last_active":"2024-09-19T06:11:15.852015+0000","last_peered":"2024-09-19T06:11:15.852015+0000","last_clean":"2024-09-19T06:11:15.852015+0000","last_became_active":"2024-09-19T06:09:59.492323+0000","last_became_peered":"2024-09-19T06:09:59.492323+0000","last_unstale":"2024-09-19T06:11:15.852015+0000","last_undegraded":"2024-09-19T06:11:15.852015+0000","last_fullsized":"2024-09-19T06:11:15.852015+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:12.754030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822340+0000","last_change":"2024-09-19T06:10:02.515957+0000","last_active":"2024-09-19T06:10:31.822340+0000","last_peered":"2024-09-19T06:10:31.822340+0000","last_clean":"2024-09-19T06:10:31.822340+0000","last_became_active":"2024-09-19T06:10:02.515493+0000","last_became_peered":"2024-09-19T06:10:02.515493+0000","last_unstale":"2024-09-19T06:10:31.822340+0000","last_undegraded":"2024-09-19T06:10:31.822340+0000","last_fullsized":"2024-09-19T06:10:31.822340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:06.988155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823601+0000","last_change":"2024-09-19T06:09:59.775131+0000","last_active":"2024-09-19T06:10:31.823601+0000","last_peered":"2024-09-19T06:10:31.823601+0000","last_clean":"2024-09-19T06:10:31.823601+0000","last_became_active":"2024-09-19T06:09:59.774642+0000","last_became_peered":"2024-09-19T06:09:59.774642+0000","last_unstale":"2024-09-19T06:10:31.823601+0000","last_undegraded":"2024-09-19T06:10:31.823601+0000","last_fullsized":"2024-09-19T06:10:31.823601+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:31.722485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819343+0000","last_change":"2024-09-19T06:10:02.522531+0000","last_active":"2024-09-19T06:10:31.819343+0000","last_peered":"2024-09-19T06:10:31.819343+0000","last_clean":"2024-09-19T06:10:31.819343+0000","last_became_active":"2024-09-19T06:10:02.522186+0000","last_became_peered":"2024-09-19T06:10:02.522186+0000","last_unstale":"2024-09-19T06:10:31.819343+0000","last_undegraded":"2024-09-19T06:10:31.819343+0000","last_fullsized":"2024-09-19T06:10:31.819343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:45.689043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824376+0000","last_change":"2024-09-19T06:09:59.494819+0000","last_active":"2024-09-19T06:10:31.824376+0000","last_peered":"2024-09-19T06:10:31.824376+0000","last_clean":"2024-09-19T06:10:31.824376+0000","last_became_active":"2024-09-19T06:09:59.494434+0000","last_became_peered":"2024-09-19T06:09:59.494434+0000","last_unstale":"2024-09-19T06:10:31.824376+0000","last_undegraded":"2024-09-19T06:10:31.824376+0000","last_fullsized":"2024-09-19T06:10:31.824376+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:42.207621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820312+0000","last_change":"2024-09-19T06:10:02.522893+0000","last_active":"2024-09-19T06:10:31.820312+0000","last_peered":"2024-09-19T06:10:31.820312+0000","last_clean":"2024-09-19T06:10:31.820312+0000","last_became_active":"2024-09-19T06:10:02.522596+0000","last_became_peered":"2024-09-19T06:10:02.522596+0000","last_unstale":"2024-09-19T06:10:31.820312+0000","last_undegraded":"2024-09-19T06:10:31.820312+0000","last_fullsized":"2024-09-19T06:10:31.820312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:21.394878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.838085+0000","last_change":"2024-09-19T06:10:31.838085+0000","last_active":"2024-09-19T06:10:31.838085+0000","last_peered":"2024-09-19T06:10:31.838085+0000","last_clean":"2024-09-19T06:10:31.838085+0000","last_became_active":"2024-09-19T06:10:31.826924+0000","last_became_peered":"2024-09-19T06:10:31.826924+0000","last_unstale":"2024-09-19T06:10:31.838085+0000","last_undegraded":"2024-09-19T06:10:31.838085+0000","last_fullsized":"2024-09-19T06:10:31.838085+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:19.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823274+0000","last_change":"2024-09-19T06:10:02.516137+0000","last_active":"2024-09-19T06:10:31.823274+0000","last_peered":"2024-09-19T06:10:31.823274+0000","last_clean":"2024-09-19T06:10:31.823274+0000","last_became_active":"2024-09-19T06:10:02.515769+0000","last_became_peered":"2024-09-19T06:10:02.515769+0000","last_unstale":"2024-09-19T06:10:31.823274+0000","last_undegraded":"2024-09-19T06:10:31.823274+0000","last_fullsized":"2024-09-19T06:10:31.823274+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:56.741950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820246+0000","last_change":"2024-09-19T06:09:59.498177+0000","last_active":"2024-09-19T06:10:31.820246+0000","last_peered":"2024-09-19T06:10:31.820246+0000","last_clean":"2024-09-19T06:10:31.820246+0000","last_became_active":"2024-09-19T06:09:59.497808+0000","last_became_peered":"2024-09-19T06:09:59.497808+0000","last_unstale":"2024-09-19T06:10:31.820246+0000","last_undegraded":"2024-09-19T06:10:31.820246+0000","last_fullsized":"2024-09-19T06:10:31.820246+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:06.473332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822740+0000","last_change":"2024-09-19T06:10:02.526442+0000","last_active":"2024-09-19T06:10:31.822740+0000","last_peered":"2024-09-19T06:10:31.822740+0000","last_clean":"2024-09-19T06:10:31.822740+0000","last_became_active":"2024-09-19T06:10:02.526116+0000","last_became_peered":"2024-09-19T06:10:02.526116+0000","last_unstale":"2024-09-19T06:10:31.822740+0000","last_undegraded":"2024-09-19T06:10:31.822740+0000","last_fullsized":"2024-09-19T06:10:31.822740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:05.000599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":65,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:11:15.887243+0000","last_change":"2024-09-19T06:10:31.829793+0000","last_active":"2024-09-19T06:11:15.887243+0000","last_peered":"2024-09-19T06:11:15.887243+0000","last_clean":"2024-09-19T06:11:15.887243+0000","last_became_active":"2024-09-19T06:10:31.822044+0000","last_became_peered":"2024-09-19T06:10:31.822044+0000","last_unstale":"2024-09-19T06:11:15.887243+0000","last_undegraded":"2024-09-19T06:11:15.887243+0000","last_fullsized":"2024-09-19T06:11:15.887243+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:45.301315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1170,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823112+0000","last_change":"2024-09-19T06:10:02.524435+0000","last_active":"2024-09-19T06:10:31.823112+0000","last_peered":"2024-09-19T06:10:31.823112+0000","last_clean":"2024-09-19T06:10:31.823112+0000","last_became_active":"2024-09-19T06:10:02.523634+0000","last_became_peered":"2024-09-19T06:10:02.523634+0000","last_unstale":"2024-09-19T06:10:31.823112+0000","last_undegraded":"2024-09-19T06:10:31.823112+0000","last_fullsized":"2024-09-19T06:10:31.823112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:07.679183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":350,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822667+0000","last_change":"2024-09-19T06:08:39.873247+0000","last_active":"2024-09-19T06:10:31.822667+0000","last_peered":"2024-09-19T06:10:31.822667+0000","last_clean":"2024-09-19T06:10:31.822667+0000","last_became_active":"2024-09-19T06:08:39.872647+0000","last_became_peered":"2024-09-19T06:08:39.872647+0000","last_unstale":"2024-09-19T06:10:31.822667+0000","last_undegraded":"2024-09-19T06:10:31.822667+0000","last_fullsized":"2024-09-19T06:10:31.822667+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:56.991890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:56.991890+0000","last_clean_scrub_stamp":"2024-09-19T06:04:56.991890+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:18.835510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.818858+0000","last_change":"2024-09-19T06:09:59.492677+0000","last_active":"2024-09-19T06:10:31.818858+0000","last_peered":"2024-09-19T06:10:31.818858+0000","last_clean":"2024-09-19T06:10:31.818858+0000","last_became_active":"2024-09-19T06:09:59.492235+0000","last_became_peered":"2024-09-19T06:09:59.492235+0000","last_unstale":"2024-09-19T06:10:31.818858+0000","last_undegraded":"2024-09-19T06:10:31.818858+0000","last_fullsized":"2024-09-19T06:10:31.818858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:40.173728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823152+0000","last_change":"2024-09-19T06:10:02.523331+0000","last_active":"2024-09-19T06:10:31.823152+0000","last_peered":"2024-09-19T06:10:31.823152+0000","last_clean":"2024-09-19T06:10:31.823152+0000","last_became_active":"2024-09-19T06:10:02.522896+0000","last_became_peered":"2024-09-19T06:10:02.522896+0000","last_unstale":"2024-09-19T06:10:31.823152+0000","last_undegraded":"2024-09-19T06:10:31.823152+0000","last_fullsized":"2024-09-19T06:10:31.823152+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:56.994375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822479+0000","last_change":"2024-09-19T06:09:59.496407+0000","last_active":"2024-09-19T06:10:31.822479+0000","last_peered":"2024-09-19T06:10:31.822479+0000","last_clean":"2024-09-19T06:10:31.822479+0000","last_became_active":"2024-09-19T06:09:59.496074+0000","last_became_peered":"2024-09-19T06:09:59.496074+0000","last_unstale":"2024-09-19T06:10:31.822479+0000","last_undegraded":"2024-09-19T06:10:31.822479+0000","last_fullsized":"2024-09-19T06:10:31.822479+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:11.257227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815458+0000","last_change":"2024-09-19T06:10:02.515229+0000","last_active":"2024-09-19T06:10:31.815458+0000","last_peered":"2024-09-19T06:10:31.815458+0000","last_clean":"2024-09-19T06:10:31.815458+0000","last_became_active":"2024-09-19T06:10:02.514092+0000","last_became_peered":"2024-09-19T06:10:02.514092+0000","last_unstale":"2024-09-19T06:10:31.815458+0000","last_undegraded":"2024-09-19T06:10:31.815458+0000","last_fullsized":"2024-09-19T06:10:31.815458+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:32:36.805821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":95,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:11:17.854434+0000","last_change":"2024-09-19T06:09:59.777102+0000","last_active":"2024-09-19T06:11:17.854434+0000","last_peered":"2024-09-19T06:11:17.854434+0000","last_clean":"2024-09-19T06:11:17.854434+0000","last_became_active":"2024-09-19T06:09:59.774456+0000","last_became_peered":"2024-09-19T06:09:59.774456+0000","last_unstale":"2024-09-19T06:11:17.854434+0000","last_undegraded":"2024-09-19T06:11:17.854434+0000","last_fullsized":"2024-09-19T06:11:17.854434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:11.353528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820463+0000","last_change":"2024-09-19T06:10:02.517039+0000","last_active":"2024-09-19T06:10:31.820463+0000","last_peered":"2024-09-19T06:10:31.820463+0000","last_clean":"2024-09-19T06:10:31.820463+0000","last_became_active":"2024-09-19T06:10:02.516291+0000","last_became_peered":"2024-09-19T06:10:02.516291+0000","last_unstale":"2024-09-19T06:10:31.820463+0000","last_undegraded":"2024-09-19T06:10:31.820463+0000","last_fullsized":"2024-09-19T06:10:31.820463+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:27.835967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":96,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:11:18.020467+0000","last_change":"2024-09-19T06:09:59.499496+0000","last_active":"2024-09-19T06:11:18.020467+0000","last_peered":"2024-09-19T06:11:18.020467+0000","last_clean":"2024-09-19T06:11:18.020467+0000","last_became_active":"2024-09-19T06:09:59.499172+0000","last_became_peered":"2024-09-19T06:09:59.499172+0000","last_unstale":"2024-09-19T06:11:18.020467+0000","last_undegraded":"2024-09-19T06:11:18.020467+0000","last_fullsized":"2024-09-19T06:11:18.020467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:52.062675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815533+0000","last_change":"2024-09-19T06:10:02.523099+0000","last_active":"2024-09-19T06:10:31.815533+0000","last_peered":"2024-09-19T06:10:31.815533+0000","last_clean":"2024-09-19T06:10:31.815533+0000","last_became_active":"2024-09-19T06:10:02.522770+0000","last_became_peered":"2024-09-19T06:10:02.522770+0000","last_unstale":"2024-09-19T06:10:31.815533+0000","last_undegraded":"2024-09-19T06:10:31.815533+0000","last_fullsized":"2024-09-19T06:10:31.815533+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:39.807159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820720+0000","last_change":"2024-09-19T06:09:59.775371+0000","last_active":"2024-09-19T06:10:31.820720+0000","last_peered":"2024-09-19T06:10:31.820720+0000","last_clean":"2024-09-19T06:10:31.820720+0000","last_became_active":"2024-09-19T06:09:59.774944+0000","last_became_peered":"2024-09-19T06:09:59.774944+0000","last_unstale":"2024-09-19T06:10:31.820720+0000","last_undegraded":"2024-09-19T06:10:31.820720+0000","last_fullsized":"2024-09-19T06:10:31.820720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:44.305005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815663+0000","last_change":"2024-09-19T06:10:02.521207+0000","last_active":"2024-09-19T06:10:31.815663+0000","last_peered":"2024-09-19T06:10:31.815663+0000","last_clean":"2024-09-19T06:10:31.815663+0000","last_became_active":"2024-09-19T06:10:02.520843+0000","last_became_peered":"2024-09-19T06:10:02.520843+0000","last_unstale":"2024-09-19T06:10:31.815663+0000","last_undegraded":"2024-09-19T06:10:31.815663+0000","last_fullsized":"2024-09-19T06:10:31.815663+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:39.462042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824516+0000","last_change":"2024-09-19T06:09:59.775259+0000","last_active":"2024-09-19T06:10:31.824516+0000","last_peered":"2024-09-19T06:10:31.824516+0000","last_clean":"2024-09-19T06:10:31.824516+0000","last_became_active":"2024-09-19T06:09:59.774393+0000","last_became_peered":"2024-09-19T06:09:59.774393+0000","last_unstale":"2024-09-19T06:10:31.824516+0000","last_undegraded":"2024-09-19T06:10:31.824516+0000","last_fullsized":"2024-09-19T06:10:31.824516+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:39:05.904778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816888+0000","last_change":"2024-09-19T06:10:02.516445+0000","last_active":"2024-09-19T06:10:31.816888+0000","last_peered":"2024-09-19T06:10:31.816888+0000","last_clean":"2024-09-19T06:10:31.816888+0000","last_became_active":"2024-09-19T06:10:02.515524+0000","last_became_peered":"2024-09-19T06:10:02.515524+0000","last_unstale":"2024-09-19T06:10:31.816888+0000","last_undegraded":"2024-09-19T06:10:31.816888+0000","last_fullsized":"2024-09-19T06:10:31.816888+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:42.863526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'15","reported_seq":57,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:34.526289+0000","last_change":"2024-09-19T06:10:31.834659+0000","last_active":"2024-09-19T06:10:34.526289+0000","last_peered":"2024-09-19T06:10:34.526289+0000","last_clean":"2024-09-19T06:10:34.526289+0000","last_became_active":"2024-09-19T06:10:31.825992+0000","last_became_peered":"2024-09-19T06:10:31.825992+0000","last_unstale":"2024-09-19T06:10:34.526289+0000","last_undegraded":"2024-09-19T06:10:34.526289+0000","last_fullsized":"2024-09-19T06:10:34.526289+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:16.208213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822787+0000","last_change":"2024-09-19T06:10:02.532473+0000","last_active":"2024-09-19T06:10:31.822787+0000","last_peered":"2024-09-19T06:10:31.822787+0000","last_clean":"2024-09-19T06:10:31.822787+0000","last_became_active":"2024-09-19T06:10:02.531745+0000","last_became_peered":"2024-09-19T06:10:02.531745+0000","last_unstale":"2024-09-19T06:10:31.822787+0000","last_undegraded":"2024-09-19T06:10:31.822787+0000","last_fullsized":"2024-09-19T06:10:31.822787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:22.659626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819369+0000","last_change":"2024-09-19T06:10:00.231383+0000","last_active":"2024-09-19T06:10:31.819369+0000","last_peered":"2024-09-19T06:10:31.819369+0000","last_clean":"2024-09-19T06:10:31.819369+0000","last_became_active":"2024-09-19T06:10:00.231016+0000","last_became_peered":"2024-09-19T06:10:00.231016+0000","last_unstale":"2024-09-19T06:10:31.819369+0000","last_undegraded":"2024-09-19T06:10:31.819369+0000","last_fullsized":"2024-09-19T06:10:31.819369+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:39:07.178556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816556+0000","last_change":"2024-09-19T06:10:02.532772+0000","last_active":"2024-09-19T06:10:31.816556+0000","last_peered":"2024-09-19T06:10:31.816556+0000","last_clean":"2024-09-19T06:10:31.816556+0000","last_became_active":"2024-09-19T06:10:02.528187+0000","last_became_peered":"2024-09-19T06:10:02.528187+0000","last_unstale":"2024-09-19T06:10:31.816556+0000","last_undegraded":"2024-09-19T06:10:31.816556+0000","last_fullsized":"2024-09-19T06:10:31.816556+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:35.550221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.950081+0000","last_change":"2024-09-19T06:09:59.774860+0000","last_active":"2024-09-19T06:10:31.950081+0000","last_peered":"2024-09-19T06:10:31.950081+0000","last_clean":"2024-09-19T06:10:31.950081+0000","last_became_active":"2024-09-19T06:09:59.774525+0000","last_became_peered":"2024-09-19T06:09:59.774525+0000","last_unstale":"2024-09-19T06:10:31.950081+0000","last_undegraded":"2024-09-19T06:10:31.950081+0000","last_fullsized":"2024-09-19T06:10:31.950081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:28.480611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823598+0000","last_change":"2024-09-19T06:10:02.514951+0000","last_active":"2024-09-19T06:10:31.823598+0000","last_peered":"2024-09-19T06:10:31.823598+0000","last_clean":"2024-09-19T06:10:31.823598+0000","last_became_active":"2024-09-19T06:10:02.514632+0000","last_became_peered":"2024-09-19T06:10:02.514632+0000","last_unstale":"2024-09-19T06:10:31.823598+0000","last_undegraded":"2024-09-19T06:10:31.823598+0000","last_fullsized":"2024-09-19T06:10:31.823598+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:58.225253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822496+0000","last_change":"2024-09-19T06:09:59.496203+0000","last_active":"2024-09-19T06:10:31.822496+0000","last_peered":"2024-09-19T06:10:31.822496+0000","last_clean":"2024-09-19T06:10:31.822496+0000","last_became_active":"2024-09-19T06:09:59.495854+0000","last_became_peered":"2024-09-19T06:09:59.495854+0000","last_unstale":"2024-09-19T06:10:31.822496+0000","last_undegraded":"2024-09-19T06:10:31.822496+0000","last_fullsized":"2024-09-19T06:10:31.822496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:43.388624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819866+0000","last_change":"2024-09-19T06:10:02.521713+0000","last_active":"2024-09-19T06:10:31.819866+0000","last_peered":"2024-09-19T06:10:31.819866+0000","last_clean":"2024-09-19T06:10:31.819866+0000","last_became_active":"2024-09-19T06:10:02.521389+0000","last_became_peered":"2024-09-19T06:10:02.521389+0000","last_unstale":"2024-09-19T06:10:31.819866+0000","last_undegraded":"2024-09-19T06:10:31.819866+0000","last_fullsized":"2024-09-19T06:10:31.819866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:34.441627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819038+0000","last_change":"2024-09-19T06:09:59.492636+0000","last_active":"2024-09-19T06:10:31.819038+0000","last_peered":"2024-09-19T06:10:31.819038+0000","last_clean":"2024-09-19T06:10:31.819038+0000","last_became_active":"2024-09-19T06:09:59.491801+0000","last_became_peered":"2024-09-19T06:09:59.491801+0000","last_unstale":"2024-09-19T06:10:31.819038+0000","last_undegraded":"2024-09-19T06:10:31.819038+0000","last_fullsized":"2024-09-19T06:10:31.819038+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:27.911582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822238+0000","last_change":"2024-09-19T06:10:02.527073+0000","last_active":"2024-09-19T06:10:31.822238+0000","last_peered":"2024-09-19T06:10:31.822238+0000","last_clean":"2024-09-19T06:10:31.822238+0000","last_became_active":"2024-09-19T06:10:02.525847+0000","last_became_peered":"2024-09-19T06:10:02.525847+0000","last_unstale":"2024-09-19T06:10:31.822238+0000","last_undegraded":"2024-09-19T06:10:31.822238+0000","last_fullsized":"2024-09-19T06:10:31.822238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:22.717353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823978+0000","last_change":"2024-09-19T06:09:59.493905+0000","last_active":"2024-09-19T06:10:31.823978+0000","last_peered":"2024-09-19T06:10:31.823978+0000","last_clean":"2024-09-19T06:10:31.823978+0000","last_became_active":"2024-09-19T06:09:59.493517+0000","last_became_peered":"2024-09-19T06:09:59.493517+0000","last_unstale":"2024-09-19T06:10:31.823978+0000","last_undegraded":"2024-09-19T06:10:31.823978+0000","last_fullsized":"2024-09-19T06:10:31.823978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:22.959756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822361+0000","last_change":"2024-09-19T06:10:02.518002+0000","last_active":"2024-09-19T06:10:31.822361+0000","last_peered":"2024-09-19T06:10:31.822361+0000","last_clean":"2024-09-19T06:10:31.822361+0000","last_became_active":"2024-09-19T06:10:02.517492+0000","last_became_peered":"2024-09-19T06:10:02.517492+0000","last_unstale":"2024-09-19T06:10:31.822361+0000","last_undegraded":"2024-09-19T06:10:31.822361+0000","last_fullsized":"2024-09-19T06:10:31.822361+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:58.935232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.951506+0000","last_change":"2024-09-19T06:10:31.951506+0000","last_active":"2024-09-19T06:10:31.951506+0000","last_peered":"2024-09-19T06:10:31.951506+0000","last_clean":"2024-09-19T06:10:31.951506+0000","last_became_active":"2024-09-19T06:10:31.951079+0000","last_became_peered":"2024-09-19T06:10:31.951079+0000","last_unstale":"2024-09-19T06:10:31.951506+0000","last_undegraded":"2024-09-19T06:10:31.951506+0000","last_fullsized":"2024-09-19T06:10:31.951506+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:53.978445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824216+0000","last_change":"2024-09-19T06:09:59.496546+0000","last_active":"2024-09-19T06:10:31.824216+0000","last_peered":"2024-09-19T06:10:31.824216+0000","last_clean":"2024-09-19T06:10:31.824216+0000","last_became_active":"2024-09-19T06:09:59.496195+0000","last_became_peered":"2024-09-19T06:09:59.496195+0000","last_unstale":"2024-09-19T06:10:31.824216+0000","last_undegraded":"2024-09-19T06:10:31.824216+0000","last_fullsized":"2024-09-19T06:10:31.824216+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:58.443134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.950061+0000","last_change":"2024-09-19T06:10:02.522270+0000","last_active":"2024-09-19T06:10:31.950061+0000","last_peered":"2024-09-19T06:10:31.950061+0000","last_clean":"2024-09-19T06:10:31.950061+0000","last_became_active":"2024-09-19T06:10:02.517109+0000","last_became_peered":"2024-09-19T06:10:02.517109+0000","last_unstale":"2024-09-19T06:10:31.950061+0000","last_undegraded":"2024-09-19T06:10:31.950061+0000","last_fullsized":"2024-09-19T06:10:31.950061+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:56.967980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824448+0000","last_change":"2024-09-19T06:09:59.494016+0000","last_active":"2024-09-19T06:10:31.824448+0000","last_peered":"2024-09-19T06:10:31.824448+0000","last_clean":"2024-09-19T06:10:31.824448+0000","last_became_active":"2024-09-19T06:09:59.493525+0000","last_became_peered":"2024-09-19T06:09:59.493525+0000","last_unstale":"2024-09-19T06:10:31.824448+0000","last_undegraded":"2024-09-19T06:10:31.824448+0000","last_fullsized":"2024-09-19T06:10:31.824448+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:06.650633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.817372+0000","last_change":"2024-09-19T06:10:02.531329+0000","last_active":"2024-09-19T06:10:31.817372+0000","last_peered":"2024-09-19T06:10:31.817372+0000","last_clean":"2024-09-19T06:10:31.817372+0000","last_became_active":"2024-09-19T06:10:02.527107+0000","last_became_peered":"2024-09-19T06:10:02.527107+0000","last_unstale":"2024-09-19T06:10:31.817372+0000","last_undegraded":"2024-09-19T06:10:31.817372+0000","last_fullsized":"2024-09-19T06:10:31.817372+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:25.891416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823419+0000","last_change":"2024-09-19T06:09:59.774966+0000","last_active":"2024-09-19T06:10:31.823419+0000","last_peered":"2024-09-19T06:10:31.823419+0000","last_clean":"2024-09-19T06:10:31.823419+0000","last_became_active":"2024-09-19T06:09:59.774038+0000","last_became_peered":"2024-09-19T06:09:59.774038+0000","last_unstale":"2024-09-19T06:10:31.823419+0000","last_undegraded":"2024-09-19T06:10:31.823419+0000","last_fullsized":"2024-09-19T06:10:31.823419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:54.703512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824217+0000","last_change":"2024-09-19T06:10:31.824217+0000","last_active":"2024-09-19T06:10:31.824217+0000","last_peered":"2024-09-19T06:10:31.824217+0000","last_clean":"2024-09-19T06:10:31.824217+0000","last_became_active":"2024-09-19T06:10:31.823867+0000","last_became_peered":"2024-09-19T06:10:31.823867+0000","last_unstale":"2024-09-19T06:10:31.824217+0000","last_undegraded":"2024-09-19T06:10:31.824217+0000","last_fullsized":"2024-09-19T06:10:31.824217+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:53.261746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":119,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:11:15.015953+0000","last_change":"2024-09-19T06:10:31.962041+0000","last_active":"2024-09-19T06:11:15.015953+0000","last_peered":"2024-09-19T06:11:15.015953+0000","last_clean":"2024-09-19T06:11:15.015953+0000","last_became_active":"2024-09-19T06:10:31.952142+0000","last_became_peered":"2024-09-19T06:10:31.952142+0000","last_unstale":"2024-09-19T06:11:15.015953+0000","last_undegraded":"2024-09-19T06:11:15.015953+0000","last_fullsized":"2024-09-19T06:11:15.015953+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:30.304256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66972,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":606,"num_read_kb":383,"num_write":245,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2857,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":200916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282250,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449117,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":468494,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678051,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1118208,"data_stored":1118272,"data_compressed":41671,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841575,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":467409,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103214,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":974848,"data_stored":467115,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332148,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1036288,"data_stored":1060700,"data_compressed":41671,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495673,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":970752,"data_stored":467519,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757311,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1040384,"data_stored":1058970,"data_compressed":41671,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920836,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":978944,"data_stored":468157,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149769,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":466951,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":527246,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":528868,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":991232,"data_stored":468465,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34250,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34250,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34250,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":62581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":60959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:11:22.718 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:11:23.101 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:23.240 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:22 smithi003 ceph-mon[30893]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:11:23.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:22 smithi059 ceph-mon[35138]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:11:23.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:22 smithi071 ceph-mon[35662]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:11:23.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.836+0000 7f57af000640 1 -- 172.21.15.3:0/2583785174 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57a8103e30 msgr2=0x7f57a8104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:23.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.836+0000 7f57af000640 1 --2- 172.21.15.3:0/2583785174 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57a8103e30 0x7f57a8104210 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f579c009ca0 tx=0x7f579c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:11:23.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.836+0000 7f57af000640 1 -- 172.21.15.3:0/2583785174 shutdown_connections 2024-09-19T06:11:23.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.836+0000 7f57af000640 1 --2- 172.21.15.3:0/2583785174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57a8108f60 0x7f57a8110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:23.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.836+0000 7f57af000640 1 --2- 172.21.15.3:0/2583785174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57a81047e0 0x7f57a8108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:23.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.836+0000 7f57af000640 1 --2- 172.21.15.3:0/2583785174 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57a8103e30 0x7f57a8104210 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:23.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.836+0000 7f57af000640 1 -- 172.21.15.3:0/2583785174 >> 172.21.15.3:0/2583785174 conn(0x7f57a80ff8d0 msgr2=0x7f57a8101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:23.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.836+0000 7f57af000640 1 -- 172.21.15.3:0/2583785174 shutdown_connections 2024-09-19T06:11:23.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.836+0000 7f57af000640 1 -- 172.21.15.3:0/2583785174 wait complete. 2024-09-19T06:11:23.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.837+0000 7f57af000640 1 Processor -- start 2024-09-19T06:11:23.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.837+0000 7f57af000640 1 -- start start 2024-09-19T06:11:23.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.837+0000 7f57af000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57a8103e30 0x7f57a819a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:23.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.837+0000 7f57af000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57a81047e0 0x7f57a819a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:23.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.837+0000 7f57af000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57a8108f60 0x7f57a819ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:23.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.837+0000 7f57af000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f57a8114010 con 0x7f57a8108f60 2024-09-19T06:11:23.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.837+0000 7f57af000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f57a8113e90 con 0x7f57a8103e30 2024-09-19T06:11:23.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.837+0000 7f57af000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f57a8114190 con 0x7f57a81047e0 2024-09-19T06:11:23.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.838+0000 7f57adc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57a8103e30 0x7f57a819a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:23.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.838+0000 7f57ae600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57a8108f60 0x7f57a819ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:23.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.838+0000 7f57adc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57a8103e30 0x7f57a819a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:54874/0 (socket says 172.21.15.3:54874) 2024-09-19T06:11:23.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.838+0000 7f57adc00640 1 -- 172.21.15.3:0/1323288071 learned_addr learned my addr 172.21.15.3:0/1323288071 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:23.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.838+0000 7f57ad200640 1 --2- 172.21.15.3:0/1323288071 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57a81047e0 0x7f57a819a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:23.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.838+0000 7f57adc00640 1 -- 172.21.15.3:0/1323288071 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57a81047e0 msgr2=0x7f57a819a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:23.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.838+0000 7f57adc00640 1 --2- 172.21.15.3:0/1323288071 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57a81047e0 0x7f57a819a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:23.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.838+0000 7f57adc00640 1 -- 172.21.15.3:0/1323288071 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57a8108f60 msgr2=0x7f57a819ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:23.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.838+0000 7f57adc00640 1 --2- 172.21.15.3:0/1323288071 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57a8108f60 0x7f57a819ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:23.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.838+0000 7f57adc00640 1 -- 172.21.15.3:0/1323288071 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57a819f400 con 0x7f57a8103e30 2024-09-19T06:11:23.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.839+0000 7f57adc00640 1 --2- 172.21.15.3:0/1323288071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57a8103e30 0x7f57a819a450 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f579c005e30 tx=0x7f579c003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:23.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.839+0000 7f57a6000640 1 -- 172.21.15.3:0/1323288071 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c031650 con 0x7f57a8103e30 2024-09-19T06:11:23.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.839+0000 7f57af000640 1 -- 172.21.15.3:0/1323288071 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57a819f690 con 0x7f57a8103e30 2024-09-19T06:11:23.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.839+0000 7f57a6000640 1 -- 172.21.15.3:0/1323288071 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f579c0317f0 con 0x7f57a8103e30 2024-09-19T06:11:23.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.839+0000 7f57a6000640 1 -- 172.21.15.3:0/1323288071 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c02fa30 con 0x7f57a8103e30 2024-09-19T06:11:23.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.839+0000 7f57af000640 1 -- 172.21.15.3:0/1323288071 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57a81a6fd0 con 0x7f57a8103e30 2024-09-19T06:11:23.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.840+0000 7f57af000640 1 -- 172.21.15.3:0/1323288071 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57a8104210 con 0x7f57a8103e30 2024-09-19T06:11:23.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.842+0000 7f57a6000640 1 -- 172.21.15.3:0/1323288071 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f579c02fbf0 con 0x7f57a8103e30 2024-09-19T06:11:23.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.843+0000 7f57a6000640 1 --2- 172.21.15.3:0/1323288071 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f57900a32d0 0x7f57900a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:23.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.844+0000 7f57a6000640 1 -- 172.21.15.3:0/1323288071 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f579c0f0e00 con 0x7f57a8103e30 2024-09-19T06:11:23.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.844+0000 7f57ad200640 1 --2- 172.21.15.3:0/1323288071 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f57900a32d0 0x7f57900a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:23.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.844+0000 7f57ad200640 1 --2- 172.21.15.3:0/1323288071 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f57900a32d0 0x7f57900a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f57940095f0 tx=0x7f5794005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:23.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:23.845+0000 7f57a6000640 1 -- 172.21.15.3:0/1323288071 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f579c0bda50 con 0x7f57a8103e30 2024-09-19T06:11:24.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:24.028+0000 7f57af000640 1 -- 172.21.15.3:0/1323288071 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f57a810c1b0 con 0x7f57900a32d0 2024-09-19T06:11:24.031 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:23 smithi003 ceph-mon[30893]: pgmap v344: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:24.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:24.038+0000 7f57a6000640 1 -- 172.21.15.3:0/1323288071 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259032 (secure 0 0 0) 0x7f579401b3f0 con 0x7f57900a32d0 2024-09-19T06:11:24.044 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:11:24.045 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-19T06:11:24.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:24.042+0000 7f57af000640 1 -- 172.21.15.3:0/1323288071 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f57900a32d0 msgr2=0x7f57900a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:24.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:24.042+0000 7f57af000640 1 --2- 172.21.15.3:0/1323288071 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f57900a32d0 0x7f57900a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f57940095f0 tx=0x7f5794005f90 comp rx=0 tx=0).stop 2024-09-19T06:11:24.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:24.042+0000 7f57af000640 1 -- 172.21.15.3:0/1323288071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57a8103e30 msgr2=0x7f57a819a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:24.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:24.042+0000 7f57af000640 1 --2- 172.21.15.3:0/1323288071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57a8103e30 0x7f57a819a450 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f579c005e30 tx=0x7f579c003f90 comp rx=0 tx=0).stop 2024-09-19T06:11:24.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:24.042+0000 7f57af000640 1 -- 172.21.15.3:0/1323288071 shutdown_connections 2024-09-19T06:11:24.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:24.042+0000 7f57af000640 1 --2- 172.21.15.3:0/1323288071 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f57900a32d0 0x7f57900a5790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:24.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:24.042+0000 7f57af000640 1 --2- 172.21.15.3:0/1323288071 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57a8108f60 0x7f57a819ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:24.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:24.042+0000 7f57af000640 1 --2- 172.21.15.3:0/1323288071 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57a81047e0 0x7f57a819a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:24.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:24.042+0000 7f57af000640 1 --2- 172.21.15.3:0/1323288071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57a8103e30 0x7f57a819a450 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:24.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:24.042+0000 7f57af000640 1 -- 172.21.15.3:0/1323288071 >> 172.21.15.3:0/1323288071 conn(0x7f57a80ff8d0 msgr2=0x7f57a8100bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:24.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:24.042+0000 7f57af000640 1 -- 172.21.15.3:0/1323288071 shutdown_connections 2024-09-19T06:11:24.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:24.042+0000 7f57af000640 1 -- 172.21.15.3:0/1323288071 wait complete. 2024-09-19T06:11:24.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:23 smithi059 ceph-mon[35138]: pgmap v344: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:24.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:23 smithi071 ceph-mon[35662]: pgmap v344: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:24.880 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2024-09-19T06:11:22.151391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657574,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":777,"num_read_kb":522,"num_write":428,"num_write_kb":3075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1183593,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":349,"ondisk_log_size":349,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365308,"kb_used_data":11856,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576516,"statfs":{"total":1151940427776,"available":1151566352384,"internally_reserved":0,"allocated":12140544,"data_stored":7568166,"data_compressed":176952,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19140,"internal_metadata":361674044},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003232"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.821380+0000","last_change":"2024-09-19T06:10:02.531329+0000","last_active":"2024-09-19T06:10:31.821380+0000","last_peered":"2024-09-19T06:10:31.821380+0000","last_clean":"2024-09-19T06:10:31.821380+0000","last_became_active":"2024-09-19T06:10:02.530997+0000","last_became_peered":"2024-09-19T06:10:02.530997+0000","last_unstale":"2024-09-19T06:10:31.821380+0000","last_undegraded":"2024-09-19T06:10:31.821380+0000","last_fullsized":"2024-09-19T06:10:31.821380+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:15.240495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816455+0000","last_change":"2024-09-19T06:10:02.526083+0000","last_active":"2024-09-19T06:10:31.816455+0000","last_peered":"2024-09-19T06:10:31.816455+0000","last_clean":"2024-09-19T06:10:31.816455+0000","last_became_active":"2024-09-19T06:10:02.522889+0000","last_became_peered":"2024-09-19T06:10:02.522889+0000","last_unstale":"2024-09-19T06:10:31.816455+0000","last_undegraded":"2024-09-19T06:10:31.816455+0000","last_fullsized":"2024-09-19T06:10:31.816455+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:19.735866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816994+0000","last_change":"2024-09-19T06:10:02.531779+0000","last_active":"2024-09-19T06:10:31.816994+0000","last_peered":"2024-09-19T06:10:31.816994+0000","last_clean":"2024-09-19T06:10:31.816994+0000","last_became_active":"2024-09-19T06:10:02.526795+0000","last_became_peered":"2024-09-19T06:10:02.526795+0000","last_unstale":"2024-09-19T06:10:31.816994+0000","last_undegraded":"2024-09-19T06:10:31.816994+0000","last_fullsized":"2024-09-19T06:10:31.816994+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:28.800773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819230+0000","last_change":"2024-09-19T06:10:02.518697+0000","last_active":"2024-09-19T06:10:31.819230+0000","last_peered":"2024-09-19T06:10:31.819230+0000","last_clean":"2024-09-19T06:10:31.819230+0000","last_became_active":"2024-09-19T06:10:02.518114+0000","last_became_peered":"2024-09-19T06:10:02.518114+0000","last_unstale":"2024-09-19T06:10:31.819230+0000","last_undegraded":"2024-09-19T06:10:31.819230+0000","last_fullsized":"2024-09-19T06:10:31.819230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:08.172638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823875+0000","last_change":"2024-09-19T06:10:02.520450+0000","last_active":"2024-09-19T06:10:31.823875+0000","last_peered":"2024-09-19T06:10:31.823875+0000","last_clean":"2024-09-19T06:10:31.823875+0000","last_became_active":"2024-09-19T06:10:02.519079+0000","last_became_peered":"2024-09-19T06:10:02.519079+0000","last_unstale":"2024-09-19T06:10:31.823875+0000","last_undegraded":"2024-09-19T06:10:31.823875+0000","last_fullsized":"2024-09-19T06:10:31.823875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:47.502020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815408+0000","last_change":"2024-09-19T06:10:02.518567+0000","last_active":"2024-09-19T06:10:31.815408+0000","last_peered":"2024-09-19T06:10:31.815408+0000","last_clean":"2024-09-19T06:10:31.815408+0000","last_became_active":"2024-09-19T06:10:02.517568+0000","last_became_peered":"2024-09-19T06:10:02.517568+0000","last_unstale":"2024-09-19T06:10:31.815408+0000","last_undegraded":"2024-09-19T06:10:31.815408+0000","last_fullsized":"2024-09-19T06:10:31.815408+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:10.245189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822197+0000","last_change":"2024-09-19T06:10:02.521844+0000","last_active":"2024-09-19T06:10:31.822197+0000","last_peered":"2024-09-19T06:10:31.822197+0000","last_clean":"2024-09-19T06:10:31.822197+0000","last_became_active":"2024-09-19T06:10:02.521522+0000","last_became_peered":"2024-09-19T06:10:02.521522+0000","last_unstale":"2024-09-19T06:10:31.822197+0000","last_undegraded":"2024-09-19T06:10:31.822197+0000","last_fullsized":"2024-09-19T06:10:31.822197+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:46.166077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.821465+0000","last_change":"2024-09-19T06:10:02.526977+0000","last_active":"2024-09-19T06:10:31.821465+0000","last_peered":"2024-09-19T06:10:31.821465+0000","last_clean":"2024-09-19T06:10:31.821465+0000","last_became_active":"2024-09-19T06:10:02.526036+0000","last_became_peered":"2024-09-19T06:10:02.526036+0000","last_unstale":"2024-09-19T06:10:31.821465+0000","last_undegraded":"2024-09-19T06:10:31.821465+0000","last_fullsized":"2024-09-19T06:10:31.821465+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:43:28.587020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.950831+0000","last_change":"2024-09-19T06:10:02.524721+0000","last_active":"2024-09-19T06:10:31.950831+0000","last_peered":"2024-09-19T06:10:31.950831+0000","last_clean":"2024-09-19T06:10:31.950831+0000","last_became_active":"2024-09-19T06:10:02.523871+0000","last_became_peered":"2024-09-19T06:10:02.523871+0000","last_unstale":"2024-09-19T06:10:31.950831+0000","last_undegraded":"2024-09-19T06:10:31.950831+0000","last_fullsized":"2024-09-19T06:10:31.950831+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:31.324530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815849+0000","last_change":"2024-09-19T06:10:02.518494+0000","last_active":"2024-09-19T06:10:31.815849+0000","last_peered":"2024-09-19T06:10:31.815849+0000","last_clean":"2024-09-19T06:10:31.815849+0000","last_became_active":"2024-09-19T06:10:02.518140+0000","last_became_peered":"2024-09-19T06:10:02.518140+0000","last_unstale":"2024-09-19T06:10:31.815849+0000","last_undegraded":"2024-09-19T06:10:31.815849+0000","last_fullsized":"2024-09-19T06:10:31.815849+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:42.695222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822993+0000","last_change":"2024-09-19T06:10:02.524697+0000","last_active":"2024-09-19T06:10:31.822993+0000","last_peered":"2024-09-19T06:10:31.822993+0000","last_clean":"2024-09-19T06:10:31.822993+0000","last_became_active":"2024-09-19T06:10:02.524094+0000","last_became_peered":"2024-09-19T06:10:02.524094+0000","last_unstale":"2024-09-19T06:10:31.822993+0000","last_undegraded":"2024-09-19T06:10:31.822993+0000","last_fullsized":"2024-09-19T06:10:31.822993+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:12.591847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819323+0000","last_change":"2024-09-19T06:10:02.515878+0000","last_active":"2024-09-19T06:10:31.819323+0000","last_peered":"2024-09-19T06:10:31.819323+0000","last_clean":"2024-09-19T06:10:31.819323+0000","last_became_active":"2024-09-19T06:10:02.515456+0000","last_became_peered":"2024-09-19T06:10:02.515456+0000","last_unstale":"2024-09-19T06:10:31.819323+0000","last_undegraded":"2024-09-19T06:10:31.819323+0000","last_fullsized":"2024-09-19T06:10:31.819323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:58.687431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824936+0000","last_change":"2024-09-19T06:10:31.824936+0000","last_active":"2024-09-19T06:10:31.824936+0000","last_peered":"2024-09-19T06:10:31.824936+0000","last_clean":"2024-09-19T06:10:31.824936+0000","last_became_active":"2024-09-19T06:10:31.824611+0000","last_became_peered":"2024-09-19T06:10:31.824611+0000","last_unstale":"2024-09-19T06:10:31.824936+0000","last_undegraded":"2024-09-19T06:10:31.824936+0000","last_fullsized":"2024-09-19T06:10:31.824936+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:36.397693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815684+0000","last_change":"2024-09-19T06:10:02.513397+0000","last_active":"2024-09-19T06:10:31.815684+0000","last_peered":"2024-09-19T06:10:31.815684+0000","last_clean":"2024-09-19T06:10:31.815684+0000","last_became_active":"2024-09-19T06:10:02.513011+0000","last_became_peered":"2024-09-19T06:10:02.513011+0000","last_unstale":"2024-09-19T06:10:31.815684+0000","last_undegraded":"2024-09-19T06:10:31.815684+0000","last_fullsized":"2024-09-19T06:10:31.815684+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:06:03.509401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815644+0000","last_change":"2024-09-19T06:10:02.521623+0000","last_active":"2024-09-19T06:10:31.815644+0000","last_peered":"2024-09-19T06:10:31.815644+0000","last_clean":"2024-09-19T06:10:31.815644+0000","last_became_active":"2024-09-19T06:10:02.519371+0000","last_became_peered":"2024-09-19T06:10:02.519371+0000","last_unstale":"2024-09-19T06:10:31.815644+0000","last_undegraded":"2024-09-19T06:10:31.815644+0000","last_fullsized":"2024-09-19T06:10:31.815644+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:10.687026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.949882+0000","last_change":"2024-09-19T06:10:02.520865+0000","last_active":"2024-09-19T06:10:31.949882+0000","last_peered":"2024-09-19T06:10:31.949882+0000","last_clean":"2024-09-19T06:10:31.949882+0000","last_became_active":"2024-09-19T06:10:02.519683+0000","last_became_peered":"2024-09-19T06:10:02.519683+0000","last_unstale":"2024-09-19T06:10:31.949882+0000","last_undegraded":"2024-09-19T06:10:31.949882+0000","last_fullsized":"2024-09-19T06:10:31.949882+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:40.320474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.821336+0000","last_change":"2024-09-19T06:10:02.531552+0000","last_active":"2024-09-19T06:10:31.821336+0000","last_peered":"2024-09-19T06:10:31.821336+0000","last_clean":"2024-09-19T06:10:31.821336+0000","last_became_active":"2024-09-19T06:10:02.531081+0000","last_became_peered":"2024-09-19T06:10:02.531081+0000","last_unstale":"2024-09-19T06:10:31.821336+0000","last_undegraded":"2024-09-19T06:10:31.821336+0000","last_fullsized":"2024-09-19T06:10:31.821336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:07.835754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820977+0000","last_change":"2024-09-19T06:10:02.509088+0000","last_active":"2024-09-19T06:10:31.820977+0000","last_peered":"2024-09-19T06:10:31.820977+0000","last_clean":"2024-09-19T06:10:31.820977+0000","last_became_active":"2024-09-19T06:10:02.508752+0000","last_became_peered":"2024-09-19T06:10:02.508752+0000","last_unstale":"2024-09-19T06:10:31.820977+0000","last_undegraded":"2024-09-19T06:10:31.820977+0000","last_fullsized":"2024-09-19T06:10:31.820977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:36.832952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819925+0000","last_change":"2024-09-19T06:10:02.534694+0000","last_active":"2024-09-19T06:10:31.819925+0000","last_peered":"2024-09-19T06:10:31.819925+0000","last_clean":"2024-09-19T06:10:31.819925+0000","last_became_active":"2024-09-19T06:10:02.534384+0000","last_became_peered":"2024-09-19T06:10:02.534384+0000","last_unstale":"2024-09-19T06:10:31.819925+0000","last_undegraded":"2024-09-19T06:10:31.819925+0000","last_fullsized":"2024-09-19T06:10:31.819925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:48.006128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819900+0000","last_change":"2024-09-19T06:10:02.521104+0000","last_active":"2024-09-19T06:10:31.819900+0000","last_peered":"2024-09-19T06:10:31.819900+0000","last_clean":"2024-09-19T06:10:31.819900+0000","last_became_active":"2024-09-19T06:10:02.520755+0000","last_became_peered":"2024-09-19T06:10:02.520755+0000","last_unstale":"2024-09-19T06:10:31.819900+0000","last_undegraded":"2024-09-19T06:10:31.819900+0000","last_fullsized":"2024-09-19T06:10:31.819900+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:46.091297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.817016+0000","last_change":"2024-09-19T06:10:02.522048+0000","last_active":"2024-09-19T06:10:31.817016+0000","last_peered":"2024-09-19T06:10:31.817016+0000","last_clean":"2024-09-19T06:10:31.817016+0000","last_became_active":"2024-09-19T06:10:02.521750+0000","last_became_peered":"2024-09-19T06:10:02.521750+0000","last_unstale":"2024-09-19T06:10:31.817016+0000","last_undegraded":"2024-09-19T06:10:31.817016+0000","last_fullsized":"2024-09-19T06:10:31.817016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:07.780609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.950055+0000","last_change":"2024-09-19T06:10:02.527386+0000","last_active":"2024-09-19T06:10:31.950055+0000","last_peered":"2024-09-19T06:10:31.950055+0000","last_clean":"2024-09-19T06:10:31.950055+0000","last_became_active":"2024-09-19T06:10:02.526804+0000","last_became_peered":"2024-09-19T06:10:02.526804+0000","last_unstale":"2024-09-19T06:10:31.950055+0000","last_undegraded":"2024-09-19T06:10:31.950055+0000","last_fullsized":"2024-09-19T06:10:31.950055+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:15.652068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.821745+0000","last_change":"2024-09-19T06:10:02.528521+0000","last_active":"2024-09-19T06:10:31.821745+0000","last_peered":"2024-09-19T06:10:31.821745+0000","last_clean":"2024-09-19T06:10:31.821745+0000","last_became_active":"2024-09-19T06:10:02.528087+0000","last_became_peered":"2024-09-19T06:10:02.528087+0000","last_unstale":"2024-09-19T06:10:31.821745+0000","last_undegraded":"2024-09-19T06:10:31.821745+0000","last_fullsized":"2024-09-19T06:10:31.821745+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:29.176129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819851+0000","last_change":"2024-09-19T06:10:02.518544+0000","last_active":"2024-09-19T06:10:31.819851+0000","last_peered":"2024-09-19T06:10:31.819851+0000","last_clean":"2024-09-19T06:10:31.819851+0000","last_became_active":"2024-09-19T06:10:02.518230+0000","last_became_peered":"2024-09-19T06:10:02.518230+0000","last_unstale":"2024-09-19T06:10:31.819851+0000","last_undegraded":"2024-09-19T06:10:31.819851+0000","last_fullsized":"2024-09-19T06:10:31.819851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:26:32.116211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822472+0000","last_change":"2024-09-19T06:10:02.531859+0000","last_active":"2024-09-19T06:10:31.822472+0000","last_peered":"2024-09-19T06:10:31.822472+0000","last_clean":"2024-09-19T06:10:31.822472+0000","last_became_active":"2024-09-19T06:10:02.531572+0000","last_became_peered":"2024-09-19T06:10:02.531572+0000","last_unstale":"2024-09-19T06:10:31.822472+0000","last_undegraded":"2024-09-19T06:10:31.822472+0000","last_fullsized":"2024-09-19T06:10:31.822472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:34.314977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819440+0000","last_change":"2024-09-19T06:10:02.521292+0000","last_active":"2024-09-19T06:10:31.819440+0000","last_peered":"2024-09-19T06:10:31.819440+0000","last_clean":"2024-09-19T06:10:31.819440+0000","last_became_active":"2024-09-19T06:10:02.520967+0000","last_became_peered":"2024-09-19T06:10:02.520967+0000","last_unstale":"2024-09-19T06:10:31.819440+0000","last_undegraded":"2024-09-19T06:10:31.819440+0000","last_fullsized":"2024-09-19T06:10:31.819440+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:11.318504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820304+0000","last_change":"2024-09-19T06:10:02.521514+0000","last_active":"2024-09-19T06:10:31.820304+0000","last_peered":"2024-09-19T06:10:31.820304+0000","last_clean":"2024-09-19T06:10:31.820304+0000","last_became_active":"2024-09-19T06:10:02.521203+0000","last_became_peered":"2024-09-19T06:10:02.521203+0000","last_unstale":"2024-09-19T06:10:31.820304+0000","last_undegraded":"2024-09-19T06:10:31.820304+0000","last_fullsized":"2024-09-19T06:10:31.820304+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:53.689067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824501+0000","last_change":"2024-09-19T06:10:31.824501+0000","last_active":"2024-09-19T06:10:31.824501+0000","last_peered":"2024-09-19T06:10:31.824501+0000","last_clean":"2024-09-19T06:10:31.824501+0000","last_became_active":"2024-09-19T06:10:31.824161+0000","last_became_peered":"2024-09-19T06:10:31.824161+0000","last_unstale":"2024-09-19T06:10:31.824501+0000","last_undegraded":"2024-09-19T06:10:31.824501+0000","last_fullsized":"2024-09-19T06:10:31.824501+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:28.203581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816369+0000","last_change":"2024-09-19T06:10:02.530351+0000","last_active":"2024-09-19T06:10:31.816369+0000","last_peered":"2024-09-19T06:10:31.816369+0000","last_clean":"2024-09-19T06:10:31.816369+0000","last_became_active":"2024-09-19T06:10:02.529292+0000","last_became_peered":"2024-09-19T06:10:02.529292+0000","last_unstale":"2024-09-19T06:10:31.816369+0000","last_undegraded":"2024-09-19T06:10:31.816369+0000","last_fullsized":"2024-09-19T06:10:31.816369+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:02.324413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819026+0000","last_change":"2024-09-19T06:10:02.534885+0000","last_active":"2024-09-19T06:10:31.819026+0000","last_peered":"2024-09-19T06:10:31.819026+0000","last_clean":"2024-09-19T06:10:31.819026+0000","last_became_active":"2024-09-19T06:10:02.534520+0000","last_became_peered":"2024-09-19T06:10:02.534520+0000","last_unstale":"2024-09-19T06:10:31.819026+0000","last_undegraded":"2024-09-19T06:10:31.819026+0000","last_fullsized":"2024-09-19T06:10:31.819026+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:04.896787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819767+0000","last_change":"2024-09-19T06:10:02.518120+0000","last_active":"2024-09-19T06:10:31.819767+0000","last_peered":"2024-09-19T06:10:31.819767+0000","last_clean":"2024-09-19T06:10:31.819767+0000","last_became_active":"2024-09-19T06:10:02.517595+0000","last_became_peered":"2024-09-19T06:10:02.517595+0000","last_unstale":"2024-09-19T06:10:31.819767+0000","last_undegraded":"2024-09-19T06:10:31.819767+0000","last_fullsized":"2024-09-19T06:10:31.819767+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:00.695783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819720+0000","last_change":"2024-09-19T06:10:02.524413+0000","last_active":"2024-09-19T06:10:31.819720+0000","last_peered":"2024-09-19T06:10:31.819720+0000","last_clean":"2024-09-19T06:10:31.819720+0000","last_became_active":"2024-09-19T06:10:02.523559+0000","last_became_peered":"2024-09-19T06:10:02.523559+0000","last_unstale":"2024-09-19T06:10:31.819720+0000","last_undegraded":"2024-09-19T06:10:31.819720+0000","last_fullsized":"2024-09-19T06:10:31.819720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:04.045759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823856+0000","last_change":"2024-09-19T06:10:02.514572+0000","last_active":"2024-09-19T06:10:31.823856+0000","last_peered":"2024-09-19T06:10:31.823856+0000","last_clean":"2024-09-19T06:10:31.823856+0000","last_became_active":"2024-09-19T06:10:02.513685+0000","last_became_peered":"2024-09-19T06:10:02.513685+0000","last_unstale":"2024-09-19T06:10:31.823856+0000","last_undegraded":"2024-09-19T06:10:31.823856+0000","last_fullsized":"2024-09-19T06:10:31.823856+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:09.108036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:11:16.888669+0000","last_change":"2024-09-19T06:10:31.829554+0000","last_active":"2024-09-19T06:11:16.888669+0000","last_peered":"2024-09-19T06:11:16.888669+0000","last_clean":"2024-09-19T06:11:16.888669+0000","last_became_active":"2024-09-19T06:10:31.824266+0000","last_became_peered":"2024-09-19T06:10:31.824266+0000","last_unstale":"2024-09-19T06:11:16.888669+0000","last_undegraded":"2024-09-19T06:11:16.888669+0000","last_fullsized":"2024-09-19T06:11:16.888669+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:07.241897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":47,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1015,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819853+0000","last_change":"2024-09-19T06:10:02.524271+0000","last_active":"2024-09-19T06:10:31.819853+0000","last_peered":"2024-09-19T06:10:31.819853+0000","last_clean":"2024-09-19T06:10:31.819853+0000","last_became_active":"2024-09-19T06:10:02.523948+0000","last_became_peered":"2024-09-19T06:10:02.523948+0000","last_unstale":"2024-09-19T06:10:31.819853+0000","last_undegraded":"2024-09-19T06:10:31.819853+0000","last_fullsized":"2024-09-19T06:10:31.819853+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:46.406652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815443+0000","last_change":"2024-09-19T06:09:59.493186+0000","last_active":"2024-09-19T06:10:31.815443+0000","last_peered":"2024-09-19T06:10:31.815443+0000","last_clean":"2024-09-19T06:10:31.815443+0000","last_became_active":"2024-09-19T06:09:59.492841+0000","last_became_peered":"2024-09-19T06:09:59.492841+0000","last_unstale":"2024-09-19T06:10:31.815443+0000","last_undegraded":"2024-09-19T06:10:31.815443+0000","last_fullsized":"2024-09-19T06:10:31.815443+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:48.557724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816757+0000","last_change":"2024-09-19T06:09:59.493364+0000","last_active":"2024-09-19T06:10:31.816757+0000","last_peered":"2024-09-19T06:10:31.816757+0000","last_clean":"2024-09-19T06:10:31.816757+0000","last_became_active":"2024-09-19T06:09:59.491868+0000","last_became_peered":"2024-09-19T06:09:59.491868+0000","last_unstale":"2024-09-19T06:10:31.816757+0000","last_undegraded":"2024-09-19T06:10:31.816757+0000","last_fullsized":"2024-09-19T06:10:31.816757+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:23.088768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.821572+0000","last_change":"2024-09-19T06:10:02.534453+0000","last_active":"2024-09-19T06:10:31.821572+0000","last_peered":"2024-09-19T06:10:31.821572+0000","last_clean":"2024-09-19T06:10:31.821572+0000","last_became_active":"2024-09-19T06:10:02.532003+0000","last_became_peered":"2024-09-19T06:10:02.532003+0000","last_unstale":"2024-09-19T06:10:31.821572+0000","last_undegraded":"2024-09-19T06:10:31.821572+0000","last_fullsized":"2024-09-19T06:10:31.821572+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:41.609673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820651+0000","last_change":"2024-09-19T06:09:59.493574+0000","last_active":"2024-09-19T06:10:31.820651+0000","last_peered":"2024-09-19T06:10:31.820651+0000","last_clean":"2024-09-19T06:10:31.820651+0000","last_became_active":"2024-09-19T06:09:59.493243+0000","last_became_peered":"2024-09-19T06:09:59.493243+0000","last_unstale":"2024-09-19T06:10:31.820651+0000","last_undegraded":"2024-09-19T06:10:31.820651+0000","last_fullsized":"2024-09-19T06:10:31.820651+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:12:43.491780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820035+0000","last_change":"2024-09-19T06:10:02.520122+0000","last_active":"2024-09-19T06:10:31.820035+0000","last_peered":"2024-09-19T06:10:31.820035+0000","last_clean":"2024-09-19T06:10:31.820035+0000","last_became_active":"2024-09-19T06:10:02.519795+0000","last_became_peered":"2024-09-19T06:10:02.519795+0000","last_unstale":"2024-09-19T06:10:31.820035+0000","last_undegraded":"2024-09-19T06:10:31.820035+0000","last_fullsized":"2024-09-19T06:10:31.820035+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:12.384824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":160,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:11:20.893480+0000","last_change":"2024-09-19T06:09:59.491192+0000","last_active":"2024-09-19T06:11:20.893480+0000","last_peered":"2024-09-19T06:11:20.893480+0000","last_clean":"2024-09-19T06:11:20.893480+0000","last_became_active":"2024-09-19T06:09:59.490774+0000","last_became_peered":"2024-09-19T06:09:59.490774+0000","last_unstale":"2024-09-19T06:11:20.893480+0000","last_undegraded":"2024-09-19T06:11:20.893480+0000","last_fullsized":"2024-09-19T06:11:20.893480+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:30.276512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":130,"num_read_kb":130,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.950309+0000","last_change":"2024-09-19T06:10:02.516728+0000","last_active":"2024-09-19T06:10:31.950309+0000","last_peered":"2024-09-19T06:10:31.950309+0000","last_clean":"2024-09-19T06:10:31.950309+0000","last_became_active":"2024-09-19T06:10:02.516415+0000","last_became_peered":"2024-09-19T06:10:02.516415+0000","last_unstale":"2024-09-19T06:10:31.950309+0000","last_undegraded":"2024-09-19T06:10:31.950309+0000","last_fullsized":"2024-09-19T06:10:31.950309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:45.012284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822879+0000","last_change":"2024-09-19T06:09:59.499167+0000","last_active":"2024-09-19T06:10:31.822879+0000","last_peered":"2024-09-19T06:10:31.822879+0000","last_clean":"2024-09-19T06:10:31.822879+0000","last_became_active":"2024-09-19T06:09:59.498796+0000","last_became_peered":"2024-09-19T06:09:59.498796+0000","last_unstale":"2024-09-19T06:10:31.822879+0000","last_undegraded":"2024-09-19T06:10:31.822879+0000","last_fullsized":"2024-09-19T06:10:31.822879+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:08.665495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823990+0000","last_change":"2024-09-19T06:10:31.823990+0000","last_active":"2024-09-19T06:10:31.823990+0000","last_peered":"2024-09-19T06:10:31.823990+0000","last_clean":"2024-09-19T06:10:31.823990+0000","last_became_active":"2024-09-19T06:10:31.823448+0000","last_became_peered":"2024-09-19T06:10:31.823448+0000","last_unstale":"2024-09-19T06:10:31.823990+0000","last_undegraded":"2024-09-19T06:10:31.823990+0000","last_fullsized":"2024-09-19T06:10:31.823990+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:33.882448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820128+0000","last_change":"2024-09-19T06:09:59.774875+0000","last_active":"2024-09-19T06:10:31.820128+0000","last_peered":"2024-09-19T06:10:31.820128+0000","last_clean":"2024-09-19T06:10:31.820128+0000","last_became_active":"2024-09-19T06:09:59.774376+0000","last_became_peered":"2024-09-19T06:09:59.774376+0000","last_unstale":"2024-09-19T06:10:31.820128+0000","last_undegraded":"2024-09-19T06:10:31.820128+0000","last_fullsized":"2024-09-19T06:10:31.820128+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:01.283578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.950220+0000","last_change":"2024-09-19T06:10:02.518202+0000","last_active":"2024-09-19T06:10:31.950220+0000","last_peered":"2024-09-19T06:10:31.950220+0000","last_clean":"2024-09-19T06:10:31.950220+0000","last_became_active":"2024-09-19T06:10:02.517865+0000","last_became_peered":"2024-09-19T06:10:02.517865+0000","last_unstale":"2024-09-19T06:10:31.950220+0000","last_undegraded":"2024-09-19T06:10:31.950220+0000","last_fullsized":"2024-09-19T06:10:31.950220+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:28.128891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'31","reported_seq":196,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:11:20.893547+0000","last_change":"2024-09-19T06:09:59.493139+0000","last_active":"2024-09-19T06:11:20.893547+0000","last_peered":"2024-09-19T06:11:20.893547+0000","last_clean":"2024-09-19T06:11:20.893547+0000","last_became_active":"2024-09-19T06:09:59.492768+0000","last_became_peered":"2024-09-19T06:09:59.492768+0000","last_unstale":"2024-09-19T06:11:20.893547+0000","last_undegraded":"2024-09-19T06:11:20.893547+0000","last_fullsized":"2024-09-19T06:11:20.893547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:17.872432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":139,"num_read_kb":127,"num_write":33,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824313+0000","last_change":"2024-09-19T06:10:02.516187+0000","last_active":"2024-09-19T06:10:31.824313+0000","last_peered":"2024-09-19T06:10:31.824313+0000","last_clean":"2024-09-19T06:10:31.824313+0000","last_became_active":"2024-09-19T06:10:02.515888+0000","last_became_peered":"2024-09-19T06:10:02.515888+0000","last_unstale":"2024-09-19T06:10:31.824313+0000","last_undegraded":"2024-09-19T06:10:31.824313+0000","last_fullsized":"2024-09-19T06:10:31.824313+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:29.672889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":37,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819416+0000","last_change":"2024-09-19T06:09:59.492155+0000","last_active":"2024-09-19T06:10:31.819416+0000","last_peered":"2024-09-19T06:10:31.819416+0000","last_clean":"2024-09-19T06:10:31.819416+0000","last_became_active":"2024-09-19T06:09:59.491730+0000","last_became_peered":"2024-09-19T06:09:59.491730+0000","last_unstale":"2024-09-19T06:10:31.819416+0000","last_undegraded":"2024-09-19T06:10:31.819416+0000","last_fullsized":"2024-09-19T06:10:31.819416+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:30.632665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816446+0000","last_change":"2024-09-19T06:10:02.526214+0000","last_active":"2024-09-19T06:10:31.816446+0000","last_peered":"2024-09-19T06:10:31.816446+0000","last_clean":"2024-09-19T06:10:31.816446+0000","last_became_active":"2024-09-19T06:10:02.525846+0000","last_became_peered":"2024-09-19T06:10:02.525846+0000","last_unstale":"2024-09-19T06:10:31.816446+0000","last_undegraded":"2024-09-19T06:10:31.816446+0000","last_fullsized":"2024-09-19T06:10:31.816446+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:14.294741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820233+0000","last_change":"2024-09-19T06:09:59.494814+0000","last_active":"2024-09-19T06:10:31.820233+0000","last_peered":"2024-09-19T06:10:31.820233+0000","last_clean":"2024-09-19T06:10:31.820233+0000","last_became_active":"2024-09-19T06:09:59.494461+0000","last_became_peered":"2024-09-19T06:09:59.494461+0000","last_unstale":"2024-09-19T06:10:31.820233+0000","last_undegraded":"2024-09-19T06:10:31.820233+0000","last_fullsized":"2024-09-19T06:10:31.820233+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:37.730327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823102+0000","last_change":"2024-09-19T06:10:02.518851+0000","last_active":"2024-09-19T06:10:31.823102+0000","last_peered":"2024-09-19T06:10:31.823102+0000","last_clean":"2024-09-19T06:10:31.823102+0000","last_became_active":"2024-09-19T06:10:02.518462+0000","last_became_peered":"2024-09-19T06:10:02.518462+0000","last_unstale":"2024-09-19T06:10:31.823102+0000","last_undegraded":"2024-09-19T06:10:31.823102+0000","last_fullsized":"2024-09-19T06:10:31.823102+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:22.629918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":99,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:11:20.859470+0000","last_change":"2024-09-19T06:09:59.493839+0000","last_active":"2024-09-19T06:11:20.859470+0000","last_peered":"2024-09-19T06:11:20.859470+0000","last_clean":"2024-09-19T06:11:20.859470+0000","last_became_active":"2024-09-19T06:09:59.492323+0000","last_became_peered":"2024-09-19T06:09:59.492323+0000","last_unstale":"2024-09-19T06:11:20.859470+0000","last_undegraded":"2024-09-19T06:11:20.859470+0000","last_fullsized":"2024-09-19T06:11:20.859470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:12.754030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":69,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822340+0000","last_change":"2024-09-19T06:10:02.515957+0000","last_active":"2024-09-19T06:10:31.822340+0000","last_peered":"2024-09-19T06:10:31.822340+0000","last_clean":"2024-09-19T06:10:31.822340+0000","last_became_active":"2024-09-19T06:10:02.515493+0000","last_became_peered":"2024-09-19T06:10:02.515493+0000","last_unstale":"2024-09-19T06:10:31.822340+0000","last_undegraded":"2024-09-19T06:10:31.822340+0000","last_fullsized":"2024-09-19T06:10:31.822340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:06.988155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823601+0000","last_change":"2024-09-19T06:09:59.775131+0000","last_active":"2024-09-19T06:10:31.823601+0000","last_peered":"2024-09-19T06:10:31.823601+0000","last_clean":"2024-09-19T06:10:31.823601+0000","last_became_active":"2024-09-19T06:09:59.774642+0000","last_became_peered":"2024-09-19T06:09:59.774642+0000","last_unstale":"2024-09-19T06:10:31.823601+0000","last_undegraded":"2024-09-19T06:10:31.823601+0000","last_fullsized":"2024-09-19T06:10:31.823601+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:31.722485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819343+0000","last_change":"2024-09-19T06:10:02.522531+0000","last_active":"2024-09-19T06:10:31.819343+0000","last_peered":"2024-09-19T06:10:31.819343+0000","last_clean":"2024-09-19T06:10:31.819343+0000","last_became_active":"2024-09-19T06:10:02.522186+0000","last_became_peered":"2024-09-19T06:10:02.522186+0000","last_unstale":"2024-09-19T06:10:31.819343+0000","last_undegraded":"2024-09-19T06:10:31.819343+0000","last_fullsized":"2024-09-19T06:10:31.819343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:45.689043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824376+0000","last_change":"2024-09-19T06:09:59.494819+0000","last_active":"2024-09-19T06:10:31.824376+0000","last_peered":"2024-09-19T06:10:31.824376+0000","last_clean":"2024-09-19T06:10:31.824376+0000","last_became_active":"2024-09-19T06:09:59.494434+0000","last_became_peered":"2024-09-19T06:09:59.494434+0000","last_unstale":"2024-09-19T06:10:31.824376+0000","last_undegraded":"2024-09-19T06:10:31.824376+0000","last_fullsized":"2024-09-19T06:10:31.824376+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:42.207621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820312+0000","last_change":"2024-09-19T06:10:02.522893+0000","last_active":"2024-09-19T06:10:31.820312+0000","last_peered":"2024-09-19T06:10:31.820312+0000","last_clean":"2024-09-19T06:10:31.820312+0000","last_became_active":"2024-09-19T06:10:02.522596+0000","last_became_peered":"2024-09-19T06:10:02.522596+0000","last_unstale":"2024-09-19T06:10:31.820312+0000","last_undegraded":"2024-09-19T06:10:31.820312+0000","last_fullsized":"2024-09-19T06:10:31.820312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:21.394878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.838085+0000","last_change":"2024-09-19T06:10:31.838085+0000","last_active":"2024-09-19T06:10:31.838085+0000","last_peered":"2024-09-19T06:10:31.838085+0000","last_clean":"2024-09-19T06:10:31.838085+0000","last_became_active":"2024-09-19T06:10:31.826924+0000","last_became_peered":"2024-09-19T06:10:31.826924+0000","last_unstale":"2024-09-19T06:10:31.838085+0000","last_undegraded":"2024-09-19T06:10:31.838085+0000","last_fullsized":"2024-09-19T06:10:31.838085+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:19.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823274+0000","last_change":"2024-09-19T06:10:02.516137+0000","last_active":"2024-09-19T06:10:31.823274+0000","last_peered":"2024-09-19T06:10:31.823274+0000","last_clean":"2024-09-19T06:10:31.823274+0000","last_became_active":"2024-09-19T06:10:02.515769+0000","last_became_peered":"2024-09-19T06:10:02.515769+0000","last_unstale":"2024-09-19T06:10:31.823274+0000","last_undegraded":"2024-09-19T06:10:31.823274+0000","last_fullsized":"2024-09-19T06:10:31.823274+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:56.741950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820246+0000","last_change":"2024-09-19T06:09:59.498177+0000","last_active":"2024-09-19T06:10:31.820246+0000","last_peered":"2024-09-19T06:10:31.820246+0000","last_clean":"2024-09-19T06:10:31.820246+0000","last_became_active":"2024-09-19T06:09:59.497808+0000","last_became_peered":"2024-09-19T06:09:59.497808+0000","last_unstale":"2024-09-19T06:10:31.820246+0000","last_undegraded":"2024-09-19T06:10:31.820246+0000","last_fullsized":"2024-09-19T06:10:31.820246+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:06.473332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822740+0000","last_change":"2024-09-19T06:10:02.526442+0000","last_active":"2024-09-19T06:10:31.822740+0000","last_peered":"2024-09-19T06:10:31.822740+0000","last_clean":"2024-09-19T06:10:31.822740+0000","last_became_active":"2024-09-19T06:10:02.526116+0000","last_became_peered":"2024-09-19T06:10:02.526116+0000","last_unstale":"2024-09-19T06:10:31.822740+0000","last_undegraded":"2024-09-19T06:10:31.822740+0000","last_fullsized":"2024-09-19T06:10:31.822740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:05.000599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":70,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:11:20.894261+0000","last_change":"2024-09-19T06:10:31.829793+0000","last_active":"2024-09-19T06:11:20.894261+0000","last_peered":"2024-09-19T06:11:20.894261+0000","last_clean":"2024-09-19T06:11:20.894261+0000","last_became_active":"2024-09-19T06:10:31.822044+0000","last_became_peered":"2024-09-19T06:10:31.822044+0000","last_unstale":"2024-09-19T06:11:20.894261+0000","last_undegraded":"2024-09-19T06:11:20.894261+0000","last_fullsized":"2024-09-19T06:11:20.894261+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:45.301315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1170,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823112+0000","last_change":"2024-09-19T06:10:02.524435+0000","last_active":"2024-09-19T06:10:31.823112+0000","last_peered":"2024-09-19T06:10:31.823112+0000","last_clean":"2024-09-19T06:10:31.823112+0000","last_became_active":"2024-09-19T06:10:02.523634+0000","last_became_peered":"2024-09-19T06:10:02.523634+0000","last_unstale":"2024-09-19T06:10:31.823112+0000","last_undegraded":"2024-09-19T06:10:31.823112+0000","last_fullsized":"2024-09-19T06:10:31.823112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:07.679183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":350,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822667+0000","last_change":"2024-09-19T06:08:39.873247+0000","last_active":"2024-09-19T06:10:31.822667+0000","last_peered":"2024-09-19T06:10:31.822667+0000","last_clean":"2024-09-19T06:10:31.822667+0000","last_became_active":"2024-09-19T06:08:39.872647+0000","last_became_peered":"2024-09-19T06:08:39.872647+0000","last_unstale":"2024-09-19T06:10:31.822667+0000","last_undegraded":"2024-09-19T06:10:31.822667+0000","last_fullsized":"2024-09-19T06:10:31.822667+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:56.991890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:56.991890+0000","last_clean_scrub_stamp":"2024-09-19T06:04:56.991890+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:18.835510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.818858+0000","last_change":"2024-09-19T06:09:59.492677+0000","last_active":"2024-09-19T06:10:31.818858+0000","last_peered":"2024-09-19T06:10:31.818858+0000","last_clean":"2024-09-19T06:10:31.818858+0000","last_became_active":"2024-09-19T06:09:59.492235+0000","last_became_peered":"2024-09-19T06:09:59.492235+0000","last_unstale":"2024-09-19T06:10:31.818858+0000","last_undegraded":"2024-09-19T06:10:31.818858+0000","last_fullsized":"2024-09-19T06:10:31.818858+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:40.173728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823152+0000","last_change":"2024-09-19T06:10:02.523331+0000","last_active":"2024-09-19T06:10:31.823152+0000","last_peered":"2024-09-19T06:10:31.823152+0000","last_clean":"2024-09-19T06:10:31.823152+0000","last_became_active":"2024-09-19T06:10:02.522896+0000","last_became_peered":"2024-09-19T06:10:02.522896+0000","last_unstale":"2024-09-19T06:10:31.823152+0000","last_undegraded":"2024-09-19T06:10:31.823152+0000","last_fullsized":"2024-09-19T06:10:31.823152+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:56.994375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822479+0000","last_change":"2024-09-19T06:09:59.496407+0000","last_active":"2024-09-19T06:10:31.822479+0000","last_peered":"2024-09-19T06:10:31.822479+0000","last_clean":"2024-09-19T06:10:31.822479+0000","last_became_active":"2024-09-19T06:09:59.496074+0000","last_became_peered":"2024-09-19T06:09:59.496074+0000","last_unstale":"2024-09-19T06:10:31.822479+0000","last_undegraded":"2024-09-19T06:10:31.822479+0000","last_fullsized":"2024-09-19T06:10:31.822479+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:11.257227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815458+0000","last_change":"2024-09-19T06:10:02.515229+0000","last_active":"2024-09-19T06:10:31.815458+0000","last_peered":"2024-09-19T06:10:31.815458+0000","last_clean":"2024-09-19T06:10:31.815458+0000","last_became_active":"2024-09-19T06:10:02.514092+0000","last_became_peered":"2024-09-19T06:10:02.514092+0000","last_unstale":"2024-09-19T06:10:31.815458+0000","last_undegraded":"2024-09-19T06:10:31.815458+0000","last_fullsized":"2024-09-19T06:10:31.815458+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:32:36.805821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":95,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:11:17.854434+0000","last_change":"2024-09-19T06:09:59.777102+0000","last_active":"2024-09-19T06:11:17.854434+0000","last_peered":"2024-09-19T06:11:17.854434+0000","last_clean":"2024-09-19T06:11:17.854434+0000","last_became_active":"2024-09-19T06:09:59.774456+0000","last_became_peered":"2024-09-19T06:09:59.774456+0000","last_unstale":"2024-09-19T06:11:17.854434+0000","last_undegraded":"2024-09-19T06:11:17.854434+0000","last_fullsized":"2024-09-19T06:11:17.854434+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:11.353528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820463+0000","last_change":"2024-09-19T06:10:02.517039+0000","last_active":"2024-09-19T06:10:31.820463+0000","last_peered":"2024-09-19T06:10:31.820463+0000","last_clean":"2024-09-19T06:10:31.820463+0000","last_became_active":"2024-09-19T06:10:02.516291+0000","last_became_peered":"2024-09-19T06:10:02.516291+0000","last_unstale":"2024-09-19T06:10:31.820463+0000","last_undegraded":"2024-09-19T06:10:31.820463+0000","last_fullsized":"2024-09-19T06:10:31.820463+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:27.835967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":96,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:11:18.020467+0000","last_change":"2024-09-19T06:09:59.499496+0000","last_active":"2024-09-19T06:11:18.020467+0000","last_peered":"2024-09-19T06:11:18.020467+0000","last_clean":"2024-09-19T06:11:18.020467+0000","last_became_active":"2024-09-19T06:09:59.499172+0000","last_became_peered":"2024-09-19T06:09:59.499172+0000","last_unstale":"2024-09-19T06:11:18.020467+0000","last_undegraded":"2024-09-19T06:11:18.020467+0000","last_fullsized":"2024-09-19T06:11:18.020467+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:52.062675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815533+0000","last_change":"2024-09-19T06:10:02.523099+0000","last_active":"2024-09-19T06:10:31.815533+0000","last_peered":"2024-09-19T06:10:31.815533+0000","last_clean":"2024-09-19T06:10:31.815533+0000","last_became_active":"2024-09-19T06:10:02.522770+0000","last_became_peered":"2024-09-19T06:10:02.522770+0000","last_unstale":"2024-09-19T06:10:31.815533+0000","last_undegraded":"2024-09-19T06:10:31.815533+0000","last_fullsized":"2024-09-19T06:10:31.815533+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:39.807159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.820720+0000","last_change":"2024-09-19T06:09:59.775371+0000","last_active":"2024-09-19T06:10:31.820720+0000","last_peered":"2024-09-19T06:10:31.820720+0000","last_clean":"2024-09-19T06:10:31.820720+0000","last_became_active":"2024-09-19T06:09:59.774944+0000","last_became_peered":"2024-09-19T06:09:59.774944+0000","last_unstale":"2024-09-19T06:10:31.820720+0000","last_undegraded":"2024-09-19T06:10:31.820720+0000","last_fullsized":"2024-09-19T06:10:31.820720+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:44.305005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.815663+0000","last_change":"2024-09-19T06:10:02.521207+0000","last_active":"2024-09-19T06:10:31.815663+0000","last_peered":"2024-09-19T06:10:31.815663+0000","last_clean":"2024-09-19T06:10:31.815663+0000","last_became_active":"2024-09-19T06:10:02.520843+0000","last_became_peered":"2024-09-19T06:10:02.520843+0000","last_unstale":"2024-09-19T06:10:31.815663+0000","last_undegraded":"2024-09-19T06:10:31.815663+0000","last_fullsized":"2024-09-19T06:10:31.815663+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:39.462042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824516+0000","last_change":"2024-09-19T06:09:59.775259+0000","last_active":"2024-09-19T06:10:31.824516+0000","last_peered":"2024-09-19T06:10:31.824516+0000","last_clean":"2024-09-19T06:10:31.824516+0000","last_became_active":"2024-09-19T06:09:59.774393+0000","last_became_peered":"2024-09-19T06:09:59.774393+0000","last_unstale":"2024-09-19T06:10:31.824516+0000","last_undegraded":"2024-09-19T06:10:31.824516+0000","last_fullsized":"2024-09-19T06:10:31.824516+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:39:05.904778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816888+0000","last_change":"2024-09-19T06:10:02.516445+0000","last_active":"2024-09-19T06:10:31.816888+0000","last_peered":"2024-09-19T06:10:31.816888+0000","last_clean":"2024-09-19T06:10:31.816888+0000","last_became_active":"2024-09-19T06:10:02.515524+0000","last_became_peered":"2024-09-19T06:10:02.515524+0000","last_unstale":"2024-09-19T06:10:31.816888+0000","last_undegraded":"2024-09-19T06:10:31.816888+0000","last_fullsized":"2024-09-19T06:10:31.816888+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:42.863526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'15","reported_seq":57,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:34.526289+0000","last_change":"2024-09-19T06:10:31.834659+0000","last_active":"2024-09-19T06:10:34.526289+0000","last_peered":"2024-09-19T06:10:34.526289+0000","last_clean":"2024-09-19T06:10:34.526289+0000","last_became_active":"2024-09-19T06:10:31.825992+0000","last_became_peered":"2024-09-19T06:10:31.825992+0000","last_unstale":"2024-09-19T06:10:34.526289+0000","last_undegraded":"2024-09-19T06:10:34.526289+0000","last_fullsized":"2024-09-19T06:10:34.526289+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:16.208213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822787+0000","last_change":"2024-09-19T06:10:02.532473+0000","last_active":"2024-09-19T06:10:31.822787+0000","last_peered":"2024-09-19T06:10:31.822787+0000","last_clean":"2024-09-19T06:10:31.822787+0000","last_became_active":"2024-09-19T06:10:02.531745+0000","last_became_peered":"2024-09-19T06:10:02.531745+0000","last_unstale":"2024-09-19T06:10:31.822787+0000","last_undegraded":"2024-09-19T06:10:31.822787+0000","last_fullsized":"2024-09-19T06:10:31.822787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:22.659626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":34,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819369+0000","last_change":"2024-09-19T06:10:00.231383+0000","last_active":"2024-09-19T06:10:31.819369+0000","last_peered":"2024-09-19T06:10:31.819369+0000","last_clean":"2024-09-19T06:10:31.819369+0000","last_became_active":"2024-09-19T06:10:00.231016+0000","last_became_peered":"2024-09-19T06:10:00.231016+0000","last_unstale":"2024-09-19T06:10:31.819369+0000","last_undegraded":"2024-09-19T06:10:31.819369+0000","last_fullsized":"2024-09-19T06:10:31.819369+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:39:07.178556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.816556+0000","last_change":"2024-09-19T06:10:02.532772+0000","last_active":"2024-09-19T06:10:31.816556+0000","last_peered":"2024-09-19T06:10:31.816556+0000","last_clean":"2024-09-19T06:10:31.816556+0000","last_became_active":"2024-09-19T06:10:02.528187+0000","last_became_peered":"2024-09-19T06:10:02.528187+0000","last_unstale":"2024-09-19T06:10:31.816556+0000","last_undegraded":"2024-09-19T06:10:31.816556+0000","last_fullsized":"2024-09-19T06:10:31.816556+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:35.550221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.950081+0000","last_change":"2024-09-19T06:09:59.774860+0000","last_active":"2024-09-19T06:10:31.950081+0000","last_peered":"2024-09-19T06:10:31.950081+0000","last_clean":"2024-09-19T06:10:31.950081+0000","last_became_active":"2024-09-19T06:09:59.774525+0000","last_became_peered":"2024-09-19T06:09:59.774525+0000","last_unstale":"2024-09-19T06:10:31.950081+0000","last_undegraded":"2024-09-19T06:10:31.950081+0000","last_fullsized":"2024-09-19T06:10:31.950081+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:28.480611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823598+0000","last_change":"2024-09-19T06:10:02.514951+0000","last_active":"2024-09-19T06:10:31.823598+0000","last_peered":"2024-09-19T06:10:31.823598+0000","last_clean":"2024-09-19T06:10:31.823598+0000","last_became_active":"2024-09-19T06:10:02.514632+0000","last_became_peered":"2024-09-19T06:10:02.514632+0000","last_unstale":"2024-09-19T06:10:31.823598+0000","last_undegraded":"2024-09-19T06:10:31.823598+0000","last_fullsized":"2024-09-19T06:10:31.823598+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:58.225253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":33,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822496+0000","last_change":"2024-09-19T06:09:59.496203+0000","last_active":"2024-09-19T06:10:31.822496+0000","last_peered":"2024-09-19T06:10:31.822496+0000","last_clean":"2024-09-19T06:10:31.822496+0000","last_became_active":"2024-09-19T06:09:59.495854+0000","last_became_peered":"2024-09-19T06:09:59.495854+0000","last_unstale":"2024-09-19T06:10:31.822496+0000","last_undegraded":"2024-09-19T06:10:31.822496+0000","last_fullsized":"2024-09-19T06:10:31.822496+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:43.388624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819866+0000","last_change":"2024-09-19T06:10:02.521713+0000","last_active":"2024-09-19T06:10:31.819866+0000","last_peered":"2024-09-19T06:10:31.819866+0000","last_clean":"2024-09-19T06:10:31.819866+0000","last_became_active":"2024-09-19T06:10:02.521389+0000","last_became_peered":"2024-09-19T06:10:02.521389+0000","last_unstale":"2024-09-19T06:10:31.819866+0000","last_undegraded":"2024-09-19T06:10:31.819866+0000","last_fullsized":"2024-09-19T06:10:31.819866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:34.441627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.819038+0000","last_change":"2024-09-19T06:09:59.492636+0000","last_active":"2024-09-19T06:10:31.819038+0000","last_peered":"2024-09-19T06:10:31.819038+0000","last_clean":"2024-09-19T06:10:31.819038+0000","last_became_active":"2024-09-19T06:09:59.491801+0000","last_became_peered":"2024-09-19T06:09:59.491801+0000","last_unstale":"2024-09-19T06:10:31.819038+0000","last_undegraded":"2024-09-19T06:10:31.819038+0000","last_fullsized":"2024-09-19T06:10:31.819038+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:27.911582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822238+0000","last_change":"2024-09-19T06:10:02.527073+0000","last_active":"2024-09-19T06:10:31.822238+0000","last_peered":"2024-09-19T06:10:31.822238+0000","last_clean":"2024-09-19T06:10:31.822238+0000","last_became_active":"2024-09-19T06:10:02.525847+0000","last_became_peered":"2024-09-19T06:10:02.525847+0000","last_unstale":"2024-09-19T06:10:31.822238+0000","last_undegraded":"2024-09-19T06:10:31.822238+0000","last_fullsized":"2024-09-19T06:10:31.822238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:22.717353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823978+0000","last_change":"2024-09-19T06:09:59.493905+0000","last_active":"2024-09-19T06:10:31.823978+0000","last_peered":"2024-09-19T06:10:31.823978+0000","last_clean":"2024-09-19T06:10:31.823978+0000","last_became_active":"2024-09-19T06:09:59.493517+0000","last_became_peered":"2024-09-19T06:09:59.493517+0000","last_unstale":"2024-09-19T06:10:31.823978+0000","last_undegraded":"2024-09-19T06:10:31.823978+0000","last_fullsized":"2024-09-19T06:10:31.823978+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:22.959756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.822361+0000","last_change":"2024-09-19T06:10:02.518002+0000","last_active":"2024-09-19T06:10:31.822361+0000","last_peered":"2024-09-19T06:10:31.822361+0000","last_clean":"2024-09-19T06:10:31.822361+0000","last_became_active":"2024-09-19T06:10:02.517492+0000","last_became_peered":"2024-09-19T06:10:02.517492+0000","last_unstale":"2024-09-19T06:10:31.822361+0000","last_undegraded":"2024-09-19T06:10:31.822361+0000","last_fullsized":"2024-09-19T06:10:31.822361+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:58.935232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.951506+0000","last_change":"2024-09-19T06:10:31.951506+0000","last_active":"2024-09-19T06:10:31.951506+0000","last_peered":"2024-09-19T06:10:31.951506+0000","last_clean":"2024-09-19T06:10:31.951506+0000","last_became_active":"2024-09-19T06:10:31.951079+0000","last_became_peered":"2024-09-19T06:10:31.951079+0000","last_unstale":"2024-09-19T06:10:31.951506+0000","last_undegraded":"2024-09-19T06:10:31.951506+0000","last_fullsized":"2024-09-19T06:10:31.951506+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:53.978445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824216+0000","last_change":"2024-09-19T06:09:59.496546+0000","last_active":"2024-09-19T06:10:31.824216+0000","last_peered":"2024-09-19T06:10:31.824216+0000","last_clean":"2024-09-19T06:10:31.824216+0000","last_became_active":"2024-09-19T06:09:59.496195+0000","last_became_peered":"2024-09-19T06:09:59.496195+0000","last_unstale":"2024-09-19T06:10:31.824216+0000","last_undegraded":"2024-09-19T06:10:31.824216+0000","last_fullsized":"2024-09-19T06:10:31.824216+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:58.443134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.950061+0000","last_change":"2024-09-19T06:10:02.522270+0000","last_active":"2024-09-19T06:10:31.950061+0000","last_peered":"2024-09-19T06:10:31.950061+0000","last_clean":"2024-09-19T06:10:31.950061+0000","last_became_active":"2024-09-19T06:10:02.517109+0000","last_became_peered":"2024-09-19T06:10:02.517109+0000","last_unstale":"2024-09-19T06:10:31.950061+0000","last_undegraded":"2024-09-19T06:10:31.950061+0000","last_fullsized":"2024-09-19T06:10:31.950061+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:56.967980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824448+0000","last_change":"2024-09-19T06:09:59.494016+0000","last_active":"2024-09-19T06:10:31.824448+0000","last_peered":"2024-09-19T06:10:31.824448+0000","last_clean":"2024-09-19T06:10:31.824448+0000","last_became_active":"2024-09-19T06:09:59.493525+0000","last_became_peered":"2024-09-19T06:09:59.493525+0000","last_unstale":"2024-09-19T06:10:31.824448+0000","last_undegraded":"2024-09-19T06:10:31.824448+0000","last_fullsized":"2024-09-19T06:10:31.824448+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:06.650633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.817372+0000","last_change":"2024-09-19T06:10:02.531329+0000","last_active":"2024-09-19T06:10:31.817372+0000","last_peered":"2024-09-19T06:10:31.817372+0000","last_clean":"2024-09-19T06:10:31.817372+0000","last_became_active":"2024-09-19T06:10:02.527107+0000","last_became_peered":"2024-09-19T06:10:02.527107+0000","last_unstale":"2024-09-19T06:10:31.817372+0000","last_undegraded":"2024-09-19T06:10:31.817372+0000","last_fullsized":"2024-09-19T06:10:31.817372+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:25.891416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.823419+0000","last_change":"2024-09-19T06:09:59.774966+0000","last_active":"2024-09-19T06:10:31.823419+0000","last_peered":"2024-09-19T06:10:31.823419+0000","last_clean":"2024-09-19T06:10:31.823419+0000","last_became_active":"2024-09-19T06:09:59.774038+0000","last_became_peered":"2024-09-19T06:09:59.774038+0000","last_unstale":"2024-09-19T06:10:31.823419+0000","last_undegraded":"2024-09-19T06:10:31.823419+0000","last_fullsized":"2024-09-19T06:10:31.823419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:54.703512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:10:31.824217+0000","last_change":"2024-09-19T06:10:31.824217+0000","last_active":"2024-09-19T06:10:31.824217+0000","last_peered":"2024-09-19T06:10:31.824217+0000","last_clean":"2024-09-19T06:10:31.824217+0000","last_became_active":"2024-09-19T06:10:31.823867+0000","last_became_peered":"2024-09-19T06:10:31.823867+0000","last_unstale":"2024-09-19T06:10:31.824217+0000","last_undegraded":"2024-09-19T06:10:31.824217+0000","last_fullsized":"2024-09-19T06:10:31.824217+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:53.261746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":124,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-19T06:11:20.022496+0000","last_change":"2024-09-19T06:10:31.962041+0000","last_active":"2024-09-19T06:11:20.022496+0000","last_peered":"2024-09-19T06:11:20.022496+0000","last_clean":"2024-09-19T06:11:20.022496+0000","last_became_active":"2024-09-19T06:10:31.952142+0000","last_became_peered":"2024-09-19T06:10:31.952142+0000","last_unstale":"2024-09-19T06:11:20.022496+0000","last_undegraded":"2024-09-19T06:11:20.022496+0000","last_fullsized":"2024-09-19T06:11:20.022496+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:30.304256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66972,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":641,"num_read_kb":403,"num_write":245,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2857,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":200916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282250,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449117,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":468494,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678052,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1118208,"data_stored":1118272,"data_compressed":41671,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841576,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":467409,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103215,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":974848,"data_stored":467115,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332148,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1036288,"data_stored":1060700,"data_compressed":41671,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495673,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":970752,"data_stored":467519,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757311,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1040384,"data_stored":1058970,"data_compressed":41671,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920837,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":978944,"data_stored":468157,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149769,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":466951,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411409,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":527246,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":528868,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":991232,"data_stored":468465,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34250,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34250,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34250,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":62581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":60959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:11:24.884 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T06:11:24.884 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T06:11:24.885 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T06:11:24.885 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T06:11:25.270 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:25.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:24 smithi059 ceph-mon[35138]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:11:25.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:24 smithi003 ceph-mon[30893]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:11:25.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:24 smithi071 ceph-mon[35662]: from='client.24863 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:11:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.818+0000 7f2807e00640 1 -- 172.21.15.3:0/2877926308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2808103e30 msgr2=0x7f2808104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.818+0000 7f2807e00640 1 --2- 172.21.15.3:0/2877926308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2808103e30 0x7f2808104210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f27f8009900 tx=0x7f27f802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:11:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.818+0000 7f2807e00640 1 -- 172.21.15.3:0/2877926308 shutdown_connections 2024-09-19T06:11:25.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.818+0000 7f2807e00640 1 --2- 172.21.15.3:0/2877926308 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2808108f60 0x7f2808110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:25.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.818+0000 7f2807e00640 1 --2- 172.21.15.3:0/2877926308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28081047e0 0x7f2808108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:25.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.818+0000 7f2807e00640 1 --2- 172.21.15.3:0/2877926308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2808103e30 0x7f2808104210 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:25.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.818+0000 7f2807e00640 1 -- 172.21.15.3:0/2877926308 >> 172.21.15.3:0/2877926308 conn(0x7f28080ff8d0 msgr2=0x7f2808101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:25.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.818+0000 7f2807e00640 1 -- 172.21.15.3:0/2877926308 shutdown_connections 2024-09-19T06:11:25.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.818+0000 7f2807e00640 1 -- 172.21.15.3:0/2877926308 wait complete. 2024-09-19T06:11:25.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.819+0000 7f2807e00640 1 Processor -- start 2024-09-19T06:11:25.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.819+0000 7f2807e00640 1 -- start start 2024-09-19T06:11:25.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.820+0000 7f2807e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2808103e30 0x7f280819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:25.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.820+0000 7f2807e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28081047e0 0x7f280819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:25.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.820+0000 7f2807e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2808108f60 0x7f280819edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:25.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.820+0000 7f2807e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2808114010 con 0x7f2808103e30 2024-09-19T06:11:25.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.820+0000 7f2807e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2808113e90 con 0x7f2808108f60 2024-09-19T06:11:25.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.820+0000 7f2807e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2808114190 con 0x7f28081047e0 2024-09-19T06:11:25.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.820+0000 7f2806a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2808103e30 0x7f280819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:25.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.820+0000 7f2807400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2808108f60 0x7f280819edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:25.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.820+0000 7f2807400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2808108f60 0x7f280819edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:53064/0 (socket says 172.21.15.3:53064) 2024-09-19T06:11:25.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.820+0000 7f2807400640 1 -- 172.21.15.3:0/3503464784 learned_addr learned my addr 172.21.15.3:0/3503464784 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:25.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.820+0000 7f2806000640 1 --2- 172.21.15.3:0/3503464784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28081047e0 0x7f280819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:25.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.820+0000 7f2806a00640 1 -- 172.21.15.3:0/3503464784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28081047e0 msgr2=0x7f280819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:25.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.821+0000 7f2806a00640 1 --2- 172.21.15.3:0/3503464784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28081047e0 0x7f280819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:25.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.821+0000 7f2806a00640 1 -- 172.21.15.3:0/3503464784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2808108f60 msgr2=0x7f280819edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:25.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.821+0000 7f2806a00640 1 --2- 172.21.15.3:0/3503464784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2808108f60 0x7f280819edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:25.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.821+0000 7f2806a00640 1 -- 172.21.15.3:0/3503464784 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f280819f4a0 con 0x7f2808103e30 2024-09-19T06:11:25.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.821+0000 7f2807400640 1 --2- 172.21.15.3:0/3503464784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2808108f60 0x7f280819edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:25.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.821+0000 7f2806a00640 1 --2- 172.21.15.3:0/3503464784 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2808103e30 0x7f280819a4f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f27f802a910 tx=0x7f27f8003b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:25.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.821+0000 7f27ff400640 1 -- 172.21.15.3:0/3503464784 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f803f070 con 0x7f2808103e30 2024-09-19T06:11:25.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.821+0000 7f27ff400640 1 -- 172.21.15.3:0/3503464784 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f27f8031c90 con 0x7f2808103e30 2024-09-19T06:11:25.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.821+0000 7f27ff400640 1 -- 172.21.15.3:0/3503464784 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f8035030 con 0x7f2808103e30 2024-09-19T06:11:25.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.821+0000 7f2807e00640 1 -- 172.21.15.3:0/3503464784 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f280819f730 con 0x7f2808103e30 2024-09-19T06:11:25.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.821+0000 7f2807e00640 1 -- 172.21.15.3:0/3503464784 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f280819fbc0 con 0x7f2808103e30 2024-09-19T06:11:25.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.822+0000 7f2807e00640 1 -- 172.21.15.3:0/3503464784 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2808104210 con 0x7f2808103e30 2024-09-19T06:11:25.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.824+0000 7f27ff400640 1 -- 172.21.15.3:0/3503464784 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f27f8042070 con 0x7f2808103e30 2024-09-19T06:11:25.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.826+0000 7f27ff400640 1 --2- 172.21.15.3:0/3503464784 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f27ec0a3350 0x7f27ec0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:25.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.826+0000 7f27ff400640 1 -- 172.21.15.3:0/3503464784 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f27f80efff0 con 0x7f2808103e30 2024-09-19T06:11:25.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.826+0000 7f2806000640 1 --2- 172.21.15.3:0/3503464784 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f27ec0a3350 0x7f27ec0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:25.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.827+0000 7f2806000640 1 --2- 172.21.15.3:0/3503464784 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f27ec0a3350 0x7f27ec0a5810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f28080ffd80 tx=0x7f27f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:25.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:25.830+0000 7f27ff400640 1 -- 172.21.15.3:0/3503464784 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f27f80bc540 con 0x7f2808103e30 2024-09-19T06:11:26.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:26.056+0000 7f2807e00640 1 -- 172.21.15.3:0/3503464784 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f280819b850 con 0x7f2808103e30 2024-09-19T06:11:26.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:26.057+0000 7f27ff400640 1 -- 172.21.15.3:0/3503464784 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f27f80c0840 con 0x7f2808103e30 2024-09-19T06:11:26.059 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:11:26.059 INFO:teuthology.orchestra.run.smithi003.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T06:11:26.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:26.059+0000 7f2807e00640 1 -- 172.21.15.3:0/3503464784 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f27ec0a3350 msgr2=0x7f27ec0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:26.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:26.059+0000 7f2807e00640 1 --2- 172.21.15.3:0/3503464784 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f27ec0a3350 0x7f27ec0a5810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f28080ffd80 tx=0x7f27f4005f90 comp rx=0 tx=0).stop 2024-09-19T06:11:26.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:26.059+0000 7f2807e00640 1 -- 172.21.15.3:0/3503464784 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2808103e30 msgr2=0x7f280819a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:26.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:26.059+0000 7f2807e00640 1 --2- 172.21.15.3:0/3503464784 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2808103e30 0x7f280819a4f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f27f802a910 tx=0x7f27f8003b20 comp rx=0 tx=0).stop 2024-09-19T06:11:26.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:26.059+0000 7f2807e00640 1 -- 172.21.15.3:0/3503464784 shutdown_connections 2024-09-19T06:11:26.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:26.059+0000 7f2807e00640 1 --2- 172.21.15.3:0/3503464784 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f27ec0a3350 0x7f27ec0a5810 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:26.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:26.059+0000 7f2807e00640 1 --2- 172.21.15.3:0/3503464784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2808108f60 0x7f280819edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:26.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:26.059+0000 7f2807e00640 1 --2- 172.21.15.3:0/3503464784 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f28081047e0 0x7f280819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:26.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:26.059+0000 7f2807e00640 1 --2- 172.21.15.3:0/3503464784 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2808103e30 0x7f280819a4f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:26.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:26.059+0000 7f2807e00640 1 -- 172.21.15.3:0/3503464784 >> 172.21.15.3:0/3503464784 conn(0x7f28080ff8d0 msgr2=0x7f2808100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:26.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:26.059+0000 7f2807e00640 1 -- 172.21.15.3:0/3503464784 shutdown_connections 2024-09-19T06:11:26.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:26.059+0000 7f2807e00640 1 -- 172.21.15.3:0/3503464784 wait complete. 2024-09-19T06:11:26.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:25 smithi059 ceph-mon[35138]: pgmap v345: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:26.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:25 smithi003 ceph-mon[30893]: pgmap v345: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:26.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:25 smithi071 ceph-mon[35662]: pgmap v345: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:26.937 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T06:11:26.937 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:11:27.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:26 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/3503464784' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T06:11:27.318 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:27.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:26 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3503464784' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T06:11:27.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:26 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/3503464784' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T06:11:27.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.884+0000 7f53fe200640 1 -- 172.21.15.3:0/1088705802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53f8103ff0 msgr2=0x7f53f81043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:27.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.884+0000 7f53fe200640 1 --2- 172.21.15.3:0/1088705802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53f8103ff0 0x7f53f81043d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f53e8009900 tx=0x7f53e802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.884+0000 7f53fe200640 1 -- 172.21.15.3:0/1088705802 shutdown_connections 2024-09-19T06:11:27.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.884+0000 7f53fe200640 1 --2- 172.21.15.3:0/1088705802 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53f8109120 0x7f53f8110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.884+0000 7f53fe200640 1 --2- 172.21.15.3:0/1088705802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f81049a0 0x7f53f81089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.884+0000 7f53fe200640 1 --2- 172.21.15.3:0/1088705802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53f8103ff0 0x7f53f81043d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.884+0000 7f53fe200640 1 -- 172.21.15.3:0/1088705802 >> 172.21.15.3:0/1088705802 conn(0x7f53f80ffa90 msgr2=0x7f53f8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:27.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.884+0000 7f53fe200640 1 -- 172.21.15.3:0/1088705802 shutdown_connections 2024-09-19T06:11:27.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.884+0000 7f53fe200640 1 -- 172.21.15.3:0/1088705802 wait complete. 2024-09-19T06:11:27.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.885+0000 7f53fe200640 1 Processor -- start 2024-09-19T06:11:27.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.885+0000 7f53fe200640 1 -- start start 2024-09-19T06:11:27.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.886+0000 7f53fe200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53f8103ff0 0x7f53f819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:27.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.886+0000 7f53fe200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53f81049a0 0x7f53f819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:27.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.886+0000 7f53fe200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f8109120 0x7f53f819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:27.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.886+0000 7f53fe200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f53f8114150 con 0x7f53f8103ff0 2024-09-19T06:11:27.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.886+0000 7f53fe200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f53f8113fd0 con 0x7f53f8109120 2024-09-19T06:11:27.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.886+0000 7f53fe200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f53f81142d0 con 0x7f53f81049a0 2024-09-19T06:11:27.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.886+0000 7f53f7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53f8103ff0 0x7f53f819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:27.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.886+0000 7f53f7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53f8103ff0 0x7f53f819a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42036/0 (socket says 172.21.15.3:42036) 2024-09-19T06:11:27.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.886+0000 7f53f7400640 1 -- 172.21.15.3:0/3687954285 learned_addr learned my addr 172.21.15.3:0/3687954285 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:27.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.886+0000 7f53f6a00640 1 --2- 172.21.15.3:0/3687954285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53f81049a0 0x7f53f819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:27.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.886+0000 7f53f7e00640 1 --2- 172.21.15.3:0/3687954285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f8109120 0x7f53f819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:27.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.886+0000 7f53f7400640 1 -- 172.21.15.3:0/3687954285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53f81049a0 msgr2=0x7f53f819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:27.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.887+0000 7f53f7400640 1 --2- 172.21.15.3:0/3687954285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53f81049a0 0x7f53f819ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.887+0000 7f53f7400640 1 -- 172.21.15.3:0/3687954285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f8109120 msgr2=0x7f53f819eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:27.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.887+0000 7f53f7400640 1 --2- 172.21.15.3:0/3687954285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f8109120 0x7f53f819eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:27.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.887+0000 7f53f7400640 1 -- 172.21.15.3:0/3687954285 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f819f5a0 con 0x7f53f8103ff0 2024-09-19T06:11:27.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.887+0000 7f53f7400640 1 --2- 172.21.15.3:0/3687954285 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53f8103ff0 0x7f53f819a5f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f53e8006010 tx=0x7f53e8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:27.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.887+0000 7f53efe00640 1 -- 172.21.15.3:0/3687954285 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e803f030 con 0x7f53f8103ff0 2024-09-19T06:11:27.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.887+0000 7f53efe00640 1 -- 172.21.15.3:0/3687954285 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53e8004440 con 0x7f53f8103ff0 2024-09-19T06:11:27.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.887+0000 7f53fe200640 1 -- 172.21.15.3:0/3687954285 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53f819f830 con 0x7f53f8103ff0 2024-09-19T06:11:27.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.887+0000 7f53efe00640 1 -- 172.21.15.3:0/3687954285 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e8035070 con 0x7f53f8103ff0 2024-09-19T06:11:27.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.887+0000 7f53fe200640 1 -- 172.21.15.3:0/3687954285 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f81a7170 con 0x7f53f8103ff0 2024-09-19T06:11:27.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.888+0000 7f53fe200640 1 -- 172.21.15.3:0/3687954285 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53f81043d0 con 0x7f53f8103ff0 2024-09-19T06:11:27.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.890+0000 7f53efe00640 1 -- 172.21.15.3:0/3687954285 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f53e8042030 con 0x7f53f8103ff0 2024-09-19T06:11:27.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.892+0000 7f53efe00640 1 --2- 172.21.15.3:0/3687954285 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f53dc0a3350 0x7f53dc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:27.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.892+0000 7f53efe00640 1 -- 172.21.15.3:0/3687954285 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f53e80efae0 con 0x7f53f8103ff0 2024-09-19T06:11:27.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.892+0000 7f53f6a00640 1 --2- 172.21.15.3:0/3687954285 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f53dc0a3350 0x7f53dc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:27.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.893+0000 7f53f6a00640 1 --2- 172.21.15.3:0/3687954285 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f53dc0a3350 0x7f53dc0a5810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f53f80ffeb0 tx=0x7f53e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:27.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:27.896+0000 7f53efe00640 1 -- 172.21.15.3:0/3687954285 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f53e80bbfd0 con 0x7f53f8103ff0 2024-09-19T06:11:28.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:28.121+0000 7f53fe200640 1 -- 172.21.15.3:0/3687954285 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f53f819b950 con 0x7f53f8103ff0 2024-09-19T06:11:28.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:28.122+0000 7f53efe00640 1 -- 172.21.15.3:0/3687954285 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11941 (secure 0 0 0) 0x7f53e80c02d0 con 0x7f53f8103ff0 2024-09-19T06:11:28.124 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:11:28.124 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":28,"btime":"2024-09-19T06:10:19:770544+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:10:18.878479+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[14517,24514,24515,24532,24557]},"id":1}]} 2024-09-19T06:11:28.125 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 28 2024-09-19T06:11:28.126 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:28.124+0000 7f53fe200640 1 -- 172.21.15.3:0/3687954285 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f53dc0a3350 msgr2=0x7f53dc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:28.126 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:28.124+0000 7f53fe200640 1 --2- 172.21.15.3:0/3687954285 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f53dc0a3350 0x7f53dc0a5810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f53f80ffeb0 tx=0x7f53e4005f90 comp rx=0 tx=0).stop 2024-09-19T06:11:28.126 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:28.124+0000 7f53fe200640 1 -- 172.21.15.3:0/3687954285 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53f8103ff0 msgr2=0x7f53f819a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:28.126 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:28.124+0000 7f53fe200640 1 --2- 172.21.15.3:0/3687954285 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53f8103ff0 0x7f53f819a5f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f53e8006010 tx=0x7f53e8004040 comp rx=0 tx=0).stop 2024-09-19T06:11:28.126 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:28.124+0000 7f53fe200640 1 -- 172.21.15.3:0/3687954285 shutdown_connections 2024-09-19T06:11:28.126 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:28.124+0000 7f53fe200640 1 --2- 172.21.15.3:0/3687954285 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f53dc0a3350 0x7f53dc0a5810 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:28.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:28.124+0000 7f53fe200640 1 --2- 172.21.15.3:0/3687954285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f8109120 0x7f53f819eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:28.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:28.124+0000 7f53fe200640 1 --2- 172.21.15.3:0/3687954285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53f81049a0 0x7f53f819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:28.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:28.124+0000 7f53fe200640 1 --2- 172.21.15.3:0/3687954285 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53f8103ff0 0x7f53f819a5f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:28.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:28.124+0000 7f53fe200640 1 -- 172.21.15.3:0/3687954285 >> 172.21.15.3:0/3687954285 conn(0x7f53f80ffa90 msgr2=0x7f53f8100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:28.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:28.124+0000 7f53fe200640 1 -- 172.21.15.3:0/3687954285 shutdown_connections 2024-09-19T06:11:28.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:28.124+0000 7f53fe200640 1 -- 172.21.15.3:0/3687954285 wait complete. 2024-09-19T06:11:28.140 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:27 smithi003 ceph-mon[30893]: pgmap v346: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:11:28.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:27 smithi059 ceph-mon[35138]: pgmap v346: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:11:28.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:27 smithi071 ceph-mon[35662]: pgmap v346: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:11:29.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:28 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3687954285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:11:29.109 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:11:29.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:28 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/3687954285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:11:29.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:28 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/3687954285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:11:29.505 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:30.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.136+0000 7efc30600640 1 -- 172.21.15.3:0/2546278419 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc28103ff0 msgr2=0x7efc281043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:30.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.136+0000 7efc30600640 1 --2- 172.21.15.3:0/2546278419 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc28103ff0 0x7efc281043d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efc1c009900 tx=0x7efc1c02a410 comp rx=0 tx=0).stop 2024-09-19T06:11:30.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.136+0000 7efc30600640 1 -- 172.21.15.3:0/2546278419 shutdown_connections 2024-09-19T06:11:30.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.136+0000 7efc30600640 1 --2- 172.21.15.3:0/2546278419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc28109120 0x7efc28110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:30.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.136+0000 7efc30600640 1 --2- 172.21.15.3:0/2546278419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc281049a0 0x7efc281089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:30.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.136+0000 7efc30600640 1 --2- 172.21.15.3:0/2546278419 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc28103ff0 0x7efc281043d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:30.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.136+0000 7efc30600640 1 -- 172.21.15.3:0/2546278419 >> 172.21.15.3:0/2546278419 conn(0x7efc280ffa90 msgr2=0x7efc28101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:30.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.136+0000 7efc30600640 1 -- 172.21.15.3:0/2546278419 shutdown_connections 2024-09-19T06:11:30.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.136+0000 7efc30600640 1 -- 172.21.15.3:0/2546278419 wait complete. 2024-09-19T06:11:30.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.137+0000 7efc30600640 1 Processor -- start 2024-09-19T06:11:30.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.137+0000 7efc30600640 1 -- start start 2024-09-19T06:11:30.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.137+0000 7efc30600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc28103ff0 0x7efc2819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:30.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.137+0000 7efc30600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc281049a0 0x7efc2819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:30.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.137+0000 7efc30600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc28109120 0x7efc2819eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:30.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.137+0000 7efc30600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7efc28114120 con 0x7efc28103ff0 2024-09-19T06:11:30.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.137+0000 7efc30600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efc28113fa0 con 0x7efc28109120 2024-09-19T06:11:30.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.137+0000 7efc30600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efc281142a0 con 0x7efc281049a0 2024-09-19T06:11:30.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.138+0000 7efc2dc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc28103ff0 0x7efc2819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:30.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.138+0000 7efc2dc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc28103ff0 0x7efc2819a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42050/0 (socket says 172.21.15.3:42050) 2024-09-19T06:11:30.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.138+0000 7efc2dc00640 1 -- 172.21.15.3:0/4254911012 learned_addr learned my addr 172.21.15.3:0/4254911012 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:30.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.138+0000 7efc2e600640 1 --2- 172.21.15.3:0/4254911012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc28109120 0x7efc2819eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:30.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.138+0000 7efc2d200640 1 --2- 172.21.15.3:0/4254911012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc281049a0 0x7efc2819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:30.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.138+0000 7efc2dc00640 1 -- 172.21.15.3:0/4254911012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc281049a0 msgr2=0x7efc2819ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:30.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.138+0000 7efc2dc00640 1 --2- 172.21.15.3:0/4254911012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc281049a0 0x7efc2819ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:30.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.138+0000 7efc2dc00640 1 -- 172.21.15.3:0/4254911012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc28109120 msgr2=0x7efc2819eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:30.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.138+0000 7efc2dc00640 1 --2- 172.21.15.3:0/4254911012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc28109120 0x7efc2819eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:30.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.138+0000 7efc2dc00640 1 -- 172.21.15.3:0/4254911012 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc2819f590 con 0x7efc28103ff0 2024-09-19T06:11:30.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.138+0000 7efc2e600640 1 --2- 172.21.15.3:0/4254911012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc28109120 0x7efc2819eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:30.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.138+0000 7efc2dc00640 1 --2- 172.21.15.3:0/4254911012 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc28103ff0 0x7efc2819a5e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efc1c006010 tx=0x7efc1c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:30.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.139+0000 7efc26000640 1 -- 172.21.15.3:0/4254911012 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1c03f030 con 0x7efc28103ff0 2024-09-19T06:11:30.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.139+0000 7efc26000640 1 -- 172.21.15.3:0/4254911012 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc1c003ce0 con 0x7efc28103ff0 2024-09-19T06:11:30.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.139+0000 7efc30600640 1 -- 172.21.15.3:0/4254911012 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc2819f820 con 0x7efc28103ff0 2024-09-19T06:11:30.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.139+0000 7efc26000640 1 -- 172.21.15.3:0/4254911012 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1c035070 con 0x7efc28103ff0 2024-09-19T06:11:30.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.139+0000 7efc30600640 1 -- 172.21.15.3:0/4254911012 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc281a7160 con 0x7efc28103ff0 2024-09-19T06:11:30.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.140+0000 7efc30600640 1 -- 172.21.15.3:0/4254911012 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc281043d0 con 0x7efc28103ff0 2024-09-19T06:11:30.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.142+0000 7efc26000640 1 -- 172.21.15.3:0/4254911012 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7efc1c042030 con 0x7efc28103ff0 2024-09-19T06:11:30.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.143+0000 7efc26000640 1 --2- 172.21.15.3:0/4254911012 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7efc100a3350 0x7efc100a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:30.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.143+0000 7efc26000640 1 -- 172.21.15.3:0/4254911012 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7efc1c0effd0 con 0x7efc28103ff0 2024-09-19T06:11:30.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.143+0000 7efc2d200640 1 --2- 172.21.15.3:0/4254911012 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7efc100a3350 0x7efc100a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:30.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.144+0000 7efc2d200640 1 --2- 172.21.15.3:0/4254911012 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7efc100a3350 0x7efc100a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efc280ffeb0 tx=0x7efc1400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:30.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.147+0000 7efc26000640 1 -- 172.21.15.3:0/4254911012 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efc1c0bc580 con 0x7efc28103ff0 2024-09-19T06:11:30.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:29 smithi059 ceph-mon[35138]: pgmap v347: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:30.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:29 smithi003 ceph-mon[30893]: pgmap v347: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:30.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:29 smithi071 ceph-mon[35662]: pgmap v347: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:30.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.371+0000 7efc30600640 1 -- 172.21.15.3:0/4254911012 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc2810c300 con 0x7efc28103ff0 2024-09-19T06:11:30.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.372+0000 7efc26000640 1 -- 172.21.15.3:0/4254911012 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11941 (secure 0 0 0) 0x7efc1c0c0880 con 0x7efc28103ff0 2024-09-19T06:11:30.374 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:11:30.374 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":28,"btime":"2024-09-19T06:10:19:770544+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:10:18.878479+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[14517,24514,24515,24532,24557]},"id":1}]} 2024-09-19T06:11:30.375 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 28 2024-09-19T06:11:30.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.374+0000 7efc30600640 1 -- 172.21.15.3:0/4254911012 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7efc100a3350 msgr2=0x7efc100a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:30.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.374+0000 7efc30600640 1 --2- 172.21.15.3:0/4254911012 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7efc100a3350 0x7efc100a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efc280ffeb0 tx=0x7efc1400b410 comp rx=0 tx=0).stop 2024-09-19T06:11:30.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.374+0000 7efc30600640 1 -- 172.21.15.3:0/4254911012 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc28103ff0 msgr2=0x7efc2819a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:30.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.374+0000 7efc30600640 1 --2- 172.21.15.3:0/4254911012 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc28103ff0 0x7efc2819a5e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efc1c006010 tx=0x7efc1c0042f0 comp rx=0 tx=0).stop 2024-09-19T06:11:30.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.374+0000 7efc30600640 1 -- 172.21.15.3:0/4254911012 shutdown_connections 2024-09-19T06:11:30.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.374+0000 7efc30600640 1 --2- 172.21.15.3:0/4254911012 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7efc100a3350 0x7efc100a5810 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:30.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.374+0000 7efc30600640 1 --2- 172.21.15.3:0/4254911012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc28109120 0x7efc2819eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:30.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.374+0000 7efc30600640 1 --2- 172.21.15.3:0/4254911012 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efc281049a0 0x7efc2819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:30.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.374+0000 7efc30600640 1 --2- 172.21.15.3:0/4254911012 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efc28103ff0 0x7efc2819a5e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:30.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.374+0000 7efc30600640 1 -- 172.21.15.3:0/4254911012 >> 172.21.15.3:0/4254911012 conn(0x7efc280ffa90 msgr2=0x7efc28100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:30.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.374+0000 7efc30600640 1 -- 172.21.15.3:0/4254911012 shutdown_connections 2024-09-19T06:11:30.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:30.375+0000 7efc30600640 1 -- 172.21.15.3:0/4254911012 wait complete. 2024-09-19T06:11:31.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:30 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/4254911012' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:11:31.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:30 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/4254911012' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:11:31.319 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:11:31.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:30 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/4254911012' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:11:31.699 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:32.158 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:31 smithi003 ceph-mon[30893]: pgmap v348: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:32.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:31 smithi059 ceph-mon[35138]: pgmap v348: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:32.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.269+0000 7f8f0b800640 1 -- 172.21.15.3:0/1497513787 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f04102790 msgr2=0x7f8f041067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:32.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.269+0000 7f8f0b800640 1 --2- 172.21.15.3:0/1497513787 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f04102790 0x7f8f041067e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8eec009900 tx=0x7f8eec02a410 comp rx=0 tx=0).stop 2024-09-19T06:11:32.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.269+0000 7f8f0b800640 1 -- 172.21.15.3:0/1497513787 shutdown_connections 2024-09-19T06:11:32.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.269+0000 7f8f0b800640 1 --2- 172.21.15.3:0/1497513787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f04106f10 0x7f8f0410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:32.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.269+0000 7f8f0b800640 1 --2- 172.21.15.3:0/1497513787 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f04102790 0x7f8f041067e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:32.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.269+0000 7f8f0b800640 1 --2- 172.21.15.3:0/1497513787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f04101de0 0x7f8f041021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:32.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.269+0000 7f8f0b800640 1 -- 172.21.15.3:0/1497513787 >> 172.21.15.3:0/1497513787 conn(0x7f8f040fd8c0 msgr2=0x7f8f040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:32.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.269+0000 7f8f0b800640 1 -- 172.21.15.3:0/1497513787 shutdown_connections 2024-09-19T06:11:32.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.269+0000 7f8f0b800640 1 -- 172.21.15.3:0/1497513787 wait complete. 2024-09-19T06:11:32.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.270+0000 7f8f0b800640 1 Processor -- start 2024-09-19T06:11:32.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.270+0000 7f8f0b800640 1 -- start start 2024-09-19T06:11:32.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.270+0000 7f8f0b800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f04101de0 0x7f8f040744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:32.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.270+0000 7f8f0b800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f04102790 0x7f8f04074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:32.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.270+0000 7f8f0b800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f04106f10 0x7f8f04074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:32.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.270+0000 7f8f0b800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8f04111fc0 con 0x7f8f04102790 2024-09-19T06:11:32.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.270+0000 7f8f0b800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8f04111e40 con 0x7f8f04106f10 2024-09-19T06:11:32.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.270+0000 7f8f0b800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8f04112140 con 0x7f8f04101de0 2024-09-19T06:11:32.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.271+0000 7f8efbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f04102790 0x7f8f04074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:32.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.271+0000 7f8f09800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f04106f10 0x7f8f04074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:32.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.271+0000 7f8f09800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f04106f10 0x7f8f04074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:53130/0 (socket says 172.21.15.3:53130) 2024-09-19T06:11:32.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.271+0000 7f8f09800640 1 -- 172.21.15.3:0/1777867978 learned_addr learned my addr 172.21.15.3:0/1777867978 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:32.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.271+0000 7f8f08e00640 1 --2- 172.21.15.3:0/1777867978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f04101de0 0x7f8f040744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:32.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.271+0000 7f8f09800640 1 -- 172.21.15.3:0/1777867978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f04101de0 msgr2=0x7f8f040744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:32.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.271+0000 7f8f09800640 1 --2- 172.21.15.3:0/1777867978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f04101de0 0x7f8f040744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.271+0000 7f8f09800640 1 -- 172.21.15.3:0/1777867978 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f04102790 msgr2=0x7f8f04074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.271+0000 7f8f09800640 1 --2- 172.21.15.3:0/1777867978 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f04102790 0x7f8f04074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.271+0000 7f8f09800640 1 -- 172.21.15.3:0/1777867978 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f041a6900 con 0x7f8f04106f10 2024-09-19T06:11:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.271+0000 7f8efbe00640 1 --2- 172.21.15.3:0/1777867978 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f04102790 0x7f8f04074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.271+0000 7f8f09800640 1 --2- 172.21.15.3:0/1777867978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f04106f10 0x7f8f04074f70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8efc009fd0 tx=0x7f8efc00b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.272+0000 7f8f02000640 1 -- 172.21.15.3:0/1777867978 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8efc017070 con 0x7f8f04106f10 2024-09-19T06:11:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.272+0000 7f8f0b800640 1 -- 172.21.15.3:0/1777867978 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f041a6bf0 con 0x7f8f04106f10 2024-09-19T06:11:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.272+0000 7f8f02000640 1 -- 172.21.15.3:0/1777867978 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8efc003e50 con 0x7f8f04106f10 2024-09-19T06:11:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.272+0000 7f8f02000640 1 -- 172.21.15.3:0/1777867978 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8efc0106c0 con 0x7f8f04106f10 2024-09-19T06:11:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.272+0000 7f8f0b800640 1 -- 172.21.15.3:0/1777867978 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f041a7100 con 0x7f8f04106f10 2024-09-19T06:11:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.273+0000 7f8f0b800640 1 -- 172.21.15.3:0/1777867978 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f041021c0 con 0x7f8f04106f10 2024-09-19T06:11:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.275+0000 7f8f02000640 1 -- 172.21.15.3:0/1777867978 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f8efc003970 con 0x7f8f04106f10 2024-09-19T06:11:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.276+0000 7f8f02000640 1 --2- 172.21.15.3:0/1777867978 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f8ee80a32d0 0x7f8ee80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:32.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.276+0000 7f8f02000640 1 -- 172.21.15.3:0/1777867978 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f8efc0cf730 con 0x7f8f04106f10 2024-09-19T06:11:32.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.276+0000 7f8f08e00640 1 --2- 172.21.15.3:0/1777867978 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f8ee80a32d0 0x7f8ee80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:32.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.277+0000 7f8f08e00640 1 --2- 172.21.15.3:0/1777867978 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f8ee80a32d0 0x7f8ee80a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400bbe0 tx=0x7f8ef400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:32.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.279+0000 7f8f02000640 1 -- 172.21.15.3:0/1777867978 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8efc09bc20 con 0x7f8f04106f10 2024-09-19T06:11:32.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:31 smithi071 ceph-mon[35662]: pgmap v348: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:32.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.463+0000 7f8f0b800640 1 -- 172.21.15.3:0/1777867978 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f0402d7c0 con 0x7f8f04106f10 2024-09-19T06:11:32.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.465+0000 7f8f02000640 1 -- 172.21.15.3:0/1777867978 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22583 (secure 0 0 0) 0x7f8efc09ff20 con 0x7f8f04106f10 2024-09-19T06:11:32.468 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:11:32.468 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":88,"fsid":"782a5144-764c-11ef-bceb-c7b262605968","created":"2024-09-19T06:01:35.224753+0000","modified":"2024-09-19T06:10:31.811461+0000","last_up_change":"2024-09-19T06:09:02.478979+0000","last_in_change":"2024-09-19T06:08:38.865280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:04:56.654478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:09:58.426008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:10:01.215704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd89ea4b-a24e-4946-80fc-1776b6d05e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6803","nonce":2061486638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6805","nonce":2061486638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6809","nonce":2061486638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6807","nonce":2061486638}]},"public_addr":"172.21.15.3:6803/2061486638","cluster_addr":"172.21.15.3:6805/2061486638","heartbeat_back_addr":"172.21.15.3:6809/2061486638","heartbeat_front_addr":"172.21.15.3:6807/2061486638","state":["exists","up"]},{"osd":1,"uuid":"e03ca275-8da5-402f-9cd2-654ca422b9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6801","nonce":129318538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6803","nonce":129318538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6807","nonce":129318538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6805","nonce":129318538}]},"public_addr":"172.21.15.59:6801/129318538","cluster_addr":"172.21.15.59:6803/129318538","heartbeat_back_addr":"172.21.15.59:6807/129318538","heartbeat_front_addr":"172.21.15.59:6805/129318538","state":["exists","up"]},{"osd":2,"uuid":"62b7d36d-6078-4027-93b2-009be70a6d80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6801","nonce":2436210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6803","nonce":2436210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6807","nonce":2436210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6805","nonce":2436210695}]},"public_addr":"172.21.15.71:6801/2436210695","cluster_addr":"172.21.15.71:6803/2436210695","heartbeat_back_addr":"172.21.15.71:6807/2436210695","heartbeat_front_addr":"172.21.15.71:6805/2436210695","state":["exists","up"]},{"osd":3,"uuid":"ba33cc45-0103-443d-b262-622a505d9806","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6811","nonce":3577306700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6813","nonce":3577306700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6817","nonce":3577306700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6815","nonce":3577306700}]},"public_addr":"172.21.15.3:6811/3577306700","cluster_addr":"172.21.15.3:6813/3577306700","heartbeat_back_addr":"172.21.15.3:6817/3577306700","heartbeat_front_addr":"172.21.15.3:6815/3577306700","state":["exists","up"]},{"osd":4,"uuid":"40564c0c-6335-4207-a8e0-8078c9bfd015","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6809","nonce":4002980986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6811","nonce":4002980986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6815","nonce":4002980986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6813","nonce":4002980986}]},"public_addr":"172.21.15.59:6809/4002980986","cluster_addr":"172.21.15.59:6811/4002980986","heartbeat_back_addr":"172.21.15.59:6815/4002980986","heartbeat_front_addr":"172.21.15.59:6813/4002980986","state":["exists","up"]},{"osd":5,"uuid":"4db04b82-3403-4fd5-9eb7-7b81ed6b1d26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6809","nonce":2455500497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6811","nonce":2455500497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6815","nonce":2455500497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6813","nonce":2455500497}]},"public_addr":"172.21.15.71:6809/2455500497","cluster_addr":"172.21.15.71:6811/2455500497","heartbeat_back_addr":"172.21.15.71:6815/2455500497","heartbeat_front_addr":"172.21.15.71:6813/2455500497","state":["exists","up"]},{"osd":6,"uuid":"42a74f01-c5d0-4fc6-a8ee-a8bd84d4ab4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6819","nonce":823411903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6821","nonce":823411903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6825","nonce":823411903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6823","nonce":823411903}]},"public_addr":"172.21.15.3:6819/823411903","cluster_addr":"172.21.15.3:6821/823411903","heartbeat_back_addr":"172.21.15.3:6825/823411903","heartbeat_front_addr":"172.21.15.3:6823/823411903","state":["exists","up"]},{"osd":7,"uuid":"8a9bc2ec-4292-465d-8a0d-dda78521a319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6817","nonce":2133603853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6819","nonce":2133603853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6823","nonce":2133603853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6821","nonce":2133603853}]},"public_addr":"172.21.15.59:6817/2133603853","cluster_addr":"172.21.15.59:6819/2133603853","heartbeat_back_addr":"172.21.15.59:6823/2133603853","heartbeat_front_addr":"172.21.15.59:6821/2133603853","state":["exists","up"]},{"osd":8,"uuid":"6099a5c4-3504-43ca-8c58-d23f9096cd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6817","nonce":905333117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6819","nonce":905333117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6823","nonce":905333117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6821","nonce":905333117}]},"public_addr":"172.21.15.71:6817/905333117","cluster_addr":"172.21.15.71:6819/905333117","heartbeat_back_addr":"172.21.15.71:6823/905333117","heartbeat_front_addr":"172.21.15.71:6821/905333117","state":["exists","up"]},{"osd":9,"uuid":"b5a8aac6-bb10-4db8-a056-25228fbe754c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6827","nonce":124909267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6829","nonce":124909267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6833","nonce":124909267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6831","nonce":124909267}]},"public_addr":"172.21.15.3:6827/124909267","cluster_addr":"172.21.15.3:6829/124909267","heartbeat_back_addr":"172.21.15.3:6833/124909267","heartbeat_front_addr":"172.21.15.3:6831/124909267","state":["exists","up"]},{"osd":10,"uuid":"e49f3aab-0804-4aea-ae3f-38f022ab5239","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6825","nonce":784134238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6827","nonce":784134238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6831","nonce":784134238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6829","nonce":784134238}]},"public_addr":"172.21.15.59:6825/784134238","cluster_addr":"172.21.15.59:6827/784134238","heartbeat_back_addr":"172.21.15.59:6831/784134238","heartbeat_front_addr":"172.21.15.59:6829/784134238","state":["exists","up"]},{"osd":11,"uuid":"6c6d6c23-bcf7-43e7-94d1-5f2ebaa15441","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6825","nonce":3502550915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6827","nonce":3502550915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6831","nonce":3502550915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6829","nonce":3502550915}]},"public_addr":"172.21.15.71:6825/3502550915","cluster_addr":"172.21.15.71:6827/3502550915","heartbeat_back_addr":"172.21.15.71:6831/3502550915","heartbeat_front_addr":"172.21.15.71:6829/3502550915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:01.683342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:28.058683+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:53.250819+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:05:23.267377+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:05:49.756289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:06:15.766613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:06:46.054328+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:12.579180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:37.976863+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:08.683966+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:35.120765+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:00.624411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/1458736313":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/2065281908":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/953348594":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6801/518259590":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/1658697906":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6801/2386230415":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6800/2386230415":"2024-09-20T06:02:01.122348+0000","172.21.15.3:0/1616091100":"2024-09-20T06:02:30.039686+0000","172.21.15.3:6800/518259590":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/2122482494":"2024-09-20T06:02:01.122348+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:11:32.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.469+0000 7f8f0b800640 1 -- 172.21.15.3:0/1777867978 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f8ee80a32d0 msgr2=0x7f8ee80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:32.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.469+0000 7f8f0b800640 1 --2- 172.21.15.3:0/1777867978 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f8ee80a32d0 0x7f8ee80a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8ef400bbe0 tx=0x7f8ef400b390 comp rx=0 tx=0).stop 2024-09-19T06:11:32.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.469+0000 7f8f0b800640 1 -- 172.21.15.3:0/1777867978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f04106f10 msgr2=0x7f8f04074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:32.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.469+0000 7f8f0b800640 1 --2- 172.21.15.3:0/1777867978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f04106f10 0x7f8f04074f70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8efc009fd0 tx=0x7f8efc00b260 comp rx=0 tx=0).stop 2024-09-19T06:11:32.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.469+0000 7f8f0b800640 1 -- 172.21.15.3:0/1777867978 shutdown_connections 2024-09-19T06:11:32.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.469+0000 7f8f0b800640 1 --2- 172.21.15.3:0/1777867978 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f8ee80a32d0 0x7f8ee80a5790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:32.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.469+0000 7f8f0b800640 1 --2- 172.21.15.3:0/1777867978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f04106f10 0x7f8f04074f70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:32.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.469+0000 7f8f0b800640 1 --2- 172.21.15.3:0/1777867978 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f04102790 0x7f8f04074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:32.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.469+0000 7f8f0b800640 1 --2- 172.21.15.3:0/1777867978 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f04101de0 0x7f8f040744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:32.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.469+0000 7f8f0b800640 1 -- 172.21.15.3:0/1777867978 >> 172.21.15.3:0/1777867978 conn(0x7f8f040fd8c0 msgr2=0x7f8f040febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:32.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.469+0000 7f8f0b800640 1 -- 172.21.15.3:0/1777867978 shutdown_connections 2024-09-19T06:11:32.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:32.469+0000 7f8f0b800640 1 -- 172.21.15.3:0/1777867978 wait complete. 2024-09-19T06:11:33.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:32 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1777867978' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:11:33.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:32 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1777867978' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:11:33.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:32 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1777867978' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:11:33.403 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:11:33.781 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:34.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:34 smithi059 ceph-mon[35138]: pgmap v349: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:34.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:34 smithi003 ceph-mon[30893]: pgmap v349: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:34.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:34 smithi071 ceph-mon[35662]: pgmap v349: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:34.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.555+0000 7f19fd600640 1 -- 172.21.15.3:0/335759900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19f8076720 msgr2=0x7f19f8076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:34.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.555+0000 7f19fd600640 1 --2- 172.21.15.3:0/335759900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19f8076720 0x7f19f8076b00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009860 tx=0x7f19e802a340 comp rx=0 tx=0).stop 2024-09-19T06:11:34.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.555+0000 7f19fd600640 1 -- 172.21.15.3:0/335759900 shutdown_connections 2024-09-19T06:11:34.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.555+0000 7f19fd600640 1 --2- 172.21.15.3:0/335759900 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19f8112a30 0x7f19f8114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:34.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.555+0000 7f19fd600640 1 --2- 172.21.15.3:0/335759900 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19f8077040 0x7f19f81124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:34.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.555+0000 7f19fd600640 1 --2- 172.21.15.3:0/335759900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19f8076720 0x7f19f8076b00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:34.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.555+0000 7f19fd600640 1 -- 172.21.15.3:0/335759900 >> 172.21.15.3:0/335759900 conn(0x7f19f80ffa90 msgr2=0x7f19f8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:34.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.556+0000 7f19fd600640 1 -- 172.21.15.3:0/335759900 shutdown_connections 2024-09-19T06:11:34.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.556+0000 7f19fd600640 1 -- 172.21.15.3:0/335759900 wait complete. 2024-09-19T06:11:34.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.556+0000 7f19fd600640 1 Processor -- start 2024-09-19T06:11:34.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.557+0000 7f19fd600640 1 -- start start 2024-09-19T06:11:34.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.557+0000 7f19fd600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19f8076720 0x7f19f81a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:34.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.557+0000 7f19fd600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19f8077040 0x7f19f81a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:34.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.557+0000 7f19fd600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19f8112a30 0x7f19f819e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:34.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.557+0000 7f19fd600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f19f81185a0 con 0x7f19f8076720 2024-09-19T06:11:34.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.557+0000 7f19fd600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f19f8118420 con 0x7f19f8112a30 2024-09-19T06:11:34.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.557+0000 7f19fd600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f19f8118720 con 0x7f19f8077040 2024-09-19T06:11:34.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.557+0000 7f19f6a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19f8076720 0x7f19f81a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:34.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.557+0000 7f19f6a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19f8076720 0x7f19f81a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44426/0 (socket says 172.21.15.3:44426) 2024-09-19T06:11:34.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.557+0000 7f19f6a00640 1 -- 172.21.15.3:0/3213379827 learned_addr learned my addr 172.21.15.3:0/3213379827 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:34.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.557+0000 7f19f7400640 1 --2- 172.21.15.3:0/3213379827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19f8112a30 0x7f19f819e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:34.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.557+0000 7f19f6000640 1 --2- 172.21.15.3:0/3213379827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19f8077040 0x7f19f81a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:34.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.558+0000 7f19f6a00640 1 -- 172.21.15.3:0/3213379827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19f8077040 msgr2=0x7f19f81a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:34.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.558+0000 7f19f6a00640 1 --2- 172.21.15.3:0/3213379827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19f8077040 0x7f19f81a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:34.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.558+0000 7f19f6a00640 1 -- 172.21.15.3:0/3213379827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19f8112a30 msgr2=0x7f19f819e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:34.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.558+0000 7f19f6a00640 1 --2- 172.21.15.3:0/3213379827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19f8112a30 0x7f19f819e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:34.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.558+0000 7f19f6a00640 1 -- 172.21.15.3:0/3213379827 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f819efc0 con 0x7f19f8076720 2024-09-19T06:11:34.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.558+0000 7f19f6a00640 1 --2- 172.21.15.3:0/3213379827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19f8076720 0x7f19f81a46d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f19e8035040 tx=0x7f19e8033d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:34.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.558+0000 7f19ef400640 1 -- 172.21.15.3:0/3213379827 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e803f020 con 0x7f19f8076720 2024-09-19T06:11:34.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.558+0000 7f19ef400640 1 -- 172.21.15.3:0/3213379827 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19e8032770 con 0x7f19f8076720 2024-09-19T06:11:34.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.558+0000 7f19fd600640 1 -- 172.21.15.3:0/3213379827 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f819f250 con 0x7f19f8076720 2024-09-19T06:11:34.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.558+0000 7f19ef400640 1 -- 172.21.15.3:0/3213379827 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e8037040 con 0x7f19f8076720 2024-09-19T06:11:34.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.559+0000 7f19fd600640 1 -- 172.21.15.3:0/3213379827 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f81ab5a0 con 0x7f19f8076720 2024-09-19T06:11:34.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.560+0000 7f19fd600640 1 -- 172.21.15.3:0/3213379827 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19f8076b00 con 0x7f19f8076720 2024-09-19T06:11:34.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.562+0000 7f19ef400640 1 -- 172.21.15.3:0/3213379827 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f19e8042020 con 0x7f19f8076720 2024-09-19T06:11:34.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.563+0000 7f19ef400640 1 --2- 172.21.15.3:0/3213379827 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f19dc0a32d0 0x7f19dc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:34.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.563+0000 7f19ef400640 1 -- 172.21.15.3:0/3213379827 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f19e80efbd0 con 0x7f19f8076720 2024-09-19T06:11:34.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.563+0000 7f19f6000640 1 --2- 172.21.15.3:0/3213379827 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f19dc0a32d0 0x7f19dc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:34.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.564+0000 7f19f6000640 1 --2- 172.21.15.3:0/3213379827 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f19dc0a32d0 0x7f19dc0a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f19f8079370 tx=0x7f19e4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:34.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.567+0000 7f19ef400640 1 -- 172.21.15.3:0/3213379827 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f19e8049020 con 0x7f19f8076720 2024-09-19T06:11:34.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.789+0000 7f19fd600640 1 -- 172.21.15.3:0/3213379827 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19f810dbc0 con 0x7f19f8076720 2024-09-19T06:11:34.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.789+0000 7f19ef400640 1 -- 172.21.15.3:0/3213379827 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11941 (secure 0 0 0) 0x7f19e80bc820 con 0x7f19f8076720 2024-09-19T06:11:34.792 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:11:34.792 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":28,"btime":"2024-09-19T06:10:19:770544+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:10:18.878479+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[14517,24514,24515,24532,24557]},"id":1}]} 2024-09-19T06:11:34.792 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 28 2024-09-19T06:11:34.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.792+0000 7f19fd600640 1 -- 172.21.15.3:0/3213379827 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f19dc0a32d0 msgr2=0x7f19dc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:34.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.792+0000 7f19fd600640 1 --2- 172.21.15.3:0/3213379827 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f19dc0a32d0 0x7f19dc0a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f19f8079370 tx=0x7f19e4009260 comp rx=0 tx=0).stop 2024-09-19T06:11:34.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.792+0000 7f19fd600640 1 -- 172.21.15.3:0/3213379827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19f8076720 msgr2=0x7f19f81a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:34.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.792+0000 7f19fd600640 1 --2- 172.21.15.3:0/3213379827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19f8076720 0x7f19f81a46d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f19e8035040 tx=0x7f19e8033d90 comp rx=0 tx=0).stop 2024-09-19T06:11:34.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.792+0000 7f19fd600640 1 -- 172.21.15.3:0/3213379827 shutdown_connections 2024-09-19T06:11:34.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.792+0000 7f19fd600640 1 --2- 172.21.15.3:0/3213379827 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f19dc0a32d0 0x7f19dc0a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:34.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.792+0000 7f19fd600640 1 --2- 172.21.15.3:0/3213379827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19f8112a30 0x7f19f819e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:34.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.792+0000 7f19fd600640 1 --2- 172.21.15.3:0/3213379827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f19f8077040 0x7f19f81a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:34.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.792+0000 7f19fd600640 1 --2- 172.21.15.3:0/3213379827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19f8076720 0x7f19f81a46d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:34.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.792+0000 7f19fd600640 1 -- 172.21.15.3:0/3213379827 >> 172.21.15.3:0/3213379827 conn(0x7f19f80ffa90 msgr2=0x7f19f8101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:34.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.792+0000 7f19fd600640 1 -- 172.21.15.3:0/3213379827 shutdown_connections 2024-09-19T06:11:34.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:34.792+0000 7f19fd600640 1 -- 172.21.15.3:0/3213379827 wait complete. 2024-09-19T06:11:35.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:35 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3213379827' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:11:35.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:35 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/3213379827' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:11:35.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:35 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/3213379827' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:11:35.603 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T06:10:03.693253+0000', 'modified': '2024-09-19T06:10:18.878479+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24557, 'mds_1': 24532, 'mds_2': 24515, 'mds_3': 24514, 'mds_4': 14517}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14505': {'gid': 14505, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.3:6839/2272422067', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.3:6838', 'nonce': 2272422067}, {'type': 'v1', 'addr': '172.21.15.3:6839', 'nonce': 2272422067}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14517': {'gid': 14517, 'name': 'a', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.3:6841/4189406134', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.3:6840', 'nonce': 4189406134}, {'type': 'v1', 'addr': '172.21.15.3:6841', 'nonce': 4189406134}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.71:6833/2883963583', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6832', 'nonce': 2883963583}, {'type': 'v1', 'addr': '172.21.15.71:6833', 'nonce': 2883963583}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24458': {'gid': 24458, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.59:6833/927949058', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 927949058}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 927949058}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24494': {'gid': 24494, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.59:6835/3846556695', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6834', 'nonce': 3846556695}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 3846556695}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24502': {'gid': 24502, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.71:6835/3322076004', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6834', 'nonce': 3322076004}, {'type': 'v1', 'addr': '172.21.15.71:6835', 'nonce': 3322076004}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24514': {'gid': 24514, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.71:6837/886513714', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6836', 'nonce': 886513714}, {'type': 'v1', 'addr': '172.21.15.71:6837', 'nonce': 886513714}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24515': {'gid': 24515, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.59:6837/4286779405', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6836', 'nonce': 4286779405}, {'type': 'v1', 'addr': '172.21.15.59:6837', 'nonce': 4286779405}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24532': {'gid': 24532, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.71:6839/3577136418', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6838', 'nonce': 3577136418}, {'type': 'v1', 'addr': '172.21.15.71:6839', 'nonce': 3577136418}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24557': {'gid': 24557, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.59:6839/3162585306', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6838', 'nonce': 3162585306}, {'type': 'v1', 'addr': '172.21.15.59:6839', 'nonce': 3162585306}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24557, 'qdb_cluster': [14517, 24514, 24515, 24532, 24557]} 2024-09-19T06:11:35.604 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-19T06:11:35.604 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.a status 2024-09-19T06:11:35.988 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:36.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:36 smithi059 ceph-mon[35138]: pgmap v350: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:36.290 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:36 smithi003 ceph-mon[30893]: pgmap v350: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:36.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:36 smithi071 ceph-mon[35662]: pgmap v350: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:36.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.548+0000 7f6adf200640 1 -- 172.21.15.3:0/1407097250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae0077040 msgr2=0x7f6ae0112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:36.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.548+0000 7f6adf200640 1 --2- 172.21.15.3:0/1407097250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae0077040 0x7f6ae0112330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009900 tx=0x7f6acc02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.548+0000 7f6adf200640 1 -- 172.21.15.3:0/1407097250 shutdown_connections 2024-09-19T06:11:36.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.548+0000 7f6adf200640 1 --2- 172.21.15.3:0/1407097250 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ae0112870 0x7f6ae0114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.548+0000 7f6adf200640 1 --2- 172.21.15.3:0/1407097250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae0077040 0x7f6ae0112330 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.548+0000 7f6adf200640 1 --2- 172.21.15.3:0/1407097250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ae0076720 0x7f6ae0076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.548+0000 7f6adf200640 1 -- 172.21.15.3:0/1407097250 >> 172.21.15.3:0/1407097250 conn(0x7f6ae00ff8d0 msgr2=0x7f6ae0101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:36.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.549+0000 7f6adf200640 1 -- 172.21.15.3:0/1407097250 shutdown_connections 2024-09-19T06:11:36.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.549+0000 7f6adf200640 1 -- 172.21.15.3:0/1407097250 wait complete. 2024-09-19T06:11:36.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.550+0000 7f6adf200640 1 Processor -- start 2024-09-19T06:11:36.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.550+0000 7f6adf200640 1 -- start start 2024-09-19T06:11:36.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.550+0000 7f6adf200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ae0076720 0x7f6ae01a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:36.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.550+0000 7f6adf200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ae0077040 0x7f6ae01a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:36.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.550+0000 7f6adf200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae0112870 0x7f6ae019e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:36.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.550+0000 7f6adf200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae01183e0 con 0x7f6ae0076720 2024-09-19T06:11:36.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.550+0000 7f6adf200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae0118260 con 0x7f6ae0077040 2024-09-19T06:11:36.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.550+0000 7f6adf200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae0118560 con 0x7f6ae0112870 2024-09-19T06:11:36.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.550+0000 7f6adde00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ae0076720 0x7f6ae01a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:36.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.551+0000 7f6adde00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ae0076720 0x7f6ae01a4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44438/0 (socket says 172.21.15.3:44438) 2024-09-19T06:11:36.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.551+0000 7f6adde00640 1 -- 172.21.15.3:0/837394074 learned_addr learned my addr 172.21.15.3:0/837394074 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:36.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.551+0000 7f6add400640 1 --2- 172.21.15.3:0/837394074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ae0077040 0x7f6ae01a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:36.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.551+0000 7f6ade800640 1 --2- 172.21.15.3:0/837394074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae0112870 0x7f6ae019e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:36.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.551+0000 7f6add400640 1 -- 172.21.15.3:0/837394074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae0112870 msgr2=0x7f6ae019e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:36.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.551+0000 7f6add400640 1 --2- 172.21.15.3:0/837394074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae0112870 0x7f6ae019e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.551+0000 7f6add400640 1 -- 172.21.15.3:0/837394074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ae0076720 msgr2=0x7f6ae01a4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:36.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.551+0000 7f6add400640 1 --2- 172.21.15.3:0/837394074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ae0076720 0x7f6ae01a4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.551+0000 7f6add400640 1 -- 172.21.15.3:0/837394074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae019efc0 con 0x7f6ae0077040 2024-09-19T06:11:36.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.551+0000 7f6adde00640 1 --2- 172.21.15.3:0/837394074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ae0076720 0x7f6ae01a4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:36.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.551+0000 7f6add400640 1 --2- 172.21.15.3:0/837394074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ae0077040 0x7f6ae01a4bc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6acc005940 tx=0x7f6acc0040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:36.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.552+0000 7f6ad6a00640 1 -- 172.21.15.3:0/837394074 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc03f030 con 0x7f6ae0077040 2024-09-19T06:11:36.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.552+0000 7f6ad6a00640 1 -- 172.21.15.3:0/837394074 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6acc0044c0 con 0x7f6ae0077040 2024-09-19T06:11:36.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.552+0000 7f6ad6a00640 1 -- 172.21.15.3:0/837394074 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc035070 con 0x7f6ae0077040 2024-09-19T06:11:36.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.552+0000 7f6adf200640 1 -- 172.21.15.3:0/837394074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae019f250 con 0x7f6ae0077040 2024-09-19T06:11:36.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.552+0000 7f6adf200640 1 -- 172.21.15.3:0/837394074 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae01ab430 con 0x7f6ae0077040 2024-09-19T06:11:36.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.555+0000 7f6ad6a00640 1 -- 172.21.15.3:0/837394074 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f6acc042030 con 0x7f6ae0077040 2024-09-19T06:11:36.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.555+0000 7f6ae7686740 1 Processor -- start 2024-09-19T06:11:36.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.555+0000 7f6ae7686740 1 -- start start 2024-09-19T06:11:36.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.556+0000 7f6ae7686740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9396214e0 0x55b9396218c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:36.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.556+0000 7f6ae7686740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b939621e00 0x55b93962c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:36.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.556+0000 7f6ae7686740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b93962c6c0 0x55b93962eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:36.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.556+0000 7f6ae7686740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b9395870b0 con 0x55b93962c6c0 2024-09-19T06:11:36.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.556+0000 7f6ae7686740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b93952eab0 con 0x55b939621e00 2024-09-19T06:11:36.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.556+0000 7f6ae7686740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b939583070 con 0x55b9396214e0 2024-09-19T06:11:36.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.556+0000 7f6add400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b93962c6c0 0x55b93962eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:36.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.556+0000 7f6adde00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b939621e00 0x55b93962c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:36.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.556+0000 7f6adde00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b939621e00 0x55b93962c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:47210/0 (socket says 172.21.15.3:47210) 2024-09-19T06:11:36.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.556+0000 7f6add400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b93962c6c0 0x55b93962eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44454/0 (socket says 172.21.15.3:44454) 2024-09-19T06:11:36.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.556+0000 7f6adde00640 1 -- 172.21.15.3:0/1688840257 learned_addr learned my addr 172.21.15.3:0/1688840257 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:36.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.556+0000 7f6ade800640 1 --2- 172.21.15.3:0/1688840257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9396214e0 0x55b9396218c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:36.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.556+0000 7f6adde00640 1 -- 172.21.15.3:0/1688840257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9396214e0 msgr2=0x55b9396218c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:36.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.556+0000 7f6adde00640 1 --2- 172.21.15.3:0/1688840257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9396214e0 0x55b9396218c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.556+0000 7f6adde00640 1 -- 172.21.15.3:0/1688840257 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b93962c6c0 msgr2=0x55b93962eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:36.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.556+0000 7f6adde00640 1 --2- 172.21.15.3:0/1688840257 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b93962c6c0 0x55b93962eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.557+0000 7f6adde00640 1 -- 172.21.15.3:0/1688840257 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b93953b4a0 con 0x55b939621e00 2024-09-19T06:11:36.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.557+0000 7f6ade800640 1 --2- 172.21.15.3:0/1688840257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9396214e0 0x55b9396218c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:36.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.557+0000 7f6adde00640 1 --2- 172.21.15.3:0/1688840257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b939621e00 0x55b93962c180 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0011650 tx=0x7f6ad0009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e023cbac1b959bc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:36.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.557+0000 7f6ad6a00640 1 --2- 172.21.15.3:0/837394074 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f6ac40a32d0 0x7f6ac40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:36.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.557+0000 7f6ad6a00640 1 -- 172.21.15.3:0/837394074 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f6acc0efe40 con 0x7f6ae0077040 2024-09-19T06:11:36.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.557+0000 7f6acb000640 1 -- 172.21.15.3:0/1688840257 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad001e070 con 0x55b939621e00 2024-09-19T06:11:36.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.557+0000 7f6acb000640 1 -- 172.21.15.3:0/1688840257 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ad000fba0 con 0x55b939621e00 2024-09-19T06:11:36.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.557+0000 7f6acb000640 1 -- 172.21.15.3:0/1688840257 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0019cd0 con 0x55b939621e00 2024-09-19T06:11:36.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.557+0000 7f6ade800640 1 --2- 172.21.15.3:0/837394074 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f6ac40a32d0 0x7f6ac40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:36.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.558+0000 7f6ae7686740 1 -- 172.21.15.3:0/1688840257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b939621e00 msgr2=0x55b93962c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:36.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.558+0000 7f6ae7686740 1 --2- 172.21.15.3:0/1688840257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b939621e00 0x55b93962c180 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0011650 tx=0x7f6ad0009f90 comp rx=0 tx=0).stop 2024-09-19T06:11:36.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.558+0000 7f6ade800640 1 --2- 172.21.15.3:0/837394074 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f6ac40a32d0 0x7f6ac40a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6ae006b3d0 tx=0x7f6ad8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:36.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.558+0000 7f6ae7686740 1 -- 172.21.15.3:0/1688840257 shutdown_connections 2024-09-19T06:11:36.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.558+0000 7f6ae7686740 1 --2- 172.21.15.3:0/1688840257 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b93962c6c0 0x55b93962eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.558+0000 7f6ae7686740 1 --2- 172.21.15.3:0/1688840257 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b939621e00 0x55b93962c180 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.558+0000 7f6ae7686740 1 --2- 172.21.15.3:0/1688840257 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9396214e0 0x55b9396218c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.558+0000 7f6ae7686740 1 -- 172.21.15.3:0/1688840257 >> 172.21.15.3:0/1688840257 conn(0x55b93961da70 msgr2=0x55b93961de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:36.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.558+0000 7f6ae7686740 1 -- 172.21.15.3:0/1688840257 shutdown_connections 2024-09-19T06:11:36.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.558+0000 7f6ae7686740 1 -- 172.21.15.3:0/1688840257 wait complete. 2024-09-19T06:11:36.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.559+0000 7f6ae7686740 1 -- start start 2024-09-19T06:11:36.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.559+0000 7f6ae7686740 1 Processor -- start 2024-09-19T06:11:36.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.559+0000 7f6ae7686740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9396214e0 0x55b939629570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:36.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.559+0000 7f6ae7686740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b939621e00 0x55b939629ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:36.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.559+0000 7f6ae7686740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b93962c6c0 0x55b939629ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:36.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.559+0000 7f6ae7686740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b93962f330 con 0x55b93962c6c0 2024-09-19T06:11:36.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.559+0000 7f6ae7686740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b93950f920 con 0x55b939621e00 2024-09-19T06:11:36.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.559+0000 7f6ae7686740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b93962f4b0 con 0x55b9396214e0 2024-09-19T06:11:36.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.559+0000 7f6ae7686740 10 client.0 _ll_register_callbacks cb 0x55b9395338a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:11:36.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.560+0000 7f6adde00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9396214e0 0x55b939629570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:36.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.560+0000 7f6ade800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b93962c6c0 0x55b939629ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:36.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.560+0000 7f6adde00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9396214e0 0x55b939629570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:59358/0 (socket says 172.21.15.3:59358) 2024-09-19T06:11:36.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.560+0000 7f6adde00640 1 -- 172.21.15.3:0/509362644 learned_addr learned my addr 172.21.15.3:0/509362644 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:36.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.560+0000 7f6add400640 1 --2- 172.21.15.3:0/509362644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b939621e00 0x55b939629ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:36.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.560+0000 7f6adde00640 1 -- 172.21.15.3:0/509362644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b939621e00 msgr2=0x55b939629ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:36.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.560+0000 7f6adde00640 1 --2- 172.21.15.3:0/509362644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b939621e00 0x55b939629ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.560+0000 7f6adde00640 1 -- 172.21.15.3:0/509362644 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b93962c6c0 msgr2=0x55b939629ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:36.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.560+0000 7f6adde00640 1 --2- 172.21.15.3:0/509362644 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b93962c6c0 0x55b939629ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.560+0000 7f6adde00640 1 -- 172.21.15.3:0/509362644 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9392f82b0 con 0x55b9396214e0 2024-09-19T06:11:36.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.560+0000 7f6adde00640 1 --2- 172.21.15.3:0/509362644 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9396214e0 0x55b939629570 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0019850 tx=0x7f6ad00056d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38a91f026bc1fba4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:36.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.560+0000 7f6abf400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:11:36.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.561+0000 7f6abf400640 1 -- 172.21.15.3:0/509362644 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad001e040 con 0x55b9396214e0 2024-09-19T06:11:36.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.561+0000 7f6ae7686740 1 -- 172.21.15.3:0/509362644 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ad000fba0 con 0x55b9396214e0 2024-09-19T06:11:36.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.561+0000 7f6abf400640 1 -- 172.21.15.3:0/509362644 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f6ad000fd50 con 0x55b9396214e0 2024-09-19T06:11:36.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.561+0000 7f6abf400640 1 -- 172.21.15.3:0/509362644 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6ad0009cc0 con 0x55b9396214e0 2024-09-19T06:11:36.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.561+0000 7f6ae7686740 10 client.24913 fetch_fsmap learned FSMap version 28 2024-09-19T06:11:36.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.561+0000 7f6ae7686740 1 -- 172.21.15.3:0/509362644 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b93963afe0 con 0x55b9396214e0 2024-09-19T06:11:36.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.561+0000 7f6abf400640 1 -- 172.21.15.3:0/509362644 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ad000fba0 con 0x55b9396214e0 2024-09-19T06:11:36.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.561+0000 7f6abf400640 1 -- 172.21.15.3:0/509362644 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6ad0021070 con 0x55b9396214e0 2024-09-19T06:11:36.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.562+0000 7f6ae7686740 10 client.24913 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:11:36.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.562+0000 7f6ae7686740 10 client.24913 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T06:11:36.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.562+0000 7f6ae7686740 20 client.24913 populate_metadata read hostname 'smithi003' 2024-09-19T06:11:36.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.562+0000 7f6ae7686740 1 --2- 172.21.15.3:0/509362644 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55b93963d3f0 0x55b93963e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:36.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.562+0000 7f6ae7686740 4 client.24913 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:11:36.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.562+0000 7f6ae7686740 1 -- 172.21.15.3:0/509362644 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b939594620 con 0x55b93963d3f0 2024-09-19T06:11:36.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.562+0000 7f6add400640 1 --2- 172.21.15.3:0/509362644 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55b93963d3f0 0x55b93963e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:36.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.563+0000 7f6abf400640 10 client.24913 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:11:36.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.562+0000 7f6add400640 1 --2- 172.21.15.3:0/509362644 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55b93963d3f0 0x55b93963e860 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8bb6a59bd98d0df3 server_cookie=d1de3a1d61fd4cca in_seq=0 out_seq=0 2024-09-19T06:11:36.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.563+0000 7f6abf400640 1 -- 172.21.15.3:0/509362644 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b939594620 con 0x55b93963d3f0 2024-09-19T06:11:36.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.563+0000 7f6abf400640 10 client.24913 handle_command_reply: tid=0 2024-09-19T06:11:36.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.563+0000 7f6ae7686740 1 client.24913 shutdown 2024-09-19T06:11:36.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.564+0000 7f6ae7686740 1 -- 172.21.15.3:0/509362644 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9396214e0 msgr2=0x55b939629570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:36.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.564+0000 7f6ae7686740 1 --2- 172.21.15.3:0/509362644 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9396214e0 0x55b939629570 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0019850 tx=0x7f6ad00056d0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.564+0000 7f6ae7686740 1 -- 172.21.15.3:0/509362644 shutdown_connections 2024-09-19T06:11:36.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.564+0000 7f6ae7686740 1 --2- 172.21.15.3:0/509362644 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55b93963d3f0 0x55b93963e860 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.564+0000 7f6ae7686740 1 --2- 172.21.15.3:0/509362644 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b93962c6c0 0x55b939629ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.564+0000 7f6ae7686740 1 --2- 172.21.15.3:0/509362644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b939621e00 0x55b939629ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.564+0000 7f6abf400640 0 client.24913 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:11:36.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.564+0000 7f6ae7686740 1 --2- 172.21.15.3:0/509362644 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b9396214e0 0x55b939629570 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.564+0000 7f6ae7686740 1 -- 172.21.15.3:0/509362644 >> 172.21.15.3:0/509362644 conn(0x55b93961da70 msgr2=0x55b93961cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:36.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.564+0000 7f6ae7686740 1 -- 172.21.15.3:0/509362644 shutdown_connections 2024-09-19T06:11:36.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.564+0000 7f6ae7686740 1 -- 172.21.15.3:0/509362644 wait complete. 2024-09-19T06:11:36.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.564+0000 7f6ae7686740 20 client.24913 trim_cache size 0 max 16384 2024-09-19T06:11:36.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.583+0000 7f6ae7686740 1 Processor -- start 2024-09-19T06:11:36.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.583+0000 7f6ae7686740 1 -- start start 2024-09-19T06:11:36.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.583+0000 7f6ae7686740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b93961da70 0x55b93963e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:36.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.583+0000 7f6ae7686740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b9396214e0 0x55b939623f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:36.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.583+0000 7f6ae7686740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b939621e00 0x55b939629ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:36.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.583+0000 7f6ae7686740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b93963cba0 con 0x55b9396214e0 2024-09-19T06:11:36.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.583+0000 7f6ae7686740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b93963d270 con 0x55b939621e00 2024-09-19T06:11:36.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.583+0000 7f6ae7686740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b93963d940 con 0x55b93961da70 2024-09-19T06:11:36.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.584+0000 7f6add400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b9396214e0 0x55b939623f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:36.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.584+0000 7f6adde00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b93961da70 0x55b93963e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:36.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.584+0000 7f6add400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b9396214e0 0x55b939623f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44464/0 (socket says 172.21.15.3:44464) 2024-09-19T06:11:36.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.584+0000 7f6add400640 1 -- 172.21.15.3:0/4247999009 learned_addr learned my addr 172.21.15.3:0/4247999009 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:36.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.584+0000 7f6ade800640 1 --2- 172.21.15.3:0/4247999009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b939621e00 0x55b939629ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:36.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.584+0000 7f6adde00640 1 -- 172.21.15.3:0/4247999009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b939621e00 msgr2=0x55b939629ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:36.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.584+0000 7f6adde00640 1 --2- 172.21.15.3:0/4247999009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b939621e00 0x55b939629ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.584+0000 7f6adde00640 1 -- 172.21.15.3:0/4247999009 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b9396214e0 msgr2=0x55b939623f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:36.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.584+0000 7f6adde00640 1 --2- 172.21.15.3:0/4247999009 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b9396214e0 0x55b939623f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.584+0000 7f6adde00640 1 -- 172.21.15.3:0/4247999009 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b93961ec00 con 0x55b93961da70 2024-09-19T06:11:36.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.584+0000 7f6add400640 1 --2- 172.21.15.3:0/4247999009 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b9396214e0 0x55b939623f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:36.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.584+0000 7f6adde00640 1 --2- 172.21.15.3:0/4247999009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b93961da70 0x55b93963e190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6ad00059f0 tx=0x7f6ad0003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1063d435d2b0961 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:36.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.585+0000 7f6aca600640 1 -- 172.21.15.3:0/4247999009 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad001e040 con 0x55b93961da70 2024-09-19T06:11:36.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.585+0000 7f6aca600640 1 -- 172.21.15.3:0/4247999009 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ad0009e60 con 0x55b93961da70 2024-09-19T06:11:36.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.585+0000 7f6aca600640 1 -- 172.21.15.3:0/4247999009 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0004000 con 0x55b93961da70 2024-09-19T06:11:36.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.585+0000 7f6ae7686740 1 -- 172.21.15.3:0/4247999009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b93961da70 msgr2=0x55b93963e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:36.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.585+0000 7f6ae7686740 1 --2- 172.21.15.3:0/4247999009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b93961da70 0x55b93963e190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6ad00059f0 tx=0x7f6ad0003b20 comp rx=0 tx=0).stop 2024-09-19T06:11:36.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.585+0000 7f6ae7686740 1 -- 172.21.15.3:0/4247999009 shutdown_connections 2024-09-19T06:11:36.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.585+0000 7f6ae7686740 1 --2- 172.21.15.3:0/4247999009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b939621e00 0x55b939629ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.585+0000 7f6ae7686740 1 --2- 172.21.15.3:0/4247999009 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b9396214e0 0x55b939623f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.585+0000 7f6ae7686740 1 --2- 172.21.15.3:0/4247999009 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b93961da70 0x55b93963e190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.585+0000 7f6ae7686740 1 -- 172.21.15.3:0/4247999009 >> 172.21.15.3:0/4247999009 conn(0x55b93963c7c0 msgr2=0x55b93962b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:36.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.586+0000 7f6ae7686740 1 -- 172.21.15.3:0/4247999009 shutdown_connections 2024-09-19T06:11:36.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.586+0000 7f6ae7686740 1 -- 172.21.15.3:0/4247999009 wait complete. 2024-09-19T06:11:36.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.586+0000 7f6ae7686740 1 -- start start 2024-09-19T06:11:36.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.586+0000 7f6ae7686740 1 Processor -- start 2024-09-19T06:11:36.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.587+0000 7f6ae7686740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b93961da70 0x55b939640a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:36.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.587+0000 7f6ae7686740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9396214e0 0x55b939640fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:36.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.587+0000 7f6ae7686740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b939621e00 0x55b939641510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:36.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.587+0000 7f6ae7686740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b93963e6e0 con 0x55b939621e00 2024-09-19T06:11:36.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.587+0000 7f6ae7686740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b93963e010 con 0x55b9396214e0 2024-09-19T06:11:36.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.587+0000 7f6ae7686740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b93963edb0 con 0x55b93961da70 2024-09-19T06:11:36.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.587+0000 7f6ae7686740 10 client.0 _ll_register_callbacks cb 0x7f6ad8009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:11:36.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.587+0000 7f6ade800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b939621e00 0x55b939641510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:36.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.587+0000 7f6ade800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b939621e00 0x55b939641510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44474/0 (socket says 172.21.15.3:44474) 2024-09-19T06:11:36.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.587+0000 7f6ade800640 1 -- 172.21.15.3:0/3988318591 learned_addr learned my addr 172.21.15.3:0/3988318591 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:36.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.587+0000 7f6adde00640 1 --2- 172.21.15.3:0/3988318591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b93961da70 0x55b939640a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:36.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.587+0000 7f6add400640 1 --2- 172.21.15.3:0/3988318591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9396214e0 0x55b939640fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:36.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.587+0000 7f6ade800640 1 -- 172.21.15.3:0/3988318591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b93961da70 msgr2=0x55b939640a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:36.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.587+0000 7f6ade800640 1 --2- 172.21.15.3:0/3988318591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b93961da70 0x55b939640a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.587+0000 7f6ade800640 1 -- 172.21.15.3:0/3988318591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9396214e0 msgr2=0x55b939640fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:36.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.587+0000 7f6ade800640 1 --2- 172.21.15.3:0/3988318591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9396214e0 0x55b939640fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.587+0000 7f6ade800640 1 -- 172.21.15.3:0/3988318591 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9396454d0 con 0x55b939621e00 2024-09-19T06:11:36.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.587+0000 7f6add400640 1 --2- 172.21.15.3:0/3988318591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9396214e0 0x55b939640fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:36.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.588+0000 7f6ade800640 1 --2- 172.21.15.3:0/3988318591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b939621e00 0x55b939641510 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800f800 tx=0x7f6ad8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f629d7be92a806 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:36.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.588+0000 7f6abf400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:11:36.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.588+0000 7f6abf400640 1 -- 172.21.15.3:0/3988318591 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad802f060 con 0x55b939621e00 2024-09-19T06:11:36.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.588+0000 7f6abf400640 1 -- 172.21.15.3:0/3988318591 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f6ad8003b80 con 0x55b939621e00 2024-09-19T06:11:36.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.588+0000 7f6ae7686740 1 -- 172.21.15.3:0/3988318591 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ad0009e60 con 0x55b939621e00 2024-09-19T06:11:36.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.588+0000 7f6abf400640 1 -- 172.21.15.3:0/3988318591 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6ad8003d80 con 0x55b939621e00 2024-09-19T06:11:36.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.588+0000 7f6ae7686740 10 client.14880 fetch_fsmap learned FSMap version 28 2024-09-19T06:11:36.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.588+0000 7f6ae7686740 1 -- 172.21.15.3:0/3988318591 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b9396a8040 con 0x55b939621e00 2024-09-19T06:11:36.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.589+0000 7f6abf400640 1 -- 172.21.15.3:0/3988318591 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ad0009e60 con 0x55b939621e00 2024-09-19T06:11:36.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.589+0000 7f6abf400640 1 -- 172.21.15.3:0/3988318591 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6ad801f720 con 0x55b939621e00 2024-09-19T06:11:36.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.589+0000 7f6ae7686740 10 client.14880 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:11:36.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.589+0000 7f6ae7686740 10 client.14880 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T06:11:36.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.589+0000 7f6ae7686740 20 client.14880 populate_metadata read hostname 'smithi003' 2024-09-19T06:11:36.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.589+0000 7f6ae7686740 1 --2- 172.21.15.3:0/3988318591 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55b93962c6c0 0x55b9396ab980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:36.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.589+0000 7f6ae7686740 4 client.14880 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:11:36.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.589+0000 7f6ae7686740 1 -- 172.21.15.3:0/3988318591 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "status"}) -- 0x55b93958eb30 con 0x55b93962c6c0 2024-09-19T06:11:36.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.589+0000 7f6adde00640 1 --2- 172.21.15.3:0/3988318591 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55b93962c6c0 0x55b9396ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:36.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.590+0000 7f6adde00640 1 --2- 172.21.15.3:0/3988318591 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55b93962c6c0 0x55b9396ab980 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1844d895bebbb7e8 server_cookie=11abc7f682fb4488 in_seq=0 out_seq=0 2024-09-19T06:11:36.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.590+0000 7f6abf400640 10 client.14880 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:11:36.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.590+0000 7f6abf400640 1 -- 172.21.15.3:0/3988318591 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55b93958eb30 con 0x55b93962c6c0 2024-09-19T06:11:36.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.590+0000 7f6abf400640 10 client.14880 handle_command_reply: tid=0 2024-09-19T06:11:36.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.590+0000 7f6ae7686740 1 client.14880 shutdown 2024-09-19T06:11:36.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.590+0000 7f6ae7686740 1 -- 172.21.15.3:0/3988318591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b939621e00 msgr2=0x55b939641510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:36.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.590+0000 7f6ae7686740 1 --2- 172.21.15.3:0/3988318591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b939621e00 0x55b939641510 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800f800 tx=0x7f6ad8004a40 comp rx=0 tx=0).stop 2024-09-19T06:11:36.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.590+0000 7f6ae7686740 1 -- 172.21.15.3:0/3988318591 shutdown_connections 2024-09-19T06:11:36.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.590+0000 7f6ae7686740 1 --2- 172.21.15.3:0/3988318591 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55b93962c6c0 0x55b9396ab980 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.590+0000 7f6ae7686740 1 --2- 172.21.15.3:0/3988318591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b939621e00 0x55b939641510 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.590+0000 7f6ae7686740 1 --2- 172.21.15.3:0/3988318591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b9396214e0 0x55b939640fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.590+0000 7f6ae7686740 1 --2- 172.21.15.3:0/3988318591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b93961da70 0x55b939640a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.590+0000 7f6abf400640 0 client.14880 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:11:36.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.590+0000 7f6ae7686740 1 -- 172.21.15.3:0/3988318591 >> 172.21.15.3:0/3988318591 conn(0x55b93963c7c0 msgr2=0x55b939637730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:36.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.591+0000 7f6ae7686740 1 -- 172.21.15.3:0/3988318591 shutdown_connections 2024-09-19T06:11:36.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.591+0000 7f6ae7686740 1 -- 172.21.15.3:0/3988318591 wait complete. 2024-09-19T06:11:36.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.591+0000 7f6ae7686740 20 client.14880 trim_cache size 0 max 16384 2024-09-19T06:11:36.601 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:11:36.601 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "782a5144-764c-11ef-bceb-c7b262605968", 2024-09-19T06:11:36.601 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 4, 2024-09-19T06:11:36.601 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 14517, 2024-09-19T06:11:36.601 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2024-09-19T06:11:36.602 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2024-09-19T06:11:36.602 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2024-09-19T06:11:36.602 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 79.828673441000007, 2024-09-19T06:11:36.602 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 28, 2024-09-19T06:11:36.602 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 88, 2024-09-19T06:11:36.603 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 86, 2024-09-19T06:11:36.603 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 109.289856263 2024-09-19T06:11:36.603 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:11:36.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.591+0000 7f6adf200640 1 -- 172.21.15.3:0/837394074 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f6ac40a32d0 msgr2=0x7f6ac40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:36.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.591+0000 7f6adf200640 1 --2- 172.21.15.3:0/837394074 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f6ac40a32d0 0x7f6ac40a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6ae006b3d0 tx=0x7f6ad8009500 comp rx=0 tx=0).stop 2024-09-19T06:11:36.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.591+0000 7f6adf200640 1 -- 172.21.15.3:0/837394074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ae0077040 msgr2=0x7f6ae01a4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:36.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.591+0000 7f6adf200640 1 --2- 172.21.15.3:0/837394074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ae0077040 0x7f6ae01a4bc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6acc005940 tx=0x7f6acc0040c0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.591+0000 7f6adf200640 1 -- 172.21.15.3:0/837394074 shutdown_connections 2024-09-19T06:11:36.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.591+0000 7f6adf200640 1 --2- 172.21.15.3:0/837394074 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f6ac40a32d0 0x7f6ac40a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.591+0000 7f6adf200640 1 --2- 172.21.15.3:0/837394074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ae0112870 0x7f6ae019e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.591+0000 7f6adf200640 1 --2- 172.21.15.3:0/837394074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ae0077040 0x7f6ae01a4bc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.591+0000 7f6adf200640 1 --2- 172.21.15.3:0/837394074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ae0076720 0x7f6ae01a4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:36.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.591+0000 7f6adf200640 1 -- 172.21.15.3:0/837394074 >> 172.21.15.3:0/837394074 conn(0x7f6ae00ff8d0 msgr2=0x7f6ae0101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:36.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.592+0000 7f6adf200640 1 -- 172.21.15.3:0/837394074 shutdown_connections 2024-09-19T06:11:36.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:36.592+0000 7f6adf200640 1 -- 172.21.15.3:0/837394074 wait complete. 2024-09-19T06:11:37.531 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T06:11:37.910 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:38.272 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:38 smithi003 ceph-mon[30893]: pgmap v351: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:11:38.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:38 smithi059 ceph-mon[35138]: pgmap v351: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:11:38.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:38 smithi071 ceph-mon[35662]: pgmap v351: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:11:38.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.498+0000 7f0bcb200640 1 -- 172.21.15.3:0/1502363651 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bcc077040 msgr2=0x7f0bcc112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:38.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.498+0000 7f0bcb200640 1 --2- 172.21.15.3:0/1502363651 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bcc077040 0x7f0bcc112330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009900 tx=0x7f0bb402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.498+0000 7f0bcb200640 1 -- 172.21.15.3:0/1502363651 shutdown_connections 2024-09-19T06:11:38.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.498+0000 7f0bcb200640 1 --2- 172.21.15.3:0/1502363651 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bcc112870 0x7f0bcc114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.498+0000 7f0bcb200640 1 --2- 172.21.15.3:0/1502363651 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bcc077040 0x7f0bcc112330 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.498+0000 7f0bcb200640 1 --2- 172.21.15.3:0/1502363651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bcc076720 0x7f0bcc076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.498+0000 7f0bcb200640 1 -- 172.21.15.3:0/1502363651 >> 172.21.15.3:0/1502363651 conn(0x7f0bcc0ff8d0 msgr2=0x7f0bcc101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:38.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.498+0000 7f0bcb200640 1 -- 172.21.15.3:0/1502363651 shutdown_connections 2024-09-19T06:11:38.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.498+0000 7f0bcb200640 1 -- 172.21.15.3:0/1502363651 wait complete. 2024-09-19T06:11:38.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.500+0000 7f0bcb200640 1 Processor -- start 2024-09-19T06:11:38.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.500+0000 7f0bcb200640 1 -- start start 2024-09-19T06:11:38.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.500+0000 7f0bcb200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bcc076720 0x7f0bcc1a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:38.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.500+0000 7f0bcb200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bcc077040 0x7f0bcc1a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:38.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.500+0000 7f0bcb200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bcc112870 0x7f0bcc19e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:38.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.500+0000 7f0bcb200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0bcc118430 con 0x7f0bcc077040 2024-09-19T06:11:38.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.500+0000 7f0bcb200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0bcc1182b0 con 0x7f0bcc112870 2024-09-19T06:11:38.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.500+0000 7f0bcb200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0bcc1185b0 con 0x7f0bcc076720 2024-09-19T06:11:38.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.501+0000 7f0bc9e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bcc076720 0x7f0bcc1a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:38.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.501+0000 7f0bc1400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bcc077040 0x7f0bcc1a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:38.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.501+0000 7f0bc9e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bcc076720 0x7f0bcc1a4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:59392/0 (socket says 172.21.15.3:59392) 2024-09-19T06:11:38.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.501+0000 7f0bc9e00640 1 -- 172.21.15.3:0/121871440 learned_addr learned my addr 172.21.15.3:0/121871440 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:38.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.501+0000 7f0bca800640 1 --2- 172.21.15.3:0/121871440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bcc112870 0x7f0bcc19e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:38.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.501+0000 7f0bc9e00640 1 -- 172.21.15.3:0/121871440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bcc112870 msgr2=0x7f0bcc19e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:38.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.501+0000 7f0bc9e00640 1 --2- 172.21.15.3:0/121871440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bcc112870 0x7f0bcc19e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.501+0000 7f0bc9e00640 1 -- 172.21.15.3:0/121871440 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bcc077040 msgr2=0x7f0bcc1a4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:38.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.501+0000 7f0bc9e00640 1 --2- 172.21.15.3:0/121871440 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bcc077040 0x7f0bcc1a4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.501+0000 7f0bc9e00640 1 -- 172.21.15.3:0/121871440 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bcc19efb0 con 0x7f0bcc076720 2024-09-19T06:11:38.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.501+0000 7f0bc1400640 1 --2- 172.21.15.3:0/121871440 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bcc077040 0x7f0bcc1a4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:38.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.501+0000 7f0bc9e00640 1 --2- 172.21.15.3:0/121871440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bcc076720 0x7f0bcc1a4670 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc00d950 tx=0x7f0bbc00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:38.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.502+0000 7f0bc3400640 1 -- 172.21.15.3:0/121871440 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc017030 con 0x7f0bcc076720 2024-09-19T06:11:38.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.502+0000 7f0bc3400640 1 -- 172.21.15.3:0/121871440 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bbc004020 con 0x7f0bcc076720 2024-09-19T06:11:38.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.502+0000 7f0bc3400640 1 -- 172.21.15.3:0/121871440 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc0047a0 con 0x7f0bcc076720 2024-09-19T06:11:38.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.502+0000 7f0bcb200640 1 -- 172.21.15.3:0/121871440 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bcc19f2a0 con 0x7f0bcc076720 2024-09-19T06:11:38.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.502+0000 7f0bcb200640 1 -- 172.21.15.3:0/121871440 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bcc1ab5f0 con 0x7f0bcc076720 2024-09-19T06:11:38.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.505+0000 7f0bd3a22740 1 Processor -- start 2024-09-19T06:11:38.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.505+0000 7f0bc3400640 1 -- 172.21.15.3:0/121871440 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f0bbc0041d0 con 0x7f0bcc076720 2024-09-19T06:11:38.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.505+0000 7f0bd3a22740 1 -- start start 2024-09-19T06:11:38.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.505+0000 7f0bd3a22740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3994e0 0x56395c3998c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:38.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.505+0000 7f0bd3a22740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56395c399e00 0x56395c3a4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:38.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.506+0000 7f0bd3a22740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c3a46c0 0x56395c3a6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:38.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.506+0000 7f0bd3a22740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56395c2ff0b0 con 0x56395c3994e0 2024-09-19T06:11:38.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.506+0000 7f0bd3a22740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56395c2a6ab0 con 0x56395c399e00 2024-09-19T06:11:38.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.506+0000 7f0bd3a22740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56395c2fb070 con 0x56395c3a46c0 2024-09-19T06:11:38.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.506+0000 7f0bca800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3994e0 0x56395c3998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:38.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.506+0000 7f0bca800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3994e0 0x56395c3998c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44488/0 (socket says 172.21.15.3:44488) 2024-09-19T06:11:38.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.506+0000 7f0bca800640 1 -- 172.21.15.3:0/710440775 learned_addr learned my addr 172.21.15.3:0/710440775 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:38.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.506+0000 7f0bc9e00640 1 --2- 172.21.15.3:0/710440775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56395c399e00 0x56395c3a4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:38.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.506+0000 7f0bc1400640 1 --2- 172.21.15.3:0/710440775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c3a46c0 0x56395c3a6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:38.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.506+0000 7f0bca800640 1 -- 172.21.15.3:0/710440775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c3a46c0 msgr2=0x56395c3a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:38.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.506+0000 7f0bca800640 1 --2- 172.21.15.3:0/710440775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c3a46c0 0x56395c3a6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.506+0000 7f0bca800640 1 -- 172.21.15.3:0/710440775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56395c399e00 msgr2=0x56395c3a4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:38.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.506+0000 7f0bca800640 1 --2- 172.21.15.3:0/710440775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56395c399e00 0x56395c3a4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.506+0000 7f0bca800640 1 -- 172.21.15.3:0/710440775 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56395c2b34a0 con 0x56395c3994e0 2024-09-19T06:11:38.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.507+0000 7f0bca800640 1 --2- 172.21.15.3:0/710440775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3994e0 0x56395c3998c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009f30 tx=0x7f0bc40118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c0cc15542dc9db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:38.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.507+0000 7f0bc3400640 1 --2- 172.21.15.3:0/121871440 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0bb00a32d0 0x7f0bb00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:38.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.507+0000 7f0bc3400640 1 -- 172.21.15.3:0/121871440 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f0bbc0cf460 con 0x7f0bcc076720 2024-09-19T06:11:38.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.507+0000 7f0bbb400640 1 -- 172.21.15.3:0/710440775 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4004d20 con 0x56395c3994e0 2024-09-19T06:11:38.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.507+0000 7f0bc9e00640 1 --2- 172.21.15.3:0/121871440 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0bb00a32d0 0x7f0bb00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:38.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.507+0000 7f0bbb400640 1 -- 172.21.15.3:0/710440775 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bc4004050 con 0x56395c3994e0 2024-09-19T06:11:38.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.507+0000 7f0bbb400640 1 -- 172.21.15.3:0/710440775 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4005260 con 0x56395c3994e0 2024-09-19T06:11:38.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.508+0000 7f0bd3a22740 1 -- 172.21.15.3:0/710440775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3994e0 msgr2=0x56395c3998c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:38.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.508+0000 7f0bd3a22740 1 --2- 172.21.15.3:0/710440775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3994e0 0x56395c3998c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009f30 tx=0x7f0bc40118d0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.508+0000 7f0bc9e00640 1 --2- 172.21.15.3:0/121871440 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0bb00a32d0 0x7f0bb00a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc09b5a0 tx=0x7f0bbc0d2f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:38.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.508+0000 7f0bd3a22740 1 -- 172.21.15.3:0/710440775 shutdown_connections 2024-09-19T06:11:38.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.508+0000 7f0bd3a22740 1 --2- 172.21.15.3:0/710440775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c3a46c0 0x56395c3a6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.508+0000 7f0bd3a22740 1 --2- 172.21.15.3:0/710440775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56395c399e00 0x56395c3a4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.508+0000 7f0bd3a22740 1 --2- 172.21.15.3:0/710440775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3994e0 0x56395c3998c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.508+0000 7f0bd3a22740 1 -- 172.21.15.3:0/710440775 >> 172.21.15.3:0/710440775 conn(0x56395c395a70 msgr2=0x56395c395e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:38.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.508+0000 7f0bd3a22740 1 -- 172.21.15.3:0/710440775 shutdown_connections 2024-09-19T06:11:38.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.508+0000 7f0bd3a22740 1 -- 172.21.15.3:0/710440775 wait complete. 2024-09-19T06:11:38.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.509+0000 7f0bd3a22740 1 -- start start 2024-09-19T06:11:38.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.509+0000 7f0bd3a22740 1 Processor -- start 2024-09-19T06:11:38.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.509+0000 7f0bd3a22740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56395c3994e0 0x56395c3a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:38.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.509+0000 7f0bd3a22740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c399e00 0x56395c3a1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:38.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.509+0000 7f0bd3a22740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3a46c0 0x56395c3a2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:38.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.509+0000 7f0bd3a22740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56395c3a7330 con 0x56395c3a46c0 2024-09-19T06:11:38.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.509+0000 7f0bd3a22740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56395c287920 con 0x56395c3994e0 2024-09-19T06:11:38.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.509+0000 7f0bd3a22740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56395c3a74b0 con 0x56395c399e00 2024-09-19T06:11:38.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.509+0000 7f0bd3a22740 10 client.0 _ll_register_callbacks cb 0x56395c2ab8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:11:38.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.510+0000 7f0bca800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56395c3994e0 0x56395c3a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:38.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.510+0000 7f0bc1400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c399e00 0x56395c3a1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:38.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.510+0000 7f0bc1400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c399e00 0x56395c3a1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:59402/0 (socket says 172.21.15.3:59402) 2024-09-19T06:11:38.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.510+0000 7f0bc1400640 1 -- 172.21.15.3:0/297020377 learned_addr learned my addr 172.21.15.3:0/297020377 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:38.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.510+0000 7f0bca800640 1 --2- 172.21.15.3:0/297020377 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3a46c0 0x56395c3a2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:38.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.510+0000 7f0bc1400640 1 -- 172.21.15.3:0/297020377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56395c3994e0 msgr2=0x56395c3a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:38.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.510+0000 7f0bc1400640 1 --2- 172.21.15.3:0/297020377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56395c3994e0 0x56395c3a15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.510+0000 7f0bc1400640 1 -- 172.21.15.3:0/297020377 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3a46c0 msgr2=0x56395c3a2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:38.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.510+0000 7f0bc1400640 1 --2- 172.21.15.3:0/297020377 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3a46c0 0x56395c3a2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.510+0000 7f0bc1400640 1 -- 172.21.15.3:0/297020377 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56395c0702b0 con 0x56395c399e00 2024-09-19T06:11:38.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.510+0000 7f0bca800640 1 --2- 172.21.15.3:0/297020377 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3a46c0 0x56395c3a2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:11:38.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.510+0000 7f0bc1400640 1 --2- 172.21.15.3:0/297020377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c399e00 0x56395c3a1b00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4033000 tx=0x7f0bb4005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29a501f0f9b190ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:38.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.510+0000 7f0bafe00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:11:38.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.511+0000 7f0bafe00640 1 -- 172.21.15.3:0/297020377 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4035040 con 0x56395c399e00 2024-09-19T06:11:38.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.511+0000 7f0bafe00640 1 -- 172.21.15.3:0/297020377 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f0bb4004960 con 0x56395c399e00 2024-09-19T06:11:38.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.511+0000 7f0bd3a22740 1 -- 172.21.15.3:0/297020377 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bc4004050 con 0x56395c399e00 2024-09-19T06:11:38.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.511+0000 7f0bafe00640 1 -- 172.21.15.3:0/297020377 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0bb404c070 con 0x56395c399e00 2024-09-19T06:11:38.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.511+0000 7f0bd3a22740 10 client.24931 fetch_fsmap learned FSMap version 28 2024-09-19T06:11:38.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.511+0000 7f0bd3a22740 1 -- 172.21.15.3:0/297020377 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56395c3b2ff0 con 0x56395c399e00 2024-09-19T06:11:38.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.511+0000 7f0bafe00640 1 -- 172.21.15.3:0/297020377 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bc4004050 con 0x56395c399e00 2024-09-19T06:11:38.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.512+0000 7f0bafe00640 1 -- 172.21.15.3:0/297020377 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0bb40035f0 con 0x56395c399e00 2024-09-19T06:11:38.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.512+0000 7f0bd3a22740 10 client.24931 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:11:38.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.512+0000 7f0bd3a22740 10 client.24931 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T06:11:38.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.512+0000 7f0bd3a22740 20 client.24931 populate_metadata read hostname 'smithi003' 2024-09-19T06:11:38.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.512+0000 7f0bd3a22740 1 --2- 172.21.15.3:0/297020377 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x56395c3b5670 0x56395c3b6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:38.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.512+0000 7f0bd3a22740 4 client.24931 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:11:38.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.512+0000 7f0bd3a22740 1 -- 172.21.15.3:0/297020377 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56395c30c620 con 0x56395c3b5670 2024-09-19T06:11:38.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.512+0000 7f0bca800640 1 --2- 172.21.15.3:0/297020377 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x56395c3b5670 0x56395c3b6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:38.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.513+0000 7f0bca800640 1 --2- 172.21.15.3:0/297020377 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x56395c3b5670 0x56395c3b6ae0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=46379fb142cd0ac9 server_cookie=96724daffad039a in_seq=0 out_seq=0 2024-09-19T06:11:38.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.513+0000 7f0bafe00640 10 client.24931 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:11:38.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.514+0000 7f0bafe00640 1 -- 172.21.15.3:0/297020377 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56395c30c620 con 0x56395c3b5670 2024-09-19T06:11:38.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.514+0000 7f0bafe00640 10 client.24931 handle_command_reply: tid=0 2024-09-19T06:11:38.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.514+0000 7f0bd3a22740 1 client.24931 shutdown 2024-09-19T06:11:38.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.514+0000 7f0bd3a22740 1 -- 172.21.15.3:0/297020377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c399e00 msgr2=0x56395c3a1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:38.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.514+0000 7f0bd3a22740 1 --2- 172.21.15.3:0/297020377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c399e00 0x56395c3a1b00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4033000 tx=0x7f0bb4005270 comp rx=0 tx=0).stop 2024-09-19T06:11:38.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.514+0000 7f0bd3a22740 1 -- 172.21.15.3:0/297020377 shutdown_connections 2024-09-19T06:11:38.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.514+0000 7f0bd3a22740 1 --2- 172.21.15.3:0/297020377 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x56395c3b5670 0x56395c3b6ae0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.514+0000 7f0bd3a22740 1 --2- 172.21.15.3:0/297020377 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3a46c0 0x56395c3a2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.514+0000 7f0bd3a22740 1 --2- 172.21.15.3:0/297020377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c399e00 0x56395c3a1b00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.514+0000 7f0bd3a22740 1 --2- 172.21.15.3:0/297020377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56395c3994e0 0x56395c3a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.514+0000 7f0bd3a22740 1 -- 172.21.15.3:0/297020377 >> 172.21.15.3:0/297020377 conn(0x56395c395a70 msgr2=0x56395c394bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:38.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.514+0000 7f0bafe00640 0 client.24931 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:11:38.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.514+0000 7f0bd3a22740 1 -- 172.21.15.3:0/297020377 shutdown_connections 2024-09-19T06:11:38.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.514+0000 7f0bd3a22740 1 -- 172.21.15.3:0/297020377 wait complete. 2024-09-19T06:11:38.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.514+0000 7f0bd3a22740 20 client.24931 trim_cache size 0 max 16384 2024-09-19T06:11:38.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.537+0000 7f0bd3a22740 1 Processor -- start 2024-09-19T06:11:38.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.537+0000 7f0bd3a22740 1 -- start start 2024-09-19T06:11:38.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.537+0000 7f0bd3a22740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56395c3994e0 0x56395c39bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:38.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.537+0000 7f0bd3a22740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c399e00 0x56395c390840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:38.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.537+0000 7f0bd3a22740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3a46c0 0x56395c39fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:38.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.537+0000 7f0bd3a22740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56395c3b4e20 con 0x56395c3a46c0 2024-09-19T06:11:38.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.537+0000 7f0bd3a22740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56395c3b54f0 con 0x56395c3994e0 2024-09-19T06:11:38.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.537+0000 7f0bd3a22740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56395c3b5bc0 con 0x56395c399e00 2024-09-19T06:11:38.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.537+0000 7f0bc1400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c399e00 0x56395c390840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:38.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.537+0000 7f0bc1400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c399e00 0x56395c390840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:59416/0 (socket says 172.21.15.3:59416) 2024-09-19T06:11:38.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.537+0000 7f0bc1400640 1 -- 172.21.15.3:0/1801107529 learned_addr learned my addr 172.21.15.3:0/1801107529 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:38.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.537+0000 7f0bca800640 1 --2- 172.21.15.3:0/1801107529 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3a46c0 0x56395c39fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:38.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.538+0000 7f0bca800640 1 --2- 172.21.15.3:0/1801107529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56395c3994e0 0x56395c39bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:38.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.538+0000 7f0bc1400640 1 -- 172.21.15.3:0/1801107529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56395c3994e0 msgr2=0x56395c39bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:38.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.538+0000 7f0bc1400640 1 --2- 172.21.15.3:0/1801107529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56395c3994e0 0x56395c39bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.538+0000 7f0bc1400640 1 -- 172.21.15.3:0/1801107529 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3a46c0 msgr2=0x56395c39fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:38.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.538+0000 7f0bc1400640 1 --2- 172.21.15.3:0/1801107529 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3a46c0 0x56395c39fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.538+0000 7f0bc1400640 1 -- 172.21.15.3:0/1801107529 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56395c3a3f30 con 0x56395c399e00 2024-09-19T06:11:38.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.538+0000 7f0bc1400640 1 --2- 172.21.15.3:0/1801107529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c399e00 0x56395c390840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4003a90 tx=0x7f0bb402a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=595bec645e8b24cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:38.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.538+0000 7f0bbaa00640 1 -- 172.21.15.3:0/1801107529 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4056030 con 0x56395c399e00 2024-09-19T06:11:38.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.538+0000 7f0bbaa00640 1 -- 172.21.15.3:0/1801107529 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bb4005850 con 0x56395c399e00 2024-09-19T06:11:38.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.538+0000 7f0bbaa00640 1 -- 172.21.15.3:0/1801107529 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4035030 con 0x56395c399e00 2024-09-19T06:11:38.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.539+0000 7f0bd3a22740 1 -- 172.21.15.3:0/1801107529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c399e00 msgr2=0x56395c390840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:38.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.539+0000 7f0bd3a22740 1 --2- 172.21.15.3:0/1801107529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c399e00 0x56395c390840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4003a90 tx=0x7f0bb402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.539+0000 7f0bd3a22740 1 -- 172.21.15.3:0/1801107529 shutdown_connections 2024-09-19T06:11:38.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.539+0000 7f0bd3a22740 1 --2- 172.21.15.3:0/1801107529 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3a46c0 0x56395c39fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.539+0000 7f0bd3a22740 1 --2- 172.21.15.3:0/1801107529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c399e00 0x56395c390840 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.539+0000 7f0bd3a22740 1 --2- 172.21.15.3:0/1801107529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56395c3994e0 0x56395c39bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.539+0000 7f0bd3a22740 1 -- 172.21.15.3:0/1801107529 >> 172.21.15.3:0/1801107529 conn(0x56395c395a70 msgr2=0x56395c39c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:38.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.539+0000 7f0bd3a22740 1 -- 172.21.15.3:0/1801107529 shutdown_connections 2024-09-19T06:11:38.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.539+0000 7f0bd3a22740 1 -- 172.21.15.3:0/1801107529 wait complete. 2024-09-19T06:11:38.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.540+0000 7f0bd3a22740 1 -- start start 2024-09-19T06:11:38.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.540+0000 7f0bd3a22740 1 Processor -- start 2024-09-19T06:11:38.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.540+0000 7f0bd3a22740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3994e0 0x56395c3bf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:38.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.540+0000 7f0bd3a22740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c399e00 0x56395c3bf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:38.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.540+0000 7f0bd3a22740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56395c3a46c0 0x56395c3b8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:38.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.540+0000 7f0bd3a22740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56395c3b6960 con 0x56395c3994e0 2024-09-19T06:11:38.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.540+0000 7f0bd3a22740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56395c3b6290 con 0x56395c3a46c0 2024-09-19T06:11:38.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.540+0000 7f0bd3a22740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56395c3b7030 con 0x56395c399e00 2024-09-19T06:11:38.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.540+0000 7f0bd3a22740 10 client.0 _ll_register_callbacks cb 0x7f0bb4004480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:11:38.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.541+0000 7f0bca800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3994e0 0x56395c3bf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:38.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.541+0000 7f0bca800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3994e0 0x56395c3bf110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44514/0 (socket says 172.21.15.3:44514) 2024-09-19T06:11:38.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.541+0000 7f0bc1400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c399e00 0x56395c3bf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:38.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.541+0000 7f0bca800640 1 -- 172.21.15.3:0/2629192623 learned_addr learned my addr 172.21.15.3:0/2629192623 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:38.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.541+0000 7f0bca800640 1 --2- 172.21.15.3:0/2629192623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56395c3a46c0 0x56395c3b8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:38.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.541+0000 7f0bc1400640 1 -- 172.21.15.3:0/2629192623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56395c3a46c0 msgr2=0x56395c3b8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:38.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.541+0000 7f0bc1400640 1 --2- 172.21.15.3:0/2629192623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56395c3a46c0 0x56395c3b8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.541+0000 7f0bc1400640 1 -- 172.21.15.3:0/2629192623 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3994e0 msgr2=0x56395c3bf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:38.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.541+0000 7f0bc1400640 1 --2- 172.21.15.3:0/2629192623 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3994e0 0x56395c3bf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.541+0000 7f0bc1400640 1 -- 172.21.15.3:0/2629192623 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56395c3b8ec0 con 0x56395c399e00 2024-09-19T06:11:38.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.541+0000 7f0bca800640 1 --2- 172.21.15.3:0/2629192623 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3994e0 0x56395c3bf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:38.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.541+0000 7f0bc1400640 1 --2- 172.21.15.3:0/2629192623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c399e00 0x56395c3bf650 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x56395c398e20 tx=0x7f0bb40053a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7de507089702f86 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:38.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.541+0000 7f0bafe00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:11:38.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.542+0000 7f0bafe00640 1 -- 172.21.15.3:0/2629192623 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4060060 con 0x56395c399e00 2024-09-19T06:11:38.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.542+0000 7f0bafe00640 1 -- 172.21.15.3:0/2629192623 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f0bb40317b0 con 0x56395c399e00 2024-09-19T06:11:38.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.542+0000 7f0bd3a22740 1 -- 172.21.15.3:0/2629192623 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bb4005850 con 0x56395c399e00 2024-09-19T06:11:38.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.542+0000 7f0bafe00640 1 -- 172.21.15.3:0/2629192623 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0bb4056070 con 0x56395c399e00 2024-09-19T06:11:38.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.542+0000 7f0bd3a22740 10 client.24937 fetch_fsmap learned FSMap version 28 2024-09-19T06:11:38.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.542+0000 7f0bd3a22740 1 -- 172.21.15.3:0/2629192623 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56395c3bd8e0 con 0x56395c399e00 2024-09-19T06:11:38.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.542+0000 7f0bafe00640 1 -- 172.21.15.3:0/2629192623 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bb4005850 con 0x56395c399e00 2024-09-19T06:11:38.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.542+0000 7f0bafe00640 1 -- 172.21.15.3:0/2629192623 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f0bb4051480 con 0x56395c399e00 2024-09-19T06:11:38.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.543+0000 7f0bd3a22740 10 client.24937 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:11:38.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.543+0000 7f0bd3a22740 10 client.24937 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T06:11:38.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.543+0000 7f0bd3a22740 20 client.24937 populate_metadata read hostname 'smithi003' 2024-09-19T06:11:38.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.543+0000 7f0bd3a22740 1 --2- 172.21.15.3:0/2629192623 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x56395c424380 0x56395c423090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:38.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.543+0000 7f0bd3a22740 4 client.24937 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:11:38.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.543+0000 7f0bd3a22740 1 -- 172.21.15.3:0/2629192623 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "status"}) -- 0x56395c306b30 con 0x56395c424380 2024-09-19T06:11:38.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.543+0000 7f0bca800640 1 --2- 172.21.15.3:0/2629192623 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x56395c424380 0x56395c423090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:38.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.543+0000 7f0bca800640 1 --2- 172.21.15.3:0/2629192623 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x56395c424380 0x56395c423090 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3f7c6faa071d4b35 server_cookie=353511dc097b7778 in_seq=0 out_seq=0 2024-09-19T06:11:38.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.543+0000 7f0bafe00640 10 client.24937 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:11:38.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.544+0000 7f0bafe00640 1 -- 172.21.15.3:0/2629192623 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56395c306b30 con 0x56395c424380 2024-09-19T06:11:38.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.544+0000 7f0bafe00640 10 client.24937 handle_command_reply: tid=0 2024-09-19T06:11:38.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.544+0000 7f0bd3a22740 1 client.24937 shutdown 2024-09-19T06:11:38.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.544+0000 7f0bd3a22740 1 -- 172.21.15.3:0/2629192623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c399e00 msgr2=0x56395c3bf650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:38.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.544+0000 7f0bd3a22740 1 --2- 172.21.15.3:0/2629192623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c399e00 0x56395c3bf650 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x56395c398e20 tx=0x7f0bb40053a0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.544+0000 7f0bd3a22740 1 -- 172.21.15.3:0/2629192623 shutdown_connections 2024-09-19T06:11:38.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.544+0000 7f0bd3a22740 1 --2- 172.21.15.3:0/2629192623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56395c3a46c0 0x56395c3b8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.544+0000 7f0bd3a22740 1 --2- 172.21.15.3:0/2629192623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56395c399e00 0x56395c3bf650 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.544+0000 7f0bd3a22740 1 --2- 172.21.15.3:0/2629192623 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x56395c424380 0x56395c423090 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.544+0000 7f0bd3a22740 1 --2- 172.21.15.3:0/2629192623 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56395c3994e0 0x56395c3bf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.544+0000 7f0bafe00640 0 client.24937 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:11:38.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.544+0000 7f0bd3a22740 1 -- 172.21.15.3:0/2629192623 >> 172.21.15.3:0/2629192623 conn(0x56395c395a70 msgr2=0x56395c39c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:38.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.544+0000 7f0bd3a22740 1 -- 172.21.15.3:0/2629192623 shutdown_connections 2024-09-19T06:11:38.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.544+0000 7f0bd3a22740 1 -- 172.21.15.3:0/2629192623 wait complete. 2024-09-19T06:11:38.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.544+0000 7f0bd3a22740 20 client.24937 trim_cache size 0 max 16384 2024-09-19T06:11:38.550 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:11:38.550 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "782a5144-764c-11ef-bceb-c7b262605968", 2024-09-19T06:11:38.551 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 3, 2024-09-19T06:11:38.551 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 24514, 2024-09-19T06:11:38.551 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2024-09-19T06:11:38.551 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2024-09-19T06:11:38.551 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2024-09-19T06:11:38.551 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 81.961847445999993, 2024-09-19T06:11:38.551 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 28, 2024-09-19T06:11:38.551 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 88, 2024-09-19T06:11:38.551 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 86, 2024-09-19T06:11:38.551 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 125.49200745100001 2024-09-19T06:11:38.551 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:11:38.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.545+0000 7f0bcb200640 1 -- 172.21.15.3:0/121871440 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0bb00a32d0 msgr2=0x7f0bb00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:38.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.545+0000 7f0bcb200640 1 --2- 172.21.15.3:0/121871440 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0bb00a32d0 0x7f0bb00a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc09b5a0 tx=0x7f0bbc0d2f10 comp rx=0 tx=0).stop 2024-09-19T06:11:38.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.545+0000 7f0bcb200640 1 -- 172.21.15.3:0/121871440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bcc076720 msgr2=0x7f0bcc1a4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:38.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.545+0000 7f0bcb200640 1 --2- 172.21.15.3:0/121871440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bcc076720 0x7f0bcc1a4670 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc00d950 tx=0x7f0bbc00de10 comp rx=0 tx=0).stop 2024-09-19T06:11:38.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.545+0000 7f0bcb200640 1 -- 172.21.15.3:0/121871440 shutdown_connections 2024-09-19T06:11:38.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.545+0000 7f0bcb200640 1 --2- 172.21.15.3:0/121871440 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f0bb00a32d0 0x7f0bb00a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.545+0000 7f0bcb200640 1 --2- 172.21.15.3:0/121871440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bcc112870 0x7f0bcc19e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.545+0000 7f0bcb200640 1 --2- 172.21.15.3:0/121871440 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0bcc077040 0x7f0bcc1a4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.545+0000 7f0bcb200640 1 --2- 172.21.15.3:0/121871440 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0bcc076720 0x7f0bcc1a4670 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:38.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.545+0000 7f0bcb200640 1 -- 172.21.15.3:0/121871440 >> 172.21.15.3:0/121871440 conn(0x7f0bcc0ff8d0 msgr2=0x7f0bcc101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:38.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.545+0000 7f0bcb200640 1 -- 172.21.15.3:0/121871440 shutdown_connections 2024-09-19T06:11:38.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:38.545+0000 7f0bcb200640 1 -- 172.21.15.3:0/121871440 wait complete. 2024-09-19T06:11:39.432 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T06:11:39.809 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:40.233 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:40 smithi003 ceph-mon[30893]: pgmap v352: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:40.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:40 smithi059 ceph-mon[35138]: pgmap v352: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:40.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:40 smithi071 ceph-mon[35662]: pgmap v352: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:40.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.525+0000 7fc3d7600640 1 -- 172.21.15.3:0/4114399510 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3d01049c0 msgr2=0x7fc3d0108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:40.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.525+0000 7fc3d7600640 1 --2- 172.21.15.3:0/4114399510 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3d01049c0 0x7fc3d0108a10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009900 tx=0x7fc3b802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.525+0000 7fc3d7600640 1 -- 172.21.15.3:0/4114399510 shutdown_connections 2024-09-19T06:11:40.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.525+0000 7fc3d7600640 1 --2- 172.21.15.3:0/4114399510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d0109140 0x7fc3d0110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.525+0000 7fc3d7600640 1 --2- 172.21.15.3:0/4114399510 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3d01049c0 0x7fc3d0108a10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.525+0000 7fc3d7600640 1 --2- 172.21.15.3:0/4114399510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d0104010 0x7fc3d01043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.525+0000 7fc3d7600640 1 -- 172.21.15.3:0/4114399510 >> 172.21.15.3:0/4114399510 conn(0x7fc3d00ffa50 msgr2=0x7fc3d0101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:40.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.525+0000 7fc3d7600640 1 -- 172.21.15.3:0/4114399510 shutdown_connections 2024-09-19T06:11:40.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.525+0000 7fc3d7600640 1 -- 172.21.15.3:0/4114399510 wait complete. 2024-09-19T06:11:40.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.526+0000 7fc3d7600640 1 Processor -- start 2024-09-19T06:11:40.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.526+0000 7fc3d7600640 1 -- start start 2024-09-19T06:11:40.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.526+0000 7fc3d7600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d0104010 0x7fc3d019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.526+0000 7fc3d7600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d01049c0 0x7fc3d019ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.526+0000 7fc3d7600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3d0109140 0x7fc3d019efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.526+0000 7fc3d7600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d0114160 con 0x7fc3d0109140 2024-09-19T06:11:40.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.526+0000 7fc3d7600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d0113fe0 con 0x7fc3d0104010 2024-09-19T06:11:40.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.526+0000 7fc3d7600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d01142e0 con 0x7fc3d01049c0 2024-09-19T06:11:40.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.527+0000 7fc3d5600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3d0109140 0x7fc3d019efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.527+0000 7fc3d4c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d0104010 0x7fc3d019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.527+0000 7fc3d5600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3d0109140 0x7fc3d019efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44524/0 (socket says 172.21.15.3:44524) 2024-09-19T06:11:40.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.527+0000 7fc3d5600640 1 -- 172.21.15.3:0/650583778 learned_addr learned my addr 172.21.15.3:0/650583778 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:40.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.527+0000 7fc3c7e00640 1 --2- 172.21.15.3:0/650583778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d01049c0 0x7fc3d019ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.527+0000 7fc3d5600640 1 -- 172.21.15.3:0/650583778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d01049c0 msgr2=0x7fc3d019ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:40.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.527+0000 7fc3d5600640 1 --2- 172.21.15.3:0/650583778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d01049c0 0x7fc3d019ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.527+0000 7fc3d5600640 1 -- 172.21.15.3:0/650583778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d0104010 msgr2=0x7fc3d019a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:40.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.527+0000 7fc3d5600640 1 --2- 172.21.15.3:0/650583778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d0104010 0x7fc3d019a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.527+0000 7fc3d5600640 1 -- 172.21.15.3:0/650583778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d019f690 con 0x7fc3d0109140 2024-09-19T06:11:40.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.527+0000 7fc3d4c00640 1 --2- 172.21.15.3:0/650583778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d0104010 0x7fc3d019a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:40.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.527+0000 7fc3d5600640 1 --2- 172.21.15.3:0/650583778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3d0109140 0x7fc3d019efb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800eb10 tx=0x7fc3c800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:40.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.528+0000 7fc3ce000640 1 -- 172.21.15.3:0/650583778 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8004b20 con 0x7fc3d0109140 2024-09-19T06:11:40.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.528+0000 7fc3ce000640 1 -- 172.21.15.3:0/650583778 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3c8004cc0 con 0x7fc3d0109140 2024-09-19T06:11:40.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.528+0000 7fc3ce000640 1 -- 172.21.15.3:0/650583778 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8010760 con 0x7fc3d0109140 2024-09-19T06:11:40.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.528+0000 7fc3d7600640 1 -- 172.21.15.3:0/650583778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d019f980 con 0x7fc3d0109140 2024-09-19T06:11:40.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.528+0000 7fc3d7600640 1 -- 172.21.15.3:0/650583778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d01a7260 con 0x7fc3d0109140 2024-09-19T06:11:40.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.532+0000 7fc3da228740 1 Processor -- start 2024-09-19T06:11:40.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.532+0000 7fc3ce000640 1 -- 172.21.15.3:0/650583778 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fc3c8005020 con 0x7fc3d0109140 2024-09-19T06:11:40.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.533+0000 7fc3da228740 1 -- start start 2024-09-19T06:11:40.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.533+0000 7fc3da228740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9330 0x55a5b0cf9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.533+0000 7fc3da228740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5b0cf9c50 0x55a5b0d03fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.533+0000 7fc3da228740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5b0d04510 0x55a5b0d06900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.533+0000 7fc3da228740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a5b0c5f0b0 con 0x55a5b0cf9330 2024-09-19T06:11:40.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.533+0000 7fc3da228740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a5b0c06ab0 con 0x55a5b0cf9c50 2024-09-19T06:11:40.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.533+0000 7fc3da228740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a5b0c5b070 con 0x55a5b0d04510 2024-09-19T06:11:40.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.533+0000 7fc3c7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9330 0x55a5b0cf9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.533+0000 7fc3d4c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5b0cf9c50 0x55a5b0d03fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.533+0000 7fc3c7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9330 0x55a5b0cf9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44526/0 (socket says 172.21.15.3:44526) 2024-09-19T06:11:40.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.533+0000 7fc3d4c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5b0cf9c50 0x55a5b0d03fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:47316/0 (socket says 172.21.15.3:47316) 2024-09-19T06:11:40.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.533+0000 7fc3c7e00640 1 -- 172.21.15.3:0/277784436 learned_addr learned my addr 172.21.15.3:0/277784436 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:40.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.534+0000 7fc3c7e00640 1 --2- 172.21.15.3:0/277784436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5b0d04510 0x55a5b0d06900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.534+0000 7fc3d4c00640 1 -- 172.21.15.3:0/277784436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5b0d04510 msgr2=0x55a5b0d06900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:40.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.534+0000 7fc3d4c00640 1 --2- 172.21.15.3:0/277784436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5b0d04510 0x55a5b0d06900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.534+0000 7fc3d4c00640 1 -- 172.21.15.3:0/277784436 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9330 msgr2=0x55a5b0cf9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:40.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.534+0000 7fc3d4c00640 1 --2- 172.21.15.3:0/277784436 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9330 0x55a5b0cf9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.534+0000 7fc3d4c00640 1 -- 172.21.15.3:0/277784436 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5b0c134a0 con 0x55a5b0cf9c50 2024-09-19T06:11:40.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.534+0000 7fc3c7e00640 1 --2- 172.21.15.3:0/277784436 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9330 0x55a5b0cf9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:11:40.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.534+0000 7fc3ce000640 1 --2- 172.21.15.3:0/650583778 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc3b40a32d0 0x7fc3b40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.534+0000 7fc3d4c00640 1 --2- 172.21.15.3:0/277784436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5b0cf9c50 0x55a5b0d03fd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009fd0 tx=0x7fc3c00118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acb3e9e87cb6550c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:40.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.534+0000 7fc3ce000640 1 -- 172.21.15.3:0/650583778 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fc3c80d0160 con 0x7fc3d0109140 2024-09-19T06:11:40.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.534+0000 7fc3c5c00640 1 -- 172.21.15.3:0/277784436 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0004030 con 0x55a5b0cf9c50 2024-09-19T06:11:40.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.534+0000 7fc3c7e00640 1 --2- 172.21.15.3:0/650583778 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc3b40a32d0 0x7fc3b40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.534+0000 7fc3c5c00640 1 -- 172.21.15.3:0/277784436 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3c0005500 con 0x55a5b0cf9c50 2024-09-19T06:11:40.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.534+0000 7fc3c5c00640 1 -- 172.21.15.3:0/277784436 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0004e10 con 0x55a5b0cf9c50 2024-09-19T06:11:40.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.535+0000 7fc3da228740 1 -- 172.21.15.3:0/277784436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5b0cf9c50 msgr2=0x55a5b0d03fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:40.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.535+0000 7fc3c7e00640 1 --2- 172.21.15.3:0/650583778 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc3b40a32d0 0x7fc3b40a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55a5b0cf6c40 tx=0x7fc3b8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:40.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.535+0000 7fc3da228740 1 --2- 172.21.15.3:0/277784436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5b0cf9c50 0x55a5b0d03fd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009fd0 tx=0x7fc3c00118d0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.535+0000 7fc3da228740 1 -- 172.21.15.3:0/277784436 shutdown_connections 2024-09-19T06:11:40.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.535+0000 7fc3da228740 1 --2- 172.21.15.3:0/277784436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5b0d04510 0x55a5b0d06900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.535+0000 7fc3da228740 1 --2- 172.21.15.3:0/277784436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5b0cf9c50 0x55a5b0d03fd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.535+0000 7fc3da228740 1 --2- 172.21.15.3:0/277784436 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9330 0x55a5b0cf9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.535+0000 7fc3da228740 1 -- 172.21.15.3:0/277784436 >> 172.21.15.3:0/277784436 conn(0x55a5b0cf58c0 msgr2=0x55a5b0cf5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:40.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.535+0000 7fc3da228740 1 -- 172.21.15.3:0/277784436 shutdown_connections 2024-09-19T06:11:40.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.535+0000 7fc3da228740 1 -- 172.21.15.3:0/277784436 wait complete. 2024-09-19T06:11:40.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.536+0000 7fc3da228740 1 -- start start 2024-09-19T06:11:40.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.536+0000 7fc3da228740 1 Processor -- start 2024-09-19T06:11:40.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.537+0000 7fc3da228740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9330 0x55a5b0d01610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.537+0000 7fc3da228740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5b0cf9c50 0x55a5b0d01b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.537+0000 7fc3da228740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5b0d04510 0x55a5b0d02090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.537+0000 7fc3da228740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a5b0d07060 con 0x55a5b0cf9330 2024-09-19T06:11:40.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.537+0000 7fc3da228740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a5b0be7920 con 0x55a5b0d04510 2024-09-19T06:11:40.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.537+0000 7fc3da228740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a5b0d071e0 con 0x55a5b0cf9c50 2024-09-19T06:11:40.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.537+0000 7fc3da228740 10 client.0 _ll_register_callbacks cb 0x55a5b0c0b8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:11:40.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.537+0000 7fc3d4c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9330 0x55a5b0d01610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.537+0000 7fc3d4c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9330 0x55a5b0d01610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44534/0 (socket says 172.21.15.3:44534) 2024-09-19T06:11:40.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.537+0000 7fc3d4c00640 1 -- 172.21.15.3:0/788586289 learned_addr learned my addr 172.21.15.3:0/788586289 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:40.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.537+0000 7fc3d5600640 1 --2- 172.21.15.3:0/788586289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5b0d04510 0x55a5b0d02090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.537+0000 7fc3c7e00640 1 --2- 172.21.15.3:0/788586289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5b0cf9c50 0x55a5b0d01b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.537+0000 7fc3d4c00640 1 -- 172.21.15.3:0/788586289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5b0cf9c50 msgr2=0x55a5b0d01b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:40.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.537+0000 7fc3d4c00640 1 --2- 172.21.15.3:0/788586289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5b0cf9c50 0x55a5b0d01b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.537+0000 7fc3d4c00640 1 -- 172.21.15.3:0/788586289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5b0d04510 msgr2=0x55a5b0d02090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:40.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.537+0000 7fc3d4c00640 1 --2- 172.21.15.3:0/788586289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5b0d04510 0x55a5b0d02090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.537+0000 7fc3d4c00640 1 -- 172.21.15.3:0/788586289 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5b09d02b0 con 0x55a5b0cf9330 2024-09-19T06:11:40.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.537+0000 7fc3c7e00640 1 --2- 172.21.15.3:0/788586289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5b0cf9c50 0x55a5b0d01b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:11:40.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.538+0000 7fc3d4c00640 1 --2- 172.21.15.3:0/788586289 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9330 0x55a5b0d01610 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc3c00058c0 tx=0x7fc3c000fd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211dc08e4c22f850 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:40.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.538+0000 7fc3be000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:11:40.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.538+0000 7fc3be000640 1 -- 172.21.15.3:0/788586289 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0028070 con 0x55a5b0cf9330 2024-09-19T06:11:40.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.538+0000 7fc3be000640 1 -- 172.21.15.3:0/788586289 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fc3c0004a50 con 0x55a5b0cf9330 2024-09-19T06:11:40.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.538+0000 7fc3da228740 1 -- 172.21.15.3:0/788586289 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3c0005500 con 0x55a5b0cf9330 2024-09-19T06:11:40.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.538+0000 7fc3be000640 1 -- 172.21.15.3:0/788586289 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc3c0034050 con 0x55a5b0cf9330 2024-09-19T06:11:40.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.538+0000 7fc3da228740 10 client.14910 fetch_fsmap learned FSMap version 28 2024-09-19T06:11:40.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.538+0000 7fc3da228740 1 -- 172.21.15.3:0/788586289 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a5b0d12e20 con 0x55a5b0cf9330 2024-09-19T06:11:40.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.539+0000 7fc3be000640 1 -- 172.21.15.3:0/788586289 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3c0005500 con 0x55a5b0cf9330 2024-09-19T06:11:40.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.539+0000 7fc3be000640 1 -- 172.21.15.3:0/788586289 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc3c00196b0 con 0x55a5b0cf9330 2024-09-19T06:11:40.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.539+0000 7fc3da228740 10 client.14910 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:11:40.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.539+0000 7fc3da228740 10 client.14910 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T06:11:40.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.539+0000 7fc3da228740 20 client.14910 populate_metadata read hostname 'smithi003' 2024-09-19T06:11:40.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.539+0000 7fc3da228740 1 --2- 172.21.15.3:0/788586289 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55a5b0d151a0 0x55a5b0d16610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.539+0000 7fc3da228740 4 client.14910 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:11:40.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.539+0000 7fc3da228740 1 -- 172.21.15.3:0/788586289 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5b0c6c620 con 0x55a5b0d151a0 2024-09-19T06:11:40.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.539+0000 7fc3c7e00640 1 --2- 172.21.15.3:0/788586289 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55a5b0d151a0 0x55a5b0d16610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.540+0000 7fc3c7e00640 1 --2- 172.21.15.3:0/788586289 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55a5b0d151a0 0x55a5b0d16610 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6d232c848bf463fe server_cookie=34ea319ea3172ce4 in_seq=0 out_seq=0 2024-09-19T06:11:40.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.540+0000 7fc3be000640 10 client.14910 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:11:40.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.541+0000 7fc3be000640 1 -- 172.21.15.3:0/788586289 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a5b0c6c620 con 0x55a5b0d151a0 2024-09-19T06:11:40.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.541+0000 7fc3be000640 10 client.14910 handle_command_reply: tid=0 2024-09-19T06:11:40.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.541+0000 7fc3da228740 1 client.14910 shutdown 2024-09-19T06:11:40.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.541+0000 7fc3da228740 1 -- 172.21.15.3:0/788586289 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9330 msgr2=0x55a5b0d01610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:40.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.541+0000 7fc3da228740 1 --2- 172.21.15.3:0/788586289 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9330 0x55a5b0d01610 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc3c00058c0 tx=0x7fc3c000fd80 comp rx=0 tx=0).stop 2024-09-19T06:11:40.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.541+0000 7fc3da228740 1 -- 172.21.15.3:0/788586289 shutdown_connections 2024-09-19T06:11:40.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.541+0000 7fc3da228740 1 --2- 172.21.15.3:0/788586289 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55a5b0d151a0 0x55a5b0d16610 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.541+0000 7fc3da228740 1 --2- 172.21.15.3:0/788586289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5b0d04510 0x55a5b0d02090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.541+0000 7fc3da228740 1 --2- 172.21.15.3:0/788586289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5b0cf9c50 0x55a5b0d01b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.541+0000 7fc3da228740 1 --2- 172.21.15.3:0/788586289 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9330 0x55a5b0d01610 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.541+0000 7fc3da228740 1 -- 172.21.15.3:0/788586289 >> 172.21.15.3:0/788586289 conn(0x55a5b0cf58c0 msgr2=0x55a5b0cfb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:40.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.541+0000 7fc3be000640 0 client.14910 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:11:40.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.541+0000 7fc3da228740 1 -- 172.21.15.3:0/788586289 shutdown_connections 2024-09-19T06:11:40.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.542+0000 7fc3da228740 1 -- 172.21.15.3:0/788586289 wait complete. 2024-09-19T06:11:40.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.542+0000 7fc3da228740 20 client.14910 trim_cache size 0 max 16384 2024-09-19T06:11:40.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.560+0000 7fc3da228740 1 Processor -- start 2024-09-19T06:11:40.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.560+0000 7fc3da228740 1 -- start start 2024-09-19T06:11:40.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.561+0000 7fc3da228740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5b0cf9330 0x55a5b0d01ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.561+0000 7fc3da228740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9c50 0x55a5b0d020e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.561+0000 7fc3da228740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5b0d04510 0x55a5b0cfe8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.561+0000 7fc3da228740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a5b0d14950 con 0x55a5b0cf9c50 2024-09-19T06:11:40.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.561+0000 7fc3da228740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a5b0d15020 con 0x55a5b0d04510 2024-09-19T06:11:40.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.561+0000 7fc3da228740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a5b0d156f0 con 0x55a5b0cf9330 2024-09-19T06:11:40.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.561+0000 7fc3c7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9c50 0x55a5b0d020e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.561+0000 7fc3d4c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5b0cf9330 0x55a5b0d01ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.561+0000 7fc3c7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9c50 0x55a5b0d020e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44536/0 (socket says 172.21.15.3:44536) 2024-09-19T06:11:40.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.561+0000 7fc3c7e00640 1 -- 172.21.15.3:0/907048490 learned_addr learned my addr 172.21.15.3:0/907048490 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:40.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.561+0000 7fc3d5600640 1 --2- 172.21.15.3:0/907048490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5b0d04510 0x55a5b0cfe8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.561+0000 7fc3d4c00640 1 -- 172.21.15.3:0/907048490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5b0d04510 msgr2=0x55a5b0cfe8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:40.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.561+0000 7fc3d4c00640 1 --2- 172.21.15.3:0/907048490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5b0d04510 0x55a5b0cfe8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.561+0000 7fc3d4c00640 1 -- 172.21.15.3:0/907048490 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9c50 msgr2=0x55a5b0d020e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:40.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.561+0000 7fc3d4c00640 1 --2- 172.21.15.3:0/907048490 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9c50 0x55a5b0d020e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.561+0000 7fc3d4c00640 1 -- 172.21.15.3:0/907048490 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5b0cf9a80 con 0x55a5b0cf9330 2024-09-19T06:11:40.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.561+0000 7fc3c7e00640 1 --2- 172.21.15.3:0/907048490 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9c50 0x55a5b0d020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:40.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.562+0000 7fc3d4c00640 1 --2- 172.21.15.3:0/907048490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5b0cf9330 0x55a5b0d01ba0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009ef0 tx=0x7fc3c00118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47b0540ff3fdccc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:40.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.562+0000 7fc3c5200640 1 -- 172.21.15.3:0/907048490 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0031020 con 0x55a5b0cf9330 2024-09-19T06:11:40.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.562+0000 7fc3c5200640 1 -- 172.21.15.3:0/907048490 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3c0024490 con 0x55a5b0cf9330 2024-09-19T06:11:40.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.562+0000 7fc3c5200640 1 -- 172.21.15.3:0/907048490 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0028070 con 0x55a5b0cf9330 2024-09-19T06:11:40.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.563+0000 7fc3da228740 1 -- 172.21.15.3:0/907048490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5b0cf9330 msgr2=0x55a5b0d01ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:40.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.563+0000 7fc3da228740 1 --2- 172.21.15.3:0/907048490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5b0cf9330 0x55a5b0d01ba0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0009ef0 tx=0x7fc3c00118d0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.563+0000 7fc3da228740 1 -- 172.21.15.3:0/907048490 shutdown_connections 2024-09-19T06:11:40.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.563+0000 7fc3da228740 1 --2- 172.21.15.3:0/907048490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5b0d04510 0x55a5b0cfe8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.563+0000 7fc3da228740 1 --2- 172.21.15.3:0/907048490 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9c50 0x55a5b0d020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.563+0000 7fc3da228740 1 --2- 172.21.15.3:0/907048490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5b0cf9330 0x55a5b0d01ba0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.563+0000 7fc3da228740 1 -- 172.21.15.3:0/907048490 >> 172.21.15.3:0/907048490 conn(0x55a5b0cf58c0 msgr2=0x55a5b0cfff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:40.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.563+0000 7fc3da228740 1 -- 172.21.15.3:0/907048490 shutdown_connections 2024-09-19T06:11:40.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.563+0000 7fc3da228740 1 -- 172.21.15.3:0/907048490 wait complete. 2024-09-19T06:11:40.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.563+0000 7fc3da228740 1 -- start start 2024-09-19T06:11:40.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.564+0000 7fc3da228740 1 Processor -- start 2024-09-19T06:11:40.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.564+0000 7fc3da228740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5b0cf9330 0x55a5b0d1ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.564+0000 7fc3da228740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9c50 0x55a5b0d1f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.564+0000 7fc3da228740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5b0d04510 0x55a5b0d1c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.564+0000 7fc3da228740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a5b0d16490 con 0x55a5b0cf9c50 2024-09-19T06:11:40.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.564+0000 7fc3da228740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a5b0d15dc0 con 0x55a5b0d04510 2024-09-19T06:11:40.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.564+0000 7fc3da228740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a5b0d16b60 con 0x55a5b0cf9330 2024-09-19T06:11:40.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.564+0000 7fc3da228740 10 client.0 _ll_register_callbacks cb 0x7fc3c000fa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:11:40.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.564+0000 7fc3c7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9c50 0x55a5b0d1f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.564+0000 7fc3c7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9c50 0x55a5b0d1f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44546/0 (socket says 172.21.15.3:44546) 2024-09-19T06:11:40.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.564+0000 7fc3d4c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5b0cf9330 0x55a5b0d1ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.564+0000 7fc3d5600640 1 --2- 172.21.15.3:0/2146058675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5b0d04510 0x55a5b0d1c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.564+0000 7fc3c7e00640 1 -- 172.21.15.3:0/2146058675 learned_addr learned my addr 172.21.15.3:0/2146058675 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:40.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.565+0000 7fc3d5600640 1 -- 172.21.15.3:0/2146058675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5b0cf9330 msgr2=0x55a5b0d1ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:40.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.565+0000 7fc3d5600640 1 --2- 172.21.15.3:0/2146058675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5b0cf9330 0x55a5b0d1ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.565+0000 7fc3d5600640 1 -- 172.21.15.3:0/2146058675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9c50 msgr2=0x55a5b0d1f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:40.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.565+0000 7fc3d5600640 1 --2- 172.21.15.3:0/2146058675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9c50 0x55a5b0d1f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.565+0000 7fc3d5600640 1 -- 172.21.15.3:0/2146058675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5b0d1d1a0 con 0x55a5b0d04510 2024-09-19T06:11:40.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.565+0000 7fc3d5600640 1 --2- 172.21.15.3:0/2146058675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5b0d04510 0x55a5b0d1c970 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80cda90 tx=0x7fc3c8098210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5f322bb63107277 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:40.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.565+0000 7fc3be000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:11:40.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.565+0000 7fc3be000640 1 -- 172.21.15.3:0/2146058675 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c80b9070 con 0x55a5b0d04510 2024-09-19T06:11:40.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.565+0000 7fc3be000640 1 -- 172.21.15.3:0/2146058675 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fc3c80cdce0 con 0x55a5b0d04510 2024-09-19T06:11:40.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.565+0000 7fc3da228740 1 -- 172.21.15.3:0/2146058675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3c0024490 con 0x55a5b0d04510 2024-09-19T06:11:40.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.565+0000 7fc3be000640 1 -- 172.21.15.3:0/2146058675 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc3c80a0950 con 0x55a5b0d04510 2024-09-19T06:11:40.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.565+0000 7fc3da228740 10 client.24947 fetch_fsmap learned FSMap version 28 2024-09-19T06:11:40.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.565+0000 7fc3da228740 1 -- 172.21.15.3:0/2146058675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a5b0cfef70 con 0x55a5b0d04510 2024-09-19T06:11:40.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.566+0000 7fc3be000640 1 -- 172.21.15.3:0/2146058675 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3c0024490 con 0x55a5b0d04510 2024-09-19T06:11:40.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.566+0000 7fc3be000640 1 -- 172.21.15.3:0/2146058675 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc3c809b9f0 con 0x55a5b0d04510 2024-09-19T06:11:40.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.566+0000 7fc3da228740 10 client.24947 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:11:40.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.566+0000 7fc3da228740 10 client.24947 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T06:11:40.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.566+0000 7fc3da228740 20 client.24947 populate_metadata read hostname 'smithi003' 2024-09-19T06:11:40.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.566+0000 7fc3da228740 1 --2- 172.21.15.3:0/2146058675 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55a5b0d84150 0x55a5b0d82e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:40.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.566+0000 7fc3da228740 4 client.24947 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:11:40.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.566+0000 7fc3da228740 1 -- 172.21.15.3:0/2146058675 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "status"}) -- 0x55a5b0c66b30 con 0x55a5b0d84150 2024-09-19T06:11:40.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.566+0000 7fc3d4c00640 1 --2- 172.21.15.3:0/2146058675 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55a5b0d84150 0x55a5b0d82e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:40.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.567+0000 7fc3d4c00640 1 --2- 172.21.15.3:0/2146058675 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55a5b0d84150 0x55a5b0d82e60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=84accb634608c740 server_cookie=a4db4dade026f2f1 in_seq=0 out_seq=0 2024-09-19T06:11:40.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.567+0000 7fc3be000640 10 client.24947 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:11:40.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.567+0000 7fc3be000640 1 -- 172.21.15.3:0/2146058675 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55a5b0c66b30 con 0x55a5b0d84150 2024-09-19T06:11:40.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.567+0000 7fc3be000640 10 client.24947 handle_command_reply: tid=0 2024-09-19T06:11:40.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.567+0000 7fc3da228740 1 client.24947 shutdown 2024-09-19T06:11:40.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.567+0000 7fc3da228740 1 -- 172.21.15.3:0/2146058675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5b0d04510 msgr2=0x55a5b0d1c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:40.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.567+0000 7fc3da228740 1 --2- 172.21.15.3:0/2146058675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5b0d04510 0x55a5b0d1c970 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc3c80cda90 tx=0x7fc3c8098210 comp rx=0 tx=0).stop 2024-09-19T06:11:40.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.567+0000 7fc3da228740 1 -- 172.21.15.3:0/2146058675 shutdown_connections 2024-09-19T06:11:40.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.567+0000 7fc3da228740 1 --2- 172.21.15.3:0/2146058675 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55a5b0d84150 0x55a5b0d82e60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.567+0000 7fc3da228740 1 --2- 172.21.15.3:0/2146058675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a5b0d04510 0x55a5b0d1c970 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.567+0000 7fc3da228740 1 --2- 172.21.15.3:0/2146058675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a5b0cf9c50 0x55a5b0d1f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.567+0000 7fc3da228740 1 --2- 172.21.15.3:0/2146058675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a5b0cf9330 0x55a5b0d1ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.567+0000 7fc3da228740 1 -- 172.21.15.3:0/2146058675 >> 172.21.15.3:0/2146058675 conn(0x55a5b0cf58c0 msgr2=0x55a5b0cf4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:40.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.567+0000 7fc3be000640 0 client.24947 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:11:40.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.567+0000 7fc3da228740 1 -- 172.21.15.3:0/2146058675 shutdown_connections 2024-09-19T06:11:40.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.567+0000 7fc3da228740 1 -- 172.21.15.3:0/2146058675 wait complete. 2024-09-19T06:11:40.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.568+0000 7fc3da228740 20 client.24947 trim_cache size 0 max 16384 2024-09-19T06:11:40.577 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:11:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "782a5144-764c-11ef-bceb-c7b262605968", 2024-09-19T06:11:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 2, 2024-09-19T06:11:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 24515, 2024-09-19T06:11:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2024-09-19T06:11:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2024-09-19T06:11:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2024-09-19T06:11:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 85.001047033999996, 2024-09-19T06:11:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 28, 2024-09-19T06:11:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 88, 2024-09-19T06:11:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 86, 2024-09-19T06:11:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 124.786816906 2024-09-19T06:11:40.578 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:11:40.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.568+0000 7fc3d7600640 1 -- 172.21.15.3:0/650583778 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc3b40a32d0 msgr2=0x7fc3b40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:40.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.568+0000 7fc3d7600640 1 --2- 172.21.15.3:0/650583778 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc3b40a32d0 0x7fc3b40a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55a5b0cf6c40 tx=0x7fc3b8000bc0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.568+0000 7fc3d7600640 1 -- 172.21.15.3:0/650583778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3d0109140 msgr2=0x7fc3d019efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:40.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.568+0000 7fc3d7600640 1 --2- 172.21.15.3:0/650583778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3d0109140 0x7fc3d019efb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800eb10 tx=0x7fc3c800c2d0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.568+0000 7fc3d7600640 1 -- 172.21.15.3:0/650583778 shutdown_connections 2024-09-19T06:11:40.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.568+0000 7fc3d7600640 1 --2- 172.21.15.3:0/650583778 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc3b40a32d0 0x7fc3b40a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.568+0000 7fc3d7600640 1 --2- 172.21.15.3:0/650583778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3d0109140 0x7fc3d019efb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.568+0000 7fc3d7600640 1 --2- 172.21.15.3:0/650583778 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3d01049c0 0x7fc3d019ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.568+0000 7fc3d7600640 1 --2- 172.21.15.3:0/650583778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d0104010 0x7fc3d019a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:40.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.568+0000 7fc3d7600640 1 -- 172.21.15.3:0/650583778 >> 172.21.15.3:0/650583778 conn(0x7fc3d00ffa50 msgr2=0x7fc3d0100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:40.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.569+0000 7fc3d7600640 1 -- 172.21.15.3:0/650583778 shutdown_connections 2024-09-19T06:11:40.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:40.569+0000 7fc3d7600640 1 -- 172.21.15.3:0/650583778 wait complete. 2024-09-19T06:11:41.559 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T06:11:41.936 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:42.303 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:42 smithi003 ceph-mon[30893]: pgmap v353: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:42.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:42 smithi071 ceph-mon[35662]: pgmap v353: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:42.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:42 smithi059 ceph-mon[35138]: pgmap v353: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:42.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.542+0000 7fe48a000640 1 -- 172.21.15.3:0/4097975810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe484102360 msgr2=0x7fe48410e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:42.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.542+0000 7fe48a000640 1 --2- 172.21.15.3:0/4097975810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe484102360 0x7fe48410e890 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe47c009cd0 tx=0x7fe47c02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.542+0000 7fe48a000640 1 -- 172.21.15.3:0/4097975810 shutdown_connections 2024-09-19T06:11:42.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.542+0000 7fe48a000640 1 --2- 172.21.15.3:0/4097975810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe484102360 0x7fe48410e890 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.542+0000 7fe48a000640 1 --2- 172.21.15.3:0/4097975810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe4841019c0 0x7fe484101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.542+0000 7fe48a000640 1 --2- 172.21.15.3:0/4097975810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4841079c0 0x7fe484107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.542+0000 7fe48a000640 1 -- 172.21.15.3:0/4097975810 >> 172.21.15.3:0/4097975810 conn(0x7fe4840fd740 msgr2=0x7fe4840ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:42.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.542+0000 7fe48a000640 1 -- 172.21.15.3:0/4097975810 shutdown_connections 2024-09-19T06:11:42.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.542+0000 7fe48a000640 1 -- 172.21.15.3:0/4097975810 wait complete. 2024-09-19T06:11:42.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.543+0000 7fe48a000640 1 Processor -- start 2024-09-19T06:11:42.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.543+0000 7fe48a000640 1 -- start start 2024-09-19T06:11:42.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.543+0000 7fe48a000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4841019c0 0x7fe48419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:42.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.543+0000 7fe48a000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe484102360 0x7fe48419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:42.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.543+0000 7fe48a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4841079c0 0x7fe48419ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:42.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.544+0000 7fe48a000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe484111dc0 con 0x7fe4841019c0 2024-09-19T06:11:42.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.544+0000 7fe48a000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe484111c40 con 0x7fe4841079c0 2024-09-19T06:11:42.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.544+0000 7fe48a000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe484111f40 con 0x7fe484102360 2024-09-19T06:11:42.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.544+0000 7fe488c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4841019c0 0x7fe48419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:42.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.544+0000 7fe488c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4841019c0 0x7fe48419a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44562/0 (socket says 172.21.15.3:44562) 2024-09-19T06:11:42.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.544+0000 7fe488c00640 1 -- 172.21.15.3:0/3712720777 learned_addr learned my addr 172.21.15.3:0/3712720777 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:42.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.544+0000 7fe489600640 1 --2- 172.21.15.3:0/3712720777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4841079c0 0x7fe48419ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:42.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.544+0000 7fe47be00640 1 --2- 172.21.15.3:0/3712720777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe484102360 0x7fe48419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:42.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.544+0000 7fe488c00640 1 -- 172.21.15.3:0/3712720777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe484102360 msgr2=0x7fe48419a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:42.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.544+0000 7fe488c00640 1 --2- 172.21.15.3:0/3712720777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe484102360 0x7fe48419a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.544+0000 7fe488c00640 1 -- 172.21.15.3:0/3712720777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4841079c0 msgr2=0x7fe48419ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:42.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.544+0000 7fe488c00640 1 --2- 172.21.15.3:0/3712720777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4841079c0 0x7fe48419ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.544+0000 7fe488c00640 1 -- 172.21.15.3:0/3712720777 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48419f450 con 0x7fe4841019c0 2024-09-19T06:11:42.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.545+0000 7fe488c00640 1 --2- 172.21.15.3:0/3712720777 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4841019c0 0x7fe48419a4a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe47400ea60 tx=0x7fe47400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:42.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.545+0000 7fe482000640 1 -- 172.21.15.3:0/3712720777 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47400cde0 con 0x7fe4841019c0 2024-09-19T06:11:42.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.545+0000 7fe482000640 1 -- 172.21.15.3:0/3712720777 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4740035f0 con 0x7fe4841019c0 2024-09-19T06:11:42.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.545+0000 7fe482000640 1 -- 172.21.15.3:0/3712720777 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe474010670 con 0x7fe4841019c0 2024-09-19T06:11:42.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.545+0000 7fe48a000640 1 -- 172.21.15.3:0/3712720777 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe48419f740 con 0x7fe4841019c0 2024-09-19T06:11:42.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.545+0000 7fe48a000640 1 -- 172.21.15.3:0/3712720777 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4841a7020 con 0x7fe4841019c0 2024-09-19T06:11:42.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.548+0000 7fe482000640 1 -- 172.21.15.3:0/3712720777 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe4740037a0 con 0x7fe4841019c0 2024-09-19T06:11:42.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.549+0000 7fe48e245740 1 Processor -- start 2024-09-19T06:11:42.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.549+0000 7fe48e245740 1 -- start start 2024-09-19T06:11:42.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.549+0000 7fe48e245740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56478ec2b4e0 0x56478ec2b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:42.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.549+0000 7fe48e245740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56478ec2be00 0x56478ec36180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:42.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.549+0000 7fe48e245740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec366c0 0x56478ec38ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:42.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.549+0000 7fe48e245740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56478eb910b0 con 0x56478ec2b4e0 2024-09-19T06:11:42.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.549+0000 7fe48e245740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56478eb38ab0 con 0x56478ec2be00 2024-09-19T06:11:42.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.549+0000 7fe48e245740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56478eb8d070 con 0x56478ec366c0 2024-09-19T06:11:42.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.550+0000 7fe489600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56478ec2b4e0 0x56478ec2b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:42.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.550+0000 7fe489600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56478ec2b4e0 0x56478ec2b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44574/0 (socket says 172.21.15.3:44574) 2024-09-19T06:11:42.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.550+0000 7fe488c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56478ec2be00 0x56478ec36180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:42.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.550+0000 7fe489600640 1 -- 172.21.15.3:0/3871856098 learned_addr learned my addr 172.21.15.3:0/3871856098 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:42.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.550+0000 7fe47be00640 1 --2- 172.21.15.3:0/3871856098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec366c0 0x56478ec38ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:42.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.550+0000 7fe489600640 1 -- 172.21.15.3:0/3871856098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec366c0 msgr2=0x56478ec38ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:42.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.550+0000 7fe489600640 1 --2- 172.21.15.3:0/3871856098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec366c0 0x56478ec38ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.550+0000 7fe489600640 1 -- 172.21.15.3:0/3871856098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56478ec2be00 msgr2=0x56478ec36180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:42.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.550+0000 7fe489600640 1 --2- 172.21.15.3:0/3871856098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56478ec2be00 0x56478ec36180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.550+0000 7fe489600640 1 -- 172.21.15.3:0/3871856098 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56478eb454a0 con 0x56478ec2b4e0 2024-09-19T06:11:42.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.550+0000 7fe488c00640 1 --2- 172.21.15.3:0/3871856098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56478ec2be00 0x56478ec36180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:42.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.550+0000 7fe482000640 1 --2- 172.21.15.3:0/3712720777 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe4680a3350 0x7fe4680a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:42.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.550+0000 7fe489600640 1 --2- 172.21.15.3:0/3871856098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56478ec2b4e0 0x56478ec2b8c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe47c009cd0 tx=0x7fe47c009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c55ba9c0f466575 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:42.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.551+0000 7fe482000640 1 -- 172.21.15.3:0/3712720777 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fe4740cfcf0 con 0x7fe4841019c0 2024-09-19T06:11:42.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.551+0000 7fe488c00640 1 --2- 172.21.15.3:0/3712720777 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe4680a3350 0x7fe4680a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:42.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.551+0000 7fe479c00640 1 -- 172.21.15.3:0/3871856098 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c048070 con 0x56478ec2b4e0 2024-09-19T06:11:42.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.551+0000 7fe479c00640 1 -- 172.21.15.3:0/3871856098 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe47c036070 con 0x56478ec2b4e0 2024-09-19T06:11:42.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.551+0000 7fe479c00640 1 -- 172.21.15.3:0/3871856098 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c004440 con 0x56478ec2b4e0 2024-09-19T06:11:42.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.552+0000 7fe48e245740 1 -- 172.21.15.3:0/3871856098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56478ec2b4e0 msgr2=0x56478ec2b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:42.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.552+0000 7fe48e245740 1 --2- 172.21.15.3:0/3871856098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56478ec2b4e0 0x56478ec2b8c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe47c009cd0 tx=0x7fe47c009a20 comp rx=0 tx=0).stop 2024-09-19T06:11:42.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.552+0000 7fe488c00640 1 --2- 172.21.15.3:0/3712720777 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe4680a3350 0x7fe4680a5810 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe47409c0c0 tx=0x7fe4740d37a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:42.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.552+0000 7fe48e245740 1 -- 172.21.15.3:0/3871856098 shutdown_connections 2024-09-19T06:11:42.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.552+0000 7fe48e245740 1 --2- 172.21.15.3:0/3871856098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec366c0 0x56478ec38ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.552+0000 7fe48e245740 1 --2- 172.21.15.3:0/3871856098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56478ec2be00 0x56478ec36180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.552+0000 7fe48e245740 1 --2- 172.21.15.3:0/3871856098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56478ec2b4e0 0x56478ec2b8c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.552+0000 7fe48e245740 1 -- 172.21.15.3:0/3871856098 >> 172.21.15.3:0/3871856098 conn(0x56478ec27a70 msgr2=0x56478ec27e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:42.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.552+0000 7fe48e245740 1 -- 172.21.15.3:0/3871856098 shutdown_connections 2024-09-19T06:11:42.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.552+0000 7fe48e245740 1 -- 172.21.15.3:0/3871856098 wait complete. 2024-09-19T06:11:42.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.552+0000 7fe48e245740 1 -- start start 2024-09-19T06:11:42.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.553+0000 7fe48e245740 1 Processor -- start 2024-09-19T06:11:42.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.553+0000 7fe48e245740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec2b4e0 0x56478ec335c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:42.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.553+0000 7fe48e245740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56478ec2be00 0x56478ec33b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:42.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.553+0000 7fe48e245740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56478ec366c0 0x56478ec34040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:42.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.553+0000 7fe48e245740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56478ec39330 con 0x56478ec2be00 2024-09-19T06:11:42.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.553+0000 7fe48e245740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56478eb19920 con 0x56478ec366c0 2024-09-19T06:11:42.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.553+0000 7fe48e245740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56478ec394b0 con 0x56478ec2b4e0 2024-09-19T06:11:42.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.553+0000 7fe48e245740 10 client.0 _ll_register_callbacks cb 0x56478eb3d8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:11:42.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.553+0000 7fe489600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec2b4e0 0x56478ec335c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:42.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.553+0000 7fe489600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec2b4e0 0x56478ec335c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:59504/0 (socket says 172.21.15.3:59504) 2024-09-19T06:11:42.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.553+0000 7fe489600640 1 -- 172.21.15.3:0/2336492960 learned_addr learned my addr 172.21.15.3:0/2336492960 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:42.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.553+0000 7fe47be00640 1 --2- 172.21.15.3:0/2336492960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56478ec2be00 0x56478ec33b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:42.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.554+0000 7fe489600640 1 --2- 172.21.15.3:0/2336492960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56478ec366c0 0x56478ec34040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:42.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.554+0000 7fe489600640 1 -- 172.21.15.3:0/2336492960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56478ec366c0 msgr2=0x56478ec34040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:42.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.554+0000 7fe489600640 1 --2- 172.21.15.3:0/2336492960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56478ec366c0 0x56478ec34040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.554+0000 7fe489600640 1 -- 172.21.15.3:0/2336492960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56478ec2be00 msgr2=0x56478ec33b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:42.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.554+0000 7fe489600640 1 --2- 172.21.15.3:0/2336492960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56478ec2be00 0x56478ec33b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.554+0000 7fe489600640 1 -- 172.21.15.3:0/2336492960 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56478e9022b0 con 0x56478ec2b4e0 2024-09-19T06:11:42.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.554+0000 7fe489600640 1 --2- 172.21.15.3:0/2336492960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec2b4e0 0x56478ec335c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe47c046040 tx=0x7fe47c003f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5c5c1e5bd668cb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:42.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.554+0000 7fe472000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:11:42.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.554+0000 7fe472000640 1 -- 172.21.15.3:0/2336492960 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c056060 con 0x56478ec2b4e0 2024-09-19T06:11:42.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.554+0000 7fe472000640 1 -- 172.21.15.3:0/2336492960 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fe47c031ac0 con 0x56478ec2b4e0 2024-09-19T06:11:42.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.554+0000 7fe48e245740 1 -- 172.21.15.3:0/2336492960 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe47c036070 con 0x56478ec2b4e0 2024-09-19T06:11:42.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.555+0000 7fe472000640 1 -- 172.21.15.3:0/2336492960 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe47c048040 con 0x56478ec2b4e0 2024-09-19T06:11:42.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.555+0000 7fe48e245740 10 client.24967 fetch_fsmap learned FSMap version 28 2024-09-19T06:11:42.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.555+0000 7fe48e245740 1 -- 172.21.15.3:0/2336492960 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56478ec39330 con 0x56478ec2b4e0 2024-09-19T06:11:42.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.555+0000 7fe472000640 1 -- 172.21.15.3:0/2336492960 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe47c036070 con 0x56478ec2b4e0 2024-09-19T06:11:42.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.555+0000 7fe472000640 1 -- 172.21.15.3:0/2336492960 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe47c042030 con 0x56478ec2b4e0 2024-09-19T06:11:42.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.555+0000 7fe48e245740 10 client.24967 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:11:42.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.556+0000 7fe48e245740 10 client.24967 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T06:11:42.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.556+0000 7fe48e245740 20 client.24967 populate_metadata read hostname 'smithi003' 2024-09-19T06:11:42.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.556+0000 7fe48e245740 1 --2- 172.21.15.3:0/2336492960 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56478ec471e0 0x56478ec48650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:42.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.556+0000 7fe48e245740 4 client.24967 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:11:42.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.556+0000 7fe48e245740 1 -- 172.21.15.3:0/2336492960 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56478eb9e620 con 0x56478ec471e0 2024-09-19T06:11:42.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.556+0000 7fe47be00640 1 --2- 172.21.15.3:0/2336492960 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56478ec471e0 0x56478ec48650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:42.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.556+0000 7fe47be00640 1 --2- 172.21.15.3:0/2336492960 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56478ec471e0 0x56478ec48650 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b80d95d1a79a8eb0 server_cookie=5aeebb0572b743f6 in_seq=0 out_seq=0 2024-09-19T06:11:42.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.556+0000 7fe472000640 10 client.24967 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:11:42.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.557+0000 7fe472000640 1 -- 172.21.15.3:0/2336492960 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56478eb9e620 con 0x56478ec471e0 2024-09-19T06:11:42.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.557+0000 7fe472000640 10 client.24967 handle_command_reply: tid=0 2024-09-19T06:11:42.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.557+0000 7fe48e245740 1 client.24967 shutdown 2024-09-19T06:11:42.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.557+0000 7fe48e245740 1 -- 172.21.15.3:0/2336492960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec2b4e0 msgr2=0x56478ec335c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:42.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.557+0000 7fe48e245740 1 --2- 172.21.15.3:0/2336492960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec2b4e0 0x56478ec335c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe47c046040 tx=0x7fe47c003f00 comp rx=0 tx=0).stop 2024-09-19T06:11:42.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.558+0000 7fe48e245740 1 -- 172.21.15.3:0/2336492960 shutdown_connections 2024-09-19T06:11:42.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.558+0000 7fe48e245740 1 --2- 172.21.15.3:0/2336492960 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56478ec471e0 0x56478ec48650 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.558+0000 7fe48e245740 1 --2- 172.21.15.3:0/2336492960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56478ec366c0 0x56478ec34040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.558+0000 7fe48e245740 1 --2- 172.21.15.3:0/2336492960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56478ec2be00 0x56478ec33b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.558+0000 7fe472000640 0 client.24967 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:11:42.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.558+0000 7fe48e245740 1 --2- 172.21.15.3:0/2336492960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec2b4e0 0x56478ec335c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.558+0000 7fe48e245740 1 -- 172.21.15.3:0/2336492960 >> 172.21.15.3:0/2336492960 conn(0x56478ec27a70 msgr2=0x56478ec26bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:42.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.558+0000 7fe48e245740 1 -- 172.21.15.3:0/2336492960 shutdown_connections 2024-09-19T06:11:42.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.558+0000 7fe48e245740 1 -- 172.21.15.3:0/2336492960 wait complete. 2024-09-19T06:11:42.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.558+0000 7fe48e245740 20 client.24967 trim_cache size 0 max 16384 2024-09-19T06:11:42.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.576+0000 7fe48e245740 1 Processor -- start 2024-09-19T06:11:42.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.577+0000 7fe48e245740 1 -- start start 2024-09-19T06:11:42.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.577+0000 7fe48e245740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec2b4e0 0x56478ec48650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:42.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.577+0000 7fe48e245740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56478ec2be00 0x56478ec325a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:42.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.577+0000 7fe48e245740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56478ec366c0 0x56478ec30820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:42.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.577+0000 7fe48e245740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56478ec46990 con 0x56478ec2be00 2024-09-19T06:11:42.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.577+0000 7fe48e245740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56478ec47060 con 0x56478ec366c0 2024-09-19T06:11:42.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.577+0000 7fe48e245740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56478ec47730 con 0x56478ec2b4e0 2024-09-19T06:11:42.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.577+0000 7fe47be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56478ec2be00 0x56478ec325a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:42.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.577+0000 7fe47be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56478ec2be00 0x56478ec325a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44590/0 (socket says 172.21.15.3:44590) 2024-09-19T06:11:42.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.577+0000 7fe47be00640 1 -- 172.21.15.3:0/3308571023 learned_addr learned my addr 172.21.15.3:0/3308571023 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:42.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.577+0000 7fe489600640 1 --2- 172.21.15.3:0/3308571023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec2b4e0 0x56478ec48650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:42.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.577+0000 7fe489600640 1 --2- 172.21.15.3:0/3308571023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56478ec366c0 0x56478ec30820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:42.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.577+0000 7fe47be00640 1 -- 172.21.15.3:0/3308571023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec2b4e0 msgr2=0x56478ec48650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:42.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.577+0000 7fe47be00640 1 --2- 172.21.15.3:0/3308571023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec2b4e0 0x56478ec48650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.577+0000 7fe47be00640 1 -- 172.21.15.3:0/3308571023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56478ec366c0 msgr2=0x56478ec30820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:42.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.577+0000 7fe47be00640 1 --2- 172.21.15.3:0/3308571023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56478ec366c0 0x56478ec30820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.577+0000 7fe47be00640 1 -- 172.21.15.3:0/3308571023 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56478ec28700 con 0x56478ec2be00 2024-09-19T06:11:42.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.577+0000 7fe489600640 1 --2- 172.21.15.3:0/3308571023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec2b4e0 0x56478ec48650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:42.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.578+0000 7fe47be00640 1 --2- 172.21.15.3:0/3308571023 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56478ec2be00 0x56478ec325a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x56478ec32e50 tx=0x7fe46c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f861f2d5ebb064b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:42.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.578+0000 7fe479200640 1 -- 172.21.15.3:0/3308571023 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c003dc0 con 0x56478ec2be00 2024-09-19T06:11:42.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.578+0000 7fe479200640 1 -- 172.21.15.3:0/3308571023 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe46c010910 con 0x56478ec2be00 2024-09-19T06:11:42.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.578+0000 7fe479200640 1 -- 172.21.15.3:0/3308571023 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c01ea00 con 0x56478ec2be00 2024-09-19T06:11:42.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.579+0000 7fe48e245740 1 -- 172.21.15.3:0/3308571023 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56478ec2be00 msgr2=0x56478ec325a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:42.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.579+0000 7fe48e245740 1 --2- 172.21.15.3:0/3308571023 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56478ec2be00 0x56478ec325a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x56478ec32e50 tx=0x7fe46c005f90 comp rx=0 tx=0).stop 2024-09-19T06:11:42.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.579+0000 7fe48e245740 1 -- 172.21.15.3:0/3308571023 shutdown_connections 2024-09-19T06:11:42.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.579+0000 7fe48e245740 1 --2- 172.21.15.3:0/3308571023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56478ec366c0 0x56478ec30820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.579+0000 7fe48e245740 1 --2- 172.21.15.3:0/3308571023 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56478ec2be00 0x56478ec325a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.579+0000 7fe48e245740 1 --2- 172.21.15.3:0/3308571023 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec2b4e0 0x56478ec48650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.579+0000 7fe48e245740 1 -- 172.21.15.3:0/3308571023 >> 172.21.15.3:0/3308571023 conn(0x56478ec27a70 msgr2=0x56478ec31e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:42.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.579+0000 7fe48e245740 1 -- 172.21.15.3:0/3308571023 shutdown_connections 2024-09-19T06:11:42.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.579+0000 7fe48e245740 1 -- 172.21.15.3:0/3308571023 wait complete. 2024-09-19T06:11:42.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.579+0000 7fe48e245740 1 -- start start 2024-09-19T06:11:42.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.580+0000 7fe48e245740 1 Processor -- start 2024-09-19T06:11:42.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.580+0000 7fe48e245740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec2b4e0 0x56478ec50e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:42.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.580+0000 7fe48e245740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56478ec2be00 0x56478ec4a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:42.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.580+0000 7fe48e245740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56478ec366c0 0x56478ec4a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:42.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.580+0000 7fe48e245740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56478ec484d0 con 0x56478ec366c0 2024-09-19T06:11:42.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.580+0000 7fe48e245740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56478ec47e00 con 0x56478ec2be00 2024-09-19T06:11:42.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.580+0000 7fe48e245740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56478ec48ba0 con 0x56478ec2b4e0 2024-09-19T06:11:42.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.580+0000 7fe48e245740 10 client.0 _ll_register_callbacks cb 0x7fe46c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:11:42.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.580+0000 7fe489600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56478ec366c0 0x56478ec4a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:42.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.580+0000 7fe489600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec2b4e0 0x56478ec50e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:42.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.580+0000 7fe489600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec2b4e0 0x56478ec50e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:59528/0 (socket says 172.21.15.3:59528) 2024-09-19T06:11:42.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.580+0000 7fe489600640 1 -- 172.21.15.3:0/3376380572 learned_addr learned my addr 172.21.15.3:0/3376380572 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:42.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.581+0000 7fe47be00640 1 --2- 172.21.15.3:0/3376380572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56478ec2be00 0x56478ec4a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:42.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.581+0000 7fe489600640 1 -- 172.21.15.3:0/3376380572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56478ec2be00 msgr2=0x56478ec4a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:42.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.581+0000 7fe489600640 1 --2- 172.21.15.3:0/3376380572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56478ec2be00 0x56478ec4a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.581+0000 7fe489600640 1 -- 172.21.15.3:0/3376380572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56478ec366c0 msgr2=0x56478ec4a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:42.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.581+0000 7fe489600640 1 --2- 172.21.15.3:0/3376380572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56478ec366c0 0x56478ec4a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.581+0000 7fe489600640 1 -- 172.21.15.3:0/3376380572 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56478ec4ad60 con 0x56478ec2b4e0 2024-09-19T06:11:42.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.581+0000 7fe489600640 1 --2- 172.21.15.3:0/3376380572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec2b4e0 0x56478ec50e80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe47c005e00 tx=0x7fe47c03e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b52db80ec482c9f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:42.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.581+0000 7fe472000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:11:42.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.581+0000 7fe472000640 1 -- 172.21.15.3:0/3376380572 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe47c056070 con 0x56478ec2b4e0 2024-09-19T06:11:42.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.581+0000 7fe472000640 1 -- 172.21.15.3:0/3376380572 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fe47c003970 con 0x56478ec2b4e0 2024-09-19T06:11:42.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.581+0000 7fe48e245740 1 -- 172.21.15.3:0/3376380572 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe46c010910 con 0x56478ec2b4e0 2024-09-19T06:11:42.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.582+0000 7fe472000640 1 -- 172.21.15.3:0/3376380572 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe47c060040 con 0x56478ec2b4e0 2024-09-19T06:11:42.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.582+0000 7fe48e245740 10 client.24973 fetch_fsmap learned FSMap version 28 2024-09-19T06:11:42.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.582+0000 7fe48e245740 1 -- 172.21.15.3:0/3376380572 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56478ecb18f0 con 0x56478ec2b4e0 2024-09-19T06:11:42.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.582+0000 7fe472000640 1 -- 172.21.15.3:0/3376380572 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe46c010910 con 0x56478ec2b4e0 2024-09-19T06:11:42.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.582+0000 7fe472000640 1 -- 172.21.15.3:0/3376380572 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe47c064030 con 0x56478ec2b4e0 2024-09-19T06:11:42.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.582+0000 7fe48e245740 10 client.24973 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:11:42.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.582+0000 7fe48e245740 10 client.24973 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T06:11:42.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.582+0000 7fe48e245740 20 client.24973 populate_metadata read hostname 'smithi003' 2024-09-19T06:11:42.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.582+0000 7fe48e245740 1 --2- 172.21.15.3:0/3376380572 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56478ecb6280 0x56478ecb4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:42.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.582+0000 7fe48e245740 4 client.24973 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:11:42.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.582+0000 7fe48e245740 1 -- 172.21.15.3:0/3376380572 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "status"}) -- 0x56478eb98b30 con 0x56478ecb6280 2024-09-19T06:11:42.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.583+0000 7fe47be00640 1 --2- 172.21.15.3:0/3376380572 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56478ecb6280 0x56478ecb4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:42.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.583+0000 7fe47be00640 1 --2- 172.21.15.3:0/3376380572 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56478ecb6280 0x56478ecb4f90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=56d1ba03ead130cf server_cookie=41179bb9e584397c in_seq=0 out_seq=0 2024-09-19T06:11:42.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.583+0000 7fe472000640 10 client.24973 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:11:42.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.584+0000 7fe472000640 1 -- 172.21.15.3:0/3376380572 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x56478eb98b30 con 0x56478ecb6280 2024-09-19T06:11:42.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.584+0000 7fe472000640 10 client.24973 handle_command_reply: tid=0 2024-09-19T06:11:42.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.584+0000 7fe48e245740 1 client.24973 shutdown 2024-09-19T06:11:42.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.584+0000 7fe48e245740 1 -- 172.21.15.3:0/3376380572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec2b4e0 msgr2=0x56478ec50e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:42.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.584+0000 7fe48e245740 1 --2- 172.21.15.3:0/3376380572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec2b4e0 0x56478ec50e80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe47c005e00 tx=0x7fe47c03e040 comp rx=0 tx=0).stop 2024-09-19T06:11:42.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.584+0000 7fe48e245740 1 -- 172.21.15.3:0/3376380572 shutdown_connections 2024-09-19T06:11:42.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.584+0000 7fe48e245740 1 --2- 172.21.15.3:0/3376380572 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56478ecb6280 0x56478ecb4f90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.584+0000 7fe48e245740 1 --2- 172.21.15.3:0/3376380572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56478ec366c0 0x56478ec4a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.584+0000 7fe48e245740 1 --2- 172.21.15.3:0/3376380572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56478ec2be00 0x56478ec4a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.584+0000 7fe48e245740 1 --2- 172.21.15.3:0/3376380572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56478ec2b4e0 0x56478ec50e80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.584+0000 7fe472000640 0 client.24973 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:11:42.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.584+0000 7fe48e245740 1 -- 172.21.15.3:0/3376380572 >> 172.21.15.3:0/3376380572 conn(0x56478ec27a70 msgr2=0x56478ec326b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:42.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.584+0000 7fe48e245740 1 -- 172.21.15.3:0/3376380572 shutdown_connections 2024-09-19T06:11:42.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.584+0000 7fe48e245740 1 -- 172.21.15.3:0/3376380572 wait complete. 2024-09-19T06:11:42.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.584+0000 7fe48e245740 20 client.24973 trim_cache size 0 max 16384 2024-09-19T06:11:42.591 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:11:42.591 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "782a5144-764c-11ef-bceb-c7b262605968", 2024-09-19T06:11:42.591 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 1, 2024-09-19T06:11:42.591 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 24532, 2024-09-19T06:11:42.591 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2024-09-19T06:11:42.591 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2024-09-19T06:11:42.591 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2024-09-19T06:11:42.591 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 88.025314369, 2024-09-19T06:11:42.591 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 28, 2024-09-19T06:11:42.591 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 88, 2024-09-19T06:11:42.591 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 86, 2024-09-19T06:11:42.592 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 124.00765322300001 2024-09-19T06:11:42.592 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:11:42.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.585+0000 7fe48a000640 1 -- 172.21.15.3:0/3712720777 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe4680a3350 msgr2=0x7fe4680a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:42.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.585+0000 7fe48a000640 1 --2- 172.21.15.3:0/3712720777 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe4680a3350 0x7fe4680a5810 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe47409c0c0 tx=0x7fe4740d37a0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.585+0000 7fe48a000640 1 -- 172.21.15.3:0/3712720777 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4841019c0 msgr2=0x7fe48419a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:42.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.585+0000 7fe48a000640 1 --2- 172.21.15.3:0/3712720777 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4841019c0 0x7fe48419a4a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe47400ea60 tx=0x7fe47400ef20 comp rx=0 tx=0).stop 2024-09-19T06:11:42.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.585+0000 7fe48a000640 1 -- 172.21.15.3:0/3712720777 shutdown_connections 2024-09-19T06:11:42.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.585+0000 7fe48a000640 1 --2- 172.21.15.3:0/3712720777 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fe4680a3350 0x7fe4680a5810 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.585+0000 7fe48a000640 1 --2- 172.21.15.3:0/3712720777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4841079c0 0x7fe48419ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.585+0000 7fe48a000640 1 --2- 172.21.15.3:0/3712720777 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe484102360 0x7fe48419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.585+0000 7fe48a000640 1 --2- 172.21.15.3:0/3712720777 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe4841019c0 0x7fe48419a4a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:42.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.585+0000 7fe48a000640 1 -- 172.21.15.3:0/3712720777 >> 172.21.15.3:0/3712720777 conn(0x7fe4840fd740 msgr2=0x7fe48410d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:42.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.585+0000 7fe48a000640 1 -- 172.21.15.3:0/3712720777 shutdown_connections 2024-09-19T06:11:42.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:42.585+0000 7fe48a000640 1 -- 172.21.15.3:0/3712720777 wait complete. 2024-09-19T06:11:43.525 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T06:11:43.905 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:44.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:44 smithi003 ceph-mon[30893]: pgmap v354: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:44.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:44 smithi071 ceph-mon[35662]: pgmap v354: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:44.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.502+0000 7f7dd2a00640 1 -- 172.21.15.3:0/583382501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dcc102790 msgr2=0x7f7dcc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:44.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.502+0000 7f7dd2a00640 1 --2- 172.21.15.3:0/583382501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dcc102790 0x7f7dcc1067e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7db4009900 tx=0x7f7db402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.502+0000 7f7dd2a00640 1 -- 172.21.15.3:0/583382501 shutdown_connections 2024-09-19T06:11:44.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.502+0000 7f7dd2a00640 1 --2- 172.21.15.3:0/583382501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dcc106f10 0x7f7dcc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.502+0000 7f7dd2a00640 1 --2- 172.21.15.3:0/583382501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dcc102790 0x7f7dcc1067e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.502+0000 7f7dd2a00640 1 --2- 172.21.15.3:0/583382501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dcc101de0 0x7f7dcc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.502+0000 7f7dd2a00640 1 -- 172.21.15.3:0/583382501 >> 172.21.15.3:0/583382501 conn(0x7f7dcc0fd8c0 msgr2=0x7f7dcc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:44.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.502+0000 7f7dd2a00640 1 -- 172.21.15.3:0/583382501 shutdown_connections 2024-09-19T06:11:44.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.502+0000 7f7dd2a00640 1 -- 172.21.15.3:0/583382501 wait complete. 2024-09-19T06:11:44.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.503+0000 7f7dd2a00640 1 Processor -- start 2024-09-19T06:11:44.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.503+0000 7f7dd2a00640 1 -- start start 2024-09-19T06:11:44.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.504+0000 7f7dd2a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dcc101de0 0x7f7dcc19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:44.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.504+0000 7f7dd2a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dcc102790 0x7f7dcc19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:44.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.504+0000 7f7dd2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dcc106f10 0x7f7dcc19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:44.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.504+0000 7f7dd2a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc111f70 con 0x7f7dcc101de0 2024-09-19T06:11:44.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.504+0000 7f7dd2a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc111df0 con 0x7f7dcc106f10 2024-09-19T06:11:44.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.504+0000 7f7dd2a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc1120f0 con 0x7f7dcc102790 2024-09-19T06:11:44.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.504+0000 7f7dcbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dcc101de0 0x7f7dcc19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:44.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.504+0000 7f7dcbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dcc101de0 0x7f7dcc19a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46624/0 (socket says 172.21.15.3:46624) 2024-09-19T06:11:44.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.504+0000 7f7dcbe00640 1 -- 172.21.15.3:0/3883037218 learned_addr learned my addr 172.21.15.3:0/3883037218 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:44.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.504+0000 7f7dc3400640 1 --2- 172.21.15.3:0/3883037218 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dcc102790 0x7f7dcc19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:44.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.504+0000 7f7dd0a00640 1 --2- 172.21.15.3:0/3883037218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dcc106f10 0x7f7dcc19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:44.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.504+0000 7f7dcbe00640 1 -- 172.21.15.3:0/3883037218 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dcc102790 msgr2=0x7f7dcc19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:44.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.504+0000 7f7dcbe00640 1 --2- 172.21.15.3:0/3883037218 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dcc102790 0x7f7dcc19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.504+0000 7f7dcbe00640 1 -- 172.21.15.3:0/3883037218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dcc106f10 msgr2=0x7f7dcc19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:44.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.504+0000 7f7dcbe00640 1 --2- 172.21.15.3:0/3883037218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dcc106f10 0x7f7dcc19ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.504+0000 7f7dcbe00640 1 -- 172.21.15.3:0/3883037218 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc19f5e0 con 0x7f7dcc101de0 2024-09-19T06:11:44.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.505+0000 7f7dcbe00640 1 --2- 172.21.15.3:0/3883037218 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dcc101de0 0x7f7dcc19a630 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc00e9f0 tx=0x7f7dbc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:44.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.505+0000 7f7dc9600640 1 -- 172.21.15.3:0/3883037218 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc00cd80 con 0x7f7dcc101de0 2024-09-19T06:11:44.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.505+0000 7f7dc9600640 1 -- 172.21.15.3:0/3883037218 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dbc010910 con 0x7f7dcc101de0 2024-09-19T06:11:44.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.505+0000 7f7dd2a00640 1 -- 172.21.15.3:0/3883037218 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dcc19f8d0 con 0x7f7dcc101de0 2024-09-19T06:11:44.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.505+0000 7f7dc9600640 1 -- 172.21.15.3:0/3883037218 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc018990 con 0x7f7dcc101de0 2024-09-19T06:11:44.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.505+0000 7f7dd2a00640 1 -- 172.21.15.3:0/3883037218 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dcc1a71b0 con 0x7f7dcc101de0 2024-09-19T06:11:44.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.508+0000 7f7dd5401740 1 Processor -- start 2024-09-19T06:11:44.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.508+0000 7f7dc9600640 1 -- 172.21.15.3:0/3883037218 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f7dbc010ac0 con 0x7f7dcc101de0 2024-09-19T06:11:44.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.508+0000 7f7dd5401740 1 -- start start 2024-09-19T06:11:44.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.509+0000 7f7dd5401740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56442f90c330 0x56442f90c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:44.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.509+0000 7f7dd5401740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56442f90cc50 0x56442f916fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:44.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.509+0000 7f7dd5401740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f917510 0x56442f919900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:44.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.509+0000 7f7dd5401740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56442f8720b0 con 0x56442f917510 2024-09-19T06:11:44.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.509+0000 7f7dd5401740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56442f819ab0 con 0x56442f90cc50 2024-09-19T06:11:44.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.509+0000 7f7dd5401740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56442f86e070 con 0x56442f90c330 2024-09-19T06:11:44.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.509+0000 7f7dcbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56442f90cc50 0x56442f916fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:44.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.509+0000 7f7dc3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f917510 0x56442f919900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:44.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.509+0000 7f7dcbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56442f90cc50 0x56442f916fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55418/0 (socket says 172.21.15.3:55418) 2024-09-19T06:11:44.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.509+0000 7f7dcbe00640 1 -- 172.21.15.3:0/904219937 learned_addr learned my addr 172.21.15.3:0/904219937 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:44.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.509+0000 7f7dd0a00640 1 --2- 172.21.15.3:0/904219937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56442f90c330 0x56442f90c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:44.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.510+0000 7f7dcbe00640 1 -- 172.21.15.3:0/904219937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56442f90c330 msgr2=0x56442f90c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:44.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.510+0000 7f7dcbe00640 1 --2- 172.21.15.3:0/904219937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56442f90c330 0x56442f90c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.510+0000 7f7dcbe00640 1 -- 172.21.15.3:0/904219937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f917510 msgr2=0x56442f919900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:44.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.510+0000 7f7dcbe00640 1 --2- 172.21.15.3:0/904219937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f917510 0x56442f919900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.510+0000 7f7dcbe00640 1 -- 172.21.15.3:0/904219937 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56442f8264a0 con 0x56442f90cc50 2024-09-19T06:11:44.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.510+0000 7f7dc3400640 1 --2- 172.21.15.3:0/904219937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f917510 0x56442f919900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:44.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.510+0000 7f7dc9600640 1 --2- 172.21.15.3:0/3883037218 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f7db00a3350 0x7f7db00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:44.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.510+0000 7f7dcbe00640 1 --2- 172.21.15.3:0/904219937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56442f90cc50 0x56442f916fd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0d3e80 tx=0x7f7dbc0d67d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f960769472b7fd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:44.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.510+0000 7f7dc9600640 1 -- 172.21.15.3:0/3883037218 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f7dbc0cfd90 con 0x7f7dcc101de0 2024-09-19T06:11:44.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.510+0000 7f7dd0a00640 1 --2- 172.21.15.3:0/3883037218 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f7db00a3350 0x7f7db00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:44.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.510+0000 7f7dc1200640 1 -- 172.21.15.3:0/904219937 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc098520 con 0x56442f90cc50 2024-09-19T06:11:44.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.511+0000 7f7dc1200640 1 -- 172.21.15.3:0/904219937 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dbc0d1070 con 0x56442f90cc50 2024-09-19T06:11:44.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.511+0000 7f7dc1200640 1 -- 172.21.15.3:0/904219937 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc09bbe0 con 0x56442f90cc50 2024-09-19T06:11:44.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.511+0000 7f7dd5401740 1 -- 172.21.15.3:0/904219937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56442f90cc50 msgr2=0x56442f916fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:44.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.511+0000 7f7dd5401740 1 --2- 172.21.15.3:0/904219937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56442f90cc50 0x56442f916fd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0d3e80 tx=0x7f7dbc0d67d0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.511+0000 7f7dd0a00640 1 --2- 172.21.15.3:0/3883037218 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f7db00a3350 0x7f7db00a5810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4005fd0 tx=0x7f7dc4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:44.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.511+0000 7f7dd5401740 1 -- 172.21.15.3:0/904219937 shutdown_connections 2024-09-19T06:11:44.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.511+0000 7f7dd5401740 1 --2- 172.21.15.3:0/904219937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f917510 0x56442f919900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.511+0000 7f7dd5401740 1 --2- 172.21.15.3:0/904219937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56442f90cc50 0x56442f916fd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.511+0000 7f7dd5401740 1 --2- 172.21.15.3:0/904219937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56442f90c330 0x56442f90c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.511+0000 7f7dd5401740 1 -- 172.21.15.3:0/904219937 >> 172.21.15.3:0/904219937 conn(0x56442f9088c0 msgr2=0x56442f908ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.512+0000 7f7dd5401740 1 -- 172.21.15.3:0/904219937 shutdown_connections 2024-09-19T06:11:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.512+0000 7f7dd5401740 1 -- 172.21.15.3:0/904219937 wait complete. 2024-09-19T06:11:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.512+0000 7f7dd5401740 1 -- start start 2024-09-19T06:11:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.512+0000 7f7dd5401740 1 Processor -- start 2024-09-19T06:11:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.513+0000 7f7dd5401740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f90c330 0x56442f914670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.513+0000 7f7dd5401740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56442f90cc50 0x56442f914bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.513+0000 7f7dd5401740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56442f917510 0x56442f915110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.513+0000 7f7dd5401740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56442f91a060 con 0x56442f90c330 2024-09-19T06:11:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.513+0000 7f7dd5401740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56442f7fa920 con 0x56442f917510 2024-09-19T06:11:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.513+0000 7f7dd5401740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56442f91a1e0 con 0x56442f90cc50 2024-09-19T06:11:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.513+0000 7f7dd5401740 10 client.0 _ll_register_callbacks cb 0x56442f81e8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:11:44.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.513+0000 7f7dcbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f90c330 0x56442f914670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:44.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.513+0000 7f7dcbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f90c330 0x56442f914670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46648/0 (socket says 172.21.15.3:46648) 2024-09-19T06:11:44.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.513+0000 7f7dcbe00640 1 -- 172.21.15.3:0/2311663765 learned_addr learned my addr 172.21.15.3:0/2311663765 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:44.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.513+0000 7f7dc3400640 1 --2- 172.21.15.3:0/2311663765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56442f90cc50 0x56442f914bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:44.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.513+0000 7f7dd0a00640 1 --2- 172.21.15.3:0/2311663765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56442f917510 0x56442f915110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:44.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.513+0000 7f7dcbe00640 1 -- 172.21.15.3:0/2311663765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56442f90cc50 msgr2=0x56442f914bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:44.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.513+0000 7f7dcbe00640 1 --2- 172.21.15.3:0/2311663765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56442f90cc50 0x56442f914bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.513+0000 7f7dcbe00640 1 -- 172.21.15.3:0/2311663765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56442f917510 msgr2=0x56442f915110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:44.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.513+0000 7f7dcbe00640 1 --2- 172.21.15.3:0/2311663765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56442f917510 0x56442f915110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.514+0000 7f7dcbe00640 1 -- 172.21.15.3:0/2311663765 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56442f5e32b0 con 0x56442f90c330 2024-09-19T06:11:44.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.514+0000 7f7dd0a00640 1 --2- 172.21.15.3:0/2311663765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56442f917510 0x56442f915110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:11:44.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.514+0000 7f7dcbe00640 1 --2- 172.21.15.3:0/2311663765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f90c330 0x56442f914670 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0d6cd0 tx=0x7f7dbc009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67872139131177ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:44.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.514+0000 7f7db9600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:11:44.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.514+0000 7f7db9600640 1 -- 172.21.15.3:0/2311663765 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc09bdc0 con 0x56442f90c330 2024-09-19T06:11:44.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.514+0000 7f7db9600640 1 -- 172.21.15.3:0/2311663765 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f7dbc09a580 con 0x56442f90c330 2024-09-19T06:11:44.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.514+0000 7f7dd5401740 1 -- 172.21.15.3:0/2311663765 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dbc0d1070 con 0x56442f90c330 2024-09-19T06:11:44.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.514+0000 7f7db9600640 1 -- 172.21.15.3:0/2311663765 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7dbc09c050 con 0x56442f90c330 2024-09-19T06:11:44.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.514+0000 7f7dd5401740 10 client.14946 fetch_fsmap learned FSMap version 28 2024-09-19T06:11:44.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.514+0000 7f7dd5401740 1 -- 172.21.15.3:0/2311663765 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56442f925f00 con 0x56442f90c330 2024-09-19T06:11:44.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.515+0000 7f7db9600640 1 -- 172.21.15.3:0/2311663765 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dbc0d1070 con 0x56442f90c330 2024-09-19T06:11:44.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.515+0000 7f7db9600640 1 -- 172.21.15.3:0/2311663765 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7dbc0a0150 con 0x56442f90c330 2024-09-19T06:11:44.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.515+0000 7f7dd5401740 10 client.14946 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:11:44.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.515+0000 7f7dd5401740 10 client.14946 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:11:44.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.515+0000 7f7dd5401740 20 client.14946 populate_metadata read hostname 'smithi003' 2024-09-19T06:11:44.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.515+0000 7f7dd5401740 1 --2- 172.21.15.3:0/2311663765 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56442f927250 0x56442f9292f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:44.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.515+0000 7f7dd5401740 4 client.14946 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:11:44.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.515+0000 7f7dd5401740 1 -- 172.21.15.3:0/2311663765 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56442f87f620 con 0x56442f927250 2024-09-19T06:11:44.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.515+0000 7f7dc3400640 1 --2- 172.21.15.3:0/2311663765 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56442f927250 0x56442f9292f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:44.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.516+0000 7f7dc3400640 1 --2- 172.21.15.3:0/2311663765 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56442f927250 0x56442f9292f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23cec79da9ebf40e server_cookie=307790d9b1afe062 in_seq=0 out_seq=0 2024-09-19T06:11:44.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.516+0000 7f7db9600640 10 client.14946 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:11:44.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.517+0000 7f7db9600640 1 -- 172.21.15.3:0/2311663765 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56442f87f620 con 0x56442f927250 2024-09-19T06:11:44.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.517+0000 7f7db9600640 10 client.14946 handle_command_reply: tid=0 2024-09-19T06:11:44.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.517+0000 7f7dd5401740 1 client.14946 shutdown 2024-09-19T06:11:44.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.517+0000 7f7dd5401740 1 -- 172.21.15.3:0/2311663765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f90c330 msgr2=0x56442f914670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:44.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.517+0000 7f7dd5401740 1 --2- 172.21.15.3:0/2311663765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f90c330 0x56442f914670 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0d6cd0 tx=0x7f7dbc009310 comp rx=0 tx=0).stop 2024-09-19T06:11:44.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.517+0000 7f7dd5401740 1 -- 172.21.15.3:0/2311663765 shutdown_connections 2024-09-19T06:11:44.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.517+0000 7f7dd5401740 1 --2- 172.21.15.3:0/2311663765 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56442f927250 0x56442f9292f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.517+0000 7f7dd5401740 1 --2- 172.21.15.3:0/2311663765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56442f917510 0x56442f915110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.517+0000 7f7dd5401740 1 --2- 172.21.15.3:0/2311663765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56442f90cc50 0x56442f914bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.517+0000 7f7dd5401740 1 --2- 172.21.15.3:0/2311663765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f90c330 0x56442f914670 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.517+0000 7f7dd5401740 1 -- 172.21.15.3:0/2311663765 >> 172.21.15.3:0/2311663765 conn(0x56442f9088c0 msgr2=0x56442f90e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:44.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.517+0000 7f7db9600640 0 client.14946 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:11:44.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.517+0000 7f7dd5401740 1 -- 172.21.15.3:0/2311663765 shutdown_connections 2024-09-19T06:11:44.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.517+0000 7f7dd5401740 1 -- 172.21.15.3:0/2311663765 wait complete. 2024-09-19T06:11:44.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.518+0000 7f7dd5401740 20 client.14946 trim_cache size 0 max 16384 2024-09-19T06:11:44.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:44 smithi059 ceph-mon[35138]: pgmap v354: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:44.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.536+0000 7f7dd5401740 1 Processor -- start 2024-09-19T06:11:44.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.536+0000 7f7dd5401740 1 -- start start 2024-09-19T06:11:44.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.537+0000 7f7dd5401740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56442f90c330 0x56442f9292f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:44.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.537+0000 7f7dd5401740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56442f90cc50 0x56442f908210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:44.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.537+0000 7f7dd5401740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f917510 0x56442f913bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:44.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.537+0000 7f7dd5401740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56442f927630 con 0x56442f917510 2024-09-19T06:11:44.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.537+0000 7f7dd5401740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56442f927d00 con 0x56442f90cc50 2024-09-19T06:11:44.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.537+0000 7f7dd5401740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56442f9283d0 con 0x56442f90c330 2024-09-19T06:11:44.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.537+0000 7f7dd0a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f917510 0x56442f913bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:44.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.537+0000 7f7dd0a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f917510 0x56442f913bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46660/0 (socket says 172.21.15.3:46660) 2024-09-19T06:11:44.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.537+0000 7f7dd0a00640 1 -- 172.21.15.3:0/962497739 learned_addr learned my addr 172.21.15.3:0/962497739 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:44.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.537+0000 7f7dcbe00640 1 --2- 172.21.15.3:0/962497739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56442f90c330 0x56442f9292f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:44.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.537+0000 7f7dc3400640 1 --2- 172.21.15.3:0/962497739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56442f90cc50 0x56442f908210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:44.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.538+0000 7f7dd0a00640 1 -- 172.21.15.3:0/962497739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56442f90c330 msgr2=0x56442f9292f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:44.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.538+0000 7f7dd0a00640 1 --2- 172.21.15.3:0/962497739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56442f90c330 0x56442f9292f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.538+0000 7f7dd0a00640 1 -- 172.21.15.3:0/962497739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56442f90cc50 msgr2=0x56442f908210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:44.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.538+0000 7f7dd0a00640 1 --2- 172.21.15.3:0/962497739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56442f90cc50 0x56442f908210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.538+0000 7f7dd0a00640 1 -- 172.21.15.3:0/962497739 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56442f913620 con 0x56442f917510 2024-09-19T06:11:44.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.538+0000 7f7dcbe00640 1 --2- 172.21.15.3:0/962497739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56442f90c330 0x56442f9292f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:44.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.538+0000 7f7dc3400640 1 --2- 172.21.15.3:0/962497739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56442f90cc50 0x56442f908210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:44.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.538+0000 7f7dd0a00640 1 --2- 172.21.15.3:0/962497739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f917510 0x56442f913bb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4003d20 tx=0x7f7dc4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7fe234d9ba4838 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:44.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.538+0000 7f7dbbe00640 1 -- 172.21.15.3:0/962497739 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4003e10 con 0x56442f917510 2024-09-19T06:11:44.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.538+0000 7f7dbbe00640 1 -- 172.21.15.3:0/962497739 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dc40045c0 con 0x56442f917510 2024-09-19T06:11:44.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.538+0000 7f7dbbe00640 1 -- 172.21.15.3:0/962497739 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc401e630 con 0x56442f917510 2024-09-19T06:11:44.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.539+0000 7f7dd5401740 1 -- 172.21.15.3:0/962497739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f917510 msgr2=0x56442f913bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:44.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.539+0000 7f7dd5401740 1 --2- 172.21.15.3:0/962497739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f917510 0x56442f913bb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4003d20 tx=0x7f7dc4016000 comp rx=0 tx=0).stop 2024-09-19T06:11:44.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.539+0000 7f7dd5401740 1 -- 172.21.15.3:0/962497739 shutdown_connections 2024-09-19T06:11:44.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.539+0000 7f7dd5401740 1 --2- 172.21.15.3:0/962497739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f917510 0x56442f913bb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.539+0000 7f7dd5401740 1 --2- 172.21.15.3:0/962497739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56442f90cc50 0x56442f908210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.539+0000 7f7dd5401740 1 --2- 172.21.15.3:0/962497739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56442f90c330 0x56442f9292f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.539+0000 7f7dd5401740 1 -- 172.21.15.3:0/962497739 >> 172.21.15.3:0/962497739 conn(0x56442f9088c0 msgr2=0x56442f915ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:44.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.539+0000 7f7dd5401740 1 -- 172.21.15.3:0/962497739 shutdown_connections 2024-09-19T06:11:44.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.539+0000 7f7dd5401740 1 -- 172.21.15.3:0/962497739 wait complete. 2024-09-19T06:11:44.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.540+0000 7f7dd5401740 1 -- start start 2024-09-19T06:11:44.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.540+0000 7f7dd5401740 1 Processor -- start 2024-09-19T06:11:44.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.540+0000 7f7dd5401740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f90c330 0x56442f92b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:44.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.540+0000 7f7dd5401740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56442f90cc50 0x56442f92b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:44.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.540+0000 7f7dd5401740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56442f917510 0x56442f92bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:44.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.540+0000 7f7dd5401740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56442f929170 con 0x56442f90c330 2024-09-19T06:11:44.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.540+0000 7f7dd5401740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56442f928aa0 con 0x56442f917510 2024-09-19T06:11:44.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.540+0000 7f7dd5401740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56442f929840 con 0x56442f90cc50 2024-09-19T06:11:44.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.541+0000 7f7dd5401740 10 client.0 _ll_register_callbacks cb 0x7f7dbc0d3d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:11:44.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.541+0000 7f7dcbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f90c330 0x56442f92b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:44.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.541+0000 7f7dcbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f90c330 0x56442f92b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46674/0 (socket says 172.21.15.3:46674) 2024-09-19T06:11:44.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.541+0000 7f7dcbe00640 1 -- 172.21.15.3:0/3458761842 learned_addr learned my addr 172.21.15.3:0/3458761842 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:44.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.541+0000 7f7dd0a00640 1 --2- 172.21.15.3:0/3458761842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56442f917510 0x56442f92bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:44.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.541+0000 7f7dc3400640 1 --2- 172.21.15.3:0/3458761842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56442f90cc50 0x56442f92b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:44.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.541+0000 7f7dcbe00640 1 -- 172.21.15.3:0/3458761842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56442f90cc50 msgr2=0x56442f92b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:44.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.541+0000 7f7dcbe00640 1 --2- 172.21.15.3:0/3458761842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56442f90cc50 0x56442f92b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.541+0000 7f7dcbe00640 1 -- 172.21.15.3:0/3458761842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56442f917510 msgr2=0x56442f92bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:11:44.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.541+0000 7f7dcbe00640 1 --2- 172.21.15.3:0/3458761842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56442f917510 0x56442f92bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.541+0000 7f7dcbe00640 1 -- 172.21.15.3:0/3458761842 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56442f92fa40 con 0x56442f90c330 2024-09-19T06:11:44.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.541+0000 7f7dcbe00640 1 --2- 172.21.15.3:0/3458761842 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f90c330 0x56442f92b250 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc00c6a0 tx=0x7f7dbc0d67d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4810af7960046f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:44.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.541+0000 7f7db9600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:11:44.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.542+0000 7f7db9600640 1 -- 172.21.15.3:0/3458761842 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc09bdc0 con 0x56442f90c330 2024-09-19T06:11:44.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.542+0000 7f7db9600640 1 -- 172.21.15.3:0/3458761842 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f7dbc09a580 con 0x56442f90c330 2024-09-19T06:11:44.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.542+0000 7f7dd5401740 1 -- 172.21.15.3:0/3458761842 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dc40045c0 con 0x56442f90c330 2024-09-19T06:11:44.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.542+0000 7f7db9600640 1 -- 172.21.15.3:0/3458761842 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7dbc09bbe0 con 0x56442f90c330 2024-09-19T06:11:44.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.542+0000 7f7dd5401740 10 client.14952 fetch_fsmap learned FSMap version 28 2024-09-19T06:11:44.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.542+0000 7f7dd5401740 1 -- 172.21.15.3:0/3458761842 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56442f9927a0 con 0x56442f90c330 2024-09-19T06:11:44.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.542+0000 7f7db9600640 1 -- 172.21.15.3:0/3458761842 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dc40045c0 con 0x56442f90c330 2024-09-19T06:11:44.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.542+0000 7f7db9600640 1 -- 172.21.15.3:0/3458761842 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7dbc0a01e0 con 0x56442f90c330 2024-09-19T06:11:44.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.543+0000 7f7dd5401740 10 client.14952 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:11:44.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.543+0000 7f7dd5401740 10 client.14952 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:11:44.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.543+0000 7f7dd5401740 20 client.14952 populate_metadata read hostname 'smithi003' 2024-09-19T06:11:44.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.543+0000 7f7dd5401740 1 --2- 172.21.15.3:0/3458761842 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56442f9970f0 0x56442f995e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:44.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.543+0000 7f7dd5401740 4 client.14952 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:11:44.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.543+0000 7f7dd5401740 1 -- 172.21.15.3:0/3458761842 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "status"}) -- 0x56442f879b30 con 0x56442f9970f0 2024-09-19T06:11:44.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.543+0000 7f7dc3400640 1 --2- 172.21.15.3:0/3458761842 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56442f9970f0 0x56442f995e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:44.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.544+0000 7f7dc3400640 1 --2- 172.21.15.3:0/3458761842 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56442f9970f0 0x56442f995e00 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5271cbaa105288a server_cookie=72e898a73d5b9508 in_seq=0 out_seq=0 2024-09-19T06:11:44.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.544+0000 7f7db9600640 10 client.14952 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:11:44.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.544+0000 7f7db9600640 1 -- 172.21.15.3:0/3458761842 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x56442f879b30 con 0x56442f9970f0 2024-09-19T06:11:44.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.544+0000 7f7db9600640 10 client.14952 handle_command_reply: tid=0 2024-09-19T06:11:44.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.544+0000 7f7dd5401740 1 client.14952 shutdown 2024-09-19T06:11:44.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.544+0000 7f7dd5401740 1 -- 172.21.15.3:0/3458761842 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f90c330 msgr2=0x56442f92b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:44.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.544+0000 7f7dd5401740 1 --2- 172.21.15.3:0/3458761842 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f90c330 0x56442f92b250 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc00c6a0 tx=0x7f7dbc0d67d0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.544+0000 7f7dd5401740 1 -- 172.21.15.3:0/3458761842 shutdown_connections 2024-09-19T06:11:44.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.544+0000 7f7dd5401740 1 --2- 172.21.15.3:0/3458761842 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56442f9970f0 0x56442f995e00 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.544+0000 7f7dd5401740 1 --2- 172.21.15.3:0/3458761842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56442f917510 0x56442f92bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.544+0000 7f7dd5401740 1 --2- 172.21.15.3:0/3458761842 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56442f90cc50 0x56442f92b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.544+0000 7f7dd5401740 1 --2- 172.21.15.3:0/3458761842 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56442f90c330 0x56442f92b250 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.544+0000 7f7db9600640 0 client.14952 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:11:44.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.544+0000 7f7dd5401740 1 -- 172.21.15.3:0/3458761842 >> 172.21.15.3:0/3458761842 conn(0x56442f9088c0 msgr2=0x56442f922c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:44.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.544+0000 7f7dd5401740 1 -- 172.21.15.3:0/3458761842 shutdown_connections 2024-09-19T06:11:44.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.545+0000 7f7dd5401740 1 -- 172.21.15.3:0/3458761842 wait complete. 2024-09-19T06:11:44.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.545+0000 7f7dd5401740 20 client.14952 trim_cache size 0 max 16384 2024-09-19T06:11:44.550 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:11:44.550 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "782a5144-764c-11ef-bceb-c7b262605968", 2024-09-19T06:11:44.550 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 0, 2024-09-19T06:11:44.550 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 24557, 2024-09-19T06:11:44.551 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2024-09-19T06:11:44.551 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2024-09-19T06:11:44.551 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2024-09-19T06:11:44.551 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 100.028199026, 2024-09-19T06:11:44.551 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 28, 2024-09-19T06:11:44.551 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 88, 2024-09-19T06:11:44.551 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 86, 2024-09-19T06:11:44.551 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 114.56623594600001 2024-09-19T06:11:44.551 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:11:44.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.545+0000 7f7dd2a00640 1 -- 172.21.15.3:0/3883037218 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f7db00a3350 msgr2=0x7f7db00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:44.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.545+0000 7f7dd2a00640 1 --2- 172.21.15.3:0/3883037218 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f7db00a3350 0x7f7db00a5810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4005fd0 tx=0x7f7dc4009500 comp rx=0 tx=0).stop 2024-09-19T06:11:44.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.545+0000 7f7dd2a00640 1 -- 172.21.15.3:0/3883037218 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dcc101de0 msgr2=0x7f7dcc19a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:44.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.545+0000 7f7dd2a00640 1 --2- 172.21.15.3:0/3883037218 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dcc101de0 0x7f7dcc19a630 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc00e9f0 tx=0x7f7dbc00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.545+0000 7f7dd2a00640 1 -- 172.21.15.3:0/3883037218 shutdown_connections 2024-09-19T06:11:44.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.545+0000 7f7dd2a00640 1 --2- 172.21.15.3:0/3883037218 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f7db00a3350 0x7f7db00a5810 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.545+0000 7f7dd2a00640 1 --2- 172.21.15.3:0/3883037218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dcc106f10 0x7f7dcc19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.545+0000 7f7dd2a00640 1 --2- 172.21.15.3:0/3883037218 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dcc102790 0x7f7dcc19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.545+0000 7f7dd2a00640 1 --2- 172.21.15.3:0/3883037218 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dcc101de0 0x7f7dcc19a630 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:44.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.545+0000 7f7dd2a00640 1 -- 172.21.15.3:0/3883037218 >> 172.21.15.3:0/3883037218 conn(0x7f7dcc0fd8c0 msgr2=0x7f7dcc0feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:44.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.546+0000 7f7dd2a00640 1 -- 172.21.15.3:0/3883037218 shutdown_connections 2024-09-19T06:11:44.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:44.546+0000 7f7dd2a00640 1 -- 172.21.15.3:0/3883037218 wait complete. 2024-09-19T06:11:45.444 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T06:11:45.444 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T06:11:45.454 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi003.front.sepia.ceph.com 2024-09-19T06:11:45.455 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T06:11:45.831 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:46.237 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:46 smithi003 ceph-mon[30893]: pgmap v355: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:46.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:46 smithi071 ceph-mon[35662]: pgmap v355: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:46.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.470+0000 7f1511600640 1 -- 172.21.15.3:0/3220138963 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f150c101c00 msgr2=0x7f150c102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:46.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.470+0000 7f1511600640 1 --2- 172.21.15.3:0/3220138963 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f150c101c00 0x7f150c102000 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f14fc009900 tx=0x7f14fc02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:11:46.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.470+0000 7f1511600640 1 -- 172.21.15.3:0/3220138963 shutdown_connections 2024-09-19T06:11:46.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.470+0000 7f1511600640 1 --2- 172.21.15.3:0/3220138963 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f150c1037c0 0x7f150c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:46.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.470+0000 7f1511600640 1 --2- 172.21.15.3:0/3220138963 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f150c102e00 0x7f150c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:46.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.470+0000 7f1511600640 1 --2- 172.21.15.3:0/3220138963 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f150c101c00 0x7f150c102000 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:46.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.470+0000 7f1511600640 1 -- 172.21.15.3:0/3220138963 >> 172.21.15.3:0/3220138963 conn(0x7f150c0fd390 msgr2=0x7f150c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:46.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.471+0000 7f1511600640 1 -- 172.21.15.3:0/3220138963 shutdown_connections 2024-09-19T06:11:46.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.471+0000 7f1511600640 1 -- 172.21.15.3:0/3220138963 wait complete. 2024-09-19T06:11:46.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.472+0000 7f1511600640 1 Processor -- start 2024-09-19T06:11:46.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.472+0000 7f1511600640 1 -- start start 2024-09-19T06:11:46.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.472+0000 7f1511600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f150c101c00 0x7f150c075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:46.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.472+0000 7f1511600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f150c102e00 0x7f150c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:46.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.472+0000 7f1511600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f150c1037c0 0x7f150c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:46.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.472+0000 7f1511600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f150c10d8b0 con 0x7f150c101c00 2024-09-19T06:11:46.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.472+0000 7f1511600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f150c10d730 con 0x7f150c102e00 2024-09-19T06:11:46.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.472+0000 7f1511600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f150c10da30 con 0x7f150c1037c0 2024-09-19T06:11:46.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.473+0000 7f150aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f150c101c00 0x7f150c075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:46.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.473+0000 7f150aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f150c101c00 0x7f150c075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46690/0 (socket says 172.21.15.3:46690) 2024-09-19T06:11:46.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.473+0000 7f150a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f150c102e00 0x7f150c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:46.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.473+0000 7f150aa00640 1 -- 172.21.15.3:0/3447897972 learned_addr learned my addr 172.21.15.3:0/3447897972 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:46.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.473+0000 7f150b400640 1 --2- 172.21.15.3:0/3447897972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f150c1037c0 0x7f150c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:46.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.473+0000 7f150aa00640 1 -- 172.21.15.3:0/3447897972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f150c1037c0 msgr2=0x7f150c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:46.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.473+0000 7f150aa00640 1 --2- 172.21.15.3:0/3447897972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f150c1037c0 0x7f150c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:46.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.473+0000 7f150aa00640 1 -- 172.21.15.3:0/3447897972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f150c102e00 msgr2=0x7f150c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:46.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.473+0000 7f150aa00640 1 --2- 172.21.15.3:0/3447897972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f150c102e00 0x7f150c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:46.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.473+0000 7f150aa00640 1 -- 172.21.15.3:0/3447897972 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f150c0753e0 con 0x7f150c101c00 2024-09-19T06:11:46.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.473+0000 7f150b400640 1 --2- 172.21.15.3:0/3447897972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f150c1037c0 0x7f150c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:11:46.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.473+0000 7f150a000640 1 --2- 172.21.15.3:0/3447897972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f150c102e00 0x7f150c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:46.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.474+0000 7f150aa00640 1 --2- 172.21.15.3:0/3447897972 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f150c101c00 0x7f150c075f90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f14fc031440 tx=0x7f14fc032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:46.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.474+0000 7f1503400640 1 -- 172.21.15.3:0/3447897972 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc03f030 con 0x7f150c101c00 2024-09-19T06:11:46.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.474+0000 7f1503400640 1 -- 172.21.15.3:0/3447897972 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14fc003ce0 con 0x7f150c101c00 2024-09-19T06:11:46.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.474+0000 7f1511600640 1 -- 172.21.15.3:0/3447897972 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f150c1a2000 con 0x7f150c101c00 2024-09-19T06:11:46.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.474+0000 7f1503400640 1 -- 172.21.15.3:0/3447897972 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc035070 con 0x7f150c101c00 2024-09-19T06:11:46.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.474+0000 7f1511600640 1 -- 172.21.15.3:0/3447897972 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f150c1a24b0 con 0x7f150c101c00 2024-09-19T06:11:46.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.475+0000 7f1511600640 1 -- 172.21.15.3:0/3447897972 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f150c108fd0 con 0x7f150c101c00 2024-09-19T06:11:46.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.477+0000 7f1503400640 1 -- 172.21.15.3:0/3447897972 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f14fc042030 con 0x7f150c101c00 2024-09-19T06:11:46.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.478+0000 7f1503400640 1 --2- 172.21.15.3:0/3447897972 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f14f00a32d0 0x7f14f00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:46.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.478+0000 7f1503400640 1 -- 172.21.15.3:0/3447897972 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f14fc0f00e0 con 0x7f150c101c00 2024-09-19T06:11:46.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.479+0000 7f150a000640 1 --2- 172.21.15.3:0/3447897972 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f14f00a32d0 0x7f14f00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:46.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.479+0000 7f150a000640 1 --2- 172.21.15.3:0/3447897972 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f14f00a32d0 0x7f14f00a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f150c075d10 tx=0x7f14f800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:46.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.483+0000 7f1503400640 1 -- 172.21.15.3:0/3447897972 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f14fc0bcc20 con 0x7f150c101c00 2024-09-19T06:11:46.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:46 smithi059 ceph-mon[35138]: pgmap v355: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:46.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.689+0000 7f1511600640 1 -- 172.21.15.3:0/3447897972 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f150c062630 con 0x7f14f00a32d0 2024-09-19T06:11:46.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.690+0000 7f1503400640 1 -- 172.21.15.3:0/3447897972 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f150c062630 con 0x7f14f00a32d0 2024-09-19T06:11:46.692 INFO:teuthology.orchestra.run.smithi003.stdout:Backend: cephadm 2024-09-19T06:11:46.692 INFO:teuthology.orchestra.run.smithi003.stdout:Available: Yes 2024-09-19T06:11:46.692 INFO:teuthology.orchestra.run.smithi003.stdout:Paused: No 2024-09-19T06:11:46.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.692+0000 7f1511600640 1 -- 172.21.15.3:0/3447897972 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f14f00a32d0 msgr2=0x7f14f00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:46.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.692+0000 7f1511600640 1 --2- 172.21.15.3:0/3447897972 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f14f00a32d0 0x7f14f00a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f150c075d10 tx=0x7f14f800b410 comp rx=0 tx=0).stop 2024-09-19T06:11:46.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.692+0000 7f1511600640 1 -- 172.21.15.3:0/3447897972 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f150c101c00 msgr2=0x7f150c075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:46.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.692+0000 7f1511600640 1 --2- 172.21.15.3:0/3447897972 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f150c101c00 0x7f150c075f90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f14fc031440 tx=0x7f14fc032ce0 comp rx=0 tx=0).stop 2024-09-19T06:11:46.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.692+0000 7f1511600640 1 -- 172.21.15.3:0/3447897972 shutdown_connections 2024-09-19T06:11:46.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.692+0000 7f1511600640 1 --2- 172.21.15.3:0/3447897972 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f14f00a32d0 0x7f14f00a5790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:46.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.692+0000 7f1511600640 1 --2- 172.21.15.3:0/3447897972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f150c1037c0 0x7f150c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:46.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.692+0000 7f1511600640 1 --2- 172.21.15.3:0/3447897972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f150c102e00 0x7f150c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:46.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.692+0000 7f1511600640 1 --2- 172.21.15.3:0/3447897972 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f150c101c00 0x7f150c075f90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:46.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.692+0000 7f1511600640 1 -- 172.21.15.3:0/3447897972 >> 172.21.15.3:0/3447897972 conn(0x7f150c0fd390 msgr2=0x7f150c1061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:46.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.693+0000 7f1511600640 1 -- 172.21.15.3:0/3447897972 shutdown_connections 2024-09-19T06:11:46.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:46.693+0000 7f1511600640 1 -- 172.21.15.3:0/3447897972 wait complete. 2024-09-19T06:11:47.631 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T06:11:48.009 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:48.321 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:48 smithi003 ceph-mon[30893]: pgmap v356: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:11:48.321 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:48 smithi003 ceph-mon[30893]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:11:48.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:48 smithi071 ceph-mon[35662]: pgmap v356: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:11:48.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:48 smithi071 ceph-mon[35662]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:11:48.340 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:48 smithi059 ceph-mon[35138]: pgmap v356: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:11:48.341 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:48 smithi059 ceph-mon[35138]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:11:48.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.606+0000 7fee1d000640 1 -- 172.21.15.3:0/446312450 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee18102e00 msgr2=0x7fee18103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:48.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.606+0000 7fee1d000640 1 --2- 172.21.15.3:0/446312450 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee18102e00 0x7fee18103280 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fee00009900 tx=0x7fee0002a410 comp rx=0 tx=0).stop 2024-09-19T06:11:48.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.606+0000 7fee1d000640 1 -- 172.21.15.3:0/446312450 shutdown_connections 2024-09-19T06:11:48.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.606+0000 7fee1d000640 1 --2- 172.21.15.3:0/446312450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee181037c0 0x7fee1810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:48.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.606+0000 7fee1d000640 1 --2- 172.21.15.3:0/446312450 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee18102e00 0x7fee18103280 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:48.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.606+0000 7fee1d000640 1 --2- 172.21.15.3:0/446312450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee18101c00 0x7fee18102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:48.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.606+0000 7fee1d000640 1 -- 172.21.15.3:0/446312450 >> 172.21.15.3:0/446312450 conn(0x7fee180fd390 msgr2=0x7fee180ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:48.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.606+0000 7fee1d000640 1 -- 172.21.15.3:0/446312450 shutdown_connections 2024-09-19T06:11:48.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.606+0000 7fee1d000640 1 -- 172.21.15.3:0/446312450 wait complete. 2024-09-19T06:11:48.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.607+0000 7fee1d000640 1 Processor -- start 2024-09-19T06:11:48.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.607+0000 7fee1d000640 1 -- start start 2024-09-19T06:11:48.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.608+0000 7fee1d000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee18101c00 0x7fee1819a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:48.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.608+0000 7fee1d000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee18102e00 0x7fee1819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:48.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.608+0000 7fee1d000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee181037c0 0x7fee181a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:48.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.608+0000 7fee1d000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fee1810d860 con 0x7fee18102e00 2024-09-19T06:11:48.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.608+0000 7fee1d000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fee1810d6e0 con 0x7fee18101c00 2024-09-19T06:11:48.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.608+0000 7fee1d000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fee1810d9e0 con 0x7fee181037c0 2024-09-19T06:11:48.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.608+0000 7fee15e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee18101c00 0x7fee1819a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:48.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.608+0000 7fee0fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee18102e00 0x7fee1819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:48.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.608+0000 7fee15e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee18101c00 0x7fee1819a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55502/0 (socket says 172.21.15.3:55502) 2024-09-19T06:11:48.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.608+0000 7fee15e00640 1 -- 172.21.15.3:0/2326117391 learned_addr learned my addr 172.21.15.3:0/2326117391 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:48.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.608+0000 7fee16800640 1 --2- 172.21.15.3:0/2326117391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee181037c0 0x7fee181a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:48.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.609+0000 7fee15e00640 1 -- 172.21.15.3:0/2326117391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee181037c0 msgr2=0x7fee181a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:48.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.609+0000 7fee15e00640 1 --2- 172.21.15.3:0/2326117391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee181037c0 0x7fee181a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:48.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.609+0000 7fee15e00640 1 -- 172.21.15.3:0/2326117391 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee18102e00 msgr2=0x7fee1819a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:48.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.609+0000 7fee15e00640 1 --2- 172.21.15.3:0/2326117391 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee18102e00 0x7fee1819a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:48.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.609+0000 7fee15e00640 1 -- 172.21.15.3:0/2326117391 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee181a1d40 con 0x7fee18101c00 2024-09-19T06:11:48.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.609+0000 7fee15e00640 1 --2- 172.21.15.3:0/2326117391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee18101c00 0x7fee1819a110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fee0800e9c0 tx=0x7fee0800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:48.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.609+0000 7fee0ea00640 1 -- 172.21.15.3:0/2326117391 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0800cd80 con 0x7fee18101c00 2024-09-19T06:11:48.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.609+0000 7fee0ea00640 1 -- 172.21.15.3:0/2326117391 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee080035f0 con 0x7fee18101c00 2024-09-19T06:11:48.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.609+0000 7fee1d000640 1 -- 172.21.15.3:0/2326117391 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee181a1fd0 con 0x7fee18101c00 2024-09-19T06:11:48.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.609+0000 7fee0ea00640 1 -- 172.21.15.3:0/2326117391 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee08010690 con 0x7fee18101c00 2024-09-19T06:11:48.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.609+0000 7fee1d000640 1 -- 172.21.15.3:0/2326117391 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee181a2480 con 0x7fee18101c00 2024-09-19T06:11:48.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.610+0000 7fee1d000640 1 -- 172.21.15.3:0/2326117391 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee181a2710 con 0x7fee18101c00 2024-09-19T06:11:48.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.613+0000 7fee0ea00640 1 -- 172.21.15.3:0/2326117391 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fee080037a0 con 0x7fee18101c00 2024-09-19T06:11:48.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.614+0000 7fee0ea00640 1 --2- 172.21.15.3:0/2326117391 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fedfc0a3300 0x7fedfc0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:48.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.614+0000 7fee0ea00640 1 -- 172.21.15.3:0/2326117391 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fee080cff10 con 0x7fee18101c00 2024-09-19T06:11:48.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.614+0000 7fee0fe00640 1 --2- 172.21.15.3:0/2326117391 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fedfc0a3300 0x7fedfc0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:48.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.615+0000 7fee0fe00640 1 --2- 172.21.15.3:0/2326117391 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fedfc0a3300 0x7fedfc0a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fee000314e0 tx=0x7fee00000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:48.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.616+0000 7fee0ea00640 1 -- 172.21.15.3:0/2326117391 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fee0809cae0 con 0x7fee18101c00 2024-09-19T06:11:48.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.814+0000 7fee1d000640 1 -- 172.21.15.3:0/2326117391 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fee181a28e0 con 0x7fedfc0a3300 2024-09-19T06:11:48.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.826+0000 7fee0ea00640 1 -- 172.21.15.3:0/2326117391 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7fee181a28e0 con 0x7fedfc0a3300 2024-09-19T06:11:48.829 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:11:48.829 INFO:teuthology.orchestra.run.smithi003.stdout:mds.a smithi003 running (2m) 27s ago 2m 16.4M - 19.1.1-361-g2f599a46 d2baa855c067 4d6e68aabb92 2024-09-19T06:11:48.829 INFO:teuthology.orchestra.run.smithi003.stdout:mds.b smithi059 running (119s) 48s ago 118s 26.5M - 19.1.1-361-g2f599a46 d2baa855c067 ffa8ccde8f87 2024-09-19T06:11:48.829 INFO:teuthology.orchestra.run.smithi003.stdout:mds.c smithi071 running (2m) 48s ago 2m 17.6M - 19.1.1-361-g2f599a46 d2baa855c067 1f1909f6bdaa 2024-09-19T06:11:48.829 INFO:teuthology.orchestra.run.smithi003.stdout:mds.d smithi003 running (2m) 27s ago 2m 12.7M - 19.1.1-361-g2f599a46 d2baa855c067 8fac3f5192b4 2024-09-19T06:11:48.829 INFO:teuthology.orchestra.run.smithi003.stdout:mds.e smithi059 running (2m) 48s ago 2m 16.6M - 19.1.1-361-g2f599a46 d2baa855c067 c0017ef5992f 2024-09-19T06:11:48.830 INFO:teuthology.orchestra.run.smithi003.stdout:mds.f smithi071 running (2m) 48s ago 2m 19.3M - 19.1.1-361-g2f599a46 d2baa855c067 1753bbb0dc9f 2024-09-19T06:11:48.830 INFO:teuthology.orchestra.run.smithi003.stdout:mds.g smithi003 running (2m) 27s ago 2m 15.2M - 19.1.1-361-g2f599a46 d2baa855c067 1f73e7768b6c 2024-09-19T06:11:48.830 INFO:teuthology.orchestra.run.smithi003.stdout:mds.h smithi059 running (2m) 48s ago 2m 18.1M - 19.1.1-361-g2f599a46 d2baa855c067 531d5cd8bc40 2024-09-19T06:11:48.830 INFO:teuthology.orchestra.run.smithi003.stdout:mds.i smithi071 running (2m) 48s ago 2m 18.6M - 19.1.1-361-g2f599a46 d2baa855c067 027efa936dc3 2024-09-19T06:11:48.830 INFO:teuthology.orchestra.run.smithi003.stdout:mds.j smithi003 running (2m) 27s ago 2m 12.8M - 19.1.1-361-g2f599a46 d2baa855c067 ec843aefa2aa 2024-09-19T06:11:48.830 INFO:teuthology.orchestra.run.smithi003.stdout:mds.k smithi059 running (2m) 48s ago 2m 15.9M - 19.1.1-361-g2f599a46 d2baa855c067 59be01e6c866 2024-09-19T06:11:48.830 INFO:teuthology.orchestra.run.smithi003.stdout:mds.l smithi071 running (2m) 48s ago 2m 19.1M - 19.1.1-361-g2f599a46 d2baa855c067 bf30b1269f5f 2024-09-19T06:11:48.830 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.x smithi003 *:9283,8765 running (10m) 27s ago 10m 509M - 19.1.1-361-g2f599a46 d2baa855c067 0f74198e9686 2024-09-19T06:11:48.830 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.y smithi059 *:8443,8765 running (8m) 48s ago 8m 442M - 19.1.1-361-g2f599a46 d2baa855c067 98ccaf64235e 2024-09-19T06:11:48.830 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.z smithi071 *:8443,8765 running (8m) 48s ago 8m 444M - 19.1.1-361-g2f599a46 d2baa855c067 c9c913e309fb 2024-09-19T06:11:48.831 INFO:teuthology.orchestra.run.smithi003.stdout:mon.a smithi003 running (10m) 27s ago 10m 48.6M 2048M 19.1.1-361-g2f599a46 d2baa855c067 c484d090f876 2024-09-19T06:11:48.831 INFO:teuthology.orchestra.run.smithi003.stdout:mon.b smithi059 running (8m) 48s ago 8m 44.1M 2048M 19.1.1-361-g2f599a46 d2baa855c067 db4bd5ba039d 2024-09-19T06:11:48.831 INFO:teuthology.orchestra.run.smithi003.stdout:mon.c smithi071 running (8m) 48s ago 8m 42.3M 2048M 19.1.1-361-g2f599a46 d2baa855c067 f634a5a1238b 2024-09-19T06:11:48.831 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (7m) 27s ago 7m 54.6M 4273M 19.1.1-361-g2f599a46 d2baa855c067 239c7b5837fc 2024-09-19T06:11:48.831 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi059 running (7m) 48s ago 7m 48.3M 4273M 19.1.1-361-g2f599a46 d2baa855c067 7e462337ccb1 2024-09-19T06:11:48.831 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi071 running (7m) 48s ago 7m 48.8M 4272M 19.1.1-361-g2f599a46 d2baa855c067 59320f4f7697 2024-09-19T06:11:48.831 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi003 running (6m) 27s ago 6m 53.4M 4273M 19.1.1-361-g2f599a46 d2baa855c067 be8e2ea0992a 2024-09-19T06:11:48.831 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi059 running (6m) 48s ago 6m 56.0M 4273M 19.1.1-361-g2f599a46 d2baa855c067 a9d942a0c72f 2024-09-19T06:11:48.831 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi071 running (5m) 48s ago 5m 46.1M 4272M 19.1.1-361-g2f599a46 d2baa855c067 a60fc85becd7 2024-09-19T06:11:48.831 INFO:teuthology.orchestra.run.smithi003.stdout:osd.6 smithi003 running (5m) 27s ago 5m 51.6M 4273M 19.1.1-361-g2f599a46 d2baa855c067 7f4b7c8eb30b 2024-09-19T06:11:48.831 INFO:teuthology.orchestra.run.smithi003.stdout:osd.7 smithi059 running (4m) 48s ago 4m 54.1M 4273M 19.1.1-361-g2f599a46 d2baa855c067 9ad009e6fe8b 2024-09-19T06:11:48.831 INFO:teuthology.orchestra.run.smithi003.stdout:osd.8 smithi071 running (4m) 48s ago 4m 54.2M 4272M 19.1.1-361-g2f599a46 d2baa855c067 bbac22e30d40 2024-09-19T06:11:48.831 INFO:teuthology.orchestra.run.smithi003.stdout:osd.9 smithi003 running (3m) 27s ago 3m 50.7M 4273M 19.1.1-361-g2f599a46 d2baa855c067 8fcd2e30972f 2024-09-19T06:11:48.832 INFO:teuthology.orchestra.run.smithi003.stdout:osd.10 smithi059 running (3m) 48s ago 3m 44.0M 4273M 19.1.1-361-g2f599a46 d2baa855c067 ee0e330b8a54 2024-09-19T06:11:48.832 INFO:teuthology.orchestra.run.smithi003.stdout:osd.11 smithi071 running (2m) 48s ago 2m 42.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 7f0808a68d96 2024-09-19T06:11:48.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.828+0000 7fee1d000640 1 -- 172.21.15.3:0/2326117391 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fedfc0a3300 msgr2=0x7fedfc0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:48.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.829+0000 7fee1d000640 1 --2- 172.21.15.3:0/2326117391 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fedfc0a3300 0x7fedfc0a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fee000314e0 tx=0x7fee00000bc0 comp rx=0 tx=0).stop 2024-09-19T06:11:48.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.829+0000 7fee1d000640 1 -- 172.21.15.3:0/2326117391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee18101c00 msgr2=0x7fee1819a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:48.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.829+0000 7fee1d000640 1 --2- 172.21.15.3:0/2326117391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee18101c00 0x7fee1819a110 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fee0800e9c0 tx=0x7fee0800ee80 comp rx=0 tx=0).stop 2024-09-19T06:11:48.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.829+0000 7fee1d000640 1 -- 172.21.15.3:0/2326117391 shutdown_connections 2024-09-19T06:11:48.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.829+0000 7fee1d000640 1 --2- 172.21.15.3:0/2326117391 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fedfc0a3300 0x7fedfc0a57c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:48.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.829+0000 7fee1d000640 1 --2- 172.21.15.3:0/2326117391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fee181037c0 0x7fee181a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:48.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.829+0000 7fee1d000640 1 --2- 172.21.15.3:0/2326117391 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee18102e00 0x7fee1819a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:48.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.829+0000 7fee1d000640 1 --2- 172.21.15.3:0/2326117391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee18101c00 0x7fee1819a110 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:48.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.829+0000 7fee1d000640 1 -- 172.21.15.3:0/2326117391 >> 172.21.15.3:0/2326117391 conn(0x7fee180fd390 msgr2=0x7fee181085d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:48.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.829+0000 7fee1d000640 1 -- 172.21.15.3:0/2326117391 shutdown_connections 2024-09-19T06:11:48.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:48.829+0000 7fee1d000640 1 -- 172.21.15.3:0/2326117391 wait complete. 2024-09-19T06:11:49.664 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T06:11:50.044 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:50.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:50 smithi003 ceph-mon[30893]: pgmap v357: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:50 smithi003 ceph-mon[30893]: from='client.24995 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:11:50.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:50 smithi071 ceph-mon[35662]: pgmap v357: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:50.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:50 smithi071 ceph-mon[35662]: from='client.24995 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:11:50.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:50 smithi059 ceph-mon[35138]: pgmap v357: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:50.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:50 smithi059 ceph-mon[35138]: from='client.24995 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:11:50.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.654+0000 7f89ec800640 1 -- 172.21.15.3:0/555697883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89e4102e00 msgr2=0x7f89e4103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:50.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.654+0000 7f89ec800640 1 --2- 172.21.15.3:0/555697883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89e4102e00 0x7f89e4103280 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009900 tx=0x7f89d402a410 comp rx=0 tx=0).stop 2024-09-19T06:11:50.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.654+0000 7f89ec800640 1 -- 172.21.15.3:0/555697883 shutdown_connections 2024-09-19T06:11:50.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.654+0000 7f89ec800640 1 --2- 172.21.15.3:0/555697883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89e41037c0 0x7f89e410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:50.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.654+0000 7f89ec800640 1 --2- 172.21.15.3:0/555697883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89e4102e00 0x7f89e4103280 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:50.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.654+0000 7f89ec800640 1 --2- 172.21.15.3:0/555697883 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89e4101c00 0x7f89e4102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:50.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.654+0000 7f89ec800640 1 -- 172.21.15.3:0/555697883 >> 172.21.15.3:0/555697883 conn(0x7f89e40fd390 msgr2=0x7f89e40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:50.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.654+0000 7f89ec800640 1 -- 172.21.15.3:0/555697883 shutdown_connections 2024-09-19T06:11:50.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.655+0000 7f89ec800640 1 -- 172.21.15.3:0/555697883 wait complete. 2024-09-19T06:11:50.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.656+0000 7f89ec800640 1 Processor -- start 2024-09-19T06:11:50.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.656+0000 7f89ec800640 1 -- start start 2024-09-19T06:11:50.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.656+0000 7f89ec800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89e4101c00 0x7f89e419a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:50.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.656+0000 7f89ec800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89e4102e00 0x7f89e419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:50.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.656+0000 7f89ec800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89e41037c0 0x7f89e41a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:50.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.656+0000 7f89ec800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f89e410d880 con 0x7f89e41037c0 2024-09-19T06:11:50.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.656+0000 7f89ec800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f89e410d700 con 0x7f89e4101c00 2024-09-19T06:11:50.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.656+0000 7f89ec800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f89e410da00 con 0x7f89e4102e00 2024-09-19T06:11:50.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.656+0000 7f89e9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89e4101c00 0x7f89e419a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:50.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.656+0000 7f89e9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89e4101c00 0x7f89e419a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55518/0 (socket says 172.21.15.3:55518) 2024-09-19T06:11:50.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.656+0000 7f89e9e00640 1 -- 172.21.15.3:0/2371774775 learned_addr learned my addr 172.21.15.3:0/2371774775 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:50.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.656+0000 7f89ea800640 1 --2- 172.21.15.3:0/2371774775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89e41037c0 0x7f89e41a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:50.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.657+0000 7f89e9400640 1 --2- 172.21.15.3:0/2371774775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89e4102e00 0x7f89e419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:50.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.657+0000 7f89e9e00640 1 -- 172.21.15.3:0/2371774775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89e4102e00 msgr2=0x7f89e419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:50.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.657+0000 7f89e9e00640 1 --2- 172.21.15.3:0/2371774775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89e4102e00 0x7f89e419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:50.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.657+0000 7f89e9e00640 1 -- 172.21.15.3:0/2371774775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89e41037c0 msgr2=0x7f89e41a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:50.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.657+0000 7f89e9e00640 1 --2- 172.21.15.3:0/2371774775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89e41037c0 0x7f89e41a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:50.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.657+0000 7f89e9e00640 1 -- 172.21.15.3:0/2371774775 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e41a1d10 con 0x7f89e4101c00 2024-09-19T06:11:50.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.657+0000 7f89e9400640 1 --2- 172.21.15.3:0/2371774775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89e4102e00 0x7f89e419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:11:50.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.657+0000 7f89e9e00640 1 --2- 172.21.15.3:0/2371774775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89e4101c00 0x7f89e419a0e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f89d800e9c0 tx=0x7f89d800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:50.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.657+0000 7f89dea00640 1 -- 172.21.15.3:0/2371774775 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d800cd80 con 0x7f89e4101c00 2024-09-19T06:11:50.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.657+0000 7f89dea00640 1 -- 172.21.15.3:0/2371774775 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89d80035f0 con 0x7f89e4101c00 2024-09-19T06:11:50.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.657+0000 7f89ec800640 1 -- 172.21.15.3:0/2371774775 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e41a1fa0 con 0x7f89e4101c00 2024-09-19T06:11:50.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.657+0000 7f89dea00640 1 -- 172.21.15.3:0/2371774775 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d8010690 con 0x7f89e4101c00 2024-09-19T06:11:50.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.657+0000 7f89ec800640 1 -- 172.21.15.3:0/2371774775 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e41a24a0 con 0x7f89e4101c00 2024-09-19T06:11:50.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.658+0000 7f89ec800640 1 -- 172.21.15.3:0/2371774775 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89e41a2730 con 0x7f89e4101c00 2024-09-19T06:11:50.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.660+0000 7f89dea00640 1 -- 172.21.15.3:0/2371774775 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f89d80037a0 con 0x7f89e4101c00 2024-09-19T06:11:50.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.662+0000 7f89dea00640 1 --2- 172.21.15.3:0/2371774775 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f89cc0a3380 0x7f89cc0a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:50.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.662+0000 7f89dea00640 1 -- 172.21.15.3:0/2371774775 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f89d80cff10 con 0x7f89e4101c00 2024-09-19T06:11:50.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.662+0000 7f89e9400640 1 --2- 172.21.15.3:0/2371774775 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f89cc0a3380 0x7f89cc0a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:50.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.663+0000 7f89e9400640 1 --2- 172.21.15.3:0/2371774775 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f89cc0a3380 0x7f89cc0a5840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f89d4000c00 tx=0x7f89d40095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:50.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.664+0000 7f89dea00640 1 -- 172.21.15.3:0/2371774775 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f89d809cb40 con 0x7f89e4101c00 2024-09-19T06:11:50.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.857+0000 7f89ec800640 1 -- 172.21.15.3:0/2371774775 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f89e41a2900 con 0x7f89cc0a3380 2024-09-19T06:11:50.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.863+0000 7f89dea00640 1 -- 172.21.15.3:0/2371774775 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f89e41a2900 con 0x7f89cc0a3380 2024-09-19T06:11:50.864 INFO:teuthology.orchestra.run.smithi003.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T06:11:50.864 INFO:teuthology.orchestra.run.smithi003.stdout:mds.all 12/12 50s ago 2m smithi003=a;smithi003=d;smithi003=g;smithi003=j;smithi059=b;smithi059=e;smithi059=h;smithi059=k;smithi071=c;smithi071=f;smithi071=i;smithi071=l;count:12 2024-09-19T06:11:50.864 INFO:teuthology.orchestra.run.smithi003.stdout:mgr 3/3 50s ago 8m smithi003=x;smithi059=y;smithi071=z;count:3 2024-09-19T06:11:50.864 INFO:teuthology.orchestra.run.smithi003.stdout:mon 3/3 50s ago 8m smithi003:172.21.15.3=a;smithi059:172.21.15.59=b;smithi071:172.21.15.71=c;count:3 2024-09-19T06:11:50.864 INFO:teuthology.orchestra.run.smithi003.stdout:osd 12 50s ago - 2024-09-19T06:11:50.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.865+0000 7f89ec800640 1 -- 172.21.15.3:0/2371774775 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f89cc0a3380 msgr2=0x7f89cc0a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:50.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.865+0000 7f89ec800640 1 --2- 172.21.15.3:0/2371774775 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f89cc0a3380 0x7f89cc0a5840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f89d4000c00 tx=0x7f89d40095f0 comp rx=0 tx=0).stop 2024-09-19T06:11:50.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.865+0000 7f89ec800640 1 -- 172.21.15.3:0/2371774775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89e4101c00 msgr2=0x7f89e419a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:50.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.865+0000 7f89ec800640 1 --2- 172.21.15.3:0/2371774775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89e4101c00 0x7f89e419a0e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f89d800e9c0 tx=0x7f89d800ee80 comp rx=0 tx=0).stop 2024-09-19T06:11:50.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.866+0000 7f89ec800640 1 -- 172.21.15.3:0/2371774775 shutdown_connections 2024-09-19T06:11:50.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.866+0000 7f89ec800640 1 --2- 172.21.15.3:0/2371774775 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f89cc0a3380 0x7f89cc0a5840 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:50.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.866+0000 7f89ec800640 1 --2- 172.21.15.3:0/2371774775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89e41037c0 0x7f89e41a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:50.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.866+0000 7f89ec800640 1 --2- 172.21.15.3:0/2371774775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89e4102e00 0x7f89e419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:50.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.866+0000 7f89ec800640 1 --2- 172.21.15.3:0/2371774775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89e4101c00 0x7f89e419a0e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:50.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.866+0000 7f89ec800640 1 -- 172.21.15.3:0/2371774775 >> 172.21.15.3:0/2371774775 conn(0x7f89e40fd390 msgr2=0x7f89e4074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:50.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.866+0000 7f89ec800640 1 -- 172.21.15.3:0/2371774775 shutdown_connections 2024-09-19T06:11:50.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:50.866+0000 7f89ec800640 1 -- 172.21.15.3:0/2371774775 wait complete. 2024-09-19T06:11:51.713 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T06:11:52.093 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:52.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:52 smithi003 ceph-mon[30893]: pgmap v358: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:52.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:52 smithi003 ceph-mon[30893]: from='client.25001 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:11:52.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:52 smithi071 ceph-mon[35662]: pgmap v358: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:52.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:52 smithi071 ceph-mon[35662]: from='client.25001 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:11:52.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:52 smithi059 ceph-mon[35138]: pgmap v358: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:52.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:52 smithi059 ceph-mon[35138]: from='client.25001 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:11:52.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.658+0000 7f0501800640 1 -- 172.21.15.3:0/3414690882 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04fc104f60 msgr2=0x7f04fc1053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:52.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.658+0000 7f0501800640 1 --2- 172.21.15.3:0/3414690882 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04fc104f60 0x7f04fc1053e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f04e4009900 tx=0x7f04e402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:11:52.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.658+0000 7f0501800640 1 -- 172.21.15.3:0/3414690882 shutdown_connections 2024-09-19T06:11:52.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.658+0000 7f0501800640 1 --2- 172.21.15.3:0/3414690882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04fc105920 0x7f04fc10c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:52.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.658+0000 7f0501800640 1 --2- 172.21.15.3:0/3414690882 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04fc104f60 0x7f04fc1053e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:52.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.658+0000 7f0501800640 1 --2- 172.21.15.3:0/3414690882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04fc103e00 0x7f04fc104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:52.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.658+0000 7f0501800640 1 -- 172.21.15.3:0/3414690882 >> 172.21.15.3:0/3414690882 conn(0x7f04fc0ff5b0 msgr2=0x7f04fc1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:52.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.658+0000 7f0501800640 1 -- 172.21.15.3:0/3414690882 shutdown_connections 2024-09-19T06:11:52.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.659+0000 7f0501800640 1 -- 172.21.15.3:0/3414690882 wait complete. 2024-09-19T06:11:52.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.659+0000 7f0501800640 1 Processor -- start 2024-09-19T06:11:52.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.660+0000 7f0501800640 1 -- start start 2024-09-19T06:11:52.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.660+0000 7f0501800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04fc103e00 0x7f04fc19a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:52.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.660+0000 7f0501800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04fc104f60 0x7f04fc19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:52.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.660+0000 7f0501800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04fc105920 0x7f04fc1a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:52.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.660+0000 7f0501800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc10fab0 con 0x7f04fc104f60 2024-09-19T06:11:52.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.660+0000 7f0501800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc10f930 con 0x7f04fc103e00 2024-09-19T06:11:52.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.660+0000 7f0501800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc10fc30 con 0x7f04fc105920 2024-09-19T06:11:52.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.660+0000 7f04f3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04fc104f60 0x7f04fc19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:52.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.660+0000 7f04faa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04fc103e00 0x7f04fc19a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:52.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.660+0000 7f04f3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04fc104f60 0x7f04fc19a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46736/0 (socket says 172.21.15.3:46736) 2024-09-19T06:11:52.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.660+0000 7f04f3e00640 1 -- 172.21.15.3:0/807820007 learned_addr learned my addr 172.21.15.3:0/807820007 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:52.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.660+0000 7f04fb400640 1 --2- 172.21.15.3:0/807820007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04fc105920 0x7f04fc1a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:52.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.661+0000 7f04faa00640 1 -- 172.21.15.3:0/807820007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04fc105920 msgr2=0x7f04fc1a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:52.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.661+0000 7f04faa00640 1 --2- 172.21.15.3:0/807820007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04fc105920 0x7f04fc1a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:52.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.661+0000 7f04faa00640 1 -- 172.21.15.3:0/807820007 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04fc104f60 msgr2=0x7f04fc19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:52.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.661+0000 7f04faa00640 1 --2- 172.21.15.3:0/807820007 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04fc104f60 0x7f04fc19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:52.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.661+0000 7f04faa00640 1 -- 172.21.15.3:0/807820007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04fc1a1d40 con 0x7f04fc103e00 2024-09-19T06:11:52.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.661+0000 7f04faa00640 1 --2- 172.21.15.3:0/807820007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04fc103e00 0x7f04fc19a110 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00e9f0 tx=0x7f04ec00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:52.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.661+0000 7f04f3400640 1 -- 172.21.15.3:0/807820007 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec00ccc0 con 0x7f04fc103e00 2024-09-19T06:11:52.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.661+0000 7f0501800640 1 -- 172.21.15.3:0/807820007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04fc1a1fd0 con 0x7f04fc103e00 2024-09-19T06:11:52.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.661+0000 7f04f3400640 1 -- 172.21.15.3:0/807820007 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04ec005020 con 0x7f04fc103e00 2024-09-19T06:11:52.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.661+0000 7f04f3400640 1 -- 172.21.15.3:0/807820007 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec0049e0 con 0x7f04fc103e00 2024-09-19T06:11:52.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.661+0000 7f0501800640 1 -- 172.21.15.3:0/807820007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04fc1a2430 con 0x7f04fc103e00 2024-09-19T06:11:52.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.662+0000 7f0501800640 1 -- 172.21.15.3:0/807820007 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04fc1a26c0 con 0x7f04fc103e00 2024-09-19T06:11:52.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.665+0000 7f04f3400640 1 -- 172.21.15.3:0/807820007 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f04ec005560 con 0x7f04fc103e00 2024-09-19T06:11:52.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.666+0000 7f04f3400640 1 --2- 172.21.15.3:0/807820007 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f04e00a3300 0x7f04e00a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:52.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.666+0000 7f04f3400640 1 -- 172.21.15.3:0/807820007 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f04ec0cfac0 con 0x7f04fc103e00 2024-09-19T06:11:52.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.666+0000 7f04f3e00640 1 --2- 172.21.15.3:0/807820007 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f04e00a3300 0x7f04e00a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:52.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.667+0000 7f04f3e00640 1 --2- 172.21.15.3:0/807820007 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f04e00a3300 0x7f04e00a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f04e4000c00 tx=0x7f04e40046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:52.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.668+0000 7f04f3400640 1 -- 172.21.15.3:0/807820007 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f04ec0051d0 con 0x7f04fc103e00 2024-09-19T06:11:52.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.861+0000 7f0501800640 1 -- 172.21.15.3:0/807820007 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f04fc1a2890 con 0x7f04e00a3300 2024-09-19T06:11:52.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.863+0000 7f04f3400640 1 -- 172.21.15.3:0/807820007 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+187 (secure 0 0 0) 0x7f04fc1a2890 con 0x7f04e00a3300 2024-09-19T06:11:52.864 INFO:teuthology.orchestra.run.smithi003.stdout:HOST ADDR LABELS STATUS 2024-09-19T06:11:52.864 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003 172.21.15.3 2024-09-19T06:11:52.864 INFO:teuthology.orchestra.run.smithi003.stdout:smithi059 172.21.15.59 2024-09-19T06:11:52.864 INFO:teuthology.orchestra.run.smithi003.stdout:smithi071 172.21.15.71 2024-09-19T06:11:52.864 INFO:teuthology.orchestra.run.smithi003.stdout:3 hosts in cluster 2024-09-19T06:11:52.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.865+0000 7f0501800640 1 -- 172.21.15.3:0/807820007 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f04e00a3300 msgr2=0x7f04e00a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:52.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.865+0000 7f0501800640 1 --2- 172.21.15.3:0/807820007 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f04e00a3300 0x7f04e00a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f04e4000c00 tx=0x7f04e40046c0 comp rx=0 tx=0).stop 2024-09-19T06:11:52.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.865+0000 7f0501800640 1 -- 172.21.15.3:0/807820007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04fc103e00 msgr2=0x7f04fc19a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:52.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.865+0000 7f0501800640 1 --2- 172.21.15.3:0/807820007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04fc103e00 0x7f04fc19a110 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00e9f0 tx=0x7f04ec00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:11:52.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.865+0000 7f0501800640 1 -- 172.21.15.3:0/807820007 shutdown_connections 2024-09-19T06:11:52.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.865+0000 7f0501800640 1 --2- 172.21.15.3:0/807820007 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f04e00a3300 0x7f04e00a57c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:52.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.865+0000 7f0501800640 1 --2- 172.21.15.3:0/807820007 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f04fc105920 0x7f04fc1a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:52.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.865+0000 7f0501800640 1 --2- 172.21.15.3:0/807820007 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04fc104f60 0x7f04fc19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:52.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.865+0000 7f0501800640 1 --2- 172.21.15.3:0/807820007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04fc103e00 0x7f04fc19a110 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:52.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.865+0000 7f0501800640 1 -- 172.21.15.3:0/807820007 >> 172.21.15.3:0/807820007 conn(0x7f04fc0ff5b0 msgr2=0x7f04fc1016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:52.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.865+0000 7f0501800640 1 -- 172.21.15.3:0/807820007 shutdown_connections 2024-09-19T06:11:52.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:52.865+0000 7f0501800640 1 -- 172.21.15.3:0/807820007 wait complete. 2024-09-19T06:11:53.765 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T06:11:54.144 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:54.333 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:54 smithi003 ceph-mon[30893]: pgmap v359: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:54.333 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:54 smithi003 ceph-mon[30893]: from='client.25007 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:11:54.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:54 smithi071 ceph-mon[35662]: pgmap v359: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:54.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:54 smithi071 ceph-mon[35662]: from='client.25007 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:11:54.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:54 smithi059 ceph-mon[35138]: pgmap v359: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:11:54.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:54 smithi059 ceph-mon[35138]: from='client.25007 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:11:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.740+0000 7fc48a800640 1 -- 172.21.15.3:0/1490146744 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc484104f60 msgr2=0x7fc4841053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.740+0000 7fc48a800640 1 --2- 172.21.15.3:0/1490146744 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc484104f60 0x7fc4841053e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc470009900 tx=0x7fc47002a410 comp rx=0 tx=0).stop 2024-09-19T06:11:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.741+0000 7fc48a800640 1 -- 172.21.15.3:0/1490146744 shutdown_connections 2024-09-19T06:11:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.741+0000 7fc48a800640 1 --2- 172.21.15.3:0/1490146744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc484105920 0x7fc48410c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.741+0000 7fc48a800640 1 --2- 172.21.15.3:0/1490146744 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc484104f60 0x7fc4841053e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.741+0000 7fc48a800640 1 --2- 172.21.15.3:0/1490146744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc484103e00 0x7fc484104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.741+0000 7fc48a800640 1 -- 172.21.15.3:0/1490146744 >> 172.21.15.3:0/1490146744 conn(0x7fc4840ff5b0 msgr2=0x7fc4841019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.741+0000 7fc48a800640 1 -- 172.21.15.3:0/1490146744 shutdown_connections 2024-09-19T06:11:54.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.741+0000 7fc48a800640 1 -- 172.21.15.3:0/1490146744 wait complete. 2024-09-19T06:11:54.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.742+0000 7fc48a800640 1 Processor -- start 2024-09-19T06:11:54.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.742+0000 7fc48a800640 1 -- start start 2024-09-19T06:11:54.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.742+0000 7fc48a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc484103e00 0x7fc48419a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:54.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.742+0000 7fc48a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc484104f60 0x7fc48419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:54.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.742+0000 7fc48a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc484105920 0x7fc4841a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:54.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.742+0000 7fc48a800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc48410fb00 con 0x7fc484103e00 2024-09-19T06:11:54.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.742+0000 7fc48a800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc48410f980 con 0x7fc484104f60 2024-09-19T06:11:54.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.742+0000 7fc48a800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc48410fc80 con 0x7fc484105920 2024-09-19T06:11:54.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.742+0000 7fc483400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc484103e00 0x7fc48419a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:54.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.742+0000 7fc483e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc484105920 0x7fc4841a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:54.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.742+0000 7fc482a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc484104f60 0x7fc48419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:54.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.742+0000 7fc483e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc484105920 0x7fc4841a16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:47144/0 (socket says 172.21.15.3:47144) 2024-09-19T06:11:54.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.742+0000 7fc483400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc484103e00 0x7fc48419a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45414/0 (socket says 172.21.15.3:45414) 2024-09-19T06:11:54.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.742+0000 7fc483e00640 1 -- 172.21.15.3:0/2606282512 learned_addr learned my addr 172.21.15.3:0/2606282512 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:54.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.743+0000 7fc482a00640 1 -- 172.21.15.3:0/2606282512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc484105920 msgr2=0x7fc4841a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:54.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.743+0000 7fc482a00640 1 --2- 172.21.15.3:0/2606282512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc484105920 0x7fc4841a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:54.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.743+0000 7fc482a00640 1 -- 172.21.15.3:0/2606282512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc484103e00 msgr2=0x7fc48419a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:54.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.743+0000 7fc482a00640 1 --2- 172.21.15.3:0/2606282512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc484103e00 0x7fc48419a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:54.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.743+0000 7fc482a00640 1 -- 172.21.15.3:0/2606282512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4841a1d50 con 0x7fc484104f60 2024-09-19T06:11:54.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.743+0000 7fc483400640 1 --2- 172.21.15.3:0/2606282512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc484103e00 0x7fc48419a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:54.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.743+0000 7fc482a00640 1 --2- 172.21.15.3:0/2606282512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc484104f60 0x7fc48419a660 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc470009230 tx=0x7fc470032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:54.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.744+0000 7fc47be00640 1 -- 172.21.15.3:0/2606282512 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc47003f030 con 0x7fc484104f60 2024-09-19T06:11:54.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.744+0000 7fc47be00640 1 -- 172.21.15.3:0/2606282512 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc470003ce0 con 0x7fc484104f60 2024-09-19T06:11:54.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.744+0000 7fc47be00640 1 -- 172.21.15.3:0/2606282512 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc470035070 con 0x7fc484104f60 2024-09-19T06:11:54.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.744+0000 7fc48a800640 1 -- 172.21.15.3:0/2606282512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4841a1fe0 con 0x7fc484104f60 2024-09-19T06:11:54.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.744+0000 7fc48a800640 1 -- 172.21.15.3:0/2606282512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4841a2430 con 0x7fc484104f60 2024-09-19T06:11:54.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.745+0000 7fc48a800640 1 -- 172.21.15.3:0/2606282512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc48410b240 con 0x7fc484104f60 2024-09-19T06:11:54.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.748+0000 7fc47be00640 1 -- 172.21.15.3:0/2606282512 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fc470042030 con 0x7fc484104f60 2024-09-19T06:11:54.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.749+0000 7fc47be00640 1 --2- 172.21.15.3:0/2606282512 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc4680a3380 0x7fc4680a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:54.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.749+0000 7fc47be00640 1 -- 172.21.15.3:0/2606282512 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fc4700f0280 con 0x7fc484104f60 2024-09-19T06:11:54.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.750+0000 7fc483400640 1 --2- 172.21.15.3:0/2606282512 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc4680a3380 0x7fc4680a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:54.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.750+0000 7fc483400640 1 --2- 172.21.15.3:0/2606282512 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc4680a3380 0x7fc4680a5840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc474009fc0 tx=0x7fc474005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:54.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.751+0000 7fc47be00640 1 -- 172.21.15.3:0/2606282512 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc4700bc770 con 0x7fc484104f60 2024-09-19T06:11:54.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.942+0000 7fc48a800640 1 -- 172.21.15.3:0/2606282512 --> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fc484062630 con 0x7fc4680a3380 2024-09-19T06:11:54.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.944+0000 7fc47be00640 1 -- 172.21.15.3:0/2606282512 <== mgr.14150 v2:172.21.15.3:6800/1278931596 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fc484062630 con 0x7fc4680a3380 2024-09-19T06:11:54.946 INFO:teuthology.orchestra.run.smithi003.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T06:11:54.946 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330009Z400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-19T06:11:54.946 INFO:teuthology.orchestra.run.smithi003.stdout:smithi059 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330009L400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-19T06:11:54.946 INFO:teuthology.orchestra.run.smithi003.stdout:smithi071 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040172400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T06:11:54.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.947+0000 7fc48a800640 1 -- 172.21.15.3:0/2606282512 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc4680a3380 msgr2=0x7fc4680a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:54.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.947+0000 7fc48a800640 1 --2- 172.21.15.3:0/2606282512 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc4680a3380 0x7fc4680a5840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc474009fc0 tx=0x7fc474005f90 comp rx=0 tx=0).stop 2024-09-19T06:11:54.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.947+0000 7fc48a800640 1 -- 172.21.15.3:0/2606282512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc484104f60 msgr2=0x7fc48419a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:54.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.947+0000 7fc48a800640 1 --2- 172.21.15.3:0/2606282512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc484104f60 0x7fc48419a660 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc470009230 tx=0x7fc470032ce0 comp rx=0 tx=0).stop 2024-09-19T06:11:54.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.947+0000 7fc48a800640 1 -- 172.21.15.3:0/2606282512 shutdown_connections 2024-09-19T06:11:54.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.947+0000 7fc48a800640 1 --2- 172.21.15.3:0/2606282512 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc4680a3380 0x7fc4680a5840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:54.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.947+0000 7fc48a800640 1 --2- 172.21.15.3:0/2606282512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc484105920 0x7fc4841a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:54.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.947+0000 7fc48a800640 1 --2- 172.21.15.3:0/2606282512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc484104f60 0x7fc48419a660 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:54.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.947+0000 7fc48a800640 1 --2- 172.21.15.3:0/2606282512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc484103e00 0x7fc48419a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:54.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.947+0000 7fc48a800640 1 -- 172.21.15.3:0/2606282512 >> 172.21.15.3:0/2606282512 conn(0x7fc4840ff5b0 msgr2=0x7fc484108410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:54.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.948+0000 7fc48a800640 1 -- 172.21.15.3:0/2606282512 shutdown_connections 2024-09-19T06:11:54.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:54.948+0000 7fc48a800640 1 -- 172.21.15.3:0/2606282512 wait complete. 2024-09-19T06:11:55.719 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T06:11:55.729 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi003.front.sepia.ceph.com 2024-09-19T06:11:55.729 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T06:11:56.106 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:56.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:56 smithi003 ceph-mon[30893]: pgmap v360: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:56.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:56 smithi003 ceph-mon[30893]: from='client.25013 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:11:56.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:56 smithi071 ceph-mon[35662]: pgmap v360: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:56.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:56 smithi071 ceph-mon[35662]: from='client.25013 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:11:56.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:56 smithi059 ceph-mon[35138]: pgmap v360: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:11:56.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:56 smithi059 ceph-mon[35138]: from='client.25013 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:11:56.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.733+0000 7f2e97600640 1 -- 172.21.15.3:0/3188156797 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e90103e00 msgr2=0x7f2e90104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:56.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.733+0000 7f2e97600640 1 --2- 172.21.15.3:0/3188156797 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e90103e00 0x7f2e90104200 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009900 tx=0x7f2e8402a410 comp rx=0 tx=0).stop 2024-09-19T06:11:56.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.733+0000 7f2e97600640 1 -- 172.21.15.3:0/3188156797 shutdown_connections 2024-09-19T06:11:56.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.733+0000 7f2e97600640 1 --2- 172.21.15.3:0/3188156797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e90105920 0x7f2e9010c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:56.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.733+0000 7f2e97600640 1 --2- 172.21.15.3:0/3188156797 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e90104f60 0x7f2e901053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:56.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.733+0000 7f2e97600640 1 --2- 172.21.15.3:0/3188156797 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e90103e00 0x7f2e90104200 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:56.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.733+0000 7f2e97600640 1 -- 172.21.15.3:0/3188156797 >> 172.21.15.3:0/3188156797 conn(0x7f2e900ff5b0 msgr2=0x7f2e901019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:56.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.733+0000 7f2e97600640 1 -- 172.21.15.3:0/3188156797 shutdown_connections 2024-09-19T06:11:56.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.733+0000 7f2e97600640 1 -- 172.21.15.3:0/3188156797 wait complete. 2024-09-19T06:11:56.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.734+0000 7f2e97600640 1 Processor -- start 2024-09-19T06:11:56.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.734+0000 7f2e97600640 1 -- start start 2024-09-19T06:11:56.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.734+0000 7f2e97600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e90103e00 0x7f2e90079fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:56.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.735+0000 7f2e97600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e90104f60 0x7f2e9007a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:56.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.735+0000 7f2e97600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e90105920 0x7f2e90076b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:56.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.735+0000 7f2e97600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9010fae0 con 0x7f2e90104f60 2024-09-19T06:11:56.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.735+0000 7f2e97600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9010f960 con 0x7f2e90105920 2024-09-19T06:11:56.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.735+0000 7f2e97600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9010fc60 con 0x7f2e90103e00 2024-09-19T06:11:56.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.735+0000 7f2e94c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e90103e00 0x7f2e90079fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:56.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.735+0000 7f2e8fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e90104f60 0x7f2e9007a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:56.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.735+0000 7f2e94c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e90103e00 0x7f2e90079fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:47158/0 (socket says 172.21.15.3:47158) 2024-09-19T06:11:56.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.735+0000 7f2e94c00640 1 -- 172.21.15.3:0/1585285918 learned_addr learned my addr 172.21.15.3:0/1585285918 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:56.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.735+0000 7f2e95600640 1 --2- 172.21.15.3:0/1585285918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e90105920 0x7f2e90076b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:56.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.735+0000 7f2e94c00640 1 -- 172.21.15.3:0/1585285918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e90105920 msgr2=0x7f2e90076b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:56.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.735+0000 7f2e94c00640 1 --2- 172.21.15.3:0/1585285918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e90105920 0x7f2e90076b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:56.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.735+0000 7f2e94c00640 1 -- 172.21.15.3:0/1585285918 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e90104f60 msgr2=0x7f2e9007a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:56.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.735+0000 7f2e94c00640 1 --2- 172.21.15.3:0/1585285918 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e90104f60 0x7f2e9007a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:56.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.735+0000 7f2e94c00640 1 -- 172.21.15.3:0/1585285918 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e900773c0 con 0x7f2e90103e00 2024-09-19T06:11:56.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.735+0000 7f2e8fe00640 1 --2- 172.21.15.3:0/1585285918 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e90104f60 0x7f2e9007a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:11:56.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.736+0000 7f2e94c00640 1 --2- 172.21.15.3:0/1585285918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e90103e00 0x7f2e90079fa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2e84031440 tx=0x7f2e84032ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:56.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.736+0000 7f2e8d600640 1 -- 172.21.15.3:0/1585285918 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8403f030 con 0x7f2e90103e00 2024-09-19T06:11:56.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.736+0000 7f2e8d600640 1 -- 172.21.15.3:0/1585285918 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e84003ce0 con 0x7f2e90103e00 2024-09-19T06:11:56.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.736+0000 7f2e97600640 1 -- 172.21.15.3:0/1585285918 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e901a6500 con 0x7f2e90103e00 2024-09-19T06:11:56.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.736+0000 7f2e8d600640 1 -- 172.21.15.3:0/1585285918 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e84035070 con 0x7f2e90103e00 2024-09-19T06:11:56.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.736+0000 7f2e97600640 1 -- 172.21.15.3:0/1585285918 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e901a68a0 con 0x7f2e90103e00 2024-09-19T06:11:56.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.737+0000 7f2e97600640 1 -- 172.21.15.3:0/1585285918 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e9010b1a0 con 0x7f2e90103e00 2024-09-19T06:11:56.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.739+0000 7f2e8d600640 1 -- 172.21.15.3:0/1585285918 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f2e84042030 con 0x7f2e90103e00 2024-09-19T06:11:56.741 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.741+0000 7f2e8d600640 1 --2- 172.21.15.3:0/1585285918 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f2e780a32d0 0x7f2e780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:56.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.741+0000 7f2e8d600640 1 -- 172.21.15.3:0/1585285918 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f2e840f04a0 con 0x7f2e90103e00 2024-09-19T06:11:56.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.741+0000 7f2e8fe00640 1 --2- 172.21.15.3:0/1585285918 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f2e780a32d0 0x7f2e780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:56.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.741+0000 7f2e8fe00640 1 --2- 172.21.15.3:0/1585285918 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f2e780a32d0 0x7f2e780a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2e90077f20 tx=0x7f2e7c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:56.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.743+0000 7f2e8d600640 1 -- 172.21.15.3:0/1585285918 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2e840bc990 con 0x7f2e90103e00 2024-09-19T06:11:56.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.971+0000 7f2e97600640 1 -- 172.21.15.3:0/1585285918 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f2e9002d7c0 con 0x7f2e90103e00 2024-09-19T06:11:56.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.972+0000 7f2e8d600640 1 -- 172.21.15.3:0/1585285918 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+3107 (secure 0 0 0) 0x7f2e840c0c90 con 0x7f2e90103e00 2024-09-19T06:11:56.973 INFO:teuthology.orchestra.run.smithi003.stdout:e28 2024-09-19T06:11:56.974 INFO:teuthology.orchestra.run.smithi003.stdout:btime 2024-09-19T06:10:19:770544+0000 2024-09-19T06:11:56.974 INFO:teuthology.orchestra.run.smithi003.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:11:56.974 INFO:teuthology.orchestra.run.smithi003.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T06:11:56.974 INFO:teuthology.orchestra.run.smithi003.stdout:legacy client fscid: 1 2024-09-19T06:11:56.974 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:11:56.974 INFO:teuthology.orchestra.run.smithi003.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:11:56.974 INFO:teuthology.orchestra.run.smithi003.stdout:fs_name cephfs 2024-09-19T06:11:56.974 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 28 2024-09-19T06:11:56.974 INFO:teuthology.orchestra.run.smithi003.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T06:11:56.974 INFO:teuthology.orchestra.run.smithi003.stdout:created 2024-09-19T06:10:03.693253+0000 2024-09-19T06:11:56.974 INFO:teuthology.orchestra.run.smithi003.stdout:modified 2024-09-19T06:10:18.878479+0000 2024-09-19T06:11:56.974 INFO:teuthology.orchestra.run.smithi003.stdout:tableserver 0 2024-09-19T06:11:56.974 INFO:teuthology.orchestra.run.smithi003.stdout:root 0 2024-09-19T06:11:56.975 INFO:teuthology.orchestra.run.smithi003.stdout:session_timeout 300 2024-09-19T06:11:56.975 INFO:teuthology.orchestra.run.smithi003.stdout:session_autoclose 300 2024-09-19T06:11:56.975 INFO:teuthology.orchestra.run.smithi003.stdout:max_file_size 1099511627776 2024-09-19T06:11:56.975 INFO:teuthology.orchestra.run.smithi003.stdout:max_xattr_size 65536 2024-09-19T06:11:56.975 INFO:teuthology.orchestra.run.smithi003.stdout:required_client_features {} 2024-09-19T06:11:56.975 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure 0 2024-09-19T06:11:56.975 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure_osd_epoch 0 2024-09-19T06:11:56.975 INFO:teuthology.orchestra.run.smithi003.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T06:11:56.975 INFO:teuthology.orchestra.run.smithi003.stdout:max_mds 5 2024-09-19T06:11:56.975 INFO:teuthology.orchestra.run.smithi003.stdout:in 0,1,2,3,4 2024-09-19T06:11:56.975 INFO:teuthology.orchestra.run.smithi003.stdout:up {0=24557,1=24532,2=24515,3=24514,4=14517} 2024-09-19T06:11:56.975 INFO:teuthology.orchestra.run.smithi003.stdout:failed 2024-09-19T06:11:56.975 INFO:teuthology.orchestra.run.smithi003.stdout:damaged 2024-09-19T06:11:56.975 INFO:teuthology.orchestra.run.smithi003.stdout:stopped 2024-09-19T06:11:56.976 INFO:teuthology.orchestra.run.smithi003.stdout:data_pools [3] 2024-09-19T06:11:56.976 INFO:teuthology.orchestra.run.smithi003.stdout:metadata_pool 2 2024-09-19T06:11:56.976 INFO:teuthology.orchestra.run.smithi003.stdout:inline_data disabled 2024-09-19T06:11:56.976 INFO:teuthology.orchestra.run.smithi003.stdout:balancer 2024-09-19T06:11:56.976 INFO:teuthology.orchestra.run.smithi003.stdout:bal_rank_mask -1 2024-09-19T06:11:56.976 INFO:teuthology.orchestra.run.smithi003.stdout:standby_count_wanted 0 2024-09-19T06:11:56.976 INFO:teuthology.orchestra.run.smithi003.stdout:qdb_cluster leader: 24557 members: 14517,24514,24515,24532,24557 2024-09-19T06:11:56.976 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.b{0:24557} state up:active seq 5 addr [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:11:56.976 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.f{0:24502} state up:standby-replay seq 1 addr [v2:172.21.15.71:6834/3322076004,v1:172.21.15.71:6835/3322076004] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:11:56.976 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.i{1:24532} state up:active seq 10 addr [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:11:56.976 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.e{1:24494} state up:standby-replay seq 1 addr [v2:172.21.15.59:6834/3846556695,v1:172.21.15.59:6835/3846556695] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:11:56.976 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.h{2:24515} state up:active seq 11 addr [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:11:56.976 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.k{2:24458} state up:standby-replay seq 1 addr [v2:172.21.15.59:6832/927949058,v1:172.21.15.59:6833/927949058] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:11:56.977 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.c{3:24514} state up:active seq 12 addr [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:11:56.977 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.l{3:24454} state up:standby-replay seq 1 addr [v2:172.21.15.71:6832/2883963583,v1:172.21.15.71:6833/2883963583] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:11:56.977 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.a{4:14517} state up:active seq 9 addr [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:11:56.977 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.g{4:14505} state up:standby-replay seq 1 addr [v2:172.21.15.3:6838/2272422067,v1:172.21.15.3:6839/2272422067] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:11:56.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:11:56.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:11:56.977 INFO:teuthology.orchestra.run.smithi003.stdout:Standby daemons: 2024-09-19T06:11:56.977 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:11:56.977 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.j{-1:14445} state up:standby seq 1 addr [v2:172.21.15.3:6834/469648602,v1:172.21.15.3:6835/469648602] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:11:56.977 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.d{-1:14457} state up:standby seq 1 addr [v2:172.21.15.3:6836/832907982,v1:172.21.15.3:6837/832907982] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:11:56.978 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 28 2024-09-19T06:11:56.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.974+0000 7f2e97600640 1 -- 172.21.15.3:0/1585285918 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f2e780a32d0 msgr2=0x7f2e780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:56.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.974+0000 7f2e97600640 1 --2- 172.21.15.3:0/1585285918 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f2e780a32d0 0x7f2e780a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2e90077f20 tx=0x7f2e7c00b410 comp rx=0 tx=0).stop 2024-09-19T06:11:56.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.974+0000 7f2e97600640 1 -- 172.21.15.3:0/1585285918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e90103e00 msgr2=0x7f2e90079fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:56.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.974+0000 7f2e97600640 1 --2- 172.21.15.3:0/1585285918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e90103e00 0x7f2e90079fa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2e84031440 tx=0x7f2e84032ce0 comp rx=0 tx=0).stop 2024-09-19T06:11:56.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.974+0000 7f2e97600640 1 -- 172.21.15.3:0/1585285918 shutdown_connections 2024-09-19T06:11:56.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.974+0000 7f2e97600640 1 --2- 172.21.15.3:0/1585285918 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f2e780a32d0 0x7f2e780a5790 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:56.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.974+0000 7f2e97600640 1 --2- 172.21.15.3:0/1585285918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e90105920 0x7f2e90076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:56.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.974+0000 7f2e97600640 1 --2- 172.21.15.3:0/1585285918 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e90104f60 0x7f2e9007a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:56.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.974+0000 7f2e97600640 1 --2- 172.21.15.3:0/1585285918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e90103e00 0x7f2e90079fa0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:56.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.974+0000 7f2e97600640 1 -- 172.21.15.3:0/1585285918 >> 172.21.15.3:0/1585285918 conn(0x7f2e900ff5b0 msgr2=0x7f2e90108370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:56.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.975+0000 7f2e97600640 1 -- 172.21.15.3:0/1585285918 shutdown_connections 2024-09-19T06:11:56.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:56.975+0000 7f2e97600640 1 -- 172.21.15.3:0/1585285918 wait complete. 2024-09-19T06:11:57.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:57 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1585285918' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:11:57.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:57 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1585285918' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:11:57.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:57 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1585285918' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:11:57.814 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T06:11:58.194 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:11:58.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:58 smithi003 ceph-mon[30893]: pgmap v361: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:11:58.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:58 smithi071 ceph-mon[35662]: pgmap v361: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:11:58.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:58 smithi059 ceph-mon[35138]: pgmap v361: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:11:58.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.777+0000 7f1c97400640 1 -- 172.21.15.3:0/1636838475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c90077df0 msgr2=0x7f1c90078250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:58.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.777+0000 7f1c97400640 1 --2- 172.21.15.3:0/1636838475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c90077df0 0x7f1c90078250 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009900 tx=0x7f1c7c02a410 comp rx=0 tx=0).stop 2024-09-19T06:11:58.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.777+0000 7f1c97400640 1 -- 172.21.15.3:0/1636838475 shutdown_connections 2024-09-19T06:11:58.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.777+0000 7f1c97400640 1 --2- 172.21.15.3:0/1636838475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c90078790 0x7f1c90079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:58.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.777+0000 7f1c97400640 1 --2- 172.21.15.3:0/1636838475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c90077df0 0x7f1c90078250 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:58.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.777+0000 7f1c97400640 1 --2- 172.21.15.3:0/1636838475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c90076ba0 0x7f1c90076fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:58.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.777+0000 7f1c97400640 1 -- 172.21.15.3:0/1636838475 >> 172.21.15.3:0/1636838475 conn(0x7f1c900ff5b0 msgr2=0x7f1c901019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:58.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.777+0000 7f1c97400640 1 -- 172.21.15.3:0/1636838475 shutdown_connections 2024-09-19T06:11:58.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.777+0000 7f1c97400640 1 -- 172.21.15.3:0/1636838475 wait complete. 2024-09-19T06:11:58.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.778+0000 7f1c97400640 1 Processor -- start 2024-09-19T06:11:58.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.778+0000 7f1c97400640 1 -- start start 2024-09-19T06:11:58.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.778+0000 7f1c97400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c90076ba0 0x7f1c9019e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:58.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.778+0000 7f1c97400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c90077df0 0x7f1c9019ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:58.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.778+0000 7f1c97400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c90078790 0x7f1c901a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:58.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.778+0000 7f1c97400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1c90113e60 con 0x7f1c90078790 2024-09-19T06:11:58.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.778+0000 7f1c97400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1c90113ce0 con 0x7f1c90076ba0 2024-09-19T06:11:58.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.778+0000 7f1c97400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1c90113fe0 con 0x7f1c90077df0 2024-09-19T06:11:58.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.779+0000 7f1c8fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c90077df0 0x7f1c9019ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:58.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.779+0000 7f1c8fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c90077df0 0x7f1c9019ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:47172/0 (socket says 172.21.15.3:47172) 2024-09-19T06:11:58.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.779+0000 7f1c94a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c90076ba0 0x7f1c9019e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:58.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.779+0000 7f1c8fe00640 1 -- 172.21.15.3:0/2039082997 learned_addr learned my addr 172.21.15.3:0/2039082997 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:11:58.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.779+0000 7f1c95400640 1 --2- 172.21.15.3:0/2039082997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c90078790 0x7f1c901a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:58.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.779+0000 7f1c94a00640 1 -- 172.21.15.3:0/2039082997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c90077df0 msgr2=0x7f1c9019ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:58.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.779+0000 7f1c94a00640 1 --2- 172.21.15.3:0/2039082997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c90077df0 0x7f1c9019ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:58.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.779+0000 7f1c94a00640 1 -- 172.21.15.3:0/2039082997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c90078790 msgr2=0x7f1c901a5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:58.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.779+0000 7f1c94a00640 1 --2- 172.21.15.3:0/2039082997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c90078790 0x7f1c901a5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:58.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.779+0000 7f1c94a00640 1 -- 172.21.15.3:0/2039082997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c901a6140 con 0x7f1c90076ba0 2024-09-19T06:11:58.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.779+0000 7f1c95400640 1 --2- 172.21.15.3:0/2039082997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c90078790 0x7f1c901a5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:11:58.782 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.779+0000 7f1c94a00640 1 --2- 172.21.15.3:0/2039082997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c90076ba0 0x7f1c9019e510 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400e9f0 tx=0x7f1c8400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:58.782 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.780+0000 7f1c8d600640 1 -- 172.21.15.3:0/2039082997 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8400ccc0 con 0x7f1c90076ba0 2024-09-19T06:11:58.782 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.780+0000 7f1c97400640 1 -- 172.21.15.3:0/2039082997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c901a6430 con 0x7f1c90076ba0 2024-09-19T06:11:58.782 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.780+0000 7f1c8d600640 1 -- 172.21.15.3:0/2039082997 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c84010910 con 0x7f1c90076ba0 2024-09-19T06:11:58.782 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.780+0000 7f1c8d600640 1 -- 172.21.15.3:0/2039082997 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c84018960 con 0x7f1c90076ba0 2024-09-19T06:11:58.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.780+0000 7f1c97400640 1 -- 172.21.15.3:0/2039082997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c901a6940 con 0x7f1c90076ba0 2024-09-19T06:11:58.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.781+0000 7f1c97400640 1 -- 172.21.15.3:0/2039082997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c90110780 con 0x7f1c90076ba0 2024-09-19T06:11:58.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.783+0000 7f1c8d600640 1 -- 172.21.15.3:0/2039082997 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f1c84010ac0 con 0x7f1c90076ba0 2024-09-19T06:11:58.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.784+0000 7f1c8d600640 1 --2- 172.21.15.3:0/2039082997 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f1c780a3300 0x7f1c780a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:11:58.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.784+0000 7f1c8d600640 1 -- 172.21.15.3:0/2039082997 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f1c840d00b0 con 0x7f1c90076ba0 2024-09-19T06:11:58.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.784+0000 7f1c8fe00640 1 --2- 172.21.15.3:0/2039082997 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f1c780a3300 0x7f1c780a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:11:58.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.785+0000 7f1c8fe00640 1 --2- 172.21.15.3:0/2039082997 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f1c780a3300 0x7f1c780a57c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c031440 tx=0x7f1c7c0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:11:58.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.786+0000 7f1c8d600640 1 -- 172.21.15.3:0/2039082997 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1c8409cbf0 con 0x7f1c90076ba0 2024-09-19T06:11:58.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.974+0000 7f1c97400640 1 -- 172.21.15.3:0/2039082997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f1c90062df0 con 0x7f1c90076ba0 2024-09-19T06:11:58.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.975+0000 7f1c8d600640 1 -- 172.21.15.3:0/2039082997 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v88) ==== 56+0+5268 (secure 0 0 0) 0x7f1c8409c4f0 con 0x7f1c90076ba0 2024-09-19T06:11:58.977 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 88 2024-09-19T06:11:58.977 INFO:teuthology.orchestra.run.smithi003.stdout:fsid 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:11:58.977 INFO:teuthology.orchestra.run.smithi003.stdout:created 2024-09-19T06:01:35.224753+0000 2024-09-19T06:11:58.977 INFO:teuthology.orchestra.run.smithi003.stdout:modified 2024-09-19T06:10:31.811461+0000 2024-09-19T06:11:58.977 INFO:teuthology.orchestra.run.smithi003.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T06:11:58.977 INFO:teuthology.orchestra.run.smithi003.stdout:crush_version 26 2024-09-19T06:11:58.977 INFO:teuthology.orchestra.run.smithi003.stdout:full_ratio 0.95 2024-09-19T06:11:58.977 INFO:teuthology.orchestra.run.smithi003.stdout:backfillfull_ratio 0.9 2024-09-19T06:11:58.977 INFO:teuthology.orchestra.run.smithi003.stdout:nearfull_ratio 0.85 2024-09-19T06:11:58.977 INFO:teuthology.orchestra.run.smithi003.stdout:require_min_compat_client luminous 2024-09-19T06:11:58.977 INFO:teuthology.orchestra.run.smithi003.stdout:min_compat_client luminous 2024-09-19T06:11:58.978 INFO:teuthology.orchestra.run.smithi003.stdout:require_osd_release squid 2024-09-19T06:11:58.978 INFO:teuthology.orchestra.run.smithi003.stdout:stretch_mode_enabled false 2024-09-19T06:11:58.978 INFO:teuthology.orchestra.run.smithi003.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T06:11:58.978 INFO:teuthology.orchestra.run.smithi003.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 86 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-19T06:11:58.978 INFO:teuthology.orchestra.run.smithi003.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 86 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-19T06:11:58.978 INFO:teuthology.orchestra.run.smithi003.stdout:max_osd 12 2024-09-19T06:11:58.978 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 up in weight 1 up_from 8 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.3:6802/2061486638,v1:172.21.15.3:6803/2061486638] [v2:172.21.15.3:6804/2061486638,v1:172.21.15.3:6805/2061486638] exists,up fd89ea4b-a24e-4946-80fc-1776b6d05e24 2024-09-19T06:11:58.978 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 up in weight 1 up_from 13 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6800/129318538,v1:172.21.15.59:6801/129318538] [v2:172.21.15.59:6802/129318538,v1:172.21.15.59:6803/129318538] exists,up e03ca275-8da5-402f-9cd2-654ca422b9b0 2024-09-19T06:11:58.978 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 up in weight 1 up_from 18 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6800/2436210695,v1:172.21.15.71:6801/2436210695] [v2:172.21.15.71:6802/2436210695,v1:172.21.15.71:6803/2436210695] exists,up 62b7d36d-6078-4027-93b2-009be70a6d80 2024-09-19T06:11:58.978 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 up in weight 1 up_from 26 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.3:6810/3577306700,v1:172.21.15.3:6811/3577306700] [v2:172.21.15.3:6812/3577306700,v1:172.21.15.3:6813/3577306700] exists,up ba33cc45-0103-443d-b262-622a505d9806 2024-09-19T06:11:58.978 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 up in weight 1 up_from 33 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6808/4002980986,v1:172.21.15.59:6809/4002980986] [v2:172.21.15.59:6810/4002980986,v1:172.21.15.59:6811/4002980986] exists,up 40564c0c-6335-4207-a8e0-8078c9bfd015 2024-09-19T06:11:58.978 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 up in weight 1 up_from 38 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6808/2455500497,v1:172.21.15.71:6809/2455500497] [v2:172.21.15.71:6810/2455500497,v1:172.21.15.71:6811/2455500497] exists,up 4db04b82-3403-4fd5-9eb7-7b81ed6b1d26 2024-09-19T06:11:58.978 INFO:teuthology.orchestra.run.smithi003.stdout:osd.6 up in weight 1 up_from 46 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.3:6818/823411903,v1:172.21.15.3:6819/823411903] [v2:172.21.15.3:6820/823411903,v1:172.21.15.3:6821/823411903] exists,up 42a74f01-c5d0-4fc6-a8ee-a8bd84d4ab4c 2024-09-19T06:11:58.979 INFO:teuthology.orchestra.run.smithi003.stdout:osd.7 up in weight 1 up_from 51 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6816/2133603853,v1:172.21.15.59:6817/2133603853] [v2:172.21.15.59:6818/2133603853,v1:172.21.15.59:6819/2133603853] exists,up 8a9bc2ec-4292-465d-8a0d-dda78521a319 2024-09-19T06:11:58.979 INFO:teuthology.orchestra.run.smithi003.stdout:osd.8 up in weight 1 up_from 58 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6816/905333117,v1:172.21.15.71:6817/905333117] [v2:172.21.15.71:6818/905333117,v1:172.21.15.71:6819/905333117] exists,up 6099a5c4-3504-43ca-8c58-d23f9096cd7b 2024-09-19T06:11:58.979 INFO:teuthology.orchestra.run.smithi003.stdout:osd.9 up in weight 1 up_from 66 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.3:6826/124909267,v1:172.21.15.3:6827/124909267] [v2:172.21.15.3:6828/124909267,v1:172.21.15.3:6829/124909267] exists,up b5a8aac6-bb10-4db8-a056-25228fbe754c 2024-09-19T06:11:58.979 INFO:teuthology.orchestra.run.smithi003.stdout:osd.10 up in weight 1 up_from 71 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6824/784134238,v1:172.21.15.59:6825/784134238] [v2:172.21.15.59:6826/784134238,v1:172.21.15.59:6827/784134238] exists,up e49f3aab-0804-4aea-ae3f-38f022ab5239 2024-09-19T06:11:58.979 INFO:teuthology.orchestra.run.smithi003.stdout:osd.11 up in weight 1 up_from 78 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6824/3502550915,v1:172.21.15.71:6825/3502550915] [v2:172.21.15.71:6826/3502550915,v1:172.21.15.71:6827/3502550915] exists,up 6c6d6c23-bcf7-43e7-94d1-5f2ebaa15441 2024-09-19T06:11:58.979 INFO:teuthology.orchestra.run.smithi003.stdout:pg_upmap_items 2.6 [8,11] 2024-09-19T06:11:58.979 INFO:teuthology.orchestra.run.smithi003.stdout:pg_upmap_items 2.c [2,4] 2024-09-19T06:11:58.979 INFO:teuthology.orchestra.run.smithi003.stdout:pg_upmap_items 2.e [2,4] 2024-09-19T06:11:58.979 INFO:teuthology.orchestra.run.smithi003.stdout:pg_upmap_items 2.1b [5,11] 2024-09-19T06:11:58.979 INFO:teuthology.orchestra.run.smithi003.stdout:pg_upmap_items 2.1f [8,1] 2024-09-19T06:11:58.979 INFO:teuthology.orchestra.run.smithi003.stdout:pg_upmap_items 3.17 [4,6] 2024-09-19T06:11:58.979 INFO:teuthology.orchestra.run.smithi003.stdout:pg_upmap_items 3.1d [4,8] 2024-09-19T06:11:58.979 INFO:teuthology.orchestra.run.smithi003.stdout:pg_upmap_items 3.1e [3,9] 2024-09-19T06:11:58.979 INFO:teuthology.orchestra.run.smithi003.stdout:pg_upmap_items 3.24 [4,9] 2024-09-19T06:11:58.980 INFO:teuthology.orchestra.run.smithi003.stdout:pg_upmap_items 3.33 [5,9] 2024-09-19T06:11:58.980 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:0/1458736313 expires 2024-09-20T06:02:30.039686+0000 2024-09-19T06:11:58.980 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:0/2065281908 expires 2024-09-20T06:02:30.039686+0000 2024-09-19T06:11:58.980 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:0/953348594 expires 2024-09-20T06:02:01.122348+0000 2024-09-19T06:11:58.980 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:6801/518259590 expires 2024-09-20T06:02:30.039686+0000 2024-09-19T06:11:58.980 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:0/1658697906 expires 2024-09-20T06:02:01.122348+0000 2024-09-19T06:11:58.980 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:6801/2386230415 expires 2024-09-20T06:02:01.122348+0000 2024-09-19T06:11:58.980 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:6800/2386230415 expires 2024-09-20T06:02:01.122348+0000 2024-09-19T06:11:58.980 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:0/1616091100 expires 2024-09-20T06:02:30.039686+0000 2024-09-19T06:11:58.980 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:6800/518259590 expires 2024-09-20T06:02:30.039686+0000 2024-09-19T06:11:58.980 INFO:teuthology.orchestra.run.smithi003.stdout:blocklist 172.21.15.3:0/2122482494 expires 2024-09-20T06:02:01.122348+0000 2024-09-19T06:11:58.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.978+0000 7f1c97400640 1 -- 172.21.15.3:0/2039082997 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f1c780a3300 msgr2=0x7f1c780a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:58.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.978+0000 7f1c97400640 1 --2- 172.21.15.3:0/2039082997 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f1c780a3300 0x7f1c780a57c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c031440 tx=0x7f1c7c0315b0 comp rx=0 tx=0).stop 2024-09-19T06:11:58.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.978+0000 7f1c97400640 1 -- 172.21.15.3:0/2039082997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c90076ba0 msgr2=0x7f1c9019e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:11:58.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.978+0000 7f1c97400640 1 --2- 172.21.15.3:0/2039082997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c90076ba0 0x7f1c9019e510 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400e9f0 tx=0x7f1c8400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:11:58.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.978+0000 7f1c97400640 1 -- 172.21.15.3:0/2039082997 shutdown_connections 2024-09-19T06:11:58.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.978+0000 7f1c97400640 1 --2- 172.21.15.3:0/2039082997 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f1c780a3300 0x7f1c780a57c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:58.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.978+0000 7f1c97400640 1 --2- 172.21.15.3:0/2039082997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1c90078790 0x7f1c901a5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:58.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.978+0000 7f1c97400640 1 --2- 172.21.15.3:0/2039082997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1c90077df0 0x7f1c9019ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:58.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.978+0000 7f1c97400640 1 --2- 172.21.15.3:0/2039082997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c90076ba0 0x7f1c9019e510 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:11:58.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.979+0000 7f1c97400640 1 -- 172.21.15.3:0/2039082997 >> 172.21.15.3:0/2039082997 conn(0x7f1c900ff5b0 msgr2=0x7f1c90101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:11:58.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.979+0000 7f1c97400640 1 -- 172.21.15.3:0/2039082997 shutdown_connections 2024-09-19T06:11:58.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:11:58.979+0000 7f1c97400640 1 -- 172.21.15.3:0/2039082997 wait complete. 2024-09-19T06:11:59.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:11:59 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2039082997' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T06:11:59.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:11:59 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2039082997' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T06:11:59.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:11:59 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2039082997' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T06:11:59.787 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T06:11:59.799 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:12:00.221 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:00.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:00 smithi003 ceph-mon[30893]: pgmap v362: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:12:00.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:00 smithi071 ceph-mon[35662]: pgmap v362: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:12:00.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:00 smithi059 ceph-mon[35138]: pgmap v362: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-19T06:12:00.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.867+0000 7fcd8b600640 1 -- 172.21.15.3:0/1751447694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd84077040 msgr2=0x7fcd841124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:00.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.867+0000 7fcd8b600640 1 --2- 172.21.15.3:0/1751447694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd84077040 0x7fcd841124f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcd70009900 tx=0x7fcd7002a3f0 comp rx=0 tx=0).stop 2024-09-19T06:12:00.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.867+0000 7fcd8b600640 1 -- 172.21.15.3:0/1751447694 shutdown_connections 2024-09-19T06:12:00.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.867+0000 7fcd8b600640 1 --2- 172.21.15.3:0/1751447694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd84112a30 0x7fcd84114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:00.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.867+0000 7fcd8b600640 1 --2- 172.21.15.3:0/1751447694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd84077040 0x7fcd841124f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:00.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.867+0000 7fcd8b600640 1 --2- 172.21.15.3:0/1751447694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd84076720 0x7fcd84076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:00.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.867+0000 7fcd8b600640 1 -- 172.21.15.3:0/1751447694 >> 172.21.15.3:0/1751447694 conn(0x7fcd840ffa90 msgr2=0x7fcd84101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:00.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.867+0000 7fcd8b600640 1 -- 172.21.15.3:0/1751447694 shutdown_connections 2024-09-19T06:12:00.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.867+0000 7fcd8b600640 1 -- 172.21.15.3:0/1751447694 wait complete. 2024-09-19T06:12:00.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.868+0000 7fcd8b600640 1 Processor -- start 2024-09-19T06:12:00.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.868+0000 7fcd8b600640 1 -- start start 2024-09-19T06:12:00.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.868+0000 7fcd8b600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd84076720 0x7fcd841a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:00.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.868+0000 7fcd8b600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd84077040 0x7fcd841a4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:00.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.868+0000 7fcd8b600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd84112a30 0x7fcd8419e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:00.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.868+0000 7fcd8b600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcd84118610 con 0x7fcd84077040 2024-09-19T06:12:00.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.868+0000 7fcd8b600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcd84118490 con 0x7fcd84112a30 2024-09-19T06:12:00.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.868+0000 7fcd8b600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcd84118790 con 0x7fcd84076720 2024-09-19T06:12:00.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.868+0000 7fcd83e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd84077040 0x7fcd841a4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:00.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.868+0000 7fcd83e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd84077040 0x7fcd841a4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45466/0 (socket says 172.21.15.3:45466) 2024-09-19T06:12:00.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.869+0000 7fcd83e00640 1 -- 172.21.15.3:0/713329791 learned_addr learned my addr 172.21.15.3:0/713329791 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:00.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.869+0000 7fcd88c00640 1 --2- 172.21.15.3:0/713329791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd84076720 0x7fcd841a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:00.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.869+0000 7fcd89600640 1 --2- 172.21.15.3:0/713329791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd84112a30 0x7fcd8419e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:00.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.869+0000 7fcd83e00640 1 -- 172.21.15.3:0/713329791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd84076720 msgr2=0x7fcd841a4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:00.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.869+0000 7fcd83e00640 1 --2- 172.21.15.3:0/713329791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd84076720 0x7fcd841a4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:00.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.869+0000 7fcd83e00640 1 -- 172.21.15.3:0/713329791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd84112a30 msgr2=0x7fcd8419e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:00.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.869+0000 7fcd83e00640 1 --2- 172.21.15.3:0/713329791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd84112a30 0x7fcd8419e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:00.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.869+0000 7fcd83e00640 1 -- 172.21.15.3:0/713329791 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8419f030 con 0x7fcd84077040 2024-09-19T06:12:00.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.869+0000 7fcd88c00640 1 --2- 172.21.15.3:0/713329791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd84076720 0x7fcd841a4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:00.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.869+0000 7fcd89600640 1 --2- 172.21.15.3:0/713329791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd84112a30 0x7fcd8419e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:00.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.869+0000 7fcd83e00640 1 --2- 172.21.15.3:0/713329791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd84077040 0x7fcd841a4c80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcd70004770 tx=0x7fcd70003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:00.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.870+0000 7fcd81600640 1 -- 172.21.15.3:0/713329791 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7003f070 con 0x7fcd84077040 2024-09-19T06:12:00.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.870+0000 7fcd81600640 1 -- 172.21.15.3:0/713329791 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd70031ca0 con 0x7fcd84077040 2024-09-19T06:12:00.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.870+0000 7fcd8b600640 1 -- 172.21.15.3:0/713329791 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd8419f2c0 con 0x7fcd84077040 2024-09-19T06:12:00.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.870+0000 7fcd81600640 1 -- 172.21.15.3:0/713329791 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd70035030 con 0x7fcd84077040 2024-09-19T06:12:00.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.870+0000 7fcd8b600640 1 -- 172.21.15.3:0/713329791 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd841ab610 con 0x7fcd84077040 2024-09-19T06:12:00.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.871+0000 7fcd8b600640 1 -- 172.21.15.3:0/713329791 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd84076b00 con 0x7fcd84077040 2024-09-19T06:12:00.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.873+0000 7fcd81600640 1 -- 172.21.15.3:0/713329791 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fcd70042070 con 0x7fcd84077040 2024-09-19T06:12:00.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.874+0000 7fcd81600640 1 --2- 172.21.15.3:0/713329791 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fcd6c0a3350 0x7fcd6c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:00.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.875+0000 7fcd81600640 1 -- 172.21.15.3:0/713329791 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fcd700f0060 con 0x7fcd84077040 2024-09-19T06:12:00.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.875+0000 7fcd88c00640 1 --2- 172.21.15.3:0/713329791 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fcd6c0a3350 0x7fcd6c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:00.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.875+0000 7fcd88c00640 1 --2- 172.21.15.3:0/713329791 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fcd6c0a3350 0x7fcd6c0a5810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcd8419fa40 tx=0x7fcd78005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:00.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:00.878+0000 7fcd81600640 1 -- 172.21.15.3:0/713329791 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcd700bcba0 con 0x7fcd84077040 2024-09-19T06:12:01.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:01.098+0000 7fcd81600640 1 -- 172.21.15.3:0/713329791 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fcd700b8b10 con 0x7fcd84077040 2024-09-19T06:12:01.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:01.105+0000 7fcd8b600640 1 -- 172.21.15.3:0/713329791 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd8419fe30 con 0x7fcd84077040 2024-09-19T06:12:01.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:01.106+0000 7fcd81600640 1 -- 172.21.15.3:0/713329791 <== mon.0 v2:172.21.15.3:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11941 (secure 0 0 0) 0x7fcd8419fe30 con 0x7fcd84077040 2024-09-19T06:12:01.107 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:12:01.107 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":28,"btime":"2024-09-19T06:10:19:770544+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:10:18.878479+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[14517,24514,24515,24532,24557]},"id":1}]} 2024-09-19T06:12:01.107 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 28 2024-09-19T06:12:01.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:01.108+0000 7fcd8b600640 1 -- 172.21.15.3:0/713329791 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fcd6c0a3350 msgr2=0x7fcd6c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:01.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:01.108+0000 7fcd8b600640 1 --2- 172.21.15.3:0/713329791 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fcd6c0a3350 0x7fcd6c0a5810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcd8419fa40 tx=0x7fcd78005f90 comp rx=0 tx=0).stop 2024-09-19T06:12:01.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:01.108+0000 7fcd8b600640 1 -- 172.21.15.3:0/713329791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd84077040 msgr2=0x7fcd841a4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:01.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:01.108+0000 7fcd8b600640 1 --2- 172.21.15.3:0/713329791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd84077040 0x7fcd841a4c80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcd70004770 tx=0x7fcd70003c10 comp rx=0 tx=0).stop 2024-09-19T06:12:01.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:01.108+0000 7fcd8b600640 1 -- 172.21.15.3:0/713329791 shutdown_connections 2024-09-19T06:12:01.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:01.108+0000 7fcd8b600640 1 --2- 172.21.15.3:0/713329791 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fcd6c0a3350 0x7fcd6c0a5810 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:01.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:01.108+0000 7fcd8b600640 1 --2- 172.21.15.3:0/713329791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd84112a30 0x7fcd8419e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:01.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:01.108+0000 7fcd8b600640 1 --2- 172.21.15.3:0/713329791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcd84077040 0x7fcd841a4c80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:01.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:01.108+0000 7fcd8b600640 1 --2- 172.21.15.3:0/713329791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcd84076720 0x7fcd841a4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:01.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:01.108+0000 7fcd8b600640 1 -- 172.21.15.3:0/713329791 >> 172.21.15.3:0/713329791 conn(0x7fcd840ffa90 msgr2=0x7fcd84101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:01.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:01.109+0000 7fcd8b600640 1 -- 172.21.15.3:0/713329791 shutdown_connections 2024-09-19T06:12:01.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:01.109+0000 7fcd8b600640 1 -- 172.21.15.3:0/713329791 wait complete. 2024-09-19T06:12:02.030 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:12:02.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:02 smithi003 ceph-mon[30893]: pgmap v363: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:12:02.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:02 smithi003 ceph-mon[30893]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-19T06:12:02.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:02 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/713329791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:02.412 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:02.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:02 smithi059 ceph-mon[35138]: pgmap v363: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:12:02.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:02 smithi059 ceph-mon[35138]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-19T06:12:02.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:02 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/713329791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:02.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:02 smithi071 ceph-mon[35662]: pgmap v363: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T06:12:02.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:02 smithi071 ceph-mon[35662]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-19T06:12:02.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:02 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/713329791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:03.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.001+0000 7fc86f800640 1 -- 172.21.15.3:0/3616570210 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc868076720 msgr2=0x7fc868076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:03.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.001+0000 7fc86f800640 1 --2- 172.21.15.3:0/3616570210 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc868076720 0x7fc868076b00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009900 tx=0x7fc85c02a410 comp rx=0 tx=0).stop 2024-09-19T06:12:03.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.001+0000 7fc86f800640 1 -- 172.21.15.3:0/3616570210 shutdown_connections 2024-09-19T06:12:03.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.001+0000 7fc86f800640 1 --2- 172.21.15.3:0/3616570210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc868112a50 0x7fc868114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:03.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.001+0000 7fc86f800640 1 --2- 172.21.15.3:0/3616570210 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc868077040 0x7fc868112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:03.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.001+0000 7fc86f800640 1 --2- 172.21.15.3:0/3616570210 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc868076720 0x7fc868076b00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:03.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.001+0000 7fc86f800640 1 -- 172.21.15.3:0/3616570210 >> 172.21.15.3:0/3616570210 conn(0x7fc8680ffa50 msgr2=0x7fc868101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:03.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.001+0000 7fc86f800640 1 -- 172.21.15.3:0/3616570210 shutdown_connections 2024-09-19T06:12:03.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.001+0000 7fc86f800640 1 -- 172.21.15.3:0/3616570210 wait complete. 2024-09-19T06:12:03.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.002+0000 7fc86f800640 1 Processor -- start 2024-09-19T06:12:03.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.003+0000 7fc86f800640 1 -- start start 2024-09-19T06:12:03.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.003+0000 7fc86f800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc868076720 0x7fc8681a47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:03.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.003+0000 7fc86f800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc868077040 0x7fc8681a4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:03.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.003+0000 7fc86f800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc868112a50 0x7fc86819e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:03.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.003+0000 7fc86f800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc8681185c0 con 0x7fc868076720 2024-09-19T06:12:03.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.003+0000 7fc86f800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc868118440 con 0x7fc868077040 2024-09-19T06:12:03.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.003+0000 7fc86f800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc868118740 con 0x7fc868112a50 2024-09-19T06:12:03.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.004+0000 7fc86ce00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc868076720 0x7fc8681a47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:03.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.004+0000 7fc86ce00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc868076720 0x7fc8681a47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45488/0 (socket says 172.21.15.3:45488) 2024-09-19T06:12:03.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.004+0000 7fc86ce00640 1 -- 172.21.15.3:0/1076303800 learned_addr learned my addr 172.21.15.3:0/1076303800 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:03.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.004+0000 7fc867e00640 1 --2- 172.21.15.3:0/1076303800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc868077040 0x7fc8681a4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:03.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.004+0000 7fc86d800640 1 --2- 172.21.15.3:0/1076303800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc868112a50 0x7fc86819e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:03.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.004+0000 7fc86ce00640 1 -- 172.21.15.3:0/1076303800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc868112a50 msgr2=0x7fc86819e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:03.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.004+0000 7fc86ce00640 1 --2- 172.21.15.3:0/1076303800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc868112a50 0x7fc86819e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:03.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.004+0000 7fc86ce00640 1 -- 172.21.15.3:0/1076303800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc868077040 msgr2=0x7fc8681a4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:03.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.004+0000 7fc86ce00640 1 --2- 172.21.15.3:0/1076303800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc868077040 0x7fc8681a4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:03.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.004+0000 7fc86ce00640 1 -- 172.21.15.3:0/1076303800 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc86819f0e0 con 0x7fc868076720 2024-09-19T06:12:03.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.004+0000 7fc867e00640 1 --2- 172.21.15.3:0/1076303800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc868077040 0x7fc8681a4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:03.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.004+0000 7fc86ce00640 1 --2- 172.21.15.3:0/1076303800 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc868076720 0x7fc8681a47f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc85c006010 tx=0x7fc85c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:03.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.005+0000 7fc865600640 1 -- 172.21.15.3:0/1076303800 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85c03f030 con 0x7fc868076720 2024-09-19T06:12:03.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.005+0000 7fc865600640 1 -- 172.21.15.3:0/1076303800 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc85c003ce0 con 0x7fc868076720 2024-09-19T06:12:03.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.005+0000 7fc865600640 1 -- 172.21.15.3:0/1076303800 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85c035070 con 0x7fc868076720 2024-09-19T06:12:03.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.005+0000 7fc86f800640 1 -- 172.21.15.3:0/1076303800 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc86819f370 con 0x7fc868076720 2024-09-19T06:12:03.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.005+0000 7fc86f800640 1 -- 172.21.15.3:0/1076303800 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8681ab6c0 con 0x7fc868076720 2024-09-19T06:12:03.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.006+0000 7fc86f800640 1 -- 172.21.15.3:0/1076303800 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc868077e60 con 0x7fc868076720 2024-09-19T06:12:03.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.008+0000 7fc865600640 1 -- 172.21.15.3:0/1076303800 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fc85c042030 con 0x7fc868076720 2024-09-19T06:12:03.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.010+0000 7fc865600640 1 --2- 172.21.15.3:0/1076303800 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc8500a32c0 0x7fc8500a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:03.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.010+0000 7fc865600640 1 -- 172.21.15.3:0/1076303800 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fc85c0efe40 con 0x7fc868076720 2024-09-19T06:12:03.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.010+0000 7fc867e00640 1 --2- 172.21.15.3:0/1076303800 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc8500a32c0 0x7fc8500a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:03.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.011+0000 7fc867e00640 1 --2- 172.21.15.3:0/1076303800 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc8500a32c0 0x7fc8500a5780 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc8680792b0 tx=0x7fc85400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:03.015 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.014+0000 7fc865600640 1 -- 172.21.15.3:0/1076303800 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc85c0bc550 con 0x7fc868076720 2024-09-19T06:12:03.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.239+0000 7fc86f800640 1 -- 172.21.15.3:0/1076303800 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc86810dbe0 con 0x7fc868076720 2024-09-19T06:12:03.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.240+0000 7fc865600640 1 -- 172.21.15.3:0/1076303800 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11941 (secure 0 0 0) 0x7fc85c0c0850 con 0x7fc868076720 2024-09-19T06:12:03.242 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:12:03.243 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":28,"btime":"2024-09-19T06:10:19:770544+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:10:18.878479+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[14517,24514,24515,24532,24557]},"id":1}]} 2024-09-19T06:12:03.243 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 28 2024-09-19T06:12:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.242+0000 7fc86f800640 1 -- 172.21.15.3:0/1076303800 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc8500a32c0 msgr2=0x7fc8500a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.242+0000 7fc86f800640 1 --2- 172.21.15.3:0/1076303800 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc8500a32c0 0x7fc8500a5780 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc8680792b0 tx=0x7fc85400b410 comp rx=0 tx=0).stop 2024-09-19T06:12:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.242+0000 7fc86f800640 1 -- 172.21.15.3:0/1076303800 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc868076720 msgr2=0x7fc8681a47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.242+0000 7fc86f800640 1 --2- 172.21.15.3:0/1076303800 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc868076720 0x7fc8681a47f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc85c006010 tx=0x7fc85c0042f0 comp rx=0 tx=0).stop 2024-09-19T06:12:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.243+0000 7fc86f800640 1 -- 172.21.15.3:0/1076303800 shutdown_connections 2024-09-19T06:12:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.243+0000 7fc86f800640 1 --2- 172.21.15.3:0/1076303800 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fc8500a32c0 0x7fc8500a5780 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.243+0000 7fc86f800640 1 --2- 172.21.15.3:0/1076303800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc868112a50 0x7fc86819e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.243+0000 7fc86f800640 1 --2- 172.21.15.3:0/1076303800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc868077040 0x7fc8681a4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.243+0000 7fc86f800640 1 --2- 172.21.15.3:0/1076303800 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc868076720 0x7fc8681a47f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.243+0000 7fc86f800640 1 -- 172.21.15.3:0/1076303800 >> 172.21.15.3:0/1076303800 conn(0x7fc8680ffa50 msgr2=0x7fc868101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:03.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.243+0000 7fc86f800640 1 -- 172.21.15.3:0/1076303800 shutdown_connections 2024-09-19T06:12:03.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:03.243+0000 7fc86f800640 1 -- 172.21.15.3:0/1076303800 wait complete. 2024-09-19T06:12:04.072 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:12:04.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:04 smithi003 ceph-mon[30893]: pgmap v364: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-19T06:12:04.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:04 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1076303800' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:04.453 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:04.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:04 smithi059 ceph-mon[35138]: pgmap v364: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-19T06:12:04.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:04 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1076303800' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:04.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:04 smithi071 ceph-mon[35662]: pgmap v364: 97 pgs: 97 active+clean; 642 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-19T06:12:04.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:04 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1076303800' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:05.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.057+0000 7f85fae00640 1 -- 172.21.15.3:0/102048129 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85f4104010 msgr2=0x7f85f41043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:05.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.057+0000 7f85fae00640 1 --2- 172.21.15.3:0/102048129 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85f4104010 0x7f85f41043f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f85e4009900 tx=0x7f85e402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:12:05.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.057+0000 7f85fae00640 1 -- 172.21.15.3:0/102048129 shutdown_connections 2024-09-19T06:12:05.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.057+0000 7f85fae00640 1 --2- 172.21.15.3:0/102048129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f4109140 0x7f85f4110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:05.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.057+0000 7f85fae00640 1 --2- 172.21.15.3:0/102048129 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85f41049c0 0x7f85f4108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:05.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.057+0000 7f85fae00640 1 --2- 172.21.15.3:0/102048129 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85f4104010 0x7f85f41043f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:05.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.057+0000 7f85fae00640 1 -- 172.21.15.3:0/102048129 >> 172.21.15.3:0/102048129 conn(0x7f85f40ffa50 msgr2=0x7f85f4101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:05.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.057+0000 7f85fae00640 1 -- 172.21.15.3:0/102048129 shutdown_connections 2024-09-19T06:12:05.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.057+0000 7f85fae00640 1 -- 172.21.15.3:0/102048129 wait complete. 2024-09-19T06:12:05.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.058+0000 7f85fae00640 1 Processor -- start 2024-09-19T06:12:05.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.058+0000 7f85fae00640 1 -- start start 2024-09-19T06:12:05.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.059+0000 7f85fae00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85f4104010 0x7f85f419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:05.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.059+0000 7f85fae00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f41049c0 0x7f85f419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:05.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.059+0000 7f85fae00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85f4109140 0x7f85f419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:05.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.059+0000 7f85fae00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f85f41141b0 con 0x7f85f4109140 2024-09-19T06:12:05.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.059+0000 7f85fae00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f85f4114030 con 0x7f85f41049c0 2024-09-19T06:12:05.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.059+0000 7f85fae00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f85f4114330 con 0x7f85f4104010 2024-09-19T06:12:05.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.059+0000 7f85f8e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85f4109140 0x7f85f419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:05.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.059+0000 7f85f3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f41049c0 0x7f85f419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:05.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.059+0000 7f85f3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f41049c0 0x7f85f419ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:45278/0 (socket says 172.21.15.3:45278) 2024-09-19T06:12:05.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.059+0000 7f85f3400640 1 -- 172.21.15.3:0/3370639078 learned_addr learned my addr 172.21.15.3:0/3370639078 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:05.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.059+0000 7f85f8e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85f4109140 0x7f85f419ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53594/0 (socket says 172.21.15.3:53594) 2024-09-19T06:12:05.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.059+0000 7f85f3e00640 1 --2- 172.21.15.3:0/3370639078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85f4104010 0x7f85f419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:05.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.059+0000 7f85f3400640 1 -- 172.21.15.3:0/3370639078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85f4104010 msgr2=0x7f85f419a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:05.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.059+0000 7f85f3400640 1 --2- 172.21.15.3:0/3370639078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85f4104010 0x7f85f419a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:05.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.059+0000 7f85f3400640 1 -- 172.21.15.3:0/3370639078 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85f4109140 msgr2=0x7f85f419ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:05.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.059+0000 7f85f3400640 1 --2- 172.21.15.3:0/3370639078 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85f4109140 0x7f85f419ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:05.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.059+0000 7f85f3400640 1 -- 172.21.15.3:0/3370639078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f419f5e0 con 0x7f85f41049c0 2024-09-19T06:12:05.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.060+0000 7f85f3400640 1 --2- 172.21.15.3:0/3370639078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f41049c0 0x7f85f419ab70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f85e000e9f0 tx=0x7f85e000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:05.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.060+0000 7f85f0c00640 1 -- 172.21.15.3:0/3370639078 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e000cd80 con 0x7f85f41049c0 2024-09-19T06:12:05.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.060+0000 7f85f0c00640 1 -- 172.21.15.3:0/3370639078 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85e0005500 con 0x7f85f41049c0 2024-09-19T06:12:05.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.060+0000 7f85f0c00640 1 -- 172.21.15.3:0/3370639078 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e0010690 con 0x7f85f41049c0 2024-09-19T06:12:05.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.060+0000 7f85fae00640 1 -- 172.21.15.3:0/3370639078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f419f8d0 con 0x7f85f41049c0 2024-09-19T06:12:05.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.060+0000 7f85fae00640 1 -- 172.21.15.3:0/3370639078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f41a71b0 con 0x7f85f41049c0 2024-09-19T06:12:05.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.061+0000 7f85fae00640 1 -- 172.21.15.3:0/3370639078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85f41043f0 con 0x7f85f41049c0 2024-09-19T06:12:05.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.063+0000 7f85f0c00640 1 -- 172.21.15.3:0/3370639078 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f85e00046c0 con 0x7f85f41049c0 2024-09-19T06:12:05.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.065+0000 7f85f0c00640 1 --2- 172.21.15.3:0/3370639078 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f85d80a32c0 0x7f85d80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:05.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.065+0000 7f85f0c00640 1 -- 172.21.15.3:0/3370639078 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f85e00cfef0 con 0x7f85f41049c0 2024-09-19T06:12:05.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.065+0000 7f85f3e00640 1 --2- 172.21.15.3:0/3370639078 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f85d80a32c0 0x7f85d80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:05.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.065+0000 7f85f3e00640 1 --2- 172.21.15.3:0/3370639078 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f85d80a32c0 0x7f85d80a5780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f85e4000c00 tx=0x7f85e4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:05.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.067+0000 7f85f0c00640 1 -- 172.21.15.3:0/3370639078 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f85e0054210 con 0x7f85f41049c0 2024-09-19T06:12:05.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.252+0000 7f85fae00640 1 -- 172.21.15.3:0/3370639078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f85f419b990 con 0x7f85f41049c0 2024-09-19T06:12:05.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.254+0000 7f85f0c00640 1 -- 172.21.15.3:0/3370639078 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22583 (secure 0 0 0) 0x7f85f419b990 con 0x7f85f41049c0 2024-09-19T06:12:05.256 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:12:05.256 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":88,"fsid":"782a5144-764c-11ef-bceb-c7b262605968","created":"2024-09-19T06:01:35.224753+0000","modified":"2024-09-19T06:10:31.811461+0000","last_up_change":"2024-09-19T06:09:02.478979+0000","last_in_change":"2024-09-19T06:08:38.865280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:04:56.654478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:09:58.426008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:10:01.215704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd89ea4b-a24e-4946-80fc-1776b6d05e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6803","nonce":2061486638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6805","nonce":2061486638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6809","nonce":2061486638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6807","nonce":2061486638}]},"public_addr":"172.21.15.3:6803/2061486638","cluster_addr":"172.21.15.3:6805/2061486638","heartbeat_back_addr":"172.21.15.3:6809/2061486638","heartbeat_front_addr":"172.21.15.3:6807/2061486638","state":["exists","up"]},{"osd":1,"uuid":"e03ca275-8da5-402f-9cd2-654ca422b9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6801","nonce":129318538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6803","nonce":129318538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6807","nonce":129318538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6805","nonce":129318538}]},"public_addr":"172.21.15.59:6801/129318538","cluster_addr":"172.21.15.59:6803/129318538","heartbeat_back_addr":"172.21.15.59:6807/129318538","heartbeat_front_addr":"172.21.15.59:6805/129318538","state":["exists","up"]},{"osd":2,"uuid":"62b7d36d-6078-4027-93b2-009be70a6d80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6801","nonce":2436210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6803","nonce":2436210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6807","nonce":2436210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6805","nonce":2436210695}]},"public_addr":"172.21.15.71:6801/2436210695","cluster_addr":"172.21.15.71:6803/2436210695","heartbeat_back_addr":"172.21.15.71:6807/2436210695","heartbeat_front_addr":"172.21.15.71:6805/2436210695","state":["exists","up"]},{"osd":3,"uuid":"ba33cc45-0103-443d-b262-622a505d9806","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6811","nonce":3577306700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6813","nonce":3577306700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6817","nonce":3577306700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6815","nonce":3577306700}]},"public_addr":"172.21.15.3:6811/3577306700","cluster_addr":"172.21.15.3:6813/3577306700","heartbeat_back_addr":"172.21.15.3:6817/3577306700","heartbeat_front_addr":"172.21.15.3:6815/3577306700","state":["exists","up"]},{"osd":4,"uuid":"40564c0c-6335-4207-a8e0-8078c9bfd015","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6809","nonce":4002980986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6811","nonce":4002980986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6815","nonce":4002980986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6813","nonce":4002980986}]},"public_addr":"172.21.15.59:6809/4002980986","cluster_addr":"172.21.15.59:6811/4002980986","heartbeat_back_addr":"172.21.15.59:6815/4002980986","heartbeat_front_addr":"172.21.15.59:6813/4002980986","state":["exists","up"]},{"osd":5,"uuid":"4db04b82-3403-4fd5-9eb7-7b81ed6b1d26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6809","nonce":2455500497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6811","nonce":2455500497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6815","nonce":2455500497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6813","nonce":2455500497}]},"public_addr":"172.21.15.71:6809/2455500497","cluster_addr":"172.21.15.71:6811/2455500497","heartbeat_back_addr":"172.21.15.71:6815/2455500497","heartbeat_front_addr":"172.21.15.71:6813/2455500497","state":["exists","up"]},{"osd":6,"uuid":"42a74f01-c5d0-4fc6-a8ee-a8bd84d4ab4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6819","nonce":823411903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6821","nonce":823411903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6825","nonce":823411903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6823","nonce":823411903}]},"public_addr":"172.21.15.3:6819/823411903","cluster_addr":"172.21.15.3:6821/823411903","heartbeat_back_addr":"172.21.15.3:6825/823411903","heartbeat_front_addr":"172.21.15.3:6823/823411903","state":["exists","up"]},{"osd":7,"uuid":"8a9bc2ec-4292-465d-8a0d-dda78521a319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6817","nonce":2133603853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6819","nonce":2133603853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6823","nonce":2133603853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6821","nonce":2133603853}]},"public_addr":"172.21.15.59:6817/2133603853","cluster_addr":"172.21.15.59:6819/2133603853","heartbeat_back_addr":"172.21.15.59:6823/2133603853","heartbeat_front_addr":"172.21.15.59:6821/2133603853","state":["exists","up"]},{"osd":8,"uuid":"6099a5c4-3504-43ca-8c58-d23f9096cd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6817","nonce":905333117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6819","nonce":905333117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6823","nonce":905333117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6821","nonce":905333117}]},"public_addr":"172.21.15.71:6817/905333117","cluster_addr":"172.21.15.71:6819/905333117","heartbeat_back_addr":"172.21.15.71:6823/905333117","heartbeat_front_addr":"172.21.15.71:6821/905333117","state":["exists","up"]},{"osd":9,"uuid":"b5a8aac6-bb10-4db8-a056-25228fbe754c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6827","nonce":124909267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6829","nonce":124909267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6833","nonce":124909267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6831","nonce":124909267}]},"public_addr":"172.21.15.3:6827/124909267","cluster_addr":"172.21.15.3:6829/124909267","heartbeat_back_addr":"172.21.15.3:6833/124909267","heartbeat_front_addr":"172.21.15.3:6831/124909267","state":["exists","up"]},{"osd":10,"uuid":"e49f3aab-0804-4aea-ae3f-38f022ab5239","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6825","nonce":784134238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6827","nonce":784134238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6831","nonce":784134238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6829","nonce":784134238}]},"public_addr":"172.21.15.59:6825/784134238","cluster_addr":"172.21.15.59:6827/784134238","heartbeat_back_addr":"172.21.15.59:6831/784134238","heartbeat_front_addr":"172.21.15.59:6829/784134238","state":["exists","up"]},{"osd":11,"uuid":"6c6d6c23-bcf7-43e7-94d1-5f2ebaa15441","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6825","nonce":3502550915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6827","nonce":3502550915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6831","nonce":3502550915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6829","nonce":3502550915}]},"public_addr":"172.21.15.71:6825/3502550915","cluster_addr":"172.21.15.71:6827/3502550915","heartbeat_back_addr":"172.21.15.71:6831/3502550915","heartbeat_front_addr":"172.21.15.71:6829/3502550915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:01.683342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:28.058683+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:53.250819+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:05:23.267377+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:05:49.756289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:06:15.766613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:06:46.054328+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:12.579180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:37.976863+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:08.683966+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:35.120765+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:00.624411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/1458736313":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/2065281908":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/953348594":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6801/518259590":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/1658697906":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6801/2386230415":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6800/2386230415":"2024-09-20T06:02:01.122348+0000","172.21.15.3:0/1616091100":"2024-09-20T06:02:30.039686+0000","172.21.15.3:6800/518259590":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/2122482494":"2024-09-20T06:02:01.122348+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:12:05.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.256+0000 7f85fae00640 1 -- 172.21.15.3:0/3370639078 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f85d80a32c0 msgr2=0x7f85d80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:05.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.256+0000 7f85fae00640 1 --2- 172.21.15.3:0/3370639078 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f85d80a32c0 0x7f85d80a5780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f85e4000c00 tx=0x7f85e4005b50 comp rx=0 tx=0).stop 2024-09-19T06:12:05.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.256+0000 7f85fae00640 1 -- 172.21.15.3:0/3370639078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f41049c0 msgr2=0x7f85f419ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:05.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.256+0000 7f85fae00640 1 --2- 172.21.15.3:0/3370639078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f41049c0 0x7f85f419ab70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f85e000e9f0 tx=0x7f85e000edf0 comp rx=0 tx=0).stop 2024-09-19T06:12:05.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.256+0000 7f85fae00640 1 -- 172.21.15.3:0/3370639078 shutdown_connections 2024-09-19T06:12:05.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.256+0000 7f85fae00640 1 --2- 172.21.15.3:0/3370639078 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f85d80a32c0 0x7f85d80a5780 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:05.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.256+0000 7f85fae00640 1 --2- 172.21.15.3:0/3370639078 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85f4109140 0x7f85f419ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:05.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.256+0000 7f85fae00640 1 --2- 172.21.15.3:0/3370639078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f41049c0 0x7f85f419ab70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:05.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.256+0000 7f85fae00640 1 --2- 172.21.15.3:0/3370639078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85f4104010 0x7f85f419a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:05.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.256+0000 7f85fae00640 1 -- 172.21.15.3:0/3370639078 >> 172.21.15.3:0/3370639078 conn(0x7f85f40ffa50 msgr2=0x7f85f4100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:05.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.257+0000 7f85fae00640 1 -- 172.21.15.3:0/3370639078 shutdown_connections 2024-09-19T06:12:05.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:05.257+0000 7f85fae00640 1 -- 172.21.15.3:0/3370639078 wait complete. 2024-09-19T06:12:06.055 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T06:10:03.693253+0000', 'modified': '2024-09-19T06:10:18.878479+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24557, 'mds_1': 24532, 'mds_2': 24515, 'mds_3': 24514, 'mds_4': 14517}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14505': {'gid': 14505, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.3:6839/2272422067', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.3:6838', 'nonce': 2272422067}, {'type': 'v1', 'addr': '172.21.15.3:6839', 'nonce': 2272422067}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14517': {'gid': 14517, 'name': 'a', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.3:6841/4189406134', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.3:6840', 'nonce': 4189406134}, {'type': 'v1', 'addr': '172.21.15.3:6841', 'nonce': 4189406134}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.71:6833/2883963583', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6832', 'nonce': 2883963583}, {'type': 'v1', 'addr': '172.21.15.71:6833', 'nonce': 2883963583}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24458': {'gid': 24458, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.59:6833/927949058', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 927949058}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 927949058}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24494': {'gid': 24494, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.59:6835/3846556695', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6834', 'nonce': 3846556695}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 3846556695}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24502': {'gid': 24502, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.71:6835/3322076004', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6834', 'nonce': 3322076004}, {'type': 'v1', 'addr': '172.21.15.71:6835', 'nonce': 3322076004}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24514': {'gid': 24514, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.71:6837/886513714', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6836', 'nonce': 886513714}, {'type': 'v1', 'addr': '172.21.15.71:6837', 'nonce': 886513714}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24515': {'gid': 24515, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.59:6837/4286779405', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6836', 'nonce': 4286779405}, {'type': 'v1', 'addr': '172.21.15.59:6837', 'nonce': 4286779405}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24532': {'gid': 24532, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.71:6839/3577136418', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6838', 'nonce': 3577136418}, {'type': 'v1', 'addr': '172.21.15.71:6839', 'nonce': 3577136418}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24557': {'gid': 24557, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.59:6839/3162585306', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6838', 'nonce': 3162585306}, {'type': 'v1', 'addr': '172.21.15.59:6839', 'nonce': 3162585306}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24557, 'qdb_cluster': [14517, 24514, 24515, 24532, 24557]} 2024-09-19T06:12:06.055 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-19T06:12:06.055 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.a status 2024-09-19T06:12:06.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:06 smithi003 ceph-mon[30893]: pgmap v365: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-19T06:12:06.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:06 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3370639078' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:12:06.434 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:06.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:06 smithi059 ceph-mon[35138]: pgmap v365: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-19T06:12:06.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:06 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/3370639078' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:12:06.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:06 smithi071 ceph-mon[35662]: pgmap v365: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-19T06:12:06.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:06 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/3370639078' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:12:07.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.021+0000 7ff02f200640 1 -- 172.21.15.3:0/1886769322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff030103e30 msgr2=0x7ff030104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:07.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.021+0000 7ff02f200640 1 --2- 172.21.15.3:0/1886769322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff030103e30 0x7ff030104210 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff020009900 tx=0x7ff02002a3f0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.021+0000 7ff02f200640 1 -- 172.21.15.3:0/1886769322 shutdown_connections 2024-09-19T06:12:07.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.021+0000 7ff02f200640 1 --2- 172.21.15.3:0/1886769322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff030108f60 0x7ff030110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.021+0000 7ff02f200640 1 --2- 172.21.15.3:0/1886769322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0301047e0 0x7ff030108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.021+0000 7ff02f200640 1 --2- 172.21.15.3:0/1886769322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff030103e30 0x7ff030104210 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.021+0000 7ff02f200640 1 -- 172.21.15.3:0/1886769322 >> 172.21.15.3:0/1886769322 conn(0x7ff0300ff8d0 msgr2=0x7ff030101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:07.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.021+0000 7ff02f200640 1 -- 172.21.15.3:0/1886769322 shutdown_connections 2024-09-19T06:12:07.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.021+0000 7ff02f200640 1 -- 172.21.15.3:0/1886769322 wait complete. 2024-09-19T06:12:07.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.022+0000 7ff02f200640 1 Processor -- start 2024-09-19T06:12:07.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.022+0000 7ff02f200640 1 -- start start 2024-09-19T06:12:07.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.022+0000 7ff02f200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff030103e30 0x7ff03019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:07.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.022+0000 7ff02f200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0301047e0 0x7ff03019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:07.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.022+0000 7ff02f200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff030108f60 0x7ff03019eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:07.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.022+0000 7ff02f200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff030114010 con 0x7ff0301047e0 2024-09-19T06:12:07.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.022+0000 7ff02f200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff030113e90 con 0x7ff030103e30 2024-09-19T06:12:07.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.022+0000 7ff02f200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff030114190 con 0x7ff030108f60 2024-09-19T06:12:07.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.023+0000 7ff02de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff030103e30 0x7ff03019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:07.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.023+0000 7ff027e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0301047e0 0x7ff03019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:07.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.023+0000 7ff02de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff030103e30 0x7ff03019a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:45294/0 (socket says 172.21.15.3:45294) 2024-09-19T06:12:07.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.023+0000 7ff02de00640 1 -- 172.21.15.3:0/4083356787 learned_addr learned my addr 172.21.15.3:0/4083356787 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:07.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.023+0000 7ff02e800640 1 --2- 172.21.15.3:0/4083356787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff030108f60 0x7ff03019eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:07.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.023+0000 7ff02de00640 1 -- 172.21.15.3:0/4083356787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff030108f60 msgr2=0x7ff03019eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:07.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.023+0000 7ff02de00640 1 --2- 172.21.15.3:0/4083356787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff030108f60 0x7ff03019eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.023+0000 7ff02de00640 1 -- 172.21.15.3:0/4083356787 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0301047e0 msgr2=0x7ff03019aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:07.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.023+0000 7ff02de00640 1 --2- 172.21.15.3:0/4083356787 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0301047e0 0x7ff03019aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.023+0000 7ff02de00640 1 -- 172.21.15.3:0/4083356787 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff03019f480 con 0x7ff030103e30 2024-09-19T06:12:07.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.023+0000 7ff027e00640 1 --2- 172.21.15.3:0/4083356787 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0301047e0 0x7ff03019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:07.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.023+0000 7ff02de00640 1 --2- 172.21.15.3:0/4083356787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff030103e30 0x7ff03019a4d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff020004770 tx=0x7ff020003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:07.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.024+0000 7ff026a00640 1 -- 172.21.15.3:0/4083356787 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02003f070 con 0x7ff030103e30 2024-09-19T06:12:07.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.024+0000 7ff02f200640 1 -- 172.21.15.3:0/4083356787 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff03019f710 con 0x7ff030103e30 2024-09-19T06:12:07.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.024+0000 7ff026a00640 1 -- 172.21.15.3:0/4083356787 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff020031ca0 con 0x7ff030103e30 2024-09-19T06:12:07.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.024+0000 7ff026a00640 1 -- 172.21.15.3:0/4083356787 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff020035030 con 0x7ff030103e30 2024-09-19T06:12:07.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.024+0000 7ff02f200640 1 -- 172.21.15.3:0/4083356787 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0301a7050 con 0x7ff030103e30 2024-09-19T06:12:07.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.028+0000 7ff037c7b740 1 Processor -- start 2024-09-19T06:12:07.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.028+0000 7ff037c7b740 1 -- start start 2024-09-19T06:12:07.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.028+0000 7ff037c7b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56355257a4e0 0x56355257a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:07.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.028+0000 7ff037c7b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56355257ae00 0x563552585180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:07.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.028+0000 7ff037c7b740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5635525856c0 0x563552587ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:07.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.028+0000 7ff037c7b740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5635524e00b0 con 0x5635525856c0 2024-09-19T06:12:07.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.028+0000 7ff037c7b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563552487ab0 con 0x56355257a4e0 2024-09-19T06:12:07.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.028+0000 7ff037c7b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5635524dc070 con 0x56355257ae00 2024-09-19T06:12:07.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.028+0000 7ff026a00640 1 -- 172.21.15.3:0/4083356787 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7ff020042070 con 0x7ff030103e30 2024-09-19T06:12:07.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.029+0000 7ff027e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5635525856c0 0x563552587ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:07.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.029+0000 7ff02e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56355257a4e0 0x56355257a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:07.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.029+0000 7ff027e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5635525856c0 0x563552587ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53624/0 (socket says 172.21.15.3:53624) 2024-09-19T06:12:07.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.029+0000 7ff027e00640 1 -- 172.21.15.3:0/2376680155 learned_addr learned my addr 172.21.15.3:0/2376680155 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:07.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.029+0000 7ff02de00640 1 --2- 172.21.15.3:0/2376680155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56355257ae00 0x563552585180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:07.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.029+0000 7ff027e00640 1 -- 172.21.15.3:0/2376680155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56355257ae00 msgr2=0x563552585180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:07.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.029+0000 7ff027e00640 1 --2- 172.21.15.3:0/2376680155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56355257ae00 0x563552585180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.029+0000 7ff027e00640 1 -- 172.21.15.3:0/2376680155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56355257a4e0 msgr2=0x56355257a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:07.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.029+0000 7ff027e00640 1 --2- 172.21.15.3:0/2376680155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56355257a4e0 0x56355257a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.029+0000 7ff027e00640 1 -- 172.21.15.3:0/2376680155 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635524944a0 con 0x5635525856c0 2024-09-19T06:12:07.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.029+0000 7ff02e800640 1 --2- 172.21.15.3:0/2376680155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56355257a4e0 0x56355257a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:07.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.030+0000 7ff027e00640 1 --2- 172.21.15.3:0/2376680155 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5635525856c0 0x563552587ab0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff0180114f0 tx=0x7ff0180119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63ca45b35a623aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:07.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.030+0000 7ff01f400640 1 -- 172.21.15.3:0/2376680155 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff018004020 con 0x5635525856c0 2024-09-19T06:12:07.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.030+0000 7ff01f400640 1 -- 172.21.15.3:0/2376680155 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0180041c0 con 0x5635525856c0 2024-09-19T06:12:07.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.030+0000 7ff01f400640 1 -- 172.21.15.3:0/2376680155 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01800f940 con 0x5635525856c0 2024-09-19T06:12:07.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.030+0000 7ff026a00640 1 --2- 172.21.15.3:0/4083356787 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff0140a3240 0x7ff0140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:07.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.030+0000 7ff026a00640 1 -- 172.21.15.3:0/4083356787 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7ff0200eff70 con 0x7ff030103e30 2024-09-19T06:12:07.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.030+0000 7ff037c7b740 1 -- 172.21.15.3:0/2376680155 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5635525856c0 msgr2=0x563552587ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:07.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.030+0000 7ff037c7b740 1 --2- 172.21.15.3:0/2376680155 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5635525856c0 0x563552587ab0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff0180114f0 tx=0x7ff0180119b0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.031+0000 7ff037c7b740 1 -- 172.21.15.3:0/2376680155 shutdown_connections 2024-09-19T06:12:07.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.031+0000 7ff037c7b740 1 --2- 172.21.15.3:0/2376680155 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5635525856c0 0x563552587ab0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.031+0000 7ff037c7b740 1 --2- 172.21.15.3:0/2376680155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56355257ae00 0x563552585180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.031+0000 7ff037c7b740 1 --2- 172.21.15.3:0/2376680155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56355257a4e0 0x56355257a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.031+0000 7ff037c7b740 1 -- 172.21.15.3:0/2376680155 >> 172.21.15.3:0/2376680155 conn(0x563552576a70 msgr2=0x563552576e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:07.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.031+0000 7ff02e800640 1 --2- 172.21.15.3:0/4083356787 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff0140a3240 0x7ff0140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:07.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.031+0000 7ff037c7b740 1 -- 172.21.15.3:0/2376680155 shutdown_connections 2024-09-19T06:12:07.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.031+0000 7ff037c7b740 1 -- 172.21.15.3:0/2376680155 wait complete. 2024-09-19T06:12:07.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.031+0000 7ff037c7b740 1 -- start start 2024-09-19T06:12:07.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.031+0000 7ff02e800640 1 --2- 172.21.15.3:0/4083356787 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff0140a3240 0x7ff0140a5700 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff028005fd0 tx=0x7ff028009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:07.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.031+0000 7ff037c7b740 1 Processor -- start 2024-09-19T06:12:07.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.032+0000 7ff037c7b740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56355257a4e0 0x563552582500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:07.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.032+0000 7ff037c7b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56355257ae00 0x563552582a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:07.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.032+0000 7ff037c7b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5635525856c0 0x563552582f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:07.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.032+0000 7ff037c7b740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563552588330 con 0x56355257a4e0 2024-09-19T06:12:07.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.032+0000 7ff037c7b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563552468920 con 0x5635525856c0 2024-09-19T06:12:07.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.032+0000 7ff037c7b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5635525884b0 con 0x56355257ae00 2024-09-19T06:12:07.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.032+0000 7ff037c7b740 10 client.0 _ll_register_callbacks cb 0x56355248c8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:07.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.032+0000 7ff02de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56355257a4e0 0x563552582500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:07.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.032+0000 7ff02de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56355257a4e0 0x563552582500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53634/0 (socket says 172.21.15.3:53634) 2024-09-19T06:12:07.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.032+0000 7ff02de00640 1 -- 172.21.15.3:0/2660881763 learned_addr learned my addr 172.21.15.3:0/2660881763 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:07.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.032+0000 7ff027e00640 1 --2- 172.21.15.3:0/2660881763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56355257ae00 0x563552582a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:07.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.032+0000 7ff02e800640 1 --2- 172.21.15.3:0/2660881763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5635525856c0 0x563552582f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:07.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.033+0000 7ff02de00640 1 -- 172.21.15.3:0/2660881763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56355257ae00 msgr2=0x563552582a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:07.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.033+0000 7ff02de00640 1 --2- 172.21.15.3:0/2660881763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56355257ae00 0x563552582a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.033+0000 7ff02de00640 1 -- 172.21.15.3:0/2660881763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5635525856c0 msgr2=0x563552582f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:07.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.033+0000 7ff02de00640 1 --2- 172.21.15.3:0/2660881763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5635525856c0 0x563552582f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.033+0000 7ff02de00640 1 -- 172.21.15.3:0/2660881763 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635522512b0 con 0x56355257a4e0 2024-09-19T06:12:07.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.033+0000 7ff02de00640 1 --2- 172.21.15.3:0/2660881763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56355257a4e0 0x563552582500 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff0200bc380 tx=0x7ff020031f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c67567457342f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:07.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.033+0000 7ff013e00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:12:07.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.033+0000 7ff013e00640 1 -- 172.21.15.3:0/2660881763 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff020049070 con 0x56355257a4e0 2024-09-19T06:12:07.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.033+0000 7ff013e00640 1 -- 172.21.15.3:0/2660881763 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7ff0200b8cf0 con 0x56355257a4e0 2024-09-19T06:12:07.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.033+0000 7ff037c7b740 1 -- 172.21.15.3:0/2660881763 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0180041c0 con 0x56355257a4e0 2024-09-19T06:12:07.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.033+0000 7ff013e00640 1 -- 172.21.15.3:0/2660881763 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff0200bc1c0 con 0x56355257a4e0 2024-09-19T06:12:07.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.034+0000 7ff037c7b740 10 client.15024 fetch_fsmap learned FSMap version 28 2024-09-19T06:12:07.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.034+0000 7ff037c7b740 1 -- 172.21.15.3:0/2660881763 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563552588330 con 0x56355257a4e0 2024-09-19T06:12:07.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.034+0000 7ff013e00640 1 -- 172.21.15.3:0/2660881763 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0180041c0 con 0x56355257a4e0 2024-09-19T06:12:07.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.034+0000 7ff013e00640 1 -- 172.21.15.3:0/2660881763 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff0200c4db0 con 0x56355257a4e0 2024-09-19T06:12:07.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.034+0000 7ff037c7b740 10 client.15024 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:12:07.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.034+0000 7ff037c7b740 10 client.15024 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T06:12:07.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.034+0000 7ff037c7b740 20 client.15024 populate_metadata read hostname 'smithi003' 2024-09-19T06:12:07.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.034+0000 7ff037c7b740 1 --2- 172.21.15.3:0/2660881763 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x563552596600 0x563552597a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:07.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.034+0000 7ff037c7b740 4 client.15024 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:12:07.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.034+0000 7ff037c7b740 1 -- 172.21.15.3:0/2660881763 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635524ed620 con 0x563552596600 2024-09-19T06:12:07.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.035+0000 7ff027e00640 1 --2- 172.21.15.3:0/2660881763 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x563552596600 0x563552597a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:07.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.035+0000 7ff027e00640 1 --2- 172.21.15.3:0/2660881763 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x563552596600 0x563552597a70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=af8b79701d782ba1 server_cookie=c773f1ea7c524a5d in_seq=0 out_seq=0 2024-09-19T06:12:07.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.035+0000 7ff013e00640 10 client.15024 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:12:07.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.036+0000 7ff013e00640 1 -- 172.21.15.3:0/2660881763 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5635524ed620 con 0x563552596600 2024-09-19T06:12:07.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.036+0000 7ff013e00640 10 client.15024 handle_command_reply: tid=0 2024-09-19T06:12:07.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.036+0000 7ff037c7b740 1 client.15024 shutdown 2024-09-19T06:12:07.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.036+0000 7ff037c7b740 1 -- 172.21.15.3:0/2660881763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56355257a4e0 msgr2=0x563552582500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:07.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.036+0000 7ff037c7b740 1 --2- 172.21.15.3:0/2660881763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56355257a4e0 0x563552582500 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff0200bc380 tx=0x7ff020031f10 comp rx=0 tx=0).stop 2024-09-19T06:12:07.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.036+0000 7ff037c7b740 1 -- 172.21.15.3:0/2660881763 shutdown_connections 2024-09-19T06:12:07.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.036+0000 7ff037c7b740 1 --2- 172.21.15.3:0/2660881763 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x563552596600 0x563552597a70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.036+0000 7ff037c7b740 1 --2- 172.21.15.3:0/2660881763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5635525856c0 0x563552582f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.036+0000 7ff037c7b740 1 --2- 172.21.15.3:0/2660881763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56355257ae00 0x563552582a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.036+0000 7ff037c7b740 1 --2- 172.21.15.3:0/2660881763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56355257a4e0 0x563552582500 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.036+0000 7ff013e00640 0 client.15024 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:12:07.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.036+0000 7ff037c7b740 1 -- 172.21.15.3:0/2660881763 >> 172.21.15.3:0/2660881763 conn(0x563552576a70 msgr2=0x56355257c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:07.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.036+0000 7ff037c7b740 1 -- 172.21.15.3:0/2660881763 shutdown_connections 2024-09-19T06:12:07.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.036+0000 7ff037c7b740 1 -- 172.21.15.3:0/2660881763 wait complete. 2024-09-19T06:12:07.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.037+0000 7ff037c7b740 20 client.15024 trim_cache size 0 max 16384 2024-09-19T06:12:07.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.055+0000 7ff037c7b740 1 Processor -- start 2024-09-19T06:12:07.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.055+0000 7ff037c7b740 1 -- start start 2024-09-19T06:12:07.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.056+0000 7ff037c7b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56355257a4e0 0x563552597a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:07.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.056+0000 7ff037c7b740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56355257ae00 0x56355257cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:07.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.056+0000 7ff037c7b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5635525856c0 0x563552581de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:07.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.056+0000 7ff037c7b740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563552595db0 con 0x56355257ae00 2024-09-19T06:12:07.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.056+0000 7ff037c7b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563552596480 con 0x56355257a4e0 2024-09-19T06:12:07.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.056+0000 7ff037c7b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563552596b50 con 0x5635525856c0 2024-09-19T06:12:07.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.056+0000 7ff027e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56355257ae00 0x56355257cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:07.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.056+0000 7ff027e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56355257ae00 0x56355257cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53650/0 (socket says 172.21.15.3:53650) 2024-09-19T06:12:07.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.056+0000 7ff027e00640 1 -- 172.21.15.3:0/1117600340 learned_addr learned my addr 172.21.15.3:0/1117600340 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:07.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.056+0000 7ff02de00640 1 --2- 172.21.15.3:0/1117600340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56355257a4e0 0x563552597a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:07.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.056+0000 7ff02e800640 1 --2- 172.21.15.3:0/1117600340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5635525856c0 0x563552581de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:07.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.056+0000 7ff027e00640 1 -- 172.21.15.3:0/1117600340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5635525856c0 msgr2=0x563552581de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:07.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.056+0000 7ff027e00640 1 --2- 172.21.15.3:0/1117600340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5635525856c0 0x563552581de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.056+0000 7ff027e00640 1 -- 172.21.15.3:0/1117600340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56355257a4e0 msgr2=0x563552597a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:07.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.056+0000 7ff027e00640 1 --2- 172.21.15.3:0/1117600340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56355257a4e0 0x563552597a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.056+0000 7ff027e00640 1 -- 172.21.15.3:0/1117600340 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563552580a50 con 0x56355257ae00 2024-09-19T06:12:07.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.056+0000 7ff02e800640 1 --2- 172.21.15.3:0/1117600340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5635525856c0 0x563552581de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:12:07.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.057+0000 7ff027e00640 1 --2- 172.21.15.3:0/1117600340 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56355257ae00 0x56355257cf40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff018003fb0 tx=0x7ff01800f5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a79767e8ebf2fd73 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:07.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.057+0000 7ff01ea00640 1 -- 172.21.15.3:0/1117600340 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff018004100 con 0x56355257ae00 2024-09-19T06:12:07.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.057+0000 7ff01ea00640 1 -- 172.21.15.3:0/1117600340 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0180042a0 con 0x56355257ae00 2024-09-19T06:12:07.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.057+0000 7ff01ea00640 1 -- 172.21.15.3:0/1117600340 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff018003ad0 con 0x56355257ae00 2024-09-19T06:12:07.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.057+0000 7ff037c7b740 1 -- 172.21.15.3:0/1117600340 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56355257ae00 msgr2=0x56355257cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:07.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.058+0000 7ff037c7b740 1 --2- 172.21.15.3:0/1117600340 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56355257ae00 0x56355257cf40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff018003fb0 tx=0x7ff01800f5c0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.058+0000 7ff037c7b740 1 -- 172.21.15.3:0/1117600340 shutdown_connections 2024-09-19T06:12:07.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.058+0000 7ff037c7b740 1 --2- 172.21.15.3:0/1117600340 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5635525856c0 0x563552581de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.058+0000 7ff037c7b740 1 --2- 172.21.15.3:0/1117600340 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56355257ae00 0x56355257cf40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.058+0000 7ff037c7b740 1 --2- 172.21.15.3:0/1117600340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56355257a4e0 0x563552597a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.058+0000 7ff037c7b740 1 -- 172.21.15.3:0/1117600340 >> 172.21.15.3:0/1117600340 conn(0x563552576a70 msgr2=0x563552583d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:07.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.058+0000 7ff037c7b740 1 -- 172.21.15.3:0/1117600340 shutdown_connections 2024-09-19T06:12:07.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.058+0000 7ff037c7b740 1 -- 172.21.15.3:0/1117600340 wait complete. 2024-09-19T06:12:07.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.058+0000 7ff037c7b740 1 -- start start 2024-09-19T06:12:07.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.058+0000 7ff037c7b740 1 Processor -- start 2024-09-19T06:12:07.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.059+0000 7ff037c7b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56355257a4e0 0x56355259ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:07.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.059+0000 7ff037c7b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56355257ae00 0x5635525a04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:07.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.059+0000 7ff037c7b740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5635525856c0 0x563552599290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:07.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.059+0000 7ff037c7b740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5635525978f0 con 0x5635525856c0 2024-09-19T06:12:07.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.059+0000 7ff037c7b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563552597220 con 0x56355257a4e0 2024-09-19T06:12:07.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.059+0000 7ff037c7b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563552597fc0 con 0x56355257ae00 2024-09-19T06:12:07.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.059+0000 7ff037c7b740 10 client.0 _ll_register_callbacks cb 0x7ff020005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:07.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.059+0000 7ff02e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5635525856c0 0x563552599290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:07.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.059+0000 7ff02de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56355257a4e0 0x56355259ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:07.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.059+0000 7ff02e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5635525856c0 0x563552599290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53664/0 (socket says 172.21.15.3:53664) 2024-09-19T06:12:07.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.059+0000 7ff02e800640 1 -- 172.21.15.3:0/982144671 learned_addr learned my addr 172.21.15.3:0/982144671 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:07.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.059+0000 7ff027e00640 1 --2- 172.21.15.3:0/982144671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56355257ae00 0x5635525a04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:07.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.059+0000 7ff02de00640 1 -- 172.21.15.3:0/982144671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56355257ae00 msgr2=0x5635525a04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:07.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.060+0000 7ff02de00640 1 --2- 172.21.15.3:0/982144671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56355257ae00 0x5635525a04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.060+0000 7ff02de00640 1 -- 172.21.15.3:0/982144671 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5635525856c0 msgr2=0x563552599290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:07.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.060+0000 7ff02de00640 1 --2- 172.21.15.3:0/982144671 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5635525856c0 0x563552599290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.060+0000 7ff02de00640 1 -- 172.21.15.3:0/982144671 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563552599ac0 con 0x56355257a4e0 2024-09-19T06:12:07.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.060+0000 7ff027e00640 1 --2- 172.21.15.3:0/982144671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56355257ae00 0x5635525a04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:07.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.060+0000 7ff02e800640 1 --2- 172.21.15.3:0/982144671 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5635525856c0 0x563552599290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:07.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.060+0000 7ff02de00640 1 --2- 172.21.15.3:0/982144671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56355257a4e0 0x56355259ff60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff0200b8ae0 tx=0x7ff0200f3930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=398c19afd3a53b34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:07.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.060+0000 7ff013e00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:12:07.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.060+0000 7ff013e00640 1 -- 172.21.15.3:0/982144671 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff020049040 con 0x56355257a4e0 2024-09-19T06:12:07.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.060+0000 7ff013e00640 1 -- 172.21.15.3:0/982144671 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7ff0200bbad0 con 0x56355257a4e0 2024-09-19T06:12:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.060+0000 7ff037c7b740 1 -- 172.21.15.3:0/982144671 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0180042a0 con 0x56355257a4e0 2024-09-19T06:12:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.060+0000 7ff013e00640 1 -- 172.21.15.3:0/982144671 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff020005d50 con 0x56355257a4e0 2024-09-19T06:12:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.060+0000 7ff037c7b740 10 client.25061 fetch_fsmap learned FSMap version 28 2024-09-19T06:12:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.060+0000 7ff037c7b740 1 -- 172.21.15.3:0/982144671 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56355259e560 con 0x56355257a4e0 2024-09-19T06:12:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.060+0000 7ff013e00640 1 -- 172.21.15.3:0/982144671 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0180042a0 con 0x56355257a4e0 2024-09-19T06:12:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.061+0000 7ff013e00640 1 -- 172.21.15.3:0/982144671 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff0200317c0 con 0x56355257a4e0 2024-09-19T06:12:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.061+0000 7ff037c7b740 10 client.25061 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:12:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.061+0000 7ff037c7b740 10 client.25061 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T06:12:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.061+0000 7ff037c7b740 20 client.25061 populate_metadata read hostname 'smithi003' 2024-09-19T06:12:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.061+0000 7ff037c7b740 1 --2- 172.21.15.3:0/982144671 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x563552605190 0x563552603ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.061+0000 7ff037c7b740 4 client.25061 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:12:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.061+0000 7ff037c7b740 1 -- 172.21.15.3:0/982144671 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "status"}) -- 0x5635524e7b30 con 0x563552605190 2024-09-19T06:12:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.061+0000 7ff027e00640 1 --2- 172.21.15.3:0/982144671 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x563552605190 0x563552603ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:07.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.062+0000 7ff027e00640 1 --2- 172.21.15.3:0/982144671 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x563552605190 0x563552603ea0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1d091b6f8dac9dd0 server_cookie=50bea88f675f8167 in_seq=0 out_seq=0 2024-09-19T06:12:07.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.062+0000 7ff013e00640 10 client.25061 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:12:07.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.062+0000 7ff013e00640 1 -- 172.21.15.3:0/982144671 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5635524e7b30 con 0x563552605190 2024-09-19T06:12:07.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.062+0000 7ff013e00640 10 client.25061 handle_command_reply: tid=0 2024-09-19T06:12:07.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.062+0000 7ff037c7b740 1 client.25061 shutdown 2024-09-19T06:12:07.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.062+0000 7ff037c7b740 1 -- 172.21.15.3:0/982144671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56355257a4e0 msgr2=0x56355259ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:07.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.062+0000 7ff037c7b740 1 --2- 172.21.15.3:0/982144671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56355257a4e0 0x56355259ff60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff0200b8ae0 tx=0x7ff0200f3930 comp rx=0 tx=0).stop 2024-09-19T06:12:07.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.062+0000 7ff037c7b740 1 -- 172.21.15.3:0/982144671 shutdown_connections 2024-09-19T06:12:07.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.062+0000 7ff037c7b740 1 --2- 172.21.15.3:0/982144671 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x563552605190 0x563552603ea0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.062+0000 7ff037c7b740 1 --2- 172.21.15.3:0/982144671 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5635525856c0 0x563552599290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.062+0000 7ff037c7b740 1 --2- 172.21.15.3:0/982144671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56355257ae00 0x5635525a04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.062+0000 7ff037c7b740 1 --2- 172.21.15.3:0/982144671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56355257a4e0 0x56355259ff60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.062+0000 7ff037c7b740 1 -- 172.21.15.3:0/982144671 >> 172.21.15.3:0/982144671 conn(0x563552576a70 msgr2=0x5635525957c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:07.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.062+0000 7ff013e00640 0 client.25061 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:12:07.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.062+0000 7ff037c7b740 1 -- 172.21.15.3:0/982144671 shutdown_connections 2024-09-19T06:12:07.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.062+0000 7ff037c7b740 1 -- 172.21.15.3:0/982144671 wait complete. 2024-09-19T06:12:07.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.063+0000 7ff037c7b740 20 client.25061 trim_cache size 0 max 16384 2024-09-19T06:12:07.069 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:12:07.069 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "782a5144-764c-11ef-bceb-c7b262605968", 2024-09-19T06:12:07.069 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 4, 2024-09-19T06:12:07.069 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 14517, 2024-09-19T06:12:07.069 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2024-09-19T06:12:07.069 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2024-09-19T06:12:07.069 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2024-09-19T06:12:07.070 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 110.300545062, 2024-09-19T06:12:07.070 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 28, 2024-09-19T06:12:07.070 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 88, 2024-09-19T06:12:07.070 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 86, 2024-09-19T06:12:07.070 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 139.76171562499999 2024-09-19T06:12:07.070 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:12:07.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.063+0000 7ff02f200640 1 -- 172.21.15.3:0/4083356787 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff0140a3240 msgr2=0x7ff0140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:07.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.063+0000 7ff02f200640 1 --2- 172.21.15.3:0/4083356787 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff0140a3240 0x7ff0140a5700 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff028005fd0 tx=0x7ff028009500 comp rx=0 tx=0).stop 2024-09-19T06:12:07.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.063+0000 7ff02f200640 1 -- 172.21.15.3:0/4083356787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff030103e30 msgr2=0x7ff03019a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:07.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.063+0000 7ff02f200640 1 --2- 172.21.15.3:0/4083356787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff030103e30 0x7ff03019a4d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff020004770 tx=0x7ff020003c10 comp rx=0 tx=0).stop 2024-09-19T06:12:07.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.063+0000 7ff02f200640 1 -- 172.21.15.3:0/4083356787 shutdown_connections 2024-09-19T06:12:07.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.063+0000 7ff02f200640 1 --2- 172.21.15.3:0/4083356787 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff0140a3240 0x7ff0140a5700 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.063+0000 7ff02f200640 1 --2- 172.21.15.3:0/4083356787 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff030108f60 0x7ff03019eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.063+0000 7ff02f200640 1 --2- 172.21.15.3:0/4083356787 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0301047e0 0x7ff03019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.063+0000 7ff02f200640 1 --2- 172.21.15.3:0/4083356787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff030103e30 0x7ff03019a4d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:07.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.063+0000 7ff02f200640 1 -- 172.21.15.3:0/4083356787 >> 172.21.15.3:0/4083356787 conn(0x7ff0300ff8d0 msgr2=0x7ff030100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:07.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.063+0000 7ff02f200640 1 -- 172.21.15.3:0/4083356787 shutdown_connections 2024-09-19T06:12:07.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:07.063+0000 7ff02f200640 1 -- 172.21.15.3:0/4083356787 wait complete. 2024-09-19T06:12:07.850 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T06:12:08.230 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:08.369 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:08 smithi003 ceph-mon[30893]: pgmap v366: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-19T06:12:08.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:08 smithi059 ceph-mon[35138]: pgmap v366: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-19T06:12:08.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:08 smithi071 ceph-mon[35662]: pgmap v366: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-19T06:12:08.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.825+0000 7fa976800640 1 -- 172.21.15.3:0/2235887509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa970103e30 msgr2=0x7fa970104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:08.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.825+0000 7fa976800640 1 --2- 172.21.15.3:0/2235887509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa970103e30 0x7fa970104210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa964009900 tx=0x7fa96402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.825+0000 7fa976800640 1 -- 172.21.15.3:0/2235887509 shutdown_connections 2024-09-19T06:12:08.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.825+0000 7fa976800640 1 --2- 172.21.15.3:0/2235887509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa970108f60 0x7fa970110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.825+0000 7fa976800640 1 --2- 172.21.15.3:0/2235887509 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9701047e0 0x7fa970108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.825+0000 7fa976800640 1 --2- 172.21.15.3:0/2235887509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa970103e30 0x7fa970104210 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.825+0000 7fa976800640 1 -- 172.21.15.3:0/2235887509 >> 172.21.15.3:0/2235887509 conn(0x7fa9700ff8d0 msgr2=0x7fa970101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:08.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.825+0000 7fa976800640 1 -- 172.21.15.3:0/2235887509 shutdown_connections 2024-09-19T06:12:08.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.825+0000 7fa976800640 1 -- 172.21.15.3:0/2235887509 wait complete. 2024-09-19T06:12:08.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.826+0000 7fa976800640 1 Processor -- start 2024-09-19T06:12:08.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.826+0000 7fa976800640 1 -- start start 2024-09-19T06:12:08.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.827+0000 7fa976800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa970103e30 0x7fa97019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:08.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.827+0000 7fa976800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9701047e0 0x7fa97019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:08.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.827+0000 7fa976800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa970108f60 0x7fa97019edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:08.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.827+0000 7fa976800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa970113fc0 con 0x7fa970108f60 2024-09-19T06:12:08.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.827+0000 7fa976800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa970113e40 con 0x7fa970103e30 2024-09-19T06:12:08.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.827+0000 7fa976800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa970114140 con 0x7fa9701047e0 2024-09-19T06:12:08.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.827+0000 7fa975e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa970108f60 0x7fa97019edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:08.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.827+0000 7fa975e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa970108f60 0x7fa97019edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53686/0 (socket says 172.21.15.3:53686) 2024-09-19T06:12:08.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.827+0000 7fa975e00640 1 -- 172.21.15.3:0/110210463 learned_addr learned my addr 172.21.15.3:0/110210463 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:08.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.827+0000 7fa975400640 1 --2- 172.21.15.3:0/110210463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa970103e30 0x7fa97019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:08.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.827+0000 7fa974a00640 1 --2- 172.21.15.3:0/110210463 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9701047e0 0x7fa97019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:08.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.828+0000 7fa975e00640 1 -- 172.21.15.3:0/110210463 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9701047e0 msgr2=0x7fa97019aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:08.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.828+0000 7fa975e00640 1 --2- 172.21.15.3:0/110210463 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9701047e0 0x7fa97019aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.828+0000 7fa975e00640 1 -- 172.21.15.3:0/110210463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa970103e30 msgr2=0x7fa97019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:08.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.828+0000 7fa975e00640 1 --2- 172.21.15.3:0/110210463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa970103e30 0x7fa97019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.828+0000 7fa975e00640 1 -- 172.21.15.3:0/110210463 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa97019f490 con 0x7fa970108f60 2024-09-19T06:12:08.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.828+0000 7fa975400640 1 --2- 172.21.15.3:0/110210463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa970103e30 0x7fa97019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:08.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.828+0000 7fa975e00640 1 --2- 172.21.15.3:0/110210463 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa970108f60 0x7fa97019edb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa96800eb10 tx=0x7fa96800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:08.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.828+0000 7fa96e000640 1 -- 172.21.15.3:0/110210463 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa968004b20 con 0x7fa970108f60 2024-09-19T06:12:08.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.828+0000 7fa96e000640 1 -- 172.21.15.3:0/110210463 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa968004cc0 con 0x7fa970108f60 2024-09-19T06:12:08.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.828+0000 7fa96e000640 1 -- 172.21.15.3:0/110210463 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa968010760 con 0x7fa970108f60 2024-09-19T06:12:08.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.828+0000 7fa976800640 1 -- 172.21.15.3:0/110210463 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa97019f780 con 0x7fa970108f60 2024-09-19T06:12:08.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.828+0000 7fa976800640 1 -- 172.21.15.3:0/110210463 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9701a7060 con 0x7fa970108f60 2024-09-19T06:12:08.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.833+0000 7fa97a80d740 1 Processor -- start 2024-09-19T06:12:08.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.833+0000 7fa96e000640 1 -- 172.21.15.3:0/110210463 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fa968005000 con 0x7fa970108f60 2024-09-19T06:12:08.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.833+0000 7fa97a80d740 1 -- start start 2024-09-19T06:12:08.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.833+0000 7fa97a80d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3c9b4f4e0 0x55d3c9b4f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:08.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.833+0000 7fa97a80d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b4fe00 0x55d3c9b5a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:08.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.833+0000 7fa97a80d740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d3c9b5a6c0 0x55d3c9b5cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:08.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.833+0000 7fa97a80d740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d3c9ab50b0 con 0x55d3c9b5a6c0 2024-09-19T06:12:08.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.833+0000 7fa97a80d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d3c9a5cab0 con 0x55d3c9b4fe00 2024-09-19T06:12:08.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.833+0000 7fa97a80d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d3c9ab1070 con 0x55d3c9b4f4e0 2024-09-19T06:12:08.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.834+0000 7fa974a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3c9b4f4e0 0x55d3c9b4f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:08.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.834+0000 7fa975400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b4fe00 0x55d3c9b5a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:08.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.834+0000 7fa975400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b4fe00 0x55d3c9b5a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:45366/0 (socket says 172.21.15.3:45366) 2024-09-19T06:12:08.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.834+0000 7fa974a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d3c9b5a6c0 0x55d3c9b5cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:08.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.834+0000 7fa975400640 1 -- 172.21.15.3:0/2712479273 learned_addr learned my addr 172.21.15.3:0/2712479273 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:08.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.834+0000 7fa975400640 1 -- 172.21.15.3:0/2712479273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3c9b4f4e0 msgr2=0x55d3c9b4f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:08.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.834+0000 7fa975400640 1 --2- 172.21.15.3:0/2712479273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3c9b4f4e0 0x55d3c9b4f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.834+0000 7fa975400640 1 -- 172.21.15.3:0/2712479273 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d3c9b5a6c0 msgr2=0x55d3c9b5cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:08.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.834+0000 7fa975400640 1 --2- 172.21.15.3:0/2712479273 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d3c9b5a6c0 0x55d3c9b5cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.834+0000 7fa975400640 1 -- 172.21.15.3:0/2712479273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3c9a694a0 con 0x55d3c9b4fe00 2024-09-19T06:12:08.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.834+0000 7fa974a00640 1 --2- 172.21.15.3:0/2712479273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3c9b4f4e0 0x55d3c9b4f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:12:08.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.834+0000 7fa975400640 1 --2- 172.21.15.3:0/2712479273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b4fe00 0x55d3c9b5a180 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa964009900 tx=0x7fa964005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e292feed36f4b20d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:08.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.835+0000 7fa962600640 1 -- 172.21.15.3:0/2712479273 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa964035040 con 0x55d3c9b4fe00 2024-09-19T06:12:08.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.835+0000 7fa962600640 1 -- 172.21.15.3:0/2712479273 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa964031830 con 0x55d3c9b4fe00 2024-09-19T06:12:08.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.835+0000 7fa962600640 1 -- 172.21.15.3:0/2712479273 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9640047a0 con 0x55d3c9b4fe00 2024-09-19T06:12:08.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.835+0000 7fa96e000640 1 --2- 172.21.15.3:0/110210463 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa9580a32c0 0x7fa9580a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:08.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.835+0000 7fa96e000640 1 -- 172.21.15.3:0/110210463 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fa9680cfd70 con 0x7fa970108f60 2024-09-19T06:12:08.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.835+0000 7fa974a00640 1 --2- 172.21.15.3:0/110210463 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa9580a32c0 0x7fa9580a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:08.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.835+0000 7fa97a80d740 1 -- 172.21.15.3:0/2712479273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b4fe00 msgr2=0x55d3c9b5a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:08.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.835+0000 7fa97a80d740 1 --2- 172.21.15.3:0/2712479273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b4fe00 0x55d3c9b5a180 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa964009900 tx=0x7fa964005d50 comp rx=0 tx=0).stop 2024-09-19T06:12:08.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.836+0000 7fa97a80d740 1 -- 172.21.15.3:0/2712479273 shutdown_connections 2024-09-19T06:12:08.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.836+0000 7fa97a80d740 1 --2- 172.21.15.3:0/2712479273 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d3c9b5a6c0 0x55d3c9b5cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.836+0000 7fa97a80d740 1 --2- 172.21.15.3:0/2712479273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b4fe00 0x55d3c9b5a180 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.836+0000 7fa97a80d740 1 --2- 172.21.15.3:0/2712479273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3c9b4f4e0 0x55d3c9b4f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.836+0000 7fa97a80d740 1 -- 172.21.15.3:0/2712479273 >> 172.21.15.3:0/2712479273 conn(0x55d3c9b4ba70 msgr2=0x55d3c9b4be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:08.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.836+0000 7fa97a80d740 1 -- 172.21.15.3:0/2712479273 shutdown_connections 2024-09-19T06:12:08.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.836+0000 7fa97a80d740 1 -- 172.21.15.3:0/2712479273 wait complete. 2024-09-19T06:12:08.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.836+0000 7fa974a00640 1 --2- 172.21.15.3:0/110210463 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa9580a32c0 0x7fa9580a5780 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55d3c9b4cdf0 tx=0x7fa95c004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:08.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.836+0000 7fa97a80d740 1 -- start start 2024-09-19T06:12:08.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.836+0000 7fa97a80d740 1 Processor -- start 2024-09-19T06:12:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.837+0000 7fa97a80d740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d3c9b4f4e0 0x55d3c9b57580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.837+0000 7fa97a80d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b4fe00 0x55d3c9b57ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.837+0000 7fa97a80d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3c9b5a6c0 0x55d3c9b58000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.837+0000 7fa97a80d740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d3c9b5d330 con 0x55d3c9b4f4e0 2024-09-19T06:12:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.837+0000 7fa97a80d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d3c9a3d920 con 0x55d3c9b4fe00 2024-09-19T06:12:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.837+0000 7fa97a80d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d3c9b5d4b0 con 0x55d3c9b5a6c0 2024-09-19T06:12:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.837+0000 7fa97a80d740 10 client.0 _ll_register_callbacks cb 0x55d3c9a618a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.837+0000 7fa974a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b4fe00 0x55d3c9b57ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.837+0000 7fa975400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d3c9b4f4e0 0x55d3c9b57580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.837+0000 7fa974a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b4fe00 0x55d3c9b57ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:45380/0 (socket says 172.21.15.3:45380) 2024-09-19T06:12:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.837+0000 7fa975400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d3c9b4f4e0 0x55d3c9b57580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53704/0 (socket says 172.21.15.3:53704) 2024-09-19T06:12:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.837+0000 7fa974a00640 1 -- 172.21.15.3:0/3149201613 learned_addr learned my addr 172.21.15.3:0/3149201613 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.837+0000 7fa975e00640 1 --2- 172.21.15.3:0/3149201613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3c9b5a6c0 0x55d3c9b58000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.838+0000 7fa974a00640 1 -- 172.21.15.3:0/3149201613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3c9b5a6c0 msgr2=0x55d3c9b58000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.838+0000 7fa974a00640 1 --2- 172.21.15.3:0/3149201613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3c9b5a6c0 0x55d3c9b58000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.838+0000 7fa974a00640 1 -- 172.21.15.3:0/3149201613 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d3c9b4f4e0 msgr2=0x55d3c9b57580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.838+0000 7fa974a00640 1 --2- 172.21.15.3:0/3149201613 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d3c9b4f4e0 0x55d3c9b57580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.838+0000 7fa974a00640 1 -- 172.21.15.3:0/3149201613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3c98262b0 con 0x55d3c9b4fe00 2024-09-19T06:12:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.838+0000 7fa974a00640 1 --2- 172.21.15.3:0/3149201613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b4fe00 0x55d3c9b57ac0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa95c009670 tx=0x7fa95c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecab15ed75b0a40d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.838+0000 7fa956a00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:12:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.838+0000 7fa956a00640 1 -- 172.21.15.3:0/3149201613 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c02e060 con 0x55d3c9b4fe00 2024-09-19T06:12:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.838+0000 7fa97a80d740 1 -- 172.21.15.3:0/3149201613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa964031830 con 0x55d3c9b4fe00 2024-09-19T06:12:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.838+0000 7fa956a00640 1 -- 172.21.15.3:0/3149201613 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fa95c010dc0 con 0x55d3c9b4fe00 2024-09-19T06:12:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.839+0000 7fa956a00640 1 -- 172.21.15.3:0/3149201613 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa95c019040 con 0x55d3c9b4fe00 2024-09-19T06:12:08.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.839+0000 7fa97a80d740 10 client.25073 fetch_fsmap learned FSMap version 28 2024-09-19T06:12:08.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.839+0000 7fa97a80d740 1 -- 172.21.15.3:0/3149201613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d3c9b69060 con 0x55d3c9b4fe00 2024-09-19T06:12:08.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.839+0000 7fa956a00640 1 -- 172.21.15.3:0/3149201613 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa964031830 con 0x55d3c9b4fe00 2024-09-19T06:12:08.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.839+0000 7fa956a00640 1 -- 172.21.15.3:0/3149201613 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa95c028030 con 0x55d3c9b4fe00 2024-09-19T06:12:08.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.839+0000 7fa97a80d740 10 client.25073 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:12:08.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.839+0000 7fa97a80d740 10 client.25073 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T06:12:08.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.839+0000 7fa97a80d740 20 client.25073 populate_metadata read hostname 'smithi003' 2024-09-19T06:12:08.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.839+0000 7fa97a80d740 1 --2- 172.21.15.3:0/3149201613 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55d3c9b6b6a0 0x55d3c9b6cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:08.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.839+0000 7fa97a80d740 4 client.25073 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:12:08.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.839+0000 7fa97a80d740 1 -- 172.21.15.3:0/3149201613 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3c9ac2620 con 0x55d3c9b6b6a0 2024-09-19T06:12:08.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.840+0000 7fa975400640 1 --2- 172.21.15.3:0/3149201613 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55d3c9b6b6a0 0x55d3c9b6cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:08.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.840+0000 7fa975400640 1 --2- 172.21.15.3:0/3149201613 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55d3c9b6b6a0 0x55d3c9b6cb10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d88c2b0c528f45ba server_cookie=8f2bc76f49b81322 in_seq=0 out_seq=0 2024-09-19T06:12:08.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.840+0000 7fa956a00640 10 client.25073 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:12:08.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.841+0000 7fa956a00640 1 -- 172.21.15.3:0/3149201613 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d3c9ac2620 con 0x55d3c9b6b6a0 2024-09-19T06:12:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.841+0000 7fa956a00640 10 client.25073 handle_command_reply: tid=0 2024-09-19T06:12:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.841+0000 7fa97a80d740 1 client.25073 shutdown 2024-09-19T06:12:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.841+0000 7fa97a80d740 1 -- 172.21.15.3:0/3149201613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b4fe00 msgr2=0x55d3c9b57ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.841+0000 7fa97a80d740 1 --2- 172.21.15.3:0/3149201613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b4fe00 0x55d3c9b57ac0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa95c009670 tx=0x7fa95c0046c0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.841+0000 7fa97a80d740 1 -- 172.21.15.3:0/3149201613 shutdown_connections 2024-09-19T06:12:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.842+0000 7fa97a80d740 1 --2- 172.21.15.3:0/3149201613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3c9b5a6c0 0x55d3c9b58000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.842+0000 7fa97a80d740 1 --2- 172.21.15.3:0/3149201613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b4fe00 0x55d3c9b57ac0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.842+0000 7fa97a80d740 1 --2- 172.21.15.3:0/3149201613 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55d3c9b6b6a0 0x55d3c9b6cb10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.842+0000 7fa97a80d740 1 --2- 172.21.15.3:0/3149201613 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d3c9b4f4e0 0x55d3c9b57580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.842+0000 7fa97a80d740 1 -- 172.21.15.3:0/3149201613 >> 172.21.15.3:0/3149201613 conn(0x55d3c9b4ba70 msgr2=0x55d3c9b51750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.842+0000 7fa956a00640 0 client.25073 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:12:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.842+0000 7fa97a80d740 1 -- 172.21.15.3:0/3149201613 shutdown_connections 2024-09-19T06:12:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.842+0000 7fa97a80d740 1 -- 172.21.15.3:0/3149201613 wait complete. 2024-09-19T06:12:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.842+0000 7fa97a80d740 20 client.25073 trim_cache size 0 max 16384 2024-09-19T06:12:08.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.860+0000 7fa97a80d740 1 Processor -- start 2024-09-19T06:12:08.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.861+0000 7fa97a80d740 1 -- start start 2024-09-19T06:12:08.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.861+0000 7fa97a80d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b4f4e0 0x55d3c9b51f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:08.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.861+0000 7fa97a80d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3c9b4fe00 0x55d3c9b54800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:08.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.861+0000 7fa97a80d740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d3c9b5a6c0 0x55d3c9b54d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:08.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.861+0000 7fa97a80d740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d3c9b6ae50 con 0x55d3c9b5a6c0 2024-09-19T06:12:08.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.861+0000 7fa97a80d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d3c9b6b520 con 0x55d3c9b4f4e0 2024-09-19T06:12:08.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.861+0000 7fa97a80d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d3c9b6bbf0 con 0x55d3c9b4fe00 2024-09-19T06:12:08.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.861+0000 7fa975e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d3c9b5a6c0 0x55d3c9b54d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:08.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.861+0000 7fa975400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b4f4e0 0x55d3c9b51f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:08.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.861+0000 7fa975e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d3c9b5a6c0 0x55d3c9b54d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53706/0 (socket says 172.21.15.3:53706) 2024-09-19T06:12:08.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.861+0000 7fa975e00640 1 -- 172.21.15.3:0/2916923145 learned_addr learned my addr 172.21.15.3:0/2916923145 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:08.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.861+0000 7fa974a00640 1 --2- 172.21.15.3:0/2916923145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3c9b4fe00 0x55d3c9b54800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:08.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.862+0000 7fa975e00640 1 -- 172.21.15.3:0/2916923145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3c9b4fe00 msgr2=0x55d3c9b54800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:08.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.862+0000 7fa975e00640 1 --2- 172.21.15.3:0/2916923145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3c9b4fe00 0x55d3c9b54800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.862+0000 7fa975e00640 1 -- 172.21.15.3:0/2916923145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b4f4e0 msgr2=0x55d3c9b51f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:08.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.862+0000 7fa975e00640 1 --2- 172.21.15.3:0/2916923145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b4f4e0 0x55d3c9b51f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.862+0000 7fa975e00640 1 -- 172.21.15.3:0/2916923145 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3c9b4f310 con 0x55d3c9b5a6c0 2024-09-19T06:12:08.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.862+0000 7fa975400640 1 --2- 172.21.15.3:0/2916923145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b4f4e0 0x55d3c9b51f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:08.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.862+0000 7fa974a00640 1 --2- 172.21.15.3:0/2916923145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3c9b4fe00 0x55d3c9b54800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:08.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.862+0000 7fa975e00640 1 --2- 172.21.15.3:0/2916923145 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d3c9b5a6c0 0x55d3c9b54d40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa9680cd850 tx=0x7fa9680058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b59eef5ad46f88cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:08.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.862+0000 7fa961c00640 1 -- 172.21.15.3:0/2916923145 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9680b4070 con 0x55d3c9b5a6c0 2024-09-19T06:12:08.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.862+0000 7fa961c00640 1 -- 172.21.15.3:0/2916923145 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa96809ca70 con 0x55d3c9b5a6c0 2024-09-19T06:12:08.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.862+0000 7fa961c00640 1 -- 172.21.15.3:0/2916923145 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9680989e0 con 0x55d3c9b5a6c0 2024-09-19T06:12:08.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.863+0000 7fa97a80d740 1 -- 172.21.15.3:0/2916923145 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d3c9b5a6c0 msgr2=0x55d3c9b54d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:08.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.863+0000 7fa97a80d740 1 --2- 172.21.15.3:0/2916923145 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d3c9b5a6c0 0x55d3c9b54d40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa9680cd850 tx=0x7fa9680058d0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.863+0000 7fa97a80d740 1 -- 172.21.15.3:0/2916923145 shutdown_connections 2024-09-19T06:12:08.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.863+0000 7fa97a80d740 1 --2- 172.21.15.3:0/2916923145 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d3c9b5a6c0 0x55d3c9b54d40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.863+0000 7fa97a80d740 1 --2- 172.21.15.3:0/2916923145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3c9b4fe00 0x55d3c9b54800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.863+0000 7fa97a80d740 1 --2- 172.21.15.3:0/2916923145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b4f4e0 0x55d3c9b51f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.863+0000 7fa97a80d740 1 -- 172.21.15.3:0/2916923145 >> 172.21.15.3:0/2916923145 conn(0x55d3c9b4ba70 msgr2=0x55d3c9b55e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:08.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.863+0000 7fa97a80d740 1 -- 172.21.15.3:0/2916923145 shutdown_connections 2024-09-19T06:12:08.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.863+0000 7fa97a80d740 1 -- 172.21.15.3:0/2916923145 wait complete. 2024-09-19T06:12:08.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.863+0000 7fa97a80d740 1 -- start start 2024-09-19T06:12:08.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.864+0000 7fa97a80d740 1 Processor -- start 2024-09-19T06:12:08.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.864+0000 7fa97a80d740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d3c9b4f4e0 0x55d3c9b74de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:08.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.864+0000 7fa97a80d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3c9b4fe00 0x55d3c9b75320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:08.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.864+0000 7fa97a80d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b5a6c0 0x55d3c9b6fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:08.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.864+0000 7fa97a80d740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d3c9b6c990 con 0x55d3c9b4f4e0 2024-09-19T06:12:08.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.864+0000 7fa97a80d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d3c9b6c2c0 con 0x55d3c9b5a6c0 2024-09-19T06:12:08.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.864+0000 7fa97a80d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d3c9b6d060 con 0x55d3c9b4fe00 2024-09-19T06:12:08.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.864+0000 7fa97a80d740 10 client.0 _ll_register_callbacks cb 0x7fa95c021830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:08.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.864+0000 7fa975400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d3c9b4f4e0 0x55d3c9b74de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:08.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.864+0000 7fa974a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3c9b4fe00 0x55d3c9b75320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:08.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.864+0000 7fa974a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3c9b4fe00 0x55d3c9b75320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:48110/0 (socket says 172.21.15.3:48110) 2024-09-19T06:12:08.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.864+0000 7fa974a00640 1 -- 172.21.15.3:0/2710645552 learned_addr learned my addr 172.21.15.3:0/2710645552 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:08.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.864+0000 7fa975e00640 1 --2- 172.21.15.3:0/2710645552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b5a6c0 0x55d3c9b6fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:08.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.865+0000 7fa974a00640 1 -- 172.21.15.3:0/2710645552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b5a6c0 msgr2=0x55d3c9b6fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:08.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.865+0000 7fa974a00640 1 --2- 172.21.15.3:0/2710645552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b5a6c0 0x55d3c9b6fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.865+0000 7fa974a00640 1 -- 172.21.15.3:0/2710645552 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d3c9b4f4e0 msgr2=0x55d3c9b74de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:08.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.865+0000 7fa974a00640 1 --2- 172.21.15.3:0/2710645552 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d3c9b4f4e0 0x55d3c9b74de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.865+0000 7fa974a00640 1 -- 172.21.15.3:0/2710645552 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3c9b702d0 con 0x55d3c9b4fe00 2024-09-19T06:12:08.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.865+0000 7fa974a00640 1 --2- 172.21.15.3:0/2710645552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3c9b4fe00 0x55d3c9b75320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa95c010800 tx=0x7fa95c021740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d10bdba4fed6539d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:08.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.865+0000 7fa956a00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:12:08.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.865+0000 7fa956a00640 1 -- 172.21.15.3:0/2710645552 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c041060 con 0x55d3c9b4fe00 2024-09-19T06:12:08.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.865+0000 7fa97a80d740 1 -- 172.21.15.3:0/2710645552 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa96809ca70 con 0x55d3c9b4fe00 2024-09-19T06:12:08.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.865+0000 7fa956a00640 1 -- 172.21.15.3:0/2710645552 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fa95c03c430 con 0x55d3c9b4fe00 2024-09-19T06:12:08.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.866+0000 7fa956a00640 1 -- 172.21.15.3:0/2710645552 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa95c03c630 con 0x55d3c9b4fe00 2024-09-19T06:12:08.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.866+0000 7fa97a80d740 10 client.25087 fetch_fsmap learned FSMap version 28 2024-09-19T06:12:08.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.866+0000 7fa97a80d740 1 -- 172.21.15.3:0/2710645552 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d3c9bd64f0 con 0x55d3c9b4fe00 2024-09-19T06:12:08.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.866+0000 7fa956a00640 1 -- 172.21.15.3:0/2710645552 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa96809ca70 con 0x55d3c9b4fe00 2024-09-19T06:12:08.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.866+0000 7fa956a00640 1 -- 172.21.15.3:0/2710645552 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa95c028040 con 0x55d3c9b4fe00 2024-09-19T06:12:08.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.866+0000 7fa97a80d740 10 client.25087 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:12:08.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.866+0000 7fa97a80d740 10 client.25087 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T06:12:08.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.866+0000 7fa97a80d740 20 client.25087 populate_metadata read hostname 'smithi003' 2024-09-19T06:12:08.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.866+0000 7fa97a80d740 1 --2- 172.21.15.3:0/2710645552 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55d3c9bdb090 0x55d3c9bd9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:08.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.866+0000 7fa97a80d740 4 client.25087 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:12:08.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.866+0000 7fa97a80d740 1 -- 172.21.15.3:0/2710645552 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "status"}) -- 0x55d3c9abcb30 con 0x55d3c9bdb090 2024-09-19T06:12:08.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.867+0000 7fa975400640 1 --2- 172.21.15.3:0/2710645552 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55d3c9bdb090 0x55d3c9bd9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:08.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.867+0000 7fa975400640 1 --2- 172.21.15.3:0/2710645552 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55d3c9bdb090 0x55d3c9bd9da0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3e4d931234afbe0e server_cookie=e5809bf7a7007997 in_seq=0 out_seq=0 2024-09-19T06:12:08.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.867+0000 7fa956a00640 10 client.25087 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:12:08.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.867+0000 7fa956a00640 1 -- 172.21.15.3:0/2710645552 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55d3c9abcb30 con 0x55d3c9bdb090 2024-09-19T06:12:08.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.867+0000 7fa956a00640 10 client.25087 handle_command_reply: tid=0 2024-09-19T06:12:08.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.867+0000 7fa97a80d740 1 client.25087 shutdown 2024-09-19T06:12:08.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.867+0000 7fa97a80d740 1 -- 172.21.15.3:0/2710645552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3c9b4fe00 msgr2=0x55d3c9b75320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:08.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.867+0000 7fa97a80d740 1 --2- 172.21.15.3:0/2710645552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3c9b4fe00 0x55d3c9b75320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa95c010800 tx=0x7fa95c021740 comp rx=0 tx=0).stop 2024-09-19T06:12:08.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.868+0000 7fa97a80d740 1 -- 172.21.15.3:0/2710645552 shutdown_connections 2024-09-19T06:12:08.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.868+0000 7fa97a80d740 1 --2- 172.21.15.3:0/2710645552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d3c9b5a6c0 0x55d3c9b6fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.868+0000 7fa97a80d740 1 --2- 172.21.15.3:0/2710645552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d3c9b4fe00 0x55d3c9b75320 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.868+0000 7fa97a80d740 1 --2- 172.21.15.3:0/2710645552 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55d3c9bdb090 0x55d3c9bd9da0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.868+0000 7fa97a80d740 1 --2- 172.21.15.3:0/2710645552 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d3c9b4f4e0 0x55d3c9b74de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.868+0000 7fa956a00640 0 client.25087 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:12:08.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.868+0000 7fa97a80d740 1 -- 172.21.15.3:0/2710645552 >> 172.21.15.3:0/2710645552 conn(0x55d3c9b4ba70 msgr2=0x55d3c9b65700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:08.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.868+0000 7fa97a80d740 1 -- 172.21.15.3:0/2710645552 shutdown_connections 2024-09-19T06:12:08.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.868+0000 7fa97a80d740 1 -- 172.21.15.3:0/2710645552 wait complete. 2024-09-19T06:12:08.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.868+0000 7fa97a80d740 20 client.25087 trim_cache size 0 max 16384 2024-09-19T06:12:08.874 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:12:08.875 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "782a5144-764c-11ef-bceb-c7b262605968", 2024-09-19T06:12:08.875 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 3, 2024-09-19T06:12:08.875 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 24514, 2024-09-19T06:12:08.875 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2024-09-19T06:12:08.875 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2024-09-19T06:12:08.875 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2024-09-19T06:12:08.875 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 112.285574963, 2024-09-19T06:12:08.875 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 28, 2024-09-19T06:12:08.875 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 88, 2024-09-19T06:12:08.875 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 86, 2024-09-19T06:12:08.875 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 155.81573335900001 2024-09-19T06:12:08.875 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:12:08.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.869+0000 7fa976800640 1 -- 172.21.15.3:0/110210463 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa9580a32c0 msgr2=0x7fa9580a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:08.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.869+0000 7fa976800640 1 --2- 172.21.15.3:0/110210463 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa9580a32c0 0x7fa9580a5780 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55d3c9b4cdf0 tx=0x7fa95c004730 comp rx=0 tx=0).stop 2024-09-19T06:12:08.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.869+0000 7fa976800640 1 -- 172.21.15.3:0/110210463 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa970108f60 msgr2=0x7fa97019edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:08.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.869+0000 7fa976800640 1 --2- 172.21.15.3:0/110210463 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa970108f60 0x7fa97019edb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa96800eb10 tx=0x7fa96800c2d0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.869+0000 7fa976800640 1 -- 172.21.15.3:0/110210463 shutdown_connections 2024-09-19T06:12:08.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.869+0000 7fa976800640 1 --2- 172.21.15.3:0/110210463 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fa9580a32c0 0x7fa9580a5780 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.869+0000 7fa976800640 1 --2- 172.21.15.3:0/110210463 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa970108f60 0x7fa97019edb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.869+0000 7fa976800640 1 --2- 172.21.15.3:0/110210463 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa9701047e0 0x7fa97019aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.869+0000 7fa976800640 1 --2- 172.21.15.3:0/110210463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa970103e30 0x7fa97019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:08.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.869+0000 7fa976800640 1 -- 172.21.15.3:0/110210463 >> 172.21.15.3:0/110210463 conn(0x7fa9700ff8d0 msgr2=0x7fa970100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:08.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.869+0000 7fa976800640 1 -- 172.21.15.3:0/110210463 shutdown_connections 2024-09-19T06:12:08.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:08.869+0000 7fa976800640 1 -- 172.21.15.3:0/110210463 wait complete. 2024-09-19T06:12:09.680 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T06:12:10.058 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:10.228 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:10 smithi003 ceph-mon[30893]: pgmap v367: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-19T06:12:10.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:10 smithi059 ceph-mon[35138]: pgmap v367: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-19T06:12:10.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:10 smithi071 ceph-mon[35662]: pgmap v367: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-19T06:12:10.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.643+0000 7faffce00640 1 -- 172.21.15.3:0/464889306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faff8076720 msgr2=0x7faff8076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:10.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.643+0000 7faffce00640 1 --2- 172.21.15.3:0/464889306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faff8076720 0x7faff8076b00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fafe8009900 tx=0x7fafe802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.643+0000 7faffce00640 1 -- 172.21.15.3:0/464889306 shutdown_connections 2024-09-19T06:12:10.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.643+0000 7faffce00640 1 --2- 172.21.15.3:0/464889306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faff8112a30 0x7faff8114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.643+0000 7faffce00640 1 --2- 172.21.15.3:0/464889306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faff8077040 0x7faff81124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.643+0000 7faffce00640 1 --2- 172.21.15.3:0/464889306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faff8076720 0x7faff8076b00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.643+0000 7faffce00640 1 -- 172.21.15.3:0/464889306 >> 172.21.15.3:0/464889306 conn(0x7faff80ffa90 msgr2=0x7faff8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:10.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.643+0000 7faffce00640 1 -- 172.21.15.3:0/464889306 shutdown_connections 2024-09-19T06:12:10.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.643+0000 7faffce00640 1 -- 172.21.15.3:0/464889306 wait complete. 2024-09-19T06:12:10.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.644+0000 7faffce00640 1 Processor -- start 2024-09-19T06:12:10.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.644+0000 7faffce00640 1 -- start start 2024-09-19T06:12:10.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.644+0000 7faffce00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faff8076720 0x7faff81a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:10.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.644+0000 7faffce00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faff8077040 0x7faff81a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:10.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.645+0000 7faffce00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faff8112a30 0x7faff819e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:10.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.645+0000 7faffce00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7faff8118610 con 0x7faff8076720 2024-09-19T06:12:10.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.645+0000 7faffce00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faff8118490 con 0x7faff8112a30 2024-09-19T06:12:10.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.645+0000 7faffce00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faff8118790 con 0x7faff8077040 2024-09-19T06:12:10.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.645+0000 7faff5e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faff8076720 0x7faff81a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:10.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.645+0000 7faff5e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faff8076720 0x7faff81a4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53738/0 (socket says 172.21.15.3:53738) 2024-09-19T06:12:10.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.645+0000 7faff5e00640 1 -- 172.21.15.3:0/620842199 learned_addr learned my addr 172.21.15.3:0/620842199 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:10.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.645+0000 7fafefe00640 1 --2- 172.21.15.3:0/620842199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faff8077040 0x7faff81a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:10.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.645+0000 7faff6800640 1 --2- 172.21.15.3:0/620842199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faff8112a30 0x7faff819e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:10.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.645+0000 7faff5e00640 1 -- 172.21.15.3:0/620842199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faff8077040 msgr2=0x7faff81a4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:10.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.645+0000 7faff5e00640 1 --2- 172.21.15.3:0/620842199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faff8077040 0x7faff81a4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.645+0000 7faff5e00640 1 -- 172.21.15.3:0/620842199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faff8112a30 msgr2=0x7faff819e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:10.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.645+0000 7faff5e00640 1 --2- 172.21.15.3:0/620842199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faff8112a30 0x7faff819e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.645+0000 7faff5e00640 1 -- 172.21.15.3:0/620842199 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff819f010 con 0x7faff8076720 2024-09-19T06:12:10.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.646+0000 7faff5e00640 1 --2- 172.21.15.3:0/620842199 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faff8076720 0x7faff81a4720 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fafe8004770 tx=0x7fafe8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:10.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.646+0000 7fafeea00640 1 -- 172.21.15.3:0/620842199 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe803f070 con 0x7faff8076720 2024-09-19T06:12:10.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.646+0000 7fafeea00640 1 -- 172.21.15.3:0/620842199 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafe8031ca0 con 0x7faff8076720 2024-09-19T06:12:10.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.646+0000 7faffce00640 1 -- 172.21.15.3:0/620842199 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faff819f2a0 con 0x7faff8076720 2024-09-19T06:12:10.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.646+0000 7faffce00640 1 -- 172.21.15.3:0/620842199 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faff81ab5f0 con 0x7faff8076720 2024-09-19T06:12:10.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.646+0000 7fafeea00640 1 -- 172.21.15.3:0/620842199 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe8035030 con 0x7faff8076720 2024-09-19T06:12:10.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.649+0000 7fafeea00640 1 -- 172.21.15.3:0/620842199 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fafe8042070 con 0x7faff8076720 2024-09-19T06:12:10.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.649+0000 7fafff8c0740 1 Processor -- start 2024-09-19T06:12:10.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.650+0000 7fafff8c0740 1 -- start start 2024-09-19T06:12:10.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.650+0000 7fafff8c0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bab62c7330 0x55bab62c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:10.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.650+0000 7fafff8c0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7c50 0x55bab62d1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:10.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.650+0000 7fafff8c0740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bab62d2510 0x55bab62d4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:10.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.650+0000 7fafff8c0740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bab622d0b0 con 0x55bab62d2510 2024-09-19T06:12:10.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.650+0000 7fafff8c0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bab61d4ab0 con 0x55bab62c7330 2024-09-19T06:12:10.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.650+0000 7fafff8c0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bab6229070 con 0x55bab62c7c50 2024-09-19T06:12:10.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.650+0000 7faff6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bab62c7330 0x55bab62c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:10.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.650+0000 7faff5e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7c50 0x55bab62d1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:10.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.650+0000 7faff6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bab62c7330 0x55bab62c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:45414/0 (socket says 172.21.15.3:45414) 2024-09-19T06:12:10.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.650+0000 7faff6800640 1 -- 172.21.15.3:0/562722498 learned_addr learned my addr 172.21.15.3:0/562722498 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:10.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.650+0000 7fafefe00640 1 --2- 172.21.15.3:0/562722498 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bab62d2510 0x55bab62d4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:10.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.651+0000 7faff6800640 1 -- 172.21.15.3:0/562722498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7c50 msgr2=0x55bab62d1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:10.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.651+0000 7faff6800640 1 --2- 172.21.15.3:0/562722498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7c50 0x55bab62d1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.651+0000 7faff6800640 1 -- 172.21.15.3:0/562722498 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bab62d2510 msgr2=0x55bab62d4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:10.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.651+0000 7faff6800640 1 --2- 172.21.15.3:0/562722498 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bab62d2510 0x55bab62d4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.651+0000 7faff6800640 1 -- 172.21.15.3:0/562722498 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bab61e14a0 con 0x55bab62c7330 2024-09-19T06:12:10.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.651+0000 7fafeea00640 1 --2- 172.21.15.3:0/620842199 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fafdc0a3240 0x7fafdc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:10.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.651+0000 7faff6800640 1 --2- 172.21.15.3:0/562722498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bab62c7330 0x55bab62c7710 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faff0009f30 tx=0x7faff00118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f34ddd3f2ccf320 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:10.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.651+0000 7fafeea00640 1 -- 172.21.15.3:0/620842199 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fafe80efbc0 con 0x7faff8076720 2024-09-19T06:12:10.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.651+0000 7fafe7400640 1 -- 172.21.15.3:0/562722498 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0004d20 con 0x55bab62c7330 2024-09-19T06:12:10.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.651+0000 7faff5e00640 1 --2- 172.21.15.3:0/620842199 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fafdc0a3240 0x7fafdc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:10.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.651+0000 7fafe7400640 1 -- 172.21.15.3:0/562722498 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faff0004050 con 0x55bab62c7330 2024-09-19T06:12:10.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.651+0000 7fafe7400640 1 -- 172.21.15.3:0/562722498 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0005220 con 0x55bab62c7330 2024-09-19T06:12:10.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.652+0000 7fafff8c0740 1 -- 172.21.15.3:0/562722498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bab62c7330 msgr2=0x55bab62c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:10.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.652+0000 7faff5e00640 1 --2- 172.21.15.3:0/620842199 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fafdc0a3240 0x7fafdc0a5700 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fafe80c4960 tx=0x7fafe80f3600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:10.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.652+0000 7fafff8c0740 1 --2- 172.21.15.3:0/562722498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bab62c7330 0x55bab62c7710 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faff0009f30 tx=0x7faff00118d0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.652+0000 7fafff8c0740 1 -- 172.21.15.3:0/562722498 shutdown_connections 2024-09-19T06:12:10.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.652+0000 7fafff8c0740 1 --2- 172.21.15.3:0/562722498 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bab62d2510 0x55bab62d4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.652+0000 7fafff8c0740 1 --2- 172.21.15.3:0/562722498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7c50 0x55bab62d1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.652+0000 7fafff8c0740 1 --2- 172.21.15.3:0/562722498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bab62c7330 0x55bab62c7710 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.652+0000 7fafff8c0740 1 -- 172.21.15.3:0/562722498 >> 172.21.15.3:0/562722498 conn(0x55bab62c38c0 msgr2=0x55bab62c3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:10.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.653+0000 7fafff8c0740 1 -- 172.21.15.3:0/562722498 shutdown_connections 2024-09-19T06:12:10.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.653+0000 7fafff8c0740 1 -- 172.21.15.3:0/562722498 wait complete. 2024-09-19T06:12:10.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.653+0000 7fafff8c0740 1 -- start start 2024-09-19T06:12:10.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.653+0000 7fafff8c0740 1 Processor -- start 2024-09-19T06:12:10.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.654+0000 7fafff8c0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7330 0x55bab62cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:10.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.654+0000 7fafff8c0740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bab62c7c50 0x55bab62cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:10.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.654+0000 7fafff8c0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bab62d2510 0x55bab62cffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:10.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.654+0000 7fafff8c0740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bab62d5060 con 0x55bab62c7c50 2024-09-19T06:12:10.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.654+0000 7fafff8c0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bab61b5920 con 0x55bab62d2510 2024-09-19T06:12:10.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.654+0000 7fafff8c0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bab62d51e0 con 0x55bab62c7330 2024-09-19T06:12:10.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.654+0000 7fafff8c0740 10 client.0 _ll_register_callbacks cb 0x55bab61d98a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:10.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.654+0000 7fafefe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bab62c7c50 0x55bab62cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:10.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.654+0000 7faff6800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7330 0x55bab62cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:10.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.654+0000 7fafefe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bab62c7c50 0x55bab62cfa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53766/0 (socket says 172.21.15.3:53766) 2024-09-19T06:12:10.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.654+0000 7faff6800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7330 0x55bab62cf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:48148/0 (socket says 172.21.15.3:48148) 2024-09-19T06:12:10.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.654+0000 7fafefe00640 1 -- 172.21.15.3:0/494766489 learned_addr learned my addr 172.21.15.3:0/494766489 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:10.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.654+0000 7faff6800640 1 --2- 172.21.15.3:0/494766489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bab62d2510 0x55bab62cffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:10.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.655+0000 7fafefe00640 1 -- 172.21.15.3:0/494766489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7330 msgr2=0x55bab62cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:10.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.655+0000 7fafefe00640 1 --2- 172.21.15.3:0/494766489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7330 0x55bab62cf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.655+0000 7fafefe00640 1 -- 172.21.15.3:0/494766489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bab62d2510 msgr2=0x55bab62cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:10.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.655+0000 7fafefe00640 1 --2- 172.21.15.3:0/494766489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bab62d2510 0x55bab62cffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.655+0000 7fafefe00640 1 -- 172.21.15.3:0/494766489 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bab5f9e2b0 con 0x55bab62c7c50 2024-09-19T06:12:10.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.655+0000 7fafefe00640 1 --2- 172.21.15.3:0/494766489 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bab62c7c50 0x55bab62cfa60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fafe0012700 tx=0x7fafe0012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37591ba018e59852 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:10.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.655+0000 7fafdbe00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:12:10.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.655+0000 7fafdbe00640 1 -- 172.21.15.3:0/494766489 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe000f920 con 0x55bab62c7c50 2024-09-19T06:12:10.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.655+0000 7fafdbe00640 1 -- 172.21.15.3:0/494766489 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fafe000fac0 con 0x55bab62c7c50 2024-09-19T06:12:10.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.655+0000 7fafff8c0740 1 -- 172.21.15.3:0/494766489 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faff0004050 con 0x55bab62c7c50 2024-09-19T06:12:10.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.655+0000 7fafdbe00640 1 -- 172.21.15.3:0/494766489 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fafe000fcc0 con 0x55bab62c7c50 2024-09-19T06:12:10.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.655+0000 7fafff8c0740 10 client.15060 fetch_fsmap learned FSMap version 28 2024-09-19T06:12:10.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.656+0000 7fafff8c0740 1 -- 172.21.15.3:0/494766489 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bab62e0e10 con 0x55bab62c7c50 2024-09-19T06:12:10.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.656+0000 7fafdbe00640 1 -- 172.21.15.3:0/494766489 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faff0004050 con 0x55bab62c7c50 2024-09-19T06:12:10.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.656+0000 7fafdbe00640 1 -- 172.21.15.3:0/494766489 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fafe0026420 con 0x55bab62c7c50 2024-09-19T06:12:10.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.656+0000 7fafff8c0740 10 client.15060 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:12:10.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.656+0000 7fafff8c0740 10 client.15060 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T06:12:10.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.656+0000 7fafff8c0740 20 client.15060 populate_metadata read hostname 'smithi003' 2024-09-19T06:12:10.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.656+0000 7fafff8c0740 1 --2- 172.21.15.3:0/494766489 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55bab62e3440 0x55bab62e48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:10.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.656+0000 7fafff8c0740 4 client.15060 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:12:10.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.656+0000 7fafff8c0740 1 -- 172.21.15.3:0/494766489 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bab623a620 con 0x55bab62e3440 2024-09-19T06:12:10.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.657+0000 7faff6800640 1 --2- 172.21.15.3:0/494766489 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55bab62e3440 0x55bab62e48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:10.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.657+0000 7faff6800640 1 --2- 172.21.15.3:0/494766489 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55bab62e3440 0x55bab62e48b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fdeff7eb333e7ff server_cookie=2c8ba7e157479cad in_seq=0 out_seq=0 2024-09-19T06:12:10.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.657+0000 7fafdbe00640 10 client.15060 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:12:10.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.658+0000 7fafdbe00640 1 -- 172.21.15.3:0/494766489 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bab623a620 con 0x55bab62e3440 2024-09-19T06:12:10.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.658+0000 7fafdbe00640 10 client.15060 handle_command_reply: tid=0 2024-09-19T06:12:10.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.658+0000 7fafff8c0740 1 client.15060 shutdown 2024-09-19T06:12:10.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.658+0000 7fafff8c0740 1 -- 172.21.15.3:0/494766489 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bab62c7c50 msgr2=0x55bab62cfa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:10.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.658+0000 7fafff8c0740 1 --2- 172.21.15.3:0/494766489 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bab62c7c50 0x55bab62cfa60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fafe0012700 tx=0x7fafe0012bc0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.658+0000 7fafff8c0740 1 -- 172.21.15.3:0/494766489 shutdown_connections 2024-09-19T06:12:10.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.658+0000 7fafff8c0740 1 --2- 172.21.15.3:0/494766489 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55bab62e3440 0x55bab62e48b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.658+0000 7fafff8c0740 1 --2- 172.21.15.3:0/494766489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bab62d2510 0x55bab62cffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.658+0000 7fafff8c0740 1 --2- 172.21.15.3:0/494766489 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bab62c7c50 0x55bab62cfa60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.658+0000 7fafff8c0740 1 --2- 172.21.15.3:0/494766489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7330 0x55bab62cf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.658+0000 7fafdbe00640 0 client.15060 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:12:10.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.658+0000 7fafff8c0740 1 -- 172.21.15.3:0/494766489 >> 172.21.15.3:0/494766489 conn(0x55bab62c38c0 msgr2=0x55bab62c95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:10.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.658+0000 7fafff8c0740 1 -- 172.21.15.3:0/494766489 shutdown_connections 2024-09-19T06:12:10.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.658+0000 7fafff8c0740 1 -- 172.21.15.3:0/494766489 wait complete. 2024-09-19T06:12:10.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.659+0000 7fafff8c0740 20 client.15060 trim_cache size 0 max 16384 2024-09-19T06:12:10.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.677+0000 7fafff8c0740 1 Processor -- start 2024-09-19T06:12:10.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.677+0000 7fafff8c0740 1 -- start start 2024-09-19T06:12:10.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.678+0000 7fafff8c0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7330 0x55bab62cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:10.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.678+0000 7fafff8c0740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bab62c7c50 0x55bab62cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:10.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.678+0000 7fafff8c0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bab62d2510 0x55bab62ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:10.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.678+0000 7fafff8c0740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bab62e2bf0 con 0x55bab62c7c50 2024-09-19T06:12:10.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.678+0000 7fafff8c0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bab62e32c0 con 0x55bab62d2510 2024-09-19T06:12:10.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.678+0000 7fafff8c0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bab62e3990 con 0x55bab62c7330 2024-09-19T06:12:10.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.678+0000 7fafefe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bab62c7c50 0x55bab62cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:10.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.678+0000 7faff6800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7330 0x55bab62cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:10.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.678+0000 7faff6800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7330 0x55bab62cfdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:48152/0 (socket says 172.21.15.3:48152) 2024-09-19T06:12:10.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.678+0000 7faff6800640 1 -- 172.21.15.3:0/2536126741 learned_addr learned my addr 172.21.15.3:0/2536126741 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:10.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.678+0000 7faff6800640 1 --2- 172.21.15.3:0/2536126741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bab62d2510 0x55bab62ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:10.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.678+0000 7faff6800640 1 -- 172.21.15.3:0/2536126741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bab62d2510 msgr2=0x55bab62ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:10.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.678+0000 7faff6800640 1 --2- 172.21.15.3:0/2536126741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bab62d2510 0x55bab62ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.678+0000 7faff6800640 1 -- 172.21.15.3:0/2536126741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bab62c7c50 msgr2=0x55bab62cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:10.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.678+0000 7faff6800640 1 --2- 172.21.15.3:0/2536126741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bab62c7c50 0x55bab62cc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.678+0000 7faff6800640 1 -- 172.21.15.3:0/2536126741 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bab62e3e40 con 0x55bab62c7330 2024-09-19T06:12:10.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.678+0000 7fafefe00640 1 --2- 172.21.15.3:0/2536126741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bab62c7c50 0x55bab62cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:10.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.679+0000 7faff6800640 1 --2- 172.21.15.3:0/2536126741 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7330 0x55bab62cfdf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faff0009ed0 tx=0x7faff00118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e1b467528f0df00 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:10.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.679+0000 7fafe6a00640 1 -- 172.21.15.3:0/2536126741 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0005610 con 0x55bab62c7330 2024-09-19T06:12:10.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.679+0000 7fafe6a00640 1 -- 172.21.15.3:0/2536126741 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faff00057b0 con 0x55bab62c7330 2024-09-19T06:12:10.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.679+0000 7fafe6a00640 1 -- 172.21.15.3:0/2536126741 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff000f480 con 0x55bab62c7330 2024-09-19T06:12:10.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.680+0000 7fafff8c0740 1 -- 172.21.15.3:0/2536126741 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7330 msgr2=0x55bab62cfdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:10.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.680+0000 7fafff8c0740 1 --2- 172.21.15.3:0/2536126741 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7330 0x55bab62cfdf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faff0009ed0 tx=0x7faff00118d0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.680+0000 7fafff8c0740 1 -- 172.21.15.3:0/2536126741 shutdown_connections 2024-09-19T06:12:10.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.680+0000 7fafff8c0740 1 --2- 172.21.15.3:0/2536126741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bab62d2510 0x55bab62ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.680+0000 7fafff8c0740 1 --2- 172.21.15.3:0/2536126741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bab62c7c50 0x55bab62cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.680+0000 7fafff8c0740 1 --2- 172.21.15.3:0/2536126741 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7330 0x55bab62cfdf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.680+0000 7fafff8c0740 1 -- 172.21.15.3:0/2536126741 >> 172.21.15.3:0/2536126741 conn(0x55bab62c38c0 msgr2=0x55bab62cde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:10.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.680+0000 7fafff8c0740 1 -- 172.21.15.3:0/2536126741 shutdown_connections 2024-09-19T06:12:10.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.680+0000 7fafff8c0740 1 -- 172.21.15.3:0/2536126741 wait complete. 2024-09-19T06:12:10.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.680+0000 7fafff8c0740 1 -- start start 2024-09-19T06:12:10.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.681+0000 7fafff8c0740 1 Processor -- start 2024-09-19T06:12:10.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.681+0000 7fafff8c0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bab62c7330 0x55bab62ecdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:10.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.681+0000 7fafff8c0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7c50 0x55bab62ed330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:10.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.681+0000 7fafff8c0740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bab62d2510 0x55bab62e7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:10.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.681+0000 7fafff8c0740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bab62e4730 con 0x55bab62d2510 2024-09-19T06:12:10.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.681+0000 7fafff8c0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bab62e4060 con 0x55bab62c7330 2024-09-19T06:12:10.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.681+0000 7fafff8c0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bab62e4e00 con 0x55bab62c7c50 2024-09-19T06:12:10.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.681+0000 7fafff8c0740 10 client.0 _ll_register_callbacks cb 0x7fafe0009ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:10.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.681+0000 7fafefe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7c50 0x55bab62ed330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:10.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.681+0000 7faff6800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bab62d2510 0x55bab62e7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:10.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.681+0000 7fafefe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7c50 0x55bab62ed330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:48168/0 (socket says 172.21.15.3:48168) 2024-09-19T06:12:10.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.681+0000 7fafefe00640 1 -- 172.21.15.3:0/3612647477 learned_addr learned my addr 172.21.15.3:0/3612647477 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:10.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.681+0000 7faff6800640 1 --2- 172.21.15.3:0/3612647477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bab62c7330 0x55bab62ecdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:10.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.682+0000 7fafefe00640 1 -- 172.21.15.3:0/3612647477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bab62c7330 msgr2=0x55bab62ecdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:10.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.682+0000 7fafefe00640 1 --2- 172.21.15.3:0/3612647477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bab62c7330 0x55bab62ecdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.682+0000 7fafefe00640 1 -- 172.21.15.3:0/3612647477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bab62d2510 msgr2=0x55bab62e7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:10.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.682+0000 7fafefe00640 1 --2- 172.21.15.3:0/3612647477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bab62d2510 0x55bab62e7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.682+0000 7fafefe00640 1 -- 172.21.15.3:0/3612647477 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bab62e83e0 con 0x55bab62c7c50 2024-09-19T06:12:10.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.682+0000 7fafefe00640 1 --2- 172.21.15.3:0/3612647477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7c50 0x55bab62ed330 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x55bab62cedb0 tx=0x7fafe000fbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a2777af61a815c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:10.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.682+0000 7fafdbe00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:12:10.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.682+0000 7fafdbe00640 1 -- 172.21.15.3:0/3612647477 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe00050d0 con 0x55bab62c7c50 2024-09-19T06:12:10.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.682+0000 7fafff8c0740 1 -- 172.21.15.3:0/3612647477 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faff00057b0 con 0x55bab62c7c50 2024-09-19T06:12:10.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.682+0000 7fafdbe00640 1 -- 172.21.15.3:0/3612647477 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fafe0018040 con 0x55bab62c7c50 2024-09-19T06:12:10.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.683+0000 7fafdbe00640 1 -- 172.21.15.3:0/3612647477 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fafe0005270 con 0x55bab62c7c50 2024-09-19T06:12:10.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.683+0000 7fafff8c0740 10 client.25105 fetch_fsmap learned FSMap version 28 2024-09-19T06:12:10.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.683+0000 7fafff8c0740 1 -- 172.21.15.3:0/3612647477 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bab634e740 con 0x55bab62c7c50 2024-09-19T06:12:10.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.683+0000 7fafdbe00640 1 -- 172.21.15.3:0/3612647477 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faff00057b0 con 0x55bab62c7c50 2024-09-19T06:12:10.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.683+0000 7fafdbe00640 1 -- 172.21.15.3:0/3612647477 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fafe0003c30 con 0x55bab62c7c50 2024-09-19T06:12:10.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.683+0000 7fafff8c0740 10 client.25105 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:12:10.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.684+0000 7fafff8c0740 10 client.25105 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T06:12:10.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.684+0000 7fafff8c0740 20 client.25105 populate_metadata read hostname 'smithi003' 2024-09-19T06:12:10.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.684+0000 7fafff8c0740 1 --2- 172.21.15.3:0/3612647477 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55bab6353320 0x55bab6352030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:10.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.684+0000 7fafff8c0740 4 client.25105 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:12:10.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.684+0000 7fafff8c0740 1 -- 172.21.15.3:0/3612647477 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "status"}) -- 0x55bab6234b30 con 0x55bab6353320 2024-09-19T06:12:10.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.684+0000 7faff6800640 1 --2- 172.21.15.3:0/3612647477 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55bab6353320 0x55bab6352030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:10.689 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.684+0000 7faff6800640 1 --2- 172.21.15.3:0/3612647477 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55bab6353320 0x55bab6352030 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d4ab1c5008f689c2 server_cookie=6bbfa6b6b7b74b05 in_seq=0 out_seq=0 2024-09-19T06:12:10.689 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.684+0000 7fafdbe00640 10 client.25105 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:12:10.689 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.685+0000 7fafdbe00640 1 -- 172.21.15.3:0/3612647477 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55bab6234b30 con 0x55bab6353320 2024-09-19T06:12:10.689 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.685+0000 7fafdbe00640 10 client.25105 handle_command_reply: tid=0 2024-09-19T06:12:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.685+0000 7fafff8c0740 1 client.25105 shutdown 2024-09-19T06:12:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.685+0000 7fafff8c0740 1 -- 172.21.15.3:0/3612647477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7c50 msgr2=0x55bab62ed330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.685+0000 7fafff8c0740 1 --2- 172.21.15.3:0/3612647477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7c50 0x55bab62ed330 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x55bab62cedb0 tx=0x7fafe000fbd0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.685+0000 7fafff8c0740 1 -- 172.21.15.3:0/3612647477 shutdown_connections 2024-09-19T06:12:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.685+0000 7fafff8c0740 1 --2- 172.21.15.3:0/3612647477 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55bab6353320 0x55bab6352030 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.685+0000 7fafff8c0740 1 --2- 172.21.15.3:0/3612647477 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bab62d2510 0x55bab62e7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.685+0000 7fafff8c0740 1 --2- 172.21.15.3:0/3612647477 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bab62c7c50 0x55bab62ed330 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.685+0000 7fafff8c0740 1 --2- 172.21.15.3:0/3612647477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bab62c7330 0x55bab62ecdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.685+0000 7fafdbe00640 0 client.25105 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:12:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.685+0000 7fafff8c0740 1 -- 172.21.15.3:0/3612647477 >> 172.21.15.3:0/3612647477 conn(0x55bab62c38c0 msgr2=0x55bab62c8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.685+0000 7fafff8c0740 1 -- 172.21.15.3:0/3612647477 shutdown_connections 2024-09-19T06:12:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.685+0000 7fafff8c0740 1 -- 172.21.15.3:0/3612647477 wait complete. 2024-09-19T06:12:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.685+0000 7fafff8c0740 20 client.25105 trim_cache size 0 max 16384 2024-09-19T06:12:10.691 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:12:10.691 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "782a5144-764c-11ef-bceb-c7b262605968", 2024-09-19T06:12:10.691 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 2, 2024-09-19T06:12:10.691 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 24515, 2024-09-19T06:12:10.691 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2024-09-19T06:12:10.691 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2024-09-19T06:12:10.691 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2024-09-19T06:12:10.691 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 115.118645665, 2024-09-19T06:12:10.691 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 28, 2024-09-19T06:12:10.691 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 88, 2024-09-19T06:12:10.691 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 86, 2024-09-19T06:12:10.692 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 154.904415457 2024-09-19T06:12:10.692 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:12:10.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.686+0000 7faffce00640 1 -- 172.21.15.3:0/620842199 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fafdc0a3240 msgr2=0x7fafdc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:10.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.686+0000 7faffce00640 1 --2- 172.21.15.3:0/620842199 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fafdc0a3240 0x7fafdc0a5700 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fafe80c4960 tx=0x7fafe80f3600 comp rx=0 tx=0).stop 2024-09-19T06:12:10.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.686+0000 7faffce00640 1 -- 172.21.15.3:0/620842199 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faff8076720 msgr2=0x7faff81a4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:10.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.686+0000 7faffce00640 1 --2- 172.21.15.3:0/620842199 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faff8076720 0x7faff81a4720 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fafe8004770 tx=0x7fafe8003c10 comp rx=0 tx=0).stop 2024-09-19T06:12:10.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.686+0000 7faffce00640 1 -- 172.21.15.3:0/620842199 shutdown_connections 2024-09-19T06:12:10.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.686+0000 7faffce00640 1 --2- 172.21.15.3:0/620842199 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fafdc0a3240 0x7fafdc0a5700 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.686+0000 7faffce00640 1 --2- 172.21.15.3:0/620842199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faff8112a30 0x7faff819e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.686+0000 7faffce00640 1 --2- 172.21.15.3:0/620842199 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faff8077040 0x7faff81a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.686+0000 7faffce00640 1 --2- 172.21.15.3:0/620842199 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faff8076720 0x7faff81a4720 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:10.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.686+0000 7faffce00640 1 -- 172.21.15.3:0/620842199 >> 172.21.15.3:0/620842199 conn(0x7faff80ffa90 msgr2=0x7faff8101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:10.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.686+0000 7faffce00640 1 -- 172.21.15.3:0/620842199 shutdown_connections 2024-09-19T06:12:10.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:10.686+0000 7faffce00640 1 -- 172.21.15.3:0/620842199 wait complete. 2024-09-19T06:12:11.491 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T06:12:11.868 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:12.318 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:12 smithi003 ceph-mon[30893]: pgmap v368: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-19T06:12:12.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:12 smithi059 ceph-mon[35138]: pgmap v368: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-19T06:12:12.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.576+0000 7ff046a00640 1 -- 172.21.15.3:0/339641354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff040103ff0 msgr2=0x7ff0401043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:12.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.576+0000 7ff046a00640 1 --2- 172.21.15.3:0/339641354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff040103ff0 0x7ff0401043d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff030009860 tx=0x7ff03002a340 comp rx=0 tx=0).stop 2024-09-19T06:12:12.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.576+0000 7ff046a00640 1 -- 172.21.15.3:0/339641354 shutdown_connections 2024-09-19T06:12:12.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.576+0000 7ff046a00640 1 --2- 172.21.15.3:0/339641354 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff040109120 0x7ff040110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.576+0000 7ff046a00640 1 --2- 172.21.15.3:0/339641354 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff0401049a0 0x7ff0401089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.576+0000 7ff046a00640 1 --2- 172.21.15.3:0/339641354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff040103ff0 0x7ff0401043d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.576+0000 7ff046a00640 1 -- 172.21.15.3:0/339641354 >> 172.21.15.3:0/339641354 conn(0x7ff0400ffa90 msgr2=0x7ff040101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:12.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.576+0000 7ff046a00640 1 -- 172.21.15.3:0/339641354 shutdown_connections 2024-09-19T06:12:12.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.576+0000 7ff046a00640 1 -- 172.21.15.3:0/339641354 wait complete. 2024-09-19T06:12:12.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.577+0000 7ff046a00640 1 Processor -- start 2024-09-19T06:12:12.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.577+0000 7ff046a00640 1 -- start start 2024-09-19T06:12:12.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.578+0000 7ff046a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff040103ff0 0x7ff04019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:12.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.578+0000 7ff046a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0401049a0 0x7ff04019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:12.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.578+0000 7ff046a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff040109120 0x7ff04019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:12.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.578+0000 7ff046a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff040114140 con 0x7ff0401049a0 2024-09-19T06:12:12.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.578+0000 7ff046a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff040113fc0 con 0x7ff040109120 2024-09-19T06:12:12.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.578+0000 7ff046a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff0401142c0 con 0x7ff040103ff0 2024-09-19T06:12:12.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.578+0000 7ff037e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0401049a0 0x7ff04019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:12.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.578+0000 7ff037e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0401049a0 0x7ff04019ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53808/0 (socket says 172.21.15.3:53808) 2024-09-19T06:12:12.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.578+0000 7ff037e00640 1 -- 172.21.15.3:0/876750559 learned_addr learned my addr 172.21.15.3:0/876750559 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:12.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.578+0000 7ff03fe00640 1 --2- 172.21.15.3:0/876750559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff040103ff0 0x7ff04019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:12.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.578+0000 7ff044a00640 1 --2- 172.21.15.3:0/876750559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff040109120 0x7ff04019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:12.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.579+0000 7ff044a00640 1 -- 172.21.15.3:0/876750559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff040103ff0 msgr2=0x7ff04019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:12.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.579+0000 7ff044a00640 1 --2- 172.21.15.3:0/876750559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff040103ff0 0x7ff04019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.579+0000 7ff044a00640 1 -- 172.21.15.3:0/876750559 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0401049a0 msgr2=0x7ff04019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:12.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.579+0000 7ff044a00640 1 --2- 172.21.15.3:0/876750559 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0401049a0 0x7ff04019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.579+0000 7ff044a00640 1 -- 172.21.15.3:0/876750559 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04019f5f0 con 0x7ff040109120 2024-09-19T06:12:12.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.579+0000 7ff037e00640 1 --2- 172.21.15.3:0/876750559 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0401049a0 0x7ff04019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:12.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.579+0000 7ff03fe00640 1 --2- 172.21.15.3:0/876750559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff040103ff0 0x7ff04019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:12.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.579+0000 7ff044a00640 1 --2- 172.21.15.3:0/876750559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff040109120 0x7ff04019ef10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff03800efc0 tx=0x7ff03800c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:12.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.579+0000 7ff03d600640 1 -- 172.21.15.3:0/876750559 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff038003970 con 0x7ff040109120 2024-09-19T06:12:12.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.579+0000 7ff03d600640 1 -- 172.21.15.3:0/876750559 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff038004020 con 0x7ff040109120 2024-09-19T06:12:12.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.579+0000 7ff03d600640 1 -- 172.21.15.3:0/876750559 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03800b9f0 con 0x7ff040109120 2024-09-19T06:12:12.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.579+0000 7ff046a00640 1 -- 172.21.15.3:0/876750559 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff04019f8e0 con 0x7ff040109120 2024-09-19T06:12:12.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.580+0000 7ff046a00640 1 -- 172.21.15.3:0/876750559 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0401a71c0 con 0x7ff040109120 2024-09-19T06:12:12.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.583+0000 7ff048ffd740 1 Processor -- start 2024-09-19T06:12:12.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.583+0000 7ff03d600640 1 -- 172.21.15.3:0/876750559 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7ff03801d020 con 0x7ff040109120 2024-09-19T06:12:12.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.583+0000 7ff048ffd740 1 -- start start 2024-09-19T06:12:12.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.583+0000 7ff048ffd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baa3822330 0x55baa3822710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:12.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.583+0000 7ff048ffd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822c50 0x55baa382cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:12.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.583+0000 7ff048ffd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55baa382d510 0x55baa382f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:12.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.583+0000 7ff048ffd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55baa37880b0 con 0x55baa382d510 2024-09-19T06:12:12.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.583+0000 7ff048ffd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55baa372fab0 con 0x55baa3822330 2024-09-19T06:12:12.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.583+0000 7ff048ffd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55baa3784070 con 0x55baa3822c50 2024-09-19T06:12:12.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.584+0000 7ff03fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822c50 0x55baa382cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:12.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.583+0000 7ff037e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baa3822330 0x55baa3822710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:12.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.584+0000 7ff03fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822c50 0x55baa382cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:48196/0 (socket says 172.21.15.3:48196) 2024-09-19T06:12:12.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.584+0000 7ff03fe00640 1 -- 172.21.15.3:0/1200661133 learned_addr learned my addr 172.21.15.3:0/1200661133 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:12.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.584+0000 7ff037e00640 1 --2- 172.21.15.3:0/1200661133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55baa382d510 0x55baa382f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:12.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.584+0000 7ff03fe00640 1 -- 172.21.15.3:0/1200661133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baa3822330 msgr2=0x55baa3822710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:12.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.584+0000 7ff03fe00640 1 --2- 172.21.15.3:0/1200661133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baa3822330 0x55baa3822710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.584+0000 7ff03fe00640 1 -- 172.21.15.3:0/1200661133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55baa382d510 msgr2=0x55baa382f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:12.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.584+0000 7ff03fe00640 1 --2- 172.21.15.3:0/1200661133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55baa382d510 0x55baa382f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.584+0000 7ff03fe00640 1 -- 172.21.15.3:0/1200661133 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baa373c4a0 con 0x55baa3822c50 2024-09-19T06:12:12.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.584+0000 7ff03fe00640 1 --2- 172.21.15.3:0/1200661133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822c50 0x55baa382cfd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff03002a860 tx=0x7ff030009510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fa6d86446f6bf24 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:12.588 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:12 smithi071 ceph-mon[35662]: pgmap v368: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-19T06:12:12.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.585+0000 7ff035200640 1 -- 172.21.15.3:0/1200661133 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030037040 con 0x55baa3822c50 2024-09-19T06:12:12.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.585+0000 7ff035200640 1 -- 172.21.15.3:0/1200661133 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff030004230 con 0x55baa3822c50 2024-09-19T06:12:12.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.585+0000 7ff035200640 1 -- 172.21.15.3:0/1200661133 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030003c10 con 0x55baa3822c50 2024-09-19T06:12:12.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.585+0000 7ff03d600640 1 --2- 172.21.15.3:0/876750559 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff0240a32c0 0x7ff0240a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:12.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.585+0000 7ff03d600640 1 -- 172.21.15.3:0/876750559 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7ff0380cf710 con 0x7ff040109120 2024-09-19T06:12:12.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.585+0000 7ff037e00640 1 --2- 172.21.15.3:0/876750559 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff0240a32c0 0x7ff0240a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:12.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.586+0000 7ff048ffd740 1 -- 172.21.15.3:0/1200661133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822c50 msgr2=0x55baa382cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:12.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.586+0000 7ff048ffd740 1 --2- 172.21.15.3:0/1200661133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822c50 0x55baa382cfd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff03002a860 tx=0x7ff030009510 comp rx=0 tx=0).stop 2024-09-19T06:12:12.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.586+0000 7ff048ffd740 1 -- 172.21.15.3:0/1200661133 shutdown_connections 2024-09-19T06:12:12.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.586+0000 7ff048ffd740 1 --2- 172.21.15.3:0/1200661133 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55baa382d510 0x55baa382f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.586+0000 7ff048ffd740 1 --2- 172.21.15.3:0/1200661133 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822c50 0x55baa382cfd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.586+0000 7ff048ffd740 1 --2- 172.21.15.3:0/1200661133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baa3822330 0x55baa3822710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.586+0000 7ff048ffd740 1 -- 172.21.15.3:0/1200661133 >> 172.21.15.3:0/1200661133 conn(0x55baa381e8c0 msgr2=0x55baa381eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:12.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.586+0000 7ff037e00640 1 --2- 172.21.15.3:0/876750559 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff0240a32c0 0x7ff0240a5780 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55baa381fc40 tx=0x7ff028005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:12.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.586+0000 7ff048ffd740 1 -- 172.21.15.3:0/1200661133 shutdown_connections 2024-09-19T06:12:12.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.586+0000 7ff048ffd740 1 -- 172.21.15.3:0/1200661133 wait complete. 2024-09-19T06:12:12.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.586+0000 7ff048ffd740 1 -- start start 2024-09-19T06:12:12.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.587+0000 7ff048ffd740 1 Processor -- start 2024-09-19T06:12:12.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.587+0000 7ff048ffd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822330 0x55baa382a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:12.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.587+0000 7ff048ffd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55baa3822c50 0x55baa382aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:12.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.587+0000 7ff048ffd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baa382d510 0x55baa382af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:12.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.587+0000 7ff048ffd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55baa3830060 con 0x55baa3822c50 2024-09-19T06:12:12.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.587+0000 7ff048ffd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55baa3710920 con 0x55baa382d510 2024-09-19T06:12:12.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.587+0000 7ff048ffd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55baa38301e0 con 0x55baa3822330 2024-09-19T06:12:12.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.587+0000 7ff048ffd740 10 client.0 _ll_register_callbacks cb 0x55baa37348a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:12.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.587+0000 7ff037e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55baa3822c50 0x55baa382aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:12.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.587+0000 7ff03fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822330 0x55baa382a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:12.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.587+0000 7ff03fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822330 0x55baa382a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:48202/0 (socket says 172.21.15.3:48202) 2024-09-19T06:12:12.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.587+0000 7ff03fe00640 1 -- 172.21.15.3:0/911927762 learned_addr learned my addr 172.21.15.3:0/911927762 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:12.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.587+0000 7ff037e00640 1 --2- 172.21.15.3:0/911927762 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55baa3822c50 0x55baa382aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53824/0 (socket says 172.21.15.3:53824) 2024-09-19T06:12:12.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.588+0000 7ff044a00640 1 --2- 172.21.15.3:0/911927762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baa382d510 0x55baa382af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:12.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.588+0000 7ff03fe00640 1 -- 172.21.15.3:0/911927762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baa382d510 msgr2=0x55baa382af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:12.592 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.588+0000 7ff03fe00640 1 --2- 172.21.15.3:0/911927762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baa382d510 0x55baa382af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.588+0000 7ff03fe00640 1 -- 172.21.15.3:0/911927762 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55baa3822c50 msgr2=0x55baa382aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:12.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.588+0000 7ff03fe00640 1 --2- 172.21.15.3:0/911927762 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55baa3822c50 0x55baa382aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.588+0000 7ff03fe00640 1 -- 172.21.15.3:0/911927762 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baa34f92b0 con 0x55baa3822330 2024-09-19T06:12:12.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.588+0000 7ff044a00640 1 --2- 172.21.15.3:0/911927762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baa382d510 0x55baa382af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:12:12.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.588+0000 7ff03fe00640 1 --2- 172.21.15.3:0/911927762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822330 0x55baa382a4e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff030035040 tx=0x7ff030030960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c27c50bfd568530 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:12.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.588+0000 7ff02d600640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:12:12.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.588+0000 7ff02d600640 1 -- 172.21.15.3:0/911927762 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030037040 con 0x55baa3822330 2024-09-19T06:12:12.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.589+0000 7ff02d600640 1 -- 172.21.15.3:0/911927762 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7ff03003d440 con 0x55baa3822330 2024-09-19T06:12:12.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.589+0000 7ff048ffd740 1 -- 172.21.15.3:0/911927762 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff030004230 con 0x55baa3822330 2024-09-19T06:12:12.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.589+0000 7ff02d600640 1 -- 172.21.15.3:0/911927762 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff03003d640 con 0x55baa3822330 2024-09-19T06:12:12.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.589+0000 7ff048ffd740 10 client.25117 fetch_fsmap learned FSMap version 28 2024-09-19T06:12:12.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.589+0000 7ff048ffd740 1 -- 172.21.15.3:0/911927762 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55baa3830060 con 0x55baa3822330 2024-09-19T06:12:12.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.589+0000 7ff02d600640 1 -- 172.21.15.3:0/911927762 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff030004230 con 0x55baa3822330 2024-09-19T06:12:12.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.589+0000 7ff02d600640 1 -- 172.21.15.3:0/911927762 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff030032a90 con 0x55baa3822330 2024-09-19T06:12:12.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.589+0000 7ff048ffd740 10 client.25117 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:12:12.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.589+0000 7ff048ffd740 10 client.25117 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T06:12:12.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.590+0000 7ff048ffd740 20 client.25117 populate_metadata read hostname 'smithi003' 2024-09-19T06:12:12.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.590+0000 7ff048ffd740 1 --2- 172.21.15.3:0/911927762 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55baa383df70 0x55baa383f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:12.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.590+0000 7ff048ffd740 4 client.25117 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:12:12.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.590+0000 7ff048ffd740 1 -- 172.21.15.3:0/911927762 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55baa3795620 con 0x55baa383df70 2024-09-19T06:12:12.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.590+0000 7ff037e00640 1 --2- 172.21.15.3:0/911927762 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55baa383df70 0x55baa383f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:12.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.590+0000 7ff037e00640 1 --2- 172.21.15.3:0/911927762 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55baa383df70 0x55baa383f3e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7e0d4c343dd8ae38 server_cookie=d778c1ae9407b573 in_seq=0 out_seq=0 2024-09-19T06:12:12.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.590+0000 7ff02d600640 10 client.25117 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:12:12.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.591+0000 7ff02d600640 1 -- 172.21.15.3:0/911927762 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55baa3795620 con 0x55baa383df70 2024-09-19T06:12:12.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.591+0000 7ff02d600640 10 client.25117 handle_command_reply: tid=0 2024-09-19T06:12:12.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.591+0000 7ff048ffd740 1 client.25117 shutdown 2024-09-19T06:12:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.591+0000 7ff048ffd740 1 -- 172.21.15.3:0/911927762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822330 msgr2=0x55baa382a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.591+0000 7ff048ffd740 1 --2- 172.21.15.3:0/911927762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822330 0x55baa382a4e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff030035040 tx=0x7ff030030960 comp rx=0 tx=0).stop 2024-09-19T06:12:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.592+0000 7ff048ffd740 1 -- 172.21.15.3:0/911927762 shutdown_connections 2024-09-19T06:12:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.592+0000 7ff048ffd740 1 --2- 172.21.15.3:0/911927762 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55baa383df70 0x55baa383f3e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.592+0000 7ff048ffd740 1 --2- 172.21.15.3:0/911927762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baa382d510 0x55baa382af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.592+0000 7ff048ffd740 1 --2- 172.21.15.3:0/911927762 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55baa3822c50 0x55baa382aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.592+0000 7ff048ffd740 1 --2- 172.21.15.3:0/911927762 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822330 0x55baa382a4e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.592+0000 7ff02d600640 0 client.25117 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:12:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.592+0000 7ff048ffd740 1 -- 172.21.15.3:0/911927762 >> 172.21.15.3:0/911927762 conn(0x55baa381e8c0 msgr2=0x55baa38245a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.592+0000 7ff048ffd740 1 -- 172.21.15.3:0/911927762 shutdown_connections 2024-09-19T06:12:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.592+0000 7ff048ffd740 1 -- 172.21.15.3:0/911927762 wait complete. 2024-09-19T06:12:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.592+0000 7ff048ffd740 20 client.25117 trim_cache size 0 max 16384 2024-09-19T06:12:12.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.611+0000 7ff048ffd740 1 Processor -- start 2024-09-19T06:12:12.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.611+0000 7ff048ffd740 1 -- start start 2024-09-19T06:12:12.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.611+0000 7ff048ffd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55baa3822330 0x55baa383f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:12.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.611+0000 7ff048ffd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822c50 0x55baa382adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:12.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.611+0000 7ff048ffd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baa382d510 0x55baa3824d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:12.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.611+0000 7ff048ffd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55baa383d720 con 0x55baa3822330 2024-09-19T06:12:12.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.611+0000 7ff048ffd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55baa383ddf0 con 0x55baa382d510 2024-09-19T06:12:12.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.611+0000 7ff048ffd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55baa383e4c0 con 0x55baa3822c50 2024-09-19T06:12:12.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.611+0000 7ff03fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55baa3822330 0x55baa383f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:12.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.611+0000 7ff03fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55baa3822330 0x55baa383f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53834/0 (socket says 172.21.15.3:53834) 2024-09-19T06:12:12.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.611+0000 7ff03fe00640 1 -- 172.21.15.3:0/4060834992 learned_addr learned my addr 172.21.15.3:0/4060834992 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:12.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.611+0000 7ff044a00640 1 --2- 172.21.15.3:0/4060834992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baa382d510 0x55baa3824d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:12.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.611+0000 7ff037e00640 1 --2- 172.21.15.3:0/4060834992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822c50 0x55baa382adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:12.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.612+0000 7ff03fe00640 1 -- 172.21.15.3:0/4060834992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822c50 msgr2=0x55baa382adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:12.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.612+0000 7ff03fe00640 1 --2- 172.21.15.3:0/4060834992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822c50 0x55baa382adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.612+0000 7ff03fe00640 1 -- 172.21.15.3:0/4060834992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baa382d510 msgr2=0x55baa3824d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:12.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.612+0000 7ff03fe00640 1 --2- 172.21.15.3:0/4060834992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baa382d510 0x55baa3824d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.612+0000 7ff03fe00640 1 -- 172.21.15.3:0/4060834992 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baa383d550 con 0x55baa3822330 2024-09-19T06:12:12.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.612+0000 7ff03fe00640 1 --2- 172.21.15.3:0/4060834992 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55baa3822330 0x55baa383f3e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff030005e00 tx=0x7ff0300308e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6f36f7df492a5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:12.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.612+0000 7ff02fe00640 1 -- 172.21.15.3:0/4060834992 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff030037040 con 0x55baa3822330 2024-09-19T06:12:12.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.612+0000 7ff02fe00640 1 -- 172.21.15.3:0/4060834992 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff03005d020 con 0x55baa3822330 2024-09-19T06:12:12.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.612+0000 7ff02fe00640 1 -- 172.21.15.3:0/4060834992 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03004ead0 con 0x55baa3822330 2024-09-19T06:12:12.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.613+0000 7ff048ffd740 1 -- 172.21.15.3:0/4060834992 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55baa3822330 msgr2=0x55baa383f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:12.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.613+0000 7ff048ffd740 1 --2- 172.21.15.3:0/4060834992 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55baa3822330 0x55baa383f3e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff030005e00 tx=0x7ff0300308e0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.613+0000 7ff048ffd740 1 -- 172.21.15.3:0/4060834992 shutdown_connections 2024-09-19T06:12:12.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.613+0000 7ff048ffd740 1 --2- 172.21.15.3:0/4060834992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baa382d510 0x55baa3824d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.613+0000 7ff048ffd740 1 --2- 172.21.15.3:0/4060834992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822c50 0x55baa382adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.613+0000 7ff048ffd740 1 --2- 172.21.15.3:0/4060834992 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55baa3822330 0x55baa383f3e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.613+0000 7ff048ffd740 1 -- 172.21.15.3:0/4060834992 >> 172.21.15.3:0/4060834992 conn(0x55baa381e8c0 msgr2=0x55baa3838430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:12.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.613+0000 7ff048ffd740 1 -- 172.21.15.3:0/4060834992 shutdown_connections 2024-09-19T06:12:12.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.613+0000 7ff048ffd740 1 -- 172.21.15.3:0/4060834992 wait complete. 2024-09-19T06:12:12.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.613+0000 7ff048ffd740 1 -- start start 2024-09-19T06:12:12.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.614+0000 7ff048ffd740 1 Processor -- start 2024-09-19T06:12:12.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.614+0000 7ff048ffd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baa3822330 0x55baa38476b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:12.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.614+0000 7ff048ffd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822c50 0x55baa3847bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:12.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.614+0000 7ff048ffd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55baa382d510 0x55baa3842660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:12.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.614+0000 7ff048ffd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55baa383f260 con 0x55baa382d510 2024-09-19T06:12:12.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.614+0000 7ff048ffd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55baa383eb90 con 0x55baa3822330 2024-09-19T06:12:12.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.614+0000 7ff048ffd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55baa383f930 con 0x55baa3822c50 2024-09-19T06:12:12.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.614+0000 7ff048ffd740 10 client.0 _ll_register_callbacks cb 0x7ff028005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:12.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.614+0000 7ff044a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55baa382d510 0x55baa3842660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:12.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.614+0000 7ff037e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822c50 0x55baa3847bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:12.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.614+0000 7ff044a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55baa382d510 0x55baa3842660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53840/0 (socket says 172.21.15.3:53840) 2024-09-19T06:12:12.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.614+0000 7ff044a00640 1 -- 172.21.15.3:0/4040064112 learned_addr learned my addr 172.21.15.3:0/4040064112 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:12.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.614+0000 7ff037e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822c50 0x55baa3847bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:48228/0 (socket says 172.21.15.3:48228) 2024-09-19T06:12:12.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.614+0000 7ff03fe00640 1 --2- 172.21.15.3:0/4040064112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baa3822330 0x55baa38476b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:12.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.615+0000 7ff037e00640 1 -- 172.21.15.3:0/4040064112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baa3822330 msgr2=0x55baa38476b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:12.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.615+0000 7ff037e00640 1 --2- 172.21.15.3:0/4040064112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baa3822330 0x55baa38476b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.615+0000 7ff037e00640 1 -- 172.21.15.3:0/4040064112 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55baa382d510 msgr2=0x55baa3842660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:12.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.615+0000 7ff037e00640 1 --2- 172.21.15.3:0/4040064112 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55baa382d510 0x55baa3842660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.615+0000 7ff037e00640 1 -- 172.21.15.3:0/4040064112 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baa3842ba0 con 0x55baa3822c50 2024-09-19T06:12:12.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.615+0000 7ff037e00640 1 --2- 172.21.15.3:0/4040064112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822c50 0x55baa3847bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55baa382bb20 tx=0x7ff028004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d5b371be9930aec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:12.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.615+0000 7ff02d600640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:12:12.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.615+0000 7ff02d600640 1 -- 172.21.15.3:0/4040064112 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028020920 con 0x55baa3822c50 2024-09-19T06:12:12.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.615+0000 7ff048ffd740 1 -- 172.21.15.3:0/4040064112 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff03005d020 con 0x55baa3822c50 2024-09-19T06:12:12.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.615+0000 7ff02d600640 1 -- 172.21.15.3:0/4040064112 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7ff028020ac0 con 0x55baa3822c50 2024-09-19T06:12:12.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.616+0000 7ff02d600640 1 -- 172.21.15.3:0/4040064112 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff028020cc0 con 0x55baa3822c50 2024-09-19T06:12:12.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.616+0000 7ff048ffd740 10 client.25123 fetch_fsmap learned FSMap version 28 2024-09-19T06:12:12.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.616+0000 7ff048ffd740 1 -- 172.21.15.3:0/4040064112 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55baa38a8df0 con 0x55baa3822c50 2024-09-19T06:12:12.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.616+0000 7ff02d600640 1 -- 172.21.15.3:0/4040064112 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff03005d020 con 0x55baa3822c50 2024-09-19T06:12:12.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.616+0000 7ff02d600640 1 -- 172.21.15.3:0/4040064112 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff028036430 con 0x55baa3822c50 2024-09-19T06:12:12.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.616+0000 7ff048ffd740 10 client.25123 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:12:12.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.616+0000 7ff048ffd740 10 client.25123 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T06:12:12.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.616+0000 7ff048ffd740 20 client.25123 populate_metadata read hostname 'smithi003' 2024-09-19T06:12:12.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.617+0000 7ff048ffd740 1 --2- 172.21.15.3:0/4040064112 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55baa38ad980 0x55baa38ac690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:12.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.617+0000 7ff048ffd740 4 client.25123 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:12:12.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.617+0000 7ff048ffd740 1 -- 172.21.15.3:0/4040064112 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "status"}) -- 0x55baa378fb30 con 0x55baa38ad980 2024-09-19T06:12:12.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.617+0000 7ff03fe00640 1 --2- 172.21.15.3:0/4040064112 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55baa38ad980 0x55baa38ac690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:12.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.617+0000 7ff03fe00640 1 --2- 172.21.15.3:0/4040064112 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55baa38ad980 0x55baa38ac690 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8fea813e99f1ca9 server_cookie=31f105b145963056 in_seq=0 out_seq=0 2024-09-19T06:12:12.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.617+0000 7ff02d600640 10 client.25123 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:12:12.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.617+0000 7ff02d600640 1 -- 172.21.15.3:0/4040064112 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55baa378fb30 con 0x55baa38ad980 2024-09-19T06:12:12.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.617+0000 7ff02d600640 10 client.25123 handle_command_reply: tid=0 2024-09-19T06:12:12.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.617+0000 7ff048ffd740 1 client.25123 shutdown 2024-09-19T06:12:12.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.618+0000 7ff048ffd740 1 -- 172.21.15.3:0/4040064112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822c50 msgr2=0x55baa3847bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:12.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.618+0000 7ff048ffd740 1 --2- 172.21.15.3:0/4040064112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822c50 0x55baa3847bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55baa382bb20 tx=0x7ff028004730 comp rx=0 tx=0).stop 2024-09-19T06:12:12.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.618+0000 7ff048ffd740 1 -- 172.21.15.3:0/4040064112 shutdown_connections 2024-09-19T06:12:12.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.618+0000 7ff048ffd740 1 --2- 172.21.15.3:0/4040064112 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55baa38ad980 0x55baa38ac690 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.618+0000 7ff048ffd740 1 --2- 172.21.15.3:0/4040064112 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55baa382d510 0x55baa3842660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.618+0000 7ff048ffd740 1 --2- 172.21.15.3:0/4040064112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55baa3822c50 0x55baa3847bf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.618+0000 7ff02d600640 0 client.25123 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:12:12.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.618+0000 7ff048ffd740 1 --2- 172.21.15.3:0/4040064112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55baa3822330 0x55baa38476b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.618+0000 7ff048ffd740 1 -- 172.21.15.3:0/4040064112 >> 172.21.15.3:0/4040064112 conn(0x55baa381e8c0 msgr2=0x55baa381da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:12.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.618+0000 7ff048ffd740 1 -- 172.21.15.3:0/4040064112 shutdown_connections 2024-09-19T06:12:12.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.618+0000 7ff048ffd740 1 -- 172.21.15.3:0/4040064112 wait complete. 2024-09-19T06:12:12.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.618+0000 7ff048ffd740 20 client.25123 trim_cache size 0 max 16384 2024-09-19T06:12:12.624 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:12:12.624 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "782a5144-764c-11ef-bceb-c7b262605968", 2024-09-19T06:12:12.624 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 1, 2024-09-19T06:12:12.625 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 24532, 2024-09-19T06:12:12.625 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2024-09-19T06:12:12.625 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2024-09-19T06:12:12.625 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2024-09-19T06:12:12.625 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 118.059225387, 2024-09-19T06:12:12.625 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 28, 2024-09-19T06:12:12.625 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 88, 2024-09-19T06:12:12.625 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 86, 2024-09-19T06:12:12.625 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 154.04156447400001 2024-09-19T06:12:12.625 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:12:12.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.619+0000 7ff046a00640 1 -- 172.21.15.3:0/876750559 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff0240a32c0 msgr2=0x7ff0240a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:12.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.619+0000 7ff046a00640 1 --2- 172.21.15.3:0/876750559 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff0240a32c0 0x7ff0240a5780 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55baa381fc40 tx=0x7ff028005f90 comp rx=0 tx=0).stop 2024-09-19T06:12:12.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.619+0000 7ff046a00640 1 -- 172.21.15.3:0/876750559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff040109120 msgr2=0x7ff04019ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:12.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.619+0000 7ff046a00640 1 --2- 172.21.15.3:0/876750559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff040109120 0x7ff04019ef10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff03800efc0 tx=0x7ff03800c800 comp rx=0 tx=0).stop 2024-09-19T06:12:12.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.619+0000 7ff046a00640 1 -- 172.21.15.3:0/876750559 shutdown_connections 2024-09-19T06:12:12.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.619+0000 7ff046a00640 1 --2- 172.21.15.3:0/876750559 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff0240a32c0 0x7ff0240a5780 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.619+0000 7ff046a00640 1 --2- 172.21.15.3:0/876750559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff040109120 0x7ff04019ef10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.619+0000 7ff046a00640 1 --2- 172.21.15.3:0/876750559 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff0401049a0 0x7ff04019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.619+0000 7ff046a00640 1 --2- 172.21.15.3:0/876750559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff040103ff0 0x7ff04019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:12.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.619+0000 7ff046a00640 1 -- 172.21.15.3:0/876750559 >> 172.21.15.3:0/876750559 conn(0x7ff0400ffa90 msgr2=0x7ff040100df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:12.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.619+0000 7ff046a00640 1 -- 172.21.15.3:0/876750559 shutdown_connections 2024-09-19T06:12:12.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:12.619+0000 7ff046a00640 1 -- 172.21.15.3:0/876750559 wait complete. 2024-09-19T06:12:13.408 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T06:12:13.785 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:14.256 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:14 smithi003 ceph-mon[30893]: pgmap v369: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-19T06:12:14.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.369+0000 7ff608e00640 1 -- 172.21.15.3:0/565821106 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff60410e450 msgr2=0x7ff604110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:14.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.369+0000 7ff608e00640 1 --2- 172.21.15.3:0/565821106 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff60410e450 0x7ff604110840 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009ca0 tx=0x7ff5fc02a950 comp rx=0 tx=0).stop 2024-09-19T06:12:14.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.369+0000 7ff608e00640 1 -- 172.21.15.3:0/565821106 shutdown_connections 2024-09-19T06:12:14.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.369+0000 7ff608e00640 1 --2- 172.21.15.3:0/565821106 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff60410e450 0x7ff604110840 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.369+0000 7ff608e00640 1 --2- 172.21.15.3:0/565821106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff604074e30 0x7ff60410df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.369+0000 7ff608e00640 1 --2- 172.21.15.3:0/565821106 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff604074510 0x7ff6040748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.369+0000 7ff608e00640 1 -- 172.21.15.3:0/565821106 >> 172.21.15.3:0/565821106 conn(0x7ff6040fd8b0 msgr2=0x7ff6040ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:14.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.369+0000 7ff608e00640 1 -- 172.21.15.3:0/565821106 shutdown_connections 2024-09-19T06:12:14.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.369+0000 7ff608e00640 1 -- 172.21.15.3:0/565821106 wait complete. 2024-09-19T06:12:14.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.370+0000 7ff608e00640 1 Processor -- start 2024-09-19T06:12:14.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.370+0000 7ff608e00640 1 -- start start 2024-09-19T06:12:14.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.370+0000 7ff608e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff604074510 0x7ff60419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:14.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.370+0000 7ff608e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff604074e30 0x7ff60419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:14.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.370+0000 7ff608e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff60410e450 0x7ff60419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:14.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.370+0000 7ff608e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff6041141b0 con 0x7ff604074510 2024-09-19T06:12:14.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.370+0000 7ff608e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff604114030 con 0x7ff604074e30 2024-09-19T06:12:14.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.370+0000 7ff608e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff604114330 con 0x7ff60410e450 2024-09-19T06:12:14.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.371+0000 7ff5fbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff604074e30 0x7ff60419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:14.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.371+0000 7ff601e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff604074510 0x7ff60419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:14.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.371+0000 7ff5fbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff604074e30 0x7ff60419ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55890/0 (socket says 172.21.15.3:55890) 2024-09-19T06:12:14.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.371+0000 7ff5fbe00640 1 -- 172.21.15.3:0/1224598508 learned_addr learned my addr 172.21.15.3:0/1224598508 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:14.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.371+0000 7ff602800640 1 --2- 172.21.15.3:0/1224598508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff60410e450 0x7ff60419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:14.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.371+0000 7ff5fbe00640 1 -- 172.21.15.3:0/1224598508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff60410e450 msgr2=0x7ff60419ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:14.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.371+0000 7ff5fbe00640 1 --2- 172.21.15.3:0/1224598508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff60410e450 0x7ff60419ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.371+0000 7ff5fbe00640 1 -- 172.21.15.3:0/1224598508 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff604074510 msgr2=0x7ff60419a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:14.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.371+0000 7ff5fbe00640 1 --2- 172.21.15.3:0/1224598508 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff604074510 0x7ff60419a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.371+0000 7ff5fbe00640 1 -- 172.21.15.3:0/1224598508 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff60419f5e0 con 0x7ff604074e30 2024-09-19T06:12:14.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.371+0000 7ff5fbe00640 1 --2- 172.21.15.3:0/1224598508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff604074e30 0x7ff60419ab70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec00e9f0 tx=0x7ff5ec00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:14.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.372+0000 7ff5faa00640 1 -- 172.21.15.3:0/1224598508 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec00cd80 con 0x7ff604074e30 2024-09-19T06:12:14.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.372+0000 7ff5faa00640 1 -- 172.21.15.3:0/1224598508 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5ec010910 con 0x7ff604074e30 2024-09-19T06:12:14.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.372+0000 7ff5faa00640 1 -- 172.21.15.3:0/1224598508 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec018990 con 0x7ff604074e30 2024-09-19T06:12:14.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.372+0000 7ff608e00640 1 -- 172.21.15.3:0/1224598508 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff60419f8d0 con 0x7ff604074e30 2024-09-19T06:12:14.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.372+0000 7ff608e00640 1 -- 172.21.15.3:0/1224598508 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6041a71b0 con 0x7ff604074e30 2024-09-19T06:12:14.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.375+0000 7ff5faa00640 1 -- 172.21.15.3:0/1224598508 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7ff5ec010ac0 con 0x7ff604074e30 2024-09-19T06:12:14.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.375+0000 7ff60b83c740 1 Processor -- start 2024-09-19T06:12:14.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.375+0000 7ff60b83c740 1 -- start start 2024-09-19T06:12:14.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.376+0000 7ff60b83c740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42330 0x561bd7a42710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:14.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.376+0000 7ff60b83c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bd7a42c50 0x561bd7a4cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:14.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.376+0000 7ff60b83c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bd7a4d510 0x561bd7a4f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:14.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.376+0000 7ff60b83c740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561bd79a80b0 con 0x561bd7a42330 2024-09-19T06:12:14.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.376+0000 7ff60b83c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561bd794fab0 con 0x561bd7a4d510 2024-09-19T06:12:14.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.376+0000 7ff60b83c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561bd79a4070 con 0x561bd7a42c50 2024-09-19T06:12:14.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.376+0000 7ff602800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42330 0x561bd7a42710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:14.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.376+0000 7ff602800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42330 0x561bd7a42710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40416/0 (socket says 172.21.15.3:40416) 2024-09-19T06:12:14.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.376+0000 7ff602800640 1 -- 172.21.15.3:0/3887745149 learned_addr learned my addr 172.21.15.3:0/3887745149 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:14.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.376+0000 7ff5fbe00640 1 --2- 172.21.15.3:0/3887745149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bd7a4d510 0x561bd7a4f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:14.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.376+0000 7ff601e00640 1 --2- 172.21.15.3:0/3887745149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bd7a42c50 0x561bd7a4cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:14.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.376+0000 7ff602800640 1 -- 172.21.15.3:0/3887745149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bd7a42c50 msgr2=0x561bd7a4cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:14.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.376+0000 7ff602800640 1 --2- 172.21.15.3:0/3887745149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bd7a42c50 0x561bd7a4cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.376+0000 7ff602800640 1 -- 172.21.15.3:0/3887745149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bd7a4d510 msgr2=0x561bd7a4f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:14.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.376+0000 7ff602800640 1 --2- 172.21.15.3:0/3887745149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bd7a4d510 0x561bd7a4f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.376+0000 7ff602800640 1 -- 172.21.15.3:0/3887745149 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bd795c4a0 con 0x561bd7a42330 2024-09-19T06:12:14.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.377+0000 7ff5faa00640 1 --2- 172.21.15.3:0/1224598508 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff5e80a32c0 0x7ff5e80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:14.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.377+0000 7ff602800640 1 --2- 172.21.15.3:0/3887745149 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42330 0x561bd7a42710 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff6040754f0 tx=0x7ff5fc005f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce7702de94ea8a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:14.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.377+0000 7ff5faa00640 1 -- 172.21.15.3:0/1224598508 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7ff5ec0cfb60 con 0x7ff604074e30 2024-09-19T06:12:14.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.377+0000 7ff601e00640 1 --2- 172.21.15.3:0/1224598508 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff5e80a32c0 0x7ff5e80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:14.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.377+0000 7ff5f3400640 1 -- 172.21.15.3:0/3887745149 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc048070 con 0x561bd7a42330 2024-09-19T06:12:14.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.377+0000 7ff5f3400640 1 -- 172.21.15.3:0/3887745149 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5fc003e50 con 0x561bd7a42330 2024-09-19T06:12:14.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.377+0000 7ff5f3400640 1 -- 172.21.15.3:0/3887745149 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc034040 con 0x561bd7a42330 2024-09-19T06:12:14.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.378+0000 7ff60b83c740 1 -- 172.21.15.3:0/3887745149 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42330 msgr2=0x561bd7a42710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:14.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.378+0000 7ff60b83c740 1 --2- 172.21.15.3:0/3887745149 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42330 0x561bd7a42710 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff6040754f0 tx=0x7ff5fc005f80 comp rx=0 tx=0).stop 2024-09-19T06:12:14.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.378+0000 7ff60b83c740 1 -- 172.21.15.3:0/3887745149 shutdown_connections 2024-09-19T06:12:14.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.378+0000 7ff60b83c740 1 --2- 172.21.15.3:0/3887745149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bd7a4d510 0x561bd7a4f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.378+0000 7ff60b83c740 1 --2- 172.21.15.3:0/3887745149 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bd7a42c50 0x561bd7a4cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.378+0000 7ff601e00640 1 --2- 172.21.15.3:0/1224598508 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff5e80a32c0 0x7ff5e80a5780 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x561bd7a3f720 tx=0x7ff5f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:14.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.378+0000 7ff60b83c740 1 --2- 172.21.15.3:0/3887745149 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42330 0x561bd7a42710 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.378+0000 7ff60b83c740 1 -- 172.21.15.3:0/3887745149 >> 172.21.15.3:0/3887745149 conn(0x561bd7a3e8c0 msgr2=0x561bd7a3eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:14.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.378+0000 7ff60b83c740 1 -- 172.21.15.3:0/3887745149 shutdown_connections 2024-09-19T06:12:14.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.378+0000 7ff60b83c740 1 -- 172.21.15.3:0/3887745149 wait complete. 2024-09-19T06:12:14.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.379+0000 7ff60b83c740 1 -- start start 2024-09-19T06:12:14.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.379+0000 7ff60b83c740 1 Processor -- start 2024-09-19T06:12:14.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.379+0000 7ff60b83c740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42330 0x561bd7a4a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:14.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.379+0000 7ff60b83c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bd7a42c50 0x561bd7a4aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:14.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.379+0000 7ff60b83c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bd7a4d510 0x561bd7a4afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:14.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.379+0000 7ff60b83c740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561bd7a50060 con 0x561bd7a42330 2024-09-19T06:12:14.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.379+0000 7ff60b83c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561bd7930920 con 0x561bd7a4d510 2024-09-19T06:12:14.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.379+0000 7ff60b83c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561bd7a501e0 con 0x561bd7a42c50 2024-09-19T06:12:14.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.380+0000 7ff60b83c740 10 client.0 _ll_register_callbacks cb 0x561bd79548a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:14.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.380+0000 7ff601e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42330 0x561bd7a4a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:14.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.380+0000 7ff601e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42330 0x561bd7a4a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40432/0 (socket says 172.21.15.3:40432) 2024-09-19T06:12:14.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.380+0000 7ff601e00640 1 -- 172.21.15.3:0/3555173130 learned_addr learned my addr 172.21.15.3:0/3555173130 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:14.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.380+0000 7ff5fbe00640 1 --2- 172.21.15.3:0/3555173130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bd7a42c50 0x561bd7a4aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:14.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.380+0000 7ff602800640 1 --2- 172.21.15.3:0/3555173130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bd7a4d510 0x561bd7a4afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:14.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.380+0000 7ff601e00640 1 -- 172.21.15.3:0/3555173130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bd7a42c50 msgr2=0x561bd7a4aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:14.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.380+0000 7ff601e00640 1 --2- 172.21.15.3:0/3555173130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bd7a42c50 0x561bd7a4aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.380+0000 7ff601e00640 1 -- 172.21.15.3:0/3555173130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bd7a4d510 msgr2=0x561bd7a4afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:14.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.380+0000 7ff601e00640 1 --2- 172.21.15.3:0/3555173130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bd7a4d510 0x561bd7a4afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.380+0000 7ff601e00640 1 -- 172.21.15.3:0/3555173130 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bd77192b0 con 0x561bd7a42330 2024-09-19T06:12:14.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.380+0000 7ff601e00640 1 --2- 172.21.15.3:0/3555173130 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42330 0x561bd7a4a550 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4009730 tx=0x7ff5f4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22eef6486146483 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:14.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.380+0000 7ff5e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:12:14.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.381+0000 7ff5e7e00640 1 -- 172.21.15.3:0/3555173130 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f401f640 con 0x561bd7a42330 2024-09-19T06:12:14.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.381+0000 7ff5e7e00640 1 -- 172.21.15.3:0/3555173130 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7ff5f401f7e0 con 0x561bd7a42330 2024-09-19T06:12:14.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.381+0000 7ff60b83c740 1 -- 172.21.15.3:0/3555173130 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5fc003e50 con 0x561bd7a42330 2024-09-19T06:12:14.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.381+0000 7ff5e7e00640 1 -- 172.21.15.3:0/3555173130 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff5f401f9e0 con 0x561bd7a42330 2024-09-19T06:12:14.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.381+0000 7ff60b83c740 10 client.15096 fetch_fsmap learned FSMap version 28 2024-09-19T06:12:14.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.381+0000 7ff60b83c740 1 -- 172.21.15.3:0/3555173130 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561bd7a5be30 con 0x561bd7a42330 2024-09-19T06:12:14.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.381+0000 7ff5e7e00640 1 -- 172.21.15.3:0/3555173130 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5fc003e50 con 0x561bd7a42330 2024-09-19T06:12:14.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.382+0000 7ff5e7e00640 1 -- 172.21.15.3:0/3555173130 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff5f4027070 con 0x561bd7a42330 2024-09-19T06:12:14.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.382+0000 7ff60b83c740 10 client.15096 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:12:14.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.382+0000 7ff60b83c740 10 client.15096 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:12:14.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.382+0000 7ff60b83c740 20 client.15096 populate_metadata read hostname 'smithi003' 2024-09-19T06:12:14.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.382+0000 7ff60b83c740 1 --2- 172.21.15.3:0/3555173130 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x561bd7a5e450 0x561bd7a5f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:14.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.382+0000 7ff60b83c740 4 client.15096 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:12:14.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.382+0000 7ff60b83c740 1 -- 172.21.15.3:0/3555173130 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561bd79b5620 con 0x561bd7a5e450 2024-09-19T06:12:14.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.382+0000 7ff5fbe00640 1 --2- 172.21.15.3:0/3555173130 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x561bd7a5e450 0x561bd7a5f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:14.396 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:14 smithi071 ceph-mon[35662]: pgmap v369: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-19T06:12:14.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.382+0000 7ff5fbe00640 1 --2- 172.21.15.3:0/3555173130 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x561bd7a5e450 0x561bd7a5f8c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef8ee91160971b6c server_cookie=255f980b38703dd0 in_seq=0 out_seq=0 2024-09-19T06:12:14.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.383+0000 7ff5e7e00640 10 client.15096 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:12:14.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.383+0000 7ff5e7e00640 1 -- 172.21.15.3:0/3555173130 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561bd79b5620 con 0x561bd7a5e450 2024-09-19T06:12:14.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.383+0000 7ff5e7e00640 10 client.15096 handle_command_reply: tid=0 2024-09-19T06:12:14.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.383+0000 7ff60b83c740 1 client.15096 shutdown 2024-09-19T06:12:14.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.384+0000 7ff60b83c740 1 -- 172.21.15.3:0/3555173130 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42330 msgr2=0x561bd7a4a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:14.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.384+0000 7ff60b83c740 1 --2- 172.21.15.3:0/3555173130 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42330 0x561bd7a4a550 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4009730 tx=0x7ff5f4004730 comp rx=0 tx=0).stop 2024-09-19T06:12:14.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.384+0000 7ff60b83c740 1 -- 172.21.15.3:0/3555173130 shutdown_connections 2024-09-19T06:12:14.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.384+0000 7ff60b83c740 1 --2- 172.21.15.3:0/3555173130 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x561bd7a5e450 0x561bd7a5f8c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.384+0000 7ff60b83c740 1 --2- 172.21.15.3:0/3555173130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bd7a4d510 0x561bd7a4afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.384+0000 7ff60b83c740 1 --2- 172.21.15.3:0/3555173130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bd7a42c50 0x561bd7a4aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.384+0000 7ff60b83c740 1 --2- 172.21.15.3:0/3555173130 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42330 0x561bd7a4a550 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.384+0000 7ff60b83c740 1 -- 172.21.15.3:0/3555173130 >> 172.21.15.3:0/3555173130 conn(0x561bd7a3e8c0 msgr2=0x561bd7a445a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:14.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.384+0000 7ff5e7e00640 0 client.15096 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:12:14.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.384+0000 7ff60b83c740 1 -- 172.21.15.3:0/3555173130 shutdown_connections 2024-09-19T06:12:14.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.384+0000 7ff60b83c740 1 -- 172.21.15.3:0/3555173130 wait complete. 2024-09-19T06:12:14.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.384+0000 7ff60b83c740 20 client.15096 trim_cache size 0 max 16384 2024-09-19T06:12:14.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.403+0000 7ff60b83c740 1 Processor -- start 2024-09-19T06:12:14.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.403+0000 7ff60b83c740 1 -- start start 2024-09-19T06:12:14.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.403+0000 7ff60b83c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bd7a42330 0x561bd7a44d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:14.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.403+0000 7ff60b83c740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42c50 0x561bd7a4aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:14.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.403+0000 7ff60b83c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bd7a4d510 0x561bd7a4afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:14.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.403+0000 7ff60b83c740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561bd7a5dc00 con 0x561bd7a42c50 2024-09-19T06:12:14.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.403+0000 7ff60b83c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561bd7a5e2d0 con 0x561bd7a4d510 2024-09-19T06:12:14.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.403+0000 7ff60b83c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561bd7a5e9a0 con 0x561bd7a42330 2024-09-19T06:12:14.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.403+0000 7ff5fbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42c50 0x561bd7a4aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:14.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.403+0000 7ff5fbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42c50 0x561bd7a4aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40448/0 (socket says 172.21.15.3:40448) 2024-09-19T06:12:14.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.403+0000 7ff5fbe00640 1 -- 172.21.15.3:0/3855745317 learned_addr learned my addr 172.21.15.3:0/3855745317 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:14.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.403+0000 7ff601e00640 1 --2- 172.21.15.3:0/3855745317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bd7a42330 0x561bd7a44d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:14.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.403+0000 7ff602800640 1 --2- 172.21.15.3:0/3855745317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bd7a4d510 0x561bd7a4afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:14.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.404+0000 7ff5fbe00640 1 -- 172.21.15.3:0/3855745317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bd7a42330 msgr2=0x561bd7a44d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:14.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.404+0000 7ff5fbe00640 1 --2- 172.21.15.3:0/3855745317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bd7a42330 0x561bd7a44d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.404+0000 7ff5fbe00640 1 -- 172.21.15.3:0/3855745317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bd7a4d510 msgr2=0x561bd7a4afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:14.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.404+0000 7ff5fbe00640 1 --2- 172.21.15.3:0/3855745317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bd7a4d510 0x561bd7a4afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.404+0000 7ff5fbe00640 1 -- 172.21.15.3:0/3855745317 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bd7a3fa30 con 0x561bd7a42c50 2024-09-19T06:12:14.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.404+0000 7ff601e00640 1 --2- 172.21.15.3:0/3855745317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bd7a42330 0x561bd7a44d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:14.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.404+0000 7ff5fbe00640 1 --2- 172.21.15.3:0/3855745317 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42c50 0x561bd7a4aaa0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec09c140 tx=0x7ff5ec0bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921c71d6ca7f20c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:14.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.404+0000 7ff5f2a00640 1 -- 172.21.15.3:0/3855745317 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec09bcf0 con 0x561bd7a42c50 2024-09-19T06:12:14.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.404+0000 7ff5f2a00640 1 -- 172.21.15.3:0/3855745317 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5ec09c1b0 con 0x561bd7a42c50 2024-09-19T06:12:14.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.404+0000 7ff5f2a00640 1 -- 172.21.15.3:0/3855745317 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec09bb10 con 0x561bd7a42c50 2024-09-19T06:12:14.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.405+0000 7ff60b83c740 1 -- 172.21.15.3:0/3855745317 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42c50 msgr2=0x561bd7a4aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:14.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.405+0000 7ff60b83c740 1 --2- 172.21.15.3:0/3855745317 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42c50 0x561bd7a4aaa0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec09c140 tx=0x7ff5ec0bc040 comp rx=0 tx=0).stop 2024-09-19T06:12:14.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.405+0000 7ff60b83c740 1 -- 172.21.15.3:0/3855745317 shutdown_connections 2024-09-19T06:12:14.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.405+0000 7ff60b83c740 1 --2- 172.21.15.3:0/3855745317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bd7a4d510 0x561bd7a4afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.405+0000 7ff60b83c740 1 --2- 172.21.15.3:0/3855745317 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42c50 0x561bd7a4aaa0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.405+0000 7ff60b83c740 1 --2- 172.21.15.3:0/3855745317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bd7a42330 0x561bd7a44d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.405+0000 7ff60b83c740 1 -- 172.21.15.3:0/3855745317 >> 172.21.15.3:0/3855745317 conn(0x561bd7a3e8c0 msgr2=0x561bd7a48e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:14.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.405+0000 7ff60b83c740 1 -- 172.21.15.3:0/3855745317 shutdown_connections 2024-09-19T06:12:14.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.405+0000 7ff60b83c740 1 -- 172.21.15.3:0/3855745317 wait complete. 2024-09-19T06:12:14.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.405+0000 7ff60b83c740 1 -- start start 2024-09-19T06:12:14.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.406+0000 7ff60b83c740 1 Processor -- start 2024-09-19T06:12:14.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.406+0000 7ff60b83c740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42330 0x561bd7a61900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:14.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.406+0000 7ff60b83c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bd7a42c50 0x561bd7a61e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:14.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.406+0000 7ff60b83c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bd7a4d510 0x561bd7a62380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:14.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.406+0000 7ff60b83c740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561bd7a5f740 con 0x561bd7a42330 2024-09-19T06:12:14.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.406+0000 7ff60b83c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561bd7a5f070 con 0x561bd7a42c50 2024-09-19T06:12:14.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.406+0000 7ff60b83c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561bd7a5fe10 con 0x561bd7a4d510 2024-09-19T06:12:14.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.406+0000 7ff60b83c740 10 client.0 _ll_register_callbacks cb 0x7ff5f40044b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:14.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.406+0000 7ff601e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42330 0x561bd7a61900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:14.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.406+0000 7ff601e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42330 0x561bd7a61900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40454/0 (socket says 172.21.15.3:40454) 2024-09-19T06:12:14.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.406+0000 7ff601e00640 1 -- 172.21.15.3:0/519942261 learned_addr learned my addr 172.21.15.3:0/519942261 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:14.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.406+0000 7ff5fbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bd7a42c50 0x561bd7a61e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:14.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.407+0000 7ff602800640 1 --2- 172.21.15.3:0/519942261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bd7a4d510 0x561bd7a62380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:14.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.407+0000 7ff601e00640 1 -- 172.21.15.3:0/519942261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bd7a4d510 msgr2=0x561bd7a62380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:14.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.407+0000 7ff601e00640 1 --2- 172.21.15.3:0/519942261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bd7a4d510 0x561bd7a62380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.407+0000 7ff601e00640 1 -- 172.21.15.3:0/519942261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bd7a42c50 msgr2=0x561bd7a61e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:14.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.407+0000 7ff601e00640 1 --2- 172.21.15.3:0/519942261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bd7a42c50 0x561bd7a61e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.407+0000 7ff601e00640 1 -- 172.21.15.3:0/519942261 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bd7a660a0 con 0x561bd7a42330 2024-09-19T06:12:14.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.407+0000 7ff601e00640 1 --2- 172.21.15.3:0/519942261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42330 0x561bd7a61900 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4012cb0 tx=0x7ff5f40337a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d49e28d467c884 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:14.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.407+0000 7ff5e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:12:14.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.407+0000 7ff5e7e00640 1 -- 172.21.15.3:0/519942261 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f40338a0 con 0x561bd7a42330 2024-09-19T06:12:14.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.407+0000 7ff5e7e00640 1 -- 172.21.15.3:0/519942261 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7ff5f4033a40 con 0x561bd7a42330 2024-09-19T06:12:14.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.408+0000 7ff60b83c740 1 -- 172.21.15.3:0/519942261 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5ec09c1b0 con 0x561bd7a42330 2024-09-19T06:12:14.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.408+0000 7ff5e7e00640 1 -- 172.21.15.3:0/519942261 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff5f4033c40 con 0x561bd7a42330 2024-09-19T06:12:14.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.408+0000 7ff60b83c740 10 client.15102 fetch_fsmap learned FSMap version 28 2024-09-19T06:12:14.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.408+0000 7ff60b83c740 1 -- 172.21.15.3:0/519942261 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561bd7ac8e00 con 0x561bd7a42330 2024-09-19T06:12:14.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.408+0000 7ff5e7e00640 1 -- 172.21.15.3:0/519942261 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5ec09c1b0 con 0x561bd7a42330 2024-09-19T06:12:14.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.408+0000 7ff5e7e00640 1 -- 172.21.15.3:0/519942261 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff5f4027040 con 0x561bd7a42330 2024-09-19T06:12:14.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.408+0000 7ff60b83c740 10 client.15102 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T06:12:14.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.408+0000 7ff60b83c740 10 client.15102 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T06:12:14.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.408+0000 7ff60b83c740 20 client.15102 populate_metadata read hostname 'smithi003' 2024-09-19T06:12:14.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.408+0000 7ff60b83c740 1 --2- 172.21.15.3:0/519942261 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x561bd7acda30 0x561bd7acc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:14.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.408+0000 7ff60b83c740 4 client.15102 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T06:12:14.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.408+0000 7ff60b83c740 1 -- 172.21.15.3:0/519942261 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "status"}) -- 0x561bd79afb30 con 0x561bd7acda30 2024-09-19T06:12:14.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.409+0000 7ff5fbe00640 1 --2- 172.21.15.3:0/519942261 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x561bd7acda30 0x561bd7acc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:14.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.409+0000 7ff5fbe00640 1 --2- 172.21.15.3:0/519942261 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x561bd7acda30 0x561bd7acc740 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9aa6fc2aa7514f9c server_cookie=ee711703cb7b79e0 in_seq=0 out_seq=0 2024-09-19T06:12:14.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.409+0000 7ff5e7e00640 10 client.15102 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:12:14.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.409+0000 7ff5e7e00640 1 -- 172.21.15.3:0/519942261 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x561bd79afb30 con 0x561bd7acda30 2024-09-19T06:12:14.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.409+0000 7ff5e7e00640 10 client.15102 handle_command_reply: tid=0 2024-09-19T06:12:14.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.409+0000 7ff60b83c740 1 client.15102 shutdown 2024-09-19T06:12:14.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.410+0000 7ff60b83c740 1 -- 172.21.15.3:0/519942261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42330 msgr2=0x561bd7a61900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:14.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.410+0000 7ff60b83c740 1 --2- 172.21.15.3:0/519942261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42330 0x561bd7a61900 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4012cb0 tx=0x7ff5f40337a0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.410+0000 7ff60b83c740 1 -- 172.21.15.3:0/519942261 shutdown_connections 2024-09-19T06:12:14.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.410+0000 7ff60b83c740 1 --2- 172.21.15.3:0/519942261 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x561bd7acda30 0x561bd7acc740 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.410+0000 7ff60b83c740 1 --2- 172.21.15.3:0/519942261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bd7a4d510 0x561bd7a62380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.410+0000 7ff60b83c740 1 --2- 172.21.15.3:0/519942261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bd7a42c50 0x561bd7a61e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.410+0000 7ff60b83c740 1 --2- 172.21.15.3:0/519942261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bd7a42330 0x561bd7a61900 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.410+0000 7ff5e7e00640 0 client.15102 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:12:14.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.410+0000 7ff60b83c740 1 -- 172.21.15.3:0/519942261 >> 172.21.15.3:0/519942261 conn(0x561bd7a3e8c0 msgr2=0x561bd7a58430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:14.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.410+0000 7ff60b83c740 1 -- 172.21.15.3:0/519942261 shutdown_connections 2024-09-19T06:12:14.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.410+0000 7ff60b83c740 1 -- 172.21.15.3:0/519942261 wait complete. 2024-09-19T06:12:14.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.410+0000 7ff60b83c740 20 client.15102 trim_cache size 0 max 16384 2024-09-19T06:12:14.417 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:12:14.417 INFO:teuthology.orchestra.run.smithi003.stdout: "cluster_fsid": "782a5144-764c-11ef-bceb-c7b262605968", 2024-09-19T06:12:14.417 INFO:teuthology.orchestra.run.smithi003.stdout: "whoami": 0, 2024-09-19T06:12:14.417 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 24557, 2024-09-19T06:12:14.417 INFO:teuthology.orchestra.run.smithi003.stdout: "want_state": "up:active", 2024-09-19T06:12:14.417 INFO:teuthology.orchestra.run.smithi003.stdout: "state": "up:active", 2024-09-19T06:12:14.417 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs", 2024-09-19T06:12:14.417 INFO:teuthology.orchestra.run.smithi003.stdout: "rank_uptime": 129.893794297, 2024-09-19T06:12:14.417 INFO:teuthology.orchestra.run.smithi003.stdout: "mdsmap_epoch": 28, 2024-09-19T06:12:14.417 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch": 88, 2024-09-19T06:12:14.418 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_epoch_barrier": 86, 2024-09-19T06:12:14.418 INFO:teuthology.orchestra.run.smithi003.stdout: "uptime": 144.43183144 2024-09-19T06:12:14.418 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:12:14.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.411+0000 7ff608e00640 1 -- 172.21.15.3:0/1224598508 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff5e80a32c0 msgr2=0x7ff5e80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:14.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.411+0000 7ff608e00640 1 --2- 172.21.15.3:0/1224598508 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff5e80a32c0 0x7ff5e80a5780 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x561bd7a3f720 tx=0x7ff5f4005f90 comp rx=0 tx=0).stop 2024-09-19T06:12:14.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.411+0000 7ff608e00640 1 -- 172.21.15.3:0/1224598508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff604074e30 msgr2=0x7ff60419ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:14.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.411+0000 7ff608e00640 1 --2- 172.21.15.3:0/1224598508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff604074e30 0x7ff60419ab70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec00e9f0 tx=0x7ff5ec00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.411+0000 7ff608e00640 1 -- 172.21.15.3:0/1224598508 shutdown_connections 2024-09-19T06:12:14.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.411+0000 7ff608e00640 1 --2- 172.21.15.3:0/1224598508 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7ff5e80a32c0 0x7ff5e80a5780 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.411+0000 7ff608e00640 1 --2- 172.21.15.3:0/1224598508 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff60410e450 0x7ff60419ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.411+0000 7ff608e00640 1 --2- 172.21.15.3:0/1224598508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff604074e30 0x7ff60419ab70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.411+0000 7ff608e00640 1 --2- 172.21.15.3:0/1224598508 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff604074510 0x7ff60419a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:14.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.411+0000 7ff608e00640 1 -- 172.21.15.3:0/1224598508 >> 172.21.15.3:0/1224598508 conn(0x7ff6040fd8b0 msgr2=0x7ff6040fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:14.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.411+0000 7ff608e00640 1 -- 172.21.15.3:0/1224598508 shutdown_connections 2024-09-19T06:12:14.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:14.411+0000 7ff608e00640 1 -- 172.21.15.3:0/1224598508 wait complete. 2024-09-19T06:12:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:14 smithi059 ceph-mon[35138]: pgmap v369: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-19T06:12:15.309 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T06:12:15.318 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T06:12:15.318 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T06:12:15.319 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T06:12:15.319 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-19T06:12:15.320 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T06:12:15.320 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi003.front.sepia.ceph.com 2024-09-19T06:12:15.320 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-19T06:12:15.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.480+0000 7f44e7200640 1 -- 172.21.15.3:0/1599665330 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44e0105760 msgr2=0x7f44e010bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:15.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.480+0000 7f44e7200640 1 --2- 172.21.15.3:0/1599665330 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44e0105760 0x7f44e010bff0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f44dc009ca0 tx=0x7f44dc02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:12:15.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.480+0000 7f44e7200640 1 -- 172.21.15.3:0/1599665330 shutdown_connections 2024-09-19T06:12:15.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.480+0000 7f44e7200640 1 --2- 172.21.15.3:0/1599665330 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44e0105760 0x7f44e010bff0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:15.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.480+0000 7f44e7200640 1 --2- 172.21.15.3:0/1599665330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44e0104da0 0x7f44e0105220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:15.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.480+0000 7f44e7200640 1 --2- 172.21.15.3:0/1599665330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44e0103bb0 0x7f44e0103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:15.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.480+0000 7f44e7200640 1 -- 172.21.15.3:0/1599665330 >> 172.21.15.3:0/1599665330 conn(0x7f44e00ff310 msgr2=0x7f44e0101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:15.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.480+0000 7f44e7200640 1 -- 172.21.15.3:0/1599665330 shutdown_connections 2024-09-19T06:12:15.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.480+0000 7f44e7200640 1 -- 172.21.15.3:0/1599665330 wait complete. 2024-09-19T06:12:15.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.481+0000 7f44e7200640 1 Processor -- start 2024-09-19T06:12:15.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.481+0000 7f44e7200640 1 -- start start 2024-09-19T06:12:15.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.481+0000 7f44e7200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44e0103bb0 0x7f44e0199e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:15.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.481+0000 7f44e7200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44e0104da0 0x7f44e019a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:15.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.481+0000 7f44e7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44e0105760 0x7f44e01a1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:15.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.481+0000 7f44e7200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f44e010f830 con 0x7f44e0103bb0 2024-09-19T06:12:15.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.481+0000 7f44e7200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f44e010f6b0 con 0x7f44e0105760 2024-09-19T06:12:15.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.481+0000 7f44e7200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f44e010f9b0 con 0x7f44e0104da0 2024-09-19T06:12:15.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.482+0000 7f44e5e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44e0103bb0 0x7f44e0199e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:15.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.482+0000 7f44e5e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44e0103bb0 0x7f44e0199e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40484/0 (socket says 172.21.15.3:40484) 2024-09-19T06:12:15.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.482+0000 7f44e5e00640 1 -- 172.21.15.3:0/3746917278 learned_addr learned my addr 172.21.15.3:0/3746917278 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.482+0000 7f44e5400640 1 --2- 172.21.15.3:0/3746917278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44e0104da0 0x7f44e019a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.482+0000 7f44e6800640 1 --2- 172.21.15.3:0/3746917278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44e0105760 0x7f44e01a1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.482+0000 7f44e5e00640 1 -- 172.21.15.3:0/3746917278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44e0104da0 msgr2=0x7f44e019a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.482+0000 7f44e5e00640 1 --2- 172.21.15.3:0/3746917278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44e0104da0 0x7f44e019a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.482+0000 7f44e5e00640 1 -- 172.21.15.3:0/3746917278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44e0105760 msgr2=0x7f44e01a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.482+0000 7f44e5e00640 1 --2- 172.21.15.3:0/3746917278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44e0105760 0x7f44e01a1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.482+0000 7f44e5e00640 1 -- 172.21.15.3:0/3746917278 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e01a1a70 con 0x7f44e0103bb0 2024-09-19T06:12:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.482+0000 7f44e5e00640 1 --2- 172.21.15.3:0/3746917278 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44e0103bb0 0x7f44e0199e50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f44d400e9c0 tx=0x7f44d400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.482+0000 7f44daa00640 1 -- 172.21.15.3:0/3746917278 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d400cd80 con 0x7f44e0103bb0 2024-09-19T06:12:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.482+0000 7f44daa00640 1 -- 172.21.15.3:0/3746917278 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44d40035f0 con 0x7f44e0103bb0 2024-09-19T06:12:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.482+0000 7f44daa00640 1 -- 172.21.15.3:0/3746917278 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d4010690 con 0x7f44e0103bb0 2024-09-19T06:12:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.483+0000 7f44e7200640 1 -- 172.21.15.3:0/3746917278 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e01a1d60 con 0x7f44e0103bb0 2024-09-19T06:12:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.483+0000 7f44e7200640 1 -- 172.21.15.3:0/3746917278 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e01a21a0 con 0x7f44e0103bb0 2024-09-19T06:12:15.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.484+0000 7f44e7200640 1 -- 172.21.15.3:0/3746917278 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44e010af50 con 0x7f44e0103bb0 2024-09-19T06:12:15.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.486+0000 7f44daa00640 1 -- 172.21.15.3:0/3746917278 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f44d40037a0 con 0x7f44e0103bb0 2024-09-19T06:12:15.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.488+0000 7f44daa00640 1 --2- 172.21.15.3:0/3746917278 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f44c80a3230 0x7f44c80a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:15.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.488+0000 7f44daa00640 1 -- 172.21.15.3:0/3746917278 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7f44d40cfe00 con 0x7f44e0103bb0 2024-09-19T06:12:15.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.488+0000 7f44e5400640 1 --2- 172.21.15.3:0/3746917278 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f44c80a3230 0x7f44c80a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:15.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.489+0000 7f44e5400640 1 --2- 172.21.15.3:0/3746917278 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f44c80a3230 0x7f44c80a56f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f44e019b360 tx=0x7f44d0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:15.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.492+0000 7f44daa00640 1 -- 172.21.15.3:0/3746917278 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f44d409caa0 con 0x7f44e0103bb0 2024-09-19T06:12:15.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:15.726+0000 7f44e7200640 1 -- 172.21.15.3:0/3746917278 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f44e0062630 con 0x7f44e0103bb0 2024-09-19T06:12:16.113 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:16.111+0000 7f44daa00640 1 -- 172.21.15.3:0/3746917278 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f44d409c3a0 con 0x7f44e0103bb0 2024-09-19T06:12:16.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:16.113+0000 7f44e7200640 1 -- 172.21.15.3:0/3746917278 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f44c80a3230 msgr2=0x7f44c80a56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:16.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:16.113+0000 7f44e7200640 1 --2- 172.21.15.3:0/3746917278 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f44c80a3230 0x7f44c80a56f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f44e019b360 tx=0x7f44d0005f90 comp rx=0 tx=0).stop 2024-09-19T06:12:16.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:16.113+0000 7f44e7200640 1 -- 172.21.15.3:0/3746917278 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44e0103bb0 msgr2=0x7f44e0199e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:16.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:16.113+0000 7f44e7200640 1 --2- 172.21.15.3:0/3746917278 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44e0103bb0 0x7f44e0199e50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f44d400e9c0 tx=0x7f44d400ee80 comp rx=0 tx=0).stop 2024-09-19T06:12:16.116 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:16.114+0000 7f44e7200640 1 -- 172.21.15.3:0/3746917278 shutdown_connections 2024-09-19T06:12:16.116 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:16.114+0000 7f44e7200640 1 --2- 172.21.15.3:0/3746917278 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7f44c80a3230 0x7f44c80a56f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:16.116 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:16.114+0000 7f44e7200640 1 --2- 172.21.15.3:0/3746917278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44e0105760 0x7f44e01a1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:16.116 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:16.114+0000 7f44e7200640 1 --2- 172.21.15.3:0/3746917278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44e0104da0 0x7f44e019a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:16.117 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:16.114+0000 7f44e7200640 1 --2- 172.21.15.3:0/3746917278 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44e0103bb0 0x7f44e0199e50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:16.117 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:16.114+0000 7f44e7200640 1 -- 172.21.15.3:0/3746917278 >> 172.21.15.3:0/3746917278 conn(0x7f44e00ff310 msgr2=0x7f44e0108120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:16.117 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:16.115+0000 7f44e7200640 1 -- 172.21.15.3:0/3746917278 shutdown_connections 2024-09-19T06:12:16.117 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:16.115+0000 7f44e7200640 1 -- 172.21.15.3:0/3746917278 wait complete. 2024-09-19T06:12:16.139 INFO:teuthology.run_tasks:Running task kclient... 2024-09-19T06:12:16.166 INFO:tasks.kclient:Mounting kernel clients... 2024-09-19T06:12:16.166 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-19T06:12:16.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:12:16.166 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list 2024-09-19T06:12:16.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:12:16.205 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link delete ceph-brx 2024-09-19T06:12:16.305 INFO:teuthology.orchestra.run.smithi003.stderr:Cannot find device "ceph-brx" 2024-09-19T06:12:16.308 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:12:16.309 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-19T06:12:16.309 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T06:12:16.309 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T06:12:16.309 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T06:12:16.357 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:16 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: ignoring --setuser ceph since I am not root 2024-09-19T06:12:16.357 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:16 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: ignoring --setgroup ceph since I am not root 2024-09-19T06:12:16.358 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:16 smithi003 ceph-mon[30893]: pgmap v370: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-19T06:12:16.358 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:16 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3746917278' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T06:12:16.469 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:16 smithi071 ceph-mon[35662]: pgmap v370: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-19T06:12:16.469 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:16 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/3746917278' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T06:12:16.470 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:16 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: ignoring --setuser ceph since I am not root 2024-09-19T06:12:16.470 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:16 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: ignoring --setgroup ceph since I am not root 2024-09-19T06:12:16.470 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:16 smithi071 ceph-mgr[37478]: -- 172.21.15.71:0/4247851617 <== mon.1 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dd5ff950e0 con 0x55dd5ff72800 2024-09-19T06:12:16.470 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:16 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:16.267+0000 7fea5d946040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:12:16.470 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:16 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:16.323+0000 7fea5d946040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:12:16.470 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:16 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:16.467+0000 7fea5d946040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:12:16.481 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:16 smithi059 ceph-mon[35138]: pgmap v370: 97 pgs: 97 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-19T06:12:16.482 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:16 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/3746917278' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T06:12:16.482 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:16 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: ignoring --setuser ceph since I am not root 2024-09-19T06:12:16.482 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:16 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: ignoring --setgroup ceph since I am not root 2024-09-19T06:12:16.482 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:16 smithi059 ceph-mgr[36508]: -- 172.21.15.59:0/306648745 <== mon.2 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b360e230e0 con 0x55b360e00800 2024-09-19T06:12:16.482 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:16 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:16.267+0000 7ff8cdb9d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:12:16.482 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:16 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:16.326+0000 7ff8cdb9d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:12:16.483 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:16 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:16.480+0000 7ff8cdb9d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:12:16.641 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:16 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:16.364+0000 7ff7a1436040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T06:12:16.642 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:16 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:16.439+0000 7ff7a1436040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T06:12:16.696 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:16.788 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:16 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:16.549+0000 7ff8cdb9d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:12:16.788 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:16 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:16.702+0000 7ff8cdb9d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:12:16.818 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:16 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:16.533+0000 7fea5d946040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:12:16.819 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:16 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:16.678+0000 7fea5d946040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:12:16.819 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:16 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:16.817+0000 7fea5d946040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:12:16.914 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:16 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:16.639+0000 7ff7a1436040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T06:12:16.915 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:16 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:16.728+0000 7ff7a1436040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T06:12:17.114 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:16 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:16.849+0000 7ff8cdb9d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:12:17.265 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:17 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3746917278' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T06:12:17.265 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:17 smithi003 ceph-mon[30893]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-19T06:12:17.265 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:16 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:16.912+0000 7ff7a1436040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:12:17.265 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:17 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:17.090+0000 7ff7a1436040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T06:12:17.372 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:17 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/3746917278' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T06:12:17.373 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:17 smithi071 ceph-mon[35662]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-19T06:12:17.373 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:17 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:17.127+0000 7fea5d946040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:12:17.373 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:17 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:17.187+0000 7fea5d946040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:12:17.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.262+0000 7fd48a000640 1 -- 172.21.15.3:0/3859907848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4841049a0 msgr2=0x7fd4841089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:17.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.262+0000 7fd48a000640 1 --2- 172.21.15.3:0/3859907848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4841049a0 0x7fd4841089f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd470009860 tx=0x7fd47002a340 comp rx=0 tx=0).stop 2024-09-19T06:12:17.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.262+0000 7fd48a000640 1 -- 172.21.15.3:0/3859907848 shutdown_connections 2024-09-19T06:12:17.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.262+0000 7fd48a000640 1 --2- 172.21.15.3:0/3859907848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd484109120 0x7fd484110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:17.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.262+0000 7fd48a000640 1 --2- 172.21.15.3:0/3859907848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4841049a0 0x7fd4841089f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:17.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.262+0000 7fd48a000640 1 --2- 172.21.15.3:0/3859907848 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd484103ff0 0x7fd4841043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:17.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.262+0000 7fd48a000640 1 -- 172.21.15.3:0/3859907848 >> 172.21.15.3:0/3859907848 conn(0x7fd4840ffa90 msgr2=0x7fd484101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:17.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.262+0000 7fd48a000640 1 -- 172.21.15.3:0/3859907848 shutdown_connections 2024-09-19T06:12:17.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.262+0000 7fd48a000640 1 -- 172.21.15.3:0/3859907848 wait complete. 2024-09-19T06:12:17.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.263+0000 7fd48a000640 1 Processor -- start 2024-09-19T06:12:17.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.263+0000 7fd48a000640 1 -- start start 2024-09-19T06:12:17.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.263+0000 7fd48a000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd484103ff0 0x7fd48419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:17.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.264+0000 7fd48a000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4841049a0 0x7fd48419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:17.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.264+0000 7fd48a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd484109120 0x7fd48419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:17.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.264+0000 7fd48a000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd484114120 con 0x7fd4841049a0 2024-09-19T06:12:17.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.264+0000 7fd48a000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd484113fa0 con 0x7fd484109120 2024-09-19T06:12:17.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.264+0000 7fd48a000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd4841142a0 con 0x7fd484103ff0 2024-09-19T06:12:17.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.264+0000 7fd483400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd484103ff0 0x7fd48419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:17.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.264+0000 7fd483400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd484103ff0 0x7fd48419a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:46778/0 (socket says 172.21.15.3:46778) 2024-09-19T06:12:17.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.264+0000 7fd483400640 1 -- 172.21.15.3:0/1808052578 learned_addr learned my addr 172.21.15.3:0/1808052578 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:17.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.264+0000 7fd482a00640 1 --2- 172.21.15.3:0/1808052578 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4841049a0 0x7fd48419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:17.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.264+0000 7fd483e00640 1 --2- 172.21.15.3:0/1808052578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd484109120 0x7fd48419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:17.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.264+0000 7fd483400640 1 -- 172.21.15.3:0/1808052578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd484109120 msgr2=0x7fd48419ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:17.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.264+0000 7fd483400640 1 --2- 172.21.15.3:0/1808052578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd484109120 0x7fd48419ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:17.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.264+0000 7fd483400640 1 -- 172.21.15.3:0/1808052578 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4841049a0 msgr2=0x7fd48419ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:17.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.264+0000 7fd483400640 1 --2- 172.21.15.3:0/1808052578 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4841049a0 0x7fd48419ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:17.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.264+0000 7fd483400640 1 -- 172.21.15.3:0/1808052578 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48419f670 con 0x7fd484103ff0 2024-09-19T06:12:17.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.264+0000 7fd483400640 1 --2- 172.21.15.3:0/1808052578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd484103ff0 0x7fd48419a6c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd47400e9c0 tx=0x7fd47400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:17.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.265+0000 7fd47be00640 1 -- 172.21.15.3:0/1808052578 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47400ccc0 con 0x7fd484103ff0 2024-09-19T06:12:17.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.265+0000 7fd48a000640 1 -- 172.21.15.3:0/1808052578 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd48419f960 con 0x7fd484103ff0 2024-09-19T06:12:17.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.265+0000 7fd47be00640 1 -- 172.21.15.3:0/1808052578 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd474005500 con 0x7fd484103ff0 2024-09-19T06:12:17.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.265+0000 7fd47be00640 1 -- 172.21.15.3:0/1808052578 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd474010430 con 0x7fd484103ff0 2024-09-19T06:12:17.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.265+0000 7fd48a000640 1 -- 172.21.15.3:0/1808052578 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4841a7240 con 0x7fd484103ff0 2024-09-19T06:12:17.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.266+0000 7fd48a000640 1 -- 172.21.15.3:0/1808052578 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4841043d0 con 0x7fd484103ff0 2024-09-19T06:12:17.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.268+0000 7fd47be00640 1 -- 172.21.15.3:0/1808052578 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 19) ==== 138371+0+0 (secure 0 0 0) 0x7fd4740046c0 con 0x7fd484103ff0 2024-09-19T06:12:17.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.269+0000 7fd47be00640 1 --2- 172.21.15.3:0/1808052578 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd4680a3290 0x7fd4680a5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:17.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.269+0000 7fd482a00640 1 -- 172.21.15.3:0/1808052578 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd4680a3290 msgr2=0x7fd4680a5750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.3:6800/1278931596 2024-09-19T06:12:17.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.269+0000 7fd47be00640 1 -- 172.21.15.3:0/1808052578 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fd4740cfce0 con 0x7fd484103ff0 2024-09-19T06:12:17.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.269+0000 7fd482a00640 1 --2- 172.21.15.3:0/1808052578 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd4680a3290 0x7fd4680a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:12:17.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.273+0000 7fd47be00640 1 -- 172.21.15.3:0/1808052578 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd47409c980 con 0x7fd484103ff0 2024-09-19T06:12:17.435 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:17 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:17.177+0000 7ff8cdb9d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:12:17.435 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:17 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:17.240+0000 7ff8cdb9d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:12:17.435 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:17 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/3746917278' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T06:12:17.435 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:17 smithi059 ceph-mon[35138]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-19T06:12:17.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.470+0000 7fd482a00640 1 -- 172.21.15.3:0/1808052578 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd4680a3290 msgr2=0x7fd4680a5750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.3:6800/1278931596 2024-09-19T06:12:17.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.470+0000 7fd482a00640 1 --2- 172.21.15.3:0/1808052578 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd4680a3290 0x7fd4680a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:12:17.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.494+0000 7fd48a000640 1 -- 172.21.15.3:0/1808052578 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd48410c360 con 0x7fd484103ff0 2024-09-19T06:12:17.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.494+0000 7fd47be00640 1 -- 172.21.15.3:0/1808052578 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+73 (secure 0 0 0) 0x7fd47409c280 con 0x7fd484103ff0 2024-09-19T06:12:17.496 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T06:12:17.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.496+0000 7fd48a000640 1 -- 172.21.15.3:0/1808052578 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd4680a3290 msgr2=0x7fd4680a5750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:12:17.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.496+0000 7fd48a000640 1 --2- 172.21.15.3:0/1808052578 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd4680a3290 0x7fd4680a5750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:17.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.496+0000 7fd48a000640 1 -- 172.21.15.3:0/1808052578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd484103ff0 msgr2=0x7fd48419a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:17.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.496+0000 7fd48a000640 1 --2- 172.21.15.3:0/1808052578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd484103ff0 0x7fd48419a6c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd47400e9c0 tx=0x7fd47400ee80 comp rx=0 tx=0).stop 2024-09-19T06:12:17.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.497+0000 7fd48a000640 1 -- 172.21.15.3:0/1808052578 shutdown_connections 2024-09-19T06:12:17.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.497+0000 7fd48a000640 1 --2- 172.21.15.3:0/1808052578 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fd4680a3290 0x7fd4680a5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:17.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.497+0000 7fd48a000640 1 --2- 172.21.15.3:0/1808052578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd484109120 0x7fd48419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:17.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.497+0000 7fd48a000640 1 --2- 172.21.15.3:0/1808052578 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4841049a0 0x7fd48419ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:17.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.497+0000 7fd48a000640 1 --2- 172.21.15.3:0/1808052578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd484103ff0 0x7fd48419a6c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:17.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.497+0000 7fd48a000640 1 -- 172.21.15.3:0/1808052578 >> 172.21.15.3:0/1808052578 conn(0x7fd4840ffa90 msgr2=0x7fd484100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:17.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.497+0000 7fd48a000640 1 -- 172.21.15.3:0/1808052578 shutdown_connections 2024-09-19T06:12:17.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:17.497+0000 7fd48a000640 1 -- 172.21.15.3:0/1808052578 wait complete. 2024-09-19T06:12:17.565 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:17 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:17.484+0000 7ff7a1436040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T06:12:17.788 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:17 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:17.433+0000 7ff8cdb9d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:12:17.834 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:17 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:17.563+0000 7ff7a1436040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T06:12:17.835 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:17 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:17.784+0000 7ff7a1436040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:12:17.835 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:17 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:17.371+0000 7fea5d946040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T06:12:18.288 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:18 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1808052578' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:12:18.329 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T06:12:18.329 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T06:12:18.329 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi003.front.sepia.ceph.com 2024-09-19T06:12:18.329 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T06:12:18.329 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T06:12:18.329 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T06:12:18.329 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T06:12:18.329 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T06:12:18.329 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T06:12:18.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:12:18.330 DEBUG:teuthology.orchestra.run.smithi003:> ip addr 2024-09-19T06:12:18.367 INFO:teuthology.orchestra.run.smithi003.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T06:12:18.368 INFO:teuthology.orchestra.run.smithi003.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T06:12:18.368 INFO:teuthology.orchestra.run.smithi003.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T06:12:18.368 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:12:18.368 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 ::1/128 scope host 2024-09-19T06:12:18.368 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:12:18.368 INFO:teuthology.orchestra.run.smithi003.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:12:18.368 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ac brd ff:ff:ff:ff:ff:ff 2024-09-19T06:12:18.368 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp7s0f0 2024-09-19T06:12:18.368 INFO:teuthology.orchestra.run.smithi003.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:12:18.368 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ad brd ff:ff:ff:ff:ff:ff 2024-09-19T06:12:18.368 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp7s0f1 2024-09-19T06:12:18.369 INFO:teuthology.orchestra.run.smithi003.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T06:12:18.369 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dc brd ff:ff:ff:ff:ff:ff 2024-09-19T06:12:18.369 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp1s0f0 2024-09-19T06:12:18.369 INFO:teuthology.orchestra.run.smithi003.stdout: inet 172.21.15.3/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T06:12:18.369 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft 42064sec preferred_lft 42064sec 2024-09-19T06:12:18.369 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::ec4:7aff:febd:15dc/64 scope link 2024-09-19T06:12:18.369 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:12:18.369 INFO:teuthology.orchestra.run.smithi003.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:12:18.369 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dd brd ff:ff:ff:ff:ff:ff 2024-09-19T06:12:18.369 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp1s0f1 2024-09-19T06:12:18.370 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T06:12:18.370 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:12:18.370 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2024-09-19T06:12:18.370 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link add name ceph-brx type bridge 2024-09-19T06:12:18.371 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip addr flush dev ceph-brx 2024-09-19T06:12:18.371 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set ceph-brx up 2024-09-19T06:12:18.371 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T06:12:18.371 DEBUG:teuthology.orchestra.run.smithi003:> ') 2024-09-19T06:12:18.427 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:18 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:18.354+0000 7ff8cdb9d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:12:18.427 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:18 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1808052578' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:12:18.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:12:18.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:18 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1808052578' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:12:18.586 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:18 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:18.247+0000 7fea5d946040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:12:18.586 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:18 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:18.313+0000 7fea5d946040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:12:18.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:12:18.788 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:18 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:18.425+0000 7ff8cdb9d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:12:18.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:12:18.795 DEBUG:teuthology.orchestra.run.smithi003:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T06:12:18.855 INFO:teuthology.orchestra.run.smithi003.stdout:1 2024-09-19T06:12:18.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:12:18.862 DEBUG:teuthology.orchestra.run.smithi003:> route 2024-09-19T06:12:18.914 INFO:teuthology.orchestra.run.smithi003.stdout:Kernel IP routing table 2024-09-19T06:12:18.914 INFO:teuthology.orchestra.run.smithi003.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T06:12:18.914 INFO:teuthology.orchestra.run.smithi003.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T06:12:18.914 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T06:12:18.914 INFO:teuthology.orchestra.run.smithi003.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T06:12:18.915 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:12:18.915 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2024-09-19T06:12:18.915 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T06:12:18.915 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T06:12:18.915 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T06:12:18.915 DEBUG:teuthology.orchestra.run.smithi003:> ') 2024-09-19T06:12:18.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:12:19.233 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:18 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:18.963+0000 7ff7a1436040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T06:12:19.233 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:19 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:19.050+0000 7ff7a1436040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T06:12:19.280 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:19 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:19.021+0000 7fea5d946040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:12:19.280 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:19 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:19.134+0000 7fea5d946040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:12:19.442 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:19 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:19.170+0000 7ff8cdb9d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:12:19.442 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:19 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:19.291+0000 7ff8cdb9d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:12:19.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:12:19.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:12:19.500 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list 2024-09-19T06:12:19.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:12:19.537 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list-id 2024-09-19T06:12:19.554 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:19 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:19.278+0000 7fea5d946040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:12:19.554 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:19 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:19.339+0000 7fea5d946040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:12:19.554 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:19 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:19.486+0000 7fea5d946040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:12:19.554 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:19 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:19.552+0000 7fea5d946040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:12:19.613 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:12:19.613 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2024-09-19T06:12:19.613 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:12:19.613 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T06:12:19.613 DEBUG:teuthology.orchestra.run.smithi003:> ') 2024-09-19T06:12:19.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:12:19.733 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:19 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:19.440+0000 7ff8cdb9d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:12:19.733 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:19 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:19.504+0000 7ff8cdb9d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:12:19.733 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:19 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:19.660+0000 7ff8cdb9d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:12:19.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:12:19.796 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T06:12:19.796 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:12:19.796 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2024-09-19T06:12:19.796 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T06:12:19.796 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T06:12:19.796 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T06:12:19.796 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T06:12:19.796 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T06:12:19.796 DEBUG:teuthology.orchestra.run.smithi003:> ') 2024-09-19T06:12:19.834 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:19 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:19.612+0000 7fea5d946040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:12:19.834 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:19 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:19.768+0000 7fea5d946040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:12:19.834 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:19 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:19.832+0000 7fea5d946040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:12:19.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:12:20.030 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:19 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:19.731+0000 7ff8cdb9d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:12:20.030 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:19 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:19.794+0000 7ff8cdb9d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:12:20.030 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:19 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:19.960+0000 7ff8cdb9d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:12:20.030 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:20 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:20.028+0000 7ff8cdb9d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:12:20.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:12:20.046 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:12:20.046 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2024-09-19T06:12:20.046 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set brx.0 up 2024-09-19T06:12:20.046 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T06:12:20.046 DEBUG:teuthology.orchestra.run.smithi003:> ') 2024-09-19T06:12:20.085 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:19 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:19.898+0000 7fea5d946040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:12:20.085 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:19 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:19.980+0000 7fea5d946040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:12:20.086 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:20 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:20.039+0000 7fea5d946040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:12:20.126 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:12:20.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:12:20.217 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T06:12:20.217 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T06:12:20.253 INFO:teuthology.orchestra.run.smithi003.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T06:12:20.253 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T06:12:20.253 DEBUG:teuthology.orchestra.run.smithi003:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T06:12:20.288 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:20 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:20.097+0000 7ff8cdb9d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:12:20.288 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:20 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:20.183+0000 7ff8cdb9d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:12:20.288 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:20 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:20.246+0000 7ff8cdb9d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:12:20.329 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-19T06:12:20.329 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-19T06:12:20.329 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/b4db2566-1936-4ff9-9108-adaa0f4d33e3 2024-09-19T06:12:20.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:12:20.329 DEBUG:teuthology.orchestra.run.smithi003:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/b4db2566-1936-4ff9-9108-adaa0f4d33e3 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-09-19T06:12:20.334 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:20 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:20.041+0000 7ff7a1436040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T06:12:20.334 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:20 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:20.190+0000 7ff7a1436040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T06:12:20.437 INFO:teuthology.orchestra.run.smithi003.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-09-19T06:12:20.437 INFO:teuthology.orchestra.run.smithi003.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2024-09-19T06:12:20.437 INFO:teuthology.orchestra.run.smithi003.stdout:invalid new device string format 2024-09-19T06:12:20.585 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:20 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:20.097+0000 7fea5d946040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:12:20.632 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:20 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:20.366+0000 7ff7a1436040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T06:12:20.632 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:20 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:20.444+0000 7ff7a1436040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T06:12:20.788 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:20 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:20.307+0000 7ff8cdb9d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:12:20.952 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:20 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:20.629+0000 7ff7a1436040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T06:12:20.953 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:20 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:20.716+0000 7ff7a1436040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T06:12:20.953 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:20 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:20.793+0000 7ff7a1436040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T06:12:21.117 INFO:teuthology.orchestra.run.smithi003.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-09-19T06:12:21.117 INFO:teuthology.orchestra.run.smithi003.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2024-09-19T06:12:21.117 INFO:teuthology.orchestra.run.smithi003.stdout:invalid new device string format 2024-09-19T06:12:21.117 INFO:teuthology.orchestra.run.smithi003.stdout:mount.ceph: resolved to: "172.21.15.3:6789,172.21.15.59:6789,172.21.15.71:6789" 2024-09-19T06:12:21.117 INFO:teuthology.orchestra.run.smithi003.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.3:6789,172.21.15.59:6789,172.21.15.71:6789:/volumes/qa/sv_1/b4db2566-1936-4ff9-9108-adaa0f4d33e3 2024-09-19T06:12:21.118 INFO:teuthology.orchestra.run.smithi003.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,key=0,fsid=782a5144-764c-11ef-bceb-c7b262605968" will pass to kernel 2024-09-19T06:12:21.121 INFO:teuthology.orchestra.run.smithi003.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T06:12:21.121 INFO:teuthology.orchestra.run.smithi003.stdout: You just mounted a file system that supports labels which does not 2024-09-19T06:12:21.121 INFO:teuthology.orchestra.run.smithi003.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T06:12:21.121 INFO:teuthology.orchestra.run.smithi003.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T06:12:21.121 INFO:teuthology.orchestra.run.smithi003.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T06:12:21.124 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T06:12:21.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:12:21.124 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T06:12:21.184 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T06:12:21.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T06:12:21.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:12:21.274 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:20 smithi003 ceph-mon[30893]: Standby manager daemon z restarted 2024-09-19T06:12:21.274 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:20 smithi003 ceph-mon[30893]: Standby manager daemon z started 2024-09-19T06:12:21.274 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:20 smithi003 ceph-mon[30893]: from='mgr.? 172.21.15.71:0/3029542432' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:12:21.275 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:20 smithi003 ceph-mon[30893]: from='mgr.? 172.21.15.71:0/3029542432' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:12:21.275 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:20 smithi003 ceph-mon[30893]: from='mgr.? 172.21.15.71:0/3029542432' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:12:21.275 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:20 smithi003 ceph-mon[30893]: from='mgr.? 172.21.15.71:0/3029542432' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:12:21.275 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:20 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:20.993+0000 7ff7a1436040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T06:12:21.275 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:21 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:21.075+0000 7ff7a1436040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T06:12:21.275 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:21 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:21.167+0000 7ff7a1436040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T06:12:21.275 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:21 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:21.272+0000 7ff7a1436040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T06:12:21.278 INFO:teuthology.orchestra.run.smithi003.stdout:client15135 2024-09-19T06:12:21.279 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-19T06:12:21.279 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:12:21.288 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:12:21 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y[36504]: 2024-09-19T06:12:21.139+0000 7ff8cdb9d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:12:21.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:20 smithi059 ceph-mon[35138]: Standby manager daemon z restarted 2024-09-19T06:12:21.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:20 smithi059 ceph-mon[35138]: Standby manager daemon z started 2024-09-19T06:12:21.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:20 smithi059 ceph-mon[35138]: from='mgr.? 172.21.15.71:0/3029542432' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:12:21.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:20 smithi059 ceph-mon[35138]: from='mgr.? 172.21.15.71:0/3029542432' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:12:21.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:20 smithi059 ceph-mon[35138]: from='mgr.? 172.21.15.71:0/3029542432' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:12:21.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:20 smithi059 ceph-mon[35138]: from='mgr.? 172.21.15.71:0/3029542432' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:12:21.316 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T06:12:21.335 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:12:20 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z[37474]: 2024-09-19T06:12:20.881+0000 7fea5d946040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:12:21.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:20 smithi071 ceph-mon[35662]: Standby manager daemon z restarted 2024-09-19T06:12:21.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:20 smithi071 ceph-mon[35662]: Standby manager daemon z started 2024-09-19T06:12:21.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:20 smithi071 ceph-mon[35662]: from='mgr.? 172.21.15.71:0/3029542432' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T06:12:21.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:20 smithi071 ceph-mon[35662]: from='mgr.? 172.21.15.71:0/3029542432' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:12:21.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:20 smithi071 ceph-mon[35662]: from='mgr.? 172.21.15.71:0/3029542432' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T06:12:21.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:20 smithi071 ceph-mon[35662]: from='mgr.? 172.21.15.71:0/3029542432' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:12:21.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T06:12:21.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:12:21.447 INFO:teuthology.orchestra.run.smithi003.stdout:client15135 2024-09-19T06:12:21.447 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T06:12:21.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T06:12:21.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:12:21.539 INFO:teuthology.orchestra.run.smithi003.stdout:client15135 2024-09-19T06:12:21.539 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/782a5144-764c-11ef-bceb-c7b262605968.client15135/status') 2024-09-19T06:12:21.584 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:21 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:21.348+0000 7ff7a1436040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T06:12:21.585 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:21 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:21.423+0000 7ff7a1436040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T06:12:21.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:12:21.642 INFO:teuthology.orchestra.run.smithi003.stdout:instance: client.15135 (3)192.168.0.1:0/1889542789 2024-09-19T06:12:21.642 INFO:teuthology.orchestra.run.smithi003.stdout:blocklisted: false 2024-09-19T06:12:21.642 INFO:teuthology.orchestra.run.smithi003.stderr:0+1 records in 2024-09-19T06:12:21.642 INFO:teuthology.orchestra.run.smithi003.stderr:0+1 records out 2024-09-19T06:12:21.642 INFO:teuthology.orchestra.run.smithi003.stderr:70 bytes copied, 7.5622e-05 s, 926 kB/s 2024-09-19T06:12:21.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:12:21.652 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T06:12:21.662 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T06:12:21.662 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi003.front.sepia.ceph.com 2024-09-19T06:12:21.662 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-19T06:12:21.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.818+0000 7fb67d400640 1 -- 172.21.15.3:0/1219369513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb678101b40 msgr2=0x7fb678101f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:21.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.818+0000 7fb67d400640 1 --2- 172.21.15.3:0/1219369513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb678101b40 0x7fb678101f40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb668009900 tx=0x7fb66802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:12:21.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.818+0000 7fb67d400640 1 -- 172.21.15.3:0/1219369513 shutdown_connections 2024-09-19T06:12:21.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.818+0000 7fb67d400640 1 --2- 172.21.15.3:0/1219369513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6781036f0 0x7fb678109f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:21.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.818+0000 7fb67d400640 1 --2- 172.21.15.3:0/1219369513 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb678102d30 0x7fb6781031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:21.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.818+0000 7fb67d400640 1 --2- 172.21.15.3:0/1219369513 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb678101b40 0x7fb678101f40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:21.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.818+0000 7fb67d400640 1 -- 172.21.15.3:0/1219369513 >> 172.21.15.3:0/1219369513 conn(0x7fb6780fd2e0 msgr2=0x7fb6780ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:21.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.819+0000 7fb67d400640 1 -- 172.21.15.3:0/1219369513 shutdown_connections 2024-09-19T06:12:21.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.819+0000 7fb67d400640 1 -- 172.21.15.3:0/1219369513 wait complete. 2024-09-19T06:12:21.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.819+0000 7fb67d400640 1 Processor -- start 2024-09-19T06:12:21.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.820+0000 7fb67d400640 1 -- start start 2024-09-19T06:12:21.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.820+0000 7fb67d400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb678101b40 0x7fb678197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:21.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.820+0000 7fb67d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb678102d30 0x7fb678198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:21.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.820+0000 7fb67d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6781036f0 0x7fb67819f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:21.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.820+0000 7fb67d400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb67810d7c0 con 0x7fb6781036f0 2024-09-19T06:12:21.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.820+0000 7fb67d400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb67810d640 con 0x7fb678102d30 2024-09-19T06:12:21.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.820+0000 7fb67d400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb67810d940 con 0x7fb678101b40 2024-09-19T06:12:21.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.820+0000 7fb677200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6781036f0 0x7fb67819f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:21.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.820+0000 7fb677200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6781036f0 0x7fb67819f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40542/0 (socket says 172.21.15.3:40542) 2024-09-19T06:12:21.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.820+0000 7fb677200640 1 -- 172.21.15.3:0/454265429 learned_addr learned my addr 172.21.15.3:0/454265429 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:21.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.820+0000 7fb676800640 1 --2- 172.21.15.3:0/454265429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb678101b40 0x7fb678197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:21.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.820+0000 7fb675e00640 1 --2- 172.21.15.3:0/454265429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb678102d30 0x7fb678198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:21.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.821+0000 7fb677200640 1 -- 172.21.15.3:0/454265429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb678101b40 msgr2=0x7fb678197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:21.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.821+0000 7fb677200640 1 --2- 172.21.15.3:0/454265429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb678101b40 0x7fb678197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:21.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.821+0000 7fb677200640 1 -- 172.21.15.3:0/454265429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb678102d30 msgr2=0x7fb678198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:21.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.821+0000 7fb677200640 1 --2- 172.21.15.3:0/454265429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb678102d30 0x7fb678198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:21.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.821+0000 7fb677200640 1 -- 172.21.15.3:0/454265429 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb67819fb00 con 0x7fb6781036f0 2024-09-19T06:12:21.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.821+0000 7fb676800640 1 --2- 172.21.15.3:0/454265429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb678101b40 0x7fb678197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:12:21.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.821+0000 7fb677200640 1 --2- 172.21.15.3:0/454265429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6781036f0 0x7fb67819f490 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb67000efd0 tx=0x7fb67000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:21.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.821+0000 7fb66f400640 1 -- 172.21.15.3:0/454265429 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb670003b70 con 0x7fb6781036f0 2024-09-19T06:12:21.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.821+0000 7fb66f400640 1 -- 172.21.15.3:0/454265429 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb670003d10 con 0x7fb6781036f0 2024-09-19T06:12:21.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.821+0000 7fb66f400640 1 -- 172.21.15.3:0/454265429 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6700109f0 con 0x7fb6781036f0 2024-09-19T06:12:21.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.821+0000 7fb67d400640 1 -- 172.21.15.3:0/454265429 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb67819fdf0 con 0x7fb6781036f0 2024-09-19T06:12:21.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.821+0000 7fb67d400640 1 -- 172.21.15.3:0/454265429 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6781a0260 con 0x7fb6781036f0 2024-09-19T06:12:21.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.823+0000 7fb67d400640 1 -- 172.21.15.3:0/454265429 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb678108fd0 con 0x7fb6781036f0 2024-09-19T06:12:21.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.824+0000 7fb66f400640 1 -- 172.21.15.3:0/454265429 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 138371+0+0 (secure 0 0 0) 0x7fb670004020 con 0x7fb6781036f0 2024-09-19T06:12:21.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.827+0000 7fb66f400640 1 --2- 172.21.15.3:0/454265429 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fb65c0a3310 0x7fb65c0a57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:21.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.827+0000 7fb676800640 1 -- 172.21.15.3:0/454265429 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fb65c0a3310 msgr2=0x7fb65c0a57d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.3:6800/1278931596 2024-09-19T06:12:21.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.827+0000 7fb66f400640 1 -- 172.21.15.3:0/454265429 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8269+0+0 (secure 0 0 0) 0x7fb6700cfe30 con 0x7fb6781036f0 2024-09-19T06:12:21.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.827+0000 7fb676800640 1 --2- 172.21.15.3:0/454265429 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fb65c0a3310 0x7fb65c0a57d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:12:21.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.831+0000 7fb66f400640 1 -- 172.21.15.3:0/454265429 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb67009cad0 con 0x7fb6781036f0 2024-09-19T06:12:21.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:21.966+0000 7fb66f400640 1 -- 172.21.15.3:0/454265429 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mgrmap(e 21) ==== 138371+0+0 (secure 0 0 0) 0x7fb670004310 con 0x7fb6781036f0 2024-09-19T06:12:22.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:22.028+0000 7fb676800640 1 -- 172.21.15.3:0/454265429 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fb65c0a3310 msgr2=0x7fb65c0a57d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.3:6800/1278931596 2024-09-19T06:12:22.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:22.028+0000 7fb676800640 1 --2- 172.21.15.3:0/454265429 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fb65c0a3310 0x7fb65c0a57d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:12:22.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:22.059+0000 7fb67d400640 1 -- 172.21.15.3:0/454265429 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fb678062df0 con 0x7fb6781036f0 2024-09-19T06:12:22.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:21 smithi059 ceph-mon[35138]: mgrmap e20: x(active, since 9m), standbys: y, z 2024-09-19T06:12:22.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:21 smithi059 ceph-mon[35138]: Standby manager daemon y restarted 2024-09-19T06:12:22.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:21 smithi059 ceph-mon[35138]: Standby manager daemon y started 2024-09-19T06:12:22.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:21 smithi059 ceph-mon[35138]: from='mgr.? 172.21.15.59:0/4154636990' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:12:22.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:21 smithi059 ceph-mon[35138]: from='mgr.? 172.21.15.59:0/4154636990' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:12:22.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:21 smithi059 ceph-mon[35138]: from='mgr.? 172.21.15.59:0/4154636990' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:12:22.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:21 smithi059 ceph-mon[35138]: from='mgr.? 172.21.15.59:0/4154636990' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:12:22.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:21 smithi003 ceph-mon[30893]: mgrmap e20: x(active, since 9m), standbys: y, z 2024-09-19T06:12:22.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:21 smithi003 ceph-mon[30893]: Standby manager daemon y restarted 2024-09-19T06:12:22.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:21 smithi003 ceph-mon[30893]: Standby manager daemon y started 2024-09-19T06:12:22.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:21 smithi003 ceph-mon[30893]: from='mgr.? 172.21.15.59:0/4154636990' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:12:22.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:21 smithi003 ceph-mon[30893]: from='mgr.? 172.21.15.59:0/4154636990' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:12:22.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:21 smithi003 ceph-mon[30893]: from='mgr.? 172.21.15.59:0/4154636990' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:12:22.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:21 smithi003 ceph-mon[30893]: from='mgr.? 172.21.15.59:0/4154636990' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:12:22.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:21 smithi071 ceph-mon[35662]: mgrmap e20: x(active, since 9m), standbys: y, z 2024-09-19T06:12:22.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:21 smithi071 ceph-mon[35662]: Standby manager daemon y restarted 2024-09-19T06:12:22.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:21 smithi071 ceph-mon[35662]: Standby manager daemon y started 2024-09-19T06:12:22.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:21 smithi071 ceph-mon[35662]: from='mgr.? 172.21.15.59:0/4154636990' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T06:12:22.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:21 smithi071 ceph-mon[35662]: from='mgr.? 172.21.15.59:0/4154636990' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:12:22.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:21 smithi071 ceph-mon[35662]: from='mgr.? 172.21.15.59:0/4154636990' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T06:12:22.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:21 smithi071 ceph-mon[35662]: from='mgr.? 172.21.15.59:0/4154636990' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:12:22.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:22.421+0000 7fb66f400640 1 -- 172.21.15.3:0/454265429 <== mon.0 v2:172.21.15.3:3300/0 8 ==== mgrmap(e 22) ==== 138040+0+0 (secure 0 0 0) 0x7fb6700cd930 con 0x7fb6781036f0 2024-09-19T06:12:22.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:22.422+0000 7fb66f400640 1 -- 172.21.15.3:0/454265429 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fb65c0a3310 msgr2=0x7fb65c0a57d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:12:22.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:22.422+0000 7fb66f400640 1 --2- 172.21.15.3:0/454265429 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fb65c0a3310 0x7fb65c0a57d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:22.754 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:22.406+0000 7ff7a1436040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T06:12:22.961 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:22.959+0000 7fb66f400640 1 -- 172.21.15.3:0/454265429 <== mon.0 v2:172.21.15.3:3300/0 9 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v29) ==== 117+0+0 (secure 0 0 0) 0x7fb6700c4170 con 0x7fb6781036f0 2024-09-19T06:12:22.964 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:22.961+0000 7fb67d400640 1 -- 172.21.15.3:0/454265429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6781036f0 msgr2=0x7fb67819f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:22.964 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:22.961+0000 7fb67d400640 1 --2- 172.21.15.3:0/454265429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6781036f0 0x7fb67819f490 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb67000efd0 tx=0x7fb67000c6a0 comp rx=0 tx=0).stop 2024-09-19T06:12:22.964 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:22.962+0000 7fb67d400640 1 -- 172.21.15.3:0/454265429 shutdown_connections 2024-09-19T06:12:22.964 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:22.962+0000 7fb67d400640 1 --2- 172.21.15.3:0/454265429 >> [v2:172.21.15.3:6800/1278931596,v1:172.21.15.3:6801/1278931596] conn(0x7fb65c0a3310 0x7fb65c0a57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:22.964 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:22.962+0000 7fb67d400640 1 --2- 172.21.15.3:0/454265429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb6781036f0 0x7fb67819f490 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:22.964 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:22.962+0000 7fb67d400640 1 --2- 172.21.15.3:0/454265429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb678102d30 0x7fb678198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:22.964 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:22.962+0000 7fb67d400640 1 --2- 172.21.15.3:0/454265429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb678101b40 0x7fb678197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:22.964 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:22.962+0000 7fb67d400640 1 -- 172.21.15.3:0/454265429 >> 172.21.15.3:0/454265429 conn(0x7fb6780fd2e0 msgr2=0x7fb6781061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:22.964 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:22.962+0000 7fb67d400640 1 -- 172.21.15.3:0/454265429 shutdown_connections 2024-09-19T06:12:22.964 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:22.962+0000 7fb67d400640 1 -- 172.21.15.3:0/454265429 wait complete. 2024-09-19T06:12:22.982 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T06:12:22.994 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-19T06:12:23.005 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:12:23.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: mgrmap e21: x(active, since 9m), standbys: y, z 2024-09-19T06:12:23.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/454265429' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T06:12:23.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: Active manager daemon x restarted 2024-09-19T06:12:23.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: Activating manager daemon x 2024-09-19T06:12:23.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T06:12:23.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: mgrmap e22: x(active, starting, since 0.013622s), standbys: y, z 2024-09-19T06:12:23.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:12:23.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:12:23.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:12:23.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:12:23.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:12:23.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:12:23.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:12:23.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:12:23.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:12:23.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:12:23.040 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:12:23.041 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:12:23.041 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:12:23.041 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:12:23.041 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:12:23.041 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:12:23.041 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:12:23.041 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:12:23.042 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:12:23.042 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:12:23.042 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:12:23.042 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:12:23.042 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:12:23.043 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:12:23.043 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:12:23.043 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:12:23.043 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:12:23.043 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:12:23.044 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:12:23.044 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:12:23.044 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:12:23.044 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:12:23.044 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:12:23.044 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: Manager daemon x is now available 2024-09-19T06:12:23.045 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:23.045 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:12:23.045 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:22 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:12:23.064 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:22.751+0000 7ff6fa600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:12:23.064 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:22.751+0000 7ff6fa600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:12:23.064 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:22.751+0000 7ff6fa600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:12:23.064 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:22.751+0000 7ff6fa600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:12:23.064 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:22.751+0000 7ff6fa600640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:12:23.064 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:22.752+0000 7ff6fe200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:12:23.064 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:22.752+0000 7ff6fe200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:12:23.064 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:22.752+0000 7ff6fe200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:12:23.064 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:22.752+0000 7ff6fe200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:12:23.064 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:22.752+0000 7ff6fe200640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:12:23.065 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: mgrmap e21: x(active, since 9m), standbys: y, z 2024-09-19T06:12:23.065 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/454265429' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T06:12:23.065 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: Active manager daemon x restarted 2024-09-19T06:12:23.065 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: Activating manager daemon x 2024-09-19T06:12:23.065 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T06:12:23.065 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: mgrmap e22: x(active, starting, since 0.013622s), standbys: y, z 2024-09-19T06:12:23.065 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:12:23.065 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:12:23.066 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:12:23.066 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:12:23.066 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:12:23.066 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:12:23.066 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:12:23.066 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:12:23.066 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:12:23.066 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:12:23.066 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:12:23.066 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:12:23.067 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:12:23.067 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:12:23.067 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:12:23.067 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:12:23.067 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:12:23.067 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:12:23.067 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:12:23.067 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:12:23.067 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:12:23.067 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:12:23.067 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:12:23.068 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:12:23.068 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:12:23.068 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:12:23.068 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:12:23.068 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:12:23.068 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:12:23.069 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:12:23.069 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:12:23.069 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:12:23.069 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:12:23.069 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: Manager daemon x is now available 2024-09-19T06:12:23.069 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:23.069 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:12:23.069 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:22 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:12:23.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: mgrmap e21: x(active, since 9m), standbys: y, z 2024-09-19T06:12:23.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/454265429' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T06:12:23.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: Active manager daemon x restarted 2024-09-19T06:12:23.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: Activating manager daemon x 2024-09-19T06:12:23.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T06:12:23.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: mgrmap e22: x(active, starting, since 0.013622s), standbys: y, z 2024-09-19T06:12:23.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T06:12:23.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T06:12:23.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T06:12:23.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T06:12:23.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T06:12:23.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:12:23.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:12:23.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:12:23.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:12:23.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:12:23.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:12:23.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:12:23.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:12:23.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:12:23.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:12:23.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T06:12:23.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T06:12:23.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T06:12:23.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:12:23.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:12:23.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:12:23.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:12:23.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:12:23.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:12:23.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T06:12:23.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T06:12:23.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T06:12:23.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T06:12:23.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T06:12:23.088 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T06:12:23.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:12:23.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:12:23.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:12:23.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: Manager daemon x is now available 2024-09-19T06:12:23.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:23.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:12:23.089 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:22 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T06:12:23.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.178+0000 7f91c0a00640 1 -- 172.21.15.3:0/327854462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91bc105300 msgr2=0x7f91bc105700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:23.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.178+0000 7f91c0a00640 1 --2- 172.21.15.3:0/327854462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91bc105300 0x7f91bc105700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f91ac009900 tx=0x7f91ac02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.178+0000 7f91c0a00640 1 -- 172.21.15.3:0/327854462 shutdown_connections 2024-09-19T06:12:23.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.178+0000 7f91c0a00640 1 --2- 172.21.15.3:0/327854462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91bc1041f0 0x7f91bc10c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.178+0000 7f91c0a00640 1 --2- 172.21.15.3:0/327854462 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91bc103830 0x7f91bc103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.178+0000 7f91c0a00640 1 --2- 172.21.15.3:0/327854462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91bc105300 0x7f91bc105700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.178+0000 7f91c0a00640 1 -- 172.21.15.3:0/327854462 >> 172.21.15.3:0/327854462 conn(0x7f91bc0ff380 msgr2=0x7f91bc1017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:23.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.178+0000 7f91c0a00640 1 -- 172.21.15.3:0/327854462 shutdown_connections 2024-09-19T06:12:23.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.178+0000 7f91c0a00640 1 -- 172.21.15.3:0/327854462 wait complete. 2024-09-19T06:12:23.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.179+0000 7f91c0a00640 1 Processor -- start 2024-09-19T06:12:23.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.179+0000 7f91c0a00640 1 -- start start 2024-09-19T06:12:23.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.179+0000 7f91c0a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91bc103830 0x7f91bc19a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:23.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.179+0000 7f91c0a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91bc1041f0 0x7f91bc19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:23.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.179+0000 7f91c0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91bc105300 0x7f91bc1a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:23.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.179+0000 7f91c0a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc10f9f0 con 0x7f91bc1041f0 2024-09-19T06:12:23.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.179+0000 7f91c0a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc10f870 con 0x7f91bc105300 2024-09-19T06:12:23.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.179+0000 7f91c0a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc10fb70 con 0x7f91bc103830 2024-09-19T06:12:23.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.180+0000 7f91bb400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91bc103830 0x7f91bc19a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:23.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.180+0000 7f91baa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91bc1041f0 0x7f91bc19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:23.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.180+0000 7f91bb400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91bc103830 0x7f91bc19a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:46908/0 (socket says 172.21.15.3:46908) 2024-09-19T06:12:23.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.180+0000 7f91bb400640 1 -- 172.21.15.3:0/1991702049 learned_addr learned my addr 172.21.15.3:0/1991702049 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:23.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.180+0000 7f91bbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91bc105300 0x7f91bc1a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:23.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.180+0000 7f91bb400640 1 -- 172.21.15.3:0/1991702049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91bc105300 msgr2=0x7f91bc1a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:23.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.180+0000 7f91bb400640 1 --2- 172.21.15.3:0/1991702049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91bc105300 0x7f91bc1a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.180+0000 7f91bb400640 1 -- 172.21.15.3:0/1991702049 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91bc1041f0 msgr2=0x7f91bc19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:23.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.180+0000 7f91bb400640 1 --2- 172.21.15.3:0/1991702049 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91bc1041f0 0x7f91bc19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.180+0000 7f91bb400640 1 -- 172.21.15.3:0/1991702049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91bc1a1ca0 con 0x7f91bc103830 2024-09-19T06:12:23.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.180+0000 7f91baa00640 1 --2- 172.21.15.3:0/1991702049 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91bc1041f0 0x7f91bc19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:23.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.181+0000 7f91bb400640 1 --2- 172.21.15.3:0/1991702049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91bc103830 0x7f91bc19a080 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f91ac031440 tx=0x7f91ac032ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:23.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.181+0000 7f91b3e00640 1 -- 172.21.15.3:0/1991702049 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac03f030 con 0x7f91bc103830 2024-09-19T06:12:23.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.181+0000 7f91b3e00640 1 -- 172.21.15.3:0/1991702049 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91ac003ce0 con 0x7f91bc103830 2024-09-19T06:12:23.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.181+0000 7f91c0a00640 1 -- 172.21.15.3:0/1991702049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91bc1a1f30 con 0x7f91bc103830 2024-09-19T06:12:23.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.181+0000 7f91b3e00640 1 -- 172.21.15.3:0/1991702049 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac035070 con 0x7f91bc103830 2024-09-19T06:12:23.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.181+0000 7f91c0a00640 1 -- 172.21.15.3:0/1991702049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91bc1a2390 con 0x7f91bc103830 2024-09-19T06:12:23.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.182+0000 7f91c0a00640 1 -- 172.21.15.3:0/1991702049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91bc103cb0 con 0x7f91bc103830 2024-09-19T06:12:23.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.184+0000 7f91b3e00640 1 -- 172.21.15.3:0/1991702049 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 22) ==== 138040+0+0 (secure 0 0 0) 0x7f91ac042030 con 0x7f91bc103830 2024-09-19T06:12:23.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.187+0000 7f91b3e00640 1 -- 172.21.15.3:0/1991702049 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f91ac0ef560 con 0x7f91bc103830 2024-09-19T06:12:23.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.189+0000 7f91b3e00640 1 -- 172.21.15.3:0/1991702049 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f91ac0bbeb0 con 0x7f91bc103830 2024-09-19T06:12:23.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.377+0000 7f91c0a00640 1 -- 172.21.15.3:0/1991702049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91bc062df0 con 0x7f91bc103830 2024-09-19T06:12:23.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.379+0000 7f91b3e00640 1 -- 172.21.15.3:0/1991702049 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+22955 (secure 0 0 0) 0x7f91ac0c01b0 con 0x7f91bc103830 2024-09-19T06:12:23.381 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:12:23.381 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":89,"fsid":"782a5144-764c-11ef-bceb-c7b262605968","created":"2024-09-19T06:01:35.224753+0000","modified":"2024-09-19T06:12:22.409698+0000","last_up_change":"2024-09-19T06:09:02.478979+0000","last_in_change":"2024-09-19T06:08:38.865280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:04:56.654478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:09:58.426008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:10:01.215704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd89ea4b-a24e-4946-80fc-1776b6d05e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6803","nonce":2061486638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6805","nonce":2061486638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6809","nonce":2061486638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6807","nonce":2061486638}]},"public_addr":"172.21.15.3:6803/2061486638","cluster_addr":"172.21.15.3:6805/2061486638","heartbeat_back_addr":"172.21.15.3:6809/2061486638","heartbeat_front_addr":"172.21.15.3:6807/2061486638","state":["exists","up"]},{"osd":1,"uuid":"e03ca275-8da5-402f-9cd2-654ca422b9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6801","nonce":129318538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6803","nonce":129318538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6807","nonce":129318538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6805","nonce":129318538}]},"public_addr":"172.21.15.59:6801/129318538","cluster_addr":"172.21.15.59:6803/129318538","heartbeat_back_addr":"172.21.15.59:6807/129318538","heartbeat_front_addr":"172.21.15.59:6805/129318538","state":["exists","up"]},{"osd":2,"uuid":"62b7d36d-6078-4027-93b2-009be70a6d80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6801","nonce":2436210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6803","nonce":2436210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6807","nonce":2436210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6805","nonce":2436210695}]},"public_addr":"172.21.15.71:6801/2436210695","cluster_addr":"172.21.15.71:6803/2436210695","heartbeat_back_addr":"172.21.15.71:6807/2436210695","heartbeat_front_addr":"172.21.15.71:6805/2436210695","state":["exists","up"]},{"osd":3,"uuid":"ba33cc45-0103-443d-b262-622a505d9806","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6811","nonce":3577306700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6813","nonce":3577306700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6817","nonce":3577306700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6815","nonce":3577306700}]},"public_addr":"172.21.15.3:6811/3577306700","cluster_addr":"172.21.15.3:6813/3577306700","heartbeat_back_addr":"172.21.15.3:6817/3577306700","heartbeat_front_addr":"172.21.15.3:6815/3577306700","state":["exists","up"]},{"osd":4,"uuid":"40564c0c-6335-4207-a8e0-8078c9bfd015","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6809","nonce":4002980986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6811","nonce":4002980986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6815","nonce":4002980986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6813","nonce":4002980986}]},"public_addr":"172.21.15.59:6809/4002980986","cluster_addr":"172.21.15.59:6811/4002980986","heartbeat_back_addr":"172.21.15.59:6815/4002980986","heartbeat_front_addr":"172.21.15.59:6813/4002980986","state":["exists","up"]},{"osd":5,"uuid":"4db04b82-3403-4fd5-9eb7-7b81ed6b1d26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6809","nonce":2455500497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6811","nonce":2455500497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6815","nonce":2455500497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6813","nonce":2455500497}]},"public_addr":"172.21.15.71:6809/2455500497","cluster_addr":"172.21.15.71:6811/2455500497","heartbeat_back_addr":"172.21.15.71:6815/2455500497","heartbeat_front_addr":"172.21.15.71:6813/2455500497","state":["exists","up"]},{"osd":6,"uuid":"42a74f01-c5d0-4fc6-a8ee-a8bd84d4ab4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6819","nonce":823411903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6821","nonce":823411903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6825","nonce":823411903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6823","nonce":823411903}]},"public_addr":"172.21.15.3:6819/823411903","cluster_addr":"172.21.15.3:6821/823411903","heartbeat_back_addr":"172.21.15.3:6825/823411903","heartbeat_front_addr":"172.21.15.3:6823/823411903","state":["exists","up"]},{"osd":7,"uuid":"8a9bc2ec-4292-465d-8a0d-dda78521a319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6817","nonce":2133603853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6819","nonce":2133603853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6823","nonce":2133603853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6821","nonce":2133603853}]},"public_addr":"172.21.15.59:6817/2133603853","cluster_addr":"172.21.15.59:6819/2133603853","heartbeat_back_addr":"172.21.15.59:6823/2133603853","heartbeat_front_addr":"172.21.15.59:6821/2133603853","state":["exists","up"]},{"osd":8,"uuid":"6099a5c4-3504-43ca-8c58-d23f9096cd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6817","nonce":905333117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6819","nonce":905333117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6823","nonce":905333117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6821","nonce":905333117}]},"public_addr":"172.21.15.71:6817/905333117","cluster_addr":"172.21.15.71:6819/905333117","heartbeat_back_addr":"172.21.15.71:6823/905333117","heartbeat_front_addr":"172.21.15.71:6821/905333117","state":["exists","up"]},{"osd":9,"uuid":"b5a8aac6-bb10-4db8-a056-25228fbe754c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6827","nonce":124909267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6829","nonce":124909267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6833","nonce":124909267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6831","nonce":124909267}]},"public_addr":"172.21.15.3:6827/124909267","cluster_addr":"172.21.15.3:6829/124909267","heartbeat_back_addr":"172.21.15.3:6833/124909267","heartbeat_front_addr":"172.21.15.3:6831/124909267","state":["exists","up"]},{"osd":10,"uuid":"e49f3aab-0804-4aea-ae3f-38f022ab5239","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6825","nonce":784134238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6827","nonce":784134238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6831","nonce":784134238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6829","nonce":784134238}]},"public_addr":"172.21.15.59:6825/784134238","cluster_addr":"172.21.15.59:6827/784134238","heartbeat_back_addr":"172.21.15.59:6831/784134238","heartbeat_front_addr":"172.21.15.59:6829/784134238","state":["exists","up"]},{"osd":11,"uuid":"6c6d6c23-bcf7-43e7-94d1-5f2ebaa15441","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6825","nonce":3502550915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6827","nonce":3502550915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6831","nonce":3502550915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6829","nonce":3502550915}]},"public_addr":"172.21.15.71:6825/3502550915","cluster_addr":"172.21.15.71:6827/3502550915","heartbeat_back_addr":"172.21.15.71:6831/3502550915","heartbeat_front_addr":"172.21.15.71:6829/3502550915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:01.683342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:28.058683+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:53.250819+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:05:23.267377+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:05:49.756289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:06:15.766613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:06:46.054328+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:12.579180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:37.976863+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:08.683966+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:35.120765+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:00.624411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/3104337397":"2024-09-20T06:12:22.409669+0000","172.21.15.3:0/4101082351":"2024-09-20T06:12:22.409669+0000","172.21.15.3:0/3358701720":"2024-09-20T06:12:22.409669+0000","172.21.15.3:0/1616091100":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/3155841850":"2024-09-20T06:12:22.409669+0000","172.21.15.3:6800/2386230415":"2024-09-20T06:02:01.122348+0000","172.21.15.3:0/2122482494":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6801/2386230415":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6800/1278931596":"2024-09-20T06:12:22.409669+0000","172.21.15.3:0/1658697906":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6801/518259590":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/953348594":"2024-09-20T06:02:01.122348+0000","172.21.15.3:0/2065281908":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/1458736313":"2024-09-20T06:02:30.039686+0000","172.21.15.3:6800/518259590":"2024-09-20T06:02:30.039686+0000","172.21.15.3:6801/1278931596":"2024-09-20T06:12:22.409669+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:12:23.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.381+0000 7f91c0a00640 1 -- 172.21.15.3:0/1991702049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91bc103830 msgr2=0x7f91bc19a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:23.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.381+0000 7f91c0a00640 1 --2- 172.21.15.3:0/1991702049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91bc103830 0x7f91bc19a080 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f91ac031440 tx=0x7f91ac032ce0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.381+0000 7f91c0a00640 1 -- 172.21.15.3:0/1991702049 shutdown_connections 2024-09-19T06:12:23.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.381+0000 7f91c0a00640 1 --2- 172.21.15.3:0/1991702049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91bc105300 0x7f91bc1a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.381+0000 7f91c0a00640 1 --2- 172.21.15.3:0/1991702049 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f91bc1041f0 0x7f91bc19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.381+0000 7f91c0a00640 1 --2- 172.21.15.3:0/1991702049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f91bc103830 0x7f91bc19a080 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.381+0000 7f91c0a00640 1 -- 172.21.15.3:0/1991702049 >> 172.21.15.3:0/1991702049 conn(0x7f91bc0ff380 msgr2=0x7f91bc108180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:23.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.381+0000 7f91c0a00640 1 -- 172.21.15.3:0/1991702049 shutdown_connections 2024-09-19T06:12:23.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.381+0000 7f91c0a00640 1 -- 172.21.15.3:0/1991702049 wait complete. 2024-09-19T06:12:23.401 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T06:04:56.654478+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T06:09:58.426008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T06:10:01.215704+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T06:12:23.402 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T06:12:23.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.588+0000 7f9630c00640 1 -- 172.21.15.3:0/2797060220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f962c077df0 msgr2=0x7f962c078250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:23.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.588+0000 7f9630c00640 1 --2- 172.21.15.3:0/2797060220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f962c077df0 0x7f962c078250 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9618009900 tx=0x7f961802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.588+0000 7f9630c00640 1 -- 172.21.15.3:0/2797060220 shutdown_connections 2024-09-19T06:12:23.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.588+0000 7f9630c00640 1 --2- 172.21.15.3:0/2797060220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f962c078790 0x7f962c079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.588+0000 7f9630c00640 1 --2- 172.21.15.3:0/2797060220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f962c077df0 0x7f962c078250 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.588+0000 7f9630c00640 1 --2- 172.21.15.3:0/2797060220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f962c076bb0 0x7f962c076fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.588+0000 7f9630c00640 1 -- 172.21.15.3:0/2797060220 >> 172.21.15.3:0/2797060220 conn(0x7f962c0ff4a0 msgr2=0x7f962c1018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:23.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.588+0000 7f9630c00640 1 -- 172.21.15.3:0/2797060220 shutdown_connections 2024-09-19T06:12:23.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.588+0000 7f9630c00640 1 -- 172.21.15.3:0/2797060220 wait complete. 2024-09-19T06:12:23.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.589+0000 7f9630c00640 1 Processor -- start 2024-09-19T06:12:23.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.589+0000 7f9630c00640 1 -- start start 2024-09-19T06:12:23.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.589+0000 7f9630c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f962c076bb0 0x7f962c19e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:23.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.589+0000 7f9630c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f962c077df0 0x7f962c19e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:23.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.589+0000 7f9630c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f962c078790 0x7f962c1a5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:23.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.589+0000 7f9630c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f962c113e20 con 0x7f962c078790 2024-09-19T06:12:23.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.589+0000 7f9630c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f962c113ca0 con 0x7f962c077df0 2024-09-19T06:12:23.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.589+0000 7f9630c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f962c113fa0 con 0x7f962c076bb0 2024-09-19T06:12:23.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.589+0000 7f9629e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f962c076bb0 0x7f962c19e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:23.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.589+0000 7f9629e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f962c076bb0 0x7f962c19e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:46932/0 (socket says 172.21.15.3:46932) 2024-09-19T06:12:23.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.589+0000 7f9629e00640 1 -- 172.21.15.3:0/902699006 learned_addr learned my addr 172.21.15.3:0/902699006 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:23.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.589+0000 7f9629400640 1 --2- 172.21.15.3:0/902699006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f962c077df0 0x7f962c19e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:23.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.590+0000 7f962a800640 1 --2- 172.21.15.3:0/902699006 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f962c078790 0x7f962c1a5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:23.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.590+0000 7f9629e00640 1 -- 172.21.15.3:0/902699006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f962c077df0 msgr2=0x7f962c19e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:23.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.590+0000 7f9629e00640 1 --2- 172.21.15.3:0/902699006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f962c077df0 0x7f962c19e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.590+0000 7f9629e00640 1 -- 172.21.15.3:0/902699006 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f962c078790 msgr2=0x7f962c1a5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:23.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.590+0000 7f9629e00640 1 --2- 172.21.15.3:0/902699006 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f962c078790 0x7f962c1a5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.590+0000 7f9629e00640 1 -- 172.21.15.3:0/902699006 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f962c1a60a0 con 0x7f962c076bb0 2024-09-19T06:12:23.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.590+0000 7f9629e00640 1 --2- 172.21.15.3:0/902699006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f962c076bb0 0x7f962c19e480 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f961c00d950 tx=0x7f961c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:23.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.590+0000 7f9622a00640 1 -- 172.21.15.3:0/902699006 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961c017030 con 0x7f962c076bb0 2024-09-19T06:12:23.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.590+0000 7f9622a00640 1 -- 172.21.15.3:0/902699006 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f961c004020 con 0x7f962c076bb0 2024-09-19T06:12:23.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.590+0000 7f9622a00640 1 -- 172.21.15.3:0/902699006 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961c0047a0 con 0x7f962c076bb0 2024-09-19T06:12:23.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.591+0000 7f9630c00640 1 -- 172.21.15.3:0/902699006 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f962c1a6390 con 0x7f962c076bb0 2024-09-19T06:12:23.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.591+0000 7f9630c00640 1 -- 172.21.15.3:0/902699006 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f962c1a6860 con 0x7f962c076bb0 2024-09-19T06:12:23.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.593+0000 7f9630c00640 1 -- 172.21.15.3:0/902699006 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f962c1106b0 con 0x7f962c076bb0 2024-09-19T06:12:23.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.594+0000 7f9622a00640 1 -- 172.21.15.3:0/902699006 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 23) ==== 138167+0+0 (secure 0 0 0) 0x7f961c0041d0 con 0x7f962c076bb0 2024-09-19T06:12:23.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.595+0000 7f9622a00640 1 --2- 172.21.15.3:0/902699006 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f96100a30d0 0x7f96100a5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:23.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.596+0000 7f9622a00640 1 -- 172.21.15.3:0/902699006 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f961c0cf070 con 0x7f962c076bb0 2024-09-19T06:12:23.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.596+0000 7f9629400640 1 --2- 172.21.15.3:0/902699006 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f96100a30d0 0x7f96100a5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:23.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.596+0000 7f9629400640 1 --2- 172.21.15.3:0/902699006 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f96100a30d0 0x7f96100a5590 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9618031440 tx=0x7f96180315b0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:23.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.599+0000 7f9622a00640 1 -- 172.21.15.3:0/902699006 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f961c09bf20 con 0x7f962c076bb0 2024-09-19T06:12:23.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.796+0000 7f9630c00640 1 -- 172.21.15.3:0/902699006 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f962c062df0 con 0x7f962c076bb0 2024-09-19T06:12:23.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.797+0000 7f9622a00640 1 -- 172.21.15.3:0/902699006 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7f961c09b820 con 0x7f962c076bb0 2024-09-19T06:12:23.799 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2024-09-19T06:12:23.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.799+0000 7f9630c00640 1 -- 172.21.15.3:0/902699006 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f96100a30d0 msgr2=0x7f96100a5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:23.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.799+0000 7f9630c00640 1 --2- 172.21.15.3:0/902699006 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f96100a30d0 0x7f96100a5590 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9618031440 tx=0x7f96180315b0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.799+0000 7f9630c00640 1 -- 172.21.15.3:0/902699006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f962c076bb0 msgr2=0x7f962c19e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:23.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.799+0000 7f9630c00640 1 --2- 172.21.15.3:0/902699006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f962c076bb0 0x7f962c19e480 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f961c00d950 tx=0x7f961c00de10 comp rx=0 tx=0).stop 2024-09-19T06:12:23.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.799+0000 7f9630c00640 1 -- 172.21.15.3:0/902699006 shutdown_connections 2024-09-19T06:12:23.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.799+0000 7f9630c00640 1 --2- 172.21.15.3:0/902699006 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f96100a30d0 0x7f96100a5590 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.799+0000 7f9630c00640 1 --2- 172.21.15.3:0/902699006 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f962c078790 0x7f962c1a5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.799+0000 7f9630c00640 1 --2- 172.21.15.3:0/902699006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f962c077df0 0x7f962c19e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.799+0000 7f9630c00640 1 --2- 172.21.15.3:0/902699006 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f962c076bb0 0x7f962c19e480 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.799+0000 7f9630c00640 1 -- 172.21.15.3:0/902699006 >> 172.21.15.3:0/902699006 conn(0x7f962c0ff4a0 msgr2=0x7f962c100f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:23.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.800+0000 7f9630c00640 1 -- 172.21.15.3:0/902699006 shutdown_connections 2024-09-19T06:12:23.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.800+0000 7f9630c00640 1 -- 172.21.15.3:0/902699006 wait complete. 2024-09-19T06:12:23.819 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T06:12:23.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.989+0000 7fd21de00640 1 -- 172.21.15.3:0/3757543906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd218101a30 msgr2=0x7fd218101eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:23.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.989+0000 7fd21de00640 1 --2- 172.21.15.3:0/3757543906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd218101a30 0x7fd218101eb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd204009900 tx=0x7fd20402a410 comp rx=0 tx=0).stop 2024-09-19T06:12:23.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.989+0000 7fd21de00640 1 -- 172.21.15.3:0/3757543906 shutdown_connections 2024-09-19T06:12:23.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.989+0000 7fd21de00640 1 --2- 172.21.15.3:0/3757543906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2181023f0 0x7fd218108c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.989+0000 7fd21de00640 1 --2- 172.21.15.3:0/3757543906 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd218101a30 0x7fd218101eb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.989+0000 7fd21de00640 1 --2- 172.21.15.3:0/3757543906 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd218100840 0x7fd218100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.989+0000 7fd21de00640 1 -- 172.21.15.3:0/3757543906 >> 172.21.15.3:0/3757543906 conn(0x7fd2180fbfa0 msgr2=0x7fd2180fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:23.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.989+0000 7fd21de00640 1 -- 172.21.15.3:0/3757543906 shutdown_connections 2024-09-19T06:12:23.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.989+0000 7fd21de00640 1 -- 172.21.15.3:0/3757543906 wait complete. 2024-09-19T06:12:23.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.990+0000 7fd21de00640 1 Processor -- start 2024-09-19T06:12:23.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.991+0000 7fd21de00640 1 -- start start 2024-09-19T06:12:23.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.991+0000 7fd21de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd218100840 0x7fd218199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:23.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.991+0000 7fd21de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd218101a30 0x7fd21819a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:23.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.991+0000 7fd21de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2181023f0 0x7fd2181a1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:23.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.991+0000 7fd21de00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd21810d670 con 0x7fd218101a30 2024-09-19T06:12:23.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.991+0000 7fd21de00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd21810d4f0 con 0x7fd218100840 2024-09-19T06:12:23.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.991+0000 7fd21de00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd21810d7f0 con 0x7fd2181023f0 2024-09-19T06:12:23.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.991+0000 7fd217e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd218101a30 0x7fd21819a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:23.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.991+0000 7fd21ca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd218100840 0x7fd218199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:23.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.991+0000 7fd217e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd218101a30 0x7fd21819a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39314/0 (socket says 172.21.15.3:39314) 2024-09-19T06:12:23.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.991+0000 7fd217e00640 1 -- 172.21.15.3:0/1525295512 learned_addr learned my addr 172.21.15.3:0/1525295512 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:23.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.991+0000 7fd21d400640 1 --2- 172.21.15.3:0/1525295512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2181023f0 0x7fd2181a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:23.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.992+0000 7fd217e00640 1 -- 172.21.15.3:0/1525295512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2181023f0 msgr2=0x7fd2181a1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:23.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.992+0000 7fd217e00640 1 --2- 172.21.15.3:0/1525295512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2181023f0 0x7fd2181a1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:23.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.992+0000 7fd217e00640 1 -- 172.21.15.3:0/1525295512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd218100840 msgr2=0x7fd218199ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:23.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.992+0000 7fd217e00640 1 --2- 172.21.15.3:0/1525295512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd218100840 0x7fd218199ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:24.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.992+0000 7fd217e00640 1 -- 172.21.15.3:0/1525295512 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2181a1b00 con 0x7fd218101a30 2024-09-19T06:12:24.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.992+0000 7fd217e00640 1 --2- 172.21.15.3:0/1525295512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd218101a30 0x7fd21819a420 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd204031440 tx=0x7fd204032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:24.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.993+0000 7fd215600640 1 -- 172.21.15.3:0/1525295512 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20403f030 con 0x7fd218101a30 2024-09-19T06:12:24.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.993+0000 7fd21de00640 1 -- 172.21.15.3:0/1525295512 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2181a1d90 con 0x7fd218101a30 2024-09-19T06:12:24.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.993+0000 7fd215600640 1 -- 172.21.15.3:0/1525295512 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd204003ce0 con 0x7fd218101a30 2024-09-19T06:12:24.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.993+0000 7fd215600640 1 -- 172.21.15.3:0/1525295512 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd204035070 con 0x7fd218101a30 2024-09-19T06:12:24.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.993+0000 7fd21de00640 1 -- 172.21.15.3:0/1525295512 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2181a2220 con 0x7fd218101a30 2024-09-19T06:12:24.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.994+0000 7fd21de00640 1 -- 172.21.15.3:0/1525295512 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2181a2450 con 0x7fd218101a30 2024-09-19T06:12:24.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.997+0000 7fd215600640 1 -- 172.21.15.3:0/1525295512 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 23) ==== 138167+0+0 (secure 0 0 0) 0x7fd204042030 con 0x7fd218101a30 2024-09-19T06:12:24.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.999+0000 7fd215600640 1 --2- 172.21.15.3:0/1525295512 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd2000a3050 0x7fd2000a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:24.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:23.999+0000 7fd215600640 1 -- 172.21.15.3:0/1525295512 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fd2040efb00 con 0x7fd218101a30 2024-09-19T06:12:24.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.000+0000 7fd21ca00640 1 --2- 172.21.15.3:0/1525295512 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd2000a3050 0x7fd2000a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:24.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.001+0000 7fd21ca00640 1 --2- 172.21.15.3:0/1525295512 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd2000a3050 0x7fd2000a5510 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd218101890 tx=0x7fd20c005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:24.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.003+0000 7fd215600640 1 -- 172.21.15.3:0/1525295512 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd2040bc360 con 0x7fd218101a30 2024-09-19T06:12:24.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:23 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/454265429' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T06:12:24.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:23 smithi059 ceph-mon[35138]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:12:24.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:23 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1991702049' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:12:24.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:23 smithi059 ceph-mon[35138]: mgrmap e23: x(active, since 1.01995s), standbys: y, z 2024-09-19T06:12:24.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:23 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:24.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:23 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:24.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:23 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/902699006' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:12:24.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:23 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/454265429' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T06:12:24.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:23 smithi003 ceph-mon[30893]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:12:24.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:23 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1991702049' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:12:24.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:23 smithi003 ceph-mon[30893]: mgrmap e23: x(active, since 1.01995s), standbys: y, z 2024-09-19T06:12:24.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:23 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:24.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:23 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:24.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:23 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/902699006' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:12:24.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:23 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/454265429' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T06:12:24.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:23 smithi071 ceph-mon[35662]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T06:12:24.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:23 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1991702049' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:12:24.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:23 smithi071 ceph-mon[35662]: mgrmap e23: x(active, since 1.01995s), standbys: y, z 2024-09-19T06:12:24.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:23 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:24.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:23 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:24.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:23 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/902699006' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:12:24.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.205+0000 7fd21de00640 1 -- 172.21.15.3:0/1525295512 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd2181a2620 con 0x7fd218101a30 2024-09-19T06:12:24.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.206+0000 7fd215600640 1 -- 172.21.15.3:0/1525295512 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7fd2040c0660 con 0x7fd218101a30 2024-09-19T06:12:24.208 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2024-09-19T06:12:24.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.209+0000 7fd21de00640 1 -- 172.21.15.3:0/1525295512 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd2000a3050 msgr2=0x7fd2000a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:24.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.209+0000 7fd21de00640 1 --2- 172.21.15.3:0/1525295512 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd2000a3050 0x7fd2000a5510 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd218101890 tx=0x7fd20c005f90 comp rx=0 tx=0).stop 2024-09-19T06:12:24.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.209+0000 7fd21de00640 1 -- 172.21.15.3:0/1525295512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd218101a30 msgr2=0x7fd21819a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:24.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.209+0000 7fd21de00640 1 --2- 172.21.15.3:0/1525295512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd218101a30 0x7fd21819a420 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd204031440 tx=0x7fd204032ce0 comp rx=0 tx=0).stop 2024-09-19T06:12:24.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.209+0000 7fd21de00640 1 -- 172.21.15.3:0/1525295512 shutdown_connections 2024-09-19T06:12:24.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.209+0000 7fd21de00640 1 --2- 172.21.15.3:0/1525295512 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd2000a3050 0x7fd2000a5510 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:24.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.209+0000 7fd21de00640 1 --2- 172.21.15.3:0/1525295512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd2181023f0 0x7fd2181a1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:24.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.209+0000 7fd21de00640 1 --2- 172.21.15.3:0/1525295512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd218101a30 0x7fd21819a420 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:24.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.209+0000 7fd21de00640 1 --2- 172.21.15.3:0/1525295512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd218100840 0x7fd218199ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:24.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.209+0000 7fd21de00640 1 -- 172.21.15.3:0/1525295512 >> 172.21.15.3:0/1525295512 conn(0x7fd2180fbfa0 msgr2=0x7fd218109640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:24.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.209+0000 7fd21de00640 1 -- 172.21.15.3:0/1525295512 shutdown_connections 2024-09-19T06:12:24.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.209+0000 7fd21de00640 1 -- 172.21.15.3:0/1525295512 wait complete. 2024-09-19T06:12:24.229 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T06:12:24.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.386+0000 7f200fa00640 1 -- 172.21.15.3:0/2338042771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2008103d50 msgr2=0x7f2008104150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:24.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.386+0000 7f200fa00640 1 --2- 172.21.15.3:0/2338042771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2008103d50 0x7f2008104150 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc009900 tx=0x7f1ffc02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:12:24.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.387+0000 7f200fa00640 1 -- 172.21.15.3:0/2338042771 shutdown_connections 2024-09-19T06:12:24.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.387+0000 7f200fa00640 1 --2- 172.21.15.3:0/2338042771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2008105900 0x7f200810c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:24.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.387+0000 7f200fa00640 1 --2- 172.21.15.3:0/2338042771 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2008104f40 0x7f20081053c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:24.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.387+0000 7f200fa00640 1 --2- 172.21.15.3:0/2338042771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2008103d50 0x7f2008104150 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:24.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.387+0000 7f200fa00640 1 -- 172.21.15.3:0/2338042771 >> 172.21.15.3:0/2338042771 conn(0x7f20080ff4b0 msgr2=0x7f20081018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:24.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.387+0000 7f200fa00640 1 -- 172.21.15.3:0/2338042771 shutdown_connections 2024-09-19T06:12:24.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.387+0000 7f200fa00640 1 -- 172.21.15.3:0/2338042771 wait complete. 2024-09-19T06:12:24.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.388+0000 7f200fa00640 1 Processor -- start 2024-09-19T06:12:24.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.388+0000 7f200fa00640 1 -- start start 2024-09-19T06:12:24.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.388+0000 7f200fa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2008103d50 0x7f200819a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:24.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.388+0000 7f200fa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2008104f40 0x7f200819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:24.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.388+0000 7f200fa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2008105900 0x7f20081a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:24.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.388+0000 7f200fa00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f200810fa20 con 0x7f2008103d50 2024-09-19T06:12:24.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.388+0000 7f200fa00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f200810f8a0 con 0x7f2008105900 2024-09-19T06:12:24.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.388+0000 7f200fa00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f200810fba0 con 0x7f2008104f40 2024-09-19T06:12:24.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.388+0000 7f200d000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2008103d50 0x7f200819a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:24.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.388+0000 7f2007e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2008104f40 0x7f200819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:24.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.388+0000 7f200da00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2008105900 0x7f20081a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:24.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.388+0000 7f200d000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2008103d50 0x7f200819a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39342/0 (socket says 172.21.15.3:39342) 2024-09-19T06:12:24.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.388+0000 7f200d000640 1 -- 172.21.15.3:0/2046859999 learned_addr learned my addr 172.21.15.3:0/2046859999 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:24.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.389+0000 7f2007e00640 1 -- 172.21.15.3:0/2046859999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2008105900 msgr2=0x7f20081a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:24.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.389+0000 7f2007e00640 1 --2- 172.21.15.3:0/2046859999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2008105900 0x7f20081a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:24.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.389+0000 7f2007e00640 1 -- 172.21.15.3:0/2046859999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2008103d50 msgr2=0x7f200819a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:24.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.389+0000 7f2007e00640 1 --2- 172.21.15.3:0/2046859999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2008103d50 0x7f200819a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:24.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.389+0000 7f2007e00640 1 -- 172.21.15.3:0/2046859999 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20081a1ca0 con 0x7f2008104f40 2024-09-19T06:12:24.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.389+0000 7f2007e00640 1 --2- 172.21.15.3:0/2046859999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2008104f40 0x7f200819a5c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400e9f0 tx=0x7f1ff400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:24.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.389+0000 7f2005600640 1 -- 172.21.15.3:0/2046859999 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff400ccc0 con 0x7f2008104f40 2024-09-19T06:12:24.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.389+0000 7f2005600640 1 -- 172.21.15.3:0/2046859999 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ff4010910 con 0x7f2008104f40 2024-09-19T06:12:24.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.389+0000 7f200fa00640 1 -- 172.21.15.3:0/2046859999 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20081a1f90 con 0x7f2008104f40 2024-09-19T06:12:24.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.389+0000 7f2005600640 1 -- 172.21.15.3:0/2046859999 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4018960 con 0x7f2008104f40 2024-09-19T06:12:24.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.390+0000 7f200fa00640 1 -- 172.21.15.3:0/2046859999 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20081a2450 con 0x7f2008104f40 2024-09-19T06:12:24.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.391+0000 7f200fa00640 1 -- 172.21.15.3:0/2046859999 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f200810b190 con 0x7f2008104f40 2024-09-19T06:12:24.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.392+0000 7f2005600640 1 -- 172.21.15.3:0/2046859999 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 23) ==== 138167+0+0 (secure 0 0 0) 0x7f1ff4010ac0 con 0x7f2008104f40 2024-09-19T06:12:24.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.394+0000 7f2005600640 1 --2- 172.21.15.3:0/2046859999 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1ff00a3050 0x7f1ff00a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:24.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.394+0000 7f2005600640 1 -- 172.21.15.3:0/2046859999 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f1ff40cf9a0 con 0x7f2008104f40 2024-09-19T06:12:24.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.394+0000 7f200d000640 1 --2- 172.21.15.3:0/2046859999 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1ff00a3050 0x7f1ff00a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:24.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.395+0000 7f200d000640 1 --2- 172.21.15.3:0/2046859999 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1ff00a3050 0x7f1ff00a5510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc000c00 tx=0x7f1ffc0315b0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:24.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.399+0000 7f2005600640 1 -- 172.21.15.3:0/2046859999 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1ff409c200 con 0x7f2008104f40 2024-09-19T06:12:24.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.606+0000 7f200fa00640 1 -- 172.21.15.3:0/2046859999 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2008062e90 con 0x7f2008104f40 2024-09-19T06:12:24.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.607+0000 7f2005600640 1 -- 172.21.15.3:0/2046859999 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7f1ff40a0500 con 0x7f2008104f40 2024-09-19T06:12:24.609 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2024-09-19T06:12:24.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.609+0000 7f200fa00640 1 -- 172.21.15.3:0/2046859999 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1ff00a3050 msgr2=0x7f1ff00a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:24.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.609+0000 7f200fa00640 1 --2- 172.21.15.3:0/2046859999 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1ff00a3050 0x7f1ff00a5510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc000c00 tx=0x7f1ffc0315b0 comp rx=0 tx=0).stop 2024-09-19T06:12:24.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.609+0000 7f200fa00640 1 -- 172.21.15.3:0/2046859999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2008104f40 msgr2=0x7f200819a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:24.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.609+0000 7f200fa00640 1 --2- 172.21.15.3:0/2046859999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2008104f40 0x7f200819a5c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400e9f0 tx=0x7f1ff400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:12:24.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.609+0000 7f200fa00640 1 -- 172.21.15.3:0/2046859999 shutdown_connections 2024-09-19T06:12:24.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.609+0000 7f200fa00640 1 --2- 172.21.15.3:0/2046859999 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1ff00a3050 0x7f1ff00a5510 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:24.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.609+0000 7f200fa00640 1 --2- 172.21.15.3:0/2046859999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2008105900 0x7f20081a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:24.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.609+0000 7f200fa00640 1 --2- 172.21.15.3:0/2046859999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2008104f40 0x7f200819a5c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:24.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.609+0000 7f200fa00640 1 --2- 172.21.15.3:0/2046859999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2008103d50 0x7f200819a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:24.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.609+0000 7f200fa00640 1 -- 172.21.15.3:0/2046859999 >> 172.21.15.3:0/2046859999 conn(0x7f20080ff4b0 msgr2=0x7f2008108360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:24.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.609+0000 7f200fa00640 1 -- 172.21.15.3:0/2046859999 shutdown_connections 2024-09-19T06:12:24.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:24.610+0000 7f200fa00640 1 -- 172.21.15.3:0/2046859999 wait complete. 2024-09-19T06:12:24.627 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-19T06:12:24.628 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:12:24.835 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:24.568+0000 7ff6e2000640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:06:12:24] ENGINE Error in HTTPServer.serve 2024-09-19T06:12:24.835 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: Traceback (most recent call last): 2024-09-19T06:12:24.835 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:12:24.835 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: self._connections.run(self.expiration_interval) 2024-09-19T06:12:24.836 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:12:24.836 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: self._run(expiration_interval) 2024-09-19T06:12:24.836 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:12:24.836 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:12:24.836 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:12:24.836 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:12:24.836 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:12:24.836 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: s = self.context.wrap_socket( 2024-09-19T06:12:24.836 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:12:24.836 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: return self.sslsocket_class._create( 2024-09-19T06:12:24.836 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:12:24.836 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: self.do_handshake() 2024-09-19T06:12:24.836 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:12:24.837 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: self._sslobj.do_handshake() 2024-09-19T06:12:24.837 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:12:24.837 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:12:25.034 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:25.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-mon[30893]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:25.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1525295512' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:12:25.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:25.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:25.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2046859999' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:12:25.222 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:25.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:24 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:25.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:24 smithi059 ceph-mon[35138]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:25.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:24 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1525295512' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:12:25.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:24 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:25.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:24 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:25.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:24 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2046859999' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:12:25.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:24 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:25.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:24 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:25.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:24 smithi071 ceph-mon[35662]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:25.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:24 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1525295512' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:12:25.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:24 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:25.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:24 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:25.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:24 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2046859999' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:12:25.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:24 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:25.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:24 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:25.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.654+0000 7f49a1800640 1 -- 172.21.15.3:0/3663334866 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f499c109090 msgr2=0x7f499c110c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:25.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.654+0000 7f49a1800640 1 --2- 172.21.15.3:0/3663334866 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f499c109090 0x7f499c110c10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4994009ca0 tx=0x7f499402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:12:25.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.654+0000 7f49a1800640 1 -- 172.21.15.3:0/3663334866 shutdown_connections 2024-09-19T06:12:25.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.654+0000 7f49a1800640 1 --2- 172.21.15.3:0/3663334866 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f499c109090 0x7f499c110c10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:25.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.654+0000 7f49a1800640 1 --2- 172.21.15.3:0/3663334866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f499c104800 0x7f499c108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:25.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.654+0000 7f49a1800640 1 --2- 172.21.15.3:0/3663334866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f499c103e50 0x7f499c104230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:25.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.654+0000 7f49a1800640 1 -- 172.21.15.3:0/3663334866 >> 172.21.15.3:0/3663334866 conn(0x7f499c0ff8b0 msgr2=0x7f499c101cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:25.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.654+0000 7f49a1800640 1 -- 172.21.15.3:0/3663334866 shutdown_connections 2024-09-19T06:12:25.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.654+0000 7f49a1800640 1 -- 172.21.15.3:0/3663334866 wait complete. 2024-09-19T06:12:25.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.655+0000 7f49a1800640 1 Processor -- start 2024-09-19T06:12:25.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.655+0000 7f49a1800640 1 -- start start 2024-09-19T06:12:25.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.656+0000 7f49a1800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f499c103e50 0x7f499c19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:25.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.656+0000 7f49a1800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f499c104800 0x7f499c19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:25.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.656+0000 7f49a1800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f499c109090 0x7f499c19ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:25.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.656+0000 7f49a1800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f499c1140b0 con 0x7f499c104800 2024-09-19T06:12:25.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.656+0000 7f49a1800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f499c113f30 con 0x7f499c103e50 2024-09-19T06:12:25.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.656+0000 7f49a1800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f499c114230 con 0x7f499c109090 2024-09-19T06:12:25.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.656+0000 7f4993e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f499c104800 0x7f499c19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:25.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.656+0000 7f49a0e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f499c109090 0x7f499c19ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:25.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.656+0000 7f499be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f499c103e50 0x7f499c19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:25.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.656+0000 7f49a0e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f499c109090 0x7f499c19ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:51654/0 (socket says 172.21.15.3:51654) 2024-09-19T06:12:25.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.656+0000 7f49a0e00640 1 -- 172.21.15.3:0/426483686 learned_addr learned my addr 172.21.15.3:0/426483686 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:25.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.657+0000 7f499be00640 1 -- 172.21.15.3:0/426483686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f499c109090 msgr2=0x7f499c19ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:25.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.657+0000 7f499be00640 1 --2- 172.21.15.3:0/426483686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f499c109090 0x7f499c19ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:25.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.657+0000 7f499be00640 1 -- 172.21.15.3:0/426483686 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f499c104800 msgr2=0x7f499c19aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:25.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.657+0000 7f499be00640 1 --2- 172.21.15.3:0/426483686 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f499c104800 0x7f499c19aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:25.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.657+0000 7f499be00640 1 -- 172.21.15.3:0/426483686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499c19f520 con 0x7f499c103e50 2024-09-19T06:12:25.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.657+0000 7f49a0e00640 1 --2- 172.21.15.3:0/426483686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f499c109090 0x7f499c19ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:25.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.657+0000 7f4993e00640 1 --2- 172.21.15.3:0/426483686 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f499c104800 0x7f499c19aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:25.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.657+0000 7f499be00640 1 --2- 172.21.15.3:0/426483686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f499c103e50 0x7f499c19a570 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f498c00e9f0 tx=0x7f498c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:25.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.658+0000 7f4999600640 1 -- 172.21.15.3:0/426483686 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498c00ccc0 con 0x7f499c103e50 2024-09-19T06:12:25.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.658+0000 7f49a1800640 1 -- 172.21.15.3:0/426483686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f499c19f810 con 0x7f499c103e50 2024-09-19T06:12:25.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.658+0000 7f4999600640 1 -- 172.21.15.3:0/426483686 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f498c005020 con 0x7f499c103e50 2024-09-19T06:12:25.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.658+0000 7f4999600640 1 -- 172.21.15.3:0/426483686 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498c0049e0 con 0x7f499c103e50 2024-09-19T06:12:25.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.658+0000 7f49a1800640 1 -- 172.21.15.3:0/426483686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f499c1a70f0 con 0x7f499c103e50 2024-09-19T06:12:25.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.659+0000 7f49a1800640 1 -- 172.21.15.3:0/426483686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f499c105330 con 0x7f499c103e50 2024-09-19T06:12:25.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.661+0000 7f4999600640 1 -- 172.21.15.3:0/426483686 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 24) ==== 138474+0+0 (secure 0 0 0) 0x7f498c004cc0 con 0x7f499c103e50 2024-09-19T06:12:25.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.662+0000 7f4999600640 1 --2- 172.21.15.3:0/426483686 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f49800a3430 0x7f49800a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:25.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.663+0000 7f4999600640 1 -- 172.21.15.3:0/426483686 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f498c0cfc70 con 0x7f499c103e50 2024-09-19T06:12:25.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.663+0000 7f4993e00640 1 --2- 172.21.15.3:0/426483686 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f49800a3430 0x7f49800a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:25.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.663+0000 7f4993e00640 1 --2- 172.21.15.3:0/426483686 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f49800a3430 0x7f49800a58f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f49840095f0 tx=0x7f4984005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:25.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.666+0000 7f4999600640 1 -- 172.21.15.3:0/426483686 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f498c09c5f0 con 0x7f499c103e50 2024-09-19T06:12:25.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.912+0000 7f49a1800640 1 -- 172.21.15.3:0/426483686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f499c10c320 con 0x7f499c103e50 2024-09-19T06:12:25.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.913+0000 7f4999600640 1 -- 172.21.15.3:0/426483686 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7f499c10c320 con 0x7f499c103e50 2024-09-19T06:12:25.915 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:12:25.916 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"btime":"2024-09-19T06:12:22:958217+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:12:22.060987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24532,24515,24514,14517]},"id":1}]} 2024-09-19T06:12:25.916 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2024-09-19T06:12:25.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.916+0000 7f49a1800640 1 -- 172.21.15.3:0/426483686 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f49800a3430 msgr2=0x7f49800a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:25.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.916+0000 7f49a1800640 1 --2- 172.21.15.3:0/426483686 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f49800a3430 0x7f49800a58f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f49840095f0 tx=0x7f4984005f90 comp rx=0 tx=0).stop 2024-09-19T06:12:25.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.916+0000 7f49a1800640 1 -- 172.21.15.3:0/426483686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f499c103e50 msgr2=0x7f499c19a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:25.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.916+0000 7f49a1800640 1 --2- 172.21.15.3:0/426483686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f499c103e50 0x7f499c19a570 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f498c00e9f0 tx=0x7f498c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:12:25.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.916+0000 7f49a1800640 1 -- 172.21.15.3:0/426483686 shutdown_connections 2024-09-19T06:12:25.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.916+0000 7f49a1800640 1 --2- 172.21.15.3:0/426483686 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f49800a3430 0x7f49800a58f0 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f49840095f0 tx=0x7f4984005f90 comp rx=0 tx=0).stop 2024-09-19T06:12:25.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.916+0000 7f49a1800640 1 --2- 172.21.15.3:0/426483686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f499c109090 0x7f499c19ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:25.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.916+0000 7f49a1800640 1 --2- 172.21.15.3:0/426483686 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f499c104800 0x7f499c19aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:25.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.916+0000 7f49a1800640 1 --2- 172.21.15.3:0/426483686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f499c103e50 0x7f499c19a570 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:25.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.916+0000 7f49a1800640 1 -- 172.21.15.3:0/426483686 >> 172.21.15.3:0/426483686 conn(0x7f499c0ff8b0 msgr2=0x7f499c100ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:25.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.917+0000 7f49a1800640 1 -- 172.21.15.3:0/426483686 shutdown_connections 2024-09-19T06:12:25.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:25.917+0000 7f49a1800640 1 -- 172.21.15.3:0/426483686 wait complete. 2024-09-19T06:12:26.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:25 smithi059 ceph-mon[35138]: [19/Sep/2024:06:12:24] ENGINE Bus STARTING 2024-09-19T06:12:26.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:25 smithi059 ceph-mon[35138]: [19/Sep/2024:06:12:24] ENGINE Serving on https://172.21.15.3:7150 2024-09-19T06:12:26.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:25 smithi059 ceph-mon[35138]: [19/Sep/2024:06:12:24] ENGINE Error in HTTPServer.serve 2024-09-19T06:12:26.289 INFO:journalctl@ceph.mon.b.smithi059.stdout: Traceback (most recent call last): 2024-09-19T06:12:26.289 INFO:journalctl@ceph.mon.b.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:12:26.289 INFO:journalctl@ceph.mon.b.smithi059.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:12:26.289 INFO:journalctl@ceph.mon.b.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:12:26.289 INFO:journalctl@ceph.mon.b.smithi059.stdout: self._run(expiration_interval) 2024-09-19T06:12:26.290 INFO:journalctl@ceph.mon.b.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:12:26.290 INFO:journalctl@ceph.mon.b.smithi059.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:12:26.290 INFO:journalctl@ceph.mon.b.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:12:26.290 INFO:journalctl@ceph.mon.b.smithi059.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:12:26.290 INFO:journalctl@ceph.mon.b.smithi059.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:12:26.290 INFO:journalctl@ceph.mon.b.smithi059.stdout: s = self.context.wrap_socket( 2024-09-19T06:12:26.290 INFO:journalctl@ceph.mon.b.smithi059.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:12:26.290 INFO:journalctl@ceph.mon.b.smithi059.stdout: return self.sslsocket_class._create( 2024-09-19T06:12:26.290 INFO:journalctl@ceph.mon.b.smithi059.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:12:26.290 INFO:journalctl@ceph.mon.b.smithi059.stdout: self.do_handshake() 2024-09-19T06:12:26.290 INFO:journalctl@ceph.mon.b.smithi059.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:12:26.291 INFO:journalctl@ceph.mon.b.smithi059.stdout: self._sslobj.do_handshake() 2024-09-19T06:12:26.291 INFO:journalctl@ceph.mon.b.smithi059.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:12:26.291 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:25 smithi059 ceph-mon[35138]: [19/Sep/2024:06:12:24] ENGINE Serving on http://172.21.15.3:8765 2024-09-19T06:12:26.291 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:25 smithi059 ceph-mon[35138]: [19/Sep/2024:06:12:24] ENGINE Bus STARTED 2024-09-19T06:12:26.291 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:25 smithi059 ceph-mon[35138]: mgrmap e24: x(active, since 2s), standbys: y, z 2024-09-19T06:12:26.291 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:25 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:26.291 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:25 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:26.291 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:25 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:26.291 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:25 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:26.292 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:25 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:26.292 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:25 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:26.292 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:25 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:26.292 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:25 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:26.292 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:25 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:26.292 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:25 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:26.293 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:25 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:26.293 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:25 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:26.293 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:25 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/426483686' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:26.331 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:25 smithi003 ceph-mon[30893]: [19/Sep/2024:06:12:24] ENGINE Bus STARTING 2024-09-19T06:12:26.331 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:25 smithi003 ceph-mon[30893]: [19/Sep/2024:06:12:24] ENGINE Serving on https://172.21.15.3:7150 2024-09-19T06:12:26.331 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:25 smithi003 ceph-mon[30893]: [19/Sep/2024:06:12:24] ENGINE Error in HTTPServer.serve 2024-09-19T06:12:26.331 INFO:journalctl@ceph.mon.a.smithi003.stdout: Traceback (most recent call last): 2024-09-19T06:12:26.331 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:12:26.332 INFO:journalctl@ceph.mon.a.smithi003.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:12:26.332 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:12:26.332 INFO:journalctl@ceph.mon.a.smithi003.stdout: self._run(expiration_interval) 2024-09-19T06:12:26.332 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:12:26.332 INFO:journalctl@ceph.mon.a.smithi003.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:12:26.332 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:12:26.332 INFO:journalctl@ceph.mon.a.smithi003.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:12:26.332 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:12:26.332 INFO:journalctl@ceph.mon.a.smithi003.stdout: s = self.context.wrap_socket( 2024-09-19T06:12:26.332 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:12:26.332 INFO:journalctl@ceph.mon.a.smithi003.stdout: return self.sslsocket_class._create( 2024-09-19T06:12:26.332 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:12:26.332 INFO:journalctl@ceph.mon.a.smithi003.stdout: self.do_handshake() 2024-09-19T06:12:26.332 INFO:journalctl@ceph.mon.a.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:12:26.333 INFO:journalctl@ceph.mon.a.smithi003.stdout: self._sslobj.do_handshake() 2024-09-19T06:12:26.333 INFO:journalctl@ceph.mon.a.smithi003.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:12:26.333 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:25 smithi003 ceph-mon[30893]: [19/Sep/2024:06:12:24] ENGINE Serving on http://172.21.15.3:8765 2024-09-19T06:12:26.333 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:25 smithi003 ceph-mon[30893]: [19/Sep/2024:06:12:24] ENGINE Bus STARTED 2024-09-19T06:12:26.333 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:25 smithi003 ceph-mon[30893]: mgrmap e24: x(active, since 2s), standbys: y, z 2024-09-19T06:12:26.333 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:25 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:26.333 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:25 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:26.333 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:25 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:26.333 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:25 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:26.333 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:25 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:26.333 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:25 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:26.333 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:25 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:26.333 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:25 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:26.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:25 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:26.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:25 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:26.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:25 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:26.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:25 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:26.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:25 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/426483686' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:26.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:25 smithi071 ceph-mon[35662]: [19/Sep/2024:06:12:24] ENGINE Bus STARTING 2024-09-19T06:12:26.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:25 smithi071 ceph-mon[35662]: [19/Sep/2024:06:12:24] ENGINE Serving on https://172.21.15.3:7150 2024-09-19T06:12:26.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:25 smithi071 ceph-mon[35662]: [19/Sep/2024:06:12:24] ENGINE Error in HTTPServer.serve 2024-09-19T06:12:26.336 INFO:journalctl@ceph.mon.c.smithi071.stdout: Traceback (most recent call last): 2024-09-19T06:12:26.336 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:12:26.336 INFO:journalctl@ceph.mon.c.smithi071.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:12:26.336 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:12:26.336 INFO:journalctl@ceph.mon.c.smithi071.stdout: self._run(expiration_interval) 2024-09-19T06:12:26.336 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:12:26.336 INFO:journalctl@ceph.mon.c.smithi071.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:12:26.337 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:12:26.337 INFO:journalctl@ceph.mon.c.smithi071.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:12:26.337 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:12:26.337 INFO:journalctl@ceph.mon.c.smithi071.stdout: s = self.context.wrap_socket( 2024-09-19T06:12:26.337 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:12:26.337 INFO:journalctl@ceph.mon.c.smithi071.stdout: return self.sslsocket_class._create( 2024-09-19T06:12:26.337 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:12:26.337 INFO:journalctl@ceph.mon.c.smithi071.stdout: self.do_handshake() 2024-09-19T06:12:26.337 INFO:journalctl@ceph.mon.c.smithi071.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:12:26.337 INFO:journalctl@ceph.mon.c.smithi071.stdout: self._sslobj.do_handshake() 2024-09-19T06:12:26.337 INFO:journalctl@ceph.mon.c.smithi071.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:12:26.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:25 smithi071 ceph-mon[35662]: [19/Sep/2024:06:12:24] ENGINE Serving on http://172.21.15.3:8765 2024-09-19T06:12:26.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:25 smithi071 ceph-mon[35662]: [19/Sep/2024:06:12:24] ENGINE Bus STARTED 2024-09-19T06:12:26.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:25 smithi071 ceph-mon[35662]: mgrmap e24: x(active, since 2s), standbys: y, z 2024-09-19T06:12:26.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:25 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:26.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:25 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:26.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:25 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:26.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:25 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:26.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:25 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:26.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:25 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:26.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:25 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:26.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:25 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:26.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:25 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:26.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:25 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:26.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:25 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:26.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:25 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:26.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:25 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/426483686' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:26.770 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-19T06:12:26.770 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-19T06:12:26.771 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:12:26.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.931+0000 7fa11a600640 1 -- 172.21.15.3:0/2970196475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1141058f0 msgr2=0x7fa11410c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:26.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.931+0000 7fa11a600640 1 --2- 172.21.15.3:0/2970196475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1141058f0 0x7fa11410c180 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa10c009ca0 tx=0x7fa10c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:12:26.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.931+0000 7fa11a600640 1 -- 172.21.15.3:0/2970196475 shutdown_connections 2024-09-19T06:12:26.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.931+0000 7fa11a600640 1 --2- 172.21.15.3:0/2970196475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1141058f0 0x7fa11410c180 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:26.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.931+0000 7fa11a600640 1 --2- 172.21.15.3:0/2970196475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa114104f30 0x7fa1141053b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:26.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.931+0000 7fa11a600640 1 --2- 172.21.15.3:0/2970196475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa114103d40 0x7fa114104140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:26.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.931+0000 7fa11a600640 1 -- 172.21.15.3:0/2970196475 >> 172.21.15.3:0/2970196475 conn(0x7fa1140ff4a0 msgr2=0x7fa1141018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:26.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.932+0000 7fa11a600640 1 -- 172.21.15.3:0/2970196475 shutdown_connections 2024-09-19T06:12:26.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.932+0000 7fa11a600640 1 -- 172.21.15.3:0/2970196475 wait complete. 2024-09-19T06:12:26.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.932+0000 7fa11a600640 1 Processor -- start 2024-09-19T06:12:26.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.933+0000 7fa11a600640 1 -- start start 2024-09-19T06:12:26.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.933+0000 7fa11a600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa114103d40 0x7fa114199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:26.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.933+0000 7fa11a600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa114104f30 0x7fa11419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:26.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.933+0000 7fa11a600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1141058f0 0x7fa1141a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:26.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.933+0000 7fa11a600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa11410fa10 con 0x7fa114104f30 2024-09-19T06:12:26.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.933+0000 7fa11a600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa11410f890 con 0x7fa1141058f0 2024-09-19T06:12:26.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.933+0000 7fa11a600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa11410fb90 con 0x7fa114103d40 2024-09-19T06:12:26.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.933+0000 7fa112a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa114104f30 0x7fa11419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:26.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.933+0000 7fa113400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa114103d40 0x7fa114199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:26.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.933+0000 7fa112a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa114104f30 0x7fa11419a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39384/0 (socket says 172.21.15.3:39384) 2024-09-19T06:12:26.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.933+0000 7fa112a00640 1 -- 172.21.15.3:0/2449950547 learned_addr learned my addr 172.21.15.3:0/2449950547 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:26.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.933+0000 7fa113e00640 1 --2- 172.21.15.3:0/2449950547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1141058f0 0x7fa1141a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:26.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.934+0000 7fa113400640 1 -- 172.21.15.3:0/2449950547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1141058f0 msgr2=0x7fa1141a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:26.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.934+0000 7fa113400640 1 --2- 172.21.15.3:0/2449950547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1141058f0 0x7fa1141a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:26.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.934+0000 7fa113400640 1 -- 172.21.15.3:0/2449950547 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa114104f30 msgr2=0x7fa11419a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:26.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.934+0000 7fa113400640 1 --2- 172.21.15.3:0/2449950547 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa114104f30 0x7fa11419a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:26.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.934+0000 7fa113400640 1 -- 172.21.15.3:0/2449950547 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1141a1c00 con 0x7fa114103d40 2024-09-19T06:12:26.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.934+0000 7fa112a00640 1 --2- 172.21.15.3:0/2449950547 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa114104f30 0x7fa11419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:26.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.934+0000 7fa113400640 1 --2- 172.21.15.3:0/2449950547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa114103d40 0x7fa114199fe0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa10400e9c0 tx=0x7fa10400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:26.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.934+0000 7fa10be00640 1 -- 172.21.15.3:0/2449950547 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10400ccc0 con 0x7fa114103d40 2024-09-19T06:12:26.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.934+0000 7fa10be00640 1 -- 172.21.15.3:0/2449950547 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1040035f0 con 0x7fa114103d40 2024-09-19T06:12:26.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.934+0000 7fa11a600640 1 -- 172.21.15.3:0/2449950547 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1141a1ef0 con 0x7fa114103d40 2024-09-19T06:12:26.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.934+0000 7fa10be00640 1 -- 172.21.15.3:0/2449950547 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10400ce60 con 0x7fa114103d40 2024-09-19T06:12:26.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.935+0000 7fa11a600640 1 -- 172.21.15.3:0/2449950547 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1141a2300 con 0x7fa114103d40 2024-09-19T06:12:26.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.935+0000 7fa11a600640 1 -- 172.21.15.3:0/2449950547 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa11410b0e0 con 0x7fa114103d40 2024-09-19T06:12:26.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.939+0000 7fa10be00640 1 -- 172.21.15.3:0/2449950547 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 24) ==== 138474+0+0 (secure 0 0 0) 0x7fa1040037a0 con 0x7fa114103d40 2024-09-19T06:12:26.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.941+0000 7fa10be00640 1 --2- 172.21.15.3:0/2449950547 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa0f80a33c0 0x7fa0f80a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:26.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.941+0000 7fa10be00640 1 -- 172.21.15.3:0/2449950547 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fa1040d03f0 con 0x7fa114103d40 2024-09-19T06:12:26.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.941+0000 7fa112a00640 1 --2- 172.21.15.3:0/2449950547 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa0f80a33c0 0x7fa0f80a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:26.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.941+0000 7fa10be00640 1 -- 172.21.15.3:0/2449950547 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa10409cd70 con 0x7fa114103d40 2024-09-19T06:12:26.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:26.942+0000 7fa112a00640 1 --2- 172.21.15.3:0/2449950547 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa0f80a33c0 0x7fa0f80a5880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa11419b4f0 tx=0x7fa100005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:27.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:26 smithi003 ceph-mon[30893]: Adjusting osd_memory_target on smithi071 to 176.0M 2024-09-19T06:12:27.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:26 smithi003 ceph-mon[30893]: Unable to set osd_memory_target on smithi071 to 184573132: error parsing value: Value '184573132' is below minimum 939524096 2024-09-19T06:12:27.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:26 smithi003 ceph-mon[30893]: Adjusting osd_memory_target on smithi059 to 177.0M 2024-09-19T06:12:27.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:26 smithi003 ceph-mon[30893]: Unable to set osd_memory_target on smithi059 to 185698508: error parsing value: Value '185698508' is below minimum 939524096 2024-09-19T06:12:27.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:26 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:27.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:26 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:27.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.128+0000 7fa11a600640 1 -- 172.21.15.3:0/2449950547 --> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa114062630 con 0x7fa0f80a33c0 2024-09-19T06:12:27.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.136+0000 7fa10be00640 1 -- 172.21.15.3:0/2449950547 <== mgr.15126 v2:172.21.15.3:6800/3015970538 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258094 (secure 0 0 0) 0x7fa114062630 con 0x7fa0f80a33c0 2024-09-19T06:12:27.270 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:12:27.271 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-19T06:12:27.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.141+0000 7fa11a600640 1 -- 172.21.15.3:0/2449950547 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa0f80a33c0 msgr2=0x7fa0f80a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:27.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.141+0000 7fa11a600640 1 --2- 172.21.15.3:0/2449950547 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa0f80a33c0 0x7fa0f80a5880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa11419b4f0 tx=0x7fa100005f90 comp rx=0 tx=0).stop 2024-09-19T06:12:27.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.141+0000 7fa11a600640 1 -- 172.21.15.3:0/2449950547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa114103d40 msgr2=0x7fa114199fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:27.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.141+0000 7fa11a600640 1 --2- 172.21.15.3:0/2449950547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa114103d40 0x7fa114199fe0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa10400e9c0 tx=0x7fa10400ee80 comp rx=0 tx=0).stop 2024-09-19T06:12:27.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.141+0000 7fa11a600640 1 -- 172.21.15.3:0/2449950547 shutdown_connections 2024-09-19T06:12:27.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.141+0000 7fa11a600640 1 --2- 172.21.15.3:0/2449950547 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa0f80a33c0 0x7fa0f80a5880 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:27.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.141+0000 7fa11a600640 1 --2- 172.21.15.3:0/2449950547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1141058f0 0x7fa1141a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:27.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.141+0000 7fa11a600640 1 --2- 172.21.15.3:0/2449950547 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa114104f30 0x7fa11419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:27.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.141+0000 7fa11a600640 1 --2- 172.21.15.3:0/2449950547 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa114103d40 0x7fa114199fe0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:27.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.141+0000 7fa11a600640 1 -- 172.21.15.3:0/2449950547 >> 172.21.15.3:0/2449950547 conn(0x7fa1140ff4a0 msgr2=0x7fa1141082b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:27.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.141+0000 7fa11a600640 1 -- 172.21.15.3:0/2449950547 shutdown_connections 2024-09-19T06:12:27.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.141+0000 7fa11a600640 1 -- 172.21.15.3:0/2449950547 wait complete. 2024-09-19T06:12:27.274 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-19T06:12:26.431109+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1191667,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1504,"num_read_kb":929,"num_write":561,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1183593,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":944,"ondisk_log_size":944,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365520,"kb_used_data":12068,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576304,"statfs":{"total":1151940427776,"available":1151566135296,"internally_reserved":0,"allocated":12357632,"data_stored":8719156,"data_compressed":253649,"data_compressed_allocated":335872,"data_compressed_original":3072000,"omap_allocated":19140,"internal_metadata":361674044},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.978979"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523130+0000","last_change":"2024-09-19T06:10:02.531329+0000","last_active":"2024-09-19T06:12:22.523130+0000","last_peered":"2024-09-19T06:12:22.523130+0000","last_clean":"2024-09-19T06:12:22.523130+0000","last_became_active":"2024-09-19T06:10:02.530997+0000","last_became_peered":"2024-09-19T06:10:02.530997+0000","last_unstale":"2024-09-19T06:12:22.523130+0000","last_undegraded":"2024-09-19T06:12:22.523130+0000","last_fullsized":"2024-09-19T06:12:22.523130+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:15.240495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417846+0000","last_change":"2024-09-19T06:10:02.526083+0000","last_active":"2024-09-19T06:12:22.417846+0000","last_peered":"2024-09-19T06:12:22.417846+0000","last_clean":"2024-09-19T06:12:22.417846+0000","last_became_active":"2024-09-19T06:10:02.522889+0000","last_became_peered":"2024-09-19T06:10:02.522889+0000","last_unstale":"2024-09-19T06:12:22.417846+0000","last_undegraded":"2024-09-19T06:12:22.417846+0000","last_fullsized":"2024-09-19T06:12:22.417846+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:19.735866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417392+0000","last_change":"2024-09-19T06:10:02.531779+0000","last_active":"2024-09-19T06:12:22.417392+0000","last_peered":"2024-09-19T06:12:22.417392+0000","last_clean":"2024-09-19T06:12:22.417392+0000","last_became_active":"2024-09-19T06:10:02.526795+0000","last_became_peered":"2024-09-19T06:10:02.526795+0000","last_unstale":"2024-09-19T06:12:22.417392+0000","last_undegraded":"2024-09-19T06:12:22.417392+0000","last_fullsized":"2024-09-19T06:12:22.417392+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:28.800773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759797+0000","last_change":"2024-09-19T06:10:02.518697+0000","last_active":"2024-09-19T06:12:22.759797+0000","last_peered":"2024-09-19T06:12:22.759797+0000","last_clean":"2024-09-19T06:12:22.759797+0000","last_became_active":"2024-09-19T06:10:02.518114+0000","last_became_peered":"2024-09-19T06:10:02.518114+0000","last_unstale":"2024-09-19T06:12:22.759797+0000","last_undegraded":"2024-09-19T06:12:22.759797+0000","last_fullsized":"2024-09-19T06:12:22.759797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:08.172638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798502+0000","last_change":"2024-09-19T06:10:02.520450+0000","last_active":"2024-09-19T06:12:22.798502+0000","last_peered":"2024-09-19T06:12:22.798502+0000","last_clean":"2024-09-19T06:12:22.798502+0000","last_became_active":"2024-09-19T06:10:02.519079+0000","last_became_peered":"2024-09-19T06:10:02.519079+0000","last_unstale":"2024-09-19T06:12:22.798502+0000","last_undegraded":"2024-09-19T06:12:22.798502+0000","last_fullsized":"2024-09-19T06:12:22.798502+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:47.502020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.539627+0000","last_change":"2024-09-19T06:10:02.518567+0000","last_active":"2024-09-19T06:12:22.539627+0000","last_peered":"2024-09-19T06:12:22.539627+0000","last_clean":"2024-09-19T06:12:22.539627+0000","last_became_active":"2024-09-19T06:10:02.517568+0000","last_became_peered":"2024-09-19T06:10:02.517568+0000","last_unstale":"2024-09-19T06:12:22.539627+0000","last_undegraded":"2024-09-19T06:12:22.539627+0000","last_fullsized":"2024-09-19T06:12:22.539627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:10.245189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417732+0000","last_change":"2024-09-19T06:10:02.521844+0000","last_active":"2024-09-19T06:12:22.417732+0000","last_peered":"2024-09-19T06:12:22.417732+0000","last_clean":"2024-09-19T06:12:22.417732+0000","last_became_active":"2024-09-19T06:10:02.521522+0000","last_became_peered":"2024-09-19T06:10:02.521522+0000","last_unstale":"2024-09-19T06:12:22.417732+0000","last_undegraded":"2024-09-19T06:12:22.417732+0000","last_fullsized":"2024-09-19T06:12:22.417732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:46.166077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523672+0000","last_change":"2024-09-19T06:10:02.526977+0000","last_active":"2024-09-19T06:12:22.523672+0000","last_peered":"2024-09-19T06:12:22.523672+0000","last_clean":"2024-09-19T06:12:22.523672+0000","last_became_active":"2024-09-19T06:10:02.526036+0000","last_became_peered":"2024-09-19T06:10:02.526036+0000","last_unstale":"2024-09-19T06:12:22.523672+0000","last_undegraded":"2024-09-19T06:12:22.523672+0000","last_fullsized":"2024-09-19T06:12:22.523672+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:43:28.587020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.769658+0000","last_change":"2024-09-19T06:10:02.524721+0000","last_active":"2024-09-19T06:12:22.769658+0000","last_peered":"2024-09-19T06:12:22.769658+0000","last_clean":"2024-09-19T06:12:22.769658+0000","last_became_active":"2024-09-19T06:10:02.523871+0000","last_became_peered":"2024-09-19T06:10:02.523871+0000","last_unstale":"2024-09-19T06:12:22.769658+0000","last_undegraded":"2024-09-19T06:12:22.769658+0000","last_fullsized":"2024-09-19T06:12:22.769658+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:31.324530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.540176+0000","last_change":"2024-09-19T06:10:02.518494+0000","last_active":"2024-09-19T06:12:22.540176+0000","last_peered":"2024-09-19T06:12:22.540176+0000","last_clean":"2024-09-19T06:12:22.540176+0000","last_became_active":"2024-09-19T06:10:02.518140+0000","last_became_peered":"2024-09-19T06:10:02.518140+0000","last_unstale":"2024-09-19T06:12:22.540176+0000","last_undegraded":"2024-09-19T06:12:22.540176+0000","last_fullsized":"2024-09-19T06:12:22.540176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:42.695222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.418287+0000","last_change":"2024-09-19T06:10:02.524697+0000","last_active":"2024-09-19T06:12:22.418287+0000","last_peered":"2024-09-19T06:12:22.418287+0000","last_clean":"2024-09-19T06:12:22.418287+0000","last_became_active":"2024-09-19T06:10:02.524094+0000","last_became_peered":"2024-09-19T06:10:02.524094+0000","last_unstale":"2024-09-19T06:12:22.418287+0000","last_undegraded":"2024-09-19T06:12:22.418287+0000","last_fullsized":"2024-09-19T06:12:22.418287+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:12.591847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759946+0000","last_change":"2024-09-19T06:10:02.515878+0000","last_active":"2024-09-19T06:12:22.759946+0000","last_peered":"2024-09-19T06:12:22.759946+0000","last_clean":"2024-09-19T06:12:22.759946+0000","last_became_active":"2024-09-19T06:10:02.515456+0000","last_became_peered":"2024-09-19T06:10:02.515456+0000","last_unstale":"2024-09-19T06:12:22.759946+0000","last_undegraded":"2024-09-19T06:12:22.759946+0000","last_fullsized":"2024-09-19T06:12:22.759946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:58.687431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.760533+0000","last_change":"2024-09-19T06:10:31.824936+0000","last_active":"2024-09-19T06:12:22.760533+0000","last_peered":"2024-09-19T06:12:22.760533+0000","last_clean":"2024-09-19T06:12:22.760533+0000","last_became_active":"2024-09-19T06:10:31.824611+0000","last_became_peered":"2024-09-19T06:10:31.824611+0000","last_unstale":"2024-09-19T06:12:22.760533+0000","last_undegraded":"2024-09-19T06:12:22.760533+0000","last_fullsized":"2024-09-19T06:12:22.760533+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:36.397693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417277+0000","last_change":"2024-09-19T06:10:02.513397+0000","last_active":"2024-09-19T06:12:22.417277+0000","last_peered":"2024-09-19T06:12:22.417277+0000","last_clean":"2024-09-19T06:12:22.417277+0000","last_became_active":"2024-09-19T06:10:02.513011+0000","last_became_peered":"2024-09-19T06:10:02.513011+0000","last_unstale":"2024-09-19T06:12:22.417277+0000","last_undegraded":"2024-09-19T06:12:22.417277+0000","last_fullsized":"2024-09-19T06:12:22.417277+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:06:03.509401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417240+0000","last_change":"2024-09-19T06:10:02.521623+0000","last_active":"2024-09-19T06:12:22.417240+0000","last_peered":"2024-09-19T06:12:22.417240+0000","last_clean":"2024-09-19T06:12:22.417240+0000","last_became_active":"2024-09-19T06:10:02.519371+0000","last_became_peered":"2024-09-19T06:10:02.519371+0000","last_unstale":"2024-09-19T06:12:22.417240+0000","last_undegraded":"2024-09-19T06:12:22.417240+0000","last_fullsized":"2024-09-19T06:12:22.417240+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:10.687026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.768975+0000","last_change":"2024-09-19T06:10:02.520865+0000","last_active":"2024-09-19T06:12:22.768975+0000","last_peered":"2024-09-19T06:12:22.768975+0000","last_clean":"2024-09-19T06:12:22.768975+0000","last_became_active":"2024-09-19T06:10:02.519683+0000","last_became_peered":"2024-09-19T06:10:02.519683+0000","last_unstale":"2024-09-19T06:12:22.768975+0000","last_undegraded":"2024-09-19T06:12:22.768975+0000","last_fullsized":"2024-09-19T06:12:22.768975+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:40.320474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523207+0000","last_change":"2024-09-19T06:10:02.531552+0000","last_active":"2024-09-19T06:12:22.523207+0000","last_peered":"2024-09-19T06:12:22.523207+0000","last_clean":"2024-09-19T06:12:22.523207+0000","last_became_active":"2024-09-19T06:10:02.531081+0000","last_became_peered":"2024-09-19T06:10:02.531081+0000","last_unstale":"2024-09-19T06:12:22.523207+0000","last_undegraded":"2024-09-19T06:12:22.523207+0000","last_fullsized":"2024-09-19T06:12:22.523207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:07.835754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.416671+0000","last_change":"2024-09-19T06:10:02.509088+0000","last_active":"2024-09-19T06:12:22.416671+0000","last_peered":"2024-09-19T06:12:22.416671+0000","last_clean":"2024-09-19T06:12:22.416671+0000","last_became_active":"2024-09-19T06:10:02.508752+0000","last_became_peered":"2024-09-19T06:10:02.508752+0000","last_unstale":"2024-09-19T06:12:22.416671+0000","last_undegraded":"2024-09-19T06:12:22.416671+0000","last_fullsized":"2024-09-19T06:12:22.416671+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:36.832952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.760233+0000","last_change":"2024-09-19T06:10:02.534694+0000","last_active":"2024-09-19T06:12:22.760233+0000","last_peered":"2024-09-19T06:12:22.760233+0000","last_clean":"2024-09-19T06:12:22.760233+0000","last_became_active":"2024-09-19T06:10:02.534384+0000","last_became_peered":"2024-09-19T06:10:02.534384+0000","last_unstale":"2024-09-19T06:12:22.760233+0000","last_undegraded":"2024-09-19T06:12:22.760233+0000","last_fullsized":"2024-09-19T06:12:22.760233+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:48.006128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.522896+0000","last_change":"2024-09-19T06:10:02.521104+0000","last_active":"2024-09-19T06:12:22.522896+0000","last_peered":"2024-09-19T06:12:22.522896+0000","last_clean":"2024-09-19T06:12:22.522896+0000","last_became_active":"2024-09-19T06:10:02.520755+0000","last_became_peered":"2024-09-19T06:10:02.520755+0000","last_unstale":"2024-09-19T06:12:22.522896+0000","last_undegraded":"2024-09-19T06:12:22.522896+0000","last_fullsized":"2024-09-19T06:12:22.522896+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:46.091297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.760733+0000","last_change":"2024-09-19T06:10:02.522048+0000","last_active":"2024-09-19T06:12:22.760733+0000","last_peered":"2024-09-19T06:12:22.760733+0000","last_clean":"2024-09-19T06:12:22.760733+0000","last_became_active":"2024-09-19T06:10:02.521750+0000","last_became_peered":"2024-09-19T06:10:02.521750+0000","last_unstale":"2024-09-19T06:12:22.760733+0000","last_undegraded":"2024-09-19T06:12:22.760733+0000","last_fullsized":"2024-09-19T06:12:22.760733+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:07.780609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.769195+0000","last_change":"2024-09-19T06:10:02.527386+0000","last_active":"2024-09-19T06:12:22.769195+0000","last_peered":"2024-09-19T06:12:22.769195+0000","last_clean":"2024-09-19T06:12:22.769195+0000","last_became_active":"2024-09-19T06:10:02.526804+0000","last_became_peered":"2024-09-19T06:10:02.526804+0000","last_unstale":"2024-09-19T06:12:22.769195+0000","last_undegraded":"2024-09-19T06:12:22.769195+0000","last_fullsized":"2024-09-19T06:12:22.769195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:15.652068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523556+0000","last_change":"2024-09-19T06:10:02.528521+0000","last_active":"2024-09-19T06:12:22.523556+0000","last_peered":"2024-09-19T06:12:22.523556+0000","last_clean":"2024-09-19T06:12:22.523556+0000","last_became_active":"2024-09-19T06:10:02.528087+0000","last_became_peered":"2024-09-19T06:10:02.528087+0000","last_unstale":"2024-09-19T06:12:22.523556+0000","last_undegraded":"2024-09-19T06:12:22.523556+0000","last_fullsized":"2024-09-19T06:12:22.523556+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:29.176129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.536015+0000","last_change":"2024-09-19T06:10:02.518544+0000","last_active":"2024-09-19T06:12:22.536015+0000","last_peered":"2024-09-19T06:12:22.536015+0000","last_clean":"2024-09-19T06:12:22.536015+0000","last_became_active":"2024-09-19T06:10:02.518230+0000","last_became_peered":"2024-09-19T06:10:02.518230+0000","last_unstale":"2024-09-19T06:12:22.536015+0000","last_undegraded":"2024-09-19T06:12:22.536015+0000","last_fullsized":"2024-09-19T06:12:22.536015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:26:32.116211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.524066+0000","last_change":"2024-09-19T06:10:02.531859+0000","last_active":"2024-09-19T06:12:22.524066+0000","last_peered":"2024-09-19T06:12:22.524066+0000","last_clean":"2024-09-19T06:12:22.524066+0000","last_became_active":"2024-09-19T06:10:02.531572+0000","last_became_peered":"2024-09-19T06:10:02.531572+0000","last_unstale":"2024-09-19T06:12:22.524066+0000","last_undegraded":"2024-09-19T06:12:22.524066+0000","last_fullsized":"2024-09-19T06:12:22.524066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:34.314977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.760242+0000","last_change":"2024-09-19T06:10:02.521292+0000","last_active":"2024-09-19T06:12:22.760242+0000","last_peered":"2024-09-19T06:12:22.760242+0000","last_clean":"2024-09-19T06:12:22.760242+0000","last_became_active":"2024-09-19T06:10:02.520967+0000","last_became_peered":"2024-09-19T06:10:02.520967+0000","last_unstale":"2024-09-19T06:12:22.760242+0000","last_undegraded":"2024-09-19T06:12:22.760242+0000","last_fullsized":"2024-09-19T06:12:22.760242+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:11.318504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523032+0000","last_change":"2024-09-19T06:10:02.521514+0000","last_active":"2024-09-19T06:12:22.523032+0000","last_peered":"2024-09-19T06:12:22.523032+0000","last_clean":"2024-09-19T06:12:22.523032+0000","last_became_active":"2024-09-19T06:10:02.521203+0000","last_became_peered":"2024-09-19T06:10:02.521203+0000","last_unstale":"2024-09-19T06:12:22.523032+0000","last_undegraded":"2024-09-19T06:12:22.523032+0000","last_fullsized":"2024-09-19T06:12:22.523032+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:53.689067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759912+0000","last_change":"2024-09-19T06:10:31.824501+0000","last_active":"2024-09-19T06:12:22.759912+0000","last_peered":"2024-09-19T06:12:22.759912+0000","last_clean":"2024-09-19T06:12:22.759912+0000","last_became_active":"2024-09-19T06:10:31.824161+0000","last_became_peered":"2024-09-19T06:10:31.824161+0000","last_unstale":"2024-09-19T06:12:22.759912+0000","last_undegraded":"2024-09-19T06:12:22.759912+0000","last_fullsized":"2024-09-19T06:12:22.759912+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:28.203581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417661+0000","last_change":"2024-09-19T06:10:02.530351+0000","last_active":"2024-09-19T06:12:22.417661+0000","last_peered":"2024-09-19T06:12:22.417661+0000","last_clean":"2024-09-19T06:12:22.417661+0000","last_became_active":"2024-09-19T06:10:02.529292+0000","last_became_peered":"2024-09-19T06:10:02.529292+0000","last_unstale":"2024-09-19T06:12:22.417661+0000","last_undegraded":"2024-09-19T06:12:22.417661+0000","last_fullsized":"2024-09-19T06:12:22.417661+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:02.324413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759801+0000","last_change":"2024-09-19T06:10:02.534885+0000","last_active":"2024-09-19T06:12:22.759801+0000","last_peered":"2024-09-19T06:12:22.759801+0000","last_clean":"2024-09-19T06:12:22.759801+0000","last_became_active":"2024-09-19T06:10:02.534520+0000","last_became_peered":"2024-09-19T06:10:02.534520+0000","last_unstale":"2024-09-19T06:12:22.759801+0000","last_undegraded":"2024-09-19T06:12:22.759801+0000","last_fullsized":"2024-09-19T06:12:22.759801+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:04.896787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759826+0000","last_change":"2024-09-19T06:10:02.518120+0000","last_active":"2024-09-19T06:12:22.759826+0000","last_peered":"2024-09-19T06:12:22.759826+0000","last_clean":"2024-09-19T06:12:22.759826+0000","last_became_active":"2024-09-19T06:10:02.517595+0000","last_became_peered":"2024-09-19T06:10:02.517595+0000","last_unstale":"2024-09-19T06:12:22.759826+0000","last_undegraded":"2024-09-19T06:12:22.759826+0000","last_fullsized":"2024-09-19T06:12:22.759826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:00.695783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.522797+0000","last_change":"2024-09-19T06:10:02.524413+0000","last_active":"2024-09-19T06:12:22.522797+0000","last_peered":"2024-09-19T06:12:22.522797+0000","last_clean":"2024-09-19T06:12:22.522797+0000","last_became_active":"2024-09-19T06:10:02.523559+0000","last_became_peered":"2024-09-19T06:10:02.523559+0000","last_unstale":"2024-09-19T06:12:22.522797+0000","last_undegraded":"2024-09-19T06:12:22.522797+0000","last_fullsized":"2024-09-19T06:12:22.522797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:04.045759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798454+0000","last_change":"2024-09-19T06:10:02.514572+0000","last_active":"2024-09-19T06:12:22.798454+0000","last_peered":"2024-09-19T06:12:22.798454+0000","last_clean":"2024-09-19T06:12:22.798454+0000","last_became_active":"2024-09-19T06:10:02.513685+0000","last_became_peered":"2024-09-19T06:10:02.513685+0000","last_unstale":"2024-09-19T06:12:22.798454+0000","last_undegraded":"2024-09-19T06:12:22.798454+0000","last_fullsized":"2024-09-19T06:12:22.798454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:09.108036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"89'9","reported_seq":136,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.982038+0000","last_change":"2024-09-19T06:10:31.829554+0000","last_active":"2024-09-19T06:12:22.982038+0000","last_peered":"2024-09-19T06:12:22.982038+0000","last_clean":"2024-09-19T06:12:22.982038+0000","last_became_active":"2024-09-19T06:10:31.824266+0000","last_became_peered":"2024-09-19T06:10:31.824266+0000","last_unstale":"2024-09-19T06:12:22.982038+0000","last_undegraded":"2024-09-19T06:12:22.982038+0000","last_fullsized":"2024-09-19T06:12:22.982038+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:07.241897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1942,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":2,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1015,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.536116+0000","last_change":"2024-09-19T06:10:02.524271+0000","last_active":"2024-09-19T06:12:22.536116+0000","last_peered":"2024-09-19T06:12:22.536116+0000","last_clean":"2024-09-19T06:12:22.536116+0000","last_became_active":"2024-09-19T06:10:02.523948+0000","last_became_peered":"2024-09-19T06:10:02.523948+0000","last_unstale":"2024-09-19T06:12:22.536116+0000","last_undegraded":"2024-09-19T06:12:22.536116+0000","last_fullsized":"2024-09-19T06:12:22.536116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:46.406652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.539711+0000","last_change":"2024-09-19T06:09:59.493186+0000","last_active":"2024-09-19T06:12:22.539711+0000","last_peered":"2024-09-19T06:12:22.539711+0000","last_clean":"2024-09-19T06:12:22.539711+0000","last_became_active":"2024-09-19T06:09:59.492841+0000","last_became_peered":"2024-09-19T06:09:59.492841+0000","last_unstale":"2024-09-19T06:12:22.539711+0000","last_undegraded":"2024-09-19T06:12:22.539711+0000","last_fullsized":"2024-09-19T06:12:22.539711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:48.557724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759731+0000","last_change":"2024-09-19T06:09:59.493364+0000","last_active":"2024-09-19T06:12:22.759731+0000","last_peered":"2024-09-19T06:12:22.759731+0000","last_clean":"2024-09-19T06:12:22.759731+0000","last_became_active":"2024-09-19T06:09:59.491868+0000","last_became_peered":"2024-09-19T06:09:59.491868+0000","last_unstale":"2024-09-19T06:12:22.759731+0000","last_undegraded":"2024-09-19T06:12:22.759731+0000","last_fullsized":"2024-09-19T06:12:22.759731+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:23.088768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523512+0000","last_change":"2024-09-19T06:10:02.534453+0000","last_active":"2024-09-19T06:12:22.523512+0000","last_peered":"2024-09-19T06:12:22.523512+0000","last_clean":"2024-09-19T06:12:22.523512+0000","last_became_active":"2024-09-19T06:10:02.532003+0000","last_became_peered":"2024-09-19T06:10:02.532003+0000","last_unstale":"2024-09-19T06:12:22.523512+0000","last_undegraded":"2024-09-19T06:12:22.523512+0000","last_fullsized":"2024-09-19T06:12:22.523512+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:41.609673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.536292+0000","last_change":"2024-09-19T06:09:59.493574+0000","last_active":"2024-09-19T06:12:22.536292+0000","last_peered":"2024-09-19T06:12:22.536292+0000","last_clean":"2024-09-19T06:12:22.536292+0000","last_became_active":"2024-09-19T06:09:59.493243+0000","last_became_peered":"2024-09-19T06:09:59.493243+0000","last_unstale":"2024-09-19T06:12:22.536292+0000","last_undegraded":"2024-09-19T06:12:22.536292+0000","last_fullsized":"2024-09-19T06:12:22.536292+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:12:43.491780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.416070+0000","last_change":"2024-09-19T06:10:02.520122+0000","last_active":"2024-09-19T06:12:22.416070+0000","last_peered":"2024-09-19T06:12:22.416070+0000","last_clean":"2024-09-19T06:12:22.416070+0000","last_became_active":"2024-09-19T06:10:02.519795+0000","last_became_peered":"2024-09-19T06:10:02.519795+0000","last_unstale":"2024-09-19T06:12:22.416070+0000","last_undegraded":"2024-09-19T06:12:22.416070+0000","last_fullsized":"2024-09-19T06:12:22.416070+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:12.384824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"89'7","reported_seq":289,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.981477+0000","last_change":"2024-09-19T06:09:59.491192+0000","last_active":"2024-09-19T06:12:22.981477+0000","last_peered":"2024-09-19T06:12:22.981477+0000","last_clean":"2024-09-19T06:12:22.981477+0000","last_became_active":"2024-09-19T06:09:59.490774+0000","last_became_peered":"2024-09-19T06:09:59.490774+0000","last_unstale":"2024-09-19T06:12:22.981477+0000","last_undegraded":"2024-09-19T06:12:22.981477+0000","last_fullsized":"2024-09-19T06:12:22.981477+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:30.276512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":254,"num_read_kb":254,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.769254+0000","last_change":"2024-09-19T06:10:02.516728+0000","last_active":"2024-09-19T06:12:22.769254+0000","last_peered":"2024-09-19T06:12:22.769254+0000","last_clean":"2024-09-19T06:12:22.769254+0000","last_became_active":"2024-09-19T06:10:02.516415+0000","last_became_peered":"2024-09-19T06:10:02.516415+0000","last_unstale":"2024-09-19T06:12:22.769254+0000","last_undegraded":"2024-09-19T06:12:22.769254+0000","last_fullsized":"2024-09-19T06:12:22.769254+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:45.012284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.418403+0000","last_change":"2024-09-19T06:09:59.499167+0000","last_active":"2024-09-19T06:12:22.418403+0000","last_peered":"2024-09-19T06:12:22.418403+0000","last_clean":"2024-09-19T06:12:22.418403+0000","last_became_active":"2024-09-19T06:09:59.498796+0000","last_became_peered":"2024-09-19T06:09:59.498796+0000","last_unstale":"2024-09-19T06:12:22.418403+0000","last_undegraded":"2024-09-19T06:12:22.418403+0000","last_fullsized":"2024-09-19T06:12:22.418403+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:08.665495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417683+0000","last_change":"2024-09-19T06:10:31.823990+0000","last_active":"2024-09-19T06:12:22.417683+0000","last_peered":"2024-09-19T06:12:22.417683+0000","last_clean":"2024-09-19T06:12:22.417683+0000","last_became_active":"2024-09-19T06:10:31.823448+0000","last_became_peered":"2024-09-19T06:10:31.823448+0000","last_unstale":"2024-09-19T06:12:22.417683+0000","last_undegraded":"2024-09-19T06:12:22.417683+0000","last_fullsized":"2024-09-19T06:12:22.417683+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:33.882448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.536353+0000","last_change":"2024-09-19T06:09:59.774875+0000","last_active":"2024-09-19T06:12:22.536353+0000","last_peered":"2024-09-19T06:12:22.536353+0000","last_clean":"2024-09-19T06:12:22.536353+0000","last_became_active":"2024-09-19T06:09:59.774376+0000","last_became_peered":"2024-09-19T06:09:59.774376+0000","last_unstale":"2024-09-19T06:12:22.536353+0000","last_undegraded":"2024-09-19T06:12:22.536353+0000","last_fullsized":"2024-09-19T06:12:22.536353+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:01.283578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.769374+0000","last_change":"2024-09-19T06:10:02.518202+0000","last_active":"2024-09-19T06:12:22.769374+0000","last_peered":"2024-09-19T06:12:22.769374+0000","last_clean":"2024-09-19T06:12:22.769374+0000","last_became_active":"2024-09-19T06:10:02.517865+0000","last_became_peered":"2024-09-19T06:10:02.517865+0000","last_unstale":"2024-09-19T06:12:22.769374+0000","last_undegraded":"2024-09-19T06:12:22.769374+0000","last_fullsized":"2024-09-19T06:12:22.769374+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:28.128891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"89'38","reported_seq":333,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.982684+0000","last_change":"2024-09-19T06:09:59.493139+0000","last_active":"2024-09-19T06:12:22.982684+0000","last_peered":"2024-09-19T06:12:22.982684+0000","last_clean":"2024-09-19T06:12:22.982684+0000","last_became_active":"2024-09-19T06:09:59.492768+0000","last_became_peered":"2024-09-19T06:09:59.492768+0000","last_unstale":"2024-09-19T06:12:22.982684+0000","last_undegraded":"2024-09-19T06:12:22.982684+0000","last_fullsized":"2024-09-19T06:12:22.982684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:17.872432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66483,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":266,"num_read_kb":198,"num_write":40,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798746+0000","last_change":"2024-09-19T06:10:02.516187+0000","last_active":"2024-09-19T06:12:22.798746+0000","last_peered":"2024-09-19T06:12:22.798746+0000","last_clean":"2024-09-19T06:12:22.798746+0000","last_became_active":"2024-09-19T06:10:02.515888+0000","last_became_peered":"2024-09-19T06:10:02.515888+0000","last_unstale":"2024-09-19T06:12:22.798746+0000","last_undegraded":"2024-09-19T06:12:22.798746+0000","last_fullsized":"2024-09-19T06:12:22.798746+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:29.672889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759957+0000","last_change":"2024-09-19T06:09:59.492155+0000","last_active":"2024-09-19T06:12:22.759957+0000","last_peered":"2024-09-19T06:12:22.759957+0000","last_clean":"2024-09-19T06:12:22.759957+0000","last_became_active":"2024-09-19T06:09:59.491730+0000","last_became_peered":"2024-09-19T06:09:59.491730+0000","last_unstale":"2024-09-19T06:12:22.759957+0000","last_undegraded":"2024-09-19T06:12:22.759957+0000","last_fullsized":"2024-09-19T06:12:22.759957+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:30.632665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.760036+0000","last_change":"2024-09-19T06:10:02.526214+0000","last_active":"2024-09-19T06:12:22.760036+0000","last_peered":"2024-09-19T06:12:22.760036+0000","last_clean":"2024-09-19T06:12:22.760036+0000","last_became_active":"2024-09-19T06:10:02.525846+0000","last_became_peered":"2024-09-19T06:10:02.525846+0000","last_unstale":"2024-09-19T06:12:22.760036+0000","last_undegraded":"2024-09-19T06:12:22.760036+0000","last_fullsized":"2024-09-19T06:12:22.760036+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:14.294741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.536313+0000","last_change":"2024-09-19T06:09:59.494814+0000","last_active":"2024-09-19T06:12:22.536313+0000","last_peered":"2024-09-19T06:12:22.536313+0000","last_clean":"2024-09-19T06:12:22.536313+0000","last_became_active":"2024-09-19T06:09:59.494461+0000","last_became_peered":"2024-09-19T06:09:59.494461+0000","last_unstale":"2024-09-19T06:12:22.536313+0000","last_undegraded":"2024-09-19T06:12:22.536313+0000","last_fullsized":"2024-09-19T06:12:22.536313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:37.730327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.418125+0000","last_change":"2024-09-19T06:10:02.518851+0000","last_active":"2024-09-19T06:12:22.418125+0000","last_peered":"2024-09-19T06:12:22.418125+0000","last_clean":"2024-09-19T06:12:22.418125+0000","last_became_active":"2024-09-19T06:10:02.518462+0000","last_became_peered":"2024-09-19T06:10:02.518462+0000","last_unstale":"2024-09-19T06:12:22.418125+0000","last_undegraded":"2024-09-19T06:12:22.418125+0000","last_fullsized":"2024-09-19T06:12:22.418125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:22.629918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'6","reported_seq":165,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.953339+0000","last_change":"2024-09-19T06:09:59.493839+0000","last_active":"2024-09-19T06:12:22.953339+0000","last_peered":"2024-09-19T06:12:22.953339+0000","last_clean":"2024-09-19T06:12:22.953339+0000","last_became_active":"2024-09-19T06:09:59.492323+0000","last_became_peered":"2024-09-19T06:09:59.492323+0000","last_unstale":"2024-09-19T06:12:22.953339+0000","last_undegraded":"2024-09-19T06:12:22.953339+0000","last_fullsized":"2024-09-19T06:12:22.953339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:12.754030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":131,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417730+0000","last_change":"2024-09-19T06:10:02.515957+0000","last_active":"2024-09-19T06:12:22.417730+0000","last_peered":"2024-09-19T06:12:22.417730+0000","last_clean":"2024-09-19T06:12:22.417730+0000","last_became_active":"2024-09-19T06:10:02.515493+0000","last_became_peered":"2024-09-19T06:10:02.515493+0000","last_unstale":"2024-09-19T06:12:22.417730+0000","last_undegraded":"2024-09-19T06:12:22.417730+0000","last_fullsized":"2024-09-19T06:12:22.417730+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:06.988155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798500+0000","last_change":"2024-09-19T06:09:59.775131+0000","last_active":"2024-09-19T06:12:22.798500+0000","last_peered":"2024-09-19T06:12:22.798500+0000","last_clean":"2024-09-19T06:12:22.798500+0000","last_became_active":"2024-09-19T06:09:59.774642+0000","last_became_peered":"2024-09-19T06:09:59.774642+0000","last_unstale":"2024-09-19T06:12:22.798500+0000","last_undegraded":"2024-09-19T06:12:22.798500+0000","last_fullsized":"2024-09-19T06:12:22.798500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:31.722485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.536308+0000","last_change":"2024-09-19T06:10:02.522531+0000","last_active":"2024-09-19T06:12:22.536308+0000","last_peered":"2024-09-19T06:12:22.536308+0000","last_clean":"2024-09-19T06:12:22.536308+0000","last_became_active":"2024-09-19T06:10:02.522186+0000","last_became_peered":"2024-09-19T06:10:02.522186+0000","last_unstale":"2024-09-19T06:12:22.536308+0000","last_undegraded":"2024-09-19T06:12:22.536308+0000","last_fullsized":"2024-09-19T06:12:22.536308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:45.689043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798825+0000","last_change":"2024-09-19T06:09:59.494819+0000","last_active":"2024-09-19T06:12:22.798825+0000","last_peered":"2024-09-19T06:12:22.798825+0000","last_clean":"2024-09-19T06:12:22.798825+0000","last_became_active":"2024-09-19T06:09:59.494434+0000","last_became_peered":"2024-09-19T06:09:59.494434+0000","last_unstale":"2024-09-19T06:12:22.798825+0000","last_undegraded":"2024-09-19T06:12:22.798825+0000","last_fullsized":"2024-09-19T06:12:22.798825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:42.207621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523127+0000","last_change":"2024-09-19T06:10:02.522893+0000","last_active":"2024-09-19T06:12:22.523127+0000","last_peered":"2024-09-19T06:12:22.523127+0000","last_clean":"2024-09-19T06:12:22.523127+0000","last_became_active":"2024-09-19T06:10:02.522596+0000","last_became_peered":"2024-09-19T06:10:02.522596+0000","last_unstale":"2024-09-19T06:12:22.523127+0000","last_undegraded":"2024-09-19T06:12:22.523127+0000","last_fullsized":"2024-09-19T06:12:22.523127+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:21.394878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759883+0000","last_change":"2024-09-19T06:10:31.838085+0000","last_active":"2024-09-19T06:12:22.759883+0000","last_peered":"2024-09-19T06:12:22.759883+0000","last_clean":"2024-09-19T06:12:22.759883+0000","last_became_active":"2024-09-19T06:10:31.826924+0000","last_became_peered":"2024-09-19T06:10:31.826924+0000","last_unstale":"2024-09-19T06:12:22.759883+0000","last_undegraded":"2024-09-19T06:12:22.759883+0000","last_fullsized":"2024-09-19T06:12:22.759883+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:19.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.418534+0000","last_change":"2024-09-19T06:10:02.516137+0000","last_active":"2024-09-19T06:12:22.418534+0000","last_peered":"2024-09-19T06:12:22.418534+0000","last_clean":"2024-09-19T06:12:22.418534+0000","last_became_active":"2024-09-19T06:10:02.515769+0000","last_became_peered":"2024-09-19T06:10:02.515769+0000","last_unstale":"2024-09-19T06:12:22.418534+0000","last_undegraded":"2024-09-19T06:12:22.418534+0000","last_fullsized":"2024-09-19T06:12:22.418534+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:56.741950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'41","reported_seq":78,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.688076+0000","last_change":"2024-09-19T06:09:59.498177+0000","last_active":"2024-09-19T06:12:22.688076+0000","last_peered":"2024-09-19T06:12:22.688076+0000","last_clean":"2024-09-19T06:12:22.688076+0000","last_became_active":"2024-09-19T06:09:59.497808+0000","last_became_peered":"2024-09-19T06:09:59.497808+0000","last_unstale":"2024-09-19T06:12:22.688076+0000","last_undegraded":"2024-09-19T06:12:22.688076+0000","last_fullsized":"2024-09-19T06:12:22.688076+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:06.473332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.418112+0000","last_change":"2024-09-19T06:10:02.526442+0000","last_active":"2024-09-19T06:12:22.418112+0000","last_peered":"2024-09-19T06:12:22.418112+0000","last_clean":"2024-09-19T06:12:22.418112+0000","last_became_active":"2024-09-19T06:10:02.526116+0000","last_became_peered":"2024-09-19T06:10:02.526116+0000","last_unstale":"2024-09-19T06:12:22.418112+0000","last_undegraded":"2024-09-19T06:12:22.418112+0000","last_fullsized":"2024-09-19T06:12:22.418112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:05.000599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'7","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.982209+0000","last_change":"2024-09-19T06:10:31.829793+0000","last_active":"2024-09-19T06:12:22.982209+0000","last_peered":"2024-09-19T06:12:22.982209+0000","last_clean":"2024-09-19T06:12:22.982209+0000","last_became_active":"2024-09-19T06:10:31.822044+0000","last_became_peered":"2024-09-19T06:10:31.822044+0000","last_unstale":"2024-09-19T06:12:22.982209+0000","last_undegraded":"2024-09-19T06:12:22.982209+0000","last_fullsized":"2024-09-19T06:12:22.982209+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:45.301315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1874,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":2,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1170,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.418385+0000","last_change":"2024-09-19T06:10:02.524435+0000","last_active":"2024-09-19T06:12:22.418385+0000","last_peered":"2024-09-19T06:12:22.418385+0000","last_clean":"2024-09-19T06:12:22.418385+0000","last_became_active":"2024-09-19T06:10:02.523634+0000","last_became_peered":"2024-09-19T06:10:02.523634+0000","last_unstale":"2024-09-19T06:12:22.418385+0000","last_undegraded":"2024-09-19T06:12:22.418385+0000","last_fullsized":"2024-09-19T06:12:22.418385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:07.679183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":352,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417875+0000","last_change":"2024-09-19T06:08:39.873247+0000","last_active":"2024-09-19T06:12:22.417875+0000","last_peered":"2024-09-19T06:12:22.417875+0000","last_clean":"2024-09-19T06:12:22.417875+0000","last_became_active":"2024-09-19T06:08:39.872647+0000","last_became_peered":"2024-09-19T06:08:39.872647+0000","last_unstale":"2024-09-19T06:12:22.417875+0000","last_undegraded":"2024-09-19T06:12:22.417875+0000","last_fullsized":"2024-09-19T06:12:22.417875+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:56.991890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:56.991890+0000","last_clean_scrub_stamp":"2024-09-19T06:04:56.991890+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:18.835510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759946+0000","last_change":"2024-09-19T06:09:59.492677+0000","last_active":"2024-09-19T06:12:22.759946+0000","last_peered":"2024-09-19T06:12:22.759946+0000","last_clean":"2024-09-19T06:12:22.759946+0000","last_became_active":"2024-09-19T06:09:59.492235+0000","last_became_peered":"2024-09-19T06:09:59.492235+0000","last_unstale":"2024-09-19T06:12:22.759946+0000","last_undegraded":"2024-09-19T06:12:22.759946+0000","last_fullsized":"2024-09-19T06:12:22.759946+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:40.173728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523728+0000","last_change":"2024-09-19T06:10:02.523331+0000","last_active":"2024-09-19T06:12:22.523728+0000","last_peered":"2024-09-19T06:12:22.523728+0000","last_clean":"2024-09-19T06:12:22.523728+0000","last_became_active":"2024-09-19T06:10:02.522896+0000","last_became_peered":"2024-09-19T06:10:02.522896+0000","last_unstale":"2024-09-19T06:12:22.523728+0000","last_undegraded":"2024-09-19T06:12:22.523728+0000","last_fullsized":"2024-09-19T06:12:22.523728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:56.994375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417840+0000","last_change":"2024-09-19T06:09:59.496407+0000","last_active":"2024-09-19T06:12:22.417840+0000","last_peered":"2024-09-19T06:12:22.417840+0000","last_clean":"2024-09-19T06:12:22.417840+0000","last_became_active":"2024-09-19T06:09:59.496074+0000","last_became_peered":"2024-09-19T06:09:59.496074+0000","last_unstale":"2024-09-19T06:12:22.417840+0000","last_undegraded":"2024-09-19T06:12:22.417840+0000","last_fullsized":"2024-09-19T06:12:22.417840+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:11.257227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759741+0000","last_change":"2024-09-19T06:10:02.515229+0000","last_active":"2024-09-19T06:12:22.759741+0000","last_peered":"2024-09-19T06:12:22.759741+0000","last_clean":"2024-09-19T06:12:22.759741+0000","last_became_active":"2024-09-19T06:10:02.514092+0000","last_became_peered":"2024-09-19T06:10:02.514092+0000","last_unstale":"2024-09-19T06:12:22.759741+0000","last_undegraded":"2024-09-19T06:12:22.759741+0000","last_fullsized":"2024-09-19T06:12:22.759741+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:32:36.805821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"89'6","reported_seq":163,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.763210+0000","last_change":"2024-09-19T06:09:59.777102+0000","last_active":"2024-09-19T06:12:22.763210+0000","last_peered":"2024-09-19T06:12:22.763210+0000","last_clean":"2024-09-19T06:12:22.763210+0000","last_became_active":"2024-09-19T06:09:59.774456+0000","last_became_peered":"2024-09-19T06:09:59.774456+0000","last_unstale":"2024-09-19T06:12:22.763210+0000","last_undegraded":"2024-09-19T06:12:22.763210+0000","last_fullsized":"2024-09-19T06:12:22.763210+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:11.353528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":128,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.536115+0000","last_change":"2024-09-19T06:10:02.517039+0000","last_active":"2024-09-19T06:12:22.536115+0000","last_peered":"2024-09-19T06:12:22.536115+0000","last_clean":"2024-09-19T06:12:22.536115+0000","last_became_active":"2024-09-19T06:10:02.516291+0000","last_became_peered":"2024-09-19T06:10:02.516291+0000","last_unstale":"2024-09-19T06:12:22.536115+0000","last_undegraded":"2024-09-19T06:12:22.536115+0000","last_fullsized":"2024-09-19T06:12:22.536115+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:27.835967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"89'8","reported_seq":167,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:23.113189+0000","last_change":"2024-09-19T06:09:59.499496+0000","last_active":"2024-09-19T06:12:23.113189+0000","last_peered":"2024-09-19T06:12:23.113189+0000","last_clean":"2024-09-19T06:12:23.113189+0000","last_became_active":"2024-09-19T06:09:59.499172+0000","last_became_peered":"2024-09-19T06:09:59.499172+0000","last_unstale":"2024-09-19T06:12:23.113189+0000","last_undegraded":"2024-09-19T06:12:23.113189+0000","last_fullsized":"2024-09-19T06:12:23.113189+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:52.062675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":130,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.539804+0000","last_change":"2024-09-19T06:10:02.523099+0000","last_active":"2024-09-19T06:12:22.539804+0000","last_peered":"2024-09-19T06:12:22.539804+0000","last_clean":"2024-09-19T06:12:22.539804+0000","last_became_active":"2024-09-19T06:10:02.522770+0000","last_became_peered":"2024-09-19T06:10:02.522770+0000","last_unstale":"2024-09-19T06:12:22.539804+0000","last_undegraded":"2024-09-19T06:12:22.539804+0000","last_fullsized":"2024-09-19T06:12:22.539804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:39.807159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.416333+0000","last_change":"2024-09-19T06:09:59.775371+0000","last_active":"2024-09-19T06:12:22.416333+0000","last_peered":"2024-09-19T06:12:22.416333+0000","last_clean":"2024-09-19T06:12:22.416333+0000","last_became_active":"2024-09-19T06:09:59.774944+0000","last_became_peered":"2024-09-19T06:09:59.774944+0000","last_unstale":"2024-09-19T06:12:22.416333+0000","last_undegraded":"2024-09-19T06:12:22.416333+0000","last_fullsized":"2024-09-19T06:12:22.416333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:44.305005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.539885+0000","last_change":"2024-09-19T06:10:02.521207+0000","last_active":"2024-09-19T06:12:22.539885+0000","last_peered":"2024-09-19T06:12:22.539885+0000","last_clean":"2024-09-19T06:12:22.539885+0000","last_became_active":"2024-09-19T06:10:02.520843+0000","last_became_peered":"2024-09-19T06:10:02.520843+0000","last_unstale":"2024-09-19T06:12:22.539885+0000","last_undegraded":"2024-09-19T06:12:22.539885+0000","last_fullsized":"2024-09-19T06:12:22.539885+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:39.462042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798901+0000","last_change":"2024-09-19T06:09:59.775259+0000","last_active":"2024-09-19T06:12:22.798901+0000","last_peered":"2024-09-19T06:12:22.798901+0000","last_clean":"2024-09-19T06:12:22.798901+0000","last_became_active":"2024-09-19T06:09:59.774393+0000","last_became_peered":"2024-09-19T06:09:59.774393+0000","last_unstale":"2024-09-19T06:12:22.798901+0000","last_undegraded":"2024-09-19T06:12:22.798901+0000","last_fullsized":"2024-09-19T06:12:22.798901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:39:05.904778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.760041+0000","last_change":"2024-09-19T06:10:02.516445+0000","last_active":"2024-09-19T06:12:22.760041+0000","last_peered":"2024-09-19T06:12:22.760041+0000","last_clean":"2024-09-19T06:12:22.760041+0000","last_became_active":"2024-09-19T06:10:02.515524+0000","last_became_peered":"2024-09-19T06:10:02.515524+0000","last_unstale":"2024-09-19T06:12:22.760041+0000","last_undegraded":"2024-09-19T06:12:22.760041+0000","last_fullsized":"2024-09-19T06:12:22.760041+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:42.863526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"89'51","reported_seq":119,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.685554+0000","last_change":"2024-09-19T06:10:31.834659+0000","last_active":"2024-09-19T06:12:22.685554+0000","last_peered":"2024-09-19T06:12:22.685554+0000","last_clean":"2024-09-19T06:12:22.685554+0000","last_became_active":"2024-09-19T06:10:31.825992+0000","last_became_peered":"2024-09-19T06:10:31.825992+0000","last_unstale":"2024-09-19T06:12:22.685554+0000","last_undegraded":"2024-09-19T06:12:22.685554+0000","last_fullsized":"2024-09-19T06:12:22.685554+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:16.208213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":91,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.524191+0000","last_change":"2024-09-19T06:10:02.532473+0000","last_active":"2024-09-19T06:12:22.524191+0000","last_peered":"2024-09-19T06:12:22.524191+0000","last_clean":"2024-09-19T06:12:22.524191+0000","last_became_active":"2024-09-19T06:10:02.531745+0000","last_became_peered":"2024-09-19T06:10:02.531745+0000","last_unstale":"2024-09-19T06:12:22.524191+0000","last_undegraded":"2024-09-19T06:12:22.524191+0000","last_fullsized":"2024-09-19T06:12:22.524191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:22.659626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.760021+0000","last_change":"2024-09-19T06:10:00.231383+0000","last_active":"2024-09-19T06:12:22.760021+0000","last_peered":"2024-09-19T06:12:22.760021+0000","last_clean":"2024-09-19T06:12:22.760021+0000","last_became_active":"2024-09-19T06:10:00.231016+0000","last_became_peered":"2024-09-19T06:10:00.231016+0000","last_unstale":"2024-09-19T06:12:22.760021+0000","last_undegraded":"2024-09-19T06:12:22.760021+0000","last_fullsized":"2024-09-19T06:12:22.760021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:39:07.178556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.418119+0000","last_change":"2024-09-19T06:10:02.532772+0000","last_active":"2024-09-19T06:12:22.418119+0000","last_peered":"2024-09-19T06:12:22.418119+0000","last_clean":"2024-09-19T06:12:22.418119+0000","last_became_active":"2024-09-19T06:10:02.528187+0000","last_became_peered":"2024-09-19T06:10:02.528187+0000","last_unstale":"2024-09-19T06:12:22.418119+0000","last_undegraded":"2024-09-19T06:12:22.418119+0000","last_fullsized":"2024-09-19T06:12:22.418119+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:35.550221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.769076+0000","last_change":"2024-09-19T06:09:59.774860+0000","last_active":"2024-09-19T06:12:22.769076+0000","last_peered":"2024-09-19T06:12:22.769076+0000","last_clean":"2024-09-19T06:12:22.769076+0000","last_became_active":"2024-09-19T06:09:59.774525+0000","last_became_peered":"2024-09-19T06:09:59.774525+0000","last_unstale":"2024-09-19T06:12:22.769076+0000","last_undegraded":"2024-09-19T06:12:22.769076+0000","last_fullsized":"2024-09-19T06:12:22.769076+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:28.480611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798429+0000","last_change":"2024-09-19T06:10:02.514951+0000","last_active":"2024-09-19T06:12:22.798429+0000","last_peered":"2024-09-19T06:12:22.798429+0000","last_clean":"2024-09-19T06:12:22.798429+0000","last_became_active":"2024-09-19T06:10:02.514632+0000","last_became_peered":"2024-09-19T06:10:02.514632+0000","last_unstale":"2024-09-19T06:12:22.798429+0000","last_undegraded":"2024-09-19T06:12:22.798429+0000","last_fullsized":"2024-09-19T06:12:22.798429+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:58.225253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523613+0000","last_change":"2024-09-19T06:09:59.496203+0000","last_active":"2024-09-19T06:12:22.523613+0000","last_peered":"2024-09-19T06:12:22.523613+0000","last_clean":"2024-09-19T06:12:22.523613+0000","last_became_active":"2024-09-19T06:09:59.495854+0000","last_became_peered":"2024-09-19T06:09:59.495854+0000","last_unstale":"2024-09-19T06:12:22.523613+0000","last_undegraded":"2024-09-19T06:12:22.523613+0000","last_fullsized":"2024-09-19T06:12:22.523613+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:43.388624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.522910+0000","last_change":"2024-09-19T06:10:02.521713+0000","last_active":"2024-09-19T06:12:22.522910+0000","last_peered":"2024-09-19T06:12:22.522910+0000","last_clean":"2024-09-19T06:12:22.522910+0000","last_became_active":"2024-09-19T06:10:02.521389+0000","last_became_peered":"2024-09-19T06:10:02.521389+0000","last_unstale":"2024-09-19T06:12:22.522910+0000","last_undegraded":"2024-09-19T06:12:22.522910+0000","last_fullsized":"2024-09-19T06:12:22.522910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:34.441627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759827+0000","last_change":"2024-09-19T06:09:59.492636+0000","last_active":"2024-09-19T06:12:22.759827+0000","last_peered":"2024-09-19T06:12:22.759827+0000","last_clean":"2024-09-19T06:12:22.759827+0000","last_became_active":"2024-09-19T06:09:59.491801+0000","last_became_peered":"2024-09-19T06:09:59.491801+0000","last_unstale":"2024-09-19T06:12:22.759827+0000","last_undegraded":"2024-09-19T06:12:22.759827+0000","last_fullsized":"2024-09-19T06:12:22.759827+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:27.911582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.524299+0000","last_change":"2024-09-19T06:10:02.527073+0000","last_active":"2024-09-19T06:12:22.524299+0000","last_peered":"2024-09-19T06:12:22.524299+0000","last_clean":"2024-09-19T06:12:22.524299+0000","last_became_active":"2024-09-19T06:10:02.525847+0000","last_became_peered":"2024-09-19T06:10:02.525847+0000","last_unstale":"2024-09-19T06:12:22.524299+0000","last_undegraded":"2024-09-19T06:12:22.524299+0000","last_fullsized":"2024-09-19T06:12:22.524299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:22.717353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798512+0000","last_change":"2024-09-19T06:09:59.493905+0000","last_active":"2024-09-19T06:12:22.798512+0000","last_peered":"2024-09-19T06:12:22.798512+0000","last_clean":"2024-09-19T06:12:22.798512+0000","last_became_active":"2024-09-19T06:09:59.493517+0000","last_became_peered":"2024-09-19T06:09:59.493517+0000","last_unstale":"2024-09-19T06:12:22.798512+0000","last_undegraded":"2024-09-19T06:12:22.798512+0000","last_fullsized":"2024-09-19T06:12:22.798512+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:22.959756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417840+0000","last_change":"2024-09-19T06:10:02.518002+0000","last_active":"2024-09-19T06:12:22.417840+0000","last_peered":"2024-09-19T06:12:22.417840+0000","last_clean":"2024-09-19T06:12:22.417840+0000","last_became_active":"2024-09-19T06:10:02.517492+0000","last_became_peered":"2024-09-19T06:10:02.517492+0000","last_unstale":"2024-09-19T06:12:22.417840+0000","last_undegraded":"2024-09-19T06:12:22.417840+0000","last_fullsized":"2024-09-19T06:12:22.417840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:58.935232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.536205+0000","last_change":"2024-09-19T06:10:31.951506+0000","last_active":"2024-09-19T06:12:22.536205+0000","last_peered":"2024-09-19T06:12:22.536205+0000","last_clean":"2024-09-19T06:12:22.536205+0000","last_became_active":"2024-09-19T06:10:31.951079+0000","last_became_peered":"2024-09-19T06:10:31.951079+0000","last_unstale":"2024-09-19T06:12:22.536205+0000","last_undegraded":"2024-09-19T06:12:22.536205+0000","last_fullsized":"2024-09-19T06:12:22.536205+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:53.978445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798709+0000","last_change":"2024-09-19T06:09:59.496546+0000","last_active":"2024-09-19T06:12:22.798709+0000","last_peered":"2024-09-19T06:12:22.798709+0000","last_clean":"2024-09-19T06:12:22.798709+0000","last_became_active":"2024-09-19T06:09:59.496195+0000","last_became_peered":"2024-09-19T06:09:59.496195+0000","last_unstale":"2024-09-19T06:12:22.798709+0000","last_undegraded":"2024-09-19T06:12:22.798709+0000","last_fullsized":"2024-09-19T06:12:22.798709+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:58.443134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.769448+0000","last_change":"2024-09-19T06:10:02.522270+0000","last_active":"2024-09-19T06:12:22.769448+0000","last_peered":"2024-09-19T06:12:22.769448+0000","last_clean":"2024-09-19T06:12:22.769448+0000","last_became_active":"2024-09-19T06:10:02.517109+0000","last_became_peered":"2024-09-19T06:10:02.517109+0000","last_unstale":"2024-09-19T06:12:22.769448+0000","last_undegraded":"2024-09-19T06:12:22.769448+0000","last_fullsized":"2024-09-19T06:12:22.769448+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:56.967980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798805+0000","last_change":"2024-09-19T06:09:59.494016+0000","last_active":"2024-09-19T06:12:22.798805+0000","last_peered":"2024-09-19T06:12:22.798805+0000","last_clean":"2024-09-19T06:12:22.798805+0000","last_became_active":"2024-09-19T06:09:59.493525+0000","last_became_peered":"2024-09-19T06:09:59.493525+0000","last_unstale":"2024-09-19T06:12:22.798805+0000","last_undegraded":"2024-09-19T06:12:22.798805+0000","last_fullsized":"2024-09-19T06:12:22.798805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:06.650633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417554+0000","last_change":"2024-09-19T06:10:02.531329+0000","last_active":"2024-09-19T06:12:22.417554+0000","last_peered":"2024-09-19T06:12:22.417554+0000","last_clean":"2024-09-19T06:12:22.417554+0000","last_became_active":"2024-09-19T06:10:02.527107+0000","last_became_peered":"2024-09-19T06:10:02.527107+0000","last_unstale":"2024-09-19T06:12:22.417554+0000","last_undegraded":"2024-09-19T06:12:22.417554+0000","last_fullsized":"2024-09-19T06:12:22.417554+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:25.891416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.524291+0000","last_change":"2024-09-19T06:09:59.774966+0000","last_active":"2024-09-19T06:12:22.524291+0000","last_peered":"2024-09-19T06:12:22.524291+0000","last_clean":"2024-09-19T06:12:22.524291+0000","last_became_active":"2024-09-19T06:09:59.774038+0000","last_became_peered":"2024-09-19T06:09:59.774038+0000","last_unstale":"2024-09-19T06:12:22.524291+0000","last_undegraded":"2024-09-19T06:12:22.524291+0000","last_fullsized":"2024-09-19T06:12:22.524291+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:54.703512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.416493+0000","last_change":"2024-09-19T06:10:31.824217+0000","last_active":"2024-09-19T06:12:22.416493+0000","last_peered":"2024-09-19T06:12:22.416493+0000","last_clean":"2024-09-19T06:12:22.416493+0000","last_became_active":"2024-09-19T06:10:31.823867+0000","last_became_peered":"2024-09-19T06:10:31.823867+0000","last_unstale":"2024-09-19T06:12:22.416493+0000","last_undegraded":"2024-09-19T06:12:22.416493+0000","last_fullsized":"2024-09-19T06:12:22.416493+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:53.261746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"89'15","reported_seq":191,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.771460+0000","last_change":"2024-09-19T06:10:31.962041+0000","last_active":"2024-09-19T06:12:22.771460+0000","last_peered":"2024-09-19T06:12:22.771460+0000","last_clean":"2024-09-19T06:12:22.771460+0000","last_became_active":"2024-09-19T06:10:31.952142+0000","last_became_peered":"2024-09-19T06:10:31.952142+0000","last_unstale":"2024-09-19T06:12:22.771460+0000","last_undegraded":"2024-09-19T06:12:22.771460+0000","last_fullsized":"2024-09-19T06:12:22.771460+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:30.304256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":601065,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1368,"num_read_kb":810,"num_write":378,"num_write_kb":1468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2857,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":724992,"data_stored":1803195,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":305,"ondisk_log_size":305,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107700,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449129,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1007616,"data_stored":872326,"data_compressed":27816,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678063,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28160,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716992,"statfs":{"total":95995035648,"available":95966199808,"internally_reserved":0,"allocated":1159168,"data_stored":1265969,"data_compressed":50726,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841587,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1024000,"data_stored":869610,"data_compressed":27818,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103227,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":987136,"data_stored":476100,"data_compressed":8670,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332160,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1048576,"data_stored":1071539,"data_compressed":44570,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495685,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":983040,"data_stored":477038,"data_compressed":8670,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757323,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1073152,"data_stored":1199555,"data_compressed":50726,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920848,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":468468,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149781,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":466951,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411421,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1064960,"data_stored":543877,"data_compressed":8670,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":529569,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738470,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1003520,"data_stored":478154,"data_compressed":8670,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":69834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":525246,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":133798,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":200212,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":397054,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:12:27.279 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:12:27.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:26 smithi059 ceph-mon[35138]: Adjusting osd_memory_target on smithi071 to 176.0M 2024-09-19T06:12:27.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:26 smithi059 ceph-mon[35138]: Unable to set osd_memory_target on smithi071 to 184573132: error parsing value: Value '184573132' is below minimum 939524096 2024-09-19T06:12:27.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:26 smithi059 ceph-mon[35138]: Adjusting osd_memory_target on smithi059 to 177.0M 2024-09-19T06:12:27.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:26 smithi059 ceph-mon[35138]: Unable to set osd_memory_target on smithi059 to 185698508: error parsing value: Value '185698508' is below minimum 939524096 2024-09-19T06:12:27.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:26 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:27.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:26 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:27.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:26 smithi071 ceph-mon[35662]: Adjusting osd_memory_target on smithi071 to 176.0M 2024-09-19T06:12:27.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:26 smithi071 ceph-mon[35662]: Unable to set osd_memory_target on smithi071 to 184573132: error parsing value: Value '184573132' is below minimum 939524096 2024-09-19T06:12:27.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:26 smithi071 ceph-mon[35662]: Adjusting osd_memory_target on smithi059 to 177.0M 2024-09-19T06:12:27.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:26 smithi071 ceph-mon[35662]: Unable to set osd_memory_target on smithi059 to 185698508: error parsing value: Value '185698508' is below minimum 939524096 2024-09-19T06:12:27.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:26 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:27.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:26 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:27.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.447+0000 7fa83d800640 1 -- 172.21.15.3:0/1882281626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa838101b40 msgr2=0x7fa838101f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:27.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.447+0000 7fa83d800640 1 --2- 172.21.15.3:0/1882281626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa838101b40 0x7fa838101f40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa828009900 tx=0x7fa82802a410 comp rx=0 tx=0).stop 2024-09-19T06:12:27.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.448+0000 7fa83d800640 1 -- 172.21.15.3:0/1882281626 shutdown_connections 2024-09-19T06:12:27.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.448+0000 7fa83d800640 1 --2- 172.21.15.3:0/1882281626 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8381036f0 0x7fa838109f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:27.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.448+0000 7fa83d800640 1 --2- 172.21.15.3:0/1882281626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa838102d30 0x7fa8381031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:27.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.448+0000 7fa83d800640 1 --2- 172.21.15.3:0/1882281626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa838101b40 0x7fa838101f40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:27.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.448+0000 7fa83d800640 1 -- 172.21.15.3:0/1882281626 >> 172.21.15.3:0/1882281626 conn(0x7fa8380fd2e0 msgr2=0x7fa8380ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:27.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.448+0000 7fa83d800640 1 -- 172.21.15.3:0/1882281626 shutdown_connections 2024-09-19T06:12:27.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.448+0000 7fa83d800640 1 -- 172.21.15.3:0/1882281626 wait complete. 2024-09-19T06:12:27.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.449+0000 7fa83d800640 1 Processor -- start 2024-09-19T06:12:27.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.449+0000 7fa83d800640 1 -- start start 2024-09-19T06:12:27.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.449+0000 7fa83d800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa838101b40 0x7fa83819a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:27.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.449+0000 7fa83d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa838102d30 0x7fa83819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:27.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.449+0000 7fa83d800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8381036f0 0x7fa8381a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:27.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.449+0000 7fa83d800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa83810d7f0 con 0x7fa8381036f0 2024-09-19T06:12:27.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.449+0000 7fa83d800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa83810d670 con 0x7fa838102d30 2024-09-19T06:12:27.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.449+0000 7fa83d800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa83810d970 con 0x7fa838101b40 2024-09-19T06:12:27.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.449+0000 7fa836a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa838101b40 0x7fa83819a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:27.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.449+0000 7fa836a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa838101b40 0x7fa83819a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:51680/0 (socket says 172.21.15.3:51680) 2024-09-19T06:12:27.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.449+0000 7fa836a00640 1 -- 172.21.15.3:0/400041377 learned_addr learned my addr 172.21.15.3:0/400041377 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:27.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.449+0000 7fa836000640 1 --2- 172.21.15.3:0/400041377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa838102d30 0x7fa83819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:27.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.450+0000 7fa837400640 1 --2- 172.21.15.3:0/400041377 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8381036f0 0x7fa8381a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:27.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.450+0000 7fa836a00640 1 -- 172.21.15.3:0/400041377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa838102d30 msgr2=0x7fa83819a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:27.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.450+0000 7fa836a00640 1 --2- 172.21.15.3:0/400041377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa838102d30 0x7fa83819a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:27.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.450+0000 7fa836a00640 1 -- 172.21.15.3:0/400041377 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8381036f0 msgr2=0x7fa8381a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:27.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.450+0000 7fa836a00640 1 --2- 172.21.15.3:0/400041377 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8381036f0 0x7fa8381a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:27.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.450+0000 7fa836a00640 1 -- 172.21.15.3:0/400041377 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8381a1cc0 con 0x7fa838101b40 2024-09-19T06:12:27.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.450+0000 7fa836000640 1 --2- 172.21.15.3:0/400041377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa838102d30 0x7fa83819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:27.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.450+0000 7fa836a00640 1 --2- 172.21.15.3:0/400041377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa838101b40 0x7fa83819a0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa828031440 tx=0x7fa828032ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:27.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.451+0000 7fa82f400640 1 -- 172.21.15.3:0/400041377 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82803f030 con 0x7fa838101b40 2024-09-19T06:12:27.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.451+0000 7fa82f400640 1 -- 172.21.15.3:0/400041377 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa828003ce0 con 0x7fa838101b40 2024-09-19T06:12:27.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.451+0000 7fa83d800640 1 -- 172.21.15.3:0/400041377 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8381a1f50 con 0x7fa838101b40 2024-09-19T06:12:27.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.451+0000 7fa82f400640 1 -- 172.21.15.3:0/400041377 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa828035070 con 0x7fa838101b40 2024-09-19T06:12:27.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.451+0000 7fa83d800640 1 -- 172.21.15.3:0/400041377 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8381a2360 con 0x7fa838101b40 2024-09-19T06:12:27.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.452+0000 7fa83d800640 1 -- 172.21.15.3:0/400041377 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8381a2590 con 0x7fa838101b40 2024-09-19T06:12:27.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.454+0000 7fa82f400640 1 -- 172.21.15.3:0/400041377 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 138530+0+0 (secure 0 0 0) 0x7fa828042030 con 0x7fa838101b40 2024-09-19T06:12:27.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.455+0000 7fa82f400640 1 --2- 172.21.15.3:0/400041377 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa81c0a3450 0x7fa81c0a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:27.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.455+0000 7fa82f400640 1 -- 172.21.15.3:0/400041377 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fa8280f0480 con 0x7fa838101b40 2024-09-19T06:12:27.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.455+0000 7fa836000640 1 --2- 172.21.15.3:0/400041377 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa81c0a3450 0x7fa81c0a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:27.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.456+0000 7fa836000640 1 --2- 172.21.15.3:0/400041377 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa81c0a3450 0x7fa81c0a5910 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa83819b5b0 tx=0x7fa82400b410 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:27.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.458+0000 7fa82f400640 1 -- 172.21.15.3:0/400041377 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa8280bc640 con 0x7fa838101b40 2024-09-19T06:12:27.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.649+0000 7fa83d800640 1 -- 172.21.15.3:0/400041377 --> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa838109c20 con 0x7fa81c0a3450 2024-09-19T06:12:27.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.656+0000 7fa82f400640 1 -- 172.21.15.3:0/400041377 <== mgr.15126 v2:172.21.15.3:6800/3015970538 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258094 (secure 0 0 0) 0x7fa838109c20 con 0x7fa81c0a3450 2024-09-19T06:12:27.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:12:27.663 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-19T06:12:27.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.660+0000 7fa83d800640 1 -- 172.21.15.3:0/400041377 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa81c0a3450 msgr2=0x7fa81c0a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:27.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.660+0000 7fa83d800640 1 --2- 172.21.15.3:0/400041377 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa81c0a3450 0x7fa81c0a5910 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa83819b5b0 tx=0x7fa82400b410 comp rx=0 tx=0).stop 2024-09-19T06:12:27.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.660+0000 7fa83d800640 1 -- 172.21.15.3:0/400041377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa838101b40 msgr2=0x7fa83819a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:27.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.660+0000 7fa83d800640 1 --2- 172.21.15.3:0/400041377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa838101b40 0x7fa83819a0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa828031440 tx=0x7fa828032ce0 comp rx=0 tx=0).stop 2024-09-19T06:12:27.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.661+0000 7fa83d800640 1 -- 172.21.15.3:0/400041377 shutdown_connections 2024-09-19T06:12:27.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.661+0000 7fa83d800640 1 --2- 172.21.15.3:0/400041377 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa81c0a3450 0x7fa81c0a5910 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:27.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.661+0000 7fa83d800640 1 --2- 172.21.15.3:0/400041377 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa8381036f0 0x7fa8381a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:27.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.661+0000 7fa83d800640 1 --2- 172.21.15.3:0/400041377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa838102d30 0x7fa83819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:27.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.661+0000 7fa83d800640 1 --2- 172.21.15.3:0/400041377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa838101b40 0x7fa83819a0a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:27.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.661+0000 7fa83d800640 1 -- 172.21.15.3:0/400041377 >> 172.21.15.3:0/400041377 conn(0x7fa8380fd2e0 msgr2=0x7fa838108500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:27.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.661+0000 7fa83d800640 1 -- 172.21.15.3:0/400041377 shutdown_connections 2024-09-19T06:12:27.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.661+0000 7fa83d800640 1 -- 172.21.15.3:0/400041377 wait complete. 2024-09-19T06:12:27.680 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-19T06:12:26.431109+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1191667,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1504,"num_read_kb":929,"num_write":561,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1183593,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":944,"ondisk_log_size":944,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365520,"kb_used_data":12068,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576304,"statfs":{"total":1151940427776,"available":1151566135296,"internally_reserved":0,"allocated":12357632,"data_stored":8719156,"data_compressed":253649,"data_compressed_allocated":335872,"data_compressed_original":3072000,"omap_allocated":19140,"internal_metadata":361674044},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.978979"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523130+0000","last_change":"2024-09-19T06:10:02.531329+0000","last_active":"2024-09-19T06:12:22.523130+0000","last_peered":"2024-09-19T06:12:22.523130+0000","last_clean":"2024-09-19T06:12:22.523130+0000","last_became_active":"2024-09-19T06:10:02.530997+0000","last_became_peered":"2024-09-19T06:10:02.530997+0000","last_unstale":"2024-09-19T06:12:22.523130+0000","last_undegraded":"2024-09-19T06:12:22.523130+0000","last_fullsized":"2024-09-19T06:12:22.523130+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:15.240495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417846+0000","last_change":"2024-09-19T06:10:02.526083+0000","last_active":"2024-09-19T06:12:22.417846+0000","last_peered":"2024-09-19T06:12:22.417846+0000","last_clean":"2024-09-19T06:12:22.417846+0000","last_became_active":"2024-09-19T06:10:02.522889+0000","last_became_peered":"2024-09-19T06:10:02.522889+0000","last_unstale":"2024-09-19T06:12:22.417846+0000","last_undegraded":"2024-09-19T06:12:22.417846+0000","last_fullsized":"2024-09-19T06:12:22.417846+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:19.735866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417392+0000","last_change":"2024-09-19T06:10:02.531779+0000","last_active":"2024-09-19T06:12:22.417392+0000","last_peered":"2024-09-19T06:12:22.417392+0000","last_clean":"2024-09-19T06:12:22.417392+0000","last_became_active":"2024-09-19T06:10:02.526795+0000","last_became_peered":"2024-09-19T06:10:02.526795+0000","last_unstale":"2024-09-19T06:12:22.417392+0000","last_undegraded":"2024-09-19T06:12:22.417392+0000","last_fullsized":"2024-09-19T06:12:22.417392+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:28.800773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759797+0000","last_change":"2024-09-19T06:10:02.518697+0000","last_active":"2024-09-19T06:12:22.759797+0000","last_peered":"2024-09-19T06:12:22.759797+0000","last_clean":"2024-09-19T06:12:22.759797+0000","last_became_active":"2024-09-19T06:10:02.518114+0000","last_became_peered":"2024-09-19T06:10:02.518114+0000","last_unstale":"2024-09-19T06:12:22.759797+0000","last_undegraded":"2024-09-19T06:12:22.759797+0000","last_fullsized":"2024-09-19T06:12:22.759797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:08.172638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798502+0000","last_change":"2024-09-19T06:10:02.520450+0000","last_active":"2024-09-19T06:12:22.798502+0000","last_peered":"2024-09-19T06:12:22.798502+0000","last_clean":"2024-09-19T06:12:22.798502+0000","last_became_active":"2024-09-19T06:10:02.519079+0000","last_became_peered":"2024-09-19T06:10:02.519079+0000","last_unstale":"2024-09-19T06:12:22.798502+0000","last_undegraded":"2024-09-19T06:12:22.798502+0000","last_fullsized":"2024-09-19T06:12:22.798502+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:47.502020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.539627+0000","last_change":"2024-09-19T06:10:02.518567+0000","last_active":"2024-09-19T06:12:22.539627+0000","last_peered":"2024-09-19T06:12:22.539627+0000","last_clean":"2024-09-19T06:12:22.539627+0000","last_became_active":"2024-09-19T06:10:02.517568+0000","last_became_peered":"2024-09-19T06:10:02.517568+0000","last_unstale":"2024-09-19T06:12:22.539627+0000","last_undegraded":"2024-09-19T06:12:22.539627+0000","last_fullsized":"2024-09-19T06:12:22.539627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:10.245189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417732+0000","last_change":"2024-09-19T06:10:02.521844+0000","last_active":"2024-09-19T06:12:22.417732+0000","last_peered":"2024-09-19T06:12:22.417732+0000","last_clean":"2024-09-19T06:12:22.417732+0000","last_became_active":"2024-09-19T06:10:02.521522+0000","last_became_peered":"2024-09-19T06:10:02.521522+0000","last_unstale":"2024-09-19T06:12:22.417732+0000","last_undegraded":"2024-09-19T06:12:22.417732+0000","last_fullsized":"2024-09-19T06:12:22.417732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:46.166077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523672+0000","last_change":"2024-09-19T06:10:02.526977+0000","last_active":"2024-09-19T06:12:22.523672+0000","last_peered":"2024-09-19T06:12:22.523672+0000","last_clean":"2024-09-19T06:12:22.523672+0000","last_became_active":"2024-09-19T06:10:02.526036+0000","last_became_peered":"2024-09-19T06:10:02.526036+0000","last_unstale":"2024-09-19T06:12:22.523672+0000","last_undegraded":"2024-09-19T06:12:22.523672+0000","last_fullsized":"2024-09-19T06:12:22.523672+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:43:28.587020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.769658+0000","last_change":"2024-09-19T06:10:02.524721+0000","last_active":"2024-09-19T06:12:22.769658+0000","last_peered":"2024-09-19T06:12:22.769658+0000","last_clean":"2024-09-19T06:12:22.769658+0000","last_became_active":"2024-09-19T06:10:02.523871+0000","last_became_peered":"2024-09-19T06:10:02.523871+0000","last_unstale":"2024-09-19T06:12:22.769658+0000","last_undegraded":"2024-09-19T06:12:22.769658+0000","last_fullsized":"2024-09-19T06:12:22.769658+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:31.324530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.540176+0000","last_change":"2024-09-19T06:10:02.518494+0000","last_active":"2024-09-19T06:12:22.540176+0000","last_peered":"2024-09-19T06:12:22.540176+0000","last_clean":"2024-09-19T06:12:22.540176+0000","last_became_active":"2024-09-19T06:10:02.518140+0000","last_became_peered":"2024-09-19T06:10:02.518140+0000","last_unstale":"2024-09-19T06:12:22.540176+0000","last_undegraded":"2024-09-19T06:12:22.540176+0000","last_fullsized":"2024-09-19T06:12:22.540176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:42.695222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.418287+0000","last_change":"2024-09-19T06:10:02.524697+0000","last_active":"2024-09-19T06:12:22.418287+0000","last_peered":"2024-09-19T06:12:22.418287+0000","last_clean":"2024-09-19T06:12:22.418287+0000","last_became_active":"2024-09-19T06:10:02.524094+0000","last_became_peered":"2024-09-19T06:10:02.524094+0000","last_unstale":"2024-09-19T06:12:22.418287+0000","last_undegraded":"2024-09-19T06:12:22.418287+0000","last_fullsized":"2024-09-19T06:12:22.418287+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:12.591847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759946+0000","last_change":"2024-09-19T06:10:02.515878+0000","last_active":"2024-09-19T06:12:22.759946+0000","last_peered":"2024-09-19T06:12:22.759946+0000","last_clean":"2024-09-19T06:12:22.759946+0000","last_became_active":"2024-09-19T06:10:02.515456+0000","last_became_peered":"2024-09-19T06:10:02.515456+0000","last_unstale":"2024-09-19T06:12:22.759946+0000","last_undegraded":"2024-09-19T06:12:22.759946+0000","last_fullsized":"2024-09-19T06:12:22.759946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:58.687431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.760533+0000","last_change":"2024-09-19T06:10:31.824936+0000","last_active":"2024-09-19T06:12:22.760533+0000","last_peered":"2024-09-19T06:12:22.760533+0000","last_clean":"2024-09-19T06:12:22.760533+0000","last_became_active":"2024-09-19T06:10:31.824611+0000","last_became_peered":"2024-09-19T06:10:31.824611+0000","last_unstale":"2024-09-19T06:12:22.760533+0000","last_undegraded":"2024-09-19T06:12:22.760533+0000","last_fullsized":"2024-09-19T06:12:22.760533+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:36.397693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417277+0000","last_change":"2024-09-19T06:10:02.513397+0000","last_active":"2024-09-19T06:12:22.417277+0000","last_peered":"2024-09-19T06:12:22.417277+0000","last_clean":"2024-09-19T06:12:22.417277+0000","last_became_active":"2024-09-19T06:10:02.513011+0000","last_became_peered":"2024-09-19T06:10:02.513011+0000","last_unstale":"2024-09-19T06:12:22.417277+0000","last_undegraded":"2024-09-19T06:12:22.417277+0000","last_fullsized":"2024-09-19T06:12:22.417277+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:06:03.509401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417240+0000","last_change":"2024-09-19T06:10:02.521623+0000","last_active":"2024-09-19T06:12:22.417240+0000","last_peered":"2024-09-19T06:12:22.417240+0000","last_clean":"2024-09-19T06:12:22.417240+0000","last_became_active":"2024-09-19T06:10:02.519371+0000","last_became_peered":"2024-09-19T06:10:02.519371+0000","last_unstale":"2024-09-19T06:12:22.417240+0000","last_undegraded":"2024-09-19T06:12:22.417240+0000","last_fullsized":"2024-09-19T06:12:22.417240+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:10.687026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.768975+0000","last_change":"2024-09-19T06:10:02.520865+0000","last_active":"2024-09-19T06:12:22.768975+0000","last_peered":"2024-09-19T06:12:22.768975+0000","last_clean":"2024-09-19T06:12:22.768975+0000","last_became_active":"2024-09-19T06:10:02.519683+0000","last_became_peered":"2024-09-19T06:10:02.519683+0000","last_unstale":"2024-09-19T06:12:22.768975+0000","last_undegraded":"2024-09-19T06:12:22.768975+0000","last_fullsized":"2024-09-19T06:12:22.768975+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:40.320474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523207+0000","last_change":"2024-09-19T06:10:02.531552+0000","last_active":"2024-09-19T06:12:22.523207+0000","last_peered":"2024-09-19T06:12:22.523207+0000","last_clean":"2024-09-19T06:12:22.523207+0000","last_became_active":"2024-09-19T06:10:02.531081+0000","last_became_peered":"2024-09-19T06:10:02.531081+0000","last_unstale":"2024-09-19T06:12:22.523207+0000","last_undegraded":"2024-09-19T06:12:22.523207+0000","last_fullsized":"2024-09-19T06:12:22.523207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:07.835754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.416671+0000","last_change":"2024-09-19T06:10:02.509088+0000","last_active":"2024-09-19T06:12:22.416671+0000","last_peered":"2024-09-19T06:12:22.416671+0000","last_clean":"2024-09-19T06:12:22.416671+0000","last_became_active":"2024-09-19T06:10:02.508752+0000","last_became_peered":"2024-09-19T06:10:02.508752+0000","last_unstale":"2024-09-19T06:12:22.416671+0000","last_undegraded":"2024-09-19T06:12:22.416671+0000","last_fullsized":"2024-09-19T06:12:22.416671+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:36.832952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.760233+0000","last_change":"2024-09-19T06:10:02.534694+0000","last_active":"2024-09-19T06:12:22.760233+0000","last_peered":"2024-09-19T06:12:22.760233+0000","last_clean":"2024-09-19T06:12:22.760233+0000","last_became_active":"2024-09-19T06:10:02.534384+0000","last_became_peered":"2024-09-19T06:10:02.534384+0000","last_unstale":"2024-09-19T06:12:22.760233+0000","last_undegraded":"2024-09-19T06:12:22.760233+0000","last_fullsized":"2024-09-19T06:12:22.760233+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:48.006128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.522896+0000","last_change":"2024-09-19T06:10:02.521104+0000","last_active":"2024-09-19T06:12:22.522896+0000","last_peered":"2024-09-19T06:12:22.522896+0000","last_clean":"2024-09-19T06:12:22.522896+0000","last_became_active":"2024-09-19T06:10:02.520755+0000","last_became_peered":"2024-09-19T06:10:02.520755+0000","last_unstale":"2024-09-19T06:12:22.522896+0000","last_undegraded":"2024-09-19T06:12:22.522896+0000","last_fullsized":"2024-09-19T06:12:22.522896+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:46.091297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.760733+0000","last_change":"2024-09-19T06:10:02.522048+0000","last_active":"2024-09-19T06:12:22.760733+0000","last_peered":"2024-09-19T06:12:22.760733+0000","last_clean":"2024-09-19T06:12:22.760733+0000","last_became_active":"2024-09-19T06:10:02.521750+0000","last_became_peered":"2024-09-19T06:10:02.521750+0000","last_unstale":"2024-09-19T06:12:22.760733+0000","last_undegraded":"2024-09-19T06:12:22.760733+0000","last_fullsized":"2024-09-19T06:12:22.760733+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:07.780609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.769195+0000","last_change":"2024-09-19T06:10:02.527386+0000","last_active":"2024-09-19T06:12:22.769195+0000","last_peered":"2024-09-19T06:12:22.769195+0000","last_clean":"2024-09-19T06:12:22.769195+0000","last_became_active":"2024-09-19T06:10:02.526804+0000","last_became_peered":"2024-09-19T06:10:02.526804+0000","last_unstale":"2024-09-19T06:12:22.769195+0000","last_undegraded":"2024-09-19T06:12:22.769195+0000","last_fullsized":"2024-09-19T06:12:22.769195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:15.652068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523556+0000","last_change":"2024-09-19T06:10:02.528521+0000","last_active":"2024-09-19T06:12:22.523556+0000","last_peered":"2024-09-19T06:12:22.523556+0000","last_clean":"2024-09-19T06:12:22.523556+0000","last_became_active":"2024-09-19T06:10:02.528087+0000","last_became_peered":"2024-09-19T06:10:02.528087+0000","last_unstale":"2024-09-19T06:12:22.523556+0000","last_undegraded":"2024-09-19T06:12:22.523556+0000","last_fullsized":"2024-09-19T06:12:22.523556+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:29.176129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.536015+0000","last_change":"2024-09-19T06:10:02.518544+0000","last_active":"2024-09-19T06:12:22.536015+0000","last_peered":"2024-09-19T06:12:22.536015+0000","last_clean":"2024-09-19T06:12:22.536015+0000","last_became_active":"2024-09-19T06:10:02.518230+0000","last_became_peered":"2024-09-19T06:10:02.518230+0000","last_unstale":"2024-09-19T06:12:22.536015+0000","last_undegraded":"2024-09-19T06:12:22.536015+0000","last_fullsized":"2024-09-19T06:12:22.536015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:26:32.116211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.524066+0000","last_change":"2024-09-19T06:10:02.531859+0000","last_active":"2024-09-19T06:12:22.524066+0000","last_peered":"2024-09-19T06:12:22.524066+0000","last_clean":"2024-09-19T06:12:22.524066+0000","last_became_active":"2024-09-19T06:10:02.531572+0000","last_became_peered":"2024-09-19T06:10:02.531572+0000","last_unstale":"2024-09-19T06:12:22.524066+0000","last_undegraded":"2024-09-19T06:12:22.524066+0000","last_fullsized":"2024-09-19T06:12:22.524066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:34.314977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.760242+0000","last_change":"2024-09-19T06:10:02.521292+0000","last_active":"2024-09-19T06:12:22.760242+0000","last_peered":"2024-09-19T06:12:22.760242+0000","last_clean":"2024-09-19T06:12:22.760242+0000","last_became_active":"2024-09-19T06:10:02.520967+0000","last_became_peered":"2024-09-19T06:10:02.520967+0000","last_unstale":"2024-09-19T06:12:22.760242+0000","last_undegraded":"2024-09-19T06:12:22.760242+0000","last_fullsized":"2024-09-19T06:12:22.760242+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:11.318504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523032+0000","last_change":"2024-09-19T06:10:02.521514+0000","last_active":"2024-09-19T06:12:22.523032+0000","last_peered":"2024-09-19T06:12:22.523032+0000","last_clean":"2024-09-19T06:12:22.523032+0000","last_became_active":"2024-09-19T06:10:02.521203+0000","last_became_peered":"2024-09-19T06:10:02.521203+0000","last_unstale":"2024-09-19T06:12:22.523032+0000","last_undegraded":"2024-09-19T06:12:22.523032+0000","last_fullsized":"2024-09-19T06:12:22.523032+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:53.689067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759912+0000","last_change":"2024-09-19T06:10:31.824501+0000","last_active":"2024-09-19T06:12:22.759912+0000","last_peered":"2024-09-19T06:12:22.759912+0000","last_clean":"2024-09-19T06:12:22.759912+0000","last_became_active":"2024-09-19T06:10:31.824161+0000","last_became_peered":"2024-09-19T06:10:31.824161+0000","last_unstale":"2024-09-19T06:12:22.759912+0000","last_undegraded":"2024-09-19T06:12:22.759912+0000","last_fullsized":"2024-09-19T06:12:22.759912+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:28.203581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417661+0000","last_change":"2024-09-19T06:10:02.530351+0000","last_active":"2024-09-19T06:12:22.417661+0000","last_peered":"2024-09-19T06:12:22.417661+0000","last_clean":"2024-09-19T06:12:22.417661+0000","last_became_active":"2024-09-19T06:10:02.529292+0000","last_became_peered":"2024-09-19T06:10:02.529292+0000","last_unstale":"2024-09-19T06:12:22.417661+0000","last_undegraded":"2024-09-19T06:12:22.417661+0000","last_fullsized":"2024-09-19T06:12:22.417661+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:02.324413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759801+0000","last_change":"2024-09-19T06:10:02.534885+0000","last_active":"2024-09-19T06:12:22.759801+0000","last_peered":"2024-09-19T06:12:22.759801+0000","last_clean":"2024-09-19T06:12:22.759801+0000","last_became_active":"2024-09-19T06:10:02.534520+0000","last_became_peered":"2024-09-19T06:10:02.534520+0000","last_unstale":"2024-09-19T06:12:22.759801+0000","last_undegraded":"2024-09-19T06:12:22.759801+0000","last_fullsized":"2024-09-19T06:12:22.759801+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:04.896787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759826+0000","last_change":"2024-09-19T06:10:02.518120+0000","last_active":"2024-09-19T06:12:22.759826+0000","last_peered":"2024-09-19T06:12:22.759826+0000","last_clean":"2024-09-19T06:12:22.759826+0000","last_became_active":"2024-09-19T06:10:02.517595+0000","last_became_peered":"2024-09-19T06:10:02.517595+0000","last_unstale":"2024-09-19T06:12:22.759826+0000","last_undegraded":"2024-09-19T06:12:22.759826+0000","last_fullsized":"2024-09-19T06:12:22.759826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:00.695783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.522797+0000","last_change":"2024-09-19T06:10:02.524413+0000","last_active":"2024-09-19T06:12:22.522797+0000","last_peered":"2024-09-19T06:12:22.522797+0000","last_clean":"2024-09-19T06:12:22.522797+0000","last_became_active":"2024-09-19T06:10:02.523559+0000","last_became_peered":"2024-09-19T06:10:02.523559+0000","last_unstale":"2024-09-19T06:12:22.522797+0000","last_undegraded":"2024-09-19T06:12:22.522797+0000","last_fullsized":"2024-09-19T06:12:22.522797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:04.045759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798454+0000","last_change":"2024-09-19T06:10:02.514572+0000","last_active":"2024-09-19T06:12:22.798454+0000","last_peered":"2024-09-19T06:12:22.798454+0000","last_clean":"2024-09-19T06:12:22.798454+0000","last_became_active":"2024-09-19T06:10:02.513685+0000","last_became_peered":"2024-09-19T06:10:02.513685+0000","last_unstale":"2024-09-19T06:12:22.798454+0000","last_undegraded":"2024-09-19T06:12:22.798454+0000","last_fullsized":"2024-09-19T06:12:22.798454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:09.108036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"89'9","reported_seq":136,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.982038+0000","last_change":"2024-09-19T06:10:31.829554+0000","last_active":"2024-09-19T06:12:22.982038+0000","last_peered":"2024-09-19T06:12:22.982038+0000","last_clean":"2024-09-19T06:12:22.982038+0000","last_became_active":"2024-09-19T06:10:31.824266+0000","last_became_peered":"2024-09-19T06:10:31.824266+0000","last_unstale":"2024-09-19T06:12:22.982038+0000","last_undegraded":"2024-09-19T06:12:22.982038+0000","last_fullsized":"2024-09-19T06:12:22.982038+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:07.241897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1942,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":2,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1015,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.536116+0000","last_change":"2024-09-19T06:10:02.524271+0000","last_active":"2024-09-19T06:12:22.536116+0000","last_peered":"2024-09-19T06:12:22.536116+0000","last_clean":"2024-09-19T06:12:22.536116+0000","last_became_active":"2024-09-19T06:10:02.523948+0000","last_became_peered":"2024-09-19T06:10:02.523948+0000","last_unstale":"2024-09-19T06:12:22.536116+0000","last_undegraded":"2024-09-19T06:12:22.536116+0000","last_fullsized":"2024-09-19T06:12:22.536116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:46.406652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.539711+0000","last_change":"2024-09-19T06:09:59.493186+0000","last_active":"2024-09-19T06:12:22.539711+0000","last_peered":"2024-09-19T06:12:22.539711+0000","last_clean":"2024-09-19T06:12:22.539711+0000","last_became_active":"2024-09-19T06:09:59.492841+0000","last_became_peered":"2024-09-19T06:09:59.492841+0000","last_unstale":"2024-09-19T06:12:22.539711+0000","last_undegraded":"2024-09-19T06:12:22.539711+0000","last_fullsized":"2024-09-19T06:12:22.539711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:48.557724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759731+0000","last_change":"2024-09-19T06:09:59.493364+0000","last_active":"2024-09-19T06:12:22.759731+0000","last_peered":"2024-09-19T06:12:22.759731+0000","last_clean":"2024-09-19T06:12:22.759731+0000","last_became_active":"2024-09-19T06:09:59.491868+0000","last_became_peered":"2024-09-19T06:09:59.491868+0000","last_unstale":"2024-09-19T06:12:22.759731+0000","last_undegraded":"2024-09-19T06:12:22.759731+0000","last_fullsized":"2024-09-19T06:12:22.759731+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:23.088768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523512+0000","last_change":"2024-09-19T06:10:02.534453+0000","last_active":"2024-09-19T06:12:22.523512+0000","last_peered":"2024-09-19T06:12:22.523512+0000","last_clean":"2024-09-19T06:12:22.523512+0000","last_became_active":"2024-09-19T06:10:02.532003+0000","last_became_peered":"2024-09-19T06:10:02.532003+0000","last_unstale":"2024-09-19T06:12:22.523512+0000","last_undegraded":"2024-09-19T06:12:22.523512+0000","last_fullsized":"2024-09-19T06:12:22.523512+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:41.609673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.536292+0000","last_change":"2024-09-19T06:09:59.493574+0000","last_active":"2024-09-19T06:12:22.536292+0000","last_peered":"2024-09-19T06:12:22.536292+0000","last_clean":"2024-09-19T06:12:22.536292+0000","last_became_active":"2024-09-19T06:09:59.493243+0000","last_became_peered":"2024-09-19T06:09:59.493243+0000","last_unstale":"2024-09-19T06:12:22.536292+0000","last_undegraded":"2024-09-19T06:12:22.536292+0000","last_fullsized":"2024-09-19T06:12:22.536292+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:12:43.491780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.416070+0000","last_change":"2024-09-19T06:10:02.520122+0000","last_active":"2024-09-19T06:12:22.416070+0000","last_peered":"2024-09-19T06:12:22.416070+0000","last_clean":"2024-09-19T06:12:22.416070+0000","last_became_active":"2024-09-19T06:10:02.519795+0000","last_became_peered":"2024-09-19T06:10:02.519795+0000","last_unstale":"2024-09-19T06:12:22.416070+0000","last_undegraded":"2024-09-19T06:12:22.416070+0000","last_fullsized":"2024-09-19T06:12:22.416070+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:12.384824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"89'7","reported_seq":289,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.981477+0000","last_change":"2024-09-19T06:09:59.491192+0000","last_active":"2024-09-19T06:12:22.981477+0000","last_peered":"2024-09-19T06:12:22.981477+0000","last_clean":"2024-09-19T06:12:22.981477+0000","last_became_active":"2024-09-19T06:09:59.490774+0000","last_became_peered":"2024-09-19T06:09:59.490774+0000","last_unstale":"2024-09-19T06:12:22.981477+0000","last_undegraded":"2024-09-19T06:12:22.981477+0000","last_fullsized":"2024-09-19T06:12:22.981477+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:30.276512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":254,"num_read_kb":254,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.769254+0000","last_change":"2024-09-19T06:10:02.516728+0000","last_active":"2024-09-19T06:12:22.769254+0000","last_peered":"2024-09-19T06:12:22.769254+0000","last_clean":"2024-09-19T06:12:22.769254+0000","last_became_active":"2024-09-19T06:10:02.516415+0000","last_became_peered":"2024-09-19T06:10:02.516415+0000","last_unstale":"2024-09-19T06:12:22.769254+0000","last_undegraded":"2024-09-19T06:12:22.769254+0000","last_fullsized":"2024-09-19T06:12:22.769254+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:45.012284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.418403+0000","last_change":"2024-09-19T06:09:59.499167+0000","last_active":"2024-09-19T06:12:22.418403+0000","last_peered":"2024-09-19T06:12:22.418403+0000","last_clean":"2024-09-19T06:12:22.418403+0000","last_became_active":"2024-09-19T06:09:59.498796+0000","last_became_peered":"2024-09-19T06:09:59.498796+0000","last_unstale":"2024-09-19T06:12:22.418403+0000","last_undegraded":"2024-09-19T06:12:22.418403+0000","last_fullsized":"2024-09-19T06:12:22.418403+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:08.665495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417683+0000","last_change":"2024-09-19T06:10:31.823990+0000","last_active":"2024-09-19T06:12:22.417683+0000","last_peered":"2024-09-19T06:12:22.417683+0000","last_clean":"2024-09-19T06:12:22.417683+0000","last_became_active":"2024-09-19T06:10:31.823448+0000","last_became_peered":"2024-09-19T06:10:31.823448+0000","last_unstale":"2024-09-19T06:12:22.417683+0000","last_undegraded":"2024-09-19T06:12:22.417683+0000","last_fullsized":"2024-09-19T06:12:22.417683+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:33.882448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.536353+0000","last_change":"2024-09-19T06:09:59.774875+0000","last_active":"2024-09-19T06:12:22.536353+0000","last_peered":"2024-09-19T06:12:22.536353+0000","last_clean":"2024-09-19T06:12:22.536353+0000","last_became_active":"2024-09-19T06:09:59.774376+0000","last_became_peered":"2024-09-19T06:09:59.774376+0000","last_unstale":"2024-09-19T06:12:22.536353+0000","last_undegraded":"2024-09-19T06:12:22.536353+0000","last_fullsized":"2024-09-19T06:12:22.536353+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:01.283578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.769374+0000","last_change":"2024-09-19T06:10:02.518202+0000","last_active":"2024-09-19T06:12:22.769374+0000","last_peered":"2024-09-19T06:12:22.769374+0000","last_clean":"2024-09-19T06:12:22.769374+0000","last_became_active":"2024-09-19T06:10:02.517865+0000","last_became_peered":"2024-09-19T06:10:02.517865+0000","last_unstale":"2024-09-19T06:12:22.769374+0000","last_undegraded":"2024-09-19T06:12:22.769374+0000","last_fullsized":"2024-09-19T06:12:22.769374+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:28.128891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"89'38","reported_seq":333,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.982684+0000","last_change":"2024-09-19T06:09:59.493139+0000","last_active":"2024-09-19T06:12:22.982684+0000","last_peered":"2024-09-19T06:12:22.982684+0000","last_clean":"2024-09-19T06:12:22.982684+0000","last_became_active":"2024-09-19T06:09:59.492768+0000","last_became_peered":"2024-09-19T06:09:59.492768+0000","last_unstale":"2024-09-19T06:12:22.982684+0000","last_undegraded":"2024-09-19T06:12:22.982684+0000","last_fullsized":"2024-09-19T06:12:22.982684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:17.872432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66483,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":266,"num_read_kb":198,"num_write":40,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798746+0000","last_change":"2024-09-19T06:10:02.516187+0000","last_active":"2024-09-19T06:12:22.798746+0000","last_peered":"2024-09-19T06:12:22.798746+0000","last_clean":"2024-09-19T06:12:22.798746+0000","last_became_active":"2024-09-19T06:10:02.515888+0000","last_became_peered":"2024-09-19T06:10:02.515888+0000","last_unstale":"2024-09-19T06:12:22.798746+0000","last_undegraded":"2024-09-19T06:12:22.798746+0000","last_fullsized":"2024-09-19T06:12:22.798746+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:29.672889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759957+0000","last_change":"2024-09-19T06:09:59.492155+0000","last_active":"2024-09-19T06:12:22.759957+0000","last_peered":"2024-09-19T06:12:22.759957+0000","last_clean":"2024-09-19T06:12:22.759957+0000","last_became_active":"2024-09-19T06:09:59.491730+0000","last_became_peered":"2024-09-19T06:09:59.491730+0000","last_unstale":"2024-09-19T06:12:22.759957+0000","last_undegraded":"2024-09-19T06:12:22.759957+0000","last_fullsized":"2024-09-19T06:12:22.759957+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:30.632665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.760036+0000","last_change":"2024-09-19T06:10:02.526214+0000","last_active":"2024-09-19T06:12:22.760036+0000","last_peered":"2024-09-19T06:12:22.760036+0000","last_clean":"2024-09-19T06:12:22.760036+0000","last_became_active":"2024-09-19T06:10:02.525846+0000","last_became_peered":"2024-09-19T06:10:02.525846+0000","last_unstale":"2024-09-19T06:12:22.760036+0000","last_undegraded":"2024-09-19T06:12:22.760036+0000","last_fullsized":"2024-09-19T06:12:22.760036+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:14.294741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.536313+0000","last_change":"2024-09-19T06:09:59.494814+0000","last_active":"2024-09-19T06:12:22.536313+0000","last_peered":"2024-09-19T06:12:22.536313+0000","last_clean":"2024-09-19T06:12:22.536313+0000","last_became_active":"2024-09-19T06:09:59.494461+0000","last_became_peered":"2024-09-19T06:09:59.494461+0000","last_unstale":"2024-09-19T06:12:22.536313+0000","last_undegraded":"2024-09-19T06:12:22.536313+0000","last_fullsized":"2024-09-19T06:12:22.536313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:37.730327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.418125+0000","last_change":"2024-09-19T06:10:02.518851+0000","last_active":"2024-09-19T06:12:22.418125+0000","last_peered":"2024-09-19T06:12:22.418125+0000","last_clean":"2024-09-19T06:12:22.418125+0000","last_became_active":"2024-09-19T06:10:02.518462+0000","last_became_peered":"2024-09-19T06:10:02.518462+0000","last_unstale":"2024-09-19T06:12:22.418125+0000","last_undegraded":"2024-09-19T06:12:22.418125+0000","last_fullsized":"2024-09-19T06:12:22.418125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:22.629918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'6","reported_seq":165,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.953339+0000","last_change":"2024-09-19T06:09:59.493839+0000","last_active":"2024-09-19T06:12:22.953339+0000","last_peered":"2024-09-19T06:12:22.953339+0000","last_clean":"2024-09-19T06:12:22.953339+0000","last_became_active":"2024-09-19T06:09:59.492323+0000","last_became_peered":"2024-09-19T06:09:59.492323+0000","last_unstale":"2024-09-19T06:12:22.953339+0000","last_undegraded":"2024-09-19T06:12:22.953339+0000","last_fullsized":"2024-09-19T06:12:22.953339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:12.754030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":131,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417730+0000","last_change":"2024-09-19T06:10:02.515957+0000","last_active":"2024-09-19T06:12:22.417730+0000","last_peered":"2024-09-19T06:12:22.417730+0000","last_clean":"2024-09-19T06:12:22.417730+0000","last_became_active":"2024-09-19T06:10:02.515493+0000","last_became_peered":"2024-09-19T06:10:02.515493+0000","last_unstale":"2024-09-19T06:12:22.417730+0000","last_undegraded":"2024-09-19T06:12:22.417730+0000","last_fullsized":"2024-09-19T06:12:22.417730+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:06.988155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798500+0000","last_change":"2024-09-19T06:09:59.775131+0000","last_active":"2024-09-19T06:12:22.798500+0000","last_peered":"2024-09-19T06:12:22.798500+0000","last_clean":"2024-09-19T06:12:22.798500+0000","last_became_active":"2024-09-19T06:09:59.774642+0000","last_became_peered":"2024-09-19T06:09:59.774642+0000","last_unstale":"2024-09-19T06:12:22.798500+0000","last_undegraded":"2024-09-19T06:12:22.798500+0000","last_fullsized":"2024-09-19T06:12:22.798500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:31.722485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.536308+0000","last_change":"2024-09-19T06:10:02.522531+0000","last_active":"2024-09-19T06:12:22.536308+0000","last_peered":"2024-09-19T06:12:22.536308+0000","last_clean":"2024-09-19T06:12:22.536308+0000","last_became_active":"2024-09-19T06:10:02.522186+0000","last_became_peered":"2024-09-19T06:10:02.522186+0000","last_unstale":"2024-09-19T06:12:22.536308+0000","last_undegraded":"2024-09-19T06:12:22.536308+0000","last_fullsized":"2024-09-19T06:12:22.536308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:45.689043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798825+0000","last_change":"2024-09-19T06:09:59.494819+0000","last_active":"2024-09-19T06:12:22.798825+0000","last_peered":"2024-09-19T06:12:22.798825+0000","last_clean":"2024-09-19T06:12:22.798825+0000","last_became_active":"2024-09-19T06:09:59.494434+0000","last_became_peered":"2024-09-19T06:09:59.494434+0000","last_unstale":"2024-09-19T06:12:22.798825+0000","last_undegraded":"2024-09-19T06:12:22.798825+0000","last_fullsized":"2024-09-19T06:12:22.798825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:42.207621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523127+0000","last_change":"2024-09-19T06:10:02.522893+0000","last_active":"2024-09-19T06:12:22.523127+0000","last_peered":"2024-09-19T06:12:22.523127+0000","last_clean":"2024-09-19T06:12:22.523127+0000","last_became_active":"2024-09-19T06:10:02.522596+0000","last_became_peered":"2024-09-19T06:10:02.522596+0000","last_unstale":"2024-09-19T06:12:22.523127+0000","last_undegraded":"2024-09-19T06:12:22.523127+0000","last_fullsized":"2024-09-19T06:12:22.523127+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:21.394878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759883+0000","last_change":"2024-09-19T06:10:31.838085+0000","last_active":"2024-09-19T06:12:22.759883+0000","last_peered":"2024-09-19T06:12:22.759883+0000","last_clean":"2024-09-19T06:12:22.759883+0000","last_became_active":"2024-09-19T06:10:31.826924+0000","last_became_peered":"2024-09-19T06:10:31.826924+0000","last_unstale":"2024-09-19T06:12:22.759883+0000","last_undegraded":"2024-09-19T06:12:22.759883+0000","last_fullsized":"2024-09-19T06:12:22.759883+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:19.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.418534+0000","last_change":"2024-09-19T06:10:02.516137+0000","last_active":"2024-09-19T06:12:22.418534+0000","last_peered":"2024-09-19T06:12:22.418534+0000","last_clean":"2024-09-19T06:12:22.418534+0000","last_became_active":"2024-09-19T06:10:02.515769+0000","last_became_peered":"2024-09-19T06:10:02.515769+0000","last_unstale":"2024-09-19T06:12:22.418534+0000","last_undegraded":"2024-09-19T06:12:22.418534+0000","last_fullsized":"2024-09-19T06:12:22.418534+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:56.741950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'41","reported_seq":78,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.688076+0000","last_change":"2024-09-19T06:09:59.498177+0000","last_active":"2024-09-19T06:12:22.688076+0000","last_peered":"2024-09-19T06:12:22.688076+0000","last_clean":"2024-09-19T06:12:22.688076+0000","last_became_active":"2024-09-19T06:09:59.497808+0000","last_became_peered":"2024-09-19T06:09:59.497808+0000","last_unstale":"2024-09-19T06:12:22.688076+0000","last_undegraded":"2024-09-19T06:12:22.688076+0000","last_fullsized":"2024-09-19T06:12:22.688076+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:06.473332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.418112+0000","last_change":"2024-09-19T06:10:02.526442+0000","last_active":"2024-09-19T06:12:22.418112+0000","last_peered":"2024-09-19T06:12:22.418112+0000","last_clean":"2024-09-19T06:12:22.418112+0000","last_became_active":"2024-09-19T06:10:02.526116+0000","last_became_peered":"2024-09-19T06:10:02.526116+0000","last_unstale":"2024-09-19T06:12:22.418112+0000","last_undegraded":"2024-09-19T06:12:22.418112+0000","last_fullsized":"2024-09-19T06:12:22.418112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:05.000599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'7","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.982209+0000","last_change":"2024-09-19T06:10:31.829793+0000","last_active":"2024-09-19T06:12:22.982209+0000","last_peered":"2024-09-19T06:12:22.982209+0000","last_clean":"2024-09-19T06:12:22.982209+0000","last_became_active":"2024-09-19T06:10:31.822044+0000","last_became_peered":"2024-09-19T06:10:31.822044+0000","last_unstale":"2024-09-19T06:12:22.982209+0000","last_undegraded":"2024-09-19T06:12:22.982209+0000","last_fullsized":"2024-09-19T06:12:22.982209+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:45.301315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1874,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":2,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1170,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.418385+0000","last_change":"2024-09-19T06:10:02.524435+0000","last_active":"2024-09-19T06:12:22.418385+0000","last_peered":"2024-09-19T06:12:22.418385+0000","last_clean":"2024-09-19T06:12:22.418385+0000","last_became_active":"2024-09-19T06:10:02.523634+0000","last_became_peered":"2024-09-19T06:10:02.523634+0000","last_unstale":"2024-09-19T06:12:22.418385+0000","last_undegraded":"2024-09-19T06:12:22.418385+0000","last_fullsized":"2024-09-19T06:12:22.418385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:07.679183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":352,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417875+0000","last_change":"2024-09-19T06:08:39.873247+0000","last_active":"2024-09-19T06:12:22.417875+0000","last_peered":"2024-09-19T06:12:22.417875+0000","last_clean":"2024-09-19T06:12:22.417875+0000","last_became_active":"2024-09-19T06:08:39.872647+0000","last_became_peered":"2024-09-19T06:08:39.872647+0000","last_unstale":"2024-09-19T06:12:22.417875+0000","last_undegraded":"2024-09-19T06:12:22.417875+0000","last_fullsized":"2024-09-19T06:12:22.417875+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:56.991890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:56.991890+0000","last_clean_scrub_stamp":"2024-09-19T06:04:56.991890+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:18.835510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759946+0000","last_change":"2024-09-19T06:09:59.492677+0000","last_active":"2024-09-19T06:12:22.759946+0000","last_peered":"2024-09-19T06:12:22.759946+0000","last_clean":"2024-09-19T06:12:22.759946+0000","last_became_active":"2024-09-19T06:09:59.492235+0000","last_became_peered":"2024-09-19T06:09:59.492235+0000","last_unstale":"2024-09-19T06:12:22.759946+0000","last_undegraded":"2024-09-19T06:12:22.759946+0000","last_fullsized":"2024-09-19T06:12:22.759946+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:40.173728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523728+0000","last_change":"2024-09-19T06:10:02.523331+0000","last_active":"2024-09-19T06:12:22.523728+0000","last_peered":"2024-09-19T06:12:22.523728+0000","last_clean":"2024-09-19T06:12:22.523728+0000","last_became_active":"2024-09-19T06:10:02.522896+0000","last_became_peered":"2024-09-19T06:10:02.522896+0000","last_unstale":"2024-09-19T06:12:22.523728+0000","last_undegraded":"2024-09-19T06:12:22.523728+0000","last_fullsized":"2024-09-19T06:12:22.523728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:56.994375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417840+0000","last_change":"2024-09-19T06:09:59.496407+0000","last_active":"2024-09-19T06:12:22.417840+0000","last_peered":"2024-09-19T06:12:22.417840+0000","last_clean":"2024-09-19T06:12:22.417840+0000","last_became_active":"2024-09-19T06:09:59.496074+0000","last_became_peered":"2024-09-19T06:09:59.496074+0000","last_unstale":"2024-09-19T06:12:22.417840+0000","last_undegraded":"2024-09-19T06:12:22.417840+0000","last_fullsized":"2024-09-19T06:12:22.417840+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:11.257227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759741+0000","last_change":"2024-09-19T06:10:02.515229+0000","last_active":"2024-09-19T06:12:22.759741+0000","last_peered":"2024-09-19T06:12:22.759741+0000","last_clean":"2024-09-19T06:12:22.759741+0000","last_became_active":"2024-09-19T06:10:02.514092+0000","last_became_peered":"2024-09-19T06:10:02.514092+0000","last_unstale":"2024-09-19T06:12:22.759741+0000","last_undegraded":"2024-09-19T06:12:22.759741+0000","last_fullsized":"2024-09-19T06:12:22.759741+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:32:36.805821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"89'6","reported_seq":163,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.763210+0000","last_change":"2024-09-19T06:09:59.777102+0000","last_active":"2024-09-19T06:12:22.763210+0000","last_peered":"2024-09-19T06:12:22.763210+0000","last_clean":"2024-09-19T06:12:22.763210+0000","last_became_active":"2024-09-19T06:09:59.774456+0000","last_became_peered":"2024-09-19T06:09:59.774456+0000","last_unstale":"2024-09-19T06:12:22.763210+0000","last_undegraded":"2024-09-19T06:12:22.763210+0000","last_fullsized":"2024-09-19T06:12:22.763210+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:11.353528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":128,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.536115+0000","last_change":"2024-09-19T06:10:02.517039+0000","last_active":"2024-09-19T06:12:22.536115+0000","last_peered":"2024-09-19T06:12:22.536115+0000","last_clean":"2024-09-19T06:12:22.536115+0000","last_became_active":"2024-09-19T06:10:02.516291+0000","last_became_peered":"2024-09-19T06:10:02.516291+0000","last_unstale":"2024-09-19T06:12:22.536115+0000","last_undegraded":"2024-09-19T06:12:22.536115+0000","last_fullsized":"2024-09-19T06:12:22.536115+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:27.835967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"89'8","reported_seq":167,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:23.113189+0000","last_change":"2024-09-19T06:09:59.499496+0000","last_active":"2024-09-19T06:12:23.113189+0000","last_peered":"2024-09-19T06:12:23.113189+0000","last_clean":"2024-09-19T06:12:23.113189+0000","last_became_active":"2024-09-19T06:09:59.499172+0000","last_became_peered":"2024-09-19T06:09:59.499172+0000","last_unstale":"2024-09-19T06:12:23.113189+0000","last_undegraded":"2024-09-19T06:12:23.113189+0000","last_fullsized":"2024-09-19T06:12:23.113189+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:52.062675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":130,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.539804+0000","last_change":"2024-09-19T06:10:02.523099+0000","last_active":"2024-09-19T06:12:22.539804+0000","last_peered":"2024-09-19T06:12:22.539804+0000","last_clean":"2024-09-19T06:12:22.539804+0000","last_became_active":"2024-09-19T06:10:02.522770+0000","last_became_peered":"2024-09-19T06:10:02.522770+0000","last_unstale":"2024-09-19T06:12:22.539804+0000","last_undegraded":"2024-09-19T06:12:22.539804+0000","last_fullsized":"2024-09-19T06:12:22.539804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:39.807159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.416333+0000","last_change":"2024-09-19T06:09:59.775371+0000","last_active":"2024-09-19T06:12:22.416333+0000","last_peered":"2024-09-19T06:12:22.416333+0000","last_clean":"2024-09-19T06:12:22.416333+0000","last_became_active":"2024-09-19T06:09:59.774944+0000","last_became_peered":"2024-09-19T06:09:59.774944+0000","last_unstale":"2024-09-19T06:12:22.416333+0000","last_undegraded":"2024-09-19T06:12:22.416333+0000","last_fullsized":"2024-09-19T06:12:22.416333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:44.305005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.539885+0000","last_change":"2024-09-19T06:10:02.521207+0000","last_active":"2024-09-19T06:12:22.539885+0000","last_peered":"2024-09-19T06:12:22.539885+0000","last_clean":"2024-09-19T06:12:22.539885+0000","last_became_active":"2024-09-19T06:10:02.520843+0000","last_became_peered":"2024-09-19T06:10:02.520843+0000","last_unstale":"2024-09-19T06:12:22.539885+0000","last_undegraded":"2024-09-19T06:12:22.539885+0000","last_fullsized":"2024-09-19T06:12:22.539885+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:39.462042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798901+0000","last_change":"2024-09-19T06:09:59.775259+0000","last_active":"2024-09-19T06:12:22.798901+0000","last_peered":"2024-09-19T06:12:22.798901+0000","last_clean":"2024-09-19T06:12:22.798901+0000","last_became_active":"2024-09-19T06:09:59.774393+0000","last_became_peered":"2024-09-19T06:09:59.774393+0000","last_unstale":"2024-09-19T06:12:22.798901+0000","last_undegraded":"2024-09-19T06:12:22.798901+0000","last_fullsized":"2024-09-19T06:12:22.798901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:39:05.904778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.760041+0000","last_change":"2024-09-19T06:10:02.516445+0000","last_active":"2024-09-19T06:12:22.760041+0000","last_peered":"2024-09-19T06:12:22.760041+0000","last_clean":"2024-09-19T06:12:22.760041+0000","last_became_active":"2024-09-19T06:10:02.515524+0000","last_became_peered":"2024-09-19T06:10:02.515524+0000","last_unstale":"2024-09-19T06:12:22.760041+0000","last_undegraded":"2024-09-19T06:12:22.760041+0000","last_fullsized":"2024-09-19T06:12:22.760041+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:42.863526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"89'51","reported_seq":119,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.685554+0000","last_change":"2024-09-19T06:10:31.834659+0000","last_active":"2024-09-19T06:12:22.685554+0000","last_peered":"2024-09-19T06:12:22.685554+0000","last_clean":"2024-09-19T06:12:22.685554+0000","last_became_active":"2024-09-19T06:10:31.825992+0000","last_became_peered":"2024-09-19T06:10:31.825992+0000","last_unstale":"2024-09-19T06:12:22.685554+0000","last_undegraded":"2024-09-19T06:12:22.685554+0000","last_fullsized":"2024-09-19T06:12:22.685554+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:16.208213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":91,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.524191+0000","last_change":"2024-09-19T06:10:02.532473+0000","last_active":"2024-09-19T06:12:22.524191+0000","last_peered":"2024-09-19T06:12:22.524191+0000","last_clean":"2024-09-19T06:12:22.524191+0000","last_became_active":"2024-09-19T06:10:02.531745+0000","last_became_peered":"2024-09-19T06:10:02.531745+0000","last_unstale":"2024-09-19T06:12:22.524191+0000","last_undegraded":"2024-09-19T06:12:22.524191+0000","last_fullsized":"2024-09-19T06:12:22.524191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:22.659626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.760021+0000","last_change":"2024-09-19T06:10:00.231383+0000","last_active":"2024-09-19T06:12:22.760021+0000","last_peered":"2024-09-19T06:12:22.760021+0000","last_clean":"2024-09-19T06:12:22.760021+0000","last_became_active":"2024-09-19T06:10:00.231016+0000","last_became_peered":"2024-09-19T06:10:00.231016+0000","last_unstale":"2024-09-19T06:12:22.760021+0000","last_undegraded":"2024-09-19T06:12:22.760021+0000","last_fullsized":"2024-09-19T06:12:22.760021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:39:07.178556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.418119+0000","last_change":"2024-09-19T06:10:02.532772+0000","last_active":"2024-09-19T06:12:22.418119+0000","last_peered":"2024-09-19T06:12:22.418119+0000","last_clean":"2024-09-19T06:12:22.418119+0000","last_became_active":"2024-09-19T06:10:02.528187+0000","last_became_peered":"2024-09-19T06:10:02.528187+0000","last_unstale":"2024-09-19T06:12:22.418119+0000","last_undegraded":"2024-09-19T06:12:22.418119+0000","last_fullsized":"2024-09-19T06:12:22.418119+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:35.550221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.769076+0000","last_change":"2024-09-19T06:09:59.774860+0000","last_active":"2024-09-19T06:12:22.769076+0000","last_peered":"2024-09-19T06:12:22.769076+0000","last_clean":"2024-09-19T06:12:22.769076+0000","last_became_active":"2024-09-19T06:09:59.774525+0000","last_became_peered":"2024-09-19T06:09:59.774525+0000","last_unstale":"2024-09-19T06:12:22.769076+0000","last_undegraded":"2024-09-19T06:12:22.769076+0000","last_fullsized":"2024-09-19T06:12:22.769076+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:28.480611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798429+0000","last_change":"2024-09-19T06:10:02.514951+0000","last_active":"2024-09-19T06:12:22.798429+0000","last_peered":"2024-09-19T06:12:22.798429+0000","last_clean":"2024-09-19T06:12:22.798429+0000","last_became_active":"2024-09-19T06:10:02.514632+0000","last_became_peered":"2024-09-19T06:10:02.514632+0000","last_unstale":"2024-09-19T06:12:22.798429+0000","last_undegraded":"2024-09-19T06:12:22.798429+0000","last_fullsized":"2024-09-19T06:12:22.798429+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:58.225253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523613+0000","last_change":"2024-09-19T06:09:59.496203+0000","last_active":"2024-09-19T06:12:22.523613+0000","last_peered":"2024-09-19T06:12:22.523613+0000","last_clean":"2024-09-19T06:12:22.523613+0000","last_became_active":"2024-09-19T06:09:59.495854+0000","last_became_peered":"2024-09-19T06:09:59.495854+0000","last_unstale":"2024-09-19T06:12:22.523613+0000","last_undegraded":"2024-09-19T06:12:22.523613+0000","last_fullsized":"2024-09-19T06:12:22.523613+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:43.388624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.522910+0000","last_change":"2024-09-19T06:10:02.521713+0000","last_active":"2024-09-19T06:12:22.522910+0000","last_peered":"2024-09-19T06:12:22.522910+0000","last_clean":"2024-09-19T06:12:22.522910+0000","last_became_active":"2024-09-19T06:10:02.521389+0000","last_became_peered":"2024-09-19T06:10:02.521389+0000","last_unstale":"2024-09-19T06:12:22.522910+0000","last_undegraded":"2024-09-19T06:12:22.522910+0000","last_fullsized":"2024-09-19T06:12:22.522910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:34.441627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759827+0000","last_change":"2024-09-19T06:09:59.492636+0000","last_active":"2024-09-19T06:12:22.759827+0000","last_peered":"2024-09-19T06:12:22.759827+0000","last_clean":"2024-09-19T06:12:22.759827+0000","last_became_active":"2024-09-19T06:09:59.491801+0000","last_became_peered":"2024-09-19T06:09:59.491801+0000","last_unstale":"2024-09-19T06:12:22.759827+0000","last_undegraded":"2024-09-19T06:12:22.759827+0000","last_fullsized":"2024-09-19T06:12:22.759827+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:27.911582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.524299+0000","last_change":"2024-09-19T06:10:02.527073+0000","last_active":"2024-09-19T06:12:22.524299+0000","last_peered":"2024-09-19T06:12:22.524299+0000","last_clean":"2024-09-19T06:12:22.524299+0000","last_became_active":"2024-09-19T06:10:02.525847+0000","last_became_peered":"2024-09-19T06:10:02.525847+0000","last_unstale":"2024-09-19T06:12:22.524299+0000","last_undegraded":"2024-09-19T06:12:22.524299+0000","last_fullsized":"2024-09-19T06:12:22.524299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:22.717353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798512+0000","last_change":"2024-09-19T06:09:59.493905+0000","last_active":"2024-09-19T06:12:22.798512+0000","last_peered":"2024-09-19T06:12:22.798512+0000","last_clean":"2024-09-19T06:12:22.798512+0000","last_became_active":"2024-09-19T06:09:59.493517+0000","last_became_peered":"2024-09-19T06:09:59.493517+0000","last_unstale":"2024-09-19T06:12:22.798512+0000","last_undegraded":"2024-09-19T06:12:22.798512+0000","last_fullsized":"2024-09-19T06:12:22.798512+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:22.959756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417840+0000","last_change":"2024-09-19T06:10:02.518002+0000","last_active":"2024-09-19T06:12:22.417840+0000","last_peered":"2024-09-19T06:12:22.417840+0000","last_clean":"2024-09-19T06:12:22.417840+0000","last_became_active":"2024-09-19T06:10:02.517492+0000","last_became_peered":"2024-09-19T06:10:02.517492+0000","last_unstale":"2024-09-19T06:12:22.417840+0000","last_undegraded":"2024-09-19T06:12:22.417840+0000","last_fullsized":"2024-09-19T06:12:22.417840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:58.935232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.536205+0000","last_change":"2024-09-19T06:10:31.951506+0000","last_active":"2024-09-19T06:12:22.536205+0000","last_peered":"2024-09-19T06:12:22.536205+0000","last_clean":"2024-09-19T06:12:22.536205+0000","last_became_active":"2024-09-19T06:10:31.951079+0000","last_became_peered":"2024-09-19T06:10:31.951079+0000","last_unstale":"2024-09-19T06:12:22.536205+0000","last_undegraded":"2024-09-19T06:12:22.536205+0000","last_fullsized":"2024-09-19T06:12:22.536205+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:53.978445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798709+0000","last_change":"2024-09-19T06:09:59.496546+0000","last_active":"2024-09-19T06:12:22.798709+0000","last_peered":"2024-09-19T06:12:22.798709+0000","last_clean":"2024-09-19T06:12:22.798709+0000","last_became_active":"2024-09-19T06:09:59.496195+0000","last_became_peered":"2024-09-19T06:09:59.496195+0000","last_unstale":"2024-09-19T06:12:22.798709+0000","last_undegraded":"2024-09-19T06:12:22.798709+0000","last_fullsized":"2024-09-19T06:12:22.798709+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:58.443134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.769448+0000","last_change":"2024-09-19T06:10:02.522270+0000","last_active":"2024-09-19T06:12:22.769448+0000","last_peered":"2024-09-19T06:12:22.769448+0000","last_clean":"2024-09-19T06:12:22.769448+0000","last_became_active":"2024-09-19T06:10:02.517109+0000","last_became_peered":"2024-09-19T06:10:02.517109+0000","last_unstale":"2024-09-19T06:12:22.769448+0000","last_undegraded":"2024-09-19T06:12:22.769448+0000","last_fullsized":"2024-09-19T06:12:22.769448+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:56.967980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798805+0000","last_change":"2024-09-19T06:09:59.494016+0000","last_active":"2024-09-19T06:12:22.798805+0000","last_peered":"2024-09-19T06:12:22.798805+0000","last_clean":"2024-09-19T06:12:22.798805+0000","last_became_active":"2024-09-19T06:09:59.493525+0000","last_became_peered":"2024-09-19T06:09:59.493525+0000","last_unstale":"2024-09-19T06:12:22.798805+0000","last_undegraded":"2024-09-19T06:12:22.798805+0000","last_fullsized":"2024-09-19T06:12:22.798805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:06.650633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417554+0000","last_change":"2024-09-19T06:10:02.531329+0000","last_active":"2024-09-19T06:12:22.417554+0000","last_peered":"2024-09-19T06:12:22.417554+0000","last_clean":"2024-09-19T06:12:22.417554+0000","last_became_active":"2024-09-19T06:10:02.527107+0000","last_became_peered":"2024-09-19T06:10:02.527107+0000","last_unstale":"2024-09-19T06:12:22.417554+0000","last_undegraded":"2024-09-19T06:12:22.417554+0000","last_fullsized":"2024-09-19T06:12:22.417554+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:25.891416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.524291+0000","last_change":"2024-09-19T06:09:59.774966+0000","last_active":"2024-09-19T06:12:22.524291+0000","last_peered":"2024-09-19T06:12:22.524291+0000","last_clean":"2024-09-19T06:12:22.524291+0000","last_became_active":"2024-09-19T06:09:59.774038+0000","last_became_peered":"2024-09-19T06:09:59.774038+0000","last_unstale":"2024-09-19T06:12:22.524291+0000","last_undegraded":"2024-09-19T06:12:22.524291+0000","last_fullsized":"2024-09-19T06:12:22.524291+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:54.703512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.416493+0000","last_change":"2024-09-19T06:10:31.824217+0000","last_active":"2024-09-19T06:12:22.416493+0000","last_peered":"2024-09-19T06:12:22.416493+0000","last_clean":"2024-09-19T06:12:22.416493+0000","last_became_active":"2024-09-19T06:10:31.823867+0000","last_became_peered":"2024-09-19T06:10:31.823867+0000","last_unstale":"2024-09-19T06:12:22.416493+0000","last_undegraded":"2024-09-19T06:12:22.416493+0000","last_fullsized":"2024-09-19T06:12:22.416493+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:53.261746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"89'15","reported_seq":191,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.771460+0000","last_change":"2024-09-19T06:10:31.962041+0000","last_active":"2024-09-19T06:12:22.771460+0000","last_peered":"2024-09-19T06:12:22.771460+0000","last_clean":"2024-09-19T06:12:22.771460+0000","last_became_active":"2024-09-19T06:10:31.952142+0000","last_became_peered":"2024-09-19T06:10:31.952142+0000","last_unstale":"2024-09-19T06:12:22.771460+0000","last_undegraded":"2024-09-19T06:12:22.771460+0000","last_fullsized":"2024-09-19T06:12:22.771460+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:30.304256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":601065,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1368,"num_read_kb":810,"num_write":378,"num_write_kb":1468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2857,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":724992,"data_stored":1803195,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":305,"ondisk_log_size":305,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107700,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449129,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1007616,"data_stored":872326,"data_compressed":27816,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678063,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28160,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716992,"statfs":{"total":95995035648,"available":95966199808,"internally_reserved":0,"allocated":1159168,"data_stored":1265969,"data_compressed":50726,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841587,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1024000,"data_stored":869610,"data_compressed":27818,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103227,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":987136,"data_stored":476100,"data_compressed":8670,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332160,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1048576,"data_stored":1071539,"data_compressed":44570,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495685,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":983040,"data_stored":477038,"data_compressed":8670,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757323,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1073152,"data_stored":1199555,"data_compressed":50726,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920848,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":468468,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149781,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":466951,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411421,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1064960,"data_stored":543877,"data_compressed":8670,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":529569,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738470,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1003520,"data_stored":478154,"data_compressed":8670,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":69834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":525246,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":133798,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":200212,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":397054,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:12:27.684 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-19T06:12:27.684 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T06:12:27.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.894+0000 7fc4efe00640 1 -- 172.21.15.3:0/3135190606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4f0076230 msgr2=0x7fc4f0074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:27.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.894+0000 7fc4efe00640 1 --2- 172.21.15.3:0/3135190606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4f0076230 0x7fc4f0074680 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0009900 tx=0x7fc4e002a3f0 comp rx=0 tx=0).stop 2024-09-19T06:12:27.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.894+0000 7fc4efe00640 1 -- 172.21.15.3:0/3135190606 shutdown_connections 2024-09-19T06:12:27.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.894+0000 7fc4efe00640 1 --2- 172.21.15.3:0/3135190606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4f010dff0 0x7fc4f01103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:27.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.894+0000 7fc4efe00640 1 --2- 172.21.15.3:0/3135190606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4f0074c50 0x7fc4f00750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:27.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.894+0000 7fc4efe00640 1 --2- 172.21.15.3:0/3135190606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4f0076230 0x7fc4f0074680 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:27.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.894+0000 7fc4efe00640 1 -- 172.21.15.3:0/3135190606 >> 172.21.15.3:0/3135190606 conn(0x7fc4f00fd180 msgr2=0x7fc4f00ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:27.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.894+0000 7fc4efe00640 1 -- 172.21.15.3:0/3135190606 shutdown_connections 2024-09-19T06:12:27.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.894+0000 7fc4efe00640 1 -- 172.21.15.3:0/3135190606 wait complete. 2024-09-19T06:12:27.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.895+0000 7fc4efe00640 1 Processor -- start 2024-09-19T06:12:27.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.895+0000 7fc4efe00640 1 -- start start 2024-09-19T06:12:27.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.896+0000 7fc4efe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4f0074c50 0x7fc4f019e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:27.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.896+0000 7fc4efe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4f0076230 0x7fc4f019e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:27.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.896+0000 7fc4efe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4f010dff0 0x7fc4f01a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:27.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.896+0000 7fc4efe00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f0113d00 con 0x7fc4f010dff0 2024-09-19T06:12:27.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.896+0000 7fc4efe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f0113b80 con 0x7fc4f0076230 2024-09-19T06:12:27.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.896+0000 7fc4efe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc4f0113e80 con 0x7fc4f0074c50 2024-09-19T06:12:27.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.896+0000 7fc4eea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4f0074c50 0x7fc4f019e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:27.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.896+0000 7fc4ee000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4f0076230 0x7fc4f019e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:27.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.896+0000 7fc4eea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4f0074c50 0x7fc4f019e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:51702/0 (socket says 172.21.15.3:51702) 2024-09-19T06:12:27.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.896+0000 7fc4eea00640 1 -- 172.21.15.3:0/2028575122 learned_addr learned my addr 172.21.15.3:0/2028575122 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:27.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.896+0000 7fc4ef400640 1 --2- 172.21.15.3:0/2028575122 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4f010dff0 0x7fc4f01a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:27.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.896+0000 7fc4eea00640 1 -- 172.21.15.3:0/2028575122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4f0076230 msgr2=0x7fc4f019e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:27.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.896+0000 7fc4eea00640 1 --2- 172.21.15.3:0/2028575122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4f0076230 0x7fc4f019e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:27.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.897+0000 7fc4eea00640 1 -- 172.21.15.3:0/2028575122 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4f010dff0 msgr2=0x7fc4f01a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:27.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.897+0000 7fc4eea00640 1 --2- 172.21.15.3:0/2028575122 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4f010dff0 0x7fc4f01a5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:27.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.897+0000 7fc4eea00640 1 -- 172.21.15.3:0/2028575122 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4f01a5f00 con 0x7fc4f0074c50 2024-09-19T06:12:27.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.897+0000 7fc4eea00640 1 --2- 172.21.15.3:0/2028575122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4f0074c50 0x7fc4f019e2e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0031440 tx=0x7fc4e0032ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:27.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.897+0000 7fc4e7400640 1 -- 172.21.15.3:0/2028575122 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e003f030 con 0x7fc4f0074c50 2024-09-19T06:12:27.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.897+0000 7fc4e7400640 1 -- 172.21.15.3:0/2028575122 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4e0003ce0 con 0x7fc4f0074c50 2024-09-19T06:12:27.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.897+0000 7fc4efe00640 1 -- 172.21.15.3:0/2028575122 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4f01a6190 con 0x7fc4f0074c50 2024-09-19T06:12:27.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.897+0000 7fc4e7400640 1 -- 172.21.15.3:0/2028575122 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0035070 con 0x7fc4f0074c50 2024-09-19T06:12:27.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.897+0000 7fc4efe00640 1 -- 172.21.15.3:0/2028575122 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4f01a6680 con 0x7fc4f0074c50 2024-09-19T06:12:27.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.899+0000 7fc4efe00640 1 -- 172.21.15.3:0/2028575122 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4f01040a0 con 0x7fc4f0074c50 2024-09-19T06:12:27.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.900+0000 7fc4e7400640 1 -- 172.21.15.3:0/2028575122 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 138530+0+0 (secure 0 0 0) 0x7fc4e0042030 con 0x7fc4f0074c50 2024-09-19T06:12:27.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.901+0000 7fc4e7400640 1 --2- 172.21.15.3:0/2028575122 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc4d40a3440 0x7fc4d40a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:27.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.902+0000 7fc4e7400640 1 -- 172.21.15.3:0/2028575122 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fc4e00effe0 con 0x7fc4f0074c50 2024-09-19T06:12:27.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.902+0000 7fc4ee000640 1 --2- 172.21.15.3:0/2028575122 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc4d40a3440 0x7fc4d40a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:27.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.903+0000 7fc4ee000640 1 --2- 172.21.15.3:0/2028575122 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc4d40a3440 0x7fc4d40a5900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc4f019f7f0 tx=0x7fc4dc005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:27.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:27.905+0000 7fc4e7400640 1 -- 172.21.15.3:0/2028575122 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc4e00bc200 con 0x7fc4f0074c50 2024-09-19T06:12:28.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:27 smithi003 ceph-mon[30893]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:28.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:27 smithi003 ceph-mon[30893]: from='client.25249 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:12:28.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:27 smithi003 ceph-mon[30893]: mgrmap e25: x(active, since 5s), standbys: y, z 2024-09-19T06:12:28.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:27 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:28.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:27 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:28.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:27 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:28.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:27 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:28.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:27 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:28.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:27 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:28.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:27 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:28.086 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:27 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:28.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:28.093+0000 7fc4efe00640 1 -- 172.21.15.3:0/2028575122 --> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc4f0062630 con 0x7fc4d40a3440 2024-09-19T06:12:28.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:28.105+0000 7fc4e7400640 1 -- 172.21.15.3:0/2028575122 <== mgr.15126 v2:172.21.15.3:6800/3015970538 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258094 (secure 0 0 0) 0x7fc4f0062630 con 0x7fc4d40a3440 2024-09-19T06:12:28.111 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:12:28.113 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-19T06:12:28.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:28.110+0000 7fc4efe00640 1 -- 172.21.15.3:0/2028575122 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc4d40a3440 msgr2=0x7fc4d40a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:28.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:28.110+0000 7fc4efe00640 1 --2- 172.21.15.3:0/2028575122 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc4d40a3440 0x7fc4d40a5900 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc4f019f7f0 tx=0x7fc4dc005f90 comp rx=0 tx=0).stop 2024-09-19T06:12:28.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:28.110+0000 7fc4efe00640 1 -- 172.21.15.3:0/2028575122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4f0074c50 msgr2=0x7fc4f019e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:28.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:28.110+0000 7fc4efe00640 1 --2- 172.21.15.3:0/2028575122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4f0074c50 0x7fc4f019e2e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0031440 tx=0x7fc4e0032ce0 comp rx=0 tx=0).stop 2024-09-19T06:12:28.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:28.110+0000 7fc4efe00640 1 -- 172.21.15.3:0/2028575122 shutdown_connections 2024-09-19T06:12:28.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:28.111+0000 7fc4efe00640 1 --2- 172.21.15.3:0/2028575122 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc4d40a3440 0x7fc4d40a5900 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:28.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:28.111+0000 7fc4efe00640 1 --2- 172.21.15.3:0/2028575122 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc4f010dff0 0x7fc4f01a5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:28.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:28.111+0000 7fc4efe00640 1 --2- 172.21.15.3:0/2028575122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4f0076230 0x7fc4f019e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:28.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:28.111+0000 7fc4efe00640 1 --2- 172.21.15.3:0/2028575122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc4f0074c50 0x7fc4f019e2e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:28.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:28.111+0000 7fc4efe00640 1 -- 172.21.15.3:0/2028575122 >> 172.21.15.3:0/2028575122 conn(0x7fc4f00fd180 msgr2=0x7fc4f0101270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:28.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:28.111+0000 7fc4efe00640 1 -- 172.21.15.3:0/2028575122 shutdown_connections 2024-09-19T06:12:28.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:28.111+0000 7fc4efe00640 1 -- 172.21.15.3:0/2028575122 wait complete. 2024-09-19T06:12:28.130 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-19T06:12:26.431109+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1191667,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1504,"num_read_kb":929,"num_write":561,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":1183593,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":944,"ondisk_log_size":944,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365520,"kb_used_data":12068,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576304,"statfs":{"total":1151940427776,"available":1151566135296,"internally_reserved":0,"allocated":12357632,"data_stored":8719156,"data_compressed":253649,"data_compressed_allocated":335872,"data_compressed_original":3072000,"omap_allocated":19140,"internal_metadata":361674044},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.978979"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523130+0000","last_change":"2024-09-19T06:10:02.531329+0000","last_active":"2024-09-19T06:12:22.523130+0000","last_peered":"2024-09-19T06:12:22.523130+0000","last_clean":"2024-09-19T06:12:22.523130+0000","last_became_active":"2024-09-19T06:10:02.530997+0000","last_became_peered":"2024-09-19T06:10:02.530997+0000","last_unstale":"2024-09-19T06:12:22.523130+0000","last_undegraded":"2024-09-19T06:12:22.523130+0000","last_fullsized":"2024-09-19T06:12:22.523130+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:15.240495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417846+0000","last_change":"2024-09-19T06:10:02.526083+0000","last_active":"2024-09-19T06:12:22.417846+0000","last_peered":"2024-09-19T06:12:22.417846+0000","last_clean":"2024-09-19T06:12:22.417846+0000","last_became_active":"2024-09-19T06:10:02.522889+0000","last_became_peered":"2024-09-19T06:10:02.522889+0000","last_unstale":"2024-09-19T06:12:22.417846+0000","last_undegraded":"2024-09-19T06:12:22.417846+0000","last_fullsized":"2024-09-19T06:12:22.417846+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:19.735866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417392+0000","last_change":"2024-09-19T06:10:02.531779+0000","last_active":"2024-09-19T06:12:22.417392+0000","last_peered":"2024-09-19T06:12:22.417392+0000","last_clean":"2024-09-19T06:12:22.417392+0000","last_became_active":"2024-09-19T06:10:02.526795+0000","last_became_peered":"2024-09-19T06:10:02.526795+0000","last_unstale":"2024-09-19T06:12:22.417392+0000","last_undegraded":"2024-09-19T06:12:22.417392+0000","last_fullsized":"2024-09-19T06:12:22.417392+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:28.800773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759797+0000","last_change":"2024-09-19T06:10:02.518697+0000","last_active":"2024-09-19T06:12:22.759797+0000","last_peered":"2024-09-19T06:12:22.759797+0000","last_clean":"2024-09-19T06:12:22.759797+0000","last_became_active":"2024-09-19T06:10:02.518114+0000","last_became_peered":"2024-09-19T06:10:02.518114+0000","last_unstale":"2024-09-19T06:12:22.759797+0000","last_undegraded":"2024-09-19T06:12:22.759797+0000","last_fullsized":"2024-09-19T06:12:22.759797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:55:08.172638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798502+0000","last_change":"2024-09-19T06:10:02.520450+0000","last_active":"2024-09-19T06:12:22.798502+0000","last_peered":"2024-09-19T06:12:22.798502+0000","last_clean":"2024-09-19T06:12:22.798502+0000","last_became_active":"2024-09-19T06:10:02.519079+0000","last_became_peered":"2024-09-19T06:10:02.519079+0000","last_unstale":"2024-09-19T06:12:22.798502+0000","last_undegraded":"2024-09-19T06:12:22.798502+0000","last_fullsized":"2024-09-19T06:12:22.798502+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:47.502020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.539627+0000","last_change":"2024-09-19T06:10:02.518567+0000","last_active":"2024-09-19T06:12:22.539627+0000","last_peered":"2024-09-19T06:12:22.539627+0000","last_clean":"2024-09-19T06:12:22.539627+0000","last_became_active":"2024-09-19T06:10:02.517568+0000","last_became_peered":"2024-09-19T06:10:02.517568+0000","last_unstale":"2024-09-19T06:12:22.539627+0000","last_undegraded":"2024-09-19T06:12:22.539627+0000","last_fullsized":"2024-09-19T06:12:22.539627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:07:10.245189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417732+0000","last_change":"2024-09-19T06:10:02.521844+0000","last_active":"2024-09-19T06:12:22.417732+0000","last_peered":"2024-09-19T06:12:22.417732+0000","last_clean":"2024-09-19T06:12:22.417732+0000","last_became_active":"2024-09-19T06:10:02.521522+0000","last_became_peered":"2024-09-19T06:10:02.521522+0000","last_unstale":"2024-09-19T06:12:22.417732+0000","last_undegraded":"2024-09-19T06:12:22.417732+0000","last_fullsized":"2024-09-19T06:12:22.417732+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:46.166077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523672+0000","last_change":"2024-09-19T06:10:02.526977+0000","last_active":"2024-09-19T06:12:22.523672+0000","last_peered":"2024-09-19T06:12:22.523672+0000","last_clean":"2024-09-19T06:12:22.523672+0000","last_became_active":"2024-09-19T06:10:02.526036+0000","last_became_peered":"2024-09-19T06:10:02.526036+0000","last_unstale":"2024-09-19T06:12:22.523672+0000","last_undegraded":"2024-09-19T06:12:22.523672+0000","last_fullsized":"2024-09-19T06:12:22.523672+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:43:28.587020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.769658+0000","last_change":"2024-09-19T06:10:02.524721+0000","last_active":"2024-09-19T06:12:22.769658+0000","last_peered":"2024-09-19T06:12:22.769658+0000","last_clean":"2024-09-19T06:12:22.769658+0000","last_became_active":"2024-09-19T06:10:02.523871+0000","last_became_peered":"2024-09-19T06:10:02.523871+0000","last_unstale":"2024-09-19T06:12:22.769658+0000","last_undegraded":"2024-09-19T06:12:22.769658+0000","last_fullsized":"2024-09-19T06:12:22.769658+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:31.324530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.540176+0000","last_change":"2024-09-19T06:10:02.518494+0000","last_active":"2024-09-19T06:12:22.540176+0000","last_peered":"2024-09-19T06:12:22.540176+0000","last_clean":"2024-09-19T06:12:22.540176+0000","last_became_active":"2024-09-19T06:10:02.518140+0000","last_became_peered":"2024-09-19T06:10:02.518140+0000","last_unstale":"2024-09-19T06:12:22.540176+0000","last_undegraded":"2024-09-19T06:12:22.540176+0000","last_fullsized":"2024-09-19T06:12:22.540176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:42.695222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.418287+0000","last_change":"2024-09-19T06:10:02.524697+0000","last_active":"2024-09-19T06:12:22.418287+0000","last_peered":"2024-09-19T06:12:22.418287+0000","last_clean":"2024-09-19T06:12:22.418287+0000","last_became_active":"2024-09-19T06:10:02.524094+0000","last_became_peered":"2024-09-19T06:10:02.524094+0000","last_unstale":"2024-09-19T06:12:22.418287+0000","last_undegraded":"2024-09-19T06:12:22.418287+0000","last_fullsized":"2024-09-19T06:12:22.418287+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:12.591847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759946+0000","last_change":"2024-09-19T06:10:02.515878+0000","last_active":"2024-09-19T06:12:22.759946+0000","last_peered":"2024-09-19T06:12:22.759946+0000","last_clean":"2024-09-19T06:12:22.759946+0000","last_became_active":"2024-09-19T06:10:02.515456+0000","last_became_peered":"2024-09-19T06:10:02.515456+0000","last_unstale":"2024-09-19T06:12:22.759946+0000","last_undegraded":"2024-09-19T06:12:22.759946+0000","last_fullsized":"2024-09-19T06:12:22.759946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:58.687431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.760533+0000","last_change":"2024-09-19T06:10:31.824936+0000","last_active":"2024-09-19T06:12:22.760533+0000","last_peered":"2024-09-19T06:12:22.760533+0000","last_clean":"2024-09-19T06:12:22.760533+0000","last_became_active":"2024-09-19T06:10:31.824611+0000","last_became_peered":"2024-09-19T06:10:31.824611+0000","last_unstale":"2024-09-19T06:12:22.760533+0000","last_undegraded":"2024-09-19T06:12:22.760533+0000","last_fullsized":"2024-09-19T06:12:22.760533+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:36.397693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417277+0000","last_change":"2024-09-19T06:10:02.513397+0000","last_active":"2024-09-19T06:12:22.417277+0000","last_peered":"2024-09-19T06:12:22.417277+0000","last_clean":"2024-09-19T06:12:22.417277+0000","last_became_active":"2024-09-19T06:10:02.513011+0000","last_became_peered":"2024-09-19T06:10:02.513011+0000","last_unstale":"2024-09-19T06:12:22.417277+0000","last_undegraded":"2024-09-19T06:12:22.417277+0000","last_fullsized":"2024-09-19T06:12:22.417277+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:06:03.509401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417240+0000","last_change":"2024-09-19T06:10:02.521623+0000","last_active":"2024-09-19T06:12:22.417240+0000","last_peered":"2024-09-19T06:12:22.417240+0000","last_clean":"2024-09-19T06:12:22.417240+0000","last_became_active":"2024-09-19T06:10:02.519371+0000","last_became_peered":"2024-09-19T06:10:02.519371+0000","last_unstale":"2024-09-19T06:12:22.417240+0000","last_undegraded":"2024-09-19T06:12:22.417240+0000","last_fullsized":"2024-09-19T06:12:22.417240+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:10.687026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.768975+0000","last_change":"2024-09-19T06:10:02.520865+0000","last_active":"2024-09-19T06:12:22.768975+0000","last_peered":"2024-09-19T06:12:22.768975+0000","last_clean":"2024-09-19T06:12:22.768975+0000","last_became_active":"2024-09-19T06:10:02.519683+0000","last_became_peered":"2024-09-19T06:10:02.519683+0000","last_unstale":"2024-09-19T06:12:22.768975+0000","last_undegraded":"2024-09-19T06:12:22.768975+0000","last_fullsized":"2024-09-19T06:12:22.768975+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:40.320474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523207+0000","last_change":"2024-09-19T06:10:02.531552+0000","last_active":"2024-09-19T06:12:22.523207+0000","last_peered":"2024-09-19T06:12:22.523207+0000","last_clean":"2024-09-19T06:12:22.523207+0000","last_became_active":"2024-09-19T06:10:02.531081+0000","last_became_peered":"2024-09-19T06:10:02.531081+0000","last_unstale":"2024-09-19T06:12:22.523207+0000","last_undegraded":"2024-09-19T06:12:22.523207+0000","last_fullsized":"2024-09-19T06:12:22.523207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:07.835754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.416671+0000","last_change":"2024-09-19T06:10:02.509088+0000","last_active":"2024-09-19T06:12:22.416671+0000","last_peered":"2024-09-19T06:12:22.416671+0000","last_clean":"2024-09-19T06:12:22.416671+0000","last_became_active":"2024-09-19T06:10:02.508752+0000","last_became_peered":"2024-09-19T06:10:02.508752+0000","last_unstale":"2024-09-19T06:12:22.416671+0000","last_undegraded":"2024-09-19T06:12:22.416671+0000","last_fullsized":"2024-09-19T06:12:22.416671+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:36.832952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.760233+0000","last_change":"2024-09-19T06:10:02.534694+0000","last_active":"2024-09-19T06:12:22.760233+0000","last_peered":"2024-09-19T06:12:22.760233+0000","last_clean":"2024-09-19T06:12:22.760233+0000","last_became_active":"2024-09-19T06:10:02.534384+0000","last_became_peered":"2024-09-19T06:10:02.534384+0000","last_unstale":"2024-09-19T06:12:22.760233+0000","last_undegraded":"2024-09-19T06:12:22.760233+0000","last_fullsized":"2024-09-19T06:12:22.760233+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:48.006128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.522896+0000","last_change":"2024-09-19T06:10:02.521104+0000","last_active":"2024-09-19T06:12:22.522896+0000","last_peered":"2024-09-19T06:12:22.522896+0000","last_clean":"2024-09-19T06:12:22.522896+0000","last_became_active":"2024-09-19T06:10:02.520755+0000","last_became_peered":"2024-09-19T06:10:02.520755+0000","last_unstale":"2024-09-19T06:12:22.522896+0000","last_undegraded":"2024-09-19T06:12:22.522896+0000","last_fullsized":"2024-09-19T06:12:22.522896+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:46.091297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.760733+0000","last_change":"2024-09-19T06:10:02.522048+0000","last_active":"2024-09-19T06:12:22.760733+0000","last_peered":"2024-09-19T06:12:22.760733+0000","last_clean":"2024-09-19T06:12:22.760733+0000","last_became_active":"2024-09-19T06:10:02.521750+0000","last_became_peered":"2024-09-19T06:10:02.521750+0000","last_unstale":"2024-09-19T06:12:22.760733+0000","last_undegraded":"2024-09-19T06:12:22.760733+0000","last_fullsized":"2024-09-19T06:12:22.760733+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:07.780609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.769195+0000","last_change":"2024-09-19T06:10:02.527386+0000","last_active":"2024-09-19T06:12:22.769195+0000","last_peered":"2024-09-19T06:12:22.769195+0000","last_clean":"2024-09-19T06:12:22.769195+0000","last_became_active":"2024-09-19T06:10:02.526804+0000","last_became_peered":"2024-09-19T06:10:02.526804+0000","last_unstale":"2024-09-19T06:12:22.769195+0000","last_undegraded":"2024-09-19T06:12:22.769195+0000","last_fullsized":"2024-09-19T06:12:22.769195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:15.652068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523556+0000","last_change":"2024-09-19T06:10:02.528521+0000","last_active":"2024-09-19T06:12:22.523556+0000","last_peered":"2024-09-19T06:12:22.523556+0000","last_clean":"2024-09-19T06:12:22.523556+0000","last_became_active":"2024-09-19T06:10:02.528087+0000","last_became_peered":"2024-09-19T06:10:02.528087+0000","last_unstale":"2024-09-19T06:12:22.523556+0000","last_undegraded":"2024-09-19T06:12:22.523556+0000","last_fullsized":"2024-09-19T06:12:22.523556+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:29.176129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.536015+0000","last_change":"2024-09-19T06:10:02.518544+0000","last_active":"2024-09-19T06:12:22.536015+0000","last_peered":"2024-09-19T06:12:22.536015+0000","last_clean":"2024-09-19T06:12:22.536015+0000","last_became_active":"2024-09-19T06:10:02.518230+0000","last_became_peered":"2024-09-19T06:10:02.518230+0000","last_unstale":"2024-09-19T06:12:22.536015+0000","last_undegraded":"2024-09-19T06:12:22.536015+0000","last_fullsized":"2024-09-19T06:12:22.536015+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:26:32.116211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.524066+0000","last_change":"2024-09-19T06:10:02.531859+0000","last_active":"2024-09-19T06:12:22.524066+0000","last_peered":"2024-09-19T06:12:22.524066+0000","last_clean":"2024-09-19T06:12:22.524066+0000","last_became_active":"2024-09-19T06:10:02.531572+0000","last_became_peered":"2024-09-19T06:10:02.531572+0000","last_unstale":"2024-09-19T06:12:22.524066+0000","last_undegraded":"2024-09-19T06:12:22.524066+0000","last_fullsized":"2024-09-19T06:12:22.524066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:24:34.314977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.760242+0000","last_change":"2024-09-19T06:10:02.521292+0000","last_active":"2024-09-19T06:12:22.760242+0000","last_peered":"2024-09-19T06:12:22.760242+0000","last_clean":"2024-09-19T06:12:22.760242+0000","last_became_active":"2024-09-19T06:10:02.520967+0000","last_became_peered":"2024-09-19T06:10:02.520967+0000","last_unstale":"2024-09-19T06:12:22.760242+0000","last_undegraded":"2024-09-19T06:12:22.760242+0000","last_fullsized":"2024-09-19T06:12:22.760242+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:11.318504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523032+0000","last_change":"2024-09-19T06:10:02.521514+0000","last_active":"2024-09-19T06:12:22.523032+0000","last_peered":"2024-09-19T06:12:22.523032+0000","last_clean":"2024-09-19T06:12:22.523032+0000","last_became_active":"2024-09-19T06:10:02.521203+0000","last_became_peered":"2024-09-19T06:10:02.521203+0000","last_unstale":"2024-09-19T06:12:22.523032+0000","last_undegraded":"2024-09-19T06:12:22.523032+0000","last_fullsized":"2024-09-19T06:12:22.523032+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:53.689067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759912+0000","last_change":"2024-09-19T06:10:31.824501+0000","last_active":"2024-09-19T06:12:22.759912+0000","last_peered":"2024-09-19T06:12:22.759912+0000","last_clean":"2024-09-19T06:12:22.759912+0000","last_became_active":"2024-09-19T06:10:31.824161+0000","last_became_peered":"2024-09-19T06:10:31.824161+0000","last_unstale":"2024-09-19T06:12:22.759912+0000","last_undegraded":"2024-09-19T06:12:22.759912+0000","last_fullsized":"2024-09-19T06:12:22.759912+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:28.203581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417661+0000","last_change":"2024-09-19T06:10:02.530351+0000","last_active":"2024-09-19T06:12:22.417661+0000","last_peered":"2024-09-19T06:12:22.417661+0000","last_clean":"2024-09-19T06:12:22.417661+0000","last_became_active":"2024-09-19T06:10:02.529292+0000","last_became_peered":"2024-09-19T06:10:02.529292+0000","last_unstale":"2024-09-19T06:12:22.417661+0000","last_undegraded":"2024-09-19T06:12:22.417661+0000","last_fullsized":"2024-09-19T06:12:22.417661+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:02.324413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759801+0000","last_change":"2024-09-19T06:10:02.534885+0000","last_active":"2024-09-19T06:12:22.759801+0000","last_peered":"2024-09-19T06:12:22.759801+0000","last_clean":"2024-09-19T06:12:22.759801+0000","last_became_active":"2024-09-19T06:10:02.534520+0000","last_became_peered":"2024-09-19T06:10:02.534520+0000","last_unstale":"2024-09-19T06:12:22.759801+0000","last_undegraded":"2024-09-19T06:12:22.759801+0000","last_fullsized":"2024-09-19T06:12:22.759801+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:04.896787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759826+0000","last_change":"2024-09-19T06:10:02.518120+0000","last_active":"2024-09-19T06:12:22.759826+0000","last_peered":"2024-09-19T06:12:22.759826+0000","last_clean":"2024-09-19T06:12:22.759826+0000","last_became_active":"2024-09-19T06:10:02.517595+0000","last_became_peered":"2024-09-19T06:10:02.517595+0000","last_unstale":"2024-09-19T06:12:22.759826+0000","last_undegraded":"2024-09-19T06:12:22.759826+0000","last_fullsized":"2024-09-19T06:12:22.759826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:00.695783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.522797+0000","last_change":"2024-09-19T06:10:02.524413+0000","last_active":"2024-09-19T06:12:22.522797+0000","last_peered":"2024-09-19T06:12:22.522797+0000","last_clean":"2024-09-19T06:12:22.522797+0000","last_became_active":"2024-09-19T06:10:02.523559+0000","last_became_peered":"2024-09-19T06:10:02.523559+0000","last_unstale":"2024-09-19T06:12:22.522797+0000","last_undegraded":"2024-09-19T06:12:22.522797+0000","last_fullsized":"2024-09-19T06:12:22.522797+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:04.045759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798454+0000","last_change":"2024-09-19T06:10:02.514572+0000","last_active":"2024-09-19T06:12:22.798454+0000","last_peered":"2024-09-19T06:12:22.798454+0000","last_clean":"2024-09-19T06:12:22.798454+0000","last_became_active":"2024-09-19T06:10:02.513685+0000","last_became_peered":"2024-09-19T06:10:02.513685+0000","last_unstale":"2024-09-19T06:12:22.798454+0000","last_undegraded":"2024-09-19T06:12:22.798454+0000","last_fullsized":"2024-09-19T06:12:22.798454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:09.108036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"89'9","reported_seq":136,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.982038+0000","last_change":"2024-09-19T06:10:31.829554+0000","last_active":"2024-09-19T06:12:22.982038+0000","last_peered":"2024-09-19T06:12:22.982038+0000","last_clean":"2024-09-19T06:12:22.982038+0000","last_became_active":"2024-09-19T06:10:31.824266+0000","last_became_peered":"2024-09-19T06:10:31.824266+0000","last_unstale":"2024-09-19T06:12:22.982038+0000","last_undegraded":"2024-09-19T06:12:22.982038+0000","last_fullsized":"2024-09-19T06:12:22.982038+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:07.241897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1942,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":2,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1015,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.536116+0000","last_change":"2024-09-19T06:10:02.524271+0000","last_active":"2024-09-19T06:12:22.536116+0000","last_peered":"2024-09-19T06:12:22.536116+0000","last_clean":"2024-09-19T06:12:22.536116+0000","last_became_active":"2024-09-19T06:10:02.523948+0000","last_became_peered":"2024-09-19T06:10:02.523948+0000","last_unstale":"2024-09-19T06:12:22.536116+0000","last_undegraded":"2024-09-19T06:12:22.536116+0000","last_fullsized":"2024-09-19T06:12:22.536116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:46.406652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.539711+0000","last_change":"2024-09-19T06:09:59.493186+0000","last_active":"2024-09-19T06:12:22.539711+0000","last_peered":"2024-09-19T06:12:22.539711+0000","last_clean":"2024-09-19T06:12:22.539711+0000","last_became_active":"2024-09-19T06:09:59.492841+0000","last_became_peered":"2024-09-19T06:09:59.492841+0000","last_unstale":"2024-09-19T06:12:22.539711+0000","last_undegraded":"2024-09-19T06:12:22.539711+0000","last_fullsized":"2024-09-19T06:12:22.539711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:48.557724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759731+0000","last_change":"2024-09-19T06:09:59.493364+0000","last_active":"2024-09-19T06:12:22.759731+0000","last_peered":"2024-09-19T06:12:22.759731+0000","last_clean":"2024-09-19T06:12:22.759731+0000","last_became_active":"2024-09-19T06:09:59.491868+0000","last_became_peered":"2024-09-19T06:09:59.491868+0000","last_unstale":"2024-09-19T06:12:22.759731+0000","last_undegraded":"2024-09-19T06:12:22.759731+0000","last_fullsized":"2024-09-19T06:12:22.759731+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:23.088768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523512+0000","last_change":"2024-09-19T06:10:02.534453+0000","last_active":"2024-09-19T06:12:22.523512+0000","last_peered":"2024-09-19T06:12:22.523512+0000","last_clean":"2024-09-19T06:12:22.523512+0000","last_became_active":"2024-09-19T06:10:02.532003+0000","last_became_peered":"2024-09-19T06:10:02.532003+0000","last_unstale":"2024-09-19T06:12:22.523512+0000","last_undegraded":"2024-09-19T06:12:22.523512+0000","last_fullsized":"2024-09-19T06:12:22.523512+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:41.609673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.536292+0000","last_change":"2024-09-19T06:09:59.493574+0000","last_active":"2024-09-19T06:12:22.536292+0000","last_peered":"2024-09-19T06:12:22.536292+0000","last_clean":"2024-09-19T06:12:22.536292+0000","last_became_active":"2024-09-19T06:09:59.493243+0000","last_became_peered":"2024-09-19T06:09:59.493243+0000","last_unstale":"2024-09-19T06:12:22.536292+0000","last_undegraded":"2024-09-19T06:12:22.536292+0000","last_fullsized":"2024-09-19T06:12:22.536292+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:12:43.491780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.416070+0000","last_change":"2024-09-19T06:10:02.520122+0000","last_active":"2024-09-19T06:12:22.416070+0000","last_peered":"2024-09-19T06:12:22.416070+0000","last_clean":"2024-09-19T06:12:22.416070+0000","last_became_active":"2024-09-19T06:10:02.519795+0000","last_became_peered":"2024-09-19T06:10:02.519795+0000","last_unstale":"2024-09-19T06:12:22.416070+0000","last_undegraded":"2024-09-19T06:12:22.416070+0000","last_fullsized":"2024-09-19T06:12:22.416070+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:12.384824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"89'7","reported_seq":289,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.981477+0000","last_change":"2024-09-19T06:09:59.491192+0000","last_active":"2024-09-19T06:12:22.981477+0000","last_peered":"2024-09-19T06:12:22.981477+0000","last_clean":"2024-09-19T06:12:22.981477+0000","last_became_active":"2024-09-19T06:09:59.490774+0000","last_became_peered":"2024-09-19T06:09:59.490774+0000","last_unstale":"2024-09-19T06:12:22.981477+0000","last_undegraded":"2024-09-19T06:12:22.981477+0000","last_fullsized":"2024-09-19T06:12:22.981477+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:42:30.276512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":254,"num_read_kb":254,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.769254+0000","last_change":"2024-09-19T06:10:02.516728+0000","last_active":"2024-09-19T06:12:22.769254+0000","last_peered":"2024-09-19T06:12:22.769254+0000","last_clean":"2024-09-19T06:12:22.769254+0000","last_became_active":"2024-09-19T06:10:02.516415+0000","last_became_peered":"2024-09-19T06:10:02.516415+0000","last_unstale":"2024-09-19T06:12:22.769254+0000","last_undegraded":"2024-09-19T06:12:22.769254+0000","last_fullsized":"2024-09-19T06:12:22.769254+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:45.012284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.418403+0000","last_change":"2024-09-19T06:09:59.499167+0000","last_active":"2024-09-19T06:12:22.418403+0000","last_peered":"2024-09-19T06:12:22.418403+0000","last_clean":"2024-09-19T06:12:22.418403+0000","last_became_active":"2024-09-19T06:09:59.498796+0000","last_became_peered":"2024-09-19T06:09:59.498796+0000","last_unstale":"2024-09-19T06:12:22.418403+0000","last_undegraded":"2024-09-19T06:12:22.418403+0000","last_fullsized":"2024-09-19T06:12:22.418403+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:13:08.665495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417683+0000","last_change":"2024-09-19T06:10:31.823990+0000","last_active":"2024-09-19T06:12:22.417683+0000","last_peered":"2024-09-19T06:12:22.417683+0000","last_clean":"2024-09-19T06:12:22.417683+0000","last_became_active":"2024-09-19T06:10:31.823448+0000","last_became_peered":"2024-09-19T06:10:31.823448+0000","last_unstale":"2024-09-19T06:12:22.417683+0000","last_undegraded":"2024-09-19T06:12:22.417683+0000","last_fullsized":"2024-09-19T06:12:22.417683+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:33.882448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.536353+0000","last_change":"2024-09-19T06:09:59.774875+0000","last_active":"2024-09-19T06:12:22.536353+0000","last_peered":"2024-09-19T06:12:22.536353+0000","last_clean":"2024-09-19T06:12:22.536353+0000","last_became_active":"2024-09-19T06:09:59.774376+0000","last_became_peered":"2024-09-19T06:09:59.774376+0000","last_unstale":"2024-09-19T06:12:22.536353+0000","last_undegraded":"2024-09-19T06:12:22.536353+0000","last_fullsized":"2024-09-19T06:12:22.536353+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:01.283578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.769374+0000","last_change":"2024-09-19T06:10:02.518202+0000","last_active":"2024-09-19T06:12:22.769374+0000","last_peered":"2024-09-19T06:12:22.769374+0000","last_clean":"2024-09-19T06:12:22.769374+0000","last_became_active":"2024-09-19T06:10:02.517865+0000","last_became_peered":"2024-09-19T06:10:02.517865+0000","last_unstale":"2024-09-19T06:12:22.769374+0000","last_undegraded":"2024-09-19T06:12:22.769374+0000","last_fullsized":"2024-09-19T06:12:22.769374+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:28.128891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"89'38","reported_seq":333,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.982684+0000","last_change":"2024-09-19T06:09:59.493139+0000","last_active":"2024-09-19T06:12:22.982684+0000","last_peered":"2024-09-19T06:12:22.982684+0000","last_clean":"2024-09-19T06:12:22.982684+0000","last_became_active":"2024-09-19T06:09:59.492768+0000","last_became_peered":"2024-09-19T06:09:59.492768+0000","last_unstale":"2024-09-19T06:12:22.982684+0000","last_undegraded":"2024-09-19T06:12:22.982684+0000","last_fullsized":"2024-09-19T06:12:22.982684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:17.872432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66483,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":266,"num_read_kb":198,"num_write":40,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798746+0000","last_change":"2024-09-19T06:10:02.516187+0000","last_active":"2024-09-19T06:12:22.798746+0000","last_peered":"2024-09-19T06:12:22.798746+0000","last_clean":"2024-09-19T06:12:22.798746+0000","last_became_active":"2024-09-19T06:10:02.515888+0000","last_became_peered":"2024-09-19T06:10:02.515888+0000","last_unstale":"2024-09-19T06:12:22.798746+0000","last_undegraded":"2024-09-19T06:12:22.798746+0000","last_fullsized":"2024-09-19T06:12:22.798746+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:29.672889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759957+0000","last_change":"2024-09-19T06:09:59.492155+0000","last_active":"2024-09-19T06:12:22.759957+0000","last_peered":"2024-09-19T06:12:22.759957+0000","last_clean":"2024-09-19T06:12:22.759957+0000","last_became_active":"2024-09-19T06:09:59.491730+0000","last_became_peered":"2024-09-19T06:09:59.491730+0000","last_unstale":"2024-09-19T06:12:22.759957+0000","last_undegraded":"2024-09-19T06:12:22.759957+0000","last_fullsized":"2024-09-19T06:12:22.759957+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:30.632665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.760036+0000","last_change":"2024-09-19T06:10:02.526214+0000","last_active":"2024-09-19T06:12:22.760036+0000","last_peered":"2024-09-19T06:12:22.760036+0000","last_clean":"2024-09-19T06:12:22.760036+0000","last_became_active":"2024-09-19T06:10:02.525846+0000","last_became_peered":"2024-09-19T06:10:02.525846+0000","last_unstale":"2024-09-19T06:12:22.760036+0000","last_undegraded":"2024-09-19T06:12:22.760036+0000","last_fullsized":"2024-09-19T06:12:22.760036+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:14.294741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.536313+0000","last_change":"2024-09-19T06:09:59.494814+0000","last_active":"2024-09-19T06:12:22.536313+0000","last_peered":"2024-09-19T06:12:22.536313+0000","last_clean":"2024-09-19T06:12:22.536313+0000","last_became_active":"2024-09-19T06:09:59.494461+0000","last_became_peered":"2024-09-19T06:09:59.494461+0000","last_unstale":"2024-09-19T06:12:22.536313+0000","last_undegraded":"2024-09-19T06:12:22.536313+0000","last_fullsized":"2024-09-19T06:12:22.536313+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:37.730327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.418125+0000","last_change":"2024-09-19T06:10:02.518851+0000","last_active":"2024-09-19T06:12:22.418125+0000","last_peered":"2024-09-19T06:12:22.418125+0000","last_clean":"2024-09-19T06:12:22.418125+0000","last_became_active":"2024-09-19T06:10:02.518462+0000","last_became_peered":"2024-09-19T06:10:02.518462+0000","last_unstale":"2024-09-19T06:12:22.418125+0000","last_undegraded":"2024-09-19T06:12:22.418125+0000","last_fullsized":"2024-09-19T06:12:22.418125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:44:22.629918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'6","reported_seq":165,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.953339+0000","last_change":"2024-09-19T06:09:59.493839+0000","last_active":"2024-09-19T06:12:22.953339+0000","last_peered":"2024-09-19T06:12:22.953339+0000","last_clean":"2024-09-19T06:12:22.953339+0000","last_became_active":"2024-09-19T06:09:59.492323+0000","last_became_peered":"2024-09-19T06:09:59.492323+0000","last_unstale":"2024-09-19T06:12:22.953339+0000","last_undegraded":"2024-09-19T06:12:22.953339+0000","last_fullsized":"2024-09-19T06:12:22.953339+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:12.754030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":131,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417730+0000","last_change":"2024-09-19T06:10:02.515957+0000","last_active":"2024-09-19T06:12:22.417730+0000","last_peered":"2024-09-19T06:12:22.417730+0000","last_clean":"2024-09-19T06:12:22.417730+0000","last_became_active":"2024-09-19T06:10:02.515493+0000","last_became_peered":"2024-09-19T06:10:02.515493+0000","last_unstale":"2024-09-19T06:12:22.417730+0000","last_undegraded":"2024-09-19T06:12:22.417730+0000","last_fullsized":"2024-09-19T06:12:22.417730+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:06.988155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798500+0000","last_change":"2024-09-19T06:09:59.775131+0000","last_active":"2024-09-19T06:12:22.798500+0000","last_peered":"2024-09-19T06:12:22.798500+0000","last_clean":"2024-09-19T06:12:22.798500+0000","last_became_active":"2024-09-19T06:09:59.774642+0000","last_became_peered":"2024-09-19T06:09:59.774642+0000","last_unstale":"2024-09-19T06:12:22.798500+0000","last_undegraded":"2024-09-19T06:12:22.798500+0000","last_fullsized":"2024-09-19T06:12:22.798500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:31.722485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.536308+0000","last_change":"2024-09-19T06:10:02.522531+0000","last_active":"2024-09-19T06:12:22.536308+0000","last_peered":"2024-09-19T06:12:22.536308+0000","last_clean":"2024-09-19T06:12:22.536308+0000","last_became_active":"2024-09-19T06:10:02.522186+0000","last_became_peered":"2024-09-19T06:10:02.522186+0000","last_unstale":"2024-09-19T06:12:22.536308+0000","last_undegraded":"2024-09-19T06:12:22.536308+0000","last_fullsized":"2024-09-19T06:12:22.536308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:30:45.689043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798825+0000","last_change":"2024-09-19T06:09:59.494819+0000","last_active":"2024-09-19T06:12:22.798825+0000","last_peered":"2024-09-19T06:12:22.798825+0000","last_clean":"2024-09-19T06:12:22.798825+0000","last_became_active":"2024-09-19T06:09:59.494434+0000","last_became_peered":"2024-09-19T06:09:59.494434+0000","last_unstale":"2024-09-19T06:12:22.798825+0000","last_undegraded":"2024-09-19T06:12:22.798825+0000","last_fullsized":"2024-09-19T06:12:22.798825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:52:42.207621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523127+0000","last_change":"2024-09-19T06:10:02.522893+0000","last_active":"2024-09-19T06:12:22.523127+0000","last_peered":"2024-09-19T06:12:22.523127+0000","last_clean":"2024-09-19T06:12:22.523127+0000","last_became_active":"2024-09-19T06:10:02.522596+0000","last_became_peered":"2024-09-19T06:10:02.522596+0000","last_unstale":"2024-09-19T06:12:22.523127+0000","last_undegraded":"2024-09-19T06:12:22.523127+0000","last_fullsized":"2024-09-19T06:12:22.523127+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:27:21.394878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759883+0000","last_change":"2024-09-19T06:10:31.838085+0000","last_active":"2024-09-19T06:12:22.759883+0000","last_peered":"2024-09-19T06:12:22.759883+0000","last_clean":"2024-09-19T06:12:22.759883+0000","last_became_active":"2024-09-19T06:10:31.826924+0000","last_became_peered":"2024-09-19T06:10:31.826924+0000","last_unstale":"2024-09-19T06:12:22.759883+0000","last_undegraded":"2024-09-19T06:12:22.759883+0000","last_fullsized":"2024-09-19T06:12:22.759883+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:19.875110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4],"acting":[6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.418534+0000","last_change":"2024-09-19T06:10:02.516137+0000","last_active":"2024-09-19T06:12:22.418534+0000","last_peered":"2024-09-19T06:12:22.418534+0000","last_clean":"2024-09-19T06:12:22.418534+0000","last_became_active":"2024-09-19T06:10:02.515769+0000","last_became_peered":"2024-09-19T06:10:02.515769+0000","last_unstale":"2024-09-19T06:12:22.418534+0000","last_undegraded":"2024-09-19T06:12:22.418534+0000","last_fullsized":"2024-09-19T06:12:22.418534+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:56.741950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'41","reported_seq":78,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.688076+0000","last_change":"2024-09-19T06:09:59.498177+0000","last_active":"2024-09-19T06:12:22.688076+0000","last_peered":"2024-09-19T06:12:22.688076+0000","last_clean":"2024-09-19T06:12:22.688076+0000","last_became_active":"2024-09-19T06:09:59.497808+0000","last_became_peered":"2024-09-19T06:09:59.497808+0000","last_unstale":"2024-09-19T06:12:22.688076+0000","last_undegraded":"2024-09-19T06:12:22.688076+0000","last_fullsized":"2024-09-19T06:12:22.688076+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:06.473332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.418112+0000","last_change":"2024-09-19T06:10:02.526442+0000","last_active":"2024-09-19T06:12:22.418112+0000","last_peered":"2024-09-19T06:12:22.418112+0000","last_clean":"2024-09-19T06:12:22.418112+0000","last_became_active":"2024-09-19T06:10:02.526116+0000","last_became_peered":"2024-09-19T06:10:02.526116+0000","last_unstale":"2024-09-19T06:12:22.418112+0000","last_undegraded":"2024-09-19T06:12:22.418112+0000","last_fullsized":"2024-09-19T06:12:22.418112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:05.000599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"89'7","reported_seq":137,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.982209+0000","last_change":"2024-09-19T06:10:31.829793+0000","last_active":"2024-09-19T06:12:22.982209+0000","last_peered":"2024-09-19T06:12:22.982209+0000","last_clean":"2024-09-19T06:12:22.982209+0000","last_became_active":"2024-09-19T06:10:31.822044+0000","last_became_peered":"2024-09-19T06:10:31.822044+0000","last_unstale":"2024-09-19T06:12:22.982209+0000","last_undegraded":"2024-09-19T06:12:22.982209+0000","last_fullsized":"2024-09-19T06:12:22.982209+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:45.301315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1874,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":2,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1170,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.418385+0000","last_change":"2024-09-19T06:10:02.524435+0000","last_active":"2024-09-19T06:12:22.418385+0000","last_peered":"2024-09-19T06:12:22.418385+0000","last_clean":"2024-09-19T06:12:22.418385+0000","last_became_active":"2024-09-19T06:10:02.523634+0000","last_became_peered":"2024-09-19T06:10:02.523634+0000","last_unstale":"2024-09-19T06:12:22.418385+0000","last_undegraded":"2024-09-19T06:12:22.418385+0000","last_fullsized":"2024-09-19T06:12:22.418385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:07.679183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":352,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417875+0000","last_change":"2024-09-19T06:08:39.873247+0000","last_active":"2024-09-19T06:12:22.417875+0000","last_peered":"2024-09-19T06:12:22.417875+0000","last_clean":"2024-09-19T06:12:22.417875+0000","last_became_active":"2024-09-19T06:08:39.872647+0000","last_became_peered":"2024-09-19T06:08:39.872647+0000","last_unstale":"2024-09-19T06:12:22.417875+0000","last_undegraded":"2024-09-19T06:12:22.417875+0000","last_fullsized":"2024-09-19T06:12:22.417875+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:04:56.991890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:04:56.991890+0000","last_clean_scrub_stamp":"2024-09-19T06:04:56.991890+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:18.835510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759946+0000","last_change":"2024-09-19T06:09:59.492677+0000","last_active":"2024-09-19T06:12:22.759946+0000","last_peered":"2024-09-19T06:12:22.759946+0000","last_clean":"2024-09-19T06:12:22.759946+0000","last_became_active":"2024-09-19T06:09:59.492235+0000","last_became_peered":"2024-09-19T06:09:59.492235+0000","last_unstale":"2024-09-19T06:12:22.759946+0000","last_undegraded":"2024-09-19T06:12:22.759946+0000","last_fullsized":"2024-09-19T06:12:22.759946+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:49:40.173728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523728+0000","last_change":"2024-09-19T06:10:02.523331+0000","last_active":"2024-09-19T06:12:22.523728+0000","last_peered":"2024-09-19T06:12:22.523728+0000","last_clean":"2024-09-19T06:12:22.523728+0000","last_became_active":"2024-09-19T06:10:02.522896+0000","last_became_peered":"2024-09-19T06:10:02.522896+0000","last_unstale":"2024-09-19T06:12:22.523728+0000","last_undegraded":"2024-09-19T06:12:22.523728+0000","last_fullsized":"2024-09-19T06:12:22.523728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:56.994375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417840+0000","last_change":"2024-09-19T06:09:59.496407+0000","last_active":"2024-09-19T06:12:22.417840+0000","last_peered":"2024-09-19T06:12:22.417840+0000","last_clean":"2024-09-19T06:12:22.417840+0000","last_became_active":"2024-09-19T06:09:59.496074+0000","last_became_peered":"2024-09-19T06:09:59.496074+0000","last_unstale":"2024-09-19T06:12:22.417840+0000","last_undegraded":"2024-09-19T06:12:22.417840+0000","last_fullsized":"2024-09-19T06:12:22.417840+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:11.257227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759741+0000","last_change":"2024-09-19T06:10:02.515229+0000","last_active":"2024-09-19T06:12:22.759741+0000","last_peered":"2024-09-19T06:12:22.759741+0000","last_clean":"2024-09-19T06:12:22.759741+0000","last_became_active":"2024-09-19T06:10:02.514092+0000","last_became_peered":"2024-09-19T06:10:02.514092+0000","last_unstale":"2024-09-19T06:12:22.759741+0000","last_undegraded":"2024-09-19T06:12:22.759741+0000","last_fullsized":"2024-09-19T06:12:22.759741+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:32:36.805821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"89'6","reported_seq":163,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.763210+0000","last_change":"2024-09-19T06:09:59.777102+0000","last_active":"2024-09-19T06:12:22.763210+0000","last_peered":"2024-09-19T06:12:22.763210+0000","last_clean":"2024-09-19T06:12:22.763210+0000","last_became_active":"2024-09-19T06:09:59.774456+0000","last_became_peered":"2024-09-19T06:09:59.774456+0000","last_unstale":"2024-09-19T06:12:22.763210+0000","last_undegraded":"2024-09-19T06:12:22.763210+0000","last_fullsized":"2024-09-19T06:12:22.763210+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:11.353528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":128,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.536115+0000","last_change":"2024-09-19T06:10:02.517039+0000","last_active":"2024-09-19T06:12:22.536115+0000","last_peered":"2024-09-19T06:12:22.536115+0000","last_clean":"2024-09-19T06:12:22.536115+0000","last_became_active":"2024-09-19T06:10:02.516291+0000","last_became_peered":"2024-09-19T06:10:02.516291+0000","last_unstale":"2024-09-19T06:12:22.536115+0000","last_undegraded":"2024-09-19T06:12:22.536115+0000","last_fullsized":"2024-09-19T06:12:22.536115+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:27.835967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"89'8","reported_seq":167,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:23.113189+0000","last_change":"2024-09-19T06:09:59.499496+0000","last_active":"2024-09-19T06:12:23.113189+0000","last_peered":"2024-09-19T06:12:23.113189+0000","last_clean":"2024-09-19T06:12:23.113189+0000","last_became_active":"2024-09-19T06:09:59.499172+0000","last_became_peered":"2024-09-19T06:09:59.499172+0000","last_unstale":"2024-09-19T06:12:23.113189+0000","last_undegraded":"2024-09-19T06:12:23.113189+0000","last_fullsized":"2024-09-19T06:12:23.113189+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:52.062675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":130,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.539804+0000","last_change":"2024-09-19T06:10:02.523099+0000","last_active":"2024-09-19T06:12:22.539804+0000","last_peered":"2024-09-19T06:12:22.539804+0000","last_clean":"2024-09-19T06:12:22.539804+0000","last_became_active":"2024-09-19T06:10:02.522770+0000","last_became_peered":"2024-09-19T06:10:02.522770+0000","last_unstale":"2024-09-19T06:12:22.539804+0000","last_undegraded":"2024-09-19T06:12:22.539804+0000","last_fullsized":"2024-09-19T06:12:22.539804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:39.807159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.416333+0000","last_change":"2024-09-19T06:09:59.775371+0000","last_active":"2024-09-19T06:12:22.416333+0000","last_peered":"2024-09-19T06:12:22.416333+0000","last_clean":"2024-09-19T06:12:22.416333+0000","last_became_active":"2024-09-19T06:09:59.774944+0000","last_became_peered":"2024-09-19T06:09:59.774944+0000","last_unstale":"2024-09-19T06:12:22.416333+0000","last_undegraded":"2024-09-19T06:12:22.416333+0000","last_fullsized":"2024-09-19T06:12:22.416333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:44.305005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.539885+0000","last_change":"2024-09-19T06:10:02.521207+0000","last_active":"2024-09-19T06:12:22.539885+0000","last_peered":"2024-09-19T06:12:22.539885+0000","last_clean":"2024-09-19T06:12:22.539885+0000","last_became_active":"2024-09-19T06:10:02.520843+0000","last_became_peered":"2024-09-19T06:10:02.520843+0000","last_unstale":"2024-09-19T06:12:22.539885+0000","last_undegraded":"2024-09-19T06:12:22.539885+0000","last_fullsized":"2024-09-19T06:12:22.539885+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:39.462042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798901+0000","last_change":"2024-09-19T06:09:59.775259+0000","last_active":"2024-09-19T06:12:22.798901+0000","last_peered":"2024-09-19T06:12:22.798901+0000","last_clean":"2024-09-19T06:12:22.798901+0000","last_became_active":"2024-09-19T06:09:59.774393+0000","last_became_peered":"2024-09-19T06:09:59.774393+0000","last_unstale":"2024-09-19T06:12:22.798901+0000","last_undegraded":"2024-09-19T06:12:22.798901+0000","last_fullsized":"2024-09-19T06:12:22.798901+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:39:05.904778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.760041+0000","last_change":"2024-09-19T06:10:02.516445+0000","last_active":"2024-09-19T06:12:22.760041+0000","last_peered":"2024-09-19T06:12:22.760041+0000","last_clean":"2024-09-19T06:12:22.760041+0000","last_became_active":"2024-09-19T06:10:02.515524+0000","last_became_peered":"2024-09-19T06:10:02.515524+0000","last_unstale":"2024-09-19T06:12:22.760041+0000","last_undegraded":"2024-09-19T06:12:22.760041+0000","last_fullsized":"2024-09-19T06:12:22.760041+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:42.863526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"89'51","reported_seq":119,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.685554+0000","last_change":"2024-09-19T06:10:31.834659+0000","last_active":"2024-09-19T06:12:22.685554+0000","last_peered":"2024-09-19T06:12:22.685554+0000","last_clean":"2024-09-19T06:12:22.685554+0000","last_became_active":"2024-09-19T06:10:31.825992+0000","last_became_peered":"2024-09-19T06:10:31.825992+0000","last_unstale":"2024-09-19T06:12:22.685554+0000","last_undegraded":"2024-09-19T06:12:22.685554+0000","last_fullsized":"2024-09-19T06:12:22.685554+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:16.208213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":91,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.524191+0000","last_change":"2024-09-19T06:10:02.532473+0000","last_active":"2024-09-19T06:12:22.524191+0000","last_peered":"2024-09-19T06:12:22.524191+0000","last_clean":"2024-09-19T06:12:22.524191+0000","last_became_active":"2024-09-19T06:10:02.531745+0000","last_became_peered":"2024-09-19T06:10:02.531745+0000","last_unstale":"2024-09-19T06:12:22.524191+0000","last_undegraded":"2024-09-19T06:12:22.524191+0000","last_fullsized":"2024-09-19T06:12:22.524191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:22.659626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.760021+0000","last_change":"2024-09-19T06:10:00.231383+0000","last_active":"2024-09-19T06:12:22.760021+0000","last_peered":"2024-09-19T06:12:22.760021+0000","last_clean":"2024-09-19T06:12:22.760021+0000","last_became_active":"2024-09-19T06:10:00.231016+0000","last_became_peered":"2024-09-19T06:10:00.231016+0000","last_unstale":"2024-09-19T06:12:22.760021+0000","last_undegraded":"2024-09-19T06:12:22.760021+0000","last_fullsized":"2024-09-19T06:12:22.760021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:39:07.178556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.418119+0000","last_change":"2024-09-19T06:10:02.532772+0000","last_active":"2024-09-19T06:12:22.418119+0000","last_peered":"2024-09-19T06:12:22.418119+0000","last_clean":"2024-09-19T06:12:22.418119+0000","last_became_active":"2024-09-19T06:10:02.528187+0000","last_became_peered":"2024-09-19T06:10:02.528187+0000","last_unstale":"2024-09-19T06:12:22.418119+0000","last_undegraded":"2024-09-19T06:12:22.418119+0000","last_fullsized":"2024-09-19T06:12:22.418119+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:35.550221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.769076+0000","last_change":"2024-09-19T06:09:59.774860+0000","last_active":"2024-09-19T06:12:22.769076+0000","last_peered":"2024-09-19T06:12:22.769076+0000","last_clean":"2024-09-19T06:12:22.769076+0000","last_became_active":"2024-09-19T06:09:59.774525+0000","last_became_peered":"2024-09-19T06:09:59.774525+0000","last_unstale":"2024-09-19T06:12:22.769076+0000","last_undegraded":"2024-09-19T06:12:22.769076+0000","last_fullsized":"2024-09-19T06:12:22.769076+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:28.480611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798429+0000","last_change":"2024-09-19T06:10:02.514951+0000","last_active":"2024-09-19T06:12:22.798429+0000","last_peered":"2024-09-19T06:12:22.798429+0000","last_clean":"2024-09-19T06:12:22.798429+0000","last_became_active":"2024-09-19T06:10:02.514632+0000","last_became_peered":"2024-09-19T06:10:02.514632+0000","last_unstale":"2024-09-19T06:12:22.798429+0000","last_undegraded":"2024-09-19T06:12:22.798429+0000","last_fullsized":"2024-09-19T06:12:22.798429+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:58.225253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.523613+0000","last_change":"2024-09-19T06:09:59.496203+0000","last_active":"2024-09-19T06:12:22.523613+0000","last_peered":"2024-09-19T06:12:22.523613+0000","last_clean":"2024-09-19T06:12:22.523613+0000","last_became_active":"2024-09-19T06:09:59.495854+0000","last_became_peered":"2024-09-19T06:09:59.495854+0000","last_unstale":"2024-09-19T06:12:22.523613+0000","last_undegraded":"2024-09-19T06:12:22.523613+0000","last_fullsized":"2024-09-19T06:12:22.523613+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:43.388624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.522910+0000","last_change":"2024-09-19T06:10:02.521713+0000","last_active":"2024-09-19T06:12:22.522910+0000","last_peered":"2024-09-19T06:12:22.522910+0000","last_clean":"2024-09-19T06:12:22.522910+0000","last_became_active":"2024-09-19T06:10:02.521389+0000","last_became_peered":"2024-09-19T06:10:02.521389+0000","last_unstale":"2024-09-19T06:12:22.522910+0000","last_undegraded":"2024-09-19T06:12:22.522910+0000","last_fullsized":"2024-09-19T06:12:22.522910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:34.441627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.759827+0000","last_change":"2024-09-19T06:09:59.492636+0000","last_active":"2024-09-19T06:12:22.759827+0000","last_peered":"2024-09-19T06:12:22.759827+0000","last_clean":"2024-09-19T06:12:22.759827+0000","last_became_active":"2024-09-19T06:09:59.491801+0000","last_became_peered":"2024-09-19T06:09:59.491801+0000","last_unstale":"2024-09-19T06:12:22.759827+0000","last_undegraded":"2024-09-19T06:12:22.759827+0000","last_fullsized":"2024-09-19T06:12:22.759827+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:27.911582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.524299+0000","last_change":"2024-09-19T06:10:02.527073+0000","last_active":"2024-09-19T06:12:22.524299+0000","last_peered":"2024-09-19T06:12:22.524299+0000","last_clean":"2024-09-19T06:12:22.524299+0000","last_became_active":"2024-09-19T06:10:02.525847+0000","last_became_peered":"2024-09-19T06:10:02.525847+0000","last_unstale":"2024-09-19T06:12:22.524299+0000","last_undegraded":"2024-09-19T06:12:22.524299+0000","last_fullsized":"2024-09-19T06:12:22.524299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:18:22.717353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798512+0000","last_change":"2024-09-19T06:09:59.493905+0000","last_active":"2024-09-19T06:12:22.798512+0000","last_peered":"2024-09-19T06:12:22.798512+0000","last_clean":"2024-09-19T06:12:22.798512+0000","last_became_active":"2024-09-19T06:09:59.493517+0000","last_became_peered":"2024-09-19T06:09:59.493517+0000","last_unstale":"2024-09-19T06:12:22.798512+0000","last_undegraded":"2024-09-19T06:12:22.798512+0000","last_fullsized":"2024-09-19T06:12:22.798512+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:22.959756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417840+0000","last_change":"2024-09-19T06:10:02.518002+0000","last_active":"2024-09-19T06:12:22.417840+0000","last_peered":"2024-09-19T06:12:22.417840+0000","last_clean":"2024-09-19T06:12:22.417840+0000","last_became_active":"2024-09-19T06:10:02.517492+0000","last_became_peered":"2024-09-19T06:10:02.517492+0000","last_unstale":"2024-09-19T06:12:22.417840+0000","last_undegraded":"2024-09-19T06:12:22.417840+0000","last_fullsized":"2024-09-19T06:12:22.417840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:58.935232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.536205+0000","last_change":"2024-09-19T06:10:31.951506+0000","last_active":"2024-09-19T06:12:22.536205+0000","last_peered":"2024-09-19T06:12:22.536205+0000","last_clean":"2024-09-19T06:12:22.536205+0000","last_became_active":"2024-09-19T06:10:31.951079+0000","last_became_peered":"2024-09-19T06:10:31.951079+0000","last_unstale":"2024-09-19T06:12:22.536205+0000","last_undegraded":"2024-09-19T06:12:22.536205+0000","last_fullsized":"2024-09-19T06:12:22.536205+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:53.978445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798709+0000","last_change":"2024-09-19T06:09:59.496546+0000","last_active":"2024-09-19T06:12:22.798709+0000","last_peered":"2024-09-19T06:12:22.798709+0000","last_clean":"2024-09-19T06:12:22.798709+0000","last_became_active":"2024-09-19T06:09:59.496195+0000","last_became_peered":"2024-09-19T06:09:59.496195+0000","last_unstale":"2024-09-19T06:12:22.798709+0000","last_undegraded":"2024-09-19T06:12:22.798709+0000","last_fullsized":"2024-09-19T06:12:22.798709+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:58.443134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.769448+0000","last_change":"2024-09-19T06:10:02.522270+0000","last_active":"2024-09-19T06:12:22.769448+0000","last_peered":"2024-09-19T06:12:22.769448+0000","last_clean":"2024-09-19T06:12:22.769448+0000","last_became_active":"2024-09-19T06:10:02.517109+0000","last_became_peered":"2024-09-19T06:10:02.517109+0000","last_unstale":"2024-09-19T06:12:22.769448+0000","last_undegraded":"2024-09-19T06:12:22.769448+0000","last_fullsized":"2024-09-19T06:12:22.769448+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:56.967980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.798805+0000","last_change":"2024-09-19T06:09:59.494016+0000","last_active":"2024-09-19T06:12:22.798805+0000","last_peered":"2024-09-19T06:12:22.798805+0000","last_clean":"2024-09-19T06:12:22.798805+0000","last_became_active":"2024-09-19T06:09:59.493525+0000","last_became_peered":"2024-09-19T06:09:59.493525+0000","last_unstale":"2024-09-19T06:12:22.798805+0000","last_undegraded":"2024-09-19T06:12:22.798805+0000","last_fullsized":"2024-09-19T06:12:22.798805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:06.650633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.417554+0000","last_change":"2024-09-19T06:10:02.531329+0000","last_active":"2024-09-19T06:12:22.417554+0000","last_peered":"2024-09-19T06:12:22.417554+0000","last_clean":"2024-09-19T06:12:22.417554+0000","last_became_active":"2024-09-19T06:10:02.527107+0000","last_became_peered":"2024-09-19T06:10:02.527107+0000","last_unstale":"2024-09-19T06:12:22.417554+0000","last_undegraded":"2024-09-19T06:12:22.417554+0000","last_fullsized":"2024-09-19T06:12:22.417554+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:25.891416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.524291+0000","last_change":"2024-09-19T06:09:59.774966+0000","last_active":"2024-09-19T06:12:22.524291+0000","last_peered":"2024-09-19T06:12:22.524291+0000","last_clean":"2024-09-19T06:12:22.524291+0000","last_became_active":"2024-09-19T06:09:59.774038+0000","last_became_peered":"2024-09-19T06:09:59.774038+0000","last_unstale":"2024-09-19T06:12:22.524291+0000","last_undegraded":"2024-09-19T06:12:22.524291+0000","last_fullsized":"2024-09-19T06:12:22.524291+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:54.703512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.416493+0000","last_change":"2024-09-19T06:10:31.824217+0000","last_active":"2024-09-19T06:12:22.416493+0000","last_peered":"2024-09-19T06:12:22.416493+0000","last_clean":"2024-09-19T06:12:22.416493+0000","last_became_active":"2024-09-19T06:10:31.823867+0000","last_became_peered":"2024-09-19T06:10:31.823867+0000","last_unstale":"2024-09-19T06:12:22.416493+0000","last_undegraded":"2024-09-19T06:12:22.416493+0000","last_fullsized":"2024-09-19T06:12:22.416493+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:10:01.486359+0000","last_clean_scrub_stamp":"2024-09-19T06:10:01.486359+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:53.261746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"89'15","reported_seq":191,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-19T06:12:22.771460+0000","last_change":"2024-09-19T06:10:31.962041+0000","last_active":"2024-09-19T06:12:22.771460+0000","last_peered":"2024-09-19T06:12:22.771460+0000","last_clean":"2024-09-19T06:12:22.771460+0000","last_became_active":"2024-09-19T06:10:31.952142+0000","last_became_peered":"2024-09-19T06:10:31.952142+0000","last_unstale":"2024-09-19T06:12:22.771460+0000","last_undegraded":"2024-09-19T06:12:22.771460+0000","last_fullsized":"2024-09-19T06:12:22.771460+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:09:58.476194+0000","last_clean_scrub_stamp":"2024-09-19T06:09:58.476194+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:30.304256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":601065,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1368,"num_read_kb":810,"num_write":378,"num_write_kb":1468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":2857,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":724992,"data_stored":1803195,"data_compressed":75906,"data_compressed_allocated":98304,"data_compressed_original":1548288,"omap_allocated":0,"internal_metadata":0},"log_size":305,"ondisk_log_size":305,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107700,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449129,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1007616,"data_stored":872326,"data_compressed":27816,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":71,"seq":304942678063,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28160,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716992,"statfs":{"total":95995035648,"available":95966199808,"internally_reserved":0,"allocated":1159168,"data_stored":1265969,"data_compressed":50726,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":66,"seq":283467841587,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1024000,"data_stored":869610,"data_compressed":27818,"data_compressed_allocated":36864,"data_compressed_original":417792,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103227,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":987136,"data_stored":476100,"data_compressed":8670,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332160,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1048576,"data_stored":1071539,"data_compressed":44570,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495685,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":983040,"data_stored":477038,"data_compressed":8670,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757323,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28084,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717068,"statfs":{"total":95995035648,"available":95966277632,"internally_reserved":0,"allocated":1073152,"data_stored":1199555,"data_compressed":50726,"data_compressed_allocated":65536,"data_compressed_original":737280,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920848,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":468468,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149781,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":466951,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411421,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1064960,"data_stored":543877,"data_compressed":8670,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":529569,"data_compressed":5771,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738470,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1003520,"data_stored":478154,"data_compressed":8670,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35900,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":69834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":525246,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":133798,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":200212,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":397054,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:12:28.136 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:12:28.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:27 smithi059 ceph-mon[35138]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:28.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:27 smithi059 ceph-mon[35138]: from='client.25249 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:12:28.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:27 smithi059 ceph-mon[35138]: mgrmap e25: x(active, since 5s), standbys: y, z 2024-09-19T06:12:28.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:27 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:28.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:27 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:28.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:27 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:28.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:27 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:28.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:27 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:28.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:27 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:28.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:27 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:28.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:27 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:28.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:27 smithi071 ceph-mon[35662]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:28.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:27 smithi071 ceph-mon[35662]: from='client.25249 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:12:28.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:27 smithi071 ceph-mon[35662]: mgrmap e25: x(active, since 5s), standbys: y, z 2024-09-19T06:12:28.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:27 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:28.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:27 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:28.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:27 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:28.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:27 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:28.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:27 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:28.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:27 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:12:28.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:27 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:28.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:27 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:28.649 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:29.053 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:28 smithi003 ceph-mon[30893]: Adjusting osd_memory_target on smithi003 to 177.5M 2024-09-19T06:12:29.054 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:28 smithi003 ceph-mon[30893]: Unable to set osd_memory_target on smithi003 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-19T06:12:29.054 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:28 smithi003 ceph-mon[30893]: Updating smithi003:/etc/ceph/ceph.conf 2024-09-19T06:12:29.054 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:28 smithi003 ceph-mon[30893]: Updating smithi059:/etc/ceph/ceph.conf 2024-09-19T06:12:29.054 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:28 smithi003 ceph-mon[30893]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-19T06:12:29.054 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:28 smithi003 ceph-mon[30893]: from='client.25255 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:12:29.054 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:28 smithi003 ceph-mon[30893]: Updating smithi071:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:12:29.054 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:28 smithi003 ceph-mon[30893]: Updating smithi059:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:12:29.054 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:28 smithi003 ceph-mon[30893]: from='client.25261 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:12:29.054 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:28 smithi003 ceph-mon[30893]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:12:29.054 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:28 smithi003 ceph-mon[30893]: Updating smithi059:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:12:29.054 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:28 smithi003 ceph-mon[30893]: Updating smithi003:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:12:29.054 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:28 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:29.054 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:28 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:29.055 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:28 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:29.055 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:28 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:29.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:28 smithi059 ceph-mon[35138]: Adjusting osd_memory_target on smithi003 to 177.5M 2024-09-19T06:12:29.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:28 smithi059 ceph-mon[35138]: Unable to set osd_memory_target on smithi003 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-19T06:12:29.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:28 smithi059 ceph-mon[35138]: Updating smithi003:/etc/ceph/ceph.conf 2024-09-19T06:12:29.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:28 smithi059 ceph-mon[35138]: Updating smithi059:/etc/ceph/ceph.conf 2024-09-19T06:12:29.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:28 smithi059 ceph-mon[35138]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-19T06:12:29.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:28 smithi059 ceph-mon[35138]: from='client.25255 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:12:29.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:28 smithi059 ceph-mon[35138]: Updating smithi071:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:12:29.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:28 smithi059 ceph-mon[35138]: Updating smithi059:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:12:29.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:28 smithi059 ceph-mon[35138]: from='client.25261 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:12:29.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:28 smithi059 ceph-mon[35138]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:12:29.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:28 smithi059 ceph-mon[35138]: Updating smithi059:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:12:29.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:28 smithi059 ceph-mon[35138]: Updating smithi003:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:12:29.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:28 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:29.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:28 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:29.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:28 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:29.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:28 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:29.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:28 smithi071 ceph-mon[35662]: Adjusting osd_memory_target on smithi003 to 177.5M 2024-09-19T06:12:29.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:28 smithi071 ceph-mon[35662]: Unable to set osd_memory_target on smithi003 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-19T06:12:29.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:28 smithi071 ceph-mon[35662]: Updating smithi003:/etc/ceph/ceph.conf 2024-09-19T06:12:29.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:28 smithi071 ceph-mon[35662]: Updating smithi059:/etc/ceph/ceph.conf 2024-09-19T06:12:29.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:28 smithi071 ceph-mon[35662]: Updating smithi071:/etc/ceph/ceph.conf 2024-09-19T06:12:29.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:28 smithi071 ceph-mon[35662]: from='client.25255 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:12:29.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:28 smithi071 ceph-mon[35662]: Updating smithi071:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:12:29.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:28 smithi071 ceph-mon[35662]: Updating smithi059:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:12:29.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:28 smithi071 ceph-mon[35662]: from='client.25261 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:12:29.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:28 smithi071 ceph-mon[35662]: Updating smithi071:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:12:29.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:28 smithi071 ceph-mon[35662]: Updating smithi059:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:12:29.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:28 smithi071 ceph-mon[35662]: Updating smithi003:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:12:29.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:28 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:29.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:28 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:29.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:28 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:29.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:28 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:29.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.392+0000 7efe16200640 1 -- 172.21.15.3:0/4292939280 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe101049a0 msgr2=0x7efe101089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:29.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.392+0000 7efe16200640 1 --2- 172.21.15.3:0/4292939280 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe101049a0 0x7efe101089f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efdf8009860 tx=0x7efdf802a340 comp rx=0 tx=0).stop 2024-09-19T06:12:29.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.392+0000 7efe16200640 1 -- 172.21.15.3:0/4292939280 shutdown_connections 2024-09-19T06:12:29.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.392+0000 7efe16200640 1 --2- 172.21.15.3:0/4292939280 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe10109120 0x7efe10110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:29.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.392+0000 7efe16200640 1 --2- 172.21.15.3:0/4292939280 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe101049a0 0x7efe101089f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:29.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.392+0000 7efe16200640 1 --2- 172.21.15.3:0/4292939280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe10103ff0 0x7efe101043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:29.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.392+0000 7efe16200640 1 -- 172.21.15.3:0/4292939280 >> 172.21.15.3:0/4292939280 conn(0x7efe100ffa90 msgr2=0x7efe10101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:29.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.392+0000 7efe16200640 1 -- 172.21.15.3:0/4292939280 shutdown_connections 2024-09-19T06:12:29.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.392+0000 7efe16200640 1 -- 172.21.15.3:0/4292939280 wait complete. 2024-09-19T06:12:29.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.393+0000 7efe16200640 1 Processor -- start 2024-09-19T06:12:29.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.393+0000 7efe16200640 1 -- start start 2024-09-19T06:12:29.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.394+0000 7efe16200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe10103ff0 0x7efe1019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:29.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.394+0000 7efe16200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe101049a0 0x7efe1019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:29.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.394+0000 7efe16200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe10109120 0x7efe1019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:29.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.394+0000 7efe16200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7efe10114140 con 0x7efe101049a0 2024-09-19T06:12:29.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.394+0000 7efe16200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efe10113fc0 con 0x7efe10109120 2024-09-19T06:12:29.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.394+0000 7efe16200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efe101142c0 con 0x7efe10103ff0 2024-09-19T06:12:29.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.394+0000 7efe0f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe10103ff0 0x7efe1019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:29.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.394+0000 7efe07e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe101049a0 0x7efe1019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:29.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.394+0000 7efe0f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe10103ff0 0x7efe1019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:51712/0 (socket says 172.21.15.3:51712) 2024-09-19T06:12:29.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.394+0000 7efe07e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe101049a0 0x7efe1019ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39440/0 (socket says 172.21.15.3:39440) 2024-09-19T06:12:29.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.394+0000 7efe0f400640 1 -- 172.21.15.3:0/2028174664 learned_addr learned my addr 172.21.15.3:0/2028174664 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:29.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.394+0000 7efe0fe00640 1 --2- 172.21.15.3:0/2028174664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe10109120 0x7efe1019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:29.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.395+0000 7efe0f400640 1 -- 172.21.15.3:0/2028174664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe10109120 msgr2=0x7efe1019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:29.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.395+0000 7efe0f400640 1 --2- 172.21.15.3:0/2028174664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe10109120 0x7efe1019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:29.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.395+0000 7efe0f400640 1 -- 172.21.15.3:0/2028174664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe101049a0 msgr2=0x7efe1019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:29.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.395+0000 7efe0f400640 1 --2- 172.21.15.3:0/2028174664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe101049a0 0x7efe1019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:29.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.395+0000 7efe0f400640 1 -- 172.21.15.3:0/2028174664 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1019f5d0 con 0x7efe10103ff0 2024-09-19T06:12:29.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.395+0000 7efe0f400640 1 --2- 172.21.15.3:0/2028174664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe10103ff0 0x7efe1019a620 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efe0000e9f0 tx=0x7efe0000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:29.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.395+0000 7efe0cc00640 1 -- 172.21.15.3:0/2028174664 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0000cd80 con 0x7efe10103ff0 2024-09-19T06:12:29.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.395+0000 7efe0cc00640 1 -- 172.21.15.3:0/2028174664 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe00005500 con 0x7efe10103ff0 2024-09-19T06:12:29.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.395+0000 7efe0cc00640 1 -- 172.21.15.3:0/2028174664 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe00010690 con 0x7efe10103ff0 2024-09-19T06:12:29.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.395+0000 7efe16200640 1 -- 172.21.15.3:0/2028174664 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe1019f8c0 con 0x7efe10103ff0 2024-09-19T06:12:29.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.395+0000 7efe16200640 1 -- 172.21.15.3:0/2028174664 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe101a71a0 con 0x7efe10103ff0 2024-09-19T06:12:29.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.397+0000 7efe16200640 1 -- 172.21.15.3:0/2028174664 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe101043d0 con 0x7efe10103ff0 2024-09-19T06:12:29.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.398+0000 7efe0cc00640 1 -- 172.21.15.3:0/2028174664 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 138530+0+0 (secure 0 0 0) 0x7efe000046c0 con 0x7efe10103ff0 2024-09-19T06:12:29.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.400+0000 7efe0cc00640 1 --2- 172.21.15.3:0/2028174664 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7efdf40a34c0 0x7efdf40a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:29.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.400+0000 7efe0cc00640 1 -- 172.21.15.3:0/2028174664 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7efe000d02a0 con 0x7efe10103ff0 2024-09-19T06:12:29.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.400+0000 7efe07e00640 1 --2- 172.21.15.3:0/2028174664 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7efdf40a34c0 0x7efdf40a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:29.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.401+0000 7efe07e00640 1 --2- 172.21.15.3:0/2028174664 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7efdf40a34c0 0x7efdf40a5980 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efdf802a930 tx=0x7efdf80056d0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:29.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.404+0000 7efe0cc00640 1 -- 172.21.15.3:0/2028174664 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efe0009cab0 con 0x7efe10103ff0 2024-09-19T06:12:29.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.656+0000 7efe16200640 1 -- 172.21.15.3:0/2028174664 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe1010c360 con 0x7efe10103ff0 2024-09-19T06:12:29.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.657+0000 7efe0cc00640 1 -- 172.21.15.3:0/2028174664 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7efe0009c3b0 con 0x7efe10103ff0 2024-09-19T06:12:29.659 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:12:29.659 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"btime":"2024-09-19T06:12:22:958217+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:12:22.060987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24532,24515,24514,14517]},"id":1}]} 2024-09-19T06:12:29.660 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2024-09-19T06:12:29.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.659+0000 7efe16200640 1 -- 172.21.15.3:0/2028174664 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7efdf40a34c0 msgr2=0x7efdf40a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:29.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.659+0000 7efe16200640 1 --2- 172.21.15.3:0/2028174664 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7efdf40a34c0 0x7efdf40a5980 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efdf802a930 tx=0x7efdf80056d0 comp rx=0 tx=0).stop 2024-09-19T06:12:29.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.659+0000 7efe16200640 1 -- 172.21.15.3:0/2028174664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe10103ff0 msgr2=0x7efe1019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:29.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.659+0000 7efe16200640 1 --2- 172.21.15.3:0/2028174664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe10103ff0 0x7efe1019a620 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efe0000e9f0 tx=0x7efe0000edf0 comp rx=0 tx=0).stop 2024-09-19T06:12:29.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.659+0000 7efe16200640 1 -- 172.21.15.3:0/2028174664 shutdown_connections 2024-09-19T06:12:29.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.659+0000 7efe16200640 1 --2- 172.21.15.3:0/2028174664 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7efdf40a34c0 0x7efdf40a5980 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:29.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.659+0000 7efe16200640 1 --2- 172.21.15.3:0/2028174664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe10109120 0x7efe1019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:29.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.659+0000 7efe16200640 1 --2- 172.21.15.3:0/2028174664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe101049a0 0x7efe1019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:29.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.659+0000 7efe16200640 1 --2- 172.21.15.3:0/2028174664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe10103ff0 0x7efe1019a620 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:29.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.659+0000 7efe16200640 1 -- 172.21.15.3:0/2028174664 >> 172.21.15.3:0/2028174664 conn(0x7efe100ffa90 msgr2=0x7efe10100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:29.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.659+0000 7efe16200640 1 -- 172.21.15.3:0/2028174664 shutdown_connections 2024-09-19T06:12:29.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:29.659+0000 7efe16200640 1 -- 172.21.15.3:0/2028174664 wait complete. 2024-09-19T06:12:30.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:29 smithi059 ceph-mon[35138]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:30.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:29 smithi059 ceph-mon[35138]: Updating smithi059:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:12:30.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:29 smithi059 ceph-mon[35138]: Updating smithi071:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:12:30.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:29 smithi059 ceph-mon[35138]: Updating smithi003:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:12:30.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:29 smithi059 ceph-mon[35138]: Updating smithi003:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:12:30.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:29 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2028174664' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:30.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:29 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:30.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:29 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:30.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:29 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:30.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:29 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:30.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:29 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:30.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:29 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:30.290 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:29 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:30.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:29 smithi003 ceph-mon[30893]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:30.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:29 smithi003 ceph-mon[30893]: Updating smithi059:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:12:30.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:29 smithi003 ceph-mon[30893]: Updating smithi071:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:12:30.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:29 smithi003 ceph-mon[30893]: Updating smithi003:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:12:30.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:29 smithi003 ceph-mon[30893]: Updating smithi003:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:12:30.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:29 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2028174664' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:30.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:29 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:30.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:29 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:30.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:29 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:30.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:29 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:30.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:29 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:30.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:29 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:30.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:29 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:30.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:29 smithi071 ceph-mon[35662]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:12:30.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:29 smithi071 ceph-mon[35662]: Updating smithi059:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:12:30.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:29 smithi071 ceph-mon[35662]: Updating smithi071:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:12:30.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:29 smithi071 ceph-mon[35662]: Updating smithi003:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:12:30.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:29 smithi071 ceph-mon[35662]: Updating smithi003:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:12:30.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:29 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2028174664' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:12:30.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:29 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:30.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:29 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:30.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:29 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:30.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:29 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:30.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:29 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:30.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:29 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:30.338 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:29 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:30.474 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:12:30.851 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:31.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.476+0000 7f55f0e00640 1 -- 172.21.15.3:0/1231585067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55ec103ff0 msgr2=0x7f55ec1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:31.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.476+0000 7f55f0e00640 1 --2- 172.21.15.3:0/1231585067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55ec103ff0 0x7f55ec1043d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f55dc009ca0 tx=0x7f55dc02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:12:31.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.476+0000 7f55f0e00640 1 -- 172.21.15.3:0/1231585067 shutdown_connections 2024-09-19T06:12:31.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.476+0000 7f55f0e00640 1 --2- 172.21.15.3:0/1231585067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55ec109120 0x7f55ec110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:31.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.476+0000 7f55f0e00640 1 --2- 172.21.15.3:0/1231585067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55ec1049a0 0x7f55ec1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:31.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.476+0000 7f55f0e00640 1 --2- 172.21.15.3:0/1231585067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55ec103ff0 0x7f55ec1043d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:31.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.476+0000 7f55f0e00640 1 -- 172.21.15.3:0/1231585067 >> 172.21.15.3:0/1231585067 conn(0x7f55ec0ffa90 msgr2=0x7f55ec101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:31.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.476+0000 7f55f0e00640 1 -- 172.21.15.3:0/1231585067 shutdown_connections 2024-09-19T06:12:31.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.476+0000 7f55f0e00640 1 -- 172.21.15.3:0/1231585067 wait complete. 2024-09-19T06:12:31.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.478+0000 7f55f0e00640 1 Processor -- start 2024-09-19T06:12:31.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.478+0000 7f55f0e00640 1 -- start start 2024-09-19T06:12:31.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.478+0000 7f55f0e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55ec103ff0 0x7f55ec19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:31.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.478+0000 7f55f0e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55ec1049a0 0x7f55ec19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:31.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.478+0000 7f55f0e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55ec109120 0x7f55ec19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:31.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.478+0000 7f55f0e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f55ec114170 con 0x7f55ec1049a0 2024-09-19T06:12:31.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.478+0000 7f55f0e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f55ec113ff0 con 0x7f55ec109120 2024-09-19T06:12:31.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.478+0000 7f55f0e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f55ec1142f0 con 0x7f55ec103ff0 2024-09-19T06:12:31.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.479+0000 7f55e1400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55ec1049a0 0x7f55ec19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:31.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.479+0000 7f55e1400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55ec1049a0 0x7f55ec19abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39454/0 (socket says 172.21.15.3:39454) 2024-09-19T06:12:31.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.479+0000 7f55e1400640 1 -- 172.21.15.3:0/106231816 learned_addr learned my addr 172.21.15.3:0/106231816 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:31.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.479+0000 7f55ea800640 1 --2- 172.21.15.3:0/106231816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55ec109120 0x7f55ec19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:31.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.479+0000 7f55e9e00640 1 --2- 172.21.15.3:0/106231816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55ec103ff0 0x7f55ec19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:31.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.479+0000 7f55e1400640 1 -- 172.21.15.3:0/106231816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55ec103ff0 msgr2=0x7f55ec19a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:31.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.479+0000 7f55e1400640 1 --2- 172.21.15.3:0/106231816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55ec103ff0 0x7f55ec19a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:31.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.479+0000 7f55e1400640 1 -- 172.21.15.3:0/106231816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55ec109120 msgr2=0x7f55ec19ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:31.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.479+0000 7f55e1400640 1 --2- 172.21.15.3:0/106231816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55ec109120 0x7f55ec19ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:31.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.479+0000 7f55e1400640 1 -- 172.21.15.3:0/106231816 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55ec19f620 con 0x7f55ec1049a0 2024-09-19T06:12:31.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.479+0000 7f55e1400640 1 --2- 172.21.15.3:0/106231816 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55ec1049a0 0x7f55ec19abb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f55d400d950 tx=0x7f55d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:31.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.480+0000 7f55e3400640 1 -- 172.21.15.3:0/106231816 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d4017070 con 0x7f55ec1049a0 2024-09-19T06:12:31.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.480+0000 7f55e3400640 1 -- 172.21.15.3:0/106231816 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55d4009c30 con 0x7f55ec1049a0 2024-09-19T06:12:31.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.480+0000 7f55e3400640 1 -- 172.21.15.3:0/106231816 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d400f6b0 con 0x7f55ec1049a0 2024-09-19T06:12:31.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.480+0000 7f55f0e00640 1 -- 172.21.15.3:0/106231816 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55ec19f910 con 0x7f55ec1049a0 2024-09-19T06:12:31.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.480+0000 7f55f0e00640 1 -- 172.21.15.3:0/106231816 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55ec1a71f0 con 0x7f55ec1049a0 2024-09-19T06:12:31.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.481+0000 7f55f0e00640 1 -- 172.21.15.3:0/106231816 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55ec1043d0 con 0x7f55ec1049a0 2024-09-19T06:12:31.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.483+0000 7f55e3400640 1 -- 172.21.15.3:0/106231816 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 25) ==== 138530+0+0 (secure 0 0 0) 0x7f55d40109d0 con 0x7f55ec1049a0 2024-09-19T06:12:31.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.484+0000 7f55e3400640 1 --2- 172.21.15.3:0/106231816 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f55d00a3440 0x7f55d00a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:31.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.484+0000 7f55e3400640 1 -- 172.21.15.3:0/106231816 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f55d40cfb00 con 0x7f55ec1049a0 2024-09-19T06:12:31.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.485+0000 7f55e9e00640 1 --2- 172.21.15.3:0/106231816 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f55d00a3440 0x7f55d00a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:31.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.485+0000 7f55e9e00640 1 --2- 172.21.15.3:0/106231816 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f55d00a3440 0x7f55d00a5900 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f55dc006010 tx=0x7f55dc009820 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:31.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.489+0000 7f55e3400640 1 -- 172.21.15.3:0/106231816 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f55d4009de0 con 0x7f55ec1049a0 2024-09-19T06:12:31.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.675+0000 7f55f0e00640 1 -- 172.21.15.3:0/106231816 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55ec10bd70 con 0x7f55ec1049a0 2024-09-19T06:12:31.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.677+0000 7f55e3400640 1 -- 172.21.15.3:0/106231816 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+22955 (secure 0 0 0) 0x7f55d409bcc0 con 0x7f55ec1049a0 2024-09-19T06:12:31.679 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:12:31.679 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":89,"fsid":"782a5144-764c-11ef-bceb-c7b262605968","created":"2024-09-19T06:01:35.224753+0000","modified":"2024-09-19T06:12:22.409698+0000","last_up_change":"2024-09-19T06:09:02.478979+0000","last_in_change":"2024-09-19T06:08:38.865280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:04:56.654478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:09:58.426008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:10:01.215704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd89ea4b-a24e-4946-80fc-1776b6d05e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6803","nonce":2061486638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6805","nonce":2061486638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6809","nonce":2061486638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6807","nonce":2061486638}]},"public_addr":"172.21.15.3:6803/2061486638","cluster_addr":"172.21.15.3:6805/2061486638","heartbeat_back_addr":"172.21.15.3:6809/2061486638","heartbeat_front_addr":"172.21.15.3:6807/2061486638","state":["exists","up"]},{"osd":1,"uuid":"e03ca275-8da5-402f-9cd2-654ca422b9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6801","nonce":129318538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6803","nonce":129318538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6807","nonce":129318538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6805","nonce":129318538}]},"public_addr":"172.21.15.59:6801/129318538","cluster_addr":"172.21.15.59:6803/129318538","heartbeat_back_addr":"172.21.15.59:6807/129318538","heartbeat_front_addr":"172.21.15.59:6805/129318538","state":["exists","up"]},{"osd":2,"uuid":"62b7d36d-6078-4027-93b2-009be70a6d80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6801","nonce":2436210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6803","nonce":2436210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6807","nonce":2436210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6805","nonce":2436210695}]},"public_addr":"172.21.15.71:6801/2436210695","cluster_addr":"172.21.15.71:6803/2436210695","heartbeat_back_addr":"172.21.15.71:6807/2436210695","heartbeat_front_addr":"172.21.15.71:6805/2436210695","state":["exists","up"]},{"osd":3,"uuid":"ba33cc45-0103-443d-b262-622a505d9806","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6811","nonce":3577306700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6813","nonce":3577306700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6817","nonce":3577306700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6815","nonce":3577306700}]},"public_addr":"172.21.15.3:6811/3577306700","cluster_addr":"172.21.15.3:6813/3577306700","heartbeat_back_addr":"172.21.15.3:6817/3577306700","heartbeat_front_addr":"172.21.15.3:6815/3577306700","state":["exists","up"]},{"osd":4,"uuid":"40564c0c-6335-4207-a8e0-8078c9bfd015","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6809","nonce":4002980986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6811","nonce":4002980986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6815","nonce":4002980986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6813","nonce":4002980986}]},"public_addr":"172.21.15.59:6809/4002980986","cluster_addr":"172.21.15.59:6811/4002980986","heartbeat_back_addr":"172.21.15.59:6815/4002980986","heartbeat_front_addr":"172.21.15.59:6813/4002980986","state":["exists","up"]},{"osd":5,"uuid":"4db04b82-3403-4fd5-9eb7-7b81ed6b1d26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6809","nonce":2455500497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6811","nonce":2455500497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6815","nonce":2455500497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6813","nonce":2455500497}]},"public_addr":"172.21.15.71:6809/2455500497","cluster_addr":"172.21.15.71:6811/2455500497","heartbeat_back_addr":"172.21.15.71:6815/2455500497","heartbeat_front_addr":"172.21.15.71:6813/2455500497","state":["exists","up"]},{"osd":6,"uuid":"42a74f01-c5d0-4fc6-a8ee-a8bd84d4ab4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6819","nonce":823411903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6821","nonce":823411903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6825","nonce":823411903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6823","nonce":823411903}]},"public_addr":"172.21.15.3:6819/823411903","cluster_addr":"172.21.15.3:6821/823411903","heartbeat_back_addr":"172.21.15.3:6825/823411903","heartbeat_front_addr":"172.21.15.3:6823/823411903","state":["exists","up"]},{"osd":7,"uuid":"8a9bc2ec-4292-465d-8a0d-dda78521a319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6817","nonce":2133603853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6819","nonce":2133603853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6823","nonce":2133603853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6821","nonce":2133603853}]},"public_addr":"172.21.15.59:6817/2133603853","cluster_addr":"172.21.15.59:6819/2133603853","heartbeat_back_addr":"172.21.15.59:6823/2133603853","heartbeat_front_addr":"172.21.15.59:6821/2133603853","state":["exists","up"]},{"osd":8,"uuid":"6099a5c4-3504-43ca-8c58-d23f9096cd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6817","nonce":905333117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6819","nonce":905333117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6823","nonce":905333117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6821","nonce":905333117}]},"public_addr":"172.21.15.71:6817/905333117","cluster_addr":"172.21.15.71:6819/905333117","heartbeat_back_addr":"172.21.15.71:6823/905333117","heartbeat_front_addr":"172.21.15.71:6821/905333117","state":["exists","up"]},{"osd":9,"uuid":"b5a8aac6-bb10-4db8-a056-25228fbe754c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6827","nonce":124909267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6829","nonce":124909267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6833","nonce":124909267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6831","nonce":124909267}]},"public_addr":"172.21.15.3:6827/124909267","cluster_addr":"172.21.15.3:6829/124909267","heartbeat_back_addr":"172.21.15.3:6833/124909267","heartbeat_front_addr":"172.21.15.3:6831/124909267","state":["exists","up"]},{"osd":10,"uuid":"e49f3aab-0804-4aea-ae3f-38f022ab5239","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6825","nonce":784134238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6827","nonce":784134238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6831","nonce":784134238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6829","nonce":784134238}]},"public_addr":"172.21.15.59:6825/784134238","cluster_addr":"172.21.15.59:6827/784134238","heartbeat_back_addr":"172.21.15.59:6831/784134238","heartbeat_front_addr":"172.21.15.59:6829/784134238","state":["exists","up"]},{"osd":11,"uuid":"6c6d6c23-bcf7-43e7-94d1-5f2ebaa15441","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6825","nonce":3502550915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6827","nonce":3502550915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6831","nonce":3502550915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6829","nonce":3502550915}]},"public_addr":"172.21.15.71:6825/3502550915","cluster_addr":"172.21.15.71:6827/3502550915","heartbeat_back_addr":"172.21.15.71:6831/3502550915","heartbeat_front_addr":"172.21.15.71:6829/3502550915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:01.683342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:28.058683+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:53.250819+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:05:23.267377+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:05:49.756289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:06:15.766613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:06:46.054328+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:12.579180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:37.976863+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:08.683966+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:35.120765+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:00.624411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/3104337397":"2024-09-20T06:12:22.409669+0000","172.21.15.3:0/4101082351":"2024-09-20T06:12:22.409669+0000","172.21.15.3:0/3358701720":"2024-09-20T06:12:22.409669+0000","172.21.15.3:0/1616091100":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/3155841850":"2024-09-20T06:12:22.409669+0000","172.21.15.3:6800/2386230415":"2024-09-20T06:02:01.122348+0000","172.21.15.3:0/2122482494":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6801/2386230415":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6800/1278931596":"2024-09-20T06:12:22.409669+0000","172.21.15.3:0/1658697906":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6801/518259590":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/953348594":"2024-09-20T06:02:01.122348+0000","172.21.15.3:0/2065281908":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/1458736313":"2024-09-20T06:02:30.039686+0000","172.21.15.3:6800/518259590":"2024-09-20T06:02:30.039686+0000","172.21.15.3:6801/1278931596":"2024-09-20T06:12:22.409669+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:12:31.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.679+0000 7f55f0e00640 1 -- 172.21.15.3:0/106231816 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f55d00a3440 msgr2=0x7f55d00a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:31.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.679+0000 7f55f0e00640 1 --2- 172.21.15.3:0/106231816 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f55d00a3440 0x7f55d00a5900 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f55dc006010 tx=0x7f55dc009820 comp rx=0 tx=0).stop 2024-09-19T06:12:31.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.679+0000 7f55f0e00640 1 -- 172.21.15.3:0/106231816 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55ec1049a0 msgr2=0x7f55ec19abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:31.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.679+0000 7f55f0e00640 1 --2- 172.21.15.3:0/106231816 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55ec1049a0 0x7f55ec19abb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f55d400d950 tx=0x7f55d400de10 comp rx=0 tx=0).stop 2024-09-19T06:12:31.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.679+0000 7f55f0e00640 1 -- 172.21.15.3:0/106231816 shutdown_connections 2024-09-19T06:12:31.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.679+0000 7f55f0e00640 1 --2- 172.21.15.3:0/106231816 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f55d00a3440 0x7f55d00a5900 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:31.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.679+0000 7f55f0e00640 1 --2- 172.21.15.3:0/106231816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55ec109120 0x7f55ec19ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:31.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.679+0000 7f55f0e00640 1 --2- 172.21.15.3:0/106231816 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55ec1049a0 0x7f55ec19abb0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:31.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.679+0000 7f55f0e00640 1 --2- 172.21.15.3:0/106231816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55ec103ff0 0x7f55ec19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:31.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.679+0000 7f55f0e00640 1 -- 172.21.15.3:0/106231816 >> 172.21.15.3:0/106231816 conn(0x7f55ec0ffa90 msgr2=0x7f55ec100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:31.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.680+0000 7f55f0e00640 1 -- 172.21.15.3:0/106231816 shutdown_connections 2024-09-19T06:12:31.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:31.680+0000 7f55f0e00640 1 -- 172.21.15.3:0/106231816 wait complete. 2024-09-19T06:12:32.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:31 smithi059 ceph-mon[35138]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 293 B/s wr, 25 op/s 2024-09-19T06:12:32.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:31 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/106231816' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:12:32.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:31 smithi003 ceph-mon[30893]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 293 B/s wr, 25 op/s 2024-09-19T06:12:32.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:31 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/106231816' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:12:32.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:31 smithi071 ceph-mon[35662]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 293 B/s wr, 25 op/s 2024-09-19T06:12:32.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:31 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/106231816' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:12:32.530 DEBUG:tasks.fwd_scrub:Yielding 2024-09-19T06:12:32.530 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T06:12:33.325 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T06:12:33.325 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi003.front.sepia.ceph.com 2024-09-19T06:12:33.325 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-19T06:12:33.326 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-19T06:12:33.326 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:12:33.326 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:12:33.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.497+0000 7f24d6200640 1 -- 172.21.15.3:0/2617942069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24d0101ac0 msgr2=0x7f24d0101f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:33.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.497+0000 7f24d6200640 1 --2- 172.21.15.3:0/2617942069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24d0101ac0 0x7f24d0101f20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f24bc009930 tx=0x7f24bc02a420 comp rx=0 tx=0).stop 2024-09-19T06:12:33.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.497+0000 7f24d6200640 1 -- 172.21.15.3:0/2617942069 shutdown_connections 2024-09-19T06:12:33.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.497+0000 7f24d6200640 1 --2- 172.21.15.3:0/2617942069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24d0102460 0x7f24d010e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:33.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.497+0000 7f24d6200640 1 --2- 172.21.15.3:0/2617942069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24d0101ac0 0x7f24d0101f20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:33.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.497+0000 7f24d6200640 1 --2- 172.21.15.3:0/2617942069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24d0107ad0 0x7f24d0107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:33.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.497+0000 7f24d6200640 1 -- 172.21.15.3:0/2617942069 >> 172.21.15.3:0/2617942069 conn(0x7f24d00fd7e0 msgr2=0x7f24d00ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:33.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.498+0000 7f24d6200640 1 -- 172.21.15.3:0/2617942069 shutdown_connections 2024-09-19T06:12:33.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.498+0000 7f24d6200640 1 -- 172.21.15.3:0/2617942069 wait complete. 2024-09-19T06:12:33.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.498+0000 7f24d6200640 1 Processor -- start 2024-09-19T06:12:33.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.499+0000 7f24d6200640 1 -- start start 2024-09-19T06:12:33.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.499+0000 7f24d6200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24d0101ac0 0x7f24d019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:33.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.499+0000 7f24d6200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24d0102460 0x7f24d019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:33.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.499+0000 7f24d6200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24d0107ad0 0x7f24d019ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:33.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.499+0000 7f24d6200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f24d0111ed0 con 0x7f24d0101ac0 2024-09-19T06:12:33.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.499+0000 7f24d6200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f24d0111d50 con 0x7f24d0107ad0 2024-09-19T06:12:33.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.499+0000 7f24d6200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f24d0112050 con 0x7f24d0102460 2024-09-19T06:12:33.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.499+0000 7f24cf400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24d0101ac0 0x7f24d019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:33.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.499+0000 7f24cea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24d0102460 0x7f24d019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:33.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.499+0000 7f24cf400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24d0101ac0 0x7f24d019a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39464/0 (socket says 172.21.15.3:39464) 2024-09-19T06:12:33.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.499+0000 7f24cfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24d0107ad0 0x7f24d019ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:33.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.499+0000 7f24cf400640 1 -- 172.21.15.3:0/478928300 learned_addr learned my addr 172.21.15.3:0/478928300 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:33.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.500+0000 7f24cfe00640 1 -- 172.21.15.3:0/478928300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24d0102460 msgr2=0x7f24d019abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:33.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.500+0000 7f24cfe00640 1 --2- 172.21.15.3:0/478928300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24d0102460 0x7f24d019abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:33.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.500+0000 7f24cfe00640 1 -- 172.21.15.3:0/478928300 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24d0101ac0 msgr2=0x7f24d019a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:33.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.500+0000 7f24cfe00640 1 --2- 172.21.15.3:0/478928300 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24d0101ac0 0x7f24d019a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:33.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.500+0000 7f24cfe00640 1 -- 172.21.15.3:0/478928300 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d019f680 con 0x7f24d0107ad0 2024-09-19T06:12:33.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.500+0000 7f24cfe00640 1 --2- 172.21.15.3:0/478928300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24d0107ad0 0x7f24d019ef50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f24c8009fd0 tx=0x7f24c800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:33.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.500+0000 7f24c7e00640 1 -- 172.21.15.3:0/478928300 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c800ce20 con 0x7f24d0107ad0 2024-09-19T06:12:33.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.500+0000 7f24d6200640 1 -- 172.21.15.3:0/478928300 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d019f970 con 0x7f24d0107ad0 2024-09-19T06:12:33.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.500+0000 7f24c7e00640 1 -- 172.21.15.3:0/478928300 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24c8005020 con 0x7f24d0107ad0 2024-09-19T06:12:33.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.500+0000 7f24c7e00640 1 -- 172.21.15.3:0/478928300 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c8010720 con 0x7f24d0107ad0 2024-09-19T06:12:33.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.500+0000 7f24d6200640 1 -- 172.21.15.3:0/478928300 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d01a7200 con 0x7f24d0107ad0 2024-09-19T06:12:33.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.502+0000 7f24d6200640 1 -- 172.21.15.3:0/478928300 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d0103200 con 0x7f24d0107ad0 2024-09-19T06:12:33.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.504+0000 7f24c7e00640 1 -- 172.21.15.3:0/478928300 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 138530+0+0 (secure 0 0 0) 0x7f24c8005540 con 0x7f24d0107ad0 2024-09-19T06:12:33.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.505+0000 7f24c7e00640 1 --2- 172.21.15.3:0/478928300 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f24b40a3440 0x7f24b40a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:33.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.505+0000 7f24c7e00640 1 -- 172.21.15.3:0/478928300 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f24c80d0790 con 0x7f24d0107ad0 2024-09-19T06:12:33.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.505+0000 7f24cf400640 1 --2- 172.21.15.3:0/478928300 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f24b40a3440 0x7f24b40a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:33.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.506+0000 7f24cf400640 1 --2- 172.21.15.3:0/478928300 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f24b40a3440 0x7f24b40a5900 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f24c0005fd0 tx=0x7f24c000b480 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:33.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.507+0000 7f24c7e00640 1 -- 172.21.15.3:0/478928300 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f24c809cfa0 con 0x7f24d0107ad0 2024-09-19T06:12:33.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.707+0000 7f24d6200640 1 -- 172.21.15.3:0/478928300 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f24d0101f20 con 0x7f24d0107ad0 2024-09-19T06:12:33.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.713+0000 7f24c7e00640 1 -- 172.21.15.3:0/478928300 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v30)=0 v30) ==== 129+0+0 (secure 0 0 0) 0x7f24d0101f20 con 0x7f24d0107ad0 2024-09-19T06:12:33.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.716+0000 7f24d6200640 1 -- 172.21.15.3:0/478928300 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f24b40a3440 msgr2=0x7f24b40a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:33.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.716+0000 7f24d6200640 1 --2- 172.21.15.3:0/478928300 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f24b40a3440 0x7f24b40a5900 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f24c0005fd0 tx=0x7f24c000b480 comp rx=0 tx=0).stop 2024-09-19T06:12:33.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.716+0000 7f24d6200640 1 -- 172.21.15.3:0/478928300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24d0107ad0 msgr2=0x7f24d019ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:33.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.716+0000 7f24d6200640 1 --2- 172.21.15.3:0/478928300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24d0107ad0 0x7f24d019ef50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f24c8009fd0 tx=0x7f24c800ef10 comp rx=0 tx=0).stop 2024-09-19T06:12:33.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.716+0000 7f24d6200640 1 -- 172.21.15.3:0/478928300 shutdown_connections 2024-09-19T06:12:33.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.716+0000 7f24d6200640 1 --2- 172.21.15.3:0/478928300 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f24b40a3440 0x7f24b40a5900 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:33.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.716+0000 7f24d6200640 1 --2- 172.21.15.3:0/478928300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24d0107ad0 0x7f24d019ef50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:33.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.716+0000 7f24d6200640 1 --2- 172.21.15.3:0/478928300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24d0102460 0x7f24d019abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:33.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.716+0000 7f24d6200640 1 --2- 172.21.15.3:0/478928300 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24d0101ac0 0x7f24d019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:33.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.716+0000 7f24d6200640 1 -- 172.21.15.3:0/478928300 >> 172.21.15.3:0/478928300 conn(0x7f24d00fd7e0 msgr2=0x7f24d010d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:33.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.716+0000 7f24d6200640 1 -- 172.21.15.3:0/478928300 shutdown_connections 2024-09-19T06:12:33.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.716+0000 7f24d6200640 1 -- 172.21.15.3:0/478928300 wait complete. 2024-09-19T06:12:33.738 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-19T06:12:33.743 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:33.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.904+0000 7f12e5a00640 1 -- 172.21.15.3:0/2047475382 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f12e0101ac0 msgr2=0x7f12e0101f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:33.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.904+0000 7f12e5a00640 1 --2- 172.21.15.3:0/2047475382 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f12e0101ac0 0x7f12e0101f20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009930 tx=0x7f12c802a420 comp rx=0 tx=0).stop 2024-09-19T06:12:33.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.905+0000 7f12e5a00640 1 -- 172.21.15.3:0/2047475382 shutdown_connections 2024-09-19T06:12:33.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.905+0000 7f12e5a00640 1 --2- 172.21.15.3:0/2047475382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12e0102460 0x7f12e010e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:33.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.905+0000 7f12e5a00640 1 --2- 172.21.15.3:0/2047475382 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f12e0101ac0 0x7f12e0101f20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:33.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.905+0000 7f12e5a00640 1 --2- 172.21.15.3:0/2047475382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e0107ad0 0x7f12e0107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:33.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.905+0000 7f12e5a00640 1 -- 172.21.15.3:0/2047475382 >> 172.21.15.3:0/2047475382 conn(0x7f12e00fd7a0 msgr2=0x7f12e00ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:33.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.905+0000 7f12e5a00640 1 -- 172.21.15.3:0/2047475382 shutdown_connections 2024-09-19T06:12:33.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.905+0000 7f12e5a00640 1 -- 172.21.15.3:0/2047475382 wait complete. 2024-09-19T06:12:33.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.906+0000 7f12e5a00640 1 Processor -- start 2024-09-19T06:12:33.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.906+0000 7f12e5a00640 1 -- start start 2024-09-19T06:12:33.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.906+0000 7f12e5a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f12e0101ac0 0x7f12e019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:33.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.906+0000 7f12e5a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e0102460 0x7f12e019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:33.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.906+0000 7f12e5a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12e0107ad0 0x7f12e019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:33.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.906+0000 7f12e5a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f12e0111f10 con 0x7f12e0101ac0 2024-09-19T06:12:33.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.906+0000 7f12e5a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f12e0111d90 con 0x7f12e0102460 2024-09-19T06:12:33.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.906+0000 7f12e5a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f12e0112090 con 0x7f12e0107ad0 2024-09-19T06:12:33.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.906+0000 7f12dea00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f12e0101ac0 0x7f12e019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:33.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.906+0000 7f12d7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e0102460 0x7f12e019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:33.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.906+0000 7f12dea00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f12e0101ac0 0x7f12e019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53854/0 (socket says 172.21.15.3:53854) 2024-09-19T06:12:33.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.906+0000 7f12dea00640 1 -- 172.21.15.3:0/314510833 learned_addr learned my addr 172.21.15.3:0/314510833 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:33.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.906+0000 7f12df400640 1 --2- 172.21.15.3:0/314510833 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12e0107ad0 0x7f12e019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:33.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.907+0000 7f12dea00640 1 -- 172.21.15.3:0/314510833 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12e0107ad0 msgr2=0x7f12e019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:33.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.907+0000 7f12dea00640 1 --2- 172.21.15.3:0/314510833 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12e0107ad0 0x7f12e019ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:33.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.907+0000 7f12dea00640 1 -- 172.21.15.3:0/314510833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e0102460 msgr2=0x7f12e019aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:33.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.907+0000 7f12dea00640 1 --2- 172.21.15.3:0/314510833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e0102460 0x7f12e019aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:33.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.907+0000 7f12dea00640 1 -- 172.21.15.3:0/314510833 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e019f650 con 0x7f12e0101ac0 2024-09-19T06:12:33.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.907+0000 7f12d7e00640 1 --2- 172.21.15.3:0/314510833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e0102460 0x7f12e019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:33.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.907+0000 7f12dea00640 1 --2- 172.21.15.3:0/314510833 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f12e0101ac0 0x7f12e019a660 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f12d000d950 tx=0x7f12d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:33.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.907+0000 7f12d7400640 1 -- 172.21.15.3:0/314510833 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d0017030 con 0x7f12e0101ac0 2024-09-19T06:12:33.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.907+0000 7f12d7400640 1 -- 172.21.15.3:0/314510833 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12d0004020 con 0x7f12e0101ac0 2024-09-19T06:12:33.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.907+0000 7f12e5a00640 1 -- 172.21.15.3:0/314510833 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12e019f940 con 0x7f12e0101ac0 2024-09-19T06:12:33.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.907+0000 7f12d7400640 1 -- 172.21.15.3:0/314510833 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d00047a0 con 0x7f12e0101ac0 2024-09-19T06:12:33.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.908+0000 7f12e5a00640 1 -- 172.21.15.3:0/314510833 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12e01a71d0 con 0x7f12e0101ac0 2024-09-19T06:12:33.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.909+0000 7f12e5a00640 1 -- 172.21.15.3:0/314510833 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12e0101f20 con 0x7f12e0101ac0 2024-09-19T06:12:33.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.910+0000 7f12d7400640 1 -- 172.21.15.3:0/314510833 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 25) ==== 138530+0+0 (secure 0 0 0) 0x7f12d00041d0 con 0x7f12e0101ac0 2024-09-19T06:12:33.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.912+0000 7f12d7400640 1 --2- 172.21.15.3:0/314510833 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f12c40a34c0 0x7f12c40a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:33.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.912+0000 7f12d7400640 1 -- 172.21.15.3:0/314510833 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f12d00cf740 con 0x7f12e0101ac0 2024-09-19T06:12:33.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.912+0000 7f12d7e00640 1 --2- 172.21.15.3:0/314510833 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f12c40a34c0 0x7f12c40a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:33.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.913+0000 7f12d7e00640 1 --2- 172.21.15.3:0/314510833 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f12c40a34c0 0x7f12c40a5980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009900 tx=0x7f12c80058d0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:33.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:33.916+0000 7f12d7400640 1 -- 172.21.15.3:0/314510833 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f12d009bf50 con 0x7f12e0101ac0 2024-09-19T06:12:34.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.109+0000 7f12e5a00640 1 -- 172.21.15.3:0/314510833 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f12e01a7460 con 0x7f12e0101ac0 2024-09-19T06:12:34.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.113+0000 7f12d7400640 1 -- 172.21.15.3:0/314510833 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v31)=0 v31) ==== 138+0+0 (secure 0 0 0) 0x7f12d009b850 con 0x7f12e0101ac0 2024-09-19T06:12:34.118 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.116+0000 7f12e5a00640 1 -- 172.21.15.3:0/314510833 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f12c40a34c0 msgr2=0x7f12c40a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:34.120 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.116+0000 7f12e5a00640 1 --2- 172.21.15.3:0/314510833 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f12c40a34c0 0x7f12c40a5980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009900 tx=0x7f12c80058d0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.120 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.116+0000 7f12e5a00640 1 -- 172.21.15.3:0/314510833 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f12e0101ac0 msgr2=0x7f12e019a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:34.120 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.116+0000 7f12e5a00640 1 --2- 172.21.15.3:0/314510833 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f12e0101ac0 0x7f12e019a660 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f12d000d950 tx=0x7f12d000de10 comp rx=0 tx=0).stop 2024-09-19T06:12:34.120 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.116+0000 7f12e5a00640 1 -- 172.21.15.3:0/314510833 shutdown_connections 2024-09-19T06:12:34.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.116+0000 7f12e5a00640 1 --2- 172.21.15.3:0/314510833 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f12c40a34c0 0x7f12c40a5980 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.116+0000 7f12e5a00640 1 --2- 172.21.15.3:0/314510833 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f12e0107ad0 0x7f12e019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.116+0000 7f12e5a00640 1 --2- 172.21.15.3:0/314510833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e0102460 0x7f12e019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.116+0000 7f12e5a00640 1 --2- 172.21.15.3:0/314510833 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f12e0101ac0 0x7f12e019a660 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.116+0000 7f12e5a00640 1 -- 172.21.15.3:0/314510833 >> 172.21.15.3:0/314510833 conn(0x7f12e00fd7a0 msgr2=0x7f12e00fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:34.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.117+0000 7f12e5a00640 1 -- 172.21.15.3:0/314510833 shutdown_connections 2024-09-19T06:12:34.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.117+0000 7f12e5a00640 1 -- 172.21.15.3:0/314510833 wait complete. 2024-09-19T06:12:34.140 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-19T06:12:34.287 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:33 smithi003 ceph-mon[30893]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 228 B/s wr, 19 op/s 2024-09-19T06:12:34.287 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:33 smithi003 ceph-mon[30893]: from='client.? ' entity='client.admin' 2024-09-19T06:12:34.287 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:33 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:34.287 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:33 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:34.287 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:33 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:34.287 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:33 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:34.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:33 smithi059 ceph-mon[35138]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 228 B/s wr, 19 op/s 2024-09-19T06:12:34.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:33 smithi059 ceph-mon[35138]: from='client.? ' entity='client.admin' 2024-09-19T06:12:34.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:33 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:34.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:33 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:34.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:33 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:34.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:33 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:34.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.300+0000 7f31f7200640 1 -- 172.21.15.3:0/745546425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31f8102ae0 msgr2=0x7f31f8102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:34.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.300+0000 7f31f7200640 1 --2- 172.21.15.3:0/745546425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31f8102ae0 0x7f31f8102ec0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f31e8009900 tx=0x7f31e802a480 comp rx=0 tx=0).stop 2024-09-19T06:12:34.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.300+0000 7f31f7200640 1 -- 172.21.15.3:0/745546425 shutdown_connections 2024-09-19T06:12:34.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.300+0000 7f31f7200640 1 --2- 172.21.15.3:0/745546425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31f810bf30 0x7f31f810e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.300+0000 7f31f7200640 1 --2- 172.21.15.3:0/745546425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31f8103400 0x7f31f810b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.300+0000 7f31f7200640 1 --2- 172.21.15.3:0/745546425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31f8102ae0 0x7f31f8102ec0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.300+0000 7f31f7200640 1 -- 172.21.15.3:0/745546425 >> 172.21.15.3:0/745546425 conn(0x7f31f80777f0 msgr2=0x7f31f80feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:34.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.301+0000 7f31f7200640 1 -- 172.21.15.3:0/745546425 shutdown_connections 2024-09-19T06:12:34.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.301+0000 7f31f7200640 1 -- 172.21.15.3:0/745546425 wait complete. 2024-09-19T06:12:34.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.302+0000 7f31f7200640 1 Processor -- start 2024-09-19T06:12:34.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.302+0000 7f31f7200640 1 -- start start 2024-09-19T06:12:34.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.302+0000 7f31f7200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31f8102ae0 0x7f31f819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.302+0000 7f31f7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31f8103400 0x7f31f819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.302+0000 7f31f7200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31f810bf30 0x7f31f819ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.302+0000 7f31f7200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f31f8111d60 con 0x7f31f810bf30 2024-09-19T06:12:34.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.302+0000 7f31f7200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f31f8111be0 con 0x7f31f8103400 2024-09-19T06:12:34.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.302+0000 7f31f7200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f31f8111ee0 con 0x7f31f8102ae0 2024-09-19T06:12:34.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.302+0000 7f31f5e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31f8102ae0 0x7f31f819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.302+0000 7f31f5e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31f8102ae0 0x7f31f819a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:42688/0 (socket says 172.21.15.3:42688) 2024-09-19T06:12:34.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.302+0000 7f31f5e00640 1 -- 172.21.15.3:0/1453850254 learned_addr learned my addr 172.21.15.3:0/1453850254 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:34.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.302+0000 7f31f5400640 1 --2- 172.21.15.3:0/1453850254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31f8103400 0x7f31f819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.302+0000 7f31f6800640 1 --2- 172.21.15.3:0/1453850254 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31f810bf30 0x7f31f819ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.303+0000 7f31f5e00640 1 -- 172.21.15.3:0/1453850254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31f8103400 msgr2=0x7f31f819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:34.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.303+0000 7f31f5e00640 1 --2- 172.21.15.3:0/1453850254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31f8103400 0x7f31f819a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.303+0000 7f31f5e00640 1 -- 172.21.15.3:0/1453850254 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31f810bf30 msgr2=0x7f31f819ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:34.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.303+0000 7f31f5e00640 1 --2- 172.21.15.3:0/1453850254 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31f810bf30 0x7f31f819ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.303+0000 7f31f5e00640 1 -- 172.21.15.3:0/1453850254 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f819f490 con 0x7f31f8102ae0 2024-09-19T06:12:34.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.303+0000 7f31f6800640 1 --2- 172.21.15.3:0/1453850254 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31f810bf30 0x7f31f819ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:12:34.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.303+0000 7f31f5e00640 1 --2- 172.21.15.3:0/1453850254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31f8102ae0 0x7f31f819a4a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f31e8004770 tx=0x7f31e8003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:34.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.303+0000 7f31eea00640 1 -- 172.21.15.3:0/1453850254 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e803f070 con 0x7f31f8102ae0 2024-09-19T06:12:34.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.303+0000 7f31eea00640 1 -- 172.21.15.3:0/1453850254 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31e8031ca0 con 0x7f31f8102ae0 2024-09-19T06:12:34.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.304+0000 7f31eea00640 1 -- 172.21.15.3:0/1453850254 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e8035030 con 0x7f31f8102ae0 2024-09-19T06:12:34.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.304+0000 7f31f7200640 1 -- 172.21.15.3:0/1453850254 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31f819f720 con 0x7f31f8102ae0 2024-09-19T06:12:34.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.304+0000 7f31f7200640 1 -- 172.21.15.3:0/1453850254 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31f81a7010 con 0x7f31f8102ae0 2024-09-19T06:12:34.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.305+0000 7f31f7200640 1 -- 172.21.15.3:0/1453850254 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31f8102ec0 con 0x7f31f8102ae0 2024-09-19T06:12:34.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.307+0000 7f31eea00640 1 -- 172.21.15.3:0/1453850254 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 138530+0+0 (secure 0 0 0) 0x7f31e8042070 con 0x7f31f8102ae0 2024-09-19T06:12:34.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.308+0000 7f31eea00640 1 --2- 172.21.15.3:0/1453850254 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f31dc0a34b0 0x7f31dc0a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.308+0000 7f31eea00640 1 -- 172.21.15.3:0/1453850254 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f31e80f0ab0 con 0x7f31f8102ae0 2024-09-19T06:12:34.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.308+0000 7f31f5400640 1 --2- 172.21.15.3:0/1453850254 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f31dc0a34b0 0x7f31dc0a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.309+0000 7f31f5400640 1 --2- 172.21.15.3:0/1453850254 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f31dc0a34b0 0x7f31dc0a5970 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f31f8101a00 tx=0x7f31e4005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:34.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.310+0000 7f31eea00640 1 -- 172.21.15.3:0/1453850254 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f31e80bd380 con 0x7f31f8102ae0 2024-09-19T06:12:34.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:33 smithi071 ceph-mon[35662]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 228 B/s wr, 19 op/s 2024-09-19T06:12:34.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:33 smithi071 ceph-mon[35662]: from='client.? ' entity='client.admin' 2024-09-19T06:12:34.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:33 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:34.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:33 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:34.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:33 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:34.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:33 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:34.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.406+0000 7f5e8de00640 1 -- 172.21.15.3:0/34953478 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e881049a0 msgr2=0x7f5e881089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:34.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.406+0000 7f5e8de00640 1 --2- 172.21.15.3:0/34953478 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e881049a0 0x7f5e881089f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5e74009900 tx=0x7f5e7402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.406+0000 7f5e8de00640 1 -- 172.21.15.3:0/34953478 shutdown_connections 2024-09-19T06:12:34.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.406+0000 7f5e8de00640 1 --2- 172.21.15.3:0/34953478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e88109120 0x7f5e88110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.406+0000 7f5e8de00640 1 --2- 172.21.15.3:0/34953478 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e881049a0 0x7f5e881089f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.406+0000 7f5e8de00640 1 --2- 172.21.15.3:0/34953478 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e88103ff0 0x7f5e881043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.406+0000 7f5e8de00640 1 -- 172.21.15.3:0/34953478 >> 172.21.15.3:0/34953478 conn(0x7f5e880ffa90 msgr2=0x7f5e88101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:34.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.406+0000 7f5e8de00640 1 -- 172.21.15.3:0/34953478 shutdown_connections 2024-09-19T06:12:34.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.406+0000 7f5e8de00640 1 -- 172.21.15.3:0/34953478 wait complete. 2024-09-19T06:12:34.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.407+0000 7f5e8de00640 1 Processor -- start 2024-09-19T06:12:34.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.407+0000 7f5e8de00640 1 -- start start 2024-09-19T06:12:34.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.408+0000 7f5e8de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e88103ff0 0x7f5e8819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.408+0000 7f5e8de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e881049a0 0x7f5e8819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.408+0000 7f5e8de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e88109120 0x7f5e8819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.408+0000 7f5e8de00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5e88114190 con 0x7f5e88103ff0 2024-09-19T06:12:34.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.408+0000 7f5e8de00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5e88114010 con 0x7f5e881049a0 2024-09-19T06:12:34.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.408+0000 7f5e8de00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5e88114310 con 0x7f5e88109120 2024-09-19T06:12:34.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.408+0000 7f5e86a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e88103ff0 0x7f5e8819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.408+0000 7f5e86000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e881049a0 0x7f5e8819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.408+0000 7f5e86000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e881049a0 0x7f5e8819ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40372/0 (socket says 172.21.15.3:40372) 2024-09-19T06:12:34.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.408+0000 7f5e86a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e88103ff0 0x7f5e8819a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53912/0 (socket says 172.21.15.3:53912) 2024-09-19T06:12:34.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.408+0000 7f5e86000640 1 -- 172.21.15.3:0/3065645644 learned_addr learned my addr 172.21.15.3:0/3065645644 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:34.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.408+0000 7f5e87400640 1 --2- 172.21.15.3:0/3065645644 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e88109120 0x7f5e8819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.409+0000 7f5e86a00640 1 -- 172.21.15.3:0/3065645644 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e88109120 msgr2=0x7f5e8819eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:34.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.409+0000 7f5e86a00640 1 --2- 172.21.15.3:0/3065645644 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e88109120 0x7f5e8819eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.409+0000 7f5e86a00640 1 -- 172.21.15.3:0/3065645644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e881049a0 msgr2=0x7f5e8819ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:34.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.409+0000 7f5e86a00640 1 --2- 172.21.15.3:0/3065645644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e881049a0 0x7f5e8819ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.409+0000 7f5e86a00640 1 -- 172.21.15.3:0/3065645644 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e8819f5c0 con 0x7f5e88103ff0 2024-09-19T06:12:34.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.409+0000 7f5e86000640 1 --2- 172.21.15.3:0/3065645644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e881049a0 0x7f5e8819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:34.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.409+0000 7f5e86a00640 1 --2- 172.21.15.3:0/3065645644 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e88103ff0 0x7f5e8819a610 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800e9f0 tx=0x7f5e7800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:34.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.409+0000 7f5e8ca00640 1 -- 172.21.15.3:0/3065645644 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7800ccc0 con 0x7f5e88103ff0 2024-09-19T06:12:34.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.410+0000 7f5e8ca00640 1 -- 172.21.15.3:0/3065645644 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e78005020 con 0x7f5e88103ff0 2024-09-19T06:12:34.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.410+0000 7f5e8de00640 1 -- 172.21.15.3:0/3065645644 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e8819f8b0 con 0x7f5e88103ff0 2024-09-19T06:12:34.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.410+0000 7f5e8ca00640 1 -- 172.21.15.3:0/3065645644 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e780049e0 con 0x7f5e88103ff0 2024-09-19T06:12:34.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.410+0000 7f5e8de00640 1 -- 172.21.15.3:0/3065645644 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e881a7190 con 0x7f5e88103ff0 2024-09-19T06:12:34.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.413+0000 7f5e908ce740 1 Processor -- start 2024-09-19T06:12:34.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.413+0000 7f5e908ce740 1 -- start start 2024-09-19T06:12:34.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.413+0000 7f5e8ca00640 1 -- 172.21.15.3:0/3065645644 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 25) ==== 138530+0+0 (secure 0 0 0) 0x7f5e78005560 con 0x7f5e88103ff0 2024-09-19T06:12:34.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.413+0000 7f5e908ce740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e812ac0 0x56507e812ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.413+0000 7f5e908ce740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56507e8133e0 0x56507e81d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.413+0000 7f5e908ce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56507e81dca0 0x56507e820090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.413+0000 7f5e908ce740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56507e779290 con 0x56507e8133e0 2024-09-19T06:12:34.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.413+0000 7f5e908ce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56507e720b40 con 0x56507e81dca0 2024-09-19T06:12:34.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.413+0000 7f5e908ce740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56507e775250 con 0x56507e812ac0 2024-09-19T06:12:34.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.414+0000 7f5e87400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e812ac0 0x56507e812ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.414+0000 7f5e87400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e812ac0 0x56507e812ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:42710/0 (socket says 172.21.15.3:42710) 2024-09-19T06:12:34.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.414+0000 7f5e87400640 1 -- 172.21.15.3:0/514458380 learned_addr learned my addr 172.21.15.3:0/514458380 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:34.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.414+0000 7f5e86000640 1 --2- 172.21.15.3:0/514458380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56507e81dca0 0x56507e820090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.414+0000 7f5e86a00640 1 --2- 172.21.15.3:0/514458380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56507e8133e0 0x56507e81d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.414+0000 7f5e87400640 1 -- 172.21.15.3:0/514458380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56507e81dca0 msgr2=0x56507e820090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:34.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.414+0000 7f5e87400640 1 --2- 172.21.15.3:0/514458380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56507e81dca0 0x56507e820090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.414+0000 7f5e87400640 1 -- 172.21.15.3:0/514458380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56507e8133e0 msgr2=0x56507e81d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:34.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.414+0000 7f5e87400640 1 --2- 172.21.15.3:0/514458380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56507e8133e0 0x56507e81d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.414+0000 7f5e87400640 1 -- 172.21.15.3:0/514458380 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56507e4ea6a0 con 0x56507e812ac0 2024-09-19T06:12:34.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.415+0000 7f5e87400640 1 --2- 172.21.15.3:0/514458380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e812ac0 0x56507e812ea0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009f50 tx=0x7f5e800118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e71a676750922a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:34.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.415+0000 7f5e73e00640 1 -- 172.21.15.3:0/514458380 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e80004d20 con 0x56507e812ac0 2024-09-19T06:12:34.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.415+0000 7f5e73e00640 1 -- 172.21.15.3:0/514458380 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e80004050 con 0x56507e812ac0 2024-09-19T06:12:34.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.415+0000 7f5e73e00640 1 -- 172.21.15.3:0/514458380 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e80005260 con 0x56507e812ac0 2024-09-19T06:12:34.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.415+0000 7f5e8ca00640 1 --2- 172.21.15.3:0/3065645644 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f5e6c0a3440 0x7f5e6c0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.416+0000 7f5e908ce740 1 -- 172.21.15.3:0/514458380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e812ac0 msgr2=0x56507e812ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:34.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.416+0000 7f5e908ce740 1 --2- 172.21.15.3:0/514458380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e812ac0 0x56507e812ea0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009f50 tx=0x7f5e800118d0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.416+0000 7f5e8ca00640 1 -- 172.21.15.3:0/3065645644 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f5e780cfea0 con 0x7f5e88103ff0 2024-09-19T06:12:34.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.416+0000 7f5e86a00640 1 --2- 172.21.15.3:0/3065645644 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f5e6c0a3440 0x7f5e6c0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.416+0000 7f5e908ce740 1 -- 172.21.15.3:0/514458380 shutdown_connections 2024-09-19T06:12:34.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.416+0000 7f5e908ce740 1 --2- 172.21.15.3:0/514458380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56507e81dca0 0x56507e820090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.416+0000 7f5e908ce740 1 --2- 172.21.15.3:0/514458380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56507e8133e0 0x56507e81d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.416+0000 7f5e908ce740 1 --2- 172.21.15.3:0/514458380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e812ac0 0x56507e812ea0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.416+0000 7f5e908ce740 1 -- 172.21.15.3:0/514458380 >> 172.21.15.3:0/514458380 conn(0x56507e80f050 msgr2=0x56507e80f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:34.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.416+0000 7f5e908ce740 1 -- 172.21.15.3:0/514458380 shutdown_connections 2024-09-19T06:12:34.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.416+0000 7f5e908ce740 1 -- 172.21.15.3:0/514458380 wait complete. 2024-09-19T06:12:34.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.417+0000 7f5e86a00640 1 --2- 172.21.15.3:0/3065645644 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f5e6c0a3440 0x7f5e6c0a5900 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5e780cd530 tx=0x7f5e780054d0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:34.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.417+0000 7f5e908ce740 1 -- start start 2024-09-19T06:12:34.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.417+0000 7f5e908ce740 1 Processor -- start 2024-09-19T06:12:34.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.417+0000 7f5e908ce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56507e812ac0 0x56507e81d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.417+0000 7f5e908ce740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e8133e0 0x56507e81a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.418+0000 7f5e908ce740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56507e81dca0 0x56507e81adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.418+0000 7f5e908ce740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56507e820910 con 0x56507e81dca0 2024-09-19T06:12:34.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.418+0000 7f5e908ce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56507e733fa0 con 0x56507e812ac0 2024-09-19T06:12:34.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.418+0000 7f5e908ce740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56507e820a90 con 0x56507e8133e0 2024-09-19T06:12:34.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.418+0000 7f5e908ce740 10 client.0 _ll_register_callbacks cb 0x56507e487ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:34.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.418+0000 7f5e87400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56507e812ac0 0x56507e81d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.418+0000 7f5e86000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e8133e0 0x56507e81a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.418+0000 7f5e87400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56507e812ac0 0x56507e81d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40396/0 (socket says 172.21.15.3:40396) 2024-09-19T06:12:34.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.418+0000 7f5e87400640 1 -- 172.21.15.3:0/1426307741 learned_addr learned my addr 172.21.15.3:0/1426307741 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:34.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.418+0000 7f5e87400640 1 --2- 172.21.15.3:0/1426307741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56507e81dca0 0x56507e81adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.418+0000 7f5e86000640 1 -- 172.21.15.3:0/1426307741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56507e812ac0 msgr2=0x56507e81d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:34.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.418+0000 7f5e86000640 1 --2- 172.21.15.3:0/1426307741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56507e812ac0 0x56507e81d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.418+0000 7f5e86000640 1 -- 172.21.15.3:0/1426307741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56507e81dca0 msgr2=0x56507e81adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:34.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.418+0000 7f5e86000640 1 --2- 172.21.15.3:0/1426307741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56507e81dca0 0x56507e81adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.418+0000 7f5e86000640 1 -- 172.21.15.3:0/1426307741 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56507e81b5f0 con 0x56507e8133e0 2024-09-19T06:12:34.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.419+0000 7f5e86000640 1 --2- 172.21.15.3:0/1426307741 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e8133e0 0x56507e81a880 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5e74000c00 tx=0x7f5e740035f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c6db2afba26ca39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:34.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.419+0000 7f5e70c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:12:34.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.419+0000 7f5e70c00640 1 -- 172.21.15.3:0/1426307741 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74035040 con 0x56507e8133e0 2024-09-19T06:12:34.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.419+0000 7f5e908ce740 1 -- 172.21.15.3:0/1426307741 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e80004050 con 0x56507e8133e0 2024-09-19T06:12:34.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.419+0000 7f5e70c00640 1 -- 172.21.15.3:0/1426307741 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f5e74003cb0 con 0x56507e8133e0 2024-09-19T06:12:34.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.420+0000 7f5e70c00640 1 -- 172.21.15.3:0/1426307741 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5e74005020 con 0x56507e8133e0 2024-09-19T06:12:34.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.420+0000 7f5e908ce740 10 client.25303 fetch_fsmap learned FSMap version 29 2024-09-19T06:12:34.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.420+0000 7f5e908ce740 1 -- 172.21.15.3:0/1426307741 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56507e82c870 con 0x56507e8133e0 2024-09-19T06:12:34.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.420+0000 7f5e70c00640 1 -- 172.21.15.3:0/1426307741 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e80004050 con 0x56507e8133e0 2024-09-19T06:12:34.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.420+0000 7f5e70c00640 1 -- 172.21.15.3:0/1426307741 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f5e740315b0 con 0x56507e8133e0 2024-09-19T06:12:34.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.420+0000 7f5e908ce740 10 client.25303 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:12:34.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.420+0000 7f5e908ce740 10 client.25303 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:12:34.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.420+0000 7f5e908ce740 20 client.25303 populate_metadata read hostname 'smithi003' 2024-09-19T06:12:34.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.420+0000 7f5e908ce740 1 --2- 172.21.15.3:0/1426307741 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56507e82dc80 0x56507e830070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.420+0000 7f5e908ce740 4 client.25303 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:12:34.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.420+0000 7f5e908ce740 1 -- 172.21.15.3:0/1426307741 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56507e786800 con 0x56507e82dc80 2024-09-19T06:12:34.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.421+0000 7f5e87400640 1 --2- 172.21.15.3:0/1426307741 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56507e82dc80 0x56507e830070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.421+0000 7f5e87400640 1 --2- 172.21.15.3:0/1426307741 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56507e82dc80 0x56507e830070 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f386033ff871ec4 server_cookie=e614f648bc1a0899 in_seq=0 out_seq=0 2024-09-19T06:12:34.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.421+0000 7f5e70c00640 10 client.25303 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:12:34.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.422+0000 7f5e70c00640 1 -- 172.21.15.3:0/1426307741 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56507e786800 con 0x56507e82dc80 2024-09-19T06:12:34.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.422+0000 7f5e70c00640 10 client.25303 handle_command_reply: tid=0 2024-09-19T06:12:34.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.422+0000 7f5e908ce740 1 client.25303 shutdown 2024-09-19T06:12:34.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.422+0000 7f5e908ce740 1 -- 172.21.15.3:0/1426307741 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e8133e0 msgr2=0x56507e81a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:34.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.422+0000 7f5e908ce740 1 --2- 172.21.15.3:0/1426307741 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e8133e0 0x56507e81a880 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5e74000c00 tx=0x7f5e740035f0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.423+0000 7f5e908ce740 1 -- 172.21.15.3:0/1426307741 shutdown_connections 2024-09-19T06:12:34.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.423+0000 7f5e908ce740 1 --2- 172.21.15.3:0/1426307741 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56507e82dc80 0x56507e830070 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.423+0000 7f5e908ce740 1 --2- 172.21.15.3:0/1426307741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56507e81dca0 0x56507e81adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.423+0000 7f5e908ce740 1 --2- 172.21.15.3:0/1426307741 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e8133e0 0x56507e81a880 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.423+0000 7f5e70c00640 0 client.25303 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:12:34.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.423+0000 7f5e908ce740 1 --2- 172.21.15.3:0/1426307741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56507e812ac0 0x56507e81d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.423+0000 7f5e908ce740 1 -- 172.21.15.3:0/1426307741 >> 172.21.15.3:0/1426307741 conn(0x56507e80f050 msgr2=0x56507e80e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:34.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.423+0000 7f5e908ce740 1 -- 172.21.15.3:0/1426307741 shutdown_connections 2024-09-19T06:12:34.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.423+0000 7f5e908ce740 1 -- 172.21.15.3:0/1426307741 wait complete. 2024-09-19T06:12:34.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.423+0000 7f5e908ce740 20 client.25303 trim_cache size 0 max 16384 2024-09-19T06:12:34.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.441+0000 7f5e908ce740 1 Processor -- start 2024-09-19T06:12:34.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.441+0000 7f5e908ce740 1 -- start start 2024-09-19T06:12:34.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.442+0000 7f5e908ce740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e812ac0 0x56507e814c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.442+0000 7f5e908ce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56507e8133e0 0x56507e835940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.442+0000 7f5e908ce740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56507e81dca0 0x56507e835e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.442+0000 7f5e908ce740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5e881afaa0 con 0x56507e81dca0 2024-09-19T06:12:34.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.442+0000 7f5e908ce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5e881b15e0 con 0x56507e8133e0 2024-09-19T06:12:34.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.442+0000 7f5e908ce740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5e881b0170 con 0x56507e812ac0 2024-09-19T06:12:34.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.442+0000 7f5e87400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56507e81dca0 0x56507e835e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.442+0000 7f5e86000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56507e8133e0 0x56507e835940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.442+0000 7f5e87400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56507e81dca0 0x56507e835e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53950/0 (socket says 172.21.15.3:53950) 2024-09-19T06:12:34.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.442+0000 7f5e87400640 1 -- 172.21.15.3:0/1881016275 learned_addr learned my addr 172.21.15.3:0/1881016275 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:34.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.442+0000 7f5e87400640 1 --2- 172.21.15.3:0/1881016275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e812ac0 0x56507e814c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.443+0000 7f5e86000640 1 -- 172.21.15.3:0/1881016275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e812ac0 msgr2=0x56507e814c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:34.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.443+0000 7f5e86000640 1 --2- 172.21.15.3:0/1881016275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e812ac0 0x56507e814c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.443+0000 7f5e86000640 1 -- 172.21.15.3:0/1881016275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56507e81dca0 msgr2=0x56507e835e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:34.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.443+0000 7f5e86000640 1 --2- 172.21.15.3:0/1881016275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56507e81dca0 0x56507e835e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.443+0000 7f5e86000640 1 -- 172.21.15.3:0/1881016275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56507e813950 con 0x56507e8133e0 2024-09-19T06:12:34.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.443+0000 7f5e87400640 1 --2- 172.21.15.3:0/1881016275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56507e81dca0 0x56507e835e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:34.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.443+0000 7f5e86000640 1 --2- 172.21.15.3:0/1881016275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56507e8133e0 0x56507e835940 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x56507e81be30 tx=0x7f5e7402a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=776f70a00cda3101 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:34.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.443+0000 7f5e73400640 1 -- 172.21.15.3:0/1881016275 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74052070 con 0x56507e8133e0 2024-09-19T06:12:34.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.443+0000 7f5e73400640 1 -- 172.21.15.3:0/1881016275 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e74031dc0 con 0x56507e8133e0 2024-09-19T06:12:34.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.443+0000 7f5e73400640 1 -- 172.21.15.3:0/1881016275 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74035030 con 0x56507e8133e0 2024-09-19T06:12:34.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.444+0000 7f5e908ce740 1 -- 172.21.15.3:0/1881016275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56507e8133e0 msgr2=0x56507e835940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:34.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.444+0000 7f5e908ce740 1 --2- 172.21.15.3:0/1881016275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56507e8133e0 0x56507e835940 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x56507e81be30 tx=0x7f5e7402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.444+0000 7f5e908ce740 1 -- 172.21.15.3:0/1881016275 shutdown_connections 2024-09-19T06:12:34.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.444+0000 7f5e908ce740 1 --2- 172.21.15.3:0/1881016275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56507e81dca0 0x56507e835e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.444+0000 7f5e908ce740 1 --2- 172.21.15.3:0/1881016275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56507e8133e0 0x56507e835940 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.444+0000 7f5e908ce740 1 --2- 172.21.15.3:0/1881016275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e812ac0 0x56507e814c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.444+0000 7f5e908ce740 1 -- 172.21.15.3:0/1881016275 >> 172.21.15.3:0/1881016275 conn(0x56507e80f050 msgr2=0x56507e814510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:34.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.444+0000 7f5e908ce740 1 -- 172.21.15.3:0/1881016275 shutdown_connections 2024-09-19T06:12:34.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.444+0000 7f5e908ce740 1 -- 172.21.15.3:0/1881016275 wait complete. 2024-09-19T06:12:34.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.445+0000 7f5e908ce740 1 -- start start 2024-09-19T06:12:34.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.445+0000 7f5e908ce740 1 Processor -- start 2024-09-19T06:12:34.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.446+0000 7f5e908ce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56507e812ac0 0x56507e826170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.446+0000 7f5e908ce740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e8133e0 0x56507e822cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.446+0000 7f5e908ce740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56507e81dca0 0x56507e8231f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.446+0000 7f5e908ce740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5e881b0f10 con 0x56507e81dca0 2024-09-19T06:12:34.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.446+0000 7f5e908ce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5e881b0840 con 0x56507e812ac0 2024-09-19T06:12:34.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.446+0000 7f5e908ce740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5e881ada80 con 0x56507e8133e0 2024-09-19T06:12:34.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.446+0000 7f5e908ce740 10 client.0 _ll_register_callbacks cb 0x7f5e74009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:34.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.446+0000 7f5e87400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56507e812ac0 0x56507e826170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.446+0000 7f5e86000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e8133e0 0x56507e822cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.446+0000 7f5e87400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56507e81dca0 0x56507e8231f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.446+0000 7f5e86000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e8133e0 0x56507e822cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:42736/0 (socket says 172.21.15.3:42736) 2024-09-19T06:12:34.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.446+0000 7f5e86000640 1 -- 172.21.15.3:0/2178118757 learned_addr learned my addr 172.21.15.3:0/2178118757 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:34.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.447+0000 7f5e86000640 1 -- 172.21.15.3:0/2178118757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56507e812ac0 msgr2=0x56507e826170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:34.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.447+0000 7f5e86000640 1 --2- 172.21.15.3:0/2178118757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56507e812ac0 0x56507e826170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.447+0000 7f5e86000640 1 -- 172.21.15.3:0/2178118757 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56507e81dca0 msgr2=0x56507e8231f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:34.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.447+0000 7f5e86000640 1 --2- 172.21.15.3:0/2178118757 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56507e81dca0 0x56507e8231f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.447+0000 7f5e86000640 1 -- 172.21.15.3:0/2178118757 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56507e80ee80 con 0x56507e8133e0 2024-09-19T06:12:34.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.447+0000 7f5e86000640 1 --2- 172.21.15.3:0/2178118757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e8133e0 0x56507e822cb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5e74000c00 tx=0x7f5e74003ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38f025f3d8d7923c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:34.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.447+0000 7f5e70c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:12:34.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.447+0000 7f5e70c00640 1 -- 172.21.15.3:0/2178118757 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74052040 con 0x56507e8133e0 2024-09-19T06:12:34.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.447+0000 7f5e908ce740 1 -- 172.21.15.3:0/2178118757 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e74031dc0 con 0x56507e8133e0 2024-09-19T06:12:34.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.447+0000 7f5e70c00640 1 -- 172.21.15.3:0/2178118757 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f5e74004980 con 0x56507e8133e0 2024-09-19T06:12:34.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.448+0000 7f5e70c00640 1 -- 172.21.15.3:0/2178118757 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5e74065050 con 0x56507e8133e0 2024-09-19T06:12:34.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.448+0000 7f5e908ce740 10 client.25309 fetch_fsmap learned FSMap version 29 2024-09-19T06:12:34.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.448+0000 7f5e908ce740 1 -- 172.21.15.3:0/2178118757 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56507e899560 con 0x56507e8133e0 2024-09-19T06:12:34.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.448+0000 7f5e70c00640 1 -- 172.21.15.3:0/2178118757 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e74031dc0 con 0x56507e8133e0 2024-09-19T06:12:34.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.448+0000 7f5e70c00640 1 -- 172.21.15.3:0/2178118757 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f5e74004b80 con 0x56507e8133e0 2024-09-19T06:12:34.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.448+0000 7f5e908ce740 10 client.25309 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:12:34.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.448+0000 7f5e908ce740 10 client.25309 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:12:34.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.448+0000 7f5e908ce740 20 client.25309 populate_metadata read hostname 'smithi003' 2024-09-19T06:12:34.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.448+0000 7f5e908ce740 1 --2- 172.21.15.3:0/2178118757 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56507e899c10 0x56507e89c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.448+0000 7f5e908ce740 4 client.25309 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:12:34.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.448+0000 7f5e908ce740 1 -- 172.21.15.3:0/2178118757 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56507e780d10 con 0x56507e899c10 2024-09-19T06:12:34.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.449+0000 7f5e87400640 1 --2- 172.21.15.3:0/2178118757 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56507e899c10 0x56507e89c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.449+0000 7f5e87400640 1 --2- 172.21.15.3:0/2178118757 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56507e899c10 0x56507e89c000 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b27b34bda39cfb8b server_cookie=b0a80eeb903994f8 in_seq=0 out_seq=0 2024-09-19T06:12:34.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.449+0000 7f5e70c00640 10 client.25309 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:12:34.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.450+0000 7f5e70c00640 1 -- 172.21.15.3:0/2178118757 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56507e780d10 con 0x56507e899c10 2024-09-19T06:12:34.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.450+0000 7f5e70c00640 10 client.25309 handle_command_reply: tid=0 2024-09-19T06:12:34.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.450+0000 7f5e908ce740 1 client.25309 shutdown 2024-09-19T06:12:34.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.450+0000 7f5e908ce740 1 -- 172.21.15.3:0/2178118757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e8133e0 msgr2=0x56507e822cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:34.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.450+0000 7f5e908ce740 1 --2- 172.21.15.3:0/2178118757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e8133e0 0x56507e822cb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5e74000c00 tx=0x7f5e74003ce0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.451+0000 7f5e908ce740 1 -- 172.21.15.3:0/2178118757 shutdown_connections 2024-09-19T06:12:34.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.451+0000 7f5e908ce740 1 --2- 172.21.15.3:0/2178118757 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56507e899c10 0x56507e89c000 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.451+0000 7f5e908ce740 1 --2- 172.21.15.3:0/2178118757 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56507e81dca0 0x56507e8231f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.451+0000 7f5e908ce740 1 --2- 172.21.15.3:0/2178118757 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56507e8133e0 0x56507e822cb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.451+0000 7f5e908ce740 1 --2- 172.21.15.3:0/2178118757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56507e812ac0 0x56507e826170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.451+0000 7f5e70c00640 0 client.25309 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:12:34.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.451+0000 7f5e908ce740 1 -- 172.21.15.3:0/2178118757 >> 172.21.15.3:0/2178118757 conn(0x56507e80f050 msgr2=0x56507e80e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:34.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.451+0000 7f5e908ce740 1 -- 172.21.15.3:0/2178118757 shutdown_connections 2024-09-19T06:12:34.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.451+0000 7f5e908ce740 1 -- 172.21.15.3:0/2178118757 wait complete. 2024-09-19T06:12:34.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.451+0000 7f5e908ce740 20 client.25309 trim_cache size 0 max 16384 2024-09-19T06:12:34.455 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:12:34.455 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": 0, 2024-09-19T06:12:34.455 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_tag": "e0df15f2-ecf8-4c4c-a6ba-c4223a61d3ec", 2024-09-19T06:12:34.455 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": "asynchronous" 2024-09-19T06:12:34.455 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:12:34.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.452+0000 7f5e8de00640 1 -- 172.21.15.3:0/3065645644 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f5e6c0a3440 msgr2=0x7f5e6c0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:34.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.452+0000 7f5e8de00640 1 --2- 172.21.15.3:0/3065645644 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f5e6c0a3440 0x7f5e6c0a5900 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5e780cd530 tx=0x7f5e780054d0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.452+0000 7f5e8de00640 1 -- 172.21.15.3:0/3065645644 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e88103ff0 msgr2=0x7f5e8819a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:34.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.452+0000 7f5e8de00640 1 --2- 172.21.15.3:0/3065645644 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e88103ff0 0x7f5e8819a610 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800e9f0 tx=0x7f5e7800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.452+0000 7f5e8de00640 1 -- 172.21.15.3:0/3065645644 shutdown_connections 2024-09-19T06:12:34.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.452+0000 7f5e8de00640 1 --2- 172.21.15.3:0/3065645644 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f5e6c0a3440 0x7f5e6c0a5900 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.452+0000 7f5e8de00640 1 --2- 172.21.15.3:0/3065645644 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5e88109120 0x7f5e8819eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.452+0000 7f5e8de00640 1 --2- 172.21.15.3:0/3065645644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e881049a0 0x7f5e8819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.452+0000 7f5e8de00640 1 --2- 172.21.15.3:0/3065645644 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e88103ff0 0x7f5e8819a610 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.452+0000 7f5e8de00640 1 -- 172.21.15.3:0/3065645644 >> 172.21.15.3:0/3065645644 conn(0x7f5e880ffa90 msgr2=0x7f5e88100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:34.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.452+0000 7f5e8de00640 1 -- 172.21.15.3:0/3065645644 shutdown_connections 2024-09-19T06:12:34.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.452+0000 7f5e8de00640 1 -- 172.21.15.3:0/3065645644 wait complete. 2024-09-19T06:12:34.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.518+0000 7f31f7200640 1 -- 172.21.15.3:0/1453850254 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f31f819b7f0 con 0x7f31f8102ae0 2024-09-19T06:12:34.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.525+0000 7f31eea00640 1 -- 172.21.15.3:0/1453850254 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v32)=0 v32) ==== 133+0+0 (secure 0 0 0) 0x7f31e80bcc80 con 0x7f31f8102ae0 2024-09-19T06:12:34.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.528+0000 7f31f7200640 1 -- 172.21.15.3:0/1453850254 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f31dc0a34b0 msgr2=0x7f31dc0a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:34.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.528+0000 7f31f7200640 1 --2- 172.21.15.3:0/1453850254 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f31dc0a34b0 0x7f31dc0a5970 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f31f8101a00 tx=0x7f31e4005f90 comp rx=0 tx=0).stop 2024-09-19T06:12:34.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.528+0000 7f31f7200640 1 -- 172.21.15.3:0/1453850254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31f8102ae0 msgr2=0x7f31f819a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:34.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.528+0000 7f31f7200640 1 --2- 172.21.15.3:0/1453850254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31f8102ae0 0x7f31f819a4a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f31e8004770 tx=0x7f31e8003c10 comp rx=0 tx=0).stop 2024-09-19T06:12:34.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.529+0000 7f31f7200640 1 -- 172.21.15.3:0/1453850254 shutdown_connections 2024-09-19T06:12:34.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.529+0000 7f31f7200640 1 --2- 172.21.15.3:0/1453850254 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f31dc0a34b0 0x7f31dc0a5970 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.529+0000 7f31f7200640 1 --2- 172.21.15.3:0/1453850254 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f31f810bf30 0x7f31f819ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.529+0000 7f31f7200640 1 --2- 172.21.15.3:0/1453850254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31f8103400 0x7f31f819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.529+0000 7f31f7200640 1 --2- 172.21.15.3:0/1453850254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f31f8102ae0 0x7f31f819a4a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.529+0000 7f31f7200640 1 -- 172.21.15.3:0/1453850254 >> 172.21.15.3:0/1453850254 conn(0x7f31f80777f0 msgr2=0x7f31f8100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:34.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.529+0000 7f31f7200640 1 -- 172.21.15.3:0/1453850254 shutdown_connections 2024-09-19T06:12:34.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.529+0000 7f31f7200640 1 -- 172.21.15.3:0/1453850254 wait complete. 2024-09-19T06:12:34.550 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-19T06:12:34.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.715+0000 7f8597200640 1 -- 172.21.15.3:0/933937524 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8598103400 msgr2=0x7f859810b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:34.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.715+0000 7f8597200640 1 --2- 172.21.15.3:0/933937524 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8598103400 0x7f859810b8e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8580009900 tx=0x7f858002a480 comp rx=0 tx=0).stop 2024-09-19T06:12:34.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.715+0000 7f8597200640 1 -- 172.21.15.3:0/933937524 shutdown_connections 2024-09-19T06:12:34.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.715+0000 7f8597200640 1 --2- 172.21.15.3:0/933937524 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f859810bf30 0x7f859810e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.715+0000 7f8597200640 1 --2- 172.21.15.3:0/933937524 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8598103400 0x7f859810b8e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.715+0000 7f8597200640 1 --2- 172.21.15.3:0/933937524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8598102ae0 0x7f8598102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.715+0000 7f8597200640 1 -- 172.21.15.3:0/933937524 >> 172.21.15.3:0/933937524 conn(0x7f85980777f0 msgr2=0x7f85980feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:34.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.715+0000 7f8597200640 1 -- 172.21.15.3:0/933937524 shutdown_connections 2024-09-19T06:12:34.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.715+0000 7f8597200640 1 -- 172.21.15.3:0/933937524 wait complete. 2024-09-19T06:12:34.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.716+0000 7f8597200640 1 Processor -- start 2024-09-19T06:12:34.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.716+0000 7f8597200640 1 -- start start 2024-09-19T06:12:34.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.717+0000 7f8597200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8598102ae0 0x7f859819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.717+0000 7f8597200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8598103400 0x7f859819a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.717+0000 7f8597200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f859810bf30 0x7f859819ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.717+0000 7f8597200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8598111d10 con 0x7f859810bf30 2024-09-19T06:12:34.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.717+0000 7f8597200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8598111b90 con 0x7f8598103400 2024-09-19T06:12:34.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.717+0000 7f8597200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8598111e90 con 0x7f8598102ae0 2024-09-19T06:12:34.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.717+0000 7f8596800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f859810bf30 0x7f859819ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.717+0000 7f8595e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8598102ae0 0x7f859819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.717+0000 7f8596800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f859810bf30 0x7f859819ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53978/0 (socket says 172.21.15.3:53978) 2024-09-19T06:12:34.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.717+0000 7f8596800640 1 -- 172.21.15.3:0/4148087322 learned_addr learned my addr 172.21.15.3:0/4148087322 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:34.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.717+0000 7f858fe00640 1 --2- 172.21.15.3:0/4148087322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8598103400 0x7f859819a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.717+0000 7f8596800640 1 -- 172.21.15.3:0/4148087322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8598102ae0 msgr2=0x7f859819a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:34.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.717+0000 7f8596800640 1 --2- 172.21.15.3:0/4148087322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8598102ae0 0x7f859819a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.717+0000 7f8596800640 1 -- 172.21.15.3:0/4148087322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8598103400 msgr2=0x7f859819a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:34.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.717+0000 7f8596800640 1 --2- 172.21.15.3:0/4148087322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8598103400 0x7f859819a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:34.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.717+0000 7f8596800640 1 -- 172.21.15.3:0/4148087322 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859819f450 con 0x7f859810bf30 2024-09-19T06:12:34.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.717+0000 7f8595e00640 1 --2- 172.21.15.3:0/4148087322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8598102ae0 0x7f859819a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:34.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.718+0000 7f8596800640 1 --2- 172.21.15.3:0/4148087322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f859810bf30 0x7f859819ed20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f859000eb10 tx=0x7f859000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:34.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.718+0000 7f858ea00640 1 -- 172.21.15.3:0/4148087322 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8590004b20 con 0x7f859810bf30 2024-09-19T06:12:34.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.718+0000 7f858ea00640 1 -- 172.21.15.3:0/4148087322 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8590004cc0 con 0x7f859810bf30 2024-09-19T06:12:34.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.718+0000 7f8597200640 1 -- 172.21.15.3:0/4148087322 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f859819f740 con 0x7f859810bf30 2024-09-19T06:12:34.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.718+0000 7f858ea00640 1 -- 172.21.15.3:0/4148087322 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8590010760 con 0x7f859810bf30 2024-09-19T06:12:34.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.718+0000 7f8597200640 1 -- 172.21.15.3:0/4148087322 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85981a6fd0 con 0x7f859810bf30 2024-09-19T06:12:34.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.719+0000 7f8597200640 1 -- 172.21.15.3:0/4148087322 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8598102ec0 con 0x7f859810bf30 2024-09-19T06:12:34.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.721+0000 7f858ea00640 1 -- 172.21.15.3:0/4148087322 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 25) ==== 138530+0+0 (secure 0 0 0) 0x7f8590005020 con 0x7f859810bf30 2024-09-19T06:12:34.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.723+0000 7f858ea00640 1 --2- 172.21.15.3:0/4148087322 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f857c0a3430 0x7f857c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:34.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.723+0000 7f858ea00640 1 -- 172.21.15.3:0/4148087322 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f85900d0410 con 0x7f859810bf30 2024-09-19T06:12:34.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.723+0000 7f8595e00640 1 --2- 172.21.15.3:0/4148087322 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f857c0a3430 0x7f857c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:34.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.724+0000 7f8595e00640 1 --2- 172.21.15.3:0/4148087322 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f857c0a3430 0x7f857c0a58f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8588009fc0 tx=0x7f8588005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:34.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.727+0000 7f858ea00640 1 -- 172.21.15.3:0/4148087322 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f859009cc20 con 0x7f859810bf30 2024-09-19T06:12:34.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:34.950+0000 7f8597200640 1 -- 172.21.15.3:0/4148087322 --> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f85980fd430 con 0x7f857c0a3430 2024-09-19T06:12:35.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.022+0000 7f858ea00640 1 -- 172.21.15.3:0/4148087322 <== mgr.15126 v2:172.21.15.3:6800/3015970538 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f85980fd430 con 0x7f857c0a3430 2024-09-19T06:12:35.024 INFO:teuthology.orchestra.run.smithi003.stdout:Schedule set for path / 2024-09-19T06:12:35.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.024+0000 7f8597200640 1 -- 172.21.15.3:0/4148087322 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f857c0a3430 msgr2=0x7f857c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:35.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.024+0000 7f8597200640 1 --2- 172.21.15.3:0/4148087322 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f857c0a3430 0x7f857c0a58f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8588009fc0 tx=0x7f8588005f90 comp rx=0 tx=0).stop 2024-09-19T06:12:35.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.024+0000 7f8597200640 1 -- 172.21.15.3:0/4148087322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f859810bf30 msgr2=0x7f859819ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:35.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.024+0000 7f8597200640 1 --2- 172.21.15.3:0/4148087322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f859810bf30 0x7f859819ed20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f859000eb10 tx=0x7f859000c2d0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.024+0000 7f8597200640 1 -- 172.21.15.3:0/4148087322 shutdown_connections 2024-09-19T06:12:35.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.024+0000 7f8597200640 1 --2- 172.21.15.3:0/4148087322 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f857c0a3430 0x7f857c0a58f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.024+0000 7f8597200640 1 --2- 172.21.15.3:0/4148087322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f859810bf30 0x7f859819ed20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.024+0000 7f8597200640 1 --2- 172.21.15.3:0/4148087322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8598103400 0x7f859819a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.024+0000 7f8597200640 1 --2- 172.21.15.3:0/4148087322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8598102ae0 0x7f859819a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.024+0000 7f8597200640 1 -- 172.21.15.3:0/4148087322 >> 172.21.15.3:0/4148087322 conn(0x7f85980777f0 msgr2=0x7f85980fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:35.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.024+0000 7f8597200640 1 -- 172.21.15.3:0/4148087322 shutdown_connections 2024-09-19T06:12:35.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.024+0000 7f8597200640 1 -- 172.21.15.3:0/4148087322 wait complete. 2024-09-19T06:12:35.042 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-19T06:12:35.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.202+0000 7efea3800640 1 -- 172.21.15.3:0/3134815788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe9c101ac0 msgr2=0x7efe9c101f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:35.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.202+0000 7efea3800640 1 --2- 172.21.15.3:0/3134815788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe9c101ac0 0x7efe9c101f20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efe84009890 tx=0x7efe8402a360 comp rx=0 tx=0).stop 2024-09-19T06:12:35.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.202+0000 7efea3800640 1 -- 172.21.15.3:0/3134815788 shutdown_connections 2024-09-19T06:12:35.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.202+0000 7efea3800640 1 --2- 172.21.15.3:0/3134815788 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe9c102460 0x7efe9c10e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.202+0000 7efea3800640 1 --2- 172.21.15.3:0/3134815788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe9c101ac0 0x7efe9c101f20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.202+0000 7efea3800640 1 --2- 172.21.15.3:0/3134815788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe9c107ad0 0x7efe9c107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.202+0000 7efea3800640 1 -- 172.21.15.3:0/3134815788 >> 172.21.15.3:0/3134815788 conn(0x7efe9c0fd7a0 msgr2=0x7efe9c0ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:35.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.202+0000 7efea3800640 1 -- 172.21.15.3:0/3134815788 shutdown_connections 2024-09-19T06:12:35.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.202+0000 7efea3800640 1 -- 172.21.15.3:0/3134815788 wait complete. 2024-09-19T06:12:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.203+0000 7efea3800640 1 Processor -- start 2024-09-19T06:12:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.203+0000 7efea3800640 1 -- start start 2024-09-19T06:12:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.204+0000 7efea3800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe9c101ac0 0x7efe9c19a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.204+0000 7efea3800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe9c102460 0x7efe9c19ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.204+0000 7efea3800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe9c107ad0 0x7efe9c19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:35.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.204+0000 7efea3800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7efe9c111f10 con 0x7efe9c107ad0 2024-09-19T06:12:35.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.204+0000 7efea3800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efe9c111d90 con 0x7efe9c101ac0 2024-09-19T06:12:35.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.204+0000 7efea3800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efe9c112090 con 0x7efe9c102460 2024-09-19T06:12:35.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.204+0000 7efea1800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe9c107ad0 0x7efe9c19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:35.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.204+0000 7efea0e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe9c101ac0 0x7efe9c19a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:35.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.204+0000 7efea1800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe9c107ad0 0x7efe9c19ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53990/0 (socket says 172.21.15.3:53990) 2024-09-19T06:12:35.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.204+0000 7efea1800640 1 -- 172.21.15.3:0/910816150 learned_addr learned my addr 172.21.15.3:0/910816150 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:35.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.204+0000 7efe93e00640 1 --2- 172.21.15.3:0/910816150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe9c102460 0x7efe9c19ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:35.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.204+0000 7efea1800640 1 -- 172.21.15.3:0/910816150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe9c102460 msgr2=0x7efe9c19ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:35.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.204+0000 7efea1800640 1 --2- 172.21.15.3:0/910816150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe9c102460 0x7efe9c19ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.204+0000 7efea1800640 1 -- 172.21.15.3:0/910816150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe9c101ac0 msgr2=0x7efe9c19a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:35.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.204+0000 7efea1800640 1 --2- 172.21.15.3:0/910816150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe9c101ac0 0x7efe9c19a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.204+0000 7efea1800640 1 -- 172.21.15.3:0/910816150 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9c19f6b0 con 0x7efe9c107ad0 2024-09-19T06:12:35.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.205+0000 7efea1800640 1 --2- 172.21.15.3:0/910816150 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe9c107ad0 0x7efe9c19ef80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7efe9400efc0 tx=0x7efe9400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:35.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.205+0000 7efe9a000640 1 -- 172.21.15.3:0/910816150 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe94003970 con 0x7efe9c107ad0 2024-09-19T06:12:35.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.205+0000 7efe9a000640 1 -- 172.21.15.3:0/910816150 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe94004020 con 0x7efe9c107ad0 2024-09-19T06:12:35.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.205+0000 7efea3800640 1 -- 172.21.15.3:0/910816150 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe9c19f9a0 con 0x7efe9c107ad0 2024-09-19T06:12:35.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.205+0000 7efe9a000640 1 -- 172.21.15.3:0/910816150 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9400b9f0 con 0x7efe9c107ad0 2024-09-19T06:12:35.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.205+0000 7efea3800640 1 -- 172.21.15.3:0/910816150 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe9c1a7230 con 0x7efe9c107ad0 2024-09-19T06:12:35.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.206+0000 7efea3800640 1 -- 172.21.15.3:0/910816150 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe9c101f20 con 0x7efe9c107ad0 2024-09-19T06:12:35.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.208+0000 7efe9a000640 1 -- 172.21.15.3:0/910816150 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 25) ==== 138530+0+0 (secure 0 0 0) 0x7efe9401d020 con 0x7efe9c107ad0 2024-09-19T06:12:35.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.210+0000 7efe9a000640 1 --2- 172.21.15.3:0/910816150 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7efe800a34c0 0x7efe800a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:35.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.211+0000 7efe9a000640 1 -- 172.21.15.3:0/910816150 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7efe940cfcf0 con 0x7efe9c107ad0 2024-09-19T06:12:35.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.211+0000 7efea0e00640 1 --2- 172.21.15.3:0/910816150 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7efe800a34c0 0x7efe800a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:35.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.211+0000 7efea0e00640 1 --2- 172.21.15.3:0/910816150 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7efe800a34c0 0x7efe800a5980 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efe8c009b50 tx=0x7efe8c005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:35.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.215+0000 7efe9a000640 1 -- 172.21.15.3:0/910816150 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efe940d4070 con 0x7efe9c107ad0 2024-09-19T06:12:35.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:35 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/314510833' entity='client.admin' 2024-09-19T06:12:35.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:35 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:35.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:35 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:35.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:35 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:35.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:35 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:35.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:35 smithi003 ceph-mon[30893]: scrub queued for path: / 2024-09-19T06:12:35.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:35 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:12:35.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:35 smithi003 ceph-mon[30893]: scrub summary: active paths [/] 2024-09-19T06:12:35.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:35 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:12:35.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:35 smithi003 ceph-mon[30893]: from='client.? ' entity='client.admin' 2024-09-19T06:12:35.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:35 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:35.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:35 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:35.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:35 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:35.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:35 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:35.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.429+0000 7efea3800640 1 -- 172.21.15.3:0/910816150 --> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7efe9c0fe5d0 con 0x7efe800a34c0 2024-09-19T06:12:35.498 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:12:35.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.501+0000 7efe9a000640 1 -- 172.21.15.3:0/910816150 <== mgr.15126 v2:172.21.15.3:6800/3015970538 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7efe9c0fe5d0 con 0x7efe800a34c0 2024-09-19T06:12:35.503 INFO:teuthology.orchestra.run.smithi003.stdout:Retention added to path / 2024-09-19T06:12:35.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.504+0000 7efea3800640 1 -- 172.21.15.3:0/910816150 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7efe800a34c0 msgr2=0x7efe800a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:35.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.504+0000 7efea3800640 1 --2- 172.21.15.3:0/910816150 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7efe800a34c0 0x7efe800a5980 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efe8c009b50 tx=0x7efe8c005f90 comp rx=0 tx=0).stop 2024-09-19T06:12:35.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.504+0000 7efea3800640 1 -- 172.21.15.3:0/910816150 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe9c107ad0 msgr2=0x7efe9c19ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:35.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.504+0000 7efea3800640 1 --2- 172.21.15.3:0/910816150 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe9c107ad0 0x7efe9c19ef80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7efe9400efc0 tx=0x7efe9400c800 comp rx=0 tx=0).stop 2024-09-19T06:12:35.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.504+0000 7efea3800640 1 -- 172.21.15.3:0/910816150 shutdown_connections 2024-09-19T06:12:35.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.504+0000 7efea3800640 1 --2- 172.21.15.3:0/910816150 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7efe800a34c0 0x7efe800a5980 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.504+0000 7efea3800640 1 --2- 172.21.15.3:0/910816150 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efe9c107ad0 0x7efe9c19ef80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.504+0000 7efea3800640 1 --2- 172.21.15.3:0/910816150 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efe9c102460 0x7efe9c19ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.504+0000 7efea3800640 1 --2- 172.21.15.3:0/910816150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe9c101ac0 0x7efe9c19a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.504+0000 7efea3800640 1 -- 172.21.15.3:0/910816150 >> 172.21.15.3:0/910816150 conn(0x7efe9c0fd7a0 msgr2=0x7efe9c0fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:35.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.504+0000 7efea3800640 1 -- 172.21.15.3:0/910816150 shutdown_connections 2024-09-19T06:12:35.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.504+0000 7efea3800640 1 -- 172.21.15.3:0/910816150 wait complete. 2024-09-19T06:12:35.521 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T06:12:35.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:35 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/314510833' entity='client.admin' 2024-09-19T06:12:35.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:35 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:35.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:35 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:35.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:35 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:35.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:35 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:35.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:35 smithi059 ceph-mon[35138]: scrub queued for path: / 2024-09-19T06:12:35.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:35 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:12:35.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:35 smithi059 ceph-mon[35138]: scrub summary: active paths [/] 2024-09-19T06:12:35.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:35 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:12:35.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:35 smithi059 ceph-mon[35138]: from='client.? ' entity='client.admin' 2024-09-19T06:12:35.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:35 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:35.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:35 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:35.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:35 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:35.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:35 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:35.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:35 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/314510833' entity='client.admin' 2024-09-19T06:12:35.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:35 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:35.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:35 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:35.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:35 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:35.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:35 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:35.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:35 smithi071 ceph-mon[35662]: scrub queued for path: / 2024-09-19T06:12:35.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:35 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:12:35.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:35 smithi071 ceph-mon[35662]: scrub summary: active paths [/] 2024-09-19T06:12:35.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:35 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:12:35.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:35 smithi071 ceph-mon[35662]: from='client.? ' entity='client.admin' 2024-09-19T06:12:35.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:35 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:12:35.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:35 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:12:35.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:35 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:12:35.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:35 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:12:35.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.718+0000 7fcf3d800640 1 -- 172.21.15.3:0/1103963750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38103400 msgr2=0x7fcf3810b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:35.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.718+0000 7fcf3d800640 1 --2- 172.21.15.3:0/1103963750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38103400 0x7fcf3810b8e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcf24009900 tx=0x7fcf2402a480 comp rx=0 tx=0).stop 2024-09-19T06:12:35.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.718+0000 7fcf3d800640 1 -- 172.21.15.3:0/1103963750 shutdown_connections 2024-09-19T06:12:35.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.718+0000 7fcf3d800640 1 --2- 172.21.15.3:0/1103963750 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf3810bf30 0x7fcf3810e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.718+0000 7fcf3d800640 1 --2- 172.21.15.3:0/1103963750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38103400 0x7fcf3810b8e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.718+0000 7fcf3d800640 1 --2- 172.21.15.3:0/1103963750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf38102ae0 0x7fcf38102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.718+0000 7fcf3d800640 1 -- 172.21.15.3:0/1103963750 >> 172.21.15.3:0/1103963750 conn(0x7fcf380777f0 msgr2=0x7fcf380feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:35.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.718+0000 7fcf3d800640 1 -- 172.21.15.3:0/1103963750 shutdown_connections 2024-09-19T06:12:35.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.718+0000 7fcf3d800640 1 -- 172.21.15.3:0/1103963750 wait complete. 2024-09-19T06:12:35.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.719+0000 7fcf3d800640 1 Processor -- start 2024-09-19T06:12:35.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.719+0000 7fcf3d800640 1 -- start start 2024-09-19T06:12:35.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.720+0000 7fcf3d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38102ae0 0x7fcf3819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:35.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.720+0000 7fcf3d800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf38103400 0x7fcf3819a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:35.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.720+0000 7fcf3d800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf3810bf30 0x7fcf3819ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:35.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.720+0000 7fcf3d800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcf38111d10 con 0x7fcf3810bf30 2024-09-19T06:12:35.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.720+0000 7fcf3d800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcf38111b90 con 0x7fcf38102ae0 2024-09-19T06:12:35.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.720+0000 7fcf3d800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcf38111e90 con 0x7fcf38103400 2024-09-19T06:12:35.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.720+0000 7fcf37e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38102ae0 0x7fcf3819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:35.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.720+0000 7fcf37e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38102ae0 0x7fcf3819a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40472/0 (socket says 172.21.15.3:40472) 2024-09-19T06:12:35.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.720+0000 7fcf3ce00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf3810bf30 0x7fcf3819ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:35.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.720+0000 7fcf37e00640 1 -- 172.21.15.3:0/2694623390 learned_addr learned my addr 172.21.15.3:0/2694623390 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:35.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.720+0000 7fcf37400640 1 --2- 172.21.15.3:0/2694623390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf38103400 0x7fcf3819a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:35.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.721+0000 7fcf37e00640 1 -- 172.21.15.3:0/2694623390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf38103400 msgr2=0x7fcf3819a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:35.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.721+0000 7fcf37e00640 1 --2- 172.21.15.3:0/2694623390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf38103400 0x7fcf3819a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.721+0000 7fcf37e00640 1 -- 172.21.15.3:0/2694623390 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf3810bf30 msgr2=0x7fcf3819ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:35.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.721+0000 7fcf37e00640 1 --2- 172.21.15.3:0/2694623390 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf3810bf30 0x7fcf3819ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.721+0000 7fcf37e00640 1 -- 172.21.15.3:0/2694623390 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf3819f470 con 0x7fcf38102ae0 2024-09-19T06:12:35.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.721+0000 7fcf37e00640 1 --2- 172.21.15.3:0/2694623390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38102ae0 0x7fcf3819a480 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800e9f0 tx=0x7fcf2800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:35.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.721+0000 7fcf34c00640 1 -- 172.21.15.3:0/2694623390 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2800cd80 con 0x7fcf38102ae0 2024-09-19T06:12:35.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.721+0000 7fcf34c00640 1 -- 172.21.15.3:0/2694623390 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf28005500 con 0x7fcf38102ae0 2024-09-19T06:12:35.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.721+0000 7fcf3d800640 1 -- 172.21.15.3:0/2694623390 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf3819f760 con 0x7fcf38102ae0 2024-09-19T06:12:35.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.721+0000 7fcf34c00640 1 -- 172.21.15.3:0/2694623390 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf28010690 con 0x7fcf38102ae0 2024-09-19T06:12:35.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.721+0000 7fcf3d800640 1 -- 172.21.15.3:0/2694623390 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf381a6ff0 con 0x7fcf38102ae0 2024-09-19T06:12:35.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.722+0000 7fcf3d800640 1 -- 172.21.15.3:0/2694623390 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf38102ec0 con 0x7fcf38102ae0 2024-09-19T06:12:35.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.725+0000 7fcf34c00640 1 -- 172.21.15.3:0/2694623390 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 138530+0+0 (secure 0 0 0) 0x7fcf280046c0 con 0x7fcf38102ae0 2024-09-19T06:12:35.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.726+0000 7fcf34c00640 1 --2- 172.21.15.3:0/2694623390 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcf1c0a3430 0x7fcf1c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:35.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.726+0000 7fcf34c00640 1 -- 172.21.15.3:0/2694623390 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fcf280d04d0 con 0x7fcf38102ae0 2024-09-19T06:12:35.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.726+0000 7fcf37400640 1 --2- 172.21.15.3:0/2694623390 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcf1c0a3430 0x7fcf1c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:35.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.727+0000 7fcf37400640 1 --2- 172.21.15.3:0/2694623390 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcf1c0a3430 0x7fcf1c0a58f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcf24009230 tx=0x7fcf240058d0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:35.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.728+0000 7fcf34c00640 1 -- 172.21.15.3:0/2694623390 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcf28054210 con 0x7fcf38102ae0 2024-09-19T06:12:35.883 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:12:35.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.943+0000 7fcf3d800640 1 -- 172.21.15.3:0/2694623390 --> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fcf380fd430 con 0x7fcf1c0a3430 2024-09-19T06:12:35.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.950+0000 7fcf34c00640 1 -- 172.21.15.3:0/2694623390 <== mgr.15126 v2:172.21.15.3:6800/3015970538 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7fcf380fd430 con 0x7fcf1c0a3430 2024-09-19T06:12:35.953 INFO:teuthology.orchestra.run.smithi003.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T06:12:34", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-19T06:12:35.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.952+0000 7fcf3d800640 1 -- 172.21.15.3:0/2694623390 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcf1c0a3430 msgr2=0x7fcf1c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:35.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.952+0000 7fcf3d800640 1 --2- 172.21.15.3:0/2694623390 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcf1c0a3430 0x7fcf1c0a58f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcf24009230 tx=0x7fcf240058d0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.952+0000 7fcf3d800640 1 -- 172.21.15.3:0/2694623390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38102ae0 msgr2=0x7fcf3819a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:35.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.952+0000 7fcf3d800640 1 --2- 172.21.15.3:0/2694623390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38102ae0 0x7fcf3819a480 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800e9f0 tx=0x7fcf2800edf0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.953+0000 7fcf3d800640 1 -- 172.21.15.3:0/2694623390 shutdown_connections 2024-09-19T06:12:35.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.953+0000 7fcf3d800640 1 --2- 172.21.15.3:0/2694623390 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcf1c0a3430 0x7fcf1c0a58f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.953+0000 7fcf3d800640 1 --2- 172.21.15.3:0/2694623390 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf3810bf30 0x7fcf3819ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.953+0000 7fcf3d800640 1 --2- 172.21.15.3:0/2694623390 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf38103400 0x7fcf3819a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.953+0000 7fcf3d800640 1 --2- 172.21.15.3:0/2694623390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf38102ae0 0x7fcf3819a480 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:35.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.953+0000 7fcf3d800640 1 -- 172.21.15.3:0/2694623390 >> 172.21.15.3:0/2694623390 conn(0x7fcf380777f0 msgr2=0x7fcf380fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:35.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.953+0000 7fcf3d800640 1 -- 172.21.15.3:0/2694623390 shutdown_connections 2024-09-19T06:12:35.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:35.953+0000 7fcf3d800640 1 -- 172.21.15.3:0/2694623390 wait complete. 2024-09-19T06:12:35.972 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T06:12:36.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.129+0000 7f2b0fe00640 1 -- 172.21.15.3:0/3232421474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b10101930 msgr2=0x7f2b10101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:36.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.129+0000 7f2b0fe00640 1 --2- 172.21.15.3:0/3232421474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b10101930 0x7f2b10101d90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009900 tx=0x7f2afc02a410 comp rx=0 tx=0).stop 2024-09-19T06:12:36.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.129+0000 7f2b0fe00640 1 -- 172.21.15.3:0/3232421474 shutdown_connections 2024-09-19T06:12:36.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.129+0000 7f2b0fe00640 1 --2- 172.21.15.3:0/3232421474 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2b101022d0 0x7f2b1010e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.129+0000 7f2b0fe00640 1 --2- 172.21.15.3:0/3232421474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b10101930 0x7f2b10101d90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.129+0000 7f2b0fe00640 1 --2- 172.21.15.3:0/3232421474 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b10107940 0x7f2b10107d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.129+0000 7f2b0fe00640 1 -- 172.21.15.3:0/3232421474 >> 172.21.15.3:0/3232421474 conn(0x7f2b100fd630 msgr2=0x7f2b100ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:36.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.129+0000 7f2b0fe00640 1 -- 172.21.15.3:0/3232421474 shutdown_connections 2024-09-19T06:12:36.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.129+0000 7f2b0fe00640 1 -- 172.21.15.3:0/3232421474 wait complete. 2024-09-19T06:12:36.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.130+0000 7f2b0fe00640 1 Processor -- start 2024-09-19T06:12:36.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.130+0000 7f2b0fe00640 1 -- start start 2024-09-19T06:12:36.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.131+0000 7f2b0fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b10101930 0x7f2b1019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.131+0000 7f2b0fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2b101022d0 0x7f2b1019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.131+0000 7f2b0fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b10107940 0x7f2b1019ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.131+0000 7f2b0fe00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2b10111da0 con 0x7f2b101022d0 2024-09-19T06:12:36.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.131+0000 7f2b0fe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2b10111c20 con 0x7f2b10101930 2024-09-19T06:12:36.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.131+0000 7f2b0fe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2b10111f20 con 0x7f2b10107940 2024-09-19T06:12:36.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.131+0000 7f2b0e000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2b101022d0 0x7f2b1019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.131+0000 7f2b0e000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2b101022d0 0x7f2b1019a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54040/0 (socket says 172.21.15.3:54040) 2024-09-19T06:12:36.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.131+0000 7f2b0e000640 1 -- 172.21.15.3:0/2142833030 learned_addr learned my addr 172.21.15.3:0/2142833030 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:36.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.131+0000 7f2b0ea00640 1 --2- 172.21.15.3:0/2142833030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b10101930 0x7f2b1019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.131+0000 7f2b0f400640 1 --2- 172.21.15.3:0/2142833030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b10107940 0x7f2b1019ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.132+0000 7f2b0e000640 1 -- 172.21.15.3:0/2142833030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b10107940 msgr2=0x7f2b1019ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:36.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.132+0000 7f2b0e000640 1 --2- 172.21.15.3:0/2142833030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b10107940 0x7f2b1019ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.132+0000 7f2b0e000640 1 -- 172.21.15.3:0/2142833030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b10101930 msgr2=0x7f2b1019a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:36.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.132+0000 7f2b0e000640 1 --2- 172.21.15.3:0/2142833030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b10101930 0x7f2b1019a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.132+0000 7f2b0e000640 1 -- 172.21.15.3:0/2142833030 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b1019f430 con 0x7f2b101022d0 2024-09-19T06:12:36.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.132+0000 7f2b0e000640 1 --2- 172.21.15.3:0/2142833030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2b101022d0 0x7f2b1019a980 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2afc02aa00 tx=0x7f2afc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:36.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.132+0000 7f2b07400640 1 -- 172.21.15.3:0/2142833030 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc03f070 con 0x7f2b101022d0 2024-09-19T06:12:36.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.132+0000 7f2b07400640 1 -- 172.21.15.3:0/2142833030 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2afc031c30 con 0x7f2b101022d0 2024-09-19T06:12:36.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.132+0000 7f2b07400640 1 -- 172.21.15.3:0/2142833030 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc035030 con 0x7f2b101022d0 2024-09-19T06:12:36.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.132+0000 7f2b0fe00640 1 -- 172.21.15.3:0/2142833030 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b1019f6c0 con 0x7f2b101022d0 2024-09-19T06:12:36.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.133+0000 7f2b0fe00640 1 -- 172.21.15.3:0/2142833030 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b101a6fb0 con 0x7f2b101022d0 2024-09-19T06:12:36.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.134+0000 7f2b0fe00640 1 -- 172.21.15.3:0/2142833030 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b10101d90 con 0x7f2b101022d0 2024-09-19T06:12:36.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.136+0000 7f2b07400640 1 -- 172.21.15.3:0/2142833030 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 25) ==== 138530+0+0 (secure 0 0 0) 0x7f2afc042070 con 0x7f2b101022d0 2024-09-19T06:12:36.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.137+0000 7f2b07400640 1 --2- 172.21.15.3:0/2142833030 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2af40a3430 0x7f2af40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.137+0000 7f2b07400640 1 -- 172.21.15.3:0/2142833030 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f2afc0f04d0 con 0x7f2b101022d0 2024-09-19T06:12:36.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.137+0000 7f2b0ea00640 1 --2- 172.21.15.3:0/2142833030 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2af40a3430 0x7f2af40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.138+0000 7f2b0ea00640 1 --2- 172.21.15.3:0/2142833030 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2af40a3430 0x7f2af40a58f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2b00009b50 tx=0x7f2b00005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:36.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.141+0000 7f2b07400640 1 -- 172.21.15.3:0/2142833030 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2afc031de0 con 0x7f2b101022d0 2024-09-19T06:12:36.232 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:36 smithi003 ceph-mon[30893]: pgmap v9: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 186 B/s wr, 20 op/s 2024-09-19T06:12:36.233 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:36 smithi003 ceph-mon[30893]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:12:36.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.353+0000 7f2b0fe00640 1 -- 172.21.15.3:0/2142833030 --> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f2b100fe390 con 0x7f2af40a3430 2024-09-19T06:12:36.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.360+0000 7f2b07400640 1 -- 172.21.15.3:0/2142833030 <== mgr.15126 v2:172.21.15.3:6800/3015970538 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f2b100fe390 con 0x7f2af40a3430 2024-09-19T06:12:36.362 INFO:teuthology.orchestra.run.smithi003.stdout:/ 1m 6m3h 2024-09-19T06:12:36.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.362+0000 7f2b0fe00640 1 -- 172.21.15.3:0/2142833030 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2af40a3430 msgr2=0x7f2af40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:36.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.362+0000 7f2b0fe00640 1 --2- 172.21.15.3:0/2142833030 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2af40a3430 0x7f2af40a58f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2b00009b50 tx=0x7f2b00005f90 comp rx=0 tx=0).stop 2024-09-19T06:12:36.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.362+0000 7f2b0fe00640 1 -- 172.21.15.3:0/2142833030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2b101022d0 msgr2=0x7f2b1019a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:36.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.362+0000 7f2b0fe00640 1 --2- 172.21.15.3:0/2142833030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2b101022d0 0x7f2b1019a980 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2afc02aa00 tx=0x7f2afc003c10 comp rx=0 tx=0).stop 2024-09-19T06:12:36.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.363+0000 7f2b0fe00640 1 -- 172.21.15.3:0/2142833030 shutdown_connections 2024-09-19T06:12:36.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.363+0000 7f2b0fe00640 1 --2- 172.21.15.3:0/2142833030 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2af40a3430 0x7f2af40a58f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.363+0000 7f2b0fe00640 1 --2- 172.21.15.3:0/2142833030 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2b10107940 0x7f2b1019ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.363+0000 7f2b0fe00640 1 --2- 172.21.15.3:0/2142833030 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2b101022d0 0x7f2b1019a980 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.363+0000 7f2b0fe00640 1 --2- 172.21.15.3:0/2142833030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b10101930 0x7f2b1019a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.363+0000 7f2b0fe00640 1 -- 172.21.15.3:0/2142833030 >> 172.21.15.3:0/2142833030 conn(0x7f2b100fd630 msgr2=0x7f2b100fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:36.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.363+0000 7f2b0fe00640 1 -- 172.21.15.3:0/2142833030 shutdown_connections 2024-09-19T06:12:36.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.363+0000 7f2b0fe00640 1 -- 172.21.15.3:0/2142833030 wait complete. 2024-09-19T06:12:36.381 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-19T06:12:36.443 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-19T06:12:36.453 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-19T06:12:36.463 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi003.front.sepia.ceph.com 2024-09-19T06:12:36.463 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-19T06:12:36.467 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T06:12:36.481 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T06:12:36.481 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T06:12:36.482 INFO:tasks.workunit:timeout=3h 2024-09-19T06:12:36.482 INFO:tasks.workunit:cleanup=True 2024-09-19T06:12:36.482 DEBUG:teuthology.orchestra.run.smithi003:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T06:12:36.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.491+0000 7f4451000640 1 -- 172.21.15.3:0/2481311576 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f444c1019c0 msgr2=0x7f444c101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:36.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.491+0000 7f4451000640 1 --2- 172.21.15.3:0/2481311576 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f444c1019c0 0x7f444c101e20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4438009930 tx=0x7f443802a420 comp rx=0 tx=0).stop 2024-09-19T06:12:36.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.491+0000 7f4451000640 1 -- 172.21.15.3:0/2481311576 shutdown_connections 2024-09-19T06:12:36.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.491+0000 7f4451000640 1 --2- 172.21.15.3:0/2481311576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f444c102360 0x7f444c10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.491+0000 7f4451000640 1 --2- 172.21.15.3:0/2481311576 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f444c1019c0 0x7f444c101e20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.491+0000 7f4451000640 1 --2- 172.21.15.3:0/2481311576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f444c1079c0 0x7f444c107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.491+0000 7f4451000640 1 -- 172.21.15.3:0/2481311576 >> 172.21.15.3:0/2481311576 conn(0x7f444c0fd740 msgr2=0x7f444c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:36.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.491+0000 7f4451000640 1 -- 172.21.15.3:0/2481311576 shutdown_connections 2024-09-19T06:12:36.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.492+0000 7f4451000640 1 -- 172.21.15.3:0/2481311576 wait complete. 2024-09-19T06:12:36.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.493+0000 7f4451000640 1 Processor -- start 2024-09-19T06:12:36.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.493+0000 7f4451000640 1 -- start start 2024-09-19T06:12:36.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.493+0000 7f4451000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f444c1019c0 0x7f444c19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.493+0000 7f4451000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f444c102360 0x7f444c19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.494+0000 7f4451000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f444c1079c0 0x7f444c19edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.494+0000 7f4451000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f444c111dc0 con 0x7f444c1019c0 2024-09-19T06:12:36.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.494+0000 7f4451000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f444c111c40 con 0x7f444c1079c0 2024-09-19T06:12:36.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.494+0000 7f4451000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f444c111f40 con 0x7f444c102360 2024-09-19T06:12:36.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.494+0000 7f444b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f444c1019c0 0x7f444c19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.494+0000 7f444aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f444c102360 0x7f444c19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.494+0000 7f444be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f444c1079c0 0x7f444c19edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.494+0000 7f444aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f444c102360 0x7f444c19aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:42846/0 (socket says 172.21.15.3:42846) 2024-09-19T06:12:36.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.494+0000 7f444be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f444c1079c0 0x7f444c19edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40506/0 (socket says 172.21.15.3:40506) 2024-09-19T06:12:36.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.494+0000 7f444aa00640 1 -- 172.21.15.3:0/1107383969 learned_addr learned my addr 172.21.15.3:0/1107383969 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:36.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.494+0000 7f444aa00640 1 -- 172.21.15.3:0/1107383969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f444c1079c0 msgr2=0x7f444c19edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:36.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.494+0000 7f444aa00640 1 --2- 172.21.15.3:0/1107383969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f444c1079c0 0x7f444c19edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.494+0000 7f444aa00640 1 -- 172.21.15.3:0/1107383969 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f444c1019c0 msgr2=0x7f444c19a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:36.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.494+0000 7f444aa00640 1 --2- 172.21.15.3:0/1107383969 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f444c1019c0 0x7f444c19a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.494+0000 7f444aa00640 1 -- 172.21.15.3:0/1107383969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f444c19f490 con 0x7f444c102360 2024-09-19T06:12:36.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.495+0000 7f444aa00640 1 --2- 172.21.15.3:0/1107383969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f444c102360 0x7f444c19aa20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4438009230 tx=0x7f4438004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:36.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.495+0000 7f4443e00640 1 -- 172.21.15.3:0/1107383969 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443803f030 con 0x7f444c102360 2024-09-19T06:12:36.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.495+0000 7f4443e00640 1 -- 172.21.15.3:0/1107383969 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4438003ad0 con 0x7f444c102360 2024-09-19T06:12:36.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.495+0000 7f4451000640 1 -- 172.21.15.3:0/1107383969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f444c19f720 con 0x7f444c102360 2024-09-19T06:12:36.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.495+0000 7f4443e00640 1 -- 172.21.15.3:0/1107383969 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4438035070 con 0x7f444c102360 2024-09-19T06:12:36.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.496+0000 7f4451000640 1 -- 172.21.15.3:0/1107383969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f444c1a7060 con 0x7f444c102360 2024-09-19T06:12:36.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.499+0000 7f4443e00640 1 -- 172.21.15.3:0/1107383969 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 25) ==== 138530+0+0 (secure 0 0 0) 0x7f4438042030 con 0x7f444c102360 2024-09-19T06:12:36.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.499+0000 7f4454bfd740 1 Processor -- start 2024-09-19T06:12:36.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.499+0000 7f4454bfd740 1 -- start start 2024-09-19T06:12:36.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.499+0000 7f4454bfd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b54516d50 0x562b54517130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.499+0000 7f4454bfd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54517670 0x562b545219f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.499+0000 7f4454bfd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54521f30 0x562b54524320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.499+0000 7f4454bfd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562b5447d3e0 con 0x562b54516d50 2024-09-19T06:12:36.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.499+0000 7f4454bfd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562b54424d80 con 0x562b54517670 2024-09-19T06:12:36.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.500+0000 7f4454bfd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562b544793a0 con 0x562b54521f30 2024-09-19T06:12:36.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.500+0000 7f444be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b54516d50 0x562b54517130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.500+0000 7f444b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54517670 0x562b545219f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.500+0000 7f444b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54517670 0x562b545219f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40512/0 (socket says 172.21.15.3:40512) 2024-09-19T06:12:36.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.500+0000 7f444b400640 1 -- 172.21.15.3:0/2498936735 learned_addr learned my addr 172.21.15.3:0/2498936735 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:36.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.500+0000 7f444aa00640 1 --2- 172.21.15.3:0/2498936735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54521f30 0x562b54524320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.501+0000 7f444b400640 1 -- 172.21.15.3:0/2498936735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54521f30 msgr2=0x562b54524320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:36.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.501+0000 7f444b400640 1 --2- 172.21.15.3:0/2498936735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54521f30 0x562b54524320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.501+0000 7f444b400640 1 -- 172.21.15.3:0/2498936735 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b54516d50 msgr2=0x562b54517130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:36.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.501+0000 7f444b400640 1 --2- 172.21.15.3:0/2498936735 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b54516d50 0x562b54517130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.501+0000 7f444b400640 1 -- 172.21.15.3:0/2498936735 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b54443ae0 con 0x562b54517670 2024-09-19T06:12:36.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.501+0000 7f444be00640 1 --2- 172.21.15.3:0/2498936735 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b54516d50 0x562b54517130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:36.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.501+0000 7f4443e00640 1 --2- 172.21.15.3:0/1107383969 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f44300a3440 0x7f44300a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.501+0000 7f4443e00640 1 -- 172.21.15.3:0/1107383969 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f44380f04a0 con 0x7f444c102360 2024-09-19T06:12:36.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.501+0000 7f444b400640 1 --2- 172.21.15.3:0/2498936735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54517670 0x562b545219f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f443c009ca0 tx=0x7f443c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee5b7e4fb818f81c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:36.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.501+0000 7f444be00640 1 --2- 172.21.15.3:0/1107383969 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f44300a3440 0x7f44300a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.502+0000 7f4440c00640 1 -- 172.21.15.3:0/2498936735 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c01e070 con 0x562b54517670 2024-09-19T06:12:36.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.502+0000 7f4440c00640 1 -- 172.21.15.3:0/2498936735 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f443c019b10 con 0x562b54517670 2024-09-19T06:12:36.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.502+0000 7f4440c00640 1 -- 172.21.15.3:0/2498936735 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c00eae0 con 0x562b54517670 2024-09-19T06:12:36.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.502+0000 7f4454bfd740 1 -- 172.21.15.3:0/2498936735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54517670 msgr2=0x562b545219f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:36.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.502+0000 7f4454bfd740 1 --2- 172.21.15.3:0/2498936735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54517670 0x562b545219f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f443c009ca0 tx=0x7f443c011810 comp rx=0 tx=0).stop 2024-09-19T06:12:36.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.502+0000 7f444be00640 1 --2- 172.21.15.3:0/1107383969 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f44300a3440 0x7f44300a5900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4444005fd0 tx=0x7f4444009600 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:36.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.503+0000 7f4454bfd740 1 -- 172.21.15.3:0/2498936735 shutdown_connections 2024-09-19T06:12:36.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.503+0000 7f4454bfd740 1 --2- 172.21.15.3:0/2498936735 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54521f30 0x562b54524320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.503+0000 7f4454bfd740 1 --2- 172.21.15.3:0/2498936735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54517670 0x562b545219f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.503+0000 7f4454bfd740 1 --2- 172.21.15.3:0/2498936735 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b54516d50 0x562b54517130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.503+0000 7f4454bfd740 1 -- 172.21.15.3:0/2498936735 >> 172.21.15.3:0/2498936735 conn(0x562b545132e0 msgr2=0x562b545136c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:36.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.503+0000 7f4454bfd740 1 -- 172.21.15.3:0/2498936735 shutdown_connections 2024-09-19T06:12:36.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.503+0000 7f4454bfd740 1 -- 172.21.15.3:0/2498936735 wait complete. 2024-09-19T06:12:36.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.503+0000 7f4454bfd740 1 -- start start 2024-09-19T06:12:36.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.504+0000 7f4454bfd740 1 Processor -- start 2024-09-19T06:12:36.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.504+0000 7f4454bfd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54516d50 0x562b5451eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.504+0000 7f4454bfd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54517670 0x562b5451f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.504+0000 7f4454bfd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b54521f30 0x562b5451f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.505+0000 7f4454bfd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562b54524ba0 con 0x562b54521f30 2024-09-19T06:12:36.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.505+0000 7f4454bfd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562b544380f0 con 0x562b54517670 2024-09-19T06:12:36.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.505+0000 7f4454bfd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562b54524d20 con 0x562b54516d50 2024-09-19T06:12:36.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.505+0000 7f4454bfd740 10 client.0 _ll_register_callbacks cb 0x562b544299e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:36.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.505+0000 7f444b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54516d50 0x562b5451eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.505+0000 7f444aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54517670 0x562b5451f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.505+0000 7f444b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54516d50 0x562b5451eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:42854/0 (socket says 172.21.15.3:42854) 2024-09-19T06:12:36.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.505+0000 7f444b400640 1 -- 172.21.15.3:0/560595094 learned_addr learned my addr 172.21.15.3:0/560595094 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:36.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.505+0000 7f444aa00640 1 -- 172.21.15.3:0/560595094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54516d50 msgr2=0x562b5451eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:36.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.505+0000 7f444aa00640 1 --2- 172.21.15.3:0/560595094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54516d50 0x562b5451eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.505+0000 7f444aa00640 1 -- 172.21.15.3:0/560595094 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b54521f30 msgr2=0x562b5451f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:36.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.505+0000 7f444aa00640 1 --2- 172.21.15.3:0/560595094 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b54521f30 0x562b5451f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.505+0000 7f444aa00640 1 -- 172.21.15.3:0/560595094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b541ee3c0 con 0x562b54517670 2024-09-19T06:12:36.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.505+0000 7f444b400640 1 --2- 172.21.15.3:0/560595094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54516d50 0x562b5451eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:36.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.506+0000 7f444aa00640 1 --2- 172.21.15.3:0/560595094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54517670 0x562b5451f430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f44380edad0 tx=0x7f44380bc430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3561d1a8fc90cfe8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:36.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.506+0000 7f4435600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:12:36.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.506+0000 7f4435600640 1 -- 172.21.15.3:0/560595094 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4438049070 con 0x562b54517670 2024-09-19T06:12:36.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.506+0000 7f4435600640 1 -- 172.21.15.3:0/560595094 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f443803bd60 con 0x562b54517670 2024-09-19T06:12:36.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.506+0000 7f4454bfd740 1 -- 172.21.15.3:0/560595094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f443c019b10 con 0x562b54517670 2024-09-19T06:12:36.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.506+0000 7f4435600640 1 -- 172.21.15.3:0/560595094 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f44380bc660 con 0x562b54517670 2024-09-19T06:12:36.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.506+0000 7f4454bfd740 10 client.25334 fetch_fsmap learned FSMap version 29 2024-09-19T06:12:36.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.506+0000 7f4454bfd740 1 -- 172.21.15.3:0/560595094 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562b54530910 con 0x562b54517670 2024-09-19T06:12:36.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.506+0000 7f4435600640 1 -- 172.21.15.3:0/560595094 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f443c019b10 con 0x562b54517670 2024-09-19T06:12:36.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.507+0000 7f4435600640 1 -- 172.21.15.3:0/560595094 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f44380b8cd0 con 0x562b54517670 2024-09-19T06:12:36.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.507+0000 7f4454bfd740 10 client.25334 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:12:36.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.507+0000 7f4454bfd740 10 client.25334 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:12:36.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.507+0000 7f4454bfd740 20 client.25334 populate_metadata read hostname 'smithi003' 2024-09-19T06:12:36.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.507+0000 7f4454bfd740 1 --2- 172.21.15.3:0/560595094 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562b54531d50 0x562b545341e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.507+0000 7f4454bfd740 4 client.25334 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:12:36.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.507+0000 7f4454bfd740 1 -- 172.21.15.3:0/560595094 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b5448a950 con 0x562b54531d50 2024-09-19T06:12:36.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.507+0000 7f444b400640 1 --2- 172.21.15.3:0/560595094 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562b54531d50 0x562b545341e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.508+0000 7f444b400640 1 --2- 172.21.15.3:0/560595094 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562b54531d50 0x562b545341e0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d73ddbb65f535387 server_cookie=eb2d9d03d28bf0e1 in_seq=0 out_seq=0 2024-09-19T06:12:36.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.508+0000 7f4435600640 10 client.25334 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:12:36.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.509+0000 7f4435600640 1 -- 172.21.15.3:0/560595094 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562b5448a950 con 0x562b54531d50 2024-09-19T06:12:36.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.509+0000 7f4435600640 10 client.25334 handle_command_reply: tid=0 2024-09-19T06:12:36.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.509+0000 7f4454bfd740 1 client.25334 shutdown 2024-09-19T06:12:36.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.509+0000 7f4454bfd740 1 -- 172.21.15.3:0/560595094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54517670 msgr2=0x562b5451f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:36.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.509+0000 7f4454bfd740 1 --2- 172.21.15.3:0/560595094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54517670 0x562b5451f430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f44380edad0 tx=0x7f44380bc430 comp rx=0 tx=0).stop 2024-09-19T06:12:36.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.509+0000 7f4454bfd740 1 -- 172.21.15.3:0/560595094 shutdown_connections 2024-09-19T06:12:36.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.509+0000 7f4454bfd740 1 --2- 172.21.15.3:0/560595094 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562b54531d50 0x562b545341e0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.509+0000 7f4454bfd740 1 --2- 172.21.15.3:0/560595094 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b54521f30 0x562b5451f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.509+0000 7f4454bfd740 1 --2- 172.21.15.3:0/560595094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54517670 0x562b5451f430 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.509+0000 7f4454bfd740 1 --2- 172.21.15.3:0/560595094 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54516d50 0x562b5451eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.509+0000 7f4435600640 0 client.25334 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:12:36.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.509+0000 7f4454bfd740 1 -- 172.21.15.3:0/560595094 >> 172.21.15.3:0/560595094 conn(0x562b545132e0 msgr2=0x562b54519010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:36.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.509+0000 7f4454bfd740 1 -- 172.21.15.3:0/560595094 shutdown_connections 2024-09-19T06:12:36.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.509+0000 7f4454bfd740 1 -- 172.21.15.3:0/560595094 wait complete. 2024-09-19T06:12:36.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.510+0000 7f4454bfd740 20 client.25334 trim_cache size 0 max 16384 2024-09-19T06:12:36.526 INFO:teuthology.orchestra.run.smithi003.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T06:12:36.526 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-19T06:12:36.526 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-19T06:12:36.526 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:12:36.526 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-19T06:12:36.526 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2024-09-19 06:10:28.755898730 +0000 2024-09-19T06:12:36.527 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2024-09-19 06:10:28.755898730 +0000 2024-09-19T06:12:36.527 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2024-09-19 06:12:21.177765813 +0000 2024-09-19T06:12:36.527 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2024-09-19 06:10:28.755898730 +0000 2024-09-19T06:12:36.527 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T06:12:36.527 DEBUG:teuthology.orchestra.run.smithi003:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T06:12:36.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.531+0000 7f4454bfd740 1 Processor -- start 2024-09-19T06:12:36.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.531+0000 7f4454bfd740 1 -- start start 2024-09-19T06:12:36.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.531+0000 7f4454bfd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b54516d50 0x562b5451a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.531+0000 7f4454bfd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54517670 0x562b5451f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.531+0000 7f4454bfd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54521f30 0x562b54539ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.531+0000 7f4454bfd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f444c1af940 con 0x562b54516d50 2024-09-19T06:12:36.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.531+0000 7f4454bfd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f444c1b1480 con 0x562b54521f30 2024-09-19T06:12:36.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.531+0000 7f4454bfd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f444c1b0010 con 0x562b54517670 2024-09-19T06:12:36.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.531+0000 7f444aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54517670 0x562b5451f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.531+0000 7f444aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54517670 0x562b5451f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:42856/0 (socket says 172.21.15.3:42856) 2024-09-19T06:12:36.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.531+0000 7f444aa00640 1 -- 172.21.15.3:0/1862339950 learned_addr learned my addr 172.21.15.3:0/1862339950 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:36.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.532+0000 7f444b400640 1 --2- 172.21.15.3:0/1862339950 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b54516d50 0x562b5451a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.532+0000 7f444be00640 1 --2- 172.21.15.3:0/1862339950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54521f30 0x562b54539ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.532+0000 7f444aa00640 1 -- 172.21.15.3:0/1862339950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54521f30 msgr2=0x562b54539ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:36.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.532+0000 7f444aa00640 1 --2- 172.21.15.3:0/1862339950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54521f30 0x562b54539ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.532+0000 7f444aa00640 1 -- 172.21.15.3:0/1862339950 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b54516d50 msgr2=0x562b5451a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:36.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.532+0000 7f444aa00640 1 --2- 172.21.15.3:0/1862339950 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b54516d50 0x562b5451a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.532+0000 7f444aa00640 1 -- 172.21.15.3:0/1862339950 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b54521860 con 0x562b54517670 2024-09-19T06:12:36.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.532+0000 7f444b400640 1 --2- 172.21.15.3:0/1862339950 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b54516d50 0x562b5451a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:12:36.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.532+0000 7f444be00640 1 --2- 172.21.15.3:0/1862339950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54521f30 0x562b54539ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:12:36.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.532+0000 7f444aa00640 1 --2- 172.21.15.3:0/1862339950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54517670 0x562b5451f5c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f44380c4cf0 tx=0x7f44380bab70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cea2d27a8cc8eb5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:36.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.532+0000 7f4437e00640 1 -- 172.21.15.3:0/1862339950 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4438049030 con 0x562b54517670 2024-09-19T06:12:36.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.533+0000 7f4437e00640 1 -- 172.21.15.3:0/1862339950 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44380c5220 con 0x562b54517670 2024-09-19T06:12:36.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.533+0000 7f4437e00640 1 -- 172.21.15.3:0/1862339950 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44380b8cd0 con 0x562b54517670 2024-09-19T06:12:36.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.533+0000 7f4454bfd740 1 -- 172.21.15.3:0/1862339950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54517670 msgr2=0x562b5451f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:36.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.533+0000 7f4454bfd740 1 --2- 172.21.15.3:0/1862339950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54517670 0x562b5451f5c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f44380c4cf0 tx=0x7f44380bab70 comp rx=0 tx=0).stop 2024-09-19T06:12:36.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.533+0000 7f4454bfd740 1 -- 172.21.15.3:0/1862339950 shutdown_connections 2024-09-19T06:12:36.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.533+0000 7f4454bfd740 1 --2- 172.21.15.3:0/1862339950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54521f30 0x562b54539ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.533+0000 7f4454bfd740 1 --2- 172.21.15.3:0/1862339950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54517670 0x562b5451f5c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.533+0000 7f4454bfd740 1 --2- 172.21.15.3:0/1862339950 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b54516d50 0x562b5451a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.533+0000 7f4454bfd740 1 -- 172.21.15.3:0/1862339950 >> 172.21.15.3:0/1862339950 conn(0x562b545132e0 msgr2=0x562b5451eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:36.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.533+0000 7f4454bfd740 1 -- 172.21.15.3:0/1862339950 shutdown_connections 2024-09-19T06:12:36.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.534+0000 7f4454bfd740 1 -- 172.21.15.3:0/1862339950 wait complete. 2024-09-19T06:12:36.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.534+0000 7f4454bfd740 1 -- start start 2024-09-19T06:12:36.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.534+0000 7f4454bfd740 1 Processor -- start 2024-09-19T06:12:36.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.535+0000 7f4454bfd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54516d50 0x562b5452a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.535+0000 7f4454bfd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54517670 0x562b5451ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.535+0000 7f4454bfd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b54521f30 0x562b5451bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.535+0000 7f4454bfd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f444c1b0db0 con 0x562b54521f30 2024-09-19T06:12:36.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.535+0000 7f4454bfd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f444c1b06e0 con 0x562b54517670 2024-09-19T06:12:36.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.535+0000 7f4454bfd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f444c1ad920 con 0x562b54516d50 2024-09-19T06:12:36.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.535+0000 7f4454bfd740 10 client.0 _ll_register_callbacks cb 0x7f4438031a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:36.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.535+0000 7f444be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b54521f30 0x562b5451bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.535+0000 7f444be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b54521f30 0x562b5451bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54094/0 (socket says 172.21.15.3:54094) 2024-09-19T06:12:36.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.535+0000 7f444be00640 1 -- 172.21.15.3:0/3055440042 learned_addr learned my addr 172.21.15.3:0/3055440042 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:36.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.535+0000 7f444aa00640 1 --2- 172.21.15.3:0/3055440042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54517670 0x562b5451ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.536+0000 7f444b400640 1 --2- 172.21.15.3:0/3055440042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54516d50 0x562b5452a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.536+0000 7f444aa00640 1 -- 172.21.15.3:0/3055440042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54516d50 msgr2=0x562b5452a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:36.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.536+0000 7f444aa00640 1 --2- 172.21.15.3:0/3055440042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54516d50 0x562b5452a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.536+0000 7f444aa00640 1 -- 172.21.15.3:0/3055440042 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b54521f30 msgr2=0x562b5451bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:36.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.536+0000 7f444aa00640 1 --2- 172.21.15.3:0/3055440042 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b54521f30 0x562b5451bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.536+0000 7f444aa00640 1 -- 172.21.15.3:0/3055440042 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b5451c640 con 0x562b54517670 2024-09-19T06:12:36.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.536+0000 7f444b400640 1 --2- 172.21.15.3:0/3055440042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54516d50 0x562b5452a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:12:36.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.536+0000 7f444be00640 1 --2- 172.21.15.3:0/3055440042 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b54521f30 0x562b5451bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:12:36.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.536+0000 7f444aa00640 1 --2- 172.21.15.3:0/3055440042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54517670 0x562b5451ba90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f44380ba910 tx=0x7f44380edbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c47fadaa22e09f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:36.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.536+0000 7f4435600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:12:36.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.536+0000 7f4435600640 1 -- 172.21.15.3:0/3055440042 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4438049070 con 0x562b54517670 2024-09-19T06:12:36.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.536+0000 7f4435600640 1 -- 172.21.15.3:0/3055440042 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f44380b8cd0 con 0x562b54517670 2024-09-19T06:12:36.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.536+0000 7f4454bfd740 1 -- 172.21.15.3:0/3055440042 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44380c5220 con 0x562b54517670 2024-09-19T06:12:36.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.537+0000 7f4435600640 1 -- 172.21.15.3:0/3055440042 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f44380f3c90 con 0x562b54517670 2024-09-19T06:12:36.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.537+0000 7f4454bfd740 10 client.25337 fetch_fsmap learned FSMap version 29 2024-09-19T06:12:36.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.537+0000 7f4454bfd740 1 -- 172.21.15.3:0/3055440042 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562b5451c640 con 0x562b54517670 2024-09-19T06:12:36.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.537+0000 7f4435600640 1 -- 172.21.15.3:0/3055440042 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44380c5220 con 0x562b54517670 2024-09-19T06:12:36.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.537+0000 7f4435600640 1 -- 172.21.15.3:0/3055440042 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f44380edd80 con 0x562b54517670 2024-09-19T06:12:36.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.537+0000 7f4454bfd740 10 client.25337 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:12:36.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.538+0000 7f4454bfd740 10 client.25337 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:12:36.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.538+0000 7f4454bfd740 20 client.25337 populate_metadata read hostname 'smithi003' 2024-09-19T06:12:36.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.538+0000 7f4454bfd740 1 --2- 172.21.15.3:0/3055440042 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562b5459cb70 0x562b5459ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:36.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.538+0000 7f4454bfd740 4 client.25337 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:12:36.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.538+0000 7f4454bfd740 1 -- 172.21.15.3:0/3055440042 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562b54484e60 con 0x562b5459cb70 2024-09-19T06:12:36.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.538+0000 7f444b400640 1 --2- 172.21.15.3:0/3055440042 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562b5459cb70 0x562b5459ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:36.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.538+0000 7f444b400640 1 --2- 172.21.15.3:0/3055440042 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562b5459cb70 0x562b5459ef60 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8bcfdcf3c85a93b server_cookie=d24ed72d22e9a238 in_seq=0 out_seq=0 2024-09-19T06:12:36.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.538+0000 7f4435600640 10 client.25337 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:12:36.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.539+0000 7f4435600640 1 -- 172.21.15.3:0/3055440042 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562b54484e60 con 0x562b5459cb70 2024-09-19T06:12:36.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.539+0000 7f4435600640 10 client.25337 handle_command_reply: tid=0 2024-09-19T06:12:36.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.539+0000 7f4454bfd740 1 client.25337 shutdown 2024-09-19T06:12:36.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.539+0000 7f4454bfd740 1 -- 172.21.15.3:0/3055440042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54517670 msgr2=0x562b5451ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:36.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.539+0000 7f4454bfd740 1 --2- 172.21.15.3:0/3055440042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54517670 0x562b5451ba90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f44380ba910 tx=0x7f44380edbe0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.539+0000 7f4454bfd740 1 -- 172.21.15.3:0/3055440042 shutdown_connections 2024-09-19T06:12:36.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.539+0000 7f4454bfd740 1 --2- 172.21.15.3:0/3055440042 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562b5459cb70 0x562b5459ef60 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.539+0000 7f4454bfd740 1 --2- 172.21.15.3:0/3055440042 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b54521f30 0x562b5451bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.539+0000 7f4454bfd740 1 --2- 172.21.15.3:0/3055440042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b54517670 0x562b5451ba90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.539+0000 7f4454bfd740 1 --2- 172.21.15.3:0/3055440042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b54516d50 0x562b5452a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.539+0000 7f4435600640 0 client.25337 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:12:36.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.539+0000 7f4454bfd740 1 -- 172.21.15.3:0/3055440042 >> 172.21.15.3:0/3055440042 conn(0x562b545132e0 msgr2=0x562b5451f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:36.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.539+0000 7f4454bfd740 1 -- 172.21.15.3:0/3055440042 shutdown_connections 2024-09-19T06:12:36.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.539+0000 7f4454bfd740 1 -- 172.21.15.3:0/3055440042 wait complete. 2024-09-19T06:12:36.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.540+0000 7f4454bfd740 20 client.25337 trim_cache size 0 max 16384 2024-09-19T06:12:36.549 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:12:36.550 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:12:36.550 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": { 2024-09-19T06:12:36.550 INFO:teuthology.orchestra.run.smithi003.stdout: "e0df15f2-ecf8-4c4c-a6ba-c4223a61d3ec": { 2024-09-19T06:12:36.550 INFO:teuthology.orchestra.run.smithi003.stdout: "path": "/", 2024-09-19T06:12:36.550 INFO:teuthology.orchestra.run.smithi003.stdout: "tag": "e0df15f2-ecf8-4c4c-a6ba-c4223a61d3ec", 2024-09-19T06:12:36.550 INFO:teuthology.orchestra.run.smithi003.stdout: "options": "recursive,force" 2024-09-19T06:12:36.550 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:12:36.550 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:12:36.550 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:12:36.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.540+0000 7f4451000640 1 -- 172.21.15.3:0/1107383969 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f44300a3440 msgr2=0x7f44300a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:36.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.540+0000 7f4451000640 1 --2- 172.21.15.3:0/1107383969 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f44300a3440 0x7f44300a5900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4444005fd0 tx=0x7f4444009600 comp rx=0 tx=0).stop 2024-09-19T06:12:36.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.540+0000 7f4451000640 1 -- 172.21.15.3:0/1107383969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f444c102360 msgr2=0x7f444c19aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:36.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.540+0000 7f4451000640 1 --2- 172.21.15.3:0/1107383969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f444c102360 0x7f444c19aa20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4438009230 tx=0x7f4438004270 comp rx=0 tx=0).stop 2024-09-19T06:12:36.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.540+0000 7f4451000640 1 -- 172.21.15.3:0/1107383969 shutdown_connections 2024-09-19T06:12:36.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.541+0000 7f4451000640 1 --2- 172.21.15.3:0/1107383969 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f44300a3440 0x7f44300a5900 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.541+0000 7f4451000640 1 --2- 172.21.15.3:0/1107383969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f444c1079c0 0x7f444c19edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.541+0000 7f4451000640 1 --2- 172.21.15.3:0/1107383969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f444c102360 0x7f444c19aa20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.541+0000 7f4451000640 1 --2- 172.21.15.3:0/1107383969 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f444c1019c0 0x7f444c19a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:36.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.541+0000 7f4451000640 1 -- 172.21.15.3:0/1107383969 >> 172.21.15.3:0/1107383969 conn(0x7f444c0fd740 msgr2=0x7f444c10d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:36.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.541+0000 7f4451000640 1 -- 172.21.15.3:0/1107383969 shutdown_connections 2024-09-19T06:12:36.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:12:36.541+0000 7f4451000640 1 -- 172.21.15.3:0/1107383969 wait complete. 2024-09-19T06:12:36.552 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:36 smithi059 ceph-mon[35138]: pgmap v9: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 186 B/s wr, 20 op/s 2024-09-19T06:12:36.552 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:36 smithi059 ceph-mon[35138]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:12:36.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:36 smithi071 ceph-mon[35662]: pgmap v9: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 186 B/s wr, 20 op/s 2024-09-19T06:12:36.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:36 smithi071 ceph-mon[35662]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:12:36.612 DEBUG:teuthology.orchestra.run.smithi003:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T06:12:36.690 INFO:tasks.workunit.client.0.smithi003.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T06:12:37.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:37 smithi003 ceph-mon[30893]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:12:37.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:37 smithi003 ceph-mon[30893]: from='client.25316 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:12:37.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:37 smithi059 ceph-mon[35138]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:12:37.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:37 smithi059 ceph-mon[35138]: from='client.25316 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:12:37.583 INFO:tasks.cephfs.filesystem:scrub status for tag:e0df15f2-ecf8-4c4c-a6ba-c4223a61d3ec - {'path': '/', 'tag': 'e0df15f2-ecf8-4c4c-a6ba-c4223a61d3ec', 'options': 'recursive,force'} 2024-09-19T06:12:37.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:37 smithi071 ceph-mon[35662]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:12:37.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:37 smithi071 ceph-mon[35662]: from='client.25316 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:12:38.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:38 smithi059 ceph-mon[35138]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:12:38.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:38 smithi059 ceph-mon[35138]: pgmap v10: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 170 B/s wr, 18 op/s 2024-09-19T06:12:38.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:38 smithi003 ceph-mon[30893]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:12:38.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:38 smithi003 ceph-mon[30893]: pgmap v10: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 170 B/s wr, 18 op/s 2024-09-19T06:12:38.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:38 smithi071 ceph-mon[35662]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:12:38.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:38 smithi071 ceph-mon[35662]: pgmap v10: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 170 B/s wr, 18 op/s 2024-09-19T06:12:40.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:40 smithi059 ceph-mon[35138]: pgmap v11: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 170 B/s wr, 18 op/s 2024-09-19T06:12:40.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:40 smithi003 ceph-mon[30893]: pgmap v11: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 170 B/s wr, 18 op/s 2024-09-19T06:12:40.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:40 smithi071 ceph-mon[35662]: pgmap v11: 97 pgs: 97 active+clean; 1.1 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 170 B/s wr, 18 op/s 2024-09-19T06:12:42.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:42 smithi059 ceph-mon[35138]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 KiB/s wr, 55 op/s 2024-09-19T06:12:42.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:42 smithi003 ceph-mon[30893]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 KiB/s wr, 55 op/s 2024-09-19T06:12:42.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:42 smithi071 ceph-mon[35662]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 KiB/s wr, 55 op/s 2024-09-19T06:12:44.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:44 smithi059 ceph-mon[35138]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-09-19T06:12:44.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:44 smithi003 ceph-mon[30893]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-09-19T06:12:44.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:44 smithi071 ceph-mon[35662]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-09-19T06:12:45.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:45 smithi059 ceph-mon[35138]: scrub summary: idle 2024-09-19T06:12:45.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:45 smithi003 ceph-mon[30893]: scrub summary: idle 2024-09-19T06:12:45.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:45 smithi071 ceph-mon[35662]: scrub summary: idle 2024-09-19T06:12:46.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:46 smithi059 ceph-mon[35138]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 77 KiB/s wr, 45 op/s 2024-09-19T06:12:46.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:46 smithi003 ceph-mon[30893]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 77 KiB/s wr, 45 op/s 2024-09-19T06:12:46.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:46 smithi071 ceph-mon[35662]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 77 KiB/s wr, 45 op/s 2024-09-19T06:12:48.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:48 smithi059 ceph-mon[35138]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-09-19T06:12:48.708 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:48 smithi071 ceph-mon[35662]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-09-19T06:12:48.708 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:48 smithi003 ceph-mon[30893]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-09-19T06:12:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.682+0000 7f3818800640 1 -- 172.21.15.3:0/3686105076 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3810103f30 msgr2=0x7f3810104310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.682+0000 7f3818800640 1 --2- 172.21.15.3:0/3686105076 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3810103f30 0x7f3810104310 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3804009900 tx=0x7f380402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.682+0000 7f3818800640 1 -- 172.21.15.3:0/3686105076 shutdown_connections 2024-09-19T06:12:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.682+0000 7f3818800640 1 --2- 172.21.15.3:0/3686105076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3810109080 0x7f3810110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.683+0000 7f3818800640 1 --2- 172.21.15.3:0/3686105076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38101048e0 0x7f3810108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.683+0000 7f3818800640 1 --2- 172.21.15.3:0/3686105076 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3810103f30 0x7f3810104310 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.683+0000 7f3818800640 1 -- 172.21.15.3:0/3686105076 >> 172.21.15.3:0/3686105076 conn(0x7f38100ff980 msgr2=0x7f3810101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.683+0000 7f3818800640 1 -- 172.21.15.3:0/3686105076 shutdown_connections 2024-09-19T06:12:49.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.683+0000 7f3818800640 1 -- 172.21.15.3:0/3686105076 wait complete. 2024-09-19T06:12:49.687 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.683+0000 7f3818800640 1 Processor -- start 2024-09-19T06:12:49.687 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.684+0000 7f3818800640 1 -- start start 2024-09-19T06:12:49.687 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.684+0000 7f3818800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3810103f30 0x7f381019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:49.687 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.684+0000 7f3818800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3810109080 0x7f381019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.684+0000 7f3818800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f381019eee0 0x7f381019f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.684+0000 7f3818800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f38101140b0 con 0x7f3810109080 2024-09-19T06:12:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.684+0000 7f3818800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3810113f30 con 0x7f3810103f30 2024-09-19T06:12:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.684+0000 7f3818800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3810114230 con 0x7f381019eee0 2024-09-19T06:12:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.684+0000 7f3815e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3810103f30 0x7f381019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.684+0000 7f3815e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3810103f30 0x7f381019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40566/0 (socket says 172.21.15.3:40566) 2024-09-19T06:12:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.684+0000 7f3815e00640 1 -- 172.21.15.3:0/1183016238 learned_addr learned my addr 172.21.15.3:0/1183016238 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.684+0000 7f3815400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3810109080 0x7f381019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.684+0000 7f3816800640 1 --2- 172.21.15.3:0/1183016238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f381019eee0 0x7f381019f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.685+0000 7f3815e00640 1 -- 172.21.15.3:0/1183016238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f381019eee0 msgr2=0x7f381019f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.685+0000 7f3815e00640 1 --2- 172.21.15.3:0/1183016238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f381019eee0 0x7f381019f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.688 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.685+0000 7f3815e00640 1 -- 172.21.15.3:0/1183016238 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3810109080 msgr2=0x7f381019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.685+0000 7f3815e00640 1 --2- 172.21.15.3:0/1183016238 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3810109080 0x7f381019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.685+0000 7f3815e00640 1 -- 172.21.15.3:0/1183016238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f381019f9d0 con 0x7f3810103f30 2024-09-19T06:12:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.685+0000 7f3815e00640 1 --2- 172.21.15.3:0/1183016238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3810103f30 0x7f381019a620 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3804006010 tx=0x7f38040042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.685+0000 7f380aa00640 1 -- 172.21.15.3:0/1183016238 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380403f030 con 0x7f3810103f30 2024-09-19T06:12:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.685+0000 7f380aa00640 1 -- 172.21.15.3:0/1183016238 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3804003ce0 con 0x7f3810103f30 2024-09-19T06:12:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.685+0000 7f380aa00640 1 -- 172.21.15.3:0/1183016238 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3804035070 con 0x7f3810103f30 2024-09-19T06:12:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.685+0000 7f3818800640 1 -- 172.21.15.3:0/1183016238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f381019fc60 con 0x7f3810103f30 2024-09-19T06:12:49.689 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.685+0000 7f3818800640 1 -- 172.21.15.3:0/1183016238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38101a7480 con 0x7f3810103f30 2024-09-19T06:12:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.688+0000 7f381b6d1740 1 Processor -- start 2024-09-19T06:12:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.688+0000 7f380aa00640 1 -- 172.21.15.3:0/1183016238 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 138530+0+0 (secure 0 0 0) 0x7f3804042030 con 0x7f3810103f30 2024-09-19T06:12:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.688+0000 7f381b6d1740 1 -- start start 2024-09-19T06:12:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.689+0000 7f381b6d1740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647c47c31e0 0x5647c47c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.689+0000 7f381b6d1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 0x5647c47cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.689+0000 7f381b6d1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647c47ce3a0 0x5647c47d0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.689+0000 7f381b6d1740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5647c4729100 con 0x5647c47c31e0 2024-09-19T06:12:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.689+0000 7f381b6d1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5647c46d11b0 con 0x5647c47c3b00 2024-09-19T06:12:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.689+0000 7f381b6d1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5647c47250c0 con 0x5647c47ce3a0 2024-09-19T06:12:49.691 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.689+0000 7f3815e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 0x5647c47cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:49.692 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.689+0000 7f3815400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647c47ce3a0 0x5647c47d0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:49.692 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.689+0000 7f3816800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647c47c31e0 0x5647c47c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:49.692 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.689+0000 7f3815e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 0x5647c47cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40574/0 (socket says 172.21.15.3:40574) 2024-09-19T06:12:49.692 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.689+0000 7f3815e00640 1 -- 172.21.15.3:0/3934396221 learned_addr learned my addr 172.21.15.3:0/3934396221 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:49.695 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.689+0000 7f3815e00640 1 -- 172.21.15.3:0/3934396221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647c47ce3a0 msgr2=0x5647c47d0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:49.695 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.689+0000 7f3815e00640 1 --2- 172.21.15.3:0/3934396221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647c47ce3a0 0x5647c47d0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.689+0000 7f3815e00640 1 -- 172.21.15.3:0/3934396221 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647c47c31e0 msgr2=0x5647c47c35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.689+0000 7f3815e00640 1 --2- 172.21.15.3:0/3934396221 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647c47c31e0 0x5647c47c35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.690+0000 7f3815e00640 1 -- 172.21.15.3:0/3934396221 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647c443c210 con 0x5647c47c3b00 2024-09-19T06:12:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.690+0000 7f3815e00640 1 --2- 172.21.15.3:0/3934396221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 0x5647c47cde60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f38040ed950 tx=0x7f38040f84c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8063cf172fd4f0e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.690+0000 7f37ff000640 1 -- 172.21.15.3:0/3934396221 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38040f22d0 con 0x5647c47c3b00 2024-09-19T06:12:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.690+0000 7f37ff000640 1 -- 172.21.15.3:0/3934396221 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38040fd030 con 0x5647c47c3b00 2024-09-19T06:12:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.690+0000 7f37ff000640 1 -- 172.21.15.3:0/3934396221 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3804101740 con 0x5647c47c3b00 2024-09-19T06:12:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.690+0000 7f380aa00640 1 --2- 172.21.15.3:0/1183016238 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f37f80a34c0 0x7f37f80a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.691+0000 7f380aa00640 1 -- 172.21.15.3:0/1183016238 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f38040f03b0 con 0x7f3810103f30 2024-09-19T06:12:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.691+0000 7f381b6d1740 1 -- 172.21.15.3:0/3934396221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 msgr2=0x5647c47cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:49.696 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.691+0000 7f381b6d1740 1 --2- 172.21.15.3:0/3934396221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 0x5647c47cde60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f38040ed950 tx=0x7f38040f84c0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.697 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.691+0000 7f3816800640 1 --2- 172.21.15.3:0/1183016238 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f37f80a34c0 0x7f37f80a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:49.697 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.691+0000 7f381b6d1740 1 -- 172.21.15.3:0/3934396221 shutdown_connections 2024-09-19T06:12:49.697 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.691+0000 7f381b6d1740 1 --2- 172.21.15.3:0/3934396221 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647c47ce3a0 0x5647c47d0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.697 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.691+0000 7f381b6d1740 1 --2- 172.21.15.3:0/3934396221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 0x5647c47cde60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.697 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.691+0000 7f381b6d1740 1 --2- 172.21.15.3:0/3934396221 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647c47c31e0 0x5647c47c35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.697 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.691+0000 7f381b6d1740 1 -- 172.21.15.3:0/3934396221 >> 172.21.15.3:0/3934396221 conn(0x5647c47bf750 msgr2=0x5647c47bfb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:49.697 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.691+0000 7f381b6d1740 1 -- 172.21.15.3:0/3934396221 shutdown_connections 2024-09-19T06:12:49.697 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.691+0000 7f381b6d1740 1 -- 172.21.15.3:0/3934396221 wait complete. 2024-09-19T06:12:49.697 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.691+0000 7f3816800640 1 --2- 172.21.15.3:0/1183016238 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f37f80a34c0 0x7f37f80a5980 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f380c005fd0 tx=0x7f380c0096a0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:49.697 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.692+0000 7f381b6d1740 1 -- start start 2024-09-19T06:12:49.697 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.692+0000 7f381b6d1740 1 Processor -- start 2024-09-19T06:12:49.697 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.692+0000 7f381b6d1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647c47c31e0 0x5647c47cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:49.697 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.692+0000 7f381b6d1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 0x5647c47cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:49.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.692+0000 7f381b6d1740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647c47ce3a0 0x5647c47cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:49.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.692+0000 7f381b6d1740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5647c47d0d30 con 0x5647c47ce3a0 2024-09-19T06:12:49.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.692+0000 7f381b6d1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5647c46b2090 con 0x5647c47c3b00 2024-09-19T06:12:49.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.692+0000 7f381b6d1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5647c47d0eb0 con 0x5647c47c31e0 2024-09-19T06:12:49.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.692+0000 7f381b6d1740 10 client.0 _ll_register_callbacks cb 0x5647c4706f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:49.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.692+0000 7f3815400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 0x5647c47cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:49.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.692+0000 7f3815400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 0x5647c47cb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40588/0 (socket says 172.21.15.3:40588) 2024-09-19T06:12:49.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.692+0000 7f3815400640 1 -- 172.21.15.3:0/2028964429 learned_addr learned my addr 172.21.15.3:0/2028964429 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:49.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.693+0000 7f3816800640 1 --2- 172.21.15.3:0/2028964429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647c47ce3a0 0x5647c47cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:49.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.693+0000 7f3815e00640 1 --2- 172.21.15.3:0/2028964429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647c47c31e0 0x5647c47cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:49.700 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.693+0000 7f3815400640 1 -- 172.21.15.3:0/2028964429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647c47c31e0 msgr2=0x5647c47cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:49.700 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.693+0000 7f3815400640 1 --2- 172.21.15.3:0/2028964429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647c47c31e0 0x5647c47cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.700 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.693+0000 7f3815400640 1 -- 172.21.15.3:0/2028964429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647c47ce3a0 msgr2=0x5647c47cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:49.700 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.693+0000 7f3815400640 1 --2- 172.21.15.3:0/2028964429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647c47ce3a0 0x5647c47cbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.700 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.693+0000 7f3815400640 1 -- 172.21.15.3:0/2028964429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647c4508620 con 0x5647c47c3b00 2024-09-19T06:12:49.700 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.693+0000 7f3815400640 1 --2- 172.21.15.3:0/2028964429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 0x5647c47cb860 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3800012700 tx=0x7f3800012b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab21f6aa590d4984 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:49.700 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.693+0000 7f37f3400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:12:49.700 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.693+0000 7f37f3400640 1 -- 172.21.15.3:0/2028964429 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380000f640 con 0x5647c47c3b00 2024-09-19T06:12:49.700 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.693+0000 7f381b6d1740 1 -- 172.21.15.3:0/2028964429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38040fd030 con 0x5647c47c3b00 2024-09-19T06:12:49.700 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.693+0000 7f37f3400640 1 -- 172.21.15.3:0/2028964429 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f380000f7e0 con 0x5647c47c3b00 2024-09-19T06:12:49.700 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.694+0000 7f37f3400640 1 -- 172.21.15.3:0/2028964429 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f380000f9e0 con 0x5647c47c3b00 2024-09-19T06:12:49.701 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.694+0000 7f381b6d1740 10 client.25349 fetch_fsmap learned FSMap version 29 2024-09-19T06:12:49.701 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.694+0000 7f381b6d1740 1 -- 172.21.15.3:0/2028964429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5647c47dc930 con 0x5647c47c3b00 2024-09-19T06:12:49.701 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.694+0000 7f37f3400640 1 -- 172.21.15.3:0/2028964429 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38040fd030 con 0x5647c47c3b00 2024-09-19T06:12:49.702 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.694+0000 7f37f3400640 1 -- 172.21.15.3:0/2028964429 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3800010ca0 con 0x5647c47c3b00 2024-09-19T06:12:49.702 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.694+0000 7f381b6d1740 10 client.25349 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:12:49.702 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.694+0000 7f381b6d1740 10 client.25349 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:12:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.694+0000 7f381b6d1740 20 client.25349 populate_metadata read hostname 'smithi003' 2024-09-19T06:12:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.694+0000 7f381b6d1740 1 --2- 172.21.15.3:0/2028964429 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5647c47dde90 0x5647c47e0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.694+0000 7f381b6d1740 4 client.25349 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:12:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.694+0000 7f381b6d1740 1 -- 172.21.15.3:0/2028964429 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647c4736830 con 0x5647c47dde90 2024-09-19T06:12:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.694+0000 7f3815e00640 1 --2- 172.21.15.3:0/2028964429 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5647c47dde90 0x5647c47e0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.695+0000 7f3815e00640 1 --2- 172.21.15.3:0/2028964429 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5647c47dde90 0x5647c47e0280 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a62cb6826a5440de server_cookie=507b976582340cfe in_seq=0 out_seq=0 2024-09-19T06:12:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.695+0000 7f37f3400640 10 client.25349 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:12:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.696+0000 7f37f3400640 1 -- 172.21.15.3:0/2028964429 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5647c4736830 con 0x5647c47dde90 2024-09-19T06:12:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.696+0000 7f37f3400640 10 client.25349 handle_command_reply: tid=0 2024-09-19T06:12:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.696+0000 7f381b6d1740 1 client.25349 shutdown 2024-09-19T06:12:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.696+0000 7f381b6d1740 1 -- 172.21.15.3:0/2028964429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 msgr2=0x5647c47cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.696+0000 7f381b6d1740 1 --2- 172.21.15.3:0/2028964429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 0x5647c47cb860 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3800012700 tx=0x7f3800012b00 comp rx=0 tx=0).stop 2024-09-19T06:12:49.703 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.696+0000 7f381b6d1740 1 -- 172.21.15.3:0/2028964429 shutdown_connections 2024-09-19T06:12:49.704 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.696+0000 7f381b6d1740 1 --2- 172.21.15.3:0/2028964429 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5647c47dde90 0x5647c47e0280 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.704 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.696+0000 7f381b6d1740 1 --2- 172.21.15.3:0/2028964429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647c47ce3a0 0x5647c47cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.704 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.696+0000 7f381b6d1740 1 --2- 172.21.15.3:0/2028964429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 0x5647c47cb860 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.704 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.696+0000 7f381b6d1740 1 --2- 172.21.15.3:0/2028964429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647c47c31e0 0x5647c47cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.704 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.696+0000 7f381b6d1740 1 -- 172.21.15.3:0/2028964429 >> 172.21.15.3:0/2028964429 conn(0x5647c47bf750 msgr2=0x5647c47c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:49.704 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.696+0000 7f37f3400640 0 client.25349 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:12:49.704 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.696+0000 7f381b6d1740 1 -- 172.21.15.3:0/2028964429 shutdown_connections 2024-09-19T06:12:49.704 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.696+0000 7f381b6d1740 1 -- 172.21.15.3:0/2028964429 wait complete. 2024-09-19T06:12:49.704 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.696+0000 7f381b6d1740 20 client.25349 trim_cache size 0 max 16384 2024-09-19T06:12:49.714 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.711+0000 7f381b6d1740 1 Processor -- start 2024-09-19T06:12:49.714 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.711+0000 7f381b6d1740 1 -- start start 2024-09-19T06:12:49.714 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.712+0000 7f381b6d1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647c47c31e0 0x5647c47c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:49.714 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.712+0000 7f381b6d1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 0x5647c47cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:49.714 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.712+0000 7f381b6d1740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647c47ce3a0 0x5647c47e5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:49.714 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.712+0000 7f381b6d1740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f38101afb40 con 0x5647c47ce3a0 2024-09-19T06:12:49.714 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.712+0000 7f381b6d1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f38101b1680 con 0x5647c47c3b00 2024-09-19T06:12:49.714 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.712+0000 7f381b6d1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f38101b0210 con 0x5647c47c31e0 2024-09-19T06:12:49.715 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.712+0000 7f3815400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 0x5647c47cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:49.715 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.712+0000 7f3815400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 0x5647c47cbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40604/0 (socket says 172.21.15.3:40604) 2024-09-19T06:12:49.715 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.712+0000 7f3815400640 1 -- 172.21.15.3:0/3393786281 learned_addr learned my addr 172.21.15.3:0/3393786281 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:49.715 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.712+0000 7f3816800640 1 --2- 172.21.15.3:0/3393786281 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647c47ce3a0 0x5647c47e5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:49.715 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.712+0000 7f3815e00640 1 --2- 172.21.15.3:0/3393786281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647c47c31e0 0x5647c47c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:49.715 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.712+0000 7f3815400640 1 -- 172.21.15.3:0/3393786281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647c47c31e0 msgr2=0x5647c47c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:49.715 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.712+0000 7f3815400640 1 --2- 172.21.15.3:0/3393786281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647c47c31e0 0x5647c47c53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.715 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.712+0000 7f3815400640 1 -- 172.21.15.3:0/3393786281 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647c47ce3a0 msgr2=0x5647c47e5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:49.715 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.712+0000 7f3815400640 1 --2- 172.21.15.3:0/3393786281 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647c47ce3a0 0x5647c47e5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.715 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.712+0000 7f3815400640 1 -- 172.21.15.3:0/3393786281 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647c47d0790 con 0x5647c47c3b00 2024-09-19T06:12:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.713+0000 7f3815400640 1 --2- 172.21.15.3:0/3393786281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 0x5647c47cbbd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3800005870 tx=0x7f3800009fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a228e95e4f4142b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.713+0000 7f37fe600640 1 -- 172.21.15.3:0/3393786281 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380000f700 con 0x5647c47c3b00 2024-09-19T06:12:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.713+0000 7f37fe600640 1 -- 172.21.15.3:0/3393786281 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3800005550 con 0x5647c47c3b00 2024-09-19T06:12:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.713+0000 7f37fe600640 1 -- 172.21.15.3:0/3393786281 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380001cb00 con 0x5647c47c3b00 2024-09-19T06:12:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.713+0000 7f381b6d1740 1 -- 172.21.15.3:0/3393786281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 msgr2=0x5647c47cbbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.713+0000 7f381b6d1740 1 --2- 172.21.15.3:0/3393786281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 0x5647c47cbbd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3800005870 tx=0x7f3800009fd0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.713+0000 7f381b6d1740 1 -- 172.21.15.3:0/3393786281 shutdown_connections 2024-09-19T06:12:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.713+0000 7f381b6d1740 1 --2- 172.21.15.3:0/3393786281 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647c47ce3a0 0x5647c47e5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.713+0000 7f381b6d1740 1 --2- 172.21.15.3:0/3393786281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 0x5647c47cbbd0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.719 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.713+0000 7f381b6d1740 1 --2- 172.21.15.3:0/3393786281 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647c47c31e0 0x5647c47c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.713+0000 7f381b6d1740 1 -- 172.21.15.3:0/3393786281 >> 172.21.15.3:0/3393786281 conn(0x5647c47bf750 msgr2=0x5647c47c4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.713+0000 7f381b6d1740 1 -- 172.21.15.3:0/3393786281 shutdown_connections 2024-09-19T06:12:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.713+0000 7f381b6d1740 1 -- 172.21.15.3:0/3393786281 wait complete. 2024-09-19T06:12:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.714+0000 7f381b6d1740 1 -- start start 2024-09-19T06:12:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.714+0000 7f381b6d1740 1 Processor -- start 2024-09-19T06:12:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.714+0000 7f381b6d1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647c47c31e0 0x5647c47d6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.714+0000 7f381b6d1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 0x5647c47c8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.714+0000 7f381b6d1740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647c47ce3a0 0x5647c47c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.714+0000 7f381b6d1740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f38101b0fb0 con 0x5647c47ce3a0 2024-09-19T06:12:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.714+0000 7f381b6d1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f38101b08e0 con 0x5647c47c3b00 2024-09-19T06:12:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.714+0000 7f381b6d1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f38101adb20 con 0x5647c47c31e0 2024-09-19T06:12:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.715+0000 7f381b6d1740 10 client.0 _ll_register_callbacks cb 0x7f3800009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:12:49.720 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.715+0000 7f3815400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 0x5647c47c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.715+0000 7f3815400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 0x5647c47c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40616/0 (socket says 172.21.15.3:40616) 2024-09-19T06:12:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.715+0000 7f3815400640 1 -- 172.21.15.3:0/2729979997 learned_addr learned my addr 172.21.15.3:0/2729979997 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:12:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.715+0000 7f3816800640 1 --2- 172.21.15.3:0/2729979997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647c47ce3a0 0x5647c47c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.715+0000 7f3815e00640 1 --2- 172.21.15.3:0/2729979997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647c47c31e0 0x5647c47d6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.715+0000 7f3815400640 1 -- 172.21.15.3:0/2729979997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647c47c31e0 msgr2=0x5647c47d6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.715+0000 7f3815400640 1 --2- 172.21.15.3:0/2729979997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647c47c31e0 0x5647c47d6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.715+0000 7f3815400640 1 -- 172.21.15.3:0/2729979997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647c47ce3a0 msgr2=0x5647c47c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:12:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.715+0000 7f3815400640 1 --2- 172.21.15.3:0/2729979997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647c47ce3a0 0x5647c47c8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.715+0000 7f3815400640 1 -- 172.21.15.3:0/2729979997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647c4847b20 con 0x5647c47c3b00 2024-09-19T06:12:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.715+0000 7f3815400640 1 --2- 172.21.15.3:0/2729979997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 0x5647c47c8360 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f380000f930 tx=0x7f380000f960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f38ba7dd5d48aa7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:12:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.715+0000 7f37f3400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:12:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.715+0000 7f37f3400640 1 -- 172.21.15.3:0/2729979997 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380001c6c0 con 0x5647c47c3b00 2024-09-19T06:12:49.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.716+0000 7f37f3400640 1 -- 172.21.15.3:0/2729979997 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f380001c860 con 0x5647c47c3b00 2024-09-19T06:12:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.716+0000 7f381b6d1740 1 -- 172.21.15.3:0/2729979997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3800005550 con 0x5647c47c3b00 2024-09-19T06:12:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.716+0000 7f37f3400640 1 -- 172.21.15.3:0/2729979997 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f380001caa0 con 0x5647c47c3b00 2024-09-19T06:12:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.716+0000 7f381b6d1740 10 client.25355 fetch_fsmap learned FSMap version 29 2024-09-19T06:12:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.716+0000 7f381b6d1740 1 -- 172.21.15.3:0/2729979997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5647c4848cf0 con 0x5647c47c3b00 2024-09-19T06:12:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.716+0000 7f37f3400640 1 -- 172.21.15.3:0/2729979997 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3800005550 con 0x5647c47c3b00 2024-09-19T06:12:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.716+0000 7f37f3400640 1 -- 172.21.15.3:0/2729979997 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3800034020 con 0x5647c47c3b00 2024-09-19T06:12:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.716+0000 7f381b6d1740 10 client.25355 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:12:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.716+0000 7f381b6d1740 10 client.25355 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:12:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.716+0000 7f381b6d1740 20 client.25355 populate_metadata read hostname 'smithi003' 2024-09-19T06:12:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.716+0000 7f381b6d1740 1 --2- 172.21.15.3:0/2729979997 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5647c4849300 0x5647c484b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:12:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.716+0000 7f381b6d1740 4 client.25355 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:12:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.716+0000 7f381b6d1740 1 -- 172.21.15.3:0/2729979997 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5647c4730b80 con 0x5647c4849300 2024-09-19T06:12:49.722 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.717+0000 7f3815e00640 1 --2- 172.21.15.3:0/2729979997 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5647c4849300 0x5647c484b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:12:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.717+0000 7f3815e00640 1 --2- 172.21.15.3:0/2729979997 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5647c4849300 0x5647c484b720 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54c3b792278423bf server_cookie=4a498fa81dc7d15c in_seq=0 out_seq=0 2024-09-19T06:12:49.723 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.717+0000 7f37f3400640 10 client.25355 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:12:49.731 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.729+0000 7f37f3400640 1 -- 172.21.15.3:0/2729979997 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5647c4730b80 con 0x5647c4849300 2024-09-19T06:12:49.731 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.729+0000 7f37f3400640 10 client.25355 handle_command_reply: tid=0 2024-09-19T06:12:49.731 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.729+0000 7f381b6d1740 1 client.25355 shutdown 2024-09-19T06:12:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.729+0000 7f381b6d1740 1 -- 172.21.15.3:0/2729979997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 msgr2=0x5647c47c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.729+0000 7f381b6d1740 1 --2- 172.21.15.3:0/2729979997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 0x5647c47c8360 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f380000f930 tx=0x7f380000f960 comp rx=0 tx=0).stop 2024-09-19T06:12:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.729+0000 7f381b6d1740 1 -- 172.21.15.3:0/2729979997 shutdown_connections 2024-09-19T06:12:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.729+0000 7f381b6d1740 1 --2- 172.21.15.3:0/2729979997 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5647c4849300 0x5647c484b720 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.729+0000 7f381b6d1740 1 --2- 172.21.15.3:0/2729979997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647c47ce3a0 0x5647c47c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.729+0000 7f381b6d1740 1 --2- 172.21.15.3:0/2729979997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647c47c3b00 0x5647c47c8360 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.729+0000 7f37f3400640 0 client.25355 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:12:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.729+0000 7f381b6d1740 1 --2- 172.21.15.3:0/2729979997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647c47c31e0 0x5647c47d6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.729+0000 7f381b6d1740 1 -- 172.21.15.3:0/2729979997 >> 172.21.15.3:0/2729979997 conn(0x5647c47bf750 msgr2=0x5647c47c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.729+0000 7f381b6d1740 1 -- 172.21.15.3:0/2729979997 shutdown_connections 2024-09-19T06:12:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.729+0000 7f381b6d1740 1 -- 172.21.15.3:0/2729979997 wait complete. 2024-09-19T06:12:49.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.729+0000 7f381b6d1740 20 client.25355 trim_cache size 0 max 16384 2024-09-19T06:12:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:12:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:12:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:12:49.733 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:12:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.730+0000 7f3818800640 1 -- 172.21.15.3:0/1183016238 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f37f80a34c0 msgr2=0x7f37f80a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.730+0000 7f3818800640 1 --2- 172.21.15.3:0/1183016238 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f37f80a34c0 0x7f37f80a5980 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f380c005fd0 tx=0x7f380c0096a0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.730+0000 7f3818800640 1 -- 172.21.15.3:0/1183016238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3810103f30 msgr2=0x7f381019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:12:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.730+0000 7f3818800640 1 --2- 172.21.15.3:0/1183016238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3810103f30 0x7f381019a620 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3804006010 tx=0x7f38040042f0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.730+0000 7f3818800640 1 -- 172.21.15.3:0/1183016238 shutdown_connections 2024-09-19T06:12:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.730+0000 7f3818800640 1 --2- 172.21.15.3:0/1183016238 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f37f80a34c0 0x7f37f80a5980 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.730+0000 7f3818800640 1 --2- 172.21.15.3:0/1183016238 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f381019eee0 0x7f381019f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.730+0000 7f3818800640 1 --2- 172.21.15.3:0/1183016238 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3810109080 0x7f381019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.730+0000 7f3818800640 1 --2- 172.21.15.3:0/1183016238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3810103f30 0x7f381019a620 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:12:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.730+0000 7f3818800640 1 -- 172.21.15.3:0/1183016238 >> 172.21.15.3:0/1183016238 conn(0x7f38100ff980 msgr2=0x7f3810100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:12:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.730+0000 7f3818800640 1 -- 172.21.15.3:0/1183016238 shutdown_connections 2024-09-19T06:12:49.734 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:12:49.730+0000 7f3818800640 1 -- 172.21.15.3:0/1183016238 wait complete. 2024-09-19T06:12:50.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:50 smithi059 ceph-mon[35138]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-09-19T06:12:50.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:50 smithi003 ceph-mon[30893]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-09-19T06:12:50.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:50 smithi071 ceph-mon[35662]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-09-19T06:12:52.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:52 smithi059 ceph-mon[35138]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 77 KiB/s wr, 45 op/s 2024-09-19T06:12:52.762 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:52 smithi071 ceph-mon[35662]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 77 KiB/s wr, 45 op/s 2024-09-19T06:12:52.762 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:52 smithi003 ceph-mon[30893]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 77 KiB/s wr, 45 op/s 2024-09-19T06:12:54.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:54 smithi059 ceph-mon[35138]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:12:54.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:54 smithi003 ceph-mon[30893]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:12:54.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:54 smithi071 ceph-mon[35662]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:12:56.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:56 smithi059 ceph-mon[35138]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.0 KiB/s wr, 16 op/s 2024-09-19T06:12:56.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:56 smithi003 ceph-mon[30893]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.0 KiB/s wr, 16 op/s 2024-09-19T06:12:56.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:56 smithi071 ceph-mon[35662]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.0 KiB/s wr, 16 op/s 2024-09-19T06:12:58.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:12:58 smithi059 ceph-mon[35138]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-19T06:12:58.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:12:58 smithi003 ceph-mon[30893]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-19T06:12:58.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:12:58 smithi071 ceph-mon[35662]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-19T06:13:00.516 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:00 smithi003 ceph-mon[30893]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-19T06:13:00.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:00 smithi059 ceph-mon[35138]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-19T06:13:00.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:00 smithi071 ceph-mon[35662]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-19T06:13:00.834 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:13:00 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:13:00.513+0000 7ff6cea00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:13:00.835 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:13:00 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:13:00.513+0000 7ff6cea00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:13:00.835 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:13:00 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:13:00.513+0000 7ff6cea00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:13:00.835 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:13:00 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:13:00.513+0000 7ff6cea00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:13:00.835 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:13:00 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:13:00.513+0000 7ff6cea00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T06:13:02.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:02 smithi059 ceph-mon[35138]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.0 KiB/s wr, 16 op/s 2024-09-19T06:13:02.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:02 smithi003 ceph-mon[30893]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.0 KiB/s wr, 16 op/s 2024-09-19T06:13:02.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:02 smithi071 ceph-mon[35662]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.0 KiB/s wr, 16 op/s 2024-09-19T06:13:02.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.852+0000 7fb92e000640 1 -- 172.21.15.3:0/4138642858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb928109bf0 msgr2=0x7fb928109fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:02.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.852+0000 7fb92e000640 1 --2- 172.21.15.3:0/4138642858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb928109bf0 0x7fb928109fd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009890 tx=0x7fb91c02a360 comp rx=0 tx=0).stop 2024-09-19T06:13:02.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.852+0000 7fb92e000640 1 -- 172.21.15.3:0/4138642858 shutdown_connections 2024-09-19T06:13:02.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.852+0000 7fb92e000640 1 --2- 172.21.15.3:0/4138642858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb9281044d0 0x7fb9281109b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.852+0000 7fb92e000640 1 --2- 172.21.15.3:0/4138642858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb928103b30 0x7fb928103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.852+0000 7fb92e000640 1 --2- 172.21.15.3:0/4138642858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb928109bf0 0x7fb928109fd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.852+0000 7fb92e000640 1 -- 172.21.15.3:0/4138642858 >> 172.21.15.3:0/4138642858 conn(0x7fb9280ff7b0 msgr2=0x7fb928101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:02.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.852+0000 7fb92e000640 1 -- 172.21.15.3:0/4138642858 shutdown_connections 2024-09-19T06:13:02.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.852+0000 7fb92e000640 1 -- 172.21.15.3:0/4138642858 wait complete. 2024-09-19T06:13:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.853+0000 7fb92e000640 1 Processor -- start 2024-09-19T06:13:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.854+0000 7fb92e000640 1 -- start start 2024-09-19T06:13:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.854+0000 7fb92e000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb928103b30 0x7fb92819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.854+0000 7fb92e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9281044d0 0x7fb92819a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.854+0000 7fb92e000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb928109bf0 0x7fb92819ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.854+0000 7fb92e000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb928113f40 con 0x7fb928109bf0 2024-09-19T06:13:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.854+0000 7fb92e000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb928113dc0 con 0x7fb9281044d0 2024-09-19T06:13:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.854+0000 7fb92e000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb9281140c0 con 0x7fb928103b30 2024-09-19T06:13:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.855+0000 7fb927e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9281044d0 0x7fb92819a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.855+0000 7fb927e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9281044d0 0x7fb92819a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:56908/0 (socket says 172.21.15.3:56908) 2024-09-19T06:13:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.855+0000 7fb927e00640 1 -- 172.21.15.3:0/4037324877 learned_addr learned my addr 172.21.15.3:0/4037324877 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:02.858 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.855+0000 7fb92d600640 1 --2- 172.21.15.3:0/4037324877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb928109bf0 0x7fb92819ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:02.858 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.855+0000 7fb92cc00640 1 --2- 172.21.15.3:0/4037324877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb928103b30 0x7fb92819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:02.858 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.855+0000 7fb927e00640 1 -- 172.21.15.3:0/4037324877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb928103b30 msgr2=0x7fb92819a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:02.858 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.855+0000 7fb927e00640 1 --2- 172.21.15.3:0/4037324877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb928103b30 0x7fb92819a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.858 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.855+0000 7fb927e00640 1 -- 172.21.15.3:0/4037324877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb928109bf0 msgr2=0x7fb92819ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:02.858 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.855+0000 7fb927e00640 1 --2- 172.21.15.3:0/4037324877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb928109bf0 0x7fb92819ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.858 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.855+0000 7fb927e00640 1 -- 172.21.15.3:0/4037324877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92819f450 con 0x7fb9281044d0 2024-09-19T06:13:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.855+0000 7fb927e00640 1 --2- 172.21.15.3:0/4037324877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9281044d0 0x7fb92819a9a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb91400e9f0 tx=0x7fb91400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.856+0000 7fb925600640 1 -- 172.21.15.3:0/4037324877 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91400cd80 con 0x7fb9281044d0 2024-09-19T06:13:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.856+0000 7fb925600640 1 -- 172.21.15.3:0/4037324877 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb914005500 con 0x7fb9281044d0 2024-09-19T06:13:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.856+0000 7fb925600640 1 -- 172.21.15.3:0/4037324877 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914010690 con 0x7fb9281044d0 2024-09-19T06:13:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.856+0000 7fb92e000640 1 -- 172.21.15.3:0/4037324877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb92819f740 con 0x7fb9281044d0 2024-09-19T06:13:02.859 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.856+0000 7fb92e000640 1 -- 172.21.15.3:0/4037324877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9281a6fd0 con 0x7fb9281044d0 2024-09-19T06:13:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.859+0000 7fb9323e6740 1 Processor -- start 2024-09-19T06:13:02.861 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.859+0000 7fb9323e6740 1 -- start start 2024-09-19T06:13:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.860+0000 7fb9323e6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55895e7c43b0 0x55895e7c4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.860+0000 7fb9323e6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7c4cd0 0x55895e7cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.860+0000 7fb9323e6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55895e7cf570 0x55895e7d1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.860+0000 7fb9323e6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55895e72a100 con 0x55895e7c4cd0 2024-09-19T06:13:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.860+0000 7fb9323e6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55895e6d21b0 con 0x55895e7c43b0 2024-09-19T06:13:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.860+0000 7fb9323e6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55895e7260c0 con 0x55895e7cf570 2024-09-19T06:13:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.860+0000 7fb925600640 1 -- 172.21.15.3:0/4037324877 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 25) ==== 138530+0+0 (secure 0 0 0) 0x7fb9140046c0 con 0x7fb9281044d0 2024-09-19T06:13:02.862 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.860+0000 7fb92cc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7c4cd0 0x55895e7cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.860+0000 7fb92cc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7c4cd0 0x55895e7cf030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36422/0 (socket says 172.21.15.3:36422) 2024-09-19T06:13:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.860+0000 7fb92cc00640 1 -- 172.21.15.3:0/3434510916 learned_addr learned my addr 172.21.15.3:0/3434510916 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.860+0000 7fb92d600640 1 --2- 172.21.15.3:0/3434510916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55895e7c43b0 0x55895e7c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:02.863 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.860+0000 7fb927e00640 1 --2- 172.21.15.3:0/3434510916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55895e7cf570 0x55895e7d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:02.864 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.861+0000 7fb92cc00640 1 -- 172.21.15.3:0/3434510916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55895e7cf570 msgr2=0x55895e7d1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:02.864 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.861+0000 7fb92cc00640 1 --2- 172.21.15.3:0/3434510916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55895e7cf570 0x55895e7d1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.865 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.861+0000 7fb92cc00640 1 -- 172.21.15.3:0/3434510916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55895e7c43b0 msgr2=0x55895e7c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:02.865 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.861+0000 7fb92cc00640 1 --2- 172.21.15.3:0/3434510916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55895e7c43b0 0x55895e7c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.865 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.861+0000 7fb92cc00640 1 -- 172.21.15.3:0/3434510916 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55895e43d210 con 0x55895e7c4cd0 2024-09-19T06:13:02.865 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.861+0000 7fb92d600640 1 --2- 172.21.15.3:0/3434510916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55895e7c43b0 0x55895e7c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:02.865 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.861+0000 7fb92cc00640 1 --2- 172.21.15.3:0/3434510916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7c4cd0 0x55895e7cf030 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb91c02a880 tx=0x7fb91c005b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a256324888a8562a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:02.865 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.861+0000 7fb919c00640 1 -- 172.21.15.3:0/3434510916 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c041020 con 0x55895e7c4cd0 2024-09-19T06:13:02.865 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.861+0000 7fb919c00640 1 -- 172.21.15.3:0/3434510916 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb91c030e80 con 0x55895e7c4cd0 2024-09-19T06:13:02.865 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.861+0000 7fb919c00640 1 -- 172.21.15.3:0/3434510916 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c037040 con 0x55895e7c4cd0 2024-09-19T06:13:02.865 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.862+0000 7fb925600640 1 --2- 172.21.15.3:0/4037324877 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb9100a34b0 0x7fb9100a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:02.865 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.862+0000 7fb925600640 1 -- 172.21.15.3:0/4037324877 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fb9140d02a0 con 0x7fb9281044d0 2024-09-19T06:13:02.865 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.862+0000 7fb92d600640 1 --2- 172.21.15.3:0/4037324877 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb9100a34b0 0x7fb9100a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:02.865 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.862+0000 7fb9323e6740 1 -- 172.21.15.3:0/3434510916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7c4cd0 msgr2=0x55895e7cf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.862+0000 7fb9323e6740 1 --2- 172.21.15.3:0/3434510916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7c4cd0 0x55895e7cf030 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb91c02a880 tx=0x7fb91c005b20 comp rx=0 tx=0).stop 2024-09-19T06:13:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.863+0000 7fb9323e6740 1 -- 172.21.15.3:0/3434510916 shutdown_connections 2024-09-19T06:13:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.863+0000 7fb9323e6740 1 --2- 172.21.15.3:0/3434510916 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55895e7cf570 0x55895e7d1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.863+0000 7fb9323e6740 1 --2- 172.21.15.3:0/3434510916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7c4cd0 0x55895e7cf030 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.863+0000 7fb9323e6740 1 --2- 172.21.15.3:0/3434510916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55895e7c43b0 0x55895e7c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.863+0000 7fb9323e6740 1 -- 172.21.15.3:0/3434510916 >> 172.21.15.3:0/3434510916 conn(0x55895e7c0920 msgr2=0x55895e7c0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.863+0000 7fb92d600640 1 --2- 172.21.15.3:0/4037324877 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb9100a34b0 0x7fb9100a5970 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb920009fd0 tx=0x7fb920010040 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.863+0000 7fb9323e6740 1 -- 172.21.15.3:0/3434510916 shutdown_connections 2024-09-19T06:13:02.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.863+0000 7fb9323e6740 1 -- 172.21.15.3:0/3434510916 wait complete. 2024-09-19T06:13:02.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.863+0000 7fb9323e6740 1 -- start start 2024-09-19T06:13:02.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.863+0000 7fb9323e6740 1 Processor -- start 2024-09-19T06:13:02.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.864+0000 7fb9323e6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7c43b0 0x55895e7cc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:02.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.864+0000 7fb9323e6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55895e7c4cd0 0x55895e7ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:02.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.864+0000 7fb9323e6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55895e7cf570 0x55895e7cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:02.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.864+0000 7fb9323e6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55895e7d1f90 con 0x55895e7c43b0 2024-09-19T06:13:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.864+0000 7fb9323e6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55895e6b3090 con 0x55895e7c4cd0 2024-09-19T06:13:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.864+0000 7fb9323e6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55895e7d2110 con 0x55895e7cf570 2024-09-19T06:13:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.864+0000 7fb9323e6740 10 client.0 _ll_register_callbacks cb 0x55895e707f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.864+0000 7fb92cc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7c43b0 0x55895e7cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.864+0000 7fb927e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55895e7c4cd0 0x55895e7ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.864+0000 7fb92cc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7c43b0 0x55895e7cc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36424/0 (socket says 172.21.15.3:36424) 2024-09-19T06:13:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.864+0000 7fb92cc00640 1 -- 172.21.15.3:0/1284991696 learned_addr learned my addr 172.21.15.3:0/1284991696 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.864+0000 7fb92d600640 1 --2- 172.21.15.3:0/1284991696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55895e7cf570 0x55895e7cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.865+0000 7fb927e00640 1 -- 172.21.15.3:0/1284991696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55895e7cf570 msgr2=0x55895e7cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.865+0000 7fb927e00640 1 --2- 172.21.15.3:0/1284991696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55895e7cf570 0x55895e7cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.865+0000 7fb927e00640 1 -- 172.21.15.3:0/1284991696 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7c43b0 msgr2=0x55895e7cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.865+0000 7fb927e00640 1 --2- 172.21.15.3:0/1284991696 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7c43b0 0x55895e7cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.865+0000 7fb927e00640 1 -- 172.21.15.3:0/1284991696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55895e509620 con 0x55895e7c4cd0 2024-09-19T06:13:02.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.865+0000 7fb92cc00640 1 --2- 172.21.15.3:0/1284991696 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7c43b0 0x55895e7cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:02.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.865+0000 7fb927e00640 1 --2- 172.21.15.3:0/1284991696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55895e7c4cd0 0x55895e7ccb80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb9140cd8d0 tx=0x7fb9140d3c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9cd3c843b4f1e2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:02.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.865+0000 7fb90e000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:13:02.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.865+0000 7fb90e000640 1 -- 172.21.15.3:0/1284991696 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91409bef0 con 0x55895e7c4cd0 2024-09-19T06:13:02.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.865+0000 7fb90e000640 1 -- 172.21.15.3:0/1284991696 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fb9140cdb80 con 0x55895e7c4cd0 2024-09-19T06:13:02.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.865+0000 7fb9323e6740 1 -- 172.21.15.3:0/1284991696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb91c030e80 con 0x55895e7c4cd0 2024-09-19T06:13:02.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.865+0000 7fb90e000640 1 -- 172.21.15.3:0/1284991696 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb91409bd10 con 0x55895e7c4cd0 2024-09-19T06:13:02.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.865+0000 7fb9323e6740 10 client.25373 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:02.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.865+0000 7fb9323e6740 1 -- 172.21.15.3:0/1284991696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55895e7ddd00 con 0x55895e7c4cd0 2024-09-19T06:13:02.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.866+0000 7fb90e000640 1 -- 172.21.15.3:0/1284991696 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb91c030e80 con 0x55895e7c4cd0 2024-09-19T06:13:02.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.866+0000 7fb90e000640 1 -- 172.21.15.3:0/1284991696 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb9140b50f0 con 0x55895e7c4cd0 2024-09-19T06:13:02.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.866+0000 7fb9323e6740 10 client.25373 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.866+0000 7fb9323e6740 10 client.25373 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:13:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.866+0000 7fb9323e6740 20 client.25373 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.866+0000 7fb9323e6740 1 --2- 172.21.15.3:0/1284991696 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55895e7df170 0x55895e7e1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.866+0000 7fb9323e6740 4 client.25373 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:13:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.866+0000 7fb9323e6740 1 -- 172.21.15.3:0/1284991696 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55895e737830 con 0x55895e7df170 2024-09-19T06:13:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.867+0000 7fb92cc00640 1 --2- 172.21.15.3:0/1284991696 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55895e7df170 0x55895e7e1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.867+0000 7fb92cc00640 1 --2- 172.21.15.3:0/1284991696 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55895e7df170 0x55895e7e1560 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6982fd448778f7c6 server_cookie=b145e6fd836b40ce in_seq=0 out_seq=0 2024-09-19T06:13:02.872 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.867+0000 7fb90e000640 10 client.25373 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:02.873 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.868+0000 7fb90e000640 1 -- 172.21.15.3:0/1284991696 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55895e737830 con 0x55895e7df170 2024-09-19T06:13:02.873 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.868+0000 7fb90e000640 10 client.25373 handle_command_reply: tid=0 2024-09-19T06:13:02.873 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.868+0000 7fb9323e6740 1 client.25373 shutdown 2024-09-19T06:13:02.873 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.868+0000 7fb9323e6740 1 -- 172.21.15.3:0/1284991696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55895e7c4cd0 msgr2=0x55895e7ccb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:02.873 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.868+0000 7fb9323e6740 1 --2- 172.21.15.3:0/1284991696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55895e7c4cd0 0x55895e7ccb80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb9140cd8d0 tx=0x7fb9140d3c20 comp rx=0 tx=0).stop 2024-09-19T06:13:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.868+0000 7fb9323e6740 1 -- 172.21.15.3:0/1284991696 shutdown_connections 2024-09-19T06:13:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.868+0000 7fb9323e6740 1 --2- 172.21.15.3:0/1284991696 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55895e7df170 0x55895e7e1560 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.868+0000 7fb9323e6740 1 --2- 172.21.15.3:0/1284991696 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55895e7cf570 0x55895e7cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.868+0000 7fb9323e6740 1 --2- 172.21.15.3:0/1284991696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55895e7c4cd0 0x55895e7ccb80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.868+0000 7fb9323e6740 1 --2- 172.21.15.3:0/1284991696 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7c43b0 0x55895e7cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.868+0000 7fb9323e6740 1 -- 172.21.15.3:0/1284991696 >> 172.21.15.3:0/1284991696 conn(0x55895e7c0920 msgr2=0x55895e7c6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.868+0000 7fb90e000640 0 client.25373 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.869+0000 7fb9323e6740 1 -- 172.21.15.3:0/1284991696 shutdown_connections 2024-09-19T06:13:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.869+0000 7fb9323e6740 1 -- 172.21.15.3:0/1284991696 wait complete. 2024-09-19T06:13:02.874 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.869+0000 7fb9323e6740 20 client.25373 trim_cache size 0 max 16384 2024-09-19T06:13:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.890+0000 7fb9323e6740 1 Processor -- start 2024-09-19T06:13:02.892 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.890+0000 7fb9323e6740 1 -- start start 2024-09-19T06:13:02.893 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.891+0000 7fb9323e6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7c43b0 0x55895e7e6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:02.893 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.891+0000 7fb9323e6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55895e7c4cd0 0x55895e7e73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:02.893 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.891+0000 7fb9323e6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55895e7cf570 0x55895e7c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:02.894 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.891+0000 7fb9323e6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb9281af930 con 0x55895e7c43b0 2024-09-19T06:13:02.894 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.891+0000 7fb9323e6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb9281b1470 con 0x55895e7cf570 2024-09-19T06:13:02.894 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.891+0000 7fb9323e6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb9281b0000 con 0x55895e7c4cd0 2024-09-19T06:13:02.894 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.891+0000 7fb92cc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7c43b0 0x55895e7e6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:02.894 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.891+0000 7fb92cc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7c43b0 0x55895e7e6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36432/0 (socket says 172.21.15.3:36432) 2024-09-19T06:13:02.894 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.891+0000 7fb92cc00640 1 -- 172.21.15.3:0/3593973435 learned_addr learned my addr 172.21.15.3:0/3593973435 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:02.894 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.891+0000 7fb92d600640 1 --2- 172.21.15.3:0/3593973435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55895e7cf570 0x55895e7c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:02.894 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.891+0000 7fb927e00640 1 --2- 172.21.15.3:0/3593973435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55895e7c4cd0 0x55895e7e73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:02.894 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.891+0000 7fb92cc00640 1 -- 172.21.15.3:0/3593973435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55895e7c4cd0 msgr2=0x55895e7e73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:02.894 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.891+0000 7fb92cc00640 1 --2- 172.21.15.3:0/3593973435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55895e7c4cd0 0x55895e7e73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.894 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.891+0000 7fb92cc00640 1 -- 172.21.15.3:0/3593973435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55895e7cf570 msgr2=0x55895e7c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:02.894 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.891+0000 7fb92cc00640 1 --2- 172.21.15.3:0/3593973435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55895e7cf570 0x55895e7c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.895 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.891+0000 7fb92cc00640 1 -- 172.21.15.3:0/3593973435 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55895e7c4b00 con 0x55895e7c43b0 2024-09-19T06:13:02.895 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.892+0000 7fb92cc00640 1 --2- 172.21.15.3:0/3593973435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7c43b0 0x55895e7e6e70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb91c02a880 tx=0x7fb91c0056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d029a3077a92bfe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:02.897 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.892+0000 7fb919200640 1 -- 172.21.15.3:0/3593973435 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c041040 con 0x55895e7c43b0 2024-09-19T06:13:02.897 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.892+0000 7fb919200640 1 -- 172.21.15.3:0/3593973435 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb91c050910 con 0x55895e7c43b0 2024-09-19T06:13:02.897 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.892+0000 7fb919200640 1 -- 172.21.15.3:0/3593973435 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c037040 con 0x55895e7c43b0 2024-09-19T06:13:02.897 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.893+0000 7fb9323e6740 1 -- 172.21.15.3:0/3593973435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7c43b0 msgr2=0x55895e7e6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:02.897 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.893+0000 7fb9323e6740 1 --2- 172.21.15.3:0/3593973435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7c43b0 0x55895e7e6e70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb91c02a880 tx=0x7fb91c0056d0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.897 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.893+0000 7fb9323e6740 1 -- 172.21.15.3:0/3593973435 shutdown_connections 2024-09-19T06:13:02.897 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.893+0000 7fb9323e6740 1 --2- 172.21.15.3:0/3593973435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55895e7cf570 0x55895e7c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.897 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.893+0000 7fb9323e6740 1 --2- 172.21.15.3:0/3593973435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55895e7c4cd0 0x55895e7e73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.897 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.893+0000 7fb9323e6740 1 --2- 172.21.15.3:0/3593973435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7c43b0 0x55895e7e6e70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.897 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.893+0000 7fb9323e6740 1 -- 172.21.15.3:0/3593973435 >> 172.21.15.3:0/3593973435 conn(0x55895e7c0920 msgr2=0x55895e7c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.893+0000 7fb9323e6740 1 -- 172.21.15.3:0/3593973435 shutdown_connections 2024-09-19T06:13:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.893+0000 7fb9323e6740 1 -- 172.21.15.3:0/3593973435 wait complete. 2024-09-19T06:13:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.893+0000 7fb9323e6740 1 -- start start 2024-09-19T06:13:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.894+0000 7fb9323e6740 1 Processor -- start 2024-09-19T06:13:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.894+0000 7fb9323e6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55895e7c43b0 0x55895e7d7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.894+0000 7fb9323e6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55895e7c4cd0 0x55895e7c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.894+0000 7fb9323e6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7cf570 0x55895e7c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.894+0000 7fb9323e6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb9281b0da0 con 0x55895e7cf570 2024-09-19T06:13:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.894+0000 7fb9323e6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb9281b06d0 con 0x55895e7c43b0 2024-09-19T06:13:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.894+0000 7fb9323e6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb9281ad910 con 0x55895e7c4cd0 2024-09-19T06:13:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.894+0000 7fb9323e6740 10 client.0 _ll_register_callbacks cb 0x7fb9140d3a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.894+0000 7fb92d600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7cf570 0x55895e7c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.894+0000 7fb92cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55895e7c43b0 0x55895e7d7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:02.898 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.894+0000 7fb927e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55895e7c4cd0 0x55895e7c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.894+0000 7fb92d600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7cf570 0x55895e7c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36444/0 (socket says 172.21.15.3:36444) 2024-09-19T06:13:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.894+0000 7fb92d600640 1 -- 172.21.15.3:0/480778967 learned_addr learned my addr 172.21.15.3:0/480778967 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.895+0000 7fb92cc00640 1 -- 172.21.15.3:0/480778967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55895e7c4cd0 msgr2=0x55895e7c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.895+0000 7fb92cc00640 1 --2- 172.21.15.3:0/480778967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55895e7c4cd0 0x55895e7c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.895+0000 7fb92cc00640 1 -- 172.21.15.3:0/480778967 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7cf570 msgr2=0x55895e7c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.895+0000 7fb92cc00640 1 --2- 172.21.15.3:0/480778967 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7cf570 0x55895e7c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.895+0000 7fb92cc00640 1 -- 172.21.15.3:0/480778967 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55895e7ca010 con 0x55895e7c43b0 2024-09-19T06:13:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.895+0000 7fb92cc00640 1 --2- 172.21.15.3:0/480778967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55895e7c43b0 0x55895e7d7ab0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009890 tx=0x7fb91c005c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ede9295715913e52 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:02.899 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.895+0000 7fb90e000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:13:02.900 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.895+0000 7fb90e000640 1 -- 172.21.15.3:0/480778967 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c037040 con 0x55895e7c43b0 2024-09-19T06:13:02.901 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.895+0000 7fb9323e6740 1 -- 172.21.15.3:0/480778967 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb91c050910 con 0x55895e7c43b0 2024-09-19T06:13:02.901 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.895+0000 7fb90e000640 1 -- 172.21.15.3:0/480778967 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fb91c050ac0 con 0x55895e7c43b0 2024-09-19T06:13:02.901 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.896+0000 7fb90e000640 1 -- 172.21.15.3:0/480778967 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb91c041040 con 0x55895e7c43b0 2024-09-19T06:13:02.901 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.896+0000 7fb9323e6740 10 client.25379 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:02.901 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.896+0000 7fb9323e6740 1 -- 172.21.15.3:0/480778967 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55895e849dd0 con 0x55895e7c43b0 2024-09-19T06:13:02.901 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.896+0000 7fb90e000640 1 -- 172.21.15.3:0/480778967 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb91c050910 con 0x55895e7c43b0 2024-09-19T06:13:02.901 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.897+0000 7fb90e000640 1 -- 172.21.15.3:0/480778967 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb91c03dc10 con 0x55895e7c43b0 2024-09-19T06:13:02.901 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.897+0000 7fb9323e6740 10 client.25379 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:02.901 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.897+0000 7fb9323e6740 10 client.25379 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:13:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.897+0000 7fb9323e6740 20 client.25379 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.897+0000 7fb9323e6740 1 --2- 172.21.15.3:0/480778967 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55895e84a100 0x55895e84c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.897+0000 7fb9323e6740 4 client.25379 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:13:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.897+0000 7fb9323e6740 1 -- 172.21.15.3:0/480778967 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55895e731b80 con 0x55895e84a100 2024-09-19T06:13:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.897+0000 7fb927e00640 1 --2- 172.21.15.3:0/480778967 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55895e84a100 0x55895e84c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.897+0000 7fb927e00640 1 --2- 172.21.15.3:0/480778967 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55895e84a100 0x55895e84c4f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67d315a20717d992 server_cookie=337b20d8e36741d5 in_seq=0 out_seq=0 2024-09-19T06:13:02.902 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:02.897+0000 7fb90e000640 10 client.25379 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:03.216 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:03.214+0000 7fb925600640 1 -- 172.21.15.3:0/4037324877 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mgrmap(e 26) ==== 138587+0+0 (secure 0 0 0) 0x7fb9140b50f0 con 0x7fb9281044d0 2024-09-19T06:13:04.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:04 smithi059 ceph-mon[35138]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-19T06:13:04.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:04 smithi059 ceph-mon[35138]: mgrmap e26: x(active, since 40s), standbys: y, z 2024-09-19T06:13:04.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:04 smithi003 ceph-mon[30893]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-19T06:13:04.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:04 smithi003 ceph-mon[30893]: mgrmap e26: x(active, since 40s), standbys: y, z 2024-09-19T06:13:04.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:04 smithi071 ceph-mon[35662]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-19T06:13:04.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:04 smithi071 ceph-mon[35662]: mgrmap e26: x(active, since 40s), standbys: y, z 2024-09-19T06:13:04.994 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.992+0000 7fb90e000640 1 -- 172.21.15.3:0/480778967 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55895e731b80 con 0x55895e84a100 2024-09-19T06:13:04.994 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.992+0000 7fb90e000640 10 client.25379 handle_command_reply: tid=0 2024-09-19T06:13:04.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.992+0000 7fb9323e6740 1 client.25379 shutdown 2024-09-19T06:13:04.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.992+0000 7fb9323e6740 1 -- 172.21.15.3:0/480778967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55895e7c43b0 msgr2=0x55895e7d7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:04.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.992+0000 7fb9323e6740 1 --2- 172.21.15.3:0/480778967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55895e7c43b0 0x55895e7d7ab0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009890 tx=0x7fb91c005c90 comp rx=0 tx=0).stop 2024-09-19T06:13:04.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.992+0000 7fb9323e6740 1 -- 172.21.15.3:0/480778967 shutdown_connections 2024-09-19T06:13:04.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.992+0000 7fb9323e6740 1 --2- 172.21.15.3:0/480778967 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55895e84a100 0x55895e84c4f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:04.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.992+0000 7fb9323e6740 1 --2- 172.21.15.3:0/480778967 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55895e7cf570 0x55895e7c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:04.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.992+0000 7fb9323e6740 1 --2- 172.21.15.3:0/480778967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55895e7c4cd0 0x55895e7c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:04.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.992+0000 7fb9323e6740 1 --2- 172.21.15.3:0/480778967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55895e7c43b0 0x55895e7d7ab0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:04.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.992+0000 7fb9323e6740 1 -- 172.21.15.3:0/480778967 >> 172.21.15.3:0/480778967 conn(0x55895e7c0920 msgr2=0x55895e7cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:04.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.992+0000 7fb90e000640 0 client.25379 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:04.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.992+0000 7fb9323e6740 1 -- 172.21.15.3:0/480778967 shutdown_connections 2024-09-19T06:13:04.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.992+0000 7fb9323e6740 1 -- 172.21.15.3:0/480778967 wait complete. 2024-09-19T06:13:04.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.993+0000 7fb9323e6740 20 client.25379 trim_cache size 0 max 16384 2024-09-19T06:13:04.996 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:13:04.996 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:13:04.996 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:13:04.996 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:13:04.997 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.993+0000 7fb92e000640 1 -- 172.21.15.3:0/4037324877 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb9100a34b0 msgr2=0x7fb9100a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:04.997 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.993+0000 7fb92e000640 1 --2- 172.21.15.3:0/4037324877 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb9100a34b0 0x7fb9100a5970 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb920009fd0 tx=0x7fb920010040 comp rx=0 tx=0).stop 2024-09-19T06:13:04.997 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.993+0000 7fb92e000640 1 -- 172.21.15.3:0/4037324877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9281044d0 msgr2=0x7fb92819a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:04.997 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.993+0000 7fb92e000640 1 --2- 172.21.15.3:0/4037324877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9281044d0 0x7fb92819a9a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb91400e9f0 tx=0x7fb91400edf0 comp rx=0 tx=0).stop 2024-09-19T06:13:04.997 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.994+0000 7fb92e000640 1 -- 172.21.15.3:0/4037324877 shutdown_connections 2024-09-19T06:13:04.997 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.994+0000 7fb92e000640 1 --2- 172.21.15.3:0/4037324877 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb9100a34b0 0x7fb9100a5970 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:04.997 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.994+0000 7fb92e000640 1 --2- 172.21.15.3:0/4037324877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb928109bf0 0x7fb92819ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:04.997 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.994+0000 7fb92e000640 1 --2- 172.21.15.3:0/4037324877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9281044d0 0x7fb92819a9a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:04.997 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.994+0000 7fb92e000640 1 --2- 172.21.15.3:0/4037324877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb928103b30 0x7fb92819a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:04.997 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.994+0000 7fb92e000640 1 -- 172.21.15.3:0/4037324877 >> 172.21.15.3:0/4037324877 conn(0x7fb9280ff7b0 msgr2=0x7fb928101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:04.997 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.994+0000 7fb92e000640 1 -- 172.21.15.3:0/4037324877 shutdown_connections 2024-09-19T06:13:04.998 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:04.994+0000 7fb92e000640 1 -- 172.21.15.3:0/4037324877 wait complete. 2024-09-19T06:13:06.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:06 smithi059 ceph-mon[35138]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 32 op/s 2024-09-19T06:13:06.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:06 smithi003 ceph-mon[30893]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 32 op/s 2024-09-19T06:13:06.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:06 smithi071 ceph-mon[35662]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 32 op/s 2024-09-19T06:13:07.584 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:13:08.015 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:08.508 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:08 smithi003 ceph-mon[30893]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-19T06:13:08.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:08 smithi059 ceph-mon[35138]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-19T06:13:08.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:08 smithi071 ceph-mon[35662]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-19T06:13:08.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.828+0000 7f57b5e00640 1 -- 172.21.15.3:0/2062447431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57b0074510 msgr2=0x7f57b00748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:08.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.828+0000 7f57b5e00640 1 --2- 172.21.15.3:0/2062447431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57b0074510 0x7f57b00748f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009ca0 tx=0x7f57a402a940 comp rx=0 tx=0).stop 2024-09-19T06:13:08.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.828+0000 7f57b5e00640 1 -- 172.21.15.3:0/2062447431 shutdown_connections 2024-09-19T06:13:08.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.828+0000 7f57b5e00640 1 --2- 172.21.15.3:0/2062447431 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57b010e280 0x7f57b0110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.828+0000 7f57b5e00640 1 --2- 172.21.15.3:0/2062447431 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57b0074e30 0x7f57b010dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.828+0000 7f57b5e00640 1 --2- 172.21.15.3:0/2062447431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57b0074510 0x7f57b00748f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.828+0000 7f57b5e00640 1 -- 172.21.15.3:0/2062447431 >> 172.21.15.3:0/2062447431 conn(0x7f57b00fd740 msgr2=0x7f57b00ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:08.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.828+0000 7f57b5e00640 1 -- 172.21.15.3:0/2062447431 shutdown_connections 2024-09-19T06:13:08.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.828+0000 7f57b5e00640 1 -- 172.21.15.3:0/2062447431 wait complete. 2024-09-19T06:13:08.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.829+0000 7f57b5e00640 1 Processor -- start 2024-09-19T06:13:08.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.830+0000 7f57b5e00640 1 -- start start 2024-09-19T06:13:08.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.830+0000 7f57b5e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57b0074510 0x7f57b019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:08.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.830+0000 7f57b5e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57b0074e30 0x7f57b019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:08.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.830+0000 7f57b5e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57b010e280 0x7f57b019ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:08.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.830+0000 7f57b5e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f57b0114000 con 0x7f57b0074e30 2024-09-19T06:13:08.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.830+0000 7f57b5e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f57b0113e80 con 0x7f57b0074510 2024-09-19T06:13:08.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.830+0000 7f57b5e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f57b0114180 con 0x7f57b010e280 2024-09-19T06:13:08.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.830+0000 7f57b4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57b0074510 0x7f57b019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:08.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.830+0000 7f57b4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57b0074510 0x7f57b019a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:42844/0 (socket says 172.21.15.3:42844) 2024-09-19T06:13:08.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.830+0000 7f57b4a00640 1 -- 172.21.15.3:0/3571166905 learned_addr learned my addr 172.21.15.3:0/3571166905 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:08.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.830+0000 7f57afe00640 1 --2- 172.21.15.3:0/3571166905 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57b0074e30 0x7f57b019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:08.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.831+0000 7f57b5400640 1 --2- 172.21.15.3:0/3571166905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57b010e280 0x7f57b019ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:08.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.831+0000 7f57afe00640 1 -- 172.21.15.3:0/3571166905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57b010e280 msgr2=0x7f57b019ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:08.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.831+0000 7f57afe00640 1 --2- 172.21.15.3:0/3571166905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57b010e280 0x7f57b019ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.831+0000 7f57afe00640 1 -- 172.21.15.3:0/3571166905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57b0074510 msgr2=0x7f57b019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:08.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.831+0000 7f57afe00640 1 --2- 172.21.15.3:0/3571166905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57b0074510 0x7f57b019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.831+0000 7f57afe00640 1 -- 172.21.15.3:0/3571166905 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b019f530 con 0x7f57b0074e30 2024-09-19T06:13:08.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.831+0000 7f57afe00640 1 --2- 172.21.15.3:0/3571166905 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57b0074e30 0x7f57b019aac0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f579c00e9f0 tx=0x7f579c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:08.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.832+0000 7f57ad600640 1 -- 172.21.15.3:0/3571166905 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c00ccc0 con 0x7f57b0074e30 2024-09-19T06:13:08.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.832+0000 7f57ad600640 1 -- 172.21.15.3:0/3571166905 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f579c005020 con 0x7f57b0074e30 2024-09-19T06:13:08.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.832+0000 7f57b5e00640 1 -- 172.21.15.3:0/3571166905 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b019f820 con 0x7f57b0074e30 2024-09-19T06:13:08.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.832+0000 7f57b5e00640 1 -- 172.21.15.3:0/3571166905 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b01a7100 con 0x7f57b0074e30 2024-09-19T06:13:08.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.832+0000 7f57ad600640 1 -- 172.21.15.3:0/3571166905 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c004b20 con 0x7f57b0074e30 2024-09-19T06:13:08.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.836+0000 7f57ba000740 1 Processor -- start 2024-09-19T06:13:08.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.836+0000 7f57ad600640 1 -- 172.21.15.3:0/3571166905 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 138587+0+0 (secure 0 0 0) 0x7f579c004cc0 con 0x7f57b0074e30 2024-09-19T06:13:08.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.836+0000 7f57ba000740 1 -- start start 2024-09-19T06:13:08.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.836+0000 7f57ba000740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bea819dd50 0x55bea819e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:08.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.836+0000 7f57ba000740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bea819e670 0x55bea81a89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:08.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.836+0000 7f57ba000740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea81a8f30 0x55bea81ab320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:08.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.836+0000 7f57ba000740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bea81043e0 con 0x55bea819dd50 2024-09-19T06:13:08.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.836+0000 7f57ba000740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bea80abd80 con 0x55bea81a8f30 2024-09-19T06:13:08.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.836+0000 7f57ba000740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bea81003a0 con 0x55bea819e670 2024-09-19T06:13:08.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.837+0000 7f57b5400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bea819dd50 0x55bea819e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:08.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.837+0000 7f57afe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea81a8f30 0x55bea81ab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:08.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.837+0000 7f57b5400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bea819dd50 0x55bea819e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45298/0 (socket says 172.21.15.3:45298) 2024-09-19T06:13:08.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.837+0000 7f57afe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea81a8f30 0x55bea81ab320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:42860/0 (socket says 172.21.15.3:42860) 2024-09-19T06:13:08.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.837+0000 7f57b5400640 1 -- 172.21.15.3:0/4161328381 learned_addr learned my addr 172.21.15.3:0/4161328381 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:08.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.837+0000 7f57b4a00640 1 --2- 172.21.15.3:0/4161328381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bea819e670 0x55bea81a89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:08.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.837+0000 7f57b4a00640 1 -- 172.21.15.3:0/4161328381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea81a8f30 msgr2=0x55bea81ab320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:08.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.837+0000 7f57b4a00640 1 --2- 172.21.15.3:0/4161328381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea81a8f30 0x55bea81ab320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.837+0000 7f57b4a00640 1 -- 172.21.15.3:0/4161328381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bea819dd50 msgr2=0x55bea819e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:08.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.838+0000 7f57b4a00640 1 --2- 172.21.15.3:0/4161328381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bea819dd50 0x55bea819e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.838+0000 7f57b4a00640 1 -- 172.21.15.3:0/4161328381 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bea80caae0 con 0x55bea819e670 2024-09-19T06:13:08.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.838+0000 7f57afe00640 1 --2- 172.21.15.3:0/4161328381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea81a8f30 0x55bea81ab320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:13:08.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.838+0000 7f57b5400640 1 --2- 172.21.15.3:0/4161328381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bea819dd50 0x55bea819e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:08.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.838+0000 7f57b4a00640 1 --2- 172.21.15.3:0/4161328381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bea819e670 0x55bea81a89f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f57a4004af0 tx=0x7f57a4005f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46cd87ba23deb8fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:08.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.839+0000 7f57a1c00640 1 -- 172.21.15.3:0/4161328381 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a4034040 con 0x55bea819e670 2024-09-19T06:13:08.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.839+0000 7f57a1c00640 1 -- 172.21.15.3:0/4161328381 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57a4003970 con 0x55bea819e670 2024-09-19T06:13:08.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.839+0000 7f57a1c00640 1 -- 172.21.15.3:0/4161328381 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a4030640 con 0x55bea819e670 2024-09-19T06:13:08.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.839+0000 7f57ad600640 1 --2- 172.21.15.3:0/3571166905 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f57980a34d0 0x7f57980a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:08.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.839+0000 7f57ad600640 1 -- 172.21.15.3:0/3571166905 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f579c0cfde0 con 0x7f57b0074e30 2024-09-19T06:13:08.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.840+0000 7f57ba000740 1 -- 172.21.15.3:0/4161328381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bea819e670 msgr2=0x55bea81a89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:08.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.840+0000 7f57ba000740 1 --2- 172.21.15.3:0/4161328381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bea819e670 0x55bea81a89f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f57a4004af0 tx=0x7f57a4005f80 comp rx=0 tx=0).stop 2024-09-19T06:13:08.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.840+0000 7f57b5400640 1 --2- 172.21.15.3:0/3571166905 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f57980a34d0 0x7f57980a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:08.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.840+0000 7f57ba000740 1 -- 172.21.15.3:0/4161328381 shutdown_connections 2024-09-19T06:13:08.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.840+0000 7f57ba000740 1 --2- 172.21.15.3:0/4161328381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea81a8f30 0x55bea81ab320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.840+0000 7f57ba000740 1 --2- 172.21.15.3:0/4161328381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bea819e670 0x55bea81a89f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.840+0000 7f57ba000740 1 --2- 172.21.15.3:0/4161328381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bea819dd50 0x55bea819e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.840+0000 7f57ba000740 1 -- 172.21.15.3:0/4161328381 >> 172.21.15.3:0/4161328381 conn(0x55bea819a2e0 msgr2=0x55bea819a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:08.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.841+0000 7f57ba000740 1 -- 172.21.15.3:0/4161328381 shutdown_connections 2024-09-19T06:13:08.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.841+0000 7f57ba000740 1 -- 172.21.15.3:0/4161328381 wait complete. 2024-09-19T06:13:08.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.841+0000 7f57b5400640 1 --2- 172.21.15.3:0/3571166905 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f57980a34d0 0x7f57980a5990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009ed0 tx=0x7f57a8005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:08.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.841+0000 7f57ba000740 1 -- start start 2024-09-19T06:13:08.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.842+0000 7f57ba000740 1 Processor -- start 2024-09-19T06:13:08.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.842+0000 7f57ba000740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bea819dd50 0x55bea81a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:08.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.842+0000 7f57ba000740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea819e670 0x55bea81a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.842+0000 7f57ba000740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bea81a8f30 0x55bea81a6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.842+0000 7f57ba000740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bea81abbf0 con 0x55bea81a8f30 2024-09-19T06:13:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.842+0000 7f57ba000740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bea80bf0f0 con 0x55bea819e670 2024-09-19T06:13:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.842+0000 7f57ba000740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bea81abd70 con 0x55bea819dd50 2024-09-19T06:13:08.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.842+0000 7f57ba000740 10 client.0 _ll_register_callbacks cb 0x55bea80b09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.843+0000 7f57afe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea819e670 0x55bea81a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.843+0000 7f57afe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea819e670 0x55bea81a6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:42862/0 (socket says 172.21.15.3:42862) 2024-09-19T06:13:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.843+0000 7f57afe00640 1 -- 172.21.15.3:0/1708546002 learned_addr learned my addr 172.21.15.3:0/1708546002 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.843+0000 7f57b4a00640 1 --2- 172.21.15.3:0/1708546002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bea819dd50 0x55bea81a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.843+0000 7f57afe00640 1 -- 172.21.15.3:0/1708546002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bea819dd50 msgr2=0x55bea81a5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.843+0000 7f57afe00640 1 --2- 172.21.15.3:0/1708546002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bea819dd50 0x55bea81a5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.843+0000 7f57afe00640 1 -- 172.21.15.3:0/1708546002 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bea81a8f30 msgr2=0x55bea81a6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.843+0000 7f57afe00640 1 --2- 172.21.15.3:0/1708546002 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bea81a8f30 0x55bea81a6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.843+0000 7f57afe00640 1 -- 172.21.15.3:0/1708546002 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bea7e753c0 con 0x55bea819e670 2024-09-19T06:13:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.843+0000 7f57afe00640 1 --2- 172.21.15.3:0/1708546002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea819e670 0x55bea81a6200 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f579c00c6a0 tx=0x7f579c09b950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9e5acebc3e38c18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:08.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.843+0000 7f5796000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:13:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.844+0000 7f5796000640 1 -- 172.21.15.3:0/1708546002 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c01c050 con 0x55bea819e670 2024-09-19T06:13:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.844+0000 7f57ba000740 1 -- 172.21.15.3:0/1708546002 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57a4003970 con 0x55bea819e670 2024-09-19T06:13:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.844+0000 7f5796000640 1 -- 172.21.15.3:0/1708546002 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f579c09c280 con 0x55bea819e670 2024-09-19T06:13:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.844+0000 7f5796000640 1 -- 172.21.15.3:0/1708546002 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f579c09be10 con 0x55bea819e670 2024-09-19T06:13:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.844+0000 7f57ba000740 10 client.25391 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.844+0000 7f57ba000740 1 -- 172.21.15.3:0/1708546002 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bea81b77f0 con 0x55bea819e670 2024-09-19T06:13:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.844+0000 7f5796000640 1 -- 172.21.15.3:0/1708546002 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57a4003970 con 0x55bea819e670 2024-09-19T06:13:08.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.845+0000 7f5796000640 1 -- 172.21.15.3:0/1708546002 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f579c0cd630 con 0x55bea819e670 2024-09-19T06:13:08.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.845+0000 7f57ba000740 10 client.25391 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:08.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.845+0000 7f57ba000740 10 client.25391 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:13:08.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.845+0000 7f57ba000740 20 client.25391 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:08.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.845+0000 7f57ba000740 1 --2- 172.21.15.3:0/1708546002 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55bea81b8cc0 0x55bea81bb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:08.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.845+0000 7f57ba000740 4 client.25391 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:13:08.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.845+0000 7f57ba000740 1 -- 172.21.15.3:0/1708546002 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bea8111950 con 0x55bea81b8cc0 2024-09-19T06:13:08.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.846+0000 7f57b4a00640 1 --2- 172.21.15.3:0/1708546002 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55bea81b8cc0 0x55bea81bb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:08.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.846+0000 7f57b4a00640 1 --2- 172.21.15.3:0/1708546002 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55bea81b8cc0 0x55bea81bb140 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f11b01bc83b5bf70 server_cookie=f629ed119c724a32 in_seq=0 out_seq=0 2024-09-19T06:13:08.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.846+0000 7f5796000640 10 client.25391 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:08.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.847+0000 7f5796000640 1 -- 172.21.15.3:0/1708546002 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bea8111950 con 0x55bea81b8cc0 2024-09-19T06:13:08.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.847+0000 7f5796000640 10 client.25391 handle_command_reply: tid=0 2024-09-19T06:13:08.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.847+0000 7f57ba000740 1 client.25391 shutdown 2024-09-19T06:13:08.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.847+0000 7f57ba000740 1 -- 172.21.15.3:0/1708546002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea819e670 msgr2=0x55bea81a6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:08.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.847+0000 7f57ba000740 1 --2- 172.21.15.3:0/1708546002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea819e670 0x55bea81a6200 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f579c00c6a0 tx=0x7f579c09b950 comp rx=0 tx=0).stop 2024-09-19T06:13:08.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.848+0000 7f57ba000740 1 -- 172.21.15.3:0/1708546002 shutdown_connections 2024-09-19T06:13:08.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.848+0000 7f57ba000740 1 --2- 172.21.15.3:0/1708546002 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55bea81b8cc0 0x55bea81bb140 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.848+0000 7f57ba000740 1 --2- 172.21.15.3:0/1708546002 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bea81a8f30 0x55bea81a6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.848+0000 7f57ba000740 1 --2- 172.21.15.3:0/1708546002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea819e670 0x55bea81a6200 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.848+0000 7f57ba000740 1 --2- 172.21.15.3:0/1708546002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bea819dd50 0x55bea81a5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.848+0000 7f57ba000740 1 -- 172.21.15.3:0/1708546002 >> 172.21.15.3:0/1708546002 conn(0x55bea819a2e0 msgr2=0x55bea81a0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:08.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.848+0000 7f5796000640 0 client.25391 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:08.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.848+0000 7f57ba000740 1 -- 172.21.15.3:0/1708546002 shutdown_connections 2024-09-19T06:13:08.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.848+0000 7f57ba000740 1 -- 172.21.15.3:0/1708546002 wait complete. 2024-09-19T06:13:08.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.848+0000 7f57ba000740 20 client.25391 trim_cache size 0 max 16384 2024-09-19T06:13:08.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.881+0000 7f57ba000740 1 Processor -- start 2024-09-19T06:13:08.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.881+0000 7f57ba000740 1 -- start start 2024-09-19T06:13:08.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.882+0000 7f57ba000740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea819dd50 0x55bea81c0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:08.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.882+0000 7f57ba000740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bea819e670 0x55bea81c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:08.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.882+0000 7f57ba000740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bea81a8f30 0x55bea81aa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:08.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.882+0000 7f57ba000740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f579000e730 con 0x55bea81a8f30 2024-09-19T06:13:08.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.882+0000 7f57ba000740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5790010270 con 0x55bea819dd50 2024-09-19T06:13:08.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.882+0000 7f57ba000740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f579000ee00 con 0x55bea819e670 2024-09-19T06:13:08.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.882+0000 7f57b4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea819dd50 0x55bea81c0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:08.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.882+0000 7f57b4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea819dd50 0x55bea81c0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:42868/0 (socket says 172.21.15.3:42868) 2024-09-19T06:13:08.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.882+0000 7f57b4a00640 1 -- 172.21.15.3:0/3897758509 learned_addr learned my addr 172.21.15.3:0/3897758509 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:08.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.882+0000 7f57afe00640 1 --2- 172.21.15.3:0/3897758509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bea819e670 0x55bea81c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:08.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.883+0000 7f57b5400640 1 --2- 172.21.15.3:0/3897758509 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bea81a8f30 0x55bea81aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:08.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.883+0000 7f57b4a00640 1 -- 172.21.15.3:0/3897758509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bea819e670 msgr2=0x55bea81c0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:08.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.883+0000 7f57b4a00640 1 --2- 172.21.15.3:0/3897758509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bea819e670 0x55bea81c0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.883+0000 7f57b4a00640 1 -- 172.21.15.3:0/3897758509 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bea81a8f30 msgr2=0x55bea81aa320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:08.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.883+0000 7f57b4a00640 1 --2- 172.21.15.3:0/3897758509 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bea81a8f30 0x55bea81aa320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.883+0000 7f57b4a00640 1 -- 172.21.15.3:0/3897758509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bea819e4a0 con 0x55bea819dd50 2024-09-19T06:13:08.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.884+0000 7f57b4a00640 1 --2- 172.21.15.3:0/3897758509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea819dd50 0x55bea81c0a10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f57a4004af0 tx=0x7f57a4005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93ef654cc40c128c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:08.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.884+0000 7f57a1200640 1 -- 172.21.15.3:0/3897758509 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a4034040 con 0x55bea819dd50 2024-09-19T06:13:08.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.884+0000 7f57a1200640 1 -- 172.21.15.3:0/3897758509 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57a402fa50 con 0x55bea819dd50 2024-09-19T06:13:08.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.884+0000 7f57a1200640 1 -- 172.21.15.3:0/3897758509 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a4004040 con 0x55bea819dd50 2024-09-19T06:13:08.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.885+0000 7f57ba000740 1 -- 172.21.15.3:0/3897758509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea819dd50 msgr2=0x55bea81c0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:08.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.885+0000 7f57ba000740 1 --2- 172.21.15.3:0/3897758509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea819dd50 0x55bea81c0a10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f57a4004af0 tx=0x7f57a4005bd0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.885+0000 7f57ba000740 1 -- 172.21.15.3:0/3897758509 shutdown_connections 2024-09-19T06:13:08.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.885+0000 7f57ba000740 1 --2- 172.21.15.3:0/3897758509 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bea81a8f30 0x55bea81aa320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.885+0000 7f57ba000740 1 --2- 172.21.15.3:0/3897758509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bea819e670 0x55bea81c0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.885+0000 7f57ba000740 1 --2- 172.21.15.3:0/3897758509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea819dd50 0x55bea81c0a10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.885+0000 7f57ba000740 1 -- 172.21.15.3:0/3897758509 >> 172.21.15.3:0/3897758509 conn(0x55bea819a2e0 msgr2=0x55bea81a7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:08.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.886+0000 7f57ba000740 1 -- 172.21.15.3:0/3897758509 shutdown_connections 2024-09-19T06:13:08.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.886+0000 7f57ba000740 1 -- 172.21.15.3:0/3897758509 wait complete. 2024-09-19T06:13:08.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.886+0000 7f57ba000740 1 -- start start 2024-09-19T06:13:08.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.887+0000 7f57ba000740 1 Processor -- start 2024-09-19T06:13:08.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.887+0000 7f57ba000740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea819dd50 0x55bea81b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:08.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.887+0000 7f57ba000740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bea819e670 0x55bea81b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:08.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.887+0000 7f57ba000740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bea81a8f30 0x55bea81abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:08.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.887+0000 7f57ba000740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f579000fba0 con 0x55bea81a8f30 2024-09-19T06:13:08.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.887+0000 7f57ba000740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f579000f4d0 con 0x55bea819dd50 2024-09-19T06:13:08.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.887+0000 7f57ba000740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f579000c710 con 0x55bea819e670 2024-09-19T06:13:08.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.887+0000 7f57ba000740 10 client.0 _ll_register_callbacks cb 0x7f579c0980b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:08.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.888+0000 7f57b4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea819dd50 0x55bea81b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:08.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.888+0000 7f57afe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bea819e670 0x55bea81b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:08.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.888+0000 7f57afe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bea819e670 0x55bea81b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:51366/0 (socket says 172.21.15.3:51366) 2024-09-19T06:13:08.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.888+0000 7f57afe00640 1 -- 172.21.15.3:0/4217901531 learned_addr learned my addr 172.21.15.3:0/4217901531 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:08.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.889+0000 7f57afe00640 1 -- 172.21.15.3:0/4217901531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea819dd50 msgr2=0x55bea81b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:08.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.889+0000 7f57afe00640 1 --2- 172.21.15.3:0/4217901531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea819dd50 0x55bea81b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.889+0000 7f57afe00640 1 -- 172.21.15.3:0/4217901531 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bea81a8f30 msgr2=0x55bea81abfe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:13:08.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.889+0000 7f57b5400640 1 --2- 172.21.15.3:0/4217901531 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bea81a8f30 0x55bea81abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:08.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.889+0000 7f57afe00640 1 --2- 172.21.15.3:0/4217901531 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bea81a8f30 0x55bea81abfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.889+0000 7f57afe00640 1 -- 172.21.15.3:0/4217901531 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bea81ac5f0 con 0x55bea819e670 2024-09-19T06:13:08.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.890+0000 7f57b4a00640 1 --2- 172.21.15.3:0/4217901531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea819dd50 0x55bea81b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:08.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.890+0000 7f57b5400640 1 --2- 172.21.15.3:0/4217901531 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bea81a8f30 0x55bea81abfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:13:08.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.890+0000 7f57afe00640 1 --2- 172.21.15.3:0/4217901531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bea819e670 0x55bea81b1750 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f579c098270 tx=0x7f579c009f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=484a7f7a84c5d9a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:08.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.890+0000 7f5796000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:13:08.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.891+0000 7f5796000640 1 -- 172.21.15.3:0/4217901531 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c01c040 con 0x55bea819e670 2024-09-19T06:13:08.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.891+0000 7f5796000640 1 -- 172.21.15.3:0/4217901531 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f579c0a47f0 con 0x55bea819e670 2024-09-19T06:13:08.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.891+0000 7f57ba000740 1 -- 172.21.15.3:0/4217901531 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57a402fa50 con 0x55bea819e670 2024-09-19T06:13:08.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.891+0000 7f5796000640 1 -- 172.21.15.3:0/4217901531 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f579c09b770 con 0x55bea819e670 2024-09-19T06:13:08.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.891+0000 7f57ba000740 10 client.25408 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:08.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.891+0000 7f57ba000740 1 -- 172.21.15.3:0/4217901531 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bea82242f0 con 0x55bea819e670 2024-09-19T06:13:08.893 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.892+0000 7f5796000640 1 -- 172.21.15.3:0/4217901531 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57a402fa50 con 0x55bea819e670 2024-09-19T06:13:08.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.892+0000 7f5796000640 1 -- 172.21.15.3:0/4217901531 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f579c0a1350 con 0x55bea819e670 2024-09-19T06:13:08.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.892+0000 7f57ba000740 10 client.25408 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:08.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.892+0000 7f57ba000740 10 client.25408 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:13:08.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.892+0000 7f57ba000740 20 client.25408 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:08.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.892+0000 7f57ba000740 1 --2- 172.21.15.3:0/4217901531 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55bea8224800 0x55bea8226c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:08.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.892+0000 7f57ba000740 4 client.25408 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:13:08.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.892+0000 7f57ba000740 1 -- 172.21.15.3:0/4217901531 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bea810be60 con 0x55bea8224800 2024-09-19T06:13:08.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.893+0000 7f57b4a00640 1 --2- 172.21.15.3:0/4217901531 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55bea8224800 0x55bea8226c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:08.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.893+0000 7f57b4a00640 1 --2- 172.21.15.3:0/4217901531 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55bea8224800 0x55bea8226c20 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d94fe1d8b1c97bc server_cookie=ba52b99430e36ebd in_seq=0 out_seq=0 2024-09-19T06:13:08.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.893+0000 7f5796000640 10 client.25408 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:08.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.893+0000 7f5796000640 1 -- 172.21.15.3:0/4217901531 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55bea810be60 con 0x55bea8224800 2024-09-19T06:13:08.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.893+0000 7f5796000640 10 client.25408 handle_command_reply: tid=0 2024-09-19T06:13:08.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.893+0000 7f57ba000740 1 client.25408 shutdown 2024-09-19T06:13:08.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.894+0000 7f57ba000740 1 -- 172.21.15.3:0/4217901531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bea819e670 msgr2=0x55bea81b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:08.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.894+0000 7f57ba000740 1 --2- 172.21.15.3:0/4217901531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bea819e670 0x55bea81b1750 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f579c098270 tx=0x7f579c009f60 comp rx=0 tx=0).stop 2024-09-19T06:13:08.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.894+0000 7f57ba000740 1 -- 172.21.15.3:0/4217901531 shutdown_connections 2024-09-19T06:13:08.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.894+0000 7f57ba000740 1 --2- 172.21.15.3:0/4217901531 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55bea8224800 0x55bea8226c20 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.894+0000 7f57ba000740 1 --2- 172.21.15.3:0/4217901531 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bea81a8f30 0x55bea81abfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.894+0000 7f57ba000740 1 --2- 172.21.15.3:0/4217901531 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bea819e670 0x55bea81b1750 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f579c098270 tx=0x7f579c009f60 comp rx=0 tx=0).stop 2024-09-19T06:13:08.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.894+0000 7f57ba000740 1 --2- 172.21.15.3:0/4217901531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bea819dd50 0x55bea81b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.894+0000 7f57ba000740 1 -- 172.21.15.3:0/4217901531 >> 172.21.15.3:0/4217901531 conn(0x55bea819a2e0 msgr2=0x55bea81a5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:08.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.894+0000 7f5796000640 0 client.25408 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:08.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.895+0000 7f57ba000740 1 -- 172.21.15.3:0/4217901531 shutdown_connections 2024-09-19T06:13:08.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.895+0000 7f57ba000740 1 -- 172.21.15.3:0/4217901531 wait complete. 2024-09-19T06:13:08.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.895+0000 7f57ba000740 20 client.25408 trim_cache size 0 max 16384 2024-09-19T06:13:08.898 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:13:08.898 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "no active scrubs running", 2024-09-19T06:13:08.898 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": {} 2024-09-19T06:13:08.898 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:13:08.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.896+0000 7f57b5e00640 1 -- 172.21.15.3:0/3571166905 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f57980a34d0 msgr2=0x7f57980a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:08.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.896+0000 7f57b5e00640 1 --2- 172.21.15.3:0/3571166905 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f57980a34d0 0x7f57980a5990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009ed0 tx=0x7f57a8005f90 comp rx=0 tx=0).stop 2024-09-19T06:13:08.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.896+0000 7f57b5e00640 1 -- 172.21.15.3:0/3571166905 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57b0074e30 msgr2=0x7f57b019aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:08.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.896+0000 7f57b5e00640 1 --2- 172.21.15.3:0/3571166905 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57b0074e30 0x7f57b019aac0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f579c00e9f0 tx=0x7f579c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.897+0000 7f57b5e00640 1 -- 172.21.15.3:0/3571166905 shutdown_connections 2024-09-19T06:13:08.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.897+0000 7f57b5e00640 1 --2- 172.21.15.3:0/3571166905 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f57980a34d0 0x7f57980a5990 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.897+0000 7f57b5e00640 1 --2- 172.21.15.3:0/3571166905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f57b010e280 0x7f57b019ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.897+0000 7f57b5e00640 1 --2- 172.21.15.3:0/3571166905 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57b0074e30 0x7f57b019aac0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.897+0000 7f57b5e00640 1 --2- 172.21.15.3:0/3571166905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57b0074510 0x7f57b019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:08.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.897+0000 7f57b5e00640 1 -- 172.21.15.3:0/3571166905 >> 172.21.15.3:0/3571166905 conn(0x7f57b00fd740 msgr2=0x7f57b00fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:08.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.897+0000 7f57b5e00640 1 -- 172.21.15.3:0/3571166905 shutdown_connections 2024-09-19T06:13:08.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:08.897+0000 7f57b5e00640 1 -- 172.21.15.3:0/3571166905 wait complete. 2024-09-19T06:13:10.003 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:13:10.004 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:13:10.481 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:10.517 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:10 smithi003 ceph-mon[30893]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T06:13:10.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:10 smithi059 ceph-mon[35138]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T06:13:10.589 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:10 smithi071 ceph-mon[35662]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T06:13:11.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.127+0000 7fcdfca00640 1 -- 172.21.15.3:0/879697205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdf80745c0 msgr2=0x7fcdf80749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:11.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.127+0000 7fcdfca00640 1 --2- 172.21.15.3:0/879697205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdf80745c0 0x7fcdf80749a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcde8009860 tx=0x7fcde802a3d0 comp rx=0 tx=0).stop 2024-09-19T06:13:11.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.127+0000 7fcdfca00640 1 -- 172.21.15.3:0/879697205 shutdown_connections 2024-09-19T06:13:11.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.127+0000 7fcdfca00640 1 --2- 172.21.15.3:0/879697205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdf810e260 0x7fcdf8110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:11.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.127+0000 7fcdfca00640 1 --2- 172.21.15.3:0/879697205 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdf8074ee0 0x7fcdf810dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:11.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.127+0000 7fcdfca00640 1 --2- 172.21.15.3:0/879697205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdf80745c0 0x7fcdf80749a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:11.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.127+0000 7fcdfca00640 1 -- 172.21.15.3:0/879697205 >> 172.21.15.3:0/879697205 conn(0x7fcdf80fd740 msgr2=0x7fcdf80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:11.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.128+0000 7fcdfca00640 1 -- 172.21.15.3:0/879697205 shutdown_connections 2024-09-19T06:13:11.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.128+0000 7fcdfca00640 1 -- 172.21.15.3:0/879697205 wait complete. 2024-09-19T06:13:11.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.129+0000 7fcdfca00640 1 Processor -- start 2024-09-19T06:13:11.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.129+0000 7fcdfca00640 1 -- start start 2024-09-19T06:13:11.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.130+0000 7fcdfca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdf80745c0 0x7fcdf819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:11.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.130+0000 7fcdfca00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdf8074ee0 0x7fcdf819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:11.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.130+0000 7fcdfca00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdf810e260 0x7fcdf819edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:11.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.130+0000 7fcdfca00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf8114000 con 0x7fcdf8074ee0 2024-09-19T06:13:11.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.130+0000 7fcdfca00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf8113e80 con 0x7fcdf80745c0 2024-09-19T06:13:11.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.130+0000 7fcdfca00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf8114180 con 0x7fcdf810e260 2024-09-19T06:13:11.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.130+0000 7fcdf6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdf80745c0 0x7fcdf819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:11.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.130+0000 7fcdf5e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdf8074ee0 0x7fcdf819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:11.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.130+0000 7fcdf6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdf80745c0 0x7fcdf819a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:42894/0 (socket says 172.21.15.3:42894) 2024-09-19T06:13:11.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.130+0000 7fcdf6800640 1 -- 172.21.15.3:0/1565210512 learned_addr learned my addr 172.21.15.3:0/1565210512 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:11.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.131+0000 7fcdf7200640 1 --2- 172.21.15.3:0/1565210512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdf810e260 0x7fcdf819edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:11.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.131+0000 7fcdf6800640 1 -- 172.21.15.3:0/1565210512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdf810e260 msgr2=0x7fcdf819edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:11.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.131+0000 7fcdf6800640 1 --2- 172.21.15.3:0/1565210512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdf810e260 0x7fcdf819edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:11.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.131+0000 7fcdf6800640 1 -- 172.21.15.3:0/1565210512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdf8074ee0 msgr2=0x7fcdf819aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:11.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.131+0000 7fcdf6800640 1 --2- 172.21.15.3:0/1565210512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdf8074ee0 0x7fcdf819aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:11.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.131+0000 7fcdf6800640 1 -- 172.21.15.3:0/1565210512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf819f4b0 con 0x7fcdf80745c0 2024-09-19T06:13:11.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.131+0000 7fcdf5e00640 1 --2- 172.21.15.3:0/1565210512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdf8074ee0 0x7fcdf819aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:13:11.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.132+0000 7fcdf6800640 1 --2- 172.21.15.3:0/1565210512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdf80745c0 0x7fcdf819a500 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcde8009980 tx=0x7fcde80309a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:11.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.132+0000 7fcdef400640 1 -- 172.21.15.3:0/1565210512 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde8040070 con 0x7fcdf80745c0 2024-09-19T06:13:11.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.132+0000 7fcdfca00640 1 -- 172.21.15.3:0/1565210512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdf819f740 con 0x7fcdf80745c0 2024-09-19T06:13:11.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.132+0000 7fcdef400640 1 -- 172.21.15.3:0/1565210512 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcde8005620 con 0x7fcdf80745c0 2024-09-19T06:13:11.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.132+0000 7fcdef400640 1 -- 172.21.15.3:0/1565210512 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde80049b0 con 0x7fcdf80745c0 2024-09-19T06:13:11.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.132+0000 7fcdfca00640 1 -- 172.21.15.3:0/1565210512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdf81a7080 con 0x7fcdf80745c0 2024-09-19T06:13:11.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.134+0000 7fcdfca00640 1 -- 172.21.15.3:0/1565210512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdf80749a0 con 0x7fcdf80745c0 2024-09-19T06:13:11.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.136+0000 7fcdef400640 1 -- 172.21.15.3:0/1565210512 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 138587+0+0 (secure 0 0 0) 0x7fcde8043070 con 0x7fcdf80745c0 2024-09-19T06:13:11.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.137+0000 7fcdef400640 1 --2- 172.21.15.3:0/1565210512 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcddc0a34d0 0x7fcddc0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:11.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.137+0000 7fcdef400640 1 -- 172.21.15.3:0/1565210512 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fcde80f0d20 con 0x7fcdf80745c0 2024-09-19T06:13:11.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.137+0000 7fcdf5e00640 1 --2- 172.21.15.3:0/1565210512 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcddc0a34d0 0x7fcddc0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:11.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.138+0000 7fcdf5e00640 1 --2- 172.21.15.3:0/1565210512 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcddc0a34d0 0x7fcddc0a5990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8110b20 tx=0x7fcde4009260 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:11.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.141+0000 7fcdef400640 1 -- 172.21.15.3:0/1565210512 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcde80bd580 con 0x7fcdf80745c0 2024-09-19T06:13:11.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.509+0000 7fcdfca00640 1 -- 172.21.15.3:0/1565210512 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcdf81a7250 con 0x7fcdf80745c0 2024-09-19T06:13:11.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.510+0000 7fcdef400640 1 -- 172.21.15.3:0/1565210512 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7fcde80bce80 con 0x7fcdf80745c0 2024-09-19T06:13:11.512 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:13:11.512 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"btime":"2024-09-19T06:12:22:958217+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:12:22.060987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24532,24515,24514,14517]},"id":1}]} 2024-09-19T06:13:11.512 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2024-09-19T06:13:11.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.514+0000 7fcdfca00640 1 -- 172.21.15.3:0/1565210512 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcddc0a34d0 msgr2=0x7fcddc0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:11.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.514+0000 7fcdfca00640 1 --2- 172.21.15.3:0/1565210512 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcddc0a34d0 0x7fcddc0a5990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8110b20 tx=0x7fcde4009260 comp rx=0 tx=0).stop 2024-09-19T06:13:11.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.514+0000 7fcdfca00640 1 -- 172.21.15.3:0/1565210512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdf80745c0 msgr2=0x7fcdf819a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:11.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.514+0000 7fcdfca00640 1 --2- 172.21.15.3:0/1565210512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdf80745c0 0x7fcdf819a500 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcde8009980 tx=0x7fcde80309a0 comp rx=0 tx=0).stop 2024-09-19T06:13:11.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.514+0000 7fcdfca00640 1 -- 172.21.15.3:0/1565210512 shutdown_connections 2024-09-19T06:13:11.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.514+0000 7fcdfca00640 1 --2- 172.21.15.3:0/1565210512 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcddc0a34d0 0x7fcddc0a5990 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:11.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.514+0000 7fcdfca00640 1 --2- 172.21.15.3:0/1565210512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdf810e260 0x7fcdf819edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:11.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.514+0000 7fcdfca00640 1 --2- 172.21.15.3:0/1565210512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdf8074ee0 0x7fcdf819aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:11.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.514+0000 7fcdfca00640 1 --2- 172.21.15.3:0/1565210512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdf80745c0 0x7fcdf819a500 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcde8009980 tx=0x7fcde80309a0 comp rx=0 tx=0).stop 2024-09-19T06:13:11.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.514+0000 7fcdfca00640 1 -- 172.21.15.3:0/1565210512 >> 172.21.15.3:0/1565210512 conn(0x7fcdf80fd740 msgr2=0x7fcdf80fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:11.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.514+0000 7fcdfca00640 1 -- 172.21.15.3:0/1565210512 shutdown_connections 2024-09-19T06:13:11.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:11.515+0000 7fcdfca00640 1 -- 172.21.15.3:0/1565210512 wait complete. 2024-09-19T06:13:12.323 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:13:12.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:12 smithi059 ceph-mon[35138]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 30 op/s 2024-09-19T06:13:12.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:12 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1565210512' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:13:12.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:12 smithi003 ceph-mon[30893]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 30 op/s 2024-09-19T06:13:12.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:12 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1565210512' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:13:12.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:12 smithi071 ceph-mon[35662]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 25 KiB/s wr, 30 op/s 2024-09-19T06:13:12.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:12 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1565210512' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:13:12.775 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:13.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.428+0000 7f8a0b200640 1 -- 172.21.15.3:0/2827403254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a0c1047e0 msgr2=0x7f8a0c108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:13.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.428+0000 7f8a0b200640 1 --2- 172.21.15.3:0/2827403254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a0c1047e0 0x7f8a0c108830 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f89f8009900 tx=0x7f89f802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.428+0000 7f8a0b200640 1 -- 172.21.15.3:0/2827403254 shutdown_connections 2024-09-19T06:13:13.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.428+0000 7f8a0b200640 1 --2- 172.21.15.3:0/2827403254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a0c108f60 0x7f8a0c110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.428+0000 7f8a0b200640 1 --2- 172.21.15.3:0/2827403254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a0c1047e0 0x7f8a0c108830 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.428+0000 7f8a0b200640 1 --2- 172.21.15.3:0/2827403254 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8a0c103e30 0x7f8a0c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.428+0000 7f8a0b200640 1 -- 172.21.15.3:0/2827403254 >> 172.21.15.3:0/2827403254 conn(0x7f8a0c0ff910 msgr2=0x7f8a0c101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:13.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.428+0000 7f8a0b200640 1 -- 172.21.15.3:0/2827403254 shutdown_connections 2024-09-19T06:13:13.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.428+0000 7f8a0b200640 1 -- 172.21.15.3:0/2827403254 wait complete. 2024-09-19T06:13:13.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.429+0000 7f8a0b200640 1 Processor -- start 2024-09-19T06:13:13.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.429+0000 7f8a0b200640 1 -- start start 2024-09-19T06:13:13.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.430+0000 7f8a0b200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8a0c103e30 0x7f8a0c19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:13.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.430+0000 7f8a0b200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a0c1047e0 0x7f8a0c19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:13.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.430+0000 7f8a0b200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a0c108f60 0x7f8a0c19ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:13.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.430+0000 7f8a0b200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c113fd0 con 0x7f8a0c103e30 2024-09-19T06:13:13.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.430+0000 7f8a0b200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c113e50 con 0x7f8a0c108f60 2024-09-19T06:13:13.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.430+0000 7f8a0b200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c114150 con 0x7f8a0c1047e0 2024-09-19T06:13:13.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.430+0000 7f8a09e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8a0c103e30 0x7f8a0c19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:13.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.430+0000 7f8a09e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8a0c103e30 0x7f8a0c19a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45362/0 (socket says 172.21.15.3:45362) 2024-09-19T06:13:13.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.430+0000 7f8a09e00640 1 -- 172.21.15.3:0/3059558866 learned_addr learned my addr 172.21.15.3:0/3059558866 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:13.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.430+0000 7f8a0a800640 1 --2- 172.21.15.3:0/3059558866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a0c108f60 0x7f8a0c19ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:13.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.431+0000 7f8a09400640 1 --2- 172.21.15.3:0/3059558866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a0c1047e0 0x7f8a0c19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:13.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.431+0000 7f8a09e00640 1 -- 172.21.15.3:0/3059558866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a0c1047e0 msgr2=0x7f8a0c19a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:13.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.431+0000 7f8a09e00640 1 --2- 172.21.15.3:0/3059558866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a0c1047e0 0x7f8a0c19a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.431+0000 7f8a09e00640 1 -- 172.21.15.3:0/3059558866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a0c108f60 msgr2=0x7f8a0c19ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:13.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.431+0000 7f8a09e00640 1 --2- 172.21.15.3:0/3059558866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a0c108f60 0x7f8a0c19ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.431+0000 7f8a09e00640 1 -- 172.21.15.3:0/3059558866 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a0c19f440 con 0x7f8a0c103e30 2024-09-19T06:13:13.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.431+0000 7f8a09400640 1 --2- 172.21.15.3:0/3059558866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a0c1047e0 0x7f8a0c19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:13:13.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.431+0000 7f8a09e00640 1 --2- 172.21.15.3:0/3059558866 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8a0c103e30 0x7f8a0c19a490 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00ebc0 tx=0x7f89fc00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:13.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.432+0000 7f8a02a00640 1 -- 172.21.15.3:0/3059558866 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc010630 con 0x7f8a0c103e30 2024-09-19T06:13:13.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.432+0000 7f8a02a00640 1 -- 172.21.15.3:0/3059558866 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89fc010cb0 con 0x7f8a0c103e30 2024-09-19T06:13:13.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.432+0000 7f8a0b200640 1 -- 172.21.15.3:0/3059558866 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a0c19f730 con 0x7f8a0c103e30 2024-09-19T06:13:13.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.432+0000 7f8a02a00640 1 -- 172.21.15.3:0/3059558866 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc018bd0 con 0x7f8a0c103e30 2024-09-19T06:13:13.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.432+0000 7f8a0b200640 1 -- 172.21.15.3:0/3059558866 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a0c1a7010 con 0x7f8a0c103e30 2024-09-19T06:13:13.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.436+0000 7f8a02a00640 1 -- 172.21.15.3:0/3059558866 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 138587+0+0 (secure 0 0 0) 0x7f89fc0107d0 con 0x7f8a0c103e30 2024-09-19T06:13:13.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.436+0000 7f8a13640740 1 Processor -- start 2024-09-19T06:13:13.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.437+0000 7f8a13640740 1 -- start start 2024-09-19T06:13:13.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.437+0000 7f8a13640740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55889d441e40 0x55889d442220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:13.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.437+0000 7f8a13640740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55889d442760 0x55889d44cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:13.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.437+0000 7f8a13640740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55889d44d020 0x55889d44f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:13.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.437+0000 7f8a13640740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55889d3a83e0 con 0x55889d44d020 2024-09-19T06:13:13.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.437+0000 7f8a13640740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55889d34fd80 con 0x55889d442760 2024-09-19T06:13:13.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.437+0000 7f8a13640740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55889d3a43a0 con 0x55889d441e40 2024-09-19T06:13:13.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.438+0000 7f8a0a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55889d441e40 0x55889d442220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:13.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.438+0000 7f8a09e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55889d442760 0x55889d44cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:13.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.438+0000 7f8a0a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55889d441e40 0x55889d442220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:51392/0 (socket says 172.21.15.3:51392) 2024-09-19T06:13:13.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.438+0000 7f8a0a800640 1 -- 172.21.15.3:0/4087850555 learned_addr learned my addr 172.21.15.3:0/4087850555 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:13.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.438+0000 7f8a09400640 1 --2- 172.21.15.3:0/4087850555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55889d44d020 0x55889d44f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:13.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.438+0000 7f8a0a800640 1 -- 172.21.15.3:0/4087850555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55889d442760 msgr2=0x55889d44cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:13.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.438+0000 7f8a0a800640 1 --2- 172.21.15.3:0/4087850555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55889d442760 0x55889d44cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.438+0000 7f8a0a800640 1 -- 172.21.15.3:0/4087850555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55889d44d020 msgr2=0x55889d44f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:13.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.438+0000 7f8a0a800640 1 --2- 172.21.15.3:0/4087850555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55889d44d020 0x55889d44f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.438+0000 7f8a0a800640 1 -- 172.21.15.3:0/4087850555 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55889d36eae0 con 0x55889d441e40 2024-09-19T06:13:13.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.439+0000 7f8a09e00640 1 --2- 172.21.15.3:0/4087850555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55889d442760 0x55889d44cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:13.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.439+0000 7f8a02a00640 1 --2- 172.21.15.3:0/3059558866 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f89f00a34d0 0x7f89f00a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:13.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.439+0000 7f8a0a800640 1 --2- 172.21.15.3:0/4087850555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55889d441e40 0x55889d442220 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009c20 tx=0x7f8a04011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a561b03fcb7027af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:13.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.439+0000 7f8a09e00640 1 --2- 172.21.15.3:0/3059558866 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f89f00a34d0 0x7f89f00a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:13.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.439+0000 7f89f7000640 1 -- 172.21.15.3:0/4087850555 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0401e070 con 0x55889d441e40 2024-09-19T06:13:13.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.440+0000 7f89f7000640 1 -- 172.21.15.3:0/4087850555 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a04019b10 con 0x55889d441e40 2024-09-19T06:13:13.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.440+0000 7f89f7000640 1 -- 172.21.15.3:0/4087850555 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0400e9a0 con 0x55889d441e40 2024-09-19T06:13:13.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.440+0000 7f8a02a00640 1 -- 172.21.15.3:0/3059558866 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f89fc0d0610 con 0x7f8a0c103e30 2024-09-19T06:13:13.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.440+0000 7f8a13640740 1 -- 172.21.15.3:0/4087850555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55889d441e40 msgr2=0x55889d442220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:13.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.440+0000 7f8a09e00640 1 --2- 172.21.15.3:0/3059558866 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f89f00a34d0 0x7f89f00a5990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f89fc0cdbe0 tx=0x7f89fc0d5040 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:13.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.440+0000 7f8a13640740 1 --2- 172.21.15.3:0/4087850555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55889d441e40 0x55889d442220 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009c20 tx=0x7f8a04011810 comp rx=0 tx=0).stop 2024-09-19T06:13:13.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.441+0000 7f8a13640740 1 -- 172.21.15.3:0/4087850555 shutdown_connections 2024-09-19T06:13:13.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.441+0000 7f8a13640740 1 --2- 172.21.15.3:0/4087850555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55889d44d020 0x55889d44f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.441+0000 7f8a13640740 1 --2- 172.21.15.3:0/4087850555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55889d442760 0x55889d44cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.441+0000 7f8a13640740 1 --2- 172.21.15.3:0/4087850555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55889d441e40 0x55889d442220 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.441+0000 7f8a13640740 1 -- 172.21.15.3:0/4087850555 >> 172.21.15.3:0/4087850555 conn(0x55889d43e3d0 msgr2=0x55889d43e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:13.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.441+0000 7f8a13640740 1 -- 172.21.15.3:0/4087850555 shutdown_connections 2024-09-19T06:13:13.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.441+0000 7f8a13640740 1 -- 172.21.15.3:0/4087850555 wait complete. 2024-09-19T06:13:13.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.441+0000 7f8a13640740 1 -- start start 2024-09-19T06:13:13.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.442+0000 7f8a13640740 1 Processor -- start 2024-09-19T06:13:13.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.442+0000 7f8a13640740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55889d441e40 0x55889d449ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:13.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.442+0000 7f8a13640740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55889d442760 0x55889d44a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:13.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.442+0000 7f8a13640740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55889d44d020 0x55889d44a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:13.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.442+0000 7f8a13640740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55889d44fbf0 con 0x55889d441e40 2024-09-19T06:13:13.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.442+0000 7f8a13640740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55889d3630f0 con 0x55889d442760 2024-09-19T06:13:13.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.442+0000 7f8a13640740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55889d44fd70 con 0x55889d44d020 2024-09-19T06:13:13.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.443+0000 7f8a13640740 10 client.0 _ll_register_callbacks cb 0x55889d34abd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:13.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.443+0000 7f8a0a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55889d44d020 0x55889d44a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:13.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.443+0000 7f8a09400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55889d442760 0x55889d44a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:13.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.443+0000 7f8a0a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55889d44d020 0x55889d44a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:51394/0 (socket says 172.21.15.3:51394) 2024-09-19T06:13:13.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.443+0000 7f8a0a800640 1 -- 172.21.15.3:0/1465467306 learned_addr learned my addr 172.21.15.3:0/1465467306 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:13.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.443+0000 7f8a0a800640 1 --2- 172.21.15.3:0/1465467306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55889d441e40 0x55889d449ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:13.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.444+0000 7f8a09400640 1 -- 172.21.15.3:0/1465467306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55889d44d020 msgr2=0x55889d44a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:13.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.444+0000 7f8a09400640 1 --2- 172.21.15.3:0/1465467306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55889d44d020 0x55889d44a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.444+0000 7f8a09400640 1 -- 172.21.15.3:0/1465467306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55889d441e40 msgr2=0x55889d449ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:13.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.444+0000 7f8a09400640 1 --2- 172.21.15.3:0/1465467306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55889d441e40 0x55889d449ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.444+0000 7f8a09400640 1 -- 172.21.15.3:0/1465467306 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55889d1193c0 con 0x55889d442760 2024-09-19T06:13:13.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.444+0000 7f8a09400640 1 --2- 172.21.15.3:0/1465467306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55889d442760 0x55889d44a400 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f89f8006010 tx=0x7f89f8005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acca19c3dd9d7d16 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:13.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.444+0000 7f89eb400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:13:13.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.444+0000 7f89eb400640 1 -- 172.21.15.3:0/1465467306 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f8035030 con 0x55889d442760 2024-09-19T06:13:13.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.444+0000 7f89eb400640 1 -- 172.21.15.3:0/1465467306 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f89f80046c0 con 0x55889d442760 2024-09-19T06:13:13.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.444+0000 7f8a13640740 1 -- 172.21.15.3:0/1465467306 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a04019b10 con 0x55889d442760 2024-09-19T06:13:13.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.445+0000 7f89eb400640 1 -- 172.21.15.3:0/1465467306 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f89f8005d50 con 0x55889d442760 2024-09-19T06:13:13.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.445+0000 7f8a13640740 10 client.25415 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:13.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.445+0000 7f8a13640740 1 -- 172.21.15.3:0/1465467306 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55889d45bc70 con 0x55889d442760 2024-09-19T06:13:13.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.445+0000 7f89eb400640 1 -- 172.21.15.3:0/1465467306 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a04019b10 con 0x55889d442760 2024-09-19T06:13:13.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.446+0000 7f89eb400640 1 -- 172.21.15.3:0/1465467306 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f89f8031a70 con 0x55889d442760 2024-09-19T06:13:13.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.446+0000 7f8a13640740 10 client.25415 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:13.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.446+0000 7f8a13640740 10 client.25415 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:13:13.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.446+0000 7f8a13640740 20 client.25415 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:13.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.446+0000 7f8a13640740 1 --2- 172.21.15.3:0/1465467306 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55889d45d130 0x55889d45f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:13.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.446+0000 7f8a13640740 4 client.25415 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:13:13.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.446+0000 7f8a13640740 1 -- 172.21.15.3:0/1465467306 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55889d3b5950 con 0x55889d45d130 2024-09-19T06:13:13.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.446+0000 7f8a0a800640 1 --2- 172.21.15.3:0/1465467306 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55889d45d130 0x55889d45f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:13.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.447+0000 7f8a0a800640 1 --2- 172.21.15.3:0/1465467306 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55889d45d130 0x55889d45f590 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fc652950b966fe7 server_cookie=e8a4ea3ba38be878 in_seq=0 out_seq=0 2024-09-19T06:13:13.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.447+0000 7f89eb400640 10 client.25415 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:13:13.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.448+0000 7f89eb400640 1 -- 172.21.15.3:0/1465467306 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55889d3b5950 con 0x55889d45d130 2024-09-19T06:13:13.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.448+0000 7f89eb400640 10 client.25415 handle_command_reply: tid=0 2024-09-19T06:13:13.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.448+0000 7f8a13640740 1 client.25415 shutdown 2024-09-19T06:13:13.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.449+0000 7f8a13640740 1 -- 172.21.15.3:0/1465467306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55889d442760 msgr2=0x55889d44a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:13.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.449+0000 7f8a13640740 1 --2- 172.21.15.3:0/1465467306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55889d442760 0x55889d44a400 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f89f8006010 tx=0x7f89f8005270 comp rx=0 tx=0).stop 2024-09-19T06:13:13.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.449+0000 7f8a13640740 1 -- 172.21.15.3:0/1465467306 shutdown_connections 2024-09-19T06:13:13.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.449+0000 7f8a13640740 1 --2- 172.21.15.3:0/1465467306 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55889d45d130 0x55889d45f590 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.449+0000 7f8a13640740 1 --2- 172.21.15.3:0/1465467306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55889d44d020 0x55889d44a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.449+0000 7f8a13640740 1 --2- 172.21.15.3:0/1465467306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55889d442760 0x55889d44a400 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.449+0000 7f8a13640740 1 --2- 172.21.15.3:0/1465467306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55889d441e40 0x55889d449ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.449+0000 7f8a13640740 1 -- 172.21.15.3:0/1465467306 >> 172.21.15.3:0/1465467306 conn(0x55889d43e3d0 msgr2=0x55889d43d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:13.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.449+0000 7f89eb400640 0 client.25415 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:13:13.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.449+0000 7f8a13640740 1 -- 172.21.15.3:0/1465467306 shutdown_connections 2024-09-19T06:13:13.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.450+0000 7f8a13640740 1 -- 172.21.15.3:0/1465467306 wait complete. 2024-09-19T06:13:13.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.450+0000 7f8a13640740 20 client.25415 trim_cache size 0 max 16384 2024-09-19T06:13:13.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.477+0000 7f8a13640740 1 Processor -- start 2024-09-19T06:13:13.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.477+0000 7f8a13640740 1 -- start start 2024-09-19T06:13:13.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.477+0000 7f8a13640740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55889d441e40 0x55889d4448a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:13.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.477+0000 7f8a13640740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55889d442760 0x55889d464ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:13.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.477+0000 7f8a13640740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55889d44d020 0x55889d4653e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:13.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.477+0000 7f8a13640740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f89ec00e7c0 con 0x55889d441e40 2024-09-19T06:13:13.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.477+0000 7f8a13640740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f89ec010300 con 0x55889d44d020 2024-09-19T06:13:13.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.477+0000 7f8a13640740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f89ec00ee90 con 0x55889d442760 2024-09-19T06:13:13.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.477+0000 7f8a0a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55889d441e40 0x55889d4448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:13.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.478+0000 7f8a0a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55889d441e40 0x55889d4448a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45406/0 (socket says 172.21.15.3:45406) 2024-09-19T06:13:13.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.478+0000 7f8a0a800640 1 -- 172.21.15.3:0/2878849803 learned_addr learned my addr 172.21.15.3:0/2878849803 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:13.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.478+0000 7f8a09400640 1 --2- 172.21.15.3:0/2878849803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55889d442760 0x55889d464ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:13.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.478+0000 7f8a0a800640 1 --2- 172.21.15.3:0/2878849803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55889d44d020 0x55889d4653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:13.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.478+0000 7f8a09400640 1 -- 172.21.15.3:0/2878849803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55889d44d020 msgr2=0x55889d4653e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:13.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.478+0000 7f8a09400640 1 --2- 172.21.15.3:0/2878849803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55889d44d020 0x55889d4653e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.478+0000 7f8a09400640 1 -- 172.21.15.3:0/2878849803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55889d441e40 msgr2=0x55889d4448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:13.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.478+0000 7f8a09400640 1 --2- 172.21.15.3:0/2878849803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55889d441e40 0x55889d4448a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.478+0000 7f8a09400640 1 -- 172.21.15.3:0/2878849803 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55889d44c830 con 0x55889d442760 2024-09-19T06:13:13.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.479+0000 7f8a09400640 1 --2- 172.21.15.3:0/2878849803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55889d442760 0x55889d464ea0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f89f8005ab0 tx=0x7f89f8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b85deaadda3faa9a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:13.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.479+0000 7f89f6600640 1 -- 172.21.15.3:0/2878849803 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f8050040 con 0x55889d442760 2024-09-19T06:13:13.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.479+0000 7f89f6600640 1 -- 172.21.15.3:0/2878849803 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89f8003670 con 0x55889d442760 2024-09-19T06:13:13.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.479+0000 7f89f6600640 1 -- 172.21.15.3:0/2878849803 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f8035040 con 0x55889d442760 2024-09-19T06:13:13.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.480+0000 7f8a13640740 1 -- 172.21.15.3:0/2878849803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55889d442760 msgr2=0x55889d464ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:13.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.480+0000 7f8a13640740 1 --2- 172.21.15.3:0/2878849803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55889d442760 0x55889d464ea0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f89f8005ab0 tx=0x7f89f8009780 comp rx=0 tx=0).stop 2024-09-19T06:13:13.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.480+0000 7f8a13640740 1 -- 172.21.15.3:0/2878849803 shutdown_connections 2024-09-19T06:13:13.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.480+0000 7f8a13640740 1 --2- 172.21.15.3:0/2878849803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55889d44d020 0x55889d4653e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.480+0000 7f8a13640740 1 --2- 172.21.15.3:0/2878849803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55889d442760 0x55889d464ea0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.480+0000 7f8a13640740 1 --2- 172.21.15.3:0/2878849803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55889d441e40 0x55889d4448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.480+0000 7f8a13640740 1 -- 172.21.15.3:0/2878849803 >> 172.21.15.3:0/2878849803 conn(0x55889d43e3d0 msgr2=0x55889d43d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:13.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.480+0000 7f8a13640740 1 -- 172.21.15.3:0/2878849803 shutdown_connections 2024-09-19T06:13:13.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.480+0000 7f8a13640740 1 -- 172.21.15.3:0/2878849803 wait complete. 2024-09-19T06:13:13.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.481+0000 7f8a13640740 1 -- start start 2024-09-19T06:13:13.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.481+0000 7f8a13640740 1 Processor -- start 2024-09-19T06:13:13.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.481+0000 7f8a13640740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55889d441e40 0x55889d455020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:13.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.481+0000 7f8a13640740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55889d442760 0x55889d455560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:13.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.481+0000 7f8a13640740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55889d44d020 0x55889d451ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:13.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.482+0000 7f8a13640740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f89ec00fc30 con 0x55889d442760 2024-09-19T06:13:13.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.482+0000 7f8a13640740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f89ec00f560 con 0x55889d44d020 2024-09-19T06:13:13.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.482+0000 7f8a13640740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f89ec00c7a0 con 0x55889d441e40 2024-09-19T06:13:13.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.482+0000 7f8a13640740 10 client.0 _ll_register_callbacks cb 0x7f89fc0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:13.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.482+0000 7f8a09400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55889d442760 0x55889d455560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:13.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.482+0000 7f8a09400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55889d442760 0x55889d455560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45412/0 (socket says 172.21.15.3:45412) 2024-09-19T06:13:13.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.482+0000 7f8a09400640 1 -- 172.21.15.3:0/3559852900 learned_addr learned my addr 172.21.15.3:0/3559852900 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:13.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.482+0000 7f8a09400640 1 -- 172.21.15.3:0/3559852900 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55889d441e40 msgr2=0x55889d455020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:13:13.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.482+0000 7f8a09400640 1 --2- 172.21.15.3:0/3559852900 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55889d441e40 0x55889d455020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.482+0000 7f8a09400640 1 -- 172.21.15.3:0/3559852900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55889d44d020 msgr2=0x55889d451ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:13:13.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.482+0000 7f8a09400640 1 --2- 172.21.15.3:0/3559852900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55889d44d020 0x55889d451ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.482+0000 7f8a09400640 1 -- 172.21.15.3:0/3559852900 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55889d455ca0 con 0x55889d442760 2024-09-19T06:13:13.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.483+0000 7f8a09400640 1 --2- 172.21.15.3:0/3559852900 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55889d442760 0x55889d455560 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f89f802a9b0 tx=0x7f89f8009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c559eb5410ed83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:13.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.483+0000 7f89eb400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:13:13.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.483+0000 7f89eb400640 1 -- 172.21.15.3:0/3559852900 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89f8035040 con 0x55889d442760 2024-09-19T06:13:13.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.483+0000 7f89eb400640 1 -- 172.21.15.3:0/3559852900 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f89f80319c0 con 0x55889d442760 2024-09-19T06:13:13.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.483+0000 7f8a13640740 1 -- 172.21.15.3:0/3559852900 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89f8003670 con 0x55889d442760 2024-09-19T06:13:13.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.484+0000 7f89eb400640 1 -- 172.21.15.3:0/3559852900 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f89f8050040 con 0x55889d442760 2024-09-19T06:13:13.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.484+0000 7f8a13640740 10 client.15387 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:13.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.484+0000 7f8a13640740 1 -- 172.21.15.3:0/3559852900 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55889d4c84c0 con 0x55889d442760 2024-09-19T06:13:13.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.484+0000 7f89eb400640 1 -- 172.21.15.3:0/3559852900 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89f8003670 con 0x55889d442760 2024-09-19T06:13:13.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.484+0000 7f89eb400640 1 -- 172.21.15.3:0/3559852900 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f89f8004980 con 0x55889d442760 2024-09-19T06:13:13.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.484+0000 7f8a13640740 10 client.15387 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:13.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.484+0000 7f8a13640740 10 client.15387 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:13:13.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.484+0000 7f8a13640740 20 client.15387 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:13.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.484+0000 7f8a13640740 1 --2- 172.21.15.3:0/3559852900 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55889d4c8a70 0x55889d4cae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:13.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.484+0000 7f8a13640740 4 client.15387 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:13:13.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.484+0000 7f8a13640740 1 -- 172.21.15.3:0/3559852900 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55889d3afe60 con 0x55889d4c8a70 2024-09-19T06:13:13.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.485+0000 7f8a0a800640 1 --2- 172.21.15.3:0/3559852900 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55889d4c8a70 0x55889d4cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:13.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.486+0000 7f8a0a800640 1 --2- 172.21.15.3:0/3559852900 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55889d4c8a70 0x55889d4cae60 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=42390e1cd6b7f443 server_cookie=856ec2b5bfa97d60 in_seq=0 out_seq=0 2024-09-19T06:13:13.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.486+0000 7f89eb400640 10 client.15387 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:13:13.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.486+0000 7f89eb400640 1 -- 172.21.15.3:0/3559852900 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55889d3afe60 con 0x55889d4c8a70 2024-09-19T06:13:13.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.486+0000 7f89eb400640 10 client.15387 handle_command_reply: tid=0 2024-09-19T06:13:13.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.486+0000 7f8a13640740 1 client.15387 shutdown 2024-09-19T06:13:13.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.486+0000 7f8a13640740 1 -- 172.21.15.3:0/3559852900 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55889d442760 msgr2=0x55889d455560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:13.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.486+0000 7f8a13640740 1 --2- 172.21.15.3:0/3559852900 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55889d442760 0x55889d455560 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f89f802a9b0 tx=0x7f89f8009520 comp rx=0 tx=0).stop 2024-09-19T06:13:13.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.486+0000 7f8a13640740 1 -- 172.21.15.3:0/3559852900 shutdown_connections 2024-09-19T06:13:13.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.486+0000 7f8a13640740 1 --2- 172.21.15.3:0/3559852900 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55889d4c8a70 0x55889d4cae60 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.486+0000 7f8a13640740 1 --2- 172.21.15.3:0/3559852900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55889d44d020 0x55889d451ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.486+0000 7f8a13640740 1 --2- 172.21.15.3:0/3559852900 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55889d442760 0x55889d455560 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.486+0000 7f8a13640740 1 --2- 172.21.15.3:0/3559852900 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55889d441e40 0x55889d455020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.486+0000 7f89eb400640 0 client.15387 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:13:13.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.486+0000 7f8a13640740 1 -- 172.21.15.3:0/3559852900 >> 172.21.15.3:0/3559852900 conn(0x55889d43e3d0 msgr2=0x55889d44b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:13.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.487+0000 7f8a13640740 1 -- 172.21.15.3:0/3559852900 shutdown_connections 2024-09-19T06:13:13.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.487+0000 7f8a13640740 1 -- 172.21.15.3:0/3559852900 wait complete. 2024-09-19T06:13:13.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.487+0000 7f8a13640740 20 client.15387 trim_cache size 0 max 16384 2024-09-19T06:13:13.496 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:13:13.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.488+0000 7f8a0b200640 1 -- 172.21.15.3:0/3059558866 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f89f00a34d0 msgr2=0x7f89f00a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:13.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.488+0000 7f8a0b200640 1 --2- 172.21.15.3:0/3059558866 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f89f00a34d0 0x7f89f00a5990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f89fc0cdbe0 tx=0x7f89fc0d5040 comp rx=0 tx=0).stop 2024-09-19T06:13:13.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.488+0000 7f8a0b200640 1 -- 172.21.15.3:0/3059558866 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8a0c103e30 msgr2=0x7f8a0c19a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:13.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.488+0000 7f8a0b200640 1 --2- 172.21.15.3:0/3059558866 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8a0c103e30 0x7f8a0c19a490 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00ebc0 tx=0x7f89fc00c6a0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.488+0000 7f8a0b200640 1 -- 172.21.15.3:0/3059558866 shutdown_connections 2024-09-19T06:13:13.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.488+0000 7f8a0b200640 1 --2- 172.21.15.3:0/3059558866 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f89f00a34d0 0x7f89f00a5990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.488+0000 7f8a0b200640 1 --2- 172.21.15.3:0/3059558866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a0c108f60 0x7f8a0c19ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.488+0000 7f8a0b200640 1 --2- 172.21.15.3:0/3059558866 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a0c1047e0 0x7f8a0c19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.488+0000 7f8a0b200640 1 --2- 172.21.15.3:0/3059558866 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8a0c103e30 0x7f8a0c19a490 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:13.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.488+0000 7f8a0b200640 1 -- 172.21.15.3:0/3059558866 >> 172.21.15.3:0/3059558866 conn(0x7f8a0c0ff910 msgr2=0x7f8a0c100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:13.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.489+0000 7f8a0b200640 1 -- 172.21.15.3:0/3059558866 shutdown_connections 2024-09-19T06:13:13.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:13.489+0000 7f8a0b200640 1 -- 172.21.15.3:0/3059558866 wait complete. 2024-09-19T06:13:14.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:14 smithi059 ceph-mon[35138]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 26 op/s 2024-09-19T06:13:14.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:14 smithi003 ceph-mon[30893]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 26 op/s 2024-09-19T06:13:14.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:14 smithi071 ceph-mon[35662]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 26 op/s 2024-09-19T06:13:14.643 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:13:15.158 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:15.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.952+0000 7f4f02e00640 1 -- 172.21.15.3:0/2045302805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4efc074e30 msgr2=0x7f4efc10dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:15.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.952+0000 7f4f02e00640 1 --2- 172.21.15.3:0/2045302805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4efc074e30 0x7f4efc10dd40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009860 tx=0x7f4ee802a3d0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.952+0000 7f4f02e00640 1 -- 172.21.15.3:0/2045302805 shutdown_connections 2024-09-19T06:13:15.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.952+0000 7f4f02e00640 1 --2- 172.21.15.3:0/2045302805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4efc10e280 0x7f4efc110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.952+0000 7f4f02e00640 1 --2- 172.21.15.3:0/2045302805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4efc074e30 0x7f4efc10dd40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.952+0000 7f4f02e00640 1 --2- 172.21.15.3:0/2045302805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4efc074510 0x7f4efc0748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.952+0000 7f4f02e00640 1 -- 172.21.15.3:0/2045302805 >> 172.21.15.3:0/2045302805 conn(0x7f4efc0fd740 msgr2=0x7f4efc0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:15.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.952+0000 7f4f02e00640 1 -- 172.21.15.3:0/2045302805 shutdown_connections 2024-09-19T06:13:15.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.952+0000 7f4f02e00640 1 -- 172.21.15.3:0/2045302805 wait complete. 2024-09-19T06:13:15.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.954+0000 7f4f02e00640 1 Processor -- start 2024-09-19T06:13:15.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.954+0000 7f4f02e00640 1 -- start start 2024-09-19T06:13:15.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.954+0000 7f4f02e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4efc074510 0x7f4efc19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:15.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.954+0000 7f4f02e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4efc074e30 0x7f4efc19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:15.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.954+0000 7f4f02e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4efc10e280 0x7f4efc19edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:15.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.954+0000 7f4f02e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4efc114000 con 0x7f4efc074e30 2024-09-19T06:13:15.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.954+0000 7f4f02e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4efc113e80 con 0x7f4efc10e280 2024-09-19T06:13:15.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.954+0000 7f4f02e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4efc114180 con 0x7f4efc074510 2024-09-19T06:13:15.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.955+0000 7f4f01000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4efc074e30 0x7f4efc19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:15.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.955+0000 7f4f01000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4efc074e30 0x7f4efc19aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57602/0 (socket says 172.21.15.3:57602) 2024-09-19T06:13:15.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.955+0000 7f4f01000640 1 -- 172.21.15.3:0/3505701185 learned_addr learned my addr 172.21.15.3:0/3505701185 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:15.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.955+0000 7f4f01a00640 1 --2- 172.21.15.3:0/3505701185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4efc074510 0x7f4efc19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:15.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.955+0000 7f4f02400640 1 --2- 172.21.15.3:0/3505701185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4efc10e280 0x7f4efc19edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:15.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.956+0000 7f4f02400640 1 -- 172.21.15.3:0/3505701185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4efc074510 msgr2=0x7f4efc19a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:15.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.956+0000 7f4f02400640 1 --2- 172.21.15.3:0/3505701185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4efc074510 0x7f4efc19a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.956+0000 7f4f02400640 1 -- 172.21.15.3:0/3505701185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4efc074e30 msgr2=0x7f4efc19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:15.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.956+0000 7f4f02400640 1 --2- 172.21.15.3:0/3505701185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4efc074e30 0x7f4efc19aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.956+0000 7f4f02400640 1 -- 172.21.15.3:0/3505701185 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4efc19f490 con 0x7f4efc10e280 2024-09-19T06:13:15.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.956+0000 7f4f01000640 1 --2- 172.21.15.3:0/3505701185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4efc074e30 0x7f4efc19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:15.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.956+0000 7f4f02400640 1 --2- 172.21.15.3:0/3505701185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4efc10e280 0x7f4efc19edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4005fd0 tx=0x7f4ef400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:15.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.956+0000 7f4efa000640 1 -- 172.21.15.3:0/3505701185 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef400cdf0 con 0x7f4efc10e280 2024-09-19T06:13:15.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.956+0000 7f4efa000640 1 -- 172.21.15.3:0/3505701185 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ef4005020 con 0x7f4efc10e280 2024-09-19T06:13:15.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.956+0000 7f4efa000640 1 -- 172.21.15.3:0/3505701185 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef40106d0 con 0x7f4efc10e280 2024-09-19T06:13:15.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.957+0000 7f4f02e00640 1 -- 172.21.15.3:0/3505701185 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4efc19f780 con 0x7f4efc10e280 2024-09-19T06:13:15.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.957+0000 7f4f02e00640 1 -- 172.21.15.3:0/3505701185 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4efc1a7060 con 0x7f4efc10e280 2024-09-19T06:13:15.961 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.960+0000 7f4efa000640 1 -- 172.21.15.3:0/3505701185 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 138587+0+0 (secure 0 0 0) 0x7f4ef40054d0 con 0x7f4efc10e280 2024-09-19T06:13:15.963 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.962+0000 7f4f06e98740 1 Processor -- start 2024-09-19T06:13:15.963 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.962+0000 7f4f06e98740 1 -- start start 2024-09-19T06:13:15.963 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.962+0000 7f4f06e98740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dd7ed9e40 0x563dd7eda220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:15.964 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.962+0000 7f4f06e98740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7eda760 0x563dd7ee4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:15.964 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.963+0000 7f4efa000640 1 --2- 172.21.15.3:0/3505701185 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f4ee40a3550 0x7f4ee40a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:15.964 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.963+0000 7f4efa000640 1 -- 172.21.15.3:0/3505701185 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f4ef40d0570 con 0x7f4efc10e280 2024-09-19T06:13:15.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.963+0000 7f4f06e98740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563dd7ee5020 0x563dd7ee7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:15.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.963+0000 7f4f06e98740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563dd7e403e0 con 0x563dd7ed9e40 2024-09-19T06:13:15.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.963+0000 7f4f06e98740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563dd7de7d80 con 0x563dd7eda760 2024-09-19T06:13:15.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.963+0000 7f4f06e98740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563dd7e3c3a0 con 0x563dd7ee5020 2024-09-19T06:13:15.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.963+0000 7f4f01000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dd7ed9e40 0x563dd7eda220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:15.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.963+0000 7f4f01a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7eda760 0x563dd7ee4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:15.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.963+0000 7f4f01000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dd7ed9e40 0x563dd7eda220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57612/0 (socket says 172.21.15.3:57612) 2024-09-19T06:13:15.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.963+0000 7f4f01000640 1 -- 172.21.15.3:0/1472850050 learned_addr learned my addr 172.21.15.3:0/1472850050 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:15.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.963+0000 7f4f01a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7eda760 0x563dd7ee4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44318/0 (socket says 172.21.15.3:44318) 2024-09-19T06:13:15.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.963+0000 7f4f01000640 1 --2- 172.21.15.3:0/1472850050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563dd7ee5020 0x563dd7ee7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:15.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.964+0000 7f4f01a00640 1 -- 172.21.15.3:0/1472850050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563dd7ee5020 msgr2=0x563dd7ee7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:15.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.964+0000 7f4f01a00640 1 --2- 172.21.15.3:0/1472850050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563dd7ee5020 0x563dd7ee7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.964+0000 7f4f01a00640 1 -- 172.21.15.3:0/1472850050 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dd7ed9e40 msgr2=0x563dd7eda220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:15.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.964+0000 7f4f01a00640 1 --2- 172.21.15.3:0/1472850050 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dd7ed9e40 0x563dd7eda220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.964+0000 7f4f01a00640 1 -- 172.21.15.3:0/1472850050 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dd7e06ae0 con 0x563dd7eda760 2024-09-19T06:13:15.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.964+0000 7f4f02400640 1 --2- 172.21.15.3:0/3505701185 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f4ee40a3550 0x7f4ee40a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:15.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.964+0000 7f4f01a00640 1 --2- 172.21.15.3:0/1472850050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7eda760 0x563dd7ee4ae0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0005fd0 tx=0x7f4ef0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75c046e96ddfbd06 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:15.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.964+0000 7f4f01000640 1 --2- 172.21.15.3:0/1472850050 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dd7ed9e40 0x563dd7eda220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:13:15.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.965+0000 7f4eeea00640 1 -- 172.21.15.3:0/1472850050 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef002e070 con 0x563dd7eda760 2024-09-19T06:13:15.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.965+0000 7f4eeea00640 1 -- 172.21.15.3:0/1472850050 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ef00035f0 con 0x563dd7eda760 2024-09-19T06:13:15.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.965+0000 7f4eeea00640 1 -- 172.21.15.3:0/1472850050 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef002a680 con 0x563dd7eda760 2024-09-19T06:13:15.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.966+0000 7f4f06e98740 1 -- 172.21.15.3:0/1472850050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7eda760 msgr2=0x563dd7ee4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:15.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.966+0000 7f4f06e98740 1 --2- 172.21.15.3:0/1472850050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7eda760 0x563dd7ee4ae0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0005fd0 tx=0x7f4ef0011810 comp rx=0 tx=0).stop 2024-09-19T06:13:15.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.966+0000 7f4f02400640 1 --2- 172.21.15.3:0/3505701185 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f4ee40a3550 0x7f4ee40a5a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ef40cdb40 tx=0x7f4ef40058d0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:15.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.966+0000 7f4f06e98740 1 -- 172.21.15.3:0/1472850050 shutdown_connections 2024-09-19T06:13:15.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.966+0000 7f4f06e98740 1 --2- 172.21.15.3:0/1472850050 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563dd7ee5020 0x563dd7ee7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.966+0000 7f4f06e98740 1 --2- 172.21.15.3:0/1472850050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7eda760 0x563dd7ee4ae0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.966+0000 7f4f06e98740 1 --2- 172.21.15.3:0/1472850050 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dd7ed9e40 0x563dd7eda220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.966+0000 7f4f06e98740 1 -- 172.21.15.3:0/1472850050 >> 172.21.15.3:0/1472850050 conn(0x563dd7ed63d0 msgr2=0x563dd7ed67b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:15.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.966+0000 7f4f06e98740 1 -- 172.21.15.3:0/1472850050 shutdown_connections 2024-09-19T06:13:15.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.966+0000 7f4f06e98740 1 -- 172.21.15.3:0/1472850050 wait complete. 2024-09-19T06:13:15.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.967+0000 7f4f06e98740 1 -- start start 2024-09-19T06:13:15.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.967+0000 7f4f06e98740 1 Processor -- start 2024-09-19T06:13:15.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.968+0000 7f4f06e98740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7ed9e40 0x563dd7ee1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:15.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.968+0000 7f4f06e98740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563dd7eda760 0x563dd7ee2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:15.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.968+0000 7f4f06e98740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dd7ee5020 0x563dd7ee2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:15.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.968+0000 7f4f06e98740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563dd7ee7bf0 con 0x563dd7ee5020 2024-09-19T06:13:15.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.968+0000 7f4f06e98740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563dd7dfb0f0 con 0x563dd7ed9e40 2024-09-19T06:13:15.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.968+0000 7f4f06e98740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563dd7ee7d70 con 0x563dd7eda760 2024-09-19T06:13:15.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.968+0000 7f4f06e98740 10 client.0 _ll_register_callbacks cb 0x563dd7de2bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:15.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.968+0000 7f4f01000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7ed9e40 0x563dd7ee1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:15.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.968+0000 7f4f01a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563dd7eda760 0x563dd7ee2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:15.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.969+0000 7f4f01a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563dd7eda760 0x563dd7ee2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:60972/0 (socket says 172.21.15.3:60972) 2024-09-19T06:13:15.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.969+0000 7f4f01a00640 1 -- 172.21.15.3:0/3711083823 learned_addr learned my addr 172.21.15.3:0/3711083823 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:15.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.969+0000 7f4f01000640 1 --2- 172.21.15.3:0/3711083823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dd7ee5020 0x563dd7ee2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:15.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.969+0000 7f4f01000640 1 -- 172.21.15.3:0/3711083823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563dd7eda760 msgr2=0x563dd7ee2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:15.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.969+0000 7f4f01000640 1 --2- 172.21.15.3:0/3711083823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563dd7eda760 0x563dd7ee2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.969+0000 7f4f01000640 1 -- 172.21.15.3:0/3711083823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dd7ee5020 msgr2=0x563dd7ee2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:15.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.969+0000 7f4f01000640 1 --2- 172.21.15.3:0/3711083823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dd7ee5020 0x563dd7ee2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.969+0000 7f4f01000640 1 -- 172.21.15.3:0/3711083823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dd7bb13c0 con 0x563dd7ed9e40 2024-09-19T06:13:15.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.970+0000 7f4f01000640 1 --2- 172.21.15.3:0/3711083823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7ed9e40 0x563dd7ee1ec0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8000c00 tx=0x7f4ee8005cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7d11929c255a4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:15.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.970+0000 7f4ee3400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:13:15.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.970+0000 7f4ee3400640 1 -- 172.21.15.3:0/3711083823 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8043070 con 0x563dd7ed9e40 2024-09-19T06:13:15.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.970+0000 7f4ee3400640 1 -- 172.21.15.3:0/3711083823 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f4ee8004260 con 0x563dd7ed9e40 2024-09-19T06:13:15.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.970+0000 7f4f06e98740 1 -- 172.21.15.3:0/3711083823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ef00035f0 con 0x563dd7ed9e40 2024-09-19T06:13:15.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.971+0000 7f4ee3400640 1 -- 172.21.15.3:0/3711083823 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4ee8054050 con 0x563dd7ed9e40 2024-09-19T06:13:15.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.971+0000 7f4f06e98740 10 client.25427 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:15.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.971+0000 7f4f06e98740 1 -- 172.21.15.3:0/3711083823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563dd7efc3f0 con 0x563dd7ed9e40 2024-09-19T06:13:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.971+0000 7f4ee3400640 1 -- 172.21.15.3:0/3711083823 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ef00035f0 con 0x563dd7ed9e40 2024-09-19T06:13:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.972+0000 7f4ee3400640 1 -- 172.21.15.3:0/3711083823 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4ee8003a30 con 0x563dd7ed9e40 2024-09-19T06:13:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.972+0000 7f4f06e98740 10 client.25427 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.972+0000 7f4f06e98740 10 client.25427 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:13:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.972+0000 7f4f06e98740 20 client.25427 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.972+0000 7f4f06e98740 1 --2- 172.21.15.3:0/3711083823 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x563dd7efd8b0 0x563dd7effd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.972+0000 7f4f06e98740 4 client.25427 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:13:15.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.972+0000 7f4f06e98740 1 -- 172.21.15.3:0/3711083823 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563dd7e4d950 con 0x563dd7efd8b0 2024-09-19T06:13:15.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.972+0000 7f4f01a00640 1 --2- 172.21.15.3:0/3711083823 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x563dd7efd8b0 0x563dd7effd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:15.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.973+0000 7f4f01a00640 1 --2- 172.21.15.3:0/3711083823 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x563dd7efd8b0 0x563dd7effd10 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=decbe2a2bbec613 server_cookie=91880aa9aeca3251 in_seq=0 out_seq=0 2024-09-19T06:13:15.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.973+0000 7f4ee3400640 10 client.25427 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:13:15.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.974+0000 7f4ee3400640 1 -- 172.21.15.3:0/3711083823 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563dd7e4d950 con 0x563dd7efd8b0 2024-09-19T06:13:15.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.974+0000 7f4ee3400640 10 client.25427 handle_command_reply: tid=0 2024-09-19T06:13:15.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.974+0000 7f4f06e98740 1 client.25427 shutdown 2024-09-19T06:13:15.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.974+0000 7f4f06e98740 1 -- 172.21.15.3:0/3711083823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7ed9e40 msgr2=0x563dd7ee1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:15.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.974+0000 7f4f06e98740 1 --2- 172.21.15.3:0/3711083823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7ed9e40 0x563dd7ee1ec0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8000c00 tx=0x7f4ee8005cb0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.975+0000 7f4f06e98740 1 -- 172.21.15.3:0/3711083823 shutdown_connections 2024-09-19T06:13:15.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.975+0000 7f4f06e98740 1 --2- 172.21.15.3:0/3711083823 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x563dd7efd8b0 0x563dd7effd10 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.975+0000 7f4f06e98740 1 --2- 172.21.15.3:0/3711083823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dd7ee5020 0x563dd7ee2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.975+0000 7f4f06e98740 1 --2- 172.21.15.3:0/3711083823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563dd7eda760 0x563dd7ee2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.975+0000 7f4f06e98740 1 --2- 172.21.15.3:0/3711083823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7ed9e40 0x563dd7ee1ec0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.975+0000 7f4ee3400640 0 client.25427 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:13:15.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.975+0000 7f4f06e98740 1 -- 172.21.15.3:0/3711083823 >> 172.21.15.3:0/3711083823 conn(0x563dd7ed63d0 msgr2=0x563dd7edc100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:15.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.975+0000 7f4f06e98740 1 -- 172.21.15.3:0/3711083823 shutdown_connections 2024-09-19T06:13:15.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.975+0000 7f4f06e98740 1 -- 172.21.15.3:0/3711083823 wait complete. 2024-09-19T06:13:15.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.975+0000 7f4f06e98740 20 client.25427 trim_cache size 0 max 16384 2024-09-19T06:13:15.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.989+0000 7f4f06e98740 1 Processor -- start 2024-09-19T06:13:15.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.989+0000 7f4f06e98740 1 -- start start 2024-09-19T06:13:15.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.990+0000 7f4f06e98740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563dd7ed9e40 0x563dd7ee27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:15.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.990+0000 7f4f06e98740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dd7eda760 0x563dd7ef8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:15.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.990+0000 7f4f06e98740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7ee5020 0x563dd7ef9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:15.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.990+0000 7f4f06e98740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4efc06fff0 con 0x563dd7eda760 2024-09-19T06:13:15.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.990+0000 7f4f06e98740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4efc071b30 con 0x563dd7ee5020 2024-09-19T06:13:15.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.990+0000 7f4f06e98740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4efc0706c0 con 0x563dd7ed9e40 2024-09-19T06:13:15.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.990+0000 7f4f01000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563dd7ed9e40 0x563dd7ee27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:15.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.990+0000 7f4f01000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563dd7ed9e40 0x563dd7ee27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:60986/0 (socket says 172.21.15.3:60986) 2024-09-19T06:13:15.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.990+0000 7f4f01000640 1 -- 172.21.15.3:0/3229546315 learned_addr learned my addr 172.21.15.3:0/3229546315 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:15.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.991+0000 7f4f01a00640 1 --2- 172.21.15.3:0/3229546315 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dd7eda760 0x563dd7ef8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:15.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.991+0000 7f4f01000640 1 --2- 172.21.15.3:0/3229546315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7ee5020 0x563dd7ef9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:15.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.991+0000 7f4f01000640 1 -- 172.21.15.3:0/3229546315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7ee5020 msgr2=0x563dd7ef9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:15.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.991+0000 7f4f01000640 1 --2- 172.21.15.3:0/3229546315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7ee5020 0x563dd7ef9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.991+0000 7f4f01000640 1 -- 172.21.15.3:0/3229546315 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dd7eda760 msgr2=0x563dd7ef8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:15.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.991+0000 7f4f01000640 1 --2- 172.21.15.3:0/3229546315 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dd7eda760 0x563dd7ef8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.991+0000 7f4f01000640 1 -- 172.21.15.3:0/3229546315 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dd7ed70a0 con 0x563dd7ed9e40 2024-09-19T06:13:15.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.991+0000 7f4f01a00640 1 --2- 172.21.15.3:0/3229546315 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dd7eda760 0x563dd7ef8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:13:15.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.991+0000 7f4f01000640 1 --2- 172.21.15.3:0/3229546315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563dd7ed9e40 0x563dd7ee27d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009830 tx=0x7f4ee8005890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58bcdc34cb4827f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:15.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.992+0000 7f4eee000640 1 -- 172.21.15.3:0/3229546315 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8043040 con 0x563dd7ed9e40 2024-09-19T06:13:15.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.992+0000 7f4eee000640 1 -- 172.21.15.3:0/3229546315 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ee8004320 con 0x563dd7ed9e40 2024-09-19T06:13:15.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.992+0000 7f4eee000640 1 -- 172.21.15.3:0/3229546315 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee80052d0 con 0x563dd7ed9e40 2024-09-19T06:13:15.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.993+0000 7f4f06e98740 1 -- 172.21.15.3:0/3229546315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563dd7ed9e40 msgr2=0x563dd7ee27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:15.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.993+0000 7f4f06e98740 1 --2- 172.21.15.3:0/3229546315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563dd7ed9e40 0x563dd7ee27d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009830 tx=0x7f4ee8005890 comp rx=0 tx=0).stop 2024-09-19T06:13:15.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.993+0000 7f4f06e98740 1 -- 172.21.15.3:0/3229546315 shutdown_connections 2024-09-19T06:13:15.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.993+0000 7f4f06e98740 1 --2- 172.21.15.3:0/3229546315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7ee5020 0x563dd7ef9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.993+0000 7f4f06e98740 1 --2- 172.21.15.3:0/3229546315 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dd7eda760 0x563dd7ef8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.993+0000 7f4f06e98740 1 --2- 172.21.15.3:0/3229546315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563dd7ed9e40 0x563dd7ee27d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:15.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.993+0000 7f4f06e98740 1 -- 172.21.15.3:0/3229546315 >> 172.21.15.3:0/3229546315 conn(0x563dd7ed63d0 msgr2=0x563dd7ef86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:15.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.993+0000 7f4f06e98740 1 -- 172.21.15.3:0/3229546315 shutdown_connections 2024-09-19T06:13:15.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.993+0000 7f4f06e98740 1 -- 172.21.15.3:0/3229546315 wait complete. 2024-09-19T06:13:15.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.994+0000 7f4f06e98740 1 -- start start 2024-09-19T06:13:15.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.994+0000 7f4f06e98740 1 Processor -- start 2024-09-19T06:13:15.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.995+0000 7f4f06e98740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7ed9e40 0x563dd7ef5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:15.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.995+0000 7f4f06e98740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dd7eda760 0x563dd7ef5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:15.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.995+0000 7f4f06e98740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563dd7ee5020 0x563dd7ef2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:15.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.995+0000 7f4f06e98740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4efc071460 con 0x563dd7eda760 2024-09-19T06:13:15.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.995+0000 7f4f06e98740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4efc070d90 con 0x563dd7ed9e40 2024-09-19T06:13:15.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.995+0000 7f4f06e98740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4efc06dff0 con 0x563dd7ee5020 2024-09-19T06:13:15.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.995+0000 7f4f06e98740 10 client.0 _ll_register_callbacks cb 0x7f4ef40093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:15.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.995+0000 7f4f01000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7ed9e40 0x563dd7ef5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:15.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.995+0000 7f4f01000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7ed9e40 0x563dd7ef5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44346/0 (socket says 172.21.15.3:44346) 2024-09-19T06:13:15.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.995+0000 7f4f01000640 1 -- 172.21.15.3:0/3484380930 learned_addr learned my addr 172.21.15.3:0/3484380930 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:16.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.995+0000 7f4f01000640 1 --2- 172.21.15.3:0/3484380930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563dd7ee5020 0x563dd7ef2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:16.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.996+0000 7f4f01a00640 1 --2- 172.21.15.3:0/3484380930 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dd7eda760 0x563dd7ef5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:16.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.996+0000 7f4f01000640 1 -- 172.21.15.3:0/3484380930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563dd7ee5020 msgr2=0x563dd7ef2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:16.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.996+0000 7f4f01000640 1 --2- 172.21.15.3:0/3484380930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563dd7ee5020 0x563dd7ef2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:16.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.996+0000 7f4f01000640 1 -- 172.21.15.3:0/3484380930 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dd7eda760 msgr2=0x563dd7ef5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:16.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.996+0000 7f4f01000640 1 --2- 172.21.15.3:0/3484380930 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dd7eda760 0x563dd7ef5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:16.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.996+0000 7f4f01000640 1 -- 172.21.15.3:0/3484380930 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dd7ef6400 con 0x563dd7ed9e40 2024-09-19T06:13:16.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.996+0000 7f4f01000640 1 --2- 172.21.15.3:0/3484380930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7ed9e40 0x563dd7ef5850 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009980 tx=0x7f4ee8032bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a45836a32577e9e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:16.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.996+0000 7f4ee3400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:13:16.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.997+0000 7f4ee3400640 1 -- 172.21.15.3:0/3484380930 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8043040 con 0x563dd7ed9e40 2024-09-19T06:13:16.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.997+0000 7f4ee3400640 1 -- 172.21.15.3:0/3484380930 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f4ee8032220 con 0x563dd7ed9e40 2024-09-19T06:13:16.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.997+0000 7f4f06e98740 1 -- 172.21.15.3:0/3484380930 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ee8004320 con 0x563dd7ed9e40 2024-09-19T06:13:16.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.997+0000 7f4ee3400640 1 -- 172.21.15.3:0/3484380930 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4ee8030e60 con 0x563dd7ed9e40 2024-09-19T06:13:16.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.997+0000 7f4f06e98740 10 client.25433 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:16.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.997+0000 7f4f06e98740 1 -- 172.21.15.3:0/3484380930 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563dd7f68b30 con 0x563dd7ed9e40 2024-09-19T06:13:16.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.998+0000 7f4ee3400640 1 -- 172.21.15.3:0/3484380930 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ee8004320 con 0x563dd7ed9e40 2024-09-19T06:13:16.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.998+0000 7f4ee3400640 1 -- 172.21.15.3:0/3484380930 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4ee803f810 con 0x563dd7ed9e40 2024-09-19T06:13:16.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.998+0000 7f4f06e98740 10 client.25433 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:16.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.998+0000 7f4f06e98740 10 client.25433 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:13:16.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.999+0000 7f4f06e98740 20 client.25433 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:16.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.999+0000 7f4f06e98740 1 --2- 172.21.15.3:0/3484380930 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x563dd7f69130 0x563dd7f6b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:16.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.999+0000 7f4f06e98740 4 client.25433 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:13:16.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.999+0000 7f4f06e98740 1 -- 172.21.15.3:0/3484380930 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563dd7e47e60 con 0x563dd7f69130 2024-09-19T06:13:16.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:15.999+0000 7f4f01a00640 1 --2- 172.21.15.3:0/3484380930 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x563dd7f69130 0x563dd7f6b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:16.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.000+0000 7f4f01a00640 1 --2- 172.21.15.3:0/3484380930 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x563dd7f69130 0x563dd7f6b520 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8858c9e7d8fe2ad1 server_cookie=b31f25a6b7481c33 in_seq=0 out_seq=0 2024-09-19T06:13:16.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.000+0000 7f4ee3400640 10 client.25433 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:13:16.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.000+0000 7f4ee3400640 1 -- 172.21.15.3:0/3484380930 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563dd7e47e60 con 0x563dd7f69130 2024-09-19T06:13:16.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.000+0000 7f4ee3400640 10 client.25433 handle_command_reply: tid=0 2024-09-19T06:13:16.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.000+0000 7f4f06e98740 1 client.25433 shutdown 2024-09-19T06:13:16.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.000+0000 7f4f06e98740 1 -- 172.21.15.3:0/3484380930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7ed9e40 msgr2=0x563dd7ef5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:16.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.000+0000 7f4f06e98740 1 --2- 172.21.15.3:0/3484380930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7ed9e40 0x563dd7ef5850 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009980 tx=0x7f4ee8032bd0 comp rx=0 tx=0).stop 2024-09-19T06:13:16.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.000+0000 7f4f06e98740 1 -- 172.21.15.3:0/3484380930 shutdown_connections 2024-09-19T06:13:16.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.000+0000 7f4f06e98740 1 --2- 172.21.15.3:0/3484380930 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563dd7ee5020 0x563dd7ef2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:16.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.000+0000 7f4f06e98740 1 --2- 172.21.15.3:0/3484380930 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x563dd7f69130 0x563dd7f6b520 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:16.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.000+0000 7f4f06e98740 1 --2- 172.21.15.3:0/3484380930 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563dd7eda760 0x563dd7ef5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:16.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.000+0000 7f4f06e98740 1 --2- 172.21.15.3:0/3484380930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563dd7ed9e40 0x563dd7ef5850 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:16.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.000+0000 7f4f06e98740 1 -- 172.21.15.3:0/3484380930 >> 172.21.15.3:0/3484380930 conn(0x563dd7ed63d0 msgr2=0x563dd7ed4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:16.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.001+0000 7f4ee3400640 0 client.25433 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:13:16.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.001+0000 7f4f06e98740 1 -- 172.21.15.3:0/3484380930 shutdown_connections 2024-09-19T06:13:16.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.001+0000 7f4f06e98740 1 -- 172.21.15.3:0/3484380930 wait complete. 2024-09-19T06:13:16.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.001+0000 7f4f06e98740 20 client.25433 trim_cache size 0 max 16384 2024-09-19T06:13:16.006 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:13:16.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.002+0000 7f4f02e00640 1 -- 172.21.15.3:0/3505701185 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f4ee40a3550 msgr2=0x7f4ee40a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:16.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.002+0000 7f4f02e00640 1 --2- 172.21.15.3:0/3505701185 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f4ee40a3550 0x7f4ee40a5a10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ef40cdb40 tx=0x7f4ef40058d0 comp rx=0 tx=0).stop 2024-09-19T06:13:16.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.002+0000 7f4f02e00640 1 -- 172.21.15.3:0/3505701185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4efc10e280 msgr2=0x7f4efc19edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:16.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.002+0000 7f4f02e00640 1 --2- 172.21.15.3:0/3505701185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4efc10e280 0x7f4efc19edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4005fd0 tx=0x7f4ef400ef10 comp rx=0 tx=0).stop 2024-09-19T06:13:16.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.002+0000 7f4f02e00640 1 -- 172.21.15.3:0/3505701185 shutdown_connections 2024-09-19T06:13:16.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.003+0000 7f4f02e00640 1 --2- 172.21.15.3:0/3505701185 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f4ee40a3550 0x7f4ee40a5a10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:16.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.003+0000 7f4f02e00640 1 --2- 172.21.15.3:0/3505701185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4efc10e280 0x7f4efc19edb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:16.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.003+0000 7f4f02e00640 1 --2- 172.21.15.3:0/3505701185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4efc074e30 0x7f4efc19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:16.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.003+0000 7f4f02e00640 1 --2- 172.21.15.3:0/3505701185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4efc074510 0x7f4efc19a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:16.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.003+0000 7f4f02e00640 1 -- 172.21.15.3:0/3505701185 >> 172.21.15.3:0/3505701185 conn(0x7f4efc0fd740 msgr2=0x7f4efc0fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:16.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.003+0000 7f4f02e00640 1 -- 172.21.15.3:0/3505701185 shutdown_connections 2024-09-19T06:13:16.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:16.003+0000 7f4f02e00640 1 -- 172.21.15.3:0/3505701185 wait complete. 2024-09-19T06:13:16.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:16 smithi059 ceph-mon[35138]: pgmap v29: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 KiB/s wr, 30 op/s 2024-09-19T06:13:16.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:16 smithi003 ceph-mon[30893]: pgmap v29: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 KiB/s wr, 30 op/s 2024-09-19T06:13:16.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:16 smithi071 ceph-mon[35662]: pgmap v29: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 26 KiB/s wr, 30 op/s 2024-09-19T06:13:16.891 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:13:17.320 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:17.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.974+0000 7fb776000640 1 -- 172.21.15.3:0/1083097441 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7680319b0 con 0x7fb778108f60 2024-09-19T06:13:17.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.975+0000 7fb77d000640 1 -- 172.21.15.3:0/1083097441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb778108f60 msgr2=0x7fb778110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:17.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.975+0000 7fb77d000640 1 --2- 172.21.15.3:0/1083097441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb778108f60 0x7fb778110ae0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb768009900 tx=0x7fb76802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:13:17.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.975+0000 7fb77d000640 1 -- 172.21.15.3:0/1083097441 shutdown_connections 2024-09-19T06:13:17.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.975+0000 7fb77d000640 1 --2- 172.21.15.3:0/1083097441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb778108f60 0x7fb778110ae0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:17.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.975+0000 7fb77d000640 1 --2- 172.21.15.3:0/1083097441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb7781047e0 0x7fb778108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:17.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.975+0000 7fb77d000640 1 --2- 172.21.15.3:0/1083097441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb778103e30 0x7fb778104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:17.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.975+0000 7fb77d000640 1 -- 172.21.15.3:0/1083097441 >> 172.21.15.3:0/1083097441 conn(0x7fb7780ff910 msgr2=0x7fb778101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:17.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.975+0000 7fb77d000640 1 -- 172.21.15.3:0/1083097441 shutdown_connections 2024-09-19T06:13:17.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.975+0000 7fb77d000640 1 -- 172.21.15.3:0/1083097441 wait complete. 2024-09-19T06:13:17.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.977+0000 7fb77d000640 1 Processor -- start 2024-09-19T06:13:17.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.977+0000 7fb77d000640 1 -- start start 2024-09-19T06:13:17.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.977+0000 7fb77d000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb778103e30 0x7fb77819a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:17.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.977+0000 7fb77d000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7781047e0 0x7fb77819a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:17.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.977+0000 7fb77d000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb778108f60 0x7fb77819ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:17.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.977+0000 7fb77d000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb778113fc0 con 0x7fb7781047e0 2024-09-19T06:13:17.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.977+0000 7fb77d000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb778113e40 con 0x7fb778108f60 2024-09-19T06:13:17.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.977+0000 7fb77d000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb778114140 con 0x7fb778103e30 2024-09-19T06:13:17.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.978+0000 7fb777400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb778103e30 0x7fb77819a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:17.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.978+0000 7fb777400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb778103e30 0x7fb77819a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:32774/0 (socket says 172.21.15.3:32774) 2024-09-19T06:13:17.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.978+0000 7fb777400640 1 -- 172.21.15.3:0/2929619426 learned_addr learned my addr 172.21.15.3:0/2929619426 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:17.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.978+0000 7fb776a00640 1 --2- 172.21.15.3:0/2929619426 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7781047e0 0x7fb77819a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:17.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.978+0000 7fb777e00640 1 --2- 172.21.15.3:0/2929619426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb778108f60 0x7fb77819ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:17.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.979+0000 7fb777e00640 1 -- 172.21.15.3:0/2929619426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb778103e30 msgr2=0x7fb77819a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:17.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.979+0000 7fb777e00640 1 --2- 172.21.15.3:0/2929619426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb778103e30 0x7fb77819a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:17.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.979+0000 7fb777e00640 1 -- 172.21.15.3:0/2929619426 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7781047e0 msgr2=0x7fb77819a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:17.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.979+0000 7fb777e00640 1 --2- 172.21.15.3:0/2929619426 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7781047e0 0x7fb77819a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:17.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.979+0000 7fb777e00640 1 -- 172.21.15.3:0/2929619426 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb77819f3d0 con 0x7fb778108f60 2024-09-19T06:13:17.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.979+0000 7fb777400640 1 --2- 172.21.15.3:0/2929619426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb778103e30 0x7fb77819a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:17.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.979+0000 7fb777e00640 1 --2- 172.21.15.3:0/2929619426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb778108f60 0x7fb77819ecf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb768009230 tx=0x7fb768004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:17.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.979+0000 7fb76fe00640 1 -- 172.21.15.3:0/2929619426 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76803f030 con 0x7fb778108f60 2024-09-19T06:13:17.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.980+0000 7fb76fe00640 1 -- 172.21.15.3:0/2929619426 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb768004440 con 0x7fb778108f60 2024-09-19T06:13:17.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.980+0000 7fb76fe00640 1 -- 172.21.15.3:0/2929619426 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb768035070 con 0x7fb778108f60 2024-09-19T06:13:17.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.980+0000 7fb77d000640 1 -- 172.21.15.3:0/2929619426 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb77819f660 con 0x7fb778108f60 2024-09-19T06:13:17.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.980+0000 7fb77d000640 1 -- 172.21.15.3:0/2929619426 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb77819faf0 con 0x7fb778108f60 2024-09-19T06:13:17.986 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.985+0000 7fb78107f740 1 Processor -- start 2024-09-19T06:13:17.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.985+0000 7fb76fe00640 1 -- 172.21.15.3:0/2929619426 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 138587+0+0 (secure 0 0 0) 0x7fb768042030 con 0x7fb778108f60 2024-09-19T06:13:17.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.986+0000 7fb78107f740 1 -- start start 2024-09-19T06:13:17.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.986+0000 7fb78107f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5637c884bd40 0x5637c884c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:17.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.986+0000 7fb78107f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637c884c660 0x5637c885f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:17.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.986+0000 7fb78107f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637c885f830 0x5637c8861c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:17.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.986+0000 7fb78107f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5637c87b23e0 con 0x5637c884bd40 2024-09-19T06:13:17.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.986+0000 7fb78107f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5637c8759d80 con 0x5637c884c660 2024-09-19T06:13:17.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.986+0000 7fb78107f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5637c87ae3a0 con 0x5637c885f830 2024-09-19T06:13:17.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.987+0000 7fb777400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637c884c660 0x5637c885f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:17.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.987+0000 7fb777400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637c884c660 0x5637c885f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44376/0 (socket says 172.21.15.3:44376) 2024-09-19T06:13:17.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.987+0000 7fb777400640 1 -- 172.21.15.3:0/3047800870 learned_addr learned my addr 172.21.15.3:0/3047800870 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:17.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.987+0000 7fb776a00640 1 --2- 172.21.15.3:0/3047800870 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5637c884bd40 0x5637c884c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:17.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.987+0000 7fb776a00640 1 --2- 172.21.15.3:0/3047800870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637c885f830 0x5637c8861c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:17.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.987+0000 7fb777400640 1 -- 172.21.15.3:0/3047800870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637c885f830 msgr2=0x5637c8861c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:17.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.987+0000 7fb777400640 1 --2- 172.21.15.3:0/3047800870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637c885f830 0x5637c8861c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:17.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.987+0000 7fb777400640 1 -- 172.21.15.3:0/3047800870 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5637c884bd40 msgr2=0x5637c884c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:17.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.987+0000 7fb777400640 1 --2- 172.21.15.3:0/3047800870 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5637c884bd40 0x5637c884c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:17.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.987+0000 7fb777400640 1 -- 172.21.15.3:0/3047800870 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637c8778ae0 con 0x5637c884c660 2024-09-19T06:13:17.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.987+0000 7fb776a00640 1 --2- 172.21.15.3:0/3047800870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637c885f830 0x5637c8861c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:13:17.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.988+0000 7fb76fe00640 1 --2- 172.21.15.3:0/2929619426 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb75c0a3550 0x7fb75c0a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:17.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.987+0000 7fb777400640 1 --2- 172.21.15.3:0/3047800870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637c884c660 0x5637c885f2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb770009c30 tx=0x7fb77000eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef95f543fdde798c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:17.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.988+0000 7fb76fe00640 1 -- 172.21.15.3:0/2929619426 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fb7680f0250 con 0x7fb778108f60 2024-09-19T06:13:17.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.988+0000 7fb76cc00640 1 -- 172.21.15.3:0/3047800870 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb770004d20 con 0x5637c884c660 2024-09-19T06:13:17.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.988+0000 7fb776a00640 1 --2- 172.21.15.3:0/2929619426 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb75c0a3550 0x7fb75c0a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:17.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.989+0000 7fb776a00640 1 --2- 172.21.15.3:0/2929619426 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb75c0a3550 0x7fb75c0a5a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x5637c884d8e0 tx=0x7fb76400b5b0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:17.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.990+0000 7fb76cc00640 1 -- 172.21.15.3:0/3047800870 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb770005020 con 0x5637c884c660 2024-09-19T06:13:17.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.990+0000 7fb76cc00640 1 -- 172.21.15.3:0/3047800870 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77001a600 con 0x5637c884c660 2024-09-19T06:13:17.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.990+0000 7fb78107f740 1 -- 172.21.15.3:0/3047800870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637c884c660 msgr2=0x5637c885f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:17.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.990+0000 7fb78107f740 1 --2- 172.21.15.3:0/3047800870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637c884c660 0x5637c885f2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb770009c30 tx=0x7fb77000eda0 comp rx=0 tx=0).stop 2024-09-19T06:13:17.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.991+0000 7fb78107f740 1 -- 172.21.15.3:0/3047800870 shutdown_connections 2024-09-19T06:13:17.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.991+0000 7fb78107f740 1 --2- 172.21.15.3:0/3047800870 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637c885f830 0x5637c8861c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:17.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.991+0000 7fb78107f740 1 --2- 172.21.15.3:0/3047800870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637c884c660 0x5637c885f2f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:17.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.991+0000 7fb78107f740 1 --2- 172.21.15.3:0/3047800870 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5637c884bd40 0x5637c884c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:17.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.991+0000 7fb78107f740 1 -- 172.21.15.3:0/3047800870 >> 172.21.15.3:0/3047800870 conn(0x5637c88483d0 msgr2=0x5637c88487b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:17.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.991+0000 7fb78107f740 1 -- 172.21.15.3:0/3047800870 shutdown_connections 2024-09-19T06:13:17.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.991+0000 7fb78107f740 1 -- 172.21.15.3:0/3047800870 wait complete. 2024-09-19T06:13:17.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.992+0000 7fb78107f740 1 -- start start 2024-09-19T06:13:17.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.992+0000 7fb78107f740 1 Processor -- start 2024-09-19T06:13:17.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.993+0000 7fb78107f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637c884bd40 0x5637c8856dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:17.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.993+0000 7fb78107f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637c884c660 0x5637c8857310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:17.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.993+0000 7fb78107f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5637c885f830 0x5637c885b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:17.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.993+0000 7fb78107f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5637c884ed80 con 0x5637c885f830 2024-09-19T06:13:17.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.993+0000 7fb78107f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5637c876d0f0 con 0x5637c884bd40 2024-09-19T06:13:17.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.993+0000 7fb78107f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5637c884ef00 con 0x5637c884c660 2024-09-19T06:13:18.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.993+0000 7fb78107f740 10 client.0 _ll_register_callbacks cb 0x5637c8754bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:18.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.993+0000 7fb776a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637c884c660 0x5637c8857310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.993+0000 7fb777400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637c884bd40 0x5637c8856dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.993+0000 7fb777400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637c884bd40 0x5637c8856dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44382/0 (socket says 172.21.15.3:44382) 2024-09-19T06:13:18.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.993+0000 7fb776a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637c884c660 0x5637c8857310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:32798/0 (socket says 172.21.15.3:32798) 2024-09-19T06:13:18.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.993+0000 7fb777400640 1 -- 172.21.15.3:0/634342441 learned_addr learned my addr 172.21.15.3:0/634342441 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:18.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.994+0000 7fb777e00640 1 --2- 172.21.15.3:0/634342441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5637c885f830 0x5637c885b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.994+0000 7fb777400640 1 -- 172.21.15.3:0/634342441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637c884c660 msgr2=0x5637c8857310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:18.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.994+0000 7fb777400640 1 --2- 172.21.15.3:0/634342441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637c884c660 0x5637c8857310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.994+0000 7fb777400640 1 -- 172.21.15.3:0/634342441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5637c885f830 msgr2=0x5637c885b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:18.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.994+0000 7fb777400640 1 --2- 172.21.15.3:0/634342441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5637c885f830 0x5637c885b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.994+0000 7fb777400640 1 -- 172.21.15.3:0/634342441 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637c85233c0 con 0x5637c884bd40 2024-09-19T06:13:18.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.994+0000 7fb777e00640 1 --2- 172.21.15.3:0/634342441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5637c885f830 0x5637c885b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:13:18.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.995+0000 7fb777400640 1 --2- 172.21.15.3:0/634342441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637c884bd40 0x5637c8856dd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb770011810 tx=0x7fb7700051d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e36da9acdb9e90b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:18.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.995+0000 7fb761600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:13:18.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.995+0000 7fb761600640 1 -- 172.21.15.3:0/634342441 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb770020040 con 0x5637c884bd40 2024-09-19T06:13:18.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.995+0000 7fb761600640 1 -- 172.21.15.3:0/634342441 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fb770005540 con 0x5637c884bd40 2024-09-19T06:13:18.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.995+0000 7fb78107f740 1 -- 172.21.15.3:0/634342441 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb770005020 con 0x5637c884bd40 2024-09-19T06:13:18.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.995+0000 7fb761600640 1 -- 172.21.15.3:0/634342441 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb770004a40 con 0x5637c884bd40 2024-09-19T06:13:18.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.996+0000 7fb78107f740 10 client.25445 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:18.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.996+0000 7fb78107f740 1 -- 172.21.15.3:0/634342441 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5637c8865cf0 con 0x5637c884bd40 2024-09-19T06:13:18.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.996+0000 7fb761600640 1 -- 172.21.15.3:0/634342441 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb770005020 con 0x5637c884bd40 2024-09-19T06:13:18.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.996+0000 7fb761600640 1 -- 172.21.15.3:0/634342441 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb770023030 con 0x5637c884bd40 2024-09-19T06:13:18.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.996+0000 7fb78107f740 10 client.25445 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:18.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.996+0000 7fb78107f740 10 client.25445 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:13:18.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.996+0000 7fb78107f740 20 client.25445 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:18.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.996+0000 7fb78107f740 1 --2- 172.21.15.3:0/634342441 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5637c8867150 0x5637c8869540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.997+0000 7fb78107f740 4 client.25445 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:13:18.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.997+0000 7fb78107f740 1 -- 172.21.15.3:0/634342441 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637c87bf950 con 0x5637c8867150 2024-09-19T06:13:18.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.997+0000 7fb776a00640 1 --2- 172.21.15.3:0/634342441 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5637c8867150 0x5637c8869540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.998+0000 7fb761600640 10 client.25445 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:13:18.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.998+0000 7fb776a00640 1 --2- 172.21.15.3:0/634342441 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5637c8867150 0x5637c8869540 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=245fe16c141215d4 server_cookie=5b911fdbbb422e1e in_seq=0 out_seq=0 2024-09-19T06:13:18.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.999+0000 7fb761600640 1 -- 172.21.15.3:0/634342441 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5637c87bf950 con 0x5637c8867150 2024-09-19T06:13:18.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.999+0000 7fb761600640 10 client.25445 handle_command_reply: tid=0 2024-09-19T06:13:18.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:17.999+0000 7fb78107f740 1 client.25445 shutdown 2024-09-19T06:13:18.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.000+0000 7fb78107f740 1 -- 172.21.15.3:0/634342441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637c884bd40 msgr2=0x5637c8856dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:18.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.000+0000 7fb78107f740 1 --2- 172.21.15.3:0/634342441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637c884bd40 0x5637c8856dd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb770011810 tx=0x7fb7700051d0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.000+0000 7fb78107f740 1 -- 172.21.15.3:0/634342441 shutdown_connections 2024-09-19T06:13:18.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.000+0000 7fb78107f740 1 --2- 172.21.15.3:0/634342441 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5637c8867150 0x5637c8869540 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.000+0000 7fb78107f740 1 --2- 172.21.15.3:0/634342441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5637c885f830 0x5637c885b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.000+0000 7fb78107f740 1 --2- 172.21.15.3:0/634342441 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637c884c660 0x5637c8857310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.000+0000 7fb78107f740 1 --2- 172.21.15.3:0/634342441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637c884bd40 0x5637c8856dd0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.000+0000 7fb78107f740 1 -- 172.21.15.3:0/634342441 >> 172.21.15.3:0/634342441 conn(0x5637c88483d0 msgr2=0x5637c884e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:18.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.000+0000 7fb761600640 0 client.25445 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:13:18.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.000+0000 7fb78107f740 1 -- 172.21.15.3:0/634342441 shutdown_connections 2024-09-19T06:13:18.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.001+0000 7fb78107f740 1 -- 172.21.15.3:0/634342441 wait complete. 2024-09-19T06:13:18.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.001+0000 7fb78107f740 20 client.25445 trim_cache size 0 max 16384 2024-09-19T06:13:18.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.028+0000 7fb78107f740 1 Processor -- start 2024-09-19T06:13:18.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.028+0000 7fb78107f740 1 -- start start 2024-09-19T06:13:18.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.029+0000 7fb78107f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637c884c660 0x5637c885b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.029+0000 7fb78107f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637c885f830 0x5637c8855bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.029+0000 7fb78107f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5637c885ef90 0x5637c886ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.029+0000 7fb78107f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb7781ab610 con 0x5637c885ef90 2024-09-19T06:13:18.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.029+0000 7fb78107f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb7781ad150 con 0x5637c885f830 2024-09-19T06:13:18.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.029+0000 7fb78107f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb7781abce0 con 0x5637c884c660 2024-09-19T06:13:18.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.029+0000 7fb777400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637c884c660 0x5637c885b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.029+0000 7fb776a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637c885f830 0x5637c8855bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.029+0000 7fb777400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637c884c660 0x5637c885b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:32810/0 (socket says 172.21.15.3:32810) 2024-09-19T06:13:18.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.029+0000 7fb777400640 1 -- 172.21.15.3:0/4204205261 learned_addr learned my addr 172.21.15.3:0/4204205261 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:18.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.030+0000 7fb777400640 1 -- 172.21.15.3:0/4204205261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637c885f830 msgr2=0x5637c8855bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:18.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.030+0000 7fb777400640 1 --2- 172.21.15.3:0/4204205261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637c885f830 0x5637c8855bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.030+0000 7fb777400640 1 -- 172.21.15.3:0/4204205261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5637c885ef90 msgr2=0x5637c886ec60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:13:18.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.030+0000 7fb777e00640 1 --2- 172.21.15.3:0/4204205261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5637c885ef90 0x5637c886ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.030+0000 7fb777400640 1 --2- 172.21.15.3:0/4204205261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5637c885ef90 0x5637c886ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.031+0000 7fb777400640 1 -- 172.21.15.3:0/4204205261 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637c8848200 con 0x5637c884c660 2024-09-19T06:13:18.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.031+0000 7fb777e00640 1 --2- 172.21.15.3:0/4204205261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5637c885ef90 0x5637c886ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:13:18.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.031+0000 7fb777400640 1 --2- 172.21.15.3:0/4204205261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637c884c660 0x5637c885b470 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb770024040 tx=0x7fb770009c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b482dd20a4fe533e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:18.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.032+0000 7fb763e00640 1 -- 172.21.15.3:0/4204205261 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb770005880 con 0x5637c884c660 2024-09-19T06:13:18.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.032+0000 7fb763e00640 1 -- 172.21.15.3:0/4204205261 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb77002b070 con 0x5637c884c660 2024-09-19T06:13:18.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.032+0000 7fb763e00640 1 -- 172.21.15.3:0/4204205261 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb770003bd0 con 0x5637c884c660 2024-09-19T06:13:18.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.033+0000 7fb78107f740 1 -- 172.21.15.3:0/4204205261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637c884c660 msgr2=0x5637c885b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:18.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.033+0000 7fb78107f740 1 --2- 172.21.15.3:0/4204205261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637c884c660 0x5637c885b470 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb770024040 tx=0x7fb770009c80 comp rx=0 tx=0).stop 2024-09-19T06:13:18.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.033+0000 7fb78107f740 1 -- 172.21.15.3:0/4204205261 shutdown_connections 2024-09-19T06:13:18.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.033+0000 7fb78107f740 1 --2- 172.21.15.3:0/4204205261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5637c885ef90 0x5637c886ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.033+0000 7fb78107f740 1 --2- 172.21.15.3:0/4204205261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637c885f830 0x5637c8855bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.033+0000 7fb78107f740 1 --2- 172.21.15.3:0/4204205261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637c884c660 0x5637c885b470 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.033+0000 7fb78107f740 1 -- 172.21.15.3:0/4204205261 >> 172.21.15.3:0/4204205261 conn(0x5637c88483d0 msgr2=0x5637c88554c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:18.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.034+0000 7fb78107f740 1 -- 172.21.15.3:0/4204205261 shutdown_connections 2024-09-19T06:13:18.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.034+0000 7fb78107f740 1 -- 172.21.15.3:0/4204205261 wait complete. 2024-09-19T06:13:18.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.034+0000 7fb78107f740 1 -- start start 2024-09-19T06:13:18.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.035+0000 7fb78107f740 1 Processor -- start 2024-09-19T06:13:18.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.035+0000 7fb78107f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5637c884c660 0x5637c887b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.035+0000 7fb78107f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637c885ef90 0x5637c8876340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.035+0000 7fb78107f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637c885f830 0x5637c8876880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.035+0000 7fb78107f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb7781aca80 con 0x5637c884c660 2024-09-19T06:13:18.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.035+0000 7fb78107f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb7781ac3b0 con 0x5637c885f830 2024-09-19T06:13:18.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.035+0000 7fb78107f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb7781a95f0 con 0x5637c885ef90 2024-09-19T06:13:18.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.035+0000 7fb78107f740 10 client.0 _ll_register_callbacks cb 0x7fb77000e790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:18.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.036+0000 7fb777400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5637c884c660 0x5637c887b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.036+0000 7fb776a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637c885ef90 0x5637c8876340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.036+0000 7fb777400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5637c884c660 0x5637c887b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57692/0 (socket says 172.21.15.3:57692) 2024-09-19T06:13:18.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.036+0000 7fb777400640 1 -- 172.21.15.3:0/3904933058 learned_addr learned my addr 172.21.15.3:0/3904933058 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:18.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.036+0000 7fb777e00640 1 --2- 172.21.15.3:0/3904933058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637c885f830 0x5637c8876880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.037+0000 7fb777400640 1 -- 172.21.15.3:0/3904933058 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637c885ef90 msgr2=0x5637c8876340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:18.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.037+0000 7fb777400640 1 --2- 172.21.15.3:0/3904933058 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637c885ef90 0x5637c8876340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.037+0000 7fb777400640 1 -- 172.21.15.3:0/3904933058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637c885f830 msgr2=0x5637c8876880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:18.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.037+0000 7fb777400640 1 --2- 172.21.15.3:0/3904933058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637c885f830 0x5637c8876880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.037+0000 7fb777400640 1 -- 172.21.15.3:0/3904933058 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637c8849060 con 0x5637c884c660 2024-09-19T06:13:18.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.037+0000 7fb777400640 1 --2- 172.21.15.3:0/3904933058 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5637c884c660 0x5637c887b010 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb770004540 tx=0x7fb770005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aef248b08d60b3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:18.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.037+0000 7fb761600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:13:18.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.038+0000 7fb761600640 1 -- 172.21.15.3:0/3904933058 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7700047c0 con 0x5637c884c660 2024-09-19T06:13:18.041 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.038+0000 7fb761600640 1 -- 172.21.15.3:0/3904933058 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fb770005040 con 0x5637c884c660 2024-09-19T06:13:18.041 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.039+0000 7fb78107f740 1 -- 172.21.15.3:0/3904933058 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb77002b070 con 0x5637c884c660 2024-09-19T06:13:18.041 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.039+0000 7fb761600640 1 -- 172.21.15.3:0/3904933058 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb770005240 con 0x5637c884c660 2024-09-19T06:13:18.041 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.039+0000 7fb78107f740 10 client.15417 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:18.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.039+0000 7fb78107f740 1 -- 172.21.15.3:0/3904933058 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5637c88d1790 con 0x5637c884c660 2024-09-19T06:13:18.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.040+0000 7fb761600640 1 -- 172.21.15.3:0/3904933058 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb77002b070 con 0x5637c884c660 2024-09-19T06:13:18.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.041+0000 7fb761600640 1 -- 172.21.15.3:0/3904933058 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb770023040 con 0x5637c884c660 2024-09-19T06:13:18.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.041+0000 7fb78107f740 10 client.15417 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:18.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.041+0000 7fb78107f740 10 client.15417 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:13:18.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.041+0000 7fb78107f740 20 client.15417 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:18.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.041+0000 7fb78107f740 1 --2- 172.21.15.3:0/3904933058 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5637c88d1e50 0x5637c88d4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.041+0000 7fb78107f740 4 client.15417 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:13:18.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.041+0000 7fb78107f740 1 -- 172.21.15.3:0/3904933058 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5637c87b9e60 con 0x5637c88d1e50 2024-09-19T06:13:18.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.042+0000 7fb776a00640 1 --2- 172.21.15.3:0/3904933058 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5637c88d1e50 0x5637c88d4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.042+0000 7fb776a00640 1 --2- 172.21.15.3:0/3904933058 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5637c88d1e50 0x5637c88d4270 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=534100f8d44b0ef9 server_cookie=ac4f6831714830bf in_seq=0 out_seq=0 2024-09-19T06:13:18.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.042+0000 7fb761600640 10 client.15417 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:13:18.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.043+0000 7fb761600640 1 -- 172.21.15.3:0/3904933058 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5637c87b9e60 con 0x5637c88d1e50 2024-09-19T06:13:18.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.043+0000 7fb761600640 10 client.15417 handle_command_reply: tid=0 2024-09-19T06:13:18.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.043+0000 7fb78107f740 1 client.15417 shutdown 2024-09-19T06:13:18.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.044+0000 7fb78107f740 1 -- 172.21.15.3:0/3904933058 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5637c884c660 msgr2=0x5637c887b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:18.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.044+0000 7fb78107f740 1 --2- 172.21.15.3:0/3904933058 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5637c884c660 0x5637c887b010 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb770004540 tx=0x7fb770005990 comp rx=0 tx=0).stop 2024-09-19T06:13:18.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.044+0000 7fb78107f740 1 -- 172.21.15.3:0/3904933058 shutdown_connections 2024-09-19T06:13:18.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.044+0000 7fb78107f740 1 --2- 172.21.15.3:0/3904933058 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5637c88d1e50 0x5637c88d4270 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.044+0000 7fb78107f740 1 --2- 172.21.15.3:0/3904933058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5637c885f830 0x5637c8876880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.044+0000 7fb78107f740 1 --2- 172.21.15.3:0/3904933058 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5637c885ef90 0x5637c8876340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.044+0000 7fb761600640 0 client.15417 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:13:18.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.044+0000 7fb78107f740 1 --2- 172.21.15.3:0/3904933058 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5637c884c660 0x5637c887b010 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.044+0000 7fb78107f740 1 -- 172.21.15.3:0/3904933058 >> 172.21.15.3:0/3904933058 conn(0x5637c88483d0 msgr2=0x5637c8855ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:18.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.045+0000 7fb78107f740 1 -- 172.21.15.3:0/3904933058 shutdown_connections 2024-09-19T06:13:18.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.045+0000 7fb78107f740 1 -- 172.21.15.3:0/3904933058 wait complete. 2024-09-19T06:13:18.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.045+0000 7fb78107f740 20 client.15417 trim_cache size 0 max 16384 2024-09-19T06:13:18.049 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:13:18.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.046+0000 7fb77d000640 1 -- 172.21.15.3:0/2929619426 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb75c0a3550 msgr2=0x7fb75c0a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:18.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.046+0000 7fb77d000640 1 --2- 172.21.15.3:0/2929619426 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb75c0a3550 0x7fb75c0a5a10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x5637c884d8e0 tx=0x7fb76400b5b0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.046+0000 7fb77d000640 1 -- 172.21.15.3:0/2929619426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb778108f60 msgr2=0x7fb77819ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:18.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.046+0000 7fb77d000640 1 --2- 172.21.15.3:0/2929619426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb778108f60 0x7fb77819ecf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb768009230 tx=0x7fb768004040 comp rx=0 tx=0).stop 2024-09-19T06:13:18.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.047+0000 7fb77d000640 1 -- 172.21.15.3:0/2929619426 shutdown_connections 2024-09-19T06:13:18.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.047+0000 7fb77d000640 1 --2- 172.21.15.3:0/2929619426 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb75c0a3550 0x7fb75c0a5a10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.047+0000 7fb77d000640 1 --2- 172.21.15.3:0/2929619426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb778108f60 0x7fb77819ecf0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.047+0000 7fb77d000640 1 --2- 172.21.15.3:0/2929619426 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7781047e0 0x7fb77819a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.047+0000 7fb77d000640 1 --2- 172.21.15.3:0/2929619426 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb778103e30 0x7fb77819a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.047+0000 7fb77d000640 1 -- 172.21.15.3:0/2929619426 >> 172.21.15.3:0/2929619426 conn(0x7fb7780ff910 msgr2=0x7fb778100cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:18.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.047+0000 7fb77d000640 1 -- 172.21.15.3:0/2929619426 shutdown_connections 2024-09-19T06:13:18.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:18.048+0000 7fb77d000640 1 -- 172.21.15.3:0/2929619426 wait complete. 2024-09-19T06:13:18.157 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.155+0000 7f8b49c00640 1 -- 172.21.15.3:0/339105861 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b44074ee0 msgr2=0x7f8b4410dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:18.158 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.155+0000 7f8b49c00640 1 --2- 172.21.15.3:0/339105861 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b44074ee0 0x7f8b4410dc90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8b30009900 tx=0x7f8b3002a480 comp rx=0 tx=0).stop 2024-09-19T06:13:18.158 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.156+0000 7f8b49c00640 1 -- 172.21.15.3:0/339105861 shutdown_connections 2024-09-19T06:13:18.158 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.156+0000 7f8b49c00640 1 --2- 172.21.15.3:0/339105861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b4410e1d0 0x7f8b441105e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.158 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.156+0000 7f8b49c00640 1 --2- 172.21.15.3:0/339105861 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b44074ee0 0x7f8b4410dc90 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.159 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.156+0000 7f8b49c00640 1 --2- 172.21.15.3:0/339105861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b440745c0 0x7f8b440749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.159 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.156+0000 7f8b49c00640 1 -- 172.21.15.3:0/339105861 >> 172.21.15.3:0/339105861 conn(0x7f8b440fd630 msgr2=0x7f8b440ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:18.159 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.156+0000 7f8b49c00640 1 -- 172.21.15.3:0/339105861 shutdown_connections 2024-09-19T06:13:18.159 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.156+0000 7f8b49c00640 1 -- 172.21.15.3:0/339105861 wait complete. 2024-09-19T06:13:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.157+0000 7f8b49c00640 1 Processor -- start 2024-09-19T06:13:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.157+0000 7f8b49c00640 1 -- start start 2024-09-19T06:13:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.158+0000 7f8b49c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b440745c0 0x7f8b4419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.158+0000 7f8b49c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b44074ee0 0x7f8b4419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.158+0000 7f8b49c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b4410e1d0 0x7f8b4419ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.158+0000 7f8b49c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8b44113fb0 con 0x7f8b44074ee0 2024-09-19T06:13:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.158+0000 7f8b49c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8b44113e30 con 0x7f8b440745c0 2024-09-19T06:13:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.158+0000 7f8b49c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8b44114130 con 0x7f8b4410e1d0 2024-09-19T06:13:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.158+0000 7f8b43400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b44074ee0 0x7f8b4419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.158+0000 7f8b43e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b440745c0 0x7f8b4419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.158+0000 7f8b43400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b44074ee0 0x7f8b4419aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57708/0 (socket says 172.21.15.3:57708) 2024-09-19T06:13:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.158+0000 7f8b43400640 1 -- 172.21.15.3:0/3920225429 learned_addr learned my addr 172.21.15.3:0/3920225429 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.158+0000 7f8b49200640 1 --2- 172.21.15.3:0/3920225429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b4410e1d0 0x7f8b4419ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.159+0000 7f8b43e00640 1 -- 172.21.15.3:0/3920225429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b4410e1d0 msgr2=0x7f8b4419ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.159+0000 7f8b43e00640 1 --2- 172.21.15.3:0/3920225429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b4410e1d0 0x7f8b4419ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.159+0000 7f8b43e00640 1 -- 172.21.15.3:0/3920225429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b44074ee0 msgr2=0x7f8b4419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.159+0000 7f8b43e00640 1 --2- 172.21.15.3:0/3920225429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b44074ee0 0x7f8b4419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.159+0000 7f8b43e00640 1 -- 172.21.15.3:0/3920225429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b4419f510 con 0x7f8b440745c0 2024-09-19T06:13:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.159+0000 7f8b43e00640 1 --2- 172.21.15.3:0/3920225429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b440745c0 0x7f8b4419a520 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400e9f0 tx=0x7f8b3400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.160+0000 7f8b40c00640 1 -- 172.21.15.3:0/3920225429 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3400ccc0 con 0x7f8b440745c0 2024-09-19T06:13:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.160+0000 7f8b40c00640 1 -- 172.21.15.3:0/3920225429 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b34005020 con 0x7f8b440745c0 2024-09-19T06:13:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.160+0000 7f8b49c00640 1 -- 172.21.15.3:0/3920225429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b4419f800 con 0x7f8b440745c0 2024-09-19T06:13:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.160+0000 7f8b40c00640 1 -- 172.21.15.3:0/3920225429 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b340049e0 con 0x7f8b440745c0 2024-09-19T06:13:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.160+0000 7f8b49c00640 1 -- 172.21.15.3:0/3920225429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b441a7090 con 0x7f8b440745c0 2024-09-19T06:13:18.166 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.164+0000 7f8b4e0a1740 1 Processor -- start 2024-09-19T06:13:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.164+0000 7f8b4e0a1740 1 -- start start 2024-09-19T06:13:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.165+0000 7f8b4e0a1740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d0173b0 0x56102d017790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.165+0000 7f8b4e0a1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56102d017cd0 0x56102d022030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.165+0000 7f8b4e0a1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56102d022570 0x56102d024960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.165+0000 7f8b4e0a1740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56102cf7d100 con 0x56102d0173b0 2024-09-19T06:13:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.165+0000 7f8b4e0a1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56102cf251b0 con 0x56102d022570 2024-09-19T06:13:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.165+0000 7f8b4e0a1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56102cf790c0 con 0x56102d017cd0 2024-09-19T06:13:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.165+0000 7f8b49200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d0173b0 0x56102d017790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.165+0000 7f8b49200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d0173b0 0x56102d017790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57724/0 (socket says 172.21.15.3:57724) 2024-09-19T06:13:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.165+0000 7f8b49200640 1 -- 172.21.15.3:0/1052333593 learned_addr learned my addr 172.21.15.3:0/1052333593 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:18.167 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.165+0000 7f8b43400640 1 --2- 172.21.15.3:0/1052333593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56102d022570 0x56102d024960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.165+0000 7f8b40c00640 1 -- 172.21.15.3:0/3920225429 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 138587+0+0 (secure 0 0 0) 0x7f8b34005560 con 0x7f8b440745c0 2024-09-19T06:13:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.166+0000 7f8b49200640 1 -- 172.21.15.3:0/1052333593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56102d017cd0 msgr2=0x56102d022030 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:13:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.166+0000 7f8b49200640 1 --2- 172.21.15.3:0/1052333593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56102d017cd0 0x56102d022030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.166+0000 7f8b49200640 1 -- 172.21.15.3:0/1052333593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56102d022570 msgr2=0x56102d024960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.166+0000 7f8b49200640 1 --2- 172.21.15.3:0/1052333593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56102d022570 0x56102d024960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.166+0000 7f8b49200640 1 -- 172.21.15.3:0/1052333593 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56102cc90210 con 0x56102d0173b0 2024-09-19T06:13:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.166+0000 7f8b49200640 1 --2- 172.21.15.3:0/1052333593 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d0173b0 0x56102d017790 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009f30 tx=0x7f8b3c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa053dcd54267fd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:18.169 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.166+0000 7f8b39600640 1 -- 172.21.15.3:0/1052333593 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c004d20 con 0x56102d0173b0 2024-09-19T06:13:18.169 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.166+0000 7f8b39600640 1 -- 172.21.15.3:0/1052333593 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b3c004050 con 0x56102d0173b0 2024-09-19T06:13:18.169 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.166+0000 7f8b39600640 1 -- 172.21.15.3:0/1052333593 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c005260 con 0x56102d0173b0 2024-09-19T06:13:18.169 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.167+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/1052333593 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d0173b0 msgr2=0x56102d017790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.167+0000 7f8b4e0a1740 1 --2- 172.21.15.3:0/1052333593 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d0173b0 0x56102d017790 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009f30 tx=0x7f8b3c0118d0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.167+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/1052333593 shutdown_connections 2024-09-19T06:13:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.167+0000 7f8b4e0a1740 1 --2- 172.21.15.3:0/1052333593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56102d022570 0x56102d024960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.167+0000 7f8b4e0a1740 1 --2- 172.21.15.3:0/1052333593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56102d017cd0 0x56102d022030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.167+0000 7f8b4e0a1740 1 --2- 172.21.15.3:0/1052333593 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d0173b0 0x56102d017790 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.167+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/1052333593 >> 172.21.15.3:0/1052333593 conn(0x56102d013920 msgr2=0x56102d013d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.167+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/1052333593 shutdown_connections 2024-09-19T06:13:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.167+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/1052333593 wait complete. 2024-09-19T06:13:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.168+0000 7f8b40c00640 1 --2- 172.21.15.3:0/3920225429 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8b280a34d0 0x7f8b280a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.168+0000 7f8b40c00640 1 -- 172.21.15.3:0/3920225429 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f8b340cff20 con 0x7f8b440745c0 2024-09-19T06:13:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.168+0000 7f8b4e0a1740 1 -- start start 2024-09-19T06:13:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.168+0000 7f8b4e0a1740 1 Processor -- start 2024-09-19T06:13:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.168+0000 7f8b43400640 1 --2- 172.21.15.3:0/3920225429 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8b280a34d0 0x7f8b280a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.169+0000 7f8b4e0a1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56102d0173b0 0x56102d01f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.169+0000 7f8b4e0a1740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d017cd0 0x56102d01fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.169+0000 7f8b4e0a1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56102d022570 0x56102d020000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.169+0000 7f8b4e0a1740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56102d024ff0 con 0x56102d017cd0 2024-09-19T06:13:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.169+0000 7f8b4e0a1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56102cf06090 con 0x56102d022570 2024-09-19T06:13:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.169+0000 7f8b4e0a1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56102d025170 con 0x56102d0173b0 2024-09-19T06:13:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.169+0000 7f8b4e0a1740 10 client.0 _ll_register_callbacks cb 0x56102cf5af30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.169+0000 7f8b43e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56102d0173b0 0x56102d01f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.169+0000 7f8b49200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56102d022570 0x56102d020000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.169+0000 7f8b43e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56102d0173b0 0x56102d01f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:32844/0 (socket says 172.21.15.3:32844) 2024-09-19T06:13:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.169+0000 7f8b43e00640 1 -- 172.21.15.3:0/1659044459 learned_addr learned my addr 172.21.15.3:0/1659044459 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.169+0000 7f8b43400640 1 --2- 172.21.15.3:0/1659044459 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d017cd0 0x56102d01fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.170+0000 7f8b49200640 1 -- 172.21.15.3:0/1659044459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56102d0173b0 msgr2=0x56102d01f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.170+0000 7f8b49200640 1 --2- 172.21.15.3:0/1659044459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56102d0173b0 0x56102d01f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.170+0000 7f8b49200640 1 -- 172.21.15.3:0/1659044459 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d017cd0 msgr2=0x56102d01fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.170+0000 7f8b49200640 1 --2- 172.21.15.3:0/1659044459 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d017cd0 0x56102d01fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.170+0000 7f8b49200640 1 -- 172.21.15.3:0/1659044459 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56102cd5c620 con 0x56102d022570 2024-09-19T06:13:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.170+0000 7f8b49200640 1 --2- 172.21.15.3:0/1659044459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56102d022570 0x56102d020000 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c01b040 tx=0x7f8b3c003c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3edc85a6042357c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.170+0000 7f8b2e000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:13:18.175 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.170+0000 7f8b43400640 1 --2- 172.21.15.3:0/3920225429 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8b280a34d0 0x7f8b280a5990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8b4410f510 tx=0x7f8b300043a0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:18.175 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.171+0000 7f8b2e000640 1 -- 172.21.15.3:0/1659044459 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c029020 con 0x56102d022570 2024-09-19T06:13:18.175 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.171+0000 7f8b2e000640 1 -- 172.21.15.3:0/1659044459 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f8b3c005040 con 0x56102d022570 2024-09-19T06:13:18.175 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.171+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/1659044459 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b3c004050 con 0x56102d022570 2024-09-19T06:13:18.175 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.171+0000 7f8b2e000640 1 -- 172.21.15.3:0/1659044459 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8b3c004e50 con 0x56102d022570 2024-09-19T06:13:18.175 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.171+0000 7f8b4e0a1740 10 client.25463 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:18.175 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.171+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/1659044459 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56102d039650 con 0x56102d022570 2024-09-19T06:13:18.175 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.171+0000 7f8b2e000640 1 -- 172.21.15.3:0/1659044459 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b3c004050 con 0x56102d022570 2024-09-19T06:13:18.175 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.172+0000 7f8b2e000640 1 -- 172.21.15.3:0/1659044459 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8b3c025630 con 0x56102d022570 2024-09-19T06:13:18.176 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.172+0000 7f8b4e0a1740 10 client.25463 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:18.176 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.172+0000 7f8b4e0a1740 10 client.25463 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:13:18.176 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.172+0000 7f8b4e0a1740 20 client.25463 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:18.176 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.172+0000 7f8b4e0a1740 1 --2- 172.21.15.3:0/1659044459 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56102d03aab0 0x56102d03cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.176 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.172+0000 7f8b4e0a1740 4 client.25463 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:13:18.176 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.172+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/1659044459 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56102cf8a830 con 0x56102d03aab0 2024-09-19T06:13:18.176 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.172+0000 7f8b43e00640 1 --2- 172.21.15.3:0/1659044459 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56102d03aab0 0x56102d03cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.177 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.173+0000 7f8b43e00640 1 --2- 172.21.15.3:0/1659044459 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56102d03aab0 0x56102d03cea0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57d4a6b3b4c7acb9 server_cookie=ed9eb150e49f7a4a in_seq=0 out_seq=0 2024-09-19T06:13:18.177 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.173+0000 7f8b2e000640 10 client.25463 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:18.177 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.174+0000 7f8b2e000640 1 -- 172.21.15.3:0/1659044459 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56102cf8a830 con 0x56102d03aab0 2024-09-19T06:13:18.177 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.174+0000 7f8b2e000640 10 client.25463 handle_command_reply: tid=0 2024-09-19T06:13:18.177 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.174+0000 7f8b4e0a1740 1 client.25463 shutdown 2024-09-19T06:13:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.174+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/1659044459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56102d022570 msgr2=0x56102d020000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.174+0000 7f8b4e0a1740 1 --2- 172.21.15.3:0/1659044459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56102d022570 0x56102d020000 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c01b040 tx=0x7f8b3c003c60 comp rx=0 tx=0).stop 2024-09-19T06:13:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.174+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/1659044459 shutdown_connections 2024-09-19T06:13:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.174+0000 7f8b4e0a1740 1 --2- 172.21.15.3:0/1659044459 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56102d03aab0 0x56102d03cea0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.174+0000 7f8b4e0a1740 1 --2- 172.21.15.3:0/1659044459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56102d022570 0x56102d020000 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.174+0000 7f8b4e0a1740 1 --2- 172.21.15.3:0/1659044459 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d017cd0 0x56102d01fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.174+0000 7f8b4e0a1740 1 --2- 172.21.15.3:0/1659044459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56102d0173b0 0x56102d01f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.174+0000 7f8b2e000640 0 client.25463 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.174+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/1659044459 >> 172.21.15.3:0/1659044459 conn(0x56102d013920 msgr2=0x56102d019680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.174+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/1659044459 shutdown_connections 2024-09-19T06:13:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.174+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/1659044459 wait complete. 2024-09-19T06:13:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.175+0000 7f8b4e0a1740 20 client.25463 trim_cache size 0 max 16384 2024-09-19T06:13:18.192 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.191+0000 7f8b4e0a1740 1 Processor -- start 2024-09-19T06:13:18.192 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.191+0000 7f8b4e0a1740 1 -- start start 2024-09-19T06:13:18.195 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.191+0000 7f8b4e0a1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56102d0173b0 0x56102d0425c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.195 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.191+0000 7f8b4e0a1740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d017cd0 0x56102d042b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.195 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.191+0000 7f8b4e0a1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56102d022570 0x56102d0121c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.195 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.191+0000 7f8b4e0a1740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8b441ab5e0 con 0x56102d017cd0 2024-09-19T06:13:18.195 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.191+0000 7f8b4e0a1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8b441ad120 con 0x56102d022570 2024-09-19T06:13:18.195 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.191+0000 7f8b4e0a1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8b441abcb0 con 0x56102d0173b0 2024-09-19T06:13:18.195 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.191+0000 7f8b43400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d017cd0 0x56102d042b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.195 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.192+0000 7f8b43e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56102d0173b0 0x56102d0425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.195 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.191+0000 7f8b43400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d017cd0 0x56102d042b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57752/0 (socket says 172.21.15.3:57752) 2024-09-19T06:13:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.192+0000 7f8b43400640 1 -- 172.21.15.3:0/907368474 learned_addr learned my addr 172.21.15.3:0/907368474 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.192+0000 7f8b49200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56102d022570 0x56102d0121c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.192+0000 7f8b43e00640 1 -- 172.21.15.3:0/907368474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56102d022570 msgr2=0x56102d0121c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.192+0000 7f8b43e00640 1 --2- 172.21.15.3:0/907368474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56102d022570 0x56102d0121c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.192+0000 7f8b43e00640 1 -- 172.21.15.3:0/907368474 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d017cd0 msgr2=0x56102d042b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.192+0000 7f8b43e00640 1 --2- 172.21.15.3:0/907368474 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d017cd0 0x56102d042b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.192+0000 7f8b43e00640 1 -- 172.21.15.3:0/907368474 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56102d02eb80 con 0x56102d0173b0 2024-09-19T06:13:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.192+0000 7f8b43e00640 1 --2- 172.21.15.3:0/907368474 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56102d0173b0 0x56102d0425c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400c6a0 tx=0x7f8b34009f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=179872be54c9006c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.192+0000 7f8b38c00640 1 -- 172.21.15.3:0/907368474 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3401c040 con 0x56102d0173b0 2024-09-19T06:13:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.192+0000 7f8b38c00640 1 -- 172.21.15.3:0/907368474 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b34084070 con 0x56102d0173b0 2024-09-19T06:13:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.192+0000 7f8b38c00640 1 -- 172.21.15.3:0/907368474 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b340a4730 con 0x56102d0173b0 2024-09-19T06:13:18.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.193+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/907368474 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56102d0173b0 msgr2=0x56102d0425c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:18.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.193+0000 7f8b4e0a1740 1 --2- 172.21.15.3:0/907368474 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56102d0173b0 0x56102d0425c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400c6a0 tx=0x7f8b34009f60 comp rx=0 tx=0).stop 2024-09-19T06:13:18.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.193+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/907368474 shutdown_connections 2024-09-19T06:13:18.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.193+0000 7f8b4e0a1740 1 --2- 172.21.15.3:0/907368474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56102d022570 0x56102d0121c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.193+0000 7f8b4e0a1740 1 --2- 172.21.15.3:0/907368474 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d017cd0 0x56102d042b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.193+0000 7f8b4e0a1740 1 --2- 172.21.15.3:0/907368474 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56102d0173b0 0x56102d0425c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.193+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/907368474 >> 172.21.15.3:0/907368474 conn(0x56102d013920 msgr2=0x56102d01e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:18.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.193+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/907368474 shutdown_connections 2024-09-19T06:13:18.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.193+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/907368474 wait complete. 2024-09-19T06:13:18.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.194+0000 7f8b4e0a1740 1 -- start start 2024-09-19T06:13:18.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.194+0000 7f8b4e0a1740 1 Processor -- start 2024-09-19T06:13:18.199 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.195+0000 7f8b4e0a1740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d0173b0 0x56102d025a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.200 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.195+0000 7f8b4e0a1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56102d017cd0 0x56102d025fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.200 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.195+0000 7f8b4e0a1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56102d022570 0x56102d0a3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.200 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.195+0000 7f8b4e0a1740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8b441aca50 con 0x56102d0173b0 2024-09-19T06:13:18.200 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.195+0000 7f8b4e0a1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8b441ac380 con 0x56102d022570 2024-09-19T06:13:18.200 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.195+0000 7f8b4e0a1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8b441a95c0 con 0x56102d017cd0 2024-09-19T06:13:18.200 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.195+0000 7f8b4e0a1740 10 client.0 _ll_register_callbacks cb 0x7f8b34005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:18.200 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.195+0000 7f8b43e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d0173b0 0x56102d025a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.200 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.195+0000 7f8b43e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d0173b0 0x56102d025a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57762/0 (socket says 172.21.15.3:57762) 2024-09-19T06:13:18.200 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.195+0000 7f8b43400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56102d017cd0 0x56102d025fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.200 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.195+0000 7f8b43e00640 1 -- 172.21.15.3:0/1364027897 learned_addr learned my addr 172.21.15.3:0/1364027897 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:18.200 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.195+0000 7f8b49200640 1 --2- 172.21.15.3:0/1364027897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56102d022570 0x56102d0a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.201 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.196+0000 7f8b43e00640 1 -- 172.21.15.3:0/1364027897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56102d017cd0 msgr2=0x56102d025fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:18.201 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.196+0000 7f8b43e00640 1 --2- 172.21.15.3:0/1364027897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56102d017cd0 0x56102d025fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.201 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.196+0000 7f8b43e00640 1 -- 172.21.15.3:0/1364027897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56102d022570 msgr2=0x56102d0a3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:18.201 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.196+0000 7f8b43e00640 1 --2- 172.21.15.3:0/1364027897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56102d022570 0x56102d0a3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.201 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.196+0000 7f8b43e00640 1 -- 172.21.15.3:0/1364027897 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56102d020550 con 0x56102d0173b0 2024-09-19T06:13:18.201 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.196+0000 7f8b43e00640 1 --2- 172.21.15.3:0/1364027897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d0173b0 0x56102d025a60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8b3409b9a0 tx=0x7f8b340d0230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42a36280deddbbd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:18.201 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.196+0000 7f8b2e000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:13:18.201 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.196+0000 7f8b2e000640 1 -- 172.21.15.3:0/1364027897 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b340ba020 con 0x56102d0173b0 2024-09-19T06:13:18.201 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.196+0000 7f8b2e000640 1 -- 172.21.15.3:0/1364027897 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f8b340a4730 con 0x56102d0173b0 2024-09-19T06:13:18.201 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.196+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/1364027897 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b34084070 con 0x56102d0173b0 2024-09-19T06:13:18.201 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.197+0000 7f8b2e000640 1 -- 172.21.15.3:0/1364027897 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8b340a4bc0 con 0x56102d0173b0 2024-09-19T06:13:18.201 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.197+0000 7f8b4e0a1740 10 client.15435 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:18.201 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.197+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/1364027897 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56102d0a4c00 con 0x56102d0173b0 2024-09-19T06:13:18.202 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.197+0000 7f8b2e000640 1 -- 172.21.15.3:0/1364027897 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b34084070 con 0x56102d0173b0 2024-09-19T06:13:18.202 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.197+0000 7f8b2e000640 1 -- 172.21.15.3:0/1364027897 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8b3409f040 con 0x56102d0173b0 2024-09-19T06:13:18.202 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.197+0000 7f8b4e0a1740 10 client.15435 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:18.202 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.197+0000 7f8b4e0a1740 10 client.15435 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:13:18.202 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.197+0000 7f8b4e0a1740 20 client.15435 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:18.202 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.197+0000 7f8b4e0a1740 1 --2- 172.21.15.3:0/1364027897 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56102d0a5200 0x56102d0a7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:18.202 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.197+0000 7f8b4e0a1740 4 client.15435 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:13:18.202 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.197+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/1364027897 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56102cf84b80 con 0x56102d0a5200 2024-09-19T06:13:18.202 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.198+0000 7f8b43400640 1 --2- 172.21.15.3:0/1364027897 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56102d0a5200 0x56102d0a7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:18.203 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.198+0000 7f8b43400640 1 --2- 172.21.15.3:0/1364027897 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56102d0a5200 0x56102d0a7620 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51dc449560c5ae48 server_cookie=f30bef0edccb92c7 in_seq=0 out_seq=0 2024-09-19T06:13:18.203 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.198+0000 7f8b2e000640 10 client.15435 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.206+0000 7f8b2e000640 1 -- 172.21.15.3:0/1364027897 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56102cf84b80 con 0x56102d0a5200 2024-09-19T06:13:18.211 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.206+0000 7f8b2e000640 10 client.15435 handle_command_reply: tid=0 2024-09-19T06:13:18.211 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.206+0000 7f8b4e0a1740 1 client.15435 shutdown 2024-09-19T06:13:18.211 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.206+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/1364027897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d0173b0 msgr2=0x56102d025a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:18.211 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.206+0000 7f8b4e0a1740 1 --2- 172.21.15.3:0/1364027897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d0173b0 0x56102d025a60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8b3409b9a0 tx=0x7f8b340d0230 comp rx=0 tx=0).stop 2024-09-19T06:13:18.211 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.206+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/1364027897 shutdown_connections 2024-09-19T06:13:18.211 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.206+0000 7f8b4e0a1740 1 --2- 172.21.15.3:0/1364027897 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56102d0a5200 0x56102d0a7620 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.211 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.206+0000 7f8b4e0a1740 1 --2- 172.21.15.3:0/1364027897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56102d022570 0x56102d0a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.211 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.206+0000 7f8b4e0a1740 1 --2- 172.21.15.3:0/1364027897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56102d017cd0 0x56102d025fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.212 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.206+0000 7f8b4e0a1740 1 --2- 172.21.15.3:0/1364027897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56102d0173b0 0x56102d025a60 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.212 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.206+0000 7f8b2e000640 0 client.15435 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:18.212 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.206+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/1364027897 >> 172.21.15.3:0/1364027897 conn(0x56102d013920 msgr2=0x56102d01f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:18.212 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.207+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/1364027897 shutdown_connections 2024-09-19T06:13:18.212 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.207+0000 7f8b4e0a1740 1 -- 172.21.15.3:0/1364027897 wait complete. 2024-09-19T06:13:18.212 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.207+0000 7f8b4e0a1740 20 client.15435 trim_cache size 0 max 16384 2024-09-19T06:13:18.212 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:13:18.213 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:13:18.213 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:13:18.213 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:13:18.213 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.208+0000 7f8b49c00640 1 -- 172.21.15.3:0/3920225429 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8b280a34d0 msgr2=0x7f8b280a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:18.213 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.208+0000 7f8b49c00640 1 --2- 172.21.15.3:0/3920225429 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8b280a34d0 0x7f8b280a5990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8b4410f510 tx=0x7f8b300043a0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.213 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.208+0000 7f8b49c00640 1 -- 172.21.15.3:0/3920225429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b440745c0 msgr2=0x7f8b4419a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:18.214 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.208+0000 7f8b49c00640 1 --2- 172.21.15.3:0/3920225429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b440745c0 0x7f8b4419a520 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8b3400e9f0 tx=0x7f8b3400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.214 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.208+0000 7f8b49c00640 1 -- 172.21.15.3:0/3920225429 shutdown_connections 2024-09-19T06:13:18.214 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.208+0000 7f8b49c00640 1 --2- 172.21.15.3:0/3920225429 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8b280a34d0 0x7f8b280a5990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.214 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.208+0000 7f8b49c00640 1 --2- 172.21.15.3:0/3920225429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8b4410e1d0 0x7f8b4419ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.214 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.208+0000 7f8b49c00640 1 --2- 172.21.15.3:0/3920225429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b44074ee0 0x7f8b4419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.214 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.208+0000 7f8b49c00640 1 --2- 172.21.15.3:0/3920225429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b440745c0 0x7f8b4419a520 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:18.214 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.208+0000 7f8b49c00640 1 -- 172.21.15.3:0/3920225429 >> 172.21.15.3:0/3920225429 conn(0x7f8b440fd630 msgr2=0x7f8b440fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:18.214 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.208+0000 7f8b49c00640 1 -- 172.21.15.3:0/3920225429 shutdown_connections 2024-09-19T06:13:18.214 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:18.208+0000 7f8b49c00640 1 -- 172.21.15.3:0/3920225429 wait complete. 2024-09-19T06:13:18.236 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:18 smithi003 ceph-mon[30893]: pgmap v30: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-09-19T06:13:18.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:18 smithi059 ceph-mon[35138]: pgmap v30: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-09-19T06:13:18.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:18 smithi071 ceph-mon[35662]: pgmap v30: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-09-19T06:13:19.107 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:13:19.567 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:20.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.263+0000 7fa971200640 1 -- 172.21.15.3:0/655544646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa96c102370 msgr2=0x7fa96c10e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:20.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.263+0000 7fa971200640 1 --2- 172.21.15.3:0/655544646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa96c102370 0x7fa96c10e8a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa964009c10 tx=0x7fa96402a6e0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.263+0000 7fa971200640 1 -- 172.21.15.3:0/655544646 shutdown_connections 2024-09-19T06:13:20.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.263+0000 7fa971200640 1 --2- 172.21.15.3:0/655544646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa96c102370 0x7fa96c10e8a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.263+0000 7fa971200640 1 --2- 172.21.15.3:0/655544646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa96c1019d0 0x7fa96c101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.263+0000 7fa971200640 1 --2- 172.21.15.3:0/655544646 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa96c1079d0 0x7fa96c107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.263+0000 7fa971200640 1 -- 172.21.15.3:0/655544646 >> 172.21.15.3:0/655544646 conn(0x7fa96c0fd710 msgr2=0x7fa96c0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:20.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.263+0000 7fa971200640 1 -- 172.21.15.3:0/655544646 shutdown_connections 2024-09-19T06:13:20.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.263+0000 7fa971200640 1 -- 172.21.15.3:0/655544646 wait complete. 2024-09-19T06:13:20.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.265+0000 7fa971200640 1 Processor -- start 2024-09-19T06:13:20.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.265+0000 7fa971200640 1 -- start start 2024-09-19T06:13:20.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.265+0000 7fa971200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa96c1019d0 0x7fa96c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:20.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.266+0000 7fa971200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa96c102370 0x7fa96c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:20.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.266+0000 7fa971200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa96c1079d0 0x7fa96c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:20.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.266+0000 7fa971200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c111dd0 con 0x7fa96c1079d0 2024-09-19T06:13:20.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.266+0000 7fa971200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c111c50 con 0x7fa96c1019d0 2024-09-19T06:13:20.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.266+0000 7fa971200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c111f50 con 0x7fa96c102370 2024-09-19T06:13:20.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.266+0000 7fa96be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa96c1079d0 0x7fa96c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:20.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.266+0000 7fa96be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa96c1079d0 0x7fa96c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57772/0 (socket says 172.21.15.3:57772) 2024-09-19T06:13:20.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.266+0000 7fa96be00640 1 -- 172.21.15.3:0/1451768501 learned_addr learned my addr 172.21.15.3:0/1451768501 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:20.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.266+0000 7fa96b400640 1 --2- 172.21.15.3:0/1451768501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa96c1019d0 0x7fa96c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:20.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.267+0000 7fa96aa00640 1 --2- 172.21.15.3:0/1451768501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa96c102370 0x7fa96c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:20.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.267+0000 7fa96be00640 1 -- 172.21.15.3:0/1451768501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa96c102370 msgr2=0x7fa96c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:20.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.267+0000 7fa96be00640 1 --2- 172.21.15.3:0/1451768501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa96c102370 0x7fa96c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.267+0000 7fa96be00640 1 -- 172.21.15.3:0/1451768501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa96c1019d0 msgr2=0x7fa96c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:20.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.267+0000 7fa96be00640 1 --2- 172.21.15.3:0/1451768501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa96c1019d0 0x7fa96c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.267+0000 7fa96be00640 1 -- 172.21.15.3:0/1451768501 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa96c1aac40 con 0x7fa96c1079d0 2024-09-19T06:13:20.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.267+0000 7fa96aa00640 1 --2- 172.21.15.3:0/1451768501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa96c102370 0x7fa96c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:13:20.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.268+0000 7fa96be00640 1 --2- 172.21.15.3:0/1451768501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa96c1079d0 0x7fa96c074f70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa96402ac00 tx=0x7fa9640305d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:20.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.268+0000 7fa963e00640 1 -- 172.21.15.3:0/1451768501 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa964041020 con 0x7fa96c1079d0 2024-09-19T06:13:20.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.268+0000 7fa971200640 1 -- 172.21.15.3:0/1451768501 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa96c1aae10 con 0x7fa96c1079d0 2024-09-19T06:13:20.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.268+0000 7fa971200640 1 -- 172.21.15.3:0/1451768501 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa96c1ab310 con 0x7fa96c1079d0 2024-09-19T06:13:20.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.268+0000 7fa963e00640 1 -- 172.21.15.3:0/1451768501 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa964003e50 con 0x7fa96c1079d0 2024-09-19T06:13:20.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.268+0000 7fa963e00640 1 -- 172.21.15.3:0/1451768501 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa964036040 con 0x7fa96c1079d0 2024-09-19T06:13:20.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.273+0000 7fa975477740 1 Processor -- start 2024-09-19T06:13:20.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.274+0000 7fa963e00640 1 -- 172.21.15.3:0/1451768501 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 138587+0+0 (secure 0 0 0) 0x7fa964044020 con 0x7fa96c1079d0 2024-09-19T06:13:20.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.274+0000 7fa975477740 1 -- start start 2024-09-19T06:13:20.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.275+0000 7fa975477740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56495f609e40 0x56495f60a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:20.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.275+0000 7fa975477740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56495f60a760 0x56495f614ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:20.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.275+0000 7fa975477740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f615020 0x56495f617410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:20.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.275+0000 7fa975477740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56495f5703e0 con 0x56495f615020 2024-09-19T06:13:20.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.275+0000 7fa975477740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56495f517d80 con 0x56495f60a760 2024-09-19T06:13:20.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.275+0000 7fa975477740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56495f56c3a0 con 0x56495f609e40 2024-09-19T06:13:20.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.275+0000 7fa96b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56495f60a760 0x56495f614ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:20.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.275+0000 7fa96b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56495f60a760 0x56495f614ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44472/0 (socket says 172.21.15.3:44472) 2024-09-19T06:13:20.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.275+0000 7fa96b400640 1 -- 172.21.15.3:0/1611087648 learned_addr learned my addr 172.21.15.3:0/1611087648 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:20.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.276+0000 7fa96aa00640 1 --2- 172.21.15.3:0/1611087648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56495f609e40 0x56495f60a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:20.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.276+0000 7fa96aa00640 1 --2- 172.21.15.3:0/1611087648 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f615020 0x56495f617410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:20.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.276+0000 7fa96b400640 1 -- 172.21.15.3:0/1611087648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56495f609e40 msgr2=0x56495f60a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:20.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.276+0000 7fa96b400640 1 --2- 172.21.15.3:0/1611087648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56495f609e40 0x56495f60a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.276+0000 7fa96b400640 1 -- 172.21.15.3:0/1611087648 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f615020 msgr2=0x56495f617410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:20.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.276+0000 7fa96b400640 1 --2- 172.21.15.3:0/1611087648 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f615020 0x56495f617410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.276+0000 7fa96b400640 1 -- 172.21.15.3:0/1611087648 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56495f536ae0 con 0x56495f60a760 2024-09-19T06:13:20.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.276+0000 7fa96aa00640 1 --2- 172.21.15.3:0/1611087648 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f615020 0x56495f617410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:13:20.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.277+0000 7fa96b400640 1 --2- 172.21.15.3:0/1611087648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56495f60a760 0x56495f614ae0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa95c009c20 tx=0x7fa95c0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6db1d99ab7c4aeec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:20.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.277+0000 7fa963e00640 1 --2- 172.21.15.3:0/1451768501 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa9500a3550 0x7fa9500a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:20.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.277+0000 7fa960c00640 1 -- 172.21.15.3:0/1611087648 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c01c480 con 0x56495f60a760 2024-09-19T06:13:20.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.277+0000 7fa963e00640 1 -- 172.21.15.3:0/1451768501 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fa9640f0ca0 con 0x7fa96c1079d0 2024-09-19T06:13:20.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.277+0000 7fa960c00640 1 -- 172.21.15.3:0/1611087648 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa95c01cb00 con 0x56495f60a760 2024-09-19T06:13:20.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.277+0000 7fa960c00640 1 -- 172.21.15.3:0/1611087648 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c011c60 con 0x56495f60a760 2024-09-19T06:13:20.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.278+0000 7fa96aa00640 1 --2- 172.21.15.3:0/1451768501 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa9500a3550 0x7fa9500a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:20.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.279+0000 7fa975477740 1 -- 172.21.15.3:0/1611087648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56495f60a760 msgr2=0x56495f614ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:20.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.279+0000 7fa975477740 1 --2- 172.21.15.3:0/1611087648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56495f60a760 0x56495f614ae0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa95c009c20 tx=0x7fa95c0107a0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.279+0000 7fa975477740 1 -- 172.21.15.3:0/1611087648 shutdown_connections 2024-09-19T06:13:20.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.279+0000 7fa975477740 1 --2- 172.21.15.3:0/1611087648 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f615020 0x56495f617410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.279+0000 7fa975477740 1 --2- 172.21.15.3:0/1611087648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56495f60a760 0x56495f614ae0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.279+0000 7fa975477740 1 --2- 172.21.15.3:0/1611087648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56495f609e40 0x56495f60a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.279+0000 7fa975477740 1 -- 172.21.15.3:0/1611087648 >> 172.21.15.3:0/1611087648 conn(0x56495f6063d0 msgr2=0x56495f6067b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:20.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.279+0000 7fa96aa00640 1 --2- 172.21.15.3:0/1451768501 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa9500a3550 0x7fa9500a5a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x56495f607750 tx=0x7fa958005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:20.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.279+0000 7fa975477740 1 -- 172.21.15.3:0/1611087648 shutdown_connections 2024-09-19T06:13:20.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.279+0000 7fa975477740 1 -- 172.21.15.3:0/1611087648 wait complete. 2024-09-19T06:13:20.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.280+0000 7fa975477740 1 -- start start 2024-09-19T06:13:20.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.280+0000 7fa975477740 1 Processor -- start 2024-09-19T06:13:20.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.281+0000 7fa975477740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56495f609e40 0x56495f611ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:20.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.281+0000 7fa975477740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f60a760 0x56495f612400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:20.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.281+0000 7fa975477740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56495f615020 0x56495f612940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:20.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.281+0000 7fa975477740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56495f617bf0 con 0x56495f60a760 2024-09-19T06:13:20.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.281+0000 7fa975477740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56495f52b0f0 con 0x56495f609e40 2024-09-19T06:13:20.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.281+0000 7fa975477740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56495f617d70 con 0x56495f615020 2024-09-19T06:13:20.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.281+0000 7fa975477740 10 client.0 _ll_register_callbacks cb 0x56495f512bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:20.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.282+0000 7fa96aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f60a760 0x56495f612400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:20.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.282+0000 7fa96aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f60a760 0x56495f612400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57778/0 (socket says 172.21.15.3:57778) 2024-09-19T06:13:20.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.282+0000 7fa96aa00640 1 -- 172.21.15.3:0/3039909500 learned_addr learned my addr 172.21.15.3:0/3039909500 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:20.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.282+0000 7fa96be00640 1 --2- 172.21.15.3:0/3039909500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56495f615020 0x56495f612940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:20.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.282+0000 7fa96b400640 1 --2- 172.21.15.3:0/3039909500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56495f609e40 0x56495f611ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:20.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.282+0000 7fa96be00640 1 -- 172.21.15.3:0/3039909500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56495f609e40 msgr2=0x56495f611ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:20.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.282+0000 7fa96be00640 1 --2- 172.21.15.3:0/3039909500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56495f609e40 0x56495f611ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.282+0000 7fa96be00640 1 -- 172.21.15.3:0/3039909500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f60a760 msgr2=0x56495f612400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:20.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.282+0000 7fa96be00640 1 --2- 172.21.15.3:0/3039909500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f60a760 0x56495f612400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.282+0000 7fa96be00640 1 -- 172.21.15.3:0/3039909500 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56495f2e13c0 con 0x56495f615020 2024-09-19T06:13:20.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.282+0000 7fa96aa00640 1 --2- 172.21.15.3:0/3039909500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f60a760 0x56495f612400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:20.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.283+0000 7fa96be00640 1 --2- 172.21.15.3:0/3039909500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56495f615020 0x56495f612940 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa9640ee210 tx=0x7fa9640bc8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ba328747adeb3c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:20.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.283+0000 7fa955600640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:13:20.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.283+0000 7fa955600640 1 -- 172.21.15.3:0/3039909500 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9640c0070 con 0x56495f615020 2024-09-19T06:13:20.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.283+0000 7fa975477740 1 -- 172.21.15.3:0/3039909500 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa95c01cb00 con 0x56495f615020 2024-09-19T06:13:20.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.283+0000 7fa955600640 1 -- 172.21.15.3:0/3039909500 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fa9640c5780 con 0x56495f615020 2024-09-19T06:13:20.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.284+0000 7fa955600640 1 -- 172.21.15.3:0/3039909500 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa9640bcda0 con 0x56495f615020 2024-09-19T06:13:20.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.284+0000 7fa975477740 10 client.25483 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:20.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.284+0000 7fa975477740 1 -- 172.21.15.3:0/3039909500 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56495f617c40 con 0x56495f615020 2024-09-19T06:13:20.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.284+0000 7fa955600640 1 -- 172.21.15.3:0/3039909500 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa95c01cb00 con 0x56495f615020 2024-09-19T06:13:20.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.284+0000 7fa955600640 1 -- 172.21.15.3:0/3039909500 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa964004b40 con 0x56495f615020 2024-09-19T06:13:20.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.285+0000 7fa975477740 10 client.25483 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:20.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.285+0000 7fa975477740 10 client.25483 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:13:20.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.285+0000 7fa975477740 20 client.25483 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:20.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.285+0000 7fa975477740 1 --2- 172.21.15.3:0/3039909500 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56495f624fe0 0x56495f627480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:20.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.285+0000 7fa975477740 4 client.25483 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:13:20.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.285+0000 7fa975477740 1 -- 172.21.15.3:0/3039909500 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56495f57d950 con 0x56495f624fe0 2024-09-19T06:13:20.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.285+0000 7fa96b400640 1 --2- 172.21.15.3:0/3039909500 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56495f624fe0 0x56495f627480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:20.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.286+0000 7fa96b400640 1 --2- 172.21.15.3:0/3039909500 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56495f624fe0 0x56495f627480 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7c14bdadfb10a5d1 server_cookie=71e1a086605ef770 in_seq=0 out_seq=0 2024-09-19T06:13:20.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.286+0000 7fa955600640 10 client.25483 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:13:20.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.287+0000 7fa955600640 1 -- 172.21.15.3:0/3039909500 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56495f57d950 con 0x56495f624fe0 2024-09-19T06:13:20.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.287+0000 7fa955600640 10 client.25483 handle_command_reply: tid=0 2024-09-19T06:13:20.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.287+0000 7fa975477740 1 client.25483 shutdown 2024-09-19T06:13:20.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.287+0000 7fa975477740 1 -- 172.21.15.3:0/3039909500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56495f615020 msgr2=0x56495f612940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:20.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.287+0000 7fa975477740 1 --2- 172.21.15.3:0/3039909500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56495f615020 0x56495f612940 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa9640ee210 tx=0x7fa9640bc8e0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.287+0000 7fa975477740 1 -- 172.21.15.3:0/3039909500 shutdown_connections 2024-09-19T06:13:20.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.287+0000 7fa975477740 1 --2- 172.21.15.3:0/3039909500 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56495f624fe0 0x56495f627480 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.288+0000 7fa975477740 1 --2- 172.21.15.3:0/3039909500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56495f615020 0x56495f612940 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.288+0000 7fa975477740 1 --2- 172.21.15.3:0/3039909500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f60a760 0x56495f612400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.288+0000 7fa975477740 1 --2- 172.21.15.3:0/3039909500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56495f609e40 0x56495f611ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.288+0000 7fa975477740 1 -- 172.21.15.3:0/3039909500 >> 172.21.15.3:0/3039909500 conn(0x56495f6063d0 msgr2=0x56495f60c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:20.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.288+0000 7fa955600640 0 client.25483 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:13:20.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.288+0000 7fa975477740 1 -- 172.21.15.3:0/3039909500 shutdown_connections 2024-09-19T06:13:20.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.288+0000 7fa975477740 1 -- 172.21.15.3:0/3039909500 wait complete. 2024-09-19T06:13:20.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.288+0000 7fa975477740 20 client.25483 trim_cache size 0 max 16384 2024-09-19T06:13:20.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.315+0000 7fa975477740 1 Processor -- start 2024-09-19T06:13:20.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.316+0000 7fa975477740 1 -- start start 2024-09-19T06:13:20.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.316+0000 7fa975477740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56495f609e40 0x56495f62cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:20.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.316+0000 7fa975477740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56495f60a760 0x56495f62d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:20.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.316+0000 7fa975477740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f615020 0x56495f60f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:20.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.316+0000 7fa975477740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c1b3e80 con 0x56495f615020 2024-09-19T06:13:20.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.316+0000 7fa975477740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c1b59c0 con 0x56495f609e40 2024-09-19T06:13:20.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.316+0000 7fa975477740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c1b4550 con 0x56495f60a760 2024-09-19T06:13:20.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.317+0000 7fa96b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56495f609e40 0x56495f62cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:20.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.317+0000 7fa96aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56495f60a760 0x56495f62d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:20.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.317+0000 7fa96aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56495f60a760 0x56495f62d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:32876/0 (socket says 172.21.15.3:32876) 2024-09-19T06:13:20.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.317+0000 7fa96aa00640 1 -- 172.21.15.3:0/2505983882 learned_addr learned my addr 172.21.15.3:0/2505983882 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:20.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.317+0000 7fa96be00640 1 --2- 172.21.15.3:0/2505983882 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f615020 0x56495f60f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:20.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.317+0000 7fa96aa00640 1 -- 172.21.15.3:0/2505983882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56495f609e40 msgr2=0x56495f62cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:20.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.317+0000 7fa96aa00640 1 --2- 172.21.15.3:0/2505983882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56495f609e40 0x56495f62cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.317+0000 7fa96aa00640 1 -- 172.21.15.3:0/2505983882 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f615020 msgr2=0x56495f60f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:20.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.318+0000 7fa96aa00640 1 --2- 172.21.15.3:0/2505983882 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f615020 0x56495f60f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.318+0000 7fa96aa00640 1 -- 172.21.15.3:0/2505983882 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56495f606200 con 0x56495f60a760 2024-09-19T06:13:20.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.318+0000 7fa96be00640 1 --2- 172.21.15.3:0/2505983882 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f615020 0x56495f60f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:20.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.318+0000 7fa96aa00640 1 --2- 172.21.15.3:0/2505983882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56495f60a760 0x56495f62d290 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa9580099a0 tx=0x7fa9580046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53b8ed2754d12065 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:20.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.318+0000 7fa957e00640 1 -- 172.21.15.3:0/2505983882 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95801b070 con 0x56495f60a760 2024-09-19T06:13:20.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.319+0000 7fa957e00640 1 -- 172.21.15.3:0/2505983882 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa95801c040 con 0x56495f60a760 2024-09-19T06:13:20.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.319+0000 7fa957e00640 1 -- 172.21.15.3:0/2505983882 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9580238e0 con 0x56495f60a760 2024-09-19T06:13:20.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.320+0000 7fa975477740 1 -- 172.21.15.3:0/2505983882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56495f60a760 msgr2=0x56495f62d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:20.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.320+0000 7fa975477740 1 --2- 172.21.15.3:0/2505983882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56495f60a760 0x56495f62d290 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa9580099a0 tx=0x7fa9580046c0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.320+0000 7fa975477740 1 -- 172.21.15.3:0/2505983882 shutdown_connections 2024-09-19T06:13:20.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.320+0000 7fa975477740 1 --2- 172.21.15.3:0/2505983882 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f615020 0x56495f60f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.320+0000 7fa975477740 1 --2- 172.21.15.3:0/2505983882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56495f60a760 0x56495f62d290 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.320+0000 7fa975477740 1 --2- 172.21.15.3:0/2505983882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56495f609e40 0x56495f62cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.320+0000 7fa975477740 1 -- 172.21.15.3:0/2505983882 >> 172.21.15.3:0/2505983882 conn(0x56495f6063d0 msgr2=0x56495f613f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:20.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.320+0000 7fa975477740 1 -- 172.21.15.3:0/2505983882 shutdown_connections 2024-09-19T06:13:20.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.320+0000 7fa975477740 1 -- 172.21.15.3:0/2505983882 wait complete. 2024-09-19T06:13:20.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.321+0000 7fa975477740 1 -- start start 2024-09-19T06:13:20.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.321+0000 7fa975477740 1 Processor -- start 2024-09-19T06:13:20.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.322+0000 7fa975477740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f609e40 0x56495f61d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:20.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.322+0000 7fa975477740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56495f60a760 0x56495f6189d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:20.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.322+0000 7fa975477740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56495f615020 0x56495f618f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:20.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.322+0000 7fa975477740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c1b52f0 con 0x56495f609e40 2024-09-19T06:13:20.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.322+0000 7fa975477740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c1b4c20 con 0x56495f615020 2024-09-19T06:13:20.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.322+0000 7fa975477740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c1b1e60 con 0x56495f60a760 2024-09-19T06:13:20.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.322+0000 7fa975477740 10 client.0 _ll_register_callbacks cb 0x7fa964031440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:20.325 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:20 smithi003 ceph-mon[30893]: pgmap v31: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-19T06:13:20.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.322+0000 7fa96b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f609e40 0x56495f61d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:20.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.323+0000 7fa96b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f609e40 0x56495f61d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57800/0 (socket says 172.21.15.3:57800) 2024-09-19T06:13:20.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.323+0000 7fa96b400640 1 -- 172.21.15.3:0/460123599 learned_addr learned my addr 172.21.15.3:0/460123599 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:20.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.323+0000 7fa96aa00640 1 --2- 172.21.15.3:0/460123599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56495f60a760 0x56495f6189d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:20.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.323+0000 7fa96be00640 1 --2- 172.21.15.3:0/460123599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56495f615020 0x56495f618f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:20.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.323+0000 7fa96b400640 1 -- 172.21.15.3:0/460123599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56495f60a760 msgr2=0x56495f6189d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:20.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.323+0000 7fa96b400640 1 --2- 172.21.15.3:0/460123599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56495f60a760 0x56495f6189d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.323+0000 7fa96b400640 1 -- 172.21.15.3:0/460123599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56495f615020 msgr2=0x56495f618f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:20.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.323+0000 7fa96b400640 1 --2- 172.21.15.3:0/460123599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56495f615020 0x56495f618f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.323+0000 7fa96b400640 1 -- 172.21.15.3:0/460123599 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56495f619710 con 0x56495f609e40 2024-09-19T06:13:20.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.323+0000 7fa96be00640 1 --2- 172.21.15.3:0/460123599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56495f615020 0x56495f618f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:20.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.324+0000 7fa96b400640 1 --2- 172.21.15.3:0/460123599 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f609e40 0x56495f61d6a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa95c009620 tx=0x7fa95c011800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b614394ffb2f4915 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:20.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.324+0000 7fa955600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:13:20.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.324+0000 7fa955600640 1 -- 172.21.15.3:0/460123599 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c004040 con 0x56495f609e40 2024-09-19T06:13:20.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.324+0000 7fa955600640 1 -- 172.21.15.3:0/460123599 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fa95c0041e0 con 0x56495f609e40 2024-09-19T06:13:20.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.324+0000 7fa975477740 1 -- 172.21.15.3:0/460123599 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa95801c040 con 0x56495f609e40 2024-09-19T06:13:20.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.325+0000 7fa955600640 1 -- 172.21.15.3:0/460123599 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa95c0043e0 con 0x56495f609e40 2024-09-19T06:13:20.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.325+0000 7fa975477740 10 client.15453 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:20.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.325+0000 7fa975477740 1 -- 172.21.15.3:0/460123599 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56495f68fc90 con 0x56495f609e40 2024-09-19T06:13:20.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.325+0000 7fa955600640 1 -- 172.21.15.3:0/460123599 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa95801c040 con 0x56495f609e40 2024-09-19T06:13:20.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.326+0000 7fa955600640 1 -- 172.21.15.3:0/460123599 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa95c005340 con 0x56495f609e40 2024-09-19T06:13:20.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.326+0000 7fa975477740 10 client.15453 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:20.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.326+0000 7fa975477740 10 client.15453 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:13:20.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.326+0000 7fa975477740 20 client.15453 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:20.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.326+0000 7fa975477740 1 --2- 172.21.15.3:0/460123599 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56495f690090 0x56495f692480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:20.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.326+0000 7fa975477740 4 client.15453 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:13:20.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.326+0000 7fa975477740 1 -- 172.21.15.3:0/460123599 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56495f577e60 con 0x56495f690090 2024-09-19T06:13:20.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.326+0000 7fa96aa00640 1 --2- 172.21.15.3:0/460123599 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56495f690090 0x56495f692480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:20.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.328+0000 7fa96aa00640 1 --2- 172.21.15.3:0/460123599 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56495f690090 0x56495f692480 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4dbc8f0f75b79f51 server_cookie=9818c2df22e31aaa in_seq=0 out_seq=0 2024-09-19T06:13:20.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.328+0000 7fa955600640 10 client.15453 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:13:20.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.329+0000 7fa955600640 1 -- 172.21.15.3:0/460123599 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56495f577e60 con 0x56495f690090 2024-09-19T06:13:20.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.329+0000 7fa955600640 10 client.15453 handle_command_reply: tid=0 2024-09-19T06:13:20.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.329+0000 7fa975477740 1 client.15453 shutdown 2024-09-19T06:13:20.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.329+0000 7fa975477740 1 -- 172.21.15.3:0/460123599 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f609e40 msgr2=0x56495f61d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:20.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.329+0000 7fa975477740 1 --2- 172.21.15.3:0/460123599 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f609e40 0x56495f61d6a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa95c009620 tx=0x7fa95c011800 comp rx=0 tx=0).stop 2024-09-19T06:13:20.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.329+0000 7fa975477740 1 -- 172.21.15.3:0/460123599 shutdown_connections 2024-09-19T06:13:20.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.329+0000 7fa975477740 1 --2- 172.21.15.3:0/460123599 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56495f690090 0x56495f692480 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.329+0000 7fa975477740 1 --2- 172.21.15.3:0/460123599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56495f615020 0x56495f618f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.329+0000 7fa975477740 1 --2- 172.21.15.3:0/460123599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56495f60a760 0x56495f6189d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.329+0000 7fa975477740 1 --2- 172.21.15.3:0/460123599 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56495f609e40 0x56495f61d6a0 secure :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa95c009620 tx=0x7fa95c011800 comp rx=0 tx=0).stop 2024-09-19T06:13:20.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.329+0000 7fa975477740 1 -- 172.21.15.3:0/460123599 >> 172.21.15.3:0/460123599 conn(0x56495f6063d0 msgr2=0x56495f605490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:20.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.330+0000 7fa955600640 0 client.15453 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:13:20.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.330+0000 7fa975477740 1 -- 172.21.15.3:0/460123599 shutdown_connections 2024-09-19T06:13:20.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.330+0000 7fa975477740 1 -- 172.21.15.3:0/460123599 wait complete. 2024-09-19T06:13:20.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.331+0000 7fa975477740 20 client.15453 trim_cache size 0 max 16384 2024-09-19T06:13:20.332 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:13:20.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.331+0000 7fa971200640 1 -- 172.21.15.3:0/1451768501 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa9500a3550 msgr2=0x7fa9500a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:20.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.331+0000 7fa971200640 1 --2- 172.21.15.3:0/1451768501 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa9500a3550 0x7fa9500a5a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x56495f607750 tx=0x7fa958005f90 comp rx=0 tx=0).stop 2024-09-19T06:13:20.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.331+0000 7fa971200640 1 -- 172.21.15.3:0/1451768501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa96c1079d0 msgr2=0x7fa96c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:20.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.331+0000 7fa971200640 1 --2- 172.21.15.3:0/1451768501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa96c1079d0 0x7fa96c074f70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa96402ac00 tx=0x7fa9640305d0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.332+0000 7fa971200640 1 -- 172.21.15.3:0/1451768501 shutdown_connections 2024-09-19T06:13:20.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.332+0000 7fa971200640 1 --2- 172.21.15.3:0/1451768501 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa9500a3550 0x7fa9500a5a10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.332+0000 7fa971200640 1 --2- 172.21.15.3:0/1451768501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa96c1079d0 0x7fa96c074f70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.332+0000 7fa971200640 1 --2- 172.21.15.3:0/1451768501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa96c102370 0x7fa96c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.332+0000 7fa971200640 1 --2- 172.21.15.3:0/1451768501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa96c1019d0 0x7fa96c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:20.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.332+0000 7fa971200640 1 -- 172.21.15.3:0/1451768501 >> 172.21.15.3:0/1451768501 conn(0x7fa96c0fd710 msgr2=0x7fa96c0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:20.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.332+0000 7fa971200640 1 -- 172.21.15.3:0/1451768501 shutdown_connections 2024-09-19T06:13:20.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:20.333+0000 7fa971200640 1 -- 172.21.15.3:0/1451768501 wait complete. 2024-09-19T06:13:20.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:20 smithi059 ceph-mon[35138]: pgmap v31: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-19T06:13:20.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:20 smithi071 ceph-mon[35662]: pgmap v31: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-19T06:13:21.207 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:13:21.732 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:22.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.470+0000 7ff5bb200640 1 -- 172.21.15.3:0/1069672027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5bc1079c0 msgr2=0x7ff5bc107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:22.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.470+0000 7ff5bb200640 1 --2- 172.21.15.3:0/1069672027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5bc1079c0 0x7ff5bc107da0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac009930 tx=0x7ff5ac02a420 comp rx=0 tx=0).stop 2024-09-19T06:13:22.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.470+0000 7ff5bb200640 1 -- 172.21.15.3:0/1069672027 shutdown_connections 2024-09-19T06:13:22.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.470+0000 7ff5bb200640 1 --2- 172.21.15.3:0/1069672027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5bc102360 0x7ff5bc10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.470+0000 7ff5bb200640 1 --2- 172.21.15.3:0/1069672027 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff5bc1019c0 0x7ff5bc101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.470+0000 7ff5bb200640 1 --2- 172.21.15.3:0/1069672027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5bc1079c0 0x7ff5bc107da0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.470+0000 7ff5bb200640 1 -- 172.21.15.3:0/1069672027 >> 172.21.15.3:0/1069672027 conn(0x7ff5bc0fd740 msgr2=0x7ff5bc0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:22.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.470+0000 7ff5bb200640 1 -- 172.21.15.3:0/1069672027 shutdown_connections 2024-09-19T06:13:22.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.470+0000 7ff5bb200640 1 -- 172.21.15.3:0/1069672027 wait complete. 2024-09-19T06:13:22.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.472+0000 7ff5bb200640 1 Processor -- start 2024-09-19T06:13:22.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.472+0000 7ff5bb200640 1 -- start start 2024-09-19T06:13:22.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.473+0000 7ff5bb200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff5bc1019c0 0x7ff5bc0739d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:22.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.473+0000 7ff5bb200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5bc102360 0x7ff5bc06ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:22.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.473+0000 7ff5bb200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5bc1079c0 0x7ff5bc06cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:22.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.473+0000 7ff5b9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5bc102360 0x7ff5bc06ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:22.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.473+0000 7ff5b9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5bc102360 0x7ff5bc06ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44510/0 (socket says 172.21.15.3:44510) 2024-09-19T06:13:22.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.473+0000 7ff5b9400640 1 -- 172.21.15.3:0/2872330936 learned_addr learned my addr 172.21.15.3:0/2872330936 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:22.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.474+0000 7ff5b9e00640 1 --2- 172.21.15.3:0/2872330936 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff5bc1019c0 0x7ff5bc0739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:22.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.474+0000 7ff5ba800640 1 --2- 172.21.15.3:0/2872330936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5bc1079c0 0x7ff5bc06cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:22.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.474+0000 7ff5bb200640 1 -- 172.21.15.3:0/2872330936 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc111dd0 con 0x7ff5bc1019c0 2024-09-19T06:13:22.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.474+0000 7ff5bb200640 1 -- 172.21.15.3:0/2872330936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc111c50 con 0x7ff5bc102360 2024-09-19T06:13:22.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.474+0000 7ff5bb200640 1 -- 172.21.15.3:0/2872330936 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc111f50 con 0x7ff5bc1079c0 2024-09-19T06:13:22.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.475+0000 7ff5ba800640 1 -- 172.21.15.3:0/2872330936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5bc102360 msgr2=0x7ff5bc06ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:22.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.475+0000 7ff5ba800640 1 --2- 172.21.15.3:0/2872330936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5bc102360 0x7ff5bc06ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.475+0000 7ff5ba800640 1 -- 172.21.15.3:0/2872330936 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff5bc1019c0 msgr2=0x7ff5bc0739d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:22.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.475+0000 7ff5ba800640 1 --2- 172.21.15.3:0/2872330936 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff5bc1019c0 0x7ff5bc0739d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.475+0000 7ff5ba800640 1 -- 172.21.15.3:0/2872330936 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5bc06d530 con 0x7ff5bc1079c0 2024-09-19T06:13:22.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.475+0000 7ff5b9e00640 1 --2- 172.21.15.3:0/2872330936 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff5bc1019c0 0x7ff5bc0739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:22.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.475+0000 7ff5b9400640 1 --2- 172.21.15.3:0/2872330936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5bc102360 0x7ff5bc06ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:13:22.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.475+0000 7ff5ba800640 1 --2- 172.21.15.3:0/2872330936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5bc1079c0 0x7ff5bc06cfa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009fd0 tx=0x7ff5b400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:22.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.476+0000 7ff5b2a00640 1 -- 172.21.15.3:0/2872330936 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4004b20 con 0x7ff5bc1079c0 2024-09-19T06:13:22.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.476+0000 7ff5b2a00640 1 -- 172.21.15.3:0/2872330936 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5b4018a00 con 0x7ff5bc1079c0 2024-09-19T06:13:22.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.476+0000 7ff5b2a00640 1 -- 172.21.15.3:0/2872330936 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b401abd0 con 0x7ff5bc1079c0 2024-09-19T06:13:22.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.476+0000 7ff5bb200640 1 -- 172.21.15.3:0/2872330936 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5bc06d820 con 0x7ff5bc1079c0 2024-09-19T06:13:22.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.476+0000 7ff5bb200640 1 -- 172.21.15.3:0/2872330936 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5bc0717c0 con 0x7ff5bc1079c0 2024-09-19T06:13:22.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.481+0000 7ff5b2a00640 1 -- 172.21.15.3:0/2872330936 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) ==== 138587+0+0 (secure 0 0 0) 0x7ff5b4021020 con 0x7ff5bc1079c0 2024-09-19T06:13:22.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.481+0000 7ff5c3670740 1 Processor -- start 2024-09-19T06:13:22.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.481+0000 7ff5c3670740 1 -- start start 2024-09-19T06:13:22.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.482+0000 7ff5c3670740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e87c2fae40 0x55e87c2fb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:22.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.482+0000 7ff5c3670740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e87c2fb760 0x55e87c305ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:22.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.482+0000 7ff5c3670740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c306020 0x55e87c308410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:22.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.483+0000 7ff5b9400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e87c2fae40 0x55e87c2fb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:22.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.483+0000 7ff5b9400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e87c2fae40 0x55e87c2fb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57820/0 (socket says 172.21.15.3:57820) 2024-09-19T06:13:22.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.483+0000 7ff5b9400640 1 -- 172.21.15.3:0/3872514596 learned_addr learned my addr 172.21.15.3:0/3872514596 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:22.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.483+0000 7ff5b9e00640 1 --2- 172.21.15.3:0/3872514596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e87c2fb760 0x55e87c305ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:22.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.483+0000 7ff5c3670740 1 -- 172.21.15.3:0/3872514596 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e87c2613e0 con 0x55e87c2fae40 2024-09-19T06:13:22.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.483+0000 7ff5c3670740 1 -- 172.21.15.3:0/3872514596 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e87c208d80 con 0x55e87c306020 2024-09-19T06:13:22.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.483+0000 7ff5c3670740 1 -- 172.21.15.3:0/3872514596 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e87c25d3a0 con 0x55e87c2fb760 2024-09-19T06:13:22.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.483+0000 7ff5b9400640 1 --2- 172.21.15.3:0/3872514596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c306020 0x55e87c308410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:22.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.484+0000 7ff5b2a00640 1 --2- 172.21.15.3:0/2872330936 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff5a00a3550 0x7ff5a00a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:22.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.484+0000 7ff5b2a00640 1 -- 172.21.15.3:0/2872330936 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7ff5b40d3e40 con 0x7ff5bc1079c0 2024-09-19T06:13:22.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.484+0000 7ff5b9400640 1 -- 172.21.15.3:0/3872514596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e87c2fb760 msgr2=0x55e87c305ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:22.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.484+0000 7ff5b9400640 1 --2- 172.21.15.3:0/3872514596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e87c2fb760 0x55e87c305ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.484+0000 7ff5b9400640 1 -- 172.21.15.3:0/3872514596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e87c2fae40 msgr2=0x55e87c2fb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:22.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.484+0000 7ff5b9400640 1 --2- 172.21.15.3:0/3872514596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e87c2fae40 0x55e87c2fb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.484+0000 7ff5b9400640 1 -- 172.21.15.3:0/3872514596 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e87c227ae0 con 0x55e87c306020 2024-09-19T06:13:22.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.485+0000 7ff5ba800640 1 --2- 172.21.15.3:0/2872330936 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff5a00a3550 0x7ff5a00a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:22.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.485+0000 7ff5b9400640 1 --2- 172.21.15.3:0/3872514596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c306020 0x55e87c308410 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8013750 tx=0x7ff5a8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86dd14401d46f061 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:22.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.486+0000 7ff5a7000640 1 -- 172.21.15.3:0/3872514596 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a80130d0 con 0x55e87c306020 2024-09-19T06:13:22.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.486+0000 7ff5a7000640 1 -- 172.21.15.3:0/3872514596 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5a8005500 con 0x55e87c306020 2024-09-19T06:13:22.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.486+0000 7ff5a7000640 1 -- 172.21.15.3:0/3872514596 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a800c7d0 con 0x55e87c306020 2024-09-19T06:13:22.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.486+0000 7ff5ba800640 1 --2- 172.21.15.3:0/2872330936 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff5a00a3550 0x7ff5a00a5a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40d1410 tx=0x7ff5b4005f70 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:22.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.487+0000 7ff5c3670740 1 -- 172.21.15.3:0/3872514596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c306020 msgr2=0x55e87c308410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:22.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.487+0000 7ff5c3670740 1 --2- 172.21.15.3:0/3872514596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c306020 0x55e87c308410 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8013750 tx=0x7ff5a8004730 comp rx=0 tx=0).stop 2024-09-19T06:13:22.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.487+0000 7ff5c3670740 1 -- 172.21.15.3:0/3872514596 shutdown_connections 2024-09-19T06:13:22.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.487+0000 7ff5c3670740 1 --2- 172.21.15.3:0/3872514596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c306020 0x55e87c308410 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.487+0000 7ff5c3670740 1 --2- 172.21.15.3:0/3872514596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e87c2fb760 0x55e87c305ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.487+0000 7ff5c3670740 1 --2- 172.21.15.3:0/3872514596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e87c2fae40 0x55e87c2fb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.487+0000 7ff5c3670740 1 -- 172.21.15.3:0/3872514596 >> 172.21.15.3:0/3872514596 conn(0x55e87c2f73d0 msgr2=0x55e87c2f77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:22.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.488+0000 7ff5c3670740 1 -- 172.21.15.3:0/3872514596 shutdown_connections 2024-09-19T06:13:22.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.488+0000 7ff5c3670740 1 -- 172.21.15.3:0/3872514596 wait complete. 2024-09-19T06:13:22.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.488+0000 7ff5c3670740 1 -- start start 2024-09-19T06:13:22.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.489+0000 7ff5c3670740 1 Processor -- start 2024-09-19T06:13:22.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.489+0000 7ff5c3670740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e87c2fae40 0x55e87c302f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:22.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.489+0000 7ff5c3670740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c2fb760 0x55e87c3034b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:22.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.489+0000 7ff5c3670740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e87c306020 0x55e87c3039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:22.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.489+0000 7ff5c3670740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e87c308bf0 con 0x55e87c306020 2024-09-19T06:13:22.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.489+0000 7ff5c3670740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e87c21c0f0 con 0x55e87c2fb760 2024-09-19T06:13:22.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.489+0000 7ff5c3670740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e87c308d70 con 0x55e87c2fae40 2024-09-19T06:13:22.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.490+0000 7ff5c3670740 10 client.0 _ll_register_callbacks cb 0x55e87c203bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:22.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.490+0000 7ff5b9400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e87c2fae40 0x55e87c302f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:22.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.490+0000 7ff5b9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c2fb760 0x55e87c3034b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:22.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.490+0000 7ff5b9400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e87c2fae40 0x55e87c302f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:32896/0 (socket says 172.21.15.3:32896) 2024-09-19T06:13:22.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.490+0000 7ff5b9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c2fb760 0x55e87c3034b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44530/0 (socket says 172.21.15.3:44530) 2024-09-19T06:13:22.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.490+0000 7ff5b9400640 1 -- 172.21.15.3:0/2132725377 learned_addr learned my addr 172.21.15.3:0/2132725377 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:22.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.490+0000 7ff5b9400640 1 --2- 172.21.15.3:0/2132725377 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e87c306020 0x55e87c3039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:22.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.490+0000 7ff5b9e00640 1 -- 172.21.15.3:0/2132725377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e87c2fae40 msgr2=0x55e87c302f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:22.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.490+0000 7ff5b9e00640 1 --2- 172.21.15.3:0/2132725377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e87c2fae40 0x55e87c302f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.490+0000 7ff5b9e00640 1 -- 172.21.15.3:0/2132725377 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e87c306020 msgr2=0x55e87c3039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:22.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.490+0000 7ff5b9e00640 1 --2- 172.21.15.3:0/2132725377 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e87c306020 0x55e87c3039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.490+0000 7ff5b9e00640 1 -- 172.21.15.3:0/2132725377 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e87bfd23c0 con 0x55e87c2fb760 2024-09-19T06:13:22.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.490+0000 7ff5b9400640 1 --2- 172.21.15.3:0/2132725377 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e87c306020 0x55e87c3039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:13:22.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.491+0000 7ff5b9e00640 1 --2- 172.21.15.3:0/2132725377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c2fb760 0x55e87c3034b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac009230 tx=0x7ff5ac005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a360283b6e8aff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:22.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.491+0000 7ff59b400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:13:22.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.491+0000 7ff59b400640 1 -- 172.21.15.3:0/2132725377 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac035040 con 0x55e87c2fb760 2024-09-19T06:13:22.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.491+0000 7ff5c3670740 1 -- 172.21.15.3:0/2132725377 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5a8005500 con 0x55e87c2fb760 2024-09-19T06:13:22.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.491+0000 7ff59b400640 1 -- 172.21.15.3:0/2132725377 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7ff5ac004760 con 0x55e87c2fb760 2024-09-19T06:13:22.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.492+0000 7ff59b400640 1 -- 172.21.15.3:0/2132725377 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff5ac004960 con 0x55e87c2fb760 2024-09-19T06:13:22.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.492+0000 7ff5c3670740 10 client.25499 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:22.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.492+0000 7ff5c3670740 1 -- 172.21.15.3:0/2132725377 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e87c31d4a0 con 0x55e87c2fb760 2024-09-19T06:13:22.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.492+0000 7ff59b400640 1 -- 172.21.15.3:0/2132725377 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5a8005500 con 0x55e87c2fb760 2024-09-19T06:13:22.496 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:22 smithi003 ceph-mon[30893]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.7 KiB/s wr, 16 op/s 2024-09-19T06:13:22.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.493+0000 7ff59b400640 1 -- 172.21.15.3:0/2132725377 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff5ac0035f0 con 0x55e87c2fb760 2024-09-19T06:13:22.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.493+0000 7ff5c3670740 10 client.25499 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:22.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.493+0000 7ff5c3670740 10 client.25499 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:13:22.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.493+0000 7ff5c3670740 20 client.25499 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:22.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.493+0000 7ff5c3670740 1 --2- 172.21.15.3:0/2132725377 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e87c31e8b0 0x55e87c320ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:22.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.493+0000 7ff5c3670740 4 client.25499 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:13:22.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.493+0000 7ff5c3670740 1 -- 172.21.15.3:0/2132725377 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e87c26e950 con 0x55e87c31e8b0 2024-09-19T06:13:22.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.494+0000 7ff5b9400640 1 --2- 172.21.15.3:0/2132725377 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e87c31e8b0 0x55e87c320ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:22.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.495+0000 7ff5b9400640 1 --2- 172.21.15.3:0/2132725377 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e87c31e8b0 0x55e87c320ce0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9915e5067488eff3 server_cookie=190ca4f436112786 in_seq=0 out_seq=0 2024-09-19T06:13:22.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.495+0000 7ff59b400640 10 client.25499 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:22.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.496+0000 7ff59b400640 1 -- 172.21.15.3:0/2132725377 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e87c26e950 con 0x55e87c31e8b0 2024-09-19T06:13:22.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.496+0000 7ff59b400640 10 client.25499 handle_command_reply: tid=0 2024-09-19T06:13:22.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.496+0000 7ff5c3670740 1 client.25499 shutdown 2024-09-19T06:13:22.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.496+0000 7ff5c3670740 1 -- 172.21.15.3:0/2132725377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c2fb760 msgr2=0x55e87c3034b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:22.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.496+0000 7ff5c3670740 1 --2- 172.21.15.3:0/2132725377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c2fb760 0x55e87c3034b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac009230 tx=0x7ff5ac005040 comp rx=0 tx=0).stop 2024-09-19T06:13:22.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.497+0000 7ff5c3670740 1 -- 172.21.15.3:0/2132725377 shutdown_connections 2024-09-19T06:13:22.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.497+0000 7ff5c3670740 1 --2- 172.21.15.3:0/2132725377 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e87c31e8b0 0x55e87c320ce0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.497+0000 7ff5c3670740 1 --2- 172.21.15.3:0/2132725377 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e87c306020 0x55e87c3039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.497+0000 7ff5c3670740 1 --2- 172.21.15.3:0/2132725377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c2fb760 0x55e87c3034b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.497+0000 7ff5c3670740 1 --2- 172.21.15.3:0/2132725377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e87c2fae40 0x55e87c302f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.497+0000 7ff5c3670740 1 -- 172.21.15.3:0/2132725377 >> 172.21.15.3:0/2132725377 conn(0x55e87c2f73d0 msgr2=0x55e87c2fd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:22.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.497+0000 7ff59b400640 0 client.25499 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:22.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.498+0000 7ff5c3670740 1 -- 172.21.15.3:0/2132725377 shutdown_connections 2024-09-19T06:13:22.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.498+0000 7ff5c3670740 1 -- 172.21.15.3:0/2132725377 wait complete. 2024-09-19T06:13:22.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.498+0000 7ff5c3670740 20 client.25499 trim_cache size 0 max 16384 2024-09-19T06:13:22.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.520+0000 7ff5c3670740 1 Processor -- start 2024-09-19T06:13:22.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.521+0000 7ff5c3670740 1 -- start start 2024-09-19T06:13:22.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.521+0000 7ff5c3670740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c2fae40 0x55e87c3208c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:22.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.522+0000 7ff5c3670740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e87c2fb760 0x55e87c3265b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:22.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.522+0000 7ff5c3670740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e87c306020 0x55e87c326af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:22.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.522+0000 7ff5c3670740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1b3d30 con 0x55e87c2fb760 2024-09-19T06:13:22.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.522+0000 7ff5c3670740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1b5870 con 0x55e87c2fae40 2024-09-19T06:13:22.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.522+0000 7ff5c3670740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1b4400 con 0x55e87c306020 2024-09-19T06:13:22.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.522+0000 7ff5b9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c2fae40 0x55e87c3208c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:22.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.522+0000 7ff5b9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c2fae40 0x55e87c3208c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44532/0 (socket says 172.21.15.3:44532) 2024-09-19T06:13:22.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.522+0000 7ff5b9400640 1 -- 172.21.15.3:0/2379362014 learned_addr learned my addr 172.21.15.3:0/2379362014 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:22.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.522+0000 7ff5b9400640 1 --2- 172.21.15.3:0/2379362014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e87c306020 0x55e87c326af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:22.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.523+0000 7ff5b9e00640 1 --2- 172.21.15.3:0/2379362014 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e87c2fb760 0x55e87c3265b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:22.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.524+0000 7ff5b9400640 1 -- 172.21.15.3:0/2379362014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e87c306020 msgr2=0x55e87c326af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:22.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.524+0000 7ff5b9400640 1 --2- 172.21.15.3:0/2379362014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e87c306020 0x55e87c326af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.524+0000 7ff5b9400640 1 -- 172.21.15.3:0/2379362014 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e87c2fb760 msgr2=0x55e87c3265b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:22.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.525+0000 7ff5b9400640 1 --2- 172.21.15.3:0/2379362014 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e87c2fb760 0x55e87c3265b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.525+0000 7ff5b9400640 1 -- 172.21.15.3:0/2379362014 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e87c3058e0 con 0x55e87c2fae40 2024-09-19T06:13:22.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.526+0000 7ff5b9e00640 1 --2- 172.21.15.3:0/2379362014 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e87c2fb760 0x55e87c3265b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:22.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.526+0000 7ff5b9400640 1 --2- 172.21.15.3:0/2379362014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c2fae40 0x55e87c3208c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8013750 tx=0x7ff5a8009d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=788f55ddb2613015 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:22.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.527+0000 7ff5a6600640 1 -- 172.21.15.3:0/2379362014 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a8013220 con 0x55e87c2fae40 2024-09-19T06:13:22.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.527+0000 7ff5a6600640 1 -- 172.21.15.3:0/2379362014 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5a8035020 con 0x55e87c2fae40 2024-09-19T06:13:22.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.527+0000 7ff5a6600640 1 -- 172.21.15.3:0/2379362014 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a800cc60 con 0x55e87c2fae40 2024-09-19T06:13:22.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.528+0000 7ff5c3670740 1 -- 172.21.15.3:0/2379362014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c2fae40 msgr2=0x55e87c3208c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:22.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.528+0000 7ff5c3670740 1 --2- 172.21.15.3:0/2379362014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c2fae40 0x55e87c3208c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8013750 tx=0x7ff5a8009d70 comp rx=0 tx=0).stop 2024-09-19T06:13:22.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.528+0000 7ff5c3670740 1 -- 172.21.15.3:0/2379362014 shutdown_connections 2024-09-19T06:13:22.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.528+0000 7ff5c3670740 1 --2- 172.21.15.3:0/2379362014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e87c306020 0x55e87c326af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.528+0000 7ff5c3670740 1 --2- 172.21.15.3:0/2379362014 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e87c2fb760 0x55e87c3265b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.528+0000 7ff5c3670740 1 --2- 172.21.15.3:0/2379362014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c2fae40 0x55e87c3208c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.528+0000 7ff5c3670740 1 -- 172.21.15.3:0/2379362014 >> 172.21.15.3:0/2379362014 conn(0x55e87c2f73d0 msgr2=0x55e87c304ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:22.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.529+0000 7ff5c3670740 1 -- 172.21.15.3:0/2379362014 shutdown_connections 2024-09-19T06:13:22.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.529+0000 7ff5c3670740 1 -- 172.21.15.3:0/2379362014 wait complete. 2024-09-19T06:13:22.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.530+0000 7ff5c3670740 1 -- start start 2024-09-19T06:13:22.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.530+0000 7ff5c3670740 1 Processor -- start 2024-09-19T06:13:22.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.531+0000 7ff5c3670740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e87c2fae40 0x55e87c30e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:22.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.531+0000 7ff5c3670740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e87c2fb760 0x55e87c309b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:22.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.531+0000 7ff5c3670740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c306020 0x55e87c30a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:22.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.531+0000 7ff5c3670740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1b51a0 con 0x55e87c2fb760 2024-09-19T06:13:22.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.531+0000 7ff5c3670740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1b4ad0 con 0x55e87c306020 2024-09-19T06:13:22.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.531+0000 7ff5c3670740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff5bc1b1d10 con 0x55e87c2fae40 2024-09-19T06:13:22.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.531+0000 7ff5c3670740 10 client.0 _ll_register_callbacks cb 0x7ff5ac009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:22.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.531+0000 7ff5b9400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e87c2fae40 0x55e87c30e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:22.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.531+0000 7ff5b9400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e87c2fae40 0x55e87c30e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:32906/0 (socket says 172.21.15.3:32906) 2024-09-19T06:13:22.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.531+0000 7ff5b9400640 1 -- 172.21.15.3:0/4070414850 learned_addr learned my addr 172.21.15.3:0/4070414850 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:22.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.531+0000 7ff5b9400640 1 --2- 172.21.15.3:0/4070414850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c306020 0x55e87c30a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:22.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.531+0000 7ff5b9e00640 1 --2- 172.21.15.3:0/4070414850 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e87c2fb760 0x55e87c309b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:22.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.532+0000 7ff5b9400640 1 -- 172.21.15.3:0/4070414850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c306020 msgr2=0x55e87c30a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:22.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.532+0000 7ff5b9400640 1 --2- 172.21.15.3:0/4070414850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c306020 0x55e87c30a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.532+0000 7ff5b9400640 1 -- 172.21.15.3:0/4070414850 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e87c2fb760 msgr2=0x55e87c309b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:22.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.532+0000 7ff5b9400640 1 --2- 172.21.15.3:0/4070414850 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e87c2fb760 0x55e87c309b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.532+0000 7ff5b9400640 1 -- 172.21.15.3:0/4070414850 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e87c30a8e0 con 0x55e87c2fae40 2024-09-19T06:13:22.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.532+0000 7ff5b9e00640 1 --2- 172.21.15.3:0/4070414850 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e87c2fb760 0x55e87c309b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:13:22.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.532+0000 7ff5b9400640 1 --2- 172.21.15.3:0/4070414850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e87c2fae40 0x55e87c30e7b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff5a80059f0 tx=0x7ff5a800ca40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=781f7084cfac58e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:22.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.532+0000 7ff59b400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:13:22.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.533+0000 7ff59b400640 1 -- 172.21.15.3:0/4070414850 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a8013220 con 0x55e87c2fae40 2024-09-19T06:13:22.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.533+0000 7ff59b400640 1 -- 172.21.15.3:0/4070414850 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7ff5a802fe80 con 0x55e87c2fae40 2024-09-19T06:13:22.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:22 smithi059 ceph-mon[35138]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.7 KiB/s wr, 16 op/s 2024-09-19T06:13:22.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.533+0000 7ff5c3670740 1 -- 172.21.15.3:0/4070414850 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5a8035020 con 0x55e87c2fae40 2024-09-19T06:13:22.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.533+0000 7ff59b400640 1 -- 172.21.15.3:0/4070414850 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff5a800cbe0 con 0x55e87c2fae40 2024-09-19T06:13:22.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.533+0000 7ff5c3670740 10 client.25507 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:22.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.533+0000 7ff5c3670740 1 -- 172.21.15.3:0/4070414850 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e87c389620 con 0x55e87c2fae40 2024-09-19T06:13:22.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.534+0000 7ff59b400640 1 -- 172.21.15.3:0/4070414850 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5a8035020 con 0x55e87c2fae40 2024-09-19T06:13:22.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.534+0000 7ff59b400640 1 -- 172.21.15.3:0/4070414850 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff5a803c040 con 0x55e87c2fae40 2024-09-19T06:13:22.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.534+0000 7ff5c3670740 10 client.25507 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:22.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.534+0000 7ff5c3670740 10 client.25507 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:13:22.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.534+0000 7ff5c3670740 20 client.25507 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:22.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.534+0000 7ff5c3670740 1 --2- 172.21.15.3:0/4070414850 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e87c389a00 0x55e87c38bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:22.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.534+0000 7ff5c3670740 4 client.25507 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:13:22.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.534+0000 7ff5c3670740 1 -- 172.21.15.3:0/4070414850 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e87c268e60 con 0x55e87c389a00 2024-09-19T06:13:22.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.534+0000 7ff5b9e00640 1 --2- 172.21.15.3:0/4070414850 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e87c389a00 0x55e87c38bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:22.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.535+0000 7ff59b400640 10 client.25507 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:22.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.535+0000 7ff5b9e00640 1 --2- 172.21.15.3:0/4070414850 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e87c389a00 0x55e87c38bdf0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b25bab12770caefd server_cookie=d89cdd456295f545 in_seq=0 out_seq=0 2024-09-19T06:13:22.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.536+0000 7ff59b400640 1 -- 172.21.15.3:0/4070414850 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e87c268e60 con 0x55e87c389a00 2024-09-19T06:13:22.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.536+0000 7ff59b400640 10 client.25507 handle_command_reply: tid=0 2024-09-19T06:13:22.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.536+0000 7ff5c3670740 1 client.25507 shutdown 2024-09-19T06:13:22.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.536+0000 7ff5c3670740 1 -- 172.21.15.3:0/4070414850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e87c2fae40 msgr2=0x55e87c30e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:22.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.536+0000 7ff5c3670740 1 --2- 172.21.15.3:0/4070414850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e87c2fae40 0x55e87c30e7b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff5a80059f0 tx=0x7ff5a800ca40 comp rx=0 tx=0).stop 2024-09-19T06:13:22.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.536+0000 7ff5c3670740 1 -- 172.21.15.3:0/4070414850 shutdown_connections 2024-09-19T06:13:22.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.536+0000 7ff5c3670740 1 --2- 172.21.15.3:0/4070414850 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e87c389a00 0x55e87c38bdf0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.536+0000 7ff5c3670740 1 --2- 172.21.15.3:0/4070414850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e87c306020 0x55e87c30a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.536+0000 7ff5c3670740 1 --2- 172.21.15.3:0/4070414850 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e87c2fb760 0x55e87c309b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.536+0000 7ff5c3670740 1 --2- 172.21.15.3:0/4070414850 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e87c2fae40 0x55e87c30e7b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.536+0000 7ff5c3670740 1 -- 172.21.15.3:0/4070414850 >> 172.21.15.3:0/4070414850 conn(0x55e87c2f73d0 msgr2=0x55e87c3047d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:22.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.536+0000 7ff59b400640 0 client.25507 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:22.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.536+0000 7ff5c3670740 1 -- 172.21.15.3:0/4070414850 shutdown_connections 2024-09-19T06:13:22.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.537+0000 7ff5c3670740 1 -- 172.21.15.3:0/4070414850 wait complete. 2024-09-19T06:13:22.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.537+0000 7ff5c3670740 20 client.25507 trim_cache size 0 max 16384 2024-09-19T06:13:22.542 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:13:22.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.538+0000 7ff5bb200640 1 -- 172.21.15.3:0/2872330936 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff5a00a3550 msgr2=0x7ff5a00a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:22.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.538+0000 7ff5bb200640 1 --2- 172.21.15.3:0/2872330936 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff5a00a3550 0x7ff5a00a5a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40d1410 tx=0x7ff5b4005f70 comp rx=0 tx=0).stop 2024-09-19T06:13:22.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.538+0000 7ff5bb200640 1 -- 172.21.15.3:0/2872330936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5bc1079c0 msgr2=0x7ff5bc06cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:22.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.538+0000 7ff5bb200640 1 --2- 172.21.15.3:0/2872330936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5bc1079c0 0x7ff5bc06cfa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009fd0 tx=0x7ff5b400c6a0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.538+0000 7ff5bb200640 1 -- 172.21.15.3:0/2872330936 shutdown_connections 2024-09-19T06:13:22.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.538+0000 7ff5bb200640 1 --2- 172.21.15.3:0/2872330936 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff5a00a3550 0x7ff5a00a5a10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.538+0000 7ff5bb200640 1 --2- 172.21.15.3:0/2872330936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5bc1079c0 0x7ff5bc06cfa0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.538+0000 7ff5bb200640 1 --2- 172.21.15.3:0/2872330936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff5bc102360 0x7ff5bc06ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.538+0000 7ff5bb200640 1 --2- 172.21.15.3:0/2872330936 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff5bc1019c0 0x7ff5bc0739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:22.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.538+0000 7ff5bb200640 1 -- 172.21.15.3:0/2872330936 >> 172.21.15.3:0/2872330936 conn(0x7ff5bc0fd740 msgr2=0x7ff5bc0fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:22.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.539+0000 7ff5bb200640 1 -- 172.21.15.3:0/2872330936 shutdown_connections 2024-09-19T06:13:22.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:22.539+0000 7ff5bb200640 1 -- 172.21.15.3:0/2872330936 wait complete. 2024-09-19T06:13:22.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:22 smithi071 ceph-mon[35662]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.7 KiB/s wr, 16 op/s 2024-09-19T06:13:24.431 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:13:24.432 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:13:24.515 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:24 smithi003 ceph-mon[30893]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.4 KiB/s wr, 10 op/s 2024-09-19T06:13:24.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:24 smithi059 ceph-mon[35138]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.4 KiB/s wr, 10 op/s 2024-09-19T06:13:24.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:24 smithi071 ceph-mon[35662]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.4 KiB/s wr, 10 op/s 2024-09-19T06:13:25.003 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:25.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.717+0000 7f8de2a00640 1 -- 172.21.15.3:0/267859315 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ddc074e30 msgr2=0x7f8ddc10dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:25.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.717+0000 7f8de2a00640 1 --2- 172.21.15.3:0/267859315 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ddc074e30 0x7f8ddc10dd40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8009900 tx=0x7f8dc802a480 comp rx=0 tx=0).stop 2024-09-19T06:13:25.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.717+0000 7f8de2a00640 1 -- 172.21.15.3:0/267859315 shutdown_connections 2024-09-19T06:13:25.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.717+0000 7f8de2a00640 1 --2- 172.21.15.3:0/267859315 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ddc10e280 0x7f8ddc110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.717+0000 7f8de2a00640 1 --2- 172.21.15.3:0/267859315 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ddc074e30 0x7f8ddc10dd40 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.717+0000 7f8de2a00640 1 --2- 172.21.15.3:0/267859315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ddc074510 0x7f8ddc0748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.717+0000 7f8de2a00640 1 -- 172.21.15.3:0/267859315 >> 172.21.15.3:0/267859315 conn(0x7f8ddc0fd740 msgr2=0x7f8ddc0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:25.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.718+0000 7f8de2a00640 1 -- 172.21.15.3:0/267859315 shutdown_connections 2024-09-19T06:13:25.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.718+0000 7f8de2a00640 1 -- 172.21.15.3:0/267859315 wait complete. 2024-09-19T06:13:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.719+0000 7f8de2a00640 1 Processor -- start 2024-09-19T06:13:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.719+0000 7f8de2a00640 1 -- start start 2024-09-19T06:13:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.719+0000 7f8de2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ddc074510 0x7f8ddc19a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.719+0000 7f8de2a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ddc074e30 0x7f8ddc19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.719+0000 7f8de2a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ddc10e280 0x7f8ddc19ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.719+0000 7f8de2a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc113fc0 con 0x7f8ddc10e280 2024-09-19T06:13:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.719+0000 7f8de2a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc113e40 con 0x7f8ddc074510 2024-09-19T06:13:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.719+0000 7f8de2a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc114140 con 0x7f8ddc074e30 2024-09-19T06:13:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.720+0000 7f8de0c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ddc074e30 0x7f8ddc19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.720+0000 7f8de0c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ddc074e30 0x7f8ddc19aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:35610/0 (socket says 172.21.15.3:35610) 2024-09-19T06:13:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.720+0000 7f8de1600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ddc074510 0x7f8ddc19a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.720+0000 7f8de0c00640 1 -- 172.21.15.3:0/3129877263 learned_addr learned my addr 172.21.15.3:0/3129877263 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:25.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.720+0000 7f8de2000640 1 --2- 172.21.15.3:0/3129877263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ddc10e280 0x7f8ddc19ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:25.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.720+0000 7f8de0c00640 1 -- 172.21.15.3:0/3129877263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ddc074510 msgr2=0x7f8ddc19a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:25.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.720+0000 7f8de0c00640 1 --2- 172.21.15.3:0/3129877263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ddc074510 0x7f8ddc19a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.720+0000 7f8de0c00640 1 -- 172.21.15.3:0/3129877263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ddc10e280 msgr2=0x7f8ddc19ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:25.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.720+0000 7f8de0c00640 1 --2- 172.21.15.3:0/3129877263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ddc10e280 0x7f8ddc19ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.720+0000 7f8de0c00640 1 -- 172.21.15.3:0/3129877263 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ddc19f4f0 con 0x7f8ddc074e30 2024-09-19T06:13:25.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.721+0000 7f8de0c00640 1 --2- 172.21.15.3:0/3129877263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ddc074e30 0x7f8ddc19aa80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8004770 tx=0x7f8dc8003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:25.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.721+0000 7f8dda000640 1 -- 172.21.15.3:0/3129877263 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc803f070 con 0x7f8ddc074e30 2024-09-19T06:13:25.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.721+0000 7f8de2a00640 1 -- 172.21.15.3:0/3129877263 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ddc19f780 con 0x7f8ddc074e30 2024-09-19T06:13:25.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.721+0000 7f8dda000640 1 -- 172.21.15.3:0/3129877263 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dc8031ca0 con 0x7f8ddc074e30 2024-09-19T06:13:25.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.721+0000 7f8dda000640 1 -- 172.21.15.3:0/3129877263 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8035030 con 0x7f8ddc074e30 2024-09-19T06:13:25.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.721+0000 7f8de2a00640 1 -- 172.21.15.3:0/3129877263 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ddc1a70c0 con 0x7f8ddc074e30 2024-09-19T06:13:25.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.726+0000 7f8de6a19740 1 Processor -- start 2024-09-19T06:13:25.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.726+0000 7f8de6a19740 1 -- start start 2024-09-19T06:13:25.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.727+0000 7f8dda000640 1 -- 172.21.15.3:0/3129877263 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 26) ==== 138587+0+0 (secure 0 0 0) 0x7f8dc8042070 con 0x7f8ddc074e30 2024-09-19T06:13:25.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.727+0000 7f8de6a19740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564df0e6ccb0 0x564df0e6d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:25.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.727+0000 7f8de6a19740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6d5d0 0x564df0e77950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:25.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.727+0000 7f8de6a19740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564df0e77e90 0x564df0e7a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:25.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.727+0000 7f8de6a19740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x564df0dd3290 con 0x564df0e77e90 2024-09-19T06:13:25.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.727+0000 7f8de6a19740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564df0d7ab40 con 0x564df0e6ccb0 2024-09-19T06:13:25.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.727+0000 7f8de6a19740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564df0dcf250 con 0x564df0e6d5d0 2024-09-19T06:13:25.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.728+0000 7f8de2000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564df0e6ccb0 0x564df0e6d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:25.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.728+0000 7f8de2000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564df0e6ccb0 0x564df0e6d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:41580/0 (socket says 172.21.15.3:41580) 2024-09-19T06:13:25.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.728+0000 7f8de2000640 1 -- 172.21.15.3:0/4186317091 learned_addr learned my addr 172.21.15.3:0/4186317091 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:25.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.728+0000 7f8de1600640 1 --2- 172.21.15.3:0/4186317091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6d5d0 0x564df0e77950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:25.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.729+0000 7f8de2000640 1 -- 172.21.15.3:0/4186317091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6d5d0 msgr2=0x564df0e77950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:25.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.729+0000 7f8de0c00640 1 --2- 172.21.15.3:0/4186317091 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564df0e77e90 0x564df0e7a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:25.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.729+0000 7f8dda000640 1 --2- 172.21.15.3:0/3129877263 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8dc40a35d0 0x7f8dc40a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:25.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.729+0000 7f8de2000640 1 --2- 172.21.15.3:0/4186317091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6d5d0 0x564df0e77950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.729+0000 7f8de2000640 1 -- 172.21.15.3:0/4186317091 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564df0e77e90 msgr2=0x564df0e7a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:25.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.729+0000 7f8de2000640 1 --2- 172.21.15.3:0/4186317091 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564df0e77e90 0x564df0e7a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.729+0000 7f8de2000640 1 -- 172.21.15.3:0/4186317091 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564df0b446a0 con 0x564df0e6ccb0 2024-09-19T06:13:25.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.729+0000 7f8dda000640 1 -- 172.21.15.3:0/3129877263 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f8dc80effe0 con 0x7f8ddc074e30 2024-09-19T06:13:25.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.729+0000 7f8de1600640 1 --2- 172.21.15.3:0/4186317091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6d5d0 0x564df0e77950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:13:25.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.729+0000 7f8de0c00640 1 --2- 172.21.15.3:0/4186317091 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564df0e77e90 0x564df0e7a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:13:25.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.730+0000 7f8de2000640 1 --2- 172.21.15.3:0/3129877263 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8dc40a35d0 0x7f8dc40a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:25.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.730+0000 7f8de2000640 1 --2- 172.21.15.3:0/4186317091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564df0e6ccb0 0x564df0e6d090 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009f30 tx=0x7f8dd40118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d123bad83cf43319 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:25.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.731+0000 7f8dce600640 1 -- 172.21.15.3:0/4186317091 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4003c90 con 0x564df0e6ccb0 2024-09-19T06:13:25.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.731+0000 7f8dce600640 1 -- 172.21.15.3:0/4186317091 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dd400fb60 con 0x564df0e6ccb0 2024-09-19T06:13:25.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.731+0000 7f8dce600640 1 -- 172.21.15.3:0/4186317091 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd401bab0 con 0x564df0e6ccb0 2024-09-19T06:13:25.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.732+0000 7f8de6a19740 1 -- 172.21.15.3:0/4186317091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564df0e6ccb0 msgr2=0x564df0e6d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:25.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.732+0000 7f8de6a19740 1 --2- 172.21.15.3:0/4186317091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564df0e6ccb0 0x564df0e6d090 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009f30 tx=0x7f8dd40118d0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.732+0000 7f8de2000640 1 --2- 172.21.15.3:0/3129877263 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8dc40a35d0 0x7f8dc40a5a90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4020000 tx=0x7f8dd4021000 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:25.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.732+0000 7f8de6a19740 1 -- 172.21.15.3:0/4186317091 shutdown_connections 2024-09-19T06:13:25.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.732+0000 7f8de6a19740 1 --2- 172.21.15.3:0/4186317091 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564df0e77e90 0x564df0e7a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.732+0000 7f8de6a19740 1 --2- 172.21.15.3:0/4186317091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6d5d0 0x564df0e77950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.732+0000 7f8de6a19740 1 --2- 172.21.15.3:0/4186317091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564df0e6ccb0 0x564df0e6d090 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.732+0000 7f8de6a19740 1 -- 172.21.15.3:0/4186317091 >> 172.21.15.3:0/4186317091 conn(0x564df0e69240 msgr2=0x564df0e69620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:25.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.732+0000 7f8de6a19740 1 -- 172.21.15.3:0/4186317091 shutdown_connections 2024-09-19T06:13:25.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.732+0000 7f8de6a19740 1 -- 172.21.15.3:0/4186317091 wait complete. 2024-09-19T06:13:25.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.733+0000 7f8de6a19740 1 -- start start 2024-09-19T06:13:25.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.733+0000 7f8de6a19740 1 Processor -- start 2024-09-19T06:13:25.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.734+0000 7f8de6a19740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6ccb0 0x564df0e77710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:25.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.734+0000 7f8de6a19740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564df0e6d5d0 0x564df0e749c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:25.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.734+0000 7f8de6a19740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564df0e77e90 0x564df0e74f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:25.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.734+0000 7f8de6a19740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x564df0e7ab00 con 0x564df0e77e90 2024-09-19T06:13:25.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.734+0000 7f8de6a19740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564df0d8dfa0 con 0x564df0e6d5d0 2024-09-19T06:13:25.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.734+0000 7f8de6a19740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564df0e7ac80 con 0x564df0e6ccb0 2024-09-19T06:13:25.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.734+0000 7f8de6a19740 10 client.0 _ll_register_callbacks cb 0x564df0ae1ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:25.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.734+0000 7f8de1600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6ccb0 0x564df0e77710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:25.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.734+0000 7f8de1600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6ccb0 0x564df0e77710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:35634/0 (socket says 172.21.15.3:35634) 2024-09-19T06:13:25.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.734+0000 7f8de1600640 1 -- 172.21.15.3:0/2193760645 learned_addr learned my addr 172.21.15.3:0/2193760645 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:25.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.735+0000 7f8de0c00640 1 --2- 172.21.15.3:0/2193760645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564df0e6d5d0 0x564df0e749c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:25.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.735+0000 7f8de2000640 1 --2- 172.21.15.3:0/2193760645 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564df0e77e90 0x564df0e74f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:25.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.735+0000 7f8de1600640 1 -- 172.21.15.3:0/2193760645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564df0e6d5d0 msgr2=0x564df0e749c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:25.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.735+0000 7f8de1600640 1 --2- 172.21.15.3:0/2193760645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564df0e6d5d0 0x564df0e749c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.735+0000 7f8de1600640 1 -- 172.21.15.3:0/2193760645 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564df0e77e90 msgr2=0x564df0e74f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:25.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.735+0000 7f8de1600640 1 --2- 172.21.15.3:0/2193760645 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564df0e77e90 0x564df0e74f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.735+0000 7f8de1600640 1 -- 172.21.15.3:0/2193760645 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564df0e756e0 con 0x564df0e6ccb0 2024-09-19T06:13:25.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.735+0000 7f8de2000640 1 --2- 172.21.15.3:0/2193760645 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564df0e77e90 0x564df0e74f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:13:25.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.736+0000 7f8de1600640 1 --2- 172.21.15.3:0/2193760645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6ccb0 0x564df0e77710 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0012700 tx=0x7f8dd0012bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad418b2b9f2c3bfb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:25.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.736+0000 7f8dc2a00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:13:25.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.737+0000 7f8dc2a00640 1 -- 172.21.15.3:0/2193760645 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd0004050 con 0x564df0e6ccb0 2024-09-19T06:13:25.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.737+0000 7f8dc2a00640 1 -- 172.21.15.3:0/2193760645 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f8dd00041f0 con 0x564df0e6ccb0 2024-09-19T06:13:25.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.737+0000 7f8de6a19740 1 -- 172.21.15.3:0/2193760645 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dd400fb60 con 0x564df0e6ccb0 2024-09-19T06:13:25.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.737+0000 7f8dc2a00640 1 -- 172.21.15.3:0/2193760645 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8dd00043f0 con 0x564df0e6ccb0 2024-09-19T06:13:25.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.737+0000 7f8de6a19740 10 client.25519 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:25.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.737+0000 7f8de6a19740 1 -- 172.21.15.3:0/2193760645 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564df0e8f1a0 con 0x564df0e6ccb0 2024-09-19T06:13:25.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.738+0000 7f8dc2a00640 1 -- 172.21.15.3:0/2193760645 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dd400fb60 con 0x564df0e6ccb0 2024-09-19T06:13:25.741 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.739+0000 7f8dc2a00640 1 -- 172.21.15.3:0/2193760645 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8dd0010430 con 0x564df0e6ccb0 2024-09-19T06:13:25.741 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.739+0000 7f8de6a19740 10 client.25519 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:25.741 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.739+0000 7f8de6a19740 10 client.25519 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:13:25.741 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.739+0000 7f8de6a19740 20 client.25519 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:25.741 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.739+0000 7f8de6a19740 1 --2- 172.21.15.3:0/2193760645 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564df0e90660 0x564df0e92b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:25.741 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.739+0000 7f8de6a19740 4 client.25519 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:13:25.741 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.739+0000 7f8de6a19740 1 -- 172.21.15.3:0/2193760645 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564df0de0800 con 0x564df0e90660 2024-09-19T06:13:25.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.739+0000 7f8de0c00640 1 --2- 172.21.15.3:0/2193760645 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564df0e90660 0x564df0e92b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:25.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.740+0000 7f8de0c00640 1 --2- 172.21.15.3:0/2193760645 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564df0e90660 0x564df0e92b00 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39fff0f53c4a0642 server_cookie=ba829978be4c147b in_seq=0 out_seq=0 2024-09-19T06:13:25.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.740+0000 7f8dc2a00640 10 client.25519 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:25.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.741+0000 7f8dc2a00640 1 -- 172.21.15.3:0/2193760645 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564df0de0800 con 0x564df0e90660 2024-09-19T06:13:25.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.741+0000 7f8dc2a00640 10 client.25519 handle_command_reply: tid=0 2024-09-19T06:13:25.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.741+0000 7f8de6a19740 1 client.25519 shutdown 2024-09-19T06:13:25.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.741+0000 7f8de6a19740 1 -- 172.21.15.3:0/2193760645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6ccb0 msgr2=0x564df0e77710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:25.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.741+0000 7f8de6a19740 1 --2- 172.21.15.3:0/2193760645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6ccb0 0x564df0e77710 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0012700 tx=0x7f8dd0012bc0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.742+0000 7f8de6a19740 1 -- 172.21.15.3:0/2193760645 shutdown_connections 2024-09-19T06:13:25.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.742+0000 7f8de6a19740 1 --2- 172.21.15.3:0/2193760645 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564df0e90660 0x564df0e92b00 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.742+0000 7f8de6a19740 1 --2- 172.21.15.3:0/2193760645 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564df0e77e90 0x564df0e74f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.742+0000 7f8de6a19740 1 --2- 172.21.15.3:0/2193760645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564df0e6d5d0 0x564df0e749c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.742+0000 7f8de6a19740 1 --2- 172.21.15.3:0/2193760645 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6ccb0 0x564df0e77710 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.742+0000 7f8de6a19740 1 -- 172.21.15.3:0/2193760645 >> 172.21.15.3:0/2193760645 conn(0x564df0e69240 msgr2=0x564df0e6ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:25.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.742+0000 7f8dc2a00640 0 client.25519 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:25.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.742+0000 7f8de6a19740 1 -- 172.21.15.3:0/2193760645 shutdown_connections 2024-09-19T06:13:25.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.742+0000 7f8de6a19740 1 -- 172.21.15.3:0/2193760645 wait complete. 2024-09-19T06:13:25.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.742+0000 7f8de6a19740 20 client.25519 trim_cache size 0 max 16384 2024-09-19T06:13:25.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.761+0000 7f8de6a19740 1 Processor -- start 2024-09-19T06:13:25.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.761+0000 7f8de6a19740 1 -- start start 2024-09-19T06:13:25.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.761+0000 7f8de6a19740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564df0e6ccb0 0x564df0e68180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:25.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.761+0000 7f8de6a19740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6d5d0 0x564df0e983d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:25.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.761+0000 7f8de6a19740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564df0e77e90 0x564df0e98910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:25.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.761+0000 7f8de6a19740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc00e7c0 con 0x564df0e6ccb0 2024-09-19T06:13:25.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.761+0000 7f8de6a19740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc010300 con 0x564df0e77e90 2024-09-19T06:13:25.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.761+0000 7f8de6a19740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc00ee90 con 0x564df0e6d5d0 2024-09-19T06:13:25.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.762+0000 7f8de2000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564df0e77e90 0x564df0e98910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:25.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.762+0000 7f8de2000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564df0e77e90 0x564df0e98910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:41592/0 (socket says 172.21.15.3:41592) 2024-09-19T06:13:25.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.762+0000 7f8de2000640 1 -- 172.21.15.3:0/1116152205 learned_addr learned my addr 172.21.15.3:0/1116152205 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:25.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.762+0000 7f8de1600640 1 --2- 172.21.15.3:0/1116152205 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564df0e6ccb0 0x564df0e68180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:25.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.762+0000 7f8de0c00640 1 --2- 172.21.15.3:0/1116152205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6d5d0 0x564df0e983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:25.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.762+0000 7f8de2000640 1 -- 172.21.15.3:0/1116152205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6d5d0 msgr2=0x564df0e983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:25.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.762+0000 7f8de2000640 1 --2- 172.21.15.3:0/1116152205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6d5d0 0x564df0e983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.762+0000 7f8de2000640 1 -- 172.21.15.3:0/1116152205 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564df0e6ccb0 msgr2=0x564df0e68180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:25.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.763+0000 7f8de2000640 1 --2- 172.21.15.3:0/1116152205 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564df0e6ccb0 0x564df0e68180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.763+0000 7f8de2000640 1 -- 172.21.15.3:0/1116152205 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564df0e6cae0 con 0x564df0e77e90 2024-09-19T06:13:25.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.763+0000 7f8de0c00640 1 --2- 172.21.15.3:0/1116152205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6d5d0 0x564df0e983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:25.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.763+0000 7f8de1600640 1 --2- 172.21.15.3:0/1116152205 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564df0e6ccb0 0x564df0e68180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:13:25.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.764+0000 7f8de2000640 1 --2- 172.21.15.3:0/1116152205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564df0e77e90 0x564df0e98910 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009f30 tx=0x7f8dd4027000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a06a01069d3129e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:25.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.764+0000 7f8dcdc00640 1 -- 172.21.15.3:0/1116152205 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4029040 con 0x564df0e77e90 2024-09-19T06:13:25.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.764+0000 7f8dcdc00640 1 -- 172.21.15.3:0/1116152205 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dd401b980 con 0x564df0e77e90 2024-09-19T06:13:25.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.764+0000 7f8dcdc00640 1 -- 172.21.15.3:0/1116152205 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd402ecd0 con 0x564df0e77e90 2024-09-19T06:13:25.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.765+0000 7f8de6a19740 1 -- 172.21.15.3:0/1116152205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564df0e77e90 msgr2=0x564df0e98910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:25.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.765+0000 7f8de6a19740 1 --2- 172.21.15.3:0/1116152205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564df0e77e90 0x564df0e98910 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009f30 tx=0x7f8dd4027000 comp rx=0 tx=0).stop 2024-09-19T06:13:25.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.765+0000 7f8de6a19740 1 -- 172.21.15.3:0/1116152205 shutdown_connections 2024-09-19T06:13:25.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.765+0000 7f8de6a19740 1 --2- 172.21.15.3:0/1116152205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564df0e77e90 0x564df0e98910 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.765+0000 7f8de6a19740 1 --2- 172.21.15.3:0/1116152205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6d5d0 0x564df0e983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.765+0000 7f8de6a19740 1 --2- 172.21.15.3:0/1116152205 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564df0e6ccb0 0x564df0e68180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.765+0000 7f8de6a19740 1 -- 172.21.15.3:0/1116152205 >> 172.21.15.3:0/1116152205 conn(0x564df0e69240 msgr2=0x564df0e67a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:25.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.766+0000 7f8de6a19740 1 -- 172.21.15.3:0/1116152205 shutdown_connections 2024-09-19T06:13:25.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.766+0000 7f8de6a19740 1 -- 172.21.15.3:0/1116152205 wait complete. 2024-09-19T06:13:25.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.766+0000 7f8de6a19740 1 -- start start 2024-09-19T06:13:25.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.767+0000 7f8de6a19740 1 Processor -- start 2024-09-19T06:13:25.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.767+0000 7f8de6a19740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564df0e6ccb0 0x564df0e866f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:25.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.767+0000 7f8de6a19740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6d5d0 0x564df0e86c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:25.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.768+0000 7f8de6a19740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564df0e77e90 0x564df0e87170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:25.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.768+0000 7f8de6a19740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc00fc30 con 0x564df0e6ccb0 2024-09-19T06:13:25.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.768+0000 7f8de6a19740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc00f560 con 0x564df0e77e90 2024-09-19T06:13:25.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.768+0000 7f8de6a19740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc00c7a0 con 0x564df0e6d5d0 2024-09-19T06:13:25.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.768+0000 7f8de6a19740 10 client.0 _ll_register_callbacks cb 0x7f8dd0009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:25.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.768+0000 7f8de1600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564df0e6ccb0 0x564df0e866f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:25.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.768+0000 7f8de0c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6d5d0 0x564df0e86c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:25.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.768+0000 7f8de2000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564df0e77e90 0x564df0e87170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:25.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.768+0000 7f8de0c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6d5d0 0x564df0e86c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:35640/0 (socket says 172.21.15.3:35640) 2024-09-19T06:13:25.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.768+0000 7f8de0c00640 1 -- 172.21.15.3:0/3601918225 learned_addr learned my addr 172.21.15.3:0/3601918225 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:25.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.769+0000 7f8de0c00640 1 -- 172.21.15.3:0/3601918225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564df0e77e90 msgr2=0x564df0e87170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:25.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.769+0000 7f8de0c00640 1 --2- 172.21.15.3:0/3601918225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564df0e77e90 0x564df0e87170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.769+0000 7f8de0c00640 1 -- 172.21.15.3:0/3601918225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564df0e6ccb0 msgr2=0x564df0e866f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:25.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.769+0000 7f8de0c00640 1 --2- 172.21.15.3:0/3601918225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564df0e6ccb0 0x564df0e866f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.769+0000 7f8de0c00640 1 -- 172.21.15.3:0/3601918225 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564df0efa5b0 con 0x564df0e6d5d0 2024-09-19T06:13:25.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.769+0000 7f8de0c00640 1 --2- 172.21.15.3:0/3601918225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6d5d0 0x564df0e86c30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8dc803b8e0 tx=0x7f8dc80dc040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0f6a5b7be1b7fd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:25.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.769+0000 7f8dc2a00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:13:25.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.769+0000 7f8dc2a00640 1 -- 172.21.15.3:0/3601918225 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8049040 con 0x564df0e6d5d0 2024-09-19T06:13:25.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.769+0000 7f8dc2a00640 1 -- 172.21.15.3:0/3601918225 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f8dc80c0150 con 0x564df0e6d5d0 2024-09-19T06:13:25.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.770+0000 7f8de6a19740 1 -- 172.21.15.3:0/3601918225 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dd401b980 con 0x564df0e6d5d0 2024-09-19T06:13:25.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.771+0000 7f8dc2a00640 1 -- 172.21.15.3:0/3601918225 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8dc80c4d70 con 0x564df0e6d5d0 2024-09-19T06:13:25.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.771+0000 7f8de6a19740 10 client.25525 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:25.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.771+0000 7f8de6a19740 1 -- 172.21.15.3:0/3601918225 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564df0efb8d0 con 0x564df0e6d5d0 2024-09-19T06:13:25.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.771+0000 7f8dc2a00640 1 -- 172.21.15.3:0/3601918225 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dd401b980 con 0x564df0e6d5d0 2024-09-19T06:13:25.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.771+0000 7f8dc2a00640 1 -- 172.21.15.3:0/3601918225 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8dc804c060 con 0x564df0e6d5d0 2024-09-19T06:13:25.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.771+0000 7f8de6a19740 10 client.25525 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:25.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.771+0000 7f8de6a19740 10 client.25525 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:13:25.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.771+0000 7f8de6a19740 20 client.25525 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:25.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.772+0000 7f8de6a19740 1 --2- 172.21.15.3:0/3601918225 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564df0efc000 0x564df0efe420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:25.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.772+0000 7f8de6a19740 4 client.25525 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:13:25.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.772+0000 7f8de6a19740 1 -- 172.21.15.3:0/3601918225 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564df0ddad10 con 0x564df0efc000 2024-09-19T06:13:25.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.772+0000 7f8de1600640 1 --2- 172.21.15.3:0/3601918225 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564df0efc000 0x564df0efe420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:25.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.773+0000 7f8de1600640 1 --2- 172.21.15.3:0/3601918225 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564df0efc000 0x564df0efe420 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e10852e84ed86806 server_cookie=bd1caca156a35a5b in_seq=0 out_seq=0 2024-09-19T06:13:25.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.773+0000 7f8dc2a00640 10 client.25525 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:25.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.774+0000 7f8dc2a00640 1 -- 172.21.15.3:0/3601918225 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564df0ddad10 con 0x564df0efc000 2024-09-19T06:13:25.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.774+0000 7f8dc2a00640 10 client.25525 handle_command_reply: tid=0 2024-09-19T06:13:25.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.774+0000 7f8de6a19740 1 client.25525 shutdown 2024-09-19T06:13:25.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.775+0000 7f8de6a19740 1 -- 172.21.15.3:0/3601918225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6d5d0 msgr2=0x564df0e86c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:25.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.775+0000 7f8de6a19740 1 --2- 172.21.15.3:0/3601918225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6d5d0 0x564df0e86c30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8dc803b8e0 tx=0x7f8dc80dc040 comp rx=0 tx=0).stop 2024-09-19T06:13:25.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.776+0000 7f8de6a19740 1 -- 172.21.15.3:0/3601918225 shutdown_connections 2024-09-19T06:13:25.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.776+0000 7f8de6a19740 1 --2- 172.21.15.3:0/3601918225 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564df0efc000 0x564df0efe420 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.776+0000 7f8de6a19740 1 --2- 172.21.15.3:0/3601918225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564df0e77e90 0x564df0e87170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.776+0000 7f8de6a19740 1 --2- 172.21.15.3:0/3601918225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564df0e6d5d0 0x564df0e86c30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.776+0000 7f8de6a19740 1 --2- 172.21.15.3:0/3601918225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564df0e6ccb0 0x564df0e866f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.776+0000 7f8de6a19740 1 -- 172.21.15.3:0/3601918225 >> 172.21.15.3:0/3601918225 conn(0x564df0e69240 msgr2=0x564df0e8be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:25.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.776+0000 7f8dc2a00640 0 client.25525 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:25.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.776+0000 7f8de6a19740 1 -- 172.21.15.3:0/3601918225 shutdown_connections 2024-09-19T06:13:25.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.776+0000 7f8de6a19740 1 -- 172.21.15.3:0/3601918225 wait complete. 2024-09-19T06:13:25.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.776+0000 7f8de6a19740 20 client.25525 trim_cache size 0 max 16384 2024-09-19T06:13:25.779 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:13:25.779 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": 0, 2024-09-19T06:13:25.779 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_tag": "9f894eba-d95d-4b2f-8c9c-13b8572f2a63", 2024-09-19T06:13:25.780 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": "asynchronous" 2024-09-19T06:13:25.780 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:13:25.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.778+0000 7f8de2a00640 1 -- 172.21.15.3:0/3129877263 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8dc40a35d0 msgr2=0x7f8dc40a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:25.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.778+0000 7f8de2a00640 1 --2- 172.21.15.3:0/3129877263 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8dc40a35d0 0x7f8dc40a5a90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4020000 tx=0x7f8dd4021000 comp rx=0 tx=0).stop 2024-09-19T06:13:25.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.778+0000 7f8de2a00640 1 -- 172.21.15.3:0/3129877263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ddc074e30 msgr2=0x7f8ddc19aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:25.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.778+0000 7f8de2a00640 1 --2- 172.21.15.3:0/3129877263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ddc074e30 0x7f8ddc19aa80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8004770 tx=0x7f8dc8003c10 comp rx=0 tx=0).stop 2024-09-19T06:13:25.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.778+0000 7f8de2a00640 1 -- 172.21.15.3:0/3129877263 shutdown_connections 2024-09-19T06:13:25.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.778+0000 7f8de2a00640 1 --2- 172.21.15.3:0/3129877263 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8dc40a35d0 0x7f8dc40a5a90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.778+0000 7f8de2a00640 1 --2- 172.21.15.3:0/3129877263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ddc10e280 0x7f8ddc19ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.778+0000 7f8de2a00640 1 --2- 172.21.15.3:0/3129877263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8ddc074e30 0x7f8ddc19aa80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.778+0000 7f8de2a00640 1 --2- 172.21.15.3:0/3129877263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ddc074510 0x7f8ddc19a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:25.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.778+0000 7f8de2a00640 1 -- 172.21.15.3:0/3129877263 >> 172.21.15.3:0/3129877263 conn(0x7f8ddc0fd740 msgr2=0x7f8ddc0fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:25.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.778+0000 7f8de2a00640 1 -- 172.21.15.3:0/3129877263 shutdown_connections 2024-09-19T06:13:25.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:25.778+0000 7f8de2a00640 1 -- 172.21.15.3:0/3129877263 wait complete. 2024-09-19T06:13:26.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:26 smithi059 ceph-mon[35138]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.4 KiB/s wr, 14 op/s 2024-09-19T06:13:26.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:26 smithi059 ceph-mon[35138]: scrub queued for path: / 2024-09-19T06:13:26.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:26 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:13:26.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:26 smithi059 ceph-mon[35138]: scrub summary: active paths [/] 2024-09-19T06:13:26.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:26 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:13:26.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:26 smithi003 ceph-mon[30893]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.4 KiB/s wr, 14 op/s 2024-09-19T06:13:26.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:26 smithi003 ceph-mon[30893]: scrub queued for path: / 2024-09-19T06:13:26.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:26 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:13:26.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:26 smithi003 ceph-mon[30893]: scrub summary: active paths [/] 2024-09-19T06:13:26.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:26 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:13:26.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:26 smithi071 ceph-mon[35662]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.4 KiB/s wr, 14 op/s 2024-09-19T06:13:26.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:26 smithi071 ceph-mon[35662]: scrub queued for path: / 2024-09-19T06:13:26.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:26 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:13:26.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:26 smithi071 ceph-mon[35662]: scrub summary: active paths [/] 2024-09-19T06:13:26.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:26 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:13:26.705 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:13:27.137 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:27.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.833+0000 7f03ab200640 1 -- 172.21.15.3:0/2579845539 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03ac105d90 msgr2=0x7f03ac106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:27.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.833+0000 7f03ab200640 1 --2- 172.21.15.3:0/2579845539 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03ac105d90 0x7f03ac106220 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f03a4009900 tx=0x7f03a402a470 comp rx=0 tx=0).stop 2024-09-19T06:13:27.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.833+0000 7f03ab200640 1 -- 172.21.15.3:0/2579845539 shutdown_connections 2024-09-19T06:13:27.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.833+0000 7f03ab200640 1 --2- 172.21.15.3:0/2579845539 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03ac105d90 0x7f03ac106220 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.833+0000 7f03ab200640 1 --2- 172.21.15.3:0/2579845539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ac1012a0 0x7f03ac105770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.833+0000 7f03ab200640 1 --2- 172.21.15.3:0/2579845539 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03ac100980 0x7f03ac100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.833+0000 7f03ab200640 1 -- 172.21.15.3:0/2579845539 >> 172.21.15.3:0/2579845539 conn(0x7f03ac0fc610 msgr2=0x7f03ac0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:27.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.833+0000 7f03ab200640 1 -- 172.21.15.3:0/2579845539 shutdown_connections 2024-09-19T06:13:27.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.833+0000 7f03ab200640 1 -- 172.21.15.3:0/2579845539 wait complete. 2024-09-19T06:13:27.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.834+0000 7f03ab200640 1 Processor -- start 2024-09-19T06:13:27.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.834+0000 7f03ab200640 1 -- start start 2024-09-19T06:13:27.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.835+0000 7f03ab200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03ac100980 0x7f03ac1a4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:27.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.835+0000 7f03ab200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03ac1012a0 0x7f03ac1a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:27.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.835+0000 7f03ab200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ac105d90 0x7f03ac19e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:27.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.835+0000 7f03ab200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f03ac1183b0 con 0x7f03ac100980 2024-09-19T06:13:27.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.835+0000 7f03ab200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f03ac118230 con 0x7f03ac105d90 2024-09-19T06:13:27.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.835+0000 7f03ab200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f03ac118530 con 0x7f03ac1012a0 2024-09-19T06:13:27.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.835+0000 7f03a9e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03ac100980 0x7f03ac1a4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:27.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.835+0000 7f03aa800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ac105d90 0x7f03ac19e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:27.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.835+0000 7f03a9e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03ac100980 0x7f03ac1a4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36526/0 (socket says 172.21.15.3:36526) 2024-09-19T06:13:27.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.835+0000 7f03a9e00640 1 -- 172.21.15.3:0/854388429 learned_addr learned my addr 172.21.15.3:0/854388429 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:27.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.836+0000 7f03aa800640 1 -- 172.21.15.3:0/854388429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03ac1012a0 msgr2=0x7f03ac1a4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:27.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.836+0000 7f03aa800640 1 --2- 172.21.15.3:0/854388429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03ac1012a0 0x7f03ac1a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.836+0000 7f03aa800640 1 -- 172.21.15.3:0/854388429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03ac100980 msgr2=0x7f03ac1a4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:27.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.836+0000 7f03aa800640 1 --2- 172.21.15.3:0/854388429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03ac100980 0x7f03ac1a4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.836+0000 7f03aa800640 1 -- 172.21.15.3:0/854388429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03ac19ef70 con 0x7f03ac105d90 2024-09-19T06:13:27.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.836+0000 7f03a9e00640 1 --2- 172.21.15.3:0/854388429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03ac100980 0x7f03ac1a4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:27.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.836+0000 7f03aa800640 1 --2- 172.21.15.3:0/854388429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ac105d90 0x7f03ac19e700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f03a4009230 tx=0x7f03a4004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:27.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.837+0000 7f03a3400640 1 -- 172.21.15.3:0/854388429 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a403f030 con 0x7f03ac105d90 2024-09-19T06:13:27.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.837+0000 7f03ab200640 1 -- 172.21.15.3:0/854388429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03ac19f200 con 0x7f03ac105d90 2024-09-19T06:13:27.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.837+0000 7f03a3400640 1 -- 172.21.15.3:0/854388429 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03a4004440 con 0x7f03ac105d90 2024-09-19T06:13:27.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.837+0000 7f03ab200640 1 -- 172.21.15.3:0/854388429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03ac1ab3e0 con 0x7f03ac105d90 2024-09-19T06:13:27.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.838+0000 7f03a3400640 1 -- 172.21.15.3:0/854388429 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a4035070 con 0x7f03ac105d90 2024-09-19T06:13:27.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.840+0000 7f03b3419740 1 Processor -- start 2024-09-19T06:13:27.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.840+0000 7f03b3419740 1 -- start start 2024-09-19T06:13:27.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.841+0000 7f03b3419740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b730d50 0x55fc3b731130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:27.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.841+0000 7f03b3419740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc3b731670 0x55fc3b73b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:27.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.841+0000 7f03b3419740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc3b73bf30 0x55fc3b73e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:27.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.841+0000 7f03b3419740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55fc3b6973e0 con 0x55fc3b73bf30 2024-09-19T06:13:27.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.841+0000 7f03b3419740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fc3b63ed80 con 0x55fc3b731670 2024-09-19T06:13:27.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.841+0000 7f03b3419740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55fc3b6933a0 con 0x55fc3b730d50 2024-09-19T06:13:27.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.841+0000 7f03a1400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b730d50 0x55fc3b731130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:27.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.842+0000 7f03a9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc3b731670 0x55fc3b73b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:27.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.842+0000 7f03a9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc3b731670 0x55fc3b73b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:41628/0 (socket says 172.21.15.3:41628) 2024-09-19T06:13:27.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.842+0000 7f03a9e00640 1 -- 172.21.15.3:0/3670100455 learned_addr learned my addr 172.21.15.3:0/3670100455 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:27.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.842+0000 7f03a9e00640 1 -- 172.21.15.3:0/3670100455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b730d50 msgr2=0x55fc3b731130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:27.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.842+0000 7f03a9e00640 1 --2- 172.21.15.3:0/3670100455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b730d50 0x55fc3b731130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.842+0000 7f03a9e00640 1 -- 172.21.15.3:0/3670100455 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc3b73bf30 msgr2=0x55fc3b73e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:27.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.842+0000 7f03a9e00640 1 --2- 172.21.15.3:0/3670100455 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc3b73bf30 0x55fc3b73e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.842+0000 7f03a9e00640 1 -- 172.21.15.3:0/3670100455 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc3b65dae0 con 0x55fc3b731670 2024-09-19T06:13:27.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.843+0000 7f03a9e00640 1 --2- 172.21.15.3:0/3670100455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc3b731670 0x55fc3b73b9f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f039c00e8e0 tx=0x7f039c00eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c7b943378919d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:27.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.843+0000 7f039b000640 1 -- 172.21.15.3:0/3670100455 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039c004d20 con 0x55fc3b731670 2024-09-19T06:13:27.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.843+0000 7f039b000640 1 -- 172.21.15.3:0/3670100455 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f039c010e90 con 0x55fc3b731670 2024-09-19T06:13:27.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.843+0000 7f039b000640 1 -- 172.21.15.3:0/3670100455 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039c01a680 con 0x55fc3b731670 2024-09-19T06:13:27.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.843+0000 7f03a3400640 1 -- 172.21.15.3:0/854388429 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 138587+0+0 (secure 0 0 0) 0x7f03a4042030 con 0x7f03ac105d90 2024-09-19T06:13:27.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.844+0000 7f03b3419740 1 -- 172.21.15.3:0/3670100455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc3b731670 msgr2=0x55fc3b73b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:27.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.844+0000 7f03b3419740 1 --2- 172.21.15.3:0/3670100455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc3b731670 0x55fc3b73b9f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f039c00e8e0 tx=0x7f039c00eda0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.844+0000 7f03b3419740 1 -- 172.21.15.3:0/3670100455 shutdown_connections 2024-09-19T06:13:27.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.844+0000 7f03b3419740 1 --2- 172.21.15.3:0/3670100455 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc3b73bf30 0x55fc3b73e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.845+0000 7f03b3419740 1 --2- 172.21.15.3:0/3670100455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc3b731670 0x55fc3b73b9f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.845+0000 7f03b3419740 1 --2- 172.21.15.3:0/3670100455 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b730d50 0x55fc3b731130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.845+0000 7f03b3419740 1 -- 172.21.15.3:0/3670100455 >> 172.21.15.3:0/3670100455 conn(0x55fc3b72d2e0 msgr2=0x55fc3b72d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:27.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.845+0000 7f03b3419740 1 -- 172.21.15.3:0/3670100455 shutdown_connections 2024-09-19T06:13:27.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.845+0000 7f03b3419740 1 -- 172.21.15.3:0/3670100455 wait complete. 2024-09-19T06:13:27.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.845+0000 7f03b3419740 1 -- start start 2024-09-19T06:13:27.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.845+0000 7f03b3419740 1 Processor -- start 2024-09-19T06:13:27.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.846+0000 7f03b3419740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b730d50 0x55fc3b738da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:27.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.846+0000 7f03a3400640 1 --2- 172.21.15.3:0/854388429 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f03900a35e0 0x7f03900a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:27.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.846+0000 7f03b3419740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc3b731670 0x55fc3b7392e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:27.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.846+0000 7f03b3419740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc3b73bf30 0x55fc3b739820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:27.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.846+0000 7f03b3419740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55fc3b73eba0 con 0x55fc3b73bf30 2024-09-19T06:13:27.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.846+0000 7f03b3419740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fc3b6520f0 con 0x55fc3b731670 2024-09-19T06:13:27.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.846+0000 7f03b3419740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55fc3b73ed20 con 0x55fc3b730d50 2024-09-19T06:13:27.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.846+0000 7f03b3419740 10 client.0 _ll_register_callbacks cb 0x55fc3b6439e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:27.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.847+0000 7f03a3400640 1 -- 172.21.15.3:0/854388429 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f03a40035f0 con 0x7f03ac105d90 2024-09-19T06:13:27.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.847+0000 7f03a1400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b730d50 0x55fc3b738da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:27.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.847+0000 7f03a1400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b730d50 0x55fc3b738da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:35666/0 (socket says 172.21.15.3:35666) 2024-09-19T06:13:27.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.847+0000 7f03a1400640 1 -- 172.21.15.3:0/1120121204 learned_addr learned my addr 172.21.15.3:0/1120121204 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:27.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.847+0000 7f03a1400640 1 --2- 172.21.15.3:0/1120121204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc3b731670 0x55fc3b7392e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:27.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.848+0000 7f03a1400640 1 -- 172.21.15.3:0/1120121204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc3b731670 msgr2=0x55fc3b7392e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:27.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.848+0000 7f03a1400640 1 --2- 172.21.15.3:0/1120121204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc3b731670 0x55fc3b7392e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.848+0000 7f03a1400640 1 -- 172.21.15.3:0/1120121204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc3b73bf30 msgr2=0x55fc3b739820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:13:27.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.848+0000 7f03a9e00640 1 --2- 172.21.15.3:0/854388429 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f03900a35e0 0x7f03900a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:27.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.848+0000 7f03aa800640 1 --2- 172.21.15.3:0/1120121204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc3b73bf30 0x55fc3b739820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:27.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.849+0000 7f03a1400640 1 --2- 172.21.15.3:0/1120121204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc3b73bf30 0x55fc3b739820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.849+0000 7f03a1400640 1 -- 172.21.15.3:0/1120121204 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc3b4083c0 con 0x55fc3b730d50 2024-09-19T06:13:27.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.849+0000 7f03aa800640 1 --2- 172.21.15.3:0/1120121204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc3b73bf30 0x55fc3b739820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:13:27.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.849+0000 7f03a1400640 1 --2- 172.21.15.3:0/1120121204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b730d50 0x55fc3b738da0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0394012db0 tx=0x7f0394009820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f350d3ea31d1cb5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:27.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.849+0000 7f038f400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:13:27.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.850+0000 7f03a9e00640 1 --2- 172.21.15.3:0/854388429 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f03900a35e0 0x7f03900a5aa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f039c005660 tx=0x7f039c009fd0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:27.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.850+0000 7f038f400640 1 -- 172.21.15.3:0/1120121204 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039400fc50 con 0x55fc3b730d50 2024-09-19T06:13:27.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.850+0000 7f038f400640 1 -- 172.21.15.3:0/1120121204 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f039400fdf0 con 0x55fc3b730d50 2024-09-19T06:13:27.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.850+0000 7f03b3419740 1 -- 172.21.15.3:0/1120121204 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f039c010e90 con 0x55fc3b730d50 2024-09-19T06:13:27.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.850+0000 7f038f400640 1 -- 172.21.15.3:0/1120121204 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0394010430 con 0x55fc3b730d50 2024-09-19T06:13:27.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.850+0000 7f03b3419740 10 client.25534 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:27.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.851+0000 7f03b3419740 1 -- 172.21.15.3:0/1120121204 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fc3b74a800 con 0x55fc3b730d50 2024-09-19T06:13:27.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.851+0000 7f038f400640 1 -- 172.21.15.3:0/1120121204 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f039c010e90 con 0x55fc3b730d50 2024-09-19T06:13:27.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.851+0000 7f038f400640 1 -- 172.21.15.3:0/1120121204 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f03940285a0 con 0x55fc3b730d50 2024-09-19T06:13:27.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.851+0000 7f03b3419740 10 client.25534 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:27.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.851+0000 7f03b3419740 10 client.25534 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:13:27.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.852+0000 7f03b3419740 20 client.25534 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:27.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.852+0000 7f03b3419740 1 --2- 172.21.15.3:0/1120121204 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55fc3b74bc60 0x55fc3b74e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:27.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.852+0000 7f03b3419740 4 client.25534 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:13:27.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.852+0000 7f03b3419740 1 -- 172.21.15.3:0/1120121204 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc3b6a4950 con 0x55fc3b74bc60 2024-09-19T06:13:27.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.852+0000 7f03a1400640 1 --2- 172.21.15.3:0/1120121204 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55fc3b74bc60 0x55fc3b74e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:27.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.853+0000 7f03a1400640 1 --2- 172.21.15.3:0/1120121204 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55fc3b74bc60 0x55fc3b74e0e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95f6d513a8653927 server_cookie=1a80ea23a114773f in_seq=0 out_seq=0 2024-09-19T06:13:27.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.853+0000 7f038f400640 10 client.25534 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:27.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.854+0000 7f038f400640 1 -- 172.21.15.3:0/1120121204 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fc3b6a4950 con 0x55fc3b74bc60 2024-09-19T06:13:27.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.854+0000 7f038f400640 10 client.25534 handle_command_reply: tid=0 2024-09-19T06:13:27.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.854+0000 7f03b3419740 1 client.25534 shutdown 2024-09-19T06:13:27.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.854+0000 7f03b3419740 1 -- 172.21.15.3:0/1120121204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b730d50 msgr2=0x55fc3b738da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:27.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.854+0000 7f03b3419740 1 --2- 172.21.15.3:0/1120121204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b730d50 0x55fc3b738da0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0394012db0 tx=0x7f0394009820 comp rx=0 tx=0).stop 2024-09-19T06:13:27.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.854+0000 7f03b3419740 1 -- 172.21.15.3:0/1120121204 shutdown_connections 2024-09-19T06:13:27.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.854+0000 7f03b3419740 1 --2- 172.21.15.3:0/1120121204 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55fc3b74bc60 0x55fc3b74e0e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.854+0000 7f03b3419740 1 --2- 172.21.15.3:0/1120121204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc3b73bf30 0x55fc3b739820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.854+0000 7f03b3419740 1 --2- 172.21.15.3:0/1120121204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc3b731670 0x55fc3b7392e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.854+0000 7f03b3419740 1 --2- 172.21.15.3:0/1120121204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b730d50 0x55fc3b738da0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.854+0000 7f03b3419740 1 -- 172.21.15.3:0/1120121204 >> 172.21.15.3:0/1120121204 conn(0x55fc3b72d2e0 msgr2=0x55fc3b732fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:27.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.854+0000 7f038f400640 0 client.25534 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:27.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.855+0000 7f03b3419740 1 -- 172.21.15.3:0/1120121204 shutdown_connections 2024-09-19T06:13:27.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.855+0000 7f03b3419740 1 -- 172.21.15.3:0/1120121204 wait complete. 2024-09-19T06:13:27.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.855+0000 7f03b3419740 20 client.25534 trim_cache size 0 max 16384 2024-09-19T06:13:27.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.873+0000 7f03b3419740 1 Processor -- start 2024-09-19T06:13:27.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.874+0000 7f03b3419740 1 -- start start 2024-09-19T06:13:27.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.874+0000 7f03b3419740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc3b730d50 0x55fc3b7337b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:27.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.874+0000 7f03b3419740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc3b731670 0x55fc3b72c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:27.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.874+0000 7f03b3419740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b73bf30 0x55fc3b7539b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:27.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.874+0000 7f03b3419740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f03ac1b3d40 con 0x55fc3b730d50 2024-09-19T06:13:27.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.874+0000 7f03b3419740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f03ac1b5880 con 0x55fc3b731670 2024-09-19T06:13:27.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.874+0000 7f03b3419740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f03ac1b4410 con 0x55fc3b73bf30 2024-09-19T06:13:27.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.875+0000 7f03aa800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b73bf30 0x55fc3b7539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:27.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.875+0000 7f03a1400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc3b731670 0x55fc3b72c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:27.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.875+0000 7f03aa800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b73bf30 0x55fc3b7539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:35670/0 (socket says 172.21.15.3:35670) 2024-09-19T06:13:27.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.875+0000 7f03aa800640 1 -- 172.21.15.3:0/3677086019 learned_addr learned my addr 172.21.15.3:0/3677086019 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:27.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.875+0000 7f03a1400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc3b731670 0x55fc3b72c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:41634/0 (socket says 172.21.15.3:41634) 2024-09-19T06:13:27.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.875+0000 7f03a9e00640 1 --2- 172.21.15.3:0/3677086019 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc3b730d50 0x55fc3b7337b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:27.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.875+0000 7f03aa800640 1 -- 172.21.15.3:0/3677086019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc3b731670 msgr2=0x55fc3b72c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:27.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.875+0000 7f03aa800640 1 --2- 172.21.15.3:0/3677086019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc3b731670 0x55fc3b72c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.875+0000 7f03aa800640 1 -- 172.21.15.3:0/3677086019 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc3b730d50 msgr2=0x55fc3b7337b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:27.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.875+0000 7f03aa800640 1 --2- 172.21.15.3:0/3677086019 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc3b730d50 0x55fc3b7337b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.875+0000 7f03aa800640 1 -- 172.21.15.3:0/3677086019 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc3b7372f0 con 0x55fc3b73bf30 2024-09-19T06:13:27.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.876+0000 7f03aa800640 1 --2- 172.21.15.3:0/3677086019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b73bf30 0x55fc3b7539b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f03a40ece50 tx=0x7f03a40bb380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53b145b6e7ec2858 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:27.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.876+0000 7f039a600640 1 -- 172.21.15.3:0/3677086019 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a4035070 con 0x55fc3b73bf30 2024-09-19T06:13:27.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.876+0000 7f039a600640 1 -- 172.21.15.3:0/3677086019 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f03a4004440 con 0x55fc3b73bf30 2024-09-19T06:13:27.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.876+0000 7f039a600640 1 -- 172.21.15.3:0/3677086019 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a403b5f0 con 0x55fc3b73bf30 2024-09-19T06:13:27.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.877+0000 7f03b3419740 1 -- 172.21.15.3:0/3677086019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b73bf30 msgr2=0x55fc3b7539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:27.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.877+0000 7f03b3419740 1 --2- 172.21.15.3:0/3677086019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b73bf30 0x55fc3b7539b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f03a40ece50 tx=0x7f03a40bb380 comp rx=0 tx=0).stop 2024-09-19T06:13:27.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.877+0000 7f03b3419740 1 -- 172.21.15.3:0/3677086019 shutdown_connections 2024-09-19T06:13:27.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.877+0000 7f03b3419740 1 --2- 172.21.15.3:0/3677086019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b73bf30 0x55fc3b7539b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.877+0000 7f03b3419740 1 --2- 172.21.15.3:0/3677086019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc3b731670 0x55fc3b72c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.877+0000 7f03b3419740 1 --2- 172.21.15.3:0/3677086019 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc3b730d50 0x55fc3b7337b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.877+0000 7f03b3419740 1 -- 172.21.15.3:0/3677086019 >> 172.21.15.3:0/3677086019 conn(0x55fc3b72d2e0 msgr2=0x55fc3b73ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:27.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.878+0000 7f03b3419740 1 -- 172.21.15.3:0/3677086019 shutdown_connections 2024-09-19T06:13:27.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.878+0000 7f03b3419740 1 -- 172.21.15.3:0/3677086019 wait complete. 2024-09-19T06:13:27.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.878+0000 7f03b3419740 1 -- start start 2024-09-19T06:13:27.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.878+0000 7f03b3419740 1 Processor -- start 2024-09-19T06:13:27.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.879+0000 7f03b3419740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc3b730d50 0x55fc3b740390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:27.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.879+0000 7f03b3419740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b731670 0x55fc3b7408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:27.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.879+0000 7f03b3419740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc3b73bf30 0x55fc3b7b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:27.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.879+0000 7f03b3419740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f03ac1b51b0 con 0x55fc3b73bf30 2024-09-19T06:13:27.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.879+0000 7f03b3419740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f03ac1b4ae0 con 0x55fc3b730d50 2024-09-19T06:13:27.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.879+0000 7f03b3419740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f03ac1b1d20 con 0x55fc3b731670 2024-09-19T06:13:27.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.879+0000 7f03b3419740 10 client.0 _ll_register_callbacks cb 0x7f03940129f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:27.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.880+0000 7f03a1400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b731670 0x55fc3b7408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:27.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.880+0000 7f03a9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc3b730d50 0x55fc3b740390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:27.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.880+0000 7f03a1400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b731670 0x55fc3b7408d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:35674/0 (socket says 172.21.15.3:35674) 2024-09-19T06:13:27.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.880+0000 7f03a1400640 1 -- 172.21.15.3:0/221031443 learned_addr learned my addr 172.21.15.3:0/221031443 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:27.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.880+0000 7f03aa800640 1 --2- 172.21.15.3:0/221031443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc3b73bf30 0x55fc3b7b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:27.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.881+0000 7f03a1400640 1 -- 172.21.15.3:0/221031443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc3b730d50 msgr2=0x55fc3b740390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:27.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.881+0000 7f03a1400640 1 --2- 172.21.15.3:0/221031443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc3b730d50 0x55fc3b740390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.881+0000 7f03a1400640 1 -- 172.21.15.3:0/221031443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc3b73bf30 msgr2=0x55fc3b7b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:27.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.881+0000 7f03a1400640 1 --2- 172.21.15.3:0/221031443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc3b73bf30 0x55fc3b7b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.881+0000 7f03a1400640 1 -- 172.21.15.3:0/221031443 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc3b7b5ec0 con 0x55fc3b731670 2024-09-19T06:13:27.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.881+0000 7f03aa800640 1 --2- 172.21.15.3:0/221031443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc3b73bf30 0x55fc3b7b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:27.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.881+0000 7f03a9e00640 1 --2- 172.21.15.3:0/221031443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc3b730d50 0x55fc3b740390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:13:27.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.882+0000 7f03a1400640 1 --2- 172.21.15.3:0/221031443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b731670 0x55fc3b7408d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0394009d30 tx=0x7f039400b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0e656c5e0fed7d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:27.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.882+0000 7f038f400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:13:27.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.882+0000 7f038f400640 1 -- 172.21.15.3:0/221031443 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03940097b0 con 0x55fc3b731670 2024-09-19T06:13:27.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.882+0000 7f038f400640 1 -- 172.21.15.3:0/221031443 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f039400fe30 con 0x55fc3b731670 2024-09-19T06:13:27.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.882+0000 7f03b3419740 1 -- 172.21.15.3:0/221031443 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03a4004440 con 0x55fc3b731670 2024-09-19T06:13:27.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.882+0000 7f038f400640 1 -- 172.21.15.3:0/221031443 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0394010e50 con 0x55fc3b731670 2024-09-19T06:13:27.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.882+0000 7f03b3419740 10 client.25540 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:27.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.882+0000 7f03b3419740 1 -- 172.21.15.3:0/221031443 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fc3b7b7130 con 0x55fc3b731670 2024-09-19T06:13:27.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.883+0000 7f038f400640 1 -- 172.21.15.3:0/221031443 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0394010e50 con 0x55fc3b731670 2024-09-19T06:13:27.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.883+0000 7f038f400640 1 -- 172.21.15.3:0/221031443 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f039403b050 con 0x55fc3b731670 2024-09-19T06:13:27.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.883+0000 7f03b3419740 10 client.25540 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:27.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.883+0000 7f03b3419740 10 client.25540 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:13:27.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.883+0000 7f03b3419740 20 client.25540 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:27.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.883+0000 7f03b3419740 1 --2- 172.21.15.3:0/221031443 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55fc3b7b7780 0x55fc3b7b9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:27.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.883+0000 7f03b3419740 4 client.25540 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:13:27.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.883+0000 7f03b3419740 1 -- 172.21.15.3:0/221031443 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fc3b69ee60 con 0x55fc3b7b7780 2024-09-19T06:13:27.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.884+0000 7f03a9e00640 1 --2- 172.21.15.3:0/221031443 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55fc3b7b7780 0x55fc3b7b9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:27.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.884+0000 7f03a9e00640 1 --2- 172.21.15.3:0/221031443 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55fc3b7b7780 0x55fc3b7b9ba0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71c500a732496237 server_cookie=f8b5369d1f583347 in_seq=0 out_seq=0 2024-09-19T06:13:27.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.884+0000 7f038f400640 10 client.25540 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:27.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.885+0000 7f038f400640 1 -- 172.21.15.3:0/221031443 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55fc3b69ee60 con 0x55fc3b7b7780 2024-09-19T06:13:27.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.885+0000 7f038f400640 10 client.25540 handle_command_reply: tid=0 2024-09-19T06:13:27.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.885+0000 7f03b3419740 1 client.25540 shutdown 2024-09-19T06:13:27.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.885+0000 7f03b3419740 1 -- 172.21.15.3:0/221031443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b731670 msgr2=0x55fc3b7408d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:27.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.885+0000 7f03b3419740 1 --2- 172.21.15.3:0/221031443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b731670 0x55fc3b7408d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0394009d30 tx=0x7f039400b000 comp rx=0 tx=0).stop 2024-09-19T06:13:27.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.885+0000 7f03b3419740 1 -- 172.21.15.3:0/221031443 shutdown_connections 2024-09-19T06:13:27.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.885+0000 7f03b3419740 1 --2- 172.21.15.3:0/221031443 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55fc3b7b7780 0x55fc3b7b9ba0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.885+0000 7f03b3419740 1 --2- 172.21.15.3:0/221031443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fc3b73bf30 0x55fc3b7b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.885+0000 7f03b3419740 1 --2- 172.21.15.3:0/221031443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fc3b731670 0x55fc3b7408d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.885+0000 7f03b3419740 1 --2- 172.21.15.3:0/221031443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fc3b730d50 0x55fc3b740390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.885+0000 7f03b3419740 1 -- 172.21.15.3:0/221031443 >> 172.21.15.3:0/221031443 conn(0x55fc3b72d2e0 msgr2=0x55fc3b746e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:27.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.885+0000 7f038f400640 0 client.25540 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:27.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.886+0000 7f03b3419740 1 -- 172.21.15.3:0/221031443 shutdown_connections 2024-09-19T06:13:27.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.886+0000 7f03b3419740 1 -- 172.21.15.3:0/221031443 wait complete. 2024-09-19T06:13:27.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.886+0000 7f03b3419740 20 client.25540 trim_cache size 0 max 16384 2024-09-19T06:13:27.892 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:13:27.892 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:13:27.893 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": { 2024-09-19T06:13:27.893 INFO:teuthology.orchestra.run.smithi003.stdout: "9f894eba-d95d-4b2f-8c9c-13b8572f2a63": { 2024-09-19T06:13:27.893 INFO:teuthology.orchestra.run.smithi003.stdout: "path": "/", 2024-09-19T06:13:27.893 INFO:teuthology.orchestra.run.smithi003.stdout: "tag": "9f894eba-d95d-4b2f-8c9c-13b8572f2a63", 2024-09-19T06:13:27.893 INFO:teuthology.orchestra.run.smithi003.stdout: "options": "recursive,force" 2024-09-19T06:13:27.893 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:13:27.893 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:13:27.893 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:13:27.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.887+0000 7f03ab200640 1 -- 172.21.15.3:0/854388429 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f03900a35e0 msgr2=0x7f03900a5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:27.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.887+0000 7f03ab200640 1 --2- 172.21.15.3:0/854388429 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f03900a35e0 0x7f03900a5aa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f039c005660 tx=0x7f039c009fd0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.887+0000 7f03ab200640 1 -- 172.21.15.3:0/854388429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ac105d90 msgr2=0x7f03ac19e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:27.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.887+0000 7f03ab200640 1 --2- 172.21.15.3:0/854388429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ac105d90 0x7f03ac19e700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f03a4009230 tx=0x7f03a4004040 comp rx=0 tx=0).stop 2024-09-19T06:13:27.894 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.887+0000 7f03ab200640 1 -- 172.21.15.3:0/854388429 shutdown_connections 2024-09-19T06:13:27.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.887+0000 7f03ab200640 1 --2- 172.21.15.3:0/854388429 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f03900a35e0 0x7f03900a5aa0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.887+0000 7f03ab200640 1 --2- 172.21.15.3:0/854388429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03ac105d90 0x7f03ac19e700 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.887+0000 7f03ab200640 1 --2- 172.21.15.3:0/854388429 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f03ac1012a0 0x7f03ac1a4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.887+0000 7f03ab200640 1 --2- 172.21.15.3:0/854388429 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f03ac100980 0x7f03ac1a4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:27.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.887+0000 7f03ab200640 1 -- 172.21.15.3:0/854388429 >> 172.21.15.3:0/854388429 conn(0x7f03ac0fc610 msgr2=0x7f03ac103740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:27.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.887+0000 7f03ab200640 1 -- 172.21.15.3:0/854388429 shutdown_connections 2024-09-19T06:13:27.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:27.887+0000 7f03ab200640 1 -- 172.21.15.3:0/854388429 wait complete. 2024-09-19T06:13:28.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:28 smithi059 ceph-mon[35138]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-19T06:13:28.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:28 smithi003 ceph-mon[30893]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-19T06:13:28.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:28 smithi071 ceph-mon[35662]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-19T06:13:28.844 INFO:tasks.cephfs.filesystem:scrub status for tag:9f894eba-d95d-4b2f-8c9c-13b8572f2a63 - {'path': '/', 'tag': '9f894eba-d95d-4b2f-8c9c-13b8572f2a63', 'options': 'recursive,force'} 2024-09-19T06:13:29.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:29 smithi059 ceph-mon[35138]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T06:13:29.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:29 smithi003 ceph-mon[30893]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T06:13:29.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:29 smithi071 ceph-mon[35662]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-19T06:13:30.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:30 smithi059 ceph-mon[35138]: scrub summary: idle 2024-09-19T06:13:30.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:30 smithi003 ceph-mon[30893]: scrub summary: idle 2024-09-19T06:13:30.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:30 smithi071 ceph-mon[35662]: scrub summary: idle 2024-09-19T06:13:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.398+0000 7f1283200640 1 -- 172.21.15.3:0/2554963155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1284102ae0 msgr2=0x7f1284102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.398+0000 7f1283200640 1 --2- 172.21.15.3:0/2554963155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1284102ae0 0x7f1284102ec0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1274009860 tx=0x7f127402a3d0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.398+0000 7f1283200640 1 -- 172.21.15.3:0/2554963155 shutdown_connections 2024-09-19T06:13:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.398+0000 7f1283200640 1 --2- 172.21.15.3:0/2554963155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f128410bf30 0x7f128410e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.398+0000 7f1283200640 1 --2- 172.21.15.3:0/2554963155 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1284103400 0x7f128410b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.398+0000 7f1283200640 1 --2- 172.21.15.3:0/2554963155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1284102ae0 0x7f1284102ec0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.398+0000 7f1283200640 1 -- 172.21.15.3:0/2554963155 >> 172.21.15.3:0/2554963155 conn(0x7f12840777f0 msgr2=0x7f12840feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:31.401 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.398+0000 7f1283200640 1 -- 172.21.15.3:0/2554963155 shutdown_connections 2024-09-19T06:13:31.401 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.398+0000 7f1283200640 1 -- 172.21.15.3:0/2554963155 wait complete. 2024-09-19T06:13:31.401 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.400+0000 7f1283200640 1 Processor -- start 2024-09-19T06:13:31.401 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.400+0000 7f1283200640 1 -- start start 2024-09-19T06:13:31.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.400+0000 7f1283200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1284102ae0 0x7f1284100730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:31.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.400+0000 7f1283200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1284103400 0x7f1284100c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:31.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.400+0000 7f1283200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f128410bf30 0x7f12841011b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:31.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.400+0000 7f1283200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1284111d60 con 0x7f1284103400 2024-09-19T06:13:31.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.400+0000 7f1283200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1284111be0 con 0x7f1284102ae0 2024-09-19T06:13:31.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.400+0000 7f1283200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1284111ee0 con 0x7f128410bf30 2024-09-19T06:13:31.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.401+0000 7f1281e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1284102ae0 0x7f1284100730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:31.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.401+0000 7f1281e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1284102ae0 0x7f1284100730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:41672/0 (socket says 172.21.15.3:41672) 2024-09-19T06:13:31.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.401+0000 7f1281e00640 1 -- 172.21.15.3:0/2902837634 learned_addr learned my addr 172.21.15.3:0/2902837634 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:31.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.401+0000 7f1281400640 1 --2- 172.21.15.3:0/2902837634 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1284103400 0x7f1284100c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:31.404 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.401+0000 7f1282800640 1 --2- 172.21.15.3:0/2902837634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f128410bf30 0x7f12841011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:31.404 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.401+0000 7f1281e00640 1 -- 172.21.15.3:0/2902837634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f128410bf30 msgr2=0x7f12841011b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:31.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.401+0000 7f1281e00640 1 --2- 172.21.15.3:0/2902837634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f128410bf30 0x7f12841011b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.401+0000 7f1281e00640 1 -- 172.21.15.3:0/2902837634 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1284103400 msgr2=0x7f1284100c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:31.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.401+0000 7f1281e00640 1 --2- 172.21.15.3:0/2902837634 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1284103400 0x7f1284100c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.402+0000 7f1281e00640 1 -- 172.21.15.3:0/2902837634 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12841a6750 con 0x7f1284102ae0 2024-09-19T06:13:31.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.402+0000 7f1281e00640 1 --2- 172.21.15.3:0/2902837634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1284102ae0 0x7f1284100730 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1274009980 tx=0x7f12740309a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:31.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.402+0000 7f127aa00640 1 -- 172.21.15.3:0/2902837634 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1274040070 con 0x7f1284102ae0 2024-09-19T06:13:31.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.402+0000 7f127aa00640 1 -- 172.21.15.3:0/2902837634 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1274005620 con 0x7f1284102ae0 2024-09-19T06:13:31.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.402+0000 7f127aa00640 1 -- 172.21.15.3:0/2902837634 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12740049b0 con 0x7f1284102ae0 2024-09-19T06:13:31.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.402+0000 7f1283200640 1 -- 172.21.15.3:0/2902837634 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12841a69e0 con 0x7f1284102ae0 2024-09-19T06:13:31.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.402+0000 7f1283200640 1 -- 172.21.15.3:0/2902837634 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12841a6e80 con 0x7f1284102ae0 2024-09-19T06:13:31.409 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.407+0000 7f128bad4740 1 Processor -- start 2024-09-19T06:13:31.410 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.407+0000 7f128bad4740 1 -- start start 2024-09-19T06:13:31.410 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.407+0000 7f127aa00640 1 -- 172.21.15.3:0/2902837634 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 138587+0+0 (secure 0 0 0) 0x7f1274043070 con 0x7f1284102ae0 2024-09-19T06:13:31.410 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.408+0000 7f128bad4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb311bc0 0x5596bb311fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:31.410 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.408+0000 7f128bad4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596bb3124e0 0x5596bb31c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:31.410 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.408+0000 7f128bad4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596bb31cd80 0x5596bb31f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:31.410 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.408+0000 7f128bad4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5596bb26f100 con 0x5596bb31cd80 2024-09-19T06:13:31.410 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.408+0000 7f128bad4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5596bb2171b0 con 0x5596bb3124e0 2024-09-19T06:13:31.411 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.408+0000 7f128bad4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5596bb26b0c0 con 0x5596bb311bc0 2024-09-19T06:13:31.411 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.408+0000 7f1282800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb311bc0 0x5596bb311fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:31.411 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.408+0000 7f1282800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb311bc0 0x5596bb311fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:35690/0 (socket says 172.21.15.3:35690) 2024-09-19T06:13:31.411 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.408+0000 7f1282800640 1 -- 172.21.15.3:0/4132523185 learned_addr learned my addr 172.21.15.3:0/4132523185 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:31.412 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.409+0000 7f1281400640 1 --2- 172.21.15.3:0/4132523185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596bb31cd80 0x5596bb31f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:31.412 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.409+0000 7f1281e00640 1 --2- 172.21.15.3:0/4132523185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596bb3124e0 0x5596bb31c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:31.412 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.409+0000 7f1282800640 1 -- 172.21.15.3:0/4132523185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596bb3124e0 msgr2=0x5596bb31c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:31.412 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.409+0000 7f1282800640 1 --2- 172.21.15.3:0/4132523185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596bb3124e0 0x5596bb31c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.412 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.409+0000 7f1282800640 1 -- 172.21.15.3:0/4132523185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596bb31cd80 msgr2=0x5596bb31f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:31.412 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.409+0000 7f1282800640 1 --2- 172.21.15.3:0/4132523185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596bb31cd80 0x5596bb31f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.412 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.409+0000 7f1282800640 1 -- 172.21.15.3:0/4132523185 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596baf82210 con 0x5596bb311bc0 2024-09-19T06:13:31.412 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.410+0000 7f1281400640 1 --2- 172.21.15.3:0/4132523185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596bb31cd80 0x5596bb31f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:31.412 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.410+0000 7f127aa00640 1 --2- 172.21.15.3:0/2902837634 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f12680a35c0 0x7f12680a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:31.412 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.410+0000 7f127aa00640 1 -- 172.21.15.3:0/2902837634 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f12740f0d00 con 0x7f1284102ae0 2024-09-19T06:13:31.413 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.410+0000 7f1282800640 1 --2- 172.21.15.3:0/4132523185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb311bc0 0x5596bb311fa0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f127c00f400 tx=0x7f127c00f8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8e0a609e5e9e7b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:31.413 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.410+0000 7f126f000640 1 -- 172.21.15.3:0/4132523185 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c01d070 con 0x5596bb311bc0 2024-09-19T06:13:31.413 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.411+0000 7f126f000640 1 -- 172.21.15.3:0/4132523185 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f127c00cb20 con 0x5596bb311bc0 2024-09-19T06:13:31.413 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.411+0000 7f126f000640 1 -- 172.21.15.3:0/4132523185 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c018cc0 con 0x5596bb311bc0 2024-09-19T06:13:31.413 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.411+0000 7f1281e00640 1 --2- 172.21.15.3:0/2902837634 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f12680a35c0 0x7f12680a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:31.414 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.412+0000 7f128bad4740 1 -- 172.21.15.3:0/4132523185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb311bc0 msgr2=0x5596bb311fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:31.414 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.412+0000 7f128bad4740 1 --2- 172.21.15.3:0/4132523185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb311bc0 0x5596bb311fa0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f127c00f400 tx=0x7f127c00f8c0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.414 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.412+0000 7f128bad4740 1 -- 172.21.15.3:0/4132523185 shutdown_connections 2024-09-19T06:13:31.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.412+0000 7f128bad4740 1 --2- 172.21.15.3:0/4132523185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596bb31cd80 0x5596bb31f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.412+0000 7f128bad4740 1 --2- 172.21.15.3:0/4132523185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596bb3124e0 0x5596bb31c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.412+0000 7f128bad4740 1 --2- 172.21.15.3:0/4132523185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb311bc0 0x5596bb311fa0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.412+0000 7f128bad4740 1 -- 172.21.15.3:0/4132523185 >> 172.21.15.3:0/4132523185 conn(0x5596bb30e130 msgr2=0x5596bb30e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:31.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.413+0000 7f1281e00640 1 --2- 172.21.15.3:0/2902837634 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f12680a35c0 0x7f12680a5a80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f12740ee2d0 tx=0x7f127402a3d0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:31.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.413+0000 7f128bad4740 1 -- 172.21.15.3:0/4132523185 shutdown_connections 2024-09-19T06:13:31.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.413+0000 7f128bad4740 1 -- 172.21.15.3:0/4132523185 wait complete. 2024-09-19T06:13:31.416 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.413+0000 7f128bad4740 1 -- start start 2024-09-19T06:13:31.416 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.414+0000 7f128bad4740 1 Processor -- start 2024-09-19T06:13:31.416 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.414+0000 7f128bad4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596bb311bc0 0x5596bb319e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:31.416 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.414+0000 7f128bad4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb3124e0 0x5596bb31a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:31.417 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.414+0000 7f128bad4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596bb31cd80 0x5596bb31a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:31.417 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.414+0000 7f128bad4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5596bb31f950 con 0x5596bb31cd80 2024-09-19T06:13:31.417 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.414+0000 7f128bad4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5596bb1f8090 con 0x5596bb311bc0 2024-09-19T06:13:31.417 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.414+0000 7f128bad4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5596bb31fad0 con 0x5596bb3124e0 2024-09-19T06:13:31.417 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.414+0000 7f128bad4740 10 client.0 _ll_register_callbacks cb 0x5596bb24cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:31.417 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.415+0000 7f1281400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb3124e0 0x5596bb31a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:31.417 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.415+0000 7f1281400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb3124e0 0x5596bb31a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:35704/0 (socket says 172.21.15.3:35704) 2024-09-19T06:13:31.418 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.415+0000 7f1281400640 1 -- 172.21.15.3:0/3560417553 learned_addr learned my addr 172.21.15.3:0/3560417553 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:31.418 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.415+0000 7f1282800640 1 --2- 172.21.15.3:0/3560417553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596bb311bc0 0x5596bb319e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:31.418 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.415+0000 7f1282800640 1 --2- 172.21.15.3:0/3560417553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596bb31cd80 0x5596bb31a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:31.418 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.415+0000 7f1281400640 1 -- 172.21.15.3:0/3560417553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596bb311bc0 msgr2=0x5596bb319e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:31.418 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.415+0000 7f1281400640 1 --2- 172.21.15.3:0/3560417553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596bb311bc0 0x5596bb319e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.418 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.415+0000 7f1281400640 1 -- 172.21.15.3:0/3560417553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596bb31cd80 msgr2=0x5596bb31a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:31.418 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.415+0000 7f1281400640 1 --2- 172.21.15.3:0/3560417553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596bb31cd80 0x5596bb31a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.418 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.415+0000 7f1281400640 1 -- 172.21.15.3:0/3560417553 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596bb04e620 con 0x5596bb3124e0 2024-09-19T06:13:31.419 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.416+0000 7f1281400640 1 --2- 172.21.15.3:0/3560417553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb3124e0 0x5596bb31a340 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1270012700 tx=0x7f1270012bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=162b3ca60888d260 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:31.419 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.416+0000 7f1263400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:13:31.419 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.416+0000 7f1263400640 1 -- 172.21.15.3:0/3560417553 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1270004050 con 0x5596bb3124e0 2024-09-19T06:13:31.419 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.416+0000 7f1263400640 1 -- 172.21.15.3:0/3560417553 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f12700041f0 con 0x5596bb3124e0 2024-09-19T06:13:31.420 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.416+0000 7f128bad4740 1 -- 172.21.15.3:0/3560417553 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f127c00cb20 con 0x5596bb3124e0 2024-09-19T06:13:31.420 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.417+0000 7f1263400640 1 -- 172.21.15.3:0/3560417553 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1270004430 con 0x5596bb3124e0 2024-09-19T06:13:31.420 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.417+0000 7f128bad4740 10 client.25552 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:31.420 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.417+0000 7f128bad4740 1 -- 172.21.15.3:0/3560417553 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5596bb32b7a0 con 0x5596bb3124e0 2024-09-19T06:13:31.420 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.417+0000 7f1263400640 1 -- 172.21.15.3:0/3560417553 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f127c00cb20 con 0x5596bb3124e0 2024-09-19T06:13:31.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.418+0000 7f1263400640 1 -- 172.21.15.3:0/3560417553 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f1270003c10 con 0x5596bb3124e0 2024-09-19T06:13:31.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.418+0000 7f128bad4740 10 client.25552 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:31.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.418+0000 7f128bad4740 10 client.25552 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:13:31.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.418+0000 7f128bad4740 20 client.25552 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:31.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.418+0000 7f128bad4740 1 --2- 172.21.15.3:0/3560417553 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5596bb32cc60 0x5596bb32f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:31.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.418+0000 7f128bad4740 4 client.25552 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:13:31.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.418+0000 7f128bad4740 1 -- 172.21.15.3:0/3560417553 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596bb27c830 con 0x5596bb32cc60 2024-09-19T06:13:31.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.419+0000 7f1282800640 1 --2- 172.21.15.3:0/3560417553 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5596bb32cc60 0x5596bb32f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:31.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.419+0000 7f1282800640 1 --2- 172.21.15.3:0/3560417553 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5596bb32cc60 0x5596bb32f050 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bf57c5fb39b7215 server_cookie=fcc2a00c282c7e85 in_seq=0 out_seq=0 2024-09-19T06:13:31.422 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.419+0000 7f1263400640 10 client.25552 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:31.422 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.420+0000 7f1263400640 1 -- 172.21.15.3:0/3560417553 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5596bb27c830 con 0x5596bb32cc60 2024-09-19T06:13:31.423 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.420+0000 7f1263400640 10 client.25552 handle_command_reply: tid=0 2024-09-19T06:13:31.423 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.420+0000 7f128bad4740 1 client.25552 shutdown 2024-09-19T06:13:31.423 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.420+0000 7f128bad4740 1 -- 172.21.15.3:0/3560417553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb3124e0 msgr2=0x5596bb31a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:31.423 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.420+0000 7f128bad4740 1 --2- 172.21.15.3:0/3560417553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb3124e0 0x5596bb31a340 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1270012700 tx=0x7f1270012bc0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.423 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.420+0000 7f128bad4740 1 -- 172.21.15.3:0/3560417553 shutdown_connections 2024-09-19T06:13:31.423 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.420+0000 7f128bad4740 1 --2- 172.21.15.3:0/3560417553 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5596bb32cc60 0x5596bb32f050 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.423 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.420+0000 7f128bad4740 1 --2- 172.21.15.3:0/3560417553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596bb31cd80 0x5596bb31a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.423 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.420+0000 7f128bad4740 1 --2- 172.21.15.3:0/3560417553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb3124e0 0x5596bb31a340 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.423 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.420+0000 7f128bad4740 1 --2- 172.21.15.3:0/3560417553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596bb311bc0 0x5596bb319e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.423 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.420+0000 7f128bad4740 1 -- 172.21.15.3:0/3560417553 >> 172.21.15.3:0/3560417553 conn(0x5596bb30e130 msgr2=0x5596bb313e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:31.423 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.420+0000 7f1263400640 0 client.25552 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:31.423 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.421+0000 7f128bad4740 1 -- 172.21.15.3:0/3560417553 shutdown_connections 2024-09-19T06:13:31.424 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.421+0000 7f128bad4740 1 -- 172.21.15.3:0/3560417553 wait complete. 2024-09-19T06:13:31.424 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.421+0000 7f128bad4740 20 client.25552 trim_cache size 0 max 16384 2024-09-19T06:13:31.438 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.436+0000 7f128bad4740 1 Processor -- start 2024-09-19T06:13:31.438 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.437+0000 7f128bad4740 1 -- start start 2024-09-19T06:13:31.439 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.437+0000 7f128bad4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb311bc0 0x5596bb31a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:31.439 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.437+0000 7f128bad4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596bb3124e0 0x5596bb3348d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:31.439 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.437+0000 7f128bad4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596bb31cd80 0x5596bb334e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:31.439 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.437+0000 7f128bad4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f12841ab5e0 con 0x5596bb31cd80 2024-09-19T06:13:31.439 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.437+0000 7f128bad4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f12841ad120 con 0x5596bb3124e0 2024-09-19T06:13:31.439 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.437+0000 7f128bad4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f12841abcb0 con 0x5596bb311bc0 2024-09-19T06:13:31.440 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.437+0000 7f1282800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb311bc0 0x5596bb31a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:31.440 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.438+0000 7f1281400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596bb3124e0 0x5596bb3348d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:31.440 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.438+0000 7f1281400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596bb3124e0 0x5596bb3348d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:41714/0 (socket says 172.21.15.3:41714) 2024-09-19T06:13:31.440 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.438+0000 7f1281400640 1 -- 172.21.15.3:0/2563519179 learned_addr learned my addr 172.21.15.3:0/2563519179 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:31.440 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.438+0000 7f1282800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb311bc0 0x5596bb31a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:35706/0 (socket says 172.21.15.3:35706) 2024-09-19T06:13:31.440 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.438+0000 7f1282800640 1 --2- 172.21.15.3:0/2563519179 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596bb31cd80 0x5596bb334e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:31.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.438+0000 7f1281400640 1 -- 172.21.15.3:0/2563519179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb311bc0 msgr2=0x5596bb31a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:31.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.438+0000 7f1281400640 1 --2- 172.21.15.3:0/2563519179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb311bc0 0x5596bb31a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.438+0000 7f1281400640 1 -- 172.21.15.3:0/2563519179 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596bb31cd80 msgr2=0x5596bb334e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:31.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.438+0000 7f1281400640 1 --2- 172.21.15.3:0/2563519179 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596bb31cd80 0x5596bb334e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.438+0000 7f1281400640 1 -- 172.21.15.3:0/2563519179 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596bb318350 con 0x5596bb3124e0 2024-09-19T06:13:31.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.438+0000 7f1281400640 1 --2- 172.21.15.3:0/2563519179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596bb3124e0 0x5596bb3348d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1270000c00 tx=0x7f127000f850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2ed042e61ac877 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:31.442 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.439+0000 7f126e600640 1 -- 172.21.15.3:0/2563519179 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1270032070 con 0x5596bb3124e0 2024-09-19T06:13:31.442 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.439+0000 7f126e600640 1 -- 172.21.15.3:0/2563519179 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f127000fe00 con 0x5596bb3124e0 2024-09-19T06:13:31.442 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.439+0000 7f126e600640 1 -- 172.21.15.3:0/2563519179 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1270029040 con 0x5596bb3124e0 2024-09-19T06:13:31.443 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.440+0000 7f128bad4740 1 -- 172.21.15.3:0/2563519179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596bb3124e0 msgr2=0x5596bb3348d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:31.443 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.440+0000 7f128bad4740 1 --2- 172.21.15.3:0/2563519179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596bb3124e0 0x5596bb3348d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1270000c00 tx=0x7f127000f850 comp rx=0 tx=0).stop 2024-09-19T06:13:31.443 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.440+0000 7f128bad4740 1 -- 172.21.15.3:0/2563519179 shutdown_connections 2024-09-19T06:13:31.443 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.440+0000 7f128bad4740 1 --2- 172.21.15.3:0/2563519179 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596bb31cd80 0x5596bb334e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.443 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.440+0000 7f128bad4740 1 --2- 172.21.15.3:0/2563519179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596bb3124e0 0x5596bb3348d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.443 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.440+0000 7f128bad4740 1 --2- 172.21.15.3:0/2563519179 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb311bc0 0x5596bb31a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.443 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.440+0000 7f128bad4740 1 -- 172.21.15.3:0/2563519179 >> 172.21.15.3:0/2563519179 conn(0x5596bb30e130 msgr2=0x5596bb315100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:31.443 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.440+0000 7f128bad4740 1 -- 172.21.15.3:0/2563519179 shutdown_connections 2024-09-19T06:13:31.443 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.440+0000 7f128bad4740 1 -- 172.21.15.3:0/2563519179 wait complete. 2024-09-19T06:13:31.443 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.440+0000 7f128bad4740 1 -- start start 2024-09-19T06:13:31.443 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.441+0000 7f128bad4740 1 Processor -- start 2024-09-19T06:13:31.445 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.441+0000 7f128bad4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb311bc0 0x5596bb3253b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:31.445 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.441+0000 7f128bad4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596bb3124e0 0x5596bb316a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:31.445 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.441+0000 7f128bad4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596bb31cd80 0x5596bb316f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:31.445 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.441+0000 7f128bad4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f12841aca50 con 0x5596bb3124e0 2024-09-19T06:13:31.445 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.441+0000 7f128bad4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f12841ac380 con 0x5596bb31cd80 2024-09-19T06:13:31.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.441+0000 7f128bad4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f12841a95c0 con 0x5596bb311bc0 2024-09-19T06:13:31.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.441+0000 7f128bad4740 10 client.0 _ll_register_callbacks cb 0x7f1270009840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:31.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.442+0000 7f1282800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb311bc0 0x5596bb3253b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:31.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.442+0000 7f1282800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb311bc0 0x5596bb3253b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:35712/0 (socket says 172.21.15.3:35712) 2024-09-19T06:13:31.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.442+0000 7f1282800640 1 -- 172.21.15.3:0/1910795552 learned_addr learned my addr 172.21.15.3:0/1910795552 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:31.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.442+0000 7f1282800640 1 --2- 172.21.15.3:0/1910795552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596bb31cd80 0x5596bb316f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:31.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.442+0000 7f1281400640 1 --2- 172.21.15.3:0/1910795552 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596bb3124e0 0x5596bb316a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:31.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.442+0000 7f1282800640 1 -- 172.21.15.3:0/1910795552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596bb31cd80 msgr2=0x5596bb316f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:31.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.442+0000 7f1282800640 1 --2- 172.21.15.3:0/1910795552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596bb31cd80 0x5596bb316f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.442+0000 7f1282800640 1 -- 172.21.15.3:0/1910795552 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596bb3124e0 msgr2=0x5596bb316a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:31.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.442+0000 7f1282800640 1 --2- 172.21.15.3:0/1910795552 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596bb3124e0 0x5596bb316a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.442+0000 7f1282800640 1 -- 172.21.15.3:0/1910795552 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596bb3176b0 con 0x5596bb311bc0 2024-09-19T06:13:31.447 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.443+0000 7f1281400640 1 --2- 172.21.15.3:0/1910795552 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596bb3124e0 0x5596bb316a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:13:31.447 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.443+0000 7f1282800640 1 --2- 172.21.15.3:0/1910795552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb311bc0 0x5596bb3253b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f127c0185d0 tx=0x7f127c00f8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eecf53139f74c53b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:31.447 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.443+0000 7f1263400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:13:31.447 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.443+0000 7f1263400640 1 -- 172.21.15.3:0/1910795552 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c01d040 con 0x5596bb311bc0 2024-09-19T06:13:31.447 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.443+0000 7f1263400640 1 -- 172.21.15.3:0/1910795552 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f127c015040 con 0x5596bb311bc0 2024-09-19T06:13:31.447 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.443+0000 7f128bad4740 1 -- 172.21.15.3:0/1910795552 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f127000fe00 con 0x5596bb311bc0 2024-09-19T06:13:31.448 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.444+0000 7f1263400640 1 -- 172.21.15.3:0/1910795552 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f127c00c640 con 0x5596bb311bc0 2024-09-19T06:13:31.448 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.444+0000 7f128bad4740 10 client.25558 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:31.448 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.444+0000 7f128bad4740 1 -- 172.21.15.3:0/1910795552 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5596bb3977c0 con 0x5596bb311bc0 2024-09-19T06:13:31.448 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.444+0000 7f1263400640 1 -- 172.21.15.3:0/1910795552 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f127000fe00 con 0x5596bb311bc0 2024-09-19T06:13:31.448 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.444+0000 7f1263400640 1 -- 172.21.15.3:0/1910795552 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f127c00b040 con 0x5596bb311bc0 2024-09-19T06:13:31.448 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.444+0000 7f128bad4740 10 client.25558 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:31.448 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.444+0000 7f128bad4740 10 client.25558 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:13:31.449 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.444+0000 7f128bad4740 20 client.25558 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:31.449 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.444+0000 7f128bad4740 1 --2- 172.21.15.3:0/1910795552 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5596bb397c50 0x5596bb39a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:31.449 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.444+0000 7f128bad4740 4 client.25558 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:13:31.449 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.444+0000 7f128bad4740 1 -- 172.21.15.3:0/1910795552 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5596bb276b80 con 0x5596bb397c50 2024-09-19T06:13:31.449 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.445+0000 7f1281400640 1 --2- 172.21.15.3:0/1910795552 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5596bb397c50 0x5596bb39a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:31.449 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.445+0000 7f1281400640 1 --2- 172.21.15.3:0/1910795552 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5596bb397c50 0x5596bb39a040 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8e1c17a37474d9 server_cookie=b06072de56abd1ed in_seq=0 out_seq=0 2024-09-19T06:13:31.449 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.445+0000 7f1263400640 10 client.25558 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:31.451 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.449+0000 7f1263400640 1 -- 172.21.15.3:0/1910795552 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5596bb276b80 con 0x5596bb397c50 2024-09-19T06:13:31.451 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.449+0000 7f1263400640 10 client.25558 handle_command_reply: tid=0 2024-09-19T06:13:31.451 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.449+0000 7f128bad4740 1 client.25558 shutdown 2024-09-19T06:13:31.451 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.449+0000 7f128bad4740 1 -- 172.21.15.3:0/1910795552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb311bc0 msgr2=0x5596bb3253b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:31.451 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.450+0000 7f128bad4740 1 --2- 172.21.15.3:0/1910795552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb311bc0 0x5596bb3253b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f127c0185d0 tx=0x7f127c00f8c0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.452 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.450+0000 7f128bad4740 1 -- 172.21.15.3:0/1910795552 shutdown_connections 2024-09-19T06:13:31.452 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.450+0000 7f128bad4740 1 --2- 172.21.15.3:0/1910795552 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5596bb397c50 0x5596bb39a040 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.452 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.450+0000 7f128bad4740 1 --2- 172.21.15.3:0/1910795552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596bb31cd80 0x5596bb316f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.452 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.450+0000 7f128bad4740 1 --2- 172.21.15.3:0/1910795552 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5596bb3124e0 0x5596bb316a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.452 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.450+0000 7f128bad4740 1 --2- 172.21.15.3:0/1910795552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5596bb311bc0 0x5596bb3253b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.452 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.450+0000 7f128bad4740 1 -- 172.21.15.3:0/1910795552 >> 172.21.15.3:0/1910795552 conn(0x5596bb30e130 msgr2=0x5596bb313620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:31.453 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.450+0000 7f1263400640 0 client.25558 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:31.453 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.450+0000 7f128bad4740 1 -- 172.21.15.3:0/1910795552 shutdown_connections 2024-09-19T06:13:31.453 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.450+0000 7f128bad4740 1 -- 172.21.15.3:0/1910795552 wait complete. 2024-09-19T06:13:31.453 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.451+0000 7f128bad4740 20 client.25558 trim_cache size 0 max 16384 2024-09-19T06:13:31.453 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:13:31.453 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:13:31.453 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:13:31.453 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:13:31.457 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.455+0000 7f1283200640 1 -- 172.21.15.3:0/2902837634 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f12680a35c0 msgr2=0x7f12680a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:31.457 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.455+0000 7f1283200640 1 --2- 172.21.15.3:0/2902837634 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f12680a35c0 0x7f12680a5a80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f12740ee2d0 tx=0x7f127402a3d0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.457 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.455+0000 7f1283200640 1 -- 172.21.15.3:0/2902837634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1284102ae0 msgr2=0x7f1284100730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:31.457 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.455+0000 7f1283200640 1 --2- 172.21.15.3:0/2902837634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1284102ae0 0x7f1284100730 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1274009980 tx=0x7f12740309a0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.457 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.455+0000 7f1283200640 1 -- 172.21.15.3:0/2902837634 shutdown_connections 2024-09-19T06:13:31.457 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.455+0000 7f1283200640 1 --2- 172.21.15.3:0/2902837634 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f12680a35c0 0x7f12680a5a80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.457 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.455+0000 7f1283200640 1 --2- 172.21.15.3:0/2902837634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f128410bf30 0x7f12841011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.457 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.455+0000 7f1283200640 1 --2- 172.21.15.3:0/2902837634 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1284103400 0x7f1284100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.458 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.455+0000 7f1283200640 1 --2- 172.21.15.3:0/2902837634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1284102ae0 0x7f1284100730 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:31.458 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.455+0000 7f1283200640 1 -- 172.21.15.3:0/2902837634 >> 172.21.15.3:0/2902837634 conn(0x7f12840777f0 msgr2=0x7f12840fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:31.458 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.455+0000 7f1283200640 1 -- 172.21.15.3:0/2902837634 shutdown_connections 2024-09-19T06:13:31.458 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:31.455+0000 7f1283200640 1 -- 172.21.15.3:0/2902837634 wait complete. 2024-09-19T06:13:31.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:31 smithi059 ceph-mon[35138]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1023 B/s wr, 15 op/s 2024-09-19T06:13:31.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:31 smithi003 ceph-mon[30893]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1023 B/s wr, 15 op/s 2024-09-19T06:13:31.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:31 smithi071 ceph-mon[35662]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1023 B/s wr, 15 op/s 2024-09-19T06:13:33.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:33 smithi059 ceph-mon[35138]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-19T06:13:33.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:33 smithi003 ceph-mon[30893]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-19T06:13:33.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:33 smithi071 ceph-mon[35662]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-19T06:13:35.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:35 smithi059 ceph-mon[35138]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 255 B/s wr, 14 op/s 2024-09-19T06:13:35.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:35 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:13:35.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:35 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:13:35.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:35 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:13:35.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:35 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:13:35.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:35 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:13:35.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:35 smithi003 ceph-mon[30893]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 255 B/s wr, 14 op/s 2024-09-19T06:13:35.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:35 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:13:35.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:35 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:13:35.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:35 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:13:35.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:35 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:13:35.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:35 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:13:35.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:35 smithi071 ceph-mon[35662]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 255 B/s wr, 14 op/s 2024-09-19T06:13:35.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:35 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:13:35.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:35 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:13:35.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:35 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:13:35.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:35 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:13:35.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:35 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:13:36.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:36 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:13:36.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:36 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:13:36.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:36 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:13:36.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:36 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:13:36.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:36 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:13:36.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:36 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:13:36.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:36 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:13:36.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:36 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:13:36.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:36 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:13:38.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:37 smithi003 ceph-mon[30893]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T06:13:38.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:37 smithi071 ceph-mon[35662]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T06:13:38.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:37 smithi059 ceph-mon[35138]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-19T06:13:40.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:39 smithi003 ceph-mon[30893]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-19T06:13:40.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:39 smithi071 ceph-mon[35662]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-19T06:13:40.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:39 smithi059 ceph-mon[35138]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-19T06:13:42.079 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:41 smithi003 ceph-mon[30893]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-19T06:13:42.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:41 smithi071 ceph-mon[35662]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-19T06:13:42.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:41 smithi059 ceph-mon[35138]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-19T06:13:44.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:43 smithi003 ceph-mon[30893]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T06:13:44.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:43 smithi071 ceph-mon[35662]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T06:13:44.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:43 smithi059 ceph-mon[35138]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T06:13:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.583+0000 7f09b5200640 1 -- 172.21.15.3:0/3250768469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09b0103f30 msgr2=0x7f09b0104310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.583+0000 7f09b5200640 1 --2- 172.21.15.3:0/3250768469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09b0103f30 0x7f09b0104310 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f09a0009860 tx=0x7f09a002a340 comp rx=0 tx=0).stop 2024-09-19T06:13:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.583+0000 7f09b5200640 1 -- 172.21.15.3:0/3250768469 shutdown_connections 2024-09-19T06:13:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.583+0000 7f09b5200640 1 --2- 172.21.15.3:0/3250768469 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b0109080 0x7f09b0110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.585 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.583+0000 7f09b5200640 1 --2- 172.21.15.3:0/3250768469 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09b01048e0 0x7f09b0108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.586 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.583+0000 7f09b5200640 1 --2- 172.21.15.3:0/3250768469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09b0103f30 0x7f09b0104310 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.586 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.583+0000 7f09b5200640 1 -- 172.21.15.3:0/3250768469 >> 172.21.15.3:0/3250768469 conn(0x7f09b00ff980 msgr2=0x7f09b0101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:44.586 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.583+0000 7f09b5200640 1 -- 172.21.15.3:0/3250768469 shutdown_connections 2024-09-19T06:13:44.586 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.583+0000 7f09b5200640 1 -- 172.21.15.3:0/3250768469 wait complete. 2024-09-19T06:13:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.584+0000 7f09b5200640 1 Processor -- start 2024-09-19T06:13:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.584+0000 7f09b5200640 1 -- start start 2024-09-19T06:13:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.584+0000 7f09b5200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b0103f30 0x7f09b019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.584+0000 7f09b5200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09b0109080 0x7f09b019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.585+0000 7f09b5200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09b019eed0 0x7f09b019f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.585+0000 7f09b5200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01140a0 con 0x7f09b019eed0 2024-09-19T06:13:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.585+0000 7f09b5200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f09b0113f20 con 0x7f09b0109080 2024-09-19T06:13:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.585+0000 7f09b5200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f09b0114220 con 0x7f09b0103f30 2024-09-19T06:13:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.585+0000 7f09ade00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b0103f30 0x7f09b019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.585+0000 7f09ad400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09b0109080 0x7f09b019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:44.589 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.585+0000 7f09ae800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09b019eed0 0x7f09b019f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:44.589 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.585+0000 7f09ad400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09b0109080 0x7f09b019ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:53080/0 (socket says 172.21.15.3:53080) 2024-09-19T06:13:44.589 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.585+0000 7f09ade00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b0103f30 0x7f09b019a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:52038/0 (socket says 172.21.15.3:52038) 2024-09-19T06:13:44.589 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.585+0000 7f09ad400640 1 -- 172.21.15.3:0/190141083 learned_addr learned my addr 172.21.15.3:0/190141083 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:44.589 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.585+0000 7f09ad400640 1 -- 172.21.15.3:0/190141083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b0103f30 msgr2=0x7f09b019a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:44.589 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.585+0000 7f09ad400640 1 --2- 172.21.15.3:0/190141083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b0103f30 0x7f09b019a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.589 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.585+0000 7f09ad400640 1 -- 172.21.15.3:0/190141083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09b019eed0 msgr2=0x7f09b019f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:44.589 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.585+0000 7f09ad400640 1 --2- 172.21.15.3:0/190141083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09b019eed0 0x7f09b019f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.589 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.585+0000 7f09ad400640 1 -- 172.21.15.3:0/190141083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09b019f9c0 con 0x7f09b0109080 2024-09-19T06:13:44.589 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.586+0000 7f09ad400640 1 --2- 172.21.15.3:0/190141083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09b0109080 0x7f09b019ab50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f099c00e9f0 tx=0x7f099c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:44.589 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.586+0000 7f09a6a00640 1 -- 172.21.15.3:0/190141083 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099c00ccc0 con 0x7f09b0109080 2024-09-19T06:13:44.589 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.586+0000 7f09b5200640 1 -- 172.21.15.3:0/190141083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09b019fcb0 con 0x7f09b0109080 2024-09-19T06:13:44.589 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.586+0000 7f09a6a00640 1 -- 172.21.15.3:0/190141083 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f099c010910 con 0x7f09b0109080 2024-09-19T06:13:44.590 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.586+0000 7f09a6a00640 1 -- 172.21.15.3:0/190141083 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099c018960 con 0x7f09b0109080 2024-09-19T06:13:44.590 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.586+0000 7f09b5200640 1 -- 172.21.15.3:0/190141083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09b01a74a0 con 0x7f09b0109080 2024-09-19T06:13:44.591 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.589+0000 7f09b8020740 1 Processor -- start 2024-09-19T06:13:44.591 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.589+0000 7f09b8020740 1 -- start start 2024-09-19T06:13:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.589+0000 7f09b8020740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a996d501e0 0x55a996d505c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.589+0000 7f09b8020740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a996d50b00 0x55a996d5ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.589+0000 7f09b8020740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d5b3a0 0x55a996d5d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.589+0000 7f09b8020740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a996cb6100 con 0x55a996d501e0 2024-09-19T06:13:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.589+0000 7f09b8020740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a996c5e1b0 con 0x55a996d5b3a0 2024-09-19T06:13:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.589+0000 7f09b8020740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a996cb20c0 con 0x55a996d50b00 2024-09-19T06:13:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.590+0000 7f09ae800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a996d501e0 0x55a996d505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.590+0000 7f09a6a00640 1 -- 172.21.15.3:0/190141083 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 26) ==== 138587+0+0 (secure 0 0 0) 0x7f099c010ac0 con 0x7f09b0109080 2024-09-19T06:13:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.590+0000 7f09ade00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a996d50b00 0x55a996d5ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.590+0000 7f09ade00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a996d50b00 0x55a996d5ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:52050/0 (socket says 172.21.15.3:52050) 2024-09-19T06:13:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.590+0000 7f09ade00640 1 -- 172.21.15.3:0/2215608884 learned_addr learned my addr 172.21.15.3:0/2215608884 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.590+0000 7f09ad400640 1 --2- 172.21.15.3:0/2215608884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d5b3a0 0x55a996d5d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.590+0000 7f09ae800640 1 -- 172.21.15.3:0/2215608884 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a996d50b00 msgr2=0x55a996d5ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.590+0000 7f09ae800640 1 --2- 172.21.15.3:0/2215608884 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a996d50b00 0x55a996d5ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.590+0000 7f09ae800640 1 -- 172.21.15.3:0/2215608884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d5b3a0 msgr2=0x55a996d5d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.590+0000 7f09ae800640 1 --2- 172.21.15.3:0/2215608884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d5b3a0 0x55a996d5d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.590+0000 7f09ae800640 1 -- 172.21.15.3:0/2215608884 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9969c9210 con 0x55a996d501e0 2024-09-19T06:13:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.590+0000 7f09ade00640 1 --2- 172.21.15.3:0/2215608884 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a996d50b00 0x55a996d5ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.591+0000 7f09ae800640 1 --2- 172.21.15.3:0/2215608884 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a996d501e0 0x55a996d505c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009f00 tx=0x7f09a8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e1f8f377b9e947 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.591+0000 7f099b400640 1 -- 172.21.15.3:0/2215608884 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a8004d20 con 0x55a996d501e0 2024-09-19T06:13:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.591+0000 7f099b400640 1 -- 172.21.15.3:0/2215608884 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09a8004050 con 0x55a996d501e0 2024-09-19T06:13:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.591+0000 7f099b400640 1 -- 172.21.15.3:0/2215608884 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a8005220 con 0x55a996d501e0 2024-09-19T06:13:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.591+0000 7f09a6a00640 1 --2- 172.21.15.3:0/190141083 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f09940a34d0 0x7f09940a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.592+0000 7f09a6a00640 1 -- 172.21.15.3:0/190141083 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f099c0d02d0 con 0x7f09b0109080 2024-09-19T06:13:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.592+0000 7f09b8020740 1 -- 172.21.15.3:0/2215608884 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a996d501e0 msgr2=0x55a996d505c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.592+0000 7f09b8020740 1 --2- 172.21.15.3:0/2215608884 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a996d501e0 0x55a996d505c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009f00 tx=0x7f09a8011810 comp rx=0 tx=0).stop 2024-09-19T06:13:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.592+0000 7f09ade00640 1 --2- 172.21.15.3:0/190141083 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f09940a34d0 0x7f09940a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.592+0000 7f09b8020740 1 -- 172.21.15.3:0/2215608884 shutdown_connections 2024-09-19T06:13:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.592+0000 7f09b8020740 1 --2- 172.21.15.3:0/2215608884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d5b3a0 0x55a996d5d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.592+0000 7f09b8020740 1 --2- 172.21.15.3:0/2215608884 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a996d50b00 0x55a996d5ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.592+0000 7f09b8020740 1 --2- 172.21.15.3:0/2215608884 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a996d501e0 0x55a996d505c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.592+0000 7f09b8020740 1 -- 172.21.15.3:0/2215608884 >> 172.21.15.3:0/2215608884 conn(0x55a996d4c750 msgr2=0x55a996d4cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.592+0000 7f09b8020740 1 -- 172.21.15.3:0/2215608884 shutdown_connections 2024-09-19T06:13:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.592+0000 7f09b8020740 1 -- 172.21.15.3:0/2215608884 wait complete. 2024-09-19T06:13:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.592+0000 7f09b8020740 1 -- start start 2024-09-19T06:13:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.592+0000 7f09ade00640 1 --2- 172.21.15.3:0/190141083 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f09940a34d0 0x7f09940a5990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f09a0000c00 tx=0x7f09a00056d0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.593+0000 7f09b8020740 1 Processor -- start 2024-09-19T06:13:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.593+0000 7f09b8020740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a996d501e0 0x55a996d582a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:44.599 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.593+0000 7f09b8020740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d50b00 0x55a996d587e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.593+0000 7f09b8020740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a996d5b3a0 0x55a996d58d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.593+0000 7f09b8020740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a996d5df70 con 0x55a996d501e0 2024-09-19T06:13:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.593+0000 7f09b8020740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a996c3f090 con 0x55a996d50b00 2024-09-19T06:13:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.593+0000 7f09b8020740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a996d5e0f0 con 0x55a996d5b3a0 2024-09-19T06:13:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.593+0000 7f09b8020740 10 client.0 _ll_register_callbacks cb 0x55a996c93f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.593+0000 7f09ade00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a996d501e0 0x55a996d582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.593+0000 7f09ad400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d50b00 0x55a996d587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.593+0000 7f09ad400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d50b00 0x55a996d587e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:53100/0 (socket says 172.21.15.3:53100) 2024-09-19T06:13:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.593+0000 7f09ad400640 1 -- 172.21.15.3:0/2451969678 learned_addr learned my addr 172.21.15.3:0/2451969678 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.593+0000 7f09ade00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a996d501e0 0x55a996d582a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48356/0 (socket says 172.21.15.3:48356) 2024-09-19T06:13:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.594+0000 7f09ae800640 1 --2- 172.21.15.3:0/2451969678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a996d5b3a0 0x55a996d58d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.594+0000 7f09ad400640 1 -- 172.21.15.3:0/2451969678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a996d5b3a0 msgr2=0x55a996d58d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.594+0000 7f09ad400640 1 --2- 172.21.15.3:0/2451969678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a996d5b3a0 0x55a996d58d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.594+0000 7f09ad400640 1 -- 172.21.15.3:0/2451969678 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a996d501e0 msgr2=0x55a996d582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.594+0000 7f09ad400640 1 --2- 172.21.15.3:0/2451969678 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a996d501e0 0x55a996d582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.594+0000 7f09ad400640 1 -- 172.21.15.3:0/2451969678 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a996a95620 con 0x55a996d50b00 2024-09-19T06:13:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.594+0000 7f09ade00640 1 --2- 172.21.15.3:0/2451969678 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a996d501e0 0x55a996d582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.594+0000 7f09ad400640 1 --2- 172.21.15.3:0/2451969678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d50b00 0x55a996d587e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f099c09c340 tx=0x7f099c09c200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f80149a0d9107c11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.594+0000 7f098fe00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:13:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.594+0000 7f098fe00640 1 -- 172.21.15.3:0/2451969678 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099c09c3b0 con 0x55a996d50b00 2024-09-19T06:13:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.595+0000 7f098fe00640 1 -- 172.21.15.3:0/2451969678 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f099c09b800 con 0x55a996d50b00 2024-09-19T06:13:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.595+0000 7f09b8020740 1 -- 172.21.15.3:0/2451969678 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09a8004050 con 0x55a996d50b00 2024-09-19T06:13:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.595+0000 7f098fe00640 1 -- 172.21.15.3:0/2451969678 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f099c0a06b0 con 0x55a996d50b00 2024-09-19T06:13:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.595+0000 7f09b8020740 10 client.25571 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.595+0000 7f09b8020740 1 -- 172.21.15.3:0/2451969678 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a996d69b20 con 0x55a996d50b00 2024-09-19T06:13:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.595+0000 7f098fe00640 1 -- 172.21.15.3:0/2451969678 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f09a8004050 con 0x55a996d50b00 2024-09-19T06:13:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.595+0000 7f098fe00640 1 -- 172.21.15.3:0/2451969678 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f099c0bc0b0 con 0x55a996d50b00 2024-09-19T06:13:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.596+0000 7f09b8020740 10 client.25571 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.596+0000 7f09b8020740 10 client.25571 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:13:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.596+0000 7f09b8020740 20 client.25571 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.596+0000 7f09b8020740 1 --2- 172.21.15.3:0/2451969678 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a996d6afe0 0x55a996d6d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.596+0000 7f09b8020740 4 client.25571 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:13:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.596+0000 7f09b8020740 1 -- 172.21.15.3:0/2451969678 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a996cc3830 con 0x55a996d6afe0 2024-09-19T06:13:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.596+0000 7f09ade00640 1 --2- 172.21.15.3:0/2451969678 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a996d6afe0 0x55a996d6d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:44.603 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.597+0000 7f098fe00640 10 client.25571 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.597+0000 7f09ade00640 1 --2- 172.21.15.3:0/2451969678 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a996d6afe0 0x55a996d6d3d0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82dda5843fc6b5ef server_cookie=e4207e3311fc4fe1 in_seq=0 out_seq=0 2024-09-19T06:13:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.598+0000 7f098fe00640 1 -- 172.21.15.3:0/2451969678 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a996cc3830 con 0x55a996d6afe0 2024-09-19T06:13:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.598+0000 7f098fe00640 10 client.25571 handle_command_reply: tid=0 2024-09-19T06:13:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.598+0000 7f09b8020740 1 client.25571 shutdown 2024-09-19T06:13:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.598+0000 7f09b8020740 1 -- 172.21.15.3:0/2451969678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d50b00 msgr2=0x55a996d587e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.598+0000 7f09b8020740 1 --2- 172.21.15.3:0/2451969678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d50b00 0x55a996d587e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f099c09c340 tx=0x7f099c09c200 comp rx=0 tx=0).stop 2024-09-19T06:13:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.598+0000 7f09b8020740 1 -- 172.21.15.3:0/2451969678 shutdown_connections 2024-09-19T06:13:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.598+0000 7f09b8020740 1 --2- 172.21.15.3:0/2451969678 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a996d6afe0 0x55a996d6d3d0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.598+0000 7f09b8020740 1 --2- 172.21.15.3:0/2451969678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a996d5b3a0 0x55a996d58d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.598+0000 7f09b8020740 1 --2- 172.21.15.3:0/2451969678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d50b00 0x55a996d587e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.598+0000 7f09b8020740 1 --2- 172.21.15.3:0/2451969678 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a996d501e0 0x55a996d582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.598+0000 7f09b8020740 1 -- 172.21.15.3:0/2451969678 >> 172.21.15.3:0/2451969678 conn(0x55a996d4c750 msgr2=0x55a996d52460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.598+0000 7f098fe00640 0 client.25571 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.598+0000 7f09b8020740 1 -- 172.21.15.3:0/2451969678 shutdown_connections 2024-09-19T06:13:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.598+0000 7f09b8020740 1 -- 172.21.15.3:0/2451969678 wait complete. 2024-09-19T06:13:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.599+0000 7f09b8020740 20 client.25571 trim_cache size 0 max 16384 2024-09-19T06:13:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.614+0000 7f09b8020740 1 Processor -- start 2024-09-19T06:13:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.614+0000 7f09b8020740 1 -- start start 2024-09-19T06:13:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.614+0000 7f09b8020740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a996d501e0 0x55a996d52c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.614+0000 7f09b8020740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d50b00 0x55a996d72c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.614+0000 7f09b8020740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a996d5b3a0 0x55a996d731d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.614+0000 7f09b8020740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01afae0 con 0x55a996d5b3a0 2024-09-19T06:13:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.614+0000 7f09b8020740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01b1620 con 0x55a996d50b00 2024-09-19T06:13:44.617 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.614+0000 7f09b8020740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01b01b0 con 0x55a996d501e0 2024-09-19T06:13:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.614+0000 7f09ae800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a996d5b3a0 0x55a996d731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.614+0000 7f09ad400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d50b00 0x55a996d72c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.614+0000 7f09ad400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d50b00 0x55a996d72c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:53102/0 (socket says 172.21.15.3:53102) 2024-09-19T06:13:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.615+0000 7f09ad400640 1 -- 172.21.15.3:0/2941757737 learned_addr learned my addr 172.21.15.3:0/2941757737 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.615+0000 7f09ade00640 1 --2- 172.21.15.3:0/2941757737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a996d501e0 0x55a996d52c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.615+0000 7f09ad400640 1 -- 172.21.15.3:0/2941757737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a996d501e0 msgr2=0x55a996d52c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.615+0000 7f09ad400640 1 --2- 172.21.15.3:0/2941757737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a996d501e0 0x55a996d52c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.615+0000 7f09ad400640 1 -- 172.21.15.3:0/2941757737 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a996d5b3a0 msgr2=0x55a996d731d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:44.618 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.615+0000 7f09ad400640 1 --2- 172.21.15.3:0/2941757737 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a996d5b3a0 0x55a996d731d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.619 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.615+0000 7f09ad400640 1 -- 172.21.15.3:0/2941757737 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a996d4d800 con 0x55a996d50b00 2024-09-19T06:13:44.619 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.615+0000 7f09ad400640 1 --2- 172.21.15.3:0/2941757737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d50b00 0x55a996d72c90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f099c09a660 tx=0x7f099c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=962b10d5721283cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:44.623 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.615+0000 7f099aa00640 1 -- 172.21.15.3:0/2941757737 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099c0a4f70 con 0x55a996d50b00 2024-09-19T06:13:44.623 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.616+0000 7f099aa00640 1 -- 172.21.15.3:0/2941757737 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f099c0bc0b0 con 0x55a996d50b00 2024-09-19T06:13:44.623 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.616+0000 7f099aa00640 1 -- 172.21.15.3:0/2941757737 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099c0a03d0 con 0x55a996d50b00 2024-09-19T06:13:44.623 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.616+0000 7f09b8020740 1 -- 172.21.15.3:0/2941757737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d50b00 msgr2=0x55a996d72c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:44.623 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.616+0000 7f09b8020740 1 --2- 172.21.15.3:0/2941757737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d50b00 0x55a996d72c90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f099c09a660 tx=0x7f099c0057f0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.623 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.616+0000 7f09b8020740 1 -- 172.21.15.3:0/2941757737 shutdown_connections 2024-09-19T06:13:44.623 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.616+0000 7f09b8020740 1 --2- 172.21.15.3:0/2941757737 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a996d5b3a0 0x55a996d731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.623 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.616+0000 7f09b8020740 1 --2- 172.21.15.3:0/2941757737 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d50b00 0x55a996d72c90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.623 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.616+0000 7f09b8020740 1 --2- 172.21.15.3:0/2941757737 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a996d501e0 0x55a996d52c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.623 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.616+0000 7f09b8020740 1 -- 172.21.15.3:0/2941757737 >> 172.21.15.3:0/2941757737 conn(0x55a996d4c750 msgr2=0x55a996d5a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:44.624 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.616+0000 7f09b8020740 1 -- 172.21.15.3:0/2941757737 shutdown_connections 2024-09-19T06:13:44.624 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.616+0000 7f09b8020740 1 -- 172.21.15.3:0/2941757737 wait complete. 2024-09-19T06:13:44.624 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.617+0000 7f09b8020740 1 -- start start 2024-09-19T06:13:44.624 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.617+0000 7f09b8020740 1 Processor -- start 2024-09-19T06:13:44.624 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.617+0000 7f09b8020740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a996d501e0 0x55a996d5f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:44.624 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.617+0000 7f09b8020740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d50b00 0x55a996d5f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:44.624 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.617+0000 7f09b8020740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a996d5b3a0 0x55a996d5fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:44.624 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.617+0000 7f09b8020740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01b0f50 con 0x55a996d5b3a0 2024-09-19T06:13:44.624 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.617+0000 7f09b8020740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01b0880 con 0x55a996d50b00 2024-09-19T06:13:44.624 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.617+0000 7f09b8020740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f09b01adac0 con 0x55a996d501e0 2024-09-19T06:13:44.624 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.618+0000 7f09b8020740 10 client.0 _ll_register_callbacks cb 0x7f099c00e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:44.625 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.618+0000 7f09ad400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d50b00 0x55a996d5f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:44.625 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.618+0000 7f09ade00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a996d501e0 0x55a996d5f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:44.625 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.618+0000 7f09ad400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d50b00 0x55a996d5f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:53112/0 (socket says 172.21.15.3:53112) 2024-09-19T06:13:44.625 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.618+0000 7f09ad400640 1 -- 172.21.15.3:0/326385063 learned_addr learned my addr 172.21.15.3:0/326385063 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:44.625 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.618+0000 7f09ae800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a996d5b3a0 0x55a996d5fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:44.625 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.618+0000 7f09ade00640 1 -- 172.21.15.3:0/326385063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d50b00 msgr2=0x55a996d5f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:44.625 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.618+0000 7f09ade00640 1 --2- 172.21.15.3:0/326385063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d50b00 0x55a996d5f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.625 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.618+0000 7f09ade00640 1 -- 172.21.15.3:0/326385063 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a996d5b3a0 msgr2=0x55a996d5fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:44.626 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.618+0000 7f09ade00640 1 --2- 172.21.15.3:0/326385063 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a996d5b3a0 0x55a996d5fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.626 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.618+0000 7f09ade00640 1 -- 172.21.15.3:0/326385063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a996d47d60 con 0x55a996d501e0 2024-09-19T06:13:44.626 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.618+0000 7f09ad400640 1 --2- 172.21.15.3:0/326385063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d50b00 0x55a996d5f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:44.626 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.618+0000 7f09ade00640 1 --2- 172.21.15.3:0/326385063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a996d501e0 0x55a996d5f360 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55a996d4d5b0 tx=0x7f09a0005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6eea3f44ee1852f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:44.626 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.618+0000 7f098fe00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:13:44.626 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.619+0000 7f098fe00640 1 -- 172.21.15.3:0/326385063 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a0044040 con 0x55a996d501e0 2024-09-19T06:13:44.626 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.619+0000 7f09b8020740 1 -- 172.21.15.3:0/326385063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f099c0bc0b0 con 0x55a996d501e0 2024-09-19T06:13:44.626 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.619+0000 7f098fe00640 1 -- 172.21.15.3:0/326385063 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f09a00037f0 con 0x55a996d501e0 2024-09-19T06:13:44.626 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.619+0000 7f098fe00640 1 -- 172.21.15.3:0/326385063 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f09a0037040 con 0x55a996d501e0 2024-09-19T06:13:44.626 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.619+0000 7f09b8020740 10 client.25576 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:44.626 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.619+0000 7f09b8020740 1 -- 172.21.15.3:0/326385063 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a996d50010 con 0x55a996d501e0 2024-09-19T06:13:44.626 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.619+0000 7f098fe00640 1 -- 172.21.15.3:0/326385063 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f099c0bc0b0 con 0x55a996d501e0 2024-09-19T06:13:44.627 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.620+0000 7f098fe00640 1 -- 172.21.15.3:0/326385063 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f09a003db70 con 0x55a996d501e0 2024-09-19T06:13:44.627 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.620+0000 7f09b8020740 10 client.25576 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:44.627 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.620+0000 7f09b8020740 10 client.25576 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:13:44.627 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.620+0000 7f09b8020740 20 client.25576 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:44.627 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.620+0000 7f09b8020740 1 --2- 172.21.15.3:0/326385063 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a996dd6510 0x55a996dd8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:44.627 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.620+0000 7f09b8020740 4 client.25576 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:13:44.627 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.620+0000 7f09b8020740 1 -- 172.21.15.3:0/326385063 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a996cbdb80 con 0x55a996dd6510 2024-09-19T06:13:44.627 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.620+0000 7f09ad400640 1 --2- 172.21.15.3:0/326385063 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a996dd6510 0x55a996dd8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:44.627 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.621+0000 7f09ad400640 1 --2- 172.21.15.3:0/326385063 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a996dd6510 0x55a996dd8900 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2060fc64fd31070f server_cookie=b1c2d12a135cbe5 in_seq=0 out_seq=0 2024-09-19T06:13:44.627 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.621+0000 7f098fe00640 10 client.25576 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:44.629 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.626+0000 7f098fe00640 1 -- 172.21.15.3:0/326385063 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a996cbdb80 con 0x55a996dd6510 2024-09-19T06:13:44.629 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.626+0000 7f098fe00640 10 client.25576 handle_command_reply: tid=0 2024-09-19T06:13:44.629 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.626+0000 7f09b8020740 1 client.25576 shutdown 2024-09-19T06:13:44.629 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.626+0000 7f09b8020740 1 -- 172.21.15.3:0/326385063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a996d501e0 msgr2=0x55a996d5f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:44.629 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.626+0000 7f09b8020740 1 --2- 172.21.15.3:0/326385063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a996d501e0 0x55a996d5f360 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55a996d4d5b0 tx=0x7f09a0005f90 comp rx=0 tx=0).stop 2024-09-19T06:13:44.629 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.626+0000 7f09b8020740 1 -- 172.21.15.3:0/326385063 shutdown_connections 2024-09-19T06:13:44.629 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.626+0000 7f09b8020740 1 --2- 172.21.15.3:0/326385063 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a996dd6510 0x55a996dd8900 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.630 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.626+0000 7f09b8020740 1 --2- 172.21.15.3:0/326385063 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a996d5b3a0 0x55a996d5fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.630 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.626+0000 7f09b8020740 1 --2- 172.21.15.3:0/326385063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a996d50b00 0x55a996d5f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.630 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.627+0000 7f09b8020740 1 --2- 172.21.15.3:0/326385063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a996d501e0 0x55a996d5f360 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.630 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.627+0000 7f098fe00640 0 client.25576 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:44.630 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.627+0000 7f09b8020740 1 -- 172.21.15.3:0/326385063 >> 172.21.15.3:0/326385063 conn(0x55a996d4c750 msgr2=0x55a996d59850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:44.630 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.627+0000 7f09b8020740 1 -- 172.21.15.3:0/326385063 shutdown_connections 2024-09-19T06:13:44.630 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.627+0000 7f09b8020740 1 -- 172.21.15.3:0/326385063 wait complete. 2024-09-19T06:13:44.630 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.627+0000 7f09b8020740 20 client.25576 trim_cache size 0 max 16384 2024-09-19T06:13:44.631 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:13:44.631 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:13:44.631 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:13:44.631 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:13:44.631 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.628+0000 7f09b5200640 1 -- 172.21.15.3:0/190141083 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f09940a34d0 msgr2=0x7f09940a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:44.632 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.628+0000 7f09b5200640 1 --2- 172.21.15.3:0/190141083 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f09940a34d0 0x7f09940a5990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f09a0000c00 tx=0x7f09a00056d0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.632 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.628+0000 7f09b5200640 1 -- 172.21.15.3:0/190141083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09b0109080 msgr2=0x7f09b019ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:44.632 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.628+0000 7f09b5200640 1 --2- 172.21.15.3:0/190141083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09b0109080 0x7f09b019ab50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f099c00e9f0 tx=0x7f099c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.632 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.628+0000 7f09b5200640 1 -- 172.21.15.3:0/190141083 shutdown_connections 2024-09-19T06:13:44.632 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.628+0000 7f09b5200640 1 --2- 172.21.15.3:0/190141083 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f09940a34d0 0x7f09940a5990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.632 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.628+0000 7f09b5200640 1 --2- 172.21.15.3:0/190141083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09b019eed0 0x7f09b019f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.632 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.628+0000 7f09b5200640 1 --2- 172.21.15.3:0/190141083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09b0109080 0x7f09b019ab50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.632 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.628+0000 7f09b5200640 1 --2- 172.21.15.3:0/190141083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f09b0103f30 0x7f09b019a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:44.632 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.628+0000 7f09b5200640 1 -- 172.21.15.3:0/190141083 >> 172.21.15.3:0/190141083 conn(0x7f09b00ff980 msgr2=0x7f09b0100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:44.632 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.628+0000 7f09b5200640 1 -- 172.21.15.3:0/190141083 shutdown_connections 2024-09-19T06:13:44.632 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:44.628+0000 7f09b5200640 1 -- 172.21.15.3:0/190141083 wait complete. 2024-09-19T06:13:45.465 INFO:tasks.workunit.client.0.smithi003.stderr:Updating files: 62% (8075/12896) Updating files: 63% (8125/12896) Updating files: 64% (8254/12896) Updating files: 65% (8383/12896) Updating files: 66% (8512/12896) Updating files: 67% (8641/12896) Updating files: 68% (8770/12896) Updating files: 69% (8899/12896) Updating files: 70% (9028/12896) Updating files: 71% (9157/12896) Updating files: 72% (9286/12896) Updating files: 73% (9415/12896) Updating files: 74% (9544/12896) Updating files: 75% (9672/12896) Updating files: 76% (9801/12896) Updating files: 77% (9930/12896) Updating files: 78% (10059/12896) Updating files: 79% (10188/12896) Updating files: 80% (10317/12896) Updating files: 81% (10446/12896) Updating files: 82% (10575/12896) Updating files: 83% (10704/12896) Updating files: 84% (10833/12896) Updating files: 85% (10962/12896) Updating files: 86% (11091/12896) Updating files: 87% (11220/12896) Updating files: 88% (11349/12896) Updating files: 89% (11478/12896) Updating files: 90% (11607/12896) Updating files: 91% (11736/12896) Updating files: 92% (11865/12896) Updating files: 93% (11994/12896) Updating files: 94% (12123/12896) Updating files: 95% (12252/12896) Updating files: 96% (12381/12896) Updating files: 97% (12510/12896) Updating files: 97% (12611/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-19T06:13:46.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:45 smithi003 ceph-mon[30893]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-19T06:13:46.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:45 smithi071 ceph-mon[35662]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-19T06:13:46.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:45 smithi059 ceph-mon[35138]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-19T06:13:46.410 INFO:tasks.workunit.client.0.smithi003.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T06:13:46.411 INFO:tasks.workunit.client.0.smithi003.stderr: 2024-09-19T06:13:46.411 INFO:tasks.workunit.client.0.smithi003.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T06:13:46.411 INFO:tasks.workunit.client.0.smithi003.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T06:13:46.411 INFO:tasks.workunit.client.0.smithi003.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T06:13:46.411 INFO:tasks.workunit.client.0.smithi003.stderr: 2024-09-19T06:13:46.411 INFO:tasks.workunit.client.0.smithi003.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T06:13:46.411 INFO:tasks.workunit.client.0.smithi003.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T06:13:46.411 INFO:tasks.workunit.client.0.smithi003.stderr: 2024-09-19T06:13:46.412 INFO:tasks.workunit.client.0.smithi003.stderr: git switch -c 2024-09-19T06:13:46.412 INFO:tasks.workunit.client.0.smithi003.stderr: 2024-09-19T06:13:46.412 INFO:tasks.workunit.client.0.smithi003.stderr:Or undo this operation with: 2024-09-19T06:13:46.412 INFO:tasks.workunit.client.0.smithi003.stderr: 2024-09-19T06:13:46.412 INFO:tasks.workunit.client.0.smithi003.stderr: git switch - 2024-09-19T06:13:46.412 INFO:tasks.workunit.client.0.smithi003.stderr: 2024-09-19T06:13:46.412 INFO:tasks.workunit.client.0.smithi003.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T06:13:46.412 INFO:tasks.workunit.client.0.smithi003.stderr: 2024-09-19T06:13:46.412 INFO:tasks.workunit.client.0.smithi003.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T06:13:46.425 DEBUG:teuthology.orchestra.run.smithi003:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T06:13:46.508 INFO:tasks.workunit.client.0.smithi003.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T06:13:46.513 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T06:13:46.513 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T06:13:47.206 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T06:13:47.309 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T06:13:47.376 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T06:13:47.379 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T06:13:47.380 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T06:13:47.445 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T06:13:47.452 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-19T06:13:47.452 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T06:13:47.529 INFO:tasks.workunit:Running workunits matching fs/test_o_trunc.sh on client.0... 2024-09-19T06:13:47.530 INFO:tasks.workunit:Running workunit fs/test_o_trunc.sh... 2024-09-19T06:13:47.530 DEBUG:teuthology.orchestra.run.smithi003:workunit test fs/test_o_trunc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-09-19T06:13:47.616 INFO:tasks.workunit.client.0.smithi003.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-09-19T06:13:47.618 INFO:tasks.workunit.client.0.smithi003.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs 2024-09-19T06:13:47.618 INFO:tasks.workunit.client.0.smithi003.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc trunc.foo 600 2024-09-19T06:13:48.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:47 smithi003 ceph-mon[30893]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:13:48.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:47 smithi071 ceph-mon[35662]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:13:48.090 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:47 smithi059 ceph-mon[35138]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:13:50.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:49 smithi003 ceph-mon[30893]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-19T06:13:50.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:49 smithi071 ceph-mon[35662]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-19T06:13:50.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:49 smithi059 ceph-mon[35138]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 10 op/s 2024-09-19T06:13:52.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:51 smithi003 ceph-mon[30893]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-19T06:13:52.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:51 smithi071 ceph-mon[35662]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-19T06:13:52.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:51 smithi059 ceph-mon[35138]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-19T06:13:54.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:53 smithi059 ceph-mon[35138]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-19T06:13:54.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:53 smithi003 ceph-mon[30893]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-19T06:13:54.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:53 smithi071 ceph-mon[35662]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 8 op/s 2024-09-19T06:13:56.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:55 smithi059 ceph-mon[35138]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.4 KiB/s wr, 16 op/s 2024-09-19T06:13:56.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:55 smithi059 ceph-mon[35138]: mgrmap e27: x(active, since 92s), standbys: y, z 2024-09-19T06:13:56.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:55 smithi003 ceph-mon[30893]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.4 KiB/s wr, 16 op/s 2024-09-19T06:13:56.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:55 smithi003 ceph-mon[30893]: mgrmap e27: x(active, since 92s), standbys: y, z 2024-09-19T06:13:56.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:55 smithi071 ceph-mon[35662]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.4 KiB/s wr, 16 op/s 2024-09-19T06:13:56.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:55 smithi071 ceph-mon[35662]: mgrmap e27: x(active, since 92s), standbys: y, z 2024-09-19T06:13:57.764 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.761+0000 7f8574800640 1 -- 172.21.15.3:0/1264543065 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f856c103f40 msgr2=0x7f856c104320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:57.764 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.761+0000 7f8574800640 1 --2- 172.21.15.3:0/1264543065 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f856c103f40 0x7f856c104320 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8560009900 tx=0x7f856002a3f0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.764 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.762+0000 7f8574800640 1 -- 172.21.15.3:0/1264543065 shutdown_connections 2024-09-19T06:13:57.764 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.762+0000 7f8574800640 1 --2- 172.21.15.3:0/1264543065 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f856c109090 0x7f856c110be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.764 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.762+0000 7f8574800640 1 --2- 172.21.15.3:0/1264543065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f856c1048f0 0x7f856c108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.764 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.762+0000 7f8574800640 1 --2- 172.21.15.3:0/1264543065 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f856c103f40 0x7f856c104320 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.764 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.762+0000 7f8574800640 1 -- 172.21.15.3:0/1264543065 >> 172.21.15.3:0/1264543065 conn(0x7f856c0ff970 msgr2=0x7f856c101d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:57.764 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.762+0000 7f8574800640 1 -- 172.21.15.3:0/1264543065 shutdown_connections 2024-09-19T06:13:57.765 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.762+0000 7f8574800640 1 -- 172.21.15.3:0/1264543065 wait complete. 2024-09-19T06:13:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.763+0000 7f8574800640 1 Processor -- start 2024-09-19T06:13:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.763+0000 7f8574800640 1 -- start start 2024-09-19T06:13:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.763+0000 7f8574800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f856c103f40 0x7f856c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.763+0000 7f8574800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f856c109090 0x7f856c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.763+0000 7f8574800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f856c19ef30 0x7f856c19f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.767 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.763+0000 7f8574800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f856c1140c0 con 0x7f856c109090 2024-09-19T06:13:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.763+0000 7f8574800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f856c113f40 con 0x7f856c103f40 2024-09-19T06:13:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.763+0000 7f8574800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f856c114240 con 0x7f856c19ef30 2024-09-19T06:13:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.763+0000 7f8571400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f856c109090 0x7f856c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.763+0000 7f8572800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f856c19ef30 0x7f856c19f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.763+0000 7f8571400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f856c109090 0x7f856c19abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34046/0 (socket says 172.21.15.3:34046) 2024-09-19T06:13:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.763+0000 7f8571400640 1 -- 172.21.15.3:0/2654183835 learned_addr learned my addr 172.21.15.3:0/2654183835 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.763+0000 7f8572800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f856c19ef30 0x7f856c19f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:58232/0 (socket says 172.21.15.3:58232) 2024-09-19T06:13:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.763+0000 7f8571e00640 1 --2- 172.21.15.3:0/2654183835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f856c103f40 0x7f856c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.764+0000 7f8571400640 1 -- 172.21.15.3:0/2654183835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f856c19ef30 msgr2=0x7f856c19f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.764+0000 7f8571400640 1 --2- 172.21.15.3:0/2654183835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f856c19ef30 0x7f856c19f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.768 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.764+0000 7f8571400640 1 -- 172.21.15.3:0/2654183835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f856c103f40 msgr2=0x7f856c19a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.764+0000 7f8571400640 1 --2- 172.21.15.3:0/2654183835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f856c103f40 0x7f856c19a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.764+0000 7f8571400640 1 -- 172.21.15.3:0/2654183835 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856c19fa20 con 0x7f856c109090 2024-09-19T06:13:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.764+0000 7f8572800640 1 --2- 172.21.15.3:0/2654183835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f856c19ef30 0x7f856c19f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.764+0000 7f8571400640 1 --2- 172.21.15.3:0/2654183835 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f856c109090 0x7f856c19abb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f855c00e9c0 tx=0x7f855c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.764+0000 7f8566a00640 1 -- 172.21.15.3:0/2654183835 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c00cd80 con 0x7f856c109090 2024-09-19T06:13:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.764+0000 7f8566a00640 1 -- 172.21.15.3:0/2654183835 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f855c005500 con 0x7f856c109090 2024-09-19T06:13:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.764+0000 7f8574800640 1 -- 172.21.15.3:0/2654183835 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f856c19fd10 con 0x7f856c109090 2024-09-19T06:13:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.764+0000 7f8566a00640 1 -- 172.21.15.3:0/2654183835 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c010690 con 0x7f856c109090 2024-09-19T06:13:57.769 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.764+0000 7f8574800640 1 -- 172.21.15.3:0/2654183835 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f856c1a7500 con 0x7f856c109090 2024-09-19T06:13:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.768+0000 7f85775fc740 1 Processor -- start 2024-09-19T06:13:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.768+0000 7f8566a00640 1 -- 172.21.15.3:0/2654183835 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f855c0046c0 con 0x7f856c109090 2024-09-19T06:13:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.768+0000 7f85775fc740 1 -- start start 2024-09-19T06:13:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.768+0000 7f85775fc740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320a1e0 0x564b8320a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.768+0000 7f85775fc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b8320ab00 0x564b83214e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.768+0000 7f85775fc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b832153a0 0x564b83217790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.768+0000 7f85775fc740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x564b83170100 con 0x564b8320a1e0 2024-09-19T06:13:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.768+0000 7f85775fc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564b831181b0 con 0x564b832153a0 2024-09-19T06:13:57.772 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.768+0000 7f85775fc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564b8316c0c0 con 0x564b8320ab00 2024-09-19T06:13:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.768+0000 7f8571e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b8320ab00 0x564b83214e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.768+0000 7f8572800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320a1e0 0x564b8320a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.768+0000 7f8571e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b8320ab00 0x564b83214e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:58236/0 (socket says 172.21.15.3:58236) 2024-09-19T06:13:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.768+0000 7f8571e00640 1 -- 172.21.15.3:0/3644201705 learned_addr learned my addr 172.21.15.3:0/3644201705 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.768+0000 7f8572800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320a1e0 0x564b8320a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34060/0 (socket says 172.21.15.3:34060) 2024-09-19T06:13:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.769+0000 7f8571400640 1 --2- 172.21.15.3:0/3644201705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b832153a0 0x564b83217790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.769+0000 7f8571e00640 1 -- 172.21.15.3:0/3644201705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b832153a0 msgr2=0x564b83217790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.769+0000 7f8571e00640 1 --2- 172.21.15.3:0/3644201705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b832153a0 0x564b83217790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.769+0000 7f8571e00640 1 -- 172.21.15.3:0/3644201705 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320a1e0 msgr2=0x564b8320a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.769+0000 7f8571e00640 1 --2- 172.21.15.3:0/3644201705 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320a1e0 0x564b8320a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.769+0000 7f8571e00640 1 -- 172.21.15.3:0/3644201705 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b82e83210 con 0x564b8320ab00 2024-09-19T06:13:57.773 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.769+0000 7f8572800640 1 --2- 172.21.15.3:0/3644201705 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320a1e0 0x564b8320a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:57.774 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.769+0000 7f8571e00640 1 --2- 172.21.15.3:0/3644201705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b8320ab00 0x564b83214e60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8560009900 tx=0x7f8560005e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cff6de7d7143eee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:57.774 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.769+0000 7f8566a00640 1 --2- 172.21.15.3:0/2654183835 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f85540a33b0 0x7f85540a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.774 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.770+0000 7f855b000640 1 -- 172.21.15.3:0/3644201705 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560040070 con 0x564b8320ab00 2024-09-19T06:13:57.774 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.770+0000 7f855b000640 1 -- 172.21.15.3:0/3644201705 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85600318f0 con 0x564b8320ab00 2024-09-19T06:13:57.774 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.770+0000 7f855b000640 1 -- 172.21.15.3:0/3644201705 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560035040 con 0x564b8320ab00 2024-09-19T06:13:57.774 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.770+0000 7f8566a00640 1 -- 172.21.15.3:0/2654183835 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f855c0d0120 con 0x7f856c109090 2024-09-19T06:13:57.774 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.770+0000 7f8572800640 1 --2- 172.21.15.3:0/2654183835 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f85540a33b0 0x7f85540a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.770+0000 7f85775fc740 1 -- 172.21.15.3:0/3644201705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b8320ab00 msgr2=0x564b83214e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.770+0000 7f85775fc740 1 --2- 172.21.15.3:0/3644201705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b8320ab00 0x564b83214e60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8560009900 tx=0x7f8560005e00 comp rx=0 tx=0).stop 2024-09-19T06:13:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.770+0000 7f8572800640 1 --2- 172.21.15.3:0/2654183835 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f85540a33b0 0x7f85540a5870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8568005fd0 tx=0x7f85680096a0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:57.778 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.770+0000 7f85775fc740 1 -- 172.21.15.3:0/3644201705 shutdown_connections 2024-09-19T06:13:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.771+0000 7f85775fc740 1 --2- 172.21.15.3:0/3644201705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b832153a0 0x564b83217790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.771+0000 7f85775fc740 1 --2- 172.21.15.3:0/3644201705 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b8320ab00 0x564b83214e60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.771+0000 7f85775fc740 1 --2- 172.21.15.3:0/3644201705 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320a1e0 0x564b8320a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.771+0000 7f85775fc740 1 -- 172.21.15.3:0/3644201705 >> 172.21.15.3:0/3644201705 conn(0x564b83206750 msgr2=0x564b83206b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.771+0000 7f85775fc740 1 -- 172.21.15.3:0/3644201705 shutdown_connections 2024-09-19T06:13:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.771+0000 7f85775fc740 1 -- 172.21.15.3:0/3644201705 wait complete. 2024-09-19T06:13:57.779 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.771+0000 7f85775fc740 1 -- start start 2024-09-19T06:13:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.771+0000 7f85775fc740 1 Processor -- start 2024-09-19T06:13:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.772+0000 7f85775fc740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320a1e0 0x564b832123a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.772+0000 7f85775fc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b8320ab00 0x564b832128e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.772+0000 7f85775fc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b832153a0 0x564b83212e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.772+0000 7f85775fc740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x564b83217f70 con 0x564b8320a1e0 2024-09-19T06:13:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.772+0000 7f85775fc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564b830f9090 con 0x564b8320ab00 2024-09-19T06:13:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.772+0000 7f85775fc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564b832180f0 con 0x564b832153a0 2024-09-19T06:13:57.780 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.772+0000 7f85775fc740 10 client.0 _ll_register_callbacks cb 0x564b8314df30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.772+0000 7f8571e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320a1e0 0x564b832123a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.772+0000 7f8571e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320a1e0 0x564b832123a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34070/0 (socket says 172.21.15.3:34070) 2024-09-19T06:13:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.772+0000 7f8571e00640 1 -- 172.21.15.3:0/2541328849 learned_addr learned my addr 172.21.15.3:0/2541328849 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.772+0000 7f8571400640 1 --2- 172.21.15.3:0/2541328849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b8320ab00 0x564b832128e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.772+0000 7f8572800640 1 --2- 172.21.15.3:0/2541328849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b832153a0 0x564b83212e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.772+0000 7f8571e00640 1 -- 172.21.15.3:0/2541328849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b832153a0 msgr2=0x564b83212e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.772+0000 7f8571e00640 1 --2- 172.21.15.3:0/2541328849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b832153a0 0x564b83212e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.772+0000 7f8571e00640 1 -- 172.21.15.3:0/2541328849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b8320ab00 msgr2=0x564b832128e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.772+0000 7f8571e00640 1 --2- 172.21.15.3:0/2541328849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b8320ab00 0x564b832128e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.772+0000 7f8571e00640 1 -- 172.21.15.3:0/2541328849 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b82f4f620 con 0x564b8320a1e0 2024-09-19T06:13:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.772+0000 7f8571400640 1 --2- 172.21.15.3:0/2541328849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b8320ab00 0x564b832128e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:13:57.781 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.773+0000 7f8571e00640 1 --2- 172.21.15.3:0/2541328849 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320a1e0 0x564b832123a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8560000c00 tx=0x7f8560005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f76c49e9f18267 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.773+0000 7f854f400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:13:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.773+0000 7f854f400640 1 -- 172.21.15.3:0/2541328849 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560040070 con 0x564b8320a1e0 2024-09-19T06:13:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.773+0000 7f85775fc740 1 -- 172.21.15.3:0/2541328849 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85600318f0 con 0x564b8320a1e0 2024-09-19T06:13:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.773+0000 7f854f400640 1 -- 172.21.15.3:0/2541328849 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f8560004240 con 0x564b8320a1e0 2024-09-19T06:13:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.773+0000 7f854f400640 1 -- 172.21.15.3:0/2541328849 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8560056050 con 0x564b8320a1e0 2024-09-19T06:13:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.773+0000 7f85775fc740 10 client.15543 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.773+0000 7f85775fc740 1 -- 172.21.15.3:0/2541328849 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564b83223b90 con 0x564b8320a1e0 2024-09-19T06:13:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.774+0000 7f854f400640 1 -- 172.21.15.3:0/2541328849 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85600318f0 con 0x564b8320a1e0 2024-09-19T06:13:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.774+0000 7f854f400640 1 -- 172.21.15.3:0/2541328849 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f85600035f0 con 0x564b8320a1e0 2024-09-19T06:13:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.774+0000 7f85775fc740 10 client.15543 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.774+0000 7f85775fc740 10 client.15543 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:13:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.774+0000 7f85775fc740 20 client.15543 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:57.782 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.774+0000 7f85775fc740 1 --2- 172.21.15.3:0/2541328849 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564b83224ee0 0x564b832272d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.783 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.774+0000 7f85775fc740 4 client.15543 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:13:57.783 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.774+0000 7f85775fc740 1 -- 172.21.15.3:0/2541328849 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b8317d830 con 0x564b83224ee0 2024-09-19T06:13:57.783 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.774+0000 7f8571400640 1 --2- 172.21.15.3:0/2541328849 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564b83224ee0 0x564b832272d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.783 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.775+0000 7f8571400640 1 --2- 172.21.15.3:0/2541328849 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564b83224ee0 0x564b832272d0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=558730ca670d185d server_cookie=7b15c14b363548d3 in_seq=0 out_seq=0 2024-09-19T06:13:57.783 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.775+0000 7f854f400640 10 client.15543 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:57.783 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.775+0000 7f854f400640 1 -- 172.21.15.3:0/2541328849 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564b8317d830 con 0x564b83224ee0 2024-09-19T06:13:57.783 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.775+0000 7f854f400640 10 client.15543 handle_command_reply: tid=0 2024-09-19T06:13:57.783 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.775+0000 7f85775fc740 1 client.15543 shutdown 2024-09-19T06:13:57.783 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.776+0000 7f85775fc740 1 -- 172.21.15.3:0/2541328849 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320a1e0 msgr2=0x564b832123a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:57.783 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.776+0000 7f85775fc740 1 --2- 172.21.15.3:0/2541328849 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320a1e0 0x564b832123a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8560000c00 tx=0x7f8560005250 comp rx=0 tx=0).stop 2024-09-19T06:13:57.784 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.776+0000 7f85775fc740 1 -- 172.21.15.3:0/2541328849 shutdown_connections 2024-09-19T06:13:57.784 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.776+0000 7f85775fc740 1 --2- 172.21.15.3:0/2541328849 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564b83224ee0 0x564b832272d0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.784 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.776+0000 7f85775fc740 1 --2- 172.21.15.3:0/2541328849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b832153a0 0x564b83212e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.784 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.776+0000 7f85775fc740 1 --2- 172.21.15.3:0/2541328849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b8320ab00 0x564b832128e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.784 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.776+0000 7f85775fc740 1 --2- 172.21.15.3:0/2541328849 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320a1e0 0x564b832123a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.784 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.776+0000 7f854f400640 0 client.15543 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:57.784 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.776+0000 7f85775fc740 1 -- 172.21.15.3:0/2541328849 >> 172.21.15.3:0/2541328849 conn(0x564b83206750 msgr2=0x564b8320c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:57.784 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.776+0000 7f85775fc740 1 -- 172.21.15.3:0/2541328849 shutdown_connections 2024-09-19T06:13:57.784 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.776+0000 7f85775fc740 1 -- 172.21.15.3:0/2541328849 wait complete. 2024-09-19T06:13:57.784 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.776+0000 7f85775fc740 20 client.15543 trim_cache size 0 max 16384 2024-09-19T06:13:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.791+0000 7f85775fc740 1 Processor -- start 2024-09-19T06:13:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.791+0000 7f85775fc740 1 -- start start 2024-09-19T06:13:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.791+0000 7f85775fc740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320a1e0 0x564b8322c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.791+0000 7f85775fc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b8320ab00 0x564b8322ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.791+0000 7f85775fc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b832153a0 0x564b83205010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.792+0000 7f85775fc740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f856c1afab0 con 0x564b8320a1e0 2024-09-19T06:13:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.792+0000 7f85775fc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f856c1b15f0 con 0x564b8320ab00 2024-09-19T06:13:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.792+0000 7f85775fc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f856c1b0180 con 0x564b832153a0 2024-09-19T06:13:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.792+0000 7f8571e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320a1e0 0x564b8322c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.792+0000 7f8571e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320a1e0 0x564b8322c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34078/0 (socket says 172.21.15.3:34078) 2024-09-19T06:13:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.792+0000 7f8571e00640 1 -- 172.21.15.3:0/3189790574 learned_addr learned my addr 172.21.15.3:0/3189790574 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.792+0000 7f8571400640 1 --2- 172.21.15.3:0/3189790574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b8320ab00 0x564b8322ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.792+0000 7f8572800640 1 --2- 172.21.15.3:0/3189790574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b832153a0 0x564b83205010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.795 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.792+0000 7f8571400640 1 -- 172.21.15.3:0/3189790574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b832153a0 msgr2=0x564b83205010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:57.796 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.792+0000 7f8571400640 1 --2- 172.21.15.3:0/3189790574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b832153a0 0x564b83205010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.796 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.792+0000 7f8571400640 1 -- 172.21.15.3:0/3189790574 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320a1e0 msgr2=0x564b8322c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:57.796 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.792+0000 7f8571400640 1 --2- 172.21.15.3:0/3189790574 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320a1e0 0x564b8322c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.796 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.792+0000 7f8571400640 1 -- 172.21.15.3:0/3189790574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b83214e50 con 0x564b8320ab00 2024-09-19T06:13:57.796 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.792+0000 7f8571e00640 1 --2- 172.21.15.3:0/3189790574 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320a1e0 0x564b8322c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.793+0000 7f8571400640 1 --2- 172.21.15.3:0/3189790574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b8320ab00 0x564b8322ce10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f855c0cd810 tx=0x7f855c0bc040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6b16bf0b988a151 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.793+0000 7f855a600640 1 -- 172.21.15.3:0/3189790574 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c09c170 con 0x564b8320ab00 2024-09-19T06:13:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.793+0000 7f855a600640 1 -- 172.21.15.3:0/3189790574 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f855c09caa0 con 0x564b8320ab00 2024-09-19T06:13:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.793+0000 7f855a600640 1 -- 172.21.15.3:0/3189790574 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c09bd00 con 0x564b8320ab00 2024-09-19T06:13:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.793+0000 7f85775fc740 1 -- 172.21.15.3:0/3189790574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b8320ab00 msgr2=0x564b8322ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.793+0000 7f85775fc740 1 --2- 172.21.15.3:0/3189790574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b8320ab00 0x564b8322ce10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f855c0cd810 tx=0x7f855c0bc040 comp rx=0 tx=0).stop 2024-09-19T06:13:57.800 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.794+0000 7f85775fc740 1 -- 172.21.15.3:0/3189790574 shutdown_connections 2024-09-19T06:13:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.794+0000 7f85775fc740 1 --2- 172.21.15.3:0/3189790574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b832153a0 0x564b83205010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.794+0000 7f85775fc740 1 --2- 172.21.15.3:0/3189790574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b8320ab00 0x564b8322ce10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.794+0000 7f85775fc740 1 --2- 172.21.15.3:0/3189790574 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320a1e0 0x564b8322c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.794+0000 7f85775fc740 1 -- 172.21.15.3:0/3189790574 >> 172.21.15.3:0/3189790574 conn(0x564b83206750 msgr2=0x564b83206b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.794+0000 7f85775fc740 1 -- 172.21.15.3:0/3189790574 shutdown_connections 2024-09-19T06:13:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.794+0000 7f85775fc740 1 -- 172.21.15.3:0/3189790574 wait complete. 2024-09-19T06:13:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.794+0000 7f85775fc740 1 -- start start 2024-09-19T06:13:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.794+0000 7f85775fc740 1 Processor -- start 2024-09-19T06:13:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.795+0000 7f85775fc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b8320a1e0 0x564b8321d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.795+0000 7f85775fc740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320ab00 0x564b8321d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.801 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.795+0000 7f85775fc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b832153a0 0x564b8320ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.802 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.795+0000 7f85775fc740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f856c1b0f20 con 0x564b8320ab00 2024-09-19T06:13:57.802 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.795+0000 7f85775fc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f856c1b0850 con 0x564b832153a0 2024-09-19T06:13:57.802 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.795+0000 7f85775fc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f856c1ada90 con 0x564b8320a1e0 2024-09-19T06:13:57.802 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.795+0000 7f85775fc740 10 client.0 _ll_register_callbacks cb 0x7f8568009db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:57.802 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.795+0000 7f8571400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320ab00 0x564b8321d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.802 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.795+0000 7f8571400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320ab00 0x564b8321d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34092/0 (socket says 172.21.15.3:34092) 2024-09-19T06:13:57.802 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.795+0000 7f8571400640 1 -- 172.21.15.3:0/2818067258 learned_addr learned my addr 172.21.15.3:0/2818067258 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:57.802 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.795+0000 7f8571e00640 1 --2- 172.21.15.3:0/2818067258 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b8320a1e0 0x564b8321d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.802 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.795+0000 7f8572800640 1 --2- 172.21.15.3:0/2818067258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b832153a0 0x564b8320ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.802 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.795+0000 7f8571e00640 1 -- 172.21.15.3:0/2818067258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b832153a0 msgr2=0x564b8320ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:57.802 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.795+0000 7f8571e00640 1 --2- 172.21.15.3:0/2818067258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b832153a0 0x564b8320ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.802 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.795+0000 7f8571e00640 1 -- 172.21.15.3:0/2818067258 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320ab00 msgr2=0x564b8321d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:57.803 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.795+0000 7f8571e00640 1 --2- 172.21.15.3:0/2818067258 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320ab00 0x564b8321d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.803 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.795+0000 7f8571e00640 1 -- 172.21.15.3:0/2818067258 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b8320f420 con 0x564b8320a1e0 2024-09-19T06:13:57.803 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.795+0000 7f8571400640 1 --2- 172.21.15.3:0/2818067258 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320ab00 0x564b8321d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:57.803 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.796+0000 7f8571e00640 1 --2- 172.21.15.3:0/2818067258 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b8320a1e0 0x564b8321d270 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8560003a40 tx=0x7f85600038a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b590a1737e6f8d51 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:57.803 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.796+0000 7f854f400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:13:57.803 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.796+0000 7f854f400640 1 -- 172.21.15.3:0/2818067258 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856005f060 con 0x564b8320a1e0 2024-09-19T06:13:57.803 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.796+0000 7f85775fc740 1 -- 172.21.15.3:0/2818067258 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f855c09caa0 con 0x564b8320a1e0 2024-09-19T06:13:57.803 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.796+0000 7f854f400640 1 -- 172.21.15.3:0/2818067258 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f8560004240 con 0x564b8320a1e0 2024-09-19T06:13:57.803 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.796+0000 7f854f400640 1 -- 172.21.15.3:0/2818067258 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8560040040 con 0x564b8320a1e0 2024-09-19T06:13:57.803 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.796+0000 7f85775fc740 10 client.25594 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:57.803 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.796+0000 7f85775fc740 1 -- 172.21.15.3:0/2818067258 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564b8328f370 con 0x564b8320a1e0 2024-09-19T06:13:57.803 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.796+0000 7f854f400640 1 -- 172.21.15.3:0/2818067258 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f855c09caa0 con 0x564b8320a1e0 2024-09-19T06:13:57.804 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.797+0000 7f854f400640 1 -- 172.21.15.3:0/2818067258 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8560004930 con 0x564b8320a1e0 2024-09-19T06:13:57.804 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.797+0000 7f85775fc740 10 client.25594 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:57.804 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.797+0000 7f85775fc740 10 client.25594 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:13:57.804 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.797+0000 7f85775fc740 20 client.25594 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:57.804 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.797+0000 7f85775fc740 1 --2- 172.21.15.3:0/2818067258 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564b8328f9d0 0x564b83291dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:57.804 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.797+0000 7f85775fc740 4 client.25594 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:13:57.804 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.797+0000 7f85775fc740 1 -- 172.21.15.3:0/2818067258 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564b83177b80 con 0x564b8328f9d0 2024-09-19T06:13:57.804 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.797+0000 7f8571400640 1 --2- 172.21.15.3:0/2818067258 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564b8328f9d0 0x564b83291dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:57.804 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.797+0000 7f8571400640 1 --2- 172.21.15.3:0/2818067258 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564b8328f9d0 0x564b83291dc0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dcdda56f43c025f server_cookie=7f1433659225d815 in_seq=0 out_seq=0 2024-09-19T06:13:57.804 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.797+0000 7f854f400640 10 client.25594 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:57.812 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.809+0000 7f854f400640 1 -- 172.21.15.3:0/2818067258 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564b83177b80 con 0x564b8328f9d0 2024-09-19T06:13:57.812 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.809+0000 7f854f400640 10 client.25594 handle_command_reply: tid=0 2024-09-19T06:13:57.812 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.809+0000 7f85775fc740 1 client.25594 shutdown 2024-09-19T06:13:57.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.809+0000 7f85775fc740 1 -- 172.21.15.3:0/2818067258 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b8320a1e0 msgr2=0x564b8321d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:57.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.809+0000 7f85775fc740 1 --2- 172.21.15.3:0/2818067258 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b8320a1e0 0x564b8321d270 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8560003a40 tx=0x7f85600038a0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.809+0000 7f85775fc740 1 -- 172.21.15.3:0/2818067258 shutdown_connections 2024-09-19T06:13:57.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.809+0000 7f85775fc740 1 --2- 172.21.15.3:0/2818067258 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564b8328f9d0 0x564b83291dc0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.809+0000 7f85775fc740 1 --2- 172.21.15.3:0/2818067258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564b832153a0 0x564b8320ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.809+0000 7f85775fc740 1 --2- 172.21.15.3:0/2818067258 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564b8320ab00 0x564b8321d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.809+0000 7f854f400640 0 client.25594 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:57.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.809+0000 7f85775fc740 1 --2- 172.21.15.3:0/2818067258 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564b8320a1e0 0x564b8321d270 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.809+0000 7f85775fc740 1 -- 172.21.15.3:0/2818067258 >> 172.21.15.3:0/2818067258 conn(0x564b83206750 msgr2=0x564b83212340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:57.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.809+0000 7f85775fc740 1 -- 172.21.15.3:0/2818067258 shutdown_connections 2024-09-19T06:13:57.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.809+0000 7f85775fc740 1 -- 172.21.15.3:0/2818067258 wait complete. 2024-09-19T06:13:57.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.809+0000 7f85775fc740 20 client.25594 trim_cache size 0 max 16384 2024-09-19T06:13:57.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:13:57.816 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:13:57.816 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:13:57.816 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:13:57.817 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.810+0000 7f8574800640 1 -- 172.21.15.3:0/2654183835 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f85540a33b0 msgr2=0x7f85540a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:57.817 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.810+0000 7f8574800640 1 --2- 172.21.15.3:0/2654183835 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f85540a33b0 0x7f85540a5870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8568005fd0 tx=0x7f85680096a0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.817 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.810+0000 7f8574800640 1 -- 172.21.15.3:0/2654183835 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f856c109090 msgr2=0x7f856c19abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.810+0000 7f8574800640 1 --2- 172.21.15.3:0/2654183835 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f856c109090 0x7f856c19abb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f855c00e9c0 tx=0x7f855c00ee80 comp rx=0 tx=0).stop 2024-09-19T06:13:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.810+0000 7f8574800640 1 -- 172.21.15.3:0/2654183835 shutdown_connections 2024-09-19T06:13:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.810+0000 7f8574800640 1 --2- 172.21.15.3:0/2654183835 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f85540a33b0 0x7f85540a5870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.810+0000 7f8574800640 1 --2- 172.21.15.3:0/2654183835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f856c19ef30 0x7f856c19f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.810+0000 7f8574800640 1 --2- 172.21.15.3:0/2654183835 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f856c109090 0x7f856c19abb0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.818 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.810+0000 7f8574800640 1 --2- 172.21.15.3:0/2654183835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f856c103f40 0x7f856c19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:57.819 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.810+0000 7f8574800640 1 -- 172.21.15.3:0/2654183835 >> 172.21.15.3:0/2654183835 conn(0x7f856c0ff970 msgr2=0x7f856c100d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:57.819 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.810+0000 7f8574800640 1 -- 172.21.15.3:0/2654183835 shutdown_connections 2024-09-19T06:13:57.819 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:13:57.810+0000 7f8574800640 1 -- 172.21.15.3:0/2654183835 wait complete. 2024-09-19T06:13:58.137 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:57 smithi003 ceph-mon[30893]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 12 op/s 2024-09-19T06:13:58.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:57 smithi059 ceph-mon[35138]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 12 op/s 2024-09-19T06:13:58.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:57 smithi071 ceph-mon[35662]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 12 op/s 2024-09-19T06:13:58.845 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:13:59.235 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:13:59.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.851+0000 7f1f99a00640 1 -- 172.21.15.3:0/3755114011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f94109140 msgr2=0x7f1f94110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:59.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.851+0000 7f1f99a00640 1 --2- 172.21.15.3:0/3755114011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f94109140 0x7f1f94110cc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c009ca0 tx=0x7f1f8c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.851+0000 7f1f99a00640 1 -- 172.21.15.3:0/3755114011 shutdown_connections 2024-09-19T06:13:59.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.851+0000 7f1f99a00640 1 --2- 172.21.15.3:0/3755114011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f94109140 0x7f1f94110cc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.851+0000 7f1f99a00640 1 --2- 172.21.15.3:0/3755114011 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f941049c0 0x7f1f94108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.851+0000 7f1f99a00640 1 --2- 172.21.15.3:0/3755114011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f94104010 0x7f1f941043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.851+0000 7f1f99a00640 1 -- 172.21.15.3:0/3755114011 >> 172.21.15.3:0/3755114011 conn(0x7f1f940ffa50 msgr2=0x7f1f94101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:59.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.852+0000 7f1f99a00640 1 -- 172.21.15.3:0/3755114011 shutdown_connections 2024-09-19T06:13:59.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.852+0000 7f1f99a00640 1 -- 172.21.15.3:0/3755114011 wait complete. 2024-09-19T06:13:59.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.853+0000 7f1f99a00640 1 Processor -- start 2024-09-19T06:13:59.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.853+0000 7f1f99a00640 1 -- start start 2024-09-19T06:13:59.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.853+0000 7f1f99a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f94104010 0x7f1f9419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:59.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.853+0000 7f1f99a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f941049c0 0x7f1f9419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:59.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.854+0000 7f1f99a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f94109140 0x7f1f9419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:59.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.854+0000 7f1f99a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1f941141c0 con 0x7f1f94109140 2024-09-19T06:13:59.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.854+0000 7f1f99a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1f94114040 con 0x7f1f94104010 2024-09-19T06:13:59.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.854+0000 7f1f99a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1f94114340 con 0x7f1f941049c0 2024-09-19T06:13:59.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.854+0000 7f1f92a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f94104010 0x7f1f9419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:59.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.854+0000 7f1f92a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f94104010 0x7f1f9419a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:39910/0 (socket says 172.21.15.3:39910) 2024-09-19T06:13:59.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.854+0000 7f1f92000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f941049c0 0x7f1f9419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:59.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.854+0000 7f1f92a00640 1 -- 172.21.15.3:0/1985561747 learned_addr learned my addr 172.21.15.3:0/1985561747 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:59.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.854+0000 7f1f93400640 1 --2- 172.21.15.3:0/1985561747 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f94109140 0x7f1f9419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:59.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.854+0000 7f1f92a00640 1 -- 172.21.15.3:0/1985561747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f941049c0 msgr2=0x7f1f9419ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:59.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.854+0000 7f1f92a00640 1 --2- 172.21.15.3:0/1985561747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f941049c0 0x7f1f9419ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.854+0000 7f1f92a00640 1 -- 172.21.15.3:0/1985561747 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f94109140 msgr2=0x7f1f9419ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:59.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.854+0000 7f1f92a00640 1 --2- 172.21.15.3:0/1985561747 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f94109140 0x7f1f9419ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.854+0000 7f1f92a00640 1 -- 172.21.15.3:0/1985561747 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9419f670 con 0x7f1f94104010 2024-09-19T06:13:59.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.854+0000 7f1f92000640 1 --2- 172.21.15.3:0/1985561747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f941049c0 0x7f1f9419ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:59.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.855+0000 7f1f92a00640 1 --2- 172.21.15.3:0/1985561747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f94104010 0x7f1f9419a6c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400e9f0 tx=0x7f1f8400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:59.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.855+0000 7f1f8b400640 1 -- 172.21.15.3:0/1985561747 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8400cd80 con 0x7f1f94104010 2024-09-19T06:13:59.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.855+0000 7f1f8b400640 1 -- 172.21.15.3:0/1985561747 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f84005500 con 0x7f1f94104010 2024-09-19T06:13:59.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.855+0000 7f1f99a00640 1 -- 172.21.15.3:0/1985561747 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f9419f960 con 0x7f1f94104010 2024-09-19T06:13:59.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.855+0000 7f1f8b400640 1 -- 172.21.15.3:0/1985561747 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f84010690 con 0x7f1f94104010 2024-09-19T06:13:59.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.855+0000 7f1f99a00640 1 -- 172.21.15.3:0/1985561747 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f941a7240 con 0x7f1f94104010 2024-09-19T06:13:59.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.858+0000 7f1f8b400640 1 -- 172.21.15.3:0/1985561747 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f1f840046c0 con 0x7f1f94104010 2024-09-19T06:13:59.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.858+0000 7f1f9c4b8740 1 Processor -- start 2024-09-19T06:13:59.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.858+0000 7f1f9c4b8740 1 -- start start 2024-09-19T06:13:59.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.859+0000 7f1f9c4b8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd391b90 0x55f1dd391f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:59.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.859+0000 7f1f9c4b8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1dd3924b0 0x55f1dd39c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:59.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.859+0000 7f1f9c4b8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd39cd70 0x55f1dd39f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:59.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.859+0000 7f1f9c4b8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55f1dd2f83e0 con 0x55f1dd391b90 2024-09-19T06:13:59.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.859+0000 7f1f9c4b8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f1dd29fd80 con 0x55f1dd39cd70 2024-09-19T06:13:59.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.859+0000 7f1f9c4b8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f1dd2f43a0 con 0x55f1dd3924b0 2024-09-19T06:13:59.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.859+0000 7f1f93400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd391b90 0x55f1dd391f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:59.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.859+0000 7f1f93400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd391b90 0x55f1dd391f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34116/0 (socket says 172.21.15.3:34116) 2024-09-19T06:13:59.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.859+0000 7f1f93400640 1 -- 172.21.15.3:0/3003771527 learned_addr learned my addr 172.21.15.3:0/3003771527 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:59.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.859+0000 7f1f92000640 1 --2- 172.21.15.3:0/3003771527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd39cd70 0x55f1dd39f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:59.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.859+0000 7f1f92a00640 1 --2- 172.21.15.3:0/3003771527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1dd3924b0 0x55f1dd39c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:59.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.859+0000 7f1f93400640 1 -- 172.21.15.3:0/3003771527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1dd3924b0 msgr2=0x55f1dd39c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:59.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.860+0000 7f1f93400640 1 --2- 172.21.15.3:0/3003771527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1dd3924b0 0x55f1dd39c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.860+0000 7f1f93400640 1 -- 172.21.15.3:0/3003771527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd39cd70 msgr2=0x55f1dd39f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:59.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.860+0000 7f1f93400640 1 --2- 172.21.15.3:0/3003771527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd39cd70 0x55f1dd39f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.860+0000 7f1f93400640 1 -- 172.21.15.3:0/3003771527 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1dd2beae0 con 0x55f1dd391b90 2024-09-19T06:13:59.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.860+0000 7f1f92a00640 1 --2- 172.21.15.3:0/3003771527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1dd3924b0 0x55f1dd39c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:13:59.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.860+0000 7f1f92000640 1 --2- 172.21.15.3:0/3003771527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd39cd70 0x55f1dd39f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:59.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.860+0000 7f1f8b400640 1 --2- 172.21.15.3:0/1985561747 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1f780a33b0 0x7f1f780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:59.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.860+0000 7f1f93400640 1 --2- 172.21.15.3:0/3003771527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd391b90 0x55f1dd391f70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c009ca0 tx=0x7f1f8c0093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db387b2d455f5502 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:59.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.860+0000 7f1f8b400640 1 -- 172.21.15.3:0/1985561747 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f1f840d0160 con 0x7f1f94104010 2024-09-19T06:13:59.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.860+0000 7f1f92a00640 1 --2- 172.21.15.3:0/1985561747 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1f780a33b0 0x7f1f780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:59.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.860+0000 7f1f7fe00640 1 -- 172.21.15.3:0/3003771527 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c031db0 con 0x55f1dd391b90 2024-09-19T06:13:59.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.861+0000 7f1f7fe00640 1 -- 172.21.15.3:0/3003771527 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f8c036030 con 0x55f1dd391b90 2024-09-19T06:13:59.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.861+0000 7f1f7fe00640 1 -- 172.21.15.3:0/3003771527 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c0042d0 con 0x55f1dd391b90 2024-09-19T06:13:59.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.861+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/3003771527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd391b90 msgr2=0x55f1dd391f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:59.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.861+0000 7f1f9c4b8740 1 --2- 172.21.15.3:0/3003771527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd391b90 0x55f1dd391f70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c009ca0 tx=0x7f1f8c0093e0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.861+0000 7f1f92a00640 1 --2- 172.21.15.3:0/1985561747 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1f780a33b0 0x7f1f780a5870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55f1dd38ef80 tx=0x7f1f84098040 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:59.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.861+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/3003771527 shutdown_connections 2024-09-19T06:13:59.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.861+0000 7f1f9c4b8740 1 --2- 172.21.15.3:0/3003771527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd39cd70 0x55f1dd39f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.861+0000 7f1f9c4b8740 1 --2- 172.21.15.3:0/3003771527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1dd3924b0 0x55f1dd39c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.861+0000 7f1f9c4b8740 1 --2- 172.21.15.3:0/3003771527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd391b90 0x55f1dd391f70 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.861+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/3003771527 >> 172.21.15.3:0/3003771527 conn(0x55f1dd38e120 msgr2=0x55f1dd38e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:59.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.861+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/3003771527 shutdown_connections 2024-09-19T06:13:59.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.862+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/3003771527 wait complete. 2024-09-19T06:13:59.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.862+0000 7f1f9c4b8740 1 -- start start 2024-09-19T06:13:59.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.862+0000 7f1f9c4b8740 1 Processor -- start 2024-09-19T06:13:59.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.863+0000 7f1f9c4b8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd391b90 0x55f1dd399c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:59.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.863+0000 7f1f9c4b8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd3924b0 0x55f1dd39a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:59.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.863+0000 7f1f9c4b8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1dd39cd70 0x55f1dd39a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:59.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.863+0000 7f1f9c4b8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55f1dd39f860 con 0x55f1dd391b90 2024-09-19T06:13:59.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.863+0000 7f1f9c4b8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f1dd2b30f0 con 0x55f1dd3924b0 2024-09-19T06:13:59.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.863+0000 7f1f9c4b8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f1dd39f9e0 con 0x55f1dd39cd70 2024-09-19T06:13:59.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.863+0000 7f1f9c4b8740 10 client.0 _ll_register_callbacks cb 0x55f1dd2a49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:59.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.863+0000 7f1f93400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd391b90 0x55f1dd399c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:59.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.863+0000 7f1f93400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd391b90 0x55f1dd399c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34120/0 (socket says 172.21.15.3:34120) 2024-09-19T06:13:59.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.863+0000 7f1f93400640 1 -- 172.21.15.3:0/1414808098 learned_addr learned my addr 172.21.15.3:0/1414808098 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:59.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.863+0000 7f1f92000640 1 --2- 172.21.15.3:0/1414808098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd3924b0 0x55f1dd39a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:59.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.863+0000 7f1f93400640 1 --2- 172.21.15.3:0/1414808098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1dd39cd70 0x55f1dd39a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:59.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.864+0000 7f1f93400640 1 -- 172.21.15.3:0/1414808098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1dd39cd70 msgr2=0x55f1dd39a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:59.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.864+0000 7f1f93400640 1 --2- 172.21.15.3:0/1414808098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1dd39cd70 0x55f1dd39a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.864+0000 7f1f93400640 1 -- 172.21.15.3:0/1414808098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd3924b0 msgr2=0x55f1dd39a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:59.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.864+0000 7f1f93400640 1 --2- 172.21.15.3:0/1414808098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd3924b0 0x55f1dd39a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.864+0000 7f1f93400640 1 -- 172.21.15.3:0/1414808098 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1dd0693c0 con 0x55f1dd391b90 2024-09-19T06:13:59.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.864+0000 7f1f92000640 1 --2- 172.21.15.3:0/1414808098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd3924b0 0x55f1dd39a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:13:59.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.864+0000 7f1f93400640 1 --2- 172.21.15.3:0/1414808098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd391b90 0x55f1dd399c60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c031450 tx=0x7f1f8c031980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63858ba81b3dd83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:59.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.864+0000 7f1f7cc00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:13:59.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.864+0000 7f1f7cc00640 1 -- 172.21.15.3:0/1414808098 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c058060 con 0x55f1dd391b90 2024-09-19T06:13:59.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.864+0000 7f1f7cc00640 1 -- 172.21.15.3:0/1414808098 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f1f8c003d80 con 0x55f1dd391b90 2024-09-19T06:13:59.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.864+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/1414808098 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f8c036030 con 0x55f1dd391b90 2024-09-19T06:13:59.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.864+0000 7f1f7cc00640 1 -- 172.21.15.3:0/1414808098 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1f8c0040b0 con 0x55f1dd391b90 2024-09-19T06:13:59.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.865+0000 7f1f9c4b8740 10 client.15561 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:59.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.865+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/1414808098 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f1dd39f860 con 0x55f1dd391b90 2024-09-19T06:13:59.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.865+0000 7f1f7cc00640 1 -- 172.21.15.3:0/1414808098 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f8c036030 con 0x55f1dd391b90 2024-09-19T06:13:59.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.865+0000 7f1f7cc00640 1 -- 172.21.15.3:0/1414808098 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f1f8c043070 con 0x55f1dd391b90 2024-09-19T06:13:59.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.865+0000 7f1f9c4b8740 10 client.15561 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:59.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.865+0000 7f1f9c4b8740 10 client.15561 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:13:59.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.865+0000 7f1f9c4b8740 20 client.15561 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:59.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.865+0000 7f1f9c4b8740 1 --2- 172.21.15.3:0/1414808098 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f1dd3ac6e0 0x55f1dd3aead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:59.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.865+0000 7f1f9c4b8740 4 client.15561 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:13:59.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.865+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/1414808098 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1dd305950 con 0x55f1dd3ac6e0 2024-09-19T06:13:59.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.866+0000 7f1f92000640 1 --2- 172.21.15.3:0/1414808098 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f1dd3ac6e0 0x55f1dd3aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:59.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.866+0000 7f1f92000640 1 --2- 172.21.15.3:0/1414808098 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f1dd3ac6e0 0x55f1dd3aead0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d67759361129d816 server_cookie=1a62ca9eae3e4bae in_seq=0 out_seq=0 2024-09-19T06:13:59.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.866+0000 7f1f7cc00640 10 client.15561 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:59.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.867+0000 7f1f7cc00640 1 -- 172.21.15.3:0/1414808098 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f1dd305950 con 0x55f1dd3ac6e0 2024-09-19T06:13:59.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.867+0000 7f1f7cc00640 10 client.15561 handle_command_reply: tid=0 2024-09-19T06:13:59.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.867+0000 7f1f9c4b8740 1 client.15561 shutdown 2024-09-19T06:13:59.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.867+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/1414808098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd391b90 msgr2=0x55f1dd399c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:59.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.867+0000 7f1f9c4b8740 1 --2- 172.21.15.3:0/1414808098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd391b90 0x55f1dd399c60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c031450 tx=0x7f1f8c031980 comp rx=0 tx=0).stop 2024-09-19T06:13:59.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.867+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/1414808098 shutdown_connections 2024-09-19T06:13:59.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.867+0000 7f1f9c4b8740 1 --2- 172.21.15.3:0/1414808098 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f1dd3ac6e0 0x55f1dd3aead0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.867+0000 7f1f9c4b8740 1 --2- 172.21.15.3:0/1414808098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1dd39cd70 0x55f1dd39a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.867+0000 7f1f9c4b8740 1 --2- 172.21.15.3:0/1414808098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd3924b0 0x55f1dd39a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.867+0000 7f1f9c4b8740 1 --2- 172.21.15.3:0/1414808098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd391b90 0x55f1dd399c60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.867+0000 7f1f7cc00640 0 client.15561 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:59.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.867+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/1414808098 >> 172.21.15.3:0/1414808098 conn(0x55f1dd38e120 msgr2=0x55f1dd393e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:59.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.867+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/1414808098 shutdown_connections 2024-09-19T06:13:59.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.867+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/1414808098 wait complete. 2024-09-19T06:13:59.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.868+0000 7f1f9c4b8740 20 client.15561 trim_cache size 0 max 16384 2024-09-19T06:13:59.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.886+0000 7f1f9c4b8740 1 Processor -- start 2024-09-19T06:13:59.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.886+0000 7f1f9c4b8740 1 -- start start 2024-09-19T06:13:59.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.886+0000 7f1f9c4b8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd391b90 0x55f1dd388e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:59.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.886+0000 7f1f9c4b8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd3924b0 0x55f1dd3b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:59.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.886+0000 7f1f9c4b8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1dd39cd70 0x55f1dd3b4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:59.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.886+0000 7f1f9c4b8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1f941afab0 con 0x55f1dd3924b0 2024-09-19T06:13:59.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.886+0000 7f1f9c4b8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1f941b15f0 con 0x55f1dd391b90 2024-09-19T06:13:59.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.886+0000 7f1f9c4b8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1f941b0180 con 0x55f1dd39cd70 2024-09-19T06:13:59.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.887+0000 7f1f93400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd391b90 0x55f1dd388e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:59.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.887+0000 7f1f92000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd3924b0 0x55f1dd3b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:59.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.887+0000 7f1f93400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd391b90 0x55f1dd388e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:39942/0 (socket says 172.21.15.3:39942) 2024-09-19T06:13:59.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.887+0000 7f1f93400640 1 -- 172.21.15.3:0/2528401995 learned_addr learned my addr 172.21.15.3:0/2528401995 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:59.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.887+0000 7f1f93400640 1 --2- 172.21.15.3:0/2528401995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1dd39cd70 0x55f1dd3b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:59.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.887+0000 7f1f93400640 1 -- 172.21.15.3:0/2528401995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1dd39cd70 msgr2=0x55f1dd3b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:59.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.887+0000 7f1f93400640 1 --2- 172.21.15.3:0/2528401995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1dd39cd70 0x55f1dd3b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.887+0000 7f1f93400640 1 -- 172.21.15.3:0/2528401995 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd3924b0 msgr2=0x55f1dd3b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:59.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.887+0000 7f1f93400640 1 --2- 172.21.15.3:0/2528401995 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd3924b0 0x55f1dd3b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.887+0000 7f1f93400640 1 -- 172.21.15.3:0/2528401995 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1dd3922e0 con 0x55f1dd391b90 2024-09-19T06:13:59.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.887+0000 7f1f93400640 1 --2- 172.21.15.3:0/2528401995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd391b90 0x55f1dd388e50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c009620 tx=0x7f1f8c02f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2318c1f7d06e382 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:59.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.888+0000 7f1f7f400640 1 -- 172.21.15.3:0/2528401995 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c058040 con 0x55f1dd391b90 2024-09-19T06:13:59.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.888+0000 7f1f7f400640 1 -- 172.21.15.3:0/2528401995 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f8c036020 con 0x55f1dd391b90 2024-09-19T06:13:59.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.888+0000 7f1f7f400640 1 -- 172.21.15.3:0/2528401995 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c004b40 con 0x55f1dd391b90 2024-09-19T06:13:59.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.888+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/2528401995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd391b90 msgr2=0x55f1dd388e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:59.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.888+0000 7f1f9c4b8740 1 --2- 172.21.15.3:0/2528401995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd391b90 0x55f1dd388e50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c009620 tx=0x7f1f8c02f610 comp rx=0 tx=0).stop 2024-09-19T06:13:59.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.888+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/2528401995 shutdown_connections 2024-09-19T06:13:59.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.888+0000 7f1f9c4b8740 1 --2- 172.21.15.3:0/2528401995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1dd39cd70 0x55f1dd3b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.888+0000 7f1f9c4b8740 1 --2- 172.21.15.3:0/2528401995 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd3924b0 0x55f1dd3b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.888+0000 7f1f9c4b8740 1 --2- 172.21.15.3:0/2528401995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd391b90 0x55f1dd388e50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.888+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/2528401995 >> 172.21.15.3:0/2528401995 conn(0x55f1dd38e120 msgr2=0x55f1dd398530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:59.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.888+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/2528401995 shutdown_connections 2024-09-19T06:13:59.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.889+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/2528401995 wait complete. 2024-09-19T06:13:59.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.889+0000 7f1f9c4b8740 1 -- start start 2024-09-19T06:13:59.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.889+0000 7f1f9c4b8740 1 Processor -- start 2024-09-19T06:13:59.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.890+0000 7f1f9c4b8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1dd391b90 0x55f1dd3a0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:59.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.890+0000 7f1f9c4b8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd3924b0 0x55f1dd3a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:59.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.890+0000 7f1f9c4b8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd39cd70 0x55f1dd415380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:59.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.890+0000 7f1f9c4b8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1f941b0f20 con 0x55f1dd3924b0 2024-09-19T06:13:59.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.890+0000 7f1f9c4b8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1f941b0850 con 0x55f1dd39cd70 2024-09-19T06:13:59.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.890+0000 7f1f9c4b8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1f941ada90 con 0x55f1dd391b90 2024-09-19T06:13:59.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.890+0000 7f1f9c4b8740 10 client.0 _ll_register_callbacks cb 0x7f1f8c031860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:13:59.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.890+0000 7f1f92000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd3924b0 0x55f1dd3a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:59.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.890+0000 7f1f93400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd39cd70 0x55f1dd415380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:59.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.890+0000 7f1f93400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd39cd70 0x55f1dd415380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:39956/0 (socket says 172.21.15.3:39956) 2024-09-19T06:13:59.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.890+0000 7f1f93400640 1 -- 172.21.15.3:0/1629685082 learned_addr learned my addr 172.21.15.3:0/1629685082 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:13:59.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.890+0000 7f1f93400640 1 --2- 172.21.15.3:0/1629685082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1dd391b90 0x55f1dd3a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:59.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.890+0000 7f1f92000640 1 -- 172.21.15.3:0/1629685082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1dd391b90 msgr2=0x55f1dd3a0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:59.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.890+0000 7f1f92000640 1 --2- 172.21.15.3:0/1629685082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1dd391b90 0x55f1dd3a0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.890+0000 7f1f92000640 1 -- 172.21.15.3:0/1629685082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd39cd70 msgr2=0x55f1dd415380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:13:59.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.890+0000 7f1f92000640 1 --2- 172.21.15.3:0/1629685082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd39cd70 0x55f1dd415380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.890+0000 7f1f92000640 1 -- 172.21.15.3:0/1629685082 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1dd4158c0 con 0x55f1dd3924b0 2024-09-19T06:13:59.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.891+0000 7f1f92000640 1 --2- 172.21.15.3:0/1629685082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd3924b0 0x55f1dd3a06d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55f1dd39b210 tx=0x7f1f800207d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14ed52277ddbb12 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:13:59.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.891+0000 7f1f7cc00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:13:59.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.891+0000 7f1f7cc00640 1 -- 172.21.15.3:0/1629685082 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f8002d060 con 0x55f1dd3924b0 2024-09-19T06:13:59.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.891+0000 7f1f7cc00640 1 -- 172.21.15.3:0/1629685082 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f1f80010630 con 0x55f1dd3924b0 2024-09-19T06:13:59.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.891+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/1629685082 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f8c036020 con 0x55f1dd3924b0 2024-09-19T06:13:59.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.891+0000 7f1f7cc00640 1 -- 172.21.15.3:0/1629685082 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1f80010830 con 0x55f1dd3924b0 2024-09-19T06:13:59.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.891+0000 7f1f9c4b8740 10 client.15567 fetch_fsmap learned FSMap version 29 2024-09-19T06:13:59.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.891+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/1629685082 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f1dd416b70 con 0x55f1dd3924b0 2024-09-19T06:13:59.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.892+0000 7f1f7cc00640 1 -- 172.21.15.3:0/1629685082 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f8c036020 con 0x55f1dd3924b0 2024-09-19T06:13:59.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.892+0000 7f1f7cc00640 1 -- 172.21.15.3:0/1629685082 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f1f800318e0 con 0x55f1dd3924b0 2024-09-19T06:13:59.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.892+0000 7f1f9c4b8740 10 client.15567 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:13:59.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.892+0000 7f1f9c4b8740 10 client.15567 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:13:59.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.892+0000 7f1f9c4b8740 20 client.15567 populate_metadata read hostname 'smithi003' 2024-09-19T06:13:59.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.892+0000 7f1f9c4b8740 1 --2- 172.21.15.3:0/1629685082 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f1dd4172a0 0x55f1dd4196c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:13:59.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.892+0000 7f1f9c4b8740 4 client.15567 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:13:59.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.892+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/1629685082 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f1dd2ffe60 con 0x55f1dd4172a0 2024-09-19T06:13:59.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.892+0000 7f1f93400640 1 --2- 172.21.15.3:0/1629685082 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f1dd4172a0 0x55f1dd4196c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:13:59.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.893+0000 7f1f93400640 1 --2- 172.21.15.3:0/1629685082 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f1dd4172a0 0x55f1dd4196c0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f8f01636d0d0558 server_cookie=79d56006e7d31c3d in_seq=0 out_seq=0 2024-09-19T06:13:59.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.893+0000 7f1f7cc00640 10 client.15567 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:59.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.893+0000 7f1f7cc00640 1 -- 172.21.15.3:0/1629685082 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f1dd2ffe60 con 0x55f1dd4172a0 2024-09-19T06:13:59.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.893+0000 7f1f7cc00640 10 client.15567 handle_command_reply: tid=0 2024-09-19T06:13:59.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.893+0000 7f1f9c4b8740 1 client.15567 shutdown 2024-09-19T06:13:59.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.893+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/1629685082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd3924b0 msgr2=0x55f1dd3a06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:59.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.893+0000 7f1f9c4b8740 1 --2- 172.21.15.3:0/1629685082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd3924b0 0x55f1dd3a06d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55f1dd39b210 tx=0x7f1f800207d0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.893+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/1629685082 shutdown_connections 2024-09-19T06:13:59.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.893+0000 7f1f9c4b8740 1 --2- 172.21.15.3:0/1629685082 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f1dd4172a0 0x55f1dd4196c0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.893+0000 7f1f9c4b8740 1 --2- 172.21.15.3:0/1629685082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f1dd39cd70 0x55f1dd415380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.893+0000 7f1f9c4b8740 1 --2- 172.21.15.3:0/1629685082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f1dd3924b0 0x55f1dd3a06d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.893+0000 7f1f9c4b8740 1 --2- 172.21.15.3:0/1629685082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f1dd391b90 0x55f1dd3a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.893+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/1629685082 >> 172.21.15.3:0/1629685082 conn(0x55f1dd38e120 msgr2=0x55f1dd3935e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:59.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.893+0000 7f1f7cc00640 0 client.15567 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:13:59.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.894+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/1629685082 shutdown_connections 2024-09-19T06:13:59.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.894+0000 7f1f9c4b8740 1 -- 172.21.15.3:0/1629685082 wait complete. 2024-09-19T06:13:59.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.894+0000 7f1f9c4b8740 20 client.15567 trim_cache size 0 max 16384 2024-09-19T06:13:59.903 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:13:59.904 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "no active scrubs running", 2024-09-19T06:13:59.904 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": {} 2024-09-19T06:13:59.904 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:13:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.894+0000 7f1f99a00640 1 -- 172.21.15.3:0/1985561747 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1f780a33b0 msgr2=0x7f1f780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.894+0000 7f1f99a00640 1 --2- 172.21.15.3:0/1985561747 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1f780a33b0 0x7f1f780a5870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55f1dd38ef80 tx=0x7f1f84098040 comp rx=0 tx=0).stop 2024-09-19T06:13:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.894+0000 7f1f99a00640 1 -- 172.21.15.3:0/1985561747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f94104010 msgr2=0x7f1f9419a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:13:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.894+0000 7f1f99a00640 1 --2- 172.21.15.3:0/1985561747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f94104010 0x7f1f9419a6c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400e9f0 tx=0x7f1f8400edf0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.894+0000 7f1f99a00640 1 -- 172.21.15.3:0/1985561747 shutdown_connections 2024-09-19T06:13:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.894+0000 7f1f99a00640 1 --2- 172.21.15.3:0/1985561747 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1f780a33b0 0x7f1f780a5870 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.894+0000 7f1f99a00640 1 --2- 172.21.15.3:0/1985561747 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f94109140 0x7f1f9419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.894+0000 7f1f99a00640 1 --2- 172.21.15.3:0/1985561747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f941049c0 0x7f1f9419ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.895+0000 7f1f99a00640 1 --2- 172.21.15.3:0/1985561747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f94104010 0x7f1f9419a6c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:13:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.895+0000 7f1f99a00640 1 -- 172.21.15.3:0/1985561747 >> 172.21.15.3:0/1985561747 conn(0x7f1f940ffa50 msgr2=0x7f1f94100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:13:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.895+0000 7f1f99a00640 1 -- 172.21.15.3:0/1985561747 shutdown_connections 2024-09-19T06:13:59.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:13:59.895+0000 7f1f99a00640 1 -- 172.21.15.3:0/1985561747 wait complete. 2024-09-19T06:14:00.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:13:59 smithi003 ceph-mon[30893]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 16 op/s 2024-09-19T06:14:00.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:13:59 smithi059 ceph-mon[35138]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 16 op/s 2024-09-19T06:14:00.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:13:59 smithi071 ceph-mon[35662]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 16 op/s 2024-09-19T06:14:00.956 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:14:00.957 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:14:01.353 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:01.945 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:01 smithi003 ceph-mon[30893]: pgmap v52: 97 pgs: 97 active+clean; 1.5 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 20 op/s 2024-09-19T06:14:01.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.943+0000 7f555a800640 1 -- 172.21.15.3:0/1646975956 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55541079c0 msgr2=0x7f5554107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:01.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.943+0000 7f555a800640 1 --2- 172.21.15.3:0/1646975956 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55541079c0 0x7f5554107da0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5548009930 tx=0x7f554802a420 comp rx=0 tx=0).stop 2024-09-19T06:14:01.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.943+0000 7f555a800640 1 -- 172.21.15.3:0/1646975956 shutdown_connections 2024-09-19T06:14:01.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.943+0000 7f555a800640 1 --2- 172.21.15.3:0/1646975956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5554102360 0x7f555410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.943+0000 7f555a800640 1 --2- 172.21.15.3:0/1646975956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55541019c0 0x7f5554101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.943+0000 7f555a800640 1 --2- 172.21.15.3:0/1646975956 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55541079c0 0x7f5554107da0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.943+0000 7f555a800640 1 -- 172.21.15.3:0/1646975956 >> 172.21.15.3:0/1646975956 conn(0x7f55540fd740 msgr2=0x7f55540ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:01.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.943+0000 7f555a800640 1 -- 172.21.15.3:0/1646975956 shutdown_connections 2024-09-19T06:14:01.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.943+0000 7f555a800640 1 -- 172.21.15.3:0/1646975956 wait complete. 2024-09-19T06:14:01.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.945+0000 7f555a800640 1 Processor -- start 2024-09-19T06:14:01.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.945+0000 7f555a800640 1 -- start start 2024-09-19T06:14:01.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.945+0000 7f555a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55541019c0 0x7f5554198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.945+0000 7f555a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5554102360 0x7f55541987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.945+0000 7f555a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55541079c0 0x7f555419cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.945+0000 7f555a800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5554111e10 con 0x7f55541079c0 2024-09-19T06:14:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.945+0000 7f555a800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5554111c90 con 0x7f55541019c0 2024-09-19T06:14:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.945+0000 7f555a800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5554111f90 con 0x7f5554102360 2024-09-19T06:14:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.945+0000 7f5559e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55541079c0 0x7f555419cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.945+0000 7f5559e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55541079c0 0x7f555419cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34160/0 (socket says 172.21.15.3:34160) 2024-09-19T06:14:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.945+0000 7f5559e00640 1 -- 172.21.15.3:0/1174186165 learned_addr learned my addr 172.21.15.3:0/1174186165 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.946+0000 7f5558a00640 1 --2- 172.21.15.3:0/1174186165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5554102360 0x7f55541987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.946+0000 7f5559400640 1 --2- 172.21.15.3:0/1174186165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55541019c0 0x7f5554198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.946+0000 7f5559e00640 1 -- 172.21.15.3:0/1174186165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5554102360 msgr2=0x7f55541987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.946+0000 7f5559e00640 1 --2- 172.21.15.3:0/1174186165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5554102360 0x7f55541987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.946+0000 7f5559e00640 1 -- 172.21.15.3:0/1174186165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55541019c0 msgr2=0x7f5554198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:01.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.946+0000 7f5559e00640 1 --2- 172.21.15.3:0/1174186165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55541019c0 0x7f5554198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:01.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.946+0000 7f5559e00640 1 -- 172.21.15.3:0/1174186165 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f555419d240 con 0x7f55541079c0 2024-09-19T06:14:01.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.946+0000 7f5558a00640 1 --2- 172.21.15.3:0/1174186165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5554102360 0x7f55541987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:01.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.946+0000 7f5559e00640 1 --2- 172.21.15.3:0/1174186165 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55541079c0 0x7f555419cb60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f554c00eb10 tx=0x7f554c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:01.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.947+0000 7f5552000640 1 -- 172.21.15.3:0/1174186165 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c004b20 con 0x7f55541079c0 2024-09-19T06:14:01.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.947+0000 7f5552000640 1 -- 172.21.15.3:0/1174186165 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f554c004cc0 con 0x7f55541079c0 2024-09-19T06:14:01.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.947+0000 7f555a800640 1 -- 172.21.15.3:0/1174186165 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f555419d530 con 0x7f55541079c0 2024-09-19T06:14:01.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.947+0000 7f5552000640 1 -- 172.21.15.3:0/1174186165 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c010760 con 0x7f55541079c0 2024-09-19T06:14:01.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.947+0000 7f555a800640 1 -- 172.21.15.3:0/1174186165 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55541a4e10 con 0x7f55541079c0 2024-09-19T06:14:01.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.948+0000 7f555a800640 1 -- 172.21.15.3:0/1174186165 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5554101e20 con 0x7f55541079c0 2024-09-19T06:14:01.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.950+0000 7f5552000640 1 -- 172.21.15.3:0/1174186165 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f554c005020 con 0x7f55541079c0 2024-09-19T06:14:01.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.951+0000 7f5552000640 1 --2- 172.21.15.3:0/1174186165 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f553c0a33b0 0x7f553c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:01.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.951+0000 7f5552000640 1 -- 172.21.15.3:0/1174186165 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f554c0d03c0 con 0x7f55541079c0 2024-09-19T06:14:01.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.952+0000 7f5559400640 1 --2- 172.21.15.3:0/1174186165 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f553c0a33b0 0x7f553c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:01.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.952+0000 7f5559400640 1 --2- 172.21.15.3:0/1174186165 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f553c0a33b0 0x7f553c0a5870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5548006010 tx=0x7f5548000bc0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:01.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:01.956+0000 7f5552000640 1 -- 172.21.15.3:0/1174186165 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f554c09cd40 con 0x7f55541079c0 2024-09-19T06:14:02.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:02.181+0000 7f555a800640 1 -- 172.21.15.3:0/1174186165 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f555402d7c0 con 0x7f55541079c0 2024-09-19T06:14:02.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:02.182+0000 7f5552000640 1 -- 172.21.15.3:0/1174186165 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7f554c098020 con 0x7f55541079c0 2024-09-19T06:14:02.184 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:14:02.184 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"btime":"2024-09-19T06:12:22:958217+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:12:22.060987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24532,24515,24514,14517]},"id":1}]} 2024-09-19T06:14:02.184 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2024-09-19T06:14:02.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:02.184+0000 7f555a800640 1 -- 172.21.15.3:0/1174186165 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f553c0a33b0 msgr2=0x7f553c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:02.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:02.184+0000 7f555a800640 1 --2- 172.21.15.3:0/1174186165 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f553c0a33b0 0x7f553c0a5870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5548006010 tx=0x7f5548000bc0 comp rx=0 tx=0).stop 2024-09-19T06:14:02.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:02.184+0000 7f555a800640 1 -- 172.21.15.3:0/1174186165 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55541079c0 msgr2=0x7f555419cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:02.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:02.184+0000 7f555a800640 1 --2- 172.21.15.3:0/1174186165 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55541079c0 0x7f555419cb60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f554c00eb10 tx=0x7f554c00c2d0 comp rx=0 tx=0).stop 2024-09-19T06:14:02.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:02.184+0000 7f555a800640 1 -- 172.21.15.3:0/1174186165 shutdown_connections 2024-09-19T06:14:02.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:02.184+0000 7f555a800640 1 --2- 172.21.15.3:0/1174186165 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f553c0a33b0 0x7f553c0a5870 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:02.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:02.184+0000 7f555a800640 1 --2- 172.21.15.3:0/1174186165 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55541079c0 0x7f555419cb60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:02.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:02.184+0000 7f555a800640 1 --2- 172.21.15.3:0/1174186165 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5554102360 0x7f55541987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:02.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:02.184+0000 7f555a800640 1 --2- 172.21.15.3:0/1174186165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55541019c0 0x7f5554198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:02.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:02.184+0000 7f555a800640 1 -- 172.21.15.3:0/1174186165 >> 172.21.15.3:0/1174186165 conn(0x7f55540fd740 msgr2=0x7f55540fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:02.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:02.185+0000 7f555a800640 1 -- 172.21.15.3:0/1174186165 shutdown_connections 2024-09-19T06:14:02.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:02.185+0000 7f555a800640 1 -- 172.21.15.3:0/1174186165 wait complete. 2024-09-19T06:14:02.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:01 smithi059 ceph-mon[35138]: pgmap v52: 97 pgs: 97 active+clean; 1.5 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 20 op/s 2024-09-19T06:14:02.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:01 smithi071 ceph-mon[35662]: pgmap v52: 97 pgs: 97 active+clean; 1.5 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 20 op/s 2024-09-19T06:14:03.111 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:02 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1174186165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:03.113 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:14:03.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:02 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1174186165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:03.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:02 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1174186165' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:03.496 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:04.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:03 smithi003 ceph-mon[30893]: pgmap v53: 97 pgs: 97 active+clean; 1.5 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-19T06:14:04.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.265+0000 7f3560800640 1 -- 172.21.15.3:0/337537091 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3558109120 msgr2=0x7f3558110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:04.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.265+0000 7f3560800640 1 --2- 172.21.15.3:0/337537091 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3558109120 0x7f3558110ca0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3554009ca0 tx=0x7f355402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.265+0000 7f3560800640 1 -- 172.21.15.3:0/337537091 shutdown_connections 2024-09-19T06:14:04.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.265+0000 7f3560800640 1 --2- 172.21.15.3:0/337537091 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3558109120 0x7f3558110ca0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.265+0000 7f3560800640 1 --2- 172.21.15.3:0/337537091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f35581049a0 0x7f35581089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.265+0000 7f3560800640 1 --2- 172.21.15.3:0/337537091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3558103ff0 0x7f35581043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.265+0000 7f3560800640 1 -- 172.21.15.3:0/337537091 >> 172.21.15.3:0/337537091 conn(0x7f35580ffa90 msgr2=0x7f3558101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:04.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.265+0000 7f3560800640 1 -- 172.21.15.3:0/337537091 shutdown_connections 2024-09-19T06:14:04.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.265+0000 7f3560800640 1 -- 172.21.15.3:0/337537091 wait complete. 2024-09-19T06:14:04.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.266+0000 7f3560800640 1 Processor -- start 2024-09-19T06:14:04.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.266+0000 7f3560800640 1 -- start start 2024-09-19T06:14:04.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.267+0000 7f3560800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3558103ff0 0x7f355819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:04.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.267+0000 7f3560800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35581049a0 0x7f355819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:04.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.267+0000 7f3560800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3558109120 0x7f355819eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:04.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.267+0000 7f3560800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f35581141a0 con 0x7f3558103ff0 2024-09-19T06:14:04.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.267+0000 7f3560800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3558114020 con 0x7f35581049a0 2024-09-19T06:14:04.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.267+0000 7f3560800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3558114320 con 0x7f3558109120 2024-09-19T06:14:04.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.267+0000 7f355de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3558103ff0 0x7f355819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:04.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.267+0000 7f355de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3558103ff0 0x7f355819a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53384/0 (socket says 172.21.15.3:53384) 2024-09-19T06:14:04.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.267+0000 7f355de00640 1 -- 172.21.15.3:0/80463303 learned_addr learned my addr 172.21.15.3:0/80463303 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:04.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.267+0000 7f355d400640 1 --2- 172.21.15.3:0/80463303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35581049a0 0x7f355819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:04.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.267+0000 7f355e800640 1 --2- 172.21.15.3:0/80463303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3558109120 0x7f355819eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:04.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.267+0000 7f355d400640 1 -- 172.21.15.3:0/80463303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3558109120 msgr2=0x7f355819eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:04.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.267+0000 7f355d400640 1 --2- 172.21.15.3:0/80463303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3558109120 0x7f355819eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.267+0000 7f355d400640 1 -- 172.21.15.3:0/80463303 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3558103ff0 msgr2=0x7f355819a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:04.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.267+0000 7f355d400640 1 --2- 172.21.15.3:0/80463303 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3558103ff0 0x7f355819a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.267+0000 7f355d400640 1 -- 172.21.15.3:0/80463303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355819f590 con 0x7f35581049a0 2024-09-19T06:14:04.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.267+0000 7f355e800640 1 --2- 172.21.15.3:0/80463303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3558109120 0x7f355819eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:04.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.267+0000 7f355de00640 1 --2- 172.21.15.3:0/80463303 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3558103ff0 0x7f355819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:04.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.268+0000 7f355d400640 1 --2- 172.21.15.3:0/80463303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35581049a0 0x7f355819ab20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f354800e9f0 tx=0x7f354800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:04.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.268+0000 7f3552a00640 1 -- 172.21.15.3:0/80463303 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354800ccc0 con 0x7f35581049a0 2024-09-19T06:14:04.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.268+0000 7f3552a00640 1 -- 172.21.15.3:0/80463303 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3548005020 con 0x7f35581049a0 2024-09-19T06:14:04.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.268+0000 7f3560800640 1 -- 172.21.15.3:0/80463303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f355819f880 con 0x7f35581049a0 2024-09-19T06:14:04.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.268+0000 7f3552a00640 1 -- 172.21.15.3:0/80463303 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35480049e0 con 0x7f35581049a0 2024-09-19T06:14:04.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.268+0000 7f3560800640 1 -- 172.21.15.3:0/80463303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35581a7160 con 0x7f35581049a0 2024-09-19T06:14:04.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.271+0000 7f35632c8740 1 Processor -- start 2024-09-19T06:14:04.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.271+0000 7f35632c8740 1 -- start start 2024-09-19T06:14:04.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.271+0000 7f3552a00640 1 -- 172.21.15.3:0/80463303 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f3548005560 con 0x7f35581049a0 2024-09-19T06:14:04.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.272+0000 7f35632c8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e26b72c70 0x558e26b73050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:04.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.272+0000 7f35632c8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b73590 0x558e26b7d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:04.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.272+0000 7f35632c8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e26b7de50 0x558e26b80240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:04.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.272+0000 7f35632c8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558e26ad93e0 con 0x558e26b73590 2024-09-19T06:14:04.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.272+0000 7f35632c8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558e26a80d80 con 0x558e26b7de50 2024-09-19T06:14:04.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.272+0000 7f35632c8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558e26ad53a0 con 0x558e26b72c70 2024-09-19T06:14:04.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.272+0000 7f355e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e26b72c70 0x558e26b73050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:04.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.272+0000 7f355e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e26b72c70 0x558e26b73050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:40518/0 (socket says 172.21.15.3:40518) 2024-09-19T06:14:04.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.272+0000 7f355e800640 1 -- 172.21.15.3:0/3597112303 learned_addr learned my addr 172.21.15.3:0/3597112303 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:04.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.272+0000 7f355d400640 1 --2- 172.21.15.3:0/3597112303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e26b7de50 0x558e26b80240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:04.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.272+0000 7f355e800640 1 -- 172.21.15.3:0/3597112303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e26b7de50 msgr2=0x558e26b80240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:04.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.272+0000 7f355e800640 1 --2- 172.21.15.3:0/3597112303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e26b7de50 0x558e26b80240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.273+0000 7f355e800640 1 -- 172.21.15.3:0/3597112303 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b73590 msgr2=0x558e26b7d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:04.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.273+0000 7f355e800640 1 --2- 172.21.15.3:0/3597112303 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b73590 0x558e26b7d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.273+0000 7f355e800640 1 -- 172.21.15.3:0/3597112303 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e26a9fae0 con 0x558e26b72c70 2024-09-19T06:14:04.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.273+0000 7f355e800640 1 --2- 172.21.15.3:0/3597112303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e26b72c70 0x558e26b73050 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3554035000 tx=0x7f3554009800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f994babd40aaed9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:04.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.273+0000 7f3547000640 1 -- 172.21.15.3:0/3597112303 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3554031db0 con 0x558e26b72c70 2024-09-19T06:14:04.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.273+0000 7f3547000640 1 -- 172.21.15.3:0/3597112303 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3554036040 con 0x558e26b72c70 2024-09-19T06:14:04.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.273+0000 7f3547000640 1 -- 172.21.15.3:0/3597112303 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3554004360 con 0x558e26b72c70 2024-09-19T06:14:04.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.274+0000 7f3552a00640 1 --2- 172.21.15.3:0/80463303 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f35400a3430 0x7f35400a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:04.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.274+0000 7f3552a00640 1 -- 172.21.15.3:0/80463303 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f35480cfc80 con 0x7f35581049a0 2024-09-19T06:14:04.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.274+0000 7f355de00640 1 --2- 172.21.15.3:0/80463303 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f35400a3430 0x7f35400a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:04.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.274+0000 7f35632c8740 1 -- 172.21.15.3:0/3597112303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e26b72c70 msgr2=0x558e26b73050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:04.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.274+0000 7f35632c8740 1 --2- 172.21.15.3:0/3597112303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e26b72c70 0x558e26b73050 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3554035000 tx=0x7f3554009800 comp rx=0 tx=0).stop 2024-09-19T06:14:04.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.274+0000 7f35632c8740 1 -- 172.21.15.3:0/3597112303 shutdown_connections 2024-09-19T06:14:04.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.274+0000 7f35632c8740 1 --2- 172.21.15.3:0/3597112303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e26b7de50 0x558e26b80240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.274+0000 7f35632c8740 1 --2- 172.21.15.3:0/3597112303 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b73590 0x558e26b7d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.274+0000 7f35632c8740 1 --2- 172.21.15.3:0/3597112303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e26b72c70 0x558e26b73050 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.274+0000 7f35632c8740 1 -- 172.21.15.3:0/3597112303 >> 172.21.15.3:0/3597112303 conn(0x558e26b6f200 msgr2=0x558e26b6f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:04.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.274+0000 7f35632c8740 1 -- 172.21.15.3:0/3597112303 shutdown_connections 2024-09-19T06:14:04.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.275+0000 7f35632c8740 1 -- 172.21.15.3:0/3597112303 wait complete. 2024-09-19T06:14:04.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.275+0000 7f355de00640 1 --2- 172.21.15.3:0/80463303 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f35400a3430 0x7f35400a58f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x558e26b70060 tx=0x7f354c009570 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:04.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.275+0000 7f35632c8740 1 -- start start 2024-09-19T06:14:04.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.275+0000 7f35632c8740 1 Processor -- start 2024-09-19T06:14:04.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.276+0000 7f35632c8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b72c70 0x558e26b7ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:04.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.276+0000 7f35632c8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e26b73590 0x558e26b7b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:04.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.276+0000 7f35632c8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e26b7de50 0x558e26b7b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:04.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.276+0000 7f35632c8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558e26b80a20 con 0x558e26b72c70 2024-09-19T06:14:04.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.276+0000 7f35632c8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558e26a940f0 con 0x558e26b7de50 2024-09-19T06:14:04.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.276+0000 7f35632c8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558e26b80ba0 con 0x558e26b73590 2024-09-19T06:14:04.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.276+0000 7f35632c8740 10 client.0 _ll_register_callbacks cb 0x558e26a7bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:04.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.276+0000 7f355de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b72c70 0x558e26b7ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:04.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.276+0000 7f355de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b72c70 0x558e26b7ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53398/0 (socket says 172.21.15.3:53398) 2024-09-19T06:14:04.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.276+0000 7f355de00640 1 -- 172.21.15.3:0/1315911672 learned_addr learned my addr 172.21.15.3:0/1315911672 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:04.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.276+0000 7f355d400640 1 --2- 172.21.15.3:0/1315911672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e26b73590 0x558e26b7b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:04.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.276+0000 7f355e800640 1 --2- 172.21.15.3:0/1315911672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e26b7de50 0x558e26b7b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:04.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.277+0000 7f355de00640 1 -- 172.21.15.3:0/1315911672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e26b73590 msgr2=0x558e26b7b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:04.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.277+0000 7f355de00640 1 --2- 172.21.15.3:0/1315911672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e26b73590 0x558e26b7b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.277+0000 7f355de00640 1 -- 172.21.15.3:0/1315911672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e26b7de50 msgr2=0x558e26b7b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:04.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.277+0000 7f355de00640 1 --2- 172.21.15.3:0/1315911672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e26b7de50 0x558e26b7b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.277+0000 7f355de00640 1 -- 172.21.15.3:0/1315911672 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e2684a3c0 con 0x558e26b72c70 2024-09-19T06:14:04.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.277+0000 7f355d400640 1 --2- 172.21.15.3:0/1315911672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e26b73590 0x558e26b7b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:04.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.277+0000 7f355de00640 1 --2- 172.21.15.3:0/1315911672 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b72c70 0x558e26b7ad00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f354c00fb70 tx=0x7f354c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30414d4f5da5d19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:04.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.277+0000 7f353b400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:14:04.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.277+0000 7f353b400640 1 -- 172.21.15.3:0/1315911672 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354c0263f0 con 0x558e26b72c70 2024-09-19T06:14:04.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.277+0000 7f35632c8740 1 -- 172.21.15.3:0/1315911672 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3554036040 con 0x558e26b72c70 2024-09-19T06:14:04.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.277+0000 7f353b400640 1 -- 172.21.15.3:0/1315911672 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f354c026590 con 0x558e26b72c70 2024-09-19T06:14:04.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.278+0000 7f353b400640 1 -- 172.21.15.3:0/1315911672 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f354c026790 con 0x558e26b72c70 2024-09-19T06:14:04.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.278+0000 7f35632c8740 10 client.15582 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:04.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.278+0000 7f35632c8740 1 -- 172.21.15.3:0/1315911672 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558e26b8cb10 con 0x558e26b72c70 2024-09-19T06:14:04.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.278+0000 7f353b400640 1 -- 172.21.15.3:0/1315911672 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3554036040 con 0x558e26b72c70 2024-09-19T06:14:04.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.278+0000 7f353b400640 1 -- 172.21.15.3:0/1315911672 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f354c01aab0 con 0x558e26b72c70 2024-09-19T06:14:04.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.278+0000 7f35632c8740 10 client.15582 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:04.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.278+0000 7f35632c8740 10 client.15582 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:14:04.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.278+0000 7f35632c8740 20 client.15582 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:04.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.278+0000 7f35632c8740 1 --2- 172.21.15.3:0/1315911672 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x558e26b8df20 0x558e26b903e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:04.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.278+0000 7f35632c8740 4 client.15582 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:14:04.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.278+0000 7f35632c8740 1 -- 172.21.15.3:0/1315911672 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e26ae6950 con 0x558e26b8df20 2024-09-19T06:14:04.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.279+0000 7f355d400640 1 --2- 172.21.15.3:0/1315911672 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x558e26b8df20 0x558e26b903e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:04.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.279+0000 7f355d400640 1 --2- 172.21.15.3:0/1315911672 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x558e26b8df20 0x558e26b903e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=21b2bd0d3468f29f server_cookie=923abff8553a08df in_seq=0 out_seq=0 2024-09-19T06:14:04.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.279+0000 7f353b400640 10 client.15582 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:14:04.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.280+0000 7f353b400640 1 -- 172.21.15.3:0/1315911672 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558e26ae6950 con 0x558e26b8df20 2024-09-19T06:14:04.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.280+0000 7f353b400640 10 client.15582 handle_command_reply: tid=0 2024-09-19T06:14:04.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.280+0000 7f35632c8740 1 client.15582 shutdown 2024-09-19T06:14:04.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.280+0000 7f35632c8740 1 -- 172.21.15.3:0/1315911672 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b72c70 msgr2=0x558e26b7ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:04.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.280+0000 7f35632c8740 1 --2- 172.21.15.3:0/1315911672 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b72c70 0x558e26b7ad00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f354c00fb70 tx=0x7f354c005f90 comp rx=0 tx=0).stop 2024-09-19T06:14:04.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.280+0000 7f35632c8740 1 -- 172.21.15.3:0/1315911672 shutdown_connections 2024-09-19T06:14:04.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.280+0000 7f35632c8740 1 --2- 172.21.15.3:0/1315911672 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x558e26b8df20 0x558e26b903e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.280+0000 7f35632c8740 1 --2- 172.21.15.3:0/1315911672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e26b7de50 0x558e26b7b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.280+0000 7f35632c8740 1 --2- 172.21.15.3:0/1315911672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e26b73590 0x558e26b7b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.280+0000 7f35632c8740 1 --2- 172.21.15.3:0/1315911672 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b72c70 0x558e26b7ad00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.280+0000 7f35632c8740 1 -- 172.21.15.3:0/1315911672 >> 172.21.15.3:0/1315911672 conn(0x558e26b6f200 msgr2=0x558e26b74f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:04.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.280+0000 7f353b400640 0 client.15582 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:14:04.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.280+0000 7f35632c8740 1 -- 172.21.15.3:0/1315911672 shutdown_connections 2024-09-19T06:14:04.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.281+0000 7f35632c8740 1 -- 172.21.15.3:0/1315911672 wait complete. 2024-09-19T06:14:04.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.281+0000 7f35632c8740 20 client.15582 trim_cache size 0 max 16384 2024-09-19T06:14:04.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:03 smithi059 ceph-mon[35138]: pgmap v53: 97 pgs: 97 active+clean; 1.5 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-19T06:14:04.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.294+0000 7f35632c8740 1 Processor -- start 2024-09-19T06:14:04.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.294+0000 7f35632c8740 1 -- start start 2024-09-19T06:14:04.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.295+0000 7f35632c8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e26b72c70 0x558e26b756d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:04.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.295+0000 7f35632c8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e26b73590 0x558e26b795d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:04.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.295+0000 7f35632c8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b7de50 0x558e26b95d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:04.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.295+0000 7f35632c8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f35581afb40 con 0x558e26b7de50 2024-09-19T06:14:04.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.295+0000 7f35632c8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f35581b1680 con 0x558e26b73590 2024-09-19T06:14:04.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.295+0000 7f35632c8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f35581b0210 con 0x558e26b72c70 2024-09-19T06:14:04.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.295+0000 7f355e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b7de50 0x558e26b95d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:04.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.295+0000 7f355e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b7de50 0x558e26b95d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53402/0 (socket says 172.21.15.3:53402) 2024-09-19T06:14:04.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.295+0000 7f355e800640 1 -- 172.21.15.3:0/2090070953 learned_addr learned my addr 172.21.15.3:0/2090070953 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:04.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.295+0000 7f355d400640 1 --2- 172.21.15.3:0/2090070953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e26b73590 0x558e26b795d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:04.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.295+0000 7f355de00640 1 --2- 172.21.15.3:0/2090070953 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e26b72c70 0x558e26b756d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:04.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.296+0000 7f355e800640 1 -- 172.21.15.3:0/2090070953 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e26b72c70 msgr2=0x558e26b756d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:04.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.296+0000 7f355e800640 1 --2- 172.21.15.3:0/2090070953 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e26b72c70 0x558e26b756d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.296+0000 7f355e800640 1 -- 172.21.15.3:0/2090070953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e26b73590 msgr2=0x558e26b795d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:04.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.296+0000 7f355e800640 1 --2- 172.21.15.3:0/2090070953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e26b73590 0x558e26b795d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.296+0000 7f355e800640 1 -- 172.21.15.3:0/2090070953 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e26b6f030 con 0x558e26b7de50 2024-09-19T06:14:04.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.296+0000 7f355e800640 1 --2- 172.21.15.3:0/2090070953 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b7de50 0x558e26b95d00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3554006010 tx=0x7f35540093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6062c108e554d111 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:04.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.296+0000 7f3546600640 1 -- 172.21.15.3:0/2090070953 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3554053070 con 0x558e26b7de50 2024-09-19T06:14:04.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.296+0000 7f3546600640 1 -- 172.21.15.3:0/2090070953 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3554036050 con 0x558e26b7de50 2024-09-19T06:14:04.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.296+0000 7f3546600640 1 -- 172.21.15.3:0/2090070953 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355404a040 con 0x558e26b7de50 2024-09-19T06:14:04.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.297+0000 7f35632c8740 1 -- 172.21.15.3:0/2090070953 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b7de50 msgr2=0x558e26b95d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:04.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.297+0000 7f35632c8740 1 --2- 172.21.15.3:0/2090070953 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b7de50 0x558e26b95d00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3554006010 tx=0x7f35540093f0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.297+0000 7f35632c8740 1 -- 172.21.15.3:0/2090070953 shutdown_connections 2024-09-19T06:14:04.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.297+0000 7f35632c8740 1 --2- 172.21.15.3:0/2090070953 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b7de50 0x558e26b95d00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.297+0000 7f35632c8740 1 --2- 172.21.15.3:0/2090070953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e26b73590 0x558e26b795d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.297+0000 7f35632c8740 1 --2- 172.21.15.3:0/2090070953 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e26b72c70 0x558e26b756d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.297+0000 7f35632c8740 1 -- 172.21.15.3:0/2090070953 >> 172.21.15.3:0/2090070953 conn(0x558e26b6f200 msgr2=0x558e26b6e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:04.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.297+0000 7f35632c8740 1 -- 172.21.15.3:0/2090070953 shutdown_connections 2024-09-19T06:14:04.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.297+0000 7f35632c8740 1 -- 172.21.15.3:0/2090070953 wait complete. 2024-09-19T06:14:04.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.297+0000 7f35632c8740 1 -- start start 2024-09-19T06:14:04.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.298+0000 7f35632c8740 1 Processor -- start 2024-09-19T06:14:04.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.298+0000 7f35632c8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e26b72c70 0x558e26b81bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:04.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.298+0000 7f35632c8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b73590 0x558e26b820f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:04.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.298+0000 7f35632c8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e26b7de50 0x558e26b82630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:04.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.298+0000 7f35632c8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f35581b0fb0 con 0x558e26b73590 2024-09-19T06:14:04.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.298+0000 7f35632c8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f35581b08e0 con 0x558e26b72c70 2024-09-19T06:14:04.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.298+0000 7f35632c8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f35581adb20 con 0x558e26b7de50 2024-09-19T06:14:04.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.298+0000 7f35632c8740 10 client.0 _ll_register_callbacks cb 0x7f354c009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:04.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.298+0000 7f355d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b73590 0x558e26b820f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:04.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.298+0000 7f355e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e26b7de50 0x558e26b82630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:04.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.298+0000 7f355d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b73590 0x558e26b820f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53412/0 (socket says 172.21.15.3:53412) 2024-09-19T06:14:04.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.298+0000 7f355d400640 1 -- 172.21.15.3:0/1208620755 learned_addr learned my addr 172.21.15.3:0/1208620755 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:04.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.298+0000 7f355de00640 1 --2- 172.21.15.3:0/1208620755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e26b72c70 0x558e26b81bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:04.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.299+0000 7f355e800640 1 -- 172.21.15.3:0/1208620755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e26b72c70 msgr2=0x558e26b81bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:04.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.299+0000 7f355e800640 1 --2- 172.21.15.3:0/1208620755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e26b72c70 0x558e26b81bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.299+0000 7f355e800640 1 -- 172.21.15.3:0/1208620755 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b73590 msgr2=0x558e26b820f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:04.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.299+0000 7f355e800640 1 --2- 172.21.15.3:0/1208620755 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b73590 0x558e26b820f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.299+0000 7f355e800640 1 -- 172.21.15.3:0/1208620755 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e26b702b0 con 0x558e26b7de50 2024-09-19T06:14:04.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.299+0000 7f355d400640 1 --2- 172.21.15.3:0/1208620755 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b73590 0x558e26b820f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:04.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.299+0000 7f355e800640 1 --2- 172.21.15.3:0/1208620755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e26b7de50 0x558e26b82630 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3554051040 tx=0x7f3554000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd0abdcba43d1012 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:04.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.299+0000 7f353b400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:14:04.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.299+0000 7f353b400640 1 -- 172.21.15.3:0/1208620755 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3554053070 con 0x558e26b7de50 2024-09-19T06:14:04.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.299+0000 7f35632c8740 1 -- 172.21.15.3:0/1208620755 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3554036050 con 0x558e26b7de50 2024-09-19T06:14:04.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.300+0000 7f353b400640 1 -- 172.21.15.3:0/1208620755 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f3554003970 con 0x558e26b7de50 2024-09-19T06:14:04.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.300+0000 7f353b400640 1 -- 172.21.15.3:0/1208620755 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3554003b70 con 0x558e26b7de50 2024-09-19T06:14:04.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.300+0000 7f35632c8740 10 client.25636 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:04.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.300+0000 7f35632c8740 1 -- 172.21.15.3:0/1208620755 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558e26b6a770 con 0x558e26b7de50 2024-09-19T06:14:04.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.300+0000 7f353b400640 1 -- 172.21.15.3:0/1208620755 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3554036050 con 0x558e26b7de50 2024-09-19T06:14:04.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.300+0000 7f353b400640 1 -- 172.21.15.3:0/1208620755 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f355404d070 con 0x558e26b7de50 2024-09-19T06:14:04.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.300+0000 7f35632c8740 10 client.25636 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:04.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.300+0000 7f35632c8740 10 client.25636 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:14:04.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.300+0000 7f35632c8740 20 client.25636 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:04.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.300+0000 7f35632c8740 1 --2- 172.21.15.3:0/1208620755 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x558e26bf8e10 0x558e26bfb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:04.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.300+0000 7f35632c8740 4 client.25636 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:14:04.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.300+0000 7f35632c8740 1 -- 172.21.15.3:0/1208620755 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558e26ae0e60 con 0x558e26bf8e10 2024-09-19T06:14:04.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.301+0000 7f355de00640 1 --2- 172.21.15.3:0/1208620755 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x558e26bf8e10 0x558e26bfb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:04.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.301+0000 7f355de00640 1 --2- 172.21.15.3:0/1208620755 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x558e26bf8e10 0x558e26bfb200 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=14c14463e5dd47d9 server_cookie=186bf20e4c11be65 in_seq=0 out_seq=0 2024-09-19T06:14:04.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.301+0000 7f353b400640 10 client.25636 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:14:04.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.301+0000 7f353b400640 1 -- 172.21.15.3:0/1208620755 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558e26ae0e60 con 0x558e26bf8e10 2024-09-19T06:14:04.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.301+0000 7f353b400640 10 client.25636 handle_command_reply: tid=0 2024-09-19T06:14:04.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.301+0000 7f35632c8740 1 client.25636 shutdown 2024-09-19T06:14:04.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.302+0000 7f35632c8740 1 -- 172.21.15.3:0/1208620755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e26b7de50 msgr2=0x558e26b82630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:04.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.302+0000 7f35632c8740 1 --2- 172.21.15.3:0/1208620755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e26b7de50 0x558e26b82630 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3554051040 tx=0x7f3554000f40 comp rx=0 tx=0).stop 2024-09-19T06:14:04.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.302+0000 7f35632c8740 1 -- 172.21.15.3:0/1208620755 shutdown_connections 2024-09-19T06:14:04.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.302+0000 7f35632c8740 1 --2- 172.21.15.3:0/1208620755 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x558e26bf8e10 0x558e26bfb200 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.302+0000 7f35632c8740 1 --2- 172.21.15.3:0/1208620755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558e26b7de50 0x558e26b82630 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.302+0000 7f35632c8740 1 --2- 172.21.15.3:0/1208620755 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558e26b73590 0x558e26b820f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.302+0000 7f35632c8740 1 --2- 172.21.15.3:0/1208620755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558e26b72c70 0x558e26b81bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.302+0000 7f35632c8740 1 -- 172.21.15.3:0/1208620755 >> 172.21.15.3:0/1208620755 conn(0x558e26b6f200 msgr2=0x558e26b88ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:04.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.302+0000 7f353b400640 0 client.25636 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:14:04.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.302+0000 7f35632c8740 1 -- 172.21.15.3:0/1208620755 shutdown_connections 2024-09-19T06:14:04.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.302+0000 7f35632c8740 1 -- 172.21.15.3:0/1208620755 wait complete. 2024-09-19T06:14:04.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.302+0000 7f35632c8740 20 client.25636 trim_cache size 0 max 16384 2024-09-19T06:14:04.309 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:14:04.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.303+0000 7f3560800640 1 -- 172.21.15.3:0/80463303 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f35400a3430 msgr2=0x7f35400a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:04.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.303+0000 7f3560800640 1 --2- 172.21.15.3:0/80463303 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f35400a3430 0x7f35400a58f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x558e26b70060 tx=0x7f354c009570 comp rx=0 tx=0).stop 2024-09-19T06:14:04.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.303+0000 7f3560800640 1 -- 172.21.15.3:0/80463303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35581049a0 msgr2=0x7f355819ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:04.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.303+0000 7f3560800640 1 --2- 172.21.15.3:0/80463303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35581049a0 0x7f355819ab20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f354800e9f0 tx=0x7f354800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.303+0000 7f3560800640 1 -- 172.21.15.3:0/80463303 shutdown_connections 2024-09-19T06:14:04.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.303+0000 7f3560800640 1 --2- 172.21.15.3:0/80463303 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f35400a3430 0x7f35400a58f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.303+0000 7f3560800640 1 --2- 172.21.15.3:0/80463303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3558109120 0x7f355819eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.303+0000 7f3560800640 1 --2- 172.21.15.3:0/80463303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35581049a0 0x7f355819ab20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.303+0000 7f3560800640 1 --2- 172.21.15.3:0/80463303 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3558103ff0 0x7f355819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:04.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.303+0000 7f3560800640 1 -- 172.21.15.3:0/80463303 >> 172.21.15.3:0/80463303 conn(0x7f35580ffa90 msgr2=0x7f35581005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:04.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.303+0000 7f3560800640 1 -- 172.21.15.3:0/80463303 shutdown_connections 2024-09-19T06:14:04.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:04.303+0000 7f3560800640 1 -- 172.21.15.3:0/80463303 wait complete. 2024-09-19T06:14:04.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:03 smithi071 ceph-mon[35662]: pgmap v53: 97 pgs: 97 active+clean; 1.5 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 17 op/s 2024-09-19T06:14:05.158 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:14:05.538 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:05.930 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:05 smithi003 ceph-mon[30893]: pgmap v54: 97 pgs: 97 active+clean; 1.6 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 48 KiB/s wr, 38 op/s 2024-09-19T06:14:06.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:05 smithi059 ceph-mon[35138]: pgmap v54: 97 pgs: 97 active+clean; 1.6 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 48 KiB/s wr, 38 op/s 2024-09-19T06:14:06.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.279+0000 7fe051c00640 1 -- 172.21.15.3:0/3209712997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe04c103ff0 msgr2=0x7fe04c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:06.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.279+0000 7fe051c00640 1 --2- 172.21.15.3:0/3209712997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe04c103ff0 0x7fe04c1043d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009900 tx=0x7fe03c02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.279+0000 7fe051c00640 1 -- 172.21.15.3:0/3209712997 shutdown_connections 2024-09-19T06:14:06.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.279+0000 7fe051c00640 1 --2- 172.21.15.3:0/3209712997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe04c109120 0x7fe04c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.279+0000 7fe051c00640 1 --2- 172.21.15.3:0/3209712997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe04c1049a0 0x7fe04c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.279+0000 7fe051c00640 1 --2- 172.21.15.3:0/3209712997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe04c103ff0 0x7fe04c1043d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.279+0000 7fe051c00640 1 -- 172.21.15.3:0/3209712997 >> 172.21.15.3:0/3209712997 conn(0x7fe04c0ffa90 msgr2=0x7fe04c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:06.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.279+0000 7fe051c00640 1 -- 172.21.15.3:0/3209712997 shutdown_connections 2024-09-19T06:14:06.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.279+0000 7fe051c00640 1 -- 172.21.15.3:0/3209712997 wait complete. 2024-09-19T06:14:06.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.280+0000 7fe051c00640 1 Processor -- start 2024-09-19T06:14:06.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.281+0000 7fe051c00640 1 -- start start 2024-09-19T06:14:06.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.281+0000 7fe051c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe04c103ff0 0x7fe04c19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:06.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.281+0000 7fe051c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe04c1049a0 0x7fe04c19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:06.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.281+0000 7fe051c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe04c109120 0x7fe04c19eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:06.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.281+0000 7fe051c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c114120 con 0x7fe04c1049a0 2024-09-19T06:14:06.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.281+0000 7fe051c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c113fa0 con 0x7fe04c103ff0 2024-09-19T06:14:06.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.281+0000 7fe051c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c1142a0 con 0x7fe04c109120 2024-09-19T06:14:06.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.281+0000 7fe04aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe04c103ff0 0x7fe04c19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:06.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.281+0000 7fe04a000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe04c1049a0 0x7fe04c19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:06.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.281+0000 7fe04aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe04c103ff0 0x7fe04c19a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:54344/0 (socket says 172.21.15.3:54344) 2024-09-19T06:14:06.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.281+0000 7fe04aa00640 1 -- 172.21.15.3:0/4166359171 learned_addr learned my addr 172.21.15.3:0/4166359171 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:06.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.281+0000 7fe04b400640 1 --2- 172.21.15.3:0/4166359171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe04c109120 0x7fe04c19eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:06.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.282+0000 7fe04a000640 1 -- 172.21.15.3:0/4166359171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe04c109120 msgr2=0x7fe04c19eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:06.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.282+0000 7fe04a000640 1 --2- 172.21.15.3:0/4166359171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe04c109120 0x7fe04c19eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.282+0000 7fe04a000640 1 -- 172.21.15.3:0/4166359171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe04c103ff0 msgr2=0x7fe04c19a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:06.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.282+0000 7fe04a000640 1 --2- 172.21.15.3:0/4166359171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe04c103ff0 0x7fe04c19a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.282+0000 7fe04a000640 1 -- 172.21.15.3:0/4166359171 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04c19f590 con 0x7fe04c1049a0 2024-09-19T06:14:06.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.282+0000 7fe04a000640 1 --2- 172.21.15.3:0/4166359171 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe04c1049a0 0x7fe04c19ab20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe03800e9f0 tx=0x7fe03800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:06.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.282+0000 7fe043400640 1 -- 172.21.15.3:0/4166359171 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03800ccc0 con 0x7fe04c1049a0 2024-09-19T06:14:06.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.282+0000 7fe051c00640 1 -- 172.21.15.3:0/4166359171 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe04c19f880 con 0x7fe04c1049a0 2024-09-19T06:14:06.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.282+0000 7fe043400640 1 -- 172.21.15.3:0/4166359171 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe038010910 con 0x7fe04c1049a0 2024-09-19T06:14:06.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.282+0000 7fe043400640 1 -- 172.21.15.3:0/4166359171 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe038018960 con 0x7fe04c1049a0 2024-09-19T06:14:06.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.283+0000 7fe051c00640 1 -- 172.21.15.3:0/4166359171 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe04c1a7160 con 0x7fe04c1049a0 2024-09-19T06:14:06.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.286+0000 7fe043400640 1 -- 172.21.15.3:0/4166359171 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fe038010ac0 con 0x7fe04c1049a0 2024-09-19T06:14:06.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.286+0000 7fe0545d4740 1 Processor -- start 2024-09-19T06:14:06.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.286+0000 7fe0545d4740 1 -- start start 2024-09-19T06:14:06.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.286+0000 7fe0545d4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b608f6c70 0x557b608f7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:06.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.286+0000 7fe0545d4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f7590 0x557b60901910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:06.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.286+0000 7fe0545d4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b60901e50 0x557b60904240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:06.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.286+0000 7fe0545d4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557b6085d3e0 con 0x557b608f6c70 2024-09-19T06:14:06.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.286+0000 7fe0545d4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557b60804d80 con 0x557b608f7590 2024-09-19T06:14:06.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.286+0000 7fe0545d4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557b608593a0 con 0x557b60901e50 2024-09-19T06:14:06.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.286+0000 7fe04b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b608f6c70 0x557b608f7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:06.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.286+0000 7fe04aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f7590 0x557b60901910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:06.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.286+0000 7fe04aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f7590 0x557b60901910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:54356/0 (socket says 172.21.15.3:54356) 2024-09-19T06:14:06.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.286+0000 7fe04b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b608f6c70 0x557b608f7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53446/0 (socket says 172.21.15.3:53446) 2024-09-19T06:14:06.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.286+0000 7fe04aa00640 1 -- 172.21.15.3:0/432194591 learned_addr learned my addr 172.21.15.3:0/432194591 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:06.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.287+0000 7fe04a000640 1 --2- 172.21.15.3:0/432194591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b60901e50 0x557b60904240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:06.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.287+0000 7fe04aa00640 1 -- 172.21.15.3:0/432194591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b60901e50 msgr2=0x557b60904240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:06.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.287+0000 7fe04aa00640 1 --2- 172.21.15.3:0/432194591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b60901e50 0x557b60904240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.287+0000 7fe04aa00640 1 -- 172.21.15.3:0/432194591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b608f6c70 msgr2=0x557b608f7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:06.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.287+0000 7fe04aa00640 1 --2- 172.21.15.3:0/432194591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b608f6c70 0x557b608f7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.287+0000 7fe04aa00640 1 -- 172.21.15.3:0/432194591 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b60823ae0 con 0x557b608f7590 2024-09-19T06:14:06.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.287+0000 7fe043400640 1 --2- 172.21.15.3:0/4166359171 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe0300a33b0 0x7fe0300a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:06.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.287+0000 7fe04aa00640 1 --2- 172.21.15.3:0/432194591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f7590 0x557b60901910 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009a20 tx=0x7fe03c005dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bb61a3ab2112aba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:06.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.287+0000 7fe043400640 1 -- 172.21.15.3:0/4166359171 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fe0380d0110 con 0x7fe04c1049a0 2024-09-19T06:14:06.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.288+0000 7fe04b400640 1 --2- 172.21.15.3:0/4166359171 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe0300a33b0 0x7fe0300a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:06.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.288+0000 7fe037e00640 1 -- 172.21.15.3:0/432194591 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03c040070 con 0x557b608f7590 2024-09-19T06:14:06.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.288+0000 7fe037e00640 1 -- 172.21.15.3:0/432194591 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe03c004030 con 0x557b608f7590 2024-09-19T06:14:06.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.288+0000 7fe037e00640 1 -- 172.21.15.3:0/432194591 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03c035040 con 0x557b608f7590 2024-09-19T06:14:06.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.288+0000 7fe0545d4740 1 -- 172.21.15.3:0/432194591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f7590 msgr2=0x557b60901910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:06.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.288+0000 7fe0545d4740 1 --2- 172.21.15.3:0/432194591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f7590 0x557b60901910 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009a20 tx=0x7fe03c005dd0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.288+0000 7fe04b400640 1 --2- 172.21.15.3:0/4166359171 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe0300a33b0 0x7fe0300a5870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe044005fd0 tx=0x7fe044009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:06.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.288+0000 7fe0545d4740 1 -- 172.21.15.3:0/432194591 shutdown_connections 2024-09-19T06:14:06.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.288+0000 7fe0545d4740 1 --2- 172.21.15.3:0/432194591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b60901e50 0x557b60904240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.288+0000 7fe0545d4740 1 --2- 172.21.15.3:0/432194591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f7590 0x557b60901910 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.288+0000 7fe0545d4740 1 --2- 172.21.15.3:0/432194591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b608f6c70 0x557b608f7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.288+0000 7fe0545d4740 1 -- 172.21.15.3:0/432194591 >> 172.21.15.3:0/432194591 conn(0x557b608f3200 msgr2=0x557b608f35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:06.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.289+0000 7fe0545d4740 1 -- 172.21.15.3:0/432194591 shutdown_connections 2024-09-19T06:14:06.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.289+0000 7fe0545d4740 1 -- 172.21.15.3:0/432194591 wait complete. 2024-09-19T06:14:06.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.289+0000 7fe0545d4740 1 -- start start 2024-09-19T06:14:06.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.289+0000 7fe0545d4740 1 Processor -- start 2024-09-19T06:14:06.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.290+0000 7fe0545d4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b608f6c70 0x557b608fed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:06.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.290+0000 7fe0545d4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f7590 0x557b608ff240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:06.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.290+0000 7fe0545d4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b60901e50 0x557b608ff780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:06.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.290+0000 7fe0545d4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557b60904a20 con 0x557b60901e50 2024-09-19T06:14:06.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.290+0000 7fe0545d4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557b608180f0 con 0x557b608f7590 2024-09-19T06:14:06.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.290+0000 7fe0545d4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557b60904ba0 con 0x557b608f6c70 2024-09-19T06:14:06.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.290+0000 7fe0545d4740 10 client.0 _ll_register_callbacks cb 0x557b607ffbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:06.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.290+0000 7fe04a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f7590 0x557b608ff240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:06.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.290+0000 7fe04aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b608f6c70 0x557b608fed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:06.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.290+0000 7fe04a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f7590 0x557b608ff240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:54358/0 (socket says 172.21.15.3:54358) 2024-09-19T06:14:06.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.290+0000 7fe04aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b608f6c70 0x557b608fed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:40576/0 (socket says 172.21.15.3:40576) 2024-09-19T06:14:06.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.290+0000 7fe04a000640 1 -- 172.21.15.3:0/1395593100 learned_addr learned my addr 172.21.15.3:0/1395593100 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:06.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.290+0000 7fe04b400640 1 --2- 172.21.15.3:0/1395593100 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b60901e50 0x557b608ff780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:06.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.291+0000 7fe04a000640 1 -- 172.21.15.3:0/1395593100 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b608f6c70 msgr2=0x557b608fed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:06.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.291+0000 7fe04a000640 1 --2- 172.21.15.3:0/1395593100 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b608f6c70 0x557b608fed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.291+0000 7fe04a000640 1 -- 172.21.15.3:0/1395593100 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b60901e50 msgr2=0x557b608ff780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:06.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.291+0000 7fe04a000640 1 --2- 172.21.15.3:0/1395593100 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b60901e50 0x557b608ff780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.291+0000 7fe04a000640 1 -- 172.21.15.3:0/1395593100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b605ce3c0 con 0x557b608f7590 2024-09-19T06:14:06.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.291+0000 7fe04aa00640 1 --2- 172.21.15.3:0/1395593100 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b608f6c70 0x557b608fed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:06.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.291+0000 7fe04a000640 1 --2- 172.21.15.3:0/1395593100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f7590 0x557b608ff240 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe0380cd860 tx=0x7fe03809bf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b63023634c08ed55 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:06.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.291+0000 7fe034c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:14:06.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.291+0000 7fe034c00640 1 -- 172.21.15.3:0/1395593100 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0380cdc90 con 0x557b608f7590 2024-09-19T06:14:06.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.291+0000 7fe0545d4740 1 -- 172.21.15.3:0/1395593100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe03c004030 con 0x557b608f7590 2024-09-19T06:14:06.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.291+0000 7fe034c00640 1 -- 172.21.15.3:0/1395593100 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fe0380d2310 con 0x557b608f7590 2024-09-19T06:14:06.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.291+0000 7fe034c00640 1 -- 172.21.15.3:0/1395593100 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe0380a0740 con 0x557b608f7590 2024-09-19T06:14:06.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.291+0000 7fe0545d4740 10 client.25649 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:06.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.291+0000 7fe0545d4740 1 -- 172.21.15.3:0/1395593100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557b60910a30 con 0x557b608f7590 2024-09-19T06:14:06.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.291+0000 7fe034c00640 1 -- 172.21.15.3:0/1395593100 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe03c004030 con 0x557b608f7590 2024-09-19T06:14:06.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.292+0000 7fe034c00640 1 -- 172.21.15.3:0/1395593100 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe038018b00 con 0x557b608f7590 2024-09-19T06:14:06.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.292+0000 7fe0545d4740 10 client.25649 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:06.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.292+0000 7fe0545d4740 10 client.25649 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:14:06.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.292+0000 7fe0545d4740 20 client.25649 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:06.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.292+0000 7fe0545d4740 1 --2- 172.21.15.3:0/1395593100 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x557b60911e40 0x557b60914290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:06.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.292+0000 7fe0545d4740 4 client.25649 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:14:06.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.292+0000 7fe0545d4740 1 -- 172.21.15.3:0/1395593100 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b6086a950 con 0x557b60911e40 2024-09-19T06:14:06.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.292+0000 7fe04aa00640 1 --2- 172.21.15.3:0/1395593100 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x557b60911e40 0x557b60914290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:06.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.293+0000 7fe04aa00640 1 --2- 172.21.15.3:0/1395593100 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x557b60911e40 0x557b60914290 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d61f30a95aee399f server_cookie=b8fac9784d99b144 in_seq=0 out_seq=0 2024-09-19T06:14:06.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.293+0000 7fe034c00640 10 client.25649 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:14:06.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.294+0000 7fe034c00640 1 -- 172.21.15.3:0/1395593100 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557b6086a950 con 0x557b60911e40 2024-09-19T06:14:06.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.294+0000 7fe034c00640 10 client.25649 handle_command_reply: tid=0 2024-09-19T06:14:06.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.294+0000 7fe0545d4740 1 client.25649 shutdown 2024-09-19T06:14:06.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.294+0000 7fe0545d4740 1 -- 172.21.15.3:0/1395593100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f7590 msgr2=0x557b608ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:06.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.294+0000 7fe0545d4740 1 --2- 172.21.15.3:0/1395593100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f7590 0x557b608ff240 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe0380cd860 tx=0x7fe03809bf80 comp rx=0 tx=0).stop 2024-09-19T06:14:06.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.294+0000 7fe0545d4740 1 -- 172.21.15.3:0/1395593100 shutdown_connections 2024-09-19T06:14:06.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.294+0000 7fe0545d4740 1 --2- 172.21.15.3:0/1395593100 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x557b60911e40 0x557b60914290 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.294+0000 7fe0545d4740 1 --2- 172.21.15.3:0/1395593100 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b60901e50 0x557b608ff780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.294+0000 7fe0545d4740 1 --2- 172.21.15.3:0/1395593100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f7590 0x557b608ff240 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.294+0000 7fe0545d4740 1 --2- 172.21.15.3:0/1395593100 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b608f6c70 0x557b608fed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.294+0000 7fe034c00640 0 client.25649 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:14:06.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.294+0000 7fe0545d4740 1 -- 172.21.15.3:0/1395593100 >> 172.21.15.3:0/1395593100 conn(0x557b608f3200 msgr2=0x557b608f8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:06.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.294+0000 7fe0545d4740 1 -- 172.21.15.3:0/1395593100 shutdown_connections 2024-09-19T06:14:06.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.294+0000 7fe0545d4740 1 -- 172.21.15.3:0/1395593100 wait complete. 2024-09-19T06:14:06.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.294+0000 7fe0545d4740 20 client.25649 trim_cache size 0 max 16384 2024-09-19T06:14:06.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.308+0000 7fe0545d4740 1 Processor -- start 2024-09-19T06:14:06.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.308+0000 7fe0545d4740 1 -- start start 2024-09-19T06:14:06.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.309+0000 7fe0545d4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b608f6c70 0x557b60919b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:06.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.309+0000 7fe0545d4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f7590 0x557b6091a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:06.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.309+0000 7fe0545d4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b60901e50 0x557b608fbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:06.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.309+0000 7fe0545d4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c1afa90 con 0x557b60901e50 2024-09-19T06:14:06.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.309+0000 7fe0545d4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c1b15d0 con 0x557b608f7590 2024-09-19T06:14:06.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.309+0000 7fe0545d4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c1b0160 con 0x557b608f6c70 2024-09-19T06:14:06.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.309+0000 7fe04a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f7590 0x557b6091a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:06.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.309+0000 7fe04a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f7590 0x557b6091a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:54362/0 (socket says 172.21.15.3:54362) 2024-09-19T06:14:06.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.309+0000 7fe04a000640 1 -- 172.21.15.3:0/1432385949 learned_addr learned my addr 172.21.15.3:0/1432385949 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:06.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.309+0000 7fe04b400640 1 --2- 172.21.15.3:0/1432385949 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b60901e50 0x557b608fbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:06.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.309+0000 7fe04aa00640 1 --2- 172.21.15.3:0/1432385949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b608f6c70 0x557b60919b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:06.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.309+0000 7fe04a000640 1 -- 172.21.15.3:0/1432385949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b608f6c70 msgr2=0x557b60919b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:06.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.309+0000 7fe04a000640 1 --2- 172.21.15.3:0/1432385949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b608f6c70 0x557b60919b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.309+0000 7fe04a000640 1 -- 172.21.15.3:0/1432385949 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b60901e50 msgr2=0x557b608fbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:06.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.309+0000 7fe04a000640 1 --2- 172.21.15.3:0/1432385949 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b60901e50 0x557b608fbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.309+0000 7fe04a000640 1 -- 172.21.15.3:0/1432385949 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b608f3030 con 0x557b608f7590 2024-09-19T06:14:06.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.310+0000 7fe04a000640 1 --2- 172.21.15.3:0/1432385949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f7590 0x557b6091a0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe038098e10 tx=0x7fe03809c5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=621315401d659158 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:06.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.310+0000 7fe037400640 1 -- 172.21.15.3:0/1432385949 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0380986e0 con 0x557b608f7590 2024-09-19T06:14:06.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.310+0000 7fe037400640 1 -- 172.21.15.3:0/1432385949 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe038018b00 con 0x557b608f7590 2024-09-19T06:14:06.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.310+0000 7fe037400640 1 -- 172.21.15.3:0/1432385949 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03809bda0 con 0x557b608f7590 2024-09-19T06:14:06.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.310+0000 7fe0545d4740 1 -- 172.21.15.3:0/1432385949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f7590 msgr2=0x557b6091a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:06.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.310+0000 7fe0545d4740 1 --2- 172.21.15.3:0/1432385949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f7590 0x557b6091a0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe038098e10 tx=0x7fe03809c5c0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.311+0000 7fe0545d4740 1 -- 172.21.15.3:0/1432385949 shutdown_connections 2024-09-19T06:14:06.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.311+0000 7fe0545d4740 1 --2- 172.21.15.3:0/1432385949 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b60901e50 0x557b608fbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.311+0000 7fe0545d4740 1 --2- 172.21.15.3:0/1432385949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f7590 0x557b6091a0a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.311+0000 7fe0545d4740 1 --2- 172.21.15.3:0/1432385949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b608f6c70 0x557b60919b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.311+0000 7fe0545d4740 1 -- 172.21.15.3:0/1432385949 >> 172.21.15.3:0/1432385949 conn(0x557b608f3200 msgr2=0x557b60900d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:06.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.311+0000 7fe0545d4740 1 -- 172.21.15.3:0/1432385949 shutdown_connections 2024-09-19T06:14:06.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.311+0000 7fe0545d4740 1 -- 172.21.15.3:0/1432385949 wait complete. 2024-09-19T06:14:06.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.311+0000 7fe0545d4740 1 -- start start 2024-09-19T06:14:06.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.311+0000 7fe0545d4740 1 Processor -- start 2024-09-19T06:14:06.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.312+0000 7fe0545d4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f6c70 0x557b60905ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:06.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.312+0000 7fe0545d4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b608f7590 0x557b60905ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:06.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.312+0000 7fe0545d4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b60901e50 0x557b60906530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:06.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.312+0000 7fe0545d4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c1b0f00 con 0x557b608f7590 2024-09-19T06:14:06.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.312+0000 7fe0545d4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c1b0830 con 0x557b608f6c70 2024-09-19T06:14:06.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.312+0000 7fe0545d4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c1ada70 con 0x557b60901e50 2024-09-19T06:14:06.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.312+0000 7fe0545d4740 10 client.0 _ll_register_callbacks cb 0x7fe03800ce60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:06.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.312+0000 7fe04a000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b608f7590 0x557b60905ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:06.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.312+0000 7fe04aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f6c70 0x557b60905ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:06.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.312+0000 7fe04a000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b608f7590 0x557b60905ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53472/0 (socket says 172.21.15.3:53472) 2024-09-19T06:14:06.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.312+0000 7fe04aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f6c70 0x557b60905ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:54372/0 (socket says 172.21.15.3:54372) 2024-09-19T06:14:06.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.312+0000 7fe04a000640 1 -- 172.21.15.3:0/2603923090 learned_addr learned my addr 172.21.15.3:0/2603923090 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:06.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.312+0000 7fe04b400640 1 --2- 172.21.15.3:0/2603923090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b60901e50 0x557b60906530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:06.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.312+0000 7fe04aa00640 1 -- 172.21.15.3:0/2603923090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b60901e50 msgr2=0x557b60906530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:06.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.312+0000 7fe04aa00640 1 --2- 172.21.15.3:0/2603923090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b60901e50 0x557b60906530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.312+0000 7fe04aa00640 1 -- 172.21.15.3:0/2603923090 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b608f7590 msgr2=0x557b60905ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:06.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.312+0000 7fe04aa00640 1 --2- 172.21.15.3:0/2603923090 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b608f7590 0x557b60905ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.312+0000 7fe04aa00640 1 -- 172.21.15.3:0/2603923090 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b608ee770 con 0x557b608f6c70 2024-09-19T06:14:06.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.313+0000 7fe04a000640 1 --2- 172.21.15.3:0/2603923090 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b608f7590 0x557b60905ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:06.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.313+0000 7fe04aa00640 1 --2- 172.21.15.3:0/2603923090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f6c70 0x557b60905ab0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe03c005ab0 tx=0x7fe03c005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a310a26ca5f5134 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:06.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.313+0000 7fe034c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:14:06.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.313+0000 7fe034c00640 1 -- 172.21.15.3:0/2603923090 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03c040070 con 0x557b608f6c70 2024-09-19T06:14:06.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.313+0000 7fe0545d4740 1 -- 172.21.15.3:0/2603923090 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe038018b00 con 0x557b608f6c70 2024-09-19T06:14:06.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.313+0000 7fe034c00640 1 -- 172.21.15.3:0/2603923090 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fe03c0317b0 con 0x557b608f6c70 2024-09-19T06:14:06.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.313+0000 7fe034c00640 1 -- 172.21.15.3:0/2603923090 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe03c060050 con 0x557b608f6c70 2024-09-19T06:14:06.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.313+0000 7fe0545d4740 10 client.25655 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:06.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.313+0000 7fe0545d4740 1 -- 172.21.15.3:0/2603923090 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557b6097cba0 con 0x557b608f6c70 2024-09-19T06:14:06.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.314+0000 7fe034c00640 1 -- 172.21.15.3:0/2603923090 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe038018b00 con 0x557b608f6c70 2024-09-19T06:14:06.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.314+0000 7fe034c00640 1 -- 172.21.15.3:0/2603923090 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe03c04f070 con 0x557b608f6c70 2024-09-19T06:14:06.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.314+0000 7fe0545d4740 10 client.25655 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:06.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.314+0000 7fe0545d4740 10 client.25655 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:14:06.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.314+0000 7fe0545d4740 20 client.25655 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:06.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.314+0000 7fe0545d4740 1 --2- 172.21.15.3:0/2603923090 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x557b6097ce90 0x557b6097f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:06.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.314+0000 7fe0545d4740 4 client.25655 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:14:06.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.314+0000 7fe0545d4740 1 -- 172.21.15.3:0/2603923090 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557b60864e60 con 0x557b6097ce90 2024-09-19T06:14:06.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.314+0000 7fe04a000640 1 --2- 172.21.15.3:0/2603923090 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x557b6097ce90 0x557b6097f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:06.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.315+0000 7fe04a000640 1 --2- 172.21.15.3:0/2603923090 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x557b6097ce90 0x557b6097f280 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ba0baa1bbf6e4c1f server_cookie=fb977fcf40377ea in_seq=0 out_seq=0 2024-09-19T06:14:06.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.315+0000 7fe034c00640 10 client.25655 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:14:06.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.315+0000 7fe034c00640 1 -- 172.21.15.3:0/2603923090 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557b60864e60 con 0x557b6097ce90 2024-09-19T06:14:06.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.315+0000 7fe034c00640 10 client.25655 handle_command_reply: tid=0 2024-09-19T06:14:06.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.315+0000 7fe0545d4740 1 client.25655 shutdown 2024-09-19T06:14:06.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.315+0000 7fe0545d4740 1 -- 172.21.15.3:0/2603923090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f6c70 msgr2=0x557b60905ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:06.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.315+0000 7fe0545d4740 1 --2- 172.21.15.3:0/2603923090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f6c70 0x557b60905ab0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe03c005ab0 tx=0x7fe03c005a20 comp rx=0 tx=0).stop 2024-09-19T06:14:06.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.315+0000 7fe0545d4740 1 -- 172.21.15.3:0/2603923090 shutdown_connections 2024-09-19T06:14:06.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.315+0000 7fe0545d4740 1 --2- 172.21.15.3:0/2603923090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b60901e50 0x557b60906530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.315+0000 7fe0545d4740 1 --2- 172.21.15.3:0/2603923090 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x557b6097ce90 0x557b6097f280 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.315+0000 7fe0545d4740 1 --2- 172.21.15.3:0/2603923090 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b608f7590 0x557b60905ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.315+0000 7fe0545d4740 1 --2- 172.21.15.3:0/2603923090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b608f6c70 0x557b60905ab0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.315+0000 7fe0545d4740 1 -- 172.21.15.3:0/2603923090 >> 172.21.15.3:0/2603923090 conn(0x557b608f3200 msgr2=0x557b608f2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:06.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.315+0000 7fe034c00640 0 client.25655 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:14:06.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.315+0000 7fe0545d4740 1 -- 172.21.15.3:0/2603923090 shutdown_connections 2024-09-19T06:14:06.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.316+0000 7fe0545d4740 1 -- 172.21.15.3:0/2603923090 wait complete. 2024-09-19T06:14:06.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.316+0000 7fe0545d4740 20 client.25655 trim_cache size 0 max 16384 2024-09-19T06:14:06.333 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:14:06.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.316+0000 7fe051c00640 1 -- 172.21.15.3:0/4166359171 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe0300a33b0 msgr2=0x7fe0300a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:06.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.316+0000 7fe051c00640 1 --2- 172.21.15.3:0/4166359171 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe0300a33b0 0x7fe0300a5870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe044005fd0 tx=0x7fe044009500 comp rx=0 tx=0).stop 2024-09-19T06:14:06.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.316+0000 7fe051c00640 1 -- 172.21.15.3:0/4166359171 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe04c1049a0 msgr2=0x7fe04c19ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:06.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.316+0000 7fe051c00640 1 --2- 172.21.15.3:0/4166359171 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe04c1049a0 0x7fe04c19ab20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe03800e9f0 tx=0x7fe03800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.316+0000 7fe051c00640 1 -- 172.21.15.3:0/4166359171 shutdown_connections 2024-09-19T06:14:06.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.317+0000 7fe051c00640 1 --2- 172.21.15.3:0/4166359171 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe0300a33b0 0x7fe0300a5870 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.317+0000 7fe051c00640 1 --2- 172.21.15.3:0/4166359171 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe04c109120 0x7fe04c19eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.317+0000 7fe051c00640 1 --2- 172.21.15.3:0/4166359171 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe04c1049a0 0x7fe04c19ab20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.317+0000 7fe051c00640 1 --2- 172.21.15.3:0/4166359171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe04c103ff0 0x7fe04c19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:06.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.317+0000 7fe051c00640 1 -- 172.21.15.3:0/4166359171 >> 172.21.15.3:0/4166359171 conn(0x7fe04c0ffa90 msgr2=0x7fe04c100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:06.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.317+0000 7fe051c00640 1 -- 172.21.15.3:0/4166359171 shutdown_connections 2024-09-19T06:14:06.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:06.317+0000 7fe051c00640 1 -- 172.21.15.3:0/4166359171 wait complete. 2024-09-19T06:14:06.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:05 smithi071 ceph-mon[35662]: pgmap v54: 97 pgs: 97 active+clean; 1.6 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 48 KiB/s wr, 38 op/s 2024-09-19T06:14:07.302 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:14:07.681 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:08.073 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:07 smithi003 ceph-mon[30893]: pgmap v55: 97 pgs: 97 active+clean; 1.6 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 39 KiB/s wr, 30 op/s 2024-09-19T06:14:08.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:07 smithi059 ceph-mon[35138]: pgmap v55: 97 pgs: 97 active+clean; 1.6 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 39 KiB/s wr, 30 op/s 2024-09-19T06:14:08.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:07 smithi071 ceph-mon[35662]: pgmap v55: 97 pgs: 97 active+clean; 1.6 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 39 KiB/s wr, 30 op/s 2024-09-19T06:14:08.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.439+0000 7f71c3200640 1 -- 172.21.15.3:0/3160113586 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71bc103ff0 msgr2=0x7f71bc1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:08.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.439+0000 7f71c3200640 1 --2- 172.21.15.3:0/3160113586 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71bc103ff0 0x7f71bc1043d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f71ac009900 tx=0x7f71ac02a410 comp rx=0 tx=0).stop 2024-09-19T06:14:08.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.439+0000 7f71c3200640 1 -- 172.21.15.3:0/3160113586 shutdown_connections 2024-09-19T06:14:08.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.439+0000 7f71c3200640 1 --2- 172.21.15.3:0/3160113586 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71bc109120 0x7f71bc110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.439+0000 7f71c3200640 1 --2- 172.21.15.3:0/3160113586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71bc1049a0 0x7f71bc1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.439+0000 7f71c3200640 1 --2- 172.21.15.3:0/3160113586 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71bc103ff0 0x7f71bc1043d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.439+0000 7f71c3200640 1 -- 172.21.15.3:0/3160113586 >> 172.21.15.3:0/3160113586 conn(0x7f71bc0ffa90 msgr2=0x7f71bc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:08.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.439+0000 7f71c3200640 1 -- 172.21.15.3:0/3160113586 shutdown_connections 2024-09-19T06:14:08.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.439+0000 7f71c3200640 1 -- 172.21.15.3:0/3160113586 wait complete. 2024-09-19T06:14:08.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.440+0000 7f71c3200640 1 Processor -- start 2024-09-19T06:14:08.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.441+0000 7f71c3200640 1 -- start start 2024-09-19T06:14:08.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.441+0000 7f71c3200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71bc103ff0 0x7f71bc19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:08.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.441+0000 7f71c3200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71bc1049a0 0x7f71bc19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:08.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.441+0000 7f71c3200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71bc109120 0x7f71bc19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:08.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.441+0000 7f71c3200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc1141a0 con 0x7f71bc1049a0 2024-09-19T06:14:08.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.441+0000 7f71c3200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc114020 con 0x7f71bc109120 2024-09-19T06:14:08.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.441+0000 7f71c3200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc114320 con 0x7f71bc103ff0 2024-09-19T06:14:08.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.441+0000 7f71b3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71bc1049a0 0x7f71bc19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:08.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.441+0000 7f71bbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71bc103ff0 0x7f71bc19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:08.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.441+0000 7f71bbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71bc103ff0 0x7f71bc19a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:40630/0 (socket says 172.21.15.3:40630) 2024-09-19T06:14:08.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.441+0000 7f71bbe00640 1 -- 172.21.15.3:0/3430836277 learned_addr learned my addr 172.21.15.3:0/3430836277 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:08.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.442+0000 7f71c1200640 1 --2- 172.21.15.3:0/3430836277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71bc109120 0x7f71bc19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:08.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.442+0000 7f71bbe00640 1 -- 172.21.15.3:0/3430836277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71bc109120 msgr2=0x7f71bc19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:08.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.442+0000 7f71bbe00640 1 --2- 172.21.15.3:0/3430836277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71bc109120 0x7f71bc19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.442+0000 7f71bbe00640 1 -- 172.21.15.3:0/3430836277 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71bc1049a0 msgr2=0x7f71bc19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:08.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.442+0000 7f71bbe00640 1 --2- 172.21.15.3:0/3430836277 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71bc1049a0 0x7f71bc19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.442+0000 7f71bbe00640 1 -- 172.21.15.3:0/3430836277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71bc19f5d0 con 0x7f71bc103ff0 2024-09-19T06:14:08.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.442+0000 7f71c1200640 1 --2- 172.21.15.3:0/3430836277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71bc109120 0x7f71bc19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:08.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.442+0000 7f71bbe00640 1 --2- 172.21.15.3:0/3430836277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71bc103ff0 0x7f71bc19a620 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f71ac004770 tx=0x7f71ac003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:08.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.442+0000 7f71b9600640 1 -- 172.21.15.3:0/3430836277 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac03f070 con 0x7f71bc103ff0 2024-09-19T06:14:08.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.442+0000 7f71c3200640 1 -- 172.21.15.3:0/3430836277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71bc19f860 con 0x7f71bc103ff0 2024-09-19T06:14:08.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.442+0000 7f71b9600640 1 -- 172.21.15.3:0/3430836277 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71ac031ca0 con 0x7f71bc103ff0 2024-09-19T06:14:08.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.442+0000 7f71b9600640 1 -- 172.21.15.3:0/3430836277 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac035030 con 0x7f71bc103ff0 2024-09-19T06:14:08.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.443+0000 7f71c3200640 1 -- 172.21.15.3:0/3430836277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71bc1a71a0 con 0x7f71bc103ff0 2024-09-19T06:14:08.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.447+0000 7f71c5dbb740 1 Processor -- start 2024-09-19T06:14:08.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.447+0000 7f71c5dbb740 1 -- start start 2024-09-19T06:14:08.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.447+0000 7f71b9600640 1 -- 172.21.15.3:0/3430836277 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f71ac042070 con 0x7f71bc103ff0 2024-09-19T06:14:08.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.447+0000 7f71c5dbb740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d474c70 0x562f1d475050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:08.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.447+0000 7f71c5dbb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1d475590 0x562f1d47f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:08.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.447+0000 7f71c5dbb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1d47fe50 0x562f1d482240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:08.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.447+0000 7f71c5dbb740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562f1d3db3e0 con 0x562f1d474c70 2024-09-19T06:14:08.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.447+0000 7f71c5dbb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562f1d382d80 con 0x562f1d475590 2024-09-19T06:14:08.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.447+0000 7f71c5dbb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562f1d3d73a0 con 0x562f1d47fe50 2024-09-19T06:14:08.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.448+0000 7f71c1200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d474c70 0x562f1d475050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:08.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.448+0000 7f71bbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1d475590 0x562f1d47f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:08.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.448+0000 7f71c1200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d474c70 0x562f1d475050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53494/0 (socket says 172.21.15.3:53494) 2024-09-19T06:14:08.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.448+0000 7f71c1200640 1 -- 172.21.15.3:0/3970598167 learned_addr learned my addr 172.21.15.3:0/3970598167 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:08.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.448+0000 7f71b3e00640 1 --2- 172.21.15.3:0/3970598167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1d47fe50 0x562f1d482240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:08.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.448+0000 7f71bbe00640 1 -- 172.21.15.3:0/3970598167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1d47fe50 msgr2=0x562f1d482240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:08.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.448+0000 7f71bbe00640 1 --2- 172.21.15.3:0/3970598167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1d47fe50 0x562f1d482240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.448+0000 7f71bbe00640 1 -- 172.21.15.3:0/3970598167 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d474c70 msgr2=0x562f1d475050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:08.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.448+0000 7f71bbe00640 1 --2- 172.21.15.3:0/3970598167 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d474c70 0x562f1d475050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.448+0000 7f71bbe00640 1 -- 172.21.15.3:0/3970598167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f1d3a1ae0 con 0x562f1d475590 2024-09-19T06:14:08.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.449+0000 7f71bbe00640 1 --2- 172.21.15.3:0/3970598167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1d475590 0x562f1d47f910 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f71ac0edbc0 tx=0x7f71ac0f66d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7548d05429e63ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:08.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.449+0000 7f71b1600640 1 -- 172.21.15.3:0/3970598167 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0f08c0 con 0x562f1d475590 2024-09-19T06:14:08.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.449+0000 7f71b1600640 1 -- 172.21.15.3:0/3970598167 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71ac0fd030 con 0x562f1d475590 2024-09-19T06:14:08.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.449+0000 7f71b1600640 1 -- 172.21.15.3:0/3970598167 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac102640 con 0x562f1d475590 2024-09-19T06:14:08.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.449+0000 7f71b9600640 1 --2- 172.21.15.3:0/3430836277 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f71a00a33b0 0x7f71a00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:08.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.450+0000 7f71b9600640 1 -- 172.21.15.3:0/3430836277 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f71ac0f04d0 con 0x7f71bc103ff0 2024-09-19T06:14:08.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.450+0000 7f71c1200640 1 --2- 172.21.15.3:0/3430836277 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f71a00a33b0 0x7f71a00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:08.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.450+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3970598167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1d475590 msgr2=0x562f1d47f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:08.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.450+0000 7f71c5dbb740 1 --2- 172.21.15.3:0/3970598167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1d475590 0x562f1d47f910 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f71ac0edbc0 tx=0x7f71ac0f66d0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.450+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3970598167 shutdown_connections 2024-09-19T06:14:08.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.450+0000 7f71c5dbb740 1 --2- 172.21.15.3:0/3970598167 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1d47fe50 0x562f1d482240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.450+0000 7f71c5dbb740 1 --2- 172.21.15.3:0/3970598167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1d475590 0x562f1d47f910 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.450+0000 7f71c5dbb740 1 --2- 172.21.15.3:0/3970598167 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d474c70 0x562f1d475050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.450+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3970598167 >> 172.21.15.3:0/3970598167 conn(0x562f1d471200 msgr2=0x562f1d4715e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:08.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.451+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3970598167 shutdown_connections 2024-09-19T06:14:08.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.451+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3970598167 wait complete. 2024-09-19T06:14:08.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.451+0000 7f71c1200640 1 --2- 172.21.15.3:0/3430836277 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f71a00a33b0 0x7f71a00a5870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009fd0 tx=0x7f71b4009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:08.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.451+0000 7f71c5dbb740 1 -- start start 2024-09-19T06:14:08.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.451+0000 7f71c5dbb740 1 Processor -- start 2024-09-19T06:14:08.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.452+0000 7f71c5dbb740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d474c70 0x562f1d47ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:08.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.452+0000 7f71c5dbb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1d475590 0x562f1d47d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:08.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.452+0000 7f71c5dbb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1d47fe50 0x562f1d47d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:08.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.452+0000 7f71c5dbb740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562f1d4827e0 con 0x562f1d474c70 2024-09-19T06:14:08.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.452+0000 7f71c5dbb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562f1d3960f0 con 0x562f1d47fe50 2024-09-19T06:14:08.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.452+0000 7f71c5dbb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562f1d482960 con 0x562f1d475590 2024-09-19T06:14:08.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.452+0000 7f71c5dbb740 10 client.0 _ll_register_callbacks cb 0x562f1d37dbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:08.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.452+0000 7f71b3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1d475590 0x562f1d47d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:08.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.452+0000 7f71b3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1d475590 0x562f1d47d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:40642/0 (socket says 172.21.15.3:40642) 2024-09-19T06:14:08.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.452+0000 7f71b3e00640 1 -- 172.21.15.3:0/3756832413 learned_addr learned my addr 172.21.15.3:0/3756832413 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:08.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.452+0000 7f71c1200640 1 --2- 172.21.15.3:0/3756832413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1d47fe50 0x562f1d47d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:08.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.453+0000 7f71bbe00640 1 --2- 172.21.15.3:0/3756832413 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d474c70 0x562f1d47ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:08.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.453+0000 7f71c1200640 1 -- 172.21.15.3:0/3756832413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1d475590 msgr2=0x562f1d47d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:08.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.453+0000 7f71c1200640 1 --2- 172.21.15.3:0/3756832413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1d475590 0x562f1d47d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.453+0000 7f71c1200640 1 -- 172.21.15.3:0/3756832413 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d474c70 msgr2=0x562f1d47ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:08.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.453+0000 7f71c1200640 1 --2- 172.21.15.3:0/3756832413 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d474c70 0x562f1d47ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.453+0000 7f71c1200640 1 -- 172.21.15.3:0/3756832413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f1d14c3c0 con 0x562f1d47fe50 2024-09-19T06:14:08.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.453+0000 7f71bbe00640 1 --2- 172.21.15.3:0/3756832413 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d474c70 0x562f1d47ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:14:08.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.453+0000 7f71c1200640 1 --2- 172.21.15.3:0/3756832413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1d47fe50 0x562f1d47d730 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f71b4010b50 tx=0x7f71b4004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b05f47373cfe7d00 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:08.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.453+0000 7f71aa000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:14:08.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.454+0000 7f71aa000640 1 -- 172.21.15.3:0/3756832413 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b4009b90 con 0x562f1d47fe50 2024-09-19T06:14:08.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.454+0000 7f71aa000640 1 -- 172.21.15.3:0/3756832413 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f71b401fbc0 con 0x562f1d47fe50 2024-09-19T06:14:08.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.454+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3756832413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71ac0fd030 con 0x562f1d47fe50 2024-09-19T06:14:08.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.454+0000 7f71aa000640 1 -- 172.21.15.3:0/3756832413 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f71b401fdc0 con 0x562f1d47fe50 2024-09-19T06:14:08.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.454+0000 7f71c5dbb740 10 client.25667 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:08.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.454+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3756832413 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562f1d48e710 con 0x562f1d47fe50 2024-09-19T06:14:08.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.454+0000 7f71aa000640 1 -- 172.21.15.3:0/3756832413 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71ac0fd030 con 0x562f1d47fe50 2024-09-19T06:14:08.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.455+0000 7f71aa000640 1 -- 172.21.15.3:0/3756832413 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f71b4026070 con 0x562f1d47fe50 2024-09-19T06:14:08.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.455+0000 7f71c5dbb740 10 client.25667 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:08.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.455+0000 7f71c5dbb740 10 client.25667 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:14:08.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.455+0000 7f71c5dbb740 20 client.25667 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:08.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.455+0000 7f71c5dbb740 1 --2- 172.21.15.3:0/3756832413 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x562f1d48fc70 0x562f1d4920f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:08.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.455+0000 7f71c5dbb740 4 client.25667 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:14:08.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.455+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3756832413 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f1d3e8950 con 0x562f1d48fc70 2024-09-19T06:14:08.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.455+0000 7f71bbe00640 1 --2- 172.21.15.3:0/3756832413 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x562f1d48fc70 0x562f1d4920f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:08.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.456+0000 7f71bbe00640 1 --2- 172.21.15.3:0/3756832413 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x562f1d48fc70 0x562f1d4920f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f8a27871829cb67b server_cookie=63e153a1acef7fe1 in_seq=0 out_seq=0 2024-09-19T06:14:08.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.456+0000 7f71aa000640 10 client.25667 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:14:08.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.456+0000 7f71aa000640 1 -- 172.21.15.3:0/3756832413 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562f1d3e8950 con 0x562f1d48fc70 2024-09-19T06:14:08.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.456+0000 7f71aa000640 10 client.25667 handle_command_reply: tid=0 2024-09-19T06:14:08.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.456+0000 7f71c5dbb740 1 client.25667 shutdown 2024-09-19T06:14:08.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.457+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3756832413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1d47fe50 msgr2=0x562f1d47d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:08.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.457+0000 7f71c5dbb740 1 --2- 172.21.15.3:0/3756832413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1d47fe50 0x562f1d47d730 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f71b4010b50 tx=0x7f71b4004ab0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.457+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3756832413 shutdown_connections 2024-09-19T06:14:08.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.457+0000 7f71c5dbb740 1 --2- 172.21.15.3:0/3756832413 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x562f1d48fc70 0x562f1d4920f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.457+0000 7f71c5dbb740 1 --2- 172.21.15.3:0/3756832413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1d47fe50 0x562f1d47d730 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.457+0000 7f71c5dbb740 1 --2- 172.21.15.3:0/3756832413 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1d475590 0x562f1d47d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.457+0000 7f71c5dbb740 1 --2- 172.21.15.3:0/3756832413 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d474c70 0x562f1d47ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.457+0000 7f71aa000640 0 client.25667 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:14:08.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.457+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3756832413 >> 172.21.15.3:0/3756832413 conn(0x562f1d471200 msgr2=0x562f1d476f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:08.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.457+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3756832413 shutdown_connections 2024-09-19T06:14:08.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.457+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3756832413 wait complete. 2024-09-19T06:14:08.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.457+0000 7f71c5dbb740 20 client.25667 trim_cache size 0 max 16384 2024-09-19T06:14:08.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.471+0000 7f71c5dbb740 1 Processor -- start 2024-09-19T06:14:08.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.471+0000 7f71c5dbb740 1 -- start start 2024-09-19T06:14:08.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.471+0000 7f71c5dbb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1d474c70 0x562f1d4776d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:08.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.471+0000 7f71c5dbb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1d475590 0x562f1d4979c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:08.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.471+0000 7f71c5dbb740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d47fe50 0x562f1d497f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:08.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.471+0000 7f71c5dbb740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc1afb00 con 0x562f1d47fe50 2024-09-19T06:14:08.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.471+0000 7f71c5dbb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc1b1640 con 0x562f1d475590 2024-09-19T06:14:08.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.471+0000 7f71c5dbb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc1b01d0 con 0x562f1d474c70 2024-09-19T06:14:08.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.472+0000 7f71c1200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d47fe50 0x562f1d497f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:08.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.472+0000 7f71b3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1d475590 0x562f1d4979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:08.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.472+0000 7f71c1200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d47fe50 0x562f1d497f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53520/0 (socket says 172.21.15.3:53520) 2024-09-19T06:14:08.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.472+0000 7f71b3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1d475590 0x562f1d4979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:54416/0 (socket says 172.21.15.3:54416) 2024-09-19T06:14:08.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.472+0000 7f71c1200640 1 -- 172.21.15.3:0/3368052968 learned_addr learned my addr 172.21.15.3:0/3368052968 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:08.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.472+0000 7f71bbe00640 1 --2- 172.21.15.3:0/3368052968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1d474c70 0x562f1d4776d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:08.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.472+0000 7f71c1200640 1 -- 172.21.15.3:0/3368052968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1d474c70 msgr2=0x562f1d4776d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:08.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.472+0000 7f71c1200640 1 --2- 172.21.15.3:0/3368052968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1d474c70 0x562f1d4776d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.472+0000 7f71c1200640 1 -- 172.21.15.3:0/3368052968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1d475590 msgr2=0x562f1d4979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:08.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.472+0000 7f71c1200640 1 --2- 172.21.15.3:0/3368052968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1d475590 0x562f1d4979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.472+0000 7f71c1200640 1 -- 172.21.15.3:0/3368052968 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f1d471030 con 0x562f1d47fe50 2024-09-19T06:14:08.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.472+0000 7f71c1200640 1 --2- 172.21.15.3:0/3368052968 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d47fe50 0x562f1d497f00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f71b4006010 tx=0x7f71b401f8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73182d97245330f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:08.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.473+0000 7f71b0c00640 1 -- 172.21.15.3:0/3368052968 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b4030ce0 con 0x562f1d47fe50 2024-09-19T06:14:08.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.473+0000 7f71b0c00640 1 -- 172.21.15.3:0/3368052968 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71b4030400 con 0x562f1d47fe50 2024-09-19T06:14:08.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.473+0000 7f71b0c00640 1 -- 172.21.15.3:0/3368052968 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b401c650 con 0x562f1d47fe50 2024-09-19T06:14:08.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.473+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3368052968 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d47fe50 msgr2=0x562f1d497f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:08.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.473+0000 7f71c5dbb740 1 --2- 172.21.15.3:0/3368052968 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d47fe50 0x562f1d497f00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f71b4006010 tx=0x7f71b401f8b0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.474+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3368052968 shutdown_connections 2024-09-19T06:14:08.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.474+0000 7f71c5dbb740 1 --2- 172.21.15.3:0/3368052968 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d47fe50 0x562f1d497f00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.474+0000 7f71c5dbb740 1 --2- 172.21.15.3:0/3368052968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1d475590 0x562f1d4979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.474+0000 7f71c5dbb740 1 --2- 172.21.15.3:0/3368052968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1d474c70 0x562f1d4776d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.474+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3368052968 >> 172.21.15.3:0/3368052968 conn(0x562f1d471200 msgr2=0x562f1d47ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:08.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.474+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3368052968 shutdown_connections 2024-09-19T06:14:08.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.474+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3368052968 wait complete. 2024-09-19T06:14:08.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.474+0000 7f71c5dbb740 1 -- start start 2024-09-19T06:14:08.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.474+0000 7f71c5dbb740 1 Processor -- start 2024-09-19T06:14:08.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.475+0000 7f71c5dbb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1d474c70 0x562f1d479c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:08.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.475+0000 7f71c5dbb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1d475590 0x562f1d47a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:08.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.475+0000 7f71c5dbb740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d47fe50 0x562f1d47a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:08.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.475+0000 7f71c5dbb740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc1b0f70 con 0x562f1d47fe50 2024-09-19T06:14:08.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.475+0000 7f71c5dbb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc1b08a0 con 0x562f1d474c70 2024-09-19T06:14:08.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.475+0000 7f71c5dbb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc1adae0 con 0x562f1d475590 2024-09-19T06:14:08.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.475+0000 7f71c5dbb740 10 client.0 _ll_register_callbacks cb 0x7f71b40109e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:08.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.475+0000 7f71c1200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d47fe50 0x562f1d47a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:08.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.475+0000 7f71bbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1d474c70 0x562f1d479c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:08.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.475+0000 7f71c1200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d47fe50 0x562f1d47a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53528/0 (socket says 172.21.15.3:53528) 2024-09-19T06:14:08.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.475+0000 7f71c1200640 1 -- 172.21.15.3:0/3841337088 learned_addr learned my addr 172.21.15.3:0/3841337088 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:08.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.475+0000 7f71b3e00640 1 --2- 172.21.15.3:0/3841337088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1d475590 0x562f1d47a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:08.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.476+0000 7f71bbe00640 1 -- 172.21.15.3:0/3841337088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1d475590 msgr2=0x562f1d47a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:08.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.476+0000 7f71bbe00640 1 --2- 172.21.15.3:0/3841337088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1d475590 0x562f1d47a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.476+0000 7f71bbe00640 1 -- 172.21.15.3:0/3841337088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d47fe50 msgr2=0x562f1d47a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:08.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.476+0000 7f71bbe00640 1 --2- 172.21.15.3:0/3841337088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d47fe50 0x562f1d47a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.476+0000 7f71bbe00640 1 -- 172.21.15.3:0/3841337088 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f1d46c770 con 0x562f1d474c70 2024-09-19T06:14:08.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.476+0000 7f71c1200640 1 --2- 172.21.15.3:0/3841337088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d47fe50 0x562f1d47a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:08.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.476+0000 7f71bbe00640 1 --2- 172.21.15.3:0/3841337088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1d474c70 0x562f1d479c80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f71ac0b9120 tx=0x7f71ac03b460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=227de953e6cbd350 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:08.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.476+0000 7f71aa000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:14:08.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.476+0000 7f71aa000640 1 -- 172.21.15.3:0/3841337088 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac049070 con 0x562f1d474c70 2024-09-19T06:14:08.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.476+0000 7f71aa000640 1 -- 172.21.15.3:0/3841337088 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f71ac0baa50 con 0x562f1d474c70 2024-09-19T06:14:08.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.476+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3841337088 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71b4030400 con 0x562f1d474c70 2024-09-19T06:14:08.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.476+0000 7f71aa000640 1 -- 172.21.15.3:0/3841337088 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f71ac0b89f0 con 0x562f1d474c70 2024-09-19T06:14:08.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.476+0000 7f71c5dbb740 10 client.25673 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:08.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.476+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3841337088 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562f1d4faa60 con 0x562f1d474c70 2024-09-19T06:14:08.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.477+0000 7f71aa000640 1 -- 172.21.15.3:0/3841337088 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71b4030400 con 0x562f1d474c70 2024-09-19T06:14:08.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.477+0000 7f71aa000640 1 -- 172.21.15.3:0/3841337088 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f71ac0b8dc0 con 0x562f1d474c70 2024-09-19T06:14:08.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.477+0000 7f71c5dbb740 10 client.25673 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:08.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.477+0000 7f71c5dbb740 10 client.25673 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:14:08.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.477+0000 7f71c5dbb740 20 client.25673 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:08.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.477+0000 7f71c5dbb740 1 --2- 172.21.15.3:0/3841337088 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x562f1d4fb0a0 0x562f1d4fd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:08.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.477+0000 7f71c5dbb740 4 client.25673 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:14:08.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.477+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3841337088 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562f1d3e2e60 con 0x562f1d4fb0a0 2024-09-19T06:14:08.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.477+0000 7f71b3e00640 1 --2- 172.21.15.3:0/3841337088 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x562f1d4fb0a0 0x562f1d4fd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:08.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.478+0000 7f71b3e00640 1 --2- 172.21.15.3:0/3841337088 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x562f1d4fb0a0 0x562f1d4fd4c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=21b27b7a92c806c6 server_cookie=23e667c447b3f2c7 in_seq=0 out_seq=0 2024-09-19T06:14:08.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.478+0000 7f71aa000640 10 client.25673 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:14:08.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.478+0000 7f71aa000640 1 -- 172.21.15.3:0/3841337088 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562f1d3e2e60 con 0x562f1d4fb0a0 2024-09-19T06:14:08.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.478+0000 7f71aa000640 10 client.25673 handle_command_reply: tid=0 2024-09-19T06:14:08.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.478+0000 7f71c5dbb740 1 client.25673 shutdown 2024-09-19T06:14:08.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.478+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3841337088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1d474c70 msgr2=0x562f1d479c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:08.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.478+0000 7f71c5dbb740 1 --2- 172.21.15.3:0/3841337088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1d474c70 0x562f1d479c80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f71ac0b9120 tx=0x7f71ac03b460 comp rx=0 tx=0).stop 2024-09-19T06:14:08.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.478+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3841337088 shutdown_connections 2024-09-19T06:14:08.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.478+0000 7f71c5dbb740 1 --2- 172.21.15.3:0/3841337088 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x562f1d4fb0a0 0x562f1d4fd4c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.478+0000 7f71c5dbb740 1 --2- 172.21.15.3:0/3841337088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1d47fe50 0x562f1d47a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.478+0000 7f71c5dbb740 1 --2- 172.21.15.3:0/3841337088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1d475590 0x562f1d47a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.478+0000 7f71c5dbb740 1 --2- 172.21.15.3:0/3841337088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1d474c70 0x562f1d479c80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.478+0000 7f71aa000640 0 client.25673 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:14:08.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.478+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3841337088 >> 172.21.15.3:0/3841337088 conn(0x562f1d471200 msgr2=0x562f1d470380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:08.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.478+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3841337088 shutdown_connections 2024-09-19T06:14:08.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.479+0000 7f71c5dbb740 1 -- 172.21.15.3:0/3841337088 wait complete. 2024-09-19T06:14:08.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.479+0000 7f71c5dbb740 20 client.25673 trim_cache size 0 max 16384 2024-09-19T06:14:08.484 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:14:08.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.479+0000 7f71c3200640 1 -- 172.21.15.3:0/3430836277 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f71a00a33b0 msgr2=0x7f71a00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:08.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.479+0000 7f71c3200640 1 --2- 172.21.15.3:0/3430836277 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f71a00a33b0 0x7f71a00a5870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009fd0 tx=0x7f71b4009500 comp rx=0 tx=0).stop 2024-09-19T06:14:08.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.479+0000 7f71c3200640 1 -- 172.21.15.3:0/3430836277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71bc103ff0 msgr2=0x7f71bc19a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:08.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.479+0000 7f71c3200640 1 --2- 172.21.15.3:0/3430836277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71bc103ff0 0x7f71bc19a620 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f71ac004770 tx=0x7f71ac003c10 comp rx=0 tx=0).stop 2024-09-19T06:14:08.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.479+0000 7f71c3200640 1 -- 172.21.15.3:0/3430836277 shutdown_connections 2024-09-19T06:14:08.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.479+0000 7f71c3200640 1 --2- 172.21.15.3:0/3430836277 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f71a00a33b0 0x7f71a00a5870 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.479+0000 7f71c3200640 1 --2- 172.21.15.3:0/3430836277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71bc109120 0x7f71bc19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.479+0000 7f71c3200640 1 --2- 172.21.15.3:0/3430836277 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71bc1049a0 0x7f71bc19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.479+0000 7f71c3200640 1 --2- 172.21.15.3:0/3430836277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f71bc103ff0 0x7f71bc19a620 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:08.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.479+0000 7f71c3200640 1 -- 172.21.15.3:0/3430836277 >> 172.21.15.3:0/3430836277 conn(0x7f71bc0ffa90 msgr2=0x7f71bc100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:08.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.480+0000 7f71c3200640 1 -- 172.21.15.3:0/3430836277 shutdown_connections 2024-09-19T06:14:08.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:08.480+0000 7f71c3200640 1 -- 172.21.15.3:0/3430836277 wait complete. 2024-09-19T06:14:09.555 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:14:09.936 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:10.242 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:09 smithi003 ceph-mon[30893]: pgmap v56: 97 pgs: 97 active+clean; 1.7 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 49 KiB/s wr, 36 op/s 2024-09-19T06:14:10.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:09 smithi059 ceph-mon[35138]: pgmap v56: 97 pgs: 97 active+clean; 1.7 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 49 KiB/s wr, 36 op/s 2024-09-19T06:14:10.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:09 smithi071 ceph-mon[35662]: pgmap v56: 97 pgs: 97 active+clean; 1.7 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 49 KiB/s wr, 36 op/s 2024-09-19T06:14:10.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.519+0000 7fd61a800640 1 -- 172.21.15.3:0/4246691328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd614112870 msgr2=0x7fd614114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:10.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.519+0000 7fd61a800640 1 --2- 172.21.15.3:0/4246691328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd614112870 0x7fd614114c60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd60c009ca0 tx=0x7fd60c02a8b0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.519+0000 7fd61a800640 1 -- 172.21.15.3:0/4246691328 shutdown_connections 2024-09-19T06:14:10.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.519+0000 7fd61a800640 1 --2- 172.21.15.3:0/4246691328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd614112870 0x7fd614114c60 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.519+0000 7fd61a800640 1 --2- 172.21.15.3:0/4246691328 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd614077040 0x7fd614112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.519+0000 7fd61a800640 1 --2- 172.21.15.3:0/4246691328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd614076720 0x7fd614076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.519+0000 7fd61a800640 1 -- 172.21.15.3:0/4246691328 >> 172.21.15.3:0/4246691328 conn(0x7fd6140ff8d0 msgr2=0x7fd614101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:10.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.519+0000 7fd61a800640 1 -- 172.21.15.3:0/4246691328 shutdown_connections 2024-09-19T06:14:10.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.519+0000 7fd61a800640 1 -- 172.21.15.3:0/4246691328 wait complete. 2024-09-19T06:14:10.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.521+0000 7fd61a800640 1 Processor -- start 2024-09-19T06:14:10.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.521+0000 7fd61a800640 1 -- start start 2024-09-19T06:14:10.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.521+0000 7fd61a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd614076720 0x7fd6141a45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.521+0000 7fd61a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd614077040 0x7fd6141a4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.521+0000 7fd61a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd614112870 0x7fd61419e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.521+0000 7fd61a800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141183c0 con 0x7fd614077040 2024-09-19T06:14:10.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.521+0000 7fd61a800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd614118240 con 0x7fd614112870 2024-09-19T06:14:10.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.521+0000 7fd61a800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd614118540 con 0x7fd614076720 2024-09-19T06:14:10.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.522+0000 7fd619400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd614076720 0x7fd6141a45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.522+0000 7fd619400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd614076720 0x7fd6141a45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:40680/0 (socket says 172.21.15.3:40680) 2024-09-19T06:14:10.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.522+0000 7fd619400640 1 -- 172.21.15.3:0/2386822756 learned_addr learned my addr 172.21.15.3:0/2386822756 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:10.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.522+0000 7fd619e00640 1 --2- 172.21.15.3:0/2386822756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd614112870 0x7fd61419e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.522+0000 7fd618a00640 1 --2- 172.21.15.3:0/2386822756 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd614077040 0x7fd6141a4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.522+0000 7fd619e00640 1 -- 172.21.15.3:0/2386822756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd614076720 msgr2=0x7fd6141a45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:10.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.522+0000 7fd619e00640 1 --2- 172.21.15.3:0/2386822756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd614076720 0x7fd6141a45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.522+0000 7fd619e00640 1 -- 172.21.15.3:0/2386822756 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd614077040 msgr2=0x7fd6141a4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:10.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.522+0000 7fd619e00640 1 --2- 172.21.15.3:0/2386822756 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd614077040 0x7fd6141a4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.522+0000 7fd619e00640 1 -- 172.21.15.3:0/2386822756 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61419ef10 con 0x7fd614112870 2024-09-19T06:14:10.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.523+0000 7fd619400640 1 --2- 172.21.15.3:0/2386822756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd614076720 0x7fd6141a45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:10.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.523+0000 7fd619e00640 1 --2- 172.21.15.3:0/2386822756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd614112870 0x7fd61419e6a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd61406b3d0 tx=0x7fd60c030ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:10.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.523+0000 7fd612000640 1 -- 172.21.15.3:0/2386822756 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c003d80 con 0x7fd614112870 2024-09-19T06:14:10.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.523+0000 7fd61a800640 1 -- 172.21.15.3:0/2386822756 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd61419f1a0 con 0x7fd614112870 2024-09-19T06:14:10.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.524+0000 7fd612000640 1 -- 172.21.15.3:0/2386822756 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd60c040070 con 0x7fd614112870 2024-09-19T06:14:10.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.524+0000 7fd612000640 1 -- 172.21.15.3:0/2386822756 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60c045a60 con 0x7fd614112870 2024-09-19T06:14:10.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.524+0000 7fd61a800640 1 -- 172.21.15.3:0/2386822756 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6141ab550 con 0x7fd614112870 2024-09-19T06:14:10.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.527+0000 7fd61ea39740 1 Processor -- start 2024-09-19T06:14:10.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.528+0000 7fd612000640 1 -- 172.21.15.3:0/2386822756 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fd60c004690 con 0x7fd614112870 2024-09-19T06:14:10.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.528+0000 7fd61ea39740 1 -- start start 2024-09-19T06:14:10.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.528+0000 7fd61ea39740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c3489e40 0x55d2c348a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.528+0000 7fd61ea39740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c348a760 0x55d2c3494ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.528+0000 7fd61ea39740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2c3495020 0x55d2c3497410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.528+0000 7fd61ea39740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d2c33f03e0 con 0x55d2c3489e40 2024-09-19T06:14:10.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.528+0000 7fd61ea39740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d2c3397d80 con 0x55d2c348a760 2024-09-19T06:14:10.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.528+0000 7fd61ea39740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d2c33ec3a0 con 0x55d2c3495020 2024-09-19T06:14:10.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.528+0000 7fd618a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c3489e40 0x55d2c348a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.528+0000 7fd619400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c348a760 0x55d2c3494ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.529+0000 7fd618a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c3489e40 0x55d2c348a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53568/0 (socket says 172.21.15.3:53568) 2024-09-19T06:14:10.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.529+0000 7fd618a00640 1 -- 172.21.15.3:0/3728815542 learned_addr learned my addr 172.21.15.3:0/3728815542 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:10.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.529+0000 7fd619400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c348a760 0x55d2c3494ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:54452/0 (socket says 172.21.15.3:54452) 2024-09-19T06:14:10.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.529+0000 7fd618a00640 1 --2- 172.21.15.3:0/3728815542 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2c3495020 0x55d2c3497410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.529+0000 7fd619400640 1 -- 172.21.15.3:0/3728815542 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2c3495020 msgr2=0x55d2c3497410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:10.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.529+0000 7fd619400640 1 --2- 172.21.15.3:0/3728815542 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2c3495020 0x55d2c3497410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.529+0000 7fd619400640 1 -- 172.21.15.3:0/3728815542 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c3489e40 msgr2=0x55d2c348a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:10.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.529+0000 7fd619400640 1 --2- 172.21.15.3:0/3728815542 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c3489e40 0x55d2c348a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.529+0000 7fd619400640 1 -- 172.21.15.3:0/3728815542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2c33b6ae0 con 0x55d2c348a760 2024-09-19T06:14:10.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.529+0000 7fd619400640 1 --2- 172.21.15.3:0/3728815542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c348a760 0x55d2c3494ae0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd608011510 tx=0x7fd6080119d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bd7282685bfa99d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:10.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.530+0000 7fd606600640 1 -- 172.21.15.3:0/3728815542 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60801e070 con 0x55d2c348a760 2024-09-19T06:14:10.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.530+0000 7fd606600640 1 -- 172.21.15.3:0/3728815542 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd60800fa40 con 0x55d2c348a760 2024-09-19T06:14:10.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.530+0000 7fd606600640 1 -- 172.21.15.3:0/3728815542 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd608019bb0 con 0x55d2c348a760 2024-09-19T06:14:10.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.530+0000 7fd612000640 1 --2- 172.21.15.3:0/2386822756 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd5fc0a3430 0x7fd5fc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.530+0000 7fd612000640 1 -- 172.21.15.3:0/2386822756 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fd60c0f0cf0 con 0x7fd614112870 2024-09-19T06:14:10.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.531+0000 7fd618a00640 1 --2- 172.21.15.3:0/2386822756 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd5fc0a3430 0x7fd5fc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.531+0000 7fd61ea39740 1 -- 172.21.15.3:0/3728815542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c348a760 msgr2=0x55d2c3494ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:10.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.531+0000 7fd61ea39740 1 --2- 172.21.15.3:0/3728815542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c348a760 0x55d2c3494ae0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd608011510 tx=0x7fd6080119d0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.532+0000 7fd61ea39740 1 -- 172.21.15.3:0/3728815542 shutdown_connections 2024-09-19T06:14:10.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.532+0000 7fd61ea39740 1 --2- 172.21.15.3:0/3728815542 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2c3495020 0x55d2c3497410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.532+0000 7fd61ea39740 1 --2- 172.21.15.3:0/3728815542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c348a760 0x55d2c3494ae0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.532+0000 7fd61ea39740 1 --2- 172.21.15.3:0/3728815542 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c3489e40 0x55d2c348a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.532+0000 7fd61ea39740 1 -- 172.21.15.3:0/3728815542 >> 172.21.15.3:0/3728815542 conn(0x55d2c34863d0 msgr2=0x55d2c34867b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:10.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.532+0000 7fd618a00640 1 --2- 172.21.15.3:0/2386822756 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd5fc0a3430 0x7fd5fc0a58f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd600009fd0 tx=0x7fd600015040 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:10.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.532+0000 7fd61ea39740 1 -- 172.21.15.3:0/3728815542 shutdown_connections 2024-09-19T06:14:10.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.532+0000 7fd61ea39740 1 -- 172.21.15.3:0/3728815542 wait complete. 2024-09-19T06:14:10.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.533+0000 7fd61ea39740 1 -- start start 2024-09-19T06:14:10.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.533+0000 7fd61ea39740 1 Processor -- start 2024-09-19T06:14:10.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.533+0000 7fd61ea39740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2c3489e40 0x55d2c3491f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.533+0000 7fd61ea39740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c348a760 0x55d2c3492480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.533+0000 7fd61ea39740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c3495020 0x55d2c34929c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.533+0000 7fd61ea39740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d2c3497c40 con 0x55d2c3495020 2024-09-19T06:14:10.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.533+0000 7fd61ea39740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d2c33ab0f0 con 0x55d2c348a760 2024-09-19T06:14:10.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.533+0000 7fd61ea39740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d2c3497dc0 con 0x55d2c3489e40 2024-09-19T06:14:10.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.534+0000 7fd61ea39740 10 client.0 _ll_register_callbacks cb 0x55d2c3392bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:10.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.534+0000 7fd619400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2c3489e40 0x55d2c3491f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.534+0000 7fd618a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c348a760 0x55d2c3492480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.534+0000 7fd619400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2c3489e40 0x55d2c3491f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:40700/0 (socket says 172.21.15.3:40700) 2024-09-19T06:14:10.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.534+0000 7fd619400640 1 -- 172.21.15.3:0/1143747080 learned_addr learned my addr 172.21.15.3:0/1143747080 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:10.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.534+0000 7fd619e00640 1 --2- 172.21.15.3:0/1143747080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c3495020 0x55d2c34929c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.534+0000 7fd618a00640 1 -- 172.21.15.3:0/1143747080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2c3489e40 msgr2=0x55d2c3491f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:10.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.534+0000 7fd618a00640 1 --2- 172.21.15.3:0/1143747080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2c3489e40 0x55d2c3491f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.534+0000 7fd618a00640 1 -- 172.21.15.3:0/1143747080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c3495020 msgr2=0x55d2c34929c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:10.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.534+0000 7fd618a00640 1 --2- 172.21.15.3:0/1143747080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c3495020 0x55d2c34929c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.534+0000 7fd618a00640 1 -- 172.21.15.3:0/1143747080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2c31613c0 con 0x55d2c348a760 2024-09-19T06:14:10.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.534+0000 7fd619400640 1 --2- 172.21.15.3:0/1143747080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2c3489e40 0x55d2c3491f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:10.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.534+0000 7fd619e00640 1 --2- 172.21.15.3:0/1143747080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c3495020 0x55d2c34929c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:10.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.535+0000 7fd618a00640 1 --2- 172.21.15.3:0/1143747080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c348a760 0x55d2c3492480 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd60000fb30 tx=0x7fd600005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9f255d2c1fa93eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:10.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.535+0000 7fd5faa00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:14:10.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.535+0000 7fd5faa00640 1 -- 172.21.15.3:0/1143747080 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd600004320 con 0x55d2c348a760 2024-09-19T06:14:10.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.535+0000 7fd61ea39740 1 -- 172.21.15.3:0/1143747080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd60800fa40 con 0x55d2c348a760 2024-09-19T06:14:10.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.535+0000 7fd5faa00640 1 -- 172.21.15.3:0/1143747080 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fd6000035f0 con 0x55d2c348a760 2024-09-19T06:14:10.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.535+0000 7fd5faa00640 1 -- 172.21.15.3:0/1143747080 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd6000044c0 con 0x55d2c348a760 2024-09-19T06:14:10.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.535+0000 7fd61ea39740 10 client.25685 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:10.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.535+0000 7fd61ea39740 1 -- 172.21.15.3:0/1143747080 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d2c34a3d60 con 0x55d2c348a760 2024-09-19T06:14:10.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.536+0000 7fd5faa00640 1 -- 172.21.15.3:0/1143747080 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd60800fa40 con 0x55d2c348a760 2024-09-19T06:14:10.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.536+0000 7fd5faa00640 1 -- 172.21.15.3:0/1143747080 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd600034a40 con 0x55d2c348a760 2024-09-19T06:14:10.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.536+0000 7fd61ea39740 10 client.25685 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:10.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.536+0000 7fd61ea39740 10 client.25685 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:14:10.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.536+0000 7fd61ea39740 20 client.25685 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:10.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.536+0000 7fd61ea39740 1 --2- 172.21.15.3:0/1143747080 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55d2c34a51c0 0x55d2c34a7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.536+0000 7fd61ea39740 4 client.25685 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:14:10.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.536+0000 7fd61ea39740 1 -- 172.21.15.3:0/1143747080 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2c33fd950 con 0x55d2c34a51c0 2024-09-19T06:14:10.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.536+0000 7fd619400640 1 --2- 172.21.15.3:0/1143747080 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55d2c34a51c0 0x55d2c34a7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.537+0000 7fd619400640 1 --2- 172.21.15.3:0/1143747080 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55d2c34a51c0 0x55d2c34a7600 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b8641c7c07867a2c server_cookie=36b4ea71644494b9 in_seq=0 out_seq=0 2024-09-19T06:14:10.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.537+0000 7fd5faa00640 10 client.25685 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:14:10.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.538+0000 7fd5faa00640 1 -- 172.21.15.3:0/1143747080 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d2c33fd950 con 0x55d2c34a51c0 2024-09-19T06:14:10.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.538+0000 7fd5faa00640 10 client.25685 handle_command_reply: tid=0 2024-09-19T06:14:10.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.538+0000 7fd61ea39740 1 client.25685 shutdown 2024-09-19T06:14:10.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.538+0000 7fd61ea39740 1 -- 172.21.15.3:0/1143747080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c348a760 msgr2=0x55d2c3492480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:10.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.538+0000 7fd61ea39740 1 --2- 172.21.15.3:0/1143747080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c348a760 0x55d2c3492480 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd60000fb30 tx=0x7fd600005f90 comp rx=0 tx=0).stop 2024-09-19T06:14:10.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.538+0000 7fd61ea39740 1 -- 172.21.15.3:0/1143747080 shutdown_connections 2024-09-19T06:14:10.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.538+0000 7fd61ea39740 1 --2- 172.21.15.3:0/1143747080 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55d2c34a51c0 0x55d2c34a7600 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.538+0000 7fd61ea39740 1 --2- 172.21.15.3:0/1143747080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c3495020 0x55d2c34929c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.538+0000 7fd61ea39740 1 --2- 172.21.15.3:0/1143747080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c348a760 0x55d2c3492480 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.538+0000 7fd5faa00640 0 client.25685 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:14:10.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.538+0000 7fd61ea39740 1 --2- 172.21.15.3:0/1143747080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2c3489e40 0x55d2c3491f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.538+0000 7fd61ea39740 1 -- 172.21.15.3:0/1143747080 >> 172.21.15.3:0/1143747080 conn(0x55d2c34863d0 msgr2=0x55d2c348c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:10.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.538+0000 7fd61ea39740 1 -- 172.21.15.3:0/1143747080 shutdown_connections 2024-09-19T06:14:10.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.538+0000 7fd61ea39740 1 -- 172.21.15.3:0/1143747080 wait complete. 2024-09-19T06:14:10.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.539+0000 7fd61ea39740 20 client.25685 trim_cache size 0 max 16384 2024-09-19T06:14:10.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.553+0000 7fd61ea39740 1 Processor -- start 2024-09-19T06:14:10.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.553+0000 7fd61ea39740 1 -- start start 2024-09-19T06:14:10.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.553+0000 7fd61ea39740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c3489e40 0x55d2c348c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.553+0000 7fd61ea39740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c348a760 0x55d2c34aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.553+0000 7fd61ea39740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2c3495020 0x55d2c34ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.553+0000 7fd61ea39740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141b3cb0 con 0x55d2c348a760 2024-09-19T06:14:10.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.553+0000 7fd61ea39740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141b57f0 con 0x55d2c3489e40 2024-09-19T06:14:10.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.553+0000 7fd61ea39740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141b4380 con 0x55d2c3495020 2024-09-19T06:14:10.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.553+0000 7fd618a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c348a760 0x55d2c34aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.553+0000 7fd618a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c348a760 0x55d2c34aced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53586/0 (socket says 172.21.15.3:53586) 2024-09-19T06:14:10.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.553+0000 7fd618a00640 1 -- 172.21.15.3:0/295113920 learned_addr learned my addr 172.21.15.3:0/295113920 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:10.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.553+0000 7fd619400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c3489e40 0x55d2c348c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.553+0000 7fd619e00640 1 --2- 172.21.15.3:0/295113920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2c3495020 0x55d2c34ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.554+0000 7fd619400640 1 -- 172.21.15.3:0/295113920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2c3495020 msgr2=0x55d2c34ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:10.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.554+0000 7fd619400640 1 --2- 172.21.15.3:0/295113920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2c3495020 0x55d2c34ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.554+0000 7fd619400640 1 -- 172.21.15.3:0/295113920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c348a760 msgr2=0x55d2c34aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:10.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.554+0000 7fd619400640 1 --2- 172.21.15.3:0/295113920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c348a760 0x55d2c34aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.554+0000 7fd619400640 1 -- 172.21.15.3:0/295113920 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2c3485e70 con 0x55d2c3489e40 2024-09-19T06:14:10.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.554+0000 7fd619400640 1 --2- 172.21.15.3:0/295113920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c3489e40 0x55d2c348c8a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd608019750 tx=0x7fd608005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21db0a175f7b55ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:10.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.554+0000 7fd605c00640 1 -- 172.21.15.3:0/295113920 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60801e040 con 0x55d2c3489e40 2024-09-19T06:14:10.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.554+0000 7fd605c00640 1 -- 172.21.15.3:0/295113920 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd608029070 con 0x55d2c3489e40 2024-09-19T06:14:10.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.554+0000 7fd605c00640 1 -- 172.21.15.3:0/295113920 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6080052a0 con 0x55d2c3489e40 2024-09-19T06:14:10.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.555+0000 7fd61ea39740 1 -- 172.21.15.3:0/295113920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c3489e40 msgr2=0x55d2c348c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:10.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.555+0000 7fd61ea39740 1 --2- 172.21.15.3:0/295113920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c3489e40 0x55d2c348c8a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd608019750 tx=0x7fd608005f90 comp rx=0 tx=0).stop 2024-09-19T06:14:10.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.555+0000 7fd61ea39740 1 -- 172.21.15.3:0/295113920 shutdown_connections 2024-09-19T06:14:10.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.555+0000 7fd61ea39740 1 --2- 172.21.15.3:0/295113920 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2c3495020 0x55d2c34ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.555+0000 7fd61ea39740 1 --2- 172.21.15.3:0/295113920 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c348a760 0x55d2c34aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.555+0000 7fd61ea39740 1 --2- 172.21.15.3:0/295113920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c3489e40 0x55d2c348c8a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.555+0000 7fd61ea39740 1 -- 172.21.15.3:0/295113920 >> 172.21.15.3:0/295113920 conn(0x55d2c34863d0 msgr2=0x55d2c3491030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:10.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.555+0000 7fd61ea39740 1 -- 172.21.15.3:0/295113920 shutdown_connections 2024-09-19T06:14:10.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.555+0000 7fd61ea39740 1 -- 172.21.15.3:0/295113920 wait complete. 2024-09-19T06:14:10.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.556+0000 7fd61ea39740 1 -- start start 2024-09-19T06:14:10.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.556+0000 7fd61ea39740 1 Processor -- start 2024-09-19T06:14:10.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.556+0000 7fd61ea39740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c3489e40 0x55d2c3498570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.556+0000 7fd61ea39740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2c348a760 0x55d2c3498ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.556+0000 7fd61ea39740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c3495020 0x55d2c350de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.556+0000 7fd61ea39740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141b5120 con 0x55d2c3489e40 2024-09-19T06:14:10.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.556+0000 7fd61ea39740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141b4a50 con 0x55d2c3495020 2024-09-19T06:14:10.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.556+0000 7fd61ea39740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141b1c90 con 0x55d2c348a760 2024-09-19T06:14:10.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.556+0000 7fd61ea39740 10 client.0 _ll_register_callbacks cb 0x7fd600013dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:10.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.557+0000 7fd619400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c3489e40 0x55d2c3498570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.557+0000 7fd619e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c3495020 0x55d2c350de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.557+0000 7fd618a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2c348a760 0x55d2c3498ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.557+0000 7fd619400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c3489e40 0x55d2c3498570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53594/0 (socket says 172.21.15.3:53594) 2024-09-19T06:14:10.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.557+0000 7fd619400640 1 -- 172.21.15.3:0/1681415435 learned_addr learned my addr 172.21.15.3:0/1681415435 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:10.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.557+0000 7fd619e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c3495020 0x55d2c350de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:54478/0 (socket says 172.21.15.3:54478) 2024-09-19T06:14:10.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.557+0000 7fd618a00640 1 -- 172.21.15.3:0/1681415435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c3495020 msgr2=0x55d2c350de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:10.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.557+0000 7fd618a00640 1 --2- 172.21.15.3:0/1681415435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c3495020 0x55d2c350de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.557+0000 7fd618a00640 1 -- 172.21.15.3:0/1681415435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c3489e40 msgr2=0x55d2c3498570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:10.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.557+0000 7fd618a00640 1 --2- 172.21.15.3:0/1681415435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c3489e40 0x55d2c3498570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.557+0000 7fd618a00640 1 -- 172.21.15.3:0/1681415435 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2c350e450 con 0x55d2c348a760 2024-09-19T06:14:10.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.557+0000 7fd619e00640 1 --2- 172.21.15.3:0/1681415435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c3495020 0x55d2c350de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:10.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.557+0000 7fd619400640 1 --2- 172.21.15.3:0/1681415435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c3489e40 0x55d2c3498570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:10.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.557+0000 7fd618a00640 1 --2- 172.21.15.3:0/1681415435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2c348a760 0x55d2c3498ab0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd600034e90 tx=0x7fd600011b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59a437d5720bc6c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:10.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.557+0000 7fd5faa00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:14:10.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.558+0000 7fd5faa00640 1 -- 172.21.15.3:0/1681415435 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd600039030 con 0x55d2c348a760 2024-09-19T06:14:10.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.558+0000 7fd61ea39740 1 -- 172.21.15.3:0/1681415435 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd608029070 con 0x55d2c348a760 2024-09-19T06:14:10.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.558+0000 7fd5faa00640 1 -- 172.21.15.3:0/1681415435 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fd60001c040 con 0x55d2c348a760 2024-09-19T06:14:10.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.558+0000 7fd5faa00640 1 -- 172.21.15.3:0/1681415435 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd600043050 con 0x55d2c348a760 2024-09-19T06:14:10.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.558+0000 7fd61ea39740 10 client.25690 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:10.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.558+0000 7fd61ea39740 1 -- 172.21.15.3:0/1681415435 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d2c350f6f0 con 0x55d2c348a760 2024-09-19T06:14:10.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.558+0000 7fd5faa00640 1 -- 172.21.15.3:0/1681415435 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd608029070 con 0x55d2c348a760 2024-09-19T06:14:10.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.559+0000 7fd5faa00640 1 -- 172.21.15.3:0/1681415435 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd600004930 con 0x55d2c348a760 2024-09-19T06:14:10.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.559+0000 7fd61ea39740 10 client.25690 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:10.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.559+0000 7fd61ea39740 10 client.25690 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:14:10.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.559+0000 7fd61ea39740 20 client.25690 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:10.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.559+0000 7fd61ea39740 1 --2- 172.21.15.3:0/1681415435 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55d2c350fe30 0x55d2c3512250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.559+0000 7fd61ea39740 4 client.25690 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:14:10.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.559+0000 7fd61ea39740 1 -- 172.21.15.3:0/1681415435 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d2c33f7e60 con 0x55d2c350fe30 2024-09-19T06:14:10.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.559+0000 7fd619400640 1 --2- 172.21.15.3:0/1681415435 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55d2c350fe30 0x55d2c3512250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.560+0000 7fd619400640 1 --2- 172.21.15.3:0/1681415435 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55d2c350fe30 0x55d2c3512250 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5a0f6e5fedf26aba server_cookie=de0f59648b31fa77 in_seq=0 out_seq=0 2024-09-19T06:14:10.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.560+0000 7fd5faa00640 10 client.25690 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:14:10.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.560+0000 7fd5faa00640 1 -- 172.21.15.3:0/1681415435 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d2c33f7e60 con 0x55d2c350fe30 2024-09-19T06:14:10.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.560+0000 7fd5faa00640 10 client.25690 handle_command_reply: tid=0 2024-09-19T06:14:10.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.560+0000 7fd61ea39740 1 client.25690 shutdown 2024-09-19T06:14:10.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.560+0000 7fd61ea39740 1 -- 172.21.15.3:0/1681415435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2c348a760 msgr2=0x55d2c3498ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:10.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.560+0000 7fd61ea39740 1 --2- 172.21.15.3:0/1681415435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2c348a760 0x55d2c3498ab0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd600034e90 tx=0x7fd600011b70 comp rx=0 tx=0).stop 2024-09-19T06:14:10.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.560+0000 7fd61ea39740 1 -- 172.21.15.3:0/1681415435 shutdown_connections 2024-09-19T06:14:10.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.560+0000 7fd61ea39740 1 --2- 172.21.15.3:0/1681415435 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55d2c350fe30 0x55d2c3512250 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.560+0000 7fd61ea39740 1 --2- 172.21.15.3:0/1681415435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d2c3495020 0x55d2c350de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.560+0000 7fd61ea39740 1 --2- 172.21.15.3:0/1681415435 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d2c348a760 0x55d2c3498ab0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.560+0000 7fd61ea39740 1 --2- 172.21.15.3:0/1681415435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d2c3489e40 0x55d2c3498570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.560+0000 7fd5faa00640 0 client.25690 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:14:10.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.560+0000 7fd61ea39740 1 -- 172.21.15.3:0/1681415435 >> 172.21.15.3:0/1681415435 conn(0x55d2c34863d0 msgr2=0x55d2c3484c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:10.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.560+0000 7fd61ea39740 1 -- 172.21.15.3:0/1681415435 shutdown_connections 2024-09-19T06:14:10.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.560+0000 7fd61ea39740 1 -- 172.21.15.3:0/1681415435 wait complete. 2024-09-19T06:14:10.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.560+0000 7fd61ea39740 20 client.25690 trim_cache size 0 max 16384 2024-09-19T06:14:10.567 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:14:10.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.561+0000 7fd61a800640 1 -- 172.21.15.3:0/2386822756 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd5fc0a3430 msgr2=0x7fd5fc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:10.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.561+0000 7fd61a800640 1 --2- 172.21.15.3:0/2386822756 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd5fc0a3430 0x7fd5fc0a58f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd600009fd0 tx=0x7fd600015040 comp rx=0 tx=0).stop 2024-09-19T06:14:10.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.561+0000 7fd61a800640 1 -- 172.21.15.3:0/2386822756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd614112870 msgr2=0x7fd61419e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:10.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.561+0000 7fd61a800640 1 --2- 172.21.15.3:0/2386822756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd614112870 0x7fd61419e6a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd61406b3d0 tx=0x7fd60c030ed0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.561+0000 7fd61a800640 1 -- 172.21.15.3:0/2386822756 shutdown_connections 2024-09-19T06:14:10.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.561+0000 7fd61a800640 1 --2- 172.21.15.3:0/2386822756 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd5fc0a3430 0x7fd5fc0a58f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.561+0000 7fd61a800640 1 --2- 172.21.15.3:0/2386822756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd614112870 0x7fd61419e6a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.561+0000 7fd61a800640 1 --2- 172.21.15.3:0/2386822756 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd614077040 0x7fd6141a4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.561+0000 7fd61a800640 1 --2- 172.21.15.3:0/2386822756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd614076720 0x7fd6141a45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.561+0000 7fd61a800640 1 -- 172.21.15.3:0/2386822756 >> 172.21.15.3:0/2386822756 conn(0x7fd6140ff8d0 msgr2=0x7fd614101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:10.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.561+0000 7fd61a800640 1 -- 172.21.15.3:0/2386822756 shutdown_connections 2024-09-19T06:14:10.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:10.561+0000 7fd61a800640 1 -- 172.21.15.3:0/2386822756 wait complete. 2024-09-19T06:14:10.936 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.934+0000 7fbb95000640 1 -- 172.21.15.3:0/393247910 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb90107ad0 msgr2=0x7fbb90107eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:10.937 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.934+0000 7fbb95000640 1 --2- 172.21.15.3:0/393247910 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb90107ad0 0x7fbb90107eb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009930 tx=0x7fbb8002a440 comp rx=0 tx=0).stop 2024-09-19T06:14:10.937 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.934+0000 7fbb95000640 1 -- 172.21.15.3:0/393247910 shutdown_connections 2024-09-19T06:14:10.937 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.934+0000 7fbb95000640 1 --2- 172.21.15.3:0/393247910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb90102460 0x7fbb9010e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.937 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.934+0000 7fbb95000640 1 --2- 172.21.15.3:0/393247910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb90101ac0 0x7fbb90101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.937 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.934+0000 7fbb95000640 1 --2- 172.21.15.3:0/393247910 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb90107ad0 0x7fbb90107eb0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.937 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.934+0000 7fbb95000640 1 -- 172.21.15.3:0/393247910 >> 172.21.15.3:0/393247910 conn(0x7fbb900fd7a0 msgr2=0x7fbb900ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:10.937 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.934+0000 7fbb95000640 1 -- 172.21.15.3:0/393247910 shutdown_connections 2024-09-19T06:14:10.937 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.934+0000 7fbb95000640 1 -- 172.21.15.3:0/393247910 wait complete. 2024-09-19T06:14:10.939 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.935+0000 7fbb95000640 1 Processor -- start 2024-09-19T06:14:10.940 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.935+0000 7fbb95000640 1 -- start start 2024-09-19T06:14:10.940 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.936+0000 7fbb95000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb90101ac0 0x7fbb900744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.940 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.936+0000 7fbb95000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb90102460 0x7fbb90074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.940 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.936+0000 7fbb95000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb90107ad0 0x7fbb90074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.940 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.936+0000 7fbb95000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbb90111f60 con 0x7fbb90102460 2024-09-19T06:14:10.940 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.936+0000 7fbb95000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbb90111de0 con 0x7fbb90101ac0 2024-09-19T06:14:10.940 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.936+0000 7fbb95000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbb901120e0 con 0x7fbb90107ad0 2024-09-19T06:14:10.940 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.936+0000 7fbb87e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb90102460 0x7fbb90074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.940 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.936+0000 7fbb8de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb90101ac0 0x7fbb900744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.940 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.936+0000 7fbb8de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb90101ac0 0x7fbb900744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:54502/0 (socket says 172.21.15.3:54502) 2024-09-19T06:14:10.941 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.936+0000 7fbb8de00640 1 -- 172.21.15.3:0/4161019146 learned_addr learned my addr 172.21.15.3:0/4161019146 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.936+0000 7fbb8e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb90107ad0 0x7fbb90074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.936+0000 7fbb87e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb90102460 0x7fbb90074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53606/0 (socket says 172.21.15.3:53606) 2024-09-19T06:14:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.936+0000 7fbb8e800640 1 -- 172.21.15.3:0/4161019146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb90101ac0 msgr2=0x7fbb900744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.936+0000 7fbb8e800640 1 --2- 172.21.15.3:0/4161019146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb90101ac0 0x7fbb900744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.936+0000 7fbb8e800640 1 -- 172.21.15.3:0/4161019146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb90102460 msgr2=0x7fbb90074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.936+0000 7fbb8e800640 1 --2- 172.21.15.3:0/4161019146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb90102460 0x7fbb90074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.936+0000 7fbb8e800640 1 -- 172.21.15.3:0/4161019146 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb901a6910 con 0x7fbb90107ad0 2024-09-19T06:14:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.936+0000 7fbb8de00640 1 --2- 172.21.15.3:0/4161019146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb90101ac0 0x7fbb900744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:10.942 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.936+0000 7fbb87e00640 1 --2- 172.21.15.3:0/4161019146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb90102460 0x7fbb90074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.937+0000 7fbb8e800640 1 --2- 172.21.15.3:0/4161019146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb90107ad0 0x7fbb90074f70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009fd0 tx=0x7fbb8800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.937+0000 7fbb86a00640 1 -- 172.21.15.3:0/4161019146 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8800ce20 con 0x7fbb90107ad0 2024-09-19T06:14:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.937+0000 7fbb86a00640 1 -- 172.21.15.3:0/4161019146 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb88005020 con 0x7fbb90107ad0 2024-09-19T06:14:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.937+0000 7fbb95000640 1 -- 172.21.15.3:0/4161019146 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb901a6c00 con 0x7fbb90107ad0 2024-09-19T06:14:10.943 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.937+0000 7fbb86a00640 1 -- 172.21.15.3:0/4161019146 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb88010720 con 0x7fbb90107ad0 2024-09-19T06:14:10.944 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.937+0000 7fbb95000640 1 -- 172.21.15.3:0/4161019146 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb901a7150 con 0x7fbb90107ad0 2024-09-19T06:14:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.941+0000 7fbb9807a740 1 Processor -- start 2024-09-19T06:14:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.941+0000 7fbb86a00640 1 -- 172.21.15.3:0/4161019146 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fbb88005540 con 0x7fbb90107ad0 2024-09-19T06:14:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.942+0000 7fbb9807a740 1 -- start start 2024-09-19T06:14:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.942+0000 7fbb9807a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b56939b1e0 0x55b56939b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.942+0000 7fbb9807a740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939bb00 0x55b5693a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.954 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.942+0000 7fbb9807a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5693a63a0 0x55b5693a8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.954 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.942+0000 7fbb9807a740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b569301100 con 0x55b56939bb00 2024-09-19T06:14:10.954 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.942+0000 7fbb9807a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b5692a91b0 con 0x55b5693a63a0 2024-09-19T06:14:10.954 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.942+0000 7fbb9807a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b5692fd0c0 con 0x55b56939b1e0 2024-09-19T06:14:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.942+0000 7fbb8de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939bb00 0x55b5693a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.942+0000 7fbb8de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939bb00 0x55b5693a5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53616/0 (socket says 172.21.15.3:53616) 2024-09-19T06:14:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.942+0000 7fbb8de00640 1 -- 172.21.15.3:0/2740425420 learned_addr learned my addr 172.21.15.3:0/2740425420 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.942+0000 7fbb87e00640 1 --2- 172.21.15.3:0/2740425420 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b56939b1e0 0x55b56939b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.955 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.942+0000 7fbb87e00640 1 --2- 172.21.15.3:0/2740425420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5693a63a0 0x55b5693a8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.943+0000 7fbb8de00640 1 -- 172.21.15.3:0/2740425420 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b56939b1e0 msgr2=0x55b56939b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.943+0000 7fbb8de00640 1 --2- 172.21.15.3:0/2740425420 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b56939b1e0 0x55b56939b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.943+0000 7fbb8de00640 1 -- 172.21.15.3:0/2740425420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5693a63a0 msgr2=0x55b5693a8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:10.956 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.943+0000 7fbb8de00640 1 --2- 172.21.15.3:0/2740425420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5693a63a0 0x55b5693a8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.957 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.943+0000 7fbb8de00640 1 -- 172.21.15.3:0/2740425420 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b569014210 con 0x55b56939bb00 2024-09-19T06:14:10.957 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.943+0000 7fbb8de00640 1 --2- 172.21.15.3:0/2740425420 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939bb00 0x55b5693a5e60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbb80005e10 tx=0x7fbb80005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b483139340eae97d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.943+0000 7fbb86a00640 1 --2- 172.21.15.3:0/4161019146 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbb740a33b0 0x7fbb740a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.943+0000 7fbb7f400640 1 -- 172.21.15.3:0/2740425420 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb80040070 con 0x55b56939bb00 2024-09-19T06:14:10.961 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.943+0000 7fbb7f400640 1 -- 172.21.15.3:0/2740425420 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb80004760 con 0x55b56939bb00 2024-09-19T06:14:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.943+0000 7fbb86a00640 1 -- 172.21.15.3:0/4161019146 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fbb880d0310 con 0x7fbb90107ad0 2024-09-19T06:14:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.943+0000 7fbb7f400640 1 -- 172.21.15.3:0/2740425420 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb80035040 con 0x55b56939bb00 2024-09-19T06:14:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.943+0000 7fbb87e00640 1 --2- 172.21.15.3:0/4161019146 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbb740a33b0 0x7fbb740a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.944+0000 7fbb9807a740 1 -- 172.21.15.3:0/2740425420 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939bb00 msgr2=0x55b5693a5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:10.962 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.944+0000 7fbb9807a740 1 --2- 172.21.15.3:0/2740425420 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939bb00 0x55b5693a5e60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbb80005e10 tx=0x7fbb80005e40 comp rx=0 tx=0).stop 2024-09-19T06:14:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.944+0000 7fbb9807a740 1 -- 172.21.15.3:0/2740425420 shutdown_connections 2024-09-19T06:14:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.944+0000 7fbb9807a740 1 --2- 172.21.15.3:0/2740425420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5693a63a0 0x55b5693a8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.944+0000 7fbb9807a740 1 --2- 172.21.15.3:0/2740425420 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939bb00 0x55b5693a5e60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.944+0000 7fbb9807a740 1 --2- 172.21.15.3:0/2740425420 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b56939b1e0 0x55b56939b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.963 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.944+0000 7fbb9807a740 1 -- 172.21.15.3:0/2740425420 >> 172.21.15.3:0/2740425420 conn(0x55b569397750 msgr2=0x55b569397b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:10.964 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.944+0000 7fbb87e00640 1 --2- 172.21.15.3:0/4161019146 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbb740a33b0 0x7fbb740a5870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55b569398ad0 tx=0x7fbb78013040 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:10.964 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.944+0000 7fbb9807a740 1 -- 172.21.15.3:0/2740425420 shutdown_connections 2024-09-19T06:14:10.964 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.944+0000 7fbb9807a740 1 -- 172.21.15.3:0/2740425420 wait complete. 2024-09-19T06:14:10.964 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.945+0000 7fbb9807a740 1 -- start start 2024-09-19T06:14:10.964 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.945+0000 7fbb9807a740 1 Processor -- start 2024-09-19T06:14:10.965 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.945+0000 7fbb9807a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b56939b1e0 0x55b5693a32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.965 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.945+0000 7fbb9807a740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939bb00 0x55b5693a3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.965 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.945+0000 7fbb9807a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5693a63a0 0x55b5693a3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.965 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.945+0000 7fbb9807a740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b5693a8fc0 con 0x55b56939bb00 2024-09-19T06:14:10.966 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.945+0000 7fbb9807a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b56928a090 con 0x55b5693a63a0 2024-09-19T06:14:10.966 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.945+0000 7fbb9807a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b5693a9140 con 0x55b56939b1e0 2024-09-19T06:14:10.966 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.945+0000 7fbb9807a740 10 client.0 _ll_register_callbacks cb 0x55b5692def30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:10.966 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.946+0000 7fbb87e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939bb00 0x55b5693a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.967 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.946+0000 7fbb8e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5693a63a0 0x55b5693a3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.967 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.946+0000 7fbb87e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939bb00 0x55b5693a3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53630/0 (socket says 172.21.15.3:53630) 2024-09-19T06:14:10.967 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.946+0000 7fbb87e00640 1 -- 172.21.15.3:0/207187992 learned_addr learned my addr 172.21.15.3:0/207187992 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:10.967 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.946+0000 7fbb8de00640 1 --2- 172.21.15.3:0/207187992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b56939b1e0 0x55b5693a32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.967 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.946+0000 7fbb8e800640 1 -- 172.21.15.3:0/207187992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b56939b1e0 msgr2=0x55b5693a32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:10.968 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.946+0000 7fbb8e800640 1 --2- 172.21.15.3:0/207187992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b56939b1e0 0x55b5693a32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.968 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.946+0000 7fbb8e800640 1 -- 172.21.15.3:0/207187992 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939bb00 msgr2=0x55b5693a3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:10.968 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.946+0000 7fbb8e800640 1 --2- 172.21.15.3:0/207187992 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939bb00 0x55b5693a3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.968 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.946+0000 7fbb8e800640 1 -- 172.21.15.3:0/207187992 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5690e0620 con 0x55b5693a63a0 2024-09-19T06:14:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.946+0000 7fbb87e00640 1 --2- 172.21.15.3:0/207187992 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939bb00 0x55b5693a3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.946+0000 7fbb8e800640 1 --2- 172.21.15.3:0/207187992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5693a63a0 0x55b5693a3d40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbb880cda60 tx=0x7fbb8809cdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53c851b339b7d4ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.946+0000 7fbb73e00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:14:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.946+0000 7fbb73e00640 1 -- 172.21.15.3:0/207187992 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb880a5260 con 0x55b5693a63a0 2024-09-19T06:14:10.969 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.947+0000 7fbb9807a740 1 -- 172.21.15.3:0/207187992 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb80004760 con 0x55b5693a63a0 2024-09-19T06:14:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.947+0000 7fbb73e00640 1 -- 172.21.15.3:0/207187992 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fbb880a4dd0 con 0x55b5693a63a0 2024-09-19T06:14:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.947+0000 7fbb73e00640 1 -- 172.21.15.3:0/207187992 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbb880a4fd0 con 0x55b5693a63a0 2024-09-19T06:14:10.970 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.947+0000 7fbb9807a740 10 client.25703 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.947+0000 7fbb9807a740 1 -- 172.21.15.3:0/207187992 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b5693b4c30 con 0x55b5693a63a0 2024-09-19T06:14:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.947+0000 7fbb73e00640 1 -- 172.21.15.3:0/207187992 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb80004760 con 0x55b5693a63a0 2024-09-19T06:14:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.947+0000 7fbb73e00640 1 -- 172.21.15.3:0/207187992 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fbb880983d0 con 0x55b5693a63a0 2024-09-19T06:14:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.947+0000 7fbb9807a740 10 client.25703 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:10.971 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.947+0000 7fbb9807a740 10 client.25703 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:14:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.947+0000 7fbb9807a740 20 client.25703 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.947+0000 7fbb9807a740 1 --2- 172.21.15.3:0/207187992 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b5693b60f0 0x55b5693b84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.947+0000 7fbb9807a740 4 client.25703 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:14:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.947+0000 7fbb9807a740 1 -- 172.21.15.3:0/207187992 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b56930e830 con 0x55b5693b60f0 2024-09-19T06:14:10.972 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.948+0000 7fbb8de00640 1 --2- 172.21.15.3:0/207187992 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b5693b60f0 0x55b5693b84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.948+0000 7fbb8de00640 1 --2- 172.21.15.3:0/207187992 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b5693b60f0 0x55b5693b84e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a026cca025f8f31 server_cookie=ebbbcb153d3b093 in_seq=0 out_seq=0 2024-09-19T06:14:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.948+0000 7fbb73e00640 10 client.25703 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.949+0000 7fbb73e00640 1 -- 172.21.15.3:0/207187992 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b56930e830 con 0x55b5693b60f0 2024-09-19T06:14:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.949+0000 7fbb73e00640 10 client.25703 handle_command_reply: tid=0 2024-09-19T06:14:10.973 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.949+0000 7fbb9807a740 1 client.25703 shutdown 2024-09-19T06:14:10.974 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.949+0000 7fbb9807a740 1 -- 172.21.15.3:0/207187992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5693a63a0 msgr2=0x55b5693a3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:10.974 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.949+0000 7fbb9807a740 1 --2- 172.21.15.3:0/207187992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5693a63a0 0x55b5693a3d40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbb880cda60 tx=0x7fbb8809cdb0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.974 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.949+0000 7fbb9807a740 1 -- 172.21.15.3:0/207187992 shutdown_connections 2024-09-19T06:14:10.975 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.949+0000 7fbb9807a740 1 --2- 172.21.15.3:0/207187992 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b5693b60f0 0x55b5693b84e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.975 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.949+0000 7fbb9807a740 1 --2- 172.21.15.3:0/207187992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5693a63a0 0x55b5693a3d40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.975 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.949+0000 7fbb73e00640 0 client.25703 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:10.975 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.949+0000 7fbb9807a740 1 --2- 172.21.15.3:0/207187992 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939bb00 0x55b5693a3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.975 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.949+0000 7fbb9807a740 1 --2- 172.21.15.3:0/207187992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b56939b1e0 0x55b5693a32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.976 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.949+0000 7fbb9807a740 1 -- 172.21.15.3:0/207187992 >> 172.21.15.3:0/207187992 conn(0x55b569397750 msgr2=0x55b56939d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:10.976 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.950+0000 7fbb9807a740 1 -- 172.21.15.3:0/207187992 shutdown_connections 2024-09-19T06:14:10.976 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.950+0000 7fbb9807a740 1 -- 172.21.15.3:0/207187992 wait complete. 2024-09-19T06:14:10.976 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.950+0000 7fbb9807a740 20 client.25703 trim_cache size 0 max 16384 2024-09-19T06:14:10.984 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.965+0000 7fbb9807a740 1 Processor -- start 2024-09-19T06:14:10.985 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.965+0000 7fbb9807a740 1 -- start start 2024-09-19T06:14:10.985 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.965+0000 7fbb9807a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b56939b1e0 0x55b56939dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.985 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.965+0000 7fbb9807a740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939bb00 0x55b5693bddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.985 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.965+0000 7fbb9807a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5693a63a0 0x55b5693be330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.985 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.965+0000 7fbb9807a740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbb901afa80 con 0x55b56939bb00 2024-09-19T06:14:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.965+0000 7fbb9807a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbb901b15c0 con 0x55b56939b1e0 2024-09-19T06:14:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.965+0000 7fbb9807a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbb901b0150 con 0x55b5693a63a0 2024-09-19T06:14:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.966+0000 7fbb8de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b56939b1e0 0x55b56939dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.966+0000 7fbb87e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939bb00 0x55b5693bddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.966+0000 7fbb8de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b56939b1e0 0x55b56939dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:54540/0 (socket says 172.21.15.3:54540) 2024-09-19T06:14:10.986 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.966+0000 7fbb8de00640 1 -- 172.21.15.3:0/4019289363 learned_addr learned my addr 172.21.15.3:0/4019289363 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:10.987 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.966+0000 7fbb8e800640 1 --2- 172.21.15.3:0/4019289363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5693a63a0 0x55b5693be330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.987 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.966+0000 7fbb8de00640 1 -- 172.21.15.3:0/4019289363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5693a63a0 msgr2=0x55b5693be330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:10.987 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.966+0000 7fbb8de00640 1 --2- 172.21.15.3:0/4019289363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5693a63a0 0x55b5693be330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.987 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.966+0000 7fbb8de00640 1 -- 172.21.15.3:0/4019289363 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939bb00 msgr2=0x55b5693bddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:10.987 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.966+0000 7fbb8de00640 1 --2- 172.21.15.3:0/4019289363 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939bb00 0x55b5693bddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.966+0000 7fbb8de00640 1 -- 172.21.15.3:0/4019289363 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b569392d60 con 0x55b56939b1e0 2024-09-19T06:14:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.966+0000 7fbb8e800640 1 --2- 172.21.15.3:0/4019289363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5693a63a0 0x55b5693be330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.966+0000 7fbb87e00640 1 --2- 172.21.15.3:0/4019289363 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939bb00 0x55b5693bddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.966+0000 7fbb8de00640 1 --2- 172.21.15.3:0/4019289363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b56939b1e0 0x55b56939dc50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbb80005e80 tx=0x7fbb80004de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fff7fa51e2e0fd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.966+0000 7fbb7ea00640 1 -- 172.21.15.3:0/4019289363 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb80040040 con 0x55b56939b1e0 2024-09-19T06:14:10.988 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.966+0000 7fbb7ea00640 1 -- 172.21.15.3:0/4019289363 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb80004b90 con 0x55b56939b1e0 2024-09-19T06:14:10.989 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.967+0000 7fbb7ea00640 1 -- 172.21.15.3:0/4019289363 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb80035040 con 0x55b56939b1e0 2024-09-19T06:14:10.989 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.967+0000 7fbb9807a740 1 -- 172.21.15.3:0/4019289363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b56939b1e0 msgr2=0x55b56939dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:10.989 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.967+0000 7fbb9807a740 1 --2- 172.21.15.3:0/4019289363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b56939b1e0 0x55b56939dc50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbb80005e80 tx=0x7fbb80004de0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.989 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.967+0000 7fbb9807a740 1 -- 172.21.15.3:0/4019289363 shutdown_connections 2024-09-19T06:14:10.989 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.967+0000 7fbb9807a740 1 --2- 172.21.15.3:0/4019289363 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b5693a63a0 0x55b5693be330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.989 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.967+0000 7fbb9807a740 1 --2- 172.21.15.3:0/4019289363 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939bb00 0x55b5693bddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.990 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.967+0000 7fbb9807a740 1 --2- 172.21.15.3:0/4019289363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b56939b1e0 0x55b56939dc50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.990 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.967+0000 7fbb9807a740 1 -- 172.21.15.3:0/4019289363 >> 172.21.15.3:0/4019289363 conn(0x55b569397750 msgr2=0x55b5693a5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:10.990 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.967+0000 7fbb9807a740 1 -- 172.21.15.3:0/4019289363 shutdown_connections 2024-09-19T06:14:10.990 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.967+0000 7fbb9807a740 1 -- 172.21.15.3:0/4019289363 wait complete. 2024-09-19T06:14:10.990 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.968+0000 7fbb9807a740 1 -- start start 2024-09-19T06:14:10.990 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.968+0000 7fbb9807a740 1 Processor -- start 2024-09-19T06:14:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.968+0000 7fbb9807a740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939b1e0 0x55b5693ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.968+0000 7fbb9807a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b56939bb00 0x55b5693aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.968+0000 7fbb9807a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5693a63a0 0x55b56939fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.991 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.968+0000 7fbb9807a740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbb901b0ef0 con 0x55b56939b1e0 2024-09-19T06:14:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.968+0000 7fbb9807a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbb901b0820 con 0x55b5693a63a0 2024-09-19T06:14:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.968+0000 7fbb9807a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbb901ada60 con 0x55b56939bb00 2024-09-19T06:14:10.992 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.968+0000 7fbb9807a740 10 client.0 _ll_register_callbacks cb 0x7fbb8809c1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:10.993 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.968+0000 7fbb8de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939b1e0 0x55b5693ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.993 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.969+0000 7fbb8de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939b1e0 0x55b5693ae610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53652/0 (socket says 172.21.15.3:53652) 2024-09-19T06:14:10.993 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.969+0000 7fbb8de00640 1 -- 172.21.15.3:0/171460001 learned_addr learned my addr 172.21.15.3:0/171460001 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:10.993 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.969+0000 7fbb8e800640 1 --2- 172.21.15.3:0/171460001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5693a63a0 0x55b56939fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.993 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.969+0000 7fbb87e00640 1 --2- 172.21.15.3:0/171460001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b56939bb00 0x55b5693aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.993 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.969+0000 7fbb8de00640 1 -- 172.21.15.3:0/171460001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b56939bb00 msgr2=0x55b5693aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:10.994 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.969+0000 7fbb8de00640 1 --2- 172.21.15.3:0/171460001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b56939bb00 0x55b5693aeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.994 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.969+0000 7fbb8de00640 1 -- 172.21.15.3:0/171460001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5693a63a0 msgr2=0x55b56939fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:10.994 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.969+0000 7fbb8de00640 1 --2- 172.21.15.3:0/171460001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5693a63a0 0x55b56939fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.969+0000 7fbb8de00640 1 -- 172.21.15.3:0/171460001 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5693a03a0 con 0x55b56939b1e0 2024-09-19T06:14:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.969+0000 7fbb8e800640 1 --2- 172.21.15.3:0/171460001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5693a63a0 0x55b56939fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.969+0000 7fbb8de00640 1 --2- 172.21.15.3:0/171460001 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939b1e0 0x55b5693ae610 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbb80006010 tx=0x7fbb80000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac3412966cce5da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.969+0000 7fbb73e00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:14:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.969+0000 7fbb73e00640 1 -- 172.21.15.3:0/171460001 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb80040070 con 0x55b56939b1e0 2024-09-19T06:14:10.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.969+0000 7fbb73e00640 1 -- 172.21.15.3:0/171460001 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fbb80031890 con 0x55b56939b1e0 2024-09-19T06:14:10.996 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.969+0000 7fbb9807a740 1 -- 172.21.15.3:0/171460001 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb80004b90 con 0x55b56939b1e0 2024-09-19T06:14:10.996 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.970+0000 7fbb73e00640 1 -- 172.21.15.3:0/171460001 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbb80031a90 con 0x55b56939b1e0 2024-09-19T06:14:10.996 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.970+0000 7fbb9807a740 10 client.15657 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:10.996 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.970+0000 7fbb9807a740 1 -- 172.21.15.3:0/171460001 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b569420950 con 0x55b56939b1e0 2024-09-19T06:14:10.996 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.970+0000 7fbb73e00640 1 -- 172.21.15.3:0/171460001 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb80004b90 con 0x55b56939b1e0 2024-09-19T06:14:10.996 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.970+0000 7fbb73e00640 1 -- 172.21.15.3:0/171460001 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fbb800037b0 con 0x55b56939b1e0 2024-09-19T06:14:10.997 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.970+0000 7fbb9807a740 10 client.15657 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:10.997 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.970+0000 7fbb9807a740 10 client.15657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:14:10.997 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.970+0000 7fbb9807a740 20 client.15657 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:10.997 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.970+0000 7fbb9807a740 1 --2- 172.21.15.3:0/171460001 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b569420b80 0x55b569422f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:10.997 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.970+0000 7fbb9807a740 4 client.15657 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:14:10.997 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.970+0000 7fbb9807a740 1 -- 172.21.15.3:0/171460001 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b569308b80 con 0x55b569420b80 2024-09-19T06:14:10.998 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.971+0000 7fbb87e00640 1 --2- 172.21.15.3:0/171460001 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b569420b80 0x55b569422f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:10.998 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.971+0000 7fbb87e00640 1 --2- 172.21.15.3:0/171460001 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b569420b80 0x55b569422f70 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2e18a701f0d1fa5 server_cookie=e4a7cb43f587857 in_seq=0 out_seq=0 2024-09-19T06:14:10.998 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.971+0000 7fbb73e00640 10 client.15657 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.985+0000 7fbb73e00640 1 -- 172.21.15.3:0/171460001 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b569308b80 con 0x55b569420b80 2024-09-19T06:14:11.000 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.985+0000 7fbb73e00640 10 client.15657 handle_command_reply: tid=0 2024-09-19T06:14:11.001 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.985+0000 7fbb9807a740 1 client.15657 shutdown 2024-09-19T06:14:11.001 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.985+0000 7fbb9807a740 1 -- 172.21.15.3:0/171460001 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939b1e0 msgr2=0x55b5693ae610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:11.001 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.985+0000 7fbb9807a740 1 --2- 172.21.15.3:0/171460001 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939b1e0 0x55b5693ae610 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbb80006010 tx=0x7fbb80000bc0 comp rx=0 tx=0).stop 2024-09-19T06:14:11.001 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.986+0000 7fbb9807a740 1 -- 172.21.15.3:0/171460001 shutdown_connections 2024-09-19T06:14:11.001 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.986+0000 7fbb9807a740 1 --2- 172.21.15.3:0/171460001 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b569420b80 0x55b569422f70 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:11.001 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.986+0000 7fbb9807a740 1 --2- 172.21.15.3:0/171460001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5693a63a0 0x55b56939fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:11.002 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.986+0000 7fbb9807a740 1 --2- 172.21.15.3:0/171460001 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b56939bb00 0x55b5693aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:11.002 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.986+0000 7fbb9807a740 1 --2- 172.21.15.3:0/171460001 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b56939b1e0 0x55b5693ae610 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:11.002 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.986+0000 7fbb73e00640 0 client.15657 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:11.002 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.986+0000 7fbb9807a740 1 -- 172.21.15.3:0/171460001 >> 172.21.15.3:0/171460001 conn(0x55b569397750 msgr2=0x55b569396010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:11.002 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.986+0000 7fbb9807a740 1 -- 172.21.15.3:0/171460001 shutdown_connections 2024-09-19T06:14:11.002 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.986+0000 7fbb9807a740 1 -- 172.21.15.3:0/171460001 wait complete. 2024-09-19T06:14:11.003 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.986+0000 7fbb9807a740 20 client.15657 trim_cache size 0 max 16384 2024-09-19T06:14:11.003 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:14:11.003 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:14:11.003 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:14:11.004 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:14:11.004 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.986+0000 7fbb95000640 1 -- 172.21.15.3:0/4161019146 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbb740a33b0 msgr2=0x7fbb740a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:11.005 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.986+0000 7fbb95000640 1 --2- 172.21.15.3:0/4161019146 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbb740a33b0 0x7fbb740a5870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55b569398ad0 tx=0x7fbb78013040 comp rx=0 tx=0).stop 2024-09-19T06:14:11.005 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.986+0000 7fbb95000640 1 -- 172.21.15.3:0/4161019146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb90107ad0 msgr2=0x7fbb90074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:11.005 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.986+0000 7fbb95000640 1 --2- 172.21.15.3:0/4161019146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb90107ad0 0x7fbb90074f70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009fd0 tx=0x7fbb8800ef10 comp rx=0 tx=0).stop 2024-09-19T06:14:11.005 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.987+0000 7fbb95000640 1 -- 172.21.15.3:0/4161019146 shutdown_connections 2024-09-19T06:14:11.005 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.987+0000 7fbb95000640 1 --2- 172.21.15.3:0/4161019146 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbb740a33b0 0x7fbb740a5870 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:11.005 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.987+0000 7fbb95000640 1 --2- 172.21.15.3:0/4161019146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbb90107ad0 0x7fbb90074f70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:11.006 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.987+0000 7fbb95000640 1 --2- 172.21.15.3:0/4161019146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbb90102460 0x7fbb90074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:11.006 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.987+0000 7fbb95000640 1 --2- 172.21.15.3:0/4161019146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb90101ac0 0x7fbb900744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:11.006 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.987+0000 7fbb95000640 1 -- 172.21.15.3:0/4161019146 >> 172.21.15.3:0/4161019146 conn(0x7fbb900fd7a0 msgr2=0x7fbb900fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:11.006 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.987+0000 7fbb95000640 1 -- 172.21.15.3:0/4161019146 shutdown_connections 2024-09-19T06:14:11.006 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:10.987+0000 7fbb95000640 1 -- 172.21.15.3:0/4161019146 wait complete. 2024-09-19T06:14:11.388 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:14:11.765 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:12.129 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:11 smithi003 ceph-mon[30893]: pgmap v57: 97 pgs: 97 active+clean; 1.7 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 48 KiB/s wr, 33 op/s 2024-09-19T06:14:12.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:11 smithi059 ceph-mon[35138]: pgmap v57: 97 pgs: 97 active+clean; 1.7 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 48 KiB/s wr, 33 op/s 2024-09-19T06:14:12.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:11 smithi071 ceph-mon[35662]: pgmap v57: 97 pgs: 97 active+clean; 1.7 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 48 KiB/s wr, 33 op/s 2024-09-19T06:14:12.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.350+0000 7f8f79000640 1 -- 172.21.15.3:0/696258721 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f7410e260 msgr2=0x7f8f74110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:12.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.350+0000 7f8f79000640 1 --2- 172.21.15.3:0/696258721 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f7410e260 0x7f8f74110650 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c009ca0 tx=0x7f8f6c02a950 comp rx=0 tx=0).stop 2024-09-19T06:14:12.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.350+0000 7f8f79000640 1 -- 172.21.15.3:0/696258721 shutdown_connections 2024-09-19T06:14:12.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.350+0000 7f8f79000640 1 --2- 172.21.15.3:0/696258721 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f7410e260 0x7f8f74110650 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.350+0000 7f8f79000640 1 --2- 172.21.15.3:0/696258721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f74074ee0 0x7f8f7410dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.350+0000 7f8f79000640 1 --2- 172.21.15.3:0/696258721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f740745c0 0x7f8f740749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.350+0000 7f8f79000640 1 -- 172.21.15.3:0/696258721 >> 172.21.15.3:0/696258721 conn(0x7f8f740fd6e0 msgr2=0x7f8f740ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:12.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.350+0000 7f8f79000640 1 -- 172.21.15.3:0/696258721 shutdown_connections 2024-09-19T06:14:12.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.350+0000 7f8f79000640 1 -- 172.21.15.3:0/696258721 wait complete. 2024-09-19T06:14:12.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.351+0000 7f8f79000640 1 Processor -- start 2024-09-19T06:14:12.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.351+0000 7f8f79000640 1 -- start start 2024-09-19T06:14:12.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.352+0000 7f8f79000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f740745c0 0x7f8f7419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:12.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.352+0000 7f8f79000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f74074ee0 0x7f8f7419a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:12.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.352+0000 7f8f79000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f7410e260 0x7f8f7419ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:12.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.352+0000 7f8f79000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8f74113fb0 con 0x7f8f740745c0 2024-09-19T06:14:12.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.352+0000 7f8f79000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8f74113e30 con 0x7f8f74074ee0 2024-09-19T06:14:12.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.352+0000 7f8f79000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8f74114130 con 0x7f8f7410e260 2024-09-19T06:14:12.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.352+0000 7f8f73400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f740745c0 0x7f8f7419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:12.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.352+0000 7f8f73400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f740745c0 0x7f8f7419a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53680/0 (socket says 172.21.15.3:53680) 2024-09-19T06:14:12.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.352+0000 7f8f73400640 1 -- 172.21.15.3:0/1108950156 learned_addr learned my addr 172.21.15.3:0/1108950156 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:12.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.352+0000 7f8f6aa00640 1 --2- 172.21.15.3:0/1108950156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f74074ee0 0x7f8f7419a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:12.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.352+0000 7f8f73e00640 1 --2- 172.21.15.3:0/1108950156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f7410e260 0x7f8f7419ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:12.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.353+0000 7f8f73400640 1 -- 172.21.15.3:0/1108950156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f7410e260 msgr2=0x7f8f7419ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:12.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.353+0000 7f8f73400640 1 --2- 172.21.15.3:0/1108950156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f7410e260 0x7f8f7419ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.353+0000 7f8f73400640 1 -- 172.21.15.3:0/1108950156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f74074ee0 msgr2=0x7f8f7419a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:12.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.353+0000 7f8f73400640 1 --2- 172.21.15.3:0/1108950156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f74074ee0 0x7f8f7419a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.353+0000 7f8f73400640 1 -- 172.21.15.3:0/1108950156 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f7419f3e0 con 0x7f8f740745c0 2024-09-19T06:14:12.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.353+0000 7f8f73400640 1 --2- 172.21.15.3:0/1108950156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f740745c0 0x7f8f7419a430 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8f6400e9f0 tx=0x7f8f6400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:12.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.353+0000 7f8f70c00640 1 -- 172.21.15.3:0/1108950156 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6400cd80 con 0x7f8f740745c0 2024-09-19T06:14:12.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.353+0000 7f8f70c00640 1 -- 172.21.15.3:0/1108950156 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f64005500 con 0x7f8f740745c0 2024-09-19T06:14:12.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.353+0000 7f8f70c00640 1 -- 172.21.15.3:0/1108950156 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f64010690 con 0x7f8f740745c0 2024-09-19T06:14:12.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.353+0000 7f8f79000640 1 -- 172.21.15.3:0/1108950156 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f7419f6d0 con 0x7f8f740745c0 2024-09-19T06:14:12.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.353+0000 7f8f79000640 1 -- 172.21.15.3:0/1108950156 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f741a6fb0 con 0x7f8f740745c0 2024-09-19T06:14:12.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.357+0000 7f8f7d07f740 1 Processor -- start 2024-09-19T06:14:12.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.358+0000 7f8f7d07f740 1 -- start start 2024-09-19T06:14:12.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.358+0000 7f8f70c00640 1 -- 172.21.15.3:0/1108950156 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f8f640046c0 con 0x7f8f740745c0 2024-09-19T06:14:12.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.358+0000 7f8f7d07f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605ffd82e40 0x5605ffd83220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:12.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.358+0000 7f8f7d07f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605ffd83760 0x5605ffd8dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:12.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.358+0000 7f8f7d07f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd8e020 0x5605ffd90410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:12.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.358+0000 7f8f7d07f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5605ffce93e0 con 0x5605ffd8e020 2024-09-19T06:14:12.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.358+0000 7f8f7d07f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5605ffc90d80 con 0x5605ffd82e40 2024-09-19T06:14:12.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.358+0000 7f8f7d07f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5605ffce53a0 con 0x5605ffd83760 2024-09-19T06:14:12.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.358+0000 7f8f73400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605ffd83760 0x5605ffd8dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:12.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.358+0000 7f8f6aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd8e020 0x5605ffd90410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:12.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.358+0000 7f8f6aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd8e020 0x5605ffd90410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53690/0 (socket says 172.21.15.3:53690) 2024-09-19T06:14:12.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.359+0000 7f8f73e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605ffd82e40 0x5605ffd83220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:12.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.359+0000 7f8f6aa00640 1 -- 172.21.15.3:0/1187330309 learned_addr learned my addr 172.21.15.3:0/1187330309 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:12.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.359+0000 7f8f6aa00640 1 -- 172.21.15.3:0/1187330309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605ffd83760 msgr2=0x5605ffd8dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:12.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.359+0000 7f8f6aa00640 1 --2- 172.21.15.3:0/1187330309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605ffd83760 0x5605ffd8dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.359+0000 7f8f6aa00640 1 -- 172.21.15.3:0/1187330309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605ffd82e40 msgr2=0x5605ffd83220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:12.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.359+0000 7f8f6aa00640 1 --2- 172.21.15.3:0/1187330309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605ffd82e40 0x5605ffd83220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.359+0000 7f8f6aa00640 1 -- 172.21.15.3:0/1187330309 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605ffcafae0 con 0x5605ffd8e020 2024-09-19T06:14:12.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.359+0000 7f8f6aa00640 1 --2- 172.21.15.3:0/1187330309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd8e020 0x5605ffd90410 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c009c10 tx=0x7f8f5c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226394d6e5f37013 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:12.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.360+0000 7f8f68c00640 1 -- 172.21.15.3:0/1187330309 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c004230 con 0x5605ffd8e020 2024-09-19T06:14:12.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.360+0000 7f8f68c00640 1 -- 172.21.15.3:0/1187330309 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f5c0043d0 con 0x5605ffd8e020 2024-09-19T06:14:12.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.360+0000 7f8f68c00640 1 -- 172.21.15.3:0/1187330309 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c004e00 con 0x5605ffd8e020 2024-09-19T06:14:12.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.360+0000 7f8f70c00640 1 --2- 172.21.15.3:0/1108950156 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8f580a3430 0x7f8f580a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:12.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.360+0000 7f8f70c00640 1 -- 172.21.15.3:0/1108950156 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f8f640d00a0 con 0x7f8f740745c0 2024-09-19T06:14:12.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.360+0000 7f8f73e00640 1 --2- 172.21.15.3:0/1108950156 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8f580a3430 0x7f8f580a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:12.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.360+0000 7f8f7d07f740 1 -- 172.21.15.3:0/1187330309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd8e020 msgr2=0x5605ffd90410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:12.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.360+0000 7f8f7d07f740 1 --2- 172.21.15.3:0/1187330309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd8e020 0x5605ffd90410 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c009c10 tx=0x7f8f5c011810 comp rx=0 tx=0).stop 2024-09-19T06:14:12.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.360+0000 7f8f7d07f740 1 -- 172.21.15.3:0/1187330309 shutdown_connections 2024-09-19T06:14:12.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.360+0000 7f8f7d07f740 1 --2- 172.21.15.3:0/1187330309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd8e020 0x5605ffd90410 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.360+0000 7f8f7d07f740 1 --2- 172.21.15.3:0/1187330309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605ffd83760 0x5605ffd8dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.360+0000 7f8f7d07f740 1 --2- 172.21.15.3:0/1187330309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605ffd82e40 0x5605ffd83220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.360+0000 7f8f7d07f740 1 -- 172.21.15.3:0/1187330309 >> 172.21.15.3:0/1187330309 conn(0x5605ffd7f3d0 msgr2=0x5605ffd7f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:12.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.361+0000 7f8f7d07f740 1 -- 172.21.15.3:0/1187330309 shutdown_connections 2024-09-19T06:14:12.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.361+0000 7f8f7d07f740 1 -- 172.21.15.3:0/1187330309 wait complete. 2024-09-19T06:14:12.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.361+0000 7f8f73e00640 1 --2- 172.21.15.3:0/1108950156 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8f580a3430 0x7f8f580a58f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c005e30 tx=0x7f8f6c005c50 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:12.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.361+0000 7f8f7d07f740 1 -- start start 2024-09-19T06:14:12.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.361+0000 7f8f7d07f740 1 Processor -- start 2024-09-19T06:14:12.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.362+0000 7f8f7d07f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605ffd82e40 0x5605ffd8aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:12.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.362+0000 7f8f7d07f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605ffd83760 0x5605ffd8b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:12.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.362+0000 7f8f7d07f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd8e020 0x5605ffd8b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:12.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.362+0000 7f8f7d07f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5605ffd90bf0 con 0x5605ffd8e020 2024-09-19T06:14:12.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.362+0000 7f8f7d07f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5605ffca40f0 con 0x5605ffd83760 2024-09-19T06:14:12.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.362+0000 7f8f7d07f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5605ffd90d70 con 0x5605ffd82e40 2024-09-19T06:14:12.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.362+0000 7f8f7d07f740 10 client.0 _ll_register_callbacks cb 0x5605ffc8bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:12.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.362+0000 7f8f73e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd8e020 0x5605ffd8b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:12.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.362+0000 7f8f73400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605ffd82e40 0x5605ffd8aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:12.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.362+0000 7f8f73e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd8e020 0x5605ffd8b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53700/0 (socket says 172.21.15.3:53700) 2024-09-19T06:14:12.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.362+0000 7f8f73e00640 1 -- 172.21.15.3:0/2946808880 learned_addr learned my addr 172.21.15.3:0/2946808880 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:12.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.362+0000 7f8f6aa00640 1 --2- 172.21.15.3:0/2946808880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605ffd83760 0x5605ffd8b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:12.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.363+0000 7f8f73400640 1 -- 172.21.15.3:0/2946808880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605ffd83760 msgr2=0x5605ffd8b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:12.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.363+0000 7f8f73400640 1 --2- 172.21.15.3:0/2946808880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605ffd83760 0x5605ffd8b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.363+0000 7f8f73400640 1 -- 172.21.15.3:0/2946808880 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd8e020 msgr2=0x5605ffd8b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:12.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.363+0000 7f8f73400640 1 --2- 172.21.15.3:0/2946808880 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd8e020 0x5605ffd8b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.363+0000 7f8f73400640 1 -- 172.21.15.3:0/2946808880 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605ffa5a3c0 con 0x5605ffd82e40 2024-09-19T06:14:12.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.363+0000 7f8f73400640 1 --2- 172.21.15.3:0/2946808880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605ffd82e40 0x5605ffd8aed0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8f640cd7c0 tx=0x7f8f640d37e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9b14e71886820af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:12.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.363+0000 7f8f61600640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:14:12.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.363+0000 7f8f61600640 1 -- 172.21.15.3:0/2946808880 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6409bec0 con 0x5605ffd82e40 2024-09-19T06:14:12.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.363+0000 7f8f7d07f740 1 -- 172.21.15.3:0/2946808880 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f5c0043d0 con 0x5605ffd82e40 2024-09-19T06:14:12.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.363+0000 7f8f61600640 1 -- 172.21.15.3:0/2946808880 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f8f640a4b60 con 0x5605ffd82e40 2024-09-19T06:14:12.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.364+0000 7f8f61600640 1 -- 172.21.15.3:0/2946808880 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8f6409bce0 con 0x5605ffd82e40 2024-09-19T06:14:12.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.364+0000 7f8f7d07f740 10 client.25720 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:12.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.364+0000 7f8f7d07f740 1 -- 172.21.15.3:0/2946808880 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5605ffd9ccb0 con 0x5605ffd82e40 2024-09-19T06:14:12.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.364+0000 7f8f61600640 1 -- 172.21.15.3:0/2946808880 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f5c0043d0 con 0x5605ffd82e40 2024-09-19T06:14:12.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.364+0000 7f8f61600640 1 -- 172.21.15.3:0/2946808880 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8f640b5140 con 0x5605ffd82e40 2024-09-19T06:14:12.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.364+0000 7f8f7d07f740 10 client.25720 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:12.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.364+0000 7f8f7d07f740 10 client.25720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:14:12.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.364+0000 7f8f7d07f740 20 client.25720 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:12.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.364+0000 7f8f7d07f740 1 --2- 172.21.15.3:0/2946808880 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5605ffd9e000 0x5605ffda0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:12.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.364+0000 7f8f7d07f740 4 client.25720 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:14:12.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.364+0000 7f8f7d07f740 1 -- 172.21.15.3:0/2946808880 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605ffcf6950 con 0x5605ffd9e000 2024-09-19T06:14:12.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.365+0000 7f8f6aa00640 1 --2- 172.21.15.3:0/2946808880 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5605ffd9e000 0x5605ffda0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:12.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.365+0000 7f8f6aa00640 1 --2- 172.21.15.3:0/2946808880 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5605ffd9e000 0x5605ffda0410 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cf9c7ee1183ea5a server_cookie=88c0da4e37775c5d in_seq=0 out_seq=0 2024-09-19T06:14:12.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.365+0000 7f8f61600640 10 client.25720 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:12.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.366+0000 7f8f61600640 1 -- 172.21.15.3:0/2946808880 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5605ffcf6950 con 0x5605ffd9e000 2024-09-19T06:14:12.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.366+0000 7f8f61600640 10 client.25720 handle_command_reply: tid=0 2024-09-19T06:14:12.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.366+0000 7f8f7d07f740 1 client.25720 shutdown 2024-09-19T06:14:12.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.366+0000 7f8f7d07f740 1 -- 172.21.15.3:0/2946808880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605ffd82e40 msgr2=0x5605ffd8aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:12.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.366+0000 7f8f7d07f740 1 --2- 172.21.15.3:0/2946808880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605ffd82e40 0x5605ffd8aed0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8f640cd7c0 tx=0x7f8f640d37e0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.366+0000 7f8f7d07f740 1 -- 172.21.15.3:0/2946808880 shutdown_connections 2024-09-19T06:14:12.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.366+0000 7f8f7d07f740 1 --2- 172.21.15.3:0/2946808880 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5605ffd9e000 0x5605ffda0410 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.366+0000 7f8f7d07f740 1 --2- 172.21.15.3:0/2946808880 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd8e020 0x5605ffd8b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.366+0000 7f8f7d07f740 1 --2- 172.21.15.3:0/2946808880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605ffd83760 0x5605ffd8b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.366+0000 7f8f61600640 0 client.25720 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:12.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.366+0000 7f8f7d07f740 1 --2- 172.21.15.3:0/2946808880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605ffd82e40 0x5605ffd8aed0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.366+0000 7f8f7d07f740 1 -- 172.21.15.3:0/2946808880 >> 172.21.15.3:0/2946808880 conn(0x5605ffd7f3d0 msgr2=0x5605ffd850b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:12.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.367+0000 7f8f7d07f740 1 -- 172.21.15.3:0/2946808880 shutdown_connections 2024-09-19T06:14:12.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.367+0000 7f8f7d07f740 1 -- 172.21.15.3:0/2946808880 wait complete. 2024-09-19T06:14:12.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.367+0000 7f8f7d07f740 20 client.25720 trim_cache size 0 max 16384 2024-09-19T06:14:12.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.380+0000 7f8f7d07f740 1 Processor -- start 2024-09-19T06:14:12.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.380+0000 7f8f7d07f740 1 -- start start 2024-09-19T06:14:12.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.381+0000 7f8f7d07f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605ffd82e40 0x5605ffd858a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:12.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.381+0000 7f8f7d07f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd83760 0x5605ffd8ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:12.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.381+0000 7f8f7d07f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605ffd8e020 0x5605ffda5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:12.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.381+0000 7f8f7d07f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8f741af950 con 0x5605ffd83760 2024-09-19T06:14:12.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.381+0000 7f8f7d07f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8f741b1490 con 0x5605ffd82e40 2024-09-19T06:14:12.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.381+0000 7f8f7d07f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8f741b0020 con 0x5605ffd8e020 2024-09-19T06:14:12.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.381+0000 7f8f6aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd83760 0x5605ffd8ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:12.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.381+0000 7f8f6aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd83760 0x5605ffd8ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53712/0 (socket says 172.21.15.3:53712) 2024-09-19T06:14:12.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.381+0000 7f8f73400640 1 --2- 172.21.15.3:0/4193539582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605ffd82e40 0x5605ffd858a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:12.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.381+0000 7f8f6aa00640 1 -- 172.21.15.3:0/4193539582 learned_addr learned my addr 172.21.15.3:0/4193539582 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:12.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.381+0000 7f8f73e00640 1 --2- 172.21.15.3:0/4193539582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605ffd8e020 0x5605ffda5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:12.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.381+0000 7f8f73400640 1 -- 172.21.15.3:0/4193539582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605ffd8e020 msgr2=0x5605ffda5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:12.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.381+0000 7f8f73400640 1 --2- 172.21.15.3:0/4193539582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605ffd8e020 0x5605ffda5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.381+0000 7f8f73400640 1 -- 172.21.15.3:0/4193539582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd83760 msgr2=0x5605ffd8ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:12.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.381+0000 7f8f73400640 1 --2- 172.21.15.3:0/4193539582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd83760 0x5605ffd8ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.381+0000 7f8f73400640 1 -- 172.21.15.3:0/4193539582 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605ffd7ee70 con 0x5605ffd82e40 2024-09-19T06:14:12.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.381+0000 7f8f6aa00640 1 --2- 172.21.15.3:0/4193539582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd83760 0x5605ffd8ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:12.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.382+0000 7f8f73400640 1 --2- 172.21.15.3:0/4193539582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605ffd82e40 0x5605ffd858a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8f6409c310 tx=0x7f8f6409a890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4846cbc89ebfd231 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:12.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.382+0000 7f8f63e00640 1 -- 172.21.15.3:0/4193539582 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f6409bec0 con 0x5605ffd82e40 2024-09-19T06:14:12.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.382+0000 7f8f63e00640 1 -- 172.21.15.3:0/4193539582 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f6409ca80 con 0x5605ffd82e40 2024-09-19T06:14:12.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.382+0000 7f8f63e00640 1 -- 172.21.15.3:0/4193539582 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f640b5140 con 0x5605ffd82e40 2024-09-19T06:14:12.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.383+0000 7f8f7d07f740 1 -- 172.21.15.3:0/4193539582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605ffd82e40 msgr2=0x5605ffd858a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:12.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.383+0000 7f8f7d07f740 1 --2- 172.21.15.3:0/4193539582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605ffd82e40 0x5605ffd858a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8f6409c310 tx=0x7f8f6409a890 comp rx=0 tx=0).stop 2024-09-19T06:14:12.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.383+0000 7f8f7d07f740 1 -- 172.21.15.3:0/4193539582 shutdown_connections 2024-09-19T06:14:12.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.383+0000 7f8f7d07f740 1 --2- 172.21.15.3:0/4193539582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605ffd8e020 0x5605ffda5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.383+0000 7f8f7d07f740 1 --2- 172.21.15.3:0/4193539582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd83760 0x5605ffd8ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.383+0000 7f8f7d07f740 1 --2- 172.21.15.3:0/4193539582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605ffd82e40 0x5605ffd858a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.383+0000 7f8f7d07f740 1 -- 172.21.15.3:0/4193539582 >> 172.21.15.3:0/4193539582 conn(0x5605ffd7f3d0 msgr2=0x5605ffd8c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:12.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.383+0000 7f8f7d07f740 1 -- 172.21.15.3:0/4193539582 shutdown_connections 2024-09-19T06:14:12.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.383+0000 7f8f7d07f740 1 -- 172.21.15.3:0/4193539582 wait complete. 2024-09-19T06:14:12.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.384+0000 7f8f7d07f740 1 -- start start 2024-09-19T06:14:12.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.384+0000 7f8f7d07f740 1 Processor -- start 2024-09-19T06:14:12.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.384+0000 7f8f7d07f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605ffd82e40 0x5605ffd96890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:12.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.384+0000 7f8f7d07f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd83760 0x5605ffd91bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:12.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.384+0000 7f8f7d07f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605ffd8e020 0x5605ffd92350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:12.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.384+0000 7f8f7d07f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8f741b0dc0 con 0x5605ffd83760 2024-09-19T06:14:12.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.384+0000 7f8f7d07f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8f741b06f0 con 0x5605ffd8e020 2024-09-19T06:14:12.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.384+0000 7f8f7d07f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8f741ad930 con 0x5605ffd82e40 2024-09-19T06:14:12.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.384+0000 7f8f7d07f740 10 client.0 _ll_register_callbacks cb 0x7f8f6400e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:12.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.385+0000 7f8f6aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd83760 0x5605ffd91bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:12.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.385+0000 7f8f73e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605ffd8e020 0x5605ffd92350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:12.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.385+0000 7f8f73400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605ffd82e40 0x5605ffd96890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:12.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.385+0000 7f8f73400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605ffd82e40 0x5605ffd96890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:40836/0 (socket says 172.21.15.3:40836) 2024-09-19T06:14:12.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.385+0000 7f8f73400640 1 -- 172.21.15.3:0/4235511371 learned_addr learned my addr 172.21.15.3:0/4235511371 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:12.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.385+0000 7f8f73e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605ffd8e020 0x5605ffd92350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:54604/0 (socket says 172.21.15.3:54604) 2024-09-19T06:14:12.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.385+0000 7f8f73400640 1 -- 172.21.15.3:0/4235511371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605ffd8e020 msgr2=0x5605ffd92350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:12.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.385+0000 7f8f73400640 1 --2- 172.21.15.3:0/4235511371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605ffd8e020 0x5605ffd92350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.385+0000 7f8f73400640 1 -- 172.21.15.3:0/4235511371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd83760 msgr2=0x5605ffd91bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:12.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.385+0000 7f8f73400640 1 --2- 172.21.15.3:0/4235511371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd83760 0x5605ffd91bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.385+0000 7f8f73400640 1 -- 172.21.15.3:0/4235511371 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605ffe07c80 con 0x5605ffd82e40 2024-09-19T06:14:12.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.385+0000 7f8f6aa00640 1 --2- 172.21.15.3:0/4235511371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd83760 0x5605ffd91bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:12.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.385+0000 7f8f73400640 1 --2- 172.21.15.3:0/4235511371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605ffd82e40 0x5605ffd96890 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8f64098d50 tx=0x7f8f64098c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d6c02a206926b21 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:12.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.385+0000 7f8f61600640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:14:12.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.386+0000 7f8f61600640 1 -- 172.21.15.3:0/4235511371 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f640b9020 con 0x5605ffd82e40 2024-09-19T06:14:12.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.386+0000 7f8f61600640 1 -- 172.21.15.3:0/4235511371 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f8f640d34d0 con 0x5605ffd82e40 2024-09-19T06:14:12.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.386+0000 7f8f7d07f740 1 -- 172.21.15.3:0/4235511371 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f6409ca80 con 0x5605ffd82e40 2024-09-19T06:14:12.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.386+0000 7f8f61600640 1 -- 172.21.15.3:0/4235511371 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8f6409bec0 con 0x5605ffd82e40 2024-09-19T06:14:12.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.386+0000 7f8f7d07f740 10 client.25726 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:12.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.386+0000 7f8f7d07f740 1 -- 172.21.15.3:0/4235511371 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5605ffe08e10 con 0x5605ffd82e40 2024-09-19T06:14:12.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.386+0000 7f8f61600640 1 -- 172.21.15.3:0/4235511371 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f6409ca80 con 0x5605ffd82e40 2024-09-19T06:14:12.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.386+0000 7f8f61600640 1 -- 172.21.15.3:0/4235511371 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8f6409b7d0 con 0x5605ffd82e40 2024-09-19T06:14:12.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.386+0000 7f8f7d07f740 10 client.25726 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:12.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.386+0000 7f8f7d07f740 10 client.25726 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:14:12.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.386+0000 7f8f7d07f740 20 client.25726 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:12.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.386+0000 7f8f7d07f740 1 --2- 172.21.15.3:0/4235511371 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5605ffe09290 0x5605ffe0b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:12.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.386+0000 7f8f7d07f740 4 client.25726 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:14:12.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.386+0000 7f8f7d07f740 1 -- 172.21.15.3:0/4235511371 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5605ffcf0e60 con 0x5605ffe09290 2024-09-19T06:14:12.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.387+0000 7f8f6aa00640 1 --2- 172.21.15.3:0/4235511371 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5605ffe09290 0x5605ffe0b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:12.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.387+0000 7f8f6aa00640 1 --2- 172.21.15.3:0/4235511371 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5605ffe09290 0x5605ffe0b680 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d1eec623de82217 server_cookie=45bf3133ff73232c in_seq=0 out_seq=0 2024-09-19T06:14:12.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.387+0000 7f8f61600640 10 client.25726 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:12.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.387+0000 7f8f61600640 1 -- 172.21.15.3:0/4235511371 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5605ffcf0e60 con 0x5605ffe09290 2024-09-19T06:14:12.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.387+0000 7f8f61600640 10 client.25726 handle_command_reply: tid=0 2024-09-19T06:14:12.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.387+0000 7f8f7d07f740 1 client.25726 shutdown 2024-09-19T06:14:12.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.387+0000 7f8f7d07f740 1 -- 172.21.15.3:0/4235511371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605ffd82e40 msgr2=0x5605ffd96890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:12.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.387+0000 7f8f7d07f740 1 --2- 172.21.15.3:0/4235511371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605ffd82e40 0x5605ffd96890 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8f64098d50 tx=0x7f8f64098c00 comp rx=0 tx=0).stop 2024-09-19T06:14:12.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.387+0000 7f8f7d07f740 1 -- 172.21.15.3:0/4235511371 shutdown_connections 2024-09-19T06:14:12.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.388+0000 7f8f7d07f740 1 --2- 172.21.15.3:0/4235511371 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5605ffe09290 0x5605ffe0b680 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.388+0000 7f8f7d07f740 1 --2- 172.21.15.3:0/4235511371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5605ffd8e020 0x5605ffd92350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.388+0000 7f8f7d07f740 1 --2- 172.21.15.3:0/4235511371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5605ffd83760 0x5605ffd91bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.388+0000 7f8f61600640 0 client.25726 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:12.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.388+0000 7f8f7d07f740 1 --2- 172.21.15.3:0/4235511371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5605ffd82e40 0x5605ffd96890 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.388+0000 7f8f7d07f740 1 -- 172.21.15.3:0/4235511371 >> 172.21.15.3:0/4235511371 conn(0x5605ffd7f3d0 msgr2=0x5605ffd89370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:12.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.388+0000 7f8f7d07f740 1 -- 172.21.15.3:0/4235511371 shutdown_connections 2024-09-19T06:14:12.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.388+0000 7f8f7d07f740 1 -- 172.21.15.3:0/4235511371 wait complete. 2024-09-19T06:14:12.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.388+0000 7f8f7d07f740 20 client.25726 trim_cache size 0 max 16384 2024-09-19T06:14:12.397 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:14:12.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.388+0000 7f8f79000640 1 -- 172.21.15.3:0/1108950156 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8f580a3430 msgr2=0x7f8f580a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:12.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.388+0000 7f8f79000640 1 --2- 172.21.15.3:0/1108950156 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8f580a3430 0x7f8f580a58f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c005e30 tx=0x7f8f6c005c50 comp rx=0 tx=0).stop 2024-09-19T06:14:12.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.388+0000 7f8f79000640 1 -- 172.21.15.3:0/1108950156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f740745c0 msgr2=0x7f8f7419a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:12.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.388+0000 7f8f79000640 1 --2- 172.21.15.3:0/1108950156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f740745c0 0x7f8f7419a430 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8f6400e9f0 tx=0x7f8f6400edf0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.389+0000 7f8f79000640 1 -- 172.21.15.3:0/1108950156 shutdown_connections 2024-09-19T06:14:12.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.389+0000 7f8f79000640 1 --2- 172.21.15.3:0/1108950156 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8f580a3430 0x7f8f580a58f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.389+0000 7f8f79000640 1 --2- 172.21.15.3:0/1108950156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8f7410e260 0x7f8f7419ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.389+0000 7f8f79000640 1 --2- 172.21.15.3:0/1108950156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f74074ee0 0x7f8f7419a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.389+0000 7f8f79000640 1 --2- 172.21.15.3:0/1108950156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f740745c0 0x7f8f7419a430 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:12.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.389+0000 7f8f79000640 1 -- 172.21.15.3:0/1108950156 >> 172.21.15.3:0/1108950156 conn(0x7f8f740fd6e0 msgr2=0x7f8f740fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:12.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.389+0000 7f8f79000640 1 -- 172.21.15.3:0/1108950156 shutdown_connections 2024-09-19T06:14:12.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:12.389+0000 7f8f79000640 1 -- 172.21.15.3:0/1108950156 wait complete. 2024-09-19T06:14:14.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:13 smithi059 ceph-mon[35138]: pgmap v58: 97 pgs: 97 active+clean; 1.7 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 KiB/s wr, 27 op/s 2024-09-19T06:14:14.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:13 smithi003 ceph-mon[30893]: pgmap v58: 97 pgs: 97 active+clean; 1.7 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 KiB/s wr, 27 op/s 2024-09-19T06:14:14.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:13 smithi071 ceph-mon[35662]: pgmap v58: 97 pgs: 97 active+clean; 1.7 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 KiB/s wr, 27 op/s 2024-09-19T06:14:14.409 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:14:14.409 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:14:14.801 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:15.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.454+0000 7fe62b200640 1 -- 172.21.15.3:0/1613118011 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe62c1047e0 msgr2=0x7fe62c108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:15.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.454+0000 7fe62b200640 1 --2- 172.21.15.3:0/1613118011 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe62c1047e0 0x7fe62c108830 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe614009900 tx=0x7fe61402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.454+0000 7fe62b200640 1 -- 172.21.15.3:0/1613118011 shutdown_connections 2024-09-19T06:14:15.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.454+0000 7fe62b200640 1 --2- 172.21.15.3:0/1613118011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe62c108f60 0x7fe62c110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.454+0000 7fe62b200640 1 --2- 172.21.15.3:0/1613118011 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe62c1047e0 0x7fe62c108830 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.454+0000 7fe62b200640 1 --2- 172.21.15.3:0/1613118011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe62c103e30 0x7fe62c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.454+0000 7fe62b200640 1 -- 172.21.15.3:0/1613118011 >> 172.21.15.3:0/1613118011 conn(0x7fe62c0ff8d0 msgr2=0x7fe62c101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:15.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.455+0000 7fe62b200640 1 -- 172.21.15.3:0/1613118011 shutdown_connections 2024-09-19T06:14:15.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.455+0000 7fe62b200640 1 -- 172.21.15.3:0/1613118011 wait complete. 2024-09-19T06:14:15.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.456+0000 7fe62b200640 1 Processor -- start 2024-09-19T06:14:15.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.456+0000 7fe62b200640 1 -- start start 2024-09-19T06:14:15.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.456+0000 7fe62b200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe62c103e30 0x7fe62c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:15.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.456+0000 7fe62b200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe62c1047e0 0x7fe62c19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:15.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.456+0000 7fe62b200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe62c108f60 0x7fe62c19eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:15.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.456+0000 7fe62b200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c114010 con 0x7fe62c1047e0 2024-09-19T06:14:15.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.456+0000 7fe62b200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c113e90 con 0x7fe62c103e30 2024-09-19T06:14:15.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.456+0000 7fe62b200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c114190 con 0x7fe62c108f60 2024-09-19T06:14:15.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.456+0000 7fe621400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe62c1047e0 0x7fe62c19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:15.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.457+0000 7fe621400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe62c1047e0 0x7fe62c19aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60434/0 (socket says 172.21.15.3:60434) 2024-09-19T06:14:15.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.457+0000 7fe621400640 1 -- 172.21.15.3:0/276182751 learned_addr learned my addr 172.21.15.3:0/276182751 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:15.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.457+0000 7fe629e00640 1 --2- 172.21.15.3:0/276182751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe62c103e30 0x7fe62c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:15.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.457+0000 7fe62a800640 1 --2- 172.21.15.3:0/276182751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe62c108f60 0x7fe62c19eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:15.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.457+0000 7fe621400640 1 -- 172.21.15.3:0/276182751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe62c108f60 msgr2=0x7fe62c19eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:15.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.457+0000 7fe621400640 1 --2- 172.21.15.3:0/276182751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe62c108f60 0x7fe62c19eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.457+0000 7fe621400640 1 -- 172.21.15.3:0/276182751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe62c103e30 msgr2=0x7fe62c19a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:15.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.457+0000 7fe621400640 1 --2- 172.21.15.3:0/276182751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe62c103e30 0x7fe62c19a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.457+0000 7fe621400640 1 -- 172.21.15.3:0/276182751 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe62c19f480 con 0x7fe62c1047e0 2024-09-19T06:14:15.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.457+0000 7fe621400640 1 --2- 172.21.15.3:0/276182751 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe62c1047e0 0x7fe62c19aa10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe614004770 tx=0x7fe614003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:15.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.458+0000 7fe623400640 1 -- 172.21.15.3:0/276182751 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61403f070 con 0x7fe62c1047e0 2024-09-19T06:14:15.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.458+0000 7fe623400640 1 -- 172.21.15.3:0/276182751 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe614031ca0 con 0x7fe62c1047e0 2024-09-19T06:14:15.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.458+0000 7fe623400640 1 -- 172.21.15.3:0/276182751 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe614035030 con 0x7fe62c1047e0 2024-09-19T06:14:15.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.458+0000 7fe62b200640 1 -- 172.21.15.3:0/276182751 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe62c19f710 con 0x7fe62c1047e0 2024-09-19T06:14:15.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.458+0000 7fe62b200640 1 -- 172.21.15.3:0/276182751 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe62c1a7050 con 0x7fe62c1047e0 2024-09-19T06:14:15.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.461+0000 7fe6335fe740 1 Processor -- start 2024-09-19T06:14:15.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.461+0000 7fe623400640 1 -- 172.21.15.3:0/276182751 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fe614042070 con 0x7fe62c1047e0 2024-09-19T06:14:15.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.461+0000 7fe6335fe740 1 -- start start 2024-09-19T06:14:15.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.461+0000 7fe6335fe740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559ef386acb0 0x559ef386b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:15.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.461+0000 7fe6335fe740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef386b5d0 0x559ef3875950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:15.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.461+0000 7fe6335fe740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559ef3875e90 0x559ef3878280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.461+0000 7fe6335fe740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x559ef37d1290 con 0x559ef386b5d0 2024-09-19T06:14:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.461+0000 7fe6335fe740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559ef3778b40 con 0x559ef3875e90 2024-09-19T06:14:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.461+0000 7fe6335fe740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559ef37cd250 con 0x559ef386acb0 2024-09-19T06:14:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.462+0000 7fe629e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef386b5d0 0x559ef3875950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.462+0000 7fe62a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559ef386acb0 0x559ef386b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.462+0000 7fe629e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef386b5d0 0x559ef3875950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60450/0 (socket says 172.21.15.3:60450) 2024-09-19T06:14:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.462+0000 7fe629e00640 1 -- 172.21.15.3:0/3108244029 learned_addr learned my addr 172.21.15.3:0/3108244029 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.462+0000 7fe621400640 1 --2- 172.21.15.3:0/3108244029 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559ef3875e90 0x559ef3878280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.462+0000 7fe62a800640 1 -- 172.21.15.3:0/3108244029 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559ef3875e90 msgr2=0x559ef3878280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.462+0000 7fe62a800640 1 --2- 172.21.15.3:0/3108244029 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559ef3875e90 0x559ef3878280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.462+0000 7fe62a800640 1 -- 172.21.15.3:0/3108244029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef386b5d0 msgr2=0x559ef3875950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.462+0000 7fe62a800640 1 --2- 172.21.15.3:0/3108244029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef386b5d0 0x559ef3875950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.462+0000 7fe62a800640 1 -- 172.21.15.3:0/3108244029 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ef35426a0 con 0x559ef386acb0 2024-09-19T06:14:15.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.462+0000 7fe623400640 1 --2- 172.21.15.3:0/276182751 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe6100a3430 0x7fe6100a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:15.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.462+0000 7fe62a800640 1 --2- 172.21.15.3:0/3108244029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559ef386acb0 0x559ef386b090 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe624009f10 tx=0x7fe624011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2090746b5588566 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:15.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.462+0000 7fe623400640 1 -- 172.21.15.3:0/276182751 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fe6140f02c0 con 0x7fe62c1047e0 2024-09-19T06:14:15.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.463+0000 7fe61b000640 1 -- 172.21.15.3:0/3108244029 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe624004d20 con 0x559ef386acb0 2024-09-19T06:14:15.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.463+0000 7fe629e00640 1 --2- 172.21.15.3:0/276182751 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe6100a3430 0x7fe6100a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:15.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.463+0000 7fe61b000640 1 -- 172.21.15.3:0/3108244029 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe624004050 con 0x559ef386acb0 2024-09-19T06:14:15.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.463+0000 7fe61b000640 1 -- 172.21.15.3:0/3108244029 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe624005260 con 0x559ef386acb0 2024-09-19T06:14:15.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.464+0000 7fe6335fe740 1 -- 172.21.15.3:0/3108244029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559ef386acb0 msgr2=0x559ef386b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:15.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.464+0000 7fe6335fe740 1 --2- 172.21.15.3:0/3108244029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559ef386acb0 0x559ef386b090 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe624009f10 tx=0x7fe624011810 comp rx=0 tx=0).stop 2024-09-19T06:14:15.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.464+0000 7fe629e00640 1 --2- 172.21.15.3:0/276182751 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe6100a3430 0x7fe6100a58f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x559ef38680a0 tx=0x7fe61c005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:15.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.464+0000 7fe6335fe740 1 -- 172.21.15.3:0/3108244029 shutdown_connections 2024-09-19T06:14:15.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.464+0000 7fe6335fe740 1 --2- 172.21.15.3:0/3108244029 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559ef3875e90 0x559ef3878280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.464+0000 7fe6335fe740 1 --2- 172.21.15.3:0/3108244029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef386b5d0 0x559ef3875950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.464+0000 7fe6335fe740 1 --2- 172.21.15.3:0/3108244029 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559ef386acb0 0x559ef386b090 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.464+0000 7fe6335fe740 1 -- 172.21.15.3:0/3108244029 >> 172.21.15.3:0/3108244029 conn(0x559ef3867240 msgr2=0x559ef3867620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:15.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.464+0000 7fe6335fe740 1 -- 172.21.15.3:0/3108244029 shutdown_connections 2024-09-19T06:14:15.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.464+0000 7fe6335fe740 1 -- 172.21.15.3:0/3108244029 wait complete. 2024-09-19T06:14:15.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.464+0000 7fe6335fe740 1 -- start start 2024-09-19T06:14:15.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.464+0000 7fe6335fe740 1 Processor -- start 2024-09-19T06:14:15.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.465+0000 7fe6335fe740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559ef386acb0 0x559ef3875730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:15.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.465+0000 7fe6335fe740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559ef386b5d0 0x559ef38729e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:15.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.465+0000 7fe6335fe740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef3875e90 0x559ef3872f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:15.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.465+0000 7fe6335fe740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x559ef3878b00 con 0x559ef3875e90 2024-09-19T06:14:15.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.465+0000 7fe6335fe740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559ef378bfa0 con 0x559ef386acb0 2024-09-19T06:14:15.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.465+0000 7fe6335fe740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559ef3878c80 con 0x559ef386b5d0 2024-09-19T06:14:15.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.465+0000 7fe6335fe740 10 client.0 _ll_register_callbacks cb 0x559ef34dfba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:15.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.465+0000 7fe62a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef3875e90 0x559ef3872f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:15.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.465+0000 7fe629e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559ef386acb0 0x559ef3875730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:15.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.465+0000 7fe62a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef3875e90 0x559ef3872f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60460/0 (socket says 172.21.15.3:60460) 2024-09-19T06:14:15.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.465+0000 7fe62a800640 1 -- 172.21.15.3:0/2588851714 learned_addr learned my addr 172.21.15.3:0/2588851714 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:15.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.465+0000 7fe621400640 1 --2- 172.21.15.3:0/2588851714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559ef386b5d0 0x559ef38729e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:15.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.466+0000 7fe62a800640 1 -- 172.21.15.3:0/2588851714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559ef386b5d0 msgr2=0x559ef38729e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:15.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.466+0000 7fe62a800640 1 --2- 172.21.15.3:0/2588851714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559ef386b5d0 0x559ef38729e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.466+0000 7fe62a800640 1 -- 172.21.15.3:0/2588851714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559ef386acb0 msgr2=0x559ef3875730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:15.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.466+0000 7fe62a800640 1 --2- 172.21.15.3:0/2588851714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559ef386acb0 0x559ef3875730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.466+0000 7fe62a800640 1 -- 172.21.15.3:0/2588851714 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ef3873720 con 0x559ef3875e90 2024-09-19T06:14:15.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.466+0000 7fe629e00640 1 --2- 172.21.15.3:0/2588851714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559ef386acb0 0x559ef3875730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:15.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.466+0000 7fe62a800640 1 --2- 172.21.15.3:0/2588851714 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef3875e90 0x559ef3872f20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe624005f40 tx=0x7fe624003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f855ba4da735546 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:15.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.466+0000 7fe60f400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:14:15.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.466+0000 7fe60f400640 1 -- 172.21.15.3:0/2588851714 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe624029020 con 0x559ef3875e90 2024-09-19T06:14:15.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.466+0000 7fe6335fe740 1 -- 172.21.15.3:0/2588851714 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe624004050 con 0x559ef3875e90 2024-09-19T06:14:15.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.466+0000 7fe60f400640 1 -- 172.21.15.3:0/2588851714 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fe624005040 con 0x559ef3875e90 2024-09-19T06:14:15.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.467+0000 7fe60f400640 1 -- 172.21.15.3:0/2588851714 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe624034050 con 0x559ef3875e90 2024-09-19T06:14:15.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.467+0000 7fe6335fe740 10 client.15687 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:15.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.467+0000 7fe6335fe740 1 -- 172.21.15.3:0/2588851714 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559ef3884980 con 0x559ef3875e90 2024-09-19T06:14:15.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.467+0000 7fe60f400640 1 -- 172.21.15.3:0/2588851714 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe624004050 con 0x559ef3875e90 2024-09-19T06:14:15.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.467+0000 7fe60f400640 1 -- 172.21.15.3:0/2588851714 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe624025500 con 0x559ef3875e90 2024-09-19T06:14:15.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.467+0000 7fe6335fe740 10 client.15687 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:15.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.467+0000 7fe6335fe740 10 client.15687 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:14:15.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.467+0000 7fe6335fe740 20 client.15687 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:15.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.467+0000 7fe6335fe740 1 --2- 172.21.15.3:0/2588851714 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x559ef3885d90 0x559ef3888180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:15.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.467+0000 7fe6335fe740 4 client.15687 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:14:15.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.467+0000 7fe6335fe740 1 -- 172.21.15.3:0/2588851714 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ef37de800 con 0x559ef3885d90 2024-09-19T06:14:15.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.468+0000 7fe629e00640 1 --2- 172.21.15.3:0/2588851714 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x559ef3885d90 0x559ef3888180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:15.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.468+0000 7fe629e00640 1 --2- 172.21.15.3:0/2588851714 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x559ef3885d90 0x559ef3888180 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=885202bb5f1d1413 server_cookie=366e7934c3f5e374 in_seq=0 out_seq=0 2024-09-19T06:14:15.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.468+0000 7fe60f400640 10 client.15687 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:15.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.469+0000 7fe60f400640 1 -- 172.21.15.3:0/2588851714 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559ef37de800 con 0x559ef3885d90 2024-09-19T06:14:15.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.469+0000 7fe60f400640 10 client.15687 handle_command_reply: tid=0 2024-09-19T06:14:15.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.469+0000 7fe6335fe740 1 client.15687 shutdown 2024-09-19T06:14:15.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.469+0000 7fe6335fe740 1 -- 172.21.15.3:0/2588851714 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef3875e90 msgr2=0x559ef3872f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:15.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.469+0000 7fe6335fe740 1 --2- 172.21.15.3:0/2588851714 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef3875e90 0x559ef3872f20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe624005f40 tx=0x7fe624003c60 comp rx=0 tx=0).stop 2024-09-19T06:14:15.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.469+0000 7fe6335fe740 1 -- 172.21.15.3:0/2588851714 shutdown_connections 2024-09-19T06:14:15.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.469+0000 7fe6335fe740 1 --2- 172.21.15.3:0/2588851714 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x559ef3885d90 0x559ef3888180 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.470+0000 7fe6335fe740 1 --2- 172.21.15.3:0/2588851714 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef3875e90 0x559ef3872f20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.470+0000 7fe6335fe740 1 --2- 172.21.15.3:0/2588851714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559ef386b5d0 0x559ef38729e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.470+0000 7fe6335fe740 1 --2- 172.21.15.3:0/2588851714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559ef386acb0 0x559ef3875730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.470+0000 7fe60f400640 0 client.15687 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:15.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.470+0000 7fe6335fe740 1 -- 172.21.15.3:0/2588851714 >> 172.21.15.3:0/2588851714 conn(0x559ef3867240 msgr2=0x559ef386cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:15.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.470+0000 7fe6335fe740 1 -- 172.21.15.3:0/2588851714 shutdown_connections 2024-09-19T06:14:15.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.470+0000 7fe6335fe740 1 -- 172.21.15.3:0/2588851714 wait complete. 2024-09-19T06:14:15.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.470+0000 7fe6335fe740 20 client.15687 trim_cache size 0 max 16384 2024-09-19T06:14:15.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.488+0000 7fe6335fe740 1 Processor -- start 2024-09-19T06:14:15.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.488+0000 7fe6335fe740 1 -- start start 2024-09-19T06:14:15.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.488+0000 7fe6335fe740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef386acb0 0x559ef3866160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:15.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.488+0000 7fe6335fe740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559ef386b5d0 0x559ef388d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:15.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.488+0000 7fe6335fe740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559ef3875e90 0x559ef388de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:15.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.488+0000 7fe6335fe740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c1af9b0 con 0x559ef386acb0 2024-09-19T06:14:15.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.488+0000 7fe6335fe740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c1b14f0 con 0x559ef3875e90 2024-09-19T06:14:15.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.488+0000 7fe6335fe740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c1b0080 con 0x559ef386b5d0 2024-09-19T06:14:15.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.489+0000 7fe629e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef386acb0 0x559ef3866160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:15.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.489+0000 7fe629e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef386acb0 0x559ef3866160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60476/0 (socket says 172.21.15.3:60476) 2024-09-19T06:14:15.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.489+0000 7fe629e00640 1 -- 172.21.15.3:0/4114752174 learned_addr learned my addr 172.21.15.3:0/4114752174 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:15.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.489+0000 7fe621400640 1 --2- 172.21.15.3:0/4114752174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559ef386b5d0 0x559ef388d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:15.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.489+0000 7fe62a800640 1 --2- 172.21.15.3:0/4114752174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559ef3875e90 0x559ef388de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:15.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.489+0000 7fe629e00640 1 -- 172.21.15.3:0/4114752174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559ef386b5d0 msgr2=0x559ef388d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:15.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.489+0000 7fe629e00640 1 --2- 172.21.15.3:0/4114752174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559ef386b5d0 0x559ef388d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.489+0000 7fe629e00640 1 -- 172.21.15.3:0/4114752174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559ef3875e90 msgr2=0x559ef388de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:15.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.489+0000 7fe629e00640 1 --2- 172.21.15.3:0/4114752174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559ef3875e90 0x559ef388de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.489+0000 7fe629e00640 1 -- 172.21.15.3:0/4114752174 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ef38682f0 con 0x559ef386acb0 2024-09-19T06:14:15.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.489+0000 7fe621400640 1 --2- 172.21.15.3:0/4114752174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559ef386b5d0 0x559ef388d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:15.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.490+0000 7fe629e00640 1 --2- 172.21.15.3:0/4114752174 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef386acb0 0x559ef3866160 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x559ef38888b0 tx=0x7fe61c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5edd77b54047e2df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:15.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.490+0000 7fe61a600640 1 -- 172.21.15.3:0/4114752174 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61c03a070 con 0x559ef386acb0 2024-09-19T06:14:15.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.490+0000 7fe61a600640 1 -- 172.21.15.3:0/4114752174 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe61c01ed80 con 0x559ef386acb0 2024-09-19T06:14:15.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.490+0000 7fe61a600640 1 -- 172.21.15.3:0/4114752174 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61c035c50 con 0x559ef386acb0 2024-09-19T06:14:15.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.490+0000 7fe6335fe740 1 -- 172.21.15.3:0/4114752174 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef386acb0 msgr2=0x559ef3866160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:15.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.490+0000 7fe6335fe740 1 --2- 172.21.15.3:0/4114752174 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef386acb0 0x559ef3866160 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x559ef38888b0 tx=0x7fe61c01b000 comp rx=0 tx=0).stop 2024-09-19T06:14:15.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.491+0000 7fe6335fe740 1 -- 172.21.15.3:0/4114752174 shutdown_connections 2024-09-19T06:14:15.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.491+0000 7fe6335fe740 1 --2- 172.21.15.3:0/4114752174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559ef3875e90 0x559ef388de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.491+0000 7fe6335fe740 1 --2- 172.21.15.3:0/4114752174 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559ef386b5d0 0x559ef388d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.491+0000 7fe6335fe740 1 --2- 172.21.15.3:0/4114752174 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef386acb0 0x559ef3866160 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.491+0000 7fe6335fe740 1 -- 172.21.15.3:0/4114752174 >> 172.21.15.3:0/4114752174 conn(0x559ef3867240 msgr2=0x559ef3865a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:15.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.491+0000 7fe6335fe740 1 -- 172.21.15.3:0/4114752174 shutdown_connections 2024-09-19T06:14:15.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.491+0000 7fe6335fe740 1 -- 172.21.15.3:0/4114752174 wait complete. 2024-09-19T06:14:15.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.491+0000 7fe6335fe740 1 -- start start 2024-09-19T06:14:15.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.491+0000 7fe6335fe740 1 Processor -- start 2024-09-19T06:14:15.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.492+0000 7fe6335fe740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef386acb0 0x559ef387e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:15.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.492+0000 7fe6335fe740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559ef386b5d0 0x559ef387b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:15.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.492+0000 7fe6335fe740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559ef3875e90 0x559ef387bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:15.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.492+0000 7fe6335fe740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c1b0e20 con 0x559ef386acb0 2024-09-19T06:14:15.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.492+0000 7fe6335fe740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c1b0750 con 0x559ef3875e90 2024-09-19T06:14:15.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.492+0000 7fe6335fe740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c1ad990 con 0x559ef386b5d0 2024-09-19T06:14:15.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.492+0000 7fe6335fe740 10 client.0 _ll_register_callbacks cb 0x7fe61c0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:15.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.492+0000 7fe629e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef386acb0 0x559ef387e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:15.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.492+0000 7fe629e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef386acb0 0x559ef387e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60492/0 (socket says 172.21.15.3:60492) 2024-09-19T06:14:15.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.492+0000 7fe629e00640 1 -- 172.21.15.3:0/3504543432 learned_addr learned my addr 172.21.15.3:0/3504543432 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:15.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.492+0000 7fe621400640 1 --2- 172.21.15.3:0/3504543432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559ef386b5d0 0x559ef387b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:15.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.492+0000 7fe62a800640 1 --2- 172.21.15.3:0/3504543432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559ef3875e90 0x559ef387bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:15.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.493+0000 7fe629e00640 1 -- 172.21.15.3:0/3504543432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559ef386b5d0 msgr2=0x559ef387b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:15.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.493+0000 7fe629e00640 1 --2- 172.21.15.3:0/3504543432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559ef386b5d0 0x559ef387b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.493+0000 7fe629e00640 1 -- 172.21.15.3:0/3504543432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559ef3875e90 msgr2=0x559ef387bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:15.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.493+0000 7fe629e00640 1 --2- 172.21.15.3:0/3504543432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559ef3875e90 0x559ef387bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.493+0000 7fe629e00640 1 -- 172.21.15.3:0/3504543432 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ef387c320 con 0x559ef386acb0 2024-09-19T06:14:15.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.493+0000 7fe629e00640 1 --2- 172.21.15.3:0/3504543432 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef386acb0 0x559ef387e450 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe61c019040 tx=0x7fe61c035460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0a510fee7853a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:15.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.493+0000 7fe60f400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:14:15.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.493+0000 7fe60f400640 1 -- 172.21.15.3:0/3504543432 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61c043060 con 0x559ef386acb0 2024-09-19T06:14:15.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.493+0000 7fe60f400640 1 -- 172.21.15.3:0/3504543432 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fe61c035ad0 con 0x559ef386acb0 2024-09-19T06:14:15.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.493+0000 7fe6335fe740 1 -- 172.21.15.3:0/3504543432 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe61c01ed80 con 0x559ef386acb0 2024-09-19T06:14:15.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.494+0000 7fe60f400640 1 -- 172.21.15.3:0/3504543432 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe61c03a070 con 0x559ef386acb0 2024-09-19T06:14:15.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.494+0000 7fe6335fe740 10 client.15693 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:15.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.494+0000 7fe6335fe740 1 -- 172.21.15.3:0/3504543432 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559ef38f0790 con 0x559ef386acb0 2024-09-19T06:14:15.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.494+0000 7fe60f400640 1 -- 172.21.15.3:0/3504543432 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe61c01ed80 con 0x559ef386acb0 2024-09-19T06:14:15.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.494+0000 7fe60f400640 1 -- 172.21.15.3:0/3504543432 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe61c00fa30 con 0x559ef386acb0 2024-09-19T06:14:15.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.494+0000 7fe6335fe740 10 client.15693 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:15.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.494+0000 7fe6335fe740 10 client.15693 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:14:15.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.494+0000 7fe6335fe740 20 client.15693 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:15.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.494+0000 7fe6335fe740 1 --2- 172.21.15.3:0/3504543432 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x559ef38f0ee0 0x559ef38f3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:15.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.494+0000 7fe6335fe740 4 client.15693 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:14:15.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.494+0000 7fe6335fe740 1 -- 172.21.15.3:0/3504543432 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559ef37d8d10 con 0x559ef38f0ee0 2024-09-19T06:14:15.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.495+0000 7fe621400640 1 --2- 172.21.15.3:0/3504543432 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x559ef38f0ee0 0x559ef38f3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:15.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.495+0000 7fe621400640 1 --2- 172.21.15.3:0/3504543432 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x559ef38f0ee0 0x559ef38f3300 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ce549c06f069b80 server_cookie=8514fc203517954d in_seq=0 out_seq=0 2024-09-19T06:14:15.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.495+0000 7fe60f400640 10 client.15693 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:15.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.496+0000 7fe60f400640 1 -- 172.21.15.3:0/3504543432 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559ef37d8d10 con 0x559ef38f0ee0 2024-09-19T06:14:15.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.496+0000 7fe60f400640 10 client.15693 handle_command_reply: tid=0 2024-09-19T06:14:15.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.496+0000 7fe6335fe740 1 client.15693 shutdown 2024-09-19T06:14:15.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.496+0000 7fe6335fe740 1 -- 172.21.15.3:0/3504543432 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef386acb0 msgr2=0x559ef387e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:15.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.496+0000 7fe6335fe740 1 --2- 172.21.15.3:0/3504543432 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef386acb0 0x559ef387e450 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe61c019040 tx=0x7fe61c035460 comp rx=0 tx=0).stop 2024-09-19T06:14:15.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.496+0000 7fe6335fe740 1 -- 172.21.15.3:0/3504543432 shutdown_connections 2024-09-19T06:14:15.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.496+0000 7fe6335fe740 1 --2- 172.21.15.3:0/3504543432 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x559ef38f0ee0 0x559ef38f3300 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.496+0000 7fe6335fe740 1 --2- 172.21.15.3:0/3504543432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559ef3875e90 0x559ef387bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.496+0000 7fe6335fe740 1 --2- 172.21.15.3:0/3504543432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559ef386b5d0 0x559ef387b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.496+0000 7fe6335fe740 1 --2- 172.21.15.3:0/3504543432 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559ef386acb0 0x559ef387e450 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.496+0000 7fe6335fe740 1 -- 172.21.15.3:0/3504543432 >> 172.21.15.3:0/3504543432 conn(0x559ef3867240 msgr2=0x559ef3866270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:15.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.497+0000 7fe60f400640 0 client.15693 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:15.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.497+0000 7fe6335fe740 1 -- 172.21.15.3:0/3504543432 shutdown_connections 2024-09-19T06:14:15.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.497+0000 7fe6335fe740 1 -- 172.21.15.3:0/3504543432 wait complete. 2024-09-19T06:14:15.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.497+0000 7fe6335fe740 20 client.15693 trim_cache size 0 max 16384 2024-09-19T06:14:15.504 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:14:15.504 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": 0, 2024-09-19T06:14:15.504 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_tag": "d336f3c6-0eda-40f8-8659-8753f24506b8", 2024-09-19T06:14:15.504 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": "asynchronous" 2024-09-19T06:14:15.504 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:14:15.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.497+0000 7fe62b200640 1 -- 172.21.15.3:0/276182751 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe6100a3430 msgr2=0x7fe6100a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:15.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.498+0000 7fe62b200640 1 --2- 172.21.15.3:0/276182751 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe6100a3430 0x7fe6100a58f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x559ef38680a0 tx=0x7fe61c005f90 comp rx=0 tx=0).stop 2024-09-19T06:14:15.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.498+0000 7fe62b200640 1 -- 172.21.15.3:0/276182751 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe62c1047e0 msgr2=0x7fe62c19aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:15.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.498+0000 7fe62b200640 1 --2- 172.21.15.3:0/276182751 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe62c1047e0 0x7fe62c19aa10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe614004770 tx=0x7fe614003c10 comp rx=0 tx=0).stop 2024-09-19T06:14:15.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.498+0000 7fe62b200640 1 -- 172.21.15.3:0/276182751 shutdown_connections 2024-09-19T06:14:15.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.498+0000 7fe62b200640 1 --2- 172.21.15.3:0/276182751 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe6100a3430 0x7fe6100a58f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.498+0000 7fe62b200640 1 --2- 172.21.15.3:0/276182751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe62c108f60 0x7fe62c19eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.498+0000 7fe62b200640 1 --2- 172.21.15.3:0/276182751 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe62c1047e0 0x7fe62c19aa10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.498+0000 7fe62b200640 1 --2- 172.21.15.3:0/276182751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe62c103e30 0x7fe62c19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:15.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.498+0000 7fe62b200640 1 -- 172.21.15.3:0/276182751 >> 172.21.15.3:0/276182751 conn(0x7fe62c0ff8d0 msgr2=0x7fe62c100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:15.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.498+0000 7fe62b200640 1 -- 172.21.15.3:0/276182751 shutdown_connections 2024-09-19T06:14:15.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:15.498+0000 7fe62b200640 1 -- 172.21.15.3:0/276182751 wait complete. 2024-09-19T06:14:16.138 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:15 smithi071 ceph-mon[35662]: pgmap v59: 97 pgs: 97 active+clean; 1.8 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 52 KiB/s wr, 37 op/s 2024-09-19T06:14:16.245 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:15 smithi003 ceph-mon[30893]: pgmap v59: 97 pgs: 97 active+clean; 1.8 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 52 KiB/s wr, 37 op/s 2024-09-19T06:14:16.287 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:14:16.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:15 smithi059 ceph-mon[35138]: pgmap v59: 97 pgs: 97 active+clean; 1.8 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 52 KiB/s wr, 37 op/s 2024-09-19T06:14:16.664 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:17.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:16 smithi003 ceph-mon[30893]: scrub queued for path: / 2024-09-19T06:14:17.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:16 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:14:17.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:16 smithi003 ceph-mon[30893]: scrub summary: active paths [/] 2024-09-19T06:14:17.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:16 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:14:17.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.245+0000 7f9094c00640 1 -- 172.21.15.3:0/558489901 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9090112a50 msgr2=0x7f9090114e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:17.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.245+0000 7f9094c00640 1 --2- 172.21.15.3:0/558489901 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9090112a50 0x7f9090114e40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9088009ca0 tx=0x7f908802a8b0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.245+0000 7f9094c00640 1 -- 172.21.15.3:0/558489901 shutdown_connections 2024-09-19T06:14:17.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.245+0000 7f9094c00640 1 --2- 172.21.15.3:0/558489901 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9090112a50 0x7f9090114e40 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.245+0000 7f9094c00640 1 --2- 172.21.15.3:0/558489901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9090077040 0x7f9090112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.245+0000 7f9094c00640 1 --2- 172.21.15.3:0/558489901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9090076720 0x7f9090076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.245+0000 7f9094c00640 1 -- 172.21.15.3:0/558489901 >> 172.21.15.3:0/558489901 conn(0x7f90900ffa50 msgr2=0x7f9090101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:17.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.245+0000 7f9094c00640 1 -- 172.21.15.3:0/558489901 shutdown_connections 2024-09-19T06:14:17.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.245+0000 7f9094c00640 1 -- 172.21.15.3:0/558489901 wait complete. 2024-09-19T06:14:17.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.246+0000 7f9094c00640 1 Processor -- start 2024-09-19T06:14:17.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.246+0000 7f9094c00640 1 -- start start 2024-09-19T06:14:17.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.246+0000 7f9094c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9090076720 0x7f909019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:17.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.246+0000 7f9094c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9090077040 0x7f909019f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:17.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.246+0000 7f9094c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9090112a50 0x7f90901a3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:17.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.247+0000 7f9094c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f90901185e0 con 0x7f9090076720 2024-09-19T06:14:17.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.247+0000 7f9094c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9090118460 con 0x7f9090077040 2024-09-19T06:14:17.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.247+0000 7f9094c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9090118760 con 0x7f9090112a50 2024-09-19T06:14:17.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.247+0000 7f908de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9090076720 0x7f909019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:17.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.247+0000 7f908de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9090076720 0x7f909019eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60500/0 (socket says 172.21.15.3:60500) 2024-09-19T06:14:17.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.247+0000 7f908de00640 1 -- 172.21.15.3:0/2740443977 learned_addr learned my addr 172.21.15.3:0/2740443977 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:17.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.247+0000 7f9085400640 1 --2- 172.21.15.3:0/2740443977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9090077040 0x7f909019f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:17.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.247+0000 7f908e800640 1 --2- 172.21.15.3:0/2740443977 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9090112a50 0x7f90901a3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:17.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.247+0000 7f908de00640 1 -- 172.21.15.3:0/2740443977 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9090112a50 msgr2=0x7f90901a3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:17.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.247+0000 7f908de00640 1 --2- 172.21.15.3:0/2740443977 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9090112a50 0x7f90901a3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.247+0000 7f908de00640 1 -- 172.21.15.3:0/2740443977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9090077040 msgr2=0x7f909019f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:17.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.247+0000 7f908de00640 1 --2- 172.21.15.3:0/2740443977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9090077040 0x7f909019f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.247+0000 7f908de00640 1 -- 172.21.15.3:0/2740443977 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90901a3bb0 con 0x7f9090076720 2024-09-19T06:14:17.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.248+0000 7f908de00640 1 --2- 172.21.15.3:0/2740443977 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9090076720 0x7f909019eb80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f908000d950 tx=0x7f908000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:17.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.248+0000 7f9087400640 1 -- 172.21.15.3:0/2740443977 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9080017070 con 0x7f9090076720 2024-09-19T06:14:17.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.248+0000 7f9087400640 1 -- 172.21.15.3:0/2740443977 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9080009c30 con 0x7f9090076720 2024-09-19T06:14:17.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.248+0000 7f9094c00640 1 -- 172.21.15.3:0/2740443977 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90901a3ea0 con 0x7f9090076720 2024-09-19T06:14:17.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.248+0000 7f9087400640 1 -- 172.21.15.3:0/2740443977 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908000f6b0 con 0x7f9090076720 2024-09-19T06:14:17.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.248+0000 7f9094c00640 1 -- 172.21.15.3:0/2740443977 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90901ab730 con 0x7f9090076720 2024-09-19T06:14:17.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.251+0000 7f90975c9740 1 Processor -- start 2024-09-19T06:14:17.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.251+0000 7f9087400640 1 -- 172.21.15.3:0/2740443977 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f90800109d0 con 0x7f9090076720 2024-09-19T06:14:17.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.251+0000 7f90975c9740 1 -- start start 2024-09-19T06:14:17.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.252+0000 7f90975c9740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a58c7c0b90 0x55a58c7c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:17.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.252+0000 7f90975c9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7c14b0 0x55a58c7cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:17.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.252+0000 7f90975c9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a58c7cbd70 0x55a58c7ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:17.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.252+0000 7f90975c9740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a58c7273e0 con 0x55a58c7c0b90 2024-09-19T06:14:17.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.252+0000 7f90975c9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a58c6ced80 con 0x55a58c7cbd70 2024-09-19T06:14:17.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.252+0000 7f90975c9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a58c7233a0 con 0x55a58c7c14b0 2024-09-19T06:14:17.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.252+0000 7f908e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a58c7c0b90 0x55a58c7c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:17.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.252+0000 7f908de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7c14b0 0x55a58c7cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:17.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.252+0000 7f908e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a58c7c0b90 0x55a58c7c0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60510/0 (socket says 172.21.15.3:60510) 2024-09-19T06:14:17.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.252+0000 7f908e800640 1 -- 172.21.15.3:0/2565916068 learned_addr learned my addr 172.21.15.3:0/2565916068 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:17.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.252+0000 7f9085400640 1 --2- 172.21.15.3:0/2565916068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a58c7cbd70 0x55a58c7ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:17.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.253+0000 7f908e800640 1 -- 172.21.15.3:0/2565916068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7c14b0 msgr2=0x55a58c7cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:17.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.253+0000 7f908e800640 1 --2- 172.21.15.3:0/2565916068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7c14b0 0x55a58c7cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.253+0000 7f908e800640 1 -- 172.21.15.3:0/2565916068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a58c7cbd70 msgr2=0x55a58c7ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:17.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.253+0000 7f908e800640 1 --2- 172.21.15.3:0/2565916068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a58c7cbd70 0x55a58c7ce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.253+0000 7f908e800640 1 -- 172.21.15.3:0/2565916068 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a58c6edae0 con 0x55a58c7c0b90 2024-09-19T06:14:17.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.253+0000 7f908de00640 1 --2- 172.21.15.3:0/2565916068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7c14b0 0x55a58c7cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:17.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.253+0000 7f908e800640 1 --2- 172.21.15.3:0/2565916068 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a58c7c0b90 0x55a58c7c0f70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f909007aa10 tx=0x7f90880093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749a197d0f9814fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:17.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.253+0000 7f907f000640 1 -- 172.21.15.3:0/2565916068 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9088030720 con 0x55a58c7c0b90 2024-09-19T06:14:17.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.253+0000 7f907f000640 1 -- 172.21.15.3:0/2565916068 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9088036030 con 0x55a58c7c0b90 2024-09-19T06:14:17.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.253+0000 7f907f000640 1 -- 172.21.15.3:0/2565916068 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9088004380 con 0x55a58c7c0b90 2024-09-19T06:14:17.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.253+0000 7f9087400640 1 --2- 172.21.15.3:0/2740443977 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f90740a33b0 0x7f90740a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:17.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.254+0000 7f9087400640 1 -- 172.21.15.3:0/2740443977 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f90800cf960 con 0x7f9090076720 2024-09-19T06:14:17.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.254+0000 7f908de00640 1 --2- 172.21.15.3:0/2740443977 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f90740a33b0 0x7f90740a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:17.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.254+0000 7f90975c9740 1 -- 172.21.15.3:0/2565916068 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a58c7c0b90 msgr2=0x55a58c7c0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:17.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.254+0000 7f90975c9740 1 --2- 172.21.15.3:0/2565916068 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a58c7c0b90 0x55a58c7c0f70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f909007aa10 tx=0x7f90880093e0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.254+0000 7f90975c9740 1 -- 172.21.15.3:0/2565916068 shutdown_connections 2024-09-19T06:14:17.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.254+0000 7f90975c9740 1 --2- 172.21.15.3:0/2565916068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a58c7cbd70 0x55a58c7ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.254+0000 7f90975c9740 1 --2- 172.21.15.3:0/2565916068 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7c14b0 0x55a58c7cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.254+0000 7f90975c9740 1 --2- 172.21.15.3:0/2565916068 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a58c7c0b90 0x55a58c7c0f70 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.254+0000 7f90975c9740 1 -- 172.21.15.3:0/2565916068 >> 172.21.15.3:0/2565916068 conn(0x55a58c7bd120 msgr2=0x55a58c7bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:17.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.254+0000 7f90975c9740 1 -- 172.21.15.3:0/2565916068 shutdown_connections 2024-09-19T06:14:17.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.254+0000 7f908de00640 1 --2- 172.21.15.3:0/2740443977 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f90740a33b0 0x7f90740a5870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55a58c7bdf80 tx=0x7f9080084f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:17.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.254+0000 7f90975c9740 1 -- 172.21.15.3:0/2565916068 wait complete. 2024-09-19T06:14:17.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.255+0000 7f90975c9740 1 -- start start 2024-09-19T06:14:17.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.255+0000 7f90975c9740 1 Processor -- start 2024-09-19T06:14:17.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.255+0000 7f90975c9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7c0b90 0x55a58c7c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:17.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.256+0000 7f90975c9740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a58c7c14b0 0x55a58c7c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:17.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.256+0000 7f90975c9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a58c7cbd70 0x55a58c7c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:17.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.256+0000 7f90975c9740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a58c7ce9e0 con 0x55a58c7c14b0 2024-09-19T06:14:17.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.256+0000 7f90975c9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a58c6e20f0 con 0x55a58c7cbd70 2024-09-19T06:14:17.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.256+0000 7f90975c9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a58c7ceb60 con 0x55a58c7c0b90 2024-09-19T06:14:17.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.256+0000 7f90975c9740 10 client.0 _ll_register_callbacks cb 0x55a58c6d39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:17.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.256+0000 7f908e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7c0b90 0x55a58c7c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:17.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.256+0000 7f908e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7c0b90 0x55a58c7c8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:43388/0 (socket says 172.21.15.3:43388) 2024-09-19T06:14:17.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.256+0000 7f908e800640 1 -- 172.21.15.3:0/4192903744 learned_addr learned my addr 172.21.15.3:0/4192903744 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:17.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.256+0000 7f9085400640 1 --2- 172.21.15.3:0/4192903744 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a58c7c14b0 0x55a58c7c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:17.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.256+0000 7f908e800640 1 --2- 172.21.15.3:0/4192903744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a58c7cbd70 0x55a58c7c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:17.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.256+0000 7f908e800640 1 -- 172.21.15.3:0/4192903744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a58c7cbd70 msgr2=0x55a58c7c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:17.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.256+0000 7f908e800640 1 --2- 172.21.15.3:0/4192903744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a58c7cbd70 0x55a58c7c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.256+0000 7f908e800640 1 -- 172.21.15.3:0/4192903744 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a58c7c14b0 msgr2=0x55a58c7c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:17.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.256+0000 7f908e800640 1 --2- 172.21.15.3:0/4192903744 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a58c7c14b0 0x55a58c7c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.256+0000 7f908e800640 1 -- 172.21.15.3:0/4192903744 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a58c4983c0 con 0x55a58c7c0b90 2024-09-19T06:14:17.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.257+0000 7f908e800640 1 --2- 172.21.15.3:0/4192903744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7c0b90 0x55a58c7c8c30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9088009620 tx=0x7f9088030f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=673ea59766da1671 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:17.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.257+0000 7f9073400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:14:17.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.257+0000 7f9073400640 1 -- 172.21.15.3:0/4192903744 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9088059060 con 0x55a58c7c0b90 2024-09-19T06:14:17.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.257+0000 7f90975c9740 1 -- 172.21.15.3:0/4192903744 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9088036030 con 0x55a58c7c0b90 2024-09-19T06:14:17.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.257+0000 7f9073400640 1 -- 172.21.15.3:0/4192903744 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f9088004770 con 0x55a58c7c0b90 2024-09-19T06:14:17.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.257+0000 7f9073400640 1 -- 172.21.15.3:0/4192903744 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9088004b40 con 0x55a58c7c0b90 2024-09-19T06:14:17.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.258+0000 7f90975c9740 10 client.25756 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:17.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.258+0000 7f90975c9740 1 -- 172.21.15.3:0/4192903744 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a58c7ce9e0 con 0x55a58c7c0b90 2024-09-19T06:14:17.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.258+0000 7f9073400640 1 -- 172.21.15.3:0/4192903744 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9088036030 con 0x55a58c7c0b90 2024-09-19T06:14:17.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.258+0000 7f9073400640 1 -- 172.21.15.3:0/4192903744 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9088043070 con 0x55a58c7c0b90 2024-09-19T06:14:17.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.258+0000 7f90975c9740 10 client.25756 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:17.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.258+0000 7f90975c9740 10 client.25756 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:14:17.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.258+0000 7f90975c9740 20 client.25756 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:17.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.258+0000 7f90975c9740 1 --2- 172.21.15.3:0/4192903744 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a58c7db810 0x55a58c7ddc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:17.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.258+0000 7f90975c9740 4 client.25756 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:14:17.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.258+0000 7f90975c9740 1 -- 172.21.15.3:0/4192903744 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a58c734950 con 0x55a58c7db810 2024-09-19T06:14:17.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.259+0000 7f9085400640 1 --2- 172.21.15.3:0/4192903744 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a58c7db810 0x55a58c7ddc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:17.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.259+0000 7f9085400640 1 --2- 172.21.15.3:0/4192903744 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a58c7db810 0x55a58c7ddc00 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=474e17c012bb6d3d server_cookie=5a20c8e65449692d in_seq=0 out_seq=0 2024-09-19T06:14:17.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.259+0000 7f9073400640 10 client.25756 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:17.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.260+0000 7f9073400640 1 -- 172.21.15.3:0/4192903744 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a58c734950 con 0x55a58c7db810 2024-09-19T06:14:17.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.260+0000 7f9073400640 10 client.25756 handle_command_reply: tid=0 2024-09-19T06:14:17.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.260+0000 7f90975c9740 1 client.25756 shutdown 2024-09-19T06:14:17.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.260+0000 7f90975c9740 1 -- 172.21.15.3:0/4192903744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7c0b90 msgr2=0x55a58c7c8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:17.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.260+0000 7f90975c9740 1 --2- 172.21.15.3:0/4192903744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7c0b90 0x55a58c7c8c30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9088009620 tx=0x7f9088030f70 comp rx=0 tx=0).stop 2024-09-19T06:14:17.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.260+0000 7f90975c9740 1 -- 172.21.15.3:0/4192903744 shutdown_connections 2024-09-19T06:14:17.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.260+0000 7f90975c9740 1 --2- 172.21.15.3:0/4192903744 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a58c7db810 0x55a58c7ddc00 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.260+0000 7f90975c9740 1 --2- 172.21.15.3:0/4192903744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a58c7cbd70 0x55a58c7c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.260+0000 7f90975c9740 1 --2- 172.21.15.3:0/4192903744 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a58c7c14b0 0x55a58c7c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.260+0000 7f90975c9740 1 --2- 172.21.15.3:0/4192903744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7c0b90 0x55a58c7c8c30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.260+0000 7f9073400640 0 client.25756 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:17.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.260+0000 7f90975c9740 1 -- 172.21.15.3:0/4192903744 >> 172.21.15.3:0/4192903744 conn(0x55a58c7bd120 msgr2=0x55a58c7c2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:17.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.261+0000 7f90975c9740 1 -- 172.21.15.3:0/4192903744 shutdown_connections 2024-09-19T06:14:17.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.261+0000 7f90975c9740 1 -- 172.21.15.3:0/4192903744 wait complete. 2024-09-19T06:14:17.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.261+0000 7f90975c9740 20 client.25756 trim_cache size 0 max 16384 2024-09-19T06:14:17.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.279+0000 7f90975c9740 1 Processor -- start 2024-09-19T06:14:17.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.279+0000 7f90975c9740 1 -- start start 2024-09-19T06:14:17.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.279+0000 7f90975c9740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a58c7c0b90 0x55a58c7c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:17.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.279+0000 7f90975c9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a58c7c14b0 0x55a58c7e3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:17.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.279+0000 7f90975c9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7cbd70 0x55a58c7e38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:17.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.279+0000 7f90975c9740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f90901b3fa0 con 0x55a58c7c0b90 2024-09-19T06:14:17.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.279+0000 7f90975c9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f90901b5ae0 con 0x55a58c7c14b0 2024-09-19T06:14:17.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.279+0000 7f90975c9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f90901b4670 con 0x55a58c7cbd70 2024-09-19T06:14:17.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.279+0000 7f908e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a58c7c0b90 0x55a58c7c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:17.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.279+0000 7f908e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a58c7c0b90 0x55a58c7c2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60516/0 (socket says 172.21.15.3:60516) 2024-09-19T06:14:17.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.279+0000 7f908e800640 1 -- 172.21.15.3:0/3924997715 learned_addr learned my addr 172.21.15.3:0/3924997715 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:17.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.280+0000 7f9085400640 1 --2- 172.21.15.3:0/3924997715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a58c7c14b0 0x55a58c7e3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:17.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.280+0000 7f908e800640 1 --2- 172.21.15.3:0/3924997715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7cbd70 0x55a58c7e38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:17.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.280+0000 7f908e800640 1 -- 172.21.15.3:0/3924997715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7cbd70 msgr2=0x55a58c7e38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:17.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.280+0000 7f908e800640 1 --2- 172.21.15.3:0/3924997715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7cbd70 0x55a58c7e38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.280+0000 7f908e800640 1 -- 172.21.15.3:0/3924997715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a58c7c14b0 msgr2=0x55a58c7e3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:17.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.280+0000 7f908e800640 1 --2- 172.21.15.3:0/3924997715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a58c7c14b0 0x55a58c7e3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.280+0000 7f908e800640 1 -- 172.21.15.3:0/3924997715 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a58c7ce4a0 con 0x55a58c7c0b90 2024-09-19T06:14:17.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.280+0000 7f9085400640 1 --2- 172.21.15.3:0/3924997715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a58c7c14b0 0x55a58c7e3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:17.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.280+0000 7f908e800640 1 --2- 172.21.15.3:0/3924997715 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a58c7c0b90 0x55a58c7c2cf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f908802add0 tx=0x7f9088004a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d596db65f25436 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:17.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.280+0000 7f907e600640 1 -- 172.21.15.3:0/3924997715 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9088059040 con 0x55a58c7c0b90 2024-09-19T06:14:17.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.280+0000 7f907e600640 1 -- 172.21.15.3:0/3924997715 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9088036040 con 0x55a58c7c0b90 2024-09-19T06:14:17.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.280+0000 7f907e600640 1 -- 172.21.15.3:0/3924997715 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90880058e0 con 0x55a58c7c0b90 2024-09-19T06:14:17.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.281+0000 7f90975c9740 1 -- 172.21.15.3:0/3924997715 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a58c7c0b90 msgr2=0x55a58c7c2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:17.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.281+0000 7f90975c9740 1 --2- 172.21.15.3:0/3924997715 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a58c7c0b90 0x55a58c7c2cf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f908802add0 tx=0x7f9088004a60 comp rx=0 tx=0).stop 2024-09-19T06:14:17.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.281+0000 7f90975c9740 1 -- 172.21.15.3:0/3924997715 shutdown_connections 2024-09-19T06:14:17.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.281+0000 7f90975c9740 1 --2- 172.21.15.3:0/3924997715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7cbd70 0x55a58c7e38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.281+0000 7f90975c9740 1 --2- 172.21.15.3:0/3924997715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a58c7c14b0 0x55a58c7e3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.281+0000 7f90975c9740 1 --2- 172.21.15.3:0/3924997715 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a58c7c0b90 0x55a58c7c2cf0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.281+0000 7f90975c9740 1 -- 172.21.15.3:0/3924997715 >> 172.21.15.3:0/3924997715 conn(0x55a58c7bd120 msgr2=0x55a58c7c25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:17.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.281+0000 7f90975c9740 1 -- 172.21.15.3:0/3924997715 shutdown_connections 2024-09-19T06:14:17.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.281+0000 7f90975c9740 1 -- 172.21.15.3:0/3924997715 wait complete. 2024-09-19T06:14:17.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.282+0000 7f90975c9740 1 -- start start 2024-09-19T06:14:17.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.282+0000 7f90975c9740 1 Processor -- start 2024-09-19T06:14:17.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.283+0000 7f90975c9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a58c7c0b90 0x55a58c7c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:17.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.283+0000 7f90975c9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7c14b0 0x55a58c7c6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:17.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.283+0000 7f90975c9740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a58c7cbd70 0x55a58c7c6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:17.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.283+0000 7f90975c9740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f90901b5410 con 0x55a58c7cbd70 2024-09-19T06:14:17.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.283+0000 7f90975c9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f90901b4d40 con 0x55a58c7c0b90 2024-09-19T06:14:17.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.283+0000 7f90975c9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f90901b1f80 con 0x55a58c7c14b0 2024-09-19T06:14:17.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.283+0000 7f90975c9740 10 client.0 _ll_register_callbacks cb 0x7f9088030770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:17.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.283+0000 7f908e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a58c7c0b90 0x55a58c7c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:17.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.283+0000 7f9085400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7c14b0 0x55a58c7c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:17.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.283+0000 7f908e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a58c7cbd70 0x55a58c7c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:17.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.283+0000 7f9085400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7c14b0 0x55a58c7c6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:43404/0 (socket says 172.21.15.3:43404) 2024-09-19T06:14:17.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.283+0000 7f9085400640 1 -- 172.21.15.3:0/2126181335 learned_addr learned my addr 172.21.15.3:0/2126181335 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:17.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.283+0000 7f9085400640 1 -- 172.21.15.3:0/2126181335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a58c7c0b90 msgr2=0x55a58c7c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:17.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.283+0000 7f9085400640 1 --2- 172.21.15.3:0/2126181335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a58c7c0b90 0x55a58c7c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.283+0000 7f9085400640 1 -- 172.21.15.3:0/2126181335 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a58c7cbd70 msgr2=0x55a58c7c6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:17.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.283+0000 7f9085400640 1 --2- 172.21.15.3:0/2126181335 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a58c7cbd70 0x55a58c7c6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.283+0000 7f9085400640 1 -- 172.21.15.3:0/2126181335 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a58c845410 con 0x55a58c7c14b0 2024-09-19T06:14:17.299 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:16 smithi059 ceph-mon[35138]: scrub queued for path: / 2024-09-19T06:14:17.299 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:16 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:14:17.299 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:16 smithi059 ceph-mon[35138]: scrub summary: active paths [/] 2024-09-19T06:14:17.299 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:16 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:14:17.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.284+0000 7f9085400640 1 --2- 172.21.15.3:0/2126181335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7c14b0 0x55a58c7c6210 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f909019faf0 tx=0x7f9078009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b66aa4b54d229ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:17.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.284+0000 7f9073400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:14:17.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.284+0000 7f9073400640 1 -- 172.21.15.3:0/2126181335 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9078022070 con 0x55a58c7c14b0 2024-09-19T06:14:17.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.284+0000 7f9073400640 1 -- 172.21.15.3:0/2126181335 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f907801f8d0 con 0x55a58c7c14b0 2024-09-19T06:14:17.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.284+0000 7f90975c9740 1 -- 172.21.15.3:0/2126181335 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9088036040 con 0x55a58c7c14b0 2024-09-19T06:14:17.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.284+0000 7f9073400640 1 -- 172.21.15.3:0/2126181335 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f907801fad0 con 0x55a58c7c14b0 2024-09-19T06:14:17.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.284+0000 7f90975c9740 10 client.25762 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:17.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.284+0000 7f90975c9740 1 -- 172.21.15.3:0/2126181335 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a58c846790 con 0x55a58c7c14b0 2024-09-19T06:14:17.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.285+0000 7f9073400640 1 -- 172.21.15.3:0/2126181335 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9088036040 con 0x55a58c7c14b0 2024-09-19T06:14:17.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.285+0000 7f9073400640 1 -- 172.21.15.3:0/2126181335 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9078026570 con 0x55a58c7c14b0 2024-09-19T06:14:17.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.285+0000 7f90975c9740 10 client.25762 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:17.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.285+0000 7f90975c9740 10 client.25762 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:14:17.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.285+0000 7f90975c9740 20 client.25762 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:17.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.285+0000 7f90975c9740 1 --2- 172.21.15.3:0/2126181335 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a58c846ea0 0x55a58c8492c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:17.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.285+0000 7f90975c9740 4 client.25762 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:14:17.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.285+0000 7f90975c9740 1 -- 172.21.15.3:0/2126181335 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a58c72ee60 con 0x55a58c846ea0 2024-09-19T06:14:17.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.285+0000 7f908e800640 1 --2- 172.21.15.3:0/2126181335 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a58c846ea0 0x55a58c8492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:17.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.286+0000 7f908e800640 1 --2- 172.21.15.3:0/2126181335 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a58c846ea0 0x55a58c8492c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f019ef7fad1141c6 server_cookie=3f13ee55eeb9aadc in_seq=0 out_seq=0 2024-09-19T06:14:17.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.286+0000 7f9073400640 10 client.25762 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:17.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.286+0000 7f9073400640 1 -- 172.21.15.3:0/2126181335 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a58c72ee60 con 0x55a58c846ea0 2024-09-19T06:14:17.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.286+0000 7f9073400640 10 client.25762 handle_command_reply: tid=0 2024-09-19T06:14:17.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.286+0000 7f90975c9740 1 client.25762 shutdown 2024-09-19T06:14:17.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.286+0000 7f90975c9740 1 -- 172.21.15.3:0/2126181335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7c14b0 msgr2=0x55a58c7c6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:17.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.286+0000 7f90975c9740 1 --2- 172.21.15.3:0/2126181335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7c14b0 0x55a58c7c6210 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f909019faf0 tx=0x7f9078009f90 comp rx=0 tx=0).stop 2024-09-19T06:14:17.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.286+0000 7f90975c9740 1 -- 172.21.15.3:0/2126181335 shutdown_connections 2024-09-19T06:14:17.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.286+0000 7f90975c9740 1 --2- 172.21.15.3:0/2126181335 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a58c846ea0 0x55a58c8492c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.286+0000 7f90975c9740 1 --2- 172.21.15.3:0/2126181335 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a58c7cbd70 0x55a58c7c6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.286+0000 7f90975c9740 1 --2- 172.21.15.3:0/2126181335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a58c7c14b0 0x55a58c7c6210 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.286+0000 7f90975c9740 1 --2- 172.21.15.3:0/2126181335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a58c7c0b90 0x55a58c7c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.286+0000 7f9073400640 0 client.25762 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:17.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.286+0000 7f90975c9740 1 -- 172.21.15.3:0/2126181335 >> 172.21.15.3:0/2126181335 conn(0x55a58c7bd120 msgr2=0x55a58c7c2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:17.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.287+0000 7f90975c9740 1 -- 172.21.15.3:0/2126181335 shutdown_connections 2024-09-19T06:14:17.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.287+0000 7f90975c9740 1 -- 172.21.15.3:0/2126181335 wait complete. 2024-09-19T06:14:17.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.287+0000 7f90975c9740 20 client.25762 trim_cache size 0 max 16384 2024-09-19T06:14:17.308 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:14:17.308 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:14:17.308 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": { 2024-09-19T06:14:17.308 INFO:teuthology.orchestra.run.smithi003.stdout: "d336f3c6-0eda-40f8-8659-8753f24506b8": { 2024-09-19T06:14:17.308 INFO:teuthology.orchestra.run.smithi003.stdout: "path": "/", 2024-09-19T06:14:17.308 INFO:teuthology.orchestra.run.smithi003.stdout: "tag": "d336f3c6-0eda-40f8-8659-8753f24506b8", 2024-09-19T06:14:17.308 INFO:teuthology.orchestra.run.smithi003.stdout: "options": "recursive,force" 2024-09-19T06:14:17.308 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:14:17.308 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:14:17.308 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:14:17.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.287+0000 7f9094c00640 1 -- 172.21.15.3:0/2740443977 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f90740a33b0 msgr2=0x7f90740a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:17.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.287+0000 7f9094c00640 1 --2- 172.21.15.3:0/2740443977 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f90740a33b0 0x7f90740a5870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55a58c7bdf80 tx=0x7f9080084f90 comp rx=0 tx=0).stop 2024-09-19T06:14:17.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.287+0000 7f9094c00640 1 -- 172.21.15.3:0/2740443977 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9090076720 msgr2=0x7f909019eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:17.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.287+0000 7f9094c00640 1 --2- 172.21.15.3:0/2740443977 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9090076720 0x7f909019eb80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f908000d950 tx=0x7f908000de10 comp rx=0 tx=0).stop 2024-09-19T06:14:17.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.287+0000 7f9094c00640 1 -- 172.21.15.3:0/2740443977 shutdown_connections 2024-09-19T06:14:17.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.287+0000 7f9094c00640 1 --2- 172.21.15.3:0/2740443977 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f90740a33b0 0x7f90740a5870 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.287+0000 7f9094c00640 1 --2- 172.21.15.3:0/2740443977 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9090112a50 0x7f90901a3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.287+0000 7f9094c00640 1 --2- 172.21.15.3:0/2740443977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9090077040 0x7f909019f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.287+0000 7f9094c00640 1 --2- 172.21.15.3:0/2740443977 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9090076720 0x7f909019eb80 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:17.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.287+0000 7f9094c00640 1 -- 172.21.15.3:0/2740443977 >> 172.21.15.3:0/2740443977 conn(0x7f90900ffa50 msgr2=0x7f9090101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:17.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.288+0000 7f9094c00640 1 -- 172.21.15.3:0/2740443977 shutdown_connections 2024-09-19T06:14:17.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:17.288+0000 7f9094c00640 1 -- 172.21.15.3:0/2740443977 wait complete. 2024-09-19T06:14:17.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:16 smithi071 ceph-mon[35662]: scrub queued for path: / 2024-09-19T06:14:17.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:16 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:14:17.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:16 smithi071 ceph-mon[35662]: scrub summary: active paths [/] 2024-09-19T06:14:17.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:16 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:14:18.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:17 smithi003 ceph-mon[30893]: pgmap v60: 97 pgs: 97 active+clean; 1.8 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-09-19T06:14:18.189 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:17 smithi059 ceph-mon[35138]: pgmap v60: 97 pgs: 97 active+clean; 1.8 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-09-19T06:14:18.238 INFO:tasks.cephfs.filesystem:scrub status for tag:d336f3c6-0eda-40f8-8659-8753f24506b8 - {'path': '/', 'tag': 'd336f3c6-0eda-40f8-8659-8753f24506b8', 'options': 'recursive,force'} 2024-09-19T06:14:18.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:17 smithi071 ceph-mon[35662]: pgmap v60: 97 pgs: 97 active+clean; 1.8 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-09-19T06:14:20.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:19 smithi059 ceph-mon[35138]: pgmap v61: 97 pgs: 97 active+clean; 1.9 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 22 op/s 2024-09-19T06:14:20.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:19 smithi003 ceph-mon[30893]: pgmap v61: 97 pgs: 97 active+clean; 1.9 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 22 op/s 2024-09-19T06:14:20.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:19 smithi071 ceph-mon[35662]: pgmap v61: 97 pgs: 97 active+clean; 1.9 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 22 op/s 2024-09-19T06:14:21.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:20 smithi059 ceph-mon[35138]: scrub summary: idle 2024-09-19T06:14:21.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:20 smithi003 ceph-mon[30893]: scrub summary: idle 2024-09-19T06:14:21.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:20 smithi071 ceph-mon[35662]: scrub summary: idle 2024-09-19T06:14:22.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:21 smithi059 ceph-mon[35138]: pgmap v62: 97 pgs: 97 active+clean; 1.9 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T06:14:22.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:21 smithi003 ceph-mon[30893]: pgmap v62: 97 pgs: 97 active+clean; 1.9 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T06:14:22.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:21 smithi071 ceph-mon[35662]: pgmap v62: 97 pgs: 97 active+clean; 1.9 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-19T06:14:24.117 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.115+0000 7f3e1ac00640 1 -- 172.21.15.3:0/3221173037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e14109090 msgr2=0x7f3e14110be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:24.117 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.115+0000 7f3e1ac00640 1 --2- 172.21.15.3:0/3221173037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e14109090 0x7f3e14110be0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009860 tx=0x7f3e0c02a340 comp rx=0 tx=0).stop 2024-09-19T06:14:24.117 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.115+0000 7f3e1ac00640 1 -- 172.21.15.3:0/3221173037 shutdown_connections 2024-09-19T06:14:24.117 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.115+0000 7f3e1ac00640 1 --2- 172.21.15.3:0/3221173037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e14109090 0x7f3e14110be0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.117 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.115+0000 7f3e1ac00640 1 --2- 172.21.15.3:0/3221173037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e141048f0 0x7f3e14108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.115+0000 7f3e1ac00640 1 --2- 172.21.15.3:0/3221173037 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e14103f40 0x7f3e14104320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.115+0000 7f3e1ac00640 1 -- 172.21.15.3:0/3221173037 >> 172.21.15.3:0/3221173037 conn(0x7f3e140ff970 msgr2=0x7f3e14101d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:24.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.115+0000 7f3e1ac00640 1 -- 172.21.15.3:0/3221173037 shutdown_connections 2024-09-19T06:14:24.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.115+0000 7f3e1ac00640 1 -- 172.21.15.3:0/3221173037 wait complete. 2024-09-19T06:14:24.119 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.116+0000 7f3e1ac00640 1 Processor -- start 2024-09-19T06:14:24.119 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.116+0000 7f3e1ac00640 1 -- start start 2024-09-19T06:14:24.119 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.117+0000 7f3e1ac00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e14103f40 0x7f3e1419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:24.119 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.117+0000 7f3e1ac00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e14109090 0x7f3e1419abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:24.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.117+0000 7f3e1ac00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e1419ef40 0x7f3e1419f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:24.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.117+0000 7f3e1ac00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3e141140d0 con 0x7f3e14109090 2024-09-19T06:14:24.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.117+0000 7f3e1ac00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3e14113f50 con 0x7f3e1419ef40 2024-09-19T06:14:24.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.117+0000 7f3e1ac00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3e14114250 con 0x7f3e14103f40 2024-09-19T06:14:24.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.117+0000 7f3e0b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e14109090 0x7f3e1419abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:24.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.117+0000 7f3e0b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e14109090 0x7f3e1419abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51926/0 (socket says 172.21.15.3:51926) 2024-09-19T06:14:24.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.117+0000 7f3e0b400640 1 -- 172.21.15.3:0/3770659810 learned_addr learned my addr 172.21.15.3:0/3770659810 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:24.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.117+0000 7f3e13e00640 1 --2- 172.21.15.3:0/3770659810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e14103f40 0x7f3e1419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:24.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.117+0000 7f3e18c00640 1 --2- 172.21.15.3:0/3770659810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e1419ef40 0x7f3e1419f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:24.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.118+0000 7f3e0b400640 1 -- 172.21.15.3:0/3770659810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e14103f40 msgr2=0x7f3e1419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:24.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.118+0000 7f3e0b400640 1 --2- 172.21.15.3:0/3770659810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e14103f40 0x7f3e1419a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.118+0000 7f3e0b400640 1 -- 172.21.15.3:0/3770659810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e1419ef40 msgr2=0x7f3e1419f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:24.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.118+0000 7f3e0b400640 1 --2- 172.21.15.3:0/3770659810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e1419ef40 0x7f3e1419f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.118+0000 7f3e0b400640 1 -- 172.21.15.3:0/3770659810 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1419fa30 con 0x7f3e14109090 2024-09-19T06:14:24.121 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.118+0000 7f3e18c00640 1 --2- 172.21.15.3:0/3770659810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e1419ef40 0x7f3e1419f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:24.121 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.118+0000 7f3e0b400640 1 --2- 172.21.15.3:0/3770659810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e14109090 0x7f3e1419abc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00e9f0 tx=0x7f3dfc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:24.121 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.118+0000 7f3e11600640 1 -- 172.21.15.3:0/3770659810 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc00ccc0 con 0x7f3e14109090 2024-09-19T06:14:24.122 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.118+0000 7f3e11600640 1 -- 172.21.15.3:0/3770659810 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dfc005500 con 0x7f3e14109090 2024-09-19T06:14:24.122 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.118+0000 7f3e1ac00640 1 -- 172.21.15.3:0/3770659810 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1419fd20 con 0x7f3e14109090 2024-09-19T06:14:24.122 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.118+0000 7f3e11600640 1 -- 172.21.15.3:0/3770659810 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc010690 con 0x7f3e14109090 2024-09-19T06:14:24.122 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.118+0000 7f3e1ac00640 1 -- 172.21.15.3:0/3770659810 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e141a7510 con 0x7f3e14109090 2024-09-19T06:14:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.123+0000 7f3e1dc52740 1 Processor -- start 2024-09-19T06:14:24.124 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.123+0000 7f3e1dc52740 1 -- start start 2024-09-19T06:14:24.125 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.123+0000 7f3e1dc52740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c46001e0 0x5582c46005c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.123+0000 7f3e11600640 1 -- 172.21.15.3:0/3770659810 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f3dfc0046c0 con 0x7f3e14109090 2024-09-19T06:14:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.123+0000 7f3e1dc52740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c4600b00 0x5582c460ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.123+0000 7f3e1dc52740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c460b3a0 0x5582c460d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.123+0000 7f3e1dc52740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5582c4566100 con 0x5582c4600b00 2024-09-19T06:14:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.123+0000 7f3e1dc52740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5582c450e1b0 con 0x5582c460b3a0 2024-09-19T06:14:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.123+0000 7f3e1dc52740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5582c45620c0 con 0x5582c46001e0 2024-09-19T06:14:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.123+0000 7f3e18c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c46001e0 0x5582c46005c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.123+0000 7f3e18c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c46001e0 0x5582c46005c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:38374/0 (socket says 172.21.15.3:38374) 2024-09-19T06:14:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.123+0000 7f3e18c00640 1 -- 172.21.15.3:0/479337769 learned_addr learned my addr 172.21.15.3:0/479337769 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.123+0000 7f3e0b400640 1 --2- 172.21.15.3:0/479337769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c460b3a0 0x5582c460d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.124+0000 7f3e13e00640 1 --2- 172.21.15.3:0/479337769 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c4600b00 0x5582c460ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.124+0000 7f3e18c00640 1 -- 172.21.15.3:0/479337769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c460b3a0 msgr2=0x5582c460d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:24.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.124+0000 7f3e18c00640 1 --2- 172.21.15.3:0/479337769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c460b3a0 0x5582c460d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.124+0000 7f3e18c00640 1 -- 172.21.15.3:0/479337769 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c4600b00 msgr2=0x5582c460ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.124+0000 7f3e18c00640 1 --2- 172.21.15.3:0/479337769 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c4600b00 0x5582c460ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.127 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.124+0000 7f3e18c00640 1 -- 172.21.15.3:0/479337769 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582c4279210 con 0x5582c46001e0 2024-09-19T06:14:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.124+0000 7f3e18c00640 1 --2- 172.21.15.3:0/479337769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c46001e0 0x5582c46005c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009860 tx=0x7f3e0c005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54ed8ed19cc1dac5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.124+0000 7f3e09200640 1 -- 172.21.15.3:0/479337769 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c037040 con 0x5582c46001e0 2024-09-19T06:14:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.125+0000 7f3e09200640 1 -- 172.21.15.3:0/479337769 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e0c030550 con 0x5582c46001e0 2024-09-19T06:14:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.125+0000 7f3e09200640 1 -- 172.21.15.3:0/479337769 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c005500 con 0x5582c46001e0 2024-09-19T06:14:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.125+0000 7f3e11600640 1 --2- 172.21.15.3:0/3770659810 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3df80a3430 0x7f3df80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.125+0000 7f3e11600640 1 -- 172.21.15.3:0/3770659810 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f3dfc0d00c0 con 0x7f3e14109090 2024-09-19T06:14:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.125+0000 7f3e13e00640 1 --2- 172.21.15.3:0/3770659810 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3df80a3430 0x7f3df80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.125+0000 7f3e1dc52740 1 -- 172.21.15.3:0/479337769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c46001e0 msgr2=0x5582c46005c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.125+0000 7f3e1dc52740 1 --2- 172.21.15.3:0/479337769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c46001e0 0x5582c46005c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009860 tx=0x7f3e0c005dc0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.126+0000 7f3e1dc52740 1 -- 172.21.15.3:0/479337769 shutdown_connections 2024-09-19T06:14:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.126+0000 7f3e1dc52740 1 --2- 172.21.15.3:0/479337769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c460b3a0 0x5582c460d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.126+0000 7f3e1dc52740 1 --2- 172.21.15.3:0/479337769 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c4600b00 0x5582c460ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.129 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.126+0000 7f3e1dc52740 1 --2- 172.21.15.3:0/479337769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c46001e0 0x5582c46005c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.126+0000 7f3e1dc52740 1 -- 172.21.15.3:0/479337769 >> 172.21.15.3:0/479337769 conn(0x5582c45fc750 msgr2=0x5582c45fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.126+0000 7f3e1dc52740 1 -- 172.21.15.3:0/479337769 shutdown_connections 2024-09-19T06:14:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.126+0000 7f3e1dc52740 1 -- 172.21.15.3:0/479337769 wait complete. 2024-09-19T06:14:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.126+0000 7f3e13e00640 1 --2- 172.21.15.3:0/3770659810 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3df80a3430 0x7f3df80a58f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x5582c45fd5b0 tx=0x7f3e04010040 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.126+0000 7f3e1dc52740 1 -- start start 2024-09-19T06:14:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.126+0000 7f3e1dc52740 1 Processor -- start 2024-09-19T06:14:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.127+0000 7f3e1dc52740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c46001e0 0x5582c46082e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.127+0000 7f3e1dc52740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c4600b00 0x5582c4608820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.127+0000 7f3e1dc52740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c460b3a0 0x5582c4608d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.127+0000 7f3e1dc52740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5582c460df70 con 0x5582c460b3a0 2024-09-19T06:14:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.127+0000 7f3e1dc52740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5582c44ef090 con 0x5582c4600b00 2024-09-19T06:14:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.127+0000 7f3e1dc52740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5582c460e0f0 con 0x5582c46001e0 2024-09-19T06:14:24.130 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.127+0000 7f3e1dc52740 10 client.0 _ll_register_callbacks cb 0x5582c4543f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:24.132 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.127+0000 7f3e18c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c460b3a0 0x5582c4608d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:24.132 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.127+0000 7f3e13e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c46001e0 0x5582c46082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:24.132 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.127+0000 7f3e18c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c460b3a0 0x5582c4608d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51946/0 (socket says 172.21.15.3:51946) 2024-09-19T06:14:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.127+0000 7f3e18c00640 1 -- 172.21.15.3:0/4024991593 learned_addr learned my addr 172.21.15.3:0/4024991593 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.127+0000 7f3e0b400640 1 --2- 172.21.15.3:0/4024991593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c4600b00 0x5582c4608820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.128+0000 7f3e18c00640 1 -- 172.21.15.3:0/4024991593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c46001e0 msgr2=0x5582c46082e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.128+0000 7f3e18c00640 1 --2- 172.21.15.3:0/4024991593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c46001e0 0x5582c46082e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.128+0000 7f3e18c00640 1 -- 172.21.15.3:0/4024991593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c4600b00 msgr2=0x5582c4608820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.128+0000 7f3e18c00640 1 --2- 172.21.15.3:0/4024991593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c4600b00 0x5582c4608820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.128+0000 7f3e18c00640 1 -- 172.21.15.3:0/4024991593 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582c4345620 con 0x5582c460b3a0 2024-09-19T06:14:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.128+0000 7f3e18c00640 1 --2- 172.21.15.3:0/4024991593 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c460b3a0 0x5582c4608d60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009830 tx=0x7f3e0c005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c533c1167f7d5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.128+0000 7f3e01600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:14:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.128+0000 7f3e01600640 1 -- 172.21.15.3:0/4024991593 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c037070 con 0x5582c460b3a0 2024-09-19T06:14:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.128+0000 7f3e01600640 1 -- 172.21.15.3:0/4024991593 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f3e0c004040 con 0x5582c460b3a0 2024-09-19T06:14:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.128+0000 7f3e1dc52740 1 -- 172.21.15.3:0/4024991593 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e0c030550 con 0x5582c460b3a0 2024-09-19T06:14:24.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.129+0000 7f3e01600640 1 -- 172.21.15.3:0/4024991593 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3e0c004240 con 0x5582c460b3a0 2024-09-19T06:14:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.129+0000 7f3e1dc52740 10 client.15723 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.129+0000 7f3e1dc52740 1 -- 172.21.15.3:0/4024991593 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5582c4619b70 con 0x5582c460b3a0 2024-09-19T06:14:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.129+0000 7f3e01600640 1 -- 172.21.15.3:0/4024991593 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e0c030550 con 0x5582c460b3a0 2024-09-19T06:14:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.129+0000 7f3e01600640 1 -- 172.21.15.3:0/4024991593 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3e0c0035f0 con 0x5582c460b3a0 2024-09-19T06:14:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.129+0000 7f3e1dc52740 10 client.15723 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.129+0000 7f3e1dc52740 10 client.15723 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:14:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.129+0000 7f3e1dc52740 20 client.15723 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.129+0000 7f3e1dc52740 1 --2- 172.21.15.3:0/4024991593 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5582c461aec0 0x5582c461d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.129+0000 7f3e1dc52740 4 client.15723 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:14:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.129+0000 7f3e1dc52740 1 -- 172.21.15.3:0/4024991593 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582c4573830 con 0x5582c461aec0 2024-09-19T06:14:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.130+0000 7f3e13e00640 1 --2- 172.21.15.3:0/4024991593 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5582c461aec0 0x5582c461d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.130+0000 7f3e13e00640 1 --2- 172.21.15.3:0/4024991593 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5582c461aec0 0x5582c461d2b0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81e46399eafea7a6 server_cookie=8be1f2288e3d143c in_seq=0 out_seq=0 2024-09-19T06:14:24.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.130+0000 7f3e01600640 10 client.15723 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:24.135 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.131+0000 7f3e01600640 1 -- 172.21.15.3:0/4024991593 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5582c4573830 con 0x5582c461aec0 2024-09-19T06:14:24.135 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.131+0000 7f3e01600640 10 client.15723 handle_command_reply: tid=0 2024-09-19T06:14:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.131+0000 7f3e1dc52740 1 client.15723 shutdown 2024-09-19T06:14:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.131+0000 7f3e1dc52740 1 -- 172.21.15.3:0/4024991593 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c460b3a0 msgr2=0x5582c4608d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.131+0000 7f3e1dc52740 1 --2- 172.21.15.3:0/4024991593 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c460b3a0 0x5582c4608d60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009830 tx=0x7f3e0c005c90 comp rx=0 tx=0).stop 2024-09-19T06:14:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.131+0000 7f3e1dc52740 1 -- 172.21.15.3:0/4024991593 shutdown_connections 2024-09-19T06:14:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.131+0000 7f3e1dc52740 1 --2- 172.21.15.3:0/4024991593 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5582c461aec0 0x5582c461d2b0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.131+0000 7f3e1dc52740 1 --2- 172.21.15.3:0/4024991593 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c460b3a0 0x5582c4608d60 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.131+0000 7f3e1dc52740 1 --2- 172.21.15.3:0/4024991593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c4600b00 0x5582c4608820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.131+0000 7f3e1dc52740 1 --2- 172.21.15.3:0/4024991593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c46001e0 0x5582c46082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.131+0000 7f3e01600640 0 client.15723 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.131+0000 7f3e1dc52740 1 -- 172.21.15.3:0/4024991593 >> 172.21.15.3:0/4024991593 conn(0x5582c45fc750 msgr2=0x5582c46024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.132+0000 7f3e1dc52740 1 -- 172.21.15.3:0/4024991593 shutdown_connections 2024-09-19T06:14:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.132+0000 7f3e1dc52740 1 -- 172.21.15.3:0/4024991593 wait complete. 2024-09-19T06:14:24.136 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.132+0000 7f3e1dc52740 20 client.15723 trim_cache size 0 max 16384 2024-09-19T06:14:24.150 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.147+0000 7f3e1dc52740 1 Processor -- start 2024-09-19T06:14:24.150 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.147+0000 7f3e1dc52740 1 -- start start 2024-09-19T06:14:24.151 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.147+0000 7f3e1dc52740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c46001e0 0x5582c45f78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:24.151 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.147+0000 7f3e1dc52740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c4600b00 0x5582c4622880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:24.151 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.147+0000 7f3e1dc52740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c460b3a0 0x5582c4622dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:24.151 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.147+0000 7f3e1dc52740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3e141afa80 con 0x5582c46001e0 2024-09-19T06:14:24.151 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.147+0000 7f3e1dc52740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3e141b15c0 con 0x5582c460b3a0 2024-09-19T06:14:24.151 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.147+0000 7f3e1dc52740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3e141b0150 con 0x5582c4600b00 2024-09-19T06:14:24.151 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.148+0000 7f3e13e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c46001e0 0x5582c45f78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:24.151 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.148+0000 7f3e0b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c4600b00 0x5582c4622880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:24.151 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.148+0000 7f3e18c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c460b3a0 0x5582c4622dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:24.151 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.148+0000 7f3e0b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c4600b00 0x5582c4622880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:38404/0 (socket says 172.21.15.3:38404) 2024-09-19T06:14:24.151 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.148+0000 7f3e0b400640 1 -- 172.21.15.3:0/941980304 learned_addr learned my addr 172.21.15.3:0/941980304 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:24.151 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.148+0000 7f3e0b400640 1 -- 172.21.15.3:0/941980304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c460b3a0 msgr2=0x5582c4622dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:24.151 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.148+0000 7f3e0b400640 1 --2- 172.21.15.3:0/941980304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c460b3a0 0x5582c4622dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.151 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.148+0000 7f3e0b400640 1 -- 172.21.15.3:0/941980304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c46001e0 msgr2=0x5582c45f78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.148+0000 7f3e0b400640 1 --2- 172.21.15.3:0/941980304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c46001e0 0x5582c45f78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.148+0000 7f3e0b400640 1 -- 172.21.15.3:0/941980304 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582c45fff60 con 0x5582c4600b00 2024-09-19T06:14:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.148+0000 7f3e18c00640 1 --2- 172.21.15.3:0/941980304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c460b3a0 0x5582c4622dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.148+0000 7f3e0b400640 1 --2- 172.21.15.3:0/941980304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c4600b00 0x5582c4622880 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc098d10 tx=0x7f3dfc004ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f912220c46eeaf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.149+0000 7f3e03e00640 1 -- 172.21.15.3:0/941980304 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc09be80 con 0x5582c4600b00 2024-09-19T06:14:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.149+0000 7f3e03e00640 1 -- 172.21.15.3:0/941980304 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dfc09ca40 con 0x5582c4600b00 2024-09-19T06:14:24.152 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.149+0000 7f3e03e00640 1 -- 172.21.15.3:0/941980304 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc0056b0 con 0x5582c4600b00 2024-09-19T06:14:24.155 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.149+0000 7f3e1dc52740 1 -- 172.21.15.3:0/941980304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c4600b00 msgr2=0x5582c4622880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:24.155 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.149+0000 7f3e1dc52740 1 --2- 172.21.15.3:0/941980304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c4600b00 0x5582c4622880 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc098d10 tx=0x7f3dfc004ba0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.155 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.149+0000 7f3e1dc52740 1 -- 172.21.15.3:0/941980304 shutdown_connections 2024-09-19T06:14:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.149+0000 7f3e1dc52740 1 --2- 172.21.15.3:0/941980304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c460b3a0 0x5582c4622dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.149+0000 7f3e1dc52740 1 --2- 172.21.15.3:0/941980304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c4600b00 0x5582c4622880 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.149+0000 7f3e1dc52740 1 --2- 172.21.15.3:0/941980304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c46001e0 0x5582c45f78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.149+0000 7f3e1dc52740 1 -- 172.21.15.3:0/941980304 >> 172.21.15.3:0/941980304 conn(0x5582c45fc750 msgr2=0x5582c46073b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.149+0000 7f3e1dc52740 1 -- 172.21.15.3:0/941980304 shutdown_connections 2024-09-19T06:14:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.149+0000 7f3e1dc52740 1 -- 172.21.15.3:0/941980304 wait complete. 2024-09-19T06:14:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.150+0000 7f3e1dc52740 1 -- start start 2024-09-19T06:14:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.150+0000 7f3e1dc52740 1 Processor -- start 2024-09-19T06:14:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.150+0000 7f3e1dc52740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c46001e0 0x5582c4613630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.150+0000 7f3e1dc52740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c4600b00 0x5582c4613b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.150+0000 7f3e1dc52740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c460b3a0 0x5582c4604d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.150+0000 7f3e1dc52740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3e141b0ef0 con 0x5582c4600b00 2024-09-19T06:14:24.156 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.150+0000 7f3e1dc52740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3e141b0820 con 0x5582c460b3a0 2024-09-19T06:14:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.150+0000 7f3e1dc52740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3e141ada80 con 0x5582c46001e0 2024-09-19T06:14:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.150+0000 7f3e1dc52740 10 client.0 _ll_register_callbacks cb 0x7f3e04009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.151+0000 7f3e0b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c4600b00 0x5582c4613b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.151+0000 7f3e0b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c4600b00 0x5582c4613b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51970/0 (socket says 172.21.15.3:51970) 2024-09-19T06:14:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.151+0000 7f3e0b400640 1 -- 172.21.15.3:0/654654917 learned_addr learned my addr 172.21.15.3:0/654654917 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.151+0000 7f3e13e00640 1 --2- 172.21.15.3:0/654654917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c46001e0 0x5582c4613630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.151+0000 7f3e18c00640 1 --2- 172.21.15.3:0/654654917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c460b3a0 0x5582c4604d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.151+0000 7f3e0b400640 1 -- 172.21.15.3:0/654654917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c46001e0 msgr2=0x5582c4613630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.151+0000 7f3e0b400640 1 --2- 172.21.15.3:0/654654917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c46001e0 0x5582c4613630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.151+0000 7f3e0b400640 1 -- 172.21.15.3:0/654654917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c460b3a0 msgr2=0x5582c4604d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.151+0000 7f3e0b400640 1 --2- 172.21.15.3:0/654654917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c460b3a0 0x5582c4604d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.151+0000 7f3e0b400640 1 -- 172.21.15.3:0/654654917 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582c46055a0 con 0x5582c4600b00 2024-09-19T06:14:24.157 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.151+0000 7f3e0b400640 1 --2- 172.21.15.3:0/654654917 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c4600b00 0x5582c4613b70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc0a4a80 tx=0x7f3dfc0d03b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10cd82ee0567f5af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.151+0000 7f3e01600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:14:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.152+0000 7f3e01600640 1 -- 172.21.15.3:0/654654917 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc09bca0 con 0x5582c4600b00 2024-09-19T06:14:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.152+0000 7f3e01600640 1 -- 172.21.15.3:0/654654917 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f3dfc09a640 con 0x5582c4600b00 2024-09-19T06:14:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.152+0000 7f3e1dc52740 1 -- 172.21.15.3:0/654654917 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dfc09ca40 con 0x5582c4600b00 2024-09-19T06:14:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.152+0000 7f3e01600640 1 -- 172.21.15.3:0/654654917 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3dfc0056b0 con 0x5582c4600b00 2024-09-19T06:14:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.152+0000 7f3e1dc52740 10 client.15729 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.152+0000 7f3e1dc52740 1 -- 172.21.15.3:0/654654917 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5582c4685460 con 0x5582c4600b00 2024-09-19T06:14:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.152+0000 7f3e01600640 1 -- 172.21.15.3:0/654654917 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dfc09ca40 con 0x5582c4600b00 2024-09-19T06:14:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.152+0000 7f3e01600640 1 -- 172.21.15.3:0/654654917 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3dfc09b790 con 0x5582c4600b00 2024-09-19T06:14:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.152+0000 7f3e1dc52740 10 client.15729 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.152+0000 7f3e1dc52740 10 client.15729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:14:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.152+0000 7f3e1dc52740 20 client.15729 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.152+0000 7f3e1dc52740 1 --2- 172.21.15.3:0/654654917 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5582c4685b10 0x5582c4687f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:24.158 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.152+0000 7f3e1dc52740 4 client.15729 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:14:24.159 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.152+0000 7f3e1dc52740 1 -- 172.21.15.3:0/654654917 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5582c456db80 con 0x5582c4685b10 2024-09-19T06:14:24.159 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.153+0000 7f3e13e00640 1 --2- 172.21.15.3:0/654654917 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5582c4685b10 0x5582c4687f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:24.159 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.153+0000 7f3e13e00640 1 --2- 172.21.15.3:0/654654917 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5582c4685b10 0x5582c4687f30 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91531f8b8b2de16f server_cookie=a86206d5d5d7f41f in_seq=0 out_seq=0 2024-09-19T06:14:24.159 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.153+0000 7f3e01600640 10 client.15729 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:24.170 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.168+0000 7f3e01600640 1 -- 172.21.15.3:0/654654917 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5582c456db80 con 0x5582c4685b10 2024-09-19T06:14:24.170 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.168+0000 7f3e01600640 10 client.15729 handle_command_reply: tid=0 2024-09-19T06:14:24.170 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.168+0000 7f3e1dc52740 1 client.15729 shutdown 2024-09-19T06:14:24.170 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.168+0000 7f3e1dc52740 1 -- 172.21.15.3:0/654654917 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c4600b00 msgr2=0x5582c4613b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:24.170 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.168+0000 7f3e1dc52740 1 --2- 172.21.15.3:0/654654917 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c4600b00 0x5582c4613b70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc0a4a80 tx=0x7f3dfc0d03b0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.170 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.168+0000 7f3e1dc52740 1 -- 172.21.15.3:0/654654917 shutdown_connections 2024-09-19T06:14:24.171 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.168+0000 7f3e1dc52740 1 --2- 172.21.15.3:0/654654917 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5582c4685b10 0x5582c4687f30 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.171 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.168+0000 7f3e1dc52740 1 --2- 172.21.15.3:0/654654917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c460b3a0 0x5582c4604d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.171 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.168+0000 7f3e1dc52740 1 --2- 172.21.15.3:0/654654917 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c4600b00 0x5582c4613b70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.171 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.168+0000 7f3e01600640 0 client.15729 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:24.171 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.168+0000 7f3e1dc52740 1 --2- 172.21.15.3:0/654654917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c46001e0 0x5582c4613630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.171 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.168+0000 7f3e1dc52740 1 -- 172.21.15.3:0/654654917 >> 172.21.15.3:0/654654917 conn(0x5582c45fc750 msgr2=0x5582c45fb010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:24.171 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.168+0000 7f3e1dc52740 1 -- 172.21.15.3:0/654654917 shutdown_connections 2024-09-19T06:14:24.171 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.168+0000 7f3e1dc52740 1 -- 172.21.15.3:0/654654917 wait complete. 2024-09-19T06:14:24.171 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.168+0000 7f3e1dc52740 20 client.15729 trim_cache size 0 max 16384 2024-09-19T06:14:24.171 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:14:24.172 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:14:24.172 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:14:24.172 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:14:24.172 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.169+0000 7f3e1ac00640 1 -- 172.21.15.3:0/3770659810 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3df80a3430 msgr2=0x7f3df80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:24.172 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.169+0000 7f3e1ac00640 1 --2- 172.21.15.3:0/3770659810 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3df80a3430 0x7f3df80a58f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x5582c45fd5b0 tx=0x7f3e04010040 comp rx=0 tx=0).stop 2024-09-19T06:14:24.172 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.169+0000 7f3e1ac00640 1 -- 172.21.15.3:0/3770659810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e14109090 msgr2=0x7f3e1419abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:24.173 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.169+0000 7f3e1ac00640 1 --2- 172.21.15.3:0/3770659810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e14109090 0x7f3e1419abc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00e9f0 tx=0x7f3dfc00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.173 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.169+0000 7f3e1ac00640 1 -- 172.21.15.3:0/3770659810 shutdown_connections 2024-09-19T06:14:24.173 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.169+0000 7f3e1ac00640 1 --2- 172.21.15.3:0/3770659810 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3df80a3430 0x7f3df80a58f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.173 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.169+0000 7f3e1ac00640 1 --2- 172.21.15.3:0/3770659810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e1419ef40 0x7f3e1419f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.173 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.169+0000 7f3e1ac00640 1 --2- 172.21.15.3:0/3770659810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e14109090 0x7f3e1419abc0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.173 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.169+0000 7f3e1ac00640 1 --2- 172.21.15.3:0/3770659810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3e14103f40 0x7f3e1419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:24.173 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.169+0000 7f3e1ac00640 1 -- 172.21.15.3:0/3770659810 >> 172.21.15.3:0/3770659810 conn(0x7f3e140ff970 msgr2=0x7f3e14100cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:24.173 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.169+0000 7f3e1ac00640 1 -- 172.21.15.3:0/3770659810 shutdown_connections 2024-09-19T06:14:24.173 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:24.169+0000 7f3e1ac00640 1 -- 172.21.15.3:0/3770659810 wait complete. 2024-09-19T06:14:24.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:23 smithi059 ceph-mon[35138]: pgmap v63: 97 pgs: 97 active+clean; 1.9 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T06:14:24.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:23 smithi003 ceph-mon[30893]: pgmap v63: 97 pgs: 97 active+clean; 1.9 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T06:14:24.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:23 smithi071 ceph-mon[35662]: pgmap v63: 97 pgs: 97 active+clean; 1.9 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T06:14:26.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:25 smithi059 ceph-mon[35138]: pgmap v64: 97 pgs: 97 active+clean; 2.0 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 23 op/s 2024-09-19T06:14:26.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:25 smithi003 ceph-mon[30893]: pgmap v64: 97 pgs: 97 active+clean; 2.0 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 23 op/s 2024-09-19T06:14:26.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:25 smithi071 ceph-mon[35662]: pgmap v64: 97 pgs: 97 active+clean; 2.0 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 23 op/s 2024-09-19T06:14:28.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:27 smithi059 ceph-mon[35138]: pgmap v65: 97 pgs: 97 active+clean; 2.0 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-09-19T06:14:28.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:27 smithi003 ceph-mon[30893]: pgmap v65: 97 pgs: 97 active+clean; 2.0 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-09-19T06:14:28.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:27 smithi071 ceph-mon[35662]: pgmap v65: 97 pgs: 97 active+clean; 2.0 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 14 op/s 2024-09-19T06:14:30.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:29 smithi003 ceph-mon[30893]: pgmap v66: 97 pgs: 97 active+clean; 2.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-09-19T06:14:30.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:29 smithi059 ceph-mon[35138]: pgmap v66: 97 pgs: 97 active+clean; 2.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-09-19T06:14:30.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:29 smithi071 ceph-mon[35662]: pgmap v66: 97 pgs: 97 active+clean; 2.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-09-19T06:14:32.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:31 smithi059 ceph-mon[35138]: pgmap v67: 97 pgs: 97 active+clean; 2.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-19T06:14:32.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:31 smithi003 ceph-mon[30893]: pgmap v67: 97 pgs: 97 active+clean; 2.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-19T06:14:32.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:31 smithi071 ceph-mon[35662]: pgmap v67: 97 pgs: 97 active+clean; 2.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 16 op/s 2024-09-19T06:14:34.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:33 smithi059 ceph-mon[35138]: pgmap v68: 97 pgs: 97 active+clean; 2.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T06:14:34.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:33 smithi003 ceph-mon[30893]: pgmap v68: 97 pgs: 97 active+clean; 2.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T06:14:34.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:33 smithi071 ceph-mon[35662]: pgmap v68: 97 pgs: 97 active+clean; 2.1 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T06:14:36.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:35 smithi059 ceph-mon[35138]: pgmap v69: 97 pgs: 97 active+clean; 2.2 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-09-19T06:14:36.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:35 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:14:36.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:35 smithi003 ceph-mon[30893]: pgmap v69: 97 pgs: 97 active+clean; 2.2 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-09-19T06:14:36.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:35 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:14:36.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:35 smithi071 ceph-mon[35662]: pgmap v69: 97 pgs: 97 active+clean; 2.2 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-09-19T06:14:36.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:35 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:14:37.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:36 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:14:37.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:36 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:14:37.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:36 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:14:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.289+0000 7faac7800640 1 -- 172.21.15.3:0/739608372 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faac0101ac0 msgr2=0x7faac0101f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.289+0000 7faac7800640 1 --2- 172.21.15.3:0/739608372 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faac0101ac0 0x7faac0101f20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7faaa8009930 tx=0x7faaa802a420 comp rx=0 tx=0).stop 2024-09-19T06:14:37.290 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.289+0000 7faac7800640 1 -- 172.21.15.3:0/739608372 shutdown_connections 2024-09-19T06:14:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.289+0000 7faac7800640 1 --2- 172.21.15.3:0/739608372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac0102460 0x7faac010e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.289+0000 7faac7800640 1 --2- 172.21.15.3:0/739608372 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faac0101ac0 0x7faac0101f20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.289+0000 7faac7800640 1 --2- 172.21.15.3:0/739608372 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac0107ad0 0x7faac0107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.289+0000 7faac7800640 1 -- 172.21.15.3:0/739608372 >> 172.21.15.3:0/739608372 conn(0x7faac00fd7e0 msgr2=0x7faac00ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.289+0000 7faac7800640 1 -- 172.21.15.3:0/739608372 shutdown_connections 2024-09-19T06:14:37.291 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.289+0000 7faac7800640 1 -- 172.21.15.3:0/739608372 wait complete. 2024-09-19T06:14:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.290+0000 7faac7800640 1 Processor -- start 2024-09-19T06:14:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.290+0000 7faac7800640 1 -- start start 2024-09-19T06:14:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.291+0000 7faac7800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac0101ac0 0x7faac019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.291+0000 7faac7800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faac0102460 0x7faac019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:37.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.291+0000 7faac7800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac0107ad0 0x7faac019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.291+0000 7faac7800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7faac0111f60 con 0x7faac0102460 2024-09-19T06:14:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.291+0000 7faac7800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faac0111de0 con 0x7faac0101ac0 2024-09-19T06:14:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.291+0000 7faac7800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faac01120e0 con 0x7faac0107ad0 2024-09-19T06:14:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.291+0000 7faab7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faac0102460 0x7faac019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.291+0000 7faac4e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac0101ac0 0x7faac019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.291+0000 7faab7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faac0102460 0x7faac019abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34522/0 (socket says 172.21.15.3:34522) 2024-09-19T06:14:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.291+0000 7faab7e00640 1 -- 172.21.15.3:0/3628328373 learned_addr learned my addr 172.21.15.3:0/3628328373 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.291+0000 7faac5800640 1 --2- 172.21.15.3:0/3628328373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac0107ad0 0x7faac019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.291+0000 7faab7e00640 1 -- 172.21.15.3:0/3628328373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac0107ad0 msgr2=0x7faac019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.291+0000 7faab7e00640 1 --2- 172.21.15.3:0/3628328373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac0107ad0 0x7faac019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.291+0000 7faab7e00640 1 -- 172.21.15.3:0/3628328373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac0101ac0 msgr2=0x7faac019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:37.295 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.291+0000 7faab7e00640 1 --2- 172.21.15.3:0/3628328373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac0101ac0 0x7faac019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.291+0000 7faab7e00640 1 -- 172.21.15.3:0/3628328373 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac019f660 con 0x7faac0102460 2024-09-19T06:14:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.292+0000 7faac5800640 1 --2- 172.21.15.3:0/3628328373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac0107ad0 0x7faac019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.292+0000 7faab7e00640 1 --2- 172.21.15.3:0/3628328373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faac0102460 0x7faac019abb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faaa802a940 tx=0x7faaa8003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.292+0000 7faabe000640 1 -- 172.21.15.3:0/3628328373 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa803f070 con 0x7faac0102460 2024-09-19T06:14:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.292+0000 7faabe000640 1 -- 172.21.15.3:0/3628328373 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faaa8031c90 con 0x7faac0102460 2024-09-19T06:14:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.292+0000 7faac7800640 1 -- 172.21.15.3:0/3628328373 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac019f8f0 con 0x7faac0102460 2024-09-19T06:14:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.292+0000 7faabe000640 1 -- 172.21.15.3:0/3628328373 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa8035030 con 0x7faac0102460 2024-09-19T06:14:37.296 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.292+0000 7faac7800640 1 -- 172.21.15.3:0/3628328373 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faac01a71e0 con 0x7faac0102460 2024-09-19T06:14:37.302 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.295+0000 7faaca5bf740 1 Processor -- start 2024-09-19T06:14:37.303 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.295+0000 7faabe000640 1 -- 172.21.15.3:0/3628328373 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7faaa8042070 con 0x7faac0102460 2024-09-19T06:14:37.303 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.295+0000 7faaca5bf740 1 -- start start 2024-09-19T06:14:37.303 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.296+0000 7faaca5bf740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40d6dc1e0 0x55a40d6dc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:37.303 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.296+0000 7faaca5bf740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6dcb00 0x55a40d6e6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:37.303 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.296+0000 7faaca5bf740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a40d6e73a0 0x55a40d6e9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:37.303 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.296+0000 7faaca5bf740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a40d642100 con 0x55a40d6dcb00 2024-09-19T06:14:37.303 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.296+0000 7faaca5bf740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a40d5ea1b0 con 0x55a40d6e73a0 2024-09-19T06:14:37.303 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.296+0000 7faaca5bf740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a40d63e0c0 con 0x55a40d6dc1e0 2024-09-19T06:14:37.303 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.296+0000 7faac4e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6dcb00 0x55a40d6e6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:37.304 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.296+0000 7faac4e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6dcb00 0x55a40d6e6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34534/0 (socket says 172.21.15.3:34534) 2024-09-19T06:14:37.304 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.296+0000 7faac4e00640 1 -- 172.21.15.3:0/4264648570 learned_addr learned my addr 172.21.15.3:0/4264648570 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:37.304 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.296+0000 7faac5800640 1 --2- 172.21.15.3:0/4264648570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40d6dc1e0 0x55a40d6dc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:37.304 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.296+0000 7faab7e00640 1 --2- 172.21.15.3:0/4264648570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a40d6e73a0 0x55a40d6e9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:37.304 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.296+0000 7faac4e00640 1 -- 172.21.15.3:0/4264648570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40d6dc1e0 msgr2=0x55a40d6dc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:37.304 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.296+0000 7faac4e00640 1 --2- 172.21.15.3:0/4264648570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40d6dc1e0 0x55a40d6dc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.304 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.296+0000 7faac4e00640 1 -- 172.21.15.3:0/4264648570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a40d6e73a0 msgr2=0x55a40d6e9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:37.304 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.296+0000 7faac4e00640 1 --2- 172.21.15.3:0/4264648570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a40d6e73a0 0x55a40d6e9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.305 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.296+0000 7faac4e00640 1 -- 172.21.15.3:0/4264648570 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a40d355210 con 0x55a40d6dcb00 2024-09-19T06:14:37.305 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.297+0000 7faac4e00640 1 --2- 172.21.15.3:0/4264648570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6dcb00 0x55a40d6e6e60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7faab0009ca0 tx=0x7faab0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2595c71a8258107 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:37.305 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.297+0000 7faabe000640 1 --2- 172.21.15.3:0/3628328373 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7faaa40a33b0 0x7faaa40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:37.305 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.297+0000 7faab6000640 1 -- 172.21.15.3:0/4264648570 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab001e070 con 0x55a40d6dcb00 2024-09-19T06:14:37.305 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.297+0000 7faab6000640 1 -- 172.21.15.3:0/4264648570 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faab0019b10 con 0x55a40d6dcb00 2024-09-19T06:14:37.305 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.297+0000 7faab6000640 1 -- 172.21.15.3:0/4264648570 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab000eae0 con 0x55a40d6dcb00 2024-09-19T06:14:37.305 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.297+0000 7faabe000640 1 -- 172.21.15.3:0/3628328373 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7faaa80f0410 con 0x7faac0102460 2024-09-19T06:14:37.305 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.297+0000 7faac5800640 1 --2- 172.21.15.3:0/3628328373 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7faaa40a33b0 0x7faaa40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:37.305 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.298+0000 7faaca5bf740 1 -- 172.21.15.3:0/4264648570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6dcb00 msgr2=0x55a40d6e6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:37.305 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.298+0000 7faaca5bf740 1 --2- 172.21.15.3:0/4264648570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6dcb00 0x55a40d6e6e60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7faab0009ca0 tx=0x7faab0011810 comp rx=0 tx=0).stop 2024-09-19T06:14:37.306 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.298+0000 7faaca5bf740 1 -- 172.21.15.3:0/4264648570 shutdown_connections 2024-09-19T06:14:37.306 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.298+0000 7faaca5bf740 1 --2- 172.21.15.3:0/4264648570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a40d6e73a0 0x55a40d6e9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.306 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.298+0000 7faaca5bf740 1 --2- 172.21.15.3:0/4264648570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6dcb00 0x55a40d6e6e60 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.306 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.298+0000 7faaca5bf740 1 --2- 172.21.15.3:0/4264648570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40d6dc1e0 0x55a40d6dc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.306 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.298+0000 7faaca5bf740 1 -- 172.21.15.3:0/4264648570 >> 172.21.15.3:0/4264648570 conn(0x55a40d6d8750 msgr2=0x55a40d6d8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:37.306 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.298+0000 7faac5800640 1 --2- 172.21.15.3:0/3628328373 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7faaa40a33b0 0x7faaa40a5870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faab8005fd0 tx=0x7faab80096a0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:37.306 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.298+0000 7faaca5bf740 1 -- 172.21.15.3:0/4264648570 shutdown_connections 2024-09-19T06:14:37.306 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.298+0000 7faaca5bf740 1 -- 172.21.15.3:0/4264648570 wait complete. 2024-09-19T06:14:37.306 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.298+0000 7faaca5bf740 1 -- start start 2024-09-19T06:14:37.306 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.299+0000 7faaca5bf740 1 Processor -- start 2024-09-19T06:14:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.299+0000 7faaca5bf740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6dc1e0 0x55a40d6e4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.299+0000 7faaca5bf740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40d6dcb00 0x55a40d6e4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.299+0000 7faaca5bf740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a40d6e73a0 0x55a40d6e4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.299+0000 7faaca5bf740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a40d6e9f70 con 0x55a40d6dc1e0 2024-09-19T06:14:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.299+0000 7faaca5bf740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a40d5cb090 con 0x55a40d6e73a0 2024-09-19T06:14:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.299+0000 7faaca5bf740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a40d6ea0f0 con 0x55a40d6dcb00 2024-09-19T06:14:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.299+0000 7faaca5bf740 10 client.0 _ll_register_callbacks cb 0x55a40d61ff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.299+0000 7faac4e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6dc1e0 0x55a40d6e4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:37.307 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.299+0000 7faab7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40d6dcb00 0x55a40d6e4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.299+0000 7faac5800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a40d6e73a0 0x55a40d6e4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.299+0000 7faab7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40d6dcb00 0x55a40d6e4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:49872/0 (socket says 172.21.15.3:49872) 2024-09-19T06:14:37.308 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.299+0000 7faab7e00640 1 -- 172.21.15.3:0/3733604626 learned_addr learned my addr 172.21.15.3:0/3733604626 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.300+0000 7faac5800640 1 -- 172.21.15.3:0/3733604626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40d6dcb00 msgr2=0x55a40d6e4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.300+0000 7faac5800640 1 --2- 172.21.15.3:0/3733604626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40d6dcb00 0x55a40d6e4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.300+0000 7faac5800640 1 -- 172.21.15.3:0/3733604626 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6dc1e0 msgr2=0x55a40d6e4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.300+0000 7faac5800640 1 --2- 172.21.15.3:0/3733604626 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6dc1e0 0x55a40d6e4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.300+0000 7faac5800640 1 -- 172.21.15.3:0/3733604626 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a40d421620 con 0x55a40d6e73a0 2024-09-19T06:14:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.300+0000 7faac4e00640 1 --2- 172.21.15.3:0/3733604626 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6dc1e0 0x55a40d6e4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.300+0000 7faac5800640 1 --2- 172.21.15.3:0/3733604626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a40d6e73a0 0x55a40d6e4ea0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7faab8010ba0 tx=0x7faab8004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d33ba43414477c31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.300+0000 7faaaea00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:14:37.309 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.300+0000 7faaaea00640 1 -- 172.21.15.3:0/3733604626 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab801fd40 con 0x55a40d6e73a0 2024-09-19T06:14:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.300+0000 7faaca5bf740 1 -- 172.21.15.3:0/3733604626 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faab0019b10 con 0x55a40d6e73a0 2024-09-19T06:14:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.300+0000 7faaaea00640 1 -- 172.21.15.3:0/3733604626 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7faab801c3f0 con 0x55a40d6e73a0 2024-09-19T06:14:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.301+0000 7faaaea00640 1 -- 172.21.15.3:0/3733604626 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faab801c630 con 0x55a40d6e73a0 2024-09-19T06:14:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.301+0000 7faaca5bf740 10 client.25793 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.301+0000 7faaca5bf740 1 -- 172.21.15.3:0/3733604626 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a40d6f5cc0 con 0x55a40d6e73a0 2024-09-19T06:14:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.301+0000 7faaaea00640 1 -- 172.21.15.3:0/3733604626 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faab0019b10 con 0x55a40d6e73a0 2024-09-19T06:14:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.301+0000 7faaaea00640 1 -- 172.21.15.3:0/3733604626 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7faab8026070 con 0x55a40d6e73a0 2024-09-19T06:14:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.301+0000 7faaca5bf740 10 client.25793 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:37.310 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.301+0000 7faaca5bf740 10 client.25793 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:14:37.311 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.301+0000 7faaca5bf740 20 client.25793 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:37.311 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.301+0000 7faaca5bf740 1 --2- 172.21.15.3:0/3733604626 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a40d6f7130 0x55a40d6f9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:37.311 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.301+0000 7faaca5bf740 4 client.25793 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:14:37.311 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.301+0000 7faaca5bf740 1 -- 172.21.15.3:0/3733604626 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a40d64f830 con 0x55a40d6f7130 2024-09-19T06:14:37.311 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.302+0000 7faac4e00640 1 --2- 172.21.15.3:0/3733604626 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a40d6f7130 0x55a40d6f9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.302+0000 7faac4e00640 1 --2- 172.21.15.3:0/3733604626 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a40d6f7130 0x55a40d6f9580 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56d988b16bd5b77e server_cookie=8c67950417347ab8 in_seq=0 out_seq=0 2024-09-19T06:14:37.313 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.302+0000 7faaaea00640 10 client.25793 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.303+0000 7faaaea00640 1 -- 172.21.15.3:0/3733604626 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a40d64f830 con 0x55a40d6f7130 2024-09-19T06:14:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.303+0000 7faaaea00640 10 client.25793 handle_command_reply: tid=0 2024-09-19T06:14:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.303+0000 7faaca5bf740 1 client.25793 shutdown 2024-09-19T06:14:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.303+0000 7faaca5bf740 1 -- 172.21.15.3:0/3733604626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a40d6e73a0 msgr2=0x55a40d6e4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.303+0000 7faaca5bf740 1 --2- 172.21.15.3:0/3733604626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a40d6e73a0 0x55a40d6e4ea0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7faab8010ba0 tx=0x7faab8004ab0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.303+0000 7faaca5bf740 1 -- 172.21.15.3:0/3733604626 shutdown_connections 2024-09-19T06:14:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.303+0000 7faaca5bf740 1 --2- 172.21.15.3:0/3733604626 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a40d6f7130 0x55a40d6f9580 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.303+0000 7faaca5bf740 1 --2- 172.21.15.3:0/3733604626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a40d6e73a0 0x55a40d6e4ea0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.314 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.303+0000 7faaca5bf740 1 --2- 172.21.15.3:0/3733604626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40d6dcb00 0x55a40d6e4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.315 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.303+0000 7faaaea00640 0 client.25793 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:37.315 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.303+0000 7faaca5bf740 1 --2- 172.21.15.3:0/3733604626 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6dc1e0 0x55a40d6e4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.315 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.303+0000 7faaca5bf740 1 -- 172.21.15.3:0/3733604626 >> 172.21.15.3:0/3733604626 conn(0x55a40d6d8750 msgr2=0x55a40d6de4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:37.315 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.304+0000 7faaca5bf740 1 -- 172.21.15.3:0/3733604626 shutdown_connections 2024-09-19T06:14:37.315 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.304+0000 7faaca5bf740 1 -- 172.21.15.3:0/3733604626 wait complete. 2024-09-19T06:14:37.315 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.304+0000 7faaca5bf740 20 client.25793 trim_cache size 0 max 16384 2024-09-19T06:14:37.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.319+0000 7faaca5bf740 1 Processor -- start 2024-09-19T06:14:37.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.319+0000 7faaca5bf740 1 -- start start 2024-09-19T06:14:37.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.319+0000 7faaca5bf740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a40d6dc1e0 0x55a40d6dec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:37.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.319+0000 7faaca5bf740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40d6dcb00 0x55a40d6e4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:37.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.319+0000 7faaca5bf740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6e73a0 0x55a40d6feee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:37.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.319+0000 7faaca5bf740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7faac01afb30 con 0x55a40d6e73a0 2024-09-19T06:14:37.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.319+0000 7faaca5bf740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faac01b1670 con 0x55a40d6dc1e0 2024-09-19T06:14:37.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.319+0000 7faaca5bf740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faac01b0200 con 0x55a40d6dcb00 2024-09-19T06:14:37.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.320+0000 7faac5800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6e73a0 0x55a40d6feee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:37.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.320+0000 7faac4e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a40d6dc1e0 0x55a40d6dec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:37.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.320+0000 7faac5800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6e73a0 0x55a40d6feee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34556/0 (socket says 172.21.15.3:34556) 2024-09-19T06:14:37.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.320+0000 7faac5800640 1 -- 172.21.15.3:0/237899456 learned_addr learned my addr 172.21.15.3:0/237899456 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:37.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.320+0000 7faab7e00640 1 --2- 172.21.15.3:0/237899456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40d6dcb00 0x55a40d6e4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:37.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.320+0000 7faac5800640 1 -- 172.21.15.3:0/237899456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40d6dcb00 msgr2=0x55a40d6e4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:37.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.320+0000 7faac5800640 1 --2- 172.21.15.3:0/237899456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40d6dcb00 0x55a40d6e4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.320+0000 7faac5800640 1 -- 172.21.15.3:0/237899456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a40d6dc1e0 msgr2=0x55a40d6dec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:37.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.320+0000 7faac5800640 1 --2- 172.21.15.3:0/237899456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a40d6dc1e0 0x55a40d6dec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.320+0000 7faac5800640 1 -- 172.21.15.3:0/237899456 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a40d6dc010 con 0x55a40d6e73a0 2024-09-19T06:14:37.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.320+0000 7faac5800640 1 --2- 172.21.15.3:0/237899456 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6e73a0 0x55a40d6feee0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7faab80108a0 tx=0x7faab8009f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d407324578d18291 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:37.329 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.320+0000 7faab5600640 1 -- 172.21.15.3:0/237899456 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab801c3f0 con 0x55a40d6e73a0 2024-09-19T06:14:37.329 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.321+0000 7faab5600640 1 -- 172.21.15.3:0/237899456 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faab8028440 con 0x55a40d6e73a0 2024-09-19T06:14:37.329 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.321+0000 7faab5600640 1 -- 172.21.15.3:0/237899456 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab801ca30 con 0x55a40d6e73a0 2024-09-19T06:14:37.329 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.321+0000 7faaca5bf740 1 -- 172.21.15.3:0/237899456 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6e73a0 msgr2=0x55a40d6feee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:37.329 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.321+0000 7faaca5bf740 1 --2- 172.21.15.3:0/237899456 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6e73a0 0x55a40d6feee0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7faab80108a0 tx=0x7faab8009f40 comp rx=0 tx=0).stop 2024-09-19T06:14:37.329 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.321+0000 7faaca5bf740 1 -- 172.21.15.3:0/237899456 shutdown_connections 2024-09-19T06:14:37.329 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.321+0000 7faaca5bf740 1 --2- 172.21.15.3:0/237899456 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6e73a0 0x55a40d6feee0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.321+0000 7faaca5bf740 1 --2- 172.21.15.3:0/237899456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40d6dcb00 0x55a40d6e4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.321+0000 7faaca5bf740 1 --2- 172.21.15.3:0/237899456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a40d6dc1e0 0x55a40d6dec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.321+0000 7faaca5bf740 1 -- 172.21.15.3:0/237899456 >> 172.21.15.3:0/237899456 conn(0x55a40d6d8750 msgr2=0x55a40d6e43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.321+0000 7faaca5bf740 1 -- 172.21.15.3:0/237899456 shutdown_connections 2024-09-19T06:14:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.321+0000 7faaca5bf740 1 -- 172.21.15.3:0/237899456 wait complete. 2024-09-19T06:14:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.322+0000 7faaca5bf740 1 -- start start 2024-09-19T06:14:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.322+0000 7faaca5bf740 1 Processor -- start 2024-09-19T06:14:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.322+0000 7faaca5bf740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6dc1e0 0x55a40d6e1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.322+0000 7faaca5bf740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a40d6dcb00 0x55a40d6e1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.322+0000 7faaca5bf740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40d6e73a0 0x55a40d6e2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.322+0000 7faaca5bf740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7faac01b0fa0 con 0x55a40d6dc1e0 2024-09-19T06:14:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.322+0000 7faaca5bf740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faac01b08d0 con 0x55a40d6dcb00 2024-09-19T06:14:37.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.322+0000 7faaca5bf740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faac01adb10 con 0x55a40d6e73a0 2024-09-19T06:14:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.322+0000 7faaca5bf740 10 client.0 _ll_register_callbacks cb 0x7faab8010a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.322+0000 7faac4e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6dc1e0 0x55a40d6e1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.323+0000 7faac4e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6dc1e0 0x55a40d6e1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:34566/0 (socket says 172.21.15.3:34566) 2024-09-19T06:14:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.323+0000 7faac5800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40d6e73a0 0x55a40d6e2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.323+0000 7faac4e00640 1 -- 172.21.15.3:0/2840855704 learned_addr learned my addr 172.21.15.3:0/2840855704 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.323+0000 7faab7e00640 1 --2- 172.21.15.3:0/2840855704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a40d6dcb00 0x55a40d6e1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.323+0000 7faac4e00640 1 -- 172.21.15.3:0/2840855704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40d6e73a0 msgr2=0x55a40d6e2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.323+0000 7faac4e00640 1 --2- 172.21.15.3:0/2840855704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40d6e73a0 0x55a40d6e2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.323+0000 7faac4e00640 1 -- 172.21.15.3:0/2840855704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a40d6dcb00 msgr2=0x55a40d6e1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.323+0000 7faac4e00640 1 --2- 172.21.15.3:0/2840855704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a40d6dcb00 0x55a40d6e1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.323+0000 7faac4e00640 1 -- 172.21.15.3:0/2840855704 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a40d761010 con 0x55a40d6dc1e0 2024-09-19T06:14:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.323+0000 7faac5800640 1 --2- 172.21.15.3:0/2840855704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40d6e73a0 0x55a40d6e2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:37.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.323+0000 7faac4e00640 1 --2- 172.21.15.3:0/2840855704 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6dc1e0 0x55a40d6e1600 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7faab00098c0 tx=0x7faab00097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5696458ded35400 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.323+0000 7faaaea00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:14:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.323+0000 7faaaea00640 1 -- 172.21.15.3:0/2840855704 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab0035060 con 0x55a40d6dc1e0 2024-09-19T06:14:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.323+0000 7faaaea00640 1 -- 172.21.15.3:0/2840855704 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7faab0005450 con 0x55a40d6dc1e0 2024-09-19T06:14:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.323+0000 7faaca5bf740 1 -- 172.21.15.3:0/2840855704 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faab8028440 con 0x55a40d6dc1e0 2024-09-19T06:14:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.324+0000 7faaaea00640 1 -- 172.21.15.3:0/2840855704 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faab001e040 con 0x55a40d6dc1e0 2024-09-19T06:14:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.324+0000 7faaca5bf740 10 client.15747 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.324+0000 7faaca5bf740 1 -- 172.21.15.3:0/2840855704 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a40d7622e0 con 0x55a40d6dc1e0 2024-09-19T06:14:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.324+0000 7faaaea00640 1 -- 172.21.15.3:0/2840855704 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faab8028440 con 0x55a40d6dc1e0 2024-09-19T06:14:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.324+0000 7faaaea00640 1 -- 172.21.15.3:0/2840855704 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7faab002f070 con 0x55a40d6dc1e0 2024-09-19T06:14:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.324+0000 7faaca5bf740 10 client.15747 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.324+0000 7faaca5bf740 10 client.15747 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:14:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.324+0000 7faaca5bf740 20 client.15747 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.324+0000 7faaca5bf740 1 --2- 172.21.15.3:0/2840855704 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a40d762800 0x55a40d764c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:37.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.324+0000 7faaca5bf740 4 client.15747 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:14:37.333 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.324+0000 7faaca5bf740 1 -- 172.21.15.3:0/2840855704 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a40d6d3d80 con 0x55a40d762800 2024-09-19T06:14:37.333 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.325+0000 7faab7e00640 1 --2- 172.21.15.3:0/2840855704 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a40d762800 0x55a40d764c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:37.333 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.325+0000 7faab7e00640 1 --2- 172.21.15.3:0/2840855704 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a40d762800 0x55a40d764c20 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecb7793550132eea server_cookie=1e6206d171d38de0 in_seq=0 out_seq=0 2024-09-19T06:14:37.333 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.325+0000 7faaaea00640 10 client.15747 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:37.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:36 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:14:37.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:36 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:14:37.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:36 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:14:37.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:36 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:14:37.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:36 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:14:37.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:36 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:14:37.341 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.340+0000 7faaaea00640 1 -- 172.21.15.3:0/2840855704 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a40d6d3d80 con 0x55a40d762800 2024-09-19T06:14:37.341 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.340+0000 7faaaea00640 10 client.15747 handle_command_reply: tid=0 2024-09-19T06:14:37.341 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.340+0000 7faaca5bf740 1 client.15747 shutdown 2024-09-19T06:14:37.341 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.340+0000 7faaca5bf740 1 -- 172.21.15.3:0/2840855704 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6dc1e0 msgr2=0x55a40d6e1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:37.341 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.340+0000 7faaca5bf740 1 --2- 172.21.15.3:0/2840855704 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6dc1e0 0x55a40d6e1600 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7faab00098c0 tx=0x7faab00097a0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.341 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.340+0000 7faaca5bf740 1 -- 172.21.15.3:0/2840855704 shutdown_connections 2024-09-19T06:14:37.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.340+0000 7faaca5bf740 1 --2- 172.21.15.3:0/2840855704 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a40d762800 0x55a40d764c20 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.340+0000 7faaca5bf740 1 --2- 172.21.15.3:0/2840855704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a40d6e73a0 0x55a40d6e2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.340+0000 7faaca5bf740 1 --2- 172.21.15.3:0/2840855704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a40d6dcb00 0x55a40d6e1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.340+0000 7faaaea00640 0 client.15747 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:37.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.340+0000 7faaca5bf740 1 --2- 172.21.15.3:0/2840855704 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a40d6dc1e0 0x55a40d6e1600 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.340+0000 7faaca5bf740 1 -- 172.21.15.3:0/2840855704 >> 172.21.15.3:0/2840855704 conn(0x55a40d6d8750 msgr2=0x55a40d6e4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:37.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.340+0000 7faaca5bf740 1 -- 172.21.15.3:0/2840855704 shutdown_connections 2024-09-19T06:14:37.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.340+0000 7faaca5bf740 1 -- 172.21.15.3:0/2840855704 wait complete. 2024-09-19T06:14:37.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.340+0000 7faaca5bf740 20 client.15747 trim_cache size 0 max 16384 2024-09-19T06:14:37.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:14:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:14:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:14:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:14:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.341+0000 7faac7800640 1 -- 172.21.15.3:0/3628328373 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7faaa40a33b0 msgr2=0x7faaa40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.341+0000 7faac7800640 1 --2- 172.21.15.3:0/3628328373 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7faaa40a33b0 0x7faaa40a5870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faab8005fd0 tx=0x7faab80096a0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.341+0000 7faac7800640 1 -- 172.21.15.3:0/3628328373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faac0102460 msgr2=0x7faac019abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:37.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.341+0000 7faac7800640 1 --2- 172.21.15.3:0/3628328373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faac0102460 0x7faac019abb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faaa802a940 tx=0x7faaa8003b90 comp rx=0 tx=0).stop 2024-09-19T06:14:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.341+0000 7faac7800640 1 -- 172.21.15.3:0/3628328373 shutdown_connections 2024-09-19T06:14:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.341+0000 7faac7800640 1 --2- 172.21.15.3:0/3628328373 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7faaa40a33b0 0x7faaa40a5870 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.341+0000 7faac7800640 1 --2- 172.21.15.3:0/3628328373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faac0107ad0 0x7faac019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.341+0000 7faac7800640 1 --2- 172.21.15.3:0/3628328373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faac0102460 0x7faac019abb0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.341+0000 7faac7800640 1 --2- 172.21.15.3:0/3628328373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac0101ac0 0x7faac019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.341+0000 7faac7800640 1 -- 172.21.15.3:0/3628328373 >> 172.21.15.3:0/3628328373 conn(0x7faac00fd7e0 msgr2=0x7faac00fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.341+0000 7faac7800640 1 -- 172.21.15.3:0/3628328373 shutdown_connections 2024-09-19T06:14:37.344 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:37.341+0000 7faac7800640 1 -- 172.21.15.3:0/3628328373 wait complete. 2024-09-19T06:14:38.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:37 smithi059 ceph-mon[35138]: pgmap v70: 97 pgs: 97 active+clean; 2.2 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T06:14:38.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:37 smithi003 ceph-mon[30893]: pgmap v70: 97 pgs: 97 active+clean; 2.2 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T06:14:38.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:37 smithi071 ceph-mon[35662]: pgmap v70: 97 pgs: 97 active+clean; 2.2 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T06:14:40.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:39 smithi059 ceph-mon[35138]: pgmap v71: 97 pgs: 97 active+clean; 2.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 24 op/s 2024-09-19T06:14:40.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:39 smithi071 ceph-mon[35662]: pgmap v71: 97 pgs: 97 active+clean; 2.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 24 op/s 2024-09-19T06:14:40.336 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:39 smithi003 ceph-mon[30893]: pgmap v71: 97 pgs: 97 active+clean; 2.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 24 op/s 2024-09-19T06:14:42.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:41 smithi059 ceph-mon[35138]: pgmap v72: 97 pgs: 97 active+clean; 2.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T06:14:42.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:41 smithi003 ceph-mon[30893]: pgmap v72: 97 pgs: 97 active+clean; 2.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T06:14:42.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:41 smithi071 ceph-mon[35662]: pgmap v72: 97 pgs: 97 active+clean; 2.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-19T06:14:44.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:43 smithi059 ceph-mon[35138]: pgmap v73: 97 pgs: 97 active+clean; 2.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-09-19T06:14:44.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:43 smithi003 ceph-mon[30893]: pgmap v73: 97 pgs: 97 active+clean; 2.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-09-19T06:14:44.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:43 smithi071 ceph-mon[35662]: pgmap v73: 97 pgs: 97 active+clean; 2.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-09-19T06:14:46.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:45 smithi059 ceph-mon[35138]: pgmap v74: 97 pgs: 97 active+clean; 2.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-09-19T06:14:46.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:45 smithi003 ceph-mon[30893]: pgmap v74: 97 pgs: 97 active+clean; 2.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-09-19T06:14:46.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:45 smithi071 ceph-mon[35662]: pgmap v74: 97 pgs: 97 active+clean; 2.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-09-19T06:14:48.239 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:14:48.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:47 smithi059 ceph-mon[35138]: pgmap v75: 97 pgs: 97 active+clean; 2.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T06:14:48.296 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:47 smithi003 ceph-mon[30893]: pgmap v75: 97 pgs: 97 active+clean; 2.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T06:14:48.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:47 smithi071 ceph-mon[35662]: pgmap v75: 97 pgs: 97 active+clean; 2.4 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T06:14:48.636 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:49.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.202+0000 7f54ca800640 1 -- 172.21.15.3:0/818248742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c4101130 msgr2=0x7f54c410ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:49.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.202+0000 7f54ca800640 1 --2- 172.21.15.3:0/818248742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c4101130 0x7f54c410ddf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f54b0009900 tx=0x7f54b002a3f0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.202+0000 7f54ca800640 1 -- 172.21.15.3:0/818248742 shutdown_connections 2024-09-19T06:14:49.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.202+0000 7f54ca800640 1 --2- 172.21.15.3:0/818248742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54c410e330 0x7f54c4110720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.202+0000 7f54ca800640 1 --2- 172.21.15.3:0/818248742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c4101130 0x7f54c410ddf0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.202+0000 7f54ca800640 1 --2- 172.21.15.3:0/818248742 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f54c4100780 0x7f54c4100b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.202+0000 7f54ca800640 1 -- 172.21.15.3:0/818248742 >> 172.21.15.3:0/818248742 conn(0x7f54c40fc610 msgr2=0x7f54c40fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:49.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.202+0000 7f54ca800640 1 -- 172.21.15.3:0/818248742 shutdown_connections 2024-09-19T06:14:49.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.202+0000 7f54ca800640 1 -- 172.21.15.3:0/818248742 wait complete. 2024-09-19T06:14:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.203+0000 7f54ca800640 1 Processor -- start 2024-09-19T06:14:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.204+0000 7f54ca800640 1 -- start start 2024-09-19T06:14:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.204+0000 7f54ca800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f54c4100780 0x7f54c419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.204+0000 7f54ca800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54c4101130 0x7f54c419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.204+0000 7f54ca800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c410e330 0x7f54c419eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.204+0000 7f54ca800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f54c4114030 con 0x7f54c4100780 2024-09-19T06:14:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.204+0000 7f54ca800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f54c4113eb0 con 0x7f54c410e330 2024-09-19T06:14:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.204+0000 7f54ca800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f54c41141b0 con 0x7f54c4101130 2024-09-19T06:14:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.204+0000 7f54c9400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f54c4100780 0x7f54c419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.204+0000 7f54c9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c410e330 0x7f54c419eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.204+0000 7f54c9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c410e330 0x7f54c419eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:36172/0 (socket says 172.21.15.3:36172) 2024-09-19T06:14:49.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.204+0000 7f54c9e00640 1 -- 172.21.15.3:0/1096905 learned_addr learned my addr 172.21.15.3:0/1096905 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:49.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.204+0000 7f54c8a00640 1 --2- 172.21.15.3:0/1096905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54c4101130 0x7f54c419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.205+0000 7f54c9e00640 1 -- 172.21.15.3:0/1096905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54c4101130 msgr2=0x7f54c419aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:49.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.205+0000 7f54c9e00640 1 --2- 172.21.15.3:0/1096905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54c4101130 0x7f54c419aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.205+0000 7f54c9e00640 1 -- 172.21.15.3:0/1096905 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f54c4100780 msgr2=0x7f54c419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:49.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.205+0000 7f54c9e00640 1 --2- 172.21.15.3:0/1096905 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f54c4100780 0x7f54c419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.205+0000 7f54c9e00640 1 -- 172.21.15.3:0/1096905 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c419f480 con 0x7f54c410e330 2024-09-19T06:14:49.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.205+0000 7f54c9e00640 1 --2- 172.21.15.3:0/1096905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c410e330 0x7f54c419eda0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00eb40 tx=0x7f54bc00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.205+0000 7f54c2000640 1 -- 172.21.15.3:0/1096905 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc004b20 con 0x7f54c410e330 2024-09-19T06:14:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.205+0000 7f54ca800640 1 -- 172.21.15.3:0/1096905 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54c419f770 con 0x7f54c410e330 2024-09-19T06:14:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.205+0000 7f54c2000640 1 -- 172.21.15.3:0/1096905 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54bc004cc0 con 0x7f54c410e330 2024-09-19T06:14:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.205+0000 7f54c2000640 1 -- 172.21.15.3:0/1096905 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc010850 con 0x7f54c410e330 2024-09-19T06:14:49.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.206+0000 7f54ca800640 1 -- 172.21.15.3:0/1096905 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54c41a7050 con 0x7f54c410e330 2024-09-19T06:14:49.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.209+0000 7f54ce7d4740 1 Processor -- start 2024-09-19T06:14:49.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.210+0000 7f54c2000640 1 -- 172.21.15.3:0/1096905 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f54bc005020 con 0x7f54c410e330 2024-09-19T06:14:49.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.210+0000 7f54ce7d4740 1 -- start start 2024-09-19T06:14:49.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.210+0000 7f54ce7d4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5d5d50 0x56265c5d6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.210+0000 7f54ce7d4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56265c5d6670 0x56265c5e09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.211+0000 7f54ce7d4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56265c5e0f30 0x56265c5e3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.211+0000 7f54ce7d4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56265c53c3e0 con 0x56265c5d5d50 2024-09-19T06:14:49.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.211+0000 7f54ce7d4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56265c4e3d80 con 0x56265c5d6670 2024-09-19T06:14:49.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.211+0000 7f54ce7d4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56265c5383a0 con 0x56265c5e0f30 2024-09-19T06:14:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.211+0000 7f54c8a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5d5d50 0x56265c5d6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.211+0000 7f54c9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56265c5d6670 0x56265c5e09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.211+0000 7f54c8a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5d5d50 0x56265c5d6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35436/0 (socket says 172.21.15.3:35436) 2024-09-19T06:14:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.211+0000 7f54c8a00640 1 -- 172.21.15.3:0/997260305 learned_addr learned my addr 172.21.15.3:0/997260305 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.211+0000 7f54c8a00640 1 --2- 172.21.15.3:0/997260305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56265c5e0f30 0x56265c5e3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.211+0000 7f54c8a00640 1 -- 172.21.15.3:0/997260305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56265c5e0f30 msgr2=0x56265c5e3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.211+0000 7f54c8a00640 1 --2- 172.21.15.3:0/997260305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56265c5e0f30 0x56265c5e3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.211+0000 7f54c8a00640 1 -- 172.21.15.3:0/997260305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56265c5d6670 msgr2=0x56265c5e09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.211+0000 7f54c8a00640 1 --2- 172.21.15.3:0/997260305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56265c5d6670 0x56265c5e09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.211+0000 7f54c8a00640 1 -- 172.21.15.3:0/997260305 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56265c502ae0 con 0x56265c5d5d50 2024-09-19T06:14:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.211+0000 7f54c9400640 1 --2- 172.21.15.3:0/997260305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56265c5d6670 0x56265c5e09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.212+0000 7f54c8a00640 1 --2- 172.21.15.3:0/997260305 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5d5d50 0x56265c5d6130 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f54b0009230 tx=0x7f54b0005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e867384c0495e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.212+0000 7f54c2000640 1 --2- 172.21.15.3:0/1096905 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f54ac0a33b0 0x7f54ac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.212+0000 7f54c2000640 1 -- 172.21.15.3:0/1096905 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f54bc0d0510 con 0x7f54c410e330 2024-09-19T06:14:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.212+0000 7f54b6600640 1 -- 172.21.15.3:0/997260305 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b0044020 con 0x56265c5d5d50 2024-09-19T06:14:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.212+0000 7f54b6600640 1 -- 172.21.15.3:0/997260305 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54b00044a0 con 0x56265c5d5d50 2024-09-19T06:14:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.212+0000 7f54c9400640 1 --2- 172.21.15.3:0/1096905 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f54ac0a33b0 0x7f54ac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.212+0000 7f54b6600640 1 -- 172.21.15.3:0/997260305 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b0035040 con 0x56265c5d5d50 2024-09-19T06:14:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.213+0000 7f54ce7d4740 1 -- 172.21.15.3:0/997260305 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5d5d50 msgr2=0x56265c5d6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.213+0000 7f54ce7d4740 1 --2- 172.21.15.3:0/997260305 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5d5d50 0x56265c5d6130 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f54b0009230 tx=0x7f54b0005bc0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.213+0000 7f54c9400640 1 --2- 172.21.15.3:0/1096905 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f54ac0a33b0 0x7f54ac0a5870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x56265c5d3140 tx=0x7f54b8005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.213+0000 7f54ce7d4740 1 -- 172.21.15.3:0/997260305 shutdown_connections 2024-09-19T06:14:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.213+0000 7f54ce7d4740 1 --2- 172.21.15.3:0/997260305 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56265c5e0f30 0x56265c5e3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.213+0000 7f54ce7d4740 1 --2- 172.21.15.3:0/997260305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56265c5d6670 0x56265c5e09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.213+0000 7f54ce7d4740 1 --2- 172.21.15.3:0/997260305 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5d5d50 0x56265c5d6130 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.213+0000 7f54ce7d4740 1 -- 172.21.15.3:0/997260305 >> 172.21.15.3:0/997260305 conn(0x56265c5d22e0 msgr2=0x56265c5d26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.213+0000 7f54ce7d4740 1 -- 172.21.15.3:0/997260305 shutdown_connections 2024-09-19T06:14:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.213+0000 7f54ce7d4740 1 -- 172.21.15.3:0/997260305 wait complete. 2024-09-19T06:14:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.214+0000 7f54ce7d4740 1 -- start start 2024-09-19T06:14:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.214+0000 7f54ce7d4740 1 Processor -- start 2024-09-19T06:14:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.214+0000 7f54ce7d4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56265c5d5d50 0x56265c5dde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.214+0000 7f54ce7d4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5d6670 0x56265c5de3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.214+0000 7f54ce7d4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56265c5e0f30 0x56265c5de8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.214+0000 7f54ce7d4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56265c5e3ba0 con 0x56265c5d6670 2024-09-19T06:14:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.214+0000 7f54ce7d4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56265c4f70f0 con 0x56265c5d5d50 2024-09-19T06:14:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.214+0000 7f54ce7d4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56265c5e3d20 con 0x56265c5e0f30 2024-09-19T06:14:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.214+0000 7f54ce7d4740 10 client.0 _ll_register_callbacks cb 0x56265c4e89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.214+0000 7f54c8a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5d6670 0x56265c5de3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.215+0000 7f54c8a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5d6670 0x56265c5de3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35438/0 (socket says 172.21.15.3:35438) 2024-09-19T06:14:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.215+0000 7f54c8a00640 1 -- 172.21.15.3:0/3757437551 learned_addr learned my addr 172.21.15.3:0/3757437551 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.215+0000 7f54c9400640 1 --2- 172.21.15.3:0/3757437551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56265c5d5d50 0x56265c5dde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.215+0000 7f54c9e00640 1 --2- 172.21.15.3:0/3757437551 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56265c5e0f30 0x56265c5de8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.215+0000 7f54c8a00640 1 -- 172.21.15.3:0/3757437551 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56265c5e0f30 msgr2=0x56265c5de8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.215+0000 7f54c8a00640 1 --2- 172.21.15.3:0/3757437551 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56265c5e0f30 0x56265c5de8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.215+0000 7f54c8a00640 1 -- 172.21.15.3:0/3757437551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56265c5d5d50 msgr2=0x56265c5dde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.215+0000 7f54c8a00640 1 --2- 172.21.15.3:0/3757437551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56265c5d5d50 0x56265c5dde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.215+0000 7f54c8a00640 1 -- 172.21.15.3:0/3757437551 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56265c2ad3c0 con 0x56265c5d6670 2024-09-19T06:14:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.215+0000 7f54c8a00640 1 --2- 172.21.15.3:0/3757437551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5d6670 0x56265c5de3b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f54b0004930 tx=0x7f54b0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa15a5783e2b703 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.215+0000 7f54aaa00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:14:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.216+0000 7f54aaa00640 1 -- 172.21.15.3:0/3757437551 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b0044030 con 0x56265c5d6670 2024-09-19T06:14:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.216+0000 7f54ce7d4740 1 -- 172.21.15.3:0/3757437551 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54b00044a0 con 0x56265c5d6670 2024-09-19T06:14:49.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.216+0000 7f54aaa00640 1 -- 172.21.15.3:0/3757437551 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f54b0005070 con 0x56265c5d6670 2024-09-19T06:14:49.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.216+0000 7f54aaa00640 1 -- 172.21.15.3:0/3757437551 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f54b0057050 con 0x56265c5d6670 2024-09-19T06:14:49.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.216+0000 7f54ce7d4740 10 client.15759 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:49.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.216+0000 7f54ce7d4740 1 -- 172.21.15.3:0/3757437551 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56265c5ef8a0 con 0x56265c5d6670 2024-09-19T06:14:49.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.216+0000 7f54aaa00640 1 -- 172.21.15.3:0/3757437551 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54b00044a0 con 0x56265c5d6670 2024-09-19T06:14:49.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.217+0000 7f54aaa00640 1 -- 172.21.15.3:0/3757437551 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f54b0049420 con 0x56265c5d6670 2024-09-19T06:14:49.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.217+0000 7f54ce7d4740 10 client.15759 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:49.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.217+0000 7f54ce7d4740 10 client.15759 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:14:49.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.217+0000 7f54ce7d4740 20 client.15759 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:49.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.217+0000 7f54ce7d4740 1 --2- 172.21.15.3:0/3757437551 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56265c5f0bf0 0x56265c5f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.217+0000 7f54ce7d4740 4 client.15759 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:14:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.217+0000 7f54ce7d4740 1 -- 172.21.15.3:0/3757437551 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56265c549950 con 0x56265c5f0bf0 2024-09-19T06:14:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.217+0000 7f54c9400640 1 --2- 172.21.15.3:0/3757437551 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56265c5f0bf0 0x56265c5f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.218+0000 7f54c9400640 1 --2- 172.21.15.3:0/3757437551 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56265c5f0bf0 0x56265c5f2fe0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71f2efd340f44ac4 server_cookie=d4bffe45bea0bcf4 in_seq=0 out_seq=0 2024-09-19T06:14:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.218+0000 7f54aaa00640 10 client.15759 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.218+0000 7f54aaa00640 1 -- 172.21.15.3:0/3757437551 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56265c549950 con 0x56265c5f0bf0 2024-09-19T06:14:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.218+0000 7f54aaa00640 10 client.15759 handle_command_reply: tid=0 2024-09-19T06:14:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.219+0000 7f54ce7d4740 1 client.15759 shutdown 2024-09-19T06:14:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.219+0000 7f54ce7d4740 1 -- 172.21.15.3:0/3757437551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5d6670 msgr2=0x56265c5de3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.219+0000 7f54ce7d4740 1 --2- 172.21.15.3:0/3757437551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5d6670 0x56265c5de3b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f54b0004930 tx=0x7f54b0009260 comp rx=0 tx=0).stop 2024-09-19T06:14:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.219+0000 7f54ce7d4740 1 -- 172.21.15.3:0/3757437551 shutdown_connections 2024-09-19T06:14:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.219+0000 7f54ce7d4740 1 --2- 172.21.15.3:0/3757437551 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56265c5f0bf0 0x56265c5f2fe0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.219+0000 7f54ce7d4740 1 --2- 172.21.15.3:0/3757437551 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56265c5e0f30 0x56265c5de8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.219+0000 7f54ce7d4740 1 --2- 172.21.15.3:0/3757437551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5d6670 0x56265c5de3b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.219+0000 7f54ce7d4740 1 --2- 172.21.15.3:0/3757437551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56265c5d5d50 0x56265c5dde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.219+0000 7f54aaa00640 0 client.15759 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:49.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.219+0000 7f54ce7d4740 1 -- 172.21.15.3:0/3757437551 >> 172.21.15.3:0/3757437551 conn(0x56265c5d22e0 msgr2=0x56265c5d8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:49.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.219+0000 7f54ce7d4740 1 -- 172.21.15.3:0/3757437551 shutdown_connections 2024-09-19T06:14:49.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.219+0000 7f54ce7d4740 1 -- 172.21.15.3:0/3757437551 wait complete. 2024-09-19T06:14:49.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.219+0000 7f54ce7d4740 20 client.15759 trim_cache size 0 max 16384 2024-09-19T06:14:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.237+0000 7f54ce7d4740 1 Processor -- start 2024-09-19T06:14:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.237+0000 7f54ce7d4740 1 -- start start 2024-09-19T06:14:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.237+0000 7f54ce7d4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56265c5d5d50 0x56265c5d87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.237+0000 7f54ce7d4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5d6670 0x56265c5f6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.238+0000 7f54ce7d4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56265c5e0f30 0x56265c5f6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.238+0000 7f54ce7d4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f54c41af860 con 0x56265c5d6670 2024-09-19T06:14:49.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.238+0000 7f54ce7d4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f54c41b13a0 con 0x56265c5d5d50 2024-09-19T06:14:49.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.238+0000 7f54ce7d4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f54c41aff30 con 0x56265c5e0f30 2024-09-19T06:14:49.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.238+0000 7f54c8a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5d6670 0x56265c5f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.238+0000 7f54c8a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5d6670 0x56265c5f6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35454/0 (socket says 172.21.15.3:35454) 2024-09-19T06:14:49.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.238+0000 7f54c8a00640 1 -- 172.21.15.3:0/3806623263 learned_addr learned my addr 172.21.15.3:0/3806623263 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:49.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.238+0000 7f54c9400640 1 --2- 172.21.15.3:0/3806623263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56265c5d5d50 0x56265c5d87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.238+0000 7f54c9e00640 1 --2- 172.21.15.3:0/3806623263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56265c5e0f30 0x56265c5f6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.238+0000 7f54c8a00640 1 -- 172.21.15.3:0/3806623263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56265c5e0f30 msgr2=0x56265c5f6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:49.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.238+0000 7f54c8a00640 1 --2- 172.21.15.3:0/3806623263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56265c5e0f30 0x56265c5f6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.238+0000 7f54c8a00640 1 -- 172.21.15.3:0/3806623263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56265c5d5d50 msgr2=0x56265c5d87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:49.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.238+0000 7f54c8a00640 1 --2- 172.21.15.3:0/3806623263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56265c5d5d50 0x56265c5d87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.238+0000 7f54c8a00640 1 -- 172.21.15.3:0/3806623263 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56265c5e07e0 con 0x56265c5d6670 2024-09-19T06:14:49.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.238+0000 7f54c9400640 1 --2- 172.21.15.3:0/3806623263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56265c5d5d50 0x56265c5d87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:49.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.239+0000 7f54c8a00640 1 --2- 172.21.15.3:0/3806623263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5d6670 0x56265c5f6000 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f54b0009230 tx=0x7f54b00058c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c8cb1f59fe9822 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:49.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.239+0000 7f54b5c00640 1 -- 172.21.15.3:0/3806623263 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b0044040 con 0x56265c5d6670 2024-09-19T06:14:49.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.239+0000 7f54b5c00640 1 -- 172.21.15.3:0/3806623263 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54b00044a0 con 0x56265c5d6670 2024-09-19T06:14:49.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.239+0000 7f54b5c00640 1 -- 172.21.15.3:0/3806623263 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b0035070 con 0x56265c5d6670 2024-09-19T06:14:49.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.239+0000 7f54ce7d4740 1 -- 172.21.15.3:0/3806623263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5d6670 msgr2=0x56265c5f6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:49.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.239+0000 7f54ce7d4740 1 --2- 172.21.15.3:0/3806623263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5d6670 0x56265c5f6000 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f54b0009230 tx=0x7f54b00058c0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.240+0000 7f54ce7d4740 1 -- 172.21.15.3:0/3806623263 shutdown_connections 2024-09-19T06:14:49.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.240+0000 7f54ce7d4740 1 --2- 172.21.15.3:0/3806623263 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56265c5e0f30 0x56265c5f6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.240+0000 7f54ce7d4740 1 --2- 172.21.15.3:0/3806623263 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5d6670 0x56265c5f6000 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.240+0000 7f54ce7d4740 1 --2- 172.21.15.3:0/3806623263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56265c5d5d50 0x56265c5d87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.240+0000 7f54ce7d4740 1 -- 172.21.15.3:0/3806623263 >> 172.21.15.3:0/3806623263 conn(0x56265c5d22e0 msgr2=0x56265c5dc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:49.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.240+0000 7f54ce7d4740 1 -- 172.21.15.3:0/3806623263 shutdown_connections 2024-09-19T06:14:49.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.240+0000 7f54ce7d4740 1 -- 172.21.15.3:0/3806623263 wait complete. 2024-09-19T06:14:49.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.240+0000 7f54ce7d4740 1 -- start start 2024-09-19T06:14:49.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.240+0000 7f54ce7d4740 1 Processor -- start 2024-09-19T06:14:49.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.241+0000 7f54ce7d4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56265c5d5d50 0x56265c5f40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.241+0000 7f54ce7d4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56265c5d6670 0x56265c5f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.241+0000 7f54ce7d4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5e0f30 0x56265c5f4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.241+0000 7f54ce7d4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f54c41b0cd0 con 0x56265c5e0f30 2024-09-19T06:14:49.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.241+0000 7f54ce7d4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f54c41b0600 con 0x56265c5d6670 2024-09-19T06:14:49.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.241+0000 7f54ce7d4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f54c41ad840 con 0x56265c5d5d50 2024-09-19T06:14:49.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.241+0000 7f54ce7d4740 10 client.0 _ll_register_callbacks cb 0x7f54b0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:49.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.241+0000 7f54c9e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5e0f30 0x56265c5f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.241+0000 7f54c9e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5e0f30 0x56265c5f4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35462/0 (socket says 172.21.15.3:35462) 2024-09-19T06:14:49.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.241+0000 7f54c9e00640 1 -- 172.21.15.3:0/3822829864 learned_addr learned my addr 172.21.15.3:0/3822829864 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:49.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.241+0000 7f54c9400640 1 --2- 172.21.15.3:0/3822829864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56265c5d5d50 0x56265c5f40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.242+0000 7f54c9e00640 1 -- 172.21.15.3:0/3822829864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56265c5d5d50 msgr2=0x56265c5f40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:49.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.242+0000 7f54c8a00640 1 --2- 172.21.15.3:0/3822829864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56265c5d6670 0x56265c5f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.242+0000 7f54c9e00640 1 --2- 172.21.15.3:0/3822829864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56265c5d5d50 0x56265c5f40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.242+0000 7f54c9e00640 1 -- 172.21.15.3:0/3822829864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56265c5d6670 msgr2=0x56265c5f45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:49.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.242+0000 7f54c9e00640 1 --2- 172.21.15.3:0/3822829864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56265c5d6670 0x56265c5f45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.242+0000 7f54c9e00640 1 -- 172.21.15.3:0/3822829864 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56265c65a820 con 0x56265c5e0f30 2024-09-19T06:14:49.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.242+0000 7f54c8a00640 1 --2- 172.21.15.3:0/3822829864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56265c5d6670 0x56265c5f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:14:49.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.242+0000 7f54c9e00640 1 --2- 172.21.15.3:0/3822829864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5e0f30 0x56265c5f4b60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f54bc09c720 tx=0x7f54bc09c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36059dce7d6103e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:49.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.242+0000 7f54aaa00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:14:49.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.242+0000 7f54aaa00640 1 -- 172.21.15.3:0/3822829864 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc09ce90 con 0x56265c5e0f30 2024-09-19T06:14:49.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.242+0000 7f54aaa00640 1 -- 172.21.15.3:0/3822829864 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f54bc0a4f70 con 0x56265c5e0f30 2024-09-19T06:14:49.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.242+0000 7f54ce7d4740 1 -- 172.21.15.3:0/3822829864 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54b00044a0 con 0x56265c5e0f30 2024-09-19T06:14:49.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.242+0000 7f54aaa00640 1 -- 172.21.15.3:0/3822829864 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f54bc09c790 con 0x56265c5e0f30 2024-09-19T06:14:49.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.242+0000 7f54ce7d4740 10 client.15765 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:49.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.242+0000 7f54ce7d4740 1 -- 172.21.15.3:0/3822829864 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56265c65bb90 con 0x56265c5e0f30 2024-09-19T06:14:49.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.243+0000 7f54aaa00640 1 -- 172.21.15.3:0/3822829864 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54b00044a0 con 0x56265c5e0f30 2024-09-19T06:14:49.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.243+0000 7f54aaa00640 1 -- 172.21.15.3:0/3822829864 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f54bc09bd00 con 0x56265c5e0f30 2024-09-19T06:14:49.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.243+0000 7f54ce7d4740 10 client.15765 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:49.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.243+0000 7f54ce7d4740 10 client.15765 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:14:49.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.243+0000 7f54ce7d4740 20 client.15765 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:49.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.243+0000 7f54ce7d4740 1 --2- 172.21.15.3:0/3822829864 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56265c65c2e0 0x56265c65e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:49.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.243+0000 7f54ce7d4740 4 client.15765 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:14:49.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.243+0000 7f54ce7d4740 1 -- 172.21.15.3:0/3822829864 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56265c543e60 con 0x56265c65c2e0 2024-09-19T06:14:49.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.243+0000 7f54c9400640 1 --2- 172.21.15.3:0/3822829864 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56265c65c2e0 0x56265c65e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:49.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.244+0000 7f54c9400640 1 --2- 172.21.15.3:0/3822829864 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56265c65c2e0 0x56265c65e720 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4bc94741e7cfbb3 server_cookie=ddf73a0dac2f6638 in_seq=0 out_seq=0 2024-09-19T06:14:49.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.244+0000 7f54aaa00640 10 client.15765 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:49.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.244+0000 7f54aaa00640 1 -- 172.21.15.3:0/3822829864 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56265c543e60 con 0x56265c65c2e0 2024-09-19T06:14:49.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.244+0000 7f54aaa00640 10 client.15765 handle_command_reply: tid=0 2024-09-19T06:14:49.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.244+0000 7f54ce7d4740 1 client.15765 shutdown 2024-09-19T06:14:49.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.244+0000 7f54ce7d4740 1 -- 172.21.15.3:0/3822829864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5e0f30 msgr2=0x56265c5f4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:49.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.244+0000 7f54ce7d4740 1 --2- 172.21.15.3:0/3822829864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5e0f30 0x56265c5f4b60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f54bc09c720 tx=0x7f54bc09c390 comp rx=0 tx=0).stop 2024-09-19T06:14:49.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.244+0000 7f54ce7d4740 1 -- 172.21.15.3:0/3822829864 shutdown_connections 2024-09-19T06:14:49.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.244+0000 7f54ce7d4740 1 --2- 172.21.15.3:0/3822829864 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56265c65c2e0 0x56265c65e720 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.244+0000 7f54ce7d4740 1 --2- 172.21.15.3:0/3822829864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56265c5e0f30 0x56265c5f4b60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.244+0000 7f54ce7d4740 1 --2- 172.21.15.3:0/3822829864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56265c5d6670 0x56265c5f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.244+0000 7f54ce7d4740 1 --2- 172.21.15.3:0/3822829864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56265c5d5d50 0x56265c5f40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.244+0000 7f54aaa00640 0 client.15765 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:49.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.244+0000 7f54ce7d4740 1 -- 172.21.15.3:0/3822829864 >> 172.21.15.3:0/3822829864 conn(0x56265c5d22e0 msgr2=0x56265c5dddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:49.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.244+0000 7f54ce7d4740 1 -- 172.21.15.3:0/3822829864 shutdown_connections 2024-09-19T06:14:49.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.244+0000 7f54ce7d4740 1 -- 172.21.15.3:0/3822829864 wait complete. 2024-09-19T06:14:49.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.244+0000 7f54ce7d4740 20 client.15765 trim_cache size 0 max 16384 2024-09-19T06:14:49.264 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:14:49.264 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "no active scrubs running", 2024-09-19T06:14:49.265 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": {} 2024-09-19T06:14:49.265 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:14:49.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.245+0000 7f54ca800640 1 -- 172.21.15.3:0/1096905 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f54ac0a33b0 msgr2=0x7f54ac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:49.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.245+0000 7f54ca800640 1 --2- 172.21.15.3:0/1096905 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f54ac0a33b0 0x7f54ac0a5870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x56265c5d3140 tx=0x7f54b8005f90 comp rx=0 tx=0).stop 2024-09-19T06:14:49.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.245+0000 7f54ca800640 1 -- 172.21.15.3:0/1096905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c410e330 msgr2=0x7f54c419eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:49.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.245+0000 7f54ca800640 1 --2- 172.21.15.3:0/1096905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c410e330 0x7f54c419eda0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f54bc00eb40 tx=0x7f54bc00c2d0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.245+0000 7f54ca800640 1 -- 172.21.15.3:0/1096905 shutdown_connections 2024-09-19T06:14:49.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.245+0000 7f54ca800640 1 --2- 172.21.15.3:0/1096905 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f54ac0a33b0 0x7f54ac0a5870 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.245+0000 7f54ca800640 1 --2- 172.21.15.3:0/1096905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54c410e330 0x7f54c419eda0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.245+0000 7f54ca800640 1 --2- 172.21.15.3:0/1096905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f54c4101130 0x7f54c419aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.245+0000 7f54ca800640 1 --2- 172.21.15.3:0/1096905 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f54c4100780 0x7f54c419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:49.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.245+0000 7f54ca800640 1 -- 172.21.15.3:0/1096905 >> 172.21.15.3:0/1096905 conn(0x7f54c40fc610 msgr2=0x7f54c40fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:49.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.245+0000 7f54ca800640 1 -- 172.21.15.3:0/1096905 shutdown_connections 2024-09-19T06:14:49.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:49.246+0000 7f54ca800640 1 -- 172.21.15.3:0/1096905 wait complete. 2024-09-19T06:14:50.202 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:49 smithi003 ceph-mon[30893]: pgmap v76: 97 pgs: 97 active+clean; 2.5 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 22 op/s 2024-09-19T06:14:50.235 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:14:50.236 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:14:50.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:49 smithi059 ceph-mon[35138]: pgmap v76: 97 pgs: 97 active+clean; 2.5 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 22 op/s 2024-09-19T06:14:50.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:49 smithi071 ceph-mon[35662]: pgmap v76: 97 pgs: 97 active+clean; 2.5 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 22 op/s 2024-09-19T06:14:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.456+0000 7ffb7c000640 1 -- 172.21.15.3:0/1728063694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb7410e380 msgr2=0x7ffb74110770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.456+0000 7ffb7c000640 1 --2- 172.21.15.3:0/1728063694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb7410e380 0x7ffb74110770 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009ca0 tx=0x7ffb6c02a950 comp rx=0 tx=0).stop 2024-09-19T06:14:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.456+0000 7ffb7c000640 1 -- 172.21.15.3:0/1728063694 shutdown_connections 2024-09-19T06:14:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.456+0000 7ffb7c000640 1 --2- 172.21.15.3:0/1728063694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb7410e380 0x7ffb74110770 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.456+0000 7ffb7c000640 1 --2- 172.21.15.3:0/1728063694 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb74074ec0 0x7ffb7410de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.456+0000 7ffb7c000640 1 --2- 172.21.15.3:0/1728063694 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb740745a0 0x7ffb74074980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.456+0000 7ffb7c000640 1 -- 172.21.15.3:0/1728063694 >> 172.21.15.3:0/1728063694 conn(0x7ffb740fd7a0 msgr2=0x7ffb740ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.457+0000 7ffb7c000640 1 -- 172.21.15.3:0/1728063694 shutdown_connections 2024-09-19T06:14:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.457+0000 7ffb7c000640 1 -- 172.21.15.3:0/1728063694 wait complete. 2024-09-19T06:14:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.458+0000 7ffb7c000640 1 Processor -- start 2024-09-19T06:14:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.458+0000 7ffb7c000640 1 -- start start 2024-09-19T06:14:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.458+0000 7ffb7c000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb740745a0 0x7ffb7419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.458+0000 7ffb7c000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb74074ec0 0x7ffb7419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.458+0000 7ffb7c000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb7410e380 0x7ffb7419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.458+0000 7ffb7c000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ffb741140c0 con 0x7ffb7410e380 2024-09-19T06:14:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.458+0000 7ffb7c000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffb74113f40 con 0x7ffb74074ec0 2024-09-19T06:14:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.458+0000 7ffb7c000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffb74114240 con 0x7ffb740745a0 2024-09-19T06:14:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.458+0000 7ffb7a000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb7410e380 0x7ffb7419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.458+0000 7ffb7a000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb7410e380 0x7ffb7419eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35468/0 (socket says 172.21.15.3:35468) 2024-09-19T06:14:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.458+0000 7ffb7a000640 1 -- 172.21.15.3:0/1551247891 learned_addr learned my addr 172.21.15.3:0/1551247891 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.458+0000 7ffb79600640 1 --2- 172.21.15.3:0/1551247891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb740745a0 0x7ffb7419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.458+0000 7ffb78c00640 1 --2- 172.21.15.3:0/1551247891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb74074ec0 0x7ffb7419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.459+0000 7ffb7a000640 1 -- 172.21.15.3:0/1551247891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb740745a0 msgr2=0x7ffb7419a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.459+0000 7ffb7a000640 1 --2- 172.21.15.3:0/1551247891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb740745a0 0x7ffb7419a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.459+0000 7ffb7a000640 1 -- 172.21.15.3:0/1551247891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb74074ec0 msgr2=0x7ffb7419ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.459+0000 7ffb7a000640 1 --2- 172.21.15.3:0/1551247891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb74074ec0 0x7ffb7419ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.459+0000 7ffb7a000640 1 -- 172.21.15.3:0/1551247891 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb7419f600 con 0x7ffb7410e380 2024-09-19T06:14:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.459+0000 7ffb79600640 1 --2- 172.21.15.3:0/1551247891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb740745a0 0x7ffb7419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.459+0000 7ffb78c00640 1 --2- 172.21.15.3:0/1551247891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb74074ec0 0x7ffb7419ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:50.464 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.459+0000 7ffb7a000640 1 --2- 172.21.15.3:0/1551247891 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb7410e380 0x7ffb7419eed0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009dc0 tx=0x7ffb6c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:50.464 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.459+0000 7ffb72000640 1 -- 172.21.15.3:0/1551247891 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c034040 con 0x7ffb7410e380 2024-09-19T06:14:50.464 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.459+0000 7ffb72000640 1 -- 172.21.15.3:0/1551247891 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb6c02f940 con 0x7ffb7410e380 2024-09-19T06:14:50.464 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.459+0000 7ffb7c000640 1 -- 172.21.15.3:0/1551247891 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb7419f890 con 0x7ffb7410e380 2024-09-19T06:14:50.464 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.460+0000 7ffb72000640 1 -- 172.21.15.3:0/1551247891 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c0046a0 con 0x7ffb7410e380 2024-09-19T06:14:50.464 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.460+0000 7ffb7c000640 1 -- 172.21.15.3:0/1551247891 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb741a7180 con 0x7ffb7410e380 2024-09-19T06:14:50.465 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.462+0000 7ffb7f07b740 1 Processor -- start 2024-09-19T06:14:50.465 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.463+0000 7ffb72000640 1 -- 172.21.15.3:0/1551247891 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7ffb6c037020 con 0x7ffb7410e380 2024-09-19T06:14:50.465 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.463+0000 7ffb7f07b740 1 -- start start 2024-09-19T06:14:50.465 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.463+0000 7ffb7f07b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56511e0a71e0 0x56511e0a75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.465 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.463+0000 7ffb7f07b740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a7b00 0x56511e0b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.465 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.463+0000 7ffb7f07b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56511e0b23a0 0x56511e0b4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.463+0000 7ffb7f07b740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56511e00d100 con 0x56511e0a7b00 2024-09-19T06:14:50.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.463+0000 7ffb7f07b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56511dfb51b0 con 0x56511e0b23a0 2024-09-19T06:14:50.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.463+0000 7ffb7f07b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56511e0090c0 con 0x56511e0a71e0 2024-09-19T06:14:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.464+0000 7ffb78c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56511e0a71e0 0x56511e0a75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.464+0000 7ffb79600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a7b00 0x56511e0b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.464+0000 7ffb78c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56511e0a71e0 0x56511e0a75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:60336/0 (socket says 172.21.15.3:60336) 2024-09-19T06:14:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.464+0000 7ffb78c00640 1 -- 172.21.15.3:0/236063027 learned_addr learned my addr 172.21.15.3:0/236063027 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.464+0000 7ffb78c00640 1 --2- 172.21.15.3:0/236063027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56511e0b23a0 0x56511e0b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.464+0000 7ffb79600640 1 -- 172.21.15.3:0/236063027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56511e0a71e0 msgr2=0x56511e0a75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.464+0000 7ffb79600640 1 --2- 172.21.15.3:0/236063027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56511e0a71e0 0x56511e0a75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.464+0000 7ffb79600640 1 -- 172.21.15.3:0/236063027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56511e0b23a0 msgr2=0x56511e0b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.464+0000 7ffb79600640 1 --2- 172.21.15.3:0/236063027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56511e0b23a0 0x56511e0b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.464+0000 7ffb79600640 1 -- 172.21.15.3:0/236063027 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56511dd20210 con 0x56511e0a7b00 2024-09-19T06:14:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.464+0000 7ffb78c00640 1 --2- 172.21.15.3:0/236063027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56511e0a71e0 0x56511e0a75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.464+0000 7ffb79600640 1 --2- 172.21.15.3:0/236063027 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a7b00 0x56511e0b1e60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009fd0 tx=0x7ffb680118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=416db76d8e9557dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.465+0000 7ffb66600640 1 -- 172.21.15.3:0/236063027 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb68004030 con 0x56511e0a7b00 2024-09-19T06:14:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.465+0000 7ffb66600640 1 -- 172.21.15.3:0/236063027 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb68005500 con 0x56511e0a7b00 2024-09-19T06:14:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.465+0000 7ffb66600640 1 -- 172.21.15.3:0/236063027 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb68004da0 con 0x56511e0a7b00 2024-09-19T06:14:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.465+0000 7ffb7f07b740 1 -- 172.21.15.3:0/236063027 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a7b00 msgr2=0x56511e0b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.465+0000 7ffb7f07b740 1 --2- 172.21.15.3:0/236063027 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a7b00 0x56511e0b1e60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009fd0 tx=0x7ffb680118d0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.465+0000 7ffb7f07b740 1 -- 172.21.15.3:0/236063027 shutdown_connections 2024-09-19T06:14:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.465+0000 7ffb7f07b740 1 --2- 172.21.15.3:0/236063027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56511e0b23a0 0x56511e0b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.465+0000 7ffb7f07b740 1 --2- 172.21.15.3:0/236063027 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a7b00 0x56511e0b1e60 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.465+0000 7ffb7f07b740 1 --2- 172.21.15.3:0/236063027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56511e0a71e0 0x56511e0a75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.465+0000 7ffb7f07b740 1 -- 172.21.15.3:0/236063027 >> 172.21.15.3:0/236063027 conn(0x56511e0a3750 msgr2=0x56511e0a3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.466+0000 7ffb7f07b740 1 -- 172.21.15.3:0/236063027 shutdown_connections 2024-09-19T06:14:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.466+0000 7ffb7f07b740 1 -- 172.21.15.3:0/236063027 wait complete. 2024-09-19T06:14:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.466+0000 7ffb72000640 1 --2- 172.21.15.3:0/1551247891 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ffb5c0a3340 0x7ffb5c0a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.466+0000 7ffb72000640 1 -- 172.21.15.3:0/1551247891 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7ffb6c0f0910 con 0x7ffb7410e380 2024-09-19T06:14:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.466+0000 7ffb79600640 1 --2- 172.21.15.3:0/1551247891 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ffb5c0a3340 0x7ffb5c0a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.466+0000 7ffb7f07b740 1 -- start start 2024-09-19T06:14:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.467+0000 7ffb7f07b740 1 Processor -- start 2024-09-19T06:14:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.467+0000 7ffb79600640 1 --2- 172.21.15.3:0/1551247891 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ffb5c0a3340 0x7ffb5c0a5800 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009d60 tx=0x7ffb68000bc0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.467+0000 7ffb7f07b740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a71e0 0x56511e0af320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.467+0000 7ffb7f07b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56511e0a7b00 0x56511e0af860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.467+0000 7ffb7f07b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56511e0b23a0 0x56511e0afda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.467+0000 7ffb7f07b740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56511e0b4f70 con 0x56511e0a71e0 2024-09-19T06:14:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.467+0000 7ffb7f07b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56511df96090 con 0x56511e0a7b00 2024-09-19T06:14:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.467+0000 7ffb7f07b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56511e0b50f0 con 0x56511e0b23a0 2024-09-19T06:14:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.467+0000 7ffb7f07b740 10 client.0 _ll_register_callbacks cb 0x56511dfeaf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.467+0000 7ffb78c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56511e0a7b00 0x56511e0af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.467+0000 7ffb79600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a71e0 0x56511e0af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.468+0000 7ffb78c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56511e0a7b00 0x56511e0af860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:36250/0 (socket says 172.21.15.3:36250) 2024-09-19T06:14:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.468+0000 7ffb78c00640 1 -- 172.21.15.3:0/2283761220 learned_addr learned my addr 172.21.15.3:0/2283761220 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.468+0000 7ffb7a000640 1 --2- 172.21.15.3:0/2283761220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56511e0b23a0 0x56511e0afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.468+0000 7ffb78c00640 1 -- 172.21.15.3:0/2283761220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56511e0b23a0 msgr2=0x56511e0afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.468+0000 7ffb78c00640 1 --2- 172.21.15.3:0/2283761220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56511e0b23a0 0x56511e0afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.468+0000 7ffb78c00640 1 -- 172.21.15.3:0/2283761220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a71e0 msgr2=0x56511e0af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.468+0000 7ffb78c00640 1 --2- 172.21.15.3:0/2283761220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a71e0 0x56511e0af320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.468+0000 7ffb78c00640 1 -- 172.21.15.3:0/2283761220 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56511ddec620 con 0x56511e0a7b00 2024-09-19T06:14:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.468+0000 7ffb78c00640 1 --2- 172.21.15.3:0/2283761220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56511e0a7b00 0x56511e0af860 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffb60004520 tx=0x7ffb60004610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4129ad9429e03238 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.468+0000 7ffb5aa00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:14:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.469+0000 7ffb5aa00640 1 -- 172.21.15.3:0/2283761220 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6001e430 con 0x56511e0a7b00 2024-09-19T06:14:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.469+0000 7ffb7f07b740 1 -- 172.21.15.3:0/2283761220 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb68005500 con 0x56511e0a7b00 2024-09-19T06:14:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.469+0000 7ffb5aa00640 1 -- 172.21.15.3:0/2283761220 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7ffb6001e5d0 con 0x56511e0a7b00 2024-09-19T06:14:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.469+0000 7ffb5aa00640 1 -- 172.21.15.3:0/2283761220 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffb6001e7d0 con 0x56511e0a7b00 2024-09-19T06:14:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.469+0000 7ffb7f07b740 10 client.25826 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.469+0000 7ffb7f07b740 1 -- 172.21.15.3:0/2283761220 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56511e0c0ba0 con 0x56511e0a7b00 2024-09-19T06:14:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.469+0000 7ffb5aa00640 1 -- 172.21.15.3:0/2283761220 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb68005500 con 0x56511e0a7b00 2024-09-19T06:14:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.469+0000 7ffb5aa00640 1 -- 172.21.15.3:0/2283761220 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ffb6001d070 con 0x56511e0a7b00 2024-09-19T06:14:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.469+0000 7ffb7f07b740 10 client.25826 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.469+0000 7ffb7f07b740 10 client.25826 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:14:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.469+0000 7ffb7f07b740 20 client.25826 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.469+0000 7ffb7f07b740 1 --2- 172.21.15.3:0/2283761220 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56511e0c2060 0x56511e0c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.469+0000 7ffb7f07b740 4 client.25826 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:14:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.469+0000 7ffb7f07b740 1 -- 172.21.15.3:0/2283761220 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56511e01a830 con 0x56511e0c2060 2024-09-19T06:14:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.470+0000 7ffb79600640 1 --2- 172.21.15.3:0/2283761220 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56511e0c2060 0x56511e0c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.470+0000 7ffb79600640 1 --2- 172.21.15.3:0/2283761220 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56511e0c2060 0x56511e0c44b0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18dcc33527b5291f server_cookie=4ce1ecd9558318d5 in_seq=0 out_seq=0 2024-09-19T06:14:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.470+0000 7ffb5aa00640 10 client.25826 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.471+0000 7ffb5aa00640 1 -- 172.21.15.3:0/2283761220 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56511e01a830 con 0x56511e0c2060 2024-09-19T06:14:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.471+0000 7ffb5aa00640 10 client.25826 handle_command_reply: tid=0 2024-09-19T06:14:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.471+0000 7ffb7f07b740 1 client.25826 shutdown 2024-09-19T06:14:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.471+0000 7ffb7f07b740 1 -- 172.21.15.3:0/2283761220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56511e0a7b00 msgr2=0x56511e0af860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.471+0000 7ffb7f07b740 1 --2- 172.21.15.3:0/2283761220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56511e0a7b00 0x56511e0af860 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffb60004520 tx=0x7ffb60004610 comp rx=0 tx=0).stop 2024-09-19T06:14:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.471+0000 7ffb7f07b740 1 -- 172.21.15.3:0/2283761220 shutdown_connections 2024-09-19T06:14:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.471+0000 7ffb7f07b740 1 --2- 172.21.15.3:0/2283761220 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56511e0c2060 0x56511e0c44b0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.471+0000 7ffb7f07b740 1 --2- 172.21.15.3:0/2283761220 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56511e0b23a0 0x56511e0afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.471+0000 7ffb7f07b740 1 --2- 172.21.15.3:0/2283761220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56511e0a7b00 0x56511e0af860 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.471+0000 7ffb7f07b740 1 --2- 172.21.15.3:0/2283761220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a71e0 0x56511e0af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.471+0000 7ffb5aa00640 0 client.25826 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.472+0000 7ffb7f07b740 1 -- 172.21.15.3:0/2283761220 >> 172.21.15.3:0/2283761220 conn(0x56511e0a3750 msgr2=0x56511e0a9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.472+0000 7ffb7f07b740 1 -- 172.21.15.3:0/2283761220 shutdown_connections 2024-09-19T06:14:50.480 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.472+0000 7ffb7f07b740 1 -- 172.21.15.3:0/2283761220 wait complete. 2024-09-19T06:14:50.480 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.472+0000 7ffb7f07b740 20 client.25826 trim_cache size 0 max 16384 2024-09-19T06:14:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.488+0000 7ffb7f07b740 1 Processor -- start 2024-09-19T06:14:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.488+0000 7ffb7f07b740 1 -- start start 2024-09-19T06:14:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.488+0000 7ffb7f07b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56511e0a71e0 0x56511e0a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.488+0000 7ffb7f07b740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a7b00 0x56511e0c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.488+0000 7ffb7f07b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56511e0b23a0 0x56511e0ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.488+0000 7ffb7f07b740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ffb741afab0 con 0x56511e0a7b00 2024-09-19T06:14:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.488+0000 7ffb7f07b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffb741b15f0 con 0x56511e0b23a0 2024-09-19T06:14:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.488+0000 7ffb7f07b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffb741b0180 con 0x56511e0a71e0 2024-09-19T06:14:50.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.489+0000 7ffb78c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a7b00 0x56511e0c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.489+0000 7ffb78c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a7b00 0x56511e0c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35494/0 (socket says 172.21.15.3:35494) 2024-09-19T06:14:50.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.489+0000 7ffb7a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56511e0b23a0 0x56511e0ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.489+0000 7ffb78c00640 1 -- 172.21.15.3:0/4028996410 learned_addr learned my addr 172.21.15.3:0/4028996410 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:50.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.489+0000 7ffb79600640 1 --2- 172.21.15.3:0/4028996410 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56511e0a71e0 0x56511e0a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.489+0000 7ffb78c00640 1 -- 172.21.15.3:0/4028996410 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56511e0a71e0 msgr2=0x56511e0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:50.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.489+0000 7ffb78c00640 1 --2- 172.21.15.3:0/4028996410 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56511e0a71e0 0x56511e0a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.489+0000 7ffb78c00640 1 -- 172.21.15.3:0/4028996410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56511e0b23a0 msgr2=0x56511e0ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:50.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.489+0000 7ffb78c00640 1 --2- 172.21.15.3:0/4028996410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56511e0b23a0 0x56511e0ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.489+0000 7ffb78c00640 1 -- 172.21.15.3:0/4028996410 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56511e0c4b30 con 0x56511e0a7b00 2024-09-19T06:14:50.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.489+0000 7ffb7a000640 1 --2- 172.21.15.3:0/4028996410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56511e0b23a0 0x56511e0ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:50.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.489+0000 7ffb78c00640 1 --2- 172.21.15.3:0/4028996410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a7b00 0x56511e0c9dc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ffb600057a0 tx=0x7ffb6000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e29f47a503d1428 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:50.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.490+0000 7ffb65c00640 1 -- 172.21.15.3:0/4028996410 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb60004350 con 0x56511e0a7b00 2024-09-19T06:14:50.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.490+0000 7ffb65c00640 1 -- 172.21.15.3:0/4028996410 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb60003d00 con 0x56511e0a7b00 2024-09-19T06:14:50.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.490+0000 7ffb65c00640 1 -- 172.21.15.3:0/4028996410 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6001ebd0 con 0x56511e0a7b00 2024-09-19T06:14:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.490+0000 7ffb7f07b740 1 -- 172.21.15.3:0/4028996410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a7b00 msgr2=0x56511e0c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.490+0000 7ffb7f07b740 1 --2- 172.21.15.3:0/4028996410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a7b00 0x56511e0c9dc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ffb600057a0 tx=0x7ffb6000eb80 comp rx=0 tx=0).stop 2024-09-19T06:14:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.491+0000 7ffb7f07b740 1 -- 172.21.15.3:0/4028996410 shutdown_connections 2024-09-19T06:14:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.491+0000 7ffb7f07b740 1 --2- 172.21.15.3:0/4028996410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56511e0b23a0 0x56511e0ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.491+0000 7ffb7f07b740 1 --2- 172.21.15.3:0/4028996410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a7b00 0x56511e0c9dc0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.491+0000 7ffb7f07b740 1 --2- 172.21.15.3:0/4028996410 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56511e0a71e0 0x56511e0a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.491+0000 7ffb7f07b740 1 -- 172.21.15.3:0/4028996410 >> 172.21.15.3:0/4028996410 conn(0x56511e0a3750 msgr2=0x56511e0b1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.491+0000 7ffb7f07b740 1 -- 172.21.15.3:0/4028996410 shutdown_connections 2024-09-19T06:14:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.491+0000 7ffb7f07b740 1 -- 172.21.15.3:0/4028996410 wait complete. 2024-09-19T06:14:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.491+0000 7ffb7f07b740 1 -- start start 2024-09-19T06:14:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.491+0000 7ffb7f07b740 1 Processor -- start 2024-09-19T06:14:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.492+0000 7ffb7f07b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56511e0a71e0 0x56511e0ac470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.492+0000 7ffb7f07b740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a7b00 0x56511e0ac9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.492+0000 7ffb7f07b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56511e0b23a0 0x56511e0acef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.492+0000 7ffb7f07b740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ffb741b0f20 con 0x56511e0a7b00 2024-09-19T06:14:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.492+0000 7ffb7f07b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffb741b0850 con 0x56511e0a71e0 2024-09-19T06:14:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.492+0000 7ffb7f07b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffb741ada90 con 0x56511e0b23a0 2024-09-19T06:14:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.492+0000 7ffb7f07b740 10 client.0 _ll_register_callbacks cb 0x7ffb60011530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.492+0000 7ffb78c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a7b00 0x56511e0ac9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.492+0000 7ffb78c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a7b00 0x56511e0ac9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35506/0 (socket says 172.21.15.3:35506) 2024-09-19T06:14:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.492+0000 7ffb78c00640 1 -- 172.21.15.3:0/930758782 learned_addr learned my addr 172.21.15.3:0/930758782 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.492+0000 7ffb7a000640 1 --2- 172.21.15.3:0/930758782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56511e0b23a0 0x56511e0acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.492+0000 7ffb79600640 1 --2- 172.21.15.3:0/930758782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56511e0a71e0 0x56511e0ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.492+0000 7ffb78c00640 1 -- 172.21.15.3:0/930758782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56511e0b23a0 msgr2=0x56511e0acef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.492+0000 7ffb78c00640 1 --2- 172.21.15.3:0/930758782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56511e0b23a0 0x56511e0acef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.492+0000 7ffb78c00640 1 -- 172.21.15.3:0/930758782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56511e0a71e0 msgr2=0x56511e0ac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.492+0000 7ffb78c00640 1 --2- 172.21.15.3:0/930758782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56511e0a71e0 0x56511e0ac470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.492+0000 7ffb78c00640 1 -- 172.21.15.3:0/930758782 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56511e09ed60 con 0x56511e0a7b00 2024-09-19T06:14:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.492+0000 7ffb79600640 1 --2- 172.21.15.3:0/930758782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56511e0a71e0 0x56511e0ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.492+0000 7ffb78c00640 1 --2- 172.21.15.3:0/930758782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a7b00 0x56511e0ac9b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ffb60006010 tx=0x7ffb6001e430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d348ed3967b4dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.492+0000 7ffb5aa00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:14:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.493+0000 7ffb5aa00640 1 -- 172.21.15.3:0/930758782 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb60004350 con 0x56511e0a7b00 2024-09-19T06:14:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.493+0000 7ffb5aa00640 1 -- 172.21.15.3:0/930758782 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7ffb6001e970 con 0x56511e0a7b00 2024-09-19T06:14:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.493+0000 7ffb7f07b740 1 -- 172.21.15.3:0/930758782 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb60003d00 con 0x56511e0a7b00 2024-09-19T06:14:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.493+0000 7ffb5aa00640 1 -- 172.21.15.3:0/930758782 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffb60011700 con 0x56511e0a7b00 2024-09-19T06:14:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.493+0000 7ffb7f07b740 10 client.15783 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.493+0000 7ffb7f07b740 1 -- 172.21.15.3:0/930758782 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56511e0a7010 con 0x56511e0a7b00 2024-09-19T06:14:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.493+0000 7ffb5aa00640 1 -- 172.21.15.3:0/930758782 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb60003d00 con 0x56511e0a7b00 2024-09-19T06:14:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.494+0000 7ffb5aa00640 1 -- 172.21.15.3:0/930758782 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ffb6001d070 con 0x56511e0a7b00 2024-09-19T06:14:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.494+0000 7ffb7f07b740 10 client.15783 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.494+0000 7ffb7f07b740 10 client.15783 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:14:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.494+0000 7ffb7f07b740 20 client.15783 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.494+0000 7ffb7f07b740 1 --2- 172.21.15.3:0/930758782 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56511e12d3f0 0x56511e12f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.494+0000 7ffb7f07b740 4 client.15783 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:14:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.494+0000 7ffb7f07b740 1 -- 172.21.15.3:0/930758782 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56511e014b80 con 0x56511e12d3f0 2024-09-19T06:14:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.494+0000 7ffb79600640 1 --2- 172.21.15.3:0/930758782 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56511e12d3f0 0x56511e12f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.494+0000 7ffb79600640 1 --2- 172.21.15.3:0/930758782 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56511e12d3f0 0x56511e12f810 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d48a869452f1b19 server_cookie=51a584844ca97626 in_seq=0 out_seq=0 2024-09-19T06:14:50.500 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.494+0000 7ffb5aa00640 10 client.15783 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:50.511 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.509+0000 7ffb5aa00640 1 -- 172.21.15.3:0/930758782 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56511e014b80 con 0x56511e12d3f0 2024-09-19T06:14:50.511 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.509+0000 7ffb5aa00640 10 client.15783 handle_command_reply: tid=0 2024-09-19T06:14:50.511 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.509+0000 7ffb7f07b740 1 client.15783 shutdown 2024-09-19T06:14:50.511 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.509+0000 7ffb7f07b740 1 -- 172.21.15.3:0/930758782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a7b00 msgr2=0x56511e0ac9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:50.511 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.509+0000 7ffb7f07b740 1 --2- 172.21.15.3:0/930758782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a7b00 0x56511e0ac9b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ffb60006010 tx=0x7ffb6001e430 comp rx=0 tx=0).stop 2024-09-19T06:14:50.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.509+0000 7ffb7f07b740 1 -- 172.21.15.3:0/930758782 shutdown_connections 2024-09-19T06:14:50.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.509+0000 7ffb7f07b740 1 --2- 172.21.15.3:0/930758782 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56511e12d3f0 0x56511e12f810 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.509+0000 7ffb7f07b740 1 --2- 172.21.15.3:0/930758782 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56511e0b23a0 0x56511e0acef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.509+0000 7ffb7f07b740 1 --2- 172.21.15.3:0/930758782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56511e0a7b00 0x56511e0ac9b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.509+0000 7ffb7f07b740 1 --2- 172.21.15.3:0/930758782 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56511e0a71e0 0x56511e0ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.509+0000 7ffb5aa00640 0 client.15783 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:14:50.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.509+0000 7ffb7f07b740 1 -- 172.21.15.3:0/930758782 >> 172.21.15.3:0/930758782 conn(0x56511e0a3750 msgr2=0x56511e0b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:50.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.509+0000 7ffb7f07b740 1 -- 172.21.15.3:0/930758782 shutdown_connections 2024-09-19T06:14:50.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.509+0000 7ffb7f07b740 1 -- 172.21.15.3:0/930758782 wait complete. 2024-09-19T06:14:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.510+0000 7ffb7f07b740 20 client.15783 trim_cache size 0 max 16384 2024-09-19T06:14:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:14:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:14:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:14:50.513 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:14:50.514 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.510+0000 7ffb7c000640 1 -- 172.21.15.3:0/1551247891 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ffb5c0a3340 msgr2=0x7ffb5c0a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:50.514 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.510+0000 7ffb7c000640 1 --2- 172.21.15.3:0/1551247891 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ffb5c0a3340 0x7ffb5c0a5800 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009d60 tx=0x7ffb68000bc0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.514 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.510+0000 7ffb7c000640 1 -- 172.21.15.3:0/1551247891 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb7410e380 msgr2=0x7ffb7419eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:50.514 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.510+0000 7ffb7c000640 1 --2- 172.21.15.3:0/1551247891 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb7410e380 0x7ffb7419eed0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009dc0 tx=0x7ffb6c003c10 comp rx=0 tx=0).stop 2024-09-19T06:14:50.514 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.510+0000 7ffb7c000640 1 -- 172.21.15.3:0/1551247891 shutdown_connections 2024-09-19T06:14:50.515 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.510+0000 7ffb7c000640 1 --2- 172.21.15.3:0/1551247891 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ffb5c0a3340 0x7ffb5c0a5800 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.515 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.510+0000 7ffb7c000640 1 --2- 172.21.15.3:0/1551247891 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffb7410e380 0x7ffb7419eed0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.515 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.510+0000 7ffb7c000640 1 --2- 172.21.15.3:0/1551247891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb74074ec0 0x7ffb7419ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.515 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.510+0000 7ffb7c000640 1 --2- 172.21.15.3:0/1551247891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffb740745a0 0x7ffb7419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:50.515 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.510+0000 7ffb7c000640 1 -- 172.21.15.3:0/1551247891 >> 172.21.15.3:0/1551247891 conn(0x7ffb740fd7a0 msgr2=0x7ffb740fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:50.515 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.511+0000 7ffb7c000640 1 -- 172.21.15.3:0/1551247891 shutdown_connections 2024-09-19T06:14:50.515 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:14:50.511+0000 7ffb7c000640 1 -- 172.21.15.3:0/1551247891 wait complete. 2024-09-19T06:14:50.635 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:51.094 INFO:tasks.workunit.client.0.smithi003.stdout:1/600: open fd = 3 2024-09-19T06:14:51.094 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.094 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.094 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.094 INFO:tasks.workunit.client.0.smithi003.stdout:2/600: open fd = 3 2024-09-19T06:14:51.095 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.095 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.095 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.095 INFO:tasks.workunit.client.0.smithi003.stdout:3/600: open fd = 3 2024-09-19T06:14:51.095 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.095 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.095 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.095 INFO:tasks.workunit.client.0.smithi003.stdout:4/600: open fd = 3 2024-09-19T06:14:51.095 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.095 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.095 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.095 INFO:tasks.workunit.client.0.smithi003.stdout:5/600: open fd = 3 2024-09-19T06:14:51.095 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.095 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.096 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.096 INFO:tasks.workunit.client.0.smithi003.stdout:6/600: open fd = 3 2024-09-19T06:14:51.096 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.096 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.096 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.096 INFO:tasks.workunit.client.0.smithi003.stdout:7/600: open fd = 3 2024-09-19T06:14:51.096 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.096 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.096 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.096 INFO:tasks.workunit.client.0.smithi003.stdout:8/600: open fd = 3 2024-09-19T06:14:51.096 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.096 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.096 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.097 INFO:tasks.workunit.client.0.smithi003.stdout:9/600: open fd = 3 2024-09-19T06:14:51.097 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.097 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.097 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.097 INFO:tasks.workunit.client.0.smithi003.stdout:10/600: open fd = 3 2024-09-19T06:14:51.097 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.097 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.097 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.097 INFO:tasks.workunit.client.0.smithi003.stdout:11/600: open fd = 3 2024-09-19T06:14:51.097 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.097 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.097 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.097 INFO:tasks.workunit.client.0.smithi003.stdout:12/600: open fd = 3 2024-09-19T06:14:51.098 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.098 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.098 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.098 INFO:tasks.workunit.client.0.smithi003.stdout:13/600: open fd = 3 2024-09-19T06:14:51.098 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.098 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.098 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.098 INFO:tasks.workunit.client.0.smithi003.stdout:14/600: open fd = 3 2024-09-19T06:14:51.098 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.098 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.098 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.098 INFO:tasks.workunit.client.0.smithi003.stdout:15/600: open fd = 3 2024-09-19T06:14:51.098 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.098 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.098 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.099 INFO:tasks.workunit.client.0.smithi003.stdout:16/600: open fd = 3 2024-09-19T06:14:51.099 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.099 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.099 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.099 INFO:tasks.workunit.client.0.smithi003.stdout:17/600: open fd = 3 2024-09-19T06:14:51.099 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.099 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.099 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.099 INFO:tasks.workunit.client.0.smithi003.stdout:18/600: open fd = 3 2024-09-19T06:14:51.099 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.099 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.099 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.099 INFO:tasks.workunit.client.0.smithi003.stdout:19/600: open fd = 3 2024-09-19T06:14:51.099 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.100 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.100 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.100 INFO:tasks.workunit.client.0.smithi003.stdout:20/600: open fd = 3 2024-09-19T06:14:51.100 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.100 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.100 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.100 INFO:tasks.workunit.client.0.smithi003.stdout:21/600: open fd = 3 2024-09-19T06:14:51.100 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.100 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.100 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.100 INFO:tasks.workunit.client.0.smithi003.stdout:22/600: open fd = 3 2024-09-19T06:14:51.100 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.100 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.100 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.101 INFO:tasks.workunit.client.0.smithi003.stdout:23/600: open fd = 3 2024-09-19T06:14:51.101 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.101 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.101 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.101 INFO:tasks.workunit.client.0.smithi003.stdout:24/600: open fd = 3 2024-09-19T06:14:51.101 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.101 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.101 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.101 INFO:tasks.workunit.client.0.smithi003.stdout:25/600: open fd = 3 2024-09-19T06:14:51.101 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.101 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.101 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.101 INFO:tasks.workunit.client.0.smithi003.stdout:26/600: open fd = 3 2024-09-19T06:14:51.101 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.102 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.102 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.102 INFO:tasks.workunit.client.0.smithi003.stdout:27/600: open fd = 3 2024-09-19T06:14:51.102 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.102 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.102 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.102 INFO:tasks.workunit.client.0.smithi003.stdout:28/600: open fd = 3 2024-09-19T06:14:51.102 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.102 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.102 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.102 INFO:tasks.workunit.client.0.smithi003.stdout:29/600: open fd = 3 2024-09-19T06:14:51.102 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.102 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.102 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.103 INFO:tasks.workunit.client.0.smithi003.stdout:30/600: open fd = 3 2024-09-19T06:14:51.103 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.103 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.103 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.103 INFO:tasks.workunit.client.0.smithi003.stdout:31/600: open fd = 3 2024-09-19T06:14:51.103 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.103 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.103 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.103 INFO:tasks.workunit.client.0.smithi003.stdout:32/600: open fd = 3 2024-09-19T06:14:51.103 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.103 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.103 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.103 INFO:tasks.workunit.client.0.smithi003.stdout:33/600: open fd = 3 2024-09-19T06:14:51.103 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.104 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.104 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.104 INFO:tasks.workunit.client.0.smithi003.stdout:34/600: open fd = 3 2024-09-19T06:14:51.104 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.104 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.104 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.104 INFO:tasks.workunit.client.0.smithi003.stdout:35/600: open fd = 3 2024-09-19T06:14:51.104 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.104 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.104 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.104 INFO:tasks.workunit.client.0.smithi003.stdout:36/600: open fd = 3 2024-09-19T06:14:51.104 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.105 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.105 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.105 INFO:tasks.workunit.client.0.smithi003.stdout:37/600: open fd = 3 2024-09-19T06:14:51.105 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.105 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.105 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.105 INFO:tasks.workunit.client.0.smithi003.stdout:38/600: open fd = 3 2024-09-19T06:14:51.105 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.105 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.106 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.106 INFO:tasks.workunit.client.0.smithi003.stdout:39/600: open fd = 3 2024-09-19T06:14:51.106 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.106 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.106 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.106 INFO:tasks.workunit.client.0.smithi003.stdout:40/600: open fd = 3 2024-09-19T06:14:51.106 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.106 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.106 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.106 INFO:tasks.workunit.client.0.smithi003.stdout:41/600: open fd = 3 2024-09-19T06:14:51.106 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.106 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.106 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.106 INFO:tasks.workunit.client.0.smithi003.stdout:42/600: open fd = 3 2024-09-19T06:14:51.107 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.107 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.107 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.107 INFO:tasks.workunit.client.0.smithi003.stdout:43/600: open fd = 3 2024-09-19T06:14:51.107 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.107 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.107 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.107 INFO:tasks.workunit.client.0.smithi003.stdout:44/600: open fd = 3 2024-09-19T06:14:51.107 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.107 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.107 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.107 INFO:tasks.workunit.client.0.smithi003.stdout:45/600: open fd = 3 2024-09-19T06:14:51.107 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.107 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.107 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.108 INFO:tasks.workunit.client.0.smithi003.stdout:46/600: open fd = 3 2024-09-19T06:14:51.108 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.108 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.108 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.108 INFO:tasks.workunit.client.0.smithi003.stdout:47/600: open fd = 3 2024-09-19T06:14:51.108 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.108 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.108 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.108 INFO:tasks.workunit.client.0.smithi003.stdout:48/600: open fd = 3 2024-09-19T06:14:51.108 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.108 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.108 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.108 INFO:tasks.workunit.client.0.smithi003.stdout:49/600: open fd = 3 2024-09-19T06:14:51.109 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.109 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.109 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.109 INFO:tasks.workunit.client.0.smithi003.stdout:50/600: open fd = 3 2024-09-19T06:14:51.109 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.109 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.109 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.109 INFO:tasks.workunit.client.0.smithi003.stdout:51/600: open fd = 3 2024-09-19T06:14:51.109 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.109 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.109 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.109 INFO:tasks.workunit.client.0.smithi003.stdout:52/600: open fd = 3 2024-09-19T06:14:51.109 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.109 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.109 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.110 INFO:tasks.workunit.client.0.smithi003.stdout:53/600: open fd = 3 2024-09-19T06:14:51.110 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.110 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.110 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.110 INFO:tasks.workunit.client.0.smithi003.stdout:54/600: open fd = 3 2024-09-19T06:14:51.110 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.110 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.110 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.110 INFO:tasks.workunit.client.0.smithi003.stdout:55/600: open fd = 3 2024-09-19T06:14:51.110 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.110 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.110 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.110 INFO:tasks.workunit.client.0.smithi003.stdout:56/600: open fd = 3 2024-09-19T06:14:51.110 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.111 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.111 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.111 INFO:tasks.workunit.client.0.smithi003.stdout:57/600: open fd = 3 2024-09-19T06:14:51.111 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.111 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.111 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.111 INFO:tasks.workunit.client.0.smithi003.stdout:58/600: open fd = 3 2024-09-19T06:14:51.111 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.111 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.111 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.111 INFO:tasks.workunit.client.0.smithi003.stdout:59/600: open fd = 3 2024-09-19T06:14:51.111 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.111 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.111 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.111 INFO:tasks.workunit.client.0.smithi003.stdout:60/600: open fd = 3 2024-09-19T06:14:51.112 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.112 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.112 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.112 INFO:tasks.workunit.client.0.smithi003.stdout:61/600: open fd = 3 2024-09-19T06:14:51.112 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.112 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.112 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.112 INFO:tasks.workunit.client.0.smithi003.stdout:62/600: open fd = 3 2024-09-19T06:14:51.112 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.112 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.112 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.112 INFO:tasks.workunit.client.0.smithi003.stdout:63/600: open fd = 3 2024-09-19T06:14:51.112 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.112 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:14:51.112 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:14:51.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.183+0000 7f9b10000640 1 -- 172.21.15.3:0/426500037 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b08101df0 msgr2=0x7f9b081021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:51.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.183+0000 7f9b10000640 1 --2- 172.21.15.3:0/426500037 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b08101df0 0x7f9b081021d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9afc009900 tx=0x7f9afc02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:14:51.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.183+0000 7f9b10000640 1 -- 172.21.15.3:0/426500037 shutdown_connections 2024-09-19T06:14:51.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.183+0000 7f9b10000640 1 --2- 172.21.15.3:0/426500037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b08106f20 0x7f9b0810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:51.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.183+0000 7f9b10000640 1 --2- 172.21.15.3:0/426500037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b081027a0 0x7f9b081067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:51.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.183+0000 7f9b10000640 1 --2- 172.21.15.3:0/426500037 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b08101df0 0x7f9b081021d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:51.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.183+0000 7f9b10000640 1 -- 172.21.15.3:0/426500037 >> 172.21.15.3:0/426500037 conn(0x7f9b080fd8b0 msgr2=0x7f9b080ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:51.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.184+0000 7f9b10000640 1 -- 172.21.15.3:0/426500037 shutdown_connections 2024-09-19T06:14:51.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.184+0000 7f9b10000640 1 -- 172.21.15.3:0/426500037 wait complete. 2024-09-19T06:14:51.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.184+0000 7f9b10000640 1 Processor -- start 2024-09-19T06:14:51.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.185+0000 7f9b10000640 1 -- start start 2024-09-19T06:14:51.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.185+0000 7f9b10000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b08101df0 0x7f9b0819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:51.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.185+0000 7f9b10000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b081027a0 0x7f9b0819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:51.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.185+0000 7f9b10000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b08106f20 0x7f9b0819ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:51.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.185+0000 7f9b10000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9b08111fd0 con 0x7f9b08106f20 2024-09-19T06:14:51.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.185+0000 7f9b10000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9b08111e50 con 0x7f9b08101df0 2024-09-19T06:14:51.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.185+0000 7f9b10000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9b08112150 con 0x7f9b081027a0 2024-09-19T06:14:51.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.185+0000 7f9b0e000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b08106f20 0x7f9b0819ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:51.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.185+0000 7f9b0d600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b08101df0 0x7f9b0819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:51.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.185+0000 7f9b0e000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b08106f20 0x7f9b0819ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35512/0 (socket says 172.21.15.3:35512) 2024-09-19T06:14:51.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.185+0000 7f9b0e000640 1 -- 172.21.15.3:0/157046969 learned_addr learned my addr 172.21.15.3:0/157046969 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:51.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.185+0000 7f9b0cc00640 1 --2- 172.21.15.3:0/157046969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b081027a0 0x7f9b0819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:51.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.186+0000 7f9b0d600640 1 -- 172.21.15.3:0/157046969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b081027a0 msgr2=0x7f9b0819aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:51.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.186+0000 7f9b0d600640 1 --2- 172.21.15.3:0/157046969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b081027a0 0x7f9b0819aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:51.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.186+0000 7f9b0d600640 1 -- 172.21.15.3:0/157046969 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b08106f20 msgr2=0x7f9b0819ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:51.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.186+0000 7f9b0d600640 1 --2- 172.21.15.3:0/157046969 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b08106f20 0x7f9b0819ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:51.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.186+0000 7f9b0d600640 1 -- 172.21.15.3:0/157046969 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0819f560 con 0x7f9b08101df0 2024-09-19T06:14:51.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.186+0000 7f9b0e000640 1 --2- 172.21.15.3:0/157046969 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b08106f20 0x7f9b0819ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:51.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.186+0000 7f9b0d600640 1 --2- 172.21.15.3:0/157046969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b08101df0 0x7f9b0819a5b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9afc02a910 tx=0x7f9afc003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:51.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.187+0000 7f9b06000640 1 -- 172.21.15.3:0/157046969 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc03f070 con 0x7f9b08101df0 2024-09-19T06:14:51.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.187+0000 7f9b06000640 1 -- 172.21.15.3:0/157046969 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9afc031c90 con 0x7f9b08101df0 2024-09-19T06:14:51.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.187+0000 7f9b10000640 1 -- 172.21.15.3:0/157046969 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b0819f7f0 con 0x7f9b08101df0 2024-09-19T06:14:51.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.187+0000 7f9b06000640 1 -- 172.21.15.3:0/157046969 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc035030 con 0x7f9b08101df0 2024-09-19T06:14:51.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.187+0000 7f9b10000640 1 -- 172.21.15.3:0/157046969 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b081a7130 con 0x7f9b08101df0 2024-09-19T06:14:51.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.188+0000 7f9b10000640 1 -- 172.21.15.3:0/157046969 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b081032d0 con 0x7f9b08101df0 2024-09-19T06:14:51.192 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.190+0000 7f9b06000640 1 -- 172.21.15.3:0/157046969 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f9afc042070 con 0x7f9b08101df0 2024-09-19T06:14:51.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.191+0000 7f9b06000640 1 --2- 172.21.15.3:0/157046969 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9af00a33b0 0x7f9af00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:51.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.191+0000 7f9b06000640 1 -- 172.21.15.3:0/157046969 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f9afc0f0980 con 0x7f9b08101df0 2024-09-19T06:14:51.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.192+0000 7f9b0cc00640 1 --2- 172.21.15.3:0/157046969 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9af00a33b0 0x7f9af00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:51.194 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.192+0000 7f9b0cc00640 1 --2- 172.21.15.3:0/157046969 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9af00a33b0 0x7f9af00a5870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9b08076480 tx=0x7f9af4005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:51.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.193+0000 7f9b06000640 1 -- 172.21.15.3:0/157046969 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9afc0bccb0 con 0x7f9b08101df0 2024-09-19T06:14:51.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.416+0000 7f9b10000640 1 -- 172.21.15.3:0/157046969 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b081021d0 con 0x7f9b08101df0 2024-09-19T06:14:51.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.417+0000 7f9b06000640 1 -- 172.21.15.3:0/157046969 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7f9b081021d0 con 0x7f9b08101df0 2024-09-19T06:14:51.419 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:14:51.419 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"btime":"2024-09-19T06:12:22:958217+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:12:22.060987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24532,24515,24514,14517]},"id":1}]} 2024-09-19T06:14:51.419 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2024-09-19T06:14:51.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.419+0000 7f9b10000640 1 -- 172.21.15.3:0/157046969 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9af00a33b0 msgr2=0x7f9af00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:51.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.419+0000 7f9b10000640 1 --2- 172.21.15.3:0/157046969 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9af00a33b0 0x7f9af00a5870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9b08076480 tx=0x7f9af4005f90 comp rx=0 tx=0).stop 2024-09-19T06:14:51.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.419+0000 7f9b10000640 1 -- 172.21.15.3:0/157046969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b08101df0 msgr2=0x7f9b0819a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:51.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.419+0000 7f9b10000640 1 --2- 172.21.15.3:0/157046969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b08101df0 0x7f9b0819a5b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9afc02a910 tx=0x7f9afc003b90 comp rx=0 tx=0).stop 2024-09-19T06:14:51.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.419+0000 7f9b10000640 1 -- 172.21.15.3:0/157046969 shutdown_connections 2024-09-19T06:14:51.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.419+0000 7f9b10000640 1 --2- 172.21.15.3:0/157046969 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9af00a33b0 0x7f9af00a5870 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:51.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.419+0000 7f9b10000640 1 --2- 172.21.15.3:0/157046969 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b08106f20 0x7f9b0819ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:51.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.419+0000 7f9b10000640 1 --2- 172.21.15.3:0/157046969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b081027a0 0x7f9b0819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:51.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.419+0000 7f9b10000640 1 --2- 172.21.15.3:0/157046969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b08101df0 0x7f9b0819a5b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:51.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.419+0000 7f9b10000640 1 -- 172.21.15.3:0/157046969 >> 172.21.15.3:0/157046969 conn(0x7f9b080fd8b0 msgr2=0x7f9b080fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:51.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.419+0000 7f9b10000640 1 -- 172.21.15.3:0/157046969 shutdown_connections 2024-09-19T06:14:51.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:51.419+0000 7f9b10000640 1 -- 172.21.15.3:0/157046969 wait complete. 2024-09-19T06:14:52.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:51 smithi003 ceph-mon[30893]: pgmap v77: 97 pgs: 97 active+clean; 2.5 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-09-19T06:14:52.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:51 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/157046969' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:52.285 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:14:52.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:51 smithi059 ceph-mon[35138]: pgmap v77: 97 pgs: 97 active+clean; 2.5 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-09-19T06:14:52.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:51 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/157046969' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:52.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:51 smithi071 ceph-mon[35662]: pgmap v77: 97 pgs: 97 active+clean; 2.5 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-09-19T06:14:52.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:51 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/157046969' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:14:52.722 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:53.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.305+0000 7f072c000640 1 -- 172.21.15.3:0/65262876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07241049c0 msgr2=0x7f0724108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:53.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.305+0000 7f072c000640 1 --2- 172.21.15.3:0/65262876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07241049c0 0x7f0724108a10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0710009900 tx=0x7f071002a410 comp rx=0 tx=0).stop 2024-09-19T06:14:53.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.306+0000 7f072c000640 1 -- 172.21.15.3:0/65262876 shutdown_connections 2024-09-19T06:14:53.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.306+0000 7f072c000640 1 --2- 172.21.15.3:0/65262876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0724109140 0x7f0724110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.306+0000 7f072c000640 1 --2- 172.21.15.3:0/65262876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07241049c0 0x7f0724108a10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.306+0000 7f072c000640 1 --2- 172.21.15.3:0/65262876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0724104010 0x7f07241043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.306+0000 7f072c000640 1 -- 172.21.15.3:0/65262876 >> 172.21.15.3:0/65262876 conn(0x7f07240ffa50 msgr2=0x7f0724101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:53.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.306+0000 7f072c000640 1 -- 172.21.15.3:0/65262876 shutdown_connections 2024-09-19T06:14:53.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.306+0000 7f072c000640 1 -- 172.21.15.3:0/65262876 wait complete. 2024-09-19T06:14:53.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.307+0000 7f072c000640 1 Processor -- start 2024-09-19T06:14:53.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.307+0000 7f072c000640 1 -- start start 2024-09-19T06:14:53.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.307+0000 7f072c000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0724104010 0x7f072419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.307+0000 7f072c000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07241049c0 0x7f072419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.307+0000 7f072c000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0724109140 0x7f072419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.307+0000 7f072c000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0724114140 con 0x7f07241049c0 2024-09-19T06:14:53.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.307+0000 7f072c000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0724113fc0 con 0x7f0724109140 2024-09-19T06:14:53.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.307+0000 7f072c000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f07241142c0 con 0x7f0724104010 2024-09-19T06:14:53.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.307+0000 7f0729600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0724104010 0x7f072419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.307+0000 7f0728c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07241049c0 0x7f072419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.307+0000 7f0729600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0724104010 0x7f072419a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:60384/0 (socket says 172.21.15.3:60384) 2024-09-19T06:14:53.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.307+0000 7f0729600640 1 -- 172.21.15.3:0/1595081459 learned_addr learned my addr 172.21.15.3:0/1595081459 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:53.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.307+0000 7f072a000640 1 --2- 172.21.15.3:0/1595081459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0724109140 0x7f072419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.308+0000 7f0729600640 1 -- 172.21.15.3:0/1595081459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0724109140 msgr2=0x7f072419eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.308+0000 7f0729600640 1 --2- 172.21.15.3:0/1595081459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0724109140 0x7f072419eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.308+0000 7f0729600640 1 -- 172.21.15.3:0/1595081459 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07241049c0 msgr2=0x7f072419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.308+0000 7f0729600640 1 --2- 172.21.15.3:0/1595081459 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07241049c0 0x7f072419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.308+0000 7f0729600640 1 -- 172.21.15.3:0/1595081459 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072419f5d0 con 0x7f0724104010 2024-09-19T06:14:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.308+0000 7f0728c00640 1 --2- 172.21.15.3:0/1595081459 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07241049c0 0x7f072419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.308+0000 7f0729600640 1 --2- 172.21.15.3:0/1595081459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0724104010 0x7f072419a620 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f071800d950 tx=0x7f071800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.308+0000 7f0722000640 1 -- 172.21.15.3:0/1595081459 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0718017070 con 0x7f0724104010 2024-09-19T06:14:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.308+0000 7f072c000640 1 -- 172.21.15.3:0/1595081459 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f072419f8c0 con 0x7f0724104010 2024-09-19T06:14:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.308+0000 7f0722000640 1 -- 172.21.15.3:0/1595081459 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0718009c30 con 0x7f0724104010 2024-09-19T06:14:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.308+0000 7f0722000640 1 -- 172.21.15.3:0/1595081459 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071800f6b0 con 0x7f0724104010 2024-09-19T06:14:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.309+0000 7f072c000640 1 -- 172.21.15.3:0/1595081459 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07241a71a0 con 0x7f0724104010 2024-09-19T06:14:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.312+0000 7f072ea3e740 1 Processor -- start 2024-09-19T06:14:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.312+0000 7f072ea3e740 1 -- start start 2024-09-19T06:14:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.312+0000 7f0722000640 1 -- 172.21.15.3:0/1595081459 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f07180109d0 con 0x7f0724104010 2024-09-19T06:14:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.312+0000 7f072ea3e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea55dc70 0x5577ea55e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.312+0000 7f072ea3e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577ea55e590 0x5577ea568910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.312+0000 7f072ea3e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea568e50 0x5577ea56b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.312+0000 7f072ea3e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5577ea4c43e0 con 0x5577ea568e50 2024-09-19T06:14:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.312+0000 7f072ea3e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5577ea46bd80 con 0x5577ea55e590 2024-09-19T06:14:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.312+0000 7f072ea3e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5577ea4c03a0 con 0x5577ea55dc70 2024-09-19T06:14:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.312+0000 7f0728c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea568e50 0x5577ea56b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.312+0000 7f0729600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577ea55e590 0x5577ea568910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.312+0000 7f072a000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea55dc70 0x5577ea55e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.313+0000 7f0728c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea568e50 0x5577ea56b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35546/0 (socket says 172.21.15.3:35546) 2024-09-19T06:14:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.313+0000 7f072a000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea55dc70 0x5577ea55e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:60392/0 (socket says 172.21.15.3:60392) 2024-09-19T06:14:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.313+0000 7f0728c00640 1 -- 172.21.15.3:0/4079808113 learned_addr learned my addr 172.21.15.3:0/4079808113 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.313+0000 7f072a000640 1 -- 172.21.15.3:0/4079808113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577ea55e590 msgr2=0x5577ea568910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.313+0000 7f072a000640 1 --2- 172.21.15.3:0/4079808113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577ea55e590 0x5577ea568910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.313+0000 7f072a000640 1 -- 172.21.15.3:0/4079808113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea568e50 msgr2=0x5577ea56b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.313+0000 7f072a000640 1 --2- 172.21.15.3:0/4079808113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea568e50 0x5577ea56b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.313+0000 7f072a000640 1 -- 172.21.15.3:0/4079808113 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577ea48aae0 con 0x5577ea55dc70 2024-09-19T06:14:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.313+0000 7f072a000640 1 --2- 172.21.15.3:0/4079808113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea55dc70 0x5577ea55e050 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f071c009f00 tx=0x7f071c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e057b315ba040d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.313+0000 7f0722000640 1 --2- 172.21.15.3:0/1595081459 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f070c0a33b0 0x7f070c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.313+0000 7f0716600640 1 -- 172.21.15.3:0/4079808113 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071c004d20 con 0x5577ea55dc70 2024-09-19T06:14:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.314+0000 7f0716600640 1 -- 172.21.15.3:0/4079808113 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f071c004050 con 0x5577ea55dc70 2024-09-19T06:14:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.314+0000 7f0722000640 1 -- 172.21.15.3:0/1595081459 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f07180cf8e0 con 0x7f0724104010 2024-09-19T06:14:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.314+0000 7f0716600640 1 -- 172.21.15.3:0/4079808113 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071c005220 con 0x5577ea55dc70 2024-09-19T06:14:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.314+0000 7f0729600640 1 --2- 172.21.15.3:0/1595081459 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f070c0a33b0 0x7f070c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.314+0000 7f072ea3e740 1 -- 172.21.15.3:0/4079808113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea55dc70 msgr2=0x5577ea55e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.314+0000 7f0729600640 1 --2- 172.21.15.3:0/1595081459 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f070c0a33b0 0x7f070c0a5870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f07180cd0e0 tx=0x7f07180d5550 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.314+0000 7f072ea3e740 1 --2- 172.21.15.3:0/4079808113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea55dc70 0x5577ea55e050 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f071c009f00 tx=0x7f071c011810 comp rx=0 tx=0).stop 2024-09-19T06:14:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.314+0000 7f072ea3e740 1 -- 172.21.15.3:0/4079808113 shutdown_connections 2024-09-19T06:14:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.314+0000 7f072ea3e740 1 --2- 172.21.15.3:0/4079808113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea568e50 0x5577ea56b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.314+0000 7f072ea3e740 1 --2- 172.21.15.3:0/4079808113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577ea55e590 0x5577ea568910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.314+0000 7f072ea3e740 1 --2- 172.21.15.3:0/4079808113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea55dc70 0x5577ea55e050 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.314+0000 7f072ea3e740 1 -- 172.21.15.3:0/4079808113 >> 172.21.15.3:0/4079808113 conn(0x5577ea55a200 msgr2=0x5577ea55a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.314+0000 7f072ea3e740 1 -- 172.21.15.3:0/4079808113 shutdown_connections 2024-09-19T06:14:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.315+0000 7f072ea3e740 1 -- 172.21.15.3:0/4079808113 wait complete. 2024-09-19T06:14:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.315+0000 7f072ea3e740 1 -- start start 2024-09-19T06:14:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.315+0000 7f072ea3e740 1 Processor -- start 2024-09-19T06:14:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.316+0000 7f072ea3e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea55dc70 0x5577ea565cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.316+0000 7f072ea3e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577ea55e590 0x5577ea566210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.316+0000 7f072ea3e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea568e50 0x5577ea566750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.316+0000 7f072ea3e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5577ea56ba20 con 0x5577ea55dc70 2024-09-19T06:14:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.316+0000 7f072ea3e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5577ea47f0f0 con 0x5577ea55e590 2024-09-19T06:14:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.316+0000 7f072ea3e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5577ea56bba0 con 0x5577ea568e50 2024-09-19T06:14:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.316+0000 7f072ea3e740 10 client.0 _ll_register_callbacks cb 0x5577ea466bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.316+0000 7f072a000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea55dc70 0x5577ea565cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.316+0000 7f072a000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea55dc70 0x5577ea565cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35556/0 (socket says 172.21.15.3:35556) 2024-09-19T06:14:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.316+0000 7f072a000640 1 -- 172.21.15.3:0/1444038780 learned_addr learned my addr 172.21.15.3:0/1444038780 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.316+0000 7f0728c00640 1 --2- 172.21.15.3:0/1444038780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577ea55e590 0x5577ea566210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.316+0000 7f072a000640 1 --2- 172.21.15.3:0/1444038780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea568e50 0x5577ea566750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.316+0000 7f072a000640 1 -- 172.21.15.3:0/1444038780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea568e50 msgr2=0x5577ea566750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.316+0000 7f072a000640 1 --2- 172.21.15.3:0/1444038780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea568e50 0x5577ea566750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.316+0000 7f072a000640 1 -- 172.21.15.3:0/1444038780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577ea55e590 msgr2=0x5577ea566210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.316+0000 7f072a000640 1 --2- 172.21.15.3:0/1444038780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577ea55e590 0x5577ea566210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.316+0000 7f072a000640 1 -- 172.21.15.3:0/1444038780 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577ea2353c0 con 0x5577ea55dc70 2024-09-19T06:14:53.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.317+0000 7f072a000640 1 --2- 172.21.15.3:0/1444038780 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea55dc70 0x5577ea565cd0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f071c004e30 tx=0x7f071c004940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6ec6347175fec5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:53.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.317+0000 7f070aa00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:14:53.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.317+0000 7f070aa00640 1 -- 172.21.15.3:0/1444038780 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071c004610 con 0x5577ea55dc70 2024-09-19T06:14:53.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.317+0000 7f070aa00640 1 -- 172.21.15.3:0/1444038780 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f071c028480 con 0x5577ea55dc70 2024-09-19T06:14:53.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.317+0000 7f072ea3e740 1 -- 172.21.15.3:0/1444038780 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f071c004050 con 0x5577ea55dc70 2024-09-19T06:14:53.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.317+0000 7f070aa00640 1 -- 172.21.15.3:0/1444038780 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f071c036050 con 0x5577ea55dc70 2024-09-19T06:14:53.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.317+0000 7f072ea3e740 10 client.15801 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:53.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.317+0000 7f072ea3e740 1 -- 172.21.15.3:0/1444038780 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5577ea5779f0 con 0x5577ea55dc70 2024-09-19T06:14:53.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.318+0000 7f070aa00640 1 -- 172.21.15.3:0/1444038780 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f071c004050 con 0x5577ea55dc70 2024-09-19T06:14:53.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.318+0000 7f070aa00640 1 -- 172.21.15.3:0/1444038780 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f071c026720 con 0x5577ea55dc70 2024-09-19T06:14:53.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.318+0000 7f072ea3e740 10 client.15801 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:53.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.318+0000 7f072ea3e740 10 client.15801 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:14:53.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.318+0000 7f072ea3e740 20 client.15801 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:53.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.318+0000 7f072ea3e740 1 --2- 172.21.15.3:0/1444038780 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5577ea578eb0 0x5577ea57b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.318+0000 7f072ea3e740 4 client.15801 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:14:53.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.318+0000 7f072ea3e740 1 -- 172.21.15.3:0/1444038780 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577ea4d1950 con 0x5577ea578eb0 2024-09-19T06:14:53.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.318+0000 7f0728c00640 1 --2- 172.21.15.3:0/1444038780 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5577ea578eb0 0x5577ea57b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.319+0000 7f0728c00640 1 --2- 172.21.15.3:0/1444038780 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5577ea578eb0 0x5577ea57b2a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a80e1948cb062207 server_cookie=eebb79847163b4d1 in_seq=0 out_seq=0 2024-09-19T06:14:53.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.319+0000 7f070aa00640 10 client.15801 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:14:53.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.319+0000 7f070aa00640 1 -- 172.21.15.3:0/1444038780 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5577ea4d1950 con 0x5577ea578eb0 2024-09-19T06:14:53.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.319+0000 7f070aa00640 10 client.15801 handle_command_reply: tid=0 2024-09-19T06:14:53.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.319+0000 7f072ea3e740 1 client.15801 shutdown 2024-09-19T06:14:53.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.320+0000 7f072ea3e740 1 -- 172.21.15.3:0/1444038780 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea55dc70 msgr2=0x5577ea565cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:53.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.320+0000 7f072ea3e740 1 --2- 172.21.15.3:0/1444038780 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea55dc70 0x5577ea565cd0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f071c004e30 tx=0x7f071c004940 comp rx=0 tx=0).stop 2024-09-19T06:14:53.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.320+0000 7f072ea3e740 1 -- 172.21.15.3:0/1444038780 shutdown_connections 2024-09-19T06:14:53.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.320+0000 7f072ea3e740 1 --2- 172.21.15.3:0/1444038780 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5577ea578eb0 0x5577ea57b2a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.320+0000 7f072ea3e740 1 --2- 172.21.15.3:0/1444038780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea568e50 0x5577ea566750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.320+0000 7f072ea3e740 1 --2- 172.21.15.3:0/1444038780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577ea55e590 0x5577ea566210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.320+0000 7f072ea3e740 1 --2- 172.21.15.3:0/1444038780 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea55dc70 0x5577ea565cd0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.320+0000 7f072ea3e740 1 -- 172.21.15.3:0/1444038780 >> 172.21.15.3:0/1444038780 conn(0x5577ea55a200 msgr2=0x5577ea559380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:53.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.320+0000 7f070aa00640 0 client.15801 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:14:53.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.320+0000 7f072ea3e740 1 -- 172.21.15.3:0/1444038780 shutdown_connections 2024-09-19T06:14:53.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.320+0000 7f072ea3e740 1 -- 172.21.15.3:0/1444038780 wait complete. 2024-09-19T06:14:53.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.320+0000 7f072ea3e740 20 client.15801 trim_cache size 0 max 16384 2024-09-19T06:14:53.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.334+0000 7f072ea3e740 1 Processor -- start 2024-09-19T06:14:53.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.334+0000 7f072ea3e740 1 -- start start 2024-09-19T06:14:53.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.334+0000 7f072ea3e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea55dc70 0x5577ea5809e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.334+0000 7f072ea3e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea55e590 0x5577ea580f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.334+0000 7f072ea3e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577ea568e50 0x5577ea55f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.334+0000 7f072ea3e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f07241afa40 con 0x5577ea55dc70 2024-09-19T06:14:53.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.334+0000 7f072ea3e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f07241b1580 con 0x5577ea568e50 2024-09-19T06:14:53.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.334+0000 7f072ea3e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f07241b0110 con 0x5577ea55e590 2024-09-19T06:14:53.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.334+0000 7f072a000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea55dc70 0x5577ea5809e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.334+0000 7f072a000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea55dc70 0x5577ea5809e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35562/0 (socket says 172.21.15.3:35562) 2024-09-19T06:14:53.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.334+0000 7f072a000640 1 -- 172.21.15.3:0/2245297652 learned_addr learned my addr 172.21.15.3:0/2245297652 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:53.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.334+0000 7f0728c00640 1 --2- 172.21.15.3:0/2245297652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea55e590 0x5577ea580f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.335+0000 7f072a000640 1 --2- 172.21.15.3:0/2245297652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577ea568e50 0x5577ea55f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.335+0000 7f0728c00640 1 -- 172.21.15.3:0/2245297652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577ea568e50 msgr2=0x5577ea55f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:53.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.335+0000 7f0728c00640 1 --2- 172.21.15.3:0/2245297652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577ea568e50 0x5577ea55f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.335+0000 7f0728c00640 1 -- 172.21.15.3:0/2245297652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea55dc70 msgr2=0x5577ea5809e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:53.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.335+0000 7f0728c00640 1 --2- 172.21.15.3:0/2245297652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea55dc70 0x5577ea5809e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.335+0000 7f0728c00640 1 -- 172.21.15.3:0/2245297652 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577ea555770 con 0x5577ea55e590 2024-09-19T06:14:53.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.335+0000 7f072a000640 1 --2- 172.21.15.3:0/2245297652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577ea568e50 0x5577ea55f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:53.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.335+0000 7f0728c00640 1 --2- 172.21.15.3:0/2245297652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea55e590 0x5577ea580f20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0710000c00 tx=0x7f0710032a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e725fe2dc21080e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:53.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.335+0000 7f0715c00640 1 -- 172.21.15.3:0/2245297652 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071004b030 con 0x5577ea55e590 2024-09-19T06:14:53.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.336+0000 7f0715c00640 1 -- 172.21.15.3:0/2245297652 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0710005040 con 0x5577ea55e590 2024-09-19T06:14:53.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.336+0000 7f0715c00640 1 -- 172.21.15.3:0/2245297652 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0710035040 con 0x5577ea55e590 2024-09-19T06:14:53.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.336+0000 7f072ea3e740 1 -- 172.21.15.3:0/2245297652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea55e590 msgr2=0x5577ea580f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:53.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.336+0000 7f072ea3e740 1 --2- 172.21.15.3:0/2245297652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea55e590 0x5577ea580f20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0710000c00 tx=0x7f0710032a70 comp rx=0 tx=0).stop 2024-09-19T06:14:53.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.336+0000 7f072ea3e740 1 -- 172.21.15.3:0/2245297652 shutdown_connections 2024-09-19T06:14:53.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.336+0000 7f072ea3e740 1 --2- 172.21.15.3:0/2245297652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577ea568e50 0x5577ea55f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.336+0000 7f072ea3e740 1 --2- 172.21.15.3:0/2245297652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea55e590 0x5577ea580f20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.336+0000 7f072ea3e740 1 --2- 172.21.15.3:0/2245297652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea55dc70 0x5577ea5809e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.336+0000 7f072ea3e740 1 -- 172.21.15.3:0/2245297652 >> 172.21.15.3:0/2245297652 conn(0x5577ea55a200 msgr2=0x5577ea567d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:53.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.336+0000 7f072ea3e740 1 -- 172.21.15.3:0/2245297652 shutdown_connections 2024-09-19T06:14:53.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.336+0000 7f072ea3e740 1 -- 172.21.15.3:0/2245297652 wait complete. 2024-09-19T06:14:53.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.337+0000 7f072ea3e740 1 -- start start 2024-09-19T06:14:53.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.337+0000 7f072ea3e740 1 Processor -- start 2024-09-19T06:14:53.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.337+0000 7f072ea3e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea55dc70 0x5577ea570f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.337+0000 7f072ea3e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea55e590 0x5577ea5714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.337+0000 7f072ea3e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577ea568e50 0x5577ea56c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.337+0000 7f072ea3e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f07241b0eb0 con 0x5577ea55dc70 2024-09-19T06:14:53.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.337+0000 7f072ea3e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f07241b07e0 con 0x5577ea568e50 2024-09-19T06:14:53.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.337+0000 7f072ea3e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f07241ada20 con 0x5577ea55e590 2024-09-19T06:14:53.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.337+0000 7f072ea3e740 10 client.0 _ll_register_callbacks cb 0x7f0710009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:53.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.338+0000 7f072a000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea55dc70 0x5577ea570f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.338+0000 7f0728c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea55e590 0x5577ea5714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.338+0000 7f0728c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea55e590 0x5577ea5714d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:60440/0 (socket says 172.21.15.3:60440) 2024-09-19T06:14:53.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.338+0000 7f0728c00640 1 -- 172.21.15.3:0/2640502223 learned_addr learned my addr 172.21.15.3:0/2640502223 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:53.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.338+0000 7f072a000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea55dc70 0x5577ea570f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35572/0 (socket says 172.21.15.3:35572) 2024-09-19T06:14:53.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.338+0000 7f072a000640 1 --2- 172.21.15.3:0/2640502223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577ea568e50 0x5577ea56c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.338+0000 7f0728c00640 1 -- 172.21.15.3:0/2640502223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577ea568e50 msgr2=0x5577ea56c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:53.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.338+0000 7f0728c00640 1 --2- 172.21.15.3:0/2640502223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577ea568e50 0x5577ea56c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.338+0000 7f0728c00640 1 -- 172.21.15.3:0/2640502223 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea55dc70 msgr2=0x5577ea570f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:53.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.338+0000 7f0728c00640 1 --2- 172.21.15.3:0/2640502223 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea55dc70 0x5577ea570f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.338+0000 7f0728c00640 1 -- 172.21.15.3:0/2640502223 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577ea566ca0 con 0x5577ea55e590 2024-09-19T06:14:53.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.338+0000 7f072a000640 1 --2- 172.21.15.3:0/2640502223 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea55dc70 0x5577ea570f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:53.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.338+0000 7f0728c00640 1 --2- 172.21.15.3:0/2640502223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea55e590 0x5577ea5714d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0710006010 tx=0x7f071002ab50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=502c2466c364939c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:53.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.338+0000 7f070aa00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:14:53.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.339+0000 7f070aa00640 1 -- 172.21.15.3:0/2640502223 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071004b070 con 0x5577ea55e590 2024-09-19T06:14:53.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.339+0000 7f072ea3e740 1 -- 172.21.15.3:0/2640502223 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0710005040 con 0x5577ea55e590 2024-09-19T06:14:53.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.339+0000 7f070aa00640 1 -- 172.21.15.3:0/2640502223 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f0710004240 con 0x5577ea55e590 2024-09-19T06:14:53.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.339+0000 7f070aa00640 1 -- 172.21.15.3:0/2640502223 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0710035040 con 0x5577ea55e590 2024-09-19T06:14:53.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.339+0000 7f072ea3e740 10 client.25858 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:53.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.339+0000 7f072ea3e740 1 -- 172.21.15.3:0/2640502223 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5577ea5e32e0 con 0x5577ea55e590 2024-09-19T06:14:53.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.339+0000 7f070aa00640 1 -- 172.21.15.3:0/2640502223 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0710005040 con 0x5577ea55e590 2024-09-19T06:14:53.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.340+0000 7f070aa00640 1 -- 172.21.15.3:0/2640502223 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0710003710 con 0x5577ea55e590 2024-09-19T06:14:53.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.340+0000 7f072ea3e740 10 client.25858 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:53.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.340+0000 7f072ea3e740 10 client.25858 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:14:53.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.340+0000 7f072ea3e740 20 client.25858 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:53.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.340+0000 7f072ea3e740 1 --2- 172.21.15.3:0/2640502223 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5577ea5e39b0 0x5577ea5e5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:53.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.340+0000 7f072ea3e740 4 client.25858 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:14:53.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.340+0000 7f072ea3e740 1 -- 172.21.15.3:0/2640502223 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5577ea4cbe60 con 0x5577ea5e39b0 2024-09-19T06:14:53.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.340+0000 7f072a000640 1 --2- 172.21.15.3:0/2640502223 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5577ea5e39b0 0x5577ea5e5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:53.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.341+0000 7f072a000640 1 --2- 172.21.15.3:0/2640502223 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5577ea5e39b0 0x5577ea5e5dd0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7b98723a3c86bb6f server_cookie=689beb88069a60dc in_seq=0 out_seq=0 2024-09-19T06:14:53.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.341+0000 7f070aa00640 10 client.25858 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:14:53.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.341+0000 7f070aa00640 1 -- 172.21.15.3:0/2640502223 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5577ea4cbe60 con 0x5577ea5e39b0 2024-09-19T06:14:53.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.341+0000 7f070aa00640 10 client.25858 handle_command_reply: tid=0 2024-09-19T06:14:53.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.341+0000 7f072ea3e740 1 client.25858 shutdown 2024-09-19T06:14:53.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.341+0000 7f072ea3e740 1 -- 172.21.15.3:0/2640502223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea55e590 msgr2=0x5577ea5714d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:53.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.341+0000 7f072ea3e740 1 --2- 172.21.15.3:0/2640502223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea55e590 0x5577ea5714d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0710006010 tx=0x7f071002ab50 comp rx=0 tx=0).stop 2024-09-19T06:14:53.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.341+0000 7f072ea3e740 1 -- 172.21.15.3:0/2640502223 shutdown_connections 2024-09-19T06:14:53.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.341+0000 7f072ea3e740 1 --2- 172.21.15.3:0/2640502223 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5577ea5e39b0 0x5577ea5e5dd0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.341+0000 7f072ea3e740 1 --2- 172.21.15.3:0/2640502223 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577ea568e50 0x5577ea56c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.341+0000 7f072ea3e740 1 --2- 172.21.15.3:0/2640502223 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577ea55e590 0x5577ea5714d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.341+0000 7f072ea3e740 1 --2- 172.21.15.3:0/2640502223 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5577ea55dc70 0x5577ea570f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.341+0000 7f070aa00640 0 client.25858 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:14:53.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.341+0000 7f072ea3e740 1 -- 172.21.15.3:0/2640502223 >> 172.21.15.3:0/2640502223 conn(0x5577ea55a200 msgr2=0x5577ea565c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:53.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.341+0000 7f072ea3e740 1 -- 172.21.15.3:0/2640502223 shutdown_connections 2024-09-19T06:14:53.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.342+0000 7f072ea3e740 1 -- 172.21.15.3:0/2640502223 wait complete. 2024-09-19T06:14:53.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.342+0000 7f072ea3e740 20 client.25858 trim_cache size 0 max 16384 2024-09-19T06:14:53.365 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:14:53.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.342+0000 7f072c000640 1 -- 172.21.15.3:0/1595081459 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f070c0a33b0 msgr2=0x7f070c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:53.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.342+0000 7f072c000640 1 --2- 172.21.15.3:0/1595081459 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f070c0a33b0 0x7f070c0a5870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f07180cd0e0 tx=0x7f07180d5550 comp rx=0 tx=0).stop 2024-09-19T06:14:53.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.342+0000 7f072c000640 1 -- 172.21.15.3:0/1595081459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0724104010 msgr2=0x7f072419a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:53.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.342+0000 7f072c000640 1 --2- 172.21.15.3:0/1595081459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0724104010 0x7f072419a620 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f071800d950 tx=0x7f071800de10 comp rx=0 tx=0).stop 2024-09-19T06:14:53.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.342+0000 7f072c000640 1 -- 172.21.15.3:0/1595081459 shutdown_connections 2024-09-19T06:14:53.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.342+0000 7f072c000640 1 --2- 172.21.15.3:0/1595081459 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f070c0a33b0 0x7f070c0a5870 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.342+0000 7f072c000640 1 --2- 172.21.15.3:0/1595081459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0724109140 0x7f072419eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.342+0000 7f072c000640 1 --2- 172.21.15.3:0/1595081459 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07241049c0 0x7f072419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.342+0000 7f072c000640 1 --2- 172.21.15.3:0/1595081459 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0724104010 0x7f072419a620 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:53.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.342+0000 7f072c000640 1 -- 172.21.15.3:0/1595081459 >> 172.21.15.3:0/1595081459 conn(0x7f07240ffa50 msgr2=0x7f0724100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:53.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.343+0000 7f072c000640 1 -- 172.21.15.3:0/1595081459 shutdown_connections 2024-09-19T06:14:53.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:53.343+0000 7f072c000640 1 -- 172.21.15.3:0/1595081459 wait complete. 2024-09-19T06:14:54.029 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:53 smithi003 ceph-mon[30893]: pgmap v78: 97 pgs: 97 active+clean; 2.5 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-09-19T06:14:54.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:53 smithi059 ceph-mon[35138]: pgmap v78: 97 pgs: 97 active+clean; 2.5 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-09-19T06:14:54.319 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:14:54.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:53 smithi071 ceph-mon[35662]: pgmap v78: 97 pgs: 97 active+clean; 2.5 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-09-19T06:14:54.699 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:55.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.332+0000 7f56ff000640 1 -- 172.21.15.3:0/1601760516 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f56f8112a30 msgr2=0x7f56f8114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:55.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.332+0000 7f56ff000640 1 --2- 172.21.15.3:0/1601760516 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f56f8112a30 0x7f56f8114e20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f56f0009ca0 tx=0x7f56f002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.332+0000 7f56ff000640 1 -- 172.21.15.3:0/1601760516 shutdown_connections 2024-09-19T06:14:55.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.332+0000 7f56ff000640 1 --2- 172.21.15.3:0/1601760516 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f56f8112a30 0x7f56f8114e20 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.332+0000 7f56ff000640 1 --2- 172.21.15.3:0/1601760516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56f8077040 0x7f56f81124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.332+0000 7f56ff000640 1 --2- 172.21.15.3:0/1601760516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56f8076720 0x7f56f8076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.332+0000 7f56ff000640 1 -- 172.21.15.3:0/1601760516 >> 172.21.15.3:0/1601760516 conn(0x7f56f80ffa90 msgr2=0x7f56f8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:55.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.332+0000 7f56ff000640 1 -- 172.21.15.3:0/1601760516 shutdown_connections 2024-09-19T06:14:55.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.332+0000 7f56ff000640 1 -- 172.21.15.3:0/1601760516 wait complete. 2024-09-19T06:14:55.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.333+0000 7f56ff000640 1 Processor -- start 2024-09-19T06:14:55.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.333+0000 7f56ff000640 1 -- start start 2024-09-19T06:14:55.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.334+0000 7f56ff000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56f8076720 0x7f56f81a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:55.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.334+0000 7f56ff000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56f8077040 0x7f56f81a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:55.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.334+0000 7f56ff000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f56f8112a30 0x7f56f819e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:55.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.334+0000 7f56ff000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f56f81185d0 con 0x7f56f8112a30 2024-09-19T06:14:55.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.334+0000 7f56ff000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f56f8118450 con 0x7f56f8076720 2024-09-19T06:14:55.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.334+0000 7f56ff000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f56f8118750 con 0x7f56f8077040 2024-09-19T06:14:55.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.334+0000 7f56f7400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56f8077040 0x7f56f81a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:55.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.334+0000 7f56fd000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f56f8112a30 0x7f56f819e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:55.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.334+0000 7f56f7400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56f8077040 0x7f56f81a4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:43330/0 (socket says 172.21.15.3:43330) 2024-09-19T06:14:55.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.334+0000 7f56f7400640 1 -- 172.21.15.3:0/3086756158 learned_addr learned my addr 172.21.15.3:0/3086756158 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:55.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.334+0000 7f56f7e00640 1 --2- 172.21.15.3:0/3086756158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56f8076720 0x7f56f81a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:55.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.334+0000 7f56f7400640 1 -- 172.21.15.3:0/3086756158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56f8076720 msgr2=0x7f56f81a46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:55.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.334+0000 7f56f7400640 1 --2- 172.21.15.3:0/3086756158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56f8076720 0x7f56f81a46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.334+0000 7f56f7400640 1 -- 172.21.15.3:0/3086756158 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f56f8112a30 msgr2=0x7f56f819e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:55.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.334+0000 7f56f7400640 1 --2- 172.21.15.3:0/3086756158 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f56f8112a30 0x7f56f819e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.334+0000 7f56f7400640 1 -- 172.21.15.3:0/3086756158 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f819efb0 con 0x7f56f8077040 2024-09-19T06:14:55.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.335+0000 7f56f7400640 1 --2- 172.21.15.3:0/3086756158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56f8077040 0x7f56f81a4c00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f56e400d950 tx=0x7f56e400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:55.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.335+0000 7f56f4c00640 1 -- 172.21.15.3:0/3086756158 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e4017030 con 0x7f56f8077040 2024-09-19T06:14:55.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.335+0000 7f56f4c00640 1 -- 172.21.15.3:0/3086756158 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56e4004020 con 0x7f56f8077040 2024-09-19T06:14:55.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.335+0000 7f56ff000640 1 -- 172.21.15.3:0/3086756158 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f819f2a0 con 0x7f56f8077040 2024-09-19T06:14:55.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.335+0000 7f56f4c00640 1 -- 172.21.15.3:0/3086756158 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e40047a0 con 0x7f56f8077040 2024-09-19T06:14:55.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.335+0000 7f56ff000640 1 -- 172.21.15.3:0/3086756158 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f81ab590 con 0x7f56f8077040 2024-09-19T06:14:55.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.338+0000 7f5701a5c740 1 Processor -- start 2024-09-19T06:14:55.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.339+0000 7f5701a5c740 1 -- start start 2024-09-19T06:14:55.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.339+0000 7f5701a5c740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1866c70 0x5560f1867050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:55.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.339+0000 7f5701a5c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560f1867590 0x5560f1871910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:55.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.339+0000 7f5701a5c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1871e50 0x5560f1874240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:55.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.339+0000 7f5701a5c740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5560f17cd3e0 con 0x5560f1866c70 2024-09-19T06:14:55.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.339+0000 7f5701a5c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5560f1774d80 con 0x5560f1871e50 2024-09-19T06:14:55.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.339+0000 7f5701a5c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5560f17c93a0 con 0x5560f1867590 2024-09-19T06:14:55.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.339+0000 7f56f4c00640 1 -- 172.21.15.3:0/3086756158 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f56e40041d0 con 0x7f56f8077040 2024-09-19T06:14:55.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.339+0000 7f56fd000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1866c70 0x5560f1867050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:55.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.339+0000 7f56fd000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1866c70 0x5560f1867050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55920/0 (socket says 172.21.15.3:55920) 2024-09-19T06:14:55.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.339+0000 7f56f7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1871e50 0x5560f1874240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:55.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.339+0000 7f56fd000640 1 -- 172.21.15.3:0/819039630 learned_addr learned my addr 172.21.15.3:0/819039630 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:55.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.339+0000 7f56f7e00640 1 --2- 172.21.15.3:0/819039630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560f1867590 0x5560f1871910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:55.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.340+0000 7f56fd000640 1 -- 172.21.15.3:0/819039630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560f1867590 msgr2=0x5560f1871910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:55.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.340+0000 7f56fd000640 1 --2- 172.21.15.3:0/819039630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560f1867590 0x5560f1871910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.340+0000 7f56fd000640 1 -- 172.21.15.3:0/819039630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1871e50 msgr2=0x5560f1874240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:55.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.340+0000 7f56fd000640 1 --2- 172.21.15.3:0/819039630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1871e50 0x5560f1874240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.340+0000 7f56fd000640 1 -- 172.21.15.3:0/819039630 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f1793ae0 con 0x5560f1866c70 2024-09-19T06:14:55.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.340+0000 7f56f7400640 1 --2- 172.21.15.3:0/819039630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1871e50 0x5560f1874240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:55.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.340+0000 7f56fd000640 1 --2- 172.21.15.3:0/819039630 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1866c70 0x5560f1867050 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f56f807aa10 tx=0x7f56f00093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998ba426d762a38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:55.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.341+0000 7f56ed600640 1 -- 172.21.15.3:0/819039630 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f0031db0 con 0x5560f1866c70 2024-09-19T06:14:55.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.341+0000 7f56ed600640 1 -- 172.21.15.3:0/819039630 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56f0036030 con 0x5560f1866c70 2024-09-19T06:14:55.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.341+0000 7f56ed600640 1 -- 172.21.15.3:0/819039630 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f0004240 con 0x5560f1866c70 2024-09-19T06:14:55.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.341+0000 7f56f4c00640 1 --2- 172.21.15.3:0/3086756158 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f56dc0a33b0 0x7f56dc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:55.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.341+0000 7f56f4c00640 1 -- 172.21.15.3:0/3086756158 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f56e40cf670 con 0x7f56f8077040 2024-09-19T06:14:55.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.341+0000 7f56f7e00640 1 --2- 172.21.15.3:0/3086756158 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f56dc0a33b0 0x7f56dc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:55.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.342+0000 7f5701a5c740 1 -- 172.21.15.3:0/819039630 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1866c70 msgr2=0x5560f1867050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:55.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.342+0000 7f5701a5c740 1 --2- 172.21.15.3:0/819039630 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1866c70 0x5560f1867050 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f56f807aa10 tx=0x7f56f00093e0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.342+0000 7f5701a5c740 1 -- 172.21.15.3:0/819039630 shutdown_connections 2024-09-19T06:14:55.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.342+0000 7f5701a5c740 1 --2- 172.21.15.3:0/819039630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1871e50 0x5560f1874240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.342+0000 7f5701a5c740 1 --2- 172.21.15.3:0/819039630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560f1867590 0x5560f1871910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.342+0000 7f5701a5c740 1 --2- 172.21.15.3:0/819039630 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1866c70 0x5560f1867050 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.342+0000 7f5701a5c740 1 -- 172.21.15.3:0/819039630 >> 172.21.15.3:0/819039630 conn(0x5560f1863200 msgr2=0x5560f18635e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:55.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.342+0000 7f5701a5c740 1 -- 172.21.15.3:0/819039630 shutdown_connections 2024-09-19T06:14:55.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.342+0000 7f5701a5c740 1 -- 172.21.15.3:0/819039630 wait complete. 2024-09-19T06:14:55.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.342+0000 7f56f7e00640 1 --2- 172.21.15.3:0/3086756158 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f56dc0a33b0 0x7f56dc0a5870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x5560f1864060 tx=0x7f56e8005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:55.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.343+0000 7f5701a5c740 1 -- start start 2024-09-19T06:14:55.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.343+0000 7f5701a5c740 1 Processor -- start 2024-09-19T06:14:55.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.343+0000 7f5701a5c740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1866c70 0x5560f186ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:55.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.343+0000 7f5701a5c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560f1867590 0x5560f186f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:55.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.343+0000 7f5701a5c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1871e50 0x5560f186f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:55.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.343+0000 7f5701a5c740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5560f18748a0 con 0x5560f1866c70 2024-09-19T06:14:55.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.343+0000 7f5701a5c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5560f17880f0 con 0x5560f1871e50 2024-09-19T06:14:55.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.343+0000 7f5701a5c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5560f1874a20 con 0x5560f1867590 2024-09-19T06:14:55.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.344+0000 7f5701a5c740 10 client.0 _ll_register_callbacks cb 0x5560f176fbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:55.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.344+0000 7f56fd000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1871e50 0x5560f186f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:55.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.344+0000 7f56f7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1866c70 0x5560f186ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:55.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.344+0000 7f56fd000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1871e50 0x5560f186f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:42472/0 (socket says 172.21.15.3:42472) 2024-09-19T06:14:55.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.344+0000 7f56fd000640 1 -- 172.21.15.3:0/3733667034 learned_addr learned my addr 172.21.15.3:0/3733667034 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:55.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.344+0000 7f56f7400640 1 --2- 172.21.15.3:0/3733667034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560f1867590 0x5560f186f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:55.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.344+0000 7f56fd000640 1 -- 172.21.15.3:0/3733667034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560f1867590 msgr2=0x5560f186f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:55.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.344+0000 7f56fd000640 1 --2- 172.21.15.3:0/3733667034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560f1867590 0x5560f186f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.344+0000 7f56fd000640 1 -- 172.21.15.3:0/3733667034 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1866c70 msgr2=0x5560f186ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:55.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.344+0000 7f56fd000640 1 --2- 172.21.15.3:0/3733667034 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1866c70 0x5560f186ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.344+0000 7f56fd000640 1 -- 172.21.15.3:0/3733667034 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560f153e3c0 con 0x5560f1871e50 2024-09-19T06:14:55.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.344+0000 7f56f7e00640 1 --2- 172.21.15.3:0/3733667034 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1866c70 0x5560f186ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:55.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.345+0000 7f56fd000640 1 --2- 172.21.15.3:0/3733667034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1871e50 0x5560f186f7a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f56f0009bf0 tx=0x7f56f002f490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19a7ea60577d148 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:55.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.345+0000 7f56e2000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:14:55.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.345+0000 7f56e2000640 1 -- 172.21.15.3:0/3733667034 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f004a040 con 0x5560f1871e50 2024-09-19T06:14:55.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.345+0000 7f5701a5c740 1 -- 172.21.15.3:0/3733667034 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56f0036030 con 0x5560f1871e50 2024-09-19T06:14:55.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.345+0000 7f56e2000640 1 -- 172.21.15.3:0/3733667034 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f56f0003970 con 0x5560f1871e50 2024-09-19T06:14:55.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.345+0000 7f56e2000640 1 -- 172.21.15.3:0/3733667034 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f56f005e050 con 0x5560f1871e50 2024-09-19T06:14:55.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.345+0000 7f5701a5c740 10 client.25868 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:55.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.345+0000 7f5701a5c740 1 -- 172.21.15.3:0/3733667034 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5560f18748a0 con 0x5560f1871e50 2024-09-19T06:14:55.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.346+0000 7f56e2000640 1 -- 172.21.15.3:0/3733667034 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56f0036030 con 0x5560f1871e50 2024-09-19T06:14:55.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.346+0000 7f56e2000640 1 -- 172.21.15.3:0/3733667034 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f56f004d030 con 0x5560f1871e50 2024-09-19T06:14:55.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.346+0000 7f5701a5c740 10 client.25868 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:55.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.346+0000 7f5701a5c740 10 client.25868 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:14:55.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.346+0000 7f5701a5c740 20 client.25868 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:55.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.346+0000 7f5701a5c740 1 --2- 172.21.15.3:0/3733667034 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x5560f1881a40 0x5560f1883e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:55.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.346+0000 7f5701a5c740 4 client.25868 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:14:55.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.346+0000 7f5701a5c740 1 -- 172.21.15.3:0/3733667034 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560f17da950 con 0x5560f1881a40 2024-09-19T06:14:55.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.347+0000 7f56f7e00640 1 --2- 172.21.15.3:0/3733667034 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x5560f1881a40 0x5560f1883e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:55.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.347+0000 7f56f7e00640 1 --2- 172.21.15.3:0/3733667034 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x5560f1881a40 0x5560f1883e30 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a730cb734c3960ed server_cookie=66db4881717eebaf in_seq=0 out_seq=0 2024-09-19T06:14:55.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.347+0000 7f56e2000640 10 client.25868 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:14:55.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.348+0000 7f56e2000640 1 -- 172.21.15.3:0/3733667034 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5560f17da950 con 0x5560f1881a40 2024-09-19T06:14:55.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.348+0000 7f56e2000640 10 client.25868 handle_command_reply: tid=0 2024-09-19T06:14:55.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.348+0000 7f5701a5c740 1 client.25868 shutdown 2024-09-19T06:14:55.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.348+0000 7f5701a5c740 1 -- 172.21.15.3:0/3733667034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1871e50 msgr2=0x5560f186f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:55.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.348+0000 7f5701a5c740 1 --2- 172.21.15.3:0/3733667034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1871e50 0x5560f186f7a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f56f0009bf0 tx=0x7f56f002f490 comp rx=0 tx=0).stop 2024-09-19T06:14:55.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.348+0000 7f5701a5c740 1 -- 172.21.15.3:0/3733667034 shutdown_connections 2024-09-19T06:14:55.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.348+0000 7f5701a5c740 1 --2- 172.21.15.3:0/3733667034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1871e50 0x5560f186f7a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.348+0000 7f5701a5c740 1 --2- 172.21.15.3:0/3733667034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560f1867590 0x5560f186f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.349+0000 7f5701a5c740 1 --2- 172.21.15.3:0/3733667034 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x5560f1881a40 0x5560f1883e30 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.349+0000 7f5701a5c740 1 --2- 172.21.15.3:0/3733667034 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1866c70 0x5560f186ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.349+0000 7f56e2000640 0 client.25868 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:14:55.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.349+0000 7f5701a5c740 1 -- 172.21.15.3:0/3733667034 >> 172.21.15.3:0/3733667034 conn(0x5560f1863200 msgr2=0x5560f1868ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:55.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.349+0000 7f5701a5c740 1 -- 172.21.15.3:0/3733667034 shutdown_connections 2024-09-19T06:14:55.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.349+0000 7f5701a5c740 1 -- 172.21.15.3:0/3733667034 wait complete. 2024-09-19T06:14:55.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.349+0000 7f5701a5c740 20 client.25868 trim_cache size 0 max 16384 2024-09-19T06:14:55.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.362+0000 7f5701a5c740 1 Processor -- start 2024-09-19T06:14:55.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.363+0000 7f5701a5c740 1 -- start start 2024-09-19T06:14:55.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.363+0000 7f5701a5c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560f1866c70 0x5560f18696d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:55.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.363+0000 7f5701a5c740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1867590 0x5560f1870580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:55.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.363+0000 7f5701a5c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1871e50 0x5560f18896b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:55.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.363+0000 7f5701a5c740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f56f81b3dc0 con 0x5560f1867590 2024-09-19T06:14:55.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.363+0000 7f5701a5c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f56f81b5900 con 0x5560f1871e50 2024-09-19T06:14:55.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.363+0000 7f5701a5c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f56f81b4490 con 0x5560f1866c70 2024-09-19T06:14:55.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.363+0000 7f56f7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1867590 0x5560f1870580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:55.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.363+0000 7f56f7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1867590 0x5560f1870580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55942/0 (socket says 172.21.15.3:55942) 2024-09-19T06:14:55.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.363+0000 7f56f7400640 1 -- 172.21.15.3:0/1847832902 learned_addr learned my addr 172.21.15.3:0/1847832902 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:55.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.363+0000 7f56fd000640 1 --2- 172.21.15.3:0/1847832902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1871e50 0x5560f18896b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:55.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.363+0000 7f56f7e00640 1 --2- 172.21.15.3:0/1847832902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560f1866c70 0x5560f18696d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:55.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.364+0000 7f56f7400640 1 -- 172.21.15.3:0/1847832902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560f1866c70 msgr2=0x5560f18696d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:55.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.364+0000 7f56f7400640 1 --2- 172.21.15.3:0/1847832902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560f1866c70 0x5560f18696d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.364+0000 7f56f7400640 1 -- 172.21.15.3:0/1847832902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1871e50 msgr2=0x5560f18896b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:55.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.364+0000 7f56f7400640 1 --2- 172.21.15.3:0/1847832902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1871e50 0x5560f18896b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.364+0000 7f56f7400640 1 -- 172.21.15.3:0/1847832902 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f1871430 con 0x5560f1867590 2024-09-19T06:14:55.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.364+0000 7f56fd000640 1 --2- 172.21.15.3:0/1847832902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1871e50 0x5560f18896b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:55.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.364+0000 7f56f7e00640 1 --2- 172.21.15.3:0/1847832902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560f1866c70 0x5560f18696d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:55.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.364+0000 7f56f7400640 1 --2- 172.21.15.3:0/1847832902 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1867590 0x5560f1870580 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f56e4097d50 tx=0x7f56e40d5530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e11cbad4c600fbe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:55.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.364+0000 7f56ecc00640 1 -- 172.21.15.3:0/1847832902 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e409b430 con 0x5560f1867590 2024-09-19T06:14:55.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.364+0000 7f56ecc00640 1 -- 172.21.15.3:0/1847832902 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56e409bff0 con 0x5560f1867590 2024-09-19T06:14:55.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.364+0000 7f56ecc00640 1 -- 172.21.15.3:0/1847832902 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e40860b0 con 0x5560f1867590 2024-09-19T06:14:55.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.365+0000 7f5701a5c740 1 -- 172.21.15.3:0/1847832902 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1867590 msgr2=0x5560f1870580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:55.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.365+0000 7f5701a5c740 1 --2- 172.21.15.3:0/1847832902 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1867590 0x5560f1870580 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f56e4097d50 tx=0x7f56e40d5530 comp rx=0 tx=0).stop 2024-09-19T06:14:55.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.365+0000 7f5701a5c740 1 -- 172.21.15.3:0/1847832902 shutdown_connections 2024-09-19T06:14:55.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.365+0000 7f5701a5c740 1 --2- 172.21.15.3:0/1847832902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1871e50 0x5560f18896b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.365+0000 7f5701a5c740 1 --2- 172.21.15.3:0/1847832902 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1867590 0x5560f1870580 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.365+0000 7f5701a5c740 1 --2- 172.21.15.3:0/1847832902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560f1866c70 0x5560f18696d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.365+0000 7f5701a5c740 1 -- 172.21.15.3:0/1847832902 >> 172.21.15.3:0/1847832902 conn(0x5560f1863200 msgr2=0x5560f186dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:55.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.365+0000 7f5701a5c740 1 -- 172.21.15.3:0/1847832902 shutdown_connections 2024-09-19T06:14:55.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.365+0000 7f5701a5c740 1 -- 172.21.15.3:0/1847832902 wait complete. 2024-09-19T06:14:55.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.365+0000 7f5701a5c740 1 -- start start 2024-09-19T06:14:55.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.366+0000 7f5701a5c740 1 Processor -- start 2024-09-19T06:14:55.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.366+0000 7f5701a5c740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1866c70 0x5560f187a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:55.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.366+0000 7f5701a5c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1867590 0x5560f186ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:55.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.366+0000 7f5701a5c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560f1871e50 0x5560f186bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:55.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.366+0000 7f5701a5c740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f56f81b5230 con 0x5560f1866c70 2024-09-19T06:14:55.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.366+0000 7f5701a5c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f56f81b4b60 con 0x5560f1867590 2024-09-19T06:14:55.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.366+0000 7f5701a5c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f56f81b1da0 con 0x5560f1871e50 2024-09-19T06:14:55.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.366+0000 7f5701a5c740 10 client.0 _ll_register_callbacks cb 0x7f56e40d5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:55.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.366+0000 7f56f7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1866c70 0x5560f187a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:55.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.367+0000 7f56f7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1867590 0x5560f186ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:55.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.367+0000 7f56f7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1867590 0x5560f186ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:42500/0 (socket says 172.21.15.3:42500) 2024-09-19T06:14:55.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.367+0000 7f56f7400640 1 -- 172.21.15.3:0/1074314458 learned_addr learned my addr 172.21.15.3:0/1074314458 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:55.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.367+0000 7f56fd000640 1 --2- 172.21.15.3:0/1074314458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560f1871e50 0x5560f186bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:55.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.367+0000 7f56f7400640 1 -- 172.21.15.3:0/1074314458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560f1871e50 msgr2=0x5560f186bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:55.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.367+0000 7f56f7400640 1 --2- 172.21.15.3:0/1074314458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560f1871e50 0x5560f186bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.367+0000 7f56f7400640 1 -- 172.21.15.3:0/1074314458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1866c70 msgr2=0x5560f187a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:55.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.367+0000 7f56f7400640 1 --2- 172.21.15.3:0/1074314458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1866c70 0x5560f187a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.367+0000 7f56f7400640 1 -- 172.21.15.3:0/1074314458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560f18841a0 con 0x5560f1867590 2024-09-19T06:14:55.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.367+0000 7f56fd000640 1 --2- 172.21.15.3:0/1074314458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560f1871e50 0x5560f186bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:55.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.367+0000 7f56f7400640 1 --2- 172.21.15.3:0/1074314458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1867590 0x5560f186ba00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f56e4009610 tx=0x7f56e40d5380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32108247eb713777 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:55.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.367+0000 7f56e2000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:14:55.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.368+0000 7f56e2000640 1 -- 172.21.15.3:0/1074314458 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e409b250 con 0x5560f1867590 2024-09-19T06:14:55.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.368+0000 7f56e2000640 1 -- 172.21.15.3:0/1074314458 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f56e409af40 con 0x5560f1867590 2024-09-19T06:14:55.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.368+0000 7f5701a5c740 1 -- 172.21.15.3:0/1074314458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56e409bff0 con 0x5560f1867590 2024-09-19T06:14:55.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.368+0000 7f56e2000640 1 -- 172.21.15.3:0/1074314458 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f56e40860b0 con 0x5560f1867590 2024-09-19T06:14:55.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.368+0000 7f5701a5c740 10 client.25874 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:55.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.368+0000 7f5701a5c740 1 -- 172.21.15.3:0/1074314458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5560f18ec450 con 0x5560f1867590 2024-09-19T06:14:55.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.368+0000 7f56e2000640 1 -- 172.21.15.3:0/1074314458 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56e409bff0 con 0x5560f1867590 2024-09-19T06:14:55.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.369+0000 7f56e2000640 1 -- 172.21.15.3:0/1074314458 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f56e4097740 con 0x5560f1867590 2024-09-19T06:14:55.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.369+0000 7f5701a5c740 10 client.25874 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:55.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.369+0000 7f5701a5c740 10 client.25874 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:14:55.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.369+0000 7f5701a5c740 20 client.25874 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:55.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.369+0000 7f5701a5c740 1 --2- 172.21.15.3:0/1074314458 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x5560f18ecb10 0x5560f18eef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:55.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.369+0000 7f5701a5c740 4 client.25874 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:14:55.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.369+0000 7f5701a5c740 1 -- 172.21.15.3:0/1074314458 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5560f17d4e60 con 0x5560f18ecb10 2024-09-19T06:14:55.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.369+0000 7f56f7e00640 1 --2- 172.21.15.3:0/1074314458 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x5560f18ecb10 0x5560f18eef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:55.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.370+0000 7f56f7e00640 1 --2- 172.21.15.3:0/1074314458 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x5560f18ecb10 0x5560f18eef30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4a78637121b3753 server_cookie=e8ad36a6e50d0214 in_seq=0 out_seq=0 2024-09-19T06:14:55.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.370+0000 7f56e2000640 10 client.25874 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:14:55.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.370+0000 7f56e2000640 1 -- 172.21.15.3:0/1074314458 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5560f17d4e60 con 0x5560f18ecb10 2024-09-19T06:14:55.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.370+0000 7f56e2000640 10 client.25874 handle_command_reply: tid=0 2024-09-19T06:14:55.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.370+0000 7f5701a5c740 1 client.25874 shutdown 2024-09-19T06:14:55.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.370+0000 7f5701a5c740 1 -- 172.21.15.3:0/1074314458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1867590 msgr2=0x5560f186ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:55.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.370+0000 7f5701a5c740 1 --2- 172.21.15.3:0/1074314458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1867590 0x5560f186ba00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f56e4009610 tx=0x7f56e40d5380 comp rx=0 tx=0).stop 2024-09-19T06:14:55.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.370+0000 7f5701a5c740 1 -- 172.21.15.3:0/1074314458 shutdown_connections 2024-09-19T06:14:55.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.370+0000 7f5701a5c740 1 --2- 172.21.15.3:0/1074314458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5560f1871e50 0x5560f186bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.370+0000 7f5701a5c740 1 --2- 172.21.15.3:0/1074314458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5560f1867590 0x5560f186ba00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.370+0000 7f5701a5c740 1 --2- 172.21.15.3:0/1074314458 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x5560f18ecb10 0x5560f18eef30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.370+0000 7f5701a5c740 1 --2- 172.21.15.3:0/1074314458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5560f1866c70 0x5560f187a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.370+0000 7f5701a5c740 1 -- 172.21.15.3:0/1074314458 >> 172.21.15.3:0/1074314458 conn(0x5560f1863200 msgr2=0x5560f186d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:55.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.370+0000 7f56e2000640 0 client.25874 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:14:55.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.370+0000 7f5701a5c740 1 -- 172.21.15.3:0/1074314458 shutdown_connections 2024-09-19T06:14:55.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.370+0000 7f5701a5c740 1 -- 172.21.15.3:0/1074314458 wait complete. 2024-09-19T06:14:55.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.370+0000 7f5701a5c740 20 client.25874 trim_cache size 0 max 16384 2024-09-19T06:14:55.377 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:14:55.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.371+0000 7f56ff000640 1 -- 172.21.15.3:0/3086756158 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f56dc0a33b0 msgr2=0x7f56dc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:55.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.371+0000 7f56ff000640 1 --2- 172.21.15.3:0/3086756158 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f56dc0a33b0 0x7f56dc0a5870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x5560f1864060 tx=0x7f56e8005f90 comp rx=0 tx=0).stop 2024-09-19T06:14:55.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.371+0000 7f56ff000640 1 -- 172.21.15.3:0/3086756158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56f8077040 msgr2=0x7f56f81a4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:55.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.371+0000 7f56ff000640 1 --2- 172.21.15.3:0/3086756158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56f8077040 0x7f56f81a4c00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f56e400d950 tx=0x7f56e400de10 comp rx=0 tx=0).stop 2024-09-19T06:14:55.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.371+0000 7f56ff000640 1 -- 172.21.15.3:0/3086756158 shutdown_connections 2024-09-19T06:14:55.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.371+0000 7f56ff000640 1 --2- 172.21.15.3:0/3086756158 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f56dc0a33b0 0x7f56dc0a5870 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.371+0000 7f56ff000640 1 --2- 172.21.15.3:0/3086756158 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f56f8112a30 0x7f56f819e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.371+0000 7f56ff000640 1 --2- 172.21.15.3:0/3086756158 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f56f8077040 0x7f56f81a4c00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.371+0000 7f56ff000640 1 --2- 172.21.15.3:0/3086756158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56f8076720 0x7f56f81a46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:55.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.371+0000 7f56ff000640 1 -- 172.21.15.3:0/3086756158 >> 172.21.15.3:0/3086756158 conn(0x7f56f80ffa90 msgr2=0x7f56f8101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:55.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.371+0000 7f56ff000640 1 -- 172.21.15.3:0/3086756158 shutdown_connections 2024-09-19T06:14:55.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:55.371+0000 7f56ff000640 1 -- 172.21.15.3:0/3086756158 wait complete. 2024-09-19T06:14:56.074 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:55 smithi003 ceph-mon[30893]: pgmap v79: 97 pgs: 97 active+clean; 2.7 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-09-19T06:14:56.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:55 smithi059 ceph-mon[35138]: pgmap v79: 97 pgs: 97 active+clean; 2.7 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-09-19T06:14:56.306 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:14:56.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:55 smithi071 ceph-mon[35662]: pgmap v79: 97 pgs: 97 active+clean; 2.7 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-09-19T06:14:56.684 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:57.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.249+0000 7fcf9a000640 1 -- 172.21.15.3:0/3484490373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf941027a0 msgr2=0x7fcf941067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:57.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.249+0000 7fcf9a000640 1 --2- 172.21.15.3:0/3484490373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf941027a0 0x7fcf941067f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c009900 tx=0x7fcf7c02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.249+0000 7fcf9a000640 1 -- 172.21.15.3:0/3484490373 shutdown_connections 2024-09-19T06:14:57.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.249+0000 7fcf9a000640 1 --2- 172.21.15.3:0/3484490373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf94106f20 0x7fcf9410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.249+0000 7fcf9a000640 1 --2- 172.21.15.3:0/3484490373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf941027a0 0x7fcf941067f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.249+0000 7fcf9a000640 1 --2- 172.21.15.3:0/3484490373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf94101df0 0x7fcf941021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.249+0000 7fcf9a000640 1 -- 172.21.15.3:0/3484490373 >> 172.21.15.3:0/3484490373 conn(0x7fcf940fd8b0 msgr2=0x7fcf940ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:57.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.249+0000 7fcf9a000640 1 -- 172.21.15.3:0/3484490373 shutdown_connections 2024-09-19T06:14:57.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.249+0000 7fcf9a000640 1 -- 172.21.15.3:0/3484490373 wait complete. 2024-09-19T06:14:57.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.250+0000 7fcf9a000640 1 Processor -- start 2024-09-19T06:14:57.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.250+0000 7fcf9a000640 1 -- start start 2024-09-19T06:14:57.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.251+0000 7fcf9a000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf94101df0 0x7fcf941983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.251+0000 7fcf9a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf941027a0 0x7fcf94198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.251+0000 7fcf9a000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf94106f20 0x7fcf9419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.251+0000 7fcf9a000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcf94111f80 con 0x7fcf94101df0 2024-09-19T06:14:57.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.251+0000 7fcf9a000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcf94111e00 con 0x7fcf941027a0 2024-09-19T06:14:57.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.251+0000 7fcf9a000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcf94112100 con 0x7fcf94106f20 2024-09-19T06:14:57.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.251+0000 7fcf93400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf94101df0 0x7fcf941983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.251+0000 7fcf93400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf94101df0 0x7fcf941983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55964/0 (socket says 172.21.15.3:55964) 2024-09-19T06:14:57.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.251+0000 7fcf93400640 1 -- 172.21.15.3:0/1951832089 learned_addr learned my addr 172.21.15.3:0/1951832089 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:57.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.251+0000 7fcf8aa00640 1 --2- 172.21.15.3:0/1951832089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf941027a0 0x7fcf94198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.251+0000 7fcf93e00640 1 --2- 172.21.15.3:0/1951832089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf94106f20 0x7fcf9419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.252+0000 7fcf93400640 1 -- 172.21.15.3:0/1951832089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf94106f20 msgr2=0x7fcf9419cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:57.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.252+0000 7fcf93400640 1 --2- 172.21.15.3:0/1951832089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf94106f20 0x7fcf9419cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.252+0000 7fcf93400640 1 -- 172.21.15.3:0/1951832089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf941027a0 msgr2=0x7fcf94198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:57.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.252+0000 7fcf93400640 1 --2- 172.21.15.3:0/1951832089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf941027a0 0x7fcf94198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.252+0000 7fcf93400640 1 -- 172.21.15.3:0/1951832089 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9419d370 con 0x7fcf94101df0 2024-09-19T06:14:57.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.252+0000 7fcf8aa00640 1 --2- 172.21.15.3:0/1951832089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf941027a0 0x7fcf94198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:57.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.252+0000 7fcf93400640 1 --2- 172.21.15.3:0/1951832089 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf94101df0 0x7fcf941983c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400d950 tx=0x7fcf8400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:57.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.252+0000 7fcf90c00640 1 -- 172.21.15.3:0/1951832089 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf84017070 con 0x7fcf94101df0 2024-09-19T06:14:57.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.252+0000 7fcf90c00640 1 -- 172.21.15.3:0/1951832089 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf84009c30 con 0x7fcf94101df0 2024-09-19T06:14:57.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.252+0000 7fcf90c00640 1 -- 172.21.15.3:0/1951832089 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8400f6b0 con 0x7fcf94101df0 2024-09-19T06:14:57.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.252+0000 7fcf9a000640 1 -- 172.21.15.3:0/1951832089 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf9419d660 con 0x7fcf94101df0 2024-09-19T06:14:57.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.253+0000 7fcf9a000640 1 -- 172.21.15.3:0/1951832089 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf941a4f40 con 0x7fcf94101df0 2024-09-19T06:14:57.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.256+0000 7fcf90c00640 1 -- 172.21.15.3:0/1951832089 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fcf840109d0 con 0x7fcf94101df0 2024-09-19T06:14:57.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.256+0000 7fcf9cc4e740 1 Processor -- start 2024-09-19T06:14:57.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.256+0000 7fcf9cc4e740 1 -- start start 2024-09-19T06:14:57.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.256+0000 7fcf9cc4e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e20080 0x55ed91e20460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.256+0000 7fcf9cc4e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed91e209a0 0x55ed91e2ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.256+0000 7fcf9cc4e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed91e2b260 0x55ed91e2d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.256+0000 7fcf9cc4e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ed91d823e0 con 0x55ed91e20080 2024-09-19T06:14:57.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.256+0000 7fcf9cc4e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ed91d29d80 con 0x55ed91e2b260 2024-09-19T06:14:57.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.256+0000 7fcf9cc4e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ed91d7e3a0 con 0x55ed91e209a0 2024-09-19T06:14:57.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.256+0000 7fcf93e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e20080 0x55ed91e20460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.257+0000 7fcf93400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed91e209a0 0x55ed91e2ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.257+0000 7fcf93e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e20080 0x55ed91e20460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55970/0 (socket says 172.21.15.3:55970) 2024-09-19T06:14:57.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.257+0000 7fcf93e00640 1 -- 172.21.15.3:0/3968880380 learned_addr learned my addr 172.21.15.3:0/3968880380 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:57.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.257+0000 7fcf8aa00640 1 --2- 172.21.15.3:0/3968880380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed91e2b260 0x55ed91e2d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.257+0000 7fcf93e00640 1 -- 172.21.15.3:0/3968880380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed91e209a0 msgr2=0x55ed91e2ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:57.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.257+0000 7fcf93e00640 1 --2- 172.21.15.3:0/3968880380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed91e209a0 0x55ed91e2ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.257+0000 7fcf93e00640 1 -- 172.21.15.3:0/3968880380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed91e2b260 msgr2=0x55ed91e2d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:57.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.257+0000 7fcf93e00640 1 --2- 172.21.15.3:0/3968880380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed91e2b260 0x55ed91e2d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.257+0000 7fcf93e00640 1 -- 172.21.15.3:0/3968880380 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed91d48ae0 con 0x55ed91e20080 2024-09-19T06:14:57.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.257+0000 7fcf93400640 1 --2- 172.21.15.3:0/3968880380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed91e209a0 0x55ed91e2ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:14:57.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.257+0000 7fcf90c00640 1 --2- 172.21.15.3:0/1951832089 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcf780a33b0 0x7fcf780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.257+0000 7fcf93e00640 1 --2- 172.21.15.3:0/3968880380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e20080 0x55ed91e20460 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c009f70 tx=0x7fcf8c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab52a288cf19850 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:57.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.258+0000 7fcf90c00640 1 -- 172.21.15.3:0/1951832089 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fcf840cfa10 con 0x7fcf94101df0 2024-09-19T06:14:57.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.258+0000 7fcf93400640 1 --2- 172.21.15.3:0/1951832089 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcf780a33b0 0x7fcf780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.258+0000 7fcf83e00640 1 -- 172.21.15.3:0/3968880380 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c016070 con 0x55ed91e20080 2024-09-19T06:14:57.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.258+0000 7fcf83e00640 1 -- 172.21.15.3:0/3968880380 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf8c004d20 con 0x55ed91e20080 2024-09-19T06:14:57.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.258+0000 7fcf83e00640 1 -- 172.21.15.3:0/3968880380 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c012950 con 0x55ed91e20080 2024-09-19T06:14:57.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.259+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/3968880380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e20080 msgr2=0x55ed91e20460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:57.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.259+0000 7fcf9cc4e740 1 --2- 172.21.15.3:0/3968880380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e20080 0x55ed91e20460 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c009f70 tx=0x7fcf8c010800 comp rx=0 tx=0).stop 2024-09-19T06:14:57.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.259+0000 7fcf93400640 1 --2- 172.21.15.3:0/1951832089 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcf780a33b0 0x7fcf780a5870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55ed91e1d470 tx=0x7fcf84084f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:57.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.259+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/3968880380 shutdown_connections 2024-09-19T06:14:57.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.259+0000 7fcf9cc4e740 1 --2- 172.21.15.3:0/3968880380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed91e2b260 0x55ed91e2d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.259+0000 7fcf9cc4e740 1 --2- 172.21.15.3:0/3968880380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed91e209a0 0x55ed91e2ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.259+0000 7fcf9cc4e740 1 --2- 172.21.15.3:0/3968880380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e20080 0x55ed91e20460 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.259+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/3968880380 >> 172.21.15.3:0/3968880380 conn(0x55ed91e1c610 msgr2=0x55ed91e1c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:57.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.259+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/3968880380 shutdown_connections 2024-09-19T06:14:57.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.259+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/3968880380 wait complete. 2024-09-19T06:14:57.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.259+0000 7fcf9cc4e740 1 -- start start 2024-09-19T06:14:57.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.259+0000 7fcf9cc4e740 1 Processor -- start 2024-09-19T06:14:57.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.260+0000 7fcf9cc4e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed91e20080 0x55ed91e28190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.260+0000 7fcf9cc4e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e209a0 0x55ed91e286d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.260+0000 7fcf9cc4e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed91e2b260 0x55ed91e28c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.260+0000 7fcf9cc4e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ed91e2de30 con 0x55ed91e209a0 2024-09-19T06:14:57.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.260+0000 7fcf9cc4e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ed91d3d0f0 con 0x55ed91e2b260 2024-09-19T06:14:57.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.260+0000 7fcf9cc4e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ed91e2dfb0 con 0x55ed91e20080 2024-09-19T06:14:57.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.260+0000 7fcf9cc4e740 10 client.0 _ll_register_callbacks cb 0x55ed91d24bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.260+0000 7fcf8aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e209a0 0x55ed91e286d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.260+0000 7fcf93e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed91e20080 0x55ed91e28190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.260+0000 7fcf93e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed91e20080 0x55ed91e28190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:43412/0 (socket says 172.21.15.3:43412) 2024-09-19T06:14:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.260+0000 7fcf8aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e209a0 0x55ed91e286d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55984/0 (socket says 172.21.15.3:55984) 2024-09-19T06:14:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.260+0000 7fcf93e00640 1 -- 172.21.15.3:0/158180814 learned_addr learned my addr 172.21.15.3:0/158180814 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.260+0000 7fcf93e00640 1 --2- 172.21.15.3:0/158180814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed91e2b260 0x55ed91e28c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.261+0000 7fcf8aa00640 1 -- 172.21.15.3:0/158180814 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed91e20080 msgr2=0x55ed91e28190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.261+0000 7fcf8aa00640 1 --2- 172.21.15.3:0/158180814 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed91e20080 0x55ed91e28190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.261+0000 7fcf8aa00640 1 -- 172.21.15.3:0/158180814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed91e2b260 msgr2=0x55ed91e28c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.261+0000 7fcf8aa00640 1 --2- 172.21.15.3:0/158180814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed91e2b260 0x55ed91e28c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.261+0000 7fcf8aa00640 1 -- 172.21.15.3:0/158180814 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed91af33c0 con 0x55ed91e209a0 2024-09-19T06:14:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.261+0000 7fcf8aa00640 1 --2- 172.21.15.3:0/158180814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e209a0 0x55ed91e286d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c006010 tx=0x7fcf7c0318d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00bb4da60f1df06 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.261+0000 7fcf80c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:14:57.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.261+0000 7fcf80c00640 1 -- 172.21.15.3:0/158180814 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c035040 con 0x55ed91e209a0 2024-09-19T06:14:57.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.261+0000 7fcf80c00640 1 -- 172.21.15.3:0/158180814 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fcf7c004460 con 0x55ed91e209a0 2024-09-19T06:14:57.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.261+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/158180814 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf8c004d20 con 0x55ed91e209a0 2024-09-19T06:14:57.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.262+0000 7fcf80c00640 1 -- 172.21.15.3:0/158180814 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcf7c005030 con 0x55ed91e209a0 2024-09-19T06:14:57.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.262+0000 7fcf9cc4e740 10 client.15837 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:57.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.262+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/158180814 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ed91e39ec0 con 0x55ed91e209a0 2024-09-19T06:14:57.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.262+0000 7fcf80c00640 1 -- 172.21.15.3:0/158180814 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf8c004d20 con 0x55ed91e209a0 2024-09-19T06:14:57.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.262+0000 7fcf80c00640 1 -- 172.21.15.3:0/158180814 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fcf7c0035f0 con 0x55ed91e209a0 2024-09-19T06:14:57.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.262+0000 7fcf9cc4e740 10 client.15837 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:57.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.262+0000 7fcf9cc4e740 10 client.15837 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:14:57.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.262+0000 7fcf9cc4e740 20 client.15837 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:57.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.262+0000 7fcf9cc4e740 1 --2- 172.21.15.3:0/158180814 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55ed91e3b380 0x55ed91e3d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.263+0000 7fcf9cc4e740 4 client.15837 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:14:57.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.263+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/158180814 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed91d8f950 con 0x55ed91e3b380 2024-09-19T06:14:57.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.263+0000 7fcf93e00640 1 --2- 172.21.15.3:0/158180814 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55ed91e3b380 0x55ed91e3d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.264+0000 7fcf93e00640 1 --2- 172.21.15.3:0/158180814 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55ed91e3b380 0x55ed91e3d7a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b3c3321cd91418f7 server_cookie=64f9a3b06eee5257 in_seq=0 out_seq=0 2024-09-19T06:14:57.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.264+0000 7fcf80c00640 10 client.15837 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:14:57.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.264+0000 7fcf80c00640 1 -- 172.21.15.3:0/158180814 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ed91d8f950 con 0x55ed91e3b380 2024-09-19T06:14:57.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.264+0000 7fcf80c00640 10 client.15837 handle_command_reply: tid=0 2024-09-19T06:14:57.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.264+0000 7fcf9cc4e740 1 client.15837 shutdown 2024-09-19T06:14:57.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.265+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/158180814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e209a0 msgr2=0x55ed91e286d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:57.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.265+0000 7fcf9cc4e740 1 --2- 172.21.15.3:0/158180814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e209a0 0x55ed91e286d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c006010 tx=0x7fcf7c0318d0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.265+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/158180814 shutdown_connections 2024-09-19T06:14:57.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.265+0000 7fcf9cc4e740 1 --2- 172.21.15.3:0/158180814 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55ed91e3b380 0x55ed91e3d7a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.265+0000 7fcf9cc4e740 1 --2- 172.21.15.3:0/158180814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed91e2b260 0x55ed91e28c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.265+0000 7fcf9cc4e740 1 --2- 172.21.15.3:0/158180814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e209a0 0x55ed91e286d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.265+0000 7fcf9cc4e740 1 --2- 172.21.15.3:0/158180814 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed91e20080 0x55ed91e28190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.265+0000 7fcf80c00640 0 client.15837 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:14:57.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.265+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/158180814 >> 172.21.15.3:0/158180814 conn(0x55ed91e1c610 msgr2=0x55ed91e17380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:57.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.265+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/158180814 shutdown_connections 2024-09-19T06:14:57.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.265+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/158180814 wait complete. 2024-09-19T06:14:57.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.265+0000 7fcf9cc4e740 20 client.15837 trim_cache size 0 max 16384 2024-09-19T06:14:57.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.279+0000 7fcf9cc4e740 1 Processor -- start 2024-09-19T06:14:57.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.279+0000 7fcf9cc4e740 1 -- start start 2024-09-19T06:14:57.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.280+0000 7fcf9cc4e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed91e20080 0x55ed91e26a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.280+0000 7fcf9cc4e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e209a0 0x55ed91e28a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.280+0000 7fcf9cc4e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed91e2b260 0x55ed91e43070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.280+0000 7fcf9cc4e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcf941ab750 con 0x55ed91e209a0 2024-09-19T06:14:57.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.280+0000 7fcf9cc4e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcf941ad290 con 0x55ed91e2b260 2024-09-19T06:14:57.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.280+0000 7fcf9cc4e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcf941abe20 con 0x55ed91e20080 2024-09-19T06:14:57.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.280+0000 7fcf8aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e209a0 0x55ed91e28a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.280+0000 7fcf8aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e209a0 0x55ed91e28a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55998/0 (socket says 172.21.15.3:55998) 2024-09-19T06:14:57.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.280+0000 7fcf8aa00640 1 -- 172.21.15.3:0/894066124 learned_addr learned my addr 172.21.15.3:0/894066124 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:57.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.280+0000 7fcf93e00640 1 --2- 172.21.15.3:0/894066124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed91e2b260 0x55ed91e43070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.280+0000 7fcf93e00640 1 --2- 172.21.15.3:0/894066124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed91e20080 0x55ed91e26a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.280+0000 7fcf8aa00640 1 -- 172.21.15.3:0/894066124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed91e20080 msgr2=0x55ed91e26a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:57.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.280+0000 7fcf8aa00640 1 --2- 172.21.15.3:0/894066124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed91e20080 0x55ed91e26a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.280+0000 7fcf8aa00640 1 -- 172.21.15.3:0/894066124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed91e2b260 msgr2=0x55ed91e43070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:57.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.280+0000 7fcf8aa00640 1 --2- 172.21.15.3:0/894066124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed91e2b260 0x55ed91e43070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.280+0000 7fcf8aa00640 1 -- 172.21.15.3:0/894066124 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed91e1d6c0 con 0x55ed91e209a0 2024-09-19T06:14:57.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.280+0000 7fcf93e00640 1 --2- 172.21.15.3:0/894066124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed91e20080 0x55ed91e26a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:57.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.281+0000 7fcf8aa00640 1 --2- 172.21.15.3:0/894066124 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e209a0 0x55ed91e28a60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c005930 tx=0x7fcf7c02a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42376097fa70fe75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:57.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.281+0000 7fcf83400640 1 -- 172.21.15.3:0/894066124 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c051070 con 0x55ed91e209a0 2024-09-19T06:14:57.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.281+0000 7fcf83400640 1 -- 172.21.15.3:0/894066124 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf7c040070 con 0x55ed91e209a0 2024-09-19T06:14:57.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.281+0000 7fcf83400640 1 -- 172.21.15.3:0/894066124 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c035040 con 0x55ed91e209a0 2024-09-19T06:14:57.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.282+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/894066124 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e209a0 msgr2=0x55ed91e28a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:57.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.282+0000 7fcf9cc4e740 1 --2- 172.21.15.3:0/894066124 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e209a0 0x55ed91e28a60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c005930 tx=0x7fcf7c02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.282+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/894066124 shutdown_connections 2024-09-19T06:14:57.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.282+0000 7fcf9cc4e740 1 --2- 172.21.15.3:0/894066124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed91e2b260 0x55ed91e43070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.282+0000 7fcf9cc4e740 1 --2- 172.21.15.3:0/894066124 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e209a0 0x55ed91e28a60 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.282+0000 7fcf9cc4e740 1 --2- 172.21.15.3:0/894066124 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed91e20080 0x55ed91e26a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.282+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/894066124 >> 172.21.15.3:0/894066124 conn(0x55ed91e1c610 msgr2=0x55ed91e2a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:57.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.282+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/894066124 shutdown_connections 2024-09-19T06:14:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.282+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/894066124 wait complete. 2024-09-19T06:14:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.282+0000 7fcf9cc4e740 1 -- start start 2024-09-19T06:14:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.282+0000 7fcf9cc4e740 1 Processor -- start 2024-09-19T06:14:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.283+0000 7fcf9cc4e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed91e20080 0x55ed91e2eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.283+0000 7fcf9cc4e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed91e209a0 0x55ed91e2f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.283+0000 7fcf9cc4e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e2b260 0x55ed91e2f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.283+0000 7fcf9cc4e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcf941acbc0 con 0x55ed91e2b260 2024-09-19T06:14:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.283+0000 7fcf9cc4e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcf941ac4f0 con 0x55ed91e20080 2024-09-19T06:14:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.283+0000 7fcf9cc4e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcf941a9730 con 0x55ed91e209a0 2024-09-19T06:14:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.283+0000 7fcf9cc4e740 10 client.0 _ll_register_callbacks cb 0x7fcf7c005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.283+0000 7fcf93e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e2b260 0x55ed91e2f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.283+0000 7fcf93e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e2b260 0x55ed91e2f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56004/0 (socket says 172.21.15.3:56004) 2024-09-19T06:14:57.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.283+0000 7fcf93e00640 1 -- 172.21.15.3:0/1907473646 learned_addr learned my addr 172.21.15.3:0/1907473646 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:57.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.283+0000 7fcf8aa00640 1 --2- 172.21.15.3:0/1907473646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed91e209a0 0x55ed91e2f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.283+0000 7fcf93e00640 1 --2- 172.21.15.3:0/1907473646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed91e20080 0x55ed91e2eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.284+0000 7fcf8aa00640 1 -- 172.21.15.3:0/1907473646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed91e20080 msgr2=0x55ed91e2eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:57.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.284+0000 7fcf8aa00640 1 --2- 172.21.15.3:0/1907473646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed91e20080 0x55ed91e2eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.284+0000 7fcf8aa00640 1 -- 172.21.15.3:0/1907473646 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e2b260 msgr2=0x55ed91e2f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:57.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.284+0000 7fcf8aa00640 1 --2- 172.21.15.3:0/1907473646 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e2b260 0x55ed91e2f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.284+0000 7fcf8aa00640 1 -- 172.21.15.3:0/1907473646 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed91e1d2a0 con 0x55ed91e209a0 2024-09-19T06:14:57.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.284+0000 7fcf93e00640 1 --2- 172.21.15.3:0/1907473646 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e2b260 0x55ed91e2f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:57.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.284+0000 7fcf8aa00640 1 --2- 172.21.15.3:0/1907473646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed91e209a0 0x55ed91e2f400 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55ed91e2b060 tx=0x7fcf7c0315b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=780cf3ee549351d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:57.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.284+0000 7fcf80c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:14:57.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.284+0000 7fcf80c00640 1 -- 172.21.15.3:0/1907473646 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c035070 con 0x55ed91e209a0 2024-09-19T06:14:57.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.284+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/1907473646 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf7c040070 con 0x55ed91e209a0 2024-09-19T06:14:57.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.284+0000 7fcf80c00640 1 -- 172.21.15.3:0/1907473646 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fcf7c0051d0 con 0x55ed91e209a0 2024-09-19T06:14:57.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.285+0000 7fcf80c00640 1 -- 172.21.15.3:0/1907473646 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcf7c051040 con 0x55ed91e209a0 2024-09-19T06:14:57.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.285+0000 7fcf9cc4e740 10 client.25894 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:57.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.285+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/1907473646 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ed91e1c440 con 0x55ed91e209a0 2024-09-19T06:14:57.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.285+0000 7fcf80c00640 1 -- 172.21.15.3:0/1907473646 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf7c040070 con 0x55ed91e209a0 2024-09-19T06:14:57.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.285+0000 7fcf80c00640 1 -- 172.21.15.3:0/1907473646 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fcf7c055440 con 0x55ed91e209a0 2024-09-19T06:14:57.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.285+0000 7fcf9cc4e740 10 client.25894 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:57.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.285+0000 7fcf9cc4e740 10 client.25894 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:14:57.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.285+0000 7fcf9cc4e740 20 client.25894 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:57.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.285+0000 7fcf9cc4e740 1 --2- 172.21.15.3:0/1907473646 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55ed91ea6520 0x55ed91ea8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:57.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.285+0000 7fcf9cc4e740 4 client.25894 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:14:57.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.285+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/1907473646 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ed91d89e60 con 0x55ed91ea6520 2024-09-19T06:14:57.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.286+0000 7fcf93e00640 1 --2- 172.21.15.3:0/1907473646 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55ed91ea6520 0x55ed91ea8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:57.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.286+0000 7fcf93e00640 1 --2- 172.21.15.3:0/1907473646 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55ed91ea6520 0x55ed91ea8940 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=87b9da3ed6696854 server_cookie=c2d926be719bc546 in_seq=0 out_seq=0 2024-09-19T06:14:57.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.286+0000 7fcf80c00640 10 client.25894 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:14:57.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.286+0000 7fcf80c00640 1 -- 172.21.15.3:0/1907473646 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ed91d89e60 con 0x55ed91ea6520 2024-09-19T06:14:57.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.286+0000 7fcf80c00640 10 client.25894 handle_command_reply: tid=0 2024-09-19T06:14:57.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.286+0000 7fcf9cc4e740 1 client.25894 shutdown 2024-09-19T06:14:57.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.286+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/1907473646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed91e209a0 msgr2=0x55ed91e2f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:57.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.286+0000 7fcf9cc4e740 1 --2- 172.21.15.3:0/1907473646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed91e209a0 0x55ed91e2f400 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55ed91e2b060 tx=0x7fcf7c0315b0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.287+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/1907473646 shutdown_connections 2024-09-19T06:14:57.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.287+0000 7fcf9cc4e740 1 --2- 172.21.15.3:0/1907473646 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55ed91ea6520 0x55ed91ea8940 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.287+0000 7fcf9cc4e740 1 --2- 172.21.15.3:0/1907473646 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed91e2b260 0x55ed91e2f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.287+0000 7fcf9cc4e740 1 --2- 172.21.15.3:0/1907473646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed91e209a0 0x55ed91e2f400 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.287+0000 7fcf9cc4e740 1 --2- 172.21.15.3:0/1907473646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed91e20080 0x55ed91e2eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.287+0000 7fcf80c00640 0 client.25894 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:14:57.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.287+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/1907473646 >> 172.21.15.3:0/1907473646 conn(0x55ed91e1c610 msgr2=0x55ed91e21ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:57.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.287+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/1907473646 shutdown_connections 2024-09-19T06:14:57.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.287+0000 7fcf9cc4e740 1 -- 172.21.15.3:0/1907473646 wait complete. 2024-09-19T06:14:57.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.287+0000 7fcf9cc4e740 20 client.25894 trim_cache size 0 max 16384 2024-09-19T06:14:57.294 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:14:57.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.288+0000 7fcf9a000640 1 -- 172.21.15.3:0/1951832089 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcf780a33b0 msgr2=0x7fcf780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:57.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.288+0000 7fcf9a000640 1 --2- 172.21.15.3:0/1951832089 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcf780a33b0 0x7fcf780a5870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55ed91e1d470 tx=0x7fcf84084f90 comp rx=0 tx=0).stop 2024-09-19T06:14:57.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.288+0000 7fcf9a000640 1 -- 172.21.15.3:0/1951832089 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf94101df0 msgr2=0x7fcf941983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:57.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.288+0000 7fcf9a000640 1 --2- 172.21.15.3:0/1951832089 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf94101df0 0x7fcf941983c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400d950 tx=0x7fcf8400de10 comp rx=0 tx=0).stop 2024-09-19T06:14:57.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.288+0000 7fcf9a000640 1 -- 172.21.15.3:0/1951832089 shutdown_connections 2024-09-19T06:14:57.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.288+0000 7fcf9a000640 1 --2- 172.21.15.3:0/1951832089 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcf780a33b0 0x7fcf780a5870 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.288+0000 7fcf9a000640 1 --2- 172.21.15.3:0/1951832089 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcf94106f20 0x7fcf9419cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.288+0000 7fcf9a000640 1 --2- 172.21.15.3:0/1951832089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf941027a0 0x7fcf94198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.288+0000 7fcf9a000640 1 --2- 172.21.15.3:0/1951832089 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf94101df0 0x7fcf941983c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:57.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.288+0000 7fcf9a000640 1 -- 172.21.15.3:0/1951832089 >> 172.21.15.3:0/1951832089 conn(0x7fcf940fd8b0 msgr2=0x7fcf940feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:57.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.288+0000 7fcf9a000640 1 -- 172.21.15.3:0/1951832089 shutdown_connections 2024-09-19T06:14:57.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:57.288+0000 7fcf9a000640 1 -- 172.21.15.3:0/1951832089 wait complete. 2024-09-19T06:14:58.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:57 smithi003 ceph-mon[30893]: pgmap v80: 97 pgs: 97 active+clean; 2.7 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-09-19T06:14:58.189 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:14:58.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:57 smithi059 ceph-mon[35138]: pgmap v80: 97 pgs: 97 active+clean; 2.7 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-09-19T06:14:58.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:57 smithi071 ceph-mon[35662]: pgmap v80: 97 pgs: 97 active+clean; 2.7 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 15 op/s 2024-09-19T06:14:58.571 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:14:59.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.126+0000 7f7b69a00640 1 -- 172.21.15.3:0/3623745328 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b64109120 msgr2=0x7f7b64110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.127+0000 7f7b69a00640 1 --2- 172.21.15.3:0/3623745328 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b64109120 0x7f7b64110ca0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c009ca0 tx=0x7f7b5c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.127+0000 7f7b69a00640 1 -- 172.21.15.3:0/3623745328 shutdown_connections 2024-09-19T06:14:59.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.127+0000 7f7b69a00640 1 --2- 172.21.15.3:0/3623745328 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b64109120 0x7f7b64110ca0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.127+0000 7f7b69a00640 1 --2- 172.21.15.3:0/3623745328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b641049a0 0x7f7b641089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.127+0000 7f7b69a00640 1 --2- 172.21.15.3:0/3623745328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b64103ff0 0x7f7b641043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.127+0000 7f7b69a00640 1 -- 172.21.15.3:0/3623745328 >> 172.21.15.3:0/3623745328 conn(0x7f7b640ffa90 msgr2=0x7f7b64101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:59.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.127+0000 7f7b69a00640 1 -- 172.21.15.3:0/3623745328 shutdown_connections 2024-09-19T06:14:59.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.127+0000 7f7b69a00640 1 -- 172.21.15.3:0/3623745328 wait complete. 2024-09-19T06:14:59.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.128+0000 7f7b69a00640 1 Processor -- start 2024-09-19T06:14:59.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.128+0000 7f7b69a00640 1 -- start start 2024-09-19T06:14:59.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.128+0000 7f7b69a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b64103ff0 0x7f7b64076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.128+0000 7f7b69a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b641049a0 0x7f7b64076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.128+0000 7f7b69a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b64109120 0x7f7b64077180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.128+0000 7f7b69a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7b641141a0 con 0x7f7b641049a0 2024-09-19T06:14:59.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.128+0000 7f7b69a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7b64114020 con 0x7f7b64109120 2024-09-19T06:14:59.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.128+0000 7f7b69a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7b64114320 con 0x7f7b64103ff0 2024-09-19T06:14:59.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.128+0000 7f7b5be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b641049a0 0x7f7b64076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.128+0000 7f7b62a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b64103ff0 0x7f7b64076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.128+0000 7f7b5be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b641049a0 0x7f7b64076c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56020/0 (socket says 172.21.15.3:56020) 2024-09-19T06:14:59.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.129+0000 7f7b5be00640 1 -- 172.21.15.3:0/56910922 learned_addr learned my addr 172.21.15.3:0/56910922 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:59.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.128+0000 7f7b62a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b64103ff0 0x7f7b64076700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:43452/0 (socket says 172.21.15.3:43452) 2024-09-19T06:14:59.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.129+0000 7f7b63400640 1 --2- 172.21.15.3:0/56910922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b64109120 0x7f7b64077180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.129+0000 7f7b62a00640 1 -- 172.21.15.3:0/56910922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b64109120 msgr2=0x7f7b64077180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.129+0000 7f7b62a00640 1 --2- 172.21.15.3:0/56910922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b64109120 0x7f7b64077180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.129+0000 7f7b62a00640 1 -- 172.21.15.3:0/56910922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b641049a0 msgr2=0x7f7b64076c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.129+0000 7f7b62a00640 1 --2- 172.21.15.3:0/56910922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b641049a0 0x7f7b64076c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.129+0000 7f7b62a00640 1 -- 172.21.15.3:0/56910922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b641aac60 con 0x7f7b64103ff0 2024-09-19T06:14:59.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.129+0000 7f7b62a00640 1 --2- 172.21.15.3:0/56910922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b64103ff0 0x7f7b64076700 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400ea20 tx=0x7f7b5400eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:59.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.130+0000 7f7b5b400640 1 -- 172.21.15.3:0/56910922 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5400ccc0 con 0x7f7b64103ff0 2024-09-19T06:14:59.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.130+0000 7f7b5b400640 1 -- 172.21.15.3:0/56910922 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b5400ce60 con 0x7f7b64103ff0 2024-09-19T06:14:59.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.130+0000 7f7b69a00640 1 -- 172.21.15.3:0/56910922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b641aaf50 con 0x7f7b64103ff0 2024-09-19T06:14:59.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.130+0000 7f7b5b400640 1 -- 172.21.15.3:0/56910922 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b540049e0 con 0x7f7b64103ff0 2024-09-19T06:14:59.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.130+0000 7f7b69a00640 1 -- 172.21.15.3:0/56910922 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b641ab3b0 con 0x7f7b64103ff0 2024-09-19T06:14:59.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.133+0000 7f7b6c5d3740 1 Processor -- start 2024-09-19T06:14:59.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.133+0000 7f7b5b400640 1 -- 172.21.15.3:0/56910922 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f7b54004ba0 con 0x7f7b64103ff0 2024-09-19T06:14:59.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.133+0000 7f7b6c5d3740 1 -- start start 2024-09-19T06:14:59.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.133+0000 7f7b6c5d3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4365c70 0x55cbb4366050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.133+0000 7f7b6c5d3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb4366590 0x55cbb4370910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.133+0000 7f7b6c5d3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb4370e50 0x55cbb4373240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.133+0000 7f7b6c5d3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55cbb42cc3e0 con 0x55cbb4365c70 2024-09-19T06:14:59.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.133+0000 7f7b6c5d3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55cbb4273d80 con 0x55cbb4366590 2024-09-19T06:14:59.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.133+0000 7f7b6c5d3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cbb42c83a0 con 0x55cbb4370e50 2024-09-19T06:14:59.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.133+0000 7f7b62a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb4366590 0x55cbb4370910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.134+0000 7f7b63400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4365c70 0x55cbb4366050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.134+0000 7f7b62a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb4366590 0x55cbb4370910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:42582/0 (socket says 172.21.15.3:42582) 2024-09-19T06:14:59.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.134+0000 7f7b62a00640 1 -- 172.21.15.3:0/661629226 learned_addr learned my addr 172.21.15.3:0/661629226 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:59.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.134+0000 7f7b63400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4365c70 0x55cbb4366050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56026/0 (socket says 172.21.15.3:56026) 2024-09-19T06:14:59.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.134+0000 7f7b5be00640 1 --2- 172.21.15.3:0/661629226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb4370e50 0x55cbb4373240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.134+0000 7f7b63400640 1 -- 172.21.15.3:0/661629226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb4370e50 msgr2=0x55cbb4373240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:59.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.134+0000 7f7b63400640 1 --2- 172.21.15.3:0/661629226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb4370e50 0x55cbb4373240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.134+0000 7f7b63400640 1 -- 172.21.15.3:0/661629226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb4366590 msgr2=0x55cbb4370910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:59.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.134+0000 7f7b63400640 1 --2- 172.21.15.3:0/661629226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb4366590 0x55cbb4370910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.134+0000 7f7b63400640 1 -- 172.21.15.3:0/661629226 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbb4292ae0 con 0x55cbb4365c70 2024-09-19T06:14:59.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.134+0000 7f7b5b400640 1 --2- 172.21.15.3:0/56910922 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7b480a33b0 0x7f7b480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.134+0000 7f7b63400640 1 --2- 172.21.15.3:0/661629226 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4365c70 0x55cbb4366050 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c005e30 tx=0x7f7b5c0093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e06fb1b40861617 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:59.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.135+0000 7f7b5b400640 1 -- 172.21.15.3:0/56910922 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f7b540cfc10 con 0x7f7b64103ff0 2024-09-19T06:14:59.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.135+0000 7f7b62a00640 1 --2- 172.21.15.3:0/56910922 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7b480a33b0 0x7f7b480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.135+0000 7f7b53e00640 1 -- 172.21.15.3:0/661629226 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c031db0 con 0x55cbb4365c70 2024-09-19T06:14:59.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.135+0000 7f7b53e00640 1 -- 172.21.15.3:0/661629226 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b5c036030 con 0x55cbb4365c70 2024-09-19T06:14:59.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.135+0000 7f7b53e00640 1 -- 172.21.15.3:0/661629226 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c004240 con 0x55cbb4365c70 2024-09-19T06:14:59.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.136+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/661629226 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4365c70 msgr2=0x55cbb4366050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.136+0000 7f7b6c5d3740 1 --2- 172.21.15.3:0/661629226 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4365c70 0x55cbb4366050 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c005e30 tx=0x7f7b5c0093e0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.136+0000 7f7b62a00640 1 --2- 172.21.15.3:0/56910922 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7b480a33b0 0x7f7b480a5870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7b540988c0 tx=0x7f7b540d3750 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:59.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.136+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/661629226 shutdown_connections 2024-09-19T06:14:59.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.136+0000 7f7b6c5d3740 1 --2- 172.21.15.3:0/661629226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb4370e50 0x55cbb4373240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.136+0000 7f7b6c5d3740 1 --2- 172.21.15.3:0/661629226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb4366590 0x55cbb4370910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.136+0000 7f7b6c5d3740 1 --2- 172.21.15.3:0/661629226 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4365c70 0x55cbb4366050 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.136+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/661629226 >> 172.21.15.3:0/661629226 conn(0x55cbb4362200 msgr2=0x55cbb43625e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:59.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.136+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/661629226 shutdown_connections 2024-09-19T06:14:59.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.136+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/661629226 wait complete. 2024-09-19T06:14:59.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.137+0000 7f7b6c5d3740 1 -- start start 2024-09-19T06:14:59.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.137+0000 7f7b6c5d3740 1 Processor -- start 2024-09-19T06:14:59.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.137+0000 7f7b6c5d3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb4365c70 0x55cbb436dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.137+0000 7f7b6c5d3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4366590 0x55cbb436e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.137+0000 7f7b6c5d3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb4370e50 0x55cbb436e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.137+0000 7f7b6c5d3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55cbb43738a0 con 0x55cbb4366590 2024-09-19T06:14:59.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.137+0000 7f7b6c5d3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55cbb42870f0 con 0x55cbb4370e50 2024-09-19T06:14:59.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.137+0000 7f7b6c5d3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cbb4373a20 con 0x55cbb4365c70 2024-09-19T06:14:59.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.137+0000 7f7b6c5d3740 10 client.0 _ll_register_callbacks cb 0x55cbb426ebd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:59.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.138+0000 7f7b5be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4366590 0x55cbb436e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.138+0000 7f7b63400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb4370e50 0x55cbb436e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.138+0000 7f7b63400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb4370e50 0x55cbb436e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:42588/0 (socket says 172.21.15.3:42588) 2024-09-19T06:14:59.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.138+0000 7f7b63400640 1 -- 172.21.15.3:0/2431524070 learned_addr learned my addr 172.21.15.3:0/2431524070 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:59.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.138+0000 7f7b63400640 1 --2- 172.21.15.3:0/2431524070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb4365c70 0x55cbb436dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.138+0000 7f7b5be00640 1 -- 172.21.15.3:0/2431524070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb4365c70 msgr2=0x55cbb436dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:59.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.138+0000 7f7b5be00640 1 --2- 172.21.15.3:0/2431524070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb4365c70 0x55cbb436dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.138+0000 7f7b5be00640 1 -- 172.21.15.3:0/2431524070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb4370e50 msgr2=0x55cbb436e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:59.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.138+0000 7f7b5be00640 1 --2- 172.21.15.3:0/2431524070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb4370e50 0x55cbb436e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.138+0000 7f7b5be00640 1 -- 172.21.15.3:0/2431524070 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbb403d3c0 con 0x55cbb4366590 2024-09-19T06:14:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.138+0000 7f7b63400640 1 --2- 172.21.15.3:0/2431524070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb4365c70 0x55cbb436dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:14:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.139+0000 7f7b5be00640 1 --2- 172.21.15.3:0/2431524070 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4366590 0x55cbb436e250 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7b64077f50 tx=0x7f7b4c012bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a64e0ae4058f83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.139+0000 7f7b50c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:14:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.139+0000 7f7b50c00640 1 -- 172.21.15.3:0/2431524070 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c00f920 con 0x55cbb4366590 2024-09-19T06:14:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.139+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/2431524070 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b5c036030 con 0x55cbb4366590 2024-09-19T06:14:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.139+0000 7f7b50c00640 1 -- 172.21.15.3:0/2431524070 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f7b4c00fac0 con 0x55cbb4366590 2024-09-19T06:14:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.139+0000 7f7b50c00640 1 -- 172.21.15.3:0/2431524070 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7b4c00fcc0 con 0x55cbb4366590 2024-09-19T06:14:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.139+0000 7f7b6c5d3740 10 client.15855 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.139+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/2431524070 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cbb437f960 con 0x55cbb4366590 2024-09-19T06:14:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.140+0000 7f7b50c00640 1 -- 172.21.15.3:0/2431524070 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b5c036030 con 0x55cbb4366590 2024-09-19T06:14:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.140+0000 7f7b50c00640 1 -- 172.21.15.3:0/2431524070 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f7b4c0104a0 con 0x55cbb4366590 2024-09-19T06:14:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.140+0000 7f7b6c5d3740 10 client.15855 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.140+0000 7f7b6c5d3740 10 client.15855 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:14:59.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.140+0000 7f7b6c5d3740 20 client.15855 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:59.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.140+0000 7f7b6c5d3740 1 --2- 172.21.15.3:0/2431524070 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55cbb4380d70 0x55cbb4383190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.140+0000 7f7b6c5d3740 4 client.15855 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:14:59.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.140+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/2431524070 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cbb42d9950 con 0x55cbb4380d70 2024-09-19T06:14:59.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.140+0000 7f7b63400640 1 --2- 172.21.15.3:0/2431524070 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55cbb4380d70 0x55cbb4383190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.141+0000 7f7b63400640 1 --2- 172.21.15.3:0/2431524070 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55cbb4380d70 0x55cbb4383190 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=90a09390f9f03acf server_cookie=1da62bb89a68ae8b in_seq=0 out_seq=0 2024-09-19T06:14:59.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.141+0000 7f7b50c00640 10 client.15855 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:14:59.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.141+0000 7f7b50c00640 1 -- 172.21.15.3:0/2431524070 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cbb42d9950 con 0x55cbb4380d70 2024-09-19T06:14:59.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.141+0000 7f7b50c00640 10 client.15855 handle_command_reply: tid=0 2024-09-19T06:14:59.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.142+0000 7f7b6c5d3740 1 client.15855 shutdown 2024-09-19T06:14:59.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.142+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/2431524070 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4366590 msgr2=0x55cbb436e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.142+0000 7f7b6c5d3740 1 --2- 172.21.15.3:0/2431524070 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4366590 0x55cbb436e250 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7b64077f50 tx=0x7f7b4c012bd0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.142+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/2431524070 shutdown_connections 2024-09-19T06:14:59.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.142+0000 7f7b6c5d3740 1 --2- 172.21.15.3:0/2431524070 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55cbb4380d70 0x55cbb4383190 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.142+0000 7f7b6c5d3740 1 --2- 172.21.15.3:0/2431524070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb4370e50 0x55cbb436e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.142+0000 7f7b6c5d3740 1 --2- 172.21.15.3:0/2431524070 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4366590 0x55cbb436e250 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.142+0000 7f7b6c5d3740 1 --2- 172.21.15.3:0/2431524070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb4365c70 0x55cbb436dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.142+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/2431524070 >> 172.21.15.3:0/2431524070 conn(0x55cbb4362200 msgr2=0x55cbb4367f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:59.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.142+0000 7f7b50c00640 0 client.15855 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:14:59.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.142+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/2431524070 shutdown_connections 2024-09-19T06:14:59.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.142+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/2431524070 wait complete. 2024-09-19T06:14:59.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.142+0000 7f7b6c5d3740 20 client.15855 trim_cache size 0 max 16384 2024-09-19T06:14:59.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.156+0000 7f7b6c5d3740 1 Processor -- start 2024-09-19T06:14:59.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.156+0000 7f7b6c5d3740 1 -- start start 2024-09-19T06:14:59.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.156+0000 7f7b6c5d3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb4365c70 0x55cbb436e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.156+0000 7f7b6c5d3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4366590 0x55cbb436fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.157+0000 7f7b6c5d3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb4370e50 0x55cbb4388a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.157+0000 7f7b6c5d3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7b641b3ec0 con 0x55cbb4366590 2024-09-19T06:14:59.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.157+0000 7f7b6c5d3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7b641b5a00 con 0x55cbb4365c70 2024-09-19T06:14:59.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.157+0000 7f7b6c5d3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7b641b4590 con 0x55cbb4370e50 2024-09-19T06:14:59.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.157+0000 7f7b5be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4366590 0x55cbb436fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.157+0000 7f7b63400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb4365c70 0x55cbb436e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.157+0000 7f7b5be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4366590 0x55cbb436fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56052/0 (socket says 172.21.15.3:56052) 2024-09-19T06:14:59.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.157+0000 7f7b5be00640 1 -- 172.21.15.3:0/2298908227 learned_addr learned my addr 172.21.15.3:0/2298908227 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:59.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.157+0000 7f7b63400640 1 --2- 172.21.15.3:0/2298908227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb4370e50 0x55cbb4388a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.157+0000 7f7b5be00640 1 -- 172.21.15.3:0/2298908227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb4370e50 msgr2=0x55cbb4388a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:59.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.157+0000 7f7b5be00640 1 --2- 172.21.15.3:0/2298908227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb4370e50 0x55cbb4388a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.157+0000 7f7b5be00640 1 -- 172.21.15.3:0/2298908227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb4365c70 msgr2=0x55cbb436e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:59.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.157+0000 7f7b5be00640 1 --2- 172.21.15.3:0/2298908227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb4365c70 0x55cbb436e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.157+0000 7f7b5be00640 1 -- 172.21.15.3:0/2298908227 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbb4361ca0 con 0x55cbb4366590 2024-09-19T06:14:59.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.158+0000 7f7b5be00640 1 --2- 172.21.15.3:0/2298908227 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4366590 0x55cbb436fc80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c001eb0 tx=0x7f7b4c00f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8edca04831f6d45 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:59.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.158+0000 7f7b53400640 1 -- 172.21.15.3:0/2298908227 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c029070 con 0x55cbb4366590 2024-09-19T06:14:59.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.158+0000 7f7b53400640 1 -- 172.21.15.3:0/2298908227 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b4c005510 con 0x55cbb4366590 2024-09-19T06:14:59.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.158+0000 7f7b53400640 1 -- 172.21.15.3:0/2298908227 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c010690 con 0x55cbb4366590 2024-09-19T06:14:59.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.158+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/2298908227 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4366590 msgr2=0x55cbb436fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.158+0000 7f7b6c5d3740 1 --2- 172.21.15.3:0/2298908227 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4366590 0x55cbb436fc80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c001eb0 tx=0x7f7b4c00f840 comp rx=0 tx=0).stop 2024-09-19T06:14:59.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.158+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/2298908227 shutdown_connections 2024-09-19T06:14:59.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.158+0000 7f7b6c5d3740 1 --2- 172.21.15.3:0/2298908227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb4370e50 0x55cbb4388a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.158+0000 7f7b6c5d3740 1 --2- 172.21.15.3:0/2298908227 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4366590 0x55cbb436fc80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.158+0000 7f7b6c5d3740 1 --2- 172.21.15.3:0/2298908227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb4365c70 0x55cbb436e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.158+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/2298908227 >> 172.21.15.3:0/2298908227 conn(0x55cbb4362200 msgr2=0x55cbb436f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:59.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.159+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/2298908227 shutdown_connections 2024-09-19T06:14:59.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.159+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/2298908227 wait complete. 2024-09-19T06:14:59.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.159+0000 7f7b6c5d3740 1 -- start start 2024-09-19T06:14:59.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.159+0000 7f7b6c5d3740 1 Processor -- start 2024-09-19T06:14:59.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.160+0000 7f7b6c5d3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb4365c70 0x55cbb4378e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.160+0000 7f7b6c5d3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb4366590 0x55cbb4379390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.160+0000 7f7b6c5d3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4370e50 0x55cbb436a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.160+0000 7f7b6c5d3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7b641b5330 con 0x55cbb4370e50 2024-09-19T06:14:59.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.160+0000 7f7b6c5d3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7b641b4c60 con 0x55cbb4365c70 2024-09-19T06:14:59.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.160+0000 7f7b6c5d3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7b641b1ea0 con 0x55cbb4366590 2024-09-19T06:14:59.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.160+0000 7f7b6c5d3740 10 client.0 _ll_register_callbacks cb 0x7f7b4c0097f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:14:59.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.160+0000 7f7b63400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb4365c70 0x55cbb4378e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.160+0000 7f7b63400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4370e50 0x55cbb436a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.160+0000 7f7b5be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb4366590 0x55cbb4379390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.160+0000 7f7b63400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb4365c70 0x55cbb4378e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:42606/0 (socket says 172.21.15.3:42606) 2024-09-19T06:14:59.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.160+0000 7f7b63400640 1 -- 172.21.15.3:0/2678962320 learned_addr learned my addr 172.21.15.3:0/2678962320 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:14:59.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.160+0000 7f7b5be00640 1 -- 172.21.15.3:0/2678962320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb4365c70 msgr2=0x55cbb4378e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:59.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.160+0000 7f7b5be00640 1 --2- 172.21.15.3:0/2678962320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb4365c70 0x55cbb4378e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.160+0000 7f7b5be00640 1 -- 172.21.15.3:0/2678962320 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4370e50 msgr2=0x55cbb436a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:14:59.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.160+0000 7f7b5be00640 1 --2- 172.21.15.3:0/2678962320 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4370e50 0x55cbb436a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.160+0000 7f7b5be00640 1 -- 172.21.15.3:0/2678962320 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbb436ac80 con 0x55cbb4366590 2024-09-19T06:14:59.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.161+0000 7f7b5be00640 1 --2- 172.21.15.3:0/2678962320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb4366590 0x55cbb4379390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55cbb4367320 tx=0x7f7b4c009fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70123b81b9bc406 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:14:59.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.161+0000 7f7b50c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:14:59.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.161+0000 7f7b50c00640 1 -- 172.21.15.3:0/2678962320 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c029070 con 0x55cbb4366590 2024-09-19T06:14:59.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.161+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/2678962320 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b4c005510 con 0x55cbb4366590 2024-09-19T06:14:59.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.161+0000 7f7b50c00640 1 -- 172.21.15.3:0/2678962320 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f7b4c0052d0 con 0x55cbb4366590 2024-09-19T06:14:59.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.162+0000 7f7b50c00640 1 -- 172.21.15.3:0/2678962320 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7b4c03c050 con 0x55cbb4366590 2024-09-19T06:14:59.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.162+0000 7f7b6c5d3740 10 client.25912 fetch_fsmap learned FSMap version 29 2024-09-19T06:14:59.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.162+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/2678962320 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cbb43eb3f0 con 0x55cbb4366590 2024-09-19T06:14:59.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.162+0000 7f7b50c00640 1 -- 172.21.15.3:0/2678962320 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b4c005510 con 0x55cbb4366590 2024-09-19T06:14:59.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.162+0000 7f7b50c00640 1 -- 172.21.15.3:0/2678962320 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f7b4c01c470 con 0x55cbb4366590 2024-09-19T06:14:59.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.162+0000 7f7b6c5d3740 10 client.25912 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:14:59.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.162+0000 7f7b6c5d3740 10 client.25912 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:14:59.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.162+0000 7f7b6c5d3740 20 client.25912 populate_metadata read hostname 'smithi003' 2024-09-19T06:14:59.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.162+0000 7f7b6c5d3740 1 --2- 172.21.15.3:0/2678962320 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55cbb43eba00 0x55cbb43ede20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:14:59.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.162+0000 7f7b6c5d3740 4 client.25912 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:14:59.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.162+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/2678962320 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cbb42d3e60 con 0x55cbb43eba00 2024-09-19T06:14:59.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.162+0000 7f7b63400640 1 --2- 172.21.15.3:0/2678962320 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55cbb43eba00 0x55cbb43ede20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:14:59.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.163+0000 7f7b63400640 1 --2- 172.21.15.3:0/2678962320 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55cbb43eba00 0x55cbb43ede20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e76d86fc71bffa03 server_cookie=8bf11a075405b7c2 in_seq=0 out_seq=0 2024-09-19T06:14:59.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.163+0000 7f7b50c00640 10 client.25912 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:14:59.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.163+0000 7f7b50c00640 1 -- 172.21.15.3:0/2678962320 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cbb42d3e60 con 0x55cbb43eba00 2024-09-19T06:14:59.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.163+0000 7f7b50c00640 10 client.25912 handle_command_reply: tid=0 2024-09-19T06:14:59.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.163+0000 7f7b6c5d3740 1 client.25912 shutdown 2024-09-19T06:14:59.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.163+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/2678962320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb4366590 msgr2=0x55cbb4379390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.163+0000 7f7b6c5d3740 1 --2- 172.21.15.3:0/2678962320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb4366590 0x55cbb4379390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x55cbb4367320 tx=0x7f7b4c009fd0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.163+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/2678962320 shutdown_connections 2024-09-19T06:14:59.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.163+0000 7f7b6c5d3740 1 --2- 172.21.15.3:0/2678962320 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55cbb43eba00 0x55cbb43ede20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.163+0000 7f7b6c5d3740 1 --2- 172.21.15.3:0/2678962320 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb4370e50 0x55cbb436a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.163+0000 7f7b6c5d3740 1 --2- 172.21.15.3:0/2678962320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb4366590 0x55cbb4379390 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.163+0000 7f7b6c5d3740 1 --2- 172.21.15.3:0/2678962320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb4365c70 0x55cbb4378e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.163+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/2678962320 >> 172.21.15.3:0/2678962320 conn(0x55cbb4362200 msgr2=0x55cbb4361380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:59.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.163+0000 7f7b50c00640 0 client.25912 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:14:59.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.163+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/2678962320 shutdown_connections 2024-09-19T06:14:59.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.164+0000 7f7b6c5d3740 1 -- 172.21.15.3:0/2678962320 wait complete. 2024-09-19T06:14:59.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.164+0000 7f7b6c5d3740 20 client.25912 trim_cache size 0 max 16384 2024-09-19T06:14:59.169 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:14:59.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.164+0000 7f7b69a00640 1 -- 172.21.15.3:0/56910922 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7b480a33b0 msgr2=0x7f7b480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.164+0000 7f7b69a00640 1 --2- 172.21.15.3:0/56910922 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7b480a33b0 0x7f7b480a5870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7b540988c0 tx=0x7f7b540d3750 comp rx=0 tx=0).stop 2024-09-19T06:14:59.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.164+0000 7f7b69a00640 1 -- 172.21.15.3:0/56910922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b64103ff0 msgr2=0x7f7b64076700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:14:59.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.164+0000 7f7b69a00640 1 --2- 172.21.15.3:0/56910922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b64103ff0 0x7f7b64076700 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400ea20 tx=0x7f7b5400eee0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.164+0000 7f7b69a00640 1 -- 172.21.15.3:0/56910922 shutdown_connections 2024-09-19T06:14:59.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.164+0000 7f7b69a00640 1 --2- 172.21.15.3:0/56910922 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7b480a33b0 0x7f7b480a5870 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.164+0000 7f7b69a00640 1 --2- 172.21.15.3:0/56910922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b64109120 0x7f7b64077180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.164+0000 7f7b69a00640 1 --2- 172.21.15.3:0/56910922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b641049a0 0x7f7b64076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.164+0000 7f7b69a00640 1 --2- 172.21.15.3:0/56910922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7b64103ff0 0x7f7b64076700 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:14:59.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.164+0000 7f7b69a00640 1 -- 172.21.15.3:0/56910922 >> 172.21.15.3:0/56910922 conn(0x7f7b640ffa90 msgr2=0x7f7b641005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:14:59.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.165+0000 7f7b69a00640 1 -- 172.21.15.3:0/56910922 shutdown_connections 2024-09-19T06:14:59.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:14:59.165+0000 7f7b69a00640 1 -- 172.21.15.3:0/56910922 wait complete. 2024-09-19T06:15:00.166 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:15:00.215 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:14:59 smithi003 ceph-mon[30893]: pgmap v81: 97 pgs: 97 active+clean; 2.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-09-19T06:15:00.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:14:59 smithi059 ceph-mon[35138]: pgmap v81: 97 pgs: 97 active+clean; 2.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-09-19T06:15:00.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:14:59 smithi071 ceph-mon[35662]: pgmap v81: 97 pgs: 97 active+clean; 2.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 22 op/s 2024-09-19T06:15:00.546 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:15:01.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.136+0000 7f2798a00640 1 -- 172.21.15.3:0/795213831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2794106f20 msgr2=0x7f279410eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:01.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.136+0000 7f2798a00640 1 --2- 172.21.15.3:0/795213831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2794106f20 0x7f279410eaa0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f278c009ca0 tx=0x7f278c02a8b0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.136+0000 7f2798a00640 1 -- 172.21.15.3:0/795213831 shutdown_connections 2024-09-19T06:15:01.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.136+0000 7f2798a00640 1 --2- 172.21.15.3:0/795213831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2794106f20 0x7f279410eaa0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.136+0000 7f2798a00640 1 --2- 172.21.15.3:0/795213831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27941027a0 0x7f27941067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.136+0000 7f2798a00640 1 --2- 172.21.15.3:0/795213831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2794101df0 0x7f27941021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.136+0000 7f2798a00640 1 -- 172.21.15.3:0/795213831 >> 172.21.15.3:0/795213831 conn(0x7f27940fd8b0 msgr2=0x7f27940ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:01.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.136+0000 7f2798a00640 1 -- 172.21.15.3:0/795213831 shutdown_connections 2024-09-19T06:15:01.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.136+0000 7f2798a00640 1 -- 172.21.15.3:0/795213831 wait complete. 2024-09-19T06:15:01.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.137+0000 7f2798a00640 1 Processor -- start 2024-09-19T06:15:01.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.137+0000 7f2798a00640 1 -- start start 2024-09-19T06:15:01.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.137+0000 7f2798a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2794101df0 0x7f279419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:01.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.137+0000 7f2798a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27941027a0 0x7f279419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:01.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.137+0000 7f2798a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2794106f20 0x7f279419ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:01.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.137+0000 7f2798a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2794111f80 con 0x7f2794106f20 2024-09-19T06:15:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.137+0000 7f2798a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2794111e00 con 0x7f27941027a0 2024-09-19T06:15:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.137+0000 7f2798a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2794112100 con 0x7f2794101df0 2024-09-19T06:15:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.138+0000 7f2792800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2794106f20 0x7f279419ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.138+0000 7f2789400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27941027a0 0x7f279419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.138+0000 7f2792800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2794106f20 0x7f279419ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56090/0 (socket says 172.21.15.3:56090) 2024-09-19T06:15:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.138+0000 7f2792800640 1 -- 172.21.15.3:0/2499311297 learned_addr learned my addr 172.21.15.3:0/2499311297 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.138+0000 7f2791e00640 1 --2- 172.21.15.3:0/2499311297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2794101df0 0x7f279419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.138+0000 7f2789400640 1 -- 172.21.15.3:0/2499311297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2794101df0 msgr2=0x7f279419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.138+0000 7f2789400640 1 --2- 172.21.15.3:0/2499311297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2794101df0 0x7f279419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.138+0000 7f2789400640 1 -- 172.21.15.3:0/2499311297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2794106f20 msgr2=0x7f279419ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.138+0000 7f2789400640 1 --2- 172.21.15.3:0/2499311297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2794106f20 0x7f279419ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.138+0000 7f2789400640 1 -- 172.21.15.3:0/2499311297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279419f570 con 0x7f27941027a0 2024-09-19T06:15:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.139+0000 7f2789400640 1 --2- 172.21.15.3:0/2499311297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27941027a0 0x7f279419ab00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f277c00e9f0 tx=0x7f277c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:01.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.139+0000 7f278b400640 1 -- 172.21.15.3:0/2499311297 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c00ccc0 con 0x7f27941027a0 2024-09-19T06:15:01.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.139+0000 7f2798a00640 1 -- 172.21.15.3:0/2499311297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f279419f860 con 0x7f27941027a0 2024-09-19T06:15:01.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.139+0000 7f278b400640 1 -- 172.21.15.3:0/2499311297 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f277c005020 con 0x7f27941027a0 2024-09-19T06:15:01.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.139+0000 7f278b400640 1 -- 172.21.15.3:0/2499311297 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c0049e0 con 0x7f27941027a0 2024-09-19T06:15:01.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.139+0000 7f2798a00640 1 -- 172.21.15.3:0/2499311297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27941a7140 con 0x7f27941027a0 2024-09-19T06:15:01.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.142+0000 7f278b400640 1 -- 172.21.15.3:0/2499311297 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f277c005560 con 0x7f27941027a0 2024-09-19T06:15:01.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.142+0000 7f279b633740 1 Processor -- start 2024-09-19T06:15:01.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.142+0000 7f279b633740 1 -- start start 2024-09-19T06:15:01.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.142+0000 7f279b633740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f83c70 0x5572c0f84050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:01.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.142+0000 7f279b633740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c0f84590 0x5572c0f8e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:01.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.142+0000 7f279b633740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5572c0f8ee50 0x5572c0f91240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:01.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.142+0000 7f279b633740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5572c0eea3e0 con 0x5572c0f83c70 2024-09-19T06:15:01.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.142+0000 7f279b633740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5572c0e91d80 con 0x5572c0f84590 2024-09-19T06:15:01.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.142+0000 7f279b633740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5572c0ee63a0 con 0x5572c0f8ee50 2024-09-19T06:15:01.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.143+0000 7f2792800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f83c70 0x5572c0f84050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:01.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.143+0000 7f2791e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c0f84590 0x5572c0f8e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:01.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.143+0000 7f2792800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f83c70 0x5572c0f84050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56096/0 (socket says 172.21.15.3:56096) 2024-09-19T06:15:01.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.143+0000 7f2791e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c0f84590 0x5572c0f8e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:42634/0 (socket says 172.21.15.3:42634) 2024-09-19T06:15:01.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.143+0000 7f2792800640 1 -- 172.21.15.3:0/2834982215 learned_addr learned my addr 172.21.15.3:0/2834982215 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:01.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.143+0000 7f2789400640 1 --2- 172.21.15.3:0/2834982215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5572c0f8ee50 0x5572c0f91240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:01.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.143+0000 7f2791e00640 1 -- 172.21.15.3:0/2834982215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5572c0f8ee50 msgr2=0x5572c0f91240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:01.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.143+0000 7f2791e00640 1 --2- 172.21.15.3:0/2834982215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5572c0f8ee50 0x5572c0f91240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.143+0000 7f2791e00640 1 -- 172.21.15.3:0/2834982215 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f83c70 msgr2=0x5572c0f84050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:01.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.143+0000 7f2791e00640 1 --2- 172.21.15.3:0/2834982215 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f83c70 0x5572c0f84050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.143+0000 7f2791e00640 1 -- 172.21.15.3:0/2834982215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572c0eb0ae0 con 0x5572c0f84590 2024-09-19T06:15:01.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.143+0000 7f2789400640 1 --2- 172.21.15.3:0/2834982215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5572c0f8ee50 0x5572c0f91240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:01.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.143+0000 7f2792800640 1 --2- 172.21.15.3:0/2834982215 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f83c70 0x5572c0f84050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:01.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.144+0000 7f2791e00640 1 --2- 172.21.15.3:0/2834982215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c0f84590 0x5572c0f8e910 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2784009c20 tx=0x7f2784011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=351efe07b6f4401a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:01.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.144+0000 7f278b400640 1 --2- 172.21.15.3:0/2499311297 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f27780a33b0 0x7f27780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:01.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.144+0000 7f278b400640 1 -- 172.21.15.3:0/2499311297 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f277c0cfc70 con 0x7f27941027a0 2024-09-19T06:15:01.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.144+0000 7f2783000640 1 -- 172.21.15.3:0/2834982215 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2784004050 con 0x5572c0f84590 2024-09-19T06:15:01.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.144+0000 7f2783000640 1 -- 172.21.15.3:0/2834982215 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2784005500 con 0x5572c0f84590 2024-09-19T06:15:01.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.144+0000 7f2783000640 1 -- 172.21.15.3:0/2834982215 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27840035f0 con 0x5572c0f84590 2024-09-19T06:15:01.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.144+0000 7f2792800640 1 --2- 172.21.15.3:0/2499311297 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f27780a33b0 0x7f27780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:01.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.145+0000 7f279b633740 1 -- 172.21.15.3:0/2834982215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c0f84590 msgr2=0x5572c0f8e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:01.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.145+0000 7f279b633740 1 --2- 172.21.15.3:0/2834982215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c0f84590 0x5572c0f8e910 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2784009c20 tx=0x7f2784011810 comp rx=0 tx=0).stop 2024-09-19T06:15:01.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.145+0000 7f2792800640 1 --2- 172.21.15.3:0/2499311297 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f27780a33b0 0x7f27780a5870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f278c0304e0 tx=0x7f278c005c50 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:01.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.145+0000 7f279b633740 1 -- 172.21.15.3:0/2834982215 shutdown_connections 2024-09-19T06:15:01.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.145+0000 7f279b633740 1 --2- 172.21.15.3:0/2834982215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5572c0f8ee50 0x5572c0f91240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.145+0000 7f279b633740 1 --2- 172.21.15.3:0/2834982215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c0f84590 0x5572c0f8e910 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.145+0000 7f279b633740 1 --2- 172.21.15.3:0/2834982215 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f83c70 0x5572c0f84050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.145+0000 7f279b633740 1 -- 172.21.15.3:0/2834982215 >> 172.21.15.3:0/2834982215 conn(0x5572c0f80200 msgr2=0x5572c0f805e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:01.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.145+0000 7f279b633740 1 -- 172.21.15.3:0/2834982215 shutdown_connections 2024-09-19T06:15:01.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.145+0000 7f279b633740 1 -- 172.21.15.3:0/2834982215 wait complete. 2024-09-19T06:15:01.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.145+0000 7f279b633740 1 -- start start 2024-09-19T06:15:01.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.146+0000 7f279b633740 1 Processor -- start 2024-09-19T06:15:01.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.146+0000 7f279b633740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f83c70 0x5572c0f8bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:01.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.146+0000 7f279b633740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5572c0f84590 0x5572c0f8c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:01.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.146+0000 7f279b633740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c0f8ee50 0x5572c0f8c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:01.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.146+0000 7f279b633740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5572c0f91a20 con 0x5572c0f83c70 2024-09-19T06:15:01.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.146+0000 7f279b633740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5572c0ea50f0 con 0x5572c0f8ee50 2024-09-19T06:15:01.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.146+0000 7f279b633740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5572c0f91ba0 con 0x5572c0f84590 2024-09-19T06:15:01.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.146+0000 7f279b633740 10 client.0 _ll_register_callbacks cb 0x5572c0e8cbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:01.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.146+0000 7f2791e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f83c70 0x5572c0f8bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:01.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.146+0000 7f2791e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f83c70 0x5572c0f8bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56106/0 (socket says 172.21.15.3:56106) 2024-09-19T06:15:01.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.146+0000 7f2791e00640 1 -- 172.21.15.3:0/867131247 learned_addr learned my addr 172.21.15.3:0/867131247 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:01.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.146+0000 7f2789400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5572c0f84590 0x5572c0f8c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:01.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.147+0000 7f2792800640 1 --2- 172.21.15.3:0/867131247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c0f8ee50 0x5572c0f8c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:01.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.147+0000 7f2791e00640 1 -- 172.21.15.3:0/867131247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5572c0f84590 msgr2=0x5572c0f8c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:01.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.147+0000 7f2791e00640 1 --2- 172.21.15.3:0/867131247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5572c0f84590 0x5572c0f8c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.147+0000 7f2791e00640 1 -- 172.21.15.3:0/867131247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c0f8ee50 msgr2=0x5572c0f8c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:01.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.147+0000 7f2791e00640 1 --2- 172.21.15.3:0/867131247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c0f8ee50 0x5572c0f8c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.147+0000 7f2791e00640 1 -- 172.21.15.3:0/867131247 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572c0c5b3c0 con 0x5572c0f83c70 2024-09-19T06:15:01.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.147+0000 7f2791e00640 1 --2- 172.21.15.3:0/867131247 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f83c70 0x5572c0f8bcc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2784004a20 tx=0x7f2784004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3cb3e2cf994cc37 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:01.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.147+0000 7f2777400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:15:01.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.148+0000 7f2777400640 1 -- 172.21.15.3:0/867131247 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2784029070 con 0x5572c0f83c70 2024-09-19T06:15:01.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.148+0000 7f2777400640 1 -- 172.21.15.3:0/867131247 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f2784005250 con 0x5572c0f83c70 2024-09-19T06:15:01.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.148+0000 7f279b633740 1 -- 172.21.15.3:0/867131247 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2784005500 con 0x5572c0f83c70 2024-09-19T06:15:01.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.148+0000 7f2777400640 1 -- 172.21.15.3:0/867131247 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2784035050 con 0x5572c0f83c70 2024-09-19T06:15:01.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.148+0000 7f279b633740 10 client.15873 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:01.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.148+0000 7f279b633740 1 -- 172.21.15.3:0/867131247 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5572c0f9d9e0 con 0x5572c0f83c70 2024-09-19T06:15:01.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.148+0000 7f2777400640 1 -- 172.21.15.3:0/867131247 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2784005500 con 0x5572c0f83c70 2024-09-19T06:15:01.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.148+0000 7f2777400640 1 -- 172.21.15.3:0/867131247 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2784003d10 con 0x5572c0f83c70 2024-09-19T06:15:01.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.149+0000 7f279b633740 10 client.15873 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:01.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.149+0000 7f279b633740 10 client.15873 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:01.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.149+0000 7f279b633740 20 client.15873 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:01.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.149+0000 7f279b633740 1 --2- 172.21.15.3:0/867131247 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5572c0f9ed30 0x5572c0fa1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:01.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.149+0000 7f279b633740 4 client.15873 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:01.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.149+0000 7f279b633740 1 -- 172.21.15.3:0/867131247 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572c0ef7950 con 0x5572c0f9ed30 2024-09-19T06:15:01.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.149+0000 7f2789400640 1 --2- 172.21.15.3:0/867131247 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5572c0f9ed30 0x5572c0fa1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:01.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.149+0000 7f2789400640 1 --2- 172.21.15.3:0/867131247 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5572c0f9ed30 0x5572c0fa1120 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e0dcd3420014a49 server_cookie=542e8049a1180eb1 in_seq=0 out_seq=0 2024-09-19T06:15:01.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.149+0000 7f2777400640 10 client.15873 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:01.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.150+0000 7f2777400640 1 -- 172.21.15.3:0/867131247 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5572c0ef7950 con 0x5572c0f9ed30 2024-09-19T06:15:01.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.150+0000 7f2777400640 10 client.15873 handle_command_reply: tid=0 2024-09-19T06:15:01.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.150+0000 7f279b633740 1 client.15873 shutdown 2024-09-19T06:15:01.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.151+0000 7f279b633740 1 -- 172.21.15.3:0/867131247 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f83c70 msgr2=0x5572c0f8bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:01.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.151+0000 7f279b633740 1 --2- 172.21.15.3:0/867131247 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f83c70 0x5572c0f8bcc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2784004a20 tx=0x7f2784004e50 comp rx=0 tx=0).stop 2024-09-19T06:15:01.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.151+0000 7f279b633740 1 -- 172.21.15.3:0/867131247 shutdown_connections 2024-09-19T06:15:01.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.151+0000 7f279b633740 1 --2- 172.21.15.3:0/867131247 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5572c0f9ed30 0x5572c0fa1120 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.151+0000 7f279b633740 1 --2- 172.21.15.3:0/867131247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c0f8ee50 0x5572c0f8c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.151+0000 7f279b633740 1 --2- 172.21.15.3:0/867131247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5572c0f84590 0x5572c0f8c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.151+0000 7f279b633740 1 --2- 172.21.15.3:0/867131247 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f83c70 0x5572c0f8bcc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.151+0000 7f279b633740 1 -- 172.21.15.3:0/867131247 >> 172.21.15.3:0/867131247 conn(0x5572c0f80200 msgr2=0x5572c0f7f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:01.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.151+0000 7f2777400640 0 client.15873 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:01.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.151+0000 7f279b633740 1 -- 172.21.15.3:0/867131247 shutdown_connections 2024-09-19T06:15:01.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.151+0000 7f279b633740 1 -- 172.21.15.3:0/867131247 wait complete. 2024-09-19T06:15:01.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.151+0000 7f279b633740 20 client.15873 trim_cache size 0 max 16384 2024-09-19T06:15:01.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.165+0000 7f279b633740 1 Processor -- start 2024-09-19T06:15:01.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.165+0000 7f279b633740 1 -- start start 2024-09-19T06:15:01.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.165+0000 7f279b633740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5572c0f83c70 0x5572c0f866d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:01.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.165+0000 7f279b633740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c0f84590 0x5572c0fa6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:01.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.165+0000 7f279b633740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f8ee50 0x5572c0fa6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:01.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.165+0000 7f279b633740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f27941afb40 con 0x5572c0f8ee50 2024-09-19T06:15:01.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.165+0000 7f279b633740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f27941b1680 con 0x5572c0f84590 2024-09-19T06:15:01.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.165+0000 7f279b633740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f27941b0210 con 0x5572c0f83c70 2024-09-19T06:15:01.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.166+0000 7f2789400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c0f84590 0x5572c0fa6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:01.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.166+0000 7f2789400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c0f84590 0x5572c0fa6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:42650/0 (socket says 172.21.15.3:42650) 2024-09-19T06:15:01.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.166+0000 7f2789400640 1 -- 172.21.15.3:0/2992285382 learned_addr learned my addr 172.21.15.3:0/2992285382 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:01.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.166+0000 7f2791e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5572c0f83c70 0x5572c0f866d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:01.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.166+0000 7f2792800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f8ee50 0x5572c0fa6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:01.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.166+0000 7f2789400640 1 -- 172.21.15.3:0/2992285382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5572c0f83c70 msgr2=0x5572c0f866d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:01.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.166+0000 7f2789400640 1 --2- 172.21.15.3:0/2992285382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5572c0f83c70 0x5572c0f866d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.166+0000 7f2789400640 1 -- 172.21.15.3:0/2992285382 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f8ee50 msgr2=0x5572c0fa6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:01.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.166+0000 7f2789400640 1 --2- 172.21.15.3:0/2992285382 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f8ee50 0x5572c0fa6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.166+0000 7f2789400640 1 -- 172.21.15.3:0/2992285382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572c0f7fca0 con 0x5572c0f84590 2024-09-19T06:15:01.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.166+0000 7f2789400640 1 --2- 172.21.15.3:0/2992285382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c0f84590 0x5572c0fa6890 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f277c09be80 tx=0x7f277c0096e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bf136afc2b7a641 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:01.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.167+0000 7f2782600640 1 -- 172.21.15.3:0/2992285382 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c0b4070 con 0x5572c0f84590 2024-09-19T06:15:01.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.167+0000 7f2782600640 1 -- 172.21.15.3:0/2992285382 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f277c09bef0 con 0x5572c0f84590 2024-09-19T06:15:01.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.167+0000 7f2782600640 1 -- 172.21.15.3:0/2992285382 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c01c040 con 0x5572c0f84590 2024-09-19T06:15:01.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.167+0000 7f279b633740 1 -- 172.21.15.3:0/2992285382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c0f84590 msgr2=0x5572c0fa6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:01.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.167+0000 7f279b633740 1 --2- 172.21.15.3:0/2992285382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c0f84590 0x5572c0fa6890 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f277c09be80 tx=0x7f277c0096e0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.167+0000 7f279b633740 1 -- 172.21.15.3:0/2992285382 shutdown_connections 2024-09-19T06:15:01.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.167+0000 7f279b633740 1 --2- 172.21.15.3:0/2992285382 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f8ee50 0x5572c0fa6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.167+0000 7f279b633740 1 --2- 172.21.15.3:0/2992285382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c0f84590 0x5572c0fa6890 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.167+0000 7f279b633740 1 --2- 172.21.15.3:0/2992285382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5572c0f83c70 0x5572c0f866d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.167+0000 7f279b633740 1 -- 172.21.15.3:0/2992285382 >> 172.21.15.3:0/2992285382 conn(0x5572c0f80200 msgr2=0x5572c0f8dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:01.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.167+0000 7f279b633740 1 -- 172.21.15.3:0/2992285382 shutdown_connections 2024-09-19T06:15:01.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.167+0000 7f279b633740 1 -- 172.21.15.3:0/2992285382 wait complete. 2024-09-19T06:15:01.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.168+0000 7f279b633740 1 -- start start 2024-09-19T06:15:01.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.168+0000 7f279b633740 1 Processor -- start 2024-09-19T06:15:01.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.168+0000 7f279b633740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f83c70 0x5572c0f92530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:01.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.168+0000 7f279b633740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5572c0f84590 0x5572c0f92a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:01.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.169+0000 7f279b633740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c0f8ee50 0x5572c1001820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:01.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.169+0000 7f279b633740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f27941b0fb0 con 0x5572c0f83c70 2024-09-19T06:15:01.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.169+0000 7f279b633740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f27941b08e0 con 0x5572c0f8ee50 2024-09-19T06:15:01.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.169+0000 7f279b633740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f27941adb20 con 0x5572c0f84590 2024-09-19T06:15:01.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.169+0000 7f279b633740 10 client.0 _ll_register_callbacks cb 0x7f277c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:01.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.169+0000 7f2791e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f83c70 0x5572c0f92530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:01.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.169+0000 7f2789400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5572c0f84590 0x5572c0f92a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:01.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.169+0000 7f2791e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f83c70 0x5572c0f92530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56128/0 (socket says 172.21.15.3:56128) 2024-09-19T06:15:01.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.169+0000 7f2791e00640 1 -- 172.21.15.3:0/1881970551 learned_addr learned my addr 172.21.15.3:0/1881970551 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:01.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.169+0000 7f2792800640 1 --2- 172.21.15.3:0/1881970551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c0f8ee50 0x5572c1001820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:01.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.169+0000 7f2791e00640 1 -- 172.21.15.3:0/1881970551 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5572c0f84590 msgr2=0x5572c0f92a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:01.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.169+0000 7f2791e00640 1 --2- 172.21.15.3:0/1881970551 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5572c0f84590 0x5572c0f92a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.169+0000 7f2791e00640 1 -- 172.21.15.3:0/1881970551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c0f8ee50 msgr2=0x5572c1001820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:01.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.169+0000 7f2791e00640 1 --2- 172.21.15.3:0/1881970551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c0f8ee50 0x5572c1001820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.169+0000 7f2791e00640 1 -- 172.21.15.3:0/1881970551 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572c1001ec0 con 0x5572c0f83c70 2024-09-19T06:15:01.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.170+0000 7f2791e00640 1 --2- 172.21.15.3:0/1881970551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f83c70 0x5572c0f92530 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2784009250 tx=0x7f27840096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=527c85ed9088dc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:01.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.170+0000 7f2777400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:15:01.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.170+0000 7f2777400640 1 -- 172.21.15.3:0/1881970551 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2784029040 con 0x5572c0f83c70 2024-09-19T06:15:01.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.170+0000 7f279b633740 1 -- 172.21.15.3:0/1881970551 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f277c09bef0 con 0x5572c0f83c70 2024-09-19T06:15:01.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.170+0000 7f2777400640 1 -- 172.21.15.3:0/1881970551 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f2784023b00 con 0x5572c0f83c70 2024-09-19T06:15:01.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.170+0000 7f2777400640 1 -- 172.21.15.3:0/1881970551 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2784023d20 con 0x5572c0f83c70 2024-09-19T06:15:01.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.170+0000 7f279b633740 10 client.15879 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:01.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.170+0000 7f279b633740 1 -- 172.21.15.3:0/1881970551 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5572c1009270 con 0x5572c0f83c70 2024-09-19T06:15:01.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.170+0000 7f2777400640 1 -- 172.21.15.3:0/1881970551 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f277c09bef0 con 0x5572c0f83c70 2024-09-19T06:15:01.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.171+0000 7f2777400640 1 -- 172.21.15.3:0/1881970551 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f27840035f0 con 0x5572c0f83c70 2024-09-19T06:15:01.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.171+0000 7f279b633740 10 client.15879 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:01.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.171+0000 7f279b633740 10 client.15879 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:01.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.171+0000 7f279b633740 20 client.15879 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:01.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.171+0000 7f279b633740 1 --2- 172.21.15.3:0/1881970551 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5572c10099e0 0x5572c100be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:01.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.171+0000 7f279b633740 4 client.15879 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:15:01.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.171+0000 7f279b633740 1 -- 172.21.15.3:0/1881970551 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5572c0ef1e60 con 0x5572c10099e0 2024-09-19T06:15:01.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.171+0000 7f2789400640 1 --2- 172.21.15.3:0/1881970551 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5572c10099e0 0x5572c100be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:01.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.172+0000 7f2789400640 1 --2- 172.21.15.3:0/1881970551 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5572c10099e0 0x5572c100be00 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2659239132f8258c server_cookie=1f31a6606c7ddb0b in_seq=0 out_seq=0 2024-09-19T06:15:01.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.172+0000 7f2777400640 10 client.15879 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:01.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.172+0000 7f2777400640 1 -- 172.21.15.3:0/1881970551 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5572c0ef1e60 con 0x5572c10099e0 2024-09-19T06:15:01.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.172+0000 7f2777400640 10 client.15879 handle_command_reply: tid=0 2024-09-19T06:15:01.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.172+0000 7f279b633740 1 client.15879 shutdown 2024-09-19T06:15:01.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.172+0000 7f279b633740 1 -- 172.21.15.3:0/1881970551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f83c70 msgr2=0x5572c0f92530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:01.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.172+0000 7f279b633740 1 --2- 172.21.15.3:0/1881970551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f83c70 0x5572c0f92530 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2784009250 tx=0x7f27840096c0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.172+0000 7f279b633740 1 -- 172.21.15.3:0/1881970551 shutdown_connections 2024-09-19T06:15:01.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.172+0000 7f279b633740 1 --2- 172.21.15.3:0/1881970551 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5572c10099e0 0x5572c100be00 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.172+0000 7f279b633740 1 --2- 172.21.15.3:0/1881970551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572c0f8ee50 0x5572c1001820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.172+0000 7f279b633740 1 --2- 172.21.15.3:0/1881970551 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5572c0f84590 0x5572c0f92a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.172+0000 7f279b633740 1 --2- 172.21.15.3:0/1881970551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5572c0f83c70 0x5572c0f92530 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.172+0000 7f2777400640 0 client.15879 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:01.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.172+0000 7f279b633740 1 -- 172.21.15.3:0/1881970551 >> 172.21.15.3:0/1881970551 conn(0x5572c0f80200 msgr2=0x5572c0f8a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:01.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.172+0000 7f279b633740 1 -- 172.21.15.3:0/1881970551 shutdown_connections 2024-09-19T06:15:01.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.172+0000 7f279b633740 1 -- 172.21.15.3:0/1881970551 wait complete. 2024-09-19T06:15:01.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.173+0000 7f279b633740 20 client.15879 trim_cache size 0 max 16384 2024-09-19T06:15:01.179 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:15:01.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.173+0000 7f2798a00640 1 -- 172.21.15.3:0/2499311297 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f27780a33b0 msgr2=0x7f27780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:01.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.173+0000 7f2798a00640 1 --2- 172.21.15.3:0/2499311297 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f27780a33b0 0x7f27780a5870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f278c0304e0 tx=0x7f278c005c50 comp rx=0 tx=0).stop 2024-09-19T06:15:01.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.173+0000 7f2798a00640 1 -- 172.21.15.3:0/2499311297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27941027a0 msgr2=0x7f279419ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:01.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.173+0000 7f2798a00640 1 --2- 172.21.15.3:0/2499311297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27941027a0 0x7f279419ab00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f277c00e9f0 tx=0x7f277c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.173+0000 7f2798a00640 1 -- 172.21.15.3:0/2499311297 shutdown_connections 2024-09-19T06:15:01.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.173+0000 7f2798a00640 1 --2- 172.21.15.3:0/2499311297 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f27780a33b0 0x7f27780a5870 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.173+0000 7f2798a00640 1 --2- 172.21.15.3:0/2499311297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2794106f20 0x7f279419ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.173+0000 7f2798a00640 1 --2- 172.21.15.3:0/2499311297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27941027a0 0x7f279419ab00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.173+0000 7f2798a00640 1 --2- 172.21.15.3:0/2499311297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2794101df0 0x7f279419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:01.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.173+0000 7f2798a00640 1 -- 172.21.15.3:0/2499311297 >> 172.21.15.3:0/2499311297 conn(0x7f27940fd8b0 msgr2=0x7f27940fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:01.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.173+0000 7f2798a00640 1 -- 172.21.15.3:0/2499311297 shutdown_connections 2024-09-19T06:15:01.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:01.173+0000 7f2798a00640 1 -- 172.21.15.3:0/2499311297 wait complete. 2024-09-19T06:15:02.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:01 smithi059 ceph-mon[35138]: pgmap v82: 97 pgs: 97 active+clean; 2.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T06:15:02.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:01 smithi003 ceph-mon[30893]: pgmap v82: 97 pgs: 97 active+clean; 2.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T06:15:02.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:01 smithi071 ceph-mon[35662]: pgmap v82: 97 pgs: 97 active+clean; 2.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T06:15:03.194 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:15:03.194 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:15:03.596 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:15:03.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.643+0000 7f6ce0c00640 1 -- 172.21.15.3:0/4133732236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cdc1048e0 msgr2=0x7f6cdc108920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:03.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.643+0000 7f6ce0c00640 1 --2- 172.21.15.3:0/4133732236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cdc1048e0 0x7f6cdc108920 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009860 tx=0x7f6cc802a340 comp rx=0 tx=0).stop 2024-09-19T06:15:03.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.643+0000 7f6ce0c00640 1 -- 172.21.15.3:0/4133732236 shutdown_connections 2024-09-19T06:15:03.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.643+0000 7f6ce0c00640 1 --2- 172.21.15.3:0/4133732236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cdc109080 0x7f6cdc110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.643+0000 7f6ce0c00640 1 --2- 172.21.15.3:0/4133732236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cdc1048e0 0x7f6cdc108920 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.643+0000 7f6ce0c00640 1 --2- 172.21.15.3:0/4133732236 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cdc103f30 0x7f6cdc104310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.643+0000 7f6ce0c00640 1 -- 172.21.15.3:0/4133732236 >> 172.21.15.3:0/4133732236 conn(0x7f6cdc0ff980 msgr2=0x7f6cdc101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:03.646 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.643+0000 7f6ce0c00640 1 -- 172.21.15.3:0/4133732236 shutdown_connections 2024-09-19T06:15:03.646 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.643+0000 7f6ce0c00640 1 -- 172.21.15.3:0/4133732236 wait complete. 2024-09-19T06:15:03.646 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.644+0000 7f6ce0c00640 1 Processor -- start 2024-09-19T06:15:03.646 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.644+0000 7f6ce0c00640 1 -- start start 2024-09-19T06:15:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.645+0000 7f6ce0c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cdc103f30 0x7f6cdc19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.645+0000 7f6ce0c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cdc109080 0x7f6cdc19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.645+0000 7f6ce0c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cdc19ef10 0x7f6cdc19f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.645+0000 7f6ce0c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc1140a0 con 0x7f6cdc103f30 2024-09-19T06:15:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.645+0000 7f6ce0c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc113f20 con 0x7f6cdc109080 2024-09-19T06:15:03.648 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.645+0000 7f6ce0c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc114220 con 0x7f6cdc19ef10 2024-09-19T06:15:03.648 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.645+0000 7f6cd9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cdc109080 0x7f6cdc19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:03.648 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.645+0000 7f6cda800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cdc19ef10 0x7f6cdc19f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:03.648 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.645+0000 7f6cd9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cdc109080 0x7f6cdc19ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:42682/0 (socket says 172.21.15.3:42682) 2024-09-19T06:15:03.648 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.645+0000 7f6cd9400640 1 -- 172.21.15.3:0/3782873796 learned_addr learned my addr 172.21.15.3:0/3782873796 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:03.648 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.646+0000 7f6cd9e00640 1 --2- 172.21.15.3:0/3782873796 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cdc103f30 0x7f6cdc19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.646+0000 7f6cd9400640 1 -- 172.21.15.3:0/3782873796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cdc19ef10 msgr2=0x7f6cdc19f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.646+0000 7f6cd9400640 1 --2- 172.21.15.3:0/3782873796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cdc19ef10 0x7f6cdc19f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.646+0000 7f6cd9400640 1 -- 172.21.15.3:0/3782873796 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cdc103f30 msgr2=0x7f6cdc19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.646+0000 7f6cd9400640 1 --2- 172.21.15.3:0/3782873796 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cdc103f30 0x7f6cdc19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.646+0000 7f6cd9400640 1 -- 172.21.15.3:0/3782873796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cdc19fa00 con 0x7f6cdc109080 2024-09-19T06:15:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.646+0000 7f6cd9e00640 1 --2- 172.21.15.3:0/3782873796 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cdc103f30 0x7f6cdc19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.646+0000 7f6cd9400640 1 --2- 172.21.15.3:0/3782873796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cdc109080 0x7f6cdc19ab90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8000c00 tx=0x7f6cc8033d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.647+0000 7f6cd2a00640 1 -- 172.21.15.3:0/3782873796 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc803f020 con 0x7f6cdc109080 2024-09-19T06:15:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.647+0000 7f6ce0c00640 1 -- 172.21.15.3:0/3782873796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cdc19fc90 con 0x7f6cdc109080 2024-09-19T06:15:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.647+0000 7f6ce0c00640 1 -- 172.21.15.3:0/3782873796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cdc076920 con 0x7f6cdc109080 2024-09-19T06:15:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.647+0000 7f6cd2a00640 1 -- 172.21.15.3:0/3782873796 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cc8032770 con 0x7f6cdc109080 2024-09-19T06:15:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.647+0000 7f6cd2a00640 1 -- 172.21.15.3:0/3782873796 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8037040 con 0x7f6cdc109080 2024-09-19T06:15:03.651 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.650+0000 7f6ce3c0f740 1 Processor -- start 2024-09-19T06:15:03.651 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.650+0000 7f6ce3c0f740 1 -- start start 2024-09-19T06:15:03.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.650+0000 7f6ce3c0f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c0d0e81e0 0x558c0d0e85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:03.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.650+0000 7f6ce3c0f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e8b00 0x558c0d0f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:03.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.650+0000 7f6ce3c0f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c0d0f33a0 0x558c0d0f5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:03.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.650+0000 7f6ce3c0f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558c0d04e100 con 0x558c0d0e8b00 2024-09-19T06:15:03.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.650+0000 7f6ce3c0f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558c0cff61b0 con 0x558c0d0e81e0 2024-09-19T06:15:03.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.650+0000 7f6ce3c0f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558c0d04a0c0 con 0x558c0d0f33a0 2024-09-19T06:15:03.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.650+0000 7f6cd2a00640 1 -- 172.21.15.3:0/3782873796 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f6cc8042020 con 0x7f6cdc109080 2024-09-19T06:15:03.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.650+0000 7f6cd9e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e8b00 0x558c0d0f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:03.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.651+0000 7f6cd9e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e8b00 0x558c0d0f2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56136/0 (socket says 172.21.15.3:56136) 2024-09-19T06:15:03.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.651+0000 7f6cd9400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c0d0f33a0 0x558c0d0f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:03.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.651+0000 7f6cd9e00640 1 -- 172.21.15.3:0/105951017 learned_addr learned my addr 172.21.15.3:0/105951017 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:03.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.651+0000 7f6cda800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c0d0e81e0 0x558c0d0e85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.651+0000 7f6cd9e00640 1 -- 172.21.15.3:0/105951017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c0d0f33a0 msgr2=0x558c0d0f5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.651+0000 7f6cd9e00640 1 --2- 172.21.15.3:0/105951017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c0d0f33a0 0x558c0d0f5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.651+0000 7f6cd9e00640 1 -- 172.21.15.3:0/105951017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c0d0e81e0 msgr2=0x558c0d0e85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.651+0000 7f6cd9e00640 1 --2- 172.21.15.3:0/105951017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c0d0e81e0 0x558c0d0e85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.651+0000 7f6cd9e00640 1 -- 172.21.15.3:0/105951017 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c0cd61210 con 0x558c0d0e8b00 2024-09-19T06:15:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.651+0000 7f6cda800640 1 --2- 172.21.15.3:0/105951017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c0d0e81e0 0x558c0d0e85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.651+0000 7f6cd9e00640 1 --2- 172.21.15.3:0/105951017 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e8b00 0x558c0d0f2e60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009d20 tx=0x7f6ccc0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd37d97ac672a46e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.651+0000 7f6cc7000640 1 -- 172.21.15.3:0/105951017 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc012650 con 0x558c0d0e8b00 2024-09-19T06:15:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.652+0000 7f6cc7000640 1 -- 172.21.15.3:0/105951017 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ccc009e10 con 0x558c0d0e8b00 2024-09-19T06:15:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.652+0000 7f6cc7000640 1 -- 172.21.15.3:0/105951017 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc00fd30 con 0x558c0d0e8b00 2024-09-19T06:15:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.652+0000 7f6cd2a00640 1 --2- 172.21.15.3:0/3782873796 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6cc00a3430 0x7f6cc00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.652+0000 7f6cd2a00640 1 -- 172.21.15.3:0/3782873796 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f6cc80ef660 con 0x7f6cdc109080 2024-09-19T06:15:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.652+0000 7f6cda800640 1 --2- 172.21.15.3:0/3782873796 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6cc00a3430 0x7f6cc00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.652+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/105951017 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e8b00 msgr2=0x558c0d0f2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.652+0000 7f6ce3c0f740 1 --2- 172.21.15.3:0/105951017 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e8b00 0x558c0d0f2e60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009d20 tx=0x7f6ccc0117b0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.653+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/105951017 shutdown_connections 2024-09-19T06:15:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.653+0000 7f6ce3c0f740 1 --2- 172.21.15.3:0/105951017 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c0d0f33a0 0x558c0d0f5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.653+0000 7f6ce3c0f740 1 --2- 172.21.15.3:0/105951017 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e8b00 0x558c0d0f2e60 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.653+0000 7f6ce3c0f740 1 --2- 172.21.15.3:0/105951017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c0d0e81e0 0x558c0d0e85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.653+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/105951017 >> 172.21.15.3:0/105951017 conn(0x558c0d0e4750 msgr2=0x558c0d0e4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.653+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/105951017 shutdown_connections 2024-09-19T06:15:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.653+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/105951017 wait complete. 2024-09-19T06:15:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.653+0000 7f6ce3c0f740 1 -- start start 2024-09-19T06:15:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.653+0000 7f6cda800640 1 --2- 172.21.15.3:0/3782873796 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6cc00a3430 0x7f6cc00a58f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4009d40 tx=0x7f6cd4009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.653+0000 7f6ce3c0f740 1 Processor -- start 2024-09-19T06:15:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.654+0000 7f6ce3c0f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e81e0 0x558c0d0f0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.654+0000 7f6ce3c0f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c0d0e8b00 0x558c0d0f08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.654+0000 7f6ce3c0f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c0d0f33a0 0x558c0d0f0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.654+0000 7f6ce3c0f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558c0d0f5f70 con 0x558c0d0e81e0 2024-09-19T06:15:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.654+0000 7f6ce3c0f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558c0cfd7090 con 0x558c0d0e8b00 2024-09-19T06:15:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.654+0000 7f6ce3c0f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558c0d0f60f0 con 0x558c0d0f33a0 2024-09-19T06:15:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.654+0000 7f6ce3c0f740 10 client.0 _ll_register_callbacks cb 0x558c0d02bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.654+0000 7f6cd9e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e81e0 0x558c0d0f0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.654+0000 7f6cd9e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e81e0 0x558c0d0f0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56150/0 (socket says 172.21.15.3:56150) 2024-09-19T06:15:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.654+0000 7f6cd9e00640 1 -- 172.21.15.3:0/1789271871 learned_addr learned my addr 172.21.15.3:0/1789271871 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.654+0000 7f6cda800640 1 --2- 172.21.15.3:0/1789271871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c0d0f33a0 0x558c0d0f0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.654+0000 7f6cd9400640 1 --2- 172.21.15.3:0/1789271871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c0d0e8b00 0x558c0d0f08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.655+0000 7f6cd9e00640 1 -- 172.21.15.3:0/1789271871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c0d0f33a0 msgr2=0x558c0d0f0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.655+0000 7f6cd9e00640 1 --2- 172.21.15.3:0/1789271871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c0d0f33a0 0x558c0d0f0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.655+0000 7f6cd9e00640 1 -- 172.21.15.3:0/1789271871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c0d0e8b00 msgr2=0x558c0d0f08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.655+0000 7f6cd9e00640 1 --2- 172.21.15.3:0/1789271871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c0d0e8b00 0x558c0d0f08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.655+0000 7f6cd9e00640 1 -- 172.21.15.3:0/1789271871 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c0ce2d620 con 0x558c0d0e81e0 2024-09-19T06:15:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.655+0000 7f6cd9e00640 1 --2- 172.21.15.3:0/1789271871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e81e0 0x558c0d0f0390 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00f950 tx=0x7f6ccc009a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414e20635b294f33 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.655+0000 7f6cbb400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:15:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.655+0000 7f6cbb400640 1 -- 172.21.15.3:0/1789271871 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc028020 con 0x558c0d0e81e0 2024-09-19T06:15:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.655+0000 7f6cbb400640 1 -- 172.21.15.3:0/1789271871 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f6ccc004250 con 0x558c0d0e81e0 2024-09-19T06:15:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.655+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/1789271871 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ccc009e10 con 0x558c0d0e81e0 2024-09-19T06:15:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.655+0000 7f6cbb400640 1 -- 172.21.15.3:0/1789271871 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6ccc033050 con 0x558c0d0e81e0 2024-09-19T06:15:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.656+0000 7f6ce3c0f740 10 client.15891 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.656+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/1789271871 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558c0d101b90 con 0x558c0d0e81e0 2024-09-19T06:15:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.656+0000 7f6cbb400640 1 -- 172.21.15.3:0/1789271871 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ccc009e10 con 0x558c0d0e81e0 2024-09-19T06:15:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.656+0000 7f6cbb400640 1 -- 172.21.15.3:0/1789271871 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6ccc004920 con 0x558c0d0e81e0 2024-09-19T06:15:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.656+0000 7f6ce3c0f740 10 client.15891 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.656+0000 7f6ce3c0f740 10 client.15891 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.656+0000 7f6ce3c0f740 20 client.15891 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.656+0000 7f6ce3c0f740 1 --2- 172.21.15.3:0/1789271871 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558c0d102ff0 0x558c0d1053e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.656+0000 7f6ce3c0f740 4 client.15891 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.656+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/1789271871 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c0d05b830 con 0x558c0d102ff0 2024-09-19T06:15:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.656+0000 7f6cd9400640 1 --2- 172.21.15.3:0/1789271871 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558c0d102ff0 0x558c0d1053e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.657+0000 7f6cd9400640 1 --2- 172.21.15.3:0/1789271871 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558c0d102ff0 0x558c0d1053e0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daef11da1f4169b9 server_cookie=33c8341bea8a1c82 in_seq=0 out_seq=0 2024-09-19T06:15:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.657+0000 7f6cbb400640 10 client.15891 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.658+0000 7f6cbb400640 1 -- 172.21.15.3:0/1789271871 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c0d05b830 con 0x558c0d102ff0 2024-09-19T06:15:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.658+0000 7f6cbb400640 10 client.15891 handle_command_reply: tid=0 2024-09-19T06:15:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.658+0000 7f6ce3c0f740 1 client.15891 shutdown 2024-09-19T06:15:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.658+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/1789271871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e81e0 msgr2=0x558c0d0f0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.658+0000 7f6ce3c0f740 1 --2- 172.21.15.3:0/1789271871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e81e0 0x558c0d0f0390 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00f950 tx=0x7f6ccc009a40 comp rx=0 tx=0).stop 2024-09-19T06:15:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.658+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/1789271871 shutdown_connections 2024-09-19T06:15:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.658+0000 7f6ce3c0f740 1 --2- 172.21.15.3:0/1789271871 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558c0d102ff0 0x558c0d1053e0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.658+0000 7f6ce3c0f740 1 --2- 172.21.15.3:0/1789271871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c0d0f33a0 0x558c0d0f0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.658+0000 7f6ce3c0f740 1 --2- 172.21.15.3:0/1789271871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c0d0e8b00 0x558c0d0f08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.658+0000 7f6cbb400640 0 client.15891 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.658+0000 7f6ce3c0f740 1 --2- 172.21.15.3:0/1789271871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e81e0 0x558c0d0f0390 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.658+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/1789271871 >> 172.21.15.3:0/1789271871 conn(0x558c0d0e4750 msgr2=0x558c0d0ea4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.658+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/1789271871 shutdown_connections 2024-09-19T06:15:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.658+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/1789271871 wait complete. 2024-09-19T06:15:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.658+0000 7f6ce3c0f740 20 client.15891 trim_cache size 0 max 16384 2024-09-19T06:15:03.676 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.674+0000 7f6ce3c0f740 1 Processor -- start 2024-09-19T06:15:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.674+0000 7f6ce3c0f740 1 -- start start 2024-09-19T06:15:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.674+0000 7f6ce3c0f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c0d0e81e0 0x558c0d10a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.674+0000 7f6ce3c0f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e8b00 0x558c0d10aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.674+0000 7f6ce3c0f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c0d0f33a0 0x558c0d0e9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.674+0000 7f6ce3c0f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc1b3f00 con 0x558c0d0e8b00 2024-09-19T06:15:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.674+0000 7f6ce3c0f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc1b5a40 con 0x558c0d0f33a0 2024-09-19T06:15:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.674+0000 7f6ce3c0f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc1b45d0 con 0x558c0d0e81e0 2024-09-19T06:15:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.674+0000 7f6cd9400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e8b00 0x558c0d10aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.674+0000 7f6cd9400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e8b00 0x558c0d10aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56166/0 (socket says 172.21.15.3:56166) 2024-09-19T06:15:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.674+0000 7f6cd9400640 1 -- 172.21.15.3:0/2250204235 learned_addr learned my addr 172.21.15.3:0/2250204235 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.674+0000 7f6cd9e00640 1 --2- 172.21.15.3:0/2250204235 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c0d0e81e0 0x558c0d10a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:03.677 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.675+0000 7f6cda800640 1 --2- 172.21.15.3:0/2250204235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c0d0f33a0 0x558c0d0e9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:03.678 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.675+0000 7f6cd9400640 1 -- 172.21.15.3:0/2250204235 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c0d0e81e0 msgr2=0x558c0d10a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:03.678 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.675+0000 7f6cd9400640 1 --2- 172.21.15.3:0/2250204235 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c0d0e81e0 0x558c0d10a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.678 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.675+0000 7f6cd9400640 1 -- 172.21.15.3:0/2250204235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c0d0f33a0 msgr2=0x558c0d0e9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:03.678 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.675+0000 7f6cd9400640 1 --2- 172.21.15.3:0/2250204235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c0d0f33a0 0x558c0d0e9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.678 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.675+0000 7f6cd9400640 1 -- 172.21.15.3:0/2250204235 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c0d0dfd60 con 0x558c0d0e8b00 2024-09-19T06:15:03.678 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.675+0000 7f6cd9400640 1 --2- 172.21.15.3:0/2250204235 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e8b00 0x558c0d10aec0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6cc80ecec0 tx=0x7f6cc80a6040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d2b4eec37e94c71 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.675+0000 7f6cc6600640 1 -- 172.21.15.3:0/2250204235 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc80bb530 con 0x558c0d0e8b00 2024-09-19T06:15:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.675+0000 7f6cc6600640 1 -- 172.21.15.3:0/2250204235 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cc80bc0f0 con 0x558c0d0e8b00 2024-09-19T06:15:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.675+0000 7f6cc6600640 1 -- 172.21.15.3:0/2250204235 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc80bb350 con 0x558c0d0e8b00 2024-09-19T06:15:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.676+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/2250204235 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e8b00 msgr2=0x558c0d10aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.676+0000 7f6ce3c0f740 1 --2- 172.21.15.3:0/2250204235 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e8b00 0x558c0d10aec0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6cc80ecec0 tx=0x7f6cc80a6040 comp rx=0 tx=0).stop 2024-09-19T06:15:03.681 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.676+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/2250204235 shutdown_connections 2024-09-19T06:15:03.682 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.676+0000 7f6ce3c0f740 1 --2- 172.21.15.3:0/2250204235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c0d0f33a0 0x558c0d0e9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.682 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.676+0000 7f6ce3c0f740 1 --2- 172.21.15.3:0/2250204235 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e8b00 0x558c0d10aec0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.682 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.676+0000 7f6ce3c0f740 1 --2- 172.21.15.3:0/2250204235 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c0d0e81e0 0x558c0d10a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.682 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.676+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/2250204235 >> 172.21.15.3:0/2250204235 conn(0x558c0d0e4750 msgr2=0x558c0d0e4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:03.682 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.676+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/2250204235 shutdown_connections 2024-09-19T06:15:03.682 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.676+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/2250204235 wait complete. 2024-09-19T06:15:03.682 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.676+0000 7f6ce3c0f740 1 -- start start 2024-09-19T06:15:03.682 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.677+0000 7f6ce3c0f740 1 Processor -- start 2024-09-19T06:15:03.682 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.677+0000 7f6ce3c0f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e81e0 0x558c0d0fb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:03.682 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.677+0000 7f6ce3c0f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c0d0e8b00 0x558c0d0fb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:03.682 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.677+0000 7f6ce3c0f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c0d0f33a0 0x558c0d0f6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:03.682 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.677+0000 7f6ce3c0f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc1b5370 con 0x558c0d0e81e0 2024-09-19T06:15:03.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.677+0000 7f6ce3c0f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc1b4ca0 con 0x558c0d0e8b00 2024-09-19T06:15:03.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.677+0000 7f6ce3c0f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6cdc1b1f00 con 0x558c0d0f33a0 2024-09-19T06:15:03.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.677+0000 7f6ce3c0f740 10 client.0 _ll_register_callbacks cb 0x7f6cd4009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:03.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.677+0000 7f6cd9e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e81e0 0x558c0d0fb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:03.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.677+0000 7f6cd9e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e81e0 0x558c0d0fb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56180/0 (socket says 172.21.15.3:56180) 2024-09-19T06:15:03.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.677+0000 7f6cd9e00640 1 -- 172.21.15.3:0/3608083321 learned_addr learned my addr 172.21.15.3:0/3608083321 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:03.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.677+0000 7f6cda800640 1 --2- 172.21.15.3:0/3608083321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c0d0f33a0 0x558c0d0f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:03.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.677+0000 7f6cd9400640 1 --2- 172.21.15.3:0/3608083321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c0d0e8b00 0x558c0d0fb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:03.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.678+0000 7f6cd9e00640 1 -- 172.21.15.3:0/3608083321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c0d0f33a0 msgr2=0x558c0d0f6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:03.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.678+0000 7f6cd9e00640 1 --2- 172.21.15.3:0/3608083321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c0d0f33a0 0x558c0d0f6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.678+0000 7f6cd9e00640 1 -- 172.21.15.3:0/3608083321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c0d0e8b00 msgr2=0x558c0d0fb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:03.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.678+0000 7f6cd9e00640 1 --2- 172.21.15.3:0/3608083321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c0d0e8b00 0x558c0d0fb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.678+0000 7f6cd9e00640 1 -- 172.21.15.3:0/3608083321 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c0d0f6f90 con 0x558c0d0e81e0 2024-09-19T06:15:03.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.678+0000 7f6cd9e00640 1 --2- 172.21.15.3:0/3608083321 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e81e0 0x558c0d0fb390 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009ab0 tx=0x7f6ccc005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a0959cf4fcef19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:03.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.678+0000 7f6cbb400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:15:03.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.678+0000 7f6cbb400640 1 -- 172.21.15.3:0/3608083321 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc028040 con 0x558c0d0e81e0 2024-09-19T06:15:03.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.678+0000 7f6cbb400640 1 -- 172.21.15.3:0/3608083321 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f6ccc00f440 con 0x558c0d0e81e0 2024-09-19T06:15:03.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.678+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/3608083321 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cc80bc0f0 con 0x558c0d0e81e0 2024-09-19T06:15:03.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.678+0000 7f6cbb400640 1 -- 172.21.15.3:0/3608083321 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6ccc047050 con 0x558c0d0e81e0 2024-09-19T06:15:03.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.678+0000 7f6ce3c0f740 10 client.15897 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:03.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.679+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/3608083321 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558c0d16d4e0 con 0x558c0d0e81e0 2024-09-19T06:15:03.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.679+0000 7f6cbb400640 1 -- 172.21.15.3:0/3608083321 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cc80bc0f0 con 0x558c0d0e81e0 2024-09-19T06:15:03.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.679+0000 7f6cbb400640 1 -- 172.21.15.3:0/3608083321 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6ccc005030 con 0x558c0d0e81e0 2024-09-19T06:15:03.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.679+0000 7f6ce3c0f740 10 client.15897 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:03.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.679+0000 7f6ce3c0f740 10 client.15897 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:03.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.679+0000 7f6ce3c0f740 20 client.15897 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:03.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.679+0000 7f6ce3c0f740 1 --2- 172.21.15.3:0/3608083321 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558c0d16dbf0 0x558c0d16ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:03.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.679+0000 7f6ce3c0f740 4 client.15897 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:15:03.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.679+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/3608083321 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558c0d055b80 con 0x558c0d16dbf0 2024-09-19T06:15:03.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.679+0000 7f6cd9400640 1 --2- 172.21.15.3:0/3608083321 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558c0d16dbf0 0x558c0d16ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:03.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.680+0000 7f6cd9400640 1 --2- 172.21.15.3:0/3608083321 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558c0d16dbf0 0x558c0d16ffe0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=728b1534c80ffe0f server_cookie=2f931dd108c94583 in_seq=0 out_seq=0 2024-09-19T06:15:03.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.680+0000 7f6cbb400640 10 client.15897 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.695+0000 7f6cbb400640 1 -- 172.21.15.3:0/3608083321 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558c0d055b80 con 0x558c0d16dbf0 2024-09-19T06:15:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.695+0000 7f6cbb400640 10 client.15897 handle_command_reply: tid=0 2024-09-19T06:15:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.695+0000 7f6ce3c0f740 1 client.15897 shutdown 2024-09-19T06:15:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.695+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/3608083321 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e81e0 msgr2=0x558c0d0fb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.695+0000 7f6ce3c0f740 1 --2- 172.21.15.3:0/3608083321 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e81e0 0x558c0d0fb390 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009ab0 tx=0x7f6ccc005fd0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.695+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/3608083321 shutdown_connections 2024-09-19T06:15:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.695+0000 7f6ce3c0f740 1 --2- 172.21.15.3:0/3608083321 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558c0d16dbf0 0x558c0d16ffe0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.695+0000 7f6ce3c0f740 1 --2- 172.21.15.3:0/3608083321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558c0d0f33a0 0x558c0d0f6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.695+0000 7f6cbb400640 0 client.15897 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.695+0000 7f6ce3c0f740 1 --2- 172.21.15.3:0/3608083321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558c0d0e8b00 0x558c0d0fb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.695+0000 7f6ce3c0f740 1 --2- 172.21.15.3:0/3608083321 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558c0d0e81e0 0x558c0d0fb390 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.695+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/3608083321 >> 172.21.15.3:0/3608083321 conn(0x558c0d0e4750 msgr2=0x558c0d0e9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.696+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/3608083321 shutdown_connections 2024-09-19T06:15:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.696+0000 7f6ce3c0f740 1 -- 172.21.15.3:0/3608083321 wait complete. 2024-09-19T06:15:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.696+0000 7f6ce3c0f740 20 client.15897 trim_cache size 0 max 16384 2024-09-19T06:15:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:15:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:15:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:15:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:15:03.700 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.696+0000 7f6ce0c00640 1 -- 172.21.15.3:0/3782873796 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6cc00a3430 msgr2=0x7f6cc00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:03.700 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.696+0000 7f6ce0c00640 1 --2- 172.21.15.3:0/3782873796 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6cc00a3430 0x7f6cc00a58f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4009d40 tx=0x7f6cd4009500 comp rx=0 tx=0).stop 2024-09-19T06:15:03.700 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.696+0000 7f6ce0c00640 1 -- 172.21.15.3:0/3782873796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cdc109080 msgr2=0x7f6cdc19ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:03.700 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.696+0000 7f6ce0c00640 1 --2- 172.21.15.3:0/3782873796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cdc109080 0x7f6cdc19ab90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8000c00 tx=0x7f6cc8033d10 comp rx=0 tx=0).stop 2024-09-19T06:15:03.701 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.697+0000 7f6ce0c00640 1 -- 172.21.15.3:0/3782873796 shutdown_connections 2024-09-19T06:15:03.701 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.697+0000 7f6ce0c00640 1 --2- 172.21.15.3:0/3782873796 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6cc00a3430 0x7f6cc00a58f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.701 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.697+0000 7f6ce0c00640 1 --2- 172.21.15.3:0/3782873796 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6cdc19ef10 0x7f6cdc19f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.701 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.697+0000 7f6ce0c00640 1 --2- 172.21.15.3:0/3782873796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cdc109080 0x7f6cdc19ab90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.701 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.697+0000 7f6ce0c00640 1 --2- 172.21.15.3:0/3782873796 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cdc103f30 0x7f6cdc19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:03.701 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.697+0000 7f6ce0c00640 1 -- 172.21.15.3:0/3782873796 >> 172.21.15.3:0/3782873796 conn(0x7f6cdc0ff980 msgr2=0x7f6cdc100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:03.701 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.697+0000 7f6ce0c00640 1 -- 172.21.15.3:0/3782873796 shutdown_connections 2024-09-19T06:15:03.701 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:03.697+0000 7f6ce0c00640 1 -- 172.21.15.3:0/3782873796 wait complete. 2024-09-19T06:15:04.042 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:03 smithi003 ceph-mon[30893]: pgmap v83: 97 pgs: 97 active+clean; 2.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T06:15:04.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.157+0000 7fc3ee000640 1 -- 172.21.15.3:0/2156311839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3e8109120 msgr2=0x7fc3e8110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:04.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.157+0000 7fc3ee000640 1 --2- 172.21.15.3:0/2156311839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3e8109120 0x7fc3e8110ca0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0009ca0 tx=0x7fc3e002a8b0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.157+0000 7fc3ee000640 1 -- 172.21.15.3:0/2156311839 shutdown_connections 2024-09-19T06:15:04.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.157+0000 7fc3ee000640 1 --2- 172.21.15.3:0/2156311839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3e8109120 0x7fc3e8110ca0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.157+0000 7fc3ee000640 1 --2- 172.21.15.3:0/2156311839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3e81049a0 0x7fc3e81089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.157+0000 7fc3ee000640 1 --2- 172.21.15.3:0/2156311839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3e8103ff0 0x7fc3e81043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.157+0000 7fc3ee000640 1 -- 172.21.15.3:0/2156311839 >> 172.21.15.3:0/2156311839 conn(0x7fc3e80ffa90 msgr2=0x7fc3e8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:04.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.157+0000 7fc3ee000640 1 -- 172.21.15.3:0/2156311839 shutdown_connections 2024-09-19T06:15:04.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.157+0000 7fc3ee000640 1 -- 172.21.15.3:0/2156311839 wait complete. 2024-09-19T06:15:04.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.158+0000 7fc3ee000640 1 Processor -- start 2024-09-19T06:15:04.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.158+0000 7fc3ee000640 1 -- start start 2024-09-19T06:15:04.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.158+0000 7fc3ee000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3e8103ff0 0x7fc3e819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:04.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.158+0000 7fc3ee000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3e81049a0 0x7fc3e819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:04.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.158+0000 7fc3ee000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3e8109120 0x7fc3e819ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:04.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.158+0000 7fc3ee000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e8114130 con 0x7fc3e8109120 2024-09-19T06:15:04.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.158+0000 7fc3ee000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e8113fb0 con 0x7fc3e81049a0 2024-09-19T06:15:04.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.158+0000 7fc3ee000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e81142b0 con 0x7fc3e8103ff0 2024-09-19T06:15:04.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.159+0000 7fc3e7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3e8109120 0x7fc3e819ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:04.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.159+0000 7fc3dfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3e81049a0 0x7fc3e819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:04.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.159+0000 7fc3dfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3e81049a0 0x7fc3e819aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:33670/0 (socket says 172.21.15.3:33670) 2024-09-19T06:15:04.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.159+0000 7fc3dfe00640 1 -- 172.21.15.3:0/1575852603 learned_addr learned my addr 172.21.15.3:0/1575852603 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:04.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.159+0000 7fc3e7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3e8109120 0x7fc3e819ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53518/0 (socket says 172.21.15.3:53518) 2024-09-19T06:15:04.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.159+0000 7fc3e7400640 1 --2- 172.21.15.3:0/1575852603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3e8103ff0 0x7fc3e819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:04.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.159+0000 7fc3dfe00640 1 -- 172.21.15.3:0/1575852603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3e8103ff0 msgr2=0x7fc3e819a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:04.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.159+0000 7fc3dfe00640 1 --2- 172.21.15.3:0/1575852603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3e8103ff0 0x7fc3e819a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.159+0000 7fc3dfe00640 1 -- 172.21.15.3:0/1575852603 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3e8109120 msgr2=0x7fc3e819ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:04.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.159+0000 7fc3dfe00640 1 --2- 172.21.15.3:0/1575852603 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3e8109120 0x7fc3e819ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.159+0000 7fc3dfe00640 1 -- 172.21.15.3:0/1575852603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e819f540 con 0x7fc3e81049a0 2024-09-19T06:15:04.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.159+0000 7fc3dfe00640 1 --2- 172.21.15.3:0/1575852603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3e81049a0 0x7fc3e819aad0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000e9f0 tx=0x7fc3d000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:04.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.160+0000 7fc3e4c00640 1 -- 172.21.15.3:0/1575852603 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d000cd80 con 0x7fc3e81049a0 2024-09-19T06:15:04.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.160+0000 7fc3ee000640 1 -- 172.21.15.3:0/1575852603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e819f830 con 0x7fc3e81049a0 2024-09-19T06:15:04.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.160+0000 7fc3e4c00640 1 -- 172.21.15.3:0/1575852603 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3d0010910 con 0x7fc3e81049a0 2024-09-19T06:15:04.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.160+0000 7fc3e4c00640 1 -- 172.21.15.3:0/1575852603 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d00188f0 con 0x7fc3e81049a0 2024-09-19T06:15:04.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.160+0000 7fc3ee000640 1 -- 172.21.15.3:0/1575852603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3e81a7110 con 0x7fc3e81049a0 2024-09-19T06:15:04.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.163+0000 7fc3f0c13740 1 Processor -- start 2024-09-19T06:15:04.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.163+0000 7fc3e4c00640 1 -- 172.21.15.3:0/1575852603 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fc3d0010ac0 con 0x7fc3e81049a0 2024-09-19T06:15:04.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.163+0000 7fc3f0c13740 1 -- start start 2024-09-19T06:15:04.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.163+0000 7fc3f0c13740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4ee3ac0 0x55b1f4ee3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:04.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.163+0000 7fc3f0c13740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b1f4ee43e0 0x55b1f4eee760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:04.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.163+0000 7fc3f0c13740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f4eeeca0 0x55b1f4ef1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:04.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.163+0000 7fc3f0c13740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b1f4e4a290 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.163+0000 7fc3f0c13740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b1f4df1b40 con 0x55b1f4eeeca0 2024-09-19T06:15:04.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.163+0000 7fc3f0c13740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b1f4e46250 con 0x55b1f4ee43e0 2024-09-19T06:15:04.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.164+0000 7fc3e7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4ee3ac0 0x55b1f4ee3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:04.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.164+0000 7fc3e7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4ee3ac0 0x55b1f4ee3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53524/0 (socket says 172.21.15.3:53524) 2024-09-19T06:15:04.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.164+0000 7fc3e7e00640 1 -- 172.21.15.3:0/763035320 learned_addr learned my addr 172.21.15.3:0/763035320 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:04.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.164+0000 7fc3e7400640 1 --2- 172.21.15.3:0/763035320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b1f4ee43e0 0x55b1f4eee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:04.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.164+0000 7fc3dfe00640 1 --2- 172.21.15.3:0/763035320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f4eeeca0 0x55b1f4ef1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:04.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.164+0000 7fc3e7e00640 1 -- 172.21.15.3:0/763035320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b1f4ee43e0 msgr2=0x55b1f4eee760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:04.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.164+0000 7fc3e7e00640 1 --2- 172.21.15.3:0/763035320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b1f4ee43e0 0x55b1f4eee760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.164+0000 7fc3e7e00640 1 -- 172.21.15.3:0/763035320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f4eeeca0 msgr2=0x55b1f4ef1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:04.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.164+0000 7fc3e7e00640 1 --2- 172.21.15.3:0/763035320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f4eeeca0 0x55b1f4ef1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.164+0000 7fc3e7e00640 1 -- 172.21.15.3:0/763035320 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1f4bbb6a0 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.164+0000 7fc3e4c00640 1 --2- 172.21.15.3:0/1575852603 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc3cc0a33b0 0x7fc3cc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:04.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.165+0000 7fc3e7e00640 1 --2- 172.21.15.3:0/763035320 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4ee3ac0 0x55b1f4ee3ea0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0004aa0 tx=0x7fc3e0005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2986184e1f339e70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:04.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.165+0000 7fc3e4c00640 1 -- 172.21.15.3:0/1575852603 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fc3d00d00e0 con 0x7fc3e81049a0 2024-09-19T06:15:04.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.165+0000 7fc3e7400640 1 --2- 172.21.15.3:0/1575852603 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc3cc0a33b0 0x7fc3cc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:04.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.165+0000 7fc3d7e00640 1 -- 172.21.15.3:0/763035320 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e00306e0 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.165+0000 7fc3d7e00640 1 -- 172.21.15.3:0/763035320 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3e0036030 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.165+0000 7fc3d7e00640 1 -- 172.21.15.3:0/763035320 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0004420 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.166+0000 7fc3f0c13740 1 -- 172.21.15.3:0/763035320 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4ee3ac0 msgr2=0x55b1f4ee3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:04.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.166+0000 7fc3e7400640 1 --2- 172.21.15.3:0/1575852603 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc3cc0a33b0 0x7fc3cc0a5870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55b1f4ee0eb0 tx=0x7fc3d800b390 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:04.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.166+0000 7fc3f0c13740 1 --2- 172.21.15.3:0/763035320 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4ee3ac0 0x55b1f4ee3ea0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0004aa0 tx=0x7fc3e0005ef0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.166+0000 7fc3f0c13740 1 -- 172.21.15.3:0/763035320 shutdown_connections 2024-09-19T06:15:04.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.166+0000 7fc3f0c13740 1 --2- 172.21.15.3:0/763035320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f4eeeca0 0x55b1f4ef1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.166+0000 7fc3f0c13740 1 --2- 172.21.15.3:0/763035320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b1f4ee43e0 0x55b1f4eee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.166+0000 7fc3f0c13740 1 --2- 172.21.15.3:0/763035320 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4ee3ac0 0x55b1f4ee3ea0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.166+0000 7fc3f0c13740 1 -- 172.21.15.3:0/763035320 >> 172.21.15.3:0/763035320 conn(0x55b1f4ee0050 msgr2=0x55b1f4ee0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:04.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.166+0000 7fc3f0c13740 1 -- 172.21.15.3:0/763035320 shutdown_connections 2024-09-19T06:15:04.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.166+0000 7fc3f0c13740 1 -- 172.21.15.3:0/763035320 wait complete. 2024-09-19T06:15:04.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.167+0000 7fc3f0c13740 1 -- start start 2024-09-19T06:15:04.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.167+0000 7fc3f0c13740 1 Processor -- start 2024-09-19T06:15:04.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.167+0000 7fc3f0c13740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4ee3ac0 0x55b1f4eee5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:04.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.167+0000 7fc3f0c13740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b1f4ee43e0 0x55b1f4eeb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:04.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.167+0000 7fc3f0c13740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f4eeeca0 0x55b1f4eebdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:04.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.167+0000 7fc3f0c13740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b1f4ef1910 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.167+0000 7fc3f0c13740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b1f4e04fa0 con 0x55b1f4eeeca0 2024-09-19T06:15:04.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.167+0000 7fc3f0c13740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b1f4ef1a90 con 0x55b1f4ee43e0 2024-09-19T06:15:04.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.167+0000 7fc3f0c13740 10 client.0 _ll_register_callbacks cb 0x55b1f4b58ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:04.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.168+0000 7fc3e7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4ee3ac0 0x55b1f4eee5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:04.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.168+0000 7fc3e7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4ee3ac0 0x55b1f4eee5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53532/0 (socket says 172.21.15.3:53532) 2024-09-19T06:15:04.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.168+0000 7fc3e7400640 1 -- 172.21.15.3:0/3179801480 learned_addr learned my addr 172.21.15.3:0/3179801480 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:04.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.168+0000 7fc3dfe00640 1 --2- 172.21.15.3:0/3179801480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b1f4ee43e0 0x55b1f4eeb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:04.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.168+0000 7fc3e7e00640 1 --2- 172.21.15.3:0/3179801480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f4eeeca0 0x55b1f4eebdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:04.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.168+0000 7fc3e7400640 1 -- 172.21.15.3:0/3179801480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b1f4ee43e0 msgr2=0x55b1f4eeb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:04.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.168+0000 7fc3e7400640 1 --2- 172.21.15.3:0/3179801480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b1f4ee43e0 0x55b1f4eeb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.168+0000 7fc3e7400640 1 -- 172.21.15.3:0/3179801480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f4eeeca0 msgr2=0x55b1f4eebdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:04.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.168+0000 7fc3e7400640 1 --2- 172.21.15.3:0/3179801480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f4eeeca0 0x55b1f4eebdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.168+0000 7fc3e7400640 1 -- 172.21.15.3:0/3179801480 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1f4eec5b0 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.168+0000 7fc3e7e00640 1 --2- 172.21.15.3:0/3179801480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f4eeeca0 0x55b1f4eebdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:04.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.169+0000 7fc3e7400640 1 --2- 172.21.15.3:0/3179801480 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4ee3ac0 0x55b1f4eee5c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8003d30 tx=0x7fc3d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6460ce848de20fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:04.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.169+0000 7fc3d4c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:15:04.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.169+0000 7fc3d4c00640 1 -- 172.21.15.3:0/3179801480 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d802c060 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.169+0000 7fc3d4c00640 1 -- 172.21.15.3:0/3179801480 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fc3d8017030 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.169+0000 7fc3f0c13740 1 -- 172.21.15.3:0/3179801480 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3e0036030 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.169+0000 7fc3d4c00640 1 -- 172.21.15.3:0/3179801480 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc3d8030410 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.169+0000 7fc3f0c13740 10 client.15909 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:04.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.169+0000 7fc3f0c13740 1 -- 172.21.15.3:0/3179801480 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b1f4efd8a0 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.169+0000 7fc3d4c00640 1 -- 172.21.15.3:0/3179801480 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3e0036030 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.170+0000 7fc3d4c00640 1 -- 172.21.15.3:0/3179801480 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc3d801c4d0 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.170+0000 7fc3f0c13740 10 client.15909 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:04.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.170+0000 7fc3f0c13740 10 client.15909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:04.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.170+0000 7fc3f0c13740 20 client.15909 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:04.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.170+0000 7fc3f0c13740 1 --2- 172.21.15.3:0/3179801480 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b1f4efed60 0x55b1f4f01150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:04.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.170+0000 7fc3f0c13740 4 client.15909 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:04.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.170+0000 7fc3f0c13740 1 -- 172.21.15.3:0/3179801480 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1f4e57800 con 0x55b1f4efed60 2024-09-19T06:15:04.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.170+0000 7fc3dfe00640 1 --2- 172.21.15.3:0/3179801480 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b1f4efed60 0x55b1f4f01150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:04.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.171+0000 7fc3dfe00640 1 --2- 172.21.15.3:0/3179801480 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b1f4efed60 0x55b1f4f01150 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6833c26b1b74a70f server_cookie=e0cdf9ebe271794d in_seq=0 out_seq=0 2024-09-19T06:15:04.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.171+0000 7fc3d4c00640 10 client.15909 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:04.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.172+0000 7fc3d4c00640 1 -- 172.21.15.3:0/3179801480 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b1f4e57800 con 0x55b1f4efed60 2024-09-19T06:15:04.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.172+0000 7fc3d4c00640 10 client.15909 handle_command_reply: tid=0 2024-09-19T06:15:04.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.172+0000 7fc3f0c13740 1 client.15909 shutdown 2024-09-19T06:15:04.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.172+0000 7fc3f0c13740 1 -- 172.21.15.3:0/3179801480 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4ee3ac0 msgr2=0x55b1f4eee5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:04.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.172+0000 7fc3f0c13740 1 --2- 172.21.15.3:0/3179801480 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4ee3ac0 0x55b1f4eee5c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8003d30 tx=0x7fc3d80046c0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.172+0000 7fc3f0c13740 1 -- 172.21.15.3:0/3179801480 shutdown_connections 2024-09-19T06:15:04.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.172+0000 7fc3f0c13740 1 --2- 172.21.15.3:0/3179801480 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b1f4efed60 0x55b1f4f01150 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.172+0000 7fc3f0c13740 1 --2- 172.21.15.3:0/3179801480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f4eeeca0 0x55b1f4eebdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.172+0000 7fc3f0c13740 1 --2- 172.21.15.3:0/3179801480 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b1f4ee43e0 0x55b1f4eeb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.172+0000 7fc3f0c13740 1 --2- 172.21.15.3:0/3179801480 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4ee3ac0 0x55b1f4eee5c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.172+0000 7fc3d4c00640 0 client.15909 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:04.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.172+0000 7fc3f0c13740 1 -- 172.21.15.3:0/3179801480 >> 172.21.15.3:0/3179801480 conn(0x55b1f4ee0050 msgr2=0x55b1f4edf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:04.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.173+0000 7fc3f0c13740 1 -- 172.21.15.3:0/3179801480 shutdown_connections 2024-09-19T06:15:04.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.173+0000 7fc3f0c13740 1 -- 172.21.15.3:0/3179801480 wait complete. 2024-09-19T06:15:04.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.173+0000 7fc3f0c13740 20 client.15909 trim_cache size 0 max 16384 2024-09-19T06:15:04.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.191+0000 7fc3f0c13740 1 Processor -- start 2024-09-19T06:15:04.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.191+0000 7fc3f0c13740 1 -- start start 2024-09-19T06:15:04.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.191+0000 7fc3f0c13740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f4ee3ac0 0x55b1f4ee5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:04.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.191+0000 7fc3f0c13740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4ee43e0 0x55b1f4f069b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:04.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.191+0000 7fc3f0c13740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b1f4eeeca0 0x55b1f4f06ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:04.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.191+0000 7fc3f0c13740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e81afa10 con 0x55b1f4ee43e0 2024-09-19T06:15:04.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.191+0000 7fc3f0c13740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e81b1550 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.191+0000 7fc3f0c13740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e81b00e0 con 0x55b1f4eeeca0 2024-09-19T06:15:04.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.192+0000 7fc3dfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4ee43e0 0x55b1f4f069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:04.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.192+0000 7fc3e7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f4ee3ac0 0x55b1f4ee5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:04.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.192+0000 7fc3dfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4ee43e0 0x55b1f4f069b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53544/0 (socket says 172.21.15.3:53544) 2024-09-19T06:15:04.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.192+0000 7fc3dfe00640 1 -- 172.21.15.3:0/1121858880 learned_addr learned my addr 172.21.15.3:0/1121858880 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:04.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.192+0000 7fc3e7e00640 1 --2- 172.21.15.3:0/1121858880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b1f4eeeca0 0x55b1f4f06ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:04.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.192+0000 7fc3e7400640 1 -- 172.21.15.3:0/1121858880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b1f4eeeca0 msgr2=0x55b1f4f06ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:04.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.192+0000 7fc3e7400640 1 --2- 172.21.15.3:0/1121858880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b1f4eeeca0 0x55b1f4f06ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.192+0000 7fc3e7400640 1 -- 172.21.15.3:0/1121858880 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4ee43e0 msgr2=0x55b1f4f069b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:04.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.192+0000 7fc3e7400640 1 --2- 172.21.15.3:0/1121858880 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4ee43e0 0x55b1f4f069b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.192+0000 7fc3e7400640 1 -- 172.21.15.3:0/1121858880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1f4f01780 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.192+0000 7fc3e7400640 1 --2- 172.21.15.3:0/1121858880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f4ee3ac0 0x55b1f4ee5c20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8018040 tx=0x7fc3d801cda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=843824e2731ce424 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:04.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.193+0000 7fc3d7400640 1 -- 172.21.15.3:0/1121858880 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d801c5f0 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.193+0000 7fc3d7400640 1 -- 172.21.15.3:0/1121858880 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3d8005510 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.193+0000 7fc3d7400640 1 -- 172.21.15.3:0/1121858880 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8004c60 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.193+0000 7fc3f0c13740 1 -- 172.21.15.3:0/1121858880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f4ee3ac0 msgr2=0x55b1f4ee5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:04.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.193+0000 7fc3f0c13740 1 --2- 172.21.15.3:0/1121858880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f4ee3ac0 0x55b1f4ee5c20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8018040 tx=0x7fc3d801cda0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.193+0000 7fc3f0c13740 1 -- 172.21.15.3:0/1121858880 shutdown_connections 2024-09-19T06:15:04.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.193+0000 7fc3f0c13740 1 --2- 172.21.15.3:0/1121858880 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b1f4eeeca0 0x55b1f4f06ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.193+0000 7fc3f0c13740 1 --2- 172.21.15.3:0/1121858880 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4ee43e0 0x55b1f4f069b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.193+0000 7fc3f0c13740 1 --2- 172.21.15.3:0/1121858880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f4ee3ac0 0x55b1f4ee5c20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.193+0000 7fc3f0c13740 1 -- 172.21.15.3:0/1121858880 >> 172.21.15.3:0/1121858880 conn(0x55b1f4ee0050 msgr2=0x55b1f4ee5510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:04.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.193+0000 7fc3f0c13740 1 -- 172.21.15.3:0/1121858880 shutdown_connections 2024-09-19T06:15:04.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.194+0000 7fc3f0c13740 1 -- 172.21.15.3:0/1121858880 wait complete. 2024-09-19T06:15:04.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.194+0000 7fc3f0c13740 1 -- start start 2024-09-19T06:15:04.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.194+0000 7fc3f0c13740 1 Processor -- start 2024-09-19T06:15:04.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.195+0000 7fc3f0c13740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b1f4ee3ac0 0x55b1f4ef2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:04.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.195+0000 7fc3f0c13740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f4ee43e0 0x55b1f4ef3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:04.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.195+0000 7fc3f0c13740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4eeeca0 0x55b1f4f68980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:04.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.195+0000 7fc3f0c13740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e81b0e80 con 0x55b1f4eeeca0 2024-09-19T06:15:04.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.195+0000 7fc3f0c13740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e81b07b0 con 0x55b1f4ee43e0 2024-09-19T06:15:04.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.195+0000 7fc3f0c13740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e81ad9f0 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.195+0000 7fc3f0c13740 10 client.0 _ll_register_callbacks cb 0x7fc3d8004320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:04.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.195+0000 7fc3dfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f4ee43e0 0x55b1f4ef3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:04.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.195+0000 7fc3e7400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b1f4ee3ac0 0x55b1f4ef2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:04.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.195+0000 7fc3e7400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b1f4ee3ac0 0x55b1f4ef2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:55646/0 (socket says 172.21.15.3:55646) 2024-09-19T06:15:04.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.195+0000 7fc3e7400640 1 -- 172.21.15.3:0/457291937 learned_addr learned my addr 172.21.15.3:0/457291937 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:04.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.195+0000 7fc3dfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f4ee43e0 0x55b1f4ef3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:33702/0 (socket says 172.21.15.3:33702) 2024-09-19T06:15:04.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.195+0000 7fc3e7e00640 1 --2- 172.21.15.3:0/457291937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4eeeca0 0x55b1f4f68980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:04.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.195+0000 7fc3e7400640 1 -- 172.21.15.3:0/457291937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f4ee43e0 msgr2=0x55b1f4ef3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:04.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.195+0000 7fc3e7400640 1 --2- 172.21.15.3:0/457291937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f4ee43e0 0x55b1f4ef3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.195+0000 7fc3e7400640 1 -- 172.21.15.3:0/457291937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4eeeca0 msgr2=0x55b1f4f68980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:04.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.195+0000 7fc3e7400640 1 --2- 172.21.15.3:0/457291937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4eeeca0 0x55b1f4f68980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.195+0000 7fc3e7400640 1 -- 172.21.15.3:0/457291937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1f4ef3c20 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.196+0000 7fc3e7400640 1 --2- 172.21.15.3:0/457291937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b1f4ee3ac0 0x55b1f4ef2de0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800bde0 tx=0x7fc3d8003a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=488101c0f93195c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:04.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.196+0000 7fc3d4c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:15:04.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.196+0000 7fc3d4c00640 1 -- 172.21.15.3:0/457291937 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8046060 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.196+0000 7fc3d4c00640 1 -- 172.21.15.3:0/457291937 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fc3d8005b90 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.196+0000 7fc3f0c13740 1 -- 172.21.15.3:0/457291937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3d8005510 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.196+0000 7fc3d4c00640 1 -- 172.21.15.3:0/457291937 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc3d80309c0 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.196+0000 7fc3f0c13740 10 client.25966 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:04.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.196+0000 7fc3f0c13740 1 -- 172.21.15.3:0/457291937 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b1f4f6a030 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.197+0000 7fc3d4c00640 1 -- 172.21.15.3:0/457291937 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3d8005510 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.197+0000 7fc3d4c00640 1 -- 172.21.15.3:0/457291937 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc3d8004ec0 con 0x55b1f4ee3ac0 2024-09-19T06:15:04.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.197+0000 7fc3f0c13740 10 client.25966 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:04.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.197+0000 7fc3f0c13740 10 client.25966 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:04.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.197+0000 7fc3f0c13740 20 client.25966 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:04.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.197+0000 7fc3f0c13740 1 --2- 172.21.15.3:0/457291937 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b1f4f6a690 0x55b1f4f6ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:04.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.197+0000 7fc3f0c13740 4 client.25966 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:15:04.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.197+0000 7fc3f0c13740 1 -- 172.21.15.3:0/457291937 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b1f4e51d10 con 0x55b1f4f6a690 2024-09-19T06:15:04.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.197+0000 7fc3dfe00640 1 --2- 172.21.15.3:0/457291937 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b1f4f6a690 0x55b1f4f6ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:04.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.198+0000 7fc3dfe00640 1 --2- 172.21.15.3:0/457291937 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b1f4f6a690 0x55b1f4f6ca80 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3f73c806970b8f8 server_cookie=e7aadac4e559cbb7 in_seq=0 out_seq=0 2024-09-19T06:15:04.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.198+0000 7fc3d4c00640 10 client.25966 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:04.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.199+0000 7fc3d4c00640 1 -- 172.21.15.3:0/457291937 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b1f4e51d10 con 0x55b1f4f6a690 2024-09-19T06:15:04.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.199+0000 7fc3d4c00640 10 client.25966 handle_command_reply: tid=0 2024-09-19T06:15:04.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.199+0000 7fc3f0c13740 1 client.25966 shutdown 2024-09-19T06:15:04.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.199+0000 7fc3f0c13740 1 -- 172.21.15.3:0/457291937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b1f4ee3ac0 msgr2=0x55b1f4ef2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:04.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.199+0000 7fc3f0c13740 1 --2- 172.21.15.3:0/457291937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b1f4ee3ac0 0x55b1f4ef2de0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800bde0 tx=0x7fc3d8003a90 comp rx=0 tx=0).stop 2024-09-19T06:15:04.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.199+0000 7fc3f0c13740 1 -- 172.21.15.3:0/457291937 shutdown_connections 2024-09-19T06:15:04.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.199+0000 7fc3f0c13740 1 --2- 172.21.15.3:0/457291937 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b1f4f6a690 0x55b1f4f6ca80 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.199+0000 7fc3f0c13740 1 --2- 172.21.15.3:0/457291937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b1f4eeeca0 0x55b1f4f68980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.199+0000 7fc3f0c13740 1 --2- 172.21.15.3:0/457291937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b1f4ee43e0 0x55b1f4ef3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.199+0000 7fc3f0c13740 1 --2- 172.21.15.3:0/457291937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b1f4ee3ac0 0x55b1f4ef2de0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.199+0000 7fc3d4c00640 0 client.25966 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:04.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.199+0000 7fc3f0c13740 1 -- 172.21.15.3:0/457291937 >> 172.21.15.3:0/457291937 conn(0x55b1f4ee0050 msgr2=0x55b1f4edf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:04.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.200+0000 7fc3f0c13740 1 -- 172.21.15.3:0/457291937 shutdown_connections 2024-09-19T06:15:04.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.200+0000 7fc3f0c13740 1 -- 172.21.15.3:0/457291937 wait complete. 2024-09-19T06:15:04.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.200+0000 7fc3f0c13740 20 client.25966 trim_cache size 0 max 16384 2024-09-19T06:15:04.209 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:15:04.210 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": 0, 2024-09-19T06:15:04.210 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_tag": "6d8ac05e-e5cf-4c62-bd35-616489952336", 2024-09-19T06:15:04.210 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": "asynchronous" 2024-09-19T06:15:04.210 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:15:04.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.200+0000 7fc3ee000640 1 -- 172.21.15.3:0/1575852603 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc3cc0a33b0 msgr2=0x7fc3cc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:04.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.200+0000 7fc3ee000640 1 --2- 172.21.15.3:0/1575852603 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc3cc0a33b0 0x7fc3cc0a5870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55b1f4ee0eb0 tx=0x7fc3d800b390 comp rx=0 tx=0).stop 2024-09-19T06:15:04.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.200+0000 7fc3ee000640 1 -- 172.21.15.3:0/1575852603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3e81049a0 msgr2=0x7fc3e819aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:04.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.200+0000 7fc3ee000640 1 --2- 172.21.15.3:0/1575852603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3e81049a0 0x7fc3e819aad0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000e9f0 tx=0x7fc3d000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.201+0000 7fc3ee000640 1 -- 172.21.15.3:0/1575852603 shutdown_connections 2024-09-19T06:15:04.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.201+0000 7fc3ee000640 1 --2- 172.21.15.3:0/1575852603 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc3cc0a33b0 0x7fc3cc0a5870 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.201+0000 7fc3ee000640 1 --2- 172.21.15.3:0/1575852603 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc3e8109120 0x7fc3e819ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.201+0000 7fc3ee000640 1 --2- 172.21.15.3:0/1575852603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3e81049a0 0x7fc3e819aad0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.201+0000 7fc3ee000640 1 --2- 172.21.15.3:0/1575852603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc3e8103ff0 0x7fc3e819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:04.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.201+0000 7fc3ee000640 1 -- 172.21.15.3:0/1575852603 >> 172.21.15.3:0/1575852603 conn(0x7fc3e80ffa90 msgr2=0x7fc3e8101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:04.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.201+0000 7fc3ee000640 1 -- 172.21.15.3:0/1575852603 shutdown_connections 2024-09-19T06:15:04.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:04.201+0000 7fc3ee000640 1 -- 172.21.15.3:0/1575852603 wait complete. 2024-09-19T06:15:04.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:03 smithi059 ceph-mon[35138]: pgmap v83: 97 pgs: 97 active+clean; 2.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T06:15:04.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:03 smithi071 ceph-mon[35662]: pgmap v83: 97 pgs: 97 active+clean; 2.8 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-19T06:15:05.461 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:15:05.842 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:15:06.224 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:05 smithi003 ceph-mon[30893]: scrub queued for path: / 2024-09-19T06:15:06.224 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:05 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:15:06.224 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:05 smithi003 ceph-mon[30893]: scrub summary: active paths [/] 2024-09-19T06:15:06.224 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:05 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:15:06.224 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:05 smithi003 ceph-mon[30893]: pgmap v84: 97 pgs: 97 active+clean; 2.9 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 54 KiB/s wr, 37 op/s 2024-09-19T06:15:06.224 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:05 smithi003 ceph-mon[30893]: scrub summary: idle 2024-09-19T06:15:06.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:05 smithi059 ceph-mon[35138]: scrub queued for path: / 2024-09-19T06:15:06.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:05 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:15:06.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:05 smithi059 ceph-mon[35138]: scrub summary: active paths [/] 2024-09-19T06:15:06.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:05 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:15:06.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:05 smithi059 ceph-mon[35138]: pgmap v84: 97 pgs: 97 active+clean; 2.9 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 54 KiB/s wr, 37 op/s 2024-09-19T06:15:06.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:05 smithi059 ceph-mon[35138]: scrub summary: idle 2024-09-19T06:15:06.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:05 smithi071 ceph-mon[35662]: scrub queued for path: / 2024-09-19T06:15:06.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:05 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:15:06.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:05 smithi071 ceph-mon[35662]: scrub summary: active paths [/] 2024-09-19T06:15:06.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:05 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:15:06.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:05 smithi071 ceph-mon[35662]: pgmap v84: 97 pgs: 97 active+clean; 2.9 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 54 KiB/s wr, 37 op/s 2024-09-19T06:15:06.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:05 smithi071 ceph-mon[35662]: scrub summary: idle 2024-09-19T06:15:06.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.449+0000 7f1de9400640 1 -- 172.21.15.3:0/2241256555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1de4077040 msgr2=0x7f1de4112510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:06.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.449+0000 7f1de9400640 1 --2- 172.21.15.3:0/2241256555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1de4077040 0x7f1de4112510 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009900 tx=0x7f1dcc02a400 comp rx=0 tx=0).stop 2024-09-19T06:15:06.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.449+0000 7f1de9400640 1 -- 172.21.15.3:0/2241256555 shutdown_connections 2024-09-19T06:15:06.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.449+0000 7f1de9400640 1 --2- 172.21.15.3:0/2241256555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1de4112a50 0x7f1de4114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.449+0000 7f1de9400640 1 --2- 172.21.15.3:0/2241256555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1de4077040 0x7f1de4112510 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.449+0000 7f1de9400640 1 --2- 172.21.15.3:0/2241256555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1de4076720 0x7f1de4076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.449+0000 7f1de9400640 1 -- 172.21.15.3:0/2241256555 >> 172.21.15.3:0/2241256555 conn(0x7f1de40ffa50 msgr2=0x7f1de4101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:06.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.449+0000 7f1de9400640 1 -- 172.21.15.3:0/2241256555 shutdown_connections 2024-09-19T06:15:06.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.449+0000 7f1de9400640 1 -- 172.21.15.3:0/2241256555 wait complete. 2024-09-19T06:15:06.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.450+0000 7f1de9400640 1 Processor -- start 2024-09-19T06:15:06.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.451+0000 7f1de9400640 1 -- start start 2024-09-19T06:15:06.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.451+0000 7f1de9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1de4076720 0x7f1de41a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:06.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.451+0000 7f1de9400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1de4077040 0x7f1de41a4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:06.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.451+0000 7f1de9400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1de4112a50 0x7f1de419e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:06.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.451+0000 7f1de9400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1de41185e0 con 0x7f1de4077040 2024-09-19T06:15:06.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.451+0000 7f1de9400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1de4118460 con 0x7f1de4076720 2024-09-19T06:15:06.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.451+0000 7f1de9400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1de4118760 con 0x7f1de4112a50 2024-09-19T06:15:06.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.451+0000 7f1ddbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1de4077040 0x7f1de41a4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:06.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.451+0000 7f1ddbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1de4077040 0x7f1de41a4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53576/0 (socket says 172.21.15.3:53576) 2024-09-19T06:15:06.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.451+0000 7f1ddbe00640 1 -- 172.21.15.3:0/2352974733 learned_addr learned my addr 172.21.15.3:0/2352974733 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:06.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.451+0000 7f1de2800640 1 --2- 172.21.15.3:0/2352974733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1de4076720 0x7f1de41a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:06.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.451+0000 7f1de3200640 1 --2- 172.21.15.3:0/2352974733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1de4112a50 0x7f1de419e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:06.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.452+0000 7f1ddbe00640 1 -- 172.21.15.3:0/2352974733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1de4112a50 msgr2=0x7f1de419e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:06.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.452+0000 7f1ddbe00640 1 --2- 172.21.15.3:0/2352974733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1de4112a50 0x7f1de419e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.452+0000 7f1ddbe00640 1 -- 172.21.15.3:0/2352974733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1de4076720 msgr2=0x7f1de41a4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:06.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.452+0000 7f1ddbe00640 1 --2- 172.21.15.3:0/2352974733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1de4076720 0x7f1de41a4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.452+0000 7f1ddbe00640 1 -- 172.21.15.3:0/2352974733 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de419f040 con 0x7f1de4077040 2024-09-19T06:15:06.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.452+0000 7f1de3200640 1 --2- 172.21.15.3:0/2352974733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1de4112a50 0x7f1de419e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:06.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.452+0000 7f1ddbe00640 1 --2- 172.21.15.3:0/2352974733 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1de4077040 0x7f1de41a4c90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc006010 tx=0x7f1dcc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:06.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.452+0000 7f1ddb400640 1 -- 172.21.15.3:0/2352974733 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc03f030 con 0x7f1de4077040 2024-09-19T06:15:06.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.453+0000 7f1ddb400640 1 -- 172.21.15.3:0/2352974733 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dcc003ce0 con 0x7f1de4077040 2024-09-19T06:15:06.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.453+0000 7f1de9400640 1 -- 172.21.15.3:0/2352974733 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1de419f2d0 con 0x7f1de4077040 2024-09-19T06:15:06.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.453+0000 7f1ddb400640 1 -- 172.21.15.3:0/2352974733 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc035070 con 0x7f1de4077040 2024-09-19T06:15:06.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.453+0000 7f1de9400640 1 -- 172.21.15.3:0/2352974733 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1de41ab620 con 0x7f1de4077040 2024-09-19T06:15:06.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.456+0000 7f1debde8740 1 Processor -- start 2024-09-19T06:15:06.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.456+0000 7f1ddb400640 1 -- 172.21.15.3:0/2352974733 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f1dcc042030 con 0x7f1de4077040 2024-09-19T06:15:06.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.456+0000 7f1debde8740 1 -- start start 2024-09-19T06:15:06.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.456+0000 7f1debde8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef020fb90 0x557ef020ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:06.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.456+0000 7f1debde8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef02104b0 0x557ef021a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:06.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.456+0000 7f1debde8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557ef021ad70 0x557ef021d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:06.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.456+0000 7f1debde8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557ef01763e0 con 0x557ef020fb90 2024-09-19T06:15:06.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.456+0000 7f1debde8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557ef011dd80 con 0x557ef02104b0 2024-09-19T06:15:06.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.456+0000 7f1debde8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557ef01723a0 con 0x557ef021ad70 2024-09-19T06:15:06.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.456+0000 7f1de3200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef020fb90 0x557ef020ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:06.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.457+0000 7f1de2800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef02104b0 0x557ef021a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:06.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.457+0000 7f1de3200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef020fb90 0x557ef020ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53584/0 (socket says 172.21.15.3:53584) 2024-09-19T06:15:06.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.457+0000 7f1de3200640 1 -- 172.21.15.3:0/925307498 learned_addr learned my addr 172.21.15.3:0/925307498 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:06.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.457+0000 7f1ddbe00640 1 --2- 172.21.15.3:0/925307498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557ef021ad70 0x557ef021d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:06.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.457+0000 7f1de2800640 1 -- 172.21.15.3:0/925307498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557ef021ad70 msgr2=0x557ef021d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:06.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.457+0000 7f1de2800640 1 --2- 172.21.15.3:0/925307498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557ef021ad70 0x557ef021d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.457+0000 7f1de2800640 1 -- 172.21.15.3:0/925307498 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef020fb90 msgr2=0x557ef020ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:06.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.457+0000 7f1de2800640 1 --2- 172.21.15.3:0/925307498 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef020fb90 0x557ef020ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.457+0000 7f1de2800640 1 -- 172.21.15.3:0/925307498 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ef013cae0 con 0x557ef02104b0 2024-09-19T06:15:06.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.457+0000 7f1de2800640 1 --2- 172.21.15.3:0/925307498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef02104b0 0x557ef021a830 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4005fd0 tx=0x7f1dd400bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ad6f0d9bf618a33 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:06.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.457+0000 7f1ddb400640 1 --2- 172.21.15.3:0/2352974733 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1dc80a3430 0x7f1dc80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:06.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.458+0000 7f1dd3400640 1 -- 172.21.15.3:0/925307498 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4003bd0 con 0x557ef02104b0 2024-09-19T06:15:06.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.458+0000 7f1dd3400640 1 -- 172.21.15.3:0/925307498 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dd4015070 con 0x557ef02104b0 2024-09-19T06:15:06.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.458+0000 7f1dd3400640 1 -- 172.21.15.3:0/925307498 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4004e20 con 0x557ef02104b0 2024-09-19T06:15:06.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.458+0000 7f1ddb400640 1 -- 172.21.15.3:0/2352974733 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f1dcc0f0230 con 0x7f1de4077040 2024-09-19T06:15:06.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.458+0000 7f1de3200640 1 --2- 172.21.15.3:0/2352974733 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1dc80a3430 0x7f1dc80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:06.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.458+0000 7f1debde8740 1 -- 172.21.15.3:0/925307498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef02104b0 msgr2=0x557ef021a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:06.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.458+0000 7f1debde8740 1 --2- 172.21.15.3:0/925307498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef02104b0 0x557ef021a830 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4005fd0 tx=0x7f1dd400bb20 comp rx=0 tx=0).stop 2024-09-19T06:15:06.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.459+0000 7f1debde8740 1 -- 172.21.15.3:0/925307498 shutdown_connections 2024-09-19T06:15:06.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.459+0000 7f1debde8740 1 --2- 172.21.15.3:0/925307498 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557ef021ad70 0x557ef021d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.459+0000 7f1debde8740 1 --2- 172.21.15.3:0/925307498 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef02104b0 0x557ef021a830 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.459+0000 7f1debde8740 1 --2- 172.21.15.3:0/925307498 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef020fb90 0x557ef020ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.459+0000 7f1debde8740 1 -- 172.21.15.3:0/925307498 >> 172.21.15.3:0/925307498 conn(0x557ef020c120 msgr2=0x557ef020c500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:06.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.459+0000 7f1de3200640 1 --2- 172.21.15.3:0/2352974733 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1dc80a3430 0x7f1dc80a58f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc009fd0 tx=0x7f1ddc009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:06.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.459+0000 7f1debde8740 1 -- 172.21.15.3:0/925307498 shutdown_connections 2024-09-19T06:15:06.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.459+0000 7f1debde8740 1 -- 172.21.15.3:0/925307498 wait complete. 2024-09-19T06:15:06.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.459+0000 7f1debde8740 1 -- start start 2024-09-19T06:15:06.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.459+0000 7f1debde8740 1 Processor -- start 2024-09-19T06:15:06.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.460+0000 7f1debde8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef020fb90 0x557ef0217bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:06.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.460+0000 7f1debde8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557ef02104b0 0x557ef02180f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:06.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.460+0000 7f1debde8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef021ad70 0x557ef0218630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:06.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.460+0000 7f1debde8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557ef021da30 con 0x557ef021ad70 2024-09-19T06:15:06.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.460+0000 7f1debde8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557ef01310f0 con 0x557ef020fb90 2024-09-19T06:15:06.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.460+0000 7f1debde8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557ef021dbb0 con 0x557ef02104b0 2024-09-19T06:15:06.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.460+0000 7f1debde8740 10 client.0 _ll_register_callbacks cb 0x557ef01229e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:06.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.460+0000 7f1de3200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef021ad70 0x557ef0218630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:06.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.460+0000 7f1de2800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef020fb90 0x557ef0217bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:06.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.460+0000 7f1ddbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557ef02104b0 0x557ef02180f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:06.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.460+0000 7f1de3200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef021ad70 0x557ef0218630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53598/0 (socket says 172.21.15.3:53598) 2024-09-19T06:15:06.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.460+0000 7f1de3200640 1 -- 172.21.15.3:0/1287882112 learned_addr learned my addr 172.21.15.3:0/1287882112 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:06.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.461+0000 7f1ddbe00640 1 -- 172.21.15.3:0/1287882112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef020fb90 msgr2=0x557ef0217bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:06.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.461+0000 7f1ddbe00640 1 --2- 172.21.15.3:0/1287882112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef020fb90 0x557ef0217bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.461+0000 7f1ddbe00640 1 -- 172.21.15.3:0/1287882112 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef021ad70 msgr2=0x557ef0218630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:06.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.461+0000 7f1ddbe00640 1 --2- 172.21.15.3:0/1287882112 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef021ad70 0x557ef0218630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.461+0000 7f1ddbe00640 1 -- 172.21.15.3:0/1287882112 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eefee73c0 con 0x557ef02104b0 2024-09-19T06:15:06.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.461+0000 7f1ddbe00640 1 --2- 172.21.15.3:0/1287882112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557ef02104b0 0x557ef02180f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc0ed920 tx=0x7f1dcc009230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2e641e7ea4b37b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:06.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.461+0000 7f1dc7e00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:15:06.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.461+0000 7f1dc7e00640 1 -- 172.21.15.3:0/1287882112 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc049070 con 0x557ef02104b0 2024-09-19T06:15:06.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.461+0000 7f1dc7e00640 1 -- 172.21.15.3:0/1287882112 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f1dcc0c4d50 con 0x557ef02104b0 2024-09-19T06:15:06.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.461+0000 7f1debde8740 1 -- 172.21.15.3:0/1287882112 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dd4015070 con 0x557ef02104b0 2024-09-19T06:15:06.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.462+0000 7f1dc7e00640 1 -- 172.21.15.3:0/1287882112 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1dcc0b88c0 con 0x557ef02104b0 2024-09-19T06:15:06.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.462+0000 7f1debde8740 10 client.25978 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:06.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.462+0000 7f1debde8740 1 -- 172.21.15.3:0/1287882112 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557ef021da30 con 0x557ef02104b0 2024-09-19T06:15:06.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.462+0000 7f1dc7e00640 1 -- 172.21.15.3:0/1287882112 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dd4015070 con 0x557ef02104b0 2024-09-19T06:15:06.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.462+0000 7f1dc7e00640 1 -- 172.21.15.3:0/1287882112 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f1dcc03bbb0 con 0x557ef02104b0 2024-09-19T06:15:06.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.462+0000 7f1debde8740 10 client.25978 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:06.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.462+0000 7f1debde8740 10 client.25978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:06.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.462+0000 7f1debde8740 20 client.25978 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:06.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.462+0000 7f1debde8740 1 --2- 172.21.15.3:0/1287882112 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x557ef022aad0 0x557ef022cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:06.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.462+0000 7f1debde8740 4 client.25978 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:06.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.462+0000 7f1debde8740 1 -- 172.21.15.3:0/1287882112 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ef0183950 con 0x557ef022aad0 2024-09-19T06:15:06.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.462+0000 7f1de2800640 1 --2- 172.21.15.3:0/1287882112 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x557ef022aad0 0x557ef022cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:06.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.463+0000 7f1de2800640 1 --2- 172.21.15.3:0/1287882112 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x557ef022aad0 0x557ef022cec0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64fa13ec287d360a server_cookie=2d591c19b523ddaf in_seq=0 out_seq=0 2024-09-19T06:15:06.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.463+0000 7f1dc7e00640 10 client.25978 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:06.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.464+0000 7f1dc7e00640 1 -- 172.21.15.3:0/1287882112 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557ef0183950 con 0x557ef022aad0 2024-09-19T06:15:06.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.464+0000 7f1dc7e00640 10 client.25978 handle_command_reply: tid=0 2024-09-19T06:15:06.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.464+0000 7f1debde8740 1 client.25978 shutdown 2024-09-19T06:15:06.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.464+0000 7f1debde8740 1 -- 172.21.15.3:0/1287882112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557ef02104b0 msgr2=0x557ef02180f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:06.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.464+0000 7f1debde8740 1 --2- 172.21.15.3:0/1287882112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557ef02104b0 0x557ef02180f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc0ed920 tx=0x7f1dcc009230 comp rx=0 tx=0).stop 2024-09-19T06:15:06.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.464+0000 7f1debde8740 1 -- 172.21.15.3:0/1287882112 shutdown_connections 2024-09-19T06:15:06.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.464+0000 7f1debde8740 1 --2- 172.21.15.3:0/1287882112 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x557ef022aad0 0x557ef022cec0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.464+0000 7f1debde8740 1 --2- 172.21.15.3:0/1287882112 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef021ad70 0x557ef0218630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.464+0000 7f1debde8740 1 --2- 172.21.15.3:0/1287882112 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557ef02104b0 0x557ef02180f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.464+0000 7f1debde8740 1 --2- 172.21.15.3:0/1287882112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef020fb90 0x557ef0217bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.464+0000 7f1debde8740 1 -- 172.21.15.3:0/1287882112 >> 172.21.15.3:0/1287882112 conn(0x557ef020c120 msgr2=0x557ef0211e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:06.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.464+0000 7f1dc7e00640 0 client.25978 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:06.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.465+0000 7f1debde8740 1 -- 172.21.15.3:0/1287882112 shutdown_connections 2024-09-19T06:15:06.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.465+0000 7f1debde8740 1 -- 172.21.15.3:0/1287882112 wait complete. 2024-09-19T06:15:06.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.465+0000 7f1debde8740 20 client.25978 trim_cache size 0 max 16384 2024-09-19T06:15:06.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.484+0000 7f1debde8740 1 Processor -- start 2024-09-19T06:15:06.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.484+0000 7f1debde8740 1 -- start start 2024-09-19T06:15:06.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.484+0000 7f1debde8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef020fb90 0x557ef02327d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:06.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.484+0000 7f1debde8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef02104b0 0x557ef0232d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:06.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.484+0000 7f1debde8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557ef021ad70 0x557ef020a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:06.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.484+0000 7f1debde8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1de41b3ed0 con 0x557ef020fb90 2024-09-19T06:15:06.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.484+0000 7f1debde8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1de41b5a10 con 0x557ef02104b0 2024-09-19T06:15:06.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.484+0000 7f1debde8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1de41b45a0 con 0x557ef021ad70 2024-09-19T06:15:06.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.485+0000 7f1de2800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef020fb90 0x557ef02327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:06.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.485+0000 7f1de2800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef020fb90 0x557ef02327d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53602/0 (socket says 172.21.15.3:53602) 2024-09-19T06:15:06.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.485+0000 7f1de2800640 1 -- 172.21.15.3:0/3598687013 learned_addr learned my addr 172.21.15.3:0/3598687013 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:06.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.485+0000 7f1de3200640 1 --2- 172.21.15.3:0/3598687013 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557ef021ad70 0x557ef020a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:06.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.485+0000 7f1ddbe00640 1 --2- 172.21.15.3:0/3598687013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef02104b0 0x557ef0232d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:06.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.485+0000 7f1de2800640 1 -- 172.21.15.3:0/3598687013 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557ef021ad70 msgr2=0x557ef020a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:06.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.485+0000 7f1de2800640 1 --2- 172.21.15.3:0/3598687013 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557ef021ad70 0x557ef020a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.485+0000 7f1de2800640 1 -- 172.21.15.3:0/3598687013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef02104b0 msgr2=0x557ef0232d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:06.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.485+0000 7f1de2800640 1 --2- 172.21.15.3:0/3598687013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef02104b0 0x557ef0232d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.485+0000 7f1de2800640 1 -- 172.21.15.3:0/3598687013 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ef020bf50 con 0x557ef020fb90 2024-09-19T06:15:06.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.485+0000 7f1de2800640 1 --2- 172.21.15.3:0/3598687013 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef020fb90 0x557ef02327d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4005fd0 tx=0x7f1dd4003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc0bc7f962c04f4b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:06.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.486+0000 7f1dd2a00640 1 -- 172.21.15.3:0/3598687013 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4011640 con 0x557ef020fb90 2024-09-19T06:15:06.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.486+0000 7f1dd2a00640 1 -- 172.21.15.3:0/3598687013 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dd4015070 con 0x557ef020fb90 2024-09-19T06:15:06.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.486+0000 7f1dd2a00640 1 -- 172.21.15.3:0/3598687013 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4019680 con 0x557ef020fb90 2024-09-19T06:15:06.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.486+0000 7f1debde8740 1 -- 172.21.15.3:0/3598687013 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef020fb90 msgr2=0x557ef02327d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:06.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.486+0000 7f1debde8740 1 --2- 172.21.15.3:0/3598687013 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef020fb90 0x557ef02327d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4005fd0 tx=0x7f1dd4003d60 comp rx=0 tx=0).stop 2024-09-19T06:15:06.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.487+0000 7f1debde8740 1 -- 172.21.15.3:0/3598687013 shutdown_connections 2024-09-19T06:15:06.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.487+0000 7f1debde8740 1 --2- 172.21.15.3:0/3598687013 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557ef021ad70 0x557ef020a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.487+0000 7f1debde8740 1 --2- 172.21.15.3:0/3598687013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef02104b0 0x557ef0232d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.487+0000 7f1debde8740 1 --2- 172.21.15.3:0/3598687013 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef020fb90 0x557ef02327d0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.487+0000 7f1debde8740 1 -- 172.21.15.3:0/3598687013 >> 172.21.15.3:0/3598687013 conn(0x557ef020c120 msgr2=0x557ef0216ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:06.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.487+0000 7f1debde8740 1 -- 172.21.15.3:0/3598687013 shutdown_connections 2024-09-19T06:15:06.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.487+0000 7f1debde8740 1 -- 172.21.15.3:0/3598687013 wait complete. 2024-09-19T06:15:06.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.487+0000 7f1debde8740 1 -- start start 2024-09-19T06:15:06.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.487+0000 7f1debde8740 1 Processor -- start 2024-09-19T06:15:06.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.488+0000 7f1debde8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef020fb90 0x557ef02234c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:06.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.488+0000 7f1debde8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557ef02104b0 0x557ef021e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:06.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.488+0000 7f1debde8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef021ad70 0x557ef021ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:06.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.488+0000 7f1debde8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1de41b5340 con 0x557ef020fb90 2024-09-19T06:15:06.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.488+0000 7f1debde8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1de41b4c70 con 0x557ef021ad70 2024-09-19T06:15:06.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.488+0000 7f1debde8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1de41b1eb0 con 0x557ef02104b0 2024-09-19T06:15:06.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.488+0000 7f1debde8740 10 client.0 _ll_register_callbacks cb 0x7f1dcc005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:06.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.488+0000 7f1de2800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef020fb90 0x557ef02234c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:06.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.488+0000 7f1de2800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef020fb90 0x557ef02234c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53612/0 (socket says 172.21.15.3:53612) 2024-09-19T06:15:06.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.488+0000 7f1de2800640 1 -- 172.21.15.3:0/1915779076 learned_addr learned my addr 172.21.15.3:0/1915779076 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:06.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.488+0000 7f1ddbe00640 1 --2- 172.21.15.3:0/1915779076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557ef02104b0 0x557ef021e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:06.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.488+0000 7f1de3200640 1 --2- 172.21.15.3:0/1915779076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef021ad70 0x557ef021ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:06.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.488+0000 7f1de2800640 1 -- 172.21.15.3:0/1915779076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557ef02104b0 msgr2=0x557ef021e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:06.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.488+0000 7f1de2800640 1 --2- 172.21.15.3:0/1915779076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557ef02104b0 0x557ef021e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.488+0000 7f1de2800640 1 -- 172.21.15.3:0/1915779076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef021ad70 msgr2=0x557ef021ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:06.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.488+0000 7f1de2800640 1 --2- 172.21.15.3:0/1915779076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef021ad70 0x557ef021ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.488+0000 7f1de2800640 1 -- 172.21.15.3:0/1915779076 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ef021f510 con 0x557ef020fb90 2024-09-19T06:15:06.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.489+0000 7f1ddbe00640 1 --2- 172.21.15.3:0/1915779076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557ef02104b0 0x557ef021e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:06.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.489+0000 7f1de2800640 1 --2- 172.21.15.3:0/1915779076 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef020fb90 0x557ef02234c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40039c0 tx=0x7f1dd400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ee511db2689895 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:06.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.489+0000 7f1dc7e00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:15:06.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.489+0000 7f1dc7e00640 1 -- 172.21.15.3:0/1915779076 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4037060 con 0x557ef020fb90 2024-09-19T06:15:06.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.489+0000 7f1debde8740 1 -- 172.21.15.3:0/1915779076 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dd4015070 con 0x557ef020fb90 2024-09-19T06:15:06.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.489+0000 7f1dc7e00640 1 -- 172.21.15.3:0/1915779076 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f1dd4011850 con 0x557ef020fb90 2024-09-19T06:15:06.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.489+0000 7f1dc7e00640 1 -- 172.21.15.3:0/1915779076 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1dd4011a50 con 0x557ef020fb90 2024-09-19T06:15:06.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.489+0000 7f1debde8740 10 client.15933 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:06.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.489+0000 7f1debde8740 1 -- 172.21.15.3:0/1915779076 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557ef0295700 con 0x557ef020fb90 2024-09-19T06:15:06.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.490+0000 7f1dc7e00640 1 -- 172.21.15.3:0/1915779076 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dd4015070 con 0x557ef020fb90 2024-09-19T06:15:06.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.490+0000 7f1dc7e00640 1 -- 172.21.15.3:0/1915779076 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f1dd4019b60 con 0x557ef020fb90 2024-09-19T06:15:06.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.490+0000 7f1debde8740 10 client.15933 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:06.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.490+0000 7f1debde8740 10 client.15933 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:06.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.490+0000 7f1debde8740 20 client.15933 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:06.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.490+0000 7f1debde8740 1 --2- 172.21.15.3:0/1915779076 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x557ef0295b70 0x557ef0297f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:06.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.490+0000 7f1debde8740 4 client.15933 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:15:06.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.490+0000 7f1debde8740 1 -- 172.21.15.3:0/1915779076 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557ef017de60 con 0x557ef0295b70 2024-09-19T06:15:06.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.490+0000 7f1ddbe00640 1 --2- 172.21.15.3:0/1915779076 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x557ef0295b70 0x557ef0297f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:06.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.491+0000 7f1ddbe00640 1 --2- 172.21.15.3:0/1915779076 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x557ef0295b70 0x557ef0297f60 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac10ded15ee85abf server_cookie=78a00829c2719e1e in_seq=0 out_seq=0 2024-09-19T06:15:06.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.491+0000 7f1dc7e00640 10 client.15933 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:06.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.491+0000 7f1dc7e00640 1 -- 172.21.15.3:0/1915779076 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557ef017de60 con 0x557ef0295b70 2024-09-19T06:15:06.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.491+0000 7f1dc7e00640 10 client.15933 handle_command_reply: tid=0 2024-09-19T06:15:06.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.491+0000 7f1debde8740 1 client.15933 shutdown 2024-09-19T06:15:06.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.491+0000 7f1debde8740 1 -- 172.21.15.3:0/1915779076 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef020fb90 msgr2=0x557ef02234c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:06.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.491+0000 7f1debde8740 1 --2- 172.21.15.3:0/1915779076 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef020fb90 0x557ef02234c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40039c0 tx=0x7f1dd400b390 comp rx=0 tx=0).stop 2024-09-19T06:15:06.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.491+0000 7f1debde8740 1 -- 172.21.15.3:0/1915779076 shutdown_connections 2024-09-19T06:15:06.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.491+0000 7f1debde8740 1 --2- 172.21.15.3:0/1915779076 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x557ef0295b70 0x557ef0297f60 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.491+0000 7f1debde8740 1 --2- 172.21.15.3:0/1915779076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557ef021ad70 0x557ef021ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.491+0000 7f1debde8740 1 --2- 172.21.15.3:0/1915779076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557ef02104b0 0x557ef021e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.491+0000 7f1debde8740 1 --2- 172.21.15.3:0/1915779076 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557ef020fb90 0x557ef02234c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.491+0000 7f1debde8740 1 -- 172.21.15.3:0/1915779076 >> 172.21.15.3:0/1915779076 conn(0x557ef020c120 msgr2=0x557ef0219410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:06.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.491+0000 7f1dc7e00640 0 client.15933 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:06.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.492+0000 7f1debde8740 1 -- 172.21.15.3:0/1915779076 shutdown_connections 2024-09-19T06:15:06.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.492+0000 7f1debde8740 1 -- 172.21.15.3:0/1915779076 wait complete. 2024-09-19T06:15:06.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.492+0000 7f1debde8740 20 client.15933 trim_cache size 0 max 16384 2024-09-19T06:15:06.497 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:15:06.497 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "no active scrubs running", 2024-09-19T06:15:06.498 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": {} 2024-09-19T06:15:06.498 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:15:06.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.492+0000 7f1de9400640 1 -- 172.21.15.3:0/2352974733 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1dc80a3430 msgr2=0x7f1dc80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:06.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.492+0000 7f1de9400640 1 --2- 172.21.15.3:0/2352974733 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1dc80a3430 0x7f1dc80a58f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc009fd0 tx=0x7f1ddc009500 comp rx=0 tx=0).stop 2024-09-19T06:15:06.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.492+0000 7f1de9400640 1 -- 172.21.15.3:0/2352974733 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1de4077040 msgr2=0x7f1de41a4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:06.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.492+0000 7f1de9400640 1 --2- 172.21.15.3:0/2352974733 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1de4077040 0x7f1de41a4c90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc006010 tx=0x7f1dcc0042f0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.493+0000 7f1de9400640 1 -- 172.21.15.3:0/2352974733 shutdown_connections 2024-09-19T06:15:06.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.493+0000 7f1de9400640 1 --2- 172.21.15.3:0/2352974733 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1dc80a3430 0x7f1dc80a58f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.493+0000 7f1de9400640 1 --2- 172.21.15.3:0/2352974733 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1de4112a50 0x7f1de419e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.493+0000 7f1de9400640 1 --2- 172.21.15.3:0/2352974733 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1de4077040 0x7f1de41a4c90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.493+0000 7f1de9400640 1 --2- 172.21.15.3:0/2352974733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1de4076720 0x7f1de41a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:06.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.493+0000 7f1de9400640 1 -- 172.21.15.3:0/2352974733 >> 172.21.15.3:0/2352974733 conn(0x7f1de40ffa50 msgr2=0x7f1de4101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:06.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.493+0000 7f1de9400640 1 -- 172.21.15.3:0/2352974733 shutdown_connections 2024-09-19T06:15:06.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:06.493+0000 7f1de9400640 1 -- 172.21.15.3:0/2352974733 wait complete. 2024-09-19T06:15:07.448 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:15:07.448 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:15:07.826 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:15:08.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:07 smithi059 ceph-mon[35138]: pgmap v85: 97 pgs: 97 active+clean; 2.9 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 41 KiB/s wr, 27 op/s 2024-09-19T06:15:08.296 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:07 smithi003 ceph-mon[30893]: pgmap v85: 97 pgs: 97 active+clean; 2.9 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 41 KiB/s wr, 27 op/s 2024-09-19T06:15:08.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:07 smithi071 ceph-mon[35662]: pgmap v85: 97 pgs: 97 active+clean; 2.9 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 41 KiB/s wr, 27 op/s 2024-09-19T06:15:08.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.407+0000 7fb116800640 1 -- 172.21.15.3:0/1161353408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1101079c0 msgr2=0x7fb110107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:08.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.407+0000 7fb116800640 1 --2- 172.21.15.3:0/1161353408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1101079c0 0x7fb110107da0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb104009930 tx=0x7fb10402a440 comp rx=0 tx=0).stop 2024-09-19T06:15:08.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.407+0000 7fb116800640 1 -- 172.21.15.3:0/1161353408 shutdown_connections 2024-09-19T06:15:08.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.407+0000 7fb116800640 1 --2- 172.21.15.3:0/1161353408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb110102360 0x7fb11010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:08.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.407+0000 7fb116800640 1 --2- 172.21.15.3:0/1161353408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb1101019c0 0x7fb110101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:08.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.407+0000 7fb116800640 1 --2- 172.21.15.3:0/1161353408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1101079c0 0x7fb110107da0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:08.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.407+0000 7fb116800640 1 -- 172.21.15.3:0/1161353408 >> 172.21.15.3:0/1161353408 conn(0x7fb1100fd740 msgr2=0x7fb1100ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:08.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.407+0000 7fb116800640 1 -- 172.21.15.3:0/1161353408 shutdown_connections 2024-09-19T06:15:08.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.407+0000 7fb116800640 1 -- 172.21.15.3:0/1161353408 wait complete. 2024-09-19T06:15:08.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.409+0000 7fb116800640 1 Processor -- start 2024-09-19T06:15:08.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.409+0000 7fb116800640 1 -- start start 2024-09-19T06:15:08.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.409+0000 7fb116800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1101019c0 0x7fb11019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:08.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.409+0000 7fb116800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb110102360 0x7fb11019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:08.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.409+0000 7fb116800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1101079c0 0x7fb11019edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:08.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.409+0000 7fb116800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb110111dc0 con 0x7fb1101019c0 2024-09-19T06:15:08.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.409+0000 7fb116800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb110111c40 con 0x7fb1101079c0 2024-09-19T06:15:08.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.409+0000 7fb116800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb110111f40 con 0x7fb110102360 2024-09-19T06:15:08.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.409+0000 7fb115400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1101019c0 0x7fb11019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:08.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.409+0000 7fb114a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb110102360 0x7fb11019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:08.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.410+0000 7fb115400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1101019c0 0x7fb11019a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53622/0 (socket says 172.21.15.3:53622) 2024-09-19T06:15:08.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.410+0000 7fb115400640 1 -- 172.21.15.3:0/2745632056 learned_addr learned my addr 172.21.15.3:0/2745632056 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:08.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.410+0000 7fb115e00640 1 --2- 172.21.15.3:0/2745632056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1101079c0 0x7fb11019edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:08.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.410+0000 7fb114a00640 1 -- 172.21.15.3:0/2745632056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1101079c0 msgr2=0x7fb11019edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:08.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.410+0000 7fb114a00640 1 --2- 172.21.15.3:0/2745632056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1101079c0 0x7fb11019edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:08.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.410+0000 7fb114a00640 1 -- 172.21.15.3:0/2745632056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1101019c0 msgr2=0x7fb11019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:08.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.410+0000 7fb114a00640 1 --2- 172.21.15.3:0/2745632056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1101019c0 0x7fb11019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:08.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.410+0000 7fb114a00640 1 -- 172.21.15.3:0/2745632056 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb11019f490 con 0x7fb110102360 2024-09-19T06:15:08.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.410+0000 7fb115e00640 1 --2- 172.21.15.3:0/2745632056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1101079c0 0x7fb11019edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:08.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.410+0000 7fb115400640 1 --2- 172.21.15.3:0/2745632056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1101019c0 0x7fb11019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:08.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.410+0000 7fb114a00640 1 --2- 172.21.15.3:0/2745632056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb110102360 0x7fb11019aa20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00e9f0 tx=0x7fb0fc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:08.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.411+0000 7fb10e000640 1 -- 172.21.15.3:0/2745632056 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc00ccc0 con 0x7fb110102360 2024-09-19T06:15:08.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.411+0000 7fb116800640 1 -- 172.21.15.3:0/2745632056 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb11019f780 con 0x7fb110102360 2024-09-19T06:15:08.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.411+0000 7fb10e000640 1 -- 172.21.15.3:0/2745632056 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0fc005020 con 0x7fb110102360 2024-09-19T06:15:08.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.411+0000 7fb10e000640 1 -- 172.21.15.3:0/2745632056 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc0049e0 con 0x7fb110102360 2024-09-19T06:15:08.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.411+0000 7fb116800640 1 -- 172.21.15.3:0/2745632056 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1101a7060 con 0x7fb110102360 2024-09-19T06:15:08.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.412+0000 7fb116800640 1 -- 172.21.15.3:0/2745632056 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb110101e20 con 0x7fb110102360 2024-09-19T06:15:08.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.414+0000 7fb10e000640 1 -- 172.21.15.3:0/2745632056 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fb0fc005560 con 0x7fb110102360 2024-09-19T06:15:08.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.416+0000 7fb10e000640 1 --2- 172.21.15.3:0/2745632056 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb0f80a3430 0x7fb0f80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:08.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.416+0000 7fb10e000640 1 -- 172.21.15.3:0/2745632056 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fb0fc0cfc50 con 0x7fb110102360 2024-09-19T06:15:08.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.416+0000 7fb115400640 1 --2- 172.21.15.3:0/2745632056 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb0f80a3430 0x7fb0f80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:08.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.417+0000 7fb115400640 1 --2- 172.21.15.3:0/2745632056 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb0f80a3430 0x7fb0f80a58f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb104000c00 tx=0x7fb104009560 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:08.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.419+0000 7fb10e000640 1 -- 172.21.15.3:0/2745632056 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb0fc0051d0 con 0x7fb110102360 2024-09-19T06:15:08.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.643+0000 7fb116800640 1 -- 172.21.15.3:0/2745632056 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1101a7390 con 0x7fb110102360 2024-09-19T06:15:08.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.644+0000 7fb10e000640 1 -- 172.21.15.3:0/2745632056 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7fb0fc09c5d0 con 0x7fb110102360 2024-09-19T06:15:08.647 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:15:08.647 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"btime":"2024-09-19T06:12:22:958217+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:12:22.060987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24532,24515,24514,14517]},"id":1}]} 2024-09-19T06:15:08.647 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2024-09-19T06:15:08.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.647+0000 7fb116800640 1 -- 172.21.15.3:0/2745632056 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb0f80a3430 msgr2=0x7fb0f80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:08.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.647+0000 7fb116800640 1 --2- 172.21.15.3:0/2745632056 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb0f80a3430 0x7fb0f80a58f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb104000c00 tx=0x7fb104009560 comp rx=0 tx=0).stop 2024-09-19T06:15:08.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.647+0000 7fb116800640 1 -- 172.21.15.3:0/2745632056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb110102360 msgr2=0x7fb11019aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:08.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.647+0000 7fb116800640 1 --2- 172.21.15.3:0/2745632056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb110102360 0x7fb11019aa20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00e9f0 tx=0x7fb0fc00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:15:08.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.647+0000 7fb116800640 1 -- 172.21.15.3:0/2745632056 shutdown_connections 2024-09-19T06:15:08.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.647+0000 7fb116800640 1 --2- 172.21.15.3:0/2745632056 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb0f80a3430 0x7fb0f80a58f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:08.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.647+0000 7fb116800640 1 --2- 172.21.15.3:0/2745632056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1101079c0 0x7fb11019edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:08.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.647+0000 7fb116800640 1 --2- 172.21.15.3:0/2745632056 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb110102360 0x7fb11019aa20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:08.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.647+0000 7fb116800640 1 --2- 172.21.15.3:0/2745632056 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1101019c0 0x7fb11019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:08.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.647+0000 7fb116800640 1 -- 172.21.15.3:0/2745632056 >> 172.21.15.3:0/2745632056 conn(0x7fb1100fd740 msgr2=0x7fb11010cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:08.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.647+0000 7fb116800640 1 -- 172.21.15.3:0/2745632056 shutdown_connections 2024-09-19T06:15:08.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:08.647+0000 7fb116800640 1 -- 172.21.15.3:0/2745632056 wait complete. 2024-09-19T06:15:09.241 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:08 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2745632056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:15:09.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:08 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2745632056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:15:09.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:08 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2745632056' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:15:09.715 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:15:10.094 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:15:10.262 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:09 smithi003 ceph-mon[30893]: pgmap v86: 97 pgs: 97 active+clean; 3.0 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 57 KiB/s wr, 38 op/s 2024-09-19T06:15:10.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:09 smithi059 ceph-mon[35138]: pgmap v86: 97 pgs: 97 active+clean; 3.0 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 57 KiB/s wr, 38 op/s 2024-09-19T06:15:10.543 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:09 smithi071 ceph-mon[35662]: pgmap v86: 97 pgs: 97 active+clean; 3.0 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 57 KiB/s wr, 38 op/s 2024-09-19T06:15:10.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.684+0000 7f6d79400640 1 -- 172.21.15.3:0/3107379602 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6d74101de0 msgr2=0x7f6d741021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:10.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.684+0000 7f6d79400640 1 --2- 172.21.15.3:0/3107379602 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6d74101de0 0x7f6d741021c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009900 tx=0x7f6d6402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.684+0000 7f6d79400640 1 -- 172.21.15.3:0/3107379602 shutdown_connections 2024-09-19T06:15:10.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.684+0000 7f6d79400640 1 --2- 172.21.15.3:0/3107379602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d74106f10 0x7f6d7410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.684+0000 7f6d79400640 1 --2- 172.21.15.3:0/3107379602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d74102790 0x7f6d741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.684+0000 7f6d79400640 1 --2- 172.21.15.3:0/3107379602 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6d74101de0 0x7f6d741021c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.684+0000 7f6d79400640 1 -- 172.21.15.3:0/3107379602 >> 172.21.15.3:0/3107379602 conn(0x7f6d740fd8c0 msgr2=0x7f6d740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:10.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.684+0000 7f6d79400640 1 -- 172.21.15.3:0/3107379602 shutdown_connections 2024-09-19T06:15:10.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.684+0000 7f6d79400640 1 -- 172.21.15.3:0/3107379602 wait complete. 2024-09-19T06:15:10.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.685+0000 7f6d79400640 1 Processor -- start 2024-09-19T06:15:10.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.686+0000 7f6d79400640 1 -- start start 2024-09-19T06:15:10.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.686+0000 7f6d79400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d74101de0 0x7f6d74198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:10.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.686+0000 7f6d79400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d74102790 0x7f6d74198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:10.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.686+0000 7f6d79400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6d74106f10 0x7f6d7419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:10.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.686+0000 7f6d79400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6d74111f30 con 0x7f6d74106f10 2024-09-19T06:15:10.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.686+0000 7f6d79400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6d74111db0 con 0x7f6d74102790 2024-09-19T06:15:10.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.686+0000 7f6d79400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6d741120b0 con 0x7f6d74101de0 2024-09-19T06:15:10.689 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.686+0000 7f6d72800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d74101de0 0x7f6d74198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.686+0000 7f6d72800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d74101de0 0x7f6d74198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:55750/0 (socket says 172.21.15.3:55750) 2024-09-19T06:15:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.686+0000 7f6d73200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6d74106f10 0x7f6d7419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.686+0000 7f6d72800640 1 -- 172.21.15.3:0/1804473545 learned_addr learned my addr 172.21.15.3:0/1804473545 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.686+0000 7f6d6be00640 1 --2- 172.21.15.3:0/1804473545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d74102790 0x7f6d74198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.687+0000 7f6d72800640 1 -- 172.21.15.3:0/1804473545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d74102790 msgr2=0x7f6d74198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.687+0000 7f6d72800640 1 --2- 172.21.15.3:0/1804473545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d74102790 0x7f6d74198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.687+0000 7f6d72800640 1 -- 172.21.15.3:0/1804473545 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6d74106f10 msgr2=0x7f6d7419ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.687+0000 7f6d72800640 1 --2- 172.21.15.3:0/1804473545 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6d74106f10 0x7f6d7419ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.687+0000 7f6d72800640 1 -- 172.21.15.3:0/1804473545 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d7419d4e0 con 0x7f6d74101de0 2024-09-19T06:15:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.687+0000 7f6d73200640 1 --2- 172.21.15.3:0/1804473545 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6d74106f10 0x7f6d7419ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.687+0000 7f6d72800640 1 --2- 172.21.15.3:0/1804473545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d74101de0 0x7f6d74198530 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6d64006010 tx=0x7f6d640042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.687+0000 7f6d6b400640 1 -- 172.21.15.3:0/1804473545 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6403f030 con 0x7f6d74101de0 2024-09-19T06:15:10.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.687+0000 7f6d79400640 1 -- 172.21.15.3:0/1804473545 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d7419d770 con 0x7f6d74101de0 2024-09-19T06:15:10.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.688+0000 7f6d6b400640 1 -- 172.21.15.3:0/1804473545 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d64003ce0 con 0x7f6d74101de0 2024-09-19T06:15:10.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.688+0000 7f6d6b400640 1 -- 172.21.15.3:0/1804473545 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d64035070 con 0x7f6d74101de0 2024-09-19T06:15:10.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.688+0000 7f6d79400640 1 -- 172.21.15.3:0/1804473545 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d741a50b0 con 0x7f6d74101de0 2024-09-19T06:15:10.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.691+0000 7f6d7bfe3740 1 Processor -- start 2024-09-19T06:15:10.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.692+0000 7f6d7bfe3740 1 -- start start 2024-09-19T06:15:10.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.692+0000 7f6d7bfe3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778525b50 0x555778525f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:10.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.692+0000 7f6d7bfe3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555778526470 0x555778534d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:10.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.692+0000 7f6d7bfe3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778535260 0x555778537650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:10.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.692+0000 7f6d7bfe3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55577848c3e0 con 0x555778535260 2024-09-19T06:15:10.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.692+0000 7f6d7bfe3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555778433d80 con 0x555778526470 2024-09-19T06:15:10.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.692+0000 7f6d7bfe3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5557784883a0 con 0x555778525b50 2024-09-19T06:15:10.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.692+0000 7f6d6be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778535260 0x555778537650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:10.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.692+0000 7f6d6b400640 1 -- 172.21.15.3:0/1804473545 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f6d64042030 con 0x7f6d74101de0 2024-09-19T06:15:10.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.692+0000 7f6d73200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778525b50 0x555778525f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:10.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.692+0000 7f6d6be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778535260 0x555778537650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53634/0 (socket says 172.21.15.3:53634) 2024-09-19T06:15:10.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.692+0000 7f6d6be00640 1 -- 172.21.15.3:0/4013746858 learned_addr learned my addr 172.21.15.3:0/4013746858 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:10.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.693+0000 7f6d73200640 1 -- 172.21.15.3:0/4013746858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555778526470 msgr2=0x555778534d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:10.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.693+0000 7f6d72800640 1 --2- 172.21.15.3:0/4013746858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555778526470 0x555778534d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:10.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.693+0000 7f6d73200640 1 --2- 172.21.15.3:0/4013746858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555778526470 0x555778534d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.693+0000 7f6d73200640 1 -- 172.21.15.3:0/4013746858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778535260 msgr2=0x555778537650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:10.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.693+0000 7f6d73200640 1 --2- 172.21.15.3:0/4013746858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778535260 0x555778537650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.693+0000 7f6d73200640 1 -- 172.21.15.3:0/4013746858 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555778452ae0 con 0x555778525b50 2024-09-19T06:15:10.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.693+0000 7f6d6be00640 1 --2- 172.21.15.3:0/4013746858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778535260 0x555778537650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:10.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.693+0000 7f6d72800640 1 --2- 172.21.15.3:0/4013746858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555778526470 0x555778534d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:15:10.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.693+0000 7f6d73200640 1 --2- 172.21.15.3:0/4013746858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778525b50 0x555778525f30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c010770 tx=0x7f6d6c010c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=feedb1acd2a4baa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:10.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.694+0000 7f6d63400640 1 -- 172.21.15.3:0/4013746858 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c003970 con 0x555778525b50 2024-09-19T06:15:10.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.694+0000 7f6d63400640 1 -- 172.21.15.3:0/4013746858 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d6c00e930 con 0x555778525b50 2024-09-19T06:15:10.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.694+0000 7f6d63400640 1 -- 172.21.15.3:0/4013746858 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c004600 con 0x555778525b50 2024-09-19T06:15:10.699 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.694+0000 7f6d6b400640 1 --2- 172.21.15.3:0/1804473545 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6d580a33b0 0x7f6d580a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:10.699 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.694+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/4013746858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778525b50 msgr2=0x555778525f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:10.699 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.694+0000 7f6d7bfe3740 1 --2- 172.21.15.3:0/4013746858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778525b50 0x555778525f30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c010770 tx=0x7f6d6c010c30 comp rx=0 tx=0).stop 2024-09-19T06:15:10.699 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.694+0000 7f6d6b400640 1 -- 172.21.15.3:0/1804473545 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f6d640f0390 con 0x7f6d74101de0 2024-09-19T06:15:10.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.695+0000 7f6d72800640 1 --2- 172.21.15.3:0/1804473545 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6d580a33b0 0x7f6d580a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:10.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.695+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/4013746858 shutdown_connections 2024-09-19T06:15:10.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.695+0000 7f6d7bfe3740 1 --2- 172.21.15.3:0/4013746858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778535260 0x555778537650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.695+0000 7f6d7bfe3740 1 --2- 172.21.15.3:0/4013746858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555778526470 0x555778534d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.695+0000 7f6d7bfe3740 1 --2- 172.21.15.3:0/4013746858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778525b50 0x555778525f30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.695+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/4013746858 >> 172.21.15.3:0/4013746858 conn(0x555778522200 msgr2=0x5557785225e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:10.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.695+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/4013746858 shutdown_connections 2024-09-19T06:15:10.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.695+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/4013746858 wait complete. 2024-09-19T06:15:10.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.695+0000 7f6d72800640 1 --2- 172.21.15.3:0/1804473545 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6d580a33b0 0x7f6d580a5870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x555778528860 tx=0x7f6d6402a3f0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:10.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.695+0000 7f6d7bfe3740 1 -- start start 2024-09-19T06:15:10.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.696+0000 7f6d7bfe3740 1 Processor -- start 2024-09-19T06:15:10.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.696+0000 7f6d7bfe3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778525b50 0x555778532180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:10.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.696+0000 7f6d7bfe3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778526470 0x5557785326c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:10.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.696+0000 7f6d7bfe3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555778535260 0x555778532c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:10.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.696+0000 7f6d7bfe3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x555778537e30 con 0x555778525b50 2024-09-19T06:15:10.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.696+0000 7f6d7bfe3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5557784470f0 con 0x555778535260 2024-09-19T06:15:10.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.696+0000 7f6d7bfe3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555778537fb0 con 0x555778526470 2024-09-19T06:15:10.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.696+0000 7f6d7bfe3740 10 client.0 _ll_register_callbacks cb 0x55577842ebd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:10.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.696+0000 7f6d73200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778525b50 0x555778532180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:10.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.696+0000 7f6d6be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778526470 0x5557785326c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:10.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.696+0000 7f6d73200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778525b50 0x555778532180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53650/0 (socket says 172.21.15.3:53650) 2024-09-19T06:15:10.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.696+0000 7f6d73200640 1 -- 172.21.15.3:0/465844405 learned_addr learned my addr 172.21.15.3:0/465844405 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:10.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.697+0000 7f6d73200640 1 --2- 172.21.15.3:0/465844405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555778535260 0x555778532c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:10.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.697+0000 7f6d6be00640 1 -- 172.21.15.3:0/465844405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555778535260 msgr2=0x555778532c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:10.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.697+0000 7f6d6be00640 1 --2- 172.21.15.3:0/465844405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555778535260 0x555778532c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.697+0000 7f6d6be00640 1 -- 172.21.15.3:0/465844405 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778525b50 msgr2=0x555778532180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:10.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.697+0000 7f6d6be00640 1 --2- 172.21.15.3:0/465844405 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778525b50 0x555778532180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.697+0000 7f6d6be00640 1 -- 172.21.15.3:0/465844405 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557781fd3c0 con 0x555778526470 2024-09-19T06:15:10.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.697+0000 7f6d73200640 1 --2- 172.21.15.3:0/465844405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555778535260 0x555778532c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:10.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.697+0000 7f6d6be00640 1 --2- 172.21.15.3:0/465844405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778526470 0x5557785326c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00baa0 tx=0x7f6d5c00bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27d057709ef88428 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:10.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.697+0000 7f6d57e00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:15:10.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.697+0000 7f6d57e00640 1 -- 172.21.15.3:0/465844405 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c005020 con 0x555778526470 2024-09-19T06:15:10.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.698+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/465844405 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d6c00e930 con 0x555778526470 2024-09-19T06:15:10.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.698+0000 7f6d57e00640 1 -- 172.21.15.3:0/465844405 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f6d5c0051c0 con 0x555778526470 2024-09-19T06:15:10.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.698+0000 7f6d57e00640 1 -- 172.21.15.3:0/465844405 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6d5c0053c0 con 0x555778526470 2024-09-19T06:15:10.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.698+0000 7f6d7bfe3740 10 client.26002 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:10.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.698+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/465844405 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555778543eb0 con 0x555778526470 2024-09-19T06:15:10.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.698+0000 7f6d57e00640 1 -- 172.21.15.3:0/465844405 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d6c00e930 con 0x555778526470 2024-09-19T06:15:10.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.699+0000 7f6d57e00640 1 -- 172.21.15.3:0/465844405 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6d5c01b630 con 0x555778526470 2024-09-19T06:15:10.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.699+0000 7f6d7bfe3740 10 client.26002 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:10.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.699+0000 7f6d7bfe3740 10 client.26002 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:15:10.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.699+0000 7f6d7bfe3740 20 client.26002 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:10.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.699+0000 7f6d7bfe3740 1 --2- 172.21.15.3:0/465844405 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x555778545370 0x555778547760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:10.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.699+0000 7f6d7bfe3740 4 client.26002 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:10.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.699+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/465844405 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555778499950 con 0x555778545370 2024-09-19T06:15:10.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.699+0000 7f6d73200640 1 --2- 172.21.15.3:0/465844405 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x555778545370 0x555778547760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:10.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.700+0000 7f6d73200640 1 --2- 172.21.15.3:0/465844405 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x555778545370 0x555778547760 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7b057a2f5d1d66aa server_cookie=cd784335ef2b72dc in_seq=0 out_seq=0 2024-09-19T06:15:10.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.700+0000 7f6d57e00640 10 client.26002 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:15:10.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.700+0000 7f6d57e00640 1 -- 172.21.15.3:0/465844405 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555778499950 con 0x555778545370 2024-09-19T06:15:10.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.700+0000 7f6d57e00640 10 client.26002 handle_command_reply: tid=0 2024-09-19T06:15:10.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.700+0000 7f6d7bfe3740 1 client.26002 shutdown 2024-09-19T06:15:10.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.700+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/465844405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778526470 msgr2=0x5557785326c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:10.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.700+0000 7f6d7bfe3740 1 --2- 172.21.15.3:0/465844405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778526470 0x5557785326c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00baa0 tx=0x7f6d5c00bf60 comp rx=0 tx=0).stop 2024-09-19T06:15:10.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.701+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/465844405 shutdown_connections 2024-09-19T06:15:10.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.701+0000 7f6d7bfe3740 1 --2- 172.21.15.3:0/465844405 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x555778545370 0x555778547760 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.701+0000 7f6d7bfe3740 1 --2- 172.21.15.3:0/465844405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555778535260 0x555778532c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.701+0000 7f6d7bfe3740 1 --2- 172.21.15.3:0/465844405 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778526470 0x5557785326c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.701+0000 7f6d7bfe3740 1 --2- 172.21.15.3:0/465844405 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778525b50 0x555778532180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.701+0000 7f6d57e00640 0 client.26002 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:15:10.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.701+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/465844405 >> 172.21.15.3:0/465844405 conn(0x555778522200 msgr2=0x555778527f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:10.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.701+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/465844405 shutdown_connections 2024-09-19T06:15:10.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.701+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/465844405 wait complete. 2024-09-19T06:15:10.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.701+0000 7f6d7bfe3740 20 client.26002 trim_cache size 0 max 16384 2024-09-19T06:15:10.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.715+0000 7f6d7bfe3740 1 Processor -- start 2024-09-19T06:15:10.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.715+0000 7f6d7bfe3740 1 -- start start 2024-09-19T06:15:10.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.715+0000 7f6d7bfe3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555778525b50 0x555778531a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:10.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.715+0000 7f6d7bfe3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778526470 0x55577854d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:10.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.715+0000 7f6d7bfe3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778535260 0x55577854d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:10.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.715+0000 7f6d7bfe3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6d741ab700 con 0x555778535260 2024-09-19T06:15:10.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.715+0000 7f6d7bfe3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6d741ad240 con 0x555778525b50 2024-09-19T06:15:10.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.715+0000 7f6d7bfe3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6d741abdd0 con 0x555778526470 2024-09-19T06:15:10.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.716+0000 7f6d73200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555778525b50 0x555778531a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:10.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.716+0000 7f6d73200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778535260 0x55577854d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:10.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.716+0000 7f6d6be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778526470 0x55577854d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:10.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.716+0000 7f6d73200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778535260 0x55577854d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53662/0 (socket says 172.21.15.3:53662) 2024-09-19T06:15:10.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.716+0000 7f6d6be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778526470 0x55577854d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:55770/0 (socket says 172.21.15.3:55770) 2024-09-19T06:15:10.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.716+0000 7f6d73200640 1 -- 172.21.15.3:0/2699439320 learned_addr learned my addr 172.21.15.3:0/2699439320 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:10.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.716+0000 7f6d6be00640 1 -- 172.21.15.3:0/2699439320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555778525b50 msgr2=0x555778531a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:10.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.716+0000 7f6d6be00640 1 --2- 172.21.15.3:0/2699439320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555778525b50 0x555778531a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.716+0000 7f6d6be00640 1 -- 172.21.15.3:0/2699439320 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778535260 msgr2=0x55577854d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:10.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.716+0000 7f6d6be00640 1 --2- 172.21.15.3:0/2699439320 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778535260 0x55577854d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.716+0000 7f6d6be00640 1 -- 172.21.15.3:0/2699439320 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555778531130 con 0x555778526470 2024-09-19T06:15:10.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.716+0000 7f6d73200640 1 --2- 172.21.15.3:0/2699439320 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778535260 0x55577854d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:10.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.716+0000 7f6d6be00640 1 --2- 172.21.15.3:0/2699439320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778526470 0x55577854d070 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c01bbc0 tx=0x7f6d5c0055e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=849bac997e54c470 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:10.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.717+0000 7f6d62a00640 1 -- 172.21.15.3:0/2699439320 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c028040 con 0x555778526470 2024-09-19T06:15:10.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.717+0000 7f6d62a00640 1 -- 172.21.15.3:0/2699439320 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d5c003eb0 con 0x555778526470 2024-09-19T06:15:10.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.717+0000 7f6d62a00640 1 -- 172.21.15.3:0/2699439320 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c011960 con 0x555778526470 2024-09-19T06:15:10.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.717+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/2699439320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778526470 msgr2=0x55577854d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:10.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.717+0000 7f6d7bfe3740 1 --2- 172.21.15.3:0/2699439320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778526470 0x55577854d070 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c01bbc0 tx=0x7f6d5c0055e0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.717+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/2699439320 shutdown_connections 2024-09-19T06:15:10.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.717+0000 7f6d7bfe3740 1 --2- 172.21.15.3:0/2699439320 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778535260 0x55577854d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.717+0000 7f6d7bfe3740 1 --2- 172.21.15.3:0/2699439320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778526470 0x55577854d070 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.717+0000 7f6d7bfe3740 1 --2- 172.21.15.3:0/2699439320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555778525b50 0x555778531a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.717+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/2699439320 >> 172.21.15.3:0/2699439320 conn(0x555778522200 msgr2=0x555778534200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:10.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.718+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/2699439320 shutdown_connections 2024-09-19T06:15:10.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.718+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/2699439320 wait complete. 2024-09-19T06:15:10.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.718+0000 7f6d7bfe3740 1 -- start start 2024-09-19T06:15:10.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.718+0000 7f6d7bfe3740 1 Processor -- start 2024-09-19T06:15:10.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.719+0000 7f6d7bfe3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778525b50 0x555778538f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:10.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.719+0000 7f6d7bfe3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778526470 0x555778539480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:10.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.719+0000 7f6d7bfe3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555778535260 0x5557785399c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:10.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.719+0000 7f6d7bfe3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6d741acb70 con 0x555778525b50 2024-09-19T06:15:10.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.719+0000 7f6d7bfe3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6d741ac4a0 con 0x555778535260 2024-09-19T06:15:10.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.719+0000 7f6d7bfe3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6d741a96e0 con 0x555778526470 2024-09-19T06:15:10.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.719+0000 7f6d7bfe3740 10 client.0 _ll_register_callbacks cb 0x7f6d5c004350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:10.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.719+0000 7f6d73200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778525b50 0x555778538f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:10.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.719+0000 7f6d73200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778525b50 0x555778538f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53666/0 (socket says 172.21.15.3:53666) 2024-09-19T06:15:10.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.719+0000 7f6d73200640 1 -- 172.21.15.3:0/1893181248 learned_addr learned my addr 172.21.15.3:0/1893181248 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:10.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.719+0000 7f6d6be00640 1 --2- 172.21.15.3:0/1893181248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778526470 0x555778539480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:10.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.719+0000 7f6d73200640 1 --2- 172.21.15.3:0/1893181248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555778535260 0x5557785399c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:10.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.720+0000 7f6d6be00640 1 -- 172.21.15.3:0/1893181248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555778535260 msgr2=0x5557785399c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:10.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.720+0000 7f6d6be00640 1 --2- 172.21.15.3:0/1893181248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555778535260 0x5557785399c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.720+0000 7f6d6be00640 1 -- 172.21.15.3:0/1893181248 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778525b50 msgr2=0x555778538f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:10.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.720+0000 7f6d6be00640 1 --2- 172.21.15.3:0/1893181248 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778525b50 0x555778538f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.720+0000 7f6d6be00640 1 -- 172.21.15.3:0/1893181248 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555778547ad0 con 0x555778526470 2024-09-19T06:15:10.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.720+0000 7f6d73200640 1 --2- 172.21.15.3:0/1893181248 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778525b50 0x555778538f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:10.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.720+0000 7f6d6be00640 1 --2- 172.21.15.3:0/1893181248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778526470 0x555778539480 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x555778516c50 tx=0x7f6d5c005920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf53b459237ebfd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:10.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.720+0000 7f6d57e00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:15:10.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.720+0000 7f6d57e00640 1 -- 172.21.15.3:0/1893181248 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c03a020 con 0x555778526470 2024-09-19T06:15:10.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.720+0000 7f6d57e00640 1 -- 172.21.15.3:0/1893181248 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f6d5c01b680 con 0x555778526470 2024-09-19T06:15:10.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.720+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/1893181248 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d5c003eb0 con 0x555778526470 2024-09-19T06:15:10.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.721+0000 7f6d57e00640 1 -- 172.21.15.3:0/1893181248 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6d5c028070 con 0x555778526470 2024-09-19T06:15:10.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.721+0000 7f6d7bfe3740 10 client.26008 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:10.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.721+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/1893181248 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5557785b00b0 con 0x555778526470 2024-09-19T06:15:10.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.721+0000 7f6d57e00640 1 -- 172.21.15.3:0/1893181248 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d5c003eb0 con 0x555778526470 2024-09-19T06:15:10.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.721+0000 7f6d57e00640 1 -- 172.21.15.3:0/1893181248 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6d5c02b070 con 0x555778526470 2024-09-19T06:15:10.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.721+0000 7f6d7bfe3740 10 client.26008 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:10.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.721+0000 7f6d7bfe3740 10 client.26008 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:15:10.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.721+0000 7f6d7bfe3740 20 client.26008 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:10.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.721+0000 7f6d7bfe3740 1 --2- 172.21.15.3:0/1893181248 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5557785b0700 0x5557785b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:10.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.721+0000 7f6d7bfe3740 4 client.26008 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:15:10.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.721+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/1893181248 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555778493e60 con 0x5557785b0700 2024-09-19T06:15:10.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.721+0000 7f6d73200640 1 --2- 172.21.15.3:0/1893181248 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5557785b0700 0x5557785b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:10.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.722+0000 7f6d57e00640 10 client.26008 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:15:10.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.722+0000 7f6d73200640 1 --2- 172.21.15.3:0/1893181248 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5557785b0700 0x5557785b2af0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a0978a4bf7954e3d server_cookie=c28aaad03181282a in_seq=0 out_seq=0 2024-09-19T06:15:10.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.722+0000 7f6d57e00640 1 -- 172.21.15.3:0/1893181248 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555778493e60 con 0x5557785b0700 2024-09-19T06:15:10.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.722+0000 7f6d57e00640 10 client.26008 handle_command_reply: tid=0 2024-09-19T06:15:10.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.722+0000 7f6d7bfe3740 1 client.26008 shutdown 2024-09-19T06:15:10.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.722+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/1893181248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778526470 msgr2=0x555778539480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:10.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.722+0000 7f6d7bfe3740 1 --2- 172.21.15.3:0/1893181248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778526470 0x555778539480 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x555778516c50 tx=0x7f6d5c005920 comp rx=0 tx=0).stop 2024-09-19T06:15:10.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.723+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/1893181248 shutdown_connections 2024-09-19T06:15:10.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.723+0000 7f6d7bfe3740 1 --2- 172.21.15.3:0/1893181248 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5557785b0700 0x5557785b2af0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.723+0000 7f6d7bfe3740 1 --2- 172.21.15.3:0/1893181248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555778535260 0x5557785399c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.723+0000 7f6d7bfe3740 1 --2- 172.21.15.3:0/1893181248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555778526470 0x555778539480 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.723+0000 7f6d7bfe3740 1 --2- 172.21.15.3:0/1893181248 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555778525b50 0x555778538f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.723+0000 7f6d57e00640 0 client.26008 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:15:10.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.723+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/1893181248 >> 172.21.15.3:0/1893181248 conn(0x555778522200 msgr2=0x555778520b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:10.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.723+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/1893181248 shutdown_connections 2024-09-19T06:15:10.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.723+0000 7f6d7bfe3740 1 -- 172.21.15.3:0/1893181248 wait complete. 2024-09-19T06:15:10.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.723+0000 7f6d7bfe3740 20 client.26008 trim_cache size 0 max 16384 2024-09-19T06:15:10.729 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:15:10.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.724+0000 7f6d79400640 1 -- 172.21.15.3:0/1804473545 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6d580a33b0 msgr2=0x7f6d580a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:10.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.724+0000 7f6d79400640 1 --2- 172.21.15.3:0/1804473545 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6d580a33b0 0x7f6d580a5870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x555778528860 tx=0x7f6d6402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.724+0000 7f6d79400640 1 -- 172.21.15.3:0/1804473545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d74101de0 msgr2=0x7f6d74198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:10.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.724+0000 7f6d79400640 1 --2- 172.21.15.3:0/1804473545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d74101de0 0x7f6d74198530 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6d64006010 tx=0x7f6d640042f0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.724+0000 7f6d79400640 1 -- 172.21.15.3:0/1804473545 shutdown_connections 2024-09-19T06:15:10.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.724+0000 7f6d79400640 1 --2- 172.21.15.3:0/1804473545 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6d580a33b0 0x7f6d580a5870 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.724+0000 7f6d79400640 1 --2- 172.21.15.3:0/1804473545 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6d74106f10 0x7f6d7419ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.724+0000 7f6d79400640 1 --2- 172.21.15.3:0/1804473545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d74102790 0x7f6d74198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.724+0000 7f6d79400640 1 --2- 172.21.15.3:0/1804473545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6d74101de0 0x7f6d74198530 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:10.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.724+0000 7f6d79400640 1 -- 172.21.15.3:0/1804473545 >> 172.21.15.3:0/1804473545 conn(0x7f6d740fd8c0 msgr2=0x7f6d740fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:10.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.724+0000 7f6d79400640 1 -- 172.21.15.3:0/1804473545 shutdown_connections 2024-09-19T06:15:10.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:10.724+0000 7f6d79400640 1 -- 172.21.15.3:0/1804473545 wait complete. 2024-09-19T06:15:11.804 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:15:12.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:11 smithi003 ceph-mon[30893]: pgmap v87: 97 pgs: 97 active+clean; 3.0 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 49 KiB/s wr, 32 op/s 2024-09-19T06:15:12.185 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:15:12.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:11 smithi059 ceph-mon[35138]: pgmap v87: 97 pgs: 97 active+clean; 3.0 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 49 KiB/s wr, 32 op/s 2024-09-19T06:15:12.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:11 smithi071 ceph-mon[35662]: pgmap v87: 97 pgs: 97 active+clean; 3.0 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 49 KiB/s wr, 32 op/s 2024-09-19T06:15:12.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.882+0000 7f0a6f200640 1 -- 172.21.15.3:0/2438460932 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a68101de0 msgr2=0x7f0a681021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:12.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.882+0000 7f0a6f200640 1 --2- 172.21.15.3:0/2438460932 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a68101de0 0x7f0a681021c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0a58009900 tx=0x7f0a5802a400 comp rx=0 tx=0).stop 2024-09-19T06:15:12.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.882+0000 7f0a6f200640 1 -- 172.21.15.3:0/2438460932 shutdown_connections 2024-09-19T06:15:12.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.882+0000 7f0a6f200640 1 --2- 172.21.15.3:0/2438460932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a68106f10 0x7f0a6810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.882+0000 7f0a6f200640 1 --2- 172.21.15.3:0/2438460932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a68102790 0x7f0a681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.882+0000 7f0a6f200640 1 --2- 172.21.15.3:0/2438460932 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a68101de0 0x7f0a681021c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.882+0000 7f0a6f200640 1 -- 172.21.15.3:0/2438460932 >> 172.21.15.3:0/2438460932 conn(0x7f0a680fd8c0 msgr2=0x7f0a680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:12.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.882+0000 7f0a6f200640 1 -- 172.21.15.3:0/2438460932 shutdown_connections 2024-09-19T06:15:12.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.882+0000 7f0a6f200640 1 -- 172.21.15.3:0/2438460932 wait complete. 2024-09-19T06:15:12.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.883+0000 7f0a6f200640 1 Processor -- start 2024-09-19T06:15:12.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.884+0000 7f0a6f200640 1 -- start start 2024-09-19T06:15:12.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.884+0000 7f0a6f200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a68101de0 0x7f0a6819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.884+0000 7f0a6f200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a68102790 0x7f0a6819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.884+0000 7f0a6f200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a68106f10 0x7f0a6819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.884+0000 7f0a6f200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0a68111f70 con 0x7f0a68102790 2024-09-19T06:15:12.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.884+0000 7f0a6f200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0a68111df0 con 0x7f0a68101de0 2024-09-19T06:15:12.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.884+0000 7f0a6f200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681120f0 con 0x7f0a68106f10 2024-09-19T06:15:12.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.884+0000 7f0a67e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a68101de0 0x7f0a6819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.884+0000 7f0a67400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a68102790 0x7f0a6819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.884+0000 7f0a67e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a68101de0 0x7f0a6819a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:33858/0 (socket says 172.21.15.3:33858) 2024-09-19T06:15:12.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.884+0000 7f0a67e00640 1 -- 172.21.15.3:0/1444505668 learned_addr learned my addr 172.21.15.3:0/1444505668 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:12.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.884+0000 7f0a6d200640 1 --2- 172.21.15.3:0/1444505668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a68106f10 0x7f0a6819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.885+0000 7f0a67e00640 1 -- 172.21.15.3:0/1444505668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a68106f10 msgr2=0x7f0a6819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:12.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.885+0000 7f0a67e00640 1 --2- 172.21.15.3:0/1444505668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a68106f10 0x7f0a6819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.885+0000 7f0a67e00640 1 -- 172.21.15.3:0/1444505668 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a68102790 msgr2=0x7f0a6819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:12.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.885+0000 7f0a67e00640 1 --2- 172.21.15.3:0/1444505668 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a68102790 0x7f0a6819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.885+0000 7f0a67e00640 1 -- 172.21.15.3:0/1444505668 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a6819f5d0 con 0x7f0a68101de0 2024-09-19T06:15:12.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.885+0000 7f0a67400640 1 --2- 172.21.15.3:0/1444505668 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a68102790 0x7f0a6819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:12.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.885+0000 7f0a6d200640 1 --2- 172.21.15.3:0/1444505668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a68106f10 0x7f0a6819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:12.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.885+0000 7f0a67e00640 1 --2- 172.21.15.3:0/1444505668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a68101de0 0x7f0a6819a620 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0a58006010 tx=0x7f0a580042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:12.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.885+0000 7f0a64c00640 1 -- 172.21.15.3:0/1444505668 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5803f030 con 0x7f0a68101de0 2024-09-19T06:15:12.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.886+0000 7f0a6f200640 1 -- 172.21.15.3:0/1444505668 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a6819f860 con 0x7f0a68101de0 2024-09-19T06:15:12.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.886+0000 7f0a64c00640 1 -- 172.21.15.3:0/1444505668 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a58003ce0 con 0x7f0a68101de0 2024-09-19T06:15:12.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.886+0000 7f0a64c00640 1 -- 172.21.15.3:0/1444505668 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a58035070 con 0x7f0a68101de0 2024-09-19T06:15:12.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.886+0000 7f0a6f200640 1 -- 172.21.15.3:0/1444505668 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a681a71a0 con 0x7f0a68101de0 2024-09-19T06:15:12.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.888+0000 7f0a71de6740 1 Processor -- start 2024-09-19T06:15:12.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.889+0000 7f0a71de6740 1 -- start start 2024-09-19T06:15:12.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.889+0000 7f0a71de6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812cbc70 0x55bd812cc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.889+0000 7f0a71de6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd812cc590 0x55bd812d6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.889+0000 7f0a71de6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd812d6e50 0x55bd812d9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.889+0000 7f0a71de6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bd812323e0 con 0x55bd812cc590 2024-09-19T06:15:12.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.889+0000 7f0a71de6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bd811d9d80 con 0x55bd812d6e50 2024-09-19T06:15:12.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.889+0000 7f0a71de6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bd8122e3a0 con 0x55bd812cbc70 2024-09-19T06:15:12.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.889+0000 7f0a64c00640 1 -- 172.21.15.3:0/1444505668 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f0a58042030 con 0x7f0a68101de0 2024-09-19T06:15:12.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.889+0000 7f0a6d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812cbc70 0x55bd812cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.889+0000 7f0a67e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd812cc590 0x55bd812d6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.889+0000 7f0a6d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812cbc70 0x55bd812cc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:55814/0 (socket says 172.21.15.3:55814) 2024-09-19T06:15:12.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.889+0000 7f0a6d200640 1 -- 172.21.15.3:0/3539748917 learned_addr learned my addr 172.21.15.3:0/3539748917 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:12.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.889+0000 7f0a67400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd812d6e50 0x55bd812d9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.890+0000 7f0a6d200640 1 -- 172.21.15.3:0/3539748917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd812d6e50 msgr2=0x55bd812d9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:12.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.890+0000 7f0a6d200640 1 --2- 172.21.15.3:0/3539748917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd812d6e50 0x55bd812d9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.890+0000 7f0a6d200640 1 -- 172.21.15.3:0/3539748917 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd812cc590 msgr2=0x55bd812d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:12.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.890+0000 7f0a6d200640 1 --2- 172.21.15.3:0/3539748917 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd812cc590 0x55bd812d6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.890+0000 7f0a6d200640 1 -- 172.21.15.3:0/3539748917 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd811f8ae0 con 0x55bd812cbc70 2024-09-19T06:15:12.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.890+0000 7f0a67400640 1 --2- 172.21.15.3:0/3539748917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd812d6e50 0x55bd812d9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:12.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.890+0000 7f0a6d200640 1 --2- 172.21.15.3:0/3539748917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812cbc70 0x55bd812cc050 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0a60010710 tx=0x7f0a60010bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc81a71355fc14b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:12.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.890+0000 7f0a5d600640 1 -- 172.21.15.3:0/3539748917 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6000e8d0 con 0x55bd812cbc70 2024-09-19T06:15:12.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.891+0000 7f0a5d600640 1 -- 172.21.15.3:0/3539748917 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a60012450 con 0x55bd812cbc70 2024-09-19T06:15:12.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.891+0000 7f0a5d600640 1 -- 172.21.15.3:0/3539748917 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6001c670 con 0x55bd812cbc70 2024-09-19T06:15:12.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.891+0000 7f0a64c00640 1 --2- 172.21.15.3:0/1444505668 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0a4c0a33b0 0x7f0a4c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.891+0000 7f0a64c00640 1 -- 172.21.15.3:0/1444505668 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f0a580f0390 con 0x7f0a68101de0 2024-09-19T06:15:12.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.891+0000 7f0a67e00640 1 --2- 172.21.15.3:0/1444505668 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0a4c0a33b0 0x7f0a4c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.891+0000 7f0a71de6740 1 -- 172.21.15.3:0/3539748917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812cbc70 msgr2=0x55bd812cc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:12.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.891+0000 7f0a71de6740 1 --2- 172.21.15.3:0/3539748917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812cbc70 0x55bd812cc050 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0a60010710 tx=0x7f0a60010bd0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.891+0000 7f0a71de6740 1 -- 172.21.15.3:0/3539748917 shutdown_connections 2024-09-19T06:15:12.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.891+0000 7f0a71de6740 1 --2- 172.21.15.3:0/3539748917 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd812d6e50 0x55bd812d9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.891+0000 7f0a71de6740 1 --2- 172.21.15.3:0/3539748917 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd812cc590 0x55bd812d6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.891+0000 7f0a71de6740 1 --2- 172.21.15.3:0/3539748917 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812cbc70 0x55bd812cc050 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.891+0000 7f0a71de6740 1 -- 172.21.15.3:0/3539748917 >> 172.21.15.3:0/3539748917 conn(0x55bd812c8200 msgr2=0x55bd812c85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:12.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.891+0000 7f0a71de6740 1 -- 172.21.15.3:0/3539748917 shutdown_connections 2024-09-19T06:15:12.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.892+0000 7f0a71de6740 1 -- 172.21.15.3:0/3539748917 wait complete. 2024-09-19T06:15:12.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.892+0000 7f0a67e00640 1 --2- 172.21.15.3:0/1444505668 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0a4c0a33b0 0x7f0a4c0a5870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0a580f3fd0 tx=0x7f0a580f3e40 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:12.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.892+0000 7f0a71de6740 1 -- start start 2024-09-19T06:15:12.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.892+0000 7f0a71de6740 1 Processor -- start 2024-09-19T06:15:12.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.893+0000 7f0a71de6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd812cbc70 0x55bd812d3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.893+0000 7f0a71de6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812cc590 0x55bd812d4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.893+0000 7f0a71de6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd812d6e50 0x55bd812d47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.893+0000 7f0a71de6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bd812d9a20 con 0x55bd812d6e50 2024-09-19T06:15:12.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.893+0000 7f0a71de6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bd811ed0f0 con 0x55bd812cbc70 2024-09-19T06:15:12.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.893+0000 7f0a71de6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bd812d9ba0 con 0x55bd812cc590 2024-09-19T06:15:12.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.893+0000 7f0a71de6740 10 client.0 _ll_register_callbacks cb 0x55bd811d4bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:12.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.893+0000 7f0a67400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812cc590 0x55bd812d4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.893+0000 7f0a6d200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd812d6e50 0x55bd812d47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.893+0000 7f0a67400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812cc590 0x55bd812d4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:55830/0 (socket says 172.21.15.3:55830) 2024-09-19T06:15:12.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.893+0000 7f0a67400640 1 -- 172.21.15.3:0/1353060027 learned_addr learned my addr 172.21.15.3:0/1353060027 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:12.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.893+0000 7f0a6d200640 1 --2- 172.21.15.3:0/1353060027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd812cbc70 0x55bd812d3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.893+0000 7f0a67400640 1 -- 172.21.15.3:0/1353060027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd812cbc70 msgr2=0x55bd812d3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:12.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.893+0000 7f0a67400640 1 --2- 172.21.15.3:0/1353060027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd812cbc70 0x55bd812d3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.893+0000 7f0a67400640 1 -- 172.21.15.3:0/1353060027 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd812d6e50 msgr2=0x55bd812d47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:12.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.893+0000 7f0a67400640 1 --2- 172.21.15.3:0/1353060027 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd812d6e50 0x55bd812d47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.893+0000 7f0a67400640 1 -- 172.21.15.3:0/1353060027 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd80fa33c0 con 0x55bd812cc590 2024-09-19T06:15:12.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.894+0000 7f0a67400640 1 --2- 172.21.15.3:0/1353060027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812cc590 0x55bd812d4260 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0a54011770 tx=0x7f0a54011c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdf459a972867788 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:12.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.894+0000 7f0a52000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:15:12.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.894+0000 7f0a52000640 1 -- 172.21.15.3:0/1353060027 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5401f060 con 0x55bd812cc590 2024-09-19T06:15:12.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.894+0000 7f0a71de6740 1 -- 172.21.15.3:0/1353060027 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a60012450 con 0x55bd812cc590 2024-09-19T06:15:12.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.894+0000 7f0a52000640 1 -- 172.21.15.3:0/1353060027 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f0a54010ba0 con 0x55bd812cc590 2024-09-19T06:15:12.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.894+0000 7f0a52000640 1 -- 172.21.15.3:0/1353060027 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0a54010de0 con 0x55bd812cc590 2024-09-19T06:15:12.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.894+0000 7f0a71de6740 10 client.26020 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:12.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.894+0000 7f0a71de6740 1 -- 172.21.15.3:0/1353060027 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bd812e5aa0 con 0x55bd812cc590 2024-09-19T06:15:12.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.895+0000 7f0a52000640 1 -- 172.21.15.3:0/1353060027 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a60012450 con 0x55bd812cc590 2024-09-19T06:15:12.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.895+0000 7f0a52000640 1 -- 172.21.15.3:0/1353060027 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0a54022540 con 0x55bd812cc590 2024-09-19T06:15:12.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.895+0000 7f0a71de6740 10 client.26020 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:12.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.895+0000 7f0a71de6740 10 client.26020 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:15:12.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.895+0000 7f0a71de6740 20 client.26020 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:12.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.895+0000 7f0a71de6740 1 --2- 172.21.15.3:0/1353060027 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55bd812e6fb0 0x55bd812e93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.895+0000 7f0a71de6740 4 client.26020 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:12.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.895+0000 7f0a71de6740 1 -- 172.21.15.3:0/1353060027 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd8123f950 con 0x55bd812e6fb0 2024-09-19T06:15:12.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.895+0000 7f0a6d200640 1 --2- 172.21.15.3:0/1353060027 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55bd812e6fb0 0x55bd812e93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.896+0000 7f0a6d200640 1 --2- 172.21.15.3:0/1353060027 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55bd812e6fb0 0x55bd812e93d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8c0112e984ff4f26 server_cookie=90ae890e229827ff in_seq=0 out_seq=0 2024-09-19T06:15:12.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.896+0000 7f0a52000640 10 client.26020 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:15:12.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.897+0000 7f0a52000640 1 -- 172.21.15.3:0/1353060027 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bd8123f950 con 0x55bd812e6fb0 2024-09-19T06:15:12.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.897+0000 7f0a52000640 10 client.26020 handle_command_reply: tid=0 2024-09-19T06:15:12.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.897+0000 7f0a71de6740 1 client.26020 shutdown 2024-09-19T06:15:12.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.897+0000 7f0a71de6740 1 -- 172.21.15.3:0/1353060027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812cc590 msgr2=0x55bd812d4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:12.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.897+0000 7f0a71de6740 1 --2- 172.21.15.3:0/1353060027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812cc590 0x55bd812d4260 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0a54011770 tx=0x7f0a54011c30 comp rx=0 tx=0).stop 2024-09-19T06:15:12.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.897+0000 7f0a71de6740 1 -- 172.21.15.3:0/1353060027 shutdown_connections 2024-09-19T06:15:12.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.897+0000 7f0a71de6740 1 --2- 172.21.15.3:0/1353060027 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55bd812e6fb0 0x55bd812e93d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.897+0000 7f0a71de6740 1 --2- 172.21.15.3:0/1353060027 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd812d6e50 0x55bd812d47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.897+0000 7f0a71de6740 1 --2- 172.21.15.3:0/1353060027 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812cc590 0x55bd812d4260 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.897+0000 7f0a71de6740 1 --2- 172.21.15.3:0/1353060027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd812cbc70 0x55bd812d3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.897+0000 7f0a52000640 0 client.26020 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:15:12.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.897+0000 7f0a71de6740 1 -- 172.21.15.3:0/1353060027 >> 172.21.15.3:0/1353060027 conn(0x55bd812c8200 msgr2=0x55bd812cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:12.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.897+0000 7f0a71de6740 1 -- 172.21.15.3:0/1353060027 shutdown_connections 2024-09-19T06:15:12.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.897+0000 7f0a71de6740 1 -- 172.21.15.3:0/1353060027 wait complete. 2024-09-19T06:15:12.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.897+0000 7f0a71de6740 20 client.26020 trim_cache size 0 max 16384 2024-09-19T06:15:12.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.911+0000 7f0a71de6740 1 Processor -- start 2024-09-19T06:15:12.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.912+0000 7f0a71de6740 1 -- start start 2024-09-19T06:15:12.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.912+0000 7f0a71de6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd812cbc70 0x55bd812d25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.912+0000 7f0a71de6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd812cc590 0x55bd812d45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.912+0000 7f0a71de6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812d6e50 0x55bd812eec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.912+0000 7f0a71de6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681afb70 con 0x55bd812cc590 2024-09-19T06:15:12.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.912+0000 7f0a71de6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681b16b0 con 0x55bd812cbc70 2024-09-19T06:15:12.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.912+0000 7f0a71de6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681b0240 con 0x55bd812d6e50 2024-09-19T06:15:12.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.912+0000 7f0a67400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd812cc590 0x55bd812d45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.912+0000 7f0a67400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd812cc590 0x55bd812d45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53704/0 (socket says 172.21.15.3:53704) 2024-09-19T06:15:12.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.912+0000 7f0a67400640 1 -- 172.21.15.3:0/3376038907 learned_addr learned my addr 172.21.15.3:0/3376038907 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:12.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.912+0000 7f0a6d200640 1 --2- 172.21.15.3:0/3376038907 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812d6e50 0x55bd812eec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.912+0000 7f0a6d200640 1 --2- 172.21.15.3:0/3376038907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd812cbc70 0x55bd812d25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.913+0000 7f0a67400640 1 -- 172.21.15.3:0/3376038907 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812d6e50 msgr2=0x55bd812eec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:12.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.913+0000 7f0a67400640 1 --2- 172.21.15.3:0/3376038907 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812d6e50 0x55bd812eec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.913+0000 7f0a67400640 1 -- 172.21.15.3:0/3376038907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd812cbc70 msgr2=0x55bd812d25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:12.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.913+0000 7f0a67400640 1 --2- 172.21.15.3:0/3376038907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd812cbc70 0x55bd812d25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.913+0000 7f0a67400640 1 -- 172.21.15.3:0/3376038907 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd812c92b0 con 0x55bd812cc590 2024-09-19T06:15:12.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.913+0000 7f0a6d200640 1 --2- 172.21.15.3:0/3376038907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd812cbc70 0x55bd812d25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:12.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.913+0000 7f0a67400640 1 --2- 172.21.15.3:0/3376038907 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd812cc590 0x55bd812d45f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0a54000c00 tx=0x7f0a54022fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ec6e49f0c87d14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:12.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.913+0000 7f0a5cc00640 1 -- 172.21.15.3:0/3376038907 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a54010ba0 con 0x55bd812cc590 2024-09-19T06:15:12.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.913+0000 7f0a5cc00640 1 -- 172.21.15.3:0/3376038907 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a54022bd0 con 0x55bd812cc590 2024-09-19T06:15:12.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.913+0000 7f0a5cc00640 1 -- 172.21.15.3:0/3376038907 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a54005650 con 0x55bd812cc590 2024-09-19T06:15:12.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.914+0000 7f0a71de6740 1 -- 172.21.15.3:0/3376038907 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd812cc590 msgr2=0x55bd812d45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:12.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.914+0000 7f0a71de6740 1 --2- 172.21.15.3:0/3376038907 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd812cc590 0x55bd812d45f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0a54000c00 tx=0x7f0a54022fc0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.914+0000 7f0a71de6740 1 -- 172.21.15.3:0/3376038907 shutdown_connections 2024-09-19T06:15:12.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.914+0000 7f0a71de6740 1 --2- 172.21.15.3:0/3376038907 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812d6e50 0x55bd812eec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.914+0000 7f0a71de6740 1 --2- 172.21.15.3:0/3376038907 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd812cc590 0x55bd812d45f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.914+0000 7f0a71de6740 1 --2- 172.21.15.3:0/3376038907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd812cbc70 0x55bd812d25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.914+0000 7f0a71de6740 1 -- 172.21.15.3:0/3376038907 >> 172.21.15.3:0/3376038907 conn(0x55bd812c8200 msgr2=0x55bd812d5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:12.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.914+0000 7f0a71de6740 1 -- 172.21.15.3:0/3376038907 shutdown_connections 2024-09-19T06:15:12.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.914+0000 7f0a71de6740 1 -- 172.21.15.3:0/3376038907 wait complete. 2024-09-19T06:15:12.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.915+0000 7f0a71de6740 1 -- start start 2024-09-19T06:15:12.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.915+0000 7f0a71de6740 1 Processor -- start 2024-09-19T06:15:12.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.915+0000 7f0a71de6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812cbc70 0x55bd812daba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.915+0000 7f0a71de6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd812cc590 0x55bd812db0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.915+0000 7f0a71de6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd812d6e50 0x55bd812db620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.915+0000 7f0a71de6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681b0fe0 con 0x55bd812cc590 2024-09-19T06:15:12.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.915+0000 7f0a71de6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681b0910 con 0x55bd812d6e50 2024-09-19T06:15:12.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.915+0000 7f0a71de6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681adb50 con 0x55bd812cbc70 2024-09-19T06:15:12.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.915+0000 7f0a71de6740 10 client.0 _ll_register_callbacks cb 0x7f0a5400bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:12.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.916+0000 7f0a67400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd812cc590 0x55bd812db0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.916+0000 7f0a6d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812cbc70 0x55bd812daba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.916+0000 7f0a6d200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812cbc70 0x55bd812daba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:55844/0 (socket says 172.21.15.3:55844) 2024-09-19T06:15:12.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.916+0000 7f0a6d200640 1 -- 172.21.15.3:0/1669594583 learned_addr learned my addr 172.21.15.3:0/1669594583 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:12.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.916+0000 7f0a6d200640 1 --2- 172.21.15.3:0/1669594583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd812d6e50 0x55bd812db620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.916+0000 7f0a6d200640 1 -- 172.21.15.3:0/1669594583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd812d6e50 msgr2=0x55bd812db620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:12.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.916+0000 7f0a6d200640 1 --2- 172.21.15.3:0/1669594583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd812d6e50 0x55bd812db620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.916+0000 7f0a6d200640 1 -- 172.21.15.3:0/1669594583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd812cc590 msgr2=0x55bd812db0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:12.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.916+0000 7f0a6d200640 1 --2- 172.21.15.3:0/1669594583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd812cc590 0x55bd812db0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.916+0000 7f0a6d200640 1 -- 172.21.15.3:0/1669594583 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd812ceae0 con 0x55bd812cbc70 2024-09-19T06:15:12.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.916+0000 7f0a6d200640 1 --2- 172.21.15.3:0/1669594583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812cbc70 0x55bd812daba0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0a600092f0 tx=0x7f0a60010bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8f68e34a20d053d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:12.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.916+0000 7f0a52000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:15:12.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.917+0000 7f0a52000640 1 -- 172.21.15.3:0/1669594583 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a60031070 con 0x55bd812cbc70 2024-09-19T06:15:12.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.917+0000 7f0a52000640 1 -- 172.21.15.3:0/1669594583 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f0a6000eb80 con 0x55bd812cbc70 2024-09-19T06:15:12.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.917+0000 7f0a71de6740 1 -- 172.21.15.3:0/1669594583 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a54022bd0 con 0x55bd812cbc70 2024-09-19T06:15:12.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.917+0000 7f0a52000640 1 -- 172.21.15.3:0/1669594583 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0a6000ed80 con 0x55bd812cbc70 2024-09-19T06:15:12.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.917+0000 7f0a71de6740 10 client.26026 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:12.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.917+0000 7f0a71de6740 1 -- 172.21.15.3:0/1669594583 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bd812c3770 con 0x55bd812cbc70 2024-09-19T06:15:12.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.917+0000 7f0a52000640 1 -- 172.21.15.3:0/1669594583 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a54022bd0 con 0x55bd812cbc70 2024-09-19T06:15:12.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.917+0000 7f0a52000640 1 -- 172.21.15.3:0/1669594583 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0a60037070 con 0x55bd812cbc70 2024-09-19T06:15:12.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.918+0000 7f0a71de6740 10 client.26026 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:12.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.918+0000 7f0a71de6740 10 client.26026 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:15:12.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.918+0000 7f0a71de6740 20 client.26026 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:12.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.918+0000 7f0a71de6740 1 --2- 172.21.15.3:0/1669594583 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55bd813521a0 0x55bd813545c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:12.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.918+0000 7f0a71de6740 4 client.26026 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:15:12.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.918+0000 7f0a71de6740 1 -- 172.21.15.3:0/1669594583 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bd81239e60 con 0x55bd813521a0 2024-09-19T06:15:12.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.918+0000 7f0a67400640 1 --2- 172.21.15.3:0/1669594583 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55bd813521a0 0x55bd813545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:12.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.919+0000 7f0a67400640 1 --2- 172.21.15.3:0/1669594583 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55bd813521a0 0x55bd813545c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=64dacd161e333a0e server_cookie=6c0b886ea227b283 in_seq=0 out_seq=0 2024-09-19T06:15:12.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.919+0000 7f0a52000640 10 client.26026 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:15:12.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.919+0000 7f0a52000640 1 -- 172.21.15.3:0/1669594583 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bd81239e60 con 0x55bd813521a0 2024-09-19T06:15:12.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.919+0000 7f0a52000640 10 client.26026 handle_command_reply: tid=0 2024-09-19T06:15:12.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.919+0000 7f0a71de6740 1 client.26026 shutdown 2024-09-19T06:15:12.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.919+0000 7f0a71de6740 1 -- 172.21.15.3:0/1669594583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812cbc70 msgr2=0x55bd812daba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:12.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.919+0000 7f0a71de6740 1 --2- 172.21.15.3:0/1669594583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812cbc70 0x55bd812daba0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0a600092f0 tx=0x7f0a60010bd0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.919+0000 7f0a71de6740 1 -- 172.21.15.3:0/1669594583 shutdown_connections 2024-09-19T06:15:12.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.919+0000 7f0a71de6740 1 --2- 172.21.15.3:0/1669594583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bd812d6e50 0x55bd812db620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.919+0000 7f0a71de6740 1 --2- 172.21.15.3:0/1669594583 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55bd813521a0 0x55bd813545c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.919+0000 7f0a71de6740 1 --2- 172.21.15.3:0/1669594583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bd812cc590 0x55bd812db0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.919+0000 7f0a71de6740 1 --2- 172.21.15.3:0/1669594583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bd812cbc70 0x55bd812daba0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.919+0000 7f0a52000640 0 client.26026 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:15:12.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.919+0000 7f0a71de6740 1 -- 172.21.15.3:0/1669594583 >> 172.21.15.3:0/1669594583 conn(0x55bd812c8200 msgr2=0x55bd812c6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:12.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.919+0000 7f0a71de6740 1 -- 172.21.15.3:0/1669594583 shutdown_connections 2024-09-19T06:15:12.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.919+0000 7f0a71de6740 1 -- 172.21.15.3:0/1669594583 wait complete. 2024-09-19T06:15:12.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.919+0000 7f0a71de6740 20 client.26026 trim_cache size 0 max 16384 2024-09-19T06:15:12.933 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:15:12.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.920+0000 7f0a6f200640 1 -- 172.21.15.3:0/1444505668 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0a4c0a33b0 msgr2=0x7f0a4c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:12.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.920+0000 7f0a6f200640 1 --2- 172.21.15.3:0/1444505668 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0a4c0a33b0 0x7f0a4c0a5870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0a580f3fd0 tx=0x7f0a580f3e40 comp rx=0 tx=0).stop 2024-09-19T06:15:12.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.920+0000 7f0a6f200640 1 -- 172.21.15.3:0/1444505668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a68101de0 msgr2=0x7f0a6819a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:12.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.920+0000 7f0a6f200640 1 --2- 172.21.15.3:0/1444505668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a68101de0 0x7f0a6819a620 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0a58006010 tx=0x7f0a580042f0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.920+0000 7f0a6f200640 1 -- 172.21.15.3:0/1444505668 shutdown_connections 2024-09-19T06:15:12.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.920+0000 7f0a6f200640 1 --2- 172.21.15.3:0/1444505668 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0a4c0a33b0 0x7f0a4c0a5870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.920+0000 7f0a6f200640 1 --2- 172.21.15.3:0/1444505668 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0a68106f10 0x7f0a6819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.920+0000 7f0a6f200640 1 --2- 172.21.15.3:0/1444505668 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a68102790 0x7f0a6819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.920+0000 7f0a6f200640 1 --2- 172.21.15.3:0/1444505668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a68101de0 0x7f0a6819a620 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:12.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.920+0000 7f0a6f200640 1 -- 172.21.15.3:0/1444505668 >> 172.21.15.3:0/1444505668 conn(0x7f0a680fd8c0 msgr2=0x7f0a680ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:12.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.920+0000 7f0a6f200640 1 -- 172.21.15.3:0/1444505668 shutdown_connections 2024-09-19T06:15:12.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:12.920+0000 7f0a6f200640 1 -- 172.21.15.3:0/1444505668 wait complete. 2024-09-19T06:15:13.728 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:15:14.107 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:15:14.246 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:13 smithi003 ceph-mon[30893]: pgmap v88: 97 pgs: 97 active+clean; 3.0 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 49 KiB/s wr, 32 op/s 2024-09-19T06:15:14.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:13 smithi059 ceph-mon[35138]: pgmap v88: 97 pgs: 97 active+clean; 3.0 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 49 KiB/s wr, 32 op/s 2024-09-19T06:15:14.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:13 smithi071 ceph-mon[35662]: pgmap v88: 97 pgs: 97 active+clean; 3.0 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 49 KiB/s wr, 32 op/s 2024-09-19T06:15:14.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.714+0000 7f4c39800640 1 -- 172.21.15.3:0/2738150941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c34104010 msgr2=0x7f4c341043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:14.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.714+0000 7f4c39800640 1 --2- 172.21.15.3:0/2738150941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c34104010 0x7f4c341043f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4c24009860 tx=0x7f4c2402a340 comp rx=0 tx=0).stop 2024-09-19T06:15:14.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.715+0000 7f4c39800640 1 -- 172.21.15.3:0/2738150941 shutdown_connections 2024-09-19T06:15:14.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.715+0000 7f4c39800640 1 --2- 172.21.15.3:0/2738150941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c34109140 0x7f4c34110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.715+0000 7f4c39800640 1 --2- 172.21.15.3:0/2738150941 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c341049c0 0x7f4c34108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.715+0000 7f4c39800640 1 --2- 172.21.15.3:0/2738150941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c34104010 0x7f4c341043f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.715+0000 7f4c39800640 1 -- 172.21.15.3:0/2738150941 >> 172.21.15.3:0/2738150941 conn(0x7f4c340ffa50 msgr2=0x7f4c34101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:14.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.715+0000 7f4c39800640 1 -- 172.21.15.3:0/2738150941 shutdown_connections 2024-09-19T06:15:14.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.715+0000 7f4c39800640 1 -- 172.21.15.3:0/2738150941 wait complete. 2024-09-19T06:15:14.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.716+0000 7f4c39800640 1 Processor -- start 2024-09-19T06:15:14.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.716+0000 7f4c39800640 1 -- start start 2024-09-19T06:15:14.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.716+0000 7f4c39800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c34104010 0x7f4c3419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:14.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.716+0000 7f4c39800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c341049c0 0x7f4c3419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:14.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.716+0000 7f4c39800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c34109140 0x7f4c3419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:14.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.716+0000 7f4c39800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4c34114140 con 0x7f4c34109140 2024-09-19T06:15:14.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.716+0000 7f4c39800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4c34113fc0 con 0x7f4c34104010 2024-09-19T06:15:14.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.716+0000 7f4c39800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4c341142c0 con 0x7f4c341049c0 2024-09-19T06:15:14.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.716+0000 7f4c33400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c34109140 0x7f4c3419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:14.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.716+0000 7f4c32a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c34104010 0x7f4c3419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:14.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.716+0000 7f4c32a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c34104010 0x7f4c3419a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:43780/0 (socket says 172.21.15.3:43780) 2024-09-19T06:15:14.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.716+0000 7f4c32a00640 1 -- 172.21.15.3:0/1034502527 learned_addr learned my addr 172.21.15.3:0/1034502527 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:14.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.716+0000 7f4c2a000640 1 --2- 172.21.15.3:0/1034502527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c341049c0 0x7f4c3419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:14.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.717+0000 7f4c32a00640 1 -- 172.21.15.3:0/1034502527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c341049c0 msgr2=0x7f4c3419ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:14.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.717+0000 7f4c32a00640 1 --2- 172.21.15.3:0/1034502527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c341049c0 0x7f4c3419ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.717+0000 7f4c32a00640 1 -- 172.21.15.3:0/1034502527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c34109140 msgr2=0x7f4c3419ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:14.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.717+0000 7f4c32a00640 1 --2- 172.21.15.3:0/1034502527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c34109140 0x7f4c3419ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.717+0000 7f4c32a00640 1 -- 172.21.15.3:0/1034502527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c3419f5f0 con 0x7f4c34104010 2024-09-19T06:15:14.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.717+0000 7f4c32a00640 1 --2- 172.21.15.3:0/1034502527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c34104010 0x7f4c3419a640 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4c24035040 tx=0x7f4c24033b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:14.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.717+0000 7f4c2be00640 1 -- 172.21.15.3:0/1034502527 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c24037040 con 0x7f4c34104010 2024-09-19T06:15:14.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.718+0000 7f4c2be00640 1 -- 172.21.15.3:0/1034502527 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c24040070 con 0x7f4c34104010 2024-09-19T06:15:14.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.718+0000 7f4c39800640 1 -- 172.21.15.3:0/1034502527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c3419f880 con 0x7f4c34104010 2024-09-19T06:15:14.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.718+0000 7f4c2be00640 1 -- 172.21.15.3:0/1034502527 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c240039b0 con 0x7f4c34104010 2024-09-19T06:15:14.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.718+0000 7f4c39800640 1 -- 172.21.15.3:0/1034502527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c341a71c0 con 0x7f4c34104010 2024-09-19T06:15:14.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.721+0000 7f4c3c294740 1 Processor -- start 2024-09-19T06:15:14.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.721+0000 7f4c2be00640 1 -- 172.21.15.3:0/1034502527 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f4c240305e0 con 0x7f4c34104010 2024-09-19T06:15:14.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.721+0000 7f4c3c294740 1 -- start start 2024-09-19T06:15:14.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.721+0000 7f4c3c294740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f178c70 0x55b87f179050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:14.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.721+0000 7f4c3c294740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b87f179590 0x55b87f183910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:14.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.721+0000 7f4c3c294740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b87f183e50 0x55b87f186240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:14.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.721+0000 7f4c3c294740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b87f0df3e0 con 0x55b87f179590 2024-09-19T06:15:14.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.721+0000 7f4c3c294740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b87f086d80 con 0x55b87f178c70 2024-09-19T06:15:14.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.721+0000 7f4c3c294740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b87f0db3a0 con 0x55b87f183e50 2024-09-19T06:15:14.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.722+0000 7f4c33400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f178c70 0x55b87f179050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:14.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.722+0000 7f4c32a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b87f179590 0x55b87f183910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:14.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.722+0000 7f4c33400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f178c70 0x55b87f179050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:43790/0 (socket says 172.21.15.3:43790) 2024-09-19T06:15:14.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.722+0000 7f4c33400640 1 -- 172.21.15.3:0/2083853193 learned_addr learned my addr 172.21.15.3:0/2083853193 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:14.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.722+0000 7f4c2a000640 1 --2- 172.21.15.3:0/2083853193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b87f183e50 0x55b87f186240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:14.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.722+0000 7f4c33400640 1 -- 172.21.15.3:0/2083853193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b87f183e50 msgr2=0x55b87f186240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:14.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.722+0000 7f4c33400640 1 --2- 172.21.15.3:0/2083853193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b87f183e50 0x55b87f186240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.722+0000 7f4c33400640 1 -- 172.21.15.3:0/2083853193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b87f179590 msgr2=0x55b87f183910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:14.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.722+0000 7f4c33400640 1 --2- 172.21.15.3:0/2083853193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b87f179590 0x55b87f183910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.722+0000 7f4c33400640 1 -- 172.21.15.3:0/2083853193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b87f0a5ae0 con 0x55b87f178c70 2024-09-19T06:15:14.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.723+0000 7f4c33400640 1 --2- 172.21.15.3:0/2083853193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f178c70 0x55b87f179050 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c009f50 tx=0x7f4c2c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fef1ad9f5ddb033 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:14.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.723+0000 7f4c2be00640 1 --2- 172.21.15.3:0/1034502527 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f4c180a33b0 0x7f4c180a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:14.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.723+0000 7f4c23e00640 1 -- 172.21.15.3:0/2083853193 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c004d20 con 0x55b87f178c70 2024-09-19T06:15:14.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.723+0000 7f4c23e00640 1 -- 172.21.15.3:0/2083853193 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c2c004050 con 0x55b87f178c70 2024-09-19T06:15:14.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.723+0000 7f4c23e00640 1 -- 172.21.15.3:0/2083853193 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c005280 con 0x55b87f178c70 2024-09-19T06:15:14.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.723+0000 7f4c32a00640 1 --2- 172.21.15.3:0/1034502527 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f4c180a33b0 0x7f4c180a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:14.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.723+0000 7f4c2be00640 1 -- 172.21.15.3:0/1034502527 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f4c240efc30 con 0x7f4c34104010 2024-09-19T06:15:14.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.723+0000 7f4c3c294740 1 -- 172.21.15.3:0/2083853193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f178c70 msgr2=0x55b87f179050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:14.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.724+0000 7f4c3c294740 1 --2- 172.21.15.3:0/2083853193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f178c70 0x55b87f179050 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c009f50 tx=0x7f4c2c0118d0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.724+0000 7f4c32a00640 1 --2- 172.21.15.3:0/1034502527 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f4c180a33b0 0x7f4c180a5870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55b87f176060 tx=0x7f4c240f36e0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:14.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.724+0000 7f4c3c294740 1 -- 172.21.15.3:0/2083853193 shutdown_connections 2024-09-19T06:15:14.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.724+0000 7f4c3c294740 1 --2- 172.21.15.3:0/2083853193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b87f183e50 0x55b87f186240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.724+0000 7f4c3c294740 1 --2- 172.21.15.3:0/2083853193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b87f179590 0x55b87f183910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.724+0000 7f4c3c294740 1 --2- 172.21.15.3:0/2083853193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f178c70 0x55b87f179050 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.724+0000 7f4c3c294740 1 -- 172.21.15.3:0/2083853193 >> 172.21.15.3:0/2083853193 conn(0x55b87f175200 msgr2=0x55b87f1755e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:14.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.724+0000 7f4c3c294740 1 -- 172.21.15.3:0/2083853193 shutdown_connections 2024-09-19T06:15:14.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.724+0000 7f4c3c294740 1 -- 172.21.15.3:0/2083853193 wait complete. 2024-09-19T06:15:14.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.724+0000 7f4c3c294740 1 -- start start 2024-09-19T06:15:14.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.725+0000 7f4c3c294740 1 Processor -- start 2024-09-19T06:15:14.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.725+0000 7f4c3c294740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b87f178c70 0x55b87f180d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:14.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.725+0000 7f4c3c294740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b87f179590 0x55b87f181260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:14.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.725+0000 7f4c3c294740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f183e50 0x55b87f1817a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:14.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.725+0000 7f4c3c294740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b87f186a20 con 0x55b87f179590 2024-09-19T06:15:14.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.725+0000 7f4c3c294740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b87f09a0f0 con 0x55b87f183e50 2024-09-19T06:15:14.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.725+0000 7f4c3c294740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b87f186ba0 con 0x55b87f178c70 2024-09-19T06:15:14.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.725+0000 7f4c3c294740 10 client.0 _ll_register_callbacks cb 0x55b87f081bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:14.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.725+0000 7f4c2a000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b87f179590 0x55b87f181260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:14.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.726+0000 7f4c33400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b87f178c70 0x55b87f180d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:14.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.726+0000 7f4c2a000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b87f179590 0x55b87f181260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50632/0 (socket says 172.21.15.3:50632) 2024-09-19T06:15:14.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.726+0000 7f4c2a000640 1 -- 172.21.15.3:0/2895659573 learned_addr learned my addr 172.21.15.3:0/2895659573 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:14.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.726+0000 7f4c33400640 1 --2- 172.21.15.3:0/2895659573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f183e50 0x55b87f1817a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:14.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.726+0000 7f4c2a000640 1 -- 172.21.15.3:0/2895659573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b87f178c70 msgr2=0x55b87f180d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:14.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.726+0000 7f4c2a000640 1 --2- 172.21.15.3:0/2895659573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b87f178c70 0x55b87f180d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.726+0000 7f4c2a000640 1 -- 172.21.15.3:0/2895659573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f183e50 msgr2=0x55b87f1817a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:14.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.726+0000 7f4c2a000640 1 --2- 172.21.15.3:0/2895659573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f183e50 0x55b87f1817a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.726+0000 7f4c2a000640 1 -- 172.21.15.3:0/2895659573 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b87ee503c0 con 0x55b87f179590 2024-09-19T06:15:14.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.726+0000 7f4c33400640 1 --2- 172.21.15.3:0/2895659573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f183e50 0x55b87f1817a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:14.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.726+0000 7f4c2a000640 1 --2- 172.21.15.3:0/2895659573 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b87f179590 0x55b87f181260 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c011700 tx=0x7f4c1c011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6960edd08fb8241b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:14.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.726+0000 7f4c20c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:15:14.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.726+0000 7f4c20c00640 1 -- 172.21.15.3:0/2895659573 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c01e060 con 0x55b87f179590 2024-09-19T06:15:14.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.726+0000 7f4c20c00640 1 -- 172.21.15.3:0/2895659573 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f4c1c00fbf0 con 0x55b87f179590 2024-09-19T06:15:14.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.727+0000 7f4c3c294740 1 -- 172.21.15.3:0/2895659573 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c2c004050 con 0x55b87f179590 2024-09-19T06:15:14.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.727+0000 7f4c20c00640 1 -- 172.21.15.3:0/2895659573 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4c1c00fe30 con 0x55b87f179590 2024-09-19T06:15:14.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.727+0000 7f4c3c294740 10 client.15987 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:14.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.727+0000 7f4c3c294740 1 -- 172.21.15.3:0/2895659573 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b87f192ad0 con 0x55b87f179590 2024-09-19T06:15:14.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.727+0000 7f4c20c00640 1 -- 172.21.15.3:0/2895659573 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c2c004050 con 0x55b87f179590 2024-09-19T06:15:14.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.727+0000 7f4c20c00640 1 -- 172.21.15.3:0/2895659573 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4c1c019070 con 0x55b87f179590 2024-09-19T06:15:14.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.728+0000 7f4c3c294740 10 client.15987 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:14.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.728+0000 7f4c3c294740 10 client.15987 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:15:14.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.728+0000 7f4c3c294740 20 client.15987 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:14.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.728+0000 7f4c3c294740 1 --2- 172.21.15.3:0/2895659573 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55b87f194030 0x55b87f196450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:14.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.728+0000 7f4c3c294740 4 client.15987 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:14.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.728+0000 7f4c3c294740 1 -- 172.21.15.3:0/2895659573 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b87f0ec950 con 0x55b87f194030 2024-09-19T06:15:14.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.728+0000 7f4c33400640 1 --2- 172.21.15.3:0/2895659573 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55b87f194030 0x55b87f196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:14.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.728+0000 7f4c33400640 1 --2- 172.21.15.3:0/2895659573 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55b87f194030 0x55b87f196450 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a629f2577f27da5 server_cookie=78bc55ee466ba688 in_seq=0 out_seq=0 2024-09-19T06:15:14.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.728+0000 7f4c20c00640 10 client.15987 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:15:14.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.729+0000 7f4c20c00640 1 -- 172.21.15.3:0/2895659573 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b87f0ec950 con 0x55b87f194030 2024-09-19T06:15:14.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.729+0000 7f4c20c00640 10 client.15987 handle_command_reply: tid=0 2024-09-19T06:15:14.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.729+0000 7f4c3c294740 1 client.15987 shutdown 2024-09-19T06:15:14.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.729+0000 7f4c3c294740 1 -- 172.21.15.3:0/2895659573 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b87f179590 msgr2=0x55b87f181260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:14.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.729+0000 7f4c3c294740 1 --2- 172.21.15.3:0/2895659573 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b87f179590 0x55b87f181260 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c011700 tx=0x7f4c1c011bc0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.730+0000 7f4c3c294740 1 -- 172.21.15.3:0/2895659573 shutdown_connections 2024-09-19T06:15:14.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.730+0000 7f4c3c294740 1 --2- 172.21.15.3:0/2895659573 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55b87f194030 0x55b87f196450 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.730+0000 7f4c3c294740 1 --2- 172.21.15.3:0/2895659573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f183e50 0x55b87f1817a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.730+0000 7f4c3c294740 1 --2- 172.21.15.3:0/2895659573 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b87f179590 0x55b87f181260 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.730+0000 7f4c3c294740 1 --2- 172.21.15.3:0/2895659573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b87f178c70 0x55b87f180d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.730+0000 7f4c3c294740 1 -- 172.21.15.3:0/2895659573 >> 172.21.15.3:0/2895659573 conn(0x55b87f175200 msgr2=0x55b87f17af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:14.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.730+0000 7f4c20c00640 0 client.15987 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:15:14.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.730+0000 7f4c3c294740 1 -- 172.21.15.3:0/2895659573 shutdown_connections 2024-09-19T06:15:14.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.730+0000 7f4c3c294740 1 -- 172.21.15.3:0/2895659573 wait complete. 2024-09-19T06:15:14.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.730+0000 7f4c3c294740 20 client.15987 trim_cache size 0 max 16384 2024-09-19T06:15:14.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.744+0000 7f4c3c294740 1 Processor -- start 2024-09-19T06:15:14.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.744+0000 7f4c3c294740 1 -- start start 2024-09-19T06:15:14.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.744+0000 7f4c3c294740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f178c70 0x55b87f1815f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:14.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.744+0000 7f4c3c294740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b87f179590 0x55b87f19bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:14.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.744+0000 7f4c3c294740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b87f183e50 0x55b87f19c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:14.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.744+0000 7f4c3c294740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4c341afb20 con 0x55b87f179590 2024-09-19T06:15:14.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.744+0000 7f4c3c294740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4c341b1660 con 0x55b87f178c70 2024-09-19T06:15:14.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.744+0000 7f4c3c294740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4c341b01f0 con 0x55b87f183e50 2024-09-19T06:15:14.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.744+0000 7f4c2a000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b87f179590 0x55b87f19bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:14.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.745+0000 7f4c2a000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b87f179590 0x55b87f19bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50644/0 (socket says 172.21.15.3:50644) 2024-09-19T06:15:14.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.745+0000 7f4c2a000640 1 -- 172.21.15.3:0/2914095313 learned_addr learned my addr 172.21.15.3:0/2914095313 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:14.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.745+0000 7f4c33400640 1 --2- 172.21.15.3:0/2914095313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f178c70 0x55b87f1815f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:14.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.745+0000 7f4c33400640 1 --2- 172.21.15.3:0/2914095313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b87f183e50 0x55b87f19c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:14.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.745+0000 7f4c2a000640 1 -- 172.21.15.3:0/2914095313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b87f183e50 msgr2=0x55b87f19c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:14.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.745+0000 7f4c2a000640 1 --2- 172.21.15.3:0/2914095313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b87f183e50 0x55b87f19c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.745+0000 7f4c2a000640 1 -- 172.21.15.3:0/2914095313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f178c70 msgr2=0x55b87f1815f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:14.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.745+0000 7f4c2a000640 1 --2- 172.21.15.3:0/2914095313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f178c70 0x55b87f1815f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.745+0000 7f4c2a000640 1 -- 172.21.15.3:0/2914095313 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b87f175030 con 0x55b87f179590 2024-09-19T06:15:14.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.745+0000 7f4c2a000640 1 --2- 172.21.15.3:0/2914095313 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b87f179590 0x55b87f19bd20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c01a440 tx=0x7f4c1c009d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889f94c92748006 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:14.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.745+0000 7f4c23400640 1 -- 172.21.15.3:0/2914095313 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c003f90 con 0x55b87f179590 2024-09-19T06:15:14.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.746+0000 7f4c23400640 1 -- 172.21.15.3:0/2914095313 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c1c005550 con 0x55b87f179590 2024-09-19T06:15:14.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.746+0000 7f4c23400640 1 -- 172.21.15.3:0/2914095313 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c003970 con 0x55b87f179590 2024-09-19T06:15:14.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.746+0000 7f4c3c294740 1 -- 172.21.15.3:0/2914095313 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b87f179590 msgr2=0x55b87f19bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:14.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.746+0000 7f4c3c294740 1 --2- 172.21.15.3:0/2914095313 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b87f179590 0x55b87f19bd20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c01a440 tx=0x7f4c1c009d80 comp rx=0 tx=0).stop 2024-09-19T06:15:14.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.746+0000 7f4c3c294740 1 -- 172.21.15.3:0/2914095313 shutdown_connections 2024-09-19T06:15:14.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.746+0000 7f4c3c294740 1 --2- 172.21.15.3:0/2914095313 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b87f183e50 0x55b87f19c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.746+0000 7f4c3c294740 1 --2- 172.21.15.3:0/2914095313 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b87f179590 0x55b87f19bd20 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.746+0000 7f4c3c294740 1 --2- 172.21.15.3:0/2914095313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f178c70 0x55b87f1815f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.746+0000 7f4c3c294740 1 -- 172.21.15.3:0/2914095313 >> 172.21.15.3:0/2914095313 conn(0x55b87f175200 msgr2=0x55b87f17fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:14.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.746+0000 7f4c3c294740 1 -- 172.21.15.3:0/2914095313 shutdown_connections 2024-09-19T06:15:14.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.746+0000 7f4c3c294740 1 -- 172.21.15.3:0/2914095313 wait complete. 2024-09-19T06:15:14.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.747+0000 7f4c3c294740 1 -- start start 2024-09-19T06:15:14.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.747+0000 7f4c3c294740 1 Processor -- start 2024-09-19T06:15:14.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.747+0000 7f4c3c294740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f178c70 0x55b87f18c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:14.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.747+0000 7f4c3c294740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b87f179590 0x55b87f1875d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:14.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.747+0000 7f4c3c294740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b87f183e50 0x55b87f187b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:14.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.747+0000 7f4c3c294740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4c341b0f90 con 0x55b87f179590 2024-09-19T06:15:14.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.747+0000 7f4c3c294740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4c341b08c0 con 0x55b87f178c70 2024-09-19T06:15:14.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.747+0000 7f4c3c294740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4c341adb00 con 0x55b87f183e50 2024-09-19T06:15:14.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.747+0000 7f4c3c294740 10 client.0 _ll_register_callbacks cb 0x7f4c1c009870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:14.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.748+0000 7f4c33400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f178c70 0x55b87f18c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:14.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.748+0000 7f4c33400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f178c70 0x55b87f18c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:43810/0 (socket says 172.21.15.3:43810) 2024-09-19T06:15:14.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.748+0000 7f4c33400640 1 -- 172.21.15.3:0/3421485475 learned_addr learned my addr 172.21.15.3:0/3421485475 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:14.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.748+0000 7f4c2a000640 1 --2- 172.21.15.3:0/3421485475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b87f179590 0x55b87f1875d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:14.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.748+0000 7f4c33400640 1 --2- 172.21.15.3:0/3421485475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b87f183e50 0x55b87f187b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:14.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.748+0000 7f4c33400640 1 -- 172.21.15.3:0/3421485475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b87f183e50 msgr2=0x55b87f187b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:14.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.748+0000 7f4c33400640 1 --2- 172.21.15.3:0/3421485475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b87f183e50 0x55b87f187b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.748+0000 7f4c33400640 1 -- 172.21.15.3:0/3421485475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b87f179590 msgr2=0x55b87f1875d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:14.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.748+0000 7f4c33400640 1 --2- 172.21.15.3:0/3421485475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b87f179590 0x55b87f1875d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.748+0000 7f4c33400640 1 -- 172.21.15.3:0/3421485475 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b87f17bae0 con 0x55b87f178c70 2024-09-19T06:15:14.756 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.748+0000 7f4c33400640 1 --2- 172.21.15.3:0/3421485475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f178c70 0x55b87f18c2a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c009f50 tx=0x7f4c2c009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c38e1ef840f9ecd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:14.756 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.748+0000 7f4c20c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:15:14.756 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.748+0000 7f4c20c00640 1 -- 172.21.15.3:0/3421485475 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c004050 con 0x55b87f178c70 2024-09-19T06:15:14.756 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.749+0000 7f4c20c00640 1 -- 172.21.15.3:0/3421485475 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f4c2c0041f0 con 0x55b87f178c70 2024-09-19T06:15:14.756 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.749+0000 7f4c3c294740 1 -- 172.21.15.3:0/3421485475 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c1c005550 con 0x55b87f178c70 2024-09-19T06:15:14.756 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.749+0000 7f4c20c00640 1 -- 172.21.15.3:0/3421485475 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4c2c0043f0 con 0x55b87f178c70 2024-09-19T06:15:14.756 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.749+0000 7f4c3c294740 10 client.26039 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:14.756 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.749+0000 7f4c3c294740 1 -- 172.21.15.3:0/3421485475 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b87f170770 con 0x55b87f178c70 2024-09-19T06:15:14.756 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.749+0000 7f4c20c00640 1 -- 172.21.15.3:0/3421485475 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c1c005550 con 0x55b87f178c70 2024-09-19T06:15:14.756 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.750+0000 7f4c20c00640 1 -- 172.21.15.3:0/3421485475 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4c2c00f480 con 0x55b87f178c70 2024-09-19T06:15:14.756 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.750+0000 7f4c3c294740 10 client.26039 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:14.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.750+0000 7f4c3c294740 10 client.26039 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:15:14.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.750+0000 7f4c3c294740 20 client.26039 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:14.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.750+0000 7f4c3c294740 1 --2- 172.21.15.3:0/3421485475 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55b87f1fec00 0x55b87f200ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:14.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.750+0000 7f4c3c294740 4 client.26039 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:15:14.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.750+0000 7f4c3c294740 1 -- 172.21.15.3:0/3421485475 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b87f0e6e60 con 0x55b87f1fec00 2024-09-19T06:15:14.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.750+0000 7f4c2a000640 1 --2- 172.21.15.3:0/3421485475 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55b87f1fec00 0x55b87f200ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:14.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.751+0000 7f4c2a000640 1 --2- 172.21.15.3:0/3421485475 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55b87f1fec00 0x55b87f200ff0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=efc2f9b99429e431 server_cookie=be4460abfd3ec62 in_seq=0 out_seq=0 2024-09-19T06:15:14.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.751+0000 7f4c20c00640 10 client.26039 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:15:14.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.751+0000 7f4c20c00640 1 -- 172.21.15.3:0/3421485475 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b87f0e6e60 con 0x55b87f1fec00 2024-09-19T06:15:14.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.751+0000 7f4c20c00640 10 client.26039 handle_command_reply: tid=0 2024-09-19T06:15:14.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.751+0000 7f4c3c294740 1 client.26039 shutdown 2024-09-19T06:15:14.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.751+0000 7f4c3c294740 1 -- 172.21.15.3:0/3421485475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f178c70 msgr2=0x55b87f18c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:14.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.751+0000 7f4c3c294740 1 --2- 172.21.15.3:0/3421485475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f178c70 0x55b87f18c2a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c009f50 tx=0x7f4c2c009500 comp rx=0 tx=0).stop 2024-09-19T06:15:14.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.751+0000 7f4c3c294740 1 -- 172.21.15.3:0/3421485475 shutdown_connections 2024-09-19T06:15:14.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.751+0000 7f4c3c294740 1 --2- 172.21.15.3:0/3421485475 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55b87f1fec00 0x55b87f200ff0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.751+0000 7f4c3c294740 1 --2- 172.21.15.3:0/3421485475 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b87f183e50 0x55b87f187b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.751+0000 7f4c3c294740 1 --2- 172.21.15.3:0/3421485475 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b87f179590 0x55b87f1875d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.751+0000 7f4c3c294740 1 --2- 172.21.15.3:0/3421485475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b87f178c70 0x55b87f18c2a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.751+0000 7f4c20c00640 0 client.26039 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:15:14.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.751+0000 7f4c3c294740 1 -- 172.21.15.3:0/3421485475 >> 172.21.15.3:0/3421485475 conn(0x55b87f175200 msgr2=0x55b87f17a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:14.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.751+0000 7f4c3c294740 1 -- 172.21.15.3:0/3421485475 shutdown_connections 2024-09-19T06:15:14.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.751+0000 7f4c3c294740 1 -- 172.21.15.3:0/3421485475 wait complete. 2024-09-19T06:15:14.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.751+0000 7f4c3c294740 20 client.26039 trim_cache size 0 max 16384 2024-09-19T06:15:14.759 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:15:14.759 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.752+0000 7f4c39800640 1 -- 172.21.15.3:0/1034502527 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f4c180a33b0 msgr2=0x7f4c180a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:14.759 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.752+0000 7f4c39800640 1 --2- 172.21.15.3:0/1034502527 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f4c180a33b0 0x7f4c180a5870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55b87f176060 tx=0x7f4c240f36e0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.759 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.752+0000 7f4c39800640 1 -- 172.21.15.3:0/1034502527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c34104010 msgr2=0x7f4c3419a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:14.759 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.752+0000 7f4c39800640 1 --2- 172.21.15.3:0/1034502527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c34104010 0x7f4c3419a640 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4c24035040 tx=0x7f4c24033b60 comp rx=0 tx=0).stop 2024-09-19T06:15:14.759 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.752+0000 7f4c39800640 1 -- 172.21.15.3:0/1034502527 shutdown_connections 2024-09-19T06:15:14.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.752+0000 7f4c39800640 1 --2- 172.21.15.3:0/1034502527 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f4c180a33b0 0x7f4c180a5870 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.752+0000 7f4c39800640 1 --2- 172.21.15.3:0/1034502527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4c34109140 0x7f4c3419ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.752+0000 7f4c39800640 1 --2- 172.21.15.3:0/1034502527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4c341049c0 0x7f4c3419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.752+0000 7f4c39800640 1 --2- 172.21.15.3:0/1034502527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c34104010 0x7f4c3419a640 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:14.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.752+0000 7f4c39800640 1 -- 172.21.15.3:0/1034502527 >> 172.21.15.3:0/1034502527 conn(0x7f4c340ffa50 msgr2=0x7f4c34100df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:14.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.752+0000 7f4c39800640 1 -- 172.21.15.3:0/1034502527 shutdown_connections 2024-09-19T06:15:14.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:14.753+0000 7f4c39800640 1 -- 172.21.15.3:0/1034502527 wait complete. 2024-09-19T06:15:15.612 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:15:15.992 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:15:16.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:15 smithi059 ceph-mon[35138]: pgmap v89: 97 pgs: 97 active+clean; 3.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 61 KiB/s wr, 38 op/s 2024-09-19T06:15:16.294 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:15 smithi003 ceph-mon[30893]: pgmap v89: 97 pgs: 97 active+clean; 3.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 61 KiB/s wr, 38 op/s 2024-09-19T06:15:16.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:15 smithi071 ceph-mon[35662]: pgmap v89: 97 pgs: 97 active+clean; 3.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 61 KiB/s wr, 38 op/s 2024-09-19T06:15:16.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.561+0000 7feaba000640 1 -- 172.21.15.3:0/3505472322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feab41019c0 msgr2=0x7feab4101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:16.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.561+0000 7feaba000640 1 --2- 172.21.15.3:0/3505472322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feab41019c0 0x7feab4101e20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009930 tx=0x7fea9c02a420 comp rx=0 tx=0).stop 2024-09-19T06:15:16.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.561+0000 7feaba000640 1 -- 172.21.15.3:0/3505472322 shutdown_connections 2024-09-19T06:15:16.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.561+0000 7feaba000640 1 --2- 172.21.15.3:0/3505472322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feab4102360 0x7feab410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.561+0000 7feaba000640 1 --2- 172.21.15.3:0/3505472322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feab41019c0 0x7feab4101e20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.561+0000 7feaba000640 1 --2- 172.21.15.3:0/3505472322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feab41079c0 0x7feab4107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.561+0000 7feaba000640 1 -- 172.21.15.3:0/3505472322 >> 172.21.15.3:0/3505472322 conn(0x7feab40fd740 msgr2=0x7feab40ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:16.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.561+0000 7feaba000640 1 -- 172.21.15.3:0/3505472322 shutdown_connections 2024-09-19T06:15:16.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.561+0000 7feaba000640 1 -- 172.21.15.3:0/3505472322 wait complete. 2024-09-19T06:15:16.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.562+0000 7feaba000640 1 Processor -- start 2024-09-19T06:15:16.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.562+0000 7feaba000640 1 -- start start 2024-09-19T06:15:16.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.563+0000 7feaba000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feab41019c0 0x7feab419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.563+0000 7feaba000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feab4102360 0x7feab419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.563+0000 7feaba000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feab41079c0 0x7feab419eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.563+0000 7feaba000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7feab4111e10 con 0x7feab41019c0 2024-09-19T06:15:16.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.563+0000 7feaba000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7feab4111c90 con 0x7feab41079c0 2024-09-19T06:15:16.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.563+0000 7feaba000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7feab4111f90 con 0x7feab4102360 2024-09-19T06:15:16.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.563+0000 7feab8c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feab41019c0 0x7feab419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.563+0000 7feab8c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feab41019c0 0x7feab419a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50664/0 (socket says 172.21.15.3:50664) 2024-09-19T06:15:16.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.563+0000 7feab8c00640 1 -- 172.21.15.3:0/45835919 learned_addr learned my addr 172.21.15.3:0/45835919 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:16.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.563+0000 7feab9600640 1 --2- 172.21.15.3:0/45835919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feab41079c0 0x7feab419eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.563+0000 7feaabe00640 1 --2- 172.21.15.3:0/45835919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feab4102360 0x7feab419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.564+0000 7feab8c00640 1 -- 172.21.15.3:0/45835919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feab4102360 msgr2=0x7feab419aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:16.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.564+0000 7feab8c00640 1 --2- 172.21.15.3:0/45835919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feab4102360 0x7feab419aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.564+0000 7feab8c00640 1 -- 172.21.15.3:0/45835919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feab41079c0 msgr2=0x7feab419eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:16.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.564+0000 7feab8c00640 1 --2- 172.21.15.3:0/45835919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feab41079c0 0x7feab419eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.564+0000 7feab8c00640 1 -- 172.21.15.3:0/45835919 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab419f480 con 0x7feab41019c0 2024-09-19T06:15:16.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.564+0000 7feab8c00640 1 --2- 172.21.15.3:0/45835919 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feab41019c0 0x7feab419a4d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7feaa400e9f0 tx=0x7feaa400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:16.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.564+0000 7feab2000640 1 -- 172.21.15.3:0/45835919 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa400cd80 con 0x7feab41019c0 2024-09-19T06:15:16.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.564+0000 7feab2000640 1 -- 172.21.15.3:0/45835919 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaa4005500 con 0x7feab41019c0 2024-09-19T06:15:16.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.564+0000 7feaba000640 1 -- 172.21.15.3:0/45835919 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feab419f770 con 0x7feab41019c0 2024-09-19T06:15:16.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.564+0000 7feab2000640 1 -- 172.21.15.3:0/45835919 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa4010690 con 0x7feab41019c0 2024-09-19T06:15:16.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.564+0000 7feaba000640 1 -- 172.21.15.3:0/45835919 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feab41a7050 con 0x7feab41019c0 2024-09-19T06:15:16.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.567+0000 7feabdfc6740 1 Processor -- start 2024-09-19T06:15:16.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.568+0000 7feabdfc6740 1 -- start start 2024-09-19T06:15:16.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.568+0000 7feab2000640 1 -- 172.21.15.3:0/45835919 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7feaa40046c0 con 0x7feab41019c0 2024-09-19T06:15:16.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.568+0000 7feabdfc6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7dd9fe40 0x55ff7dda0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.568+0000 7feabdfc6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff7dda0760 0x55ff7ddaaae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.568+0000 7feabdfc6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7ddab020 0x55ff7ddad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.568+0000 7feabdfc6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ff7dd063e0 con 0x55ff7dd9fe40 2024-09-19T06:15:16.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.568+0000 7feabdfc6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ff7dcadd80 con 0x55ff7dda0760 2024-09-19T06:15:16.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.568+0000 7feabdfc6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ff7dd023a0 con 0x55ff7ddab020 2024-09-19T06:15:16.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.568+0000 7feab9600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7dd9fe40 0x55ff7dda0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.568+0000 7feab9600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7dd9fe40 0x55ff7dda0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50678/0 (socket says 172.21.15.3:50678) 2024-09-19T06:15:16.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.568+0000 7feab9600640 1 -- 172.21.15.3:0/1248552087 learned_addr learned my addr 172.21.15.3:0/1248552087 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:16.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.568+0000 7feaabe00640 1 --2- 172.21.15.3:0/1248552087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7ddab020 0x55ff7ddad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.568+0000 7feab8c00640 1 --2- 172.21.15.3:0/1248552087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff7dda0760 0x55ff7ddaaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.569+0000 7feaabe00640 1 -- 172.21.15.3:0/1248552087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff7dda0760 msgr2=0x55ff7ddaaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:16.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.569+0000 7feaabe00640 1 --2- 172.21.15.3:0/1248552087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff7dda0760 0x55ff7ddaaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.569+0000 7feaabe00640 1 -- 172.21.15.3:0/1248552087 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7dd9fe40 msgr2=0x55ff7dda0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:16.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.569+0000 7feaabe00640 1 --2- 172.21.15.3:0/1248552087 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7dd9fe40 0x55ff7dda0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.569+0000 7feaabe00640 1 -- 172.21.15.3:0/1248552087 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff7dcccae0 con 0x55ff7ddab020 2024-09-19T06:15:16.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.569+0000 7feab9600640 1 --2- 172.21.15.3:0/1248552087 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7dd9fe40 0x55ff7dda0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:16.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.569+0000 7feaabe00640 1 --2- 172.21.15.3:0/1248552087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7ddab020 0x55ff7ddad410 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fea9c02a940 tx=0x7fea9c005de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a62de2d387071 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:16.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.569+0000 7feaa9c00640 1 -- 172.21.15.3:0/1248552087 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c035040 con 0x55ff7ddab020 2024-09-19T06:15:16.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.569+0000 7feaa9c00640 1 -- 172.21.15.3:0/1248552087 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea9c005520 con 0x55ff7ddab020 2024-09-19T06:15:16.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.569+0000 7feaa9c00640 1 -- 172.21.15.3:0/1248552087 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c0035f0 con 0x55ff7ddab020 2024-09-19T06:15:16.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.570+0000 7feab2000640 1 --2- 172.21.15.3:0/45835919 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fea980a33b0 0x7fea980a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.570+0000 7feab2000640 1 -- 172.21.15.3:0/45835919 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7feaa40d0120 con 0x7feab41019c0 2024-09-19T06:15:16.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.570+0000 7feab9600640 1 --2- 172.21.15.3:0/45835919 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fea980a33b0 0x7fea980a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.570+0000 7feabdfc6740 1 -- 172.21.15.3:0/1248552087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7ddab020 msgr2=0x55ff7ddad410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:16.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.570+0000 7feabdfc6740 1 --2- 172.21.15.3:0/1248552087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7ddab020 0x55ff7ddad410 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fea9c02a940 tx=0x7fea9c005de0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.570+0000 7feabdfc6740 1 -- 172.21.15.3:0/1248552087 shutdown_connections 2024-09-19T06:15:16.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.570+0000 7feabdfc6740 1 --2- 172.21.15.3:0/1248552087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7ddab020 0x55ff7ddad410 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.570+0000 7feabdfc6740 1 --2- 172.21.15.3:0/1248552087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff7dda0760 0x55ff7ddaaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.570+0000 7feabdfc6740 1 --2- 172.21.15.3:0/1248552087 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7dd9fe40 0x55ff7dda0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.570+0000 7feabdfc6740 1 -- 172.21.15.3:0/1248552087 >> 172.21.15.3:0/1248552087 conn(0x55ff7dd9c3d0 msgr2=0x55ff7dd9c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:16.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.571+0000 7feabdfc6740 1 -- 172.21.15.3:0/1248552087 shutdown_connections 2024-09-19T06:15:16.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.571+0000 7feab9600640 1 --2- 172.21.15.3:0/45835919 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fea980a33b0 0x7fea980a5870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7feaac011890 tx=0x7feaac009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:16.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.571+0000 7feabdfc6740 1 -- 172.21.15.3:0/1248552087 wait complete. 2024-09-19T06:15:16.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.571+0000 7feabdfc6740 1 -- start start 2024-09-19T06:15:16.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.571+0000 7feabdfc6740 1 Processor -- start 2024-09-19T06:15:16.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.572+0000 7feabdfc6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff7dd9fe40 0x55ff7dda7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.572+0000 7feabdfc6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7dda0760 0x55ff7dda84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.572+0000 7feabdfc6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7ddab020 0x55ff7dda8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.572+0000 7feabdfc6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ff7ddadbf0 con 0x55ff7dda0760 2024-09-19T06:15:16.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.572+0000 7feabdfc6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ff7dcc10f0 con 0x55ff7dd9fe40 2024-09-19T06:15:16.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.572+0000 7feabdfc6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ff7ddadd70 con 0x55ff7ddab020 2024-09-19T06:15:16.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.572+0000 7feabdfc6740 10 client.0 _ll_register_callbacks cb 0x55ff7dca8bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:16.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.572+0000 7feaabe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7dda0760 0x55ff7dda84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.572+0000 7feaabe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7dda0760 0x55ff7dda84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50684/0 (socket says 172.21.15.3:50684) 2024-09-19T06:15:16.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.572+0000 7feab8c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff7dd9fe40 0x55ff7dda7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.572+0000 7feaabe00640 1 -- 172.21.15.3:0/1198052454 learned_addr learned my addr 172.21.15.3:0/1198052454 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:16.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.572+0000 7feab9600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7ddab020 0x55ff7dda8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.573+0000 7feaabe00640 1 -- 172.21.15.3:0/1198052454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7ddab020 msgr2=0x55ff7dda8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:16.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.573+0000 7feaabe00640 1 --2- 172.21.15.3:0/1198052454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7ddab020 0x55ff7dda8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.573+0000 7feaabe00640 1 -- 172.21.15.3:0/1198052454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff7dd9fe40 msgr2=0x55ff7dda7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:16.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.573+0000 7feaabe00640 1 --2- 172.21.15.3:0/1198052454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff7dd9fe40 0x55ff7dda7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.573+0000 7feaabe00640 1 -- 172.21.15.3:0/1198052454 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff7da773c0 con 0x55ff7dda0760 2024-09-19T06:15:16.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.573+0000 7feab9600640 1 --2- 172.21.15.3:0/1198052454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7ddab020 0x55ff7dda8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:16.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.573+0000 7feaabe00640 1 --2- 172.21.15.3:0/1198052454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7dda0760 0x55ff7dda84c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fea9c02aa10 tx=0x7fea9c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82784b23457214f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:16.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.573+0000 7feaa2000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:15:16.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.573+0000 7feaa2000640 1 -- 172.21.15.3:0/1198052454 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c052060 con 0x55ff7dda0760 2024-09-19T06:15:16.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.573+0000 7feabdfc6740 1 -- 172.21.15.3:0/1198052454 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea9c005520 con 0x55ff7dda0760 2024-09-19T06:15:16.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.573+0000 7feaa2000640 1 -- 172.21.15.3:0/1198052454 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fea9c004390 con 0x55ff7dda0760 2024-09-19T06:15:16.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.574+0000 7feaa2000640 1 -- 172.21.15.3:0/1198052454 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fea9c035070 con 0x55ff7dda0760 2024-09-19T06:15:16.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.574+0000 7feabdfc6740 10 client.16005 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:16.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.574+0000 7feabdfc6740 1 -- 172.21.15.3:0/1198052454 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ff7ddb9cb0 con 0x55ff7dda0760 2024-09-19T06:15:16.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.574+0000 7feaa2000640 1 -- 172.21.15.3:0/1198052454 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea9c005520 con 0x55ff7dda0760 2024-09-19T06:15:16.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.574+0000 7feaa2000640 1 -- 172.21.15.3:0/1198052454 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fea9c031880 con 0x55ff7dda0760 2024-09-19T06:15:16.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.574+0000 7feabdfc6740 10 client.16005 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:16.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.574+0000 7feabdfc6740 10 client.16005 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:15:16.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.574+0000 7feabdfc6740 20 client.16005 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:16.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.574+0000 7feabdfc6740 1 --2- 172.21.15.3:0/1198052454 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55ff7ddbb000 0x55ff7ddbd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.574+0000 7feabdfc6740 4 client.16005 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:16.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.574+0000 7feabdfc6740 1 -- 172.21.15.3:0/1198052454 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff7dd13950 con 0x55ff7ddbb000 2024-09-19T06:15:16.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.575+0000 7feab8c00640 1 --2- 172.21.15.3:0/1198052454 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55ff7ddbb000 0x55ff7ddbd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.576+0000 7feab8c00640 1 --2- 172.21.15.3:0/1198052454 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55ff7ddbb000 0x55ff7ddbd3f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f9b093f108c2e8eb server_cookie=84791a8443958995 in_seq=0 out_seq=0 2024-09-19T06:15:16.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.576+0000 7feaa2000640 10 client.16005 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:15:16.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.576+0000 7feaa2000640 1 -- 172.21.15.3:0/1198052454 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ff7dd13950 con 0x55ff7ddbb000 2024-09-19T06:15:16.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.576+0000 7feaa2000640 10 client.16005 handle_command_reply: tid=0 2024-09-19T06:15:16.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.577+0000 7feabdfc6740 1 client.16005 shutdown 2024-09-19T06:15:16.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.577+0000 7feabdfc6740 1 -- 172.21.15.3:0/1198052454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7dda0760 msgr2=0x55ff7dda84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:16.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.577+0000 7feabdfc6740 1 --2- 172.21.15.3:0/1198052454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7dda0760 0x55ff7dda84c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fea9c02aa10 tx=0x7fea9c0048f0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.577+0000 7feabdfc6740 1 -- 172.21.15.3:0/1198052454 shutdown_connections 2024-09-19T06:15:16.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.577+0000 7feabdfc6740 1 --2- 172.21.15.3:0/1198052454 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55ff7ddbb000 0x55ff7ddbd3f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.577+0000 7feabdfc6740 1 --2- 172.21.15.3:0/1198052454 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7ddab020 0x55ff7dda8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.577+0000 7feabdfc6740 1 --2- 172.21.15.3:0/1198052454 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7dda0760 0x55ff7dda84c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.577+0000 7feabdfc6740 1 --2- 172.21.15.3:0/1198052454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff7dd9fe40 0x55ff7dda7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.577+0000 7feabdfc6740 1 -- 172.21.15.3:0/1198052454 >> 172.21.15.3:0/1198052454 conn(0x55ff7dd9c3d0 msgr2=0x55ff7dda2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:16.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.577+0000 7feaa2000640 0 client.16005 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:15:16.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.577+0000 7feabdfc6740 1 -- 172.21.15.3:0/1198052454 shutdown_connections 2024-09-19T06:15:16.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.577+0000 7feabdfc6740 1 -- 172.21.15.3:0/1198052454 wait complete. 2024-09-19T06:15:16.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.577+0000 7feabdfc6740 20 client.16005 trim_cache size 0 max 16384 2024-09-19T06:15:16.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.591+0000 7feabdfc6740 1 Processor -- start 2024-09-19T06:15:16.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.591+0000 7feabdfc6740 1 -- start start 2024-09-19T06:15:16.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.592+0000 7feabdfc6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7dd9fe40 0x55ff7dda5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.592+0000 7feabdfc6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7dda0760 0x55ff7dda5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.592+0000 7feabdfc6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff7ddab020 0x55ff7dda1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.592+0000 7feabdfc6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7feab41af960 con 0x55ff7dd9fe40 2024-09-19T06:15:16.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.592+0000 7feabdfc6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7feab41b14a0 con 0x55ff7ddab020 2024-09-19T06:15:16.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.592+0000 7feabdfc6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7feab41b0030 con 0x55ff7dda0760 2024-09-19T06:15:16.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.592+0000 7feab8c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7dd9fe40 0x55ff7dda5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.592+0000 7feab8c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7dd9fe40 0x55ff7dda5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50696/0 (socket says 172.21.15.3:50696) 2024-09-19T06:15:16.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.592+0000 7feab8c00640 1 -- 172.21.15.3:0/20583 learned_addr learned my addr 172.21.15.3:0/20583 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:16.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.592+0000 7feaabe00640 1 --2- 172.21.15.3:0/20583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7dda0760 0x55ff7dda5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.592+0000 7feab9600640 1 --2- 172.21.15.3:0/20583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff7ddab020 0x55ff7dda1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.592+0000 7feab8c00640 1 -- 172.21.15.3:0/20583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7dda0760 msgr2=0x55ff7dda5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:16.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.592+0000 7feab8c00640 1 --2- 172.21.15.3:0/20583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7dda0760 0x55ff7dda5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.592+0000 7feab8c00640 1 -- 172.21.15.3:0/20583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff7ddab020 msgr2=0x55ff7dda1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:16.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.592+0000 7feab8c00640 1 --2- 172.21.15.3:0/20583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff7ddab020 0x55ff7dda1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.592+0000 7feab8c00640 1 -- 172.21.15.3:0/20583 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff7ddadc70 con 0x55ff7dd9fe40 2024-09-19T06:15:16.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.592+0000 7feaabe00640 1 --2- 172.21.15.3:0/20583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7dda0760 0x55ff7dda5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:16.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.592+0000 7feab9600640 1 --2- 172.21.15.3:0/20583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff7ddab020 0x55ff7dda1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:16.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.593+0000 7feab8c00640 1 --2- 172.21.15.3:0/20583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7dd9fe40 0x55ff7dda5200 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7feaa4098800 tx=0x7feaa40bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546680fd59a45ef3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:16.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.593+0000 7feaa9200640 1 -- 172.21.15.3:0/20583 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa409bee0 con 0x55ff7dd9fe40 2024-09-19T06:15:16.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.593+0000 7feaa9200640 1 -- 172.21.15.3:0/20583 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaa409caa0 con 0x55ff7dd9fe40 2024-09-19T06:15:16.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.593+0000 7feaa9200640 1 -- 172.21.15.3:0/20583 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa409bd00 con 0x55ff7dd9fe40 2024-09-19T06:15:16.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.593+0000 7feabdfc6740 1 -- 172.21.15.3:0/20583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7dd9fe40 msgr2=0x55ff7dda5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:16.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.594+0000 7feabdfc6740 1 --2- 172.21.15.3:0/20583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7dd9fe40 0x55ff7dda5200 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7feaa4098800 tx=0x7feaa40bc040 comp rx=0 tx=0).stop 2024-09-19T06:15:16.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.594+0000 7feabdfc6740 1 -- 172.21.15.3:0/20583 shutdown_connections 2024-09-19T06:15:16.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.594+0000 7feabdfc6740 1 --2- 172.21.15.3:0/20583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff7ddab020 0x55ff7dda1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.594+0000 7feabdfc6740 1 --2- 172.21.15.3:0/20583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7dda0760 0x55ff7dda5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.594+0000 7feabdfc6740 1 --2- 172.21.15.3:0/20583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7dd9fe40 0x55ff7dda5200 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.594+0000 7feabdfc6740 1 -- 172.21.15.3:0/20583 >> 172.21.15.3:0/20583 conn(0x55ff7dd9c3d0 msgr2=0x55ff7dd97300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:16.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.594+0000 7feabdfc6740 1 -- 172.21.15.3:0/20583 shutdown_connections 2024-09-19T06:15:16.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.594+0000 7feabdfc6740 1 -- 172.21.15.3:0/20583 wait complete. 2024-09-19T06:15:16.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.594+0000 7feabdfc6740 1 -- start start 2024-09-19T06:15:16.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.594+0000 7feabdfc6740 1 Processor -- start 2024-09-19T06:15:16.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.595+0000 7feabdfc6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7dd9fe40 0x55ff7ddbe350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.595+0000 7feabdfc6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff7dda0760 0x55ff7ddbe890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.595+0000 7feabdfc6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7ddab020 0x55ff7ddbedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.595+0000 7feabdfc6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7feab41b0dd0 con 0x55ff7ddab020 2024-09-19T06:15:16.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.595+0000 7feabdfc6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7feab41b0700 con 0x55ff7dda0760 2024-09-19T06:15:16.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.595+0000 7feabdfc6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7feab41ad940 con 0x55ff7dd9fe40 2024-09-19T06:15:16.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.595+0000 7feabdfc6740 10 client.0 _ll_register_callbacks cb 0x7feaac009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:16.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.595+0000 7feab9600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7ddab020 0x55ff7ddbedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.595+0000 7feab8c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7dd9fe40 0x55ff7ddbe350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.595+0000 7feab8c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7dd9fe40 0x55ff7ddbe350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:44796/0 (socket says 172.21.15.3:44796) 2024-09-19T06:15:16.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.595+0000 7feab9600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7ddab020 0x55ff7ddbedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50704/0 (socket says 172.21.15.3:50704) 2024-09-19T06:15:16.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.595+0000 7feab8c00640 1 -- 172.21.15.3:0/146659215 learned_addr learned my addr 172.21.15.3:0/146659215 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:16.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.595+0000 7feaabe00640 1 --2- 172.21.15.3:0/146659215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff7dda0760 0x55ff7ddbe890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.596+0000 7feab8c00640 1 -- 172.21.15.3:0/146659215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff7dda0760 msgr2=0x55ff7ddbe890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:16.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.596+0000 7feab8c00640 1 --2- 172.21.15.3:0/146659215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff7dda0760 0x55ff7ddbe890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.596+0000 7feab8c00640 1 -- 172.21.15.3:0/146659215 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7ddab020 msgr2=0x55ff7ddbedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:16.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.596+0000 7feab8c00640 1 --2- 172.21.15.3:0/146659215 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7ddab020 0x55ff7ddbedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.596+0000 7feab8c00640 1 -- 172.21.15.3:0/146659215 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff7de24b40 con 0x55ff7dd9fe40 2024-09-19T06:15:16.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.596+0000 7feab9600640 1 --2- 172.21.15.3:0/146659215 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7ddab020 0x55ff7ddbedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:16.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.596+0000 7feab8c00640 1 --2- 172.21.15.3:0/146659215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7dd9fe40 0x55ff7ddbe350 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7feaa409c0a0 tx=0x7feaa40d3bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84664be01e67e21a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:16.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.596+0000 7feaa2000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:15:16.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.596+0000 7feaa2000640 1 -- 172.21.15.3:0/146659215 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa409bee0 con 0x55ff7dd9fe40 2024-09-19T06:15:16.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.596+0000 7feabdfc6740 1 -- 172.21.15.3:0/146659215 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feaa409caa0 con 0x55ff7dd9fe40 2024-09-19T06:15:16.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.596+0000 7feaa2000640 1 -- 172.21.15.3:0/146659215 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7feaa40cda90 con 0x55ff7dd9fe40 2024-09-19T06:15:16.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.597+0000 7feaa2000640 1 -- 172.21.15.3:0/146659215 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feaa40cdc90 con 0x55ff7dd9fe40 2024-09-19T06:15:16.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.597+0000 7feabdfc6740 10 client.26062 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:16.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.597+0000 7feabdfc6740 1 -- 172.21.15.3:0/146659215 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ff7de25dc0 con 0x55ff7dd9fe40 2024-09-19T06:15:16.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.597+0000 7feaa2000640 1 -- 172.21.15.3:0/146659215 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaa409caa0 con 0x55ff7dd9fe40 2024-09-19T06:15:16.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.597+0000 7feaa2000640 1 -- 172.21.15.3:0/146659215 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7feaa40d3ce0 con 0x55ff7dd9fe40 2024-09-19T06:15:16.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.597+0000 7feabdfc6740 10 client.26062 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:16.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.597+0000 7feabdfc6740 10 client.26062 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:15:16.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.597+0000 7feabdfc6740 20 client.26062 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:16.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.597+0000 7feabdfc6740 1 --2- 172.21.15.3:0/146659215 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55ff7de26480 0x55ff7de28870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.597+0000 7feabdfc6740 4 client.26062 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:15:16.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.597+0000 7feabdfc6740 1 -- 172.21.15.3:0/146659215 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ff7dd0de60 con 0x55ff7de26480 2024-09-19T06:15:16.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.598+0000 7feaabe00640 1 --2- 172.21.15.3:0/146659215 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55ff7de26480 0x55ff7de28870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.598+0000 7feaabe00640 1 --2- 172.21.15.3:0/146659215 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55ff7de26480 0x55ff7de28870 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3e0d807958a61292 server_cookie=936ff2c467991d14 in_seq=0 out_seq=0 2024-09-19T06:15:16.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.598+0000 7feaa2000640 10 client.26062 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:15:16.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.599+0000 7feaa2000640 1 -- 172.21.15.3:0/146659215 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ff7dd0de60 con 0x55ff7de26480 2024-09-19T06:15:16.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.599+0000 7feaa2000640 10 client.26062 handle_command_reply: tid=0 2024-09-19T06:15:16.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.599+0000 7feabdfc6740 1 client.26062 shutdown 2024-09-19T06:15:16.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.599+0000 7feabdfc6740 1 -- 172.21.15.3:0/146659215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7dd9fe40 msgr2=0x55ff7ddbe350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:16.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.599+0000 7feabdfc6740 1 --2- 172.21.15.3:0/146659215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7dd9fe40 0x55ff7ddbe350 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7feaa409c0a0 tx=0x7feaa40d3bc0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.599+0000 7feabdfc6740 1 -- 172.21.15.3:0/146659215 shutdown_connections 2024-09-19T06:15:16.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.599+0000 7feabdfc6740 1 --2- 172.21.15.3:0/146659215 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55ff7de26480 0x55ff7de28870 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.599+0000 7feabdfc6740 1 --2- 172.21.15.3:0/146659215 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff7ddab020 0x55ff7ddbedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.599+0000 7feabdfc6740 1 --2- 172.21.15.3:0/146659215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff7dda0760 0x55ff7ddbe890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.599+0000 7feabdfc6740 1 --2- 172.21.15.3:0/146659215 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff7dd9fe40 0x55ff7ddbe350 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.599+0000 7feabdfc6740 1 -- 172.21.15.3:0/146659215 >> 172.21.15.3:0/146659215 conn(0x55ff7dd9c3d0 msgr2=0x55ff7dda97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:16.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.599+0000 7feaa2000640 0 client.26062 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:15:16.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.599+0000 7feabdfc6740 1 -- 172.21.15.3:0/146659215 shutdown_connections 2024-09-19T06:15:16.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.599+0000 7feabdfc6740 1 -- 172.21.15.3:0/146659215 wait complete. 2024-09-19T06:15:16.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.599+0000 7feabdfc6740 20 client.26062 trim_cache size 0 max 16384 2024-09-19T06:15:16.610 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:15:16.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.600+0000 7feaba000640 1 -- 172.21.15.3:0/45835919 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fea980a33b0 msgr2=0x7fea980a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:16.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.600+0000 7feaba000640 1 --2- 172.21.15.3:0/45835919 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fea980a33b0 0x7fea980a5870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7feaac011890 tx=0x7feaac009500 comp rx=0 tx=0).stop 2024-09-19T06:15:16.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.600+0000 7feaba000640 1 -- 172.21.15.3:0/45835919 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feab41019c0 msgr2=0x7feab419a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:16.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.600+0000 7feaba000640 1 --2- 172.21.15.3:0/45835919 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feab41019c0 0x7feab419a4d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7feaa400e9f0 tx=0x7feaa400edf0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.600+0000 7feaba000640 1 -- 172.21.15.3:0/45835919 shutdown_connections 2024-09-19T06:15:16.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.600+0000 7feaba000640 1 --2- 172.21.15.3:0/45835919 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fea980a33b0 0x7fea980a5870 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.600+0000 7feaba000640 1 --2- 172.21.15.3:0/45835919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feab41079c0 0x7feab419eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.600+0000 7feaba000640 1 --2- 172.21.15.3:0/45835919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feab4102360 0x7feab419aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.600+0000 7feaba000640 1 --2- 172.21.15.3:0/45835919 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feab41019c0 0x7feab419a4d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.600+0000 7feaba000640 1 -- 172.21.15.3:0/45835919 >> 172.21.15.3:0/45835919 conn(0x7feab40fd740 msgr2=0x7feab40fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:16.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.600+0000 7feaba000640 1 -- 172.21.15.3:0/45835919 shutdown_connections 2024-09-19T06:15:16.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:16.600+0000 7feaba000640 1 -- 172.21.15.3:0/45835919 wait complete. 2024-09-19T06:15:16.816 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.814+0000 7f9b45c00640 1 -- 172.21.15.3:0/695483747 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b401022d0 msgr2=0x7f9b4010e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:16.817 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.814+0000 7f9b45c00640 1 --2- 172.21.15.3:0/695483747 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b401022d0 0x7f9b4010e800 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9b38009cd0 tx=0x7f9b3802a8f0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.817 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.814+0000 7f9b45c00640 1 -- 172.21.15.3:0/695483747 shutdown_connections 2024-09-19T06:15:16.817 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.814+0000 7f9b45c00640 1 --2- 172.21.15.3:0/695483747 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b401022d0 0x7f9b4010e800 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.817 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.814+0000 7f9b45c00640 1 --2- 172.21.15.3:0/695483747 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b40101930 0x7f9b40101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.817 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.814+0000 7f9b45c00640 1 --2- 172.21.15.3:0/695483747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b40107940 0x7f9b40107d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.817 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.814+0000 7f9b45c00640 1 -- 172.21.15.3:0/695483747 >> 172.21.15.3:0/695483747 conn(0x7f9b400fd630 msgr2=0x7f9b400ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:16.817 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.814+0000 7f9b45c00640 1 -- 172.21.15.3:0/695483747 shutdown_connections 2024-09-19T06:15:16.817 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.814+0000 7f9b45c00640 1 -- 172.21.15.3:0/695483747 wait complete. 2024-09-19T06:15:16.819 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.816+0000 7f9b45c00640 1 Processor -- start 2024-09-19T06:15:16.819 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.816+0000 7f9b45c00640 1 -- start start 2024-09-19T06:15:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.816+0000 7f9b45c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b40101930 0x7f9b400744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.816+0000 7f9b45c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b401022d0 0x7f9b40074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.816+0000 7f9b45c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b40107940 0x7f9b40074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.816+0000 7f9b45c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9b40111d80 con 0x7f9b40107940 2024-09-19T06:15:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.816+0000 7f9b45c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9b40111c00 con 0x7f9b40101930 2024-09-19T06:15:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.816+0000 7f9b45c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9b40111f00 con 0x7f9b401022d0 2024-09-19T06:15:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.816+0000 7f9b45200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b40107940 0x7f9b40074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.816+0000 7f9b3fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b40101930 0x7f9b400744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.816+0000 7f9b37e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b401022d0 0x7f9b40074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.816+0000 7f9b45200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b40107940 0x7f9b40074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50708/0 (socket says 172.21.15.3:50708) 2024-09-19T06:15:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.817+0000 7f9b45200640 1 -- 172.21.15.3:0/3101195569 learned_addr learned my addr 172.21.15.3:0/3101195569 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.817+0000 7f9b45200640 1 -- 172.21.15.3:0/3101195569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b401022d0 msgr2=0x7f9b40074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.817+0000 7f9b45200640 1 --2- 172.21.15.3:0/3101195569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b401022d0 0x7f9b40074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.817+0000 7f9b45200640 1 -- 172.21.15.3:0/3101195569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b40101930 msgr2=0x7f9b400744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.817+0000 7f9b45200640 1 --2- 172.21.15.3:0/3101195569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b40101930 0x7f9b400744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.817+0000 7f9b45200640 1 -- 172.21.15.3:0/3101195569 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b401a66f0 con 0x7f9b40107940 2024-09-19T06:15:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.817+0000 7f9b3fe00640 1 --2- 172.21.15.3:0/3101195569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b40101930 0x7f9b400744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.817+0000 7f9b45200640 1 --2- 172.21.15.3:0/3101195569 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b40107940 0x7f9b40074f70 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9b38009ca0 tx=0x7f9b38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.817+0000 7f9b3d600640 1 -- 172.21.15.3:0/3101195569 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b38003d80 con 0x7f9b40107940 2024-09-19T06:15:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.817+0000 7f9b3d600640 1 -- 172.21.15.3:0/3101195569 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b38040070 con 0x7f9b40107940 2024-09-19T06:15:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.818+0000 7f9b45c00640 1 -- 172.21.15.3:0/3101195569 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b401a6980 con 0x7f9b40107940 2024-09-19T06:15:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.818+0000 7f9b3d600640 1 -- 172.21.15.3:0/3101195569 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b38045a10 con 0x7f9b40107940 2024-09-19T06:15:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.818+0000 7f9b45c00640 1 -- 172.21.15.3:0/3101195569 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b401a6ed0 con 0x7f9b40107940 2024-09-19T06:15:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.822+0000 7f9b4a03e740 1 Processor -- start 2024-09-19T06:15:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.822+0000 7f9b3d600640 1 -- 172.21.15.3:0/3101195569 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f9b38045bd0 con 0x7f9b40107940 2024-09-19T06:15:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.822+0000 7f9b4a03e740 1 -- start start 2024-09-19T06:15:16.825 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.822+0000 7f9b4a03e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd5843b0 0x561bdd584790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.825 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.822+0000 7f9b4a03e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bdd584cd0 0x561bdd58f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.822+0000 7f9b4a03e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bdd58f570 0x561bdd591960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.822+0000 7f9b4a03e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561bdd4ea100 con 0x561bdd5843b0 2024-09-19T06:15:16.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.822+0000 7f9b4a03e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561bdd4921b0 con 0x561bdd584cd0 2024-09-19T06:15:16.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.822+0000 7f9b4a03e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561bdd4e60c0 con 0x561bdd58f570 2024-09-19T06:15:16.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.823+0000 7f9b3fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bdd584cd0 0x561bdd58f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.823+0000 7f9b3fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bdd584cd0 0x561bdd58f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:43904/0 (socket says 172.21.15.3:43904) 2024-09-19T06:15:16.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.823+0000 7f9b3fe00640 1 -- 172.21.15.3:0/1730380723 learned_addr learned my addr 172.21.15.3:0/1730380723 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:16.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.823+0000 7f9b37e00640 1 --2- 172.21.15.3:0/1730380723 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd5843b0 0x561bdd584790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.823+0000 7f9b37e00640 1 --2- 172.21.15.3:0/1730380723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bdd58f570 0x561bdd591960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.823+0000 7f9b3fe00640 1 -- 172.21.15.3:0/1730380723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bdd58f570 msgr2=0x561bdd591960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:16.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.823+0000 7f9b3fe00640 1 --2- 172.21.15.3:0/1730380723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bdd58f570 0x561bdd591960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.823+0000 7f9b3fe00640 1 -- 172.21.15.3:0/1730380723 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd5843b0 msgr2=0x561bdd584790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.823+0000 7f9b3fe00640 1 --2- 172.21.15.3:0/1730380723 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd5843b0 0x561bdd584790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.823+0000 7f9b3fe00640 1 -- 172.21.15.3:0/1730380723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bdd1fd210 con 0x561bdd584cd0 2024-09-19T06:15:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.823+0000 7f9b37e00640 1 --2- 172.21.15.3:0/1730380723 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd5843b0 0x561bdd584790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.823+0000 7f9b3d600640 1 --2- 172.21.15.3:0/3101195569 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9b240a33a0 0x7f9b240a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.823+0000 7f9b3fe00640 1 --2- 172.21.15.3:0/1730380723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bdd584cd0 0x561bdd58f030 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9b300114f0 tx=0x7f9b300119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=894178b3adb316b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.823+0000 7f9b3d600640 1 -- 172.21.15.3:0/3101195569 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f9b380f0c80 con 0x7f9b40107940 2024-09-19T06:15:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.824+0000 7f9b37e00640 1 --2- 172.21.15.3:0/3101195569 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9b240a33a0 0x7f9b240a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.824+0000 7f9b35600640 1 -- 172.21.15.3:0/1730380723 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3001e070 con 0x561bdd584cd0 2024-09-19T06:15:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.824+0000 7f9b35600640 1 -- 172.21.15.3:0/1730380723 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b3000faa0 con 0x561bdd584cd0 2024-09-19T06:15:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.824+0000 7f9b35600640 1 -- 172.21.15.3:0/1730380723 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b30019b90 con 0x561bdd584cd0 2024-09-19T06:15:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.824+0000 7f9b4a03e740 1 -- 172.21.15.3:0/1730380723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bdd584cd0 msgr2=0x561bdd58f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.824+0000 7f9b4a03e740 1 --2- 172.21.15.3:0/1730380723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bdd584cd0 0x561bdd58f030 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9b300114f0 tx=0x7f9b300119b0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.824+0000 7f9b37e00640 1 --2- 172.21.15.3:0/3101195569 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9b240a33a0 0x7f9b240a5860 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x561bdd581ca0 tx=0x7f9b28009770 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.824+0000 7f9b4a03e740 1 -- 172.21.15.3:0/1730380723 shutdown_connections 2024-09-19T06:15:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.824+0000 7f9b4a03e740 1 --2- 172.21.15.3:0/1730380723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bdd58f570 0x561bdd591960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.824+0000 7f9b4a03e740 1 --2- 172.21.15.3:0/1730380723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bdd584cd0 0x561bdd58f030 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.824+0000 7f9b4a03e740 1 --2- 172.21.15.3:0/1730380723 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd5843b0 0x561bdd584790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.824+0000 7f9b4a03e740 1 -- 172.21.15.3:0/1730380723 >> 172.21.15.3:0/1730380723 conn(0x561bdd580920 msgr2=0x561bdd580d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.825+0000 7f9b4a03e740 1 -- 172.21.15.3:0/1730380723 shutdown_connections 2024-09-19T06:15:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.825+0000 7f9b4a03e740 1 -- 172.21.15.3:0/1730380723 wait complete. 2024-09-19T06:15:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.825+0000 7f9b4a03e740 1 -- start start 2024-09-19T06:15:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.825+0000 7f9b4a03e740 1 Processor -- start 2024-09-19T06:15:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.826+0000 7f9b4a03e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd5843b0 0x561bdd58c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.826+0000 7f9b4a03e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bdd584cd0 0x561bdd58cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.826+0000 7f9b4a03e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bdd58f570 0x561bdd58d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.826+0000 7f9b4a03e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561bdd591f90 con 0x561bdd5843b0 2024-09-19T06:15:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.826+0000 7f9b4a03e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561bdd473090 con 0x561bdd584cd0 2024-09-19T06:15:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.826+0000 7f9b4a03e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561bdd592110 con 0x561bdd58f570 2024-09-19T06:15:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.826+0000 7f9b4a03e740 10 client.0 _ll_register_callbacks cb 0x561bdd4c7f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.826+0000 7f9b3fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd5843b0 0x561bdd58c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.833 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.826+0000 7f9b3fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd5843b0 0x561bdd58c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50724/0 (socket says 172.21.15.3:50724) 2024-09-19T06:15:16.833 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.826+0000 7f9b3fe00640 1 -- 172.21.15.3:0/405568629 learned_addr learned my addr 172.21.15.3:0/405568629 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:16.833 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.826+0000 7f9b37e00640 1 --2- 172.21.15.3:0/405568629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bdd584cd0 0x561bdd58cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.833 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.826+0000 7f9b45200640 1 --2- 172.21.15.3:0/405568629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bdd58f570 0x561bdd58d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.833 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.826+0000 7f9b3fe00640 1 -- 172.21.15.3:0/405568629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bdd58f570 msgr2=0x561bdd58d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:16.833 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.826+0000 7f9b3fe00640 1 --2- 172.21.15.3:0/405568629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bdd58f570 0x561bdd58d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.833 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.826+0000 7f9b3fe00640 1 -- 172.21.15.3:0/405568629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bdd584cd0 msgr2=0x561bdd58cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:16.833 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.826+0000 7f9b3fe00640 1 --2- 172.21.15.3:0/405568629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bdd584cd0 0x561bdd58cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.833 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.826+0000 7f9b3fe00640 1 -- 172.21.15.3:0/405568629 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bdd2c9620 con 0x561bdd5843b0 2024-09-19T06:15:16.833 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.827+0000 7f9b3fe00640 1 --2- 172.21.15.3:0/405568629 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd5843b0 0x561bdd58c5d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9b30014040 tx=0x7f9b300056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14cb860028b7db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:16.833 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.827+0000 7f9b2e000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:15:16.833 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.828+0000 7f9b2e000640 1 -- 172.21.15.3:0/405568629 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3001e040 con 0x561bdd5843b0 2024-09-19T06:15:16.833 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.828+0000 7f9b2e000640 1 -- 172.21.15.3:0/405568629 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f9b3000f5c0 con 0x561bdd5843b0 2024-09-19T06:15:16.834 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.828+0000 7f9b4a03e740 1 -- 172.21.15.3:0/405568629 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b3000faa0 con 0x561bdd5843b0 2024-09-19T06:15:16.834 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.828+0000 7f9b2e000640 1 -- 172.21.15.3:0/405568629 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9b3002f050 con 0x561bdd5843b0 2024-09-19T06:15:16.834 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.828+0000 7f9b4a03e740 10 client.16023 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:16.834 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.828+0000 7f9b4a03e740 1 -- 172.21.15.3:0/405568629 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561bdd59de40 con 0x561bdd5843b0 2024-09-19T06:15:16.834 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.828+0000 7f9b2e000640 1 -- 172.21.15.3:0/405568629 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b3000faa0 con 0x561bdd5843b0 2024-09-19T06:15:16.834 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.829+0000 7f9b2e000640 1 -- 172.21.15.3:0/405568629 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9b3002a030 con 0x561bdd5843b0 2024-09-19T06:15:16.834 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.829+0000 7f9b4a03e740 10 client.16023 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:16.834 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.829+0000 7f9b4a03e740 10 client.16023 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:16.834 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.829+0000 7f9b4a03e740 20 client.16023 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:16.834 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.829+0000 7f9b4a03e740 1 --2- 172.21.15.3:0/405568629 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x561bdd59f300 0x561bdd5a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.834 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.829+0000 7f9b4a03e740 4 client.16023 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:16.834 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.829+0000 7f9b4a03e740 1 -- 172.21.15.3:0/405568629 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561bdd4f7830 con 0x561bdd59f300 2024-09-19T06:15:16.835 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.829+0000 7f9b37e00640 1 --2- 172.21.15.3:0/405568629 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x561bdd59f300 0x561bdd5a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.830+0000 7f9b37e00640 1 --2- 172.21.15.3:0/405568629 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x561bdd59f300 0x561bdd5a16f0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dcb0990c297c031 server_cookie=89e4549f33502bf2 in_seq=0 out_seq=0 2024-09-19T06:15:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.830+0000 7f9b2e000640 10 client.16023 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.830+0000 7f9b2e000640 1 -- 172.21.15.3:0/405568629 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561bdd4f7830 con 0x561bdd59f300 2024-09-19T06:15:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.830+0000 7f9b2e000640 10 client.16023 handle_command_reply: tid=0 2024-09-19T06:15:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.830+0000 7f9b4a03e740 1 client.16023 shutdown 2024-09-19T06:15:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.831+0000 7f9b4a03e740 1 -- 172.21.15.3:0/405568629 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd5843b0 msgr2=0x561bdd58c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.831+0000 7f9b4a03e740 1 --2- 172.21.15.3:0/405568629 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd5843b0 0x561bdd58c5d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9b30014040 tx=0x7f9b300056d0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.831+0000 7f9b4a03e740 1 -- 172.21.15.3:0/405568629 shutdown_connections 2024-09-19T06:15:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.831+0000 7f9b4a03e740 1 --2- 172.21.15.3:0/405568629 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x561bdd59f300 0x561bdd5a16f0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.831+0000 7f9b4a03e740 1 --2- 172.21.15.3:0/405568629 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bdd58f570 0x561bdd58d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.831+0000 7f9b4a03e740 1 --2- 172.21.15.3:0/405568629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bdd584cd0 0x561bdd58cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.831+0000 7f9b4a03e740 1 --2- 172.21.15.3:0/405568629 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd5843b0 0x561bdd58c5d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.831+0000 7f9b2e000640 0 client.16023 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.831+0000 7f9b4a03e740 1 -- 172.21.15.3:0/405568629 >> 172.21.15.3:0/405568629 conn(0x561bdd580920 msgr2=0x561bdd586680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.831+0000 7f9b4a03e740 1 -- 172.21.15.3:0/405568629 shutdown_connections 2024-09-19T06:15:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.831+0000 7f9b4a03e740 1 -- 172.21.15.3:0/405568629 wait complete. 2024-09-19T06:15:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.831+0000 7f9b4a03e740 20 client.16023 trim_cache size 0 max 16384 2024-09-19T06:15:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.846+0000 7f9b4a03e740 1 Processor -- start 2024-09-19T06:15:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.846+0000 7f9b4a03e740 1 -- start start 2024-09-19T06:15:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.847+0000 7f9b4a03e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bdd5843b0 0x561bdd5a6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.847+0000 7f9b4a03e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd584cd0 0x561bdd5a7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.847+0000 7f9b4a03e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bdd58f570 0x561bdd589810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.847+0000 7f9b4a03e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9b401af8d0 con 0x561bdd584cd0 2024-09-19T06:15:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.847+0000 7f9b4a03e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9b401b1410 con 0x561bdd58f570 2024-09-19T06:15:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.847+0000 7f9b4a03e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9b401affa0 con 0x561bdd5843b0 2024-09-19T06:15:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.847+0000 7f9b37e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd584cd0 0x561bdd5a7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.847+0000 7f9b37e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd584cd0 0x561bdd5a7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50730/0 (socket says 172.21.15.3:50730) 2024-09-19T06:15:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.847+0000 7f9b37e00640 1 -- 172.21.15.3:0/3265471672 learned_addr learned my addr 172.21.15.3:0/3265471672 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.847+0000 7f9b45200640 1 --2- 172.21.15.3:0/3265471672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bdd58f570 0x561bdd589810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.847+0000 7f9b3fe00640 1 --2- 172.21.15.3:0/3265471672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bdd5843b0 0x561bdd5a6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.847+0000 7f9b37e00640 1 -- 172.21.15.3:0/3265471672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bdd5843b0 msgr2=0x561bdd5a6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.847+0000 7f9b37e00640 1 --2- 172.21.15.3:0/3265471672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bdd5843b0 0x561bdd5a6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.847+0000 7f9b37e00640 1 -- 172.21.15.3:0/3265471672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bdd58f570 msgr2=0x561bdd589810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.847+0000 7f9b37e00640 1 --2- 172.21.15.3:0/3265471672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bdd58f570 0x561bdd589810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.847+0000 7f9b37e00640 1 -- 172.21.15.3:0/3265471672 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bdd584b00 con 0x561bdd584cd0 2024-09-19T06:15:16.853 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.847+0000 7f9b37e00640 1 --2- 172.21.15.3:0/3265471672 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd584cd0 0x561bdd5a7430 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9b280097e0 tx=0x7f9b28019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e620b152c0343789 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:16.853 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.848+0000 7f9b34c00640 1 -- 172.21.15.3:0/3265471672 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b28003bc0 con 0x561bdd584cd0 2024-09-19T06:15:16.853 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.848+0000 7f9b34c00640 1 -- 172.21.15.3:0/3265471672 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b28003d60 con 0x561bdd584cd0 2024-09-19T06:15:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.848+0000 7f9b34c00640 1 -- 172.21.15.3:0/3265471672 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b28023930 con 0x561bdd584cd0 2024-09-19T06:15:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.848+0000 7f9b4a03e740 1 -- 172.21.15.3:0/3265471672 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd584cd0 msgr2=0x561bdd5a7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.848+0000 7f9b4a03e740 1 --2- 172.21.15.3:0/3265471672 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd584cd0 0x561bdd5a7430 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9b280097e0 tx=0x7f9b28019000 comp rx=0 tx=0).stop 2024-09-19T06:15:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.848+0000 7f9b4a03e740 1 -- 172.21.15.3:0/3265471672 shutdown_connections 2024-09-19T06:15:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.848+0000 7f9b4a03e740 1 --2- 172.21.15.3:0/3265471672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bdd58f570 0x561bdd589810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.848+0000 7f9b4a03e740 1 --2- 172.21.15.3:0/3265471672 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd584cd0 0x561bdd5a7430 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.848+0000 7f9b4a03e740 1 --2- 172.21.15.3:0/3265471672 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bdd5843b0 0x561bdd5a6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.848+0000 7f9b4a03e740 1 -- 172.21.15.3:0/3265471672 >> 172.21.15.3:0/3265471672 conn(0x561bdd580920 msgr2=0x561bdd58ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.849+0000 7f9b4a03e740 1 -- 172.21.15.3:0/3265471672 shutdown_connections 2024-09-19T06:15:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.849+0000 7f9b4a03e740 1 -- 172.21.15.3:0/3265471672 wait complete. 2024-09-19T06:15:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.849+0000 7f9b4a03e740 1 -- start start 2024-09-19T06:15:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.849+0000 7f9b4a03e740 1 Processor -- start 2024-09-19T06:15:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.850+0000 7f9b4a03e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd5843b0 0x561bdd592450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.850+0000 7f9b4a03e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bdd584cd0 0x561bdd592990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.850+0000 7f9b4a03e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bdd58f570 0x561bdd592ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.850+0000 7f9b4a03e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9b401b0d40 con 0x561bdd5843b0 2024-09-19T06:15:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.850+0000 7f9b4a03e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9b401b0670 con 0x561bdd58f570 2024-09-19T06:15:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.850+0000 7f9b4a03e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9b401ad8b0 con 0x561bdd584cd0 2024-09-19T06:15:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.850+0000 7f9b4a03e740 10 client.0 _ll_register_callbacks cb 0x7f9b3001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.850+0000 7f9b3fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd5843b0 0x561bdd592450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.850+0000 7f9b3fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd5843b0 0x561bdd592450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50736/0 (socket says 172.21.15.3:50736) 2024-09-19T06:15:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.850+0000 7f9b3fe00640 1 -- 172.21.15.3:0/3903894581 learned_addr learned my addr 172.21.15.3:0/3903894581 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.850+0000 7f9b37e00640 1 --2- 172.21.15.3:0/3903894581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bdd584cd0 0x561bdd592990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.850+0000 7f9b45200640 1 --2- 172.21.15.3:0/3903894581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bdd58f570 0x561bdd592ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.850+0000 7f9b3fe00640 1 -- 172.21.15.3:0/3903894581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bdd584cd0 msgr2=0x561bdd592990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.850+0000 7f9b3fe00640 1 --2- 172.21.15.3:0/3903894581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bdd584cd0 0x561bdd592990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.850+0000 7f9b3fe00640 1 -- 172.21.15.3:0/3903894581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bdd58f570 msgr2=0x561bdd592ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.850+0000 7f9b3fe00640 1 --2- 172.21.15.3:0/3903894581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bdd58f570 0x561bdd592ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.850+0000 7f9b3fe00640 1 -- 172.21.15.3:0/3903894581 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bdd607eb0 con 0x561bdd5843b0 2024-09-19T06:15:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.850+0000 7f9b45200640 1 --2- 172.21.15.3:0/3903894581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bdd58f570 0x561bdd592ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.851+0000 7f9b3fe00640 1 --2- 172.21.15.3:0/3903894581 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd5843b0 0x561bdd592450 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9b30009250 tx=0x7f9b3000ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f0853509b0b9e6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.851+0000 7f9b2e000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:15:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.851+0000 7f9b2e000640 1 -- 172.21.15.3:0/3903894581 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b30038060 con 0x561bdd5843b0 2024-09-19T06:15:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.851+0000 7f9b4a03e740 1 -- 172.21.15.3:0/3903894581 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b28003d60 con 0x561bdd5843b0 2024-09-19T06:15:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.851+0000 7f9b2e000640 1 -- 172.21.15.3:0/3903894581 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f9b30003ac0 con 0x561bdd5843b0 2024-09-19T06:15:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.851+0000 7f9b2e000640 1 -- 172.21.15.3:0/3903894581 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9b3001e040 con 0x561bdd5843b0 2024-09-19T06:15:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.851+0000 7f9b4a03e740 10 client.16029 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.851+0000 7f9b4a03e740 1 -- 172.21.15.3:0/3903894581 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561bdd609140 con 0x561bdd5843b0 2024-09-19T06:15:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.851+0000 7f9b2e000640 1 -- 172.21.15.3:0/3903894581 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b28003d60 con 0x561bdd5843b0 2024-09-19T06:15:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.852+0000 7f9b2e000640 1 -- 172.21.15.3:0/3903894581 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9b3002a040 con 0x561bdd5843b0 2024-09-19T06:15:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.852+0000 7f9b4a03e740 10 client.16029 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.852+0000 7f9b4a03e740 10 client.16029 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.852+0000 7f9b4a03e740 20 client.16029 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.852+0000 7f9b4a03e740 1 --2- 172.21.15.3:0/3903894581 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x561bdd609830 0x561bdd60bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.852+0000 7f9b4a03e740 4 client.16029 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:15:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.852+0000 7f9b4a03e740 1 -- 172.21.15.3:0/3903894581 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561bdd4f1b80 con 0x561bdd609830 2024-09-19T06:15:16.858 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.852+0000 7f9b37e00640 1 --2- 172.21.15.3:0/3903894581 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x561bdd609830 0x561bdd60bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:16.858 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.853+0000 7f9b37e00640 1 --2- 172.21.15.3:0/3903894581 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x561bdd609830 0x561bdd60bc50 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b02f66a52f417a5 server_cookie=23c389dde612da82 in_seq=0 out_seq=0 2024-09-19T06:15:16.858 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.853+0000 7f9b2e000640 10 client.16029 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.867+0000 7f9b2e000640 1 -- 172.21.15.3:0/3903894581 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561bdd4f1b80 con 0x561bdd609830 2024-09-19T06:15:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.867+0000 7f9b2e000640 10 client.16029 handle_command_reply: tid=0 2024-09-19T06:15:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.867+0000 7f9b4a03e740 1 client.16029 shutdown 2024-09-19T06:15:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.867+0000 7f9b4a03e740 1 -- 172.21.15.3:0/3903894581 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd5843b0 msgr2=0x561bdd592450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.867+0000 7f9b4a03e740 1 --2- 172.21.15.3:0/3903894581 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd5843b0 0x561bdd592450 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9b30009250 tx=0x7f9b3000ffd0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.867+0000 7f9b4a03e740 1 -- 172.21.15.3:0/3903894581 shutdown_connections 2024-09-19T06:15:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.867+0000 7f9b4a03e740 1 --2- 172.21.15.3:0/3903894581 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x561bdd609830 0x561bdd60bc50 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.867+0000 7f9b4a03e740 1 --2- 172.21.15.3:0/3903894581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561bdd58f570 0x561bdd592ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.867+0000 7f9b4a03e740 1 --2- 172.21.15.3:0/3903894581 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561bdd584cd0 0x561bdd592990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.867+0000 7f9b2e000640 0 client.16029 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.867+0000 7f9b4a03e740 1 --2- 172.21.15.3:0/3903894581 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561bdd5843b0 0x561bdd592450 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.867+0000 7f9b4a03e740 1 -- 172.21.15.3:0/3903894581 >> 172.21.15.3:0/3903894581 conn(0x561bdd580920 msgr2=0x561bdd57f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.867+0000 7f9b4a03e740 1 -- 172.21.15.3:0/3903894581 shutdown_connections 2024-09-19T06:15:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.867+0000 7f9b4a03e740 1 -- 172.21.15.3:0/3903894581 wait complete. 2024-09-19T06:15:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.867+0000 7f9b4a03e740 20 client.16029 trim_cache size 0 max 16384 2024-09-19T06:15:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:15:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:15:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:15:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:15:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.868+0000 7f9b45c00640 1 -- 172.21.15.3:0/3101195569 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9b240a33a0 msgr2=0x7f9b240a5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.868+0000 7f9b45c00640 1 --2- 172.21.15.3:0/3101195569 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9b240a33a0 0x7f9b240a5860 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x561bdd581ca0 tx=0x7f9b28009770 comp rx=0 tx=0).stop 2024-09-19T06:15:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.868+0000 7f9b45c00640 1 -- 172.21.15.3:0/3101195569 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b40107940 msgr2=0x7f9b40074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.868+0000 7f9b45c00640 1 --2- 172.21.15.3:0/3101195569 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b40107940 0x7f9b40074f70 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9b38009ca0 tx=0x7f9b38004a40 comp rx=0 tx=0).stop 2024-09-19T06:15:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.868+0000 7f9b45c00640 1 -- 172.21.15.3:0/3101195569 shutdown_connections 2024-09-19T06:15:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.868+0000 7f9b45c00640 1 --2- 172.21.15.3:0/3101195569 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9b240a33a0 0x7f9b240a5860 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.868+0000 7f9b45c00640 1 --2- 172.21.15.3:0/3101195569 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9b40107940 0x7f9b40074f70 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.868+0000 7f9b45c00640 1 --2- 172.21.15.3:0/3101195569 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9b401022d0 0x7f9b40074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.868+0000 7f9b45c00640 1 --2- 172.21.15.3:0/3101195569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b40101930 0x7f9b400744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.868+0000 7f9b45c00640 1 -- 172.21.15.3:0/3101195569 >> 172.21.15.3:0/3101195569 conn(0x7f9b400fd630 msgr2=0x7f9b400fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.868+0000 7f9b45c00640 1 -- 172.21.15.3:0/3101195569 shutdown_connections 2024-09-19T06:15:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:16.868+0000 7f9b45c00640 1 -- 172.21.15.3:0/3101195569 wait complete. 2024-09-19T06:15:17.593 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:15:17.969 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:15:18.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:17 smithi059 ceph-mon[35138]: pgmap v90: 97 pgs: 97 active+clean; 3.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-09-19T06:15:18.289 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:17 smithi003 ceph-mon[30893]: pgmap v90: 97 pgs: 97 active+clean; 3.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-09-19T06:15:18.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:17 smithi071 ceph-mon[35662]: pgmap v90: 97 pgs: 97 active+clean; 3.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-09-19T06:15:18.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.569+0000 7f61ee000640 1 -- 172.21.15.3:0/3520751003 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61e81047e0 msgr2=0x7f61e8108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:18.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.569+0000 7f61ee000640 1 --2- 172.21.15.3:0/3520751003 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61e81047e0 0x7f61e8108830 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009900 tx=0x7f61d402a410 comp rx=0 tx=0).stop 2024-09-19T06:15:18.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.569+0000 7f61ee000640 1 -- 172.21.15.3:0/3520751003 shutdown_connections 2024-09-19T06:15:18.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.569+0000 7f61ee000640 1 --2- 172.21.15.3:0/3520751003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61e8108f60 0x7f61e8110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.569+0000 7f61ee000640 1 --2- 172.21.15.3:0/3520751003 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61e81047e0 0x7f61e8108830 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.569+0000 7f61ee000640 1 --2- 172.21.15.3:0/3520751003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61e8103e30 0x7f61e8104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.569+0000 7f61ee000640 1 -- 172.21.15.3:0/3520751003 >> 172.21.15.3:0/3520751003 conn(0x7f61e80ff8d0 msgr2=0x7f61e8101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:18.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.569+0000 7f61ee000640 1 -- 172.21.15.3:0/3520751003 shutdown_connections 2024-09-19T06:15:18.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.569+0000 7f61ee000640 1 -- 172.21.15.3:0/3520751003 wait complete. 2024-09-19T06:15:18.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.570+0000 7f61ee000640 1 Processor -- start 2024-09-19T06:15:18.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.570+0000 7f61ee000640 1 -- start start 2024-09-19T06:15:18.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.571+0000 7f61ee000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61e8103e30 0x7f61e819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:18.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.571+0000 7f61ee000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61e81047e0 0x7f61e819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:18.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.571+0000 7f61ee000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61e8108f60 0x7f61e819ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:18.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.571+0000 7f61ee000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f61e8114010 con 0x7f61e8103e30 2024-09-19T06:15:18.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.571+0000 7f61ee000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f61e8113e90 con 0x7f61e81047e0 2024-09-19T06:15:18.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.571+0000 7f61ee000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f61e8114190 con 0x7f61e8108f60 2024-09-19T06:15:18.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.571+0000 7f61ecc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61e8103e30 0x7f61e819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:18.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.571+0000 7f61ecc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61e8103e30 0x7f61e819a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50768/0 (socket says 172.21.15.3:50768) 2024-09-19T06:15:18.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.571+0000 7f61ecc00640 1 -- 172.21.15.3:0/195908622 learned_addr learned my addr 172.21.15.3:0/195908622 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:18.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.571+0000 7f61e7e00640 1 --2- 172.21.15.3:0/195908622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61e81047e0 0x7f61e819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:18.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.571+0000 7f61ed600640 1 --2- 172.21.15.3:0/195908622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61e8108f60 0x7f61e819ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:18.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.572+0000 7f61ecc00640 1 -- 172.21.15.3:0/195908622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61e8108f60 msgr2=0x7f61e819ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:18.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.572+0000 7f61ecc00640 1 --2- 172.21.15.3:0/195908622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61e8108f60 0x7f61e819ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.572+0000 7f61ecc00640 1 -- 172.21.15.3:0/195908622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61e81047e0 msgr2=0x7f61e819a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:18.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.572+0000 7f61ecc00640 1 --2- 172.21.15.3:0/195908622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61e81047e0 0x7f61e819a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.572+0000 7f61ecc00640 1 -- 172.21.15.3:0/195908622 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e819f420 con 0x7f61e8103e30 2024-09-19T06:15:18.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.572+0000 7f61ecc00640 1 --2- 172.21.15.3:0/195908622 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61e8103e30 0x7f61e819a470 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00e9f0 tx=0x7f61dc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:18.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.572+0000 7f61e5600640 1 -- 172.21.15.3:0/195908622 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc00cd80 con 0x7f61e8103e30 2024-09-19T06:15:18.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.572+0000 7f61e5600640 1 -- 172.21.15.3:0/195908622 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61dc010910 con 0x7f61e8103e30 2024-09-19T06:15:18.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.572+0000 7f61e5600640 1 -- 172.21.15.3:0/195908622 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc018990 con 0x7f61e8103e30 2024-09-19T06:15:18.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.572+0000 7f61ee000640 1 -- 172.21.15.3:0/195908622 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e819f710 con 0x7f61e8103e30 2024-09-19T06:15:18.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.573+0000 7f61ee000640 1 -- 172.21.15.3:0/195908622 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e81a6ff0 con 0x7f61e8103e30 2024-09-19T06:15:18.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.576+0000 7f61e5600640 1 -- 172.21.15.3:0/195908622 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f61dc010ac0 con 0x7f61e8103e30 2024-09-19T06:15:18.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.576+0000 7f61f21e9740 1 Processor -- start 2024-09-19T06:15:18.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.576+0000 7f61f21e9740 1 -- start start 2024-09-19T06:15:18.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.576+0000 7f61f21e9740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe19f31e40 0x55fe19f32220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:18.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.576+0000 7f61f21e9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f32760 0x55fe19f3cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:18.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.576+0000 7f61f21e9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe19f3d020 0x55fe19f3f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:18.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.576+0000 7f61f21e9740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55fe19e983e0 con 0x55fe19f31e40 2024-09-19T06:15:18.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.576+0000 7f61f21e9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fe19e3fd80 con 0x55fe19f32760 2024-09-19T06:15:18.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.576+0000 7f61f21e9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55fe19e943a0 con 0x55fe19f3d020 2024-09-19T06:15:18.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.577+0000 7f61ed600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe19f31e40 0x55fe19f32220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:18.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.577+0000 7f61ed600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe19f31e40 0x55fe19f32220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50782/0 (socket says 172.21.15.3:50782) 2024-09-19T06:15:18.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.577+0000 7f61ed600640 1 -- 172.21.15.3:0/2479397888 learned_addr learned my addr 172.21.15.3:0/2479397888 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:18.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.577+0000 7f61e7e00640 1 --2- 172.21.15.3:0/2479397888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe19f3d020 0x55fe19f3f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:18.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.577+0000 7f61ecc00640 1 --2- 172.21.15.3:0/2479397888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f32760 0x55fe19f3cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:18.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.577+0000 7f61ed600640 1 -- 172.21.15.3:0/2479397888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe19f3d020 msgr2=0x55fe19f3f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:18.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.577+0000 7f61ed600640 1 --2- 172.21.15.3:0/2479397888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe19f3d020 0x55fe19f3f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.577+0000 7f61ed600640 1 -- 172.21.15.3:0/2479397888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f32760 msgr2=0x55fe19f3cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:18.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.577+0000 7f61ed600640 1 --2- 172.21.15.3:0/2479397888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f32760 0x55fe19f3cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.577+0000 7f61ed600640 1 -- 172.21.15.3:0/2479397888 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe19e5eae0 con 0x55fe19f31e40 2024-09-19T06:15:18.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.577+0000 7f61e7e00640 1 --2- 172.21.15.3:0/2479397888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe19f3d020 0x55fe19f3f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:18.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.578+0000 7f61e5600640 1 --2- 172.21.15.3:0/195908622 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f61d00a3430 0x7f61d00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:18.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.578+0000 7f61ed600640 1 --2- 172.21.15.3:0/2479397888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe19f31e40 0x55fe19f32220 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009f50 tx=0x7f61e00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fac73e78729ab9e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:18.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.578+0000 7f61e5600640 1 -- 172.21.15.3:0/195908622 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f61dc0cfff0 con 0x7f61e8103e30 2024-09-19T06:15:18.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.578+0000 7f61d9c00640 1 -- 172.21.15.3:0/2479397888 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e0004b20 con 0x55fe19f31e40 2024-09-19T06:15:18.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.578+0000 7f61d9c00640 1 -- 172.21.15.3:0/2479397888 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61e0004cc0 con 0x55fe19f31e40 2024-09-19T06:15:18.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.578+0000 7f61ecc00640 1 --2- 172.21.15.3:0/195908622 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f61d00a3430 0x7f61d00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:18.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.578+0000 7f61d9c00640 1 -- 172.21.15.3:0/2479397888 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e0005020 con 0x55fe19f31e40 2024-09-19T06:15:18.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.579+0000 7f61f21e9740 1 -- 172.21.15.3:0/2479397888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe19f31e40 msgr2=0x55fe19f32220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:18.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.579+0000 7f61f21e9740 1 --2- 172.21.15.3:0/2479397888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe19f31e40 0x55fe19f32220 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009f50 tx=0x7f61e00118d0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.579+0000 7f61ecc00640 1 --2- 172.21.15.3:0/195908622 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f61d00a3430 0x7f61d00a58f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55fe19f2f230 tx=0x7f61dc000bc0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:18.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.579+0000 7f61f21e9740 1 -- 172.21.15.3:0/2479397888 shutdown_connections 2024-09-19T06:15:18.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.579+0000 7f61f21e9740 1 --2- 172.21.15.3:0/2479397888 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe19f3d020 0x55fe19f3f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.579+0000 7f61f21e9740 1 --2- 172.21.15.3:0/2479397888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f32760 0x55fe19f3cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.579+0000 7f61f21e9740 1 --2- 172.21.15.3:0/2479397888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe19f31e40 0x55fe19f32220 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.579+0000 7f61f21e9740 1 -- 172.21.15.3:0/2479397888 >> 172.21.15.3:0/2479397888 conn(0x55fe19f2e3d0 msgr2=0x55fe19f2e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:18.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.579+0000 7f61f21e9740 1 -- 172.21.15.3:0/2479397888 shutdown_connections 2024-09-19T06:15:18.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.579+0000 7f61f21e9740 1 -- 172.21.15.3:0/2479397888 wait complete. 2024-09-19T06:15:18.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.580+0000 7f61f21e9740 1 -- start start 2024-09-19T06:15:18.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.580+0000 7f61f21e9740 1 Processor -- start 2024-09-19T06:15:18.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.580+0000 7f61f21e9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe19f31e40 0x55fe19f39ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:18.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.580+0000 7f61f21e9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f32760 0x55fe19f3a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:18.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.580+0000 7f61f21e9740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe19f3d020 0x55fe19f3a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:18.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.580+0000 7f61f21e9740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55fe19f3fc40 con 0x55fe19f3d020 2024-09-19T06:15:18.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.580+0000 7f61f21e9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55fe19e530f0 con 0x55fe19f32760 2024-09-19T06:15:18.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.580+0000 7f61f21e9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55fe19f3fdc0 con 0x55fe19f31e40 2024-09-19T06:15:18.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.580+0000 7f61f21e9740 10 client.0 _ll_register_callbacks cb 0x55fe19e3abd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:18.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.581+0000 7f61e7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f32760 0x55fe19f3a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:18.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.581+0000 7f61ed600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe19f3d020 0x55fe19f3a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:18.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.581+0000 7f61e7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f32760 0x55fe19f3a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:43992/0 (socket says 172.21.15.3:43992) 2024-09-19T06:15:18.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.581+0000 7f61e7e00640 1 -- 172.21.15.3:0/523596015 learned_addr learned my addr 172.21.15.3:0/523596015 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:18.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.581+0000 7f61ed600640 1 --2- 172.21.15.3:0/523596015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe19f31e40 0x55fe19f39ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:18.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.581+0000 7f61e7e00640 1 -- 172.21.15.3:0/523596015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe19f31e40 msgr2=0x55fe19f39ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:18.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.581+0000 7f61e7e00640 1 --2- 172.21.15.3:0/523596015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe19f31e40 0x55fe19f39ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.581+0000 7f61e7e00640 1 -- 172.21.15.3:0/523596015 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe19f3d020 msgr2=0x55fe19f3a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:18.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.581+0000 7f61e7e00640 1 --2- 172.21.15.3:0/523596015 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe19f3d020 0x55fe19f3a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.581+0000 7f61e7e00640 1 -- 172.21.15.3:0/523596015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe19c093c0 con 0x55fe19f32760 2024-09-19T06:15:18.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.582+0000 7f61e7e00640 1 --2- 172.21.15.3:0/523596015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f32760 0x55fe19f3a3e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009230 tx=0x7f61d4004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=913ccaa497472192 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:18.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.582+0000 7f61ce000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:15:18.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.582+0000 7f61ce000640 1 -- 172.21.15.3:0/523596015 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4035040 con 0x55fe19f32760 2024-09-19T06:15:18.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.582+0000 7f61f21e9740 1 -- 172.21.15.3:0/523596015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61e0004cc0 con 0x55fe19f32760 2024-09-19T06:15:18.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.582+0000 7f61ce000640 1 -- 172.21.15.3:0/523596015 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f61d4005230 con 0x55fe19f32760 2024-09-19T06:15:18.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.582+0000 7f61ce000640 1 -- 172.21.15.3:0/523596015 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f61d4005430 con 0x55fe19f32760 2024-09-19T06:15:18.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.582+0000 7f61f21e9740 10 client.26087 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:18.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.582+0000 7f61f21e9740 1 -- 172.21.15.3:0/523596015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fe19f4bc60 con 0x55fe19f32760 2024-09-19T06:15:18.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.583+0000 7f61ce000640 1 -- 172.21.15.3:0/523596015 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61e0004cc0 con 0x55fe19f32760 2024-09-19T06:15:18.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.583+0000 7f61ce000640 1 -- 172.21.15.3:0/523596015 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f61d4003b50 con 0x55fe19f32760 2024-09-19T06:15:18.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.583+0000 7f61f21e9740 10 client.26087 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:18.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.583+0000 7f61f21e9740 10 client.26087 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:18.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.583+0000 7f61f21e9740 20 client.26087 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:18.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.583+0000 7f61f21e9740 1 --2- 172.21.15.3:0/523596015 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55fe19f4d070 0x55fe19f4f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:18.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.583+0000 7f61f21e9740 4 client.26087 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:18.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.583+0000 7f61f21e9740 1 -- 172.21.15.3:0/523596015 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe19ea5950 con 0x55fe19f4d070 2024-09-19T06:15:18.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.583+0000 7f61ed600640 1 --2- 172.21.15.3:0/523596015 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55fe19f4d070 0x55fe19f4f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:18.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.584+0000 7f61ed600640 1 --2- 172.21.15.3:0/523596015 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55fe19f4d070 0x55fe19f4f460 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=247df6370167f9a1 server_cookie=8a74d4d7ceb2265b in_seq=0 out_seq=0 2024-09-19T06:15:18.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.584+0000 7f61ce000640 10 client.26087 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:18.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.585+0000 7f61ce000640 1 -- 172.21.15.3:0/523596015 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fe19ea5950 con 0x55fe19f4d070 2024-09-19T06:15:18.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.585+0000 7f61ce000640 10 client.26087 handle_command_reply: tid=0 2024-09-19T06:15:18.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.585+0000 7f61f21e9740 1 client.26087 shutdown 2024-09-19T06:15:18.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.585+0000 7f61f21e9740 1 -- 172.21.15.3:0/523596015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f32760 msgr2=0x55fe19f3a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:18.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.585+0000 7f61f21e9740 1 --2- 172.21.15.3:0/523596015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f32760 0x55fe19f3a3e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009230 tx=0x7f61d4004270 comp rx=0 tx=0).stop 2024-09-19T06:15:18.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.585+0000 7f61f21e9740 1 -- 172.21.15.3:0/523596015 shutdown_connections 2024-09-19T06:15:18.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.585+0000 7f61f21e9740 1 --2- 172.21.15.3:0/523596015 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55fe19f4d070 0x55fe19f4f460 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.585+0000 7f61f21e9740 1 --2- 172.21.15.3:0/523596015 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe19f3d020 0x55fe19f3a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.585+0000 7f61f21e9740 1 --2- 172.21.15.3:0/523596015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f32760 0x55fe19f3a3e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.585+0000 7f61f21e9740 1 --2- 172.21.15.3:0/523596015 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe19f31e40 0x55fe19f39ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.585+0000 7f61ce000640 0 client.26087 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:18.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.585+0000 7f61f21e9740 1 -- 172.21.15.3:0/523596015 >> 172.21.15.3:0/523596015 conn(0x55fe19f2e3d0 msgr2=0x55fe19f34100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:18.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.585+0000 7f61f21e9740 1 -- 172.21.15.3:0/523596015 shutdown_connections 2024-09-19T06:15:18.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.585+0000 7f61f21e9740 1 -- 172.21.15.3:0/523596015 wait complete. 2024-09-19T06:15:18.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.585+0000 7f61f21e9740 20 client.26087 trim_cache size 0 max 16384 2024-09-19T06:15:18.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.599+0000 7f61f21e9740 1 Processor -- start 2024-09-19T06:15:18.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.599+0000 7f61f21e9740 1 -- start start 2024-09-19T06:15:18.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.600+0000 7f61f21e9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe19f31e40 0x55fe19f3a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:18.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.600+0000 7f61f21e9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f32760 0x55fe19f54d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:18.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.600+0000 7f61f21e9740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe19f3d020 0x55fe19f55250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:18.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.600+0000 7f61f21e9740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f61e81af9d0 con 0x55fe19f3d020 2024-09-19T06:15:18.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.600+0000 7f61f21e9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f61e81b1510 con 0x55fe19f32760 2024-09-19T06:15:18.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.600+0000 7f61f21e9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f61e81b00a0 con 0x55fe19f31e40 2024-09-19T06:15:18.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.600+0000 7f61e7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f32760 0x55fe19f54d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:18.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.600+0000 7f61e7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f32760 0x55fe19f54d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44004/0 (socket says 172.21.15.3:44004) 2024-09-19T06:15:18.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.600+0000 7f61e7e00640 1 -- 172.21.15.3:0/2272160603 learned_addr learned my addr 172.21.15.3:0/2272160603 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:18.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.600+0000 7f61ed600640 1 --2- 172.21.15.3:0/2272160603 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe19f3d020 0x55fe19f55250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:18.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.600+0000 7f61ed600640 1 --2- 172.21.15.3:0/2272160603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe19f31e40 0x55fe19f3a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:18.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.601+0000 7f61e7e00640 1 -- 172.21.15.3:0/2272160603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe19f31e40 msgr2=0x55fe19f3a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:18.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.601+0000 7f61e7e00640 1 --2- 172.21.15.3:0/2272160603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe19f31e40 0x55fe19f3a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.601+0000 7f61e7e00640 1 -- 172.21.15.3:0/2272160603 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe19f3d020 msgr2=0x55fe19f55250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:18.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.601+0000 7f61e7e00640 1 --2- 172.21.15.3:0/2272160603 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe19f3d020 0x55fe19f55250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.601+0000 7f61e7e00640 1 -- 172.21.15.3:0/2272160603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe19f34cb0 con 0x55fe19f32760 2024-09-19T06:15:18.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.601+0000 7f61e7e00640 1 --2- 172.21.15.3:0/2272160603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f32760 0x55fe19f54d10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f61d4006010 tx=0x7f61d4005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d851b4ebd7367e99 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:18.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.601+0000 7f61d9200640 1 -- 172.21.15.3:0/2272160603 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4052030 con 0x55fe19f32760 2024-09-19T06:15:18.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.601+0000 7f61d9200640 1 -- 172.21.15.3:0/2272160603 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61d4040070 con 0x55fe19f32760 2024-09-19T06:15:18.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.601+0000 7f61d9200640 1 -- 172.21.15.3:0/2272160603 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4035070 con 0x55fe19f32760 2024-09-19T06:15:18.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.602+0000 7f61f21e9740 1 -- 172.21.15.3:0/2272160603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f32760 msgr2=0x55fe19f54d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:18.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.602+0000 7f61f21e9740 1 --2- 172.21.15.3:0/2272160603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f32760 0x55fe19f54d10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f61d4006010 tx=0x7f61d4005a20 comp rx=0 tx=0).stop 2024-09-19T06:15:18.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.602+0000 7f61f21e9740 1 -- 172.21.15.3:0/2272160603 shutdown_connections 2024-09-19T06:15:18.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.602+0000 7f61f21e9740 1 --2- 172.21.15.3:0/2272160603 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe19f3d020 0x55fe19f55250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.602+0000 7f61f21e9740 1 --2- 172.21.15.3:0/2272160603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f32760 0x55fe19f54d10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.602+0000 7f61f21e9740 1 --2- 172.21.15.3:0/2272160603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe19f31e40 0x55fe19f3a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.602+0000 7f61f21e9740 1 -- 172.21.15.3:0/2272160603 >> 172.21.15.3:0/2272160603 conn(0x55fe19f2e3d0 msgr2=0x55fe19f3bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:18.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.602+0000 7f61f21e9740 1 -- 172.21.15.3:0/2272160603 shutdown_connections 2024-09-19T06:15:18.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.602+0000 7f61f21e9740 1 -- 172.21.15.3:0/2272160603 wait complete. 2024-09-19T06:15:18.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.602+0000 7f61f21e9740 1 -- start start 2024-09-19T06:15:18.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.603+0000 7f61f21e9740 1 Processor -- start 2024-09-19T06:15:18.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.603+0000 7f61f21e9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f31e40 0x55fe19f36eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:18.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.603+0000 7f61f21e9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe19f32760 0x55fe19f373f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:18.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.603+0000 7f61f21e9740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe19f3d020 0x55fe19f37930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:18.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.603+0000 7f61f21e9740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f61e81b0e40 con 0x55fe19f3d020 2024-09-19T06:15:18.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.603+0000 7f61f21e9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f61e81b0770 con 0x55fe19f31e40 2024-09-19T06:15:18.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.603+0000 7f61f21e9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f61e81ad9b0 con 0x55fe19f32760 2024-09-19T06:15:18.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.603+0000 7f61f21e9740 10 client.0 _ll_register_callbacks cb 0x7f61e00093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:18.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.603+0000 7f61ed600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f31e40 0x55fe19f36eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:18.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.603+0000 7f61ed600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f31e40 0x55fe19f36eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44012/0 (socket says 172.21.15.3:44012) 2024-09-19T06:15:18.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.603+0000 7f61ed600640 1 -- 172.21.15.3:0/2618724729 learned_addr learned my addr 172.21.15.3:0/2618724729 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:18.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.604+0000 7f61e7e00640 1 --2- 172.21.15.3:0/2618724729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe19f32760 0x55fe19f373f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:18.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.604+0000 7f61ed600640 1 --2- 172.21.15.3:0/2618724729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe19f3d020 0x55fe19f37930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:18.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.604+0000 7f61e7e00640 1 -- 172.21.15.3:0/2618724729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f31e40 msgr2=0x55fe19f36eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:18.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.604+0000 7f61e7e00640 1 --2- 172.21.15.3:0/2618724729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f31e40 0x55fe19f36eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.604+0000 7f61e7e00640 1 -- 172.21.15.3:0/2618724729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe19f3d020 msgr2=0x55fe19f37930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:18.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.604+0000 7f61e7e00640 1 --2- 172.21.15.3:0/2618724729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe19f3d020 0x55fe19f37930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.604+0000 7f61e7e00640 1 -- 172.21.15.3:0/2618724729 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe19fb6d10 con 0x55fe19f32760 2024-09-19T06:15:18.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.604+0000 7f61ed600640 1 --2- 172.21.15.3:0/2618724729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe19f3d020 0x55fe19f37930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:18.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.604+0000 7f61e7e00640 1 --2- 172.21.15.3:0/2618724729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe19f32760 0x55fe19f373f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f61d402a930 tx=0x7f61d4005cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cee0b69aca8f728 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:18.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.604+0000 7f61ce000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:15:18.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.605+0000 7f61ce000640 1 -- 172.21.15.3:0/2618724729 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4035040 con 0x55fe19f32760 2024-09-19T06:15:18.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.605+0000 7f61f21e9740 1 -- 172.21.15.3:0/2618724729 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61d4040070 con 0x55fe19f32760 2024-09-19T06:15:18.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.605+0000 7f61ce000640 1 -- 172.21.15.3:0/2618724729 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f61d4031860 con 0x55fe19f32760 2024-09-19T06:15:18.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.605+0000 7f61ce000640 1 -- 172.21.15.3:0/2618724729 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f61d4005850 con 0x55fe19f32760 2024-09-19T06:15:18.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.605+0000 7f61f21e9740 10 client.26098 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:18.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.605+0000 7f61f21e9740 1 -- 172.21.15.3:0/2618724729 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fe19fb7fd0 con 0x55fe19f32760 2024-09-19T06:15:18.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.605+0000 7f61ce000640 1 -- 172.21.15.3:0/2618724729 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61d4040070 con 0x55fe19f32760 2024-09-19T06:15:18.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.606+0000 7f61ce000640 1 -- 172.21.15.3:0/2618724729 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f61d40050b0 con 0x55fe19f32760 2024-09-19T06:15:18.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.606+0000 7f61f21e9740 10 client.26098 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:18.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.606+0000 7f61f21e9740 10 client.26098 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:18.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.606+0000 7f61f21e9740 20 client.26098 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:18.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.606+0000 7f61f21e9740 1 --2- 172.21.15.3:0/2618724729 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55fe19fb8510 0x55fe19fba930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:18.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.606+0000 7f61f21e9740 4 client.26098 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:15:18.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.606+0000 7f61f21e9740 1 -- 172.21.15.3:0/2618724729 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fe19e9fe60 con 0x55fe19fb8510 2024-09-19T06:15:18.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.606+0000 7f61ed600640 1 --2- 172.21.15.3:0/2618724729 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55fe19fb8510 0x55fe19fba930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:18.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.607+0000 7f61ed600640 1 --2- 172.21.15.3:0/2618724729 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55fe19fb8510 0x55fe19fba930 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa0b3261020805a8 server_cookie=d36df47661e7060 in_seq=0 out_seq=0 2024-09-19T06:15:18.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.607+0000 7f61ce000640 10 client.26098 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:18.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.607+0000 7f61ce000640 1 -- 172.21.15.3:0/2618724729 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fe19e9fe60 con 0x55fe19fb8510 2024-09-19T06:15:18.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.607+0000 7f61ce000640 10 client.26098 handle_command_reply: tid=0 2024-09-19T06:15:18.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.607+0000 7f61f21e9740 1 client.26098 shutdown 2024-09-19T06:15:18.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.607+0000 7f61f21e9740 1 -- 172.21.15.3:0/2618724729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe19f32760 msgr2=0x55fe19f373f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:18.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.607+0000 7f61f21e9740 1 --2- 172.21.15.3:0/2618724729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe19f32760 0x55fe19f373f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f61d402a930 tx=0x7f61d4005cb0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.607+0000 7f61f21e9740 1 -- 172.21.15.3:0/2618724729 shutdown_connections 2024-09-19T06:15:18.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.607+0000 7f61f21e9740 1 --2- 172.21.15.3:0/2618724729 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55fe19fb8510 0x55fe19fba930 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.607+0000 7f61f21e9740 1 --2- 172.21.15.3:0/2618724729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55fe19f3d020 0x55fe19f37930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.607+0000 7f61f21e9740 1 --2- 172.21.15.3:0/2618724729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55fe19f32760 0x55fe19f373f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.607+0000 7f61f21e9740 1 --2- 172.21.15.3:0/2618724729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe19f31e40 0x55fe19f36eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.607+0000 7f61f21e9740 1 -- 172.21.15.3:0/2618724729 >> 172.21.15.3:0/2618724729 conn(0x55fe19f2e3d0 msgr2=0x55fe19f33890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:18.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.607+0000 7f61ce000640 0 client.26098 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:18.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.607+0000 7f61f21e9740 1 -- 172.21.15.3:0/2618724729 shutdown_connections 2024-09-19T06:15:18.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.607+0000 7f61f21e9740 1 -- 172.21.15.3:0/2618724729 wait complete. 2024-09-19T06:15:18.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.607+0000 7f61f21e9740 20 client.26098 trim_cache size 0 max 16384 2024-09-19T06:15:18.614 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:15:18.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.608+0000 7f61ee000640 1 -- 172.21.15.3:0/195908622 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f61d00a3430 msgr2=0x7f61d00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:18.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.608+0000 7f61ee000640 1 --2- 172.21.15.3:0/195908622 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f61d00a3430 0x7f61d00a58f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55fe19f2f230 tx=0x7f61dc000bc0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.608+0000 7f61ee000640 1 -- 172.21.15.3:0/195908622 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61e8103e30 msgr2=0x7f61e819a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:18.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.608+0000 7f61ee000640 1 --2- 172.21.15.3:0/195908622 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61e8103e30 0x7f61e819a470 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00e9f0 tx=0x7f61dc00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.608+0000 7f61ee000640 1 -- 172.21.15.3:0/195908622 shutdown_connections 2024-09-19T06:15:18.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.608+0000 7f61ee000640 1 --2- 172.21.15.3:0/195908622 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f61d00a3430 0x7f61d00a58f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.608+0000 7f61ee000640 1 --2- 172.21.15.3:0/195908622 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f61e8108f60 0x7f61e819ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.608+0000 7f61ee000640 1 --2- 172.21.15.3:0/195908622 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61e81047e0 0x7f61e819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.608+0000 7f61ee000640 1 --2- 172.21.15.3:0/195908622 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f61e8103e30 0x7f61e819a470 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:18.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.608+0000 7f61ee000640 1 -- 172.21.15.3:0/195908622 >> 172.21.15.3:0/195908622 conn(0x7f61e80ff8d0 msgr2=0x7f61e8100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:18.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.608+0000 7f61ee000640 1 -- 172.21.15.3:0/195908622 shutdown_connections 2024-09-19T06:15:18.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:18.608+0000 7f61ee000640 1 -- 172.21.15.3:0/195908622 wait complete. 2024-09-19T06:15:20.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:20 smithi059 ceph-mon[35138]: pgmap v91: 97 pgs: 97 active+clean; 3.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 43 KiB/s wr, 26 op/s 2024-09-19T06:15:20.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:20 smithi003 ceph-mon[30893]: pgmap v91: 97 pgs: 97 active+clean; 3.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 43 KiB/s wr, 26 op/s 2024-09-19T06:15:20.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:20 smithi071 ceph-mon[35662]: pgmap v91: 97 pgs: 97 active+clean; 3.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 43 KiB/s wr, 26 op/s 2024-09-19T06:15:20.527 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:15:20.528 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:15:20.937 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:15:21.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.509+0000 7faeb3200640 1 -- 172.21.15.3:0/4152285563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faeb4108f40 msgr2=0x7faeb4110ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:21.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.509+0000 7faeb3200640 1 --2- 172.21.15.3:0/4152285563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faeb4108f40 0x7faeb4110ac0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7faeac009ca0 tx=0x7faeac02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.509+0000 7faeb3200640 1 -- 172.21.15.3:0/4152285563 shutdown_connections 2024-09-19T06:15:21.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.509+0000 7faeb3200640 1 --2- 172.21.15.3:0/4152285563 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faeb4108f40 0x7faeb4110ac0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.509+0000 7faeb3200640 1 --2- 172.21.15.3:0/4152285563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeb41047c0 0x7faeb4108810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.509+0000 7faeb3200640 1 --2- 172.21.15.3:0/4152285563 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faeb4103e10 0x7faeb41041f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.509+0000 7faeb3200640 1 -- 172.21.15.3:0/4152285563 >> 172.21.15.3:0/4152285563 conn(0x7faeb40ff8b0 msgr2=0x7faeb4101cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:21.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.509+0000 7faeb3200640 1 -- 172.21.15.3:0/4152285563 shutdown_connections 2024-09-19T06:15:21.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.509+0000 7faeb3200640 1 -- 172.21.15.3:0/4152285563 wait complete. 2024-09-19T06:15:21.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.510+0000 7faeb3200640 1 Processor -- start 2024-09-19T06:15:21.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.510+0000 7faeb3200640 1 -- start start 2024-09-19T06:15:21.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.510+0000 7faeb3200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faeb4103e10 0x7faeb419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:21.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.510+0000 7faeb3200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeb41047c0 0x7faeb419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:21.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.510+0000 7faeb3200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faeb4108f40 0x7faeb419ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:21.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.511+0000 7faeb3200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7faeb4113ff0 con 0x7faeb4108f40 2024-09-19T06:15:21.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.511+0000 7faeb3200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faeb4113e70 con 0x7faeb41047c0 2024-09-19T06:15:21.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.511+0000 7faeb3200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faeb4114170 con 0x7faeb4103e10 2024-09-19T06:15:21.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.511+0000 7faeb1e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faeb4103e10 0x7faeb419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:21.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.511+0000 7faeb1e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faeb4103e10 0x7faeb419a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:44902/0 (socket says 172.21.15.3:44902) 2024-09-19T06:15:21.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.511+0000 7faeb1e00640 1 -- 172.21.15.3:0/3455593418 learned_addr learned my addr 172.21.15.3:0/3455593418 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:21.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.511+0000 7faeb2800640 1 --2- 172.21.15.3:0/3455593418 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faeb4108f40 0x7faeb419ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:21.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.511+0000 7faeb1400640 1 --2- 172.21.15.3:0/3455593418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeb41047c0 0x7faeb419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:21.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.511+0000 7faeb1400640 1 -- 172.21.15.3:0/3455593418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faeb4103e10 msgr2=0x7faeb419a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:21.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.511+0000 7faeb1400640 1 --2- 172.21.15.3:0/3455593418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faeb4103e10 0x7faeb419a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.511+0000 7faeb1400640 1 -- 172.21.15.3:0/3455593418 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faeb4108f40 msgr2=0x7faeb419ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:21.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.511+0000 7faeb1400640 1 --2- 172.21.15.3:0/3455593418 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faeb4108f40 0x7faeb419ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.511+0000 7faeb1400640 1 -- 172.21.15.3:0/3455593418 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb419f420 con 0x7faeb41047c0 2024-09-19T06:15:21.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.511+0000 7faeb1e00640 1 --2- 172.21.15.3:0/3455593418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faeb4103e10 0x7faeb419a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:21.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.511+0000 7faeb2800640 1 --2- 172.21.15.3:0/3455593418 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faeb4108f40 0x7faeb419ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:21.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.512+0000 7faeb1400640 1 --2- 172.21.15.3:0/3455593418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeb41047c0 0x7faeb419a9b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7faea000e9f0 tx=0x7faea000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:21.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.512+0000 7faeaaa00640 1 -- 172.21.15.3:0/3455593418 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea000cd80 con 0x7faeb41047c0 2024-09-19T06:15:21.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.512+0000 7faeb3200640 1 -- 172.21.15.3:0/3455593418 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeb419f710 con 0x7faeb41047c0 2024-09-19T06:15:21.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.512+0000 7faeaaa00640 1 -- 172.21.15.3:0/3455593418 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faea00035f0 con 0x7faeb41047c0 2024-09-19T06:15:21.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.512+0000 7faeaaa00640 1 -- 172.21.15.3:0/3455593418 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea0010670 con 0x7faeb41047c0 2024-09-19T06:15:21.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.512+0000 7faeb3200640 1 -- 172.21.15.3:0/3455593418 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeb41a6ff0 con 0x7faeb41047c0 2024-09-19T06:15:21.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.515+0000 7faebb3ca740 1 Processor -- start 2024-09-19T06:15:21.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.515+0000 7faeaaa00640 1 -- 172.21.15.3:0/3455593418 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7faea00037a0 con 0x7faeb41047c0 2024-09-19T06:15:21.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.515+0000 7faebb3ca740 1 -- start start 2024-09-19T06:15:21.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.516+0000 7faebb3ca740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55addb18dcb0 0x55addb18e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:21.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.516+0000 7faebb3ca740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55addb18e5d0 0x55addb198950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:21.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.516+0000 7faebb3ca740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb198e90 0x55addb19b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:21.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.516+0000 7faebb3ca740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55addb0f4290 con 0x55addb198e90 2024-09-19T06:15:21.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.516+0000 7faebb3ca740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55addb09bb40 con 0x55addb18dcb0 2024-09-19T06:15:21.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.516+0000 7faebb3ca740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55addb0f0250 con 0x55addb18e5d0 2024-09-19T06:15:21.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.516+0000 7faeb1e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55addb18e5d0 0x55addb198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:21.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.516+0000 7faeb1400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb198e90 0x55addb19b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:21.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.516+0000 7faeb1e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55addb18e5d0 0x55addb198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:44918/0 (socket says 172.21.15.3:44918) 2024-09-19T06:15:21.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.516+0000 7faeb1e00640 1 -- 172.21.15.3:0/3617151339 learned_addr learned my addr 172.21.15.3:0/3617151339 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:21.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.516+0000 7faeb2800640 1 --2- 172.21.15.3:0/3617151339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55addb18dcb0 0x55addb18e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:21.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.517+0000 7faeb1e00640 1 -- 172.21.15.3:0/3617151339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55addb18dcb0 msgr2=0x55addb18e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:21.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.517+0000 7faeb1e00640 1 --2- 172.21.15.3:0/3617151339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55addb18dcb0 0x55addb18e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.517+0000 7faeb1e00640 1 -- 172.21.15.3:0/3617151339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb198e90 msgr2=0x55addb19b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:21.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.517+0000 7faeb1e00640 1 --2- 172.21.15.3:0/3617151339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb198e90 0x55addb19b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.517+0000 7faeb1e00640 1 -- 172.21.15.3:0/3617151339 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55addae656a0 con 0x55addb18e5d0 2024-09-19T06:15:21.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.517+0000 7faeb1400640 1 --2- 172.21.15.3:0/3617151339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb198e90 0x55addb19b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:21.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.517+0000 7faeb1e00640 1 --2- 172.21.15.3:0/3617151339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55addb18e5d0 0x55addb198950 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faea4010580 tx=0x7faea4010a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e628a02151b2eac2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:21.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.517+0000 7faeaaa00640 1 --2- 172.21.15.3:0/3455593418 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fae980a33b0 0x7fae980a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:21.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.517+0000 7fae9f000640 1 -- 172.21.15.3:0/3617151339 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea400e890 con 0x55addb18e5d0 2024-09-19T06:15:21.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.517+0000 7fae9f000640 1 -- 172.21.15.3:0/3617151339 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faea401c480 con 0x55addb18e5d0 2024-09-19T06:15:21.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.517+0000 7fae9f000640 1 -- 172.21.15.3:0/3617151339 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea4011640 con 0x55addb18e5d0 2024-09-19T06:15:21.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.517+0000 7faeaaa00640 1 -- 172.21.15.3:0/3455593418 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7faea00cffe0 con 0x7faeb41047c0 2024-09-19T06:15:21.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.517+0000 7faeb2800640 1 --2- 172.21.15.3:0/3455593418 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fae980a33b0 0x7fae980a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:21.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.518+0000 7faebb3ca740 1 -- 172.21.15.3:0/3617151339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55addb18e5d0 msgr2=0x55addb198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:21.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.518+0000 7faebb3ca740 1 --2- 172.21.15.3:0/3617151339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55addb18e5d0 0x55addb198950 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faea4010580 tx=0x7faea4010a40 comp rx=0 tx=0).stop 2024-09-19T06:15:21.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.518+0000 7faeb2800640 1 --2- 172.21.15.3:0/3455593418 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fae980a33b0 0x7fae980a5870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faeac006010 tx=0x7faeac005d80 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:21.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.518+0000 7faebb3ca740 1 -- 172.21.15.3:0/3617151339 shutdown_connections 2024-09-19T06:15:21.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.518+0000 7faebb3ca740 1 --2- 172.21.15.3:0/3617151339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb198e90 0x55addb19b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.518+0000 7faebb3ca740 1 --2- 172.21.15.3:0/3617151339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55addb18e5d0 0x55addb198950 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.518+0000 7faebb3ca740 1 --2- 172.21.15.3:0/3617151339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55addb18dcb0 0x55addb18e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.518+0000 7faebb3ca740 1 -- 172.21.15.3:0/3617151339 >> 172.21.15.3:0/3617151339 conn(0x55addb18a240 msgr2=0x55addb18a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:21.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.519+0000 7faebb3ca740 1 -- 172.21.15.3:0/3617151339 shutdown_connections 2024-09-19T06:15:21.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.519+0000 7faebb3ca740 1 -- 172.21.15.3:0/3617151339 wait complete. 2024-09-19T06:15:21.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.519+0000 7faebb3ca740 1 -- start start 2024-09-19T06:15:21.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.519+0000 7faebb3ca740 1 Processor -- start 2024-09-19T06:15:21.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.520+0000 7faebb3ca740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55addb18dcb0 0x55addb198750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:21.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.520+0000 7faebb3ca740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb18e5d0 0x55addb195a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:21.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.520+0000 7faebb3ca740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55addb198e90 0x55addb195f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:21.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.520+0000 7faebb3ca740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55addb19bb00 con 0x55addb18e5d0 2024-09-19T06:15:21.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.520+0000 7faebb3ca740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55addb0aefa0 con 0x55addb198e90 2024-09-19T06:15:21.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.520+0000 7faebb3ca740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55addb19bc80 con 0x55addb18dcb0 2024-09-19T06:15:21.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.520+0000 7faebb3ca740 10 client.0 _ll_register_callbacks cb 0x55addae02ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:21.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.520+0000 7faeb1400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb18e5d0 0x55addb195a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:21.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.520+0000 7faeb1400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb18e5d0 0x55addb195a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50848/0 (socket says 172.21.15.3:50848) 2024-09-19T06:15:21.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.520+0000 7faeb1400640 1 -- 172.21.15.3:0/1907928156 learned_addr learned my addr 172.21.15.3:0/1907928156 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:21.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.520+0000 7faeb1e00640 1 --2- 172.21.15.3:0/1907928156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55addb18dcb0 0x55addb198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:21.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.521+0000 7faeb2800640 1 --2- 172.21.15.3:0/1907928156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55addb198e90 0x55addb195f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:21.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.521+0000 7faeb1e00640 1 -- 172.21.15.3:0/1907928156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55addb198e90 msgr2=0x55addb195f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:21.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.521+0000 7faeb1e00640 1 --2- 172.21.15.3:0/1907928156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55addb198e90 0x55addb195f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.521+0000 7faeb1e00640 1 -- 172.21.15.3:0/1907928156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb18e5d0 msgr2=0x55addb195a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:21.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.521+0000 7faeb1e00640 1 --2- 172.21.15.3:0/1907928156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb18e5d0 0x55addb195a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.521+0000 7faeb1e00640 1 -- 172.21.15.3:0/1907928156 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55addb196770 con 0x55addb18dcb0 2024-09-19T06:15:21.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.521+0000 7faeb2800640 1 --2- 172.21.15.3:0/1907928156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55addb198e90 0x55addb195f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:15:21.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.521+0000 7faeb1400640 1 --2- 172.21.15.3:0/1907928156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb18e5d0 0x55addb195a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:21.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.521+0000 7faeb1e00640 1 --2- 172.21.15.3:0/1907928156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55addb18dcb0 0x55addb198750 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faea4010f40 tx=0x7faea401c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=116a1d6855b94d39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:21.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.521+0000 7fae93400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:15:21.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.521+0000 7fae93400640 1 -- 172.21.15.3:0/1907928156 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea402b060 con 0x55addb18dcb0 2024-09-19T06:15:21.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.521+0000 7fae93400640 1 -- 172.21.15.3:0/1907928156 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7faea400e690 con 0x55addb18dcb0 2024-09-19T06:15:21.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.521+0000 7faebb3ca740 1 -- 172.21.15.3:0/1907928156 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faea401c480 con 0x55addb18dcb0 2024-09-19T06:15:21.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.522+0000 7fae93400640 1 -- 172.21.15.3:0/1907928156 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faea400bd90 con 0x55addb18dcb0 2024-09-19T06:15:21.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.522+0000 7faebb3ca740 10 client.26110 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:21.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.522+0000 7faebb3ca740 1 -- 172.21.15.3:0/1907928156 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55addb1a79a0 con 0x55addb18dcb0 2024-09-19T06:15:21.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.522+0000 7fae93400640 1 -- 172.21.15.3:0/1907928156 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faea401c480 con 0x55addb18dcb0 2024-09-19T06:15:21.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.522+0000 7fae93400640 1 -- 172.21.15.3:0/1907928156 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7faea4011830 con 0x55addb18dcb0 2024-09-19T06:15:21.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.522+0000 7faebb3ca740 10 client.26110 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:21.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.522+0000 7faebb3ca740 10 client.26110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:21.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.522+0000 7faebb3ca740 20 client.26110 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:21.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.523+0000 7faebb3ca740 1 --2- 172.21.15.3:0/1907928156 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55addb1a8e60 0x55addb1ab250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:21.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.523+0000 7faebb3ca740 4 client.26110 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:21.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.523+0000 7faebb3ca740 1 -- 172.21.15.3:0/1907928156 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55addb101800 con 0x55addb1a8e60 2024-09-19T06:15:21.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.523+0000 7faeb1400640 1 --2- 172.21.15.3:0/1907928156 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55addb1a8e60 0x55addb1ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:21.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.524+0000 7faeb1400640 1 --2- 172.21.15.3:0/1907928156 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55addb1a8e60 0x55addb1ab250 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec8d6b5ebed62998 server_cookie=37fbc1c802f01889 in_seq=0 out_seq=0 2024-09-19T06:15:21.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.524+0000 7fae93400640 10 client.26110 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:21.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.524+0000 7fae93400640 1 -- 172.21.15.3:0/1907928156 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55addb101800 con 0x55addb1a8e60 2024-09-19T06:15:21.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.524+0000 7fae93400640 10 client.26110 handle_command_reply: tid=0 2024-09-19T06:15:21.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.524+0000 7faebb3ca740 1 client.26110 shutdown 2024-09-19T06:15:21.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.525+0000 7faebb3ca740 1 -- 172.21.15.3:0/1907928156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55addb18dcb0 msgr2=0x55addb198750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:21.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.525+0000 7faebb3ca740 1 --2- 172.21.15.3:0/1907928156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55addb18dcb0 0x55addb198750 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faea4010f40 tx=0x7faea401c860 comp rx=0 tx=0).stop 2024-09-19T06:15:21.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.525+0000 7faebb3ca740 1 -- 172.21.15.3:0/1907928156 shutdown_connections 2024-09-19T06:15:21.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.525+0000 7faebb3ca740 1 --2- 172.21.15.3:0/1907928156 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55addb1a8e60 0x55addb1ab250 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.525+0000 7faebb3ca740 1 --2- 172.21.15.3:0/1907928156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55addb198e90 0x55addb195f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.525+0000 7faebb3ca740 1 --2- 172.21.15.3:0/1907928156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb18e5d0 0x55addb195a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.525+0000 7faebb3ca740 1 --2- 172.21.15.3:0/1907928156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55addb18dcb0 0x55addb198750 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.525+0000 7faebb3ca740 1 -- 172.21.15.3:0/1907928156 >> 172.21.15.3:0/1907928156 conn(0x55addb18a240 msgr2=0x55addb18ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:21.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.525+0000 7fae93400640 0 client.26110 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:21.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.525+0000 7faebb3ca740 1 -- 172.21.15.3:0/1907928156 shutdown_connections 2024-09-19T06:15:21.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.525+0000 7faebb3ca740 1 -- 172.21.15.3:0/1907928156 wait complete. 2024-09-19T06:15:21.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.525+0000 7faebb3ca740 20 client.26110 trim_cache size 0 max 16384 2024-09-19T06:15:21.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.543+0000 7faebb3ca740 1 Processor -- start 2024-09-19T06:15:21.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.543+0000 7faebb3ca740 1 -- start start 2024-09-19T06:15:21.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.544+0000 7faebb3ca740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb18a240 0x55addb191000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:21.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.544+0000 7faebb3ca740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55addb18dcb0 0x55addb1b0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:21.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.544+0000 7faebb3ca740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55addb18e5d0 0x55addb1b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:21.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.544+0000 7faebb3ca740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7faeb41af9e0 con 0x55addb18a240 2024-09-19T06:15:21.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.544+0000 7faebb3ca740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faeb41b1520 con 0x55addb18e5d0 2024-09-19T06:15:21.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.544+0000 7faebb3ca740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faeb41b00b0 con 0x55addb18dcb0 2024-09-19T06:15:21.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.544+0000 7faeb1e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb18a240 0x55addb191000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:21.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.544+0000 7faeb1e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb18a240 0x55addb191000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50856/0 (socket says 172.21.15.3:50856) 2024-09-19T06:15:21.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.544+0000 7faeb1e00640 1 -- 172.21.15.3:0/561199771 learned_addr learned my addr 172.21.15.3:0/561199771 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:21.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.544+0000 7faeb2800640 1 --2- 172.21.15.3:0/561199771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55addb18e5d0 0x55addb1b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:21.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.544+0000 7faeb1400640 1 --2- 172.21.15.3:0/561199771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55addb18dcb0 0x55addb1b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:21.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.545+0000 7faeb1e00640 1 -- 172.21.15.3:0/561199771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55addb18dcb0 msgr2=0x55addb1b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:21.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.545+0000 7faeb1e00640 1 --2- 172.21.15.3:0/561199771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55addb18dcb0 0x55addb1b0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.545+0000 7faeb1e00640 1 -- 172.21.15.3:0/561199771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55addb18e5d0 msgr2=0x55addb1b0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:21.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.545+0000 7faeb1e00640 1 --2- 172.21.15.3:0/561199771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55addb18e5d0 0x55addb1b0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.545+0000 7faeb1e00640 1 -- 172.21.15.3:0/561199771 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55addb189890 con 0x55addb18a240 2024-09-19T06:15:21.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.545+0000 7faeb1e00640 1 --2- 172.21.15.3:0/561199771 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb18a240 0x55addb191000 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7faea4010a80 tx=0x7faea4005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283889330e8d6e4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:21.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.545+0000 7fae9e600640 1 -- 172.21.15.3:0/561199771 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea402b070 con 0x55addb18a240 2024-09-19T06:15:21.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.545+0000 7fae9e600640 1 -- 172.21.15.3:0/561199771 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faea401c480 con 0x55addb18a240 2024-09-19T06:15:21.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.545+0000 7fae9e600640 1 -- 172.21.15.3:0/561199771 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea400e8f0 con 0x55addb18a240 2024-09-19T06:15:21.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.546+0000 7faebb3ca740 1 -- 172.21.15.3:0/561199771 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb18a240 msgr2=0x55addb191000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:21.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.546+0000 7faebb3ca740 1 --2- 172.21.15.3:0/561199771 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb18a240 0x55addb191000 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7faea4010a80 tx=0x7faea4005f30 comp rx=0 tx=0).stop 2024-09-19T06:15:21.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.546+0000 7faebb3ca740 1 -- 172.21.15.3:0/561199771 shutdown_connections 2024-09-19T06:15:21.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.546+0000 7faebb3ca740 1 --2- 172.21.15.3:0/561199771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55addb18e5d0 0x55addb1b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.546+0000 7faebb3ca740 1 --2- 172.21.15.3:0/561199771 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55addb18dcb0 0x55addb1b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.546+0000 7faebb3ca740 1 --2- 172.21.15.3:0/561199771 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb18a240 0x55addb191000 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.546+0000 7faebb3ca740 1 -- 172.21.15.3:0/561199771 >> 172.21.15.3:0/561199771 conn(0x55addb1960a0 msgr2=0x55addb1908f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:21.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.546+0000 7faebb3ca740 1 -- 172.21.15.3:0/561199771 shutdown_connections 2024-09-19T06:15:21.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.546+0000 7faebb3ca740 1 -- 172.21.15.3:0/561199771 wait complete. 2024-09-19T06:15:21.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.547+0000 7faebb3ca740 1 -- start start 2024-09-19T06:15:21.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.547+0000 7faebb3ca740 1 Processor -- start 2024-09-19T06:15:21.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.548+0000 7faebb3ca740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55addb18a240 0x55addb1a1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:21.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.548+0000 7faebb3ca740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55addb18dcb0 0x55addb19c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:21.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.548+0000 7faebb3ca740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb18e5d0 0x55addb19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:21.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.548+0000 7faebb3ca740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7faeb41b0e50 con 0x55addb18e5d0 2024-09-19T06:15:21.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.548+0000 7faebb3ca740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faeb41b0780 con 0x55addb18a240 2024-09-19T06:15:21.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.548+0000 7faebb3ca740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faeb41ad9c0 con 0x55addb18dcb0 2024-09-19T06:15:21.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.548+0000 7faebb3ca740 10 client.0 _ll_register_callbacks cb 0x7faeac009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:21.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.548+0000 7faeb2800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb18e5d0 0x55addb19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:21.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.548+0000 7faeb1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55addb18a240 0x55addb1a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:21.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.548+0000 7faeb2800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb18e5d0 0x55addb19cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50870/0 (socket says 172.21.15.3:50870) 2024-09-19T06:15:21.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.548+0000 7faeb2800640 1 -- 172.21.15.3:0/3254335169 learned_addr learned my addr 172.21.15.3:0/3254335169 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:21.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.548+0000 7faeb1400640 1 --2- 172.21.15.3:0/3254335169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55addb18dcb0 0x55addb19c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:21.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.549+0000 7faeb2800640 1 -- 172.21.15.3:0/3254335169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55addb18dcb0 msgr2=0x55addb19c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:21.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.549+0000 7faeb2800640 1 --2- 172.21.15.3:0/3254335169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55addb18dcb0 0x55addb19c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.549+0000 7faeb2800640 1 -- 172.21.15.3:0/3254335169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55addb18a240 msgr2=0x55addb1a1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:21.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.549+0000 7faeb2800640 1 --2- 172.21.15.3:0/3254335169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55addb18a240 0x55addb1a1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.549+0000 7faeb2800640 1 -- 172.21.15.3:0/3254335169 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55addb19d310 con 0x55addb18e5d0 2024-09-19T06:15:21.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.549+0000 7faeb1400640 1 --2- 172.21.15.3:0/3254335169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55addb18dcb0 0x55addb19c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:21.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.549+0000 7faeb1e00640 1 --2- 172.21.15.3:0/3254335169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55addb18a240 0x55addb1a1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:21.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.549+0000 7faeb2800640 1 --2- 172.21.15.3:0/3254335169 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb18e5d0 0x55addb19cd20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7faeac02aeb0 tx=0x7faeac02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc4c4758b69eec5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:21.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.549+0000 7fae93400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:15:21.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.549+0000 7fae93400640 1 -- 172.21.15.3:0/3254335169 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeac004250 con 0x55addb18e5d0 2024-09-19T06:15:21.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.550+0000 7faebb3ca740 1 -- 172.21.15.3:0/3254335169 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faea401c480 con 0x55addb18e5d0 2024-09-19T06:15:21.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.550+0000 7fae93400640 1 -- 172.21.15.3:0/3254335169 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7faeac043030 con 0x55addb18e5d0 2024-09-19T06:15:21.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.550+0000 7fae93400640 1 -- 172.21.15.3:0/3254335169 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faeac0043f0 con 0x55addb18e5d0 2024-09-19T06:15:21.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.550+0000 7faebb3ca740 10 client.16065 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:21.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.550+0000 7faebb3ca740 1 -- 172.21.15.3:0/3254335169 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55addb213680 con 0x55addb18e5d0 2024-09-19T06:15:21.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.550+0000 7fae93400640 1 -- 172.21.15.3:0/3254335169 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faea401c480 con 0x55addb18e5d0 2024-09-19T06:15:21.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.550+0000 7fae93400640 1 -- 172.21.15.3:0/3254335169 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7faeac0305c0 con 0x55addb18e5d0 2024-09-19T06:15:21.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.550+0000 7faebb3ca740 10 client.16065 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:21.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.550+0000 7faebb3ca740 10 client.16065 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:21.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.550+0000 7faebb3ca740 20 client.16065 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:21.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.551+0000 7faebb3ca740 1 --2- 172.21.15.3:0/3254335169 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55addb198e90 0x55addb215da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:21.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.551+0000 7faebb3ca740 4 client.16065 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:15:21.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.551+0000 7faebb3ca740 1 -- 172.21.15.3:0/3254335169 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55addb0fbd10 con 0x55addb198e90 2024-09-19T06:15:21.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.551+0000 7faeb1e00640 1 --2- 172.21.15.3:0/3254335169 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55addb198e90 0x55addb215da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:21.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.552+0000 7faeb1e00640 1 --2- 172.21.15.3:0/3254335169 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55addb198e90 0x55addb215da0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d01eebcbfb9c6fb server_cookie=6b96763d18011b3c in_seq=0 out_seq=0 2024-09-19T06:15:21.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.552+0000 7fae93400640 10 client.16065 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:21.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.552+0000 7fae93400640 1 -- 172.21.15.3:0/3254335169 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55addb0fbd10 con 0x55addb198e90 2024-09-19T06:15:21.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.552+0000 7fae93400640 10 client.16065 handle_command_reply: tid=0 2024-09-19T06:15:21.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.553+0000 7faebb3ca740 1 client.16065 shutdown 2024-09-19T06:15:21.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.553+0000 7faebb3ca740 1 -- 172.21.15.3:0/3254335169 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb18e5d0 msgr2=0x55addb19cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:21.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.553+0000 7faebb3ca740 1 --2- 172.21.15.3:0/3254335169 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb18e5d0 0x55addb19cd20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7faeac02aeb0 tx=0x7faeac02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.553+0000 7faebb3ca740 1 -- 172.21.15.3:0/3254335169 shutdown_connections 2024-09-19T06:15:21.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.553+0000 7faebb3ca740 1 --2- 172.21.15.3:0/3254335169 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55addb198e90 0x55addb215da0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.553+0000 7faebb3ca740 1 --2- 172.21.15.3:0/3254335169 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55addb18e5d0 0x55addb19cd20 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.553+0000 7faebb3ca740 1 --2- 172.21.15.3:0/3254335169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55addb18dcb0 0x55addb19c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.553+0000 7faebb3ca740 1 --2- 172.21.15.3:0/3254335169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55addb18a240 0x55addb1a1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.553+0000 7fae93400640 0 client.16065 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:21.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.553+0000 7faebb3ca740 1 -- 172.21.15.3:0/3254335169 >> 172.21.15.3:0/3254335169 conn(0x55addb1960a0 msgr2=0x55addb194af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:21.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.553+0000 7faebb3ca740 1 -- 172.21.15.3:0/3254335169 shutdown_connections 2024-09-19T06:15:21.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.553+0000 7faebb3ca740 1 -- 172.21.15.3:0/3254335169 wait complete. 2024-09-19T06:15:21.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.553+0000 7faebb3ca740 20 client.16065 trim_cache size 0 max 16384 2024-09-19T06:15:21.557 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:15:21.557 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": 0, 2024-09-19T06:15:21.558 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_tag": "26165896-c273-4dbf-a808-60702719755a", 2024-09-19T06:15:21.558 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": "asynchronous" 2024-09-19T06:15:21.558 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:15:21.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.554+0000 7faeb3200640 1 -- 172.21.15.3:0/3455593418 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fae980a33b0 msgr2=0x7fae980a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:21.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.554+0000 7faeb3200640 1 --2- 172.21.15.3:0/3455593418 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fae980a33b0 0x7fae980a5870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faeac006010 tx=0x7faeac005d80 comp rx=0 tx=0).stop 2024-09-19T06:15:21.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.554+0000 7faeb3200640 1 -- 172.21.15.3:0/3455593418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeb41047c0 msgr2=0x7faeb419a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:21.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.554+0000 7faeb3200640 1 --2- 172.21.15.3:0/3455593418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeb41047c0 0x7faeb419a9b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7faea000e9f0 tx=0x7faea000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.554+0000 7faeb3200640 1 -- 172.21.15.3:0/3455593418 shutdown_connections 2024-09-19T06:15:21.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.554+0000 7faeb3200640 1 --2- 172.21.15.3:0/3455593418 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fae980a33b0 0x7fae980a5870 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.554+0000 7faeb3200640 1 --2- 172.21.15.3:0/3455593418 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faeb4108f40 0x7faeb419ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.554+0000 7faeb3200640 1 --2- 172.21.15.3:0/3455593418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeb41047c0 0x7faeb419a9b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.554+0000 7faeb3200640 1 --2- 172.21.15.3:0/3455593418 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faeb4103e10 0x7faeb419a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:21.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.554+0000 7faeb3200640 1 -- 172.21.15.3:0/3455593418 >> 172.21.15.3:0/3455593418 conn(0x7faeb40ff8b0 msgr2=0x7faeb4100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:21.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.554+0000 7faeb3200640 1 -- 172.21.15.3:0/3455593418 shutdown_connections 2024-09-19T06:15:21.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:21.555+0000 7faeb3200640 1 -- 172.21.15.3:0/3455593418 wait complete. 2024-09-19T06:15:22.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:22 smithi059 ceph-mon[35138]: pgmap v92: 97 pgs: 97 active+clean; 3.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 KiB/s wr, 15 op/s 2024-09-19T06:15:22.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:22 smithi003 ceph-mon[30893]: pgmap v92: 97 pgs: 97 active+clean; 3.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 KiB/s wr, 15 op/s 2024-09-19T06:15:22.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:22 smithi071 ceph-mon[35662]: pgmap v92: 97 pgs: 97 active+clean; 3.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 KiB/s wr, 15 op/s 2024-09-19T06:15:22.493 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:15:22.883 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:15:23.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:23 smithi059 ceph-mon[35138]: scrub queued for path: / 2024-09-19T06:15:23.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:23 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:15:23.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:23 smithi059 ceph-mon[35138]: scrub summary: active paths [/] 2024-09-19T06:15:23.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:23 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:15:23.332 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:23 smithi003 ceph-mon[30893]: scrub queued for path: / 2024-09-19T06:15:23.332 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:23 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:15:23.332 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:23 smithi003 ceph-mon[30893]: scrub summary: active paths [/] 2024-09-19T06:15:23.332 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:23 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:15:23.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:23 smithi071 ceph-mon[35662]: scrub queued for path: / 2024-09-19T06:15:23.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:23 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:15:23.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:23 smithi071 ceph-mon[35662]: scrub summary: active paths [/] 2024-09-19T06:15:23.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:23 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:15:23.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.446+0000 7faf8b200640 1 -- 172.21.15.3:0/449450451 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf8c077040 msgr2=0x7faf8c112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:23.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.446+0000 7faf8b200640 1 --2- 172.21.15.3:0/449450451 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf8c077040 0x7faf8c112330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faf74009860 tx=0x7faf7402a340 comp rx=0 tx=0).stop 2024-09-19T06:15:23.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.446+0000 7faf8b200640 1 -- 172.21.15.3:0/449450451 shutdown_connections 2024-09-19T06:15:23.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.446+0000 7faf8b200640 1 --2- 172.21.15.3:0/449450451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf8c112870 0x7faf8c114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.446+0000 7faf8b200640 1 --2- 172.21.15.3:0/449450451 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf8c077040 0x7faf8c112330 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.446+0000 7faf8b200640 1 --2- 172.21.15.3:0/449450451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf8c076720 0x7faf8c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.446+0000 7faf8b200640 1 -- 172.21.15.3:0/449450451 >> 172.21.15.3:0/449450451 conn(0x7faf8c0ff910 msgr2=0x7faf8c101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:23.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.446+0000 7faf8b200640 1 -- 172.21.15.3:0/449450451 shutdown_connections 2024-09-19T06:15:23.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.446+0000 7faf8b200640 1 -- 172.21.15.3:0/449450451 wait complete. 2024-09-19T06:15:23.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.447+0000 7faf8b200640 1 Processor -- start 2024-09-19T06:15:23.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.447+0000 7faf8b200640 1 -- start start 2024-09-19T06:15:23.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.448+0000 7faf8b200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf8c076720 0x7faf8c1a4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:23.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.448+0000 7faf8b200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf8c077040 0x7faf8c1a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:23.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.448+0000 7faf8b200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf8c112870 0x7faf8c19e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:23.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.448+0000 7faf8b200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c1183e0 con 0x7faf8c076720 2024-09-19T06:15:23.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.448+0000 7faf8b200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c118260 con 0x7faf8c077040 2024-09-19T06:15:23.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.448+0000 7faf8b200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c118560 con 0x7faf8c112870 2024-09-19T06:15:23.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.448+0000 7faf89e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf8c076720 0x7faf8c1a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:23.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.448+0000 7faf89e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf8c076720 0x7faf8c1a4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50892/0 (socket says 172.21.15.3:50892) 2024-09-19T06:15:23.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.448+0000 7faf89e00640 1 -- 172.21.15.3:0/558525041 learned_addr learned my addr 172.21.15.3:0/558525041 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:23.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.448+0000 7faf83e00640 1 --2- 172.21.15.3:0/558525041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf8c077040 0x7faf8c1a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:23.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.448+0000 7faf8a800640 1 --2- 172.21.15.3:0/558525041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf8c112870 0x7faf8c19e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:23.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.449+0000 7faf83e00640 1 -- 172.21.15.3:0/558525041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf8c112870 msgr2=0x7faf8c19e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:23.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.449+0000 7faf83e00640 1 --2- 172.21.15.3:0/558525041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf8c112870 0x7faf8c19e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.449+0000 7faf83e00640 1 -- 172.21.15.3:0/558525041 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf8c076720 msgr2=0x7faf8c1a4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:23.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.449+0000 7faf83e00640 1 --2- 172.21.15.3:0/558525041 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf8c076720 0x7faf8c1a4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.449+0000 7faf83e00640 1 -- 172.21.15.3:0/558525041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8c19ef60 con 0x7faf8c077040 2024-09-19T06:15:23.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.449+0000 7faf89e00640 1 --2- 172.21.15.3:0/558525041 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf8c076720 0x7faf8c1a4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:23.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.449+0000 7faf83e00640 1 --2- 172.21.15.3:0/558525041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf8c077040 0x7faf8c1a4b80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faf7402a860 tx=0x7faf74033b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:23.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.449+0000 7faf82a00640 1 -- 172.21.15.3:0/558525041 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74037040 con 0x7faf8c077040 2024-09-19T06:15:23.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.449+0000 7faf8b200640 1 -- 172.21.15.3:0/558525041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf8c19f1f0 con 0x7faf8c077040 2024-09-19T06:15:23.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.449+0000 7faf82a00640 1 -- 172.21.15.3:0/558525041 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf74033d50 con 0x7faf8c077040 2024-09-19T06:15:23.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.449+0000 7faf82a00640 1 -- 172.21.15.3:0/558525041 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74003960 con 0x7faf8c077040 2024-09-19T06:15:23.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.449+0000 7faf8b200640 1 -- 172.21.15.3:0/558525041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf8c1ab4a0 con 0x7faf8c077040 2024-09-19T06:15:23.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.452+0000 7faf93bf3740 1 Processor -- start 2024-09-19T06:15:23.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.453+0000 7faf93bf3740 1 -- start start 2024-09-19T06:15:23.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.453+0000 7faf93bf3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b1dcc4d50 0x562b1dcc5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:23.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.453+0000 7faf93bf3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dcc5670 0x562b1dccf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:23.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.453+0000 7faf93bf3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b1dccff30 0x562b1dcd2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:23.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.453+0000 7faf82a00640 1 -- 172.21.15.3:0/558525041 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7faf74042020 con 0x7faf8c077040 2024-09-19T06:15:23.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.453+0000 7faf93bf3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562b1dc2b3e0 con 0x562b1dcc5670 2024-09-19T06:15:23.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.453+0000 7faf93bf3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562b1dbd2d80 con 0x562b1dcc4d50 2024-09-19T06:15:23.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.453+0000 7faf93bf3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562b1dc273a0 con 0x562b1dccff30 2024-09-19T06:15:23.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.453+0000 7faf8a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b1dcc4d50 0x562b1dcc5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:23.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.453+0000 7faf8a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b1dcc4d50 0x562b1dcc5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44098/0 (socket says 172.21.15.3:44098) 2024-09-19T06:15:23.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.453+0000 7faf8a800640 1 -- 172.21.15.3:0/3637783476 learned_addr learned my addr 172.21.15.3:0/3637783476 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:23.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.453+0000 7faf89e00640 1 --2- 172.21.15.3:0/3637783476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dcc5670 0x562b1dccf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:23.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.454+0000 7faf83e00640 1 --2- 172.21.15.3:0/3637783476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b1dccff30 0x562b1dcd2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:23.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.454+0000 7faf89e00640 1 -- 172.21.15.3:0/3637783476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b1dccff30 msgr2=0x562b1dcd2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:23.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.454+0000 7faf89e00640 1 --2- 172.21.15.3:0/3637783476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b1dccff30 0x562b1dcd2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.454+0000 7faf89e00640 1 -- 172.21.15.3:0/3637783476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b1dcc4d50 msgr2=0x562b1dcc5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:23.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.454+0000 7faf89e00640 1 --2- 172.21.15.3:0/3637783476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b1dcc4d50 0x562b1dcc5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.454+0000 7faf89e00640 1 -- 172.21.15.3:0/3637783476 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b1dbf1ae0 con 0x562b1dcc5670 2024-09-19T06:15:23.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.455+0000 7faf89e00640 1 --2- 172.21.15.3:0/3637783476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dcc5670 0x562b1dccf9f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7faf7c0114f0 tx=0x7faf7c0119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2cd3587f1c12b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:23.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.455+0000 7faf7b400640 1 -- 172.21.15.3:0/3637783476 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c01e070 con 0x562b1dcc5670 2024-09-19T06:15:23.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.455+0000 7faf82a00640 1 --2- 172.21.15.3:0/558525041 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7faf700a33b0 0x7faf700a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:23.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.455+0000 7faf7b400640 1 -- 172.21.15.3:0/3637783476 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf7c0035f0 con 0x562b1dcc5670 2024-09-19T06:15:23.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.455+0000 7faf7b400640 1 -- 172.21.15.3:0/3637783476 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c00f800 con 0x562b1dcc5670 2024-09-19T06:15:23.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.455+0000 7faf82a00640 1 -- 172.21.15.3:0/558525041 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7faf740ef1d0 con 0x7faf8c077040 2024-09-19T06:15:23.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.455+0000 7faf8a800640 1 --2- 172.21.15.3:0/558525041 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7faf700a33b0 0x7faf700a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:23.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.456+0000 7faf93bf3740 1 -- 172.21.15.3:0/3637783476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dcc5670 msgr2=0x562b1dccf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:23.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.456+0000 7faf93bf3740 1 --2- 172.21.15.3:0/3637783476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dcc5670 0x562b1dccf9f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7faf7c0114f0 tx=0x7faf7c0119b0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.456+0000 7faf93bf3740 1 -- 172.21.15.3:0/3637783476 shutdown_connections 2024-09-19T06:15:23.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.456+0000 7faf93bf3740 1 --2- 172.21.15.3:0/3637783476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b1dccff30 0x562b1dcd2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.456+0000 7faf93bf3740 1 --2- 172.21.15.3:0/3637783476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dcc5670 0x562b1dccf9f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.456+0000 7faf93bf3740 1 --2- 172.21.15.3:0/3637783476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b1dcc4d50 0x562b1dcc5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.456+0000 7faf93bf3740 1 -- 172.21.15.3:0/3637783476 >> 172.21.15.3:0/3637783476 conn(0x562b1dcc12e0 msgr2=0x562b1dcc16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:23.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.456+0000 7faf93bf3740 1 -- 172.21.15.3:0/3637783476 shutdown_connections 2024-09-19T06:15:23.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.456+0000 7faf93bf3740 1 -- 172.21.15.3:0/3637783476 wait complete. 2024-09-19T06:15:23.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.457+0000 7faf8a800640 1 --2- 172.21.15.3:0/558525041 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7faf700a33b0 0x7faf700a5870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faf8400e560 tx=0x7faf84010040 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:23.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.457+0000 7faf93bf3740 1 -- start start 2024-09-19T06:15:23.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.457+0000 7faf93bf3740 1 Processor -- start 2024-09-19T06:15:23.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.458+0000 7faf93bf3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b1dcc4d50 0x562b1dcccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:23.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.458+0000 7faf93bf3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dcc5670 0x562b1dccd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:23.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.458+0000 7faf93bf3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b1dccff30 0x562b1dccd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:23.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.458+0000 7faf93bf3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562b1dcd2ba0 con 0x562b1dcc5670 2024-09-19T06:15:23.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.458+0000 7faf93bf3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562b1dbe60f0 con 0x562b1dcc4d50 2024-09-19T06:15:23.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.458+0000 7faf93bf3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562b1dcd2d20 con 0x562b1dccff30 2024-09-19T06:15:23.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.458+0000 7faf93bf3740 10 client.0 _ll_register_callbacks cb 0x562b1dbd79e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:23.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.458+0000 7faf83e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dcc5670 0x562b1dccd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:23.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.458+0000 7faf83e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dcc5670 0x562b1dccd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50908/0 (socket says 172.21.15.3:50908) 2024-09-19T06:15:23.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.458+0000 7faf83e00640 1 -- 172.21.15.3:0/2988189261 learned_addr learned my addr 172.21.15.3:0/2988189261 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:23.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.458+0000 7faf8a800640 1 --2- 172.21.15.3:0/2988189261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b1dccff30 0x562b1dccd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:23.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.458+0000 7faf89e00640 1 --2- 172.21.15.3:0/2988189261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b1dcc4d50 0x562b1dcccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:23.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.458+0000 7faf83e00640 1 -- 172.21.15.3:0/2988189261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b1dccff30 msgr2=0x562b1dccd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:23.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.458+0000 7faf83e00640 1 --2- 172.21.15.3:0/2988189261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b1dccff30 0x562b1dccd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.458+0000 7faf83e00640 1 -- 172.21.15.3:0/2988189261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b1dcc4d50 msgr2=0x562b1dcccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:23.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.458+0000 7faf83e00640 1 --2- 172.21.15.3:0/2988189261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b1dcc4d50 0x562b1dcccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.458+0000 7faf83e00640 1 -- 172.21.15.3:0/2988189261 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b1d99c3c0 con 0x562b1dcc5670 2024-09-19T06:15:23.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.459+0000 7faf83e00640 1 --2- 172.21.15.3:0/2988189261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dcc5670 0x562b1dccd320 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7faf74005e00 tx=0x7faf740b7200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d747e558054a1db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:23.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.459+0000 7faf6fe00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:15:23.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.459+0000 7faf6fe00640 1 -- 172.21.15.3:0/2988189261 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf740baec0 con 0x562b1dcc5670 2024-09-19T06:15:23.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.459+0000 7faf6fe00640 1 -- 172.21.15.3:0/2988189261 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7faf740bb7c0 con 0x562b1dcc5670 2024-09-19T06:15:23.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.459+0000 7faf93bf3740 1 -- 172.21.15.3:0/2988189261 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf7c0035f0 con 0x562b1dcc5670 2024-09-19T06:15:23.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.459+0000 7faf6fe00640 1 -- 172.21.15.3:0/2988189261 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faf740ecd50 con 0x562b1dcc5670 2024-09-19T06:15:23.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.459+0000 7faf93bf3740 10 client.16077 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:23.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.459+0000 7faf93bf3740 1 -- 172.21.15.3:0/2988189261 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562b1dcde850 con 0x562b1dcc5670 2024-09-19T06:15:23.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.460+0000 7faf6fe00640 1 -- 172.21.15.3:0/2988189261 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf7c0035f0 con 0x562b1dcc5670 2024-09-19T06:15:23.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.460+0000 7faf6fe00640 1 -- 172.21.15.3:0/2988189261 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7faf7403a070 con 0x562b1dcc5670 2024-09-19T06:15:23.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.460+0000 7faf93bf3740 10 client.16077 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:23.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.460+0000 7faf93bf3740 10 client.16077 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:23.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.460+0000 7faf93bf3740 20 client.16077 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:23.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.460+0000 7faf93bf3740 1 --2- 172.21.15.3:0/2988189261 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562b1dcdfc90 0x562b1dce2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:23.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.460+0000 7faf93bf3740 4 client.16077 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:23.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.460+0000 7faf93bf3740 1 -- 172.21.15.3:0/2988189261 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b1dc38950 con 0x562b1dcdfc90 2024-09-19T06:15:23.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.460+0000 7faf89e00640 1 --2- 172.21.15.3:0/2988189261 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562b1dcdfc90 0x562b1dce2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:23.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.461+0000 7faf89e00640 1 --2- 172.21.15.3:0/2988189261 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562b1dcdfc90 0x562b1dce2120 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3d88756c9db69d1 server_cookie=aa68a963d0f19d3f in_seq=0 out_seq=0 2024-09-19T06:15:23.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.461+0000 7faf6fe00640 10 client.16077 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:23.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.462+0000 7faf6fe00640 1 -- 172.21.15.3:0/2988189261 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562b1dc38950 con 0x562b1dcdfc90 2024-09-19T06:15:23.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.462+0000 7faf6fe00640 10 client.16077 handle_command_reply: tid=0 2024-09-19T06:15:23.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.462+0000 7faf93bf3740 1 client.16077 shutdown 2024-09-19T06:15:23.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.462+0000 7faf93bf3740 1 -- 172.21.15.3:0/2988189261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dcc5670 msgr2=0x562b1dccd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:23.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.462+0000 7faf93bf3740 1 --2- 172.21.15.3:0/2988189261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dcc5670 0x562b1dccd320 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7faf74005e00 tx=0x7faf740b7200 comp rx=0 tx=0).stop 2024-09-19T06:15:23.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.462+0000 7faf93bf3740 1 -- 172.21.15.3:0/2988189261 shutdown_connections 2024-09-19T06:15:23.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.462+0000 7faf93bf3740 1 --2- 172.21.15.3:0/2988189261 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562b1dcdfc90 0x562b1dce2120 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.462+0000 7faf93bf3740 1 --2- 172.21.15.3:0/2988189261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b1dccff30 0x562b1dccd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.462+0000 7faf93bf3740 1 --2- 172.21.15.3:0/2988189261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dcc5670 0x562b1dccd320 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.462+0000 7faf93bf3740 1 --2- 172.21.15.3:0/2988189261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b1dcc4d50 0x562b1dcccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.462+0000 7faf6fe00640 0 client.16077 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:23.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.462+0000 7faf93bf3740 1 -- 172.21.15.3:0/2988189261 >> 172.21.15.3:0/2988189261 conn(0x562b1dcc12e0 msgr2=0x562b1dcc7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:23.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.462+0000 7faf93bf3740 1 -- 172.21.15.3:0/2988189261 shutdown_connections 2024-09-19T06:15:23.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.462+0000 7faf93bf3740 1 -- 172.21.15.3:0/2988189261 wait complete. 2024-09-19T06:15:23.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.463+0000 7faf93bf3740 20 client.16077 trim_cache size 0 max 16384 2024-09-19T06:15:23.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.481+0000 7faf93bf3740 1 Processor -- start 2024-09-19T06:15:23.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.481+0000 7faf93bf3740 1 -- start start 2024-09-19T06:15:23.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.481+0000 7faf93bf3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b1dcc4d50 0x562b1dcced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:23.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.481+0000 7faf93bf3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dcc5670 0x562b1dce7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:23.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.482+0000 7faf93bf3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b1dccff30 0x562b1dce7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:23.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.482+0000 7faf93bf3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c1b3d20 con 0x562b1dcc5670 2024-09-19T06:15:23.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.482+0000 7faf93bf3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c1b5860 con 0x562b1dcc4d50 2024-09-19T06:15:23.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.482+0000 7faf93bf3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c1b43f0 con 0x562b1dccff30 2024-09-19T06:15:23.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.482+0000 7faf83e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dcc5670 0x562b1dce7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:23.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.482+0000 7faf83e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dcc5670 0x562b1dce7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50918/0 (socket says 172.21.15.3:50918) 2024-09-19T06:15:23.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.482+0000 7faf83e00640 1 -- 172.21.15.3:0/2824417641 learned_addr learned my addr 172.21.15.3:0/2824417641 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:23.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.482+0000 7faf89e00640 1 --2- 172.21.15.3:0/2824417641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b1dcc4d50 0x562b1dcced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:23.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.482+0000 7faf8a800640 1 --2- 172.21.15.3:0/2824417641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b1dccff30 0x562b1dce7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:23.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.482+0000 7faf83e00640 1 -- 172.21.15.3:0/2824417641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b1dccff30 msgr2=0x562b1dce7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:23.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.482+0000 7faf83e00640 1 --2- 172.21.15.3:0/2824417641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b1dccff30 0x562b1dce7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.482+0000 7faf83e00640 1 -- 172.21.15.3:0/2824417641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b1dcc4d50 msgr2=0x562b1dcced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:23.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.482+0000 7faf83e00640 1 --2- 172.21.15.3:0/2824417641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b1dcc4d50 0x562b1dcced50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.482+0000 7faf83e00640 1 -- 172.21.15.3:0/2824417641 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b1dcc0b70 con 0x562b1dcc5670 2024-09-19T06:15:23.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.483+0000 7faf83e00640 1 --2- 172.21.15.3:0/2824417641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dcc5670 0x562b1dce7a30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7faf740bb4f0 tx=0x7faf74030960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3daadfa5c3d75a8a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:23.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.483+0000 7faf7aa00640 1 -- 172.21.15.3:0/2824417641 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf740baec0 con 0x562b1dcc5670 2024-09-19T06:15:23.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.483+0000 7faf7aa00640 1 -- 172.21.15.3:0/2824417641 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf740bbc60 con 0x562b1dcc5670 2024-09-19T06:15:23.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.483+0000 7faf7aa00640 1 -- 172.21.15.3:0/2824417641 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf740bba50 con 0x562b1dcc5670 2024-09-19T06:15:23.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.484+0000 7faf93bf3740 1 -- 172.21.15.3:0/2824417641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dcc5670 msgr2=0x562b1dce7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:23.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.484+0000 7faf93bf3740 1 --2- 172.21.15.3:0/2824417641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dcc5670 0x562b1dce7a30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7faf740bb4f0 tx=0x7faf74030960 comp rx=0 tx=0).stop 2024-09-19T06:15:23.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.484+0000 7faf93bf3740 1 -- 172.21.15.3:0/2824417641 shutdown_connections 2024-09-19T06:15:23.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.484+0000 7faf93bf3740 1 --2- 172.21.15.3:0/2824417641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b1dccff30 0x562b1dce7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.484+0000 7faf93bf3740 1 --2- 172.21.15.3:0/2824417641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dcc5670 0x562b1dce7a30 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.484+0000 7faf93bf3740 1 --2- 172.21.15.3:0/2824417641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b1dcc4d50 0x562b1dcced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.484+0000 7faf93bf3740 1 -- 172.21.15.3:0/2824417641 >> 172.21.15.3:0/2824417641 conn(0x562b1dcc12e0 msgr2=0x562b1dcce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:23.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.484+0000 7faf93bf3740 1 -- 172.21.15.3:0/2824417641 shutdown_connections 2024-09-19T06:15:23.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.484+0000 7faf93bf3740 1 -- 172.21.15.3:0/2824417641 wait complete. 2024-09-19T06:15:23.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.484+0000 7faf93bf3740 1 -- start start 2024-09-19T06:15:23.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.484+0000 7faf93bf3740 1 Processor -- start 2024-09-19T06:15:23.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.485+0000 7faf93bf3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b1dcc4d50 0x562b1dcc9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:23.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.485+0000 7faf93bf3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b1dcc5670 0x562b1dcca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:23.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.485+0000 7faf93bf3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dccff30 0x562b1dcca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:23.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.485+0000 7faf93bf3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c1b5190 con 0x562b1dccff30 2024-09-19T06:15:23.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.485+0000 7faf93bf3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c1b4ac0 con 0x562b1dcc4d50 2024-09-19T06:15:23.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.485+0000 7faf93bf3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c1b1d00 con 0x562b1dcc5670 2024-09-19T06:15:23.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.485+0000 7faf93bf3740 10 client.0 _ll_register_callbacks cb 0x7faf74033f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:23.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.485+0000 7faf8a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dccff30 0x562b1dcca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:23.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.485+0000 7faf8a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dccff30 0x562b1dcca7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50934/0 (socket says 172.21.15.3:50934) 2024-09-19T06:15:23.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.485+0000 7faf8a800640 1 -- 172.21.15.3:0/659408182 learned_addr learned my addr 172.21.15.3:0/659408182 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:23.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.485+0000 7faf83e00640 1 --2- 172.21.15.3:0/659408182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b1dcc5670 0x562b1dcca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:23.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.485+0000 7faf89e00640 1 --2- 172.21.15.3:0/659408182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b1dcc4d50 0x562b1dcc9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:23.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.486+0000 7faf8a800640 1 -- 172.21.15.3:0/659408182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b1dcc5670 msgr2=0x562b1dcca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:23.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.486+0000 7faf8a800640 1 --2- 172.21.15.3:0/659408182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b1dcc5670 0x562b1dcca2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.486+0000 7faf8a800640 1 -- 172.21.15.3:0/659408182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b1dcc4d50 msgr2=0x562b1dcc9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:23.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.486+0000 7faf8a800640 1 --2- 172.21.15.3:0/659408182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b1dcc4d50 0x562b1dcc9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.486+0000 7faf8a800640 1 -- 172.21.15.3:0/659408182 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b1dcd6470 con 0x562b1dccff30 2024-09-19T06:15:23.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.486+0000 7faf8a800640 1 --2- 172.21.15.3:0/659408182 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dccff30 0x562b1dcca7f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7faf8401a6d0 tx=0x7faf84004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3aaab4c252652b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:23.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.486+0000 7faf6fe00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:15:23.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.486+0000 7faf6fe00640 1 -- 172.21.15.3:0/659408182 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf84003970 con 0x562b1dccff30 2024-09-19T06:15:23.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.486+0000 7faf6fe00640 1 -- 172.21.15.3:0/659408182 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7faf84003b10 con 0x562b1dccff30 2024-09-19T06:15:23.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.486+0000 7faf93bf3740 1 -- 172.21.15.3:0/659408182 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf740bbc60 con 0x562b1dccff30 2024-09-19T06:15:23.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.487+0000 7faf6fe00640 1 -- 172.21.15.3:0/659408182 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faf84003d10 con 0x562b1dccff30 2024-09-19T06:15:23.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.487+0000 7faf93bf3740 10 client.16083 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:23.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.487+0000 7faf93bf3740 1 -- 172.21.15.3:0/659408182 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562b1dd4aca0 con 0x562b1dccff30 2024-09-19T06:15:23.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.487+0000 7faf6fe00640 1 -- 172.21.15.3:0/659408182 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf740bbc60 con 0x562b1dccff30 2024-09-19T06:15:23.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.487+0000 7faf6fe00640 1 -- 172.21.15.3:0/659408182 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7faf8400b040 con 0x562b1dccff30 2024-09-19T06:15:23.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.487+0000 7faf93bf3740 10 client.16083 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:23.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.487+0000 7faf93bf3740 10 client.16083 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:23.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.487+0000 7faf93bf3740 20 client.16083 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:23.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.487+0000 7faf93bf3740 1 --2- 172.21.15.3:0/659408182 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562b1dcdfc90 0x562b1dd4d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:23.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.487+0000 7faf93bf3740 4 client.16083 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:15:23.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.487+0000 7faf93bf3740 1 -- 172.21.15.3:0/659408182 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562b1dc32e60 con 0x562b1dcdfc90 2024-09-19T06:15:23.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.488+0000 7faf89e00640 1 --2- 172.21.15.3:0/659408182 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562b1dcdfc90 0x562b1dd4d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:23.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.488+0000 7faf89e00640 1 --2- 172.21.15.3:0/659408182 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562b1dcdfc90 0x562b1dd4d490 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da114c34e302967e server_cookie=6e48a9868fc28dbf in_seq=0 out_seq=0 2024-09-19T06:15:23.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.488+0000 7faf6fe00640 10 client.16083 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:23.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.489+0000 7faf6fe00640 1 -- 172.21.15.3:0/659408182 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562b1dc32e60 con 0x562b1dcdfc90 2024-09-19T06:15:23.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.489+0000 7faf6fe00640 10 client.16083 handle_command_reply: tid=0 2024-09-19T06:15:23.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.489+0000 7faf93bf3740 1 client.16083 shutdown 2024-09-19T06:15:23.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.489+0000 7faf93bf3740 1 -- 172.21.15.3:0/659408182 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dccff30 msgr2=0x562b1dcca7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:23.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.489+0000 7faf93bf3740 1 --2- 172.21.15.3:0/659408182 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dccff30 0x562b1dcca7f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7faf8401a6d0 tx=0x7faf84004ab0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.489+0000 7faf93bf3740 1 -- 172.21.15.3:0/659408182 shutdown_connections 2024-09-19T06:15:23.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.489+0000 7faf93bf3740 1 --2- 172.21.15.3:0/659408182 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562b1dcdfc90 0x562b1dd4d490 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.489+0000 7faf93bf3740 1 --2- 172.21.15.3:0/659408182 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562b1dccff30 0x562b1dcca7f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.489+0000 7faf93bf3740 1 --2- 172.21.15.3:0/659408182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562b1dcc5670 0x562b1dcca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.489+0000 7faf93bf3740 1 --2- 172.21.15.3:0/659408182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562b1dcc4d50 0x562b1dcc9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.489+0000 7faf6fe00640 0 client.16083 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:23.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.489+0000 7faf93bf3740 1 -- 172.21.15.3:0/659408182 >> 172.21.15.3:0/659408182 conn(0x562b1dcc12e0 msgr2=0x562b1dcc7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:23.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.489+0000 7faf93bf3740 1 -- 172.21.15.3:0/659408182 shutdown_connections 2024-09-19T06:15:23.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.489+0000 7faf93bf3740 1 -- 172.21.15.3:0/659408182 wait complete. 2024-09-19T06:15:23.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.489+0000 7faf93bf3740 20 client.16083 trim_cache size 0 max 16384 2024-09-19T06:15:23.495 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:15:23.495 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:15:23.496 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": { 2024-09-19T06:15:23.496 INFO:teuthology.orchestra.run.smithi003.stdout: "26165896-c273-4dbf-a808-60702719755a": { 2024-09-19T06:15:23.496 INFO:teuthology.orchestra.run.smithi003.stdout: "path": "/", 2024-09-19T06:15:23.496 INFO:teuthology.orchestra.run.smithi003.stdout: "tag": "26165896-c273-4dbf-a808-60702719755a", 2024-09-19T06:15:23.496 INFO:teuthology.orchestra.run.smithi003.stdout: "options": "recursive,force" 2024-09-19T06:15:23.496 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:15:23.496 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:15:23.496 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:15:23.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.490+0000 7faf8b200640 1 -- 172.21.15.3:0/558525041 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7faf700a33b0 msgr2=0x7faf700a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:23.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.490+0000 7faf8b200640 1 --2- 172.21.15.3:0/558525041 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7faf700a33b0 0x7faf700a5870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faf8400e560 tx=0x7faf84010040 comp rx=0 tx=0).stop 2024-09-19T06:15:23.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.490+0000 7faf8b200640 1 -- 172.21.15.3:0/558525041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf8c077040 msgr2=0x7faf8c1a4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:23.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.490+0000 7faf8b200640 1 --2- 172.21.15.3:0/558525041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf8c077040 0x7faf8c1a4b80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faf7402a860 tx=0x7faf74033b60 comp rx=0 tx=0).stop 2024-09-19T06:15:23.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.490+0000 7faf8b200640 1 -- 172.21.15.3:0/558525041 shutdown_connections 2024-09-19T06:15:23.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.490+0000 7faf8b200640 1 --2- 172.21.15.3:0/558525041 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7faf700a33b0 0x7faf700a5870 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.490+0000 7faf8b200640 1 --2- 172.21.15.3:0/558525041 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faf8c112870 0x7faf8c19e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.490+0000 7faf8b200640 1 --2- 172.21.15.3:0/558525041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf8c077040 0x7faf8c1a4b80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.490+0000 7faf8b200640 1 --2- 172.21.15.3:0/558525041 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf8c076720 0x7faf8c1a4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:23.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.490+0000 7faf8b200640 1 -- 172.21.15.3:0/558525041 >> 172.21.15.3:0/558525041 conn(0x7faf8c0ff910 msgr2=0x7faf8c101d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:23.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.490+0000 7faf8b200640 1 -- 172.21.15.3:0/558525041 shutdown_connections 2024-09-19T06:15:23.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:23.490+0000 7faf8b200640 1 -- 172.21.15.3:0/558525041 wait complete. 2024-09-19T06:15:24.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:24 smithi059 ceph-mon[35138]: pgmap v93: 97 pgs: 97 active+clean; 3.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 KiB/s wr, 15 op/s 2024-09-19T06:15:24.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:24 smithi003 ceph-mon[30893]: pgmap v93: 97 pgs: 97 active+clean; 3.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 KiB/s wr, 15 op/s 2024-09-19T06:15:24.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:24 smithi071 ceph-mon[35662]: pgmap v93: 97 pgs: 97 active+clean; 3.3 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 KiB/s wr, 15 op/s 2024-09-19T06:15:24.535 INFO:tasks.cephfs.filesystem:scrub status for tag:26165896-c273-4dbf-a808-60702719755a - {'path': '/', 'tag': '26165896-c273-4dbf-a808-60702719755a', 'options': 'recursive,force'} 2024-09-19T06:15:26.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:26 smithi059 ceph-mon[35138]: pgmap v94: 97 pgs: 97 active+clean; 3.4 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 23 op/s 2024-09-19T06:15:26.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:26 smithi059 ceph-mon[35138]: scrub summary: idle 2024-09-19T06:15:26.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:26 smithi003 ceph-mon[30893]: pgmap v94: 97 pgs: 97 active+clean; 3.4 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 23 op/s 2024-09-19T06:15:26.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:26 smithi003 ceph-mon[30893]: scrub summary: idle 2024-09-19T06:15:26.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:26 smithi071 ceph-mon[35662]: pgmap v94: 97 pgs: 97 active+clean; 3.4 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 23 op/s 2024-09-19T06:15:26.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:26 smithi071 ceph-mon[35662]: scrub summary: idle 2024-09-19T06:15:28.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:28 smithi059 ceph-mon[35138]: pgmap v95: 97 pgs: 97 active+clean; 3.4 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 16 op/s 2024-09-19T06:15:28.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:28 smithi003 ceph-mon[30893]: pgmap v95: 97 pgs: 97 active+clean; 3.4 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 16 op/s 2024-09-19T06:15:28.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:28 smithi071 ceph-mon[35662]: pgmap v95: 97 pgs: 97 active+clean; 3.4 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 16 op/s 2024-09-19T06:15:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:29.997+0000 7f39d5200640 1 -- 172.21.15.3:0/2278862677 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39d0103f30 msgr2=0x7f39d0104310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:29.997+0000 7f39d5200640 1 --2- 172.21.15.3:0/2278862677 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39d0103f30 0x7f39d0104310 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009900 tx=0x7f39c002a410 comp rx=0 tx=0).stop 2024-09-19T06:15:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:29.997+0000 7f39d5200640 1 -- 172.21.15.3:0/2278862677 shutdown_connections 2024-09-19T06:15:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:29.997+0000 7f39d5200640 1 --2- 172.21.15.3:0/2278862677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39d0109080 0x7f39d0110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:29.997+0000 7f39d5200640 1 --2- 172.21.15.3:0/2278862677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39d01048e0 0x7f39d0108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:29.997+0000 7f39d5200640 1 --2- 172.21.15.3:0/2278862677 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39d0103f30 0x7f39d0104310 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:29.997+0000 7f39d5200640 1 -- 172.21.15.3:0/2278862677 >> 172.21.15.3:0/2278862677 conn(0x7f39d00ff980 msgr2=0x7f39d0101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:29.998+0000 7f39d5200640 1 -- 172.21.15.3:0/2278862677 shutdown_connections 2024-09-19T06:15:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:29.998+0000 7f39d5200640 1 -- 172.21.15.3:0/2278862677 wait complete. 2024-09-19T06:15:30.003 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:29.998+0000 7f39d5200640 1 Processor -- start 2024-09-19T06:15:30.003 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:29.999+0000 7f39d5200640 1 -- start start 2024-09-19T06:15:30.003 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:29.999+0000 7f39d5200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39d0103f30 0x7f39d019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:30.003 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:29.999+0000 7f39d5200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39d0109080 0x7f39d019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:30.003 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:29.999+0000 7f39d5200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39d019eec0 0x7f39d019f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:30.003 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:29.999+0000 7f39d5200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f39d01140d0 con 0x7f39d0103f30 2024-09-19T06:15:30.003 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:29.999+0000 7f39d5200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f39d0113f50 con 0x7f39d019eec0 2024-09-19T06:15:30.003 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:29.999+0000 7f39d5200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f39d0114250 con 0x7f39d0109080 2024-09-19T06:15:30.003 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:29.999+0000 7f39cde00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39d0103f30 0x7f39d019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:30.003 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:29.999+0000 7f39cde00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39d0103f30 0x7f39d019a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50414/0 (socket says 172.21.15.3:50414) 2024-09-19T06:15:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:29.999+0000 7f39cde00640 1 -- 172.21.15.3:0/2107030206 learned_addr learned my addr 172.21.15.3:0/2107030206 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:29.999+0000 7f39ce800640 1 --2- 172.21.15.3:0/2107030206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39d019eec0 0x7f39d019f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.000+0000 7f39c5400640 1 --2- 172.21.15.3:0/2107030206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39d0109080 0x7f39d019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.000+0000 7f39cde00640 1 -- 172.21.15.3:0/2107030206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39d0109080 msgr2=0x7f39d019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.000+0000 7f39cde00640 1 --2- 172.21.15.3:0/2107030206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39d0109080 0x7f39d019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.000+0000 7f39cde00640 1 -- 172.21.15.3:0/2107030206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39d019eec0 msgr2=0x7f39d019f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.000+0000 7f39cde00640 1 --2- 172.21.15.3:0/2107030206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39d019eec0 0x7f39d019f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.000+0000 7f39cde00640 1 -- 172.21.15.3:0/2107030206 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d019f9b0 con 0x7f39d0103f30 2024-09-19T06:15:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.000+0000 7f39cde00640 1 --2- 172.21.15.3:0/2107030206 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39d0103f30 0x7f39d019a600 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f39c0006010 tx=0x7f39c0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.000+0000 7f39c7400640 1 -- 172.21.15.3:0/2107030206 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c003f030 con 0x7f39d0103f30 2024-09-19T06:15:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.000+0000 7f39c7400640 1 -- 172.21.15.3:0/2107030206 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39c0004440 con 0x7f39d0103f30 2024-09-19T06:15:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.001+0000 7f39d5200640 1 -- 172.21.15.3:0/2107030206 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d019fc40 con 0x7f39d0103f30 2024-09-19T06:15:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.001+0000 7f39c7400640 1 -- 172.21.15.3:0/2107030206 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c0035070 con 0x7f39d0103f30 2024-09-19T06:15:30.004 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.001+0000 7f39d5200640 1 -- 172.21.15.3:0/2107030206 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d01a7400 con 0x7f39d0103f30 2024-09-19T06:15:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.004+0000 7f39c7400640 1 -- 172.21.15.3:0/2107030206 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f39c0042030 con 0x7f39d0103f30 2024-09-19T06:15:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.004+0000 7f39d80ac740 1 Processor -- start 2024-09-19T06:15:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.004+0000 7f39d80ac740 1 -- start start 2024-09-19T06:15:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.005+0000 7f39d80ac740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8154101e0 0x55e8154105c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.005+0000 7f39d80ac740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e815410b00 0x55e81541ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.005+0000 7f39d80ac740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e81541b3a0 0x55e81541d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.005+0000 7f39d80ac740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e815376100 con 0x55e81541b3a0 2024-09-19T06:15:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.005+0000 7f39d80ac740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e81531e1b0 con 0x55e8154101e0 2024-09-19T06:15:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.005+0000 7f39d80ac740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e8153720c0 con 0x55e815410b00 2024-09-19T06:15:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.005+0000 7f39c5400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e81541b3a0 0x55e81541d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.005+0000 7f39ce800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8154101e0 0x55e8154105c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.005+0000 7f39cde00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e815410b00 0x55e81541ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.005+0000 7f39c5400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e81541b3a0 0x55e81541d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50430/0 (socket says 172.21.15.3:50430) 2024-09-19T06:15:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.005+0000 7f39c5400640 1 -- 172.21.15.3:0/22569691 learned_addr learned my addr 172.21.15.3:0/22569691 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.005+0000 7f39ce800640 1 -- 172.21.15.3:0/22569691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e815410b00 msgr2=0x55e81541ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.005+0000 7f39ce800640 1 --2- 172.21.15.3:0/22569691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e815410b00 0x55e81541ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.005+0000 7f39ce800640 1 -- 172.21.15.3:0/22569691 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e81541b3a0 msgr2=0x55e81541d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.005+0000 7f39ce800640 1 --2- 172.21.15.3:0/22569691 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e81541b3a0 0x55e81541d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.005+0000 7f39ce800640 1 -- 172.21.15.3:0/22569691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e815089210 con 0x55e8154101e0 2024-09-19T06:15:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.006+0000 7f39c7400640 1 --2- 172.21.15.3:0/2107030206 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f39b40a33b0 0x7f39b40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.006+0000 7f39ce800640 1 --2- 172.21.15.3:0/22569691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8154101e0 0x55e8154105c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f39c8009f00 tx=0x7f39c8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e3db6c61263c9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.006+0000 7f39c7400640 1 -- 172.21.15.3:0/2107030206 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f39c00f00e0 con 0x7f39d0103f30 2024-09-19T06:15:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.006+0000 7f39cde00640 1 --2- 172.21.15.3:0/2107030206 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f39b40a33b0 0x7f39b40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.006+0000 7f39bf400640 1 -- 172.21.15.3:0/22569691 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c8004d20 con 0x55e8154101e0 2024-09-19T06:15:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.006+0000 7f39bf400640 1 -- 172.21.15.3:0/22569691 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39c8004050 con 0x55e8154101e0 2024-09-19T06:15:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.006+0000 7f39bf400640 1 -- 172.21.15.3:0/22569691 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c8005280 con 0x55e8154101e0 2024-09-19T06:15:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.007+0000 7f39d80ac740 1 -- 172.21.15.3:0/22569691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8154101e0 msgr2=0x55e8154105c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.007+0000 7f39cde00640 1 --2- 172.21.15.3:0/2107030206 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f39b40a33b0 0x7f39b40a5870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x55e81540d5b0 tx=0x7f39c00f3b90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.007+0000 7f39d80ac740 1 --2- 172.21.15.3:0/22569691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8154101e0 0x55e8154105c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f39c8009f00 tx=0x7f39c8011810 comp rx=0 tx=0).stop 2024-09-19T06:15:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.007+0000 7f39d80ac740 1 -- 172.21.15.3:0/22569691 shutdown_connections 2024-09-19T06:15:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.007+0000 7f39d80ac740 1 --2- 172.21.15.3:0/22569691 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e81541b3a0 0x55e81541d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.007+0000 7f39d80ac740 1 --2- 172.21.15.3:0/22569691 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e815410b00 0x55e81541ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.007+0000 7f39d80ac740 1 --2- 172.21.15.3:0/22569691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8154101e0 0x55e8154105c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.007+0000 7f39d80ac740 1 -- 172.21.15.3:0/22569691 >> 172.21.15.3:0/22569691 conn(0x55e81540c750 msgr2=0x55e81540cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.007+0000 7f39d80ac740 1 -- 172.21.15.3:0/22569691 shutdown_connections 2024-09-19T06:15:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.007+0000 7f39d80ac740 1 -- 172.21.15.3:0/22569691 wait complete. 2024-09-19T06:15:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.008+0000 7f39d80ac740 1 -- start start 2024-09-19T06:15:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.008+0000 7f39d80ac740 1 Processor -- start 2024-09-19T06:15:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.008+0000 7f39d80ac740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e8154101e0 0x55e8154182c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.008+0000 7f39d80ac740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e815410b00 0x55e815418800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.008+0000 7f39d80ac740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e81541b3a0 0x55e815418d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.008+0000 7f39d80ac740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e81541df70 con 0x55e815410b00 2024-09-19T06:15:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.008+0000 7f39d80ac740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e8152ff090 con 0x55e81541b3a0 2024-09-19T06:15:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.008+0000 7f39d80ac740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e81541e0f0 con 0x55e8154101e0 2024-09-19T06:15:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.008+0000 7f39d80ac740 10 client.0 _ll_register_callbacks cb 0x55e815353f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.009+0000 7f39c5400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e815410b00 0x55e815418800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.009+0000 7f39c5400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e815410b00 0x55e815418800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50440/0 (socket says 172.21.15.3:50440) 2024-09-19T06:15:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.009+0000 7f39c5400640 1 -- 172.21.15.3:0/275760885 learned_addr learned my addr 172.21.15.3:0/275760885 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.009+0000 7f39ce800640 1 --2- 172.21.15.3:0/275760885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e8154101e0 0x55e8154182c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.009+0000 7f39ce800640 1 --2- 172.21.15.3:0/275760885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e81541b3a0 0x55e815418d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.009+0000 7f39c5400640 1 -- 172.21.15.3:0/275760885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e8154101e0 msgr2=0x55e8154182c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.009+0000 7f39c5400640 1 --2- 172.21.15.3:0/275760885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e8154101e0 0x55e8154182c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.009+0000 7f39c5400640 1 -- 172.21.15.3:0/275760885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e81541b3a0 msgr2=0x55e815418d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.009+0000 7f39c5400640 1 --2- 172.21.15.3:0/275760885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e81541b3a0 0x55e815418d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.009+0000 7f39c5400640 1 -- 172.21.15.3:0/275760885 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e815155620 con 0x55e815410b00 2024-09-19T06:15:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.009+0000 7f39ce800640 1 --2- 172.21.15.3:0/275760885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e81541b3a0 0x55e815418d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.010+0000 7f39c5400640 1 --2- 172.21.15.3:0/275760885 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e815410b00 0x55e815418800 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f39b80126b0 tx=0x7f39b8012b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e98dc3db1056d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.010+0000 7f39b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:15:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.010+0000 7f39b3e00640 1 -- 172.21.15.3:0/275760885 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8004050 con 0x55e815410b00 2024-09-19T06:15:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.010+0000 7f39b3e00640 1 -- 172.21.15.3:0/275760885 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f39b80041f0 con 0x55e815410b00 2024-09-19T06:15:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.010+0000 7f39d80ac740 1 -- 172.21.15.3:0/275760885 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39c8004050 con 0x55e815410b00 2024-09-19T06:15:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.010+0000 7f39b3e00640 1 -- 172.21.15.3:0/275760885 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f39b80043f0 con 0x55e815410b00 2024-09-19T06:15:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.010+0000 7f39d80ac740 10 client.16095 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.010+0000 7f39d80ac740 1 -- 172.21.15.3:0/275760885 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e815429b90 con 0x55e815410b00 2024-09-19T06:15:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.010+0000 7f39b3e00640 1 -- 172.21.15.3:0/275760885 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39c8004050 con 0x55e815410b00 2024-09-19T06:15:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.011+0000 7f39b3e00640 1 -- 172.21.15.3:0/275760885 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f39b8003c10 con 0x55e815410b00 2024-09-19T06:15:30.016 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.011+0000 7f39d80ac740 10 client.16095 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:30.016 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.011+0000 7f39d80ac740 10 client.16095 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:30.016 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.011+0000 7f39d80ac740 20 client.16095 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:30.016 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.011+0000 7f39d80ac740 1 --2- 172.21.15.3:0/275760885 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e81542b050 0x55e81542d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:30.016 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.011+0000 7f39d80ac740 4 client.16095 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:30.016 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.011+0000 7f39d80ac740 1 -- 172.21.15.3:0/275760885 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e815383830 con 0x55e81542b050 2024-09-19T06:15:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.011+0000 7f39ce800640 1 --2- 172.21.15.3:0/275760885 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e81542b050 0x55e81542d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.012+0000 7f39ce800640 1 --2- 172.21.15.3:0/275760885 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e81542b050 0x55e81542d440 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8526834e325532ab server_cookie=b1c38111ed9248bc in_seq=0 out_seq=0 2024-09-19T06:15:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.012+0000 7f39b3e00640 10 client.16095 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.013+0000 7f39b3e00640 1 -- 172.21.15.3:0/275760885 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e815383830 con 0x55e81542b050 2024-09-19T06:15:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.013+0000 7f39b3e00640 10 client.16095 handle_command_reply: tid=0 2024-09-19T06:15:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.013+0000 7f39d80ac740 1 client.16095 shutdown 2024-09-19T06:15:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.013+0000 7f39d80ac740 1 -- 172.21.15.3:0/275760885 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e815410b00 msgr2=0x55e815418800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.013+0000 7f39d80ac740 1 --2- 172.21.15.3:0/275760885 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e815410b00 0x55e815418800 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f39b80126b0 tx=0x7f39b8012b70 comp rx=0 tx=0).stop 2024-09-19T06:15:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.013+0000 7f39d80ac740 1 -- 172.21.15.3:0/275760885 shutdown_connections 2024-09-19T06:15:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.013+0000 7f39d80ac740 1 --2- 172.21.15.3:0/275760885 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e81542b050 0x55e81542d440 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.013+0000 7f39d80ac740 1 --2- 172.21.15.3:0/275760885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e81541b3a0 0x55e815418d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.013+0000 7f39d80ac740 1 --2- 172.21.15.3:0/275760885 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e815410b00 0x55e815418800 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.013+0000 7f39b3e00640 0 client.16095 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.013+0000 7f39d80ac740 1 --2- 172.21.15.3:0/275760885 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e8154101e0 0x55e8154182c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.013+0000 7f39d80ac740 1 -- 172.21.15.3:0/275760885 >> 172.21.15.3:0/275760885 conn(0x55e81540c750 msgr2=0x55e815412460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.013+0000 7f39d80ac740 1 -- 172.21.15.3:0/275760885 shutdown_connections 2024-09-19T06:15:30.018 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.013+0000 7f39d80ac740 1 -- 172.21.15.3:0/275760885 wait complete. 2024-09-19T06:15:30.019 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.013+0000 7f39d80ac740 20 client.16095 trim_cache size 0 max 16384 2024-09-19T06:15:30.034 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.031+0000 7f39d80ac740 1 Processor -- start 2024-09-19T06:15:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.032+0000 7f39d80ac740 1 -- start start 2024-09-19T06:15:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.032+0000 7f39d80ac740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e8154101e0 0x55e815418b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.032+0000 7f39d80ac740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e815410b00 0x55e815432d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.032+0000 7f39d80ac740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e81541b3a0 0x55e815433250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.032+0000 7f39d80ac740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f39d01afb20 con 0x55e815410b00 2024-09-19T06:15:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.032+0000 7f39d80ac740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f39d01b1660 con 0x55e81541b3a0 2024-09-19T06:15:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.032+0000 7f39d80ac740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f39d01b01f0 con 0x55e8154101e0 2024-09-19T06:15:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.032+0000 7f39c5400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e815410b00 0x55e815432d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.032+0000 7f39c5400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e815410b00 0x55e815432d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50444/0 (socket says 172.21.15.3:50444) 2024-09-19T06:15:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.032+0000 7f39c5400640 1 -- 172.21.15.3:0/1676622078 learned_addr learned my addr 172.21.15.3:0/1676622078 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.032+0000 7f39ce800640 1 --2- 172.21.15.3:0/1676622078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e8154101e0 0x55e815418b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:30.035 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.033+0000 7f39ce800640 1 --2- 172.21.15.3:0/1676622078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e81541b3a0 0x55e815433250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.033+0000 7f39c5400640 1 -- 172.21.15.3:0/1676622078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e8154101e0 msgr2=0x55e815418b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.033+0000 7f39c5400640 1 --2- 172.21.15.3:0/1676622078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e8154101e0 0x55e815418b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.033+0000 7f39c5400640 1 -- 172.21.15.3:0/1676622078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e81541b3a0 msgr2=0x55e815433250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.033+0000 7f39c5400640 1 --2- 172.21.15.3:0/1676622078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e81541b3a0 0x55e815433250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.033+0000 7f39c5400640 1 -- 172.21.15.3:0/1676622078 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e815410010 con 0x55e815410b00 2024-09-19T06:15:30.036 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.033+0000 7f39ce800640 1 --2- 172.21.15.3:0/1676622078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e81541b3a0 0x55e815433250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.033+0000 7f39c5400640 1 --2- 172.21.15.3:0/1676622078 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e815410b00 0x55e815432d10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f39b8025670 tx=0x7f39b8025980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d54fa247e9132c1b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.033+0000 7f39bea00640 1 -- 172.21.15.3:0/1676622078 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8003fe0 con 0x55e815410b00 2024-09-19T06:15:30.038 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.033+0000 7f39bea00640 1 -- 172.21.15.3:0/1676622078 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39b8004180 con 0x55e815410b00 2024-09-19T06:15:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.033+0000 7f39bea00640 1 -- 172.21.15.3:0/1676622078 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8005070 con 0x55e815410b00 2024-09-19T06:15:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.034+0000 7f39d80ac740 1 -- 172.21.15.3:0/1676622078 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e815410b00 msgr2=0x55e815432d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.034+0000 7f39d80ac740 1 --2- 172.21.15.3:0/1676622078 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e815410b00 0x55e815432d10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f39b8025670 tx=0x7f39b8025980 comp rx=0 tx=0).stop 2024-09-19T06:15:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.034+0000 7f39d80ac740 1 -- 172.21.15.3:0/1676622078 shutdown_connections 2024-09-19T06:15:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.034+0000 7f39d80ac740 1 --2- 172.21.15.3:0/1676622078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e81541b3a0 0x55e815433250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.034+0000 7f39d80ac740 1 --2- 172.21.15.3:0/1676622078 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e815410b00 0x55e815432d10 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.034+0000 7f39d80ac740 1 --2- 172.21.15.3:0/1676622078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e8154101e0 0x55e815418b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.034+0000 7f39d80ac740 1 -- 172.21.15.3:0/1676622078 >> 172.21.15.3:0/1676622078 conn(0x55e81540c750 msgr2=0x55e81541a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.034+0000 7f39d80ac740 1 -- 172.21.15.3:0/1676622078 shutdown_connections 2024-09-19T06:15:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.034+0000 7f39d80ac740 1 -- 172.21.15.3:0/1676622078 wait complete. 2024-09-19T06:15:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.035+0000 7f39d80ac740 1 -- start start 2024-09-19T06:15:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.035+0000 7f39d80ac740 1 Processor -- start 2024-09-19T06:15:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.035+0000 7f39d80ac740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8154101e0 0x55e8154239b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:30.039 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.035+0000 7f39d80ac740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e815410b00 0x55e81541ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:30.040 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.035+0000 7f39d80ac740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e81541b3a0 0x55e81541f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:30.040 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.035+0000 7f39d80ac740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f39d01b0f90 con 0x55e81541b3a0 2024-09-19T06:15:30.040 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.035+0000 7f39d80ac740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f39d01b08c0 con 0x55e8154101e0 2024-09-19T06:15:30.040 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.035+0000 7f39d80ac740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f39d01adb20 con 0x55e815410b00 2024-09-19T06:15:30.040 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.035+0000 7f39d80ac740 10 client.0 _ll_register_callbacks cb 0x7f39b8009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:30.040 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.036+0000 7f39ce800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e81541b3a0 0x55e81541f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:30.040 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.036+0000 7f39c5400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e815410b00 0x55e81541ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:30.040 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.036+0000 7f39ce800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e81541b3a0 0x55e81541f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50458/0 (socket says 172.21.15.3:50458) 2024-09-19T06:15:30.040 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.036+0000 7f39ce800640 1 -- 172.21.15.3:0/2008510297 learned_addr learned my addr 172.21.15.3:0/2008510297 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:30.040 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.036+0000 7f39ce800640 1 --2- 172.21.15.3:0/2008510297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8154101e0 0x55e8154239b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:30.040 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.036+0000 7f39c5400640 1 -- 172.21.15.3:0/2008510297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8154101e0 msgr2=0x55e8154239b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:30.040 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.036+0000 7f39c5400640 1 --2- 172.21.15.3:0/2008510297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8154101e0 0x55e8154239b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.040 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.036+0000 7f39c5400640 1 -- 172.21.15.3:0/2008510297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e81541b3a0 msgr2=0x55e81541f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:30.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.036+0000 7f39c5400640 1 --2- 172.21.15.3:0/2008510297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e81541b3a0 0x55e81541f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.036+0000 7f39c5400640 1 -- 172.21.15.3:0/2008510297 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e81541fa40 con 0x55e815410b00 2024-09-19T06:15:30.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.036+0000 7f39ce800640 1 --2- 172.21.15.3:0/2008510297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e81541b3a0 0x55e81541f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:30.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.036+0000 7f39c5400640 1 --2- 172.21.15.3:0/2008510297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e815410b00 0x55e81541ecd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f39b8000c00 tx=0x7f39b8009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf67ef8ba3a3060f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:30.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.036+0000 7f39b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:15:30.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.037+0000 7f39b3e00640 1 -- 172.21.15.3:0/2008510297 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8033070 con 0x55e815410b00 2024-09-19T06:15:30.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.037+0000 7f39d80ac740 1 -- 172.21.15.3:0/2008510297 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39b8004180 con 0x55e815410b00 2024-09-19T06:15:30.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.037+0000 7f39b3e00640 1 -- 172.21.15.3:0/2008510297 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f39b8025c00 con 0x55e815410b00 2024-09-19T06:15:30.042 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.037+0000 7f39b3e00640 1 -- 172.21.15.3:0/2008510297 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f39b8003fe0 con 0x55e815410b00 2024-09-19T06:15:30.042 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.037+0000 7f39d80ac740 10 client.26152 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:30.042 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.037+0000 7f39d80ac740 1 -- 172.21.15.3:0/2008510297 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e815495c20 con 0x55e815410b00 2024-09-19T06:15:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.037+0000 7f39b3e00640 1 -- 172.21.15.3:0/2008510297 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39b8004180 con 0x55e815410b00 2024-09-19T06:15:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.038+0000 7f39b3e00640 1 -- 172.21.15.3:0/2008510297 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f39b802d030 con 0x55e815410b00 2024-09-19T06:15:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.038+0000 7f39d80ac740 10 client.26152 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.038+0000 7f39d80ac740 10 client.26152 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.038+0000 7f39d80ac740 20 client.26152 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.038+0000 7f39d80ac740 1 --2- 172.21.15.3:0/2008510297 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e8154962a0 0x55e8154986c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.038+0000 7f39d80ac740 4 client.26152 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:15:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.038+0000 7f39d80ac740 1 -- 172.21.15.3:0/2008510297 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e81537db80 con 0x55e8154962a0 2024-09-19T06:15:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.038+0000 7f39ce800640 1 --2- 172.21.15.3:0/2008510297 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e8154962a0 0x55e8154986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.039+0000 7f39ce800640 1 --2- 172.21.15.3:0/2008510297 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e8154962a0 0x55e8154986c0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d830bf6d700fcc66 server_cookie=167eea057270ced1 in_seq=0 out_seq=0 2024-09-19T06:15:30.043 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.039+0000 7f39b3e00640 10 client.26152 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.055+0000 7f39b3e00640 1 -- 172.21.15.3:0/2008510297 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e81537db80 con 0x55e8154962a0 2024-09-19T06:15:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.055+0000 7f39b3e00640 10 client.26152 handle_command_reply: tid=0 2024-09-19T06:15:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.055+0000 7f39d80ac740 1 client.26152 shutdown 2024-09-19T06:15:30.057 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.055+0000 7f39d80ac740 1 -- 172.21.15.3:0/2008510297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e815410b00 msgr2=0x55e81541ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.055+0000 7f39d80ac740 1 --2- 172.21.15.3:0/2008510297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e815410b00 0x55e81541ecd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f39b8000c00 tx=0x7f39b8009240 comp rx=0 tx=0).stop 2024-09-19T06:15:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.055+0000 7f39d80ac740 1 -- 172.21.15.3:0/2008510297 shutdown_connections 2024-09-19T06:15:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.055+0000 7f39d80ac740 1 --2- 172.21.15.3:0/2008510297 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e8154962a0 0x55e8154986c0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.055+0000 7f39d80ac740 1 --2- 172.21.15.3:0/2008510297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e81541b3a0 0x55e81541f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.055+0000 7f39b3e00640 0 client.26152 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.055+0000 7f39d80ac740 1 --2- 172.21.15.3:0/2008510297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e815410b00 0x55e81541ecd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.055+0000 7f39d80ac740 1 --2- 172.21.15.3:0/2008510297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e8154101e0 0x55e8154239b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.055+0000 7f39d80ac740 1 -- 172.21.15.3:0/2008510297 >> 172.21.15.3:0/2008510297 conn(0x55e81540c750 msgr2=0x55e81540b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.055+0000 7f39d80ac740 1 -- 172.21.15.3:0/2008510297 shutdown_connections 2024-09-19T06:15:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.055+0000 7f39d80ac740 1 -- 172.21.15.3:0/2008510297 wait complete. 2024-09-19T06:15:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.055+0000 7f39d80ac740 20 client.26152 trim_cache size 0 max 16384 2024-09-19T06:15:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:15:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:15:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:15:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:15:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.056+0000 7f39d5200640 1 -- 172.21.15.3:0/2107030206 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f39b40a33b0 msgr2=0x7f39b40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.056+0000 7f39d5200640 1 --2- 172.21.15.3:0/2107030206 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f39b40a33b0 0x7f39b40a5870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x55e81540d5b0 tx=0x7f39c00f3b90 comp rx=0 tx=0).stop 2024-09-19T06:15:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.056+0000 7f39d5200640 1 -- 172.21.15.3:0/2107030206 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39d0103f30 msgr2=0x7f39d019a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.056+0000 7f39d5200640 1 --2- 172.21.15.3:0/2107030206 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39d0103f30 0x7f39d019a600 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f39c0006010 tx=0x7f39c0004040 comp rx=0 tx=0).stop 2024-09-19T06:15:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.056+0000 7f39d5200640 1 -- 172.21.15.3:0/2107030206 shutdown_connections 2024-09-19T06:15:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.056+0000 7f39d5200640 1 --2- 172.21.15.3:0/2107030206 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f39b40a33b0 0x7f39b40a5870 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.056+0000 7f39d5200640 1 --2- 172.21.15.3:0/2107030206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39d019eec0 0x7f39d019f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.056+0000 7f39d5200640 1 --2- 172.21.15.3:0/2107030206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f39d0109080 0x7f39d019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.056+0000 7f39d5200640 1 --2- 172.21.15.3:0/2107030206 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39d0103f30 0x7f39d019a600 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.056+0000 7f39d5200640 1 -- 172.21.15.3:0/2107030206 >> 172.21.15.3:0/2107030206 conn(0x7f39d00ff980 msgr2=0x7f39d0100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.056+0000 7f39d5200640 1 -- 172.21.15.3:0/2107030206 shutdown_connections 2024-09-19T06:15:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:30.056+0000 7f39d5200640 1 -- 172.21.15.3:0/2107030206 wait complete. 2024-09-19T06:15:30.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:30 smithi059 ceph-mon[35138]: pgmap v96: 97 pgs: 97 active+clean; 3.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 37 KiB/s wr, 23 op/s 2024-09-19T06:15:30.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:30 smithi003 ceph-mon[30893]: pgmap v96: 97 pgs: 97 active+clean; 3.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 37 KiB/s wr, 23 op/s 2024-09-19T06:15:30.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:30 smithi071 ceph-mon[35662]: pgmap v96: 97 pgs: 97 active+clean; 3.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 37 KiB/s wr, 23 op/s 2024-09-19T06:15:32.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:32 smithi059 ceph-mon[35138]: pgmap v97: 97 pgs: 97 active+clean; 3.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 14 op/s 2024-09-19T06:15:32.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:32 smithi003 ceph-mon[30893]: pgmap v97: 97 pgs: 97 active+clean; 3.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 14 op/s 2024-09-19T06:15:32.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:32 smithi071 ceph-mon[35662]: pgmap v97: 97 pgs: 97 active+clean; 3.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 14 op/s 2024-09-19T06:15:34.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:34 smithi059 ceph-mon[35138]: pgmap v98: 97 pgs: 97 active+clean; 3.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 14 op/s 2024-09-19T06:15:34.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:34 smithi003 ceph-mon[30893]: pgmap v98: 97 pgs: 97 active+clean; 3.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 14 op/s 2024-09-19T06:15:34.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:34 smithi071 ceph-mon[35662]: pgmap v98: 97 pgs: 97 active+clean; 3.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 14 op/s 2024-09-19T06:15:36.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:36 smithi059 ceph-mon[35138]: pgmap v99: 97 pgs: 97 active+clean; 3.7 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 23 op/s 2024-09-19T06:15:36.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:36 smithi003 ceph-mon[30893]: pgmap v99: 97 pgs: 97 active+clean; 3.7 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 23 op/s 2024-09-19T06:15:36.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:36 smithi071 ceph-mon[35662]: pgmap v99: 97 pgs: 97 active+clean; 3.7 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 23 op/s 2024-09-19T06:15:37.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:37 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:15:37.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:37 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:15:37.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:37 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:15:38.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:38 smithi003 ceph-mon[30893]: pgmap v100: 97 pgs: 97 active+clean; 3.7 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 15 op/s 2024-09-19T06:15:38.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:38 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:15:38.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:38 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:15:38.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:38 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:15:38.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:38 smithi071 ceph-mon[35662]: pgmap v100: 97 pgs: 97 active+clean; 3.7 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 15 op/s 2024-09-19T06:15:38.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:38 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:15:38.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:38 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:15:38.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:38 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:15:38.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:38 smithi059 ceph-mon[35138]: pgmap v100: 97 pgs: 97 active+clean; 3.7 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 15 op/s 2024-09-19T06:15:38.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:38 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:15:38.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:38 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:15:38.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:38 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:15:40.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:40 smithi003 ceph-mon[30893]: pgmap v101: 97 pgs: 97 active+clean; 3.8 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 37 KiB/s wr, 22 op/s 2024-09-19T06:15:40.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:40 smithi071 ceph-mon[35662]: pgmap v101: 97 pgs: 97 active+clean; 3.8 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 37 KiB/s wr, 22 op/s 2024-09-19T06:15:40.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:40 smithi059 ceph-mon[35138]: pgmap v101: 97 pgs: 97 active+clean; 3.8 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 37 KiB/s wr, 22 op/s 2024-09-19T06:15:42.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:42 smithi003 ceph-mon[30893]: pgmap v102: 97 pgs: 97 active+clean; 3.8 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 15 op/s 2024-09-19T06:15:42.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:42 smithi071 ceph-mon[35662]: pgmap v102: 97 pgs: 97 active+clean; 3.8 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 15 op/s 2024-09-19T06:15:42.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:42 smithi059 ceph-mon[35138]: pgmap v102: 97 pgs: 97 active+clean; 3.8 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 15 op/s 2024-09-19T06:15:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.185+0000 7fcdb5400640 1 -- 172.21.15.3:0/1067212304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdb0074590 msgr2=0x7fcdb0074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.185+0000 7fcdb5400640 1 --2- 172.21.15.3:0/1067212304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdb0074590 0x7fcdb0074970 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009900 tx=0x7fcda002a480 comp rx=0 tx=0).stop 2024-09-19T06:15:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.185+0000 7fcdb5400640 1 -- 172.21.15.3:0/1067212304 shutdown_connections 2024-09-19T06:15:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.185+0000 7fcdb5400640 1 --2- 172.21.15.3:0/1067212304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb0112ad0 0x7fcdb0114ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.185+0000 7fcdb5400640 1 --2- 172.21.15.3:0/1067212304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdb0074eb0 0x7fcdb0112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.185+0000 7fcdb5400640 1 --2- 172.21.15.3:0/1067212304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdb0074590 0x7fcdb0074970 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.185+0000 7fcdb5400640 1 -- 172.21.15.3:0/1067212304 >> 172.21.15.3:0/1067212304 conn(0x7fcdb00fd7e0 msgr2=0x7fcdb00ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.185+0000 7fcdb5400640 1 -- 172.21.15.3:0/1067212304 shutdown_connections 2024-09-19T06:15:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.185+0000 7fcdb5400640 1 -- 172.21.15.3:0/1067212304 wait complete. 2024-09-19T06:15:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.186+0000 7fcdb5400640 1 Processor -- start 2024-09-19T06:15:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.186+0000 7fcdb5400640 1 -- start start 2024-09-19T06:15:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.186+0000 7fcdb5400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdb0074590 0x7fcdb01a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.186+0000 7fcdb5400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb0074eb0 0x7fcdb01a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.186+0000 7fcdb5400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdb0112ad0 0x7fcdb019e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.186+0000 7fcdb5400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb01184e0 con 0x7fcdb0112ad0 2024-09-19T06:15:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.186+0000 7fcdb5400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb0118360 con 0x7fcdb0074eb0 2024-09-19T06:15:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.186+0000 7fcdb5400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb0118660 con 0x7fcdb0074590 2024-09-19T06:15:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.187+0000 7fcda7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb0074eb0 0x7fcdb01a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.187+0000 7fcda7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb0074eb0 0x7fcdb01a4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:50518/0 (socket says 172.21.15.3:50518) 2024-09-19T06:15:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.187+0000 7fcda7e00640 1 -- 172.21.15.3:0/2273795268 learned_addr learned my addr 172.21.15.3:0/2273795268 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.187+0000 7fcdaf200640 1 --2- 172.21.15.3:0/2273795268 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdb0112ad0 0x7fcdb019e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.187+0000 7fcdae800640 1 --2- 172.21.15.3:0/2273795268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdb0074590 0x7fcdb01a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.187+0000 7fcda7e00640 1 -- 172.21.15.3:0/2273795268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdb0074590 msgr2=0x7fcdb01a46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.187+0000 7fcda7e00640 1 --2- 172.21.15.3:0/2273795268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdb0074590 0x7fcdb01a46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.187+0000 7fcda7e00640 1 -- 172.21.15.3:0/2273795268 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdb0112ad0 msgr2=0x7fcdb019e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.187+0000 7fcda7e00640 1 --2- 172.21.15.3:0/2273795268 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdb0112ad0 0x7fcdb019e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.187+0000 7fcda7e00640 1 -- 172.21.15.3:0/2273795268 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb019f020 con 0x7fcdb0074eb0 2024-09-19T06:15:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.187+0000 7fcdae800640 1 --2- 172.21.15.3:0/2273795268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdb0074590 0x7fcdb01a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.188+0000 7fcda7e00640 1 --2- 172.21.15.3:0/2273795268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb0074eb0 0x7fcdb01a4c20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800e9f0 tx=0x7fcd9800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.188+0000 7fcda7400640 1 -- 172.21.15.3:0/2273795268 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9800ccc0 con 0x7fcdb0074eb0 2024-09-19T06:15:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.188+0000 7fcda7400640 1 -- 172.21.15.3:0/2273795268 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd98010910 con 0x7fcdb0074eb0 2024-09-19T06:15:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.188+0000 7fcdb5400640 1 -- 172.21.15.3:0/2273795268 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdb019f310 con 0x7fcdb0074eb0 2024-09-19T06:15:43.193 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.188+0000 7fcda7400640 1 -- 172.21.15.3:0/2273795268 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd980188a0 con 0x7fcdb0074eb0 2024-09-19T06:15:43.193 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.188+0000 7fcdb5400640 1 -- 172.21.15.3:0/2273795268 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdb01ab530 con 0x7fcdb0074eb0 2024-09-19T06:15:43.201 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.191+0000 7fcda7400640 1 -- 172.21.15.3:0/2273795268 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fcd98010ac0 con 0x7fcdb0074eb0 2024-09-19T06:15:43.202 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.191+0000 7fcdb82d6740 1 Processor -- start 2024-09-19T06:15:43.202 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.191+0000 7fcdb82d6740 1 -- start start 2024-09-19T06:15:43.202 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.191+0000 7fcdb82d6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5642c17fa1e0 0x5642c17fa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:43.202 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.192+0000 7fcdb82d6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642c17fab00 0x5642c1804e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:43.202 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.192+0000 7fcdb82d6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c18053a0 0x5642c1807790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:43.203 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.192+0000 7fcdb82d6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5642c1760100 con 0x5642c18053a0 2024-09-19T06:15:43.203 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.192+0000 7fcdb82d6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5642c17081b0 con 0x5642c17fab00 2024-09-19T06:15:43.203 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.192+0000 7fcdb82d6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5642c175c0c0 con 0x5642c17fa1e0 2024-09-19T06:15:43.203 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.192+0000 7fcda7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c18053a0 0x5642c1807790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:43.203 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.192+0000 7fcda7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c18053a0 0x5642c1807790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41838/0 (socket says 172.21.15.3:41838) 2024-09-19T06:15:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.192+0000 7fcdae800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642c17fab00 0x5642c1804e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.192+0000 7fcda7e00640 1 -- 172.21.15.3:0/4137387894 learned_addr learned my addr 172.21.15.3:0/4137387894 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.192+0000 7fcdaf200640 1 --2- 172.21.15.3:0/4137387894 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5642c17fa1e0 0x5642c17fa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.192+0000 7fcdae800640 1 -- 172.21.15.3:0/4137387894 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5642c17fa1e0 msgr2=0x5642c17fa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.192+0000 7fcdae800640 1 --2- 172.21.15.3:0/4137387894 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5642c17fa1e0 0x5642c17fa5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.192+0000 7fcdae800640 1 -- 172.21.15.3:0/4137387894 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c18053a0 msgr2=0x5642c1807790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.192+0000 7fcdae800640 1 --2- 172.21.15.3:0/4137387894 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c18053a0 0x5642c1807790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.192+0000 7fcdae800640 1 -- 172.21.15.3:0/4137387894 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642c1473210 con 0x5642c17fab00 2024-09-19T06:15:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.192+0000 7fcda7e00640 1 --2- 172.21.15.3:0/4137387894 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c18053a0 0x5642c1807790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.192+0000 7fcda7400640 1 --2- 172.21.15.3:0/2273795268 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcd940a33b0 0x7fcd940a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.193+0000 7fcda7400640 1 -- 172.21.15.3:0/2273795268 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fcd980d01c0 con 0x7fcdb0074eb0 2024-09-19T06:15:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.193+0000 7fcdae800640 1 --2- 172.21.15.3:0/4137387894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642c17fab00 0x5642c1804e60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcda002aa70 tx=0x7fcda00040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=382476b7e34b3613 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.193+0000 7fcdaf200640 1 --2- 172.21.15.3:0/2273795268 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcd940a33b0 0x7fcd940a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.193+0000 7fcd9f400640 1 -- 172.21.15.3:0/4137387894 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda0035030 con 0x5642c17fab00 2024-09-19T06:15:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.193+0000 7fcd9f400640 1 -- 172.21.15.3:0/4137387894 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcda0005520 con 0x5642c17fab00 2024-09-19T06:15:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.193+0000 7fcd9f400640 1 -- 172.21.15.3:0/4137387894 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda00035f0 con 0x5642c17fab00 2024-09-19T06:15:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.194+0000 7fcdb82d6740 1 -- 172.21.15.3:0/4137387894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642c17fab00 msgr2=0x5642c1804e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.194+0000 7fcdb82d6740 1 --2- 172.21.15.3:0/4137387894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642c17fab00 0x5642c1804e60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcda002aa70 tx=0x7fcda00040c0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.194+0000 7fcdaf200640 1 --2- 172.21.15.3:0/2273795268 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcd940a33b0 0x7fcd940a5870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcda8005fd0 tx=0x7fcda8009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.194+0000 7fcdb82d6740 1 -- 172.21.15.3:0/4137387894 shutdown_connections 2024-09-19T06:15:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.194+0000 7fcdb82d6740 1 --2- 172.21.15.3:0/4137387894 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c18053a0 0x5642c1807790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.194+0000 7fcdb82d6740 1 --2- 172.21.15.3:0/4137387894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642c17fab00 0x5642c1804e60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.194+0000 7fcdb82d6740 1 --2- 172.21.15.3:0/4137387894 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5642c17fa1e0 0x5642c17fa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.194+0000 7fcdb82d6740 1 -- 172.21.15.3:0/4137387894 >> 172.21.15.3:0/4137387894 conn(0x5642c17f6750 msgr2=0x5642c17f6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.194+0000 7fcdb82d6740 1 -- 172.21.15.3:0/4137387894 shutdown_connections 2024-09-19T06:15:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.194+0000 7fcdb82d6740 1 -- 172.21.15.3:0/4137387894 wait complete. 2024-09-19T06:15:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.194+0000 7fcdb82d6740 1 -- start start 2024-09-19T06:15:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.195+0000 7fcdb82d6740 1 Processor -- start 2024-09-19T06:15:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.195+0000 7fcdb82d6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5642c17fa1e0 0x5642c1802380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:43.207 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.195+0000 7fcdb82d6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642c17fab00 0x5642c18028c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:43.207 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.195+0000 7fcdb82d6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c18053a0 0x5642c1802e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:43.207 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.195+0000 7fcdb82d6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5642c1807f70 con 0x5642c18053a0 2024-09-19T06:15:43.207 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.195+0000 7fcdb82d6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5642c16e9090 con 0x5642c17fab00 2024-09-19T06:15:43.207 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.195+0000 7fcdb82d6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5642c18080f0 con 0x5642c17fa1e0 2024-09-19T06:15:43.207 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.195+0000 7fcdb82d6740 10 client.0 _ll_register_callbacks cb 0x5642c173df30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:43.207 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.195+0000 7fcdaf200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c18053a0 0x5642c1802e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:43.207 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.195+0000 7fcdae800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5642c17fa1e0 0x5642c1802380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:43.207 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.195+0000 7fcdaf200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c18053a0 0x5642c1802e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41852/0 (socket says 172.21.15.3:41852) 2024-09-19T06:15:43.207 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.195+0000 7fcda7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642c17fab00 0x5642c18028c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:43.207 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.196+0000 7fcdaf200640 1 -- 172.21.15.3:0/2915467077 learned_addr learned my addr 172.21.15.3:0/2915467077 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.196+0000 7fcdae800640 1 -- 172.21.15.3:0/2915467077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642c17fab00 msgr2=0x5642c18028c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.196+0000 7fcdae800640 1 --2- 172.21.15.3:0/2915467077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642c17fab00 0x5642c18028c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.196+0000 7fcdae800640 1 -- 172.21.15.3:0/2915467077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c18053a0 msgr2=0x5642c1802e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.196+0000 7fcdae800640 1 --2- 172.21.15.3:0/2915467077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c18053a0 0x5642c1802e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.196+0000 7fcdae800640 1 -- 172.21.15.3:0/2915467077 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642c153f620 con 0x5642c17fa1e0 2024-09-19T06:15:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.196+0000 7fcdaf200640 1 --2- 172.21.15.3:0/2915467077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c18053a0 0x5642c1802e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.196+0000 7fcdae800640 1 --2- 172.21.15.3:0/2915467077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5642c17fa1e0 0x5642c1802380 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcda0031550 tx=0x7fcda002ab00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bf441ef52595e87 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.196+0000 7fcd93e00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:15:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.196+0000 7fcd93e00640 1 -- 172.21.15.3:0/2915467077 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda0035070 con 0x5642c17fa1e0 2024-09-19T06:15:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.196+0000 7fcdb82d6740 1 -- 172.21.15.3:0/2915467077 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcda0005520 con 0x5642c17fa1e0 2024-09-19T06:15:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.196+0000 7fcd93e00640 1 -- 172.21.15.3:0/2915467077 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fcda0004f20 con 0x5642c17fa1e0 2024-09-19T06:15:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.197+0000 7fcd93e00640 1 -- 172.21.15.3:0/2915467077 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcda0005120 con 0x5642c17fa1e0 2024-09-19T06:15:43.209 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.197+0000 7fcdb82d6740 10 client.26164 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:43.209 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.197+0000 7fcdb82d6740 1 -- 172.21.15.3:0/2915467077 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5642c1807f70 con 0x5642c17fa1e0 2024-09-19T06:15:43.209 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.197+0000 7fcd93e00640 1 -- 172.21.15.3:0/2915467077 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcda0005520 con 0x5642c17fa1e0 2024-09-19T06:15:43.209 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.197+0000 7fcd93e00640 1 -- 172.21.15.3:0/2915467077 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fcda00035f0 con 0x5642c17fa1e0 2024-09-19T06:15:43.209 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.197+0000 7fcdb82d6740 10 client.26164 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:43.209 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.197+0000 7fcdb82d6740 10 client.26164 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:43.209 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.197+0000 7fcdb82d6740 20 client.26164 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:43.209 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.197+0000 7fcdb82d6740 1 --2- 172.21.15.3:0/2915467077 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5642c1814d80 0x5642c1817170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:43.209 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.197+0000 7fcdb82d6740 4 client.26164 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:43.209 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.197+0000 7fcdb82d6740 1 -- 172.21.15.3:0/2915467077 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642c176d830 con 0x5642c1814d80 2024-09-19T06:15:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.198+0000 7fcda7e00640 1 --2- 172.21.15.3:0/2915467077 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5642c1814d80 0x5642c1817170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.198+0000 7fcda7e00640 1 --2- 172.21.15.3:0/2915467077 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5642c1814d80 0x5642c1817170 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dc2c01d229cbc56 server_cookie=f219de66384c879a in_seq=0 out_seq=0 2024-09-19T06:15:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.198+0000 7fcd93e00640 10 client.26164 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.199+0000 7fcd93e00640 1 -- 172.21.15.3:0/2915467077 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5642c176d830 con 0x5642c1814d80 2024-09-19T06:15:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.199+0000 7fcd93e00640 10 client.26164 handle_command_reply: tid=0 2024-09-19T06:15:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.199+0000 7fcdb82d6740 1 client.26164 shutdown 2024-09-19T06:15:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.199+0000 7fcdb82d6740 1 -- 172.21.15.3:0/2915467077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5642c17fa1e0 msgr2=0x5642c1802380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.199+0000 7fcdb82d6740 1 --2- 172.21.15.3:0/2915467077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5642c17fa1e0 0x5642c1802380 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcda0031550 tx=0x7fcda002ab00 comp rx=0 tx=0).stop 2024-09-19T06:15:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.199+0000 7fcdb82d6740 1 -- 172.21.15.3:0/2915467077 shutdown_connections 2024-09-19T06:15:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.199+0000 7fcdb82d6740 1 --2- 172.21.15.3:0/2915467077 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5642c1814d80 0x5642c1817170 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.199+0000 7fcdb82d6740 1 --2- 172.21.15.3:0/2915467077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c18053a0 0x5642c1802e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.199+0000 7fcdb82d6740 1 --2- 172.21.15.3:0/2915467077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642c17fab00 0x5642c18028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.199+0000 7fcdb82d6740 1 --2- 172.21.15.3:0/2915467077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5642c17fa1e0 0x5642c1802380 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.199+0000 7fcdb82d6740 1 -- 172.21.15.3:0/2915467077 >> 172.21.15.3:0/2915467077 conn(0x5642c17f6750 msgr2=0x5642c17fc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.199+0000 7fcd93e00640 0 client.26164 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.200+0000 7fcdb82d6740 1 -- 172.21.15.3:0/2915467077 shutdown_connections 2024-09-19T06:15:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.200+0000 7fcdb82d6740 1 -- 172.21.15.3:0/2915467077 wait complete. 2024-09-19T06:15:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.200+0000 7fcdb82d6740 20 client.26164 trim_cache size 0 max 16384 2024-09-19T06:15:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.215+0000 7fcdb82d6740 1 Processor -- start 2024-09-19T06:15:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.215+0000 7fcdb82d6740 1 -- start start 2024-09-19T06:15:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.215+0000 7fcdb82d6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642c17fa1e0 0x5642c181c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.215+0000 7fcdb82d6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5642c17fab00 0x5642c181cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.216+0000 7fcdb82d6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c18053a0 0x5642c17fbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.216+0000 7fcdb82d6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb01b3ed0 con 0x5642c18053a0 2024-09-19T06:15:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.216+0000 7fcdb82d6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb01b5a10 con 0x5642c17fa1e0 2024-09-19T06:15:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.216+0000 7fcdb82d6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb01b45a0 con 0x5642c17fab00 2024-09-19T06:15:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.216+0000 7fcdaf200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c18053a0 0x5642c17fbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.216+0000 7fcdaf200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c18053a0 0x5642c17fbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41854/0 (socket says 172.21.15.3:41854) 2024-09-19T06:15:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.216+0000 7fcdaf200640 1 -- 172.21.15.3:0/3241720045 learned_addr learned my addr 172.21.15.3:0/3241720045 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.216+0000 7fcdae800640 1 --2- 172.21.15.3:0/3241720045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642c17fa1e0 0x5642c181c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.216+0000 7fcda7e00640 1 --2- 172.21.15.3:0/3241720045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5642c17fab00 0x5642c181cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.216+0000 7fcdaf200640 1 -- 172.21.15.3:0/3241720045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5642c17fab00 msgr2=0x5642c181cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:43.219 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.216+0000 7fcdaf200640 1 --2- 172.21.15.3:0/3241720045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5642c17fab00 0x5642c181cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.216+0000 7fcdaf200640 1 -- 172.21.15.3:0/3241720045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642c17fa1e0 msgr2=0x5642c181c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.216+0000 7fcdaf200640 1 --2- 172.21.15.3:0/3241720045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642c17fa1e0 0x5642c181c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.216+0000 7fcdaf200640 1 -- 172.21.15.3:0/3241720045 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642c17f1d60 con 0x5642c18053a0 2024-09-19T06:15:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.216+0000 7fcda7e00640 1 --2- 172.21.15.3:0/3241720045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5642c17fab00 0x5642c181cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.217+0000 7fcdaf200640 1 --2- 172.21.15.3:0/3241720045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c18053a0 0x5642c17fbc40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcda800fba0 tx=0x7fcda8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e79605f2b677d7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.217+0000 7fcd9ea00640 1 -- 172.21.15.3:0/3241720045 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda800fe10 con 0x5642c18053a0 2024-09-19T06:15:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.217+0000 7fcd9ea00640 1 -- 172.21.15.3:0/3241720045 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcda802e070 con 0x5642c18053a0 2024-09-19T06:15:43.220 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.217+0000 7fcd9ea00640 1 -- 172.21.15.3:0/3241720045 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda8029db0 con 0x5642c18053a0 2024-09-19T06:15:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.217+0000 7fcdb82d6740 1 -- 172.21.15.3:0/3241720045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c18053a0 msgr2=0x5642c17fbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.217+0000 7fcdb82d6740 1 --2- 172.21.15.3:0/3241720045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c18053a0 0x5642c17fbc40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcda800fba0 tx=0x7fcda8017000 comp rx=0 tx=0).stop 2024-09-19T06:15:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.218+0000 7fcdb82d6740 1 -- 172.21.15.3:0/3241720045 shutdown_connections 2024-09-19T06:15:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.218+0000 7fcdb82d6740 1 --2- 172.21.15.3:0/3241720045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c18053a0 0x5642c17fbc40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.218+0000 7fcdb82d6740 1 --2- 172.21.15.3:0/3241720045 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5642c17fab00 0x5642c181cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.218+0000 7fcdb82d6740 1 --2- 172.21.15.3:0/3241720045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642c17fa1e0 0x5642c181c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.218+0000 7fcdb82d6740 1 -- 172.21.15.3:0/3241720045 >> 172.21.15.3:0/3241720045 conn(0x5642c17f6750 msgr2=0x5642c17f6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.218+0000 7fcdb82d6740 1 -- 172.21.15.3:0/3241720045 shutdown_connections 2024-09-19T06:15:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.218+0000 7fcdb82d6740 1 -- 172.21.15.3:0/3241720045 wait complete. 2024-09-19T06:15:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.218+0000 7fcdb82d6740 1 -- start start 2024-09-19T06:15:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.218+0000 7fcdb82d6740 1 Processor -- start 2024-09-19T06:15:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.219+0000 7fcdb82d6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c17fa1e0 0x5642c180d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.219+0000 7fcdb82d6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642c17fab00 0x5642c180db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.219+0000 7fcdb82d6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5642c18053a0 0x5642c18089a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.219+0000 7fcdb82d6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb01b5340 con 0x5642c17fa1e0 2024-09-19T06:15:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.219+0000 7fcdb82d6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb01b4c70 con 0x5642c17fab00 2024-09-19T06:15:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.219+0000 7fcdb82d6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb01b1eb0 con 0x5642c18053a0 2024-09-19T06:15:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.219+0000 7fcdb82d6740 10 client.0 _ll_register_callbacks cb 0x7fcd980d3be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.219+0000 7fcdae800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c17fa1e0 0x5642c180d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:43.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.219+0000 7fcdae800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c17fa1e0 0x5642c180d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41870/0 (socket says 172.21.15.3:41870) 2024-09-19T06:15:43.226 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.219+0000 7fcdae800640 1 -- 172.21.15.3:0/3772407362 learned_addr learned my addr 172.21.15.3:0/3772407362 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:43.226 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.219+0000 7fcda7e00640 1 --2- 172.21.15.3:0/3772407362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642c17fab00 0x5642c180db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:43.226 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.219+0000 7fcdaf200640 1 --2- 172.21.15.3:0/3772407362 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5642c18053a0 0x5642c18089a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:43.226 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.219+0000 7fcdae800640 1 -- 172.21.15.3:0/3772407362 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5642c18053a0 msgr2=0x5642c18089a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:43.226 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.219+0000 7fcdae800640 1 --2- 172.21.15.3:0/3772407362 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5642c18053a0 0x5642c18089a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.226 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.219+0000 7fcdae800640 1 -- 172.21.15.3:0/3772407362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642c17fab00 msgr2=0x5642c180db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:43.226 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.219+0000 7fcdae800640 1 --2- 172.21.15.3:0/3772407362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642c17fab00 0x5642c180db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.226 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.219+0000 7fcdae800640 1 -- 172.21.15.3:0/3772407362 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642c18091d0 con 0x5642c17fa1e0 2024-09-19T06:15:43.226 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.220+0000 7fcdae800640 1 --2- 172.21.15.3:0/3772407362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c17fa1e0 0x5642c180d620 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fcda0006010 tx=0x7fcda0003e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa570979c704a589 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:43.226 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.220+0000 7fcd93e00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:15:43.226 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.220+0000 7fcd93e00640 1 -- 172.21.15.3:0/3772407362 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda0035040 con 0x5642c17fa1e0 2024-09-19T06:15:43.226 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.220+0000 7fcd93e00640 1 -- 172.21.15.3:0/3772407362 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fcda0049040 con 0x5642c17fa1e0 2024-09-19T06:15:43.227 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.220+0000 7fcdb82d6740 1 -- 172.21.15.3:0/3772407362 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcda802e070 con 0x5642c17fa1e0 2024-09-19T06:15:43.227 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.220+0000 7fcd93e00640 1 -- 172.21.15.3:0/3772407362 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcda00049d0 con 0x5642c17fa1e0 2024-09-19T06:15:43.227 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.220+0000 7fcdb82d6740 10 client.16119 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:43.227 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.220+0000 7fcdb82d6740 1 -- 172.21.15.3:0/3772407362 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5642c187f2a0 con 0x5642c17fa1e0 2024-09-19T06:15:43.227 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.220+0000 7fcd93e00640 1 -- 172.21.15.3:0/3772407362 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcda802e070 con 0x5642c17fa1e0 2024-09-19T06:15:43.227 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.221+0000 7fcd93e00640 1 -- 172.21.15.3:0/3772407362 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fcda003b430 con 0x5642c17fa1e0 2024-09-19T06:15:43.227 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.221+0000 7fcdb82d6740 10 client.16119 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:43.227 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.221+0000 7fcdb82d6740 10 client.16119 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:43.227 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.221+0000 7fcdb82d6740 20 client.16119 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:43.227 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.221+0000 7fcdb82d6740 1 --2- 172.21.15.3:0/3772407362 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5642c187f920 0x5642c1881d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:43.227 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.221+0000 7fcdb82d6740 4 client.16119 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:15:43.227 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.221+0000 7fcdb82d6740 1 -- 172.21.15.3:0/3772407362 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5642c1767b80 con 0x5642c187f920 2024-09-19T06:15:43.228 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.221+0000 7fcda7e00640 1 --2- 172.21.15.3:0/3772407362 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5642c187f920 0x5642c1881d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:43.228 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.222+0000 7fcda7e00640 1 --2- 172.21.15.3:0/3772407362 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5642c187f920 0x5642c1881d40 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c563ed22313e4cca server_cookie=4f80e844f21fcb18 in_seq=0 out_seq=0 2024-09-19T06:15:43.228 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.222+0000 7fcd93e00640 10 client.16119 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:43.239 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.237+0000 7fcd93e00640 1 -- 172.21.15.3:0/3772407362 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5642c1767b80 con 0x5642c187f920 2024-09-19T06:15:43.239 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.237+0000 7fcd93e00640 10 client.16119 handle_command_reply: tid=0 2024-09-19T06:15:43.239 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.238+0000 7fcdb82d6740 1 client.16119 shutdown 2024-09-19T06:15:43.240 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.238+0000 7fcdb82d6740 1 -- 172.21.15.3:0/3772407362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c17fa1e0 msgr2=0x5642c180d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:43.240 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.238+0000 7fcdb82d6740 1 --2- 172.21.15.3:0/3772407362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c17fa1e0 0x5642c180d620 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fcda0006010 tx=0x7fcda0003e60 comp rx=0 tx=0).stop 2024-09-19T06:15:43.240 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.238+0000 7fcdb82d6740 1 -- 172.21.15.3:0/3772407362 shutdown_connections 2024-09-19T06:15:43.240 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.238+0000 7fcdb82d6740 1 --2- 172.21.15.3:0/3772407362 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5642c187f920 0x5642c1881d40 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.240 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.238+0000 7fcdb82d6740 1 --2- 172.21.15.3:0/3772407362 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5642c18053a0 0x5642c18089a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.240 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.238+0000 7fcdb82d6740 1 --2- 172.21.15.3:0/3772407362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5642c17fab00 0x5642c180db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.240 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.238+0000 7fcd93e00640 0 client.16119 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:43.240 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.238+0000 7fcdb82d6740 1 --2- 172.21.15.3:0/3772407362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5642c17fa1e0 0x5642c180d620 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.241 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.238+0000 7fcdb82d6740 1 -- 172.21.15.3:0/3772407362 >> 172.21.15.3:0/3772407362 conn(0x5642c17f6750 msgr2=0x5642c18039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:43.241 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.238+0000 7fcdb82d6740 1 -- 172.21.15.3:0/3772407362 shutdown_connections 2024-09-19T06:15:43.241 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.238+0000 7fcdb82d6740 1 -- 172.21.15.3:0/3772407362 wait complete. 2024-09-19T06:15:43.241 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.238+0000 7fcdb82d6740 20 client.16119 trim_cache size 0 max 16384 2024-09-19T06:15:43.241 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:15:43.241 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:15:43.241 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:15:43.242 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:15:43.242 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.239+0000 7fcdb5400640 1 -- 172.21.15.3:0/2273795268 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcd940a33b0 msgr2=0x7fcd940a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:43.242 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.239+0000 7fcdb5400640 1 --2- 172.21.15.3:0/2273795268 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcd940a33b0 0x7fcd940a5870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcda8005fd0 tx=0x7fcda8009500 comp rx=0 tx=0).stop 2024-09-19T06:15:43.242 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.239+0000 7fcdb5400640 1 -- 172.21.15.3:0/2273795268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb0074eb0 msgr2=0x7fcdb01a4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:43.242 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.239+0000 7fcdb5400640 1 --2- 172.21.15.3:0/2273795268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb0074eb0 0x7fcdb01a4c20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800e9f0 tx=0x7fcd9800edf0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.243 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.239+0000 7fcdb5400640 1 -- 172.21.15.3:0/2273795268 shutdown_connections 2024-09-19T06:15:43.243 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.239+0000 7fcdb5400640 1 --2- 172.21.15.3:0/2273795268 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcd940a33b0 0x7fcd940a5870 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.243 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.239+0000 7fcdb5400640 1 --2- 172.21.15.3:0/2273795268 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcdb0112ad0 0x7fcdb019e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.243 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.239+0000 7fcdb5400640 1 --2- 172.21.15.3:0/2273795268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdb0074eb0 0x7fcdb01a4c20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.243 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.239+0000 7fcdb5400640 1 --2- 172.21.15.3:0/2273795268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcdb0074590 0x7fcdb01a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:43.243 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.239+0000 7fcdb5400640 1 -- 172.21.15.3:0/2273795268 >> 172.21.15.3:0/2273795268 conn(0x7fcdb00fd7e0 msgr2=0x7fcdb00ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:43.243 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.239+0000 7fcdb5400640 1 -- 172.21.15.3:0/2273795268 shutdown_connections 2024-09-19T06:15:43.243 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:43.239+0000 7fcdb5400640 1 -- 172.21.15.3:0/2273795268 wait complete. 2024-09-19T06:15:44.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:44 smithi003 ceph-mon[30893]: pgmap v103: 97 pgs: 97 active+clean; 3.8 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 15 op/s 2024-09-19T06:15:44.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:44 smithi071 ceph-mon[35662]: pgmap v103: 97 pgs: 97 active+clean; 3.8 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 15 op/s 2024-09-19T06:15:44.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:44 smithi059 ceph-mon[35138]: pgmap v103: 97 pgs: 97 active+clean; 3.8 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 15 op/s 2024-09-19T06:15:46.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:46 smithi003 ceph-mon[30893]: pgmap v104: 97 pgs: 97 active+clean; 3.9 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-09-19T06:15:46.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:46 smithi071 ceph-mon[35662]: pgmap v104: 97 pgs: 97 active+clean; 3.9 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-09-19T06:15:46.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:46 smithi059 ceph-mon[35138]: pgmap v104: 97 pgs: 97 active+clean; 3.9 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-09-19T06:15:48.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:48 smithi003 ceph-mon[30893]: pgmap v105: 97 pgs: 97 active+clean; 3.9 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 15 op/s 2024-09-19T06:15:48.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:48 smithi071 ceph-mon[35662]: pgmap v105: 97 pgs: 97 active+clean; 3.9 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 15 op/s 2024-09-19T06:15:48.340 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:48 smithi059 ceph-mon[35138]: pgmap v105: 97 pgs: 97 active+clean; 3.9 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 15 op/s 2024-09-19T06:15:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:50 smithi003 ceph-mon[30893]: pgmap v106: 97 pgs: 97 active+clean; 4.0 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 21 op/s 2024-09-19T06:15:50.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:50 smithi071 ceph-mon[35662]: pgmap v106: 97 pgs: 97 active+clean; 4.0 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 21 op/s 2024-09-19T06:15:50.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:50 smithi059 ceph-mon[35138]: pgmap v106: 97 pgs: 97 active+clean; 4.0 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 21 op/s 2024-09-19T06:15:52.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:52 smithi003 ceph-mon[30893]: pgmap v107: 97 pgs: 97 active+clean; 4.0 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 15 op/s 2024-09-19T06:15:52.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:52 smithi071 ceph-mon[35662]: pgmap v107: 97 pgs: 97 active+clean; 4.0 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 15 op/s 2024-09-19T06:15:52.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:52 smithi059 ceph-mon[35138]: pgmap v107: 97 pgs: 97 active+clean; 4.0 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 15 op/s 2024-09-19T06:15:54.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:54 smithi003 ceph-mon[30893]: pgmap v108: 97 pgs: 97 active+clean; 4.0 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 15 op/s 2024-09-19T06:15:54.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:54 smithi071 ceph-mon[35662]: pgmap v108: 97 pgs: 97 active+clean; 4.0 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 15 op/s 2024-09-19T06:15:54.537 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:15:54.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:54 smithi059 ceph-mon[35138]: pgmap v108: 97 pgs: 97 active+clean; 4.0 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 15 op/s 2024-09-19T06:15:54.585 INFO:tasks.workunit.client.0.smithi003.stdout:64/600: open fd = 3 2024-09-19T06:15:54.585 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.585 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.585 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.585 INFO:tasks.workunit.client.0.smithi003.stdout:65/600: open fd = 3 2024-09-19T06:15:54.585 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.585 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.586 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.586 INFO:tasks.workunit.client.0.smithi003.stdout:66/600: open fd = 3 2024-09-19T06:15:54.586 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.586 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.586 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.586 INFO:tasks.workunit.client.0.smithi003.stdout:67/600: open fd = 3 2024-09-19T06:15:54.586 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.586 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.586 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.586 INFO:tasks.workunit.client.0.smithi003.stdout:68/600: open fd = 3 2024-09-19T06:15:54.586 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.586 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.586 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.586 INFO:tasks.workunit.client.0.smithi003.stdout:69/600: open fd = 3 2024-09-19T06:15:54.587 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.587 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.587 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.587 INFO:tasks.workunit.client.0.smithi003.stdout:70/600: open fd = 3 2024-09-19T06:15:54.587 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.587 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.587 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.587 INFO:tasks.workunit.client.0.smithi003.stdout:71/600: open fd = 3 2024-09-19T06:15:54.587 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.587 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.587 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.587 INFO:tasks.workunit.client.0.smithi003.stdout:72/600: open fd = 3 2024-09-19T06:15:54.587 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.588 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.588 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.588 INFO:tasks.workunit.client.0.smithi003.stdout:73/600: open fd = 3 2024-09-19T06:15:54.588 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.588 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.588 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.588 INFO:tasks.workunit.client.0.smithi003.stdout:74/600: open fd = 3 2024-09-19T06:15:54.588 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.588 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.588 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.588 INFO:tasks.workunit.client.0.smithi003.stdout:75/600: open fd = 3 2024-09-19T06:15:54.588 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.588 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.588 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.589 INFO:tasks.workunit.client.0.smithi003.stdout:76/600: open fd = 3 2024-09-19T06:15:54.589 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.589 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.589 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.589 INFO:tasks.workunit.client.0.smithi003.stdout:77/600: open fd = 3 2024-09-19T06:15:54.589 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.589 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.589 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.589 INFO:tasks.workunit.client.0.smithi003.stdout:78/600: open fd = 3 2024-09-19T06:15:54.589 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.589 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.589 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.589 INFO:tasks.workunit.client.0.smithi003.stdout:79/600: open fd = 3 2024-09-19T06:15:54.589 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.589 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.590 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.590 INFO:tasks.workunit.client.0.smithi003.stdout:80/600: open fd = 3 2024-09-19T06:15:54.590 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.590 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.590 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.590 INFO:tasks.workunit.client.0.smithi003.stdout:81/600: open fd = 3 2024-09-19T06:15:54.590 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.590 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.590 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.590 INFO:tasks.workunit.client.0.smithi003.stdout:82/600: open fd = 3 2024-09-19T06:15:54.590 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.590 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.590 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.590 INFO:tasks.workunit.client.0.smithi003.stdout:83/600: open fd = 3 2024-09-19T06:15:54.591 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.591 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.591 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.591 INFO:tasks.workunit.client.0.smithi003.stdout:84/600: open fd = 3 2024-09-19T06:15:54.591 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.591 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.591 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.591 INFO:tasks.workunit.client.0.smithi003.stdout:85/600: open fd = 3 2024-09-19T06:15:54.591 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.591 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.591 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.591 INFO:tasks.workunit.client.0.smithi003.stdout:86/600: open fd = 3 2024-09-19T06:15:54.591 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.591 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.592 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.592 INFO:tasks.workunit.client.0.smithi003.stdout:87/600: open fd = 3 2024-09-19T06:15:54.592 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.592 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.592 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.592 INFO:tasks.workunit.client.0.smithi003.stdout:88/600: open fd = 3 2024-09-19T06:15:54.592 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.592 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.592 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.592 INFO:tasks.workunit.client.0.smithi003.stdout:89/600: open fd = 3 2024-09-19T06:15:54.592 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.592 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.592 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.592 INFO:tasks.workunit.client.0.smithi003.stdout:90/600: open fd = 3 2024-09-19T06:15:54.593 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.593 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.593 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.593 INFO:tasks.workunit.client.0.smithi003.stdout:91/600: open fd = 3 2024-09-19T06:15:54.593 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.593 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.593 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.593 INFO:tasks.workunit.client.0.smithi003.stdout:92/600: open fd = 3 2024-09-19T06:15:54.593 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.593 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.593 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.593 INFO:tasks.workunit.client.0.smithi003.stdout:93/600: open fd = 3 2024-09-19T06:15:54.593 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.593 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.594 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.594 INFO:tasks.workunit.client.0.smithi003.stdout:94/600: open fd = 3 2024-09-19T06:15:54.594 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.594 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.594 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.594 INFO:tasks.workunit.client.0.smithi003.stdout:95/600: open fd = 3 2024-09-19T06:15:54.594 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.594 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.594 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.594 INFO:tasks.workunit.client.0.smithi003.stdout:96/600: open fd = 3 2024-09-19T06:15:54.594 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.594 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.594 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.594 INFO:tasks.workunit.client.0.smithi003.stdout:97/600: open fd = 3 2024-09-19T06:15:54.594 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.595 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.595 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.595 INFO:tasks.workunit.client.0.smithi003.stdout:98/600: open fd = 3 2024-09-19T06:15:54.595 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.595 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.595 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.595 INFO:tasks.workunit.client.0.smithi003.stdout:99/600: open fd = 3 2024-09-19T06:15:54.595 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.595 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.595 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.595 INFO:tasks.workunit.client.0.smithi003.stdout:100/600: open fd = 3 2024-09-19T06:15:54.595 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.595 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.595 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.596 INFO:tasks.workunit.client.0.smithi003.stdout:101/600: open fd = 3 2024-09-19T06:15:54.596 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.596 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.596 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.596 INFO:tasks.workunit.client.0.smithi003.stdout:102/600: open fd = 3 2024-09-19T06:15:54.596 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.596 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.596 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.596 INFO:tasks.workunit.client.0.smithi003.stdout:103/600: open fd = 3 2024-09-19T06:15:54.596 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.596 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.596 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.596 INFO:tasks.workunit.client.0.smithi003.stdout:104/600: open fd = 3 2024-09-19T06:15:54.596 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.597 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.597 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.597 INFO:tasks.workunit.client.0.smithi003.stdout:105/600: open fd = 3 2024-09-19T06:15:54.597 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.597 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.597 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.597 INFO:tasks.workunit.client.0.smithi003.stdout:106/600: open fd = 3 2024-09-19T06:15:54.597 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.597 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.597 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.597 INFO:tasks.workunit.client.0.smithi003.stdout:107/600: open fd = 3 2024-09-19T06:15:54.597 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.597 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.597 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.597 INFO:tasks.workunit.client.0.smithi003.stdout:108/600: open fd = 3 2024-09-19T06:15:54.598 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.598 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.598 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.598 INFO:tasks.workunit.client.0.smithi003.stdout:109/600: open fd = 3 2024-09-19T06:15:54.598 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.598 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.598 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.598 INFO:tasks.workunit.client.0.smithi003.stdout:110/600: open fd = 3 2024-09-19T06:15:54.598 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.598 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.598 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.598 INFO:tasks.workunit.client.0.smithi003.stdout:111/600: open fd = 3 2024-09-19T06:15:54.598 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.598 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.599 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.599 INFO:tasks.workunit.client.0.smithi003.stdout:112/600: open fd = 3 2024-09-19T06:15:54.599 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.599 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.599 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.599 INFO:tasks.workunit.client.0.smithi003.stdout:113/600: open fd = 3 2024-09-19T06:15:54.599 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.599 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.599 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.599 INFO:tasks.workunit.client.0.smithi003.stdout:114/600: open fd = 3 2024-09-19T06:15:54.599 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.599 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.599 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.599 INFO:tasks.workunit.client.0.smithi003.stdout:115/600: open fd = 3 2024-09-19T06:15:54.599 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.600 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.600 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.600 INFO:tasks.workunit.client.0.smithi003.stdout:116/600: open fd = 3 2024-09-19T06:15:54.600 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.600 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.600 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.600 INFO:tasks.workunit.client.0.smithi003.stdout:117/600: open fd = 3 2024-09-19T06:15:54.600 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.600 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.600 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.600 INFO:tasks.workunit.client.0.smithi003.stdout:118/600: open fd = 3 2024-09-19T06:15:54.600 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.600 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.600 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.601 INFO:tasks.workunit.client.0.smithi003.stdout:119/600: open fd = 3 2024-09-19T06:15:54.601 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.601 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.601 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.601 INFO:tasks.workunit.client.0.smithi003.stdout:120/600: open fd = 3 2024-09-19T06:15:54.601 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.601 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.601 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.601 INFO:tasks.workunit.client.0.smithi003.stdout:121/600: open fd = 3 2024-09-19T06:15:54.601 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.601 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.601 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.601 INFO:tasks.workunit.client.0.smithi003.stdout:122/600: open fd = 3 2024-09-19T06:15:54.601 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.602 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.602 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.602 INFO:tasks.workunit.client.0.smithi003.stdout:123/600: open fd = 3 2024-09-19T06:15:54.602 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.602 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.602 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.602 INFO:tasks.workunit.client.0.smithi003.stdout:124/600: open fd = 3 2024-09-19T06:15:54.602 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.602 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.602 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.602 INFO:tasks.workunit.client.0.smithi003.stdout:125/600: open fd = 3 2024-09-19T06:15:54.602 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.602 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.602 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:15:54.603 INFO:tasks.workunit.client.0.smithi003.stdout:126/600: open fd = 3 2024-09-19T06:15:54.603 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:15:54.928 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:15:55.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.477+0000 7f595ca00640 1 -- 172.21.15.3:0/282301710 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5958103e30 msgr2=0x7f5958104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:55.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.477+0000 7f595ca00640 1 --2- 172.21.15.3:0/282301710 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5958103e30 0x7f5958104210 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5948009900 tx=0x7f594802a410 comp rx=0 tx=0).stop 2024-09-19T06:15:55.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.477+0000 7f595ca00640 1 -- 172.21.15.3:0/282301710 shutdown_connections 2024-09-19T06:15:55.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.477+0000 7f595ca00640 1 --2- 172.21.15.3:0/282301710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5958108f60 0x7f5958110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.477+0000 7f595ca00640 1 --2- 172.21.15.3:0/282301710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59581047e0 0x7f5958108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.477+0000 7f595ca00640 1 --2- 172.21.15.3:0/282301710 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5958103e30 0x7f5958104210 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.477+0000 7f595ca00640 1 -- 172.21.15.3:0/282301710 >> 172.21.15.3:0/282301710 conn(0x7f59580ff910 msgr2=0x7f5958101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:55.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.477+0000 7f595ca00640 1 -- 172.21.15.3:0/282301710 shutdown_connections 2024-09-19T06:15:55.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.477+0000 7f595ca00640 1 -- 172.21.15.3:0/282301710 wait complete. 2024-09-19T06:15:55.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.478+0000 7f595ca00640 1 Processor -- start 2024-09-19T06:15:55.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.479+0000 7f595ca00640 1 -- start start 2024-09-19T06:15:55.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.479+0000 7f595ca00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5958103e30 0x7f595819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:55.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.479+0000 7f595ca00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59581047e0 0x7f595819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:55.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.479+0000 7f595ca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5958108f60 0x7f595819ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:55.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.479+0000 7f595ca00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5958114010 con 0x7f59581047e0 2024-09-19T06:15:55.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.479+0000 7f595ca00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5958113e90 con 0x7f5958108f60 2024-09-19T06:15:55.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.479+0000 7f595ca00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5958114190 con 0x7f5958103e30 2024-09-19T06:15:55.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.479+0000 7f5956a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59581047e0 0x7f595819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:55.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.479+0000 7f5957400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5958103e30 0x7f595819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:55.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.479+0000 7f5956a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59581047e0 0x7f595819a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54134/0 (socket says 172.21.15.3:54134) 2024-09-19T06:15:55.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.479+0000 7f5957400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5958103e30 0x7f595819a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:47262/0 (socket says 172.21.15.3:47262) 2024-09-19T06:15:55.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.479+0000 7f5956a00640 1 -- 172.21.15.3:0/15304915 learned_addr learned my addr 172.21.15.3:0/15304915 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:55.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.479+0000 7f5957e00640 1 --2- 172.21.15.3:0/15304915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5958108f60 0x7f595819ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:55.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.480+0000 7f5957400640 1 -- 172.21.15.3:0/15304915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5958108f60 msgr2=0x7f595819ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:55.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.480+0000 7f5957400640 1 --2- 172.21.15.3:0/15304915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5958108f60 0x7f595819ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.480+0000 7f5957400640 1 -- 172.21.15.3:0/15304915 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59581047e0 msgr2=0x7f595819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:55.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.480+0000 7f5957400640 1 --2- 172.21.15.3:0/15304915 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59581047e0 0x7f595819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.480+0000 7f5957400640 1 -- 172.21.15.3:0/15304915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f595819f440 con 0x7f5958103e30 2024-09-19T06:15:55.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.480+0000 7f5956a00640 1 --2- 172.21.15.3:0/15304915 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59581047e0 0x7f595819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:55.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.480+0000 7f5957400640 1 --2- 172.21.15.3:0/15304915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5958103e30 0x7f595819a490 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f594802a930 tx=0x7f5948003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:55.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.480+0000 7f594fe00640 1 -- 172.21.15.3:0/15304915 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594803f070 con 0x7f5958103e30 2024-09-19T06:15:55.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.480+0000 7f594fe00640 1 -- 172.21.15.3:0/15304915 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5948031c90 con 0x7f5958103e30 2024-09-19T06:15:55.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.481+0000 7f594fe00640 1 -- 172.21.15.3:0/15304915 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5948035030 con 0x7f5958103e30 2024-09-19T06:15:55.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.481+0000 7f595ca00640 1 -- 172.21.15.3:0/15304915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f595819f6d0 con 0x7f5958103e30 2024-09-19T06:15:55.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.481+0000 7f595ca00640 1 -- 172.21.15.3:0/15304915 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59581a7010 con 0x7f5958103e30 2024-09-19T06:15:55.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.484+0000 7f5960c17740 1 Processor -- start 2024-09-19T06:15:55.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.484+0000 7f5960c17740 1 -- start start 2024-09-19T06:15:55.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.484+0000 7f594fe00640 1 -- 172.21.15.3:0/15304915 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f5948042070 con 0x7f5958103e30 2024-09-19T06:15:55.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.484+0000 7f5960c17740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33e1d50 0x5643c33e2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:55.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.484+0000 7f5960c17740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643c33e2670 0x5643c33ec9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:55.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.484+0000 7f5960c17740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643c33ecf30 0x5643c33ef320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:55.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.484+0000 7f5960c17740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5643c33483e0 con 0x5643c33e1d50 2024-09-19T06:15:55.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.484+0000 7f5960c17740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5643c32efd80 con 0x5643c33e2670 2024-09-19T06:15:55.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.484+0000 7f5960c17740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5643c33443a0 con 0x5643c33ecf30 2024-09-19T06:15:55.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.484+0000 7f5957e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33e1d50 0x5643c33e2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:55.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.484+0000 7f5957400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643c33e2670 0x5643c33ec9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:55.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.485+0000 7f5957e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33e1d50 0x5643c33e2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54144/0 (socket says 172.21.15.3:54144) 2024-09-19T06:15:55.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.485+0000 7f5957e00640 1 -- 172.21.15.3:0/1852585685 learned_addr learned my addr 172.21.15.3:0/1852585685 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:55.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.485+0000 7f5956a00640 1 --2- 172.21.15.3:0/1852585685 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643c33ecf30 0x5643c33ef320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:55.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.485+0000 7f5957e00640 1 -- 172.21.15.3:0/1852585685 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643c33ecf30 msgr2=0x5643c33ef320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:55.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.485+0000 7f5957e00640 1 --2- 172.21.15.3:0/1852585685 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643c33ecf30 0x5643c33ef320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.485+0000 7f5957e00640 1 -- 172.21.15.3:0/1852585685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643c33e2670 msgr2=0x5643c33ec9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:55.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.485+0000 7f5957e00640 1 --2- 172.21.15.3:0/1852585685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643c33e2670 0x5643c33ec9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.485+0000 7f5957e00640 1 -- 172.21.15.3:0/1852585685 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643c330eae0 con 0x5643c33e1d50 2024-09-19T06:15:55.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.485+0000 7f5957e00640 1 --2- 172.21.15.3:0/1852585685 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33e1d50 0x5643c33e2130 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5950009f90 tx=0x7f5950010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54750deecff8b151 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:55.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.486+0000 7f5943e00640 1 -- 172.21.15.3:0/1852585685 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5950011700 con 0x5643c33e1d50 2024-09-19T06:15:55.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.486+0000 7f5943e00640 1 -- 172.21.15.3:0/1852585685 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5950011d80 con 0x5643c33e1d50 2024-09-19T06:15:55.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.486+0000 7f5943e00640 1 -- 172.21.15.3:0/1852585685 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5950018380 con 0x5643c33e1d50 2024-09-19T06:15:55.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.486+0000 7f594fe00640 1 --2- 172.21.15.3:0/15304915 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f593c0a33b0 0x7f593c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:55.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.486+0000 7f594fe00640 1 -- 172.21.15.3:0/15304915 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f59480f0430 con 0x7f5958103e30 2024-09-19T06:15:55.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.486+0000 7f5957400640 1 --2- 172.21.15.3:0/15304915 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f593c0a33b0 0x7f593c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:55.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.486+0000 7f5960c17740 1 -- 172.21.15.3:0/1852585685 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33e1d50 msgr2=0x5643c33e2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:55.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.486+0000 7f5960c17740 1 --2- 172.21.15.3:0/1852585685 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33e1d50 0x5643c33e2130 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5950009f90 tx=0x7f5950010860 comp rx=0 tx=0).stop 2024-09-19T06:15:55.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.487+0000 7f5960c17740 1 -- 172.21.15.3:0/1852585685 shutdown_connections 2024-09-19T06:15:55.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.487+0000 7f5960c17740 1 --2- 172.21.15.3:0/1852585685 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643c33ecf30 0x5643c33ef320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.487+0000 7f5960c17740 1 --2- 172.21.15.3:0/1852585685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643c33e2670 0x5643c33ec9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.487+0000 7f5960c17740 1 --2- 172.21.15.3:0/1852585685 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33e1d50 0x5643c33e2130 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.487+0000 7f5960c17740 1 -- 172.21.15.3:0/1852585685 >> 172.21.15.3:0/1852585685 conn(0x5643c33de2e0 msgr2=0x5643c33de6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:55.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.487+0000 7f5957400640 1 --2- 172.21.15.3:0/15304915 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f593c0a33b0 0x7f593c0a5870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f59480f3fd0 tx=0x7f59480f3ee0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:55.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.487+0000 7f5960c17740 1 -- 172.21.15.3:0/1852585685 shutdown_connections 2024-09-19T06:15:55.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.487+0000 7f5960c17740 1 -- 172.21.15.3:0/1852585685 wait complete. 2024-09-19T06:15:55.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.487+0000 7f5960c17740 1 -- start start 2024-09-19T06:15:55.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.487+0000 7f5960c17740 1 Processor -- start 2024-09-19T06:15:55.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.488+0000 7f5960c17740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643c33e1d50 0x5643c33e9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:55.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.488+0000 7f5960c17740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33e2670 0x5643c33ea3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:55.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.488+0000 7f5960c17740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643c33ecf30 0x5643c33ea910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:55.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.488+0000 7f5960c17740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5643c33efba0 con 0x5643c33e2670 2024-09-19T06:15:55.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.488+0000 7f5960c17740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5643c33030f0 con 0x5643c33e1d50 2024-09-19T06:15:55.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.488+0000 7f5960c17740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5643c33efd20 con 0x5643c33ecf30 2024-09-19T06:15:55.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.488+0000 7f5960c17740 10 client.0 _ll_register_callbacks cb 0x5643c32f49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:55.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.488+0000 7f5956a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33e2670 0x5643c33ea3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:55.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.488+0000 7f5956a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33e2670 0x5643c33ea3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54158/0 (socket says 172.21.15.3:54158) 2024-09-19T06:15:55.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.488+0000 7f5956a00640 1 -- 172.21.15.3:0/207603240 learned_addr learned my addr 172.21.15.3:0/207603240 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:55.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.488+0000 7f5957e00640 1 --2- 172.21.15.3:0/207603240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643c33e1d50 0x5643c33e9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:55.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.488+0000 7f5957e00640 1 --2- 172.21.15.3:0/207603240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643c33ecf30 0x5643c33ea910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:55.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.489+0000 7f5956a00640 1 -- 172.21.15.3:0/207603240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643c33ecf30 msgr2=0x5643c33ea910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:55.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.489+0000 7f5956a00640 1 --2- 172.21.15.3:0/207603240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643c33ecf30 0x5643c33ea910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.489+0000 7f5956a00640 1 -- 172.21.15.3:0/207603240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643c33e1d50 msgr2=0x5643c33e9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:55.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.489+0000 7f5956a00640 1 --2- 172.21.15.3:0/207603240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643c33e1d50 0x5643c33e9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.489+0000 7f5956a00640 1 -- 172.21.15.3:0/207603240 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643c30b93c0 con 0x5643c33e2670 2024-09-19T06:15:55.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.489+0000 7f5957e00640 1 --2- 172.21.15.3:0/207603240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643c33e1d50 0x5643c33e9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:55.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.489+0000 7f5956a00640 1 --2- 172.21.15.3:0/207603240 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33e2670 0x5643c33ea3d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5944004470 tx=0x7f59440039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a36c6ea7b9fa67bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:55.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.489+0000 7f5940c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:15:55.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.489+0000 7f5940c00640 1 -- 172.21.15.3:0/207603240 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5944011830 con 0x5643c33e2670 2024-09-19T06:15:55.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.489+0000 7f5940c00640 1 -- 172.21.15.3:0/207603240 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f59440119d0 con 0x5643c33e2670 2024-09-19T06:15:55.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.489+0000 7f5960c17740 1 -- 172.21.15.3:0/207603240 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5950011d80 con 0x5643c33e2670 2024-09-19T06:15:55.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.489+0000 7f5940c00640 1 -- 172.21.15.3:0/207603240 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5944011bd0 con 0x5643c33e2670 2024-09-19T06:15:55.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.490+0000 7f5960c17740 10 client.16131 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:55.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.490+0000 7f5960c17740 1 -- 172.21.15.3:0/207603240 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5643c33fb930 con 0x5643c33e2670 2024-09-19T06:15:55.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.490+0000 7f5940c00640 1 -- 172.21.15.3:0/207603240 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5950011d80 con 0x5643c33e2670 2024-09-19T06:15:55.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.490+0000 7f5940c00640 1 -- 172.21.15.3:0/207603240 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f594401b470 con 0x5643c33e2670 2024-09-19T06:15:55.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.490+0000 7f5960c17740 10 client.16131 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:55.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.490+0000 7f5960c17740 10 client.16131 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:55.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.490+0000 7f5960c17740 20 client.16131 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:55.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.490+0000 7f5960c17740 1 --2- 172.21.15.3:0/207603240 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5643c33fcd40 0x5643c33ff150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:55.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.490+0000 7f5960c17740 4 client.16131 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:55.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.490+0000 7f5960c17740 1 -- 172.21.15.3:0/207603240 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643c3355950 con 0x5643c33fcd40 2024-09-19T06:15:55.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.491+0000 7f5957e00640 1 --2- 172.21.15.3:0/207603240 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5643c33fcd40 0x5643c33ff150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:55.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.491+0000 7f5957e00640 1 --2- 172.21.15.3:0/207603240 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5643c33fcd40 0x5643c33ff150 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13aeb924193f463f server_cookie=e7285c0578c52956 in_seq=0 out_seq=0 2024-09-19T06:15:55.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.491+0000 7f5940c00640 10 client.16131 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:55.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.492+0000 7f5940c00640 1 -- 172.21.15.3:0/207603240 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5643c3355950 con 0x5643c33fcd40 2024-09-19T06:15:55.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.492+0000 7f5940c00640 10 client.16131 handle_command_reply: tid=0 2024-09-19T06:15:55.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.492+0000 7f5960c17740 1 client.16131 shutdown 2024-09-19T06:15:55.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.492+0000 7f5960c17740 1 -- 172.21.15.3:0/207603240 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33e2670 msgr2=0x5643c33ea3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:55.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.492+0000 7f5960c17740 1 --2- 172.21.15.3:0/207603240 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33e2670 0x5643c33ea3d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5944004470 tx=0x7f59440039c0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.492+0000 7f5960c17740 1 -- 172.21.15.3:0/207603240 shutdown_connections 2024-09-19T06:15:55.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.492+0000 7f5960c17740 1 --2- 172.21.15.3:0/207603240 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5643c33fcd40 0x5643c33ff150 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.492+0000 7f5960c17740 1 --2- 172.21.15.3:0/207603240 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643c33ecf30 0x5643c33ea910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.492+0000 7f5960c17740 1 --2- 172.21.15.3:0/207603240 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33e2670 0x5643c33ea3d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.492+0000 7f5960c17740 1 --2- 172.21.15.3:0/207603240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643c33e1d50 0x5643c33e9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.492+0000 7f5960c17740 1 -- 172.21.15.3:0/207603240 >> 172.21.15.3:0/207603240 conn(0x5643c33de2e0 msgr2=0x5643c33e4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:55.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.493+0000 7f5940c00640 0 client.16131 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:55.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.493+0000 7f5960c17740 1 -- 172.21.15.3:0/207603240 shutdown_connections 2024-09-19T06:15:55.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.493+0000 7f5960c17740 1 -- 172.21.15.3:0/207603240 wait complete. 2024-09-19T06:15:55.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.493+0000 7f5960c17740 20 client.16131 trim_cache size 0 max 16384 2024-09-19T06:15:55.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.510+0000 7f5960c17740 1 Processor -- start 2024-09-19T06:15:55.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.511+0000 7f5960c17740 1 -- start start 2024-09-19T06:15:55.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.511+0000 7f5960c17740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33e1d50 0x5643c3404a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:55.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.511+0000 7f5960c17740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643c33e2670 0x5643c3404f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:55.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.511+0000 7f5960c17740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643c33ecf30 0x5643c33e7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:55.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.511+0000 7f5960c17740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f59581af9a0 con 0x5643c33e1d50 2024-09-19T06:15:55.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.511+0000 7f5960c17740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f59581b14e0 con 0x5643c33ecf30 2024-09-19T06:15:55.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.511+0000 7f5960c17740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f59581b0070 con 0x5643c33e2670 2024-09-19T06:15:55.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.511+0000 7f5957e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33e1d50 0x5643c3404a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:55.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.511+0000 7f5957e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33e1d50 0x5643c3404a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54160/0 (socket says 172.21.15.3:54160) 2024-09-19T06:15:55.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.511+0000 7f5957e00640 1 -- 172.21.15.3:0/2264121731 learned_addr learned my addr 172.21.15.3:0/2264121731 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:55.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.511+0000 7f5956a00640 1 --2- 172.21.15.3:0/2264121731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643c33e2670 0x5643c3404f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:55.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.512+0000 7f5957e00640 1 --2- 172.21.15.3:0/2264121731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643c33ecf30 0x5643c33e7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:55.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.512+0000 7f5957e00640 1 -- 172.21.15.3:0/2264121731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643c33e2670 msgr2=0x5643c3404f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:55.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.512+0000 7f5957e00640 1 --2- 172.21.15.3:0/2264121731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643c33e2670 0x5643c3404f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.512+0000 7f5957e00640 1 -- 172.21.15.3:0/2264121731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643c33ecf30 msgr2=0x5643c33e7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:55.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.512+0000 7f5957e00640 1 --2- 172.21.15.3:0/2264121731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643c33ecf30 0x5643c33e7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.512+0000 7f5957e00640 1 -- 172.21.15.3:0/2264121731 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643c33ec800 con 0x5643c33e1d50 2024-09-19T06:15:55.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.512+0000 7f5957e00640 1 --2- 172.21.15.3:0/2264121731 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33e1d50 0x5643c3404a20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5950013010 tx=0x7f5950010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4353ffd6f2340329 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:55.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.512+0000 7f5943400640 1 -- 172.21.15.3:0/2264121731 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59500193d0 con 0x5643c33e1d50 2024-09-19T06:15:55.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.512+0000 7f5943400640 1 -- 172.21.15.3:0/2264121731 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5950020040 con 0x5643c33e1d50 2024-09-19T06:15:55.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.512+0000 7f5943400640 1 -- 172.21.15.3:0/2264121731 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59500056a0 con 0x5643c33e1d50 2024-09-19T06:15:55.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.513+0000 7f5960c17740 1 -- 172.21.15.3:0/2264121731 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33e1d50 msgr2=0x5643c3404a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:55.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.513+0000 7f5960c17740 1 --2- 172.21.15.3:0/2264121731 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33e1d50 0x5643c3404a20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5950013010 tx=0x7f5950010860 comp rx=0 tx=0).stop 2024-09-19T06:15:55.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.513+0000 7f5960c17740 1 -- 172.21.15.3:0/2264121731 shutdown_connections 2024-09-19T06:15:55.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.513+0000 7f5960c17740 1 --2- 172.21.15.3:0/2264121731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643c33ecf30 0x5643c33e7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.513+0000 7f5960c17740 1 --2- 172.21.15.3:0/2264121731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643c33e2670 0x5643c3404f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.513+0000 7f5960c17740 1 --2- 172.21.15.3:0/2264121731 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33e1d50 0x5643c3404a20 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.513+0000 7f5960c17740 1 -- 172.21.15.3:0/2264121731 >> 172.21.15.3:0/2264121731 conn(0x5643c33de2e0 msgr2=0x5643c33ebf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:55.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.513+0000 7f5960c17740 1 -- 172.21.15.3:0/2264121731 shutdown_connections 2024-09-19T06:15:55.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.513+0000 7f5960c17740 1 -- 172.21.15.3:0/2264121731 wait complete. 2024-09-19T06:15:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.513+0000 7f5960c17740 1 -- start start 2024-09-19T06:15:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.514+0000 7f5960c17740 1 Processor -- start 2024-09-19T06:15:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.514+0000 7f5960c17740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643c33e1d50 0x5643c33f5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.514+0000 7f5960c17740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643c33e2670 0x5643c33f5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.514+0000 7f5960c17740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33ecf30 0x5643c33f2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.514+0000 7f5960c17740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f59581b0e10 con 0x5643c33ecf30 2024-09-19T06:15:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.514+0000 7f5960c17740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f59581b0740 con 0x5643c33e1d50 2024-09-19T06:15:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.514+0000 7f5960c17740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f59581ad980 con 0x5643c33e2670 2024-09-19T06:15:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.514+0000 7f5960c17740 10 client.0 _ll_register_callbacks cb 0x7f59440040d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.515+0000 7f5957e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33ecf30 0x5643c33f2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.515+0000 7f5957e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33ecf30 0x5643c33f2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54166/0 (socket says 172.21.15.3:54166) 2024-09-19T06:15:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.515+0000 7f5957e00640 1 -- 172.21.15.3:0/3665650476 learned_addr learned my addr 172.21.15.3:0/3665650476 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.515+0000 7f5956a00640 1 --2- 172.21.15.3:0/3665650476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643c33e2670 0x5643c33f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.515+0000 7f5957e00640 1 --2- 172.21.15.3:0/3665650476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643c33e1d50 0x5643c33f5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.515+0000 7f5956a00640 1 -- 172.21.15.3:0/3665650476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643c33e1d50 msgr2=0x5643c33f5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.515+0000 7f5956a00640 1 --2- 172.21.15.3:0/3665650476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643c33e1d50 0x5643c33f5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.515+0000 7f5956a00640 1 -- 172.21.15.3:0/3665650476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33ecf30 msgr2=0x5643c33f2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.515+0000 7f5956a00640 1 --2- 172.21.15.3:0/3665650476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33ecf30 0x5643c33f2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.515+0000 7f5956a00640 1 -- 172.21.15.3:0/3665650476 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643c33f2970 con 0x5643c33e2670 2024-09-19T06:15:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.515+0000 7f5957e00640 1 --2- 172.21.15.3:0/3665650476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33ecf30 0x5643c33f2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.515+0000 7f5956a00640 1 --2- 172.21.15.3:0/3665650476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643c33e2670 0x5643c33f5840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f594401b890 tx=0x7f5944011a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e2eb4e3e012bf95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.515+0000 7f5940c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:15:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.516+0000 7f5940c00640 1 -- 172.21.15.3:0/3665650476 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594402a040 con 0x5643c33e2670 2024-09-19T06:15:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.516+0000 7f5940c00640 1 -- 172.21.15.3:0/3665650476 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f594401ba80 con 0x5643c33e2670 2024-09-19T06:15:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.516+0000 7f5960c17740 1 -- 172.21.15.3:0/3665650476 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5950020040 con 0x5643c33e2670 2024-09-19T06:15:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.516+0000 7f5940c00640 1 -- 172.21.15.3:0/3665650476 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f594401bc80 con 0x5643c33e2670 2024-09-19T06:15:55.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.516+0000 7f5960c17740 10 client.26188 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:55.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.516+0000 7f5960c17740 1 -- 172.21.15.3:0/3665650476 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5643c34686e0 con 0x5643c33e2670 2024-09-19T06:15:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.516+0000 7f5940c00640 1 -- 172.21.15.3:0/3665650476 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5950020040 con 0x5643c33e2670 2024-09-19T06:15:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.516+0000 7f5940c00640 1 -- 172.21.15.3:0/3665650476 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f59440046b0 con 0x5643c33e2670 2024-09-19T06:15:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.516+0000 7f5960c17740 10 client.26188 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.516+0000 7f5960c17740 10 client.26188 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.516+0000 7f5960c17740 20 client.26188 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.516+0000 7f5960c17740 1 --2- 172.21.15.3:0/3665650476 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5643c3468e90 0x5643c346b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.516+0000 7f5960c17740 4 client.26188 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:15:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.516+0000 7f5960c17740 1 -- 172.21.15.3:0/3665650476 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5643c334fe60 con 0x5643c3468e90 2024-09-19T06:15:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.517+0000 7f5957e00640 1 --2- 172.21.15.3:0/3665650476 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5643c3468e90 0x5643c346b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.517+0000 7f5957e00640 1 --2- 172.21.15.3:0/3665650476 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5643c3468e90 0x5643c346b2b0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e328f6279fd2a30 server_cookie=29946234f3263045 in_seq=0 out_seq=0 2024-09-19T06:15:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.517+0000 7f5940c00640 10 client.26188 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.518+0000 7f5940c00640 1 -- 172.21.15.3:0/3665650476 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5643c334fe60 con 0x5643c3468e90 2024-09-19T06:15:55.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.518+0000 7f5940c00640 10 client.26188 handle_command_reply: tid=0 2024-09-19T06:15:55.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.518+0000 7f5960c17740 1 client.26188 shutdown 2024-09-19T06:15:55.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.518+0000 7f5960c17740 1 -- 172.21.15.3:0/3665650476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643c33e2670 msgr2=0x5643c33f5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:55.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.518+0000 7f5960c17740 1 --2- 172.21.15.3:0/3665650476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643c33e2670 0x5643c33f5840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f594401b890 tx=0x7f5944011a40 comp rx=0 tx=0).stop 2024-09-19T06:15:55.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.518+0000 7f5960c17740 1 -- 172.21.15.3:0/3665650476 shutdown_connections 2024-09-19T06:15:55.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.518+0000 7f5960c17740 1 --2- 172.21.15.3:0/3665650476 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5643c3468e90 0x5643c346b2b0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.518+0000 7f5960c17740 1 --2- 172.21.15.3:0/3665650476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643c33ecf30 0x5643c33f2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.518+0000 7f5960c17740 1 --2- 172.21.15.3:0/3665650476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643c33e2670 0x5643c33f5840 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.518+0000 7f5960c17740 1 --2- 172.21.15.3:0/3665650476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643c33e1d50 0x5643c33f5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.518+0000 7f5960c17740 1 -- 172.21.15.3:0/3665650476 >> 172.21.15.3:0/3665650476 conn(0x5643c33de2e0 msgr2=0x5643c33e9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:55.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.518+0000 7f5940c00640 0 client.26188 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:55.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.518+0000 7f5960c17740 1 -- 172.21.15.3:0/3665650476 shutdown_connections 2024-09-19T06:15:55.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.518+0000 7f5960c17740 1 -- 172.21.15.3:0/3665650476 wait complete. 2024-09-19T06:15:55.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.518+0000 7f5960c17740 20 client.26188 trim_cache size 0 max 16384 2024-09-19T06:15:55.525 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:15:55.525 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "no active scrubs running", 2024-09-19T06:15:55.525 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": {} 2024-09-19T06:15:55.525 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:15:55.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.519+0000 7f595ca00640 1 -- 172.21.15.3:0/15304915 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f593c0a33b0 msgr2=0x7f593c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:55.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.519+0000 7f595ca00640 1 --2- 172.21.15.3:0/15304915 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f593c0a33b0 0x7f593c0a5870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f59480f3fd0 tx=0x7f59480f3ee0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.519+0000 7f595ca00640 1 -- 172.21.15.3:0/15304915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5958103e30 msgr2=0x7f595819a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:55.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.519+0000 7f595ca00640 1 --2- 172.21.15.3:0/15304915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5958103e30 0x7f595819a490 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f594802a930 tx=0x7f5948003b90 comp rx=0 tx=0).stop 2024-09-19T06:15:55.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.519+0000 7f595ca00640 1 -- 172.21.15.3:0/15304915 shutdown_connections 2024-09-19T06:15:55.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.519+0000 7f595ca00640 1 --2- 172.21.15.3:0/15304915 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f593c0a33b0 0x7f593c0a5870 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.519+0000 7f595ca00640 1 --2- 172.21.15.3:0/15304915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5958108f60 0x7f595819ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.519+0000 7f595ca00640 1 --2- 172.21.15.3:0/15304915 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59581047e0 0x7f595819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.519+0000 7f595ca00640 1 --2- 172.21.15.3:0/15304915 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5958103e30 0x7f595819a490 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.519+0000 7f595ca00640 1 -- 172.21.15.3:0/15304915 >> 172.21.15.3:0/15304915 conn(0x7f59580ff910 msgr2=0x7f5958100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.519+0000 7f595ca00640 1 -- 172.21.15.3:0/15304915 shutdown_connections 2024-09-19T06:15:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:55.519+0000 7f595ca00640 1 -- 172.21.15.3:0/15304915 wait complete. 2024-09-19T06:15:56.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:56 smithi003 ceph-mon[30893]: pgmap v109: 97 pgs: 97 active+clean; 4.2 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 22 op/s 2024-09-19T06:15:56.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:56 smithi071 ceph-mon[35662]: pgmap v109: 97 pgs: 97 active+clean; 4.2 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 22 op/s 2024-09-19T06:15:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.360+0000 7f694b400640 1 -- 172.21.15.3:0/1197593350 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6944103f40 msgr2=0x7f6944104320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.360+0000 7f694b400640 1 --2- 172.21.15.3:0/1197593350 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6944103f40 0x7f6944104320 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6938009900 tx=0x7f693802a410 comp rx=0 tx=0).stop 2024-09-19T06:15:56.362 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.360+0000 7f694b400640 1 -- 172.21.15.3:0/1197593350 shutdown_connections 2024-09-19T06:15:56.363 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.360+0000 7f694b400640 1 --2- 172.21.15.3:0/1197593350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6944109090 0x7f6944110be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.363 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.360+0000 7f694b400640 1 --2- 172.21.15.3:0/1197593350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69441048f0 0x7f6944108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.363 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.360+0000 7f694b400640 1 --2- 172.21.15.3:0/1197593350 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6944103f40 0x7f6944104320 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.363 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.360+0000 7f694b400640 1 -- 172.21.15.3:0/1197593350 >> 172.21.15.3:0/1197593350 conn(0x7f69440ff970 msgr2=0x7f6944101d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:56.363 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.360+0000 7f694b400640 1 -- 172.21.15.3:0/1197593350 shutdown_connections 2024-09-19T06:15:56.363 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.360+0000 7f694b400640 1 -- 172.21.15.3:0/1197593350 wait complete. 2024-09-19T06:15:56.364 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.361+0000 7f694b400640 1 Processor -- start 2024-09-19T06:15:56.365 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.361+0000 7f694b400640 1 -- start start 2024-09-19T06:15:56.365 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.362+0000 7f694b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6944103f40 0x7f694419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:56.365 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.362+0000 7f694b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6944109090 0x7f694419ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:56.365 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.362+0000 7f694b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f694419eff0 0x7f694419f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:56.365 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.362+0000 7f694b400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6944114100 con 0x7f6944109090 2024-09-19T06:15:56.365 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.362+0000 7f694b400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6944113f80 con 0x7f694419eff0 2024-09-19T06:15:56.365 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.362+0000 7f694b400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6944114280 con 0x7f6944103f40 2024-09-19T06:15:56.365 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.362+0000 7f6943e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6944109090 0x7f694419ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:56.365 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.362+0000 7f6943e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6944109090 0x7f694419ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54192/0 (socket says 172.21.15.3:54192) 2024-09-19T06:15:56.365 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.362+0000 7f6948a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6944103f40 0x7f694419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:56.365 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.362+0000 7f6943e00640 1 -- 172.21.15.3:0/3236053183 learned_addr learned my addr 172.21.15.3:0/3236053183 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.362+0000 7f6949400640 1 --2- 172.21.15.3:0/3236053183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f694419eff0 0x7f694419f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.363+0000 7f6948a00640 1 -- 172.21.15.3:0/3236053183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f694419eff0 msgr2=0x7f694419f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.363+0000 7f6948a00640 1 --2- 172.21.15.3:0/3236053183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f694419eff0 0x7f694419f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.363+0000 7f6948a00640 1 -- 172.21.15.3:0/3236053183 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6944109090 msgr2=0x7f694419ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.363+0000 7f6948a00640 1 --2- 172.21.15.3:0/3236053183 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6944109090 0x7f694419ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.363+0000 7f6948a00640 1 -- 172.21.15.3:0/3236053183 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f694419fae0 con 0x7f6944103f40 2024-09-19T06:15:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.363+0000 7f6943e00640 1 --2- 172.21.15.3:0/3236053183 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6944109090 0x7f694419ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.363+0000 7f6949400640 1 --2- 172.21.15.3:0/3236053183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f694419eff0 0x7f694419f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.363+0000 7f6948a00640 1 --2- 172.21.15.3:0/3236053183 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6944103f40 0x7f694419a730 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f693802a930 tx=0x7f6938003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.363+0000 7f6941600640 1 -- 172.21.15.3:0/3236053183 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693803f070 con 0x7f6944103f40 2024-09-19T06:15:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.363+0000 7f694b400640 1 -- 172.21.15.3:0/3236053183 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f694419fd70 con 0x7f6944103f40 2024-09-19T06:15:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.363+0000 7f6941600640 1 -- 172.21.15.3:0/3236053183 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6938031c90 con 0x7f6944103f40 2024-09-19T06:15:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.363+0000 7f6941600640 1 -- 172.21.15.3:0/3236053183 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938035030 con 0x7f6944103f40 2024-09-19T06:15:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.363+0000 7f694b400640 1 -- 172.21.15.3:0/3236053183 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69441a7540 con 0x7f6944103f40 2024-09-19T06:15:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.366+0000 7f694e24d740 1 Processor -- start 2024-09-19T06:15:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.366+0000 7f694e24d740 1 -- start start 2024-09-19T06:15:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.366+0000 7f694e24d740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb4e1e0 0x55d48cb4e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.367+0000 7f694e24d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d48cb4eb00 0x55d48cb58e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.367+0000 7f694e24d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d48cb593a0 0x55d48cb5b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.367+0000 7f694e24d740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d48cab4100 con 0x55d48cb4e1e0 2024-09-19T06:15:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.367+0000 7f694e24d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d48ca5c1b0 con 0x55d48cb593a0 2024-09-19T06:15:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.367+0000 7f694e24d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d48cab00c0 con 0x55d48cb4eb00 2024-09-19T06:15:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.367+0000 7f6941600640 1 -- 172.21.15.3:0/3236053183 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f6938042070 con 0x7f6944103f40 2024-09-19T06:15:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.367+0000 7f6949400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb4e1e0 0x55d48cb4e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.367+0000 7f6949400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb4e1e0 0x55d48cb4e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54208/0 (socket says 172.21.15.3:54208) 2024-09-19T06:15:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.367+0000 7f6949400640 1 -- 172.21.15.3:0/2537704606 learned_addr learned my addr 172.21.15.3:0/2537704606 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.367+0000 7f6943e00640 1 --2- 172.21.15.3:0/2537704606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d48cb593a0 0x55d48cb5b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.367+0000 7f6949400640 1 -- 172.21.15.3:0/2537704606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d48cb4eb00 msgr2=0x55d48cb58e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.367+0000 7f6949400640 1 --2- 172.21.15.3:0/2537704606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d48cb4eb00 0x55d48cb58e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.371 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.367+0000 7f6949400640 1 -- 172.21.15.3:0/2537704606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d48cb593a0 msgr2=0x55d48cb5b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:56.371 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.367+0000 7f6949400640 1 --2- 172.21.15.3:0/2537704606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d48cb593a0 0x55d48cb5b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.371 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.367+0000 7f6949400640 1 -- 172.21.15.3:0/2537704606 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d48c7c7210 con 0x55d48cb4e1e0 2024-09-19T06:15:56.371 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.368+0000 7f6949400640 1 --2- 172.21.15.3:0/2537704606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb4e1e0 0x55d48cb4e5c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f693c0107a0 tx=0x7f693c010c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe140756b18f7ae8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:56.371 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.368+0000 7f6935c00640 1 -- 172.21.15.3:0/2537704606 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c003b70 con 0x55d48cb4e1e0 2024-09-19T06:15:56.371 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.368+0000 7f6935c00640 1 -- 172.21.15.3:0/2537704606 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f693c010e50 con 0x55d48cb4e1e0 2024-09-19T06:15:56.371 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.368+0000 7f6935c00640 1 -- 172.21.15.3:0/2537704606 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f693c0046d0 con 0x55d48cb4e1e0 2024-09-19T06:15:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.369+0000 7f694e24d740 1 -- 172.21.15.3:0/2537704606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb4e1e0 msgr2=0x55d48cb4e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.369+0000 7f694e24d740 1 --2- 172.21.15.3:0/2537704606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb4e1e0 0x55d48cb4e5c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f693c0107a0 tx=0x7f693c010c60 comp rx=0 tx=0).stop 2024-09-19T06:15:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.369+0000 7f694e24d740 1 -- 172.21.15.3:0/2537704606 shutdown_connections 2024-09-19T06:15:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.369+0000 7f694e24d740 1 --2- 172.21.15.3:0/2537704606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d48cb593a0 0x55d48cb5b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.369+0000 7f694e24d740 1 --2- 172.21.15.3:0/2537704606 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d48cb4eb00 0x55d48cb58e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.369+0000 7f694e24d740 1 --2- 172.21.15.3:0/2537704606 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb4e1e0 0x55d48cb4e5c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.369+0000 7f694e24d740 1 -- 172.21.15.3:0/2537704606 >> 172.21.15.3:0/2537704606 conn(0x55d48cb4a750 msgr2=0x55d48cb4ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.369+0000 7f694e24d740 1 -- 172.21.15.3:0/2537704606 shutdown_connections 2024-09-19T06:15:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.369+0000 7f6941600640 1 --2- 172.21.15.3:0/3236053183 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f692c0a32c0 0x7f692c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.369+0000 7f694e24d740 1 -- 172.21.15.3:0/2537704606 wait complete. 2024-09-19T06:15:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.369+0000 7f6941600640 1 -- 172.21.15.3:0/3236053183 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f69380f0390 con 0x7f6944103f40 2024-09-19T06:15:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.369+0000 7f6943e00640 1 --2- 172.21.15.3:0/3236053183 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f692c0a32c0 0x7f692c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.369+0000 7f694e24d740 1 -- start start 2024-09-19T06:15:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.370+0000 7f694e24d740 1 Processor -- start 2024-09-19T06:15:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.370+0000 7f6943e00640 1 --2- 172.21.15.3:0/3236053183 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f692c0a32c0 0x7f692c0a5780 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55d48cb4bad0 tx=0x7f6930005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.370+0000 7f694e24d740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb4e1e0 0x55d48cb56320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.370+0000 7f694e24d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d48cb4eb00 0x55d48cb56860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.370+0000 7f694e24d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d48cb593a0 0x55d48cb56da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.370+0000 7f694e24d740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d48cb5bfc0 con 0x55d48cb4e1e0 2024-09-19T06:15:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.370+0000 7f694e24d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d48ca3d090 con 0x55d48cb4eb00 2024-09-19T06:15:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.370+0000 7f694e24d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d48cb5c140 con 0x55d48cb593a0 2024-09-19T06:15:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.370+0000 7f694e24d740 10 client.0 _ll_register_callbacks cb 0x55d48ca91f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.370+0000 7f6948a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb4e1e0 0x55d48cb56320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.370+0000 7f6943e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d48cb4eb00 0x55d48cb56860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.370+0000 7f6949400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d48cb593a0 0x55d48cb56da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.370+0000 7f6948a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb4e1e0 0x55d48cb56320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54222/0 (socket says 172.21.15.3:54222) 2024-09-19T06:15:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.370+0000 7f6948a00640 1 -- 172.21.15.3:0/4135390832 learned_addr learned my addr 172.21.15.3:0/4135390832 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.371+0000 7f6948a00640 1 -- 172.21.15.3:0/4135390832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d48cb593a0 msgr2=0x55d48cb56da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.371+0000 7f6948a00640 1 --2- 172.21.15.3:0/4135390832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d48cb593a0 0x55d48cb56da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.371+0000 7f6948a00640 1 -- 172.21.15.3:0/4135390832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d48cb4eb00 msgr2=0x55d48cb56860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.371+0000 7f6948a00640 1 --2- 172.21.15.3:0/4135390832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d48cb4eb00 0x55d48cb56860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.371+0000 7f6948a00640 1 -- 172.21.15.3:0/4135390832 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d48c893620 con 0x55d48cb4e1e0 2024-09-19T06:15:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.371+0000 7f6948a00640 1 --2- 172.21.15.3:0/4135390832 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb4e1e0 0x55d48cb56320 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6938004650 tx=0x7f6938003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd72082d3d28c73b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.371+0000 7f692a000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:15:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.371+0000 7f692a000640 1 -- 172.21.15.3:0/4135390832 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938049040 con 0x55d48cb4e1e0 2024-09-19T06:15:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.371+0000 7f692a000640 1 -- 172.21.15.3:0/4135390832 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f69380b8d30 con 0x55d48cb4e1e0 2024-09-19T06:15:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.371+0000 7f694e24d740 1 -- 172.21.15.3:0/4135390832 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f693c010e50 con 0x55d48cb4e1e0 2024-09-19T06:15:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.372+0000 7f692a000640 1 -- 172.21.15.3:0/4135390832 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f69380bc6c0 con 0x55d48cb4e1e0 2024-09-19T06:15:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.372+0000 7f694e24d740 10 client.16149 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.372+0000 7f694e24d740 1 -- 172.21.15.3:0/4135390832 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d48cb67bf0 con 0x55d48cb4e1e0 2024-09-19T06:15:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.372+0000 7f692a000640 1 -- 172.21.15.3:0/4135390832 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f693c010e50 con 0x55d48cb4e1e0 2024-09-19T06:15:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.372+0000 7f692a000640 1 -- 172.21.15.3:0/4135390832 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f69380bc920 con 0x55d48cb4e1e0 2024-09-19T06:15:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.372+0000 7f694e24d740 10 client.16149 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.372+0000 7f694e24d740 10 client.16149 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.372+0000 7f694e24d740 20 client.16149 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.372+0000 7f694e24d740 1 --2- 172.21.15.3:0/4135390832 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55d48cb68f40 0x55d48cb6b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.372+0000 7f694e24d740 4 client.16149 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.372+0000 7f694e24d740 1 -- 172.21.15.3:0/4135390832 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d48cac1830 con 0x55d48cb68f40 2024-09-19T06:15:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.373+0000 7f6943e00640 1 --2- 172.21.15.3:0/4135390832 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55d48cb68f40 0x55d48cb6b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.373+0000 7f6943e00640 1 --2- 172.21.15.3:0/4135390832 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55d48cb68f40 0x55d48cb6b370 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8fe965640888374 server_cookie=4c87bb879437364 in_seq=0 out_seq=0 2024-09-19T06:15:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.373+0000 7f692a000640 10 client.16149 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.374+0000 7f692a000640 1 -- 172.21.15.3:0/4135390832 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d48cac1830 con 0x55d48cb68f40 2024-09-19T06:15:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.374+0000 7f692a000640 10 client.16149 handle_command_reply: tid=0 2024-09-19T06:15:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.374+0000 7f694e24d740 1 client.16149 shutdown 2024-09-19T06:15:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.374+0000 7f694e24d740 1 -- 172.21.15.3:0/4135390832 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb4e1e0 msgr2=0x55d48cb56320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.374+0000 7f694e24d740 1 --2- 172.21.15.3:0/4135390832 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb4e1e0 0x55d48cb56320 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6938004650 tx=0x7f6938003f90 comp rx=0 tx=0).stop 2024-09-19T06:15:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.374+0000 7f694e24d740 1 -- 172.21.15.3:0/4135390832 shutdown_connections 2024-09-19T06:15:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.374+0000 7f694e24d740 1 --2- 172.21.15.3:0/4135390832 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55d48cb68f40 0x55d48cb6b370 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.374+0000 7f694e24d740 1 --2- 172.21.15.3:0/4135390832 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d48cb593a0 0x55d48cb56da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.374+0000 7f694e24d740 1 --2- 172.21.15.3:0/4135390832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d48cb4eb00 0x55d48cb56860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.374+0000 7f694e24d740 1 --2- 172.21.15.3:0/4135390832 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb4e1e0 0x55d48cb56320 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.374+0000 7f692a000640 0 client.16149 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.374+0000 7f694e24d740 1 -- 172.21.15.3:0/4135390832 >> 172.21.15.3:0/4135390832 conn(0x55d48cb4a750 msgr2=0x55d48cb50460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.375+0000 7f694e24d740 1 -- 172.21.15.3:0/4135390832 shutdown_connections 2024-09-19T06:15:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.375+0000 7f694e24d740 1 -- 172.21.15.3:0/4135390832 wait complete. 2024-09-19T06:15:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.375+0000 7f694e24d740 20 client.16149 trim_cache size 0 max 16384 2024-09-19T06:15:56.401 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.390+0000 7f694e24d740 1 Processor -- start 2024-09-19T06:15:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.390+0000 7f694e24d740 1 -- start start 2024-09-19T06:15:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.390+0000 7f694e24d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d48cb4e1e0 0x55d48cb58180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.390+0000 7f694e24d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d48cb4eb00 0x55d48cb70c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.391+0000 7f694e24d740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb593a0 0x55d48cb71190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.391+0000 7f694e24d740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f69441afaf0 con 0x55d48cb593a0 2024-09-19T06:15:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.391+0000 7f694e24d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f69441b1630 con 0x55d48cb4e1e0 2024-09-19T06:15:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.391+0000 7f694e24d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f69441b01c0 con 0x55d48cb4eb00 2024-09-19T06:15:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.391+0000 7f6948a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d48cb4e1e0 0x55d48cb58180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.391+0000 7f6949400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb593a0 0x55d48cb71190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.391+0000 7f6948a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d48cb4e1e0 0x55d48cb58180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:51270/0 (socket says 172.21.15.3:51270) 2024-09-19T06:15:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.391+0000 7f6948a00640 1 -- 172.21.15.3:0/3611351726 learned_addr learned my addr 172.21.15.3:0/3611351726 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.391+0000 7f6943e00640 1 --2- 172.21.15.3:0/3611351726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d48cb4eb00 0x55d48cb70c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.391+0000 7f6948a00640 1 -- 172.21.15.3:0/3611351726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d48cb4eb00 msgr2=0x55d48cb70c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.391+0000 7f6948a00640 1 --2- 172.21.15.3:0/3611351726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d48cb4eb00 0x55d48cb70c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.391+0000 7f6948a00640 1 -- 172.21.15.3:0/3611351726 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb593a0 msgr2=0x55d48cb71190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.391+0000 7f6948a00640 1 --2- 172.21.15.3:0/3611351726 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb593a0 0x55d48cb71190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.391+0000 7f6948a00640 1 -- 172.21.15.3:0/3611351726 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d48cb4e930 con 0x55d48cb4e1e0 2024-09-19T06:15:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.391+0000 7f6948a00640 1 --2- 172.21.15.3:0/3611351726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d48cb4e1e0 0x55d48cb58180 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6938000c00 tx=0x7f6938005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b238ed55a5ea1f37 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.392+0000 7f6935200640 1 -- 172.21.15.3:0/3611351726 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938049070 con 0x55d48cb4e1e0 2024-09-19T06:15:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.392+0000 7f6935200640 1 -- 172.21.15.3:0/3611351726 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69380c5280 con 0x55d48cb4e1e0 2024-09-19T06:15:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.392+0000 7f6935200640 1 -- 172.21.15.3:0/3611351726 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69380d0b30 con 0x55d48cb4e1e0 2024-09-19T06:15:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.392+0000 7f694e24d740 1 -- 172.21.15.3:0/3611351726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d48cb4e1e0 msgr2=0x55d48cb58180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.392+0000 7f694e24d740 1 --2- 172.21.15.3:0/3611351726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d48cb4e1e0 0x55d48cb58180 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6938000c00 tx=0x7f6938005dc0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.392+0000 7f694e24d740 1 -- 172.21.15.3:0/3611351726 shutdown_connections 2024-09-19T06:15:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.392+0000 7f694e24d740 1 --2- 172.21.15.3:0/3611351726 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb593a0 0x55d48cb71190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.392+0000 7f694e24d740 1 --2- 172.21.15.3:0/3611351726 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d48cb4eb00 0x55d48cb70c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.392+0000 7f694e24d740 1 --2- 172.21.15.3:0/3611351726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d48cb4e1e0 0x55d48cb58180 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.392+0000 7f694e24d740 1 -- 172.21.15.3:0/3611351726 >> 172.21.15.3:0/3611351726 conn(0x55d48cb4a750 msgr2=0x55d48cb57a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.392+0000 7f694e24d740 1 -- 172.21.15.3:0/3611351726 shutdown_connections 2024-09-19T06:15:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.392+0000 7f694e24d740 1 -- 172.21.15.3:0/3611351726 wait complete. 2024-09-19T06:15:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.393+0000 7f694e24d740 1 -- start start 2024-09-19T06:15:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.393+0000 7f694e24d740 1 Processor -- start 2024-09-19T06:15:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.393+0000 7f694e24d740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb4e1e0 0x55d48cb616c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.393+0000 7f694e24d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d48cb4eb00 0x55d48cb61c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.393+0000 7f694e24d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d48cb593a0 0x55d48cb52df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.393+0000 7f694e24d740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f69441b0f60 con 0x55d48cb4e1e0 2024-09-19T06:15:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.393+0000 7f694e24d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f69441b0890 con 0x55d48cb4eb00 2024-09-19T06:15:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.393+0000 7f694e24d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f69441adad0 con 0x55d48cb593a0 2024-09-19T06:15:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.394+0000 7f694e24d740 10 client.0 _ll_register_callbacks cb 0x7f69380b8240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.394+0000 7f6948a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb4e1e0 0x55d48cb616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.394+0000 7f6943e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d48cb4eb00 0x55d48cb61c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.394+0000 7f6948a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb4e1e0 0x55d48cb616c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54242/0 (socket says 172.21.15.3:54242) 2024-09-19T06:15:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.394+0000 7f6948a00640 1 -- 172.21.15.3:0/3090179105 learned_addr learned my addr 172.21.15.3:0/3090179105 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.394+0000 7f6949400640 1 --2- 172.21.15.3:0/3090179105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d48cb593a0 0x55d48cb52df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.394+0000 7f6948a00640 1 -- 172.21.15.3:0/3090179105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d48cb593a0 msgr2=0x55d48cb52df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.394+0000 7f6948a00640 1 --2- 172.21.15.3:0/3090179105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d48cb593a0 0x55d48cb52df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.394+0000 7f6948a00640 1 -- 172.21.15.3:0/3090179105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d48cb4eb00 msgr2=0x55d48cb61c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.394+0000 7f6948a00640 1 --2- 172.21.15.3:0/3090179105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d48cb4eb00 0x55d48cb61c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.394+0000 7f6948a00640 1 -- 172.21.15.3:0/3090179105 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d48cb53620 con 0x55d48cb4e1e0 2024-09-19T06:15:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.394+0000 7f6943e00640 1 --2- 172.21.15.3:0/3090179105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d48cb4eb00 0x55d48cb61c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.394+0000 7f6948a00640 1 --2- 172.21.15.3:0/3090179105 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb4e1e0 0x55d48cb616c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f69380c4d50 tx=0x7f6938005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b6a42110c910fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.394+0000 7f692a000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:15:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.395+0000 7f692a000640 1 -- 172.21.15.3:0/3090179105 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69380a3060 con 0x55d48cb4e1e0 2024-09-19T06:15:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.395+0000 7f692a000640 1 -- 172.21.15.3:0/3090179105 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f69380d0b30 con 0x55d48cb4e1e0 2024-09-19T06:15:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.395+0000 7f694e24d740 1 -- 172.21.15.3:0/3090179105 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69380c5280 con 0x55d48cb4e1e0 2024-09-19T06:15:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.395+0000 7f692a000640 1 -- 172.21.15.3:0/3090179105 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6938049040 con 0x55d48cb4e1e0 2024-09-19T06:15:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.395+0000 7f694e24d740 10 client.16155 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.395+0000 7f694e24d740 1 -- 172.21.15.3:0/3090179105 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d48cb53620 con 0x55d48cb4e1e0 2024-09-19T06:15:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.395+0000 7f692a000640 1 -- 172.21.15.3:0/3090179105 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69380c5280 con 0x55d48cb4e1e0 2024-09-19T06:15:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.395+0000 7f692a000640 1 -- 172.21.15.3:0/3090179105 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f693809d070 con 0x55d48cb4e1e0 2024-09-19T06:15:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.395+0000 7f694e24d740 10 client.16155 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.395+0000 7f694e24d740 10 client.16155 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:15:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.395+0000 7f694e24d740 20 client.16155 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.395+0000 7f694e24d740 1 --2- 172.21.15.3:0/3090179105 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55d48cbd3a90 0x55d48cbd5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.395+0000 7f694e24d740 4 client.16155 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:15:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.395+0000 7f694e24d740 1 -- 172.21.15.3:0/3090179105 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d48cabbb80 con 0x55d48cbd3a90 2024-09-19T06:15:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.396+0000 7f6943e00640 1 --2- 172.21.15.3:0/3090179105 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55d48cbd3a90 0x55d48cbd5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.396+0000 7f6943e00640 1 --2- 172.21.15.3:0/3090179105 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55d48cbd3a90 0x55d48cbd5e80 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a78f20b4ad1e8abd server_cookie=d5ed65ab51a99200 in_seq=0 out_seq=0 2024-09-19T06:15:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.396+0000 7f692a000640 10 client.16155 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.411+0000 7f692a000640 1 -- 172.21.15.3:0/3090179105 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d48cabbb80 con 0x55d48cbd3a90 2024-09-19T06:15:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.411+0000 7f692a000640 10 client.16155 handle_command_reply: tid=0 2024-09-19T06:15:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.411+0000 7f694e24d740 1 client.16155 shutdown 2024-09-19T06:15:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.412+0000 7f694e24d740 1 -- 172.21.15.3:0/3090179105 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb4e1e0 msgr2=0x55d48cb616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.412+0000 7f694e24d740 1 --2- 172.21.15.3:0/3090179105 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb4e1e0 0x55d48cb616c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f69380c4d50 tx=0x7f6938005bd0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.412+0000 7f694e24d740 1 -- 172.21.15.3:0/3090179105 shutdown_connections 2024-09-19T06:15:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.412+0000 7f694e24d740 1 --2- 172.21.15.3:0/3090179105 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55d48cbd3a90 0x55d48cbd5e80 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.414 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.412+0000 7f694e24d740 1 --2- 172.21.15.3:0/3090179105 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d48cb593a0 0x55d48cb52df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.412+0000 7f694e24d740 1 --2- 172.21.15.3:0/3090179105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d48cb4eb00 0x55d48cb61c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.412+0000 7f694e24d740 1 --2- 172.21.15.3:0/3090179105 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d48cb4e1e0 0x55d48cb616c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.412+0000 7f692a000640 0 client.16155 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:15:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.412+0000 7f694e24d740 1 -- 172.21.15.3:0/3090179105 >> 172.21.15.3:0/3090179105 conn(0x55d48cb4a750 msgr2=0x55d48cb547a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.412+0000 7f694e24d740 1 -- 172.21.15.3:0/3090179105 shutdown_connections 2024-09-19T06:15:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.412+0000 7f694e24d740 1 -- 172.21.15.3:0/3090179105 wait complete. 2024-09-19T06:15:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.412+0000 7f694e24d740 20 client.16155 trim_cache size 0 max 16384 2024-09-19T06:15:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:15:56.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:15:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:15:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:15:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.413+0000 7f694b400640 1 -- 172.21.15.3:0/3236053183 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f692c0a32c0 msgr2=0x7f692c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.413+0000 7f694b400640 1 --2- 172.21.15.3:0/3236053183 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f692c0a32c0 0x7f692c0a5780 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55d48cb4bad0 tx=0x7f6930005f90 comp rx=0 tx=0).stop 2024-09-19T06:15:56.416 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.413+0000 7f694b400640 1 -- 172.21.15.3:0/3236053183 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6944103f40 msgr2=0x7f694419a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.413+0000 7f694b400640 1 --2- 172.21.15.3:0/3236053183 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6944103f40 0x7f694419a730 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f693802a930 tx=0x7f6938003b90 comp rx=0 tx=0).stop 2024-09-19T06:15:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.413+0000 7f694b400640 1 -- 172.21.15.3:0/3236053183 shutdown_connections 2024-09-19T06:15:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.413+0000 7f694b400640 1 --2- 172.21.15.3:0/3236053183 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f692c0a32c0 0x7f692c0a5780 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.413+0000 7f694b400640 1 --2- 172.21.15.3:0/3236053183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f694419eff0 0x7f694419f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.413+0000 7f694b400640 1 --2- 172.21.15.3:0/3236053183 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6944109090 0x7f694419ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.413+0000 7f694b400640 1 --2- 172.21.15.3:0/3236053183 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6944103f40 0x7f694419a730 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.413+0000 7f694b400640 1 -- 172.21.15.3:0/3236053183 >> 172.21.15.3:0/3236053183 conn(0x7f69440ff970 msgr2=0x7f6944100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.413+0000 7f694b400640 1 -- 172.21.15.3:0/3236053183 shutdown_connections 2024-09-19T06:15:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:15:56.413+0000 7f694b400640 1 -- 172.21.15.3:0/3236053183 wait complete. 2024-09-19T06:15:56.526 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:15:56.527 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:15:56.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:56 smithi059 ceph-mon[35138]: pgmap v109: 97 pgs: 97 active+clean; 4.2 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 22 op/s 2024-09-19T06:15:56.946 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:15:57.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.565+0000 7f6386400640 1 -- 172.21.15.3:0/2217385123 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6380103ff0 msgr2=0x7f63801043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:57.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.565+0000 7f6386400640 1 --2- 172.21.15.3:0/2217385123 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6380103ff0 0x7f63801043d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6370009900 tx=0x7f637002a3f0 comp rx=0 tx=0).stop 2024-09-19T06:15:57.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.566+0000 7f6386400640 1 -- 172.21.15.3:0/2217385123 shutdown_connections 2024-09-19T06:15:57.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.566+0000 7f6386400640 1 --2- 172.21.15.3:0/2217385123 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6380109120 0x7f6380110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:57.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.566+0000 7f6386400640 1 --2- 172.21.15.3:0/2217385123 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63801049a0 0x7f63801089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:57.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.566+0000 7f6386400640 1 --2- 172.21.15.3:0/2217385123 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6380103ff0 0x7f63801043d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:57.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.566+0000 7f6386400640 1 -- 172.21.15.3:0/2217385123 >> 172.21.15.3:0/2217385123 conn(0x7f63800ffa90 msgr2=0x7f6380101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:57.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.566+0000 7f6386400640 1 -- 172.21.15.3:0/2217385123 shutdown_connections 2024-09-19T06:15:57.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.566+0000 7f6386400640 1 -- 172.21.15.3:0/2217385123 wait complete. 2024-09-19T06:15:57.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.567+0000 7f6386400640 1 Processor -- start 2024-09-19T06:15:57.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.567+0000 7f6386400640 1 -- start start 2024-09-19T06:15:57.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.567+0000 7f6386400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6380103ff0 0x7f638019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:57.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.567+0000 7f6386400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63801049a0 0x7f638019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:57.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.567+0000 7f6386400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6380109120 0x7f638019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:57.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.567+0000 7f6386400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6380114170 con 0x7f6380103ff0 2024-09-19T06:15:57.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.567+0000 7f6386400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6380113ff0 con 0x7f6380109120 2024-09-19T06:15:57.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.567+0000 7f6386400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f63801142f0 con 0x7f63801049a0 2024-09-19T06:15:57.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.568+0000 7f637f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6380103ff0 0x7f638019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:57.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.568+0000 7f637f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6380103ff0 0x7f638019a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54262/0 (socket says 172.21.15.3:54262) 2024-09-19T06:15:57.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.568+0000 7f637fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6380109120 0x7f638019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:57.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.568+0000 7f637f400640 1 -- 172.21.15.3:0/1682935141 learned_addr learned my addr 172.21.15.3:0/1682935141 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:57.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.568+0000 7f637ea00640 1 --2- 172.21.15.3:0/1682935141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63801049a0 0x7f638019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:57.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.568+0000 7f637fe00640 1 -- 172.21.15.3:0/1682935141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63801049a0 msgr2=0x7f638019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:57.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.568+0000 7f637fe00640 1 --2- 172.21.15.3:0/1682935141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63801049a0 0x7f638019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:57.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.568+0000 7f637fe00640 1 -- 172.21.15.3:0/1682935141 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6380103ff0 msgr2=0x7f638019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:57.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.568+0000 7f637fe00640 1 --2- 172.21.15.3:0/1682935141 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6380103ff0 0x7f638019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:57.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.568+0000 7f637fe00640 1 -- 172.21.15.3:0/1682935141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f638019f620 con 0x7f6380109120 2024-09-19T06:15:57.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.569+0000 7f637fe00640 1 --2- 172.21.15.3:0/1682935141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6380109120 0x7f638019ef40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f637800e940 tx=0x7f637800ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:57.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.569+0000 7f6377e00640 1 -- 172.21.15.3:0/1682935141 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6378004d20 con 0x7f6380109120 2024-09-19T06:15:57.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.569+0000 7f6377e00640 1 -- 172.21.15.3:0/1682935141 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6378005020 con 0x7f6380109120 2024-09-19T06:15:57.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.569+0000 7f6386400640 1 -- 172.21.15.3:0/1682935141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f638019f910 con 0x7f6380109120 2024-09-19T06:15:57.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.569+0000 7f6377e00640 1 -- 172.21.15.3:0/1682935141 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63780116b0 con 0x7f6380109120 2024-09-19T06:15:57.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.569+0000 7f6386400640 1 -- 172.21.15.3:0/1682935141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63801a71f0 con 0x7f6380109120 2024-09-19T06:15:57.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.570+0000 7f6386400640 1 -- 172.21.15.3:0/1682935141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63801043d0 con 0x7f6380109120 2024-09-19T06:15:57.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.573+0000 7f6377e00640 1 -- 172.21.15.3:0/1682935141 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f63780054d0 con 0x7f6380109120 2024-09-19T06:15:57.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.574+0000 7f6377e00640 1 --2- 172.21.15.3:0/1682935141 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f63640a3430 0x7f63640a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:57.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.574+0000 7f6377e00640 1 -- 172.21.15.3:0/1682935141 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f63780d00e0 con 0x7f6380109120 2024-09-19T06:15:57.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.574+0000 7f637f400640 1 --2- 172.21.15.3:0/1682935141 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f63640a3430 0x7f63640a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:57.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.575+0000 7f637f400640 1 --2- 172.21.15.3:0/1682935141 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f63640a3430 0x7f63640a58f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f63700096c0 tx=0x7f63700046c0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:57.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.576+0000 7f6377e00640 1 -- 172.21.15.3:0/1682935141 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6378016030 con 0x7f6380109120 2024-09-19T06:15:57.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.801+0000 7f6386400640 1 -- 172.21.15.3:0/1682935141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f638010c360 con 0x7f6380109120 2024-09-19T06:15:57.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.802+0000 7f6377e00640 1 -- 172.21.15.3:0/1682935141 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7f637809c490 con 0x7f6380109120 2024-09-19T06:15:57.804 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:15:57.804 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"btime":"2024-09-19T06:12:22:958217+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:12:22.060987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24532,24515,24514,14517]},"id":1}]} 2024-09-19T06:15:57.805 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2024-09-19T06:15:57.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.806+0000 7f6386400640 1 -- 172.21.15.3:0/1682935141 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f63640a3430 msgr2=0x7f63640a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:57.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.806+0000 7f6386400640 1 --2- 172.21.15.3:0/1682935141 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f63640a3430 0x7f63640a58f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f63700096c0 tx=0x7f63700046c0 comp rx=0 tx=0).stop 2024-09-19T06:15:57.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.806+0000 7f6386400640 1 -- 172.21.15.3:0/1682935141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6380109120 msgr2=0x7f638019ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:57.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.806+0000 7f6386400640 1 --2- 172.21.15.3:0/1682935141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6380109120 0x7f638019ef40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f637800e940 tx=0x7f637800ee00 comp rx=0 tx=0).stop 2024-09-19T06:15:57.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.806+0000 7f6386400640 1 -- 172.21.15.3:0/1682935141 shutdown_connections 2024-09-19T06:15:57.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.806+0000 7f6386400640 1 --2- 172.21.15.3:0/1682935141 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f63640a3430 0x7f63640a58f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:57.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.806+0000 7f6386400640 1 --2- 172.21.15.3:0/1682935141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6380109120 0x7f638019ef40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:57.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.806+0000 7f6386400640 1 --2- 172.21.15.3:0/1682935141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f63801049a0 0x7f638019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:57.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.806+0000 7f6386400640 1 --2- 172.21.15.3:0/1682935141 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6380103ff0 0x7f638019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:57.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.806+0000 7f6386400640 1 -- 172.21.15.3:0/1682935141 >> 172.21.15.3:0/1682935141 conn(0x7f63800ffa90 msgr2=0x7f6380100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:57.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.806+0000 7f6386400640 1 -- 172.21.15.3:0/1682935141 shutdown_connections 2024-09-19T06:15:57.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:57.806+0000 7f6386400640 1 -- 172.21.15.3:0/1682935141 wait complete. 2024-09-19T06:15:58.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:58 smithi003 ceph-mon[30893]: pgmap v110: 97 pgs: 97 active+clean; 4.2 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-19T06:15:58.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:15:58 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1682935141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:15:58.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:58 smithi071 ceph-mon[35662]: pgmap v110: 97 pgs: 97 active+clean; 4.2 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-19T06:15:58.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:15:58 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1682935141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:15:58.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:58 smithi059 ceph-mon[35138]: pgmap v110: 97 pgs: 97 active+clean; 4.2 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-19T06:15:58.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:15:58 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1682935141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:15:58.795 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:15:59.180 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:15:59.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.759+0000 7f0613800640 1 -- 172.21.15.3:0/1790591824 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f060c10e450 msgr2=0x7f060c110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:59.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.759+0000 7f0613800640 1 --2- 172.21.15.3:0/1790591824 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f060c10e450 0x7f060c110840 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0604009ca0 tx=0x7f060402a950 comp rx=0 tx=0).stop 2024-09-19T06:15:59.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.759+0000 7f0613800640 1 -- 172.21.15.3:0/1790591824 shutdown_connections 2024-09-19T06:15:59.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.759+0000 7f0613800640 1 --2- 172.21.15.3:0/1790591824 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f060c10e450 0x7f060c110840 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.759+0000 7f0613800640 1 --2- 172.21.15.3:0/1790591824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f060c074e30 0x7f060c10df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.759+0000 7f0613800640 1 --2- 172.21.15.3:0/1790591824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f060c074510 0x7f060c0748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.759+0000 7f0613800640 1 -- 172.21.15.3:0/1790591824 >> 172.21.15.3:0/1790591824 conn(0x7f060c0fd8b0 msgr2=0x7f060c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:59.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.759+0000 7f0613800640 1 -- 172.21.15.3:0/1790591824 shutdown_connections 2024-09-19T06:15:59.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.759+0000 7f0613800640 1 -- 172.21.15.3:0/1790591824 wait complete. 2024-09-19T06:15:59.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.760+0000 7f0613800640 1 Processor -- start 2024-09-19T06:15:59.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.760+0000 7f0613800640 1 -- start start 2024-09-19T06:15:59.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.760+0000 7f0613800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f060c074510 0x7f060c19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:59.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.760+0000 7f0613800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f060c074e30 0x7f060c19ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:59.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.760+0000 7f0613800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f060c10e450 0x7f060c19efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:59.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.760+0000 7f0613800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f060c114170 con 0x7f060c074e30 2024-09-19T06:15:59.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.760+0000 7f0613800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f060c113ff0 con 0x7f060c074510 2024-09-19T06:15:59.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.760+0000 7f0613800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f060c1142f0 con 0x7f060c10e450 2024-09-19T06:15:59.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.761+0000 7f060be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f060c074e30 0x7f060c19ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:59.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.761+0000 7f0610e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f060c074510 0x7f060c19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:59.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.761+0000 7f0610e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f060c074510 0x7f060c19a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:51322/0 (socket says 172.21.15.3:51322) 2024-09-19T06:15:59.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.761+0000 7f0610e00640 1 -- 172.21.15.3:0/1726737861 learned_addr learned my addr 172.21.15.3:0/1726737861 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:59.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.761+0000 7f0611800640 1 --2- 172.21.15.3:0/1726737861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f060c10e450 0x7f060c19efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:59.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.761+0000 7f060be00640 1 -- 172.21.15.3:0/1726737861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f060c10e450 msgr2=0x7f060c19efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:59.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.761+0000 7f060be00640 1 --2- 172.21.15.3:0/1726737861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f060c10e450 0x7f060c19efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.761+0000 7f060be00640 1 -- 172.21.15.3:0/1726737861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f060c074510 msgr2=0x7f060c19a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:59.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.761+0000 7f060be00640 1 --2- 172.21.15.3:0/1726737861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f060c074510 0x7f060c19a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.761+0000 7f060be00640 1 -- 172.21.15.3:0/1726737861 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f060c19f680 con 0x7f060c074e30 2024-09-19T06:15:59.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.762+0000 7f060be00640 1 --2- 172.21.15.3:0/1726737861 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f060c074e30 0x7f060c19ac10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f05f800e9f0 tx=0x7f05f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:59.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.762+0000 7f0609600640 1 -- 172.21.15.3:0/1726737861 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f800ccc0 con 0x7f060c074e30 2024-09-19T06:15:59.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.762+0000 7f0609600640 1 -- 172.21.15.3:0/1726737861 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05f8010910 con 0x7f060c074e30 2024-09-19T06:15:59.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.762+0000 7f0613800640 1 -- 172.21.15.3:0/1726737861 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f060c19f970 con 0x7f060c074e30 2024-09-19T06:15:59.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.762+0000 7f0609600640 1 -- 172.21.15.3:0/1726737861 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f8018960 con 0x7f060c074e30 2024-09-19T06:15:59.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.762+0000 7f0613800640 1 -- 172.21.15.3:0/1726737861 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f060c1a7250 con 0x7f060c074e30 2024-09-19T06:15:59.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.765+0000 7f0616478740 1 Processor -- start 2024-09-19T06:15:59.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.765+0000 7f0609600640 1 -- 172.21.15.3:0/1726737861 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f05f8010ac0 con 0x7f060c074e30 2024-09-19T06:15:59.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.765+0000 7f0616478740 1 -- start start 2024-09-19T06:15:59.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.766+0000 7f0616478740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7efec70 0x5576d7eff050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:59.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.766+0000 7f0616478740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7eff590 0x5576d7f09910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:59.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.766+0000 7f0616478740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7f09e50 0x5576d7f0c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:59.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.766+0000 7f0616478740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5576d7e653e0 con 0x5576d7eff590 2024-09-19T06:15:59.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.766+0000 7f0616478740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5576d7e0cd80 con 0x5576d7f09e50 2024-09-19T06:15:59.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.766+0000 7f0616478740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5576d7e613a0 con 0x5576d7efec70 2024-09-19T06:15:59.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.766+0000 7f0610e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7eff590 0x5576d7f09910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:59.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.766+0000 7f0610e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7eff590 0x5576d7f09910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54290/0 (socket says 172.21.15.3:54290) 2024-09-19T06:15:59.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.766+0000 7f0610e00640 1 -- 172.21.15.3:0/695346761 learned_addr learned my addr 172.21.15.3:0/695346761 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:59.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.766+0000 7f0611800640 1 --2- 172.21.15.3:0/695346761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7efec70 0x5576d7eff050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:59.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.766+0000 7f060be00640 1 --2- 172.21.15.3:0/695346761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7f09e50 0x5576d7f0c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:59.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.766+0000 7f0611800640 1 -- 172.21.15.3:0/695346761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7f09e50 msgr2=0x5576d7f0c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:59.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.766+0000 7f0611800640 1 --2- 172.21.15.3:0/695346761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7f09e50 0x5576d7f0c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.766+0000 7f0611800640 1 -- 172.21.15.3:0/695346761 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7eff590 msgr2=0x5576d7f09910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:59.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.766+0000 7f0611800640 1 --2- 172.21.15.3:0/695346761 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7eff590 0x5576d7f09910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.766+0000 7f0611800640 1 -- 172.21.15.3:0/695346761 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576d7e2bae0 con 0x5576d7efec70 2024-09-19T06:15:59.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.766+0000 7f060be00640 1 --2- 172.21.15.3:0/695346761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7f09e50 0x5576d7f0c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:59.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.766+0000 7f0610e00640 1 --2- 172.21.15.3:0/695346761 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7eff590 0x5576d7f09910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:59.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.767+0000 7f0611800640 1 --2- 172.21.15.3:0/695346761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7efec70 0x5576d7eff050 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f060402ae70 tx=0x7f06040093e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24ad14f1abc04b3a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:59.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.767+0000 7f05fe000640 1 -- 172.21.15.3:0/695346761 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0604048070 con 0x5576d7efec70 2024-09-19T06:15:59.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.767+0000 7f05fe000640 1 -- 172.21.15.3:0/695346761 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f060402f940 con 0x5576d7efec70 2024-09-19T06:15:59.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.767+0000 7f0609600640 1 --2- 172.21.15.3:0/1726737861 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f05f40a33b0 0x7f05f40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:59.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.767+0000 7f05fe000640 1 -- 172.21.15.3:0/695346761 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0604034040 con 0x5576d7efec70 2024-09-19T06:15:59.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.767+0000 7f0609600640 1 -- 172.21.15.3:0/1726737861 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f05f80d00a0 con 0x7f060c074e30 2024-09-19T06:15:59.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.767+0000 7f0610e00640 1 --2- 172.21.15.3:0/1726737861 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f05f40a33b0 0x7f05f40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:59.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.768+0000 7f0616478740 1 -- 172.21.15.3:0/695346761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7efec70 msgr2=0x5576d7eff050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:59.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.768+0000 7f0616478740 1 --2- 172.21.15.3:0/695346761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7efec70 0x5576d7eff050 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f060402ae70 tx=0x7f06040093e0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.768+0000 7f0616478740 1 -- 172.21.15.3:0/695346761 shutdown_connections 2024-09-19T06:15:59.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.768+0000 7f0616478740 1 --2- 172.21.15.3:0/695346761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7f09e50 0x5576d7f0c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.768+0000 7f0616478740 1 --2- 172.21.15.3:0/695346761 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7eff590 0x5576d7f09910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.768+0000 7f0616478740 1 --2- 172.21.15.3:0/695346761 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7efec70 0x5576d7eff050 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.768+0000 7f0616478740 1 -- 172.21.15.3:0/695346761 >> 172.21.15.3:0/695346761 conn(0x5576d7efb200 msgr2=0x5576d7efb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:59.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.768+0000 7f0616478740 1 -- 172.21.15.3:0/695346761 shutdown_connections 2024-09-19T06:15:59.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.768+0000 7f0610e00640 1 --2- 172.21.15.3:0/1726737861 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f05f40a33b0 0x7f05f40a5870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x5576d7efc060 tx=0x7f0600005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:59.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.768+0000 7f0616478740 1 -- 172.21.15.3:0/695346761 wait complete. 2024-09-19T06:15:59.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.769+0000 7f0616478740 1 -- start start 2024-09-19T06:15:59.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.769+0000 7f0616478740 1 Processor -- start 2024-09-19T06:15:59.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.769+0000 7f0616478740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7efec70 0x5576d7f06d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:59.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.769+0000 7f0616478740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7eff590 0x5576d7f072d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:59.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.769+0000 7f0616478740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7f09e50 0x5576d7f07810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:59.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.769+0000 7f0616478740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5576d7f0ca20 con 0x5576d7efec70 2024-09-19T06:15:59.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.769+0000 7f0616478740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5576d7e200f0 con 0x5576d7eff590 2024-09-19T06:15:59.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.769+0000 7f0616478740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5576d7f0cba0 con 0x5576d7f09e50 2024-09-19T06:15:59.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.770+0000 7f0616478740 10 client.0 _ll_register_callbacks cb 0x5576d7e07bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:59.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.770+0000 7f0610e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7efec70 0x5576d7f06d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:59.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.770+0000 7f060be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7eff590 0x5576d7f072d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:59.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.770+0000 7f060be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7eff590 0x5576d7f072d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:51338/0 (socket says 172.21.15.3:51338) 2024-09-19T06:15:59.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.770+0000 7f0610e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7efec70 0x5576d7f06d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54304/0 (socket says 172.21.15.3:54304) 2024-09-19T06:15:59.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.770+0000 7f060be00640 1 -- 172.21.15.3:0/248811322 learned_addr learned my addr 172.21.15.3:0/248811322 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:59.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.770+0000 7f0611800640 1 --2- 172.21.15.3:0/248811322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7f09e50 0x5576d7f07810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:59.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.770+0000 7f060be00640 1 -- 172.21.15.3:0/248811322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7f09e50 msgr2=0x5576d7f07810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:59.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.770+0000 7f060be00640 1 --2- 172.21.15.3:0/248811322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7f09e50 0x5576d7f07810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.770+0000 7f060be00640 1 -- 172.21.15.3:0/248811322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7efec70 msgr2=0x5576d7f06d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:59.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.770+0000 7f060be00640 1 --2- 172.21.15.3:0/248811322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7efec70 0x5576d7f06d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.770+0000 7f060be00640 1 -- 172.21.15.3:0/248811322 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576d7bd63c0 con 0x5576d7eff590 2024-09-19T06:15:59.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.770+0000 7f0611800640 1 --2- 172.21.15.3:0/248811322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7f09e50 0x5576d7f07810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:15:59.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.770+0000 7f060be00640 1 --2- 172.21.15.3:0/248811322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7eff590 0x5576d7f072d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f05f800e9c0 tx=0x7f05f809c2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bde3a15f5f635413 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:59.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.771+0000 7f05f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:15:59.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.771+0000 7f05f2a00640 1 -- 172.21.15.3:0/248811322 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f80cdc10 con 0x5576d7eff590 2024-09-19T06:15:59.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.771+0000 7f05f2a00640 1 -- 172.21.15.3:0/248811322 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f05f80a01c0 con 0x5576d7eff590 2024-09-19T06:15:59.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.771+0000 7f0616478740 1 -- 172.21.15.3:0/248811322 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f060402f940 con 0x5576d7eff590 2024-09-19T06:15:59.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.771+0000 7f05f2a00640 1 -- 172.21.15.3:0/248811322 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f05f80a06d0 con 0x5576d7eff590 2024-09-19T06:15:59.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.771+0000 7f0616478740 10 client.26216 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:59.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.771+0000 7f0616478740 1 -- 172.21.15.3:0/248811322 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5576d7f18ab0 con 0x5576d7eff590 2024-09-19T06:15:59.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.771+0000 7f05f2a00640 1 -- 172.21.15.3:0/248811322 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f060402f940 con 0x5576d7eff590 2024-09-19T06:15:59.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.772+0000 7f05f2a00640 1 -- 172.21.15.3:0/248811322 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f05f809b820 con 0x5576d7eff590 2024-09-19T06:15:59.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.772+0000 7f0616478740 10 client.26216 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:59.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.772+0000 7f0616478740 10 client.26216 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:15:59.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.772+0000 7f0616478740 20 client.26216 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:59.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.772+0000 7f0616478740 1 --2- 172.21.15.3:0/248811322 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5576d7f19f70 0x5576d7f1c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:59.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.772+0000 7f0616478740 4 client.26216 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:15:59.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.772+0000 7f0616478740 1 -- 172.21.15.3:0/248811322 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576d7e72950 con 0x5576d7f19f70 2024-09-19T06:15:59.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.772+0000 7f0610e00640 1 --2- 172.21.15.3:0/248811322 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5576d7f19f70 0x5576d7f1c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:59.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.773+0000 7f0610e00640 1 --2- 172.21.15.3:0/248811322 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5576d7f19f70 0x5576d7f1c360 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cbe709922ab25f3 server_cookie=239413a10ed9b755 in_seq=0 out_seq=0 2024-09-19T06:15:59.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.773+0000 7f05f2a00640 10 client.26216 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:15:59.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.773+0000 7f05f2a00640 1 -- 172.21.15.3:0/248811322 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5576d7e72950 con 0x5576d7f19f70 2024-09-19T06:15:59.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.773+0000 7f05f2a00640 10 client.26216 handle_command_reply: tid=0 2024-09-19T06:15:59.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.773+0000 7f0616478740 1 client.26216 shutdown 2024-09-19T06:15:59.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.774+0000 7f0616478740 1 -- 172.21.15.3:0/248811322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7eff590 msgr2=0x5576d7f072d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:59.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.774+0000 7f0616478740 1 --2- 172.21.15.3:0/248811322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7eff590 0x5576d7f072d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f05f800e9c0 tx=0x7f05f809c2a0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.774+0000 7f0616478740 1 -- 172.21.15.3:0/248811322 shutdown_connections 2024-09-19T06:15:59.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.774+0000 7f0616478740 1 --2- 172.21.15.3:0/248811322 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5576d7f19f70 0x5576d7f1c360 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.774+0000 7f0616478740 1 --2- 172.21.15.3:0/248811322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7f09e50 0x5576d7f07810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.774+0000 7f0616478740 1 --2- 172.21.15.3:0/248811322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7eff590 0x5576d7f072d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.774+0000 7f0616478740 1 --2- 172.21.15.3:0/248811322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7efec70 0x5576d7f06d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.774+0000 7f05f2a00640 0 client.26216 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:15:59.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.774+0000 7f0616478740 1 -- 172.21.15.3:0/248811322 >> 172.21.15.3:0/248811322 conn(0x5576d7efb200 msgr2=0x5576d7efa380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:59.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.774+0000 7f0616478740 1 -- 172.21.15.3:0/248811322 shutdown_connections 2024-09-19T06:15:59.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.774+0000 7f0616478740 1 -- 172.21.15.3:0/248811322 wait complete. 2024-09-19T06:15:59.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.774+0000 7f0616478740 20 client.26216 trim_cache size 0 max 16384 2024-09-19T06:15:59.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.788+0000 7f0616478740 1 Processor -- start 2024-09-19T06:15:59.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.789+0000 7f0616478740 1 -- start start 2024-09-19T06:15:59.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.789+0000 7f0616478740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7efec70 0x5576d7f21c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:59.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.789+0000 7f0616478740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7eff590 0x5576d7f22170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:59.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.789+0000 7f0616478740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7f09e50 0x5576d7f03ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:59.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.789+0000 7f0616478740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f060c1afaa0 con 0x5576d7f09e50 2024-09-19T06:15:59.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.789+0000 7f0616478740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f060c1b15e0 con 0x5576d7efec70 2024-09-19T06:15:59.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.789+0000 7f0616478740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f060c1b0170 con 0x5576d7eff590 2024-09-19T06:15:59.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.789+0000 7f0610e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7efec70 0x5576d7f21c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:59.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.789+0000 7f060be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7eff590 0x5576d7f22170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:59.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.789+0000 7f0610e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7efec70 0x5576d7f21c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:51342/0 (socket says 172.21.15.3:51342) 2024-09-19T06:15:59.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.789+0000 7f0610e00640 1 -- 172.21.15.3:0/2136689317 learned_addr learned my addr 172.21.15.3:0/2136689317 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:59.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.789+0000 7f060be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7eff590 0x5576d7f22170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:47416/0 (socket says 172.21.15.3:47416) 2024-09-19T06:15:59.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.789+0000 7f0611800640 1 --2- 172.21.15.3:0/2136689317 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7f09e50 0x5576d7f03ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:59.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.790+0000 7f060be00640 1 -- 172.21.15.3:0/2136689317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7efec70 msgr2=0x5576d7f21c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:59.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.790+0000 7f060be00640 1 --2- 172.21.15.3:0/2136689317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7efec70 0x5576d7f21c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.790+0000 7f060be00640 1 -- 172.21.15.3:0/2136689317 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7f09e50 msgr2=0x5576d7f03ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:59.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.790+0000 7f060be00640 1 --2- 172.21.15.3:0/2136689317 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7f09e50 0x5576d7f03ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.790+0000 7f060be00640 1 -- 172.21.15.3:0/2136689317 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576d7efc2b0 con 0x5576d7eff590 2024-09-19T06:15:59.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.790+0000 7f060be00640 1 --2- 172.21.15.3:0/2136689317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7eff590 0x5576d7f22170 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f05f809a680 tx=0x7f05f809c550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=852dc7416c347196 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:59.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.790+0000 7f05fd600640 1 -- 172.21.15.3:0/2136689317 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f809bd30 con 0x5576d7eff590 2024-09-19T06:15:59.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.790+0000 7f05fd600640 1 -- 172.21.15.3:0/2136689317 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05f80a4f90 con 0x5576d7eff590 2024-09-19T06:15:59.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.790+0000 7f05fd600640 1 -- 172.21.15.3:0/2136689317 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f8018b00 con 0x5576d7eff590 2024-09-19T06:15:59.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.791+0000 7f0616478740 1 -- 172.21.15.3:0/2136689317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7eff590 msgr2=0x5576d7f22170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:59.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.791+0000 7f0616478740 1 --2- 172.21.15.3:0/2136689317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7eff590 0x5576d7f22170 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f05f809a680 tx=0x7f05f809c550 comp rx=0 tx=0).stop 2024-09-19T06:15:59.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.791+0000 7f0616478740 1 -- 172.21.15.3:0/2136689317 shutdown_connections 2024-09-19T06:15:59.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.791+0000 7f0616478740 1 --2- 172.21.15.3:0/2136689317 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7f09e50 0x5576d7f03ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.791+0000 7f0616478740 1 --2- 172.21.15.3:0/2136689317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7eff590 0x5576d7f22170 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.791+0000 7f0616478740 1 --2- 172.21.15.3:0/2136689317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7efec70 0x5576d7f21c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.791+0000 7f0616478740 1 -- 172.21.15.3:0/2136689317 >> 172.21.15.3:0/2136689317 conn(0x5576d7efb200 msgr2=0x5576d7f08e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:59.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.791+0000 7f0616478740 1 -- 172.21.15.3:0/2136689317 shutdown_connections 2024-09-19T06:15:59.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.791+0000 7f0616478740 1 -- 172.21.15.3:0/2136689317 wait complete. 2024-09-19T06:15:59.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.791+0000 7f0616478740 1 -- start start 2024-09-19T06:15:59.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.792+0000 7f0616478740 1 Processor -- start 2024-09-19T06:15:59.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.792+0000 7f0616478740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7efec70 0x5576d7f0dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:59.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.792+0000 7f0616478740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7eff590 0x5576d7f0e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:59.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.792+0000 7f0616478740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7f09e50 0x5576d7f0e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:59.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.792+0000 7f0616478740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f060c1b0f10 con 0x5576d7efec70 2024-09-19T06:15:59.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.792+0000 7f0616478740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f060c1b0840 con 0x5576d7eff590 2024-09-19T06:15:59.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.792+0000 7f0616478740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f060c1ada80 con 0x5576d7f09e50 2024-09-19T06:15:59.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.792+0000 7f0616478740 10 client.0 _ll_register_callbacks cb 0x7f05f800ce60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:15:59.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.792+0000 7f0610e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7efec70 0x5576d7f0dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:59.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.792+0000 7f060be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7eff590 0x5576d7f0e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:59.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.793+0000 7f0611800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7f09e50 0x5576d7f0e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:59.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.793+0000 7f060be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7eff590 0x5576d7f0e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:51352/0 (socket says 172.21.15.3:51352) 2024-09-19T06:15:59.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.793+0000 7f060be00640 1 -- 172.21.15.3:0/2902983969 learned_addr learned my addr 172.21.15.3:0/2902983969 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:15:59.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.793+0000 7f0610e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7efec70 0x5576d7f0dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54318/0 (socket says 172.21.15.3:54318) 2024-09-19T06:15:59.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.793+0000 7f0610e00640 1 -- 172.21.15.3:0/2902983969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7f09e50 msgr2=0x5576d7f0e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:59.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.793+0000 7f0610e00640 1 --2- 172.21.15.3:0/2902983969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7f09e50 0x5576d7f0e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.793+0000 7f0610e00640 1 -- 172.21.15.3:0/2902983969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7eff590 msgr2=0x5576d7f0e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:15:59.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.793+0000 7f0610e00640 1 --2- 172.21.15.3:0/2902983969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7eff590 0x5576d7f0e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.793+0000 7f0610e00640 1 -- 172.21.15.3:0/2902983969 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576d7efbe90 con 0x5576d7efec70 2024-09-19T06:15:59.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.793+0000 7f0611800640 1 --2- 172.21.15.3:0/2902983969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7f09e50 0x5576d7f0e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:59.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.793+0000 7f060be00640 1 --2- 172.21.15.3:0/2902983969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7eff590 0x5576d7f0e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:15:59.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.793+0000 7f0610e00640 1 --2- 172.21.15.3:0/2902983969 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7efec70 0x5576d7f0dde0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0600009640 tx=0x7f06000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77822627a5274265 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:15:59.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.793+0000 7f05f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:15:59.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.794+0000 7f05f2a00640 1 -- 172.21.15.3:0/2902983969 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060000fb10 con 0x5576d7efec70 2024-09-19T06:15:59.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.794+0000 7f05f2a00640 1 -- 172.21.15.3:0/2902983969 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f060000fcb0 con 0x5576d7efec70 2024-09-19T06:15:59.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.794+0000 7f0616478740 1 -- 172.21.15.3:0/2902983969 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05f80a4f90 con 0x5576d7efec70 2024-09-19T06:15:59.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.794+0000 7f05f2a00640 1 -- 172.21.15.3:0/2902983969 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0600005020 con 0x5576d7efec70 2024-09-19T06:15:59.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.794+0000 7f0616478740 10 client.16179 fetch_fsmap learned FSMap version 29 2024-09-19T06:15:59.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.794+0000 7f0616478740 1 -- 172.21.15.3:0/2902983969 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5576d7ef6770 con 0x5576d7efec70 2024-09-19T06:15:59.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.794+0000 7f05f2a00640 1 -- 172.21.15.3:0/2902983969 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05f80a4f90 con 0x5576d7efec70 2024-09-19T06:15:59.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.794+0000 7f05f2a00640 1 -- 172.21.15.3:0/2902983969 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f060003c480 con 0x5576d7efec70 2024-09-19T06:15:59.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.794+0000 7f0616478740 10 client.16179 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:15:59.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.794+0000 7f0616478740 10 client.16179 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:15:59.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.794+0000 7f0616478740 20 client.16179 populate_metadata read hostname 'smithi003' 2024-09-19T06:15:59.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.795+0000 7f0616478740 1 --2- 172.21.15.3:0/2902983969 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5576d7f85510 0x5576d7f87900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:15:59.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.795+0000 7f0616478740 4 client.16179 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:15:59.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.795+0000 7f0616478740 1 -- 172.21.15.3:0/2902983969 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5576d7e6ce60 con 0x5576d7f85510 2024-09-19T06:15:59.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.795+0000 7f060be00640 1 --2- 172.21.15.3:0/2902983969 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5576d7f85510 0x5576d7f87900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:15:59.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.795+0000 7f060be00640 1 --2- 172.21.15.3:0/2902983969 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5576d7f85510 0x5576d7f87900 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=88f33a4c0d2657b server_cookie=496598c8b48e1557 in_seq=0 out_seq=0 2024-09-19T06:15:59.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.795+0000 7f05f2a00640 10 client.16179 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:15:59.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.796+0000 7f05f2a00640 1 -- 172.21.15.3:0/2902983969 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5576d7e6ce60 con 0x5576d7f85510 2024-09-19T06:15:59.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.796+0000 7f05f2a00640 10 client.16179 handle_command_reply: tid=0 2024-09-19T06:15:59.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.796+0000 7f0616478740 1 client.16179 shutdown 2024-09-19T06:15:59.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.796+0000 7f0616478740 1 -- 172.21.15.3:0/2902983969 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7efec70 msgr2=0x5576d7f0dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:59.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.796+0000 7f0616478740 1 --2- 172.21.15.3:0/2902983969 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7efec70 0x5576d7f0dde0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0600009640 tx=0x7f06000046c0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.796+0000 7f0616478740 1 -- 172.21.15.3:0/2902983969 shutdown_connections 2024-09-19T06:15:59.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.796+0000 7f0616478740 1 --2- 172.21.15.3:0/2902983969 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5576d7f85510 0x5576d7f87900 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.796+0000 7f0616478740 1 --2- 172.21.15.3:0/2902983969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576d7f09e50 0x5576d7f0e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.796+0000 7f0616478740 1 --2- 172.21.15.3:0/2902983969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576d7eff590 0x5576d7f0e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.796+0000 7f0616478740 1 --2- 172.21.15.3:0/2902983969 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576d7efec70 0x5576d7f0dde0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.796+0000 7f0616478740 1 -- 172.21.15.3:0/2902983969 >> 172.21.15.3:0/2902983969 conn(0x5576d7efb200 msgr2=0x5576d7f06d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:59.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.796+0000 7f05f2a00640 0 client.16179 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:15:59.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.796+0000 7f0616478740 1 -- 172.21.15.3:0/2902983969 shutdown_connections 2024-09-19T06:15:59.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.796+0000 7f0616478740 1 -- 172.21.15.3:0/2902983969 wait complete. 2024-09-19T06:15:59.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.796+0000 7f0616478740 20 client.16179 trim_cache size 0 max 16384 2024-09-19T06:15:59.804 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:15:59.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.797+0000 7f0613800640 1 -- 172.21.15.3:0/1726737861 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f05f40a33b0 msgr2=0x7f05f40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:59.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.797+0000 7f0613800640 1 --2- 172.21.15.3:0/1726737861 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f05f40a33b0 0x7f05f40a5870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x5576d7efc060 tx=0x7f0600005f90 comp rx=0 tx=0).stop 2024-09-19T06:15:59.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.797+0000 7f0613800640 1 -- 172.21.15.3:0/1726737861 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f060c074e30 msgr2=0x7f060c19ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:15:59.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.797+0000 7f0613800640 1 --2- 172.21.15.3:0/1726737861 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f060c074e30 0x7f060c19ac10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f05f800e9f0 tx=0x7f05f800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.797+0000 7f0613800640 1 -- 172.21.15.3:0/1726737861 shutdown_connections 2024-09-19T06:15:59.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.797+0000 7f0613800640 1 --2- 172.21.15.3:0/1726737861 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f05f40a33b0 0x7f05f40a5870 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.797+0000 7f0613800640 1 --2- 172.21.15.3:0/1726737861 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f060c10e450 0x7f060c19efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.797+0000 7f0613800640 1 --2- 172.21.15.3:0/1726737861 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f060c074e30 0x7f060c19ac10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.797+0000 7f0613800640 1 --2- 172.21.15.3:0/1726737861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f060c074510 0x7f060c19a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:15:59.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.797+0000 7f0613800640 1 -- 172.21.15.3:0/1726737861 >> 172.21.15.3:0/1726737861 conn(0x7f060c0fd8b0 msgr2=0x7f060c0fef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:15:59.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.797+0000 7f0613800640 1 -- 172.21.15.3:0/1726737861 shutdown_connections 2024-09-19T06:15:59.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:15:59.797+0000 7f0613800640 1 -- 172.21.15.3:0/1726737861 wait complete. 2024-09-19T06:16:00.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:00 smithi003 ceph-mon[30893]: pgmap v111: 97 pgs: 97 active+clean; 4.3 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 22 op/s 2024-09-19T06:16:00.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:00 smithi071 ceph-mon[35662]: pgmap v111: 97 pgs: 97 active+clean; 4.3 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 22 op/s 2024-09-19T06:16:00.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:00 smithi059 ceph-mon[35138]: pgmap v111: 97 pgs: 97 active+clean; 4.3 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 22 op/s 2024-09-19T06:16:00.881 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:16:01.265 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:01.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.843+0000 7f7ac7800640 1 -- 172.21.15.3:0/2103811205 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ac0104010 msgr2=0x7f7ac01043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:01.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.843+0000 7f7ac7800640 1 --2- 172.21.15.3:0/2103811205 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ac0104010 0x7f7ac01043f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4009900 tx=0x7f7ab402a410 comp rx=0 tx=0).stop 2024-09-19T06:16:01.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.843+0000 7f7ac7800640 1 -- 172.21.15.3:0/2103811205 shutdown_connections 2024-09-19T06:16:01.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.843+0000 7f7ac7800640 1 --2- 172.21.15.3:0/2103811205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ac0109140 0x7f7ac0110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.843+0000 7f7ac7800640 1 --2- 172.21.15.3:0/2103811205 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ac01049c0 0x7f7ac0108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.843+0000 7f7ac7800640 1 --2- 172.21.15.3:0/2103811205 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ac0104010 0x7f7ac01043f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.843+0000 7f7ac7800640 1 -- 172.21.15.3:0/2103811205 >> 172.21.15.3:0/2103811205 conn(0x7f7ac00ffa50 msgr2=0x7f7ac0101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:01.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.843+0000 7f7ac7800640 1 -- 172.21.15.3:0/2103811205 shutdown_connections 2024-09-19T06:16:01.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.843+0000 7f7ac7800640 1 -- 172.21.15.3:0/2103811205 wait complete. 2024-09-19T06:16:01.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.844+0000 7f7ac7800640 1 Processor -- start 2024-09-19T06:16:01.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.844+0000 7f7ac7800640 1 -- start start 2024-09-19T06:16:01.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.845+0000 7f7ac7800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ac0104010 0x7f7ac019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:01.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.845+0000 7f7ac7800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ac01049c0 0x7f7ac019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:01.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.845+0000 7f7ac7800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ac0109140 0x7f7ac019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:01.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.845+0000 7f7ac7800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac01141b0 con 0x7f7ac01049c0 2024-09-19T06:16:01.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.845+0000 7f7ac7800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac0114030 con 0x7f7ac0109140 2024-09-19T06:16:01.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.845+0000 7f7ac7800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac0114330 con 0x7f7ac0104010 2024-09-19T06:16:01.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.845+0000 7f7abfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ac01049c0 0x7f7ac019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:01.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.845+0000 7f7ac5800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ac0109140 0x7f7ac019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:01.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.845+0000 7f7ac4e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ac0104010 0x7f7ac019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:01.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.845+0000 7f7ac5800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ac0109140 0x7f7ac019ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:51364/0 (socket says 172.21.15.3:51364) 2024-09-19T06:16:01.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.845+0000 7f7ac5800640 1 -- 172.21.15.3:0/123407881 learned_addr learned my addr 172.21.15.3:0/123407881 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:01.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.845+0000 7f7ac5800640 1 -- 172.21.15.3:0/123407881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ac0104010 msgr2=0x7f7ac019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:01.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.845+0000 7f7ac5800640 1 --2- 172.21.15.3:0/123407881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ac0104010 0x7f7ac019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.845+0000 7f7ac5800640 1 -- 172.21.15.3:0/123407881 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ac01049c0 msgr2=0x7f7ac019ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:01.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.845+0000 7f7ac5800640 1 --2- 172.21.15.3:0/123407881 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ac01049c0 0x7f7ac019ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.845+0000 7f7ac5800640 1 -- 172.21.15.3:0/123407881 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac019f5e0 con 0x7f7ac0109140 2024-09-19T06:16:01.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.845+0000 7f7ac4e00640 1 --2- 172.21.15.3:0/123407881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ac0104010 0x7f7ac019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:01.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.846+0000 7f7ac5800640 1 --2- 172.21.15.3:0/123407881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ac0109140 0x7f7ac019ef00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800eb10 tx=0x7f7ab800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:01.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.846+0000 7f7abd600640 1 -- 172.21.15.3:0/123407881 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8004b20 con 0x7f7ac0109140 2024-09-19T06:16:01.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.846+0000 7f7ac7800640 1 -- 172.21.15.3:0/123407881 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac019f8d0 con 0x7f7ac0109140 2024-09-19T06:16:01.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.846+0000 7f7abd600640 1 -- 172.21.15.3:0/123407881 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ab8004cc0 con 0x7f7ac0109140 2024-09-19T06:16:01.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.846+0000 7f7abd600640 1 -- 172.21.15.3:0/123407881 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8010700 con 0x7f7ac0109140 2024-09-19T06:16:01.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.846+0000 7f7ac7800640 1 -- 172.21.15.3:0/123407881 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac01a71b0 con 0x7f7ac0109140 2024-09-19T06:16:01.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.850+0000 7f7aca296740 1 Processor -- start 2024-09-19T06:16:01.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.851+0000 7f7abd600640 1 -- 172.21.15.3:0/123407881 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f7ab8005000 con 0x7f7ac0109140 2024-09-19T06:16:01.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.851+0000 7f7aca296740 1 -- start start 2024-09-19T06:16:01.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.851+0000 7f7aca296740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e47c70 0x55a2f7e48050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:01.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.851+0000 7f7aca296740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2f7e48590 0x55a2f7e52910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:01.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.851+0000 7f7aca296740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2f7e52e50 0x55a2f7e55240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:01.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.851+0000 7f7aca296740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a2f7dae3e0 con 0x55a2f7e47c70 2024-09-19T06:16:01.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.851+0000 7f7aca296740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a2f7d55d80 con 0x55a2f7e48590 2024-09-19T06:16:01.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.851+0000 7f7aca296740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a2f7daa3a0 con 0x55a2f7e52e50 2024-09-19T06:16:01.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.851+0000 7f7abfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e47c70 0x55a2f7e48050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:01.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.852+0000 7f7abfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e47c70 0x55a2f7e48050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54330/0 (socket says 172.21.15.3:54330) 2024-09-19T06:16:01.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.852+0000 7f7ac4e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2f7e48590 0x55a2f7e52910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:01.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.852+0000 7f7abfe00640 1 -- 172.21.15.3:0/1028344937 learned_addr learned my addr 172.21.15.3:0/1028344937 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:01.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.852+0000 7f7abfe00640 1 --2- 172.21.15.3:0/1028344937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2f7e52e50 0x55a2f7e55240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:01.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.852+0000 7f7ac4e00640 1 -- 172.21.15.3:0/1028344937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2f7e52e50 msgr2=0x55a2f7e55240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:01.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.852+0000 7f7ac4e00640 1 --2- 172.21.15.3:0/1028344937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2f7e52e50 0x55a2f7e55240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.852+0000 7f7ac4e00640 1 -- 172.21.15.3:0/1028344937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e47c70 msgr2=0x55a2f7e48050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:01.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.852+0000 7f7ac4e00640 1 --2- 172.21.15.3:0/1028344937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e47c70 0x55a2f7e48050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.852+0000 7f7ac4e00640 1 -- 172.21.15.3:0/1028344937 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2f7d74ae0 con 0x55a2f7e48590 2024-09-19T06:16:01.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.852+0000 7f7abd600640 1 --2- 172.21.15.3:0/123407881 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7aa80a33b0 0x7f7aa80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:01.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.852+0000 7f7ac4e00640 1 --2- 172.21.15.3:0/1028344937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2f7e48590 0x55a2f7e52910 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7ab402aa00 tx=0x7f7ab4005de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d43519fc03a8e101 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:01.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.853+0000 7f7abd600640 1 -- 172.21.15.3:0/123407881 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f7ab80d03c0 con 0x7f7ac0109140 2024-09-19T06:16:01.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.853+0000 7f7abfe00640 1 --2- 172.21.15.3:0/123407881 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7aa80a33b0 0x7f7aa80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:01.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.853+0000 7f7ab2000640 1 -- 172.21.15.3:0/1028344937 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4035040 con 0x55a2f7e48590 2024-09-19T06:16:01.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.853+0000 7f7ab2000640 1 -- 172.21.15.3:0/1028344937 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ab4004760 con 0x55a2f7e48590 2024-09-19T06:16:01.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.853+0000 7f7ab2000640 1 -- 172.21.15.3:0/1028344937 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab40038e0 con 0x55a2f7e48590 2024-09-19T06:16:01.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.853+0000 7f7aca296740 1 -- 172.21.15.3:0/1028344937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2f7e48590 msgr2=0x55a2f7e52910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:01.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.853+0000 7f7aca296740 1 --2- 172.21.15.3:0/1028344937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2f7e48590 0x55a2f7e52910 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7ab402aa00 tx=0x7f7ab4005de0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.853+0000 7f7abfe00640 1 --2- 172.21.15.3:0/123407881 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7aa80a33b0 0x7f7aa80a5870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55a2f7e45580 tx=0x7f7aac015040 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:01.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.854+0000 7f7aca296740 1 -- 172.21.15.3:0/1028344937 shutdown_connections 2024-09-19T06:16:01.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.854+0000 7f7aca296740 1 --2- 172.21.15.3:0/1028344937 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2f7e52e50 0x55a2f7e55240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.854+0000 7f7aca296740 1 --2- 172.21.15.3:0/1028344937 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2f7e48590 0x55a2f7e52910 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.854+0000 7f7aca296740 1 --2- 172.21.15.3:0/1028344937 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e47c70 0x55a2f7e48050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.854+0000 7f7aca296740 1 -- 172.21.15.3:0/1028344937 >> 172.21.15.3:0/1028344937 conn(0x55a2f7e44200 msgr2=0x55a2f7e445e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:01.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.854+0000 7f7aca296740 1 -- 172.21.15.3:0/1028344937 shutdown_connections 2024-09-19T06:16:01.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.854+0000 7f7aca296740 1 -- 172.21.15.3:0/1028344937 wait complete. 2024-09-19T06:16:01.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.854+0000 7f7aca296740 1 -- start start 2024-09-19T06:16:01.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.855+0000 7f7aca296740 1 Processor -- start 2024-09-19T06:16:01.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.855+0000 7f7aca296740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2f7e47c70 0x55a2f7e4fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:01.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.855+0000 7f7aca296740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2f7e48590 0x55a2f7e50310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:01.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.855+0000 7f7aca296740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e52e50 0x55a2f7e50850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:01.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.855+0000 7f7aca296740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a2f7e55a20 con 0x55a2f7e52e50 2024-09-19T06:16:01.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.855+0000 7f7aca296740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a2f7d690f0 con 0x55a2f7e47c70 2024-09-19T06:16:01.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.855+0000 7f7aca296740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a2f7e55ba0 con 0x55a2f7e48590 2024-09-19T06:16:01.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.855+0000 7f7aca296740 10 client.0 _ll_register_callbacks cb 0x55a2f7d50bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:01.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.856+0000 7f7ac5800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e52e50 0x55a2f7e50850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:01.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.856+0000 7f7ac4e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2f7e47c70 0x55a2f7e4fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:01.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.856+0000 7f7ac5800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e52e50 0x55a2f7e50850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54340/0 (socket says 172.21.15.3:54340) 2024-09-19T06:16:01.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.856+0000 7f7ac5800640 1 -- 172.21.15.3:0/1442012798 learned_addr learned my addr 172.21.15.3:0/1442012798 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:01.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.856+0000 7f7abfe00640 1 --2- 172.21.15.3:0/1442012798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2f7e48590 0x55a2f7e50310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:01.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.856+0000 7f7ac4e00640 1 -- 172.21.15.3:0/1442012798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2f7e48590 msgr2=0x55a2f7e50310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:01.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.856+0000 7f7ac4e00640 1 --2- 172.21.15.3:0/1442012798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2f7e48590 0x55a2f7e50310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.856+0000 7f7ac4e00640 1 -- 172.21.15.3:0/1442012798 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e52e50 msgr2=0x55a2f7e50850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:01.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.856+0000 7f7ac4e00640 1 --2- 172.21.15.3:0/1442012798 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e52e50 0x55a2f7e50850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.856+0000 7f7ac4e00640 1 -- 172.21.15.3:0/1442012798 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2f7b1f3c0 con 0x55a2f7e47c70 2024-09-19T06:16:01.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.856+0000 7f7ac5800640 1 --2- 172.21.15.3:0/1442012798 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e52e50 0x55a2f7e50850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:01.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.856+0000 7f7ac4e00640 1 --2- 172.21.15.3:0/1442012798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2f7e47c70 0x55a2f7e4fdd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7ab402a930 tx=0x7f7ab4003890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=538e3b066f52bfaf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:01.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.856+0000 7f7aa6a00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:16:01.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.857+0000 7f7aa6a00640 1 -- 172.21.15.3:0/1442012798 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4035030 con 0x55a2f7e47c70 2024-09-19T06:16:01.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.857+0000 7f7aca296740 1 -- 172.21.15.3:0/1442012798 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ab4004760 con 0x55a2f7e47c70 2024-09-19T06:16:01.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.857+0000 7f7aa6a00640 1 -- 172.21.15.3:0/1442012798 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f7ab4003c90 con 0x55a2f7e47c70 2024-09-19T06:16:01.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.857+0000 7f7aa6a00640 1 -- 172.21.15.3:0/1442012798 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7ab4003e90 con 0x55a2f7e47c70 2024-09-19T06:16:01.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.857+0000 7f7aca296740 10 client.26234 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:01.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.857+0000 7f7aca296740 1 -- 172.21.15.3:0/1442012798 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a2f7e61ae0 con 0x55a2f7e47c70 2024-09-19T06:16:01.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.857+0000 7f7aa6a00640 1 -- 172.21.15.3:0/1442012798 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ab4004760 con 0x55a2f7e47c70 2024-09-19T06:16:01.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.857+0000 7f7aa6a00640 1 -- 172.21.15.3:0/1442012798 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f7ab404e520 con 0x55a2f7e47c70 2024-09-19T06:16:01.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.858+0000 7f7aca296740 10 client.26234 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:01.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.858+0000 7f7aca296740 10 client.26234 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:16:01.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.858+0000 7f7aca296740 20 client.26234 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:01.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.858+0000 7f7aca296740 1 --2- 172.21.15.3:0/1442012798 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55a2f7e62e30 0x55a2f7e65220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:01.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.858+0000 7f7aca296740 4 client.26234 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:01.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.858+0000 7f7aca296740 1 -- 172.21.15.3:0/1442012798 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2f7dbb950 con 0x55a2f7e62e30 2024-09-19T06:16:01.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.858+0000 7f7abfe00640 1 --2- 172.21.15.3:0/1442012798 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55a2f7e62e30 0x55a2f7e65220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:01.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.859+0000 7f7abfe00640 1 --2- 172.21.15.3:0/1442012798 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55a2f7e62e30 0x55a2f7e65220 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d286e3ffe1ad5070 server_cookie=fdd4481500463dc in_seq=0 out_seq=0 2024-09-19T06:16:01.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.859+0000 7f7aa6a00640 10 client.26234 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:16:01.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.859+0000 7f7aa6a00640 1 -- 172.21.15.3:0/1442012798 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a2f7dbb950 con 0x55a2f7e62e30 2024-09-19T06:16:01.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.859+0000 7f7aa6a00640 10 client.26234 handle_command_reply: tid=0 2024-09-19T06:16:01.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.859+0000 7f7aca296740 1 client.26234 shutdown 2024-09-19T06:16:01.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.860+0000 7f7aca296740 1 -- 172.21.15.3:0/1442012798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2f7e47c70 msgr2=0x55a2f7e4fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:01.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.860+0000 7f7aca296740 1 --2- 172.21.15.3:0/1442012798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2f7e47c70 0x55a2f7e4fdd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7ab402a930 tx=0x7f7ab4003890 comp rx=0 tx=0).stop 2024-09-19T06:16:01.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.860+0000 7f7aca296740 1 -- 172.21.15.3:0/1442012798 shutdown_connections 2024-09-19T06:16:01.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.860+0000 7f7aca296740 1 --2- 172.21.15.3:0/1442012798 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55a2f7e62e30 0x55a2f7e65220 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.860+0000 7f7aca296740 1 --2- 172.21.15.3:0/1442012798 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e52e50 0x55a2f7e50850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.860+0000 7f7aca296740 1 --2- 172.21.15.3:0/1442012798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2f7e48590 0x55a2f7e50310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.860+0000 7f7aca296740 1 --2- 172.21.15.3:0/1442012798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2f7e47c70 0x55a2f7e4fdd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.860+0000 7f7aa6a00640 0 client.26234 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:16:01.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.860+0000 7f7aca296740 1 -- 172.21.15.3:0/1442012798 >> 172.21.15.3:0/1442012798 conn(0x55a2f7e44200 msgr2=0x55a2f7e43380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:01.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.860+0000 7f7aca296740 1 -- 172.21.15.3:0/1442012798 shutdown_connections 2024-09-19T06:16:01.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.860+0000 7f7aca296740 1 -- 172.21.15.3:0/1442012798 wait complete. 2024-09-19T06:16:01.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.860+0000 7f7aca296740 20 client.26234 trim_cache size 0 max 16384 2024-09-19T06:16:01.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.874+0000 7f7aca296740 1 Processor -- start 2024-09-19T06:16:01.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.874+0000 7f7aca296740 1 -- start start 2024-09-19T06:16:01.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.874+0000 7f7aca296740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e47c70 0x55a2f7e6a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:01.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.874+0000 7f7aca296740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2f7e48590 0x55a2f7e6ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:01.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.874+0000 7f7aca296740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2f7e52e50 0x55a2f7e496c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:01.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.874+0000 7f7aca296740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac01afb30 con 0x55a2f7e47c70 2024-09-19T06:16:01.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.874+0000 7f7aca296740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac01b1670 con 0x55a2f7e52e50 2024-09-19T06:16:01.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.874+0000 7f7aca296740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac01b0200 con 0x55a2f7e48590 2024-09-19T06:16:01.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.875+0000 7f7ac4e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e47c70 0x55a2f7e6a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:01.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.875+0000 7f7ac4e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e47c70 0x55a2f7e6a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54344/0 (socket says 172.21.15.3:54344) 2024-09-19T06:16:01.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.875+0000 7f7ac4e00640 1 -- 172.21.15.3:0/1235523366 learned_addr learned my addr 172.21.15.3:0/1235523366 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:01.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.875+0000 7f7ac5800640 1 --2- 172.21.15.3:0/1235523366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2f7e52e50 0x55a2f7e496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:01.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.875+0000 7f7abfe00640 1 --2- 172.21.15.3:0/1235523366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2f7e48590 0x55a2f7e6ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:01.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.875+0000 7f7ac4e00640 1 -- 172.21.15.3:0/1235523366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2f7e48590 msgr2=0x55a2f7e6ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:01.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.875+0000 7f7ac4e00640 1 --2- 172.21.15.3:0/1235523366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2f7e48590 0x55a2f7e6ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.875+0000 7f7ac4e00640 1 -- 172.21.15.3:0/1235523366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2f7e52e50 msgr2=0x55a2f7e496c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:01.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.875+0000 7f7ac4e00640 1 --2- 172.21.15.3:0/1235523366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2f7e52e50 0x55a2f7e496c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.875+0000 7f7ac4e00640 1 -- 172.21.15.3:0/1235523366 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2f7e483c0 con 0x55a2f7e47c70 2024-09-19T06:16:01.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.875+0000 7f7abfe00640 1 --2- 172.21.15.3:0/1235523366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2f7e48590 0x55a2f7e6ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:01.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.875+0000 7f7ac4e00640 1 --2- 172.21.15.3:0/1235523366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e47c70 0x55a2f7e6a820 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7ab404e8f0 tx=0x7f7ab4005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e1f206e62adb5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:01.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.876+0000 7f7ab1600640 1 -- 172.21.15.3:0/1235523366 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab405c070 con 0x55a2f7e47c70 2024-09-19T06:16:01.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.876+0000 7f7ab1600640 1 -- 172.21.15.3:0/1235523366 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ab40043f0 con 0x55a2f7e47c70 2024-09-19T06:16:01.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.876+0000 7f7ab1600640 1 -- 172.21.15.3:0/1235523366 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab404edc0 con 0x55a2f7e47c70 2024-09-19T06:16:01.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.876+0000 7f7aca296740 1 -- 172.21.15.3:0/1235523366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e47c70 msgr2=0x55a2f7e6a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:01.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.876+0000 7f7aca296740 1 --2- 172.21.15.3:0/1235523366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e47c70 0x55a2f7e6a820 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7ab404e8f0 tx=0x7f7ab4005de0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.876+0000 7f7aca296740 1 -- 172.21.15.3:0/1235523366 shutdown_connections 2024-09-19T06:16:01.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.876+0000 7f7aca296740 1 --2- 172.21.15.3:0/1235523366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2f7e52e50 0x55a2f7e496c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.876+0000 7f7aca296740 1 --2- 172.21.15.3:0/1235523366 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2f7e48590 0x55a2f7e6ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.876+0000 7f7aca296740 1 --2- 172.21.15.3:0/1235523366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e47c70 0x55a2f7e6a820 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.876+0000 7f7aca296740 1 -- 172.21.15.3:0/1235523366 >> 172.21.15.3:0/1235523366 conn(0x55a2f7e44200 msgr2=0x55a2f7e51e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:01.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.877+0000 7f7aca296740 1 -- 172.21.15.3:0/1235523366 shutdown_connections 2024-09-19T06:16:01.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.877+0000 7f7aca296740 1 -- 172.21.15.3:0/1235523366 wait complete. 2024-09-19T06:16:01.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.877+0000 7f7aca296740 1 -- start start 2024-09-19T06:16:01.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.877+0000 7f7aca296740 1 Processor -- start 2024-09-19T06:16:01.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.878+0000 7f7aca296740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2f7e47c70 0x55a2f7e5b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:01.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.878+0000 7f7aca296740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e48590 0x55a2f7e5b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:01.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.878+0000 7f7aca296740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2f7e52e50 0x55a2f7e566e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:01.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.878+0000 7f7aca296740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac01b0fa0 con 0x55a2f7e48590 2024-09-19T06:16:01.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.878+0000 7f7aca296740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac01b08d0 con 0x55a2f7e52e50 2024-09-19T06:16:01.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.878+0000 7f7aca296740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac01adb10 con 0x55a2f7e47c70 2024-09-19T06:16:01.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.878+0000 7f7aca296740 10 client.0 _ll_register_callbacks cb 0x7f7aac009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:01.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.878+0000 7f7abfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e48590 0x55a2f7e5b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:01.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.878+0000 7f7ac4e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2f7e47c70 0x55a2f7e5b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:01.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.878+0000 7f7abfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e48590 0x55a2f7e5b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54352/0 (socket says 172.21.15.3:54352) 2024-09-19T06:16:01.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.878+0000 7f7abfe00640 1 -- 172.21.15.3:0/575300898 learned_addr learned my addr 172.21.15.3:0/575300898 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:01.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.878+0000 7f7ac5800640 1 --2- 172.21.15.3:0/575300898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2f7e52e50 0x55a2f7e566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:01.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.878+0000 7f7abfe00640 1 -- 172.21.15.3:0/575300898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2f7e47c70 msgr2=0x55a2f7e5b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:01.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.878+0000 7f7abfe00640 1 --2- 172.21.15.3:0/575300898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2f7e47c70 0x55a2f7e5b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.878+0000 7f7abfe00640 1 -- 172.21.15.3:0/575300898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2f7e52e50 msgr2=0x55a2f7e566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:01.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.878+0000 7f7abfe00640 1 --2- 172.21.15.3:0/575300898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2f7e52e50 0x55a2f7e566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.878+0000 7f7abfe00640 1 -- 172.21.15.3:0/575300898 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2f7e56f10 con 0x55a2f7e48590 2024-09-19T06:16:01.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.878+0000 7f7ac5800640 1 --2- 172.21.15.3:0/575300898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2f7e52e50 0x55a2f7e566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:01.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.879+0000 7f7abfe00640 1 --2- 172.21.15.3:0/575300898 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e48590 0x55a2f7e5b6a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x55a2f7e4f660 tx=0x7f7aac005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553ec0eac0dd62f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:01.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.879+0000 7f7aa6a00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:16:01.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.879+0000 7f7aa6a00640 1 -- 172.21.15.3:0/575300898 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac030070 con 0x55a2f7e48590 2024-09-19T06:16:01.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.879+0000 7f7aa6a00640 1 -- 172.21.15.3:0/575300898 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f7aac022420 con 0x55a2f7e48590 2024-09-19T06:16:01.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.879+0000 7f7aca296740 1 -- 172.21.15.3:0/575300898 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ab40043f0 con 0x55a2f7e48590 2024-09-19T06:16:01.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.879+0000 7f7aa6a00640 1 -- 172.21.15.3:0/575300898 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7aac038050 con 0x55a2f7e48590 2024-09-19T06:16:01.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.879+0000 7f7aca296740 10 client.16197 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:01.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.879+0000 7f7aca296740 1 -- 172.21.15.3:0/575300898 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a2f7ecd4c0 con 0x55a2f7e48590 2024-09-19T06:16:01.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.880+0000 7f7aa6a00640 1 -- 172.21.15.3:0/575300898 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ab40043f0 con 0x55a2f7e48590 2024-09-19T06:16:01.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.880+0000 7f7aa6a00640 1 -- 172.21.15.3:0/575300898 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f7aac033030 con 0x55a2f7e48590 2024-09-19T06:16:01.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.880+0000 7f7aca296740 10 client.16197 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:01.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.880+0000 7f7aca296740 10 client.16197 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:16:01.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.880+0000 7f7aca296740 20 client.16197 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:01.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.880+0000 7f7aca296740 1 --2- 172.21.15.3:0/575300898 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55a2f7ecdc20 0x55a2f7ed0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:01.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.880+0000 7f7aca296740 4 client.16197 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:16:01.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.880+0000 7f7aca296740 1 -- 172.21.15.3:0/575300898 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a2f7db5e60 con 0x55a2f7ecdc20 2024-09-19T06:16:01.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.880+0000 7f7ac4e00640 1 --2- 172.21.15.3:0/575300898 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55a2f7ecdc20 0x55a2f7ed0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:01.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.881+0000 7f7ac4e00640 1 --2- 172.21.15.3:0/575300898 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55a2f7ecdc20 0x55a2f7ed0040 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8894076a3a97ba47 server_cookie=a7ab6dd6b0c53cae in_seq=0 out_seq=0 2024-09-19T06:16:01.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.881+0000 7f7aa6a00640 10 client.16197 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:16:01.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.881+0000 7f7aa6a00640 1 -- 172.21.15.3:0/575300898 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a2f7db5e60 con 0x55a2f7ecdc20 2024-09-19T06:16:01.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.881+0000 7f7aa6a00640 10 client.16197 handle_command_reply: tid=0 2024-09-19T06:16:01.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.881+0000 7f7aca296740 1 client.16197 shutdown 2024-09-19T06:16:01.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.881+0000 7f7aca296740 1 -- 172.21.15.3:0/575300898 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e48590 msgr2=0x55a2f7e5b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:01.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.881+0000 7f7aca296740 1 --2- 172.21.15.3:0/575300898 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e48590 0x55a2f7e5b6a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x55a2f7e4f660 tx=0x7f7aac005f90 comp rx=0 tx=0).stop 2024-09-19T06:16:01.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.881+0000 7f7aca296740 1 -- 172.21.15.3:0/575300898 shutdown_connections 2024-09-19T06:16:01.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.881+0000 7f7aca296740 1 --2- 172.21.15.3:0/575300898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a2f7e52e50 0x55a2f7e566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.881+0000 7f7aca296740 1 --2- 172.21.15.3:0/575300898 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55a2f7ecdc20 0x55a2f7ed0040 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.881+0000 7f7aca296740 1 --2- 172.21.15.3:0/575300898 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a2f7e48590 0x55a2f7e5b6a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.881+0000 7f7aca296740 1 --2- 172.21.15.3:0/575300898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a2f7e47c70 0x55a2f7e5b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.881+0000 7f7aca296740 1 -- 172.21.15.3:0/575300898 >> 172.21.15.3:0/575300898 conn(0x55a2f7e44200 msgr2=0x55a2f7e496c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:01.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.881+0000 7f7aa6a00640 0 client.16197 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:16:01.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.881+0000 7f7aca296740 1 -- 172.21.15.3:0/575300898 shutdown_connections 2024-09-19T06:16:01.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.882+0000 7f7aca296740 1 -- 172.21.15.3:0/575300898 wait complete. 2024-09-19T06:16:01.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.882+0000 7f7aca296740 20 client.16197 trim_cache size 0 max 16384 2024-09-19T06:16:01.887 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:16:01.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.882+0000 7f7ac7800640 1 -- 172.21.15.3:0/123407881 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7aa80a33b0 msgr2=0x7f7aa80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:01.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.882+0000 7f7ac7800640 1 --2- 172.21.15.3:0/123407881 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7aa80a33b0 0x7f7aa80a5870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55a2f7e45580 tx=0x7f7aac015040 comp rx=0 tx=0).stop 2024-09-19T06:16:01.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.882+0000 7f7ac7800640 1 -- 172.21.15.3:0/123407881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ac0109140 msgr2=0x7f7ac019ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:01.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.882+0000 7f7ac7800640 1 --2- 172.21.15.3:0/123407881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ac0109140 0x7f7ac019ef00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800eb10 tx=0x7f7ab800c2d0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.882+0000 7f7ac7800640 1 -- 172.21.15.3:0/123407881 shutdown_connections 2024-09-19T06:16:01.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.882+0000 7f7ac7800640 1 --2- 172.21.15.3:0/123407881 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7aa80a33b0 0x7f7aa80a5870 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.882+0000 7f7ac7800640 1 --2- 172.21.15.3:0/123407881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ac0109140 0x7f7ac019ef00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.882+0000 7f7ac7800640 1 --2- 172.21.15.3:0/123407881 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ac01049c0 0x7f7ac019ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.882+0000 7f7ac7800640 1 --2- 172.21.15.3:0/123407881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ac0104010 0x7f7ac019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:01.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.882+0000 7f7ac7800640 1 -- 172.21.15.3:0/123407881 >> 172.21.15.3:0/123407881 conn(0x7f7ac00ffa50 msgr2=0x7f7ac0100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:01.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.883+0000 7f7ac7800640 1 -- 172.21.15.3:0/123407881 shutdown_connections 2024-09-19T06:16:01.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:01.883+0000 7f7ac7800640 1 -- 172.21.15.3:0/123407881 wait complete. 2024-09-19T06:16:02.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:02 smithi003 ceph-mon[30893]: pgmap v112: 97 pgs: 97 active+clean; 4.3 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 KiB/s wr, 15 op/s 2024-09-19T06:16:02.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:02 smithi071 ceph-mon[35662]: pgmap v112: 97 pgs: 97 active+clean; 4.3 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 KiB/s wr, 15 op/s 2024-09-19T06:16:02.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:02 smithi059 ceph-mon[35138]: pgmap v112: 97 pgs: 97 active+clean; 4.3 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 KiB/s wr, 15 op/s 2024-09-19T06:16:02.820 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:16:03.202 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:03.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.811+0000 7fc1c2a00640 1 -- 172.21.15.3:0/2666958769 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1bc109120 msgr2=0x7fc1bc110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:03.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.811+0000 7fc1c2a00640 1 --2- 172.21.15.3:0/2666958769 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1bc109120 0x7fc1bc110ca0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4009ca0 tx=0x7fc1b402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.811+0000 7fc1c2a00640 1 -- 172.21.15.3:0/2666958769 shutdown_connections 2024-09-19T06:16:03.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.811+0000 7fc1c2a00640 1 --2- 172.21.15.3:0/2666958769 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1bc109120 0x7fc1bc110ca0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.811+0000 7fc1c2a00640 1 --2- 172.21.15.3:0/2666958769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1bc1049a0 0x7fc1bc1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.811+0000 7fc1c2a00640 1 --2- 172.21.15.3:0/2666958769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1bc103ff0 0x7fc1bc1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.811+0000 7fc1c2a00640 1 -- 172.21.15.3:0/2666958769 >> 172.21.15.3:0/2666958769 conn(0x7fc1bc0ffa90 msgr2=0x7fc1bc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:03.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.811+0000 7fc1c2a00640 1 -- 172.21.15.3:0/2666958769 shutdown_connections 2024-09-19T06:16:03.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.811+0000 7fc1c2a00640 1 -- 172.21.15.3:0/2666958769 wait complete. 2024-09-19T06:16:03.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.812+0000 7fc1c2a00640 1 Processor -- start 2024-09-19T06:16:03.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.812+0000 7fc1c2a00640 1 -- start start 2024-09-19T06:16:03.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.812+0000 7fc1c2a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1bc103ff0 0x7fc1bc19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:03.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.812+0000 7fc1c2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1bc1049a0 0x7fc1bc19aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:03.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.812+0000 7fc1c2a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1bc109120 0x7fc1bc19ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:03.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.812+0000 7fc1c2a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc1bc114130 con 0x7fc1bc103ff0 2024-09-19T06:16:03.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.812+0000 7fc1c2a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc1bc113fb0 con 0x7fc1bc1049a0 2024-09-19T06:16:03.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.812+0000 7fc1c2a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc1bc1142b0 con 0x7fc1bc109120 2024-09-19T06:16:03.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.812+0000 7fc1bbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1bc103ff0 0x7fc1bc19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:03.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.813+0000 7fc1bbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1bc103ff0 0x7fc1bc19a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54366/0 (socket says 172.21.15.3:54366) 2024-09-19T06:16:03.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.813+0000 7fc1bbe00640 1 -- 172.21.15.3:0/1330270883 learned_addr learned my addr 172.21.15.3:0/1330270883 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:03.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.813+0000 7fc1b3400640 1 --2- 172.21.15.3:0/1330270883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1bc1049a0 0x7fc1bc19aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:03.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.813+0000 7fc1c0a00640 1 --2- 172.21.15.3:0/1330270883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1bc109120 0x7fc1bc19ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:03.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.813+0000 7fc1b3400640 1 -- 172.21.15.3:0/1330270883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1bc109120 msgr2=0x7fc1bc19ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:03.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.813+0000 7fc1b3400640 1 --2- 172.21.15.3:0/1330270883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1bc109120 0x7fc1bc19ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.813+0000 7fc1b3400640 1 -- 172.21.15.3:0/1330270883 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1bc103ff0 msgr2=0x7fc1bc19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:03.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.813+0000 7fc1b3400640 1 --2- 172.21.15.3:0/1330270883 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1bc103ff0 0x7fc1bc19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.813+0000 7fc1b3400640 1 -- 172.21.15.3:0/1330270883 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1bc19f540 con 0x7fc1bc1049a0 2024-09-19T06:16:03.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.813+0000 7fc1bbe00640 1 --2- 172.21.15.3:0/1330270883 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1bc103ff0 0x7fc1bc19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:03.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.813+0000 7fc1b3400640 1 --2- 172.21.15.3:0/1330270883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1bc1049a0 0x7fc1bc19aad0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4005fd0 tx=0x7fc1a400dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:03.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.814+0000 7fc1b9600640 1 -- 172.21.15.3:0/1330270883 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4009c30 con 0x7fc1bc1049a0 2024-09-19T06:16:03.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.814+0000 7fc1c2a00640 1 -- 172.21.15.3:0/1330270883 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1bc19f830 con 0x7fc1bc1049a0 2024-09-19T06:16:03.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.814+0000 7fc1b9600640 1 -- 172.21.15.3:0/1330270883 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1a4009dd0 con 0x7fc1bc1049a0 2024-09-19T06:16:03.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.814+0000 7fc1b9600640 1 -- 172.21.15.3:0/1330270883 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4010460 con 0x7fc1bc1049a0 2024-09-19T06:16:03.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.814+0000 7fc1c2a00640 1 -- 172.21.15.3:0/1330270883 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1bc1a7110 con 0x7fc1bc1049a0 2024-09-19T06:16:03.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.817+0000 7fc1c545c740 1 Processor -- start 2024-09-19T06:16:03.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.817+0000 7fc1b9600640 1 -- 172.21.15.3:0/1330270883 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fc1a4003f50 con 0x7fc1bc1049a0 2024-09-19T06:16:03.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.817+0000 7fc1c545c740 1 -- start start 2024-09-19T06:16:03.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.817+0000 7fc1c545c740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 0x5565d77b9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:03.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.817+0000 7fc1c545c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565d77b9590 0x5565d77c3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:03.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.817+0000 7fc1c545c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565d77c3e50 0x5565d77c6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:03.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.817+0000 7fc1c545c740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5565d771f3e0 con 0x5565d77b8c70 2024-09-19T06:16:03.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.817+0000 7fc1c545c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5565d76c6d80 con 0x5565d77c3e50 2024-09-19T06:16:03.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.817+0000 7fc1c545c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5565d771b3a0 con 0x5565d77b9590 2024-09-19T06:16:03.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.818+0000 7fc1c0a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 0x5565d77b9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:03.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.818+0000 7fc1b3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565d77c3e50 0x5565d77c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:03.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.818+0000 7fc1c0a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 0x5565d77b9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54380/0 (socket says 172.21.15.3:54380) 2024-09-19T06:16:03.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.818+0000 7fc1c0a00640 1 -- 172.21.15.3:0/3095154422 learned_addr learned my addr 172.21.15.3:0/3095154422 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:03.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.818+0000 7fc1bbe00640 1 --2- 172.21.15.3:0/3095154422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565d77b9590 0x5565d77c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:03.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.818+0000 7fc1b3400640 1 -- 172.21.15.3:0/3095154422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565d77b9590 msgr2=0x5565d77c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:03.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.818+0000 7fc1b3400640 1 --2- 172.21.15.3:0/3095154422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565d77b9590 0x5565d77c3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.818+0000 7fc1b3400640 1 -- 172.21.15.3:0/3095154422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 msgr2=0x5565d77b9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:03.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.818+0000 7fc1b3400640 1 --2- 172.21.15.3:0/3095154422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 0x5565d77b9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.818+0000 7fc1b3400640 1 -- 172.21.15.3:0/3095154422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565d76e5ae0 con 0x5565d77c3e50 2024-09-19T06:16:03.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.818+0000 7fc1c0a00640 1 --2- 172.21.15.3:0/3095154422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 0x5565d77b9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:03.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.818+0000 7fc1b3400640 1 --2- 172.21.15.3:0/3095154422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565d77c3e50 0x5565d77c6240 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40cd2b0 tx=0x7fc1a40d3df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9f769763c7e99a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:03.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.819+0000 7fc1b9600640 1 --2- 172.21.15.3:0/1330270883 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc1a00a33b0 0x7fc1a00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:03.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.819+0000 7fc1b1200640 1 -- 172.21.15.3:0/3095154422 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a40df020 con 0x5565d77c3e50 2024-09-19T06:16:03.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.819+0000 7fc1b9600640 1 -- 172.21.15.3:0/1330270883 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fc1a40cfbc0 con 0x7fc1bc1049a0 2024-09-19T06:16:03.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.819+0000 7fc1b1200640 1 -- 172.21.15.3:0/3095154422 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1a409bef0 con 0x5565d77c3e50 2024-09-19T06:16:03.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.819+0000 7fc1b1200640 1 -- 172.21.15.3:0/3095154422 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a409ba30 con 0x5565d77c3e50 2024-09-19T06:16:03.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.819+0000 7fc1c0a00640 1 --2- 172.21.15.3:0/1330270883 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc1a00a33b0 0x7fc1a00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:03.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.820+0000 7fc1c545c740 1 -- 172.21.15.3:0/3095154422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565d77c3e50 msgr2=0x5565d77c6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:03.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.820+0000 7fc1c545c740 1 --2- 172.21.15.3:0/3095154422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565d77c3e50 0x5565d77c6240 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40cd2b0 tx=0x7fc1a40d3df0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.820+0000 7fc1c545c740 1 -- 172.21.15.3:0/3095154422 shutdown_connections 2024-09-19T06:16:03.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.820+0000 7fc1c545c740 1 --2- 172.21.15.3:0/3095154422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565d77c3e50 0x5565d77c6240 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.820+0000 7fc1c545c740 1 --2- 172.21.15.3:0/3095154422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565d77b9590 0x5565d77c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.820+0000 7fc1c545c740 1 --2- 172.21.15.3:0/3095154422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 0x5565d77b9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.820+0000 7fc1c545c740 1 -- 172.21.15.3:0/3095154422 >> 172.21.15.3:0/3095154422 conn(0x5565d77b5200 msgr2=0x5565d77b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:03.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.820+0000 7fc1c0a00640 1 --2- 172.21.15.3:0/1330270883 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc1a00a33b0 0x7fc1a00a5870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4004af0 tx=0x7fc1b4004a80 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:03.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.820+0000 7fc1c545c740 1 -- 172.21.15.3:0/3095154422 shutdown_connections 2024-09-19T06:16:03.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.820+0000 7fc1c545c740 1 -- 172.21.15.3:0/3095154422 wait complete. 2024-09-19T06:16:03.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.821+0000 7fc1c545c740 1 -- start start 2024-09-19T06:16:03.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.821+0000 7fc1c545c740 1 Processor -- start 2024-09-19T06:16:03.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.821+0000 7fc1c545c740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 0x5565d77c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:03.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.821+0000 7fc1c545c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565d77b9590 0x5565d77c1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:03.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.821+0000 7fc1c545c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565d77c3e50 0x5565d77c1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:03.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.821+0000 7fc1c545c740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5565d77c6a20 con 0x5565d77b8c70 2024-09-19T06:16:03.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.821+0000 7fc1c545c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5565d76da0f0 con 0x5565d77b9590 2024-09-19T06:16:03.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.821+0000 7fc1c545c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5565d77c6ba0 con 0x5565d77c3e50 2024-09-19T06:16:03.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.821+0000 7fc1c545c740 10 client.0 _ll_register_callbacks cb 0x5565d76c1bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:03.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.822+0000 7fc1bbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 0x5565d77c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:03.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.822+0000 7fc1b3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565d77b9590 0x5565d77c1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:03.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.822+0000 7fc1b3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565d77b9590 0x5565d77c1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:51456/0 (socket says 172.21.15.3:51456) 2024-09-19T06:16:03.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.822+0000 7fc1b3400640 1 -- 172.21.15.3:0/2241175655 learned_addr learned my addr 172.21.15.3:0/2241175655 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:03.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.822+0000 7fc1c0a00640 1 --2- 172.21.15.3:0/2241175655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565d77c3e50 0x5565d77c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:03.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.822+0000 7fc1bbe00640 1 -- 172.21.15.3:0/2241175655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565d77c3e50 msgr2=0x5565d77c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:03.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.822+0000 7fc1bbe00640 1 --2- 172.21.15.3:0/2241175655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565d77c3e50 0x5565d77c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.822+0000 7fc1bbe00640 1 -- 172.21.15.3:0/2241175655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565d77b9590 msgr2=0x5565d77c1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:03.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.822+0000 7fc1bbe00640 1 --2- 172.21.15.3:0/2241175655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565d77b9590 0x5565d77c1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.822+0000 7fc1bbe00640 1 -- 172.21.15.3:0/2241175655 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565d74903c0 con 0x5565d77b8c70 2024-09-19T06:16:03.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.822+0000 7fc1b3400640 1 --2- 172.21.15.3:0/2241175655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565d77b9590 0x5565d77c1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:03.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.822+0000 7fc1bbe00640 1 --2- 172.21.15.3:0/2241175655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 0x5565d77c0e00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x5565d77b6060 tx=0x7fc1ac00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9173f710664cb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:03.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.822+0000 7fc1a9600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:16:03.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.823+0000 7fc1a9600640 1 -- 172.21.15.3:0/2241175655 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac012110 con 0x5565d77b8c70 2024-09-19T06:16:03.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.823+0000 7fc1a9600640 1 -- 172.21.15.3:0/2241175655 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fc1ac004050 con 0x5565d77b8c70 2024-09-19T06:16:03.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.823+0000 7fc1c545c740 1 -- 172.21.15.3:0/2241175655 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1a409bef0 con 0x5565d77b8c70 2024-09-19T06:16:03.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.823+0000 7fc1a9600640 1 -- 172.21.15.3:0/2241175655 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc1ac0122b0 con 0x5565d77b8c70 2024-09-19T06:16:03.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.823+0000 7fc1c545c740 10 client.16209 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:03.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.823+0000 7fc1c545c740 1 -- 172.21.15.3:0/2241175655 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5565d77d2b80 con 0x5565d77b8c70 2024-09-19T06:16:03.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.823+0000 7fc1a9600640 1 -- 172.21.15.3:0/2241175655 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1a409bef0 con 0x5565d77b8c70 2024-09-19T06:16:03.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.824+0000 7fc1a9600640 1 -- 172.21.15.3:0/2241175655 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc1ac0104c0 con 0x5565d77b8c70 2024-09-19T06:16:03.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.824+0000 7fc1c545c740 10 client.16209 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:03.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.824+0000 7fc1c545c740 10 client.16209 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:16:03.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.824+0000 7fc1c545c740 20 client.16209 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:03.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.824+0000 7fc1c545c740 1 --2- 172.21.15.3:0/2241175655 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5565d77d4040 0x5565d77d6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:03.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.824+0000 7fc1c545c740 4 client.16209 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:03.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.824+0000 7fc1c545c740 1 -- 172.21.15.3:0/2241175655 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565d772c950 con 0x5565d77d4040 2024-09-19T06:16:03.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.824+0000 7fc1b3400640 1 --2- 172.21.15.3:0/2241175655 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5565d77d4040 0x5565d77d6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:03.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.825+0000 7fc1b3400640 1 --2- 172.21.15.3:0/2241175655 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5565d77d4040 0x5565d77d6490 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=af2f847974893882 server_cookie=ee68083f264e65e4 in_seq=0 out_seq=0 2024-09-19T06:16:03.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.825+0000 7fc1a9600640 10 client.16209 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:16:03.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.826+0000 7fc1a9600640 1 -- 172.21.15.3:0/2241175655 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5565d772c950 con 0x5565d77d4040 2024-09-19T06:16:03.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.826+0000 7fc1a9600640 10 client.16209 handle_command_reply: tid=0 2024-09-19T06:16:03.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.826+0000 7fc1c545c740 1 client.16209 shutdown 2024-09-19T06:16:03.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.826+0000 7fc1c545c740 1 -- 172.21.15.3:0/2241175655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 msgr2=0x5565d77c0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:03.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.826+0000 7fc1c545c740 1 --2- 172.21.15.3:0/2241175655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 0x5565d77c0e00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x5565d77b6060 tx=0x7fc1ac00f790 comp rx=0 tx=0).stop 2024-09-19T06:16:03.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.826+0000 7fc1c545c740 1 -- 172.21.15.3:0/2241175655 shutdown_connections 2024-09-19T06:16:03.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.826+0000 7fc1c545c740 1 --2- 172.21.15.3:0/2241175655 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5565d77d4040 0x5565d77d6490 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.826+0000 7fc1c545c740 1 --2- 172.21.15.3:0/2241175655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565d77c3e50 0x5565d77c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.826+0000 7fc1c545c740 1 --2- 172.21.15.3:0/2241175655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565d77b9590 0x5565d77c1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.826+0000 7fc1c545c740 1 --2- 172.21.15.3:0/2241175655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 0x5565d77c0e00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.826+0000 7fc1c545c740 1 -- 172.21.15.3:0/2241175655 >> 172.21.15.3:0/2241175655 conn(0x5565d77b5200 msgr2=0x5565d77baf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:03.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.826+0000 7fc1a9600640 0 client.16209 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:16:03.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.826+0000 7fc1c545c740 1 -- 172.21.15.3:0/2241175655 shutdown_connections 2024-09-19T06:16:03.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.826+0000 7fc1c545c740 1 -- 172.21.15.3:0/2241175655 wait complete. 2024-09-19T06:16:03.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.826+0000 7fc1c545c740 20 client.16209 trim_cache size 0 max 16384 2024-09-19T06:16:03.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.840+0000 7fc1c545c740 1 Processor -- start 2024-09-19T06:16:03.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.840+0000 7fc1c545c740 1 -- start start 2024-09-19T06:16:03.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.841+0000 7fc1c545c740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 0x5565d77b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:03.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.841+0000 7fc1c545c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565d77b9590 0x5565d77dbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:03.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.841+0000 7fc1c545c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565d77c3e50 0x5565d77dc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:03.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.841+0000 7fc1c545c740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc1bc1afb10 con 0x5565d77b8c70 2024-09-19T06:16:03.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.841+0000 7fc1c545c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc1bc1b1650 con 0x5565d77b9590 2024-09-19T06:16:03.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.841+0000 7fc1c545c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc1bc1b01e0 con 0x5565d77c3e50 2024-09-19T06:16:03.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.841+0000 7fc1bbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 0x5565d77b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:03.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.841+0000 7fc1bbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 0x5565d77b55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54392/0 (socket says 172.21.15.3:54392) 2024-09-19T06:16:03.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.841+0000 7fc1b3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565d77b9590 0x5565d77dbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:03.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.841+0000 7fc1bbe00640 1 -- 172.21.15.3:0/1294293505 learned_addr learned my addr 172.21.15.3:0/1294293505 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:03.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.841+0000 7fc1c0a00640 1 --2- 172.21.15.3:0/1294293505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565d77c3e50 0x5565d77dc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:03.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.842+0000 7fc1b3400640 1 -- 172.21.15.3:0/1294293505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565d77c3e50 msgr2=0x5565d77dc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:03.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.842+0000 7fc1b3400640 1 --2- 172.21.15.3:0/1294293505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565d77c3e50 0x5565d77dc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.842+0000 7fc1b3400640 1 -- 172.21.15.3:0/1294293505 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 msgr2=0x5565d77b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:03.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.842+0000 7fc1b3400640 1 --2- 172.21.15.3:0/1294293505 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 0x5565d77b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.842+0000 7fc1b3400640 1 -- 172.21.15.3:0/1294293505 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565d77b93c0 con 0x5565d77b9590 2024-09-19T06:16:03.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.842+0000 7fc1c0a00640 1 --2- 172.21.15.3:0/1294293505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565d77c3e50 0x5565d77dc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:03.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.842+0000 7fc1bbe00640 1 --2- 172.21.15.3:0/1294293505 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 0x5565d77b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:03.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.842+0000 7fc1b3400640 1 --2- 172.21.15.3:0/1294293505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565d77b9590 0x5565d77dbd60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4004650 tx=0x7fc1a40039f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b09cf0925c7b4433 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:03.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.842+0000 7fc1abe00640 1 -- 172.21.15.3:0/1294293505 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a409e020 con 0x5565d77b9590 2024-09-19T06:16:03.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.842+0000 7fc1abe00640 1 -- 172.21.15.3:0/1294293505 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1a409bef0 con 0x5565d77b9590 2024-09-19T06:16:03.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.842+0000 7fc1abe00640 1 -- 172.21.15.3:0/1294293505 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a40df040 con 0x5565d77b9590 2024-09-19T06:16:03.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.843+0000 7fc1c545c740 1 -- 172.21.15.3:0/1294293505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565d77b9590 msgr2=0x5565d77dbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:03.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.843+0000 7fc1c545c740 1 --2- 172.21.15.3:0/1294293505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565d77b9590 0x5565d77dbd60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4004650 tx=0x7fc1a40039f0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.843+0000 7fc1c545c740 1 -- 172.21.15.3:0/1294293505 shutdown_connections 2024-09-19T06:16:03.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.843+0000 7fc1c545c740 1 --2- 172.21.15.3:0/1294293505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565d77c3e50 0x5565d77dc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.843+0000 7fc1c545c740 1 --2- 172.21.15.3:0/1294293505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565d77b9590 0x5565d77dbd60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.843+0000 7fc1c545c740 1 --2- 172.21.15.3:0/1294293505 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 0x5565d77b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.843+0000 7fc1c545c740 1 -- 172.21.15.3:0/1294293505 >> 172.21.15.3:0/1294293505 conn(0x5565d77b5200 msgr2=0x5565d77bfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:03.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.843+0000 7fc1c545c740 1 -- 172.21.15.3:0/1294293505 shutdown_connections 2024-09-19T06:16:03.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.843+0000 7fc1c545c740 1 -- 172.21.15.3:0/1294293505 wait complete. 2024-09-19T06:16:03.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.843+0000 7fc1c545c740 1 -- start start 2024-09-19T06:16:03.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.844+0000 7fc1c545c740 1 Processor -- start 2024-09-19T06:16:03.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.844+0000 7fc1c545c740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 0x5565d77cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:03.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.844+0000 7fc1c545c740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565d77b9590 0x5565d77cc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:03.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.844+0000 7fc1c545c740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565d77c3e50 0x5565d77c7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:03.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.844+0000 7fc1c545c740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc1bc1b0f80 con 0x5565d77b8c70 2024-09-19T06:16:03.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.844+0000 7fc1c545c740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc1bc1b08b0 con 0x5565d77c3e50 2024-09-19T06:16:03.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.844+0000 7fc1c545c740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc1bc1adaf0 con 0x5565d77b9590 2024-09-19T06:16:03.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.844+0000 7fc1c545c740 10 client.0 _ll_register_callbacks cb 0x7fc1ac009cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:03.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.844+0000 7fc1bbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 0x5565d77cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:03.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.845+0000 7fc1c0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565d77c3e50 0x5565d77c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:03.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.845+0000 7fc1b3400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565d77b9590 0x5565d77cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:03.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.845+0000 7fc1bbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 0x5565d77cc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54404/0 (socket says 172.21.15.3:54404) 2024-09-19T06:16:03.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.845+0000 7fc1bbe00640 1 -- 172.21.15.3:0/2801200495 learned_addr learned my addr 172.21.15.3:0/2801200495 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:03.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.845+0000 7fc1bbe00640 1 -- 172.21.15.3:0/2801200495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565d77b9590 msgr2=0x5565d77cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:03.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.845+0000 7fc1bbe00640 1 --2- 172.21.15.3:0/2801200495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565d77b9590 0x5565d77cc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.845+0000 7fc1bbe00640 1 -- 172.21.15.3:0/2801200495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565d77c3e50 msgr2=0x5565d77c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:03.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.845+0000 7fc1bbe00640 1 --2- 172.21.15.3:0/2801200495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565d77c3e50 0x5565d77c7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.845+0000 7fc1bbe00640 1 -- 172.21.15.3:0/2801200495 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565d77c7f80 con 0x5565d77b8c70 2024-09-19T06:16:03.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.845+0000 7fc1b3400640 1 --2- 172.21.15.3:0/2801200495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565d77b9590 0x5565d77cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:03.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.845+0000 7fc1bbe00640 1 --2- 172.21.15.3:0/2801200495 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 0x5565d77cc1d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0108e0 tx=0x7fc1ac00fd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987008cd64e5989 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:03.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.845+0000 7fc1a9600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:16:03.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.846+0000 7fc1a9600640 1 -- 172.21.15.3:0/2801200495 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac029040 con 0x5565d77b8c70 2024-09-19T06:16:03.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.846+0000 7fc1c545c740 1 -- 172.21.15.3:0/2801200495 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1a409bef0 con 0x5565d77b8c70 2024-09-19T06:16:03.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.846+0000 7fc1a9600640 1 -- 172.21.15.3:0/2801200495 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fc1ac0050d0 con 0x5565d77b8c70 2024-09-19T06:16:03.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.846+0000 7fc1a9600640 1 -- 172.21.15.3:0/2801200495 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc1ac03a050 con 0x5565d77b8c70 2024-09-19T06:16:03.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.846+0000 7fc1c545c740 10 client.16215 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:03.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.846+0000 7fc1c545c740 1 -- 172.21.15.3:0/2801200495 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5565d783e9e0 con 0x5565d77b8c70 2024-09-19T06:16:03.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.846+0000 7fc1a9600640 1 -- 172.21.15.3:0/2801200495 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1a409bef0 con 0x5565d77b8c70 2024-09-19T06:16:03.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.846+0000 7fc1a9600640 1 -- 172.21.15.3:0/2801200495 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc1ac035030 con 0x5565d77b8c70 2024-09-19T06:16:03.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.847+0000 7fc1c545c740 10 client.16215 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:03.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.847+0000 7fc1c545c740 10 client.16215 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:16:03.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.847+0000 7fc1c545c740 20 client.16215 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:03.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.847+0000 7fc1c545c740 1 --2- 172.21.15.3:0/2801200495 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5565d783f150 0x5565d7841570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:03.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.847+0000 7fc1c545c740 4 client.16215 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:16:03.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.847+0000 7fc1c545c740 1 -- 172.21.15.3:0/2801200495 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5565d7726e60 con 0x5565d783f150 2024-09-19T06:16:03.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.847+0000 7fc1b3400640 1 --2- 172.21.15.3:0/2801200495 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5565d783f150 0x5565d7841570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:03.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.848+0000 7fc1b3400640 1 --2- 172.21.15.3:0/2801200495 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5565d783f150 0x5565d7841570 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1faee86ea9805f3d server_cookie=48d8a8ee6d1431c3 in_seq=0 out_seq=0 2024-09-19T06:16:03.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.848+0000 7fc1a9600640 10 client.16215 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:16:03.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.848+0000 7fc1a9600640 1 -- 172.21.15.3:0/2801200495 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5565d7726e60 con 0x5565d783f150 2024-09-19T06:16:03.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.848+0000 7fc1a9600640 10 client.16215 handle_command_reply: tid=0 2024-09-19T06:16:03.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.848+0000 7fc1c545c740 1 client.16215 shutdown 2024-09-19T06:16:03.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.848+0000 7fc1c545c740 1 -- 172.21.15.3:0/2801200495 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 msgr2=0x5565d77cc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:03.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.848+0000 7fc1c545c740 1 --2- 172.21.15.3:0/2801200495 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 0x5565d77cc1d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0108e0 tx=0x7fc1ac00fd00 comp rx=0 tx=0).stop 2024-09-19T06:16:03.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.848+0000 7fc1c545c740 1 -- 172.21.15.3:0/2801200495 shutdown_connections 2024-09-19T06:16:03.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.848+0000 7fc1c545c740 1 --2- 172.21.15.3:0/2801200495 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5565d783f150 0x5565d7841570 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.848+0000 7fc1c545c740 1 --2- 172.21.15.3:0/2801200495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5565d77c3e50 0x5565d77c7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.848+0000 7fc1c545c740 1 --2- 172.21.15.3:0/2801200495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5565d77b9590 0x5565d77cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.848+0000 7fc1c545c740 1 --2- 172.21.15.3:0/2801200495 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5565d77b8c70 0x5565d77cc1d0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.848+0000 7fc1c545c740 1 -- 172.21.15.3:0/2801200495 >> 172.21.15.3:0/2801200495 conn(0x5565d77b5200 msgr2=0x5565d77ba710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:03.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.848+0000 7fc1a9600640 0 client.16215 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:16:03.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.848+0000 7fc1c545c740 1 -- 172.21.15.3:0/2801200495 shutdown_connections 2024-09-19T06:16:03.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.848+0000 7fc1c545c740 1 -- 172.21.15.3:0/2801200495 wait complete. 2024-09-19T06:16:03.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.848+0000 7fc1c545c740 20 client.16215 trim_cache size 0 max 16384 2024-09-19T06:16:03.854 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:16:03.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.849+0000 7fc1c2a00640 1 -- 172.21.15.3:0/1330270883 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc1a00a33b0 msgr2=0x7fc1a00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:03.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.849+0000 7fc1c2a00640 1 --2- 172.21.15.3:0/1330270883 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc1a00a33b0 0x7fc1a00a5870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4004af0 tx=0x7fc1b4004a80 comp rx=0 tx=0).stop 2024-09-19T06:16:03.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.849+0000 7fc1c2a00640 1 -- 172.21.15.3:0/1330270883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1bc1049a0 msgr2=0x7fc1bc19aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:03.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.849+0000 7fc1c2a00640 1 --2- 172.21.15.3:0/1330270883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1bc1049a0 0x7fc1bc19aad0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4005fd0 tx=0x7fc1a400dde0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.849+0000 7fc1c2a00640 1 -- 172.21.15.3:0/1330270883 shutdown_connections 2024-09-19T06:16:03.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.849+0000 7fc1c2a00640 1 --2- 172.21.15.3:0/1330270883 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc1a00a33b0 0x7fc1a00a5870 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.849+0000 7fc1c2a00640 1 --2- 172.21.15.3:0/1330270883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc1bc109120 0x7fc1bc19ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.849+0000 7fc1c2a00640 1 --2- 172.21.15.3:0/1330270883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1bc1049a0 0x7fc1bc19aad0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.849+0000 7fc1c2a00640 1 --2- 172.21.15.3:0/1330270883 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc1bc103ff0 0x7fc1bc19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:03.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.849+0000 7fc1c2a00640 1 -- 172.21.15.3:0/1330270883 >> 172.21.15.3:0/1330270883 conn(0x7fc1bc0ffa90 msgr2=0x7fc1bc101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:03.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.849+0000 7fc1c2a00640 1 -- 172.21.15.3:0/1330270883 shutdown_connections 2024-09-19T06:16:03.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:03.850+0000 7fc1c2a00640 1 -- 172.21.15.3:0/1330270883 wait complete. 2024-09-19T06:16:04.508 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:04 smithi003 ceph-mon[30893]: pgmap v113: 97 pgs: 97 active+clean; 4.3 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 KiB/s wr, 15 op/s 2024-09-19T06:16:04.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:04 smithi059 ceph-mon[35138]: pgmap v113: 97 pgs: 97 active+clean; 4.3 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 KiB/s wr, 15 op/s 2024-09-19T06:16:04.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:04 smithi071 ceph-mon[35662]: pgmap v113: 97 pgs: 97 active+clean; 4.3 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 KiB/s wr, 15 op/s 2024-09-19T06:16:04.688 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:16:05.066 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:05.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.636+0000 7fe28ee00640 1 -- 172.21.15.3:0/3442465670 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe288101de0 msgr2=0x7fe2881021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:05.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.636+0000 7fe28ee00640 1 --2- 172.21.15.3:0/3442465670 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe288101de0 0x7fe2881021c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe278009900 tx=0x7fe27802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.637+0000 7fe28ee00640 1 -- 172.21.15.3:0/3442465670 shutdown_connections 2024-09-19T06:16:05.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.637+0000 7fe28ee00640 1 --2- 172.21.15.3:0/3442465670 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe288106f10 0x7fe28810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.637+0000 7fe28ee00640 1 --2- 172.21.15.3:0/3442465670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe288102790 0x7fe2881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.637+0000 7fe28ee00640 1 --2- 172.21.15.3:0/3442465670 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe288101de0 0x7fe2881021c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.637+0000 7fe28ee00640 1 -- 172.21.15.3:0/3442465670 >> 172.21.15.3:0/3442465670 conn(0x7fe2880fd8c0 msgr2=0x7fe2880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:05.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.637+0000 7fe28ee00640 1 -- 172.21.15.3:0/3442465670 shutdown_connections 2024-09-19T06:16:05.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.637+0000 7fe28ee00640 1 -- 172.21.15.3:0/3442465670 wait complete. 2024-09-19T06:16:05.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.638+0000 7fe28ee00640 1 Processor -- start 2024-09-19T06:16:05.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.638+0000 7fe28ee00640 1 -- start start 2024-09-19T06:16:05.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.638+0000 7fe28ee00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe288101de0 0x7fe2880744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.638+0000 7fe28ee00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe288102790 0x7fe288074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.638+0000 7fe28ee00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe288106f10 0x7fe288074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.638+0000 7fe28ee00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe288111f30 con 0x7fe288101de0 2024-09-19T06:16:05.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.638+0000 7fe28ee00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe288111db0 con 0x7fe288102790 2024-09-19T06:16:05.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.638+0000 7fe28ee00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881120b0 con 0x7fe288106f10 2024-09-19T06:16:05.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.638+0000 7fe287e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe288101de0 0x7fe2880744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.639+0000 7fe27f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe288102790 0x7fe288074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.639+0000 7fe28ce00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe288106f10 0x7fe288074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.639+0000 7fe287e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe288101de0 0x7fe2880744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60452/0 (socket says 172.21.15.3:60452) 2024-09-19T06:16:05.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.639+0000 7fe287e00640 1 -- 172.21.15.3:0/2988462082 learned_addr learned my addr 172.21.15.3:0/2988462082 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:05.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.639+0000 7fe27f400640 1 -- 172.21.15.3:0/2988462082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe288106f10 msgr2=0x7fe288074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:05.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.639+0000 7fe27f400640 1 --2- 172.21.15.3:0/2988462082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe288106f10 0x7fe288074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.639+0000 7fe27f400640 1 -- 172.21.15.3:0/2988462082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe288101de0 msgr2=0x7fe2880744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:05.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.639+0000 7fe27f400640 1 --2- 172.21.15.3:0/2988462082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe288101de0 0x7fe2880744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.639+0000 7fe27f400640 1 -- 172.21.15.3:0/2988462082 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2881a6900 con 0x7fe288102790 2024-09-19T06:16:05.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.639+0000 7fe287e00640 1 --2- 172.21.15.3:0/2988462082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe288101de0 0x7fe2880744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:05.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.639+0000 7fe27f400640 1 --2- 172.21.15.3:0/2988462082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe288102790 0x7fe288074a30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe27000e9f0 tx=0x7fe27000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:05.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.640+0000 7fe285600640 1 -- 172.21.15.3:0/2988462082 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27000cd80 con 0x7fe288102790 2024-09-19T06:16:05.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.640+0000 7fe285600640 1 -- 172.21.15.3:0/2988462082 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2700035f0 con 0x7fe288102790 2024-09-19T06:16:05.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.640+0000 7fe28ee00640 1 -- 172.21.15.3:0/2988462082 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2881a6bf0 con 0x7fe288102790 2024-09-19T06:16:05.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.640+0000 7fe285600640 1 -- 172.21.15.3:0/2988462082 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe270010690 con 0x7fe288102790 2024-09-19T06:16:05.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.640+0000 7fe28ee00640 1 -- 172.21.15.3:0/2988462082 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2881a7130 con 0x7fe288102790 2024-09-19T06:16:05.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.644+0000 7fe29188d740 1 Processor -- start 2024-09-19T06:16:05.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.644+0000 7fe29188d740 1 -- start start 2024-09-19T06:16:05.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.644+0000 7fe29188d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6f105c70 0x557c6f106050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.644+0000 7fe29188d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6f106590 0x557c6f110910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.644+0000 7fe29188d740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f110e50 0x557c6f113240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.644+0000 7fe29188d740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557c6f06c3e0 con 0x557c6f110e50 2024-09-19T06:16:05.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.644+0000 7fe29188d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557c6f013d80 con 0x557c6f106590 2024-09-19T06:16:05.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.644+0000 7fe29188d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557c6f0683a0 con 0x557c6f105c70 2024-09-19T06:16:05.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.645+0000 7fe285600640 1 -- 172.21.15.3:0/2988462082 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fe270003b30 con 0x7fe288102790 2024-09-19T06:16:05.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.645+0000 7fe28ce00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6f105c70 0x557c6f106050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.645+0000 7fe287e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6f106590 0x557c6f110910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.645+0000 7fe28ce00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6f105c70 0x557c6f106050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:45672/0 (socket says 172.21.15.3:45672) 2024-09-19T06:16:05.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.645+0000 7fe28ce00640 1 -- 172.21.15.3:0/2095371750 learned_addr learned my addr 172.21.15.3:0/2095371750 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:05.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.645+0000 7fe27f400640 1 --2- 172.21.15.3:0/2095371750 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f110e50 0x557c6f113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.645+0000 7fe287e00640 1 -- 172.21.15.3:0/2095371750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6f105c70 msgr2=0x557c6f106050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:05.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.645+0000 7fe287e00640 1 --2- 172.21.15.3:0/2095371750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6f105c70 0x557c6f106050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.645+0000 7fe287e00640 1 -- 172.21.15.3:0/2095371750 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f110e50 msgr2=0x557c6f113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:05.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.645+0000 7fe287e00640 1 --2- 172.21.15.3:0/2095371750 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f110e50 0x557c6f113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.645+0000 7fe287e00640 1 -- 172.21.15.3:0/2095371750 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c6f032ae0 con 0x557c6f106590 2024-09-19T06:16:05.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.645+0000 7fe27f400640 1 --2- 172.21.15.3:0/2095371750 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f110e50 0x557c6f113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:05.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.646+0000 7fe287e00640 1 --2- 172.21.15.3:0/2095371750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6f106590 0x557c6f110910 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe278009230 tx=0x7fe278005dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff354ea48cab029d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:05.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.646+0000 7fe27d600640 1 -- 172.21.15.3:0/2095371750 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe278040070 con 0x557c6f106590 2024-09-19T06:16:05.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.646+0000 7fe27d600640 1 -- 172.21.15.3:0/2095371750 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe278031970 con 0x557c6f106590 2024-09-19T06:16:05.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.646+0000 7fe27d600640 1 -- 172.21.15.3:0/2095371750 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe278035040 con 0x557c6f106590 2024-09-19T06:16:05.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.646+0000 7fe285600640 1 --2- 172.21.15.3:0/2988462082 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe26c0a33b0 0x7fe26c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.646+0000 7fe285600640 1 -- 172.21.15.3:0/2988462082 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fe2700d0000 con 0x7fe288102790 2024-09-19T06:16:05.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.646+0000 7fe28ce00640 1 --2- 172.21.15.3:0/2988462082 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe26c0a33b0 0x7fe26c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.647+0000 7fe29188d740 1 -- 172.21.15.3:0/2095371750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6f106590 msgr2=0x557c6f110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:05.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.647+0000 7fe29188d740 1 --2- 172.21.15.3:0/2095371750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6f106590 0x557c6f110910 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe278009230 tx=0x7fe278005dd0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.647+0000 7fe29188d740 1 -- 172.21.15.3:0/2095371750 shutdown_connections 2024-09-19T06:16:05.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.647+0000 7fe29188d740 1 --2- 172.21.15.3:0/2095371750 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f110e50 0x557c6f113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.647+0000 7fe29188d740 1 --2- 172.21.15.3:0/2095371750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6f106590 0x557c6f110910 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.647+0000 7fe29188d740 1 --2- 172.21.15.3:0/2095371750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6f105c70 0x557c6f106050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.647+0000 7fe29188d740 1 -- 172.21.15.3:0/2095371750 >> 172.21.15.3:0/2095371750 conn(0x557c6f102200 msgr2=0x557c6f1025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:05.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.647+0000 7fe29188d740 1 -- 172.21.15.3:0/2095371750 shutdown_connections 2024-09-19T06:16:05.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.647+0000 7fe29188d740 1 -- 172.21.15.3:0/2095371750 wait complete. 2024-09-19T06:16:05.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.647+0000 7fe28ce00640 1 --2- 172.21.15.3:0/2988462082 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe26c0a33b0 0x7fe26c0a5870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe280011630 tx=0x7fe280009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:05.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.648+0000 7fe29188d740 1 -- start start 2024-09-19T06:16:05.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.648+0000 7fe29188d740 1 Processor -- start 2024-09-19T06:16:05.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.648+0000 7fe29188d740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f105c70 0x557c6f10dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.648+0000 7fe29188d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6f106590 0x557c6f10e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.648+0000 7fe29188d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6f110e50 0x557c6f10e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.648+0000 7fe29188d740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557c6f113a20 con 0x557c6f105c70 2024-09-19T06:16:05.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.648+0000 7fe29188d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557c6f0270f0 con 0x557c6f110e50 2024-09-19T06:16:05.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.648+0000 7fe29188d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557c6f113ba0 con 0x557c6f106590 2024-09-19T06:16:05.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.648+0000 7fe29188d740 10 client.0 _ll_register_callbacks cb 0x557c6f00ebd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:05.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.649+0000 7fe287e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f105c70 0x557c6f10dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.649+0000 7fe28ce00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6f110e50 0x557c6f10e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.649+0000 7fe27f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6f106590 0x557c6f10e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.649+0000 7fe287e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f105c70 0x557c6f10dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60472/0 (socket says 172.21.15.3:60472) 2024-09-19T06:16:05.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.649+0000 7fe287e00640 1 -- 172.21.15.3:0/3744113436 learned_addr learned my addr 172.21.15.3:0/3744113436 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:05.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.649+0000 7fe27f400640 1 -- 172.21.15.3:0/3744113436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6f110e50 msgr2=0x557c6f10e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:05.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.649+0000 7fe27f400640 1 --2- 172.21.15.3:0/3744113436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6f110e50 0x557c6f10e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.649+0000 7fe27f400640 1 -- 172.21.15.3:0/3744113436 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f105c70 msgr2=0x557c6f10dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:05.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.649+0000 7fe27f400640 1 --2- 172.21.15.3:0/3744113436 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f105c70 0x557c6f10dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.649+0000 7fe27f400640 1 -- 172.21.15.3:0/3744113436 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c6eddd3c0 con 0x557c6f106590 2024-09-19T06:16:05.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.649+0000 7fe27f400640 1 --2- 172.21.15.3:0/3744113436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6f106590 0x557c6f10e230 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe2700cd750 tx=0x7fe27009bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a442cafd2930d9d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:05.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.649+0000 7fe276000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:16:05.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.650+0000 7fe276000640 1 -- 172.21.15.3:0/3744113436 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27009c2e0 con 0x557c6f106590 2024-09-19T06:16:05.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.650+0000 7fe276000640 1 -- 172.21.15.3:0/3744113436 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fe270098950 con 0x557c6f106590 2024-09-19T06:16:05.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.650+0000 7fe29188d740 1 -- 172.21.15.3:0/3744113436 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe278031970 con 0x557c6f106590 2024-09-19T06:16:05.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.650+0000 7fe276000640 1 -- 172.21.15.3:0/3744113436 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe2700a0690 con 0x557c6f106590 2024-09-19T06:16:05.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.650+0000 7fe29188d740 10 client.26272 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:05.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.650+0000 7fe29188d740 1 -- 172.21.15.3:0/3744113436 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557c6f11fa60 con 0x557c6f106590 2024-09-19T06:16:05.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.650+0000 7fe276000640 1 -- 172.21.15.3:0/3744113436 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe278031970 con 0x557c6f106590 2024-09-19T06:16:05.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.650+0000 7fe276000640 1 -- 172.21.15.3:0/3744113436 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe2700d2110 con 0x557c6f106590 2024-09-19T06:16:05.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.650+0000 7fe29188d740 10 client.26272 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:05.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.650+0000 7fe29188d740 10 client.26272 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:16:05.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.650+0000 7fe29188d740 20 client.26272 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:05.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.650+0000 7fe29188d740 1 --2- 172.21.15.3:0/3744113436 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x557c6f120f20 0x557c6f123310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.650+0000 7fe29188d740 4 client.26272 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:05.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.650+0000 7fe29188d740 1 -- 172.21.15.3:0/3744113436 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c6f079950 con 0x557c6f120f20 2024-09-19T06:16:05.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.651+0000 7fe287e00640 1 --2- 172.21.15.3:0/3744113436 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x557c6f120f20 0x557c6f123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.651+0000 7fe287e00640 1 --2- 172.21.15.3:0/3744113436 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x557c6f120f20 0x557c6f123310 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7c82fa1b83da2669 server_cookie=ed62b2bd20022744 in_seq=0 out_seq=0 2024-09-19T06:16:05.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.651+0000 7fe276000640 10 client.26272 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:16:05.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.652+0000 7fe276000640 1 -- 172.21.15.3:0/3744113436 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557c6f079950 con 0x557c6f120f20 2024-09-19T06:16:05.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.652+0000 7fe276000640 10 client.26272 handle_command_reply: tid=0 2024-09-19T06:16:05.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.652+0000 7fe29188d740 1 client.26272 shutdown 2024-09-19T06:16:05.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.652+0000 7fe29188d740 1 -- 172.21.15.3:0/3744113436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6f106590 msgr2=0x557c6f10e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:05.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.652+0000 7fe29188d740 1 --2- 172.21.15.3:0/3744113436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6f106590 0x557c6f10e230 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe2700cd750 tx=0x7fe27009bee0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.652+0000 7fe29188d740 1 -- 172.21.15.3:0/3744113436 shutdown_connections 2024-09-19T06:16:05.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.652+0000 7fe29188d740 1 --2- 172.21.15.3:0/3744113436 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x557c6f120f20 0x557c6f123310 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.652+0000 7fe29188d740 1 --2- 172.21.15.3:0/3744113436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6f110e50 0x557c6f10e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.652+0000 7fe29188d740 1 --2- 172.21.15.3:0/3744113436 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6f106590 0x557c6f10e230 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.652+0000 7fe276000640 0 client.26272 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:16:05.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.652+0000 7fe29188d740 1 --2- 172.21.15.3:0/3744113436 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f105c70 0x557c6f10dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.652+0000 7fe29188d740 1 -- 172.21.15.3:0/3744113436 >> 172.21.15.3:0/3744113436 conn(0x557c6f102200 msgr2=0x557c6f101380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:05.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.653+0000 7fe29188d740 1 -- 172.21.15.3:0/3744113436 shutdown_connections 2024-09-19T06:16:05.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.653+0000 7fe29188d740 1 -- 172.21.15.3:0/3744113436 wait complete. 2024-09-19T06:16:05.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.653+0000 7fe29188d740 20 client.26272 trim_cache size 0 max 16384 2024-09-19T06:16:05.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.666+0000 7fe29188d740 1 Processor -- start 2024-09-19T06:16:05.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.666+0000 7fe29188d740 1 -- start start 2024-09-19T06:16:05.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.667+0000 7fe29188d740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f105c70 0x557c6f10fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.667+0000 7fe29188d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6f106590 0x557c6f128bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.667+0000 7fe29188d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6f110e50 0x557c6f129100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.667+0000 7fe29188d740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881afb30 con 0x557c6f105c70 2024-09-19T06:16:05.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.667+0000 7fe29188d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881b1670 con 0x557c6f110e50 2024-09-19T06:16:05.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.667+0000 7fe29188d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881b0200 con 0x557c6f106590 2024-09-19T06:16:05.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.667+0000 7fe287e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f105c70 0x557c6f10fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.667+0000 7fe287e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f105c70 0x557c6f10fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60486/0 (socket says 172.21.15.3:60486) 2024-09-19T06:16:05.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.667+0000 7fe287e00640 1 -- 172.21.15.3:0/260085254 learned_addr learned my addr 172.21.15.3:0/260085254 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:05.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.667+0000 7fe28ce00640 1 --2- 172.21.15.3:0/260085254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6f110e50 0x557c6f129100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.667+0000 7fe27f400640 1 --2- 172.21.15.3:0/260085254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6f106590 0x557c6f128bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.667+0000 7fe287e00640 1 -- 172.21.15.3:0/260085254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6f106590 msgr2=0x557c6f128bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:05.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.667+0000 7fe287e00640 1 --2- 172.21.15.3:0/260085254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6f106590 0x557c6f128bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.667+0000 7fe287e00640 1 -- 172.21.15.3:0/260085254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6f110e50 msgr2=0x557c6f129100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:05.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.667+0000 7fe287e00640 1 --2- 172.21.15.3:0/260085254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6f110e50 0x557c6f129100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.667+0000 7fe287e00640 1 -- 172.21.15.3:0/260085254 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c6f108ae0 con 0x557c6f105c70 2024-09-19T06:16:05.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.668+0000 7fe287e00640 1 --2- 172.21.15.3:0/260085254 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f105c70 0x557c6f10fc60 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe278009a20 tx=0x7fe2780054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a1c03da4212fda1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:05.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.668+0000 7fe27cc00640 1 -- 172.21.15.3:0/260085254 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe278035040 con 0x557c6f105c70 2024-09-19T06:16:05.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.668+0000 7fe27cc00640 1 -- 172.21.15.3:0/260085254 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2780035f0 con 0x557c6f105c70 2024-09-19T06:16:05.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.668+0000 7fe27cc00640 1 -- 172.21.15.3:0/260085254 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe278040040 con 0x557c6f105c70 2024-09-19T06:16:05.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.669+0000 7fe29188d740 1 -- 172.21.15.3:0/260085254 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f105c70 msgr2=0x557c6f10fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:05.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.669+0000 7fe29188d740 1 --2- 172.21.15.3:0/260085254 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f105c70 0x557c6f10fc60 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe278009a20 tx=0x7fe2780054f0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.669+0000 7fe29188d740 1 -- 172.21.15.3:0/260085254 shutdown_connections 2024-09-19T06:16:05.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.669+0000 7fe29188d740 1 --2- 172.21.15.3:0/260085254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6f110e50 0x557c6f129100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.669+0000 7fe29188d740 1 --2- 172.21.15.3:0/260085254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6f106590 0x557c6f128bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.669+0000 7fe29188d740 1 --2- 172.21.15.3:0/260085254 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f105c70 0x557c6f10fc60 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.669+0000 7fe29188d740 1 -- 172.21.15.3:0/260085254 >> 172.21.15.3:0/260085254 conn(0x557c6f102200 msgr2=0x557c6f10f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:05.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.669+0000 7fe29188d740 1 -- 172.21.15.3:0/260085254 shutdown_connections 2024-09-19T06:16:05.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.669+0000 7fe29188d740 1 -- 172.21.15.3:0/260085254 wait complete. 2024-09-19T06:16:05.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.670+0000 7fe29188d740 1 -- start start 2024-09-19T06:16:05.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.670+0000 7fe29188d740 1 Processor -- start 2024-09-19T06:16:05.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.670+0000 7fe29188d740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f105c70 0x557c6f119310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.670+0000 7fe29188d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6f106590 0x557c6f114640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.670+0000 7fe29188d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6f110e50 0x557c6f114b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.670+0000 7fe29188d740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881b0fa0 con 0x557c6f105c70 2024-09-19T06:16:05.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.670+0000 7fe29188d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881b08d0 con 0x557c6f106590 2024-09-19T06:16:05.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.670+0000 7fe29188d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881adb10 con 0x557c6f110e50 2024-09-19T06:16:05.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.670+0000 7fe29188d740 10 client.0 _ll_register_callbacks cb 0x7fe270003e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:05.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.671+0000 7fe287e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f105c70 0x557c6f119310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.671+0000 7fe27f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6f106590 0x557c6f114640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.671+0000 7fe27f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6f106590 0x557c6f114640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55736/0 (socket says 172.21.15.3:55736) 2024-09-19T06:16:05.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.671+0000 7fe287e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f105c70 0x557c6f119310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60502/0 (socket says 172.21.15.3:60502) 2024-09-19T06:16:05.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.671+0000 7fe27f400640 1 -- 172.21.15.3:0/3416203756 learned_addr learned my addr 172.21.15.3:0/3416203756 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:05.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.671+0000 7fe28ce00640 1 --2- 172.21.15.3:0/3416203756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6f110e50 0x557c6f114b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.671+0000 7fe27f400640 1 -- 172.21.15.3:0/3416203756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6f110e50 msgr2=0x557c6f114b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:05.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.671+0000 7fe27f400640 1 --2- 172.21.15.3:0/3416203756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6f110e50 0x557c6f114b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.671+0000 7fe27f400640 1 -- 172.21.15.3:0/3416203756 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f105c70 msgr2=0x557c6f119310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:05.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.671+0000 7fe27f400640 1 --2- 172.21.15.3:0/3416203756 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f105c70 0x557c6f119310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.671+0000 7fe27f400640 1 -- 172.21.15.3:0/3416203756 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c6f115140 con 0x557c6f106590 2024-09-19T06:16:05.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.671+0000 7fe27f400640 1 --2- 172.21.15.3:0/3416203756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6f106590 0x557c6f114640 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe27001f000 tx=0x7fe2700d36e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8484414bfbe3de2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:05.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.671+0000 7fe276000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:16:05.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.672+0000 7fe276000640 1 -- 172.21.15.3:0/3416203756 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27009c2e0 con 0x557c6f106590 2024-09-19T06:16:05.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.672+0000 7fe276000640 1 -- 172.21.15.3:0/3416203756 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fe2700bc140 con 0x557c6f106590 2024-09-19T06:16:05.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.672+0000 7fe29188d740 1 -- 172.21.15.3:0/3416203756 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2780035f0 con 0x557c6f106590 2024-09-19T06:16:05.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.672+0000 7fe276000640 1 -- 172.21.15.3:0/3416203756 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe270098580 con 0x557c6f106590 2024-09-19T06:16:05.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.672+0000 7fe29188d740 10 client.26276 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:05.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.672+0000 7fe29188d740 1 -- 172.21.15.3:0/3416203756 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557c6f18b960 con 0x557c6f106590 2024-09-19T06:16:05.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.672+0000 7fe276000640 1 -- 172.21.15.3:0/3416203756 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2780035f0 con 0x557c6f106590 2024-09-19T06:16:05.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.673+0000 7fe276000640 1 -- 172.21.15.3:0/3416203756 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe270098030 con 0x557c6f106590 2024-09-19T06:16:05.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.673+0000 7fe29188d740 10 client.26276 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:05.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.673+0000 7fe29188d740 10 client.26276 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:16:05.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.673+0000 7fe29188d740 20 client.26276 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:05.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.673+0000 7fe29188d740 1 --2- 172.21.15.3:0/3416203756 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x557c6f18c110 0x557c6f18e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:05.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.673+0000 7fe29188d740 4 client.26276 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:16:05.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.673+0000 7fe29188d740 1 -- 172.21.15.3:0/3416203756 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557c6f073e60 con 0x557c6f18c110 2024-09-19T06:16:05.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.673+0000 7fe287e00640 1 --2- 172.21.15.3:0/3416203756 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x557c6f18c110 0x557c6f18e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:05.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.674+0000 7fe287e00640 1 --2- 172.21.15.3:0/3416203756 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x557c6f18c110 0x557c6f18e530 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5209fec554441057 server_cookie=352c5e9b133d63a5 in_seq=0 out_seq=0 2024-09-19T06:16:05.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.674+0000 7fe276000640 10 client.26276 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:16:05.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.674+0000 7fe276000640 1 -- 172.21.15.3:0/3416203756 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557c6f073e60 con 0x557c6f18c110 2024-09-19T06:16:05.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.674+0000 7fe276000640 10 client.26276 handle_command_reply: tid=0 2024-09-19T06:16:05.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.674+0000 7fe29188d740 1 client.26276 shutdown 2024-09-19T06:16:05.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.674+0000 7fe29188d740 1 -- 172.21.15.3:0/3416203756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6f106590 msgr2=0x557c6f114640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:05.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.674+0000 7fe29188d740 1 --2- 172.21.15.3:0/3416203756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6f106590 0x557c6f114640 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe27001f000 tx=0x7fe2700d36e0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.674+0000 7fe29188d740 1 -- 172.21.15.3:0/3416203756 shutdown_connections 2024-09-19T06:16:05.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.674+0000 7fe29188d740 1 --2- 172.21.15.3:0/3416203756 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x557c6f18c110 0x557c6f18e530 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.674+0000 7fe29188d740 1 --2- 172.21.15.3:0/3416203756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6f110e50 0x557c6f114b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.674+0000 7fe29188d740 1 --2- 172.21.15.3:0/3416203756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6f106590 0x557c6f114640 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.674+0000 7fe276000640 0 client.26276 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:16:05.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.674+0000 7fe29188d740 1 --2- 172.21.15.3:0/3416203756 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6f105c70 0x557c6f119310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.674+0000 7fe29188d740 1 -- 172.21.15.3:0/3416203756 >> 172.21.15.3:0/3416203756 conn(0x557c6f102200 msgr2=0x557c6f101380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:05.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.674+0000 7fe29188d740 1 -- 172.21.15.3:0/3416203756 shutdown_connections 2024-09-19T06:16:05.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.674+0000 7fe29188d740 1 -- 172.21.15.3:0/3416203756 wait complete. 2024-09-19T06:16:05.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.674+0000 7fe29188d740 20 client.26276 trim_cache size 0 max 16384 2024-09-19T06:16:05.686 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:16:05.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.675+0000 7fe28ee00640 1 -- 172.21.15.3:0/2988462082 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe26c0a33b0 msgr2=0x7fe26c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:05.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.675+0000 7fe28ee00640 1 --2- 172.21.15.3:0/2988462082 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe26c0a33b0 0x7fe26c0a5870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe280011630 tx=0x7fe280009500 comp rx=0 tx=0).stop 2024-09-19T06:16:05.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.675+0000 7fe28ee00640 1 -- 172.21.15.3:0/2988462082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe288102790 msgr2=0x7fe288074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:05.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.675+0000 7fe28ee00640 1 --2- 172.21.15.3:0/2988462082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe288102790 0x7fe288074a30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe27000e9f0 tx=0x7fe27000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.675+0000 7fe28ee00640 1 -- 172.21.15.3:0/2988462082 shutdown_connections 2024-09-19T06:16:05.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.675+0000 7fe28ee00640 1 --2- 172.21.15.3:0/2988462082 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe26c0a33b0 0x7fe26c0a5870 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.675+0000 7fe28ee00640 1 --2- 172.21.15.3:0/2988462082 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe288106f10 0x7fe288074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.675+0000 7fe28ee00640 1 --2- 172.21.15.3:0/2988462082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe288102790 0x7fe288074a30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.675+0000 7fe28ee00640 1 --2- 172.21.15.3:0/2988462082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe288101de0 0x7fe2880744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:05.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.675+0000 7fe28ee00640 1 -- 172.21.15.3:0/2988462082 >> 172.21.15.3:0/2988462082 conn(0x7fe2880fd8c0 msgr2=0x7fe2880fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:05.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.675+0000 7fe28ee00640 1 -- 172.21.15.3:0/2988462082 shutdown_connections 2024-09-19T06:16:05.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:05.675+0000 7fe28ee00640 1 -- 172.21.15.3:0/2988462082 wait complete. 2024-09-19T06:16:06.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:06 smithi003 ceph-mon[30893]: pgmap v114: 97 pgs: 97 active+clean; 4.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 61 KiB/s wr, 36 op/s 2024-09-19T06:16:06.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:06 smithi059 ceph-mon[35138]: pgmap v114: 97 pgs: 97 active+clean; 4.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 61 KiB/s wr, 36 op/s 2024-09-19T06:16:06.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:06 smithi071 ceph-mon[35662]: pgmap v114: 97 pgs: 97 active+clean; 4.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 61 KiB/s wr, 36 op/s 2024-09-19T06:16:06.760 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:16:07.143 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:07.759 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.712+0000 7fed4dc00640 1 -- 172.21.15.3:0/1321875495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed48074eb0 msgr2=0x7fed48112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:07.759 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.712+0000 7fed4dc00640 1 --2- 172.21.15.3:0/1321875495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed48074eb0 0x7fed48112650 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fed30009900 tx=0x7fed3002a490 comp rx=0 tx=0).stop 2024-09-19T06:16:07.759 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.712+0000 7fed4dc00640 1 -- 172.21.15.3:0/1321875495 shutdown_connections 2024-09-19T06:16:07.759 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.712+0000 7fed4dc00640 1 --2- 172.21.15.3:0/1321875495 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed48112b90 0x7fed48114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.759 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.712+0000 7fed4dc00640 1 --2- 172.21.15.3:0/1321875495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed48074eb0 0x7fed48112650 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.759 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.712+0000 7fed4dc00640 1 --2- 172.21.15.3:0/1321875495 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed48074590 0x7fed48074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.759 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.712+0000 7fed4dc00640 1 -- 172.21.15.3:0/1321875495 >> 172.21.15.3:0/1321875495 conn(0x7fed480fd8c0 msgr2=0x7fed480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:07.759 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.712+0000 7fed4dc00640 1 -- 172.21.15.3:0/1321875495 shutdown_connections 2024-09-19T06:16:07.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.712+0000 7fed4dc00640 1 -- 172.21.15.3:0/1321875495 wait complete. 2024-09-19T06:16:07.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.713+0000 7fed4dc00640 1 Processor -- start 2024-09-19T06:16:07.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.713+0000 7fed4dc00640 1 -- start start 2024-09-19T06:16:07.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.713+0000 7fed4dc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed48074590 0x7fed481a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:07.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.713+0000 7fed4dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed48074eb0 0x7fed481a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:07.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.713+0000 7fed4dc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed48112b90 0x7fed4819e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:07.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.713+0000 7fed4dc00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fed481185b0 con 0x7fed48112b90 2024-09-19T06:16:07.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.713+0000 7fed4dc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fed48118430 con 0x7fed48074eb0 2024-09-19T06:16:07.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.713+0000 7fed4dc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fed48118730 con 0x7fed48074590 2024-09-19T06:16:07.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.714+0000 7fed3fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed48074eb0 0x7fed481a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:07.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.714+0000 7fed47400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed48112b90 0x7fed4819e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:07.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.714+0000 7fed3fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed48074eb0 0x7fed481a4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55756/0 (socket says 172.21.15.3:55756) 2024-09-19T06:16:07.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.714+0000 7fed3fe00640 1 -- 172.21.15.3:0/3843960073 learned_addr learned my addr 172.21.15.3:0/3843960073 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:07.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.714+0000 7fed46a00640 1 --2- 172.21.15.3:0/3843960073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed48074590 0x7fed481a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:07.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.714+0000 7fed3fe00640 1 -- 172.21.15.3:0/3843960073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed48074590 msgr2=0x7fed481a4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:07.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.714+0000 7fed3fe00640 1 --2- 172.21.15.3:0/3843960073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed48074590 0x7fed481a4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.714+0000 7fed3fe00640 1 -- 172.21.15.3:0/3843960073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed48112b90 msgr2=0x7fed4819e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:07.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.714+0000 7fed3fe00640 1 --2- 172.21.15.3:0/3843960073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed48112b90 0x7fed4819e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.714+0000 7fed3fe00640 1 -- 172.21.15.3:0/3843960073 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4819f070 con 0x7fed48074eb0 2024-09-19T06:16:07.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.714+0000 7fed3fe00640 1 --2- 172.21.15.3:0/3843960073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed48074eb0 0x7fed481a4cc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fed30004770 tx=0x7fed30003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:07.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.715+0000 7fed3f400640 1 -- 172.21.15.3:0/3843960073 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3003f070 con 0x7fed48074eb0 2024-09-19T06:16:07.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.715+0000 7fed3f400640 1 -- 172.21.15.3:0/3843960073 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed30031ca0 con 0x7fed48074eb0 2024-09-19T06:16:07.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.715+0000 7fed3f400640 1 -- 172.21.15.3:0/3843960073 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30035030 con 0x7fed48074eb0 2024-09-19T06:16:07.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.715+0000 7fed4dc00640 1 -- 172.21.15.3:0/3843960073 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed4819f300 con 0x7fed48074eb0 2024-09-19T06:16:07.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.715+0000 7fed4dc00640 1 -- 172.21.15.3:0/3843960073 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed481ab650 con 0x7fed48074eb0 2024-09-19T06:16:07.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.718+0000 7fed5069a740 1 Processor -- start 2024-09-19T06:16:07.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.718+0000 7fed5069a740 1 -- start start 2024-09-19T06:16:07.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.718+0000 7fed5069a740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56451749cc70 0x56451749d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:07.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.718+0000 7fed5069a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56451749d590 0x5645174a7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:07.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.718+0000 7fed5069a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645174a7e50 0x5645174aa240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:07.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.718+0000 7fed5069a740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5645174033e0 con 0x56451749cc70 2024-09-19T06:16:07.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.718+0000 7fed5069a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5645173aad80 con 0x5645174a7e50 2024-09-19T06:16:07.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.718+0000 7fed5069a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5645173ff3a0 con 0x56451749d590 2024-09-19T06:16:07.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.718+0000 7fed3f400640 1 -- 172.21.15.3:0/3843960073 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fed30042070 con 0x7fed48074eb0 2024-09-19T06:16:07.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.719+0000 7fed47400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56451749cc70 0x56451749d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:07.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.719+0000 7fed46a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56451749d590 0x5645174a7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:07.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.719+0000 7fed46a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56451749d590 0x5645174a7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:45732/0 (socket says 172.21.15.3:45732) 2024-09-19T06:16:07.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.719+0000 7fed47400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56451749cc70 0x56451749d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60524/0 (socket says 172.21.15.3:60524) 2024-09-19T06:16:07.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.719+0000 7fed46a00640 1 -- 172.21.15.3:0/2283514141 learned_addr learned my addr 172.21.15.3:0/2283514141 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:07.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.719+0000 7fed3fe00640 1 --2- 172.21.15.3:0/2283514141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645174a7e50 0x5645174aa240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:07.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.719+0000 7fed46a00640 1 -- 172.21.15.3:0/2283514141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645174a7e50 msgr2=0x5645174aa240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:07.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.719+0000 7fed46a00640 1 --2- 172.21.15.3:0/2283514141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645174a7e50 0x5645174aa240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.719+0000 7fed46a00640 1 -- 172.21.15.3:0/2283514141 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56451749cc70 msgr2=0x56451749d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:07.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.719+0000 7fed46a00640 1 --2- 172.21.15.3:0/2283514141 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56451749cc70 0x56451749d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.719+0000 7fed46a00640 1 -- 172.21.15.3:0/2283514141 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645173c9ae0 con 0x56451749d590 2024-09-19T06:16:07.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.719+0000 7fed47400640 1 --2- 172.21.15.3:0/2283514141 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56451749cc70 0x56451749d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:07.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.719+0000 7fed46a00640 1 --2- 172.21.15.3:0/2283514141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56451749d590 0x5645174a7910 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fed38009c90 tx=0x7fed38011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a11eade245db9bc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:07.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.720+0000 7fed37e00640 1 -- 172.21.15.3:0/2283514141 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed38005220 con 0x56451749d590 2024-09-19T06:16:07.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.720+0000 7fed37e00640 1 -- 172.21.15.3:0/2283514141 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed38004c80 con 0x56451749d590 2024-09-19T06:16:07.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.720+0000 7fed37e00640 1 -- 172.21.15.3:0/2283514141 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed380198d0 con 0x56451749d590 2024-09-19T06:16:07.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.720+0000 7fed3f400640 1 --2- 172.21.15.3:0/3843960073 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fed2c0a33b0 0x7fed2c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:07.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.720+0000 7fed3f400640 1 -- 172.21.15.3:0/3843960073 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fed300efff0 con 0x7fed48074eb0 2024-09-19T06:16:07.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.720+0000 7fed47400640 1 --2- 172.21.15.3:0/3843960073 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fed2c0a33b0 0x7fed2c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:07.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.721+0000 7fed5069a740 1 -- 172.21.15.3:0/2283514141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56451749d590 msgr2=0x5645174a7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:07.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.721+0000 7fed5069a740 1 --2- 172.21.15.3:0/2283514141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56451749d590 0x5645174a7910 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fed38009c90 tx=0x7fed38011810 comp rx=0 tx=0).stop 2024-09-19T06:16:07.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.721+0000 7fed5069a740 1 -- 172.21.15.3:0/2283514141 shutdown_connections 2024-09-19T06:16:07.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.721+0000 7fed5069a740 1 --2- 172.21.15.3:0/2283514141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645174a7e50 0x5645174aa240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.721+0000 7fed5069a740 1 --2- 172.21.15.3:0/2283514141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56451749d590 0x5645174a7910 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.721+0000 7fed5069a740 1 --2- 172.21.15.3:0/2283514141 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56451749cc70 0x56451749d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.721+0000 7fed5069a740 1 -- 172.21.15.3:0/2283514141 >> 172.21.15.3:0/2283514141 conn(0x564517499200 msgr2=0x5645174995e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:07.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.721+0000 7fed5069a740 1 -- 172.21.15.3:0/2283514141 shutdown_connections 2024-09-19T06:16:07.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.721+0000 7fed5069a740 1 -- 172.21.15.3:0/2283514141 wait complete. 2024-09-19T06:16:07.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.721+0000 7fed47400640 1 --2- 172.21.15.3:0/3843960073 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fed2c0a33b0 0x7fed2c0a5870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fed40009fd0 tx=0x7fed40009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:07.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.721+0000 7fed5069a740 1 -- start start 2024-09-19T06:16:07.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.722+0000 7fed5069a740 1 Processor -- start 2024-09-19T06:16:07.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.722+0000 7fed5069a740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56451749cc70 0x5645174a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:07.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.722+0000 7fed5069a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56451749d590 0x5645174a5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:07.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.722+0000 7fed5069a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645174a7e50 0x5645174a5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:07.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.722+0000 7fed5069a740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5645174aaa20 con 0x56451749cc70 2024-09-19T06:16:07.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.722+0000 7fed5069a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5645173be0f0 con 0x5645174a7e50 2024-09-19T06:16:07.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.722+0000 7fed5069a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5645174aaba0 con 0x56451749d590 2024-09-19T06:16:07.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.722+0000 7fed5069a740 10 client.0 _ll_register_callbacks cb 0x5645173a5bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:07.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.722+0000 7fed47400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645174a7e50 0x5645174a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:07.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.722+0000 7fed46a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56451749cc70 0x5645174a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:07.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.722+0000 7fed3fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56451749d590 0x5645174a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:07.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.722+0000 7fed47400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645174a7e50 0x5645174a5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55774/0 (socket says 172.21.15.3:55774) 2024-09-19T06:16:07.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.723+0000 7fed47400640 1 -- 172.21.15.3:0/4156585586 learned_addr learned my addr 172.21.15.3:0/4156585586 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:07.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.723+0000 7fed46a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56451749cc70 0x5645174a4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60530/0 (socket says 172.21.15.3:60530) 2024-09-19T06:16:07.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.723+0000 7fed3fe00640 1 -- 172.21.15.3:0/4156585586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645174a7e50 msgr2=0x5645174a5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:07.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.723+0000 7fed3fe00640 1 --2- 172.21.15.3:0/4156585586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645174a7e50 0x5645174a5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.723+0000 7fed3fe00640 1 -- 172.21.15.3:0/4156585586 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56451749cc70 msgr2=0x5645174a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:07.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.723+0000 7fed3fe00640 1 --2- 172.21.15.3:0/4156585586 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56451749cc70 0x5645174a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.723+0000 7fed3fe00640 1 -- 172.21.15.3:0/4156585586 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645171743c0 con 0x56451749d590 2024-09-19T06:16:07.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.723+0000 7fed3fe00640 1 --2- 172.21.15.3:0/4156585586 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56451749d590 0x5645174a5200 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fed300ed6e0 tx=0x7fed3002a490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3994681c162d2a74 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:07.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.723+0000 7fed34c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:16:07.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.723+0000 7fed34c00640 1 -- 172.21.15.3:0/4156585586 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30049030 con 0x56451749d590 2024-09-19T06:16:07.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.723+0000 7fed5069a740 1 -- 172.21.15.3:0/4156585586 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed38004c80 con 0x56451749d590 2024-09-19T06:16:07.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.723+0000 7fed34c00640 1 -- 172.21.15.3:0/4156585586 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fed3003b4f0 con 0x56451749d590 2024-09-19T06:16:07.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.724+0000 7fed34c00640 1 -- 172.21.15.3:0/4156585586 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fed300bbd40 con 0x56451749d590 2024-09-19T06:16:07.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.724+0000 7fed5069a740 10 client.26290 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:07.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.724+0000 7fed5069a740 1 -- 172.21.15.3:0/4156585586 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5645174aaa80 con 0x56451749d590 2024-09-19T06:16:07.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.724+0000 7fed34c00640 1 -- 172.21.15.3:0/4156585586 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed38004c80 con 0x56451749d590 2024-09-19T06:16:07.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.724+0000 7fed34c00640 1 -- 172.21.15.3:0/4156585586 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fed300ed960 con 0x56451749d590 2024-09-19T06:16:07.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.724+0000 7fed5069a740 10 client.26290 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:07.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.724+0000 7fed5069a740 10 client.26290 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:07.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.724+0000 7fed5069a740 20 client.26290 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:07.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.724+0000 7fed5069a740 1 --2- 172.21.15.3:0/4156585586 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5645174b7c20 0x5645174ba040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:07.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.724+0000 7fed5069a740 4 client.26290 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:07.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.724+0000 7fed5069a740 1 -- 172.21.15.3:0/4156585586 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564517410950 con 0x5645174b7c20 2024-09-19T06:16:07.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.725+0000 7fed46a00640 1 --2- 172.21.15.3:0/4156585586 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5645174b7c20 0x5645174ba040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:07.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.725+0000 7fed46a00640 1 --2- 172.21.15.3:0/4156585586 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5645174b7c20 0x5645174ba040 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58e2e090ca807eb0 server_cookie=595e4f2897c5fd79 in_seq=0 out_seq=0 2024-09-19T06:16:07.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.725+0000 7fed34c00640 10 client.26290 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:07.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.726+0000 7fed34c00640 1 -- 172.21.15.3:0/4156585586 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564517410950 con 0x5645174b7c20 2024-09-19T06:16:07.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.726+0000 7fed34c00640 10 client.26290 handle_command_reply: tid=0 2024-09-19T06:16:07.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.726+0000 7fed5069a740 1 client.26290 shutdown 2024-09-19T06:16:07.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.726+0000 7fed5069a740 1 -- 172.21.15.3:0/4156585586 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56451749d590 msgr2=0x5645174a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:07.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.726+0000 7fed5069a740 1 --2- 172.21.15.3:0/4156585586 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56451749d590 0x5645174a5200 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fed300ed6e0 tx=0x7fed3002a490 comp rx=0 tx=0).stop 2024-09-19T06:16:07.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.726+0000 7fed5069a740 1 -- 172.21.15.3:0/4156585586 shutdown_connections 2024-09-19T06:16:07.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.726+0000 7fed5069a740 1 --2- 172.21.15.3:0/4156585586 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5645174b7c20 0x5645174ba040 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.726+0000 7fed5069a740 1 --2- 172.21.15.3:0/4156585586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645174a7e50 0x5645174a5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.726+0000 7fed5069a740 1 --2- 172.21.15.3:0/4156585586 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56451749d590 0x5645174a5200 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.726+0000 7fed34c00640 0 client.26290 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:07.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.726+0000 7fed5069a740 1 --2- 172.21.15.3:0/4156585586 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56451749cc70 0x5645174a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.726+0000 7fed5069a740 1 -- 172.21.15.3:0/4156585586 >> 172.21.15.3:0/4156585586 conn(0x564517499200 msgr2=0x564517498380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:07.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.726+0000 7fed5069a740 1 -- 172.21.15.3:0/4156585586 shutdown_connections 2024-09-19T06:16:07.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.726+0000 7fed5069a740 1 -- 172.21.15.3:0/4156585586 wait complete. 2024-09-19T06:16:07.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.727+0000 7fed5069a740 20 client.26290 trim_cache size 0 max 16384 2024-09-19T06:16:07.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.740+0000 7fed5069a740 1 Processor -- start 2024-09-19T06:16:07.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.740+0000 7fed5069a740 1 -- start start 2024-09-19T06:16:07.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.741+0000 7fed5069a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56451749cc70 0x5645174bf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:07.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.741+0000 7fed5069a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56451749d590 0x5645174bfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:07.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.741+0000 7fed5069a740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645174a7e50 0x5645174a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:07.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.741+0000 7fed5069a740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fed481b3f50 con 0x5645174a7e50 2024-09-19T06:16:07.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.741+0000 7fed5069a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fed481b5a90 con 0x56451749d590 2024-09-19T06:16:07.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.741+0000 7fed5069a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fed481b4620 con 0x56451749cc70 2024-09-19T06:16:07.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.741+0000 7fed47400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645174a7e50 0x5645174a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:07.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.741+0000 7fed47400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645174a7e50 0x5645174a1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60532/0 (socket says 172.21.15.3:60532) 2024-09-19T06:16:07.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.741+0000 7fed47400640 1 -- 172.21.15.3:0/1875820809 learned_addr learned my addr 172.21.15.3:0/1875820809 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:07.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.741+0000 7fed3fe00640 1 --2- 172.21.15.3:0/1875820809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56451749d590 0x5645174bfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:07.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.741+0000 7fed46a00640 1 --2- 172.21.15.3:0/1875820809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56451749cc70 0x5645174bf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:07.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.741+0000 7fed47400640 1 -- 172.21.15.3:0/1875820809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56451749cc70 msgr2=0x5645174bf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:07.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.741+0000 7fed47400640 1 --2- 172.21.15.3:0/1875820809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56451749cc70 0x5645174bf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.741+0000 7fed47400640 1 -- 172.21.15.3:0/1875820809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56451749d590 msgr2=0x5645174bfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:07.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.741+0000 7fed47400640 1 --2- 172.21.15.3:0/1875820809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56451749d590 0x5645174bfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.742+0000 7fed47400640 1 -- 172.21.15.3:0/1875820809 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56451749dbb0 con 0x5645174a7e50 2024-09-19T06:16:07.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.742+0000 7fed3fe00640 1 --2- 172.21.15.3:0/1875820809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56451749d590 0x5645174bfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:07.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.742+0000 7fed47400640 1 --2- 172.21.15.3:0/1875820809 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645174a7e50 0x5645174a1f20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fed4000f670 tx=0x7fed40019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48783502f5e12ccd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:07.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.742+0000 7fed37400640 1 -- 172.21.15.3:0/1875820809 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40003a30 con 0x5645174a7e50 2024-09-19T06:16:07.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.742+0000 7fed37400640 1 -- 172.21.15.3:0/1875820809 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed40003bd0 con 0x5645174a7e50 2024-09-19T06:16:07.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.742+0000 7fed37400640 1 -- 172.21.15.3:0/1875820809 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40010a30 con 0x5645174a7e50 2024-09-19T06:16:07.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.743+0000 7fed5069a740 1 -- 172.21.15.3:0/1875820809 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645174a7e50 msgr2=0x5645174a1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:07.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.743+0000 7fed5069a740 1 --2- 172.21.15.3:0/1875820809 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645174a7e50 0x5645174a1f20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fed4000f670 tx=0x7fed40019000 comp rx=0 tx=0).stop 2024-09-19T06:16:07.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.743+0000 7fed5069a740 1 -- 172.21.15.3:0/1875820809 shutdown_connections 2024-09-19T06:16:07.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.743+0000 7fed5069a740 1 --2- 172.21.15.3:0/1875820809 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645174a7e50 0x5645174a1f20 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.743+0000 7fed5069a740 1 --2- 172.21.15.3:0/1875820809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56451749d590 0x5645174bfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.743+0000 7fed5069a740 1 --2- 172.21.15.3:0/1875820809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56451749cc70 0x5645174bf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.743+0000 7fed5069a740 1 -- 172.21.15.3:0/1875820809 >> 172.21.15.3:0/1875820809 conn(0x564517499200 msgr2=0x5645174a6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:07.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.743+0000 7fed5069a740 1 -- 172.21.15.3:0/1875820809 shutdown_connections 2024-09-19T06:16:07.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.743+0000 7fed5069a740 1 -- 172.21.15.3:0/1875820809 wait complete. 2024-09-19T06:16:07.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.743+0000 7fed5069a740 1 -- start start 2024-09-19T06:16:07.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.743+0000 7fed5069a740 1 Processor -- start 2024-09-19T06:16:07.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.744+0000 7fed5069a740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56451749cc70 0x5645174ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:07.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.744+0000 7fed5069a740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56451749d590 0x5645174acc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:07.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.744+0000 7fed5069a740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645174a7e50 0x56451751a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:07.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.744+0000 7fed5069a740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fed481b53c0 con 0x5645174a7e50 2024-09-19T06:16:07.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.744+0000 7fed5069a740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fed481b4cf0 con 0x56451749cc70 2024-09-19T06:16:07.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.744+0000 7fed5069a740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fed481b1f30 con 0x56451749d590 2024-09-19T06:16:07.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.744+0000 7fed5069a740 10 client.0 _ll_register_callbacks cb 0x7fed300b6f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:07.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.744+0000 7fed47400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645174a7e50 0x56451751a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:07.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.744+0000 7fed47400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645174a7e50 0x56451751a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60544/0 (socket says 172.21.15.3:60544) 2024-09-19T06:16:07.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.744+0000 7fed47400640 1 -- 172.21.15.3:0/2547169820 learned_addr learned my addr 172.21.15.3:0/2547169820 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:07.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.744+0000 7fed3fe00640 1 --2- 172.21.15.3:0/2547169820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56451749d590 0x5645174acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:07.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.744+0000 7fed46a00640 1 --2- 172.21.15.3:0/2547169820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56451749cc70 0x5645174ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:07.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.745+0000 7fed47400640 1 -- 172.21.15.3:0/2547169820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56451749d590 msgr2=0x5645174acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:07.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.745+0000 7fed47400640 1 --2- 172.21.15.3:0/2547169820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56451749d590 0x5645174acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.745+0000 7fed47400640 1 -- 172.21.15.3:0/2547169820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56451749cc70 msgr2=0x5645174ac6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:07.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.745+0000 7fed47400640 1 --2- 172.21.15.3:0/2547169820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56451749cc70 0x5645174ac6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.745+0000 7fed47400640 1 -- 172.21.15.3:0/2547169820 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564517494770 con 0x5645174a7e50 2024-09-19T06:16:07.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.745+0000 7fed3fe00640 1 --2- 172.21.15.3:0/2547169820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56451749d590 0x5645174acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:07.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.745+0000 7fed47400640 1 --2- 172.21.15.3:0/2547169820 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645174a7e50 0x56451751a8a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fed40011260 tx=0x7fed40005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=950bdafd267f288f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:07.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.745+0000 7fed34c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:16:07.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.745+0000 7fed34c00640 1 -- 172.21.15.3:0/2547169820 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40004250 con 0x5645174a7e50 2024-09-19T06:16:07.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.745+0000 7fed34c00640 1 -- 172.21.15.3:0/2547169820 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fed400043f0 con 0x5645174a7e50 2024-09-19T06:16:07.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.745+0000 7fed5069a740 1 -- 172.21.15.3:0/2547169820 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed40003bd0 con 0x5645174a7e50 2024-09-19T06:16:07.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.746+0000 7fed34c00640 1 -- 172.21.15.3:0/2547169820 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fed4003a050 con 0x5645174a7e50 2024-09-19T06:16:07.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.746+0000 7fed5069a740 10 client.16251 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:07.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.746+0000 7fed5069a740 1 -- 172.21.15.3:0/2547169820 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5645174aa900 con 0x5645174a7e50 2024-09-19T06:16:07.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.746+0000 7fed34c00640 1 -- 172.21.15.3:0/2547169820 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed40003bd0 con 0x5645174a7e50 2024-09-19T06:16:07.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.746+0000 7fed34c00640 1 -- 172.21.15.3:0/2547169820 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fed400294a0 con 0x5645174a7e50 2024-09-19T06:16:07.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.746+0000 7fed5069a740 10 client.16251 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:07.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.746+0000 7fed5069a740 10 client.16251 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:07.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.746+0000 7fed5069a740 20 client.16251 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:07.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.746+0000 7fed5069a740 1 --2- 172.21.15.3:0/2547169820 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5645175236d0 0x564517525ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:07.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.746+0000 7fed5069a740 4 client.16251 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:16:07.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.746+0000 7fed5069a740 1 -- 172.21.15.3:0/2547169820 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56451740ae60 con 0x5645175236d0 2024-09-19T06:16:07.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.747+0000 7fed46a00640 1 --2- 172.21.15.3:0/2547169820 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5645175236d0 0x564517525ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:07.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.747+0000 7fed46a00640 1 --2- 172.21.15.3:0/2547169820 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5645175236d0 0x564517525ac0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f48611dcc9e90dd7 server_cookie=a90a21e50c48b5c7 in_seq=0 out_seq=0 2024-09-19T06:16:07.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.747+0000 7fed34c00640 10 client.16251 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:07.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.747+0000 7fed34c00640 1 -- 172.21.15.3:0/2547169820 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56451740ae60 con 0x5645175236d0 2024-09-19T06:16:07.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.747+0000 7fed34c00640 10 client.16251 handle_command_reply: tid=0 2024-09-19T06:16:07.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.747+0000 7fed5069a740 1 client.16251 shutdown 2024-09-19T06:16:07.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.747+0000 7fed5069a740 1 -- 172.21.15.3:0/2547169820 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645174a7e50 msgr2=0x56451751a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:07.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.747+0000 7fed5069a740 1 --2- 172.21.15.3:0/2547169820 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645174a7e50 0x56451751a8a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fed40011260 tx=0x7fed40005a50 comp rx=0 tx=0).stop 2024-09-19T06:16:07.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.748+0000 7fed5069a740 1 -- 172.21.15.3:0/2547169820 shutdown_connections 2024-09-19T06:16:07.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.748+0000 7fed5069a740 1 --2- 172.21.15.3:0/2547169820 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5645175236d0 0x564517525ac0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.748+0000 7fed5069a740 1 --2- 172.21.15.3:0/2547169820 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5645174a7e50 0x56451751a8a0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.748+0000 7fed5069a740 1 --2- 172.21.15.3:0/2547169820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56451749d590 0x5645174acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.748+0000 7fed34c00640 0 client.16251 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:07.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.748+0000 7fed5069a740 1 --2- 172.21.15.3:0/2547169820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56451749cc70 0x5645174ac6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.748+0000 7fed5069a740 1 -- 172.21.15.3:0/2547169820 >> 172.21.15.3:0/2547169820 conn(0x564517499200 msgr2=0x56451749e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:07.775 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:16:07.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.748+0000 7fed5069a740 1 -- 172.21.15.3:0/2547169820 shutdown_connections 2024-09-19T06:16:07.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.748+0000 7fed5069a740 1 -- 172.21.15.3:0/2547169820 wait complete. 2024-09-19T06:16:07.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.748+0000 7fed5069a740 20 client.16251 trim_cache size 0 max 16384 2024-09-19T06:16:07.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.748+0000 7fed4dc00640 1 -- 172.21.15.3:0/3843960073 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fed2c0a33b0 msgr2=0x7fed2c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:07.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.748+0000 7fed4dc00640 1 --2- 172.21.15.3:0/3843960073 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fed2c0a33b0 0x7fed2c0a5870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fed40009fd0 tx=0x7fed40009500 comp rx=0 tx=0).stop 2024-09-19T06:16:07.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.748+0000 7fed4dc00640 1 -- 172.21.15.3:0/3843960073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed48074eb0 msgr2=0x7fed481a4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:07.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.748+0000 7fed4dc00640 1 --2- 172.21.15.3:0/3843960073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed48074eb0 0x7fed481a4cc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fed30004770 tx=0x7fed30003c10 comp rx=0 tx=0).stop 2024-09-19T06:16:07.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.749+0000 7fed4dc00640 1 -- 172.21.15.3:0/3843960073 shutdown_connections 2024-09-19T06:16:07.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.749+0000 7fed4dc00640 1 --2- 172.21.15.3:0/3843960073 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fed2c0a33b0 0x7fed2c0a5870 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.749+0000 7fed4dc00640 1 --2- 172.21.15.3:0/3843960073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fed48112b90 0x7fed4819e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.749+0000 7fed4dc00640 1 --2- 172.21.15.3:0/3843960073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed48074eb0 0x7fed481a4cc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.749+0000 7fed4dc00640 1 --2- 172.21.15.3:0/3843960073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fed48074590 0x7fed481a4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:07.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.749+0000 7fed4dc00640 1 -- 172.21.15.3:0/3843960073 >> 172.21.15.3:0/3843960073 conn(0x7fed480fd8c0 msgr2=0x7fed480ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:07.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.749+0000 7fed4dc00640 1 -- 172.21.15.3:0/3843960073 shutdown_connections 2024-09-19T06:16:07.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:07.749+0000 7fed4dc00640 1 -- 172.21.15.3:0/3843960073 wait complete. 2024-09-19T06:16:08.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:08 smithi059 ceph-mon[35138]: pgmap v115: 97 pgs: 97 active+clean; 4.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 49 KiB/s wr, 29 op/s 2024-09-19T06:16:08.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:08 smithi003 ceph-mon[30893]: pgmap v115: 97 pgs: 97 active+clean; 4.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 49 KiB/s wr, 29 op/s 2024-09-19T06:16:08.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:08 smithi071 ceph-mon[35662]: pgmap v115: 97 pgs: 97 active+clean; 4.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 49 KiB/s wr, 29 op/s 2024-09-19T06:16:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.542+0000 7f6f02400640 1 -- 172.21.15.3:0/2227379935 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6efc077040 msgr2=0x7f6efc112430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.542+0000 7f6f02400640 1 --2- 172.21.15.3:0/2227379935 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6efc077040 0x7f6efc112430 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009900 tx=0x7f6ee802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.542+0000 7f6f02400640 1 -- 172.21.15.3:0/2227379935 shutdown_connections 2024-09-19T06:16:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.542+0000 7f6f02400640 1 --2- 172.21.15.3:0/2227379935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6efc112970 0x7f6efc114d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.542+0000 7f6f02400640 1 --2- 172.21.15.3:0/2227379935 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6efc077040 0x7f6efc112430 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.542+0000 7f6f02400640 1 --2- 172.21.15.3:0/2227379935 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6efc076720 0x7f6efc076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.542+0000 7f6f02400640 1 -- 172.21.15.3:0/2227379935 >> 172.21.15.3:0/2227379935 conn(0x7f6efc0ff970 msgr2=0x7f6efc101d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:09.546 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.543+0000 7f6f02400640 1 -- 172.21.15.3:0/2227379935 shutdown_connections 2024-09-19T06:16:09.546 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.543+0000 7f6f02400640 1 -- 172.21.15.3:0/2227379935 wait complete. 2024-09-19T06:16:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.544+0000 7f6f02400640 1 Processor -- start 2024-09-19T06:16:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.544+0000 7f6f02400640 1 -- start start 2024-09-19T06:16:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.544+0000 7f6f02400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6efc076720 0x7f6efc1a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.544+0000 7f6f02400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6efc077040 0x7f6efc1a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.544+0000 7f6f02400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6efc112970 0x7f6efc19e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:09.548 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.544+0000 7f6f02400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc1184c0 con 0x7f6efc077040 2024-09-19T06:16:09.548 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.544+0000 7f6f02400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc118340 con 0x7f6efc076720 2024-09-19T06:16:09.548 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.544+0000 7f6f02400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc118640 con 0x7f6efc112970 2024-09-19T06:16:09.548 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.544+0000 7f6efaa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6efc077040 0x7f6efc1a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:09.548 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.544+0000 7f6efbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6efc112970 0x7f6efc19e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:09.548 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.544+0000 7f6efb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6efc076720 0x7f6efc1a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:09.548 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.544+0000 7f6efbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6efc112970 0x7f6efc19e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:45782/0 (socket says 172.21.15.3:45782) 2024-09-19T06:16:09.548 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.544+0000 7f6efaa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6efc077040 0x7f6efc1a4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60564/0 (socket says 172.21.15.3:60564) 2024-09-19T06:16:09.548 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.545+0000 7f6efbe00640 1 -- 172.21.15.3:0/364237289 learned_addr learned my addr 172.21.15.3:0/364237289 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:09.548 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.545+0000 7f6efaa00640 1 -- 172.21.15.3:0/364237289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6efc112970 msgr2=0x7f6efc19e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:09.548 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.545+0000 7f6efaa00640 1 --2- 172.21.15.3:0/364237289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6efc112970 0x7f6efc19e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.548 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.545+0000 7f6efaa00640 1 -- 172.21.15.3:0/364237289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6efc076720 msgr2=0x7f6efc1a4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:09.548 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.545+0000 7f6efaa00640 1 --2- 172.21.15.3:0/364237289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6efc076720 0x7f6efc1a4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.545+0000 7f6efaa00640 1 -- 172.21.15.3:0/364237289 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6efc19f060 con 0x7f6efc077040 2024-09-19T06:16:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.545+0000 7f6efbe00640 1 --2- 172.21.15.3:0/364237289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6efc112970 0x7f6efc19e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:09.549 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.545+0000 7f6efaa00640 1 --2- 172.21.15.3:0/364237289 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6efc077040 0x7f6efc1a4c70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8005940 tx=0x7f6ee80040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.546+0000 7f6ef3e00640 1 -- 172.21.15.3:0/364237289 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee803f030 con 0x7f6efc077040 2024-09-19T06:16:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.546+0000 7f6ef3e00640 1 -- 172.21.15.3:0/364237289 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ee80044c0 con 0x7f6efc077040 2024-09-19T06:16:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.546+0000 7f6f02400640 1 -- 172.21.15.3:0/364237289 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6efc19f2f0 con 0x7f6efc077040 2024-09-19T06:16:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.546+0000 7f6ef3e00640 1 -- 172.21.15.3:0/364237289 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8035070 con 0x7f6efc077040 2024-09-19T06:16:09.550 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.546+0000 7f6f02400640 1 -- 172.21.15.3:0/364237289 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6efc1ab5f0 con 0x7f6efc077040 2024-09-19T06:16:09.551 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.549+0000 7f6ef3e00640 1 -- 172.21.15.3:0/364237289 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f6ee8042030 con 0x7f6efc077040 2024-09-19T06:16:09.553 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.551+0000 7f6f05200740 1 Processor -- start 2024-09-19T06:16:09.553 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.551+0000 7f6ef3e00640 1 --2- 172.21.15.3:0/364237289 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6ee00a33b0 0x7f6ee00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:09.553 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.551+0000 7f6f05200740 1 -- start start 2024-09-19T06:16:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.551+0000 7f6ef3e00640 1 -- 172.21.15.3:0/364237289 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f6ee80effe0 con 0x7f6efc077040 2024-09-19T06:16:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.551+0000 7f6efbe00640 1 --2- 172.21.15.3:0/364237289 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6ee00a33b0 0x7f6ee00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.552+0000 7f6f05200740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3e31e0 0x5573fc3e35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.552+0000 7f6f05200740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573fc3e3b00 0x5573fc3ede60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.552+0000 7f6f05200740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5573fc3ee3a0 0x5573fc3f0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.552+0000 7f6f05200740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5573fc349100 con 0x5573fc3ee3a0 2024-09-19T06:16:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.552+0000 7f6f05200740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5573fc2f11b0 con 0x5573fc3e31e0 2024-09-19T06:16:09.554 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.552+0000 7f6f05200740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5573fc3450c0 con 0x5573fc3e3b00 2024-09-19T06:16:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.552+0000 7f6efb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3e31e0 0x5573fc3e35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.552+0000 7f6efb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3e31e0 0x5573fc3e35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55804/0 (socket says 172.21.15.3:55804) 2024-09-19T06:16:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.552+0000 7f6efbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5573fc3ee3a0 0x5573fc3f0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.552+0000 7f6efb400640 1 -- 172.21.15.3:0/3188340891 learned_addr learned my addr 172.21.15.3:0/3188340891 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:09.556 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.552+0000 7f6efaa00640 1 --2- 172.21.15.3:0/3188340891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573fc3e3b00 0x5573fc3ede60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.552+0000 7f6efb400640 1 -- 172.21.15.3:0/3188340891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573fc3e3b00 msgr2=0x5573fc3ede60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.552+0000 7f6efb400640 1 --2- 172.21.15.3:0/3188340891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573fc3e3b00 0x5573fc3ede60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.552+0000 7f6efb400640 1 -- 172.21.15.3:0/3188340891 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5573fc3ee3a0 msgr2=0x5573fc3f0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.552+0000 7f6efb400640 1 --2- 172.21.15.3:0/3188340891 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5573fc3ee3a0 0x5573fc3f0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.552+0000 7f6efb400640 1 -- 172.21.15.3:0/3188340891 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573fc05c210 con 0x5573fc3e31e0 2024-09-19T06:16:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.552+0000 7f6efbe00640 1 --2- 172.21.15.3:0/3188340891 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5573fc3ee3a0 0x5573fc3f0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.553+0000 7f6efbe00640 1 --2- 172.21.15.3:0/364237289 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6ee00a33b0 0x7f6ee00a5870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40099a0 tx=0x7f6ef400eed0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.553+0000 7f6efb400640 1 --2- 172.21.15.3:0/3188340891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3e31e0 0x5573fc3e35c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009c90 tx=0x7f6eec011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=955b569969b9f99e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.553+0000 7f6ef0c00640 1 -- 172.21.15.3:0/3188340891 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec005220 con 0x5573fc3e31e0 2024-09-19T06:16:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.553+0000 7f6ef0c00640 1 -- 172.21.15.3:0/3188340891 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6eec004c80 con 0x5573fc3e31e0 2024-09-19T06:16:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.553+0000 7f6ef0c00640 1 -- 172.21.15.3:0/3188340891 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec0197a0 con 0x5573fc3e31e0 2024-09-19T06:16:09.557 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.554+0000 7f6f05200740 1 -- 172.21.15.3:0/3188340891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3e31e0 msgr2=0x5573fc3e35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.554+0000 7f6f05200740 1 --2- 172.21.15.3:0/3188340891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3e31e0 0x5573fc3e35c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009c90 tx=0x7f6eec011810 comp rx=0 tx=0).stop 2024-09-19T06:16:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.554+0000 7f6f05200740 1 -- 172.21.15.3:0/3188340891 shutdown_connections 2024-09-19T06:16:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.554+0000 7f6f05200740 1 --2- 172.21.15.3:0/3188340891 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5573fc3ee3a0 0x5573fc3f0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.554+0000 7f6f05200740 1 --2- 172.21.15.3:0/3188340891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573fc3e3b00 0x5573fc3ede60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.554+0000 7f6f05200740 1 --2- 172.21.15.3:0/3188340891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3e31e0 0x5573fc3e35c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.554+0000 7f6f05200740 1 -- 172.21.15.3:0/3188340891 >> 172.21.15.3:0/3188340891 conn(0x5573fc3df750 msgr2=0x5573fc3dfb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.554+0000 7f6f05200740 1 -- 172.21.15.3:0/3188340891 shutdown_connections 2024-09-19T06:16:09.558 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.554+0000 7f6f05200740 1 -- 172.21.15.3:0/3188340891 wait complete. 2024-09-19T06:16:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.555+0000 7f6f05200740 1 -- start start 2024-09-19T06:16:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.555+0000 7f6f05200740 1 Processor -- start 2024-09-19T06:16:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.556+0000 7f6f05200740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3e31e0 0x5573fc3eb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.556+0000 7f6f05200740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5573fc3e3b00 0x5573fc3eb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.556+0000 7f6f05200740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573fc3ee3a0 0x5573fc3ebcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.556+0000 7f6f05200740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5573fc3f0f70 con 0x5573fc3e3b00 2024-09-19T06:16:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.556+0000 7f6f05200740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5573fc2d2090 con 0x5573fc3e31e0 2024-09-19T06:16:09.561 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.556+0000 7f6f05200740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5573fc3f10f0 con 0x5573fc3ee3a0 2024-09-19T06:16:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.556+0000 7f6f05200740 10 client.0 _ll_register_callbacks cb 0x5573fc326f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.556+0000 7f6efaa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5573fc3e3b00 0x5573fc3eb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.556+0000 7f6efbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573fc3ee3a0 0x5573fc3ebcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.556+0000 7f6efbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573fc3ee3a0 0x5573fc3ebcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:45800/0 (socket says 172.21.15.3:45800) 2024-09-19T06:16:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.556+0000 7f6efb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3e31e0 0x5573fc3eb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.556+0000 7f6efbe00640 1 -- 172.21.15.3:0/211853079 learned_addr learned my addr 172.21.15.3:0/211853079 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:09.562 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.556+0000 7f6efbe00640 1 -- 172.21.15.3:0/211853079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3e31e0 msgr2=0x5573fc3eb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.556+0000 7f6efbe00640 1 --2- 172.21.15.3:0/211853079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3e31e0 0x5573fc3eb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.556+0000 7f6efbe00640 1 -- 172.21.15.3:0/211853079 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5573fc3e3b00 msgr2=0x5573fc3eb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.556+0000 7f6efbe00640 1 --2- 172.21.15.3:0/211853079 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5573fc3e3b00 0x5573fc3eb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.556+0000 7f6efbe00640 1 -- 172.21.15.3:0/211853079 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573fc128620 con 0x5573fc3ee3a0 2024-09-19T06:16:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.557+0000 7f6efbe00640 1 --2- 172.21.15.3:0/211853079 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573fc3ee3a0 0x5573fc3ebcf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40117f0 tx=0x7f6ef4004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43caa3154a082f34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.557+0000 7f6ee5600640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:16:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.557+0000 7f6ee5600640 1 -- 172.21.15.3:0/211853079 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4026070 con 0x5573fc3ee3a0 2024-09-19T06:16:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.557+0000 7f6f05200740 1 -- 172.21.15.3:0/211853079 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6eec004c80 con 0x5573fc3ee3a0 2024-09-19T06:16:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.557+0000 7f6ee5600640 1 -- 172.21.15.3:0/211853079 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f6ef4003b70 con 0x5573fc3ee3a0 2024-09-19T06:16:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.557+0000 7f6ee5600640 1 -- 172.21.15.3:0/211853079 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6ef4031050 con 0x5573fc3ee3a0 2024-09-19T06:16:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.557+0000 7f6f05200740 10 client.26308 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:09.563 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.557+0000 7f6f05200740 1 -- 172.21.15.3:0/211853079 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5573fc3fcb40 con 0x5573fc3ee3a0 2024-09-19T06:16:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.558+0000 7f6ee5600640 1 -- 172.21.15.3:0/211853079 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6eec004c80 con 0x5573fc3ee3a0 2024-09-19T06:16:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.558+0000 7f6ee5600640 1 -- 172.21.15.3:0/211853079 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6ef401f070 con 0x5573fc3ee3a0 2024-09-19T06:16:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.558+0000 7f6f05200740 10 client.26308 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.558+0000 7f6f05200740 10 client.26308 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:09.564 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.558+0000 7f6f05200740 20 client.26308 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.558+0000 7f6f05200740 1 --2- 172.21.15.3:0/211853079 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5573fc3fdfb0 0x5573fc4003c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.558+0000 7f6f05200740 4 client.26308 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.558+0000 7f6f05200740 1 -- 172.21.15.3:0/211853079 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573fc356830 con 0x5573fc3fdfb0 2024-09-19T06:16:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.559+0000 7f6efb400640 1 --2- 172.21.15.3:0/211853079 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5573fc3fdfb0 0x5573fc4003c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.559+0000 7f6efb400640 1 --2- 172.21.15.3:0/211853079 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5573fc3fdfb0 0x5573fc4003c0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44811407da90ed88 server_cookie=f5a874a9b6688543 in_seq=0 out_seq=0 2024-09-19T06:16:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.559+0000 7f6ee5600640 10 client.26308 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.560+0000 7f6ee5600640 1 -- 172.21.15.3:0/211853079 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5573fc356830 con 0x5573fc3fdfb0 2024-09-19T06:16:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.560+0000 7f6ee5600640 10 client.26308 handle_command_reply: tid=0 2024-09-19T06:16:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.560+0000 7f6f05200740 1 client.26308 shutdown 2024-09-19T06:16:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.560+0000 7f6f05200740 1 -- 172.21.15.3:0/211853079 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573fc3ee3a0 msgr2=0x5573fc3ebcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.560+0000 7f6f05200740 1 --2- 172.21.15.3:0/211853079 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573fc3ee3a0 0x5573fc3ebcf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40117f0 tx=0x7f6ef4004ab0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.560+0000 7f6f05200740 1 -- 172.21.15.3:0/211853079 shutdown_connections 2024-09-19T06:16:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.560+0000 7f6f05200740 1 --2- 172.21.15.3:0/211853079 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5573fc3fdfb0 0x5573fc4003c0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.560+0000 7f6f05200740 1 --2- 172.21.15.3:0/211853079 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573fc3ee3a0 0x5573fc3ebcf0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.560+0000 7f6f05200740 1 --2- 172.21.15.3:0/211853079 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5573fc3e3b00 0x5573fc3eb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.560+0000 7f6f05200740 1 --2- 172.21.15.3:0/211853079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3e31e0 0x5573fc3eb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.560+0000 7f6ee5600640 0 client.26308 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.560+0000 7f6f05200740 1 -- 172.21.15.3:0/211853079 >> 172.21.15.3:0/211853079 conn(0x5573fc3df750 msgr2=0x5573fc3e5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.561+0000 7f6f05200740 1 -- 172.21.15.3:0/211853079 shutdown_connections 2024-09-19T06:16:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.561+0000 7f6f05200740 1 -- 172.21.15.3:0/211853079 wait complete. 2024-09-19T06:16:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.561+0000 7f6f05200740 20 client.26308 trim_cache size 0 max 16384 2024-09-19T06:16:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.578+0000 7f6f05200740 1 Processor -- start 2024-09-19T06:16:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.578+0000 7f6f05200740 1 -- start start 2024-09-19T06:16:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.579+0000 7f6f05200740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5573fc3e31e0 0x5573fc3da8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.579+0000 7f6f05200740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573fc3e3b00 0x5573fc3e5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.579+0000 7f6f05200740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3ee3a0 0x5573fc405cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:09.582 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.579+0000 7f6f05200740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc1b3ee0 con 0x5573fc3e31e0 2024-09-19T06:16:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.579+0000 7f6f05200740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc1b5a20 con 0x5573fc3ee3a0 2024-09-19T06:16:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.579+0000 7f6f05200740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc1b45b0 con 0x5573fc3e3b00 2024-09-19T06:16:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.579+0000 7f6efbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3ee3a0 0x5573fc405cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.579+0000 7f6efb400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5573fc3e31e0 0x5573fc3da8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.579+0000 7f6efbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3ee3a0 0x5573fc405cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55818/0 (socket says 172.21.15.3:55818) 2024-09-19T06:16:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.579+0000 7f6efbe00640 1 -- 172.21.15.3:0/3134792709 learned_addr learned my addr 172.21.15.3:0/3134792709 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.579+0000 7f6efaa00640 1 --2- 172.21.15.3:0/3134792709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573fc3e3b00 0x5573fc3e5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.579+0000 7f6efbe00640 1 -- 172.21.15.3:0/3134792709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573fc3e3b00 msgr2=0x5573fc3e5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.579+0000 7f6efbe00640 1 --2- 172.21.15.3:0/3134792709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573fc3e3b00 0x5573fc3e5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.583 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.579+0000 7f6efbe00640 1 -- 172.21.15.3:0/3134792709 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5573fc3e31e0 msgr2=0x5573fc3da8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.580+0000 7f6efbe00640 1 --2- 172.21.15.3:0/3134792709 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5573fc3e31e0 0x5573fc3da8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.580+0000 7f6efbe00640 1 -- 172.21.15.3:0/3134792709 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573fc3e97a0 con 0x5573fc3ee3a0 2024-09-19T06:16:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.580+0000 7f6efbe00640 1 --2- 172.21.15.3:0/3134792709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3ee3a0 0x5573fc405cd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6ef402f040 tx=0x7f6ef40048b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e621335182f65ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.580+0000 7f6ee7e00640 1 -- 172.21.15.3:0/3134792709 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4026070 con 0x5573fc3ee3a0 2024-09-19T06:16:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.580+0000 7f6ee7e00640 1 -- 172.21.15.3:0/3134792709 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ef4011230 con 0x5573fc3ee3a0 2024-09-19T06:16:09.584 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.580+0000 7f6ee7e00640 1 -- 172.21.15.3:0/3134792709 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4003c80 con 0x5573fc3ee3a0 2024-09-19T06:16:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.581+0000 7f6f05200740 1 -- 172.21.15.3:0/3134792709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3ee3a0 msgr2=0x5573fc405cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.581+0000 7f6f05200740 1 --2- 172.21.15.3:0/3134792709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3ee3a0 0x5573fc405cd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6ef402f040 tx=0x7f6ef40048b0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.581+0000 7f6f05200740 1 -- 172.21.15.3:0/3134792709 shutdown_connections 2024-09-19T06:16:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.581+0000 7f6f05200740 1 --2- 172.21.15.3:0/3134792709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3ee3a0 0x5573fc405cd0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.587 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.581+0000 7f6f05200740 1 --2- 172.21.15.3:0/3134792709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573fc3e3b00 0x5573fc3e5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.581+0000 7f6f05200740 1 --2- 172.21.15.3:0/3134792709 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5573fc3e31e0 0x5573fc3da8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.581+0000 7f6f05200740 1 -- 172.21.15.3:0/3134792709 >> 172.21.15.3:0/3134792709 conn(0x5573fc3df750 msgr2=0x5573fc3ea340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.581+0000 7f6f05200740 1 -- 172.21.15.3:0/3134792709 shutdown_connections 2024-09-19T06:16:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.581+0000 7f6f05200740 1 -- 172.21.15.3:0/3134792709 wait complete. 2024-09-19T06:16:09.588 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.581+0000 7f6f05200740 1 -- start start 2024-09-19T06:16:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.582+0000 7f6f05200740 1 Processor -- start 2024-09-19T06:16:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.582+0000 7f6f05200740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3e31e0 0x5573fc3f6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.582+0000 7f6f05200740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573fc3e3b00 0x5573fc3f6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.582+0000 7f6f05200740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5573fc3ee3a0 0x5573fc3e7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.582+0000 7f6f05200740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc1b5350 con 0x5573fc3ee3a0 2024-09-19T06:16:09.589 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.582+0000 7f6f05200740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc1b4c80 con 0x5573fc3e31e0 2024-09-19T06:16:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.582+0000 7f6f05200740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc1b1ec0 con 0x5573fc3e3b00 2024-09-19T06:16:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.582+0000 7f6f05200740 10 client.0 _ll_register_callbacks cb 0x7f6ef40114f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.583+0000 7f6efbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5573fc3ee3a0 0x5573fc3e7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.583+0000 7f6efb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3e31e0 0x5573fc3f6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:09.590 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.583+0000 7f6efb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3e31e0 0x5573fc3f6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55834/0 (socket says 172.21.15.3:55834) 2024-09-19T06:16:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.583+0000 7f6efbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5573fc3ee3a0 0x5573fc3e7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60582/0 (socket says 172.21.15.3:60582) 2024-09-19T06:16:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.583+0000 7f6efb400640 1 -- 172.21.15.3:0/1308566545 learned_addr learned my addr 172.21.15.3:0/1308566545 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.583+0000 7f6efaa00640 1 --2- 172.21.15.3:0/1308566545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573fc3e3b00 0x5573fc3f6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.583+0000 7f6efbe00640 1 -- 172.21.15.3:0/1308566545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573fc3e3b00 msgr2=0x5573fc3f6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.583+0000 7f6efbe00640 1 --2- 172.21.15.3:0/1308566545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573fc3e3b00 0x5573fc3f6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.591 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.583+0000 7f6efbe00640 1 -- 172.21.15.3:0/1308566545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3e31e0 msgr2=0x5573fc3f6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.583+0000 7f6efbe00640 1 --2- 172.21.15.3:0/1308566545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3e31e0 0x5573fc3f6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.583+0000 7f6efbe00640 1 -- 172.21.15.3:0/1308566545 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573fc3e8330 con 0x5573fc3ee3a0 2024-09-19T06:16:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.583+0000 7f6efb400640 1 --2- 172.21.15.3:0/1308566545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3e31e0 0x5573fc3f6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.583+0000 7f6efbe00640 1 --2- 172.21.15.3:0/1308566545 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5573fc3ee3a0 0x5573fc3e7b00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4009970 tx=0x7f6ef4009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f0744ea705fb5d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:09.592 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.583+0000 7f6ee5600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:16:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.584+0000 7f6ee5600640 1 -- 172.21.15.3:0/1308566545 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4026040 con 0x5573fc3ee3a0 2024-09-19T06:16:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.584+0000 7f6f05200740 1 -- 172.21.15.3:0/1308566545 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ef4011230 con 0x5573fc3ee3a0 2024-09-19T06:16:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.584+0000 7f6ee5600640 1 -- 172.21.15.3:0/1308566545 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f6ef400f790 con 0x5573fc3ee3a0 2024-09-19T06:16:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.584+0000 7f6ee5600640 1 -- 172.21.15.3:0/1308566545 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6ef400f9d0 con 0x5573fc3ee3a0 2024-09-19T06:16:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.584+0000 7f6f05200740 10 client.16269 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:09.593 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.584+0000 7f6f05200740 1 -- 172.21.15.3:0/1308566545 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5573fc4687f0 con 0x5573fc3ee3a0 2024-09-19T06:16:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.584+0000 7f6ee5600640 1 -- 172.21.15.3:0/1308566545 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ef4011230 con 0x5573fc3ee3a0 2024-09-19T06:16:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.585+0000 7f6ee5600640 1 -- 172.21.15.3:0/1308566545 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6ef40040f0 con 0x5573fc3ee3a0 2024-09-19T06:16:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.585+0000 7f6f05200740 10 client.16269 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.585+0000 7f6f05200740 10 client.16269 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:09.594 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.585+0000 7f6f05200740 20 client.16269 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.585+0000 7f6f05200740 1 --2- 172.21.15.3:0/1308566545 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5573fc468ea0 0x5573fc46b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.585+0000 7f6f05200740 4 client.16269 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:16:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.585+0000 7f6f05200740 1 -- 172.21.15.3:0/1308566545 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5573fc350b80 con 0x5573fc468ea0 2024-09-19T06:16:09.595 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.585+0000 7f6efb400640 1 --2- 172.21.15.3:0/1308566545 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5573fc468ea0 0x5573fc46b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.586+0000 7f6ee5600640 10 client.16269 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:09.596 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.586+0000 7f6efb400640 1 --2- 172.21.15.3:0/1308566545 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5573fc468ea0 0x5573fc46b290 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45035cc82b747733 server_cookie=5d442cd758a8a30f in_seq=0 out_seq=0 2024-09-19T06:16:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.601+0000 7f6ee5600640 1 -- 172.21.15.3:0/1308566545 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5573fc350b80 con 0x5573fc468ea0 2024-09-19T06:16:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.601+0000 7f6ee5600640 10 client.16269 handle_command_reply: tid=0 2024-09-19T06:16:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.601+0000 7f6f05200740 1 client.16269 shutdown 2024-09-19T06:16:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.601+0000 7f6f05200740 1 -- 172.21.15.3:0/1308566545 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5573fc3ee3a0 msgr2=0x5573fc3e7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:09.604 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.601+0000 7f6f05200740 1 --2- 172.21.15.3:0/1308566545 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5573fc3ee3a0 0x5573fc3e7b00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4009970 tx=0x7f6ef4009500 comp rx=0 tx=0).stop 2024-09-19T06:16:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.602+0000 7f6f05200740 1 -- 172.21.15.3:0/1308566545 shutdown_connections 2024-09-19T06:16:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.602+0000 7f6f05200740 1 --2- 172.21.15.3:0/1308566545 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5573fc468ea0 0x5573fc46b290 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.602+0000 7f6f05200740 1 --2- 172.21.15.3:0/1308566545 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5573fc3ee3a0 0x5573fc3e7b00 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.602+0000 7f6ee5600640 0 client.16269 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.602+0000 7f6f05200740 1 --2- 172.21.15.3:0/1308566545 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5573fc3e3b00 0x5573fc3f6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.602+0000 7f6f05200740 1 --2- 172.21.15.3:0/1308566545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5573fc3e31e0 0x5573fc3f6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.602+0000 7f6f05200740 1 -- 172.21.15.3:0/1308566545 >> 172.21.15.3:0/1308566545 conn(0x5573fc3df750 msgr2=0x5573fc3f91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.602+0000 7f6f05200740 1 -- 172.21.15.3:0/1308566545 shutdown_connections 2024-09-19T06:16:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.602+0000 7f6f05200740 1 -- 172.21.15.3:0/1308566545 wait complete. 2024-09-19T06:16:09.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.602+0000 7f6f05200740 20 client.16269 trim_cache size 0 max 16384 2024-09-19T06:16:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:16:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:16:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:16:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:16:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.603+0000 7f6f02400640 1 -- 172.21.15.3:0/364237289 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6ee00a33b0 msgr2=0x7f6ee00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.603+0000 7f6f02400640 1 --2- 172.21.15.3:0/364237289 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6ee00a33b0 0x7f6ee00a5870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40099a0 tx=0x7f6ef400eed0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.606 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.603+0000 7f6f02400640 1 -- 172.21.15.3:0/364237289 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6efc077040 msgr2=0x7f6efc1a4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.603+0000 7f6f02400640 1 --2- 172.21.15.3:0/364237289 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6efc077040 0x7f6efc1a4c70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8005940 tx=0x7f6ee80040c0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.603+0000 7f6f02400640 1 -- 172.21.15.3:0/364237289 shutdown_connections 2024-09-19T06:16:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.603+0000 7f6f02400640 1 --2- 172.21.15.3:0/364237289 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6ee00a33b0 0x7f6ee00a5870 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.603+0000 7f6f02400640 1 --2- 172.21.15.3:0/364237289 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6efc112970 0x7f6efc19e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.603+0000 7f6f02400640 1 --2- 172.21.15.3:0/364237289 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6efc077040 0x7f6efc1a4c70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.603+0000 7f6f02400640 1 --2- 172.21.15.3:0/364237289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6efc076720 0x7f6efc1a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.603+0000 7f6f02400640 1 -- 172.21.15.3:0/364237289 >> 172.21.15.3:0/364237289 conn(0x7f6efc0ff970 msgr2=0x7f6efc101d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.603+0000 7f6f02400640 1 -- 172.21.15.3:0/364237289 shutdown_connections 2024-09-19T06:16:09.607 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:09.603+0000 7f6f02400640 1 -- 172.21.15.3:0/364237289 wait complete. 2024-09-19T06:16:09.662 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:16:09.662 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:16:10.043 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:10.366 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:10 smithi003 ceph-mon[30893]: pgmap v116: 97 pgs: 97 active+clean; 4.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 62 KiB/s wr, 36 op/s 2024-09-19T06:16:10.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:10 smithi059 ceph-mon[35138]: pgmap v116: 97 pgs: 97 active+clean; 4.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 62 KiB/s wr, 36 op/s 2024-09-19T06:16:10.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:10 smithi071 ceph-mon[35662]: pgmap v116: 97 pgs: 97 active+clean; 4.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 62 KiB/s wr, 36 op/s 2024-09-19T06:16:10.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.661+0000 7f6f25200640 1 -- 172.21.15.3:0/190728159 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6f20103ff0 msgr2=0x7f6f201043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:10.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.661+0000 7f6f25200640 1 --2- 172.21.15.3:0/190728159 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6f20103ff0 0x7f6f201043d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6f10009900 tx=0x7f6f1002a400 comp rx=0 tx=0).stop 2024-09-19T06:16:10.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.661+0000 7f6f25200640 1 -- 172.21.15.3:0/190728159 shutdown_connections 2024-09-19T06:16:10.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.661+0000 7f6f25200640 1 --2- 172.21.15.3:0/190728159 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f20109120 0x7f6f20110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.661+0000 7f6f25200640 1 --2- 172.21.15.3:0/190728159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f201049a0 0x7f6f201089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.661+0000 7f6f25200640 1 --2- 172.21.15.3:0/190728159 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6f20103ff0 0x7f6f201043d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.661+0000 7f6f25200640 1 -- 172.21.15.3:0/190728159 >> 172.21.15.3:0/190728159 conn(0x7f6f200ffa90 msgr2=0x7f6f20101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:10.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.661+0000 7f6f25200640 1 -- 172.21.15.3:0/190728159 shutdown_connections 2024-09-19T06:16:10.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.661+0000 7f6f25200640 1 -- 172.21.15.3:0/190728159 wait complete. 2024-09-19T06:16:10.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.662+0000 7f6f25200640 1 Processor -- start 2024-09-19T06:16:10.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.662+0000 7f6f25200640 1 -- start start 2024-09-19T06:16:10.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.663+0000 7f6f25200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f20103ff0 0x7f6f2019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:10.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.663+0000 7f6f25200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6f201049a0 0x7f6f2019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:10.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.663+0000 7f6f25200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f20109120 0x7f6f2019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:10.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.663+0000 7f6f25200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6f201141a0 con 0x7f6f201049a0 2024-09-19T06:16:10.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.663+0000 7f6f25200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6f20114020 con 0x7f6f20103ff0 2024-09-19T06:16:10.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.663+0000 7f6f25200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6f20114320 con 0x7f6f20109120 2024-09-19T06:16:10.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.663+0000 7f6f1d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6f201049a0 0x7f6f2019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:10.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.663+0000 7f6f1d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6f201049a0 0x7f6f2019ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60596/0 (socket says 172.21.15.3:60596) 2024-09-19T06:16:10.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.663+0000 7f6f1d400640 1 -- 172.21.15.3:0/975786548 learned_addr learned my addr 172.21.15.3:0/975786548 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:10.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.663+0000 7f6f1de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f20103ff0 0x7f6f2019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:10.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.663+0000 7f6f1e800640 1 --2- 172.21.15.3:0/975786548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f20109120 0x7f6f2019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:10.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.664+0000 7f6f1d400640 1 -- 172.21.15.3:0/975786548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f20109120 msgr2=0x7f6f2019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:10.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.664+0000 7f6f1d400640 1 --2- 172.21.15.3:0/975786548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f20109120 0x7f6f2019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.664+0000 7f6f1d400640 1 -- 172.21.15.3:0/975786548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f20103ff0 msgr2=0x7f6f2019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:10.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.664+0000 7f6f1d400640 1 --2- 172.21.15.3:0/975786548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f20103ff0 0x7f6f2019a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.664+0000 7f6f1d400640 1 -- 172.21.15.3:0/975786548 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2019f5d0 con 0x7f6f201049a0 2024-09-19T06:16:10.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.664+0000 7f6f1e800640 1 --2- 172.21.15.3:0/975786548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f20109120 0x7f6f2019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:10.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.664+0000 7f6f1de00640 1 --2- 172.21.15.3:0/975786548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f20103ff0 0x7f6f2019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:10.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.664+0000 7f6f1d400640 1 --2- 172.21.15.3:0/975786548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6f201049a0 0x7f6f2019ab60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c00d950 tx=0x7f6f0c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:10.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.664+0000 7f6f16a00640 1 -- 172.21.15.3:0/975786548 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c017030 con 0x7f6f201049a0 2024-09-19T06:16:10.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.664+0000 7f6f16a00640 1 -- 172.21.15.3:0/975786548 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f0c004020 con 0x7f6f201049a0 2024-09-19T06:16:10.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.664+0000 7f6f25200640 1 -- 172.21.15.3:0/975786548 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f2019f8c0 con 0x7f6f201049a0 2024-09-19T06:16:10.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.664+0000 7f6f16a00640 1 -- 172.21.15.3:0/975786548 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c0047a0 con 0x7f6f201049a0 2024-09-19T06:16:10.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.664+0000 7f6f25200640 1 -- 172.21.15.3:0/975786548 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f201a71a0 con 0x7f6f201049a0 2024-09-19T06:16:10.672 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.667+0000 7f6f27e69740 1 Processor -- start 2024-09-19T06:16:10.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.668+0000 7f6f27e69740 1 -- start start 2024-09-19T06:16:10.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.668+0000 7f6f16a00640 1 -- 172.21.15.3:0/975786548 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f6f0c0041d0 con 0x7f6f201049a0 2024-09-19T06:16:10.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.668+0000 7f6f27e69740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f549ac0 0x55df3f549ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:10.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.668+0000 7f6f27e69740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55df3f54a3e0 0x55df3f554760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:10.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.668+0000 7f6f27e69740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df3f554ca0 0x55df3f557090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:10.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.668+0000 7f6f27e69740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55df3f4b0290 con 0x55df3f54a3e0 2024-09-19T06:16:10.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.668+0000 7f6f27e69740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55df3f457b40 con 0x55df3f554ca0 2024-09-19T06:16:10.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.668+0000 7f6f27e69740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55df3f4ac250 con 0x55df3f549ac0 2024-09-19T06:16:10.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.668+0000 7f6f1de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55df3f54a3e0 0x55df3f554760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:10.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.668+0000 7f6f1de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55df3f54a3e0 0x55df3f554760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60612/0 (socket says 172.21.15.3:60612) 2024-09-19T06:16:10.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.668+0000 7f6f1de00640 1 -- 172.21.15.3:0/2508044225 learned_addr learned my addr 172.21.15.3:0/2508044225 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:10.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.668+0000 7f6f1e800640 1 --2- 172.21.15.3:0/2508044225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f549ac0 0x55df3f549ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:10.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.668+0000 7f6f1d400640 1 --2- 172.21.15.3:0/2508044225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df3f554ca0 0x55df3f557090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:10.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.669+0000 7f6f1e800640 1 -- 172.21.15.3:0/2508044225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df3f554ca0 msgr2=0x55df3f557090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:10.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.669+0000 7f6f1e800640 1 --2- 172.21.15.3:0/2508044225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df3f554ca0 0x55df3f557090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.669+0000 7f6f1e800640 1 -- 172.21.15.3:0/2508044225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55df3f54a3e0 msgr2=0x55df3f554760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:10.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.669+0000 7f6f1e800640 1 --2- 172.21.15.3:0/2508044225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55df3f54a3e0 0x55df3f554760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.669+0000 7f6f1e800640 1 -- 172.21.15.3:0/2508044225 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df3f2216a0 con 0x55df3f549ac0 2024-09-19T06:16:10.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.669+0000 7f6f1e800640 1 --2- 172.21.15.3:0/2508044225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f549ac0 0x55df3f549ea0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6f18005fd0 tx=0x7f6f18011bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43234bb577f30e6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:10.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.669+0000 7f6f0b400640 1 -- 172.21.15.3:0/2508044225 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f18004d20 con 0x55df3f549ac0 2024-09-19T06:16:10.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.670+0000 7f6f0b400640 1 -- 172.21.15.3:0/2508044225 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f1800f9a0 con 0x55df3f549ac0 2024-09-19T06:16:10.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.670+0000 7f6f0b400640 1 -- 172.21.15.3:0/2508044225 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f18004510 con 0x55df3f549ac0 2024-09-19T06:16:10.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.670+0000 7f6f16a00640 1 --2- 172.21.15.3:0/975786548 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6f040a33b0 0x7f6f040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:10.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.670+0000 7f6f16a00640 1 -- 172.21.15.3:0/975786548 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f6f0c0cf660 con 0x7f6f201049a0 2024-09-19T06:16:10.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.670+0000 7f6f1de00640 1 --2- 172.21.15.3:0/975786548 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6f040a33b0 0x7f6f040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:10.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.670+0000 7f6f27e69740 1 -- 172.21.15.3:0/2508044225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f549ac0 msgr2=0x55df3f549ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:10.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.670+0000 7f6f27e69740 1 --2- 172.21.15.3:0/2508044225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f549ac0 0x55df3f549ea0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6f18005fd0 tx=0x7f6f18011bf0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.670+0000 7f6f27e69740 1 -- 172.21.15.3:0/2508044225 shutdown_connections 2024-09-19T06:16:10.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.670+0000 7f6f27e69740 1 --2- 172.21.15.3:0/2508044225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df3f554ca0 0x55df3f557090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.670+0000 7f6f27e69740 1 --2- 172.21.15.3:0/2508044225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55df3f54a3e0 0x55df3f554760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.670+0000 7f6f27e69740 1 --2- 172.21.15.3:0/2508044225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f549ac0 0x55df3f549ea0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.670+0000 7f6f27e69740 1 -- 172.21.15.3:0/2508044225 >> 172.21.15.3:0/2508044225 conn(0x55df3f546050 msgr2=0x55df3f546430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:10.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.671+0000 7f6f27e69740 1 -- 172.21.15.3:0/2508044225 shutdown_connections 2024-09-19T06:16:10.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.671+0000 7f6f27e69740 1 -- 172.21.15.3:0/2508044225 wait complete. 2024-09-19T06:16:10.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.671+0000 7f6f1de00640 1 --2- 172.21.15.3:0/975786548 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6f040a33b0 0x7f6f040a5870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55df3f546eb0 tx=0x7f6f10031510 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:10.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.671+0000 7f6f27e69740 1 -- start start 2024-09-19T06:16:10.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.671+0000 7f6f27e69740 1 Processor -- start 2024-09-19T06:16:10.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.672+0000 7f6f27e69740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55df3f549ac0 0x55df3f554630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:10.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.672+0000 7f6f27e69740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f54a3e0 0x55df3f5518e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:10.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.672+0000 7f6f27e69740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df3f554ca0 0x55df3f551e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:10.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.672+0000 7f6f27e69740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55df3f557910 con 0x55df3f549ac0 2024-09-19T06:16:10.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.672+0000 7f6f27e69740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55df3f46afa0 con 0x55df3f554ca0 2024-09-19T06:16:10.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.672+0000 7f6f27e69740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55df3f557a90 con 0x55df3f54a3e0 2024-09-19T06:16:10.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.672+0000 7f6f27e69740 10 client.0 _ll_register_callbacks cb 0x55df3f1beba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:10.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.672+0000 7f6f1de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55df3f549ac0 0x55df3f554630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:10.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.672+0000 7f6f1d400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f54a3e0 0x55df3f5518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:10.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.672+0000 7f6f1d400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f54a3e0 0x55df3f5518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:45866/0 (socket says 172.21.15.3:45866) 2024-09-19T06:16:10.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.672+0000 7f6f1d400640 1 -- 172.21.15.3:0/2479192969 learned_addr learned my addr 172.21.15.3:0/2479192969 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:10.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.672+0000 7f6f1e800640 1 --2- 172.21.15.3:0/2479192969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df3f554ca0 0x55df3f551e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:10.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.673+0000 7f6f1d400640 1 -- 172.21.15.3:0/2479192969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df3f554ca0 msgr2=0x55df3f551e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:10.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.673+0000 7f6f1d400640 1 --2- 172.21.15.3:0/2479192969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df3f554ca0 0x55df3f551e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.673+0000 7f6f1d400640 1 -- 172.21.15.3:0/2479192969 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55df3f549ac0 msgr2=0x55df3f554630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:10.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.673+0000 7f6f1d400640 1 --2- 172.21.15.3:0/2479192969 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55df3f549ac0 0x55df3f554630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.673+0000 7f6f1d400640 1 -- 172.21.15.3:0/2479192969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df3f552690 con 0x55df3f54a3e0 2024-09-19T06:16:10.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.673+0000 7f6f1d400640 1 --2- 172.21.15.3:0/2479192969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f54a3e0 0x55df3f5518e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0cce10 tx=0x7f6f0c005bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1b290bc1db1c3fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:10.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.673+0000 7f6effe00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:16:10.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.673+0000 7f6effe00640 1 -- 172.21.15.3:0/2479192969 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c09b710 con 0x55df3f54a3e0 2024-09-19T06:16:10.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.673+0000 7f6effe00640 1 -- 172.21.15.3:0/2479192969 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f6f0c0cd030 con 0x55df3f54a3e0 2024-09-19T06:16:10.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.673+0000 7f6f27e69740 1 -- 172.21.15.3:0/2479192969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f1800f9a0 con 0x55df3f54a3e0 2024-09-19T06:16:10.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.674+0000 7f6effe00640 1 -- 172.21.15.3:0/2479192969 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6f0c0afe60 con 0x55df3f54a3e0 2024-09-19T06:16:10.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.674+0000 7f6f27e69740 10 client.26326 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:10.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.674+0000 7f6f27e69740 1 -- 172.21.15.3:0/2479192969 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55df3f5638c0 con 0x55df3f54a3e0 2024-09-19T06:16:10.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.674+0000 7f6effe00640 1 -- 172.21.15.3:0/2479192969 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f1800f9a0 con 0x55df3f54a3e0 2024-09-19T06:16:10.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.674+0000 7f6effe00640 1 -- 172.21.15.3:0/2479192969 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6f0c09ad90 con 0x55df3f54a3e0 2024-09-19T06:16:10.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.674+0000 7f6f27e69740 10 client.26326 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:10.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.674+0000 7f6f27e69740 10 client.26326 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:10.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.674+0000 7f6f27e69740 20 client.26326 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:10.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.674+0000 7f6f27e69740 1 --2- 172.21.15.3:0/2479192969 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55df3f564cd0 0x55df3f567130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:10.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.674+0000 7f6f27e69740 4 client.26326 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:10.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.674+0000 7f6f27e69740 1 -- 172.21.15.3:0/2479192969 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df3f4bd800 con 0x55df3f564cd0 2024-09-19T06:16:10.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.674+0000 7f6f1de00640 1 --2- 172.21.15.3:0/2479192969 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55df3f564cd0 0x55df3f567130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:10.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.675+0000 7f6f1de00640 1 --2- 172.21.15.3:0/2479192969 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55df3f564cd0 0x55df3f567130 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac81c2c2c42e91dc server_cookie=82df9d66c23144ea in_seq=0 out_seq=0 2024-09-19T06:16:10.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.675+0000 7f6effe00640 10 client.26326 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:10.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.676+0000 7f6effe00640 1 -- 172.21.15.3:0/2479192969 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55df3f4bd800 con 0x55df3f564cd0 2024-09-19T06:16:10.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.676+0000 7f6effe00640 10 client.26326 handle_command_reply: tid=0 2024-09-19T06:16:10.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.676+0000 7f6f27e69740 1 client.26326 shutdown 2024-09-19T06:16:10.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.676+0000 7f6f27e69740 1 -- 172.21.15.3:0/2479192969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f54a3e0 msgr2=0x55df3f5518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:10.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.676+0000 7f6f27e69740 1 --2- 172.21.15.3:0/2479192969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f54a3e0 0x55df3f5518e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0cce10 tx=0x7f6f0c005bf0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.676+0000 7f6f27e69740 1 -- 172.21.15.3:0/2479192969 shutdown_connections 2024-09-19T06:16:10.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.676+0000 7f6f27e69740 1 --2- 172.21.15.3:0/2479192969 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55df3f564cd0 0x55df3f567130 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.676+0000 7f6f27e69740 1 --2- 172.21.15.3:0/2479192969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df3f554ca0 0x55df3f551e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.676+0000 7f6f27e69740 1 --2- 172.21.15.3:0/2479192969 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f54a3e0 0x55df3f5518e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.676+0000 7f6effe00640 0 client.26326 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:10.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.676+0000 7f6f27e69740 1 --2- 172.21.15.3:0/2479192969 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55df3f549ac0 0x55df3f554630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.676+0000 7f6f27e69740 1 -- 172.21.15.3:0/2479192969 >> 172.21.15.3:0/2479192969 conn(0x55df3f546050 msgr2=0x55df3f5451c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:10.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.676+0000 7f6f27e69740 1 -- 172.21.15.3:0/2479192969 shutdown_connections 2024-09-19T06:16:10.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.677+0000 7f6f27e69740 1 -- 172.21.15.3:0/2479192969 wait complete. 2024-09-19T06:16:10.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.677+0000 7f6f27e69740 20 client.26326 trim_cache size 0 max 16384 2024-09-19T06:16:10.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.695+0000 7f6f27e69740 1 Processor -- start 2024-09-19T06:16:10.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.695+0000 7f6f27e69740 1 -- start start 2024-09-19T06:16:10.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.695+0000 7f6f27e69740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55df3f549ac0 0x55df3f54bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:10.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.695+0000 7f6f27e69740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df3f54a3e0 0x55df3f56ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:10.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.695+0000 7f6f27e69740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f554ca0 0x55df3f56cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:10.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.695+0000 7f6f27e69740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6f201afa60 con 0x55df3f549ac0 2024-09-19T06:16:10.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.695+0000 7f6f27e69740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6f201b15a0 con 0x55df3f54a3e0 2024-09-19T06:16:10.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.695+0000 7f6f27e69740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6f201b0130 con 0x55df3f554ca0 2024-09-19T06:16:10.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.696+0000 7f6f1de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55df3f549ac0 0x55df3f54bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:10.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.696+0000 7f6f1de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55df3f549ac0 0x55df3f54bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60642/0 (socket says 172.21.15.3:60642) 2024-09-19T06:16:10.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.696+0000 7f6f1de00640 1 -- 172.21.15.3:0/3417235102 learned_addr learned my addr 172.21.15.3:0/3417235102 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:10.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.696+0000 7f6f1e800640 1 --2- 172.21.15.3:0/3417235102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f554ca0 0x55df3f56cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:10.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.696+0000 7f6f1d400640 1 --2- 172.21.15.3:0/3417235102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df3f54a3e0 0x55df3f56ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:10.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.696+0000 7f6f1e800640 1 -- 172.21.15.3:0/3417235102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df3f54a3e0 msgr2=0x55df3f56ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:10.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.696+0000 7f6f1e800640 1 --2- 172.21.15.3:0/3417235102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df3f54a3e0 0x55df3f56ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.696+0000 7f6f1e800640 1 -- 172.21.15.3:0/3417235102 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55df3f549ac0 msgr2=0x55df3f54bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:10.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.696+0000 7f6f1e800640 1 --2- 172.21.15.3:0/3417235102 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55df3f549ac0 0x55df3f54bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.696+0000 7f6f1e800640 1 -- 172.21.15.3:0/3417235102 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df3f549840 con 0x55df3f554ca0 2024-09-19T06:16:10.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.696+0000 7f6f1de00640 1 --2- 172.21.15.3:0/3417235102 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55df3f549ac0 0x55df3f54bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:10.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.696+0000 7f6f1e800640 1 --2- 172.21.15.3:0/3417235102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f554ca0 0x55df3f56cf40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6f18004090 tx=0x7f6f18009f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cee460aaab7ed73 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:10.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.697+0000 7f6f0aa00640 1 -- 172.21.15.3:0/3417235102 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f18029070 con 0x55df3f554ca0 2024-09-19T06:16:10.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.697+0000 7f6f0aa00640 1 -- 172.21.15.3:0/3417235102 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f1801f040 con 0x55df3f554ca0 2024-09-19T06:16:10.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.697+0000 7f6f0aa00640 1 -- 172.21.15.3:0/3417235102 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f18005660 con 0x55df3f554ca0 2024-09-19T06:16:10.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.698+0000 7f6f27e69740 1 -- 172.21.15.3:0/3417235102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f554ca0 msgr2=0x55df3f56cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:10.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.698+0000 7f6f27e69740 1 --2- 172.21.15.3:0/3417235102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f554ca0 0x55df3f56cf40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6f18004090 tx=0x7f6f18009f20 comp rx=0 tx=0).stop 2024-09-19T06:16:10.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.698+0000 7f6f27e69740 1 -- 172.21.15.3:0/3417235102 shutdown_connections 2024-09-19T06:16:10.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.698+0000 7f6f27e69740 1 --2- 172.21.15.3:0/3417235102 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f554ca0 0x55df3f56cf40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.698+0000 7f6f27e69740 1 --2- 172.21.15.3:0/3417235102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df3f54a3e0 0x55df3f56ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.698+0000 7f6f27e69740 1 --2- 172.21.15.3:0/3417235102 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55df3f549ac0 0x55df3f54bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.698+0000 7f6f27e69740 1 -- 172.21.15.3:0/3417235102 >> 172.21.15.3:0/3417235102 conn(0x55df3f546050 msgr2=0x55df3f54b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:10.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.698+0000 7f6f27e69740 1 -- 172.21.15.3:0/3417235102 shutdown_connections 2024-09-19T06:16:10.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.698+0000 7f6f27e69740 1 -- 172.21.15.3:0/3417235102 wait complete. 2024-09-19T06:16:10.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.698+0000 7f6f27e69740 1 -- start start 2024-09-19T06:16:10.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.698+0000 7f6f27e69740 1 Processor -- start 2024-09-19T06:16:10.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.699+0000 7f6f27e69740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55df3f549ac0 0x55df3f559cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:10.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.699+0000 7f6f27e69740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f54a3e0 0x55df3f55a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:10.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.699+0000 7f6f27e69740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df3f554ca0 0x55df3f55a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:10.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.699+0000 7f6f27e69740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6f201b0ed0 con 0x55df3f549ac0 2024-09-19T06:16:10.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.699+0000 7f6f27e69740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6f201b0800 con 0x55df3f554ca0 2024-09-19T06:16:10.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.699+0000 7f6f27e69740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6f201ada40 con 0x55df3f54a3e0 2024-09-19T06:16:10.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.699+0000 7f6f27e69740 10 client.0 _ll_register_callbacks cb 0x7f6f0c0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:10.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.699+0000 7f6f1de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55df3f549ac0 0x55df3f559cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:10.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.699+0000 7f6f1e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df3f554ca0 0x55df3f55a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:10.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.699+0000 7f6f1e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df3f554ca0 0x55df3f55a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55882/0 (socket says 172.21.15.3:55882) 2024-09-19T06:16:10.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.699+0000 7f6f1e800640 1 -- 172.21.15.3:0/1908949201 learned_addr learned my addr 172.21.15.3:0/1908949201 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:10.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.699+0000 7f6f1d400640 1 --2- 172.21.15.3:0/1908949201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f54a3e0 0x55df3f55a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:10.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.700+0000 7f6f1e800640 1 -- 172.21.15.3:0/1908949201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f54a3e0 msgr2=0x55df3f55a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:10.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.700+0000 7f6f1e800640 1 --2- 172.21.15.3:0/1908949201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f54a3e0 0x55df3f55a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.700+0000 7f6f1e800640 1 -- 172.21.15.3:0/1908949201 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55df3f549ac0 msgr2=0x55df3f559cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:10.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.700+0000 7f6f1e800640 1 --2- 172.21.15.3:0/1908949201 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55df3f549ac0 0x55df3f559cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.700+0000 7f6f1e800640 1 -- 172.21.15.3:0/1908949201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df3f5cfa60 con 0x55df3f554ca0 2024-09-19T06:16:10.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.700+0000 7f6f1d400640 1 --2- 172.21.15.3:0/1908949201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f54a3e0 0x55df3f55a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:10.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.700+0000 7f6f1de00640 1 --2- 172.21.15.3:0/1908949201 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55df3f549ac0 0x55df3f559cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:10.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.700+0000 7f6f1e800640 1 --2- 172.21.15.3:0/1908949201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df3f554ca0 0x55df3f55a730 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6f1800a010 tx=0x7f6f18003c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ce2e72ef5e43fde server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:10.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.700+0000 7f6effe00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:16:10.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.700+0000 7f6effe00640 1 -- 172.21.15.3:0/1908949201 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f18029050 con 0x55df3f554ca0 2024-09-19T06:16:10.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.700+0000 7f6effe00640 1 -- 172.21.15.3:0/1908949201 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f6f180054a0 con 0x55df3f554ca0 2024-09-19T06:16:10.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.700+0000 7f6f27e69740 1 -- 172.21.15.3:0/1908949201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f1801f040 con 0x55df3f554ca0 2024-09-19T06:16:10.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.700+0000 7f6effe00640 1 -- 172.21.15.3:0/1908949201 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6f1803c050 con 0x55df3f554ca0 2024-09-19T06:16:10.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.701+0000 7f6f27e69740 10 client.26330 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:10.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.701+0000 7f6f27e69740 1 -- 172.21.15.3:0/1908949201 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55df3f5d0d80 con 0x55df3f554ca0 2024-09-19T06:16:10.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.701+0000 7f6effe00640 1 -- 172.21.15.3:0/1908949201 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f1801f040 con 0x55df3f554ca0 2024-09-19T06:16:10.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.701+0000 7f6effe00640 1 -- 172.21.15.3:0/1908949201 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6f18018070 con 0x55df3f554ca0 2024-09-19T06:16:10.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.701+0000 7f6f27e69740 10 client.26330 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:10.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.701+0000 7f6f27e69740 10 client.26330 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:10.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.701+0000 7f6f27e69740 20 client.26330 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:10.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.701+0000 7f6f27e69740 1 --2- 172.21.15.3:0/1908949201 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55df3f5d11f0 0x55df3f5d35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:10.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.701+0000 7f6f27e69740 4 client.26330 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:16:10.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.701+0000 7f6f27e69740 1 -- 172.21.15.3:0/1908949201 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55df3f4b7d10 con 0x55df3f5d11f0 2024-09-19T06:16:10.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.701+0000 7f6f1de00640 1 --2- 172.21.15.3:0/1908949201 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55df3f5d11f0 0x55df3f5d35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:10.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.702+0000 7f6f1de00640 1 --2- 172.21.15.3:0/1908949201 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55df3f5d11f0 0x55df3f5d35e0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7668a25d4556893b server_cookie=96f92952a42dd166 in_seq=0 out_seq=0 2024-09-19T06:16:10.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.702+0000 7f6effe00640 10 client.26330 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:10.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.703+0000 7f6effe00640 1 -- 172.21.15.3:0/1908949201 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55df3f4b7d10 con 0x55df3f5d11f0 2024-09-19T06:16:10.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.703+0000 7f6effe00640 10 client.26330 handle_command_reply: tid=0 2024-09-19T06:16:10.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.703+0000 7f6f27e69740 1 client.26330 shutdown 2024-09-19T06:16:10.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.703+0000 7f6f27e69740 1 -- 172.21.15.3:0/1908949201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df3f554ca0 msgr2=0x55df3f55a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:10.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.703+0000 7f6f27e69740 1 --2- 172.21.15.3:0/1908949201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df3f554ca0 0x55df3f55a730 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6f1800a010 tx=0x7f6f18003c60 comp rx=0 tx=0).stop 2024-09-19T06:16:10.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.703+0000 7f6f27e69740 1 -- 172.21.15.3:0/1908949201 shutdown_connections 2024-09-19T06:16:10.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.703+0000 7f6f27e69740 1 --2- 172.21.15.3:0/1908949201 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55df3f5d11f0 0x55df3f5d35e0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.703+0000 7f6f27e69740 1 --2- 172.21.15.3:0/1908949201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df3f554ca0 0x55df3f55a730 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.703+0000 7f6f27e69740 1 --2- 172.21.15.3:0/1908949201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55df3f54a3e0 0x55df3f55a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.703+0000 7f6f27e69740 1 --2- 172.21.15.3:0/1908949201 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55df3f549ac0 0x55df3f559cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.703+0000 7f6f27e69740 1 -- 172.21.15.3:0/1908949201 >> 172.21.15.3:0/1908949201 conn(0x55df3f546050 msgr2=0x55df3f54bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:10.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.703+0000 7f6effe00640 0 client.26330 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:10.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.703+0000 7f6f27e69740 1 -- 172.21.15.3:0/1908949201 shutdown_connections 2024-09-19T06:16:10.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.704+0000 7f6f27e69740 1 -- 172.21.15.3:0/1908949201 wait complete. 2024-09-19T06:16:10.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.704+0000 7f6f27e69740 20 client.26330 trim_cache size 0 max 16384 2024-09-19T06:16:10.714 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:16:10.714 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": 0, 2024-09-19T06:16:10.714 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_tag": "6c4bcec1-ea1e-4139-8324-4610857e99ff", 2024-09-19T06:16:10.714 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": "asynchronous" 2024-09-19T06:16:10.714 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:16:10.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.704+0000 7f6f25200640 1 -- 172.21.15.3:0/975786548 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6f040a33b0 msgr2=0x7f6f040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:10.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.704+0000 7f6f25200640 1 --2- 172.21.15.3:0/975786548 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6f040a33b0 0x7f6f040a5870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55df3f546eb0 tx=0x7f6f10031510 comp rx=0 tx=0).stop 2024-09-19T06:16:10.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.704+0000 7f6f25200640 1 -- 172.21.15.3:0/975786548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6f201049a0 msgr2=0x7f6f2019ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:10.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.704+0000 7f6f25200640 1 --2- 172.21.15.3:0/975786548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6f201049a0 0x7f6f2019ab60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c00d950 tx=0x7f6f0c00de10 comp rx=0 tx=0).stop 2024-09-19T06:16:10.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.705+0000 7f6f25200640 1 -- 172.21.15.3:0/975786548 shutdown_connections 2024-09-19T06:16:10.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.705+0000 7f6f25200640 1 --2- 172.21.15.3:0/975786548 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6f040a33b0 0x7f6f040a5870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.705+0000 7f6f25200640 1 --2- 172.21.15.3:0/975786548 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6f20109120 0x7f6f2019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.705+0000 7f6f25200640 1 --2- 172.21.15.3:0/975786548 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6f201049a0 0x7f6f2019ab60 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.705+0000 7f6f25200640 1 --2- 172.21.15.3:0/975786548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f20103ff0 0x7f6f2019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:10.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.705+0000 7f6f25200640 1 -- 172.21.15.3:0/975786548 >> 172.21.15.3:0/975786548 conn(0x7f6f200ffa90 msgr2=0x7f6f20100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:10.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.705+0000 7f6f25200640 1 -- 172.21.15.3:0/975786548 shutdown_connections 2024-09-19T06:16:10.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:10.705+0000 7f6f25200640 1 -- 172.21.15.3:0/975786548 wait complete. 2024-09-19T06:16:11.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:11 smithi059 ceph-mon[35138]: scrub queued for path: / 2024-09-19T06:16:11.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:11 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:16:11.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:11 smithi059 ceph-mon[35138]: scrub summary: active paths [/] 2024-09-19T06:16:11.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:11 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:16:11.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:11 smithi003 ceph-mon[30893]: scrub queued for path: / 2024-09-19T06:16:11.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:11 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:16:11.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:11 smithi003 ceph-mon[30893]: scrub summary: active paths [/] 2024-09-19T06:16:11.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:11 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:16:11.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:11 smithi071 ceph-mon[35662]: scrub queued for path: / 2024-09-19T06:16:11.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:11 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:16:11.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:11 smithi071 ceph-mon[35662]: scrub summary: active paths [/] 2024-09-19T06:16:11.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:11 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:16:11.627 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:16:12.007 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:12.378 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:12 smithi003 ceph-mon[30893]: pgmap v117: 97 pgs: 97 active+clean; 4.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 KiB/s wr, 27 op/s 2024-09-19T06:16:12.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:12 smithi059 ceph-mon[35138]: pgmap v117: 97 pgs: 97 active+clean; 4.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 KiB/s wr, 27 op/s 2024-09-19T06:16:12.696 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:12 smithi071 ceph-mon[35662]: pgmap v117: 97 pgs: 97 active+clean; 4.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 KiB/s wr, 27 op/s 2024-09-19T06:16:12.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.606+0000 7f4796c00640 1 -- 172.21.15.3:0/2200603490 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4790074510 msgr2=0x7f47900748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:12.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.606+0000 7f4796c00640 1 --2- 172.21.15.3:0/2200603490 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4790074510 0x7f47900748f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4780009900 tx=0x7f478002a480 comp rx=0 tx=0).stop 2024-09-19T06:16:12.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.606+0000 7f4796c00640 1 -- 172.21.15.3:0/2200603490 shutdown_connections 2024-09-19T06:16:12.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.606+0000 7f4796c00640 1 --2- 172.21.15.3:0/2200603490 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f479010e450 0x7f4790110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.606+0000 7f4796c00640 1 --2- 172.21.15.3:0/2200603490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4790074e30 0x7f479010df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.606+0000 7f4796c00640 1 --2- 172.21.15.3:0/2200603490 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4790074510 0x7f47900748f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.606+0000 7f4796c00640 1 -- 172.21.15.3:0/2200603490 >> 172.21.15.3:0/2200603490 conn(0x7f47900fd8b0 msgr2=0x7f47900ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:12.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.606+0000 7f4796c00640 1 -- 172.21.15.3:0/2200603490 shutdown_connections 2024-09-19T06:16:12.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.606+0000 7f4796c00640 1 -- 172.21.15.3:0/2200603490 wait complete. 2024-09-19T06:16:12.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.607+0000 7f4796c00640 1 Processor -- start 2024-09-19T06:16:12.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.607+0000 7f4796c00640 1 -- start start 2024-09-19T06:16:12.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.607+0000 7f4796c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4790074510 0x7f479019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:12.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.607+0000 7f4796c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4790074e30 0x7f479019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:12.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.607+0000 7f4796c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f479010e450 0x7f479019efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:12.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.607+0000 7f4796c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f47901141b0 con 0x7f4790074510 2024-09-19T06:16:12.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.607+0000 7f4796c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4790114030 con 0x7f479010e450 2024-09-19T06:16:12.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.607+0000 7f4796c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4790114330 con 0x7f4790074e30 2024-09-19T06:16:12.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.608+0000 7f478fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4790074510 0x7f479019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:12.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.608+0000 7f478fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4790074510 0x7f479019a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60678/0 (socket says 172.21.15.3:60678) 2024-09-19T06:16:12.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.608+0000 7f478fe00640 1 -- 172.21.15.3:0/1708811424 learned_addr learned my addr 172.21.15.3:0/1708811424 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:12.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.608+0000 7f4794c00640 1 --2- 172.21.15.3:0/1708811424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f479010e450 0x7f479019efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:12.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.608+0000 7f4787400640 1 --2- 172.21.15.3:0/1708811424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4790074e30 0x7f479019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:12.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.608+0000 7f478fe00640 1 -- 172.21.15.3:0/1708811424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4790074e30 msgr2=0x7f479019ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:12.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.608+0000 7f478fe00640 1 --2- 172.21.15.3:0/1708811424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4790074e30 0x7f479019ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.608+0000 7f478fe00640 1 -- 172.21.15.3:0/1708811424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f479010e450 msgr2=0x7f479019efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:12.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.608+0000 7f478fe00640 1 --2- 172.21.15.3:0/1708811424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f479010e450 0x7f479019efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.608+0000 7f478fe00640 1 -- 172.21.15.3:0/1708811424 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f479019f6a0 con 0x7f4790074510 2024-09-19T06:16:12.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.608+0000 7f478fe00640 1 --2- 172.21.15.3:0/1708811424 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4790074510 0x7f479019a6f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4780004770 tx=0x7f4780003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:12.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.609+0000 7f478d600640 1 -- 172.21.15.3:0/1708811424 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478003f070 con 0x7f4790074510 2024-09-19T06:16:12.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.609+0000 7f4796c00640 1 -- 172.21.15.3:0/1708811424 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f479019f930 con 0x7f4790074510 2024-09-19T06:16:12.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.609+0000 7f478d600640 1 -- 172.21.15.3:0/1708811424 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4780031ca0 con 0x7f4790074510 2024-09-19T06:16:12.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.609+0000 7f478d600640 1 -- 172.21.15.3:0/1708811424 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4780035030 con 0x7f4790074510 2024-09-19T06:16:12.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.609+0000 7f4796c00640 1 -- 172.21.15.3:0/1708811424 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47901a7270 con 0x7f4790074510 2024-09-19T06:16:12.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.612+0000 7f47996c3740 1 Processor -- start 2024-09-19T06:16:12.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.612+0000 7f478d600640 1 -- 172.21.15.3:0/1708811424 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f4780042070 con 0x7f4790074510 2024-09-19T06:16:12.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.612+0000 7f47996c3740 1 -- start start 2024-09-19T06:16:12.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.613+0000 7f47996c3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561511c6b90 0x5561511c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:12.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.613+0000 7f47996c3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c74b0 0x5561511d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:12.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.613+0000 7f47996c3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561511d1d70 0x5561511d4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:12.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.613+0000 7f47996c3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55615112d3e0 con 0x5561511c74b0 2024-09-19T06:16:12.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.613+0000 7f47996c3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5561510d4d80 con 0x5561511c6b90 2024-09-19T06:16:12.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.613+0000 7f47996c3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5561511293a0 con 0x5561511d1d70 2024-09-19T06:16:12.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.613+0000 7f478fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c74b0 0x5561511d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:12.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.613+0000 7f4794c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561511c6b90 0x5561511c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:12.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.613+0000 7f478fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c74b0 0x5561511d1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60690/0 (socket says 172.21.15.3:60690) 2024-09-19T06:16:12.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.613+0000 7f478fe00640 1 -- 172.21.15.3:0/1593390983 learned_addr learned my addr 172.21.15.3:0/1593390983 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:12.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.613+0000 7f4787400640 1 --2- 172.21.15.3:0/1593390983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561511d1d70 0x5561511d4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:12.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.614+0000 7f4794c00640 1 -- 172.21.15.3:0/1593390983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561511d1d70 msgr2=0x5561511d4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:12.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.614+0000 7f4794c00640 1 --2- 172.21.15.3:0/1593390983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561511d1d70 0x5561511d4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.614+0000 7f4794c00640 1 -- 172.21.15.3:0/1593390983 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c74b0 msgr2=0x5561511d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:12.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.614+0000 7f4794c00640 1 --2- 172.21.15.3:0/1593390983 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c74b0 0x5561511d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.614+0000 7f4794c00640 1 -- 172.21.15.3:0/1593390983 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561510f3ae0 con 0x5561511c6b90 2024-09-19T06:16:12.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.614+0000 7f4794c00640 1 --2- 172.21.15.3:0/1593390983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561511c6b90 0x5561511c6f70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4788005fd0 tx=0x7f47880107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84d1786e952faf39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:12.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.614+0000 7f478d600640 1 --2- 172.21.15.3:0/1708811424 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f47740a33b0 0x7f47740a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:12.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.614+0000 7f4785200640 1 -- 172.21.15.3:0/1593390983 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4788004d20 con 0x5561511c6b90 2024-09-19T06:16:12.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.614+0000 7f4785200640 1 -- 172.21.15.3:0/1593390983 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4788015070 con 0x5561511c6b90 2024-09-19T06:16:12.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.614+0000 7f4785200640 1 -- 172.21.15.3:0/1593390983 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4788005020 con 0x5561511c6b90 2024-09-19T06:16:12.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.614+0000 7f478d600640 1 -- 172.21.15.3:0/1708811424 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f47800f0170 con 0x7f4790074510 2024-09-19T06:16:12.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.615+0000 7f478fe00640 1 --2- 172.21.15.3:0/1708811424 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f47740a33b0 0x7f47740a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:12.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.615+0000 7f47996c3740 1 -- 172.21.15.3:0/1593390983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561511c6b90 msgr2=0x5561511c6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:12.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.615+0000 7f47996c3740 1 --2- 172.21.15.3:0/1593390983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561511c6b90 0x5561511c6f70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4788005fd0 tx=0x7f47880107a0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.615+0000 7f47996c3740 1 -- 172.21.15.3:0/1593390983 shutdown_connections 2024-09-19T06:16:12.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.615+0000 7f47996c3740 1 --2- 172.21.15.3:0/1593390983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561511d1d70 0x5561511d4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.615+0000 7f47996c3740 1 --2- 172.21.15.3:0/1593390983 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c74b0 0x5561511d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.615+0000 7f47996c3740 1 --2- 172.21.15.3:0/1593390983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561511c6b90 0x5561511c6f70 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.615+0000 7f47996c3740 1 -- 172.21.15.3:0/1593390983 >> 172.21.15.3:0/1593390983 conn(0x5561511c3120 msgr2=0x5561511c3500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:12.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.615+0000 7f478fe00640 1 --2- 172.21.15.3:0/1708811424 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f47740a33b0 0x7f47740a5870 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f47800b8900 tx=0x7f47800f3c20 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:12.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.615+0000 7f47996c3740 1 -- 172.21.15.3:0/1593390983 shutdown_connections 2024-09-19T06:16:12.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.615+0000 7f47996c3740 1 -- 172.21.15.3:0/1593390983 wait complete. 2024-09-19T06:16:12.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.616+0000 7f47996c3740 1 -- start start 2024-09-19T06:16:12.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.616+0000 7f47996c3740 1 Processor -- start 2024-09-19T06:16:12.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.616+0000 7f47996c3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c6b90 0x5561511cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:12.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.617+0000 7f47996c3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561511c74b0 0x5561511cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:12.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.617+0000 7f47996c3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561511d1d70 0x5561511cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:12.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.617+0000 7f47996c3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5561511d49e0 con 0x5561511c6b90 2024-09-19T06:16:12.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.617+0000 7f47996c3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5561510e80f0 con 0x5561511c74b0 2024-09-19T06:16:12.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.617+0000 7f47996c3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5561511d4b60 con 0x5561511d1d70 2024-09-19T06:16:12.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.617+0000 7f47996c3740 10 client.0 _ll_register_callbacks cb 0x5561510d99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:12.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.617+0000 7f4794c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c6b90 0x5561511cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:12.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.617+0000 7f4787400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561511c74b0 0x5561511cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:12.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.617+0000 7f4794c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c6b90 0x5561511cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60694/0 (socket says 172.21.15.3:60694) 2024-09-19T06:16:12.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.617+0000 7f4794c00640 1 -- 172.21.15.3:0/1248042487 learned_addr learned my addr 172.21.15.3:0/1248042487 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:12.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.617+0000 7f4787400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561511c74b0 0x5561511cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55916/0 (socket says 172.21.15.3:55916) 2024-09-19T06:16:12.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.617+0000 7f4794c00640 1 --2- 172.21.15.3:0/1248042487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561511d1d70 0x5561511cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:12.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.617+0000 7f4787400640 1 -- 172.21.15.3:0/1248042487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561511d1d70 msgr2=0x5561511cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:12.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.617+0000 7f4787400640 1 --2- 172.21.15.3:0/1248042487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561511d1d70 0x5561511cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.617+0000 7f4787400640 1 -- 172.21.15.3:0/1248042487 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c6b90 msgr2=0x5561511cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:12.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.617+0000 7f4787400640 1 --2- 172.21.15.3:0/1248042487 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c6b90 0x5561511cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.618+0000 7f4787400640 1 -- 172.21.15.3:0/1248042487 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556150e9e3c0 con 0x5561511c74b0 2024-09-19T06:16:12.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.618+0000 7f4794c00640 1 --2- 172.21.15.3:0/1248042487 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c6b90 0x5561511cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:12.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.618+0000 7f4787400640 1 --2- 172.21.15.3:0/1248042487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561511c74b0 0x5561511cf150 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f477800baa0 tx=0x7f477800bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=736014490428f6b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:12.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.618+0000 7f477d600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:16:12.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.618+0000 7f477d600640 1 -- 172.21.15.3:0/1248042487 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4778003df0 con 0x5561511c74b0 2024-09-19T06:16:12.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.618+0000 7f47996c3740 1 -- 172.21.15.3:0/1248042487 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4788015070 con 0x5561511c74b0 2024-09-19T06:16:12.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.618+0000 7f477d600640 1 -- 172.21.15.3:0/1248042487 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f4778005020 con 0x5561511c74b0 2024-09-19T06:16:12.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.619+0000 7f477d600640 1 -- 172.21.15.3:0/1248042487 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4778005260 con 0x5561511c74b0 2024-09-19T06:16:12.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.619+0000 7f47996c3740 10 client.26342 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:12.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.619+0000 7f47996c3740 1 -- 172.21.15.3:0/1248042487 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5561511e0720 con 0x5561511c74b0 2024-09-19T06:16:12.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.619+0000 7f477d600640 1 -- 172.21.15.3:0/1248042487 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4788015070 con 0x5561511c74b0 2024-09-19T06:16:12.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.619+0000 7f477d600640 1 -- 172.21.15.3:0/1248042487 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4778024510 con 0x5561511c74b0 2024-09-19T06:16:12.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.619+0000 7f47996c3740 10 client.26342 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:12.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.619+0000 7f47996c3740 10 client.26342 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:12.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.619+0000 7f47996c3740 20 client.26342 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:12.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.619+0000 7f47996c3740 1 --2- 172.21.15.3:0/1248042487 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5561511e1b30 0x5561511e3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:12.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.619+0000 7f47996c3740 4 client.26342 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:12.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.619+0000 7f47996c3740 1 -- 172.21.15.3:0/1248042487 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55615113a950 con 0x5561511e1b30 2024-09-19T06:16:12.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.620+0000 7f4794c00640 1 --2- 172.21.15.3:0/1248042487 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5561511e1b30 0x5561511e3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:12.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.620+0000 7f4794c00640 1 --2- 172.21.15.3:0/1248042487 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5561511e1b30 0x5561511e3f20 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf81c3e6c2c737f server_cookie=8fe32b6756e2e18e in_seq=0 out_seq=0 2024-09-19T06:16:12.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.620+0000 7f477d600640 10 client.26342 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:12.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.621+0000 7f477d600640 1 -- 172.21.15.3:0/1248042487 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55615113a950 con 0x5561511e1b30 2024-09-19T06:16:12.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.621+0000 7f477d600640 10 client.26342 handle_command_reply: tid=0 2024-09-19T06:16:12.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.621+0000 7f47996c3740 1 client.26342 shutdown 2024-09-19T06:16:12.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.622+0000 7f47996c3740 1 -- 172.21.15.3:0/1248042487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561511c74b0 msgr2=0x5561511cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:12.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.622+0000 7f47996c3740 1 --2- 172.21.15.3:0/1248042487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561511c74b0 0x5561511cf150 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f477800baa0 tx=0x7f477800bf60 comp rx=0 tx=0).stop 2024-09-19T06:16:12.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.622+0000 7f47996c3740 1 -- 172.21.15.3:0/1248042487 shutdown_connections 2024-09-19T06:16:12.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.622+0000 7f47996c3740 1 --2- 172.21.15.3:0/1248042487 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5561511e1b30 0x5561511e3f20 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.622+0000 7f47996c3740 1 --2- 172.21.15.3:0/1248042487 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561511d1d70 0x5561511cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.622+0000 7f47996c3740 1 --2- 172.21.15.3:0/1248042487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561511c74b0 0x5561511cf150 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.622+0000 7f47996c3740 1 --2- 172.21.15.3:0/1248042487 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c6b90 0x5561511cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.622+0000 7f47996c3740 1 -- 172.21.15.3:0/1248042487 >> 172.21.15.3:0/1248042487 conn(0x5561511c3120 msgr2=0x5561511c8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:12.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.622+0000 7f477d600640 0 client.26342 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:12.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.622+0000 7f47996c3740 1 -- 172.21.15.3:0/1248042487 shutdown_connections 2024-09-19T06:16:12.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.622+0000 7f47996c3740 1 -- 172.21.15.3:0/1248042487 wait complete. 2024-09-19T06:16:12.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.622+0000 7f47996c3740 20 client.26342 trim_cache size 0 max 16384 2024-09-19T06:16:12.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.640+0000 7f47996c3740 1 Processor -- start 2024-09-19T06:16:12.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.640+0000 7f47996c3740 1 -- start start 2024-09-19T06:16:12.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.640+0000 7f47996c3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561511c6b90 0x5561511c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:12.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.640+0000 7f47996c3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c74b0 0x5561511d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:12.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.640+0000 7f47996c3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561511d1d70 0x5561511e97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:12.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.640+0000 7f47996c3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f47901afb70 con 0x5561511c74b0 2024-09-19T06:16:12.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.640+0000 7f47996c3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f47901b16b0 con 0x5561511d1d70 2024-09-19T06:16:12.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.640+0000 7f47996c3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f47901b0240 con 0x5561511c6b90 2024-09-19T06:16:12.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.641+0000 7f4794c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561511c6b90 0x5561511c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:12.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.641+0000 7f4794c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561511c6b90 0x5561511c95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:45920/0 (socket says 172.21.15.3:45920) 2024-09-19T06:16:12.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.641+0000 7f4794c00640 1 -- 172.21.15.3:0/1508129815 learned_addr learned my addr 172.21.15.3:0/1508129815 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:12.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.641+0000 7f4794c00640 1 --2- 172.21.15.3:0/1508129815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561511d1d70 0x5561511e97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:12.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.641+0000 7f4787400640 1 --2- 172.21.15.3:0/1508129815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c74b0 0x5561511d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:12.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.641+0000 7f4794c00640 1 -- 172.21.15.3:0/1508129815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561511d1d70 msgr2=0x5561511e97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:12.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.641+0000 7f4794c00640 1 --2- 172.21.15.3:0/1508129815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561511d1d70 0x5561511e97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.641+0000 7f4794c00640 1 -- 172.21.15.3:0/1508129815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c74b0 msgr2=0x5561511d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:12.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.641+0000 7f4794c00640 1 --2- 172.21.15.3:0/1508129815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c74b0 0x5561511d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.641+0000 7f4794c00640 1 -- 172.21.15.3:0/1508129815 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561511c72e0 con 0x5561511c6b90 2024-09-19T06:16:12.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.641+0000 7f4794c00640 1 --2- 172.21.15.3:0/1508129815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561511c6b90 0x5561511c95f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4788009990 tx=0x7f47880045d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=710d65e509055f67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:12.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.642+0000 7f477fe00640 1 -- 172.21.15.3:0/1508129815 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4788024040 con 0x5561511c6b90 2024-09-19T06:16:12.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.642+0000 7f477fe00640 1 -- 172.21.15.3:0/1508129815 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4788015070 con 0x5561511c6b90 2024-09-19T06:16:12.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.642+0000 7f477fe00640 1 -- 172.21.15.3:0/1508129815 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4788005030 con 0x5561511c6b90 2024-09-19T06:16:12.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.642+0000 7f47996c3740 1 -- 172.21.15.3:0/1508129815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561511c6b90 msgr2=0x5561511c95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:12.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.642+0000 7f47996c3740 1 --2- 172.21.15.3:0/1508129815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561511c6b90 0x5561511c95f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4788009990 tx=0x7f47880045d0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.642+0000 7f47996c3740 1 -- 172.21.15.3:0/1508129815 shutdown_connections 2024-09-19T06:16:12.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.642+0000 7f47996c3740 1 --2- 172.21.15.3:0/1508129815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561511d1d70 0x5561511e97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.642+0000 7f47996c3740 1 --2- 172.21.15.3:0/1508129815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c74b0 0x5561511d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.642+0000 7f47996c3740 1 --2- 172.21.15.3:0/1508129815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561511c6b90 0x5561511c95f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.642+0000 7f47996c3740 1 -- 172.21.15.3:0/1508129815 >> 172.21.15.3:0/1508129815 conn(0x5561511c3120 msgr2=0x5561511d0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:12.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.643+0000 7f47996c3740 1 -- 172.21.15.3:0/1508129815 shutdown_connections 2024-09-19T06:16:12.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.643+0000 7f47996c3740 1 -- 172.21.15.3:0/1508129815 wait complete. 2024-09-19T06:16:12.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.643+0000 7f47996c3740 1 -- start start 2024-09-19T06:16:12.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.643+0000 7f47996c3740 1 Processor -- start 2024-09-19T06:16:12.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.644+0000 7f47996c3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561511c6b90 0x5561511da5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:12.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.644+0000 7f47996c3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c74b0 0x5561511d58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:12.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.644+0000 7f47996c3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561511d1d70 0x5561511d5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:12.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.644+0000 7f47996c3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f47901b0fe0 con 0x5561511c74b0 2024-09-19T06:16:12.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.644+0000 7f47996c3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f47901b0910 con 0x5561511c6b90 2024-09-19T06:16:12.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.644+0000 7f47996c3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f47901adb50 con 0x5561511d1d70 2024-09-19T06:16:12.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.644+0000 7f47996c3740 10 client.0 _ll_register_callbacks cb 0x7f4778004340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:12.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.644+0000 7f4787400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c74b0 0x5561511d58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:12.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.644+0000 7f4787400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c74b0 0x5561511d58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60716/0 (socket says 172.21.15.3:60716) 2024-09-19T06:16:12.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.644+0000 7f4787400640 1 -- 172.21.15.3:0/3150584396 learned_addr learned my addr 172.21.15.3:0/3150584396 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:12.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.644+0000 7f4794c00640 1 --2- 172.21.15.3:0/3150584396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561511c6b90 0x5561511da5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:12.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.644+0000 7f4794c00640 1 --2- 172.21.15.3:0/3150584396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561511d1d70 0x5561511d5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:12.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.645+0000 7f4787400640 1 -- 172.21.15.3:0/3150584396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561511d1d70 msgr2=0x5561511d5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:12.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.645+0000 7f4787400640 1 --2- 172.21.15.3:0/3150584396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561511d1d70 0x5561511d5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.645+0000 7f4787400640 1 -- 172.21.15.3:0/3150584396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561511c6b90 msgr2=0x5561511da5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:12.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.645+0000 7f4787400640 1 --2- 172.21.15.3:0/3150584396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561511c6b90 0x5561511da5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.645+0000 7f4787400640 1 -- 172.21.15.3:0/3150584396 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561511d6660 con 0x5561511c74b0 2024-09-19T06:16:12.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.645+0000 7f4794c00640 1 --2- 172.21.15.3:0/3150584396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561511d1d70 0x5561511d5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:12.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.645+0000 7f4787400640 1 --2- 172.21.15.3:0/3150584396 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c74b0 0x5561511d58d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x5561511d0250 tx=0x7f4778005cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c455d9aaaf5cba5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:12.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.645+0000 7f477d600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:16:12.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.645+0000 7f477d600640 1 -- 172.21.15.3:0/3150584396 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4778033060 con 0x5561511c74b0 2024-09-19T06:16:12.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.645+0000 7f477d600640 1 -- 172.21.15.3:0/3150584396 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f4778024480 con 0x5561511c74b0 2024-09-19T06:16:12.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.645+0000 7f47996c3740 1 -- 172.21.15.3:0/3150584396 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4788015070 con 0x5561511c74b0 2024-09-19T06:16:12.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.646+0000 7f477d600640 1 -- 172.21.15.3:0/3150584396 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f477802a040 con 0x5561511c74b0 2024-09-19T06:16:12.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.646+0000 7f47996c3740 10 client.16305 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:12.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.646+0000 7f47996c3740 1 -- 172.21.15.3:0/3150584396 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55615124c850 con 0x5561511c74b0 2024-09-19T06:16:12.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.646+0000 7f477d600640 1 -- 172.21.15.3:0/3150584396 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4788015070 con 0x5561511c74b0 2024-09-19T06:16:12.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.646+0000 7f477d600640 1 -- 172.21.15.3:0/3150584396 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f477801ba70 con 0x5561511c74b0 2024-09-19T06:16:12.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.646+0000 7f47996c3740 10 client.16305 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:12.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.646+0000 7f47996c3740 10 client.16305 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:12.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.646+0000 7f47996c3740 20 client.16305 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:12.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.646+0000 7f47996c3740 1 --2- 172.21.15.3:0/3150584396 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55615124d000 0x55615124f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:12.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.646+0000 7f47996c3740 4 client.16305 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:16:12.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.646+0000 7f47996c3740 1 -- 172.21.15.3:0/3150584396 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556151134e60 con 0x55615124d000 2024-09-19T06:16:12.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.647+0000 7f4794c00640 1 --2- 172.21.15.3:0/3150584396 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55615124d000 0x55615124f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:12.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.647+0000 7f4794c00640 1 --2- 172.21.15.3:0/3150584396 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55615124d000 0x55615124f420 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1db50a73baaec1a8 server_cookie=e7bc018bb12694a9 in_seq=0 out_seq=0 2024-09-19T06:16:12.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.647+0000 7f477d600640 10 client.16305 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:12.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.647+0000 7f477d600640 1 -- 172.21.15.3:0/3150584396 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x556151134e60 con 0x55615124d000 2024-09-19T06:16:12.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.647+0000 7f477d600640 10 client.16305 handle_command_reply: tid=0 2024-09-19T06:16:12.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.647+0000 7f47996c3740 1 client.16305 shutdown 2024-09-19T06:16:12.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.648+0000 7f47996c3740 1 -- 172.21.15.3:0/3150584396 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c74b0 msgr2=0x5561511d58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:12.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.648+0000 7f47996c3740 1 --2- 172.21.15.3:0/3150584396 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c74b0 0x5561511d58d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x5561511d0250 tx=0x7f4778005cd0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.648+0000 7f47996c3740 1 -- 172.21.15.3:0/3150584396 shutdown_connections 2024-09-19T06:16:12.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.648+0000 7f47996c3740 1 --2- 172.21.15.3:0/3150584396 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55615124d000 0x55615124f420 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.648+0000 7f47996c3740 1 --2- 172.21.15.3:0/3150584396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561511d1d70 0x5561511d5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.648+0000 7f47996c3740 1 --2- 172.21.15.3:0/3150584396 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561511c74b0 0x5561511d58d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.648+0000 7f47996c3740 1 --2- 172.21.15.3:0/3150584396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561511c6b90 0x5561511da5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.648+0000 7f47996c3740 1 -- 172.21.15.3:0/3150584396 >> 172.21.15.3:0/3150584396 conn(0x5561511c3120 msgr2=0x5561511d0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:12.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.648+0000 7f477d600640 0 client.16305 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:12.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.648+0000 7f47996c3740 1 -- 172.21.15.3:0/3150584396 shutdown_connections 2024-09-19T06:16:12.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.648+0000 7f47996c3740 1 -- 172.21.15.3:0/3150584396 wait complete. 2024-09-19T06:16:12.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.648+0000 7f47996c3740 20 client.16305 trim_cache size 0 max 16384 2024-09-19T06:16:12.728 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:16:12.728 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:16:12.729 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": { 2024-09-19T06:16:12.729 INFO:teuthology.orchestra.run.smithi003.stdout: "6c4bcec1-ea1e-4139-8324-4610857e99ff": { 2024-09-19T06:16:12.729 INFO:teuthology.orchestra.run.smithi003.stdout: "path": "/", 2024-09-19T06:16:12.729 INFO:teuthology.orchestra.run.smithi003.stdout: "tag": "6c4bcec1-ea1e-4139-8324-4610857e99ff", 2024-09-19T06:16:12.729 INFO:teuthology.orchestra.run.smithi003.stdout: "options": "recursive,force" 2024-09-19T06:16:12.729 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:16:12.729 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:16:12.729 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:16:12.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.649+0000 7f4796c00640 1 -- 172.21.15.3:0/1708811424 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f47740a33b0 msgr2=0x7f47740a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:12.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.649+0000 7f4796c00640 1 --2- 172.21.15.3:0/1708811424 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f47740a33b0 0x7f47740a5870 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f47800b8900 tx=0x7f47800f3c20 comp rx=0 tx=0).stop 2024-09-19T06:16:12.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.649+0000 7f4796c00640 1 -- 172.21.15.3:0/1708811424 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4790074510 msgr2=0x7f479019a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:12.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.649+0000 7f4796c00640 1 --2- 172.21.15.3:0/1708811424 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4790074510 0x7f479019a6f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f4780004770 tx=0x7f4780003c10 comp rx=0 tx=0).stop 2024-09-19T06:16:12.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.649+0000 7f4796c00640 1 -- 172.21.15.3:0/1708811424 shutdown_connections 2024-09-19T06:16:12.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.649+0000 7f4796c00640 1 --2- 172.21.15.3:0/1708811424 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f47740a33b0 0x7f47740a5870 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.649+0000 7f4796c00640 1 --2- 172.21.15.3:0/1708811424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f479010e450 0x7f479019efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.649+0000 7f4796c00640 1 --2- 172.21.15.3:0/1708811424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4790074e30 0x7f479019ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.649+0000 7f4796c00640 1 --2- 172.21.15.3:0/1708811424 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4790074510 0x7f479019a6f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:12.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.649+0000 7f4796c00640 1 -- 172.21.15.3:0/1708811424 >> 172.21.15.3:0/1708811424 conn(0x7f47900fd8b0 msgr2=0x7f47900fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:12.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.649+0000 7f4796c00640 1 -- 172.21.15.3:0/1708811424 shutdown_connections 2024-09-19T06:16:12.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:12.649+0000 7f4796c00640 1 -- 172.21.15.3:0/1708811424 wait complete. 2024-09-19T06:16:13.708 INFO:tasks.cephfs.filesystem:scrub status for tag:6c4bcec1-ea1e-4139-8324-4610857e99ff - {'path': '/', 'tag': '6c4bcec1-ea1e-4139-8324-4610857e99ff', 'options': 'recursive,force'} 2024-09-19T06:16:14.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:14 smithi059 ceph-mon[35138]: pgmap v118: 97 pgs: 97 active+clean; 4.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 KiB/s wr, 27 op/s 2024-09-19T06:16:14.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:14 smithi003 ceph-mon[30893]: pgmap v118: 97 pgs: 97 active+clean; 4.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 KiB/s wr, 27 op/s 2024-09-19T06:16:14.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:14 smithi071 ceph-mon[35662]: pgmap v118: 97 pgs: 97 active+clean; 4.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 KiB/s wr, 27 op/s 2024-09-19T06:16:15.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:15 smithi059 ceph-mon[35138]: scrub summary: idle 2024-09-19T06:16:15.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:15 smithi003 ceph-mon[30893]: scrub summary: idle 2024-09-19T06:16:15.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:15 smithi071 ceph-mon[35662]: scrub summary: idle 2024-09-19T06:16:16.487 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:16 smithi071 ceph-mon[35662]: pgmap v119: 97 pgs: 97 active+clean; 4.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 66 KiB/s wr, 38 op/s 2024-09-19T06:16:16.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:16 smithi059 ceph-mon[35138]: pgmap v119: 97 pgs: 97 active+clean; 4.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 66 KiB/s wr, 38 op/s 2024-09-19T06:16:16.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:16 smithi003 ceph-mon[30893]: pgmap v119: 97 pgs: 97 active+clean; 4.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 66 KiB/s wr, 38 op/s 2024-09-19T06:16:18.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:18 smithi059 ceph-mon[35138]: pgmap v120: 97 pgs: 97 active+clean; 4.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 17 op/s 2024-09-19T06:16:18.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:18 smithi003 ceph-mon[30893]: pgmap v120: 97 pgs: 97 active+clean; 4.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 17 op/s 2024-09-19T06:16:18.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:18 smithi071 ceph-mon[35662]: pgmap v120: 97 pgs: 97 active+clean; 4.8 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 17 op/s 2024-09-19T06:16:20.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:20 smithi059 ceph-mon[35138]: pgmap v121: 97 pgs: 97 active+clean; 4.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-19T06:16:20.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:20 smithi003 ceph-mon[30893]: pgmap v121: 97 pgs: 97 active+clean; 4.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-19T06:16:20.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:20 smithi071 ceph-mon[35662]: pgmap v121: 97 pgs: 97 active+clean; 4.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-09-19T06:16:22.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:22 smithi059 ceph-mon[35138]: pgmap v122: 97 pgs: 97 active+clean; 4.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 32 KiB/s wr, 17 op/s 2024-09-19T06:16:22.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:22 smithi003 ceph-mon[30893]: pgmap v122: 97 pgs: 97 active+clean; 4.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 32 KiB/s wr, 17 op/s 2024-09-19T06:16:22.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:22 smithi071 ceph-mon[35662]: pgmap v122: 97 pgs: 97 active+clean; 4.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 32 KiB/s wr, 17 op/s 2024-09-19T06:16:22.733 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.731+0000 7ffbc6400640 1 -- 172.21.15.3:0/3776191841 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbc0109080 msgr2=0x7ffbc0110bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:22.733 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.731+0000 7ffbc6400640 1 --2- 172.21.15.3:0/3776191841 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbc0109080 0x7ffbc0110bd0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009ca0 tx=0x7ffbb802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.733 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.731+0000 7ffbc6400640 1 -- 172.21.15.3:0/3776191841 shutdown_connections 2024-09-19T06:16:22.733 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.731+0000 7ffbc6400640 1 --2- 172.21.15.3:0/3776191841 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbc0109080 0x7ffbc0110bd0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.733 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.731+0000 7ffbc6400640 1 --2- 172.21.15.3:0/3776191841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbc01048e0 0x7ffbc0108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.731+0000 7ffbc6400640 1 --2- 172.21.15.3:0/3776191841 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc0103f30 0x7ffbc0104310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.731+0000 7ffbc6400640 1 -- 172.21.15.3:0/3776191841 >> 172.21.15.3:0/3776191841 conn(0x7ffbc00ff980 msgr2=0x7ffbc0101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.731+0000 7ffbc6400640 1 -- 172.21.15.3:0/3776191841 shutdown_connections 2024-09-19T06:16:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.731+0000 7ffbc6400640 1 -- 172.21.15.3:0/3776191841 wait complete. 2024-09-19T06:16:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.732+0000 7ffbc6400640 1 Processor -- start 2024-09-19T06:16:22.735 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.732+0000 7ffbc6400640 1 -- start start 2024-09-19T06:16:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.733+0000 7ffbc6400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc0103f30 0x7ffbc019a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.733+0000 7ffbc6400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbc0109080 0x7ffbc019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.733+0000 7ffbc6400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbc019ee30 0x7ffbc019f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.733+0000 7ffbc6400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc01140a0 con 0x7ffbc019ee30 2024-09-19T06:16:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.733+0000 7ffbc6400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc0113f20 con 0x7ffbc0109080 2024-09-19T06:16:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.733+0000 7ffbc6400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc0114220 con 0x7ffbc0103f30 2024-09-19T06:16:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.733+0000 7ffbbfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbc019ee30 0x7ffbc019f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.733+0000 7ffbbfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbc019ee30 0x7ffbc019f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32980/0 (socket says 172.21.15.3:32980) 2024-09-19T06:16:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.733+0000 7ffbbfe00640 1 -- 172.21.15.3:0/1383447849 learned_addr learned my addr 172.21.15.3:0/1383447849 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.733+0000 7ffbb7e00640 1 --2- 172.21.15.3:0/1383447849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbc0109080 0x7ffbc019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.733+0000 7ffbbf400640 1 --2- 172.21.15.3:0/1383447849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc0103f30 0x7ffbc019a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.733+0000 7ffbbfe00640 1 -- 172.21.15.3:0/1383447849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc0103f30 msgr2=0x7ffbc019a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.733+0000 7ffbbfe00640 1 --2- 172.21.15.3:0/1383447849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc0103f30 0x7ffbc019a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.737 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.733+0000 7ffbbfe00640 1 -- 172.21.15.3:0/1383447849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbc0109080 msgr2=0x7ffbc019aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:22.737 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.733+0000 7ffbbfe00640 1 --2- 172.21.15.3:0/1383447849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbc0109080 0x7ffbc019aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.737 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.733+0000 7ffbbfe00640 1 -- 172.21.15.3:0/1383447849 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc019f920 con 0x7ffbc019ee30 2024-09-19T06:16:22.737 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.733+0000 7ffbb7e00640 1 --2- 172.21.15.3:0/1383447849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbc0109080 0x7ffbc019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:22.737 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.734+0000 7ffbbfe00640 1 --2- 172.21.15.3:0/1383447849 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbc019ee30 0x7ffbc019f2e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8031a20 tx=0x7ffbb8031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:22.738 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.734+0000 7ffbbcc00640 1 -- 172.21.15.3:0/1383447849 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8003b70 con 0x7ffbc019ee30 2024-09-19T06:16:22.738 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.734+0000 7ffbc6400640 1 -- 172.21.15.3:0/1383447849 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc019fbb0 con 0x7ffbc019ee30 2024-09-19T06:16:22.738 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.734+0000 7ffbbcc00640 1 -- 172.21.15.3:0/1383447849 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbb8003d10 con 0x7ffbc019ee30 2024-09-19T06:16:22.738 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.734+0000 7ffbbcc00640 1 -- 172.21.15.3:0/1383447849 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb802fc40 con 0x7ffbc019ee30 2024-09-19T06:16:22.738 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.734+0000 7ffbc6400640 1 -- 172.21.15.3:0/1383447849 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc01a7400 con 0x7ffbc019ee30 2024-09-19T06:16:22.739 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.737+0000 7ffbbcc00640 1 -- 172.21.15.3:0/1383447849 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7ffbb8004050 con 0x7ffbc019ee30 2024-09-19T06:16:22.739 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.737+0000 7ffbc91e8740 1 Processor -- start 2024-09-19T06:16:22.739 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.738+0000 7ffbc91e8740 1 -- start start 2024-09-19T06:16:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.738+0000 7ffbc91e8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e864bfc1e0 0x55e864bfc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.738+0000 7ffbc91e8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864bfcb00 0x55e864c06e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.738+0000 7ffbc91e8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e864c073a0 0x55e864c09790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.738+0000 7ffbc91e8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e864b62100 con 0x55e864bfcb00 2024-09-19T06:16:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.738+0000 7ffbc91e8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e864b0a1b0 con 0x55e864c073a0 2024-09-19T06:16:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.738+0000 7ffbc91e8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e864b5e0c0 con 0x55e864bfc1e0 2024-09-19T06:16:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.738+0000 7ffbbf400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864bfcb00 0x55e864c06e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.738+0000 7ffbb7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e864bfc1e0 0x55e864bfc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.738+0000 7ffbbf400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864bfcb00 0x55e864c06e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32982/0 (socket says 172.21.15.3:32982) 2024-09-19T06:16:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.738+0000 7ffbbf400640 1 -- 172.21.15.3:0/3925008225 learned_addr learned my addr 172.21.15.3:0/3925008225 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.739+0000 7ffbb7e00640 1 --2- 172.21.15.3:0/3925008225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e864c073a0 0x55e864c09790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.739+0000 7ffbbf400640 1 -- 172.21.15.3:0/3925008225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e864bfc1e0 msgr2=0x55e864bfc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.739+0000 7ffbbf400640 1 --2- 172.21.15.3:0/3925008225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e864bfc1e0 0x55e864bfc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.739+0000 7ffbbf400640 1 -- 172.21.15.3:0/3925008225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e864c073a0 msgr2=0x55e864c09790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.739+0000 7ffbbf400640 1 --2- 172.21.15.3:0/3925008225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e864c073a0 0x55e864c09790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.739+0000 7ffbbf400640 1 -- 172.21.15.3:0/3925008225 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e864875210 con 0x55e864bfcb00 2024-09-19T06:16:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.739+0000 7ffbbf400640 1 --2- 172.21.15.3:0/3925008225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864bfcb00 0x55e864c06e60 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0009cf0 tx=0x7ffbb0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165bf96f073a3fac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.739+0000 7ffbbcc00640 1 --2- 172.21.15.3:0/1383447849 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ffba40a33b0 0x7ffba40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.742 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.739+0000 7ffbb4c00640 1 -- 172.21.15.3:0/3925008225 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0004230 con 0x55e864bfcb00 2024-09-19T06:16:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.739+0000 7ffbb4c00640 1 -- 172.21.15.3:0/3925008225 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbb00043d0 con 0x55e864bfcb00 2024-09-19T06:16:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.739+0000 7ffbb4c00640 1 -- 172.21.15.3:0/3925008225 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0019900 con 0x55e864bfcb00 2024-09-19T06:16:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.739+0000 7ffbbcc00640 1 -- 172.21.15.3:0/1383447849 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7ffbb80f0d80 con 0x7ffbc019ee30 2024-09-19T06:16:22.743 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.739+0000 7ffbb7e00640 1 --2- 172.21.15.3:0/1383447849 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ffba40a33b0 0x7ffba40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.740+0000 7ffbc91e8740 1 -- 172.21.15.3:0/3925008225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864bfcb00 msgr2=0x55e864c06e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.740+0000 7ffbb7e00640 1 --2- 172.21.15.3:0/1383447849 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ffba40a33b0 0x7ffba40a5870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55e864bf9ad0 tx=0x7ffba8015040 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.740+0000 7ffbc91e8740 1 --2- 172.21.15.3:0/3925008225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864bfcb00 0x55e864c06e60 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0009cf0 tx=0x7ffbb0011810 comp rx=0 tx=0).stop 2024-09-19T06:16:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.740+0000 7ffbc91e8740 1 -- 172.21.15.3:0/3925008225 shutdown_connections 2024-09-19T06:16:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.740+0000 7ffbc91e8740 1 --2- 172.21.15.3:0/3925008225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e864c073a0 0x55e864c09790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.740+0000 7ffbc91e8740 1 --2- 172.21.15.3:0/3925008225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864bfcb00 0x55e864c06e60 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.740+0000 7ffbc91e8740 1 --2- 172.21.15.3:0/3925008225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e864bfc1e0 0x55e864bfc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.740+0000 7ffbc91e8740 1 -- 172.21.15.3:0/3925008225 >> 172.21.15.3:0/3925008225 conn(0x55e864bf8750 msgr2=0x55e864bf8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.740+0000 7ffbc91e8740 1 -- 172.21.15.3:0/3925008225 shutdown_connections 2024-09-19T06:16:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.741+0000 7ffbc91e8740 1 -- 172.21.15.3:0/3925008225 wait complete. 2024-09-19T06:16:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.741+0000 7ffbc91e8740 1 -- start start 2024-09-19T06:16:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.741+0000 7ffbc91e8740 1 Processor -- start 2024-09-19T06:16:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.742+0000 7ffbc91e8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e864bfc1e0 0x55e864c042f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.742+0000 7ffbc91e8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864bfcb00 0x55e864c04830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.742+0000 7ffbc91e8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e864c073a0 0x55e864c04d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.742+0000 7ffbc91e8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e864c09f70 con 0x55e864bfcb00 2024-09-19T06:16:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.742+0000 7ffbc91e8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e864aeb090 con 0x55e864c073a0 2024-09-19T06:16:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.742+0000 7ffbc91e8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e864c0a0f0 con 0x55e864bfc1e0 2024-09-19T06:16:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.742+0000 7ffbc91e8740 10 client.0 _ll_register_callbacks cb 0x55e864b3ff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.742+0000 7ffbb7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864bfcb00 0x55e864c04830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.742+0000 7ffbb7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864bfcb00 0x55e864c04830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32998/0 (socket says 172.21.15.3:32998) 2024-09-19T06:16:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.742+0000 7ffbb7e00640 1 -- 172.21.15.3:0/386639871 learned_addr learned my addr 172.21.15.3:0/386639871 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.742+0000 7ffbbfe00640 1 --2- 172.21.15.3:0/386639871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e864c073a0 0x55e864c04d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.742+0000 7ffbbf400640 1 --2- 172.21.15.3:0/386639871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e864bfc1e0 0x55e864c042f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.742+0000 7ffbb7e00640 1 -- 172.21.15.3:0/386639871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e864bfc1e0 msgr2=0x55e864c042f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.742+0000 7ffbb7e00640 1 --2- 172.21.15.3:0/386639871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e864bfc1e0 0x55e864c042f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.742+0000 7ffbb7e00640 1 -- 172.21.15.3:0/386639871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e864c073a0 msgr2=0x55e864c04d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:22.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.742+0000 7ffbb7e00640 1 --2- 172.21.15.3:0/386639871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e864c073a0 0x55e864c04d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.742+0000 7ffbb7e00640 1 -- 172.21.15.3:0/386639871 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e864941620 con 0x55e864bfcb00 2024-09-19T06:16:22.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.742+0000 7ffbbf400640 1 --2- 172.21.15.3:0/386639871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e864bfc1e0 0x55e864c042f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:22.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.743+0000 7ffbb7e00640 1 --2- 172.21.15.3:0/386639871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864bfcb00 0x55e864c04830 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ffba800fdf0 tx=0x7ffba8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b091d929ac5334a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:22.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.743+0000 7ffbad600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:16:22.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.743+0000 7ffbad600640 1 -- 172.21.15.3:0/386639871 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba8026070 con 0x55e864bfcb00 2024-09-19T06:16:22.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.743+0000 7ffbad600640 1 -- 172.21.15.3:0/386639871 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7ffba8004220 con 0x55e864bfcb00 2024-09-19T06:16:22.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.743+0000 7ffbc91e8740 1 -- 172.21.15.3:0/386639871 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbb00043d0 con 0x55e864bfcb00 2024-09-19T06:16:22.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.743+0000 7ffbad600640 1 -- 172.21.15.3:0/386639871 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffba8004420 con 0x55e864bfcb00 2024-09-19T06:16:22.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.743+0000 7ffbc91e8740 10 client.16317 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:22.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.743+0000 7ffbc91e8740 1 -- 172.21.15.3:0/386639871 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e864c15bd0 con 0x55e864bfcb00 2024-09-19T06:16:22.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.743+0000 7ffbad600640 1 -- 172.21.15.3:0/386639871 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbb00043d0 con 0x55e864bfcb00 2024-09-19T06:16:22.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.744+0000 7ffbad600640 1 -- 172.21.15.3:0/386639871 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ffba80035f0 con 0x55e864bfcb00 2024-09-19T06:16:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.744+0000 7ffbc91e8740 10 client.16317 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.744+0000 7ffbc91e8740 10 client.16317 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.744+0000 7ffbc91e8740 20 client.16317 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.744+0000 7ffbc91e8740 1 --2- 172.21.15.3:0/386639871 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e864c17040 0x55e864c19490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.744+0000 7ffbc91e8740 4 client.16317 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.744+0000 7ffbc91e8740 1 -- 172.21.15.3:0/386639871 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e864b6f830 con 0x55e864c17040 2024-09-19T06:16:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.744+0000 7ffbbf400640 1 --2- 172.21.15.3:0/386639871 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e864c17040 0x55e864c19490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.745+0000 7ffbbf400640 1 --2- 172.21.15.3:0/386639871 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e864c17040 0x55e864c19490 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af26ea420b223dee server_cookie=3a8b9d7b5df2778d in_seq=0 out_seq=0 2024-09-19T06:16:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.745+0000 7ffbad600640 10 client.16317 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:22.751 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.746+0000 7ffbad600640 1 -- 172.21.15.3:0/386639871 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e864b6f830 con 0x55e864c17040 2024-09-19T06:16:22.751 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.746+0000 7ffbad600640 10 client.16317 handle_command_reply: tid=0 2024-09-19T06:16:22.751 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.746+0000 7ffbc91e8740 1 client.16317 shutdown 2024-09-19T06:16:22.751 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.746+0000 7ffbc91e8740 1 -- 172.21.15.3:0/386639871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864bfcb00 msgr2=0x55e864c04830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:22.751 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.746+0000 7ffbc91e8740 1 --2- 172.21.15.3:0/386639871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864bfcb00 0x55e864c04830 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ffba800fdf0 tx=0x7ffba8004730 comp rx=0 tx=0).stop 2024-09-19T06:16:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.746+0000 7ffbc91e8740 1 -- 172.21.15.3:0/386639871 shutdown_connections 2024-09-19T06:16:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.746+0000 7ffbc91e8740 1 --2- 172.21.15.3:0/386639871 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e864c17040 0x55e864c19490 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.746+0000 7ffbc91e8740 1 --2- 172.21.15.3:0/386639871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e864c073a0 0x55e864c04d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.746+0000 7ffbc91e8740 1 --2- 172.21.15.3:0/386639871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864bfcb00 0x55e864c04830 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.746+0000 7ffbc91e8740 1 --2- 172.21.15.3:0/386639871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e864bfc1e0 0x55e864c042f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.746+0000 7ffbc91e8740 1 -- 172.21.15.3:0/386639871 >> 172.21.15.3:0/386639871 conn(0x55e864bf8750 msgr2=0x55e864bfe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.746+0000 7ffbad600640 0 client.16317 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.746+0000 7ffbc91e8740 1 -- 172.21.15.3:0/386639871 shutdown_connections 2024-09-19T06:16:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.746+0000 7ffbc91e8740 1 -- 172.21.15.3:0/386639871 wait complete. 2024-09-19T06:16:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.746+0000 7ffbc91e8740 20 client.16317 trim_cache size 0 max 16384 2024-09-19T06:16:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.762+0000 7ffbc91e8740 1 Processor -- start 2024-09-19T06:16:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.762+0000 7ffbc91e8740 1 -- start start 2024-09-19T06:16:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.762+0000 7ffbc91e8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e864bfc1e0 0x55e864c1eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.762+0000 7ffbc91e8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e864bfcb00 0x55e864c1f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.762+0000 7ffbc91e8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864c073a0 0x55e864c01590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.762+0000 7ffbc91e8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc01afab0 con 0x55e864c073a0 2024-09-19T06:16:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.762+0000 7ffbc91e8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc01b15f0 con 0x55e864bfc1e0 2024-09-19T06:16:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.762+0000 7ffbc91e8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc01b0180 con 0x55e864bfcb00 2024-09-19T06:16:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.762+0000 7ffbbfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864c073a0 0x55e864c01590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.762+0000 7ffbbfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864c073a0 0x55e864c01590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33002/0 (socket says 172.21.15.3:33002) 2024-09-19T06:16:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.762+0000 7ffbbfe00640 1 -- 172.21.15.3:0/3745958518 learned_addr learned my addr 172.21.15.3:0/3745958518 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.762+0000 7ffbbf400640 1 --2- 172.21.15.3:0/3745958518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e864bfc1e0 0x55e864c1eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.762+0000 7ffbb7e00640 1 --2- 172.21.15.3:0/3745958518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e864bfcb00 0x55e864c1f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.763+0000 7ffbbfe00640 1 -- 172.21.15.3:0/3745958518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e864bfcb00 msgr2=0x55e864c1f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.763+0000 7ffbbfe00640 1 --2- 172.21.15.3:0/3745958518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e864bfcb00 0x55e864c1f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.763+0000 7ffbbfe00640 1 -- 172.21.15.3:0/3745958518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e864bfc1e0 msgr2=0x55e864c1eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.763+0000 7ffbbfe00640 1 --2- 172.21.15.3:0/3745958518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e864bfc1e0 0x55e864c1eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.763+0000 7ffbbfe00640 1 -- 172.21.15.3:0/3745958518 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e864bf3d60 con 0x55e864c073a0 2024-09-19T06:16:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.763+0000 7ffbb7e00640 1 --2- 172.21.15.3:0/3745958518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e864bfcb00 0x55e864c1f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.763+0000 7ffbbfe00640 1 --2- 172.21.15.3:0/3745958518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864c073a0 0x55e864c01590 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80bd130 tx=0x7ffbb80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17df774440a0e171 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.763+0000 7ffbafe00640 1 -- 172.21.15.3:0/3745958518 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb80bd1a0 con 0x55e864c073a0 2024-09-19T06:16:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.763+0000 7ffbafe00640 1 -- 172.21.15.3:0/3745958518 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbb8036070 con 0x55e864c073a0 2024-09-19T06:16:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.763+0000 7ffbafe00640 1 -- 172.21.15.3:0/3745958518 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb80ee6f0 con 0x55e864c073a0 2024-09-19T06:16:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.764+0000 7ffbc91e8740 1 -- 172.21.15.3:0/3745958518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864c073a0 msgr2=0x55e864c01590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.764+0000 7ffbc91e8740 1 --2- 172.21.15.3:0/3745958518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864c073a0 0x55e864c01590 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80bd130 tx=0x7ffbb80095c0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.764+0000 7ffbc91e8740 1 -- 172.21.15.3:0/3745958518 shutdown_connections 2024-09-19T06:16:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.764+0000 7ffbc91e8740 1 --2- 172.21.15.3:0/3745958518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864c073a0 0x55e864c01590 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.764+0000 7ffbc91e8740 1 --2- 172.21.15.3:0/3745958518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e864bfcb00 0x55e864c1f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.764+0000 7ffbc91e8740 1 --2- 172.21.15.3:0/3745958518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e864bfc1e0 0x55e864c1eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.764+0000 7ffbc91e8740 1 -- 172.21.15.3:0/3745958518 >> 172.21.15.3:0/3745958518 conn(0x55e864bf8750 msgr2=0x55e864c06260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.764+0000 7ffbc91e8740 1 -- 172.21.15.3:0/3745958518 shutdown_connections 2024-09-19T06:16:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.764+0000 7ffbc91e8740 1 -- 172.21.15.3:0/3745958518 wait complete. 2024-09-19T06:16:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.764+0000 7ffbc91e8740 1 -- start start 2024-09-19T06:16:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.764+0000 7ffbc91e8740 1 Processor -- start 2024-09-19T06:16:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.765+0000 7ffbc91e8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e864bfc1e0 0x55e864c0f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.765+0000 7ffbc91e8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e864bfcb00 0x55e864c0f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.765+0000 7ffbc91e8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864c073a0 0x55e864c0c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.765+0000 7ffbc91e8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc01b0f20 con 0x55e864c073a0 2024-09-19T06:16:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.765+0000 7ffbc91e8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc01b0850 con 0x55e864bfc1e0 2024-09-19T06:16:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.765+0000 7ffbc91e8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc01ada90 con 0x55e864bfcb00 2024-09-19T06:16:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.765+0000 7ffbc91e8740 10 client.0 _ll_register_callbacks cb 0x7ffba800f5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.765+0000 7ffbbfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864c073a0 0x55e864c0c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.765+0000 7ffbbf400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e864bfc1e0 0x55e864c0f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.765+0000 7ffbbfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864c073a0 0x55e864c0c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33004/0 (socket says 172.21.15.3:33004) 2024-09-19T06:16:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.765+0000 7ffbbfe00640 1 -- 172.21.15.3:0/2929702546 learned_addr learned my addr 172.21.15.3:0/2929702546 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.765+0000 7ffbb7e00640 1 --2- 172.21.15.3:0/2929702546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e864bfcb00 0x55e864c0f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.765+0000 7ffbbf400640 1 -- 172.21.15.3:0/2929702546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e864bfcb00 msgr2=0x55e864c0f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.765+0000 7ffbbf400640 1 --2- 172.21.15.3:0/2929702546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e864bfcb00 0x55e864c0f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.765+0000 7ffbbf400640 1 -- 172.21.15.3:0/2929702546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864c073a0 msgr2=0x55e864c0c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.765+0000 7ffbbf400640 1 --2- 172.21.15.3:0/2929702546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864c073a0 0x55e864c0c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.766+0000 7ffbbf400640 1 -- 172.21.15.3:0/2929702546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e864c0c950 con 0x55e864bfc1e0 2024-09-19T06:16:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.766+0000 7ffbbf400640 1 --2- 172.21.15.3:0/2929702546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e864bfc1e0 0x55e864c0f340 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ffbb001b040 tx=0x7ffbb0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d79f143fbb5c082a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.766+0000 7ffbad600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:16:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.766+0000 7ffbad600640 1 -- 172.21.15.3:0/2929702546 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0032060 con 0x55e864bfc1e0 2024-09-19T06:16:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.766+0000 7ffbc91e8740 1 -- 172.21.15.3:0/2929702546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbb8036070 con 0x55e864bfc1e0 2024-09-19T06:16:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.766+0000 7ffbad600640 1 -- 172.21.15.3:0/2929702546 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7ffbb0005450 con 0x55e864bfc1e0 2024-09-19T06:16:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.766+0000 7ffbad600640 1 -- 172.21.15.3:0/2929702546 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffbb0005650 con 0x55e864bfc1e0 2024-09-19T06:16:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.766+0000 7ffbc91e8740 10 client.26366 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.766+0000 7ffbc91e8740 1 -- 172.21.15.3:0/2929702546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e864c826d0 con 0x55e864bfc1e0 2024-09-19T06:16:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.767+0000 7ffbad600640 1 -- 172.21.15.3:0/2929702546 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbb8036070 con 0x55e864bfc1e0 2024-09-19T06:16:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.767+0000 7ffbad600640 1 -- 172.21.15.3:0/2929702546 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ffbb0019970 con 0x55e864bfc1e0 2024-09-19T06:16:22.772 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.767+0000 7ffbc91e8740 10 client.26366 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.767+0000 7ffbc91e8740 10 client.26366 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.767+0000 7ffbc91e8740 20 client.26366 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.767+0000 7ffbc91e8740 1 --2- 172.21.15.3:0/2929702546 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e864c82c00 0x55e864c84ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.767+0000 7ffbc91e8740 4 client.26366 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:16:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.767+0000 7ffbc91e8740 1 -- 172.21.15.3:0/2929702546 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e864b69b80 con 0x55e864c82c00 2024-09-19T06:16:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.767+0000 7ffbb7e00640 1 --2- 172.21.15.3:0/2929702546 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e864c82c00 0x55e864c84ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.768+0000 7ffbb7e00640 1 --2- 172.21.15.3:0/2929702546 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e864c82c00 0x55e864c84ff0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f3002acd54117b7 server_cookie=5e7f61c1ffd9ef9b in_seq=0 out_seq=0 2024-09-19T06:16:22.773 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.768+0000 7ffbad600640 10 client.26366 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.783+0000 7ffbad600640 1 -- 172.21.15.3:0/2929702546 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e864b69b80 con 0x55e864c82c00 2024-09-19T06:16:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.783+0000 7ffbad600640 10 client.26366 handle_command_reply: tid=0 2024-09-19T06:16:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.783+0000 7ffbc91e8740 1 client.26366 shutdown 2024-09-19T06:16:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.783+0000 7ffbc91e8740 1 -- 172.21.15.3:0/2929702546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e864bfc1e0 msgr2=0x55e864c0f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.783+0000 7ffbc91e8740 1 --2- 172.21.15.3:0/2929702546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e864bfc1e0 0x55e864c0f340 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ffbb001b040 tx=0x7ffbb0009c20 comp rx=0 tx=0).stop 2024-09-19T06:16:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.784+0000 7ffbc91e8740 1 -- 172.21.15.3:0/2929702546 shutdown_connections 2024-09-19T06:16:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.784+0000 7ffbc91e8740 1 --2- 172.21.15.3:0/2929702546 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e864c82c00 0x55e864c84ff0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.784+0000 7ffbc91e8740 1 --2- 172.21.15.3:0/2929702546 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e864c073a0 0x55e864c0c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.784+0000 7ffbc91e8740 1 --2- 172.21.15.3:0/2929702546 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e864bfcb00 0x55e864c0f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.784+0000 7ffbc91e8740 1 --2- 172.21.15.3:0/2929702546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e864bfc1e0 0x55e864c0f340 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.786 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.784+0000 7ffbad600640 0 client.26366 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.784+0000 7ffbc91e8740 1 -- 172.21.15.3:0/2929702546 >> 172.21.15.3:0/2929702546 conn(0x55e864bf8750 msgr2=0x55e864c04290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.784+0000 7ffbc91e8740 1 -- 172.21.15.3:0/2929702546 shutdown_connections 2024-09-19T06:16:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.784+0000 7ffbc91e8740 1 -- 172.21.15.3:0/2929702546 wait complete. 2024-09-19T06:16:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.784+0000 7ffbc91e8740 20 client.26366 trim_cache size 0 max 16384 2024-09-19T06:16:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:16:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:16:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:16:22.787 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:16:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.785+0000 7ffbc6400640 1 -- 172.21.15.3:0/1383447849 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ffba40a33b0 msgr2=0x7ffba40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.785+0000 7ffbc6400640 1 --2- 172.21.15.3:0/1383447849 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ffba40a33b0 0x7ffba40a5870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55e864bf9ad0 tx=0x7ffba8015040 comp rx=0 tx=0).stop 2024-09-19T06:16:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.785+0000 7ffbc6400640 1 -- 172.21.15.3:0/1383447849 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbc019ee30 msgr2=0x7ffbc019f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.785+0000 7ffbc6400640 1 --2- 172.21.15.3:0/1383447849 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbc019ee30 0x7ffbc019f2e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8031a20 tx=0x7ffbb8031a50 comp rx=0 tx=0).stop 2024-09-19T06:16:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.785+0000 7ffbc6400640 1 -- 172.21.15.3:0/1383447849 shutdown_connections 2024-09-19T06:16:22.788 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.785+0000 7ffbc6400640 1 --2- 172.21.15.3:0/1383447849 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ffba40a33b0 0x7ffba40a5870 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.785+0000 7ffbc6400640 1 --2- 172.21.15.3:0/1383447849 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbc019ee30 0x7ffbc019f2e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.785+0000 7ffbc6400640 1 --2- 172.21.15.3:0/1383447849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbc0109080 0x7ffbc019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.785+0000 7ffbc6400640 1 --2- 172.21.15.3:0/1383447849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbc0103f30 0x7ffbc019a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.785+0000 7ffbc6400640 1 -- 172.21.15.3:0/1383447849 >> 172.21.15.3:0/1383447849 conn(0x7ffbc00ff980 msgr2=0x7ffbc0100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.785+0000 7ffbc6400640 1 -- 172.21.15.3:0/1383447849 shutdown_connections 2024-09-19T06:16:22.789 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:22.785+0000 7ffbc6400640 1 -- 172.21.15.3:0/1383447849 wait complete. 2024-09-19T06:16:24.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:24 smithi059 ceph-mon[35138]: pgmap v123: 97 pgs: 97 active+clean; 4.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 32 KiB/s wr, 17 op/s 2024-09-19T06:16:24.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:24 smithi003 ceph-mon[30893]: pgmap v123: 97 pgs: 97 active+clean; 4.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 32 KiB/s wr, 17 op/s 2024-09-19T06:16:24.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:24 smithi071 ceph-mon[35662]: pgmap v123: 97 pgs: 97 active+clean; 4.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 32 KiB/s wr, 17 op/s 2024-09-19T06:16:26.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:26 smithi059 ceph-mon[35138]: pgmap v124: 97 pgs: 97 active+clean; 5.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 50 KiB/s wr, 26 op/s 2024-09-19T06:16:26.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:26 smithi003 ceph-mon[30893]: pgmap v124: 97 pgs: 97 active+clean; 5.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 50 KiB/s wr, 26 op/s 2024-09-19T06:16:26.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:26 smithi071 ceph-mon[35662]: pgmap v124: 97 pgs: 97 active+clean; 5.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 50 KiB/s wr, 26 op/s 2024-09-19T06:16:28.387 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:28 smithi003 ceph-mon[30893]: pgmap v125: 97 pgs: 97 active+clean; 5.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-19T06:16:28.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:28 smithi059 ceph-mon[35138]: pgmap v125: 97 pgs: 97 active+clean; 5.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-19T06:16:28.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:28 smithi071 ceph-mon[35662]: pgmap v125: 97 pgs: 97 active+clean; 5.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-19T06:16:30.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:30 smithi003 ceph-mon[30893]: pgmap v126: 97 pgs: 97 active+clean; 5.2 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:16:30.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:30 smithi059 ceph-mon[35138]: pgmap v126: 97 pgs: 97 active+clean; 5.2 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:16:30.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:30 smithi071 ceph-mon[35662]: pgmap v126: 97 pgs: 97 active+clean; 5.2 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:16:32.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:32 smithi059 ceph-mon[35138]: pgmap v127: 97 pgs: 97 active+clean; 5.2 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-19T06:16:32.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:32 smithi003 ceph-mon[30893]: pgmap v127: 97 pgs: 97 active+clean; 5.2 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-19T06:16:32.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:32 smithi071 ceph-mon[35662]: pgmap v127: 97 pgs: 97 active+clean; 5.2 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-19T06:16:34.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:34 smithi059 ceph-mon[35138]: pgmap v128: 97 pgs: 97 active+clean; 5.2 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-19T06:16:34.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:34 smithi003 ceph-mon[30893]: pgmap v128: 97 pgs: 97 active+clean; 5.2 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-19T06:16:34.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:34 smithi071 ceph-mon[35662]: pgmap v128: 97 pgs: 97 active+clean; 5.2 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-19T06:16:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.913+0000 7f9baf200640 1 -- 172.21.15.3:0/4255291585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ba8102ae0 msgr2=0x7f9ba8102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.913+0000 7f9baf200640 1 --2- 172.21.15.3:0/4255291585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ba8102ae0 0x7f9ba8102ec0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c009860 tx=0x7f9b9c02a3d0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.913+0000 7f9baf200640 1 -- 172.21.15.3:0/4255291585 shutdown_connections 2024-09-19T06:16:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.913+0000 7f9baf200640 1 --2- 172.21.15.3:0/4255291585 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ba810bf30 0x7f9ba810e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.915 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.913+0000 7f9baf200640 1 --2- 172.21.15.3:0/4255291585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ba8103400 0x7f9ba810b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.916 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.913+0000 7f9baf200640 1 --2- 172.21.15.3:0/4255291585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ba8102ae0 0x7f9ba8102ec0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.916 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.913+0000 7f9baf200640 1 -- 172.21.15.3:0/4255291585 >> 172.21.15.3:0/4255291585 conn(0x7f9ba80777f0 msgr2=0x7f9ba80feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:35.916 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.913+0000 7f9baf200640 1 -- 172.21.15.3:0/4255291585 shutdown_connections 2024-09-19T06:16:35.916 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.913+0000 7f9baf200640 1 -- 172.21.15.3:0/4255291585 wait complete. 2024-09-19T06:16:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.914+0000 7f9baf200640 1 Processor -- start 2024-09-19T06:16:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.914+0000 7f9baf200640 1 -- start start 2024-09-19T06:16:35.917 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.914+0000 7f9baf200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ba8102ae0 0x7f9ba819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.914+0000 7f9baf200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ba8103400 0x7f9ba819a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.915+0000 7f9baf200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ba810bf30 0x7f9ba819ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.915+0000 7f9baf200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba8111d10 con 0x7f9ba8103400 2024-09-19T06:16:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.915+0000 7f9baf200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba8111b90 con 0x7f9ba810bf30 2024-09-19T06:16:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.915+0000 7f9baf200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba8111e90 con 0x7f9ba8102ae0 2024-09-19T06:16:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.915+0000 7f9bade00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ba8102ae0 0x7f9ba819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.915+0000 7f9bade00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ba8102ae0 0x7f9ba819a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:44554/0 (socket says 172.21.15.3:44554) 2024-09-19T06:16:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.915+0000 7f9bade00640 1 -- 172.21.15.3:0/2207728008 learned_addr learned my addr 172.21.15.3:0/2207728008 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.915+0000 7f9bae800640 1 --2- 172.21.15.3:0/2207728008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ba810bf30 0x7f9ba819ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.915+0000 7f9bad400640 1 --2- 172.21.15.3:0/2207728008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ba8103400 0x7f9ba819a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.915+0000 7f9bade00640 1 -- 172.21.15.3:0/2207728008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ba810bf30 msgr2=0x7f9ba819ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:35.918 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.915+0000 7f9bade00640 1 --2- 172.21.15.3:0/2207728008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ba810bf30 0x7f9ba819ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.919 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.915+0000 7f9bade00640 1 -- 172.21.15.3:0/2207728008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ba8103400 msgr2=0x7f9ba819a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:35.919 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.915+0000 7f9bade00640 1 --2- 172.21.15.3:0/2207728008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ba8103400 0x7f9ba819a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.919 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.915+0000 7f9bade00640 1 -- 172.21.15.3:0/2207728008 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba819f430 con 0x7f9ba8102ae0 2024-09-19T06:16:35.919 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.915+0000 7f9bad400640 1 --2- 172.21.15.3:0/2207728008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ba8103400 0x7f9ba819a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:35.919 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.915+0000 7f9bae800640 1 --2- 172.21.15.3:0/2207728008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ba810bf30 0x7f9ba819ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:35.919 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.916+0000 7f9bade00640 1 --2- 172.21.15.3:0/2207728008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ba8102ae0 0x7f9ba819a440 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c02a8f0 tx=0x7f9b9c030650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:35.920 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.916+0000 7f9ba2a00640 1 -- 172.21.15.3:0/2207728008 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c040020 con 0x7f9ba8102ae0 2024-09-19T06:16:35.920 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.916+0000 7f9baf200640 1 -- 172.21.15.3:0/2207728008 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba819f6c0 con 0x7f9ba8102ae0 2024-09-19T06:16:35.920 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.916+0000 7f9ba2a00640 1 -- 172.21.15.3:0/2207728008 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9b9c004460 con 0x7f9ba8102ae0 2024-09-19T06:16:35.920 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.916+0000 7f9ba2a00640 1 -- 172.21.15.3:0/2207728008 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c0046c0 con 0x7f9ba8102ae0 2024-09-19T06:16:35.920 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.916+0000 7f9baf200640 1 -- 172.21.15.3:0/2207728008 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba81a6fb0 con 0x7f9ba8102ae0 2024-09-19T06:16:35.922 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.919+0000 7f9bb3806740 1 Processor -- start 2024-09-19T06:16:35.922 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.919+0000 7f9bb3806740 1 -- start start 2024-09-19T06:16:35.922 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.920+0000 7f9ba2a00640 1 -- 172.21.15.3:0/2207728008 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f9b9c043020 con 0x7f9ba8102ae0 2024-09-19T06:16:35.922 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.920+0000 7f9bb3806740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07d33b0 0x5598b07d3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:35.922 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.920+0000 7f9bb3806740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598b07d3cd0 0x5598b07de030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:35.922 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.920+0000 7f9bb3806740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598b07de570 0x5598b07e0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.920+0000 7f9bb3806740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5598b0739100 con 0x5598b07d33b0 2024-09-19T06:16:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.920+0000 7f9bb3806740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5598b06e11b0 con 0x5598b07d3cd0 2024-09-19T06:16:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.920+0000 7f9bb3806740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5598b07350c0 con 0x5598b07de570 2024-09-19T06:16:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.920+0000 7f9bae800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07d33b0 0x5598b07d3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.920+0000 7f9bae800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07d33b0 0x5598b07d3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41258/0 (socket says 172.21.15.3:41258) 2024-09-19T06:16:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.920+0000 7f9bae800640 1 -- 172.21.15.3:0/4044779066 learned_addr learned my addr 172.21.15.3:0/4044779066 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.920+0000 7f9bade00640 1 --2- 172.21.15.3:0/4044779066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598b07d3cd0 0x5598b07de030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.920+0000 7f9bad400640 1 --2- 172.21.15.3:0/4044779066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598b07de570 0x5598b07e0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.920+0000 7f9bae800640 1 -- 172.21.15.3:0/4044779066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598b07de570 msgr2=0x5598b07e0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.920+0000 7f9bae800640 1 --2- 172.21.15.3:0/4044779066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598b07de570 0x5598b07e0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.920+0000 7f9bae800640 1 -- 172.21.15.3:0/4044779066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598b07d3cd0 msgr2=0x5598b07de030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.920+0000 7f9bae800640 1 --2- 172.21.15.3:0/4044779066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598b07d3cd0 0x5598b07de030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.920+0000 7f9bae800640 1 -- 172.21.15.3:0/4044779066 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598b044c210 con 0x5598b07d33b0 2024-09-19T06:16:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.921+0000 7f9bae800640 1 --2- 172.21.15.3:0/4044779066 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07d33b0 0x5598b07d3790 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9ba400e870 tx=0x7f9ba40095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28b878c62b58cfb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.921+0000 7f9b97000640 1 -- 172.21.15.3:0/4044779066 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba400ddd0 con 0x5598b07d33b0 2024-09-19T06:16:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.921+0000 7f9b97000640 1 -- 172.21.15.3:0/4044779066 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ba401c070 con 0x5598b07d33b0 2024-09-19T06:16:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.921+0000 7f9b97000640 1 -- 172.21.15.3:0/4044779066 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4016700 con 0x5598b07d33b0 2024-09-19T06:16:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.921+0000 7f9ba2a00640 1 --2- 172.21.15.3:0/2207728008 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9b900a33a0 0x7f9b900a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.922+0000 7f9ba2a00640 1 -- 172.21.15.3:0/2207728008 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f9b9c0f0ca0 con 0x7f9ba8102ae0 2024-09-19T06:16:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.922+0000 7f9bb3806740 1 -- 172.21.15.3:0/4044779066 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07d33b0 msgr2=0x5598b07d3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.922+0000 7f9bb3806740 1 --2- 172.21.15.3:0/4044779066 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07d33b0 0x5598b07d3790 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9ba400e870 tx=0x7f9ba40095c0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.922+0000 7f9bade00640 1 --2- 172.21.15.3:0/2207728008 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9b900a33a0 0x7f9b900a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.922+0000 7f9bb3806740 1 -- 172.21.15.3:0/4044779066 shutdown_connections 2024-09-19T06:16:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.922+0000 7f9bb3806740 1 --2- 172.21.15.3:0/4044779066 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598b07de570 0x5598b07e0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.922+0000 7f9bb3806740 1 --2- 172.21.15.3:0/4044779066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598b07d3cd0 0x5598b07de030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.922+0000 7f9bb3806740 1 --2- 172.21.15.3:0/4044779066 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07d33b0 0x5598b07d3790 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.922+0000 7f9bb3806740 1 -- 172.21.15.3:0/4044779066 >> 172.21.15.3:0/4044779066 conn(0x5598b07cf920 msgr2=0x5598b07cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.922+0000 7f9bb3806740 1 -- 172.21.15.3:0/4044779066 shutdown_connections 2024-09-19T06:16:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.922+0000 7f9bb3806740 1 -- 172.21.15.3:0/4044779066 wait complete. 2024-09-19T06:16:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.922+0000 7f9bade00640 1 --2- 172.21.15.3:0/2207728008 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9b900a33a0 0x7f9b900a5860 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x5598b07d0780 tx=0x7f9b9c0f4750 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.922+0000 7f9bb3806740 1 -- start start 2024-09-19T06:16:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.923+0000 7f9bb3806740 1 Processor -- start 2024-09-19T06:16:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.923+0000 7f9bb3806740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598b07d33b0 0x5598b07db5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.923+0000 7f9bb3806740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07d3cd0 0x5598b07dbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.923+0000 7f9bb3806740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598b07de570 0x5598b07dc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.923+0000 7f9bb3806740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5598b07e0ff0 con 0x5598b07d3cd0 2024-09-19T06:16:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.923+0000 7f9bb3806740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5598b06c2090 con 0x5598b07d33b0 2024-09-19T06:16:35.930 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.923+0000 7f9bb3806740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5598b07e1170 con 0x5598b07de570 2024-09-19T06:16:35.930 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.923+0000 7f9bb3806740 10 client.0 _ll_register_callbacks cb 0x5598b0716f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:35.930 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.923+0000 7f9bad400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07d3cd0 0x5598b07dbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:35.930 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.923+0000 7f9bad400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07d3cd0 0x5598b07dbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41272/0 (socket says 172.21.15.3:41272) 2024-09-19T06:16:35.930 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.923+0000 7f9bad400640 1 -- 172.21.15.3:0/2374772472 learned_addr learned my addr 172.21.15.3:0/2374772472 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:35.930 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.924+0000 7f9bae800640 1 --2- 172.21.15.3:0/2374772472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598b07d33b0 0x5598b07db5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:35.930 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.924+0000 7f9bae800640 1 --2- 172.21.15.3:0/2374772472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598b07de570 0x5598b07dc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:35.930 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.924+0000 7f9bad400640 1 -- 172.21.15.3:0/2374772472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598b07de570 msgr2=0x5598b07dc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:35.930 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.924+0000 7f9bad400640 1 --2- 172.21.15.3:0/2374772472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598b07de570 0x5598b07dc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.930 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.924+0000 7f9bad400640 1 -- 172.21.15.3:0/2374772472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598b07d33b0 msgr2=0x5598b07db5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:35.930 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.924+0000 7f9bad400640 1 --2- 172.21.15.3:0/2374772472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598b07d33b0 0x5598b07db5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.930 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.924+0000 7f9bad400640 1 -- 172.21.15.3:0/2374772472 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598b0518620 con 0x5598b07d3cd0 2024-09-19T06:16:35.931 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.924+0000 7f9bae800640 1 --2- 172.21.15.3:0/2374772472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598b07d33b0 0x5598b07db5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:35.931 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.924+0000 7f9bad400640 1 --2- 172.21.15.3:0/2374772472 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07d3cd0 0x5598b07dbb00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9b98012d20 tx=0x7f9b9800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ec8b1f6194c187 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:35.931 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.924+0000 7f9b8b400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:16:35.931 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.924+0000 7f9b8b400640 1 -- 172.21.15.3:0/2374772472 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b98012110 con 0x5598b07d3cd0 2024-09-19T06:16:35.931 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.925+0000 7f9bb3806740 1 -- 172.21.15.3:0/2374772472 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ba401c070 con 0x5598b07d3cd0 2024-09-19T06:16:35.931 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.925+0000 7f9b8b400640 1 -- 172.21.15.3:0/2374772472 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f9b98004050 con 0x5598b07d3cd0 2024-09-19T06:16:35.931 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.925+0000 7f9b8b400640 1 -- 172.21.15.3:0/2374772472 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9b980122b0 con 0x5598b07d3cd0 2024-09-19T06:16:35.931 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.925+0000 7f9bb3806740 10 client.16335 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:35.931 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.925+0000 7f9bb3806740 1 -- 172.21.15.3:0/2374772472 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5598b07ecee0 con 0x5598b07d3cd0 2024-09-19T06:16:35.931 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.925+0000 7f9b8b400640 1 -- 172.21.15.3:0/2374772472 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ba401c070 con 0x5598b07d3cd0 2024-09-19T06:16:35.931 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.925+0000 7f9b8b400640 1 -- 172.21.15.3:0/2374772472 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9b98010430 con 0x5598b07d3cd0 2024-09-19T06:16:35.931 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.925+0000 7f9bb3806740 10 client.16335 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:35.931 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.925+0000 7f9bb3806740 10 client.16335 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:35.932 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.925+0000 7f9bb3806740 20 client.16335 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:35.932 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.925+0000 7f9bb3806740 1 --2- 172.21.15.3:0/2374772472 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5598b07ee350 0x5598b07f0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:35.932 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.926+0000 7f9bb3806740 4 client.16335 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:35.932 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.926+0000 7f9bb3806740 1 -- 172.21.15.3:0/2374772472 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598b0746830 con 0x5598b07ee350 2024-09-19T06:16:35.932 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.926+0000 7f9bae800640 1 --2- 172.21.15.3:0/2374772472 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5598b07ee350 0x5598b07f0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:35.933 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.926+0000 7f9bae800640 1 --2- 172.21.15.3:0/2374772472 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5598b07ee350 0x5598b07f0740 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb8be7642ddcd2a7 server_cookie=5a2cb22df01a6e64 in_seq=0 out_seq=0 2024-09-19T06:16:35.933 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.926+0000 7f9b8b400640 10 client.16335 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:35.933 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.927+0000 7f9b8b400640 1 -- 172.21.15.3:0/2374772472 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5598b0746830 con 0x5598b07ee350 2024-09-19T06:16:35.933 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.927+0000 7f9b8b400640 10 client.16335 handle_command_reply: tid=0 2024-09-19T06:16:35.933 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.927+0000 7f9bb3806740 1 client.16335 shutdown 2024-09-19T06:16:35.933 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.928+0000 7f9bb3806740 1 -- 172.21.15.3:0/2374772472 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07d3cd0 msgr2=0x5598b07dbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:35.933 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.928+0000 7f9bb3806740 1 --2- 172.21.15.3:0/2374772472 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07d3cd0 0x5598b07dbb00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9b98012d20 tx=0x7f9b9800f790 comp rx=0 tx=0).stop 2024-09-19T06:16:35.934 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.928+0000 7f9bb3806740 1 -- 172.21.15.3:0/2374772472 shutdown_connections 2024-09-19T06:16:35.934 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.928+0000 7f9bb3806740 1 --2- 172.21.15.3:0/2374772472 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5598b07ee350 0x5598b07f0740 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.934 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.928+0000 7f9bb3806740 1 --2- 172.21.15.3:0/2374772472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598b07de570 0x5598b07dc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.934 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.928+0000 7f9bb3806740 1 --2- 172.21.15.3:0/2374772472 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07d3cd0 0x5598b07dbb00 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.934 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.928+0000 7f9bb3806740 1 --2- 172.21.15.3:0/2374772472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598b07d33b0 0x5598b07db5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.934 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.928+0000 7f9bb3806740 1 -- 172.21.15.3:0/2374772472 >> 172.21.15.3:0/2374772472 conn(0x5598b07cf920 msgr2=0x5598b07d5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:35.934 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.928+0000 7f9b8b400640 0 client.16335 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:35.934 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.928+0000 7f9bb3806740 1 -- 172.21.15.3:0/2374772472 shutdown_connections 2024-09-19T06:16:35.934 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.928+0000 7f9bb3806740 1 -- 172.21.15.3:0/2374772472 wait complete. 2024-09-19T06:16:35.934 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.928+0000 7f9bb3806740 20 client.16335 trim_cache size 0 max 16384 2024-09-19T06:16:35.946 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.943+0000 7f9bb3806740 1 Processor -- start 2024-09-19T06:16:35.946 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.943+0000 7f9bb3806740 1 -- start start 2024-09-19T06:16:35.946 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.943+0000 7f9bb3806740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07d33b0 0x5598b07d5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:35.946 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.943+0000 7f9bb3806740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598b07d3cd0 0x5598b07f6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:35.946 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.943+0000 7f9bb3806740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598b07de570 0x5598b07f6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:35.946 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.943+0000 7f9bb3806740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba81af8e0 con 0x5598b07d33b0 2024-09-19T06:16:35.946 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.943+0000 7f9bb3806740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba81b1420 con 0x5598b07de570 2024-09-19T06:16:35.947 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.943+0000 7f9bb3806740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba81affb0 con 0x5598b07d3cd0 2024-09-19T06:16:35.947 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.944+0000 7f9bae800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07d33b0 0x5598b07d5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:35.947 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.944+0000 7f9bae800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07d33b0 0x5598b07d5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41288/0 (socket says 172.21.15.3:41288) 2024-09-19T06:16:35.947 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.944+0000 7f9bae800640 1 -- 172.21.15.3:0/3245654582 learned_addr learned my addr 172.21.15.3:0/3245654582 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:35.947 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.944+0000 7f9bad400640 1 --2- 172.21.15.3:0/3245654582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598b07d3cd0 0x5598b07f6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:35.947 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.944+0000 7f9bae800640 1 --2- 172.21.15.3:0/3245654582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598b07de570 0x5598b07f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:35.947 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.944+0000 7f9bae800640 1 -- 172.21.15.3:0/3245654582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598b07d3cd0 msgr2=0x5598b07f6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:35.947 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.944+0000 7f9bae800640 1 --2- 172.21.15.3:0/3245654582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598b07d3cd0 0x5598b07f6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.947 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.944+0000 7f9bae800640 1 -- 172.21.15.3:0/3245654582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598b07de570 msgr2=0x5598b07f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:35.947 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.944+0000 7f9bae800640 1 --2- 172.21.15.3:0/3245654582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598b07de570 0x5598b07f6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.947 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.944+0000 7f9bae800640 1 -- 172.21.15.3:0/3245654582 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598b07d3b00 con 0x5598b07d33b0 2024-09-19T06:16:35.947 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.944+0000 7f9bae800640 1 --2- 172.21.15.3:0/3245654582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07d33b0 0x5598b07d5e20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4009ba0 tx=0x7f9ba4016380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d268d92df974b99d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:35.950 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.945+0000 7f9b96600640 1 -- 172.21.15.3:0/3245654582 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba400dd70 con 0x5598b07d33b0 2024-09-19T06:16:35.951 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.945+0000 7f9b96600640 1 -- 172.21.15.3:0/3245654582 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ba401c040 con 0x5598b07d33b0 2024-09-19T06:16:35.951 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.945+0000 7f9b96600640 1 -- 172.21.15.3:0/3245654582 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4017420 con 0x5598b07d33b0 2024-09-19T06:16:35.951 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.945+0000 7f9bb3806740 1 -- 172.21.15.3:0/3245654582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07d33b0 msgr2=0x5598b07d5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:35.951 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.945+0000 7f9bb3806740 1 --2- 172.21.15.3:0/3245654582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07d33b0 0x5598b07d5e20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4009ba0 tx=0x7f9ba4016380 comp rx=0 tx=0).stop 2024-09-19T06:16:35.951 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.945+0000 7f9bb3806740 1 -- 172.21.15.3:0/3245654582 shutdown_connections 2024-09-19T06:16:35.951 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.945+0000 7f9bb3806740 1 --2- 172.21.15.3:0/3245654582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598b07de570 0x5598b07f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.951 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.945+0000 7f9bb3806740 1 --2- 172.21.15.3:0/3245654582 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598b07d3cd0 0x5598b07f6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.951 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.945+0000 7f9bb3806740 1 --2- 172.21.15.3:0/3245654582 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07d33b0 0x5598b07d5e20 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.951 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.945+0000 7f9bb3806740 1 -- 172.21.15.3:0/3245654582 >> 172.21.15.3:0/3245654582 conn(0x5598b07cf920 msgr2=0x5598b07d9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:35.951 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.945+0000 7f9bb3806740 1 -- 172.21.15.3:0/3245654582 shutdown_connections 2024-09-19T06:16:35.951 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.945+0000 7f9bb3806740 1 -- 172.21.15.3:0/3245654582 wait complete. 2024-09-19T06:16:35.951 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.946+0000 7f9bb3806740 1 -- start start 2024-09-19T06:16:35.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.946+0000 7f9bb3806740 1 Processor -- start 2024-09-19T06:16:35.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.946+0000 7f9bb3806740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598b07d33b0 0x5598b07e1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:35.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.946+0000 7f9bb3806740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598b07d3cd0 0x5598b07e1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:35.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.946+0000 7f9bb3806740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07de570 0x5598b0857010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:35.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.946+0000 7f9bb3806740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba81b0d50 con 0x5598b07de570 2024-09-19T06:16:35.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.947+0000 7f9bb3806740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba81b0680 con 0x5598b07d3cd0 2024-09-19T06:16:35.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.947+0000 7f9bb3806740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba81ad8c0 con 0x5598b07d33b0 2024-09-19T06:16:35.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.947+0000 7f9bb3806740 10 client.0 _ll_register_callbacks cb 0x7f9b98009cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:35.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.947+0000 7f9bae800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598b07d33b0 0x5598b07e1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:35.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.947+0000 7f9bad400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598b07d3cd0 0x5598b07e1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:35.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.947+0000 7f9bae800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07de570 0x5598b0857010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:35.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.947+0000 7f9bad400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598b07d3cd0 0x5598b07e1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:38006/0 (socket says 172.21.15.3:38006) 2024-09-19T06:16:35.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.947+0000 7f9bad400640 1 -- 172.21.15.3:0/1930759443 learned_addr learned my addr 172.21.15.3:0/1930759443 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:35.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.947+0000 7f9bad400640 1 -- 172.21.15.3:0/1930759443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598b07d33b0 msgr2=0x5598b07e1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:35.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.947+0000 7f9bad400640 1 --2- 172.21.15.3:0/1930759443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598b07d33b0 0x5598b07e1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.947+0000 7f9bad400640 1 -- 172.21.15.3:0/1930759443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07de570 msgr2=0x5598b0857010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:35.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.947+0000 7f9bad400640 1 --2- 172.21.15.3:0/1930759443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07de570 0x5598b0857010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.947+0000 7f9bad400640 1 -- 172.21.15.3:0/1930759443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598b0857550 con 0x5598b07d3cd0 2024-09-19T06:16:35.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.947+0000 7f9bad400640 1 --2- 172.21.15.3:0/1930759443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598b07d3cd0 0x5598b07e1b50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9b98012cf0 tx=0x7f9b98010cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fabd9a9800ee4b45 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:35.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.947+0000 7f9b8b400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:16:35.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.948+0000 7f9b8b400640 1 -- 172.21.15.3:0/1930759443 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b98032060 con 0x5598b07d3cd0 2024-09-19T06:16:35.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.948+0000 7f9bb3806740 1 -- 172.21.15.3:0/1930759443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ba401c040 con 0x5598b07d3cd0 2024-09-19T06:16:35.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.948+0000 7f9b8b400640 1 -- 172.21.15.3:0/1930759443 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f9b98005110 con 0x5598b07d3cd0 2024-09-19T06:16:35.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.948+0000 7f9b8b400640 1 -- 172.21.15.3:0/1930759443 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9b98029040 con 0x5598b07d3cd0 2024-09-19T06:16:35.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.948+0000 7f9bb3806740 10 client.26384 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:35.954 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.948+0000 7f9bb3806740 1 -- 172.21.15.3:0/1930759443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5598b0858790 con 0x5598b07d3cd0 2024-09-19T06:16:35.954 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.948+0000 7f9b8b400640 1 -- 172.21.15.3:0/1930759443 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ba401c040 con 0x5598b07d3cd0 2024-09-19T06:16:35.954 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.949+0000 7f9b8b400640 1 -- 172.21.15.3:0/1930759443 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9b9802c030 con 0x5598b07d3cd0 2024-09-19T06:16:35.954 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.949+0000 7f9bb3806740 10 client.26384 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:35.954 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.949+0000 7f9bb3806740 10 client.26384 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:35.954 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.949+0000 7f9bb3806740 20 client.26384 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:35.954 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.949+0000 7f9bb3806740 1 --2- 172.21.15.3:0/1930759443 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5598b0858f40 0x5598b085b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:35.954 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.949+0000 7f9bb3806740 4 client.26384 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:16:35.954 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.949+0000 7f9bb3806740 1 -- 172.21.15.3:0/1930759443 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5598b0740b80 con 0x5598b0858f40 2024-09-19T06:16:35.954 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.949+0000 7f9bae800640 1 --2- 172.21.15.3:0/1930759443 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5598b0858f40 0x5598b085b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:35.955 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.949+0000 7f9bae800640 1 --2- 172.21.15.3:0/1930759443 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5598b0858f40 0x5598b085b360 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eda867fddfe8cf56 server_cookie=1c0e35ff61bdb8c9 in_seq=0 out_seq=0 2024-09-19T06:16:35.955 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.949+0000 7f9b8b400640 10 client.26384 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:35.965 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.963+0000 7f9b8b400640 1 -- 172.21.15.3:0/1930759443 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5598b0740b80 con 0x5598b0858f40 2024-09-19T06:16:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.963+0000 7f9b8b400640 10 client.26384 handle_command_reply: tid=0 2024-09-19T06:16:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.963+0000 7f9bb3806740 1 client.26384 shutdown 2024-09-19T06:16:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.963+0000 7f9bb3806740 1 -- 172.21.15.3:0/1930759443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598b07d3cd0 msgr2=0x5598b07e1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.963+0000 7f9bb3806740 1 --2- 172.21.15.3:0/1930759443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598b07d3cd0 0x5598b07e1b50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9b98012cf0 tx=0x7f9b98010cf0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.963+0000 7f9bb3806740 1 -- 172.21.15.3:0/1930759443 shutdown_connections 2024-09-19T06:16:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.963+0000 7f9bb3806740 1 --2- 172.21.15.3:0/1930759443 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5598b0858f40 0x5598b085b360 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.963+0000 7f9bb3806740 1 --2- 172.21.15.3:0/1930759443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5598b07de570 0x5598b0857010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.963+0000 7f9bb3806740 1 --2- 172.21.15.3:0/1930759443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5598b07d3cd0 0x5598b07e1b50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.963+0000 7f9bb3806740 1 --2- 172.21.15.3:0/1930759443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5598b07d33b0 0x5598b07e1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.963+0000 7f9b8b400640 0 client.26384 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.963+0000 7f9bb3806740 1 -- 172.21.15.3:0/1930759443 >> 172.21.15.3:0/1930759443 conn(0x5598b07cf920 msgr2=0x5598b07dbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:35.966 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.964+0000 7f9bb3806740 1 -- 172.21.15.3:0/1930759443 shutdown_connections 2024-09-19T06:16:35.967 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.964+0000 7f9bb3806740 1 -- 172.21.15.3:0/1930759443 wait complete. 2024-09-19T06:16:35.967 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.964+0000 7f9bb3806740 20 client.26384 trim_cache size 0 max 16384 2024-09-19T06:16:35.967 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:16:35.967 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:16:35.967 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:16:35.967 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:16:35.968 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.964+0000 7f9baf200640 1 -- 172.21.15.3:0/2207728008 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9b900a33a0 msgr2=0x7f9b900a5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:35.968 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.964+0000 7f9baf200640 1 --2- 172.21.15.3:0/2207728008 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9b900a33a0 0x7f9b900a5860 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x5598b07d0780 tx=0x7f9b9c0f4750 comp rx=0 tx=0).stop 2024-09-19T06:16:35.968 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.964+0000 7f9baf200640 1 -- 172.21.15.3:0/2207728008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ba8102ae0 msgr2=0x7f9ba819a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:35.968 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.964+0000 7f9baf200640 1 --2- 172.21.15.3:0/2207728008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ba8102ae0 0x7f9ba819a440 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c02a8f0 tx=0x7f9b9c030650 comp rx=0 tx=0).stop 2024-09-19T06:16:35.968 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.964+0000 7f9baf200640 1 -- 172.21.15.3:0/2207728008 shutdown_connections 2024-09-19T06:16:35.968 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.964+0000 7f9baf200640 1 --2- 172.21.15.3:0/2207728008 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9b900a33a0 0x7f9b900a5860 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.968 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.964+0000 7f9baf200640 1 --2- 172.21.15.3:0/2207728008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ba810bf30 0x7f9ba819ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.968 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.964+0000 7f9baf200640 1 --2- 172.21.15.3:0/2207728008 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ba8103400 0x7f9ba819a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.968 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.964+0000 7f9baf200640 1 --2- 172.21.15.3:0/2207728008 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ba8102ae0 0x7f9ba819a440 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:35.969 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.964+0000 7f9baf200640 1 -- 172.21.15.3:0/2207728008 >> 172.21.15.3:0/2207728008 conn(0x7f9ba80777f0 msgr2=0x7f9ba8100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:35.969 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.965+0000 7f9baf200640 1 -- 172.21.15.3:0/2207728008 shutdown_connections 2024-09-19T06:16:35.969 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:35.965+0000 7f9baf200640 1 -- 172.21.15.3:0/2207728008 wait complete. 2024-09-19T06:16:36.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:36 smithi059 ceph-mon[35138]: pgmap v129: 97 pgs: 97 active+clean; 5.4 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:16:36.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:36 smithi003 ceph-mon[30893]: pgmap v129: 97 pgs: 97 active+clean; 5.4 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:16:36.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:36 smithi071 ceph-mon[35662]: pgmap v129: 97 pgs: 97 active+clean; 5.4 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:16:38.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:38 smithi059 ceph-mon[35138]: pgmap v130: 97 pgs: 97 active+clean; 5.4 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-19T06:16:38.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:38 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:16:38.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:38 smithi003 ceph-mon[30893]: pgmap v130: 97 pgs: 97 active+clean; 5.4 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-19T06:16:38.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:38 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:16:38.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:38 smithi071 ceph-mon[35662]: pgmap v130: 97 pgs: 97 active+clean; 5.4 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-19T06:16:38.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:38 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:16:39.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:39 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:16:39.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:39 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:16:39.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:39 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:16:39.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:39 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:16:39.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:39 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:16:39.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:39 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:16:39.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:39 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:16:39.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:39 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:16:39.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:39 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:16:40.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:40 smithi059 ceph-mon[35138]: pgmap v131: 97 pgs: 97 active+clean; 1.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:16:40.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:40 smithi003 ceph-mon[30893]: pgmap v131: 97 pgs: 97 active+clean; 1.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:16:40.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:40 smithi071 ceph-mon[35662]: pgmap v131: 97 pgs: 97 active+clean; 1.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:16:42.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:42 smithi059 ceph-mon[35138]: pgmap v132: 97 pgs: 97 active+clean; 1.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 16 op/s 2024-09-19T06:16:42.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:42 smithi003 ceph-mon[30893]: pgmap v132: 97 pgs: 97 active+clean; 1.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 16 op/s 2024-09-19T06:16:42.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:42 smithi071 ceph-mon[35662]: pgmap v132: 97 pgs: 97 active+clean; 1.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 16 op/s 2024-09-19T06:16:43.709 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:16:44.102 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:44.431 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:44 smithi003 ceph-mon[30893]: pgmap v133: 97 pgs: 97 active+clean; 1.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 16 op/s 2024-09-19T06:16:44.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:44 smithi059 ceph-mon[35138]: pgmap v133: 97 pgs: 97 active+clean; 1.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 16 op/s 2024-09-19T06:16:44.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:44 smithi071 ceph-mon[35662]: pgmap v133: 97 pgs: 97 active+clean; 1.5 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 16 op/s 2024-09-19T06:16:44.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.709+0000 7f249f200640 1 -- 172.21.15.3:0/1211201509 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24a0108f60 msgr2=0x7f24a0110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:44.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.709+0000 7f249f200640 1 --2- 172.21.15.3:0/1211201509 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24a0108f60 0x7f24a0110ae0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2498009ca0 tx=0x7f249802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.709+0000 7f249f200640 1 -- 172.21.15.3:0/1211201509 shutdown_connections 2024-09-19T06:16:44.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.709+0000 7f249f200640 1 --2- 172.21.15.3:0/1211201509 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24a0108f60 0x7f24a0110ae0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.709+0000 7f249f200640 1 --2- 172.21.15.3:0/1211201509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24a01047e0 0x7f24a0108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.709+0000 7f249f200640 1 --2- 172.21.15.3:0/1211201509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a0103e30 0x7f24a0104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.709+0000 7f249f200640 1 -- 172.21.15.3:0/1211201509 >> 172.21.15.3:0/1211201509 conn(0x7f24a00ff8d0 msgr2=0x7f24a0101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:44.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.709+0000 7f249f200640 1 -- 172.21.15.3:0/1211201509 shutdown_connections 2024-09-19T06:16:44.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.709+0000 7f249f200640 1 -- 172.21.15.3:0/1211201509 wait complete. 2024-09-19T06:16:44.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.710+0000 7f249f200640 1 Processor -- start 2024-09-19T06:16:44.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.710+0000 7f249f200640 1 -- start start 2024-09-19T06:16:44.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.710+0000 7f249f200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24a0103e30 0x7f24a019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.711+0000 7f249f200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24a01047e0 0x7f24a019a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.711+0000 7f249f200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a0108f60 0x7f24a019ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.711+0000 7f249f200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f24a0114010 con 0x7f24a01047e0 2024-09-19T06:16:44.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.711+0000 7f249f200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f24a0113e90 con 0x7f24a0108f60 2024-09-19T06:16:44.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.711+0000 7f249f200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f24a0114190 con 0x7f24a0103e30 2024-09-19T06:16:44.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.711+0000 7f2495400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24a01047e0 0x7f24a019a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.711+0000 7f2495400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24a01047e0 0x7f24a019a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42630/0 (socket says 172.21.15.3:42630) 2024-09-19T06:16:44.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.711+0000 7f249de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24a0103e30 0x7f24a019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.711+0000 7f2495400640 1 -- 172.21.15.3:0/347501901 learned_addr learned my addr 172.21.15.3:0/347501901 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:44.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.711+0000 7f249e800640 1 --2- 172.21.15.3:0/347501901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a0108f60 0x7f24a019ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.711+0000 7f249de00640 1 -- 172.21.15.3:0/347501901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a0108f60 msgr2=0x7f24a019ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:44.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.711+0000 7f249de00640 1 --2- 172.21.15.3:0/347501901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a0108f60 0x7f24a019ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.711+0000 7f249de00640 1 -- 172.21.15.3:0/347501901 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24a01047e0 msgr2=0x7f24a019a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:44.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.711+0000 7f249de00640 1 --2- 172.21.15.3:0/347501901 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24a01047e0 0x7f24a019a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.711+0000 7f249de00640 1 -- 172.21.15.3:0/347501901 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a019f3a0 con 0x7f24a0103e30 2024-09-19T06:16:44.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.712+0000 7f249de00640 1 --2- 172.21.15.3:0/347501901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24a0103e30 0x7f24a019a3f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f249000e9f0 tx=0x7f249000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:44.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.712+0000 7f2497400640 1 -- 172.21.15.3:0/347501901 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249000ccc0 con 0x7f24a0103e30 2024-09-19T06:16:44.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.712+0000 7f2497400640 1 -- 172.21.15.3:0/347501901 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2490010910 con 0x7f24a0103e30 2024-09-19T06:16:44.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.712+0000 7f249f200640 1 -- 172.21.15.3:0/347501901 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a019f690 con 0x7f24a0103e30 2024-09-19T06:16:44.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.712+0000 7f2497400640 1 -- 172.21.15.3:0/347501901 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2490018960 con 0x7f24a0103e30 2024-09-19T06:16:44.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.712+0000 7f249f200640 1 -- 172.21.15.3:0/347501901 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a01a6f70 con 0x7f24a0103e30 2024-09-19T06:16:44.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.715+0000 7f24a73db740 1 Processor -- start 2024-09-19T06:16:44.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.715+0000 7f2497400640 1 -- 172.21.15.3:0/347501901 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f2490010ac0 con 0x7f24a0103e30 2024-09-19T06:16:44.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.716+0000 7f24a73db740 1 -- start start 2024-09-19T06:16:44.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.716+0000 7f24a73db740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261854d50 0x55b261855130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.716+0000 7f24a73db740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b261855670 0x55b26185f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.716+0000 7f24a73db740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b26185ff30 0x55b261862320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.716+0000 7f24a73db740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b2617bb3e0 con 0x55b261854d50 2024-09-19T06:16:44.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.716+0000 7f24a73db740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b261762d80 con 0x55b26185ff30 2024-09-19T06:16:44.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.716+0000 7f24a73db740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b2617b73a0 con 0x55b261855670 2024-09-19T06:16:44.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.716+0000 7f249de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b261855670 0x55b26185f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.716+0000 7f249e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261854d50 0x55b261855130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.716+0000 7f249de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b261855670 0x55b26185f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:37344/0 (socket says 172.21.15.3:37344) 2024-09-19T06:16:44.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.716+0000 7f249de00640 1 -- 172.21.15.3:0/933144414 learned_addr learned my addr 172.21.15.3:0/933144414 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:44.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.716+0000 7f2495400640 1 --2- 172.21.15.3:0/933144414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b26185ff30 0x55b261862320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.717+0000 7f249de00640 1 -- 172.21.15.3:0/933144414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b26185ff30 msgr2=0x55b261862320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:44.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.717+0000 7f249de00640 1 --2- 172.21.15.3:0/933144414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b26185ff30 0x55b261862320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.717+0000 7f249de00640 1 -- 172.21.15.3:0/933144414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261854d50 msgr2=0x55b261855130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:44.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.717+0000 7f249de00640 1 --2- 172.21.15.3:0/933144414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261854d50 0x55b261855130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.717+0000 7f249de00640 1 -- 172.21.15.3:0/933144414 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b261781ae0 con 0x55b261855670 2024-09-19T06:16:44.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.717+0000 7f2495400640 1 --2- 172.21.15.3:0/933144414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b26185ff30 0x55b261862320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:44.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.717+0000 7f249e800640 1 --2- 172.21.15.3:0/933144414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261854d50 0x55b261855130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:44.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.717+0000 7f249de00640 1 --2- 172.21.15.3:0/933144414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b261855670 0x55b26185f9f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f24900cd740 tx=0x7f24900d8780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=165db005e8284c54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:44.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.717+0000 7f2497400640 1 --2- 172.21.15.3:0/347501901 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f24840a33b0 0x7f24840a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.717+0000 7f248f000640 1 -- 172.21.15.3:0/933144414 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24900e3070 con 0x55b261855670 2024-09-19T06:16:44.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.717+0000 7f2497400640 1 -- 172.21.15.3:0/347501901 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f24900d0110 con 0x7f24a0103e30 2024-09-19T06:16:44.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.717+0000 7f248f000640 1 -- 172.21.15.3:0/933144414 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f249009c440 con 0x55b261855670 2024-09-19T06:16:44.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.717+0000 7f248f000640 1 -- 172.21.15.3:0/933144414 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249009bda0 con 0x55b261855670 2024-09-19T06:16:44.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.718+0000 7f249e800640 1 --2- 172.21.15.3:0/347501901 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f24840a33b0 0x7f24840a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.718+0000 7f24a73db740 1 -- 172.21.15.3:0/933144414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b261855670 msgr2=0x55b26185f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:44.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.718+0000 7f24a73db740 1 --2- 172.21.15.3:0/933144414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b261855670 0x55b26185f9f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f24900cd740 tx=0x7f24900d8780 comp rx=0 tx=0).stop 2024-09-19T06:16:44.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.718+0000 7f249e800640 1 --2- 172.21.15.3:0/347501901 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f24840a33b0 0x7f24840a5870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2498006010 tx=0x7f2498005d80 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:44.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.718+0000 7f24a73db740 1 -- 172.21.15.3:0/933144414 shutdown_connections 2024-09-19T06:16:44.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.718+0000 7f24a73db740 1 --2- 172.21.15.3:0/933144414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b26185ff30 0x55b261862320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.718+0000 7f24a73db740 1 --2- 172.21.15.3:0/933144414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b261855670 0x55b26185f9f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.718+0000 7f24a73db740 1 --2- 172.21.15.3:0/933144414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261854d50 0x55b261855130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.718+0000 7f24a73db740 1 -- 172.21.15.3:0/933144414 >> 172.21.15.3:0/933144414 conn(0x55b2618512e0 msgr2=0x55b2618516c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:44.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.719+0000 7f24a73db740 1 -- 172.21.15.3:0/933144414 shutdown_connections 2024-09-19T06:16:44.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.719+0000 7f24a73db740 1 -- 172.21.15.3:0/933144414 wait complete. 2024-09-19T06:16:44.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.719+0000 7f24a73db740 1 -- start start 2024-09-19T06:16:44.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.719+0000 7f24a73db740 1 Processor -- start 2024-09-19T06:16:44.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.720+0000 7f24a73db740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261854d50 0x55b26185ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.720+0000 7f24a73db740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b261855670 0x55b26185d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.720+0000 7f24a73db740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b26185ff30 0x55b26185d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.720+0000 7f24a73db740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b261862ba0 con 0x55b261854d50 2024-09-19T06:16:44.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.720+0000 7f24a73db740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b2617760f0 con 0x55b261855670 2024-09-19T06:16:44.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.720+0000 7f24a73db740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b261862d20 con 0x55b26185ff30 2024-09-19T06:16:44.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.720+0000 7f24a73db740 10 client.0 _ll_register_callbacks cb 0x55b2617679e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:44.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.720+0000 7f249de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261854d50 0x55b26185ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.720+0000 7f249de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261854d50 0x55b26185ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42650/0 (socket says 172.21.15.3:42650) 2024-09-19T06:16:44.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.720+0000 7f249de00640 1 -- 172.21.15.3:0/2231047080 learned_addr learned my addr 172.21.15.3:0/2231047080 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:44.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.720+0000 7f2495400640 1 --2- 172.21.15.3:0/2231047080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b261855670 0x55b26185d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.720+0000 7f249e800640 1 --2- 172.21.15.3:0/2231047080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b26185ff30 0x55b26185d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.721+0000 7f249de00640 1 -- 172.21.15.3:0/2231047080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b26185ff30 msgr2=0x55b26185d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:44.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.721+0000 7f249de00640 1 --2- 172.21.15.3:0/2231047080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b26185ff30 0x55b26185d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.721+0000 7f249de00640 1 -- 172.21.15.3:0/2231047080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b261855670 msgr2=0x55b26185d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:44.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.721+0000 7f249de00640 1 --2- 172.21.15.3:0/2231047080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b261855670 0x55b26185d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.721+0000 7f249de00640 1 -- 172.21.15.3:0/2231047080 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b26152c3c0 con 0x55b261854d50 2024-09-19T06:16:44.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.721+0000 7f2495400640 1 --2- 172.21.15.3:0/2231047080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b261855670 0x55b26185d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:44.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.721+0000 7f249de00640 1 --2- 172.21.15.3:0/2231047080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261854d50 0x55b26185ce60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f24900a4ad0 tx=0x7f249009c060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c23bf336d2cfde7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:44.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.721+0000 7f2483400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:16:44.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.721+0000 7f2483400640 1 -- 172.21.15.3:0/2231047080 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249009bda0 con 0x55b261854d50 2024-09-19T06:16:44.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.721+0000 7f2483400640 1 -- 172.21.15.3:0/2231047080 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f24900cda80 con 0x55b261854d50 2024-09-19T06:16:44.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.721+0000 7f24a73db740 1 -- 172.21.15.3:0/2231047080 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f249009c440 con 0x55b261854d50 2024-09-19T06:16:44.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.721+0000 7f2483400640 1 -- 172.21.15.3:0/2231047080 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f249009c210 con 0x55b261854d50 2024-09-19T06:16:44.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.721+0000 7f24a73db740 10 client.16353 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:44.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.721+0000 7f24a73db740 1 -- 172.21.15.3:0/2231047080 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b261862ba0 con 0x55b261854d50 2024-09-19T06:16:44.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.722+0000 7f2483400640 1 -- 172.21.15.3:0/2231047080 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f249009c440 con 0x55b261854d50 2024-09-19T06:16:44.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.722+0000 7f2483400640 1 -- 172.21.15.3:0/2231047080 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f249009c7a0 con 0x55b261854d50 2024-09-19T06:16:44.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.722+0000 7f24a73db740 10 client.16353 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:44.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.722+0000 7f24a73db740 10 client.16353 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:44.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.722+0000 7f24a73db740 20 client.16353 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:44.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.722+0000 7f24a73db740 1 --2- 172.21.15.3:0/2231047080 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b26186fa20 0x55b261871e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.722+0000 7f24a73db740 4 client.16353 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:44.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.722+0000 7f24a73db740 1 -- 172.21.15.3:0/2231047080 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2617c8950 con 0x55b26186fa20 2024-09-19T06:16:44.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.723+0000 7f2495400640 1 --2- 172.21.15.3:0/2231047080 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b26186fa20 0x55b261871e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.723+0000 7f2495400640 1 --2- 172.21.15.3:0/2231047080 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b26186fa20 0x55b261871e10 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f52a18c2e8dabefb server_cookie=386b0b3f15b33a7 in_seq=0 out_seq=0 2024-09-19T06:16:44.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.723+0000 7f2483400640 10 client.16353 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:44.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.724+0000 7f2483400640 1 -- 172.21.15.3:0/2231047080 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b2617c8950 con 0x55b26186fa20 2024-09-19T06:16:44.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.724+0000 7f2483400640 10 client.16353 handle_command_reply: tid=0 2024-09-19T06:16:44.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.724+0000 7f24a73db740 1 client.16353 shutdown 2024-09-19T06:16:44.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.724+0000 7f24a73db740 1 -- 172.21.15.3:0/2231047080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261854d50 msgr2=0x55b26185ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:44.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.724+0000 7f24a73db740 1 --2- 172.21.15.3:0/2231047080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261854d50 0x55b26185ce60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f24900a4ad0 tx=0x7f249009c060 comp rx=0 tx=0).stop 2024-09-19T06:16:44.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.724+0000 7f24a73db740 1 -- 172.21.15.3:0/2231047080 shutdown_connections 2024-09-19T06:16:44.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.724+0000 7f24a73db740 1 --2- 172.21.15.3:0/2231047080 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b26186fa20 0x55b261871e10 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.724+0000 7f24a73db740 1 --2- 172.21.15.3:0/2231047080 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b26185ff30 0x55b26185d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.724+0000 7f24a73db740 1 --2- 172.21.15.3:0/2231047080 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b261855670 0x55b26185d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.724+0000 7f2483400640 0 client.16353 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:44.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.724+0000 7f24a73db740 1 --2- 172.21.15.3:0/2231047080 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261854d50 0x55b26185ce60 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.724+0000 7f24a73db740 1 -- 172.21.15.3:0/2231047080 >> 172.21.15.3:0/2231047080 conn(0x55b2618512e0 msgr2=0x55b261857010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:44.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.724+0000 7f24a73db740 1 -- 172.21.15.3:0/2231047080 shutdown_connections 2024-09-19T06:16:44.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.725+0000 7f24a73db740 1 -- 172.21.15.3:0/2231047080 wait complete. 2024-09-19T06:16:44.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.725+0000 7f24a73db740 20 client.16353 trim_cache size 0 max 16384 2024-09-19T06:16:44.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.742+0000 7f24a73db740 1 Processor -- start 2024-09-19T06:16:44.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.743+0000 7f24a73db740 1 -- start start 2024-09-19T06:16:44.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.743+0000 7f24a73db740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b261854d50 0x55b2618775d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.743+0000 7f24a73db740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261855670 0x55b261877b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.743+0000 7f24a73db740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b26185ff30 0x55b26184fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.743+0000 7f24a73db740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f24a01af9d0 con 0x55b261855670 2024-09-19T06:16:44.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.743+0000 7f24a73db740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f24a01b1510 con 0x55b26185ff30 2024-09-19T06:16:44.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.743+0000 7f24a73db740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f24a01b00a0 con 0x55b261854d50 2024-09-19T06:16:44.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.743+0000 7f2495400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261855670 0x55b261877b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.743+0000 7f2495400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261855670 0x55b261877b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42654/0 (socket says 172.21.15.3:42654) 2024-09-19T06:16:44.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.743+0000 7f2495400640 1 -- 172.21.15.3:0/915796164 learned_addr learned my addr 172.21.15.3:0/915796164 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:44.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.743+0000 7f249de00640 1 --2- 172.21.15.3:0/915796164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b261854d50 0x55b2618775d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.743+0000 7f249e800640 1 --2- 172.21.15.3:0/915796164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b26185ff30 0x55b26184fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.744+0000 7f2495400640 1 -- 172.21.15.3:0/915796164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b261854d50 msgr2=0x55b2618775d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:44.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.744+0000 7f2495400640 1 --2- 172.21.15.3:0/915796164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b261854d50 0x55b2618775d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.744+0000 7f2495400640 1 -- 172.21.15.3:0/915796164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b26185ff30 msgr2=0x55b26184fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:44.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.744+0000 7f2495400640 1 --2- 172.21.15.3:0/915796164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b26185ff30 0x55b26184fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.744+0000 7f2495400640 1 -- 172.21.15.3:0/915796164 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b26185f7d0 con 0x55b261855670 2024-09-19T06:16:44.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.744+0000 7f2495400640 1 --2- 172.21.15.3:0/915796164 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261855670 0x55b261877b10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x55b26185c6f0 tx=0x7f2488005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76d1c83bb254808 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:44.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.744+0000 7f248e600640 1 -- 172.21.15.3:0/915796164 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248800f890 con 0x55b261855670 2024-09-19T06:16:44.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.744+0000 7f248e600640 1 -- 172.21.15.3:0/915796164 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2488010430 con 0x55b261855670 2024-09-19T06:16:44.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.744+0000 7f248e600640 1 -- 172.21.15.3:0/915796164 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488029670 con 0x55b261855670 2024-09-19T06:16:44.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.745+0000 7f24a73db740 1 -- 172.21.15.3:0/915796164 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261855670 msgr2=0x55b261877b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:44.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.745+0000 7f24a73db740 1 --2- 172.21.15.3:0/915796164 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261855670 0x55b261877b10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x55b26185c6f0 tx=0x7f2488005f90 comp rx=0 tx=0).stop 2024-09-19T06:16:44.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.745+0000 7f24a73db740 1 -- 172.21.15.3:0/915796164 shutdown_connections 2024-09-19T06:16:44.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.745+0000 7f24a73db740 1 --2- 172.21.15.3:0/915796164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b26185ff30 0x55b26184fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.745+0000 7f24a73db740 1 --2- 172.21.15.3:0/915796164 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261855670 0x55b261877b10 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.745+0000 7f24a73db740 1 --2- 172.21.15.3:0/915796164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b261854d50 0x55b2618775d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.745+0000 7f24a73db740 1 -- 172.21.15.3:0/915796164 >> 172.21.15.3:0/915796164 conn(0x55b2618512e0 msgr2=0x55b26185bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:44.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.745+0000 7f24a73db740 1 -- 172.21.15.3:0/915796164 shutdown_connections 2024-09-19T06:16:44.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.745+0000 7f24a73db740 1 -- 172.21.15.3:0/915796164 wait complete. 2024-09-19T06:16:44.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.745+0000 7f24a73db740 1 -- start start 2024-09-19T06:16:44.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.746+0000 7f24a73db740 1 Processor -- start 2024-09-19T06:16:44.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.746+0000 7f24a73db740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b261854d50 0x55b2618683f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.746+0000 7f24a73db740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261855670 0x55b261863720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.746+0000 7f24a73db740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b26185ff30 0x55b261863c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.746+0000 7f24a73db740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f24a01b0e40 con 0x55b261855670 2024-09-19T06:16:44.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.746+0000 7f24a73db740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f24a01b0770 con 0x55b261854d50 2024-09-19T06:16:44.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.746+0000 7f24a73db740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f24a01ad9b0 con 0x55b26185ff30 2024-09-19T06:16:44.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.746+0000 7f24a73db740 10 client.0 _ll_register_callbacks cb 0x7f24900d8170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:44.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.746+0000 7f2495400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261855670 0x55b261863720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.746+0000 7f249de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b261854d50 0x55b2618683f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.746+0000 7f2495400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261855670 0x55b261863720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42658/0 (socket says 172.21.15.3:42658) 2024-09-19T06:16:44.752 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.746+0000 7f2495400640 1 -- 172.21.15.3:0/1640135462 learned_addr learned my addr 172.21.15.3:0/1640135462 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:44.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.747+0000 7f249e800640 1 --2- 172.21.15.3:0/1640135462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b26185ff30 0x55b261863c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.747+0000 7f2495400640 1 -- 172.21.15.3:0/1640135462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b26185ff30 msgr2=0x55b261863c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:44.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.747+0000 7f2495400640 1 --2- 172.21.15.3:0/1640135462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b26185ff30 0x55b261863c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.747+0000 7f2495400640 1 -- 172.21.15.3:0/1640135462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b261854d50 msgr2=0x55b2618683f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:44.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.747+0000 7f2495400640 1 --2- 172.21.15.3:0/1640135462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b261854d50 0x55b2618683f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.747+0000 7f2495400640 1 -- 172.21.15.3:0/1640135462 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2618641a0 con 0x55b261855670 2024-09-19T06:16:44.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.747+0000 7f249de00640 1 --2- 172.21.15.3:0/1640135462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b261854d50 0x55b2618683f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:44.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.747+0000 7f2495400640 1 --2- 172.21.15.3:0/1640135462 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261855670 0x55b261863720 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2488005db0 tx=0x7f24880126f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916d37ee6d339728 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:44.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.747+0000 7f2483400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:16:44.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.747+0000 7f2483400640 1 -- 172.21.15.3:0/1640135462 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248802e070 con 0x55b261855670 2024-09-19T06:16:44.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.748+0000 7f2483400640 1 -- 172.21.15.3:0/1640135462 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f2488005270 con 0x55b261855670 2024-09-19T06:16:44.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.748+0000 7f24a73db740 1 -- 172.21.15.3:0/1640135462 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2488010430 con 0x55b261855670 2024-09-19T06:16:44.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.748+0000 7f2483400640 1 -- 172.21.15.3:0/1640135462 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2488005470 con 0x55b261855670 2024-09-19T06:16:44.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.748+0000 7f24a73db740 10 client.16359 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:44.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.748+0000 7f24a73db740 1 -- 172.21.15.3:0/1640135462 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b2618da2e0 con 0x55b261855670 2024-09-19T06:16:44.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.748+0000 7f2483400640 1 -- 172.21.15.3:0/1640135462 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2488010430 con 0x55b261855670 2024-09-19T06:16:44.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.748+0000 7f2483400640 1 -- 172.21.15.3:0/1640135462 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f248800fd00 con 0x55b261855670 2024-09-19T06:16:44.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.748+0000 7f24a73db740 10 client.16359 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:44.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.748+0000 7f24a73db740 10 client.16359 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:44.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.748+0000 7f24a73db740 20 client.16359 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:44.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.748+0000 7f24a73db740 1 --2- 172.21.15.3:0/1640135462 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b2618da9d0 0x55b2618dcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:44.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.748+0000 7f24a73db740 4 client.16359 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:16:44.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.748+0000 7f24a73db740 1 -- 172.21.15.3:0/1640135462 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b2617c2e60 con 0x55b2618da9d0 2024-09-19T06:16:44.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.749+0000 7f249de00640 1 --2- 172.21.15.3:0/1640135462 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b2618da9d0 0x55b2618dcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:44.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.749+0000 7f249de00640 1 --2- 172.21.15.3:0/1640135462 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b2618da9d0 0x55b2618dcdf0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36ef115236f8f4ff server_cookie=f3acc6dfd9bb312 in_seq=0 out_seq=0 2024-09-19T06:16:44.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.749+0000 7f2483400640 10 client.16359 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:44.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.749+0000 7f2483400640 1 -- 172.21.15.3:0/1640135462 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b2617c2e60 con 0x55b2618da9d0 2024-09-19T06:16:44.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.749+0000 7f2483400640 10 client.16359 handle_command_reply: tid=0 2024-09-19T06:16:44.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.749+0000 7f24a73db740 1 client.16359 shutdown 2024-09-19T06:16:44.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.750+0000 7f24a73db740 1 -- 172.21.15.3:0/1640135462 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261855670 msgr2=0x55b261863720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:44.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.750+0000 7f24a73db740 1 --2- 172.21.15.3:0/1640135462 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261855670 0x55b261863720 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2488005db0 tx=0x7f24880126f0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.750+0000 7f24a73db740 1 -- 172.21.15.3:0/1640135462 shutdown_connections 2024-09-19T06:16:44.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.750+0000 7f24a73db740 1 --2- 172.21.15.3:0/1640135462 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b2618da9d0 0x55b2618dcdf0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.750+0000 7f24a73db740 1 --2- 172.21.15.3:0/1640135462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b26185ff30 0x55b261863c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.750+0000 7f24a73db740 1 --2- 172.21.15.3:0/1640135462 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b261855670 0x55b261863720 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.750+0000 7f24a73db740 1 --2- 172.21.15.3:0/1640135462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b261854d50 0x55b2618683f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.750+0000 7f2483400640 0 client.16359 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:44.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.750+0000 7f24a73db740 1 -- 172.21.15.3:0/1640135462 >> 172.21.15.3:0/1640135462 conn(0x55b2618512e0 msgr2=0x55b26185ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:44.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.750+0000 7f24a73db740 1 -- 172.21.15.3:0/1640135462 shutdown_connections 2024-09-19T06:16:44.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.750+0000 7f24a73db740 1 -- 172.21.15.3:0/1640135462 wait complete. 2024-09-19T06:16:44.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.750+0000 7f24a73db740 20 client.16359 trim_cache size 0 max 16384 2024-09-19T06:16:44.759 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:16:44.759 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "no active scrubs running", 2024-09-19T06:16:44.759 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": {} 2024-09-19T06:16:44.759 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:16:44.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.751+0000 7f249f200640 1 -- 172.21.15.3:0/347501901 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f24840a33b0 msgr2=0x7f24840a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:44.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.751+0000 7f249f200640 1 --2- 172.21.15.3:0/347501901 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f24840a33b0 0x7f24840a5870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2498006010 tx=0x7f2498005d80 comp rx=0 tx=0).stop 2024-09-19T06:16:44.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.751+0000 7f249f200640 1 -- 172.21.15.3:0/347501901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24a0103e30 msgr2=0x7f24a019a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:44.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.751+0000 7f249f200640 1 --2- 172.21.15.3:0/347501901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24a0103e30 0x7f24a019a3f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f249000e9f0 tx=0x7f249000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.751+0000 7f249f200640 1 -- 172.21.15.3:0/347501901 shutdown_connections 2024-09-19T06:16:44.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.751+0000 7f249f200640 1 --2- 172.21.15.3:0/347501901 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f24840a33b0 0x7f24840a5870 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.751+0000 7f249f200640 1 --2- 172.21.15.3:0/347501901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24a0108f60 0x7f24a019ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.751+0000 7f249f200640 1 --2- 172.21.15.3:0/347501901 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24a01047e0 0x7f24a019a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.751+0000 7f249f200640 1 --2- 172.21.15.3:0/347501901 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24a0103e30 0x7f24a019a3f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:44.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.751+0000 7f249f200640 1 -- 172.21.15.3:0/347501901 >> 172.21.15.3:0/347501901 conn(0x7f24a00ff8d0 msgr2=0x7f24a0101ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:44.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.751+0000 7f249f200640 1 -- 172.21.15.3:0/347501901 shutdown_connections 2024-09-19T06:16:44.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:44.751+0000 7f249f200640 1 -- 172.21.15.3:0/347501901 wait complete. 2024-09-19T06:16:45.818 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:16:45.819 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:16:46.205 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:46.499 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:46 smithi003 ceph-mon[30893]: pgmap v134: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:16:46.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:46 smithi059 ceph-mon[35138]: pgmap v134: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:16:46.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:46 smithi071 ceph-mon[35662]: pgmap v134: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:16:46.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.774+0000 7f1f27e00640 1 -- 172.21.15.3:0/337526537 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f281079d0 msgr2=0x7f1f28107db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:46.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.774+0000 7f1f27e00640 1 --2- 172.21.15.3:0/337526537 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f281079d0 0x7f1f28107db0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009930 tx=0x7f1f1802a420 comp rx=0 tx=0).stop 2024-09-19T06:16:46.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.774+0000 7f1f27e00640 1 -- 172.21.15.3:0/337526537 shutdown_connections 2024-09-19T06:16:46.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.774+0000 7f1f27e00640 1 --2- 172.21.15.3:0/337526537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f28102370 0x7f1f2810e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.774+0000 7f1f27e00640 1 --2- 172.21.15.3:0/337526537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f281019d0 0x7f1f28101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.774+0000 7f1f27e00640 1 --2- 172.21.15.3:0/337526537 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f281079d0 0x7f1f28107db0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.774+0000 7f1f27e00640 1 -- 172.21.15.3:0/337526537 >> 172.21.15.3:0/337526537 conn(0x7f1f280fd710 msgr2=0x7f1f280ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:46.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.774+0000 7f1f27e00640 1 -- 172.21.15.3:0/337526537 shutdown_connections 2024-09-19T06:16:46.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.774+0000 7f1f27e00640 1 -- 172.21.15.3:0/337526537 wait complete. 2024-09-19T06:16:46.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.775+0000 7f1f27e00640 1 Processor -- start 2024-09-19T06:16:46.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.776+0000 7f1f27e00640 1 -- start start 2024-09-19T06:16:46.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.776+0000 7f1f27e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f281019d0 0x7f1f28198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:46.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.776+0000 7f1f27e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f28102370 0x7f1f28198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:46.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.776+0000 7f1f27e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f281079d0 0x7f1f2819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:46.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.776+0000 7f1f27e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1f28111dd0 con 0x7f1f281019d0 2024-09-19T06:16:46.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.776+0000 7f1f27e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1f28111c50 con 0x7f1f28102370 2024-09-19T06:16:46.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.776+0000 7f1f27e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1f28111f50 con 0x7f1f281079d0 2024-09-19T06:16:46.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.776+0000 7f1f26a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f281019d0 0x7f1f28198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:46.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.777+0000 7f1f26a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f281019d0 0x7f1f28198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42676/0 (socket says 172.21.15.3:42676) 2024-09-19T06:16:46.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.777+0000 7f1f26a00640 1 -- 172.21.15.3:0/441580344 learned_addr learned my addr 172.21.15.3:0/441580344 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:46.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.777+0000 7f1f26000640 1 --2- 172.21.15.3:0/441580344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f28102370 0x7f1f28198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:46.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.777+0000 7f1f27400640 1 --2- 172.21.15.3:0/441580344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f281079d0 0x7f1f2819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:46.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.777+0000 7f1f26a00640 1 -- 172.21.15.3:0/441580344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f281079d0 msgr2=0x7f1f2819cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:46.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.777+0000 7f1f26a00640 1 --2- 172.21.15.3:0/441580344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f281079d0 0x7f1f2819cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.777+0000 7f1f26a00640 1 -- 172.21.15.3:0/441580344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f28102370 msgr2=0x7f1f28198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:46.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.777+0000 7f1f26a00640 1 --2- 172.21.15.3:0/441580344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f28102370 0x7f1f28198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:46.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.777+0000 7f1f26a00640 1 -- 172.21.15.3:0/441580344 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f2819d2e0 con 0x7f1f281019d0 2024-09-19T06:16:46.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.777+0000 7f1f26000640 1 --2- 172.21.15.3:0/441580344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f28102370 0x7f1f28198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:46.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.777+0000 7f1f26a00640 1 --2- 172.21.15.3:0/441580344 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f281019d0 0x7f1f28198330 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009230 tx=0x7f1f18004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:46.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.778+0000 7f1f1f400640 1 -- 172.21.15.3:0/441580344 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1803f030 con 0x7f1f281019d0 2024-09-19T06:16:46.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.778+0000 7f1f1f400640 1 -- 172.21.15.3:0/441580344 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f18003ad0 con 0x7f1f281019d0 2024-09-19T06:16:46.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.778+0000 7f1f1f400640 1 -- 172.21.15.3:0/441580344 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f18035070 con 0x7f1f281019d0 2024-09-19T06:16:46.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.778+0000 7f1f27e00640 1 -- 172.21.15.3:0/441580344 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f2819d570 con 0x7f1f281019d0 2024-09-19T06:16:46.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.778+0000 7f1f27e00640 1 -- 172.21.15.3:0/441580344 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f2819da00 con 0x7f1f281019d0 2024-09-19T06:16:46.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.779+0000 7f1f27e00640 1 -- 172.21.15.3:0/441580344 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f28101e30 con 0x7f1f281019d0 2024-09-19T06:16:46.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.781+0000 7f1f1f400640 1 -- 172.21.15.3:0/441580344 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f1f18042030 con 0x7f1f281019d0 2024-09-19T06:16:46.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.783+0000 7f1f1f400640 1 --2- 172.21.15.3:0/441580344 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1f0c0a3430 0x7f1f0c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:46.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.783+0000 7f1f1f400640 1 -- 172.21.15.3:0/441580344 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f1f180f0070 con 0x7f1f281019d0 2024-09-19T06:16:46.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.784+0000 7f1f26000640 1 --2- 172.21.15.3:0/441580344 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1f0c0a3430 0x7f1f0c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:46.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.784+0000 7f1f26000640 1 --2- 172.21.15.3:0/441580344 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1f0c0a3430 0x7f1f0c0a58f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1f280ffde0 tx=0x7f1f14005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:46.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:46.787+0000 7f1f1f400640 1 -- 172.21.15.3:0/441580344 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1f180bc3a0 con 0x7f1f281019d0 2024-09-19T06:16:47.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:47.009+0000 7f1f27e00640 1 -- 172.21.15.3:0/441580344 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f28109f70 con 0x7f1f281019d0 2024-09-19T06:16:47.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:47.010+0000 7f1f1f400640 1 -- 172.21.15.3:0/441580344 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7f1f180c06a0 con 0x7f1f281019d0 2024-09-19T06:16:47.095 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:16:47.095 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"btime":"2024-09-19T06:12:22:958217+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:12:22.060987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24532,24515,24514,14517]},"id":1}]} 2024-09-19T06:16:47.096 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2024-09-19T06:16:47.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:47.014+0000 7f1f27e00640 1 -- 172.21.15.3:0/441580344 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1f0c0a3430 msgr2=0x7f1f0c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:47.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:47.014+0000 7f1f27e00640 1 --2- 172.21.15.3:0/441580344 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1f0c0a3430 0x7f1f0c0a58f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1f280ffde0 tx=0x7f1f14005f90 comp rx=0 tx=0).stop 2024-09-19T06:16:47.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:47.014+0000 7f1f27e00640 1 -- 172.21.15.3:0/441580344 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f281019d0 msgr2=0x7f1f28198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:47.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:47.014+0000 7f1f27e00640 1 --2- 172.21.15.3:0/441580344 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f281019d0 0x7f1f28198330 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009230 tx=0x7f1f18004270 comp rx=0 tx=0).stop 2024-09-19T06:16:47.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:47.014+0000 7f1f27e00640 1 -- 172.21.15.3:0/441580344 shutdown_connections 2024-09-19T06:16:47.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:47.014+0000 7f1f27e00640 1 --2- 172.21.15.3:0/441580344 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1f0c0a3430 0x7f1f0c0a58f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:47.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:47.014+0000 7f1f27e00640 1 --2- 172.21.15.3:0/441580344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1f281079d0 0x7f1f2819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:47.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:47.014+0000 7f1f27e00640 1 --2- 172.21.15.3:0/441580344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f28102370 0x7f1f28198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:47.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:47.014+0000 7f1f27e00640 1 --2- 172.21.15.3:0/441580344 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1f281019d0 0x7f1f28198330 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:47.097 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:47.014+0000 7f1f27e00640 1 -- 172.21.15.3:0/441580344 >> 172.21.15.3:0/441580344 conn(0x7f1f280fd710 msgr2=0x7f1f280fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:47.097 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:47.014+0000 7f1f27e00640 1 -- 172.21.15.3:0/441580344 shutdown_connections 2024-09-19T06:16:47.097 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:47.014+0000 7f1f27e00640 1 -- 172.21.15.3:0/441580344 wait complete. 2024-09-19T06:16:47.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:47 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/441580344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:16:47.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:47 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/441580344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:16:47.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:47 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/441580344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:16:47.973 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:16:48.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:48 smithi003 ceph-mon[30893]: pgmap v135: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-19T06:16:48.359 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:48.439 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:48 smithi059 ceph-mon[35138]: pgmap v135: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-19T06:16:48.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:48 smithi071 ceph-mon[35662]: pgmap v135: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-19T06:16:48.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.987+0000 7f4ea4000640 1 -- 172.21.15.3:0/503926593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e9c0745c0 msgr2=0x7f4e9c0749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:48.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.987+0000 7f4ea4000640 1 --2- 172.21.15.3:0/503926593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e9c0745c0 0x7f4e9c0749a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4e90009900 tx=0x7f4e9002a480 comp rx=0 tx=0).stop 2024-09-19T06:16:48.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.987+0000 7f4ea4000640 1 -- 172.21.15.3:0/503926593 shutdown_connections 2024-09-19T06:16:48.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.987+0000 7f4ea4000640 1 --2- 172.21.15.3:0/503926593 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e9c10e430 0x7f4e9c110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:48.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.987+0000 7f4ea4000640 1 --2- 172.21.15.3:0/503926593 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e9c074ee0 0x7f4e9c10def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:48.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.987+0000 7f4ea4000640 1 --2- 172.21.15.3:0/503926593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e9c0745c0 0x7f4e9c0749a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:48.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.987+0000 7f4ea4000640 1 -- 172.21.15.3:0/503926593 >> 172.21.15.3:0/503926593 conn(0x7f4e9c0fd8b0 msgr2=0x7f4e9c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:48.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.987+0000 7f4ea4000640 1 -- 172.21.15.3:0/503926593 shutdown_connections 2024-09-19T06:16:48.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.987+0000 7f4ea4000640 1 -- 172.21.15.3:0/503926593 wait complete. 2024-09-19T06:16:48.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.989+0000 7f4ea4000640 1 Processor -- start 2024-09-19T06:16:48.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.989+0000 7f4ea4000640 1 -- start start 2024-09-19T06:16:48.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.990+0000 7f4ea4000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e9c0745c0 0x7f4e9c19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:48.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.990+0000 7f4ea4000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e9c074ee0 0x7f4e9c19ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:48.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.990+0000 7f4ea4000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e9c10e430 0x7f4e9c19efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:48.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.990+0000 7f4ea4000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c1141a0 con 0x7f4e9c10e430 2024-09-19T06:16:48.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.990+0000 7f4ea4000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c114020 con 0x7f4e9c074ee0 2024-09-19T06:16:48.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.990+0000 7f4ea4000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c114320 con 0x7f4e9c0745c0 2024-09-19T06:16:48.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.990+0000 7f4ea1600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e9c0745c0 0x7f4e9c19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:48.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.990+0000 7f4ea1600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e9c0745c0 0x7f4e9c19a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:37410/0 (socket says 172.21.15.3:37410) 2024-09-19T06:16:48.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.990+0000 7f4ea1600640 1 -- 172.21.15.3:0/756763046 learned_addr learned my addr 172.21.15.3:0/756763046 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:48.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.990+0000 7f4ea0c00640 1 --2- 172.21.15.3:0/756763046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e9c074ee0 0x7f4e9c19ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:48.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.990+0000 7f4ea2000640 1 --2- 172.21.15.3:0/756763046 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e9c10e430 0x7f4e9c19efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:48.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.990+0000 7f4ea1600640 1 -- 172.21.15.3:0/756763046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e9c074ee0 msgr2=0x7f4e9c19ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:48.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.990+0000 7f4ea1600640 1 --2- 172.21.15.3:0/756763046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e9c074ee0 0x7f4e9c19ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:48.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.990+0000 7f4ea1600640 1 -- 172.21.15.3:0/756763046 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e9c10e430 msgr2=0x7f4e9c19efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:48.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.990+0000 7f4ea1600640 1 --2- 172.21.15.3:0/756763046 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e9c10e430 0x7f4e9c19efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:48.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.990+0000 7f4ea1600640 1 -- 172.21.15.3:0/756763046 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e9c19f6b0 con 0x7f4e9c0745c0 2024-09-19T06:16:48.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.991+0000 7f4ea1600640 1 --2- 172.21.15.3:0/756763046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e9c0745c0 0x7f4e9c19a700 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4e90006010 tx=0x7f4e90004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:48.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.991+0000 7f4e9a000640 1 -- 172.21.15.3:0/756763046 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9003f030 con 0x7f4e9c0745c0 2024-09-19T06:16:48.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.991+0000 7f4e9a000640 1 -- 172.21.15.3:0/756763046 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e90004440 con 0x7f4e9c0745c0 2024-09-19T06:16:48.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.991+0000 7f4ea4000640 1 -- 172.21.15.3:0/756763046 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e9c19f940 con 0x7f4e9c0745c0 2024-09-19T06:16:48.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.991+0000 7f4e9a000640 1 -- 172.21.15.3:0/756763046 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e90035070 con 0x7f4e9c0745c0 2024-09-19T06:16:48.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.991+0000 7f4ea4000640 1 -- 172.21.15.3:0/756763046 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e9c1a7280 con 0x7f4e9c0745c0 2024-09-19T06:16:48.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.996+0000 7f4ea6a60740 1 Processor -- start 2024-09-19T06:16:48.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.996+0000 7f4ea6a60740 1 -- start start 2024-09-19T06:16:48.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.996+0000 7f4e9a000640 1 -- 172.21.15.3:0/756763046 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f4e90042030 con 0x7f4e9c0745c0 2024-09-19T06:16:48.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.996+0000 7f4ea6a60740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55dd6ac46c70 0x55dd6ac47050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:48.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.996+0000 7f4ea6a60740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac47590 0x55dd6ac51910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:48.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.996+0000 7f4ea6a60740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6ac51e50 0x55dd6ac54240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:48.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.996+0000 7f4ea6a60740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55dd6abad3e0 con 0x55dd6ac46c70 2024-09-19T06:16:48.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.996+0000 7f4ea6a60740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55dd6ab54d80 con 0x55dd6ac51e50 2024-09-19T06:16:48.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.996+0000 7f4ea6a60740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55dd6aba93a0 con 0x55dd6ac47590 2024-09-19T06:16:48.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.997+0000 7f4ea2000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55dd6ac46c70 0x55dd6ac47050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:48.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.997+0000 7f4ea1600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac47590 0x55dd6ac51910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:48.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.997+0000 7f4ea1600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac47590 0x55dd6ac51910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:37412/0 (socket says 172.21.15.3:37412) 2024-09-19T06:16:48.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.997+0000 7f4ea1600640 1 -- 172.21.15.3:0/3058334811 learned_addr learned my addr 172.21.15.3:0/3058334811 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:48.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.997+0000 7f4ea0c00640 1 --2- 172.21.15.3:0/3058334811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6ac51e50 0x55dd6ac54240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.997+0000 7f4ea1600640 1 -- 172.21.15.3:0/3058334811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6ac51e50 msgr2=0x55dd6ac54240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:49.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.997+0000 7f4ea1600640 1 --2- 172.21.15.3:0/3058334811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6ac51e50 0x55dd6ac54240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.997+0000 7f4ea1600640 1 -- 172.21.15.3:0/3058334811 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55dd6ac46c70 msgr2=0x55dd6ac47050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:49.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.997+0000 7f4ea1600640 1 --2- 172.21.15.3:0/3058334811 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55dd6ac46c70 0x55dd6ac47050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.997+0000 7f4ea1600640 1 -- 172.21.15.3:0/3058334811 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd6ab73ae0 con 0x55dd6ac47590 2024-09-19T06:16:49.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.997+0000 7f4ea2000640 1 --2- 172.21.15.3:0/3058334811 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55dd6ac46c70 0x55dd6ac47050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:49.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.998+0000 7f4ea1600640 1 --2- 172.21.15.3:0/3058334811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac47590 0x55dd6ac51910 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4e900ed6b0 tx=0x7f4e900f8320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be3d3401cf50dee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:49.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.998+0000 7f4e8e600640 1 -- 172.21.15.3:0/3058334811 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e900f8d20 con 0x55dd6ac47590 2024-09-19T06:16:49.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.998+0000 7f4e8e600640 1 -- 172.21.15.3:0/3058334811 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e900fd030 con 0x55dd6ac47590 2024-09-19T06:16:49.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.998+0000 7f4e8e600640 1 -- 172.21.15.3:0/3058334811 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e90101630 con 0x55dd6ac47590 2024-09-19T06:16:49.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.998+0000 7f4e9a000640 1 --2- 172.21.15.3:0/756763046 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f4e840a3430 0x7f4e840a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.999+0000 7f4e9a000640 1 -- 172.21.15.3:0/756763046 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f4e900efff0 con 0x7f4e9c0745c0 2024-09-19T06:16:49.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.999+0000 7f4ea2000640 1 --2- 172.21.15.3:0/756763046 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f4e840a3430 0x7f4e840a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.999+0000 7f4ea6a60740 1 -- 172.21.15.3:0/3058334811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac47590 msgr2=0x55dd6ac51910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:49.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.999+0000 7f4ea6a60740 1 --2- 172.21.15.3:0/3058334811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac47590 0x55dd6ac51910 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4e900ed6b0 tx=0x7f4e900f8320 comp rx=0 tx=0).stop 2024-09-19T06:16:49.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.999+0000 7f4ea6a60740 1 -- 172.21.15.3:0/3058334811 shutdown_connections 2024-09-19T06:16:49.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.999+0000 7f4ea6a60740 1 --2- 172.21.15.3:0/3058334811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6ac51e50 0x55dd6ac54240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.999+0000 7f4ea6a60740 1 --2- 172.21.15.3:0/3058334811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac47590 0x55dd6ac51910 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.999+0000 7f4ea6a60740 1 --2- 172.21.15.3:0/3058334811 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55dd6ac46c70 0x55dd6ac47050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.999+0000 7f4ea6a60740 1 -- 172.21.15.3:0/3058334811 >> 172.21.15.3:0/3058334811 conn(0x55dd6ac43200 msgr2=0x55dd6ac435e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:49.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:48.999+0000 7f4ea6a60740 1 -- 172.21.15.3:0/3058334811 shutdown_connections 2024-09-19T06:16:49.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.000+0000 7f4ea6a60740 1 -- 172.21.15.3:0/3058334811 wait complete. 2024-09-19T06:16:49.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.000+0000 7f4ea2000640 1 --2- 172.21.15.3:0/756763046 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f4e840a3430 0x7f4e840a58f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009fd0 tx=0x7f4e94009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:49.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.000+0000 7f4ea6a60740 1 -- start start 2024-09-19T06:16:49.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.000+0000 7f4ea6a60740 1 Processor -- start 2024-09-19T06:16:49.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.001+0000 7f4ea6a60740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac46c70 0x55dd6ac4ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.001+0000 7f4ea6a60740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6ac47590 0x55dd6ac4f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.001+0000 7f4ea6a60740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55dd6ac51e50 0x55dd6ac4f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.001+0000 7f4ea6a60740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55dd6ac547e0 con 0x55dd6ac51e50 2024-09-19T06:16:49.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.001+0000 7f4ea6a60740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55dd6ab680f0 con 0x55dd6ac47590 2024-09-19T06:16:49.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.001+0000 7f4ea6a60740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55dd6ac54960 con 0x55dd6ac46c70 2024-09-19T06:16:49.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.001+0000 7f4ea6a60740 10 client.0 _ll_register_callbacks cb 0x55dd6ab4fbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:49.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.001+0000 7f4ea1600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac46c70 0x55dd6ac4ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.001+0000 7f4ea1600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac46c70 0x55dd6ac4ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:37420/0 (socket says 172.21.15.3:37420) 2024-09-19T06:16:49.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.001+0000 7f4ea1600640 1 -- 172.21.15.3:0/1306889886 learned_addr learned my addr 172.21.15.3:0/1306889886 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:49.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.001+0000 7f4ea0c00640 1 --2- 172.21.15.3:0/1306889886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6ac47590 0x55dd6ac4f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.001+0000 7f4ea2000640 1 --2- 172.21.15.3:0/1306889886 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55dd6ac51e50 0x55dd6ac4f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.002+0000 7f4ea1600640 1 -- 172.21.15.3:0/1306889886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6ac47590 msgr2=0x55dd6ac4f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:49.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.002+0000 7f4ea1600640 1 --2- 172.21.15.3:0/1306889886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6ac47590 0x55dd6ac4f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.002+0000 7f4ea1600640 1 -- 172.21.15.3:0/1306889886 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55dd6ac51e50 msgr2=0x55dd6ac4f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:49.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.002+0000 7f4ea1600640 1 --2- 172.21.15.3:0/1306889886 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55dd6ac51e50 0x55dd6ac4f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.002+0000 7f4ea1600640 1 -- 172.21.15.3:0/1306889886 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd6a91e3c0 con 0x55dd6ac46c70 2024-09-19T06:16:49.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.002+0000 7f4ea2000640 1 --2- 172.21.15.3:0/1306889886 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55dd6ac51e50 0x55dd6ac4f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:49.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.002+0000 7f4ea0c00640 1 --2- 172.21.15.3:0/1306889886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6ac47590 0x55dd6ac4f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:49.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.002+0000 7f4ea1600640 1 --2- 172.21.15.3:0/1306889886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac46c70 0x55dd6ac4ed00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4e900edd40 tx=0x7f4e900f0aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47e954172f7b6402 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:49.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.002+0000 7f4e82a00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:16:49.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.002+0000 7f4e82a00640 1 -- 172.21.15.3:0/1306889886 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e90049070 con 0x55dd6ac46c70 2024-09-19T06:16:49.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.002+0000 7f4ea6a60740 1 -- 172.21.15.3:0/1306889886 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e900fd030 con 0x55dd6ac46c70 2024-09-19T06:16:49.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.002+0000 7f4e82a00640 1 -- 172.21.15.3:0/1306889886 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f4e900ba680 con 0x55dd6ac46c70 2024-09-19T06:16:49.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.003+0000 7f4e82a00640 1 -- 172.21.15.3:0/1306889886 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4e900b8620 con 0x55dd6ac46c70 2024-09-19T06:16:49.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.003+0000 7f4ea6a60740 10 client.26422 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:49.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.003+0000 7f4ea6a60740 1 -- 172.21.15.3:0/1306889886 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dd6ac547e0 con 0x55dd6ac46c70 2024-09-19T06:16:49.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.003+0000 7f4e82a00640 1 -- 172.21.15.3:0/1306889886 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e900fd030 con 0x55dd6ac46c70 2024-09-19T06:16:49.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.003+0000 7f4e82a00640 1 -- 172.21.15.3:0/1306889886 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4e900ed9c0 con 0x55dd6ac46c70 2024-09-19T06:16:49.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.003+0000 7f4ea6a60740 10 client.26422 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:49.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.003+0000 7f4ea6a60740 10 client.26422 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:16:49.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.003+0000 7f4ea6a60740 20 client.26422 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:49.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.003+0000 7f4ea6a60740 1 --2- 172.21.15.3:0/1306889886 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55dd6ac61950 0x55dd6ac63d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.003+0000 7f4ea6a60740 4 client.26422 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:49.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.003+0000 7f4ea6a60740 1 -- 172.21.15.3:0/1306889886 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd6abba950 con 0x55dd6ac61950 2024-09-19T06:16:49.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.004+0000 7f4ea0c00640 1 --2- 172.21.15.3:0/1306889886 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55dd6ac61950 0x55dd6ac63d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.004+0000 7f4ea0c00640 1 --2- 172.21.15.3:0/1306889886 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55dd6ac61950 0x55dd6ac63d60 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=edb1231bda2f400b server_cookie=19fd969b475f77c3 in_seq=0 out_seq=0 2024-09-19T06:16:49.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.004+0000 7f4e82a00640 10 client.26422 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:16:49.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.005+0000 7f4e82a00640 1 -- 172.21.15.3:0/1306889886 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dd6abba950 con 0x55dd6ac61950 2024-09-19T06:16:49.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.005+0000 7f4e82a00640 10 client.26422 handle_command_reply: tid=0 2024-09-19T06:16:49.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.005+0000 7f4ea6a60740 1 client.26422 shutdown 2024-09-19T06:16:49.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.005+0000 7f4ea6a60740 1 -- 172.21.15.3:0/1306889886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac46c70 msgr2=0x55dd6ac4ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:49.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.005+0000 7f4ea6a60740 1 --2- 172.21.15.3:0/1306889886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac46c70 0x55dd6ac4ed00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4e900edd40 tx=0x7f4e900f0aa0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.005+0000 7f4ea6a60740 1 -- 172.21.15.3:0/1306889886 shutdown_connections 2024-09-19T06:16:49.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.005+0000 7f4ea6a60740 1 --2- 172.21.15.3:0/1306889886 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55dd6ac61950 0x55dd6ac63d60 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.005+0000 7f4ea6a60740 1 --2- 172.21.15.3:0/1306889886 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55dd6ac51e50 0x55dd6ac4f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.005+0000 7f4ea6a60740 1 --2- 172.21.15.3:0/1306889886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6ac47590 0x55dd6ac4f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.005+0000 7f4ea6a60740 1 --2- 172.21.15.3:0/1306889886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac46c70 0x55dd6ac4ed00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.005+0000 7f4e82a00640 0 client.26422 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:16:49.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.005+0000 7f4ea6a60740 1 -- 172.21.15.3:0/1306889886 >> 172.21.15.3:0/1306889886 conn(0x55dd6ac43200 msgr2=0x55dd6ac42380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:49.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.006+0000 7f4ea6a60740 1 -- 172.21.15.3:0/1306889886 shutdown_connections 2024-09-19T06:16:49.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.006+0000 7f4ea6a60740 1 -- 172.21.15.3:0/1306889886 wait complete. 2024-09-19T06:16:49.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.006+0000 7f4ea6a60740 20 client.26422 trim_cache size 0 max 16384 2024-09-19T06:16:49.022 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.020+0000 7f4ea6a60740 1 Processor -- start 2024-09-19T06:16:49.022 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.020+0000 7f4ea6a60740 1 -- start start 2024-09-19T06:16:49.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.020+0000 7f4ea6a60740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55dd6ac46c70 0x55dd6ac496d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.021+0000 7f4ea6a60740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac47590 0x55dd6ac42270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.021+0000 7f4ea6a60740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6ac51e50 0x55dd6ac69680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.021+0000 7f4ea6a60740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c1afb70 con 0x55dd6ac46c70 2024-09-19T06:16:49.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.021+0000 7f4ea6a60740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c1b16b0 con 0x55dd6ac51e50 2024-09-19T06:16:49.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.021+0000 7f4ea6a60740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c1b0240 con 0x55dd6ac47590 2024-09-19T06:16:49.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.021+0000 7f4ea1600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55dd6ac46c70 0x55dd6ac496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.021+0000 7f4ea1600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55dd6ac46c70 0x55dd6ac496d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42722/0 (socket says 172.21.15.3:42722) 2024-09-19T06:16:49.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.021+0000 7f4ea1600640 1 -- 172.21.15.3:0/3666578033 learned_addr learned my addr 172.21.15.3:0/3666578033 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:49.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.021+0000 7f4ea0c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac47590 0x55dd6ac42270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.021+0000 7f4ea2000640 1 --2- 172.21.15.3:0/3666578033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6ac51e50 0x55dd6ac69680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.021+0000 7f4ea1600640 1 -- 172.21.15.3:0/3666578033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac47590 msgr2=0x55dd6ac42270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:49.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.021+0000 7f4ea1600640 1 --2- 172.21.15.3:0/3666578033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac47590 0x55dd6ac42270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.021+0000 7f4ea1600640 1 -- 172.21.15.3:0/3666578033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6ac51e50 msgr2=0x55dd6ac69680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:49.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.021+0000 7f4ea1600640 1 --2- 172.21.15.3:0/3666578033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6ac51e50 0x55dd6ac69680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.021+0000 7f4ea1600640 1 -- 172.21.15.3:0/3666578033 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd6ac3e770 con 0x55dd6ac46c70 2024-09-19T06:16:49.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.021+0000 7f4ea0c00640 1 --2- 172.21.15.3:0/3666578033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac47590 0x55dd6ac42270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:49.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.022+0000 7f4ea1600640 1 --2- 172.21.15.3:0/3666578033 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55dd6ac46c70 0x55dd6ac496d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4e900b8d50 tx=0x7f4e900f8320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b9c110937e9177 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:49.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.022+0000 7f4e8dc00640 1 -- 172.21.15.3:0/3666578033 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e90049070 con 0x55dd6ac46c70 2024-09-19T06:16:49.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.022+0000 7f4e8dc00640 1 -- 172.21.15.3:0/3666578033 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e900f3650 con 0x55dd6ac46c70 2024-09-19T06:16:49.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.022+0000 7f4e8dc00640 1 -- 172.21.15.3:0/3666578033 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e900bbce0 con 0x55dd6ac46c70 2024-09-19T06:16:49.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.023+0000 7f4ea6a60740 1 -- 172.21.15.3:0/3666578033 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55dd6ac46c70 msgr2=0x55dd6ac496d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:49.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.023+0000 7f4ea6a60740 1 --2- 172.21.15.3:0/3666578033 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55dd6ac46c70 0x55dd6ac496d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4e900b8d50 tx=0x7f4e900f8320 comp rx=0 tx=0).stop 2024-09-19T06:16:49.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.023+0000 7f4ea6a60740 1 -- 172.21.15.3:0/3666578033 shutdown_connections 2024-09-19T06:16:49.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.023+0000 7f4ea6a60740 1 --2- 172.21.15.3:0/3666578033 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6ac51e50 0x55dd6ac69680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.023+0000 7f4ea6a60740 1 --2- 172.21.15.3:0/3666578033 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac47590 0x55dd6ac42270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.023+0000 7f4ea6a60740 1 --2- 172.21.15.3:0/3666578033 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55dd6ac46c70 0x55dd6ac496d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.023+0000 7f4ea6a60740 1 -- 172.21.15.3:0/3666578033 >> 172.21.15.3:0/3666578033 conn(0x55dd6ac43200 msgr2=0x55dd6ac41b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:49.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.023+0000 7f4ea6a60740 1 -- 172.21.15.3:0/3666578033 shutdown_connections 2024-09-19T06:16:49.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.023+0000 7f4ea6a60740 1 -- 172.21.15.3:0/3666578033 wait complete. 2024-09-19T06:16:49.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.024+0000 7f4ea6a60740 1 -- start start 2024-09-19T06:16:49.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.024+0000 7f4ea6a60740 1 Processor -- start 2024-09-19T06:16:49.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.024+0000 7f4ea6a60740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6ac46c70 0x55dd6ac55a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.024+0000 7f4ea6a60740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55dd6ac47590 0x55dd6ac55f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.024+0000 7f4ea6a60740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac51e50 0x55dd6ac564b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.024+0000 7f4ea6a60740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c1b0fe0 con 0x55dd6ac47590 2024-09-19T06:16:49.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.024+0000 7f4ea6a60740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c1b0910 con 0x55dd6ac46c70 2024-09-19T06:16:49.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.024+0000 7f4ea6a60740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c1adb50 con 0x55dd6ac51e50 2024-09-19T06:16:49.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.024+0000 7f4ea6a60740 10 client.0 _ll_register_callbacks cb 0x7f4e94009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:49.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.025+0000 7f4ea1600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6ac46c70 0x55dd6ac55a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.025+0000 7f4ea1600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6ac46c70 0x55dd6ac55a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:34520/0 (socket says 172.21.15.3:34520) 2024-09-19T06:16:49.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.025+0000 7f4ea1600640 1 -- 172.21.15.3:0/290806936 learned_addr learned my addr 172.21.15.3:0/290806936 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:49.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.025+0000 7f4ea2000640 1 --2- 172.21.15.3:0/290806936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac51e50 0x55dd6ac564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.025+0000 7f4ea0c00640 1 --2- 172.21.15.3:0/290806936 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55dd6ac47590 0x55dd6ac55f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.025+0000 7f4ea2000640 1 -- 172.21.15.3:0/290806936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6ac46c70 msgr2=0x55dd6ac55a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:49.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.025+0000 7f4ea2000640 1 --2- 172.21.15.3:0/290806936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6ac46c70 0x55dd6ac55a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.025+0000 7f4ea2000640 1 -- 172.21.15.3:0/290806936 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55dd6ac47590 msgr2=0x55dd6ac55f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:49.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.025+0000 7f4ea2000640 1 --2- 172.21.15.3:0/290806936 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55dd6ac47590 0x55dd6ac55f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.025+0000 7f4ea2000640 1 -- 172.21.15.3:0/290806936 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd6accb7c0 con 0x55dd6ac51e50 2024-09-19T06:16:49.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.025+0000 7f4ea1600640 1 --2- 172.21.15.3:0/290806936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6ac46c70 0x55dd6ac55a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:49.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.025+0000 7f4ea2000640 1 --2- 172.21.15.3:0/290806936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac51e50 0x55dd6ac564b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009e00 tx=0x7f4e94004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57a4388a5e689808 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:49.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.025+0000 7f4e82a00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:16:49.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.026+0000 7f4e82a00640 1 -- 172.21.15.3:0/290806936 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e9402e060 con 0x55dd6ac51e50 2024-09-19T06:16:49.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.026+0000 7f4e82a00640 1 -- 172.21.15.3:0/290806936 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f4e94010900 con 0x55dd6ac51e50 2024-09-19T06:16:49.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.026+0000 7f4ea6a60740 1 -- 172.21.15.3:0/290806936 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e900f3650 con 0x55dd6ac51e50 2024-09-19T06:16:49.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.026+0000 7f4e82a00640 1 -- 172.21.15.3:0/290806936 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4e94010b00 con 0x55dd6ac51e50 2024-09-19T06:16:49.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.026+0000 7f4ea6a60740 10 client.26428 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:49.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.026+0000 7f4ea6a60740 1 -- 172.21.15.3:0/290806936 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dd6acccae0 con 0x55dd6ac51e50 2024-09-19T06:16:49.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.026+0000 7f4e82a00640 1 -- 172.21.15.3:0/290806936 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e900f3650 con 0x55dd6ac51e50 2024-09-19T06:16:49.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.026+0000 7f4e82a00640 1 -- 172.21.15.3:0/290806936 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4e94028070 con 0x55dd6ac51e50 2024-09-19T06:16:49.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.027+0000 7f4ea6a60740 10 client.26428 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:49.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.027+0000 7f4ea6a60740 10 client.26428 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:16:49.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.027+0000 7f4ea6a60740 20 client.26428 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:49.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.027+0000 7f4ea6a60740 1 --2- 172.21.15.3:0/290806936 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55dd6accd230 0x55dd6accf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.027+0000 7f4ea6a60740 4 client.26428 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:16:49.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.027+0000 7f4ea6a60740 1 -- 172.21.15.3:0/290806936 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dd6abb4e60 con 0x55dd6accd230 2024-09-19T06:16:49.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.027+0000 7f4ea1600640 1 --2- 172.21.15.3:0/290806936 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55dd6accd230 0x55dd6accf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.027+0000 7f4ea1600640 1 --2- 172.21.15.3:0/290806936 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55dd6accd230 0x55dd6accf650 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8e02a68fe80232d6 server_cookie=664cf6d3f48f8676 in_seq=0 out_seq=0 2024-09-19T06:16:49.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.027+0000 7f4e82a00640 10 client.26428 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:16:49.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.028+0000 7f4e82a00640 1 -- 172.21.15.3:0/290806936 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dd6abb4e60 con 0x55dd6accd230 2024-09-19T06:16:49.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.028+0000 7f4e82a00640 10 client.26428 handle_command_reply: tid=0 2024-09-19T06:16:49.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.028+0000 7f4ea6a60740 1 client.26428 shutdown 2024-09-19T06:16:49.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.028+0000 7f4ea6a60740 1 -- 172.21.15.3:0/290806936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac51e50 msgr2=0x55dd6ac564b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:49.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.028+0000 7f4ea6a60740 1 --2- 172.21.15.3:0/290806936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac51e50 0x55dd6ac564b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009e00 tx=0x7f4e94004ab0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.028+0000 7f4ea6a60740 1 -- 172.21.15.3:0/290806936 shutdown_connections 2024-09-19T06:16:49.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.028+0000 7f4ea6a60740 1 --2- 172.21.15.3:0/290806936 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55dd6accd230 0x55dd6accf650 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.028+0000 7f4ea6a60740 1 --2- 172.21.15.3:0/290806936 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55dd6ac51e50 0x55dd6ac564b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.028+0000 7f4ea6a60740 1 --2- 172.21.15.3:0/290806936 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55dd6ac47590 0x55dd6ac55f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.028+0000 7f4ea6a60740 1 --2- 172.21.15.3:0/290806936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6ac46c70 0x55dd6ac55a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.028+0000 7f4e82a00640 0 client.26428 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:16:49.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.028+0000 7f4ea6a60740 1 -- 172.21.15.3:0/290806936 >> 172.21.15.3:0/290806936 conn(0x55dd6ac43200 msgr2=0x55dd6ac42380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:49.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.028+0000 7f4ea6a60740 1 -- 172.21.15.3:0/290806936 shutdown_connections 2024-09-19T06:16:49.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.028+0000 7f4ea6a60740 1 -- 172.21.15.3:0/290806936 wait complete. 2024-09-19T06:16:49.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.029+0000 7f4ea6a60740 20 client.26428 trim_cache size 0 max 16384 2024-09-19T06:16:49.034 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:16:49.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.029+0000 7f4ea4000640 1 -- 172.21.15.3:0/756763046 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f4e840a3430 msgr2=0x7f4e840a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:49.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.029+0000 7f4ea4000640 1 --2- 172.21.15.3:0/756763046 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f4e840a3430 0x7f4e840a58f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4e94009fd0 tx=0x7f4e94009500 comp rx=0 tx=0).stop 2024-09-19T06:16:49.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.029+0000 7f4ea4000640 1 -- 172.21.15.3:0/756763046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e9c0745c0 msgr2=0x7f4e9c19a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:49.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.029+0000 7f4ea4000640 1 --2- 172.21.15.3:0/756763046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e9c0745c0 0x7f4e9c19a700 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4e90006010 tx=0x7f4e90004040 comp rx=0 tx=0).stop 2024-09-19T06:16:49.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.030+0000 7f4ea4000640 1 -- 172.21.15.3:0/756763046 shutdown_connections 2024-09-19T06:16:49.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.030+0000 7f4ea4000640 1 --2- 172.21.15.3:0/756763046 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f4e840a3430 0x7f4e840a58f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.030+0000 7f4ea4000640 1 --2- 172.21.15.3:0/756763046 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e9c10e430 0x7f4e9c19efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.030+0000 7f4ea4000640 1 --2- 172.21.15.3:0/756763046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e9c074ee0 0x7f4e9c19ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.030+0000 7f4ea4000640 1 --2- 172.21.15.3:0/756763046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4e9c0745c0 0x7f4e9c19a700 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.030+0000 7f4ea4000640 1 -- 172.21.15.3:0/756763046 >> 172.21.15.3:0/756763046 conn(0x7f4e9c0fd8b0 msgr2=0x7f4e9c0fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:49.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.030+0000 7f4ea4000640 1 -- 172.21.15.3:0/756763046 shutdown_connections 2024-09-19T06:16:49.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:49.030+0000 7f4ea4000640 1 -- 172.21.15.3:0/756763046 wait complete. 2024-09-19T06:16:49.096 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.094+0000 7f55be800640 1 -- 172.21.15.3:0/3802660143 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55b81048e0 msgr2=0x7f55b8108920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:49.096 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.094+0000 7f55be800640 1 --2- 172.21.15.3:0/3802660143 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55b81048e0 0x7f55b8108920 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f55a0009900 tx=0x7f55a002a3f0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.097 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.094+0000 7f55be800640 1 -- 172.21.15.3:0/3802660143 shutdown_connections 2024-09-19T06:16:49.097 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.094+0000 7f55be800640 1 --2- 172.21.15.3:0/3802660143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55b8109080 0x7f55b8110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.097 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.094+0000 7f55be800640 1 --2- 172.21.15.3:0/3802660143 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55b81048e0 0x7f55b8108920 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.097 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.094+0000 7f55be800640 1 --2- 172.21.15.3:0/3802660143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b8103f30 0x7f55b8104310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.097 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.094+0000 7f55be800640 1 -- 172.21.15.3:0/3802660143 >> 172.21.15.3:0/3802660143 conn(0x7f55b80ff980 msgr2=0x7f55b8101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:49.097 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.094+0000 7f55be800640 1 -- 172.21.15.3:0/3802660143 shutdown_connections 2024-09-19T06:16:49.097 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.094+0000 7f55be800640 1 -- 172.21.15.3:0/3802660143 wait complete. 2024-09-19T06:16:49.099 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.095+0000 7f55be800640 1 Processor -- start 2024-09-19T06:16:49.099 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.095+0000 7f55be800640 1 -- start start 2024-09-19T06:16:49.099 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.096+0000 7f55be800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55b8103f30 0x7f55b819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.099 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.096+0000 7f55be800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b8109080 0x7f55b819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.099 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.096+0000 7f55be800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55b819ef00 0x7f55b819f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.100 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.096+0000 7f55be800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f55b81140d0 con 0x7f55b8103f30 2024-09-19T06:16:49.100 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.096+0000 7f55be800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f55b8113f50 con 0x7f55b8109080 2024-09-19T06:16:49.100 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.096+0000 7f55be800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f55b8114250 con 0x7f55b819ef00 2024-09-19T06:16:49.100 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.096+0000 7f55b7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55b8103f30 0x7f55b819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.100 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.096+0000 7f55b7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55b8103f30 0x7f55b819a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42748/0 (socket says 172.21.15.3:42748) 2024-09-19T06:16:49.100 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.096+0000 7f55b7400640 1 -- 172.21.15.3:0/1599302019 learned_addr learned my addr 172.21.15.3:0/1599302019 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:49.100 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.096+0000 7f55afe00640 1 --2- 172.21.15.3:0/1599302019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b8109080 0x7f55b819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.100 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.096+0000 7f55b7e00640 1 --2- 172.21.15.3:0/1599302019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55b819ef00 0x7f55b819f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.100 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.096+0000 7f55b7400640 1 -- 172.21.15.3:0/1599302019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55b819ef00 msgr2=0x7f55b819f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:49.100 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.096+0000 7f55b7400640 1 --2- 172.21.15.3:0/1599302019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55b819ef00 0x7f55b819f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.100 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.096+0000 7f55b7400640 1 -- 172.21.15.3:0/1599302019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b8109080 msgr2=0x7f55b819ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:49.101 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.096+0000 7f55b7400640 1 --2- 172.21.15.3:0/1599302019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b8109080 0x7f55b819ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.101 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.096+0000 7f55b7400640 1 -- 172.21.15.3:0/1599302019 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b819f9f0 con 0x7f55b8103f30 2024-09-19T06:16:49.101 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.097+0000 7f55b7400640 1 --2- 172.21.15.3:0/1599302019 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55b8103f30 0x7f55b819a640 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f55a800ea60 tx=0x7f55a800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:49.101 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.097+0000 7f55b4c00640 1 -- 172.21.15.3:0/1599302019 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a800cd20 con 0x7f55b8103f30 2024-09-19T06:16:49.101 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.097+0000 7f55be800640 1 -- 172.21.15.3:0/1599302019 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55b819fce0 con 0x7f55b8103f30 2024-09-19T06:16:49.101 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.097+0000 7f55b4c00640 1 -- 172.21.15.3:0/1599302019 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55a80035f0 con 0x7f55b8103f30 2024-09-19T06:16:49.101 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.097+0000 7f55b4c00640 1 -- 172.21.15.3:0/1599302019 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a8010690 con 0x7f55b8103f30 2024-09-19T06:16:49.101 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.097+0000 7f55be800640 1 -- 172.21.15.3:0/1599302019 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55b81a74a0 con 0x7f55b8103f30 2024-09-19T06:16:49.103 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.100+0000 7f55c1803740 1 Processor -- start 2024-09-19T06:16:49.103 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.100+0000 7f55b4c00640 1 -- 172.21.15.3:0/1599302019 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f55a80037a0 con 0x7f55b8103f30 2024-09-19T06:16:49.103 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.100+0000 7f55c1803740 1 -- start start 2024-09-19T06:16:49.103 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.101+0000 7f55c1803740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a3f69221e0 0x55a3f69225c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.103 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.101+0000 7f55c1803740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f6922b00 0x55a3f692ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.103 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.101+0000 7f55c1803740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f692d3a0 0x55a3f692f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.103 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.101+0000 7f55c1803740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a3f6888100 con 0x55a3f6922b00 2024-09-19T06:16:49.103 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.101+0000 7f55c1803740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a3f68301b0 con 0x55a3f692d3a0 2024-09-19T06:16:49.103 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.101+0000 7f55c1803740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a3f68840c0 con 0x55a3f69221e0 2024-09-19T06:16:49.103 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.101+0000 7f55b7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f6922b00 0x55a3f692ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.103 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.101+0000 7f55b7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a3f69221e0 0x55a3f69225c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.104 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.101+0000 7f55b7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f6922b00 0x55a3f692ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42764/0 (socket says 172.21.15.3:42764) 2024-09-19T06:16:49.104 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.101+0000 7f55b7400640 1 -- 172.21.15.3:0/145054335 learned_addr learned my addr 172.21.15.3:0/145054335 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:49.104 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.101+0000 7f55afe00640 1 --2- 172.21.15.3:0/145054335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f692d3a0 0x55a3f692f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.108 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.101+0000 7f55afe00640 1 -- 172.21.15.3:0/145054335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a3f69221e0 msgr2=0x55a3f69225c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:49.108 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.101+0000 7f55afe00640 1 --2- 172.21.15.3:0/145054335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a3f69221e0 0x55a3f69225c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.108 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.101+0000 7f55afe00640 1 -- 172.21.15.3:0/145054335 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f6922b00 msgr2=0x55a3f692ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:49.108 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.101+0000 7f55afe00640 1 --2- 172.21.15.3:0/145054335 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f6922b00 0x55a3f692ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.108 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.101+0000 7f55afe00640 1 -- 172.21.15.3:0/145054335 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3f659b210 con 0x55a3f692d3a0 2024-09-19T06:16:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.101+0000 7f55b7400640 1 --2- 172.21.15.3:0/145054335 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f6922b00 0x55a3f692ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.102+0000 7f55b4c00640 1 --2- 172.21.15.3:0/1599302019 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f559c0a33b0 0x7f559c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.102+0000 7f55afe00640 1 --2- 172.21.15.3:0/145054335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f692d3a0 0x55a3f692f790 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f55a002a910 tx=0x7f55a0005de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc16c930878cc7a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.102+0000 7f55b4c00640 1 -- 172.21.15.3:0/1599302019 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f55a80d0060 con 0x7f55b8103f30 2024-09-19T06:16:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.102+0000 7f55b7e00640 1 --2- 172.21.15.3:0/1599302019 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f559c0a33b0 0x7f559c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.102+0000 7f55acc00640 1 -- 172.21.15.3:0/145054335 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a0035040 con 0x55a3f692d3a0 2024-09-19T06:16:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.102+0000 7f55acc00640 1 -- 172.21.15.3:0/145054335 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55a0005520 con 0x55a3f692d3a0 2024-09-19T06:16:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.102+0000 7f55acc00640 1 -- 172.21.15.3:0/145054335 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a00035f0 con 0x55a3f692d3a0 2024-09-19T06:16:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.103+0000 7f55c1803740 1 -- 172.21.15.3:0/145054335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f692d3a0 msgr2=0x55a3f692f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.103+0000 7f55c1803740 1 --2- 172.21.15.3:0/145054335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f692d3a0 0x55a3f692f790 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f55a002a910 tx=0x7f55a0005de0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.103+0000 7f55b7e00640 1 --2- 172.21.15.3:0/1599302019 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f559c0a33b0 0x7f559c0a5870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f55b0005fd0 tx=0x7f55b0009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.103+0000 7f55c1803740 1 -- 172.21.15.3:0/145054335 shutdown_connections 2024-09-19T06:16:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.103+0000 7f55c1803740 1 --2- 172.21.15.3:0/145054335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f692d3a0 0x55a3f692f790 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.103+0000 7f55c1803740 1 --2- 172.21.15.3:0/145054335 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f6922b00 0x55a3f692ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.103+0000 7f55c1803740 1 --2- 172.21.15.3:0/145054335 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a3f69221e0 0x55a3f69225c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.103+0000 7f55c1803740 1 -- 172.21.15.3:0/145054335 >> 172.21.15.3:0/145054335 conn(0x55a3f691e750 msgr2=0x55a3f691eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.103+0000 7f55c1803740 1 -- 172.21.15.3:0/145054335 shutdown_connections 2024-09-19T06:16:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.103+0000 7f55c1803740 1 -- 172.21.15.3:0/145054335 wait complete. 2024-09-19T06:16:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.104+0000 7f55c1803740 1 -- start start 2024-09-19T06:16:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.104+0000 7f55c1803740 1 Processor -- start 2024-09-19T06:16:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.104+0000 7f55c1803740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f69221e0 0x55a3f692a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.104+0000 7f55c1803740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6922b00 0x55a3f692a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.104+0000 7f55c1803740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a3f692d3a0 0x55a3f692ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.104+0000 7f55c1803740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a3f692ff70 con 0x55a3f69221e0 2024-09-19T06:16:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.104+0000 7f55c1803740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a3f6811090 con 0x55a3f6922b00 2024-09-19T06:16:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.104+0000 7f55c1803740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a3f69300f0 con 0x55a3f692d3a0 2024-09-19T06:16:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.104+0000 7f55c1803740 10 client.0 _ll_register_callbacks cb 0x55a3f6865f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.104+0000 7f55b7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f69221e0 0x55a3f692a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.105+0000 7f55b7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f69221e0 0x55a3f692a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42766/0 (socket says 172.21.15.3:42766) 2024-09-19T06:16:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.105+0000 7f55b7400640 1 -- 172.21.15.3:0/3817916615 learned_addr learned my addr 172.21.15.3:0/3817916615 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.105+0000 7f55afe00640 1 --2- 172.21.15.3:0/3817916615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6922b00 0x55a3f692a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.105+0000 7f55b7e00640 1 --2- 172.21.15.3:0/3817916615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a3f692d3a0 0x55a3f692ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.105+0000 7f55b7400640 1 -- 172.21.15.3:0/3817916615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a3f692d3a0 msgr2=0x55a3f692ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.105+0000 7f55b7400640 1 --2- 172.21.15.3:0/3817916615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a3f692d3a0 0x55a3f692ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.105+0000 7f55b7400640 1 -- 172.21.15.3:0/3817916615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6922b00 msgr2=0x55a3f692a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.105+0000 7f55b7400640 1 --2- 172.21.15.3:0/3817916615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6922b00 0x55a3f692a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.105+0000 7f55b7400640 1 -- 172.21.15.3:0/3817916615 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3f6667620 con 0x55a3f69221e0 2024-09-19T06:16:49.112 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.105+0000 7f55afe00640 1 --2- 172.21.15.3:0/3817916615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6922b00 0x55a3f692a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:49.112 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.105+0000 7f55b7e00640 1 --2- 172.21.15.3:0/3817916615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a3f692d3a0 0x55a3f692ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:49.112 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.105+0000 7f55b7400640 1 --2- 172.21.15.3:0/3817916615 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f69221e0 0x55a3f692a310 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f55a8098740 tx=0x7f55a80cd6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e095530157575 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:49.112 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.105+0000 7f55a5600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:16:49.112 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.105+0000 7f55a5600640 1 -- 172.21.15.3:0/3817916615 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a809c0b0 con 0x55a3f69221e0 2024-09-19T06:16:49.112 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.105+0000 7f55a5600640 1 -- 172.21.15.3:0/3817916615 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f55a80d3c80 con 0x55a3f69221e0 2024-09-19T06:16:49.112 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.106+0000 7f55c1803740 1 -- 172.21.15.3:0/3817916615 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55a0005520 con 0x55a3f69221e0 2024-09-19T06:16:49.112 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.106+0000 7f55a5600640 1 -- 172.21.15.3:0/3817916615 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f55a809bc40 con 0x55a3f69221e0 2024-09-19T06:16:49.112 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.106+0000 7f55c1803740 10 client.16395 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:49.112 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.106+0000 7f55c1803740 1 -- 172.21.15.3:0/3817916615 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a3f693bba0 con 0x55a3f69221e0 2024-09-19T06:16:49.112 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.106+0000 7f55a5600640 1 -- 172.21.15.3:0/3817916615 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55a0005520 con 0x55a3f69221e0 2024-09-19T06:16:49.112 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.106+0000 7f55a5600640 1 -- 172.21.15.3:0/3817916615 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f55a80cd9d0 con 0x55a3f69221e0 2024-09-19T06:16:49.113 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.106+0000 7f55c1803740 10 client.16395 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:49.113 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.106+0000 7f55c1803740 10 client.16395 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:49.113 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.106+0000 7f55c1803740 20 client.16395 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:49.113 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.106+0000 7f55c1803740 1 --2- 172.21.15.3:0/3817916615 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a3f693d010 0x55a3f693f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.113 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.106+0000 7f55c1803740 4 client.16395 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:49.113 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.106+0000 7f55c1803740 1 -- 172.21.15.3:0/3817916615 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3f6895830 con 0x55a3f693d010 2024-09-19T06:16:49.113 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.107+0000 7f55afe00640 1 --2- 172.21.15.3:0/3817916615 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a3f693d010 0x55a3f693f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.114 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.107+0000 7f55afe00640 1 --2- 172.21.15.3:0/3817916615 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a3f693d010 0x55a3f693f440 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f78df48e33316cc2 server_cookie=8742748b1adb2777 in_seq=0 out_seq=0 2024-09-19T06:16:49.114 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.107+0000 7f55a5600640 10 client.16395 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:49.114 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.108+0000 7f55a5600640 1 -- 172.21.15.3:0/3817916615 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a3f6895830 con 0x55a3f693d010 2024-09-19T06:16:49.114 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.108+0000 7f55a5600640 10 client.16395 handle_command_reply: tid=0 2024-09-19T06:16:49.114 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.108+0000 7f55c1803740 1 client.16395 shutdown 2024-09-19T06:16:49.115 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.108+0000 7f55c1803740 1 -- 172.21.15.3:0/3817916615 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f69221e0 msgr2=0x55a3f692a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:49.115 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.108+0000 7f55c1803740 1 --2- 172.21.15.3:0/3817916615 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f69221e0 0x55a3f692a310 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f55a8098740 tx=0x7f55a80cd6f0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.115 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.108+0000 7f55c1803740 1 -- 172.21.15.3:0/3817916615 shutdown_connections 2024-09-19T06:16:49.115 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.108+0000 7f55c1803740 1 --2- 172.21.15.3:0/3817916615 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a3f693d010 0x55a3f693f440 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.115 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.108+0000 7f55c1803740 1 --2- 172.21.15.3:0/3817916615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a3f692d3a0 0x55a3f692ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.115 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.108+0000 7f55c1803740 1 --2- 172.21.15.3:0/3817916615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f6922b00 0x55a3f692a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.115 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.108+0000 7f55c1803740 1 --2- 172.21.15.3:0/3817916615 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f69221e0 0x55a3f692a310 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.115 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.108+0000 7f55a5600640 0 client.16395 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:49.115 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.108+0000 7f55c1803740 1 -- 172.21.15.3:0/3817916615 >> 172.21.15.3:0/3817916615 conn(0x55a3f691e750 msgr2=0x55a3f69244b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:49.115 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.108+0000 7f55c1803740 1 -- 172.21.15.3:0/3817916615 shutdown_connections 2024-09-19T06:16:49.115 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.108+0000 7f55c1803740 1 -- 172.21.15.3:0/3817916615 wait complete. 2024-09-19T06:16:49.115 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.108+0000 7f55c1803740 20 client.16395 trim_cache size 0 max 16384 2024-09-19T06:16:49.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.123+0000 7f55c1803740 1 Processor -- start 2024-09-19T06:16:49.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.124+0000 7f55c1803740 1 -- start start 2024-09-19T06:16:49.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.124+0000 7f55c1803740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f69221e0 0x55a3f692c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.124+0000 7f55c1803740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a3f6922b00 0x55a3f6944d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.124+0000 7f55c1803740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f692d3a0 0x55a3f69452b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.124+0000 7f55c1803740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f55b81afa50 con 0x55a3f692d3a0 2024-09-19T06:16:49.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.124+0000 7f55c1803740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f55b81b1590 con 0x55a3f69221e0 2024-09-19T06:16:49.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.124+0000 7f55c1803740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f55b81b0120 con 0x55a3f6922b00 2024-09-19T06:16:49.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.124+0000 7f55b7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f692d3a0 0x55a3f69452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.127 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.124+0000 7f55b7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f692d3a0 0x55a3f69452b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42782/0 (socket says 172.21.15.3:42782) 2024-09-19T06:16:49.127 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.124+0000 7f55b7e00640 1 -- 172.21.15.3:0/819120216 learned_addr learned my addr 172.21.15.3:0/819120216 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:49.127 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.124+0000 7f55b7400640 1 --2- 172.21.15.3:0/819120216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f69221e0 0x55a3f692c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.127 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.124+0000 7f55afe00640 1 --2- 172.21.15.3:0/819120216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a3f6922b00 0x55a3f6944d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.130 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.124+0000 7f55b7e00640 1 -- 172.21.15.3:0/819120216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a3f6922b00 msgr2=0x55a3f6944d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:49.130 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.124+0000 7f55b7e00640 1 --2- 172.21.15.3:0/819120216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a3f6922b00 0x55a3f6944d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.130 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.125+0000 7f55b7e00640 1 -- 172.21.15.3:0/819120216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f69221e0 msgr2=0x55a3f692c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:49.130 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.125+0000 7f55b7e00640 1 --2- 172.21.15.3:0/819120216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f69221e0 0x55a3f692c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.130 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.125+0000 7f55b7e00640 1 -- 172.21.15.3:0/819120216 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3f69391d0 con 0x55a3f692d3a0 2024-09-19T06:16:49.130 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.125+0000 7f55b7400640 1 --2- 172.21.15.3:0/819120216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f69221e0 0x55a3f692c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:49.130 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.125+0000 7f55b7e00640 1 --2- 172.21.15.3:0/819120216 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f692d3a0 0x55a3f69452b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f55b000f830 tx=0x7f55b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf2d6cecc216894 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:49.131 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.125+0000 7f55a7e00640 1 -- 172.21.15.3:0/819120216 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b001d410 con 0x55a3f692d3a0 2024-09-19T06:16:49.131 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.125+0000 7f55a7e00640 1 -- 172.21.15.3:0/819120216 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55b002d070 con 0x55a3f692d3a0 2024-09-19T06:16:49.131 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.125+0000 7f55a7e00640 1 -- 172.21.15.3:0/819120216 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b0028950 con 0x55a3f692d3a0 2024-09-19T06:16:49.131 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.126+0000 7f55c1803740 1 -- 172.21.15.3:0/819120216 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f692d3a0 msgr2=0x55a3f69452b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:49.131 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.126+0000 7f55c1803740 1 --2- 172.21.15.3:0/819120216 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f692d3a0 0x55a3f69452b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f55b000f830 tx=0x7f55b0017000 comp rx=0 tx=0).stop 2024-09-19T06:16:49.131 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.126+0000 7f55c1803740 1 -- 172.21.15.3:0/819120216 shutdown_connections 2024-09-19T06:16:49.131 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.126+0000 7f55c1803740 1 --2- 172.21.15.3:0/819120216 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f692d3a0 0x55a3f69452b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.131 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.126+0000 7f55c1803740 1 --2- 172.21.15.3:0/819120216 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a3f6922b00 0x55a3f6944d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.131 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.126+0000 7f55c1803740 1 --2- 172.21.15.3:0/819120216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f69221e0 0x55a3f692c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.131 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.126+0000 7f55c1803740 1 -- 172.21.15.3:0/819120216 >> 172.21.15.3:0/819120216 conn(0x55a3f691e750 msgr2=0x55a3f692ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:49.131 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.126+0000 7f55c1803740 1 -- 172.21.15.3:0/819120216 shutdown_connections 2024-09-19T06:16:49.131 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.126+0000 7f55c1803740 1 -- 172.21.15.3:0/819120216 wait complete. 2024-09-19T06:16:49.131 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.126+0000 7f55c1803740 1 -- start start 2024-09-19T06:16:49.132 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.126+0000 7f55c1803740 1 Processor -- start 2024-09-19T06:16:49.132 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.127+0000 7f55c1803740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f69221e0 0x55a3f6935740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.132 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.127+0000 7f55c1803740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a3f6922b00 0x55a3f6926d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.132 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.127+0000 7f55c1803740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f692d3a0 0x55a3f69272a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.132 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.127+0000 7f55c1803740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f55b81b0ec0 con 0x55a3f692d3a0 2024-09-19T06:16:49.132 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.127+0000 7f55c1803740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f55b81b07f0 con 0x55a3f69221e0 2024-09-19T06:16:49.132 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.127+0000 7f55c1803740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f55b81ada30 con 0x55a3f6922b00 2024-09-19T06:16:49.132 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.127+0000 7f55c1803740 10 client.0 _ll_register_callbacks cb 0x7f55a800ef90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:49.132 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.127+0000 7f55b7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f692d3a0 0x55a3f69272a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.132 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.127+0000 7f55b7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f692d3a0 0x55a3f69272a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42788/0 (socket says 172.21.15.3:42788) 2024-09-19T06:16:49.132 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.127+0000 7f55b7e00640 1 -- 172.21.15.3:0/3087883827 learned_addr learned my addr 172.21.15.3:0/3087883827 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:49.132 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.127+0000 7f55afe00640 1 --2- 172.21.15.3:0/3087883827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a3f6922b00 0x55a3f6926d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.132 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.127+0000 7f55b7400640 1 --2- 172.21.15.3:0/3087883827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f69221e0 0x55a3f6935740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.128+0000 7f55b7e00640 1 -- 172.21.15.3:0/3087883827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a3f6922b00 msgr2=0x55a3f6926d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:49.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.128+0000 7f55b7e00640 1 --2- 172.21.15.3:0/3087883827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a3f6922b00 0x55a3f6926d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.128+0000 7f55b7e00640 1 -- 172.21.15.3:0/3087883827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f69221e0 msgr2=0x55a3f6935740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:49.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.128+0000 7f55b7e00640 1 --2- 172.21.15.3:0/3087883827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f69221e0 0x55a3f6935740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.128+0000 7f55b7e00640 1 -- 172.21.15.3:0/3087883827 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3f69277e0 con 0x55a3f692d3a0 2024-09-19T06:16:49.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.128+0000 7f55afe00640 1 --2- 172.21.15.3:0/3087883827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a3f6922b00 0x55a3f6926d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:49.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.128+0000 7f55b7e00640 1 --2- 172.21.15.3:0/3087883827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f692d3a0 0x55a3f69272a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f55b0019040 tx=0x7f55b0004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b884037ce44c78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:49.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.128+0000 7f55a5600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:16:49.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.128+0000 7f55a5600640 1 -- 172.21.15.3:0/3087883827 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b0035070 con 0x55a3f692d3a0 2024-09-19T06:16:49.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.128+0000 7f55a5600640 1 -- 172.21.15.3:0/3087883827 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f55b00289e0 con 0x55a3f692d3a0 2024-09-19T06:16:49.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.128+0000 7f55c1803740 1 -- 172.21.15.3:0/3087883827 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55b002d070 con 0x55a3f692d3a0 2024-09-19T06:16:49.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.128+0000 7f55a5600640 1 -- 172.21.15.3:0/3087883827 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f55b0041050 con 0x55a3f692d3a0 2024-09-19T06:16:49.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.128+0000 7f55c1803740 10 client.16401 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:49.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.128+0000 7f55c1803740 1 -- 172.21.15.3:0/3087883827 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a3f69a7a20 con 0x55a3f692d3a0 2024-09-19T06:16:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.129+0000 7f55a5600640 1 -- 172.21.15.3:0/3087883827 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55b002d070 con 0x55a3f692d3a0 2024-09-19T06:16:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.129+0000 7f55a5600640 1 -- 172.21.15.3:0/3087883827 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f55b001db20 con 0x55a3f692d3a0 2024-09-19T06:16:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.129+0000 7f55c1803740 10 client.16401 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.129+0000 7f55c1803740 10 client.16401 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.129+0000 7f55c1803740 20 client.16401 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.129+0000 7f55c1803740 1 --2- 172.21.15.3:0/3087883827 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a3f69a8110 0x55a3f69aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.129+0000 7f55c1803740 4 client.16401 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:16:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.129+0000 7f55c1803740 1 -- 172.21.15.3:0/3087883827 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a3f688fb80 con 0x55a3f69a8110 2024-09-19T06:16:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.129+0000 7f55b7400640 1 --2- 172.21.15.3:0/3087883827 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a3f69a8110 0x55a3f69aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.130+0000 7f55b7400640 1 --2- 172.21.15.3:0/3087883827 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a3f69a8110 0x55a3f69aa530 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c66b654c5009f8b server_cookie=75b5f9dc25778e94 in_seq=0 out_seq=0 2024-09-19T06:16:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.130+0000 7f55a5600640 10 client.16401 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.143+0000 7f55a5600640 1 -- 172.21.15.3:0/3087883827 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a3f688fb80 con 0x55a3f69a8110 2024-09-19T06:16:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.143+0000 7f55a5600640 10 client.16401 handle_command_reply: tid=0 2024-09-19T06:16:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.143+0000 7f55c1803740 1 client.16401 shutdown 2024-09-19T06:16:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.143+0000 7f55c1803740 1 -- 172.21.15.3:0/3087883827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f692d3a0 msgr2=0x55a3f69272a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.143+0000 7f55c1803740 1 --2- 172.21.15.3:0/3087883827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f692d3a0 0x55a3f69272a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f55b0019040 tx=0x7f55b0004e20 comp rx=0 tx=0).stop 2024-09-19T06:16:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.144+0000 7f55c1803740 1 -- 172.21.15.3:0/3087883827 shutdown_connections 2024-09-19T06:16:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.144+0000 7f55c1803740 1 --2- 172.21.15.3:0/3087883827 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a3f69a8110 0x55a3f69aa530 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.144+0000 7f55c1803740 1 --2- 172.21.15.3:0/3087883827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a3f692d3a0 0x55a3f69272a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.144+0000 7f55c1803740 1 --2- 172.21.15.3:0/3087883827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a3f6922b00 0x55a3f6926d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.144+0000 7f55a5600640 0 client.16401 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.144+0000 7f55c1803740 1 --2- 172.21.15.3:0/3087883827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3f69221e0 0x55a3f6935740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.150 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.144+0000 7f55c1803740 1 -- 172.21.15.3:0/3087883827 >> 172.21.15.3:0/3087883827 conn(0x55a3f691e750 msgr2=0x55a3f69389e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:49.151 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.144+0000 7f55c1803740 1 -- 172.21.15.3:0/3087883827 shutdown_connections 2024-09-19T06:16:49.151 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.144+0000 7f55c1803740 1 -- 172.21.15.3:0/3087883827 wait complete. 2024-09-19T06:16:49.151 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.144+0000 7f55c1803740 20 client.16401 trim_cache size 0 max 16384 2024-09-19T06:16:49.151 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:16:49.151 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:16:49.151 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:16:49.151 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:16:49.152 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.144+0000 7f55be800640 1 -- 172.21.15.3:0/1599302019 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f559c0a33b0 msgr2=0x7f559c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:49.152 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.144+0000 7f55be800640 1 --2- 172.21.15.3:0/1599302019 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f559c0a33b0 0x7f559c0a5870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f55b0005fd0 tx=0x7f55b0009500 comp rx=0 tx=0).stop 2024-09-19T06:16:49.152 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.144+0000 7f55be800640 1 -- 172.21.15.3:0/1599302019 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55b8103f30 msgr2=0x7f55b819a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:49.152 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.144+0000 7f55be800640 1 --2- 172.21.15.3:0/1599302019 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55b8103f30 0x7f55b819a640 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f55a800ea60 tx=0x7f55a800ee60 comp rx=0 tx=0).stop 2024-09-19T06:16:49.152 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.145+0000 7f55be800640 1 -- 172.21.15.3:0/1599302019 shutdown_connections 2024-09-19T06:16:49.152 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.145+0000 7f55be800640 1 --2- 172.21.15.3:0/1599302019 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f559c0a33b0 0x7f559c0a5870 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.152 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.145+0000 7f55be800640 1 --2- 172.21.15.3:0/1599302019 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f55b819ef00 0x7f55b819f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.152 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.145+0000 7f55be800640 1 --2- 172.21.15.3:0/1599302019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b8109080 0x7f55b819ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.153 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.145+0000 7f55be800640 1 --2- 172.21.15.3:0/1599302019 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f55b8103f30 0x7f55b819a640 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:49.153 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.145+0000 7f55be800640 1 -- 172.21.15.3:0/1599302019 >> 172.21.15.3:0/1599302019 conn(0x7f55b80ff980 msgr2=0x7f55b8100c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:49.153 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.145+0000 7f55be800640 1 -- 172.21.15.3:0/1599302019 shutdown_connections 2024-09-19T06:16:49.153 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:16:49.145+0000 7f55be800640 1 -- 172.21.15.3:0/1599302019 wait complete. 2024-09-19T06:16:50.343 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:16:50.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:50 smithi059 ceph-mon[35138]: pgmap v136: 97 pgs: 97 active+clean; 1.8 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:16:50.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:50 smithi003 ceph-mon[30893]: pgmap v136: 97 pgs: 97 active+clean; 1.8 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:16:50.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:50 smithi071 ceph-mon[35662]: pgmap v136: 97 pgs: 97 active+clean; 1.8 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:16:50.732 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:51.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.310+0000 7f6abbc00640 1 -- 172.21.15.3:0/2003133823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ab4106f10 msgr2=0x7f6ab410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:51.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.310+0000 7f6abbc00640 1 --2- 172.21.15.3:0/2003133823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ab4106f10 0x7f6ab410ea90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f6aac009ca0 tx=0x7f6aac02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.311+0000 7f6abbc00640 1 -- 172.21.15.3:0/2003133823 shutdown_connections 2024-09-19T06:16:51.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.311+0000 7f6abbc00640 1 --2- 172.21.15.3:0/2003133823 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ab4106f10 0x7f6ab410ea90 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.311+0000 7f6abbc00640 1 --2- 172.21.15.3:0/2003133823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ab4102790 0x7f6ab41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.311+0000 7f6abbc00640 1 --2- 172.21.15.3:0/2003133823 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ab4101de0 0x7f6ab41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.311+0000 7f6abbc00640 1 -- 172.21.15.3:0/2003133823 >> 172.21.15.3:0/2003133823 conn(0x7f6ab40fd8c0 msgr2=0x7f6ab40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:51.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.311+0000 7f6abbc00640 1 -- 172.21.15.3:0/2003133823 shutdown_connections 2024-09-19T06:16:51.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.311+0000 7f6abbc00640 1 -- 172.21.15.3:0/2003133823 wait complete. 2024-09-19T06:16:51.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.312+0000 7f6abbc00640 1 Processor -- start 2024-09-19T06:16:51.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.312+0000 7f6abbc00640 1 -- start start 2024-09-19T06:16:51.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.312+0000 7f6abbc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ab4101de0 0x7f6ab419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:51.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.312+0000 7f6abbc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ab4102790 0x7f6ab419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:51.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.312+0000 7f6abbc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ab4106f10 0x7f6ab419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:51.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.312+0000 7f6abbc00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab4111f70 con 0x7f6ab4106f10 2024-09-19T06:16:51.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.312+0000 7f6abbc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab4111df0 con 0x7f6ab4102790 2024-09-19T06:16:51.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.312+0000 7f6abbc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab41120f0 con 0x7f6ab4101de0 2024-09-19T06:16:51.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.313+0000 7f6aabe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ab4102790 0x7f6ab419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:51.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.313+0000 7f6aabe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ab4102790 0x7f6ab419ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:34600/0 (socket says 172.21.15.3:34600) 2024-09-19T06:16:51.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.313+0000 7f6aabe00640 1 -- 172.21.15.3:0/941556494 learned_addr learned my addr 172.21.15.3:0/941556494 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:51.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.313+0000 7f6ab9c00640 1 --2- 172.21.15.3:0/941556494 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ab4106f10 0x7f6ab419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:51.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.313+0000 7f6ab9200640 1 --2- 172.21.15.3:0/941556494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ab4101de0 0x7f6ab419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:51.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.313+0000 7f6ab9c00640 1 -- 172.21.15.3:0/941556494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ab4101de0 msgr2=0x7f6ab419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:51.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.313+0000 7f6ab9c00640 1 --2- 172.21.15.3:0/941556494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ab4101de0 0x7f6ab419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.313+0000 7f6ab9c00640 1 -- 172.21.15.3:0/941556494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ab4102790 msgr2=0x7f6ab419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:51.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.313+0000 7f6ab9c00640 1 --2- 172.21.15.3:0/941556494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ab4102790 0x7f6ab419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.313+0000 7f6ab9c00640 1 -- 172.21.15.3:0/941556494 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab419f5d0 con 0x7f6ab4106f10 2024-09-19T06:16:51.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.313+0000 7f6aabe00640 1 --2- 172.21.15.3:0/941556494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ab4102790 0x7f6ab419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:51.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.313+0000 7f6ab9200640 1 --2- 172.21.15.3:0/941556494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ab4101de0 0x7f6ab419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:51.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.314+0000 7f6ab9c00640 1 --2- 172.21.15.3:0/941556494 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ab4106f10 0x7f6ab419eef0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6aac02ade0 tx=0x7f6aac0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:51.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.314+0000 7f6ab2000640 1 -- 172.21.15.3:0/941556494 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac003b70 con 0x7f6ab4106f10 2024-09-19T06:16:51.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.314+0000 7f6ab2000640 1 -- 172.21.15.3:0/941556494 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6aac003d10 con 0x7f6ab4106f10 2024-09-19T06:16:51.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.314+0000 7f6abbc00640 1 -- 172.21.15.3:0/941556494 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab419f860 con 0x7f6ab4106f10 2024-09-19T06:16:51.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.314+0000 7f6ab2000640 1 -- 172.21.15.3:0/941556494 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac02fcb0 con 0x7f6ab4106f10 2024-09-19T06:16:51.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.314+0000 7f6abbc00640 1 -- 172.21.15.3:0/941556494 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab41a71a0 con 0x7f6ab4106f10 2024-09-19T06:16:51.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.318+0000 7f6abe7cb740 1 Processor -- start 2024-09-19T06:16:51.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.319+0000 7f6ab2000640 1 -- 172.21.15.3:0/941556494 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f6aac004050 con 0x7f6ab4106f10 2024-09-19T06:16:51.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.319+0000 7f6abe7cb740 1 -- start start 2024-09-19T06:16:51.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.319+0000 7f6abe7cb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56100fe48c70 0x56100fe49050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:51.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.319+0000 7f6abe7cb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe49590 0x56100fe53910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:51.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.319+0000 7f6abe7cb740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56100fe53e50 0x56100fe56240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:51.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.319+0000 7f6abe7cb740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56100fdaf3e0 con 0x56100fe53e50 2024-09-19T06:16:51.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.319+0000 7f6abe7cb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56100fd56d80 con 0x56100fe49590 2024-09-19T06:16:51.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.319+0000 7f6abe7cb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56100fdab3a0 con 0x56100fe48c70 2024-09-19T06:16:51.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.319+0000 7f6ab9200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe49590 0x56100fe53910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:51.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.320+0000 7f6ab9200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe49590 0x56100fe53910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:34606/0 (socket says 172.21.15.3:34606) 2024-09-19T06:16:51.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.320+0000 7f6ab9200640 1 -- 172.21.15.3:0/4280623677 learned_addr learned my addr 172.21.15.3:0/4280623677 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:51.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.320+0000 7f6aabe00640 1 --2- 172.21.15.3:0/4280623677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56100fe48c70 0x56100fe49050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:51.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.320+0000 7f6aabe00640 1 --2- 172.21.15.3:0/4280623677 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56100fe53e50 0x56100fe56240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:51.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.320+0000 7f6ab9200640 1 -- 172.21.15.3:0/4280623677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56100fe48c70 msgr2=0x56100fe49050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:51.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.320+0000 7f6ab9200640 1 --2- 172.21.15.3:0/4280623677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56100fe48c70 0x56100fe49050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.320+0000 7f6ab9200640 1 -- 172.21.15.3:0/4280623677 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56100fe53e50 msgr2=0x56100fe56240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:51.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.320+0000 7f6ab9200640 1 --2- 172.21.15.3:0/4280623677 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56100fe53e50 0x56100fe56240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.320+0000 7f6ab9200640 1 -- 172.21.15.3:0/4280623677 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56100fd75ae0 con 0x56100fe49590 2024-09-19T06:16:51.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.320+0000 7f6ab2000640 1 --2- 172.21.15.3:0/941556494 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6a980a33b0 0x7f6a980a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:51.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.320+0000 7f6ab9200640 1 --2- 172.21.15.3:0/4280623677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe49590 0x56100fe53910 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40104d0 tx=0x7f6aa4010990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=419e7bf5913fbf5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:51.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.320+0000 7f6ab2000640 1 -- 172.21.15.3:0/941556494 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f6aac0f0e60 con 0x7f6ab4106f10 2024-09-19T06:16:51.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.321+0000 7f6aabe00640 1 --2- 172.21.15.3:0/941556494 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6a980a33b0 0x7f6a980a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:51.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.321+0000 7f6aaa000640 1 -- 172.21.15.3:0/4280623677 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4004220 con 0x56100fe49590 2024-09-19T06:16:51.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.321+0000 7f6aaa000640 1 -- 172.21.15.3:0/4280623677 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6aa40043c0 con 0x56100fe49590 2024-09-19T06:16:51.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.321+0000 7f6aaa000640 1 -- 172.21.15.3:0/4280623677 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4011a70 con 0x56100fe49590 2024-09-19T06:16:51.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.321+0000 7f6abe7cb740 1 -- 172.21.15.3:0/4280623677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe49590 msgr2=0x56100fe53910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:51.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.321+0000 7f6abe7cb740 1 --2- 172.21.15.3:0/4280623677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe49590 0x56100fe53910 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40104d0 tx=0x7f6aa4010990 comp rx=0 tx=0).stop 2024-09-19T06:16:51.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.321+0000 7f6aabe00640 1 --2- 172.21.15.3:0/941556494 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6a980a33b0 0x7f6a980a5870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x56100fe46580 tx=0x7f6a9c0046c0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:51.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.322+0000 7f6abe7cb740 1 -- 172.21.15.3:0/4280623677 shutdown_connections 2024-09-19T06:16:51.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.322+0000 7f6abe7cb740 1 --2- 172.21.15.3:0/4280623677 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56100fe53e50 0x56100fe56240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.322+0000 7f6abe7cb740 1 --2- 172.21.15.3:0/4280623677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe49590 0x56100fe53910 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.322+0000 7f6abe7cb740 1 --2- 172.21.15.3:0/4280623677 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56100fe48c70 0x56100fe49050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.322+0000 7f6abe7cb740 1 -- 172.21.15.3:0/4280623677 >> 172.21.15.3:0/4280623677 conn(0x56100fe45200 msgr2=0x56100fe455e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:51.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.322+0000 7f6abe7cb740 1 -- 172.21.15.3:0/4280623677 shutdown_connections 2024-09-19T06:16:51.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.322+0000 7f6abe7cb740 1 -- 172.21.15.3:0/4280623677 wait complete. 2024-09-19T06:16:51.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.322+0000 7f6abe7cb740 1 -- start start 2024-09-19T06:16:51.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.322+0000 7f6abe7cb740 1 Processor -- start 2024-09-19T06:16:51.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.323+0000 7f6abe7cb740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56100fe48c70 0x56100fe50cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:51.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.323+0000 7f6abe7cb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56100fe49590 0x56100fe511f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:51.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.323+0000 7f6abe7cb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe53e50 0x56100fe51730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:51.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.323+0000 7f6abe7cb740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56100fe56a20 con 0x56100fe48c70 2024-09-19T06:16:51.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.323+0000 7f6abe7cb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56100fd6a0f0 con 0x56100fe53e50 2024-09-19T06:16:51.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.323+0000 7f6abe7cb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56100fe56ba0 con 0x56100fe49590 2024-09-19T06:16:51.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.323+0000 7f6abe7cb740 10 client.0 _ll_register_callbacks cb 0x56100fd51bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:51.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.323+0000 7f6ab9c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe53e50 0x56100fe51730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:51.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.323+0000 7f6ab9c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe53e50 0x56100fe51730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:34620/0 (socket says 172.21.15.3:34620) 2024-09-19T06:16:51.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.323+0000 7f6ab9c00640 1 -- 172.21.15.3:0/2885389741 learned_addr learned my addr 172.21.15.3:0/2885389741 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:51.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.323+0000 7f6ab9200640 1 --2- 172.21.15.3:0/2885389741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56100fe48c70 0x56100fe50cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:51.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.323+0000 7f6aabe00640 1 --2- 172.21.15.3:0/2885389741 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56100fe49590 0x56100fe511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:51.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.324+0000 7f6ab9c00640 1 -- 172.21.15.3:0/2885389741 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56100fe49590 msgr2=0x56100fe511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:51.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.324+0000 7f6ab9c00640 1 --2- 172.21.15.3:0/2885389741 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56100fe49590 0x56100fe511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.324+0000 7f6ab9c00640 1 -- 172.21.15.3:0/2885389741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56100fe48c70 msgr2=0x56100fe50cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:51.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.324+0000 7f6ab9c00640 1 --2- 172.21.15.3:0/2885389741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56100fe48c70 0x56100fe50cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.324+0000 7f6ab9c00640 1 -- 172.21.15.3:0/2885389741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56100fb203c0 con 0x56100fe53e50 2024-09-19T06:16:51.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.324+0000 7f6ab9c00640 1 --2- 172.21.15.3:0/2885389741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe53e50 0x56100fe51730 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0c5930 tx=0x7f6aac0bd080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5bea107f5845b84 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:51.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.324+0000 7f6aa2a00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:16:51.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.324+0000 7f6aa2a00640 1 -- 172.21.15.3:0/2885389741 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac0bd1f0 con 0x56100fe53e50 2024-09-19T06:16:51.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.324+0000 7f6aa2a00640 1 -- 172.21.15.3:0/2885389741 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f6aac0ee7d0 con 0x56100fe53e50 2024-09-19T06:16:51.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.324+0000 7f6abe7cb740 1 -- 172.21.15.3:0/2885389741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6aa40043c0 con 0x56100fe53e50 2024-09-19T06:16:51.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.324+0000 7f6aa2a00640 1 -- 172.21.15.3:0/2885389741 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6aac0c15a0 con 0x56100fe53e50 2024-09-19T06:16:51.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.324+0000 7f6abe7cb740 10 client.26456 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:51.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.324+0000 7f6abe7cb740 1 -- 172.21.15.3:0/2885389741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56100fe56a20 con 0x56100fe53e50 2024-09-19T06:16:51.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.325+0000 7f6aa2a00640 1 -- 172.21.15.3:0/2885389741 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6aa40043c0 con 0x56100fe53e50 2024-09-19T06:16:51.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.325+0000 7f6aa2a00640 1 -- 172.21.15.3:0/2885389741 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6aac0c1160 con 0x56100fe53e50 2024-09-19T06:16:51.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.325+0000 7f6abe7cb740 10 client.26456 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:51.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.325+0000 7f6abe7cb740 10 client.26456 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:16:51.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.325+0000 7f6abe7cb740 20 client.26456 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:51.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.325+0000 7f6abe7cb740 1 --2- 172.21.15.3:0/2885389741 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x56100fe63e00 0x56100fe66270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:51.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.325+0000 7f6abe7cb740 4 client.26456 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:51.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.325+0000 7f6abe7cb740 1 -- 172.21.15.3:0/2885389741 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56100fdbc950 con 0x56100fe63e00 2024-09-19T06:16:51.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.325+0000 7f6ab9200640 1 --2- 172.21.15.3:0/2885389741 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x56100fe63e00 0x56100fe66270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:51.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.326+0000 7f6ab9200640 1 --2- 172.21.15.3:0/2885389741 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x56100fe63e00 0x56100fe66270 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=238c1903774cad46 server_cookie=401981c794cd380 in_seq=0 out_seq=0 2024-09-19T06:16:51.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.326+0000 7f6aa2a00640 10 client.26456 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:16:51.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.327+0000 7f6aa2a00640 1 -- 172.21.15.3:0/2885389741 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56100fdbc950 con 0x56100fe63e00 2024-09-19T06:16:51.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.327+0000 7f6aa2a00640 10 client.26456 handle_command_reply: tid=0 2024-09-19T06:16:51.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.327+0000 7f6abe7cb740 1 client.26456 shutdown 2024-09-19T06:16:51.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.327+0000 7f6abe7cb740 1 -- 172.21.15.3:0/2885389741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe53e50 msgr2=0x56100fe51730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:51.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.327+0000 7f6abe7cb740 1 --2- 172.21.15.3:0/2885389741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe53e50 0x56100fe51730 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0c5930 tx=0x7f6aac0bd080 comp rx=0 tx=0).stop 2024-09-19T06:16:51.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.327+0000 7f6abe7cb740 1 -- 172.21.15.3:0/2885389741 shutdown_connections 2024-09-19T06:16:51.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.327+0000 7f6abe7cb740 1 --2- 172.21.15.3:0/2885389741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe53e50 0x56100fe51730 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.327+0000 7f6abe7cb740 1 --2- 172.21.15.3:0/2885389741 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56100fe49590 0x56100fe511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.327+0000 7f6abe7cb740 1 --2- 172.21.15.3:0/2885389741 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x56100fe63e00 0x56100fe66270 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.327+0000 7f6abe7cb740 1 --2- 172.21.15.3:0/2885389741 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56100fe48c70 0x56100fe50cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.327+0000 7f6abe7cb740 1 -- 172.21.15.3:0/2885389741 >> 172.21.15.3:0/2885389741 conn(0x56100fe45200 msgr2=0x56100fe44380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:51.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.327+0000 7f6aa2a00640 0 client.26456 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:16:51.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.327+0000 7f6abe7cb740 1 -- 172.21.15.3:0/2885389741 shutdown_connections 2024-09-19T06:16:51.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.327+0000 7f6abe7cb740 1 -- 172.21.15.3:0/2885389741 wait complete. 2024-09-19T06:16:51.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.327+0000 7f6abe7cb740 20 client.26456 trim_cache size 0 max 16384 2024-09-19T06:16:51.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.341+0000 7f6abe7cb740 1 Processor -- start 2024-09-19T06:16:51.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.341+0000 7f6abe7cb740 1 -- start start 2024-09-19T06:16:51.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.342+0000 7f6abe7cb740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56100fe48c70 0x56100fe4add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:51.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.342+0000 7f6abe7cb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe49590 0x56100fe6bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:51.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.342+0000 7f6abe7cb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56100fe53e50 0x56100fe6c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:51.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.342+0000 7f6abe7cb740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab41af9d0 con 0x56100fe48c70 2024-09-19T06:16:51.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.342+0000 7f6abe7cb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab41b1510 con 0x56100fe49590 2024-09-19T06:16:51.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.342+0000 7f6abe7cb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab41b00a0 con 0x56100fe53e50 2024-09-19T06:16:51.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.342+0000 7f6ab9200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56100fe48c70 0x56100fe4add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:51.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.342+0000 7f6ab9200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56100fe48c70 0x56100fe4add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42834/0 (socket says 172.21.15.3:42834) 2024-09-19T06:16:51.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.342+0000 7f6ab9200640 1 -- 172.21.15.3:0/1898648688 learned_addr learned my addr 172.21.15.3:0/1898648688 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:51.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.342+0000 7f6aabe00640 1 --2- 172.21.15.3:0/1898648688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe49590 0x56100fe6bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:51.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.342+0000 7f6ab9c00640 1 --2- 172.21.15.3:0/1898648688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56100fe53e50 0x56100fe6c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:51.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.342+0000 7f6ab9200640 1 -- 172.21.15.3:0/1898648688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56100fe53e50 msgr2=0x56100fe6c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:51.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.342+0000 7f6ab9200640 1 --2- 172.21.15.3:0/1898648688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56100fe53e50 0x56100fe6c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.342+0000 7f6ab9200640 1 -- 172.21.15.3:0/1898648688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe49590 msgr2=0x56100fe6bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:51.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.342+0000 7f6ab9200640 1 --2- 172.21.15.3:0/1898648688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe49590 0x56100fe6bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.342+0000 7f6ab9200640 1 -- 172.21.15.3:0/1898648688 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56100fe40770 con 0x56100fe48c70 2024-09-19T06:16:51.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.343+0000 7f6ab9200640 1 --2- 172.21.15.3:0/1898648688 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56100fe48c70 0x56100fe4add0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40104d0 tx=0x7f6aa4003d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea4ed4ee11cb8fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:51.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.343+0000 7f6aa9600640 1 -- 172.21.15.3:0/1898648688 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa40035f0 con 0x56100fe48c70 2024-09-19T06:16:51.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.343+0000 7f6aa9600640 1 -- 172.21.15.3:0/1898648688 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6aa4005040 con 0x56100fe48c70 2024-09-19T06:16:51.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.343+0000 7f6aa9600640 1 -- 172.21.15.3:0/1898648688 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4004880 con 0x56100fe48c70 2024-09-19T06:16:51.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.344+0000 7f6abe7cb740 1 -- 172.21.15.3:0/1898648688 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56100fe48c70 msgr2=0x56100fe4add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:51.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.344+0000 7f6abe7cb740 1 --2- 172.21.15.3:0/1898648688 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56100fe48c70 0x56100fe4add0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40104d0 tx=0x7f6aa4003d30 comp rx=0 tx=0).stop 2024-09-19T06:16:51.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.344+0000 7f6abe7cb740 1 -- 172.21.15.3:0/1898648688 shutdown_connections 2024-09-19T06:16:51.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.344+0000 7f6abe7cb740 1 --2- 172.21.15.3:0/1898648688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56100fe53e50 0x56100fe6c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.344+0000 7f6abe7cb740 1 --2- 172.21.15.3:0/1898648688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe49590 0x56100fe6bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.344+0000 7f6abe7cb740 1 --2- 172.21.15.3:0/1898648688 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56100fe48c70 0x56100fe4add0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.344+0000 7f6abe7cb740 1 -- 172.21.15.3:0/1898648688 >> 172.21.15.3:0/1898648688 conn(0x56100fe45200 msgr2=0x56100fe4a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:51.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.344+0000 7f6abe7cb740 1 -- 172.21.15.3:0/1898648688 shutdown_connections 2024-09-19T06:16:51.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.344+0000 7f6abe7cb740 1 -- 172.21.15.3:0/1898648688 wait complete. 2024-09-19T06:16:51.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.344+0000 7f6abe7cb740 1 -- start start 2024-09-19T06:16:51.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.345+0000 7f6abe7cb740 1 Processor -- start 2024-09-19T06:16:51.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.345+0000 7f6abe7cb740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56100fe48c70 0x56100fe57fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:51.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.345+0000 7f6abe7cb740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56100fe49590 0x56100fe58520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:51.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.345+0000 7f6abe7cb740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe53e50 0x56100fecdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:51.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.345+0000 7f6abe7cb740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab41b0e40 con 0x56100fe49590 2024-09-19T06:16:51.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.345+0000 7f6abe7cb740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab41b0770 con 0x56100fe53e50 2024-09-19T06:16:51.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.345+0000 7f6abe7cb740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab41ad9b0 con 0x56100fe48c70 2024-09-19T06:16:51.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.345+0000 7f6abe7cb740 10 client.0 _ll_register_callbacks cb 0x7f6aac005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:51.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.345+0000 7f6ab9c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe53e50 0x56100fecdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:51.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.345+0000 7f6aabe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56100fe49590 0x56100fe58520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:51.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.345+0000 7f6ab9c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe53e50 0x56100fecdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:34646/0 (socket says 172.21.15.3:34646) 2024-09-19T06:16:51.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.345+0000 7f6ab9200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56100fe48c70 0x56100fe57fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:51.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.345+0000 7f6ab9c00640 1 -- 172.21.15.3:0/2261177035 learned_addr learned my addr 172.21.15.3:0/2261177035 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:51.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.346+0000 7f6ab9c00640 1 -- 172.21.15.3:0/2261177035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56100fe48c70 msgr2=0x56100fe57fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:51.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.346+0000 7f6ab9c00640 1 --2- 172.21.15.3:0/2261177035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56100fe48c70 0x56100fe57fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.346+0000 7f6ab9c00640 1 -- 172.21.15.3:0/2261177035 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56100fe49590 msgr2=0x56100fe58520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:51.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.346+0000 7f6ab9c00640 1 --2- 172.21.15.3:0/2261177035 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56100fe49590 0x56100fe58520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.346+0000 7f6ab9c00640 1 -- 172.21.15.3:0/2261177035 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56100fece090 con 0x56100fe53e50 2024-09-19T06:16:51.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.346+0000 7f6ab9c00640 1 --2- 172.21.15.3:0/2261177035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe53e50 0x56100fecdb50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6aac006010 tx=0x7f6aac0dd0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca49cd563d6e4d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:51.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.346+0000 7f6aa2a00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:16:51.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.346+0000 7f6aa2a00640 1 -- 172.21.15.3:0/2261177035 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac0b9490 con 0x56100fe53e50 2024-09-19T06:16:51.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.346+0000 7f6aa2a00640 1 -- 172.21.15.3:0/2261177035 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f6aac004390 con 0x56100fe53e50 2024-09-19T06:16:51.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.346+0000 7f6abe7cb740 1 -- 172.21.15.3:0/2261177035 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6aa4005040 con 0x56100fe53e50 2024-09-19T06:16:51.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.347+0000 7f6aa2a00640 1 -- 172.21.15.3:0/2261177035 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6aac0bcb50 con 0x56100fe53e50 2024-09-19T06:16:51.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.347+0000 7f6abe7cb740 10 client.26462 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:51.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.347+0000 7f6abe7cb740 1 -- 172.21.15.3:0/2261177035 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56100fece090 con 0x56100fe53e50 2024-09-19T06:16:51.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.347+0000 7f6aa2a00640 1 -- 172.21.15.3:0/2261177035 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6aa4005040 con 0x56100fe53e50 2024-09-19T06:16:51.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.347+0000 7f6aa2a00640 1 -- 172.21.15.3:0/2261177035 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6aac004b40 con 0x56100fe53e50 2024-09-19T06:16:51.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.347+0000 7f6abe7cb740 10 client.26462 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:51.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.347+0000 7f6abe7cb740 10 client.26462 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:16:51.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.347+0000 7f6abe7cb740 20 client.26462 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:51.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.347+0000 7f6abe7cb740 1 --2- 172.21.15.3:0/2261177035 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x56100fecf660 0x56100fed1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:51.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.347+0000 7f6abe7cb740 4 client.26462 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:16:51.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.347+0000 7f6abe7cb740 1 -- 172.21.15.3:0/2261177035 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56100fdb6e60 con 0x56100fecf660 2024-09-19T06:16:51.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.348+0000 7f6ab9200640 1 --2- 172.21.15.3:0/2261177035 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x56100fecf660 0x56100fed1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:51.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.348+0000 7f6ab9200640 1 --2- 172.21.15.3:0/2261177035 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x56100fecf660 0x56100fed1a80 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bd0619d8c30052cf server_cookie=974f5e565a39ef41 in_seq=0 out_seq=0 2024-09-19T06:16:51.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.348+0000 7f6aa2a00640 10 client.26462 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:16:51.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.348+0000 7f6aa2a00640 1 -- 172.21.15.3:0/2261177035 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56100fdb6e60 con 0x56100fecf660 2024-09-19T06:16:51.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.348+0000 7f6aa2a00640 10 client.26462 handle_command_reply: tid=0 2024-09-19T06:16:51.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.348+0000 7f6abe7cb740 1 client.26462 shutdown 2024-09-19T06:16:51.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.348+0000 7f6abe7cb740 1 -- 172.21.15.3:0/2261177035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe53e50 msgr2=0x56100fecdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:51.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.348+0000 7f6abe7cb740 1 --2- 172.21.15.3:0/2261177035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe53e50 0x56100fecdb50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6aac006010 tx=0x7f6aac0dd0c0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.349+0000 7f6abe7cb740 1 -- 172.21.15.3:0/2261177035 shutdown_connections 2024-09-19T06:16:51.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.349+0000 7f6abe7cb740 1 --2- 172.21.15.3:0/2261177035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56100fe53e50 0x56100fecdb50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.349+0000 7f6abe7cb740 1 --2- 172.21.15.3:0/2261177035 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x56100fecf660 0x56100fed1a80 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.349+0000 7f6abe7cb740 1 --2- 172.21.15.3:0/2261177035 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56100fe49590 0x56100fe58520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.349+0000 7f6abe7cb740 1 --2- 172.21.15.3:0/2261177035 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56100fe48c70 0x56100fe57fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.349+0000 7f6aa2a00640 0 client.26462 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:16:51.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.349+0000 7f6abe7cb740 1 -- 172.21.15.3:0/2261177035 >> 172.21.15.3:0/2261177035 conn(0x56100fe45200 msgr2=0x56100fe4aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:51.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.349+0000 7f6abe7cb740 1 -- 172.21.15.3:0/2261177035 shutdown_connections 2024-09-19T06:16:51.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.349+0000 7f6abe7cb740 1 -- 172.21.15.3:0/2261177035 wait complete. 2024-09-19T06:16:51.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.349+0000 7f6abe7cb740 20 client.26462 trim_cache size 0 max 16384 2024-09-19T06:16:51.354 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:16:51.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.349+0000 7f6abbc00640 1 -- 172.21.15.3:0/941556494 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6a980a33b0 msgr2=0x7f6a980a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:51.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.349+0000 7f6abbc00640 1 --2- 172.21.15.3:0/941556494 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6a980a33b0 0x7f6a980a5870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x56100fe46580 tx=0x7f6a9c0046c0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.349+0000 7f6abbc00640 1 -- 172.21.15.3:0/941556494 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ab4106f10 msgr2=0x7f6ab419eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:51.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.349+0000 7f6abbc00640 1 --2- 172.21.15.3:0/941556494 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ab4106f10 0x7f6ab419eef0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6aac02ade0 tx=0x7f6aac0319f0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.350+0000 7f6abbc00640 1 -- 172.21.15.3:0/941556494 shutdown_connections 2024-09-19T06:16:51.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.350+0000 7f6abbc00640 1 --2- 172.21.15.3:0/941556494 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6a980a33b0 0x7f6a980a5870 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.350+0000 7f6abbc00640 1 --2- 172.21.15.3:0/941556494 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ab4106f10 0x7f6ab419eef0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.350+0000 7f6abbc00640 1 --2- 172.21.15.3:0/941556494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ab4102790 0x7f6ab419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.350+0000 7f6abbc00640 1 --2- 172.21.15.3:0/941556494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6ab4101de0 0x7f6ab419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:51.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.350+0000 7f6abbc00640 1 -- 172.21.15.3:0/941556494 >> 172.21.15.3:0/941556494 conn(0x7f6ab40fd8c0 msgr2=0x7f6ab40febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:51.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.350+0000 7f6abbc00640 1 -- 172.21.15.3:0/941556494 shutdown_connections 2024-09-19T06:16:51.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:51.350+0000 7f6abbc00640 1 -- 172.21.15.3:0/941556494 wait complete. 2024-09-19T06:16:52.344 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:16:52.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:52 smithi059 ceph-mon[35138]: pgmap v137: 97 pgs: 97 active+clean; 1.8 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-19T06:16:52.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:52 smithi003 ceph-mon[30893]: pgmap v137: 97 pgs: 97 active+clean; 1.8 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-19T06:16:52.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:52 smithi071 ceph-mon[35662]: pgmap v137: 97 pgs: 97 active+clean; 1.8 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-19T06:16:52.726 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:53.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.334+0000 7f8e08400640 1 -- 172.21.15.3:0/1840758213 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e00109140 msgr2=0x7f8e00110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:53.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.334+0000 7f8e08400640 1 --2- 172.21.15.3:0/1840758213 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e00109140 0x7f8e00110cc0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009ca0 tx=0x7f8df802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.334+0000 7f8e08400640 1 -- 172.21.15.3:0/1840758213 shutdown_connections 2024-09-19T06:16:53.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.334+0000 7f8e08400640 1 --2- 172.21.15.3:0/1840758213 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e00109140 0x7f8e00110cc0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.334+0000 7f8e08400640 1 --2- 172.21.15.3:0/1840758213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e001049c0 0x7f8e00108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.334+0000 7f8e08400640 1 --2- 172.21.15.3:0/1840758213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e00104010 0x7f8e001043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.334+0000 7f8e08400640 1 -- 172.21.15.3:0/1840758213 >> 172.21.15.3:0/1840758213 conn(0x7f8e000ffa50 msgr2=0x7f8e00101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:53.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.335+0000 7f8e08400640 1 -- 172.21.15.3:0/1840758213 shutdown_connections 2024-09-19T06:16:53.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.335+0000 7f8e08400640 1 -- 172.21.15.3:0/1840758213 wait complete. 2024-09-19T06:16:53.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.335+0000 7f8e08400640 1 Processor -- start 2024-09-19T06:16:53.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.336+0000 7f8e08400640 1 -- start start 2024-09-19T06:16:53.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.336+0000 7f8e08400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e00104010 0x7f8e0019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:53.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.336+0000 7f8e08400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e001049c0 0x7f8e0019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:53.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.336+0000 7f8e08400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e00109140 0x7f8e0019ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:53.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.336+0000 7f8e08400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8e001141a0 con 0x7f8e00109140 2024-09-19T06:16:53.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.336+0000 7f8e08400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8e00114020 con 0x7f8e00104010 2024-09-19T06:16:53.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.336+0000 7f8e08400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8e00114320 con 0x7f8e001049c0 2024-09-19T06:16:53.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.336+0000 7f8e06400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e00109140 0x7f8e0019ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:53.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.336+0000 7f8e05a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e00104010 0x7f8e0019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:53.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.336+0000 7f8e06400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e00109140 0x7f8e0019ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42866/0 (socket says 172.21.15.3:42866) 2024-09-19T06:16:53.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.336+0000 7f8e05a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e00104010 0x7f8e0019a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:34668/0 (socket says 172.21.15.3:34668) 2024-09-19T06:16:53.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.336+0000 7f8e06400640 1 -- 172.21.15.3:0/2755090036 learned_addr learned my addr 172.21.15.3:0/2755090036 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:53.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.336+0000 7f8e05000640 1 --2- 172.21.15.3:0/2755090036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e001049c0 0x7f8e0019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:53.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.337+0000 7f8e05a00640 1 -- 172.21.15.3:0/2755090036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e001049c0 msgr2=0x7f8e0019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:53.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.337+0000 7f8e05a00640 1 --2- 172.21.15.3:0/2755090036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e001049c0 0x7f8e0019abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.337+0000 7f8e05a00640 1 -- 172.21.15.3:0/2755090036 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e00109140 msgr2=0x7f8e0019ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:53.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.337+0000 7f8e05a00640 1 --2- 172.21.15.3:0/2755090036 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e00109140 0x7f8e0019ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.337+0000 7f8e05a00640 1 -- 172.21.15.3:0/2755090036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e0019f630 con 0x7f8e00104010 2024-09-19T06:16:53.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.337+0000 7f8e05a00640 1 --2- 172.21.15.3:0/2755090036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e00104010 0x7f8e0019a680 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8df400e9f0 tx=0x7f8df400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:53.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.337+0000 7f8dfe000640 1 -- 172.21.15.3:0/2755090036 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df400ccc0 con 0x7f8e00104010 2024-09-19T06:16:53.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.337+0000 7f8e08400640 1 -- 172.21.15.3:0/2755090036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e0019f920 con 0x7f8e00104010 2024-09-19T06:16:53.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.338+0000 7f8dfe000640 1 -- 172.21.15.3:0/2755090036 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8df4010910 con 0x7f8e00104010 2024-09-19T06:16:53.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.338+0000 7f8dfe000640 1 -- 172.21.15.3:0/2755090036 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df4018880 con 0x7f8e00104010 2024-09-19T06:16:53.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.338+0000 7f8e08400640 1 -- 172.21.15.3:0/2755090036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e001a7200 con 0x7f8e00104010 2024-09-19T06:16:53.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.341+0000 7f8e0adbd740 1 Processor -- start 2024-09-19T06:16:53.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.341+0000 7f8e0adbd740 1 -- start start 2024-09-19T06:16:53.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.341+0000 7f8e0adbd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6a60cc70 0x557c6a60d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:53.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.341+0000 7f8e0adbd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 0x557c6a617910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:53.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.341+0000 7f8e0adbd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6a617e50 0x557c6a61a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:53.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.341+0000 7f8e0adbd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557c6a5733e0 con 0x557c6a60d590 2024-09-19T06:16:53.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.341+0000 7f8e0adbd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557c6a51ad80 con 0x557c6a617e50 2024-09-19T06:16:53.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.341+0000 7f8e0adbd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557c6a56f3a0 con 0x557c6a60cc70 2024-09-19T06:16:53.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.341+0000 7f8dfe000640 1 -- 172.21.15.3:0/2755090036 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f8df4010ac0 con 0x7f8e00104010 2024-09-19T06:16:53.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.341+0000 7f8e06400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6a60cc70 0x557c6a60d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:53.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.341+0000 7f8e06400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6a60cc70 0x557c6a60d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:37574/0 (socket says 172.21.15.3:37574) 2024-09-19T06:16:53.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.342+0000 7f8e06400640 1 -- 172.21.15.3:0/2592072979 learned_addr learned my addr 172.21.15.3:0/2592072979 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:53.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.342+0000 7f8e05a00640 1 --2- 172.21.15.3:0/2592072979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 0x557c6a617910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:53.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.342+0000 7f8e05000640 1 --2- 172.21.15.3:0/2592072979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6a617e50 0x557c6a61a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:53.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.342+0000 7f8e06400640 1 -- 172.21.15.3:0/2592072979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6a617e50 msgr2=0x557c6a61a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:53.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.342+0000 7f8e06400640 1 --2- 172.21.15.3:0/2592072979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6a617e50 0x557c6a61a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.342+0000 7f8e06400640 1 -- 172.21.15.3:0/2592072979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 msgr2=0x557c6a617910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:53.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.342+0000 7f8e06400640 1 --2- 172.21.15.3:0/2592072979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 0x557c6a617910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.342+0000 7f8e06400640 1 -- 172.21.15.3:0/2592072979 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c6a539ae0 con 0x557c6a60cc70 2024-09-19T06:16:53.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.342+0000 7f8e05a00640 1 --2- 172.21.15.3:0/2592072979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 0x557c6a617910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:53.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.342+0000 7f8e05000640 1 --2- 172.21.15.3:0/2592072979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6a617e50 0x557c6a61a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:53.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.342+0000 7f8e06400640 1 --2- 172.21.15.3:0/2592072979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6a60cc70 0x557c6a60d050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8df8005fb0 tx=0x7f8df8009a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=900f27716594649 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:53.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.343+0000 7f8df2a00640 1 -- 172.21.15.3:0/2592072979 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df8031db0 con 0x557c6a60cc70 2024-09-19T06:16:53.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.343+0000 7f8df2a00640 1 -- 172.21.15.3:0/2592072979 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8df8036030 con 0x557c6a60cc70 2024-09-19T06:16:53.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.343+0000 7f8df2a00640 1 -- 172.21.15.3:0/2592072979 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df8004240 con 0x557c6a60cc70 2024-09-19T06:16:53.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.343+0000 7f8dfe000640 1 --2- 172.21.15.3:0/2755090036 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8de80a3430 0x7f8de80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:53.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.343+0000 7f8dfe000640 1 -- 172.21.15.3:0/2755090036 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f8df40cfff0 con 0x7f8e00104010 2024-09-19T06:16:53.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.343+0000 7f8e05a00640 1 --2- 172.21.15.3:0/2755090036 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8de80a3430 0x7f8de80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:53.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.343+0000 7f8e0adbd740 1 -- 172.21.15.3:0/2592072979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6a60cc70 msgr2=0x557c6a60d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:53.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.343+0000 7f8e0adbd740 1 --2- 172.21.15.3:0/2592072979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6a60cc70 0x557c6a60d050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8df8005fb0 tx=0x7f8df8009a10 comp rx=0 tx=0).stop 2024-09-19T06:16:53.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.344+0000 7f8e0adbd740 1 -- 172.21.15.3:0/2592072979 shutdown_connections 2024-09-19T06:16:53.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.344+0000 7f8e0adbd740 1 --2- 172.21.15.3:0/2592072979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6a617e50 0x557c6a61a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.344+0000 7f8e0adbd740 1 --2- 172.21.15.3:0/2592072979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 0x557c6a617910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.344+0000 7f8e0adbd740 1 --2- 172.21.15.3:0/2592072979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6a60cc70 0x557c6a60d050 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.344+0000 7f8e0adbd740 1 -- 172.21.15.3:0/2592072979 >> 172.21.15.3:0/2592072979 conn(0x557c6a609200 msgr2=0x557c6a6095e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:53.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.344+0000 7f8e0adbd740 1 -- 172.21.15.3:0/2592072979 shutdown_connections 2024-09-19T06:16:53.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.344+0000 7f8e0adbd740 1 -- 172.21.15.3:0/2592072979 wait complete. 2024-09-19T06:16:53.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.344+0000 7f8e05a00640 1 --2- 172.21.15.3:0/2755090036 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8de80a3430 0x7f8de80a58f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8df40cd7f0 tx=0x7f8df4000bc0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:53.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.344+0000 7f8e0adbd740 1 -- start start 2024-09-19T06:16:53.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.345+0000 7f8e0adbd740 1 Processor -- start 2024-09-19T06:16:53.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.345+0000 7f8e0adbd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6a60cc70 0x557c6a614cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:53.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.345+0000 7f8e0adbd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 0x557c6a6151f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:53.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.345+0000 7f8e0adbd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6a617e50 0x557c6a615730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.345+0000 7f8e0adbd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557c6a61a8a0 con 0x557c6a60d590 2024-09-19T06:16:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.345+0000 7f8e0adbd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557c6a52e0f0 con 0x557c6a617e50 2024-09-19T06:16:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.345+0000 7f8e0adbd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557c6a61aa20 con 0x557c6a60cc70 2024-09-19T06:16:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.345+0000 7f8e0adbd740 10 client.0 _ll_register_callbacks cb 0x557c6a515bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.345+0000 7f8e05000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 0x557c6a6151f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.345+0000 7f8e05000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 0x557c6a6151f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42882/0 (socket says 172.21.15.3:42882) 2024-09-19T06:16:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.345+0000 7f8e06400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6a60cc70 0x557c6a614cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.345+0000 7f8e05000640 1 -- 172.21.15.3:0/2016753339 learned_addr learned my addr 172.21.15.3:0/2016753339 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.345+0000 7f8e06400640 1 --2- 172.21.15.3:0/2016753339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6a617e50 0x557c6a615730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.346+0000 7f8e05000640 1 -- 172.21.15.3:0/2016753339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6a60cc70 msgr2=0x557c6a614cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.346+0000 7f8e05000640 1 --2- 172.21.15.3:0/2016753339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6a60cc70 0x557c6a614cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.346+0000 7f8e05000640 1 -- 172.21.15.3:0/2016753339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6a617e50 msgr2=0x557c6a615730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.346+0000 7f8e05000640 1 --2- 172.21.15.3:0/2016753339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6a617e50 0x557c6a615730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.346+0000 7f8e05000640 1 -- 172.21.15.3:0/2016753339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c6a2e43c0 con 0x557c6a60d590 2024-09-19T06:16:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.346+0000 7f8e05000640 1 --2- 172.21.15.3:0/2016753339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 0x557c6a6151f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8dec012730 tx=0x7f8dec012bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b29427a7716f03 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.346+0000 7f8de7400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:16:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.346+0000 7f8de7400640 1 -- 172.21.15.3:0/2016753339 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec00f940 con 0x557c6a60d590 2024-09-19T06:16:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.346+0000 7f8e0adbd740 1 -- 172.21.15.3:0/2016753339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8df8036030 con 0x557c6a60d590 2024-09-19T06:16:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.347+0000 7f8de7400640 1 -- 172.21.15.3:0/2016753339 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f8dec00fae0 con 0x557c6a60d590 2024-09-19T06:16:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.347+0000 7f8de7400640 1 -- 172.21.15.3:0/2016753339 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8dec00fce0 con 0x557c6a60d590 2024-09-19T06:16:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.347+0000 7f8e0adbd740 10 client.16431 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.347+0000 7f8e0adbd740 1 -- 172.21.15.3:0/2016753339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557c6a626910 con 0x557c6a60d590 2024-09-19T06:16:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.347+0000 7f8de7400640 1 -- 172.21.15.3:0/2016753339 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8df8036030 con 0x557c6a60d590 2024-09-19T06:16:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.347+0000 7f8de7400640 1 -- 172.21.15.3:0/2016753339 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8dec010430 con 0x557c6a60d590 2024-09-19T06:16:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.347+0000 7f8e0adbd740 10 client.16431 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.347+0000 7f8e0adbd740 10 client.16431 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:16:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.347+0000 7f8e0adbd740 20 client.16431 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.347+0000 7f8e0adbd740 1 --2- 172.21.15.3:0/2016753339 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x557c6a627de0 0x557c6a62a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.347+0000 7f8e0adbd740 4 client.16431 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.348+0000 7f8e0adbd740 1 -- 172.21.15.3:0/2016753339 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c6a580950 con 0x557c6a627de0 2024-09-19T06:16:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.348+0000 7f8e06400640 1 --2- 172.21.15.3:0/2016753339 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x557c6a627de0 0x557c6a62a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.348+0000 7f8e06400640 1 --2- 172.21.15.3:0/2016753339 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x557c6a627de0 0x557c6a62a200 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1a4fa3cd5bd7de8b server_cookie=fda19aba02e7be10 in_seq=0 out_seq=0 2024-09-19T06:16:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.348+0000 7f8de7400640 10 client.16431 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:16:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.349+0000 7f8de7400640 1 -- 172.21.15.3:0/2016753339 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557c6a580950 con 0x557c6a627de0 2024-09-19T06:16:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.349+0000 7f8de7400640 10 client.16431 handle_command_reply: tid=0 2024-09-19T06:16:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.349+0000 7f8e0adbd740 1 client.16431 shutdown 2024-09-19T06:16:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.349+0000 7f8e0adbd740 1 -- 172.21.15.3:0/2016753339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 msgr2=0x557c6a6151f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.349+0000 7f8e0adbd740 1 --2- 172.21.15.3:0/2016753339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 0x557c6a6151f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8dec012730 tx=0x7f8dec012bf0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.349+0000 7f8e0adbd740 1 -- 172.21.15.3:0/2016753339 shutdown_connections 2024-09-19T06:16:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.349+0000 7f8e0adbd740 1 --2- 172.21.15.3:0/2016753339 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x557c6a627de0 0x557c6a62a200 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.349+0000 7f8e0adbd740 1 --2- 172.21.15.3:0/2016753339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6a617e50 0x557c6a615730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.349+0000 7f8e0adbd740 1 --2- 172.21.15.3:0/2016753339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 0x557c6a6151f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.349+0000 7f8e0adbd740 1 --2- 172.21.15.3:0/2016753339 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6a60cc70 0x557c6a614cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.349+0000 7f8e0adbd740 1 -- 172.21.15.3:0/2016753339 >> 172.21.15.3:0/2016753339 conn(0x557c6a609200 msgr2=0x557c6a608380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:53.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.349+0000 7f8de7400640 0 client.16431 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:16:53.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.350+0000 7f8e0adbd740 1 -- 172.21.15.3:0/2016753339 shutdown_connections 2024-09-19T06:16:53.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.350+0000 7f8e0adbd740 1 -- 172.21.15.3:0/2016753339 wait complete. 2024-09-19T06:16:53.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.350+0000 7f8e0adbd740 20 client.16431 trim_cache size 0 max 16384 2024-09-19T06:16:53.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.364+0000 7f8e0adbd740 1 Processor -- start 2024-09-19T06:16:53.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.364+0000 7f8e0adbd740 1 -- start start 2024-09-19T06:16:53.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.364+0000 7f8e0adbd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6a60cc70 0x557c6a615580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:53.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.364+0000 7f8e0adbd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 0x557c6a62fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:53.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.364+0000 7f8e0adbd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6a617e50 0x557c6a630010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:53.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.364+0000 7f8e0adbd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8e001afae0 con 0x557c6a60d590 2024-09-19T06:16:53.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.364+0000 7f8e0adbd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8e001b1620 con 0x557c6a60cc70 2024-09-19T06:16:53.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.364+0000 7f8e0adbd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8e001b01b0 con 0x557c6a617e50 2024-09-19T06:16:53.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.364+0000 7f8e05000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 0x557c6a62fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:53.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.364+0000 7f8e05000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 0x557c6a62fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42894/0 (socket says 172.21.15.3:42894) 2024-09-19T06:16:53.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.364+0000 7f8e05000640 1 -- 172.21.15.3:0/2925070883 learned_addr learned my addr 172.21.15.3:0/2925070883 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:53.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.364+0000 7f8e06400640 1 --2- 172.21.15.3:0/2925070883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6a60cc70 0x557c6a615580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:53.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.365+0000 7f8e06400640 1 --2- 172.21.15.3:0/2925070883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6a617e50 0x557c6a630010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:53.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.365+0000 7f8e05000640 1 -- 172.21.15.3:0/2925070883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6a617e50 msgr2=0x557c6a630010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:53.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.365+0000 7f8e05000640 1 --2- 172.21.15.3:0/2925070883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6a617e50 0x557c6a630010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.365+0000 7f8e05000640 1 -- 172.21.15.3:0/2925070883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6a60cc70 msgr2=0x557c6a615580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:53.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.365+0000 7f8e05000640 1 --2- 172.21.15.3:0/2925070883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6a60cc70 0x557c6a615580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.365+0000 7f8e05000640 1 -- 172.21.15.3:0/2925070883 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c6a604770 con 0x557c6a60d590 2024-09-19T06:16:53.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.365+0000 7f8e06400640 1 --2- 172.21.15.3:0/2925070883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6a617e50 0x557c6a630010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:16:53.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.365+0000 7f8e05000640 1 --2- 172.21.15.3:0/2925070883 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 0x557c6a62fad0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8dec010a90 tx=0x7f8dec005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1379743dc797a98d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:53.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.365+0000 7f8df2000640 1 -- 172.21.15.3:0/2925070883 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec029070 con 0x557c6a60d590 2024-09-19T06:16:53.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.365+0000 7f8df2000640 1 -- 172.21.15.3:0/2925070883 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dec00fe80 con 0x557c6a60d590 2024-09-19T06:16:53.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.365+0000 7f8df2000640 1 -- 172.21.15.3:0/2925070883 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec005360 con 0x557c6a60d590 2024-09-19T06:16:53.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.366+0000 7f8e0adbd740 1 -- 172.21.15.3:0/2925070883 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 msgr2=0x557c6a62fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:53.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.366+0000 7f8e0adbd740 1 --2- 172.21.15.3:0/2925070883 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 0x557c6a62fad0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8dec010a90 tx=0x7f8dec005e70 comp rx=0 tx=0).stop 2024-09-19T06:16:53.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.366+0000 7f8e0adbd740 1 -- 172.21.15.3:0/2925070883 shutdown_connections 2024-09-19T06:16:53.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.366+0000 7f8e0adbd740 1 --2- 172.21.15.3:0/2925070883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6a617e50 0x557c6a630010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.366+0000 7f8e0adbd740 1 --2- 172.21.15.3:0/2925070883 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 0x557c6a62fad0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.366+0000 7f8e0adbd740 1 --2- 172.21.15.3:0/2925070883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6a60cc70 0x557c6a615580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.366+0000 7f8e0adbd740 1 -- 172.21.15.3:0/2925070883 >> 172.21.15.3:0/2925070883 conn(0x557c6a609200 msgr2=0x557c6a616d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:53.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.366+0000 7f8e0adbd740 1 -- 172.21.15.3:0/2925070883 shutdown_connections 2024-09-19T06:16:53.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.366+0000 7f8e0adbd740 1 -- 172.21.15.3:0/2925070883 wait complete. 2024-09-19T06:16:53.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.367+0000 7f8e0adbd740 1 -- start start 2024-09-19T06:16:53.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.367+0000 7f8e0adbd740 1 Processor -- start 2024-09-19T06:16:53.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.367+0000 7f8e0adbd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6a60cc70 0x557c6a61ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:53.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.367+0000 7f8e0adbd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 0x557c6a6204d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:53.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.367+0000 7f8e0adbd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6a617e50 0x557c6a61b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:53.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.367+0000 7f8e0adbd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8e001b0f50 con 0x557c6a60d590 2024-09-19T06:16:53.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.367+0000 7f8e0adbd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8e001b0880 con 0x557c6a60cc70 2024-09-19T06:16:53.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.367+0000 7f8e0adbd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8e001adac0 con 0x557c6a617e50 2024-09-19T06:16:53.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.367+0000 7f8e0adbd740 10 client.0 _ll_register_callbacks cb 0x7f8dec009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:53.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.368+0000 7f8e06400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6a60cc70 0x557c6a61ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:53.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.368+0000 7f8e05000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 0x557c6a6204d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:53.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.368+0000 7f8e06400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6a60cc70 0x557c6a61ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:34702/0 (socket says 172.21.15.3:34702) 2024-09-19T06:16:53.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.368+0000 7f8e06400640 1 -- 172.21.15.3:0/3181099092 learned_addr learned my addr 172.21.15.3:0/3181099092 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:53.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.368+0000 7f8e06400640 1 --2- 172.21.15.3:0/3181099092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6a617e50 0x557c6a61b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:53.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.368+0000 7f8e06400640 1 -- 172.21.15.3:0/3181099092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6a617e50 msgr2=0x557c6a61b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:53.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.368+0000 7f8e06400640 1 --2- 172.21.15.3:0/3181099092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6a617e50 0x557c6a61b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.368+0000 7f8e06400640 1 -- 172.21.15.3:0/3181099092 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 msgr2=0x557c6a6204d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:53.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.368+0000 7f8e06400640 1 --2- 172.21.15.3:0/3181099092 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 0x557c6a6204d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.368+0000 7f8e06400640 1 -- 172.21.15.3:0/3181099092 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c6a61bbf0 con 0x557c6a60cc70 2024-09-19T06:16:53.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.368+0000 7f8e06400640 1 --2- 172.21.15.3:0/3181099092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6a60cc70 0x557c6a61ff90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009430 tx=0x7f8df8005df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f456b40b7f35ba97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:53.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.368+0000 7f8de7400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:16:53.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.369+0000 7f8de7400640 1 -- 172.21.15.3:0/3181099092 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df8066060 con 0x557c6a60cc70 2024-09-19T06:16:53.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.369+0000 7f8de7400640 1 -- 172.21.15.3:0/3181099092 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f8df804a040 con 0x557c6a60cc70 2024-09-19T06:16:53.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.369+0000 7f8e0adbd740 1 -- 172.21.15.3:0/3181099092 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557c6a57ae60 con 0x557c6a60cc70 2024-09-19T06:16:53.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.369+0000 7f8de7400640 1 -- 172.21.15.3:0/3181099092 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8df8031dc0 con 0x557c6a60cc70 2024-09-19T06:16:53.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.369+0000 7f8e0adbd740 10 client.26480 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:53.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.369+0000 7f8e0adbd740 1 -- 172.21.15.3:0/3181099092 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557c6a692680 con 0x557c6a60cc70 2024-09-19T06:16:53.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.369+0000 7f8de7400640 1 -- 172.21.15.3:0/3181099092 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x557c6a57ae60 con 0x557c6a60cc70 2024-09-19T06:16:53.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.369+0000 7f8de7400640 1 -- 172.21.15.3:0/3181099092 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8df8043070 con 0x557c6a60cc70 2024-09-19T06:16:53.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.369+0000 7f8e0adbd740 10 client.26480 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:53.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.369+0000 7f8e0adbd740 10 client.26480 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:16:53.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.369+0000 7f8e0adbd740 20 client.26480 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:53.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.370+0000 7f8e0adbd740 1 --2- 172.21.15.3:0/3181099092 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x557c6a692ad0 0x557c6a694ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:53.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.370+0000 7f8e0adbd740 4 client.26480 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:16:53.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.370+0000 7f8e0adbd740 1 -- 172.21.15.3:0/3181099092 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557c6a4f7010 con 0x557c6a692ad0 2024-09-19T06:16:53.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.370+0000 7f8e05000640 1 --2- 172.21.15.3:0/3181099092 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x557c6a692ad0 0x557c6a694ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:53.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.371+0000 7f8e05000640 1 --2- 172.21.15.3:0/3181099092 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x557c6a692ad0 0x557c6a694ec0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b79aa636b5c4fa6c server_cookie=407e7decdf01b49d in_seq=0 out_seq=0 2024-09-19T06:16:53.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.371+0000 7f8de7400640 10 client.26480 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:16:53.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.371+0000 7f8de7400640 1 -- 172.21.15.3:0/3181099092 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557c6a4f7010 con 0x557c6a692ad0 2024-09-19T06:16:53.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.371+0000 7f8de7400640 10 client.26480 handle_command_reply: tid=0 2024-09-19T06:16:53.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.371+0000 7f8e0adbd740 1 client.26480 shutdown 2024-09-19T06:16:53.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.371+0000 7f8e0adbd740 1 -- 172.21.15.3:0/3181099092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6a60cc70 msgr2=0x557c6a61ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:53.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.371+0000 7f8e0adbd740 1 --2- 172.21.15.3:0/3181099092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6a60cc70 0x557c6a61ff90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009430 tx=0x7f8df8005df0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.371+0000 7f8e0adbd740 1 -- 172.21.15.3:0/3181099092 shutdown_connections 2024-09-19T06:16:53.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.371+0000 7f8e0adbd740 1 --2- 172.21.15.3:0/3181099092 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x557c6a692ad0 0x557c6a694ec0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.371+0000 7f8e0adbd740 1 --2- 172.21.15.3:0/3181099092 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557c6a617e50 0x557c6a61b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.371+0000 7f8e0adbd740 1 --2- 172.21.15.3:0/3181099092 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557c6a60d590 0x557c6a6204d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.371+0000 7f8de7400640 0 client.26480 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:16:53.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.371+0000 7f8e0adbd740 1 --2- 172.21.15.3:0/3181099092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c6a60cc70 0x557c6a61ff90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.371+0000 7f8e0adbd740 1 -- 172.21.15.3:0/3181099092 >> 172.21.15.3:0/3181099092 conn(0x557c6a609200 msgr2=0x557c6a607b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:53.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.371+0000 7f8e0adbd740 1 -- 172.21.15.3:0/3181099092 shutdown_connections 2024-09-19T06:16:53.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.371+0000 7f8e0adbd740 1 -- 172.21.15.3:0/3181099092 wait complete. 2024-09-19T06:16:53.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.371+0000 7f8e0adbd740 20 client.26480 trim_cache size 0 max 16384 2024-09-19T06:16:53.377 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:16:53.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.372+0000 7f8e08400640 1 -- 172.21.15.3:0/2755090036 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8de80a3430 msgr2=0x7f8de80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:53.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.372+0000 7f8e08400640 1 --2- 172.21.15.3:0/2755090036 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8de80a3430 0x7f8de80a58f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8df40cd7f0 tx=0x7f8df4000bc0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.372+0000 7f8e08400640 1 -- 172.21.15.3:0/2755090036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e00104010 msgr2=0x7f8e0019a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:53.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.372+0000 7f8e08400640 1 --2- 172.21.15.3:0/2755090036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e00104010 0x7f8e0019a680 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8df400e9f0 tx=0x7f8df400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.372+0000 7f8e08400640 1 -- 172.21.15.3:0/2755090036 shutdown_connections 2024-09-19T06:16:53.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.372+0000 7f8e08400640 1 --2- 172.21.15.3:0/2755090036 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8de80a3430 0x7f8de80a58f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.372+0000 7f8e08400640 1 --2- 172.21.15.3:0/2755090036 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e00109140 0x7f8e0019ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.372+0000 7f8e08400640 1 --2- 172.21.15.3:0/2755090036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e001049c0 0x7f8e0019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.372+0000 7f8e08400640 1 --2- 172.21.15.3:0/2755090036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e00104010 0x7f8e0019a680 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:53.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.372+0000 7f8e08400640 1 -- 172.21.15.3:0/2755090036 >> 172.21.15.3:0/2755090036 conn(0x7f8e000ffa50 msgr2=0x7f8e00100d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:53.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.372+0000 7f8e08400640 1 -- 172.21.15.3:0/2755090036 shutdown_connections 2024-09-19T06:16:53.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:53.373+0000 7f8e08400640 1 -- 172.21.15.3:0/2755090036 wait complete. 2024-09-19T06:16:54.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:54 smithi003 ceph-mon[30893]: pgmap v138: 97 pgs: 97 active+clean; 1.8 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-19T06:16:54.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:54 smithi059 ceph-mon[35138]: pgmap v138: 97 pgs: 97 active+clean; 1.8 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-19T06:16:54.547 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:16:54.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:54 smithi071 ceph-mon[35662]: pgmap v138: 97 pgs: 97 active+clean; 1.8 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-19T06:16:54.926 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:55.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.944+0000 7f46d7200640 1 -- 172.21.15.3:0/3816814925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46d0077040 msgr2=0x7f46d0112510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:55.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.944+0000 7f46d7200640 1 --2- 172.21.15.3:0/3816814925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46d0077040 0x7f46d0112510 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009900 tx=0x7f46bc02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.945+0000 7f46d7200640 1 -- 172.21.15.3:0/3816814925 shutdown_connections 2024-09-19T06:16:55.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.945+0000 7f46d7200640 1 --2- 172.21.15.3:0/3816814925 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f46d0112a50 0x7f46d0114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.945+0000 7f46d7200640 1 --2- 172.21.15.3:0/3816814925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46d0077040 0x7f46d0112510 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.945+0000 7f46d7200640 1 --2- 172.21.15.3:0/3816814925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46d0076720 0x7f46d0076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.945+0000 7f46d7200640 1 -- 172.21.15.3:0/3816814925 >> 172.21.15.3:0/3816814925 conn(0x7f46d00ffa50 msgr2=0x7f46d0101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:55.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.945+0000 7f46d7200640 1 -- 172.21.15.3:0/3816814925 shutdown_connections 2024-09-19T06:16:55.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.945+0000 7f46d7200640 1 -- 172.21.15.3:0/3816814925 wait complete. 2024-09-19T06:16:55.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.946+0000 7f46d7200640 1 Processor -- start 2024-09-19T06:16:55.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.946+0000 7f46d7200640 1 -- start start 2024-09-19T06:16:55.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.946+0000 7f46d7200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f46d0076720 0x7f46d01a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:55.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.946+0000 7f46d7200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46d0077040 0x7f46d01a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:55.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.946+0000 7f46d7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46d0112a50 0x7f46d019e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:55.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.946+0000 7f46d7200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f46d0118630 con 0x7f46d0076720 2024-09-19T06:16:55.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.946+0000 7f46d7200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f46d01184b0 con 0x7f46d0112a50 2024-09-19T06:16:55.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.946+0000 7f46d7200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f46d01187b0 con 0x7f46d0077040 2024-09-19T06:16:55.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.947+0000 7f46cfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f46d0076720 0x7f46d01a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:55.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.947+0000 7f46cfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f46d0076720 0x7f46d01a4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35584/0 (socket says 172.21.15.3:35584) 2024-09-19T06:16:55.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.947+0000 7f46cfe00640 1 -- 172.21.15.3:0/1237842213 learned_addr learned my addr 172.21.15.3:0/1237842213 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:55.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.947+0000 7f46cf400640 1 --2- 172.21.15.3:0/1237842213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46d0077040 0x7f46d01a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:55.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.947+0000 7f46d5200640 1 --2- 172.21.15.3:0/1237842213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46d0112a50 0x7f46d019e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:55.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.947+0000 7f46cfe00640 1 -- 172.21.15.3:0/1237842213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46d0077040 msgr2=0x7f46d01a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:55.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.947+0000 7f46cfe00640 1 --2- 172.21.15.3:0/1237842213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46d0077040 0x7f46d01a4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.947+0000 7f46cfe00640 1 -- 172.21.15.3:0/1237842213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46d0112a50 msgr2=0x7f46d019e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:55.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.947+0000 7f46cfe00640 1 --2- 172.21.15.3:0/1237842213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46d0112a50 0x7f46d019e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.947+0000 7f46cfe00640 1 -- 172.21.15.3:0/1237842213 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d019f050 con 0x7f46d0076720 2024-09-19T06:16:55.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.947+0000 7f46cfe00640 1 --2- 172.21.15.3:0/1237842213 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f46d0076720 0x7f46d01a4760 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f46c000e9f0 tx=0x7f46c000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:55.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.948+0000 7f46ccc00640 1 -- 172.21.15.3:0/1237842213 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c000ccc0 con 0x7f46d0076720 2024-09-19T06:16:55.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.948+0000 7f46ccc00640 1 -- 172.21.15.3:0/1237842213 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46c000ce60 con 0x7f46d0076720 2024-09-19T06:16:55.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.948+0000 7f46ccc00640 1 -- 172.21.15.3:0/1237842213 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c0010690 con 0x7f46d0076720 2024-09-19T06:16:55.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.948+0000 7f46d7200640 1 -- 172.21.15.3:0/1237842213 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46d019f340 con 0x7f46d0076720 2024-09-19T06:16:55.952 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.948+0000 7f46d7200640 1 -- 172.21.15.3:0/1237842213 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46d01ab630 con 0x7f46d0076720 2024-09-19T06:16:55.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.951+0000 7f46d9c42740 1 Processor -- start 2024-09-19T06:16:55.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.951+0000 7f46d9c42740 1 -- start start 2024-09-19T06:16:55.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.951+0000 7f46ccc00640 1 -- 172.21.15.3:0/1237842213 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f46c00046c0 con 0x7f46d0076720 2024-09-19T06:16:55.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.952+0000 7f46d9c42740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f30ebbc70 0x562f30ebc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:55.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.952+0000 7f46d9c42740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f30ebc590 0x562f30ec6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:55.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.952+0000 7f46d9c42740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ec6e50 0x562f30ec9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:55.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.952+0000 7f46d9c42740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562f30e223e0 con 0x562f30ec6e50 2024-09-19T06:16:55.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.952+0000 7f46d9c42740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562f30dc9d80 con 0x562f30ebbc70 2024-09-19T06:16:55.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.952+0000 7f46d9c42740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562f30e1e3a0 con 0x562f30ebc590 2024-09-19T06:16:55.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.952+0000 7f46cf400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ec6e50 0x562f30ec9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:55.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.952+0000 7f46d5200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f30ebbc70 0x562f30ebc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:55.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.952+0000 7f46cf400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ec6e50 0x562f30ec9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35594/0 (socket says 172.21.15.3:35594) 2024-09-19T06:16:55.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.952+0000 7f46cf400640 1 -- 172.21.15.3:0/1455218228 learned_addr learned my addr 172.21.15.3:0/1455218228 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:55.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.952+0000 7f46cfe00640 1 --2- 172.21.15.3:0/1455218228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f30ebc590 0x562f30ec6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:55.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.952+0000 7f46d5200640 1 -- 172.21.15.3:0/1455218228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f30ebc590 msgr2=0x562f30ec6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:55.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.952+0000 7f46d5200640 1 --2- 172.21.15.3:0/1455218228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f30ebc590 0x562f30ec6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.952+0000 7f46d5200640 1 -- 172.21.15.3:0/1455218228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ec6e50 msgr2=0x562f30ec9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:55.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.952+0000 7f46d5200640 1 --2- 172.21.15.3:0/1455218228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ec6e50 0x562f30ec9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.952+0000 7f46d5200640 1 -- 172.21.15.3:0/1455218228 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f30de8ae0 con 0x562f30ebbc70 2024-09-19T06:16:55.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.953+0000 7f46d5200640 1 --2- 172.21.15.3:0/1455218228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f30ebbc70 0x562f30ebc050 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f46d007aa10 tx=0x7f46c8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=182764c9a3f6dad2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:55.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.953+0000 7f46ccc00640 1 --2- 172.21.15.3:0/1237842213 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f46b40a3430 0x7f46b40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:55.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.953+0000 7f46c5600640 1 -- 172.21.15.3:0/1455218228 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c8004d20 con 0x562f30ebbc70 2024-09-19T06:16:55.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.953+0000 7f46c5600640 1 -- 172.21.15.3:0/1455218228 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46c8004050 con 0x562f30ebbc70 2024-09-19T06:16:55.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.953+0000 7f46cfe00640 1 --2- 172.21.15.3:0/1237842213 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f46b40a3430 0x7f46b40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:55.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.953+0000 7f46c5600640 1 -- 172.21.15.3:0/1455218228 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c8005280 con 0x562f30ebbc70 2024-09-19T06:16:55.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.953+0000 7f46ccc00640 1 -- 172.21.15.3:0/1237842213 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f46c00d00e0 con 0x7f46d0076720 2024-09-19T06:16:55.964 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.954+0000 7f46cfe00640 1 --2- 172.21.15.3:0/1237842213 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f46b40a3430 0x7f46b40a58f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x562f30eb9060 tx=0x7f46c00bc040 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:55.964 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.954+0000 7f46d9c42740 1 -- 172.21.15.3:0/1455218228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f30ebbc70 msgr2=0x562f30ebc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:55.964 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.954+0000 7f46d9c42740 1 --2- 172.21.15.3:0/1455218228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f30ebbc70 0x562f30ebc050 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f46d007aa10 tx=0x7f46c8011810 comp rx=0 tx=0).stop 2024-09-19T06:16:55.964 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.954+0000 7f46d9c42740 1 -- 172.21.15.3:0/1455218228 shutdown_connections 2024-09-19T06:16:55.964 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.954+0000 7f46d9c42740 1 --2- 172.21.15.3:0/1455218228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ec6e50 0x562f30ec9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.954+0000 7f46d9c42740 1 --2- 172.21.15.3:0/1455218228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f30ebc590 0x562f30ec6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.954+0000 7f46d9c42740 1 --2- 172.21.15.3:0/1455218228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f30ebbc70 0x562f30ebc050 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.954+0000 7f46d9c42740 1 -- 172.21.15.3:0/1455218228 >> 172.21.15.3:0/1455218228 conn(0x562f30eb8200 msgr2=0x562f30eb85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:55.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.954+0000 7f46d9c42740 1 -- 172.21.15.3:0/1455218228 shutdown_connections 2024-09-19T06:16:55.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.955+0000 7f46d9c42740 1 -- 172.21.15.3:0/1455218228 wait complete. 2024-09-19T06:16:55.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.955+0000 7f46d9c42740 1 -- start start 2024-09-19T06:16:55.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.955+0000 7f46d9c42740 1 Processor -- start 2024-09-19T06:16:55.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.956+0000 7f46d9c42740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ebbc70 0x562f30ec3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:55.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.956+0000 7f46d9c42740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f30ebc590 0x562f30ec4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:55.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.956+0000 7f46d9c42740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f30ec6e50 0x562f30ec47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:55.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.956+0000 7f46d9c42740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562f30ec9a20 con 0x562f30ebbc70 2024-09-19T06:16:55.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.956+0000 7f46d9c42740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562f30ddd0f0 con 0x562f30ec6e50 2024-09-19T06:16:55.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.956+0000 7f46d9c42740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562f30ec9ba0 con 0x562f30ebc590 2024-09-19T06:16:55.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.956+0000 7f46d9c42740 10 client.0 _ll_register_callbacks cb 0x562f30dc4bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:55.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.956+0000 7f46d5200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ebbc70 0x562f30ec3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:55.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.956+0000 7f46d5200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ebbc70 0x562f30ec3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35600/0 (socket says 172.21.15.3:35600) 2024-09-19T06:16:55.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.956+0000 7f46d5200640 1 -- 172.21.15.3:0/3646310176 learned_addr learned my addr 172.21.15.3:0/3646310176 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:55.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.956+0000 7f46cf400640 1 --2- 172.21.15.3:0/3646310176 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f30ebc590 0x562f30ec4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:55.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.956+0000 7f46d5200640 1 --2- 172.21.15.3:0/3646310176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f30ec6e50 0x562f30ec47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:55.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.957+0000 7f46d5200640 1 -- 172.21.15.3:0/3646310176 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f30ebc590 msgr2=0x562f30ec4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:55.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.957+0000 7f46d5200640 1 --2- 172.21.15.3:0/3646310176 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f30ebc590 0x562f30ec4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.957+0000 7f46d5200640 1 -- 172.21.15.3:0/3646310176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f30ec6e50 msgr2=0x562f30ec47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:55.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.957+0000 7f46d5200640 1 --2- 172.21.15.3:0/3646310176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f30ec6e50 0x562f30ec47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.957+0000 7f46d5200640 1 -- 172.21.15.3:0/3646310176 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f30b933c0 con 0x562f30ebbc70 2024-09-19T06:16:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.957+0000 7f46d5200640 1 --2- 172.21.15.3:0/3646310176 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ebbc70 0x562f30ec3d50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f46c8003ee0 tx=0x7f46c8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a4185e9be924a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.957+0000 7f46ba000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:16:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.957+0000 7f46ba000640 1 -- 172.21.15.3:0/3646310176 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c801d040 con 0x562f30ebbc70 2024-09-19T06:16:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.957+0000 7f46d9c42740 1 -- 172.21.15.3:0/3646310176 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46c8004050 con 0x562f30ebbc70 2024-09-19T06:16:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.957+0000 7f46ba000640 1 -- 172.21.15.3:0/3646310176 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f46c8004c40 con 0x562f30ebbc70 2024-09-19T06:16:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.958+0000 7f46ba000640 1 -- 172.21.15.3:0/3646310176 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f46c8035050 con 0x562f30ebbc70 2024-09-19T06:16:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.958+0000 7f46d9c42740 10 client.16449 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:55.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.958+0000 7f46d9c42740 1 -- 172.21.15.3:0/3646310176 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562f30ed5a70 con 0x562f30ebbc70 2024-09-19T06:16:55.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.958+0000 7f46ba000640 1 -- 172.21.15.3:0/3646310176 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46c8004050 con 0x562f30ebbc70 2024-09-19T06:16:55.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.958+0000 7f46ba000640 1 -- 172.21.15.3:0/3646310176 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f46c8027430 con 0x562f30ebbc70 2024-09-19T06:16:55.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.958+0000 7f46d9c42740 10 client.16449 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:55.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.958+0000 7f46d9c42740 10 client.16449 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:16:55.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.958+0000 7f46d9c42740 20 client.16449 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:55.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.958+0000 7f46d9c42740 1 --2- 172.21.15.3:0/3646310176 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x562f30ed6e20 0x562f30ed9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:55.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.958+0000 7f46d9c42740 4 client.16449 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:55.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.958+0000 7f46d9c42740 1 -- 172.21.15.3:0/3646310176 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f30e2f950 con 0x562f30ed6e20 2024-09-19T06:16:55.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.959+0000 7f46cf400640 1 --2- 172.21.15.3:0/3646310176 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x562f30ed6e20 0x562f30ed9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:55.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.959+0000 7f46cf400640 1 --2- 172.21.15.3:0/3646310176 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x562f30ed6e20 0x562f30ed9210 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8f19b07082b8f059 server_cookie=a059c8adcba77c52 in_seq=0 out_seq=0 2024-09-19T06:16:55.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.959+0000 7f46ba000640 10 client.16449 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:16:55.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.960+0000 7f46ba000640 1 -- 172.21.15.3:0/3646310176 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562f30e2f950 con 0x562f30ed6e20 2024-09-19T06:16:55.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.960+0000 7f46ba000640 10 client.16449 handle_command_reply: tid=0 2024-09-19T06:16:55.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.960+0000 7f46d9c42740 1 client.16449 shutdown 2024-09-19T06:16:55.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.960+0000 7f46d9c42740 1 -- 172.21.15.3:0/3646310176 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ebbc70 msgr2=0x562f30ec3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:55.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.960+0000 7f46d9c42740 1 --2- 172.21.15.3:0/3646310176 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ebbc70 0x562f30ec3d50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f46c8003ee0 tx=0x7f46c8009bf0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.960+0000 7f46d9c42740 1 -- 172.21.15.3:0/3646310176 shutdown_connections 2024-09-19T06:16:55.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.960+0000 7f46d9c42740 1 --2- 172.21.15.3:0/3646310176 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x562f30ed6e20 0x562f30ed9210 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.960+0000 7f46d9c42740 1 --2- 172.21.15.3:0/3646310176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f30ec6e50 0x562f30ec47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.960+0000 7f46d9c42740 1 --2- 172.21.15.3:0/3646310176 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f30ebc590 0x562f30ec4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.960+0000 7f46d9c42740 1 --2- 172.21.15.3:0/3646310176 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ebbc70 0x562f30ec3d50 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.960+0000 7f46d9c42740 1 -- 172.21.15.3:0/3646310176 >> 172.21.15.3:0/3646310176 conn(0x562f30eb8200 msgr2=0x562f30ebdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:55.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.960+0000 7f46ba000640 0 client.16449 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:16:55.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.961+0000 7f46d9c42740 1 -- 172.21.15.3:0/3646310176 shutdown_connections 2024-09-19T06:16:55.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.961+0000 7f46d9c42740 1 -- 172.21.15.3:0/3646310176 wait complete. 2024-09-19T06:16:55.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.961+0000 7f46d9c42740 20 client.16449 trim_cache size 0 max 16384 2024-09-19T06:16:55.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.975+0000 7f46d9c42740 1 Processor -- start 2024-09-19T06:16:55.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.975+0000 7f46d9c42740 1 -- start start 2024-09-19T06:16:55.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.975+0000 7f46d9c42740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f30ebbc70 0x562f30ec5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:55.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.975+0000 7f46d9c42740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f30ebc590 0x562f30ede930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:55.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.975+0000 7f46d9c42740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ec6e50 0x562f30edee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:55.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.975+0000 7f46d9c42740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f46d01b3fc0 con 0x562f30ec6e50 2024-09-19T06:16:55.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.975+0000 7f46d9c42740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f46d01b5b00 con 0x562f30ebc590 2024-09-19T06:16:55.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.975+0000 7f46d9c42740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f46d01b4690 con 0x562f30ebbc70 2024-09-19T06:16:55.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.975+0000 7f46d5200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ec6e50 0x562f30edee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:55.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.975+0000 7f46d5200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ec6e50 0x562f30edee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35606/0 (socket says 172.21.15.3:35606) 2024-09-19T06:16:55.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.975+0000 7f46d5200640 1 -- 172.21.15.3:0/3969189021 learned_addr learned my addr 172.21.15.3:0/3969189021 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:55.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.975+0000 7f46cf400640 1 --2- 172.21.15.3:0/3969189021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f30ebc590 0x562f30ede930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:55.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.975+0000 7f46d5200640 1 --2- 172.21.15.3:0/3969189021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f30ebbc70 0x562f30ec5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:55.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.976+0000 7f46d5200640 1 -- 172.21.15.3:0/3969189021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f30ebbc70 msgr2=0x562f30ec5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:55.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.976+0000 7f46d5200640 1 --2- 172.21.15.3:0/3969189021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f30ebbc70 0x562f30ec5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.976+0000 7f46d5200640 1 -- 172.21.15.3:0/3969189021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f30ebc590 msgr2=0x562f30ede930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:55.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.976+0000 7f46d5200640 1 --2- 172.21.15.3:0/3969189021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f30ebc590 0x562f30ede930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.976+0000 7f46d5200640 1 -- 172.21.15.3:0/3969189021 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f30ebc3c0 con 0x562f30ec6e50 2024-09-19T06:16:55.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.976+0000 7f46d5200640 1 --2- 172.21.15.3:0/3969189021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ec6e50 0x562f30edee70 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f46c8029040 tx=0x7f46c8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5351fc5d0a0ec6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:55.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.976+0000 7f46c4c00640 1 -- 172.21.15.3:0/3969189021 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c801d070 con 0x562f30ec6e50 2024-09-19T06:16:55.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.976+0000 7f46c4c00640 1 -- 172.21.15.3:0/3969189021 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46c802c070 con 0x562f30ec6e50 2024-09-19T06:16:55.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.976+0000 7f46c4c00640 1 -- 172.21.15.3:0/3969189021 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c80059f0 con 0x562f30ec6e50 2024-09-19T06:16:55.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.977+0000 7f46d9c42740 1 -- 172.21.15.3:0/3969189021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ec6e50 msgr2=0x562f30edee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:55.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.977+0000 7f46d9c42740 1 --2- 172.21.15.3:0/3969189021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ec6e50 0x562f30edee70 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f46c8029040 tx=0x7f46c8011810 comp rx=0 tx=0).stop 2024-09-19T06:16:55.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.977+0000 7f46d9c42740 1 -- 172.21.15.3:0/3969189021 shutdown_connections 2024-09-19T06:16:55.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.977+0000 7f46d9c42740 1 --2- 172.21.15.3:0/3969189021 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ec6e50 0x562f30edee70 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.977+0000 7f46d9c42740 1 --2- 172.21.15.3:0/3969189021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f30ebc590 0x562f30ede930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.977+0000 7f46d9c42740 1 --2- 172.21.15.3:0/3969189021 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f30ebbc70 0x562f30ec5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.977+0000 7f46d9c42740 1 -- 172.21.15.3:0/3969189021 >> 172.21.15.3:0/3969189021 conn(0x562f30eb8200 msgr2=0x562f30ec55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:55.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.977+0000 7f46d9c42740 1 -- 172.21.15.3:0/3969189021 shutdown_connections 2024-09-19T06:16:55.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.977+0000 7f46d9c42740 1 -- 172.21.15.3:0/3969189021 wait complete. 2024-09-19T06:16:55.986 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.978+0000 7f46d9c42740 1 -- start start 2024-09-19T06:16:55.986 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.978+0000 7f46d9c42740 1 Processor -- start 2024-09-19T06:16:55.986 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.978+0000 7f46d9c42740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f30ebbc70 0x562f30ecf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:55.986 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.978+0000 7f46d9c42740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f30ebc590 0x562f30ecf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:55.986 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.978+0000 7f46d9c42740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ec6e50 0x562f30ec0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:55.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.978+0000 7f46d9c42740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f46d01b5430 con 0x562f30ec6e50 2024-09-19T06:16:55.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.978+0000 7f46d9c42740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f46d01b4d60 con 0x562f30ebbc70 2024-09-19T06:16:55.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.978+0000 7f46d9c42740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f46d01b1fa0 con 0x562f30ebc590 2024-09-19T06:16:55.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.979+0000 7f46d9c42740 10 client.0 _ll_register_callbacks cb 0x7f46c0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:55.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.979+0000 7f46d5200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f30ebbc70 0x562f30ecf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:55.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.979+0000 7f46d5200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ec6e50 0x562f30ec0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:55.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.979+0000 7f46d5200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f30ebbc70 0x562f30ecf160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:39190/0 (socket says 172.21.15.3:39190) 2024-09-19T06:16:55.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.979+0000 7f46d5200640 1 -- 172.21.15.3:0/3863060107 learned_addr learned my addr 172.21.15.3:0/3863060107 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:55.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.979+0000 7f46cf400640 1 --2- 172.21.15.3:0/3863060107 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f30ebc590 0x562f30ecf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:55.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.979+0000 7f46d5200640 1 -- 172.21.15.3:0/3863060107 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f30ebc590 msgr2=0x562f30ecf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:55.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.979+0000 7f46d5200640 1 --2- 172.21.15.3:0/3863060107 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f30ebc590 0x562f30ecf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.979+0000 7f46d5200640 1 -- 172.21.15.3:0/3863060107 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ec6e50 msgr2=0x562f30ec0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:55.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.979+0000 7f46d5200640 1 --2- 172.21.15.3:0/3863060107 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ec6e50 0x562f30ec0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.979+0000 7f46d5200640 1 -- 172.21.15.3:0/3863060107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f30ec11a0 con 0x562f30ebbc70 2024-09-19T06:16:55.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.979+0000 7f46cf400640 1 --2- 172.21.15.3:0/3863060107 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f30ebc590 0x562f30ecf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:55.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.980+0000 7f46d5200640 1 --2- 172.21.15.3:0/3863060107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f30ebbc70 0x562f30ecf160 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f46c8013040 tx=0x7f46c80055d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be435a0c768f3d77 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:55.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.980+0000 7f46ba000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:16:55.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.980+0000 7f46ba000640 1 -- 172.21.15.3:0/3863060107 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c801d040 con 0x562f30ebbc70 2024-09-19T06:16:55.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.980+0000 7f46d9c42740 1 -- 172.21.15.3:0/3863060107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46c802c070 con 0x562f30ebbc70 2024-09-19T06:16:55.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.980+0000 7f46ba000640 1 -- 172.21.15.3:0/3863060107 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f46c8027a70 con 0x562f30ebbc70 2024-09-19T06:16:55.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.980+0000 7f46ba000640 1 -- 172.21.15.3:0/3863060107 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f46c804d050 con 0x562f30ebbc70 2024-09-19T06:16:55.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.980+0000 7f46d9c42740 10 client.26498 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:55.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.980+0000 7f46d9c42740 1 -- 172.21.15.3:0/3863060107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562f30f41590 con 0x562f30ebbc70 2024-09-19T06:16:55.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.980+0000 7f46ba000640 1 -- 172.21.15.3:0/3863060107 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46c802c070 con 0x562f30ebbc70 2024-09-19T06:16:55.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.981+0000 7f46ba000640 1 -- 172.21.15.3:0/3863060107 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f46c8019820 con 0x562f30ebbc70 2024-09-19T06:16:55.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.981+0000 7f46d9c42740 10 client.26498 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:55.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.981+0000 7f46d9c42740 10 client.26498 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:16:55.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.981+0000 7f46d9c42740 20 client.26498 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:55.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.981+0000 7f46d9c42740 1 --2- 172.21.15.3:0/3863060107 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x562f30f41b90 0x562f30f43f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:55.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.981+0000 7f46d9c42740 4 client.26498 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:16:55.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.981+0000 7f46d9c42740 1 -- 172.21.15.3:0/3863060107 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562f30e29e60 con 0x562f30f41b90 2024-09-19T06:16:55.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.981+0000 7f46cf400640 1 --2- 172.21.15.3:0/3863060107 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x562f30f41b90 0x562f30f43f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:55.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.982+0000 7f46cf400640 1 --2- 172.21.15.3:0/3863060107 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x562f30f41b90 0x562f30f43f80 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=426f9c83d15bd341 server_cookie=c176477df2c939b5 in_seq=0 out_seq=0 2024-09-19T06:16:55.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.982+0000 7f46ba000640 10 client.26498 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:16:55.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.982+0000 7f46ba000640 1 -- 172.21.15.3:0/3863060107 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562f30e29e60 con 0x562f30f41b90 2024-09-19T06:16:55.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.982+0000 7f46ba000640 10 client.26498 handle_command_reply: tid=0 2024-09-19T06:16:55.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.982+0000 7f46d9c42740 1 client.26498 shutdown 2024-09-19T06:16:55.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.982+0000 7f46d9c42740 1 -- 172.21.15.3:0/3863060107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f30ebbc70 msgr2=0x562f30ecf160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:55.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.982+0000 7f46d9c42740 1 --2- 172.21.15.3:0/3863060107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f30ebbc70 0x562f30ecf160 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f46c8013040 tx=0x7f46c80055d0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.982+0000 7f46d9c42740 1 -- 172.21.15.3:0/3863060107 shutdown_connections 2024-09-19T06:16:55.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.982+0000 7f46d9c42740 1 --2- 172.21.15.3:0/3863060107 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x562f30f41b90 0x562f30f43f80 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.982+0000 7f46d9c42740 1 --2- 172.21.15.3:0/3863060107 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f30ec6e50 0x562f30ec0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.982+0000 7f46d9c42740 1 --2- 172.21.15.3:0/3863060107 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f30ebc590 0x562f30ecf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.982+0000 7f46d9c42740 1 --2- 172.21.15.3:0/3863060107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f30ebbc70 0x562f30ecf160 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.982+0000 7f46ba000640 0 client.26498 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:16:55.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.982+0000 7f46d9c42740 1 -- 172.21.15.3:0/3863060107 >> 172.21.15.3:0/3863060107 conn(0x562f30eb8200 msgr2=0x562f30ebdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:55.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.982+0000 7f46d9c42740 1 -- 172.21.15.3:0/3863060107 shutdown_connections 2024-09-19T06:16:55.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.982+0000 7f46d9c42740 1 -- 172.21.15.3:0/3863060107 wait complete. 2024-09-19T06:16:55.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.983+0000 7f46d9c42740 20 client.26498 trim_cache size 0 max 16384 2024-09-19T06:16:55.992 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:16:55.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.983+0000 7f46d7200640 1 -- 172.21.15.3:0/1237842213 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f46b40a3430 msgr2=0x7f46b40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:55.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.983+0000 7f46d7200640 1 --2- 172.21.15.3:0/1237842213 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f46b40a3430 0x7f46b40a58f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x562f30eb9060 tx=0x7f46c00bc040 comp rx=0 tx=0).stop 2024-09-19T06:16:55.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.983+0000 7f46d7200640 1 -- 172.21.15.3:0/1237842213 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f46d0076720 msgr2=0x7f46d01a4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:55.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.983+0000 7f46d7200640 1 --2- 172.21.15.3:0/1237842213 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f46d0076720 0x7f46d01a4760 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f46c000e9f0 tx=0x7f46c000edf0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.983+0000 7f46d7200640 1 -- 172.21.15.3:0/1237842213 shutdown_connections 2024-09-19T06:16:55.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.983+0000 7f46d7200640 1 --2- 172.21.15.3:0/1237842213 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f46b40a3430 0x7f46b40a58f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.983+0000 7f46d7200640 1 --2- 172.21.15.3:0/1237842213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46d0112a50 0x7f46d019e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.983+0000 7f46d7200640 1 --2- 172.21.15.3:0/1237842213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46d0077040 0x7f46d01a4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.983+0000 7f46d7200640 1 --2- 172.21.15.3:0/1237842213 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f46d0076720 0x7f46d01a4760 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:55.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.983+0000 7f46d7200640 1 -- 172.21.15.3:0/1237842213 >> 172.21.15.3:0/1237842213 conn(0x7f46d00ffa50 msgr2=0x7f46d0101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:55.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.983+0000 7f46d7200640 1 -- 172.21.15.3:0/1237842213 shutdown_connections 2024-09-19T06:16:55.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:55.983+0000 7f46d7200640 1 -- 172.21.15.3:0/1237842213 wait complete. 2024-09-19T06:16:56.472 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:56 smithi003 ceph-mon[30893]: pgmap v139: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:16:56.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:56 smithi059 ceph-mon[35138]: pgmap v139: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:16:56.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:56 smithi071 ceph-mon[35662]: pgmap v139: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T06:16:57.020 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:16:57.069 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.069 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.069 INFO:tasks.workunit.client.0.smithi003.stdout:127/600: open fd = 3 2024-09-19T06:16:57.069 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.069 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.069 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.069 INFO:tasks.workunit.client.0.smithi003.stdout:128/600: open fd = 3 2024-09-19T06:16:57.069 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.069 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.069 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.070 INFO:tasks.workunit.client.0.smithi003.stdout:129/600: open fd = 3 2024-09-19T06:16:57.070 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.070 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.070 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.070 INFO:tasks.workunit.client.0.smithi003.stdout:130/600: open fd = 3 2024-09-19T06:16:57.070 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.070 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.070 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.070 INFO:tasks.workunit.client.0.smithi003.stdout:131/600: open fd = 3 2024-09-19T06:16:57.070 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.070 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.070 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.070 INFO:tasks.workunit.client.0.smithi003.stdout:132/600: open fd = 3 2024-09-19T06:16:57.070 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.070 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.071 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.071 INFO:tasks.workunit.client.0.smithi003.stdout:133/600: open fd = 3 2024-09-19T06:16:57.071 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.071 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.071 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.071 INFO:tasks.workunit.client.0.smithi003.stdout:134/600: open fd = 3 2024-09-19T06:16:57.071 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.071 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.071 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.071 INFO:tasks.workunit.client.0.smithi003.stdout:135/600: open fd = 3 2024-09-19T06:16:57.071 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.071 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.071 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.071 INFO:tasks.workunit.client.0.smithi003.stdout:136/600: open fd = 3 2024-09-19T06:16:57.072 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.072 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.072 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.072 INFO:tasks.workunit.client.0.smithi003.stdout:137/600: open fd = 3 2024-09-19T06:16:57.072 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.072 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.072 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.072 INFO:tasks.workunit.client.0.smithi003.stdout:138/600: open fd = 3 2024-09-19T06:16:57.072 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.072 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.072 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.072 INFO:tasks.workunit.client.0.smithi003.stdout:139/600: open fd = 3 2024-09-19T06:16:57.072 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.072 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.073 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.073 INFO:tasks.workunit.client.0.smithi003.stdout:140/600: open fd = 3 2024-09-19T06:16:57.073 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.073 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.073 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.073 INFO:tasks.workunit.client.0.smithi003.stdout:141/600: open fd = 3 2024-09-19T06:16:57.073 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.073 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.073 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.073 INFO:tasks.workunit.client.0.smithi003.stdout:142/600: open fd = 3 2024-09-19T06:16:57.073 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.073 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.073 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.073 INFO:tasks.workunit.client.0.smithi003.stdout:143/600: open fd = 3 2024-09-19T06:16:57.074 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.074 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.074 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.074 INFO:tasks.workunit.client.0.smithi003.stdout:144/600: open fd = 3 2024-09-19T06:16:57.074 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.074 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.074 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.074 INFO:tasks.workunit.client.0.smithi003.stdout:145/600: open fd = 3 2024-09-19T06:16:57.074 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.074 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.074 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.074 INFO:tasks.workunit.client.0.smithi003.stdout:146/600: open fd = 3 2024-09-19T06:16:57.074 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.074 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.075 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.075 INFO:tasks.workunit.client.0.smithi003.stdout:147/600: open fd = 3 2024-09-19T06:16:57.075 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.075 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.075 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.075 INFO:tasks.workunit.client.0.smithi003.stdout:148/600: open fd = 3 2024-09-19T06:16:57.075 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.075 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.075 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.075 INFO:tasks.workunit.client.0.smithi003.stdout:149/600: open fd = 3 2024-09-19T06:16:57.075 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.075 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.075 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.075 INFO:tasks.workunit.client.0.smithi003.stdout:150/600: open fd = 3 2024-09-19T06:16:57.076 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.076 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.076 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.076 INFO:tasks.workunit.client.0.smithi003.stdout:151/600: open fd = 3 2024-09-19T06:16:57.076 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.076 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.076 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.076 INFO:tasks.workunit.client.0.smithi003.stdout:152/600: open fd = 3 2024-09-19T06:16:57.076 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.076 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.076 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.076 INFO:tasks.workunit.client.0.smithi003.stdout:153/600: open fd = 3 2024-09-19T06:16:57.076 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.076 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.077 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.077 INFO:tasks.workunit.client.0.smithi003.stdout:154/600: open fd = 3 2024-09-19T06:16:57.077 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.077 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.077 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.077 INFO:tasks.workunit.client.0.smithi003.stdout:155/600: open fd = 3 2024-09-19T06:16:57.077 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.077 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.077 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.077 INFO:tasks.workunit.client.0.smithi003.stdout:156/600: open fd = 3 2024-09-19T06:16:57.077 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.077 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.077 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.077 INFO:tasks.workunit.client.0.smithi003.stdout:157/600: open fd = 3 2024-09-19T06:16:57.077 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.078 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.078 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.078 INFO:tasks.workunit.client.0.smithi003.stdout:158/600: open fd = 3 2024-09-19T06:16:57.078 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.078 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.078 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.078 INFO:tasks.workunit.client.0.smithi003.stdout:159/600: open fd = 3 2024-09-19T06:16:57.078 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.078 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.078 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.078 INFO:tasks.workunit.client.0.smithi003.stdout:160/600: open fd = 3 2024-09-19T06:16:57.078 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.078 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.078 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.079 INFO:tasks.workunit.client.0.smithi003.stdout:161/600: open fd = 3 2024-09-19T06:16:57.079 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.079 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.079 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.079 INFO:tasks.workunit.client.0.smithi003.stdout:162/600: open fd = 3 2024-09-19T06:16:57.079 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.079 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.079 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.079 INFO:tasks.workunit.client.0.smithi003.stdout:163/600: open fd = 3 2024-09-19T06:16:57.079 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.079 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.079 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.079 INFO:tasks.workunit.client.0.smithi003.stdout:164/600: open fd = 3 2024-09-19T06:16:57.079 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.080 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.080 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.080 INFO:tasks.workunit.client.0.smithi003.stdout:165/600: open fd = 3 2024-09-19T06:16:57.080 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.080 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.080 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.080 INFO:tasks.workunit.client.0.smithi003.stdout:166/600: open fd = 3 2024-09-19T06:16:57.080 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.080 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.080 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.080 INFO:tasks.workunit.client.0.smithi003.stdout:167/600: open fd = 3 2024-09-19T06:16:57.080 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.080 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.080 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.081 INFO:tasks.workunit.client.0.smithi003.stdout:168/600: open fd = 3 2024-09-19T06:16:57.081 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.081 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.081 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.081 INFO:tasks.workunit.client.0.smithi003.stdout:169/600: open fd = 3 2024-09-19T06:16:57.081 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.081 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.081 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.081 INFO:tasks.workunit.client.0.smithi003.stdout:170/600: open fd = 3 2024-09-19T06:16:57.081 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.081 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.081 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.081 INFO:tasks.workunit.client.0.smithi003.stdout:171/600: open fd = 3 2024-09-19T06:16:57.081 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.081 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.082 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.082 INFO:tasks.workunit.client.0.smithi003.stdout:172/600: open fd = 3 2024-09-19T06:16:57.082 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.082 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.082 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.082 INFO:tasks.workunit.client.0.smithi003.stdout:173/600: open fd = 3 2024-09-19T06:16:57.082 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.082 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.082 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.082 INFO:tasks.workunit.client.0.smithi003.stdout:174/600: open fd = 3 2024-09-19T06:16:57.082 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.082 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.082 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.082 INFO:tasks.workunit.client.0.smithi003.stdout:175/600: open fd = 3 2024-09-19T06:16:57.083 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.083 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.083 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.083 INFO:tasks.workunit.client.0.smithi003.stdout:176/600: open fd = 3 2024-09-19T06:16:57.083 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.083 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.083 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.083 INFO:tasks.workunit.client.0.smithi003.stdout:177/600: open fd = 3 2024-09-19T06:16:57.083 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.083 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.083 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.083 INFO:tasks.workunit.client.0.smithi003.stdout:178/600: open fd = 3 2024-09-19T06:16:57.083 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.083 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.084 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.084 INFO:tasks.workunit.client.0.smithi003.stdout:179/600: open fd = 3 2024-09-19T06:16:57.084 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.084 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.084 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.084 INFO:tasks.workunit.client.0.smithi003.stdout:180/600: open fd = 3 2024-09-19T06:16:57.084 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.084 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.084 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.084 INFO:tasks.workunit.client.0.smithi003.stdout:181/600: open fd = 3 2024-09-19T06:16:57.084 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.084 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.084 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.084 INFO:tasks.workunit.client.0.smithi003.stdout:182/600: open fd = 3 2024-09-19T06:16:57.085 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.085 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.085 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.085 INFO:tasks.workunit.client.0.smithi003.stdout:183/600: open fd = 3 2024-09-19T06:16:57.085 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.085 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.085 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.085 INFO:tasks.workunit.client.0.smithi003.stdout:184/600: open fd = 3 2024-09-19T06:16:57.085 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.085 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.085 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.085 INFO:tasks.workunit.client.0.smithi003.stdout:185/600: open fd = 3 2024-09-19T06:16:57.085 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.085 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.086 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.086 INFO:tasks.workunit.client.0.smithi003.stdout:186/600: open fd = 3 2024-09-19T06:16:57.086 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.086 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.086 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.086 INFO:tasks.workunit.client.0.smithi003.stdout:187/600: open fd = 3 2024-09-19T06:16:57.086 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.086 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.086 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:16:57.086 INFO:tasks.workunit.client.0.smithi003.stdout:188/600: open fd = 3 2024-09-19T06:16:57.087 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.087 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:16:57.401 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:16:57.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.990+0000 7f9127200640 1 -- 172.21.15.3:0/3367664801 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9120112b90 msgr2=0x7f9120114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:57.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.990+0000 7f9127200640 1 --2- 172.21.15.3:0/3367664801 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9120112b90 0x7f9120114f80 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9118009be0 tx=0x7f911802a750 comp rx=0 tx=0).stop 2024-09-19T06:16:57.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.991+0000 7f9127200640 1 -- 172.21.15.3:0/3367664801 shutdown_connections 2024-09-19T06:16:57.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.991+0000 7f9127200640 1 --2- 172.21.15.3:0/3367664801 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9120112b90 0x7f9120114f80 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:57.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.991+0000 7f9127200640 1 --2- 172.21.15.3:0/3367664801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9120074eb0 0x7f9120112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:57.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.991+0000 7f9127200640 1 --2- 172.21.15.3:0/3367664801 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9120074590 0x7f9120074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:57.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.991+0000 7f9127200640 1 -- 172.21.15.3:0/3367664801 >> 172.21.15.3:0/3367664801 conn(0x7f91200fd8c0 msgr2=0x7f91200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:57.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.991+0000 7f9127200640 1 -- 172.21.15.3:0/3367664801 shutdown_connections 2024-09-19T06:16:57.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.991+0000 7f9127200640 1 -- 172.21.15.3:0/3367664801 wait complete. 2024-09-19T06:16:57.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.992+0000 7f9127200640 1 Processor -- start 2024-09-19T06:16:57.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.992+0000 7f9127200640 1 -- start start 2024-09-19T06:16:57.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.992+0000 7f9127200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9120074590 0x7f91201a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:57.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.992+0000 7f9127200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9120074eb0 0x7f91201a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:57.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.992+0000 7f9127200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9120112b90 0x7f912019e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:57.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.992+0000 7f9127200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9120118550 con 0x7f9120112b90 2024-09-19T06:16:57.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.992+0000 7f9127200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f91201183d0 con 0x7f9120074590 2024-09-19T06:16:57.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.992+0000 7f9127200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f91201186d0 con 0x7f9120074eb0 2024-09-19T06:16:57.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.993+0000 7f9125200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9120112b90 0x7f912019e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:57.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.993+0000 7f911fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9120074590 0x7f91201a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:57.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.993+0000 7f911fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9120074590 0x7f91201a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:39214/0 (socket says 172.21.15.3:39214) 2024-09-19T06:16:57.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.993+0000 7f911fe00640 1 -- 172.21.15.3:0/1487817297 learned_addr learned my addr 172.21.15.3:0/1487817297 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:57.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.993+0000 7f9125200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9120112b90 0x7f912019e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35630/0 (socket says 172.21.15.3:35630) 2024-09-19T06:16:57.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.993+0000 7f9117400640 1 --2- 172.21.15.3:0/1487817297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9120074eb0 0x7f91201a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:57.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.993+0000 7f9125200640 1 -- 172.21.15.3:0/1487817297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9120074eb0 msgr2=0x7f91201a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:57.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.993+0000 7f9125200640 1 --2- 172.21.15.3:0/1487817297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9120074eb0 0x7f91201a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:57.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.993+0000 7f9125200640 1 -- 172.21.15.3:0/1487817297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9120074590 msgr2=0x7f91201a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:57.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.993+0000 7f9125200640 1 --2- 172.21.15.3:0/1487817297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9120074590 0x7f91201a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:57.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.993+0000 7f9125200640 1 -- 172.21.15.3:0/1487817297 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f912019ef90 con 0x7f9120112b90 2024-09-19T06:16:57.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.993+0000 7f911fe00640 1 --2- 172.21.15.3:0/1487817297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9120074590 0x7f91201a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:57.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.994+0000 7f9125200640 1 --2- 172.21.15.3:0/1487817297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9120112b90 0x7f912019e860 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9118034040 tx=0x7f91180305d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:57.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.994+0000 7f911d600640 1 -- 172.21.15.3:0/1487817297 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9118041020 con 0x7f9120112b90 2024-09-19T06:16:57.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.994+0000 7f911d600640 1 -- 172.21.15.3:0/1487817297 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9118003e50 con 0x7f9120112b90 2024-09-19T06:16:57.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.994+0000 7f9127200640 1 -- 172.21.15.3:0/1487817297 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f912019f220 con 0x7f9120112b90 2024-09-19T06:16:57.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.994+0000 7f911d600640 1 -- 172.21.15.3:0/1487817297 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9118036040 con 0x7f9120112b90 2024-09-19T06:16:57.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.994+0000 7f9127200640 1 -- 172.21.15.3:0/1487817297 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91201ab570 con 0x7f9120112b90 2024-09-19T06:16:57.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.997+0000 7f911d600640 1 -- 172.21.15.3:0/1487817297 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f9118044020 con 0x7f9120112b90 2024-09-19T06:16:57.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.997+0000 7f9129c95740 1 Processor -- start 2024-09-19T06:16:57.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.998+0000 7f9129c95740 1 -- start start 2024-09-19T06:16:58.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.998+0000 7f9129c95740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585239b6c70 0x5585239b7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.998+0000 7f9129c95740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239b7590 0x5585239c1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.998+0000 7f9129c95740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239c1e50 0x5585239c4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.998+0000 7f9129c95740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55852391d3e0 con 0x5585239c1e50 2024-09-19T06:16:58.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.998+0000 7f9129c95740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5585238c4d80 con 0x5585239b7590 2024-09-19T06:16:58.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.998+0000 7f9129c95740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5585239193a0 con 0x5585239b6c70 2024-09-19T06:16:58.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.998+0000 7f9117400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585239b6c70 0x5585239b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.998+0000 7f9117400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239c1e50 0x5585239c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.998+0000 7f911fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239b7590 0x5585239c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.998+0000 7f911fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239b7590 0x5585239c1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:39228/0 (socket says 172.21.15.3:39228) 2024-09-19T06:16:58.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.998+0000 7f9117400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239c1e50 0x5585239c4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35634/0 (socket says 172.21.15.3:35634) 2024-09-19T06:16:58.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.999+0000 7f911fe00640 1 -- 172.21.15.3:0/3362594686 learned_addr learned my addr 172.21.15.3:0/3362594686 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:58.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.999+0000 7f911fe00640 1 -- 172.21.15.3:0/3362594686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585239b6c70 msgr2=0x5585239b7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:58.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.999+0000 7f911fe00640 1 --2- 172.21.15.3:0/3362594686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585239b6c70 0x5585239b7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.999+0000 7f911fe00640 1 -- 172.21.15.3:0/3362594686 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239c1e50 msgr2=0x5585239c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:58.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.999+0000 7f911fe00640 1 --2- 172.21.15.3:0/3362594686 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239c1e50 0x5585239c4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.999+0000 7f911fe00640 1 -- 172.21.15.3:0/3362594686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585238e3ae0 con 0x5585239b7590 2024-09-19T06:16:58.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.999+0000 7f911d600640 1 --2- 172.21.15.3:0/1487817297 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f91040a3430 0x7f91040a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:57.999+0000 7f911fe00640 1 --2- 172.21.15.3:0/3362594686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239b7590 0x5585239c1910 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f91100115f0 tx=0x7f9110011ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=322e71b3459c6f29 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:58.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.000+0000 7f911d600640 1 -- 172.21.15.3:0/1487817297 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f91180f07f0 con 0x7f9120112b90 2024-09-19T06:16:58.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.000+0000 7f9115600640 1 -- 172.21.15.3:0/3362594686 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9110004020 con 0x5585239b7590 2024-09-19T06:16:58.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.000+0000 7f9115600640 1 -- 172.21.15.3:0/3362594686 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9110005500 con 0x5585239b7590 2024-09-19T06:16:58.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.000+0000 7f9115600640 1 -- 172.21.15.3:0/3362594686 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9110004d90 con 0x5585239b7590 2024-09-19T06:16:58.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.000+0000 7f9117400640 1 --2- 172.21.15.3:0/1487817297 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f91040a3430 0x7f91040a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.000+0000 7f9129c95740 1 -- 172.21.15.3:0/3362594686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239b7590 msgr2=0x5585239c1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:58.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.000+0000 7f9129c95740 1 --2- 172.21.15.3:0/3362594686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239b7590 0x5585239c1910 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f91100115f0 tx=0x7f9110011ab0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.000+0000 7f9117400640 1 --2- 172.21.15.3:0/1487817297 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f91040a3430 0x7f91040a58f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x5585239b4580 tx=0x7f9108009260 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:58.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.000+0000 7f9129c95740 1 -- 172.21.15.3:0/3362594686 shutdown_connections 2024-09-19T06:16:58.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.000+0000 7f9129c95740 1 --2- 172.21.15.3:0/3362594686 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239c1e50 0x5585239c4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.000+0000 7f9129c95740 1 --2- 172.21.15.3:0/3362594686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239b7590 0x5585239c1910 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.000+0000 7f9129c95740 1 --2- 172.21.15.3:0/3362594686 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585239b6c70 0x5585239b7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.000+0000 7f9129c95740 1 -- 172.21.15.3:0/3362594686 >> 172.21.15.3:0/3362594686 conn(0x5585239b3200 msgr2=0x5585239b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:58.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.001+0000 7f9129c95740 1 -- 172.21.15.3:0/3362594686 shutdown_connections 2024-09-19T06:16:58.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.001+0000 7f9129c95740 1 -- 172.21.15.3:0/3362594686 wait complete. 2024-09-19T06:16:58.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.001+0000 7f9129c95740 1 -- start start 2024-09-19T06:16:58.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.001+0000 7f9129c95740 1 Processor -- start 2024-09-19T06:16:58.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.002+0000 7f9129c95740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239b6c70 0x5585239becf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.002+0000 7f9129c95740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585239b7590 0x5585239bf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.002+0000 7f9129c95740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239c1e50 0x5585239bf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.002+0000 7f9129c95740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5585239c4a20 con 0x5585239c1e50 2024-09-19T06:16:58.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.002+0000 7f9129c95740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5585238d80f0 con 0x5585239b6c70 2024-09-19T06:16:58.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.002+0000 7f9129c95740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5585239c4ba0 con 0x5585239b7590 2024-09-19T06:16:58.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.002+0000 7f9129c95740 10 client.0 _ll_register_callbacks cb 0x5585238bfbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:58.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.002+0000 7f911fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239b6c70 0x5585239becf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.002+0000 7f911fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239b6c70 0x5585239becf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:39238/0 (socket says 172.21.15.3:39238) 2024-09-19T06:16:58.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.002+0000 7f911fe00640 1 -- 172.21.15.3:0/2437227972 learned_addr learned my addr 172.21.15.3:0/2437227972 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:58.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.002+0000 7f9117400640 1 --2- 172.21.15.3:0/2437227972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585239b7590 0x5585239bf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.002+0000 7f9125200640 1 --2- 172.21.15.3:0/2437227972 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239c1e50 0x5585239bf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.003+0000 7f911fe00640 1 -- 172.21.15.3:0/2437227972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585239b7590 msgr2=0x5585239bf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:58.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.003+0000 7f911fe00640 1 --2- 172.21.15.3:0/2437227972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585239b7590 0x5585239bf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.003+0000 7f911fe00640 1 -- 172.21.15.3:0/2437227972 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239c1e50 msgr2=0x5585239bf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:58.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.003+0000 7f911fe00640 1 --2- 172.21.15.3:0/2437227972 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239c1e50 0x5585239bf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.003+0000 7f911fe00640 1 -- 172.21.15.3:0/2437227972 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55852368e3c0 con 0x5585239b6c70 2024-09-19T06:16:58.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.003+0000 7f9117400640 1 --2- 172.21.15.3:0/2437227972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585239b7590 0x5585239bf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:58.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.003+0000 7f911fe00640 1 --2- 172.21.15.3:0/2437227972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239b6c70 0x5585239becf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f91100115c0 tx=0x7f911000fd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=679ba8fb9a793db8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:58.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.003+0000 7f910e000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:16:58.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.003+0000 7f910e000640 1 -- 172.21.15.3:0/2437227972 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9110028020 con 0x5585239b6c70 2024-09-19T06:16:58.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.003+0000 7f9129c95740 1 -- 172.21.15.3:0/2437227972 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9110005500 con 0x5585239b6c70 2024-09-19T06:16:58.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.004+0000 7f910e000640 1 -- 172.21.15.3:0/2437227972 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f9110004af0 con 0x5585239b6c70 2024-09-19T06:16:58.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.004+0000 7f910e000640 1 -- 172.21.15.3:0/2437227972 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9110033050 con 0x5585239b6c70 2024-09-19T06:16:58.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.004+0000 7f9129c95740 10 client.26510 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:58.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.004+0000 7f9129c95740 1 -- 172.21.15.3:0/2437227972 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5585239d0a10 con 0x5585239b6c70 2024-09-19T06:16:58.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.004+0000 7f910e000640 1 -- 172.21.15.3:0/2437227972 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9110005500 con 0x5585239b6c70 2024-09-19T06:16:58.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.005+0000 7f910e000640 1 -- 172.21.15.3:0/2437227972 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9110023590 con 0x5585239b6c70 2024-09-19T06:16:58.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.005+0000 7f9129c95740 10 client.26510 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:58.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.005+0000 7f9129c95740 10 client.26510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:58.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.005+0000 7f9129c95740 20 client.26510 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:58.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.005+0000 7f9129c95740 1 --2- 172.21.15.3:0/2437227972 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5585239d1e20 0x5585239d4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.005+0000 7f9129c95740 4 client.26510 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:16:58.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.005+0000 7f9129c95740 1 -- 172.21.15.3:0/2437227972 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55852392a950 con 0x5585239d1e20 2024-09-19T06:16:58.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.005+0000 7f9117400640 1 --2- 172.21.15.3:0/2437227972 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5585239d1e20 0x5585239d4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.006+0000 7f9117400640 1 --2- 172.21.15.3:0/2437227972 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5585239d1e20 0x5585239d4210 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12677ecbc7cd5f80 server_cookie=b221301bf9390000 in_seq=0 out_seq=0 2024-09-19T06:16:58.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.006+0000 7f910e000640 10 client.26510 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:58.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.006+0000 7f910e000640 1 -- 172.21.15.3:0/2437227972 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55852392a950 con 0x5585239d1e20 2024-09-19T06:16:58.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.006+0000 7f910e000640 10 client.26510 handle_command_reply: tid=0 2024-09-19T06:16:58.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.007+0000 7f9129c95740 1 client.26510 shutdown 2024-09-19T06:16:58.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.007+0000 7f9129c95740 1 -- 172.21.15.3:0/2437227972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239b6c70 msgr2=0x5585239becf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:58.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.007+0000 7f9129c95740 1 --2- 172.21.15.3:0/2437227972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239b6c70 0x5585239becf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f91100115c0 tx=0x7f911000fd50 comp rx=0 tx=0).stop 2024-09-19T06:16:58.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.007+0000 7f9129c95740 1 -- 172.21.15.3:0/2437227972 shutdown_connections 2024-09-19T06:16:58.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.007+0000 7f9129c95740 1 --2- 172.21.15.3:0/2437227972 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5585239d1e20 0x5585239d4210 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.007+0000 7f9129c95740 1 --2- 172.21.15.3:0/2437227972 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239c1e50 0x5585239bf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.007+0000 7f9129c95740 1 --2- 172.21.15.3:0/2437227972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585239b7590 0x5585239bf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.007+0000 7f9129c95740 1 --2- 172.21.15.3:0/2437227972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239b6c70 0x5585239becf0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.007+0000 7f910e000640 0 client.26510 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:58.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.007+0000 7f9129c95740 1 -- 172.21.15.3:0/2437227972 >> 172.21.15.3:0/2437227972 conn(0x5585239b3200 msgr2=0x5585239b8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:58.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.007+0000 7f9129c95740 1 -- 172.21.15.3:0/2437227972 shutdown_connections 2024-09-19T06:16:58.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.007+0000 7f9129c95740 1 -- 172.21.15.3:0/2437227972 wait complete. 2024-09-19T06:16:58.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.007+0000 7f9129c95740 20 client.26510 trim_cache size 0 max 16384 2024-09-19T06:16:58.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.021+0000 7f9129c95740 1 Processor -- start 2024-09-19T06:16:58.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.021+0000 7f9129c95740 1 -- start start 2024-09-19T06:16:58.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.021+0000 7f9129c95740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239b6c70 0x5585239c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.021+0000 7f9129c95740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585239b7590 0x5585239be250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.021+0000 7f9129c95740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239c1e50 0x5585239d9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.021+0000 7f9129c95740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f91201b3f90 con 0x5585239b6c70 2024-09-19T06:16:58.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.021+0000 7f9129c95740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f91201b5ad0 con 0x5585239c1e50 2024-09-19T06:16:58.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.021+0000 7f9129c95740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f91201b4660 con 0x5585239b7590 2024-09-19T06:16:58.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.022+0000 7f911fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239b6c70 0x5585239c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.022+0000 7f911fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239b6c70 0x5585239c1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35658/0 (socket says 172.21.15.3:35658) 2024-09-19T06:16:58.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.022+0000 7f911fe00640 1 -- 172.21.15.3:0/50221349 learned_addr learned my addr 172.21.15.3:0/50221349 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:58.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.022+0000 7f9125200640 1 --2- 172.21.15.3:0/50221349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239c1e50 0x5585239d9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.022+0000 7f9117400640 1 --2- 172.21.15.3:0/50221349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585239b7590 0x5585239be250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.022+0000 7f9125200640 1 -- 172.21.15.3:0/50221349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585239b7590 msgr2=0x5585239be250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:58.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.022+0000 7f9125200640 1 --2- 172.21.15.3:0/50221349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585239b7590 0x5585239be250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.022+0000 7f9125200640 1 -- 172.21.15.3:0/50221349 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239b6c70 msgr2=0x5585239c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:58.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.022+0000 7f9125200640 1 --2- 172.21.15.3:0/50221349 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239b6c70 0x5585239c1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.022+0000 7f9125200640 1 -- 172.21.15.3:0/50221349 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585239b73c0 con 0x5585239c1e50 2024-09-19T06:16:58.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.022+0000 7f911fe00640 1 --2- 172.21.15.3:0/50221349 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239b6c70 0x5585239c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:58.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.022+0000 7f9125200640 1 --2- 172.21.15.3:0/50221349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239c1e50 0x5585239d9a70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f91180edee0 tx=0x7f91180bc670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb5423b6b49ccbd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:58.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.023+0000 7f9114c00640 1 -- 172.21.15.3:0/50221349 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91180d5070 con 0x5585239c1e50 2024-09-19T06:16:58.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.023+0000 7f9114c00640 1 -- 172.21.15.3:0/50221349 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91180c0e20 con 0x5585239c1e50 2024-09-19T06:16:58.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.023+0000 7f9114c00640 1 -- 172.21.15.3:0/50221349 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91180a7070 con 0x5585239c1e50 2024-09-19T06:16:58.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.023+0000 7f9129c95740 1 -- 172.21.15.3:0/50221349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239c1e50 msgr2=0x5585239d9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:58.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.023+0000 7f9129c95740 1 --2- 172.21.15.3:0/50221349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239c1e50 0x5585239d9a70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f91180edee0 tx=0x7f91180bc670 comp rx=0 tx=0).stop 2024-09-19T06:16:58.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.023+0000 7f9129c95740 1 -- 172.21.15.3:0/50221349 shutdown_connections 2024-09-19T06:16:58.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.023+0000 7f9129c95740 1 --2- 172.21.15.3:0/50221349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239c1e50 0x5585239d9a70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.023+0000 7f9129c95740 1 --2- 172.21.15.3:0/50221349 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585239b7590 0x5585239be250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.023+0000 7f9129c95740 1 --2- 172.21.15.3:0/50221349 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239b6c70 0x5585239c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.023+0000 7f9129c95740 1 -- 172.21.15.3:0/50221349 >> 172.21.15.3:0/50221349 conn(0x5585239b3200 msgr2=0x5585239b8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:58.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.023+0000 7f9129c95740 1 -- 172.21.15.3:0/50221349 shutdown_connections 2024-09-19T06:16:58.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.023+0000 7f9129c95740 1 -- 172.21.15.3:0/50221349 wait complete. 2024-09-19T06:16:58.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.024+0000 7f9129c95740 1 -- start start 2024-09-19T06:16:58.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.024+0000 7f9129c95740 1 Processor -- start 2024-09-19T06:16:58.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.024+0000 7f9129c95740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585239b6c70 0x5585239ca150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.024+0000 7f9129c95740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239b7590 0x5585239ca690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.024+0000 7f9129c95740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239c1e50 0x5585239c5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.024+0000 7f9129c95740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f91201b5400 con 0x5585239b7590 2024-09-19T06:16:58.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.024+0000 7f9129c95740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f91201b4d30 con 0x5585239c1e50 2024-09-19T06:16:58.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.025+0000 7f9129c95740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f91201b1f70 con 0x5585239b6c70 2024-09-19T06:16:58.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.025+0000 7f9129c95740 10 client.0 _ll_register_callbacks cb 0x7f9108009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:16:58.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.025+0000 7f9117400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239b7590 0x5585239ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.025+0000 7f9125200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239c1e50 0x5585239c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.025+0000 7f911fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585239b6c70 0x5585239ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.025+0000 7f9117400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239b7590 0x5585239ca690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35660/0 (socket says 172.21.15.3:35660) 2024-09-19T06:16:58.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.025+0000 7f9117400640 1 -- 172.21.15.3:0/3092093684 learned_addr learned my addr 172.21.15.3:0/3092093684 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:16:58.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.025+0000 7f9117400640 1 -- 172.21.15.3:0/3092093684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585239b6c70 msgr2=0x5585239ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:58.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.025+0000 7f9117400640 1 --2- 172.21.15.3:0/3092093684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585239b6c70 0x5585239ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.025+0000 7f9117400640 1 -- 172.21.15.3:0/3092093684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239c1e50 msgr2=0x5585239c5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:16:58.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.025+0000 7f9117400640 1 --2- 172.21.15.3:0/3092093684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239c1e50 0x5585239c5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.025+0000 7f9117400640 1 -- 172.21.15.3:0/3092093684 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585239c5f50 con 0x5585239b7590 2024-09-19T06:16:58.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.025+0000 7f911fe00640 1 --2- 172.21.15.3:0/3092093684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585239b6c70 0x5585239ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:16:58.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.026+0000 7f9117400640 1 --2- 172.21.15.3:0/3092093684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239b7590 0x5585239ca690 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9108009530 tx=0x7f9108004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24194fb3631a4b11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:16:58.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.026+0000 7f910e000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:16:58.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.026+0000 7f910e000640 1 -- 172.21.15.3:0/3092093684 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9108005020 con 0x5585239b7590 2024-09-19T06:16:58.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.026+0000 7f910e000640 1 -- 172.21.15.3:0/3092093684 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f910801c070 con 0x5585239b7590 2024-09-19T06:16:58.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.026+0000 7f9129c95740 1 -- 172.21.15.3:0/3092093684 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91180c0e20 con 0x5585239b7590 2024-09-19T06:16:58.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.026+0000 7f910e000640 1 -- 172.21.15.3:0/3092093684 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f91080051c0 con 0x5585239b7590 2024-09-19T06:16:58.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.026+0000 7f9129c95740 10 client.16473 fetch_fsmap learned FSMap version 29 2024-09-19T06:16:58.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.026+0000 7f9129c95740 1 -- 172.21.15.3:0/3092093684 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558523a3c6c0 con 0x5585239b7590 2024-09-19T06:16:58.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.027+0000 7f910e000640 1 -- 172.21.15.3:0/3092093684 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91180c0e20 con 0x5585239b7590 2024-09-19T06:16:58.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.027+0000 7f910e000640 1 -- 172.21.15.3:0/3092093684 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f910802b050 con 0x5585239b7590 2024-09-19T06:16:58.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.027+0000 7f9129c95740 10 client.16473 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:16:58.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.027+0000 7f9129c95740 10 client.16473 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:16:58.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.027+0000 7f9129c95740 20 client.16473 populate_metadata read hostname 'smithi003' 2024-09-19T06:16:58.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.027+0000 7f9129c95740 1 --2- 172.21.15.3:0/3092093684 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558523a3cda0 0x558523a3f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:16:58.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.027+0000 7f9129c95740 4 client.16473 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:16:58.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.027+0000 7f9129c95740 1 -- 172.21.15.3:0/3092093684 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558523924e60 con 0x558523a3cda0 2024-09-19T06:16:58.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.027+0000 7f911fe00640 1 --2- 172.21.15.3:0/3092093684 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558523a3cda0 0x558523a3f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:16:58.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.028+0000 7f911fe00640 1 --2- 172.21.15.3:0/3092093684 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558523a3cda0 0x558523a3f1c0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c5307c2ecfacf23 server_cookie=37efcb34e04d98ff in_seq=0 out_seq=0 2024-09-19T06:16:58.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.028+0000 7f910e000640 10 client.16473 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:58.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.028+0000 7f910e000640 1 -- 172.21.15.3:0/3092093684 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558523924e60 con 0x558523a3cda0 2024-09-19T06:16:58.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.028+0000 7f910e000640 10 client.16473 handle_command_reply: tid=0 2024-09-19T06:16:58.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.028+0000 7f9129c95740 1 client.16473 shutdown 2024-09-19T06:16:58.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.028+0000 7f9129c95740 1 -- 172.21.15.3:0/3092093684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239b7590 msgr2=0x5585239ca690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:58.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.028+0000 7f9129c95740 1 --2- 172.21.15.3:0/3092093684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239b7590 0x5585239ca690 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9108009530 tx=0x7f9108004730 comp rx=0 tx=0).stop 2024-09-19T06:16:58.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.028+0000 7f9129c95740 1 -- 172.21.15.3:0/3092093684 shutdown_connections 2024-09-19T06:16:58.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.028+0000 7f9129c95740 1 --2- 172.21.15.3:0/3092093684 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558523a3cda0 0x558523a3f1c0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.028+0000 7f9129c95740 1 --2- 172.21.15.3:0/3092093684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5585239c1e50 0x5585239c5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.028+0000 7f9129c95740 1 --2- 172.21.15.3:0/3092093684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5585239b7590 0x5585239ca690 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.028+0000 7f9129c95740 1 --2- 172.21.15.3:0/3092093684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5585239b6c70 0x5585239ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.028+0000 7f9129c95740 1 -- 172.21.15.3:0/3092093684 >> 172.21.15.3:0/3092093684 conn(0x5585239b3200 msgr2=0x5585239b1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:58.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.028+0000 7f910e000640 0 client.16473 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:16:58.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.029+0000 7f9129c95740 1 -- 172.21.15.3:0/3092093684 shutdown_connections 2024-09-19T06:16:58.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.029+0000 7f9129c95740 1 -- 172.21.15.3:0/3092093684 wait complete. 2024-09-19T06:16:58.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.029+0000 7f9129c95740 20 client.16473 trim_cache size 0 max 16384 2024-09-19T06:16:58.035 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:16:58.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.029+0000 7f9127200640 1 -- 172.21.15.3:0/1487817297 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f91040a3430 msgr2=0x7f91040a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:58.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.029+0000 7f9127200640 1 --2- 172.21.15.3:0/1487817297 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f91040a3430 0x7f91040a58f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x5585239b4580 tx=0x7f9108009260 comp rx=0 tx=0).stop 2024-09-19T06:16:58.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.029+0000 7f9127200640 1 -- 172.21.15.3:0/1487817297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9120112b90 msgr2=0x7f912019e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:16:58.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.029+0000 7f9127200640 1 --2- 172.21.15.3:0/1487817297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9120112b90 0x7f912019e860 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9118034040 tx=0x7f91180305d0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.029+0000 7f9127200640 1 -- 172.21.15.3:0/1487817297 shutdown_connections 2024-09-19T06:16:58.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.029+0000 7f9127200640 1 --2- 172.21.15.3:0/1487817297 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f91040a3430 0x7f91040a58f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.029+0000 7f9127200640 1 --2- 172.21.15.3:0/1487817297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9120112b90 0x7f912019e860 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.029+0000 7f9127200640 1 --2- 172.21.15.3:0/1487817297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9120074eb0 0x7f91201a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.029+0000 7f9127200640 1 --2- 172.21.15.3:0/1487817297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9120074590 0x7f91201a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:16:58.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.029+0000 7f9127200640 1 -- 172.21.15.3:0/1487817297 >> 172.21.15.3:0/1487817297 conn(0x7f91200fd8c0 msgr2=0x7f91200fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:16:58.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.030+0000 7f9127200640 1 -- 172.21.15.3:0/1487817297 shutdown_connections 2024-09-19T06:16:58.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:16:58.030+0000 7f9127200640 1 -- 172.21.15.3:0/1487817297 wait complete. 2024-09-19T06:16:58.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:16:58 smithi059 ceph-mon[35138]: pgmap v140: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 KiB/s wr, 15 op/s 2024-09-19T06:16:58.547 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:16:58 smithi003 ceph-mon[30893]: pgmap v140: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 KiB/s wr, 15 op/s 2024-09-19T06:16:58.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:16:58 smithi071 ceph-mon[35662]: pgmap v140: 97 pgs: 97 active+clean; 2.0 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 KiB/s wr, 15 op/s 2024-09-19T06:17:00.074 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:17:00.075 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:17:00.424 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:00 smithi003 ceph-mon[30893]: pgmap v141: 97 pgs: 97 active+clean; 2.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:17:00.474 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:17:00.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:00 smithi059 ceph-mon[35138]: pgmap v141: 97 pgs: 97 active+clean; 2.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:17:00.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:00 smithi071 ceph-mon[35662]: pgmap v141: 97 pgs: 97 active+clean; 2.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T06:17:01.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.090+0000 7f92c9600640 1 -- 172.21.15.3:0/3656222962 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92c4077040 msgr2=0x7f92c4112510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:01.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.090+0000 7f92c9600640 1 --2- 172.21.15.3:0/3656222962 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92c4077040 0x7f92c4112510 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f92b0009900 tx=0x7f92b002a410 comp rx=0 tx=0).stop 2024-09-19T06:17:01.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.090+0000 7f92c9600640 1 -- 172.21.15.3:0/3656222962 shutdown_connections 2024-09-19T06:17:01.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.090+0000 7f92c9600640 1 --2- 172.21.15.3:0/3656222962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92c4112a50 0x7f92c4114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.090+0000 7f92c9600640 1 --2- 172.21.15.3:0/3656222962 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92c4077040 0x7f92c4112510 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.090+0000 7f92c9600640 1 --2- 172.21.15.3:0/3656222962 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92c4076720 0x7f92c4076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.090+0000 7f92c9600640 1 -- 172.21.15.3:0/3656222962 >> 172.21.15.3:0/3656222962 conn(0x7f92c40ffa50 msgr2=0x7f92c4101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:01.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.091+0000 7f92c9600640 1 -- 172.21.15.3:0/3656222962 shutdown_connections 2024-09-19T06:17:01.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.091+0000 7f92c9600640 1 -- 172.21.15.3:0/3656222962 wait complete. 2024-09-19T06:17:01.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.092+0000 7f92c9600640 1 Processor -- start 2024-09-19T06:17:01.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.092+0000 7f92c9600640 1 -- start start 2024-09-19T06:17:01.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.092+0000 7f92c9600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92c4076720 0x7f92c41a47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:01.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.092+0000 7f92c9600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92c4077040 0x7f92c41a4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:01.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.092+0000 7f92c9600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92c4112a50 0x7f92c419e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:01.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.092+0000 7f92c9600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f92c41185e0 con 0x7f92c4076720 2024-09-19T06:17:01.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.092+0000 7f92c9600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f92c4118460 con 0x7f92c4112a50 2024-09-19T06:17:01.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.092+0000 7f92c9600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f92c4118760 con 0x7f92c4077040 2024-09-19T06:17:01.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.092+0000 7f92c2a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92c4076720 0x7f92c41a47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:01.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.092+0000 7f92c2a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92c4076720 0x7f92c41a47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35670/0 (socket says 172.21.15.3:35670) 2024-09-19T06:17:01.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.093+0000 7f92c2a00640 1 -- 172.21.15.3:0/211114614 learned_addr learned my addr 172.21.15.3:0/211114614 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:01.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.093+0000 7f92c3400640 1 --2- 172.21.15.3:0/211114614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92c4112a50 0x7f92c419e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:01.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.093+0000 7f92c2000640 1 --2- 172.21.15.3:0/211114614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92c4077040 0x7f92c41a4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:01.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.093+0000 7f92c2a00640 1 -- 172.21.15.3:0/211114614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92c4077040 msgr2=0x7f92c41a4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:01.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.093+0000 7f92c2a00640 1 --2- 172.21.15.3:0/211114614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92c4077040 0x7f92c41a4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.093+0000 7f92c2a00640 1 -- 172.21.15.3:0/211114614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92c4112a50 msgr2=0x7f92c419e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:01.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.093+0000 7f92c2a00640 1 --2- 172.21.15.3:0/211114614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92c4112a50 0x7f92c419e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.093+0000 7f92c2a00640 1 -- 172.21.15.3:0/211114614 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c419f0e0 con 0x7f92c4076720 2024-09-19T06:17:01.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.093+0000 7f92c2a00640 1 --2- 172.21.15.3:0/211114614 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92c4076720 0x7f92c41a47f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f92b400e9f0 tx=0x7f92b400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:01.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.094+0000 7f92bb400640 1 -- 172.21.15.3:0/211114614 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b400cd80 con 0x7f92c4076720 2024-09-19T06:17:01.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.094+0000 7f92bb400640 1 -- 172.21.15.3:0/211114614 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92b4005500 con 0x7f92c4076720 2024-09-19T06:17:01.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.094+0000 7f92c9600640 1 -- 172.21.15.3:0/211114614 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92c419f3d0 con 0x7f92c4076720 2024-09-19T06:17:01.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.094+0000 7f92bb400640 1 -- 172.21.15.3:0/211114614 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b4010690 con 0x7f92c4076720 2024-09-19T06:17:01.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.094+0000 7f92c9600640 1 -- 172.21.15.3:0/211114614 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92c41ab6c0 con 0x7f92c4076720 2024-09-19T06:17:01.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.097+0000 7f92bb400640 1 -- 172.21.15.3:0/211114614 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f92b40046c0 con 0x7f92c4076720 2024-09-19T06:17:01.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.098+0000 7f92cc038740 1 Processor -- start 2024-09-19T06:17:01.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.098+0000 7f92cc038740 1 -- start start 2024-09-19T06:17:01.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.098+0000 7f92cc038740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bbac0 0x561cd32bbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:01.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.098+0000 7f92cc038740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cd32bc3e0 0x561cd32c6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:01.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.098+0000 7f92cc038740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cd32c6ca0 0x561cd32c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:01.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.098+0000 7f92cc038740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561cd3222290 con 0x561cd32bc3e0 2024-09-19T06:17:01.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.098+0000 7f92cc038740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561cd31c9b40 con 0x561cd32bbac0 2024-09-19T06:17:01.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.098+0000 7f92cc038740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561cd321e250 con 0x561cd32c6ca0 2024-09-19T06:17:01.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.099+0000 7f92c3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bbac0 0x561cd32bbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:01.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.099+0000 7f92c2a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cd32bc3e0 0x561cd32c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:01.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.099+0000 7f92c3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bbac0 0x561cd32bbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:39288/0 (socket says 172.21.15.3:39288) 2024-09-19T06:17:01.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.099+0000 7f92c3400640 1 -- 172.21.15.3:0/1067598928 learned_addr learned my addr 172.21.15.3:0/1067598928 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:01.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.099+0000 7f92c2000640 1 --2- 172.21.15.3:0/1067598928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cd32c6ca0 0x561cd32c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:01.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.099+0000 7f92c3400640 1 -- 172.21.15.3:0/1067598928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cd32c6ca0 msgr2=0x561cd32c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:01.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.099+0000 7f92c3400640 1 --2- 172.21.15.3:0/1067598928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cd32c6ca0 0x561cd32c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.099+0000 7f92c3400640 1 -- 172.21.15.3:0/1067598928 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cd32bc3e0 msgr2=0x561cd32c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:01.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.099+0000 7f92c3400640 1 --2- 172.21.15.3:0/1067598928 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cd32bc3e0 0x561cd32c6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.099+0000 7f92c3400640 1 -- 172.21.15.3:0/1067598928 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cd2f936a0 con 0x561cd32bbac0 2024-09-19T06:17:01.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.100+0000 7f92bb400640 1 --2- 172.21.15.3:0/211114614 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f92a80a3430 0x7f92a80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:01.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.100+0000 7f92c3400640 1 --2- 172.21.15.3:0/1067598928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bbac0 0x561cd32bbea0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009f30 tx=0x7f92bc0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b5cfe49ff03ca4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:01.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.100+0000 7f92bb400640 1 -- 172.21.15.3:0/211114614 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f92b40d0100 con 0x7f92c4076720 2024-09-19T06:17:01.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.100+0000 7f92af400640 1 -- 172.21.15.3:0/1067598928 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc004d20 con 0x561cd32bbac0 2024-09-19T06:17:01.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.100+0000 7f92af400640 1 -- 172.21.15.3:0/1067598928 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92bc004050 con 0x561cd32bbac0 2024-09-19T06:17:01.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.100+0000 7f92af400640 1 -- 172.21.15.3:0/1067598928 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc005280 con 0x561cd32bbac0 2024-09-19T06:17:01.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.100+0000 7f92c2a00640 1 --2- 172.21.15.3:0/211114614 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f92a80a3430 0x7f92a80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:01.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.101+0000 7f92cc038740 1 -- 172.21.15.3:0/1067598928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bbac0 msgr2=0x561cd32bbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:01.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.101+0000 7f92c2a00640 1 --2- 172.21.15.3:0/211114614 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f92a80a3430 0x7f92a80a58f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x561cd32b8eb0 tx=0x7f92b40bc040 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:01.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.101+0000 7f92cc038740 1 --2- 172.21.15.3:0/1067598928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bbac0 0x561cd32bbea0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009f30 tx=0x7f92bc0118d0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.101+0000 7f92cc038740 1 -- 172.21.15.3:0/1067598928 shutdown_connections 2024-09-19T06:17:01.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.101+0000 7f92cc038740 1 --2- 172.21.15.3:0/1067598928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cd32c6ca0 0x561cd32c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.101+0000 7f92cc038740 1 --2- 172.21.15.3:0/1067598928 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cd32bc3e0 0x561cd32c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.101+0000 7f92cc038740 1 --2- 172.21.15.3:0/1067598928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bbac0 0x561cd32bbea0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.101+0000 7f92cc038740 1 -- 172.21.15.3:0/1067598928 >> 172.21.15.3:0/1067598928 conn(0x561cd32b8050 msgr2=0x561cd32b8430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:01.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.101+0000 7f92cc038740 1 -- 172.21.15.3:0/1067598928 shutdown_connections 2024-09-19T06:17:01.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.101+0000 7f92cc038740 1 -- 172.21.15.3:0/1067598928 wait complete. 2024-09-19T06:17:01.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.102+0000 7f92cc038740 1 -- start start 2024-09-19T06:17:01.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.102+0000 7f92cc038740 1 Processor -- start 2024-09-19T06:17:01.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.103+0000 7f92cc038740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bbac0 0x561cd32c6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:01.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.103+0000 7f92cc038740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cd32bc3e0 0x561cd32c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:01.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.103+0000 7f92cc038740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cd32c6ca0 0x561cd32c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:01.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.103+0000 7f92cc038740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561cd32c9910 con 0x561cd32bc3e0 2024-09-19T06:17:01.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.103+0000 7f92cc038740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561cd31dcfa0 con 0x561cd32bbac0 2024-09-19T06:17:01.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.103+0000 7f92cc038740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561cd32c9a90 con 0x561cd32c6ca0 2024-09-19T06:17:01.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.103+0000 7f92cc038740 10 client.0 _ll_register_callbacks cb 0x561cd2f30ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:01.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.103+0000 7f92c3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bbac0 0x561cd32c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:01.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.103+0000 7f92c2000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cd32bc3e0 0x561cd32c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:01.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.103+0000 7f92c3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bbac0 0x561cd32c6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:39300/0 (socket says 172.21.15.3:39300) 2024-09-19T06:17:01.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.103+0000 7f92c3400640 1 -- 172.21.15.3:0/3877029816 learned_addr learned my addr 172.21.15.3:0/3877029816 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:01.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.103+0000 7f92c3400640 1 --2- 172.21.15.3:0/3877029816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cd32c6ca0 0x561cd32c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:01.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.104+0000 7f92c2000640 1 -- 172.21.15.3:0/3877029816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cd32c6ca0 msgr2=0x561cd32c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:01.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.104+0000 7f92c2000640 1 --2- 172.21.15.3:0/3877029816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cd32c6ca0 0x561cd32c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.104+0000 7f92c2000640 1 -- 172.21.15.3:0/3877029816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bbac0 msgr2=0x561cd32c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:01.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.104+0000 7f92c2000640 1 --2- 172.21.15.3:0/3877029816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bbac0 0x561cd32c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.104+0000 7f92c2000640 1 -- 172.21.15.3:0/3877029816 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cd32c4640 con 0x561cd32bc3e0 2024-09-19T06:17:01.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.104+0000 7f92c2000640 1 --2- 172.21.15.3:0/3877029816 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cd32bc3e0 0x561cd32c38b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f92b0005940 tx=0x7f92b00317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569e8f92ad4f18f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:01.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.104+0000 7f92a3e00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:17:01.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.104+0000 7f92a3e00640 1 -- 172.21.15.3:0/3877029816 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b0035040 con 0x561cd32bc3e0 2024-09-19T06:17:01.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.104+0000 7f92a3e00640 1 -- 172.21.15.3:0/3877029816 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f92b0004240 con 0x561cd32bc3e0 2024-09-19T06:17:01.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.104+0000 7f92cc038740 1 -- 172.21.15.3:0/3877029816 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92bc004050 con 0x561cd32bc3e0 2024-09-19T06:17:01.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.105+0000 7f92a3e00640 1 -- 172.21.15.3:0/3877029816 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f92b0031a10 con 0x561cd32bc3e0 2024-09-19T06:17:01.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.105+0000 7f92cc038740 10 client.16485 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:01.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.105+0000 7f92cc038740 1 -- 172.21.15.3:0/3877029816 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561cd32d5850 con 0x561cd32bc3e0 2024-09-19T06:17:01.113 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.105+0000 7f92a3e00640 1 -- 172.21.15.3:0/3877029816 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92bc004050 con 0x561cd32bc3e0 2024-09-19T06:17:01.113 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.105+0000 7f92a3e00640 1 -- 172.21.15.3:0/3877029816 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f92b0004b00 con 0x561cd32bc3e0 2024-09-19T06:17:01.113 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.105+0000 7f92cc038740 10 client.16485 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:01.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.105+0000 7f92cc038740 10 client.16485 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:01.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.105+0000 7f92cc038740 20 client.16485 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:01.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.105+0000 7f92cc038740 1 --2- 172.21.15.3:0/3877029816 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x561cd32d6d10 0x561cd32d9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:01.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.105+0000 7f92cc038740 4 client.16485 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:17:01.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.105+0000 7f92cc038740 1 -- 172.21.15.3:0/3877029816 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561cd322f800 con 0x561cd32d6d10 2024-09-19T06:17:01.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.106+0000 7f92c3400640 1 --2- 172.21.15.3:0/3877029816 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x561cd32d6d10 0x561cd32d9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:01.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.106+0000 7f92c3400640 1 --2- 172.21.15.3:0/3877029816 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x561cd32d6d10 0x561cd32d9120 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bafe00098773ac3e server_cookie=34a9a58b08c0b47f in_seq=0 out_seq=0 2024-09-19T06:17:01.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.106+0000 7f92a3e00640 10 client.16485 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:01.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.107+0000 7f92a3e00640 1 -- 172.21.15.3:0/3877029816 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561cd322f800 con 0x561cd32d6d10 2024-09-19T06:17:01.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.107+0000 7f92a3e00640 10 client.16485 handle_command_reply: tid=0 2024-09-19T06:17:01.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.107+0000 7f92cc038740 1 client.16485 shutdown 2024-09-19T06:17:01.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.108+0000 7f92cc038740 1 -- 172.21.15.3:0/3877029816 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cd32bc3e0 msgr2=0x561cd32c38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:01.116 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.108+0000 7f92cc038740 1 --2- 172.21.15.3:0/3877029816 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cd32bc3e0 0x561cd32c38b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f92b0005940 tx=0x7f92b00317e0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.116 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.108+0000 7f92cc038740 1 -- 172.21.15.3:0/3877029816 shutdown_connections 2024-09-19T06:17:01.116 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.108+0000 7f92cc038740 1 --2- 172.21.15.3:0/3877029816 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x561cd32d6d10 0x561cd32d9120 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.116 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.108+0000 7f92cc038740 1 --2- 172.21.15.3:0/3877029816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cd32c6ca0 0x561cd32c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.116 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.108+0000 7f92cc038740 1 --2- 172.21.15.3:0/3877029816 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cd32bc3e0 0x561cd32c38b0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.116 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.108+0000 7f92cc038740 1 --2- 172.21.15.3:0/3877029816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bbac0 0x561cd32c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.116 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.108+0000 7f92a3e00640 0 client.16485 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:01.116 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.108+0000 7f92cc038740 1 -- 172.21.15.3:0/3877029816 >> 172.21.15.3:0/3877029816 conn(0x561cd32b8050 msgr2=0x561cd32bdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:01.116 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.108+0000 7f92cc038740 1 -- 172.21.15.3:0/3877029816 shutdown_connections 2024-09-19T06:17:01.117 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.108+0000 7f92cc038740 1 -- 172.21.15.3:0/3877029816 wait complete. 2024-09-19T06:17:01.117 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.108+0000 7f92cc038740 20 client.16485 trim_cache size 0 max 16384 2024-09-19T06:17:01.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.126+0000 7f92cc038740 1 Processor -- start 2024-09-19T06:17:01.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.127+0000 7f92cc038740 1 -- start start 2024-09-19T06:17:01.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.127+0000 7f92cc038740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cd32bbac0 0x561cd32c5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:01.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.127+0000 7f92cc038740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bc3e0 0x561cd32de9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:01.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.127+0000 7f92cc038740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cd32c6ca0 0x561cd32def30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:01.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.127+0000 7f92cc038740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f92c41b3ef0 con 0x561cd32bbac0 2024-09-19T06:17:01.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.127+0000 7f92cc038740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f92c41b5a30 con 0x561cd32bc3e0 2024-09-19T06:17:01.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.127+0000 7f92cc038740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f92c41b45c0 con 0x561cd32c6ca0 2024-09-19T06:17:01.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.127+0000 7f92c3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cd32bbac0 0x561cd32c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:01.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.127+0000 7f92c3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cd32bbac0 0x561cd32c5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35710/0 (socket says 172.21.15.3:35710) 2024-09-19T06:17:01.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.127+0000 7f92c3400640 1 -- 172.21.15.3:0/2649109655 learned_addr learned my addr 172.21.15.3:0/2649109655 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:01.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.127+0000 7f92c2000640 1 --2- 172.21.15.3:0/2649109655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bc3e0 0x561cd32de9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:01.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.128+0000 7f92c3400640 1 --2- 172.21.15.3:0/2649109655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cd32c6ca0 0x561cd32def30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:01.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.128+0000 7f92c3400640 1 -- 172.21.15.3:0/2649109655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cd32c6ca0 msgr2=0x561cd32def30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:01.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.128+0000 7f92c3400640 1 --2- 172.21.15.3:0/2649109655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cd32c6ca0 0x561cd32def30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.128+0000 7f92c3400640 1 -- 172.21.15.3:0/2649109655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bc3e0 msgr2=0x561cd32de9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:01.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.128+0000 7f92c3400640 1 --2- 172.21.15.3:0/2649109655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bc3e0 0x561cd32de9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.128+0000 7f92c3400640 1 -- 172.21.15.3:0/2649109655 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cd32c5d60 con 0x561cd32bbac0 2024-09-19T06:17:01.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.128+0000 7f92c3400640 1 --2- 172.21.15.3:0/2649109655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cd32bbac0 0x561cd32c5820 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0049d0 tx=0x7f92bc009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be1d1371d5a9ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:01.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.128+0000 7f92aea00640 1 -- 172.21.15.3:0/2649109655 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc004480 con 0x561cd32bbac0 2024-09-19T06:17:01.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.128+0000 7f92aea00640 1 -- 172.21.15.3:0/2649109655 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92bc004820 con 0x561cd32bbac0 2024-09-19T06:17:01.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.128+0000 7f92aea00640 1 -- 172.21.15.3:0/2649109655 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92bc005860 con 0x561cd32bbac0 2024-09-19T06:17:01.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.129+0000 7f92cc038740 1 -- 172.21.15.3:0/2649109655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cd32bbac0 msgr2=0x561cd32c5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:01.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.129+0000 7f92cc038740 1 --2- 172.21.15.3:0/2649109655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cd32bbac0 0x561cd32c5820 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0049d0 tx=0x7f92bc009500 comp rx=0 tx=0).stop 2024-09-19T06:17:01.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.129+0000 7f92cc038740 1 -- 172.21.15.3:0/2649109655 shutdown_connections 2024-09-19T06:17:01.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.129+0000 7f92cc038740 1 --2- 172.21.15.3:0/2649109655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cd32c6ca0 0x561cd32def30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.129+0000 7f92cc038740 1 --2- 172.21.15.3:0/2649109655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bc3e0 0x561cd32de9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.129+0000 7f92cc038740 1 --2- 172.21.15.3:0/2649109655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cd32bbac0 0x561cd32c5820 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.129+0000 7f92cc038740 1 -- 172.21.15.3:0/2649109655 >> 172.21.15.3:0/2649109655 conn(0x561cd32b8050 msgr2=0x561cd32c5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:01.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.129+0000 7f92cc038740 1 -- 172.21.15.3:0/2649109655 shutdown_connections 2024-09-19T06:17:01.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.129+0000 7f92cc038740 1 -- 172.21.15.3:0/2649109655 wait complete. 2024-09-19T06:17:01.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.130+0000 7f92cc038740 1 -- start start 2024-09-19T06:17:01.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.130+0000 7f92cc038740 1 Processor -- start 2024-09-19T06:17:01.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.130+0000 7f92cc038740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cd32bbac0 0x561cd32ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:01.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.130+0000 7f92cc038740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bc3e0 0x561cd32cd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:01.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.130+0000 7f92cc038740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cd32c6ca0 0x561cd32cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:01.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.130+0000 7f92cc038740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f92c41b5360 con 0x561cd32bbac0 2024-09-19T06:17:01.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.130+0000 7f92cc038740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f92c41b4c90 con 0x561cd32bc3e0 2024-09-19T06:17:01.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.130+0000 7f92cc038740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f92c41b1ed0 con 0x561cd32c6ca0 2024-09-19T06:17:01.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.130+0000 7f92cc038740 10 client.0 _ll_register_callbacks cb 0x561cd32c4810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:01.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.131+0000 7f92c2000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bc3e0 0x561cd32cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:01.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.131+0000 7f92c3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cd32bbac0 0x561cd32ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:01.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.131+0000 7f92c2000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bc3e0 0x561cd32cd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:39326/0 (socket says 172.21.15.3:39326) 2024-09-19T06:17:01.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.131+0000 7f92c2000640 1 -- 172.21.15.3:0/2425437501 learned_addr learned my addr 172.21.15.3:0/2425437501 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:01.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.131+0000 7f92c3400640 1 --2- 172.21.15.3:0/2425437501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cd32c6ca0 0x561cd32cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:01.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.131+0000 7f92c2000640 1 -- 172.21.15.3:0/2425437501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cd32c6ca0 msgr2=0x561cd32cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:01.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.131+0000 7f92c2000640 1 --2- 172.21.15.3:0/2425437501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cd32c6ca0 0x561cd32cd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.131+0000 7f92c2000640 1 -- 172.21.15.3:0/2425437501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cd32bbac0 msgr2=0x561cd32ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:01.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.131+0000 7f92c2000640 1 --2- 172.21.15.3:0/2425437501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cd32bbac0 0x561cd32ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.131+0000 7f92c2000640 1 -- 172.21.15.3:0/2425437501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cd3340bd0 con 0x561cd32bc3e0 2024-09-19T06:17:01.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.132+0000 7f92c2000640 1 --2- 172.21.15.3:0/2425437501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bc3e0 0x561cd32cd160 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f92b0031550 tx=0x7f92b00038c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=506bb5f05d3e021c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:01.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.132+0000 7f92a3e00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:17:01.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.132+0000 7f92a3e00640 1 -- 172.21.15.3:0/2425437501 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b0053070 con 0x561cd32bc3e0 2024-09-19T06:17:01.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.132+0000 7f92a3e00640 1 -- 172.21.15.3:0/2425437501 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f92b00053e0 con 0x561cd32bc3e0 2024-09-19T06:17:01.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.132+0000 7f92cc038740 1 -- 172.21.15.3:0/2425437501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92bc004820 con 0x561cd32bc3e0 2024-09-19T06:17:01.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.132+0000 7f92a3e00640 1 -- 172.21.15.3:0/2425437501 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f92b0065050 con 0x561cd32bc3e0 2024-09-19T06:17:01.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.132+0000 7f92cc038740 10 client.26534 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:01.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.132+0000 7f92cc038740 1 -- 172.21.15.3:0/2425437501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561cd3341eb0 con 0x561cd32bc3e0 2024-09-19T06:17:01.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.133+0000 7f92a3e00640 1 -- 172.21.15.3:0/2425437501 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92bc004820 con 0x561cd32bc3e0 2024-09-19T06:17:01.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.133+0000 7f92a3e00640 1 -- 172.21.15.3:0/2425437501 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f92b0060030 con 0x561cd32bc3e0 2024-09-19T06:17:01.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.133+0000 7f92cc038740 10 client.26534 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:01.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.133+0000 7f92cc038740 10 client.26534 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:01.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.133+0000 7f92cc038740 20 client.26534 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:01.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.133+0000 7f92cc038740 1 --2- 172.21.15.3:0/2425437501 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x561cd3342590 0x561cd33449b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:01.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.133+0000 7f92cc038740 4 client.26534 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:17:01.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.133+0000 7f92cc038740 1 -- 172.21.15.3:0/2425437501 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561cd3229d10 con 0x561cd3342590 2024-09-19T06:17:01.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.133+0000 7f92c3400640 1 --2- 172.21.15.3:0/2425437501 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x561cd3342590 0x561cd33449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.134+0000 7f92c3400640 1 --2- 172.21.15.3:0/2425437501 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x561cd3342590 0x561cd33449b0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60708ff17a3399d4 server_cookie=dde631766fdd63db in_seq=0 out_seq=0 2024-09-19T06:17:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.134+0000 7f92a3e00640 10 client.26534 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.135+0000 7f92a3e00640 1 -- 172.21.15.3:0/2425437501 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561cd3229d10 con 0x561cd3342590 2024-09-19T06:17:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.135+0000 7f92a3e00640 10 client.26534 handle_command_reply: tid=0 2024-09-19T06:17:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.135+0000 7f92cc038740 1 client.26534 shutdown 2024-09-19T06:17:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.135+0000 7f92cc038740 1 -- 172.21.15.3:0/2425437501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bc3e0 msgr2=0x561cd32cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.135+0000 7f92cc038740 1 --2- 172.21.15.3:0/2425437501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bc3e0 0x561cd32cd160 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f92b0031550 tx=0x7f92b00038c0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.135+0000 7f92cc038740 1 -- 172.21.15.3:0/2425437501 shutdown_connections 2024-09-19T06:17:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.135+0000 7f92cc038740 1 --2- 172.21.15.3:0/2425437501 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x561cd3342590 0x561cd33449b0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.135+0000 7f92cc038740 1 --2- 172.21.15.3:0/2425437501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561cd32c6ca0 0x561cd32cd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.135+0000 7f92cc038740 1 --2- 172.21.15.3:0/2425437501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561cd32bc3e0 0x561cd32cd160 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.135+0000 7f92cc038740 1 --2- 172.21.15.3:0/2425437501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561cd32bbac0 0x561cd32ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.135+0000 7f92cc038740 1 -- 172.21.15.3:0/2425437501 >> 172.21.15.3:0/2425437501 conn(0x561cd32b8050 msgr2=0x561cd32b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:01.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.135+0000 7f92a3e00640 0 client.26534 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:01.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.135+0000 7f92cc038740 1 -- 172.21.15.3:0/2425437501 shutdown_connections 2024-09-19T06:17:01.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.136+0000 7f92cc038740 1 -- 172.21.15.3:0/2425437501 wait complete. 2024-09-19T06:17:01.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.136+0000 7f92cc038740 20 client.26534 trim_cache size 0 max 16384 2024-09-19T06:17:01.143 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:17:01.143 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": 0, 2024-09-19T06:17:01.143 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_tag": "142a089d-2f32-4aa8-bdaf-04baec9071b7", 2024-09-19T06:17:01.143 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": "asynchronous" 2024-09-19T06:17:01.143 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:17:01.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.136+0000 7f92c9600640 1 -- 172.21.15.3:0/211114614 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f92a80a3430 msgr2=0x7f92a80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:01.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.136+0000 7f92c9600640 1 --2- 172.21.15.3:0/211114614 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f92a80a3430 0x7f92a80a58f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x561cd32b8eb0 tx=0x7f92b40bc040 comp rx=0 tx=0).stop 2024-09-19T06:17:01.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.136+0000 7f92c9600640 1 -- 172.21.15.3:0/211114614 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92c4076720 msgr2=0x7f92c41a47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:01.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.136+0000 7f92c9600640 1 --2- 172.21.15.3:0/211114614 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92c4076720 0x7f92c41a47f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f92b400e9f0 tx=0x7f92b400edf0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.137+0000 7f92c9600640 1 -- 172.21.15.3:0/211114614 shutdown_connections 2024-09-19T06:17:01.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.137+0000 7f92c9600640 1 --2- 172.21.15.3:0/211114614 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f92a80a3430 0x7f92a80a58f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.137+0000 7f92c9600640 1 --2- 172.21.15.3:0/211114614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92c4112a50 0x7f92c419e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.137+0000 7f92c9600640 1 --2- 172.21.15.3:0/211114614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f92c4077040 0x7f92c41a4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.137+0000 7f92c9600640 1 --2- 172.21.15.3:0/211114614 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92c4076720 0x7f92c41a47f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:01.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.137+0000 7f92c9600640 1 -- 172.21.15.3:0/211114614 >> 172.21.15.3:0/211114614 conn(0x7f92c40ffa50 msgr2=0x7f92c4101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:01.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.137+0000 7f92c9600640 1 -- 172.21.15.3:0/211114614 shutdown_connections 2024-09-19T06:17:01.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:01.137+0000 7f92c9600640 1 -- 172.21.15.3:0/211114614 wait complete. 2024-09-19T06:17:02.211 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:17:02.271 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.270+0000 7f58f3e00640 1 -- 172.21.15.3:0/3949941148 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58f410bf30 msgr2=0x7f58f410e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:02.272 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.270+0000 7f58f3e00640 1 --2- 172.21.15.3:0/3949941148 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58f410bf30 0x7f58f410e3b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f58ec009ca0 tx=0x7f58ec02a950 comp rx=0 tx=0).stop 2024-09-19T06:17:02.272 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.270+0000 7f58f3e00640 1 -- 172.21.15.3:0/3949941148 shutdown_connections 2024-09-19T06:17:02.272 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.270+0000 7f58f3e00640 1 --2- 172.21.15.3:0/3949941148 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58f410bf30 0x7f58f410e3b0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.272 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.270+0000 7f58f3e00640 1 --2- 172.21.15.3:0/3949941148 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58f4103400 0x7f58f410b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.272 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.270+0000 7f58f3e00640 1 --2- 172.21.15.3:0/3949941148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58f4102ae0 0x7f58f4102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.272 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.270+0000 7f58f3e00640 1 -- 172.21.15.3:0/3949941148 >> 172.21.15.3:0/3949941148 conn(0x7f58f40777f0 msgr2=0x7f58f40feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:02.272 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.271+0000 7f58f3e00640 1 -- 172.21.15.3:0/3949941148 shutdown_connections 2024-09-19T06:17:02.272 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.271+0000 7f58f3e00640 1 -- 172.21.15.3:0/3949941148 wait complete. 2024-09-19T06:17:02.274 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.271+0000 7f58f3e00640 1 Processor -- start 2024-09-19T06:17:02.274 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.272+0000 7f58f3e00640 1 -- start start 2024-09-19T06:17:02.274 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.272+0000 7f58f3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58f4102ae0 0x7f58f419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:02.274 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.272+0000 7f58f3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58f4103400 0x7f58f419a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:02.274 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.272+0000 7f58f3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58f410bf30 0x7f58f419ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:02.274 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.272+0000 7f58f3e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f58f4111d10 con 0x7f58f410bf30 2024-09-19T06:17:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.272+0000 7f58f3e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f58f4111b90 con 0x7f58f4103400 2024-09-19T06:17:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.272+0000 7f58f3e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f58f4111e90 con 0x7f58f4102ae0 2024-09-19T06:17:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.272+0000 7f58f3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58f410bf30 0x7f58f419ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.272+0000 7f58f3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58f410bf30 0x7f58f419ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35730/0 (socket says 172.21.15.3:35730) 2024-09-19T06:17:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.272+0000 7f58f2a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58f4102ae0 0x7f58f419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.272+0000 7f58f3400640 1 -- 172.21.15.3:0/541869177 learned_addr learned my addr 172.21.15.3:0/541869177 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.272+0000 7f58ebe00640 1 --2- 172.21.15.3:0/541869177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58f4103400 0x7f58f419a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.273+0000 7f58f3400640 1 -- 172.21.15.3:0/541869177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58f4102ae0 msgr2=0x7f58f419a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.273+0000 7f58f3400640 1 --2- 172.21.15.3:0/541869177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58f4102ae0 0x7f58f419a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.273+0000 7f58f3400640 1 -- 172.21.15.3:0/541869177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58f4103400 msgr2=0x7f58f419a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.273+0000 7f58f3400640 1 --2- 172.21.15.3:0/541869177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58f4103400 0x7f58f419a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.275 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.273+0000 7f58f3400640 1 -- 172.21.15.3:0/541869177 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f419f3e0 con 0x7f58f410bf30 2024-09-19T06:17:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.273+0000 7f58f2a00640 1 --2- 172.21.15.3:0/541869177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58f4102ae0 0x7f58f419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.273+0000 7f58f3400640 1 --2- 172.21.15.3:0/541869177 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58f410bf30 0x7f58f419ecb0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f58ec004af0 tx=0x7f58ec02f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.273+0000 7f58eb400640 1 -- 172.21.15.3:0/541869177 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec034040 con 0x7f58f410bf30 2024-09-19T06:17:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.273+0000 7f58f3e00640 1 -- 172.21.15.3:0/541869177 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58f419f670 con 0x7f58f410bf30 2024-09-19T06:17:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.273+0000 7f58eb400640 1 -- 172.21.15.3:0/541869177 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58ec030920 con 0x7f58f410bf30 2024-09-19T06:17:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.273+0000 7f58eb400640 1 -- 172.21.15.3:0/541869177 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec0047b0 con 0x7f58f410bf30 2024-09-19T06:17:02.276 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.274+0000 7f58f3e00640 1 -- 172.21.15.3:0/541869177 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58f41a6f60 con 0x7f58f410bf30 2024-09-19T06:17:02.277 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.277+0000 7f58eb400640 1 -- 172.21.15.3:0/541869177 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f58ec037020 con 0x7f58f410bf30 2024-09-19T06:17:02.281 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.278+0000 7f58eb400640 1 --2- 172.21.15.3:0/541869177 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f58d80a33a0 0x7f58d80a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:02.281 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.278+0000 7f58fc655740 1 Processor -- start 2024-09-19T06:17:02.281 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.278+0000 7f58eb400640 1 -- 172.21.15.3:0/541869177 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f58ec0f0990 con 0x7f58f410bf30 2024-09-19T06:17:02.281 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.278+0000 7f58fc655740 1 -- start start 2024-09-19T06:17:02.281 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.278+0000 7f58f2a00640 1 --2- 172.21.15.3:0/541869177 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f58d80a33a0 0x7f58d80a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:02.282 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.279+0000 7f58fc655740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d09ba503b0 0x55d09ba50790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:02.282 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.279+0000 7f58fc655740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba50cd0 0x55d09ba5b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:02.282 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.279+0000 7f58fc655740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba5b570 0x55d09ba5d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:02.282 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.279+0000 7f58fc655740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d09b9b6100 con 0x55d09ba50cd0 2024-09-19T06:17:02.282 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.279+0000 7f58fc655740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d09b95e1b0 con 0x55d09ba5b570 2024-09-19T06:17:02.282 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.279+0000 7f58fc655740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d09b9b20c0 con 0x55d09ba503b0 2024-09-19T06:17:02.282 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.279+0000 7f58ebe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba50cd0 0x55d09ba5b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:02.282 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.279+0000 7f58f2a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d09ba503b0 0x55d09ba50790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:02.282 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.279+0000 7f58f2a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d09ba503b0 0x55d09ba50790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:38130/0 (socket says 172.21.15.3:38130) 2024-09-19T06:17:02.282 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.279+0000 7f58ebe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba50cd0 0x55d09ba5b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35742/0 (socket says 172.21.15.3:35742) 2024-09-19T06:17:02.282 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.279+0000 7f58f2a00640 1 -- 172.21.15.3:0/3682290728 learned_addr learned my addr 172.21.15.3:0/3682290728 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:02.282 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.279+0000 7f58f3400640 1 --2- 172.21.15.3:0/3682290728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba5b570 0x55d09ba5d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:02.282 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.279+0000 7f58f2a00640 1 --2- 172.21.15.3:0/541869177 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f58d80a33a0 0x7f58d80a5860 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f58e4011490 tx=0x7f58e4005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:02.282 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.279+0000 7f58ebe00640 1 -- 172.21.15.3:0/3682290728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d09ba503b0 msgr2=0x55d09ba50790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:02.283 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.279+0000 7f58ebe00640 1 --2- 172.21.15.3:0/3682290728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d09ba503b0 0x55d09ba50790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.283 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.279+0000 7f58ebe00640 1 -- 172.21.15.3:0/3682290728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba5b570 msgr2=0x55d09ba5d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:02.283 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.279+0000 7f58ebe00640 1 --2- 172.21.15.3:0/3682290728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba5b570 0x55d09ba5d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.283 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.280+0000 7f58ebe00640 1 -- 172.21.15.3:0/3682290728 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d09b6c9210 con 0x55d09ba50cd0 2024-09-19T06:17:02.283 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.280+0000 7f58f2a00640 1 --2- 172.21.15.3:0/3682290728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d09ba503b0 0x55d09ba50790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:02.283 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.280+0000 7f58f3400640 1 --2- 172.21.15.3:0/3682290728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba5b570 0x55d09ba5d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:02.283 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.280+0000 7f58ebe00640 1 --2- 172.21.15.3:0/3682290728 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba50cd0 0x55d09ba5b030 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f58dc005d00 tx=0x7f58dc0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc64805fa2c1ae4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:02.283 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.280+0000 7f58e3400640 1 -- 172.21.15.3:0/3682290728 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc01c480 con 0x55d09ba50cd0 2024-09-19T06:17:02.283 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.280+0000 7f58e3400640 1 -- 172.21.15.3:0/3682290728 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58dc01cb00 con 0x55d09ba50cd0 2024-09-19T06:17:02.283 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.280+0000 7f58e3400640 1 -- 172.21.15.3:0/3682290728 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc011ab0 con 0x55d09ba50cd0 2024-09-19T06:17:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.281+0000 7f58fc655740 1 -- 172.21.15.3:0/3682290728 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba50cd0 msgr2=0x55d09ba5b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.281+0000 7f58fc655740 1 --2- 172.21.15.3:0/3682290728 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba50cd0 0x55d09ba5b030 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f58dc005d00 tx=0x7f58dc0107a0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.286 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.281+0000 7f58fc655740 1 -- 172.21.15.3:0/3682290728 shutdown_connections 2024-09-19T06:17:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.281+0000 7f58fc655740 1 --2- 172.21.15.3:0/3682290728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba5b570 0x55d09ba5d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.281+0000 7f58fc655740 1 --2- 172.21.15.3:0/3682290728 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba50cd0 0x55d09ba5b030 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.281+0000 7f58fc655740 1 --2- 172.21.15.3:0/3682290728 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d09ba503b0 0x55d09ba50790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.281+0000 7f58fc655740 1 -- 172.21.15.3:0/3682290728 >> 172.21.15.3:0/3682290728 conn(0x55d09ba4c920 msgr2=0x55d09ba4cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.281+0000 7f58fc655740 1 -- 172.21.15.3:0/3682290728 shutdown_connections 2024-09-19T06:17:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.281+0000 7f58fc655740 1 -- 172.21.15.3:0/3682290728 wait complete. 2024-09-19T06:17:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.282+0000 7f58fc655740 1 -- start start 2024-09-19T06:17:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.282+0000 7f58fc655740 1 Processor -- start 2024-09-19T06:17:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.283+0000 7f58fc655740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d09ba503b0 0x55d09ba586b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.283+0000 7f58fc655740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba50cd0 0x55d09ba58bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.283+0000 7f58fc655740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba5b570 0x55d09ba59130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.283+0000 7f58fc655740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d09ba5dff0 con 0x55d09ba5b570 2024-09-19T06:17:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.283+0000 7f58fc655740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d09b93f090 con 0x55d09ba50cd0 2024-09-19T06:17:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.283+0000 7f58fc655740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d09ba5e170 con 0x55d09ba503b0 2024-09-19T06:17:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.283+0000 7f58fc655740 10 client.0 _ll_register_callbacks cb 0x55d09b993f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.283+0000 7f58ebe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba50cd0 0x55d09ba58bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.283+0000 7f58f3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba5b570 0x55d09ba59130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.283+0000 7f58ebe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba50cd0 0x55d09ba58bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:39368/0 (socket says 172.21.15.3:39368) 2024-09-19T06:17:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.283+0000 7f58ebe00640 1 -- 172.21.15.3:0/1631246635 learned_addr learned my addr 172.21.15.3:0/1631246635 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.283+0000 7f58f2a00640 1 --2- 172.21.15.3:0/1631246635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d09ba503b0 0x55d09ba586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.283+0000 7f58ebe00640 1 -- 172.21.15.3:0/1631246635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d09ba503b0 msgr2=0x55d09ba586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.283+0000 7f58ebe00640 1 --2- 172.21.15.3:0/1631246635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d09ba503b0 0x55d09ba586b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.283+0000 7f58ebe00640 1 -- 172.21.15.3:0/1631246635 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba5b570 msgr2=0x55d09ba59130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.283+0000 7f58ebe00640 1 --2- 172.21.15.3:0/1631246635 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba5b570 0x55d09ba59130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.283+0000 7f58ebe00640 1 -- 172.21.15.3:0/1631246635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d09b795620 con 0x55d09ba50cd0 2024-09-19T06:17:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.284+0000 7f58ebe00640 1 --2- 172.21.15.3:0/1631246635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba50cd0 0x55d09ba58bf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f58dc011670 tx=0x7f58dc005670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=827a1a63b2cedca4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.284+0000 7f58d7e00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:17:02.289 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.284+0000 7f58d7e00640 1 -- 172.21.15.3:0/1631246635 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc01c690 con 0x55d09ba50cd0 2024-09-19T06:17:02.289 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.284+0000 7f58d7e00640 1 -- 172.21.15.3:0/1631246635 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f58dc01c830 con 0x55d09ba50cd0 2024-09-19T06:17:02.289 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.284+0000 7f58fc655740 1 -- 172.21.15.3:0/1631246635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58dc01cb00 con 0x55d09ba50cd0 2024-09-19T06:17:02.289 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.284+0000 7f58d7e00640 1 -- 172.21.15.3:0/1631246635 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f58dc004020 con 0x55d09ba50cd0 2024-09-19T06:17:02.289 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.284+0000 7f58fc655740 10 client.26546 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:02.289 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.284+0000 7f58fc655740 1 -- 172.21.15.3:0/1631246635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d09ba69e70 con 0x55d09ba50cd0 2024-09-19T06:17:02.289 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.284+0000 7f58d7e00640 1 -- 172.21.15.3:0/1631246635 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58dc01cb00 con 0x55d09ba50cd0 2024-09-19T06:17:02.289 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.285+0000 7f58d7e00640 1 -- 172.21.15.3:0/1631246635 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f58dc0035f0 con 0x55d09ba50cd0 2024-09-19T06:17:02.289 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.285+0000 7f58fc655740 10 client.26546 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:02.289 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.285+0000 7f58fc655740 10 client.26546 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:02.289 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.285+0000 7f58fc655740 20 client.26546 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:02.289 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.285+0000 7f58fc655740 1 --2- 172.21.15.3:0/1631246635 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55d09ba6b280 0x55d09ba6d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:02.290 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.285+0000 7f58fc655740 4 client.26546 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:17:02.290 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.285+0000 7f58fc655740 1 -- 172.21.15.3:0/1631246635 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d09b9c3830 con 0x55d09ba6b280 2024-09-19T06:17:02.290 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.285+0000 7f58f2a00640 1 --2- 172.21.15.3:0/1631246635 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55d09ba6b280 0x55d09ba6d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:02.290 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.286+0000 7f58f2a00640 1 --2- 172.21.15.3:0/1631246635 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55d09ba6b280 0x55d09ba6d670 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa2deb54d0b65854 server_cookie=792063bd966891c4 in_seq=0 out_seq=0 2024-09-19T06:17:02.290 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.286+0000 7f58d7e00640 10 client.26546 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:02.291 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.286+0000 7f58d7e00640 1 -- 172.21.15.3:0/1631246635 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d09b9c3830 con 0x55d09ba6b280 2024-09-19T06:17:02.291 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.286+0000 7f58d7e00640 10 client.26546 handle_command_reply: tid=0 2024-09-19T06:17:02.291 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.287+0000 7f58fc655740 1 client.26546 shutdown 2024-09-19T06:17:02.291 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.287+0000 7f58fc655740 1 -- 172.21.15.3:0/1631246635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba50cd0 msgr2=0x55d09ba58bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:02.291 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.287+0000 7f58fc655740 1 --2- 172.21.15.3:0/1631246635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba50cd0 0x55d09ba58bf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f58dc011670 tx=0x7f58dc005670 comp rx=0 tx=0).stop 2024-09-19T06:17:02.291 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.287+0000 7f58fc655740 1 -- 172.21.15.3:0/1631246635 shutdown_connections 2024-09-19T06:17:02.292 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.287+0000 7f58fc655740 1 --2- 172.21.15.3:0/1631246635 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55d09ba6b280 0x55d09ba6d670 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.292 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.287+0000 7f58fc655740 1 --2- 172.21.15.3:0/1631246635 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba5b570 0x55d09ba59130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.292 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.287+0000 7f58d7e00640 0 client.26546 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:02.292 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.287+0000 7f58fc655740 1 --2- 172.21.15.3:0/1631246635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba50cd0 0x55d09ba58bf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.292 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.287+0000 7f58fc655740 1 --2- 172.21.15.3:0/1631246635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d09ba503b0 0x55d09ba586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.292 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.287+0000 7f58fc655740 1 -- 172.21.15.3:0/1631246635 >> 172.21.15.3:0/1631246635 conn(0x55d09ba4c920 msgr2=0x55d09ba52630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:02.292 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.287+0000 7f58fc655740 1 -- 172.21.15.3:0/1631246635 shutdown_connections 2024-09-19T06:17:02.292 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.287+0000 7f58fc655740 1 -- 172.21.15.3:0/1631246635 wait complete. 2024-09-19T06:17:02.292 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.287+0000 7f58fc655740 20 client.26546 trim_cache size 0 max 16384 2024-09-19T06:17:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.319+0000 7f58fc655740 1 Processor -- start 2024-09-19T06:17:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.319+0000 7f58fc655740 1 -- start start 2024-09-19T06:17:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.319+0000 7f58fc655740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba503b0 0x55d09ba58d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.319+0000 7f58fc655740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba50cd0 0x55d09ba72c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:02.321 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.319+0000 7f58fc655740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d09ba5b570 0x55d09ba731b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.319+0000 7f58fc655740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f58f41af8a0 con 0x55d09ba503b0 2024-09-19T06:17:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.319+0000 7f58fc655740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f58f41b13e0 con 0x55d09ba50cd0 2024-09-19T06:17:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.319+0000 7f58fc655740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f58f41aff70 con 0x55d09ba5b570 2024-09-19T06:17:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.320+0000 7f58f2a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba503b0 0x55d09ba58d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.320+0000 7f58ebe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba50cd0 0x55d09ba72c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.320+0000 7f58ebe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba50cd0 0x55d09ba72c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:39378/0 (socket says 172.21.15.3:39378) 2024-09-19T06:17:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.320+0000 7f58ebe00640 1 -- 172.21.15.3:0/1519405081 learned_addr learned my addr 172.21.15.3:0/1519405081 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.320+0000 7f58f3400640 1 --2- 172.21.15.3:0/1519405081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d09ba5b570 0x55d09ba731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.320+0000 7f58ebe00640 1 -- 172.21.15.3:0/1519405081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d09ba5b570 msgr2=0x55d09ba731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.320+0000 7f58ebe00640 1 --2- 172.21.15.3:0/1519405081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d09ba5b570 0x55d09ba731b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.322 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.320+0000 7f58ebe00640 1 -- 172.21.15.3:0/1519405081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba503b0 msgr2=0x55d09ba58d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.320+0000 7f58ebe00640 1 --2- 172.21.15.3:0/1519405081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba503b0 0x55d09ba58d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.320+0000 7f58ebe00640 1 -- 172.21.15.3:0/1519405081 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d09ba50ad0 con 0x55d09ba50cd0 2024-09-19T06:17:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.320+0000 7f58f2a00640 1 --2- 172.21.15.3:0/1519405081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba503b0 0x55d09ba58d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:02.323 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.320+0000 7f58ebe00640 1 --2- 172.21.15.3:0/1519405081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba50cd0 0x55d09ba72c70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f58dc003a40 tx=0x7f58dc00bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10ca5391e3403114 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.321+0000 7f58e2a00640 1 -- 172.21.15.3:0/1519405081 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc00b720 con 0x55d09ba50cd0 2024-09-19T06:17:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.321+0000 7f58e2a00640 1 -- 172.21.15.3:0/1519405081 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58dc003c30 con 0x55d09ba50cd0 2024-09-19T06:17:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.321+0000 7f58e2a00640 1 -- 172.21.15.3:0/1519405081 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc004420 con 0x55d09ba50cd0 2024-09-19T06:17:02.325 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.322+0000 7f58fc655740 1 -- 172.21.15.3:0/1519405081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba50cd0 msgr2=0x55d09ba72c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.322+0000 7f58fc655740 1 --2- 172.21.15.3:0/1519405081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba50cd0 0x55d09ba72c70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f58dc003a40 tx=0x7f58dc00bf20 comp rx=0 tx=0).stop 2024-09-19T06:17:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.322+0000 7f58fc655740 1 -- 172.21.15.3:0/1519405081 shutdown_connections 2024-09-19T06:17:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.322+0000 7f58fc655740 1 --2- 172.21.15.3:0/1519405081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d09ba5b570 0x55d09ba731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.322+0000 7f58fc655740 1 --2- 172.21.15.3:0/1519405081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba50cd0 0x55d09ba72c70 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.322+0000 7f58fc655740 1 --2- 172.21.15.3:0/1519405081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba503b0 0x55d09ba58d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.322+0000 7f58fc655740 1 -- 172.21.15.3:0/1519405081 >> 172.21.15.3:0/1519405081 conn(0x55d09ba4c920 msgr2=0x55d09ba58670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.322+0000 7f58fc655740 1 -- 172.21.15.3:0/1519405081 shutdown_connections 2024-09-19T06:17:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.322+0000 7f58fc655740 1 -- 172.21.15.3:0/1519405081 wait complete. 2024-09-19T06:17:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.322+0000 7f58fc655740 1 -- start start 2024-09-19T06:17:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.323+0000 7f58fc655740 1 Processor -- start 2024-09-19T06:17:02.326 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.323+0000 7f58fc655740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba503b0 0x55d09ba638d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.323+0000 7f58fc655740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba50cd0 0x55d09ba550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.323+0000 7f58fc655740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d09ba5b570 0x55d09ba55630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.323+0000 7f58fc655740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f58f41b0d10 con 0x55d09ba503b0 2024-09-19T06:17:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.323+0000 7f58fc655740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f58f41b0640 con 0x55d09ba50cd0 2024-09-19T06:17:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.323+0000 7f58fc655740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f58f41ad880 con 0x55d09ba5b570 2024-09-19T06:17:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.323+0000 7f58fc655740 10 client.0 _ll_register_callbacks cb 0x7f58ec02ff50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.324+0000 7f58f2a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba503b0 0x55d09ba638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.324+0000 7f58f2a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba503b0 0x55d09ba638d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35778/0 (socket says 172.21.15.3:35778) 2024-09-19T06:17:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.324+0000 7f58f2a00640 1 -- 172.21.15.3:0/3139872386 learned_addr learned my addr 172.21.15.3:0/3139872386 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.324+0000 7f58f3400640 1 --2- 172.21.15.3:0/3139872386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d09ba5b570 0x55d09ba55630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.324+0000 7f58ebe00640 1 --2- 172.21.15.3:0/3139872386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba50cd0 0x55d09ba550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:02.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.324+0000 7f58f2a00640 1 -- 172.21.15.3:0/3139872386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d09ba5b570 msgr2=0x55d09ba55630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.324+0000 7f58f2a00640 1 --2- 172.21.15.3:0/3139872386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d09ba5b570 0x55d09ba55630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.324+0000 7f58f2a00640 1 -- 172.21.15.3:0/3139872386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba50cd0 msgr2=0x55d09ba550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.324+0000 7f58f2a00640 1 --2- 172.21.15.3:0/3139872386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba50cd0 0x55d09ba550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.324+0000 7f58f2a00640 1 -- 172.21.15.3:0/3139872386 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d09ba55bc0 con 0x55d09ba503b0 2024-09-19T06:17:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.324+0000 7f58f2a00640 1 --2- 172.21.15.3:0/3139872386 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba503b0 0x55d09ba638d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x55d09ba6dbe0 tx=0x7f58e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46d82fcf1b2be85 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:02.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.324+0000 7f58d7e00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:17:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.325+0000 7f58d7e00640 1 -- 172.21.15.3:0/3139872386 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e4035060 con 0x55d09ba503b0 2024-09-19T06:17:02.329 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.325+0000 7f58d7e00640 1 -- 172.21.15.3:0/3139872386 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f58e4003cc0 con 0x55d09ba503b0 2024-09-19T06:17:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.325+0000 7f58fc655740 1 -- 172.21.15.3:0/3139872386 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58dc003c30 con 0x55d09ba503b0 2024-09-19T06:17:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.325+0000 7f58d7e00640 1 -- 172.21.15.3:0/3139872386 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f58e4022040 con 0x55d09ba503b0 2024-09-19T06:17:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.325+0000 7f58fc655740 10 client.16509 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.325+0000 7f58fc655740 1 -- 172.21.15.3:0/3139872386 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d09bad5a70 con 0x55d09ba503b0 2024-09-19T06:17:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.325+0000 7f58d7e00640 1 -- 172.21.15.3:0/3139872386 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58dc003c30 con 0x55d09ba503b0 2024-09-19T06:17:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.326+0000 7f58d7e00640 1 -- 172.21.15.3:0/3139872386 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f58e401a040 con 0x55d09ba503b0 2024-09-19T06:17:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.326+0000 7f58fc655740 10 client.16509 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.326+0000 7f58fc655740 10 client.16509 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.326+0000 7f58fc655740 20 client.16509 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.326+0000 7f58fc655740 1 --2- 172.21.15.3:0/3139872386 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55d09bad61a0 0x55d09bad85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:02.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.326+0000 7f58fc655740 4 client.16509 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:17:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.326+0000 7f58fc655740 1 -- 172.21.15.3:0/3139872386 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d09b9bdb80 con 0x55d09bad61a0 2024-09-19T06:17:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.326+0000 7f58ebe00640 1 --2- 172.21.15.3:0/3139872386 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55d09bad61a0 0x55d09bad85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.327+0000 7f58ebe00640 1 --2- 172.21.15.3:0/3139872386 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55d09bad61a0 0x55d09bad85c0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a85833e5cc102ab5 server_cookie=593fa86d5f981a4c in_seq=0 out_seq=0 2024-09-19T06:17:02.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.327+0000 7f58d7e00640 10 client.16509 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.340+0000 7f58d7e00640 1 -- 172.21.15.3:0/3139872386 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d09b9bdb80 con 0x55d09bad61a0 2024-09-19T06:17:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.340+0000 7f58d7e00640 10 client.16509 handle_command_reply: tid=0 2024-09-19T06:17:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.340+0000 7f58fc655740 1 client.16509 shutdown 2024-09-19T06:17:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.340+0000 7f58fc655740 1 -- 172.21.15.3:0/3139872386 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba503b0 msgr2=0x55d09ba638d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.341+0000 7f58fc655740 1 --2- 172.21.15.3:0/3139872386 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba503b0 0x55d09ba638d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x55d09ba6dbe0 tx=0x7f58e4004730 comp rx=0 tx=0).stop 2024-09-19T06:17:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.341+0000 7f58fc655740 1 -- 172.21.15.3:0/3139872386 shutdown_connections 2024-09-19T06:17:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.341+0000 7f58fc655740 1 --2- 172.21.15.3:0/3139872386 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55d09bad61a0 0x55d09bad85c0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.341+0000 7f58fc655740 1 --2- 172.21.15.3:0/3139872386 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d09ba5b570 0x55d09ba55630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.341+0000 7f58fc655740 1 --2- 172.21.15.3:0/3139872386 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d09ba50cd0 0x55d09ba550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.341+0000 7f58fc655740 1 --2- 172.21.15.3:0/3139872386 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d09ba503b0 0x55d09ba638d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.341+0000 7f58d7e00640 0 client.16509 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.341+0000 7f58fc655740 1 -- 172.21.15.3:0/3139872386 >> 172.21.15.3:0/3139872386 conn(0x55d09ba4c920 msgr2=0x55d09ba4b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.341+0000 7f58fc655740 1 -- 172.21.15.3:0/3139872386 shutdown_connections 2024-09-19T06:17:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.341+0000 7f58fc655740 1 -- 172.21.15.3:0/3139872386 wait complete. 2024-09-19T06:17:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.341+0000 7f58fc655740 20 client.16509 trim_cache size 0 max 16384 2024-09-19T06:17:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:17:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:17:02.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:17:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:17:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.342+0000 7f58f3e00640 1 -- 172.21.15.3:0/541869177 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f58d80a33a0 msgr2=0x7f58d80a5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.342+0000 7f58f3e00640 1 --2- 172.21.15.3:0/541869177 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f58d80a33a0 0x7f58d80a5860 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f58e4011490 tx=0x7f58e4005f90 comp rx=0 tx=0).stop 2024-09-19T06:17:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.342+0000 7f58f3e00640 1 -- 172.21.15.3:0/541869177 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58f410bf30 msgr2=0x7f58f419ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:02.344 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.342+0000 7f58f3e00640 1 --2- 172.21.15.3:0/541869177 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58f410bf30 0x7f58f419ecb0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f58ec004af0 tx=0x7f58ec02f5b0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.342+0000 7f58f3e00640 1 -- 172.21.15.3:0/541869177 shutdown_connections 2024-09-19T06:17:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.342+0000 7f58f3e00640 1 --2- 172.21.15.3:0/541869177 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f58d80a33a0 0x7f58d80a5860 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.342+0000 7f58f3e00640 1 --2- 172.21.15.3:0/541869177 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58f410bf30 0x7f58f419ecb0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.342+0000 7f58f3e00640 1 --2- 172.21.15.3:0/541869177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58f4103400 0x7f58f419a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.342+0000 7f58f3e00640 1 --2- 172.21.15.3:0/541869177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58f4102ae0 0x7f58f419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.342+0000 7f58f3e00640 1 -- 172.21.15.3:0/541869177 >> 172.21.15.3:0/541869177 conn(0x7f58f40777f0 msgr2=0x7f58f40fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.342+0000 7f58f3e00640 1 -- 172.21.15.3:0/541869177 shutdown_connections 2024-09-19T06:17:02.345 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:02.342+0000 7f58f3e00640 1 -- 172.21.15.3:0/541869177 wait complete. 2024-09-19T06:17:02.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:02 smithi059 ceph-mon[35138]: pgmap v142: 97 pgs: 97 active+clean; 2.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-19T06:17:02.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:02 smithi059 ceph-mon[35138]: scrub queued for path: / 2024-09-19T06:17:02.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:02 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:17:02.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:02 smithi059 ceph-mon[35138]: scrub summary: active paths [/] 2024-09-19T06:17:02.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:02 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:17:02.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:02 smithi003 ceph-mon[30893]: pgmap v142: 97 pgs: 97 active+clean; 2.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-19T06:17:02.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:02 smithi003 ceph-mon[30893]: scrub queued for path: / 2024-09-19T06:17:02.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:02 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:17:02.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:02 smithi003 ceph-mon[30893]: scrub summary: active paths [/] 2024-09-19T06:17:02.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:02 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:17:02.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:02 smithi071 ceph-mon[35662]: pgmap v142: 97 pgs: 97 active+clean; 2.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-19T06:17:02.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:02 smithi071 ceph-mon[35662]: scrub queued for path: / 2024-09-19T06:17:02.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:02 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:17:02.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:02 smithi071 ceph-mon[35662]: scrub summary: active paths [/] 2024-09-19T06:17:02.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:02 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:17:02.624 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:17:03.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.197+0000 7fe66dc00640 1 -- 172.21.15.3:0/1446135385 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe668101de0 msgr2=0x7fe6681021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:03.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.197+0000 7fe66dc00640 1 --2- 172.21.15.3:0/1446135385 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe668101de0 0x7fe6681021c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe658009900 tx=0x7fe65802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.197+0000 7fe66dc00640 1 -- 172.21.15.3:0/1446135385 shutdown_connections 2024-09-19T06:17:03.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.197+0000 7fe66dc00640 1 --2- 172.21.15.3:0/1446135385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe668106f10 0x7fe66810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.197+0000 7fe66dc00640 1 --2- 172.21.15.3:0/1446135385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe668102790 0x7fe6681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.197+0000 7fe66dc00640 1 --2- 172.21.15.3:0/1446135385 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe668101de0 0x7fe6681021c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.197+0000 7fe66dc00640 1 -- 172.21.15.3:0/1446135385 >> 172.21.15.3:0/1446135385 conn(0x7fe6680fd8c0 msgr2=0x7fe6680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:03.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.197+0000 7fe66dc00640 1 -- 172.21.15.3:0/1446135385 shutdown_connections 2024-09-19T06:17:03.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.197+0000 7fe66dc00640 1 -- 172.21.15.3:0/1446135385 wait complete. 2024-09-19T06:17:03.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.198+0000 7fe66dc00640 1 Processor -- start 2024-09-19T06:17:03.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.199+0000 7fe66dc00640 1 -- start start 2024-09-19T06:17:03.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.199+0000 7fe66dc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe668101de0 0x7fe6680744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:03.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.199+0000 7fe66dc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe668102790 0x7fe668074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:03.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.199+0000 7fe66dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe668106f10 0x7fe668074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:03.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.199+0000 7fe66dc00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe668111f80 con 0x7fe668101de0 2024-09-19T06:17:03.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.199+0000 7fe66dc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe668111e00 con 0x7fe668106f10 2024-09-19T06:17:03.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.199+0000 7fe66dc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe668112100 con 0x7fe668102790 2024-09-19T06:17:03.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.199+0000 7fe666a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe668101de0 0x7fe6680744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:03.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.199+0000 7fe667400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe668106f10 0x7fe668074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:03.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.199+0000 7fe667400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe668106f10 0x7fe668074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:39418/0 (socket says 172.21.15.3:39418) 2024-09-19T06:17:03.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.199+0000 7fe666a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe668101de0 0x7fe6680744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35792/0 (socket says 172.21.15.3:35792) 2024-09-19T06:17:03.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.199+0000 7fe667400640 1 -- 172.21.15.3:0/4170604186 learned_addr learned my addr 172.21.15.3:0/4170604186 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:03.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.200+0000 7fe666000640 1 --2- 172.21.15.3:0/4170604186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe668102790 0x7fe668074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:03.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.200+0000 7fe667400640 1 -- 172.21.15.3:0/4170604186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe668102790 msgr2=0x7fe668074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:03.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.200+0000 7fe667400640 1 --2- 172.21.15.3:0/4170604186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe668102790 0x7fe668074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.200+0000 7fe667400640 1 -- 172.21.15.3:0/4170604186 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe668101de0 msgr2=0x7fe6680744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:03.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.200+0000 7fe667400640 1 --2- 172.21.15.3:0/4170604186 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe668101de0 0x7fe6680744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.200+0000 7fe667400640 1 -- 172.21.15.3:0/4170604186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6681a6920 con 0x7fe668106f10 2024-09-19T06:17:03.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.201+0000 7fe667400640 1 --2- 172.21.15.3:0/4170604186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe668106f10 0x7fe668074f70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe66000eb10 tx=0x7fe66000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:03.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.201+0000 7fe65f400640 1 -- 172.21.15.3:0/4170604186 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe660004b20 con 0x7fe668106f10 2024-09-19T06:17:03.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.201+0000 7fe65f400640 1 -- 172.21.15.3:0/4170604186 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe660004cc0 con 0x7fe668106f10 2024-09-19T06:17:03.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.201+0000 7fe65f400640 1 -- 172.21.15.3:0/4170604186 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe660010760 con 0x7fe668106f10 2024-09-19T06:17:03.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.201+0000 7fe66dc00640 1 -- 172.21.15.3:0/4170604186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6681a6c10 con 0x7fe668106f10 2024-09-19T06:17:03.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.201+0000 7fe66dc00640 1 -- 172.21.15.3:0/4170604186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6681a7100 con 0x7fe668106f10 2024-09-19T06:17:03.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.204+0000 7fe6705ba740 1 Processor -- start 2024-09-19T06:17:03.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.204+0000 7fe6705ba740 1 -- start start 2024-09-19T06:17:03.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.205+0000 7fe6705ba740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b46b90 0x564993b46f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:03.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.205+0000 7fe6705ba740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564993b474b0 0x564993b51830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:03.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.205+0000 7fe6705ba740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564993b51d70 0x564993b54160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:03.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.205+0000 7fe6705ba740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x564993aad3e0 con 0x564993b46b90 2024-09-19T06:17:03.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.205+0000 7fe6705ba740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564993a54d80 con 0x564993b474b0 2024-09-19T06:17:03.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.205+0000 7fe6705ba740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564993aa93a0 con 0x564993b51d70 2024-09-19T06:17:03.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.205+0000 7fe666000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b46b90 0x564993b46f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:03.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.205+0000 7fe666000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b46b90 0x564993b46f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35800/0 (socket says 172.21.15.3:35800) 2024-09-19T06:17:03.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.205+0000 7fe666000640 1 -- 172.21.15.3:0/3623530764 learned_addr learned my addr 172.21.15.3:0/3623530764 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:03.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.205+0000 7fe666000640 1 --2- 172.21.15.3:0/3623530764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564993b51d70 0x564993b54160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:03.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.205+0000 7fe666a00640 1 --2- 172.21.15.3:0/3623530764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564993b474b0 0x564993b51830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:03.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.206+0000 7fe666000640 1 -- 172.21.15.3:0/3623530764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564993b51d70 msgr2=0x564993b54160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:03.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.206+0000 7fe666000640 1 --2- 172.21.15.3:0/3623530764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564993b51d70 0x564993b54160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.206+0000 7fe666000640 1 -- 172.21.15.3:0/3623530764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564993b474b0 msgr2=0x564993b51830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:03.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.206+0000 7fe666000640 1 --2- 172.21.15.3:0/3623530764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564993b474b0 0x564993b51830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.206+0000 7fe666000640 1 -- 172.21.15.3:0/3623530764 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564993a73ae0 con 0x564993b46b90 2024-09-19T06:17:03.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.206+0000 7fe666000640 1 --2- 172.21.15.3:0/3623530764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b46b90 0x564993b46f70 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe65400b6c0 tx=0x7fe65400b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f45e0f5cc52516f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:03.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.206+0000 7fe653e00640 1 -- 172.21.15.3:0/3623530764 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe654012da0 con 0x564993b46b90 2024-09-19T06:17:03.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.206+0000 7fe653e00640 1 -- 172.21.15.3:0/3623530764 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe654010770 con 0x564993b46b90 2024-09-19T06:17:03.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.206+0000 7fe653e00640 1 -- 172.21.15.3:0/3623530764 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe654003850 con 0x564993b46b90 2024-09-19T06:17:03.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.207+0000 7fe6705ba740 1 -- 172.21.15.3:0/3623530764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b46b90 msgr2=0x564993b46f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:03.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.207+0000 7fe6705ba740 1 --2- 172.21.15.3:0/3623530764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b46b90 0x564993b46f70 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe65400b6c0 tx=0x7fe65400b650 comp rx=0 tx=0).stop 2024-09-19T06:17:03.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.208+0000 7fe65f400640 1 -- 172.21.15.3:0/4170604186 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fe660005020 con 0x7fe668106f10 2024-09-19T06:17:03.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.208+0000 7fe6705ba740 1 -- 172.21.15.3:0/3623530764 shutdown_connections 2024-09-19T06:17:03.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.208+0000 7fe6705ba740 1 --2- 172.21.15.3:0/3623530764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564993b51d70 0x564993b54160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.208+0000 7fe6705ba740 1 --2- 172.21.15.3:0/3623530764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564993b474b0 0x564993b51830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.208+0000 7fe6705ba740 1 --2- 172.21.15.3:0/3623530764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b46b90 0x564993b46f70 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.208+0000 7fe6705ba740 1 -- 172.21.15.3:0/3623530764 >> 172.21.15.3:0/3623530764 conn(0x564993b43120 msgr2=0x564993b43500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:03.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.208+0000 7fe6705ba740 1 -- 172.21.15.3:0/3623530764 shutdown_connections 2024-09-19T06:17:03.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.208+0000 7fe6705ba740 1 -- 172.21.15.3:0/3623530764 wait complete. 2024-09-19T06:17:03.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.209+0000 7fe6705ba740 1 -- start start 2024-09-19T06:17:03.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.209+0000 7fe6705ba740 1 Processor -- start 2024-09-19T06:17:03.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.210+0000 7fe6705ba740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b46b90 0x564993b4ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:03.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.210+0000 7fe6705ba740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564993b474b0 0x564993b4f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:03.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.210+0000 7fe6705ba740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564993b51d70 0x564993b4f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:03.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.210+0000 7fe6705ba740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x564993b549e0 con 0x564993b46b90 2024-09-19T06:17:03.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.210+0000 7fe6705ba740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564993a680f0 con 0x564993b474b0 2024-09-19T06:17:03.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.210+0000 7fe6705ba740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564993b54b60 con 0x564993b51d70 2024-09-19T06:17:03.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.210+0000 7fe6705ba740 10 client.0 _ll_register_callbacks cb 0x564993a599e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:03.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.210+0000 7fe65f400640 1 --2- 172.21.15.3:0/4170604186 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe64c0a3340 0x7fe64c0a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:03.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.210+0000 7fe666000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b46b90 0x564993b4ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:03.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.210+0000 7fe666000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b46b90 0x564993b4ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35804/0 (socket says 172.21.15.3:35804) 2024-09-19T06:17:03.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.210+0000 7fe666000640 1 -- 172.21.15.3:0/2467499395 learned_addr learned my addr 172.21.15.3:0/2467499395 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:03.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.210+0000 7fe65f400640 1 -- 172.21.15.3:0/4170604186 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fe6600d02a0 con 0x7fe668106f10 2024-09-19T06:17:03.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.210+0000 7fe666a00640 1 --2- 172.21.15.3:0/2467499395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564993b474b0 0x564993b4f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:03.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.211+0000 7fe666000640 1 --2- 172.21.15.3:0/2467499395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564993b51d70 0x564993b4f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:03.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.211+0000 7fe667400640 1 --2- 172.21.15.3:0/4170604186 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe64c0a3340 0x7fe64c0a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:03.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.211+0000 7fe666a00640 1 -- 172.21.15.3:0/2467499395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564993b51d70 msgr2=0x564993b4f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:03.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.211+0000 7fe666a00640 1 --2- 172.21.15.3:0/2467499395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564993b51d70 0x564993b4f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.211+0000 7fe666a00640 1 -- 172.21.15.3:0/2467499395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b46b90 msgr2=0x564993b4ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:03.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.211+0000 7fe666a00640 1 --2- 172.21.15.3:0/2467499395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b46b90 0x564993b4ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.211+0000 7fe666a00640 1 -- 172.21.15.3:0/2467499395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56499381e3c0 con 0x564993b474b0 2024-09-19T06:17:03.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.211+0000 7fe666000640 1 --2- 172.21.15.3:0/2467499395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b46b90 0x564993b4ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:03.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.211+0000 7fe666a00640 1 --2- 172.21.15.3:0/2467499395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564993b474b0 0x564993b4f220 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe65802a910 tx=0x7fe658005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af38c888350a503c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:03.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.211+0000 7fe650c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:17:03.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.212+0000 7fe667400640 1 --2- 172.21.15.3:0/4170604186 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe64c0a3340 0x7fe64c0a5800 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe6600049d0 tx=0x7fe660005b40 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:03.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.212+0000 7fe650c00640 1 -- 172.21.15.3:0/2467499395 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe658035040 con 0x564993b474b0 2024-09-19T06:17:03.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.212+0000 7fe650c00640 1 -- 172.21.15.3:0/2467499395 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fe6580048c0 con 0x564993b474b0 2024-09-19T06:17:03.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.212+0000 7fe6705ba740 1 -- 172.21.15.3:0/2467499395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe654010770 con 0x564993b474b0 2024-09-19T06:17:03.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.212+0000 7fe650c00640 1 -- 172.21.15.3:0/2467499395 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe658005d50 con 0x564993b474b0 2024-09-19T06:17:03.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.212+0000 7fe6705ba740 10 client.26564 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:03.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.212+0000 7fe6705ba740 1 -- 172.21.15.3:0/2467499395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564993b60710 con 0x564993b474b0 2024-09-19T06:17:03.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.212+0000 7fe650c00640 1 -- 172.21.15.3:0/2467499395 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe654010770 con 0x564993b474b0 2024-09-19T06:17:03.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.213+0000 7fe650c00640 1 -- 172.21.15.3:0/2467499395 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe658031c00 con 0x564993b474b0 2024-09-19T06:17:03.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.213+0000 7fe6705ba740 10 client.26564 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:03.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.213+0000 7fe6705ba740 10 client.26564 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:03.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.213+0000 7fe6705ba740 20 client.26564 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:03.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.213+0000 7fe6705ba740 1 --2- 172.21.15.3:0/2467499395 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564993b61bd0 0x564993b63fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:03.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.213+0000 7fe6705ba740 4 client.26564 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:17:03.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.213+0000 7fe6705ba740 1 -- 172.21.15.3:0/2467499395 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564993aba950 con 0x564993b61bd0 2024-09-19T06:17:03.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.213+0000 7fe666000640 1 --2- 172.21.15.3:0/2467499395 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564993b61bd0 0x564993b63fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:03.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.214+0000 7fe666000640 1 --2- 172.21.15.3:0/2467499395 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564993b61bd0 0x564993b63fc0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ac35ba714614d27 server_cookie=2745005e2922e0c0 in_seq=0 out_seq=0 2024-09-19T06:17:03.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.214+0000 7fe650c00640 10 client.26564 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:03.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.215+0000 7fe650c00640 1 -- 172.21.15.3:0/2467499395 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564993aba950 con 0x564993b61bd0 2024-09-19T06:17:03.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.215+0000 7fe650c00640 10 client.26564 handle_command_reply: tid=0 2024-09-19T06:17:03.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.215+0000 7fe6705ba740 1 client.26564 shutdown 2024-09-19T06:17:03.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.215+0000 7fe6705ba740 1 -- 172.21.15.3:0/2467499395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564993b474b0 msgr2=0x564993b4f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:03.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.215+0000 7fe6705ba740 1 --2- 172.21.15.3:0/2467499395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564993b474b0 0x564993b4f220 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe65802a910 tx=0x7fe658005270 comp rx=0 tx=0).stop 2024-09-19T06:17:03.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.215+0000 7fe6705ba740 1 -- 172.21.15.3:0/2467499395 shutdown_connections 2024-09-19T06:17:03.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.215+0000 7fe6705ba740 1 --2- 172.21.15.3:0/2467499395 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564993b61bd0 0x564993b63fc0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.215+0000 7fe6705ba740 1 --2- 172.21.15.3:0/2467499395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564993b51d70 0x564993b4f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.215+0000 7fe6705ba740 1 --2- 172.21.15.3:0/2467499395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564993b474b0 0x564993b4f220 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.215+0000 7fe650c00640 0 client.26564 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:03.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.215+0000 7fe6705ba740 1 --2- 172.21.15.3:0/2467499395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b46b90 0x564993b4ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.215+0000 7fe6705ba740 1 -- 172.21.15.3:0/2467499395 >> 172.21.15.3:0/2467499395 conn(0x564993b43120 msgr2=0x564993b48e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:03.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.215+0000 7fe6705ba740 1 -- 172.21.15.3:0/2467499395 shutdown_connections 2024-09-19T06:17:03.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.216+0000 7fe6705ba740 1 -- 172.21.15.3:0/2467499395 wait complete. 2024-09-19T06:17:03.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.216+0000 7fe6705ba740 20 client.26564 trim_cache size 0 max 16384 2024-09-19T06:17:03.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.234+0000 7fe6705ba740 1 Processor -- start 2024-09-19T06:17:03.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.234+0000 7fe6705ba740 1 -- start start 2024-09-19T06:17:03.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.234+0000 7fe6705ba740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564993b46b90 0x564993b495f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:03.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.234+0000 7fe6705ba740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b474b0 0x564993b69850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:03.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.234+0000 7fe6705ba740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564993b51d70 0x564993b69d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:03.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.234+0000 7fe6705ba740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe6681afb50 con 0x564993b474b0 2024-09-19T06:17:03.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.234+0000 7fe6705ba740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe6681b1690 con 0x564993b51d70 2024-09-19T06:17:03.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.234+0000 7fe6705ba740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe6681b0220 con 0x564993b46b90 2024-09-19T06:17:03.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.234+0000 7fe666a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b474b0 0x564993b69850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:03.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.234+0000 7fe666a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b474b0 0x564993b69850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35818/0 (socket says 172.21.15.3:35818) 2024-09-19T06:17:03.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.234+0000 7fe666a00640 1 -- 172.21.15.3:0/2426461759 learned_addr learned my addr 172.21.15.3:0/2426461759 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:03.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.234+0000 7fe666000640 1 --2- 172.21.15.3:0/2426461759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564993b46b90 0x564993b495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:03.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.235+0000 7fe666000640 1 --2- 172.21.15.3:0/2426461759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564993b51d70 0x564993b69d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:03.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.235+0000 7fe666a00640 1 -- 172.21.15.3:0/2426461759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564993b46b90 msgr2=0x564993b495f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:03.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.235+0000 7fe666a00640 1 --2- 172.21.15.3:0/2426461759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564993b46b90 0x564993b495f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.235+0000 7fe666a00640 1 -- 172.21.15.3:0/2426461759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564993b51d70 msgr2=0x564993b69d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:03.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.235+0000 7fe666a00640 1 --2- 172.21.15.3:0/2426461759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564993b51d70 0x564993b69d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.235+0000 7fe666a00640 1 -- 172.21.15.3:0/2426461759 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564993b42f50 con 0x564993b474b0 2024-09-19T06:17:03.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.235+0000 7fe666000640 1 --2- 172.21.15.3:0/2426461759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564993b51d70 0x564993b69d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:17:03.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.235+0000 7fe666a00640 1 --2- 172.21.15.3:0/2426461759 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b474b0 0x564993b69850 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe658005c40 tx=0x7fe65802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c9b365811b78fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:03.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.235+0000 7fe653400640 1 -- 172.21.15.3:0/2426461759 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe658052070 con 0x564993b474b0 2024-09-19T06:17:03.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.236+0000 7fe653400640 1 -- 172.21.15.3:0/2426461759 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe658040070 con 0x564993b474b0 2024-09-19T06:17:03.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.236+0000 7fe653400640 1 -- 172.21.15.3:0/2426461759 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe658035040 con 0x564993b474b0 2024-09-19T06:17:03.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.236+0000 7fe6705ba740 1 -- 172.21.15.3:0/2426461759 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b474b0 msgr2=0x564993b69850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:03.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.236+0000 7fe6705ba740 1 --2- 172.21.15.3:0/2426461759 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b474b0 0x564993b69850 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe658005c40 tx=0x7fe65802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.236+0000 7fe6705ba740 1 -- 172.21.15.3:0/2426461759 shutdown_connections 2024-09-19T06:17:03.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.236+0000 7fe6705ba740 1 --2- 172.21.15.3:0/2426461759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564993b51d70 0x564993b69d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.236+0000 7fe6705ba740 1 --2- 172.21.15.3:0/2426461759 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b474b0 0x564993b69850 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.236+0000 7fe6705ba740 1 --2- 172.21.15.3:0/2426461759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564993b46b90 0x564993b495f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.236+0000 7fe6705ba740 1 -- 172.21.15.3:0/2426461759 >> 172.21.15.3:0/2426461759 conn(0x564993b43120 msgr2=0x564993b50d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:03.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.236+0000 7fe6705ba740 1 -- 172.21.15.3:0/2426461759 shutdown_connections 2024-09-19T06:17:03.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.236+0000 7fe6705ba740 1 -- 172.21.15.3:0/2426461759 wait complete. 2024-09-19T06:17:03.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.237+0000 7fe6705ba740 1 -- start start 2024-09-19T06:17:03.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.237+0000 7fe6705ba740 1 Processor -- start 2024-09-19T06:17:03.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.237+0000 7fe6705ba740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564993b46b90 0x564993b55da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:03.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.237+0000 7fe6705ba740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564993b474b0 0x564993b562e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:03.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.237+0000 7fe6705ba740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b51d70 0x564993b56820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:03.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.237+0000 7fe6705ba740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe6681b0fc0 con 0x564993b51d70 2024-09-19T06:17:03.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.237+0000 7fe6705ba740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe6681b08f0 con 0x564993b46b90 2024-09-19T06:17:03.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.237+0000 7fe6705ba740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe6681adb30 con 0x564993b474b0 2024-09-19T06:17:03.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.238+0000 7fe6705ba740 10 client.0 _ll_register_callbacks cb 0x7fe658004540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:03.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.238+0000 7fe666a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564993b474b0 0x564993b562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:03.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.238+0000 7fe666000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b51d70 0x564993b56820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:03.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.238+0000 7fe666a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564993b474b0 0x564993b562e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:38204/0 (socket says 172.21.15.3:38204) 2024-09-19T06:17:03.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.238+0000 7fe666a00640 1 -- 172.21.15.3:0/3633352115 learned_addr learned my addr 172.21.15.3:0/3633352115 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:03.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.238+0000 7fe666000640 1 --2- 172.21.15.3:0/3633352115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564993b46b90 0x564993b55da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:03.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.238+0000 7fe666000640 1 -- 172.21.15.3:0/3633352115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564993b474b0 msgr2=0x564993b562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:03.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.238+0000 7fe666000640 1 --2- 172.21.15.3:0/3633352115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564993b474b0 0x564993b562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.238+0000 7fe666000640 1 -- 172.21.15.3:0/3633352115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564993b46b90 msgr2=0x564993b55da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:03.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.238+0000 7fe666000640 1 --2- 172.21.15.3:0/3633352115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564993b46b90 0x564993b55da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.238+0000 7fe666000640 1 -- 172.21.15.3:0/3633352115 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564993bcba20 con 0x564993b51d70 2024-09-19T06:17:03.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.238+0000 7fe666a00640 1 --2- 172.21.15.3:0/3633352115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564993b474b0 0x564993b562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:03.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.239+0000 7fe666000640 1 --2- 172.21.15.3:0/3633352115 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b51d70 0x564993b56820 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x564993b647c0 tx=0x7fe65400b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4569489070923911 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:03.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.239+0000 7fe650c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:17:03.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.239+0000 7fe650c00640 1 -- 172.21.15.3:0/3633352115 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe654004020 con 0x564993b51d70 2024-09-19T06:17:03.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.239+0000 7fe6705ba740 1 -- 172.21.15.3:0/3633352115 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe658040070 con 0x564993b51d70 2024-09-19T06:17:03.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.239+0000 7fe650c00640 1 -- 172.21.15.3:0/3633352115 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fe6540041c0 con 0x564993b51d70 2024-09-19T06:17:03.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.239+0000 7fe650c00640 1 -- 172.21.15.3:0/3633352115 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe6540043c0 con 0x564993b51d70 2024-09-19T06:17:03.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.239+0000 7fe6705ba740 10 client.16527 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:03.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.239+0000 7fe6705ba740 1 -- 172.21.15.3:0/3633352115 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564993bcccf0 con 0x564993b51d70 2024-09-19T06:17:03.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.239+0000 7fe650c00640 1 -- 172.21.15.3:0/3633352115 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe658040070 con 0x564993b51d70 2024-09-19T06:17:03.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.240+0000 7fe650c00640 1 -- 172.21.15.3:0/3633352115 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe654004a40 con 0x564993b51d70 2024-09-19T06:17:03.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.240+0000 7fe6705ba740 10 client.16527 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:03.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.240+0000 7fe6705ba740 10 client.16527 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:03.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.240+0000 7fe6705ba740 20 client.16527 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:03.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.240+0000 7fe6705ba740 1 --2- 172.21.15.3:0/3633352115 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564993bcd160 0x564993bcf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:03.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.240+0000 7fe6705ba740 4 client.16527 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:17:03.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.240+0000 7fe6705ba740 1 -- 172.21.15.3:0/3633352115 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564993ab4e60 con 0x564993bcd160 2024-09-19T06:17:03.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.240+0000 7fe666a00640 1 --2- 172.21.15.3:0/3633352115 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564993bcd160 0x564993bcf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:03.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.241+0000 7fe666a00640 1 --2- 172.21.15.3:0/3633352115 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564993bcd160 0x564993bcf550 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24c25869936c3400 server_cookie=a7523e76f3bfac38 in_seq=0 out_seq=0 2024-09-19T06:17:03.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.241+0000 7fe650c00640 10 client.16527 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.241+0000 7fe650c00640 1 -- 172.21.15.3:0/3633352115 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x564993ab4e60 con 0x564993bcd160 2024-09-19T06:17:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.241+0000 7fe650c00640 10 client.16527 handle_command_reply: tid=0 2024-09-19T06:17:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.241+0000 7fe6705ba740 1 client.16527 shutdown 2024-09-19T06:17:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.241+0000 7fe6705ba740 1 -- 172.21.15.3:0/3633352115 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b51d70 msgr2=0x564993b56820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:03.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.241+0000 7fe6705ba740 1 --2- 172.21.15.3:0/3633352115 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b51d70 0x564993b56820 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x564993b647c0 tx=0x7fe65400b410 comp rx=0 tx=0).stop 2024-09-19T06:17:03.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.241+0000 7fe6705ba740 1 -- 172.21.15.3:0/3633352115 shutdown_connections 2024-09-19T06:17:03.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.241+0000 7fe6705ba740 1 --2- 172.21.15.3:0/3633352115 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564993bcd160 0x564993bcf550 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.241+0000 7fe6705ba740 1 --2- 172.21.15.3:0/3633352115 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564993b51d70 0x564993b56820 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.241+0000 7fe6705ba740 1 --2- 172.21.15.3:0/3633352115 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564993b474b0 0x564993b562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.241+0000 7fe6705ba740 1 --2- 172.21.15.3:0/3633352115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564993b46b90 0x564993b55da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.241+0000 7fe6705ba740 1 -- 172.21.15.3:0/3633352115 >> 172.21.15.3:0/3633352115 conn(0x564993b43120 msgr2=0x564993b419a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:03.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.241+0000 7fe650c00640 0 client.16527 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:03.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.241+0000 7fe6705ba740 1 -- 172.21.15.3:0/3633352115 shutdown_connections 2024-09-19T06:17:03.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.241+0000 7fe6705ba740 1 -- 172.21.15.3:0/3633352115 wait complete. 2024-09-19T06:17:03.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.242+0000 7fe6705ba740 20 client.16527 trim_cache size 0 max 16384 2024-09-19T06:17:03.247 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:17:03.247 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:17:03.247 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": { 2024-09-19T06:17:03.247 INFO:teuthology.orchestra.run.smithi003.stdout: "142a089d-2f32-4aa8-bdaf-04baec9071b7": { 2024-09-19T06:17:03.247 INFO:teuthology.orchestra.run.smithi003.stdout: "path": "/", 2024-09-19T06:17:03.247 INFO:teuthology.orchestra.run.smithi003.stdout: "tag": "142a089d-2f32-4aa8-bdaf-04baec9071b7", 2024-09-19T06:17:03.247 INFO:teuthology.orchestra.run.smithi003.stdout: "options": "recursive,force" 2024-09-19T06:17:03.247 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:17:03.247 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:17:03.247 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:17:03.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.242+0000 7fe66dc00640 1 -- 172.21.15.3:0/4170604186 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe64c0a3340 msgr2=0x7fe64c0a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:03.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.242+0000 7fe66dc00640 1 --2- 172.21.15.3:0/4170604186 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe64c0a3340 0x7fe64c0a5800 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe6600049d0 tx=0x7fe660005b40 comp rx=0 tx=0).stop 2024-09-19T06:17:03.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.242+0000 7fe66dc00640 1 -- 172.21.15.3:0/4170604186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe668106f10 msgr2=0x7fe668074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:03.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.242+0000 7fe66dc00640 1 --2- 172.21.15.3:0/4170604186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe668106f10 0x7fe668074f70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe66000eb10 tx=0x7fe66000c2d0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.242+0000 7fe66dc00640 1 -- 172.21.15.3:0/4170604186 shutdown_connections 2024-09-19T06:17:03.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.242+0000 7fe66dc00640 1 --2- 172.21.15.3:0/4170604186 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe64c0a3340 0x7fe64c0a5800 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.242+0000 7fe66dc00640 1 --2- 172.21.15.3:0/4170604186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe668106f10 0x7fe668074f70 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.242+0000 7fe66dc00640 1 --2- 172.21.15.3:0/4170604186 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe668102790 0x7fe668074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.242+0000 7fe66dc00640 1 --2- 172.21.15.3:0/4170604186 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe668101de0 0x7fe6680744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:03.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.242+0000 7fe66dc00640 1 -- 172.21.15.3:0/4170604186 >> 172.21.15.3:0/4170604186 conn(0x7fe6680fd8c0 msgr2=0x7fe6680febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:03.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.243+0000 7fe66dc00640 1 -- 172.21.15.3:0/4170604186 shutdown_connections 2024-09-19T06:17:03.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:03.243+0000 7fe66dc00640 1 -- 172.21.15.3:0/4170604186 wait complete. 2024-09-19T06:17:04.267 INFO:tasks.cephfs.filesystem:scrub status for tag:142a089d-2f32-4aa8-bdaf-04baec9071b7 - {'path': '/', 'tag': '142a089d-2f32-4aa8-bdaf-04baec9071b7', 'options': 'recursive,force'} 2024-09-19T06:17:04.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:04 smithi059 ceph-mon[35138]: pgmap v143: 97 pgs: 97 active+clean; 2.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-19T06:17:04.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:04 smithi003 ceph-mon[30893]: pgmap v143: 97 pgs: 97 active+clean; 2.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-19T06:17:04.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:04 smithi071 ceph-mon[35662]: pgmap v143: 97 pgs: 97 active+clean; 2.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 15 op/s 2024-09-19T06:17:05.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:05 smithi059 ceph-mon[35138]: scrub summary: idle 2024-09-19T06:17:05.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:05 smithi003 ceph-mon[30893]: scrub summary: idle 2024-09-19T06:17:05.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:05 smithi071 ceph-mon[35662]: scrub summary: idle 2024-09-19T06:17:06.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:06 smithi059 ceph-mon[35138]: pgmap v144: 97 pgs: 97 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 73 KiB/s wr, 41 op/s 2024-09-19T06:17:06.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:06 smithi003 ceph-mon[30893]: pgmap v144: 97 pgs: 97 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 73 KiB/s wr, 41 op/s 2024-09-19T06:17:06.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:06 smithi071 ceph-mon[35662]: pgmap v144: 97 pgs: 97 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 73 KiB/s wr, 41 op/s 2024-09-19T06:17:08.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:08 smithi059 ceph-mon[35138]: pgmap v145: 97 pgs: 97 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 55 KiB/s wr, 31 op/s 2024-09-19T06:17:08.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:08 smithi003 ceph-mon[30893]: pgmap v145: 97 pgs: 97 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 55 KiB/s wr, 31 op/s 2024-09-19T06:17:08.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:08 smithi071 ceph-mon[35662]: pgmap v145: 97 pgs: 97 active+clean; 2.3 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 55 KiB/s wr, 31 op/s 2024-09-19T06:17:10.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:10 smithi059 ceph-mon[35138]: pgmap v146: 97 pgs: 97 active+clean; 2.5 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 69 KiB/s wr, 38 op/s 2024-09-19T06:17:10.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:10 smithi003 ceph-mon[30893]: pgmap v146: 97 pgs: 97 active+clean; 2.5 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 69 KiB/s wr, 38 op/s 2024-09-19T06:17:10.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:10 smithi071 ceph-mon[35662]: pgmap v146: 97 pgs: 97 active+clean; 2.5 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 69 KiB/s wr, 38 op/s 2024-09-19T06:17:12.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:12 smithi059 ceph-mon[35138]: pgmap v147: 97 pgs: 97 active+clean; 2.5 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 56 KiB/s wr, 31 op/s 2024-09-19T06:17:12.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:12 smithi003 ceph-mon[30893]: pgmap v147: 97 pgs: 97 active+clean; 2.5 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 56 KiB/s wr, 31 op/s 2024-09-19T06:17:12.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:12 smithi071 ceph-mon[35662]: pgmap v147: 97 pgs: 97 active+clean; 2.5 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 56 KiB/s wr, 31 op/s 2024-09-19T06:17:14.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:14 smithi059 ceph-mon[35138]: pgmap v148: 97 pgs: 97 active+clean; 2.5 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 56 KiB/s wr, 31 op/s 2024-09-19T06:17:14.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:14 smithi003 ceph-mon[30893]: pgmap v148: 97 pgs: 97 active+clean; 2.5 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 56 KiB/s wr, 31 op/s 2024-09-19T06:17:14.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:14 smithi071 ceph-mon[35662]: pgmap v148: 97 pgs: 97 active+clean; 2.5 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 56 KiB/s wr, 31 op/s 2024-09-19T06:17:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.477+0000 7f8a7e200640 1 -- 172.21.15.3:0/755209427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a781044d0 msgr2=0x7f8a781109b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.477+0000 7f8a7e200640 1 --2- 172.21.15.3:0/755209427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a781044d0 0x7f8a781109b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009cd0 tx=0x7f8a7002a8e0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.477+0000 7f8a7e200640 1 -- 172.21.15.3:0/755209427 shutdown_connections 2024-09-19T06:17:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.477+0000 7f8a7e200640 1 --2- 172.21.15.3:0/755209427 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a781044d0 0x7f8a781109b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.477+0000 7f8a7e200640 1 --2- 172.21.15.3:0/755209427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a78103b30 0x7f8a78103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.477+0000 7f8a7e200640 1 --2- 172.21.15.3:0/755209427 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8a78109bf0 0x7f8a78109fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.477+0000 7f8a7e200640 1 -- 172.21.15.3:0/755209427 >> 172.21.15.3:0/755209427 conn(0x7f8a780ff810 msgr2=0x7f8a78101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.477+0000 7f8a7e200640 1 -- 172.21.15.3:0/755209427 shutdown_connections 2024-09-19T06:17:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.477+0000 7f8a7e200640 1 -- 172.21.15.3:0/755209427 wait complete. 2024-09-19T06:17:15.482 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.478+0000 7f8a7e200640 1 Processor -- start 2024-09-19T06:17:15.482 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.478+0000 7f8a7e200640 1 -- start start 2024-09-19T06:17:15.482 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.479+0000 7f8a7e200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a78103b30 0x7f8a7819a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:15.482 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.479+0000 7f8a7e200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a781044d0 0x7f8a7819a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.479+0000 7f8a7e200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8a78109bf0 0x7f8a7819ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.479+0000 7f8a7e200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8a78113f90 con 0x7f8a78109bf0 2024-09-19T06:17:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.479+0000 7f8a7e200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8a78113e10 con 0x7f8a78103b30 2024-09-19T06:17:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.479+0000 7f8a7e200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8a78114110 con 0x7f8a781044d0 2024-09-19T06:17:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.479+0000 7f8a7ce00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a78103b30 0x7f8a7819a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.479+0000 7f8a7ce00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a78103b30 0x7f8a7819a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:33314/0 (socket says 172.21.15.3:33314) 2024-09-19T06:17:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.479+0000 7f8a7ce00640 1 -- 172.21.15.3:0/3463061187 learned_addr learned my addr 172.21.15.3:0/3463061187 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.479+0000 7f8a7d800640 1 --2- 172.21.15.3:0/3463061187 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8a78109bf0 0x7f8a7819ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.479+0000 7f8a77e00640 1 --2- 172.21.15.3:0/3463061187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a781044d0 0x7f8a7819a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.480+0000 7f8a7ce00640 1 -- 172.21.15.3:0/3463061187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a781044d0 msgr2=0x7f8a7819a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.480+0000 7f8a7ce00640 1 --2- 172.21.15.3:0/3463061187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a781044d0 0x7f8a7819a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.480+0000 7f8a7ce00640 1 -- 172.21.15.3:0/3463061187 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8a78109bf0 msgr2=0x7f8a7819ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.480+0000 7f8a7ce00640 1 --2- 172.21.15.3:0/3463061187 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8a78109bf0 0x7f8a7819ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.480+0000 7f8a7ce00640 1 -- 172.21.15.3:0/3463061187 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7819f370 con 0x7f8a78103b30 2024-09-19T06:17:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.480+0000 7f8a7ce00640 1 --2- 172.21.15.3:0/3463061187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a78103b30 0x7f8a7819a380 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c00e9f0 tx=0x7f8a6c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.480+0000 7f8a75600640 1 -- 172.21.15.3:0/3463061187 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c00cd80 con 0x7f8a78103b30 2024-09-19T06:17:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.480+0000 7f8a7e200640 1 -- 172.21.15.3:0/3463061187 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a7819f660 con 0x7f8a78103b30 2024-09-19T06:17:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.481+0000 7f8a75600640 1 -- 172.21.15.3:0/3463061187 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a6c005500 con 0x7f8a78103b30 2024-09-19T06:17:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.481+0000 7f8a7e200640 1 -- 172.21.15.3:0/3463061187 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a781a6ef0 con 0x7f8a78103b30 2024-09-19T06:17:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.481+0000 7f8a75600640 1 -- 172.21.15.3:0/3463061187 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c010690 con 0x7f8a78103b30 2024-09-19T06:17:15.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.484+0000 7f8a825ba740 1 Processor -- start 2024-09-19T06:17:15.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.484+0000 7f8a825ba740 1 -- start start 2024-09-19T06:17:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.484+0000 7f8a825ba740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b773b0 0x55f4b5b77790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.484+0000 7f8a825ba740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4b5b77cd0 0x55f4b5b82030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.484+0000 7f8a75600640 1 -- 172.21.15.3:0/3463061187 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f8a6c0046c0 con 0x7f8a78103b30 2024-09-19T06:17:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.484+0000 7f8a825ba740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f4b5b82570 0x55f4b5b84960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.484+0000 7f8a825ba740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55f4b5add100 con 0x55f4b5b773b0 2024-09-19T06:17:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.484+0000 7f8a825ba740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f4b5a851b0 con 0x55f4b5b82570 2024-09-19T06:17:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.484+0000 7f8a825ba740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f4b5ad90c0 con 0x55f4b5b77cd0 2024-09-19T06:17:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.484+0000 7f8a7d800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b773b0 0x55f4b5b77790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.484+0000 7f8a7d800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b773b0 0x55f4b5b77790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38616/0 (socket says 172.21.15.3:38616) 2024-09-19T06:17:15.488 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.484+0000 7f8a7d800640 1 -- 172.21.15.3:0/4202298233 learned_addr learned my addr 172.21.15.3:0/4202298233 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:15.488 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.485+0000 7f8a77e00640 1 --2- 172.21.15.3:0/4202298233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f4b5b82570 0x55f4b5b84960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:15.488 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.485+0000 7f8a7ce00640 1 --2- 172.21.15.3:0/4202298233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4b5b77cd0 0x55f4b5b82030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:15.488 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.485+0000 7f8a7d800640 1 -- 172.21.15.3:0/4202298233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4b5b77cd0 msgr2=0x55f4b5b82030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:15.488 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.485+0000 7f8a7d800640 1 --2- 172.21.15.3:0/4202298233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4b5b77cd0 0x55f4b5b82030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.488 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.485+0000 7f8a7d800640 1 -- 172.21.15.3:0/4202298233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f4b5b82570 msgr2=0x55f4b5b84960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:15.488 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.485+0000 7f8a7d800640 1 --2- 172.21.15.3:0/4202298233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f4b5b82570 0x55f4b5b84960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.488 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.485+0000 7f8a7d800640 1 -- 172.21.15.3:0/4202298233 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4b57f0210 con 0x55f4b5b773b0 2024-09-19T06:17:15.488 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.485+0000 7f8a77e00640 1 --2- 172.21.15.3:0/4202298233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f4b5b82570 0x55f4b5b84960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:15.491 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.485+0000 7f8a7d800640 1 --2- 172.21.15.3:0/4202298233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b773b0 0x55f4b5b77790 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009cd0 tx=0x7f8a70009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ebc0a8a1bc04cb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:15.491 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.486+0000 7f8a6a000640 1 -- 172.21.15.3:0/4202298233 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70049070 con 0x55f4b5b773b0 2024-09-19T06:17:15.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.486+0000 7f8a6a000640 1 -- 172.21.15.3:0/4202298233 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a70036040 con 0x55f4b5b773b0 2024-09-19T06:17:15.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.486+0000 7f8a6a000640 1 -- 172.21.15.3:0/4202298233 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70004040 con 0x55f4b5b773b0 2024-09-19T06:17:15.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.486+0000 7f8a75600640 1 --2- 172.21.15.3:0/3463061187 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8a600a33a0 0x7f8a600a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:15.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.486+0000 7f8a75600640 1 -- 172.21.15.3:0/3463061187 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f8a6c0d00b0 con 0x7f8a78103b30 2024-09-19T06:17:15.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.486+0000 7f8a7ce00640 1 --2- 172.21.15.3:0/3463061187 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8a600a33a0 0x7f8a600a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:15.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.486+0000 7f8a825ba740 1 -- 172.21.15.3:0/4202298233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b773b0 msgr2=0x55f4b5b77790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:15.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.486+0000 7f8a825ba740 1 --2- 172.21.15.3:0/4202298233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b773b0 0x55f4b5b77790 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009cd0 tx=0x7f8a70009a20 comp rx=0 tx=0).stop 2024-09-19T06:17:15.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.486+0000 7f8a825ba740 1 -- 172.21.15.3:0/4202298233 shutdown_connections 2024-09-19T06:17:15.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.487+0000 7f8a825ba740 1 --2- 172.21.15.3:0/4202298233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f4b5b82570 0x55f4b5b84960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.487+0000 7f8a825ba740 1 --2- 172.21.15.3:0/4202298233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4b5b77cd0 0x55f4b5b82030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.487+0000 7f8a825ba740 1 --2- 172.21.15.3:0/4202298233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b773b0 0x55f4b5b77790 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.487+0000 7f8a825ba740 1 -- 172.21.15.3:0/4202298233 >> 172.21.15.3:0/4202298233 conn(0x55f4b5b73920 msgr2=0x55f4b5b73d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:15.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.487+0000 7f8a825ba740 1 -- 172.21.15.3:0/4202298233 shutdown_connections 2024-09-19T06:17:15.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.487+0000 7f8a825ba740 1 -- 172.21.15.3:0/4202298233 wait complete. 2024-09-19T06:17:15.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.487+0000 7f8a7ce00640 1 --2- 172.21.15.3:0/3463061187 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8a600a33a0 0x7f8a600a5860 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0cd8b0 tx=0x7f8a6c0bc040 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:15.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.487+0000 7f8a825ba740 1 -- start start 2024-09-19T06:17:15.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.487+0000 7f8a825ba740 1 Processor -- start 2024-09-19T06:17:15.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.488+0000 7f8a825ba740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b773b0 0x55f4b5b7f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:15.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.488+0000 7f8a825ba740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f4b5b77cd0 0x55f4b5b7fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:15.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.488+0000 7f8a825ba740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4b5b82570 0x55f4b5b80130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:15.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.488+0000 7f8a825ba740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55f4b5b84ff0 con 0x55f4b5b773b0 2024-09-19T06:17:15.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.488+0000 7f8a825ba740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f4b5a66090 con 0x55f4b5b77cd0 2024-09-19T06:17:15.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.488+0000 7f8a825ba740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f4b5b85170 con 0x55f4b5b82570 2024-09-19T06:17:15.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.488+0000 7f8a825ba740 10 client.0 _ll_register_callbacks cb 0x55f4b5abaf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:15.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.488+0000 7f8a7d800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b773b0 0x55f4b5b7f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.488+0000 7f8a7d800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b773b0 0x55f4b5b7f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38630/0 (socket says 172.21.15.3:38630) 2024-09-19T06:17:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.488+0000 7f8a7d800640 1 -- 172.21.15.3:0/2524090845 learned_addr learned my addr 172.21.15.3:0/2524090845 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.488+0000 7f8a77e00640 1 --2- 172.21.15.3:0/2524090845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f4b5b77cd0 0x55f4b5b7fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.488+0000 7f8a7d800640 1 --2- 172.21.15.3:0/2524090845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4b5b82570 0x55f4b5b80130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.489+0000 7f8a7d800640 1 -- 172.21.15.3:0/2524090845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4b5b82570 msgr2=0x55f4b5b80130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.489+0000 7f8a7d800640 1 --2- 172.21.15.3:0/2524090845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4b5b82570 0x55f4b5b80130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.489+0000 7f8a7d800640 1 -- 172.21.15.3:0/2524090845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f4b5b77cd0 msgr2=0x55f4b5b7fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.489+0000 7f8a7d800640 1 --2- 172.21.15.3:0/2524090845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f4b5b77cd0 0x55f4b5b7fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.489+0000 7f8a7d800640 1 -- 172.21.15.3:0/2524090845 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4b58bc620 con 0x55f4b5b773b0 2024-09-19T06:17:15.495 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.489+0000 7f8a77e00640 1 --2- 172.21.15.3:0/2524090845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f4b5b77cd0 0x55f4b5b7fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:17:15.495 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.489+0000 7f8a7d800640 1 --2- 172.21.15.3:0/2524090845 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b773b0 0x55f4b5b7f6b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009620 tx=0x7f8a70003d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ddf623e71d8c1dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:15.495 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.489+0000 7f8a5ea00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:17:15.495 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.489+0000 7f8a5ea00640 1 -- 172.21.15.3:0/2524090845 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70055060 con 0x55f4b5b773b0 2024-09-19T06:17:15.495 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.489+0000 7f8a5ea00640 1 -- 172.21.15.3:0/2524090845 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f8a70041040 con 0x55f4b5b773b0 2024-09-19T06:17:15.495 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.489+0000 7f8a825ba740 1 -- 172.21.15.3:0/2524090845 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a70036040 con 0x55f4b5b773b0 2024-09-19T06:17:15.495 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.489+0000 7f8a5ea00640 1 -- 172.21.15.3:0/2524090845 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8a70049040 con 0x55f4b5b773b0 2024-09-19T06:17:15.495 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.490+0000 7f8a825ba740 10 client.16539 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:15.495 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.490+0000 7f8a825ba740 1 -- 172.21.15.3:0/2524090845 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f4b5b84ff0 con 0x55f4b5b773b0 2024-09-19T06:17:15.495 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.490+0000 7f8a5ea00640 1 -- 172.21.15.3:0/2524090845 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a70036040 con 0x55f4b5b773b0 2024-09-19T06:17:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.490+0000 7f8a5ea00640 1 -- 172.21.15.3:0/2524090845 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8a7004f070 con 0x55f4b5b773b0 2024-09-19T06:17:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.490+0000 7f8a825ba740 10 client.16539 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:15.497 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.490+0000 7f8a825ba740 10 client.16539 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.490+0000 7f8a825ba740 20 client.16539 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.490+0000 7f8a825ba740 1 --2- 172.21.15.3:0/2524090845 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f4b5b92090 0x55f4b5b94480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.490+0000 7f8a825ba740 4 client.16539 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:17:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.490+0000 7f8a825ba740 1 -- 172.21.15.3:0/2524090845 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4b5aea830 con 0x55f4b5b92090 2024-09-19T06:17:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.491+0000 7f8a77e00640 1 --2- 172.21.15.3:0/2524090845 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f4b5b92090 0x55f4b5b94480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.491+0000 7f8a77e00640 1 --2- 172.21.15.3:0/2524090845 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f4b5b92090 0x55f4b5b94480 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d4fbe5cc7780432 server_cookie=df0c62a0d0105ad2 in_seq=0 out_seq=0 2024-09-19T06:17:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.491+0000 7f8a5ea00640 10 client.16539 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.492+0000 7f8a5ea00640 1 -- 172.21.15.3:0/2524090845 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f4b5aea830 con 0x55f4b5b92090 2024-09-19T06:17:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.492+0000 7f8a5ea00640 10 client.16539 handle_command_reply: tid=0 2024-09-19T06:17:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.492+0000 7f8a825ba740 1 client.16539 shutdown 2024-09-19T06:17:15.498 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.493+0000 7f8a825ba740 1 -- 172.21.15.3:0/2524090845 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b773b0 msgr2=0x55f4b5b7f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:15.499 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.493+0000 7f8a825ba740 1 --2- 172.21.15.3:0/2524090845 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b773b0 0x55f4b5b7f6b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009620 tx=0x7f8a70003d30 comp rx=0 tx=0).stop 2024-09-19T06:17:15.499 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.493+0000 7f8a825ba740 1 -- 172.21.15.3:0/2524090845 shutdown_connections 2024-09-19T06:17:15.499 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.493+0000 7f8a825ba740 1 --2- 172.21.15.3:0/2524090845 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f4b5b92090 0x55f4b5b94480 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.499 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.493+0000 7f8a825ba740 1 --2- 172.21.15.3:0/2524090845 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4b5b82570 0x55f4b5b80130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.499 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.493+0000 7f8a825ba740 1 --2- 172.21.15.3:0/2524090845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f4b5b77cd0 0x55f4b5b7fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.499 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.493+0000 7f8a5ea00640 0 client.16539 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:15.499 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.493+0000 7f8a825ba740 1 --2- 172.21.15.3:0/2524090845 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b773b0 0x55f4b5b7f6b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.499 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.493+0000 7f8a825ba740 1 -- 172.21.15.3:0/2524090845 >> 172.21.15.3:0/2524090845 conn(0x55f4b5b73920 msgr2=0x55f4b5b79630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:15.499 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.493+0000 7f8a825ba740 1 -- 172.21.15.3:0/2524090845 shutdown_connections 2024-09-19T06:17:15.499 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.493+0000 7f8a825ba740 1 -- 172.21.15.3:0/2524090845 wait complete. 2024-09-19T06:17:15.499 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.493+0000 7f8a825ba740 20 client.16539 trim_cache size 0 max 16384 2024-09-19T06:17:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.508+0000 7f8a825ba740 1 Processor -- start 2024-09-19T06:17:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.508+0000 7f8a825ba740 1 -- start start 2024-09-19T06:17:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.509+0000 7f8a825ba740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f4b5b773b0 0x55f4b5b728b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.509+0000 7f8a825ba740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b77cd0 0x55f4b5b99b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.509+0000 7f8a825ba740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4b5b82570 0x55f4b5b9a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.509+0000 7f8a825ba740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8a781af760 con 0x55f4b5b77cd0 2024-09-19T06:17:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.509+0000 7f8a825ba740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8a781b12a0 con 0x55f4b5b773b0 2024-09-19T06:17:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.509+0000 7f8a825ba740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8a781afe30 con 0x55f4b5b82570 2024-09-19T06:17:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.509+0000 7f8a77e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b77cd0 0x55f4b5b99b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.509+0000 7f8a77e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b77cd0 0x55f4b5b99b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38638/0 (socket says 172.21.15.3:38638) 2024-09-19T06:17:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.509+0000 7f8a77e00640 1 -- 172.21.15.3:0/1925265086 learned_addr learned my addr 172.21.15.3:0/1925265086 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.509+0000 7f8a7d800640 1 --2- 172.21.15.3:0/1925265086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f4b5b773b0 0x55f4b5b728b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.509+0000 7f8a7d800640 1 --2- 172.21.15.3:0/1925265086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4b5b82570 0x55f4b5b9a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.509+0000 7f8a77e00640 1 -- 172.21.15.3:0/1925265086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4b5b82570 msgr2=0x55f4b5b9a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.509+0000 7f8a77e00640 1 --2- 172.21.15.3:0/1925265086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4b5b82570 0x55f4b5b9a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.509+0000 7f8a77e00640 1 -- 172.21.15.3:0/1925265086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f4b5b773b0 msgr2=0x55f4b5b728b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.509+0000 7f8a77e00640 1 --2- 172.21.15.3:0/1925265086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f4b5b773b0 0x55f4b5b728b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.509+0000 7f8a77e00640 1 -- 172.21.15.3:0/1925265086 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4b5b8e330 con 0x55f4b5b77cd0 2024-09-19T06:17:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.509+0000 7f8a7d800640 1 --2- 172.21.15.3:0/1925265086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f4b5b773b0 0x55f4b5b728b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.510+0000 7f8a77e00640 1 --2- 172.21.15.3:0/1925265086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b77cd0 0x55f4b5b99b30 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x55f4b5b74ca0 tx=0x7f8a64005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d121115e5f7f44d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.510+0000 7f8a69600640 1 -- 172.21.15.3:0/1925265086 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a64004230 con 0x55f4b5b77cd0 2024-09-19T06:17:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.510+0000 7f8a69600640 1 -- 172.21.15.3:0/1925265086 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a640043d0 con 0x55f4b5b77cd0 2024-09-19T06:17:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.510+0000 7f8a69600640 1 -- 172.21.15.3:0/1925265086 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a640035f0 con 0x55f4b5b77cd0 2024-09-19T06:17:15.517 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.510+0000 7f8a825ba740 1 -- 172.21.15.3:0/1925265086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b77cd0 msgr2=0x55f4b5b99b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:15.517 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.510+0000 7f8a825ba740 1 --2- 172.21.15.3:0/1925265086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b77cd0 0x55f4b5b99b30 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x55f4b5b74ca0 tx=0x7f8a64005f90 comp rx=0 tx=0).stop 2024-09-19T06:17:15.517 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.511+0000 7f8a825ba740 1 -- 172.21.15.3:0/1925265086 shutdown_connections 2024-09-19T06:17:15.517 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.511+0000 7f8a825ba740 1 --2- 172.21.15.3:0/1925265086 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4b5b82570 0x55f4b5b9a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.517 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.511+0000 7f8a825ba740 1 --2- 172.21.15.3:0/1925265086 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b77cd0 0x55f4b5b99b30 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.517 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.511+0000 7f8a825ba740 1 --2- 172.21.15.3:0/1925265086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f4b5b773b0 0x55f4b5b728b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.517 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.511+0000 7f8a825ba740 1 -- 172.21.15.3:0/1925265086 >> 172.21.15.3:0/1925265086 conn(0x55f4b5b73920 msgr2=0x55f4b5b721a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:15.517 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.511+0000 7f8a825ba740 1 -- 172.21.15.3:0/1925265086 shutdown_connections 2024-09-19T06:17:15.517 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.511+0000 7f8a825ba740 1 -- 172.21.15.3:0/1925265086 wait complete. 2024-09-19T06:17:15.518 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.511+0000 7f8a825ba740 1 -- start start 2024-09-19T06:17:15.518 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.511+0000 7f8a825ba740 1 Processor -- start 2024-09-19T06:17:15.518 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.512+0000 7f8a825ba740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f4b5b773b0 0x55f4b5b8ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:15.518 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.512+0000 7f8a825ba740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4b5b77cd0 0x55f4b5b7c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:15.518 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.512+0000 7f8a825ba740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b82570 0x55f4b5b7ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:15.518 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.512+0000 7f8a825ba740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8a781b0bd0 con 0x55f4b5b82570 2024-09-19T06:17:15.518 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.512+0000 7f8a825ba740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8a781b0500 con 0x55f4b5b773b0 2024-09-19T06:17:15.518 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.512+0000 7f8a825ba740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8a781ad740 con 0x55f4b5b77cd0 2024-09-19T06:17:15.518 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.512+0000 7f8a825ba740 10 client.0 _ll_register_callbacks cb 0x7f8a70047070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:15.518 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.512+0000 7f8a7d800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b82570 0x55f4b5b7ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:15.518 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.512+0000 7f8a7d800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b82570 0x55f4b5b7ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38646/0 (socket says 172.21.15.3:38646) 2024-09-19T06:17:15.518 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.512+0000 7f8a7d800640 1 -- 172.21.15.3:0/2376550825 learned_addr learned my addr 172.21.15.3:0/2376550825 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:15.519 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.512+0000 7f8a77e00640 1 --2- 172.21.15.3:0/2376550825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4b5b77cd0 0x55f4b5b7c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:15.519 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.512+0000 7f8a7d800640 1 --2- 172.21.15.3:0/2376550825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f4b5b773b0 0x55f4b5b8ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:15.519 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.512+0000 7f8a7d800640 1 -- 172.21.15.3:0/2376550825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4b5b77cd0 msgr2=0x55f4b5b7c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:15.519 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.512+0000 7f8a7d800640 1 --2- 172.21.15.3:0/2376550825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4b5b77cd0 0x55f4b5b7c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.519 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.512+0000 7f8a7d800640 1 -- 172.21.15.3:0/2376550825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f4b5b773b0 msgr2=0x55f4b5b8ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:15.519 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.512+0000 7f8a7d800640 1 --2- 172.21.15.3:0/2376550825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f4b5b773b0 0x55f4b5b8ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.519 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.512+0000 7f8a7d800640 1 -- 172.21.15.3:0/2376550825 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4b5b7d280 con 0x55f4b5b82570 2024-09-19T06:17:15.519 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.513+0000 7f8a7d800640 1 --2- 172.21.15.3:0/2376550825 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b82570 0x55f4b5b7ca80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8a7002ae00 tx=0x7f8a70046040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad68702a91b040e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:15.519 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.513+0000 7f8a5ea00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:17:15.519 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.513+0000 7f8a5ea00640 1 -- 172.21.15.3:0/2376550825 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70041020 con 0x55f4b5b82570 2024-09-19T06:17:15.519 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.513+0000 7f8a5ea00640 1 -- 172.21.15.3:0/2376550825 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f8a7002e040 con 0x55f4b5b82570 2024-09-19T06:17:15.520 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.513+0000 7f8a825ba740 1 -- 172.21.15.3:0/2376550825 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a640043d0 con 0x55f4b5b82570 2024-09-19T06:17:15.520 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.513+0000 7f8a5ea00640 1 -- 172.21.15.3:0/2376550825 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8a70055040 con 0x55f4b5b82570 2024-09-19T06:17:15.520 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.513+0000 7f8a825ba740 10 client.16545 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:15.520 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.513+0000 7f8a825ba740 1 -- 172.21.15.3:0/2376550825 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f4b5bfcbf0 con 0x55f4b5b82570 2024-09-19T06:17:15.520 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.513+0000 7f8a5ea00640 1 -- 172.21.15.3:0/2376550825 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a640043d0 con 0x55f4b5b82570 2024-09-19T06:17:15.520 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.514+0000 7f8a5ea00640 1 -- 172.21.15.3:0/2376550825 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8a7004f070 con 0x55f4b5b82570 2024-09-19T06:17:15.520 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.514+0000 7f8a825ba740 10 client.16545 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:15.521 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.514+0000 7f8a825ba740 10 client.16545 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:15.521 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.514+0000 7f8a825ba740 20 client.16545 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:15.521 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.514+0000 7f8a825ba740 1 --2- 172.21.15.3:0/2376550825 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f4b5bfd250 0x55f4b5bff640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:15.521 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.514+0000 7f8a825ba740 4 client.16545 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:17:15.521 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.514+0000 7f8a825ba740 1 -- 172.21.15.3:0/2376550825 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f4b5ae4b80 con 0x55f4b5bfd250 2024-09-19T06:17:15.521 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.514+0000 7f8a77e00640 1 --2- 172.21.15.3:0/2376550825 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f4b5bfd250 0x55f4b5bff640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:15.521 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.515+0000 7f8a5ea00640 10 client.16545 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:15.521 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.515+0000 7f8a77e00640 1 --2- 172.21.15.3:0/2376550825 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f4b5bfd250 0x55f4b5bff640 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d09428e99bc6b66f server_cookie=cf69f932af2a4557 in_seq=0 out_seq=0 2024-09-19T06:17:15.532 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.529+0000 7f8a5ea00640 1 -- 172.21.15.3:0/2376550825 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f4b5ae4b80 con 0x55f4b5bfd250 2024-09-19T06:17:15.532 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.529+0000 7f8a5ea00640 10 client.16545 handle_command_reply: tid=0 2024-09-19T06:17:15.532 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.529+0000 7f8a825ba740 1 client.16545 shutdown 2024-09-19T06:17:15.532 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.529+0000 7f8a825ba740 1 -- 172.21.15.3:0/2376550825 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b82570 msgr2=0x55f4b5b7ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:15.532 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.529+0000 7f8a825ba740 1 --2- 172.21.15.3:0/2376550825 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b82570 0x55f4b5b7ca80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8a7002ae00 tx=0x7f8a70046040 comp rx=0 tx=0).stop 2024-09-19T06:17:15.532 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.530+0000 7f8a825ba740 1 -- 172.21.15.3:0/2376550825 shutdown_connections 2024-09-19T06:17:15.532 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.530+0000 7f8a825ba740 1 --2- 172.21.15.3:0/2376550825 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f4b5bfd250 0x55f4b5bff640 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.532 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.530+0000 7f8a825ba740 1 --2- 172.21.15.3:0/2376550825 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f4b5b82570 0x55f4b5b7ca80 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.532 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.530+0000 7f8a825ba740 1 --2- 172.21.15.3:0/2376550825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f4b5b77cd0 0x55f4b5b7c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.532 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.530+0000 7f8a5ea00640 0 client.16545 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:15.532 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.530+0000 7f8a825ba740 1 --2- 172.21.15.3:0/2376550825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f4b5b773b0 0x55f4b5b8ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.532 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.530+0000 7f8a825ba740 1 -- 172.21.15.3:0/2376550825 >> 172.21.15.3:0/2376550825 conn(0x55f4b5b73920 msgr2=0x55f4b5b8db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:15.533 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.530+0000 7f8a825ba740 1 -- 172.21.15.3:0/2376550825 shutdown_connections 2024-09-19T06:17:15.533 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.530+0000 7f8a825ba740 1 -- 172.21.15.3:0/2376550825 wait complete. 2024-09-19T06:17:15.533 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.530+0000 7f8a825ba740 20 client.16545 trim_cache size 0 max 16384 2024-09-19T06:17:15.533 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:17:15.533 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:17:15.533 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:17:15.533 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:17:15.534 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.531+0000 7f8a7e200640 1 -- 172.21.15.3:0/3463061187 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8a600a33a0 msgr2=0x7f8a600a5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:15.534 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.531+0000 7f8a7e200640 1 --2- 172.21.15.3:0/3463061187 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8a600a33a0 0x7f8a600a5860 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0cd8b0 tx=0x7f8a6c0bc040 comp rx=0 tx=0).stop 2024-09-19T06:17:15.534 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.531+0000 7f8a7e200640 1 -- 172.21.15.3:0/3463061187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a78103b30 msgr2=0x7f8a7819a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:15.534 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.531+0000 7f8a7e200640 1 --2- 172.21.15.3:0/3463061187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a78103b30 0x7f8a7819a380 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c00e9f0 tx=0x7f8a6c00edf0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.534 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.531+0000 7f8a7e200640 1 -- 172.21.15.3:0/3463061187 shutdown_connections 2024-09-19T06:17:15.534 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.531+0000 7f8a7e200640 1 --2- 172.21.15.3:0/3463061187 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8a600a33a0 0x7f8a600a5860 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.534 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.531+0000 7f8a7e200640 1 --2- 172.21.15.3:0/3463061187 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8a78109bf0 0x7f8a7819ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.534 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.531+0000 7f8a7e200640 1 --2- 172.21.15.3:0/3463061187 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a781044d0 0x7f8a7819a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.531+0000 7f8a7e200640 1 --2- 172.21.15.3:0/3463061187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a78103b30 0x7f8a7819a380 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.531+0000 7f8a7e200640 1 -- 172.21.15.3:0/3463061187 >> 172.21.15.3:0/3463061187 conn(0x7f8a780ff810 msgr2=0x7f8a78100f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.531+0000 7f8a7e200640 1 -- 172.21.15.3:0/3463061187 shutdown_connections 2024-09-19T06:17:15.535 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:15.531+0000 7f8a7e200640 1 -- 172.21.15.3:0/3463061187 wait complete. 2024-09-19T06:17:16.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:16 smithi059 ceph-mon[35138]: pgmap v149: 97 pgs: 97 active+clean; 2.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 72 KiB/s wr, 38 op/s 2024-09-19T06:17:16.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:16 smithi003 ceph-mon[30893]: pgmap v149: 97 pgs: 97 active+clean; 2.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 72 KiB/s wr, 38 op/s 2024-09-19T06:17:16.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:16 smithi071 ceph-mon[35662]: pgmap v149: 97 pgs: 97 active+clean; 2.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 72 KiB/s wr, 38 op/s 2024-09-19T06:17:18.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:18 smithi059 ceph-mon[35138]: pgmap v150: 97 pgs: 97 active+clean; 2.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-09-19T06:17:18.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:18 smithi003 ceph-mon[30893]: pgmap v150: 97 pgs: 97 active+clean; 2.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-09-19T06:17:18.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:18 smithi071 ceph-mon[35662]: pgmap v150: 97 pgs: 97 active+clean; 2.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-09-19T06:17:20.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:20 smithi059 ceph-mon[35138]: pgmap v151: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 22 op/s 2024-09-19T06:17:20.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:20 smithi003 ceph-mon[30893]: pgmap v151: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 22 op/s 2024-09-19T06:17:20.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:20 smithi071 ceph-mon[35662]: pgmap v151: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 22 op/s 2024-09-19T06:17:22.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:22 smithi059 ceph-mon[35138]: pgmap v152: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-19T06:17:22.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:22 smithi003 ceph-mon[30893]: pgmap v152: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-19T06:17:22.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:22 smithi071 ceph-mon[35662]: pgmap v152: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-19T06:17:24.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:24 smithi059 ceph-mon[35138]: pgmap v153: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-19T06:17:24.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:24 smithi071 ceph-mon[35662]: pgmap v153: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-19T06:17:24.587 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:24 smithi003 ceph-mon[30893]: pgmap v153: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-19T06:17:26.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:26 smithi059 ceph-mon[35138]: pgmap v154: 97 pgs: 97 active+clean; 3.0 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 22 op/s 2024-09-19T06:17:26.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:26 smithi003 ceph-mon[30893]: pgmap v154: 97 pgs: 97 active+clean; 3.0 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 22 op/s 2024-09-19T06:17:26.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:26 smithi071 ceph-mon[35662]: pgmap v154: 97 pgs: 97 active+clean; 3.0 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 22 op/s 2024-09-19T06:17:28.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:28 smithi059 ceph-mon[35138]: pgmap v155: 97 pgs: 97 active+clean; 3.0 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 35 KiB/s wr, 15 op/s 2024-09-19T06:17:28.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:28 smithi003 ceph-mon[30893]: pgmap v155: 97 pgs: 97 active+clean; 3.0 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 35 KiB/s wr, 15 op/s 2024-09-19T06:17:28.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:28 smithi071 ceph-mon[35662]: pgmap v155: 97 pgs: 97 active+clean; 3.0 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 35 KiB/s wr, 15 op/s 2024-09-19T06:17:28.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.650+0000 7f20c4a00640 1 -- 172.21.15.3:0/3699085074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f20c01048e0 msgr2=0x7f20c0108920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:28.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.650+0000 7f20c4a00640 1 --2- 172.21.15.3:0/3699085074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f20c01048e0 0x7f20c0108920 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009900 tx=0x7f20a802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.651+0000 7f20c4a00640 1 -- 172.21.15.3:0/3699085074 shutdown_connections 2024-09-19T06:17:28.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.651+0000 7f20c4a00640 1 --2- 172.21.15.3:0/3699085074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c0109080 0x7f20c0110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.651+0000 7f20c4a00640 1 --2- 172.21.15.3:0/3699085074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f20c01048e0 0x7f20c0108920 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.651+0000 7f20c4a00640 1 --2- 172.21.15.3:0/3699085074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20c0103f30 0x7f20c0104310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.651+0000 7f20c4a00640 1 -- 172.21.15.3:0/3699085074 >> 172.21.15.3:0/3699085074 conn(0x7f20c00ff980 msgr2=0x7f20c0101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:28.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.651+0000 7f20c4a00640 1 -- 172.21.15.3:0/3699085074 shutdown_connections 2024-09-19T06:17:28.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.651+0000 7f20c4a00640 1 -- 172.21.15.3:0/3699085074 wait complete. 2024-09-19T06:17:28.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.652+0000 7f20c4a00640 1 Processor -- start 2024-09-19T06:17:28.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.652+0000 7f20c4a00640 1 -- start start 2024-09-19T06:17:28.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.652+0000 7f20c4a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f20c0103f30 0x7f20c019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.652+0000 7f20c4a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20c0109080 0x7f20c019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.652+0000 7f20c4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c019ef00 0x7f20c019f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.652+0000 7f20c4a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f20c01140f0 con 0x7f20c0103f30 2024-09-19T06:17:28.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.652+0000 7f20c4a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f20c0113f70 con 0x7f20c019ef00 2024-09-19T06:17:28.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.652+0000 7f20c4a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f20c0114270 con 0x7f20c0109080 2024-09-19T06:17:28.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.652+0000 7f20bde00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f20c0103f30 0x7f20c019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.652+0000 7f20be800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c019ef00 0x7f20c019f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.652+0000 7f20b5400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20c0109080 0x7f20c019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.652+0000 7f20be800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c019ef00 0x7f20c019f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:52500/0 (socket says 172.21.15.3:52500) 2024-09-19T06:17:28.656 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.653+0000 7f20be800640 1 -- 172.21.15.3:0/4079773034 learned_addr learned my addr 172.21.15.3:0/4079773034 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:28.656 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.653+0000 7f20b5400640 1 -- 172.21.15.3:0/4079773034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c019ef00 msgr2=0x7f20c019f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:28.656 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.653+0000 7f20b5400640 1 --2- 172.21.15.3:0/4079773034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c019ef00 0x7f20c019f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.656 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.653+0000 7f20b5400640 1 -- 172.21.15.3:0/4079773034 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f20c0103f30 msgr2=0x7f20c019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:28.656 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.653+0000 7f20b5400640 1 --2- 172.21.15.3:0/4079773034 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f20c0103f30 0x7f20c019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.656 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.653+0000 7f20b5400640 1 -- 172.21.15.3:0/4079773034 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c019f9f0 con 0x7f20c0109080 2024-09-19T06:17:28.657 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.654+0000 7f20b5400640 1 --2- 172.21.15.3:0/4079773034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20c0109080 0x7f20c019ab80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f20a802a910 tx=0x7f20a8003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:28.657 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.654+0000 7f20b7400640 1 -- 172.21.15.3:0/4079773034 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a803f070 con 0x7f20c0109080 2024-09-19T06:17:28.657 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.654+0000 7f20c4a00640 1 -- 172.21.15.3:0/4079773034 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c019fc80 con 0x7f20c0109080 2024-09-19T06:17:28.657 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.654+0000 7f20b7400640 1 -- 172.21.15.3:0/4079773034 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20a8031c90 con 0x7f20c0109080 2024-09-19T06:17:28.657 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.654+0000 7f20b7400640 1 -- 172.21.15.3:0/4079773034 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a8035030 con 0x7f20c0109080 2024-09-19T06:17:28.657 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.654+0000 7f20c4a00640 1 -- 172.21.15.3:0/4079773034 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c01a74a0 con 0x7f20c0109080 2024-09-19T06:17:28.659 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.658+0000 7f20c77ef740 1 Processor -- start 2024-09-19T06:17:28.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.658+0000 7f20c77ef740 1 -- start start 2024-09-19T06:17:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.658+0000 7f20c77ef740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee713181e0 0x55ee713185c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.659+0000 7f20c77ef740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ee71318b00 0x55ee71322e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.659+0000 7f20c77ef740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee713233a0 0x55ee71325790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.659+0000 7f20c77ef740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ee7127e100 con 0x55ee713233a0 2024-09-19T06:17:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.659+0000 7f20c77ef740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ee712261b0 con 0x55ee713181e0 2024-09-19T06:17:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.659+0000 7f20c77ef740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ee7127a0c0 con 0x55ee71318b00 2024-09-19T06:17:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.659+0000 7f20b7400640 1 -- 172.21.15.3:0/4079773034 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f20a8042070 con 0x7f20c0109080 2024-09-19T06:17:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.659+0000 7f20bde00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ee71318b00 0x55ee71322e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.659+0000 7f20bde00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ee71318b00 0x55ee71322e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:51210/0 (socket says 172.21.15.3:51210) 2024-09-19T06:17:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.659+0000 7f20bde00640 1 -- 172.21.15.3:0/1032137857 learned_addr learned my addr 172.21.15.3:0/1032137857 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.659+0000 7f20be800640 1 --2- 172.21.15.3:0/1032137857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee713181e0 0x55ee713185c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.659+0000 7f20b5400640 1 --2- 172.21.15.3:0/1032137857 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee713233a0 0x55ee71325790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.659+0000 7f20bde00640 1 -- 172.21.15.3:0/1032137857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee713181e0 msgr2=0x55ee713185c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:28.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.659+0000 7f20bde00640 1 --2- 172.21.15.3:0/1032137857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee713181e0 0x55ee713185c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.659+0000 7f20bde00640 1 -- 172.21.15.3:0/1032137857 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee713233a0 msgr2=0x55ee71325790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:28.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.659+0000 7f20bde00640 1 --2- 172.21.15.3:0/1032137857 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee713233a0 0x55ee71325790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.659+0000 7f20bde00640 1 -- 172.21.15.3:0/1032137857 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee70f91210 con 0x55ee71318b00 2024-09-19T06:17:28.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.660+0000 7f20bde00640 1 --2- 172.21.15.3:0/1032137857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ee71318b00 0x55ee71322e60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f20b00114f0 tx=0x7f20b00119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f528b11a30678ec5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:28.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.660+0000 7f20af000640 1 -- 172.21.15.3:0/1032137857 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b0004d20 con 0x55ee71318b00 2024-09-19T06:17:28.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.660+0000 7f20af000640 1 -- 172.21.15.3:0/1032137857 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20b0004050 con 0x55ee71318b00 2024-09-19T06:17:28.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.660+0000 7f20af000640 1 -- 172.21.15.3:0/1032137857 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b000f7c0 con 0x55ee71318b00 2024-09-19T06:17:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.660+0000 7f20b7400640 1 --2- 172.21.15.3:0/4079773034 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f20a40a33b0 0x7f20a40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.660+0000 7f20b7400640 1 -- 172.21.15.3:0/4079773034 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f20a80f0660 con 0x7f20c0109080 2024-09-19T06:17:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.661+0000 7f20be800640 1 --2- 172.21.15.3:0/4079773034 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f20a40a33b0 0x7f20a40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.661+0000 7f20c77ef740 1 -- 172.21.15.3:0/1032137857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ee71318b00 msgr2=0x55ee71322e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.661+0000 7f20c77ef740 1 --2- 172.21.15.3:0/1032137857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ee71318b00 0x55ee71322e60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f20b00114f0 tx=0x7f20b00119b0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.661+0000 7f20c77ef740 1 -- 172.21.15.3:0/1032137857 shutdown_connections 2024-09-19T06:17:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.661+0000 7f20c77ef740 1 --2- 172.21.15.3:0/1032137857 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee713233a0 0x55ee71325790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.661+0000 7f20c77ef740 1 --2- 172.21.15.3:0/1032137857 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ee71318b00 0x55ee71322e60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.667 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.661+0000 7f20c77ef740 1 --2- 172.21.15.3:0/1032137857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee713181e0 0x55ee713185c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.668 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.661+0000 7f20c77ef740 1 -- 172.21.15.3:0/1032137857 >> 172.21.15.3:0/1032137857 conn(0x55ee71314750 msgr2=0x55ee71314b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:28.668 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.661+0000 7f20c77ef740 1 -- 172.21.15.3:0/1032137857 shutdown_connections 2024-09-19T06:17:28.668 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.661+0000 7f20c77ef740 1 -- 172.21.15.3:0/1032137857 wait complete. 2024-09-19T06:17:28.668 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.661+0000 7f20be800640 1 --2- 172.21.15.3:0/4079773034 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f20a40a33b0 0x7f20a40a5870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009640 tx=0x7f20b8005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:28.668 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.661+0000 7f20c77ef740 1 -- start start 2024-09-19T06:17:28.668 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.662+0000 7f20c77ef740 1 Processor -- start 2024-09-19T06:17:28.668 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.662+0000 7f20c77ef740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee713181e0 0x55ee71320360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.668 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.662+0000 7f20c77ef740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ee71318b00 0x55ee713208a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.668 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.662+0000 7f20c77ef740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee713233a0 0x55ee71320de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.668 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.662+0000 7f20c77ef740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ee71325f70 con 0x55ee713181e0 2024-09-19T06:17:28.668 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.662+0000 7f20c77ef740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ee71207090 con 0x55ee713233a0 2024-09-19T06:17:28.668 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.662+0000 7f20c77ef740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ee713260f0 con 0x55ee71318b00 2024-09-19T06:17:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.662+0000 7f20c77ef740 10 client.0 _ll_register_callbacks cb 0x55ee7125bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.662+0000 7f20bde00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee713181e0 0x55ee71320360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.663+0000 7f20bde00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee713181e0 0x55ee71320360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43388/0 (socket says 172.21.15.3:43388) 2024-09-19T06:17:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.663+0000 7f20bde00640 1 -- 172.21.15.3:0/364297688 learned_addr learned my addr 172.21.15.3:0/364297688 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.663+0000 7f20b5400640 1 --2- 172.21.15.3:0/364297688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ee71318b00 0x55ee713208a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.663+0000 7f20be800640 1 --2- 172.21.15.3:0/364297688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee713233a0 0x55ee71320de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.663+0000 7f20b5400640 1 -- 172.21.15.3:0/364297688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee713233a0 msgr2=0x55ee71320de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.663+0000 7f20b5400640 1 --2- 172.21.15.3:0/364297688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee713233a0 0x55ee71320de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.663+0000 7f20b5400640 1 -- 172.21.15.3:0/364297688 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee713181e0 msgr2=0x55ee71320360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.663+0000 7f20b5400640 1 --2- 172.21.15.3:0/364297688 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee713181e0 0x55ee71320360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.663+0000 7f20b5400640 1 -- 172.21.15.3:0/364297688 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee7105d620 con 0x55ee71318b00 2024-09-19T06:17:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.663+0000 7f20bde00640 1 --2- 172.21.15.3:0/364297688 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee713181e0 0x55ee71320360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:28.669 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.663+0000 7f20b5400640 1 --2- 172.21.15.3:0/364297688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ee71318b00 0x55ee713208a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f20a80edd50 tx=0x7f20a8031490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a3396c919131fb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.663+0000 7f20a3400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:17:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.663+0000 7f20a3400640 1 -- 172.21.15.3:0/364297688 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a8049030 con 0x55ee71318b00 2024-09-19T06:17:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.663+0000 7f20a3400640 1 -- 172.21.15.3:0/364297688 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f20a80b9000 con 0x55ee71318b00 2024-09-19T06:17:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.663+0000 7f20c77ef740 1 -- 172.21.15.3:0/364297688 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20b0004050 con 0x55ee71318b00 2024-09-19T06:17:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.664+0000 7f20a3400640 1 -- 172.21.15.3:0/364297688 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f20a80bc2f0 con 0x55ee71318b00 2024-09-19T06:17:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.664+0000 7f20c77ef740 10 client.26602 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.664+0000 7f20c77ef740 1 -- 172.21.15.3:0/364297688 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ee71325f70 con 0x55ee71318b00 2024-09-19T06:17:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.664+0000 7f20a3400640 1 -- 172.21.15.3:0/364297688 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20b0004050 con 0x55ee71318b00 2024-09-19T06:17:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.664+0000 7f20a3400640 1 -- 172.21.15.3:0/364297688 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f20a80edfd0 con 0x55ee71318b00 2024-09-19T06:17:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.664+0000 7f20c77ef740 10 client.26602 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:28.670 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.664+0000 7f20c77ef740 10 client.26602 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:28.671 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.664+0000 7f20c77ef740 20 client.26602 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:28.671 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.664+0000 7f20c77ef740 1 --2- 172.21.15.3:0/364297688 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ee71332ee0 0x55ee71335360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.671 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.664+0000 7f20c77ef740 4 client.26602 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:17:28.671 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.664+0000 7f20c77ef740 1 -- 172.21.15.3:0/364297688 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee7128b830 con 0x55ee71332ee0 2024-09-19T06:17:28.671 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.665+0000 7f20bde00640 1 --2- 172.21.15.3:0/364297688 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ee71332ee0 0x55ee71335360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.671 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.665+0000 7f20bde00640 1 --2- 172.21.15.3:0/364297688 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ee71332ee0 0x55ee71335360 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4a7e2acc1892592 server_cookie=d7ab2687ec342906 in_seq=0 out_seq=0 2024-09-19T06:17:28.671 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.665+0000 7f20a3400640 10 client.26602 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:28.672 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.666+0000 7f20a3400640 1 -- 172.21.15.3:0/364297688 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee7128b830 con 0x55ee71332ee0 2024-09-19T06:17:28.672 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.666+0000 7f20a3400640 10 client.26602 handle_command_reply: tid=0 2024-09-19T06:17:28.672 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.666+0000 7f20c77ef740 1 client.26602 shutdown 2024-09-19T06:17:28.672 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.666+0000 7f20c77ef740 1 -- 172.21.15.3:0/364297688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ee71318b00 msgr2=0x55ee713208a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:28.672 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.666+0000 7f20c77ef740 1 --2- 172.21.15.3:0/364297688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ee71318b00 0x55ee713208a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f20a80edd50 tx=0x7f20a8031490 comp rx=0 tx=0).stop 2024-09-19T06:17:28.672 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.666+0000 7f20c77ef740 1 -- 172.21.15.3:0/364297688 shutdown_connections 2024-09-19T06:17:28.673 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.666+0000 7f20c77ef740 1 --2- 172.21.15.3:0/364297688 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ee71332ee0 0x55ee71335360 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.673 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.666+0000 7f20c77ef740 1 --2- 172.21.15.3:0/364297688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee713233a0 0x55ee71320de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.673 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.666+0000 7f20c77ef740 1 --2- 172.21.15.3:0/364297688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ee71318b00 0x55ee713208a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.673 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.666+0000 7f20c77ef740 1 --2- 172.21.15.3:0/364297688 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee713181e0 0x55ee71320360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.673 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.666+0000 7f20a3400640 0 client.26602 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:28.673 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.666+0000 7f20c77ef740 1 -- 172.21.15.3:0/364297688 >> 172.21.15.3:0/364297688 conn(0x55ee71314750 msgr2=0x55ee7131a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:28.673 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.666+0000 7f20c77ef740 1 -- 172.21.15.3:0/364297688 shutdown_connections 2024-09-19T06:17:28.673 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.666+0000 7f20c77ef740 1 -- 172.21.15.3:0/364297688 wait complete. 2024-09-19T06:17:28.673 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.667+0000 7f20c77ef740 20 client.26602 trim_cache size 0 max 16384 2024-09-19T06:17:28.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.682+0000 7f20c77ef740 1 Processor -- start 2024-09-19T06:17:28.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.682+0000 7f20c77ef740 1 -- start start 2024-09-19T06:17:28.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.682+0000 7f20c77ef740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee713181e0 0x55ee713221c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.682+0000 7f20c77ef740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee71318b00 0x55ee7133ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.682+0000 7f20c77ef740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ee713233a0 0x55ee7133b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.682+0000 7f20c77ef740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f20c01af970 con 0x55ee713181e0 2024-09-19T06:17:28.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.682+0000 7f20c77ef740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f20c01b14b0 con 0x55ee71318b00 2024-09-19T06:17:28.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.682+0000 7f20c77ef740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f20c01b0040 con 0x55ee713233a0 2024-09-19T06:17:28.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.682+0000 7f20bde00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee713181e0 0x55ee713221c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.686 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.682+0000 7f20b5400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee71318b00 0x55ee7133ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.686 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.682+0000 7f20b5400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee71318b00 0x55ee7133ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:52524/0 (socket says 172.21.15.3:52524) 2024-09-19T06:17:28.686 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.682+0000 7f20b5400640 1 -- 172.21.15.3:0/821442044 learned_addr learned my addr 172.21.15.3:0/821442044 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:28.686 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.683+0000 7f20be800640 1 --2- 172.21.15.3:0/821442044 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ee713233a0 0x55ee7133b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.686 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.683+0000 7f20b5400640 1 -- 172.21.15.3:0/821442044 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ee713233a0 msgr2=0x55ee7133b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:28.686 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.683+0000 7f20b5400640 1 --2- 172.21.15.3:0/821442044 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ee713233a0 0x55ee7133b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.686 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.683+0000 7f20b5400640 1 -- 172.21.15.3:0/821442044 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee713181e0 msgr2=0x55ee713221c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:28.686 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.683+0000 7f20b5400640 1 --2- 172.21.15.3:0/821442044 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee713181e0 0x55ee713221c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.686 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.683+0000 7f20b5400640 1 -- 172.21.15.3:0/821442044 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee7130ec20 con 0x55ee71318b00 2024-09-19T06:17:28.686 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.683+0000 7f20bde00640 1 --2- 172.21.15.3:0/821442044 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee713181e0 0x55ee713221c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:28.686 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.683+0000 7f20b5400640 1 --2- 172.21.15.3:0/821442044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee71318b00 0x55ee7133ac70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f20a8003fd0 tx=0x7f20a8005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0af5d528f7597e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:28.689 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.683+0000 7f20ae600640 1 -- 172.21.15.3:0/821442044 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a8049030 con 0x55ee71318b00 2024-09-19T06:17:28.689 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.684+0000 7f20ae600640 1 -- 172.21.15.3:0/821442044 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20a80bc990 con 0x55ee71318b00 2024-09-19T06:17:28.690 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.684+0000 7f20ae600640 1 -- 172.21.15.3:0/821442044 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a80b9000 con 0x55ee71318b00 2024-09-19T06:17:28.690 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.684+0000 7f20c77ef740 1 -- 172.21.15.3:0/821442044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee71318b00 msgr2=0x55ee7133ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:28.690 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.684+0000 7f20c77ef740 1 --2- 172.21.15.3:0/821442044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee71318b00 0x55ee7133ac70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f20a8003fd0 tx=0x7f20a8005d50 comp rx=0 tx=0).stop 2024-09-19T06:17:28.690 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.684+0000 7f20c77ef740 1 -- 172.21.15.3:0/821442044 shutdown_connections 2024-09-19T06:17:28.690 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.684+0000 7f20c77ef740 1 --2- 172.21.15.3:0/821442044 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ee713233a0 0x55ee7133b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.690 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.684+0000 7f20c77ef740 1 --2- 172.21.15.3:0/821442044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee71318b00 0x55ee7133ac70 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.690 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.684+0000 7f20c77ef740 1 --2- 172.21.15.3:0/821442044 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee713181e0 0x55ee713221c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.690 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.684+0000 7f20c77ef740 1 -- 172.21.15.3:0/821442044 >> 172.21.15.3:0/821442044 conn(0x55ee71314750 msgr2=0x55ee71321ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:28.690 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.685+0000 7f20c77ef740 1 -- 172.21.15.3:0/821442044 shutdown_connections 2024-09-19T06:17:28.690 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.685+0000 7f20c77ef740 1 -- 172.21.15.3:0/821442044 wait complete. 2024-09-19T06:17:28.690 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.685+0000 7f20c77ef740 1 -- start start 2024-09-19T06:17:28.690 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.685+0000 7f20c77ef740 1 Processor -- start 2024-09-19T06:17:28.691 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.685+0000 7f20c77ef740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ee713181e0 0x55ee71326f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.691 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.686+0000 7f20c77ef740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee71318b00 0x55ee713274b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.691 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.686+0000 7f20c77ef740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee713233a0 0x55ee713279f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.691 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.686+0000 7f20c77ef740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f20c01b0de0 con 0x55ee71318b00 2024-09-19T06:17:28.691 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.686+0000 7f20c77ef740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f20c01b0710 con 0x55ee713233a0 2024-09-19T06:17:28.691 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.686+0000 7f20c77ef740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f20c01ad950 con 0x55ee713181e0 2024-09-19T06:17:28.691 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.686+0000 7f20c77ef740 10 client.0 _ll_register_callbacks cb 0x7f20a8005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:28.691 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.686+0000 7f20b5400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee71318b00 0x55ee713274b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.691 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.686+0000 7f20b5400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee71318b00 0x55ee713274b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43402/0 (socket says 172.21.15.3:43402) 2024-09-19T06:17:28.691 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.686+0000 7f20b5400640 1 -- 172.21.15.3:0/2216051526 learned_addr learned my addr 172.21.15.3:0/2216051526 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:28.691 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.686+0000 7f20bde00640 1 --2- 172.21.15.3:0/2216051526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ee713181e0 0x55ee71326f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.691 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.686+0000 7f20be800640 1 --2- 172.21.15.3:0/2216051526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee713233a0 0x55ee713279f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.692 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.686+0000 7f20b5400640 1 -- 172.21.15.3:0/2216051526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ee713181e0 msgr2=0x55ee71326f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:28.692 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.686+0000 7f20b5400640 1 --2- 172.21.15.3:0/2216051526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ee713181e0 0x55ee71326f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.692 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.686+0000 7f20b5400640 1 -- 172.21.15.3:0/2216051526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee713233a0 msgr2=0x55ee713279f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:28.692 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.686+0000 7f20b5400640 1 --2- 172.21.15.3:0/2216051526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee713233a0 0x55ee713279f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.692 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.686+0000 7f20b5400640 1 -- 172.21.15.3:0/2216051526 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee7139cc40 con 0x55ee71318b00 2024-09-19T06:17:28.692 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.687+0000 7f20b5400640 1 --2- 172.21.15.3:0/2216051526 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee71318b00 0x55ee713274b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f20a80b9360 tx=0x7f20a803b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3bf8abcd984329 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:28.692 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.687+0000 7f20a3400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:17:28.692 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.687+0000 7f20a3400640 1 -- 172.21.15.3:0/2216051526 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a8049070 con 0x55ee71318b00 2024-09-19T06:17:28.692 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.687+0000 7f20a3400640 1 -- 172.21.15.3:0/2216051526 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f20a80c50c0 con 0x55ee71318b00 2024-09-19T06:17:28.692 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.687+0000 7f20c77ef740 1 -- 172.21.15.3:0/2216051526 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20a80bc990 con 0x55ee71318b00 2024-09-19T06:17:28.692 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.687+0000 7f20a3400640 1 -- 172.21.15.3:0/2216051526 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f20a80bc760 con 0x55ee71318b00 2024-09-19T06:17:28.692 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.687+0000 7f20c77ef740 10 client.16563 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:28.692 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.687+0000 7f20c77ef740 1 -- 172.21.15.3:0/2216051526 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ee7139cc40 con 0x55ee71318b00 2024-09-19T06:17:28.693 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.687+0000 7f20a3400640 1 -- 172.21.15.3:0/2216051526 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20a80bc990 con 0x55ee71318b00 2024-09-19T06:17:28.693 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.687+0000 7f20a3400640 1 -- 172.21.15.3:0/2216051526 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f20a80bbde0 con 0x55ee71318b00 2024-09-19T06:17:28.693 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.687+0000 7f20c77ef740 10 client.16563 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:28.693 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.687+0000 7f20c77ef740 10 client.16563 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:28.693 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.687+0000 7f20c77ef740 20 client.16563 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:28.693 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.687+0000 7f20c77ef740 1 --2- 172.21.15.3:0/2216051526 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ee7139e1e0 0x55ee713a0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:28.693 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.687+0000 7f20c77ef740 4 client.16563 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:17:28.693 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.688+0000 7f20c77ef740 1 -- 172.21.15.3:0/2216051526 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ee71285b80 con 0x55ee7139e1e0 2024-09-19T06:17:28.693 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.688+0000 7f20bde00640 1 --2- 172.21.15.3:0/2216051526 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ee7139e1e0 0x55ee713a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:28.694 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.688+0000 7f20bde00640 1 --2- 172.21.15.3:0/2216051526 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ee7139e1e0 0x55ee713a0600 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96a5fa42fb0d0670 server_cookie=e636b6548b21b034 in_seq=0 out_seq=0 2024-09-19T06:17:28.694 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.688+0000 7f20a3400640 10 client.16563 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.702+0000 7f20a3400640 1 -- 172.21.15.3:0/2216051526 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ee71285b80 con 0x55ee7139e1e0 2024-09-19T06:17:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.702+0000 7f20a3400640 10 client.16563 handle_command_reply: tid=0 2024-09-19T06:17:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.702+0000 7f20c77ef740 1 client.16563 shutdown 2024-09-19T06:17:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.703+0000 7f20c77ef740 1 -- 172.21.15.3:0/2216051526 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee71318b00 msgr2=0x55ee713274b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.703+0000 7f20c77ef740 1 --2- 172.21.15.3:0/2216051526 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee71318b00 0x55ee713274b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f20a80b9360 tx=0x7f20a803b460 comp rx=0 tx=0).stop 2024-09-19T06:17:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.703+0000 7f20c77ef740 1 -- 172.21.15.3:0/2216051526 shutdown_connections 2024-09-19T06:17:28.705 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.703+0000 7f20c77ef740 1 --2- 172.21.15.3:0/2216051526 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ee7139e1e0 0x55ee713a0600 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.706 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.703+0000 7f20c77ef740 1 --2- 172.21.15.3:0/2216051526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ee713233a0 0x55ee713279f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.706 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.703+0000 7f20c77ef740 1 --2- 172.21.15.3:0/2216051526 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ee71318b00 0x55ee713274b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.706 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.703+0000 7f20c77ef740 1 --2- 172.21.15.3:0/2216051526 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ee713181e0 0x55ee71326f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.706 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.703+0000 7f20a3400640 0 client.16563 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:28.706 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.703+0000 7f20c77ef740 1 -- 172.21.15.3:0/2216051526 >> 172.21.15.3:0/2216051526 conn(0x55ee71314750 msgr2=0x55ee7131a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:28.706 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.703+0000 7f20c77ef740 1 -- 172.21.15.3:0/2216051526 shutdown_connections 2024-09-19T06:17:28.706 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.703+0000 7f20c77ef740 1 -- 172.21.15.3:0/2216051526 wait complete. 2024-09-19T06:17:28.706 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.703+0000 7f20c77ef740 20 client.16563 trim_cache size 0 max 16384 2024-09-19T06:17:28.706 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:17:28.706 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:17:28.707 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:17:28.707 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:17:28.707 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.704+0000 7f20c4a00640 1 -- 172.21.15.3:0/4079773034 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f20a40a33b0 msgr2=0x7f20a40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:28.707 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.704+0000 7f20c4a00640 1 --2- 172.21.15.3:0/4079773034 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f20a40a33b0 0x7f20a40a5870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009640 tx=0x7f20b8005f90 comp rx=0 tx=0).stop 2024-09-19T06:17:28.707 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.704+0000 7f20c4a00640 1 -- 172.21.15.3:0/4079773034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20c0109080 msgr2=0x7f20c019ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:28.707 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.704+0000 7f20c4a00640 1 --2- 172.21.15.3:0/4079773034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20c0109080 0x7f20c019ab80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f20a802a910 tx=0x7f20a8003b20 comp rx=0 tx=0).stop 2024-09-19T06:17:28.708 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.704+0000 7f20c4a00640 1 -- 172.21.15.3:0/4079773034 shutdown_connections 2024-09-19T06:17:28.708 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.704+0000 7f20c4a00640 1 --2- 172.21.15.3:0/4079773034 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f20a40a33b0 0x7f20a40a5870 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.708 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.704+0000 7f20c4a00640 1 --2- 172.21.15.3:0/4079773034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20c019ef00 0x7f20c019f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.708 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.704+0000 7f20c4a00640 1 --2- 172.21.15.3:0/4079773034 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f20c0109080 0x7f20c019ab80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.708 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.704+0000 7f20c4a00640 1 --2- 172.21.15.3:0/4079773034 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f20c0103f30 0x7f20c019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:28.708 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.704+0000 7f20c4a00640 1 -- 172.21.15.3:0/4079773034 >> 172.21.15.3:0/4079773034 conn(0x7f20c00ff980 msgr2=0x7f20c0100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:28.708 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.704+0000 7f20c4a00640 1 -- 172.21.15.3:0/4079773034 shutdown_connections 2024-09-19T06:17:28.708 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:28.704+0000 7f20c4a00640 1 -- 172.21.15.3:0/4079773034 wait complete. 2024-09-19T06:17:30.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:30 smithi059 ceph-mon[35138]: pgmap v156: 97 pgs: 97 active+clean; 3.2 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 22 op/s 2024-09-19T06:17:30.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:30 smithi003 ceph-mon[30893]: pgmap v156: 97 pgs: 97 active+clean; 3.2 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 22 op/s 2024-09-19T06:17:30.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:30 smithi071 ceph-mon[35662]: pgmap v156: 97 pgs: 97 active+clean; 3.2 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 22 op/s 2024-09-19T06:17:32.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:32 smithi059 ceph-mon[35138]: pgmap v157: 97 pgs: 97 active+clean; 3.2 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-09-19T06:17:32.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:32 smithi003 ceph-mon[30893]: pgmap v157: 97 pgs: 97 active+clean; 3.2 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-09-19T06:17:32.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:32 smithi071 ceph-mon[35662]: pgmap v157: 97 pgs: 97 active+clean; 3.2 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-09-19T06:17:34.268 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:17:34.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:34 smithi059 ceph-mon[35138]: pgmap v158: 97 pgs: 97 active+clean; 3.2 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-09-19T06:17:34.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:34 smithi003 ceph-mon[30893]: pgmap v158: 97 pgs: 97 active+clean; 3.2 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-09-19T06:17:34.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:34 smithi071 ceph-mon[35662]: pgmap v158: 97 pgs: 97 active+clean; 3.2 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-09-19T06:17:34.667 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:17:35.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.229+0000 7f2c93e00640 1 -- 172.21.15.3:0/192516755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8c112a50 msgr2=0x7f2c8c114e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:35.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.229+0000 7f2c93e00640 1 --2- 172.21.15.3:0/192516755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8c112a50 0x7f2c8c114e40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2c84009be0 tx=0x7f2c8402a6d0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.229+0000 7f2c93e00640 1 -- 172.21.15.3:0/192516755 shutdown_connections 2024-09-19T06:17:35.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.229+0000 7f2c93e00640 1 --2- 172.21.15.3:0/192516755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8c112a50 0x7f2c8c114e40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.229+0000 7f2c93e00640 1 --2- 172.21.15.3:0/192516755 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2c8c077040 0x7f2c8c112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.229+0000 7f2c93e00640 1 --2- 172.21.15.3:0/192516755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c8c076720 0x7f2c8c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.229+0000 7f2c93e00640 1 -- 172.21.15.3:0/192516755 >> 172.21.15.3:0/192516755 conn(0x7f2c8c0ffa50 msgr2=0x7f2c8c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:35.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.229+0000 7f2c93e00640 1 -- 172.21.15.3:0/192516755 shutdown_connections 2024-09-19T06:17:35.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.229+0000 7f2c93e00640 1 -- 172.21.15.3:0/192516755 wait complete. 2024-09-19T06:17:35.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.230+0000 7f2c93e00640 1 Processor -- start 2024-09-19T06:17:35.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.230+0000 7f2c93e00640 1 -- start start 2024-09-19T06:17:35.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.231+0000 7f2c93e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2c8c076720 0x7f2c8c1a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.231+0000 7f2c93e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8c077040 0x7f2c8c1a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.231+0000 7f2c93e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c8c112a50 0x7f2c8c19e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.231+0000 7f2c93e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c1185a0 con 0x7f2c8c076720 2024-09-19T06:17:35.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.231+0000 7f2c93e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c118420 con 0x7f2c8c077040 2024-09-19T06:17:35.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.231+0000 7f2c93e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c118720 con 0x7f2c8c112a50 2024-09-19T06:17:35.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.231+0000 7f2c91400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2c8c076720 0x7f2c8c1a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.231+0000 7f2c91400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2c8c076720 0x7f2c8c1a46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40788/0 (socket says 172.21.15.3:40788) 2024-09-19T06:17:35.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.231+0000 7f2c91400640 1 -- 172.21.15.3:0/1861542103 learned_addr learned my addr 172.21.15.3:0/1861542103 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:35.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.231+0000 7f2c91e00640 1 --2- 172.21.15.3:0/1861542103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c8c112a50 0x7f2c8c19e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.231+0000 7f2c90a00640 1 --2- 172.21.15.3:0/1861542103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8c077040 0x7f2c8c1a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.232+0000 7f2c91400640 1 -- 172.21.15.3:0/1861542103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c8c112a50 msgr2=0x7f2c8c19e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:35.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.232+0000 7f2c91400640 1 --2- 172.21.15.3:0/1861542103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c8c112a50 0x7f2c8c19e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.232+0000 7f2c91400640 1 -- 172.21.15.3:0/1861542103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8c077040 msgr2=0x7f2c8c1a4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:35.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.232+0000 7f2c91400640 1 --2- 172.21.15.3:0/1861542103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8c077040 0x7f2c8c1a4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.232+0000 7f2c91400640 1 -- 172.21.15.3:0/1861542103 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c8c19efe0 con 0x7f2c8c076720 2024-09-19T06:17:35.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.232+0000 7f2c91400640 1 --2- 172.21.15.3:0/1861542103 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2c8c076720 0x7f2c8c1a46f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2c8000e9f0 tx=0x7f2c8000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:35.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.232+0000 7f2c8a000640 1 -- 172.21.15.3:0/1861542103 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8000cd80 con 0x7f2c8c076720 2024-09-19T06:17:35.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.232+0000 7f2c93e00640 1 -- 172.21.15.3:0/1861542103 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c8c19f2d0 con 0x7f2c8c076720 2024-09-19T06:17:35.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.232+0000 7f2c8a000640 1 -- 172.21.15.3:0/1861542103 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c80005500 con 0x7f2c8c076720 2024-09-19T06:17:35.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.232+0000 7f2c8a000640 1 -- 172.21.15.3:0/1861542103 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c80010690 con 0x7f2c8c076720 2024-09-19T06:17:35.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.232+0000 7f2c93e00640 1 -- 172.21.15.3:0/1861542103 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c8c1ab5c0 con 0x7f2c8c076720 2024-09-19T06:17:35.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.236+0000 7f2c8a000640 1 -- 172.21.15.3:0/1861542103 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f2c800046c0 con 0x7f2c8c076720 2024-09-19T06:17:35.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.236+0000 7f2c968ce740 1 Processor -- start 2024-09-19T06:17:35.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.236+0000 7f2c968ce740 1 -- start start 2024-09-19T06:17:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.236+0000 7f2c968ce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a7e9290b90 0x55a7e9290f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.236+0000 7f2c968ce740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e92914b0 0x55a7e929b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.236+0000 7f2c968ce740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a7e929bd70 0x55a7e929e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.236+0000 7f2c968ce740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a7e91f73e0 con 0x55a7e92914b0 2024-09-19T06:17:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.236+0000 7f2c968ce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a7e919ed80 con 0x55a7e9290b90 2024-09-19T06:17:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.236+0000 7f2c968ce740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a7e91f33a0 con 0x55a7e929bd70 2024-09-19T06:17:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.237+0000 7f2c91400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e92914b0 0x55a7e929b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.237+0000 7f2c91e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a7e9290b90 0x55a7e9290f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.237+0000 7f2c90a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a7e929bd70 0x55a7e929e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.237+0000 7f2c91400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e92914b0 0x55a7e929b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40796/0 (socket says 172.21.15.3:40796) 2024-09-19T06:17:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.237+0000 7f2c90a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a7e929bd70 0x55a7e929e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:52806/0 (socket says 172.21.15.3:52806) 2024-09-19T06:17:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.237+0000 7f2c91e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a7e9290b90 0x55a7e9290f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:43476/0 (socket says 172.21.15.3:43476) 2024-09-19T06:17:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.237+0000 7f2c91400640 1 -- 172.21.15.3:0/2579663195 learned_addr learned my addr 172.21.15.3:0/2579663195 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:35.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.237+0000 7f2c90a00640 1 -- 172.21.15.3:0/2579663195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a7e9290b90 msgr2=0x55a7e9290f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:35.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.237+0000 7f2c90a00640 1 --2- 172.21.15.3:0/2579663195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a7e9290b90 0x55a7e9290f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.237+0000 7f2c90a00640 1 -- 172.21.15.3:0/2579663195 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e92914b0 msgr2=0x55a7e929b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:35.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.237+0000 7f2c90a00640 1 --2- 172.21.15.3:0/2579663195 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e92914b0 0x55a7e929b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.237+0000 7f2c90a00640 1 -- 172.21.15.3:0/2579663195 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7e91bdae0 con 0x55a7e929bd70 2024-09-19T06:17:35.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.237+0000 7f2c8a000640 1 --2- 172.21.15.3:0/1861542103 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2c740a3430 0x7f2c740a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.237+0000 7f2c90a00640 1 --2- 172.21.15.3:0/2579663195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a7e929bd70 0x55a7e929e160 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c1a00a0 tx=0x7f2c78011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4611483718f7ea8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:35.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.238+0000 7f2c8a000640 1 -- 172.21.15.3:0/1861542103 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f2c800d0100 con 0x7f2c8c076720 2024-09-19T06:17:35.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.238+0000 7f2c91e00640 1 --2- 172.21.15.3:0/1861542103 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2c740a3430 0x7f2c740a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.238+0000 7f2c7e600640 1 -- 172.21.15.3:0/2579663195 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78009db0 con 0x55a7e929bd70 2024-09-19T06:17:35.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.238+0000 7f2c7e600640 1 -- 172.21.15.3:0/2579663195 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c780035f0 con 0x55a7e929bd70 2024-09-19T06:17:35.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.238+0000 7f2c7e600640 1 -- 172.21.15.3:0/2579663195 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78019650 con 0x55a7e929bd70 2024-09-19T06:17:35.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.239+0000 7f2c968ce740 1 -- 172.21.15.3:0/2579663195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a7e929bd70 msgr2=0x55a7e929e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:35.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.239+0000 7f2c968ce740 1 --2- 172.21.15.3:0/2579663195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a7e929bd70 0x55a7e929e160 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c1a00a0 tx=0x7f2c78011810 comp rx=0 tx=0).stop 2024-09-19T06:17:35.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.239+0000 7f2c91e00640 1 --2- 172.21.15.3:0/1861542103 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2c740a3430 0x7f2c740a58f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2c84009b30 tx=0x7f2c84005fd0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:35.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.239+0000 7f2c968ce740 1 -- 172.21.15.3:0/2579663195 shutdown_connections 2024-09-19T06:17:35.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.239+0000 7f2c968ce740 1 --2- 172.21.15.3:0/2579663195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a7e929bd70 0x55a7e929e160 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.239+0000 7f2c968ce740 1 --2- 172.21.15.3:0/2579663195 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e92914b0 0x55a7e929b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.239+0000 7f2c968ce740 1 --2- 172.21.15.3:0/2579663195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a7e9290b90 0x55a7e9290f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.239+0000 7f2c968ce740 1 -- 172.21.15.3:0/2579663195 >> 172.21.15.3:0/2579663195 conn(0x55a7e928d120 msgr2=0x55a7e928d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:35.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.239+0000 7f2c968ce740 1 -- 172.21.15.3:0/2579663195 shutdown_connections 2024-09-19T06:17:35.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.239+0000 7f2c968ce740 1 -- 172.21.15.3:0/2579663195 wait complete. 2024-09-19T06:17:35.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.239+0000 7f2c968ce740 1 -- start start 2024-09-19T06:17:35.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.240+0000 7f2c968ce740 1 Processor -- start 2024-09-19T06:17:35.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.240+0000 7f2c968ce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a7e9290b90 0x55a7e9298c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.240+0000 7f2c968ce740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a7e92914b0 0x55a7e9299180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.240+0000 7f2c968ce740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e929bd70 0x55a7e92996c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.240+0000 7f2c968ce740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a7e929e9e0 con 0x55a7e929bd70 2024-09-19T06:17:35.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.240+0000 7f2c968ce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a7e91b20f0 con 0x55a7e9290b90 2024-09-19T06:17:35.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.240+0000 7f2c968ce740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a7e929eb60 con 0x55a7e92914b0 2024-09-19T06:17:35.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.240+0000 7f2c968ce740 10 client.0 _ll_register_callbacks cb 0x55a7e91a39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:35.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.240+0000 7f2c91e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e929bd70 0x55a7e92996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.240+0000 7f2c90a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a7e92914b0 0x55a7e9299180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.240+0000 7f2c91e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e929bd70 0x55a7e92996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40800/0 (socket says 172.21.15.3:40800) 2024-09-19T06:17:35.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.240+0000 7f2c91e00640 1 -- 172.21.15.3:0/267639444 learned_addr learned my addr 172.21.15.3:0/267639444 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:35.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.240+0000 7f2c91400640 1 --2- 172.21.15.3:0/267639444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a7e9290b90 0x55a7e9298c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.241+0000 7f2c91e00640 1 -- 172.21.15.3:0/267639444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a7e92914b0 msgr2=0x55a7e9299180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:35.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.241+0000 7f2c91e00640 1 --2- 172.21.15.3:0/267639444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a7e92914b0 0x55a7e9299180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.241+0000 7f2c91e00640 1 -- 172.21.15.3:0/267639444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a7e9290b90 msgr2=0x55a7e9298c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:35.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.241+0000 7f2c91e00640 1 --2- 172.21.15.3:0/267639444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a7e9290b90 0x55a7e9298c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.241+0000 7f2c91e00640 1 -- 172.21.15.3:0/267639444 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7e8f683c0 con 0x55a7e929bd70 2024-09-19T06:17:35.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.241+0000 7f2c91400640 1 --2- 172.21.15.3:0/267639444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a7e9290b90 0x55a7e9298c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:35.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.241+0000 7f2c91e00640 1 --2- 172.21.15.3:0/267639444 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e929bd70 0x55a7e92996c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2c84009be0 tx=0x7f2c84009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb92284822dfde1d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:35.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.241+0000 7f2c72a00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:17:35.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.241+0000 7f2c72a00640 1 -- 172.21.15.3:0/267639444 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8404f070 con 0x55a7e929bd70 2024-09-19T06:17:35.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.242+0000 7f2c72a00640 1 -- 172.21.15.3:0/267639444 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f2c84003d80 con 0x55a7e929bd70 2024-09-19T06:17:35.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.242+0000 7f2c968ce740 1 -- 172.21.15.3:0/267639444 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c780035f0 con 0x55a7e929bd70 2024-09-19T06:17:35.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.242+0000 7f2c72a00640 1 -- 172.21.15.3:0/267639444 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2c8405b050 con 0x55a7e929bd70 2024-09-19T06:17:35.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.242+0000 7f2c968ce740 10 client.16575 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:35.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.242+0000 7f2c968ce740 1 -- 172.21.15.3:0/267639444 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a7e92aa670 con 0x55a7e929bd70 2024-09-19T06:17:35.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.242+0000 7f2c72a00640 1 -- 172.21.15.3:0/267639444 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c780035f0 con 0x55a7e929bd70 2024-09-19T06:17:35.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.243+0000 7f2c72a00640 1 -- 172.21.15.3:0/267639444 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2c8404b6b0 con 0x55a7e929bd70 2024-09-19T06:17:35.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.243+0000 7f2c968ce740 10 client.16575 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:35.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.243+0000 7f2c968ce740 10 client.16575 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:35.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.243+0000 7f2c968ce740 20 client.16575 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:35.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.243+0000 7f2c968ce740 1 --2- 172.21.15.3:0/267639444 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a7e92aba80 0x55a7e92adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.243+0000 7f2c968ce740 4 client.16575 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:17:35.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.243+0000 7f2c968ce740 1 -- 172.21.15.3:0/267639444 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7e9204950 con 0x55a7e92aba80 2024-09-19T06:17:35.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.243+0000 7f2c91400640 1 --2- 172.21.15.3:0/267639444 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a7e92aba80 0x55a7e92adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.244+0000 7f2c91400640 1 --2- 172.21.15.3:0/267639444 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a7e92aba80 0x55a7e92adf20 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9aa7b9ce88bde05 server_cookie=2f2e6c25e4c368ae in_seq=0 out_seq=0 2024-09-19T06:17:35.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.244+0000 7f2c72a00640 10 client.16575 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:35.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.244+0000 7f2c72a00640 1 -- 172.21.15.3:0/267639444 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a7e9204950 con 0x55a7e92aba80 2024-09-19T06:17:35.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.244+0000 7f2c72a00640 10 client.16575 handle_command_reply: tid=0 2024-09-19T06:17:35.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.244+0000 7f2c968ce740 1 client.16575 shutdown 2024-09-19T06:17:35.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.245+0000 7f2c968ce740 1 -- 172.21.15.3:0/267639444 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e929bd70 msgr2=0x55a7e92996c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:35.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.245+0000 7f2c968ce740 1 --2- 172.21.15.3:0/267639444 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e929bd70 0x55a7e92996c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2c84009be0 tx=0x7f2c84009500 comp rx=0 tx=0).stop 2024-09-19T06:17:35.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.245+0000 7f2c968ce740 1 -- 172.21.15.3:0/267639444 shutdown_connections 2024-09-19T06:17:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.245+0000 7f2c968ce740 1 --2- 172.21.15.3:0/267639444 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a7e92aba80 0x55a7e92adf20 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.245+0000 7f2c968ce740 1 --2- 172.21.15.3:0/267639444 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e929bd70 0x55a7e92996c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.245+0000 7f2c968ce740 1 --2- 172.21.15.3:0/267639444 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a7e92914b0 0x55a7e9299180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.245+0000 7f2c968ce740 1 --2- 172.21.15.3:0/267639444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a7e9290b90 0x55a7e9298c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.245+0000 7f2c968ce740 1 -- 172.21.15.3:0/267639444 >> 172.21.15.3:0/267639444 conn(0x55a7e928d120 msgr2=0x55a7e9292e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.245+0000 7f2c72a00640 0 client.16575 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.245+0000 7f2c968ce740 1 -- 172.21.15.3:0/267639444 shutdown_connections 2024-09-19T06:17:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.245+0000 7f2c968ce740 1 -- 172.21.15.3:0/267639444 wait complete. 2024-09-19T06:17:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.245+0000 7f2c968ce740 20 client.16575 trim_cache size 0 max 16384 2024-09-19T06:17:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.263+0000 7f2c968ce740 1 Processor -- start 2024-09-19T06:17:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.263+0000 7f2c968ce740 1 -- start start 2024-09-19T06:17:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.264+0000 7f2c968ce740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a7e9290b90 0x55a7e928d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.264+0000 7f2c968ce740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e92914b0 0x55a7e929abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.264+0000 7f2c968ce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a7e929bd70 0x55a7e92b3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.264+0000 7f2c968ce740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c1b3fb0 con 0x55a7e92914b0 2024-09-19T06:17:35.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.264+0000 7f2c968ce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c1b5af0 con 0x55a7e929bd70 2024-09-19T06:17:35.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.264+0000 7f2c968ce740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c1b4680 con 0x55a7e9290b90 2024-09-19T06:17:35.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.264+0000 7f2c90a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e92914b0 0x55a7e929abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.264+0000 7f2c91400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a7e9290b90 0x55a7e928d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.264+0000 7f2c91400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a7e9290b90 0x55a7e928d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:52812/0 (socket says 172.21.15.3:52812) 2024-09-19T06:17:35.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.264+0000 7f2c91400640 1 -- 172.21.15.3:0/3730705329 learned_addr learned my addr 172.21.15.3:0/3730705329 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:35.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.264+0000 7f2c91e00640 1 --2- 172.21.15.3:0/3730705329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a7e929bd70 0x55a7e92b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.264+0000 7f2c91400640 1 -- 172.21.15.3:0/3730705329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a7e929bd70 msgr2=0x55a7e92b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:35.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.264+0000 7f2c91400640 1 --2- 172.21.15.3:0/3730705329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a7e929bd70 0x55a7e92b3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.264+0000 7f2c91400640 1 -- 172.21.15.3:0/3730705329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e92914b0 msgr2=0x55a7e929abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:35.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.264+0000 7f2c91400640 1 --2- 172.21.15.3:0/3730705329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e92914b0 0x55a7e929abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.264+0000 7f2c91400640 1 -- 172.21.15.3:0/3730705329 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7e9297bf0 con 0x55a7e9290b90 2024-09-19T06:17:35.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.264+0000 7f2c90a00640 1 --2- 172.21.15.3:0/3730705329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e92914b0 0x55a7e929abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:35.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.265+0000 7f2c91400640 1 --2- 172.21.15.3:0/3730705329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a7e9290b90 0x55a7e928d500 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2c8009c080 tx=0x7f2c800bc040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e08f1747a24a09a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:35.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.267+0000 7f2c7dc00640 1 -- 172.21.15.3:0/3730705329 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8009c150 con 0x55a7e9290b90 2024-09-19T06:17:35.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.267+0000 7f2c7dc00640 1 -- 172.21.15.3:0/3730705329 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c8009ca80 con 0x55a7e9290b90 2024-09-19T06:17:35.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.267+0000 7f2c7dc00640 1 -- 172.21.15.3:0/3730705329 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8009bce0 con 0x55a7e9290b90 2024-09-19T06:17:35.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.267+0000 7f2c968ce740 1 -- 172.21.15.3:0/3730705329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a7e9290b90 msgr2=0x55a7e928d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:35.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.267+0000 7f2c968ce740 1 --2- 172.21.15.3:0/3730705329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a7e9290b90 0x55a7e928d500 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2c8009c080 tx=0x7f2c800bc040 comp rx=0 tx=0).stop 2024-09-19T06:17:35.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.268+0000 7f2c968ce740 1 -- 172.21.15.3:0/3730705329 shutdown_connections 2024-09-19T06:17:35.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.268+0000 7f2c968ce740 1 --2- 172.21.15.3:0/3730705329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a7e929bd70 0x55a7e92b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.268+0000 7f2c968ce740 1 --2- 172.21.15.3:0/3730705329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e92914b0 0x55a7e929abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.268+0000 7f2c968ce740 1 --2- 172.21.15.3:0/3730705329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a7e9290b90 0x55a7e928d500 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.268+0000 7f2c968ce740 1 -- 172.21.15.3:0/3730705329 >> 172.21.15.3:0/3730705329 conn(0x55a7e928d120 msgr2=0x55a7e929a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:35.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.268+0000 7f2c968ce740 1 -- 172.21.15.3:0/3730705329 shutdown_connections 2024-09-19T06:17:35.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.268+0000 7f2c968ce740 1 -- 172.21.15.3:0/3730705329 wait complete. 2024-09-19T06:17:35.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.268+0000 7f2c968ce740 1 -- start start 2024-09-19T06:17:35.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.268+0000 7f2c968ce740 1 Processor -- start 2024-09-19T06:17:35.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.269+0000 7f2c968ce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a7e9290b90 0x55a7e92a43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.269+0000 7f2c968ce740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a7e92914b0 0x55a7e929f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.269+0000 7f2c968ce740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e929bd70 0x55a7e929fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.269+0000 7f2c968ce740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c1b5420 con 0x55a7e929bd70 2024-09-19T06:17:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.269+0000 7f2c968ce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c1b4d50 con 0x55a7e9290b90 2024-09-19T06:17:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.269+0000 7f2c968ce740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8c1b1f90 con 0x55a7e92914b0 2024-09-19T06:17:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.269+0000 7f2c968ce740 10 client.0 _ll_register_callbacks cb 0x7f2c84030d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.269+0000 7f2c91e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e929bd70 0x55a7e929fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.269+0000 7f2c91400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a7e9290b90 0x55a7e92a43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.269+0000 7f2c91e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e929bd70 0x55a7e929fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40816/0 (socket says 172.21.15.3:40816) 2024-09-19T06:17:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.269+0000 7f2c91e00640 1 -- 172.21.15.3:0/3912959806 learned_addr learned my addr 172.21.15.3:0/3912959806 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.269+0000 7f2c90a00640 1 --2- 172.21.15.3:0/3912959806 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a7e92914b0 0x55a7e929f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.269+0000 7f2c91e00640 1 -- 172.21.15.3:0/3912959806 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a7e92914b0 msgr2=0x55a7e929f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.269+0000 7f2c91e00640 1 --2- 172.21.15.3:0/3912959806 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a7e92914b0 0x55a7e929f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.270+0000 7f2c91e00640 1 -- 172.21.15.3:0/3912959806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a7e9290b90 msgr2=0x55a7e92a43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:35.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.270+0000 7f2c91e00640 1 --2- 172.21.15.3:0/3912959806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a7e9290b90 0x55a7e92a43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.270+0000 7f2c91e00640 1 -- 172.21.15.3:0/3912959806 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7e92a0320 con 0x55a7e929bd70 2024-09-19T06:17:35.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.270+0000 7f2c91400640 1 --2- 172.21.15.3:0/3912959806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a7e9290b90 0x55a7e92a43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:35.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.270+0000 7f2c91e00640 1 --2- 172.21.15.3:0/3912959806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e929bd70 0x55a7e929fc30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2c8404bc70 tx=0x7f2c8404cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4606a4dc24498a05 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:35.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.270+0000 7f2c72a00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:17:35.296 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:17:35.296 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "no active scrubs running", 2024-09-19T06:17:35.296 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": {} 2024-09-19T06:17:35.296 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:17:35.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.270+0000 7f2c72a00640 1 -- 172.21.15.3:0/3912959806 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8404f040 con 0x55a7e929bd70 2024-09-19T06:17:35.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.270+0000 7f2c968ce740 1 -- 172.21.15.3:0/3912959806 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c8009ca80 con 0x55a7e929bd70 2024-09-19T06:17:35.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.270+0000 7f2c72a00640 1 -- 172.21.15.3:0/3912959806 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f2c840314c0 con 0x55a7e929bd70 2024-09-19T06:17:35.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.270+0000 7f2c72a00640 1 -- 172.21.15.3:0/3912959806 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2c84036040 con 0x55a7e929bd70 2024-09-19T06:17:35.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.270+0000 7f2c968ce740 10 client.16581 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:35.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.270+0000 7f2c968ce740 1 -- 172.21.15.3:0/3912959806 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a7e93166e0 con 0x55a7e929bd70 2024-09-19T06:17:35.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.271+0000 7f2c72a00640 1 -- 172.21.15.3:0/3912959806 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c8009ca80 con 0x55a7e929bd70 2024-09-19T06:17:35.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.271+0000 7f2c72a00640 1 -- 172.21.15.3:0/3912959806 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2c84070480 con 0x55a7e929bd70 2024-09-19T06:17:35.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.271+0000 7f2c968ce740 10 client.16581 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:35.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.271+0000 7f2c968ce740 10 client.16581 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:35.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.271+0000 7f2c968ce740 20 client.16581 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:35.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.271+0000 7f2c968ce740 1 --2- 172.21.15.3:0/3912959806 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a7e9316d80 0x55a7e93191a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:35.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.271+0000 7f2c968ce740 4 client.16581 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:17:35.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.271+0000 7f2c968ce740 1 -- 172.21.15.3:0/3912959806 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a7e91fee60 con 0x55a7e9316d80 2024-09-19T06:17:35.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.271+0000 7f2c91400640 1 --2- 172.21.15.3:0/3912959806 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a7e9316d80 0x55a7e93191a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:35.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.272+0000 7f2c91400640 1 --2- 172.21.15.3:0/3912959806 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a7e9316d80 0x55a7e93191a0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a41dc8912e40e272 server_cookie=428b663f119f1611 in_seq=0 out_seq=0 2024-09-19T06:17:35.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.272+0000 7f2c72a00640 10 client.16581 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:35.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.272+0000 7f2c72a00640 1 -- 172.21.15.3:0/3912959806 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a7e91fee60 con 0x55a7e9316d80 2024-09-19T06:17:35.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.272+0000 7f2c72a00640 10 client.16581 handle_command_reply: tid=0 2024-09-19T06:17:35.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.272+0000 7f2c968ce740 1 client.16581 shutdown 2024-09-19T06:17:35.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.272+0000 7f2c968ce740 1 -- 172.21.15.3:0/3912959806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e929bd70 msgr2=0x55a7e929fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:35.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.272+0000 7f2c968ce740 1 --2- 172.21.15.3:0/3912959806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e929bd70 0x55a7e929fc30 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2c8404bc70 tx=0x7f2c8404cf30 comp rx=0 tx=0).stop 2024-09-19T06:17:35.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.272+0000 7f2c968ce740 1 -- 172.21.15.3:0/3912959806 shutdown_connections 2024-09-19T06:17:35.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.272+0000 7f2c968ce740 1 --2- 172.21.15.3:0/3912959806 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a7e9316d80 0x55a7e93191a0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.272+0000 7f2c968ce740 1 --2- 172.21.15.3:0/3912959806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a7e929bd70 0x55a7e929fc30 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.272+0000 7f2c968ce740 1 --2- 172.21.15.3:0/3912959806 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a7e92914b0 0x55a7e929f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.272+0000 7f2c968ce740 1 --2- 172.21.15.3:0/3912959806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a7e9290b90 0x55a7e92a43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.272+0000 7f2c968ce740 1 -- 172.21.15.3:0/3912959806 >> 172.21.15.3:0/3912959806 conn(0x55a7e928d120 msgr2=0x55a7e929acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:35.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.272+0000 7f2c72a00640 0 client.16581 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:35.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.273+0000 7f2c968ce740 1 -- 172.21.15.3:0/3912959806 shutdown_connections 2024-09-19T06:17:35.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.273+0000 7f2c968ce740 1 -- 172.21.15.3:0/3912959806 wait complete. 2024-09-19T06:17:35.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.273+0000 7f2c968ce740 20 client.16581 trim_cache size 0 max 16384 2024-09-19T06:17:35.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.273+0000 7f2c93e00640 1 -- 172.21.15.3:0/1861542103 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2c740a3430 msgr2=0x7f2c740a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:35.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.273+0000 7f2c93e00640 1 --2- 172.21.15.3:0/1861542103 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2c740a3430 0x7f2c740a58f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2c84009b30 tx=0x7f2c84005fd0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.273+0000 7f2c93e00640 1 -- 172.21.15.3:0/1861542103 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2c8c076720 msgr2=0x7f2c8c1a46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:35.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.273+0000 7f2c93e00640 1 --2- 172.21.15.3:0/1861542103 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2c8c076720 0x7f2c8c1a46f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2c8000e9f0 tx=0x7f2c8000edf0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.273+0000 7f2c93e00640 1 -- 172.21.15.3:0/1861542103 shutdown_connections 2024-09-19T06:17:35.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.273+0000 7f2c93e00640 1 --2- 172.21.15.3:0/1861542103 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2c740a3430 0x7f2c740a58f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.273+0000 7f2c93e00640 1 --2- 172.21.15.3:0/1861542103 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2c8c112a50 0x7f2c8c19e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.273+0000 7f2c93e00640 1 --2- 172.21.15.3:0/1861542103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8c077040 0x7f2c8c1a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.274+0000 7f2c93e00640 1 --2- 172.21.15.3:0/1861542103 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2c8c076720 0x7f2c8c1a46f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:35.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.274+0000 7f2c93e00640 1 -- 172.21.15.3:0/1861542103 >> 172.21.15.3:0/1861542103 conn(0x7f2c8c0ffa50 msgr2=0x7f2c8c101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:35.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.274+0000 7f2c93e00640 1 -- 172.21.15.3:0/1861542103 shutdown_connections 2024-09-19T06:17:35.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:35.274+0000 7f2c93e00640 1 -- 172.21.15.3:0/1861542103 wait complete. 2024-09-19T06:17:36.251 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:17:36.252 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:17:36.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:36 smithi059 ceph-mon[35138]: pgmap v159: 97 pgs: 97 active+clean; 3.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 22 op/s 2024-09-19T06:17:36.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:36 smithi003 ceph-mon[30893]: pgmap v159: 97 pgs: 97 active+clean; 3.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 22 op/s 2024-09-19T06:17:36.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:36 smithi071 ceph-mon[35662]: pgmap v159: 97 pgs: 97 active+clean; 3.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 22 op/s 2024-09-19T06:17:36.632 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:17:37.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.246+0000 7f277f000640 1 -- 172.21.15.3:0/1962679370 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2778108f60 msgr2=0x7f2778110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:37.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.246+0000 7f277f000640 1 --2- 172.21.15.3:0/1962679370 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2778108f60 0x7f2778110ae0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2770009900 tx=0x7f277002a3f0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.246+0000 7f277f000640 1 -- 172.21.15.3:0/1962679370 shutdown_connections 2024-09-19T06:17:37.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.246+0000 7f277f000640 1 --2- 172.21.15.3:0/1962679370 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2778108f60 0x7f2778110ae0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.246+0000 7f277f000640 1 --2- 172.21.15.3:0/1962679370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27781047e0 0x7f2778108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.246+0000 7f277f000640 1 --2- 172.21.15.3:0/1962679370 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2778103e30 0x7f2778104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.246+0000 7f277f000640 1 -- 172.21.15.3:0/1962679370 >> 172.21.15.3:0/1962679370 conn(0x7f27780ff8d0 msgr2=0x7f2778101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:37.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.246+0000 7f277f000640 1 -- 172.21.15.3:0/1962679370 shutdown_connections 2024-09-19T06:17:37.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.246+0000 7f277f000640 1 -- 172.21.15.3:0/1962679370 wait complete. 2024-09-19T06:17:37.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.247+0000 7f277f000640 1 Processor -- start 2024-09-19T06:17:37.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.247+0000 7f277f000640 1 -- start start 2024-09-19T06:17:37.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.248+0000 7f277f000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2778103e30 0x7f277819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.248+0000 7f277f000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27781047e0 0x7f277819a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.248+0000 7f277f000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2778108f60 0x7f277819ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.248+0000 7f277f000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2778114010 con 0x7f2778103e30 2024-09-19T06:17:37.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.248+0000 7f277f000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2778113e90 con 0x7f2778108f60 2024-09-19T06:17:37.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.248+0000 7f277f000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2778114190 con 0x7f27781047e0 2024-09-19T06:17:37.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.248+0000 7f277dc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2778103e30 0x7f277819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.248+0000 7f277dc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2778103e30 0x7f277819a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40846/0 (socket says 172.21.15.3:40846) 2024-09-19T06:17:37.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.248+0000 7f277dc00640 1 -- 172.21.15.3:0/2191114308 learned_addr learned my addr 172.21.15.3:0/2191114308 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:37.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.248+0000 7f277d200640 1 --2- 172.21.15.3:0/2191114308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27781047e0 0x7f277819a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.248+0000 7f277e600640 1 --2- 172.21.15.3:0/2191114308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2778108f60 0x7f277819ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.249+0000 7f277dc00640 1 -- 172.21.15.3:0/2191114308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27781047e0 msgr2=0x7f277819a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:37.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.249+0000 7f277dc00640 1 --2- 172.21.15.3:0/2191114308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27781047e0 0x7f277819a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.249+0000 7f277dc00640 1 -- 172.21.15.3:0/2191114308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2778108f60 msgr2=0x7f277819ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:37.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.249+0000 7f277dc00640 1 --2- 172.21.15.3:0/2191114308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2778108f60 0x7f277819ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.249+0000 7f277dc00640 1 -- 172.21.15.3:0/2191114308 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f277819f3c0 con 0x7f2778103e30 2024-09-19T06:17:37.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.249+0000 7f277dc00640 1 --2- 172.21.15.3:0/2191114308 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2778103e30 0x7f277819a410 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f276c00eb90 tx=0x7f276c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:37.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.249+0000 7f2776000640 1 -- 172.21.15.3:0/2191114308 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c004d20 con 0x7f2778103e30 2024-09-19T06:17:37.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.249+0000 7f277f000640 1 -- 172.21.15.3:0/2191114308 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f277819f6b0 con 0x7f2778103e30 2024-09-19T06:17:37.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.249+0000 7f2776000640 1 -- 172.21.15.3:0/2191114308 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f276c00ee90 con 0x7f2778103e30 2024-09-19T06:17:37.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.249+0000 7f2776000640 1 -- 172.21.15.3:0/2191114308 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c010830 con 0x7f2778103e30 2024-09-19T06:17:37.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.249+0000 7f277f000640 1 -- 172.21.15.3:0/2191114308 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27781a6f90 con 0x7f2778103e30 2024-09-19T06:17:37.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.250+0000 7f277f000640 1 -- 172.21.15.3:0/2191114308 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2778104210 con 0x7f2778103e30 2024-09-19T06:17:37.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.252+0000 7f2776000640 1 -- 172.21.15.3:0/2191114308 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f276c005020 con 0x7f2778103e30 2024-09-19T06:17:37.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.253+0000 7f2776000640 1 --2- 172.21.15.3:0/2191114308 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f27600a3430 0x7f27600a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:37.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.254+0000 7f2776000640 1 -- 172.21.15.3:0/2191114308 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f276c0d0360 con 0x7f2778103e30 2024-09-19T06:17:37.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.254+0000 7f277d200640 1 --2- 172.21.15.3:0/2191114308 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f27600a3430 0x7f27600a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:37.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.255+0000 7f277d200640 1 --2- 172.21.15.3:0/2191114308 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f27600a3430 0x7f27600a58f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2778100140 tx=0x7f2764005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:37.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.258+0000 7f2776000640 1 -- 172.21.15.3:0/2191114308 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f276c09cce0 con 0x7f2778103e30 2024-09-19T06:17:37.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.483+0000 7f277f000640 1 -- 172.21.15.3:0/2191114308 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f277819b770 con 0x7f2778103e30 2024-09-19T06:17:37.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.484+0000 7f2776000640 1 -- 172.21.15.3:0/2191114308 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7f276c09c5e0 con 0x7f2778103e30 2024-09-19T06:17:37.486 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:17:37.486 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"btime":"2024-09-19T06:12:22:958217+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:12:22.060987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24532,24515,24514,14517]},"id":1}]} 2024-09-19T06:17:37.487 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2024-09-19T06:17:37.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.486+0000 7f277f000640 1 -- 172.21.15.3:0/2191114308 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f27600a3430 msgr2=0x7f27600a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:37.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.486+0000 7f277f000640 1 --2- 172.21.15.3:0/2191114308 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f27600a3430 0x7f27600a58f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2778100140 tx=0x7f2764005f90 comp rx=0 tx=0).stop 2024-09-19T06:17:37.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.486+0000 7f277f000640 1 -- 172.21.15.3:0/2191114308 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2778103e30 msgr2=0x7f277819a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:37.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.486+0000 7f277f000640 1 --2- 172.21.15.3:0/2191114308 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2778103e30 0x7f277819a410 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f276c00eb90 tx=0x7f276c00c6a0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.486+0000 7f277f000640 1 -- 172.21.15.3:0/2191114308 shutdown_connections 2024-09-19T06:17:37.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.486+0000 7f277f000640 1 --2- 172.21.15.3:0/2191114308 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f27600a3430 0x7f27600a58f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.486+0000 7f277f000640 1 --2- 172.21.15.3:0/2191114308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2778108f60 0x7f277819ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.486+0000 7f277f000640 1 --2- 172.21.15.3:0/2191114308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f27781047e0 0x7f277819a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.486+0000 7f277f000640 1 --2- 172.21.15.3:0/2191114308 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2778103e30 0x7f277819a410 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:37.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.486+0000 7f277f000640 1 -- 172.21.15.3:0/2191114308 >> 172.21.15.3:0/2191114308 conn(0x7f27780ff8d0 msgr2=0x7f2778100410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:37.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.487+0000 7f277f000640 1 -- 172.21.15.3:0/2191114308 shutdown_connections 2024-09-19T06:17:37.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:37.487+0000 7f277f000640 1 -- 172.21.15.3:0/2191114308 wait complete. 2024-09-19T06:17:38.382 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:17:38.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:38 smithi059 ceph-mon[35138]: pgmap v160: 97 pgs: 97 active+clean; 3.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-19T06:17:38.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:38 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2191114308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:17:38.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:38 smithi003 ceph-mon[30893]: pgmap v160: 97 pgs: 97 active+clean; 3.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-19T06:17:38.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:38 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2191114308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:17:38.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:38 smithi071 ceph-mon[35662]: pgmap v160: 97 pgs: 97 active+clean; 3.4 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-19T06:17:38.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:38 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2191114308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:17:38.783 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:17:39.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.431+0000 7eff81c00640 1 -- 172.21.15.3:0/3010855847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff7c112a30 msgr2=0x7eff7c114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:39.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.431+0000 7eff81c00640 1 --2- 172.21.15.3:0/3010855847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff7c112a30 0x7eff7c114e20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7eff74009be0 tx=0x7eff7402a6c0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.431+0000 7eff81c00640 1 -- 172.21.15.3:0/3010855847 shutdown_connections 2024-09-19T06:17:39.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.431+0000 7eff81c00640 1 --2- 172.21.15.3:0/3010855847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff7c112a30 0x7eff7c114e20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.431+0000 7eff81c00640 1 --2- 172.21.15.3:0/3010855847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff7c077040 0x7eff7c1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.431+0000 7eff81c00640 1 --2- 172.21.15.3:0/3010855847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff7c076720 0x7eff7c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.431+0000 7eff81c00640 1 -- 172.21.15.3:0/3010855847 >> 172.21.15.3:0/3010855847 conn(0x7eff7c0ffa90 msgr2=0x7eff7c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:39.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.431+0000 7eff81c00640 1 -- 172.21.15.3:0/3010855847 shutdown_connections 2024-09-19T06:17:39.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.431+0000 7eff81c00640 1 -- 172.21.15.3:0/3010855847 wait complete. 2024-09-19T06:17:39.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.432+0000 7eff81c00640 1 Processor -- start 2024-09-19T06:17:39.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.433+0000 7eff81c00640 1 -- start start 2024-09-19T06:17:39.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.433+0000 7eff81c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff7c076720 0x7eff7c1a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:39.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.433+0000 7eff81c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff7c077040 0x7eff7c1a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:39.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.433+0000 7eff81c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff7c112a30 0x7eff7c19e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:39.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.433+0000 7eff81c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7eff7c118590 con 0x7eff7c077040 2024-09-19T06:17:39.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.433+0000 7eff81c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7eff7c118410 con 0x7eff7c076720 2024-09-19T06:17:39.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.433+0000 7eff81c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7eff7c118710 con 0x7eff7c112a30 2024-09-19T06:17:39.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.433+0000 7eff7a000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff7c077040 0x7eff7c1a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:39.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.434+0000 7eff7aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff7c076720 0x7eff7c1a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:39.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.434+0000 7eff7a000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff7c077040 0x7eff7c1a4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40858/0 (socket says 172.21.15.3:40858) 2024-09-19T06:17:39.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.434+0000 7eff7a000640 1 -- 172.21.15.3:0/45429664 learned_addr learned my addr 172.21.15.3:0/45429664 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:39.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.434+0000 7eff7b400640 1 --2- 172.21.15.3:0/45429664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff7c112a30 0x7eff7c19e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:39.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.434+0000 7eff7aa00640 1 -- 172.21.15.3:0/45429664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff7c112a30 msgr2=0x7eff7c19e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:39.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.434+0000 7eff7aa00640 1 --2- 172.21.15.3:0/45429664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff7c112a30 0x7eff7c19e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.434+0000 7eff7aa00640 1 -- 172.21.15.3:0/45429664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff7c077040 msgr2=0x7eff7c1a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:39.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.434+0000 7eff7aa00640 1 --2- 172.21.15.3:0/45429664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff7c077040 0x7eff7c1a4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.434+0000 7eff7aa00640 1 -- 172.21.15.3:0/45429664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7c19efb0 con 0x7eff7c076720 2024-09-19T06:17:39.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.434+0000 7eff7b400640 1 --2- 172.21.15.3:0/45429664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff7c112a30 0x7eff7c19e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:17:39.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.434+0000 7eff7aa00640 1 --2- 172.21.15.3:0/45429664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff7c076720 0x7eff7c1a46c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7eff6c005fd0 tx=0x7eff6c00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:39.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.435+0000 7eff73400640 1 -- 172.21.15.3:0/45429664 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6c00cd00 con 0x7eff7c076720 2024-09-19T06:17:39.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.435+0000 7eff73400640 1 -- 172.21.15.3:0/45429664 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff6c0035f0 con 0x7eff7c076720 2024-09-19T06:17:39.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.435+0000 7eff81c00640 1 -- 172.21.15.3:0/45429664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff7c19f2a0 con 0x7eff7c076720 2024-09-19T06:17:39.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.435+0000 7eff73400640 1 -- 172.21.15.3:0/45429664 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6c010650 con 0x7eff7c076720 2024-09-19T06:17:39.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.435+0000 7eff81c00640 1 -- 172.21.15.3:0/45429664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff7c1ab590 con 0x7eff7c076720 2024-09-19T06:17:39.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.438+0000 7eff73400640 1 -- 172.21.15.3:0/45429664 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7eff6c003fe0 con 0x7eff7c076720 2024-09-19T06:17:39.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.439+0000 7eff8468b740 1 Processor -- start 2024-09-19T06:17:39.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.440+0000 7eff8468b740 1 -- start start 2024-09-19T06:17:39.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.440+0000 7eff8468b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef1dc70 0x55eadef1e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:39.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.440+0000 7eff8468b740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eadef1e590 0x55eadef28910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:39.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.440+0000 7eff73400640 1 --2- 172.21.15.3:0/45429664 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7eff600a3430 0x7eff600a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:39.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.440+0000 7eff8468b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eadef28e50 0x55eadef2b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:39.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.440+0000 7eff8468b740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55eadee843e0 con 0x55eadef1e590 2024-09-19T06:17:39.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.440+0000 7eff8468b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55eadee2bd80 con 0x55eadef28e50 2024-09-19T06:17:39.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.440+0000 7eff8468b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55eadee803a0 con 0x55eadef1dc70 2024-09-19T06:17:39.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.441+0000 7eff7b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef1dc70 0x55eadef1e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:39.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.441+0000 7eff7b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef1dc70 0x55eadef1e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:52882/0 (socket says 172.21.15.3:52882) 2024-09-19T06:17:39.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.441+0000 7eff7b400640 1 -- 172.21.15.3:0/2765683893 learned_addr learned my addr 172.21.15.3:0/2765683893 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:39.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.441+0000 7eff7aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eadef1e590 0x55eadef28910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:39.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.441+0000 7eff7b400640 1 --2- 172.21.15.3:0/2765683893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eadef28e50 0x55eadef2b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:39.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.441+0000 7eff7a000640 1 --2- 172.21.15.3:0/45429664 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7eff600a3430 0x7eff600a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:39.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.441+0000 7eff73400640 1 -- 172.21.15.3:0/45429664 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7eff6c0cff60 con 0x7eff7c076720 2024-09-19T06:17:39.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.441+0000 7eff7b400640 1 -- 172.21.15.3:0/2765683893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eadef28e50 msgr2=0x55eadef2b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:39.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.441+0000 7eff7b400640 1 --2- 172.21.15.3:0/2765683893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eadef28e50 0x55eadef2b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.441+0000 7eff7b400640 1 -- 172.21.15.3:0/2765683893 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eadef1e590 msgr2=0x55eadef28910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:39.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.441+0000 7eff7b400640 1 --2- 172.21.15.3:0/2765683893 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eadef1e590 0x55eadef28910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.441+0000 7eff7b400640 1 -- 172.21.15.3:0/2765683893 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eadee4aae0 con 0x55eadef1dc70 2024-09-19T06:17:39.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.442+0000 7eff7b400640 1 --2- 172.21.15.3:0/2765683893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef1dc70 0x55eadef1e050 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7eff74004af0 tx=0x7eff74004a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81e661f470ba7d51 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:39.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.442+0000 7eff67e00640 1 -- 172.21.15.3:0/2765683893 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff74036040 con 0x55eadef1dc70 2024-09-19T06:17:39.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.442+0000 7eff7a000640 1 --2- 172.21.15.3:0/45429664 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7eff600a3430 0x7eff600a58f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7eff7c079300 tx=0x7eff68005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:39.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.442+0000 7eff67e00640 1 -- 172.21.15.3:0/2765683893 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff74003e50 con 0x55eadef1dc70 2024-09-19T06:17:39.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.442+0000 7eff67e00640 1 -- 172.21.15.3:0/2765683893 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff74004570 con 0x55eadef1dc70 2024-09-19T06:17:39.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.443+0000 7eff8468b740 1 -- 172.21.15.3:0/2765683893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef1dc70 msgr2=0x55eadef1e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:39.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.443+0000 7eff8468b740 1 --2- 172.21.15.3:0/2765683893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef1dc70 0x55eadef1e050 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7eff74004af0 tx=0x7eff74004a60 comp rx=0 tx=0).stop 2024-09-19T06:17:39.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.443+0000 7eff8468b740 1 -- 172.21.15.3:0/2765683893 shutdown_connections 2024-09-19T06:17:39.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.443+0000 7eff8468b740 1 --2- 172.21.15.3:0/2765683893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eadef28e50 0x55eadef2b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.443+0000 7eff8468b740 1 --2- 172.21.15.3:0/2765683893 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eadef1e590 0x55eadef28910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.443+0000 7eff8468b740 1 --2- 172.21.15.3:0/2765683893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef1dc70 0x55eadef1e050 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.443+0000 7eff8468b740 1 -- 172.21.15.3:0/2765683893 >> 172.21.15.3:0/2765683893 conn(0x55eadef1a200 msgr2=0x55eadef1a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:39.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.443+0000 7eff8468b740 1 -- 172.21.15.3:0/2765683893 shutdown_connections 2024-09-19T06:17:39.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.443+0000 7eff8468b740 1 -- 172.21.15.3:0/2765683893 wait complete. 2024-09-19T06:17:39.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.444+0000 7eff8468b740 1 -- start start 2024-09-19T06:17:39.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.444+0000 7eff8468b740 1 Processor -- start 2024-09-19T06:17:39.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.445+0000 7eff8468b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eadef1dc70 0x55eadef25d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:39.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.445+0000 7eff8468b740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eadef1e590 0x55eadef262c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:39.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.445+0000 7eff8468b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef28e50 0x55eadef26800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:39.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.445+0000 7eff8468b740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55eadef2ba20 con 0x55eadef1e590 2024-09-19T06:17:39.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.445+0000 7eff8468b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55eadee3f0f0 con 0x55eadef1dc70 2024-09-19T06:17:39.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.445+0000 7eff8468b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55eadef2bba0 con 0x55eadef28e50 2024-09-19T06:17:39.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.445+0000 7eff8468b740 10 client.0 _ll_register_callbacks cb 0x55eadee26bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:39.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.445+0000 7eff7aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eadef1dc70 0x55eadef25d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:39.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.445+0000 7eff7a000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eadef1e590 0x55eadef262c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:39.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.445+0000 7eff7aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eadef1dc70 0x55eadef25d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:43566/0 (socket says 172.21.15.3:43566) 2024-09-19T06:17:39.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.445+0000 7eff7aa00640 1 -- 172.21.15.3:0/3706125074 learned_addr learned my addr 172.21.15.3:0/3706125074 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:39.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.445+0000 7eff7b400640 1 --2- 172.21.15.3:0/3706125074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef28e50 0x55eadef26800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:39.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.446+0000 7eff7a000640 1 -- 172.21.15.3:0/3706125074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef28e50 msgr2=0x55eadef26800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:39.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.446+0000 7eff7a000640 1 --2- 172.21.15.3:0/3706125074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef28e50 0x55eadef26800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.446+0000 7eff7a000640 1 -- 172.21.15.3:0/3706125074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eadef1dc70 msgr2=0x55eadef25d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:39.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.446+0000 7eff7a000640 1 --2- 172.21.15.3:0/3706125074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eadef1dc70 0x55eadef25d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.446+0000 7eff7a000640 1 -- 172.21.15.3:0/3706125074 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eadebf53c0 con 0x55eadef1e590 2024-09-19T06:17:39.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.446+0000 7eff7aa00640 1 --2- 172.21.15.3:0/3706125074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eadef1dc70 0x55eadef25d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:39.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.446+0000 7eff7a000640 1 --2- 172.21.15.3:0/3706125074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eadef1e590 0x55eadef262c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7eff6801cb80 tx=0x7eff68004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1d66784bf1c46c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:39.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.446+0000 7eff64c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:17:39.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.446+0000 7eff64c00640 1 -- 172.21.15.3:0/3706125074 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6801ce70 con 0x55eadef1e590 2024-09-19T06:17:39.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.446+0000 7eff64c00640 1 -- 172.21.15.3:0/3706125074 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7eff6800f8c0 con 0x55eadef1e590 2024-09-19T06:17:39.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.446+0000 7eff8468b740 1 -- 172.21.15.3:0/3706125074 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff74003e50 con 0x55eadef1e590 2024-09-19T06:17:39.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.447+0000 7eff64c00640 1 -- 172.21.15.3:0/3706125074 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7eff6800fac0 con 0x55eadef1e590 2024-09-19T06:17:39.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.447+0000 7eff8468b740 10 client.16599 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:39.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.447+0000 7eff8468b740 1 -- 172.21.15.3:0/3706125074 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55eadef37b10 con 0x55eadef1e590 2024-09-19T06:17:39.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.447+0000 7eff64c00640 1 -- 172.21.15.3:0/3706125074 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff74003e50 con 0x55eadef1e590 2024-09-19T06:17:39.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.447+0000 7eff64c00640 1 -- 172.21.15.3:0/3706125074 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7eff68028480 con 0x55eadef1e590 2024-09-19T06:17:39.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.447+0000 7eff8468b740 10 client.16599 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:39.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.447+0000 7eff8468b740 10 client.16599 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:17:39.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.448+0000 7eff8468b740 20 client.16599 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:39.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.448+0000 7eff8468b740 1 --2- 172.21.15.3:0/3706125074 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55eadef38f20 0x55eadef3b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:39.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.448+0000 7eff8468b740 4 client.16599 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:17:39.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.448+0000 7eff8468b740 1 -- 172.21.15.3:0/3706125074 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eadee91950 con 0x55eadef38f20 2024-09-19T06:17:39.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.448+0000 7eff7aa00640 1 --2- 172.21.15.3:0/3706125074 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55eadef38f20 0x55eadef3b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:39.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.449+0000 7eff7aa00640 1 --2- 172.21.15.3:0/3706125074 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55eadef38f20 0x55eadef3b3a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c3df2716cf852968 server_cookie=1db75f20ecafc2ac in_seq=0 out_seq=0 2024-09-19T06:17:39.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.449+0000 7eff64c00640 10 client.16599 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:17:39.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.449+0000 7eff64c00640 1 -- 172.21.15.3:0/3706125074 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eadee91950 con 0x55eadef38f20 2024-09-19T06:17:39.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.449+0000 7eff64c00640 10 client.16599 handle_command_reply: tid=0 2024-09-19T06:17:39.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.449+0000 7eff8468b740 1 client.16599 shutdown 2024-09-19T06:17:39.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.450+0000 7eff8468b740 1 -- 172.21.15.3:0/3706125074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eadef1e590 msgr2=0x55eadef262c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:39.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.450+0000 7eff8468b740 1 --2- 172.21.15.3:0/3706125074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eadef1e590 0x55eadef262c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7eff6801cb80 tx=0x7eff68004730 comp rx=0 tx=0).stop 2024-09-19T06:17:39.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.450+0000 7eff8468b740 1 -- 172.21.15.3:0/3706125074 shutdown_connections 2024-09-19T06:17:39.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.450+0000 7eff8468b740 1 --2- 172.21.15.3:0/3706125074 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55eadef38f20 0x55eadef3b3a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.450+0000 7eff8468b740 1 --2- 172.21.15.3:0/3706125074 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef28e50 0x55eadef26800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.450+0000 7eff8468b740 1 --2- 172.21.15.3:0/3706125074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eadef1e590 0x55eadef262c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.450+0000 7eff8468b740 1 --2- 172.21.15.3:0/3706125074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eadef1dc70 0x55eadef25d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.450+0000 7eff8468b740 1 -- 172.21.15.3:0/3706125074 >> 172.21.15.3:0/3706125074 conn(0x55eadef1a200 msgr2=0x55eadef1ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:39.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.450+0000 7eff64c00640 0 client.16599 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:17:39.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.450+0000 7eff8468b740 1 -- 172.21.15.3:0/3706125074 shutdown_connections 2024-09-19T06:17:39.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.450+0000 7eff8468b740 1 -- 172.21.15.3:0/3706125074 wait complete. 2024-09-19T06:17:39.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.450+0000 7eff8468b740 20 client.16599 trim_cache size 0 max 16384 2024-09-19T06:17:39.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.465+0000 7eff8468b740 1 Processor -- start 2024-09-19T06:17:39.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.465+0000 7eff8468b740 1 -- start start 2024-09-19T06:17:39.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.465+0000 7eff8468b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef1dc70 0x55eadef206d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:39.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.465+0000 7eff8468b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eadef1e590 0x55eadef27cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:39.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.465+0000 7eff8468b740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eadef28e50 0x55eadef40cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:39.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.465+0000 7eff8468b740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7eff7c1b3fb0 con 0x55eadef28e50 2024-09-19T06:17:39.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.465+0000 7eff8468b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7eff7c1b5af0 con 0x55eadef1e590 2024-09-19T06:17:39.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.465+0000 7eff8468b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7eff7c1b4680 con 0x55eadef1dc70 2024-09-19T06:17:39.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.465+0000 7eff7aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef1dc70 0x55eadef206d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:39.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.465+0000 7eff7a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eadef1e590 0x55eadef27cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:39.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.465+0000 7eff7aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef1dc70 0x55eadef206d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:52898/0 (socket says 172.21.15.3:52898) 2024-09-19T06:17:39.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.465+0000 7eff7a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eadef1e590 0x55eadef27cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:43570/0 (socket says 172.21.15.3:43570) 2024-09-19T06:17:39.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.465+0000 7eff7aa00640 1 -- 172.21.15.3:0/3366389996 learned_addr learned my addr 172.21.15.3:0/3366389996 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:39.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.466+0000 7eff7aa00640 1 -- 172.21.15.3:0/3366389996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eadef1e590 msgr2=0x55eadef27cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:39.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.466+0000 7eff7aa00640 1 --2- 172.21.15.3:0/3366389996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eadef1e590 0x55eadef27cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.466+0000 7eff7b400640 1 --2- 172.21.15.3:0/3366389996 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eadef28e50 0x55eadef40cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:39.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.466+0000 7eff7aa00640 1 -- 172.21.15.3:0/3366389996 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eadef28e50 msgr2=0x55eadef40cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:39.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.466+0000 7eff7aa00640 1 --2- 172.21.15.3:0/3366389996 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eadef28e50 0x55eadef40cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.466+0000 7eff7aa00640 1 -- 172.21.15.3:0/3366389996 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eadef1b2b0 con 0x55eadef1dc70 2024-09-19T06:17:39.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.466+0000 7eff7b400640 1 --2- 172.21.15.3:0/3366389996 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eadef28e50 0x55eadef40cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:17:39.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.466+0000 7eff7aa00640 1 --2- 172.21.15.3:0/3366389996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef1dc70 0x55eadef206d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7eff6c09c170 tx=0x7eff6c0cf040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3eda41c1dae89d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:39.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.467+0000 7eff67400640 1 -- 172.21.15.3:0/3366389996 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6c0a0590 con 0x55eadef1dc70 2024-09-19T06:17:39.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.467+0000 7eff67400640 1 -- 172.21.15.3:0/3366389996 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff6c0a4e50 con 0x55eadef1dc70 2024-09-19T06:17:39.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.467+0000 7eff67400640 1 -- 172.21.15.3:0/3366389996 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6c092b60 con 0x55eadef1dc70 2024-09-19T06:17:39.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.467+0000 7eff8468b740 1 -- 172.21.15.3:0/3366389996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef1dc70 msgr2=0x55eadef206d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:39.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.467+0000 7eff8468b740 1 --2- 172.21.15.3:0/3366389996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef1dc70 0x55eadef206d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7eff6c09c170 tx=0x7eff6c0cf040 comp rx=0 tx=0).stop 2024-09-19T06:17:39.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.467+0000 7eff8468b740 1 -- 172.21.15.3:0/3366389996 shutdown_connections 2024-09-19T06:17:39.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.467+0000 7eff8468b740 1 --2- 172.21.15.3:0/3366389996 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eadef28e50 0x55eadef40cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.467+0000 7eff8468b740 1 --2- 172.21.15.3:0/3366389996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eadef1e590 0x55eadef27cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.467+0000 7eff8468b740 1 --2- 172.21.15.3:0/3366389996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef1dc70 0x55eadef206d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.467+0000 7eff8468b740 1 -- 172.21.15.3:0/3366389996 >> 172.21.15.3:0/3366389996 conn(0x55eadef1a200 msgr2=0x55eadef275e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:39.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.468+0000 7eff8468b740 1 -- 172.21.15.3:0/3366389996 shutdown_connections 2024-09-19T06:17:39.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.468+0000 7eff8468b740 1 -- 172.21.15.3:0/3366389996 wait complete. 2024-09-19T06:17:39.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.468+0000 7eff8468b740 1 -- start start 2024-09-19T06:17:39.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.468+0000 7eff8468b740 1 Processor -- start 2024-09-19T06:17:39.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.469+0000 7eff8468b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eadef1dc70 0x55eadef315a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:39.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.469+0000 7eff8468b740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eadef1e590 0x55eadef2c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:39.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.469+0000 7eff8468b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef28e50 0x55eadef2ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:39.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.469+0000 7eff8468b740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7eff7c1b5420 con 0x55eadef1e590 2024-09-19T06:17:39.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.469+0000 7eff8468b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7eff7c1b4d50 con 0x55eadef1dc70 2024-09-19T06:17:39.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.469+0000 7eff8468b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7eff7c1b1f90 con 0x55eadef28e50 2024-09-19T06:17:39.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.469+0000 7eff8468b740 10 client.0 _ll_register_callbacks cb 0x7eff680099a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:39.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.469+0000 7eff7a000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eadef1e590 0x55eadef2c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:39.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.469+0000 7eff7a000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eadef1e590 0x55eadef2c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40884/0 (socket says 172.21.15.3:40884) 2024-09-19T06:17:39.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.469+0000 7eff7b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef28e50 0x55eadef2ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:39.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.469+0000 7eff7a000640 1 -- 172.21.15.3:0/12162049 learned_addr learned my addr 172.21.15.3:0/12162049 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:39.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.469+0000 7eff7aa00640 1 --2- 172.21.15.3:0/12162049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eadef1dc70 0x55eadef315a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:39.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.470+0000 7eff7b400640 1 -- 172.21.15.3:0/12162049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eadef1dc70 msgr2=0x55eadef315a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:39.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.470+0000 7eff7b400640 1 --2- 172.21.15.3:0/12162049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eadef1dc70 0x55eadef315a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.470+0000 7eff7b400640 1 -- 172.21.15.3:0/12162049 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eadef1e590 msgr2=0x55eadef2c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:39.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.470+0000 7eff7b400640 1 --2- 172.21.15.3:0/12162049 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eadef1e590 0x55eadef2c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.470+0000 7eff7b400640 1 -- 172.21.15.3:0/12162049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eadef15770 con 0x55eadef28e50 2024-09-19T06:17:39.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.470+0000 7eff7aa00640 1 --2- 172.21.15.3:0/12162049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eadef1dc70 0x55eadef315a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:39.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.470+0000 7eff7a000640 1 --2- 172.21.15.3:0/12162049 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eadef1e590 0x55eadef2c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:39.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.470+0000 7eff7b400640 1 --2- 172.21.15.3:0/12162049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef28e50 0x55eadef2ce60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7eff74000f80 tx=0x7eff74030e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86742969cec74a74 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:39.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.470+0000 7eff64c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:17:39.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.470+0000 7eff64c00640 1 -- 172.21.15.3:0/12162049 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7404e070 con 0x55eadef28e50 2024-09-19T06:17:39.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.470+0000 7eff64c00640 1 -- 172.21.15.3:0/12162049 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7eff74004300 con 0x55eadef28e50 2024-09-19T06:17:39.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.470+0000 7eff8468b740 1 -- 172.21.15.3:0/12162049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff6c0a4e50 con 0x55eadef28e50 2024-09-19T06:17:39.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.470+0000 7eff64c00640 1 -- 172.21.15.3:0/12162049 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7eff7405a050 con 0x55eadef28e50 2024-09-19T06:17:39.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.470+0000 7eff8468b740 10 client.26650 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:39.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.470+0000 7eff8468b740 1 -- 172.21.15.3:0/12162049 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55eadefa3a80 con 0x55eadef28e50 2024-09-19T06:17:39.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.471+0000 7eff64c00640 1 -- 172.21.15.3:0/12162049 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff6c0a4e50 con 0x55eadef28e50 2024-09-19T06:17:39.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.471+0000 7eff64c00640 1 -- 172.21.15.3:0/12162049 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7eff7403c040 con 0x55eadef28e50 2024-09-19T06:17:39.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.471+0000 7eff8468b740 10 client.26650 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:39.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.471+0000 7eff8468b740 10 client.26650 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:17:39.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.471+0000 7eff8468b740 20 client.26650 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:39.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.471+0000 7eff8468b740 1 --2- 172.21.15.3:0/12162049 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55eadefa3d60 0x55eadefa6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:39.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.471+0000 7eff8468b740 4 client.26650 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:17:39.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.471+0000 7eff8468b740 1 -- 172.21.15.3:0/12162049 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55eadee8be60 con 0x55eadefa3d60 2024-09-19T06:17:39.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.472+0000 7eff7aa00640 1 --2- 172.21.15.3:0/12162049 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55eadefa3d60 0x55eadefa6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:39.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.472+0000 7eff7aa00640 1 --2- 172.21.15.3:0/12162049 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55eadefa3d60 0x55eadefa6150 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2f9117937f01ff3a server_cookie=cbc0d10310b4555b in_seq=0 out_seq=0 2024-09-19T06:17:39.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.472+0000 7eff64c00640 10 client.26650 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:17:39.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.472+0000 7eff64c00640 1 -- 172.21.15.3:0/12162049 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55eadee8be60 con 0x55eadefa3d60 2024-09-19T06:17:39.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.472+0000 7eff64c00640 10 client.26650 handle_command_reply: tid=0 2024-09-19T06:17:39.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.472+0000 7eff8468b740 1 client.26650 shutdown 2024-09-19T06:17:39.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.472+0000 7eff8468b740 1 -- 172.21.15.3:0/12162049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef28e50 msgr2=0x55eadef2ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:39.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.472+0000 7eff8468b740 1 --2- 172.21.15.3:0/12162049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef28e50 0x55eadef2ce60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7eff74000f80 tx=0x7eff74030e50 comp rx=0 tx=0).stop 2024-09-19T06:17:39.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.473+0000 7eff8468b740 1 -- 172.21.15.3:0/12162049 shutdown_connections 2024-09-19T06:17:39.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.473+0000 7eff8468b740 1 --2- 172.21.15.3:0/12162049 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55eadefa3d60 0x55eadefa6150 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.473+0000 7eff8468b740 1 --2- 172.21.15.3:0/12162049 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55eadef28e50 0x55eadef2ce60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.473+0000 7eff8468b740 1 --2- 172.21.15.3:0/12162049 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55eadef1e590 0x55eadef2c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.473+0000 7eff8468b740 1 --2- 172.21.15.3:0/12162049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eadef1dc70 0x55eadef315a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.473+0000 7eff64c00640 0 client.26650 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:17:39.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.473+0000 7eff8468b740 1 -- 172.21.15.3:0/12162049 >> 172.21.15.3:0/12162049 conn(0x55eadef1a200 msgr2=0x55eadef19380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:39.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.473+0000 7eff8468b740 1 -- 172.21.15.3:0/12162049 shutdown_connections 2024-09-19T06:17:39.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.473+0000 7eff8468b740 1 -- 172.21.15.3:0/12162049 wait complete. 2024-09-19T06:17:39.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.473+0000 7eff8468b740 20 client.26650 trim_cache size 0 max 16384 2024-09-19T06:17:39.479 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:17:39.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.474+0000 7eff81c00640 1 -- 172.21.15.3:0/45429664 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7eff600a3430 msgr2=0x7eff600a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:39.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.474+0000 7eff81c00640 1 --2- 172.21.15.3:0/45429664 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7eff600a3430 0x7eff600a58f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7eff7c079300 tx=0x7eff68005f90 comp rx=0 tx=0).stop 2024-09-19T06:17:39.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.474+0000 7eff81c00640 1 -- 172.21.15.3:0/45429664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff7c076720 msgr2=0x7eff7c1a46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:39.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.474+0000 7eff81c00640 1 --2- 172.21.15.3:0/45429664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff7c076720 0x7eff7c1a46c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7eff6c005fd0 tx=0x7eff6c00ee50 comp rx=0 tx=0).stop 2024-09-19T06:17:39.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.474+0000 7eff81c00640 1 -- 172.21.15.3:0/45429664 shutdown_connections 2024-09-19T06:17:39.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.474+0000 7eff81c00640 1 --2- 172.21.15.3:0/45429664 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7eff600a3430 0x7eff600a58f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.474+0000 7eff81c00640 1 --2- 172.21.15.3:0/45429664 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7eff7c112a30 0x7eff7c19e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.474+0000 7eff81c00640 1 --2- 172.21.15.3:0/45429664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7eff7c077040 0x7eff7c1a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.474+0000 7eff81c00640 1 --2- 172.21.15.3:0/45429664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff7c076720 0x7eff7c1a46c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:39.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.474+0000 7eff81c00640 1 -- 172.21.15.3:0/45429664 >> 172.21.15.3:0/45429664 conn(0x7eff7c0ffa90 msgr2=0x7eff7c101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:39.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.474+0000 7eff81c00640 1 -- 172.21.15.3:0/45429664 shutdown_connections 2024-09-19T06:17:39.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:39.474+0000 7eff81c00640 1 -- 172.21.15.3:0/45429664 wait complete. 2024-09-19T06:17:39.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:39 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:17:39.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:39 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:17:39.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:39 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:17:40.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:40 smithi059 ceph-mon[35138]: pgmap v161: 97 pgs: 97 active+clean; 3.6 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 52 KiB/s wr, 22 op/s 2024-09-19T06:17:40.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:40 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:17:40.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:40 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:17:40.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:40 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:17:40.543 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:40 smithi003 ceph-mon[30893]: pgmap v161: 97 pgs: 97 active+clean; 3.6 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 52 KiB/s wr, 22 op/s 2024-09-19T06:17:40.544 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:40 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:17:40.544 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:40 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:17:40.544 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:40 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:17:40.584 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:17:40.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:40 smithi071 ceph-mon[35662]: pgmap v161: 97 pgs: 97 active+clean; 3.6 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 52 KiB/s wr, 22 op/s 2024-09-19T06:17:40.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:40 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:17:40.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:40 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:17:40.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:40 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:17:40.965 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:17:41.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.517+0000 7fb49a200640 1 -- 172.21.15.3:0/3252399939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb494076720 msgr2=0x7fb494076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:41.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.517+0000 7fb49a200640 1 --2- 172.21.15.3:0/3252399939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb494076720 0x7fb494076b00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb484009860 tx=0x7fb48402a340 comp rx=0 tx=0).stop 2024-09-19T06:17:41.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.517+0000 7fb49a200640 1 -- 172.21.15.3:0/3252399939 shutdown_connections 2024-09-19T06:17:41.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.517+0000 7fb49a200640 1 --2- 172.21.15.3:0/3252399939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb494112a30 0x7fb494114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.517+0000 7fb49a200640 1 --2- 172.21.15.3:0/3252399939 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb494077040 0x7fb4941124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.517+0000 7fb49a200640 1 --2- 172.21.15.3:0/3252399939 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb494076720 0x7fb494076b00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.517+0000 7fb49a200640 1 -- 172.21.15.3:0/3252399939 >> 172.21.15.3:0/3252399939 conn(0x7fb4940ffa90 msgr2=0x7fb494101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:41.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.517+0000 7fb49a200640 1 -- 172.21.15.3:0/3252399939 shutdown_connections 2024-09-19T06:17:41.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.517+0000 7fb49a200640 1 -- 172.21.15.3:0/3252399939 wait complete. 2024-09-19T06:17:41.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.518+0000 7fb49a200640 1 Processor -- start 2024-09-19T06:17:41.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.518+0000 7fb49a200640 1 -- start start 2024-09-19T06:17:41.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.519+0000 7fb49a200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb494076720 0x7fb4941a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.519+0000 7fb49a200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb494077040 0x7fb4941a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.519+0000 7fb49a200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb494112a30 0x7fb49419e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.519+0000 7fb49a200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb4941185c0 con 0x7fb494112a30 2024-09-19T06:17:41.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.519+0000 7fb49a200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb494118440 con 0x7fb494076720 2024-09-19T06:17:41.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.519+0000 7fb49a200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb494118740 con 0x7fb494077040 2024-09-19T06:17:41.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.519+0000 7fb493400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb494076720 0x7fb4941a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.519+0000 7fb493400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb494076720 0x7fb4941a46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:43586/0 (socket says 172.21.15.3:43586) 2024-09-19T06:17:41.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.519+0000 7fb493e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb494112a30 0x7fb49419e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.519+0000 7fb493400640 1 -- 172.21.15.3:0/1570169244 learned_addr learned my addr 172.21.15.3:0/1570169244 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:41.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.519+0000 7fb48aa00640 1 --2- 172.21.15.3:0/1570169244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb494077040 0x7fb4941a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.520+0000 7fb493400640 1 -- 172.21.15.3:0/1570169244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb494077040 msgr2=0x7fb4941a4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:41.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.520+0000 7fb493400640 1 --2- 172.21.15.3:0/1570169244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb494077040 0x7fb4941a4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.520+0000 7fb493400640 1 -- 172.21.15.3:0/1570169244 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb494112a30 msgr2=0x7fb49419e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:41.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.520+0000 7fb493400640 1 --2- 172.21.15.3:0/1570169244 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb494112a30 0x7fb49419e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.520+0000 7fb493400640 1 -- 172.21.15.3:0/1570169244 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb49419efd0 con 0x7fb494076720 2024-09-19T06:17:41.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.520+0000 7fb493400640 1 --2- 172.21.15.3:0/1570169244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb494076720 0x7fb4941a46e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb484035040 tx=0x7fb484033b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:41.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.520+0000 7fb490c00640 1 -- 172.21.15.3:0/1570169244 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb484037040 con 0x7fb494076720 2024-09-19T06:17:41.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.520+0000 7fb49a200640 1 -- 172.21.15.3:0/1570169244 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb49419f260 con 0x7fb494076720 2024-09-19T06:17:41.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.521+0000 7fb490c00640 1 -- 172.21.15.3:0/1570169244 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb484040070 con 0x7fb494076720 2024-09-19T06:17:41.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.521+0000 7fb490c00640 1 -- 172.21.15.3:0/1570169244 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4840039b0 con 0x7fb494076720 2024-09-19T06:17:41.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.521+0000 7fb49a200640 1 -- 172.21.15.3:0/1570169244 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4941ab5b0 con 0x7fb494076720 2024-09-19T06:17:41.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.523+0000 7fb49cc09740 1 Processor -- start 2024-09-19T06:17:41.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.524+0000 7fb49cc09740 1 -- start start 2024-09-19T06:17:41.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.524+0000 7fb49cc09740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580ef746c70 0x5580ef747050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.524+0000 7fb49cc09740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580ef747590 0x5580ef751910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.524+0000 7fb49cc09740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef751e50 0x5580ef754240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.524+0000 7fb49cc09740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5580ef6ad3e0 con 0x5580ef751e50 2024-09-19T06:17:41.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.524+0000 7fb49cc09740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5580ef654d80 con 0x5580ef747590 2024-09-19T06:17:41.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.524+0000 7fb49cc09740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5580ef6a93a0 con 0x5580ef746c70 2024-09-19T06:17:41.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.524+0000 7fb490c00640 1 -- 172.21.15.3:0/1570169244 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fb4840305e0 con 0x7fb494076720 2024-09-19T06:17:41.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.524+0000 7fb48aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef751e50 0x5580ef754240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.524+0000 7fb48aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef751e50 0x5580ef754240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40910/0 (socket says 172.21.15.3:40910) 2024-09-19T06:17:41.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.524+0000 7fb48aa00640 1 -- 172.21.15.3:0/2610951004 learned_addr learned my addr 172.21.15.3:0/2610951004 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:41.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.524+0000 7fb493e00640 1 --2- 172.21.15.3:0/2610951004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580ef746c70 0x5580ef747050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.525+0000 7fb493400640 1 --2- 172.21.15.3:0/2610951004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580ef747590 0x5580ef751910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.525+0000 7fb48aa00640 1 -- 172.21.15.3:0/2610951004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580ef746c70 msgr2=0x5580ef747050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:41.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.525+0000 7fb48aa00640 1 --2- 172.21.15.3:0/2610951004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580ef746c70 0x5580ef747050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.525+0000 7fb48aa00640 1 -- 172.21.15.3:0/2610951004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580ef747590 msgr2=0x5580ef751910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:41.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.525+0000 7fb48aa00640 1 --2- 172.21.15.3:0/2610951004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580ef747590 0x5580ef751910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.525+0000 7fb48aa00640 1 -- 172.21.15.3:0/2610951004 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580ef673ae0 con 0x5580ef751e50 2024-09-19T06:17:41.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.525+0000 7fb493400640 1 --2- 172.21.15.3:0/2610951004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580ef747590 0x5580ef751910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:17:41.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.525+0000 7fb493e00640 1 --2- 172.21.15.3:0/2610951004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580ef746c70 0x5580ef747050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:41.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.525+0000 7fb48aa00640 1 --2- 172.21.15.3:0/2610951004 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef751e50 0x5580ef754240 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb47c009c60 tx=0x7fb47c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd1f65063bd2988 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:41.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.525+0000 7fb483e00640 1 -- 172.21.15.3:0/2610951004 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47c004220 con 0x5580ef751e50 2024-09-19T06:17:41.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.526+0000 7fb483e00640 1 -- 172.21.15.3:0/2610951004 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb47c009e10 con 0x5580ef751e50 2024-09-19T06:17:41.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.526+0000 7fb483e00640 1 -- 172.21.15.3:0/2610951004 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47c019890 con 0x5580ef751e50 2024-09-19T06:17:41.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.526+0000 7fb490c00640 1 --2- 172.21.15.3:0/1570169244 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb4780a33b0 0x7fb4780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.526+0000 7fb490c00640 1 -- 172.21.15.3:0/1570169244 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fb4840efc40 con 0x7fb494076720 2024-09-19T06:17:41.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.526+0000 7fb49cc09740 1 -- 172.21.15.3:0/2610951004 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef751e50 msgr2=0x5580ef754240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:41.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.526+0000 7fb49cc09740 1 --2- 172.21.15.3:0/2610951004 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef751e50 0x5580ef754240 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb47c009c60 tx=0x7fb47c011810 comp rx=0 tx=0).stop 2024-09-19T06:17:41.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.526+0000 7fb493e00640 1 --2- 172.21.15.3:0/1570169244 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb4780a33b0 0x7fb4780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.526+0000 7fb49cc09740 1 -- 172.21.15.3:0/2610951004 shutdown_connections 2024-09-19T06:17:41.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.526+0000 7fb49cc09740 1 --2- 172.21.15.3:0/2610951004 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef751e50 0x5580ef754240 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.526+0000 7fb49cc09740 1 --2- 172.21.15.3:0/2610951004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580ef747590 0x5580ef751910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.526+0000 7fb49cc09740 1 --2- 172.21.15.3:0/2610951004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580ef746c70 0x5580ef747050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.526+0000 7fb49cc09740 1 -- 172.21.15.3:0/2610951004 >> 172.21.15.3:0/2610951004 conn(0x5580ef743200 msgr2=0x5580ef7435e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:41.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.527+0000 7fb49cc09740 1 -- 172.21.15.3:0/2610951004 shutdown_connections 2024-09-19T06:17:41.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.527+0000 7fb49cc09740 1 -- 172.21.15.3:0/2610951004 wait complete. 2024-09-19T06:17:41.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.527+0000 7fb49cc09740 1 -- start start 2024-09-19T06:17:41.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.527+0000 7fb493e00640 1 --2- 172.21.15.3:0/1570169244 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb4780a33b0 0x7fb4780a5870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb48c009d40 tx=0x7fb48c009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:41.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.527+0000 7fb49cc09740 1 Processor -- start 2024-09-19T06:17:41.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.528+0000 7fb49cc09740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580ef746c70 0x5580ef74ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.528+0000 7fb49cc09740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef747590 0x5580ef74f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.528+0000 7fb49cc09740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580ef751e50 0x5580ef74f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.528+0000 7fb49cc09740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5580ef754a20 con 0x5580ef747590 2024-09-19T06:17:41.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.528+0000 7fb49cc09740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5580ef6680f0 con 0x5580ef746c70 2024-09-19T06:17:41.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.528+0000 7fb49cc09740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5580ef754ba0 con 0x5580ef751e50 2024-09-19T06:17:41.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.528+0000 7fb49cc09740 10 client.0 _ll_register_callbacks cb 0x5580ef64fbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:41.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.528+0000 7fb48aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef747590 0x5580ef74f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.528+0000 7fb48aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef747590 0x5580ef74f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40918/0 (socket says 172.21.15.3:40918) 2024-09-19T06:17:41.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.528+0000 7fb48aa00640 1 -- 172.21.15.3:0/2747453233 learned_addr learned my addr 172.21.15.3:0/2747453233 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:41.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.528+0000 7fb493400640 1 --2- 172.21.15.3:0/2747453233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580ef746c70 0x5580ef74ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.528+0000 7fb493e00640 1 --2- 172.21.15.3:0/2747453233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580ef751e50 0x5580ef74f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.529+0000 7fb48aa00640 1 -- 172.21.15.3:0/2747453233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580ef751e50 msgr2=0x5580ef74f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:41.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.529+0000 7fb48aa00640 1 --2- 172.21.15.3:0/2747453233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580ef751e50 0x5580ef74f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.529+0000 7fb48aa00640 1 -- 172.21.15.3:0/2747453233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580ef746c70 msgr2=0x5580ef74ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:41.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.529+0000 7fb48aa00640 1 --2- 172.21.15.3:0/2747453233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580ef746c70 0x5580ef74ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.529+0000 7fb48aa00640 1 -- 172.21.15.3:0/2747453233 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580ef41e3c0 con 0x5580ef747590 2024-09-19T06:17:41.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.529+0000 7fb493400640 1 --2- 172.21.15.3:0/2747453233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580ef746c70 0x5580ef74ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:41.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.529+0000 7fb48aa00640 1 --2- 172.21.15.3:0/2747453233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef747590 0x5580ef74f240 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb47c01b040 tx=0x7fb47c0041d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ac2f7380118f9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:41.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.529+0000 7fb480c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:17:41.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.529+0000 7fb480c00640 1 -- 172.21.15.3:0/2747453233 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47c029020 con 0x5580ef747590 2024-09-19T06:17:41.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.529+0000 7fb49cc09740 1 -- 172.21.15.3:0/2747453233 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb47c009e10 con 0x5580ef747590 2024-09-19T06:17:41.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.529+0000 7fb480c00640 1 -- 172.21.15.3:0/2747453233 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fb47c005240 con 0x5580ef747590 2024-09-19T06:17:41.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.530+0000 7fb480c00640 1 -- 172.21.15.3:0/2747453233 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb47c034050 con 0x5580ef747590 2024-09-19T06:17:41.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.530+0000 7fb49cc09740 10 client.16614 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:41.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.530+0000 7fb49cc09740 1 -- 172.21.15.3:0/2747453233 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5580ef7609a0 con 0x5580ef747590 2024-09-19T06:17:41.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.530+0000 7fb480c00640 1 -- 172.21.15.3:0/2747453233 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb47c009e10 con 0x5580ef747590 2024-09-19T06:17:41.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.530+0000 7fb480c00640 1 -- 172.21.15.3:0/2747453233 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb47c004cc0 con 0x5580ef747590 2024-09-19T06:17:41.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.530+0000 7fb49cc09740 10 client.16614 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:41.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.530+0000 7fb49cc09740 10 client.16614 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:17:41.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.530+0000 7fb49cc09740 20 client.16614 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:41.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.530+0000 7fb49cc09740 1 --2- 172.21.15.3:0/2747453233 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x5580ef761db0 0x5580ef7641a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.530+0000 7fb49cc09740 4 client.16614 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:17:41.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.530+0000 7fb49cc09740 1 -- 172.21.15.3:0/2747453233 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580ef6ba950 con 0x5580ef761db0 2024-09-19T06:17:41.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.531+0000 7fb493400640 1 --2- 172.21.15.3:0/2747453233 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x5580ef761db0 0x5580ef7641a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.531+0000 7fb493400640 1 --2- 172.21.15.3:0/2747453233 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x5580ef761db0 0x5580ef7641a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=db3c3cdd329261e6 server_cookie=3a5618d8eb9af8dd in_seq=0 out_seq=0 2024-09-19T06:17:41.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.531+0000 7fb480c00640 10 client.16614 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:17:41.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.532+0000 7fb480c00640 1 -- 172.21.15.3:0/2747453233 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5580ef6ba950 con 0x5580ef761db0 2024-09-19T06:17:41.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.532+0000 7fb480c00640 10 client.16614 handle_command_reply: tid=0 2024-09-19T06:17:41.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.532+0000 7fb49cc09740 1 client.16614 shutdown 2024-09-19T06:17:41.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.532+0000 7fb49cc09740 1 -- 172.21.15.3:0/2747453233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef747590 msgr2=0x5580ef74f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:41.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.532+0000 7fb49cc09740 1 --2- 172.21.15.3:0/2747453233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef747590 0x5580ef74f240 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb47c01b040 tx=0x7fb47c0041d0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.533+0000 7fb49cc09740 1 -- 172.21.15.3:0/2747453233 shutdown_connections 2024-09-19T06:17:41.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.533+0000 7fb49cc09740 1 --2- 172.21.15.3:0/2747453233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580ef751e50 0x5580ef74f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.533+0000 7fb49cc09740 1 --2- 172.21.15.3:0/2747453233 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x5580ef761db0 0x5580ef7641a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.533+0000 7fb49cc09740 1 --2- 172.21.15.3:0/2747453233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef747590 0x5580ef74f240 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.533+0000 7fb480c00640 0 client.16614 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:17:41.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.533+0000 7fb49cc09740 1 --2- 172.21.15.3:0/2747453233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580ef746c70 0x5580ef74ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.533+0000 7fb49cc09740 1 -- 172.21.15.3:0/2747453233 >> 172.21.15.3:0/2747453233 conn(0x5580ef743200 msgr2=0x5580ef742380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:41.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.533+0000 7fb49cc09740 1 -- 172.21.15.3:0/2747453233 shutdown_connections 2024-09-19T06:17:41.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.533+0000 7fb49cc09740 1 -- 172.21.15.3:0/2747453233 wait complete. 2024-09-19T06:17:41.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.533+0000 7fb49cc09740 20 client.16614 trim_cache size 0 max 16384 2024-09-19T06:17:41.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.547+0000 7fb49cc09740 1 Processor -- start 2024-09-19T06:17:41.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.547+0000 7fb49cc09740 1 -- start start 2024-09-19T06:17:41.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.547+0000 7fb49cc09740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580ef746c70 0x5580ef7699b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.547+0000 7fb49cc09740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580ef747590 0x5580ef769ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.547+0000 7fb49cc09740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef751e50 0x5580ef7486c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.547+0000 7fb49cc09740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb4941b3f60 con 0x5580ef751e50 2024-09-19T06:17:41.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.547+0000 7fb49cc09740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb4941b5aa0 con 0x5580ef747590 2024-09-19T06:17:41.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.547+0000 7fb49cc09740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb4941b4630 con 0x5580ef746c70 2024-09-19T06:17:41.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.548+0000 7fb493e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef751e50 0x5580ef7486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.548+0000 7fb493400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580ef746c70 0x5580ef7699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.548+0000 7fb48aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580ef747590 0x5580ef769ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.548+0000 7fb493e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef751e50 0x5580ef7486c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40924/0 (socket says 172.21.15.3:40924) 2024-09-19T06:17:41.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.548+0000 7fb493e00640 1 -- 172.21.15.3:0/1874826934 learned_addr learned my addr 172.21.15.3:0/1874826934 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:41.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.548+0000 7fb493400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580ef746c70 0x5580ef7699b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:52952/0 (socket says 172.21.15.3:52952) 2024-09-19T06:17:41.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.548+0000 7fb493e00640 1 -- 172.21.15.3:0/1874826934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580ef746c70 msgr2=0x5580ef7699b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:41.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.548+0000 7fb493e00640 1 --2- 172.21.15.3:0/1874826934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580ef746c70 0x5580ef7699b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.548+0000 7fb493e00640 1 -- 172.21.15.3:0/1874826934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580ef747590 msgr2=0x5580ef769ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:41.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.548+0000 7fb493e00640 1 --2- 172.21.15.3:0/1874826934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580ef747590 0x5580ef769ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.548+0000 7fb493e00640 1 -- 172.21.15.3:0/1874826934 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580ef746aa0 con 0x5580ef751e50 2024-09-19T06:17:41.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.548+0000 7fb493400640 1 --2- 172.21.15.3:0/1874826934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580ef746c70 0x5580ef7699b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:41.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.548+0000 7fb48aa00640 1 --2- 172.21.15.3:0/1874826934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580ef747590 0x5580ef769ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:41.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.548+0000 7fb493e00640 1 --2- 172.21.15.3:0/1874826934 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef751e50 0x5580ef7486c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb48c004210 tx=0x7fb48c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c418a80f4d3d3fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:41.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.549+0000 7fb483400640 1 -- 172.21.15.3:0/1874826934 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48c01e690 con 0x5580ef751e50 2024-09-19T06:17:41.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.549+0000 7fb483400640 1 -- 172.21.15.3:0/1874826934 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb48c01ed10 con 0x5580ef751e50 2024-09-19T06:17:41.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.549+0000 7fb483400640 1 -- 172.21.15.3:0/1874826934 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48c01c3f0 con 0x5580ef751e50 2024-09-19T06:17:41.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.549+0000 7fb49cc09740 1 -- 172.21.15.3:0/1874826934 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef751e50 msgr2=0x5580ef7486c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:41.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.549+0000 7fb49cc09740 1 --2- 172.21.15.3:0/1874826934 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef751e50 0x5580ef7486c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb48c004210 tx=0x7fb48c019000 comp rx=0 tx=0).stop 2024-09-19T06:17:41.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.549+0000 7fb49cc09740 1 -- 172.21.15.3:0/1874826934 shutdown_connections 2024-09-19T06:17:41.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.549+0000 7fb49cc09740 1 --2- 172.21.15.3:0/1874826934 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef751e50 0x5580ef7486c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.549+0000 7fb49cc09740 1 --2- 172.21.15.3:0/1874826934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580ef747590 0x5580ef769ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.549+0000 7fb49cc09740 1 --2- 172.21.15.3:0/1874826934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580ef746c70 0x5580ef7699b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.549+0000 7fb49cc09740 1 -- 172.21.15.3:0/1874826934 >> 172.21.15.3:0/1874826934 conn(0x5580ef743200 msgr2=0x5580ef750d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:41.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.550+0000 7fb49cc09740 1 -- 172.21.15.3:0/1874826934 shutdown_connections 2024-09-19T06:17:41.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.550+0000 7fb49cc09740 1 -- 172.21.15.3:0/1874826934 wait complete. 2024-09-19T06:17:41.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.550+0000 7fb49cc09740 1 -- start start 2024-09-19T06:17:41.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.550+0000 7fb49cc09740 1 Processor -- start 2024-09-19T06:17:41.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.551+0000 7fb49cc09740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef746c70 0x5580ef75a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.551+0000 7fb49cc09740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580ef747590 0x5580ef74b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.551+0000 7fb49cc09740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580ef751e50 0x5580ef74bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.551+0000 7fb49cc09740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb4941b53d0 con 0x5580ef746c70 2024-09-19T06:17:41.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.551+0000 7fb49cc09740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb4941b4d00 con 0x5580ef747590 2024-09-19T06:17:41.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.551+0000 7fb49cc09740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb4941b1f40 con 0x5580ef751e50 2024-09-19T06:17:41.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.551+0000 7fb49cc09740 10 client.0 _ll_register_callbacks cb 0x7fb48c009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:41.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.551+0000 7fb493400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef746c70 0x5580ef75a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.551+0000 7fb48aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580ef747590 0x5580ef74b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.551+0000 7fb493400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef746c70 0x5580ef75a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40936/0 (socket says 172.21.15.3:40936) 2024-09-19T06:17:41.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.551+0000 7fb493400640 1 -- 172.21.15.3:0/4180123709 learned_addr learned my addr 172.21.15.3:0/4180123709 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:41.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.551+0000 7fb493e00640 1 --2- 172.21.15.3:0/4180123709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580ef751e50 0x5580ef74bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.551+0000 7fb48aa00640 1 -- 172.21.15.3:0/4180123709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580ef751e50 msgr2=0x5580ef74bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:41.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.551+0000 7fb48aa00640 1 --2- 172.21.15.3:0/4180123709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580ef751e50 0x5580ef74bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.551+0000 7fb48aa00640 1 -- 172.21.15.3:0/4180123709 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef746c70 msgr2=0x5580ef75a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:41.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.551+0000 7fb48aa00640 1 --2- 172.21.15.3:0/4180123709 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef746c70 0x5580ef75a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.551+0000 7fb48aa00640 1 -- 172.21.15.3:0/4180123709 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580ef73e770 con 0x5580ef747590 2024-09-19T06:17:41.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.551+0000 7fb493400640 1 --2- 172.21.15.3:0/4180123709 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef746c70 0x5580ef75a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:41.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.552+0000 7fb48aa00640 1 --2- 172.21.15.3:0/4180123709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580ef747590 0x5580ef74b7d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb47c006010 tx=0x7fb47c019a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caa6ad3a5ed662c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:41.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.552+0000 7fb480c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:17:41.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.552+0000 7fb480c00640 1 -- 172.21.15.3:0/4180123709 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47c03e060 con 0x5580ef747590 2024-09-19T06:17:41.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.552+0000 7fb480c00640 1 -- 172.21.15.3:0/4180123709 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fb47c005040 con 0x5580ef747590 2024-09-19T06:17:41.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.552+0000 7fb49cc09740 1 -- 172.21.15.3:0/4180123709 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb48c01ed10 con 0x5580ef747590 2024-09-19T06:17:41.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.552+0000 7fb480c00640 1 -- 172.21.15.3:0/4180123709 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb47c029040 con 0x5580ef747590 2024-09-19T06:17:41.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.552+0000 7fb49cc09740 10 client.26663 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:41.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.552+0000 7fb49cc09740 1 -- 172.21.15.3:0/4180123709 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5580ef7cc560 con 0x5580ef747590 2024-09-19T06:17:41.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.553+0000 7fb480c00640 1 -- 172.21.15.3:0/4180123709 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb48c01ed10 con 0x5580ef747590 2024-09-19T06:17:41.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.553+0000 7fb480c00640 1 -- 172.21.15.3:0/4180123709 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb47c0046f0 con 0x5580ef747590 2024-09-19T06:17:41.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.553+0000 7fb49cc09740 10 client.26663 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:41.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.553+0000 7fb49cc09740 10 client.26663 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:17:41.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.553+0000 7fb49cc09740 20 client.26663 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:41.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.553+0000 7fb49cc09740 1 --2- 172.21.15.3:0/4180123709 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x5580ef7ccca0 0x5580ef7cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.553+0000 7fb49cc09740 4 client.26663 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:17:41.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.553+0000 7fb49cc09740 1 -- 172.21.15.3:0/4180123709 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5580ef6b4e60 con 0x5580ef7ccca0 2024-09-19T06:17:41.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.553+0000 7fb493400640 1 --2- 172.21.15.3:0/4180123709 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x5580ef7ccca0 0x5580ef7cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.554+0000 7fb493400640 1 --2- 172.21.15.3:0/4180123709 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x5580ef7ccca0 0x5580ef7cf0c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6a7c22b3cda597db server_cookie=bb97d14669fc5f7e in_seq=0 out_seq=0 2024-09-19T06:17:41.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.554+0000 7fb480c00640 10 client.26663 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:17:41.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.554+0000 7fb480c00640 1 -- 172.21.15.3:0/4180123709 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5580ef6b4e60 con 0x5580ef7ccca0 2024-09-19T06:17:41.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.554+0000 7fb480c00640 10 client.26663 handle_command_reply: tid=0 2024-09-19T06:17:41.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.554+0000 7fb49cc09740 1 client.26663 shutdown 2024-09-19T06:17:41.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.554+0000 7fb49cc09740 1 -- 172.21.15.3:0/4180123709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580ef747590 msgr2=0x5580ef74b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:41.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.554+0000 7fb49cc09740 1 --2- 172.21.15.3:0/4180123709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580ef747590 0x5580ef74b7d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb47c006010 tx=0x7fb47c019a80 comp rx=0 tx=0).stop 2024-09-19T06:17:41.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.554+0000 7fb49cc09740 1 -- 172.21.15.3:0/4180123709 shutdown_connections 2024-09-19T06:17:41.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.554+0000 7fb49cc09740 1 --2- 172.21.15.3:0/4180123709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580ef751e50 0x5580ef74bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.554+0000 7fb49cc09740 1 --2- 172.21.15.3:0/4180123709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580ef747590 0x5580ef74b7d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.554+0000 7fb49cc09740 1 --2- 172.21.15.3:0/4180123709 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x5580ef7ccca0 0x5580ef7cf0c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.554+0000 7fb49cc09740 1 --2- 172.21.15.3:0/4180123709 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580ef746c70 0x5580ef75a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.554+0000 7fb480c00640 0 client.26663 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:17:41.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.554+0000 7fb49cc09740 1 -- 172.21.15.3:0/4180123709 >> 172.21.15.3:0/4180123709 conn(0x5580ef743200 msgr2=0x5580ef741b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:41.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.555+0000 7fb49cc09740 1 -- 172.21.15.3:0/4180123709 shutdown_connections 2024-09-19T06:17:41.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.555+0000 7fb49cc09740 1 -- 172.21.15.3:0/4180123709 wait complete. 2024-09-19T06:17:41.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.555+0000 7fb49cc09740 20 client.26663 trim_cache size 0 max 16384 2024-09-19T06:17:41.564 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:17:41.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.555+0000 7fb49a200640 1 -- 172.21.15.3:0/1570169244 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb4780a33b0 msgr2=0x7fb4780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:41.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.555+0000 7fb49a200640 1 --2- 172.21.15.3:0/1570169244 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb4780a33b0 0x7fb4780a5870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb48c009d40 tx=0x7fb48c009500 comp rx=0 tx=0).stop 2024-09-19T06:17:41.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.555+0000 7fb49a200640 1 -- 172.21.15.3:0/1570169244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb494076720 msgr2=0x7fb4941a46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:41.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.555+0000 7fb49a200640 1 --2- 172.21.15.3:0/1570169244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb494076720 0x7fb4941a46e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb484035040 tx=0x7fb484033b60 comp rx=0 tx=0).stop 2024-09-19T06:17:41.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.556+0000 7fb49a200640 1 -- 172.21.15.3:0/1570169244 shutdown_connections 2024-09-19T06:17:41.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.556+0000 7fb49a200640 1 --2- 172.21.15.3:0/1570169244 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb4780a33b0 0x7fb4780a5870 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.556+0000 7fb49a200640 1 --2- 172.21.15.3:0/1570169244 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb494112a30 0x7fb49419e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.556+0000 7fb49a200640 1 --2- 172.21.15.3:0/1570169244 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb494077040 0x7fb4941a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.556+0000 7fb49a200640 1 --2- 172.21.15.3:0/1570169244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb494076720 0x7fb4941a46e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.556+0000 7fb49a200640 1 -- 172.21.15.3:0/1570169244 >> 172.21.15.3:0/1570169244 conn(0x7fb4940ffa90 msgr2=0x7fb494101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:41.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.556+0000 7fb49a200640 1 -- 172.21.15.3:0/1570169244 shutdown_connections 2024-09-19T06:17:41.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:41.556+0000 7fb49a200640 1 -- 172.21.15.3:0/1570169244 wait complete. 2024-09-19T06:17:41.825 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.823+0000 7fdb62000640 1 -- 172.21.15.3:0/2890621507 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb5c1044d0 msgr2=0x7fdb5c1109b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.823+0000 7fdb62000640 1 --2- 172.21.15.3:0/2890621507 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb5c1044d0 0x7fdb5c1109b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fdb54009ca0 tx=0x7fdb5402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.823+0000 7fdb62000640 1 -- 172.21.15.3:0/2890621507 shutdown_connections 2024-09-19T06:17:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.823+0000 7fdb62000640 1 --2- 172.21.15.3:0/2890621507 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb5c1044d0 0x7fdb5c1109b0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.823+0000 7fdb62000640 1 --2- 172.21.15.3:0/2890621507 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb5c103b30 0x7fdb5c103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.823+0000 7fdb62000640 1 --2- 172.21.15.3:0/2890621507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb5c109bf0 0x7fdb5c109fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.823+0000 7fdb62000640 1 -- 172.21.15.3:0/2890621507 >> 172.21.15.3:0/2890621507 conn(0x7fdb5c0ff810 msgr2=0x7fdb5c101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.823+0000 7fdb62000640 1 -- 172.21.15.3:0/2890621507 shutdown_connections 2024-09-19T06:17:41.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.823+0000 7fdb62000640 1 -- 172.21.15.3:0/2890621507 wait complete. 2024-09-19T06:17:41.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.824+0000 7fdb62000640 1 Processor -- start 2024-09-19T06:17:41.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.824+0000 7fdb62000640 1 -- start start 2024-09-19T06:17:41.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.825+0000 7fdb62000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb5c103b30 0x7fdb5c19a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.825+0000 7fdb62000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb5c1044d0 0x7fdb5c19a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.825+0000 7fdb62000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb5c109bf0 0x7fdb5c19ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.825+0000 7fdb62000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c113f90 con 0x7fdb5c1044d0 2024-09-19T06:17:41.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.825+0000 7fdb62000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c113e10 con 0x7fdb5c109bf0 2024-09-19T06:17:41.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.825+0000 7fdb62000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c114110 con 0x7fdb5c103b30 2024-09-19T06:17:41.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.825+0000 7fdb5be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb5c1044d0 0x7fdb5c19a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.825+0000 7fdb5be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb5c1044d0 0x7fdb5c19a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40954/0 (socket says 172.21.15.3:40954) 2024-09-19T06:17:41.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.825+0000 7fdb5be00640 1 -- 172.21.15.3:0/1780197275 learned_addr learned my addr 172.21.15.3:0/1780197275 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.825+0000 7fdb60c00640 1 --2- 172.21.15.3:0/1780197275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb5c103b30 0x7fdb5c19a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.825+0000 7fdb61600640 1 --2- 172.21.15.3:0/1780197275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb5c109bf0 0x7fdb5c19ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.825+0000 7fdb5be00640 1 -- 172.21.15.3:0/1780197275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb5c103b30 msgr2=0x7fdb5c19a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.825+0000 7fdb5be00640 1 --2- 172.21.15.3:0/1780197275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb5c103b30 0x7fdb5c19a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.826+0000 7fdb5be00640 1 -- 172.21.15.3:0/1780197275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb5c109bf0 msgr2=0x7fdb5c19ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.826+0000 7fdb5be00640 1 --2- 172.21.15.3:0/1780197275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb5c109bf0 0x7fdb5c19ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.826+0000 7fdb5be00640 1 -- 172.21.15.3:0/1780197275 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5c19f330 con 0x7fdb5c1044d0 2024-09-19T06:17:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.826+0000 7fdb5be00640 1 --2- 172.21.15.3:0/1780197275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb5c1044d0 0x7fdb5c19a880 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800e9f0 tx=0x7fdb4800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.826+0000 7fdb59600640 1 -- 172.21.15.3:0/1780197275 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4800cd80 con 0x7fdb5c1044d0 2024-09-19T06:17:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.826+0000 7fdb59600640 1 -- 172.21.15.3:0/1780197275 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb48010910 con 0x7fdb5c1044d0 2024-09-19T06:17:41.830 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.826+0000 7fdb62000640 1 -- 172.21.15.3:0/1780197275 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5c19f620 con 0x7fdb5c1044d0 2024-09-19T06:17:41.831 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.826+0000 7fdb59600640 1 -- 172.21.15.3:0/1780197275 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb48018990 con 0x7fdb5c1044d0 2024-09-19T06:17:41.831 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.826+0000 7fdb62000640 1 -- 172.21.15.3:0/1780197275 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb5c1a6eb0 con 0x7fdb5c1044d0 2024-09-19T06:17:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.829+0000 7fdb6644f740 1 Processor -- start 2024-09-19T06:17:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.829+0000 7fdb59600640 1 -- 172.21.15.3:0/1780197275 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fdb48010ac0 con 0x7fdb5c1044d0 2024-09-19T06:17:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.829+0000 7fdb6644f740 1 -- start start 2024-09-19T06:17:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.830+0000 7fdb6644f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bccfd233b0 0x55bccfd23790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.830+0000 7fdb6644f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd23cd0 0x55bccfd2e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.830+0000 7fdb6644f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd2e570 0x55bccfd30960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.830+0000 7fdb6644f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bccfc89100 con 0x55bccfd23cd0 2024-09-19T06:17:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.830+0000 7fdb6644f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bccfc311b0 con 0x55bccfd2e570 2024-09-19T06:17:41.833 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.830+0000 7fdb6644f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bccfc850c0 con 0x55bccfd233b0 2024-09-19T06:17:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.830+0000 7fdb60c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd23cd0 0x55bccfd2e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.830+0000 7fdb60c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd23cd0 0x55bccfd2e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40958/0 (socket says 172.21.15.3:40958) 2024-09-19T06:17:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.830+0000 7fdb60c00640 1 -- 172.21.15.3:0/1765981356 learned_addr learned my addr 172.21.15.3:0/1765981356 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.830+0000 7fdb5be00640 1 --2- 172.21.15.3:0/1765981356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd2e570 0x55bccfd30960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.830+0000 7fdb61600640 1 --2- 172.21.15.3:0/1765981356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bccfd233b0 0x55bccfd23790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.830+0000 7fdb60c00640 1 -- 172.21.15.3:0/1765981356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bccfd233b0 msgr2=0x55bccfd23790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.830+0000 7fdb60c00640 1 --2- 172.21.15.3:0/1765981356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bccfd233b0 0x55bccfd23790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.830+0000 7fdb60c00640 1 -- 172.21.15.3:0/1765981356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd2e570 msgr2=0x55bccfd30960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.830+0000 7fdb60c00640 1 --2- 172.21.15.3:0/1765981356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd2e570 0x55bccfd30960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.830+0000 7fdb60c00640 1 -- 172.21.15.3:0/1765981356 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bccf99c210 con 0x55bccfd23cd0 2024-09-19T06:17:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.830+0000 7fdb5be00640 1 --2- 172.21.15.3:0/1765981356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd2e570 0x55bccfd30960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:17:41.834 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.831+0000 7fdb60c00640 1 --2- 172.21.15.3:0/1765981356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd23cd0 0x55bccfd2e030 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009cf0 tx=0x7fdb50011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4166b59476d3e69 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.831+0000 7fdb4dc00640 1 -- 172.21.15.3:0/1765981356 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5001e070 con 0x55bccfd23cd0 2024-09-19T06:17:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.831+0000 7fdb4dc00640 1 -- 172.21.15.3:0/1765981356 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb50019b10 con 0x55bccfd23cd0 2024-09-19T06:17:41.835 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.831+0000 7fdb4dc00640 1 -- 172.21.15.3:0/1765981356 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000ea00 con 0x55bccfd23cd0 2024-09-19T06:17:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.832+0000 7fdb6644f740 1 -- 172.21.15.3:0/1765981356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd23cd0 msgr2=0x55bccfd2e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:41.838 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.832+0000 7fdb6644f740 1 --2- 172.21.15.3:0/1765981356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd23cd0 0x55bccfd2e030 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009cf0 tx=0x7fdb50011810 comp rx=0 tx=0).stop 2024-09-19T06:17:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.832+0000 7fdb6644f740 1 -- 172.21.15.3:0/1765981356 shutdown_connections 2024-09-19T06:17:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.832+0000 7fdb6644f740 1 --2- 172.21.15.3:0/1765981356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd2e570 0x55bccfd30960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.832+0000 7fdb6644f740 1 --2- 172.21.15.3:0/1765981356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd23cd0 0x55bccfd2e030 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.832+0000 7fdb6644f740 1 --2- 172.21.15.3:0/1765981356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bccfd233b0 0x55bccfd23790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.832+0000 7fdb6644f740 1 -- 172.21.15.3:0/1765981356 >> 172.21.15.3:0/1765981356 conn(0x55bccfd1f920 msgr2=0x55bccfd1fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.832+0000 7fdb59600640 1 --2- 172.21.15.3:0/1780197275 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fdb440a33a0 0x7fdb440a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.832+0000 7fdb6644f740 1 -- 172.21.15.3:0/1765981356 shutdown_connections 2024-09-19T06:17:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.832+0000 7fdb6644f740 1 -- 172.21.15.3:0/1765981356 wait complete. 2024-09-19T06:17:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.832+0000 7fdb59600640 1 -- 172.21.15.3:0/1780197275 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fdb480d0010 con 0x7fdb5c1044d0 2024-09-19T06:17:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.832+0000 7fdb61600640 1 --2- 172.21.15.3:0/1780197275 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fdb440a33a0 0x7fdb440a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.833+0000 7fdb6644f740 1 -- start start 2024-09-19T06:17:41.839 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.833+0000 7fdb6644f740 1 Processor -- start 2024-09-19T06:17:41.840 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.833+0000 7fdb61600640 1 --2- 172.21.15.3:0/1780197275 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fdb440a33a0 0x7fdb440a5860 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdb54006010 tx=0x7fdb54005d80 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:41.840 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.833+0000 7fdb6644f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd233b0 0x55bccfd2b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.840 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.833+0000 7fdb6644f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd23cd0 0x55bccfd2bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.840 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.833+0000 7fdb6644f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bccfd2e570 0x55bccfd2c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.840 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.833+0000 7fdb6644f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55bccfd30f90 con 0x55bccfd23cd0 2024-09-19T06:17:41.840 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.833+0000 7fdb6644f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55bccfc12090 con 0x55bccfd233b0 2024-09-19T06:17:41.840 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.833+0000 7fdb6644f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55bccfd31110 con 0x55bccfd2e570 2024-09-19T06:17:41.840 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.834+0000 7fdb6644f740 10 client.0 _ll_register_callbacks cb 0x55bccfc66f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:41.840 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.834+0000 7fdb5be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd23cd0 0x55bccfd2bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.840 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.834+0000 7fdb60c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd233b0 0x55bccfd2b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.840 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.834+0000 7fdb60c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd233b0 0x55bccfd2b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:43642/0 (socket says 172.21.15.3:43642) 2024-09-19T06:17:41.841 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.834+0000 7fdb5be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd23cd0 0x55bccfd2bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40968/0 (socket says 172.21.15.3:40968) 2024-09-19T06:17:41.841 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.834+0000 7fdb60c00640 1 -- 172.21.15.3:0/481005652 learned_addr learned my addr 172.21.15.3:0/481005652 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:41.841 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.834+0000 7fdb61600640 1 --2- 172.21.15.3:0/481005652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bccfd2e570 0x55bccfd2c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.841 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.834+0000 7fdb5be00640 1 -- 172.21.15.3:0/481005652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bccfd2e570 msgr2=0x55bccfd2c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:41.841 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.834+0000 7fdb5be00640 1 --2- 172.21.15.3:0/481005652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bccfd2e570 0x55bccfd2c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.841 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.834+0000 7fdb5be00640 1 -- 172.21.15.3:0/481005652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd233b0 msgr2=0x55bccfd2b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:41.841 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.834+0000 7fdb5be00640 1 --2- 172.21.15.3:0/481005652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd233b0 0x55bccfd2b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.841 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.834+0000 7fdb5be00640 1 -- 172.21.15.3:0/481005652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bccfa68620 con 0x55bccfd23cd0 2024-09-19T06:17:41.841 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.834+0000 7fdb60c00640 1 --2- 172.21.15.3:0/481005652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd233b0 0x55bccfd2b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:41.841 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.835+0000 7fdb5be00640 1 --2- 172.21.15.3:0/481005652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd23cd0 0x55bccfd2bc10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdb480cd760 tx=0x7fdb4809c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71262b1c3d19c80c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:41.841 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.835+0000 7fdb42000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:17:41.841 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.835+0000 7fdb42000640 1 -- 172.21.15.3:0/481005652 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb480cdbe0 con 0x55bccfd23cd0 2024-09-19T06:17:41.842 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.835+0000 7fdb6644f740 1 -- 172.21.15.3:0/481005652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb50019b10 con 0x55bccfd23cd0 2024-09-19T06:17:41.842 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.835+0000 7fdb42000640 1 -- 172.21.15.3:0/481005652 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fdb480bc0f0 con 0x55bccfd23cd0 2024-09-19T06:17:41.842 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.835+0000 7fdb42000640 1 -- 172.21.15.3:0/481005652 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdb480a06a0 con 0x55bccfd23cd0 2024-09-19T06:17:41.842 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.835+0000 7fdb6644f740 10 client.16632 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:41.842 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.835+0000 7fdb6644f740 1 -- 172.21.15.3:0/481005652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bccfd3ceb0 con 0x55bccfd23cd0 2024-09-19T06:17:41.842 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.836+0000 7fdb42000640 1 -- 172.21.15.3:0/481005652 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb50019b10 con 0x55bccfd23cd0 2024-09-19T06:17:41.842 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.836+0000 7fdb42000640 1 -- 172.21.15.3:0/481005652 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fdb48018b30 con 0x55bccfd23cd0 2024-09-19T06:17:41.842 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.836+0000 7fdb6644f740 10 client.16632 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:41.842 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.836+0000 7fdb6644f740 10 client.16632 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:41.842 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.836+0000 7fdb6644f740 20 client.16632 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:41.842 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.836+0000 7fdb6644f740 1 --2- 172.21.15.3:0/481005652 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55bccfd3e320 0x55bccfd40710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.842 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.836+0000 7fdb6644f740 4 client.16632 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:17:41.843 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.836+0000 7fdb6644f740 1 -- 172.21.15.3:0/481005652 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bccfc96830 con 0x55bccfd3e320 2024-09-19T06:17:41.843 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.837+0000 7fdb60c00640 1 --2- 172.21.15.3:0/481005652 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55bccfd3e320 0x55bccfd40710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.837+0000 7fdb42000640 10 client.16632 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.837+0000 7fdb60c00640 1 --2- 172.21.15.3:0/481005652 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55bccfd3e320 0x55bccfd40710 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51999ddd3231132e server_cookie=7b9c62eec1d6ad20 in_seq=0 out_seq=0 2024-09-19T06:17:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.838+0000 7fdb42000640 1 -- 172.21.15.3:0/481005652 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bccfc96830 con 0x55bccfd3e320 2024-09-19T06:17:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.838+0000 7fdb42000640 10 client.16632 handle_command_reply: tid=0 2024-09-19T06:17:41.844 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.838+0000 7fdb6644f740 1 client.16632 shutdown 2024-09-19T06:17:41.845 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.838+0000 7fdb6644f740 1 -- 172.21.15.3:0/481005652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd23cd0 msgr2=0x55bccfd2bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:41.845 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.838+0000 7fdb6644f740 1 --2- 172.21.15.3:0/481005652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd23cd0 0x55bccfd2bc10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdb480cd760 tx=0x7fdb4809c270 comp rx=0 tx=0).stop 2024-09-19T06:17:41.845 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.838+0000 7fdb6644f740 1 -- 172.21.15.3:0/481005652 shutdown_connections 2024-09-19T06:17:41.845 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.838+0000 7fdb6644f740 1 --2- 172.21.15.3:0/481005652 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55bccfd3e320 0x55bccfd40710 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.845 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.838+0000 7fdb6644f740 1 --2- 172.21.15.3:0/481005652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bccfd2e570 0x55bccfd2c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.845 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.838+0000 7fdb42000640 0 client.16632 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:41.845 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.838+0000 7fdb6644f740 1 --2- 172.21.15.3:0/481005652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd23cd0 0x55bccfd2bc10 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.845 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.838+0000 7fdb6644f740 1 --2- 172.21.15.3:0/481005652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd233b0 0x55bccfd2b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.845 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.838+0000 7fdb6644f740 1 -- 172.21.15.3:0/481005652 >> 172.21.15.3:0/481005652 conn(0x55bccfd1f920 msgr2=0x55bccfd25630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:41.845 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.839+0000 7fdb6644f740 1 -- 172.21.15.3:0/481005652 shutdown_connections 2024-09-19T06:17:41.845 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.839+0000 7fdb6644f740 1 -- 172.21.15.3:0/481005652 wait complete. 2024-09-19T06:17:41.845 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.839+0000 7fdb6644f740 20 client.16632 trim_cache size 0 max 16384 2024-09-19T06:17:41.858 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.855+0000 7fdb6644f740 1 Processor -- start 2024-09-19T06:17:41.858 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.855+0000 7fdb6644f740 1 -- start start 2024-09-19T06:17:41.858 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.855+0000 7fdb6644f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd233b0 0x55bccfd25e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.858 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.855+0000 7fdb6644f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bccfd23cd0 0x55bccfd45fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.858 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.855+0000 7fdb6644f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd2e570 0x55bccfd464f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.858 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.855+0000 7fdb6644f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c1af910 con 0x55bccfd2e570 2024-09-19T06:17:41.858 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.855+0000 7fdb6644f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c1b1450 con 0x55bccfd233b0 2024-09-19T06:17:41.858 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.855+0000 7fdb6644f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c1affe0 con 0x55bccfd23cd0 2024-09-19T06:17:41.858 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.855+0000 7fdb61600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd2e570 0x55bccfd464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.859 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.855+0000 7fdb61600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd2e570 0x55bccfd464f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40978/0 (socket says 172.21.15.3:40978) 2024-09-19T06:17:41.859 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.855+0000 7fdb61600640 1 -- 172.21.15.3:0/2412612194 learned_addr learned my addr 172.21.15.3:0/2412612194 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:41.859 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.856+0000 7fdb60c00640 1 --2- 172.21.15.3:0/2412612194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd233b0 0x55bccfd25e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.859 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.856+0000 7fdb5be00640 1 --2- 172.21.15.3:0/2412612194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bccfd23cd0 0x55bccfd45fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.859 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.856+0000 7fdb60c00640 1 -- 172.21.15.3:0/2412612194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bccfd23cd0 msgr2=0x55bccfd45fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:41.859 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.856+0000 7fdb60c00640 1 --2- 172.21.15.3:0/2412612194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bccfd23cd0 0x55bccfd45fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.859 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.856+0000 7fdb60c00640 1 -- 172.21.15.3:0/2412612194 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd2e570 msgr2=0x55bccfd464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:41.859 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.856+0000 7fdb60c00640 1 --2- 172.21.15.3:0/2412612194 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd2e570 0x55bccfd464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.859 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.856+0000 7fdb60c00640 1 -- 172.21.15.3:0/2412612194 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bccfd23b00 con 0x55bccfd233b0 2024-09-19T06:17:41.859 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.856+0000 7fdb61600640 1 --2- 172.21.15.3:0/2412612194 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd2e570 0x55bccfd464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:41.859 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.856+0000 7fdb60c00640 1 --2- 172.21.15.3:0/2412612194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd233b0 0x55bccfd25e20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55bccfd40f50 tx=0x7fdb50005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b98b3567de947393 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.856+0000 7fdb4d200640 1 -- 172.21.15.3:0/2412612194 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5001e040 con 0x55bccfd233b0 2024-09-19T06:17:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.857+0000 7fdb4d200640 1 -- 172.21.15.3:0/2412612194 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb5001f040 con 0x55bccfd233b0 2024-09-19T06:17:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.857+0000 7fdb4d200640 1 -- 172.21.15.3:0/2412612194 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000ecd0 con 0x55bccfd233b0 2024-09-19T06:17:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.857+0000 7fdb6644f740 1 -- 172.21.15.3:0/2412612194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd233b0 msgr2=0x55bccfd25e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.857+0000 7fdb6644f740 1 --2- 172.21.15.3:0/2412612194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd233b0 0x55bccfd25e20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55bccfd40f50 tx=0x7fdb50005850 comp rx=0 tx=0).stop 2024-09-19T06:17:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.857+0000 7fdb6644f740 1 -- 172.21.15.3:0/2412612194 shutdown_connections 2024-09-19T06:17:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.857+0000 7fdb6644f740 1 --2- 172.21.15.3:0/2412612194 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd2e570 0x55bccfd464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.857+0000 7fdb6644f740 1 --2- 172.21.15.3:0/2412612194 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bccfd23cd0 0x55bccfd45fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.857+0000 7fdb6644f740 1 --2- 172.21.15.3:0/2412612194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd233b0 0x55bccfd25e20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.857+0000 7fdb6644f740 1 -- 172.21.15.3:0/2412612194 >> 172.21.15.3:0/2412612194 conn(0x55bccfd1f920 msgr2=0x55bccfd26990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.857+0000 7fdb6644f740 1 -- 172.21.15.3:0/2412612194 shutdown_connections 2024-09-19T06:17:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.857+0000 7fdb6644f740 1 -- 172.21.15.3:0/2412612194 wait complete. 2024-09-19T06:17:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.858+0000 7fdb6644f740 1 -- start start 2024-09-19T06:17:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.858+0000 7fdb6644f740 1 Processor -- start 2024-09-19T06:17:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.858+0000 7fdb6644f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd233b0 0x55bccfd314d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.858+0000 7fdb6644f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd23cd0 0x55bccfd31a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.858+0000 7fdb6644f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bccfd2e570 0x55bccfda6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.858+0000 7fdb6644f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c1b0d80 con 0x55bccfd23cd0 2024-09-19T06:17:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.858+0000 7fdb6644f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c1b06b0 con 0x55bccfd233b0 2024-09-19T06:17:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.858+0000 7fdb6644f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5c1ad8f0 con 0x55bccfd2e570 2024-09-19T06:17:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.858+0000 7fdb6644f740 10 client.0 _ll_register_callbacks cb 0x7fdb4800cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.859+0000 7fdb5be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd23cd0 0x55bccfd31a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.859+0000 7fdb5be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd23cd0 0x55bccfd31a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40984/0 (socket says 172.21.15.3:40984) 2024-09-19T06:17:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.859+0000 7fdb60c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd233b0 0x55bccfd314d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.859+0000 7fdb5be00640 1 -- 172.21.15.3:0/1862678931 learned_addr learned my addr 172.21.15.3:0/1862678931 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.859+0000 7fdb61600640 1 --2- 172.21.15.3:0/1862678931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bccfd2e570 0x55bccfda6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.859+0000 7fdb5be00640 1 -- 172.21.15.3:0/1862678931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bccfd2e570 msgr2=0x55bccfda6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.859+0000 7fdb5be00640 1 --2- 172.21.15.3:0/1862678931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bccfd2e570 0x55bccfda6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.859+0000 7fdb5be00640 1 -- 172.21.15.3:0/1862678931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd233b0 msgr2=0x55bccfd314d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.859+0000 7fdb5be00640 1 --2- 172.21.15.3:0/1862678931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd233b0 0x55bccfd314d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.859+0000 7fdb5be00640 1 -- 172.21.15.3:0/1862678931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bccfda74b0 con 0x55bccfd23cd0 2024-09-19T06:17:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.859+0000 7fdb61600640 1 --2- 172.21.15.3:0/1862678931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bccfd2e570 0x55bccfda6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:17:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.859+0000 7fdb60c00640 1 --2- 172.21.15.3:0/1862678931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd233b0 0x55bccfd314d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:41.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.859+0000 7fdb5be00640 1 --2- 172.21.15.3:0/1862678931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd23cd0 0x55bccfd31a10 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fdb4809a650 tx=0x7fdb4809c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae30a4c5be637174 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:41.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.859+0000 7fdb42000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:17:41.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.859+0000 7fdb42000640 1 -- 172.21.15.3:0/1862678931 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4809bd00 con 0x55bccfd23cd0 2024-09-19T06:17:41.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.859+0000 7fdb42000640 1 -- 172.21.15.3:0/1862678931 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fdb480cd9e0 con 0x55bccfd23cd0 2024-09-19T06:17:41.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.860+0000 7fdb6644f740 1 -- 172.21.15.3:0/1862678931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb5001f040 con 0x55bccfd23cd0 2024-09-19T06:17:41.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.860+0000 7fdb42000640 1 -- 172.21.15.3:0/1862678931 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdb480cdbe0 con 0x55bccfd23cd0 2024-09-19T06:17:41.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.860+0000 7fdb6644f740 10 client.16638 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:41.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.860+0000 7fdb6644f740 1 -- 172.21.15.3:0/1862678931 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bccfda86b0 con 0x55bccfd23cd0 2024-09-19T06:17:41.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.860+0000 7fdb42000640 1 -- 172.21.15.3:0/1862678931 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb5001f040 con 0x55bccfd23cd0 2024-09-19T06:17:41.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.860+0000 7fdb42000640 1 -- 172.21.15.3:0/1862678931 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fdb48098210 con 0x55bccfd23cd0 2024-09-19T06:17:41.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.860+0000 7fdb6644f740 10 client.16638 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:41.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.860+0000 7fdb6644f740 10 client.16638 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:41.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.860+0000 7fdb6644f740 20 client.16638 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:41.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.860+0000 7fdb6644f740 1 --2- 172.21.15.3:0/1862678931 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55bccfda8c40 0x55bccfdab030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:41.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.860+0000 7fdb6644f740 4 client.16638 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:17:41.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.860+0000 7fdb6644f740 1 -- 172.21.15.3:0/1862678931 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bccfc90b80 con 0x55bccfda8c40 2024-09-19T06:17:41.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.861+0000 7fdb60c00640 1 --2- 172.21.15.3:0/1862678931 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55bccfda8c40 0x55bccfdab030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:41.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.861+0000 7fdb60c00640 1 --2- 172.21.15.3:0/1862678931 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55bccfda8c40 0x55bccfdab030 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c91569281525994 server_cookie=c2134b65f92c550c in_seq=0 out_seq=0 2024-09-19T06:17:41.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.861+0000 7fdb42000640 10 client.16638 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.875+0000 7fdb42000640 1 -- 172.21.15.3:0/1862678931 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bccfc90b80 con 0x55bccfda8c40 2024-09-19T06:17:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.875+0000 7fdb42000640 10 client.16638 handle_command_reply: tid=0 2024-09-19T06:17:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.875+0000 7fdb6644f740 1 client.16638 shutdown 2024-09-19T06:17:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.875+0000 7fdb6644f740 1 -- 172.21.15.3:0/1862678931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd23cd0 msgr2=0x55bccfd31a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.875+0000 7fdb6644f740 1 --2- 172.21.15.3:0/1862678931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd23cd0 0x55bccfd31a10 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fdb4809a650 tx=0x7fdb4809c010 comp rx=0 tx=0).stop 2024-09-19T06:17:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.875+0000 7fdb6644f740 1 -- 172.21.15.3:0/1862678931 shutdown_connections 2024-09-19T06:17:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.875+0000 7fdb6644f740 1 --2- 172.21.15.3:0/1862678931 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55bccfda8c40 0x55bccfdab030 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.875+0000 7fdb6644f740 1 --2- 172.21.15.3:0/1862678931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55bccfd2e570 0x55bccfda6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.875+0000 7fdb6644f740 1 --2- 172.21.15.3:0/1862678931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55bccfd23cd0 0x55bccfd31a10 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.875+0000 7fdb6644f740 1 --2- 172.21.15.3:0/1862678931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bccfd233b0 0x55bccfd314d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.875+0000 7fdb42000640 0 client.16638 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:41.878 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.875+0000 7fdb6644f740 1 -- 172.21.15.3:0/1862678931 >> 172.21.15.3:0/1862678931 conn(0x55bccfd1f920 msgr2=0x55bccfd1e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.876+0000 7fdb6644f740 1 -- 172.21.15.3:0/1862678931 shutdown_connections 2024-09-19T06:17:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.876+0000 7fdb6644f740 1 -- 172.21.15.3:0/1862678931 wait complete. 2024-09-19T06:17:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.876+0000 7fdb6644f740 20 client.16638 trim_cache size 0 max 16384 2024-09-19T06:17:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:17:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:17:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:17:41.879 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:17:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.876+0000 7fdb62000640 1 -- 172.21.15.3:0/1780197275 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fdb440a33a0 msgr2=0x7fdb440a5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.876+0000 7fdb62000640 1 --2- 172.21.15.3:0/1780197275 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fdb440a33a0 0x7fdb440a5860 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdb54006010 tx=0x7fdb54005d80 comp rx=0 tx=0).stop 2024-09-19T06:17:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.876+0000 7fdb62000640 1 -- 172.21.15.3:0/1780197275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb5c1044d0 msgr2=0x7fdb5c19a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.876+0000 7fdb62000640 1 --2- 172.21.15.3:0/1780197275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb5c1044d0 0x7fdb5c19a880 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800e9f0 tx=0x7fdb4800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.877+0000 7fdb62000640 1 -- 172.21.15.3:0/1780197275 shutdown_connections 2024-09-19T06:17:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.877+0000 7fdb62000640 1 --2- 172.21.15.3:0/1780197275 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fdb440a33a0 0x7fdb440a5860 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.880 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.877+0000 7fdb62000640 1 --2- 172.21.15.3:0/1780197275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb5c109bf0 0x7fdb5c19ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.881 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.877+0000 7fdb62000640 1 --2- 172.21.15.3:0/1780197275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb5c1044d0 0x7fdb5c19a880 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.881 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.877+0000 7fdb62000640 1 --2- 172.21.15.3:0/1780197275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb5c103b30 0x7fdb5c19a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:41.881 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.877+0000 7fdb62000640 1 -- 172.21.15.3:0/1780197275 >> 172.21.15.3:0/1780197275 conn(0x7fdb5c0ff810 msgr2=0x7fdb5c100ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:41.881 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.877+0000 7fdb62000640 1 -- 172.21.15.3:0/1780197275 shutdown_connections 2024-09-19T06:17:41.881 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:41.877+0000 7fdb62000640 1 -- 172.21.15.3:0/1780197275 wait complete. 2024-09-19T06:17:42.421 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:17:42.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:42 smithi059 ceph-mon[35138]: pgmap v162: 97 pgs: 97 active+clean; 3.6 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-19T06:17:42.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:42 smithi003 ceph-mon[30893]: pgmap v162: 97 pgs: 97 active+clean; 3.6 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-19T06:17:42.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:42 smithi071 ceph-mon[35662]: pgmap v162: 97 pgs: 97 active+clean; 3.6 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-19T06:17:42.801 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:17:43.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.378+0000 7f53a1000640 1 -- 172.21.15.3:0/1912394211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f539c101de0 msgr2=0x7f539c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:43.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.378+0000 7f53a1000640 1 --2- 172.21.15.3:0/1912394211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f539c101de0 0x7f539c1021c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f538c009900 tx=0x7f538c02a410 comp rx=0 tx=0).stop 2024-09-19T06:17:43.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.378+0000 7f53a1000640 1 -- 172.21.15.3:0/1912394211 shutdown_connections 2024-09-19T06:17:43.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.378+0000 7f53a1000640 1 --2- 172.21.15.3:0/1912394211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539c106f10 0x7f539c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.378+0000 7f53a1000640 1 --2- 172.21.15.3:0/1912394211 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f539c102790 0x7f539c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.378+0000 7f53a1000640 1 --2- 172.21.15.3:0/1912394211 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f539c101de0 0x7f539c1021c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.378+0000 7f53a1000640 1 -- 172.21.15.3:0/1912394211 >> 172.21.15.3:0/1912394211 conn(0x7f539c0fd8c0 msgr2=0x7f539c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:43.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.378+0000 7f53a1000640 1 -- 172.21.15.3:0/1912394211 shutdown_connections 2024-09-19T06:17:43.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.378+0000 7f53a1000640 1 -- 172.21.15.3:0/1912394211 wait complete. 2024-09-19T06:17:43.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.379+0000 7f53a1000640 1 Processor -- start 2024-09-19T06:17:43.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.379+0000 7f53a1000640 1 -- start start 2024-09-19T06:17:43.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.380+0000 7f53a1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539c101de0 0x7f539c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:43.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.380+0000 7f53a1000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f539c102790 0x7f539c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:43.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.380+0000 7f53a1000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f539c106f10 0x7f539c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:43.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.380+0000 7f53a1000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f539c111fc0 con 0x7f539c106f10 2024-09-19T06:17:43.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.380+0000 7f53a1000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f539c111e40 con 0x7f539c101de0 2024-09-19T06:17:43.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.380+0000 7f53a1000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f539c112140 con 0x7f539c102790 2024-09-19T06:17:43.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.380+0000 7f5399400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f539c102790 0x7f539c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:43.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.380+0000 7f539a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f539c106f10 0x7f539c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:43.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.380+0000 7f5399400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f539c102790 0x7f539c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:53048/0 (socket says 172.21.15.3:53048) 2024-09-19T06:17:43.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.380+0000 7f5399400640 1 -- 172.21.15.3:0/3077213983 learned_addr learned my addr 172.21.15.3:0/3077213983 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:43.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.380+0000 7f5399e00640 1 --2- 172.21.15.3:0/3077213983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539c101de0 0x7f539c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:43.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.380+0000 7f5399400640 1 -- 172.21.15.3:0/3077213983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539c101de0 msgr2=0x7f539c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:43.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.380+0000 7f5399400640 1 --2- 172.21.15.3:0/3077213983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539c101de0 0x7f539c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.380+0000 7f5399400640 1 -- 172.21.15.3:0/3077213983 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f539c106f10 msgr2=0x7f539c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:43.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.380+0000 7f5399400640 1 --2- 172.21.15.3:0/3077213983 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f539c106f10 0x7f539c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.380+0000 7f5399400640 1 -- 172.21.15.3:0/3077213983 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f539c1a6920 con 0x7f539c102790 2024-09-19T06:17:43.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.381+0000 7f5399400640 1 --2- 172.21.15.3:0/3077213983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f539c102790 0x7f539c074a30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f538800e9f0 tx=0x7f538800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:43.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.381+0000 7f5392a00640 1 -- 172.21.15.3:0/3077213983 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538800cd80 con 0x7f539c102790 2024-09-19T06:17:43.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.381+0000 7f5392a00640 1 -- 172.21.15.3:0/3077213983 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5388005500 con 0x7f539c102790 2024-09-19T06:17:43.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.381+0000 7f5392a00640 1 -- 172.21.15.3:0/3077213983 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5388010690 con 0x7f539c102790 2024-09-19T06:17:43.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.381+0000 7f53a1000640 1 -- 172.21.15.3:0/3077213983 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f539c1a6c10 con 0x7f539c102790 2024-09-19T06:17:43.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.381+0000 7f53a1000640 1 -- 172.21.15.3:0/3077213983 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f539c1a7100 con 0x7f539c102790 2024-09-19T06:17:43.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.384+0000 7f53a3ad6740 1 Processor -- start 2024-09-19T06:17:43.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.384+0000 7f53a3ad6740 1 -- start start 2024-09-19T06:17:43.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.385+0000 7f53a3ad6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d3c70 0x56298e3d4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:43.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.385+0000 7f53a3ad6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56298e3d4590 0x56298e3de910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:43.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.385+0000 7f5392a00640 1 -- 172.21.15.3:0/3077213983 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f53880046c0 con 0x7f539c102790 2024-09-19T06:17:43.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.385+0000 7f53a3ad6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56298e3dee50 0x56298e3e1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:43.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.385+0000 7f53a3ad6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56298e33a3e0 con 0x56298e3d3c70 2024-09-19T06:17:43.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.385+0000 7f53a3ad6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56298e2e1d80 con 0x56298e3d4590 2024-09-19T06:17:43.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.385+0000 7f53a3ad6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56298e3363a0 con 0x56298e3dee50 2024-09-19T06:17:43.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.385+0000 7f539a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d3c70 0x56298e3d4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:43.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.385+0000 7f5399400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56298e3dee50 0x56298e3e1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:43.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.385+0000 7f539a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d3c70 0x56298e3d4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41016/0 (socket says 172.21.15.3:41016) 2024-09-19T06:17:43.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.385+0000 7f539a800640 1 -- 172.21.15.3:0/2269368245 learned_addr learned my addr 172.21.15.3:0/2269368245 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:43.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.385+0000 7f5399e00640 1 --2- 172.21.15.3:0/2269368245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56298e3d4590 0x56298e3de910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:43.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.386+0000 7f539a800640 1 -- 172.21.15.3:0/2269368245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56298e3dee50 msgr2=0x56298e3e1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:43.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.386+0000 7f539a800640 1 --2- 172.21.15.3:0/2269368245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56298e3dee50 0x56298e3e1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.386+0000 7f539a800640 1 -- 172.21.15.3:0/2269368245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56298e3d4590 msgr2=0x56298e3de910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:43.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.386+0000 7f539a800640 1 --2- 172.21.15.3:0/2269368245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56298e3d4590 0x56298e3de910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.386+0000 7f539a800640 1 -- 172.21.15.3:0/2269368245 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56298e300ae0 con 0x56298e3d3c70 2024-09-19T06:17:43.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.386+0000 7f5399400640 1 --2- 172.21.15.3:0/2269368245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56298e3dee50 0x56298e3e1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:43.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.386+0000 7f539a800640 1 --2- 172.21.15.3:0/2269368245 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d3c70 0x56298e3d4050 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5394009f50 tx=0x7f53940118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f87a90fa8ba1e8ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:43.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.386+0000 7f5387400640 1 -- 172.21.15.3:0/2269368245 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5394004d20 con 0x56298e3d3c70 2024-09-19T06:17:43.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.386+0000 7f5387400640 1 -- 172.21.15.3:0/2269368245 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5394004050 con 0x56298e3d3c70 2024-09-19T06:17:43.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.386+0000 7f5387400640 1 -- 172.21.15.3:0/2269368245 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5394005220 con 0x56298e3d3c70 2024-09-19T06:17:43.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.387+0000 7f5392a00640 1 --2- 172.21.15.3:0/3077213983 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f53800a3430 0x7f53800a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:43.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.387+0000 7f53a3ad6740 1 -- 172.21.15.3:0/2269368245 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d3c70 msgr2=0x56298e3d4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:43.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.387+0000 7f53a3ad6740 1 --2- 172.21.15.3:0/2269368245 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d3c70 0x56298e3d4050 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5394009f50 tx=0x7f53940118d0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.387+0000 7f5392a00640 1 -- 172.21.15.3:0/3077213983 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f53880d00a0 con 0x7f539c102790 2024-09-19T06:17:43.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.387+0000 7f53a3ad6740 1 -- 172.21.15.3:0/2269368245 shutdown_connections 2024-09-19T06:17:43.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.387+0000 7f53a3ad6740 1 --2- 172.21.15.3:0/2269368245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56298e3dee50 0x56298e3e1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.387+0000 7f53a3ad6740 1 --2- 172.21.15.3:0/2269368245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56298e3d4590 0x56298e3de910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.387+0000 7f5399e00640 1 --2- 172.21.15.3:0/3077213983 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f53800a3430 0x7f53800a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:43.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.387+0000 7f53a3ad6740 1 --2- 172.21.15.3:0/2269368245 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d3c70 0x56298e3d4050 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.387+0000 7f53a3ad6740 1 -- 172.21.15.3:0/2269368245 >> 172.21.15.3:0/2269368245 conn(0x56298e3d0200 msgr2=0x56298e3d05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:43.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.387+0000 7f53a3ad6740 1 -- 172.21.15.3:0/2269368245 shutdown_connections 2024-09-19T06:17:43.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.387+0000 7f53a3ad6740 1 -- 172.21.15.3:0/2269368245 wait complete. 2024-09-19T06:17:43.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.388+0000 7f53a3ad6740 1 -- start start 2024-09-19T06:17:43.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.388+0000 7f5399e00640 1 --2- 172.21.15.3:0/3077213983 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f53800a3430 0x7f53800a58f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f538c000c00 tx=0x7f538c005b50 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:43.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.388+0000 7f53a3ad6740 1 Processor -- start 2024-09-19T06:17:43.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.389+0000 7f53a3ad6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56298e3d3c70 0x56298e3dbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:43.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.389+0000 7f53a3ad6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d4590 0x56298e3dc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:43.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.389+0000 7f53a3ad6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56298e3dee50 0x56298e3dc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:43.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.389+0000 7f53a3ad6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56298e3e1a20 con 0x56298e3d4590 2024-09-19T06:17:43.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.389+0000 7f53a3ad6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56298e2f50f0 con 0x56298e3dee50 2024-09-19T06:17:43.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.389+0000 7f53a3ad6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56298e3e1ba0 con 0x56298e3d3c70 2024-09-19T06:17:43.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.389+0000 7f53a3ad6740 10 client.0 _ll_register_callbacks cb 0x56298e2dcbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:43.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.389+0000 7f5399400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d4590 0x56298e3dc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:43.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.389+0000 7f5399e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56298e3d3c70 0x56298e3dbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:43.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.389+0000 7f5399400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d4590 0x56298e3dc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41024/0 (socket says 172.21.15.3:41024) 2024-09-19T06:17:43.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.389+0000 7f5399400640 1 -- 172.21.15.3:0/925976614 learned_addr learned my addr 172.21.15.3:0/925976614 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:43.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.389+0000 7f539a800640 1 --2- 172.21.15.3:0/925976614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56298e3dee50 0x56298e3dc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:43.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.389+0000 7f5399400640 1 -- 172.21.15.3:0/925976614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56298e3d3c70 msgr2=0x56298e3dbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:43.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.389+0000 7f5399400640 1 --2- 172.21.15.3:0/925976614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56298e3d3c70 0x56298e3dbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.389+0000 7f5399400640 1 -- 172.21.15.3:0/925976614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56298e3dee50 msgr2=0x56298e3dc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:43.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.389+0000 7f5399400640 1 --2- 172.21.15.3:0/925976614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56298e3dee50 0x56298e3dc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.389+0000 7f5399400640 1 -- 172.21.15.3:0/925976614 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56298e0ab3c0 con 0x56298e3d4590 2024-09-19T06:17:43.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.390+0000 7f5399400640 1 --2- 172.21.15.3:0/925976614 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d4590 0x56298e3dc200 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f538800c6a0 tx=0x7f5388009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb096ea9c46f699 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:43.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.390+0000 7f537be00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:17:43.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.390+0000 7f537be00640 1 -- 172.21.15.3:0/925976614 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5388098620 con 0x56298e3d4590 2024-09-19T06:17:43.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.390+0000 7f537be00640 1 -- 172.21.15.3:0/925976614 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f53880a4d60 con 0x56298e3d4590 2024-09-19T06:17:43.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.390+0000 7f53a3ad6740 1 -- 172.21.15.3:0/925976614 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5394004050 con 0x56298e3d4590 2024-09-19T06:17:43.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.390+0000 7f537be00640 1 -- 172.21.15.3:0/925976614 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f538809bce0 con 0x56298e3d4590 2024-09-19T06:17:43.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.390+0000 7f53a3ad6740 10 client.16650 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:43.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.390+0000 7f53a3ad6740 1 -- 172.21.15.3:0/925976614 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56298e3eda40 con 0x56298e3d4590 2024-09-19T06:17:43.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.391+0000 7f537be00640 1 -- 172.21.15.3:0/925976614 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5394004050 con 0x56298e3d4590 2024-09-19T06:17:43.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.391+0000 7f537be00640 1 -- 172.21.15.3:0/925976614 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f53880b5140 con 0x56298e3d4590 2024-09-19T06:17:43.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.391+0000 7f53a3ad6740 10 client.16650 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:43.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.391+0000 7f53a3ad6740 10 client.16650 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:17:43.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.391+0000 7f53a3ad6740 20 client.16650 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:43.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.391+0000 7f53a3ad6740 1 --2- 172.21.15.3:0/925976614 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x56298e3eee50 0x56298e3f12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:43.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.391+0000 7f53a3ad6740 4 client.16650 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:17:43.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.391+0000 7f53a3ad6740 1 -- 172.21.15.3:0/925976614 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56298e347950 con 0x56298e3eee50 2024-09-19T06:17:43.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.391+0000 7f5399e00640 1 --2- 172.21.15.3:0/925976614 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x56298e3eee50 0x56298e3f12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:43.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.392+0000 7f5399e00640 1 --2- 172.21.15.3:0/925976614 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x56298e3eee50 0x56298e3f12b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3e377de96179a51d server_cookie=4e0de78aad822432 in_seq=0 out_seq=0 2024-09-19T06:17:43.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.392+0000 7f537be00640 10 client.16650 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:17:43.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.393+0000 7f537be00640 1 -- 172.21.15.3:0/925976614 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56298e347950 con 0x56298e3eee50 2024-09-19T06:17:43.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.393+0000 7f537be00640 10 client.16650 handle_command_reply: tid=0 2024-09-19T06:17:43.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.393+0000 7f53a3ad6740 1 client.16650 shutdown 2024-09-19T06:17:43.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.393+0000 7f53a3ad6740 1 -- 172.21.15.3:0/925976614 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d4590 msgr2=0x56298e3dc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:43.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.393+0000 7f53a3ad6740 1 --2- 172.21.15.3:0/925976614 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d4590 0x56298e3dc200 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f538800c6a0 tx=0x7f5388009310 comp rx=0 tx=0).stop 2024-09-19T06:17:43.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.393+0000 7f53a3ad6740 1 -- 172.21.15.3:0/925976614 shutdown_connections 2024-09-19T06:17:43.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.393+0000 7f53a3ad6740 1 --2- 172.21.15.3:0/925976614 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x56298e3eee50 0x56298e3f12b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.393+0000 7f53a3ad6740 1 --2- 172.21.15.3:0/925976614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56298e3dee50 0x56298e3dc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.393+0000 7f53a3ad6740 1 --2- 172.21.15.3:0/925976614 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d4590 0x56298e3dc200 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.393+0000 7f53a3ad6740 1 --2- 172.21.15.3:0/925976614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56298e3d3c70 0x56298e3dbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.393+0000 7f53a3ad6740 1 -- 172.21.15.3:0/925976614 >> 172.21.15.3:0/925976614 conn(0x56298e3d0200 msgr2=0x56298e3d5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:43.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.393+0000 7f537be00640 0 client.16650 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:17:43.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.393+0000 7f53a3ad6740 1 -- 172.21.15.3:0/925976614 shutdown_connections 2024-09-19T06:17:43.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.393+0000 7f53a3ad6740 1 -- 172.21.15.3:0/925976614 wait complete. 2024-09-19T06:17:43.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.393+0000 7f53a3ad6740 20 client.16650 trim_cache size 0 max 16384 2024-09-19T06:17:43.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.407+0000 7f53a3ad6740 1 Processor -- start 2024-09-19T06:17:43.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.407+0000 7f53a3ad6740 1 -- start start 2024-09-19T06:17:43.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.407+0000 7f53a3ad6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56298e3d3c70 0x56298e3da590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:43.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.407+0000 7f53a3ad6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d4590 0x56298e3f6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:43.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.407+0000 7f53a3ad6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56298e3dee50 0x56298e3f70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:43.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.407+0000 7f53a3ad6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f539c1afae0 con 0x56298e3d4590 2024-09-19T06:17:43.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.407+0000 7f53a3ad6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f539c1b1620 con 0x56298e3dee50 2024-09-19T06:17:43.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.407+0000 7f53a3ad6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f539c1b01b0 con 0x56298e3d3c70 2024-09-19T06:17:43.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.408+0000 7f5399400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d4590 0x56298e3f6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:43.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.408+0000 7f5399400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d4590 0x56298e3f6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41038/0 (socket says 172.21.15.3:41038) 2024-09-19T06:17:43.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.408+0000 7f5399400640 1 -- 172.21.15.3:0/2074658225 learned_addr learned my addr 172.21.15.3:0/2074658225 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:43.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.408+0000 7f5399e00640 1 --2- 172.21.15.3:0/2074658225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56298e3d3c70 0x56298e3da590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:43.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.408+0000 7f539a800640 1 --2- 172.21.15.3:0/2074658225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56298e3dee50 0x56298e3f70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:43.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.408+0000 7f5399400640 1 -- 172.21.15.3:0/2074658225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56298e3d3c70 msgr2=0x56298e3da590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:43.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.408+0000 7f5399400640 1 --2- 172.21.15.3:0/2074658225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56298e3d3c70 0x56298e3da590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.408+0000 7f5399400640 1 -- 172.21.15.3:0/2074658225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56298e3dee50 msgr2=0x56298e3f70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:43.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.408+0000 7f5399400640 1 --2- 172.21.15.3:0/2074658225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56298e3dee50 0x56298e3f70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.408+0000 7f5399400640 1 -- 172.21.15.3:0/2074658225 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56298e3d43c0 con 0x56298e3d4590 2024-09-19T06:17:43.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.408+0000 7f5399400640 1 --2- 172.21.15.3:0/2074658225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d4590 0x56298e3f6b80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f53880cddf0 tx=0x7f53880d3f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5341258be70cda77 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:43.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.409+0000 7f5386a00640 1 -- 172.21.15.3:0/2074658225 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538809bec0 con 0x56298e3d4590 2024-09-19T06:17:43.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.409+0000 7f5386a00640 1 -- 172.21.15.3:0/2074658225 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53880a0730 con 0x56298e3d4590 2024-09-19T06:17:43.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.409+0000 7f5386a00640 1 -- 172.21.15.3:0/2074658225 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538809c150 con 0x56298e3d4590 2024-09-19T06:17:43.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.409+0000 7f53a3ad6740 1 -- 172.21.15.3:0/2074658225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d4590 msgr2=0x56298e3f6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:43.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.409+0000 7f53a3ad6740 1 --2- 172.21.15.3:0/2074658225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d4590 0x56298e3f6b80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f53880cddf0 tx=0x7f53880d3f40 comp rx=0 tx=0).stop 2024-09-19T06:17:43.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.409+0000 7f53a3ad6740 1 -- 172.21.15.3:0/2074658225 shutdown_connections 2024-09-19T06:17:43.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.409+0000 7f53a3ad6740 1 --2- 172.21.15.3:0/2074658225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56298e3dee50 0x56298e3f70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.409+0000 7f53a3ad6740 1 --2- 172.21.15.3:0/2074658225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d4590 0x56298e3f6b80 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.409+0000 7f53a3ad6740 1 --2- 172.21.15.3:0/2074658225 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56298e3d3c70 0x56298e3da590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.409+0000 7f53a3ad6740 1 -- 172.21.15.3:0/2074658225 >> 172.21.15.3:0/2074658225 conn(0x56298e3d0200 msgr2=0x56298e3ddd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:43.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.409+0000 7f53a3ad6740 1 -- 172.21.15.3:0/2074658225 shutdown_connections 2024-09-19T06:17:43.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.410+0000 7f53a3ad6740 1 -- 172.21.15.3:0/2074658225 wait complete. 2024-09-19T06:17:43.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.410+0000 7f53a3ad6740 1 -- start start 2024-09-19T06:17:43.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.410+0000 7f53a3ad6740 1 Processor -- start 2024-09-19T06:17:43.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.411+0000 7f53a3ad6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d3c70 0x56298e3e2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:43.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.411+0000 7f53a3ad6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56298e3d4590 0x56298e3e3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:43.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.411+0000 7f53a3ad6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56298e3dee50 0x56298e3e3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:43.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.411+0000 7f53a3ad6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f539c1b0f50 con 0x56298e3d3c70 2024-09-19T06:17:43.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.411+0000 7f53a3ad6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f539c1b0880 con 0x56298e3d4590 2024-09-19T06:17:43.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.411+0000 7f53a3ad6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f539c1adac0 con 0x56298e3dee50 2024-09-19T06:17:43.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.411+0000 7f53a3ad6740 10 client.0 _ll_register_callbacks cb 0x7f538800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:43.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.411+0000 7f5399e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d3c70 0x56298e3e2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:43.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.411+0000 7f5399e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d3c70 0x56298e3e2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41046/0 (socket says 172.21.15.3:41046) 2024-09-19T06:17:43.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.411+0000 7f5399e00640 1 -- 172.21.15.3:0/4272735521 learned_addr learned my addr 172.21.15.3:0/4272735521 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:43.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.411+0000 7f539a800640 1 --2- 172.21.15.3:0/4272735521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56298e3dee50 0x56298e3e3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:43.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.411+0000 7f5399400640 1 --2- 172.21.15.3:0/4272735521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56298e3d4590 0x56298e3e3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:43.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.411+0000 7f5399e00640 1 -- 172.21.15.3:0/4272735521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56298e3dee50 msgr2=0x56298e3e3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:43.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.411+0000 7f5399e00640 1 --2- 172.21.15.3:0/4272735521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56298e3dee50 0x56298e3e3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.411+0000 7f5399e00640 1 -- 172.21.15.3:0/4272735521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56298e3d4590 msgr2=0x56298e3e3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:43.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.411+0000 7f5399e00640 1 --2- 172.21.15.3:0/4272735521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56298e3d4590 0x56298e3e3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.411+0000 7f5399e00640 1 -- 172.21.15.3:0/4272735521 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56298e458e40 con 0x56298e3d3c70 2024-09-19T06:17:43.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.411+0000 7f5399400640 1 --2- 172.21.15.3:0/4272735521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56298e3d4590 0x56298e3e3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:43.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.412+0000 7f5399e00640 1 --2- 172.21.15.3:0/4272735521 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d3c70 0x56298e3e2dd0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f538c0096c0 tx=0x7f538c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f7efeca3717b868 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:43.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.412+0000 7f537be00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:17:43.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.412+0000 7f537be00640 1 -- 172.21.15.3:0/4272735521 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c035040 con 0x56298e3d3c70 2024-09-19T06:17:43.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.412+0000 7f53a3ad6740 1 -- 172.21.15.3:0/4272735521 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56298e341e60 con 0x56298e3d3c70 2024-09-19T06:17:43.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.412+0000 7f537be00640 1 -- 172.21.15.3:0/4272735521 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f538c004960 con 0x56298e3d3c70 2024-09-19T06:17:43.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.412+0000 7f537be00640 1 -- 172.21.15.3:0/4272735521 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f538c004b60 con 0x56298e3d3c70 2024-09-19T06:17:43.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.412+0000 7f53a3ad6740 10 client.16656 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:43.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.412+0000 7f53a3ad6740 1 -- 172.21.15.3:0/4272735521 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56298e45a120 con 0x56298e3d3c70 2024-09-19T06:17:43.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.413+0000 7f537be00640 1 -- 172.21.15.3:0/4272735521 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56298e341e60 con 0x56298e3d3c70 2024-09-19T06:17:43.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.413+0000 7f537be00640 1 -- 172.21.15.3:0/4272735521 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f538c0035f0 con 0x56298e3d3c70 2024-09-19T06:17:43.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.413+0000 7f53a3ad6740 10 client.16656 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:43.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.413+0000 7f53a3ad6740 10 client.16656 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:17:43.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.413+0000 7f53a3ad6740 20 client.16656 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:43.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.413+0000 7f53a3ad6740 1 --2- 172.21.15.3:0/4272735521 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x56298e45a7f0 0x56298e45cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:43.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.413+0000 7f53a3ad6740 4 client.16656 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:17:43.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.413+0000 7f53a3ad6740 1 -- 172.21.15.3:0/4272735521 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56298e2be010 con 0x56298e45a7f0 2024-09-19T06:17:43.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.413+0000 7f5399400640 1 --2- 172.21.15.3:0/4272735521 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x56298e45a7f0 0x56298e45cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:43.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.414+0000 7f5399400640 1 --2- 172.21.15.3:0/4272735521 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x56298e45a7f0 0x56298e45cbe0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c06ef87be93e5c13 server_cookie=31c59b09017521f4 in_seq=0 out_seq=0 2024-09-19T06:17:43.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.414+0000 7f537be00640 10 client.16656 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:17:43.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.414+0000 7f537be00640 1 -- 172.21.15.3:0/4272735521 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56298e2be010 con 0x56298e45a7f0 2024-09-19T06:17:43.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.414+0000 7f537be00640 10 client.16656 handle_command_reply: tid=0 2024-09-19T06:17:43.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.414+0000 7f53a3ad6740 1 client.16656 shutdown 2024-09-19T06:17:43.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.414+0000 7f53a3ad6740 1 -- 172.21.15.3:0/4272735521 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d3c70 msgr2=0x56298e3e2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:43.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.414+0000 7f53a3ad6740 1 --2- 172.21.15.3:0/4272735521 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d3c70 0x56298e3e2dd0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f538c0096c0 tx=0x7f538c009260 comp rx=0 tx=0).stop 2024-09-19T06:17:43.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.414+0000 7f53a3ad6740 1 -- 172.21.15.3:0/4272735521 shutdown_connections 2024-09-19T06:17:43.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.414+0000 7f53a3ad6740 1 --2- 172.21.15.3:0/4272735521 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x56298e45a7f0 0x56298e45cbe0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.414+0000 7f53a3ad6740 1 --2- 172.21.15.3:0/4272735521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56298e3dee50 0x56298e3e3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.415+0000 7f537be00640 0 client.16656 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:17:43.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.415+0000 7f53a3ad6740 1 --2- 172.21.15.3:0/4272735521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56298e3d4590 0x56298e3e3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.415+0000 7f53a3ad6740 1 --2- 172.21.15.3:0/4272735521 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56298e3d3c70 0x56298e3e2dd0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.415+0000 7f53a3ad6740 1 -- 172.21.15.3:0/4272735521 >> 172.21.15.3:0/4272735521 conn(0x56298e3d0200 msgr2=0x56298e3ceb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:43.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.415+0000 7f53a3ad6740 1 -- 172.21.15.3:0/4272735521 shutdown_connections 2024-09-19T06:17:43.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.415+0000 7f53a3ad6740 1 -- 172.21.15.3:0/4272735521 wait complete. 2024-09-19T06:17:43.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.415+0000 7f53a3ad6740 20 client.16656 trim_cache size 0 max 16384 2024-09-19T06:17:43.421 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:17:43.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.415+0000 7f53a1000640 1 -- 172.21.15.3:0/3077213983 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f53800a3430 msgr2=0x7f53800a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:43.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.415+0000 7f53a1000640 1 --2- 172.21.15.3:0/3077213983 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f53800a3430 0x7f53800a58f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f538c000c00 tx=0x7f538c005b50 comp rx=0 tx=0).stop 2024-09-19T06:17:43.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.415+0000 7f53a1000640 1 -- 172.21.15.3:0/3077213983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f539c102790 msgr2=0x7f539c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:43.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.415+0000 7f53a1000640 1 --2- 172.21.15.3:0/3077213983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f539c102790 0x7f539c074a30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f538800e9f0 tx=0x7f538800edf0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.416+0000 7f53a1000640 1 -- 172.21.15.3:0/3077213983 shutdown_connections 2024-09-19T06:17:43.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.416+0000 7f53a1000640 1 --2- 172.21.15.3:0/3077213983 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f53800a3430 0x7f53800a58f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.416+0000 7f53a1000640 1 --2- 172.21.15.3:0/3077213983 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f539c106f10 0x7f539c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.416+0000 7f53a1000640 1 --2- 172.21.15.3:0/3077213983 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f539c102790 0x7f539c074a30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.416+0000 7f53a1000640 1 --2- 172.21.15.3:0/3077213983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539c101de0 0x7f539c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:43.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.416+0000 7f53a1000640 1 -- 172.21.15.3:0/3077213983 >> 172.21.15.3:0/3077213983 conn(0x7f539c0fd8c0 msgr2=0x7f539c0febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:43.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.416+0000 7f53a1000640 1 -- 172.21.15.3:0/3077213983 shutdown_connections 2024-09-19T06:17:43.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:43.416+0000 7f53a1000640 1 -- 172.21.15.3:0/3077213983 wait complete. 2024-09-19T06:17:44.247 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:17:44.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:44 smithi059 ceph-mon[35138]: pgmap v163: 97 pgs: 97 active+clean; 3.6 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-19T06:17:44.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:44 smithi003 ceph-mon[30893]: pgmap v163: 97 pgs: 97 active+clean; 3.6 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-19T06:17:44.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:44 smithi071 ceph-mon[35662]: pgmap v163: 97 pgs: 97 active+clean; 3.6 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-19T06:17:44.630 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:17:45.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.202+0000 7fd532c00640 1 -- 172.21.15.3:0/2183960091 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd52c102790 msgr2=0x7fd52c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:45.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.202+0000 7fd532c00640 1 --2- 172.21.15.3:0/2183960091 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd52c102790 0x7fd52c1067e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd514009900 tx=0x7fd51402a410 comp rx=0 tx=0).stop 2024-09-19T06:17:45.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.202+0000 7fd532c00640 1 -- 172.21.15.3:0/2183960091 shutdown_connections 2024-09-19T06:17:45.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.202+0000 7fd532c00640 1 --2- 172.21.15.3:0/2183960091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd52c106f10 0x7fd52c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.202+0000 7fd532c00640 1 --2- 172.21.15.3:0/2183960091 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd52c102790 0x7fd52c1067e0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.202+0000 7fd532c00640 1 --2- 172.21.15.3:0/2183960091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd52c101de0 0x7fd52c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.202+0000 7fd532c00640 1 -- 172.21.15.3:0/2183960091 >> 172.21.15.3:0/2183960091 conn(0x7fd52c0fd8c0 msgr2=0x7fd52c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:45.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.202+0000 7fd532c00640 1 -- 172.21.15.3:0/2183960091 shutdown_connections 2024-09-19T06:17:45.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.202+0000 7fd532c00640 1 -- 172.21.15.3:0/2183960091 wait complete. 2024-09-19T06:17:45.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.203+0000 7fd532c00640 1 Processor -- start 2024-09-19T06:17:45.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.203+0000 7fd532c00640 1 -- start start 2024-09-19T06:17:45.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.203+0000 7fd532c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd52c101de0 0x7fd52c19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:45.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.203+0000 7fd532c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd52c102790 0x7fd52c19ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:45.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.203+0000 7fd532c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd52c106f10 0x7fd52c19f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:45.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.203+0000 7fd532c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c111fc0 con 0x7fd52c101de0 2024-09-19T06:17:45.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.203+0000 7fd532c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c111e40 con 0x7fd52c106f10 2024-09-19T06:17:45.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.203+0000 7fd532c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c112140 con 0x7fd52c102790 2024-09-19T06:17:45.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.204+0000 7fd52be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd52c101de0 0x7fd52c19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:45.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.204+0000 7fd523400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd52c102790 0x7fd52c19ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:45.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.204+0000 7fd523400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd52c102790 0x7fd52c19ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:47390/0 (socket says 172.21.15.3:47390) 2024-09-19T06:17:45.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.204+0000 7fd52be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd52c101de0 0x7fd52c19a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48184/0 (socket says 172.21.15.3:48184) 2024-09-19T06:17:45.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.204+0000 7fd523400640 1 -- 172.21.15.3:0/1380133156 learned_addr learned my addr 172.21.15.3:0/1380133156 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:45.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.204+0000 7fd530c00640 1 --2- 172.21.15.3:0/1380133156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd52c106f10 0x7fd52c19f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:45.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.204+0000 7fd523400640 1 -- 172.21.15.3:0/1380133156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd52c106f10 msgr2=0x7fd52c19f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:45.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.204+0000 7fd523400640 1 --2- 172.21.15.3:0/1380133156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd52c106f10 0x7fd52c19f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.204+0000 7fd523400640 1 -- 172.21.15.3:0/1380133156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd52c101de0 msgr2=0x7fd52c19a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:45.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.204+0000 7fd523400640 1 --2- 172.21.15.3:0/1380133156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd52c101de0 0x7fd52c19a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.204+0000 7fd523400640 1 -- 172.21.15.3:0/1380133156 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd52c19f6f0 con 0x7fd52c102790 2024-09-19T06:17:45.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.204+0000 7fd523400640 1 --2- 172.21.15.3:0/1380133156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd52c102790 0x7fd52c19ac80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd514004770 tx=0x7fd514003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:45.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.205+0000 7fd529600640 1 -- 172.21.15.3:0/1380133156 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51403f070 con 0x7fd52c102790 2024-09-19T06:17:45.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.205+0000 7fd529600640 1 -- 172.21.15.3:0/1380133156 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd514031ca0 con 0x7fd52c102790 2024-09-19T06:17:45.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.205+0000 7fd529600640 1 -- 172.21.15.3:0/1380133156 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd514035030 con 0x7fd52c102790 2024-09-19T06:17:45.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.205+0000 7fd532c00640 1 -- 172.21.15.3:0/1380133156 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd52c19f980 con 0x7fd52c102790 2024-09-19T06:17:45.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.205+0000 7fd532c00640 1 -- 172.21.15.3:0/1380133156 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd52c19fe10 con 0x7fd52c102790 2024-09-19T06:17:45.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.208+0000 7fd535839740 1 Processor -- start 2024-09-19T06:17:45.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.208+0000 7fd535839740 1 -- start start 2024-09-19T06:17:45.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.208+0000 7fd529600640 1 -- 172.21.15.3:0/1380133156 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fd514042070 con 0x7fd52c102790 2024-09-19T06:17:45.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.208+0000 7fd535839740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b67ebfdc70 0x55b67ebfe050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:45.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.208+0000 7fd535839740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfe590 0x55b67ec08910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:45.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.208+0000 7fd535839740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 0x55b67ec0b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:45.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.208+0000 7fd535839740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b67eb643e0 con 0x55b67ec08e50 2024-09-19T06:17:45.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.208+0000 7fd535839740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b67eb0bd80 con 0x55b67ebfe590 2024-09-19T06:17:45.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.208+0000 7fd535839740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b67eb603a0 con 0x55b67ebfdc70 2024-09-19T06:17:45.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.209+0000 7fd52be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfe590 0x55b67ec08910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:45.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.209+0000 7fd52be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfe590 0x55b67ec08910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44602/0 (socket says 172.21.15.3:44602) 2024-09-19T06:17:45.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.209+0000 7fd52be00640 1 -- 172.21.15.3:0/2206732878 learned_addr learned my addr 172.21.15.3:0/2206732878 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:45.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.209+0000 7fd523400640 1 --2- 172.21.15.3:0/2206732878 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 0x55b67ec0b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:45.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.209+0000 7fd530c00640 1 --2- 172.21.15.3:0/2206732878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b67ebfdc70 0x55b67ebfe050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:45.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.209+0000 7fd52be00640 1 -- 172.21.15.3:0/2206732878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b67ebfdc70 msgr2=0x55b67ebfe050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:45.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.209+0000 7fd52be00640 1 --2- 172.21.15.3:0/2206732878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b67ebfdc70 0x55b67ebfe050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.209+0000 7fd52be00640 1 -- 172.21.15.3:0/2206732878 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 msgr2=0x55b67ec0b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:45.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.209+0000 7fd52be00640 1 --2- 172.21.15.3:0/2206732878 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 0x55b67ec0b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.209+0000 7fd52be00640 1 -- 172.21.15.3:0/2206732878 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b67eb2aae0 con 0x55b67ebfe590 2024-09-19T06:17:45.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.209+0000 7fd52be00640 1 --2- 172.21.15.3:0/2206732878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfe590 0x55b67ec08910 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009d20 tx=0x7fd51c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76302e3b5197912d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:45.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.210+0000 7fd521200640 1 -- 172.21.15.3:0/2206732878 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51c01e070 con 0x55b67ebfe590 2024-09-19T06:17:45.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.210+0000 7fd521200640 1 -- 172.21.15.3:0/2206732878 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd51c019b10 con 0x55b67ebfe590 2024-09-19T06:17:45.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.210+0000 7fd521200640 1 -- 172.21.15.3:0/2206732878 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51c00ebb0 con 0x55b67ebfe590 2024-09-19T06:17:45.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.210+0000 7fd529600640 1 --2- 172.21.15.3:0/1380133156 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd5100a33b0 0x7fd5100a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:45.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.210+0000 7fd529600640 1 -- 172.21.15.3:0/1380133156 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fd5140f0320 con 0x7fd52c102790 2024-09-19T06:17:45.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.210+0000 7fd530c00640 1 --2- 172.21.15.3:0/1380133156 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd5100a33b0 0x7fd5100a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:45.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.211+0000 7fd535839740 1 -- 172.21.15.3:0/2206732878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfe590 msgr2=0x55b67ec08910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:45.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.211+0000 7fd535839740 1 --2- 172.21.15.3:0/2206732878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfe590 0x55b67ec08910 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009d20 tx=0x7fd51c011810 comp rx=0 tx=0).stop 2024-09-19T06:17:45.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.211+0000 7fd535839740 1 -- 172.21.15.3:0/2206732878 shutdown_connections 2024-09-19T06:17:45.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.211+0000 7fd535839740 1 --2- 172.21.15.3:0/2206732878 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 0x55b67ec0b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.211+0000 7fd535839740 1 --2- 172.21.15.3:0/2206732878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfe590 0x55b67ec08910 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.211+0000 7fd535839740 1 --2- 172.21.15.3:0/2206732878 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b67ebfdc70 0x55b67ebfe050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.211+0000 7fd535839740 1 -- 172.21.15.3:0/2206732878 >> 172.21.15.3:0/2206732878 conn(0x55b67ebfa200 msgr2=0x55b67ebfa5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:45.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.211+0000 7fd535839740 1 -- 172.21.15.3:0/2206732878 shutdown_connections 2024-09-19T06:17:45.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.211+0000 7fd535839740 1 -- 172.21.15.3:0/2206732878 wait complete. 2024-09-19T06:17:45.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.211+0000 7fd530c00640 1 --2- 172.21.15.3:0/1380133156 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd5100a33b0 0x7fd5100a5870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd524005fd0 tx=0x7fd524009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:45.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.211+0000 7fd535839740 1 -- start start 2024-09-19T06:17:45.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.212+0000 7fd535839740 1 Processor -- start 2024-09-19T06:17:45.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.212+0000 7fd535839740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b67ebfdc70 0x55b67ec05cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:45.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.212+0000 7fd535839740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfe590 0x55b67ec06230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:45.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.212+0000 7fd535839740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 0x55b67ec06770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:45.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.212+0000 7fd535839740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b67ec0ba20 con 0x55b67ec08e50 2024-09-19T06:17:45.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.212+0000 7fd535839740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b67eb1f0f0 con 0x55b67ebfe590 2024-09-19T06:17:45.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.212+0000 7fd535839740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b67ec0bba0 con 0x55b67ebfdc70 2024-09-19T06:17:45.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.212+0000 7fd535839740 10 client.0 _ll_register_callbacks cb 0x55b67eb06bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:45.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.212+0000 7fd530c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 0x55b67ec06770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:45.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.212+0000 7fd523400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfe590 0x55b67ec06230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:45.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.212+0000 7fd530c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 0x55b67ec06770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48192/0 (socket says 172.21.15.3:48192) 2024-09-19T06:17:45.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.212+0000 7fd530c00640 1 -- 172.21.15.3:0/1601874673 learned_addr learned my addr 172.21.15.3:0/1601874673 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:45.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.212+0000 7fd52be00640 1 --2- 172.21.15.3:0/1601874673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b67ebfdc70 0x55b67ec05cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:45.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.213+0000 7fd530c00640 1 -- 172.21.15.3:0/1601874673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b67ebfdc70 msgr2=0x55b67ec05cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:45.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.213+0000 7fd530c00640 1 --2- 172.21.15.3:0/1601874673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b67ebfdc70 0x55b67ec05cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.213+0000 7fd530c00640 1 -- 172.21.15.3:0/1601874673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfe590 msgr2=0x55b67ec06230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:45.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.213+0000 7fd530c00640 1 --2- 172.21.15.3:0/1601874673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfe590 0x55b67ec06230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.213+0000 7fd530c00640 1 -- 172.21.15.3:0/1601874673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b67e8d53c0 con 0x55b67ec08e50 2024-09-19T06:17:45.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.213+0000 7fd523400640 1 --2- 172.21.15.3:0/1601874673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfe590 0x55b67ec06230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:45.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.213+0000 7fd52be00640 1 --2- 172.21.15.3:0/1601874673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b67ebfdc70 0x55b67ec05cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:45.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.213+0000 7fd530c00640 1 --2- 172.21.15.3:0/1601874673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 0x55b67ec06770 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd524004040 tx=0x7fd524004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e047cc2b93c75a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:45.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.213+0000 7fd519600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:17:45.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.213+0000 7fd519600640 1 -- 172.21.15.3:0/1601874673 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd524004b20 con 0x55b67ec08e50 2024-09-19T06:17:45.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.214+0000 7fd535839740 1 -- 172.21.15.3:0/1601874673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd51c019b10 con 0x55b67ec08e50 2024-09-19T06:17:45.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.214+0000 7fd519600640 1 -- 172.21.15.3:0/1601874673 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fd524004cc0 con 0x55b67ec08e50 2024-09-19T06:17:45.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.214+0000 7fd519600640 1 -- 172.21.15.3:0/1601874673 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd52400f7d0 con 0x55b67ec08e50 2024-09-19T06:17:45.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.214+0000 7fd535839740 10 client.16668 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:45.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.214+0000 7fd535839740 1 -- 172.21.15.3:0/1601874673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b67ec17ac0 con 0x55b67ec08e50 2024-09-19T06:17:45.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.214+0000 7fd519600640 1 -- 172.21.15.3:0/1601874673 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd51c019b10 con 0x55b67ec08e50 2024-09-19T06:17:45.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.214+0000 7fd519600640 1 -- 172.21.15.3:0/1601874673 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd524026030 con 0x55b67ec08e50 2024-09-19T06:17:45.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.214+0000 7fd535839740 10 client.16668 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:45.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.214+0000 7fd535839740 10 client.16668 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:17:45.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.214+0000 7fd535839740 20 client.16668 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:45.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.214+0000 7fd535839740 1 --2- 172.21.15.3:0/1601874673 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55b67ec18ed0 0x55b67ec1b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:45.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.214+0000 7fd535839740 4 client.16668 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:17:45.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.214+0000 7fd535839740 1 -- 172.21.15.3:0/1601874673 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b67eb71950 con 0x55b67ec18ed0 2024-09-19T06:17:45.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.215+0000 7fd52be00640 1 --2- 172.21.15.3:0/1601874673 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55b67ec18ed0 0x55b67ec1b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:45.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.216+0000 7fd52be00640 1 --2- 172.21.15.3:0/1601874673 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55b67ec18ed0 0x55b67ec1b320 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1459cad1d4be6d3b server_cookie=c3b1465c4842409 in_seq=0 out_seq=0 2024-09-19T06:17:45.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.216+0000 7fd519600640 10 client.16668 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:17:45.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.216+0000 7fd519600640 1 -- 172.21.15.3:0/1601874673 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b67eb71950 con 0x55b67ec18ed0 2024-09-19T06:17:45.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.216+0000 7fd519600640 10 client.16668 handle_command_reply: tid=0 2024-09-19T06:17:45.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.216+0000 7fd535839740 1 client.16668 shutdown 2024-09-19T06:17:45.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.217+0000 7fd535839740 1 -- 172.21.15.3:0/1601874673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 msgr2=0x55b67ec06770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:45.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.217+0000 7fd535839740 1 --2- 172.21.15.3:0/1601874673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 0x55b67ec06770 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd524004040 tx=0x7fd524004ab0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.217+0000 7fd535839740 1 -- 172.21.15.3:0/1601874673 shutdown_connections 2024-09-19T06:17:45.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.217+0000 7fd535839740 1 --2- 172.21.15.3:0/1601874673 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55b67ec18ed0 0x55b67ec1b320 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.217+0000 7fd535839740 1 --2- 172.21.15.3:0/1601874673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 0x55b67ec06770 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.217+0000 7fd535839740 1 --2- 172.21.15.3:0/1601874673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfe590 0x55b67ec06230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.217+0000 7fd535839740 1 --2- 172.21.15.3:0/1601874673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b67ebfdc70 0x55b67ec05cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.217+0000 7fd535839740 1 -- 172.21.15.3:0/1601874673 >> 172.21.15.3:0/1601874673 conn(0x55b67ebfa200 msgr2=0x55b67ebf9380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:45.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.217+0000 7fd519600640 0 client.16668 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:17:45.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.217+0000 7fd535839740 1 -- 172.21.15.3:0/1601874673 shutdown_connections 2024-09-19T06:17:45.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.217+0000 7fd535839740 1 -- 172.21.15.3:0/1601874673 wait complete. 2024-09-19T06:17:45.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.217+0000 7fd535839740 20 client.16668 trim_cache size 0 max 16384 2024-09-19T06:17:45.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.231+0000 7fd535839740 1 Processor -- start 2024-09-19T06:17:45.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.231+0000 7fd535839740 1 -- start start 2024-09-19T06:17:45.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.232+0000 7fd535839740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfdc70 0x55b67ec045c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:45.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.232+0000 7fd535839740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b67ebfe590 0x55b67ec20bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:45.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.232+0000 7fd535839740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 0x55b67ec21130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:45.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.232+0000 7fd535839740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c1afb10 con 0x55b67ec08e50 2024-09-19T06:17:45.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.232+0000 7fd535839740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c1b1650 con 0x55b67ebfdc70 2024-09-19T06:17:45.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.232+0000 7fd535839740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c1b01e0 con 0x55b67ebfe590 2024-09-19T06:17:45.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.232+0000 7fd530c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 0x55b67ec21130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:45.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.232+0000 7fd530c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 0x55b67ec21130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48194/0 (socket says 172.21.15.3:48194) 2024-09-19T06:17:45.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.232+0000 7fd530c00640 1 -- 172.21.15.3:0/207382392 learned_addr learned my addr 172.21.15.3:0/207382392 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:45.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.232+0000 7fd52be00640 1 --2- 172.21.15.3:0/207382392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfdc70 0x55b67ec045c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:45.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.232+0000 7fd523400640 1 --2- 172.21.15.3:0/207382392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b67ebfe590 0x55b67ec20bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:45.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.232+0000 7fd530c00640 1 -- 172.21.15.3:0/207382392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b67ebfe590 msgr2=0x55b67ec20bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:45.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.232+0000 7fd530c00640 1 --2- 172.21.15.3:0/207382392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b67ebfe590 0x55b67ec20bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.232+0000 7fd530c00640 1 -- 172.21.15.3:0/207382392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfdc70 msgr2=0x55b67ec045c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:45.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.232+0000 7fd530c00640 1 --2- 172.21.15.3:0/207382392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfdc70 0x55b67ec045c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.232+0000 7fd530c00640 1 -- 172.21.15.3:0/207382392 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b67ec04ca0 con 0x55b67ec08e50 2024-09-19T06:17:45.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.233+0000 7fd530c00640 1 --2- 172.21.15.3:0/207382392 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 0x55b67ec21130 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd524011dd0 tx=0x7fd524011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696defbbbb75f316 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:45.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.233+0000 7fd51be00640 1 -- 172.21.15.3:0/207382392 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd524034070 con 0x55b67ec08e50 2024-09-19T06:17:45.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.233+0000 7fd51be00640 1 -- 172.21.15.3:0/207382392 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5240048d0 con 0x55b67ec08e50 2024-09-19T06:17:45.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.233+0000 7fd51be00640 1 -- 172.21.15.3:0/207382392 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd524005000 con 0x55b67ec08e50 2024-09-19T06:17:45.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.234+0000 7fd535839740 1 -- 172.21.15.3:0/207382392 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 msgr2=0x55b67ec21130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:45.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.234+0000 7fd535839740 1 --2- 172.21.15.3:0/207382392 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 0x55b67ec21130 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd524011dd0 tx=0x7fd524011e50 comp rx=0 tx=0).stop 2024-09-19T06:17:45.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.234+0000 7fd535839740 1 -- 172.21.15.3:0/207382392 shutdown_connections 2024-09-19T06:17:45.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.234+0000 7fd535839740 1 --2- 172.21.15.3:0/207382392 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 0x55b67ec21130 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.234+0000 7fd535839740 1 --2- 172.21.15.3:0/207382392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b67ebfe590 0x55b67ec20bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.234+0000 7fd535839740 1 --2- 172.21.15.3:0/207382392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfdc70 0x55b67ec045c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.234+0000 7fd535839740 1 -- 172.21.15.3:0/207382392 >> 172.21.15.3:0/207382392 conn(0x55b67ebfa200 msgr2=0x55b67ec07d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:45.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.234+0000 7fd535839740 1 -- 172.21.15.3:0/207382392 shutdown_connections 2024-09-19T06:17:45.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.234+0000 7fd535839740 1 -- 172.21.15.3:0/207382392 wait complete. 2024-09-19T06:17:45.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.234+0000 7fd535839740 1 -- start start 2024-09-19T06:17:45.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.234+0000 7fd535839740 1 Processor -- start 2024-09-19T06:17:45.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.235+0000 7fd535839740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b67ebfdc70 0x55b67ec11290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:45.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.235+0000 7fd535839740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfe590 0x55b67ec0c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:45.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.235+0000 7fd535839740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 0x55b67ec0cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:45.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.235+0000 7fd535839740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c1b0f80 con 0x55b67ec08e50 2024-09-19T06:17:45.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.235+0000 7fd535839740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c1b08b0 con 0x55b67ebfe590 2024-09-19T06:17:45.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.235+0000 7fd535839740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c1adaf0 con 0x55b67ebfdc70 2024-09-19T06:17:45.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.235+0000 7fd535839740 10 client.0 _ll_register_callbacks cb 0x7fd524009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:45.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.235+0000 7fd523400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfe590 0x55b67ec0c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:45.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.235+0000 7fd530c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 0x55b67ec0cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:45.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.235+0000 7fd52be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b67ebfdc70 0x55b67ec11290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:45.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.235+0000 7fd523400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfe590 0x55b67ec0c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44624/0 (socket says 172.21.15.3:44624) 2024-09-19T06:17:45.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.235+0000 7fd523400640 1 -- 172.21.15.3:0/1269387785 learned_addr learned my addr 172.21.15.3:0/1269387785 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:45.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.235+0000 7fd52be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b67ebfdc70 0x55b67ec11290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:47434/0 (socket says 172.21.15.3:47434) 2024-09-19T06:17:45.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.236+0000 7fd523400640 1 -- 172.21.15.3:0/1269387785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b67ebfdc70 msgr2=0x55b67ec11290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:45.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.236+0000 7fd523400640 1 --2- 172.21.15.3:0/1269387785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b67ebfdc70 0x55b67ec11290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.236+0000 7fd523400640 1 -- 172.21.15.3:0/1269387785 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 msgr2=0x55b67ec0cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:45.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.236+0000 7fd523400640 1 --2- 172.21.15.3:0/1269387785 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 0x55b67ec0cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.236+0000 7fd523400640 1 -- 172.21.15.3:0/1269387785 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b67ec0d090 con 0x55b67ebfe590 2024-09-19T06:17:45.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.236+0000 7fd530c00640 1 --2- 172.21.15.3:0/1269387785 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 0x55b67ec0cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:45.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.236+0000 7fd523400640 1 --2- 172.21.15.3:0/1269387785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfe590 0x55b67ec0c610 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd5140bc410 tx=0x7fd51403b460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc56522d1d03d808 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:45.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.236+0000 7fd519600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:17:45.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.236+0000 7fd519600640 1 -- 172.21.15.3:0/1269387785 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd514049040 con 0x55b67ebfe590 2024-09-19T06:17:45.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.236+0000 7fd519600640 1 -- 172.21.15.3:0/1269387785 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fd51403b4f0 con 0x55b67ebfe590 2024-09-19T06:17:45.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.236+0000 7fd535839740 1 -- 172.21.15.3:0/1269387785 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5240048d0 con 0x55b67ebfe590 2024-09-19T06:17:45.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.236+0000 7fd519600640 1 -- 172.21.15.3:0/1269387785 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd5140bc250 con 0x55b67ebfe590 2024-09-19T06:17:45.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.236+0000 7fd535839740 10 client.26717 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:45.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.236+0000 7fd535839740 1 -- 172.21.15.3:0/1269387785 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b67ec839a0 con 0x55b67ebfe590 2024-09-19T06:17:45.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.237+0000 7fd519600640 1 -- 172.21.15.3:0/1269387785 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5240048d0 con 0x55b67ebfe590 2024-09-19T06:17:45.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.237+0000 7fd519600640 1 -- 172.21.15.3:0/1269387785 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd5140bc970 con 0x55b67ebfe590 2024-09-19T06:17:45.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.237+0000 7fd535839740 10 client.26717 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:45.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.237+0000 7fd535839740 10 client.26717 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:17:45.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.237+0000 7fd535839740 20 client.26717 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:45.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.237+0000 7fd535839740 1 --2- 172.21.15.3:0/1269387785 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55b67ec84170 0x55b67ec86590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:45.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.237+0000 7fd535839740 4 client.26717 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:17:45.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.237+0000 7fd535839740 1 -- 172.21.15.3:0/1269387785 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b67eb6be60 con 0x55b67ec84170 2024-09-19T06:17:45.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.237+0000 7fd52be00640 1 --2- 172.21.15.3:0/1269387785 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55b67ec84170 0x55b67ec86590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:45.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.238+0000 7fd52be00640 1 --2- 172.21.15.3:0/1269387785 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55b67ec84170 0x55b67ec86590 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a622604d1d39f4dc server_cookie=6df0aeba70fdaa6d in_seq=0 out_seq=0 2024-09-19T06:17:45.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.238+0000 7fd519600640 10 client.26717 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:17:45.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.238+0000 7fd519600640 1 -- 172.21.15.3:0/1269387785 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b67eb6be60 con 0x55b67ec84170 2024-09-19T06:17:45.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.238+0000 7fd519600640 10 client.26717 handle_command_reply: tid=0 2024-09-19T06:17:45.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.238+0000 7fd535839740 1 client.26717 shutdown 2024-09-19T06:17:45.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.238+0000 7fd535839740 1 -- 172.21.15.3:0/1269387785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfe590 msgr2=0x55b67ec0c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:45.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.238+0000 7fd535839740 1 --2- 172.21.15.3:0/1269387785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfe590 0x55b67ec0c610 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd5140bc410 tx=0x7fd51403b460 comp rx=0 tx=0).stop 2024-09-19T06:17:45.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.238+0000 7fd535839740 1 -- 172.21.15.3:0/1269387785 shutdown_connections 2024-09-19T06:17:45.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.238+0000 7fd535839740 1 --2- 172.21.15.3:0/1269387785 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55b67ec84170 0x55b67ec86590 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.238+0000 7fd535839740 1 --2- 172.21.15.3:0/1269387785 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b67ec08e50 0x55b67ec0cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.238+0000 7fd535839740 1 --2- 172.21.15.3:0/1269387785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b67ebfe590 0x55b67ec0c610 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.238+0000 7fd535839740 1 --2- 172.21.15.3:0/1269387785 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b67ebfdc70 0x55b67ec11290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.238+0000 7fd519600640 0 client.26717 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:17:45.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.238+0000 7fd535839740 1 -- 172.21.15.3:0/1269387785 >> 172.21.15.3:0/1269387785 conn(0x55b67ebfa200 msgr2=0x55b67ec07d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:45.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.239+0000 7fd535839740 1 -- 172.21.15.3:0/1269387785 shutdown_connections 2024-09-19T06:17:45.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.239+0000 7fd535839740 1 -- 172.21.15.3:0/1269387785 wait complete. 2024-09-19T06:17:45.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.239+0000 7fd535839740 20 client.26717 trim_cache size 0 max 16384 2024-09-19T06:17:45.256 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:17:45.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.239+0000 7fd532c00640 1 -- 172.21.15.3:0/1380133156 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd5100a33b0 msgr2=0x7fd5100a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:45.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.239+0000 7fd532c00640 1 --2- 172.21.15.3:0/1380133156 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd5100a33b0 0x7fd5100a5870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd524005fd0 tx=0x7fd524009500 comp rx=0 tx=0).stop 2024-09-19T06:17:45.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.239+0000 7fd532c00640 1 -- 172.21.15.3:0/1380133156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd52c102790 msgr2=0x7fd52c19ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:45.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.239+0000 7fd532c00640 1 --2- 172.21.15.3:0/1380133156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd52c102790 0x7fd52c19ac80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd514004770 tx=0x7fd514003c10 comp rx=0 tx=0).stop 2024-09-19T06:17:45.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.240+0000 7fd532c00640 1 -- 172.21.15.3:0/1380133156 shutdown_connections 2024-09-19T06:17:45.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.240+0000 7fd532c00640 1 --2- 172.21.15.3:0/1380133156 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd5100a33b0 0x7fd5100a5870 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.240+0000 7fd532c00640 1 --2- 172.21.15.3:0/1380133156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd52c106f10 0x7fd52c19f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.240+0000 7fd532c00640 1 --2- 172.21.15.3:0/1380133156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd52c102790 0x7fd52c19ac80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.240+0000 7fd532c00640 1 --2- 172.21.15.3:0/1380133156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd52c101de0 0x7fd52c19a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:45.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.240+0000 7fd532c00640 1 -- 172.21.15.3:0/1380133156 >> 172.21.15.3:0/1380133156 conn(0x7fd52c0fd8c0 msgr2=0x7fd52c0ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:45.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.240+0000 7fd532c00640 1 -- 172.21.15.3:0/1380133156 shutdown_connections 2024-09-19T06:17:45.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:45.240+0000 7fd532c00640 1 -- 172.21.15.3:0/1380133156 wait complete. 2024-09-19T06:17:46.258 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:17:46.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:46 smithi003 ceph-mon[30893]: pgmap v164: 97 pgs: 97 active+clean; 3.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 57 KiB/s wr, 24 op/s 2024-09-19T06:17:46.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:46 smithi071 ceph-mon[35662]: pgmap v164: 97 pgs: 97 active+clean; 3.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 57 KiB/s wr, 24 op/s 2024-09-19T06:17:46.644 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:17:46.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:46 smithi059 ceph-mon[35138]: pgmap v164: 97 pgs: 97 active+clean; 3.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 57 KiB/s wr, 24 op/s 2024-09-19T06:17:47.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.211+0000 7fe28da00640 1 -- 172.21.15.3:0/1262881974 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe2881047e0 msgr2=0x7fe288108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:47.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.211+0000 7fe28da00640 1 --2- 172.21.15.3:0/1262881974 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe2881047e0 0x7fe288108830 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe274009900 tx=0x7fe27402a410 comp rx=0 tx=0).stop 2024-09-19T06:17:47.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.212+0000 7fe28da00640 1 -- 172.21.15.3:0/1262881974 shutdown_connections 2024-09-19T06:17:47.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.212+0000 7fe28da00640 1 --2- 172.21.15.3:0/1262881974 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe288108f60 0x7fe288110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.212+0000 7fe28da00640 1 --2- 172.21.15.3:0/1262881974 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe2881047e0 0x7fe288108830 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.212+0000 7fe28da00640 1 --2- 172.21.15.3:0/1262881974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe288103e30 0x7fe288104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.212+0000 7fe28da00640 1 -- 172.21.15.3:0/1262881974 >> 172.21.15.3:0/1262881974 conn(0x7fe2880ff8d0 msgr2=0x7fe288101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:47.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.212+0000 7fe28da00640 1 -- 172.21.15.3:0/1262881974 shutdown_connections 2024-09-19T06:17:47.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.212+0000 7fe28da00640 1 -- 172.21.15.3:0/1262881974 wait complete. 2024-09-19T06:17:47.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.213+0000 7fe28da00640 1 Processor -- start 2024-09-19T06:17:47.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.213+0000 7fe28da00640 1 -- start start 2024-09-19T06:17:47.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.213+0000 7fe28da00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe288103e30 0x7fe28819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:47.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.213+0000 7fe28da00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2881047e0 0x7fe28819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:47.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.213+0000 7fe28da00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe288108f60 0x7fe28819ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:47.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.213+0000 7fe28da00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe288114010 con 0x7fe288103e30 2024-09-19T06:17:47.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.213+0000 7fe28da00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe288113e90 con 0x7fe2881047e0 2024-09-19T06:17:47.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.213+0000 7fe28da00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe288114190 con 0x7fe288108f60 2024-09-19T06:17:47.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.214+0000 7fe287e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe288103e30 0x7fe28819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:47.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.214+0000 7fe287400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2881047e0 0x7fe28819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:47.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.214+0000 7fe287e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe288103e30 0x7fe28819a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48224/0 (socket says 172.21.15.3:48224) 2024-09-19T06:17:47.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.214+0000 7fe287e00640 1 -- 172.21.15.3:0/2748983219 learned_addr learned my addr 172.21.15.3:0/2748983219 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:47.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.214+0000 7fe28d000640 1 --2- 172.21.15.3:0/2748983219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe288108f60 0x7fe28819ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:47.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.214+0000 7fe287e00640 1 -- 172.21.15.3:0/2748983219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe288108f60 msgr2=0x7fe28819ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:47.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.214+0000 7fe287e00640 1 --2- 172.21.15.3:0/2748983219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe288108f60 0x7fe28819ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.214+0000 7fe287e00640 1 -- 172.21.15.3:0/2748983219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2881047e0 msgr2=0x7fe28819a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:47.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.214+0000 7fe287e00640 1 --2- 172.21.15.3:0/2748983219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2881047e0 0x7fe28819a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.214+0000 7fe287e00640 1 -- 172.21.15.3:0/2748983219 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28819f420 con 0x7fe288103e30 2024-09-19T06:17:47.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.214+0000 7fe287e00640 1 --2- 172.21.15.3:0/2748983219 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe288103e30 0x7fe28819a470 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fe27800d950 tx=0x7fe27800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:47.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.215+0000 7fe284c00640 1 -- 172.21.15.3:0/2748983219 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe278017030 con 0x7fe288103e30 2024-09-19T06:17:47.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.215+0000 7fe284c00640 1 -- 172.21.15.3:0/2748983219 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe278004020 con 0x7fe288103e30 2024-09-19T06:17:47.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.215+0000 7fe284c00640 1 -- 172.21.15.3:0/2748983219 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2780047a0 con 0x7fe288103e30 2024-09-19T06:17:47.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.215+0000 7fe28da00640 1 -- 172.21.15.3:0/2748983219 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe28819f710 con 0x7fe288103e30 2024-09-19T06:17:47.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.215+0000 7fe28da00640 1 -- 172.21.15.3:0/2748983219 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2881a6ff0 con 0x7fe288103e30 2024-09-19T06:17:47.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.218+0000 7fe284c00640 1 -- 172.21.15.3:0/2748983219 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fe2780041d0 con 0x7fe288103e30 2024-09-19T06:17:47.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.218+0000 7fe291a9e740 1 Processor -- start 2024-09-19T06:17:47.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.218+0000 7fe291a9e740 1 -- start start 2024-09-19T06:17:47.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.218+0000 7fe291a9e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f83e40 0x5609e8f84220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:47.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.219+0000 7fe291a9e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609e8f84760 0x5609e8f8eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:47.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.219+0000 7fe291a9e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5609e8f8f020 0x5609e8f91410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:47.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.219+0000 7fe291a9e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5609e8eea3e0 con 0x5609e8f8f020 2024-09-19T06:17:47.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.219+0000 7fe291a9e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5609e8e91d80 con 0x5609e8f83e40 2024-09-19T06:17:47.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.219+0000 7fe291a9e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5609e8ee63a0 con 0x5609e8f84760 2024-09-19T06:17:47.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.219+0000 7fe287e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609e8f84760 0x5609e8f8eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:47.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.219+0000 7fe287e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609e8f84760 0x5609e8f8eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:47470/0 (socket says 172.21.15.3:47470) 2024-09-19T06:17:47.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.219+0000 7fe287e00640 1 -- 172.21.15.3:0/896648763 learned_addr learned my addr 172.21.15.3:0/896648763 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:47.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.219+0000 7fe28d000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f83e40 0x5609e8f84220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:47.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.219+0000 7fe287400640 1 --2- 172.21.15.3:0/896648763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5609e8f8f020 0x5609e8f91410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:47.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.219+0000 7fe287e00640 1 -- 172.21.15.3:0/896648763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f83e40 msgr2=0x5609e8f84220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:47.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.219+0000 7fe287e00640 1 --2- 172.21.15.3:0/896648763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f83e40 0x5609e8f84220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.219+0000 7fe287e00640 1 -- 172.21.15.3:0/896648763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5609e8f8f020 msgr2=0x5609e8f91410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:47.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.219+0000 7fe287e00640 1 --2- 172.21.15.3:0/896648763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5609e8f8f020 0x5609e8f91410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.219+0000 7fe287e00640 1 -- 172.21.15.3:0/896648763 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609e8eb0ae0 con 0x5609e8f84760 2024-09-19T06:17:47.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.220+0000 7fe284c00640 1 --2- 172.21.15.3:0/2748983219 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe26c0a3430 0x7fe26c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:47.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.220+0000 7fe284c00640 1 -- 172.21.15.3:0/2748983219 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fe2780cf640 con 0x7fe288103e30 2024-09-19T06:17:47.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.220+0000 7fe287e00640 1 --2- 172.21.15.3:0/896648763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609e8f84760 0x5609e8f8eae0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe2780ccc70 tx=0x7fe2780d5ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f62fa23989ed762 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:47.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.220+0000 7fe28d000640 1 --2- 172.21.15.3:0/2748983219 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe26c0a3430 0x7fe26c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:47.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.220+0000 7fe27d600640 1 -- 172.21.15.3:0/896648763 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe278097b60 con 0x5609e8f84760 2024-09-19T06:17:47.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.220+0000 7fe27d600640 1 -- 172.21.15.3:0/896648763 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe27809bfc0 con 0x5609e8f84760 2024-09-19T06:17:47.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.220+0000 7fe27d600640 1 -- 172.21.15.3:0/896648763 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27809b220 con 0x5609e8f84760 2024-09-19T06:17:47.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.221+0000 7fe291a9e740 1 -- 172.21.15.3:0/896648763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609e8f84760 msgr2=0x5609e8f8eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:47.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.221+0000 7fe291a9e740 1 --2- 172.21.15.3:0/896648763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609e8f84760 0x5609e8f8eae0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe2780ccc70 tx=0x7fe2780d5ef0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.221+0000 7fe28d000640 1 --2- 172.21.15.3:0/2748983219 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe26c0a3430 0x7fe26c0a58f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe280005fd0 tx=0x7fe280009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:47.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.221+0000 7fe291a9e740 1 -- 172.21.15.3:0/896648763 shutdown_connections 2024-09-19T06:17:47.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.221+0000 7fe291a9e740 1 --2- 172.21.15.3:0/896648763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5609e8f8f020 0x5609e8f91410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.221+0000 7fe291a9e740 1 --2- 172.21.15.3:0/896648763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609e8f84760 0x5609e8f8eae0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.221+0000 7fe291a9e740 1 --2- 172.21.15.3:0/896648763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f83e40 0x5609e8f84220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.221+0000 7fe291a9e740 1 -- 172.21.15.3:0/896648763 >> 172.21.15.3:0/896648763 conn(0x5609e8f803d0 msgr2=0x5609e8f807b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:47.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.221+0000 7fe291a9e740 1 -- 172.21.15.3:0/896648763 shutdown_connections 2024-09-19T06:17:47.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.221+0000 7fe291a9e740 1 -- 172.21.15.3:0/896648763 wait complete. 2024-09-19T06:17:47.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.222+0000 7fe291a9e740 1 -- start start 2024-09-19T06:17:47.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.222+0000 7fe291a9e740 1 Processor -- start 2024-09-19T06:17:47.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.222+0000 7fe291a9e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5609e8f83e40 0x5609e8f8bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:47.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.222+0000 7fe291a9e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609e8f84760 0x5609e8f8c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:47.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.222+0000 7fe291a9e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f8f020 0x5609e8f8c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:47.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.222+0000 7fe291a9e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5609e8f91bf0 con 0x5609e8f83e40 2024-09-19T06:17:47.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.222+0000 7fe291a9e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5609e8ea50f0 con 0x5609e8f8f020 2024-09-19T06:17:47.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.222+0000 7fe291a9e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5609e8f91d70 con 0x5609e8f84760 2024-09-19T06:17:47.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.223+0000 7fe291a9e740 10 client.0 _ll_register_callbacks cb 0x5609e8e8cbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:47.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.223+0000 7fe287e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5609e8f83e40 0x5609e8f8bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:47.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.223+0000 7fe287e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5609e8f83e40 0x5609e8f8bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48248/0 (socket says 172.21.15.3:48248) 2024-09-19T06:17:47.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.223+0000 7fe287e00640 1 -- 172.21.15.3:0/2042648534 learned_addr learned my addr 172.21.15.3:0/2042648534 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:47.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.223+0000 7fe28d000640 1 --2- 172.21.15.3:0/2042648534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f8f020 0x5609e8f8c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:47.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.223+0000 7fe287400640 1 --2- 172.21.15.3:0/2042648534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609e8f84760 0x5609e8f8c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:47.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.223+0000 7fe287e00640 1 -- 172.21.15.3:0/2042648534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609e8f84760 msgr2=0x5609e8f8c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:47.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.223+0000 7fe287e00640 1 --2- 172.21.15.3:0/2042648534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609e8f84760 0x5609e8f8c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.223+0000 7fe287e00640 1 -- 172.21.15.3:0/2042648534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f8f020 msgr2=0x5609e8f8c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:47.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.223+0000 7fe287e00640 1 --2- 172.21.15.3:0/2042648534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f8f020 0x5609e8f8c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.223+0000 7fe287e00640 1 -- 172.21.15.3:0/2042648534 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609e8c5b3c0 con 0x5609e8f83e40 2024-09-19T06:17:47.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.223+0000 7fe28d000640 1 --2- 172.21.15.3:0/2042648534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f8f020 0x5609e8f8c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:47.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.224+0000 7fe287e00640 1 --2- 172.21.15.3:0/2042648534 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5609e8f83e40 0x5609e8f8bf60 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fe27809c170 tx=0x7fe278098160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea7f8e4b0ed3d6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:47.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.224+0000 7fe272000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:17:47.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.224+0000 7fe272000640 1 -- 172.21.15.3:0/2042648534 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27809b400 con 0x5609e8f83e40 2024-09-19T06:17:47.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.224+0000 7fe272000640 1 -- 172.21.15.3:0/2042648534 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fe27809bb20 con 0x5609e8f83e40 2024-09-19T06:17:47.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.224+0000 7fe291a9e740 1 -- 172.21.15.3:0/2042648534 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe27809bfc0 con 0x5609e8f83e40 2024-09-19T06:17:47.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.224+0000 7fe272000640 1 -- 172.21.15.3:0/2042648534 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe27809b690 con 0x5609e8f83e40 2024-09-19T06:17:47.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.224+0000 7fe291a9e740 10 client.16686 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:47.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.224+0000 7fe291a9e740 1 -- 172.21.15.3:0/2042648534 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5609e8f9dc80 con 0x5609e8f83e40 2024-09-19T06:17:47.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.224+0000 7fe272000640 1 -- 172.21.15.3:0/2042648534 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe27809bfc0 con 0x5609e8f83e40 2024-09-19T06:17:47.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.225+0000 7fe272000640 1 -- 172.21.15.3:0/2042648534 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe2780a40a0 con 0x5609e8f83e40 2024-09-19T06:17:47.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.225+0000 7fe291a9e740 10 client.16686 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:47.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.225+0000 7fe291a9e740 10 client.16686 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:47.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.225+0000 7fe291a9e740 20 client.16686 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:47.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.225+0000 7fe291a9e740 1 --2- 172.21.15.3:0/2042648534 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5609e8f9efd0 0x5609e8fa13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:47.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.225+0000 7fe291a9e740 4 client.16686 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:17:47.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.225+0000 7fe291a9e740 1 -- 172.21.15.3:0/2042648534 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609e8ef7950 con 0x5609e8f9efd0 2024-09-19T06:17:47.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.225+0000 7fe287400640 1 --2- 172.21.15.3:0/2042648534 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5609e8f9efd0 0x5609e8fa13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:47.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.226+0000 7fe287400640 1 --2- 172.21.15.3:0/2042648534 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5609e8f9efd0 0x5609e8fa13c0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=335a1500f0ca4d43 server_cookie=d528c7e67c182744 in_seq=0 out_seq=0 2024-09-19T06:17:47.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.226+0000 7fe272000640 10 client.16686 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:47.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.227+0000 7fe272000640 1 -- 172.21.15.3:0/2042648534 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5609e8ef7950 con 0x5609e8f9efd0 2024-09-19T06:17:47.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.227+0000 7fe272000640 10 client.16686 handle_command_reply: tid=0 2024-09-19T06:17:47.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.227+0000 7fe291a9e740 1 client.16686 shutdown 2024-09-19T06:17:47.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.227+0000 7fe291a9e740 1 -- 172.21.15.3:0/2042648534 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5609e8f83e40 msgr2=0x5609e8f8bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:47.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.227+0000 7fe291a9e740 1 --2- 172.21.15.3:0/2042648534 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5609e8f83e40 0x5609e8f8bf60 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fe27809c170 tx=0x7fe278098160 comp rx=0 tx=0).stop 2024-09-19T06:17:47.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.227+0000 7fe291a9e740 1 -- 172.21.15.3:0/2042648534 shutdown_connections 2024-09-19T06:17:47.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.227+0000 7fe291a9e740 1 --2- 172.21.15.3:0/2042648534 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5609e8f9efd0 0x5609e8fa13c0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.227+0000 7fe291a9e740 1 --2- 172.21.15.3:0/2042648534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f8f020 0x5609e8f8c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.227+0000 7fe291a9e740 1 --2- 172.21.15.3:0/2042648534 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609e8f84760 0x5609e8f8c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.227+0000 7fe291a9e740 1 --2- 172.21.15.3:0/2042648534 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5609e8f83e40 0x5609e8f8bf60 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.227+0000 7fe291a9e740 1 -- 172.21.15.3:0/2042648534 >> 172.21.15.3:0/2042648534 conn(0x5609e8f803d0 msgr2=0x5609e8f860b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:47.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.227+0000 7fe272000640 0 client.16686 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:47.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.227+0000 7fe291a9e740 1 -- 172.21.15.3:0/2042648534 shutdown_connections 2024-09-19T06:17:47.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.227+0000 7fe291a9e740 1 -- 172.21.15.3:0/2042648534 wait complete. 2024-09-19T06:17:47.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.228+0000 7fe291a9e740 20 client.16686 trim_cache size 0 max 16384 2024-09-19T06:17:47.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.241+0000 7fe291a9e740 1 Processor -- start 2024-09-19T06:17:47.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.241+0000 7fe291a9e740 1 -- start start 2024-09-19T06:17:47.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.242+0000 7fe291a9e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f83e40 0x5609e8f9a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:47.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.242+0000 7fe291a9e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609e8f84760 0x5609e8f8c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:47.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.242+0000 7fe291a9e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5609e8f8f020 0x5609e8f891c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:47.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.242+0000 7fe291a9e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881af9e0 con 0x5609e8f8f020 2024-09-19T06:17:47.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.242+0000 7fe291a9e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881b1520 con 0x5609e8f83e40 2024-09-19T06:17:47.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.242+0000 7fe291a9e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881b00b0 con 0x5609e8f84760 2024-09-19T06:17:47.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.242+0000 7fe287e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f83e40 0x5609e8f9a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:47.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.242+0000 7fe287e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f83e40 0x5609e8f9a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44678/0 (socket says 172.21.15.3:44678) 2024-09-19T06:17:47.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.242+0000 7fe287e00640 1 -- 172.21.15.3:0/2428053141 learned_addr learned my addr 172.21.15.3:0/2428053141 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:47.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.242+0000 7fe28d000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5609e8f8f020 0x5609e8f891c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:47.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.242+0000 7fe287400640 1 --2- 172.21.15.3:0/2428053141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609e8f84760 0x5609e8f8c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:47.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.243+0000 7fe287e00640 1 -- 172.21.15.3:0/2428053141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609e8f84760 msgr2=0x5609e8f8c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:47.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.243+0000 7fe287e00640 1 --2- 172.21.15.3:0/2428053141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609e8f84760 0x5609e8f8c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.243+0000 7fe287e00640 1 -- 172.21.15.3:0/2428053141 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5609e8f8f020 msgr2=0x5609e8f891c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:47.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.243+0000 7fe287e00640 1 --2- 172.21.15.3:0/2428053141 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5609e8f8f020 0x5609e8f891c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.243+0000 7fe287e00640 1 -- 172.21.15.3:0/2428053141 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609e8f80200 con 0x5609e8f83e40 2024-09-19T06:17:47.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.243+0000 7fe287e00640 1 --2- 172.21.15.3:0/2428053141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f83e40 0x5609e8f9a6d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe278097d20 tx=0x7fe27809fc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aac93d0d586c4ac7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:47.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.243+0000 7fe27cc00640 1 -- 172.21.15.3:0/2428053141 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27809b400 con 0x5609e8f83e40 2024-09-19T06:17:47.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.243+0000 7fe27cc00640 1 -- 172.21.15.3:0/2428053141 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe27809bfc0 con 0x5609e8f83e40 2024-09-19T06:17:47.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.243+0000 7fe27cc00640 1 -- 172.21.15.3:0/2428053141 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27809b220 con 0x5609e8f83e40 2024-09-19T06:17:47.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.244+0000 7fe291a9e740 1 -- 172.21.15.3:0/2428053141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f83e40 msgr2=0x5609e8f9a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:47.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.244+0000 7fe291a9e740 1 --2- 172.21.15.3:0/2428053141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f83e40 0x5609e8f9a6d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe278097d20 tx=0x7fe27809fc70 comp rx=0 tx=0).stop 2024-09-19T06:17:47.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.244+0000 7fe291a9e740 1 -- 172.21.15.3:0/2428053141 shutdown_connections 2024-09-19T06:17:47.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.244+0000 7fe291a9e740 1 --2- 172.21.15.3:0/2428053141 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5609e8f8f020 0x5609e8f891c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.244+0000 7fe291a9e740 1 --2- 172.21.15.3:0/2428053141 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609e8f84760 0x5609e8f8c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.244+0000 7fe291a9e740 1 --2- 172.21.15.3:0/2428053141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f83e40 0x5609e8f9a6d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.244+0000 7fe291a9e740 1 -- 172.21.15.3:0/2428053141 >> 172.21.15.3:0/2428053141 conn(0x5609e8f803d0 msgr2=0x5609e8f99fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:47.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.244+0000 7fe291a9e740 1 -- 172.21.15.3:0/2428053141 shutdown_connections 2024-09-19T06:17:47.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.244+0000 7fe291a9e740 1 -- 172.21.15.3:0/2428053141 wait complete. 2024-09-19T06:17:47.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.245+0000 7fe291a9e740 1 -- start start 2024-09-19T06:17:47.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.245+0000 7fe291a9e740 1 Processor -- start 2024-09-19T06:17:47.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.245+0000 7fe291a9e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f83e40 0x5609e8fa4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:47.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.245+0000 7fe291a9e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609e8f84760 0x5609e8fa1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:47.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.245+0000 7fe291a9e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5609e8f8f020 0x5609e8fa1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:47.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.245+0000 7fe291a9e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881b0e50 con 0x5609e8f8f020 2024-09-19T06:17:47.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.245+0000 7fe291a9e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881b0780 con 0x5609e8f83e40 2024-09-19T06:17:47.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.245+0000 7fe291a9e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe2881ad9c0 con 0x5609e8f84760 2024-09-19T06:17:47.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.245+0000 7fe291a9e740 10 client.0 _ll_register_callbacks cb 0x7fe280009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:47.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.245+0000 7fe287e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f83e40 0x5609e8fa4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:47.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.245+0000 7fe287400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609e8f84760 0x5609e8fa1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:47.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.245+0000 7fe287e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f83e40 0x5609e8fa4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44682/0 (socket says 172.21.15.3:44682) 2024-09-19T06:17:47.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.245+0000 7fe287e00640 1 -- 172.21.15.3:0/1385452253 learned_addr learned my addr 172.21.15.3:0/1385452253 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:47.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.246+0000 7fe28d000640 1 --2- 172.21.15.3:0/1385452253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5609e8f8f020 0x5609e8fa1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:47.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.246+0000 7fe287e00640 1 -- 172.21.15.3:0/1385452253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609e8f84760 msgr2=0x5609e8fa1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:47.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.246+0000 7fe287e00640 1 --2- 172.21.15.3:0/1385452253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609e8f84760 0x5609e8fa1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.246+0000 7fe287e00640 1 -- 172.21.15.3:0/1385452253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5609e8f8f020 msgr2=0x5609e8fa1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:47.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.246+0000 7fe287e00640 1 --2- 172.21.15.3:0/1385452253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5609e8f8f020 0x5609e8fa1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.246+0000 7fe287e00640 1 -- 172.21.15.3:0/1385452253 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609e8fa27b0 con 0x5609e8f83e40 2024-09-19T06:17:47.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.246+0000 7fe287e00640 1 --2- 172.21.15.3:0/1385452253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f83e40 0x5609e8fa4720 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe278005fd0 tx=0x7fe2780cce10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=906c76013fc0ca9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:47.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.246+0000 7fe272000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:17:47.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.246+0000 7fe272000640 1 -- 172.21.15.3:0/1385452253 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27809b220 con 0x5609e8f83e40 2024-09-19T06:17:47.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.246+0000 7fe272000640 1 -- 172.21.15.3:0/1385452253 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fe27809bb20 con 0x5609e8f83e40 2024-09-19T06:17:47.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.246+0000 7fe291a9e740 1 -- 172.21.15.3:0/1385452253 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe27809bfc0 con 0x5609e8f83e40 2024-09-19T06:17:47.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.247+0000 7fe272000640 1 -- 172.21.15.3:0/1385452253 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe27809b400 con 0x5609e8f83e40 2024-09-19T06:17:47.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.247+0000 7fe291a9e740 10 client.26735 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:47.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.247+0000 7fe291a9e740 1 -- 172.21.15.3:0/1385452253 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5609e8fa27b0 con 0x5609e8f83e40 2024-09-19T06:17:47.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.247+0000 7fe272000640 1 -- 172.21.15.3:0/1385452253 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe27809bfc0 con 0x5609e8f83e40 2024-09-19T06:17:47.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.247+0000 7fe272000640 1 -- 172.21.15.3:0/1385452253 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe278084bc0 con 0x5609e8f83e40 2024-09-19T06:17:47.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.247+0000 7fe291a9e740 10 client.26735 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:47.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.247+0000 7fe291a9e740 10 client.26735 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:47.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.247+0000 7fe291a9e740 20 client.26735 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:47.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.247+0000 7fe291a9e740 1 --2- 172.21.15.3:0/1385452253 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5609e9009b80 0x5609e900bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:47.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.247+0000 7fe291a9e740 4 client.26735 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:17:47.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.247+0000 7fe291a9e740 1 -- 172.21.15.3:0/1385452253 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5609e8ef1e60 con 0x5609e9009b80 2024-09-19T06:17:47.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.247+0000 7fe287400640 1 --2- 172.21.15.3:0/1385452253 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5609e9009b80 0x5609e900bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:47.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.248+0000 7fe287400640 1 --2- 172.21.15.3:0/1385452253 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5609e9009b80 0x5609e900bf70 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdd335e6f3a6a045 server_cookie=b04ca6b22f78077b in_seq=0 out_seq=0 2024-09-19T06:17:47.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.248+0000 7fe272000640 10 client.26735 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:47.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.248+0000 7fe272000640 1 -- 172.21.15.3:0/1385452253 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5609e8ef1e60 con 0x5609e9009b80 2024-09-19T06:17:47.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.248+0000 7fe272000640 10 client.26735 handle_command_reply: tid=0 2024-09-19T06:17:47.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.248+0000 7fe291a9e740 1 client.26735 shutdown 2024-09-19T06:17:47.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.248+0000 7fe291a9e740 1 -- 172.21.15.3:0/1385452253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f83e40 msgr2=0x5609e8fa4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:47.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.248+0000 7fe291a9e740 1 --2- 172.21.15.3:0/1385452253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f83e40 0x5609e8fa4720 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe278005fd0 tx=0x7fe2780cce10 comp rx=0 tx=0).stop 2024-09-19T06:17:47.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.248+0000 7fe291a9e740 1 -- 172.21.15.3:0/1385452253 shutdown_connections 2024-09-19T06:17:47.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.248+0000 7fe291a9e740 1 --2- 172.21.15.3:0/1385452253 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5609e9009b80 0x5609e900bf70 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.248+0000 7fe291a9e740 1 --2- 172.21.15.3:0/1385452253 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5609e8f8f020 0x5609e8fa1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.248+0000 7fe291a9e740 1 --2- 172.21.15.3:0/1385452253 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5609e8f84760 0x5609e8fa1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.248+0000 7fe291a9e740 1 --2- 172.21.15.3:0/1385452253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5609e8f83e40 0x5609e8fa4720 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.248+0000 7fe272000640 0 client.26735 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:47.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.248+0000 7fe291a9e740 1 -- 172.21.15.3:0/1385452253 >> 172.21.15.3:0/1385452253 conn(0x5609e8f803d0 msgr2=0x5609e8f7f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:47.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.249+0000 7fe291a9e740 1 -- 172.21.15.3:0/1385452253 shutdown_connections 2024-09-19T06:17:47.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.249+0000 7fe291a9e740 1 -- 172.21.15.3:0/1385452253 wait complete. 2024-09-19T06:17:47.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.249+0000 7fe291a9e740 20 client.26735 trim_cache size 0 max 16384 2024-09-19T06:17:47.255 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:17:47.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.249+0000 7fe28da00640 1 -- 172.21.15.3:0/2748983219 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe26c0a3430 msgr2=0x7fe26c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:47.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.249+0000 7fe28da00640 1 --2- 172.21.15.3:0/2748983219 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe26c0a3430 0x7fe26c0a58f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe280005fd0 tx=0x7fe280009500 comp rx=0 tx=0).stop 2024-09-19T06:17:47.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.249+0000 7fe28da00640 1 -- 172.21.15.3:0/2748983219 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe288103e30 msgr2=0x7fe28819a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:47.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.249+0000 7fe28da00640 1 --2- 172.21.15.3:0/2748983219 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe288103e30 0x7fe28819a470 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fe27800d950 tx=0x7fe27800de10 comp rx=0 tx=0).stop 2024-09-19T06:17:47.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.249+0000 7fe28da00640 1 -- 172.21.15.3:0/2748983219 shutdown_connections 2024-09-19T06:17:47.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.249+0000 7fe28da00640 1 --2- 172.21.15.3:0/2748983219 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe26c0a3430 0x7fe26c0a58f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.249+0000 7fe28da00640 1 --2- 172.21.15.3:0/2748983219 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe288108f60 0x7fe28819ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.249+0000 7fe28da00640 1 --2- 172.21.15.3:0/2748983219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2881047e0 0x7fe28819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.249+0000 7fe28da00640 1 --2- 172.21.15.3:0/2748983219 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe288103e30 0x7fe28819a470 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:47.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.249+0000 7fe28da00640 1 -- 172.21.15.3:0/2748983219 >> 172.21.15.3:0/2748983219 conn(0x7fe2880ff8d0 msgr2=0x7fe288100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:47.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.250+0000 7fe28da00640 1 -- 172.21.15.3:0/2748983219 shutdown_connections 2024-09-19T06:17:47.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:47.250+0000 7fe28da00640 1 -- 172.21.15.3:0/2748983219 wait complete. 2024-09-19T06:17:48.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:48 smithi003 ceph-mon[30893]: pgmap v165: 97 pgs: 97 active+clean; 3.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 37 KiB/s wr, 15 op/s 2024-09-19T06:17:48.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:48 smithi071 ceph-mon[35662]: pgmap v165: 97 pgs: 97 active+clean; 3.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 37 KiB/s wr, 15 op/s 2024-09-19T06:17:48.590 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:48 smithi059 ceph-mon[35138]: pgmap v165: 97 pgs: 97 active+clean; 3.8 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 37 KiB/s wr, 15 op/s 2024-09-19T06:17:49.200 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:17:49.201 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:17:49.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:49 smithi003 ceph-mon[30893]: pgmap v166: 97 pgs: 97 active+clean; 3.9 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 49 KiB/s wr, 21 op/s 2024-09-19T06:17:49.593 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:17:49.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:49 smithi059 ceph-mon[35138]: pgmap v166: 97 pgs: 97 active+clean; 3.9 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 49 KiB/s wr, 21 op/s 2024-09-19T06:17:49.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:49 smithi071 ceph-mon[35662]: pgmap v166: 97 pgs: 97 active+clean; 3.9 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 49 KiB/s wr, 21 op/s 2024-09-19T06:17:50.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.197+0000 7f1282200640 1 -- 172.21.15.3:0/2218804955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f127c103ff0 msgr2=0x7f127c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:50.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.197+0000 7f1282200640 1 --2- 172.21.15.3:0/2218804955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f127c103ff0 0x7f127c1043d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f126c009900 tx=0x7f126c02a410 comp rx=0 tx=0).stop 2024-09-19T06:17:50.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.197+0000 7f1282200640 1 -- 172.21.15.3:0/2218804955 shutdown_connections 2024-09-19T06:17:50.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.197+0000 7f1282200640 1 --2- 172.21.15.3:0/2218804955 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f127c109120 0x7f127c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.197+0000 7f1282200640 1 --2- 172.21.15.3:0/2218804955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f127c1049a0 0x7f127c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.197+0000 7f1282200640 1 --2- 172.21.15.3:0/2218804955 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f127c103ff0 0x7f127c1043d0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.197+0000 7f1282200640 1 -- 172.21.15.3:0/2218804955 >> 172.21.15.3:0/2218804955 conn(0x7f127c0ffa90 msgr2=0x7f127c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:50.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.197+0000 7f1282200640 1 -- 172.21.15.3:0/2218804955 shutdown_connections 2024-09-19T06:17:50.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.197+0000 7f1282200640 1 -- 172.21.15.3:0/2218804955 wait complete. 2024-09-19T06:17:50.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.198+0000 7f1282200640 1 Processor -- start 2024-09-19T06:17:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.199+0000 7f1282200640 1 -- start start 2024-09-19T06:17:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.199+0000 7f1282200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f127c103ff0 0x7f127c19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.199+0000 7f1282200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f127c1049a0 0x7f127c19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.199+0000 7f1282200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f127c109120 0x7f127c19eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.199+0000 7f1282200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f127c114150 con 0x7f127c103ff0 2024-09-19T06:17:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.199+0000 7f1282200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f127c113fd0 con 0x7f127c109120 2024-09-19T06:17:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.199+0000 7f1282200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f127c1142d0 con 0x7f127c1049a0 2024-09-19T06:17:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.199+0000 7f127b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f127c103ff0 0x7f127c19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.199+0000 7f127b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f127c103ff0 0x7f127c19a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48284/0 (socket says 172.21.15.3:48284) 2024-09-19T06:17:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.199+0000 7f127b400640 1 -- 172.21.15.3:0/2860956512 learned_addr learned my addr 172.21.15.3:0/2860956512 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.199+0000 7f127be00640 1 --2- 172.21.15.3:0/2860956512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f127c109120 0x7f127c19eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.199+0000 7f1272a00640 1 --2- 172.21.15.3:0/2860956512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f127c1049a0 0x7f127c19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:50.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.200+0000 7f127b400640 1 -- 172.21.15.3:0/2860956512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f127c1049a0 msgr2=0x7f127c19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:50.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.200+0000 7f127b400640 1 --2- 172.21.15.3:0/2860956512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f127c1049a0 0x7f127c19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.200+0000 7f127b400640 1 -- 172.21.15.3:0/2860956512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f127c109120 msgr2=0x7f127c19eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:50.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.200+0000 7f127b400640 1 --2- 172.21.15.3:0/2860956512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f127c109120 0x7f127c19eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.200+0000 7f127b400640 1 -- 172.21.15.3:0/2860956512 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127c19f5a0 con 0x7f127c103ff0 2024-09-19T06:17:50.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.200+0000 7f127b400640 1 --2- 172.21.15.3:0/2860956512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f127c103ff0 0x7f127c19a5f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f126c006010 tx=0x7f126c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:50.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.200+0000 7f1278c00640 1 -- 172.21.15.3:0/2860956512 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c03f030 con 0x7f127c103ff0 2024-09-19T06:17:50.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.200+0000 7f1278c00640 1 -- 172.21.15.3:0/2860956512 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f126c004440 con 0x7f127c103ff0 2024-09-19T06:17:50.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.200+0000 7f1282200640 1 -- 172.21.15.3:0/2860956512 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f127c19f830 con 0x7f127c103ff0 2024-09-19T06:17:50.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.200+0000 7f1278c00640 1 -- 172.21.15.3:0/2860956512 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c035070 con 0x7f127c103ff0 2024-09-19T06:17:50.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.201+0000 7f1282200640 1 -- 172.21.15.3:0/2860956512 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f127c1a7170 con 0x7f127c103ff0 2024-09-19T06:17:50.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.203+0000 7f1284c84740 1 Processor -- start 2024-09-19T06:17:50.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.204+0000 7f1278c00640 1 -- 172.21.15.3:0/2860956512 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f126c042030 con 0x7f127c103ff0 2024-09-19T06:17:50.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.204+0000 7f1284c84740 1 -- start start 2024-09-19T06:17:50.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.204+0000 7f1284c84740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c0aa92ac0 0x563c0aa92ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:50.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.204+0000 7f1284c84740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563c0aa933e0 0x563c0aa9d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:50.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.204+0000 7f1284c84740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa9dca0 0x563c0aaa0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:50.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.204+0000 7f1284c84740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563c0a9f9290 con 0x563c0aa92ac0 2024-09-19T06:17:50.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.204+0000 7f1284c84740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563c0a9a0b40 con 0x563c0aa9dca0 2024-09-19T06:17:50.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.204+0000 7f1284c84740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563c0a9f5250 con 0x563c0aa933e0 2024-09-19T06:17:50.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.204+0000 7f127be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c0aa92ac0 0x563c0aa92ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:50.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.204+0000 7f127b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563c0aa933e0 0x563c0aa9d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:50.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.204+0000 7f1272a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa9dca0 0x563c0aaa0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:50.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.204+0000 7f1272a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa9dca0 0x563c0aaa0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44702/0 (socket says 172.21.15.3:44702) 2024-09-19T06:17:50.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.204+0000 7f1272a00640 1 -- 172.21.15.3:0/1710049037 learned_addr learned my addr 172.21.15.3:0/1710049037 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:50.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.205+0000 7f1272a00640 1 -- 172.21.15.3:0/1710049037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563c0aa933e0 msgr2=0x563c0aa9d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:50.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.205+0000 7f1272a00640 1 --2- 172.21.15.3:0/1710049037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563c0aa933e0 0x563c0aa9d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.205+0000 7f1272a00640 1 -- 172.21.15.3:0/1710049037 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c0aa92ac0 msgr2=0x563c0aa92ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:50.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.205+0000 7f1272a00640 1 --2- 172.21.15.3:0/1710049037 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c0aa92ac0 0x563c0aa92ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.205+0000 7f1272a00640 1 -- 172.21.15.3:0/1710049037 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c0a76a6a0 con 0x563c0aa9dca0 2024-09-19T06:17:50.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.205+0000 7f1272a00640 1 --2- 172.21.15.3:0/1710049037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa9dca0 0x563c0aaa0090 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1264009c90 tx=0x7f1264011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=103a272ef2dcb2e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:50.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.205+0000 7f126be00640 1 -- 172.21.15.3:0/1710049037 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126401e070 con 0x563c0aa9dca0 2024-09-19T06:17:50.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.205+0000 7f126be00640 1 -- 172.21.15.3:0/1710049037 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1264019b10 con 0x563c0aa9dca0 2024-09-19T06:17:50.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.205+0000 7f126be00640 1 -- 172.21.15.3:0/1710049037 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126400ea70 con 0x563c0aa9dca0 2024-09-19T06:17:50.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.206+0000 7f1278c00640 1 --2- 172.21.15.3:0/2860956512 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f12600a3430 0x7f12600a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:50.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.206+0000 7f1278c00640 1 -- 172.21.15.3:0/2860956512 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f126c0efff0 con 0x7f127c103ff0 2024-09-19T06:17:50.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.206+0000 7f127be00640 1 --2- 172.21.15.3:0/2860956512 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f12600a3430 0x7f12600a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:50.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.206+0000 7f1284c84740 1 -- 172.21.15.3:0/1710049037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa9dca0 msgr2=0x563c0aaa0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:50.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.206+0000 7f1284c84740 1 --2- 172.21.15.3:0/1710049037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa9dca0 0x563c0aaa0090 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1264009c90 tx=0x7f1264011810 comp rx=0 tx=0).stop 2024-09-19T06:17:50.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.206+0000 7f1284c84740 1 -- 172.21.15.3:0/1710049037 shutdown_connections 2024-09-19T06:17:50.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.206+0000 7f1284c84740 1 --2- 172.21.15.3:0/1710049037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa9dca0 0x563c0aaa0090 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.206+0000 7f1284c84740 1 --2- 172.21.15.3:0/1710049037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563c0aa933e0 0x563c0aa9d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.206+0000 7f1284c84740 1 --2- 172.21.15.3:0/1710049037 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c0aa92ac0 0x563c0aa92ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.206+0000 7f1284c84740 1 -- 172.21.15.3:0/1710049037 >> 172.21.15.3:0/1710049037 conn(0x563c0aa8f050 msgr2=0x563c0aa8f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:50.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.207+0000 7f127be00640 1 --2- 172.21.15.3:0/2860956512 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f12600a3430 0x7f12600a58f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1274005fd0 tx=0x7f1274009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:50.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.207+0000 7f1284c84740 1 -- 172.21.15.3:0/1710049037 shutdown_connections 2024-09-19T06:17:50.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.207+0000 7f1284c84740 1 -- 172.21.15.3:0/1710049037 wait complete. 2024-09-19T06:17:50.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.207+0000 7f1284c84740 1 -- start start 2024-09-19T06:17:50.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.207+0000 7f1284c84740 1 Processor -- start 2024-09-19T06:17:50.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.208+0000 7f1284c84740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa92ac0 0x563c0aa9d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:50.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.208+0000 7f1284c84740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c0aa933e0 0x563c0aa9a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:50.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.208+0000 7f1284c84740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563c0aa9dca0 0x563c0aa9ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:50.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.208+0000 7f1284c84740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563c0aaa0910 con 0x563c0aa933e0 2024-09-19T06:17:50.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.208+0000 7f1284c84740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563c0a9b3fa0 con 0x563c0aa92ac0 2024-09-19T06:17:50.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.208+0000 7f1284c84740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563c0aaa0a90 con 0x563c0aa9dca0 2024-09-19T06:17:50.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.208+0000 7f1284c84740 10 client.0 _ll_register_callbacks cb 0x563c0a707ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:50.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.208+0000 7f1272a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c0aa933e0 0x563c0aa9a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:50.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.208+0000 7f1272a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c0aa933e0 0x563c0aa9a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48310/0 (socket says 172.21.15.3:48310) 2024-09-19T06:17:50.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.208+0000 7f1272a00640 1 -- 172.21.15.3:0/33582519 learned_addr learned my addr 172.21.15.3:0/33582519 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:50.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.208+0000 7f127be00640 1 --2- 172.21.15.3:0/33582519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563c0aa9dca0 0x563c0aa9ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:50.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.208+0000 7f127b400640 1 --2- 172.21.15.3:0/33582519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa92ac0 0x563c0aa9d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:50.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.209+0000 7f1272a00640 1 -- 172.21.15.3:0/33582519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563c0aa9dca0 msgr2=0x563c0aa9ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:50.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.209+0000 7f1272a00640 1 --2- 172.21.15.3:0/33582519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563c0aa9dca0 0x563c0aa9ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.209+0000 7f1272a00640 1 -- 172.21.15.3:0/33582519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa92ac0 msgr2=0x563c0aa9d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:50.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.209+0000 7f1272a00640 1 --2- 172.21.15.3:0/33582519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa92ac0 0x563c0aa9d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.209+0000 7f1272a00640 1 -- 172.21.15.3:0/33582519 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c0aa9b5a0 con 0x563c0aa933e0 2024-09-19T06:17:50.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.209+0000 7f1272a00640 1 --2- 172.21.15.3:0/33582519 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c0aa933e0 0x563c0aa9a860 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f126401c040 tx=0x7f1264019a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7295283ff2b82047 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:50.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.209+0000 7f1268c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:17:50.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.209+0000 7f1268c00640 1 -- 172.21.15.3:0/33582519 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126401e050 con 0x563c0aa933e0 2024-09-19T06:17:50.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.209+0000 7f1268c00640 1 -- 172.21.15.3:0/33582519 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f1264005450 con 0x563c0aa933e0 2024-09-19T06:17:50.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.209+0000 7f1284c84740 1 -- 172.21.15.3:0/33582519 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1264019b10 con 0x563c0aa933e0 2024-09-19T06:17:50.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.210+0000 7f1268c00640 1 -- 172.21.15.3:0/33582519 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1264005650 con 0x563c0aa933e0 2024-09-19T06:17:50.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.210+0000 7f1284c84740 10 client.16704 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:50.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.210+0000 7f1284c84740 1 -- 172.21.15.3:0/33582519 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563c0aaac7f0 con 0x563c0aa933e0 2024-09-19T06:17:50.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.210+0000 7f1268c00640 1 -- 172.21.15.3:0/33582519 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1264019b10 con 0x563c0aa933e0 2024-09-19T06:17:50.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.210+0000 7f1268c00640 1 -- 172.21.15.3:0/33582519 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f12640046c0 con 0x563c0aa933e0 2024-09-19T06:17:50.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.210+0000 7f1284c84740 10 client.16704 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:50.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.210+0000 7f1284c84740 10 client.16704 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:50.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.210+0000 7f1284c84740 20 client.16704 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:50.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.210+0000 7f1284c84740 1 --2- 172.21.15.3:0/33582519 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563c0aaadc50 0x563c0aab0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:50.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.210+0000 7f1284c84740 4 client.16704 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:17:50.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.210+0000 7f1284c84740 1 -- 172.21.15.3:0/33582519 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c0aa06800 con 0x563c0aaadc50 2024-09-19T06:17:50.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.211+0000 7f127b400640 1 --2- 172.21.15.3:0/33582519 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563c0aaadc50 0x563c0aab0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:50.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.211+0000 7f127b400640 1 --2- 172.21.15.3:0/33582519 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563c0aaadc50 0x563c0aab0040 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45a4f9b58d795d00 server_cookie=e24c10f0d6abb147 in_seq=0 out_seq=0 2024-09-19T06:17:50.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.211+0000 7f1268c00640 10 client.16704 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:50.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.212+0000 7f1268c00640 1 -- 172.21.15.3:0/33582519 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563c0aa06800 con 0x563c0aaadc50 2024-09-19T06:17:50.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.212+0000 7f1268c00640 10 client.16704 handle_command_reply: tid=0 2024-09-19T06:17:50.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.212+0000 7f1284c84740 1 client.16704 shutdown 2024-09-19T06:17:50.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.212+0000 7f1284c84740 1 -- 172.21.15.3:0/33582519 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c0aa933e0 msgr2=0x563c0aa9a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:50.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.212+0000 7f1284c84740 1 --2- 172.21.15.3:0/33582519 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c0aa933e0 0x563c0aa9a860 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f126401c040 tx=0x7f1264019a30 comp rx=0 tx=0).stop 2024-09-19T06:17:50.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.213+0000 7f1284c84740 1 -- 172.21.15.3:0/33582519 shutdown_connections 2024-09-19T06:17:50.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.213+0000 7f1284c84740 1 --2- 172.21.15.3:0/33582519 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563c0aaadc50 0x563c0aab0040 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.213+0000 7f1284c84740 1 --2- 172.21.15.3:0/33582519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563c0aa9dca0 0x563c0aa9ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.213+0000 7f1284c84740 1 --2- 172.21.15.3:0/33582519 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c0aa933e0 0x563c0aa9a860 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.213+0000 7f1284c84740 1 --2- 172.21.15.3:0/33582519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa92ac0 0x563c0aa9d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.213+0000 7f1284c84740 1 -- 172.21.15.3:0/33582519 >> 172.21.15.3:0/33582519 conn(0x563c0aa8f050 msgr2=0x563c0aa94d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:50.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.213+0000 7f1268c00640 0 client.16704 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:50.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.213+0000 7f1284c84740 1 -- 172.21.15.3:0/33582519 shutdown_connections 2024-09-19T06:17:50.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.213+0000 7f1284c84740 1 -- 172.21.15.3:0/33582519 wait complete. 2024-09-19T06:17:50.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.213+0000 7f1284c84740 20 client.16704 trim_cache size 0 max 16384 2024-09-19T06:17:50.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.231+0000 7f1284c84740 1 Processor -- start 2024-09-19T06:17:50.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.232+0000 7f1284c84740 1 -- start start 2024-09-19T06:17:50.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.232+0000 7f1284c84740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563c0aa92ac0 0x563c0aab5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:50.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.232+0000 7f1284c84740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa933e0 0x563c0aab5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:50.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.232+0000 7f1284c84740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c0aa9dca0 0x563c0aa99000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:50.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.232+0000 7f1284c84740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f127c1afa80 con 0x563c0aa9dca0 2024-09-19T06:17:50.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.232+0000 7f1284c84740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f127c1b15c0 con 0x563c0aa933e0 2024-09-19T06:17:50.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.232+0000 7f1284c84740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f127c1b0150 con 0x563c0aa92ac0 2024-09-19T06:17:50.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.232+0000 7f127be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c0aa9dca0 0x563c0aa99000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:50.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.232+0000 7f1272a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa933e0 0x563c0aab5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:50.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.232+0000 7f127b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563c0aa92ac0 0x563c0aab5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:50.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.232+0000 7f127b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563c0aa92ac0 0x563c0aab5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:47530/0 (socket says 172.21.15.3:47530) 2024-09-19T06:17:50.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.232+0000 7f127be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c0aa9dca0 0x563c0aa99000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48316/0 (socket says 172.21.15.3:48316) 2024-09-19T06:17:50.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.232+0000 7f127b400640 1 -- 172.21.15.3:0/1144743226 learned_addr learned my addr 172.21.15.3:0/1144743226 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:50.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.232+0000 7f1272a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa933e0 0x563c0aab5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44718/0 (socket says 172.21.15.3:44718) 2024-09-19T06:17:50.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.233+0000 7f1272a00640 1 -- 172.21.15.3:0/1144743226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563c0aa92ac0 msgr2=0x563c0aab5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:50.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.233+0000 7f1272a00640 1 --2- 172.21.15.3:0/1144743226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563c0aa92ac0 0x563c0aab5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.233+0000 7f1272a00640 1 -- 172.21.15.3:0/1144743226 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c0aa9dca0 msgr2=0x563c0aa99000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:50.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.233+0000 7f1272a00640 1 --2- 172.21.15.3:0/1144743226 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c0aa9dca0 0x563c0aa99000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.233+0000 7f1272a00640 1 -- 172.21.15.3:0/1144743226 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c0aa8eaf0 con 0x563c0aa933e0 2024-09-19T06:17:50.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.233+0000 7f127b400640 1 --2- 172.21.15.3:0/1144743226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563c0aa92ac0 0x563c0aab5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:50.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.233+0000 7f1272a00640 1 --2- 172.21.15.3:0/1144743226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa933e0 0x563c0aab5d90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1264004b60 tx=0x7f1264000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d975d892a9e7430b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:50.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.233+0000 7f126b400640 1 -- 172.21.15.3:0/1144743226 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126403b020 con 0x563c0aa933e0 2024-09-19T06:17:50.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.233+0000 7f126b400640 1 -- 172.21.15.3:0/1144743226 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f126402a070 con 0x563c0aa933e0 2024-09-19T06:17:50.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.233+0000 7f126b400640 1 -- 172.21.15.3:0/1144743226 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126401e050 con 0x563c0aa933e0 2024-09-19T06:17:50.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.234+0000 7f1284c84740 1 -- 172.21.15.3:0/1144743226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa933e0 msgr2=0x563c0aab5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:50.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.234+0000 7f1284c84740 1 --2- 172.21.15.3:0/1144743226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa933e0 0x563c0aab5d90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1264004b60 tx=0x7f1264000bc0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.234+0000 7f1284c84740 1 -- 172.21.15.3:0/1144743226 shutdown_connections 2024-09-19T06:17:50.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.234+0000 7f1284c84740 1 --2- 172.21.15.3:0/1144743226 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c0aa9dca0 0x563c0aa99000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.234+0000 7f1284c84740 1 --2- 172.21.15.3:0/1144743226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa933e0 0x563c0aab5d90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.234+0000 7f1284c84740 1 --2- 172.21.15.3:0/1144743226 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563c0aa92ac0 0x563c0aab5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.234+0000 7f1284c84740 1 -- 172.21.15.3:0/1144743226 >> 172.21.15.3:0/1144743226 conn(0x563c0aa8f050 msgr2=0x563c0aa95f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:50.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.234+0000 7f1284c84740 1 -- 172.21.15.3:0/1144743226 shutdown_connections 2024-09-19T06:17:50.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.234+0000 7f1284c84740 1 -- 172.21.15.3:0/1144743226 wait complete. 2024-09-19T06:17:50.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.235+0000 7f1284c84740 1 -- start start 2024-09-19T06:17:50.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.235+0000 7f1284c84740 1 Processor -- start 2024-09-19T06:17:50.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.235+0000 7f1284c84740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa92ac0 0x563c0aaa6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:50.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.235+0000 7f1284c84740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563c0aa933e0 0x563c0aaa1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:50.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.235+0000 7f1284c84740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c0aa9dca0 0x563c0aaa1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:50.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.235+0000 7f1284c84740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f127c1b0ef0 con 0x563c0aa9dca0 2024-09-19T06:17:50.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.235+0000 7f1284c84740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f127c1b0820 con 0x563c0aa92ac0 2024-09-19T06:17:50.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.235+0000 7f1284c84740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f127c1ada60 con 0x563c0aa933e0 2024-09-19T06:17:50.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.235+0000 7f1284c84740 10 client.0 _ll_register_callbacks cb 0x7f126401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:50.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.235+0000 7f127b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa92ac0 0x563c0aaa6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:50.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.235+0000 7f127be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c0aa9dca0 0x563c0aaa1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:50.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.236+0000 7f1272a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563c0aa933e0 0x563c0aaa1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:50.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.236+0000 7f127b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa92ac0 0x563c0aaa6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44726/0 (socket says 172.21.15.3:44726) 2024-09-19T06:17:50.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.236+0000 7f127b400640 1 -- 172.21.15.3:0/3963171993 learned_addr learned my addr 172.21.15.3:0/3963171993 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:50.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.236+0000 7f127be00640 1 -- 172.21.15.3:0/3963171993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563c0aa933e0 msgr2=0x563c0aaa1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:50.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.236+0000 7f127be00640 1 --2- 172.21.15.3:0/3963171993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563c0aa933e0 0x563c0aaa1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.236+0000 7f127be00640 1 -- 172.21.15.3:0/3963171993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa92ac0 msgr2=0x563c0aaa6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:50.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.236+0000 7f127be00640 1 --2- 172.21.15.3:0/3963171993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa92ac0 0x563c0aaa6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.236+0000 7f127be00640 1 -- 172.21.15.3:0/3963171993 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c0aaa22c0 con 0x563c0aa9dca0 2024-09-19T06:17:50.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.236+0000 7f127b400640 1 --2- 172.21.15.3:0/3963171993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa92ac0 0x563c0aaa6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:50.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.236+0000 7f127be00640 1 --2- 172.21.15.3:0/3963171993 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c0aa9dca0 0x563c0aaa1bd0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1274009c30 tx=0x7f1274004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b486e38537d071 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:50.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.236+0000 7f1268c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:17:50.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.237+0000 7f1268c00640 1 -- 172.21.15.3:0/3963171993 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127402e060 con 0x563c0aa9dca0 2024-09-19T06:17:50.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.237+0000 7f1284c84740 1 -- 172.21.15.3:0/3963171993 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f126402a070 con 0x563c0aa9dca0 2024-09-19T06:17:50.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.237+0000 7f1268c00640 1 -- 172.21.15.3:0/3963171993 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f127400f890 con 0x563c0aa9dca0 2024-09-19T06:17:50.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.237+0000 7f1268c00640 1 -- 172.21.15.3:0/3963171993 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f127400fa90 con 0x563c0aa9dca0 2024-09-19T06:17:50.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.237+0000 7f1284c84740 10 client.16710 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:50.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.237+0000 7f1284c84740 1 -- 172.21.15.3:0/3963171993 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563c0ab187a0 con 0x563c0aa9dca0 2024-09-19T06:17:50.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.237+0000 7f1268c00640 1 -- 172.21.15.3:0/3963171993 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f126402a070 con 0x563c0aa9dca0 2024-09-19T06:17:50.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.237+0000 7f1268c00640 1 -- 172.21.15.3:0/3963171993 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f127401d420 con 0x563c0aa9dca0 2024-09-19T06:17:50.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.238+0000 7f1284c84740 10 client.16710 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:50.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.238+0000 7f1284c84740 10 client.16710 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:50.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.238+0000 7f1284c84740 20 client.16710 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:50.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.238+0000 7f1284c84740 1 --2- 172.21.15.3:0/3963171993 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563c0ab18ef0 0x563c0ab1b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:50.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.238+0000 7f1284c84740 4 client.16710 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:17:50.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.238+0000 7f1284c84740 1 -- 172.21.15.3:0/3963171993 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563c0aa00d10 con 0x563c0ab18ef0 2024-09-19T06:17:50.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.238+0000 7f127b400640 1 --2- 172.21.15.3:0/3963171993 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563c0ab18ef0 0x563c0ab1b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:50.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.239+0000 7f127b400640 1 --2- 172.21.15.3:0/3963171993 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563c0ab18ef0 0x563c0ab1b310 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc503a143cecb9e7 server_cookie=f8b76f8e431ffbf3 in_seq=0 out_seq=0 2024-09-19T06:17:50.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.239+0000 7f1268c00640 10 client.16710 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:50.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.240+0000 7f1268c00640 1 -- 172.21.15.3:0/3963171993 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563c0aa00d10 con 0x563c0ab18ef0 2024-09-19T06:17:50.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.240+0000 7f1268c00640 10 client.16710 handle_command_reply: tid=0 2024-09-19T06:17:50.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.240+0000 7f1284c84740 1 client.16710 shutdown 2024-09-19T06:17:50.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.240+0000 7f1284c84740 1 -- 172.21.15.3:0/3963171993 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c0aa9dca0 msgr2=0x563c0aaa1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:50.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.240+0000 7f1284c84740 1 --2- 172.21.15.3:0/3963171993 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c0aa9dca0 0x563c0aaa1bd0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1274009c30 tx=0x7f1274004a40 comp rx=0 tx=0).stop 2024-09-19T06:17:50.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.240+0000 7f1284c84740 1 -- 172.21.15.3:0/3963171993 shutdown_connections 2024-09-19T06:17:50.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.240+0000 7f1284c84740 1 --2- 172.21.15.3:0/3963171993 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563c0ab18ef0 0x563c0ab1b310 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.240+0000 7f1284c84740 1 --2- 172.21.15.3:0/3963171993 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563c0aa9dca0 0x563c0aaa1bd0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.240+0000 7f1284c84740 1 --2- 172.21.15.3:0/3963171993 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563c0aa933e0 0x563c0aaa1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.240+0000 7f1284c84740 1 --2- 172.21.15.3:0/3963171993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c0aa92ac0 0x563c0aaa6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.240+0000 7f1268c00640 0 client.16710 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:50.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.240+0000 7f1284c84740 1 -- 172.21.15.3:0/3963171993 >> 172.21.15.3:0/3963171993 conn(0x563c0aa8f050 msgr2=0x563c0aa9c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:50.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.240+0000 7f1284c84740 1 -- 172.21.15.3:0/3963171993 shutdown_connections 2024-09-19T06:17:50.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.240+0000 7f1284c84740 1 -- 172.21.15.3:0/3963171993 wait complete. 2024-09-19T06:17:50.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.240+0000 7f1284c84740 20 client.16710 trim_cache size 0 max 16384 2024-09-19T06:17:50.245 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:17:50.245 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": 0, 2024-09-19T06:17:50.245 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_tag": "10f8f634-e674-48f9-af99-bc5f13db943a", 2024-09-19T06:17:50.245 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": "asynchronous" 2024-09-19T06:17:50.245 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:17:50.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.241+0000 7f1282200640 1 -- 172.21.15.3:0/2860956512 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f12600a3430 msgr2=0x7f12600a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:50.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.241+0000 7f1282200640 1 --2- 172.21.15.3:0/2860956512 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f12600a3430 0x7f12600a58f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1274005fd0 tx=0x7f1274009500 comp rx=0 tx=0).stop 2024-09-19T06:17:50.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.241+0000 7f1282200640 1 -- 172.21.15.3:0/2860956512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f127c103ff0 msgr2=0x7f127c19a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:50.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.241+0000 7f1282200640 1 --2- 172.21.15.3:0/2860956512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f127c103ff0 0x7f127c19a5f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f126c006010 tx=0x7f126c004040 comp rx=0 tx=0).stop 2024-09-19T06:17:50.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.241+0000 7f1282200640 1 -- 172.21.15.3:0/2860956512 shutdown_connections 2024-09-19T06:17:50.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.241+0000 7f1282200640 1 --2- 172.21.15.3:0/2860956512 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f12600a3430 0x7f12600a58f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.241+0000 7f1282200640 1 --2- 172.21.15.3:0/2860956512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f127c109120 0x7f127c19eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.241+0000 7f1282200640 1 --2- 172.21.15.3:0/2860956512 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f127c1049a0 0x7f127c19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.241+0000 7f1282200640 1 --2- 172.21.15.3:0/2860956512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f127c103ff0 0x7f127c19a5f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:50.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.241+0000 7f1282200640 1 -- 172.21.15.3:0/2860956512 >> 172.21.15.3:0/2860956512 conn(0x7f127c0ffa90 msgr2=0x7f127c100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:50.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.241+0000 7f1282200640 1 -- 172.21.15.3:0/2860956512 shutdown_connections 2024-09-19T06:17:50.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:50.241+0000 7f1282200640 1 -- 172.21.15.3:0/2860956512 wait complete. 2024-09-19T06:17:51.264 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:17:51.649 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:17:51.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:51 smithi003 ceph-mon[30893]: scrub queued for path: / 2024-09-19T06:17:51.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:51 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:17:51.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:51 smithi003 ceph-mon[30893]: scrub summary: active paths [/] 2024-09-19T06:17:51.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:51 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:17:51.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:51 smithi003 ceph-mon[30893]: pgmap v167: 97 pgs: 97 active+clean; 3.9 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-09-19T06:17:51.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:51 smithi071 ceph-mon[35662]: scrub queued for path: / 2024-09-19T06:17:51.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:51 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:17:51.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:51 smithi071 ceph-mon[35662]: scrub summary: active paths [/] 2024-09-19T06:17:51.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:51 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:17:51.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:51 smithi071 ceph-mon[35662]: pgmap v167: 97 pgs: 97 active+clean; 3.9 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-09-19T06:17:52.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:51 smithi059 ceph-mon[35138]: scrub queued for path: / 2024-09-19T06:17:52.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:51 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:17:52.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:51 smithi059 ceph-mon[35138]: scrub summary: active paths [/] 2024-09-19T06:17:52.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:51 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:17:52.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:51 smithi059 ceph-mon[35138]: pgmap v167: 97 pgs: 97 active+clean; 3.9 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-09-19T06:17:52.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.238+0000 7f82a1000640 1 -- 172.21.15.3:0/3649532968 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f829c112a30 msgr2=0x7f829c114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:52.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.238+0000 7f82a1000640 1 --2- 172.21.15.3:0/3649532968 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f829c112a30 0x7f829c114e20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8294009ca0 tx=0x7f829402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.238+0000 7f82a1000640 1 -- 172.21.15.3:0/3649532968 shutdown_connections 2024-09-19T06:17:52.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.238+0000 7f82a1000640 1 --2- 172.21.15.3:0/3649532968 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f829c112a30 0x7f829c114e20 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.238+0000 7f82a1000640 1 --2- 172.21.15.3:0/3649532968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f829c077040 0x7f829c1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.238+0000 7f82a1000640 1 --2- 172.21.15.3:0/3649532968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f829c076720 0x7f829c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.238+0000 7f82a1000640 1 -- 172.21.15.3:0/3649532968 >> 172.21.15.3:0/3649532968 conn(0x7f829c0ffa90 msgr2=0x7f829c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:52.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.238+0000 7f82a1000640 1 -- 172.21.15.3:0/3649532968 shutdown_connections 2024-09-19T06:17:52.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.238+0000 7f82a1000640 1 -- 172.21.15.3:0/3649532968 wait complete. 2024-09-19T06:17:52.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.239+0000 7f82a1000640 1 Processor -- start 2024-09-19T06:17:52.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.239+0000 7f82a1000640 1 -- start start 2024-09-19T06:17:52.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.239+0000 7f82a1000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f829c076720 0x7f829c1a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:52.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.240+0000 7f82a1000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f829c077040 0x7f829c1a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:52.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.240+0000 7f82a1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f829c112a30 0x7f829c19e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:52.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.240+0000 7f82a1000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f829c1185d0 con 0x7f829c077040 2024-09-19T06:17:52.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.240+0000 7f82a1000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f829c118450 con 0x7f829c112a30 2024-09-19T06:17:52.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.240+0000 7f82a1000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f829c118750 con 0x7f829c076720 2024-09-19T06:17:52.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.240+0000 7f8291400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f829c077040 0x7f829c1a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:52.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.240+0000 7f8291400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f829c077040 0x7f829c1a4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48360/0 (socket says 172.21.15.3:48360) 2024-09-19T06:17:52.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.240+0000 7f8291400640 1 -- 172.21.15.3:0/171309114 learned_addr learned my addr 172.21.15.3:0/171309114 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:52.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.240+0000 7f8299e00640 1 --2- 172.21.15.3:0/171309114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f829c076720 0x7f829c1a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:52.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.240+0000 7f829a800640 1 --2- 172.21.15.3:0/171309114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f829c112a30 0x7f829c19e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:52.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.240+0000 7f8291400640 1 -- 172.21.15.3:0/171309114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f829c076720 msgr2=0x7f829c1a46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:52.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.240+0000 7f8291400640 1 --2- 172.21.15.3:0/171309114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f829c076720 0x7f829c1a46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.240+0000 7f8291400640 1 -- 172.21.15.3:0/171309114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f829c112a30 msgr2=0x7f829c19e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:52.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.240+0000 7f8291400640 1 --2- 172.21.15.3:0/171309114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f829c112a30 0x7f829c19e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.240+0000 7f8291400640 1 -- 172.21.15.3:0/171309114 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829c19efd0 con 0x7f829c077040 2024-09-19T06:17:52.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.240+0000 7f8299e00640 1 --2- 172.21.15.3:0/171309114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f829c076720 0x7f829c1a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:52.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.241+0000 7f8291400640 1 --2- 172.21.15.3:0/171309114 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f829c077040 0x7f829c1a4c20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f828400e9f0 tx=0x7f828400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:52.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.241+0000 7f8293400640 1 -- 172.21.15.3:0/171309114 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828400cd80 con 0x7f829c077040 2024-09-19T06:17:52.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.241+0000 7f8293400640 1 -- 172.21.15.3:0/171309114 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8284010910 con 0x7f829c077040 2024-09-19T06:17:52.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.241+0000 7f8293400640 1 -- 172.21.15.3:0/171309114 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284018990 con 0x7f829c077040 2024-09-19T06:17:52.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.241+0000 7f82a1000640 1 -- 172.21.15.3:0/171309114 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f829c19f2c0 con 0x7f829c077040 2024-09-19T06:17:52.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.241+0000 7f82a1000640 1 -- 172.21.15.3:0/171309114 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f829c1ab5b0 con 0x7f829c077040 2024-09-19T06:17:52.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.245+0000 7f82a3bc7740 1 Processor -- start 2024-09-19T06:17:52.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.245+0000 7f8293400640 1 -- 172.21.15.3:0/171309114 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f8284010ac0 con 0x7f829c077040 2024-09-19T06:17:52.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.245+0000 7f82a3bc7740 1 -- start start 2024-09-19T06:17:52.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.245+0000 7f82a3bc7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55709b82bb90 0x55709b82bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:52.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.245+0000 7f82a3bc7740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55709b82c4b0 0x55709b836830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:52.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.245+0000 7f82a3bc7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55709b836d70 0x55709b839160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:52.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.245+0000 7f82a3bc7740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55709b7923e0 con 0x55709b82c4b0 2024-09-19T06:17:52.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.245+0000 7f82a3bc7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55709b739d80 con 0x55709b82bb90 2024-09-19T06:17:52.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.245+0000 7f82a3bc7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55709b78e3a0 con 0x55709b836d70 2024-09-19T06:17:52.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.246+0000 7f829a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55709b82bb90 0x55709b82bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:52.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.246+0000 7f8299e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55709b82c4b0 0x55709b836830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:52.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.246+0000 7f829a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55709b82bb90 0x55709b82bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44756/0 (socket says 172.21.15.3:44756) 2024-09-19T06:17:52.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.246+0000 7f829a800640 1 -- 172.21.15.3:0/232044688 learned_addr learned my addr 172.21.15.3:0/232044688 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:52.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.246+0000 7f8291400640 1 --2- 172.21.15.3:0/232044688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55709b836d70 0x55709b839160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:52.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.246+0000 7f829a800640 1 -- 172.21.15.3:0/232044688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55709b836d70 msgr2=0x55709b839160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:52.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.246+0000 7f829a800640 1 --2- 172.21.15.3:0/232044688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55709b836d70 0x55709b839160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.246+0000 7f829a800640 1 -- 172.21.15.3:0/232044688 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55709b82c4b0 msgr2=0x55709b836830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:52.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.246+0000 7f829a800640 1 --2- 172.21.15.3:0/232044688 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55709b82c4b0 0x55709b836830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.246+0000 7f829a800640 1 -- 172.21.15.3:0/232044688 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55709b758ae0 con 0x55709b82bb90 2024-09-19T06:17:52.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.246+0000 7f8291400640 1 --2- 172.21.15.3:0/232044688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55709b836d70 0x55709b839160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:17:52.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.246+0000 7f829a800640 1 --2- 172.21.15.3:0/232044688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55709b82bb90 0x55709b82bf70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f829c07aa10 tx=0x7f8294005f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93920acc63c02787 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:52.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.246+0000 7f8293400640 1 --2- 172.21.15.3:0/171309114 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f82800a33b0 0x7f82800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:52.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.247+0000 7f828b400640 1 -- 172.21.15.3:0/232044688 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8294031db0 con 0x55709b82bb90 2024-09-19T06:17:52.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.247+0000 7f8293400640 1 -- 172.21.15.3:0/171309114 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f82840cfff0 con 0x7f829c077040 2024-09-19T06:17:52.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.247+0000 7f828b400640 1 -- 172.21.15.3:0/232044688 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8294036030 con 0x55709b82bb90 2024-09-19T06:17:52.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.247+0000 7f828b400640 1 -- 172.21.15.3:0/232044688 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82940042a0 con 0x55709b82bb90 2024-09-19T06:17:52.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.247+0000 7f8299e00640 1 --2- 172.21.15.3:0/171309114 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f82800a33b0 0x7f82800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:52.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.248+0000 7f82a3bc7740 1 -- 172.21.15.3:0/232044688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55709b82bb90 msgr2=0x55709b82bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:52.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.248+0000 7f82a3bc7740 1 --2- 172.21.15.3:0/232044688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55709b82bb90 0x55709b82bf70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f829c07aa10 tx=0x7f8294005f80 comp rx=0 tx=0).stop 2024-09-19T06:17:52.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.248+0000 7f8299e00640 1 --2- 172.21.15.3:0/171309114 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f82800a33b0 0x7f82800a5870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55709b828f80 tx=0x7f828c005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:52.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.248+0000 7f82a3bc7740 1 -- 172.21.15.3:0/232044688 shutdown_connections 2024-09-19T06:17:52.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.248+0000 7f82a3bc7740 1 --2- 172.21.15.3:0/232044688 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55709b836d70 0x55709b839160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.248+0000 7f82a3bc7740 1 --2- 172.21.15.3:0/232044688 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55709b82c4b0 0x55709b836830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.248+0000 7f82a3bc7740 1 --2- 172.21.15.3:0/232044688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55709b82bb90 0x55709b82bf70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.248+0000 7f82a3bc7740 1 -- 172.21.15.3:0/232044688 >> 172.21.15.3:0/232044688 conn(0x55709b828120 msgr2=0x55709b828500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:52.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.248+0000 7f82a3bc7740 1 -- 172.21.15.3:0/232044688 shutdown_connections 2024-09-19T06:17:52.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.248+0000 7f82a3bc7740 1 -- 172.21.15.3:0/232044688 wait complete. 2024-09-19T06:17:52.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.248+0000 7f82a3bc7740 1 -- start start 2024-09-19T06:17:52.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.249+0000 7f82a3bc7740 1 Processor -- start 2024-09-19T06:17:52.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.249+0000 7f82a3bc7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55709b82bb90 0x55709b833c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:52.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.249+0000 7f82a3bc7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55709b82c4b0 0x55709b8341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:52.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.249+0000 7f82a3bc7740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55709b836d70 0x55709b834710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:52.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.249+0000 7f82a3bc7740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55709b839860 con 0x55709b836d70 2024-09-19T06:17:52.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.249+0000 7f82a3bc7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55709b74d0f0 con 0x55709b82c4b0 2024-09-19T06:17:52.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.249+0000 7f82a3bc7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55709b8399e0 con 0x55709b82bb90 2024-09-19T06:17:52.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.249+0000 7f82a3bc7740 10 client.0 _ll_register_callbacks cb 0x55709b73e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:52.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.249+0000 7f8299e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55709b82bb90 0x55709b833c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:52.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.249+0000 7f8299e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55709b82bb90 0x55709b833c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:47590/0 (socket says 172.21.15.3:47590) 2024-09-19T06:17:52.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.249+0000 7f8299e00640 1 -- 172.21.15.3:0/3139319053 learned_addr learned my addr 172.21.15.3:0/3139319053 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:52.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.249+0000 7f829a800640 1 --2- 172.21.15.3:0/3139319053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55709b836d70 0x55709b834710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:52.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.250+0000 7f8291400640 1 --2- 172.21.15.3:0/3139319053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55709b82c4b0 0x55709b8341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:52.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.250+0000 7f8299e00640 1 -- 172.21.15.3:0/3139319053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55709b82c4b0 msgr2=0x55709b8341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:52.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.250+0000 7f8299e00640 1 --2- 172.21.15.3:0/3139319053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55709b82c4b0 0x55709b8341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.250+0000 7f8299e00640 1 -- 172.21.15.3:0/3139319053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55709b836d70 msgr2=0x55709b834710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:52.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.250+0000 7f8299e00640 1 --2- 172.21.15.3:0/3139319053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55709b836d70 0x55709b834710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.250+0000 7f8299e00640 1 -- 172.21.15.3:0/3139319053 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55709b5033c0 con 0x55709b82bb90 2024-09-19T06:17:52.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.250+0000 7f8299e00640 1 --2- 172.21.15.3:0/3139319053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55709b82bb90 0x55709b833c90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f828c00fb80 tx=0x7f828c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7164c68958efcd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:52.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.250+0000 7f827fe00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:17:52.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.250+0000 7f827fe00640 1 -- 172.21.15.3:0/3139319053 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c00fdf0 con 0x55709b82bb90 2024-09-19T06:17:52.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.250+0000 7f82a3bc7740 1 -- 172.21.15.3:0/3139319053 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8294036030 con 0x55709b82bb90 2024-09-19T06:17:52.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.251+0000 7f827fe00640 1 -- 172.21.15.3:0/3139319053 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f828c018030 con 0x55709b82bb90 2024-09-19T06:17:52.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.251+0000 7f827fe00640 1 -- 172.21.15.3:0/3139319053 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f828c004020 con 0x55709b82bb90 2024-09-19T06:17:52.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.251+0000 7f82a3bc7740 10 client.26770 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:52.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.251+0000 7f82a3bc7740 1 -- 172.21.15.3:0/3139319053 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55709b845620 con 0x55709b82bb90 2024-09-19T06:17:52.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.251+0000 7f827fe00640 1 -- 172.21.15.3:0/3139319053 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8294036030 con 0x55709b82bb90 2024-09-19T06:17:52.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.251+0000 7f827fe00640 1 -- 172.21.15.3:0/3139319053 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f828c0037f0 con 0x55709b82bb90 2024-09-19T06:17:52.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.251+0000 7f82a3bc7740 10 client.26770 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:52.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.251+0000 7f82a3bc7740 10 client.26770 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:52.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.251+0000 7f82a3bc7740 20 client.26770 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:52.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.251+0000 7f82a3bc7740 1 --2- 172.21.15.3:0/3139319053 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55709b846a30 0x55709b848e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:52.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.251+0000 7f82a3bc7740 4 client.26770 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:17:52.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.251+0000 7f82a3bc7740 1 -- 172.21.15.3:0/3139319053 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55709b79f950 con 0x55709b846a30 2024-09-19T06:17:52.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.252+0000 7f8291400640 1 --2- 172.21.15.3:0/3139319053 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55709b846a30 0x55709b848e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:52.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.252+0000 7f8291400640 1 --2- 172.21.15.3:0/3139319053 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55709b846a30 0x55709b848e90 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f8360765658f4eb server_cookie=912f7e3d455656bf in_seq=0 out_seq=0 2024-09-19T06:17:52.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.252+0000 7f827fe00640 10 client.26770 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:52.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.253+0000 7f827fe00640 1 -- 172.21.15.3:0/3139319053 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55709b79f950 con 0x55709b846a30 2024-09-19T06:17:52.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.253+0000 7f827fe00640 10 client.26770 handle_command_reply: tid=0 2024-09-19T06:17:52.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.253+0000 7f82a3bc7740 1 client.26770 shutdown 2024-09-19T06:17:52.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.253+0000 7f82a3bc7740 1 -- 172.21.15.3:0/3139319053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55709b82bb90 msgr2=0x55709b833c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:52.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.253+0000 7f82a3bc7740 1 --2- 172.21.15.3:0/3139319053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55709b82bb90 0x55709b833c90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f828c00fb80 tx=0x7f828c004730 comp rx=0 tx=0).stop 2024-09-19T06:17:52.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.253+0000 7f82a3bc7740 1 -- 172.21.15.3:0/3139319053 shutdown_connections 2024-09-19T06:17:52.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.253+0000 7f82a3bc7740 1 --2- 172.21.15.3:0/3139319053 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55709b846a30 0x55709b848e90 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.253+0000 7f82a3bc7740 1 --2- 172.21.15.3:0/3139319053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55709b836d70 0x55709b834710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.253+0000 7f82a3bc7740 1 --2- 172.21.15.3:0/3139319053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55709b82c4b0 0x55709b8341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.253+0000 7f827fe00640 0 client.26770 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:52.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.253+0000 7f82a3bc7740 1 --2- 172.21.15.3:0/3139319053 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55709b82bb90 0x55709b833c90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.253+0000 7f82a3bc7740 1 -- 172.21.15.3:0/3139319053 >> 172.21.15.3:0/3139319053 conn(0x55709b828120 msgr2=0x55709b82de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:52.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.254+0000 7f82a3bc7740 1 -- 172.21.15.3:0/3139319053 shutdown_connections 2024-09-19T06:17:52.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.254+0000 7f82a3bc7740 1 -- 172.21.15.3:0/3139319053 wait complete. 2024-09-19T06:17:52.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.254+0000 7f82a3bc7740 20 client.26770 trim_cache size 0 max 16384 2024-09-19T06:17:52.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.272+0000 7f82a3bc7740 1 Processor -- start 2024-09-19T06:17:52.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.272+0000 7f82a3bc7740 1 -- start start 2024-09-19T06:17:52.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.272+0000 7f82a3bc7740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55709b82bb90 0x55709b82e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:52.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.272+0000 7f82a3bc7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55709b82c4b0 0x55709b84e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:52.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.272+0000 7f82a3bc7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55709b836d70 0x55709b84ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:52.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.272+0000 7f82a3bc7740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f829c1b3ed0 con 0x55709b82bb90 2024-09-19T06:17:52.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.272+0000 7f82a3bc7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f829c1b5a10 con 0x55709b82c4b0 2024-09-19T06:17:52.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.272+0000 7f82a3bc7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f829c1b45a0 con 0x55709b836d70 2024-09-19T06:17:52.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.272+0000 7f8299e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55709b82bb90 0x55709b82e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:52.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.272+0000 7f8299e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55709b82bb90 0x55709b82e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48394/0 (socket says 172.21.15.3:48394) 2024-09-19T06:17:52.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.272+0000 7f8299e00640 1 -- 172.21.15.3:0/2202445972 learned_addr learned my addr 172.21.15.3:0/2202445972 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:52.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.273+0000 7f8291400640 1 --2- 172.21.15.3:0/2202445972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55709b82c4b0 0x55709b84e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:52.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.273+0000 7f829a800640 1 --2- 172.21.15.3:0/2202445972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55709b836d70 0x55709b84ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:52.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.273+0000 7f8299e00640 1 -- 172.21.15.3:0/2202445972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55709b836d70 msgr2=0x55709b84ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:52.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.273+0000 7f8299e00640 1 --2- 172.21.15.3:0/2202445972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55709b836d70 0x55709b84ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.273+0000 7f8299e00640 1 -- 172.21.15.3:0/2202445972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55709b82c4b0 msgr2=0x55709b84e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:52.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.273+0000 7f8299e00640 1 --2- 172.21.15.3:0/2202445972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55709b82c4b0 0x55709b84e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.273+0000 7f8299e00640 1 -- 172.21.15.3:0/2202445972 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55709b828db0 con 0x55709b82bb90 2024-09-19T06:17:52.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.273+0000 7f8291400640 1 --2- 172.21.15.3:0/2202445972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55709b82c4b0 0x55709b84e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:17:52.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.273+0000 7f829a800640 1 --2- 172.21.15.3:0/2202445972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55709b836d70 0x55709b84ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:17:52.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.273+0000 7f8299e00640 1 --2- 172.21.15.3:0/2202445972 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55709b82bb90 0x55709b82e640 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f828c0092e0 tx=0x7f828c00f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2a59ee7c44cfff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:52.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.273+0000 7f828aa00640 1 -- 172.21.15.3:0/2202445972 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c029420 con 0x55709b82bb90 2024-09-19T06:17:52.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.274+0000 7f828aa00640 1 -- 172.21.15.3:0/2202445972 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f828c00fdf0 con 0x55709b82bb90 2024-09-19T06:17:52.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.274+0000 7f828aa00640 1 -- 172.21.15.3:0/2202445972 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c01ebf0 con 0x55709b82bb90 2024-09-19T06:17:52.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.274+0000 7f82a3bc7740 1 -- 172.21.15.3:0/2202445972 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55709b82bb90 msgr2=0x55709b82e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:52.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.274+0000 7f82a3bc7740 1 --2- 172.21.15.3:0/2202445972 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55709b82bb90 0x55709b82e640 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f828c0092e0 tx=0x7f828c00f9a0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.274+0000 7f82a3bc7740 1 -- 172.21.15.3:0/2202445972 shutdown_connections 2024-09-19T06:17:52.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.274+0000 7f82a3bc7740 1 --2- 172.21.15.3:0/2202445972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55709b836d70 0x55709b84ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.274+0000 7f82a3bc7740 1 --2- 172.21.15.3:0/2202445972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55709b82c4b0 0x55709b84e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.274+0000 7f82a3bc7740 1 --2- 172.21.15.3:0/2202445972 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55709b82bb90 0x55709b82e640 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.274+0000 7f82a3bc7740 1 -- 172.21.15.3:0/2202445972 >> 172.21.15.3:0/2202445972 conn(0x55709b828120 msgr2=0x55709b8271c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:52.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.274+0000 7f82a3bc7740 1 -- 172.21.15.3:0/2202445972 shutdown_connections 2024-09-19T06:17:52.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.274+0000 7f82a3bc7740 1 -- 172.21.15.3:0/2202445972 wait complete. 2024-09-19T06:17:52.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.275+0000 7f82a3bc7740 1 -- start start 2024-09-19T06:17:52.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.275+0000 7f82a3bc7740 1 Processor -- start 2024-09-19T06:17:52.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.275+0000 7f82a3bc7740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55709b82bb90 0x55709b83ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:52.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.275+0000 7f82a3bc7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55709b82c4b0 0x55709b83f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:52.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.275+0000 7f82a3bc7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55709b836d70 0x55709b83bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:52.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.275+0000 7f82a3bc7740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f829c1b5340 con 0x55709b82bb90 2024-09-19T06:17:52.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.275+0000 7f82a3bc7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f829c1b4c70 con 0x55709b82c4b0 2024-09-19T06:17:52.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.275+0000 7f82a3bc7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f829c1b1eb0 con 0x55709b836d70 2024-09-19T06:17:52.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.275+0000 7f82a3bc7740 10 client.0 _ll_register_callbacks cb 0x7f828c00fa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:52.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.276+0000 7f8299e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55709b82bb90 0x55709b83ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:52.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.276+0000 7f8299e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55709b82bb90 0x55709b83ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48404/0 (socket says 172.21.15.3:48404) 2024-09-19T06:17:52.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.276+0000 7f8299e00640 1 -- 172.21.15.3:0/692840811 learned_addr learned my addr 172.21.15.3:0/692840811 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:52.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.276+0000 7f8291400640 1 --2- 172.21.15.3:0/692840811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55709b82c4b0 0x55709b83f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:52.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.276+0000 7f829a800640 1 --2- 172.21.15.3:0/692840811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55709b836d70 0x55709b83bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:52.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.276+0000 7f8299e00640 1 -- 172.21.15.3:0/692840811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55709b836d70 msgr2=0x55709b83bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:52.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.276+0000 7f8299e00640 1 --2- 172.21.15.3:0/692840811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55709b836d70 0x55709b83bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.276+0000 7f8299e00640 1 -- 172.21.15.3:0/692840811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55709b82c4b0 msgr2=0x55709b83f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:52.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.276+0000 7f8299e00640 1 --2- 172.21.15.3:0/692840811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55709b82c4b0 0x55709b83f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.276+0000 7f8299e00640 1 -- 172.21.15.3:0/692840811 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55709b83c170 con 0x55709b82bb90 2024-09-19T06:17:52.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.277+0000 7f8299e00640 1 --2- 172.21.15.3:0/692840811 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55709b82bb90 0x55709b83ec60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f828c019040 tx=0x7f828c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14134cbfadda8419 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:52.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.277+0000 7f827fe00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:17:52.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.277+0000 7f827fe00640 1 -- 172.21.15.3:0/692840811 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c040070 con 0x55709b82bb90 2024-09-19T06:17:52.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.277+0000 7f827fe00640 1 -- 172.21.15.3:0/692840811 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f828c01e8f0 con 0x55709b82bb90 2024-09-19T06:17:52.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.277+0000 7f82a3bc7740 1 -- 172.21.15.3:0/692840811 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f828c00fdf0 con 0x55709b82bb90 2024-09-19T06:17:52.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.277+0000 7f827fe00640 1 -- 172.21.15.3:0/692840811 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f828c04c050 con 0x55709b82bb90 2024-09-19T06:17:52.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.277+0000 7f82a3bc7740 10 client.16728 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:52.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.277+0000 7f82a3bc7740 1 -- 172.21.15.3:0/692840811 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55709b8b1eb0 con 0x55709b82bb90 2024-09-19T06:17:52.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.277+0000 7f827fe00640 1 -- 172.21.15.3:0/692840811 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f828c00fdf0 con 0x55709b82bb90 2024-09-19T06:17:52.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.278+0000 7f827fe00640 1 -- 172.21.15.3:0/692840811 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f828c039020 con 0x55709b82bb90 2024-09-19T06:17:52.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.278+0000 7f82a3bc7740 10 client.16728 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:52.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.278+0000 7f82a3bc7740 10 client.16728 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:52.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.278+0000 7f82a3bc7740 20 client.16728 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:52.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.278+0000 7f82a3bc7740 1 --2- 172.21.15.3:0/692840811 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55709b8b2460 0x55709b8b4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:52.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.278+0000 7f82a3bc7740 4 client.16728 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:17:52.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.278+0000 7f82a3bc7740 1 -- 172.21.15.3:0/692840811 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55709b799e60 con 0x55709b8b2460 2024-09-19T06:17:52.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.278+0000 7f8291400640 1 --2- 172.21.15.3:0/692840811 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55709b8b2460 0x55709b8b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:52.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.279+0000 7f8291400640 1 --2- 172.21.15.3:0/692840811 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55709b8b2460 0x55709b8b4850 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc948b33062e245e server_cookie=8840a5ba7780aeb7 in_seq=0 out_seq=0 2024-09-19T06:17:52.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.279+0000 7f827fe00640 10 client.16728 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:52.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.279+0000 7f827fe00640 1 -- 172.21.15.3:0/692840811 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55709b799e60 con 0x55709b8b2460 2024-09-19T06:17:52.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.279+0000 7f827fe00640 10 client.16728 handle_command_reply: tid=0 2024-09-19T06:17:52.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.279+0000 7f82a3bc7740 1 client.16728 shutdown 2024-09-19T06:17:52.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.279+0000 7f82a3bc7740 1 -- 172.21.15.3:0/692840811 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55709b82bb90 msgr2=0x55709b83ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:52.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.279+0000 7f82a3bc7740 1 --2- 172.21.15.3:0/692840811 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55709b82bb90 0x55709b83ec60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f828c019040 tx=0x7f828c017000 comp rx=0 tx=0).stop 2024-09-19T06:17:52.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.279+0000 7f82a3bc7740 1 -- 172.21.15.3:0/692840811 shutdown_connections 2024-09-19T06:17:52.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.279+0000 7f82a3bc7740 1 --2- 172.21.15.3:0/692840811 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55709b8b2460 0x55709b8b4850 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.279+0000 7f82a3bc7740 1 --2- 172.21.15.3:0/692840811 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55709b836d70 0x55709b83bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.279+0000 7f82a3bc7740 1 --2- 172.21.15.3:0/692840811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55709b82c4b0 0x55709b83f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.279+0000 7f82a3bc7740 1 --2- 172.21.15.3:0/692840811 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55709b82bb90 0x55709b83ec60 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.279+0000 7f82a3bc7740 1 -- 172.21.15.3:0/692840811 >> 172.21.15.3:0/692840811 conn(0x55709b828120 msgr2=0x55709b833c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:52.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.279+0000 7f827fe00640 0 client.16728 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:52.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.279+0000 7f82a3bc7740 1 -- 172.21.15.3:0/692840811 shutdown_connections 2024-09-19T06:17:52.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.279+0000 7f82a3bc7740 1 -- 172.21.15.3:0/692840811 wait complete. 2024-09-19T06:17:52.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.280+0000 7f82a3bc7740 20 client.16728 trim_cache size 0 max 16384 2024-09-19T06:17:52.285 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:17:52.285 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:17:52.286 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": { 2024-09-19T06:17:52.286 INFO:teuthology.orchestra.run.smithi003.stdout: "10f8f634-e674-48f9-af99-bc5f13db943a": { 2024-09-19T06:17:52.286 INFO:teuthology.orchestra.run.smithi003.stdout: "path": "/", 2024-09-19T06:17:52.286 INFO:teuthology.orchestra.run.smithi003.stdout: "tag": "10f8f634-e674-48f9-af99-bc5f13db943a", 2024-09-19T06:17:52.286 INFO:teuthology.orchestra.run.smithi003.stdout: "options": "recursive,force" 2024-09-19T06:17:52.286 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:17:52.286 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:17:52.286 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:17:52.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.280+0000 7f82a1000640 1 -- 172.21.15.3:0/171309114 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f82800a33b0 msgr2=0x7f82800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:52.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.280+0000 7f82a1000640 1 --2- 172.21.15.3:0/171309114 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f82800a33b0 0x7f82800a5870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55709b828f80 tx=0x7f828c005f90 comp rx=0 tx=0).stop 2024-09-19T06:17:52.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.280+0000 7f82a1000640 1 -- 172.21.15.3:0/171309114 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f829c077040 msgr2=0x7f829c1a4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:52.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.280+0000 7f82a1000640 1 --2- 172.21.15.3:0/171309114 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f829c077040 0x7f829c1a4c20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f828400e9f0 tx=0x7f828400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.280+0000 7f82a1000640 1 -- 172.21.15.3:0/171309114 shutdown_connections 2024-09-19T06:17:52.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.280+0000 7f82a1000640 1 --2- 172.21.15.3:0/171309114 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f82800a33b0 0x7f82800a5870 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.280+0000 7f82a1000640 1 --2- 172.21.15.3:0/171309114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f829c112a30 0x7f829c19e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.280+0000 7f82a1000640 1 --2- 172.21.15.3:0/171309114 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f829c077040 0x7f829c1a4c20 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.280+0000 7f82a1000640 1 --2- 172.21.15.3:0/171309114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f829c076720 0x7f829c1a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:52.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.280+0000 7f82a1000640 1 -- 172.21.15.3:0/171309114 >> 172.21.15.3:0/171309114 conn(0x7f829c0ffa90 msgr2=0x7f829c101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:52.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.281+0000 7f82a1000640 1 -- 172.21.15.3:0/171309114 shutdown_connections 2024-09-19T06:17:52.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:17:52.281+0000 7f82a1000640 1 -- 172.21.15.3:0/171309114 wait complete. 2024-09-19T06:17:53.062 INFO:tasks.cephfs.filesystem:scrub status for tag:10f8f634-e674-48f9-af99-bc5f13db943a - {'path': '/', 'tag': '10f8f634-e674-48f9-af99-bc5f13db943a', 'options': 'recursive,force'} 2024-09-19T06:17:53.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:53 smithi003 ceph-mon[30893]: pgmap v168: 97 pgs: 97 active+clean; 3.9 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-09-19T06:17:53.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:53 smithi071 ceph-mon[35662]: pgmap v168: 97 pgs: 97 active+clean; 3.9 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-09-19T06:17:54.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:53 smithi059 ceph-mon[35138]: pgmap v168: 97 pgs: 97 active+clean; 3.9 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-09-19T06:17:55.007 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.005+0000 7fc7d3c00640 1 -- 172.21.15.3:0/1701541379 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7cc101ac0 msgr2=0x7fc7cc101f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:55.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.005+0000 7fc7d3c00640 1 --2- 172.21.15.3:0/1701541379 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7cc101ac0 0x7fc7cc101f20 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009930 tx=0x7fc7b802a420 comp rx=0 tx=0).stop 2024-09-19T06:17:55.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.005+0000 7fc7d3c00640 1 -- 172.21.15.3:0/1701541379 shutdown_connections 2024-09-19T06:17:55.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.005+0000 7fc7d3c00640 1 --2- 172.21.15.3:0/1701541379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7cc102460 0x7fc7cc10e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.005+0000 7fc7d3c00640 1 --2- 172.21.15.3:0/1701541379 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7cc101ac0 0x7fc7cc101f20 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.005+0000 7fc7d3c00640 1 --2- 172.21.15.3:0/1701541379 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7cc107ad0 0x7fc7cc107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.005+0000 7fc7d3c00640 1 -- 172.21.15.3:0/1701541379 >> 172.21.15.3:0/1701541379 conn(0x7fc7cc0fd7e0 msgr2=0x7fc7cc0ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:55.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.006+0000 7fc7d3c00640 1 -- 172.21.15.3:0/1701541379 shutdown_connections 2024-09-19T06:17:55.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.006+0000 7fc7d3c00640 1 -- 172.21.15.3:0/1701541379 wait complete. 2024-09-19T06:17:55.010 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.007+0000 7fc7d3c00640 1 Processor -- start 2024-09-19T06:17:55.010 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.007+0000 7fc7d3c00640 1 -- start start 2024-09-19T06:17:55.010 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.007+0000 7fc7d3c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7cc101ac0 0x7fc7cc19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:55.010 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.007+0000 7fc7d3c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7cc102460 0x7fc7cc19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.007+0000 7fc7d3c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7cc107ad0 0x7fc7cc19ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.007+0000 7fc7d3c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc111f10 con 0x7fc7cc102460 2024-09-19T06:17:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.007+0000 7fc7d3c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc111d90 con 0x7fc7cc101ac0 2024-09-19T06:17:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.007+0000 7fc7d3c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc112090 con 0x7fc7cc107ad0 2024-09-19T06:17:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.007+0000 7fc7cbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7cc102460 0x7fc7cc19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.007+0000 7fc7d1200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7cc101ac0 0x7fc7cc19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.007+0000 7fc7d1c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7cc107ad0 0x7fc7cc19ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.007+0000 7fc7d1200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7cc101ac0 0x7fc7cc19a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:54434/0 (socket says 172.21.15.3:54434) 2024-09-19T06:17:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.007+0000 7fc7cbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7cc102460 0x7fc7cc19abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55578/0 (socket says 172.21.15.3:55578) 2024-09-19T06:17:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.008+0000 7fc7d1200640 1 -- 172.21.15.3:0/2902158636 learned_addr learned my addr 172.21.15.3:0/2902158636 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.008+0000 7fc7d1c00640 1 -- 172.21.15.3:0/2902158636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7cc101ac0 msgr2=0x7fc7cc19a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.008+0000 7fc7d1c00640 1 --2- 172.21.15.3:0/2902158636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7cc101ac0 0x7fc7cc19a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.008+0000 7fc7d1c00640 1 -- 172.21.15.3:0/2902158636 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7cc102460 msgr2=0x7fc7cc19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.008+0000 7fc7d1c00640 1 --2- 172.21.15.3:0/2902158636 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7cc102460 0x7fc7cc19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.008+0000 7fc7d1c00640 1 -- 172.21.15.3:0/2902158636 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7cc19f660 con 0x7fc7cc107ad0 2024-09-19T06:17:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.008+0000 7fc7d1200640 1 --2- 172.21.15.3:0/2902158636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7cc101ac0 0x7fc7cc19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.008+0000 7fc7cbe00640 1 --2- 172.21.15.3:0/2902158636 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7cc102460 0x7fc7cc19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.008+0000 7fc7d1c00640 1 --2- 172.21.15.3:0/2902158636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7cc107ad0 0x7fc7cc19ef30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009fd0 tx=0x7fc7c400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.008+0000 7fc7c9600640 1 -- 172.21.15.3:0/2902158636 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c400ce20 con 0x7fc7cc107ad0 2024-09-19T06:17:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.009+0000 7fc7c9600640 1 -- 172.21.15.3:0/2902158636 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7c4005020 con 0x7fc7cc107ad0 2024-09-19T06:17:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.009+0000 7fc7c9600640 1 -- 172.21.15.3:0/2902158636 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4010720 con 0x7fc7cc107ad0 2024-09-19T06:17:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.009+0000 7fc7d3c00640 1 -- 172.21.15.3:0/2902158636 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7cc19f950 con 0x7fc7cc107ad0 2024-09-19T06:17:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.009+0000 7fc7d3c00640 1 -- 172.21.15.3:0/2902158636 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7cc1a71e0 con 0x7fc7cc107ad0 2024-09-19T06:17:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.012+0000 7fc7d69e5740 1 Processor -- start 2024-09-19T06:17:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.012+0000 7fc7c9600640 1 -- 172.21.15.3:0/2902158636 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fc7c4005540 con 0x7fc7cc107ad0 2024-09-19T06:17:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.012+0000 7fc7d69e5740 1 -- start start 2024-09-19T06:17:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.013+0000 7fc7d69e5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c531a1e0 0x55b6c531a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.013+0000 7fc7d69e5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6c531ab00 0x55b6c5324e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.013+0000 7fc7d69e5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6c53253a0 0x55b6c5327790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.013+0000 7fc7d69e5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b6c5280100 con 0x55b6c531a1e0 2024-09-19T06:17:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.013+0000 7fc7d69e5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b6c52281b0 con 0x55b6c531ab00 2024-09-19T06:17:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.013+0000 7fc7d69e5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b6c527c0c0 con 0x55b6c53253a0 2024-09-19T06:17:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.013+0000 7fc7cbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c531a1e0 0x55b6c531a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.013+0000 7fc7cbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c531a1e0 0x55b6c531a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55594/0 (socket says 172.21.15.3:55594) 2024-09-19T06:17:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.013+0000 7fc7cbe00640 1 -- 172.21.15.3:0/346220282 learned_addr learned my addr 172.21.15.3:0/346220282 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.013+0000 7fc7d1200640 1 --2- 172.21.15.3:0/346220282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6c531ab00 0x55b6c5324e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.013+0000 7fc7cbe00640 1 --2- 172.21.15.3:0/346220282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6c53253a0 0x55b6c5327790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.014+0000 7fc7cbe00640 1 -- 172.21.15.3:0/346220282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6c53253a0 msgr2=0x55b6c5327790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.014+0000 7fc7cbe00640 1 --2- 172.21.15.3:0/346220282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6c53253a0 0x55b6c5327790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.014+0000 7fc7cbe00640 1 -- 172.21.15.3:0/346220282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6c531ab00 msgr2=0x55b6c5324e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.014+0000 7fc7cbe00640 1 --2- 172.21.15.3:0/346220282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6c531ab00 0x55b6c5324e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.014+0000 7fc7cbe00640 1 -- 172.21.15.3:0/346220282 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6c4f93210 con 0x55b6c531a1e0 2024-09-19T06:17:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.014+0000 7fc7c9600640 1 --2- 172.21.15.3:0/2902158636 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc7b40a33b0 0x7fc7b40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:55.020 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.014+0000 7fc7cbe00640 1 --2- 172.21.15.3:0/346220282 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c531a1e0 0x55b6c531a5c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8006010 tx=0x7fc7b8031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d26f5c53d2fad9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:55.021 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.014+0000 7fc7c9600640 1 -- 172.21.15.3:0/2902158636 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fc7c40d0490 con 0x7fc7cc107ad0 2024-09-19T06:17:55.021 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.014+0000 7fc7d1200640 1 --2- 172.21.15.3:0/2902158636 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc7b40a33b0 0x7fc7b40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:55.021 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.014+0000 7fc7be000640 1 -- 172.21.15.3:0/346220282 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8044070 con 0x55b6c531a1e0 2024-09-19T06:17:55.021 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.014+0000 7fc7be000640 1 -- 172.21.15.3:0/346220282 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7b8005500 con 0x55b6c531a1e0 2024-09-19T06:17:55.021 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.014+0000 7fc7be000640 1 -- 172.21.15.3:0/346220282 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8035040 con 0x55b6c531a1e0 2024-09-19T06:17:55.021 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.015+0000 7fc7d69e5740 1 -- 172.21.15.3:0/346220282 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c531a1e0 msgr2=0x55b6c531a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:55.021 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.015+0000 7fc7d1200640 1 --2- 172.21.15.3:0/2902158636 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc7b40a33b0 0x7fc7b40a5870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0009640 tx=0x7fc7c0005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:55.021 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.015+0000 7fc7d69e5740 1 --2- 172.21.15.3:0/346220282 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c531a1e0 0x55b6c531a5c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8006010 tx=0x7fc7b8031400 comp rx=0 tx=0).stop 2024-09-19T06:17:55.021 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.015+0000 7fc7d69e5740 1 -- 172.21.15.3:0/346220282 shutdown_connections 2024-09-19T06:17:55.021 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.015+0000 7fc7d69e5740 1 --2- 172.21.15.3:0/346220282 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6c53253a0 0x55b6c5327790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.021 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.015+0000 7fc7d69e5740 1 --2- 172.21.15.3:0/346220282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6c531ab00 0x55b6c5324e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.015+0000 7fc7d69e5740 1 --2- 172.21.15.3:0/346220282 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c531a1e0 0x55b6c531a5c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.015+0000 7fc7d69e5740 1 -- 172.21.15.3:0/346220282 >> 172.21.15.3:0/346220282 conn(0x55b6c5316750 msgr2=0x55b6c5316b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.015+0000 7fc7d69e5740 1 -- 172.21.15.3:0/346220282 shutdown_connections 2024-09-19T06:17:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.015+0000 7fc7d69e5740 1 -- 172.21.15.3:0/346220282 wait complete. 2024-09-19T06:17:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.016+0000 7fc7d69e5740 1 -- start start 2024-09-19T06:17:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.016+0000 7fc7d69e5740 1 Processor -- start 2024-09-19T06:17:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.016+0000 7fc7d69e5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6c531a1e0 0x55b6c53222e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.016+0000 7fc7d69e5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6c531ab00 0x55b6c5322820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.016+0000 7fc7d69e5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c53253a0 0x55b6c5322d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.016+0000 7fc7d69e5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b6c5327f70 con 0x55b6c53253a0 2024-09-19T06:17:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.016+0000 7fc7d69e5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b6c5209090 con 0x55b6c531ab00 2024-09-19T06:17:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.016+0000 7fc7d69e5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b6c53280f0 con 0x55b6c531a1e0 2024-09-19T06:17:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.016+0000 7fc7d69e5740 10 client.0 _ll_register_callbacks cb 0x55b6c525df30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.017+0000 7fc7d1c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c53253a0 0x55b6c5322d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.017+0000 7fc7cbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6c531ab00 0x55b6c5322820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.017+0000 7fc7d1c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c53253a0 0x55b6c5322d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55608/0 (socket says 172.21.15.3:55608) 2024-09-19T06:17:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.017+0000 7fc7d1c00640 1 -- 172.21.15.3:0/4194118571 learned_addr learned my addr 172.21.15.3:0/4194118571 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.017+0000 7fc7cbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6c531ab00 0x55b6c5322820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:54464/0 (socket says 172.21.15.3:54464) 2024-09-19T06:17:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.017+0000 7fc7d1200640 1 --2- 172.21.15.3:0/4194118571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6c531a1e0 0x55b6c53222e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.017+0000 7fc7d1c00640 1 -- 172.21.15.3:0/4194118571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6c531a1e0 msgr2=0x55b6c53222e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.017+0000 7fc7d1c00640 1 --2- 172.21.15.3:0/4194118571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6c531a1e0 0x55b6c53222e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.017+0000 7fc7d1c00640 1 -- 172.21.15.3:0/4194118571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6c531ab00 msgr2=0x55b6c5322820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.017+0000 7fc7d1c00640 1 --2- 172.21.15.3:0/4194118571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6c531ab00 0x55b6c5322820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.017+0000 7fc7d1c00640 1 -- 172.21.15.3:0/4194118571 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6c505f620 con 0x55b6c53253a0 2024-09-19T06:17:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.017+0000 7fc7d1c00640 1 --2- 172.21.15.3:0/4194118571 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c53253a0 0x55b6c5322d60 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40990e0 tx=0x7fc7c409ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54f2eb1edcb5c9f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.017+0000 7fc7b2a00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:17:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.018+0000 7fc7b2a00640 1 -- 172.21.15.3:0/4194118571 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c40a5380 con 0x55b6c53253a0 2024-09-19T06:17:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.018+0000 7fc7d69e5740 1 -- 172.21.15.3:0/4194118571 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7b8005500 con 0x55b6c53253a0 2024-09-19T06:17:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.018+0000 7fc7b2a00640 1 -- 172.21.15.3:0/4194118571 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fc7c40a4ef0 con 0x55b6c53253a0 2024-09-19T06:17:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.018+0000 7fc7b2a00640 1 -- 172.21.15.3:0/4194118571 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc7c40a50f0 con 0x55b6c53253a0 2024-09-19T06:17:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.018+0000 7fc7d69e5740 10 client.16740 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.018+0000 7fc7d69e5740 1 -- 172.21.15.3:0/4194118571 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b6c5333c20 con 0x55b6c53253a0 2024-09-19T06:17:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.018+0000 7fc7b2a00640 1 -- 172.21.15.3:0/4194118571 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7b8005500 con 0x55b6c53253a0 2024-09-19T06:17:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.018+0000 7fc7b2a00640 1 -- 172.21.15.3:0/4194118571 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc7c407c070 con 0x55b6c53253a0 2024-09-19T06:17:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.018+0000 7fc7d69e5740 10 client.16740 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.018+0000 7fc7d69e5740 10 client.16740 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.018+0000 7fc7d69e5740 20 client.16740 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.018+0000 7fc7d69e5740 1 --2- 172.21.15.3:0/4194118571 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b6c5335090 0x55b6c5337480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:55.025 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.018+0000 7fc7d69e5740 4 client.16740 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:17:55.025 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.018+0000 7fc7d69e5740 1 -- 172.21.15.3:0/4194118571 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6c528d830 con 0x55b6c5335090 2024-09-19T06:17:55.025 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.019+0000 7fc7d1200640 1 --2- 172.21.15.3:0/4194118571 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b6c5335090 0x55b6c5337480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.019+0000 7fc7d1200640 1 --2- 172.21.15.3:0/4194118571 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b6c5335090 0x55b6c5337480 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7ee4789f9804da server_cookie=cfee26c178af9e35 in_seq=0 out_seq=0 2024-09-19T06:17:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.019+0000 7fc7b2a00640 10 client.16740 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.020+0000 7fc7b2a00640 1 -- 172.21.15.3:0/4194118571 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b6c528d830 con 0x55b6c5335090 2024-09-19T06:17:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.020+0000 7fc7b2a00640 10 client.16740 handle_command_reply: tid=0 2024-09-19T06:17:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.020+0000 7fc7d69e5740 1 client.16740 shutdown 2024-09-19T06:17:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.021+0000 7fc7d69e5740 1 -- 172.21.15.3:0/4194118571 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c53253a0 msgr2=0x55b6c5322d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.021+0000 7fc7d69e5740 1 --2- 172.21.15.3:0/4194118571 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c53253a0 0x55b6c5322d60 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40990e0 tx=0x7fc7c409ced0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.021+0000 7fc7d69e5740 1 -- 172.21.15.3:0/4194118571 shutdown_connections 2024-09-19T06:17:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.021+0000 7fc7d69e5740 1 --2- 172.21.15.3:0/4194118571 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b6c5335090 0x55b6c5337480 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.021+0000 7fc7d69e5740 1 --2- 172.21.15.3:0/4194118571 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c53253a0 0x55b6c5322d60 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.021+0000 7fc7d69e5740 1 --2- 172.21.15.3:0/4194118571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6c531ab00 0x55b6c5322820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.021+0000 7fc7b2a00640 0 client.16740 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.021+0000 7fc7d69e5740 1 --2- 172.21.15.3:0/4194118571 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6c531a1e0 0x55b6c53222e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.021+0000 7fc7d69e5740 1 -- 172.21.15.3:0/4194118571 >> 172.21.15.3:0/4194118571 conn(0x55b6c5316750 msgr2=0x55b6c531c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.021+0000 7fc7d69e5740 1 -- 172.21.15.3:0/4194118571 shutdown_connections 2024-09-19T06:17:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.021+0000 7fc7d69e5740 1 -- 172.21.15.3:0/4194118571 wait complete. 2024-09-19T06:17:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.021+0000 7fc7d69e5740 20 client.16740 trim_cache size 0 max 16384 2024-09-19T06:17:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.036+0000 7fc7d69e5740 1 Processor -- start 2024-09-19T06:17:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.036+0000 7fc7d69e5740 1 -- start start 2024-09-19T06:17:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.037+0000 7fc7d69e5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6c531a1e0 0x55b6c531cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.037+0000 7fc7d69e5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6c531ab00 0x55b6c533cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.037+0000 7fc7d69e5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c53253a0 0x55b6c533d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.037+0000 7fc7d69e5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc1afa00 con 0x55b6c53253a0 2024-09-19T06:17:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.037+0000 7fc7d69e5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc1b1540 con 0x55b6c531a1e0 2024-09-19T06:17:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.037+0000 7fc7d69e5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc1b00d0 con 0x55b6c531ab00 2024-09-19T06:17:55.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.037+0000 7fc7d1c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c53253a0 0x55b6c533d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:55.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.037+0000 7fc7d1c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c53253a0 0x55b6c533d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55618/0 (socket says 172.21.15.3:55618) 2024-09-19T06:17:55.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.037+0000 7fc7d1c00640 1 -- 172.21.15.3:0/2883137493 learned_addr learned my addr 172.21.15.3:0/2883137493 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:55.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.037+0000 7fc7d1200640 1 --2- 172.21.15.3:0/2883137493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6c531a1e0 0x55b6c531cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:55.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.037+0000 7fc7cbe00640 1 --2- 172.21.15.3:0/2883137493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6c531ab00 0x55b6c533cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:55.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.037+0000 7fc7d1c00640 1 -- 172.21.15.3:0/2883137493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6c531ab00 msgr2=0x55b6c533cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:55.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.037+0000 7fc7d1c00640 1 --2- 172.21.15.3:0/2883137493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6c531ab00 0x55b6c533cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.037+0000 7fc7d1c00640 1 -- 172.21.15.3:0/2883137493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6c531a1e0 msgr2=0x55b6c531cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:55.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.037+0000 7fc7d1c00640 1 --2- 172.21.15.3:0/2883137493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6c531a1e0 0x55b6c531cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.037+0000 7fc7d1c00640 1 -- 172.21.15.3:0/2883137493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6c5337b00 con 0x55b6c53253a0 2024-09-19T06:17:55.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.037+0000 7fc7d1200640 1 --2- 172.21.15.3:0/2883137493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6c531a1e0 0x55b6c531cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:17:55.042 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.037+0000 7fc7cbe00640 1 --2- 172.21.15.3:0/2883137493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6c531ab00 0x55b6c533cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:17:55.042 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.038+0000 7fc7d1c00640 1 --2- 172.21.15.3:0/2883137493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c53253a0 0x55b6c533d2d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40a4e50 tx=0x7fc7c4005940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9a8200cb31de52 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:55.042 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.038+0000 7fc7bd600640 1 -- 172.21.15.3:0/2883137493 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4082070 con 0x55b6c53253a0 2024-09-19T06:17:55.042 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.038+0000 7fc7bd600640 1 -- 172.21.15.3:0/2883137493 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7c40b5070 con 0x55b6c53253a0 2024-09-19T06:17:55.042 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.038+0000 7fc7bd600640 1 -- 172.21.15.3:0/2883137493 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c409bb60 con 0x55b6c53253a0 2024-09-19T06:17:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.038+0000 7fc7d69e5740 1 -- 172.21.15.3:0/2883137493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c53253a0 msgr2=0x55b6c533d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.038+0000 7fc7d69e5740 1 --2- 172.21.15.3:0/2883137493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c53253a0 0x55b6c533d2d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40a4e50 tx=0x7fc7c4005940 comp rx=0 tx=0).stop 2024-09-19T06:17:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.039+0000 7fc7d69e5740 1 -- 172.21.15.3:0/2883137493 shutdown_connections 2024-09-19T06:17:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.039+0000 7fc7d69e5740 1 --2- 172.21.15.3:0/2883137493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c53253a0 0x55b6c533d2d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.039+0000 7fc7d69e5740 1 --2- 172.21.15.3:0/2883137493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6c531ab00 0x55b6c533cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.039+0000 7fc7d69e5740 1 --2- 172.21.15.3:0/2883137493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6c531a1e0 0x55b6c531cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.039+0000 7fc7d69e5740 1 -- 172.21.15.3:0/2883137493 >> 172.21.15.3:0/2883137493 conn(0x55b6c5316750 msgr2=0x55b6c5324250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.039+0000 7fc7d69e5740 1 -- 172.21.15.3:0/2883137493 shutdown_connections 2024-09-19T06:17:55.045 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.039+0000 7fc7d69e5740 1 -- 172.21.15.3:0/2883137493 wait complete. 2024-09-19T06:17:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.039+0000 7fc7d69e5740 1 -- start start 2024-09-19T06:17:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.039+0000 7fc7d69e5740 1 Processor -- start 2024-09-19T06:17:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.040+0000 7fc7d69e5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6c531a1e0 0x55b6c5329120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.040+0000 7fc7d69e5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6c531ab00 0x55b6c5329660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.040+0000 7fc7d69e5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c53253a0 0x55b6c5329ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.040+0000 7fc7d69e5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc1b0e70 con 0x55b6c53253a0 2024-09-19T06:17:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.040+0000 7fc7d69e5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc1b07a0 con 0x55b6c531ab00 2024-09-19T06:17:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.040+0000 7fc7d69e5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc7cc1ad9e0 con 0x55b6c531a1e0 2024-09-19T06:17:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.040+0000 7fc7d69e5740 10 client.0 _ll_register_callbacks cb 0x7fc7c40982f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:17:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.040+0000 7fc7d1c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c53253a0 0x55b6c5329ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:55.046 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.040+0000 7fc7d1c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c53253a0 0x55b6c5329ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55626/0 (socket says 172.21.15.3:55626) 2024-09-19T06:17:55.047 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.040+0000 7fc7d1c00640 1 -- 172.21.15.3:0/2349322268 learned_addr learned my addr 172.21.15.3:0/2349322268 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:17:55.047 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.040+0000 7fc7cbe00640 1 --2- 172.21.15.3:0/2349322268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6c531ab00 0x55b6c5329660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:55.047 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.040+0000 7fc7d1200640 1 --2- 172.21.15.3:0/2349322268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6c531a1e0 0x55b6c5329120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:55.047 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.040+0000 7fc7d1c00640 1 -- 172.21.15.3:0/2349322268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6c531a1e0 msgr2=0x55b6c5329120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:55.047 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.040+0000 7fc7d1c00640 1 --2- 172.21.15.3:0/2349322268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6c531a1e0 0x55b6c5329120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.047 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.040+0000 7fc7d1c00640 1 -- 172.21.15.3:0/2349322268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6c531ab00 msgr2=0x55b6c5329660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:17:55.047 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.040+0000 7fc7d1c00640 1 --2- 172.21.15.3:0/2349322268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6c531ab00 0x55b6c5329660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.047 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.040+0000 7fc7d1c00640 1 -- 172.21.15.3:0/2349322268 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6c53173e0 con 0x55b6c53253a0 2024-09-19T06:17:55.047 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.040+0000 7fc7cbe00640 1 --2- 172.21.15.3:0/2349322268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6c531ab00 0x55b6c5329660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:17:55.047 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.041+0000 7fc7d1c00640 1 --2- 172.21.15.3:0/2349322268 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c53253a0 0x55b6c5329ba0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40058f0 tx=0x7fc7c40989b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c91f8ae14739d50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:17:55.047 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.041+0000 7fc7b2a00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:17:55.047 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.041+0000 7fc7b2a00640 1 -- 172.21.15.3:0/2349322268 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4082050 con 0x55b6c53253a0 2024-09-19T06:17:55.047 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.041+0000 7fc7b2a00640 1 -- 172.21.15.3:0/2349322268 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fc7c409bd70 con 0x55b6c53253a0 2024-09-19T06:17:55.048 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.041+0000 7fc7d69e5740 1 -- 172.21.15.3:0/2349322268 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7c40b5070 con 0x55b6c53253a0 2024-09-19T06:17:55.048 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.041+0000 7fc7b2a00640 1 -- 172.21.15.3:0/2349322268 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc7c4098460 con 0x55b6c53253a0 2024-09-19T06:17:55.048 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.041+0000 7fc7d69e5740 10 client.16746 fetch_fsmap learned FSMap version 29 2024-09-19T06:17:55.048 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.041+0000 7fc7d69e5740 1 -- 172.21.15.3:0/2349322268 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b6c5311d60 con 0x55b6c53253a0 2024-09-19T06:17:55.048 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.041+0000 7fc7b2a00640 1 -- 172.21.15.3:0/2349322268 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7c40b5070 con 0x55b6c53253a0 2024-09-19T06:17:55.048 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.041+0000 7fc7b2a00640 1 -- 172.21.15.3:0/2349322268 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc7c407c070 con 0x55b6c53253a0 2024-09-19T06:17:55.048 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.042+0000 7fc7d69e5740 10 client.16746 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:17:55.048 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.042+0000 7fc7d69e5740 10 client.16746 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:17:55.048 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.042+0000 7fc7d69e5740 20 client.16746 populate_metadata read hostname 'smithi003' 2024-09-19T06:17:55.048 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.042+0000 7fc7d69e5740 1 --2- 172.21.15.3:0/2349322268 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b6c53a01c0 0x55b6c53a25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:17:55.048 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.042+0000 7fc7d69e5740 4 client.16746 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:17:55.048 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.042+0000 7fc7d69e5740 1 -- 172.21.15.3:0/2349322268 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b6c5287b80 con 0x55b6c53a01c0 2024-09-19T06:17:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.042+0000 7fc7d1200640 1 --2- 172.21.15.3:0/2349322268 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b6c53a01c0 0x55b6c53a25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:17:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.042+0000 7fc7d1200640 1 --2- 172.21.15.3:0/2349322268 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b6c53a01c0 0x55b6c53a25b0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e80322aeabab1210 server_cookie=87eeb897f3797aea in_seq=0 out_seq=0 2024-09-19T06:17:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.042+0000 7fc7b2a00640 10 client.16746 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:55.058 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.056+0000 7fc7b2a00640 1 -- 172.21.15.3:0/2349322268 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b6c5287b80 con 0x55b6c53a01c0 2024-09-19T06:17:55.058 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.056+0000 7fc7b2a00640 10 client.16746 handle_command_reply: tid=0 2024-09-19T06:17:55.058 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.056+0000 7fc7d69e5740 1 client.16746 shutdown 2024-09-19T06:17:55.058 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.056+0000 7fc7d69e5740 1 -- 172.21.15.3:0/2349322268 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c53253a0 msgr2=0x55b6c5329ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:55.058 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.056+0000 7fc7d69e5740 1 --2- 172.21.15.3:0/2349322268 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c53253a0 0x55b6c5329ba0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40058f0 tx=0x7fc7c40989b0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.056+0000 7fc7d69e5740 1 -- 172.21.15.3:0/2349322268 shutdown_connections 2024-09-19T06:17:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.056+0000 7fc7d69e5740 1 --2- 172.21.15.3:0/2349322268 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b6c53a01c0 0x55b6c53a25b0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.056+0000 7fc7d69e5740 1 --2- 172.21.15.3:0/2349322268 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6c53253a0 0x55b6c5329ba0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.056+0000 7fc7d69e5740 1 --2- 172.21.15.3:0/2349322268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6c531ab00 0x55b6c5329660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.056+0000 7fc7d69e5740 1 --2- 172.21.15.3:0/2349322268 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6c531a1e0 0x55b6c5329120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.056+0000 7fc7b2a00640 0 client.16746 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:17:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.056+0000 7fc7d69e5740 1 -- 172.21.15.3:0/2349322268 >> 172.21.15.3:0/2349322268 conn(0x55b6c5316750 msgr2=0x55b6c5323950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.056+0000 7fc7d69e5740 1 -- 172.21.15.3:0/2349322268 shutdown_connections 2024-09-19T06:17:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.056+0000 7fc7d69e5740 1 -- 172.21.15.3:0/2349322268 wait complete. 2024-09-19T06:17:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.057+0000 7fc7d69e5740 20 client.16746 trim_cache size 0 max 16384 2024-09-19T06:17:55.059 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:17:55.060 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:17:55.060 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:17:55.060 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:17:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.057+0000 7fc7d3c00640 1 -- 172.21.15.3:0/2902158636 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc7b40a33b0 msgr2=0x7fc7b40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.057+0000 7fc7d3c00640 1 --2- 172.21.15.3:0/2902158636 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc7b40a33b0 0x7fc7b40a5870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0009640 tx=0x7fc7c0005f90 comp rx=0 tx=0).stop 2024-09-19T06:17:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.057+0000 7fc7d3c00640 1 -- 172.21.15.3:0/2902158636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7cc107ad0 msgr2=0x7fc7cc19ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:17:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.057+0000 7fc7d3c00640 1 --2- 172.21.15.3:0/2902158636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7cc107ad0 0x7fc7cc19ef30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009fd0 tx=0x7fc7c400ef10 comp rx=0 tx=0).stop 2024-09-19T06:17:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.057+0000 7fc7d3c00640 1 -- 172.21.15.3:0/2902158636 shutdown_connections 2024-09-19T06:17:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.057+0000 7fc7d3c00640 1 --2- 172.21.15.3:0/2902158636 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc7b40a33b0 0x7fc7b40a5870 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.057+0000 7fc7d3c00640 1 --2- 172.21.15.3:0/2902158636 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc7cc107ad0 0x7fc7cc19ef30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.057+0000 7fc7d3c00640 1 --2- 172.21.15.3:0/2902158636 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc7cc102460 0x7fc7cc19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.057+0000 7fc7d3c00640 1 --2- 172.21.15.3:0/2902158636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7cc101ac0 0x7fc7cc19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:17:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.057+0000 7fc7d3c00640 1 -- 172.21.15.3:0/2902158636 >> 172.21.15.3:0/2902158636 conn(0x7fc7cc0fd7e0 msgr2=0x7fc7cc10d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:17:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.057+0000 7fc7d3c00640 1 -- 172.21.15.3:0/2902158636 shutdown_connections 2024-09-19T06:17:55.061 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:17:55.057+0000 7fc7d3c00640 1 -- 172.21.15.3:0/2902158636 wait complete. 2024-09-19T06:17:55.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:55 smithi003 ceph-mon[30893]: pgmap v169: 97 pgs: 97 active+clean; 4.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 49 KiB/s wr, 22 op/s 2024-09-19T06:17:55.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:55 smithi003 ceph-mon[30893]: scrub summary: idle 2024-09-19T06:17:55.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:55 smithi071 ceph-mon[35662]: pgmap v169: 97 pgs: 97 active+clean; 4.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 49 KiB/s wr, 22 op/s 2024-09-19T06:17:55.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:55 smithi071 ceph-mon[35662]: scrub summary: idle 2024-09-19T06:17:56.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:55 smithi059 ceph-mon[35138]: pgmap v169: 97 pgs: 97 active+clean; 4.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 49 KiB/s wr, 22 op/s 2024-09-19T06:17:56.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:55 smithi059 ceph-mon[35138]: scrub summary: idle 2024-09-19T06:17:57.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:57 smithi003 ceph-mon[30893]: pgmap v170: 97 pgs: 97 active+clean; 4.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-19T06:17:57.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:57 smithi071 ceph-mon[35662]: pgmap v170: 97 pgs: 97 active+clean; 4.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-19T06:17:58.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:57 smithi059 ceph-mon[35138]: pgmap v170: 97 pgs: 97 active+clean; 4.1 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-19T06:17:59.560 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.560 INFO:tasks.workunit.client.0.smithi003.stdout:189/600: open fd = 3 2024-09-19T06:17:59.560 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.560 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.560 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.561 INFO:tasks.workunit.client.0.smithi003.stdout:190/600: open fd = 3 2024-09-19T06:17:59.561 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.561 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.561 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.561 INFO:tasks.workunit.client.0.smithi003.stdout:191/600: open fd = 3 2024-09-19T06:17:59.561 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.561 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.561 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.561 INFO:tasks.workunit.client.0.smithi003.stdout:192/600: open fd = 3 2024-09-19T06:17:59.561 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.561 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.562 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.562 INFO:tasks.workunit.client.0.smithi003.stdout:193/600: open fd = 3 2024-09-19T06:17:59.562 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.562 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.562 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.562 INFO:tasks.workunit.client.0.smithi003.stdout:194/600: open fd = 3 2024-09-19T06:17:59.562 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.562 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.562 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.562 INFO:tasks.workunit.client.0.smithi003.stdout:195/600: open fd = 3 2024-09-19T06:17:59.562 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.562 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.563 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.563 INFO:tasks.workunit.client.0.smithi003.stdout:196/600: open fd = 3 2024-09-19T06:17:59.563 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.563 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.563 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.563 INFO:tasks.workunit.client.0.smithi003.stdout:197/600: open fd = 3 2024-09-19T06:17:59.564 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.564 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.564 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.564 INFO:tasks.workunit.client.0.smithi003.stdout:198/600: open fd = 3 2024-09-19T06:17:59.564 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.564 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.564 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.564 INFO:tasks.workunit.client.0.smithi003.stdout:199/600: open fd = 3 2024-09-19T06:17:59.564 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.564 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.565 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.565 INFO:tasks.workunit.client.0.smithi003.stdout:200/600: open fd = 3 2024-09-19T06:17:59.565 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.565 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.565 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.565 INFO:tasks.workunit.client.0.smithi003.stdout:201/600: open fd = 3 2024-09-19T06:17:59.565 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.565 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.565 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.565 INFO:tasks.workunit.client.0.smithi003.stdout:202/600: open fd = 3 2024-09-19T06:17:59.565 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.565 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.565 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.566 INFO:tasks.workunit.client.0.smithi003.stdout:203/600: open fd = 3 2024-09-19T06:17:59.566 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.566 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.566 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.566 INFO:tasks.workunit.client.0.smithi003.stdout:204/600: open fd = 3 2024-09-19T06:17:59.566 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.566 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.566 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.566 INFO:tasks.workunit.client.0.smithi003.stdout:205/600: open fd = 3 2024-09-19T06:17:59.566 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.566 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.566 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.566 INFO:tasks.workunit.client.0.smithi003.stdout:206/600: open fd = 3 2024-09-19T06:17:59.567 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.567 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.567 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.567 INFO:tasks.workunit.client.0.smithi003.stdout:207/600: open fd = 3 2024-09-19T06:17:59.567 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.567 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.567 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.567 INFO:tasks.workunit.client.0.smithi003.stdout:208/600: open fd = 3 2024-09-19T06:17:59.567 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.567 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.567 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.567 INFO:tasks.workunit.client.0.smithi003.stdout:209/600: open fd = 3 2024-09-19T06:17:59.567 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.567 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.568 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.568 INFO:tasks.workunit.client.0.smithi003.stdout:210/600: open fd = 3 2024-09-19T06:17:59.568 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.568 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.568 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.568 INFO:tasks.workunit.client.0.smithi003.stdout:211/600: open fd = 3 2024-09-19T06:17:59.568 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.568 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.568 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.568 INFO:tasks.workunit.client.0.smithi003.stdout:212/600: open fd = 3 2024-09-19T06:17:59.568 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.568 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.568 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.569 INFO:tasks.workunit.client.0.smithi003.stdout:213/600: open fd = 3 2024-09-19T06:17:59.569 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.569 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.569 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.569 INFO:tasks.workunit.client.0.smithi003.stdout:214/600: open fd = 3 2024-09-19T06:17:59.569 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.569 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.569 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.569 INFO:tasks.workunit.client.0.smithi003.stdout:215/600: open fd = 3 2024-09-19T06:17:59.569 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.570 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.570 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.570 INFO:tasks.workunit.client.0.smithi003.stdout:216/600: open fd = 3 2024-09-19T06:17:59.570 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.570 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.570 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.570 INFO:tasks.workunit.client.0.smithi003.stdout:217/600: open fd = 3 2024-09-19T06:17:59.570 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.570 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.570 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.570 INFO:tasks.workunit.client.0.smithi003.stdout:218/600: open fd = 3 2024-09-19T06:17:59.570 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.571 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.571 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.571 INFO:tasks.workunit.client.0.smithi003.stdout:219/600: open fd = 3 2024-09-19T06:17:59.571 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.571 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.571 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.571 INFO:tasks.workunit.client.0.smithi003.stdout:220/600: open fd = 3 2024-09-19T06:17:59.571 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.571 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.571 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.571 INFO:tasks.workunit.client.0.smithi003.stdout:221/600: open fd = 3 2024-09-19T06:17:59.571 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.572 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.572 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.572 INFO:tasks.workunit.client.0.smithi003.stdout:222/600: open fd = 3 2024-09-19T06:17:59.572 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.572 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.572 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.572 INFO:tasks.workunit.client.0.smithi003.stdout:223/600: open fd = 3 2024-09-19T06:17:59.572 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.572 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.572 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.572 INFO:tasks.workunit.client.0.smithi003.stdout:224/600: open fd = 3 2024-09-19T06:17:59.572 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.572 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.572 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.573 INFO:tasks.workunit.client.0.smithi003.stdout:225/600: open fd = 3 2024-09-19T06:17:59.573 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.573 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.573 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.573 INFO:tasks.workunit.client.0.smithi003.stdout:226/600: open fd = 3 2024-09-19T06:17:59.573 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.573 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.573 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.573 INFO:tasks.workunit.client.0.smithi003.stdout:227/600: open fd = 3 2024-09-19T06:17:59.573 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.573 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.573 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.574 INFO:tasks.workunit.client.0.smithi003.stdout:228/600: open fd = 3 2024-09-19T06:17:59.574 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.574 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.574 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.574 INFO:tasks.workunit.client.0.smithi003.stdout:229/600: open fd = 3 2024-09-19T06:17:59.574 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.574 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.574 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.574 INFO:tasks.workunit.client.0.smithi003.stdout:230/600: open fd = 3 2024-09-19T06:17:59.575 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.575 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.575 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.575 INFO:tasks.workunit.client.0.smithi003.stdout:231/600: open fd = 3 2024-09-19T06:17:59.575 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.575 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.575 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.575 INFO:tasks.workunit.client.0.smithi003.stdout:232/600: open fd = 3 2024-09-19T06:17:59.575 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.575 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.575 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.575 INFO:tasks.workunit.client.0.smithi003.stdout:233/600: open fd = 3 2024-09-19T06:17:59.575 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.575 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.576 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.576 INFO:tasks.workunit.client.0.smithi003.stdout:234/600: open fd = 3 2024-09-19T06:17:59.576 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.576 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.576 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.576 INFO:tasks.workunit.client.0.smithi003.stdout:235/600: open fd = 3 2024-09-19T06:17:59.576 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.576 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.576 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.576 INFO:tasks.workunit.client.0.smithi003.stdout:236/600: open fd = 3 2024-09-19T06:17:59.576 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.576 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.576 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.577 INFO:tasks.workunit.client.0.smithi003.stdout:237/600: open fd = 3 2024-09-19T06:17:59.577 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.577 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.577 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.577 INFO:tasks.workunit.client.0.smithi003.stdout:238/600: open fd = 3 2024-09-19T06:17:59.577 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.577 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.577 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.577 INFO:tasks.workunit.client.0.smithi003.stdout:239/600: open fd = 3 2024-09-19T06:17:59.577 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.577 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.577 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.577 INFO:tasks.workunit.client.0.smithi003.stdout:240/600: open fd = 3 2024-09-19T06:17:59.577 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.578 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.578 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.578 INFO:tasks.workunit.client.0.smithi003.stdout:241/600: open fd = 3 2024-09-19T06:17:59.578 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.578 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.578 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.578 INFO:tasks.workunit.client.0.smithi003.stdout:242/600: open fd = 3 2024-09-19T06:17:59.578 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.578 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.578 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.578 INFO:tasks.workunit.client.0.smithi003.stdout:243/600: open fd = 3 2024-09-19T06:17:59.578 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.578 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.578 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.579 INFO:tasks.workunit.client.0.smithi003.stdout:244/600: open fd = 3 2024-09-19T06:17:59.579 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.579 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.579 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.579 INFO:tasks.workunit.client.0.smithi003.stdout:245/600: open fd = 3 2024-09-19T06:17:59.579 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.579 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.579 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.579 INFO:tasks.workunit.client.0.smithi003.stdout:246/600: open fd = 3 2024-09-19T06:17:59.579 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.579 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.579 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.580 INFO:tasks.workunit.client.0.smithi003.stdout:247/600: open fd = 3 2024-09-19T06:17:59.580 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.580 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.580 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.580 INFO:tasks.workunit.client.0.smithi003.stdout:248/600: open fd = 3 2024-09-19T06:17:59.580 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.580 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.580 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.580 INFO:tasks.workunit.client.0.smithi003.stdout:249/600: open fd = 3 2024-09-19T06:17:59.581 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.581 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.581 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:17:59.581 INFO:tasks.workunit.client.0.smithi003.stdout:250/600: open fd = 3 2024-09-19T06:17:59.581 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.581 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:17:59.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:17:59 smithi003 ceph-mon[30893]: pgmap v171: 97 pgs: 97 active+clean; 4.3 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 48 KiB/s wr, 22 op/s 2024-09-19T06:17:59.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:17:59 smithi071 ceph-mon[35662]: pgmap v171: 97 pgs: 97 active+clean; 4.3 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 48 KiB/s wr, 22 op/s 2024-09-19T06:18:00.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:17:59 smithi059 ceph-mon[35138]: pgmap v171: 97 pgs: 97 active+clean; 4.3 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 48 KiB/s wr, 22 op/s 2024-09-19T06:18:01.842 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:01 smithi003 ceph-mon[30893]: pgmap v172: 97 pgs: 97 active+clean; 4.3 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 KiB/s wr, 16 op/s 2024-09-19T06:18:02.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:01 smithi059 ceph-mon[35138]: pgmap v172: 97 pgs: 97 active+clean; 4.3 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 KiB/s wr, 16 op/s 2024-09-19T06:18:02.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:01 smithi071 ceph-mon[35662]: pgmap v172: 97 pgs: 97 active+clean; 4.3 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 KiB/s wr, 16 op/s 2024-09-19T06:18:04.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:03 smithi059 ceph-mon[35138]: pgmap v173: 97 pgs: 97 active+clean; 4.3 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 KiB/s wr, 16 op/s 2024-09-19T06:18:04.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:03 smithi003 ceph-mon[30893]: pgmap v173: 97 pgs: 97 active+clean; 4.3 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 KiB/s wr, 16 op/s 2024-09-19T06:18:04.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:03 smithi071 ceph-mon[35662]: pgmap v173: 97 pgs: 97 active+clean; 4.3 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 KiB/s wr, 16 op/s 2024-09-19T06:18:06.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:05 smithi059 ceph-mon[35138]: pgmap v174: 97 pgs: 97 active+clean; 4.4 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 74 KiB/s wr, 38 op/s 2024-09-19T06:18:06.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:05 smithi003 ceph-mon[30893]: pgmap v174: 97 pgs: 97 active+clean; 4.4 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 74 KiB/s wr, 38 op/s 2024-09-19T06:18:06.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:05 smithi071 ceph-mon[35662]: pgmap v174: 97 pgs: 97 active+clean; 4.4 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 74 KiB/s wr, 38 op/s 2024-09-19T06:18:08.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:07 smithi059 ceph-mon[35138]: pgmap v175: 97 pgs: 97 active+clean; 4.4 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 59 KiB/s wr, 30 op/s 2024-09-19T06:18:08.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:07 smithi003 ceph-mon[30893]: pgmap v175: 97 pgs: 97 active+clean; 4.4 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 59 KiB/s wr, 30 op/s 2024-09-19T06:18:08.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:07 smithi071 ceph-mon[35662]: pgmap v175: 97 pgs: 97 active+clean; 4.4 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 59 KiB/s wr, 30 op/s 2024-09-19T06:18:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.186+0000 7f3cbbc00640 1 -- 172.21.15.3:0/2294411646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cb410a2b0 msgr2=0x7f3cb4110c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.186+0000 7f3cbbc00640 1 --2- 172.21.15.3:0/2294411646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cb410a2b0 0x7f3cb4110c00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3cac009ca0 tx=0x7f3cac02a950 comp rx=0 tx=0).stop 2024-09-19T06:18:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.187+0000 7f3cbbc00640 1 -- 172.21.15.3:0/2294411646 shutdown_connections 2024-09-19T06:18:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.187+0000 7f3cbbc00640 1 --2- 172.21.15.3:0/2294411646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cb410a2b0 0x7f3cb4110c00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.187+0000 7f3cbbc00640 1 --2- 172.21.15.3:0/2294411646 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cb4100700 0x7f3cb4109b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.187+0000 7f3cbbc00640 1 --2- 172.21.15.3:0/2294411646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb40ffde0 0x7f3cb41001c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.187+0000 7f3cbbc00640 1 -- 172.21.15.3:0/2294411646 >> 172.21.15.3:0/2294411646 conn(0x7f3cb40fba00 msgr2=0x7f3cb40fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.187+0000 7f3cbbc00640 1 -- 172.21.15.3:0/2294411646 shutdown_connections 2024-09-19T06:18:08.189 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.187+0000 7f3cbbc00640 1 -- 172.21.15.3:0/2294411646 wait complete. 2024-09-19T06:18:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.188+0000 7f3cbbc00640 1 Processor -- start 2024-09-19T06:18:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.188+0000 7f3cbbc00640 1 -- start start 2024-09-19T06:18:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.188+0000 7f3cbbc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb40ffde0 0x7f3cb419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.188+0000 7f3cbbc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cb4100700 0x7f3cb419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.188+0000 7f3cbbc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cb410a2b0 0x7f3cb419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.188+0000 7f3cbbc00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb4114080 con 0x7f3cb410a2b0 2024-09-19T06:18:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.188+0000 7f3cbbc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb4113f00 con 0x7f3cb4100700 2024-09-19T06:18:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.188+0000 7f3cbbc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb4114200 con 0x7f3cb40ffde0 2024-09-19T06:18:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.189+0000 7f3cb9c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cb410a2b0 0x7f3cb419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.189+0000 7f3cb9200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb40ffde0 0x7f3cb419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.189+0000 7f3cb3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cb4100700 0x7f3cb419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.189+0000 7f3cb9c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cb410a2b0 0x7f3cb419ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37708/0 (socket says 172.21.15.3:37708) 2024-09-19T06:18:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.189+0000 7f3cb9c00640 1 -- 172.21.15.3:0/3152105057 learned_addr learned my addr 172.21.15.3:0/3152105057 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.189+0000 7f3cb9c00640 1 -- 172.21.15.3:0/3152105057 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb40ffde0 msgr2=0x7f3cb419a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.189+0000 7f3cb9c00640 1 --2- 172.21.15.3:0/3152105057 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb40ffde0 0x7f3cb419a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.189+0000 7f3cb9c00640 1 -- 172.21.15.3:0/3152105057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cb4100700 msgr2=0x7f3cb419ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.189+0000 7f3cb9c00640 1 --2- 172.21.15.3:0/3152105057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cb4100700 0x7f3cb419ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.189+0000 7f3cb9c00640 1 -- 172.21.15.3:0/3152105057 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb419f640 con 0x7f3cb410a2b0 2024-09-19T06:18:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.189+0000 7f3cb9200640 1 --2- 172.21.15.3:0/3152105057 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb40ffde0 0x7f3cb419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.189+0000 7f3cb9c00640 1 --2- 172.21.15.3:0/3152105057 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cb410a2b0 0x7f3cb419ef10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3cac004af0 tx=0x7f3cac02f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.190+0000 7f3cb1600640 1 -- 172.21.15.3:0/3152105057 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac034040 con 0x7f3cb410a2b0 2024-09-19T06:18:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.190+0000 7f3cbbc00640 1 -- 172.21.15.3:0/3152105057 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb419f8d0 con 0x7f3cb410a2b0 2024-09-19T06:18:08.194 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.190+0000 7f3cb1600640 1 -- 172.21.15.3:0/3152105057 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3cac030920 con 0x7f3cb410a2b0 2024-09-19T06:18:08.194 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.190+0000 7f3cbbc00640 1 -- 172.21.15.3:0/3152105057 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb41a71c0 con 0x7f3cb410a2b0 2024-09-19T06:18:08.194 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.190+0000 7f3cb1600640 1 -- 172.21.15.3:0/3152105057 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac0045d0 con 0x7f3cb410a2b0 2024-09-19T06:18:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.193+0000 7f3cb1600640 1 -- 172.21.15.3:0/3152105057 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f3cac037020 con 0x7f3cb410a2b0 2024-09-19T06:18:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.193+0000 7f3cbec39740 1 Processor -- start 2024-09-19T06:18:08.195 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.193+0000 7f3cbec39740 1 -- start start 2024-09-19T06:18:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.193+0000 7f3cbec39740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc4f1e0 0x5564edc4f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.193+0000 7f3cbec39740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc4fb00 0x5564edc59e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.193+0000 7f3cbec39740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5564edc5a3a0 0x5564edc5c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.193+0000 7f3cbec39740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5564edbb5100 con 0x5564edc4f1e0 2024-09-19T06:18:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.193+0000 7f3cbec39740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5564edb5d1b0 con 0x5564edc5a3a0 2024-09-19T06:18:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.193+0000 7f3cbec39740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5564edbb10c0 con 0x5564edc4fb00 2024-09-19T06:18:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.194+0000 7f3cb3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc4f1e0 0x5564edc4f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.194+0000 7f3cb9200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc4fb00 0x5564edc59e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.194+0000 7f3cb9200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc4fb00 0x5564edc59e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:41888/0 (socket says 172.21.15.3:41888) 2024-09-19T06:18:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.194+0000 7f3cb3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc4f1e0 0x5564edc4f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37712/0 (socket says 172.21.15.3:37712) 2024-09-19T06:18:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.194+0000 7f3cb9200640 1 -- 172.21.15.3:0/464847838 learned_addr learned my addr 172.21.15.3:0/464847838 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.194+0000 7f3cb3e00640 1 --2- 172.21.15.3:0/464847838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5564edc5a3a0 0x5564edc5c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.194+0000 7f3cb9200640 1 -- 172.21.15.3:0/464847838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5564edc5a3a0 msgr2=0x5564edc5c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.194+0000 7f3cb9200640 1 --2- 172.21.15.3:0/464847838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5564edc5a3a0 0x5564edc5c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.194+0000 7f3cb9200640 1 -- 172.21.15.3:0/464847838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc4f1e0 msgr2=0x5564edc4f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.194+0000 7f3cb9200640 1 --2- 172.21.15.3:0/464847838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc4f1e0 0x5564edc4f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.194+0000 7f3cb9200640 1 -- 172.21.15.3:0/464847838 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564ed8c8210 con 0x5564edc4fb00 2024-09-19T06:18:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.194+0000 7f3cb3e00640 1 --2- 172.21.15.3:0/464847838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc4f1e0 0x5564edc4f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.195+0000 7f3cb9200640 1 --2- 172.21.15.3:0/464847838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc4fb00 0x5564edc59e60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80115f0 tx=0x7f3ca8011ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb5438e95f7b510d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.195+0000 7f3cb1600640 1 --2- 172.21.15.3:0/3152105057 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3c9c0a33b0 0x7f3c9c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.195+0000 7f3ca6000640 1 -- 172.21.15.3:0/464847838 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca801e070 con 0x5564edc4fb00 2024-09-19T06:18:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.195+0000 7f3ca6000640 1 -- 172.21.15.3:0/464847838 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ca800fb20 con 0x5564edc4fb00 2024-09-19T06:18:08.198 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.195+0000 7f3ca6000640 1 -- 172.21.15.3:0/464847838 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8019bf0 con 0x5564edc4fb00 2024-09-19T06:18:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.195+0000 7f3cb1600640 1 -- 172.21.15.3:0/3152105057 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f3cac0f0990 con 0x7f3cb410a2b0 2024-09-19T06:18:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.195+0000 7f3cb3e00640 1 --2- 172.21.15.3:0/3152105057 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3c9c0a33b0 0x7f3c9c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.196+0000 7f3cb3e00640 1 --2- 172.21.15.3:0/3152105057 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3c9c0a33b0 0x7f3c9c0a5870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x5564edc4cad0 tx=0x7f3ca0009770 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.196+0000 7f3cbec39740 1 -- 172.21.15.3:0/464847838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc4fb00 msgr2=0x5564edc59e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.196+0000 7f3cbec39740 1 --2- 172.21.15.3:0/464847838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc4fb00 0x5564edc59e60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80115f0 tx=0x7f3ca8011ab0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.196+0000 7f3cbec39740 1 -- 172.21.15.3:0/464847838 shutdown_connections 2024-09-19T06:18:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.196+0000 7f3cbec39740 1 --2- 172.21.15.3:0/464847838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5564edc5a3a0 0x5564edc5c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.196+0000 7f3cbec39740 1 --2- 172.21.15.3:0/464847838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc4fb00 0x5564edc59e60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.196+0000 7f3cbec39740 1 --2- 172.21.15.3:0/464847838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc4f1e0 0x5564edc4f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.196+0000 7f3cbec39740 1 -- 172.21.15.3:0/464847838 >> 172.21.15.3:0/464847838 conn(0x5564edc4b750 msgr2=0x5564edc4bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.196+0000 7f3cbec39740 1 -- 172.21.15.3:0/464847838 shutdown_connections 2024-09-19T06:18:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.196+0000 7f3cbec39740 1 -- 172.21.15.3:0/464847838 wait complete. 2024-09-19T06:18:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.196+0000 7f3cbec39740 1 -- start start 2024-09-19T06:18:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.197+0000 7f3cbec39740 1 Processor -- start 2024-09-19T06:18:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.197+0000 7f3cbec39740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5564edc4f1e0 0x5564edc573a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.197+0000 7f3cbec39740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc4fb00 0x5564edc578e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.197+0000 7f3cbec39740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc5a3a0 0x5564edc57e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.197+0000 7f3cbec39740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5564edc5cf70 con 0x5564edc5a3a0 2024-09-19T06:18:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.197+0000 7f3cbec39740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5564edb3e090 con 0x5564edc4f1e0 2024-09-19T06:18:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.197+0000 7f3cbec39740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5564edc5d0f0 con 0x5564edc4fb00 2024-09-19T06:18:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.197+0000 7f3cbec39740 10 client.0 _ll_register_callbacks cb 0x5564edb92f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.197+0000 7f3cb9200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5564edc4f1e0 0x5564edc573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.197+0000 7f3cb9200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5564edc4f1e0 0x5564edc573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55022/0 (socket says 172.21.15.3:55022) 2024-09-19T06:18:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.197+0000 7f3cb9200640 1 -- 172.21.15.3:0/1820210127 learned_addr learned my addr 172.21.15.3:0/1820210127 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.197+0000 7f3cb9c00640 1 --2- 172.21.15.3:0/1820210127 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc5a3a0 0x5564edc57e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.197+0000 7f3cb3e00640 1 --2- 172.21.15.3:0/1820210127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc4fb00 0x5564edc578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.198+0000 7f3cb9200640 1 -- 172.21.15.3:0/1820210127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc4fb00 msgr2=0x5564edc578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.198+0000 7f3cb9200640 1 --2- 172.21.15.3:0/1820210127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc4fb00 0x5564edc578e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.198+0000 7f3cb9200640 1 -- 172.21.15.3:0/1820210127 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc5a3a0 msgr2=0x5564edc57e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.198+0000 7f3cb9200640 1 --2- 172.21.15.3:0/1820210127 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc5a3a0 0x5564edc57e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.198+0000 7f3cb9200640 1 -- 172.21.15.3:0/1820210127 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564ed994620 con 0x5564edc4f1e0 2024-09-19T06:18:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.198+0000 7f3cb3e00640 1 --2- 172.21.15.3:0/1820210127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc4fb00 0x5564edc578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.198+0000 7f3cb9200640 1 --2- 172.21.15.3:0/1820210127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5564edc4f1e0 0x5564edc573a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800f870 tx=0x7f3ca800f8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa63e33ede2ba92e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.198+0000 7f3c9aa00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:18:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.198+0000 7f3c9aa00640 1 -- 172.21.15.3:0/1820210127 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8027060 con 0x5564edc4f1e0 2024-09-19T06:18:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.198+0000 7f3cbec39740 1 -- 172.21.15.3:0/1820210127 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ca800fb20 con 0x5564edc4f1e0 2024-09-19T06:18:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.198+0000 7f3c9aa00640 1 -- 172.21.15.3:0/1820210127 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f3ca8004030 con 0x5564edc4f1e0 2024-09-19T06:18:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.198+0000 7f3c9aa00640 1 -- 172.21.15.3:0/1820210127 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3ca801e040 con 0x5564edc4f1e0 2024-09-19T06:18:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.198+0000 7f3cbec39740 10 client.26801 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.198+0000 7f3cbec39740 1 -- 172.21.15.3:0/1820210127 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5564edc68c80 con 0x5564edc4f1e0 2024-09-19T06:18:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.199+0000 7f3c9aa00640 1 -- 172.21.15.3:0/1820210127 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ca800fb20 con 0x5564edc4f1e0 2024-09-19T06:18:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.199+0000 7f3c9aa00640 1 -- 172.21.15.3:0/1820210127 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3ca80035f0 con 0x5564edc4f1e0 2024-09-19T06:18:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.199+0000 7f3cbec39740 10 client.26801 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.199+0000 7f3cbec39740 10 client.26801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.199+0000 7f3cbec39740 20 client.26801 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.199+0000 7f3cbec39740 1 --2- 172.21.15.3:0/1820210127 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5564edc6a140 0x5564edc6c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.206 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.199+0000 7f3cbec39740 4 client.26801 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:08.206 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.199+0000 7f3cbec39740 1 -- 172.21.15.3:0/1820210127 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564edbc2830 con 0x5564edc6a140 2024-09-19T06:18:08.206 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.199+0000 7f3cb3e00640 1 --2- 172.21.15.3:0/1820210127 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5564edc6a140 0x5564edc6c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.206 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.200+0000 7f3cb3e00640 1 --2- 172.21.15.3:0/1820210127 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5564edc6a140 0x5564edc6c530 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee84496aa3d27f14 server_cookie=cb418f19cd30cad9 in_seq=0 out_seq=0 2024-09-19T06:18:08.206 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.200+0000 7f3c9aa00640 10 client.26801 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.201+0000 7f3c9aa00640 1 -- 172.21.15.3:0/1820210127 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5564edbc2830 con 0x5564edc6a140 2024-09-19T06:18:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.201+0000 7f3c9aa00640 10 client.26801 handle_command_reply: tid=0 2024-09-19T06:18:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.201+0000 7f3cbec39740 1 client.26801 shutdown 2024-09-19T06:18:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.201+0000 7f3cbec39740 1 -- 172.21.15.3:0/1820210127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5564edc4f1e0 msgr2=0x5564edc573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.201+0000 7f3cbec39740 1 --2- 172.21.15.3:0/1820210127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5564edc4f1e0 0x5564edc573a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800f870 tx=0x7f3ca800f8a0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.201+0000 7f3cbec39740 1 -- 172.21.15.3:0/1820210127 shutdown_connections 2024-09-19T06:18:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.201+0000 7f3cbec39740 1 --2- 172.21.15.3:0/1820210127 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5564edc6a140 0x5564edc6c530 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.201+0000 7f3cbec39740 1 --2- 172.21.15.3:0/1820210127 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc5a3a0 0x5564edc57e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.201+0000 7f3cbec39740 1 --2- 172.21.15.3:0/1820210127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc4fb00 0x5564edc578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.201+0000 7f3cbec39740 1 --2- 172.21.15.3:0/1820210127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5564edc4f1e0 0x5564edc573a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.201+0000 7f3c9aa00640 0 client.26801 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.201+0000 7f3cbec39740 1 -- 172.21.15.3:0/1820210127 >> 172.21.15.3:0/1820210127 conn(0x5564edc4b750 msgr2=0x5564edc514b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.201+0000 7f3cbec39740 1 -- 172.21.15.3:0/1820210127 shutdown_connections 2024-09-19T06:18:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.201+0000 7f3cbec39740 1 -- 172.21.15.3:0/1820210127 wait complete. 2024-09-19T06:18:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.201+0000 7f3cbec39740 20 client.26801 trim_cache size 0 max 16384 2024-09-19T06:18:08.219 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.217+0000 7f3cbec39740 1 Processor -- start 2024-09-19T06:18:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.217+0000 7f3cbec39740 1 -- start start 2024-09-19T06:18:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.217+0000 7f3cbec39740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5564edc4f1e0 0x5564edc71d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.217+0000 7f3cbec39740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc4fb00 0x5564edc72290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.217+0000 7f3cbec39740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc5a3a0 0x5564edc50c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.217+0000 7f3cbec39740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb41afa40 con 0x5564edc4fb00 2024-09-19T06:18:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.217+0000 7f3cbec39740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb41b1580 con 0x5564edc4f1e0 2024-09-19T06:18:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.217+0000 7f3cbec39740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb41b0110 con 0x5564edc5a3a0 2024-09-19T06:18:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.217+0000 7f3cb3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc4fb00 0x5564edc72290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.217+0000 7f3cb3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc4fb00 0x5564edc72290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37728/0 (socket says 172.21.15.3:37728) 2024-09-19T06:18:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.217+0000 7f3cb3e00640 1 -- 172.21.15.3:0/397843036 learned_addr learned my addr 172.21.15.3:0/397843036 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.218+0000 7f3cb9200640 1 --2- 172.21.15.3:0/397843036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5564edc4f1e0 0x5564edc71d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.218+0000 7f3cb9c00640 1 --2- 172.21.15.3:0/397843036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc5a3a0 0x5564edc50c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.220 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.218+0000 7f3cb3e00640 1 -- 172.21.15.3:0/397843036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc5a3a0 msgr2=0x5564edc50c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.218+0000 7f3cb3e00640 1 --2- 172.21.15.3:0/397843036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc5a3a0 0x5564edc50c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.218+0000 7f3cb3e00640 1 -- 172.21.15.3:0/397843036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5564edc4f1e0 msgr2=0x5564edc71d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.218+0000 7f3cb3e00640 1 --2- 172.21.15.3:0/397843036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5564edc4f1e0 0x5564edc71d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.218+0000 7f3cb3e00640 1 -- 172.21.15.3:0/397843036 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564edc46d60 con 0x5564edc4fb00 2024-09-19T06:18:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.218+0000 7f3cb9200640 1 --2- 172.21.15.3:0/397843036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5564edc4f1e0 0x5564edc71d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:08.221 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.218+0000 7f3cb3e00640 1 --2- 172.21.15.3:0/397843036 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc4fb00 0x5564edc72290 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00097e0 tx=0x7f3ca0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a07472e3fbe18d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:08.224 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.218+0000 7f3ca5600640 1 -- 172.21.15.3:0/397843036 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca000f7c0 con 0x5564edc4fb00 2024-09-19T06:18:08.224 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.218+0000 7f3ca5600640 1 -- 172.21.15.3:0/397843036 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ca000fe40 con 0x5564edc4fb00 2024-09-19T06:18:08.224 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.218+0000 7f3ca5600640 1 -- 172.21.15.3:0/397843036 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca002c5d0 con 0x5564edc4fb00 2024-09-19T06:18:08.224 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.219+0000 7f3cbec39740 1 -- 172.21.15.3:0/397843036 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc4fb00 msgr2=0x5564edc72290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:08.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.219+0000 7f3cbec39740 1 --2- 172.21.15.3:0/397843036 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc4fb00 0x5564edc72290 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f3ca00097e0 tx=0x7f3ca0015000 comp rx=0 tx=0).stop 2024-09-19T06:18:08.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.219+0000 7f3cbec39740 1 -- 172.21.15.3:0/397843036 shutdown_connections 2024-09-19T06:18:08.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.219+0000 7f3cbec39740 1 --2- 172.21.15.3:0/397843036 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc5a3a0 0x5564edc50c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.219+0000 7f3cbec39740 1 --2- 172.21.15.3:0/397843036 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc4fb00 0x5564edc72290 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.219+0000 7f3cbec39740 1 --2- 172.21.15.3:0/397843036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5564edc4f1e0 0x5564edc71d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.219+0000 7f3cbec39740 1 -- 172.21.15.3:0/397843036 >> 172.21.15.3:0/397843036 conn(0x5564edc4b750 msgr2=0x5564edc55c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:08.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.219+0000 7f3cbec39740 1 -- 172.21.15.3:0/397843036 shutdown_connections 2024-09-19T06:18:08.227 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.219+0000 7f3cbec39740 1 -- 172.21.15.3:0/397843036 wait complete. 2024-09-19T06:18:08.227 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.219+0000 7f3cbec39740 1 -- start start 2024-09-19T06:18:08.228 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.220+0000 7f3cbec39740 1 Processor -- start 2024-09-19T06:18:08.228 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.220+0000 7f3cbec39740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc4f1e0 0x5564edc62340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.228 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.220+0000 7f3cbec39740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc4fb00 0x5564edc62880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.228 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.220+0000 7f3cbec39740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5564edc5a3a0 0x5564edc539c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.228 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.220+0000 7f3cbec39740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb41b0eb0 con 0x5564edc4fb00 2024-09-19T06:18:08.228 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.220+0000 7f3cbec39740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb41b07e0 con 0x5564edc5a3a0 2024-09-19T06:18:08.228 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.220+0000 7f3cbec39740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb41ada20 con 0x5564edc4f1e0 2024-09-19T06:18:08.228 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.220+0000 7f3cbec39740 10 client.0 _ll_register_callbacks cb 0x7f3ca801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:08.228 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.220+0000 7f3cb9200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc4f1e0 0x5564edc62340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.228 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.220+0000 7f3cb3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc4fb00 0x5564edc62880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.228 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.220+0000 7f3cb9200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc4f1e0 0x5564edc62340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:41918/0 (socket says 172.21.15.3:41918) 2024-09-19T06:18:08.228 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.220+0000 7f3cb9200640 1 -- 172.21.15.3:0/3911331568 learned_addr learned my addr 172.21.15.3:0/3911331568 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:08.229 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.220+0000 7f3cb9c00640 1 --2- 172.21.15.3:0/3911331568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5564edc5a3a0 0x5564edc539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.229 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.221+0000 7f3cb9200640 1 -- 172.21.15.3:0/3911331568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5564edc5a3a0 msgr2=0x5564edc539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:08.229 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.221+0000 7f3cb9200640 1 --2- 172.21.15.3:0/3911331568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5564edc5a3a0 0x5564edc539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.229 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.221+0000 7f3cb9200640 1 -- 172.21.15.3:0/3911331568 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc4fb00 msgr2=0x5564edc62880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:08.229 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.221+0000 7f3cb9200640 1 --2- 172.21.15.3:0/3911331568 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc4fb00 0x5564edc62880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.229 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.221+0000 7f3cb9200640 1 -- 172.21.15.3:0/3911331568 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564edc53f00 con 0x5564edc4f1e0 2024-09-19T06:18:08.229 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.221+0000 7f3cb3e00640 1 --2- 172.21.15.3:0/3911331568 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc4fb00 0x5564edc62880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:08.229 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.221+0000 7f3cb9200640 1 --2- 172.21.15.3:0/3911331568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc4f1e0 0x5564edc62340 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8009250 tx=0x7f3ca800f3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a7193f6838dae98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:08.229 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.221+0000 7f3c9aa00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:18:08.229 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.221+0000 7f3c9aa00640 1 -- 172.21.15.3:0/3911331568 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca80052c0 con 0x5564edc4f1e0 2024-09-19T06:18:08.229 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.221+0000 7f3cbec39740 1 -- 172.21.15.3:0/3911331568 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ca000fe40 con 0x5564edc4f1e0 2024-09-19T06:18:08.229 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.221+0000 7f3c9aa00640 1 -- 172.21.15.3:0/3911331568 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f3ca8005460 con 0x5564edc4f1e0 2024-09-19T06:18:08.229 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.222+0000 7f3c9aa00640 1 -- 172.21.15.3:0/3911331568 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3ca803c050 con 0x5564edc4f1e0 2024-09-19T06:18:08.229 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.222+0000 7f3cbec39740 10 client.26809 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:08.230 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.222+0000 7f3cbec39740 1 -- 172.21.15.3:0/3911331568 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5564edcd44d0 con 0x5564edc4f1e0 2024-09-19T06:18:08.230 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.222+0000 7f3c9aa00640 1 -- 172.21.15.3:0/3911331568 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ca000fe40 con 0x5564edc4f1e0 2024-09-19T06:18:08.230 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.222+0000 7f3c9aa00640 1 -- 172.21.15.3:0/3911331568 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3ca8033070 con 0x5564edc4f1e0 2024-09-19T06:18:08.230 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.222+0000 7f3cbec39740 10 client.26809 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:08.230 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.222+0000 7f3cbec39740 10 client.26809 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:08.230 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.222+0000 7f3cbec39740 20 client.26809 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:08.230 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.222+0000 7f3cbec39740 1 --2- 172.21.15.3:0/3911331568 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5564edcd4b30 0x5564edcd6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:08.230 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.222+0000 7f3cbec39740 4 client.26809 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:18:08.230 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.222+0000 7f3cbec39740 1 -- 172.21.15.3:0/3911331568 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5564edbbcb80 con 0x5564edcd4b30 2024-09-19T06:18:08.230 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.223+0000 7f3cb3e00640 1 --2- 172.21.15.3:0/3911331568 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5564edcd4b30 0x5564edcd6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:08.231 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.223+0000 7f3cb3e00640 1 --2- 172.21.15.3:0/3911331568 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5564edcd4b30 0x5564edcd6f20 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef7f135941a5ea86 server_cookie=6f1d2462880ca631 in_seq=0 out_seq=0 2024-09-19T06:18:08.231 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.223+0000 7f3c9aa00640 10 client.26809 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:08.241 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.238+0000 7f3c9aa00640 1 -- 172.21.15.3:0/3911331568 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5564edbbcb80 con 0x5564edcd4b30 2024-09-19T06:18:08.241 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.238+0000 7f3c9aa00640 10 client.26809 handle_command_reply: tid=0 2024-09-19T06:18:08.241 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.238+0000 7f3cbec39740 1 client.26809 shutdown 2024-09-19T06:18:08.241 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.238+0000 7f3cbec39740 1 -- 172.21.15.3:0/3911331568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc4f1e0 msgr2=0x5564edc62340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:08.241 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.238+0000 7f3cbec39740 1 --2- 172.21.15.3:0/3911331568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc4f1e0 0x5564edc62340 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8009250 tx=0x7f3ca800f3c0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.241 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.239+0000 7f3cbec39740 1 -- 172.21.15.3:0/3911331568 shutdown_connections 2024-09-19T06:18:08.241 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.239+0000 7f3cbec39740 1 --2- 172.21.15.3:0/3911331568 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5564edcd4b30 0x5564edcd6f20 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.241 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.239+0000 7f3cbec39740 1 --2- 172.21.15.3:0/3911331568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5564edc5a3a0 0x5564edc539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.241 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.239+0000 7f3cbec39740 1 --2- 172.21.15.3:0/3911331568 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5564edc4fb00 0x5564edc62880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.241 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.239+0000 7f3cbec39740 1 --2- 172.21.15.3:0/3911331568 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5564edc4f1e0 0x5564edc62340 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.241 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.239+0000 7f3c9aa00640 0 client.26809 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.239+0000 7f3cbec39740 1 -- 172.21.15.3:0/3911331568 >> 172.21.15.3:0/3911331568 conn(0x5564edc4b750 msgr2=0x5564edc4a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.239+0000 7f3cbec39740 1 -- 172.21.15.3:0/3911331568 shutdown_connections 2024-09-19T06:18:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.239+0000 7f3cbec39740 1 -- 172.21.15.3:0/3911331568 wait complete. 2024-09-19T06:18:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.239+0000 7f3cbec39740 20 client.26809 trim_cache size 0 max 16384 2024-09-19T06:18:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:18:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:18:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:18:08.242 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:18:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.239+0000 7f3cbbc00640 1 -- 172.21.15.3:0/3152105057 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3c9c0a33b0 msgr2=0x7f3c9c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.239+0000 7f3cbbc00640 1 --2- 172.21.15.3:0/3152105057 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3c9c0a33b0 0x7f3c9c0a5870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x5564edc4cad0 tx=0x7f3ca0009770 comp rx=0 tx=0).stop 2024-09-19T06:18:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.239+0000 7f3cbbc00640 1 -- 172.21.15.3:0/3152105057 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cb410a2b0 msgr2=0x7f3cb419ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.239+0000 7f3cbbc00640 1 --2- 172.21.15.3:0/3152105057 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cb410a2b0 0x7f3cb419ef10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3cac004af0 tx=0x7f3cac02f3a0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.240+0000 7f3cbbc00640 1 -- 172.21.15.3:0/3152105057 shutdown_connections 2024-09-19T06:18:08.243 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.240+0000 7f3cbbc00640 1 --2- 172.21.15.3:0/3152105057 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3c9c0a33b0 0x7f3c9c0a5870 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.244 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.240+0000 7f3cbbc00640 1 --2- 172.21.15.3:0/3152105057 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3cb410a2b0 0x7f3cb419ef10 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.244 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.240+0000 7f3cbbc00640 1 --2- 172.21.15.3:0/3152105057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cb4100700 0x7f3cb419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.244 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.240+0000 7f3cbbc00640 1 --2- 172.21.15.3:0/3152105057 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3cb40ffde0 0x7f3cb419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:08.244 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.240+0000 7f3cbbc00640 1 -- 172.21.15.3:0/3152105057 >> 172.21.15.3:0/3152105057 conn(0x7f3cb40fba00 msgr2=0x7f3cb4108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:08.244 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.240+0000 7f3cbbc00640 1 -- 172.21.15.3:0/3152105057 shutdown_connections 2024-09-19T06:18:08.244 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:08.240+0000 7f3cbbc00640 1 -- 172.21.15.3:0/3152105057 wait complete. 2024-09-19T06:18:10.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:09 smithi059 ceph-mon[35138]: pgmap v176: 97 pgs: 97 active+clean; 4.7 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 83 KiB/s wr, 39 op/s 2024-09-19T06:18:10.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:09 smithi003 ceph-mon[30893]: pgmap v176: 97 pgs: 97 active+clean; 4.7 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 83 KiB/s wr, 39 op/s 2024-09-19T06:18:10.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:09 smithi071 ceph-mon[35662]: pgmap v176: 97 pgs: 97 active+clean; 4.7 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 83 KiB/s wr, 39 op/s 2024-09-19T06:18:12.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:11 smithi059 ceph-mon[35138]: pgmap v177: 97 pgs: 97 active+clean; 4.7 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 63 KiB/s wr, 30 op/s 2024-09-19T06:18:12.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:11 smithi003 ceph-mon[30893]: pgmap v177: 97 pgs: 97 active+clean; 4.7 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 63 KiB/s wr, 30 op/s 2024-09-19T06:18:12.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:11 smithi071 ceph-mon[35662]: pgmap v177: 97 pgs: 97 active+clean; 4.7 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 63 KiB/s wr, 30 op/s 2024-09-19T06:18:14.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:13 smithi059 ceph-mon[35138]: pgmap v178: 97 pgs: 97 active+clean; 4.7 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 63 KiB/s wr, 30 op/s 2024-09-19T06:18:14.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:13 smithi003 ceph-mon[30893]: pgmap v178: 97 pgs: 97 active+clean; 4.7 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 63 KiB/s wr, 30 op/s 2024-09-19T06:18:14.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:13 smithi071 ceph-mon[35662]: pgmap v178: 97 pgs: 97 active+clean; 4.7 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 63 KiB/s wr, 30 op/s 2024-09-19T06:18:16.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:15 smithi059 ceph-mon[35138]: pgmap v179: 97 pgs: 97 active+clean; 4.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 79 KiB/s wr, 37 op/s 2024-09-19T06:18:16.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:15 smithi003 ceph-mon[30893]: pgmap v179: 97 pgs: 97 active+clean; 4.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 79 KiB/s wr, 37 op/s 2024-09-19T06:18:16.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:15 smithi071 ceph-mon[35662]: pgmap v179: 97 pgs: 97 active+clean; 4.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 79 KiB/s wr, 37 op/s 2024-09-19T06:18:17.888 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:17 smithi071 ceph-mon[35662]: pgmap v180: 97 pgs: 97 active+clean; 4.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-19T06:18:18.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:17 smithi059 ceph-mon[35138]: pgmap v180: 97 pgs: 97 active+clean; 4.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-19T06:18:18.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:17 smithi003 ceph-mon[30893]: pgmap v180: 97 pgs: 97 active+clean; 4.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-19T06:18:20.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:19 smithi059 ceph-mon[35138]: pgmap v181: 97 pgs: 97 active+clean; 5.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 22 op/s 2024-09-19T06:18:20.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:19 smithi003 ceph-mon[30893]: pgmap v181: 97 pgs: 97 active+clean; 5.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 22 op/s 2024-09-19T06:18:20.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:19 smithi071 ceph-mon[35662]: pgmap v181: 97 pgs: 97 active+clean; 5.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 22 op/s 2024-09-19T06:18:21.373 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.368+0000 7f547c200640 1 -- 172.21.15.3:0/2390274072 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f54741048f0 msgr2=0x7f5474108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:21.373 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.368+0000 7f547c200640 1 --2- 172.21.15.3:0/2390274072 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f54741048f0 0x7f5474108930 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5460009900 tx=0x7f546002a410 comp rx=0 tx=0).stop 2024-09-19T06:18:21.373 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.368+0000 7f547c200640 1 -- 172.21.15.3:0/2390274072 shutdown_connections 2024-09-19T06:18:21.373 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.368+0000 7f547c200640 1 --2- 172.21.15.3:0/2390274072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5474109090 0x7f5474110be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.374 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.368+0000 7f547c200640 1 --2- 172.21.15.3:0/2390274072 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f54741048f0 0x7f5474108930 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.374 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.368+0000 7f547c200640 1 --2- 172.21.15.3:0/2390274072 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5474103f40 0x7f5474104320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.374 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.368+0000 7f547c200640 1 -- 172.21.15.3:0/2390274072 >> 172.21.15.3:0/2390274072 conn(0x7f54740ff970 msgr2=0x7f5474101d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:21.374 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.368+0000 7f547c200640 1 -- 172.21.15.3:0/2390274072 shutdown_connections 2024-09-19T06:18:21.374 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.368+0000 7f547c200640 1 -- 172.21.15.3:0/2390274072 wait complete. 2024-09-19T06:18:21.374 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.369+0000 7f547c200640 1 Processor -- start 2024-09-19T06:18:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.369+0000 7f547c200640 1 -- start start 2024-09-19T06:18:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.369+0000 7f547c200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5474103f40 0x7f547419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.369+0000 7f547c200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5474109090 0x7f547419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.369+0000 7f547c200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f547419ef00 0x7f547419f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:21.375 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.369+0000 7f547c200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5474114100 con 0x7f5474109090 2024-09-19T06:18:21.376 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.369+0000 7f547c200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5474113f80 con 0x7f5474103f40 2024-09-19T06:18:21.376 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.369+0000 7f547c200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5474114280 con 0x7f547419ef00 2024-09-19T06:18:21.376 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.370+0000 7f5479800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5474103f40 0x7f547419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:21.376 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.370+0000 7f5478e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5474109090 0x7f547419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:21.377 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.370+0000 7f5479800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5474103f40 0x7f547419a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:59900/0 (socket says 172.21.15.3:59900) 2024-09-19T06:18:21.377 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.370+0000 7f5479800640 1 -- 172.21.15.3:0/1614780646 learned_addr learned my addr 172.21.15.3:0/1614780646 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:21.377 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.370+0000 7f547a200640 1 --2- 172.21.15.3:0/1614780646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f547419ef00 0x7f547419f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:21.377 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.370+0000 7f5479800640 1 -- 172.21.15.3:0/1614780646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f547419ef00 msgr2=0x7f547419f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:21.377 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.370+0000 7f5479800640 1 --2- 172.21.15.3:0/1614780646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f547419ef00 0x7f547419f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.377 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.370+0000 7f5479800640 1 -- 172.21.15.3:0/1614780646 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5474109090 msgr2=0x7f547419ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:21.377 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.370+0000 7f5479800640 1 --2- 172.21.15.3:0/1614780646 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5474109090 0x7f547419ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.378 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.370+0000 7f5479800640 1 -- 172.21.15.3:0/1614780646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547419f9f0 con 0x7f5474103f40 2024-09-19T06:18:21.378 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.370+0000 7f5479800640 1 --2- 172.21.15.3:0/1614780646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5474103f40 0x7f547419a640 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f546800e9f0 tx=0x7f546800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:21.378 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.371+0000 7f5472000640 1 -- 172.21.15.3:0/1614780646 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546800cd80 con 0x7f5474103f40 2024-09-19T06:18:21.378 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.371+0000 7f547c200640 1 -- 172.21.15.3:0/1614780646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f547419fce0 con 0x7f5474103f40 2024-09-19T06:18:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.371+0000 7f5472000640 1 -- 172.21.15.3:0/1614780646 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5468005500 con 0x7f5474103f40 2024-09-19T06:18:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.371+0000 7f5472000640 1 -- 172.21.15.3:0/1614780646 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5468010690 con 0x7f5474103f40 2024-09-19T06:18:21.379 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.371+0000 7f547c200640 1 -- 172.21.15.3:0/1614780646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54741a74a0 con 0x7f5474103f40 2024-09-19T06:18:21.392 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.374+0000 7f547f0a5740 1 Processor -- start 2024-09-19T06:18:21.392 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.374+0000 7f547f0a5740 1 -- start start 2024-09-19T06:18:21.392 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.374+0000 7f547f0a5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b44a1e0 0x55865b44a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:21.392 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.374+0000 7f547f0a5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55865b44ab00 0x55865b454e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:21.392 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.374+0000 7f547f0a5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55865b4553a0 0x55865b457790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:21.393 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.374+0000 7f547f0a5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55865b3b0100 con 0x55865b44a1e0 2024-09-19T06:18:21.393 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.374+0000 7f547f0a5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55865b3581b0 con 0x55865b4553a0 2024-09-19T06:18:21.393 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.374+0000 7f547f0a5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55865b3ac0c0 con 0x55865b44ab00 2024-09-19T06:18:21.393 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.374+0000 7f5472000640 1 -- 172.21.15.3:0/1614780646 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f54680046c0 con 0x7f5474103f40 2024-09-19T06:18:21.393 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.374+0000 7f547a200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b44a1e0 0x55865b44a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:21.393 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.374+0000 7f547a200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b44a1e0 0x55865b44a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56838/0 (socket says 172.21.15.3:56838) 2024-09-19T06:18:21.394 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.374+0000 7f547a200640 1 -- 172.21.15.3:0/861099959 learned_addr learned my addr 172.21.15.3:0/861099959 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:21.394 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.375+0000 7f5478e00640 1 --2- 172.21.15.3:0/861099959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55865b4553a0 0x55865b457790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:21.394 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.375+0000 7f5479800640 1 --2- 172.21.15.3:0/861099959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55865b44ab00 0x55865b454e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:21.394 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.375+0000 7f547a200640 1 -- 172.21.15.3:0/861099959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55865b44ab00 msgr2=0x55865b454e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:21.395 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.375+0000 7f547a200640 1 --2- 172.21.15.3:0/861099959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55865b44ab00 0x55865b454e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.395 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.375+0000 7f547a200640 1 -- 172.21.15.3:0/861099959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55865b4553a0 msgr2=0x55865b457790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:21.395 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.375+0000 7f547a200640 1 --2- 172.21.15.3:0/861099959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55865b4553a0 0x55865b457790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.395 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.375+0000 7f547a200640 1 -- 172.21.15.3:0/861099959 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55865b0c3210 con 0x55865b44a1e0 2024-09-19T06:18:21.395 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.375+0000 7f547a200640 1 --2- 172.21.15.3:0/861099959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b44a1e0 0x55865b44a5c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f546c009f50 tx=0x7f546c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc4f5695a85b539 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:21.395 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.375+0000 7f5466a00640 1 -- 172.21.15.3:0/861099959 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c004d20 con 0x55865b44a1e0 2024-09-19T06:18:21.396 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.376+0000 7f5466a00640 1 -- 172.21.15.3:0/861099959 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f546c004050 con 0x55865b44a1e0 2024-09-19T06:18:21.396 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.376+0000 7f5466a00640 1 -- 172.21.15.3:0/861099959 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c005220 con 0x55865b44a1e0 2024-09-19T06:18:21.396 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.376+0000 7f5472000640 1 --2- 172.21.15.3:0/1614780646 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f545c0a33b0 0x7f545c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:21.396 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.376+0000 7f547f0a5740 1 -- 172.21.15.3:0/861099959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b44a1e0 msgr2=0x55865b44a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:21.396 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.376+0000 7f547f0a5740 1 --2- 172.21.15.3:0/861099959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b44a1e0 0x55865b44a5c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f546c009f50 tx=0x7f546c0118d0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.376+0000 7f5472000640 1 -- 172.21.15.3:0/1614780646 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f54680d0160 con 0x7f5474103f40 2024-09-19T06:18:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.376+0000 7f5479800640 1 --2- 172.21.15.3:0/1614780646 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f545c0a33b0 0x7f545c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.376+0000 7f547f0a5740 1 -- 172.21.15.3:0/861099959 shutdown_connections 2024-09-19T06:18:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.376+0000 7f547f0a5740 1 --2- 172.21.15.3:0/861099959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55865b4553a0 0x55865b457790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.376+0000 7f547f0a5740 1 --2- 172.21.15.3:0/861099959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55865b44ab00 0x55865b454e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.397 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.376+0000 7f547f0a5740 1 --2- 172.21.15.3:0/861099959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b44a1e0 0x55865b44a5c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.398 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.376+0000 7f547f0a5740 1 -- 172.21.15.3:0/861099959 >> 172.21.15.3:0/861099959 conn(0x55865b446750 msgr2=0x55865b446b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:21.398 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.376+0000 7f547f0a5740 1 -- 172.21.15.3:0/861099959 shutdown_connections 2024-09-19T06:18:21.398 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.376+0000 7f547f0a5740 1 -- 172.21.15.3:0/861099959 wait complete. 2024-09-19T06:18:21.398 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.377+0000 7f547f0a5740 1 -- start start 2024-09-19T06:18:21.398 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.377+0000 7f5479800640 1 --2- 172.21.15.3:0/1614780646 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f545c0a33b0 0x7f545c0a5870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55865b4475b0 tx=0x7f5468098040 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:21.398 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.377+0000 7f547f0a5740 1 Processor -- start 2024-09-19T06:18:21.399 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.377+0000 7f547f0a5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55865b44a1e0 0x55865b4522c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:21.399 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.378+0000 7f547f0a5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55865b44ab00 0x55865b452800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:21.399 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.378+0000 7f547f0a5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b4553a0 0x55865b452d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:21.399 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.378+0000 7f547f0a5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55865b457f70 con 0x55865b4553a0 2024-09-19T06:18:21.399 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.378+0000 7f547f0a5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55865b339090 con 0x55865b44a1e0 2024-09-19T06:18:21.399 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.378+0000 7f547f0a5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55865b4580f0 con 0x55865b44ab00 2024-09-19T06:18:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.378+0000 7f547f0a5740 10 client.0 _ll_register_callbacks cb 0x55865b38df30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.378+0000 7f547a200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b4553a0 0x55865b452d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.378+0000 7f5478e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55865b44ab00 0x55865b452800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.378+0000 7f547a200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b4553a0 0x55865b452d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56846/0 (socket says 172.21.15.3:56846) 2024-09-19T06:18:21.400 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.378+0000 7f547a200640 1 -- 172.21.15.3:0/299478873 learned_addr learned my addr 172.21.15.3:0/299478873 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.378+0000 7f547a200640 1 --2- 172.21.15.3:0/299478873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55865b44a1e0 0x55865b4522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.378+0000 7f5478e00640 1 -- 172.21.15.3:0/299478873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55865b44a1e0 msgr2=0x55865b4522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.379+0000 7f5478e00640 1 --2- 172.21.15.3:0/299478873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55865b44a1e0 0x55865b4522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.379+0000 7f5478e00640 1 -- 172.21.15.3:0/299478873 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b4553a0 msgr2=0x55865b452d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.379+0000 7f5478e00640 1 --2- 172.21.15.3:0/299478873 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b4553a0 0x55865b452d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.401 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.379+0000 7f5478e00640 1 -- 172.21.15.3:0/299478873 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55865b18f620 con 0x55865b44ab00 2024-09-19T06:18:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.379+0000 7f5478e00640 1 --2- 172.21.15.3:0/299478873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55865b44ab00 0x55865b452800 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f546002a930 tx=0x7f54600043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6925e992cb7d2ff2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.379+0000 7f545b400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:18:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.379+0000 7f545b400640 1 -- 172.21.15.3:0/299478873 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5460035040 con 0x55865b44ab00 2024-09-19T06:18:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.379+0000 7f547f0a5740 1 -- 172.21.15.3:0/299478873 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f546c004050 con 0x55865b44ab00 2024-09-19T06:18:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.379+0000 7f545b400640 1 -- 172.21.15.3:0/299478873 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f5460005450 con 0x55865b44ab00 2024-09-19T06:18:21.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.379+0000 7f545b400640 1 -- 172.21.15.3:0/299478873 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5460005650 con 0x55865b44ab00 2024-09-19T06:18:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.379+0000 7f547f0a5740 10 client.26821 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.379+0000 7f547f0a5740 1 -- 172.21.15.3:0/299478873 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55865b463b80 con 0x55865b44ab00 2024-09-19T06:18:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.380+0000 7f545b400640 1 -- 172.21.15.3:0/299478873 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f546c004050 con 0x55865b44ab00 2024-09-19T06:18:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.380+0000 7f545b400640 1 -- 172.21.15.3:0/299478873 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f5460003950 con 0x55865b44ab00 2024-09-19T06:18:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.380+0000 7f547f0a5740 10 client.26821 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:21.403 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.380+0000 7f547f0a5740 10 client.26821 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.380+0000 7f547f0a5740 20 client.26821 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.380+0000 7f547f0a5740 1 --2- 172.21.15.3:0/299478873 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55865b464ff0 0x55865b4673e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.380+0000 7f547f0a5740 4 client.26821 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.380+0000 7f547f0a5740 1 -- 172.21.15.3:0/299478873 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55865b3bd830 con 0x55865b464ff0 2024-09-19T06:18:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.380+0000 7f547a200640 1 --2- 172.21.15.3:0/299478873 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55865b464ff0 0x55865b4673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:21.404 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.381+0000 7f547a200640 1 --2- 172.21.15.3:0/299478873 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55865b464ff0 0x55865b4673e0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2e0701fee433bdd server_cookie=c858520e1b88400a in_seq=0 out_seq=0 2024-09-19T06:18:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.381+0000 7f545b400640 10 client.26821 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.382+0000 7f545b400640 1 -- 172.21.15.3:0/299478873 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55865b3bd830 con 0x55865b464ff0 2024-09-19T06:18:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.382+0000 7f545b400640 10 client.26821 handle_command_reply: tid=0 2024-09-19T06:18:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.382+0000 7f547f0a5740 1 client.26821 shutdown 2024-09-19T06:18:21.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.382+0000 7f547f0a5740 1 -- 172.21.15.3:0/299478873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55865b44ab00 msgr2=0x55865b452800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.382+0000 7f547f0a5740 1 --2- 172.21.15.3:0/299478873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55865b44ab00 0x55865b452800 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f546002a930 tx=0x7f54600043b0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.382+0000 7f547f0a5740 1 -- 172.21.15.3:0/299478873 shutdown_connections 2024-09-19T06:18:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.382+0000 7f547f0a5740 1 --2- 172.21.15.3:0/299478873 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55865b464ff0 0x55865b4673e0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.382+0000 7f547f0a5740 1 --2- 172.21.15.3:0/299478873 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b4553a0 0x55865b452d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.382+0000 7f547f0a5740 1 --2- 172.21.15.3:0/299478873 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55865b44ab00 0x55865b452800 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.382+0000 7f545b400640 0 client.26821 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.382+0000 7f547f0a5740 1 --2- 172.21.15.3:0/299478873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55865b44a1e0 0x55865b4522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.382+0000 7f547f0a5740 1 -- 172.21.15.3:0/299478873 >> 172.21.15.3:0/299478873 conn(0x55865b446750 msgr2=0x55865b44c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.383+0000 7f547f0a5740 1 -- 172.21.15.3:0/299478873 shutdown_connections 2024-09-19T06:18:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.383+0000 7f547f0a5740 1 -- 172.21.15.3:0/299478873 wait complete. 2024-09-19T06:18:21.407 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.383+0000 7f547f0a5740 20 client.26821 trim_cache size 0 max 16384 2024-09-19T06:18:21.416 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.398+0000 7f547f0a5740 1 Processor -- start 2024-09-19T06:18:21.417 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.398+0000 7f547f0a5740 1 -- start start 2024-09-19T06:18:21.417 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.398+0000 7f547f0a5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b44a1e0 0x55865b4416a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:21.417 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.398+0000 7f547f0a5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55865b44ab00 0x55865b452b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:21.417 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.398+0000 7f547f0a5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55865b4553a0 0x55865b46cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:21.417 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.398+0000 7f547f0a5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f54741afb40 con 0x55865b44a1e0 2024-09-19T06:18:21.418 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.398+0000 7f547f0a5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f54741b1680 con 0x55865b44ab00 2024-09-19T06:18:21.418 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.398+0000 7f547f0a5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f54741b0210 con 0x55865b4553a0 2024-09-19T06:18:21.418 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.399+0000 7f547a200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b44a1e0 0x55865b4416a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:21.418 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.399+0000 7f547a200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b44a1e0 0x55865b4416a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56858/0 (socket says 172.21.15.3:56858) 2024-09-19T06:18:21.418 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.399+0000 7f547a200640 1 -- 172.21.15.3:0/1123826601 learned_addr learned my addr 172.21.15.3:0/1123826601 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:21.418 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.399+0000 7f5478e00640 1 --2- 172.21.15.3:0/1123826601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55865b44ab00 0x55865b452b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:21.419 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.399+0000 7f547a200640 1 --2- 172.21.15.3:0/1123826601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55865b4553a0 0x55865b46cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:21.419 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.399+0000 7f547a200640 1 -- 172.21.15.3:0/1123826601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55865b4553a0 msgr2=0x55865b46cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:21.419 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.399+0000 7f547a200640 1 --2- 172.21.15.3:0/1123826601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55865b4553a0 0x55865b46cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.419 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.399+0000 7f547a200640 1 -- 172.21.15.3:0/1123826601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55865b44ab00 msgr2=0x55865b452b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:21.419 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.399+0000 7f547a200640 1 --2- 172.21.15.3:0/1123826601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55865b44ab00 0x55865b452b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.419 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.399+0000 7f547a200640 1 -- 172.21.15.3:0/1123826601 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55865b451250 con 0x55865b44a1e0 2024-09-19T06:18:21.420 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.399+0000 7f547a200640 1 --2- 172.21.15.3:0/1123826601 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b44a1e0 0x55865b4416a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f546c006010 tx=0x7f546c009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aebda5f30ec011ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:21.420 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.400+0000 7f5466000640 1 -- 172.21.15.3:0/1123826601 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c004370 con 0x55865b44a1e0 2024-09-19T06:18:21.420 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.400+0000 7f5466000640 1 -- 172.21.15.3:0/1123826601 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f546c004510 con 0x55865b44a1e0 2024-09-19T06:18:21.420 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.400+0000 7f5466000640 1 -- 172.21.15.3:0/1123826601 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c028ac0 con 0x55865b44a1e0 2024-09-19T06:18:21.420 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.400+0000 7f547f0a5740 1 -- 172.21.15.3:0/1123826601 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b44a1e0 msgr2=0x55865b4416a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:21.420 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.400+0000 7f547f0a5740 1 --2- 172.21.15.3:0/1123826601 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b44a1e0 0x55865b4416a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f546c006010 tx=0x7f546c009500 comp rx=0 tx=0).stop 2024-09-19T06:18:21.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.400+0000 7f547f0a5740 1 -- 172.21.15.3:0/1123826601 shutdown_connections 2024-09-19T06:18:21.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.400+0000 7f547f0a5740 1 --2- 172.21.15.3:0/1123826601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55865b4553a0 0x55865b46cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.400+0000 7f547f0a5740 1 --2- 172.21.15.3:0/1123826601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55865b44ab00 0x55865b452b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.400+0000 7f547f0a5740 1 --2- 172.21.15.3:0/1123826601 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b44a1e0 0x55865b4416a0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.400+0000 7f547f0a5740 1 -- 172.21.15.3:0/1123826601 >> 172.21.15.3:0/1123826601 conn(0x55865b446750 msgr2=0x55865b454230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:21.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.400+0000 7f547f0a5740 1 -- 172.21.15.3:0/1123826601 shutdown_connections 2024-09-19T06:18:21.422 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.400+0000 7f547f0a5740 1 -- 172.21.15.3:0/1123826601 wait complete. 2024-09-19T06:18:21.422 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.401+0000 7f547f0a5740 1 -- start start 2024-09-19T06:18:21.422 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.401+0000 7f547f0a5740 1 Processor -- start 2024-09-19T06:18:21.422 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.401+0000 7f547f0a5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55865b44a1e0 0x55865b45d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:21.422 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.401+0000 7f547f0a5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b44ab00 0x55865b458c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:21.422 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.401+0000 7f547f0a5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55865b4553a0 0x55865b4591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:21.422 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.401+0000 7f547f0a5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f54741b0fb0 con 0x55865b44ab00 2024-09-19T06:18:21.422 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.401+0000 7f547f0a5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f54741b08e0 con 0x55865b4553a0 2024-09-19T06:18:21.423 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.401+0000 7f547f0a5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f54741adb20 con 0x55865b44a1e0 2024-09-19T06:18:21.423 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.401+0000 7f547f0a5740 10 client.0 _ll_register_callbacks cb 0x7f5460009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:21.423 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.402+0000 7f5478e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b44ab00 0x55865b458c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:21.423 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.402+0000 7f547a200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55865b44a1e0 0x55865b45d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:21.423 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.402+0000 7f5478e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b44ab00 0x55865b458c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56864/0 (socket says 172.21.15.3:56864) 2024-09-19T06:18:21.423 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.402+0000 7f5478e00640 1 -- 172.21.15.3:0/2971904406 learned_addr learned my addr 172.21.15.3:0/2971904406 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:21.424 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.402+0000 7f547a200640 1 --2- 172.21.15.3:0/2971904406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55865b4553a0 0x55865b4591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:21.424 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.402+0000 7f5478e00640 1 -- 172.21.15.3:0/2971904406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55865b44a1e0 msgr2=0x55865b45d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:21.424 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.402+0000 7f5478e00640 1 --2- 172.21.15.3:0/2971904406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55865b44a1e0 0x55865b45d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.424 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.402+0000 7f5478e00640 1 -- 172.21.15.3:0/2971904406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55865b4553a0 msgr2=0x55865b4591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:21.424 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.402+0000 7f5478e00640 1 --2- 172.21.15.3:0/2971904406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55865b4553a0 0x55865b4591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.425 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.402+0000 7f5478e00640 1 -- 172.21.15.3:0/2971904406 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55865b459890 con 0x55865b44ab00 2024-09-19T06:18:21.425 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.402+0000 7f547a200640 1 --2- 172.21.15.3:0/2971904406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55865b4553a0 0x55865b4591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:18:21.425 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.402+0000 7f5478e00640 1 --2- 172.21.15.3:0/2971904406 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b44ab00 0x55865b458c60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f546002aa00 tx=0x7f54600098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31543bbfdced3b66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:21.425 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.402+0000 7f545b400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:18:21.425 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.403+0000 7f545b400640 1 -- 172.21.15.3:0/2971904406 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5460035070 con 0x55865b44ab00 2024-09-19T06:18:21.425 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.403+0000 7f545b400640 1 -- 172.21.15.3:0/2971904406 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f54600037f0 con 0x55865b44ab00 2024-09-19T06:18:21.425 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.403+0000 7f547f0a5740 1 -- 172.21.15.3:0/2971904406 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f546c004510 con 0x55865b44ab00 2024-09-19T06:18:21.426 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.403+0000 7f545b400640 1 -- 172.21.15.3:0/2971904406 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5460005d50 con 0x55865b44ab00 2024-09-19T06:18:21.426 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.403+0000 7f547f0a5740 10 client.16782 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:21.426 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.403+0000 7f547f0a5740 1 -- 172.21.15.3:0/2971904406 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55865b4cfae0 con 0x55865b44ab00 2024-09-19T06:18:21.426 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.403+0000 7f545b400640 1 -- 172.21.15.3:0/2971904406 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f546c004510 con 0x55865b44ab00 2024-09-19T06:18:21.426 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.403+0000 7f545b400640 1 -- 172.21.15.3:0/2971904406 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f5460004750 con 0x55865b44ab00 2024-09-19T06:18:21.427 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.403+0000 7f547f0a5740 10 client.16782 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:21.427 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.403+0000 7f547f0a5740 10 client.16782 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:21.427 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.403+0000 7f547f0a5740 20 client.16782 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:21.427 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.403+0000 7f547f0a5740 1 --2- 172.21.15.3:0/2971904406 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55865b4d0260 0x55865b4d2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:21.427 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.403+0000 7f547f0a5740 4 client.16782 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:18:21.428 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.403+0000 7f547f0a5740 1 -- 172.21.15.3:0/2971904406 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55865b441d80 con 0x55865b4d0260 2024-09-19T06:18:21.428 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.404+0000 7f547a200640 1 --2- 172.21.15.3:0/2971904406 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55865b4d0260 0x55865b4d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:21.428 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.404+0000 7f547a200640 1 --2- 172.21.15.3:0/2971904406 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55865b4d0260 0x55865b4d2680 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f193727c4838976c server_cookie=cf91079b36d3e94 in_seq=0 out_seq=0 2024-09-19T06:18:21.428 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.404+0000 7f545b400640 10 client.16782 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:21.430 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.419+0000 7f545b400640 1 -- 172.21.15.3:0/2971904406 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55865b441d80 con 0x55865b4d0260 2024-09-19T06:18:21.430 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.420+0000 7f545b400640 10 client.16782 handle_command_reply: tid=0 2024-09-19T06:18:21.430 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.420+0000 7f547f0a5740 1 client.16782 shutdown 2024-09-19T06:18:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.420+0000 7f547f0a5740 1 -- 172.21.15.3:0/2971904406 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b44ab00 msgr2=0x55865b458c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.420+0000 7f547f0a5740 1 --2- 172.21.15.3:0/2971904406 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b44ab00 0x55865b458c60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f546002aa00 tx=0x7f54600098a0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.420+0000 7f547f0a5740 1 -- 172.21.15.3:0/2971904406 shutdown_connections 2024-09-19T06:18:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.420+0000 7f547f0a5740 1 --2- 172.21.15.3:0/2971904406 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55865b4d0260 0x55865b4d2680 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.420+0000 7f547f0a5740 1 --2- 172.21.15.3:0/2971904406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55865b4553a0 0x55865b4591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.431 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.420+0000 7f547f0a5740 1 --2- 172.21.15.3:0/2971904406 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55865b44ab00 0x55865b458c60 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.420+0000 7f547f0a5740 1 --2- 172.21.15.3:0/2971904406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55865b44a1e0 0x55865b45d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.420+0000 7f545b400640 0 client.16782 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.420+0000 7f547f0a5740 1 -- 172.21.15.3:0/2971904406 >> 172.21.15.3:0/2971904406 conn(0x55865b446750 msgr2=0x55865b44bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.420+0000 7f547f0a5740 1 -- 172.21.15.3:0/2971904406 shutdown_connections 2024-09-19T06:18:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.420+0000 7f547f0a5740 1 -- 172.21.15.3:0/2971904406 wait complete. 2024-09-19T06:18:21.432 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.420+0000 7f547f0a5740 20 client.16782 trim_cache size 0 max 16384 2024-09-19T06:18:21.433 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:18:21.433 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:18:21.433 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:18:21.434 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:18:21.435 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.421+0000 7f547c200640 1 -- 172.21.15.3:0/1614780646 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f545c0a33b0 msgr2=0x7f545c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:21.435 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.421+0000 7f547c200640 1 --2- 172.21.15.3:0/1614780646 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f545c0a33b0 0x7f545c0a5870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55865b4475b0 tx=0x7f5468098040 comp rx=0 tx=0).stop 2024-09-19T06:18:21.435 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.421+0000 7f547c200640 1 -- 172.21.15.3:0/1614780646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5474103f40 msgr2=0x7f547419a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:21.435 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.421+0000 7f547c200640 1 --2- 172.21.15.3:0/1614780646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5474103f40 0x7f547419a640 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f546800e9f0 tx=0x7f546800edf0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.435 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.421+0000 7f547c200640 1 -- 172.21.15.3:0/1614780646 shutdown_connections 2024-09-19T06:18:21.435 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.421+0000 7f547c200640 1 --2- 172.21.15.3:0/1614780646 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f545c0a33b0 0x7f545c0a5870 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.421+0000 7f547c200640 1 --2- 172.21.15.3:0/1614780646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f547419ef00 0x7f547419f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.421+0000 7f547c200640 1 --2- 172.21.15.3:0/1614780646 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5474109090 0x7f547419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.421+0000 7f547c200640 1 --2- 172.21.15.3:0/1614780646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5474103f40 0x7f547419a640 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.421+0000 7f547c200640 1 -- 172.21.15.3:0/1614780646 >> 172.21.15.3:0/1614780646 conn(0x7f54740ff970 msgr2=0x7f5474100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.421+0000 7f547c200640 1 -- 172.21.15.3:0/1614780646 shutdown_connections 2024-09-19T06:18:21.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:21.421+0000 7f547c200640 1 -- 172.21.15.3:0/1614780646 wait complete. 2024-09-19T06:18:22.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:21 smithi059 ceph-mon[35138]: pgmap v182: 97 pgs: 97 active+clean; 5.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-19T06:18:22.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:21 smithi003 ceph-mon[30893]: pgmap v182: 97 pgs: 97 active+clean; 5.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-19T06:18:22.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:21 smithi071 ceph-mon[35662]: pgmap v182: 97 pgs: 97 active+clean; 5.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-19T06:18:23.064 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:18:23.462 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:23.854 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:23 smithi003 ceph-mon[30893]: pgmap v183: 97 pgs: 97 active+clean; 5.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-19T06:18:24.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:23 smithi059 ceph-mon[35138]: pgmap v183: 97 pgs: 97 active+clean; 5.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-19T06:18:24.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:23 smithi071 ceph-mon[35662]: pgmap v183: 97 pgs: 97 active+clean; 5.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-19T06:18:24.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.090+0000 7fdde6000640 1 -- 172.21.15.3:0/1762705550 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdde0109120 msgr2=0x7fdde0110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:24.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.090+0000 7fdde6000640 1 --2- 172.21.15.3:0/1762705550 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdde0109120 0x7fdde0110ca0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fddd8009ca0 tx=0x7fddd802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.090+0000 7fdde6000640 1 -- 172.21.15.3:0/1762705550 shutdown_connections 2024-09-19T06:18:24.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.090+0000 7fdde6000640 1 --2- 172.21.15.3:0/1762705550 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdde0109120 0x7fdde0110ca0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.090+0000 7fdde6000640 1 --2- 172.21.15.3:0/1762705550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde01049a0 0x7fdde01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.090+0000 7fdde6000640 1 --2- 172.21.15.3:0/1762705550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdde0103ff0 0x7fdde01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.090+0000 7fdde6000640 1 -- 172.21.15.3:0/1762705550 >> 172.21.15.3:0/1762705550 conn(0x7fdde00ffa90 msgr2=0x7fdde0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:24.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.090+0000 7fdde6000640 1 -- 172.21.15.3:0/1762705550 shutdown_connections 2024-09-19T06:18:24.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.090+0000 7fdde6000640 1 -- 172.21.15.3:0/1762705550 wait complete. 2024-09-19T06:18:24.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.091+0000 7fdde6000640 1 Processor -- start 2024-09-19T06:18:24.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.091+0000 7fdde6000640 1 -- start start 2024-09-19T06:18:24.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.091+0000 7fdde6000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdde0103ff0 0x7fdde019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.091+0000 7fdde6000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde01049a0 0x7fdde019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.091+0000 7fdde6000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdde0109120 0x7fdde019ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.091+0000 7fdde6000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdde0114150 con 0x7fdde0109120 2024-09-19T06:18:24.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.091+0000 7fdde6000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdde0113fd0 con 0x7fdde0103ff0 2024-09-19T06:18:24.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.091+0000 7fdde6000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdde01142d0 con 0x7fdde01049a0 2024-09-19T06:18:24.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.092+0000 7fdddf400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdde0103ff0 0x7fdde019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.097 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.092+0000 7fdddfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdde0109120 0x7fdde019ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.097 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.092+0000 7fdddf400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdde0103ff0 0x7fdde019a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:49808/0 (socket says 172.21.15.3:49808) 2024-09-19T06:18:24.097 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.092+0000 7fdddf400640 1 -- 172.21.15.3:0/4116567135 learned_addr learned my addr 172.21.15.3:0/4116567135 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:24.097 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.092+0000 7fdddfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdde0109120 0x7fdde019ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43116/0 (socket says 172.21.15.3:43116) 2024-09-19T06:18:24.097 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.092+0000 7fddd6a00640 1 --2- 172.21.15.3:0/4116567135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde01049a0 0x7fdde019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.097 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.092+0000 7fdddf400640 1 -- 172.21.15.3:0/4116567135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde01049a0 msgr2=0x7fdde019aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:24.097 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.092+0000 7fdddf400640 1 --2- 172.21.15.3:0/4116567135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde01049a0 0x7fdde019aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.092+0000 7fdddf400640 1 -- 172.21.15.3:0/4116567135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdde0109120 msgr2=0x7fdde019ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:24.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.092+0000 7fdddf400640 1 --2- 172.21.15.3:0/4116567135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdde0109120 0x7fdde019ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.092+0000 7fdddf400640 1 -- 172.21.15.3:0/4116567135 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde019f560 con 0x7fdde0103ff0 2024-09-19T06:18:24.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.092+0000 7fdddf400640 1 --2- 172.21.15.3:0/4116567135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdde0103ff0 0x7fdde019a5b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fddd000e9f0 tx=0x7fddd000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:24.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.093+0000 7fdddcc00640 1 -- 172.21.15.3:0/4116567135 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd000cd80 con 0x7fdde0103ff0 2024-09-19T06:18:24.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.093+0000 7fdde6000640 1 -- 172.21.15.3:0/4116567135 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdde019f850 con 0x7fdde0103ff0 2024-09-19T06:18:24.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.093+0000 7fdddcc00640 1 -- 172.21.15.3:0/4116567135 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddd0010910 con 0x7fdde0103ff0 2024-09-19T06:18:24.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.093+0000 7fdddcc00640 1 -- 172.21.15.3:0/4116567135 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd00188f0 con 0x7fdde0103ff0 2024-09-19T06:18:24.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.093+0000 7fdde6000640 1 -- 172.21.15.3:0/4116567135 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdde01a7130 con 0x7fdde0103ff0 2024-09-19T06:18:24.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.096+0000 7fdde89c5740 1 Processor -- start 2024-09-19T06:18:24.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.096+0000 7fdde89c5740 1 -- start start 2024-09-19T06:18:24.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.096+0000 7fdde89c5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561eb7b7b90 0x5561eb7b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.096+0000 7fdde89c5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561eb7b84b0 0x5561eb7c2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.096+0000 7fdde89c5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561eb7c2d70 0x5561eb7c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.096+0000 7fdde89c5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5561eb71e3e0 con 0x5561eb7c2d70 2024-09-19T06:18:24.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.096+0000 7fdde89c5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5561eb6c5d80 con 0x5561eb7b84b0 2024-09-19T06:18:24.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.096+0000 7fdde89c5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5561eb71a3a0 con 0x5561eb7b7b90 2024-09-19T06:18:24.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.096+0000 7fdddcc00640 1 -- 172.21.15.3:0/4116567135 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fddd0010ac0 con 0x7fdde0103ff0 2024-09-19T06:18:24.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.096+0000 7fdddfe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561eb7b7b90 0x5561eb7b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.097+0000 7fddd6a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561eb7c2d70 0x5561eb7c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.097+0000 7fdddfe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561eb7b7b90 0x5561eb7b7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:36110/0 (socket says 172.21.15.3:36110) 2024-09-19T06:18:24.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.097+0000 7fdddfe00640 1 -- 172.21.15.3:0/28351641 learned_addr learned my addr 172.21.15.3:0/28351641 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:24.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.097+0000 7fdddfe00640 1 -- 172.21.15.3:0/28351641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561eb7b84b0 msgr2=0x5561eb7c2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:24.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.097+0000 7fdddfe00640 1 --2- 172.21.15.3:0/28351641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561eb7b84b0 0x5561eb7c2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.097+0000 7fdddfe00640 1 -- 172.21.15.3:0/28351641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561eb7c2d70 msgr2=0x5561eb7c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:24.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.097+0000 7fdddfe00640 1 --2- 172.21.15.3:0/28351641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561eb7c2d70 0x5561eb7c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.097+0000 7fdddfe00640 1 -- 172.21.15.3:0/28351641 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561eb6e4ae0 con 0x5561eb7b7b90 2024-09-19T06:18:24.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.097+0000 7fdddfe00640 1 --2- 172.21.15.3:0/28351641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561eb7b7b90 0x5561eb7b7f70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fddd8009ca0 tx=0x7fddd8005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e15d5462e72c8546 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:24.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.098+0000 7fddcfe00640 1 -- 172.21.15.3:0/28351641 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd8031db0 con 0x5561eb7b7b90 2024-09-19T06:18:24.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.098+0000 7fddcfe00640 1 -- 172.21.15.3:0/28351641 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddd8036040 con 0x5561eb7b7b90 2024-09-19T06:18:24.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.098+0000 7fddcfe00640 1 -- 172.21.15.3:0/28351641 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd80042a0 con 0x5561eb7b7b90 2024-09-19T06:18:24.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.098+0000 7fdddcc00640 1 --2- 172.21.15.3:0/4116567135 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fddc40a33b0 0x7fddc40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.098+0000 7fdde89c5740 1 -- 172.21.15.3:0/28351641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561eb7b7b90 msgr2=0x5561eb7b7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:24.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.098+0000 7fdde89c5740 1 --2- 172.21.15.3:0/28351641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561eb7b7b90 0x5561eb7b7f70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fddd8009ca0 tx=0x7fddd8005f10 comp rx=0 tx=0).stop 2024-09-19T06:18:24.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.098+0000 7fdddcc00640 1 -- 172.21.15.3:0/4116567135 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fddd00d0110 con 0x7fdde0103ff0 2024-09-19T06:18:24.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.099+0000 7fdddf400640 1 --2- 172.21.15.3:0/4116567135 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fddc40a33b0 0x7fddc40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.099+0000 7fdde89c5740 1 -- 172.21.15.3:0/28351641 shutdown_connections 2024-09-19T06:18:24.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.099+0000 7fdde89c5740 1 --2- 172.21.15.3:0/28351641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561eb7c2d70 0x5561eb7c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.099+0000 7fdde89c5740 1 --2- 172.21.15.3:0/28351641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561eb7b84b0 0x5561eb7c2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.099+0000 7fdde89c5740 1 --2- 172.21.15.3:0/28351641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561eb7b7b90 0x5561eb7b7f70 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.099+0000 7fdde89c5740 1 -- 172.21.15.3:0/28351641 >> 172.21.15.3:0/28351641 conn(0x5561eb7b4120 msgr2=0x5561eb7b4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:24.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.099+0000 7fdde89c5740 1 -- 172.21.15.3:0/28351641 shutdown_connections 2024-09-19T06:18:24.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.099+0000 7fdde89c5740 1 -- 172.21.15.3:0/28351641 wait complete. 2024-09-19T06:18:24.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.099+0000 7fdde89c5740 1 -- start start 2024-09-19T06:18:24.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.099+0000 7fdddf400640 1 --2- 172.21.15.3:0/4116567135 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fddc40a33b0 0x7fddc40a5870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x5561eb7b4f80 tx=0x7fddd000cf20 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:24.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.100+0000 7fdde89c5740 1 Processor -- start 2024-09-19T06:18:24.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.100+0000 7fdde89c5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561eb7b7b90 0x5561eb7bfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.100+0000 7fdde89c5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561eb7b84b0 0x5561eb7c01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.100+0000 7fdde89c5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561eb7c2d70 0x5561eb7c06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.100+0000 7fdde89c5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5561eb7c5860 con 0x5561eb7b84b0 2024-09-19T06:18:24.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.100+0000 7fdde89c5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5561eb6d90f0 con 0x5561eb7b7b90 2024-09-19T06:18:24.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.100+0000 7fdde89c5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5561eb7c59e0 con 0x5561eb7c2d70 2024-09-19T06:18:24.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.100+0000 7fdde89c5740 10 client.0 _ll_register_callbacks cb 0x5561eb6ca9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:24.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.100+0000 7fddd6a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561eb7b84b0 0x5561eb7c01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.100+0000 7fdddfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561eb7b7b90 0x5561eb7bfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.100+0000 7fddd6a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561eb7b84b0 0x5561eb7c01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43122/0 (socket says 172.21.15.3:43122) 2024-09-19T06:18:24.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.100+0000 7fddd6a00640 1 -- 172.21.15.3:0/641949395 learned_addr learned my addr 172.21.15.3:0/641949395 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:24.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.101+0000 7fdddfe00640 1 --2- 172.21.15.3:0/641949395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561eb7c2d70 0x5561eb7c06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.101+0000 7fddd6a00640 1 -- 172.21.15.3:0/641949395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561eb7c2d70 msgr2=0x5561eb7c06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:24.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.101+0000 7fddd6a00640 1 --2- 172.21.15.3:0/641949395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561eb7c2d70 0x5561eb7c06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.101+0000 7fddd6a00640 1 -- 172.21.15.3:0/641949395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561eb7b7b90 msgr2=0x5561eb7bfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:24.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.101+0000 7fddd6a00640 1 --2- 172.21.15.3:0/641949395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561eb7b7b90 0x5561eb7bfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.101+0000 7fddd6a00640 1 -- 172.21.15.3:0/641949395 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561eb48f3c0 con 0x5561eb7b84b0 2024-09-19T06:18:24.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.101+0000 7fddd6a00640 1 --2- 172.21.15.3:0/641949395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561eb7b84b0 0x5561eb7c01b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fddc8012700 tx=0x7fddc8012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23302bc7d27f38e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:24.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.101+0000 7fddccc00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:18:24.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.101+0000 7fddccc00640 1 -- 172.21.15.3:0/641949395 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc800f8c0 con 0x5561eb7b84b0 2024-09-19T06:18:24.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.102+0000 7fdde89c5740 1 -- 172.21.15.3:0/641949395 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddd8036040 con 0x5561eb7b84b0 2024-09-19T06:18:24.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.102+0000 7fddccc00640 1 -- 172.21.15.3:0/641949395 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fddc800fa60 con 0x5561eb7b84b0 2024-09-19T06:18:24.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.102+0000 7fddccc00640 1 -- 172.21.15.3:0/641949395 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fddc800fc60 con 0x5561eb7b84b0 2024-09-19T06:18:24.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.102+0000 7fdde89c5740 10 client.16794 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:24.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.102+0000 7fdde89c5740 1 -- 172.21.15.3:0/641949395 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5561eb7d15d0 con 0x5561eb7b84b0 2024-09-19T06:18:24.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.102+0000 7fddccc00640 1 -- 172.21.15.3:0/641949395 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddd8036040 con 0x5561eb7b84b0 2024-09-19T06:18:24.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.102+0000 7fddccc00640 1 -- 172.21.15.3:0/641949395 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fddc8010550 con 0x5561eb7b84b0 2024-09-19T06:18:24.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.102+0000 7fdde89c5740 10 client.16794 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:24.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.102+0000 7fdde89c5740 10 client.16794 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:24.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.102+0000 7fdde89c5740 20 client.16794 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:24.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.102+0000 7fdde89c5740 1 --2- 172.21.15.3:0/641949395 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5561eb7d29e0 0x5561eb7d4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.103+0000 7fdde89c5740 4 client.16794 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:24.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.103+0000 7fdde89c5740 1 -- 172.21.15.3:0/641949395 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561eb72b950 con 0x5561eb7d29e0 2024-09-19T06:18:24.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.103+0000 7fdddfe00640 1 --2- 172.21.15.3:0/641949395 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5561eb7d29e0 0x5561eb7d4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.103+0000 7fdddfe00640 1 --2- 172.21.15.3:0/641949395 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5561eb7d29e0 0x5561eb7d4df0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8406a13a0e6d9bbc server_cookie=2734595e9edddc54 in_seq=0 out_seq=0 2024-09-19T06:18:24.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.103+0000 7fddccc00640 10 client.16794 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:24.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.104+0000 7fddccc00640 1 -- 172.21.15.3:0/641949395 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5561eb72b950 con 0x5561eb7d29e0 2024-09-19T06:18:24.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.104+0000 7fddccc00640 10 client.16794 handle_command_reply: tid=0 2024-09-19T06:18:24.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.104+0000 7fdde89c5740 1 client.16794 shutdown 2024-09-19T06:18:24.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.105+0000 7fdde89c5740 1 -- 172.21.15.3:0/641949395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561eb7b84b0 msgr2=0x5561eb7c01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:24.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.105+0000 7fdde89c5740 1 --2- 172.21.15.3:0/641949395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561eb7b84b0 0x5561eb7c01b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fddc8012700 tx=0x7fddc8012bc0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.105+0000 7fdde89c5740 1 -- 172.21.15.3:0/641949395 shutdown_connections 2024-09-19T06:18:24.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.105+0000 7fdde89c5740 1 --2- 172.21.15.3:0/641949395 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5561eb7d29e0 0x5561eb7d4df0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.105+0000 7fdde89c5740 1 --2- 172.21.15.3:0/641949395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561eb7c2d70 0x5561eb7c06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.105+0000 7fdde89c5740 1 --2- 172.21.15.3:0/641949395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561eb7b84b0 0x5561eb7c01b0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.105+0000 7fdde89c5740 1 --2- 172.21.15.3:0/641949395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561eb7b7b90 0x5561eb7bfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.105+0000 7fddccc00640 0 client.16794 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:24.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.105+0000 7fdde89c5740 1 -- 172.21.15.3:0/641949395 >> 172.21.15.3:0/641949395 conn(0x5561eb7b4120 msgr2=0x5561eb7b9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:24.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.105+0000 7fdde89c5740 1 -- 172.21.15.3:0/641949395 shutdown_connections 2024-09-19T06:18:24.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.105+0000 7fdde89c5740 1 -- 172.21.15.3:0/641949395 wait complete. 2024-09-19T06:18:24.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.105+0000 7fdde89c5740 20 client.16794 trim_cache size 0 max 16384 2024-09-19T06:18:24.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.124+0000 7fdde89c5740 1 Processor -- start 2024-09-19T06:18:24.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.124+0000 7fdde89c5740 1 -- start start 2024-09-19T06:18:24.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.124+0000 7fdde89c5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561eb7b7b90 0x5561eb7ba5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.124+0000 7fdde89c5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561eb7b84b0 0x5561eb7da6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.124+0000 7fdde89c5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561eb7c2d70 0x5561eb7dac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.124+0000 7fdde89c5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdde01afa60 con 0x5561eb7c2d70 2024-09-19T06:18:24.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.124+0000 7fdde89c5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdde01b15a0 con 0x5561eb7b7b90 2024-09-19T06:18:24.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.124+0000 7fdde89c5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdde01b0130 con 0x5561eb7b84b0 2024-09-19T06:18:24.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.124+0000 7fdddfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561eb7c2d70 0x5561eb7dac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.124+0000 7fdddfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561eb7c2d70 0x5561eb7dac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43124/0 (socket says 172.21.15.3:43124) 2024-09-19T06:18:24.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.124+0000 7fdddfe00640 1 -- 172.21.15.3:0/1766965292 learned_addr learned my addr 172.21.15.3:0/1766965292 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:24.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.124+0000 7fddd6a00640 1 --2- 172.21.15.3:0/1766965292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561eb7b84b0 0x5561eb7da6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.124+0000 7fdddfe00640 1 --2- 172.21.15.3:0/1766965292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561eb7b7b90 0x5561eb7ba5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.125+0000 7fddd6a00640 1 -- 172.21.15.3:0/1766965292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561eb7b7b90 msgr2=0x5561eb7ba5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:24.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.125+0000 7fddd6a00640 1 --2- 172.21.15.3:0/1766965292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561eb7b7b90 0x5561eb7ba5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.125+0000 7fddd6a00640 1 -- 172.21.15.3:0/1766965292 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561eb7c2d70 msgr2=0x5561eb7dac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:24.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.125+0000 7fddd6a00640 1 --2- 172.21.15.3:0/1766965292 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561eb7c2d70 0x5561eb7dac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.125+0000 7fddd6a00640 1 -- 172.21.15.3:0/1766965292 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561eb7b51d0 con 0x5561eb7b84b0 2024-09-19T06:18:24.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.125+0000 7fddd6a00640 1 --2- 172.21.15.3:0/1766965292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561eb7b84b0 0x5561eb7da6c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fddc8010940 tx=0x7fddc8009620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a38eb9bd50662a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:24.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.125+0000 7fddcf400640 1 -- 172.21.15.3:0/1766965292 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8029020 con 0x5561eb7b84b0 2024-09-19T06:18:24.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.125+0000 7fddcf400640 1 -- 172.21.15.3:0/1766965292 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddc80055f0 con 0x5561eb7b84b0 2024-09-19T06:18:24.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.125+0000 7fddcf400640 1 -- 172.21.15.3:0/1766965292 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc800f9f0 con 0x5561eb7b84b0 2024-09-19T06:18:24.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.126+0000 7fdde89c5740 1 -- 172.21.15.3:0/1766965292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561eb7b84b0 msgr2=0x5561eb7da6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:24.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.126+0000 7fdde89c5740 1 --2- 172.21.15.3:0/1766965292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561eb7b84b0 0x5561eb7da6c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fddc8010940 tx=0x7fddc8009620 comp rx=0 tx=0).stop 2024-09-19T06:18:24.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.126+0000 7fdde89c5740 1 -- 172.21.15.3:0/1766965292 shutdown_connections 2024-09-19T06:18:24.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.126+0000 7fdde89c5740 1 --2- 172.21.15.3:0/1766965292 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561eb7c2d70 0x5561eb7dac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.126+0000 7fdde89c5740 1 --2- 172.21.15.3:0/1766965292 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561eb7b84b0 0x5561eb7da6c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.126+0000 7fdde89c5740 1 --2- 172.21.15.3:0/1766965292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561eb7b7b90 0x5561eb7ba5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.126+0000 7fdde89c5740 1 -- 172.21.15.3:0/1766965292 >> 172.21.15.3:0/1766965292 conn(0x5561eb7b4120 msgr2=0x5561eb7c1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:24.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.126+0000 7fdde89c5740 1 -- 172.21.15.3:0/1766965292 shutdown_connections 2024-09-19T06:18:24.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.126+0000 7fdde89c5740 1 -- 172.21.15.3:0/1766965292 wait complete. 2024-09-19T06:18:24.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.127+0000 7fdde89c5740 1 -- start start 2024-09-19T06:18:24.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.127+0000 7fdde89c5740 1 Processor -- start 2024-09-19T06:18:24.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.127+0000 7fdde89c5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561eb7b7b90 0x5561eb7cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.127+0000 7fdde89c5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561eb7b84b0 0x5561eb7cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.127+0000 7fdde89c5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561eb7c2d70 0x5561eb7c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.127+0000 7fdde89c5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdde01b0ed0 con 0x5561eb7b84b0 2024-09-19T06:18:24.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.127+0000 7fdde89c5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdde01b0800 con 0x5561eb7b7b90 2024-09-19T06:18:24.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.127+0000 7fdde89c5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdde01ada40 con 0x5561eb7c2d70 2024-09-19T06:18:24.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.127+0000 7fdde89c5740 10 client.0 _ll_register_callbacks cb 0x7fddc8009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:24.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.128+0000 7fddd6a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561eb7b84b0 0x5561eb7cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.128+0000 7fdddfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561eb7b7b90 0x5561eb7cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.128+0000 7fdddfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561eb7b7b90 0x5561eb7cac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:49838/0 (socket says 172.21.15.3:49838) 2024-09-19T06:18:24.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.128+0000 7fdddfe00640 1 -- 172.21.15.3:0/789914898 learned_addr learned my addr 172.21.15.3:0/789914898 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:24.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.128+0000 7fdddfe00640 1 --2- 172.21.15.3:0/789914898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561eb7c2d70 0x5561eb7c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.128+0000 7fddd6a00640 1 -- 172.21.15.3:0/789914898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561eb7c2d70 msgr2=0x5561eb7c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:24.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.128+0000 7fddd6a00640 1 --2- 172.21.15.3:0/789914898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561eb7c2d70 0x5561eb7c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.128+0000 7fddd6a00640 1 -- 172.21.15.3:0/789914898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561eb7b7b90 msgr2=0x5561eb7cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:24.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.128+0000 7fddd6a00640 1 --2- 172.21.15.3:0/789914898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561eb7b7b90 0x5561eb7cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.128+0000 7fddd6a00640 1 -- 172.21.15.3:0/789914898 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561eb7b79c0 con 0x5561eb7b84b0 2024-09-19T06:18:24.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.128+0000 7fddd6a00640 1 --2- 172.21.15.3:0/789914898 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561eb7b84b0 0x5561eb7cb170 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x5561eb7cf0c0 tx=0x7fddc800f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da12c32da350657a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:24.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.128+0000 7fddccc00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:18:24.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.129+0000 7fddccc00640 1 -- 172.21.15.3:0/789914898 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8029030 con 0x5561eb7b84b0 2024-09-19T06:18:24.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.129+0000 7fdde89c5740 1 -- 172.21.15.3:0/789914898 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddc80055f0 con 0x5561eb7b84b0 2024-09-19T06:18:24.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.129+0000 7fddccc00640 1 -- 172.21.15.3:0/789914898 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fddc800fe00 con 0x5561eb7b84b0 2024-09-19T06:18:24.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.129+0000 7fddccc00640 1 -- 172.21.15.3:0/789914898 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fddc803d050 con 0x5561eb7b84b0 2024-09-19T06:18:24.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.129+0000 7fdde89c5740 10 client.16800 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:24.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.129+0000 7fdde89c5740 1 -- 172.21.15.3:0/789914898 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5561eb83db10 con 0x5561eb7b84b0 2024-09-19T06:18:24.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.129+0000 7fddccc00640 1 -- 172.21.15.3:0/789914898 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddc80055f0 con 0x5561eb7b84b0 2024-09-19T06:18:24.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.129+0000 7fddccc00640 1 -- 172.21.15.3:0/789914898 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fddc8003cd0 con 0x5561eb7b84b0 2024-09-19T06:18:24.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.129+0000 7fdde89c5740 10 client.16800 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:24.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.129+0000 7fdde89c5740 10 client.16800 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:24.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.129+0000 7fdde89c5740 20 client.16800 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:24.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.129+0000 7fdde89c5740 1 --2- 172.21.15.3:0/789914898 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5561eb83e110 0x5561eb840500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:24.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.129+0000 7fdde89c5740 4 client.16800 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:18:24.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.129+0000 7fdde89c5740 1 -- 172.21.15.3:0/789914898 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5561eb725e60 con 0x5561eb83e110 2024-09-19T06:18:24.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.130+0000 7fdddfe00640 1 --2- 172.21.15.3:0/789914898 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5561eb83e110 0x5561eb840500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:24.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.130+0000 7fdddfe00640 1 --2- 172.21.15.3:0/789914898 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5561eb83e110 0x5561eb840500 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a571bff7082957f server_cookie=22a330b7851aa25f in_seq=0 out_seq=0 2024-09-19T06:18:24.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.130+0000 7fddccc00640 10 client.16800 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:24.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.131+0000 7fddccc00640 1 -- 172.21.15.3:0/789914898 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5561eb725e60 con 0x5561eb83e110 2024-09-19T06:18:24.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.131+0000 7fddccc00640 10 client.16800 handle_command_reply: tid=0 2024-09-19T06:18:24.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.131+0000 7fdde89c5740 1 client.16800 shutdown 2024-09-19T06:18:24.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.131+0000 7fdde89c5740 1 -- 172.21.15.3:0/789914898 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561eb7b84b0 msgr2=0x5561eb7cb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:24.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.131+0000 7fdde89c5740 1 --2- 172.21.15.3:0/789914898 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561eb7b84b0 0x5561eb7cb170 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x5561eb7cf0c0 tx=0x7fddc800f9a0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.131+0000 7fdde89c5740 1 -- 172.21.15.3:0/789914898 shutdown_connections 2024-09-19T06:18:24.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.131+0000 7fdde89c5740 1 --2- 172.21.15.3:0/789914898 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5561eb83e110 0x5561eb840500 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.131+0000 7fdde89c5740 1 --2- 172.21.15.3:0/789914898 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5561eb7c2d70 0x5561eb7c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.131+0000 7fdde89c5740 1 --2- 172.21.15.3:0/789914898 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5561eb7b84b0 0x5561eb7cb170 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.131+0000 7fdde89c5740 1 --2- 172.21.15.3:0/789914898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5561eb7b7b90 0x5561eb7cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.131+0000 7fdde89c5740 1 -- 172.21.15.3:0/789914898 >> 172.21.15.3:0/789914898 conn(0x5561eb7b4120 msgr2=0x5561eb7b29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:24.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.131+0000 7fddccc00640 0 client.16800 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:24.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.131+0000 7fdde89c5740 1 -- 172.21.15.3:0/789914898 shutdown_connections 2024-09-19T06:18:24.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.131+0000 7fdde89c5740 1 -- 172.21.15.3:0/789914898 wait complete. 2024-09-19T06:18:24.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.131+0000 7fdde89c5740 20 client.16800 trim_cache size 0 max 16384 2024-09-19T06:18:24.139 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:18:24.139 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "no active scrubs running", 2024-09-19T06:18:24.139 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": {} 2024-09-19T06:18:24.139 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:18:24.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.132+0000 7fdde6000640 1 -- 172.21.15.3:0/4116567135 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fddc40a33b0 msgr2=0x7fddc40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:24.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.132+0000 7fdde6000640 1 --2- 172.21.15.3:0/4116567135 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fddc40a33b0 0x7fddc40a5870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x5561eb7b4f80 tx=0x7fddd000cf20 comp rx=0 tx=0).stop 2024-09-19T06:18:24.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.132+0000 7fdde6000640 1 -- 172.21.15.3:0/4116567135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdde0103ff0 msgr2=0x7fdde019a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:24.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.132+0000 7fdde6000640 1 --2- 172.21.15.3:0/4116567135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdde0103ff0 0x7fdde019a5b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fddd000e9f0 tx=0x7fddd000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.132+0000 7fdde6000640 1 -- 172.21.15.3:0/4116567135 shutdown_connections 2024-09-19T06:18:24.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.132+0000 7fdde6000640 1 --2- 172.21.15.3:0/4116567135 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fddc40a33b0 0x7fddc40a5870 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.132+0000 7fdde6000640 1 --2- 172.21.15.3:0/4116567135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdde0109120 0x7fdde019ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.132+0000 7fdde6000640 1 --2- 172.21.15.3:0/4116567135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdde01049a0 0x7fdde019aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.132+0000 7fdde6000640 1 --2- 172.21.15.3:0/4116567135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdde0103ff0 0x7fdde019a5b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:24.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.132+0000 7fdde6000640 1 -- 172.21.15.3:0/4116567135 >> 172.21.15.3:0/4116567135 conn(0x7fdde00ffa90 msgr2=0x7fdde0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:24.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.132+0000 7fdde6000640 1 -- 172.21.15.3:0/4116567135 shutdown_connections 2024-09-19T06:18:24.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:24.132+0000 7fdde6000640 1 -- 172.21.15.3:0/4116567135 wait complete. 2024-09-19T06:18:25.180 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:18:25.180 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:18:25.560 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:25.895 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:25 smithi003 ceph-mon[30893]: pgmap v184: 97 pgs: 97 active+clean; 5.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 57 KiB/s wr, 22 op/s 2024-09-19T06:18:26.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:25 smithi059 ceph-mon[35138]: pgmap v184: 97 pgs: 97 active+clean; 5.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 57 KiB/s wr, 22 op/s 2024-09-19T06:18:26.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:25 smithi071 ceph-mon[35662]: pgmap v184: 97 pgs: 97 active+clean; 5.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 57 KiB/s wr, 22 op/s 2024-09-19T06:18:26.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.155+0000 7fba39800640 1 -- 172.21.15.3:0/2913984692 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba34108f60 msgr2=0x7fba34110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:26.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.155+0000 7fba39800640 1 --2- 172.21.15.3:0/2913984692 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba34108f60 0x7fba34110ae0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fba2c009ca0 tx=0x7fba2c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:18:26.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.155+0000 7fba39800640 1 -- 172.21.15.3:0/2913984692 shutdown_connections 2024-09-19T06:18:26.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.155+0000 7fba39800640 1 --2- 172.21.15.3:0/2913984692 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba34108f60 0x7fba34110ae0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:26.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.155+0000 7fba39800640 1 --2- 172.21.15.3:0/2913984692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba341047e0 0x7fba34108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:26.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.155+0000 7fba39800640 1 --2- 172.21.15.3:0/2913984692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba34103e30 0x7fba34104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:26.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.155+0000 7fba39800640 1 -- 172.21.15.3:0/2913984692 >> 172.21.15.3:0/2913984692 conn(0x7fba340ff8d0 msgr2=0x7fba34101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:26.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.155+0000 7fba39800640 1 -- 172.21.15.3:0/2913984692 shutdown_connections 2024-09-19T06:18:26.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.155+0000 7fba39800640 1 -- 172.21.15.3:0/2913984692 wait complete. 2024-09-19T06:18:26.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.156+0000 7fba39800640 1 Processor -- start 2024-09-19T06:18:26.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.156+0000 7fba39800640 1 -- start start 2024-09-19T06:18:26.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.157+0000 7fba39800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba34103e30 0x7fba3419a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:26.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.157+0000 7fba39800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba341047e0 0x7fba3419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:26.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.157+0000 7fba39800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba34108f60 0x7fba3419ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:26.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.157+0000 7fba39800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fba34114010 con 0x7fba34103e30 2024-09-19T06:18:26.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.157+0000 7fba39800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fba34113e90 con 0x7fba34108f60 2024-09-19T06:18:26.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.157+0000 7fba39800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fba34114190 con 0x7fba341047e0 2024-09-19T06:18:26.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.157+0000 7fba33e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba34103e30 0x7fba3419a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:26.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.157+0000 7fba33e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba34103e30 0x7fba3419a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43152/0 (socket says 172.21.15.3:43152) 2024-09-19T06:18:26.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.157+0000 7fba38e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba34108f60 0x7fba3419ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:26.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.157+0000 7fba33e00640 1 -- 172.21.15.3:0/3347592044 learned_addr learned my addr 172.21.15.3:0/3347592044 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:26.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.157+0000 7fba2be00640 1 --2- 172.21.15.3:0/3347592044 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba341047e0 0x7fba3419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:26.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.158+0000 7fba2be00640 1 -- 172.21.15.3:0/3347592044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba34108f60 msgr2=0x7fba3419ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:26.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.158+0000 7fba2be00640 1 --2- 172.21.15.3:0/3347592044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba34108f60 0x7fba3419ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:26.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.158+0000 7fba2be00640 1 -- 172.21.15.3:0/3347592044 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba34103e30 msgr2=0x7fba3419a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:26.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.158+0000 7fba2be00640 1 --2- 172.21.15.3:0/3347592044 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba34103e30 0x7fba3419a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:26.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.158+0000 7fba2be00640 1 -- 172.21.15.3:0/3347592044 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3419f3b0 con 0x7fba341047e0 2024-09-19T06:18:26.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.158+0000 7fba33e00640 1 --2- 172.21.15.3:0/3347592044 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba34103e30 0x7fba3419a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:26.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.158+0000 7fba2be00640 1 --2- 172.21.15.3:0/3347592044 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba341047e0 0x7fba3419a940 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00e9f0 tx=0x7fba1c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:26.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.158+0000 7fba31600640 1 -- 172.21.15.3:0/3347592044 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c00ccc0 con 0x7fba341047e0 2024-09-19T06:18:26.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.158+0000 7fba31600640 1 -- 172.21.15.3:0/3347592044 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba1c005020 con 0x7fba341047e0 2024-09-19T06:18:26.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.158+0000 7fba39800640 1 -- 172.21.15.3:0/3347592044 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba3419f6a0 con 0x7fba341047e0 2024-09-19T06:18:26.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.158+0000 7fba31600640 1 -- 172.21.15.3:0/3347592044 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c0049e0 con 0x7fba341047e0 2024-09-19T06:18:26.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.158+0000 7fba39800640 1 -- 172.21.15.3:0/3347592044 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba341a6f80 con 0x7fba341047e0 2024-09-19T06:18:26.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.159+0000 7fba39800640 1 -- 172.21.15.3:0/3347592044 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba34104210 con 0x7fba341047e0 2024-09-19T06:18:26.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.161+0000 7fba31600640 1 -- 172.21.15.3:0/3347592044 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fba1c005560 con 0x7fba341047e0 2024-09-19T06:18:26.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.163+0000 7fba31600640 1 --2- 172.21.15.3:0/3347592044 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fba180a3430 0x7fba180a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:26.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.163+0000 7fba31600640 1 -- 172.21.15.3:0/3347592044 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fba1c0cfc80 con 0x7fba341047e0 2024-09-19T06:18:26.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.163+0000 7fba33e00640 1 --2- 172.21.15.3:0/3347592044 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fba180a3430 0x7fba180a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:26.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.164+0000 7fba33e00640 1 --2- 172.21.15.3:0/3347592044 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fba180a3430 0x7fba180a58f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fba24011550 tx=0x7fba24005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:26.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.165+0000 7fba31600640 1 -- 172.21.15.3:0/3347592044 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fba1c0051d0 con 0x7fba341047e0 2024-09-19T06:18:26.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.388+0000 7fba39800640 1 -- 172.21.15.3:0/3347592044 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba3419b760 con 0x7fba341047e0 2024-09-19T06:18:26.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.390+0000 7fba31600640 1 -- 172.21.15.3:0/3347592044 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7fba3419b760 con 0x7fba341047e0 2024-09-19T06:18:26.391 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:18:26.391 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"btime":"2024-09-19T06:12:22:958217+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:12:22.060987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24532,24515,24514,14517]},"id":1}]} 2024-09-19T06:18:26.391 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2024-09-19T06:18:26.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.392+0000 7fba39800640 1 -- 172.21.15.3:0/3347592044 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fba180a3430 msgr2=0x7fba180a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:26.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.392+0000 7fba39800640 1 --2- 172.21.15.3:0/3347592044 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fba180a3430 0x7fba180a58f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fba24011550 tx=0x7fba24005f90 comp rx=0 tx=0).stop 2024-09-19T06:18:26.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.392+0000 7fba39800640 1 -- 172.21.15.3:0/3347592044 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba341047e0 msgr2=0x7fba3419a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:26.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.392+0000 7fba39800640 1 --2- 172.21.15.3:0/3347592044 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba341047e0 0x7fba3419a940 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00e9f0 tx=0x7fba1c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:18:26.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.392+0000 7fba39800640 1 -- 172.21.15.3:0/3347592044 shutdown_connections 2024-09-19T06:18:26.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.392+0000 7fba39800640 1 --2- 172.21.15.3:0/3347592044 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fba180a3430 0x7fba180a58f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:26.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.392+0000 7fba39800640 1 --2- 172.21.15.3:0/3347592044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba34108f60 0x7fba3419ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:26.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.392+0000 7fba39800640 1 --2- 172.21.15.3:0/3347592044 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fba341047e0 0x7fba3419a940 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:26.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.392+0000 7fba39800640 1 --2- 172.21.15.3:0/3347592044 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fba34103e30 0x7fba3419a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:26.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.392+0000 7fba39800640 1 -- 172.21.15.3:0/3347592044 >> 172.21.15.3:0/3347592044 conn(0x7fba340ff8d0 msgr2=0x7fba34101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:26.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.392+0000 7fba39800640 1 -- 172.21.15.3:0/3347592044 shutdown_connections 2024-09-19T06:18:26.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:26.392+0000 7fba39800640 1 -- 172.21.15.3:0/3347592044 wait complete. 2024-09-19T06:18:26.758 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:26 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3347592044' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:18:27.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:26 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/3347592044' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:18:27.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:26 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/3347592044' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:18:27.508 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:18:27.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:27 smithi003 ceph-mon[30893]: pgmap v185: 97 pgs: 97 active+clean; 5.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 41 KiB/s wr, 16 op/s 2024-09-19T06:18:27.898 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:28.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:27 smithi059 ceph-mon[35138]: pgmap v185: 97 pgs: 97 active+clean; 5.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 41 KiB/s wr, 16 op/s 2024-09-19T06:18:28.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:27 smithi071 ceph-mon[35662]: pgmap v185: 97 pgs: 97 active+clean; 5.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 41 KiB/s wr, 16 op/s 2024-09-19T06:18:28.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.520+0000 7f660d800640 1 -- 172.21.15.3:0/3505702793 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f660810e3c0 msgr2=0x7f6608110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:28.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.520+0000 7f660d800640 1 --2- 172.21.15.3:0/3505702793 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f660810e3c0 0x7f6608110810 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6600009ca0 tx=0x7f660002a950 comp rx=0 tx=0).stop 2024-09-19T06:18:28.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.520+0000 7f660d800640 1 -- 172.21.15.3:0/3505702793 shutdown_connections 2024-09-19T06:18:28.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.520+0000 7f660d800640 1 --2- 172.21.15.3:0/3505702793 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f660810e3c0 0x7f6608110810 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.520+0000 7f660d800640 1 --2- 172.21.15.3:0/3505702793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6608074f40 0x7f660810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.520+0000 7f660d800640 1 --2- 172.21.15.3:0/3505702793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6608074620 0x7f6608074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.520+0000 7f660d800640 1 -- 172.21.15.3:0/3505702793 >> 172.21.15.3:0/3505702793 conn(0x7f66080fd8c0 msgr2=0x7f66080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:28.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.520+0000 7f660d800640 1 -- 172.21.15.3:0/3505702793 shutdown_connections 2024-09-19T06:18:28.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.520+0000 7f660d800640 1 -- 172.21.15.3:0/3505702793 wait complete. 2024-09-19T06:18:28.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.521+0000 7f660d800640 1 Processor -- start 2024-09-19T06:18:28.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.522+0000 7f660d800640 1 -- start start 2024-09-19T06:18:28.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.522+0000 7f660d800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6608074620 0x7f660819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.522+0000 7f660d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6608074f40 0x7f660819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.522+0000 7f660d800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f660810e3c0 0x7f660819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.522+0000 7f660d800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6608114150 con 0x7f6608074620 2024-09-19T06:18:28.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.522+0000 7f660d800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6608113fd0 con 0x7f6608074f40 2024-09-19T06:18:28.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.522+0000 7f660d800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f66081142d0 con 0x7f660810e3c0 2024-09-19T06:18:28.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.522+0000 7f6606a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6608074620 0x7f660819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.522+0000 7f6606000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6608074f40 0x7f660819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.522+0000 7f6607400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f660810e3c0 0x7f660819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.523+0000 7f6606000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6608074f40 0x7f660819ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:49860/0 (socket says 172.21.15.3:49860) 2024-09-19T06:18:28.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.523+0000 7f6607400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f660810e3c0 0x7f660819eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:36154/0 (socket says 172.21.15.3:36154) 2024-09-19T06:18:28.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.523+0000 7f6606000640 1 -- 172.21.15.3:0/291103479 learned_addr learned my addr 172.21.15.3:0/291103479 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:28.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.523+0000 7f6606a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6608074620 0x7f660819a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43170/0 (socket says 172.21.15.3:43170) 2024-09-19T06:18:28.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.523+0000 7f6607400640 1 -- 172.21.15.3:0/291103479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6608074f40 msgr2=0x7f660819ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:28.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.523+0000 7f6607400640 1 --2- 172.21.15.3:0/291103479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6608074f40 0x7f660819ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.523+0000 7f6607400640 1 -- 172.21.15.3:0/291103479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6608074620 msgr2=0x7f660819a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:28.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.523+0000 7f6607400640 1 --2- 172.21.15.3:0/291103479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6608074620 0x7f660819a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.523+0000 7f6607400640 1 -- 172.21.15.3:0/291103479 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660819f5c0 con 0x7f660810e3c0 2024-09-19T06:18:28.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.523+0000 7f6606a00640 1 --2- 172.21.15.3:0/291103479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6608074620 0x7f660819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:28.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.523+0000 7f6607400640 1 --2- 172.21.15.3:0/291103479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f660810e3c0 0x7f660819eee0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6600005cc0 tx=0x7f660002f420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:28.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.524+0000 7f65ff400640 1 -- 172.21.15.3:0/291103479 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600034040 con 0x7f660810e3c0 2024-09-19T06:18:28.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.524+0000 7f660d800640 1 -- 172.21.15.3:0/291103479 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f660819f850 con 0x7f660810e3c0 2024-09-19T06:18:28.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.524+0000 7f65ff400640 1 -- 172.21.15.3:0/291103479 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6600030920 con 0x7f660810e3c0 2024-09-19T06:18:28.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.524+0000 7f660d800640 1 -- 172.21.15.3:0/291103479 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66081a7190 con 0x7f660810e3c0 2024-09-19T06:18:28.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.524+0000 7f65ff400640 1 -- 172.21.15.3:0/291103479 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600004610 con 0x7f660810e3c0 2024-09-19T06:18:28.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.527+0000 7f6610239740 1 Processor -- start 2024-09-19T06:18:28.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.527+0000 7f65ff400640 1 -- 172.21.15.3:0/291103479 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f6600037020 con 0x7f660810e3c0 2024-09-19T06:18:28.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.527+0000 7f6610239740 1 -- start start 2024-09-19T06:18:28.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.528+0000 7f6610239740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d852773c70 0x55d852774050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.528+0000 7f6610239740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d852774590 0x55d85277e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.528+0000 7f6610239740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d85277ee50 0x55d852781240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.528+0000 7f6610239740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d8526da3e0 con 0x55d852774590 2024-09-19T06:18:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.528+0000 7f6610239740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d852681d80 con 0x55d852773c70 2024-09-19T06:18:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.528+0000 7f6610239740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d8526d63a0 con 0x55d85277ee50 2024-09-19T06:18:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.528+0000 7f6606a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d852774590 0x55d85277e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.528+0000 7f6606a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d852774590 0x55d85277e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43186/0 (socket says 172.21.15.3:43186) 2024-09-19T06:18:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.528+0000 7f6606a00640 1 -- 172.21.15.3:0/779257655 learned_addr learned my addr 172.21.15.3:0/779257655 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.528+0000 7f6606000640 1 --2- 172.21.15.3:0/779257655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d852773c70 0x55d852774050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.528+0000 7f6606000640 1 --2- 172.21.15.3:0/779257655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d85277ee50 0x55d852781240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.528+0000 7f6606a00640 1 -- 172.21.15.3:0/779257655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d85277ee50 msgr2=0x55d852781240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:28.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.528+0000 7f6606a00640 1 --2- 172.21.15.3:0/779257655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d85277ee50 0x55d852781240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.528+0000 7f6606a00640 1 -- 172.21.15.3:0/779257655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d852773c70 msgr2=0x55d852774050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:28.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.528+0000 7f6606a00640 1 --2- 172.21.15.3:0/779257655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d852773c70 0x55d852774050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.528+0000 7f6606a00640 1 -- 172.21.15.3:0/779257655 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8526a0ae0 con 0x55d852774590 2024-09-19T06:18:28.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.528+0000 7f6606000640 1 --2- 172.21.15.3:0/779257655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d852773c70 0x55d852774050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:28.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.529+0000 7f6606a00640 1 --2- 172.21.15.3:0/779257655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d852774590 0x55d85277e910 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f65f80115f0 tx=0x7f65f8011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab4538cbee313de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.529+0000 7f65f3e00640 1 -- 172.21.15.3:0/779257655 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f801e070 con 0x55d852774590 2024-09-19T06:18:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.529+0000 7f65ff400640 1 --2- 172.21.15.3:0/291103479 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f65ec0a3430 0x7f65ec0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.529+0000 7f65f3e00640 1 -- 172.21.15.3:0/779257655 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65f800fb20 con 0x55d852774590 2024-09-19T06:18:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.529+0000 7f65f3e00640 1 -- 172.21.15.3:0/779257655 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8019bf0 con 0x55d852774590 2024-09-19T06:18:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.529+0000 7f65ff400640 1 -- 172.21.15.3:0/291103479 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f66000f09d0 con 0x7f660810e3c0 2024-09-19T06:18:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.530+0000 7f6606000640 1 --2- 172.21.15.3:0/291103479 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f65ec0a3430 0x7f65ec0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.530+0000 7f6610239740 1 -- 172.21.15.3:0/779257655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d852774590 msgr2=0x55d85277e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.530+0000 7f6610239740 1 --2- 172.21.15.3:0/779257655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d852774590 0x55d85277e910 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f65f80115f0 tx=0x7f65f8011ab0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.530+0000 7f6610239740 1 -- 172.21.15.3:0/779257655 shutdown_connections 2024-09-19T06:18:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.530+0000 7f6610239740 1 --2- 172.21.15.3:0/779257655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d85277ee50 0x55d852781240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.530+0000 7f6610239740 1 --2- 172.21.15.3:0/779257655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d852774590 0x55d85277e910 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.530+0000 7f6610239740 1 --2- 172.21.15.3:0/779257655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d852773c70 0x55d852774050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.530+0000 7f6610239740 1 -- 172.21.15.3:0/779257655 >> 172.21.15.3:0/779257655 conn(0x55d852770200 msgr2=0x55d8527705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.530+0000 7f6606000640 1 --2- 172.21.15.3:0/291103479 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f65ec0a3430 0x7f65ec0a58f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x55d852771580 tx=0x7f65f4014040 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.530+0000 7f6610239740 1 -- 172.21.15.3:0/779257655 shutdown_connections 2024-09-19T06:18:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.530+0000 7f6610239740 1 -- 172.21.15.3:0/779257655 wait complete. 2024-09-19T06:18:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.531+0000 7f6610239740 1 -- start start 2024-09-19T06:18:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.531+0000 7f6610239740 1 Processor -- start 2024-09-19T06:18:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.531+0000 7f6610239740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d852773c70 0x55d85277bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.531+0000 7f6610239740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d852774590 0x55d85277c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.531+0000 7f6610239740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d85277ee50 0x55d85277c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.532+0000 7f6610239740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d852781a20 con 0x55d85277ee50 2024-09-19T06:18:28.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.532+0000 7f6610239740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d8526950f0 con 0x55d852773c70 2024-09-19T06:18:28.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.532+0000 7f6610239740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d852781ba0 con 0x55d852774590 2024-09-19T06:18:28.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.532+0000 7f6610239740 10 client.0 _ll_register_callbacks cb 0x55d85267cbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:28.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.532+0000 7f6606a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d852773c70 0x55d85277bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.532+0000 7f6606a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d852773c70 0x55d85277bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:49876/0 (socket says 172.21.15.3:49876) 2024-09-19T06:18:28.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.532+0000 7f6606a00640 1 -- 172.21.15.3:0/1934338456 learned_addr learned my addr 172.21.15.3:0/1934338456 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:28.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.532+0000 7f6606000640 1 --2- 172.21.15.3:0/1934338456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d852774590 0x55d85277c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.532+0000 7f6607400640 1 --2- 172.21.15.3:0/1934338456 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d85277ee50 0x55d85277c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.532+0000 7f6606a00640 1 -- 172.21.15.3:0/1934338456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d852774590 msgr2=0x55d85277c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:28.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.532+0000 7f6606a00640 1 --2- 172.21.15.3:0/1934338456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d852774590 0x55d85277c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.532+0000 7f6606a00640 1 -- 172.21.15.3:0/1934338456 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d85277ee50 msgr2=0x55d85277c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:28.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.532+0000 7f6606a00640 1 --2- 172.21.15.3:0/1934338456 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d85277ee50 0x55d85277c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.532+0000 7f6606a00640 1 -- 172.21.15.3:0/1934338456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d85244b3c0 con 0x55d852773c70 2024-09-19T06:18:28.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.533+0000 7f6606a00640 1 --2- 172.21.15.3:0/1934338456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d852773c70 0x55d85277bcc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f65f800f8f0 tx=0x7f65f800f920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e447f8eed14c5b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:28.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.533+0000 7f65f0c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:18:28.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.533+0000 7f65f0c00640 1 -- 172.21.15.3:0/1934338456 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f801e040 con 0x55d852773c70 2024-09-19T06:18:28.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.533+0000 7f65f0c00640 1 -- 172.21.15.3:0/1934338456 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f65f8004050 con 0x55d852773c70 2024-09-19T06:18:28.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.533+0000 7f6610239740 1 -- 172.21.15.3:0/1934338456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65f800fb20 con 0x55d852773c70 2024-09-19T06:18:28.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.533+0000 7f65f0c00640 1 -- 172.21.15.3:0/1934338456 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f65f802f050 con 0x55d852773c70 2024-09-19T06:18:28.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.533+0000 7f6610239740 10 client.26855 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:28.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.533+0000 7f6610239740 1 -- 172.21.15.3:0/1934338456 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d85278d9e0 con 0x55d852773c70 2024-09-19T06:18:28.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.534+0000 7f65f0c00640 1 -- 172.21.15.3:0/1934338456 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65f800fb20 con 0x55d852773c70 2024-09-19T06:18:28.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.534+0000 7f65f0c00640 1 -- 172.21.15.3:0/1934338456 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f65f802a030 con 0x55d852773c70 2024-09-19T06:18:28.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.534+0000 7f6610239740 10 client.26855 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:28.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.534+0000 7f6610239740 10 client.26855 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:18:28.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.534+0000 7f6610239740 20 client.26855 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:28.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.534+0000 7f6610239740 1 --2- 172.21.15.3:0/1934338456 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55d85278eea0 0x55d852791290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.534+0000 7f6610239740 4 client.26855 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:28.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.534+0000 7f6610239740 1 -- 172.21.15.3:0/1934338456 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8526e7950 con 0x55d85278eea0 2024-09-19T06:18:28.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.535+0000 7f6606000640 1 --2- 172.21.15.3:0/1934338456 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55d85278eea0 0x55d852791290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.535+0000 7f6606000640 1 --2- 172.21.15.3:0/1934338456 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55d85278eea0 0x55d852791290 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6e671ea4ae7ec28a server_cookie=498f8d5c38d642a5 in_seq=0 out_seq=0 2024-09-19T06:18:28.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.535+0000 7f65f0c00640 10 client.26855 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:18:28.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.536+0000 7f65f0c00640 1 -- 172.21.15.3:0/1934338456 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d8526e7950 con 0x55d85278eea0 2024-09-19T06:18:28.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.536+0000 7f65f0c00640 10 client.26855 handle_command_reply: tid=0 2024-09-19T06:18:28.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.536+0000 7f6610239740 1 client.26855 shutdown 2024-09-19T06:18:28.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.536+0000 7f6610239740 1 -- 172.21.15.3:0/1934338456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d852773c70 msgr2=0x55d85277bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:28.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.536+0000 7f6610239740 1 --2- 172.21.15.3:0/1934338456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d852773c70 0x55d85277bcc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f65f800f8f0 tx=0x7f65f800f920 comp rx=0 tx=0).stop 2024-09-19T06:18:28.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.536+0000 7f6610239740 1 -- 172.21.15.3:0/1934338456 shutdown_connections 2024-09-19T06:18:28.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.536+0000 7f6610239740 1 --2- 172.21.15.3:0/1934338456 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55d85278eea0 0x55d852791290 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.536+0000 7f6610239740 1 --2- 172.21.15.3:0/1934338456 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d85277ee50 0x55d85277c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.536+0000 7f6610239740 1 --2- 172.21.15.3:0/1934338456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d852774590 0x55d85277c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.536+0000 7f6610239740 1 --2- 172.21.15.3:0/1934338456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d852773c70 0x55d85277bcc0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.536+0000 7f65f0c00640 0 client.26855 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:18:28.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.536+0000 7f6610239740 1 -- 172.21.15.3:0/1934338456 >> 172.21.15.3:0/1934338456 conn(0x55d852770200 msgr2=0x55d85276f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:28.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.536+0000 7f6610239740 1 -- 172.21.15.3:0/1934338456 shutdown_connections 2024-09-19T06:18:28.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.536+0000 7f6610239740 1 -- 172.21.15.3:0/1934338456 wait complete. 2024-09-19T06:18:28.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.537+0000 7f6610239740 20 client.26855 trim_cache size 0 max 16384 2024-09-19T06:18:28.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.551+0000 7f6610239740 1 Processor -- start 2024-09-19T06:18:28.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.551+0000 7f6610239740 1 -- start start 2024-09-19T06:18:28.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.551+0000 7f6610239740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d852773c70 0x55d8527766d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.551+0000 7f6610239740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d852774590 0x55d852796a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.551+0000 7f6610239740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d85277ee50 0x55d852796fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.551+0000 7f6610239740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f66081afb10 con 0x55d852774590 2024-09-19T06:18:28.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.551+0000 7f6610239740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f66081b1650 con 0x55d852773c70 2024-09-19T06:18:28.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.551+0000 7f6610239740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f66081b01e0 con 0x55d85277ee50 2024-09-19T06:18:28.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.552+0000 7f6606000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d852774590 0x55d852796a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.552+0000 7f6606000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d852774590 0x55d852796a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43198/0 (socket says 172.21.15.3:43198) 2024-09-19T06:18:28.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.552+0000 7f6606000640 1 -- 172.21.15.3:0/28576864 learned_addr learned my addr 172.21.15.3:0/28576864 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:28.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.552+0000 7f6606a00640 1 --2- 172.21.15.3:0/28576864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d852773c70 0x55d8527766d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.552+0000 7f6607400640 1 --2- 172.21.15.3:0/28576864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d85277ee50 0x55d852796fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.552+0000 7f6606000640 1 -- 172.21.15.3:0/28576864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d85277ee50 msgr2=0x55d852796fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:28.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.552+0000 7f6606000640 1 --2- 172.21.15.3:0/28576864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d85277ee50 0x55d852796fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.552+0000 7f6606000640 1 -- 172.21.15.3:0/28576864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d852773c70 msgr2=0x55d8527766d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:28.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.552+0000 7f6606000640 1 --2- 172.21.15.3:0/28576864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d852773c70 0x55d8527766d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.552+0000 7f6606000640 1 -- 172.21.15.3:0/28576864 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d852770030 con 0x55d852774590 2024-09-19T06:18:28.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.552+0000 7f6606000640 1 --2- 172.21.15.3:0/28576864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d852774590 0x55d852796a70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f65f4005e00 tx=0x7f65f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baba1e60375af61f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:28.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.553+0000 7f65f3400640 1 -- 172.21.15.3:0/28576864 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f4030070 con 0x55d852774590 2024-09-19T06:18:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.553+0000 7f65f3400640 1 -- 172.21.15.3:0/28576864 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65f401a070 con 0x55d852774590 2024-09-19T06:18:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.553+0000 7f65f3400640 1 -- 172.21.15.3:0/28576864 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f4023e60 con 0x55d852774590 2024-09-19T06:18:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.553+0000 7f6610239740 1 -- 172.21.15.3:0/28576864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d852774590 msgr2=0x55d852796a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.553+0000 7f6610239740 1 --2- 172.21.15.3:0/28576864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d852774590 0x55d852796a70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f65f4005e00 tx=0x7f65f40046c0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.553+0000 7f6610239740 1 -- 172.21.15.3:0/28576864 shutdown_connections 2024-09-19T06:18:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.553+0000 7f6610239740 1 --2- 172.21.15.3:0/28576864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d85277ee50 0x55d852796fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.553+0000 7f6610239740 1 --2- 172.21.15.3:0/28576864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d852774590 0x55d852796a70 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.554+0000 7f6610239740 1 --2- 172.21.15.3:0/28576864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d852773c70 0x55d8527766d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.554+0000 7f6610239740 1 -- 172.21.15.3:0/28576864 >> 172.21.15.3:0/28576864 conn(0x55d852770200 msgr2=0x55d85277dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.554+0000 7f6610239740 1 -- 172.21.15.3:0/28576864 shutdown_connections 2024-09-19T06:18:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.554+0000 7f6610239740 1 -- 172.21.15.3:0/28576864 wait complete. 2024-09-19T06:18:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.554+0000 7f6610239740 1 -- start start 2024-09-19T06:18:28.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.554+0000 7f6610239740 1 Processor -- start 2024-09-19T06:18:28.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.555+0000 7f6610239740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d852773c70 0x55d852787290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.555+0000 7f6610239740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d852774590 0x55d8527825c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.555+0000 7f6610239740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d85277ee50 0x55d852782b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.555+0000 7f6610239740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f66081b0f80 con 0x55d852773c70 2024-09-19T06:18:28.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.555+0000 7f6610239740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f66081b08b0 con 0x55d852774590 2024-09-19T06:18:28.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.555+0000 7f6610239740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f66081adaf0 con 0x55d85277ee50 2024-09-19T06:18:28.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.555+0000 7f6610239740 10 client.0 _ll_register_callbacks cb 0x7f65f801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:28.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.555+0000 7f6606a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d852773c70 0x55d852787290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.555+0000 7f6606a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d852773c70 0x55d852787290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43212/0 (socket says 172.21.15.3:43212) 2024-09-19T06:18:28.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.555+0000 7f6606000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d852774590 0x55d8527825c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.555+0000 7f6606a00640 1 -- 172.21.15.3:0/1614944288 learned_addr learned my addr 172.21.15.3:0/1614944288 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:28.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.555+0000 7f6607400640 1 --2- 172.21.15.3:0/1614944288 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d85277ee50 0x55d852782b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.555+0000 7f6606a00640 1 -- 172.21.15.3:0/1614944288 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d85277ee50 msgr2=0x55d852782b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:28.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.555+0000 7f6606a00640 1 --2- 172.21.15.3:0/1614944288 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d85277ee50 0x55d852782b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.555+0000 7f6606a00640 1 -- 172.21.15.3:0/1614944288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d852774590 msgr2=0x55d8527825c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:28.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.555+0000 7f6606a00640 1 --2- 172.21.15.3:0/1614944288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d852774590 0x55d8527825c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.555+0000 7f6606a00640 1 -- 172.21.15.3:0/1614944288 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d852783040 con 0x55d852773c70 2024-09-19T06:18:28.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.555+0000 7f6607400640 1 --2- 172.21.15.3:0/1614944288 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d85277ee50 0x55d852782b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:28.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.555+0000 7f6606000640 1 --2- 172.21.15.3:0/1614944288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d852774590 0x55d8527825c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:28.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.556+0000 7f6606a00640 1 --2- 172.21.15.3:0/1614944288 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d852773c70 0x55d852787290 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f65f8019640 tx=0x7f65f8019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725d1e08b54ac582 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:28.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.556+0000 7f65f0c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:18:28.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.556+0000 7f65f0c00640 1 -- 172.21.15.3:0/1614944288 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f801e030 con 0x55d852773c70 2024-09-19T06:18:28.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.556+0000 7f65f0c00640 1 -- 172.21.15.3:0/1614944288 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f65f8005270 con 0x55d852773c70 2024-09-19T06:18:28.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.556+0000 7f6610239740 1 -- 172.21.15.3:0/1614944288 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65f401a070 con 0x55d852773c70 2024-09-19T06:18:28.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.556+0000 7f65f0c00640 1 -- 172.21.15.3:0/1614944288 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f65f8003b50 con 0x55d852773c70 2024-09-19T06:18:28.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.556+0000 7f6610239740 10 client.16824 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:28.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.556+0000 7f6610239740 1 -- 172.21.15.3:0/1614944288 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d8527f9790 con 0x55d852773c70 2024-09-19T06:18:28.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.557+0000 7f65f0c00640 1 -- 172.21.15.3:0/1614944288 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65f401a070 con 0x55d852773c70 2024-09-19T06:18:28.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.557+0000 7f65f0c00640 1 -- 172.21.15.3:0/1614944288 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f65f802a040 con 0x55d852773c70 2024-09-19T06:18:28.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.557+0000 7f6610239740 10 client.16824 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:28.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.557+0000 7f6610239740 10 client.16824 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:18:28.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.557+0000 7f6610239740 20 client.16824 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:28.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.557+0000 7f6610239740 1 --2- 172.21.15.3:0/1614944288 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55d8527f9e80 0x55d8527fc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:28.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.557+0000 7f6610239740 4 client.16824 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:18:28.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.557+0000 7f6610239740 1 -- 172.21.15.3:0/1614944288 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d8526e1e60 con 0x55d8527f9e80 2024-09-19T06:18:28.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.557+0000 7f6606000640 1 --2- 172.21.15.3:0/1614944288 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55d8527f9e80 0x55d8527fc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:28.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.558+0000 7f6606000640 1 --2- 172.21.15.3:0/1614944288 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55d8527f9e80 0x55d8527fc2a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2196d95ae6d4c969 server_cookie=937135420cfc8ddc in_seq=0 out_seq=0 2024-09-19T06:18:28.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.558+0000 7f65f0c00640 10 client.16824 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:18:28.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.558+0000 7f65f0c00640 1 -- 172.21.15.3:0/1614944288 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d8526e1e60 con 0x55d8527f9e80 2024-09-19T06:18:28.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.558+0000 7f65f0c00640 10 client.16824 handle_command_reply: tid=0 2024-09-19T06:18:28.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.558+0000 7f6610239740 1 client.16824 shutdown 2024-09-19T06:18:28.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.558+0000 7f6610239740 1 -- 172.21.15.3:0/1614944288 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d852773c70 msgr2=0x55d852787290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:28.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.558+0000 7f6610239740 1 --2- 172.21.15.3:0/1614944288 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d852773c70 0x55d852787290 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f65f8019640 tx=0x7f65f8019670 comp rx=0 tx=0).stop 2024-09-19T06:18:28.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.558+0000 7f6610239740 1 -- 172.21.15.3:0/1614944288 shutdown_connections 2024-09-19T06:18:28.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.558+0000 7f6610239740 1 --2- 172.21.15.3:0/1614944288 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55d8527f9e80 0x55d8527fc2a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.558+0000 7f6610239740 1 --2- 172.21.15.3:0/1614944288 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d85277ee50 0x55d852782b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.558+0000 7f6610239740 1 --2- 172.21.15.3:0/1614944288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d852774590 0x55d8527825c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.558+0000 7f6610239740 1 --2- 172.21.15.3:0/1614944288 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d852773c70 0x55d852787290 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.558+0000 7f65f0c00640 0 client.16824 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:18:28.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.558+0000 7f6610239740 1 -- 172.21.15.3:0/1614944288 >> 172.21.15.3:0/1614944288 conn(0x55d852770200 msgr2=0x55d85276eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:28.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.559+0000 7f6610239740 1 -- 172.21.15.3:0/1614944288 shutdown_connections 2024-09-19T06:18:28.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.559+0000 7f6610239740 1 -- 172.21.15.3:0/1614944288 wait complete. 2024-09-19T06:18:28.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.559+0000 7f6610239740 20 client.16824 trim_cache size 0 max 16384 2024-09-19T06:18:28.564 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:18:28.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.559+0000 7f660d800640 1 -- 172.21.15.3:0/291103479 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f65ec0a3430 msgr2=0x7f65ec0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:28.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.559+0000 7f660d800640 1 --2- 172.21.15.3:0/291103479 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f65ec0a3430 0x7f65ec0a58f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x55d852771580 tx=0x7f65f4014040 comp rx=0 tx=0).stop 2024-09-19T06:18:28.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.559+0000 7f660d800640 1 -- 172.21.15.3:0/291103479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f660810e3c0 msgr2=0x7f660819eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:28.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.559+0000 7f660d800640 1 --2- 172.21.15.3:0/291103479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f660810e3c0 0x7f660819eee0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6600005cc0 tx=0x7f660002f420 comp rx=0 tx=0).stop 2024-09-19T06:18:28.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.560+0000 7f660d800640 1 -- 172.21.15.3:0/291103479 shutdown_connections 2024-09-19T06:18:28.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.560+0000 7f660d800640 1 --2- 172.21.15.3:0/291103479 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f65ec0a3430 0x7f65ec0a58f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.560+0000 7f660d800640 1 --2- 172.21.15.3:0/291103479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f660810e3c0 0x7f660819eee0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.560+0000 7f660d800640 1 --2- 172.21.15.3:0/291103479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6608074f40 0x7f660819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.560+0000 7f660d800640 1 --2- 172.21.15.3:0/291103479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6608074620 0x7f660819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:28.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.560+0000 7f660d800640 1 -- 172.21.15.3:0/291103479 >> 172.21.15.3:0/291103479 conn(0x7f66080fd8c0 msgr2=0x7f66080fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:28.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.560+0000 7f660d800640 1 -- 172.21.15.3:0/291103479 shutdown_connections 2024-09-19T06:18:28.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:28.560+0000 7f660d800640 1 -- 172.21.15.3:0/291103479 wait complete. 2024-09-19T06:18:29.596 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:18:29.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:29 smithi003 ceph-mon[30893]: pgmap v186: 97 pgs: 97 active+clean; 5.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-19T06:18:29.985 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:30.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:29 smithi059 ceph-mon[35138]: pgmap v186: 97 pgs: 97 active+clean; 5.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-19T06:18:30.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:29 smithi071 ceph-mon[35662]: pgmap v186: 97 pgs: 97 active+clean; 5.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-19T06:18:30.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.568+0000 7fc101800640 1 -- 172.21.15.3:0/222814876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0fc112a30 msgr2=0x7fc0fc114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:30.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.568+0000 7fc101800640 1 --2- 172.21.15.3:0/222814876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0fc112a30 0x7fc0fc114e20 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4009ca0 tx=0x7fc0f402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.568+0000 7fc101800640 1 -- 172.21.15.3:0/222814876 shutdown_connections 2024-09-19T06:18:30.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.568+0000 7fc101800640 1 --2- 172.21.15.3:0/222814876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0fc112a30 0x7fc0fc114e20 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.568+0000 7fc101800640 1 --2- 172.21.15.3:0/222814876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0fc077040 0x7fc0fc1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.568+0000 7fc101800640 1 --2- 172.21.15.3:0/222814876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0fc076720 0x7fc0fc076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.568+0000 7fc101800640 1 -- 172.21.15.3:0/222814876 >> 172.21.15.3:0/222814876 conn(0x7fc0fc0ffa90 msgr2=0x7fc0fc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:30.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.569+0000 7fc101800640 1 -- 172.21.15.3:0/222814876 shutdown_connections 2024-09-19T06:18:30.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.569+0000 7fc101800640 1 -- 172.21.15.3:0/222814876 wait complete. 2024-09-19T06:18:30.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.570+0000 7fc101800640 1 Processor -- start 2024-09-19T06:18:30.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.570+0000 7fc101800640 1 -- start start 2024-09-19T06:18:30.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.570+0000 7fc101800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0fc076720 0x7fc0fc1a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:30.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.570+0000 7fc101800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0fc077040 0x7fc0fc1a4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:30.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.570+0000 7fc101800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0fc112a30 0x7fc0fc19e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:30.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.570+0000 7fc101800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc0fc1185e0 con 0x7fc0fc077040 2024-09-19T06:18:30.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.570+0000 7fc101800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc0fc118460 con 0x7fc0fc076720 2024-09-19T06:18:30.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.571+0000 7fc101800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc0fc118760 con 0x7fc0fc112a30 2024-09-19T06:18:30.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.571+0000 7fc0faa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0fc076720 0x7fc0fc1a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:30.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.571+0000 7fc0f3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0fc077040 0x7fc0fc1a4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:30.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.571+0000 7fc0faa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0fc076720 0x7fc0fc1a4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:49928/0 (socket says 172.21.15.3:49928) 2024-09-19T06:18:30.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.571+0000 7fc0faa00640 1 -- 172.21.15.3:0/841383591 learned_addr learned my addr 172.21.15.3:0/841383591 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:30.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.571+0000 7fc0fb400640 1 --2- 172.21.15.3:0/841383591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0fc112a30 0x7fc0fc19e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:30.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.571+0000 7fc0faa00640 1 -- 172.21.15.3:0/841383591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0fc112a30 msgr2=0x7fc0fc19e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:30.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.571+0000 7fc0faa00640 1 --2- 172.21.15.3:0/841383591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0fc112a30 0x7fc0fc19e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.571+0000 7fc0faa00640 1 -- 172.21.15.3:0/841383591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0fc077040 msgr2=0x7fc0fc1a4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:30.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.571+0000 7fc0faa00640 1 --2- 172.21.15.3:0/841383591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0fc077040 0x7fc0fc1a4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.571+0000 7fc0faa00640 1 -- 172.21.15.3:0/841383591 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0fc19f040 con 0x7fc0fc076720 2024-09-19T06:18:30.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.572+0000 7fc0faa00640 1 --2- 172.21.15.3:0/841383591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0fc076720 0x7fc0fc1a4750 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec00e9f0 tx=0x7fc0ec00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:30.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.572+0000 7fc0f3400640 1 -- 172.21.15.3:0/841383591 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec00cd80 con 0x7fc0fc076720 2024-09-19T06:18:30.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.572+0000 7fc0f3400640 1 -- 172.21.15.3:0/841383591 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0ec010910 con 0x7fc0fc076720 2024-09-19T06:18:30.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.572+0000 7fc0f3400640 1 -- 172.21.15.3:0/841383591 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec018990 con 0x7fc0fc076720 2024-09-19T06:18:30.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.572+0000 7fc101800640 1 -- 172.21.15.3:0/841383591 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0fc19f330 con 0x7fc0fc076720 2024-09-19T06:18:30.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.572+0000 7fc101800640 1 -- 172.21.15.3:0/841383591 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0fc1ab620 con 0x7fc0fc076720 2024-09-19T06:18:30.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.575+0000 7fc104448740 1 Processor -- start 2024-09-19T06:18:30.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.575+0000 7fc0f3400640 1 -- 172.21.15.3:0/841383591 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fc0ec010ac0 con 0x7fc0fc076720 2024-09-19T06:18:30.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.575+0000 7fc104448740 1 -- start start 2024-09-19T06:18:30.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.576+0000 7fc104448740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b3d4fdc70 0x557b3d4fe050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:30.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.576+0000 7fc104448740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b3d4fe590 0x557b3d508910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:30.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.576+0000 7fc104448740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b3d508e50 0x557b3d50b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:30.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.576+0000 7fc104448740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557b3d4643e0 con 0x557b3d4fdc70 2024-09-19T06:18:30.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.576+0000 7fc104448740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557b3d40bd80 con 0x557b3d4fe590 2024-09-19T06:18:30.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.576+0000 7fc104448740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557b3d4603a0 con 0x557b3d508e50 2024-09-19T06:18:30.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.576+0000 7fc0fb400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b3d4fdc70 0x557b3d4fe050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:30.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.576+0000 7fc0fb400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b3d4fdc70 0x557b3d4fe050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43250/0 (socket says 172.21.15.3:43250) 2024-09-19T06:18:30.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.576+0000 7fc0fb400640 1 -- 172.21.15.3:0/4100648573 learned_addr learned my addr 172.21.15.3:0/4100648573 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:30.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.576+0000 7fc0faa00640 1 --2- 172.21.15.3:0/4100648573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b3d4fe590 0x557b3d508910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:30.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.576+0000 7fc0f3e00640 1 --2- 172.21.15.3:0/4100648573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b3d508e50 0x557b3d50b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:30.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.577+0000 7fc0fb400640 1 -- 172.21.15.3:0/4100648573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b3d508e50 msgr2=0x557b3d50b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:30.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.577+0000 7fc0fb400640 1 --2- 172.21.15.3:0/4100648573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b3d508e50 0x557b3d50b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.577+0000 7fc0fb400640 1 -- 172.21.15.3:0/4100648573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b3d4fe590 msgr2=0x557b3d508910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:30.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.577+0000 7fc0fb400640 1 --2- 172.21.15.3:0/4100648573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b3d4fe590 0x557b3d508910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.577+0000 7fc0fb400640 1 -- 172.21.15.3:0/4100648573 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b3d42aae0 con 0x557b3d4fdc70 2024-09-19T06:18:30.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.577+0000 7fc0fb400640 1 --2- 172.21.15.3:0/4100648573 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b3d4fdc70 0x557b3d4fe050 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc07aa10 tx=0x7fc0f4005f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e0f6585f1adc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:30.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.577+0000 7fc0ebe00640 1 -- 172.21.15.3:0/4100648573 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4031db0 con 0x557b3d4fdc70 2024-09-19T06:18:30.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.577+0000 7fc0ebe00640 1 -- 172.21.15.3:0/4100648573 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0f4036030 con 0x557b3d4fdc70 2024-09-19T06:18:30.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.577+0000 7fc0f3400640 1 --2- 172.21.15.3:0/841383591 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc0e00a3430 0x7fc0e00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:30.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.578+0000 7fc0ebe00640 1 -- 172.21.15.3:0/4100648573 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4004280 con 0x557b3d4fdc70 2024-09-19T06:18:30.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.578+0000 7fc0f3400640 1 -- 172.21.15.3:0/841383591 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fc0ec0cfff0 con 0x7fc0fc076720 2024-09-19T06:18:30.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.578+0000 7fc0faa00640 1 --2- 172.21.15.3:0/841383591 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc0e00a3430 0x7fc0e00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:30.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.578+0000 7fc104448740 1 -- 172.21.15.3:0/4100648573 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b3d4fdc70 msgr2=0x557b3d4fe050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:30.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.578+0000 7fc104448740 1 --2- 172.21.15.3:0/4100648573 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b3d4fdc70 0x557b3d4fe050 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc07aa10 tx=0x7fc0f4005f80 comp rx=0 tx=0).stop 2024-09-19T06:18:30.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.578+0000 7fc104448740 1 -- 172.21.15.3:0/4100648573 shutdown_connections 2024-09-19T06:18:30.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.578+0000 7fc104448740 1 --2- 172.21.15.3:0/4100648573 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b3d508e50 0x557b3d50b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.578+0000 7fc104448740 1 --2- 172.21.15.3:0/4100648573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b3d4fe590 0x557b3d508910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.578+0000 7fc104448740 1 --2- 172.21.15.3:0/4100648573 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b3d4fdc70 0x557b3d4fe050 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.578+0000 7fc104448740 1 -- 172.21.15.3:0/4100648573 >> 172.21.15.3:0/4100648573 conn(0x557b3d4fa200 msgr2=0x557b3d4fa5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:30.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.579+0000 7fc104448740 1 -- 172.21.15.3:0/4100648573 shutdown_connections 2024-09-19T06:18:30.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.579+0000 7fc104448740 1 -- 172.21.15.3:0/4100648573 wait complete. 2024-09-19T06:18:30.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.579+0000 7fc0faa00640 1 --2- 172.21.15.3:0/841383591 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc0e00a3430 0x7fc0e00a58f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x557b3d4fb060 tx=0x7fc0ec0d3aa0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:30.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.579+0000 7fc104448740 1 -- start start 2024-09-19T06:18:30.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.579+0000 7fc104448740 1 Processor -- start 2024-09-19T06:18:30.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.580+0000 7fc104448740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b3d4fdc70 0x557b3d505cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:30.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.580+0000 7fc104448740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b3d4fe590 0x557b3d5061f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:30.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.580+0000 7fc104448740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b3d508e50 0x557b3d506730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:30.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.580+0000 7fc104448740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557b3d50b8a0 con 0x557b3d508e50 2024-09-19T06:18:30.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.580+0000 7fc104448740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557b3d41f0f0 con 0x557b3d4fdc70 2024-09-19T06:18:30.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.580+0000 7fc104448740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557b3d50ba20 con 0x557b3d4fe590 2024-09-19T06:18:30.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.580+0000 7fc104448740 10 client.0 _ll_register_callbacks cb 0x557b3d406bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:30.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.580+0000 7fc0fb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b3d4fdc70 0x557b3d505cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:30.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.580+0000 7fc0fb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b3d4fdc70 0x557b3d505cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:49944/0 (socket says 172.21.15.3:49944) 2024-09-19T06:18:30.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.580+0000 7fc0fb400640 1 -- 172.21.15.3:0/1929749613 learned_addr learned my addr 172.21.15.3:0/1929749613 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:30.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.580+0000 7fc0f3e00640 1 --2- 172.21.15.3:0/1929749613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b3d4fe590 0x557b3d5061f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:30.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.580+0000 7fc0fb400640 1 --2- 172.21.15.3:0/1929749613 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b3d508e50 0x557b3d506730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:30.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.581+0000 7fc0f3e00640 1 -- 172.21.15.3:0/1929749613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b3d4fdc70 msgr2=0x557b3d505cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:30.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.581+0000 7fc0f3e00640 1 --2- 172.21.15.3:0/1929749613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b3d4fdc70 0x557b3d505cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.581+0000 7fc0f3e00640 1 -- 172.21.15.3:0/1929749613 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b3d508e50 msgr2=0x557b3d506730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:30.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.581+0000 7fc0f3e00640 1 --2- 172.21.15.3:0/1929749613 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b3d508e50 0x557b3d506730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.581+0000 7fc0f3e00640 1 -- 172.21.15.3:0/1929749613 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b3d1d53c0 con 0x557b3d4fe590 2024-09-19T06:18:30.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.581+0000 7fc0f3e00640 1 --2- 172.21.15.3:0/1929749613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b3d4fe590 0x557b3d5061f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc0796d0 tx=0x7fc0e4012b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f1fd8240acfec1a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:30.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.581+0000 7fc0e8c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:18:30.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.581+0000 7fc0e8c00640 1 -- 172.21.15.3:0/1929749613 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e400f890 con 0x557b3d4fe590 2024-09-19T06:18:30.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.581+0000 7fc104448740 1 -- 172.21.15.3:0/1929749613 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0f4036030 con 0x557b3d4fe590 2024-09-19T06:18:30.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.581+0000 7fc0e8c00640 1 -- 172.21.15.3:0/1929749613 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fc0e400fa30 con 0x557b3d4fe590 2024-09-19T06:18:30.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.582+0000 7fc0e8c00640 1 -- 172.21.15.3:0/1929749613 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc0e400fc30 con 0x557b3d4fe590 2024-09-19T06:18:30.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.582+0000 7fc104448740 10 client.26881 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:30.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.582+0000 7fc104448740 1 -- 172.21.15.3:0/1929749613 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557b3d517940 con 0x557b3d4fe590 2024-09-19T06:18:30.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.582+0000 7fc0e8c00640 1 -- 172.21.15.3:0/1929749613 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0f4036030 con 0x557b3d4fe590 2024-09-19T06:18:30.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.582+0000 7fc0e8c00640 1 -- 172.21.15.3:0/1929749613 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc0e4010430 con 0x557b3d4fe590 2024-09-19T06:18:30.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.582+0000 7fc104448740 10 client.26881 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:30.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.582+0000 7fc104448740 10 client.26881 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:18:30.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.582+0000 7fc104448740 20 client.26881 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:30.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.582+0000 7fc104448740 1 --2- 172.21.15.3:0/1929749613 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x557b3d518e10 0x557b3d51b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:30.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.582+0000 7fc104448740 4 client.26881 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:30.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.582+0000 7fc104448740 1 -- 172.21.15.3:0/1929749613 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b3d471950 con 0x557b3d518e10 2024-09-19T06:18:30.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.583+0000 7fc0fb400640 1 --2- 172.21.15.3:0/1929749613 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x557b3d518e10 0x557b3d51b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:30.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.583+0000 7fc0fb400640 1 --2- 172.21.15.3:0/1929749613 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x557b3d518e10 0x557b3d51b230 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=17cc81b4877d35bd server_cookie=46e88d927fac332e in_seq=0 out_seq=0 2024-09-19T06:18:30.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.583+0000 7fc0e8c00640 10 client.26881 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:18:30.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.584+0000 7fc0e8c00640 1 -- 172.21.15.3:0/1929749613 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557b3d471950 con 0x557b3d518e10 2024-09-19T06:18:30.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.584+0000 7fc0e8c00640 10 client.26881 handle_command_reply: tid=0 2024-09-19T06:18:30.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.584+0000 7fc104448740 1 client.26881 shutdown 2024-09-19T06:18:30.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.584+0000 7fc104448740 1 -- 172.21.15.3:0/1929749613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b3d4fe590 msgr2=0x557b3d5061f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:30.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.584+0000 7fc104448740 1 --2- 172.21.15.3:0/1929749613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b3d4fe590 0x557b3d5061f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc0796d0 tx=0x7fc0e4012b60 comp rx=0 tx=0).stop 2024-09-19T06:18:30.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.584+0000 7fc104448740 1 -- 172.21.15.3:0/1929749613 shutdown_connections 2024-09-19T06:18:30.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.584+0000 7fc104448740 1 --2- 172.21.15.3:0/1929749613 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x557b3d518e10 0x557b3d51b230 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.584+0000 7fc104448740 1 --2- 172.21.15.3:0/1929749613 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b3d508e50 0x557b3d506730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.584+0000 7fc104448740 1 --2- 172.21.15.3:0/1929749613 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b3d4fe590 0x557b3d5061f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.584+0000 7fc104448740 1 --2- 172.21.15.3:0/1929749613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b3d4fdc70 0x557b3d505cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.584+0000 7fc104448740 1 -- 172.21.15.3:0/1929749613 >> 172.21.15.3:0/1929749613 conn(0x557b3d4fa200 msgr2=0x557b3d4f9380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:30.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.584+0000 7fc0e8c00640 0 client.26881 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:18:30.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.585+0000 7fc104448740 1 -- 172.21.15.3:0/1929749613 shutdown_connections 2024-09-19T06:18:30.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.585+0000 7fc104448740 1 -- 172.21.15.3:0/1929749613 wait complete. 2024-09-19T06:18:30.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.585+0000 7fc104448740 20 client.26881 trim_cache size 0 max 16384 2024-09-19T06:18:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.599+0000 7fc104448740 1 Processor -- start 2024-09-19T06:18:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.599+0000 7fc104448740 1 -- start start 2024-09-19T06:18:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.599+0000 7fc104448740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b3d4fdc70 0x557b3d507510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.599+0000 7fc104448740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b3d4fe590 0x557b3d506580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.599+0000 7fc104448740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b3d508e50 0x557b3d520b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:30.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.599+0000 7fc104448740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc0fc1b3f90 con 0x557b3d508e50 2024-09-19T06:18:30.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.599+0000 7fc104448740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc0fc1b5ad0 con 0x557b3d4fe590 2024-09-19T06:18:30.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.599+0000 7fc104448740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc0fc1b4660 con 0x557b3d4fdc70 2024-09-19T06:18:30.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.599+0000 7fc0fb400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b3d4fdc70 0x557b3d507510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:30.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.599+0000 7fc0fb400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b3d508e50 0x557b3d520b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:30.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.599+0000 7fc0fb400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b3d4fdc70 0x557b3d507510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:36236/0 (socket says 172.21.15.3:36236) 2024-09-19T06:18:30.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.599+0000 7fc0fb400640 1 -- 172.21.15.3:0/3334985742 learned_addr learned my addr 172.21.15.3:0/3334985742 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:30.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.599+0000 7fc0f3e00640 1 --2- 172.21.15.3:0/3334985742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b3d4fe590 0x557b3d506580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:30.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.600+0000 7fc0fb400640 1 -- 172.21.15.3:0/3334985742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b3d4fe590 msgr2=0x557b3d506580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:30.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.600+0000 7fc0fb400640 1 --2- 172.21.15.3:0/3334985742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b3d4fe590 0x557b3d506580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.600+0000 7fc0fb400640 1 -- 172.21.15.3:0/3334985742 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b3d508e50 msgr2=0x557b3d520b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:30.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.600+0000 7fc0fb400640 1 --2- 172.21.15.3:0/3334985742 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b3d508e50 0x557b3d520b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.600+0000 7fc0fb400640 1 -- 172.21.15.3:0/3334985742 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b3d5083c0 con 0x557b3d4fdc70 2024-09-19T06:18:30.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.600+0000 7fc0fb400640 1 --2- 172.21.15.3:0/3334985742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b3d4fdc70 0x557b3d507510 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc0f402f540 tx=0x7fc0f4005d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=897d526a5f68aadc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:30.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.600+0000 7fc0eb400640 1 -- 172.21.15.3:0/3334985742 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4031450 con 0x557b3d4fdc70 2024-09-19T06:18:30.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.600+0000 7fc0eb400640 1 -- 172.21.15.3:0/3334985742 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0f4036040 con 0x557b3d4fdc70 2024-09-19T06:18:30.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.600+0000 7fc0eb400640 1 -- 172.21.15.3:0/3334985742 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4004530 con 0x557b3d4fdc70 2024-09-19T06:18:30.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.601+0000 7fc104448740 1 -- 172.21.15.3:0/3334985742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b3d4fdc70 msgr2=0x557b3d507510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:30.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.601+0000 7fc104448740 1 --2- 172.21.15.3:0/3334985742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b3d4fdc70 0x557b3d507510 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc0f402f540 tx=0x7fc0f4005d80 comp rx=0 tx=0).stop 2024-09-19T06:18:30.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.601+0000 7fc104448740 1 -- 172.21.15.3:0/3334985742 shutdown_connections 2024-09-19T06:18:30.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.601+0000 7fc104448740 1 --2- 172.21.15.3:0/3334985742 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b3d508e50 0x557b3d520b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.601+0000 7fc104448740 1 --2- 172.21.15.3:0/3334985742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b3d4fe590 0x557b3d506580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.601+0000 7fc104448740 1 --2- 172.21.15.3:0/3334985742 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b3d4fdc70 0x557b3d507510 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.601+0000 7fc104448740 1 -- 172.21.15.3:0/3334985742 >> 172.21.15.3:0/3334985742 conn(0x557b3d4fa200 msgr2=0x557b3d504c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:30.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.601+0000 7fc104448740 1 -- 172.21.15.3:0/3334985742 shutdown_connections 2024-09-19T06:18:30.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.601+0000 7fc104448740 1 -- 172.21.15.3:0/3334985742 wait complete. 2024-09-19T06:18:30.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.601+0000 7fc104448740 1 -- start start 2024-09-19T06:18:30.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.602+0000 7fc104448740 1 Processor -- start 2024-09-19T06:18:30.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.602+0000 7fc104448740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b3d4fdc70 0x557b3d511000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:30.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.602+0000 7fc104448740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b3d4fe590 0x557b3d511540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:30.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.602+0000 7fc104448740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b3d508e50 0x557b3d50c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:30.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.602+0000 7fc104448740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc0fc1b5400 con 0x557b3d508e50 2024-09-19T06:18:30.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.602+0000 7fc104448740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc0fc1b4d30 con 0x557b3d4fdc70 2024-09-19T06:18:30.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.602+0000 7fc104448740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc0fc1b1f70 con 0x557b3d4fe590 2024-09-19T06:18:30.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.602+0000 7fc104448740 10 client.0 _ll_register_callbacks cb 0x7fc0e4009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:30.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.602+0000 7fc0f3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b3d4fe590 0x557b3d511540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:30.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.602+0000 7fc0fb400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b3d508e50 0x557b3d50c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:30.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.602+0000 7fc0f3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b3d4fe590 0x557b3d511540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:36250/0 (socket says 172.21.15.3:36250) 2024-09-19T06:18:30.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.602+0000 7fc0f3e00640 1 -- 172.21.15.3:0/3791752020 learned_addr learned my addr 172.21.15.3:0/3791752020 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:30.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.603+0000 7fc0fb400640 1 --2- 172.21.15.3:0/3791752020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b3d4fdc70 0x557b3d511000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:30.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.603+0000 7fc0fb400640 1 -- 172.21.15.3:0/3791752020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b3d4fe590 msgr2=0x557b3d511540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:30.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.603+0000 7fc0fb400640 1 --2- 172.21.15.3:0/3791752020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b3d4fe590 0x557b3d511540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.603+0000 7fc0fb400640 1 -- 172.21.15.3:0/3791752020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b3d4fdc70 msgr2=0x557b3d511000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:30.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.603+0000 7fc0fb400640 1 --2- 172.21.15.3:0/3791752020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b3d4fdc70 0x557b3d511000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.603+0000 7fc0fb400640 1 -- 172.21.15.3:0/3791752020 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b3d50cdb0 con 0x557b3d508e50 2024-09-19T06:18:30.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.603+0000 7fc0fb400640 1 --2- 172.21.15.3:0/3791752020 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b3d508e50 0x557b3d50c580 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4009bf0 tx=0x7fc0f4031ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbe2ed64af3aa71 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:30.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.603+0000 7fc0e8c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:18:30.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.603+0000 7fc0e8c00640 1 -- 172.21.15.3:0/3791752020 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4003970 con 0x557b3d508e50 2024-09-19T06:18:30.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.603+0000 7fc104448740 1 -- 172.21.15.3:0/3791752020 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0f4036040 con 0x557b3d508e50 2024-09-19T06:18:30.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.603+0000 7fc0e8c00640 1 -- 172.21.15.3:0/3791752020 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fc0f404a040 con 0x557b3d508e50 2024-09-19T06:18:30.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.604+0000 7fc0e8c00640 1 -- 172.21.15.3:0/3791752020 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc0f4003b10 con 0x557b3d508e50 2024-09-19T06:18:30.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.604+0000 7fc104448740 10 client.16842 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:30.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.604+0000 7fc104448740 1 -- 172.21.15.3:0/3791752020 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557b3d5836f0 con 0x557b3d508e50 2024-09-19T06:18:30.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.604+0000 7fc0e8c00640 1 -- 172.21.15.3:0/3791752020 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0f4036040 con 0x557b3d508e50 2024-09-19T06:18:30.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.604+0000 7fc0e8c00640 1 -- 172.21.15.3:0/3791752020 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc0f4043070 con 0x557b3d508e50 2024-09-19T06:18:30.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.604+0000 7fc104448740 10 client.16842 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:30.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.604+0000 7fc104448740 10 client.16842 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:18:30.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.604+0000 7fc104448740 20 client.16842 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:30.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.604+0000 7fc104448740 1 --2- 172.21.15.3:0/3791752020 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x557b3d583a80 0x557b3d585e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:30.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.604+0000 7fc104448740 4 client.16842 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:18:30.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.604+0000 7fc104448740 1 -- 172.21.15.3:0/3791752020 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557b3d46be60 con 0x557b3d583a80 2024-09-19T06:18:30.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.605+0000 7fc0f3e00640 1 --2- 172.21.15.3:0/3791752020 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x557b3d583a80 0x557b3d585e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:30.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.605+0000 7fc0f3e00640 1 --2- 172.21.15.3:0/3791752020 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x557b3d583a80 0x557b3d585e70 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bc2cefb6e3aabe1c server_cookie=b4fb7345fcaeeb11 in_seq=0 out_seq=0 2024-09-19T06:18:30.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.605+0000 7fc0e8c00640 10 client.16842 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:18:30.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.605+0000 7fc0e8c00640 1 -- 172.21.15.3:0/3791752020 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557b3d46be60 con 0x557b3d583a80 2024-09-19T06:18:30.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.605+0000 7fc0e8c00640 10 client.16842 handle_command_reply: tid=0 2024-09-19T06:18:30.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.606+0000 7fc104448740 1 client.16842 shutdown 2024-09-19T06:18:30.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.606+0000 7fc104448740 1 -- 172.21.15.3:0/3791752020 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b3d508e50 msgr2=0x557b3d50c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:30.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.606+0000 7fc104448740 1 --2- 172.21.15.3:0/3791752020 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b3d508e50 0x557b3d50c580 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4009bf0 tx=0x7fc0f4031ae0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.606+0000 7fc104448740 1 -- 172.21.15.3:0/3791752020 shutdown_connections 2024-09-19T06:18:30.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.606+0000 7fc104448740 1 --2- 172.21.15.3:0/3791752020 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x557b3d583a80 0x557b3d585e70 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.606+0000 7fc104448740 1 --2- 172.21.15.3:0/3791752020 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557b3d508e50 0x557b3d50c580 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.606+0000 7fc104448740 1 --2- 172.21.15.3:0/3791752020 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557b3d4fe590 0x557b3d511540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.606+0000 7fc104448740 1 --2- 172.21.15.3:0/3791752020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b3d4fdc70 0x557b3d511000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.606+0000 7fc0e8c00640 0 client.16842 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:18:30.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.606+0000 7fc104448740 1 -- 172.21.15.3:0/3791752020 >> 172.21.15.3:0/3791752020 conn(0x557b3d4fa200 msgr2=0x557b3d504450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:30.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.606+0000 7fc104448740 1 -- 172.21.15.3:0/3791752020 shutdown_connections 2024-09-19T06:18:30.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.606+0000 7fc104448740 1 -- 172.21.15.3:0/3791752020 wait complete. 2024-09-19T06:18:30.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.606+0000 7fc104448740 20 client.16842 trim_cache size 0 max 16384 2024-09-19T06:18:30.613 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:18:30.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.607+0000 7fc101800640 1 -- 172.21.15.3:0/841383591 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc0e00a3430 msgr2=0x7fc0e00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:30.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.607+0000 7fc101800640 1 --2- 172.21.15.3:0/841383591 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc0e00a3430 0x7fc0e00a58f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x557b3d4fb060 tx=0x7fc0ec0d3aa0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.607+0000 7fc101800640 1 -- 172.21.15.3:0/841383591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0fc076720 msgr2=0x7fc0fc1a4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:30.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.607+0000 7fc101800640 1 --2- 172.21.15.3:0/841383591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0fc076720 0x7fc0fc1a4750 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec00e9f0 tx=0x7fc0ec00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.607+0000 7fc101800640 1 -- 172.21.15.3:0/841383591 shutdown_connections 2024-09-19T06:18:30.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.607+0000 7fc101800640 1 --2- 172.21.15.3:0/841383591 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc0e00a3430 0x7fc0e00a58f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.607+0000 7fc101800640 1 --2- 172.21.15.3:0/841383591 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc0fc112a30 0x7fc0fc19e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.607+0000 7fc101800640 1 --2- 172.21.15.3:0/841383591 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc0fc077040 0x7fc0fc1a4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.607+0000 7fc101800640 1 --2- 172.21.15.3:0/841383591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0fc076720 0x7fc0fc1a4750 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:30.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.607+0000 7fc101800640 1 -- 172.21.15.3:0/841383591 >> 172.21.15.3:0/841383591 conn(0x7fc0fc0ffa90 msgr2=0x7fc0fc113630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:30.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.607+0000 7fc101800640 1 -- 172.21.15.3:0/841383591 shutdown_connections 2024-09-19T06:18:30.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:30.607+0000 7fc101800640 1 -- 172.21.15.3:0/841383591 wait complete. 2024-09-19T06:18:31.440 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:18:31.820 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:31.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:31 smithi003 ceph-mon[30893]: pgmap v187: 97 pgs: 97 active+clean; 5.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-19T06:18:32.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:31 smithi059 ceph-mon[35138]: pgmap v187: 97 pgs: 97 active+clean; 5.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-19T06:18:32.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:31 smithi071 ceph-mon[35662]: pgmap v187: 97 pgs: 97 active+clean; 5.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-19T06:18:32.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.402+0000 7f8d54a00640 1 -- 172.21.15.3:0/3126871655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8d50108f60 msgr2=0x7f8d50110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:32.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.402+0000 7f8d54a00640 1 --2- 172.21.15.3:0/3126871655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8d50108f60 0x7f8d50110ae0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8d48009900 tx=0x7f8d4802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.402+0000 7f8d54a00640 1 -- 172.21.15.3:0/3126871655 shutdown_connections 2024-09-19T06:18:32.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.402+0000 7f8d54a00640 1 --2- 172.21.15.3:0/3126871655 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8d50108f60 0x7f8d50110ae0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.402+0000 7f8d54a00640 1 --2- 172.21.15.3:0/3126871655 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d501047e0 0x7f8d50108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.402+0000 7f8d54a00640 1 --2- 172.21.15.3:0/3126871655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d50103e30 0x7f8d50104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.402+0000 7f8d54a00640 1 -- 172.21.15.3:0/3126871655 >> 172.21.15.3:0/3126871655 conn(0x7f8d500ff8d0 msgr2=0x7f8d50101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:32.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.402+0000 7f8d54a00640 1 -- 172.21.15.3:0/3126871655 shutdown_connections 2024-09-19T06:18:32.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.402+0000 7f8d54a00640 1 -- 172.21.15.3:0/3126871655 wait complete. 2024-09-19T06:18:32.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.403+0000 7f8d54a00640 1 Processor -- start 2024-09-19T06:18:32.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.403+0000 7f8d54a00640 1 -- start start 2024-09-19T06:18:32.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.403+0000 7f8d54a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d50103e30 0x7f8d5019a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:32.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.404+0000 7f8d54a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8d501047e0 0x7f8d5019a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:32.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.404+0000 7f8d54a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d50108f60 0x7f8d5019ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:32.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.404+0000 7f8d54a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8d50113fc0 con 0x7f8d501047e0 2024-09-19T06:18:32.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.404+0000 7f8d54a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8d50113e40 con 0x7f8d50108f60 2024-09-19T06:18:32.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.404+0000 7f8d54a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8d50114140 con 0x7f8d50103e30 2024-09-19T06:18:32.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.404+0000 7f8d45e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8d501047e0 0x7f8d5019a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:32.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.404+0000 7f8d45e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8d501047e0 0x7f8d5019a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43288/0 (socket says 172.21.15.3:43288) 2024-09-19T06:18:32.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.404+0000 7f8d45e00640 1 -- 172.21.15.3:0/2253901193 learned_addr learned my addr 172.21.15.3:0/2253901193 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:32.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.404+0000 7f8d4f200640 1 --2- 172.21.15.3:0/2253901193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d50108f60 0x7f8d5019ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:32.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.404+0000 7f8d4e800640 1 --2- 172.21.15.3:0/2253901193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d50103e30 0x7f8d5019a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:32.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.404+0000 7f8d45e00640 1 -- 172.21.15.3:0/2253901193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d50103e30 msgr2=0x7f8d5019a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:32.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.404+0000 7f8d45e00640 1 --2- 172.21.15.3:0/2253901193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d50103e30 0x7f8d5019a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.404+0000 7f8d45e00640 1 -- 172.21.15.3:0/2253901193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d50108f60 msgr2=0x7f8d5019ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:32.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.404+0000 7f8d45e00640 1 --2- 172.21.15.3:0/2253901193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d50108f60 0x7f8d5019ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.404+0000 7f8d45e00640 1 -- 172.21.15.3:0/2253901193 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5019f3d0 con 0x7f8d501047e0 2024-09-19T06:18:32.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.405+0000 7f8d45e00640 1 --2- 172.21.15.3:0/2253901193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8d501047e0 0x7f8d5019a960 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800e9f0 tx=0x7f8d3800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:32.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.405+0000 7f8d47e00640 1 -- 172.21.15.3:0/2253901193 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3800cd80 con 0x7f8d501047e0 2024-09-19T06:18:32.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.405+0000 7f8d47e00640 1 -- 172.21.15.3:0/2253901193 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d38005500 con 0x7f8d501047e0 2024-09-19T06:18:32.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.405+0000 7f8d54a00640 1 -- 172.21.15.3:0/2253901193 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d5019f6c0 con 0x7f8d501047e0 2024-09-19T06:18:32.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.405+0000 7f8d47e00640 1 -- 172.21.15.3:0/2253901193 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d38010690 con 0x7f8d501047e0 2024-09-19T06:18:32.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.405+0000 7f8d54a00640 1 -- 172.21.15.3:0/2253901193 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d501a6fa0 con 0x7f8d501047e0 2024-09-19T06:18:32.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.409+0000 7f8d57dc6740 1 Processor -- start 2024-09-19T06:18:32.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.409+0000 7f8d57dc6740 1 -- start start 2024-09-19T06:18:32.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.410+0000 7f8d57dc6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7764ae40 0x560d7764b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:32.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.410+0000 7f8d57dc6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d7764b760 0x560d77655ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:32.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.410+0000 7f8d57dc6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d77656020 0x560d77658410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:32.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.410+0000 7f8d57dc6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560d775b13e0 con 0x560d77656020 2024-09-19T06:18:32.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.410+0000 7f8d57dc6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560d77558d80 con 0x560d7764ae40 2024-09-19T06:18:32.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.410+0000 7f8d57dc6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560d775ad3a0 con 0x560d7764b760 2024-09-19T06:18:32.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.410+0000 7f8d4e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d7764b760 0x560d77655ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:32.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.410+0000 7f8d47e00640 1 -- 172.21.15.3:0/2253901193 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f8d380046c0 con 0x7f8d501047e0 2024-09-19T06:18:32.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.410+0000 7f8d4e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d7764b760 0x560d77655ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:36282/0 (socket says 172.21.15.3:36282) 2024-09-19T06:18:32.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.410+0000 7f8d4e800640 1 -- 172.21.15.3:0/3767783950 learned_addr learned my addr 172.21.15.3:0/3767783950 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:32.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.410+0000 7f8d4f200640 1 --2- 172.21.15.3:0/3767783950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7764ae40 0x560d7764b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:32.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.411+0000 7f8d45e00640 1 --2- 172.21.15.3:0/3767783950 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d77656020 0x560d77658410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:32.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.411+0000 7f8d4e800640 1 -- 172.21.15.3:0/3767783950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7764ae40 msgr2=0x560d7764b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:32.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.411+0000 7f8d4e800640 1 --2- 172.21.15.3:0/3767783950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7764ae40 0x560d7764b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.411+0000 7f8d4e800640 1 -- 172.21.15.3:0/3767783950 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d77656020 msgr2=0x560d77658410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:32.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.411+0000 7f8d4e800640 1 --2- 172.21.15.3:0/3767783950 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d77656020 0x560d77658410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.411+0000 7f8d4e800640 1 -- 172.21.15.3:0/3767783950 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d77577ae0 con 0x560d7764b760 2024-09-19T06:18:32.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.411+0000 7f8d45e00640 1 --2- 172.21.15.3:0/3767783950 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d77656020 0x560d77658410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:18:32.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.411+0000 7f8d4e800640 1 --2- 172.21.15.3:0/3767783950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d7764b760 0x560d77655ae0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8d400114f0 tx=0x7f8d400119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43f8b5cb6aecb9ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:32.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.411+0000 7f8d3f400640 1 -- 172.21.15.3:0/3767783950 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4001e070 con 0x560d7764b760 2024-09-19T06:18:32.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.411+0000 7f8d3f400640 1 -- 172.21.15.3:0/3767783950 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d4000fb00 con 0x560d7764b760 2024-09-19T06:18:32.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.411+0000 7f8d3f400640 1 -- 172.21.15.3:0/3767783950 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d40019bf0 con 0x560d7764b760 2024-09-19T06:18:32.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.412+0000 7f8d47e00640 1 --2- 172.21.15.3:0/2253901193 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8d340a33b0 0x7f8d340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:32.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.412+0000 7f8d57dc6740 1 -- 172.21.15.3:0/3767783950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d7764b760 msgr2=0x560d77655ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:32.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.412+0000 7f8d57dc6740 1 --2- 172.21.15.3:0/3767783950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d7764b760 0x560d77655ae0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8d400114f0 tx=0x7f8d400119b0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.412+0000 7f8d47e00640 1 -- 172.21.15.3:0/2253901193 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f8d380d0120 con 0x7f8d501047e0 2024-09-19T06:18:32.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.412+0000 7f8d4f200640 1 --2- 172.21.15.3:0/2253901193 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8d340a33b0 0x7f8d340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:32.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.412+0000 7f8d57dc6740 1 -- 172.21.15.3:0/3767783950 shutdown_connections 2024-09-19T06:18:32.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.412+0000 7f8d57dc6740 1 --2- 172.21.15.3:0/3767783950 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d77656020 0x560d77658410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.412+0000 7f8d57dc6740 1 --2- 172.21.15.3:0/3767783950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d7764b760 0x560d77655ae0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.412+0000 7f8d57dc6740 1 --2- 172.21.15.3:0/3767783950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7764ae40 0x560d7764b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.412+0000 7f8d57dc6740 1 -- 172.21.15.3:0/3767783950 >> 172.21.15.3:0/3767783950 conn(0x560d776473d0 msgr2=0x560d776477b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:32.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.412+0000 7f8d57dc6740 1 -- 172.21.15.3:0/3767783950 shutdown_connections 2024-09-19T06:18:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.412+0000 7f8d57dc6740 1 -- 172.21.15.3:0/3767783950 wait complete. 2024-09-19T06:18:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.413+0000 7f8d57dc6740 1 -- start start 2024-09-19T06:18:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.413+0000 7f8d4f200640 1 --2- 172.21.15.3:0/2253901193 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8d340a33b0 0x7f8d340a5870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8d48005c40 tx=0x7f8d48005b50 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.413+0000 7f8d57dc6740 1 Processor -- start 2024-09-19T06:18:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.413+0000 7f8d57dc6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7764ae40 0x560d77652e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.413+0000 7f8d57dc6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d7764b760 0x560d77653360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.413+0000 7f8d57dc6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d77656020 0x560d776538a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.413+0000 7f8d57dc6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560d77658bf0 con 0x560d77656020 2024-09-19T06:18:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.413+0000 7f8d57dc6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560d7756c0f0 con 0x560d7764ae40 2024-09-19T06:18:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.413+0000 7f8d57dc6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560d77658d70 con 0x560d7764b760 2024-09-19T06:18:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.413+0000 7f8d57dc6740 10 client.0 _ll_register_callbacks cb 0x560d77553bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.414+0000 7f8d4e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7764ae40 0x560d77652e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:32.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.414+0000 7f8d45e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d7764b760 0x560d77653360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:32.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.414+0000 7f8d4f200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d77656020 0x560d776538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:32.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.414+0000 7f8d4e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7764ae40 0x560d77652e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:50000/0 (socket says 172.21.15.3:50000) 2024-09-19T06:18:32.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.414+0000 7f8d45e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d7764b760 0x560d77653360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:36296/0 (socket says 172.21.15.3:36296) 2024-09-19T06:18:32.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.414+0000 7f8d4e800640 1 -- 172.21.15.3:0/3175277222 learned_addr learned my addr 172.21.15.3:0/3175277222 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:32.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.414+0000 7f8d45e00640 1 -- 172.21.15.3:0/3175277222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7764ae40 msgr2=0x560d77652e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:32.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.414+0000 7f8d45e00640 1 --2- 172.21.15.3:0/3175277222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7764ae40 0x560d77652e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.414+0000 7f8d45e00640 1 -- 172.21.15.3:0/3175277222 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d77656020 msgr2=0x560d776538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:32.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.414+0000 7f8d45e00640 1 --2- 172.21.15.3:0/3175277222 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d77656020 0x560d776538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.414+0000 7f8d45e00640 1 -- 172.21.15.3:0/3175277222 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d773223c0 con 0x560d7764b760 2024-09-19T06:18:32.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.414+0000 7f8d45e00640 1 --2- 172.21.15.3:0/3175277222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d7764b760 0x560d77653360 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8d380cd810 tx=0x7f8d3809bfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3e7a31e09739be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:32.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.414+0000 7f8d33e00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:18:32.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.415+0000 7f8d33e00640 1 -- 172.21.15.3:0/3175277222 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d380cdca0 con 0x560d7764b760 2024-09-19T06:18:32.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.415+0000 7f8d57dc6740 1 -- 172.21.15.3:0/3175277222 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d4000fb00 con 0x560d7764b760 2024-09-19T06:18:32.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.415+0000 7f8d33e00640 1 -- 172.21.15.3:0/3175277222 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f8d380d2310 con 0x560d7764b760 2024-09-19T06:18:32.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.415+0000 7f8d33e00640 1 -- 172.21.15.3:0/3175277222 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8d380a0750 con 0x560d7764b760 2024-09-19T06:18:32.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.415+0000 7f8d57dc6740 10 client.26899 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:32.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.415+0000 7f8d57dc6740 1 -- 172.21.15.3:0/3175277222 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560d77664b50 con 0x560d7764b760 2024-09-19T06:18:32.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.415+0000 7f8d33e00640 1 -- 172.21.15.3:0/3175277222 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d4000fb00 con 0x560d7764b760 2024-09-19T06:18:32.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.415+0000 7f8d33e00640 1 -- 172.21.15.3:0/3175277222 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8d3809b7f0 con 0x560d7764b760 2024-09-19T06:18:32.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.415+0000 7f8d57dc6740 10 client.26899 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:32.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.415+0000 7f8d57dc6740 10 client.26899 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:18:32.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.416+0000 7f8d57dc6740 20 client.26899 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:32.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.416+0000 7f8d57dc6740 1 --2- 172.21.15.3:0/3175277222 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x560d77666010 0x560d77668420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:32.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.416+0000 7f8d57dc6740 4 client.26899 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:32.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.416+0000 7f8d57dc6740 1 -- 172.21.15.3:0/3175277222 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d775be950 con 0x560d77666010 2024-09-19T06:18:32.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.416+0000 7f8d4e800640 1 --2- 172.21.15.3:0/3175277222 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x560d77666010 0x560d77668420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:32.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.416+0000 7f8d33e00640 10 client.26899 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:18:32.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.416+0000 7f8d4e800640 1 --2- 172.21.15.3:0/3175277222 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x560d77666010 0x560d77668420 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e2cea5bc4e8ed720 server_cookie=ae6cc3761378a237 in_seq=0 out_seq=0 2024-09-19T06:18:32.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.417+0000 7f8d33e00640 1 -- 172.21.15.3:0/3175277222 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560d775be950 con 0x560d77666010 2024-09-19T06:18:32.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.417+0000 7f8d33e00640 10 client.26899 handle_command_reply: tid=0 2024-09-19T06:18:32.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.417+0000 7f8d57dc6740 1 client.26899 shutdown 2024-09-19T06:18:32.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.417+0000 7f8d57dc6740 1 -- 172.21.15.3:0/3175277222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d7764b760 msgr2=0x560d77653360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:32.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.417+0000 7f8d57dc6740 1 --2- 172.21.15.3:0/3175277222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d7764b760 0x560d77653360 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8d380cd810 tx=0x7f8d3809bfa0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.418+0000 7f8d57dc6740 1 -- 172.21.15.3:0/3175277222 shutdown_connections 2024-09-19T06:18:32.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.418+0000 7f8d57dc6740 1 --2- 172.21.15.3:0/3175277222 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x560d77666010 0x560d77668420 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.418+0000 7f8d57dc6740 1 --2- 172.21.15.3:0/3175277222 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d77656020 0x560d776538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.418+0000 7f8d57dc6740 1 --2- 172.21.15.3:0/3175277222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d7764b760 0x560d77653360 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.418+0000 7f8d33e00640 0 client.26899 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:18:32.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.418+0000 7f8d57dc6740 1 --2- 172.21.15.3:0/3175277222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7764ae40 0x560d77652e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.418+0000 7f8d57dc6740 1 -- 172.21.15.3:0/3175277222 >> 172.21.15.3:0/3175277222 conn(0x560d776473d0 msgr2=0x560d7764d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:32.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.418+0000 7f8d57dc6740 1 -- 172.21.15.3:0/3175277222 shutdown_connections 2024-09-19T06:18:32.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.418+0000 7f8d57dc6740 1 -- 172.21.15.3:0/3175277222 wait complete. 2024-09-19T06:18:32.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.418+0000 7f8d57dc6740 20 client.26899 trim_cache size 0 max 16384 2024-09-19T06:18:32.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.431+0000 7f8d57dc6740 1 Processor -- start 2024-09-19T06:18:32.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.432+0000 7f8d57dc6740 1 -- start start 2024-09-19T06:18:32.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.432+0000 7f8d57dc6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7764ae40 0x560d7766dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:32.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.432+0000 7f8d57dc6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d7764b760 0x560d7766e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:32.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.432+0000 7f8d57dc6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d77656020 0x560d77654680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:32.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.432+0000 7f8d57dc6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8d501af980 con 0x560d7764b760 2024-09-19T06:18:32.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.432+0000 7f8d57dc6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8d501b14c0 con 0x560d7764ae40 2024-09-19T06:18:32.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.432+0000 7f8d57dc6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8d501b0050 con 0x560d77656020 2024-09-19T06:18:32.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.432+0000 7f8d45e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d7764b760 0x560d7766e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:32.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.432+0000 7f8d45e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d7764b760 0x560d7766e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43308/0 (socket says 172.21.15.3:43308) 2024-09-19T06:18:32.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.432+0000 7f8d45e00640 1 -- 172.21.15.3:0/163641489 learned_addr learned my addr 172.21.15.3:0/163641489 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:32.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.432+0000 7f8d4e800640 1 --2- 172.21.15.3:0/163641489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7764ae40 0x560d7766dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:32.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.432+0000 7f8d4f200640 1 --2- 172.21.15.3:0/163641489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d77656020 0x560d77654680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:32.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.433+0000 7f8d45e00640 1 -- 172.21.15.3:0/163641489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d77656020 msgr2=0x560d77654680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:32.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.433+0000 7f8d45e00640 1 --2- 172.21.15.3:0/163641489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d77656020 0x560d77654680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.433+0000 7f8d45e00640 1 -- 172.21.15.3:0/163641489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7764ae40 msgr2=0x560d7766dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:32.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.433+0000 7f8d45e00640 1 --2- 172.21.15.3:0/163641489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7764ae40 0x560d7766dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.433+0000 7f8d45e00640 1 -- 172.21.15.3:0/163641489 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d77647200 con 0x560d7764b760 2024-09-19T06:18:32.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.433+0000 7f8d4f200640 1 --2- 172.21.15.3:0/163641489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d77656020 0x560d77654680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.433+0000 7f8d45e00640 1 --2- 172.21.15.3:0/163641489 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d7764b760 0x560d7766e230 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8d3809a650 tx=0x7f8d3809c170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62cec5a95eec4b72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.433+0000 7f8d3ea00640 1 -- 172.21.15.3:0/163641489 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d380cdca0 con 0x560d7764b760 2024-09-19T06:18:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.433+0000 7f8d3ea00640 1 -- 172.21.15.3:0/163641489 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d380a5010 con 0x560d7764b760 2024-09-19T06:18:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.433+0000 7f8d3ea00640 1 -- 172.21.15.3:0/163641489 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d38098640 con 0x560d7764b760 2024-09-19T06:18:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.434+0000 7f8d57dc6740 1 -- 172.21.15.3:0/163641489 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d7764b760 msgr2=0x560d7766e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.434+0000 7f8d57dc6740 1 --2- 172.21.15.3:0/163641489 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d7764b760 0x560d7766e230 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8d3809a650 tx=0x7f8d3809c170 comp rx=0 tx=0).stop 2024-09-19T06:18:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.434+0000 7f8d57dc6740 1 -- 172.21.15.3:0/163641489 shutdown_connections 2024-09-19T06:18:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.434+0000 7f8d57dc6740 1 --2- 172.21.15.3:0/163641489 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d77656020 0x560d77654680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.434+0000 7f8d57dc6740 1 --2- 172.21.15.3:0/163641489 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d7764b760 0x560d7766e230 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.434+0000 7f8d57dc6740 1 --2- 172.21.15.3:0/163641489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7764ae40 0x560d7766dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.434+0000 7f8d57dc6740 1 -- 172.21.15.3:0/163641489 >> 172.21.15.3:0/163641489 conn(0x560d776473d0 msgr2=0x560d77651f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.434+0000 7f8d57dc6740 1 -- 172.21.15.3:0/163641489 shutdown_connections 2024-09-19T06:18:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.434+0000 7f8d57dc6740 1 -- 172.21.15.3:0/163641489 wait complete. 2024-09-19T06:18:32.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.434+0000 7f8d57dc6740 1 -- start start 2024-09-19T06:18:32.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.434+0000 7f8d57dc6740 1 Processor -- start 2024-09-19T06:18:32.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.435+0000 7f8d57dc6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d7764ae40 0x560d7765e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:32.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.435+0000 7f8d57dc6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7764b760 0x560d77659af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:32.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.435+0000 7f8d57dc6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d77656020 0x560d7765a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:32.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.435+0000 7f8d57dc6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8d501b0df0 con 0x560d7764ae40 2024-09-19T06:18:32.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.435+0000 7f8d57dc6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8d501b0720 con 0x560d7764b760 2024-09-19T06:18:32.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.435+0000 7f8d57dc6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8d501ad960 con 0x560d77656020 2024-09-19T06:18:32.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.435+0000 7f8d57dc6740 10 client.0 _ll_register_callbacks cb 0x7f8d38009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:32.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.435+0000 7f8d4e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d7764ae40 0x560d7765e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:32.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.435+0000 7f8d4e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d7764ae40 0x560d7765e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43318/0 (socket says 172.21.15.3:43318) 2024-09-19T06:18:32.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.435+0000 7f8d4e800640 1 -- 172.21.15.3:0/3192638293 learned_addr learned my addr 172.21.15.3:0/3192638293 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:32.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.435+0000 7f8d4f200640 1 --2- 172.21.15.3:0/3192638293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d77656020 0x560d7765a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:32.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.435+0000 7f8d45e00640 1 --2- 172.21.15.3:0/3192638293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7764b760 0x560d77659af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:32.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.436+0000 7f8d4e800640 1 -- 172.21.15.3:0/3192638293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d77656020 msgr2=0x560d7765a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:32.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.436+0000 7f8d4e800640 1 --2- 172.21.15.3:0/3192638293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d77656020 0x560d7765a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.436+0000 7f8d4e800640 1 -- 172.21.15.3:0/3192638293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7764b760 msgr2=0x560d77659af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:32.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.436+0000 7f8d4e800640 1 --2- 172.21.15.3:0/3192638293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7764b760 0x560d77659af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.436+0000 7f8d4e800640 1 -- 172.21.15.3:0/3192638293 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d7765a830 con 0x560d7764ae40 2024-09-19T06:18:32.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.436+0000 7f8d4f200640 1 --2- 172.21.15.3:0/3192638293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d77656020 0x560d7765a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:32.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.436+0000 7f8d4e800640 1 --2- 172.21.15.3:0/3192638293 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d7764ae40 0x560d7765e770 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8d40005c40 tx=0x7f8d40019410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3974384f1856b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:32.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.436+0000 7f8d33e00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:18:32.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.436+0000 7f8d33e00640 1 -- 172.21.15.3:0/3192638293 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4001e040 con 0x560d7764ae40 2024-09-19T06:18:32.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.436+0000 7f8d57dc6740 1 -- 172.21.15.3:0/3192638293 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d380a5010 con 0x560d7764ae40 2024-09-19T06:18:32.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.436+0000 7f8d33e00640 1 -- 172.21.15.3:0/3192638293 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f8d40011040 con 0x560d7764ae40 2024-09-19T06:18:32.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.436+0000 7f8d33e00640 1 -- 172.21.15.3:0/3192638293 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8d40011240 con 0x560d7764ae40 2024-09-19T06:18:32.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.437+0000 7f8d57dc6740 10 client.16857 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:32.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.437+0000 7f8d57dc6740 1 -- 172.21.15.3:0/3192638293 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560d776d0cf0 con 0x560d7764ae40 2024-09-19T06:18:32.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.437+0000 7f8d33e00640 1 -- 172.21.15.3:0/3192638293 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d380a5010 con 0x560d7764ae40 2024-09-19T06:18:32.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.437+0000 7f8d33e00640 1 -- 172.21.15.3:0/3192638293 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8d40019880 con 0x560d7764ae40 2024-09-19T06:18:32.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.437+0000 7f8d57dc6740 10 client.16857 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:32.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.437+0000 7f8d57dc6740 10 client.16857 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:18:32.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.437+0000 7f8d57dc6740 20 client.16857 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:32.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.437+0000 7f8d57dc6740 1 --2- 172.21.15.3:0/3192638293 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x560d776d1280 0x560d776d3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:32.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.437+0000 7f8d57dc6740 4 client.16857 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:18:32.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.437+0000 7f8d57dc6740 1 -- 172.21.15.3:0/3192638293 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560d775b8e60 con 0x560d776d1280 2024-09-19T06:18:32.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.437+0000 7f8d45e00640 1 --2- 172.21.15.3:0/3192638293 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x560d776d1280 0x560d776d3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:32.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.438+0000 7f8d45e00640 1 --2- 172.21.15.3:0/3192638293 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x560d776d1280 0x560d776d3670 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7f85fec9ee1ecf71 server_cookie=823f017ce3fb74a1 in_seq=0 out_seq=0 2024-09-19T06:18:32.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.438+0000 7f8d33e00640 10 client.16857 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:18:32.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.438+0000 7f8d33e00640 1 -- 172.21.15.3:0/3192638293 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560d775b8e60 con 0x560d776d1280 2024-09-19T06:18:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.438+0000 7f8d33e00640 10 client.16857 handle_command_reply: tid=0 2024-09-19T06:18:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.438+0000 7f8d57dc6740 1 client.16857 shutdown 2024-09-19T06:18:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.438+0000 7f8d57dc6740 1 -- 172.21.15.3:0/3192638293 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d7764ae40 msgr2=0x560d7765e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.438+0000 7f8d57dc6740 1 --2- 172.21.15.3:0/3192638293 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d7764ae40 0x560d7765e770 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8d40005c40 tx=0x7f8d40019410 comp rx=0 tx=0).stop 2024-09-19T06:18:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.439+0000 7f8d57dc6740 1 -- 172.21.15.3:0/3192638293 shutdown_connections 2024-09-19T06:18:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.439+0000 7f8d57dc6740 1 --2- 172.21.15.3:0/3192638293 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x560d776d1280 0x560d776d3670 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.439+0000 7f8d57dc6740 1 --2- 172.21.15.3:0/3192638293 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560d77656020 0x560d7765a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.439+0000 7f8d57dc6740 1 --2- 172.21.15.3:0/3192638293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d7764b760 0x560d77659af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.439+0000 7f8d57dc6740 1 --2- 172.21.15.3:0/3192638293 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560d7764ae40 0x560d7765e770 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.439+0000 7f8d33e00640 0 client.16857 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:18:32.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.439+0000 7f8d57dc6740 1 -- 172.21.15.3:0/3192638293 >> 172.21.15.3:0/3192638293 conn(0x560d776473d0 msgr2=0x560d77645c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:32.464 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:18:32.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.439+0000 7f8d57dc6740 1 -- 172.21.15.3:0/3192638293 shutdown_connections 2024-09-19T06:18:32.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.439+0000 7f8d57dc6740 1 -- 172.21.15.3:0/3192638293 wait complete. 2024-09-19T06:18:32.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.439+0000 7f8d57dc6740 20 client.16857 trim_cache size 0 max 16384 2024-09-19T06:18:32.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.440+0000 7f8d54a00640 1 -- 172.21.15.3:0/2253901193 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8d340a33b0 msgr2=0x7f8d340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:32.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.440+0000 7f8d54a00640 1 --2- 172.21.15.3:0/2253901193 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8d340a33b0 0x7f8d340a5870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8d48005c40 tx=0x7f8d48005b50 comp rx=0 tx=0).stop 2024-09-19T06:18:32.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.440+0000 7f8d54a00640 1 -- 172.21.15.3:0/2253901193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8d501047e0 msgr2=0x7f8d5019a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:32.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.440+0000 7f8d54a00640 1 --2- 172.21.15.3:0/2253901193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8d501047e0 0x7f8d5019a960 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800e9f0 tx=0x7f8d3800edf0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.440+0000 7f8d54a00640 1 -- 172.21.15.3:0/2253901193 shutdown_connections 2024-09-19T06:18:32.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.440+0000 7f8d54a00640 1 --2- 172.21.15.3:0/2253901193 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8d340a33b0 0x7f8d340a5870 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.440+0000 7f8d54a00640 1 --2- 172.21.15.3:0/2253901193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d50108f60 0x7f8d5019ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.440+0000 7f8d54a00640 1 --2- 172.21.15.3:0/2253901193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8d501047e0 0x7f8d5019a960 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.440+0000 7f8d54a00640 1 --2- 172.21.15.3:0/2253901193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8d50103e30 0x7f8d5019a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:32.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.440+0000 7f8d54a00640 1 -- 172.21.15.3:0/2253901193 >> 172.21.15.3:0/2253901193 conn(0x7f8d500ff8d0 msgr2=0x7f8d50100b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:32.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.440+0000 7f8d54a00640 1 -- 172.21.15.3:0/2253901193 shutdown_connections 2024-09-19T06:18:32.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:32.440+0000 7f8d54a00640 1 -- 172.21.15.3:0/2253901193 wait complete. 2024-09-19T06:18:33.307 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:18:33.687 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:33.973 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:33 smithi003 ceph-mon[30893]: pgmap v188: 97 pgs: 97 active+clean; 5.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-19T06:18:34.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:33 smithi059 ceph-mon[35138]: pgmap v188: 97 pgs: 97 active+clean; 5.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-19T06:18:34.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:33 smithi071 ceph-mon[35662]: pgmap v188: 97 pgs: 97 active+clean; 5.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-19T06:18:34.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.277+0000 7f21e8e00640 1 -- 172.21.15.3:0/3206845500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e4103e30 msgr2=0x7f21e4104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:34.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.277+0000 7f21e8e00640 1 --2- 172.21.15.3:0/3206845500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e4103e30 0x7f21e4104210 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f21d4009860 tx=0x7f21d402a340 comp rx=0 tx=0).stop 2024-09-19T06:18:34.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.277+0000 7f21e8e00640 1 -- 172.21.15.3:0/3206845500 shutdown_connections 2024-09-19T06:18:34.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.277+0000 7f21e8e00640 1 --2- 172.21.15.3:0/3206845500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f21e4108f60 0x7f21e4110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.277+0000 7f21e8e00640 1 --2- 172.21.15.3:0/3206845500 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21e41047e0 0x7f21e4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.277+0000 7f21e8e00640 1 --2- 172.21.15.3:0/3206845500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e4103e30 0x7f21e4104210 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.277+0000 7f21e8e00640 1 -- 172.21.15.3:0/3206845500 >> 172.21.15.3:0/3206845500 conn(0x7f21e40ff910 msgr2=0x7f21e4101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:34.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.277+0000 7f21e8e00640 1 -- 172.21.15.3:0/3206845500 shutdown_connections 2024-09-19T06:18:34.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.277+0000 7f21e8e00640 1 -- 172.21.15.3:0/3206845500 wait complete. 2024-09-19T06:18:34.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.278+0000 7f21e8e00640 1 Processor -- start 2024-09-19T06:18:34.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.279+0000 7f21e8e00640 1 -- start start 2024-09-19T06:18:34.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.279+0000 7f21e8e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f21e4103e30 0x7f21e419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.279+0000 7f21e8e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e41047e0 0x7f21e419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.279+0000 7f21e8e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21e4108f60 0x7f21e419edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.279+0000 7f21e8e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f21e4113fc0 con 0x7f21e4103e30 2024-09-19T06:18:34.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.279+0000 7f21e8e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f21e4113e40 con 0x7f21e41047e0 2024-09-19T06:18:34.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.279+0000 7f21e8e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f21e4114140 con 0x7f21e4108f60 2024-09-19T06:18:34.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.280+0000 7f21e3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f21e4103e30 0x7f21e419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.280+0000 7f21dbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e41047e0 0x7f21e419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.280+0000 7f21e3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f21e4103e30 0x7f21e419a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45074/0 (socket says 172.21.15.3:45074) 2024-09-19T06:18:34.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.280+0000 7f21e3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21e4108f60 0x7f21e419edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.280+0000 7f21e3400640 1 -- 172.21.15.3:0/4274300904 learned_addr learned my addr 172.21.15.3:0/4274300904 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:34.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.280+0000 7f21e3e00640 1 -- 172.21.15.3:0/4274300904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e41047e0 msgr2=0x7f21e419aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:34.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.280+0000 7f21e3e00640 1 --2- 172.21.15.3:0/4274300904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e41047e0 0x7f21e419aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.280+0000 7f21e3e00640 1 -- 172.21.15.3:0/4274300904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f21e4103e30 msgr2=0x7f21e419a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:34.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.280+0000 7f21e3e00640 1 --2- 172.21.15.3:0/4274300904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f21e4103e30 0x7f21e419a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.280+0000 7f21e3e00640 1 -- 172.21.15.3:0/4274300904 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e419f490 con 0x7f21e4108f60 2024-09-19T06:18:34.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.280+0000 7f21e3400640 1 --2- 172.21.15.3:0/4274300904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f21e4103e30 0x7f21e419a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:34.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.280+0000 7f21dbe00640 1 --2- 172.21.15.3:0/4274300904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e41047e0 0x7f21e419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:34.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.280+0000 7f21e3e00640 1 --2- 172.21.15.3:0/4274300904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21e4108f60 0x7f21e419edb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00ef00 tx=0x7f21dc00c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:34.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.281+0000 7f21e0c00640 1 -- 172.21.15.3:0/4274300904 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc004b20 con 0x7f21e4108f60 2024-09-19T06:18:34.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.281+0000 7f21e0c00640 1 -- 172.21.15.3:0/4274300904 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21dc003e50 con 0x7f21e4108f60 2024-09-19T06:18:34.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.281+0000 7f21e8e00640 1 -- 172.21.15.3:0/4274300904 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e419f780 con 0x7f21e4108f60 2024-09-19T06:18:34.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.281+0000 7f21e0c00640 1 -- 172.21.15.3:0/4274300904 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc00b570 con 0x7f21e4108f60 2024-09-19T06:18:34.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.281+0000 7f21e8e00640 1 -- 172.21.15.3:0/4274300904 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e41a7060 con 0x7f21e4108f60 2024-09-19T06:18:34.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.285+0000 7f21ecfe0740 1 Processor -- start 2024-09-19T06:18:34.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.285+0000 7f21e0c00640 1 -- 172.21.15.3:0/4274300904 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f21dc01d020 con 0x7f21e4108f60 2024-09-19T06:18:34.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.286+0000 7f21ecfe0740 1 -- start start 2024-09-19T06:18:34.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.286+0000 7f21ecfe0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c2fe40 0x55ce43c30220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.286+0000 7f21ecfe0740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c30760 0x55ce43c3aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.286+0000 7f21ecfe0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce43c3b020 0x55ce43c3d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.286+0000 7f21ecfe0740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ce43b963e0 con 0x55ce43c30760 2024-09-19T06:18:34.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.286+0000 7f21ecfe0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ce43b3dd80 con 0x55ce43c3b020 2024-09-19T06:18:34.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.286+0000 7f21ecfe0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ce43b923a0 con 0x55ce43c2fe40 2024-09-19T06:18:34.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.286+0000 7f21e3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c30760 0x55ce43c3aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.286+0000 7f21e3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c30760 0x55ce43c3aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45088/0 (socket says 172.21.15.3:45088) 2024-09-19T06:18:34.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.286+0000 7f21e3400640 1 -- 172.21.15.3:0/2846291308 learned_addr learned my addr 172.21.15.3:0/2846291308 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:34.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.286+0000 7f21dbe00640 1 --2- 172.21.15.3:0/2846291308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c2fe40 0x55ce43c30220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.286+0000 7f21dbe00640 1 --2- 172.21.15.3:0/2846291308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce43c3b020 0x55ce43c3d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.287+0000 7f21e3400640 1 -- 172.21.15.3:0/2846291308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c2fe40 msgr2=0x55ce43c30220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:34.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.287+0000 7f21e3400640 1 --2- 172.21.15.3:0/2846291308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c2fe40 0x55ce43c30220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.287+0000 7f21e3400640 1 -- 172.21.15.3:0/2846291308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce43c3b020 msgr2=0x55ce43c3d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:34.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.287+0000 7f21e3400640 1 --2- 172.21.15.3:0/2846291308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce43c3b020 0x55ce43c3d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.287+0000 7f21e3400640 1 -- 172.21.15.3:0/2846291308 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce43b5cae0 con 0x55ce43c30760 2024-09-19T06:18:34.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.287+0000 7f21dbe00640 1 --2- 172.21.15.3:0/2846291308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c2fe40 0x55ce43c30220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:34.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.287+0000 7f21e3400640 1 --2- 172.21.15.3:0/2846291308 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c30760 0x55ce43c3aae0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f21d4035040 tx=0x7f21d40095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59b3d3cef39b8b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:34.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.287+0000 7f21e0c00640 1 --2- 172.21.15.3:0/4274300904 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f21c80a33b0 0x7f21c80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.287+0000 7f21e0c00640 1 -- 172.21.15.3:0/4274300904 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f21dc0cfb40 con 0x7f21e4108f60 2024-09-19T06:18:34.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.287+0000 7f21d8c00640 1 -- 172.21.15.3:0/2846291308 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d4041020 con 0x55ce43c30760 2024-09-19T06:18:34.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.288+0000 7f21dbe00640 1 --2- 172.21.15.3:0/4274300904 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f21c80a33b0 0x7f21c80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.288+0000 7f21d8c00640 1 -- 172.21.15.3:0/2846291308 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21d4004240 con 0x55ce43c30760 2024-09-19T06:18:34.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.288+0000 7f21d8c00640 1 -- 172.21.15.3:0/2846291308 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d4037040 con 0x55ce43c30760 2024-09-19T06:18:34.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.288+0000 7f21ecfe0740 1 -- 172.21.15.3:0/2846291308 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c30760 msgr2=0x55ce43c3aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:34.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.288+0000 7f21ecfe0740 1 --2- 172.21.15.3:0/2846291308 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c30760 0x55ce43c3aae0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f21d4035040 tx=0x7f21d40095a0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.288+0000 7f21dbe00640 1 --2- 172.21.15.3:0/4274300904 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f21c80a33b0 0x7f21c80a5870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55ce43c2d750 tx=0x7f21cc005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:34.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.288+0000 7f21ecfe0740 1 -- 172.21.15.3:0/2846291308 shutdown_connections 2024-09-19T06:18:34.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.288+0000 7f21ecfe0740 1 --2- 172.21.15.3:0/2846291308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce43c3b020 0x55ce43c3d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.288+0000 7f21ecfe0740 1 --2- 172.21.15.3:0/2846291308 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c30760 0x55ce43c3aae0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.288+0000 7f21ecfe0740 1 --2- 172.21.15.3:0/2846291308 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c2fe40 0x55ce43c30220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.288+0000 7f21ecfe0740 1 -- 172.21.15.3:0/2846291308 >> 172.21.15.3:0/2846291308 conn(0x55ce43c2c3d0 msgr2=0x55ce43c2c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:34.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.289+0000 7f21ecfe0740 1 -- 172.21.15.3:0/2846291308 shutdown_connections 2024-09-19T06:18:34.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.289+0000 7f21ecfe0740 1 -- 172.21.15.3:0/2846291308 wait complete. 2024-09-19T06:18:34.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.289+0000 7f21ecfe0740 1 -- start start 2024-09-19T06:18:34.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.289+0000 7f21ecfe0740 1 Processor -- start 2024-09-19T06:18:34.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.290+0000 7f21ecfe0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce43c2fe40 0x55ce43c37f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.290+0000 7f21ecfe0740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c30760 0x55ce43c38440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.290+0000 7f21ecfe0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c3b020 0x55ce43c38980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.290+0000 7f21ecfe0740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ce43c3dbf0 con 0x55ce43c30760 2024-09-19T06:18:34.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.290+0000 7f21ecfe0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ce43b510f0 con 0x55ce43c2fe40 2024-09-19T06:18:34.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.290+0000 7f21ecfe0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ce43c3dd70 con 0x55ce43c3b020 2024-09-19T06:18:34.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.290+0000 7f21ecfe0740 10 client.0 _ll_register_callbacks cb 0x55ce43b38bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:34.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.290+0000 7f21dbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c30760 0x55ce43c38440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.290+0000 7f21dbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c30760 0x55ce43c38440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45090/0 (socket says 172.21.15.3:45090) 2024-09-19T06:18:34.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.290+0000 7f21dbe00640 1 -- 172.21.15.3:0/3286947098 learned_addr learned my addr 172.21.15.3:0/3286947098 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:34.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.290+0000 7f21e3400640 1 --2- 172.21.15.3:0/3286947098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce43c2fe40 0x55ce43c37f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.290+0000 7f21e3e00640 1 --2- 172.21.15.3:0/3286947098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c3b020 0x55ce43c38980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.290+0000 7f21e3400640 1 -- 172.21.15.3:0/3286947098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c3b020 msgr2=0x55ce43c38980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:34.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.290+0000 7f21e3400640 1 --2- 172.21.15.3:0/3286947098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c3b020 0x55ce43c38980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.290+0000 7f21e3400640 1 -- 172.21.15.3:0/3286947098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c30760 msgr2=0x55ce43c38440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:34.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.290+0000 7f21e3400640 1 --2- 172.21.15.3:0/3286947098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c30760 0x55ce43c38440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.291+0000 7f21e3400640 1 -- 172.21.15.3:0/3286947098 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce439073c0 con 0x55ce43c2fe40 2024-09-19T06:18:34.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.291+0000 7f21e3400640 1 --2- 172.21.15.3:0/3286947098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce43c2fe40 0x55ce43c37f00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f21d4009830 tx=0x7f21d4003e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ec8996a4c7fa294 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:34.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.291+0000 7f21d1600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:18:34.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.291+0000 7f21d1600640 1 -- 172.21.15.3:0/3286947098 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d404c070 con 0x55ce43c2fe40 2024-09-19T06:18:34.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.291+0000 7f21ecfe0740 1 -- 172.21.15.3:0/3286947098 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21d4004240 con 0x55ce43c2fe40 2024-09-19T06:18:34.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.291+0000 7f21d1600640 1 -- 172.21.15.3:0/3286947098 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f21d40043f0 con 0x55ce43c2fe40 2024-09-19T06:18:34.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.292+0000 7f21d1600640 1 -- 172.21.15.3:0/3286947098 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f21d4058050 con 0x55ce43c2fe40 2024-09-19T06:18:34.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.292+0000 7f21ecfe0740 10 client.26909 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:34.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.292+0000 7f21ecfe0740 1 -- 172.21.15.3:0/3286947098 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ce43c49c30 con 0x55ce43c2fe40 2024-09-19T06:18:34.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.292+0000 7f21d1600640 1 -- 172.21.15.3:0/3286947098 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21d4004240 con 0x55ce43c2fe40 2024-09-19T06:18:34.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.292+0000 7f21d1600640 1 -- 172.21.15.3:0/3286947098 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f21d403db60 con 0x55ce43c2fe40 2024-09-19T06:18:34.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.292+0000 7f21ecfe0740 10 client.26909 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:34.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.292+0000 7f21ecfe0740 10 client.26909 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:18:34.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.292+0000 7f21ecfe0740 20 client.26909 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:34.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.292+0000 7f21ecfe0740 1 --2- 172.21.15.3:0/3286947098 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55ce43c4af80 0x55ce43c4d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.292+0000 7f21ecfe0740 4 client.26909 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:34.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.292+0000 7f21ecfe0740 1 -- 172.21.15.3:0/3286947098 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce43ba3950 con 0x55ce43c4af80 2024-09-19T06:18:34.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.293+0000 7f21dbe00640 1 --2- 172.21.15.3:0/3286947098 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55ce43c4af80 0x55ce43c4d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.293+0000 7f21dbe00640 1 --2- 172.21.15.3:0/3286947098 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55ce43c4af80 0x55ce43c4d370 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e85ae9a1afd9710 server_cookie=81e1678b63265ff2 in_seq=0 out_seq=0 2024-09-19T06:18:34.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.293+0000 7f21d1600640 10 client.26909 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:18:34.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.294+0000 7f21d1600640 1 -- 172.21.15.3:0/3286947098 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ce43ba3950 con 0x55ce43c4af80 2024-09-19T06:18:34.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.294+0000 7f21d1600640 10 client.26909 handle_command_reply: tid=0 2024-09-19T06:18:34.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.294+0000 7f21ecfe0740 1 client.26909 shutdown 2024-09-19T06:18:34.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.294+0000 7f21ecfe0740 1 -- 172.21.15.3:0/3286947098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce43c2fe40 msgr2=0x55ce43c37f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:34.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.294+0000 7f21ecfe0740 1 --2- 172.21.15.3:0/3286947098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce43c2fe40 0x55ce43c37f00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f21d4009830 tx=0x7f21d4003e70 comp rx=0 tx=0).stop 2024-09-19T06:18:34.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.294+0000 7f21ecfe0740 1 -- 172.21.15.3:0/3286947098 shutdown_connections 2024-09-19T06:18:34.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.294+0000 7f21ecfe0740 1 --2- 172.21.15.3:0/3286947098 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55ce43c4af80 0x55ce43c4d370 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.294+0000 7f21ecfe0740 1 --2- 172.21.15.3:0/3286947098 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c3b020 0x55ce43c38980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.294+0000 7f21ecfe0740 1 --2- 172.21.15.3:0/3286947098 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c30760 0x55ce43c38440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.294+0000 7f21ecfe0740 1 --2- 172.21.15.3:0/3286947098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce43c2fe40 0x55ce43c37f00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.294+0000 7f21ecfe0740 1 -- 172.21.15.3:0/3286947098 >> 172.21.15.3:0/3286947098 conn(0x55ce43c2c3d0 msgr2=0x55ce43c320b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:34.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.294+0000 7f21d1600640 0 client.26909 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:18:34.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.295+0000 7f21ecfe0740 1 -- 172.21.15.3:0/3286947098 shutdown_connections 2024-09-19T06:18:34.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.295+0000 7f21ecfe0740 1 -- 172.21.15.3:0/3286947098 wait complete. 2024-09-19T06:18:34.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.295+0000 7f21ecfe0740 20 client.26909 trim_cache size 0 max 16384 2024-09-19T06:18:34.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.308+0000 7f21ecfe0740 1 Processor -- start 2024-09-19T06:18:34.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.308+0000 7f21ecfe0740 1 -- start start 2024-09-19T06:18:34.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.309+0000 7f21ecfe0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce43c2fe40 0x55ce43c31890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.309+0000 7f21ecfe0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c30760 0x55ce43c52940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.309+0000 7f21ecfe0740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c3b020 0x55ce43c52e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.309+0000 7f21ecfe0740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f21e41af8e0 con 0x55ce43c3b020 2024-09-19T06:18:34.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.309+0000 7f21ecfe0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f21e41b1420 con 0x55ce43c2fe40 2024-09-19T06:18:34.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.309+0000 7f21ecfe0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f21e41affb0 con 0x55ce43c30760 2024-09-19T06:18:34.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.309+0000 7f21dbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c30760 0x55ce43c52940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.309+0000 7f21dbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c30760 0x55ce43c52940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:44878/0 (socket says 172.21.15.3:44878) 2024-09-19T06:18:34.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.309+0000 7f21dbe00640 1 -- 172.21.15.3:0/953149769 learned_addr learned my addr 172.21.15.3:0/953149769 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:34.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.309+0000 7f21e3400640 1 --2- 172.21.15.3:0/953149769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce43c2fe40 0x55ce43c31890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.309+0000 7f21e3e00640 1 --2- 172.21.15.3:0/953149769 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c3b020 0x55ce43c52e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.309+0000 7f21dbe00640 1 -- 172.21.15.3:0/953149769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce43c2fe40 msgr2=0x55ce43c31890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:34.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.309+0000 7f21dbe00640 1 --2- 172.21.15.3:0/953149769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce43c2fe40 0x55ce43c31890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.309+0000 7f21dbe00640 1 -- 172.21.15.3:0/953149769 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c3b020 msgr2=0x55ce43c52e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:34.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.309+0000 7f21dbe00640 1 --2- 172.21.15.3:0/953149769 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c3b020 0x55ce43c52e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.310+0000 7f21dbe00640 1 -- 172.21.15.3:0/953149769 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce43c2c200 con 0x55ce43c30760 2024-09-19T06:18:34.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.310+0000 7f21e3e00640 1 --2- 172.21.15.3:0/953149769 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c3b020 0x55ce43c52e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:34.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.310+0000 7f21dbe00640 1 --2- 172.21.15.3:0/953149769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c30760 0x55ce43c52940 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x55ce43c39540 tx=0x7f21cc004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efecfef520fcda0f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:34.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.310+0000 7f21d3e00640 1 -- 172.21.15.3:0/953149769 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc003db0 con 0x55ce43c30760 2024-09-19T06:18:34.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.310+0000 7f21d3e00640 1 -- 172.21.15.3:0/953149769 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21cc021dd0 con 0x55ce43c30760 2024-09-19T06:18:34.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.310+0000 7f21d3e00640 1 -- 172.21.15.3:0/953149769 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc02dbf0 con 0x55ce43c30760 2024-09-19T06:18:34.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.311+0000 7f21ecfe0740 1 -- 172.21.15.3:0/953149769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c30760 msgr2=0x55ce43c52940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:34.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.311+0000 7f21ecfe0740 1 --2- 172.21.15.3:0/953149769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c30760 0x55ce43c52940 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x55ce43c39540 tx=0x7f21cc004730 comp rx=0 tx=0).stop 2024-09-19T06:18:34.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.311+0000 7f21ecfe0740 1 -- 172.21.15.3:0/953149769 shutdown_connections 2024-09-19T06:18:34.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.311+0000 7f21ecfe0740 1 --2- 172.21.15.3:0/953149769 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c3b020 0x55ce43c52e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.311+0000 7f21ecfe0740 1 --2- 172.21.15.3:0/953149769 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c30760 0x55ce43c52940 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.311+0000 7f21ecfe0740 1 --2- 172.21.15.3:0/953149769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce43c2fe40 0x55ce43c31890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.311+0000 7f21ecfe0740 1 -- 172.21.15.3:0/953149769 >> 172.21.15.3:0/953149769 conn(0x55ce43c2c3d0 msgr2=0x55ce43c386e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:34.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.311+0000 7f21ecfe0740 1 -- 172.21.15.3:0/953149769 shutdown_connections 2024-09-19T06:18:34.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.311+0000 7f21ecfe0740 1 -- 172.21.15.3:0/953149769 wait complete. 2024-09-19T06:18:34.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.311+0000 7f21ecfe0740 1 -- start start 2024-09-19T06:18:34.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.312+0000 7f21ecfe0740 1 Processor -- start 2024-09-19T06:18:34.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.312+0000 7f21ecfe0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c2fe40 0x55ce43c3f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.312+0000 7f21ecfe0740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c3b020 0x55ce43c3f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.312+0000 7f21ecfe0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce43c3fcd0 0x55ce43cb4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.312+0000 7f21ecfe0740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f21e41b0d50 con 0x55ce43c3b020 2024-09-19T06:18:34.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.312+0000 7f21ecfe0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f21e41b0680 con 0x55ce43c3fcd0 2024-09-19T06:18:34.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.312+0000 7f21ecfe0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f21e41ad8c0 con 0x55ce43c2fe40 2024-09-19T06:18:34.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.312+0000 7f21ecfe0740 10 client.0 _ll_register_callbacks cb 0x7f21cc011610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:34.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.312+0000 7f21dbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c3b020 0x55ce43c3f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.312+0000 7f21e3400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c2fe40 0x55ce43c3f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.312+0000 7f21dbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c3b020 0x55ce43c3f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45096/0 (socket says 172.21.15.3:45096) 2024-09-19T06:18:34.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.312+0000 7f21dbe00640 1 -- 172.21.15.3:0/2182120932 learned_addr learned my addr 172.21.15.3:0/2182120932 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:34.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.312+0000 7f21e3400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c2fe40 0x55ce43c3f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:44884/0 (socket says 172.21.15.3:44884) 2024-09-19T06:18:34.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.313+0000 7f21e3e00640 1 --2- 172.21.15.3:0/2182120932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce43c3fcd0 0x55ce43cb4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.313+0000 7f21e3400640 1 -- 172.21.15.3:0/2182120932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce43c3fcd0 msgr2=0x55ce43cb4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:34.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.313+0000 7f21e3400640 1 --2- 172.21.15.3:0/2182120932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce43c3fcd0 0x55ce43cb4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.313+0000 7f21e3400640 1 -- 172.21.15.3:0/2182120932 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c3b020 msgr2=0x55ce43c3f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:34.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.313+0000 7f21e3400640 1 --2- 172.21.15.3:0/2182120932 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c3b020 0x55ce43c3f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.313+0000 7f21e3400640 1 -- 172.21.15.3:0/2182120932 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce43c30cd0 con 0x55ce43c2fe40 2024-09-19T06:18:34.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.313+0000 7f21dbe00640 1 --2- 172.21.15.3:0/2182120932 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c3b020 0x55ce43c3f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:34.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.313+0000 7f21e3400640 1 --2- 172.21.15.3:0/2182120932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c2fe40 0x55ce43c3f0a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f21d403df80 tx=0x7f21d4030780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1941d13f7b1a566a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:34.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.313+0000 7f21d1600640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:18:34.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.314+0000 7f21d1600640 1 -- 172.21.15.3:0/2182120932 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d404c070 con 0x55ce43c2fe40 2024-09-19T06:18:34.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.314+0000 7f21d1600640 1 -- 172.21.15.3:0/2182120932 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f21d4005230 con 0x55ce43c2fe40 2024-09-19T06:18:34.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.314+0000 7f21ecfe0740 1 -- 172.21.15.3:0/2182120932 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21cc021dd0 con 0x55ce43c2fe40 2024-09-19T06:18:34.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.314+0000 7f21d1600640 1 -- 172.21.15.3:0/2182120932 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f21d4041050 con 0x55ce43c2fe40 2024-09-19T06:18:34.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.314+0000 7f21ecfe0740 10 client.26923 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:34.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.314+0000 7f21ecfe0740 1 -- 172.21.15.3:0/2182120932 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ce43cb6220 con 0x55ce43c2fe40 2024-09-19T06:18:34.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.314+0000 7f21d1600640 1 -- 172.21.15.3:0/2182120932 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21cc021dd0 con 0x55ce43c2fe40 2024-09-19T06:18:34.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.314+0000 7f21d1600640 1 -- 172.21.15.3:0/2182120932 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f21d4003ee0 con 0x55ce43c2fe40 2024-09-19T06:18:34.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.314+0000 7f21ecfe0740 10 client.26923 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:34.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.314+0000 7f21ecfe0740 10 client.26923 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:18:34.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.314+0000 7f21ecfe0740 20 client.26923 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:34.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.314+0000 7f21ecfe0740 1 --2- 172.21.15.3:0/2182120932 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55ce43cb6930 0x55ce43cb8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.315+0000 7f21ecfe0740 4 client.26923 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:18:34.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.315+0000 7f21ecfe0740 1 -- 172.21.15.3:0/2182120932 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ce43b9de60 con 0x55ce43cb6930 2024-09-19T06:18:34.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.315+0000 7f21dbe00640 1 --2- 172.21.15.3:0/2182120932 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55ce43cb6930 0x55ce43cb8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.316+0000 7f21dbe00640 1 --2- 172.21.15.3:0/2182120932 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55ce43cb6930 0x55ce43cb8d20 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=210d71736ef356b server_cookie=a2a573162dba3a62 in_seq=0 out_seq=0 2024-09-19T06:18:34.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.316+0000 7f21d1600640 10 client.26923 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:18:34.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.316+0000 7f21d1600640 1 -- 172.21.15.3:0/2182120932 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ce43b9de60 con 0x55ce43cb6930 2024-09-19T06:18:34.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.316+0000 7f21d1600640 10 client.26923 handle_command_reply: tid=0 2024-09-19T06:18:34.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.316+0000 7f21ecfe0740 1 client.26923 shutdown 2024-09-19T06:18:34.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.316+0000 7f21ecfe0740 1 -- 172.21.15.3:0/2182120932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c2fe40 msgr2=0x55ce43c3f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:34.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.316+0000 7f21ecfe0740 1 --2- 172.21.15.3:0/2182120932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c2fe40 0x55ce43c3f0a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f21d403df80 tx=0x7f21d4030780 comp rx=0 tx=0).stop 2024-09-19T06:18:34.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.316+0000 7f21ecfe0740 1 -- 172.21.15.3:0/2182120932 shutdown_connections 2024-09-19T06:18:34.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.316+0000 7f21ecfe0740 1 --2- 172.21.15.3:0/2182120932 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55ce43cb6930 0x55ce43cb8d20 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.316+0000 7f21ecfe0740 1 --2- 172.21.15.3:0/2182120932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce43c3fcd0 0x55ce43cb4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.316+0000 7f21ecfe0740 1 --2- 172.21.15.3:0/2182120932 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce43c3b020 0x55ce43c3f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.316+0000 7f21ecfe0740 1 --2- 172.21.15.3:0/2182120932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce43c2fe40 0x55ce43c3f0a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.316+0000 7f21d1600640 0 client.26923 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:18:34.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.316+0000 7f21ecfe0740 1 -- 172.21.15.3:0/2182120932 >> 172.21.15.3:0/2182120932 conn(0x55ce43c2c3d0 msgr2=0x55ce43c2abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:34.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.316+0000 7f21ecfe0740 1 -- 172.21.15.3:0/2182120932 shutdown_connections 2024-09-19T06:18:34.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.316+0000 7f21ecfe0740 1 -- 172.21.15.3:0/2182120932 wait complete. 2024-09-19T06:18:34.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.316+0000 7f21ecfe0740 20 client.26923 trim_cache size 0 max 16384 2024-09-19T06:18:34.323 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:18:34.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.317+0000 7f21e8e00640 1 -- 172.21.15.3:0/4274300904 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f21c80a33b0 msgr2=0x7f21c80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:34.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.317+0000 7f21e8e00640 1 --2- 172.21.15.3:0/4274300904 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f21c80a33b0 0x7f21c80a5870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55ce43c2d750 tx=0x7f21cc005f90 comp rx=0 tx=0).stop 2024-09-19T06:18:34.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.317+0000 7f21e8e00640 1 -- 172.21.15.3:0/4274300904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21e4108f60 msgr2=0x7f21e419edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:34.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.317+0000 7f21e8e00640 1 --2- 172.21.15.3:0/4274300904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21e4108f60 0x7f21e419edb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00ef00 tx=0x7f21dc00c740 comp rx=0 tx=0).stop 2024-09-19T06:18:34.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.317+0000 7f21e8e00640 1 -- 172.21.15.3:0/4274300904 shutdown_connections 2024-09-19T06:18:34.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.317+0000 7f21e8e00640 1 --2- 172.21.15.3:0/4274300904 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f21c80a33b0 0x7f21c80a5870 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.317+0000 7f21e8e00640 1 --2- 172.21.15.3:0/4274300904 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f21e4108f60 0x7f21e419edb0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.317+0000 7f21e8e00640 1 --2- 172.21.15.3:0/4274300904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21e41047e0 0x7f21e419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.317+0000 7f21e8e00640 1 --2- 172.21.15.3:0/4274300904 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f21e4103e30 0x7f21e419a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.317+0000 7f21e8e00640 1 -- 172.21.15.3:0/4274300904 >> 172.21.15.3:0/4274300904 conn(0x7f21e40ff910 msgr2=0x7f21e4100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:34.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.317+0000 7f21e8e00640 1 -- 172.21.15.3:0/4274300904 shutdown_connections 2024-09-19T06:18:34.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:34.317+0000 7f21e8e00640 1 -- 172.21.15.3:0/4274300904 wait complete. 2024-09-19T06:18:34.542 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.540+0000 7fb33ba00640 1 -- 172.21.15.3:0/1556567013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3341048e0 msgr2=0x7fb334108920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.540+0000 7fb33ba00640 1 --2- 172.21.15.3:0/1556567013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3341048e0 0x7fb334108920 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb320009900 tx=0x7fb32002a3f0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.541+0000 7fb33ba00640 1 -- 172.21.15.3:0/1556567013 shutdown_connections 2024-09-19T06:18:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.541+0000 7fb33ba00640 1 --2- 172.21.15.3:0/1556567013 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb334109080 0x7fb334110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.541+0000 7fb33ba00640 1 --2- 172.21.15.3:0/1556567013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3341048e0 0x7fb334108920 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.541+0000 7fb33ba00640 1 --2- 172.21.15.3:0/1556567013 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb334103f30 0x7fb334104310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.541+0000 7fb33ba00640 1 -- 172.21.15.3:0/1556567013 >> 172.21.15.3:0/1556567013 conn(0x7fb3340ff980 msgr2=0x7fb334101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.541+0000 7fb33ba00640 1 -- 172.21.15.3:0/1556567013 shutdown_connections 2024-09-19T06:18:34.543 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.541+0000 7fb33ba00640 1 -- 172.21.15.3:0/1556567013 wait complete. 2024-09-19T06:18:34.545 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.542+0000 7fb33ba00640 1 Processor -- start 2024-09-19T06:18:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.542+0000 7fb33ba00640 1 -- start start 2024-09-19T06:18:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.542+0000 7fb33ba00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb334103f30 0x7fb33419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.542+0000 7fb33ba00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb334109080 0x7fb33419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.542+0000 7fb33ba00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb33419ef20 0x7fb33419f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.542+0000 7fb33ba00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341140d0 con 0x7fb334103f30 2024-09-19T06:18:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.542+0000 7fb33ba00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb334113f50 con 0x7fb33419ef20 2024-09-19T06:18:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.542+0000 7fb33ba00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb334114250 con 0x7fb334109080 2024-09-19T06:18:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.542+0000 7fb339000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb334103f30 0x7fb33419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.542+0000 7fb333e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb334109080 0x7fb33419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.542+0000 7fb333e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb334109080 0x7fb33419aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:44898/0 (socket says 172.21.15.3:44898) 2024-09-19T06:18:34.546 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.542+0000 7fb333e00640 1 -- 172.21.15.3:0/138226931 learned_addr learned my addr 172.21.15.3:0/138226931 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.543+0000 7fb339a00640 1 --2- 172.21.15.3:0/138226931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb33419ef20 0x7fb33419f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.543+0000 7fb333e00640 1 -- 172.21.15.3:0/138226931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb33419ef20 msgr2=0x7fb33419f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.543+0000 7fb333e00640 1 --2- 172.21.15.3:0/138226931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb33419ef20 0x7fb33419f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.543+0000 7fb333e00640 1 -- 172.21.15.3:0/138226931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb334103f30 msgr2=0x7fb33419a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.543+0000 7fb333e00640 1 --2- 172.21.15.3:0/138226931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb334103f30 0x7fb33419a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.543+0000 7fb333e00640 1 -- 172.21.15.3:0/138226931 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33419fa10 con 0x7fb334109080 2024-09-19T06:18:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.543+0000 7fb339000640 1 --2- 172.21.15.3:0/138226931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb334103f30 0x7fb33419a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.543+0000 7fb333e00640 1 --2- 172.21.15.3:0/138226931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb334109080 0x7fb33419aba0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb32002a910 tx=0x7fb320003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.544+0000 7fb331600640 1 -- 172.21.15.3:0/138226931 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32003f070 con 0x7fb334109080 2024-09-19T06:18:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.544+0000 7fb331600640 1 -- 172.21.15.3:0/138226931 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb320031c90 con 0x7fb334109080 2024-09-19T06:18:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.544+0000 7fb331600640 1 -- 172.21.15.3:0/138226931 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb320035030 con 0x7fb334109080 2024-09-19T06:18:34.547 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.544+0000 7fb33ba00640 1 -- 172.21.15.3:0/138226931 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb33419fca0 con 0x7fb334109080 2024-09-19T06:18:34.548 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.544+0000 7fb33ba00640 1 -- 172.21.15.3:0/138226931 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3341a7460 con 0x7fb334109080 2024-09-19T06:18:34.550 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.547+0000 7fb33e3fd740 1 Processor -- start 2024-09-19T06:18:34.550 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.548+0000 7fb33e3fd740 1 -- start start 2024-09-19T06:18:34.550 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.548+0000 7fb33e3fd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee51e0 0x564d4bee55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.550 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.548+0000 7fb33e3fd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bee5b00 0x564d4beefe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.548+0000 7fb33e3fd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d4bef03a0 0x564d4bef2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.548+0000 7fb33e3fd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x564d4be4b100 con 0x564d4bee5b00 2024-09-19T06:18:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.548+0000 7fb33e3fd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564d4bdf31b0 con 0x564d4bee51e0 2024-09-19T06:18:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.548+0000 7fb33e3fd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564d4be470c0 con 0x564d4bef03a0 2024-09-19T06:18:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.548+0000 7fb339a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee51e0 0x564d4bee55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.548+0000 7fb339a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee51e0 0x564d4bee55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:37786/0 (socket says 172.21.15.3:37786) 2024-09-19T06:18:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.548+0000 7fb339a00640 1 -- 172.21.15.3:0/635281356 learned_addr learned my addr 172.21.15.3:0/635281356 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.548+0000 7fb339000640 1 --2- 172.21.15.3:0/635281356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bee5b00 0x564d4beefe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.548+0000 7fb331600640 1 -- 172.21.15.3:0/138226931 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fb320042070 con 0x7fb334109080 2024-09-19T06:18:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.549+0000 7fb339a00640 1 -- 172.21.15.3:0/635281356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d4bef03a0 msgr2=0x564d4bef2790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:18:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.549+0000 7fb339a00640 1 --2- 172.21.15.3:0/635281356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d4bef03a0 0x564d4bef2790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.551 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.549+0000 7fb339a00640 1 -- 172.21.15.3:0/635281356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bee5b00 msgr2=0x564d4beefe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:34.552 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.549+0000 7fb339a00640 1 --2- 172.21.15.3:0/635281356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bee5b00 0x564d4beefe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.552 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.549+0000 7fb339a00640 1 -- 172.21.15.3:0/635281356 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d4bb5e210 con 0x564d4bee51e0 2024-09-19T06:18:34.552 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.549+0000 7fb339000640 1 --2- 172.21.15.3:0/635281356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bee5b00 0x564d4beefe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.549+0000 7fb339a00640 1 --2- 172.21.15.3:0/635281356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee51e0 0x564d4bee55c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009f60 tx=0x7fb32c009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=445ec358415ee00 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.549+0000 7fb326000640 1 -- 172.21.15.3:0/635281356 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c01e070 con 0x564d4bee51e0 2024-09-19T06:18:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.549+0000 7fb326000640 1 -- 172.21.15.3:0/635281356 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb32c003c30 con 0x564d4bee51e0 2024-09-19T06:18:34.553 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.549+0000 7fb326000640 1 -- 172.21.15.3:0/635281356 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c00fa20 con 0x564d4bee51e0 2024-09-19T06:18:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.550+0000 7fb33e3fd740 1 -- 172.21.15.3:0/635281356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee51e0 msgr2=0x564d4bee55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.550+0000 7fb33e3fd740 1 --2- 172.21.15.3:0/635281356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee51e0 0x564d4bee55c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009f60 tx=0x7fb32c009f90 comp rx=0 tx=0).stop 2024-09-19T06:18:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.550+0000 7fb33e3fd740 1 -- 172.21.15.3:0/635281356 shutdown_connections 2024-09-19T06:18:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.550+0000 7fb33e3fd740 1 --2- 172.21.15.3:0/635281356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d4bef03a0 0x564d4bef2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.550+0000 7fb33e3fd740 1 --2- 172.21.15.3:0/635281356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bee5b00 0x564d4beefe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.550+0000 7fb33e3fd740 1 --2- 172.21.15.3:0/635281356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee51e0 0x564d4bee55c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.550+0000 7fb33e3fd740 1 -- 172.21.15.3:0/635281356 >> 172.21.15.3:0/635281356 conn(0x564d4bee1750 msgr2=0x564d4bee1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.550+0000 7fb331600640 1 --2- 172.21.15.3:0/138226931 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb31c0a33b0 0x7fb31c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.550+0000 7fb33e3fd740 1 -- 172.21.15.3:0/635281356 shutdown_connections 2024-09-19T06:18:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.551+0000 7fb331600640 1 -- 172.21.15.3:0/138226931 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fb3200f06c0 con 0x7fb334109080 2024-09-19T06:18:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.551+0000 7fb33e3fd740 1 -- 172.21.15.3:0/635281356 wait complete. 2024-09-19T06:18:34.554 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.551+0000 7fb339a00640 1 --2- 172.21.15.3:0/138226931 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb31c0a33b0 0x7fb31c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.555 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.551+0000 7fb33e3fd740 1 -- start start 2024-09-19T06:18:34.555 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.551+0000 7fb33e3fd740 1 Processor -- start 2024-09-19T06:18:34.555 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.552+0000 7fb339a00640 1 --2- 172.21.15.3:0/138226931 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb31c0a33b0 0x7fb31c0a5870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb32c011d60 tx=0x7fb32c000f40 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:34.557 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.552+0000 7fb33e3fd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bee51e0 0x564d4beed390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.557 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.552+0000 7fb33e3fd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee5b00 0x564d4beed8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.557 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.552+0000 7fb33e3fd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d4bef03a0 0x564d4beede10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.558 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.552+0000 7fb33e3fd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x564d4bef2f70 con 0x564d4bee51e0 2024-09-19T06:18:34.558 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.552+0000 7fb33e3fd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564d4bdd4090 con 0x564d4bee5b00 2024-09-19T06:18:34.558 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.552+0000 7fb33e3fd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564d4bef30f0 con 0x564d4bef03a0 2024-09-19T06:18:34.558 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.552+0000 7fb33e3fd740 10 client.0 _ll_register_callbacks cb 0x564d4be28f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:34.558 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.552+0000 7fb339000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bee51e0 0x564d4beed390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.558 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.553+0000 7fb339000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bee51e0 0x564d4beed390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45126/0 (socket says 172.21.15.3:45126) 2024-09-19T06:18:34.558 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.553+0000 7fb339000640 1 -- 172.21.15.3:0/4094931341 learned_addr learned my addr 172.21.15.3:0/4094931341 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:34.558 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.553+0000 7fb333e00640 1 --2- 172.21.15.3:0/4094931341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee5b00 0x564d4beed8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.558 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.553+0000 7fb339a00640 1 --2- 172.21.15.3:0/4094931341 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d4bef03a0 0x564d4beede10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.558 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.553+0000 7fb333e00640 1 -- 172.21.15.3:0/4094931341 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d4bef03a0 msgr2=0x564d4beede10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:34.558 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.553+0000 7fb333e00640 1 --2- 172.21.15.3:0/4094931341 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d4bef03a0 0x564d4beede10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.558 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.553+0000 7fb333e00640 1 -- 172.21.15.3:0/4094931341 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bee51e0 msgr2=0x564d4beed390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:34.559 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.553+0000 7fb333e00640 1 --2- 172.21.15.3:0/4094931341 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bee51e0 0x564d4beed390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.559 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.553+0000 7fb333e00640 1 -- 172.21.15.3:0/4094931341 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d4bc2a620 con 0x564d4bee5b00 2024-09-19T06:18:34.559 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.553+0000 7fb339000640 1 --2- 172.21.15.3:0/4094931341 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bee51e0 0x564d4beed390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:34.559 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.553+0000 7fb333e00640 1 --2- 172.21.15.3:0/4094931341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee5b00 0x564d4beed8d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb3200edde0 tx=0x7fb3200bc770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2862097d573261da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:34.559 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.553+0000 7fb31aa00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:18:34.559 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.553+0000 7fb31aa00640 1 -- 172.21.15.3:0/4094931341 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb320049040 con 0x564d4bee5b00 2024-09-19T06:18:34.559 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.553+0000 7fb33e3fd740 1 -- 172.21.15.3:0/4094931341 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb32c003c30 con 0x564d4bee5b00 2024-09-19T06:18:34.559 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.554+0000 7fb31aa00640 1 -- 172.21.15.3:0/4094931341 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fb3200ee090 con 0x564d4bee5b00 2024-09-19T06:18:34.559 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.554+0000 7fb31aa00640 1 -- 172.21.15.3:0/4094931341 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb320031e40 con 0x564d4bee5b00 2024-09-19T06:18:34.559 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.554+0000 7fb33e3fd740 10 client.26927 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:34.559 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.554+0000 7fb33e3fd740 1 -- 172.21.15.3:0/4094931341 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564d4befec20 con 0x564d4bee5b00 2024-09-19T06:18:34.559 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.554+0000 7fb31aa00640 1 -- 172.21.15.3:0/4094931341 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb32c003c30 con 0x564d4bee5b00 2024-09-19T06:18:34.560 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.554+0000 7fb31aa00640 1 -- 172.21.15.3:0/4094931341 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb3200b9010 con 0x564d4bee5b00 2024-09-19T06:18:34.560 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.554+0000 7fb33e3fd740 10 client.26927 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:34.560 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.554+0000 7fb33e3fd740 10 client.26927 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:34.560 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.554+0000 7fb33e3fd740 20 client.26927 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:34.560 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.554+0000 7fb33e3fd740 1 --2- 172.21.15.3:0/4094931341 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564d4bf00180 0x564d4bf025a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.560 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.554+0000 7fb33e3fd740 4 client.26927 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:34.560 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.554+0000 7fb33e3fd740 1 -- 172.21.15.3:0/4094931341 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d4be58830 con 0x564d4bf00180 2024-09-19T06:18:34.560 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.555+0000 7fb339000640 1 --2- 172.21.15.3:0/4094931341 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564d4bf00180 0x564d4bf025a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.560 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.555+0000 7fb339000640 1 --2- 172.21.15.3:0/4094931341 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564d4bf00180 0x564d4bf025a0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=813286a4b383691e server_cookie=9f1fdaffcc48bcc4 in_seq=0 out_seq=0 2024-09-19T06:18:34.560 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.555+0000 7fb31aa00640 10 client.26927 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:34.561 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.556+0000 7fb31aa00640 1 -- 172.21.15.3:0/4094931341 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564d4be58830 con 0x564d4bf00180 2024-09-19T06:18:34.561 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.556+0000 7fb31aa00640 10 client.26927 handle_command_reply: tid=0 2024-09-19T06:18:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.556+0000 7fb33e3fd740 1 client.26927 shutdown 2024-09-19T06:18:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.556+0000 7fb33e3fd740 1 -- 172.21.15.3:0/4094931341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee5b00 msgr2=0x564d4beed8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.556+0000 7fb33e3fd740 1 --2- 172.21.15.3:0/4094931341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee5b00 0x564d4beed8d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb3200edde0 tx=0x7fb3200bc770 comp rx=0 tx=0).stop 2024-09-19T06:18:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.556+0000 7fb33e3fd740 1 -- 172.21.15.3:0/4094931341 shutdown_connections 2024-09-19T06:18:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.556+0000 7fb33e3fd740 1 --2- 172.21.15.3:0/4094931341 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564d4bf00180 0x564d4bf025a0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.556+0000 7fb33e3fd740 1 --2- 172.21.15.3:0/4094931341 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d4bef03a0 0x564d4beede10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.556+0000 7fb33e3fd740 1 --2- 172.21.15.3:0/4094931341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee5b00 0x564d4beed8d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.556+0000 7fb33e3fd740 1 --2- 172.21.15.3:0/4094931341 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bee51e0 0x564d4beed390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.556+0000 7fb31aa00640 0 client.26927 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.556+0000 7fb33e3fd740 1 -- 172.21.15.3:0/4094931341 >> 172.21.15.3:0/4094931341 conn(0x564d4bee1750 msgr2=0x564d4bee74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:34.562 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.557+0000 7fb33e3fd740 1 -- 172.21.15.3:0/4094931341 shutdown_connections 2024-09-19T06:18:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.557+0000 7fb33e3fd740 1 -- 172.21.15.3:0/4094931341 wait complete. 2024-09-19T06:18:34.563 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.557+0000 7fb33e3fd740 20 client.26927 trim_cache size 0 max 16384 2024-09-19T06:18:34.574 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.572+0000 7fb33e3fd740 1 Processor -- start 2024-09-19T06:18:34.575 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.572+0000 7fb33e3fd740 1 -- start start 2024-09-19T06:18:34.575 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.572+0000 7fb33e3fd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee51e0 0x564d4beedc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.575 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.572+0000 7fb33e3fd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bee5b00 0x564d4beef1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.575 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.572+0000 7fb33e3fd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d4bef03a0 0x564d4bf07eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.575 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.572+0000 7fb33e3fd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341afa50 con 0x564d4bee5b00 2024-09-19T06:18:34.575 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.572+0000 7fb33e3fd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341b1590 con 0x564d4bee51e0 2024-09-19T06:18:34.575 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.572+0000 7fb33e3fd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341b0120 con 0x564d4bef03a0 2024-09-19T06:18:34.575 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.573+0000 7fb339000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee51e0 0x564d4beedc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.575 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.573+0000 7fb339000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee51e0 0x564d4beedc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:37810/0 (socket says 172.21.15.3:37810) 2024-09-19T06:18:34.575 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.573+0000 7fb339000640 1 -- 172.21.15.3:0/3660106641 learned_addr learned my addr 172.21.15.3:0/3660106641 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:34.575 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.573+0000 7fb339a00640 1 --2- 172.21.15.3:0/3660106641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d4bef03a0 0x564d4bf07eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.576 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.573+0000 7fb333e00640 1 --2- 172.21.15.3:0/3660106641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bee5b00 0x564d4beef1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.576 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.573+0000 7fb339000640 1 -- 172.21.15.3:0/3660106641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d4bef03a0 msgr2=0x564d4bf07eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:34.576 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.573+0000 7fb339000640 1 --2- 172.21.15.3:0/3660106641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d4bef03a0 0x564d4bf07eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.576 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.573+0000 7fb339000640 1 -- 172.21.15.3:0/3660106641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bee5b00 msgr2=0x564d4beef1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:34.576 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.573+0000 7fb339000640 1 --2- 172.21.15.3:0/3660106641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bee5b00 0x564d4beef1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.576 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.573+0000 7fb339000640 1 -- 172.21.15.3:0/3660106641 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d4bf02c20 con 0x564d4bee51e0 2024-09-19T06:18:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.573+0000 7fb339000640 1 --2- 172.21.15.3:0/3660106641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee51e0 0x564d4beedc80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x564d4bf02df0 tx=0x7fb328005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2daa39f14f06d9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.574+0000 7fb325600640 1 -- 172.21.15.3:0/3660106641 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb328003a20 con 0x564d4bee51e0 2024-09-19T06:18:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.574+0000 7fb325600640 1 -- 172.21.15.3:0/3660106641 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb328005500 con 0x564d4bee51e0 2024-09-19T06:18:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.574+0000 7fb325600640 1 -- 172.21.15.3:0/3660106641 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb328004c70 con 0x564d4bee51e0 2024-09-19T06:18:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.574+0000 7fb33e3fd740 1 -- 172.21.15.3:0/3660106641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee51e0 msgr2=0x564d4beedc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:34.578 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.574+0000 7fb33e3fd740 1 --2- 172.21.15.3:0/3660106641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee51e0 0x564d4beedc80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x564d4bf02df0 tx=0x7fb328005f90 comp rx=0 tx=0).stop 2024-09-19T06:18:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.574+0000 7fb33e3fd740 1 -- 172.21.15.3:0/3660106641 shutdown_connections 2024-09-19T06:18:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.574+0000 7fb33e3fd740 1 --2- 172.21.15.3:0/3660106641 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d4bef03a0 0x564d4bf07eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.574+0000 7fb33e3fd740 1 --2- 172.21.15.3:0/3660106641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bee5b00 0x564d4beef1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.574+0000 7fb33e3fd740 1 --2- 172.21.15.3:0/3660106641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee51e0 0x564d4beedc80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.574+0000 7fb33e3fd740 1 -- 172.21.15.3:0/3660106641 >> 172.21.15.3:0/3660106641 conn(0x564d4bee1750 msgr2=0x564d4beeeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.574+0000 7fb33e3fd740 1 -- 172.21.15.3:0/3660106641 shutdown_connections 2024-09-19T06:18:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.575+0000 7fb33e3fd740 1 -- 172.21.15.3:0/3660106641 wait complete. 2024-09-19T06:18:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.575+0000 7fb33e3fd740 1 -- start start 2024-09-19T06:18:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.575+0000 7fb33e3fd740 1 Processor -- start 2024-09-19T06:18:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.576+0000 7fb33e3fd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee51e0 0x564d4bef89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.576+0000 7fb33e3fd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d4bee5b00 0x564d4beea070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.579 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.576+0000 7fb33e3fd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bef03a0 0x564d4beea5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.576+0000 7fb33e3fd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341b0ec0 con 0x564d4bef03a0 2024-09-19T06:18:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.576+0000 7fb33e3fd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341b07f0 con 0x564d4bee51e0 2024-09-19T06:18:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.576+0000 7fb33e3fd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb3341ada30 con 0x564d4bee5b00 2024-09-19T06:18:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.576+0000 7fb33e3fd740 10 client.0 _ll_register_callbacks cb 0x7fb320005780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.576+0000 7fb339a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bef03a0 0x564d4beea5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.576+0000 7fb333e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d4bee5b00 0x564d4beea070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.576+0000 7fb339a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bef03a0 0x564d4beea5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45156/0 (socket says 172.21.15.3:45156) 2024-09-19T06:18:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.576+0000 7fb339a00640 1 -- 172.21.15.3:0/921973302 learned_addr learned my addr 172.21.15.3:0/921973302 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.576+0000 7fb333e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d4bee5b00 0x564d4beea070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:44952/0 (socket says 172.21.15.3:44952) 2024-09-19T06:18:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.576+0000 7fb339000640 1 --2- 172.21.15.3:0/921973302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee51e0 0x564d4bef89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.576+0000 7fb339a00640 1 -- 172.21.15.3:0/921973302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d4bee5b00 msgr2=0x564d4beea070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:34.580 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.576+0000 7fb339a00640 1 --2- 172.21.15.3:0/921973302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d4bee5b00 0x564d4beea070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.581 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.576+0000 7fb339a00640 1 -- 172.21.15.3:0/921973302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee51e0 msgr2=0x564d4bef89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:34.581 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.576+0000 7fb339a00640 1 --2- 172.21.15.3:0/921973302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee51e0 0x564d4bef89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.581 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.576+0000 7fb339a00640 1 -- 172.21.15.3:0/921973302 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d4bef2e50 con 0x564d4bef03a0 2024-09-19T06:18:34.581 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.577+0000 7fb339a00640 1 --2- 172.21.15.3:0/921973302 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bef03a0 0x564d4beea5b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009980 tx=0x7fb32c00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720bd59605b93c96 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:34.581 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.577+0000 7fb31aa00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:18:34.582 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.577+0000 7fb31aa00640 1 -- 172.21.15.3:0/921973302 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c036020 con 0x564d4bef03a0 2024-09-19T06:18:34.582 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.577+0000 7fb31aa00640 1 -- 172.21.15.3:0/921973302 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fb32c004c40 con 0x564d4bef03a0 2024-09-19T06:18:34.582 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.577+0000 7fb33e3fd740 1 -- 172.21.15.3:0/921973302 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb328005500 con 0x564d4bef03a0 2024-09-19T06:18:34.582 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.577+0000 7fb31aa00640 1 -- 172.21.15.3:0/921973302 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb32c041050 con 0x564d4bef03a0 2024-09-19T06:18:34.582 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.577+0000 7fb33e3fd740 10 client.16893 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:34.583 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.577+0000 7fb33e3fd740 1 -- 172.21.15.3:0/921973302 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564d4bf6ac20 con 0x564d4bef03a0 2024-09-19T06:18:34.583 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.577+0000 7fb31aa00640 1 -- 172.21.15.3:0/921973302 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb328005500 con 0x564d4bef03a0 2024-09-19T06:18:34.583 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.578+0000 7fb31aa00640 1 -- 172.21.15.3:0/921973302 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb32c005720 con 0x564d4bef03a0 2024-09-19T06:18:34.583 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.578+0000 7fb33e3fd740 10 client.16893 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:34.583 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.578+0000 7fb33e3fd740 10 client.16893 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:34.583 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.578+0000 7fb33e3fd740 20 client.16893 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:34.583 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.578+0000 7fb33e3fd740 1 --2- 172.21.15.3:0/921973302 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564d4bf6b2b0 0x564d4bf6d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:34.583 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.578+0000 7fb33e3fd740 4 client.16893 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:18:34.583 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.578+0000 7fb33e3fd740 1 -- 172.21.15.3:0/921973302 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564d4be52b80 con 0x564d4bf6b2b0 2024-09-19T06:18:34.583 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.578+0000 7fb339000640 1 --2- 172.21.15.3:0/921973302 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564d4bf6b2b0 0x564d4bf6d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:34.583 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.579+0000 7fb339000640 1 --2- 172.21.15.3:0/921973302 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564d4bf6b2b0 0x564d4bf6d6d0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36ea364c397d933e server_cookie=e0e3ba9f8a57496c in_seq=0 out_seq=0 2024-09-19T06:18:34.583 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.579+0000 7fb31aa00640 10 client.16893 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:34.595 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.593+0000 7fb31aa00640 1 -- 172.21.15.3:0/921973302 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564d4be52b80 con 0x564d4bf6b2b0 2024-09-19T06:18:34.595 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.593+0000 7fb31aa00640 10 client.16893 handle_command_reply: tid=0 2024-09-19T06:18:34.595 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.593+0000 7fb33e3fd740 1 client.16893 shutdown 2024-09-19T06:18:34.595 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.593+0000 7fb33e3fd740 1 -- 172.21.15.3:0/921973302 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bef03a0 msgr2=0x564d4beea5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:34.596 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.593+0000 7fb33e3fd740 1 --2- 172.21.15.3:0/921973302 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bef03a0 0x564d4beea5b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009980 tx=0x7fb32c00f520 comp rx=0 tx=0).stop 2024-09-19T06:18:34.596 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.593+0000 7fb33e3fd740 1 -- 172.21.15.3:0/921973302 shutdown_connections 2024-09-19T06:18:34.596 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.593+0000 7fb33e3fd740 1 --2- 172.21.15.3:0/921973302 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564d4bf6b2b0 0x564d4bf6d6d0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.596 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.593+0000 7fb33e3fd740 1 --2- 172.21.15.3:0/921973302 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564d4bef03a0 0x564d4beea5b0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.596 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.593+0000 7fb33e3fd740 1 --2- 172.21.15.3:0/921973302 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564d4bee5b00 0x564d4beea070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.596 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.593+0000 7fb31aa00640 0 client.16893 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:34.596 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.593+0000 7fb33e3fd740 1 --2- 172.21.15.3:0/921973302 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d4bee51e0 0x564d4bef89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.596 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.593+0000 7fb33e3fd740 1 -- 172.21.15.3:0/921973302 >> 172.21.15.3:0/921973302 conn(0x564d4bee1750 msgr2=0x564d4beeb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:34.596 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.593+0000 7fb33e3fd740 1 -- 172.21.15.3:0/921973302 shutdown_connections 2024-09-19T06:18:34.596 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.593+0000 7fb33e3fd740 1 -- 172.21.15.3:0/921973302 wait complete. 2024-09-19T06:18:34.596 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.594+0000 7fb33e3fd740 20 client.16893 trim_cache size 0 max 16384 2024-09-19T06:18:34.597 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:18:34.597 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:18:34.597 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:18:34.597 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:18:34.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.594+0000 7fb33ba00640 1 -- 172.21.15.3:0/138226931 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb31c0a33b0 msgr2=0x7fb31c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:34.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.594+0000 7fb33ba00640 1 --2- 172.21.15.3:0/138226931 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb31c0a33b0 0x7fb31c0a5870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb32c011d60 tx=0x7fb32c000f40 comp rx=0 tx=0).stop 2024-09-19T06:18:34.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.594+0000 7fb33ba00640 1 -- 172.21.15.3:0/138226931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb334109080 msgr2=0x7fb33419aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:34.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.594+0000 7fb33ba00640 1 --2- 172.21.15.3:0/138226931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb334109080 0x7fb33419aba0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb32002a910 tx=0x7fb320003b20 comp rx=0 tx=0).stop 2024-09-19T06:18:34.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.594+0000 7fb33ba00640 1 -- 172.21.15.3:0/138226931 shutdown_connections 2024-09-19T06:18:34.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.594+0000 7fb33ba00640 1 --2- 172.21.15.3:0/138226931 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb31c0a33b0 0x7fb31c0a5870 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.594+0000 7fb33ba00640 1 --2- 172.21.15.3:0/138226931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb33419ef20 0x7fb33419f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.594+0000 7fb33ba00640 1 --2- 172.21.15.3:0/138226931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb334109080 0x7fb33419aba0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.594+0000 7fb33ba00640 1 --2- 172.21.15.3:0/138226931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb334103f30 0x7fb33419a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:34.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.594+0000 7fb33ba00640 1 -- 172.21.15.3:0/138226931 >> 172.21.15.3:0/138226931 conn(0x7fb3340ff980 msgr2=0x7fb334100d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:34.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.594+0000 7fb33ba00640 1 -- 172.21.15.3:0/138226931 shutdown_connections 2024-09-19T06:18:34.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:34.594+0000 7fb33ba00640 1 -- 172.21.15.3:0/138226931 wait complete. 2024-09-19T06:18:35.318 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:18:35.698 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:36.015 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:35 smithi003 ceph-mon[30893]: pgmap v189: 97 pgs: 97 active+clean; 5.7 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-19T06:18:36.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:35 smithi059 ceph-mon[35138]: pgmap v189: 97 pgs: 97 active+clean; 5.7 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-19T06:18:36.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:35 smithi071 ceph-mon[35662]: pgmap v189: 97 pgs: 97 active+clean; 5.7 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-19T06:18:36.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.278+0000 7f73b4a00640 1 -- 172.21.15.3:0/3893609964 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73b0074ee0 msgr2=0x7f73b010dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:36.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.278+0000 7f73b4a00640 1 --2- 172.21.15.3:0/3893609964 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73b0074ee0 0x7f73b010dee0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f739c009900 tx=0x7f739c02a480 comp rx=0 tx=0).stop 2024-09-19T06:18:36.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.278+0000 7f73b4a00640 1 -- 172.21.15.3:0/3893609964 shutdown_connections 2024-09-19T06:18:36.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.278+0000 7f73b4a00640 1 --2- 172.21.15.3:0/3893609964 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73b010e420 0x7f73b0110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.278+0000 7f73b4a00640 1 --2- 172.21.15.3:0/3893609964 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73b0074ee0 0x7f73b010dee0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.278+0000 7f73b4a00640 1 --2- 172.21.15.3:0/3893609964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73b00745c0 0x7f73b00749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.278+0000 7f73b4a00640 1 -- 172.21.15.3:0/3893609964 >> 172.21.15.3:0/3893609964 conn(0x7f73b00fd8c0 msgr2=0x7f73b00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:36.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.278+0000 7f73b4a00640 1 -- 172.21.15.3:0/3893609964 shutdown_connections 2024-09-19T06:18:36.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.278+0000 7f73b4a00640 1 -- 172.21.15.3:0/3893609964 wait complete. 2024-09-19T06:18:36.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.279+0000 7f73b4a00640 1 Processor -- start 2024-09-19T06:18:36.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.279+0000 7f73b4a00640 1 -- start start 2024-09-19T06:18:36.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.279+0000 7f73b4a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73b00745c0 0x7f73b019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:36.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.279+0000 7f73b4a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73b0074ee0 0x7f73b019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:36.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.279+0000 7f73b4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73b010e420 0x7f73b019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:36.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.279+0000 7f73b4a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f73b0114170 con 0x7f73b0074ee0 2024-09-19T06:18:36.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.279+0000 7f73b4a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f73b0113ff0 con 0x7f73b010e420 2024-09-19T06:18:36.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.279+0000 7f73b4a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f73b01142f0 con 0x7f73b00745c0 2024-09-19T06:18:36.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.280+0000 7f73ad400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73b0074ee0 0x7f73b019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:36.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.280+0000 7f73ad400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73b0074ee0 0x7f73b019abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45170/0 (socket says 172.21.15.3:45170) 2024-09-19T06:18:36.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.280+0000 7f73ad400640 1 -- 172.21.15.3:0/703495110 learned_addr learned my addr 172.21.15.3:0/703495110 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:36.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.280+0000 7f73ae800640 1 --2- 172.21.15.3:0/703495110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73b010e420 0x7f73b019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:36.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.280+0000 7f73ade00640 1 --2- 172.21.15.3:0/703495110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73b00745c0 0x7f73b019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:36.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.280+0000 7f73ad400640 1 -- 172.21.15.3:0/703495110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73b00745c0 msgr2=0x7f73b019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:36.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.280+0000 7f73ad400640 1 --2- 172.21.15.3:0/703495110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73b00745c0 0x7f73b019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.280+0000 7f73ad400640 1 -- 172.21.15.3:0/703495110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73b010e420 msgr2=0x7f73b019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:36.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.280+0000 7f73ad400640 1 --2- 172.21.15.3:0/703495110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73b010e420 0x7f73b019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.280+0000 7f73ad400640 1 -- 172.21.15.3:0/703495110 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73b019f620 con 0x7f73b0074ee0 2024-09-19T06:18:36.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.281+0000 7f73ad400640 1 --2- 172.21.15.3:0/703495110 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73b0074ee0 0x7f73b019abb0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f739c006010 tx=0x7f739c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:36.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.281+0000 7f73a6a00640 1 -- 172.21.15.3:0/703495110 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c03f030 con 0x7f73b0074ee0 2024-09-19T06:18:36.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.281+0000 7f73a6a00640 1 -- 172.21.15.3:0/703495110 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f739c004440 con 0x7f73b0074ee0 2024-09-19T06:18:36.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.281+0000 7f73b4a00640 1 -- 172.21.15.3:0/703495110 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73b019f8b0 con 0x7f73b0074ee0 2024-09-19T06:18:36.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.281+0000 7f73a6a00640 1 -- 172.21.15.3:0/703495110 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c035070 con 0x7f73b0074ee0 2024-09-19T06:18:36.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.281+0000 7f73b4a00640 1 -- 172.21.15.3:0/703495110 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73b01a71f0 con 0x7f73b0074ee0 2024-09-19T06:18:36.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.284+0000 7f73b75db740 1 Processor -- start 2024-09-19T06:18:36.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.284+0000 7f73a6a00640 1 -- 172.21.15.3:0/703495110 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f739c042030 con 0x7f73b0074ee0 2024-09-19T06:18:36.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.284+0000 7f73b75db740 1 -- start start 2024-09-19T06:18:36.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.285+0000 7f73b75db740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc5884c70 0x562fc5885050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:36.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.285+0000 7f73b75db740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562fc5885590 0x562fc588f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:36.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.285+0000 7f73b75db740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562fc588fe50 0x562fc5892240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:36.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.285+0000 7f73b75db740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562fc57eb3e0 con 0x562fc5884c70 2024-09-19T06:18:36.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.285+0000 7f73b75db740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562fc5792d80 con 0x562fc588fe50 2024-09-19T06:18:36.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.285+0000 7f73b75db740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562fc57e73a0 con 0x562fc5885590 2024-09-19T06:18:36.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.285+0000 7f73ae800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc5884c70 0x562fc5885050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:36.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.285+0000 7f73ae800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc5884c70 0x562fc5885050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45176/0 (socket says 172.21.15.3:45176) 2024-09-19T06:18:36.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.285+0000 7f73ae800640 1 -- 172.21.15.3:0/3278318997 learned_addr learned my addr 172.21.15.3:0/3278318997 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:36.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.285+0000 7f73ade00640 1 --2- 172.21.15.3:0/3278318997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562fc5885590 0x562fc588f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:36.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.285+0000 7f73ad400640 1 --2- 172.21.15.3:0/3278318997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562fc588fe50 0x562fc5892240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:36.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.286+0000 7f73ae800640 1 -- 172.21.15.3:0/3278318997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562fc5885590 msgr2=0x562fc588f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:36.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.286+0000 7f73ae800640 1 --2- 172.21.15.3:0/3278318997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562fc5885590 0x562fc588f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.286+0000 7f73ae800640 1 -- 172.21.15.3:0/3278318997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562fc588fe50 msgr2=0x562fc5892240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:36.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.286+0000 7f73ae800640 1 --2- 172.21.15.3:0/3278318997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562fc588fe50 0x562fc5892240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.286+0000 7f73ae800640 1 -- 172.21.15.3:0/3278318997 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fc57b1ae0 con 0x562fc5884c70 2024-09-19T06:18:36.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.286+0000 7f73ade00640 1 --2- 172.21.15.3:0/3278318997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562fc5885590 0x562fc588f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:36.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.286+0000 7f73a6a00640 1 --2- 172.21.15.3:0/703495110 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f73940a33b0 0x7f73940a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:36.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.286+0000 7f73ae800640 1 --2- 172.21.15.3:0/3278318997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc5884c70 0x562fc5885050 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f73a8009f30 tx=0x7f73a80118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7714efea26b27a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:36.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.286+0000 7f73a6a00640 1 -- 172.21.15.3:0/703495110 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f739c0f00d0 con 0x7f73b0074ee0 2024-09-19T06:18:36.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.286+0000 7f73ade00640 1 --2- 172.21.15.3:0/703495110 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f73940a33b0 0x7f73940a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:36.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.287+0000 7f739b000640 1 -- 172.21.15.3:0/3278318997 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a8004d20 con 0x562fc5884c70 2024-09-19T06:18:36.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.287+0000 7f739b000640 1 -- 172.21.15.3:0/3278318997 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73a8004050 con 0x562fc5884c70 2024-09-19T06:18:36.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.287+0000 7f739b000640 1 -- 172.21.15.3:0/3278318997 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a8005260 con 0x562fc5884c70 2024-09-19T06:18:36.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.287+0000 7f73b75db740 1 -- 172.21.15.3:0/3278318997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc5884c70 msgr2=0x562fc5885050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:36.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.287+0000 7f73ade00640 1 --2- 172.21.15.3:0/703495110 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f73940a33b0 0x7f73940a5870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x562fc5882060 tx=0x7f73a0005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:36.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.287+0000 7f73b75db740 1 --2- 172.21.15.3:0/3278318997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc5884c70 0x562fc5885050 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f73a8009f30 tx=0x7f73a80118d0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.288+0000 7f73b75db740 1 -- 172.21.15.3:0/3278318997 shutdown_connections 2024-09-19T06:18:36.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.288+0000 7f73b75db740 1 --2- 172.21.15.3:0/3278318997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562fc588fe50 0x562fc5892240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.288+0000 7f73b75db740 1 --2- 172.21.15.3:0/3278318997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562fc5885590 0x562fc588f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.288+0000 7f73b75db740 1 --2- 172.21.15.3:0/3278318997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc5884c70 0x562fc5885050 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.288+0000 7f73b75db740 1 -- 172.21.15.3:0/3278318997 >> 172.21.15.3:0/3278318997 conn(0x562fc5881200 msgr2=0x562fc58815e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:36.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.288+0000 7f73b75db740 1 -- 172.21.15.3:0/3278318997 shutdown_connections 2024-09-19T06:18:36.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.288+0000 7f73b75db740 1 -- 172.21.15.3:0/3278318997 wait complete. 2024-09-19T06:18:36.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.288+0000 7f73b75db740 1 -- start start 2024-09-19T06:18:36.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.289+0000 7f73b75db740 1 Processor -- start 2024-09-19T06:18:36.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.289+0000 7f73b75db740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562fc5884c70 0x562fc588cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:36.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.289+0000 7f73b75db740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562fc5885590 0x562fc588d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:36.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.289+0000 7f73b75db740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc588fe50 0x562fc588d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:36.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.289+0000 7f73b75db740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562fc5892a20 con 0x562fc588fe50 2024-09-19T06:18:36.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.289+0000 7f73b75db740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562fc57a60f0 con 0x562fc5884c70 2024-09-19T06:18:36.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.289+0000 7f73b75db740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562fc5892ba0 con 0x562fc5885590 2024-09-19T06:18:36.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.289+0000 7f73b75db740 10 client.0 _ll_register_callbacks cb 0x562fc578dbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:36.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.289+0000 7f73ade00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562fc5884c70 0x562fc588cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:36.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.289+0000 7f73ae800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc588fe50 0x562fc588d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:36.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.290+0000 7f73ade00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562fc5884c70 0x562fc588cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:37870/0 (socket says 172.21.15.3:37870) 2024-09-19T06:18:36.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.290+0000 7f73ade00640 1 -- 172.21.15.3:0/3023246083 learned_addr learned my addr 172.21.15.3:0/3023246083 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:36.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.290+0000 7f73ad400640 1 --2- 172.21.15.3:0/3023246083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562fc5885590 0x562fc588d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:36.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.290+0000 7f73ade00640 1 -- 172.21.15.3:0/3023246083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562fc5885590 msgr2=0x562fc588d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:36.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.290+0000 7f73ade00640 1 --2- 172.21.15.3:0/3023246083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562fc5885590 0x562fc588d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.290+0000 7f73ade00640 1 -- 172.21.15.3:0/3023246083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc588fe50 msgr2=0x562fc588d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:36.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.290+0000 7f73ade00640 1 --2- 172.21.15.3:0/3023246083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc588fe50 0x562fc588d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.290+0000 7f73ade00640 1 -- 172.21.15.3:0/3023246083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fc555c3c0 con 0x562fc5884c70 2024-09-19T06:18:36.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.290+0000 7f73ad400640 1 --2- 172.21.15.3:0/3023246083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562fc5885590 0x562fc588d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:36.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.290+0000 7f73ade00640 1 --2- 172.21.15.3:0/3023246083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562fc5884c70 0x562fc588cd20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f73a00097c0 tx=0x7f73a0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19c61955523a6f4e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:36.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.290+0000 7f738f400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:18:36.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.291+0000 7f738f400640 1 -- 172.21.15.3:0/3023246083 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a002e060 con 0x562fc5884c70 2024-09-19T06:18:36.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.291+0000 7f73b75db740 1 -- 172.21.15.3:0/3023246083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73a8004050 con 0x562fc5884c70 2024-09-19T06:18:36.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.291+0000 7f738f400640 1 -- 172.21.15.3:0/3023246083 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f73a0018030 con 0x562fc5884c70 2024-09-19T06:18:36.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.291+0000 7f738f400640 1 -- 172.21.15.3:0/3023246083 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f73a0009be0 con 0x562fc5884c70 2024-09-19T06:18:36.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.291+0000 7f73b75db740 10 client.26945 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:36.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.291+0000 7f73b75db740 1 -- 172.21.15.3:0/3023246083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562fc589eaa0 con 0x562fc5884c70 2024-09-19T06:18:36.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.291+0000 7f738f400640 1 -- 172.21.15.3:0/3023246083 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73a8004050 con 0x562fc5884c70 2024-09-19T06:18:36.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.291+0000 7f738f400640 1 -- 172.21.15.3:0/3023246083 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f73a0031680 con 0x562fc5884c70 2024-09-19T06:18:36.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.291+0000 7f73b75db740 10 client.26945 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:36.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.291+0000 7f73b75db740 10 client.26945 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:36.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.292+0000 7f73b75db740 20 client.26945 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:36.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.292+0000 7f73b75db740 1 --2- 172.21.15.3:0/3023246083 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562fc589ff60 0x562fc58a23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:36.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.292+0000 7f73b75db740 4 client.26945 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:36.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.292+0000 7f73b75db740 1 -- 172.21.15.3:0/3023246083 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562fc57f8950 con 0x562fc589ff60 2024-09-19T06:18:36.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.292+0000 7f73ad400640 1 --2- 172.21.15.3:0/3023246083 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562fc589ff60 0x562fc58a23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:36.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.292+0000 7f73ad400640 1 --2- 172.21.15.3:0/3023246083 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562fc589ff60 0x562fc58a23b0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ec9300e59c1be1c server_cookie=1850931d4292f99f in_seq=0 out_seq=0 2024-09-19T06:18:36.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.292+0000 7f738f400640 10 client.26945 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:36.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.293+0000 7f738f400640 1 -- 172.21.15.3:0/3023246083 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562fc57f8950 con 0x562fc589ff60 2024-09-19T06:18:36.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.293+0000 7f738f400640 10 client.26945 handle_command_reply: tid=0 2024-09-19T06:18:36.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.293+0000 7f73b75db740 1 client.26945 shutdown 2024-09-19T06:18:36.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.293+0000 7f73b75db740 1 -- 172.21.15.3:0/3023246083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562fc5884c70 msgr2=0x562fc588cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:36.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.293+0000 7f73b75db740 1 --2- 172.21.15.3:0/3023246083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562fc5884c70 0x562fc588cd20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f73a00097c0 tx=0x7f73a0004730 comp rx=0 tx=0).stop 2024-09-19T06:18:36.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.294+0000 7f73b75db740 1 -- 172.21.15.3:0/3023246083 shutdown_connections 2024-09-19T06:18:36.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.294+0000 7f73b75db740 1 --2- 172.21.15.3:0/3023246083 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562fc589ff60 0x562fc58a23b0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.294+0000 7f73b75db740 1 --2- 172.21.15.3:0/3023246083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc588fe50 0x562fc588d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.294+0000 7f73b75db740 1 --2- 172.21.15.3:0/3023246083 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562fc5885590 0x562fc588d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.294+0000 7f73b75db740 1 --2- 172.21.15.3:0/3023246083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562fc5884c70 0x562fc588cd20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.294+0000 7f738f400640 0 client.26945 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:36.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.294+0000 7f73b75db740 1 -- 172.21.15.3:0/3023246083 >> 172.21.15.3:0/3023246083 conn(0x562fc5881200 msgr2=0x562fc5880380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:36.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.294+0000 7f73b75db740 1 -- 172.21.15.3:0/3023246083 shutdown_connections 2024-09-19T06:18:36.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.294+0000 7f73b75db740 1 -- 172.21.15.3:0/3023246083 wait complete. 2024-09-19T06:18:36.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.294+0000 7f73b75db740 20 client.26945 trim_cache size 0 max 16384 2024-09-19T06:18:36.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.307+0000 7f73b75db740 1 Processor -- start 2024-09-19T06:18:36.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.308+0000 7f73b75db740 1 -- start start 2024-09-19T06:18:36.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.308+0000 7f73b75db740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562fc5884c70 0x562fc58a7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:36.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.308+0000 7f73b75db740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc5885590 0x562fc58a81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:36.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.308+0000 7f73b75db740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562fc588fe50 0x562fc5889f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:36.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.308+0000 7f73b75db740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f73b01afae0 con 0x562fc5885590 2024-09-19T06:18:36.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.308+0000 7f73b75db740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f73b01b1620 con 0x562fc5884c70 2024-09-19T06:18:36.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.308+0000 7f73b75db740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f73b01b01b0 con 0x562fc588fe50 2024-09-19T06:18:36.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.308+0000 7f73ad400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc5885590 0x562fc58a81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:36.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.308+0000 7f73ad400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc5885590 0x562fc58a81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45190/0 (socket says 172.21.15.3:45190) 2024-09-19T06:18:36.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.308+0000 7f73ad400640 1 -- 172.21.15.3:0/425911143 learned_addr learned my addr 172.21.15.3:0/425911143 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:36.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.308+0000 7f73ade00640 1 --2- 172.21.15.3:0/425911143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562fc5884c70 0x562fc58a7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:36.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.308+0000 7f73ae800640 1 --2- 172.21.15.3:0/425911143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562fc588fe50 0x562fc5889f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:36.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.308+0000 7f73ad400640 1 -- 172.21.15.3:0/425911143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562fc588fe50 msgr2=0x562fc5889f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:36.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.309+0000 7f73ad400640 1 --2- 172.21.15.3:0/425911143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562fc588fe50 0x562fc5889f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.309+0000 7f73ad400640 1 -- 172.21.15.3:0/425911143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562fc5884c70 msgr2=0x562fc58a7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:36.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.309+0000 7f73ad400640 1 --2- 172.21.15.3:0/425911143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562fc5884c70 0x562fc58a7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.309+0000 7f73ad400640 1 -- 172.21.15.3:0/425911143 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fc58822b0 con 0x562fc5885590 2024-09-19T06:18:36.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.309+0000 7f73ae800640 1 --2- 172.21.15.3:0/425911143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562fc588fe50 0x562fc5889f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:36.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.309+0000 7f73ade00640 1 --2- 172.21.15.3:0/425911143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562fc5884c70 0x562fc58a7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:36.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.309+0000 7f73ad400640 1 --2- 172.21.15.3:0/425911143 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc5885590 0x562fc58a81c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f739c000c00 tx=0x7f739c0daf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65363f3404079118 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:36.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.309+0000 7f739a600640 1 -- 172.21.15.3:0/425911143 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c049040 con 0x562fc5885590 2024-09-19T06:18:36.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.309+0000 7f739a600640 1 -- 172.21.15.3:0/425911143 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f739c0bc400 con 0x562fc5885590 2024-09-19T06:18:36.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.309+0000 7f739a600640 1 -- 172.21.15.3:0/425911143 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c0ba790 con 0x562fc5885590 2024-09-19T06:18:36.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.310+0000 7f73b75db740 1 -- 172.21.15.3:0/425911143 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc5885590 msgr2=0x562fc58a81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:36.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.310+0000 7f73b75db740 1 --2- 172.21.15.3:0/425911143 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc5885590 0x562fc58a81c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f739c000c00 tx=0x7f739c0daf90 comp rx=0 tx=0).stop 2024-09-19T06:18:36.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.310+0000 7f73b75db740 1 -- 172.21.15.3:0/425911143 shutdown_connections 2024-09-19T06:18:36.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.310+0000 7f73b75db740 1 --2- 172.21.15.3:0/425911143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562fc588fe50 0x562fc5889f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.310+0000 7f73b75db740 1 --2- 172.21.15.3:0/425911143 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc5885590 0x562fc58a81c0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.310+0000 7f73b75db740 1 --2- 172.21.15.3:0/425911143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562fc5884c70 0x562fc58a7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.310+0000 7f73b75db740 1 -- 172.21.15.3:0/425911143 >> 172.21.15.3:0/425911143 conn(0x562fc5881200 msgr2=0x562fc588eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:36.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.310+0000 7f73b75db740 1 -- 172.21.15.3:0/425911143 shutdown_connections 2024-09-19T06:18:36.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.310+0000 7f73b75db740 1 -- 172.21.15.3:0/425911143 wait complete. 2024-09-19T06:18:36.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.310+0000 7f73b75db740 1 -- start start 2024-09-19T06:18:36.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.311+0000 7f73b75db740 1 Processor -- start 2024-09-19T06:18:36.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.311+0000 7f73b75db740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562fc5884c70 0x562fc5898720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:36.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.311+0000 7f73b75db740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc5885590 0x562fc5893af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:36.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.311+0000 7f73b75db740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562fc588fe50 0x562fc5894280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:36.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.311+0000 7f73b75db740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f73b01b0f50 con 0x562fc5885590 2024-09-19T06:18:36.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.311+0000 7f73b75db740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f73b01b0880 con 0x562fc5884c70 2024-09-19T06:18:36.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.311+0000 7f73b75db740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f73b01adac0 con 0x562fc588fe50 2024-09-19T06:18:36.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.311+0000 7f73b75db740 10 client.0 _ll_register_callbacks cb 0x7f73a0009390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:36.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.311+0000 7f73ad400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc5885590 0x562fc5893af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:36.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.311+0000 7f73ad400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc5885590 0x562fc5893af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45196/0 (socket says 172.21.15.3:45196) 2024-09-19T06:18:36.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.312+0000 7f73ad400640 1 -- 172.21.15.3:0/3553963590 learned_addr learned my addr 172.21.15.3:0/3553963590 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:36.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.312+0000 7f73ade00640 1 --2- 172.21.15.3:0/3553963590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562fc5884c70 0x562fc5898720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:36.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.312+0000 7f73ae800640 1 --2- 172.21.15.3:0/3553963590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562fc588fe50 0x562fc5894280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:36.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.312+0000 7f73ad400640 1 -- 172.21.15.3:0/3553963590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562fc588fe50 msgr2=0x562fc5894280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:36.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.312+0000 7f73ad400640 1 --2- 172.21.15.3:0/3553963590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562fc588fe50 0x562fc5894280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.312+0000 7f73ad400640 1 -- 172.21.15.3:0/3553963590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562fc5884c70 msgr2=0x562fc5898720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:36.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.312+0000 7f73ad400640 1 --2- 172.21.15.3:0/3553963590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562fc5884c70 0x562fc5898720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.312+0000 7f73ad400640 1 -- 172.21.15.3:0/3553963590 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fc5909c50 con 0x562fc5885590 2024-09-19T06:18:36.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.312+0000 7f73ad400640 1 --2- 172.21.15.3:0/3553963590 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc5885590 0x562fc5893af0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f739c0c4a90 tx=0x7f739c0f03e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3381affe408cd333 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:36.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.312+0000 7f738f400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:18:36.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.312+0000 7f738f400640 1 -- 172.21.15.3:0/3553963590 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c049050 con 0x562fc5885590 2024-09-19T06:18:36.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.312+0000 7f738f400640 1 -- 172.21.15.3:0/3553963590 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f739c0b8a70 con 0x562fc5885590 2024-09-19T06:18:36.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.312+0000 7f73b75db740 1 -- 172.21.15.3:0/3553963590 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f739c0bc400 con 0x562fc5885590 2024-09-19T06:18:36.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.313+0000 7f738f400640 1 -- 172.21.15.3:0/3553963590 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f739c0bbd60 con 0x562fc5885590 2024-09-19T06:18:36.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.313+0000 7f73b75db740 10 client.16911 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:36.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.313+0000 7f73b75db740 1 -- 172.21.15.3:0/3553963590 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562fc590ae60 con 0x562fc5885590 2024-09-19T06:18:36.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.313+0000 7f738f400640 1 -- 172.21.15.3:0/3553963590 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f739c0bc400 con 0x562fc5885590 2024-09-19T06:18:36.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.313+0000 7f738f400640 1 -- 172.21.15.3:0/3553963590 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f739c0eda40 con 0x562fc5885590 2024-09-19T06:18:36.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.313+0000 7f73b75db740 10 client.16911 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:36.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.313+0000 7f73b75db740 10 client.16911 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:36.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.313+0000 7f73b75db740 20 client.16911 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:36.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.313+0000 7f73b75db740 1 --2- 172.21.15.3:0/3553963590 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562fc590b610 0x562fc590da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:36.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.313+0000 7f73b75db740 4 client.16911 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:18:36.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.313+0000 7f73b75db740 1 -- 172.21.15.3:0/3553963590 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562fc57f2e60 con 0x562fc590b610 2024-09-19T06:18:36.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.314+0000 7f73ade00640 1 --2- 172.21.15.3:0/3553963590 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562fc590b610 0x562fc590da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:36.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.314+0000 7f73ade00640 1 --2- 172.21.15.3:0/3553963590 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562fc590b610 0x562fc590da30 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f19ade3a1685176 server_cookie=3bf62ecacf1c287c in_seq=0 out_seq=0 2024-09-19T06:18:36.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.314+0000 7f738f400640 10 client.16911 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:36.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.314+0000 7f738f400640 1 -- 172.21.15.3:0/3553963590 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562fc57f2e60 con 0x562fc590b610 2024-09-19T06:18:36.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.314+0000 7f738f400640 10 client.16911 handle_command_reply: tid=0 2024-09-19T06:18:36.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.314+0000 7f73b75db740 1 client.16911 shutdown 2024-09-19T06:18:36.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.315+0000 7f73b75db740 1 -- 172.21.15.3:0/3553963590 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc5885590 msgr2=0x562fc5893af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:36.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.315+0000 7f73b75db740 1 --2- 172.21.15.3:0/3553963590 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc5885590 0x562fc5893af0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f739c0c4a90 tx=0x7f739c0f03e0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.315+0000 7f73b75db740 1 -- 172.21.15.3:0/3553963590 shutdown_connections 2024-09-19T06:18:36.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.315+0000 7f73b75db740 1 --2- 172.21.15.3:0/3553963590 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562fc590b610 0x562fc590da30 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.315+0000 7f73b75db740 1 --2- 172.21.15.3:0/3553963590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562fc588fe50 0x562fc5894280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.315+0000 7f73b75db740 1 --2- 172.21.15.3:0/3553963590 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562fc5885590 0x562fc5893af0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.315+0000 7f73b75db740 1 --2- 172.21.15.3:0/3553963590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562fc5884c70 0x562fc5898720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.315+0000 7f73b75db740 1 -- 172.21.15.3:0/3553963590 >> 172.21.15.3:0/3553963590 conn(0x562fc5881200 msgr2=0x562fc58866c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:36.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.315+0000 7f738f400640 0 client.16911 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:36.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.315+0000 7f73b75db740 1 -- 172.21.15.3:0/3553963590 shutdown_connections 2024-09-19T06:18:36.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.315+0000 7f73b75db740 1 -- 172.21.15.3:0/3553963590 wait complete. 2024-09-19T06:18:36.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.315+0000 7f73b75db740 20 client.16911 trim_cache size 0 max 16384 2024-09-19T06:18:36.321 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:18:36.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.316+0000 7f73b4a00640 1 -- 172.21.15.3:0/703495110 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f73940a33b0 msgr2=0x7f73940a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:36.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.316+0000 7f73b4a00640 1 --2- 172.21.15.3:0/703495110 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f73940a33b0 0x7f73940a5870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x562fc5882060 tx=0x7f73a0005f90 comp rx=0 tx=0).stop 2024-09-19T06:18:36.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.316+0000 7f73b4a00640 1 -- 172.21.15.3:0/703495110 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73b0074ee0 msgr2=0x7f73b019abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:36.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.316+0000 7f73b4a00640 1 --2- 172.21.15.3:0/703495110 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73b0074ee0 0x7f73b019abb0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f739c006010 tx=0x7f739c004040 comp rx=0 tx=0).stop 2024-09-19T06:18:36.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.316+0000 7f73b4a00640 1 -- 172.21.15.3:0/703495110 shutdown_connections 2024-09-19T06:18:36.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.316+0000 7f73b4a00640 1 --2- 172.21.15.3:0/703495110 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f73940a33b0 0x7f73940a5870 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.316+0000 7f73b4a00640 1 --2- 172.21.15.3:0/703495110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73b010e420 0x7f73b019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.316+0000 7f73b4a00640 1 --2- 172.21.15.3:0/703495110 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73b0074ee0 0x7f73b019abb0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.316+0000 7f73b4a00640 1 --2- 172.21.15.3:0/703495110 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f73b00745c0 0x7f73b019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:36.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.316+0000 7f73b4a00640 1 -- 172.21.15.3:0/703495110 >> 172.21.15.3:0/703495110 conn(0x7f73b00fd8c0 msgr2=0x7f73b00fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:36.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.316+0000 7f73b4a00640 1 -- 172.21.15.3:0/703495110 shutdown_connections 2024-09-19T06:18:36.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:36.316+0000 7f73b4a00640 1 -- 172.21.15.3:0/703495110 wait complete. 2024-09-19T06:18:38.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:37 smithi059 ceph-mon[35138]: pgmap v190: 97 pgs: 97 active+clean; 5.7 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-09-19T06:18:38.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:37 smithi003 ceph-mon[30893]: pgmap v190: 97 pgs: 97 active+clean; 5.7 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-09-19T06:18:38.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:37 smithi071 ceph-mon[35662]: pgmap v190: 97 pgs: 97 active+clean; 5.7 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-09-19T06:18:38.153 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:18:38.153 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:18:38.546 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:39.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.138+0000 7fdb40a00640 1 -- 172.21.15.3:0/598245301 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb3c103e30 msgr2=0x7fdb3c104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:39.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.138+0000 7fdb40a00640 1 --2- 172.21.15.3:0/598245301 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb3c103e30 0x7fdb3c104210 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c009900 tx=0x7fdb2c02a410 comp rx=0 tx=0).stop 2024-09-19T06:18:39.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.138+0000 7fdb40a00640 1 -- 172.21.15.3:0/598245301 shutdown_connections 2024-09-19T06:18:39.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.138+0000 7fdb40a00640 1 --2- 172.21.15.3:0/598245301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3c108f60 0x7fdb3c110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.138+0000 7fdb40a00640 1 --2- 172.21.15.3:0/598245301 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb3c1047e0 0x7fdb3c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.138+0000 7fdb40a00640 1 --2- 172.21.15.3:0/598245301 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb3c103e30 0x7fdb3c104210 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.138+0000 7fdb40a00640 1 -- 172.21.15.3:0/598245301 >> 172.21.15.3:0/598245301 conn(0x7fdb3c0ff910 msgr2=0x7fdb3c101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:39.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.138+0000 7fdb40a00640 1 -- 172.21.15.3:0/598245301 shutdown_connections 2024-09-19T06:18:39.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.138+0000 7fdb40a00640 1 -- 172.21.15.3:0/598245301 wait complete. 2024-09-19T06:18:39.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.139+0000 7fdb40a00640 1 Processor -- start 2024-09-19T06:18:39.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.139+0000 7fdb40a00640 1 -- start start 2024-09-19T06:18:39.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.140+0000 7fdb40a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb3c103e30 0x7fdb3c19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:39.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.140+0000 7fdb40a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb3c1047e0 0x7fdb3c19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:39.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.140+0000 7fdb40a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3c108f60 0x7fdb3c19ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:39.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.140+0000 7fdb40a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3c114010 con 0x7fdb3c1047e0 2024-09-19T06:18:39.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.140+0000 7fdb40a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3c113e90 con 0x7fdb3c108f60 2024-09-19T06:18:39.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.140+0000 7fdb40a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3c114190 con 0x7fdb3c103e30 2024-09-19T06:18:39.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.140+0000 7fdb33e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb3c1047e0 0x7fdb3c19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:39.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.140+0000 7fdb33e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb3c1047e0 0x7fdb3c19a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45212/0 (socket says 172.21.15.3:45212) 2024-09-19T06:18:39.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.140+0000 7fdb33e00640 1 -- 172.21.15.3:0/2318616197 learned_addr learned my addr 172.21.15.3:0/2318616197 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:39.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.140+0000 7fdb3b200640 1 --2- 172.21.15.3:0/2318616197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3c108f60 0x7fdb3c19ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:39.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.140+0000 7fdb3a800640 1 --2- 172.21.15.3:0/2318616197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb3c103e30 0x7fdb3c19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:39.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.141+0000 7fdb33e00640 1 -- 172.21.15.3:0/2318616197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb3c103e30 msgr2=0x7fdb3c19a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:39.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.141+0000 7fdb33e00640 1 --2- 172.21.15.3:0/2318616197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb3c103e30 0x7fdb3c19a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.141+0000 7fdb33e00640 1 -- 172.21.15.3:0/2318616197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3c108f60 msgr2=0x7fdb3c19ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:39.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.141+0000 7fdb33e00640 1 --2- 172.21.15.3:0/2318616197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3c108f60 0x7fdb3c19ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.141+0000 7fdb33e00640 1 -- 172.21.15.3:0/2318616197 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb3c19f400 con 0x7fdb3c1047e0 2024-09-19T06:18:39.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.141+0000 7fdb33e00640 1 --2- 172.21.15.3:0/2318616197 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb3c1047e0 0x7fdb3c19a990 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdb2400e9f0 tx=0x7fdb2400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:39.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.141+0000 7fdb33400640 1 -- 172.21.15.3:0/2318616197 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2400cd80 con 0x7fdb3c1047e0 2024-09-19T06:18:39.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.141+0000 7fdb33400640 1 -- 172.21.15.3:0/2318616197 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb24005500 con 0x7fdb3c1047e0 2024-09-19T06:18:39.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.141+0000 7fdb40a00640 1 -- 172.21.15.3:0/2318616197 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb3c19f6f0 con 0x7fdb3c1047e0 2024-09-19T06:18:39.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.141+0000 7fdb33400640 1 -- 172.21.15.3:0/2318616197 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb24010690 con 0x7fdb3c1047e0 2024-09-19T06:18:39.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.141+0000 7fdb40a00640 1 -- 172.21.15.3:0/2318616197 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb3c1a6fd0 con 0x7fdb3c1047e0 2024-09-19T06:18:39.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.144+0000 7fdb4405f740 1 Processor -- start 2024-09-19T06:18:39.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.145+0000 7fdb4405f740 1 -- start start 2024-09-19T06:18:39.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.145+0000 7fdb33400640 1 -- 172.21.15.3:0/2318616197 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fdb240046c0 con 0x7fdb3c1047e0 2024-09-19T06:18:39.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.145+0000 7fdb4405f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a349956cb0 0x55a349957090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:39.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.145+0000 7fdb4405f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3499575d0 0x55a349961950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:39.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.145+0000 7fdb4405f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a349961e90 0x55a349964280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:39.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.145+0000 7fdb4405f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a3498bd290 con 0x55a349961e90 2024-09-19T06:18:39.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.145+0000 7fdb4405f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a349864b40 con 0x55a3499575d0 2024-09-19T06:18:39.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.145+0000 7fdb4405f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a3498b9250 con 0x55a349956cb0 2024-09-19T06:18:39.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.145+0000 7fdb3b200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a349956cb0 0x55a349957090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:39.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.145+0000 7fdb3b200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a349956cb0 0x55a349957090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:45040/0 (socket says 172.21.15.3:45040) 2024-09-19T06:18:39.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.145+0000 7fdb3b200640 1 -- 172.21.15.3:0/2552784950 learned_addr learned my addr 172.21.15.3:0/2552784950 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:39.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.145+0000 7fdb3a800640 1 --2- 172.21.15.3:0/2552784950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3499575d0 0x55a349961950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:39.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.145+0000 7fdb33e00640 1 --2- 172.21.15.3:0/2552784950 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a349961e90 0x55a349964280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:39.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.146+0000 7fdb3a800640 1 -- 172.21.15.3:0/2552784950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a349956cb0 msgr2=0x55a349957090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:39.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.146+0000 7fdb3a800640 1 --2- 172.21.15.3:0/2552784950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a349956cb0 0x55a349957090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.146+0000 7fdb3a800640 1 -- 172.21.15.3:0/2552784950 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a349961e90 msgr2=0x55a349964280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:39.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.146+0000 7fdb3a800640 1 --2- 172.21.15.3:0/2552784950 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a349961e90 0x55a349964280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.146+0000 7fdb3a800640 1 -- 172.21.15.3:0/2552784950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a34962e6a0 con 0x55a3499575d0 2024-09-19T06:18:39.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.146+0000 7fdb3a800640 1 --2- 172.21.15.3:0/2552784950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3499575d0 0x55a349961950 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c02aa00 tx=0x7fdb2c005de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba635a25b7dc4d5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:39.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.146+0000 7fdb2b400640 1 -- 172.21.15.3:0/2552784950 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c035040 con 0x55a3499575d0 2024-09-19T06:18:39.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.147+0000 7fdb2b400640 1 -- 172.21.15.3:0/2552784950 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb2c004400 con 0x55a3499575d0 2024-09-19T06:18:39.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.147+0000 7fdb2b400640 1 -- 172.21.15.3:0/2552784950 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c0035f0 con 0x55a3499575d0 2024-09-19T06:18:39.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.147+0000 7fdb33400640 1 --2- 172.21.15.3:0/2318616197 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fdb200a33b0 0x7fdb200a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:39.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.147+0000 7fdb33400640 1 -- 172.21.15.3:0/2318616197 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fdb240d0160 con 0x7fdb3c1047e0 2024-09-19T06:18:39.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.147+0000 7fdb3b200640 1 --2- 172.21.15.3:0/2318616197 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fdb200a33b0 0x7fdb200a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:39.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.147+0000 7fdb4405f740 1 -- 172.21.15.3:0/2552784950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3499575d0 msgr2=0x55a349961950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:39.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.147+0000 7fdb4405f740 1 --2- 172.21.15.3:0/2552784950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3499575d0 0x55a349961950 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c02aa00 tx=0x7fdb2c005de0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.148+0000 7fdb4405f740 1 -- 172.21.15.3:0/2552784950 shutdown_connections 2024-09-19T06:18:39.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.148+0000 7fdb4405f740 1 --2- 172.21.15.3:0/2552784950 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a349961e90 0x55a349964280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.148+0000 7fdb4405f740 1 --2- 172.21.15.3:0/2552784950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3499575d0 0x55a349961950 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.148+0000 7fdb4405f740 1 --2- 172.21.15.3:0/2552784950 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a349956cb0 0x55a349957090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.148+0000 7fdb4405f740 1 -- 172.21.15.3:0/2552784950 >> 172.21.15.3:0/2552784950 conn(0x55a349953240 msgr2=0x55a349953620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:39.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.148+0000 7fdb4405f740 1 -- 172.21.15.3:0/2552784950 shutdown_connections 2024-09-19T06:18:39.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.148+0000 7fdb3b200640 1 --2- 172.21.15.3:0/2318616197 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fdb200a33b0 0x7fdb200a5870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdb34011630 tx=0x7fdb34009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:39.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.148+0000 7fdb4405f740 1 -- 172.21.15.3:0/2552784950 wait complete. 2024-09-19T06:18:39.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.148+0000 7fdb4405f740 1 -- start start 2024-09-19T06:18:39.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.148+0000 7fdb4405f740 1 Processor -- start 2024-09-19T06:18:39.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.149+0000 7fdb4405f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a349956cb0 0x55a349961700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:39.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.149+0000 7fdb4405f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3499575d0 0x55a34995e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:39.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.149+0000 7fdb4405f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a349961e90 0x55a34995eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:39.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.149+0000 7fdb4405f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a349964b00 con 0x55a349956cb0 2024-09-19T06:18:39.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.149+0000 7fdb4405f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a349877fa0 con 0x55a3499575d0 2024-09-19T06:18:39.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.149+0000 7fdb4405f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a349964c80 con 0x55a349961e90 2024-09-19T06:18:39.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.149+0000 7fdb4405f740 10 client.0 _ll_register_callbacks cb 0x55a3495cbba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:39.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.149+0000 7fdb3a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a349956cb0 0x55a349961700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:39.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.149+0000 7fdb3a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a349956cb0 0x55a349961700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45226/0 (socket says 172.21.15.3:45226) 2024-09-19T06:18:39.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.149+0000 7fdb3a800640 1 -- 172.21.15.3:0/2374579739 learned_addr learned my addr 172.21.15.3:0/2374579739 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:39.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.149+0000 7fdb33e00640 1 --2- 172.21.15.3:0/2374579739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3499575d0 0x55a34995e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:39.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.149+0000 7fdb3b200640 1 --2- 172.21.15.3:0/2374579739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a349961e90 0x55a34995eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:39.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.150+0000 7fdb33e00640 1 -- 172.21.15.3:0/2374579739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a349961e90 msgr2=0x55a34995eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:39.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.150+0000 7fdb33e00640 1 --2- 172.21.15.3:0/2374579739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a349961e90 0x55a34995eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.150+0000 7fdb33e00640 1 -- 172.21.15.3:0/2374579739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a349956cb0 msgr2=0x55a349961700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:39.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.150+0000 7fdb33e00640 1 --2- 172.21.15.3:0/2374579739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a349956cb0 0x55a349961700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.150+0000 7fdb33e00640 1 -- 172.21.15.3:0/2374579739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a34995f720 con 0x55a3499575d0 2024-09-19T06:18:39.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.150+0000 7fdb33e00640 1 --2- 172.21.15.3:0/2374579739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3499575d0 0x55a34995e9b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdb240cd850 tx=0x7fdb2400cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9309aee8754feb13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:39.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.150+0000 7fdb1fe00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:18:39.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.150+0000 7fdb1fe00640 1 -- 172.21.15.3:0/2374579739 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2409bf20 con 0x55a3499575d0 2024-09-19T06:18:39.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.150+0000 7fdb1fe00640 1 -- 172.21.15.3:0/2374579739 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fdb240a4bc0 con 0x55a3499575d0 2024-09-19T06:18:39.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.150+0000 7fdb4405f740 1 -- 172.21.15.3:0/2374579739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb2c004400 con 0x55a3499575d0 2024-09-19T06:18:39.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.151+0000 7fdb1fe00640 1 -- 172.21.15.3:0/2374579739 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdb2409bd40 con 0x55a3499575d0 2024-09-19T06:18:39.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.151+0000 7fdb4405f740 10 client.26963 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:39.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.151+0000 7fdb4405f740 1 -- 172.21.15.3:0/2374579739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a3499709a0 con 0x55a3499575d0 2024-09-19T06:18:39.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.151+0000 7fdb1fe00640 1 -- 172.21.15.3:0/2374579739 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb2c004400 con 0x55a3499575d0 2024-09-19T06:18:39.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.151+0000 7fdb1fe00640 1 -- 172.21.15.3:0/2374579739 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fdb240b5250 con 0x55a3499575d0 2024-09-19T06:18:39.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.151+0000 7fdb4405f740 10 client.26963 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:39.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.151+0000 7fdb4405f740 10 client.26963 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:39.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.151+0000 7fdb4405f740 20 client.26963 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:39.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.151+0000 7fdb4405f740 1 --2- 172.21.15.3:0/2374579739 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a349971e60 0x55a349974250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:39.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.151+0000 7fdb4405f740 4 client.26963 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:39.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.151+0000 7fdb4405f740 1 -- 172.21.15.3:0/2374579739 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3498ca800 con 0x55a349971e60 2024-09-19T06:18:39.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.152+0000 7fdb3a800640 1 --2- 172.21.15.3:0/2374579739 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a349971e60 0x55a349974250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:39.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.152+0000 7fdb3a800640 1 --2- 172.21.15.3:0/2374579739 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a349971e60 0x55a349974250 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eed9348630ad87de server_cookie=9c4168efa39d9133 in_seq=0 out_seq=0 2024-09-19T06:18:39.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.152+0000 7fdb1fe00640 10 client.26963 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:39.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.153+0000 7fdb1fe00640 1 -- 172.21.15.3:0/2374579739 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a3498ca800 con 0x55a349971e60 2024-09-19T06:18:39.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.153+0000 7fdb1fe00640 10 client.26963 handle_command_reply: tid=0 2024-09-19T06:18:39.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.153+0000 7fdb4405f740 1 client.26963 shutdown 2024-09-19T06:18:39.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.153+0000 7fdb4405f740 1 -- 172.21.15.3:0/2374579739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3499575d0 msgr2=0x55a34995e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:39.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.153+0000 7fdb4405f740 1 --2- 172.21.15.3:0/2374579739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3499575d0 0x55a34995e9b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdb240cd850 tx=0x7fdb2400cf20 comp rx=0 tx=0).stop 2024-09-19T06:18:39.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.153+0000 7fdb4405f740 1 -- 172.21.15.3:0/2374579739 shutdown_connections 2024-09-19T06:18:39.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.153+0000 7fdb4405f740 1 --2- 172.21.15.3:0/2374579739 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a349971e60 0x55a349974250 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.153+0000 7fdb4405f740 1 --2- 172.21.15.3:0/2374579739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a349961e90 0x55a34995eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.153+0000 7fdb4405f740 1 --2- 172.21.15.3:0/2374579739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3499575d0 0x55a34995e9b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.153+0000 7fdb4405f740 1 --2- 172.21.15.3:0/2374579739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a349956cb0 0x55a349961700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.153+0000 7fdb1fe00640 0 client.26963 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:39.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.153+0000 7fdb4405f740 1 -- 172.21.15.3:0/2374579739 >> 172.21.15.3:0/2374579739 conn(0x55a349953240 msgr2=0x55a349958f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:39.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.154+0000 7fdb4405f740 1 -- 172.21.15.3:0/2374579739 shutdown_connections 2024-09-19T06:18:39.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.154+0000 7fdb4405f740 1 -- 172.21.15.3:0/2374579739 wait complete. 2024-09-19T06:18:39.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.154+0000 7fdb4405f740 20 client.26963 trim_cache size 0 max 16384 2024-09-19T06:18:39.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.172+0000 7fdb4405f740 1 Processor -- start 2024-09-19T06:18:39.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.172+0000 7fdb4405f740 1 -- start start 2024-09-19T06:18:39.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.172+0000 7fdb4405f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a349956cb0 0x55a34995a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:39.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.172+0000 7fdb4405f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3499575d0 0x55a349952160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:39.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.172+0000 7fdb4405f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a349961e90 0x55a349979af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:39.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.172+0000 7fdb4405f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3c1af920 con 0x55a349961e90 2024-09-19T06:18:39.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.172+0000 7fdb4405f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3c1b1460 con 0x55a3499575d0 2024-09-19T06:18:39.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.172+0000 7fdb4405f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3c1afff0 con 0x55a349956cb0 2024-09-19T06:18:39.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.172+0000 7fdb3a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a349956cb0 0x55a34995a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:39.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.172+0000 7fdb3a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a349956cb0 0x55a34995a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:45058/0 (socket says 172.21.15.3:45058) 2024-09-19T06:18:39.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.172+0000 7fdb3a800640 1 -- 172.21.15.3:0/2595963472 learned_addr learned my addr 172.21.15.3:0/2595963472 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:39.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.172+0000 7fdb33e00640 1 --2- 172.21.15.3:0/2595963472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3499575d0 0x55a349952160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:39.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.173+0000 7fdb3b200640 1 --2- 172.21.15.3:0/2595963472 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a349961e90 0x55a349979af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:39.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.173+0000 7fdb3a800640 1 -- 172.21.15.3:0/2595963472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3499575d0 msgr2=0x55a349952160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:39.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.173+0000 7fdb3a800640 1 --2- 172.21.15.3:0/2595963472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3499575d0 0x55a349952160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.173+0000 7fdb3a800640 1 -- 172.21.15.3:0/2595963472 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a349961e90 msgr2=0x55a349979af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:39.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.173+0000 7fdb3a800640 1 --2- 172.21.15.3:0/2595963472 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a349961e90 0x55a349979af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.173+0000 7fdb3a800640 1 -- 172.21.15.3:0/2595963472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a34995cf00 con 0x55a349956cb0 2024-09-19T06:18:39.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.173+0000 7fdb33e00640 1 --2- 172.21.15.3:0/2595963472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3499575d0 0x55a349952160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:39.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.173+0000 7fdb3a800640 1 --2- 172.21.15.3:0/2595963472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a349956cb0 0x55a34995a110 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c02a910 tx=0x7fdb2c02a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c20125e22abaf0d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:39.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.173+0000 7fdb2aa00640 1 -- 172.21.15.3:0/2595963472 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c035040 con 0x55a349956cb0 2024-09-19T06:18:39.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.173+0000 7fdb2aa00640 1 -- 172.21.15.3:0/2595963472 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb2c004490 con 0x55a349956cb0 2024-09-19T06:18:39.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.173+0000 7fdb2aa00640 1 -- 172.21.15.3:0/2595963472 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c003850 con 0x55a349956cb0 2024-09-19T06:18:39.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.174+0000 7fdb4405f740 1 -- 172.21.15.3:0/2595963472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a349956cb0 msgr2=0x55a34995a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:39.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.174+0000 7fdb4405f740 1 --2- 172.21.15.3:0/2595963472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a349956cb0 0x55a34995a110 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c02a910 tx=0x7fdb2c02a410 comp rx=0 tx=0).stop 2024-09-19T06:18:39.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.174+0000 7fdb4405f740 1 -- 172.21.15.3:0/2595963472 shutdown_connections 2024-09-19T06:18:39.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.174+0000 7fdb4405f740 1 --2- 172.21.15.3:0/2595963472 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a349961e90 0x55a349979af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.174+0000 7fdb4405f740 1 --2- 172.21.15.3:0/2595963472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3499575d0 0x55a349952160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.174+0000 7fdb4405f740 1 --2- 172.21.15.3:0/2595963472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a349956cb0 0x55a34995a110 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.174+0000 7fdb4405f740 1 -- 172.21.15.3:0/2595963472 >> 172.21.15.3:0/2595963472 conn(0x55a349953240 msgr2=0x55a349951a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:39.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.174+0000 7fdb4405f740 1 -- 172.21.15.3:0/2595963472 shutdown_connections 2024-09-19T06:18:39.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.174+0000 7fdb4405f740 1 -- 172.21.15.3:0/2595963472 wait complete. 2024-09-19T06:18:39.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.175+0000 7fdb4405f740 1 -- start start 2024-09-19T06:18:39.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.175+0000 7fdb4405f740 1 Processor -- start 2024-09-19T06:18:39.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.175+0000 7fdb4405f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a349956cb0 0x55a349966830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:39.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.175+0000 7fdb4405f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3499575d0 0x55a349966d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:39.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.175+0000 7fdb4405f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a349961e90 0x55a3499d4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:39.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.175+0000 7fdb4405f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3c1b0d90 con 0x55a349961e90 2024-09-19T06:18:39.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.175+0000 7fdb4405f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3c1b06c0 con 0x55a3499575d0 2024-09-19T06:18:39.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.175+0000 7fdb4405f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3c1ad900 con 0x55a349956cb0 2024-09-19T06:18:39.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.175+0000 7fdb4405f740 10 client.0 _ll_register_callbacks cb 0x7fdb24096f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:39.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.176+0000 7fdb3b200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a349961e90 0x55a3499d4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:39.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.176+0000 7fdb3a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a349956cb0 0x55a349966830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:39.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.176+0000 7fdb33e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3499575d0 0x55a349966d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:39.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.176+0000 7fdb3b200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a349961e90 0x55a3499d4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45252/0 (socket says 172.21.15.3:45252) 2024-09-19T06:18:39.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.176+0000 7fdb3b200640 1 -- 172.21.15.3:0/2862632835 learned_addr learned my addr 172.21.15.3:0/2862632835 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:39.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.176+0000 7fdb3a800640 1 -- 172.21.15.3:0/2862632835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3499575d0 msgr2=0x55a349966d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:39.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.176+0000 7fdb3a800640 1 --2- 172.21.15.3:0/2862632835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3499575d0 0x55a349966d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.176+0000 7fdb3a800640 1 -- 172.21.15.3:0/2862632835 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a349961e90 msgr2=0x55a3499d4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:39.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.176+0000 7fdb3a800640 1 --2- 172.21.15.3:0/2862632835 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a349961e90 0x55a3499d4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.176+0000 7fdb3a800640 1 -- 172.21.15.3:0/2862632835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3499d5140 con 0x55a349956cb0 2024-09-19T06:18:39.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.176+0000 7fdb3a800640 1 --2- 172.21.15.3:0/2862632835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a349956cb0 0x55a349966830 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c001eb0 tx=0x7fdb2c004280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d10f66494ff54da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:39.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.176+0000 7fdb1fe00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:18:39.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.177+0000 7fdb1fe00640 1 -- 172.21.15.3:0/2862632835 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c000e60 con 0x55a349956cb0 2024-09-19T06:18:39.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.177+0000 7fdb4405f740 1 -- 172.21.15.3:0/2862632835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a3498c4d10 con 0x55a349956cb0 2024-09-19T06:18:39.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.177+0000 7fdb1fe00640 1 -- 172.21.15.3:0/2862632835 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fdb2c0317c0 con 0x55a349956cb0 2024-09-19T06:18:39.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.177+0000 7fdb1fe00640 1 -- 172.21.15.3:0/2862632835 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdb2c069050 con 0x55a349956cb0 2024-09-19T06:18:39.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.177+0000 7fdb4405f740 10 client.26974 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:39.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.177+0000 7fdb4405f740 1 -- 172.21.15.3:0/2862632835 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a3499dd6a0 con 0x55a349956cb0 2024-09-19T06:18:39.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.177+0000 7fdb1fe00640 1 -- 172.21.15.3:0/2862632835 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55a3498c4d10 con 0x55a349956cb0 2024-09-19T06:18:39.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.177+0000 7fdb1fe00640 1 -- 172.21.15.3:0/2862632835 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fdb2c059450 con 0x55a349956cb0 2024-09-19T06:18:39.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.177+0000 7fdb4405f740 10 client.26974 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:39.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.177+0000 7fdb4405f740 10 client.26974 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:39.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.177+0000 7fdb4405f740 20 client.26974 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:39.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.178+0000 7fdb4405f740 1 --2- 172.21.15.3:0/2862632835 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a3499dd930 0x55a3499dfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:39.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.178+0000 7fdb4405f740 4 client.26974 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:18:39.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.178+0000 7fdb4405f740 1 -- 172.21.15.3:0/2862632835 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a349840fb0 con 0x55a3499dd930 2024-09-19T06:18:39.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.178+0000 7fdb33e00640 1 --2- 172.21.15.3:0/2862632835 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a3499dd930 0x55a3499dfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:39.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.178+0000 7fdb33e00640 1 --2- 172.21.15.3:0/2862632835 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a3499dd930 0x55a3499dfd20 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b88bf7f278598e16 server_cookie=b3184cf1b468d8da in_seq=0 out_seq=0 2024-09-19T06:18:39.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.178+0000 7fdb1fe00640 10 client.26974 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:39.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.179+0000 7fdb1fe00640 1 -- 172.21.15.3:0/2862632835 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a349840fb0 con 0x55a3499dd930 2024-09-19T06:18:39.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.179+0000 7fdb1fe00640 10 client.26974 handle_command_reply: tid=0 2024-09-19T06:18:39.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.179+0000 7fdb4405f740 1 client.26974 shutdown 2024-09-19T06:18:39.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.180+0000 7fdb4405f740 1 -- 172.21.15.3:0/2862632835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a349956cb0 msgr2=0x55a349966830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:39.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.180+0000 7fdb4405f740 1 --2- 172.21.15.3:0/2862632835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a349956cb0 0x55a349966830 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c001eb0 tx=0x7fdb2c004280 comp rx=0 tx=0).stop 2024-09-19T06:18:39.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.180+0000 7fdb4405f740 1 -- 172.21.15.3:0/2862632835 shutdown_connections 2024-09-19T06:18:39.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.180+0000 7fdb4405f740 1 --2- 172.21.15.3:0/2862632835 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a3499dd930 0x55a3499dfd20 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.180+0000 7fdb4405f740 1 --2- 172.21.15.3:0/2862632835 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a349961e90 0x55a3499d4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.180+0000 7fdb4405f740 1 --2- 172.21.15.3:0/2862632835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a3499575d0 0x55a349966d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.180+0000 7fdb4405f740 1 --2- 172.21.15.3:0/2862632835 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a349956cb0 0x55a349966830 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.180+0000 7fdb4405f740 1 -- 172.21.15.3:0/2862632835 >> 172.21.15.3:0/2862632835 conn(0x55a349953240 msgr2=0x55a349960210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:39.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.180+0000 7fdb1fe00640 0 client.26974 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:39.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.180+0000 7fdb4405f740 1 -- 172.21.15.3:0/2862632835 shutdown_connections 2024-09-19T06:18:39.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.180+0000 7fdb4405f740 1 -- 172.21.15.3:0/2862632835 wait complete. 2024-09-19T06:18:39.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.180+0000 7fdb4405f740 20 client.26974 trim_cache size 0 max 16384 2024-09-19T06:18:39.188 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:18:39.188 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": 0, 2024-09-19T06:18:39.188 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_tag": "76d807b6-aeb1-42c6-a13e-3d5520ba1cce", 2024-09-19T06:18:39.188 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": "asynchronous" 2024-09-19T06:18:39.188 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:18:39.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.181+0000 7fdb40a00640 1 -- 172.21.15.3:0/2318616197 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fdb200a33b0 msgr2=0x7fdb200a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:39.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.181+0000 7fdb40a00640 1 --2- 172.21.15.3:0/2318616197 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fdb200a33b0 0x7fdb200a5870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdb34011630 tx=0x7fdb34009500 comp rx=0 tx=0).stop 2024-09-19T06:18:39.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.181+0000 7fdb40a00640 1 -- 172.21.15.3:0/2318616197 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb3c1047e0 msgr2=0x7fdb3c19a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:39.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.181+0000 7fdb40a00640 1 --2- 172.21.15.3:0/2318616197 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb3c1047e0 0x7fdb3c19a990 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdb2400e9f0 tx=0x7fdb2400edf0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.181+0000 7fdb40a00640 1 -- 172.21.15.3:0/2318616197 shutdown_connections 2024-09-19T06:18:39.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.181+0000 7fdb40a00640 1 --2- 172.21.15.3:0/2318616197 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fdb200a33b0 0x7fdb200a5870 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.181+0000 7fdb40a00640 1 --2- 172.21.15.3:0/2318616197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb3c108f60 0x7fdb3c19ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.181+0000 7fdb40a00640 1 --2- 172.21.15.3:0/2318616197 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb3c1047e0 0x7fdb3c19a990 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.181+0000 7fdb40a00640 1 --2- 172.21.15.3:0/2318616197 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdb3c103e30 0x7fdb3c19a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:39.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.181+0000 7fdb40a00640 1 -- 172.21.15.3:0/2318616197 >> 172.21.15.3:0/2318616197 conn(0x7fdb3c0ff910 msgr2=0x7fdb3c100b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:39.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.181+0000 7fdb40a00640 1 -- 172.21.15.3:0/2318616197 shutdown_connections 2024-09-19T06:18:39.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:39.181+0000 7fdb40a00640 1 -- 172.21.15.3:0/2318616197 wait complete. 2024-09-19T06:18:40.030 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:39 smithi003 ceph-mon[30893]: pgmap v191: 97 pgs: 97 active+clean; 1.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-19T06:18:40.030 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:39 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:18:40.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:39 smithi059 ceph-mon[35138]: pgmap v191: 97 pgs: 97 active+clean; 1.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-19T06:18:40.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:39 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:18:40.071 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:18:40.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:39 smithi071 ceph-mon[35662]: pgmap v191: 97 pgs: 97 active+clean; 1.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-19T06:18:40.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:39 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:18:40.471 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:40.950 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:40 smithi003 ceph-mon[30893]: scrub queued for path: / 2024-09-19T06:18:40.950 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:40 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:18:40.950 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:40 smithi003 ceph-mon[30893]: scrub summary: active paths [/] 2024-09-19T06:18:40.951 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:40 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:18:40.951 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:40 smithi003 ceph-mon[30893]: scrub summary: idle 2024-09-19T06:18:40.951 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:40 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:18:40.951 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:40 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:18:40.951 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:40 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:18:41.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:40 smithi059 ceph-mon[35138]: scrub queued for path: / 2024-09-19T06:18:41.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:40 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:18:41.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:40 smithi059 ceph-mon[35138]: scrub summary: active paths [/] 2024-09-19T06:18:41.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:40 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:18:41.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:40 smithi059 ceph-mon[35138]: scrub summary: idle 2024-09-19T06:18:41.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:40 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:18:41.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:40 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:18:41.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:40 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:18:41.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.064+0000 7fb33f200640 1 -- 172.21.15.3:0/1009327855 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb340076720 msgr2=0x7fb340076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:41.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.064+0000 7fb33f200640 1 --2- 172.21.15.3:0/1009327855 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb340076720 0x7fb340076b00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb330009860 tx=0x7fb33002a340 comp rx=0 tx=0).stop 2024-09-19T06:18:41.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.065+0000 7fb33f200640 1 -- 172.21.15.3:0/1009327855 shutdown_connections 2024-09-19T06:18:41.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.065+0000 7fb33f200640 1 --2- 172.21.15.3:0/1009327855 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb340112870 0x7fb340114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.065+0000 7fb33f200640 1 --2- 172.21.15.3:0/1009327855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb340077040 0x7fb340112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.065+0000 7fb33f200640 1 --2- 172.21.15.3:0/1009327855 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb340076720 0x7fb340076b00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.065+0000 7fb33f200640 1 -- 172.21.15.3:0/1009327855 >> 172.21.15.3:0/1009327855 conn(0x7fb3400ff8d0 msgr2=0x7fb340101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:41.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.065+0000 7fb33f200640 1 -- 172.21.15.3:0/1009327855 shutdown_connections 2024-09-19T06:18:41.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.065+0000 7fb33f200640 1 -- 172.21.15.3:0/1009327855 wait complete. 2024-09-19T06:18:41.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.066+0000 7fb33f200640 1 Processor -- start 2024-09-19T06:18:41.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.066+0000 7fb33f200640 1 -- start start 2024-09-19T06:18:41.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.066+0000 7fb33f200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb340076720 0x7fb3401a4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:41.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.066+0000 7fb33f200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb340077040 0x7fb3401a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:41.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.066+0000 7fb33f200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb340112870 0x7fb34019e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:41.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.066+0000 7fb33f200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb340118400 con 0x7fb340077040 2024-09-19T06:18:41.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.066+0000 7fb33f200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb340118280 con 0x7fb340112870 2024-09-19T06:18:41.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.066+0000 7fb33f200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb340118580 con 0x7fb340076720 2024-09-19T06:18:41.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.066+0000 7fb33de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb340076720 0x7fb3401a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:41.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.066+0000 7fb335400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb340077040 0x7fb3401a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:41.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.066+0000 7fb33de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb340076720 0x7fb3401a4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:45098/0 (socket says 172.21.15.3:45098) 2024-09-19T06:18:41.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.066+0000 7fb33de00640 1 -- 172.21.15.3:0/1168370369 learned_addr learned my addr 172.21.15.3:0/1168370369 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:41.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.067+0000 7fb33e800640 1 --2- 172.21.15.3:0/1168370369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb340112870 0x7fb34019e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:41.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.067+0000 7fb33de00640 1 -- 172.21.15.3:0/1168370369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb340112870 msgr2=0x7fb34019e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:41.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.067+0000 7fb33de00640 1 --2- 172.21.15.3:0/1168370369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb340112870 0x7fb34019e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.067+0000 7fb33de00640 1 -- 172.21.15.3:0/1168370369 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb340077040 msgr2=0x7fb3401a4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:41.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.067+0000 7fb33de00640 1 --2- 172.21.15.3:0/1168370369 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb340077040 0x7fb3401a4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.067+0000 7fb33de00640 1 -- 172.21.15.3:0/1168370369 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34019ef80 con 0x7fb340076720 2024-09-19T06:18:41.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.067+0000 7fb33de00640 1 --2- 172.21.15.3:0/1168370369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb340076720 0x7fb3401a4640 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb330035040 tx=0x7fb330033b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:41.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.067+0000 7fb337400640 1 -- 172.21.15.3:0/1168370369 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb330037040 con 0x7fb340076720 2024-09-19T06:18:41.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.068+0000 7fb337400640 1 -- 172.21.15.3:0/1168370369 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb330040070 con 0x7fb340076720 2024-09-19T06:18:41.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.068+0000 7fb33f200640 1 -- 172.21.15.3:0/1168370369 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb34019f210 con 0x7fb340076720 2024-09-19T06:18:41.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.068+0000 7fb337400640 1 -- 172.21.15.3:0/1168370369 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3300039b0 con 0x7fb340076720 2024-09-19T06:18:41.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.068+0000 7fb33f200640 1 -- 172.21.15.3:0/1168370369 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3401ab3f0 con 0x7fb340076720 2024-09-19T06:18:41.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.071+0000 7fb337400640 1 -- 172.21.15.3:0/1168370369 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fb3300305e0 con 0x7fb340076720 2024-09-19T06:18:41.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.071+0000 7fb347bd5740 1 Processor -- start 2024-09-19T06:18:41.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.071+0000 7fb347bd5740 1 -- start start 2024-09-19T06:18:41.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.071+0000 7fb347bd5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff71bacd50 0x55ff71bad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:41.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.071+0000 7fb347bd5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bad670 0x55ff71bb79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:41.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.071+0000 7fb347bd5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff71bb7f30 0x55ff71bba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:41.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.071+0000 7fb347bd5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ff71b133e0 con 0x55ff71bad670 2024-09-19T06:18:41.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.071+0000 7fb347bd5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ff71abad80 con 0x55ff71bacd50 2024-09-19T06:18:41.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.071+0000 7fb347bd5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ff71b0f3a0 con 0x55ff71bb7f30 2024-09-19T06:18:41.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.072+0000 7fb33e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff71bacd50 0x55ff71bad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:41.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.072+0000 7fb33e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff71bacd50 0x55ff71bad130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:37958/0 (socket says 172.21.15.3:37958) 2024-09-19T06:18:41.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.072+0000 7fb33e800640 1 -- 172.21.15.3:0/898701274 learned_addr learned my addr 172.21.15.3:0/898701274 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:41.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.072+0000 7fb33de00640 1 --2- 172.21.15.3:0/898701274 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bad670 0x55ff71bb79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:41.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.072+0000 7fb335400640 1 --2- 172.21.15.3:0/898701274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff71bb7f30 0x55ff71bba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:41.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.072+0000 7fb33e800640 1 -- 172.21.15.3:0/898701274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff71bb7f30 msgr2=0x55ff71bba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:41.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.072+0000 7fb33e800640 1 --2- 172.21.15.3:0/898701274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff71bb7f30 0x55ff71bba320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.072+0000 7fb33e800640 1 -- 172.21.15.3:0/898701274 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bad670 msgr2=0x55ff71bb79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:41.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.072+0000 7fb33e800640 1 --2- 172.21.15.3:0/898701274 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bad670 0x55ff71bb79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.072+0000 7fb33e800640 1 -- 172.21.15.3:0/898701274 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff71ad9ae0 con 0x55ff71bacd50 2024-09-19T06:18:41.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.072+0000 7fb33de00640 1 --2- 172.21.15.3:0/898701274 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bad670 0x55ff71bb79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:18:41.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.072+0000 7fb33e800640 1 --2- 172.21.15.3:0/898701274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff71bacd50 0x55ff71bad130 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb338009fc0 tx=0x7fb3380095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b56ca8b20bbea0bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:41.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.073+0000 7fb337400640 1 --2- 172.21.15.3:0/1168370369 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb3240a3430 0x7fb3240a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:41.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.073+0000 7fb32f400640 1 -- 172.21.15.3:0/898701274 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb338003970 con 0x55ff71bacd50 2024-09-19T06:18:41.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.073+0000 7fb337400640 1 -- 172.21.15.3:0/1168370369 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fb3300efb70 con 0x7fb340076720 2024-09-19T06:18:41.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.073+0000 7fb32f400640 1 -- 172.21.15.3:0/898701274 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb33800d770 con 0x55ff71bacd50 2024-09-19T06:18:41.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.073+0000 7fb32f400640 1 -- 172.21.15.3:0/898701274 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb338004500 con 0x55ff71bacd50 2024-09-19T06:18:41.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.073+0000 7fb33de00640 1 --2- 172.21.15.3:0/1168370369 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb3240a3430 0x7fb3240a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:41.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.074+0000 7fb347bd5740 1 -- 172.21.15.3:0/898701274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff71bacd50 msgr2=0x55ff71bad130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:41.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.074+0000 7fb347bd5740 1 --2- 172.21.15.3:0/898701274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff71bacd50 0x55ff71bad130 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb338009fc0 tx=0x7fb3380095c0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.074+0000 7fb33de00640 1 --2- 172.21.15.3:0/1168370369 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb3240a3430 0x7fb3240a58f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55ff71baa140 tx=0x7fb330005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:41.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.074+0000 7fb347bd5740 1 -- 172.21.15.3:0/898701274 shutdown_connections 2024-09-19T06:18:41.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.074+0000 7fb347bd5740 1 --2- 172.21.15.3:0/898701274 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff71bb7f30 0x55ff71bba320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.074+0000 7fb347bd5740 1 --2- 172.21.15.3:0/898701274 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bad670 0x55ff71bb79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.074+0000 7fb347bd5740 1 --2- 172.21.15.3:0/898701274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff71bacd50 0x55ff71bad130 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.074+0000 7fb347bd5740 1 -- 172.21.15.3:0/898701274 >> 172.21.15.3:0/898701274 conn(0x55ff71ba92e0 msgr2=0x55ff71ba96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:41.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.074+0000 7fb347bd5740 1 -- 172.21.15.3:0/898701274 shutdown_connections 2024-09-19T06:18:41.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.074+0000 7fb347bd5740 1 -- 172.21.15.3:0/898701274 wait complete. 2024-09-19T06:18:41.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.074+0000 7fb347bd5740 1 -- start start 2024-09-19T06:18:41.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.074+0000 7fb347bd5740 1 Processor -- start 2024-09-19T06:18:41.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.075+0000 7fb347bd5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff71bacd50 0x55ff71bb4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:41.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.075+0000 7fb347bd5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bad670 0x55ff71bb53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:41.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.075+0000 7fb347bd5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff71bb7f30 0x55ff71bb5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:41.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.075+0000 7fb347bd5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ff71bbaba0 con 0x55ff71bad670 2024-09-19T06:18:41.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.075+0000 7fb347bd5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ff71ace0f0 con 0x55ff71bb7f30 2024-09-19T06:18:41.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.075+0000 7fb347bd5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ff71bbad20 con 0x55ff71bacd50 2024-09-19T06:18:41.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.075+0000 7fb347bd5740 10 client.0 _ll_register_callbacks cb 0x55ff71abf9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:41.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.075+0000 7fb335400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bad670 0x55ff71bb53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:41.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.075+0000 7fb33e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff71bacd50 0x55ff71bb4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:41.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.075+0000 7fb335400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bad670 0x55ff71bb53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45292/0 (socket says 172.21.15.3:45292) 2024-09-19T06:18:41.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.075+0000 7fb335400640 1 -- 172.21.15.3:0/175670300 learned_addr learned my addr 172.21.15.3:0/175670300 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:41.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.075+0000 7fb33e800640 1 --2- 172.21.15.3:0/175670300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff71bb7f30 0x55ff71bb5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:41.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.076+0000 7fb335400640 1 -- 172.21.15.3:0/175670300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff71bacd50 msgr2=0x55ff71bb4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:41.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.076+0000 7fb335400640 1 --2- 172.21.15.3:0/175670300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff71bacd50 0x55ff71bb4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.076+0000 7fb335400640 1 -- 172.21.15.3:0/175670300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff71bb7f30 msgr2=0x55ff71bb5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:41.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.076+0000 7fb335400640 1 --2- 172.21.15.3:0/175670300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff71bb7f30 0x55ff71bb5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.076+0000 7fb335400640 1 -- 172.21.15.3:0/175670300 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff718843c0 con 0x55ff71bad670 2024-09-19T06:18:41.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.076+0000 7fb335400640 1 --2- 172.21.15.3:0/175670300 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bad670 0x55ff71bb53c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb328012700 tx=0x7fb328012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97c5a2ce01d8b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:41.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.076+0000 7fb323e00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:18:41.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.076+0000 7fb323e00640 1 -- 172.21.15.3:0/175670300 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb328004050 con 0x55ff71bad670 2024-09-19T06:18:41.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.076+0000 7fb323e00640 1 -- 172.21.15.3:0/175670300 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fb3280041f0 con 0x55ff71bad670 2024-09-19T06:18:41.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.076+0000 7fb347bd5740 1 -- 172.21.15.3:0/175670300 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb33800d770 con 0x55ff71bad670 2024-09-19T06:18:41.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.077+0000 7fb323e00640 1 -- 172.21.15.3:0/175670300 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb3280043f0 con 0x55ff71bad670 2024-09-19T06:18:41.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.077+0000 7fb347bd5740 10 client.16938 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:41.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.077+0000 7fb347bd5740 1 -- 172.21.15.3:0/175670300 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ff71bc6880 con 0x55ff71bad670 2024-09-19T06:18:41.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.077+0000 7fb323e00640 1 -- 172.21.15.3:0/175670300 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb33800d770 con 0x55ff71bad670 2024-09-19T06:18:41.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.077+0000 7fb323e00640 1 -- 172.21.15.3:0/175670300 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb328003bc0 con 0x55ff71bad670 2024-09-19T06:18:41.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.077+0000 7fb347bd5740 10 client.16938 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:41.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.077+0000 7fb347bd5740 10 client.16938 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:41.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.077+0000 7fb347bd5740 20 client.16938 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:41.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.077+0000 7fb347bd5740 1 --2- 172.21.15.3:0/175670300 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ff71bc7d90 0x55ff71bca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:41.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.077+0000 7fb347bd5740 4 client.16938 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:41.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.077+0000 7fb347bd5740 1 -- 172.21.15.3:0/175670300 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff71b20950 con 0x55ff71bc7d90 2024-09-19T06:18:41.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.078+0000 7fb33e800640 1 --2- 172.21.15.3:0/175670300 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ff71bc7d90 0x55ff71bca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:41.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.078+0000 7fb33e800640 1 --2- 172.21.15.3:0/175670300 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ff71bc7d90 0x55ff71bca1b0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b269423cef5520d4 server_cookie=ee7bbccec16605f3 in_seq=0 out_seq=0 2024-09-19T06:18:41.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.078+0000 7fb323e00640 10 client.16938 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:41.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.079+0000 7fb323e00640 1 -- 172.21.15.3:0/175670300 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ff71b20950 con 0x55ff71bc7d90 2024-09-19T06:18:41.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.079+0000 7fb323e00640 10 client.16938 handle_command_reply: tid=0 2024-09-19T06:18:41.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.079+0000 7fb347bd5740 1 client.16938 shutdown 2024-09-19T06:18:41.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.079+0000 7fb347bd5740 1 -- 172.21.15.3:0/175670300 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bad670 msgr2=0x55ff71bb53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:41.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.079+0000 7fb347bd5740 1 --2- 172.21.15.3:0/175670300 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bad670 0x55ff71bb53c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb328012700 tx=0x7fb328012bc0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.079+0000 7fb347bd5740 1 -- 172.21.15.3:0/175670300 shutdown_connections 2024-09-19T06:18:41.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.079+0000 7fb347bd5740 1 --2- 172.21.15.3:0/175670300 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ff71bc7d90 0x55ff71bca1b0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.079+0000 7fb347bd5740 1 --2- 172.21.15.3:0/175670300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff71bb7f30 0x55ff71bb5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.079+0000 7fb347bd5740 1 --2- 172.21.15.3:0/175670300 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bad670 0x55ff71bb53c0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.079+0000 7fb347bd5740 1 --2- 172.21.15.3:0/175670300 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff71bacd50 0x55ff71bb4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.079+0000 7fb347bd5740 1 -- 172.21.15.3:0/175670300 >> 172.21.15.3:0/175670300 conn(0x55ff71ba92e0 msgr2=0x55ff71baf010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:41.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.079+0000 7fb323e00640 0 client.16938 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:41.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.080+0000 7fb347bd5740 1 -- 172.21.15.3:0/175670300 shutdown_connections 2024-09-19T06:18:41.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.080+0000 7fb347bd5740 1 -- 172.21.15.3:0/175670300 wait complete. 2024-09-19T06:18:41.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.080+0000 7fb347bd5740 20 client.16938 trim_cache size 0 max 16384 2024-09-19T06:18:41.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:40 smithi071 ceph-mon[35662]: scrub queued for path: / 2024-09-19T06:18:41.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:40 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:18:41.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:40 smithi071 ceph-mon[35662]: scrub summary: active paths [/] 2024-09-19T06:18:41.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:40 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:18:41.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:40 smithi071 ceph-mon[35662]: scrub summary: idle 2024-09-19T06:18:41.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:40 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:18:41.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:40 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:18:41.087 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:40 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:18:41.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.098+0000 7fb347bd5740 1 Processor -- start 2024-09-19T06:18:41.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.098+0000 7fb347bd5740 1 -- start start 2024-09-19T06:18:41.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.099+0000 7fb347bd5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bacd50 0x55ff71bb3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:41.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.099+0000 7fb347bd5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff71bad670 0x55ff71bb6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:41.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.099+0000 7fb347bd5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff71bb7f30 0x55ff71bb5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:41.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.099+0000 7fb347bd5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb3401b3d70 con 0x55ff71bacd50 2024-09-19T06:18:41.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.099+0000 7fb347bd5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb3401b58b0 con 0x55ff71bb7f30 2024-09-19T06:18:41.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.099+0000 7fb347bd5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb3401b4440 con 0x55ff71bad670 2024-09-19T06:18:41.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.099+0000 7fb33e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bacd50 0x55ff71bb3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:41.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.099+0000 7fb33e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bacd50 0x55ff71bb3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45298/0 (socket says 172.21.15.3:45298) 2024-09-19T06:18:41.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.099+0000 7fb335400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff71bad670 0x55ff71bb6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:41.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.099+0000 7fb33e800640 1 -- 172.21.15.3:0/210380849 learned_addr learned my addr 172.21.15.3:0/210380849 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:41.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.099+0000 7fb33e800640 1 --2- 172.21.15.3:0/210380849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff71bb7f30 0x55ff71bb5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:41.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.099+0000 7fb335400640 1 -- 172.21.15.3:0/210380849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff71bb7f30 msgr2=0x55ff71bb5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:41.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.099+0000 7fb335400640 1 --2- 172.21.15.3:0/210380849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff71bb7f30 0x55ff71bb5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.099+0000 7fb335400640 1 -- 172.21.15.3:0/210380849 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bacd50 msgr2=0x55ff71bb3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:41.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.099+0000 7fb335400640 1 --2- 172.21.15.3:0/210380849 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bacd50 0x55ff71bb3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.099+0000 7fb335400640 1 -- 172.21.15.3:0/210380849 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff71baa390 con 0x55ff71bad670 2024-09-19T06:18:41.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.100+0000 7fb335400640 1 --2- 172.21.15.3:0/210380849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff71bad670 0x55ff71bb6df0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb328003f30 tx=0x7fb328009cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db76829415172e08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:41.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.100+0000 7fb32ea00640 1 -- 172.21.15.3:0/210380849 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb328032070 con 0x55ff71bad670 2024-09-19T06:18:41.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.100+0000 7fb32ea00640 1 -- 172.21.15.3:0/210380849 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb328003fb0 con 0x55ff71bad670 2024-09-19T06:18:41.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.100+0000 7fb32ea00640 1 -- 172.21.15.3:0/210380849 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb328029040 con 0x55ff71bad670 2024-09-19T06:18:41.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.100+0000 7fb347bd5740 1 -- 172.21.15.3:0/210380849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff71bad670 msgr2=0x55ff71bb6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:41.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.100+0000 7fb347bd5740 1 --2- 172.21.15.3:0/210380849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff71bad670 0x55ff71bb6df0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb328003f30 tx=0x7fb328009cb0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.100+0000 7fb347bd5740 1 -- 172.21.15.3:0/210380849 shutdown_connections 2024-09-19T06:18:41.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.100+0000 7fb347bd5740 1 --2- 172.21.15.3:0/210380849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff71bb7f30 0x55ff71bb5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.101+0000 7fb347bd5740 1 --2- 172.21.15.3:0/210380849 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff71bad670 0x55ff71bb6df0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.101+0000 7fb347bd5740 1 --2- 172.21.15.3:0/210380849 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bacd50 0x55ff71bb3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.101+0000 7fb347bd5740 1 -- 172.21.15.3:0/210380849 >> 172.21.15.3:0/210380849 conn(0x55ff71ba92e0 msgr2=0x55ff71bb66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:41.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.101+0000 7fb347bd5740 1 -- 172.21.15.3:0/210380849 shutdown_connections 2024-09-19T06:18:41.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.101+0000 7fb347bd5740 1 -- 172.21.15.3:0/210380849 wait complete. 2024-09-19T06:18:41.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.101+0000 7fb347bd5740 1 -- start start 2024-09-19T06:18:41.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.101+0000 7fb347bd5740 1 Processor -- start 2024-09-19T06:18:41.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.102+0000 7fb347bd5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff71bacd50 0x55ff71bc04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:41.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.102+0000 7fb347bd5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff71bad670 0x55ff71bbc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:41.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.102+0000 7fb347bd5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bb7f30 0x55ff71bbcd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:41.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.102+0000 7fb347bd5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb3401b51e0 con 0x55ff71bb7f30 2024-09-19T06:18:41.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.102+0000 7fb347bd5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb3401b4b10 con 0x55ff71bad670 2024-09-19T06:18:41.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.102+0000 7fb347bd5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb3401b1d50 con 0x55ff71bacd50 2024-09-19T06:18:41.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.102+0000 7fb347bd5740 10 client.0 _ll_register_callbacks cb 0x7fb328009db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:41.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.102+0000 7fb33e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bb7f30 0x55ff71bbcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:41.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.102+0000 7fb33e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bb7f30 0x55ff71bbcd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45308/0 (socket says 172.21.15.3:45308) 2024-09-19T06:18:41.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.102+0000 7fb33e800640 1 -- 172.21.15.3:0/1366350250 learned_addr learned my addr 172.21.15.3:0/1366350250 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:41.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.102+0000 7fb33e800640 1 --2- 172.21.15.3:0/1366350250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff71bacd50 0x55ff71bc04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:41.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.102+0000 7fb335400640 1 --2- 172.21.15.3:0/1366350250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff71bad670 0x55ff71bbc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:41.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.102+0000 7fb33e800640 1 -- 172.21.15.3:0/1366350250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff71bacd50 msgr2=0x55ff71bc04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:41.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.102+0000 7fb33e800640 1 --2- 172.21.15.3:0/1366350250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff71bacd50 0x55ff71bc04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.102+0000 7fb33e800640 1 -- 172.21.15.3:0/1366350250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff71bad670 msgr2=0x55ff71bbc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:41.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.102+0000 7fb33e800640 1 --2- 172.21.15.3:0/1366350250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff71bad670 0x55ff71bbc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.102+0000 7fb33e800640 1 -- 172.21.15.3:0/1366350250 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff71ba9f70 con 0x55ff71bb7f30 2024-09-19T06:18:41.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.103+0000 7fb33e800640 1 --2- 172.21.15.3:0/1366350250 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bb7f30 0x55ff71bbcd20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb338006010 tx=0x7fb338010040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e97ebd215974362 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:41.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.103+0000 7fb323e00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:18:41.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.103+0000 7fb323e00640 1 -- 172.21.15.3:0/1366350250 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb338003c70 con 0x55ff71bb7f30 2024-09-19T06:18:41.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.103+0000 7fb347bd5740 1 -- 172.21.15.3:0/1366350250 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb328003fb0 con 0x55ff71bb7f30 2024-09-19T06:18:41.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.103+0000 7fb323e00640 1 -- 172.21.15.3:0/1366350250 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fb338003e10 con 0x55ff71bb7f30 2024-09-19T06:18:41.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.103+0000 7fb323e00640 1 -- 172.21.15.3:0/1366350250 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb3380052d0 con 0x55ff71bb7f30 2024-09-19T06:18:41.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.103+0000 7fb347bd5740 10 client.16944 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:41.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.103+0000 7fb347bd5740 1 -- 172.21.15.3:0/1366350250 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ff71c33670 con 0x55ff71bb7f30 2024-09-19T06:18:41.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.104+0000 7fb323e00640 1 -- 172.21.15.3:0/1366350250 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb328003fb0 con 0x55ff71bb7f30 2024-09-19T06:18:41.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.104+0000 7fb323e00640 1 -- 172.21.15.3:0/1366350250 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb33800b040 con 0x55ff71bb7f30 2024-09-19T06:18:41.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.104+0000 7fb347bd5740 10 client.16944 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:41.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.104+0000 7fb347bd5740 10 client.16944 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:41.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.104+0000 7fb347bd5740 20 client.16944 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:41.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.104+0000 7fb347bd5740 1 --2- 172.21.15.3:0/1366350250 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ff71c33ac0 0x55ff71c35ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:41.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.104+0000 7fb347bd5740 4 client.16944 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:18:41.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.104+0000 7fb347bd5740 1 -- 172.21.15.3:0/1366350250 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ff71b1ae60 con 0x55ff71c33ac0 2024-09-19T06:18:41.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.104+0000 7fb335400640 1 --2- 172.21.15.3:0/1366350250 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ff71c33ac0 0x55ff71c35ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:41.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.105+0000 7fb335400640 1 --2- 172.21.15.3:0/1366350250 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ff71c33ac0 0x55ff71c35ee0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9736c238bb627c4 server_cookie=3980844562d68adf in_seq=0 out_seq=0 2024-09-19T06:18:41.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.105+0000 7fb323e00640 10 client.16944 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:41.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.105+0000 7fb323e00640 1 -- 172.21.15.3:0/1366350250 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ff71b1ae60 con 0x55ff71c33ac0 2024-09-19T06:18:41.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.105+0000 7fb323e00640 10 client.16944 handle_command_reply: tid=0 2024-09-19T06:18:41.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.105+0000 7fb347bd5740 1 client.16944 shutdown 2024-09-19T06:18:41.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.105+0000 7fb347bd5740 1 -- 172.21.15.3:0/1366350250 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bb7f30 msgr2=0x55ff71bbcd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:41.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.105+0000 7fb347bd5740 1 --2- 172.21.15.3:0/1366350250 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bb7f30 0x55ff71bbcd20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb338006010 tx=0x7fb338010040 comp rx=0 tx=0).stop 2024-09-19T06:18:41.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.105+0000 7fb347bd5740 1 -- 172.21.15.3:0/1366350250 shutdown_connections 2024-09-19T06:18:41.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.105+0000 7fb347bd5740 1 --2- 172.21.15.3:0/1366350250 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ff71c33ac0 0x55ff71c35ee0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.105+0000 7fb347bd5740 1 --2- 172.21.15.3:0/1366350250 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ff71bb7f30 0x55ff71bbcd20 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.105+0000 7fb347bd5740 1 --2- 172.21.15.3:0/1366350250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ff71bad670 0x55ff71bbc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.105+0000 7fb347bd5740 1 --2- 172.21.15.3:0/1366350250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ff71bacd50 0x55ff71bc04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.105+0000 7fb323e00640 0 client.16944 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:41.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.105+0000 7fb347bd5740 1 -- 172.21.15.3:0/1366350250 >> 172.21.15.3:0/1366350250 conn(0x55ff71ba92e0 msgr2=0x55ff71bb6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:41.113 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.106+0000 7fb347bd5740 1 -- 172.21.15.3:0/1366350250 shutdown_connections 2024-09-19T06:18:41.113 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.106+0000 7fb347bd5740 1 -- 172.21.15.3:0/1366350250 wait complete. 2024-09-19T06:18:41.113 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.106+0000 7fb347bd5740 20 client.16944 trim_cache size 0 max 16384 2024-09-19T06:18:41.113 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:18:41.113 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "no active scrubs running", 2024-09-19T06:18:41.113 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": {} 2024-09-19T06:18:41.113 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:18:41.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.106+0000 7fb33f200640 1 -- 172.21.15.3:0/1168370369 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb3240a3430 msgr2=0x7fb3240a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:41.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.106+0000 7fb33f200640 1 --2- 172.21.15.3:0/1168370369 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb3240a3430 0x7fb3240a58f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55ff71baa140 tx=0x7fb330005f90 comp rx=0 tx=0).stop 2024-09-19T06:18:41.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.106+0000 7fb33f200640 1 -- 172.21.15.3:0/1168370369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb340076720 msgr2=0x7fb3401a4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:41.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.106+0000 7fb33f200640 1 --2- 172.21.15.3:0/1168370369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb340076720 0x7fb3401a4640 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb330035040 tx=0x7fb330033b60 comp rx=0 tx=0).stop 2024-09-19T06:18:41.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.106+0000 7fb33f200640 1 -- 172.21.15.3:0/1168370369 shutdown_connections 2024-09-19T06:18:41.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.106+0000 7fb33f200640 1 --2- 172.21.15.3:0/1168370369 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb3240a3430 0x7fb3240a58f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.106+0000 7fb33f200640 1 --2- 172.21.15.3:0/1168370369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb340112870 0x7fb34019e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.106+0000 7fb33f200640 1 --2- 172.21.15.3:0/1168370369 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb340077040 0x7fb3401a4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.106+0000 7fb33f200640 1 --2- 172.21.15.3:0/1168370369 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb340076720 0x7fb3401a4640 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:41.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.106+0000 7fb33f200640 1 -- 172.21.15.3:0/1168370369 >> 172.21.15.3:0/1168370369 conn(0x7fb3400ff8d0 msgr2=0x7fb340101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:41.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.107+0000 7fb33f200640 1 -- 172.21.15.3:0/1168370369 shutdown_connections 2024-09-19T06:18:41.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:41.107+0000 7fb33f200640 1 -- 172.21.15.3:0/1168370369 wait complete. 2024-09-19T06:18:41.806 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:41 smithi003 ceph-mon[30893]: pgmap v192: 97 pgs: 97 active+clean; 1.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 41 KiB/s wr, 16 op/s 2024-09-19T06:18:41.886 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:18:41.886 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:18:42.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:41 smithi059 ceph-mon[35138]: pgmap v192: 97 pgs: 97 active+clean; 1.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 41 KiB/s wr, 16 op/s 2024-09-19T06:18:42.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:41 smithi071 ceph-mon[35662]: pgmap v192: 97 pgs: 97 active+clean; 1.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 41 KiB/s wr, 16 op/s 2024-09-19T06:18:42.265 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:42.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.846+0000 7fde85200640 1 -- 172.21.15.3:0/2636840576 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde80103e30 msgr2=0x7fde80104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:42.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.846+0000 7fde85200640 1 --2- 172.21.15.3:0/2636840576 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde80103e30 0x7fde80104210 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fde70009900 tx=0x7fde7002a410 comp rx=0 tx=0).stop 2024-09-19T06:18:42.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.846+0000 7fde85200640 1 -- 172.21.15.3:0/2636840576 shutdown_connections 2024-09-19T06:18:42.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.846+0000 7fde85200640 1 --2- 172.21.15.3:0/2636840576 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde80108f60 0x7fde80110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:42.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.846+0000 7fde85200640 1 --2- 172.21.15.3:0/2636840576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde801047e0 0x7fde80108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:42.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.846+0000 7fde85200640 1 --2- 172.21.15.3:0/2636840576 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde80103e30 0x7fde80104210 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:42.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.846+0000 7fde85200640 1 -- 172.21.15.3:0/2636840576 >> 172.21.15.3:0/2636840576 conn(0x7fde800ff8d0 msgr2=0x7fde80101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:42.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.846+0000 7fde85200640 1 -- 172.21.15.3:0/2636840576 shutdown_connections 2024-09-19T06:18:42.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.846+0000 7fde85200640 1 -- 172.21.15.3:0/2636840576 wait complete. 2024-09-19T06:18:42.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.847+0000 7fde85200640 1 Processor -- start 2024-09-19T06:18:42.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.847+0000 7fde85200640 1 -- start start 2024-09-19T06:18:42.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.847+0000 7fde85200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde80103e30 0x7fde8019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:42.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.847+0000 7fde85200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde801047e0 0x7fde8019a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:42.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.847+0000 7fde85200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde80108f60 0x7fde8019ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:42.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.847+0000 7fde85200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fde80113f80 con 0x7fde801047e0 2024-09-19T06:18:42.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.847+0000 7fde85200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fde80113e00 con 0x7fde80103e30 2024-09-19T06:18:42.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.847+0000 7fde85200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fde80114100 con 0x7fde80108f60 2024-09-19T06:18:42.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.848+0000 7fde77e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde801047e0 0x7fde8019a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:42.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.848+0000 7fde77e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde801047e0 0x7fde8019a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45330/0 (socket says 172.21.15.3:45330) 2024-09-19T06:18:42.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.848+0000 7fde77e00640 1 -- 172.21.15.3:0/2094289652 learned_addr learned my addr 172.21.15.3:0/2094289652 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:42.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.848+0000 7fde7f400640 1 --2- 172.21.15.3:0/2094289652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde80103e30 0x7fde8019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:42.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.848+0000 7fde7fe00640 1 --2- 172.21.15.3:0/2094289652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde80108f60 0x7fde8019ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:42.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.848+0000 7fde77e00640 1 -- 172.21.15.3:0/2094289652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde80108f60 msgr2=0x7fde8019ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:42.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.848+0000 7fde77e00640 1 --2- 172.21.15.3:0/2094289652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde80108f60 0x7fde8019ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:42.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.848+0000 7fde77e00640 1 -- 172.21.15.3:0/2094289652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde80103e30 msgr2=0x7fde8019a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:42.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.848+0000 7fde77e00640 1 --2- 172.21.15.3:0/2094289652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde80103e30 0x7fde8019a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:42.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.848+0000 7fde77e00640 1 -- 172.21.15.3:0/2094289652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8019f430 con 0x7fde801047e0 2024-09-19T06:18:42.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.848+0000 7fde7fe00640 1 --2- 172.21.15.3:0/2094289652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde80108f60 0x7fde8019ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:42.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.849+0000 7fde77e00640 1 --2- 172.21.15.3:0/2094289652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde801047e0 0x7fde8019a9c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fde6800e9f0 tx=0x7fde6800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:42.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.849+0000 7fde7cc00640 1 -- 172.21.15.3:0/2094289652 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6800cd80 con 0x7fde801047e0 2024-09-19T06:18:42.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.849+0000 7fde7cc00640 1 -- 172.21.15.3:0/2094289652 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde68010910 con 0x7fde801047e0 2024-09-19T06:18:42.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.849+0000 7fde7cc00640 1 -- 172.21.15.3:0/2094289652 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde68018990 con 0x7fde801047e0 2024-09-19T06:18:42.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.849+0000 7fde85200640 1 -- 172.21.15.3:0/2094289652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde8019f720 con 0x7fde801047e0 2024-09-19T06:18:42.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.849+0000 7fde85200640 1 -- 172.21.15.3:0/2094289652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde801a7000 con 0x7fde801047e0 2024-09-19T06:18:42.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.850+0000 7fde85200640 1 -- 172.21.15.3:0/2094289652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde80104210 con 0x7fde801047e0 2024-09-19T06:18:42.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.853+0000 7fde7cc00640 1 -- 172.21.15.3:0/2094289652 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fde68010ac0 con 0x7fde801047e0 2024-09-19T06:18:42.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.854+0000 7fde7cc00640 1 --2- 172.21.15.3:0/2094289652 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fde640a33b0 0x7fde640a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:42.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.854+0000 7fde7cc00640 1 -- 172.21.15.3:0/2094289652 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fde680d0580 con 0x7fde801047e0 2024-09-19T06:18:42.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.854+0000 7fde7f400640 1 --2- 172.21.15.3:0/2094289652 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fde640a33b0 0x7fde640a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:42.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.855+0000 7fde7f400640 1 --2- 172.21.15.3:0/2094289652 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fde640a33b0 0x7fde640a5870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fde70009230 tx=0x7fde700058d0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:42.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:42.856+0000 7fde7cc00640 1 -- 172.21.15.3:0/2094289652 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fde6809cf00 con 0x7fde801047e0 2024-09-19T06:18:43.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:43.078+0000 7fde85200640 1 -- 172.21.15.3:0/2094289652 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde8002d7c0 con 0x7fde801047e0 2024-09-19T06:18:43.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:43.079+0000 7fde7cc00640 1 -- 172.21.15.3:0/2094289652 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7fde6809c800 con 0x7fde801047e0 2024-09-19T06:18:43.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:18:43.082 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"btime":"2024-09-19T06:12:22:958217+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:12:22.060987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24532,24515,24514,14517]},"id":1}]} 2024-09-19T06:18:43.082 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2024-09-19T06:18:43.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:43.082+0000 7fde85200640 1 -- 172.21.15.3:0/2094289652 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fde640a33b0 msgr2=0x7fde640a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:43.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:43.082+0000 7fde85200640 1 --2- 172.21.15.3:0/2094289652 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fde640a33b0 0x7fde640a5870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fde70009230 tx=0x7fde700058d0 comp rx=0 tx=0).stop 2024-09-19T06:18:43.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:43.082+0000 7fde85200640 1 -- 172.21.15.3:0/2094289652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde801047e0 msgr2=0x7fde8019a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:43.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:43.082+0000 7fde85200640 1 --2- 172.21.15.3:0/2094289652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde801047e0 0x7fde8019a9c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fde6800e9f0 tx=0x7fde6800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:18:43.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:43.082+0000 7fde85200640 1 -- 172.21.15.3:0/2094289652 shutdown_connections 2024-09-19T06:18:43.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:43.082+0000 7fde85200640 1 --2- 172.21.15.3:0/2094289652 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fde640a33b0 0x7fde640a5870 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:43.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:43.082+0000 7fde85200640 1 --2- 172.21.15.3:0/2094289652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fde80108f60 0x7fde8019ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:43.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:43.082+0000 7fde85200640 1 --2- 172.21.15.3:0/2094289652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fde801047e0 0x7fde8019a9c0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:43.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:43.082+0000 7fde85200640 1 --2- 172.21.15.3:0/2094289652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde80103e30 0x7fde8019a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:43.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:43.082+0000 7fde85200640 1 -- 172.21.15.3:0/2094289652 >> 172.21.15.3:0/2094289652 conn(0x7fde800ff8d0 msgr2=0x7fde80100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:43.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:43.082+0000 7fde85200640 1 -- 172.21.15.3:0/2094289652 shutdown_connections 2024-09-19T06:18:43.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:43.082+0000 7fde85200640 1 -- 172.21.15.3:0/2094289652 wait complete. 2024-09-19T06:18:43.822 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:43 smithi003 ceph-mon[30893]: pgmap v193: 97 pgs: 97 active+clean; 1.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 41 KiB/s wr, 16 op/s 2024-09-19T06:18:43.822 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:43 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2094289652' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:18:43.861 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:18:44.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:43 smithi059 ceph-mon[35138]: pgmap v193: 97 pgs: 97 active+clean; 1.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 41 KiB/s wr, 16 op/s 2024-09-19T06:18:44.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:43 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2094289652' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:18:44.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:43 smithi071 ceph-mon[35662]: pgmap v193: 97 pgs: 97 active+clean; 1.9 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 41 KiB/s wr, 16 op/s 2024-09-19T06:18:44.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:43 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2094289652' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:18:44.241 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:44.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.791+0000 7f44fc400640 1 -- 172.21.15.3:0/1169496195 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44f410e430 msgr2=0x7f44f4110820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:44.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.791+0000 7f44fc400640 1 --2- 172.21.15.3:0/1169496195 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44f410e430 0x7f44f4110820 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f44ec009900 tx=0x7f44ec02a480 comp rx=0 tx=0).stop 2024-09-19T06:18:44.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.791+0000 7f44fc400640 1 -- 172.21.15.3:0/1169496195 shutdown_connections 2024-09-19T06:18:44.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.791+0000 7f44fc400640 1 --2- 172.21.15.3:0/1169496195 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44f410e430 0x7f44f4110820 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.791+0000 7f44fc400640 1 --2- 172.21.15.3:0/1169496195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44f4074ee0 0x7f44f410def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.791+0000 7f44fc400640 1 --2- 172.21.15.3:0/1169496195 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44f40745c0 0x7f44f40749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.791+0000 7f44fc400640 1 -- 172.21.15.3:0/1169496195 >> 172.21.15.3:0/1169496195 conn(0x7f44f40fd8b0 msgr2=0x7f44f40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:44.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.791+0000 7f44fc400640 1 -- 172.21.15.3:0/1169496195 shutdown_connections 2024-09-19T06:18:44.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.791+0000 7f44fc400640 1 -- 172.21.15.3:0/1169496195 wait complete. 2024-09-19T06:18:44.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.792+0000 7f44fc400640 1 Processor -- start 2024-09-19T06:18:44.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.792+0000 7f44fc400640 1 -- start start 2024-09-19T06:18:44.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.793+0000 7f44fc400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44f40745c0 0x7f44f419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:44.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.793+0000 7f44fc400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44f4074ee0 0x7f44f419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:44.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.793+0000 7f44fc400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44f410e430 0x7f44f419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:44.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.793+0000 7f44fc400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f44f41141b0 con 0x7f44f40745c0 2024-09-19T06:18:44.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.793+0000 7f44fc400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f44f4114030 con 0x7f44f410e430 2024-09-19T06:18:44.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.793+0000 7f44fc400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f44f4114330 con 0x7f44f4074ee0 2024-09-19T06:18:44.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.793+0000 7f44f9a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44f40745c0 0x7f44f419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:44.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.793+0000 7f44f9a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44f40745c0 0x7f44f419a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46964/0 (socket says 172.21.15.3:46964) 2024-09-19T06:18:44.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.793+0000 7f44f9a00640 1 -- 172.21.15.3:0/3067449557 learned_addr learned my addr 172.21.15.3:0/3067449557 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:44.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.793+0000 7f44f9000640 1 --2- 172.21.15.3:0/3067449557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44f4074ee0 0x7f44f419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:44.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.793+0000 7f44fa400640 1 --2- 172.21.15.3:0/3067449557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44f410e430 0x7f44f419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:44.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.794+0000 7f44f9a00640 1 -- 172.21.15.3:0/3067449557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44f4074ee0 msgr2=0x7f44f419ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:44.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.794+0000 7f44f9a00640 1 --2- 172.21.15.3:0/3067449557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44f4074ee0 0x7f44f419ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.794+0000 7f44f9a00640 1 -- 172.21.15.3:0/3067449557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44f410e430 msgr2=0x7f44f419ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:44.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.794+0000 7f44f9a00640 1 --2- 172.21.15.3:0/3067449557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44f410e430 0x7f44f419ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.794+0000 7f44f9a00640 1 -- 172.21.15.3:0/3067449557 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f419f600 con 0x7f44f40745c0 2024-09-19T06:18:44.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.794+0000 7f44fa400640 1 --2- 172.21.15.3:0/3067449557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44f410e430 0x7f44f419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:44.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.794+0000 7f44f9a00640 1 --2- 172.21.15.3:0/3067449557 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44f40745c0 0x7f44f419a650 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f44e800ebc0 tx=0x7f44e800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:44.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.794+0000 7f44f2000640 1 -- 172.21.15.3:0/3067449557 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8010630 con 0x7f44f40745c0 2024-09-19T06:18:44.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.794+0000 7f44fc400640 1 -- 172.21.15.3:0/3067449557 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f419f8f0 con 0x7f44f40745c0 2024-09-19T06:18:44.797 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.794+0000 7f44f2000640 1 -- 172.21.15.3:0/3067449557 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44e8010cb0 con 0x7f44f40745c0 2024-09-19T06:18:44.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.794+0000 7f44f2000640 1 -- 172.21.15.3:0/3067449557 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8018bd0 con 0x7f44f40745c0 2024-09-19T06:18:44.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.794+0000 7f44fc400640 1 -- 172.21.15.3:0/3067449557 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f41a71d0 con 0x7f44f40745c0 2024-09-19T06:18:44.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.798+0000 7f44fee6f740 1 Processor -- start 2024-09-19T06:18:44.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.798+0000 7f44f2000640 1 -- 172.21.15.3:0/3067449557 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f44e80107d0 con 0x7f44f40745c0 2024-09-19T06:18:44.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.798+0000 7f44fee6f740 1 -- start start 2024-09-19T06:18:44.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.798+0000 7f44fee6f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564166bc4c70 0x564166bc5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:44.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.798+0000 7f44fee6f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564166bc5590 0x564166bcf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:44.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.798+0000 7f44fee6f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564166bcfe50 0x564166bd2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:44.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.798+0000 7f44fee6f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x564166b2b3e0 con 0x564166bc5590 2024-09-19T06:18:44.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.798+0000 7f44fee6f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564166ad2d80 con 0x564166bcfe50 2024-09-19T06:18:44.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.798+0000 7f44fee6f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564166b273a0 con 0x564166bc4c70 2024-09-19T06:18:44.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.798+0000 7f44f9a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564166bc5590 0x564166bcf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:44.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.799+0000 7f44fa400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564166bc4c70 0x564166bc5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:44.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.799+0000 7f44fa400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564166bc4c70 0x564166bc5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:54696/0 (socket says 172.21.15.3:54696) 2024-09-19T06:18:44.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.799+0000 7f44fa400640 1 -- 172.21.15.3:0/3736976648 learned_addr learned my addr 172.21.15.3:0/3736976648 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:44.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.799+0000 7f44f9000640 1 --2- 172.21.15.3:0/3736976648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564166bcfe50 0x564166bd2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:44.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.799+0000 7f44f9a00640 1 -- 172.21.15.3:0/3736976648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564166bc4c70 msgr2=0x564166bc5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:44.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.799+0000 7f44f9a00640 1 --2- 172.21.15.3:0/3736976648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564166bc4c70 0x564166bc5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.799+0000 7f44f9a00640 1 -- 172.21.15.3:0/3736976648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564166bcfe50 msgr2=0x564166bd2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:44.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.799+0000 7f44f9a00640 1 --2- 172.21.15.3:0/3736976648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564166bcfe50 0x564166bd2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.799+0000 7f44f9a00640 1 -- 172.21.15.3:0/3736976648 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564166af1ae0 con 0x564166bc5590 2024-09-19T06:18:44.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.799+0000 7f44f2000640 1 --2- 172.21.15.3:0/3067449557 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f44dc0a3430 0x7f44dc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:44.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.799+0000 7f44f9a00640 1 --2- 172.21.15.3:0/3736976648 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564166bc5590 0x564166bcf910 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f44e80cdac0 tx=0x7f44e80d8a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a95ddf43ffeef5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:44.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.800+0000 7f44f2000640 1 -- 172.21.15.3:0/3067449557 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f44e80d03d0 con 0x7f44f40745c0 2024-09-19T06:18:44.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.800+0000 7f44e6a00640 1 -- 172.21.15.3:0/3736976648 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e80988f0 con 0x564166bc5590 2024-09-19T06:18:44.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.800+0000 7f44fa400640 1 --2- 172.21.15.3:0/3067449557 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f44dc0a3430 0x7f44dc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:44.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.800+0000 7f44e6a00640 1 -- 172.21.15.3:0/3736976648 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44e809cd50 con 0x564166bc5590 2024-09-19T06:18:44.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.800+0000 7f44e6a00640 1 -- 172.21.15.3:0/3736976648 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e809bfb0 con 0x564166bc5590 2024-09-19T06:18:44.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.801+0000 7f44fee6f740 1 -- 172.21.15.3:0/3736976648 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564166bc5590 msgr2=0x564166bcf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:44.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.801+0000 7f44fa400640 1 --2- 172.21.15.3:0/3067449557 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f44dc0a3430 0x7f44dc0a58f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f44ec0096c0 tx=0x7f44ec005bb0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:44.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.801+0000 7f44fee6f740 1 --2- 172.21.15.3:0/3736976648 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564166bc5590 0x564166bcf910 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f44e80cdac0 tx=0x7f44e80d8a30 comp rx=0 tx=0).stop 2024-09-19T06:18:44.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.801+0000 7f44fee6f740 1 -- 172.21.15.3:0/3736976648 shutdown_connections 2024-09-19T06:18:44.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.801+0000 7f44fee6f740 1 --2- 172.21.15.3:0/3736976648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564166bcfe50 0x564166bd2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.801+0000 7f44fee6f740 1 --2- 172.21.15.3:0/3736976648 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564166bc5590 0x564166bcf910 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.801+0000 7f44fee6f740 1 --2- 172.21.15.3:0/3736976648 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564166bc4c70 0x564166bc5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.801+0000 7f44fee6f740 1 -- 172.21.15.3:0/3736976648 >> 172.21.15.3:0/3736976648 conn(0x564166bc1200 msgr2=0x564166bc15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:44.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.801+0000 7f44fee6f740 1 -- 172.21.15.3:0/3736976648 shutdown_connections 2024-09-19T06:18:44.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.801+0000 7f44fee6f740 1 -- 172.21.15.3:0/3736976648 wait complete. 2024-09-19T06:18:44.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.801+0000 7f44fee6f740 1 -- start start 2024-09-19T06:18:44.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.802+0000 7f44fee6f740 1 Processor -- start 2024-09-19T06:18:44.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.802+0000 7f44fee6f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564166bc4c70 0x564166bccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:44.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.802+0000 7f44fee6f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564166bc5590 0x564166bcd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:44.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.802+0000 7f44fee6f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564166bcfe50 0x564166bcd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:44.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.802+0000 7f44fee6f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x564166bd2a20 con 0x564166bc4c70 2024-09-19T06:18:44.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.802+0000 7f44fee6f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564166ae60f0 con 0x564166bc5590 2024-09-19T06:18:44.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.802+0000 7f44fee6f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564166bd2ba0 con 0x564166bcfe50 2024-09-19T06:18:44.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.802+0000 7f44fee6f740 10 client.0 _ll_register_callbacks cb 0x564166acdbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:44.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.802+0000 7f44f9000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564166bc5590 0x564166bcd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:44.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.802+0000 7f44f9a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564166bc4c70 0x564166bccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:44.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.803+0000 7f44f9000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564166bc5590 0x564166bcd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:52436/0 (socket says 172.21.15.3:52436) 2024-09-19T06:18:44.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.803+0000 7f44f9000640 1 -- 172.21.15.3:0/1746495715 learned_addr learned my addr 172.21.15.3:0/1746495715 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:44.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.803+0000 7f44fa400640 1 --2- 172.21.15.3:0/1746495715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564166bcfe50 0x564166bcd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:44.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.803+0000 7f44f9000640 1 -- 172.21.15.3:0/1746495715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564166bcfe50 msgr2=0x564166bcd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:44.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.803+0000 7f44f9000640 1 --2- 172.21.15.3:0/1746495715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564166bcfe50 0x564166bcd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.803+0000 7f44f9000640 1 -- 172.21.15.3:0/1746495715 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564166bc4c70 msgr2=0x564166bccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:44.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.803+0000 7f44f9000640 1 --2- 172.21.15.3:0/1746495715 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564166bc4c70 0x564166bccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.803+0000 7f44f9000640 1 -- 172.21.15.3:0/1746495715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56416689c3c0 con 0x564166bc5590 2024-09-19T06:18:44.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.803+0000 7f44f9a00640 1 --2- 172.21.15.3:0/1746495715 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564166bc4c70 0x564166bccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:44.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.803+0000 7f44fa400640 1 --2- 172.21.15.3:0/1746495715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564166bcfe50 0x564166bcd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:44.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.803+0000 7f44f9000640 1 --2- 172.21.15.3:0/1746495715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564166bc5590 0x564166bcd310 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f44e0012700 tx=0x7f44e0012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b55403a6682cdb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:44.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.803+0000 7f44db400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:18:44.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.804+0000 7f44db400640 1 -- 172.21.15.3:0/1746495715 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e000f8c0 con 0x564166bc5590 2024-09-19T06:18:44.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.804+0000 7f44db400640 1 -- 172.21.15.3:0/1746495715 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f44e000fa60 con 0x564166bc5590 2024-09-19T06:18:44.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.804+0000 7f44fee6f740 1 -- 172.21.15.3:0/1746495715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44e809cd50 con 0x564166bc5590 2024-09-19T06:18:44.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.804+0000 7f44db400640 1 -- 172.21.15.3:0/1746495715 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f44e000fca0 con 0x564166bc5590 2024-09-19T06:18:44.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.804+0000 7f44fee6f740 10 client.27005 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:44.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.804+0000 7f44fee6f740 1 -- 172.21.15.3:0/1746495715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564166bdeb90 con 0x564166bc5590 2024-09-19T06:18:44.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.804+0000 7f44db400640 1 -- 172.21.15.3:0/1746495715 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44e809cd50 con 0x564166bc5590 2024-09-19T06:18:44.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.804+0000 7f44db400640 1 -- 172.21.15.3:0/1746495715 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f44e0003b50 con 0x564166bc5590 2024-09-19T06:18:44.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.805+0000 7f44fee6f740 10 client.27005 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:44.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.805+0000 7f44fee6f740 10 client.27005 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:18:44.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.805+0000 7f44fee6f740 20 client.27005 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:44.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.805+0000 7f44fee6f740 1 --2- 172.21.15.3:0/1746495715 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x564166be0050 0x564166be24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:44.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.805+0000 7f44fee6f740 4 client.27005 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:44.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.805+0000 7f44fee6f740 1 -- 172.21.15.3:0/1746495715 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564166b38950 con 0x564166be0050 2024-09-19T06:18:44.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.805+0000 7f44f9a00640 1 --2- 172.21.15.3:0/1746495715 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x564166be0050 0x564166be24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:44.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.805+0000 7f44f9a00640 1 --2- 172.21.15.3:0/1746495715 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x564166be0050 0x564166be24b0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1196cfb2c1e0f670 server_cookie=ded7d4cbdc4b5c0a in_seq=0 out_seq=0 2024-09-19T06:18:44.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.805+0000 7f44db400640 10 client.27005 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:18:44.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.806+0000 7f44db400640 1 -- 172.21.15.3:0/1746495715 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564166b38950 con 0x564166be0050 2024-09-19T06:18:44.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.806+0000 7f44db400640 10 client.27005 handle_command_reply: tid=0 2024-09-19T06:18:44.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.806+0000 7f44fee6f740 1 client.27005 shutdown 2024-09-19T06:18:44.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.806+0000 7f44fee6f740 1 -- 172.21.15.3:0/1746495715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564166bc5590 msgr2=0x564166bcd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:44.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.806+0000 7f44fee6f740 1 --2- 172.21.15.3:0/1746495715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564166bc5590 0x564166bcd310 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f44e0012700 tx=0x7f44e0012bc0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.807+0000 7f44fee6f740 1 -- 172.21.15.3:0/1746495715 shutdown_connections 2024-09-19T06:18:44.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.807+0000 7f44fee6f740 1 --2- 172.21.15.3:0/1746495715 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x564166be0050 0x564166be24b0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.807+0000 7f44fee6f740 1 --2- 172.21.15.3:0/1746495715 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564166bcfe50 0x564166bcd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.807+0000 7f44fee6f740 1 --2- 172.21.15.3:0/1746495715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564166bc5590 0x564166bcd310 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.807+0000 7f44db400640 0 client.27005 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:18:44.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.807+0000 7f44fee6f740 1 --2- 172.21.15.3:0/1746495715 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564166bc4c70 0x564166bccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.807+0000 7f44fee6f740 1 -- 172.21.15.3:0/1746495715 >> 172.21.15.3:0/1746495715 conn(0x564166bc1200 msgr2=0x564166bc6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:44.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.807+0000 7f44fee6f740 1 -- 172.21.15.3:0/1746495715 shutdown_connections 2024-09-19T06:18:44.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.807+0000 7f44fee6f740 1 -- 172.21.15.3:0/1746495715 wait complete. 2024-09-19T06:18:44.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.807+0000 7f44fee6f740 20 client.27005 trim_cache size 0 max 16384 2024-09-19T06:18:44.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.821+0000 7f44fee6f740 1 Processor -- start 2024-09-19T06:18:44.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.821+0000 7f44fee6f740 1 -- start start 2024-09-19T06:18:44.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.821+0000 7f44fee6f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564166bc4c70 0x564166bcc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:44.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.821+0000 7f44fee6f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564166bc5590 0x564166bced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:44.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.821+0000 7f44fee6f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564166bcfe50 0x564166be7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:44.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.821+0000 7f44fee6f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f44f41afb70 con 0x564166bc5590 2024-09-19T06:18:44.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.821+0000 7f44fee6f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f44f41b16b0 con 0x564166bc4c70 2024-09-19T06:18:44.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.821+0000 7f44fee6f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f44f41b0240 con 0x564166bcfe50 2024-09-19T06:18:44.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.821+0000 7f44f9000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564166bc5590 0x564166bced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:44.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.821+0000 7f44f9000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564166bc5590 0x564166bced40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46994/0 (socket says 172.21.15.3:46994) 2024-09-19T06:18:44.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.821+0000 7f44f9000640 1 -- 172.21.15.3:0/1908611976 learned_addr learned my addr 172.21.15.3:0/1908611976 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:44.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.822+0000 7f44fa400640 1 --2- 172.21.15.3:0/1908611976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564166bcfe50 0x564166be7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:44.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.822+0000 7f44f9a00640 1 --2- 172.21.15.3:0/1908611976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564166bc4c70 0x564166bcc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:44.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.822+0000 7f44f9000640 1 -- 172.21.15.3:0/1908611976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564166bcfe50 msgr2=0x564166be7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:44.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.822+0000 7f44f9000640 1 --2- 172.21.15.3:0/1908611976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564166bcfe50 0x564166be7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.822+0000 7f44f9000640 1 -- 172.21.15.3:0/1908611976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564166bc4c70 msgr2=0x564166bcc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:44.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.822+0000 7f44f9000640 1 --2- 172.21.15.3:0/1908611976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564166bc4c70 0x564166bcc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.822+0000 7f44f9000640 1 -- 172.21.15.3:0/1908611976 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564166bbc770 con 0x564166bc5590 2024-09-19T06:18:44.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.822+0000 7f44f9000640 1 --2- 172.21.15.3:0/1908611976 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564166bc5590 0x564166bced40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f44e0009da0 tx=0x7f44e0009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb29ad7bcdd61b8d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:44.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.822+0000 7f44e6000640 1 -- 172.21.15.3:0/1908611976 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e0028070 con 0x564166bc5590 2024-09-19T06:18:44.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.822+0000 7f44e6000640 1 -- 172.21.15.3:0/1908611976 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44e0010830 con 0x564166bc5590 2024-09-19T06:18:44.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.822+0000 7f44e6000640 1 -- 172.21.15.3:0/1908611976 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e00054a0 con 0x564166bc5590 2024-09-19T06:18:44.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.823+0000 7f44fee6f740 1 -- 172.21.15.3:0/1908611976 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564166bc5590 msgr2=0x564166bced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:44.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.823+0000 7f44fee6f740 1 --2- 172.21.15.3:0/1908611976 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564166bc5590 0x564166bced40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f44e0009da0 tx=0x7f44e0009ec0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.823+0000 7f44fee6f740 1 -- 172.21.15.3:0/1908611976 shutdown_connections 2024-09-19T06:18:44.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.823+0000 7f44fee6f740 1 --2- 172.21.15.3:0/1908611976 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564166bcfe50 0x564166be7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.823+0000 7f44fee6f740 1 --2- 172.21.15.3:0/1908611976 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564166bc5590 0x564166bced40 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.823+0000 7f44fee6f740 1 --2- 172.21.15.3:0/1908611976 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564166bc4c70 0x564166bcc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.823+0000 7f44fee6f740 1 -- 172.21.15.3:0/1908611976 >> 172.21.15.3:0/1908611976 conn(0x564166bc1200 msgr2=0x564166bce630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:44.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.823+0000 7f44fee6f740 1 -- 172.21.15.3:0/1908611976 shutdown_connections 2024-09-19T06:18:44.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.823+0000 7f44fee6f740 1 -- 172.21.15.3:0/1908611976 wait complete. 2024-09-19T06:18:44.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.824+0000 7f44fee6f740 1 -- start start 2024-09-19T06:18:44.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.824+0000 7f44fee6f740 1 Processor -- start 2024-09-19T06:18:44.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.824+0000 7f44fee6f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564166bc4c70 0x564166bd8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:44.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.824+0000 7f44fee6f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564166bc5590 0x564166bd3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:44.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.824+0000 7f44fee6f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564166bcfe50 0x564166bd3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:44.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.824+0000 7f44fee6f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f44f41b0fe0 con 0x564166bcfe50 2024-09-19T06:18:44.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.824+0000 7f44fee6f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f44f41b0910 con 0x564166bc5590 2024-09-19T06:18:44.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.824+0000 7f44fee6f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f44f41adb50 con 0x564166bc4c70 2024-09-19T06:18:44.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.824+0000 7f44fee6f740 10 client.0 _ll_register_callbacks cb 0x7f44e0009850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:44.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.825+0000 7f44f9a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564166bc4c70 0x564166bd8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:44.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.825+0000 7f44f9000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564166bc5590 0x564166bd3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:44.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.825+0000 7f44f9a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564166bc4c70 0x564166bd8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:54714/0 (socket says 172.21.15.3:54714) 2024-09-19T06:18:44.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.825+0000 7f44f9a00640 1 -- 172.21.15.3:0/3204699556 learned_addr learned my addr 172.21.15.3:0/3204699556 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:44.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.825+0000 7f44f9000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564166bc5590 0x564166bd3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:52452/0 (socket says 172.21.15.3:52452) 2024-09-19T06:18:44.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.825+0000 7f44fa400640 1 --2- 172.21.15.3:0/3204699556 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564166bcfe50 0x564166bd3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:44.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.825+0000 7f44f9a00640 1 -- 172.21.15.3:0/3204699556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564166bc5590 msgr2=0x564166bd3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:44.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.825+0000 7f44f9a00640 1 --2- 172.21.15.3:0/3204699556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564166bc5590 0x564166bd3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.825+0000 7f44f9a00640 1 -- 172.21.15.3:0/3204699556 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564166bcfe50 msgr2=0x564166bd3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:44.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.825+0000 7f44f9a00640 1 --2- 172.21.15.3:0/3204699556 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564166bcfe50 0x564166bd3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.825+0000 7f44f9a00640 1 -- 172.21.15.3:0/3204699556 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564166bd4770 con 0x564166bc4c70 2024-09-19T06:18:44.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.825+0000 7f44f9000640 1 --2- 172.21.15.3:0/3204699556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564166bc5590 0x564166bd3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:44.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.826+0000 7f44f9a00640 1 --2- 172.21.15.3:0/3204699556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564166bc4c70 0x564166bd8620 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f44e800eb90 tx=0x7f44e80d8150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ee76345b6b1a0b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:44.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.826+0000 7f44db400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:18:44.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.826+0000 7f44db400640 1 -- 172.21.15.3:0/3204699556 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8010e60 con 0x564166bc4c70 2024-09-19T06:18:44.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.826+0000 7f44db400640 1 -- 172.21.15.3:0/3204699556 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f44e809a950 con 0x564166bc4c70 2024-09-19T06:18:44.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.826+0000 7f44fee6f740 1 -- 172.21.15.3:0/3204699556 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44e0010830 con 0x564166bc4c70 2024-09-19T06:18:44.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.826+0000 7f44db400640 1 -- 172.21.15.3:0/3204699556 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f44e809c190 con 0x564166bc4c70 2024-09-19T06:18:44.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.826+0000 7f44fee6f740 10 client.27016 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:44.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.826+0000 7f44fee6f740 1 -- 172.21.15.3:0/3204699556 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564166c4ae30 con 0x564166bc4c70 2024-09-19T06:18:44.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.826+0000 7f44db400640 1 -- 172.21.15.3:0/3204699556 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44e0010830 con 0x564166bc4c70 2024-09-19T06:18:44.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.826+0000 7f44db400640 1 -- 172.21.15.3:0/3204699556 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f44e809c8b0 con 0x564166bc4c70 2024-09-19T06:18:44.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.827+0000 7f44fee6f740 10 client.27016 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:44.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.827+0000 7f44fee6f740 10 client.27016 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:18:44.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.827+0000 7f44fee6f740 20 client.27016 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:44.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.827+0000 7f44fee6f740 1 --2- 172.21.15.3:0/3204699556 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x564166c4b060 0x564166c4d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:44.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.827+0000 7f44fee6f740 4 client.27016 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:18:44.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.827+0000 7f44fee6f740 1 -- 172.21.15.3:0/3204699556 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564166b32e60 con 0x564166c4b060 2024-09-19T06:18:44.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.827+0000 7f44f9000640 1 --2- 172.21.15.3:0/3204699556 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x564166c4b060 0x564166c4d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:44.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.827+0000 7f44f9000640 1 --2- 172.21.15.3:0/3204699556 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x564166c4b060 0x564166c4d450 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d6d31c9ca0adc795 server_cookie=11b8764483d79121 in_seq=0 out_seq=0 2024-09-19T06:18:44.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.827+0000 7f44db400640 10 client.27016 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:18:44.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.828+0000 7f44db400640 1 -- 172.21.15.3:0/3204699556 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564166b32e60 con 0x564166c4b060 2024-09-19T06:18:44.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.828+0000 7f44db400640 10 client.27016 handle_command_reply: tid=0 2024-09-19T06:18:44.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.828+0000 7f44fee6f740 1 client.27016 shutdown 2024-09-19T06:18:44.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.828+0000 7f44fee6f740 1 -- 172.21.15.3:0/3204699556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564166bc4c70 msgr2=0x564166bd8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:44.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.828+0000 7f44fee6f740 1 --2- 172.21.15.3:0/3204699556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564166bc4c70 0x564166bd8620 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f44e800eb90 tx=0x7f44e80d8150 comp rx=0 tx=0).stop 2024-09-19T06:18:44.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.828+0000 7f44fee6f740 1 -- 172.21.15.3:0/3204699556 shutdown_connections 2024-09-19T06:18:44.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.828+0000 7f44fee6f740 1 --2- 172.21.15.3:0/3204699556 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x564166c4b060 0x564166c4d450 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.828+0000 7f44fee6f740 1 --2- 172.21.15.3:0/3204699556 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564166bcfe50 0x564166bd3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.828+0000 7f44fee6f740 1 --2- 172.21.15.3:0/3204699556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564166bc5590 0x564166bd3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.828+0000 7f44db400640 0 client.27016 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:18:44.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.828+0000 7f44fee6f740 1 --2- 172.21.15.3:0/3204699556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564166bc4c70 0x564166bd8620 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.828+0000 7f44fee6f740 1 -- 172.21.15.3:0/3204699556 >> 172.21.15.3:0/3204699556 conn(0x564166bc1200 msgr2=0x564166bc6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:44.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.828+0000 7f44fee6f740 1 -- 172.21.15.3:0/3204699556 shutdown_connections 2024-09-19T06:18:44.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.828+0000 7f44fee6f740 1 -- 172.21.15.3:0/3204699556 wait complete. 2024-09-19T06:18:44.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.828+0000 7f44fee6f740 20 client.27016 trim_cache size 0 max 16384 2024-09-19T06:18:44.834 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:18:44.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.829+0000 7f44fc400640 1 -- 172.21.15.3:0/3067449557 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f44dc0a3430 msgr2=0x7f44dc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:44.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.829+0000 7f44fc400640 1 --2- 172.21.15.3:0/3067449557 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f44dc0a3430 0x7f44dc0a58f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f44ec0096c0 tx=0x7f44ec005bb0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.829+0000 7f44fc400640 1 -- 172.21.15.3:0/3067449557 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44f40745c0 msgr2=0x7f44f419a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:44.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.829+0000 7f44fc400640 1 --2- 172.21.15.3:0/3067449557 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44f40745c0 0x7f44f419a650 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f44e800ebc0 tx=0x7f44e800c6a0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.829+0000 7f44fc400640 1 -- 172.21.15.3:0/3067449557 shutdown_connections 2024-09-19T06:18:44.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.829+0000 7f44fc400640 1 --2- 172.21.15.3:0/3067449557 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f44dc0a3430 0x7f44dc0a58f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.829+0000 7f44fc400640 1 --2- 172.21.15.3:0/3067449557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44f410e430 0x7f44f419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.829+0000 7f44fc400640 1 --2- 172.21.15.3:0/3067449557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f44f4074ee0 0x7f44f419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.829+0000 7f44fc400640 1 --2- 172.21.15.3:0/3067449557 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44f40745c0 0x7f44f419a650 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:44.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.829+0000 7f44fc400640 1 -- 172.21.15.3:0/3067449557 >> 172.21.15.3:0/3067449557 conn(0x7f44f40fd8b0 msgr2=0x7f44f40fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:44.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.829+0000 7f44fc400640 1 -- 172.21.15.3:0/3067449557 shutdown_connections 2024-09-19T06:18:44.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:44.829+0000 7f44fc400640 1 -- 172.21.15.3:0/3067449557 wait complete. 2024-09-19T06:18:45.661 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:18:46.037 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:46.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:45 smithi059 ceph-mon[35138]: pgmap v194: 97 pgs: 97 active+clean; 2.1 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 24 op/s 2024-09-19T06:18:46.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:45 smithi003 ceph-mon[30893]: pgmap v194: 97 pgs: 97 active+clean; 2.1 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 24 op/s 2024-09-19T06:18:46.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:45 smithi071 ceph-mon[35662]: pgmap v194: 97 pgs: 97 active+clean; 2.1 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 24 op/s 2024-09-19T06:18:46.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.607+0000 7fd597e00640 1 -- 172.21.15.3:0/1704847883 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd590103ff0 msgr2=0x7fd5901043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:46.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.607+0000 7fd597e00640 1 --2- 172.21.15.3:0/1704847883 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd590103ff0 0x7fd5901043d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd584009900 tx=0x7fd58402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.607+0000 7fd597e00640 1 -- 172.21.15.3:0/1704847883 shutdown_connections 2024-09-19T06:18:46.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.607+0000 7fd597e00640 1 --2- 172.21.15.3:0/1704847883 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd590109120 0x7fd590110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.607+0000 7fd597e00640 1 --2- 172.21.15.3:0/1704847883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5901049a0 0x7fd5901089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.607+0000 7fd597e00640 1 --2- 172.21.15.3:0/1704847883 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd590103ff0 0x7fd5901043d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.607+0000 7fd597e00640 1 -- 172.21.15.3:0/1704847883 >> 172.21.15.3:0/1704847883 conn(0x7fd5900ffa90 msgr2=0x7fd590101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:46.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.607+0000 7fd597e00640 1 -- 172.21.15.3:0/1704847883 shutdown_connections 2024-09-19T06:18:46.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.607+0000 7fd597e00640 1 -- 172.21.15.3:0/1704847883 wait complete. 2024-09-19T06:18:46.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.608+0000 7fd597e00640 1 Processor -- start 2024-09-19T06:18:46.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.608+0000 7fd597e00640 1 -- start start 2024-09-19T06:18:46.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.608+0000 7fd597e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd590103ff0 0x7fd59019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:46.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.608+0000 7fd597e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5901049a0 0x7fd59019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:46.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.608+0000 7fd597e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd590109120 0x7fd59019eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:46.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.608+0000 7fd597e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd590114120 con 0x7fd590103ff0 2024-09-19T06:18:46.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.608+0000 7fd597e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd590113fa0 con 0x7fd590109120 2024-09-19T06:18:46.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.608+0000 7fd597e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd5901142a0 con 0x7fd5901049a0 2024-09-19T06:18:46.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.609+0000 7fd595400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd590103ff0 0x7fd59019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:46.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.609+0000 7fd595400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd590103ff0 0x7fd59019a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47008/0 (socket says 172.21.15.3:47008) 2024-09-19T06:18:46.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.609+0000 7fd595400640 1 -- 172.21.15.3:0/4237963393 learned_addr learned my addr 172.21.15.3:0/4237963393 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:46.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.609+0000 7fd595e00640 1 --2- 172.21.15.3:0/4237963393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd590109120 0x7fd59019eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:46.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.609+0000 7fd594a00640 1 --2- 172.21.15.3:0/4237963393 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5901049a0 0x7fd59019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:46.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.609+0000 7fd595e00640 1 -- 172.21.15.3:0/4237963393 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5901049a0 msgr2=0x7fd59019ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:46.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.609+0000 7fd595e00640 1 --2- 172.21.15.3:0/4237963393 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5901049a0 0x7fd59019ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.609+0000 7fd595e00640 1 -- 172.21.15.3:0/4237963393 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd590103ff0 msgr2=0x7fd59019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:46.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.609+0000 7fd595e00640 1 --2- 172.21.15.3:0/4237963393 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd590103ff0 0x7fd59019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.609+0000 7fd595e00640 1 -- 172.21.15.3:0/4237963393 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59019f590 con 0x7fd590109120 2024-09-19T06:18:46.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.609+0000 7fd595400640 1 --2- 172.21.15.3:0/4237963393 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd590103ff0 0x7fd59019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:46.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.610+0000 7fd595e00640 1 --2- 172.21.15.3:0/4237963393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd590109120 0x7fd59019eeb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd588009fd0 tx=0x7fd58800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:46.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.610+0000 7fd58e000640 1 -- 172.21.15.3:0/4237963393 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58800ce20 con 0x7fd590109120 2024-09-19T06:18:46.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.610+0000 7fd58e000640 1 -- 172.21.15.3:0/4237963393 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd588005020 con 0x7fd590109120 2024-09-19T06:18:46.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.610+0000 7fd597e00640 1 -- 172.21.15.3:0/4237963393 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd59019f880 con 0x7fd590109120 2024-09-19T06:18:46.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.610+0000 7fd58e000640 1 -- 172.21.15.3:0/4237963393 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd588010720 con 0x7fd590109120 2024-09-19T06:18:46.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.610+0000 7fd597e00640 1 -- 172.21.15.3:0/4237963393 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5901a7160 con 0x7fd590109120 2024-09-19T06:18:46.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.613+0000 7fd59aa3b740 1 Processor -- start 2024-09-19T06:18:46.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.613+0000 7fd58e000640 1 -- 172.21.15.3:0/4237963393 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fd588005540 con 0x7fd590109120 2024-09-19T06:18:46.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.613+0000 7fd59aa3b740 1 -- start start 2024-09-19T06:18:46.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.614+0000 7fd59aa3b740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d66826bc70 0x55d66826c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:46.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.614+0000 7fd59aa3b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d66826c590 0x55d668276910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:46.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.614+0000 7fd59aa3b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d668276e50 0x55d668279240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:46.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.614+0000 7fd59aa3b740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d6681d23e0 con 0x55d66826bc70 2024-09-19T06:18:46.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.614+0000 7fd59aa3b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d668179d80 con 0x55d66826c590 2024-09-19T06:18:46.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.614+0000 7fd59aa3b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d6681ce3a0 con 0x55d668276e50 2024-09-19T06:18:46.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.614+0000 7fd594a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d66826bc70 0x55d66826c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:46.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.614+0000 7fd595400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d66826c590 0x55d668276910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:46.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.614+0000 7fd594a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d66826bc70 0x55d66826c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47022/0 (socket says 172.21.15.3:47022) 2024-09-19T06:18:46.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.614+0000 7fd594a00640 1 -- 172.21.15.3:0/2720043409 learned_addr learned my addr 172.21.15.3:0/2720043409 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:46.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.614+0000 7fd595400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d66826c590 0x55d668276910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:52470/0 (socket says 172.21.15.3:52470) 2024-09-19T06:18:46.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.614+0000 7fd594a00640 1 --2- 172.21.15.3:0/2720043409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d668276e50 0x55d668279240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:46.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.615+0000 7fd594a00640 1 -- 172.21.15.3:0/2720043409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d668276e50 msgr2=0x55d668279240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:46.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.615+0000 7fd594a00640 1 --2- 172.21.15.3:0/2720043409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d668276e50 0x55d668279240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.615+0000 7fd594a00640 1 -- 172.21.15.3:0/2720043409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d66826c590 msgr2=0x55d668276910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:46.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.615+0000 7fd594a00640 1 --2- 172.21.15.3:0/2720043409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d66826c590 0x55d668276910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.615+0000 7fd594a00640 1 -- 172.21.15.3:0/2720043409 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d668198ae0 con 0x55d66826bc70 2024-09-19T06:18:46.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.615+0000 7fd594a00640 1 --2- 172.21.15.3:0/2720043409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d66826bc70 0x55d66826c050 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd57c005bc0 tx=0x7fd57c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2961275d2d3aa5a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:46.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.615+0000 7fd582600640 1 -- 172.21.15.3:0/2720043409 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c013dc0 con 0x55d66826bc70 2024-09-19T06:18:46.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.615+0000 7fd582600640 1 -- 172.21.15.3:0/2720043409 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd57c013170 con 0x55d66826bc70 2024-09-19T06:18:46.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.615+0000 7fd58e000640 1 --2- 172.21.15.3:0/4237963393 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd5780a33b0 0x7fd5780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:46.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.615+0000 7fd582600640 1 -- 172.21.15.3:0/2720043409 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c0108f0 con 0x55d66826bc70 2024-09-19T06:18:46.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.615+0000 7fd58e000640 1 -- 172.21.15.3:0/4237963393 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fd5880d0400 con 0x7fd590109120 2024-09-19T06:18:46.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.616+0000 7fd595400640 1 --2- 172.21.15.3:0/4237963393 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd5780a33b0 0x7fd5780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:46.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.616+0000 7fd59aa3b740 1 -- 172.21.15.3:0/2720043409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d66826bc70 msgr2=0x55d66826c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:46.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.616+0000 7fd59aa3b740 1 --2- 172.21.15.3:0/2720043409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d66826bc70 0x55d66826c050 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd57c005bc0 tx=0x7fd57c005f90 comp rx=0 tx=0).stop 2024-09-19T06:18:46.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.616+0000 7fd59aa3b740 1 -- 172.21.15.3:0/2720043409 shutdown_connections 2024-09-19T06:18:46.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.616+0000 7fd59aa3b740 1 --2- 172.21.15.3:0/2720043409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d668276e50 0x55d668279240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.616+0000 7fd59aa3b740 1 --2- 172.21.15.3:0/2720043409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d66826c590 0x55d668276910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.616+0000 7fd59aa3b740 1 --2- 172.21.15.3:0/2720043409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d66826bc70 0x55d66826c050 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.616+0000 7fd59aa3b740 1 -- 172.21.15.3:0/2720043409 >> 172.21.15.3:0/2720043409 conn(0x55d668268200 msgr2=0x55d6682685e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:46.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.616+0000 7fd59aa3b740 1 -- 172.21.15.3:0/2720043409 shutdown_connections 2024-09-19T06:18:46.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.616+0000 7fd59aa3b740 1 -- 172.21.15.3:0/2720043409 wait complete. 2024-09-19T06:18:46.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.617+0000 7fd595400640 1 --2- 172.21.15.3:0/4237963393 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd5780a33b0 0x7fd5780a5870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x55d668269060 tx=0x7fd584005a20 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:46.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.617+0000 7fd59aa3b740 1 -- start start 2024-09-19T06:18:46.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.617+0000 7fd59aa3b740 1 Processor -- start 2024-09-19T06:18:46.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.618+0000 7fd59aa3b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d66826bc70 0x55d668273c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:46.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.618+0000 7fd59aa3b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d66826c590 0x55d6682741c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:46.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.618+0000 7fd59aa3b740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d668276e50 0x55d668274700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:46.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.618+0000 7fd59aa3b740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d668279a20 con 0x55d668276e50 2024-09-19T06:18:46.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.618+0000 7fd59aa3b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d66818d0f0 con 0x55d66826bc70 2024-09-19T06:18:46.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.618+0000 7fd59aa3b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d668279ba0 con 0x55d66826c590 2024-09-19T06:18:46.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.618+0000 7fd59aa3b740 10 client.0 _ll_register_callbacks cb 0x55d668174bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:46.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.618+0000 7fd595e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d668276e50 0x55d668274700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:46.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.618+0000 7fd594a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d66826c590 0x55d6682741c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:46.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.618+0000 7fd594a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d66826c590 0x55d6682741c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:54750/0 (socket says 172.21.15.3:54750) 2024-09-19T06:18:46.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.618+0000 7fd594a00640 1 -- 172.21.15.3:0/2952054886 learned_addr learned my addr 172.21.15.3:0/2952054886 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:46.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.618+0000 7fd595400640 1 --2- 172.21.15.3:0/2952054886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d66826bc70 0x55d668273c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:46.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.619+0000 7fd594a00640 1 -- 172.21.15.3:0/2952054886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d66826bc70 msgr2=0x55d668273c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:46.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.619+0000 7fd594a00640 1 --2- 172.21.15.3:0/2952054886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d66826bc70 0x55d668273c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.619+0000 7fd594a00640 1 -- 172.21.15.3:0/2952054886 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d668276e50 msgr2=0x55d668274700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:46.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.619+0000 7fd594a00640 1 --2- 172.21.15.3:0/2952054886 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d668276e50 0x55d668274700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.619+0000 7fd594a00640 1 -- 172.21.15.3:0/2952054886 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d667f433c0 con 0x55d66826c590 2024-09-19T06:18:46.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.619+0000 7fd595e00640 1 --2- 172.21.15.3:0/2952054886 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d668276e50 0x55d668274700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:46.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.619+0000 7fd594a00640 1 --2- 172.21.15.3:0/2952054886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d66826c590 0x55d6682741c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd57c005500 tx=0x7fd57c005530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cb04551de6e54f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:46.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.619+0000 7fd576a00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:18:46.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.619+0000 7fd576a00640 1 -- 172.21.15.3:0/2952054886 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c024070 con 0x55d66826c590 2024-09-19T06:18:46.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.619+0000 7fd59aa3b740 1 -- 172.21.15.3:0/2952054886 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd57c013170 con 0x55d66826c590 2024-09-19T06:18:46.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.619+0000 7fd576a00640 1 -- 172.21.15.3:0/2952054886 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fd57c00f9a0 con 0x55d66826c590 2024-09-19T06:18:46.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.620+0000 7fd576a00640 1 -- 172.21.15.3:0/2952054886 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd57c030050 con 0x55d66826c590 2024-09-19T06:18:46.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.620+0000 7fd59aa3b740 10 client.27028 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:46.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.620+0000 7fd59aa3b740 1 -- 172.21.15.3:0/2952054886 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d6682859e0 con 0x55d66826c590 2024-09-19T06:18:46.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.620+0000 7fd576a00640 1 -- 172.21.15.3:0/2952054886 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd57c013170 con 0x55d66826c590 2024-09-19T06:18:46.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.620+0000 7fd576a00640 1 -- 172.21.15.3:0/2952054886 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd57c010670 con 0x55d66826c590 2024-09-19T06:18:46.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.620+0000 7fd59aa3b740 10 client.27028 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:46.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.620+0000 7fd59aa3b740 10 client.27028 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:18:46.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.620+0000 7fd59aa3b740 20 client.27028 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:46.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.620+0000 7fd59aa3b740 1 --2- 172.21.15.3:0/2952054886 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55d668286d90 0x55d668289180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:46.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.620+0000 7fd59aa3b740 4 client.27028 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:46.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.620+0000 7fd59aa3b740 1 -- 172.21.15.3:0/2952054886 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6681df950 con 0x55d668286d90 2024-09-19T06:18:46.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.621+0000 7fd595400640 1 --2- 172.21.15.3:0/2952054886 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55d668286d90 0x55d668289180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:46.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.621+0000 7fd595400640 1 --2- 172.21.15.3:0/2952054886 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55d668286d90 0x55d668289180 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b4bc715f2c7f290a server_cookie=cd40bc0f74f5ae02 in_seq=0 out_seq=0 2024-09-19T06:18:46.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.621+0000 7fd576a00640 10 client.27028 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:18:46.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.622+0000 7fd576a00640 1 -- 172.21.15.3:0/2952054886 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d6681df950 con 0x55d668286d90 2024-09-19T06:18:46.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.622+0000 7fd576a00640 10 client.27028 handle_command_reply: tid=0 2024-09-19T06:18:46.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.622+0000 7fd59aa3b740 1 client.27028 shutdown 2024-09-19T06:18:46.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.622+0000 7fd59aa3b740 1 -- 172.21.15.3:0/2952054886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d66826c590 msgr2=0x55d6682741c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:46.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.622+0000 7fd59aa3b740 1 --2- 172.21.15.3:0/2952054886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d66826c590 0x55d6682741c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd57c005500 tx=0x7fd57c005530 comp rx=0 tx=0).stop 2024-09-19T06:18:46.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.622+0000 7fd59aa3b740 1 -- 172.21.15.3:0/2952054886 shutdown_connections 2024-09-19T06:18:46.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.622+0000 7fd59aa3b740 1 --2- 172.21.15.3:0/2952054886 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55d668286d90 0x55d668289180 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.622+0000 7fd59aa3b740 1 --2- 172.21.15.3:0/2952054886 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d668276e50 0x55d668274700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.622+0000 7fd59aa3b740 1 --2- 172.21.15.3:0/2952054886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d66826c590 0x55d6682741c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.622+0000 7fd576a00640 0 client.27028 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:18:46.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.622+0000 7fd59aa3b740 1 --2- 172.21.15.3:0/2952054886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d66826bc70 0x55d668273c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.622+0000 7fd59aa3b740 1 -- 172.21.15.3:0/2952054886 >> 172.21.15.3:0/2952054886 conn(0x55d668268200 msgr2=0x55d66826df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:46.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.623+0000 7fd59aa3b740 1 -- 172.21.15.3:0/2952054886 shutdown_connections 2024-09-19T06:18:46.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.623+0000 7fd59aa3b740 1 -- 172.21.15.3:0/2952054886 wait complete. 2024-09-19T06:18:46.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.623+0000 7fd59aa3b740 20 client.27028 trim_cache size 0 max 16384 2024-09-19T06:18:46.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.636+0000 7fd59aa3b740 1 Processor -- start 2024-09-19T06:18:46.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.636+0000 7fd59aa3b740 1 -- start start 2024-09-19T06:18:46.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.637+0000 7fd59aa3b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d66826bc70 0x55d66826e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:46.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.637+0000 7fd59aa3b740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d66826c590 0x55d668275fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:46.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.637+0000 7fd59aa3b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d668276e50 0x55d66828e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:46.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.637+0000 7fd59aa3b740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd5901afa30 con 0x55d66826c590 2024-09-19T06:18:46.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.637+0000 7fd59aa3b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd5901b1570 con 0x55d66826bc70 2024-09-19T06:18:46.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.637+0000 7fd59aa3b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd5901b0100 con 0x55d668276e50 2024-09-19T06:18:46.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.637+0000 7fd594a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d66826c590 0x55d668275fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:46.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.637+0000 7fd595400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d66826bc70 0x55d66826e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:46.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.637+0000 7fd594a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d66826c590 0x55d668275fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47044/0 (socket says 172.21.15.3:47044) 2024-09-19T06:18:46.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.637+0000 7fd594a00640 1 -- 172.21.15.3:0/4261068899 learned_addr learned my addr 172.21.15.3:0/4261068899 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:46.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.637+0000 7fd595400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d66826bc70 0x55d66826e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:52498/0 (socket says 172.21.15.3:52498) 2024-09-19T06:18:46.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.637+0000 7fd595e00640 1 --2- 172.21.15.3:0/4261068899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d668276e50 0x55d66828e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:46.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.637+0000 7fd594a00640 1 -- 172.21.15.3:0/4261068899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d668276e50 msgr2=0x55d66828e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:46.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.637+0000 7fd594a00640 1 --2- 172.21.15.3:0/4261068899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d668276e50 0x55d66828e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.637+0000 7fd594a00640 1 -- 172.21.15.3:0/4261068899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d66826bc70 msgr2=0x55d66826e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:46.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.637+0000 7fd594a00640 1 --2- 172.21.15.3:0/4261068899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d66826bc70 0x55d66826e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.637+0000 7fd594a00640 1 -- 172.21.15.3:0/4261068899 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d668268030 con 0x55d66826c590 2024-09-19T06:18:46.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.637+0000 7fd595400640 1 --2- 172.21.15.3:0/4261068899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d66826bc70 0x55d66826e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:46.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.638+0000 7fd594a00640 1 --2- 172.21.15.3:0/4261068899 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d66826c590 0x55d668275fb0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd57c005c00 tx=0x7fd57c005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5825c1a8cd3ecb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:46.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.638+0000 7fd581c00640 1 -- 172.21.15.3:0/4261068899 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c024040 con 0x55d66826c590 2024-09-19T06:18:46.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.638+0000 7fd581c00640 1 -- 172.21.15.3:0/4261068899 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd57c00fe80 con 0x55d66826c590 2024-09-19T06:18:46.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.638+0000 7fd581c00640 1 -- 172.21.15.3:0/4261068899 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c010550 con 0x55d66826c590 2024-09-19T06:18:46.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.639+0000 7fd59aa3b740 1 -- 172.21.15.3:0/4261068899 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d66826c590 msgr2=0x55d668275fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:46.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.639+0000 7fd59aa3b740 1 --2- 172.21.15.3:0/4261068899 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d66826c590 0x55d668275fb0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd57c005c00 tx=0x7fd57c005b90 comp rx=0 tx=0).stop 2024-09-19T06:18:46.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.639+0000 7fd59aa3b740 1 -- 172.21.15.3:0/4261068899 shutdown_connections 2024-09-19T06:18:46.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.639+0000 7fd59aa3b740 1 --2- 172.21.15.3:0/4261068899 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d668276e50 0x55d66828e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.639+0000 7fd59aa3b740 1 --2- 172.21.15.3:0/4261068899 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d66826c590 0x55d668275fb0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.639+0000 7fd59aa3b740 1 --2- 172.21.15.3:0/4261068899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d66826bc70 0x55d66826e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.639+0000 7fd59aa3b740 1 -- 172.21.15.3:0/4261068899 >> 172.21.15.3:0/4261068899 conn(0x55d668268200 msgr2=0x55d668267380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:46.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.639+0000 7fd59aa3b740 1 -- 172.21.15.3:0/4261068899 shutdown_connections 2024-09-19T06:18:46.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.639+0000 7fd59aa3b740 1 -- 172.21.15.3:0/4261068899 wait complete. 2024-09-19T06:18:46.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.639+0000 7fd59aa3b740 1 -- start start 2024-09-19T06:18:46.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.639+0000 7fd59aa3b740 1 Processor -- start 2024-09-19T06:18:46.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.640+0000 7fd59aa3b740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d66826bc70 0x55d668270d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:46.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.640+0000 7fd59aa3b740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d66826c590 0x55d668271270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:46.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.640+0000 7fd59aa3b740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d668276e50 0x55d6682717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:46.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.640+0000 7fd59aa3b740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd5901b0ea0 con 0x55d66826bc70 2024-09-19T06:18:46.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.640+0000 7fd59aa3b740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd5901b07d0 con 0x55d66826c590 2024-09-19T06:18:46.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.640+0000 7fd59aa3b740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd5901ada10 con 0x55d668276e50 2024-09-19T06:18:46.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.640+0000 7fd59aa3b740 10 client.0 _ll_register_callbacks cb 0x7fd5880093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:46.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.640+0000 7fd595400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d66826bc70 0x55d668270d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:46.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.640+0000 7fd595400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d66826bc70 0x55d668270d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47048/0 (socket says 172.21.15.3:47048) 2024-09-19T06:18:46.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.640+0000 7fd595400640 1 -- 172.21.15.3:0/3927231088 learned_addr learned my addr 172.21.15.3:0/3927231088 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:46.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.640+0000 7fd595e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d668276e50 0x55d6682717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:46.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.640+0000 7fd594a00640 1 --2- 172.21.15.3:0/3927231088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d66826c590 0x55d668271270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:46.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.641+0000 7fd595400640 1 -- 172.21.15.3:0/3927231088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d668276e50 msgr2=0x55d6682717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:46.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.641+0000 7fd595400640 1 --2- 172.21.15.3:0/3927231088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d668276e50 0x55d6682717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.641+0000 7fd595400640 1 -- 172.21.15.3:0/3927231088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d66826c590 msgr2=0x55d668271270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:46.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.641+0000 7fd595400640 1 --2- 172.21.15.3:0/3927231088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d66826c590 0x55d668271270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.641+0000 7fd595400640 1 -- 172.21.15.3:0/3927231088 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d668267a90 con 0x55d66826bc70 2024-09-19T06:18:46.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.641+0000 7fd595400640 1 --2- 172.21.15.3:0/3927231088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d66826bc70 0x55d668270d30 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd584006010 tx=0x7fd584009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e1d68f30158528 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:46.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.641+0000 7fd576a00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:18:46.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.641+0000 7fd576a00640 1 -- 172.21.15.3:0/3927231088 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd584035040 con 0x55d66826bc70 2024-09-19T06:18:46.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.641+0000 7fd576a00640 1 -- 172.21.15.3:0/3927231088 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fd584004960 con 0x55d66826bc70 2024-09-19T06:18:46.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.641+0000 7fd59aa3b740 1 -- 172.21.15.3:0/3927231088 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d6681d9e60 con 0x55d66826bc70 2024-09-19T06:18:46.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.642+0000 7fd576a00640 1 -- 172.21.15.3:0/3927231088 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd584004b60 con 0x55d66826bc70 2024-09-19T06:18:46.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.642+0000 7fd59aa3b740 10 client.16986 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:46.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.642+0000 7fd59aa3b740 1 -- 172.21.15.3:0/3927231088 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d668268e90 con 0x55d66826bc70 2024-09-19T06:18:46.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.642+0000 7fd576a00640 1 -- 172.21.15.3:0/3927231088 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55d6681d9e60 con 0x55d66826bc70 2024-09-19T06:18:46.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.642+0000 7fd576a00640 1 -- 172.21.15.3:0/3927231088 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd58405a070 con 0x55d66826bc70 2024-09-19T06:18:46.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.642+0000 7fd59aa3b740 10 client.16986 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:46.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.642+0000 7fd59aa3b740 10 client.16986 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:18:46.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.642+0000 7fd59aa3b740 20 client.16986 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:46.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.642+0000 7fd59aa3b740 1 --2- 172.21.15.3:0/3927231088 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55d6682f1f40 0x55d6682f4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:46.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.642+0000 7fd59aa3b740 4 client.16986 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:18:46.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.642+0000 7fd59aa3b740 1 -- 172.21.15.3:0/3927231088 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d668156010 con 0x55d6682f1f40 2024-09-19T06:18:46.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.643+0000 7fd594a00640 1 --2- 172.21.15.3:0/3927231088 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55d6682f1f40 0x55d6682f4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:46.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.643+0000 7fd594a00640 1 --2- 172.21.15.3:0/3927231088 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55d6682f1f40 0x55d6682f4360 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1102cac958940dd9 server_cookie=37fbc8278634cea4 in_seq=0 out_seq=0 2024-09-19T06:18:46.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.643+0000 7fd576a00640 10 client.16986 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:18:46.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.643+0000 7fd576a00640 1 -- 172.21.15.3:0/3927231088 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d668156010 con 0x55d6682f1f40 2024-09-19T06:18:46.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.643+0000 7fd576a00640 10 client.16986 handle_command_reply: tid=0 2024-09-19T06:18:46.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.643+0000 7fd59aa3b740 1 client.16986 shutdown 2024-09-19T06:18:46.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.643+0000 7fd59aa3b740 1 -- 172.21.15.3:0/3927231088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d66826bc70 msgr2=0x55d668270d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:46.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.643+0000 7fd59aa3b740 1 --2- 172.21.15.3:0/3927231088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d66826bc70 0x55d668270d30 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd584006010 tx=0x7fd584009260 comp rx=0 tx=0).stop 2024-09-19T06:18:46.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.644+0000 7fd59aa3b740 1 -- 172.21.15.3:0/3927231088 shutdown_connections 2024-09-19T06:18:46.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.644+0000 7fd59aa3b740 1 --2- 172.21.15.3:0/3927231088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d668276e50 0x55d6682717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.644+0000 7fd59aa3b740 1 --2- 172.21.15.3:0/3927231088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d66826c590 0x55d668271270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.644+0000 7fd59aa3b740 1 --2- 172.21.15.3:0/3927231088 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55d6682f1f40 0x55d6682f4360 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.644+0000 7fd59aa3b740 1 --2- 172.21.15.3:0/3927231088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d66826bc70 0x55d668270d30 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.644+0000 7fd59aa3b740 1 -- 172.21.15.3:0/3927231088 >> 172.21.15.3:0/3927231088 conn(0x55d668268200 msgr2=0x55d668281ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:46.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.644+0000 7fd576a00640 0 client.16986 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:18:46.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.644+0000 7fd59aa3b740 1 -- 172.21.15.3:0/3927231088 shutdown_connections 2024-09-19T06:18:46.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.644+0000 7fd59aa3b740 1 -- 172.21.15.3:0/3927231088 wait complete. 2024-09-19T06:18:46.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.644+0000 7fd59aa3b740 20 client.16986 trim_cache size 0 max 16384 2024-09-19T06:18:46.650 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:18:46.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.644+0000 7fd597e00640 1 -- 172.21.15.3:0/4237963393 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd5780a33b0 msgr2=0x7fd5780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:46.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.644+0000 7fd597e00640 1 --2- 172.21.15.3:0/4237963393 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd5780a33b0 0x7fd5780a5870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x55d668269060 tx=0x7fd584005a20 comp rx=0 tx=0).stop 2024-09-19T06:18:46.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.644+0000 7fd597e00640 1 -- 172.21.15.3:0/4237963393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd590109120 msgr2=0x7fd59019eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:46.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.644+0000 7fd597e00640 1 --2- 172.21.15.3:0/4237963393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd590109120 0x7fd59019eeb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd588009fd0 tx=0x7fd58800ef10 comp rx=0 tx=0).stop 2024-09-19T06:18:46.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.645+0000 7fd597e00640 1 -- 172.21.15.3:0/4237963393 shutdown_connections 2024-09-19T06:18:46.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.645+0000 7fd597e00640 1 --2- 172.21.15.3:0/4237963393 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd5780a33b0 0x7fd5780a5870 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.645+0000 7fd597e00640 1 --2- 172.21.15.3:0/4237963393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd590109120 0x7fd59019eeb0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.645+0000 7fd597e00640 1 --2- 172.21.15.3:0/4237963393 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd5901049a0 0x7fd59019ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.645+0000 7fd597e00640 1 --2- 172.21.15.3:0/4237963393 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd590103ff0 0x7fd59019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:46.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.645+0000 7fd597e00640 1 -- 172.21.15.3:0/4237963393 >> 172.21.15.3:0/4237963393 conn(0x7fd5900ffa90 msgr2=0x7fd590100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:46.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.645+0000 7fd597e00640 1 -- 172.21.15.3:0/4237963393 shutdown_connections 2024-09-19T06:18:46.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:46.645+0000 7fd597e00640 1 -- 172.21.15.3:0/4237963393 wait complete. 2024-09-19T06:18:47.446 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:18:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.714+0000 7fe2de600640 1 -- 172.21.15.3:0/2251047929 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe2d8107940 msgr2=0x7fe2d8107d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.714+0000 7fe2de600640 1 --2- 172.21.15.3:0/2251047929 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe2d8107940 0x7fe2d8107d20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009930 tx=0x7fe2cc02a440 comp rx=0 tx=0).stop 2024-09-19T06:18:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.715+0000 7fe2de600640 1 -- 172.21.15.3:0/2251047929 shutdown_connections 2024-09-19T06:18:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.715+0000 7fe2de600640 1 --2- 172.21.15.3:0/2251047929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2d81022d0 0x7fe2d810e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.715+0000 7fe2de600640 1 --2- 172.21.15.3:0/2251047929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2d8101930 0x7fe2d8101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.715+0000 7fe2de600640 1 --2- 172.21.15.3:0/2251047929 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe2d8107940 0x7fe2d8107d20 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.717 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.715+0000 7fe2de600640 1 -- 172.21.15.3:0/2251047929 >> 172.21.15.3:0/2251047929 conn(0x7fe2d80fd630 msgr2=0x7fe2d80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:47.718 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.715+0000 7fe2de600640 1 -- 172.21.15.3:0/2251047929 shutdown_connections 2024-09-19T06:18:47.718 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.715+0000 7fe2de600640 1 -- 172.21.15.3:0/2251047929 wait complete. 2024-09-19T06:18:47.720 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.716+0000 7fe2de600640 1 Processor -- start 2024-09-19T06:18:47.720 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.716+0000 7fe2de600640 1 -- start start 2024-09-19T06:18:47.720 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.716+0000 7fe2de600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2d8101930 0x7fe2d8198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:47.720 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.716+0000 7fe2de600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2d81022d0 0x7fe2d8198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:47.720 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.716+0000 7fe2de600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe2d8107940 0x7fe2d819cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:47.720 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.716+0000 7fe2de600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d8111d50 con 0x7fe2d8107940 2024-09-19T06:18:47.720 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.716+0000 7fe2de600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d8111bd0 con 0x7fe2d81022d0 2024-09-19T06:18:47.720 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.716+0000 7fe2de600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d8111ed0 con 0x7fe2d8101930 2024-09-19T06:18:47.720 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.716+0000 7fe2dd200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2d8101930 0x7fe2d8198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:47.720 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.716+0000 7fe2dd200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2d8101930 0x7fe2d8198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:54772/0 (socket says 172.21.15.3:54772) 2024-09-19T06:18:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.716+0000 7fe2dd200640 1 -- 172.21.15.3:0/2388976905 learned_addr learned my addr 172.21.15.3:0/2388976905 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.716+0000 7fe2ddc00640 1 --2- 172.21.15.3:0/2388976905 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe2d8107940 0x7fe2d819cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.717+0000 7fe2d7e00640 1 --2- 172.21.15.3:0/2388976905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2d81022d0 0x7fe2d8198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.717+0000 7fe2dd200640 1 -- 172.21.15.3:0/2388976905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2d81022d0 msgr2=0x7fe2d8198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.717+0000 7fe2dd200640 1 --2- 172.21.15.3:0/2388976905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2d81022d0 0x7fe2d8198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.717+0000 7fe2dd200640 1 -- 172.21.15.3:0/2388976905 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe2d8107940 msgr2=0x7fe2d819cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.717+0000 7fe2dd200640 1 --2- 172.21.15.3:0/2388976905 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe2d8107940 0x7fe2d819cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.717+0000 7fe2dd200640 1 -- 172.21.15.3:0/2388976905 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d819d230 con 0x7fe2d8101930 2024-09-19T06:18:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.717+0000 7fe2dd200640 1 --2- 172.21.15.3:0/2388976905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2d8101930 0x7fe2d8198240 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009a50 tx=0x7fe2cc004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.718+0000 7fe2d5600640 1 -- 172.21.15.3:0/2388976905 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc03f030 con 0x7fe2d8101930 2024-09-19T06:18:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.718+0000 7fe2d5600640 1 -- 172.21.15.3:0/2388976905 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2cc003ad0 con 0x7fe2d8101930 2024-09-19T06:18:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.718+0000 7fe2d5600640 1 -- 172.21.15.3:0/2388976905 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc035070 con 0x7fe2d8101930 2024-09-19T06:18:47.721 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.718+0000 7fe2de600640 1 -- 172.21.15.3:0/2388976905 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2d819d4c0 con 0x7fe2d8101930 2024-09-19T06:18:47.722 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.718+0000 7fe2de600640 1 -- 172.21.15.3:0/2388976905 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2d81a4db0 con 0x7fe2d8101930 2024-09-19T06:18:47.723 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.721+0000 7fe2e29de740 1 Processor -- start 2024-09-19T06:18:47.723 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.721+0000 7fe2e29de740 1 -- start start 2024-09-19T06:18:47.723 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.721+0000 7fe2e29de740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b214a3b0 0x5612b214a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:47.723 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.721+0000 7fe2e29de740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612b214acd0 0x5612b2155030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:47.723 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.721+0000 7fe2e29de740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b2155570 0x5612b2157960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:47.723 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.721+0000 7fe2e29de740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5612b20b0100 con 0x5612b2155570 2024-09-19T06:18:47.723 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.721+0000 7fe2e29de740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5612b20581b0 con 0x5612b214a3b0 2024-09-19T06:18:47.723 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.721+0000 7fe2e29de740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5612b20ac0c0 con 0x5612b214acd0 2024-09-19T06:18:47.725 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.722+0000 7fe2ddc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b214a3b0 0x5612b214a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:47.725 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.722+0000 7fe2ddc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b214a3b0 0x5612b214a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:52540/0 (socket says 172.21.15.3:52540) 2024-09-19T06:18:47.725 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.722+0000 7fe2ddc00640 1 -- 172.21.15.3:0/1244118424 learned_addr learned my addr 172.21.15.3:0/1244118424 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:47.725 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.722+0000 7fe2d7e00640 1 --2- 172.21.15.3:0/1244118424 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b2155570 0x5612b2157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:47.725 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.722+0000 7fe2d7e00640 1 -- 172.21.15.3:0/1244118424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612b214acd0 msgr2=0x5612b2155030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:18:47.725 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.722+0000 7fe2d7e00640 1 --2- 172.21.15.3:0/1244118424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612b214acd0 0x5612b2155030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.725 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.722+0000 7fe2d7e00640 1 -- 172.21.15.3:0/1244118424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b214a3b0 msgr2=0x5612b214a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:47.725 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.722+0000 7fe2d7e00640 1 --2- 172.21.15.3:0/1244118424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b214a3b0 0x5612b214a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.726 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.722+0000 7fe2d7e00640 1 -- 172.21.15.3:0/1244118424 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612b1dc3210 con 0x5612b2155570 2024-09-19T06:18:47.726 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.722+0000 7fe2ddc00640 1 --2- 172.21.15.3:0/1244118424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b214a3b0 0x5612b214a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:47.726 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.722+0000 7fe2d7e00640 1 --2- 172.21.15.3:0/1244118424 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b2155570 0x5612b2157960 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400abc0 tx=0x7fe2c400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14fd38ac2532bce6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:47.726 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.722+0000 7fe2d5600640 1 -- 172.21.15.3:0/2388976905 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fe2cc042030 con 0x7fe2d8101930 2024-09-19T06:18:47.726 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.723+0000 7fe2ca000640 1 -- 172.21.15.3:0/1244118424 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4005220 con 0x5612b2155570 2024-09-19T06:18:47.726 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.723+0000 7fe2ca000640 1 -- 172.21.15.3:0/1244118424 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2c4004c80 con 0x5612b2155570 2024-09-19T06:18:47.726 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.723+0000 7fe2ca000640 1 -- 172.21.15.3:0/1244118424 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c40188e0 con 0x5612b2155570 2024-09-19T06:18:47.730 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.724+0000 7fe2e29de740 1 -- 172.21.15.3:0/1244118424 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b2155570 msgr2=0x5612b2157960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:47.730 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.724+0000 7fe2e29de740 1 --2- 172.21.15.3:0/1244118424 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b2155570 0x5612b2157960 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400abc0 tx=0x7fe2c400f790 comp rx=0 tx=0).stop 2024-09-19T06:18:47.730 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.724+0000 7fe2e29de740 1 -- 172.21.15.3:0/1244118424 shutdown_connections 2024-09-19T06:18:47.730 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.724+0000 7fe2e29de740 1 --2- 172.21.15.3:0/1244118424 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b2155570 0x5612b2157960 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.730 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.724+0000 7fe2e29de740 1 --2- 172.21.15.3:0/1244118424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612b214acd0 0x5612b2155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.730 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.724+0000 7fe2e29de740 1 --2- 172.21.15.3:0/1244118424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b214a3b0 0x5612b214a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.730 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.724+0000 7fe2e29de740 1 -- 172.21.15.3:0/1244118424 >> 172.21.15.3:0/1244118424 conn(0x5612b2146920 msgr2=0x5612b2146d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:47.730 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.724+0000 7fe2e29de740 1 -- 172.21.15.3:0/1244118424 shutdown_connections 2024-09-19T06:18:47.730 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.724+0000 7fe2e29de740 1 -- 172.21.15.3:0/1244118424 wait complete. 2024-09-19T06:18:47.730 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.724+0000 7fe2e29de740 1 -- start start 2024-09-19T06:18:47.730 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.725+0000 7fe2d5600640 1 --2- 172.21.15.3:0/2388976905 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe2c00a32b0 0x7fe2c00a5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:47.731 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.725+0000 7fe2e29de740 1 Processor -- start 2024-09-19T06:18:47.731 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.725+0000 7fe2d5600640 1 -- 172.21.15.3:0/2388976905 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fe2cc0f0430 con 0x7fe2d8101930 2024-09-19T06:18:47.731 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.725+0000 7fe2ddc00640 1 --2- 172.21.15.3:0/2388976905 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe2c00a32b0 0x7fe2c00a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:47.731 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.725+0000 7fe2e29de740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b214a3b0 0x5612b2152570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:47.731 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.725+0000 7fe2e29de740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b214acd0 0x5612b2152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:47.731 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.725+0000 7fe2e29de740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612b2155570 0x5612b2152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:47.731 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.725+0000 7fe2e29de740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5612b2158140 con 0x5612b214a3b0 2024-09-19T06:18:47.731 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.725+0000 7fe2e29de740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5612b2039090 con 0x5612b214acd0 2024-09-19T06:18:47.731 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.725+0000 7fe2e29de740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5612b21582c0 con 0x5612b2155570 2024-09-19T06:18:47.731 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.726+0000 7fe2e29de740 10 client.0 _ll_register_callbacks cb 0x5612b208df30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:47.731 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.726+0000 7fe2d7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b214acd0 0x5612b2152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:47.731 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.726+0000 7fe2dd200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b214a3b0 0x5612b2152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:47.731 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.726+0000 7fe2d7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b214acd0 0x5612b2152ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:52548/0 (socket says 172.21.15.3:52548) 2024-09-19T06:18:47.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.726+0000 7fe2d7e00640 1 -- 172.21.15.3:0/4096587482 learned_addr learned my addr 172.21.15.3:0/4096587482 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:47.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.726+0000 7fe2ddc00640 1 --2- 172.21.15.3:0/4096587482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612b2155570 0x5612b2152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:47.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.726+0000 7fe2ddc00640 1 --2- 172.21.15.3:0/2388976905 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe2c00a32b0 0x7fe2c00a5770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe2d000ae50 tx=0x7fe2d000a4d0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:47.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.726+0000 7fe2d7e00640 1 -- 172.21.15.3:0/4096587482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612b2155570 msgr2=0x5612b2152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:47.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.726+0000 7fe2d7e00640 1 --2- 172.21.15.3:0/4096587482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612b2155570 0x5612b2152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.726+0000 7fe2d7e00640 1 -- 172.21.15.3:0/4096587482 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b214a3b0 msgr2=0x5612b2152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:47.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.726+0000 7fe2d7e00640 1 --2- 172.21.15.3:0/4096587482 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b214a3b0 0x5612b2152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.726+0000 7fe2d7e00640 1 -- 172.21.15.3:0/4096587482 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612b1e8f620 con 0x5612b214acd0 2024-09-19T06:18:47.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.727+0000 7fe2d7e00640 1 --2- 172.21.15.3:0/4096587482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b214acd0 0x5612b2152ab0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe2c401a040 tx=0x7fe2c4004970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bebaafe2a9fad173 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:47.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.727+0000 7fe2bea00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:18:47.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.727+0000 7fe2bea00640 1 -- 172.21.15.3:0/4096587482 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4027070 con 0x5612b214acd0 2024-09-19T06:18:47.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.727+0000 7fe2bea00640 1 -- 172.21.15.3:0/4096587482 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fe2c4018790 con 0x5612b214acd0 2024-09-19T06:18:47.732 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.727+0000 7fe2e29de740 1 -- 172.21.15.3:0/4096587482 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2c4004c80 con 0x5612b214acd0 2024-09-19T06:18:47.733 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.727+0000 7fe2bea00640 1 -- 172.21.15.3:0/4096587482 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe2c4033050 con 0x5612b214acd0 2024-09-19T06:18:47.733 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.727+0000 7fe2e29de740 10 client.27038 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:47.733 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.727+0000 7fe2e29de740 1 -- 172.21.15.3:0/4096587482 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5612b2163eb0 con 0x5612b214acd0 2024-09-19T06:18:47.733 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.727+0000 7fe2bea00640 1 -- 172.21.15.3:0/4096587482 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2c4004c80 con 0x5612b214acd0 2024-09-19T06:18:47.733 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.728+0000 7fe2bea00640 1 -- 172.21.15.3:0/4096587482 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe2c4023430 con 0x5612b214acd0 2024-09-19T06:18:47.733 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.728+0000 7fe2e29de740 10 client.27038 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:47.733 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.728+0000 7fe2e29de740 10 client.27038 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:47.733 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.728+0000 7fe2e29de740 20 client.27038 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:47.733 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.728+0000 7fe2e29de740 1 --2- 172.21.15.3:0/4096587482 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5612b21652c0 0x5612b21676b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:47.733 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.728+0000 7fe2e29de740 4 client.27038 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:47.733 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.728+0000 7fe2e29de740 1 -- 172.21.15.3:0/4096587482 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612b20bd830 con 0x5612b21652c0 2024-09-19T06:18:47.733 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.728+0000 7fe2dd200640 1 --2- 172.21.15.3:0/4096587482 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5612b21652c0 0x5612b21676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:47.735 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.729+0000 7fe2dd200640 1 --2- 172.21.15.3:0/4096587482 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5612b21652c0 0x5612b21676b0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3214e363aa665bee server_cookie=a7e45a9a6293fc in_seq=0 out_seq=0 2024-09-19T06:18:47.735 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.729+0000 7fe2bea00640 10 client.27038 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:47.735 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.729+0000 7fe2bea00640 1 -- 172.21.15.3:0/4096587482 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5612b20bd830 con 0x5612b21652c0 2024-09-19T06:18:47.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.729+0000 7fe2bea00640 10 client.27038 handle_command_reply: tid=0 2024-09-19T06:18:47.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.729+0000 7fe2e29de740 1 client.27038 shutdown 2024-09-19T06:18:47.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.730+0000 7fe2e29de740 1 -- 172.21.15.3:0/4096587482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b214acd0 msgr2=0x5612b2152ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:47.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.730+0000 7fe2e29de740 1 --2- 172.21.15.3:0/4096587482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b214acd0 0x5612b2152ab0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe2c401a040 tx=0x7fe2c4004970 comp rx=0 tx=0).stop 2024-09-19T06:18:47.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.730+0000 7fe2e29de740 1 -- 172.21.15.3:0/4096587482 shutdown_connections 2024-09-19T06:18:47.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.730+0000 7fe2e29de740 1 --2- 172.21.15.3:0/4096587482 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5612b21652c0 0x5612b21676b0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.730+0000 7fe2e29de740 1 --2- 172.21.15.3:0/4096587482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612b2155570 0x5612b2152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.730+0000 7fe2e29de740 1 --2- 172.21.15.3:0/4096587482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b214acd0 0x5612b2152ab0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.730+0000 7fe2e29de740 1 --2- 172.21.15.3:0/4096587482 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b214a3b0 0x5612b2152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.730+0000 7fe2e29de740 1 -- 172.21.15.3:0/4096587482 >> 172.21.15.3:0/4096587482 conn(0x5612b2146920 msgr2=0x5612b214c630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:47.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.730+0000 7fe2bea00640 0 client.27038 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:47.736 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.730+0000 7fe2e29de740 1 -- 172.21.15.3:0/4096587482 shutdown_connections 2024-09-19T06:18:47.737 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.730+0000 7fe2e29de740 1 -- 172.21.15.3:0/4096587482 wait complete. 2024-09-19T06:18:47.737 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.730+0000 7fe2e29de740 20 client.27038 trim_cache size 0 max 16384 2024-09-19T06:18:47.748 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.745+0000 7fe2e29de740 1 Processor -- start 2024-09-19T06:18:47.748 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.745+0000 7fe2e29de740 1 -- start start 2024-09-19T06:18:47.748 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.745+0000 7fe2e29de740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b214a3b0 0x5612b214ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:47.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.746+0000 7fe2e29de740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612b214acd0 0x5612b21458b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:47.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.746+0000 7fe2e29de740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b2155570 0x5612b216cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:47.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.746+0000 7fe2e29de740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d81ab4d0 con 0x5612b214a3b0 2024-09-19T06:18:47.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.746+0000 7fe2e29de740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d81ad010 con 0x5612b2155570 2024-09-19T06:18:47.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.746+0000 7fe2e29de740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d81abba0 con 0x5612b214acd0 2024-09-19T06:18:47.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.746+0000 7fe2dd200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b214a3b0 0x5612b214ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:47.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.746+0000 7fe2dd200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b214a3b0 0x5612b214ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47096/0 (socket says 172.21.15.3:47096) 2024-09-19T06:18:47.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.746+0000 7fe2dd200640 1 -- 172.21.15.3:0/412117810 learned_addr learned my addr 172.21.15.3:0/412117810 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:47.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.746+0000 7fe2d7e00640 1 --2- 172.21.15.3:0/412117810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612b214acd0 0x5612b21458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:47.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.746+0000 7fe2ddc00640 1 --2- 172.21.15.3:0/412117810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b2155570 0x5612b216cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:47.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.746+0000 7fe2d7e00640 1 -- 172.21.15.3:0/412117810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b2155570 msgr2=0x5612b216cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:47.749 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.746+0000 7fe2d7e00640 1 --2- 172.21.15.3:0/412117810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b2155570 0x5612b216cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.750 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.746+0000 7fe2d7e00640 1 -- 172.21.15.3:0/412117810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b214a3b0 msgr2=0x5612b214ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:47.750 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.746+0000 7fe2d7e00640 1 --2- 172.21.15.3:0/412117810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b214a3b0 0x5612b214ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.750 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.746+0000 7fe2d7e00640 1 -- 172.21.15.3:0/412117810 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612b214a130 con 0x5612b214acd0 2024-09-19T06:18:47.750 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.746+0000 7fe2dd200640 1 --2- 172.21.15.3:0/412117810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b214a3b0 0x5612b214ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:47.750 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.746+0000 7fe2ddc00640 1 --2- 172.21.15.3:0/412117810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b2155570 0x5612b216cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:47.750 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.747+0000 7fe2d7e00640 1 --2- 172.21.15.3:0/412117810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612b214acd0 0x5612b21458b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe2c40239f0 tx=0x7fe2c400a2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82875d3fffdb05ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:47.753 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.747+0000 7fe2c9600640 1 -- 172.21.15.3:0/412117810 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4027070 con 0x5612b214acd0 2024-09-19T06:18:47.753 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.747+0000 7fe2c9600640 1 -- 172.21.15.3:0/412117810 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2c400a7e0 con 0x5612b214acd0 2024-09-19T06:18:47.753 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.747+0000 7fe2c9600640 1 -- 172.21.15.3:0/412117810 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4005380 con 0x5612b214acd0 2024-09-19T06:18:47.753 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.748+0000 7fe2e29de740 1 -- 172.21.15.3:0/412117810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612b214acd0 msgr2=0x5612b21458b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:47.753 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.748+0000 7fe2e29de740 1 --2- 172.21.15.3:0/412117810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612b214acd0 0x5612b21458b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe2c40239f0 tx=0x7fe2c400a2d0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.754 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.748+0000 7fe2e29de740 1 -- 172.21.15.3:0/412117810 shutdown_connections 2024-09-19T06:18:47.754 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.748+0000 7fe2e29de740 1 --2- 172.21.15.3:0/412117810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b2155570 0x5612b216cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.754 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.748+0000 7fe2e29de740 1 --2- 172.21.15.3:0/412117810 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612b214acd0 0x5612b21458b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.754 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.748+0000 7fe2e29de740 1 --2- 172.21.15.3:0/412117810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b214a3b0 0x5612b214ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.754 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.748+0000 7fe2e29de740 1 -- 172.21.15.3:0/412117810 >> 172.21.15.3:0/412117810 conn(0x5612b2146920 msgr2=0x5612b21451a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:47.754 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.748+0000 7fe2e29de740 1 -- 172.21.15.3:0/412117810 shutdown_connections 2024-09-19T06:18:47.754 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.748+0000 7fe2e29de740 1 -- 172.21.15.3:0/412117810 wait complete. 2024-09-19T06:18:47.754 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.748+0000 7fe2e29de740 1 -- start start 2024-09-19T06:18:47.754 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.748+0000 7fe2e29de740 1 Processor -- start 2024-09-19T06:18:47.754 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.749+0000 7fe2e29de740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612b214a3b0 0x5612b215d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:47.754 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.749+0000 7fe2e29de740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b214acd0 0x5612b215dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:47.754 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.749+0000 7fe2e29de740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b2155570 0x5612b214ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:47.754 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.749+0000 7fe2e29de740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d81ac940 con 0x5612b214acd0 2024-09-19T06:18:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.749+0000 7fe2e29de740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d81ac270 con 0x5612b2155570 2024-09-19T06:18:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.749+0000 7fe2e29de740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d81a94b0 con 0x5612b214a3b0 2024-09-19T06:18:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.749+0000 7fe2e29de740 10 client.0 _ll_register_callbacks cb 0x7fe2d000a830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.749+0000 7fe2d7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b214acd0 0x5612b215dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.749+0000 7fe2dd200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612b214a3b0 0x5612b215d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.749+0000 7fe2d7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b214acd0 0x5612b215dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47112/0 (socket says 172.21.15.3:47112) 2024-09-19T06:18:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.749+0000 7fe2ddc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b2155570 0x5612b214ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.749+0000 7fe2d7e00640 1 -- 172.21.15.3:0/62034309 learned_addr learned my addr 172.21.15.3:0/62034309 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.750+0000 7fe2d7e00640 1 -- 172.21.15.3:0/62034309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612b214a3b0 msgr2=0x5612b215d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.750+0000 7fe2d7e00640 1 --2- 172.21.15.3:0/62034309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612b214a3b0 0x5612b215d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.755 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.750+0000 7fe2d7e00640 1 -- 172.21.15.3:0/62034309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b2155570 msgr2=0x5612b214ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.750+0000 7fe2d7e00640 1 --2- 172.21.15.3:0/62034309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b2155570 0x5612b214ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.750+0000 7fe2d7e00640 1 -- 172.21.15.3:0/62034309 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612b214f730 con 0x5612b214acd0 2024-09-19T06:18:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.750+0000 7fe2d7e00640 1 --2- 172.21.15.3:0/62034309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b214acd0 0x5612b215dd30 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4023970 tx=0x7fe2c4005b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad55f19095778442 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.750+0000 7fe2bea00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:18:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.751+0000 7fe2bea00640 1 -- 172.21.15.3:0/62034309 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4027040 con 0x5612b214acd0 2024-09-19T06:18:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.751+0000 7fe2bea00640 1 -- 172.21.15.3:0/62034309 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7fe2c4004b70 con 0x5612b214acd0 2024-09-19T06:18:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.751+0000 7fe2e29de740 1 -- 172.21.15.3:0/62034309 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2c400a7e0 con 0x5612b214acd0 2024-09-19T06:18:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.751+0000 7fe2bea00640 1 -- 172.21.15.3:0/62034309 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe2c4004d70 con 0x5612b214acd0 2024-09-19T06:18:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.751+0000 7fe2e29de740 10 client.17004 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.751+0000 7fe2e29de740 1 -- 172.21.15.3:0/62034309 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5612b21cf7e0 con 0x5612b214acd0 2024-09-19T06:18:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.751+0000 7fe2bea00640 1 -- 172.21.15.3:0/62034309 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2c400a7e0 con 0x5612b214acd0 2024-09-19T06:18:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.751+0000 7fe2bea00640 1 -- 172.21.15.3:0/62034309 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe2c4018bd0 con 0x5612b214acd0 2024-09-19T06:18:47.756 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.751+0000 7fe2e29de740 10 client.17004 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.752+0000 7fe2e29de740 10 client.17004 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.752+0000 7fe2e29de740 20 client.17004 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.752+0000 7fe2e29de740 1 --2- 172.21.15.3:0/62034309 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5612b21cfe90 0x5612b21d22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.752+0000 7fe2e29de740 4 client.17004 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:18:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.752+0000 7fe2e29de740 1 -- 172.21.15.3:0/62034309 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5612b20b7b80 con 0x5612b21cfe90 2024-09-19T06:18:47.757 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.752+0000 7fe2dd200640 1 --2- 172.21.15.3:0/62034309 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5612b21cfe90 0x5612b21d22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:47.758 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.752+0000 7fe2dd200640 1 --2- 172.21.15.3:0/62034309 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5612b21cfe90 0x5612b21d22b0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd89a2acb80b6336 server_cookie=7b4375b8a6bf7929 in_seq=0 out_seq=0 2024-09-19T06:18:47.758 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.752+0000 7fe2bea00640 10 client.17004 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.766+0000 7fe2bea00640 1 -- 172.21.15.3:0/62034309 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5612b20b7b80 con 0x5612b21cfe90 2024-09-19T06:18:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.766+0000 7fe2bea00640 10 client.17004 handle_command_reply: tid=0 2024-09-19T06:18:47.768 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.766+0000 7fe2e29de740 1 client.17004 shutdown 2024-09-19T06:18:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.766+0000 7fe2e29de740 1 -- 172.21.15.3:0/62034309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b214acd0 msgr2=0x5612b215dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.766+0000 7fe2e29de740 1 --2- 172.21.15.3:0/62034309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b214acd0 0x5612b215dd30 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4023970 tx=0x7fe2c4005b80 comp rx=0 tx=0).stop 2024-09-19T06:18:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.766+0000 7fe2e29de740 1 -- 172.21.15.3:0/62034309 shutdown_connections 2024-09-19T06:18:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.766+0000 7fe2e29de740 1 --2- 172.21.15.3:0/62034309 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5612b21cfe90 0x5612b21d22b0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.766+0000 7fe2e29de740 1 --2- 172.21.15.3:0/62034309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5612b2155570 0x5612b214ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.766+0000 7fe2e29de740 1 --2- 172.21.15.3:0/62034309 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5612b214acd0 0x5612b215dd30 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.766+0000 7fe2bea00640 0 client.17004 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.766+0000 7fe2e29de740 1 --2- 172.21.15.3:0/62034309 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5612b214a3b0 0x5612b215d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.766+0000 7fe2e29de740 1 -- 172.21.15.3:0/62034309 >> 172.21.15.3:0/62034309 conn(0x5612b2146920 msgr2=0x5612b21459c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.766+0000 7fe2e29de740 1 -- 172.21.15.3:0/62034309 shutdown_connections 2024-09-19T06:18:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.767+0000 7fe2e29de740 1 -- 172.21.15.3:0/62034309 wait complete. 2024-09-19T06:18:47.769 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.767+0000 7fe2e29de740 20 client.17004 trim_cache size 0 max 16384 2024-09-19T06:18:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:18:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:18:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:18:47.770 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:18:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.767+0000 7fe2de600640 1 -- 172.21.15.3:0/2388976905 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe2c00a32b0 msgr2=0x7fe2c00a5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.767+0000 7fe2de600640 1 --2- 172.21.15.3:0/2388976905 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe2c00a32b0 0x7fe2c00a5770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe2d000ae50 tx=0x7fe2d000a4d0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.767+0000 7fe2de600640 1 -- 172.21.15.3:0/2388976905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2d8101930 msgr2=0x7fe2d8198240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.767+0000 7fe2de600640 1 --2- 172.21.15.3:0/2388976905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2d8101930 0x7fe2d8198240 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009a50 tx=0x7fe2cc004270 comp rx=0 tx=0).stop 2024-09-19T06:18:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.768+0000 7fe2de600640 1 -- 172.21.15.3:0/2388976905 shutdown_connections 2024-09-19T06:18:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.768+0000 7fe2de600640 1 --2- 172.21.15.3:0/2388976905 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe2c00a32b0 0x7fe2c00a5770 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.768+0000 7fe2de600640 1 --2- 172.21.15.3:0/2388976905 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe2d8107940 0x7fe2d819cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.768+0000 7fe2de600640 1 --2- 172.21.15.3:0/2388976905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2d81022d0 0x7fe2d8198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.768+0000 7fe2de600640 1 --2- 172.21.15.3:0/2388976905 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe2d8101930 0x7fe2d8198240 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.768+0000 7fe2de600640 1 -- 172.21.15.3:0/2388976905 >> 172.21.15.3:0/2388976905 conn(0x7fe2d80fd630 msgr2=0x7fe2d80fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.768+0000 7fe2de600640 1 -- 172.21.15.3:0/2388976905 shutdown_connections 2024-09-19T06:18:47.771 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:18:47.768+0000 7fe2de600640 1 -- 172.21.15.3:0/2388976905 wait complete. 2024-09-19T06:18:47.840 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:47.980 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:47 smithi003 ceph-mon[30893]: pgmap v195: 97 pgs: 97 active+clean; 2.1 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 17 op/s 2024-09-19T06:18:48.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:47 smithi059 ceph-mon[35138]: pgmap v195: 97 pgs: 97 active+clean; 2.1 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 17 op/s 2024-09-19T06:18:48.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:47 smithi071 ceph-mon[35662]: pgmap v195: 97 pgs: 97 active+clean; 2.1 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 17 op/s 2024-09-19T06:18:48.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.415+0000 7f2eaaa00640 1 -- 172.21.15.3:0/128112401 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2ea4077040 msgr2=0x7f2ea41124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:48.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.415+0000 7f2eaaa00640 1 --2- 172.21.15.3:0/128112401 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2ea4077040 0x7f2ea41124f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009900 tx=0x7f2e9002a400 comp rx=0 tx=0).stop 2024-09-19T06:18:48.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.415+0000 7f2eaaa00640 1 -- 172.21.15.3:0/128112401 shutdown_connections 2024-09-19T06:18:48.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.415+0000 7f2eaaa00640 1 --2- 172.21.15.3:0/128112401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ea4112a30 0x7f2ea4114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.415+0000 7f2eaaa00640 1 --2- 172.21.15.3:0/128112401 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2ea4077040 0x7f2ea41124f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.415+0000 7f2eaaa00640 1 --2- 172.21.15.3:0/128112401 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ea4076720 0x7f2ea4076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.415+0000 7f2eaaa00640 1 -- 172.21.15.3:0/128112401 >> 172.21.15.3:0/128112401 conn(0x7f2ea40ffa90 msgr2=0x7f2ea4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:48.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.416+0000 7f2eaaa00640 1 -- 172.21.15.3:0/128112401 shutdown_connections 2024-09-19T06:18:48.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.416+0000 7f2eaaa00640 1 -- 172.21.15.3:0/128112401 wait complete. 2024-09-19T06:18:48.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.416+0000 7f2eaaa00640 1 Processor -- start 2024-09-19T06:18:48.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.417+0000 7f2eaaa00640 1 -- start start 2024-09-19T06:18:48.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.417+0000 7f2eaaa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ea4076720 0x7f2ea41a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:48.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.417+0000 7f2eaaa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ea4077040 0x7f2ea41a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:48.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.417+0000 7f2eaaa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2ea4112a30 0x7f2ea419e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:48.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.417+0000 7f2eaaa00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea41185f0 con 0x7f2ea4112a30 2024-09-19T06:18:48.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.417+0000 7f2eaaa00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea4118470 con 0x7f2ea4077040 2024-09-19T06:18:48.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.417+0000 7f2eaaa00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea4118770 con 0x7f2ea4076720 2024-09-19T06:18:48.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.417+0000 7f2ea8a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2ea4112a30 0x7f2ea419e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:48.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.417+0000 7f2ea3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ea4076720 0x7f2ea41a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:48.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.417+0000 7f2ea8a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2ea4112a30 0x7f2ea419e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47136/0 (socket says 172.21.15.3:47136) 2024-09-19T06:18:48.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.417+0000 7f2ea8a00640 1 -- 172.21.15.3:0/2602567892 learned_addr learned my addr 172.21.15.3:0/2602567892 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:48.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.417+0000 7f2ea3400640 1 --2- 172.21.15.3:0/2602567892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ea4077040 0x7f2ea41a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:48.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.418+0000 7f2ea3e00640 1 -- 172.21.15.3:0/2602567892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ea4077040 msgr2=0x7f2ea41a4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:48.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.418+0000 7f2ea3e00640 1 --2- 172.21.15.3:0/2602567892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ea4077040 0x7f2ea41a4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.418+0000 7f2ea3e00640 1 -- 172.21.15.3:0/2602567892 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2ea4112a30 msgr2=0x7f2ea419e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:48.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.418+0000 7f2ea3e00640 1 --2- 172.21.15.3:0/2602567892 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2ea4112a30 0x7f2ea419e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.418+0000 7f2ea3e00640 1 -- 172.21.15.3:0/2602567892 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea419f010 con 0x7f2ea4076720 2024-09-19T06:18:48.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.418+0000 7f2ea3e00640 1 --2- 172.21.15.3:0/2602567892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ea4076720 0x7f2ea41a4720 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2e9400d6d0 tx=0x7f2e9400db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:48.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.418+0000 7f2ea0c00640 1 -- 172.21.15.3:0/2602567892 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e94017070 con 0x7f2ea4076720 2024-09-19T06:18:48.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.418+0000 7f2ea0c00640 1 -- 172.21.15.3:0/2602567892 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e94009820 con 0x7f2ea4076720 2024-09-19T06:18:48.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.418+0000 7f2eaaa00640 1 -- 172.21.15.3:0/2602567892 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea419f300 con 0x7f2ea4076720 2024-09-19T06:18:48.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.418+0000 7f2ea0c00640 1 -- 172.21.15.3:0/2602567892 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e94004d00 con 0x7f2ea4076720 2024-09-19T06:18:48.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.419+0000 7f2eaaa00640 1 -- 172.21.15.3:0/2602567892 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea41ab5f0 con 0x7f2ea4076720 2024-09-19T06:18:48.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.422+0000 7f2ead3d2740 1 Processor -- start 2024-09-19T06:18:48.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.422+0000 7f2ead3d2740 1 -- start start 2024-09-19T06:18:48.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.422+0000 7f2ea0c00640 1 -- 172.21.15.3:0/2602567892 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f2e940099d0 con 0x7f2ea4076720 2024-09-19T06:18:48.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.422+0000 7f2ead3d2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c61ec70 0x56465c61f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:48.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.422+0000 7f2ead3d2740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56465c61f590 0x56465c629910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:48.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.422+0000 7f2ead3d2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c629e50 0x56465c62c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:48.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.422+0000 7f2ead3d2740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56465c5853e0 con 0x56465c61f590 2024-09-19T06:18:48.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.422+0000 7f2ead3d2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56465c52cd80 con 0x56465c629e50 2024-09-19T06:18:48.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.422+0000 7f2ead3d2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56465c5813a0 con 0x56465c61ec70 2024-09-19T06:18:48.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.423+0000 7f2ea3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56465c61f590 0x56465c629910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:48.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.423+0000 7f2ea3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c629e50 0x56465c62c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:48.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.423+0000 7f2ea3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c629e50 0x56465c62c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:52598/0 (socket says 172.21.15.3:52598) 2024-09-19T06:18:48.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.423+0000 7f2ea3400640 1 -- 172.21.15.3:0/112813877 learned_addr learned my addr 172.21.15.3:0/112813877 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:48.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.423+0000 7f2ea8a00640 1 --2- 172.21.15.3:0/112813877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c61ec70 0x56465c61f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:48.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.423+0000 7f2ea3400640 1 -- 172.21.15.3:0/112813877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c61ec70 msgr2=0x56465c61f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:48.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.423+0000 7f2ea3400640 1 --2- 172.21.15.3:0/112813877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c61ec70 0x56465c61f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.423+0000 7f2ea3400640 1 -- 172.21.15.3:0/112813877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56465c61f590 msgr2=0x56465c629910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:48.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.423+0000 7f2ea3400640 1 --2- 172.21.15.3:0/112813877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56465c61f590 0x56465c629910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.423+0000 7f2ea3400640 1 -- 172.21.15.3:0/112813877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56465c54bae0 con 0x56465c629e50 2024-09-19T06:18:48.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.423+0000 7f2ea3400640 1 --2- 172.21.15.3:0/112813877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c629e50 0x56465c62c240 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009900 tx=0x7f2e90004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50855cfb852434b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:48.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.424+0000 7f2e99200640 1 -- 172.21.15.3:0/112813877 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90035040 con 0x56465c629e50 2024-09-19T06:18:48.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.424+0000 7f2e99200640 1 -- 172.21.15.3:0/112813877 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e90005520 con 0x56465c629e50 2024-09-19T06:18:48.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.424+0000 7f2e99200640 1 -- 172.21.15.3:0/112813877 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90003850 con 0x56465c629e50 2024-09-19T06:18:48.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.424+0000 7f2ea0c00640 1 --2- 172.21.15.3:0/2602567892 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2e880a33b0 0x7f2e880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:48.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.424+0000 7f2ea0c00640 1 -- 172.21.15.3:0/2602567892 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f2e940cf8a0 con 0x7f2ea4076720 2024-09-19T06:18:48.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.424+0000 7f2ea8a00640 1 --2- 172.21.15.3:0/2602567892 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2e880a33b0 0x7f2e880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:48.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.424+0000 7f2ead3d2740 1 -- 172.21.15.3:0/112813877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c629e50 msgr2=0x56465c62c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:48.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.424+0000 7f2ead3d2740 1 --2- 172.21.15.3:0/112813877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c629e50 0x56465c62c240 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009900 tx=0x7f2e90004040 comp rx=0 tx=0).stop 2024-09-19T06:18:48.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.425+0000 7f2ead3d2740 1 -- 172.21.15.3:0/112813877 shutdown_connections 2024-09-19T06:18:48.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.425+0000 7f2ead3d2740 1 --2- 172.21.15.3:0/112813877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c629e50 0x56465c62c240 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.425+0000 7f2ead3d2740 1 --2- 172.21.15.3:0/112813877 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56465c61f590 0x56465c629910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.425+0000 7f2ead3d2740 1 --2- 172.21.15.3:0/112813877 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c61ec70 0x56465c61f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.425+0000 7f2ead3d2740 1 -- 172.21.15.3:0/112813877 >> 172.21.15.3:0/112813877 conn(0x56465c61b200 msgr2=0x56465c61b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:48.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.425+0000 7f2ead3d2740 1 -- 172.21.15.3:0/112813877 shutdown_connections 2024-09-19T06:18:48.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.425+0000 7f2ea8a00640 1 --2- 172.21.15.3:0/2602567892 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2e880a33b0 0x7f2e880a5870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c005f40 tx=0x7f2e9c009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:48.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.425+0000 7f2ead3d2740 1 -- 172.21.15.3:0/112813877 wait complete. 2024-09-19T06:18:48.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.425+0000 7f2ead3d2740 1 -- start start 2024-09-19T06:18:48.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.426+0000 7f2ead3d2740 1 Processor -- start 2024-09-19T06:18:48.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.426+0000 7f2ead3d2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c61ec70 0x56465c626d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:48.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.426+0000 7f2ead3d2740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56465c61f590 0x56465c627270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:48.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.426+0000 7f2ead3d2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c629e50 0x56465c6277b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:48.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.426+0000 7f2ead3d2740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56465c62ca20 con 0x56465c61f590 2024-09-19T06:18:48.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.426+0000 7f2ead3d2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56465c5400f0 con 0x56465c61ec70 2024-09-19T06:18:48.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.426+0000 7f2ead3d2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56465c62cba0 con 0x56465c629e50 2024-09-19T06:18:48.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.426+0000 7f2ead3d2740 10 client.0 _ll_register_callbacks cb 0x56465c527bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:48.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.426+0000 7f2ea3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56465c61f590 0x56465c627270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:48.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.426+0000 7f2ea8a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c629e50 0x56465c6277b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:48.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.426+0000 7f2ea3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56465c61f590 0x56465c627270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47154/0 (socket says 172.21.15.3:47154) 2024-09-19T06:18:48.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.426+0000 7f2ea3400640 1 -- 172.21.15.3:0/2411732643 learned_addr learned my addr 172.21.15.3:0/2411732643 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:48.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.426+0000 7f2ea3e00640 1 --2- 172.21.15.3:0/2411732643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c61ec70 0x56465c626d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:48.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.427+0000 7f2ea8a00640 1 -- 172.21.15.3:0/2411732643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c61ec70 msgr2=0x56465c626d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:48.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.427+0000 7f2ea8a00640 1 --2- 172.21.15.3:0/2411732643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c61ec70 0x56465c626d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.427+0000 7f2ea8a00640 1 -- 172.21.15.3:0/2411732643 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56465c61f590 msgr2=0x56465c627270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:48.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.427+0000 7f2ea8a00640 1 --2- 172.21.15.3:0/2411732643 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56465c61f590 0x56465c627270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.427+0000 7f2ea8a00640 1 -- 172.21.15.3:0/2411732643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56465c2f63c0 con 0x56465c629e50 2024-09-19T06:18:48.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.427+0000 7f2ea3400640 1 --2- 172.21.15.3:0/2411732643 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56465c61f590 0x56465c627270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:48.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.427+0000 7f2ea8a00640 1 --2- 172.21.15.3:0/2411732643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c629e50 0x56465c6277b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c003f40 tx=0x7f2e9c004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6799faedbe12be4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:48.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.427+0000 7f2e8d600640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:18:48.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.427+0000 7f2e8d600640 1 -- 172.21.15.3:0/2411732643 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c00f8f0 con 0x56465c629e50 2024-09-19T06:18:48.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.427+0000 7f2ead3d2740 1 -- 172.21.15.3:0/2411732643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e90005520 con 0x56465c629e50 2024-09-19T06:18:48.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.427+0000 7f2e8d600640 1 -- 172.21.15.3:0/2411732643 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f2e9c00fa90 con 0x56465c629e50 2024-09-19T06:18:48.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.428+0000 7f2e8d600640 1 -- 172.21.15.3:0/2411732643 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2e9c00fc90 con 0x56465c629e50 2024-09-19T06:18:48.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.428+0000 7f2ead3d2740 10 client.27058 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:48.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.428+0000 7f2ead3d2740 1 -- 172.21.15.3:0/2411732643 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56465c638ac0 con 0x56465c629e50 2024-09-19T06:18:48.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.428+0000 7f2e8d600640 1 -- 172.21.15.3:0/2411732643 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e90005520 con 0x56465c629e50 2024-09-19T06:18:48.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.429+0000 7f2e8d600640 1 -- 172.21.15.3:0/2411732643 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2e9c026020 con 0x56465c629e50 2024-09-19T06:18:48.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.429+0000 7f2ead3d2740 10 client.27058 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:48.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.429+0000 7f2ead3d2740 10 client.27058 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:18:48.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.429+0000 7f2ead3d2740 20 client.27058 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:48.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.429+0000 7f2ead3d2740 1 --2- 172.21.15.3:0/2411732643 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x56465c639f40 0x56465c63c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:48.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.429+0000 7f2ead3d2740 4 client.27058 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:48.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.429+0000 7f2ead3d2740 1 -- 172.21.15.3:0/2411732643 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56465c592950 con 0x56465c639f40 2024-09-19T06:18:48.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.429+0000 7f2ea3e00640 1 --2- 172.21.15.3:0/2411732643 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x56465c639f40 0x56465c63c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:48.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.430+0000 7f2ea3e00640 1 --2- 172.21.15.3:0/2411732643 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x56465c639f40 0x56465c63c3e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=18ecbc9b58f272ab server_cookie=bcf5529fa8349144 in_seq=0 out_seq=0 2024-09-19T06:18:48.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.430+0000 7f2e8d600640 10 client.27058 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:18:48.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.430+0000 7f2e8d600640 1 -- 172.21.15.3:0/2411732643 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56465c592950 con 0x56465c639f40 2024-09-19T06:18:48.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.430+0000 7f2e8d600640 10 client.27058 handle_command_reply: tid=0 2024-09-19T06:18:48.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.430+0000 7f2ead3d2740 1 client.27058 shutdown 2024-09-19T06:18:48.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.431+0000 7f2ead3d2740 1 -- 172.21.15.3:0/2411732643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c629e50 msgr2=0x56465c6277b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:48.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.431+0000 7f2ead3d2740 1 --2- 172.21.15.3:0/2411732643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c629e50 0x56465c6277b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c003f40 tx=0x7f2e9c004ab0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.431+0000 7f2ead3d2740 1 -- 172.21.15.3:0/2411732643 shutdown_connections 2024-09-19T06:18:48.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.431+0000 7f2ead3d2740 1 --2- 172.21.15.3:0/2411732643 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x56465c639f40 0x56465c63c3e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.431+0000 7f2ead3d2740 1 --2- 172.21.15.3:0/2411732643 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c629e50 0x56465c6277b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.431+0000 7f2ead3d2740 1 --2- 172.21.15.3:0/2411732643 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56465c61f590 0x56465c627270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.431+0000 7f2e8d600640 0 client.27058 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:18:48.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.431+0000 7f2ead3d2740 1 --2- 172.21.15.3:0/2411732643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c61ec70 0x56465c626d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.431+0000 7f2ead3d2740 1 -- 172.21.15.3:0/2411732643 >> 172.21.15.3:0/2411732643 conn(0x56465c61b200 msgr2=0x56465c620f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:48.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.431+0000 7f2ead3d2740 1 -- 172.21.15.3:0/2411732643 shutdown_connections 2024-09-19T06:18:48.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.431+0000 7f2ead3d2740 1 -- 172.21.15.3:0/2411732643 wait complete. 2024-09-19T06:18:48.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.431+0000 7f2ead3d2740 20 client.27058 trim_cache size 0 max 16384 2024-09-19T06:18:48.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.445+0000 7f2ead3d2740 1 Processor -- start 2024-09-19T06:18:48.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.445+0000 7f2ead3d2740 1 -- start start 2024-09-19T06:18:48.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.445+0000 7f2ead3d2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c61ec70 0x56465c620e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:48.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.445+0000 7f2ead3d2740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56465c61f590 0x56465c641d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:48.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.445+0000 7f2ead3d2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c629e50 0x56465c642240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:48.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.445+0000 7f2ead3d2740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea41b3fc0 con 0x56465c61f590 2024-09-19T06:18:48.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.445+0000 7f2ead3d2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea41b5b00 con 0x56465c629e50 2024-09-19T06:18:48.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.445+0000 7f2ead3d2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea41b4690 con 0x56465c61ec70 2024-09-19T06:18:48.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.446+0000 7f2ea3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c61ec70 0x56465c620e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:48.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.446+0000 7f2ea8a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c629e50 0x56465c642240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:48.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.446+0000 7f2ea3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56465c61f590 0x56465c641d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:48.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.446+0000 7f2ea3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c61ec70 0x56465c620e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:54862/0 (socket says 172.21.15.3:54862) 2024-09-19T06:18:48.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.446+0000 7f2ea3e00640 1 -- 172.21.15.3:0/3211514731 learned_addr learned my addr 172.21.15.3:0/3211514731 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:48.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.446+0000 7f2ea8a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c629e50 0x56465c642240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:52616/0 (socket says 172.21.15.3:52616) 2024-09-19T06:18:48.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.446+0000 7f2ea8a00640 1 -- 172.21.15.3:0/3211514731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c61ec70 msgr2=0x56465c620e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:48.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.446+0000 7f2ea8a00640 1 --2- 172.21.15.3:0/3211514731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c61ec70 0x56465c620e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.446+0000 7f2ea8a00640 1 -- 172.21.15.3:0/3211514731 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56465c61f590 msgr2=0x56465c641d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:48.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.446+0000 7f2ea8a00640 1 --2- 172.21.15.3:0/3211514731 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56465c61f590 0x56465c641d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.446+0000 7f2ea8a00640 1 -- 172.21.15.3:0/3211514731 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56465c61eaa0 con 0x56465c629e50 2024-09-19T06:18:48.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.446+0000 7f2ea3e00640 1 --2- 172.21.15.3:0/3211514731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c61ec70 0x56465c620e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:48.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.446+0000 7f2ea3400640 1 --2- 172.21.15.3:0/3211514731 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56465c61f590 0x56465c641d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:48.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.446+0000 7f2ea8a00640 1 --2- 172.21.15.3:0/3211514731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c629e50 0x56465c642240 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c000f80 tx=0x7f2e9c011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49a5499f5e7538bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:48.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.447+0000 7f2e8fe00640 1 -- 172.21.15.3:0/3211514731 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c00fe30 con 0x56465c629e50 2024-09-19T06:18:48.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.447+0000 7f2e8fe00640 1 -- 172.21.15.3:0/3211514731 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e9c036070 con 0x56465c629e50 2024-09-19T06:18:48.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.447+0000 7f2e8fe00640 1 -- 172.21.15.3:0/3211514731 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c028bb0 con 0x56465c629e50 2024-09-19T06:18:48.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.447+0000 7f2ead3d2740 1 -- 172.21.15.3:0/3211514731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c629e50 msgr2=0x56465c642240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:48.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.447+0000 7f2ead3d2740 1 --2- 172.21.15.3:0/3211514731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c629e50 0x56465c642240 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c000f80 tx=0x7f2e9c011440 comp rx=0 tx=0).stop 2024-09-19T06:18:48.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.447+0000 7f2ead3d2740 1 -- 172.21.15.3:0/3211514731 shutdown_connections 2024-09-19T06:18:48.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.447+0000 7f2ead3d2740 1 --2- 172.21.15.3:0/3211514731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c629e50 0x56465c642240 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.447+0000 7f2ead3d2740 1 --2- 172.21.15.3:0/3211514731 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56465c61f590 0x56465c641d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.447+0000 7f2ead3d2740 1 --2- 172.21.15.3:0/3211514731 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c61ec70 0x56465c620e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.447+0000 7f2ead3d2740 1 -- 172.21.15.3:0/3211514731 >> 172.21.15.3:0/3211514731 conn(0x56465c61b200 msgr2=0x56465c620710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:48.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.447+0000 7f2ead3d2740 1 -- 172.21.15.3:0/3211514731 shutdown_connections 2024-09-19T06:18:48.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.447+0000 7f2ead3d2740 1 -- 172.21.15.3:0/3211514731 wait complete. 2024-09-19T06:18:48.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.448+0000 7f2ead3d2740 1 -- start start 2024-09-19T06:18:48.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.448+0000 7f2ead3d2740 1 Processor -- start 2024-09-19T06:18:48.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.448+0000 7f2ead3d2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c61ec70 0x56465c62dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:48.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.448+0000 7f2ead3d2740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56465c61f590 0x56465c62e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:48.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.448+0000 7f2ead3d2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c629e50 0x56465c62e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:48.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.448+0000 7f2ead3d2740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea41b5430 con 0x56465c61f590 2024-09-19T06:18:48.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.448+0000 7f2ead3d2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea41b4d60 con 0x56465c629e50 2024-09-19T06:18:48.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.448+0000 7f2ead3d2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea41b1fa0 con 0x56465c61ec70 2024-09-19T06:18:48.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.448+0000 7f2ead3d2740 10 client.0 _ll_register_callbacks cb 0x7f2e9c009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:48.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.449+0000 7f2ea3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56465c61f590 0x56465c62e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:48.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.449+0000 7f2ea3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c61ec70 0x56465c62dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:48.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.449+0000 7f2ea3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56465c61f590 0x56465c62e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47160/0 (socket says 172.21.15.3:47160) 2024-09-19T06:18:48.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.449+0000 7f2ea3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c61ec70 0x56465c62dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:54874/0 (socket says 172.21.15.3:54874) 2024-09-19T06:18:48.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.449+0000 7f2ea3400640 1 -- 172.21.15.3:0/3211126377 learned_addr learned my addr 172.21.15.3:0/3211126377 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:48.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.449+0000 7f2ea8a00640 1 --2- 172.21.15.3:0/3211126377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c629e50 0x56465c62e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:48.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.449+0000 7f2ea8a00640 1 -- 172.21.15.3:0/3211126377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c61ec70 msgr2=0x56465c62dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:48.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.449+0000 7f2ea8a00640 1 --2- 172.21.15.3:0/3211126377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c61ec70 0x56465c62dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.449+0000 7f2ea8a00640 1 -- 172.21.15.3:0/3211126377 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56465c61f590 msgr2=0x56465c62e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:48.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.449+0000 7f2ea8a00640 1 --2- 172.21.15.3:0/3211126377 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56465c61f590 0x56465c62e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.449+0000 7f2ea8a00640 1 -- 172.21.15.3:0/3211126377 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56465c616770 con 0x56465c629e50 2024-09-19T06:18:48.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.449+0000 7f2ea3e00640 1 --2- 172.21.15.3:0/3211126377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c61ec70 0x56465c62dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:48.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.450+0000 7f2ea8a00640 1 --2- 172.21.15.3:0/3211126377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c629e50 0x56465c62e640 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c000f80 tx=0x7f2e9c004d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=720c10a8240485ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:48.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.450+0000 7f2e8d600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:18:48.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.450+0000 7f2e8d600640 1 -- 172.21.15.3:0/3211126377 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c03e070 con 0x56465c629e50 2024-09-19T06:18:48.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.450+0000 7f2e8d600640 1 -- 172.21.15.3:0/3211126377 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f2e9c028b20 con 0x56465c629e50 2024-09-19T06:18:48.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.450+0000 7f2ead3d2740 1 -- 172.21.15.3:0/3211126377 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e9c036070 con 0x56465c629e50 2024-09-19T06:18:48.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.450+0000 7f2e8d600640 1 -- 172.21.15.3:0/3211126377 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2e9c00fe30 con 0x56465c629e50 2024-09-19T06:18:48.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.450+0000 7f2ead3d2740 10 client.27062 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:48.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.450+0000 7f2ead3d2740 1 -- 172.21.15.3:0/3211126377 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56465c6a4df0 con 0x56465c629e50 2024-09-19T06:18:48.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.450+0000 7f2e8d600640 1 -- 172.21.15.3:0/3211126377 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e9c036070 con 0x56465c629e50 2024-09-19T06:18:48.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.451+0000 7f2e8d600640 1 -- 172.21.15.3:0/3211126377 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2e9c026070 con 0x56465c629e50 2024-09-19T06:18:48.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.451+0000 7f2ead3d2740 10 client.27062 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:48.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.451+0000 7f2ead3d2740 10 client.27062 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:18:48.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.451+0000 7f2ead3d2740 20 client.27062 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:48.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.451+0000 7f2ead3d2740 1 --2- 172.21.15.3:0/3211126377 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x56465c6a53a0 0x56465c6a77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:48.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.451+0000 7f2ead3d2740 4 client.27062 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:18:48.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.451+0000 7f2ead3d2740 1 -- 172.21.15.3:0/3211126377 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56465c58ce60 con 0x56465c6a53a0 2024-09-19T06:18:48.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.451+0000 7f2ea3e00640 1 --2- 172.21.15.3:0/3211126377 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x56465c6a53a0 0x56465c6a77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:48.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.452+0000 7f2ea3e00640 1 --2- 172.21.15.3:0/3211126377 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x56465c6a53a0 0x56465c6a77c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b783a33568945765 server_cookie=a17c60e15389d6df in_seq=0 out_seq=0 2024-09-19T06:18:48.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.452+0000 7f2e8d600640 10 client.27062 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:18:48.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.452+0000 7f2e8d600640 1 -- 172.21.15.3:0/3211126377 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56465c58ce60 con 0x56465c6a53a0 2024-09-19T06:18:48.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.452+0000 7f2e8d600640 10 client.27062 handle_command_reply: tid=0 2024-09-19T06:18:48.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.452+0000 7f2ead3d2740 1 client.27062 shutdown 2024-09-19T06:18:48.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.452+0000 7f2ead3d2740 1 -- 172.21.15.3:0/3211126377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c629e50 msgr2=0x56465c62e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:48.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.452+0000 7f2ead3d2740 1 --2- 172.21.15.3:0/3211126377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c629e50 0x56465c62e640 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c000f80 tx=0x7f2e9c004d40 comp rx=0 tx=0).stop 2024-09-19T06:18:48.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.452+0000 7f2ead3d2740 1 -- 172.21.15.3:0/3211126377 shutdown_connections 2024-09-19T06:18:48.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.452+0000 7f2ead3d2740 1 --2- 172.21.15.3:0/3211126377 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x56465c6a53a0 0x56465c6a77c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.452+0000 7f2ead3d2740 1 --2- 172.21.15.3:0/3211126377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56465c629e50 0x56465c62e640 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.452+0000 7f2ead3d2740 1 --2- 172.21.15.3:0/3211126377 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56465c61f590 0x56465c62e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.452+0000 7f2ead3d2740 1 --2- 172.21.15.3:0/3211126377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56465c61ec70 0x56465c62dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.452+0000 7f2e8d600640 0 client.27062 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:18:48.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.452+0000 7f2ead3d2740 1 -- 172.21.15.3:0/3211126377 >> 172.21.15.3:0/3211126377 conn(0x56465c61b200 msgr2=0x56465c628db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:48.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.452+0000 7f2ead3d2740 1 -- 172.21.15.3:0/3211126377 shutdown_connections 2024-09-19T06:18:48.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.452+0000 7f2ead3d2740 1 -- 172.21.15.3:0/3211126377 wait complete. 2024-09-19T06:18:48.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.452+0000 7f2ead3d2740 20 client.27062 trim_cache size 0 max 16384 2024-09-19T06:18:48.459 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:18:48.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.453+0000 7f2eaaa00640 1 -- 172.21.15.3:0/2602567892 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2e880a33b0 msgr2=0x7f2e880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:48.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.453+0000 7f2eaaa00640 1 --2- 172.21.15.3:0/2602567892 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2e880a33b0 0x7f2e880a5870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c005f40 tx=0x7f2e9c009500 comp rx=0 tx=0).stop 2024-09-19T06:18:48.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.453+0000 7f2eaaa00640 1 -- 172.21.15.3:0/2602567892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ea4076720 msgr2=0x7f2ea41a4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:48.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.453+0000 7f2eaaa00640 1 --2- 172.21.15.3:0/2602567892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ea4076720 0x7f2ea41a4720 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2e9400d6d0 tx=0x7f2e9400db90 comp rx=0 tx=0).stop 2024-09-19T06:18:48.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.453+0000 7f2eaaa00640 1 -- 172.21.15.3:0/2602567892 shutdown_connections 2024-09-19T06:18:48.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.453+0000 7f2eaaa00640 1 --2- 172.21.15.3:0/2602567892 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2e880a33b0 0x7f2e880a5870 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.453+0000 7f2eaaa00640 1 --2- 172.21.15.3:0/2602567892 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2ea4112a30 0x7f2ea419e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.453+0000 7f2eaaa00640 1 --2- 172.21.15.3:0/2602567892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ea4077040 0x7f2ea41a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.453+0000 7f2eaaa00640 1 --2- 172.21.15.3:0/2602567892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2ea4076720 0x7f2ea41a4720 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:48.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.453+0000 7f2eaaa00640 1 -- 172.21.15.3:0/2602567892 >> 172.21.15.3:0/2602567892 conn(0x7f2ea40ffa90 msgr2=0x7f2ea4101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:48.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.453+0000 7f2eaaa00640 1 -- 172.21.15.3:0/2602567892 shutdown_connections 2024-09-19T06:18:48.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:48.453+0000 7f2eaaa00640 1 -- 172.21.15.3:0/2602567892 wait complete. 2024-09-19T06:18:49.397 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:18:49.776 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:49.934 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:49 smithi003 ceph-mon[30893]: pgmap v196: 97 pgs: 97 active+clean; 2.3 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 26 op/s 2024-09-19T06:18:50.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:49 smithi059 ceph-mon[35138]: pgmap v196: 97 pgs: 97 active+clean; 2.3 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 26 op/s 2024-09-19T06:18:50.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:49 smithi071 ceph-mon[35662]: pgmap v196: 97 pgs: 97 active+clean; 2.3 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 26 op/s 2024-09-19T06:18:50.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.366+0000 7f0df3200640 1 -- 172.21.15.3:0/111290532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0df4103e30 msgr2=0x7f0df4104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:50.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.366+0000 7f0df3200640 1 --2- 172.21.15.3:0/111290532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0df4103e30 0x7f0df4104210 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0de4009900 tx=0x7f0de402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.366+0000 7f0df3200640 1 -- 172.21.15.3:0/111290532 shutdown_connections 2024-09-19T06:18:50.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.366+0000 7f0df3200640 1 --2- 172.21.15.3:0/111290532 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0df4108f60 0x7f0df4110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.366+0000 7f0df3200640 1 --2- 172.21.15.3:0/111290532 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0df41047e0 0x7f0df4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.366+0000 7f0df3200640 1 --2- 172.21.15.3:0/111290532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0df4103e30 0x7f0df4104210 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.366+0000 7f0df3200640 1 -- 172.21.15.3:0/111290532 >> 172.21.15.3:0/111290532 conn(0x7f0df40ff8d0 msgr2=0x7f0df4101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:50.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.366+0000 7f0df3200640 1 -- 172.21.15.3:0/111290532 shutdown_connections 2024-09-19T06:18:50.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.366+0000 7f0df3200640 1 -- 172.21.15.3:0/111290532 wait complete. 2024-09-19T06:18:50.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.367+0000 7f0df3200640 1 Processor -- start 2024-09-19T06:18:50.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.367+0000 7f0df3200640 1 -- start start 2024-09-19T06:18:50.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.368+0000 7f0df3200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0df4103e30 0x7f0df419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:50.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.368+0000 7f0df3200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0df41047e0 0x7f0df419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:50.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.368+0000 7f0df3200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0df4108f60 0x7f0df419ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:50.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.368+0000 7f0df3200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0df4114010 con 0x7f0df4108f60 2024-09-19T06:18:50.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.368+0000 7f0df3200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0df4113e90 con 0x7f0df41047e0 2024-09-19T06:18:50.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.368+0000 7f0df3200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0df4114190 con 0x7f0df4103e30 2024-09-19T06:18:50.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.368+0000 7f0df2800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0df4108f60 0x7f0df419ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:50.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.368+0000 7f0df1400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0df41047e0 0x7f0df419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:50.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.368+0000 7f0df1e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0df4103e30 0x7f0df419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:50.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.368+0000 7f0df2800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0df4108f60 0x7f0df419ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47172/0 (socket says 172.21.15.3:47172) 2024-09-19T06:18:50.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.368+0000 7f0df2800640 1 -- 172.21.15.3:0/1145706871 learned_addr learned my addr 172.21.15.3:0/1145706871 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:50.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.369+0000 7f0df2800640 1 -- 172.21.15.3:0/1145706871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0df4103e30 msgr2=0x7f0df419a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:50.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.369+0000 7f0df2800640 1 --2- 172.21.15.3:0/1145706871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0df4103e30 0x7f0df419a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.369+0000 7f0df2800640 1 -- 172.21.15.3:0/1145706871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0df41047e0 msgr2=0x7f0df419a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:50.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.369+0000 7f0df2800640 1 --2- 172.21.15.3:0/1145706871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0df41047e0 0x7f0df419a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.369+0000 7f0df2800640 1 -- 172.21.15.3:0/1145706871 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df419f400 con 0x7f0df4108f60 2024-09-19T06:18:50.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.369+0000 7f0df1400640 1 --2- 172.21.15.3:0/1145706871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0df41047e0 0x7f0df419a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:50.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.369+0000 7f0df2800640 1 --2- 172.21.15.3:0/1145706871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0df4108f60 0x7f0df419ed20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00eb10 tx=0x7f0dec00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:50.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.369+0000 7f0deaa00640 1 -- 172.21.15.3:0/1145706871 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec004b20 con 0x7f0df4108f60 2024-09-19T06:18:50.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.369+0000 7f0deaa00640 1 -- 172.21.15.3:0/1145706871 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dec004cc0 con 0x7f0df4108f60 2024-09-19T06:18:50.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.369+0000 7f0df3200640 1 -- 172.21.15.3:0/1145706871 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df419f6f0 con 0x7f0df4108f60 2024-09-19T06:18:50.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.369+0000 7f0deaa00640 1 -- 172.21.15.3:0/1145706871 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec010760 con 0x7f0df4108f60 2024-09-19T06:18:50.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.369+0000 7f0df3200640 1 -- 172.21.15.3:0/1145706871 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df41a6fd0 con 0x7f0df4108f60 2024-09-19T06:18:50.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.373+0000 7f0deaa00640 1 -- 172.21.15.3:0/1145706871 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f0dec005020 con 0x7f0df4108f60 2024-09-19T06:18:50.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.373+0000 7f0dfbc25740 1 Processor -- start 2024-09-19T06:18:50.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.373+0000 7f0dfbc25740 1 -- start start 2024-09-19T06:18:50.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.373+0000 7f0dfbc25740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3dff7e40 0x562e3dff8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:50.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.373+0000 7f0dfbc25740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3dff8760 0x562e3e002ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:50.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.373+0000 7f0dfbc25740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e3e003020 0x562e3e005410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:50.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.373+0000 7f0dfbc25740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562e3df5e3e0 con 0x562e3dff7e40 2024-09-19T06:18:50.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.373+0000 7f0dfbc25740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562e3df05d80 con 0x562e3dff8760 2024-09-19T06:18:50.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.373+0000 7f0dfbc25740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562e3df5a3a0 con 0x562e3e003020 2024-09-19T06:18:50.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.373+0000 7f0df1400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3dff7e40 0x562e3dff8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:50.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.373+0000 7f0df1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3dff8760 0x562e3e002ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:50.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.374+0000 7f0df1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3dff8760 0x562e3e002ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:52664/0 (socket says 172.21.15.3:52664) 2024-09-19T06:18:50.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.374+0000 7f0df1e00640 1 -- 172.21.15.3:0/3299285889 learned_addr learned my addr 172.21.15.3:0/3299285889 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:50.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.374+0000 7f0df1400640 1 --2- 172.21.15.3:0/3299285889 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e3e003020 0x562e3e005410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:50.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.374+0000 7f0df1e00640 1 -- 172.21.15.3:0/3299285889 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e3e003020 msgr2=0x562e3e005410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:50.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.374+0000 7f0df1e00640 1 --2- 172.21.15.3:0/3299285889 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e3e003020 0x562e3e005410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.374+0000 7f0df1e00640 1 -- 172.21.15.3:0/3299285889 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3dff7e40 msgr2=0x562e3dff8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.374+0000 7f0df1e00640 1 --2- 172.21.15.3:0/3299285889 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3dff7e40 0x562e3dff8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.374+0000 7f0df1e00640 1 -- 172.21.15.3:0/3299285889 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e3df24ae0 con 0x562e3dff8760 2024-09-19T06:18:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.374+0000 7f0df1400640 1 --2- 172.21.15.3:0/3299285889 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e3e003020 0x562e3e005410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:18:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.374+0000 7f0df1e00640 1 --2- 172.21.15.3:0/3299285889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3dff8760 0x562e3e002ae0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0de4009900 tx=0x7f0de4005de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7cff12eaa89e063 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.374+0000 7f0ddf400640 1 -- 172.21.15.3:0/3299285889 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4035040 con 0x562e3dff8760 2024-09-19T06:18:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.375+0000 7f0ddf400640 1 -- 172.21.15.3:0/3299285889 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0de4004400 con 0x562e3dff8760 2024-09-19T06:18:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.375+0000 7f0ddf400640 1 -- 172.21.15.3:0/3299285889 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de40035f0 con 0x562e3dff8760 2024-09-19T06:18:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.375+0000 7f0deaa00640 1 --2- 172.21.15.3:0/1145706871 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0dd80a3430 0x7f0dd80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.375+0000 7f0deaa00640 1 -- 172.21.15.3:0/1145706871 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f0dec0d0330 con 0x7f0df4108f60 2024-09-19T06:18:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.375+0000 7f0df1400640 1 --2- 172.21.15.3:0/1145706871 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0dd80a3430 0x7f0dd80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.375+0000 7f0dfbc25740 1 -- 172.21.15.3:0/3299285889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3dff8760 msgr2=0x562e3e002ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.375+0000 7f0dfbc25740 1 --2- 172.21.15.3:0/3299285889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3dff8760 0x562e3e002ae0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0de4009900 tx=0x7f0de4005de0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.375+0000 7f0dfbc25740 1 -- 172.21.15.3:0/3299285889 shutdown_connections 2024-09-19T06:18:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.375+0000 7f0dfbc25740 1 --2- 172.21.15.3:0/3299285889 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e3e003020 0x562e3e005410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.375+0000 7f0dfbc25740 1 --2- 172.21.15.3:0/3299285889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3dff8760 0x562e3e002ae0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.375+0000 7f0dfbc25740 1 --2- 172.21.15.3:0/3299285889 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3dff7e40 0x562e3dff8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.375+0000 7f0dfbc25740 1 -- 172.21.15.3:0/3299285889 >> 172.21.15.3:0/3299285889 conn(0x562e3dff43d0 msgr2=0x562e3dff47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.375+0000 7f0dfbc25740 1 -- 172.21.15.3:0/3299285889 shutdown_connections 2024-09-19T06:18:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.376+0000 7f0df1400640 1 --2- 172.21.15.3:0/1145706871 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0dd80a3430 0x7f0dd80a58f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x562e3dff5750 tx=0x7f0de0009770 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.376+0000 7f0dfbc25740 1 -- 172.21.15.3:0/3299285889 wait complete. 2024-09-19T06:18:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.376+0000 7f0dfbc25740 1 -- start start 2024-09-19T06:18:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.376+0000 7f0dfbc25740 1 Processor -- start 2024-09-19T06:18:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.377+0000 7f0dfbc25740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3dff7e40 0x562e3dfffe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.377+0000 7f0dfbc25740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e3dff8760 0x562e3e0003d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.377+0000 7f0dfbc25740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3e003020 0x562e3e000910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.377+0000 7f0dfbc25740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562e3e005bf0 con 0x562e3e003020 2024-09-19T06:18:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.377+0000 7f0dfbc25740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562e3df190f0 con 0x562e3dff7e40 2024-09-19T06:18:50.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.377+0000 7f0dfbc25740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562e3e005d70 con 0x562e3dff8760 2024-09-19T06:18:50.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.377+0000 7f0dfbc25740 10 client.0 _ll_register_callbacks cb 0x562e3df00bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:50.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.377+0000 7f0df1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3dff7e40 0x562e3dfffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:50.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.377+0000 7f0df1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3dff7e40 0x562e3dfffe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:52680/0 (socket says 172.21.15.3:52680) 2024-09-19T06:18:50.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.377+0000 7f0df1e00640 1 -- 172.21.15.3:0/2363439684 learned_addr learned my addr 172.21.15.3:0/2363439684 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:50.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.377+0000 7f0df2800640 1 --2- 172.21.15.3:0/2363439684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3e003020 0x562e3e000910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:50.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.377+0000 7f0df1400640 1 --2- 172.21.15.3:0/2363439684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e3dff8760 0x562e3e0003d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:50.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.377+0000 7f0df1e00640 1 -- 172.21.15.3:0/2363439684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e3dff8760 msgr2=0x562e3e0003d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:50.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.377+0000 7f0df1e00640 1 --2- 172.21.15.3:0/2363439684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e3dff8760 0x562e3e0003d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.377+0000 7f0df1e00640 1 -- 172.21.15.3:0/2363439684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3e003020 msgr2=0x562e3e000910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:50.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.377+0000 7f0df1e00640 1 --2- 172.21.15.3:0/2363439684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3e003020 0x562e3e000910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.377+0000 7f0df1e00640 1 -- 172.21.15.3:0/2363439684 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e3dccf3c0 con 0x562e3dff7e40 2024-09-19T06:18:50.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.377+0000 7f0df2800640 1 --2- 172.21.15.3:0/2363439684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3e003020 0x562e3e000910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:50.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.378+0000 7f0df1e00640 1 --2- 172.21.15.3:0/2363439684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3dff7e40 0x562e3dfffe90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0de40048f0 tx=0x7f0de402a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2cf7b403c0e14b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:50.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.378+0000 7f0dd3e00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:18:50.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.378+0000 7f0dd3e00640 1 -- 172.21.15.3:0/2363439684 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4052060 con 0x562e3dff7e40 2024-09-19T06:18:50.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.378+0000 7f0dd3e00640 1 -- 172.21.15.3:0/2363439684 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f0de4004200 con 0x562e3dff7e40 2024-09-19T06:18:50.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.378+0000 7f0dfbc25740 1 -- 172.21.15.3:0/2363439684 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0de4004400 con 0x562e3dff7e40 2024-09-19T06:18:50.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.378+0000 7f0dd3e00640 1 -- 172.21.15.3:0/2363439684 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0de4035050 con 0x562e3dff7e40 2024-09-19T06:18:50.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.378+0000 7f0dfbc25740 10 client.27074 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:50.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.378+0000 7f0dfbc25740 1 -- 172.21.15.3:0/2363439684 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562e3e011b50 con 0x562e3dff7e40 2024-09-19T06:18:50.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.379+0000 7f0dd3e00640 1 -- 172.21.15.3:0/2363439684 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0de4004400 con 0x562e3dff7e40 2024-09-19T06:18:50.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.379+0000 7f0dd3e00640 1 -- 172.21.15.3:0/2363439684 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0de4003990 con 0x562e3dff7e40 2024-09-19T06:18:50.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.379+0000 7f0dfbc25740 10 client.27074 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:50.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.379+0000 7f0dfbc25740 10 client.27074 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:18:50.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.379+0000 7f0dfbc25740 20 client.27074 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:50.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.379+0000 7f0dfbc25740 1 --2- 172.21.15.3:0/2363439684 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x562e3e012ea0 0x562e3e015290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:50.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.379+0000 7f0dfbc25740 4 client.27074 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:50.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.379+0000 7f0dfbc25740 1 -- 172.21.15.3:0/2363439684 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e3df6b950 con 0x562e3e012ea0 2024-09-19T06:18:50.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.380+0000 7f0df1400640 1 --2- 172.21.15.3:0/2363439684 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x562e3e012ea0 0x562e3e015290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:50.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.380+0000 7f0df1400640 1 --2- 172.21.15.3:0/2363439684 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x562e3e012ea0 0x562e3e015290 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a12d2667b1b6c2ef server_cookie=a0f838a58cc3182 in_seq=0 out_seq=0 2024-09-19T06:18:50.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.380+0000 7f0dd3e00640 10 client.27074 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:18:50.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.381+0000 7f0dd3e00640 1 -- 172.21.15.3:0/2363439684 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562e3df6b950 con 0x562e3e012ea0 2024-09-19T06:18:50.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.381+0000 7f0dd3e00640 10 client.27074 handle_command_reply: tid=0 2024-09-19T06:18:50.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.381+0000 7f0dfbc25740 1 client.27074 shutdown 2024-09-19T06:18:50.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.381+0000 7f0dfbc25740 1 -- 172.21.15.3:0/2363439684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3dff7e40 msgr2=0x562e3dfffe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:50.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.381+0000 7f0dfbc25740 1 --2- 172.21.15.3:0/2363439684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3dff7e40 0x562e3dfffe90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0de40048f0 tx=0x7f0de402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.381+0000 7f0dfbc25740 1 -- 172.21.15.3:0/2363439684 shutdown_connections 2024-09-19T06:18:50.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.381+0000 7f0dfbc25740 1 --2- 172.21.15.3:0/2363439684 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x562e3e012ea0 0x562e3e015290 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.381+0000 7f0dfbc25740 1 --2- 172.21.15.3:0/2363439684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3e003020 0x562e3e000910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.381+0000 7f0dfbc25740 1 --2- 172.21.15.3:0/2363439684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e3dff8760 0x562e3e0003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.381+0000 7f0dfbc25740 1 --2- 172.21.15.3:0/2363439684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3dff7e40 0x562e3dfffe90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.381+0000 7f0dd3e00640 0 client.27074 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:18:50.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.381+0000 7f0dfbc25740 1 -- 172.21.15.3:0/2363439684 >> 172.21.15.3:0/2363439684 conn(0x562e3dff43d0 msgr2=0x562e3dffa100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:50.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.381+0000 7f0dfbc25740 1 -- 172.21.15.3:0/2363439684 shutdown_connections 2024-09-19T06:18:50.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.381+0000 7f0dfbc25740 1 -- 172.21.15.3:0/2363439684 wait complete. 2024-09-19T06:18:50.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.382+0000 7f0dfbc25740 20 client.27074 trim_cache size 0 max 16384 2024-09-19T06:18:50.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.395+0000 7f0dfbc25740 1 Processor -- start 2024-09-19T06:18:50.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.395+0000 7f0dfbc25740 1 -- start start 2024-09-19T06:18:50.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.396+0000 7f0dfbc25740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3dff7e40 0x562e3dffa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:50.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.396+0000 7f0dfbc25740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3dff8760 0x562e3e01a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:50.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.396+0000 7f0dfbc25740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e3e003020 0x562e3e01add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:50.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.396+0000 7f0dfbc25740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0df41af950 con 0x562e3dff7e40 2024-09-19T06:18:50.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.396+0000 7f0dfbc25740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0df41b1490 con 0x562e3dff8760 2024-09-19T06:18:50.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.396+0000 7f0dfbc25740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0df41b0020 con 0x562e3e003020 2024-09-19T06:18:50.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.396+0000 7f0df1e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3dff7e40 0x562e3dffa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:50.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.396+0000 7f0df1e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3dff7e40 0x562e3dffa8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47200/0 (socket says 172.21.15.3:47200) 2024-09-19T06:18:50.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.396+0000 7f0df1e00640 1 -- 172.21.15.3:0/3400041463 learned_addr learned my addr 172.21.15.3:0/3400041463 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:50.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.396+0000 7f0df1400640 1 --2- 172.21.15.3:0/3400041463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3dff8760 0x562e3e01a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:50.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.396+0000 7f0df2800640 1 --2- 172.21.15.3:0/3400041463 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e3e003020 0x562e3e01add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:50.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.396+0000 7f0df1e00640 1 -- 172.21.15.3:0/3400041463 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e3e003020 msgr2=0x562e3e01add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:50.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.396+0000 7f0df1e00640 1 --2- 172.21.15.3:0/3400041463 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e3e003020 0x562e3e01add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.396+0000 7f0df1e00640 1 -- 172.21.15.3:0/3400041463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3dff8760 msgr2=0x562e3e01a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:50.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.396+0000 7f0df1e00640 1 --2- 172.21.15.3:0/3400041463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3dff8760 0x562e3e01a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.396+0000 7f0df1e00640 1 -- 172.21.15.3:0/3400041463 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e3e005d50 con 0x562e3dff7e40 2024-09-19T06:18:50.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.396+0000 7f0df1400640 1 --2- 172.21.15.3:0/3400041463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3dff8760 0x562e3e01a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:50.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.396+0000 7f0df2800640 1 --2- 172.21.15.3:0/3400041463 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e3e003020 0x562e3e01add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:50.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.397+0000 7f0df1e00640 1 --2- 172.21.15.3:0/3400041463 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3dff7e40 0x562e3dffa8a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0de4004c50 tx=0x7f0de4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4feef09de033c043 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:50.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.397+0000 7f0ddea00640 1 -- 172.21.15.3:0/3400041463 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4052030 con 0x562e3dff7e40 2024-09-19T06:18:50.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.397+0000 7f0ddea00640 1 -- 172.21.15.3:0/3400041463 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0de4003ad0 con 0x562e3dff7e40 2024-09-19T06:18:50.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.397+0000 7f0ddea00640 1 -- 172.21.15.3:0/3400041463 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de40051d0 con 0x562e3dff7e40 2024-09-19T06:18:50.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.398+0000 7f0dfbc25740 1 -- 172.21.15.3:0/3400041463 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3dff7e40 msgr2=0x562e3dffa8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:50.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.398+0000 7f0dfbc25740 1 --2- 172.21.15.3:0/3400041463 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3dff7e40 0x562e3dffa8a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0de4004c50 tx=0x7f0de4000bc0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.398+0000 7f0dfbc25740 1 -- 172.21.15.3:0/3400041463 shutdown_connections 2024-09-19T06:18:50.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.398+0000 7f0dfbc25740 1 --2- 172.21.15.3:0/3400041463 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e3e003020 0x562e3e01add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.398+0000 7f0dfbc25740 1 --2- 172.21.15.3:0/3400041463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3dff8760 0x562e3e01a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.398+0000 7f0dfbc25740 1 --2- 172.21.15.3:0/3400041463 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3dff7e40 0x562e3dffa8a0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.398+0000 7f0dfbc25740 1 -- 172.21.15.3:0/3400041463 >> 172.21.15.3:0/3400041463 conn(0x562e3dff43d0 msgr2=0x562e3dffef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:50.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.398+0000 7f0dfbc25740 1 -- 172.21.15.3:0/3400041463 shutdown_connections 2024-09-19T06:18:50.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.398+0000 7f0dfbc25740 1 -- 172.21.15.3:0/3400041463 wait complete. 2024-09-19T06:18:50.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.398+0000 7f0dfbc25740 1 -- start start 2024-09-19T06:18:50.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.398+0000 7f0dfbc25740 1 Processor -- start 2024-09-19T06:18:50.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.399+0000 7f0dfbc25740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3dff7e40 0x562e3e006370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:50.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.399+0000 7f0dfbc25740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e3dff8760 0x562e3e0068b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:50.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.399+0000 7f0dfbc25740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3e003020 0x562e3e07b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:50.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.399+0000 7f0dfbc25740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0df41b0dc0 con 0x562e3dff7e40 2024-09-19T06:18:50.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.399+0000 7f0dfbc25740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0df41b06f0 con 0x562e3e003020 2024-09-19T06:18:50.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.399+0000 7f0dfbc25740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0df41ad930 con 0x562e3dff8760 2024-09-19T06:18:50.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.399+0000 7f0dfbc25740 10 client.0 _ll_register_callbacks cb 0x7f0de0009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:50.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.399+0000 7f0df1e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3dff7e40 0x562e3e006370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:50.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.399+0000 7f0df1e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3dff7e40 0x562e3e006370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47208/0 (socket says 172.21.15.3:47208) 2024-09-19T06:18:50.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.399+0000 7f0df1e00640 1 -- 172.21.15.3:0/1846344553 learned_addr learned my addr 172.21.15.3:0/1846344553 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:50.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.399+0000 7f0df1400640 1 --2- 172.21.15.3:0/1846344553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e3dff8760 0x562e3e0068b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:50.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.399+0000 7f0df2800640 1 --2- 172.21.15.3:0/1846344553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3e003020 0x562e3e07b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:50.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.400+0000 7f0df1e00640 1 -- 172.21.15.3:0/1846344553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e3dff8760 msgr2=0x562e3e0068b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:50.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.400+0000 7f0df1e00640 1 --2- 172.21.15.3:0/1846344553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e3dff8760 0x562e3e0068b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.400+0000 7f0df1e00640 1 -- 172.21.15.3:0/1846344553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3e003020 msgr2=0x562e3e07b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:50.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.400+0000 7f0df1e00640 1 --2- 172.21.15.3:0/1846344553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3e003020 0x562e3e07b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.400+0000 7f0df1e00640 1 -- 172.21.15.3:0/1846344553 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e3dff4200 con 0x562e3dff7e40 2024-09-19T06:18:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.400+0000 7f0df1e00640 1 --2- 172.21.15.3:0/1846344553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3dff7e40 0x562e3e006370 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0de4004b80 tx=0x7f0de4031480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d4c9716099bfd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.400+0000 7f0dd3e00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:18:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.400+0000 7f0dd3e00640 1 -- 172.21.15.3:0/1846344553 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4063070 con 0x562e3dff7e40 2024-09-19T06:18:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.400+0000 7f0dd3e00640 1 -- 172.21.15.3:0/1846344553 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f0de40035f0 con 0x562e3dff7e40 2024-09-19T06:18:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.400+0000 7f0dfbc25740 1 -- 172.21.15.3:0/1846344553 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0de4003ad0 con 0x562e3dff7e40 2024-09-19T06:18:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.401+0000 7f0dd3e00640 1 -- 172.21.15.3:0/1846344553 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0de406f050 con 0x562e3dff7e40 2024-09-19T06:18:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.401+0000 7f0dfbc25740 10 client.17040 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.401+0000 7f0dfbc25740 1 -- 172.21.15.3:0/1846344553 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562e3e07cd80 con 0x562e3dff7e40 2024-09-19T06:18:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.401+0000 7f0dd3e00640 1 -- 172.21.15.3:0/1846344553 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0de4003ad0 con 0x562e3dff7e40 2024-09-19T06:18:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.401+0000 7f0dd3e00640 1 -- 172.21.15.3:0/1846344553 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0de4031750 con 0x562e3dff7e40 2024-09-19T06:18:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.401+0000 7f0dfbc25740 10 client.17040 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.401+0000 7f0dfbc25740 10 client.17040 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:18:50.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.401+0000 7f0dfbc25740 20 client.17040 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:50.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.401+0000 7f0dfbc25740 1 --2- 172.21.15.3:0/1846344553 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x562e3e07d360 0x562e3e07f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:50.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.401+0000 7f0dfbc25740 4 client.17040 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:18:50.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.401+0000 7f0dfbc25740 1 -- 172.21.15.3:0/1846344553 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562e3df65e60 con 0x562e3e07d360 2024-09-19T06:18:50.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.402+0000 7f0df1400640 1 --2- 172.21.15.3:0/1846344553 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x562e3e07d360 0x562e3e07f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:50.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.402+0000 7f0df1400640 1 --2- 172.21.15.3:0/1846344553 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x562e3e07d360 0x562e3e07f780 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a9cd10f904f90e57 server_cookie=a37ef73a3b38d9a9 in_seq=0 out_seq=0 2024-09-19T06:18:50.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.402+0000 7f0dd3e00640 10 client.17040 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:18:50.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.402+0000 7f0dd3e00640 1 -- 172.21.15.3:0/1846344553 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562e3df65e60 con 0x562e3e07d360 2024-09-19T06:18:50.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.402+0000 7f0dd3e00640 10 client.17040 handle_command_reply: tid=0 2024-09-19T06:18:50.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.402+0000 7f0dfbc25740 1 client.17040 shutdown 2024-09-19T06:18:50.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.403+0000 7f0dfbc25740 1 -- 172.21.15.3:0/1846344553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3dff7e40 msgr2=0x562e3e006370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:50.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.403+0000 7f0dfbc25740 1 --2- 172.21.15.3:0/1846344553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3dff7e40 0x562e3e006370 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0de4004b80 tx=0x7f0de4031480 comp rx=0 tx=0).stop 2024-09-19T06:18:50.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.403+0000 7f0dfbc25740 1 -- 172.21.15.3:0/1846344553 shutdown_connections 2024-09-19T06:18:50.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.403+0000 7f0dfbc25740 1 --2- 172.21.15.3:0/1846344553 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x562e3e07d360 0x562e3e07f780 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.403+0000 7f0dfbc25740 1 --2- 172.21.15.3:0/1846344553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e3e003020 0x562e3e07b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.403+0000 7f0dfbc25740 1 --2- 172.21.15.3:0/1846344553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e3dff8760 0x562e3e0068b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.403+0000 7f0dfbc25740 1 --2- 172.21.15.3:0/1846344553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e3dff7e40 0x562e3e006370 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.403+0000 7f0dfbc25740 1 -- 172.21.15.3:0/1846344553 >> 172.21.15.3:0/1846344553 conn(0x562e3dff43d0 msgr2=0x562e3dff2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:50.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.403+0000 7f0dd3e00640 0 client.17040 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:18:50.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.403+0000 7f0dfbc25740 1 -- 172.21.15.3:0/1846344553 shutdown_connections 2024-09-19T06:18:50.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.403+0000 7f0dfbc25740 1 -- 172.21.15.3:0/1846344553 wait complete. 2024-09-19T06:18:50.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.403+0000 7f0dfbc25740 20 client.17040 trim_cache size 0 max 16384 2024-09-19T06:18:50.410 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:18:50.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.404+0000 7f0df3200640 1 -- 172.21.15.3:0/1145706871 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0dd80a3430 msgr2=0x7f0dd80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:50.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.404+0000 7f0df3200640 1 --2- 172.21.15.3:0/1145706871 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0dd80a3430 0x7f0dd80a58f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x562e3dff5750 tx=0x7f0de0009770 comp rx=0 tx=0).stop 2024-09-19T06:18:50.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.404+0000 7f0df3200640 1 -- 172.21.15.3:0/1145706871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0df4108f60 msgr2=0x7f0df419ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:50.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.404+0000 7f0df3200640 1 --2- 172.21.15.3:0/1145706871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0df4108f60 0x7f0df419ed20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0dec00eb10 tx=0x7f0dec00c2d0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.404+0000 7f0df3200640 1 -- 172.21.15.3:0/1145706871 shutdown_connections 2024-09-19T06:18:50.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.404+0000 7f0df3200640 1 --2- 172.21.15.3:0/1145706871 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0dd80a3430 0x7f0dd80a58f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.404+0000 7f0df3200640 1 --2- 172.21.15.3:0/1145706871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0df4108f60 0x7f0df419ed20 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.404+0000 7f0df3200640 1 --2- 172.21.15.3:0/1145706871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0df41047e0 0x7f0df419a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.404+0000 7f0df3200640 1 --2- 172.21.15.3:0/1145706871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0df4103e30 0x7f0df419a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:50.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.404+0000 7f0df3200640 1 -- 172.21.15.3:0/1145706871 >> 172.21.15.3:0/1145706871 conn(0x7f0df40ff8d0 msgr2=0x7f0df4100bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:50.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.404+0000 7f0df3200640 1 -- 172.21.15.3:0/1145706871 shutdown_connections 2024-09-19T06:18:50.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:50.404+0000 7f0df3200640 1 -- 172.21.15.3:0/1145706871 wait complete. 2024-09-19T06:18:51.451 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:18:51.832 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:51.971 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:51 smithi003 ceph-mon[30893]: pgmap v197: 97 pgs: 97 active+clean; 2.3 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 17 op/s 2024-09-19T06:18:52.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:51 smithi059 ceph-mon[35138]: pgmap v197: 97 pgs: 97 active+clean; 2.3 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 17 op/s 2024-09-19T06:18:52.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:51 smithi071 ceph-mon[35662]: pgmap v197: 97 pgs: 97 active+clean; 2.3 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 17 op/s 2024-09-19T06:18:52.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.458+0000 7f0e35400640 1 -- 172.21.15.3:0/3910754755 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e301079c0 msgr2=0x7f0e30107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:52.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.458+0000 7f0e35400640 1 --2- 172.21.15.3:0/3910754755 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e301079c0 0x7f0e30107da0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0e20009930 tx=0x7f0e2002a420 comp rx=0 tx=0).stop 2024-09-19T06:18:52.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.458+0000 7f0e35400640 1 -- 172.21.15.3:0/3910754755 shutdown_connections 2024-09-19T06:18:52.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.458+0000 7f0e35400640 1 --2- 172.21.15.3:0/3910754755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e30102360 0x7f0e3010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.458+0000 7f0e35400640 1 --2- 172.21.15.3:0/3910754755 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e301019c0 0x7f0e30101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.458+0000 7f0e35400640 1 --2- 172.21.15.3:0/3910754755 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e301079c0 0x7f0e30107da0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.458+0000 7f0e35400640 1 -- 172.21.15.3:0/3910754755 >> 172.21.15.3:0/3910754755 conn(0x7f0e300fd740 msgr2=0x7f0e300ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:52.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.458+0000 7f0e35400640 1 -- 172.21.15.3:0/3910754755 shutdown_connections 2024-09-19T06:18:52.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.458+0000 7f0e35400640 1 -- 172.21.15.3:0/3910754755 wait complete. 2024-09-19T06:18:52.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.459+0000 7f0e35400640 1 Processor -- start 2024-09-19T06:18:52.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.459+0000 7f0e35400640 1 -- start start 2024-09-19T06:18:52.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.460+0000 7f0e35400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e301019c0 0x7f0e300744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:52.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.460+0000 7f0e35400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e30102360 0x7f0e30074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:52.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.460+0000 7f0e35400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e301079c0 0x7f0e30074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:52.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.460+0000 7f0e35400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0e30111dc0 con 0x7f0e301079c0 2024-09-19T06:18:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.460+0000 7f0e35400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0e30111c40 con 0x7f0e30102360 2024-09-19T06:18:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.460+0000 7f0e35400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0e30111f40 con 0x7f0e301019c0 2024-09-19T06:18:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.460+0000 7f0e34a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e301079c0 0x7f0e30074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.460+0000 7f0e2f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e30102360 0x7f0e30074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.460+0000 7f0e2fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e301019c0 0x7f0e300744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.460+0000 7f0e2f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e30102360 0x7f0e30074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:52702/0 (socket says 172.21.15.3:52702) 2024-09-19T06:18:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.460+0000 7f0e2f400640 1 -- 172.21.15.3:0/1262394143 learned_addr learned my addr 172.21.15.3:0/1262394143 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.460+0000 7f0e2f400640 1 -- 172.21.15.3:0/1262394143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e301019c0 msgr2=0x7f0e300744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.460+0000 7f0e2f400640 1 --2- 172.21.15.3:0/1262394143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e301019c0 0x7f0e300744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.460+0000 7f0e2f400640 1 -- 172.21.15.3:0/1262394143 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e301079c0 msgr2=0x7f0e30074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.460+0000 7f0e2f400640 1 --2- 172.21.15.3:0/1262394143 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e301079c0 0x7f0e30074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.460+0000 7f0e2f400640 1 -- 172.21.15.3:0/1262394143 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e301a67b0 con 0x7f0e30102360 2024-09-19T06:18:52.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.461+0000 7f0e2f400640 1 --2- 172.21.15.3:0/1262394143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e30102360 0x7f0e30074a30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00e9f0 tx=0x7f0e1c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:52.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.461+0000 7f0e2cc00640 1 -- 172.21.15.3:0/1262394143 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c00cd80 con 0x7f0e30102360 2024-09-19T06:18:52.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.461+0000 7f0e2cc00640 1 -- 172.21.15.3:0/1262394143 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e1c005500 con 0x7f0e30102360 2024-09-19T06:18:52.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.461+0000 7f0e35400640 1 -- 172.21.15.3:0/1262394143 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e301a6aa0 con 0x7f0e30102360 2024-09-19T06:18:52.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.461+0000 7f0e2cc00640 1 -- 172.21.15.3:0/1262394143 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c010690 con 0x7f0e30102360 2024-09-19T06:18:52.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.461+0000 7f0e35400640 1 -- 172.21.15.3:0/1262394143 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e301a6f90 con 0x7f0e30102360 2024-09-19T06:18:52.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.464+0000 7f0e39671740 1 Processor -- start 2024-09-19T06:18:52.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.464+0000 7f0e39671740 1 -- start start 2024-09-19T06:18:52.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.465+0000 7f0e39671740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a9b3c3de40 0x55a9b3c3e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:52.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.465+0000 7f0e39671740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c3e760 0x55a9b3c48ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:52.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.465+0000 7f0e39671740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c49020 0x55a9b3c4b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:52.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.465+0000 7f0e39671740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a9b3ba43e0 con 0x55a9b3c3e760 2024-09-19T06:18:52.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.465+0000 7f0e39671740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a9b3b4bd80 con 0x55a9b3c49020 2024-09-19T06:18:52.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.465+0000 7f0e39671740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a9b3ba03a0 con 0x55a9b3c3de40 2024-09-19T06:18:52.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.465+0000 7f0e2cc00640 1 -- 172.21.15.3:0/1262394143 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f0e1c0046c0 con 0x7f0e30102360 2024-09-19T06:18:52.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.465+0000 7f0e2fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c3e760 0x55a9b3c48ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:52.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.465+0000 7f0e2fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c3e760 0x55a9b3c48ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47246/0 (socket says 172.21.15.3:47246) 2024-09-19T06:18:52.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.465+0000 7f0e2fe00640 1 -- 172.21.15.3:0/2742946537 learned_addr learned my addr 172.21.15.3:0/2742946537 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:52.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.465+0000 7f0e2f400640 1 --2- 172.21.15.3:0/2742946537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c49020 0x55a9b3c4b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:52.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.465+0000 7f0e34a00640 1 --2- 172.21.15.3:0/2742946537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a9b3c3de40 0x55a9b3c3e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:52.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.465+0000 7f0e2fe00640 1 -- 172.21.15.3:0/2742946537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a9b3c3de40 msgr2=0x55a9b3c3e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:52.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.466+0000 7f0e2fe00640 1 --2- 172.21.15.3:0/2742946537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a9b3c3de40 0x55a9b3c3e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.466+0000 7f0e2fe00640 1 -- 172.21.15.3:0/2742946537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c49020 msgr2=0x55a9b3c4b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:52.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.466+0000 7f0e2fe00640 1 --2- 172.21.15.3:0/2742946537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c49020 0x55a9b3c4b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.466+0000 7f0e2fe00640 1 -- 172.21.15.3:0/2742946537 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9b3b6aae0 con 0x55a9b3c3e760 2024-09-19T06:18:52.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.466+0000 7f0e34a00640 1 --2- 172.21.15.3:0/2742946537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a9b3c3de40 0x55a9b3c3e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:18:52.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.466+0000 7f0e2f400640 1 --2- 172.21.15.3:0/2742946537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c49020 0x55a9b3c4b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:52.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.466+0000 7f0e2fe00640 1 --2- 172.21.15.3:0/2742946537 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c3e760 0x55a9b3c48ae0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0e2002a940 tx=0x7f0e20005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff19f9ac086d300 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:52.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.466+0000 7f0e25200640 1 -- 172.21.15.3:0/2742946537 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e20040070 con 0x55a9b3c3e760 2024-09-19T06:18:52.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.466+0000 7f0e25200640 1 -- 172.21.15.3:0/2742946537 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e20031870 con 0x55a9b3c3e760 2024-09-19T06:18:52.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.466+0000 7f0e25200640 1 -- 172.21.15.3:0/2742946537 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e20035040 con 0x55a9b3c3e760 2024-09-19T06:18:52.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.467+0000 7f0e2cc00640 1 --2- 172.21.15.3:0/1262394143 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0e140a33b0 0x7f0e140a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:52.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.467+0000 7f0e39671740 1 -- 172.21.15.3:0/2742946537 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c3e760 msgr2=0x55a9b3c48ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:52.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.467+0000 7f0e39671740 1 --2- 172.21.15.3:0/2742946537 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c3e760 0x55a9b3c48ae0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0e2002a940 tx=0x7f0e20005bd0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.467+0000 7f0e2cc00640 1 -- 172.21.15.3:0/1262394143 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f0e1c0d0160 con 0x7f0e30102360 2024-09-19T06:18:52.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.467+0000 7f0e39671740 1 -- 172.21.15.3:0/2742946537 shutdown_connections 2024-09-19T06:18:52.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.467+0000 7f0e39671740 1 --2- 172.21.15.3:0/2742946537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c49020 0x55a9b3c4b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.467+0000 7f0e39671740 1 --2- 172.21.15.3:0/2742946537 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c3e760 0x55a9b3c48ae0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.467+0000 7f0e39671740 1 --2- 172.21.15.3:0/2742946537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a9b3c3de40 0x55a9b3c3e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.467+0000 7f0e39671740 1 -- 172.21.15.3:0/2742946537 >> 172.21.15.3:0/2742946537 conn(0x55a9b3c3a3d0 msgr2=0x55a9b3c3a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:52.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.467+0000 7f0e34a00640 1 --2- 172.21.15.3:0/1262394143 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0e140a33b0 0x7f0e140a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:52.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.467+0000 7f0e39671740 1 -- 172.21.15.3:0/2742946537 shutdown_connections 2024-09-19T06:18:52.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.467+0000 7f0e39671740 1 -- 172.21.15.3:0/2742946537 wait complete. 2024-09-19T06:18:52.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.468+0000 7f0e39671740 1 -- start start 2024-09-19T06:18:52.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.468+0000 7f0e34a00640 1 --2- 172.21.15.3:0/1262394143 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0e140a33b0 0x7f0e140a5870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0e28005fd0 tx=0x7f0e28009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:52.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.468+0000 7f0e39671740 1 Processor -- start 2024-09-19T06:18:52.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.469+0000 7f0e39671740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a9b3c3de40 0x55a9b3c45e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:52.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.469+0000 7f0e39671740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c3e760 0x55a9b3c46390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:52.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.469+0000 7f0e39671740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c49020 0x55a9b3c468d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:52.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.469+0000 7f0e39671740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a9b3c4bc40 con 0x55a9b3c3e760 2024-09-19T06:18:52.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.469+0000 7f0e39671740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a9b3b5f0f0 con 0x55a9b3c49020 2024-09-19T06:18:52.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.469+0000 7f0e39671740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a9b3c4bdc0 con 0x55a9b3c3de40 2024-09-19T06:18:52.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.469+0000 7f0e39671740 10 client.0 _ll_register_callbacks cb 0x55a9b3b46bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:52.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.469+0000 7f0e2f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c3e760 0x55a9b3c46390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:52.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.469+0000 7f0e2fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a9b3c3de40 0x55a9b3c45e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:52.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.469+0000 7f0e2f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c3e760 0x55a9b3c46390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47248/0 (socket says 172.21.15.3:47248) 2024-09-19T06:18:52.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.469+0000 7f0e2f400640 1 -- 172.21.15.3:0/590904005 learned_addr learned my addr 172.21.15.3:0/590904005 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:52.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.469+0000 7f0e34a00640 1 --2- 172.21.15.3:0/590904005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c49020 0x55a9b3c468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:52.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.469+0000 7f0e2fe00640 1 -- 172.21.15.3:0/590904005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c49020 msgr2=0x55a9b3c468d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:52.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.469+0000 7f0e2fe00640 1 --2- 172.21.15.3:0/590904005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c49020 0x55a9b3c468d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.469+0000 7f0e2fe00640 1 -- 172.21.15.3:0/590904005 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c3e760 msgr2=0x55a9b3c46390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:52.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.469+0000 7f0e2fe00640 1 --2- 172.21.15.3:0/590904005 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c3e760 0x55a9b3c46390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.470+0000 7f0e2fe00640 1 -- 172.21.15.3:0/590904005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9b39153c0 con 0x55a9b3c3de40 2024-09-19T06:18:52.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.470+0000 7f0e2f400640 1 --2- 172.21.15.3:0/590904005 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c3e760 0x55a9b3c46390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:52.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.470+0000 7f0e2fe00640 1 --2- 172.21.15.3:0/590904005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a9b3c3de40 0x55a9b3c45e50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0e2002a940 tx=0x7f0e200052d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29ed3d1984d8642d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:52.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.470+0000 7f0e19600640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:18:52.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.470+0000 7f0e19600640 1 -- 172.21.15.3:0/590904005 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e20040030 con 0x55a9b3c3de40 2024-09-19T06:18:52.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.470+0000 7f0e39671740 1 -- 172.21.15.3:0/590904005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e20031870 con 0x55a9b3c3de40 2024-09-19T06:18:52.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.470+0000 7f0e19600640 1 -- 172.21.15.3:0/590904005 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f0e20004260 con 0x55a9b3c3de40 2024-09-19T06:18:52.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.470+0000 7f0e19600640 1 -- 172.21.15.3:0/590904005 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0e20056050 con 0x55a9b3c3de40 2024-09-19T06:18:52.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.471+0000 7f0e39671740 10 client.27088 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.471+0000 7f0e39671740 1 -- 172.21.15.3:0/590904005 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a9b3c4bc90 con 0x55a9b3c3de40 2024-09-19T06:18:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.471+0000 7f0e19600640 1 -- 172.21.15.3:0/590904005 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e20031870 con 0x55a9b3c3de40 2024-09-19T06:18:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.471+0000 7f0e19600640 1 -- 172.21.15.3:0/590904005 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0e200038f0 con 0x55a9b3c3de40 2024-09-19T06:18:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.471+0000 7f0e39671740 10 client.27088 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.471+0000 7f0e39671740 10 client.27088 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.471+0000 7f0e39671740 20 client.27088 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.471+0000 7f0e39671740 1 --2- 172.21.15.3:0/590904005 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a9b3c614d0 0x55a9b3c638c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.471+0000 7f0e39671740 4 client.27088 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.471+0000 7f0e39671740 1 -- 172.21.15.3:0/590904005 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9b3bb1950 con 0x55a9b3c614d0 2024-09-19T06:18:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.472+0000 7f0e2f400640 1 --2- 172.21.15.3:0/590904005 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a9b3c614d0 0x55a9b3c638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.472+0000 7f0e2f400640 1 --2- 172.21.15.3:0/590904005 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a9b3c614d0 0x55a9b3c638c0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5147e5cd499eb69 server_cookie=2574bf21918e0de7 in_seq=0 out_seq=0 2024-09-19T06:18:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.472+0000 7f0e19600640 10 client.27088 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:52.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.473+0000 7f0e19600640 1 -- 172.21.15.3:0/590904005 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a9b3bb1950 con 0x55a9b3c614d0 2024-09-19T06:18:52.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.473+0000 7f0e19600640 10 client.27088 handle_command_reply: tid=0 2024-09-19T06:18:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.473+0000 7f0e39671740 1 client.27088 shutdown 2024-09-19T06:18:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.473+0000 7f0e39671740 1 -- 172.21.15.3:0/590904005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a9b3c3de40 msgr2=0x55a9b3c45e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.473+0000 7f0e39671740 1 --2- 172.21.15.3:0/590904005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a9b3c3de40 0x55a9b3c45e50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0e2002a940 tx=0x7f0e200052d0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.474+0000 7f0e39671740 1 -- 172.21.15.3:0/590904005 shutdown_connections 2024-09-19T06:18:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.474+0000 7f0e39671740 1 --2- 172.21.15.3:0/590904005 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a9b3c614d0 0x55a9b3c638c0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.474+0000 7f0e39671740 1 --2- 172.21.15.3:0/590904005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c49020 0x55a9b3c468d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.474+0000 7f0e39671740 1 --2- 172.21.15.3:0/590904005 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c3e760 0x55a9b3c46390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.474+0000 7f0e19600640 0 client.27088 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.474+0000 7f0e39671740 1 --2- 172.21.15.3:0/590904005 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a9b3c3de40 0x55a9b3c45e50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.474+0000 7f0e39671740 1 -- 172.21.15.3:0/590904005 >> 172.21.15.3:0/590904005 conn(0x55a9b3c3a3d0 msgr2=0x55a9b3c400b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.474+0000 7f0e39671740 1 -- 172.21.15.3:0/590904005 shutdown_connections 2024-09-19T06:18:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.474+0000 7f0e39671740 1 -- 172.21.15.3:0/590904005 wait complete. 2024-09-19T06:18:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.474+0000 7f0e39671740 20 client.27088 trim_cache size 0 max 16384 2024-09-19T06:18:52.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.488+0000 7f0e39671740 1 Processor -- start 2024-09-19T06:18:52.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.488+0000 7f0e39671740 1 -- start start 2024-09-19T06:18:52.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.488+0000 7f0e39671740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a9b3c3de40 0x55a9b3c69030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:52.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.488+0000 7f0e39671740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c3e760 0x55a9b3c69570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:52.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.488+0000 7f0e39671740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c49020 0x55a9b3c45e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:52.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.488+0000 7f0e39671740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0e301ab500 con 0x55a9b3c3e760 2024-09-19T06:18:52.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.488+0000 7f0e39671740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0e301ad040 con 0x55a9b3c49020 2024-09-19T06:18:52.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.488+0000 7f0e39671740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0e301abbd0 con 0x55a9b3c3de40 2024-09-19T06:18:52.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.489+0000 7f0e34a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c49020 0x55a9b3c45e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:52.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.489+0000 7f0e34a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c49020 0x55a9b3c45e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:52736/0 (socket says 172.21.15.3:52736) 2024-09-19T06:18:52.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.489+0000 7f0e34a00640 1 -- 172.21.15.3:0/3903147233 learned_addr learned my addr 172.21.15.3:0/3903147233 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:52.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.489+0000 7f0e2f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c3e760 0x55a9b3c69570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:52.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.489+0000 7f0e2fe00640 1 --2- 172.21.15.3:0/3903147233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a9b3c3de40 0x55a9b3c69030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:52.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.489+0000 7f0e34a00640 1 -- 172.21.15.3:0/3903147233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a9b3c3de40 msgr2=0x55a9b3c69030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:52.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.489+0000 7f0e34a00640 1 --2- 172.21.15.3:0/3903147233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a9b3c3de40 0x55a9b3c69030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.489+0000 7f0e34a00640 1 -- 172.21.15.3:0/3903147233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c3e760 msgr2=0x55a9b3c69570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:52.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.489+0000 7f0e34a00640 1 --2- 172.21.15.3:0/3903147233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c3e760 0x55a9b3c69570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.489+0000 7f0e34a00640 1 -- 172.21.15.3:0/3903147233 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9b3c3a200 con 0x55a9b3c49020 2024-09-19T06:18:52.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.489+0000 7f0e2fe00640 1 --2- 172.21.15.3:0/3903147233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a9b3c3de40 0x55a9b3c69030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:52.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.489+0000 7f0e2f400640 1 --2- 172.21.15.3:0/3903147233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c3e760 0x55a9b3c69570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:52.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.489+0000 7f0e34a00640 1 --2- 172.21.15.3:0/3903147233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c49020 0x55a9b3c45e10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0e280117a0 tx=0x7f0e28016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a424e4aa53c7646 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:52.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.490+0000 7f0e1be00640 1 -- 172.21.15.3:0/3903147233 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e28029640 con 0x55a9b3c49020 2024-09-19T06:18:52.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.490+0000 7f0e1be00640 1 -- 172.21.15.3:0/3903147233 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e2801f8f0 con 0x55a9b3c49020 2024-09-19T06:18:52.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.490+0000 7f0e1be00640 1 -- 172.21.15.3:0/3903147233 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e28028a50 con 0x55a9b3c49020 2024-09-19T06:18:52.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.491+0000 7f0e39671740 1 -- 172.21.15.3:0/3903147233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c49020 msgr2=0x55a9b3c45e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:52.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.491+0000 7f0e39671740 1 --2- 172.21.15.3:0/3903147233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c49020 0x55a9b3c45e10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0e280117a0 tx=0x7f0e28016000 comp rx=0 tx=0).stop 2024-09-19T06:18:52.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.491+0000 7f0e39671740 1 -- 172.21.15.3:0/3903147233 shutdown_connections 2024-09-19T06:18:52.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.491+0000 7f0e39671740 1 --2- 172.21.15.3:0/3903147233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c49020 0x55a9b3c45e10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.491+0000 7f0e39671740 1 --2- 172.21.15.3:0/3903147233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c3e760 0x55a9b3c69570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.491+0000 7f0e39671740 1 --2- 172.21.15.3:0/3903147233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a9b3c3de40 0x55a9b3c69030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.491+0000 7f0e39671740 1 -- 172.21.15.3:0/3903147233 >> 172.21.15.3:0/3903147233 conn(0x55a9b3c3a3d0 msgr2=0x55a9b3c47ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:52.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.491+0000 7f0e39671740 1 -- 172.21.15.3:0/3903147233 shutdown_connections 2024-09-19T06:18:52.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.491+0000 7f0e39671740 1 -- 172.21.15.3:0/3903147233 wait complete. 2024-09-19T06:18:52.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.491+0000 7f0e39671740 1 -- start start 2024-09-19T06:18:52.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.491+0000 7f0e39671740 1 Processor -- start 2024-09-19T06:18:52.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.492+0000 7f0e39671740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c3de40 0x55a9b3c59df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:52.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.492+0000 7f0e39671740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a9b3c3e760 0x55a9b3c55120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:52.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.492+0000 7f0e39671740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c49020 0x55a9b3c55660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:52.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.492+0000 7f0e39671740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0e301ac970 con 0x55a9b3c49020 2024-09-19T06:18:52.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.492+0000 7f0e39671740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0e301ac2a0 con 0x55a9b3c3de40 2024-09-19T06:18:52.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.492+0000 7f0e39671740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0e301a94e0 con 0x55a9b3c3e760 2024-09-19T06:18:52.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.492+0000 7f0e39671740 10 client.0 _ll_register_callbacks cb 0x7f0e20009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:52.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.492+0000 7f0e34a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c49020 0x55a9b3c55660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:52.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.492+0000 7f0e2fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c3de40 0x55a9b3c59df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:52.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.492+0000 7f0e2fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c3de40 0x55a9b3c59df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:52738/0 (socket says 172.21.15.3:52738) 2024-09-19T06:18:52.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.492+0000 7f0e2fe00640 1 -- 172.21.15.3:0/3169540425 learned_addr learned my addr 172.21.15.3:0/3169540425 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:52.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.492+0000 7f0e34a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c49020 0x55a9b3c55660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47268/0 (socket says 172.21.15.3:47268) 2024-09-19T06:18:52.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.492+0000 7f0e2f400640 1 --2- 172.21.15.3:0/3169540425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a9b3c3e760 0x55a9b3c55120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:52.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.493+0000 7f0e2fe00640 1 -- 172.21.15.3:0/3169540425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a9b3c3e760 msgr2=0x55a9b3c55120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:52.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.493+0000 7f0e2fe00640 1 --2- 172.21.15.3:0/3169540425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a9b3c3e760 0x55a9b3c55120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.493+0000 7f0e2fe00640 1 -- 172.21.15.3:0/3169540425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c49020 msgr2=0x55a9b3c55660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:52.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.493+0000 7f0e2fe00640 1 --2- 172.21.15.3:0/3169540425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c49020 0x55a9b3c55660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.493+0000 7f0e2fe00640 1 -- 172.21.15.3:0/3169540425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9b3c39c80 con 0x55a9b3c3de40 2024-09-19T06:18:52.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.493+0000 7f0e34a00640 1 --2- 172.21.15.3:0/3169540425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c49020 0x55a9b3c55660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:52.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.493+0000 7f0e2f400640 1 --2- 172.21.15.3:0/3169540425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a9b3c3e760 0x55a9b3c55120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:52.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.493+0000 7f0e2fe00640 1 --2- 172.21.15.3:0/3169540425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c3de40 0x55a9b3c59df0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0e20003f30 tx=0x7f0e20003f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cb3798d2314ea7f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:52.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.493+0000 7f0e19600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:18:52.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.494+0000 7f0e19600640 1 -- 172.21.15.3:0/3169540425 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e2005e020 con 0x55a9b3c3de40 2024-09-19T06:18:52.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.494+0000 7f0e19600640 1 -- 172.21.15.3:0/3169540425 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f0e20004460 con 0x55a9b3c3de40 2024-09-19T06:18:52.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.494+0000 7f0e39671740 1 -- 172.21.15.3:0/3169540425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e2801f8f0 con 0x55a9b3c3de40 2024-09-19T06:18:52.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.494+0000 7f0e19600640 1 -- 172.21.15.3:0/3169540425 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0e20069050 con 0x55a9b3c3de40 2024-09-19T06:18:52.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.494+0000 7f0e39671740 10 client.27098 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:52.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.494+0000 7f0e39671740 1 -- 172.21.15.3:0/3169540425 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a9b3ccbc40 con 0x55a9b3c3de40 2024-09-19T06:18:52.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.494+0000 7f0e19600640 1 -- 172.21.15.3:0/3169540425 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e2801f8f0 con 0x55a9b3c3de40 2024-09-19T06:18:52.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.495+0000 7f0e19600640 1 -- 172.21.15.3:0/3169540425 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0e20004770 con 0x55a9b3c3de40 2024-09-19T06:18:52.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.495+0000 7f0e39671740 10 client.27098 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:52.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.495+0000 7f0e39671740 10 client.27098 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:52.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.495+0000 7f0e39671740 20 client.27098 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:52.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.495+0000 7f0e39671740 1 --2- 172.21.15.3:0/3169540425 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a9b3ccc410 0x55a9b3cce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:52.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.495+0000 7f0e39671740 4 client.27098 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:18:52.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.495+0000 7f0e39671740 1 -- 172.21.15.3:0/3169540425 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a9b3babe60 con 0x55a9b3ccc410 2024-09-19T06:18:52.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.495+0000 7f0e2f400640 1 --2- 172.21.15.3:0/3169540425 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a9b3ccc410 0x55a9b3cce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:52.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.496+0000 7f0e2f400640 1 --2- 172.21.15.3:0/3169540425 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a9b3ccc410 0x55a9b3cce830 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aed0a59a4d10aeab server_cookie=de58010f4dfeb18a in_seq=0 out_seq=0 2024-09-19T06:18:52.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.496+0000 7f0e19600640 10 client.27098 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:52.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.496+0000 7f0e19600640 1 -- 172.21.15.3:0/3169540425 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a9b3babe60 con 0x55a9b3ccc410 2024-09-19T06:18:52.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.496+0000 7f0e19600640 10 client.27098 handle_command_reply: tid=0 2024-09-19T06:18:52.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.496+0000 7f0e39671740 1 client.27098 shutdown 2024-09-19T06:18:52.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.496+0000 7f0e39671740 1 -- 172.21.15.3:0/3169540425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c3de40 msgr2=0x55a9b3c59df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:52.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.496+0000 7f0e39671740 1 --2- 172.21.15.3:0/3169540425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c3de40 0x55a9b3c59df0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0e20003f30 tx=0x7f0e20003f60 comp rx=0 tx=0).stop 2024-09-19T06:18:52.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.496+0000 7f0e39671740 1 -- 172.21.15.3:0/3169540425 shutdown_connections 2024-09-19T06:18:52.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.496+0000 7f0e39671740 1 --2- 172.21.15.3:0/3169540425 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a9b3ccc410 0x55a9b3cce830 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.496+0000 7f0e39671740 1 --2- 172.21.15.3:0/3169540425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a9b3c49020 0x55a9b3c55660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.496+0000 7f0e39671740 1 --2- 172.21.15.3:0/3169540425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a9b3c3e760 0x55a9b3c55120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.496+0000 7f0e39671740 1 --2- 172.21.15.3:0/3169540425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a9b3c3de40 0x55a9b3c59df0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.496+0000 7f0e39671740 1 -- 172.21.15.3:0/3169540425 >> 172.21.15.3:0/3169540425 conn(0x55a9b3c3a3d0 msgr2=0x55a9b3c5c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:52.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.496+0000 7f0e19600640 0 client.27098 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:52.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.496+0000 7f0e39671740 1 -- 172.21.15.3:0/3169540425 shutdown_connections 2024-09-19T06:18:52.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.497+0000 7f0e39671740 1 -- 172.21.15.3:0/3169540425 wait complete. 2024-09-19T06:18:52.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.497+0000 7f0e39671740 20 client.27098 trim_cache size 0 max 16384 2024-09-19T06:18:52.501 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:18:52.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.497+0000 7f0e35400640 1 -- 172.21.15.3:0/1262394143 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0e140a33b0 msgr2=0x7f0e140a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:52.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.497+0000 7f0e35400640 1 --2- 172.21.15.3:0/1262394143 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0e140a33b0 0x7f0e140a5870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0e28005fd0 tx=0x7f0e28009500 comp rx=0 tx=0).stop 2024-09-19T06:18:52.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.497+0000 7f0e35400640 1 -- 172.21.15.3:0/1262394143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e30102360 msgr2=0x7f0e30074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:52.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.497+0000 7f0e35400640 1 --2- 172.21.15.3:0/1262394143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e30102360 0x7f0e30074a30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00e9f0 tx=0x7f0e1c00edf0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.497+0000 7f0e35400640 1 -- 172.21.15.3:0/1262394143 shutdown_connections 2024-09-19T06:18:52.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.497+0000 7f0e35400640 1 --2- 172.21.15.3:0/1262394143 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0e140a33b0 0x7f0e140a5870 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.497+0000 7f0e35400640 1 --2- 172.21.15.3:0/1262394143 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e301079c0 0x7f0e30074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.497+0000 7f0e35400640 1 --2- 172.21.15.3:0/1262394143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e30102360 0x7f0e30074a30 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.497+0000 7f0e35400640 1 --2- 172.21.15.3:0/1262394143 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0e301019c0 0x7f0e300744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:52.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.497+0000 7f0e35400640 1 -- 172.21.15.3:0/1262394143 >> 172.21.15.3:0/1262394143 conn(0x7f0e300fd740 msgr2=0x7f0e300fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:52.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.498+0000 7f0e35400640 1 -- 172.21.15.3:0/1262394143 shutdown_connections 2024-09-19T06:18:52.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:52.498+0000 7f0e35400640 1 -- 172.21.15.3:0/1262394143 wait complete. 2024-09-19T06:18:54.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:53 smithi059 ceph-mon[35138]: pgmap v198: 97 pgs: 97 active+clean; 2.3 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 17 op/s 2024-09-19T06:18:54.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:53 smithi003 ceph-mon[30893]: pgmap v198: 97 pgs: 97 active+clean; 2.3 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 17 op/s 2024-09-19T06:18:54.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:53 smithi071 ceph-mon[35662]: pgmap v198: 97 pgs: 97 active+clean; 2.3 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 17 op/s 2024-09-19T06:18:54.417 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:18:54.417 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:18:54.810 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:55.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.454+0000 7f1601e00640 1 -- 172.21.15.3:0/26701230 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f15fc103ff0 msgr2=0x7f15fc1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:55.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.454+0000 7f1601e00640 1 --2- 172.21.15.3:0/26701230 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f15fc103ff0 0x7f15fc1043d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f15ec009900 tx=0x7f15ec02a410 comp rx=0 tx=0).stop 2024-09-19T06:18:55.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.454+0000 7f1601e00640 1 -- 172.21.15.3:0/26701230 shutdown_connections 2024-09-19T06:18:55.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.454+0000 7f1601e00640 1 --2- 172.21.15.3:0/26701230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15fc109120 0x7f15fc110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.454+0000 7f1601e00640 1 --2- 172.21.15.3:0/26701230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15fc1049a0 0x7f15fc1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.454+0000 7f1601e00640 1 --2- 172.21.15.3:0/26701230 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f15fc103ff0 0x7f15fc1043d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.454+0000 7f1601e00640 1 -- 172.21.15.3:0/26701230 >> 172.21.15.3:0/26701230 conn(0x7f15fc0ffa90 msgr2=0x7f15fc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:55.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.454+0000 7f1601e00640 1 -- 172.21.15.3:0/26701230 shutdown_connections 2024-09-19T06:18:55.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.454+0000 7f1601e00640 1 -- 172.21.15.3:0/26701230 wait complete. 2024-09-19T06:18:55.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.455+0000 7f1601e00640 1 Processor -- start 2024-09-19T06:18:55.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.455+0000 7f1601e00640 1 -- start start 2024-09-19T06:18:55.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.455+0000 7f1601e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15fc103ff0 0x7f15fc19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:55.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.455+0000 7f1601e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15fc1049a0 0x7f15fc19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:55.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.455+0000 7f1601e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f15fc109120 0x7f15fc19eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:55.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.456+0000 7f1601e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc114120 con 0x7f15fc109120 2024-09-19T06:18:55.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.456+0000 7f1601e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc113fa0 con 0x7f15fc103ff0 2024-09-19T06:18:55.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.456+0000 7f1601e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc1142a0 con 0x7f15fc1049a0 2024-09-19T06:18:55.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.456+0000 7f15fb400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f15fc109120 0x7f15fc19eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:55.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.456+0000 7f15fa000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15fc1049a0 0x7f15fc19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:55.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.456+0000 7f15fb400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f15fc109120 0x7f15fc19eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35974/0 (socket says 172.21.15.3:35974) 2024-09-19T06:18:55.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.456+0000 7f15fb400640 1 -- 172.21.15.3:0/3471692610 learned_addr learned my addr 172.21.15.3:0/3471692610 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:55.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.456+0000 7f15faa00640 1 --2- 172.21.15.3:0/3471692610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15fc103ff0 0x7f15fc19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:55.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.456+0000 7f15fa000640 1 -- 172.21.15.3:0/3471692610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15fc103ff0 msgr2=0x7f15fc19a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:55.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.456+0000 7f15fa000640 1 --2- 172.21.15.3:0/3471692610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15fc103ff0 0x7f15fc19a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.456+0000 7f15fa000640 1 -- 172.21.15.3:0/3471692610 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f15fc109120 msgr2=0x7f15fc19eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:55.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.456+0000 7f15fa000640 1 --2- 172.21.15.3:0/3471692610 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f15fc109120 0x7f15fc19eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.456+0000 7f15fa000640 1 -- 172.21.15.3:0/3471692610 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15fc19f590 con 0x7f15fc1049a0 2024-09-19T06:18:55.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.456+0000 7f15fb400640 1 --2- 172.21.15.3:0/3471692610 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f15fc109120 0x7f15fc19eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:55.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.457+0000 7f15fa000640 1 --2- 172.21.15.3:0/3471692610 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15fc1049a0 0x7f15fc19ab20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f15e800e9f0 tx=0x7f15e800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:55.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.457+0000 7f1600a00640 1 -- 172.21.15.3:0/3471692610 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e800ccc0 con 0x7f15fc1049a0 2024-09-19T06:18:55.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.457+0000 7f1601e00640 1 -- 172.21.15.3:0/3471692610 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15fc19f880 con 0x7f15fc1049a0 2024-09-19T06:18:55.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.457+0000 7f1600a00640 1 -- 172.21.15.3:0/3471692610 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15e8010910 con 0x7f15fc1049a0 2024-09-19T06:18:55.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.457+0000 7f1600a00640 1 -- 172.21.15.3:0/3471692610 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e8018960 con 0x7f15fc1049a0 2024-09-19T06:18:55.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.457+0000 7f1601e00640 1 -- 172.21.15.3:0/3471692610 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15fc1a7160 con 0x7f15fc1049a0 2024-09-19T06:18:55.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.460+0000 7f16049f9740 1 Processor -- start 2024-09-19T06:18:55.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.460+0000 7f16049f9740 1 -- start start 2024-09-19T06:18:55.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.460+0000 7f16049f9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a145cac0 0x5597a145cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:55.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.460+0000 7f16049f9740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145d3e0 0x5597a1467760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:55.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.460+0000 7f16049f9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5597a1467ca0 0x5597a146a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:55.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.461+0000 7f16049f9740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5597a13c3290 con 0x5597a145d3e0 2024-09-19T06:18:55.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.461+0000 7f16049f9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5597a136ab40 con 0x5597a145cac0 2024-09-19T06:18:55.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.461+0000 7f16049f9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5597a13bf250 con 0x5597a1467ca0 2024-09-19T06:18:55.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.461+0000 7f15fb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a145cac0 0x5597a145cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:55.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.461+0000 7f1600a00640 1 -- 172.21.15.3:0/3471692610 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f15e8010ac0 con 0x7f15fc1049a0 2024-09-19T06:18:55.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.461+0000 7f15fb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a145cac0 0x5597a145cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:52860/0 (socket says 172.21.15.3:52860) 2024-09-19T06:18:55.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.461+0000 7f15fb400640 1 -- 172.21.15.3:0/2493823374 learned_addr learned my addr 172.21.15.3:0/2493823374 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:55.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.461+0000 7f15faa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145d3e0 0x5597a1467760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:55.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.461+0000 7f15fa000640 1 --2- 172.21.15.3:0/2493823374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5597a1467ca0 0x5597a146a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:55.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.461+0000 7f15fb400640 1 -- 172.21.15.3:0/2493823374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5597a1467ca0 msgr2=0x5597a146a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:55.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.461+0000 7f15fb400640 1 --2- 172.21.15.3:0/2493823374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5597a1467ca0 0x5597a146a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.461+0000 7f15fb400640 1 -- 172.21.15.3:0/2493823374 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145d3e0 msgr2=0x5597a1467760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:55.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.461+0000 7f15fb400640 1 --2- 172.21.15.3:0/2493823374 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145d3e0 0x5597a1467760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.461+0000 7f15fb400640 1 -- 172.21.15.3:0/2493823374 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597a11346a0 con 0x5597a145cac0 2024-09-19T06:18:55.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.461+0000 7f15fa000640 1 --2- 172.21.15.3:0/2493823374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5597a1467ca0 0x5597a146a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:18:55.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.462+0000 7f15fb400640 1 --2- 172.21.15.3:0/2493823374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a145cac0 0x5597a145cea0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f15f4011850 tx=0x7f15f4011d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fda38ee1836887fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:55.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.462+0000 7f15e7e00640 1 -- 172.21.15.3:0/2493823374 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f4011330 con 0x5597a145cac0 2024-09-19T06:18:55.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.462+0000 7f15e7e00640 1 -- 172.21.15.3:0/2493823374 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15f400fe80 con 0x5597a145cac0 2024-09-19T06:18:55.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.462+0000 7f15e7e00640 1 -- 172.21.15.3:0/2493823374 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f40193e0 con 0x5597a145cac0 2024-09-19T06:18:55.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.463+0000 7f16049f9740 1 -- 172.21.15.3:0/2493823374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a145cac0 msgr2=0x5597a145cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:55.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.463+0000 7f16049f9740 1 --2- 172.21.15.3:0/2493823374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a145cac0 0x5597a145cea0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f15f4011850 tx=0x7f15f4011d10 comp rx=0 tx=0).stop 2024-09-19T06:18:55.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.463+0000 7f1600a00640 1 --2- 172.21.15.3:0/3471692610 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f15e00a33b0 0x7f15e00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:55.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.463+0000 7f16049f9740 1 -- 172.21.15.3:0/2493823374 shutdown_connections 2024-09-19T06:18:55.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.463+0000 7f16049f9740 1 --2- 172.21.15.3:0/2493823374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5597a1467ca0 0x5597a146a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.463+0000 7f16049f9740 1 --2- 172.21.15.3:0/2493823374 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145d3e0 0x5597a1467760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.463+0000 7f16049f9740 1 --2- 172.21.15.3:0/2493823374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a145cac0 0x5597a145cea0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.463+0000 7f16049f9740 1 -- 172.21.15.3:0/2493823374 >> 172.21.15.3:0/2493823374 conn(0x5597a1459050 msgr2=0x5597a1459430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:55.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.463+0000 7f1600a00640 1 -- 172.21.15.3:0/3471692610 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f15e80d0110 con 0x7f15fc1049a0 2024-09-19T06:18:55.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.463+0000 7f16049f9740 1 -- 172.21.15.3:0/2493823374 shutdown_connections 2024-09-19T06:18:55.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.463+0000 7f15fb400640 1 --2- 172.21.15.3:0/3471692610 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f15e00a33b0 0x7f15e00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:55.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.463+0000 7f16049f9740 1 -- 172.21.15.3:0/2493823374 wait complete. 2024-09-19T06:18:55.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.464+0000 7f16049f9740 1 -- start start 2024-09-19T06:18:55.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.464+0000 7f15fb400640 1 --2- 172.21.15.3:0/3471692610 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f15e00a33b0 0x7f15e00a5870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f15f40049d0 tx=0x7f15f4010a90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:55.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.464+0000 7f16049f9740 1 Processor -- start 2024-09-19T06:18:55.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.465+0000 7f16049f9740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145cac0 0x5597a1467520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:55.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.465+0000 7f16049f9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5597a145d3e0 0x5597a14647d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:55.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.465+0000 7f16049f9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a1467ca0 0x5597a1464d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:55.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.465+0000 7f16049f9740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5597a146a910 con 0x5597a145cac0 2024-09-19T06:18:55.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.465+0000 7f16049f9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5597a137dfa0 con 0x5597a1467ca0 2024-09-19T06:18:55.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.465+0000 7f16049f9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5597a146aa90 con 0x5597a145d3e0 2024-09-19T06:18:55.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.465+0000 7f16049f9740 10 client.0 _ll_register_callbacks cb 0x5597a10d1ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:55.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.465+0000 7f15fa000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5597a145d3e0 0x5597a14647d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:55.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.465+0000 7f15faa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145cac0 0x5597a1467520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:55.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.466+0000 7f15faa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145cac0 0x5597a1467520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35984/0 (socket says 172.21.15.3:35984) 2024-09-19T06:18:55.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.466+0000 7f15fa000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5597a145d3e0 0x5597a14647d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:49796/0 (socket says 172.21.15.3:49796) 2024-09-19T06:18:55.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.466+0000 7f15faa00640 1 -- 172.21.15.3:0/1448896516 learned_addr learned my addr 172.21.15.3:0/1448896516 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:55.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.466+0000 7f15fb400640 1 --2- 172.21.15.3:0/1448896516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a1467ca0 0x5597a1464d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:55.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.466+0000 7f15faa00640 1 -- 172.21.15.3:0/1448896516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5597a145d3e0 msgr2=0x5597a14647d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:55.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.466+0000 7f15faa00640 1 --2- 172.21.15.3:0/1448896516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5597a145d3e0 0x5597a14647d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.466+0000 7f15faa00640 1 -- 172.21.15.3:0/1448896516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a1467ca0 msgr2=0x5597a1464d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:55.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.466+0000 7f15faa00640 1 --2- 172.21.15.3:0/1448896516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a1467ca0 0x5597a1464d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.466+0000 7f15faa00640 1 -- 172.21.15.3:0/1448896516 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597a14654f0 con 0x5597a145cac0 2024-09-19T06:18:55.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.466+0000 7f15fa000640 1 --2- 172.21.15.3:0/1448896516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5597a145d3e0 0x5597a14647d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:55.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.466+0000 7f15faa00640 1 --2- 172.21.15.3:0/1448896516 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145cac0 0x5597a1467520 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f15ec02a930 tx=0x7f15ec0317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60af45a1234d2ef5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:55.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.466+0000 7f15e4c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:18:55.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.467+0000 7f15e4c00640 1 -- 172.21.15.3:0/1448896516 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ec035040 con 0x5597a145cac0 2024-09-19T06:18:55.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.467+0000 7f15e4c00640 1 -- 172.21.15.3:0/1448896516 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f15ec004240 con 0x5597a145cac0 2024-09-19T06:18:55.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.467+0000 7f16049f9740 1 -- 172.21.15.3:0/1448896516 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5597a13d0800 con 0x5597a145cac0 2024-09-19T06:18:55.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.467+0000 7f15e4c00640 1 -- 172.21.15.3:0/1448896516 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f15ec004440 con 0x5597a145cac0 2024-09-19T06:18:55.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.467+0000 7f16049f9740 10 client.17070 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:55.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.467+0000 7f16049f9740 1 -- 172.21.15.3:0/1448896516 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5597a14766e0 con 0x5597a145cac0 2024-09-19T06:18:55.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.468+0000 7f15e4c00640 1 -- 172.21.15.3:0/1448896516 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5597a13d0800 con 0x5597a145cac0 2024-09-19T06:18:55.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.468+0000 7f15e4c00640 1 -- 172.21.15.3:0/1448896516 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f15ec03d5f0 con 0x5597a145cac0 2024-09-19T06:18:55.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.468+0000 7f16049f9740 10 client.17070 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:55.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.468+0000 7f16049f9740 10 client.17070 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:55.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.468+0000 7f16049f9740 20 client.17070 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:55.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.468+0000 7f16049f9740 1 --2- 172.21.15.3:0/1448896516 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5597a1477ba0 0x5597a147a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:55.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.468+0000 7f16049f9740 4 client.17070 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:55.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.468+0000 7f16049f9740 1 -- 172.21.15.3:0/1448896516 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597a13cad10 con 0x5597a1477ba0 2024-09-19T06:18:55.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.468+0000 7f15fa000640 1 --2- 172.21.15.3:0/1448896516 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5597a1477ba0 0x5597a147a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:55.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.469+0000 7f15fa000640 1 --2- 172.21.15.3:0/1448896516 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5597a1477ba0 0x5597a147a010 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=229d54388393e8a3 server_cookie=76fb3f3e75ff05db in_seq=0 out_seq=0 2024-09-19T06:18:55.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.469+0000 7f15e4c00640 10 client.17070 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:55.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.469+0000 7f15e4c00640 1 -- 172.21.15.3:0/1448896516 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5597a13cad10 con 0x5597a1477ba0 2024-09-19T06:18:55.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.469+0000 7f15e4c00640 10 client.17070 handle_command_reply: tid=0 2024-09-19T06:18:55.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.470+0000 7f16049f9740 1 client.17070 shutdown 2024-09-19T06:18:55.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.470+0000 7f16049f9740 1 -- 172.21.15.3:0/1448896516 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145cac0 msgr2=0x5597a1467520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:55.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.470+0000 7f16049f9740 1 --2- 172.21.15.3:0/1448896516 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145cac0 0x5597a1467520 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f15ec02a930 tx=0x7f15ec0317e0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.470+0000 7f16049f9740 1 -- 172.21.15.3:0/1448896516 shutdown_connections 2024-09-19T06:18:55.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.470+0000 7f16049f9740 1 --2- 172.21.15.3:0/1448896516 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5597a1477ba0 0x5597a147a010 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.470+0000 7f16049f9740 1 --2- 172.21.15.3:0/1448896516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a1467ca0 0x5597a1464d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.470+0000 7f16049f9740 1 --2- 172.21.15.3:0/1448896516 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5597a145d3e0 0x5597a14647d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.470+0000 7f16049f9740 1 --2- 172.21.15.3:0/1448896516 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145cac0 0x5597a1467520 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.470+0000 7f15e4c00640 0 client.17070 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:55.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.470+0000 7f16049f9740 1 -- 172.21.15.3:0/1448896516 >> 172.21.15.3:0/1448896516 conn(0x5597a1459050 msgr2=0x5597a14581c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:55.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.470+0000 7f16049f9740 1 -- 172.21.15.3:0/1448896516 shutdown_connections 2024-09-19T06:18:55.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.470+0000 7f16049f9740 1 -- 172.21.15.3:0/1448896516 wait complete. 2024-09-19T06:18:55.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.470+0000 7f16049f9740 20 client.17070 trim_cache size 0 max 16384 2024-09-19T06:18:55.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.488+0000 7f16049f9740 1 Processor -- start 2024-09-19T06:18:55.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.489+0000 7f16049f9740 1 -- start start 2024-09-19T06:18:55.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.489+0000 7f16049f9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a1459050 0x5597a1466740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:55.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.489+0000 7f16049f9740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145cac0 0x5597a147f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:55.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.489+0000 7f16049f9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5597a145d3e0 0x5597a147fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:55.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.489+0000 7f16049f9740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc1afa50 con 0x5597a145cac0 2024-09-19T06:18:55.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.489+0000 7f16049f9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc1b1590 con 0x5597a1459050 2024-09-19T06:18:55.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.489+0000 7f16049f9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc1b0120 con 0x5597a145d3e0 2024-09-19T06:18:55.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.489+0000 7f15fa000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145cac0 0x5597a147f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:55.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.489+0000 7f15faa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a1459050 0x5597a1466740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:55.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.489+0000 7f15fa000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145cac0 0x5597a147f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35998/0 (socket says 172.21.15.3:35998) 2024-09-19T06:18:55.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.489+0000 7f15fa000640 1 -- 172.21.15.3:0/1143803800 learned_addr learned my addr 172.21.15.3:0/1143803800 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:55.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.489+0000 7f15fb400640 1 --2- 172.21.15.3:0/1143803800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5597a145d3e0 0x5597a147fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:55.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.490+0000 7f15fa000640 1 -- 172.21.15.3:0/1143803800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5597a145d3e0 msgr2=0x5597a147fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:55.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.490+0000 7f15fa000640 1 --2- 172.21.15.3:0/1143803800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5597a145d3e0 0x5597a147fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.490+0000 7f15fa000640 1 -- 172.21.15.3:0/1143803800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a1459050 msgr2=0x5597a1466740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:55.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.490+0000 7f15fa000640 1 --2- 172.21.15.3:0/1143803800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a1459050 0x5597a1466740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.490+0000 7f15fa000640 1 -- 172.21.15.3:0/1143803800 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597a1463780 con 0x5597a145cac0 2024-09-19T06:18:55.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.490+0000 7f15fa000640 1 --2- 172.21.15.3:0/1143803800 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145cac0 0x5597a147f930 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f15e80cd860 tx=0x7f15e80bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e53da554cf79009 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:55.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.490+0000 7f15e7400640 1 -- 172.21.15.3:0/1143803800 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e809a740 con 0x5597a145cac0 2024-09-19T06:18:55.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.490+0000 7f15e7400640 1 -- 172.21.15.3:0/1143803800 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15e80cda80 con 0x5597a145cac0 2024-09-19T06:18:55.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.491+0000 7f15e7400640 1 -- 172.21.15.3:0/1143803800 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e809ba90 con 0x5597a145cac0 2024-09-19T06:18:55.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.491+0000 7f16049f9740 1 -- 172.21.15.3:0/1143803800 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145cac0 msgr2=0x5597a147f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:55.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.491+0000 7f16049f9740 1 --2- 172.21.15.3:0/1143803800 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145cac0 0x5597a147f930 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f15e80cd860 tx=0x7f15e80bc040 comp rx=0 tx=0).stop 2024-09-19T06:18:55.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.491+0000 7f16049f9740 1 -- 172.21.15.3:0/1143803800 shutdown_connections 2024-09-19T06:18:55.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.491+0000 7f16049f9740 1 --2- 172.21.15.3:0/1143803800 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5597a145d3e0 0x5597a147fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.491+0000 7f16049f9740 1 --2- 172.21.15.3:0/1143803800 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145cac0 0x5597a147f930 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.491+0000 7f16049f9740 1 --2- 172.21.15.3:0/1143803800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a1459050 0x5597a1466740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.491+0000 7f16049f9740 1 -- 172.21.15.3:0/1143803800 >> 172.21.15.3:0/1143803800 conn(0x5597a1464e70 msgr2=0x5597a1466030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:55.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.491+0000 7f16049f9740 1 -- 172.21.15.3:0/1143803800 shutdown_connections 2024-09-19T06:18:55.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.491+0000 7f16049f9740 1 -- 172.21.15.3:0/1143803800 wait complete. 2024-09-19T06:18:55.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.492+0000 7f16049f9740 1 -- start start 2024-09-19T06:18:55.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.492+0000 7f16049f9740 1 Processor -- start 2024-09-19T06:18:55.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.492+0000 7f16049f9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5597a1459050 0x5597a146da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:55.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.492+0000 7f16049f9740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145cac0 0x5597a146dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:55.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.492+0000 7f16049f9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a145d3e0 0x5597a146e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:55.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.492+0000 7f16049f9740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc1b0ec0 con 0x5597a145cac0 2024-09-19T06:18:55.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.492+0000 7f16049f9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc1b07f0 con 0x5597a145d3e0 2024-09-19T06:18:55.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.492+0000 7f16049f9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc1ada30 con 0x5597a1459050 2024-09-19T06:18:55.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.492+0000 7f16049f9740 10 client.0 _ll_register_callbacks cb 0x7f15ec005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:55.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.493+0000 7f15fa000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145cac0 0x5597a146dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:55.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.493+0000 7f15fa000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145cac0 0x5597a146dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36004/0 (socket says 172.21.15.3:36004) 2024-09-19T06:18:55.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.493+0000 7f15fa000640 1 -- 172.21.15.3:0/3350262140 learned_addr learned my addr 172.21.15.3:0/3350262140 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:55.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.493+0000 7f15faa00640 1 --2- 172.21.15.3:0/3350262140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5597a1459050 0x5597a146da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:55.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.493+0000 7f15fb400640 1 --2- 172.21.15.3:0/3350262140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a145d3e0 0x5597a146e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:55.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.493+0000 7f15fa000640 1 -- 172.21.15.3:0/3350262140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5597a1459050 msgr2=0x5597a146da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:55.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.493+0000 7f15fa000640 1 --2- 172.21.15.3:0/3350262140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5597a1459050 0x5597a146da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.493+0000 7f15fa000640 1 -- 172.21.15.3:0/3350262140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a145d3e0 msgr2=0x5597a146e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:55.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.493+0000 7f15fa000640 1 --2- 172.21.15.3:0/3350262140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a145d3e0 0x5597a146e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.493+0000 7f15fa000640 1 -- 172.21.15.3:0/3350262140 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597a14e1940 con 0x5597a145cac0 2024-09-19T06:18:55.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.494+0000 7f15fa000640 1 --2- 172.21.15.3:0/3350262140 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145cac0 0x5597a146dfb0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f15e80bafd0 tx=0x7f15e80a50e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779c0f70ef050c99 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:55.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.494+0000 7f15e4c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:18:55.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.494+0000 7f15e4c00640 1 -- 172.21.15.3:0/3350262140 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e80b5230 con 0x5597a145cac0 2024-09-19T06:18:55.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.494+0000 7f16049f9740 1 -- 172.21.15.3:0/3350262140 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15e80cda80 con 0x5597a145cac0 2024-09-19T06:18:55.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.494+0000 7f15e4c00640 1 -- 172.21.15.3:0/3350262140 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f15e80d2070 con 0x5597a145cac0 2024-09-19T06:18:55.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.494+0000 7f15e4c00640 1 -- 172.21.15.3:0/3350262140 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f15e80d22b0 con 0x5597a145cac0 2024-09-19T06:18:55.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.494+0000 7f16049f9740 10 client.17076 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:55.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.494+0000 7f16049f9740 1 -- 172.21.15.3:0/3350262140 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5597a14e2c40 con 0x5597a145cac0 2024-09-19T06:18:55.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.494+0000 7f15e4c00640 1 -- 172.21.15.3:0/3350262140 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15e80cda80 con 0x5597a145cac0 2024-09-19T06:18:55.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.494+0000 7f15e4c00640 1 -- 172.21.15.3:0/3350262140 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f15e8098190 con 0x5597a145cac0 2024-09-19T06:18:55.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.495+0000 7f16049f9740 10 client.17076 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:55.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.495+0000 7f16049f9740 10 client.17076 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:55.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.495+0000 7f16049f9740 20 client.17076 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:55.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.495+0000 7f16049f9740 1 --2- 172.21.15.3:0/3350262140 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5597a1467ca0 0x5597a14e52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:55.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.495+0000 7f16049f9740 4 client.17076 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:18:55.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.495+0000 7f16049f9740 1 -- 172.21.15.3:0/3350262140 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5597a1346fb0 con 0x5597a1467ca0 2024-09-19T06:18:55.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.495+0000 7f15faa00640 1 --2- 172.21.15.3:0/3350262140 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5597a1467ca0 0x5597a14e52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:55.500 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.496+0000 7f15faa00640 1 --2- 172.21.15.3:0/3350262140 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5597a1467ca0 0x5597a14e52d0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=260b971e6daef4a4 server_cookie=dad6756380134a39 in_seq=0 out_seq=0 2024-09-19T06:18:55.501 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.496+0000 7f15e4c00640 10 client.17076 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:55.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.497+0000 7f15e4c00640 1 -- 172.21.15.3:0/3350262140 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5597a1346fb0 con 0x5597a1467ca0 2024-09-19T06:18:55.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.497+0000 7f15e4c00640 10 client.17076 handle_command_reply: tid=0 2024-09-19T06:18:55.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.497+0000 7f16049f9740 1 client.17076 shutdown 2024-09-19T06:18:55.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.497+0000 7f16049f9740 1 -- 172.21.15.3:0/3350262140 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145cac0 msgr2=0x5597a146dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:55.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.497+0000 7f16049f9740 1 --2- 172.21.15.3:0/3350262140 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145cac0 0x5597a146dfb0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f15e80bafd0 tx=0x7f15e80a50e0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.497+0000 7f16049f9740 1 -- 172.21.15.3:0/3350262140 shutdown_connections 2024-09-19T06:18:55.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.497+0000 7f16049f9740 1 --2- 172.21.15.3:0/3350262140 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5597a1467ca0 0x5597a14e52d0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.497+0000 7f16049f9740 1 --2- 172.21.15.3:0/3350262140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5597a145d3e0 0x5597a146e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.497+0000 7f16049f9740 1 --2- 172.21.15.3:0/3350262140 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5597a145cac0 0x5597a146dfb0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.497+0000 7f16049f9740 1 --2- 172.21.15.3:0/3350262140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5597a1459050 0x5597a146da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.497+0000 7f16049f9740 1 -- 172.21.15.3:0/3350262140 >> 172.21.15.3:0/3350262140 conn(0x5597a1464e70 msgr2=0x5597a1466850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:55.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.497+0000 7f15e4c00640 0 client.17076 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:55.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.498+0000 7f16049f9740 1 -- 172.21.15.3:0/3350262140 shutdown_connections 2024-09-19T06:18:55.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.498+0000 7f16049f9740 1 -- 172.21.15.3:0/3350262140 wait complete. 2024-09-19T06:18:55.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.498+0000 7f16049f9740 20 client.17076 trim_cache size 0 max 16384 2024-09-19T06:18:55.503 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:18:55.503 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": 0, 2024-09-19T06:18:55.503 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_tag": "5a26eac1-ba58-4f80-9feb-ee850cc8eabc", 2024-09-19T06:18:55.503 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": "asynchronous" 2024-09-19T06:18:55.503 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:18:55.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.498+0000 7f1601e00640 1 -- 172.21.15.3:0/3471692610 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f15e00a33b0 msgr2=0x7f15e00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:55.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.498+0000 7f1601e00640 1 --2- 172.21.15.3:0/3471692610 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f15e00a33b0 0x7f15e00a5870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f15f40049d0 tx=0x7f15f4010a90 comp rx=0 tx=0).stop 2024-09-19T06:18:55.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.498+0000 7f1601e00640 1 -- 172.21.15.3:0/3471692610 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15fc1049a0 msgr2=0x7f15fc19ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:55.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.498+0000 7f1601e00640 1 --2- 172.21.15.3:0/3471692610 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15fc1049a0 0x7f15fc19ab20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f15e800e9f0 tx=0x7f15e800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.498+0000 7f1601e00640 1 -- 172.21.15.3:0/3471692610 shutdown_connections 2024-09-19T06:18:55.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.498+0000 7f1601e00640 1 --2- 172.21.15.3:0/3471692610 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f15e00a33b0 0x7f15e00a5870 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.499+0000 7f1601e00640 1 --2- 172.21.15.3:0/3471692610 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f15fc109120 0x7f15fc19eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.499+0000 7f1601e00640 1 --2- 172.21.15.3:0/3471692610 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f15fc1049a0 0x7f15fc19ab20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.499+0000 7f1601e00640 1 --2- 172.21.15.3:0/3471692610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15fc103ff0 0x7f15fc19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:55.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.499+0000 7f1601e00640 1 -- 172.21.15.3:0/3471692610 >> 172.21.15.3:0/3471692610 conn(0x7f15fc0ffa90 msgr2=0x7f15fc100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:55.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.499+0000 7f1601e00640 1 -- 172.21.15.3:0/3471692610 shutdown_connections 2024-09-19T06:18:55.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:55.499+0000 7f1601e00640 1 -- 172.21.15.3:0/3471692610 wait complete. 2024-09-19T06:18:55.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:55 smithi003 ceph-mon[30893]: pgmap v199: 97 pgs: 97 active+clean; 2.5 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-19T06:18:56.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:55 smithi059 ceph-mon[35138]: pgmap v199: 97 pgs: 97 active+clean; 2.5 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-19T06:18:56.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:55 smithi071 ceph-mon[35662]: pgmap v199: 97 pgs: 97 active+clean; 2.5 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-19T06:18:56.306 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:18:56.683 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:18:57.002 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:56 smithi003 ceph-mon[30893]: scrub queued for path: / 2024-09-19T06:18:57.002 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:56 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:18:57.002 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:56 smithi003 ceph-mon[30893]: scrub summary: active paths [/] 2024-09-19T06:18:57.002 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:56 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:18:57.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:56 smithi059 ceph-mon[35138]: scrub queued for path: / 2024-09-19T06:18:57.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:56 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:18:57.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:56 smithi059 ceph-mon[35138]: scrub summary: active paths [/] 2024-09-19T06:18:57.039 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:56 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:18:57.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:56 smithi071 ceph-mon[35662]: scrub queued for path: / 2024-09-19T06:18:57.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:56 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:18:57.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:56 smithi071 ceph-mon[35662]: scrub summary: active paths [/] 2024-09-19T06:18:57.086 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:56 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:18:57.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.280+0000 7f89db600640 1 -- 172.21.15.3:0/397954825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89d41027a0 msgr2=0x7f89d41067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:57.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.280+0000 7f89db600640 1 --2- 172.21.15.3:0/397954825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89d41027a0 0x7f89d41067f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f89c0009860 tx=0x7f89c002a340 comp rx=0 tx=0).stop 2024-09-19T06:18:57.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.280+0000 7f89db600640 1 -- 172.21.15.3:0/397954825 shutdown_connections 2024-09-19T06:18:57.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.280+0000 7f89db600640 1 --2- 172.21.15.3:0/397954825 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89d4106f20 0x7f89d410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.280+0000 7f89db600640 1 --2- 172.21.15.3:0/397954825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89d41027a0 0x7f89d41067f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.280+0000 7f89db600640 1 --2- 172.21.15.3:0/397954825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89d4101df0 0x7f89d41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.280+0000 7f89db600640 1 -- 172.21.15.3:0/397954825 >> 172.21.15.3:0/397954825 conn(0x7f89d40fd8b0 msgr2=0x7f89d40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:57.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.280+0000 7f89db600640 1 -- 172.21.15.3:0/397954825 shutdown_connections 2024-09-19T06:18:57.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.280+0000 7f89db600640 1 -- 172.21.15.3:0/397954825 wait complete. 2024-09-19T06:18:57.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.281+0000 7f89db600640 1 Processor -- start 2024-09-19T06:18:57.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.281+0000 7f89db600640 1 -- start start 2024-09-19T06:18:57.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.281+0000 7f89db600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89d4101df0 0x7f89d419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:57.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.281+0000 7f89db600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89d41027a0 0x7f89d419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:57.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.281+0000 7f89db600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89d4106f20 0x7f89d419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:57.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.281+0000 7f89db600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f89d4111f80 con 0x7f89d4106f20 2024-09-19T06:18:57.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.281+0000 7f89db600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f89d4111e00 con 0x7f89d4101df0 2024-09-19T06:18:57.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.282+0000 7f89db600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f89d4112100 con 0x7f89d41027a0 2024-09-19T06:18:57.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.282+0000 7f89d8c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89d4101df0 0x7f89d419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:57.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.282+0000 7f89d9600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89d4106f20 0x7f89d419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:57.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.282+0000 7f89d8c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89d4101df0 0x7f89d419a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:52902/0 (socket says 172.21.15.3:52902) 2024-09-19T06:18:57.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.282+0000 7f89d8c00640 1 -- 172.21.15.3:0/541128131 learned_addr learned my addr 172.21.15.3:0/541128131 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:57.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.282+0000 7f89d3e00640 1 --2- 172.21.15.3:0/541128131 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89d41027a0 0x7f89d419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:57.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.282+0000 7f89d8c00640 1 -- 172.21.15.3:0/541128131 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89d41027a0 msgr2=0x7f89d419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:57.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.282+0000 7f89d8c00640 1 --2- 172.21.15.3:0/541128131 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89d41027a0 0x7f89d419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.282+0000 7f89d8c00640 1 -- 172.21.15.3:0/541128131 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89d4106f20 msgr2=0x7f89d419eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:57.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.282+0000 7f89d8c00640 1 --2- 172.21.15.3:0/541128131 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89d4106f20 0x7f89d419eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.282+0000 7f89d8c00640 1 -- 172.21.15.3:0/541128131 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d419f5d0 con 0x7f89d4101df0 2024-09-19T06:18:57.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.283+0000 7f89d8c00640 1 --2- 172.21.15.3:0/541128131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89d4101df0 0x7f89d419a620 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f89c800e9f0 tx=0x7f89c800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:57.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.283+0000 7f89d1600640 1 -- 172.21.15.3:0/541128131 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c800cd80 con 0x7f89d4101df0 2024-09-19T06:18:57.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.283+0000 7f89db600640 1 -- 172.21.15.3:0/541128131 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d419f8c0 con 0x7f89d4101df0 2024-09-19T06:18:57.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.283+0000 7f89d1600640 1 -- 172.21.15.3:0/541128131 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89c8010910 con 0x7f89d4101df0 2024-09-19T06:18:57.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.283+0000 7f89d1600640 1 -- 172.21.15.3:0/541128131 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c80188f0 con 0x7f89d4101df0 2024-09-19T06:18:57.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.283+0000 7f89db600640 1 -- 172.21.15.3:0/541128131 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d41a71a0 con 0x7f89d4101df0 2024-09-19T06:18:57.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.286+0000 7f89de0d8740 1 Processor -- start 2024-09-19T06:18:57.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.286+0000 7f89de0d8740 1 -- start start 2024-09-19T06:18:57.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.286+0000 7f89d1600640 1 -- 172.21.15.3:0/541128131 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f89c8010ac0 con 0x7f89d4101df0 2024-09-19T06:18:57.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.287+0000 7f89de0d8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557a6f7eeb90 0x557a6f7eef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:57.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.287+0000 7f89de0d8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a6f7ef4b0 0x557a6f7f9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:57.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.287+0000 7f89de0d8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a6f7f9d70 0x557a6f7fc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:57.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.287+0000 7f89de0d8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557a6f7553e0 con 0x557a6f7eeb90 2024-09-19T06:18:57.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.287+0000 7f89de0d8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557a6f6fcd80 con 0x557a6f7ef4b0 2024-09-19T06:18:57.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.287+0000 7f89de0d8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557a6f7513a0 con 0x557a6f7f9d70 2024-09-19T06:18:57.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.287+0000 7f89d9600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557a6f7eeb90 0x557a6f7eef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:57.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.287+0000 7f89d9600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557a6f7eeb90 0x557a6f7eef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36020/0 (socket says 172.21.15.3:36020) 2024-09-19T06:18:57.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.287+0000 7f89d9600640 1 -- 172.21.15.3:0/2603356663 learned_addr learned my addr 172.21.15.3:0/2603356663 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:57.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.287+0000 7f89d8c00640 1 --2- 172.21.15.3:0/2603356663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a6f7ef4b0 0x557a6f7f9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:57.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.287+0000 7f89d3e00640 1 --2- 172.21.15.3:0/2603356663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a6f7f9d70 0x557a6f7fc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:57.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.287+0000 7f89d9600640 1 -- 172.21.15.3:0/2603356663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a6f7f9d70 msgr2=0x557a6f7fc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:57.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.287+0000 7f89d9600640 1 --2- 172.21.15.3:0/2603356663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a6f7f9d70 0x557a6f7fc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.288+0000 7f89d9600640 1 -- 172.21.15.3:0/2603356663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a6f7ef4b0 msgr2=0x557a6f7f9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:57.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.288+0000 7f89d9600640 1 --2- 172.21.15.3:0/2603356663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a6f7ef4b0 0x557a6f7f9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.288+0000 7f89d9600640 1 -- 172.21.15.3:0/2603356663 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a6f71bae0 con 0x557a6f7eeb90 2024-09-19T06:18:57.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.288+0000 7f89d9600640 1 --2- 172.21.15.3:0/2603356663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557a6f7eeb90 0x557a6f7eef70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0099f0 tx=0x7f89cc0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41ac1fdc106e73 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:57.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.288+0000 7f89c5c00640 1 -- 172.21.15.3:0/2603356663 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc01d070 con 0x557a6f7eeb90 2024-09-19T06:18:57.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.288+0000 7f89c5c00640 1 -- 172.21.15.3:0/2603356663 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89cc003e40 con 0x557a6f7eeb90 2024-09-19T06:18:57.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.288+0000 7f89c5c00640 1 -- 172.21.15.3:0/2603356663 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc00dba0 con 0x557a6f7eeb90 2024-09-19T06:18:57.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.289+0000 7f89de0d8740 1 -- 172.21.15.3:0/2603356663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557a6f7eeb90 msgr2=0x557a6f7eef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:57.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.289+0000 7f89de0d8740 1 --2- 172.21.15.3:0/2603356663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557a6f7eeb90 0x557a6f7eef70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0099f0 tx=0x7f89cc0095c0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.289+0000 7f89d1600640 1 --2- 172.21.15.3:0/541128131 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f89bc0a33b0 0x7f89bc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:57.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.289+0000 7f89d1600640 1 -- 172.21.15.3:0/541128131 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f89c80d0110 con 0x7f89d4101df0 2024-09-19T06:18:57.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.289+0000 7f89de0d8740 1 -- 172.21.15.3:0/2603356663 shutdown_connections 2024-09-19T06:18:57.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.289+0000 7f89de0d8740 1 --2- 172.21.15.3:0/2603356663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a6f7f9d70 0x557a6f7fc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.289+0000 7f89de0d8740 1 --2- 172.21.15.3:0/2603356663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a6f7ef4b0 0x557a6f7f9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.289+0000 7f89de0d8740 1 --2- 172.21.15.3:0/2603356663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557a6f7eeb90 0x557a6f7eef70 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.289+0000 7f89de0d8740 1 -- 172.21.15.3:0/2603356663 >> 172.21.15.3:0/2603356663 conn(0x557a6f7eb120 msgr2=0x557a6f7eb500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:57.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.290+0000 7f89de0d8740 1 -- 172.21.15.3:0/2603356663 shutdown_connections 2024-09-19T06:18:57.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.290+0000 7f89d9600640 1 --2- 172.21.15.3:0/541128131 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f89bc0a33b0 0x7f89bc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:57.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.290+0000 7f89de0d8740 1 -- 172.21.15.3:0/2603356663 wait complete. 2024-09-19T06:18:57.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.290+0000 7f89de0d8740 1 -- start start 2024-09-19T06:18:57.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.290+0000 7f89d9600640 1 --2- 172.21.15.3:0/541128131 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f89bc0a33b0 0x7f89bc0a5870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f89cc005c10 tx=0x7f89cc009a20 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:57.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.291+0000 7f89de0d8740 1 Processor -- start 2024-09-19T06:18:57.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.291+0000 7f89de0d8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a6f7eeb90 0x557a6f7f6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:57.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.291+0000 7f89de0d8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a6f7ef4b0 0x557a6f7f7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:57.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.291+0000 7f89de0d8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557a6f7f9d70 0x557a6f7f7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:57.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.292+0000 7f89de0d8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557a6f7fc9e0 con 0x557a6f7f9d70 2024-09-19T06:18:57.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.292+0000 7f89de0d8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557a6f7100f0 con 0x557a6f7ef4b0 2024-09-19T06:18:57.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.292+0000 7f89de0d8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557a6f7fcb60 con 0x557a6f7eeb90 2024-09-19T06:18:57.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.292+0000 7f89de0d8740 10 client.0 _ll_register_callbacks cb 0x557a6f7019e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:57.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.292+0000 7f89d9600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557a6f7f9d70 0x557a6f7f7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:57.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.292+0000 7f89d8c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a6f7eeb90 0x557a6f7f6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:57.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.292+0000 7f89d8c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a6f7eeb90 0x557a6f7f6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:49864/0 (socket says 172.21.15.3:49864) 2024-09-19T06:18:57.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.292+0000 7f89d3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a6f7ef4b0 0x557a6f7f7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:57.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.292+0000 7f89d8c00640 1 -- 172.21.15.3:0/1719322032 learned_addr learned my addr 172.21.15.3:0/1719322032 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:57.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.292+0000 7f89d8c00640 1 -- 172.21.15.3:0/1719322032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a6f7ef4b0 msgr2=0x557a6f7f7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:57.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.292+0000 7f89d8c00640 1 --2- 172.21.15.3:0/1719322032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a6f7ef4b0 0x557a6f7f7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.292+0000 7f89d8c00640 1 -- 172.21.15.3:0/1719322032 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557a6f7f9d70 msgr2=0x557a6f7f7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:57.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.292+0000 7f89d8c00640 1 --2- 172.21.15.3:0/1719322032 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557a6f7f9d70 0x557a6f7f7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.292+0000 7f89d8c00640 1 -- 172.21.15.3:0/1719322032 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a6f4c63c0 con 0x557a6f7eeb90 2024-09-19T06:18:57.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.293+0000 7f89d8c00640 1 --2- 172.21.15.3:0/1719322032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a6f7eeb90 0x557a6f7f6cd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f89c800e9c0 tx=0x7f89c80980d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44127d89a396f2ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:57.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.293+0000 7f89ba000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:18:57.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.293+0000 7f89ba000640 1 -- 172.21.15.3:0/1719322032 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c809bda0 con 0x557a6f7eeb90 2024-09-19T06:18:57.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.293+0000 7f89ba000640 1 -- 172.21.15.3:0/1719322032 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f89c80d20d0 con 0x557a6f7eeb90 2024-09-19T06:18:57.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.293+0000 7f89de0d8740 1 -- 172.21.15.3:0/1719322032 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557a6f762950 con 0x557a6f7eeb90 2024-09-19T06:18:57.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.293+0000 7f89ba000640 1 -- 172.21.15.3:0/1719322032 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f89c80cdc80 con 0x557a6f7eeb90 2024-09-19T06:18:57.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.293+0000 7f89de0d8740 10 client.27121 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:57.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.293+0000 7f89de0d8740 1 -- 172.21.15.3:0/1719322032 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557a6f808760 con 0x557a6f7eeb90 2024-09-19T06:18:57.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.293+0000 7f89ba000640 1 -- 172.21.15.3:0/1719322032 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x557a6f762950 con 0x557a6f7eeb90 2024-09-19T06:18:57.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.294+0000 7f89ba000640 1 -- 172.21.15.3:0/1719322032 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f89c809b890 con 0x557a6f7eeb90 2024-09-19T06:18:57.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.294+0000 7f89de0d8740 10 client.27121 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:57.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.294+0000 7f89de0d8740 10 client.27121 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:57.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.294+0000 7f89de0d8740 20 client.27121 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:57.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.294+0000 7f89de0d8740 1 --2- 172.21.15.3:0/1719322032 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x557a6f809c70 0x557a6f80c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:57.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.294+0000 7f89de0d8740 4 client.27121 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:18:57.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.294+0000 7f89de0d8740 1 -- 172.21.15.3:0/1719322032 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a6f75ce60 con 0x557a6f809c70 2024-09-19T06:18:57.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.294+0000 7f89d3e00640 1 --2- 172.21.15.3:0/1719322032 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x557a6f809c70 0x557a6f80c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:57.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.295+0000 7f89d3e00640 1 --2- 172.21.15.3:0/1719322032 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x557a6f809c70 0x557a6f80c0c0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=576c668abdd02574 server_cookie=99ba19be2afa55cc in_seq=0 out_seq=0 2024-09-19T06:18:57.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.295+0000 7f89ba000640 10 client.27121 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:57.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.296+0000 7f89ba000640 1 -- 172.21.15.3:0/1719322032 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557a6f75ce60 con 0x557a6f809c70 2024-09-19T06:18:57.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.296+0000 7f89ba000640 10 client.27121 handle_command_reply: tid=0 2024-09-19T06:18:57.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.296+0000 7f89de0d8740 1 client.27121 shutdown 2024-09-19T06:18:57.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.296+0000 7f89de0d8740 1 -- 172.21.15.3:0/1719322032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a6f7eeb90 msgr2=0x557a6f7f6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:57.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.296+0000 7f89de0d8740 1 --2- 172.21.15.3:0/1719322032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a6f7eeb90 0x557a6f7f6cd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f89c800e9c0 tx=0x7f89c80980d0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.296+0000 7f89de0d8740 1 -- 172.21.15.3:0/1719322032 shutdown_connections 2024-09-19T06:18:57.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.296+0000 7f89de0d8740 1 --2- 172.21.15.3:0/1719322032 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x557a6f809c70 0x557a6f80c0c0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.296+0000 7f89de0d8740 1 --2- 172.21.15.3:0/1719322032 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557a6f7f9d70 0x557a6f7f7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.296+0000 7f89ba000640 0 client.27121 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:57.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.296+0000 7f89de0d8740 1 --2- 172.21.15.3:0/1719322032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a6f7ef4b0 0x557a6f7f7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.296+0000 7f89de0d8740 1 --2- 172.21.15.3:0/1719322032 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a6f7eeb90 0x557a6f7f6cd0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.296+0000 7f89de0d8740 1 -- 172.21.15.3:0/1719322032 >> 172.21.15.3:0/1719322032 conn(0x557a6f7eb120 msgr2=0x557a6f7f0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:57.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.296+0000 7f89de0d8740 1 -- 172.21.15.3:0/1719322032 shutdown_connections 2024-09-19T06:18:57.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.296+0000 7f89de0d8740 1 -- 172.21.15.3:0/1719322032 wait complete. 2024-09-19T06:18:57.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.296+0000 7f89de0d8740 20 client.27121 trim_cache size 0 max 16384 2024-09-19T06:18:57.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.316+0000 7f89de0d8740 1 Processor -- start 2024-09-19T06:18:57.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.316+0000 7f89de0d8740 1 -- start start 2024-09-19T06:18:57.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.316+0000 7f89de0d8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a6f7eeb90 0x557a6f7f6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:57.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.316+0000 7f89de0d8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a6f7ef4b0 0x557a6f7f1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:57.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.316+0000 7f89de0d8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557a6f7f9d70 0x557a6f811990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:57.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.316+0000 7f89de0d8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f89d41afb50 con 0x557a6f7f9d70 2024-09-19T06:18:57.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.316+0000 7f89de0d8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f89d41b1690 con 0x557a6f7ef4b0 2024-09-19T06:18:57.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.316+0000 7f89de0d8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f89d41b0220 con 0x557a6f7eeb90 2024-09-19T06:18:57.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.317+0000 7f89d9600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557a6f7f9d70 0x557a6f811990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:57.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.317+0000 7f89d9600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557a6f7f9d70 0x557a6f811990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36030/0 (socket says 172.21.15.3:36030) 2024-09-19T06:18:57.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.317+0000 7f89d9600640 1 -- 172.21.15.3:0/790069375 learned_addr learned my addr 172.21.15.3:0/790069375 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:57.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.317+0000 7f89d3e00640 1 --2- 172.21.15.3:0/790069375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a6f7ef4b0 0x557a6f7f1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:57.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.317+0000 7f89d8c00640 1 --2- 172.21.15.3:0/790069375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a6f7eeb90 0x557a6f7f6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:57.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.317+0000 7f89d3e00640 1 -- 172.21.15.3:0/790069375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a6f7eeb90 msgr2=0x557a6f7f6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:57.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.317+0000 7f89d3e00640 1 --2- 172.21.15.3:0/790069375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a6f7eeb90 0x557a6f7f6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.317+0000 7f89d3e00640 1 -- 172.21.15.3:0/790069375 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557a6f7f9d70 msgr2=0x557a6f811990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:57.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.317+0000 7f89d3e00640 1 --2- 172.21.15.3:0/790069375 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557a6f7f9d70 0x557a6f811990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.317+0000 7f89d3e00640 1 -- 172.21.15.3:0/790069375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a6f7ee910 con 0x557a6f7ef4b0 2024-09-19T06:18:57.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.317+0000 7f89d9600640 1 --2- 172.21.15.3:0/790069375 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557a6f7f9d70 0x557a6f811990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:18:57.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.317+0000 7f89d3e00640 1 --2- 172.21.15.3:0/790069375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a6f7ef4b0 0x557a6f7f1640 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f89c0035040 tx=0x7f89c00056d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82769514e492e6ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:57.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.318+0000 7f89c5200640 1 -- 172.21.15.3:0/790069375 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c004d070 con 0x557a6f7ef4b0 2024-09-19T06:18:57.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.318+0000 7f89c5200640 1 -- 172.21.15.3:0/790069375 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89c0030e40 con 0x557a6f7ef4b0 2024-09-19T06:18:57.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.318+0000 7f89c5200640 1 -- 172.21.15.3:0/790069375 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c0037040 con 0x557a6f7ef4b0 2024-09-19T06:18:57.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.319+0000 7f89de0d8740 1 -- 172.21.15.3:0/790069375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a6f7ef4b0 msgr2=0x557a6f7f1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:57.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.319+0000 7f89de0d8740 1 --2- 172.21.15.3:0/790069375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a6f7ef4b0 0x557a6f7f1640 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f89c0035040 tx=0x7f89c00056d0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.319+0000 7f89de0d8740 1 -- 172.21.15.3:0/790069375 shutdown_connections 2024-09-19T06:18:57.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.319+0000 7f89de0d8740 1 --2- 172.21.15.3:0/790069375 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557a6f7f9d70 0x557a6f811990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.319+0000 7f89de0d8740 1 --2- 172.21.15.3:0/790069375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a6f7ef4b0 0x557a6f7f1640 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.319+0000 7f89de0d8740 1 --2- 172.21.15.3:0/790069375 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a6f7eeb90 0x557a6f7f6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.319+0000 7f89de0d8740 1 -- 172.21.15.3:0/790069375 >> 172.21.15.3:0/790069375 conn(0x557a6f7eb120 msgr2=0x557a6f7f74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:57.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.319+0000 7f89de0d8740 1 -- 172.21.15.3:0/790069375 shutdown_connections 2024-09-19T06:18:57.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.319+0000 7f89de0d8740 1 -- 172.21.15.3:0/790069375 wait complete. 2024-09-19T06:18:57.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.319+0000 7f89de0d8740 1 -- start start 2024-09-19T06:18:57.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.320+0000 7f89de0d8740 1 Processor -- start 2024-09-19T06:18:57.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.320+0000 7f89de0d8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557a6f7eeb90 0x557a6f801db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:57.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.320+0000 7f89de0d8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a6f7ef4b0 0x557a6f8022f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:57.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.320+0000 7f89de0d8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a6f7f9d70 0x557a6f7fed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:57.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.320+0000 7f89de0d8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f89d41b0fc0 con 0x557a6f7eeb90 2024-09-19T06:18:57.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.320+0000 7f89de0d8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f89d41b08f0 con 0x557a6f7f9d70 2024-09-19T06:18:57.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.320+0000 7f89de0d8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f89d41adb30 con 0x557a6f7ef4b0 2024-09-19T06:18:57.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.320+0000 7f89de0d8740 10 client.0 _ll_register_callbacks cb 0x7f89c8009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:18:57.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.320+0000 7f89d8c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557a6f7eeb90 0x557a6f801db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:57.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.320+0000 7f89d3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a6f7ef4b0 0x557a6f8022f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:57.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.321+0000 7f89d3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a6f7ef4b0 0x557a6f8022f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:49872/0 (socket says 172.21.15.3:49872) 2024-09-19T06:18:57.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.321+0000 7f89d3e00640 1 -- 172.21.15.3:0/208843456 learned_addr learned my addr 172.21.15.3:0/208843456 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:18:57.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.321+0000 7f89d9600640 1 --2- 172.21.15.3:0/208843456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a6f7f9d70 0x557a6f7fed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:57.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.321+0000 7f89d3e00640 1 -- 172.21.15.3:0/208843456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a6f7f9d70 msgr2=0x557a6f7fed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:57.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.321+0000 7f89d3e00640 1 --2- 172.21.15.3:0/208843456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a6f7f9d70 0x557a6f7fed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.321+0000 7f89d3e00640 1 -- 172.21.15.3:0/208843456 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557a6f7eeb90 msgr2=0x557a6f801db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:18:57.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.321+0000 7f89d3e00640 1 --2- 172.21.15.3:0/208843456 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557a6f7eeb90 0x557a6f801db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.321+0000 7f89d3e00640 1 -- 172.21.15.3:0/208843456 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a6f7ff2c0 con 0x557a6f7ef4b0 2024-09-19T06:18:57.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.321+0000 7f89d9600640 1 --2- 172.21.15.3:0/208843456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a6f7f9d70 0x557a6f7fed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:18:57.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.321+0000 7f89d3e00640 1 --2- 172.21.15.3:0/208843456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a6f7ef4b0 0x557a6f8022f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f89c002a860 tx=0x7f89c0030340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3eee44da1e45c3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:18:57.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.321+0000 7f89ba000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:18:57.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.321+0000 7f89ba000640 1 -- 172.21.15.3:0/208843456 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c004d070 con 0x557a6f7ef4b0 2024-09-19T06:18:57.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.321+0000 7f89ba000640 1 -- 172.21.15.3:0/208843456 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f89c0004280 con 0x557a6f7ef4b0 2024-09-19T06:18:57.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.322+0000 7f89de0d8740 1 -- 172.21.15.3:0/208843456 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89c0030e40 con 0x557a6f7ef4b0 2024-09-19T06:18:57.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.322+0000 7f89ba000640 1 -- 172.21.15.3:0/208843456 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f89c0037050 con 0x557a6f7ef4b0 2024-09-19T06:18:57.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.322+0000 7f89de0d8740 10 client.27127 fetch_fsmap learned FSMap version 29 2024-09-19T06:18:57.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.322+0000 7f89de0d8740 1 -- 172.21.15.3:0/208843456 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557a6f875100 con 0x557a6f7ef4b0 2024-09-19T06:18:57.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.322+0000 7f89ba000640 1 -- 172.21.15.3:0/208843456 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89c0030e40 con 0x557a6f7ef4b0 2024-09-19T06:18:57.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.322+0000 7f89ba000640 1 -- 172.21.15.3:0/208843456 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f89c0003b30 con 0x557a6f7ef4b0 2024-09-19T06:18:57.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.323+0000 7f89de0d8740 10 client.27127 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:18:57.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.323+0000 7f89de0d8740 10 client.27127 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:18:57.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.323+0000 7f89de0d8740 20 client.27127 populate_metadata read hostname 'smithi003' 2024-09-19T06:18:57.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.323+0000 7f89de0d8740 1 --2- 172.21.15.3:0/208843456 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x557a6f8757e0 0x557a6f877c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:18:57.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.323+0000 7f89de0d8740 4 client.27127 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:18:57.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.323+0000 7f89de0d8740 1 -- 172.21.15.3:0/208843456 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557a6f6d90c0 con 0x557a6f8757e0 2024-09-19T06:18:57.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.323+0000 7f89d8c00640 1 --2- 172.21.15.3:0/208843456 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x557a6f8757e0 0x557a6f877c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:18:57.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.323+0000 7f89d8c00640 1 --2- 172.21.15.3:0/208843456 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x557a6f8757e0 0x557a6f877c00 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d1d77363e861b3e server_cookie=b5e458666d40c8e5 in_seq=0 out_seq=0 2024-09-19T06:18:57.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.323+0000 7f89ba000640 10 client.27127 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:57.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.324+0000 7f89ba000640 1 -- 172.21.15.3:0/208843456 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x557a6f6d90c0 con 0x557a6f8757e0 2024-09-19T06:18:57.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.324+0000 7f89ba000640 10 client.27127 handle_command_reply: tid=0 2024-09-19T06:18:57.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.324+0000 7f89de0d8740 1 client.27127 shutdown 2024-09-19T06:18:57.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.324+0000 7f89de0d8740 1 -- 172.21.15.3:0/208843456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a6f7ef4b0 msgr2=0x557a6f8022f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:57.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.324+0000 7f89de0d8740 1 --2- 172.21.15.3:0/208843456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a6f7ef4b0 0x557a6f8022f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f89c002a860 tx=0x7f89c0030340 comp rx=0 tx=0).stop 2024-09-19T06:18:57.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.324+0000 7f89de0d8740 1 -- 172.21.15.3:0/208843456 shutdown_connections 2024-09-19T06:18:57.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.324+0000 7f89de0d8740 1 --2- 172.21.15.3:0/208843456 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x557a6f8757e0 0x557a6f877c00 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.324+0000 7f89de0d8740 1 --2- 172.21.15.3:0/208843456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557a6f7f9d70 0x557a6f7fed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.324+0000 7f89ba000640 0 client.27127 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:18:57.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.324+0000 7f89de0d8740 1 --2- 172.21.15.3:0/208843456 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557a6f7ef4b0 0x557a6f8022f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.324+0000 7f89de0d8740 1 --2- 172.21.15.3:0/208843456 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557a6f7eeb90 0x557a6f801db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.324+0000 7f89de0d8740 1 -- 172.21.15.3:0/208843456 >> 172.21.15.3:0/208843456 conn(0x557a6f7eb120 msgr2=0x557a6f7e99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:57.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.324+0000 7f89de0d8740 1 -- 172.21.15.3:0/208843456 shutdown_connections 2024-09-19T06:18:57.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.324+0000 7f89de0d8740 1 -- 172.21.15.3:0/208843456 wait complete. 2024-09-19T06:18:57.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.325+0000 7f89de0d8740 20 client.27127 trim_cache size 0 max 16384 2024-09-19T06:18:57.331 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:18:57.331 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:18:57.331 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": { 2024-09-19T06:18:57.331 INFO:teuthology.orchestra.run.smithi003.stdout: "5a26eac1-ba58-4f80-9feb-ee850cc8eabc": { 2024-09-19T06:18:57.331 INFO:teuthology.orchestra.run.smithi003.stdout: "path": "/", 2024-09-19T06:18:57.331 INFO:teuthology.orchestra.run.smithi003.stdout: "tag": "5a26eac1-ba58-4f80-9feb-ee850cc8eabc", 2024-09-19T06:18:57.331 INFO:teuthology.orchestra.run.smithi003.stdout: "options": "recursive,force" 2024-09-19T06:18:57.331 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:18:57.331 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:18:57.331 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:18:57.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.325+0000 7f89db600640 1 -- 172.21.15.3:0/541128131 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f89bc0a33b0 msgr2=0x7f89bc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:57.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.325+0000 7f89db600640 1 --2- 172.21.15.3:0/541128131 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f89bc0a33b0 0x7f89bc0a5870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f89cc005c10 tx=0x7f89cc009a20 comp rx=0 tx=0).stop 2024-09-19T06:18:57.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.325+0000 7f89db600640 1 -- 172.21.15.3:0/541128131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89d4101df0 msgr2=0x7f89d419a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:18:57.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.325+0000 7f89db600640 1 --2- 172.21.15.3:0/541128131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89d4101df0 0x7f89d419a620 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f89c800e9f0 tx=0x7f89c800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.325+0000 7f89db600640 1 -- 172.21.15.3:0/541128131 shutdown_connections 2024-09-19T06:18:57.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.325+0000 7f89db600640 1 --2- 172.21.15.3:0/541128131 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f89bc0a33b0 0x7f89bc0a5870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.325+0000 7f89db600640 1 --2- 172.21.15.3:0/541128131 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89d4106f20 0x7f89d419eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.325+0000 7f89db600640 1 --2- 172.21.15.3:0/541128131 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f89d41027a0 0x7f89d419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.325+0000 7f89db600640 1 --2- 172.21.15.3:0/541128131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89d4101df0 0x7f89d419a620 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:18:57.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.325+0000 7f89db600640 1 -- 172.21.15.3:0/541128131 >> 172.21.15.3:0/541128131 conn(0x7f89d40fd8b0 msgr2=0x7f89d40ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:18:57.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.326+0000 7f89db600640 1 -- 172.21.15.3:0/541128131 shutdown_connections 2024-09-19T06:18:57.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:18:57.326+0000 7f89db600640 1 -- 172.21.15.3:0/541128131 wait complete. 2024-09-19T06:18:58.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:57 smithi059 ceph-mon[35138]: pgmap v200: 97 pgs: 97 active+clean; 2.5 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 40 KiB/s wr, 15 op/s 2024-09-19T06:18:58.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:57 smithi003 ceph-mon[30893]: pgmap v200: 97 pgs: 97 active+clean; 2.5 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 40 KiB/s wr, 15 op/s 2024-09-19T06:18:58.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:57 smithi071 ceph-mon[35662]: pgmap v200: 97 pgs: 97 active+clean; 2.5 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 40 KiB/s wr, 15 op/s 2024-09-19T06:18:58.158 INFO:tasks.cephfs.filesystem:scrub status for tag:5a26eac1-ba58-4f80-9feb-ee850cc8eabc - {'path': '/', 'tag': '5a26eac1-ba58-4f80-9feb-ee850cc8eabc', 'options': 'recursive,force'} 2024-09-19T06:19:00.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:18:59 smithi059 ceph-mon[35138]: pgmap v201: 97 pgs: 97 active+clean; 2.7 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-19T06:19:00.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:18:59 smithi003 ceph-mon[30893]: pgmap v201: 97 pgs: 97 active+clean; 2.7 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-19T06:19:00.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:18:59 smithi071 ceph-mon[35662]: pgmap v201: 97 pgs: 97 active+clean; 2.7 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-19T06:19:00.899 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.897+0000 7f2cd5e00640 1 -- 172.21.15.3:0/2342267565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd0103b30 msgr2=0x7f2cd0103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:00.900 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.897+0000 7f2cd5e00640 1 --2- 172.21.15.3:0/2342267565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd0103b30 0x7f2cd0103f90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc009890 tx=0x7f2cbc02a370 comp rx=0 tx=0).stop 2024-09-19T06:19:00.900 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.897+0000 7f2cd5e00640 1 -- 172.21.15.3:0/2342267565 shutdown_connections 2024-09-19T06:19:00.900 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.897+0000 7f2cd5e00640 1 --2- 172.21.15.3:0/2342267565 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2cd01044d0 0x7f2cd01109b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.900 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.897+0000 7f2cd5e00640 1 --2- 172.21.15.3:0/2342267565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd0103b30 0x7f2cd0103f90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.900 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.897+0000 7f2cd5e00640 1 --2- 172.21.15.3:0/2342267565 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2cd0109bf0 0x7f2cd0109fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.900 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.897+0000 7f2cd5e00640 1 -- 172.21.15.3:0/2342267565 >> 172.21.15.3:0/2342267565 conn(0x7f2cd00ff810 msgr2=0x7f2cd0101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:00.900 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.897+0000 7f2cd5e00640 1 -- 172.21.15.3:0/2342267565 shutdown_connections 2024-09-19T06:19:00.900 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.898+0000 7f2cd5e00640 1 -- 172.21.15.3:0/2342267565 wait complete. 2024-09-19T06:19:00.902 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.898+0000 7f2cd5e00640 1 Processor -- start 2024-09-19T06:19:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.899+0000 7f2cd5e00640 1 -- start start 2024-09-19T06:19:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.899+0000 7f2cd5e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2cd0103b30 0x7f2cd019a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.899+0000 7f2cd5e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2cd01044d0 0x7f2cd019a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.899+0000 7f2cd5e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd0109bf0 0x7f2cd019ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.899+0000 7f2cd5e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd0113f00 con 0x7f2cd01044d0 2024-09-19T06:19:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.899+0000 7f2cd5e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd0113d80 con 0x7f2cd0109bf0 2024-09-19T06:19:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.899+0000 7f2cd5e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd0114080 con 0x7f2cd0103b30 2024-09-19T06:19:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.899+0000 7f2ccfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2cd01044d0 0x7f2cd019a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.899+0000 7f2cd5400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd0109bf0 0x7f2cd019ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.899+0000 7f2cd4a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2cd0103b30 0x7f2cd019a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:00.904 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.899+0000 7f2ccfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2cd01044d0 0x7f2cd019a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36062/0 (socket says 172.21.15.3:36062) 2024-09-19T06:19:00.904 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.899+0000 7f2cd5400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd0109bf0 0x7f2cd019ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:52970/0 (socket says 172.21.15.3:52970) 2024-09-19T06:19:00.904 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.899+0000 7f2ccfe00640 1 -- 172.21.15.3:0/3404124510 learned_addr learned my addr 172.21.15.3:0/3404124510 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:00.904 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.900+0000 7f2cd4a00640 1 -- 172.21.15.3:0/3404124510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd0109bf0 msgr2=0x7f2cd019ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:00.904 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.900+0000 7f2cd4a00640 1 --2- 172.21.15.3:0/3404124510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd0109bf0 0x7f2cd019ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.904 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.900+0000 7f2cd4a00640 1 -- 172.21.15.3:0/3404124510 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2cd01044d0 msgr2=0x7f2cd019a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:00.904 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.900+0000 7f2cd4a00640 1 --2- 172.21.15.3:0/3404124510 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2cd01044d0 0x7f2cd019a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.905 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.900+0000 7f2cd4a00640 1 -- 172.21.15.3:0/3404124510 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd019f3c0 con 0x7f2cd0103b30 2024-09-19T06:19:00.905 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.900+0000 7f2cd5400640 1 --2- 172.21.15.3:0/3404124510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd0109bf0 0x7f2cd019ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:00.905 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.900+0000 7f2cd4a00640 1 --2- 172.21.15.3:0/3404124510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2cd0103b30 0x7f2cd019a3d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2cc400e9f0 tx=0x7f2cc400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:00.905 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.900+0000 7f2ccd600640 1 -- 172.21.15.3:0/3404124510 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc400ccc0 con 0x7f2cd0103b30 2024-09-19T06:19:00.905 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.900+0000 7f2ccd600640 1 -- 172.21.15.3:0/3404124510 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cc4010910 con 0x7f2cd0103b30 2024-09-19T06:19:00.905 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.900+0000 7f2ccd600640 1 -- 172.21.15.3:0/3404124510 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4018960 con 0x7f2cd0103b30 2024-09-19T06:19:00.905 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.900+0000 7f2cd5e00640 1 -- 172.21.15.3:0/3404124510 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cd019f6b0 con 0x7f2cd0103b30 2024-09-19T06:19:00.905 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.901+0000 7f2cd5e00640 1 -- 172.21.15.3:0/3404124510 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cd01a6f40 con 0x7f2cd0103b30 2024-09-19T06:19:00.906 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.904+0000 7f2cda1de740 1 Processor -- start 2024-09-19T06:19:00.906 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.904+0000 7f2ccd600640 1 -- 172.21.15.3:0/3404124510 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f2cc4010ac0 con 0x7f2cd0103b30 2024-09-19T06:19:00.906 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.904+0000 7f2cda1de740 1 -- start start 2024-09-19T06:19:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.905+0000 7f2cda1de740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1bf473b0 0x562f1bf47790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.905+0000 7f2cda1de740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1bf47cd0 0x562f1bf52030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.905+0000 7f2cda1de740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf52570 0x562f1bf54960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.905+0000 7f2cda1de740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562f1bead100 con 0x562f1bf52570 2024-09-19T06:19:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.905+0000 7f2cda1de740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562f1be551b0 con 0x562f1bf473b0 2024-09-19T06:19:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.905+0000 7f2cda1de740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562f1bea90c0 con 0x562f1bf47cd0 2024-09-19T06:19:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.905+0000 7f2cd4a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1bf47cd0 0x562f1bf52030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.905+0000 7f2ccfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf52570 0x562f1bf54960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.905+0000 7f2cd5400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1bf473b0 0x562f1bf47790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.905+0000 7f2cd5400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1bf473b0 0x562f1bf47790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:52974/0 (socket says 172.21.15.3:52974) 2024-09-19T06:19:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.905+0000 7f2cd5400640 1 -- 172.21.15.3:0/3416429684 learned_addr learned my addr 172.21.15.3:0/3416429684 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.905+0000 7f2cd5400640 1 -- 172.21.15.3:0/3416429684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1bf47cd0 msgr2=0x562f1bf52030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.905+0000 7f2cd5400640 1 --2- 172.21.15.3:0/3416429684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1bf47cd0 0x562f1bf52030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.905+0000 7f2cd5400640 1 -- 172.21.15.3:0/3416429684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf52570 msgr2=0x562f1bf54960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.905+0000 7f2cd5400640 1 --2- 172.21.15.3:0/3416429684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf52570 0x562f1bf54960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.905+0000 7f2cd5400640 1 -- 172.21.15.3:0/3416429684 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f1bbc0210 con 0x562f1bf473b0 2024-09-19T06:19:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.906+0000 7f2cd5400640 1 --2- 172.21.15.3:0/3416429684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1bf473b0 0x562f1bf47790 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800e8f0 tx=0x7f2cc80095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94c56784850b1df2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.906+0000 7f2cc1c00640 1 -- 172.21.15.3:0/3416429684 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8017420 con 0x562f1bf473b0 2024-09-19T06:19:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.906+0000 7f2cc1c00640 1 -- 172.21.15.3:0/3416429684 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cc801c070 con 0x562f1bf473b0 2024-09-19T06:19:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.906+0000 7f2cc1c00640 1 -- 172.21.15.3:0/3416429684 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8016700 con 0x562f1bf473b0 2024-09-19T06:19:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.906+0000 7f2ccd600640 1 --2- 172.21.15.3:0/3404124510 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2cb80a3420 0x7f2cb80a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.907+0000 7f2ccd600640 1 -- 172.21.15.3:0/3404124510 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f2cc40d0090 con 0x7f2cd0103b30 2024-09-19T06:19:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.907+0000 7f2cd4a00640 1 --2- 172.21.15.3:0/3404124510 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2cb80a3420 0x7f2cb80a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.907+0000 7f2cda1de740 1 -- 172.21.15.3:0/3416429684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1bf473b0 msgr2=0x562f1bf47790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.907+0000 7f2cda1de740 1 --2- 172.21.15.3:0/3416429684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1bf473b0 0x562f1bf47790 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800e8f0 tx=0x7f2cc80095c0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.907+0000 7f2cda1de740 1 -- 172.21.15.3:0/3416429684 shutdown_connections 2024-09-19T06:19:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.907+0000 7f2cda1de740 1 --2- 172.21.15.3:0/3416429684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf52570 0x562f1bf54960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.907+0000 7f2cda1de740 1 --2- 172.21.15.3:0/3416429684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1bf47cd0 0x562f1bf52030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.907+0000 7f2cda1de740 1 --2- 172.21.15.3:0/3416429684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1bf473b0 0x562f1bf47790 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.907+0000 7f2cda1de740 1 -- 172.21.15.3:0/3416429684 >> 172.21.15.3:0/3416429684 conn(0x562f1bf43920 msgr2=0x562f1bf43d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.907+0000 7f2cda1de740 1 -- 172.21.15.3:0/3416429684 shutdown_connections 2024-09-19T06:19:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.907+0000 7f2cda1de740 1 -- 172.21.15.3:0/3416429684 wait complete. 2024-09-19T06:19:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.907+0000 7f2cd4a00640 1 --2- 172.21.15.3:0/3404124510 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2cb80a3420 0x7f2cb80a58e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x562f1bf44780 tx=0x7f2cc40d3b40 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.907+0000 7f2cda1de740 1 -- start start 2024-09-19T06:19:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.908+0000 7f2cda1de740 1 Processor -- start 2024-09-19T06:19:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.908+0000 7f2cda1de740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1bf473b0 0x562f1bf4f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.908+0000 7f2cda1de740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1bf47cd0 0x562f1bf4fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.908+0000 7f2cda1de740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf52570 0x562f1bf50120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.908+0000 7f2cda1de740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562f1bf54f90 con 0x562f1bf52570 2024-09-19T06:19:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.908+0000 7f2cda1de740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562f1be36090 con 0x562f1bf473b0 2024-09-19T06:19:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.908+0000 7f2cda1de740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562f1bf55110 con 0x562f1bf47cd0 2024-09-19T06:19:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.908+0000 7f2cda1de740 10 client.0 _ll_register_callbacks cb 0x562f1be8af30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.908+0000 7f2ccfe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1bf47cd0 0x562f1bf4fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.908+0000 7f2cd5400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf52570 0x562f1bf50120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.909+0000 7f2cd5400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf52570 0x562f1bf50120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36086/0 (socket says 172.21.15.3:36086) 2024-09-19T06:19:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.909+0000 7f2cd5400640 1 -- 172.21.15.3:0/2390308791 learned_addr learned my addr 172.21.15.3:0/2390308791 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:00.915 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.909+0000 7f2ccfe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1bf47cd0 0x562f1bf4fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:49906/0 (socket says 172.21.15.3:49906) 2024-09-19T06:19:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.909+0000 7f2cd5400640 1 --2- 172.21.15.3:0/2390308791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1bf473b0 0x562f1bf4f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.909+0000 7f2ccfe00640 1 -- 172.21.15.3:0/2390308791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1bf473b0 msgr2=0x562f1bf4f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.909+0000 7f2ccfe00640 1 --2- 172.21.15.3:0/2390308791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1bf473b0 0x562f1bf4f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.909+0000 7f2ccfe00640 1 -- 172.21.15.3:0/2390308791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf52570 msgr2=0x562f1bf50120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.909+0000 7f2ccfe00640 1 --2- 172.21.15.3:0/2390308791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf52570 0x562f1bf50120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.909+0000 7f2ccfe00640 1 -- 172.21.15.3:0/2390308791 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f1bc8c620 con 0x562f1bf47cd0 2024-09-19T06:19:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.909+0000 7f2cd5400640 1 --2- 172.21.15.3:0/2390308791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf52570 0x562f1bf50120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.909+0000 7f2ccfe00640 1 --2- 172.21.15.3:0/2390308791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1bf47cd0 0x562f1bf4fbe0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2cd01091d0 tx=0x7f2cbc030340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca575bc3b138f10d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.909+0000 7f2cb6000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:19:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.910+0000 7f2cb6000640 1 -- 172.21.15.3:0/2390308791 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc037040 con 0x562f1bf47cd0 2024-09-19T06:19:00.916 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.910+0000 7f2cb6000640 1 -- 172.21.15.3:0/2390308791 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f2cbc004040 con 0x562f1bf47cd0 2024-09-19T06:19:00.917 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.910+0000 7f2cda1de740 1 -- 172.21.15.3:0/2390308791 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cc801c070 con 0x562f1bf47cd0 2024-09-19T06:19:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.910+0000 7f2cb6000640 1 -- 172.21.15.3:0/2390308791 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2cbc04c050 con 0x562f1bf47cd0 2024-09-19T06:19:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.910+0000 7f2cda1de740 10 client.27139 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.910+0000 7f2cda1de740 1 -- 172.21.15.3:0/2390308791 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562f1bf60e40 con 0x562f1bf47cd0 2024-09-19T06:19:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.910+0000 7f2cb6000640 1 -- 172.21.15.3:0/2390308791 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cc801c070 con 0x562f1bf47cd0 2024-09-19T06:19:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.911+0000 7f2cb6000640 1 -- 172.21.15.3:0/2390308791 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2cbc03d450 con 0x562f1bf47cd0 2024-09-19T06:19:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.911+0000 7f2cda1de740 10 client.27139 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.911+0000 7f2cda1de740 10 client.27139 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:00.919 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.911+0000 7f2cda1de740 20 client.27139 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.911+0000 7f2cda1de740 1 --2- 172.21.15.3:0/2390308791 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562f1bf62350 0x562f1bf64740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.911+0000 7f2cda1de740 4 client.27139 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.911+0000 7f2cda1de740 1 -- 172.21.15.3:0/2390308791 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f1beba830 con 0x562f1bf62350 2024-09-19T06:19:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.911+0000 7f2cd5400640 1 --2- 172.21.15.3:0/2390308791 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562f1bf62350 0x562f1bf64740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.912+0000 7f2cd5400640 1 --2- 172.21.15.3:0/2390308791 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562f1bf62350 0x562f1bf64740 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f16c0da4143aa72e server_cookie=878844a8688868c6 in_seq=0 out_seq=0 2024-09-19T06:19:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.912+0000 7f2cb6000640 10 client.27139 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.912+0000 7f2cb6000640 1 -- 172.21.15.3:0/2390308791 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562f1beba830 con 0x562f1bf62350 2024-09-19T06:19:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.912+0000 7f2cb6000640 10 client.27139 handle_command_reply: tid=0 2024-09-19T06:19:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.912+0000 7f2cda1de740 1 client.27139 shutdown 2024-09-19T06:19:00.920 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.913+0000 7f2cda1de740 1 -- 172.21.15.3:0/2390308791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1bf47cd0 msgr2=0x562f1bf4fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.913+0000 7f2cda1de740 1 --2- 172.21.15.3:0/2390308791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1bf47cd0 0x562f1bf4fbe0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2cd01091d0 tx=0x7f2cbc030340 comp rx=0 tx=0).stop 2024-09-19T06:19:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.913+0000 7f2cda1de740 1 -- 172.21.15.3:0/2390308791 shutdown_connections 2024-09-19T06:19:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.913+0000 7f2cda1de740 1 --2- 172.21.15.3:0/2390308791 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562f1bf62350 0x562f1bf64740 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.913+0000 7f2cda1de740 1 --2- 172.21.15.3:0/2390308791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf52570 0x562f1bf50120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.913+0000 7f2cda1de740 1 --2- 172.21.15.3:0/2390308791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1bf47cd0 0x562f1bf4fbe0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.913+0000 7f2cb6000640 0 client.27139 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.913+0000 7f2cda1de740 1 --2- 172.21.15.3:0/2390308791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1bf473b0 0x562f1bf4f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.913+0000 7f2cda1de740 1 -- 172.21.15.3:0/2390308791 >> 172.21.15.3:0/2390308791 conn(0x562f1bf43920 msgr2=0x562f1bf49630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.913+0000 7f2cda1de740 1 -- 172.21.15.3:0/2390308791 shutdown_connections 2024-09-19T06:19:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.913+0000 7f2cda1de740 1 -- 172.21.15.3:0/2390308791 wait complete. 2024-09-19T06:19:00.921 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.913+0000 7f2cda1de740 20 client.27139 trim_cache size 0 max 16384 2024-09-19T06:19:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.928+0000 7f2cda1de740 1 Processor -- start 2024-09-19T06:19:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.928+0000 7f2cda1de740 1 -- start start 2024-09-19T06:19:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.929+0000 7f2cda1de740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf473b0 0x562f1bf51500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.929+0000 7f2cda1de740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1bf47cd0 0x562f1bf4ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.929+0000 7f2cda1de740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1bf52570 0x562f1bf69fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.929+0000 7f2cda1de740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd01af950 con 0x562f1bf473b0 2024-09-19T06:19:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.929+0000 7f2cda1de740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd01b1490 con 0x562f1bf52570 2024-09-19T06:19:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.929+0000 7f2cda1de740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd01b0020 con 0x562f1bf47cd0 2024-09-19T06:19:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.929+0000 7f2cd5400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf473b0 0x562f1bf51500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.929+0000 7f2cd5400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf473b0 0x562f1bf51500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36090/0 (socket says 172.21.15.3:36090) 2024-09-19T06:19:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.929+0000 7f2cd5400640 1 -- 172.21.15.3:0/4037136297 learned_addr learned my addr 172.21.15.3:0/4037136297 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.929+0000 7f2ccfe00640 1 --2- 172.21.15.3:0/4037136297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1bf47cd0 0x562f1bf4ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.929+0000 7f2cd5400640 1 --2- 172.21.15.3:0/4037136297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1bf52570 0x562f1bf69fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.929+0000 7f2cd5400640 1 -- 172.21.15.3:0/4037136297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1bf47cd0 msgr2=0x562f1bf4ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.929+0000 7f2cd5400640 1 --2- 172.21.15.3:0/4037136297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1bf47cd0 0x562f1bf4ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.929+0000 7f2cd5400640 1 -- 172.21.15.3:0/4037136297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1bf52570 msgr2=0x562f1bf69fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.929+0000 7f2cd5400640 1 --2- 172.21.15.3:0/4037136297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1bf52570 0x562f1bf69fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.929+0000 7f2cd5400640 1 -- 172.21.15.3:0/4037136297 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f1bf5e280 con 0x562f1bf473b0 2024-09-19T06:19:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.929+0000 7f2ccfe00640 1 --2- 172.21.15.3:0/4037136297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1bf47cd0 0x562f1bf4ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.930+0000 7f2cd5400640 1 --2- 172.21.15.3:0/4037136297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf473b0 0x562f1bf51500 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800d7b0 tx=0x7f2cc800e500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3349afe1888829d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.930+0000 7f2cc1200640 1 -- 172.21.15.3:0/4037136297 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8009540 con 0x562f1bf473b0 2024-09-19T06:19:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.930+0000 7f2cc1200640 1 -- 172.21.15.3:0/4037136297 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cc801c070 con 0x562f1bf473b0 2024-09-19T06:19:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.930+0000 7f2cc1200640 1 -- 172.21.15.3:0/4037136297 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc80045b0 con 0x562f1bf473b0 2024-09-19T06:19:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.930+0000 7f2cda1de740 1 -- 172.21.15.3:0/4037136297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf473b0 msgr2=0x562f1bf51500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.930+0000 7f2cda1de740 1 --2- 172.21.15.3:0/4037136297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf473b0 0x562f1bf51500 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800d7b0 tx=0x7f2cc800e500 comp rx=0 tx=0).stop 2024-09-19T06:19:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.930+0000 7f2cda1de740 1 -- 172.21.15.3:0/4037136297 shutdown_connections 2024-09-19T06:19:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.930+0000 7f2cda1de740 1 --2- 172.21.15.3:0/4037136297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1bf52570 0x562f1bf69fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.930+0000 7f2cda1de740 1 --2- 172.21.15.3:0/4037136297 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1bf47cd0 0x562f1bf4ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.930+0000 7f2cda1de740 1 --2- 172.21.15.3:0/4037136297 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf473b0 0x562f1bf51500 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.930+0000 7f2cda1de740 1 -- 172.21.15.3:0/4037136297 >> 172.21.15.3:0/4037136297 conn(0x562f1bf43920 msgr2=0x562f1bf50df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.930+0000 7f2cda1de740 1 -- 172.21.15.3:0/4037136297 shutdown_connections 2024-09-19T06:19:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.931+0000 7f2cda1de740 1 -- 172.21.15.3:0/4037136297 wait complete. 2024-09-19T06:19:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.931+0000 7f2cda1de740 1 -- start start 2024-09-19T06:19:00.938 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.931+0000 7f2cda1de740 1 Processor -- start 2024-09-19T06:19:00.938 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.931+0000 7f2cda1de740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf473b0 0x562f1bf5a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:00.938 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.931+0000 7f2cda1de740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1bf47cd0 0x562f1bf5acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:00.938 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.931+0000 7f2cda1de740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1bf52570 0x562f1bf4c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:00.938 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.931+0000 7f2cda1de740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd01b0dc0 con 0x562f1bf473b0 2024-09-19T06:19:00.938 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.931+0000 7f2cda1de740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd01b06f0 con 0x562f1bf47cd0 2024-09-19T06:19:00.938 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.931+0000 7f2cda1de740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd01ad930 con 0x562f1bf52570 2024-09-19T06:19:00.938 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.932+0000 7f2cda1de740 10 client.0 _ll_register_callbacks cb 0x7f2cc4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:00.938 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.932+0000 7f2cd5400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf473b0 0x562f1bf5a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:00.938 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.932+0000 7f2cd5400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf473b0 0x562f1bf5a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36100/0 (socket says 172.21.15.3:36100) 2024-09-19T06:19:00.938 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.932+0000 7f2cd5400640 1 -- 172.21.15.3:0/896632556 learned_addr learned my addr 172.21.15.3:0/896632556 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:00.939 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.932+0000 7f2ccfe00640 1 --2- 172.21.15.3:0/896632556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1bf47cd0 0x562f1bf5acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:00.939 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.932+0000 7f2cd5400640 1 --2- 172.21.15.3:0/896632556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1bf52570 0x562f1bf4c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:00.939 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.932+0000 7f2cd5400640 1 -- 172.21.15.3:0/896632556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1bf52570 msgr2=0x562f1bf4c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:00.939 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.932+0000 7f2cd5400640 1 --2- 172.21.15.3:0/896632556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1bf52570 0x562f1bf4c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.939 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.932+0000 7f2cd5400640 1 -- 172.21.15.3:0/896632556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1bf47cd0 msgr2=0x562f1bf5acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:00.939 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.932+0000 7f2cd5400640 1 --2- 172.21.15.3:0/896632556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1bf47cd0 0x562f1bf5acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.939 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.932+0000 7f2cd5400640 1 -- 172.21.15.3:0/896632556 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f1bf4caa0 con 0x562f1bf473b0 2024-09-19T06:19:00.939 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.932+0000 7f2cd5400640 1 --2- 172.21.15.3:0/896632556 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf473b0 0x562f1bf5a770 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8004c10 tx=0x7f2cc8004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390452f8b1b624c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:00.939 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.932+0000 7f2cb6000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:19:00.939 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.933+0000 7f2cb6000640 1 -- 172.21.15.3:0/896632556 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8037070 con 0x562f1bf473b0 2024-09-19T06:19:00.939 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.933+0000 7f2cb6000640 1 -- 172.21.15.3:0/896632556 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8527+0+0 (secure 0 0 0) 0x7f2cc8032e80 con 0x562f1bf473b0 2024-09-19T06:19:00.940 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.933+0000 7f2cda1de740 1 -- 172.21.15.3:0/896632556 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cc801c070 con 0x562f1bf473b0 2024-09-19T06:19:00.940 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.933+0000 7f2cb6000640 1 -- 172.21.15.3:0/896632556 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2cc8043050 con 0x562f1bf473b0 2024-09-19T06:19:00.940 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.933+0000 7f2cda1de740 10 client.17112 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:00.940 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.933+0000 7f2cda1de740 1 -- 172.21.15.3:0/896632556 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562f1bfccc20 con 0x562f1bf473b0 2024-09-19T06:19:00.940 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.933+0000 7f2cb6000640 1 -- 172.21.15.3:0/896632556 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cc801c070 con 0x562f1bf473b0 2024-09-19T06:19:00.940 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.933+0000 7f2cb6000640 1 -- 172.21.15.3:0/896632556 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2cc800b040 con 0x562f1bf473b0 2024-09-19T06:19:00.940 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.933+0000 7f2cda1de740 10 client.17112 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:00.940 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.933+0000 7f2cda1de740 10 client.17112 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:00.940 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.933+0000 7f2cda1de740 20 client.17112 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:00.940 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.933+0000 7f2cda1de740 1 --2- 172.21.15.3:0/896632556 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562f1bfcd050 0x562f1bfcf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:00.940 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.933+0000 7f2cda1de740 4 client.17112 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:19:00.941 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.933+0000 7f2cda1de740 1 -- 172.21.15.3:0/896632556 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562f1beb4b80 con 0x562f1bfcd050 2024-09-19T06:19:00.941 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.934+0000 7f2ccfe00640 1 --2- 172.21.15.3:0/896632556 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562f1bfcd050 0x562f1bfcf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:00.941 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.934+0000 7f2ccfe00640 1 --2- 172.21.15.3:0/896632556 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562f1bfcd050 0x562f1bfcf440 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f96963a2067684cc server_cookie=ee02751d8ea7b94d in_seq=0 out_seq=0 2024-09-19T06:19:00.941 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.934+0000 7f2cb6000640 10 client.17112 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:00.950 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.948+0000 7f2cb6000640 1 -- 172.21.15.3:0/896632556 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562f1beb4b80 con 0x562f1bfcd050 2024-09-19T06:19:00.951 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.948+0000 7f2cb6000640 10 client.17112 handle_command_reply: tid=0 2024-09-19T06:19:00.951 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.948+0000 7f2cda1de740 1 client.17112 shutdown 2024-09-19T06:19:00.951 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.948+0000 7f2cda1de740 1 -- 172.21.15.3:0/896632556 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf473b0 msgr2=0x562f1bf5a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:00.951 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.948+0000 7f2cda1de740 1 --2- 172.21.15.3:0/896632556 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf473b0 0x562f1bf5a770 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8004c10 tx=0x7f2cc8004470 comp rx=0 tx=0).stop 2024-09-19T06:19:00.951 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.948+0000 7f2cda1de740 1 -- 172.21.15.3:0/896632556 shutdown_connections 2024-09-19T06:19:00.951 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.948+0000 7f2cda1de740 1 --2- 172.21.15.3:0/896632556 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562f1bfcd050 0x562f1bfcf440 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.951 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.948+0000 7f2cda1de740 1 --2- 172.21.15.3:0/896632556 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562f1bf52570 0x562f1bf4c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.951 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.948+0000 7f2cda1de740 1 --2- 172.21.15.3:0/896632556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562f1bf47cd0 0x562f1bf5acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.951 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.948+0000 7f2cda1de740 1 --2- 172.21.15.3:0/896632556 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562f1bf473b0 0x562f1bf5a770 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.951 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.948+0000 7f2cb6000640 0 client.17112 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:00.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.948+0000 7f2cda1de740 1 -- 172.21.15.3:0/896632556 >> 172.21.15.3:0/896632556 conn(0x562f1bf43920 msgr2=0x562f1bf5da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:00.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.949+0000 7f2cda1de740 1 -- 172.21.15.3:0/896632556 shutdown_connections 2024-09-19T06:19:00.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.949+0000 7f2cda1de740 1 -- 172.21.15.3:0/896632556 wait complete. 2024-09-19T06:19:00.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.949+0000 7f2cda1de740 20 client.17112 trim_cache size 0 max 16384 2024-09-19T06:19:00.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:19:00.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:19:00.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:19:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:19:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.949+0000 7f2cd5e00640 1 -- 172.21.15.3:0/3404124510 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2cb80a3420 msgr2=0x7f2cb80a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:00.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.949+0000 7f2cd5e00640 1 --2- 172.21.15.3:0/3404124510 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2cb80a3420 0x7f2cb80a58e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x562f1bf44780 tx=0x7f2cc40d3b40 comp rx=0 tx=0).stop 2024-09-19T06:19:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.949+0000 7f2cd5e00640 1 -- 172.21.15.3:0/3404124510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2cd0103b30 msgr2=0x7f2cd019a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.949+0000 7f2cd5e00640 1 --2- 172.21.15.3:0/3404124510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2cd0103b30 0x7f2cd019a3d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2cc400e9f0 tx=0x7f2cc400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.950+0000 7f2cd5e00640 1 -- 172.21.15.3:0/3404124510 shutdown_connections 2024-09-19T06:19:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.950+0000 7f2cd5e00640 1 --2- 172.21.15.3:0/3404124510 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2cb80a3420 0x7f2cb80a58e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.950+0000 7f2cd5e00640 1 --2- 172.21.15.3:0/3404124510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd0109bf0 0x7f2cd019ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.950+0000 7f2cd5e00640 1 --2- 172.21.15.3:0/3404124510 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2cd01044d0 0x7f2cd019a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.950+0000 7f2cd5e00640 1 --2- 172.21.15.3:0/3404124510 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2cd0103b30 0x7f2cd019a3d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.950+0000 7f2cd5e00640 1 -- 172.21.15.3:0/3404124510 >> 172.21.15.3:0/3404124510 conn(0x7f2cd00ff810 msgr2=0x7f2cd0101010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.950+0000 7f2cd5e00640 1 -- 172.21.15.3:0/3404124510 shutdown_connections 2024-09-19T06:19:00.954 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:00.950+0000 7f2cd5e00640 1 -- 172.21.15.3:0/3404124510 wait complete. 2024-09-19T06:19:01.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:00 smithi059 ceph-mon[35138]: scrub summary: idle 2024-09-19T06:19:01.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:00 smithi003 ceph-mon[30893]: scrub summary: idle 2024-09-19T06:19:01.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:00 smithi071 ceph-mon[35662]: scrub summary: idle 2024-09-19T06:19:02.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:01 smithi059 ceph-mon[35138]: pgmap v202: 97 pgs: 97 active+clean; 2.7 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-09-19T06:19:02.041 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.042 INFO:tasks.workunit.client.0.smithi003.stdout:251/600: open fd = 3 2024-09-19T06:19:02.042 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.042 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.042 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.042 INFO:tasks.workunit.client.0.smithi003.stdout:252/600: open fd = 3 2024-09-19T06:19:02.042 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.042 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.042 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.042 INFO:tasks.workunit.client.0.smithi003.stdout:253/600: open fd = 3 2024-09-19T06:19:02.042 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.043 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.043 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.043 INFO:tasks.workunit.client.0.smithi003.stdout:254/600: open fd = 3 2024-09-19T06:19:02.043 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.043 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.043 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.043 INFO:tasks.workunit.client.0.smithi003.stdout:255/600: open fd = 3 2024-09-19T06:19:02.043 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.043 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.043 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.043 INFO:tasks.workunit.client.0.smithi003.stdout:256/600: open fd = 3 2024-09-19T06:19:02.043 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.043 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.043 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.044 INFO:tasks.workunit.client.0.smithi003.stdout:257/600: open fd = 3 2024-09-19T06:19:02.044 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.044 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.044 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.044 INFO:tasks.workunit.client.0.smithi003.stdout:258/600: open fd = 3 2024-09-19T06:19:02.044 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.044 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.044 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.044 INFO:tasks.workunit.client.0.smithi003.stdout:259/600: open fd = 3 2024-09-19T06:19:02.044 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.044 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.044 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.044 INFO:tasks.workunit.client.0.smithi003.stdout:260/600: open fd = 3 2024-09-19T06:19:02.044 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.045 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.045 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.045 INFO:tasks.workunit.client.0.smithi003.stdout:261/600: open fd = 3 2024-09-19T06:19:02.045 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.045 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.045 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.045 INFO:tasks.workunit.client.0.smithi003.stdout:262/600: open fd = 3 2024-09-19T06:19:02.045 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.045 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.045 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.045 INFO:tasks.workunit.client.0.smithi003.stdout:263/600: open fd = 3 2024-09-19T06:19:02.045 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.045 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.045 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.046 INFO:tasks.workunit.client.0.smithi003.stdout:264/600: open fd = 3 2024-09-19T06:19:02.046 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.046 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.046 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.046 INFO:tasks.workunit.client.0.smithi003.stdout:265/600: open fd = 3 2024-09-19T06:19:02.046 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.046 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.046 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.046 INFO:tasks.workunit.client.0.smithi003.stdout:266/600: open fd = 3 2024-09-19T06:19:02.046 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.046 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.046 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.046 INFO:tasks.workunit.client.0.smithi003.stdout:267/600: open fd = 3 2024-09-19T06:19:02.046 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.047 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.047 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.047 INFO:tasks.workunit.client.0.smithi003.stdout:268/600: open fd = 3 2024-09-19T06:19:02.047 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.047 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.047 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.047 INFO:tasks.workunit.client.0.smithi003.stdout:269/600: open fd = 3 2024-09-19T06:19:02.047 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.047 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.047 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.047 INFO:tasks.workunit.client.0.smithi003.stdout:270/600: open fd = 3 2024-09-19T06:19:02.047 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.047 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.047 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.048 INFO:tasks.workunit.client.0.smithi003.stdout:271/600: open fd = 3 2024-09-19T06:19:02.048 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.048 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.048 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.048 INFO:tasks.workunit.client.0.smithi003.stdout:272/600: open fd = 3 2024-09-19T06:19:02.048 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.048 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.048 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.048 INFO:tasks.workunit.client.0.smithi003.stdout:273/600: open fd = 3 2024-09-19T06:19:02.048 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.048 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.048 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.048 INFO:tasks.workunit.client.0.smithi003.stdout:274/600: open fd = 3 2024-09-19T06:19:02.048 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.049 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.049 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.049 INFO:tasks.workunit.client.0.smithi003.stdout:275/600: open fd = 3 2024-09-19T06:19:02.049 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.049 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.049 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.049 INFO:tasks.workunit.client.0.smithi003.stdout:276/600: open fd = 3 2024-09-19T06:19:02.049 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.049 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.049 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.049 INFO:tasks.workunit.client.0.smithi003.stdout:277/600: open fd = 3 2024-09-19T06:19:02.049 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.049 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.049 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.050 INFO:tasks.workunit.client.0.smithi003.stdout:278/600: open fd = 3 2024-09-19T06:19:02.050 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.050 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.050 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.050 INFO:tasks.workunit.client.0.smithi003.stdout:279/600: open fd = 3 2024-09-19T06:19:02.050 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.050 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.051 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.051 INFO:tasks.workunit.client.0.smithi003.stdout:280/600: open fd = 3 2024-09-19T06:19:02.051 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.051 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.051 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.052 INFO:tasks.workunit.client.0.smithi003.stdout:281/600: open fd = 3 2024-09-19T06:19:02.052 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.052 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.052 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.052 INFO:tasks.workunit.client.0.smithi003.stdout:282/600: open fd = 3 2024-09-19T06:19:02.052 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.052 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.052 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.052 INFO:tasks.workunit.client.0.smithi003.stdout:283/600: open fd = 3 2024-09-19T06:19:02.052 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.052 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.052 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.052 INFO:tasks.workunit.client.0.smithi003.stdout:284/600: open fd = 3 2024-09-19T06:19:02.053 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.053 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.053 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.053 INFO:tasks.workunit.client.0.smithi003.stdout:285/600: open fd = 3 2024-09-19T06:19:02.053 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.053 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.053 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.053 INFO:tasks.workunit.client.0.smithi003.stdout:286/600: open fd = 3 2024-09-19T06:19:02.053 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.053 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.053 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.053 INFO:tasks.workunit.client.0.smithi003.stdout:287/600: open fd = 3 2024-09-19T06:19:02.053 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.053 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.054 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.054 INFO:tasks.workunit.client.0.smithi003.stdout:288/600: open fd = 3 2024-09-19T06:19:02.054 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.054 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.054 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.054 INFO:tasks.workunit.client.0.smithi003.stdout:289/600: open fd = 3 2024-09-19T06:19:02.054 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.054 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.054 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.055 INFO:tasks.workunit.client.0.smithi003.stdout:290/600: open fd = 3 2024-09-19T06:19:02.055 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.055 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.055 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.055 INFO:tasks.workunit.client.0.smithi003.stdout:291/600: open fd = 3 2024-09-19T06:19:02.055 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.055 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.055 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.055 INFO:tasks.workunit.client.0.smithi003.stdout:292/600: open fd = 3 2024-09-19T06:19:02.055 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.055 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.055 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.055 INFO:tasks.workunit.client.0.smithi003.stdout:293/600: open fd = 3 2024-09-19T06:19:02.055 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.056 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.056 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.056 INFO:tasks.workunit.client.0.smithi003.stdout:294/600: open fd = 3 2024-09-19T06:19:02.056 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.056 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.056 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.056 INFO:tasks.workunit.client.0.smithi003.stdout:295/600: open fd = 3 2024-09-19T06:19:02.056 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.056 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.056 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.056 INFO:tasks.workunit.client.0.smithi003.stdout:296/600: open fd = 3 2024-09-19T06:19:02.056 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.056 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.056 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.056 INFO:tasks.workunit.client.0.smithi003.stdout:297/600: open fd = 3 2024-09-19T06:19:02.057 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.057 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.057 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.057 INFO:tasks.workunit.client.0.smithi003.stdout:298/600: open fd = 3 2024-09-19T06:19:02.057 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.057 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.057 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.057 INFO:tasks.workunit.client.0.smithi003.stdout:299/600: open fd = 3 2024-09-19T06:19:02.057 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.057 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.057 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.057 INFO:tasks.workunit.client.0.smithi003.stdout:300/600: open fd = 3 2024-09-19T06:19:02.057 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.057 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.058 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.058 INFO:tasks.workunit.client.0.smithi003.stdout:301/600: open fd = 3 2024-09-19T06:19:02.058 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.058 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.058 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.058 INFO:tasks.workunit.client.0.smithi003.stdout:302/600: open fd = 3 2024-09-19T06:19:02.058 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.058 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.058 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.058 INFO:tasks.workunit.client.0.smithi003.stdout:303/600: open fd = 3 2024-09-19T06:19:02.058 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.058 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.058 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.058 INFO:tasks.workunit.client.0.smithi003.stdout:304/600: open fd = 3 2024-09-19T06:19:02.059 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.059 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.059 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.059 INFO:tasks.workunit.client.0.smithi003.stdout:305/600: open fd = 3 2024-09-19T06:19:02.059 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.059 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.059 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.059 INFO:tasks.workunit.client.0.smithi003.stdout:306/600: open fd = 3 2024-09-19T06:19:02.059 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.059 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.059 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.059 INFO:tasks.workunit.client.0.smithi003.stdout:307/600: open fd = 3 2024-09-19T06:19:02.059 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.059 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.060 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.060 INFO:tasks.workunit.client.0.smithi003.stdout:308/600: open fd = 3 2024-09-19T06:19:02.060 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.060 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.060 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.060 INFO:tasks.workunit.client.0.smithi003.stdout:309/600: open fd = 3 2024-09-19T06:19:02.060 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.060 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.060 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.060 INFO:tasks.workunit.client.0.smithi003.stdout:310/600: open fd = 3 2024-09-19T06:19:02.060 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.060 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.060 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.060 INFO:tasks.workunit.client.0.smithi003.stdout:311/600: open fd = 3 2024-09-19T06:19:02.061 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.061 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.061 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:19:02.061 INFO:tasks.workunit.client.0.smithi003.stdout:312/600: open fd = 3 2024-09-19T06:19:02.061 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.061 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:19:02.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:01 smithi003 ceph-mon[30893]: pgmap v202: 97 pgs: 97 active+clean; 2.7 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-09-19T06:19:02.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:01 smithi071 ceph-mon[35662]: pgmap v202: 97 pgs: 97 active+clean; 2.7 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-09-19T06:19:04.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:03 smithi059 ceph-mon[35138]: pgmap v203: 97 pgs: 97 active+clean; 2.7 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-09-19T06:19:04.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:03 smithi003 ceph-mon[30893]: pgmap v203: 97 pgs: 97 active+clean; 2.7 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-09-19T06:19:04.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:03 smithi071 ceph-mon[35662]: pgmap v203: 97 pgs: 97 active+clean; 2.7 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-09-19T06:19:06.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:05 smithi059 ceph-mon[35138]: pgmap v204: 97 pgs: 97 active+clean; 3.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 104 KiB/s wr, 40 op/s 2024-09-19T06:19:06.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:05 smithi003 ceph-mon[30893]: pgmap v204: 97 pgs: 97 active+clean; 3.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 104 KiB/s wr, 40 op/s 2024-09-19T06:19:06.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:05 smithi071 ceph-mon[35662]: pgmap v204: 97 pgs: 97 active+clean; 3.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 104 KiB/s wr, 40 op/s 2024-09-19T06:19:07.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:06 smithi059 ceph-mon[35138]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T06:19:07.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:06 smithi003 ceph-mon[30893]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T06:19:07.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:06 smithi071 ceph-mon[35662]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T06:19:08.037 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:07 smithi003 ceph-mon[30893]: pgmap v206: 97 pgs: 97 active+clean; 3.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 106 KiB/s wr, 41 op/s 2024-09-19T06:19:08.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:07 smithi059 ceph-mon[35138]: pgmap v206: 97 pgs: 97 active+clean; 3.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 106 KiB/s wr, 41 op/s 2024-09-19T06:19:08.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:07 smithi071 ceph-mon[35662]: pgmap v206: 97 pgs: 97 active+clean; 3.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 106 KiB/s wr, 41 op/s 2024-09-19T06:19:10.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:09 smithi059 ceph-mon[35138]: pgmap v207: 97 pgs: 97 active+clean; 3.2 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 107 KiB/s wr, 39 op/s 2024-09-19T06:19:10.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:09 smithi003 ceph-mon[30893]: pgmap v207: 97 pgs: 97 active+clean; 3.2 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 107 KiB/s wr, 39 op/s 2024-09-19T06:19:10.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:09 smithi071 ceph-mon[35662]: pgmap v207: 97 pgs: 97 active+clean; 3.2 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 107 KiB/s wr, 39 op/s 2024-09-19T06:19:12.038 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:11 smithi059 ceph-mon[35138]: pgmap v208: 97 pgs: 97 active+clean; 3.2 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 107 KiB/s wr, 39 op/s 2024-09-19T06:19:12.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:11 smithi003 ceph-mon[30893]: pgmap v208: 97 pgs: 97 active+clean; 3.2 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 107 KiB/s wr, 39 op/s 2024-09-19T06:19:12.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:11 smithi071 ceph-mon[35662]: pgmap v208: 97 pgs: 97 active+clean; 3.2 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 107 KiB/s wr, 39 op/s 2024-09-19T06:19:13.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:12 smithi059 ceph-mon[35138]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T06:19:13.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:12 smithi003 ceph-mon[30893]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T06:19:13.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:12 smithi071 ceph-mon[35662]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T06:19:14.079 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.077+0000 7f0132a00640 1 -- 172.21.15.3:0/1448450995 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f012c107940 msgr2=0x7f012c107d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:14.080 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.077+0000 7f0132a00640 1 --2- 172.21.15.3:0/1448450995 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f012c107940 0x7f012c107d20 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0120009930 tx=0x7f012002a420 comp rx=0 tx=0).stop 2024-09-19T06:19:14.080 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.077+0000 7f0132a00640 1 -- 172.21.15.3:0/1448450995 shutdown_connections 2024-09-19T06:19:14.080 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.077+0000 7f0132a00640 1 --2- 172.21.15.3:0/1448450995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f012c1022d0 0x7f012c10e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.080 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.077+0000 7f0132a00640 1 --2- 172.21.15.3:0/1448450995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f012c101930 0x7f012c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.080 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.077+0000 7f0132a00640 1 --2- 172.21.15.3:0/1448450995 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f012c107940 0x7f012c107d20 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.080 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.077+0000 7f0132a00640 1 -- 172.21.15.3:0/1448450995 >> 172.21.15.3:0/1448450995 conn(0x7f012c0fd630 msgr2=0x7f012c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:14.080 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.077+0000 7f0132a00640 1 -- 172.21.15.3:0/1448450995 shutdown_connections 2024-09-19T06:19:14.080 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.077+0000 7f0132a00640 1 -- 172.21.15.3:0/1448450995 wait complete. 2024-09-19T06:19:14.082 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.078+0000 7f0132a00640 1 Processor -- start 2024-09-19T06:19:14.082 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.078+0000 7f0132a00640 1 -- start start 2024-09-19T06:19:14.082 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.079+0000 7f0132a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f012c101930 0x7f012c198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:14.082 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.079+0000 7f0132a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f012c1022d0 0x7f012c1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:14.082 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.079+0000 7f0132a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f012c107940 0x7f012c19cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.079+0000 7f0132a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f012c111dd0 con 0x7f012c107940 2024-09-19T06:19:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.079+0000 7f0132a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f012c111c50 con 0x7f012c1022d0 2024-09-19T06:19:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.079+0000 7f0132a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f012c111f50 con 0x7f012c101930 2024-09-19T06:19:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.079+0000 7f0132000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f012c107940 0x7f012c19cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.079+0000 7f0132000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f012c107940 0x7f012c19cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50962/0 (socket says 172.21.15.3:50962) 2024-09-19T06:19:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.079+0000 7f0132000640 1 -- 172.21.15.3:0/3877035550 learned_addr learned my addr 172.21.15.3:0/3877035550 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.079+0000 7f0131600640 1 --2- 172.21.15.3:0/3877035550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f012c101930 0x7f012c198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.079+0000 7f0130c00640 1 --2- 172.21.15.3:0/3877035550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f012c1022d0 0x7f012c1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.080+0000 7f0132000640 1 -- 172.21.15.3:0/3877035550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f012c101930 msgr2=0x7f012c198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.080+0000 7f0132000640 1 --2- 172.21.15.3:0/3877035550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f012c101930 0x7f012c198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.080+0000 7f0132000640 1 -- 172.21.15.3:0/3877035550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f012c1022d0 msgr2=0x7f012c1987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.080+0000 7f0132000640 1 --2- 172.21.15.3:0/3877035550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f012c1022d0 0x7f012c1987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.083 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.080+0000 7f0132000640 1 -- 172.21.15.3:0/3877035550 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f012c19d270 con 0x7f012c107940 2024-09-19T06:19:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.080+0000 7f0132000640 1 --2- 172.21.15.3:0/3877035550 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f012c107940 0x7f012c19cb40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f012400eb10 tx=0x7f012400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.080+0000 7f012a000640 1 -- 172.21.15.3:0/3877035550 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0124004b20 con 0x7f012c107940 2024-09-19T06:19:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.080+0000 7f012a000640 1 -- 172.21.15.3:0/3877035550 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0124004cc0 con 0x7f012c107940 2024-09-19T06:19:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.080+0000 7f0132a00640 1 -- 172.21.15.3:0/3877035550 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f012c19d560 con 0x7f012c107940 2024-09-19T06:19:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.080+0000 7f012a000640 1 -- 172.21.15.3:0/3877035550 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0124010760 con 0x7f012c107940 2024-09-19T06:19:14.084 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.080+0000 7f0132a00640 1 -- 172.21.15.3:0/3877035550 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f012c1a4df0 con 0x7f012c107940 2024-09-19T06:19:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.083+0000 7f0136e72740 1 Processor -- start 2024-09-19T06:19:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.084+0000 7f012a000640 1 -- 172.21.15.3:0/3877035550 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f0124005020 con 0x7f012c107940 2024-09-19T06:19:14.085 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.084+0000 7f0136e72740 1 -- start start 2024-09-19T06:19:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.084+0000 7f0136e72740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558775db33b0 0x558775db3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.084+0000 7f0136e72740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558775db3cd0 0x558775dbe030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.084+0000 7f0136e72740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775dbe570 0x558775dc0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.084+0000 7f0136e72740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558775d19100 con 0x558775dbe570 2024-09-19T06:19:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.084+0000 7f0136e72740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558775cc11b0 con 0x558775db3cd0 2024-09-19T06:19:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.084+0000 7f0136e72740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558775d150c0 con 0x558775db33b0 2024-09-19T06:19:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.084+0000 7f0131600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558775db3cd0 0x558775dbe030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:14.087 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.084+0000 7f0130c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558775db33b0 0x558775db3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.084+0000 7f0131600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558775db3cd0 0x558775dbe030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40148/0 (socket says 172.21.15.3:40148) 2024-09-19T06:19:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.084+0000 7f0131600640 1 -- 172.21.15.3:0/860546461 learned_addr learned my addr 172.21.15.3:0/860546461 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.085+0000 7f0130c00640 1 --2- 172.21.15.3:0/860546461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775dbe570 0x558775dc0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.085+0000 7f0131600640 1 -- 172.21.15.3:0/860546461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558775db33b0 msgr2=0x558775db3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.085+0000 7f0131600640 1 --2- 172.21.15.3:0/860546461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558775db33b0 0x558775db3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.085+0000 7f0131600640 1 -- 172.21.15.3:0/860546461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775dbe570 msgr2=0x558775dc0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.085+0000 7f0131600640 1 --2- 172.21.15.3:0/860546461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775dbe570 0x558775dc0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.085+0000 7f0131600640 1 -- 172.21.15.3:0/860546461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558775a2c210 con 0x558775db3cd0 2024-09-19T06:19:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.085+0000 7f0130c00640 1 --2- 172.21.15.3:0/860546461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775dbe570 0x558775dc0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.085+0000 7f0131600640 1 --2- 172.21.15.3:0/860546461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558775db3cd0 0x558775dbe030 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0120009930 tx=0x7f0120005de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1264ae09d629c169 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:14.088 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.085+0000 7f012a000640 1 --2- 172.21.15.3:0/3877035550 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f01140a33a0 0x7f01140a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.086+0000 7f012a000640 1 -- 172.21.15.3:0/3877035550 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f01240d0240 con 0x7f012c107940 2024-09-19T06:19:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.086+0000 7f011e600640 1 -- 172.21.15.3:0/860546461 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0120035040 con 0x558775db3cd0 2024-09-19T06:19:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.086+0000 7f011e600640 1 -- 172.21.15.3:0/860546461 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0120005520 con 0x558775db3cd0 2024-09-19T06:19:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.086+0000 7f011e600640 1 -- 172.21.15.3:0/860546461 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01200035f0 con 0x558775db3cd0 2024-09-19T06:19:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.086+0000 7f0130c00640 1 --2- 172.21.15.3:0/3877035550 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f01140a33a0 0x7f01140a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.086+0000 7f0136e72740 1 -- 172.21.15.3:0/860546461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558775db3cd0 msgr2=0x558775dbe030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.086+0000 7f0130c00640 1 --2- 172.21.15.3:0/3877035550 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f01140a33a0 0x7f01140a5860 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x558775db0ca0 tx=0x7f0118013040 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.086+0000 7f0136e72740 1 --2- 172.21.15.3:0/860546461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558775db3cd0 0x558775dbe030 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0120009930 tx=0x7f0120005de0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.091 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.087+0000 7f0136e72740 1 -- 172.21.15.3:0/860546461 shutdown_connections 2024-09-19T06:19:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.087+0000 7f0136e72740 1 --2- 172.21.15.3:0/860546461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775dbe570 0x558775dc0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.087+0000 7f0136e72740 1 --2- 172.21.15.3:0/860546461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558775db3cd0 0x558775dbe030 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.087+0000 7f0136e72740 1 --2- 172.21.15.3:0/860546461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558775db33b0 0x558775db3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.087+0000 7f0136e72740 1 -- 172.21.15.3:0/860546461 >> 172.21.15.3:0/860546461 conn(0x558775daf920 msgr2=0x558775dafd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.087+0000 7f0136e72740 1 -- 172.21.15.3:0/860546461 shutdown_connections 2024-09-19T06:19:14.092 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.087+0000 7f0136e72740 1 -- 172.21.15.3:0/860546461 wait complete. 2024-09-19T06:19:14.093 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.087+0000 7f0136e72740 1 -- start start 2024-09-19T06:19:14.093 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.087+0000 7f0136e72740 1 Processor -- start 2024-09-19T06:19:14.093 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.088+0000 7f0136e72740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775db33b0 0x558775dc2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:14.093 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.088+0000 7f0136e72740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558775db3cd0 0x558775dc30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:14.093 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.088+0000 7f0136e72740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558775dbe570 0x558775dc7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:14.093 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.088+0000 7f0136e72740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558775dc0ff0 con 0x558775db33b0 2024-09-19T06:19:14.093 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.088+0000 7f0136e72740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558775ca2090 con 0x558775db3cd0 2024-09-19T06:19:14.093 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.088+0000 7f0136e72740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558775dc1170 con 0x558775dbe570 2024-09-19T06:19:14.093 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.088+0000 7f0136e72740 10 client.0 _ll_register_callbacks cb 0x558775cf6f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:14.093 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.088+0000 7f0131600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775db33b0 0x558775dc2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:14.093 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.088+0000 7f0131600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775db33b0 0x558775dc2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50990/0 (socket says 172.21.15.3:50990) 2024-09-19T06:19:14.093 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.088+0000 7f0131600640 1 -- 172.21.15.3:0/1371089596 learned_addr learned my addr 172.21.15.3:0/1371089596 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:14.093 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.088+0000 7f0130c00640 1 --2- 172.21.15.3:0/1371089596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558775db3cd0 0x558775dc30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:14.093 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.088+0000 7f0132000640 1 --2- 172.21.15.3:0/1371089596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558775dbe570 0x558775dc7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:14.094 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.089+0000 7f0131600640 1 -- 172.21.15.3:0/1371089596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558775dbe570 msgr2=0x558775dc7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:14.094 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.089+0000 7f0131600640 1 --2- 172.21.15.3:0/1371089596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558775dbe570 0x558775dc7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.094 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.089+0000 7f0131600640 1 -- 172.21.15.3:0/1371089596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558775db3cd0 msgr2=0x558775dc30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:14.094 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.089+0000 7f0131600640 1 --2- 172.21.15.3:0/1371089596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558775db3cd0 0x558775dc30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.094 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.089+0000 7f0131600640 1 -- 172.21.15.3:0/1371089596 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558775af8620 con 0x558775db33b0 2024-09-19T06:19:14.094 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.089+0000 7f0131600640 1 --2- 172.21.15.3:0/1371089596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775db33b0 0x558775dc2b90 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f012002a940 tx=0x7f0120005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce41b6873f6b495 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:14.094 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.089+0000 7f0112a00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:19:14.094 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.089+0000 7f0112a00640 1 -- 172.21.15.3:0/1371089596 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0120052060 con 0x558775db33b0 2024-09-19T06:19:14.094 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.089+0000 7f0136e72740 1 -- 172.21.15.3:0/1371089596 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0120005520 con 0x558775db33b0 2024-09-19T06:19:14.094 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.089+0000 7f0112a00640 1 -- 172.21.15.3:0/1371089596 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f0120004390 con 0x558775db33b0 2024-09-19T06:19:14.094 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.089+0000 7f0112a00640 1 -- 172.21.15.3:0/1371089596 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0120035070 con 0x558775db33b0 2024-09-19T06:19:14.094 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.089+0000 7f0136e72740 10 client.17124 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:14.095 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.089+0000 7f0136e72740 1 -- 172.21.15.3:0/1371089596 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558775dd12b0 con 0x558775db33b0 2024-09-19T06:19:14.096 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.090+0000 7f0112a00640 1 -- 172.21.15.3:0/1371089596 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0120005520 con 0x558775db33b0 2024-09-19T06:19:14.096 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.090+0000 7f0112a00640 1 -- 172.21.15.3:0/1371089596 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0120003860 con 0x558775db33b0 2024-09-19T06:19:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.090+0000 7f0136e72740 10 client.17124 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.090+0000 7f0136e72740 10 client.17124 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.090+0000 7f0136e72740 20 client.17124 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.090+0000 7f0136e72740 1 --2- 172.21.15.3:0/1371089596 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558775dd2600 0x558775dd49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.090+0000 7f0136e72740 4 client.17124 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.090+0000 7f0136e72740 1 -- 172.21.15.3:0/1371089596 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558775d26830 con 0x558775dd2600 2024-09-19T06:19:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.091+0000 7f0130c00640 1 --2- 172.21.15.3:0/1371089596 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558775dd2600 0x558775dd49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.091+0000 7f0130c00640 1 --2- 172.21.15.3:0/1371089596 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558775dd2600 0x558775dd49f0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21158526135b9438 server_cookie=76a52f6d53068019 in_seq=0 out_seq=0 2024-09-19T06:19:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.091+0000 7f0112a00640 10 client.17124 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.092+0000 7f0112a00640 1 -- 172.21.15.3:0/1371089596 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558775d26830 con 0x558775dd2600 2024-09-19T06:19:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.092+0000 7f0112a00640 10 client.17124 handle_command_reply: tid=0 2024-09-19T06:19:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.092+0000 7f0136e72740 1 client.17124 shutdown 2024-09-19T06:19:14.097 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.092+0000 7f0136e72740 1 -- 172.21.15.3:0/1371089596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775db33b0 msgr2=0x558775dc2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:14.098 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.092+0000 7f0136e72740 1 --2- 172.21.15.3:0/1371089596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775db33b0 0x558775dc2b90 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f012002a940 tx=0x7f0120005b50 comp rx=0 tx=0).stop 2024-09-19T06:19:14.098 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.092+0000 7f0136e72740 1 -- 172.21.15.3:0/1371089596 shutdown_connections 2024-09-19T06:19:14.098 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.092+0000 7f0136e72740 1 --2- 172.21.15.3:0/1371089596 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558775dd2600 0x558775dd49f0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.098 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.092+0000 7f0136e72740 1 --2- 172.21.15.3:0/1371089596 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558775dbe570 0x558775dc7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.098 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.092+0000 7f0136e72740 1 --2- 172.21.15.3:0/1371089596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558775db3cd0 0x558775dc30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.098 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.092+0000 7f0112a00640 0 client.17124 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:14.098 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.092+0000 7f0136e72740 1 --2- 172.21.15.3:0/1371089596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775db33b0 0x558775dc2b90 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.098 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.092+0000 7f0136e72740 1 -- 172.21.15.3:0/1371089596 >> 172.21.15.3:0/1371089596 conn(0x558775daf920 msgr2=0x558775db5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:14.098 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.092+0000 7f0136e72740 1 -- 172.21.15.3:0/1371089596 shutdown_connections 2024-09-19T06:19:14.098 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.092+0000 7f0136e72740 1 -- 172.21.15.3:0/1371089596 wait complete. 2024-09-19T06:19:14.098 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.093+0000 7f0136e72740 20 client.17124 trim_cache size 0 max 16384 2024-09-19T06:19:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.108+0000 7f0136e72740 1 Processor -- start 2024-09-19T06:19:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.108+0000 7f0136e72740 1 -- start start 2024-09-19T06:19:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.108+0000 7f0136e72740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775db33b0 0x558775dc7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.108+0000 7f0136e72740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558775db3cd0 0x558775dd9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.109+0000 7f0136e72740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558775dbe570 0x558775dda530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:14.116 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.109+0000 7f0136e72740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f012c1ab5f0 con 0x558775db33b0 2024-09-19T06:19:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.109+0000 7f0136e72740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f012c1ad130 con 0x558775dbe570 2024-09-19T06:19:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.109+0000 7f0136e72740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f012c1abcc0 con 0x558775db3cd0 2024-09-19T06:19:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.109+0000 7f0131600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775db33b0 0x558775dc7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.109+0000 7f0131600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775db33b0 0x558775dc7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51004/0 (socket says 172.21.15.3:51004) 2024-09-19T06:19:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.109+0000 7f0131600640 1 -- 172.21.15.3:0/784612002 learned_addr learned my addr 172.21.15.3:0/784612002 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.109+0000 7f0130c00640 1 --2- 172.21.15.3:0/784612002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558775db3cd0 0x558775dd9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.109+0000 7f0132000640 1 --2- 172.21.15.3:0/784612002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558775dbe570 0x558775dda530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.109+0000 7f0131600640 1 -- 172.21.15.3:0/784612002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558775db3cd0 msgr2=0x558775dd9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.109+0000 7f0131600640 1 --2- 172.21.15.3:0/784612002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558775db3cd0 0x558775dd9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.109+0000 7f0131600640 1 -- 172.21.15.3:0/784612002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558775dbe570 msgr2=0x558775dda530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.109+0000 7f0131600640 1 --2- 172.21.15.3:0/784612002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558775dbe570 0x558775dda530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.109+0000 7f0131600640 1 -- 172.21.15.3:0/784612002 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558775dbdf80 con 0x558775db33b0 2024-09-19T06:19:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.109+0000 7f0131600640 1 --2- 172.21.15.3:0/784612002 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775db33b0 0x558775dc7110 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0120009430 tx=0x7f0120001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d56abf7b519359 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.110+0000 7f011dc00640 1 -- 172.21.15.3:0/784612002 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0120052070 con 0x558775db33b0 2024-09-19T06:19:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.110+0000 7f011dc00640 1 -- 172.21.15.3:0/784612002 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0120003e40 con 0x558775db33b0 2024-09-19T06:19:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.110+0000 7f011dc00640 1 -- 172.21.15.3:0/784612002 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0120031ae0 con 0x558775db33b0 2024-09-19T06:19:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.110+0000 7f0136e72740 1 -- 172.21.15.3:0/784612002 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775db33b0 msgr2=0x558775dc7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.110+0000 7f0136e72740 1 --2- 172.21.15.3:0/784612002 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775db33b0 0x558775dc7110 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0120009430 tx=0x7f0120001e50 comp rx=0 tx=0).stop 2024-09-19T06:19:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.110+0000 7f0136e72740 1 -- 172.21.15.3:0/784612002 shutdown_connections 2024-09-19T06:19:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.110+0000 7f0136e72740 1 --2- 172.21.15.3:0/784612002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558775dbe570 0x558775dda530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.110+0000 7f0136e72740 1 --2- 172.21.15.3:0/784612002 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558775db3cd0 0x558775dd9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.110+0000 7f0136e72740 1 --2- 172.21.15.3:0/784612002 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775db33b0 0x558775dc7110 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.110+0000 7f0136e72740 1 -- 172.21.15.3:0/784612002 >> 172.21.15.3:0/784612002 conn(0x558775daf920 msgr2=0x558775dbad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.110+0000 7f0136e72740 1 -- 172.21.15.3:0/784612002 shutdown_connections 2024-09-19T06:19:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.110+0000 7f0136e72740 1 -- 172.21.15.3:0/784612002 wait complete. 2024-09-19T06:19:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.111+0000 7f0136e72740 1 -- start start 2024-09-19T06:19:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.111+0000 7f0136e72740 1 Processor -- start 2024-09-19T06:19:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.111+0000 7f0136e72740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558775db33b0 0x558775dca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.111+0000 7f0136e72740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558775db3cd0 0x558775dca860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.111+0000 7f0136e72740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775dbe570 0x558775e3afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.111+0000 7f0136e72740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f012c1aca60 con 0x558775dbe570 2024-09-19T06:19:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.111+0000 7f0136e72740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f012c1ac390 con 0x558775db3cd0 2024-09-19T06:19:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.111+0000 7f0136e72740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f012c1a95f0 con 0x558775db33b0 2024-09-19T06:19:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.111+0000 7f0136e72740 10 client.0 _ll_register_callbacks cb 0x7f01180099f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.112+0000 7f0132000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775dbe570 0x558775e3afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.112+0000 7f0130c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558775db3cd0 0x558775dca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.112+0000 7f0131600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558775db33b0 0x558775dca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.112+0000 7f0130c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558775db3cd0 0x558775dca860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40178/0 (socket says 172.21.15.3:40178) 2024-09-19T06:19:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.112+0000 7f0130c00640 1 -- 172.21.15.3:0/2700764585 learned_addr learned my addr 172.21.15.3:0/2700764585 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.112+0000 7f0132000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775dbe570 0x558775e3afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51018/0 (socket says 172.21.15.3:51018) 2024-09-19T06:19:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.112+0000 7f0132000640 1 -- 172.21.15.3:0/2700764585 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558775db33b0 msgr2=0x558775dca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.112+0000 7f0132000640 1 --2- 172.21.15.3:0/2700764585 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558775db33b0 0x558775dca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.112+0000 7f0132000640 1 -- 172.21.15.3:0/2700764585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558775db3cd0 msgr2=0x558775dca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.112+0000 7f0132000640 1 --2- 172.21.15.3:0/2700764585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558775db3cd0 0x558775dca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.112+0000 7f0132000640 1 -- 172.21.15.3:0/2700764585 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558775e3b5a0 con 0x558775dbe570 2024-09-19T06:19:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.112+0000 7f0132000640 1 --2- 172.21.15.3:0/2700764585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775dbe570 0x558775e3afb0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f01240cd960 tx=0x7f012409c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1570dea1748d56d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.112+0000 7f0112a00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:19:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.112+0000 7f0112a00640 1 -- 172.21.15.3:0/2700764585 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01240ba060 con 0x558775dbe570 2024-09-19T06:19:14.120 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.112+0000 7f0112a00640 1 -- 172.21.15.3:0/2700764585 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f01240b5280 con 0x558775dbe570 2024-09-19T06:19:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.113+0000 7f0136e72740 1 -- 172.21.15.3:0/2700764585 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0120003e40 con 0x558775dbe570 2024-09-19T06:19:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.113+0000 7f0112a00640 1 -- 172.21.15.3:0/2700764585 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f012409c4f0 con 0x558775dbe570 2024-09-19T06:19:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.113+0000 7f0136e72740 10 client.17130 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.113+0000 7f0136e72740 1 -- 172.21.15.3:0/2700764585 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558775e3c890 con 0x558775dbe570 2024-09-19T06:19:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.113+0000 7f0112a00640 1 -- 172.21.15.3:0/2700764585 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0120003e40 con 0x558775dbe570 2024-09-19T06:19:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.113+0000 7f0112a00640 1 -- 172.21.15.3:0/2700764585 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0124005310 con 0x558775dbe570 2024-09-19T06:19:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.113+0000 7f0136e72740 10 client.17130 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.113+0000 7f0136e72740 10 client.17130 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.113+0000 7f0136e72740 20 client.17130 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.113+0000 7f0136e72740 1 --2- 172.21.15.3:0/2700764585 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558775e3d010 0x558775e3f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.113+0000 7f0136e72740 4 client.17130 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:19:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.113+0000 7f0136e72740 1 -- 172.21.15.3:0/2700764585 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558775d20b80 con 0x558775e3d010 2024-09-19T06:19:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.114+0000 7f0131600640 1 --2- 172.21.15.3:0/2700764585 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558775e3d010 0x558775e3f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:14.121 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.114+0000 7f0131600640 1 --2- 172.21.15.3:0/2700764585 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558775e3d010 0x558775e3f430 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5db7d70a2a2fef44 server_cookie=509a99e2e970fde5 in_seq=0 out_seq=0 2024-09-19T06:19:14.122 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.114+0000 7f0112a00640 10 client.17130 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.128+0000 7f0112a00640 1 -- 172.21.15.3:0/2700764585 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558775d20b80 con 0x558775e3d010 2024-09-19T06:19:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.128+0000 7f0112a00640 10 client.17130 handle_command_reply: tid=0 2024-09-19T06:19:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.129+0000 7f0136e72740 1 client.17130 shutdown 2024-09-19T06:19:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.129+0000 7f0136e72740 1 -- 172.21.15.3:0/2700764585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775dbe570 msgr2=0x558775e3afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.129+0000 7f0136e72740 1 --2- 172.21.15.3:0/2700764585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775dbe570 0x558775e3afb0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f01240cd960 tx=0x7f012409c380 comp rx=0 tx=0).stop 2024-09-19T06:19:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.129+0000 7f0136e72740 1 -- 172.21.15.3:0/2700764585 shutdown_connections 2024-09-19T06:19:14.131 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.129+0000 7f0136e72740 1 --2- 172.21.15.3:0/2700764585 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558775e3d010 0x558775e3f430 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.132 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.129+0000 7f0136e72740 1 --2- 172.21.15.3:0/2700764585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558775dbe570 0x558775e3afb0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.132 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.129+0000 7f0136e72740 1 --2- 172.21.15.3:0/2700764585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558775db3cd0 0x558775dca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.132 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.129+0000 7f0136e72740 1 --2- 172.21.15.3:0/2700764585 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558775db33b0 0x558775dca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.132 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.129+0000 7f0136e72740 1 -- 172.21.15.3:0/2700764585 >> 172.21.15.3:0/2700764585 conn(0x558775daf920 msgr2=0x558775dae1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:14.132 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.129+0000 7f0112a00640 0 client.17130 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:14.132 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.129+0000 7f0136e72740 1 -- 172.21.15.3:0/2700764585 shutdown_connections 2024-09-19T06:19:14.132 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.129+0000 7f0136e72740 1 -- 172.21.15.3:0/2700764585 wait complete. 2024-09-19T06:19:14.132 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.129+0000 7f0136e72740 20 client.17130 trim_cache size 0 max 16384 2024-09-19T06:19:14.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:19:14.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:19:14.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:19:14.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:19:14.133 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.130+0000 7f0132a00640 1 -- 172.21.15.3:0/3877035550 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f01140a33a0 msgr2=0x7f01140a5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.130+0000 7f0132a00640 1 --2- 172.21.15.3:0/3877035550 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f01140a33a0 0x7f01140a5860 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x558775db0ca0 tx=0x7f0118013040 comp rx=0 tx=0).stop 2024-09-19T06:19:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.130+0000 7f0132a00640 1 -- 172.21.15.3:0/3877035550 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f012c107940 msgr2=0x7f012c19cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.130+0000 7f0132a00640 1 --2- 172.21.15.3:0/3877035550 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f012c107940 0x7f012c19cb40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f012400eb10 tx=0x7f012400c2d0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.130+0000 7f0132a00640 1 -- 172.21.15.3:0/3877035550 shutdown_connections 2024-09-19T06:19:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.130+0000 7f0132a00640 1 --2- 172.21.15.3:0/3877035550 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f01140a33a0 0x7f01140a5860 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.130+0000 7f0132a00640 1 --2- 172.21.15.3:0/3877035550 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f012c107940 0x7f012c19cb40 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.130+0000 7f0132a00640 1 --2- 172.21.15.3:0/3877035550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f012c1022d0 0x7f012c1987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.130+0000 7f0132a00640 1 --2- 172.21.15.3:0/3877035550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f012c101930 0x7f012c198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.130+0000 7f0132a00640 1 -- 172.21.15.3:0/3877035550 >> 172.21.15.3:0/3877035550 conn(0x7f012c0fd630 msgr2=0x7f012c0fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.130+0000 7f0132a00640 1 -- 172.21.15.3:0/3877035550 shutdown_connections 2024-09-19T06:19:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:14.130+0000 7f0132a00640 1 -- 172.21.15.3:0/3877035550 wait complete. 2024-09-19T06:19:14.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:13 smithi059 ceph-mon[35138]: pgmap v210: 97 pgs: 97 active+clean; 3.2 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 9 op/s 2024-09-19T06:19:14.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:13 smithi003 ceph-mon[30893]: pgmap v210: 97 pgs: 97 active+clean; 3.2 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 9 op/s 2024-09-19T06:19:14.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:13 smithi071 ceph-mon[35662]: pgmap v210: 97 pgs: 97 active+clean; 3.2 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 9 op/s 2024-09-19T06:19:16.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:15 smithi059 ceph-mon[35138]: pgmap v211: 97 pgs: 97 active+clean; 3.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 17 op/s 2024-09-19T06:19:16.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:15 smithi003 ceph-mon[30893]: pgmap v211: 97 pgs: 97 active+clean; 3.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 17 op/s 2024-09-19T06:19:16.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:15 smithi071 ceph-mon[35662]: pgmap v211: 97 pgs: 97 active+clean; 3.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 17 op/s 2024-09-19T06:19:18.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:17 smithi059 ceph-mon[35138]: pgmap v212: 97 pgs: 97 active+clean; 3.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 47 KiB/s wr, 15 op/s 2024-09-19T06:19:18.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:17 smithi003 ceph-mon[30893]: pgmap v212: 97 pgs: 97 active+clean; 3.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 47 KiB/s wr, 15 op/s 2024-09-19T06:19:18.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:17 smithi071 ceph-mon[35662]: pgmap v212: 97 pgs: 97 active+clean; 3.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 47 KiB/s wr, 15 op/s 2024-09-19T06:19:20.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:19 smithi059 ceph-mon[35138]: pgmap v213: 97 pgs: 97 active+clean; 3.7 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 54 KiB/s wr, 19 op/s 2024-09-19T06:19:20.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:19 smithi003 ceph-mon[30893]: pgmap v213: 97 pgs: 97 active+clean; 3.7 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 54 KiB/s wr, 19 op/s 2024-09-19T06:19:20.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:19 smithi071 ceph-mon[35662]: pgmap v213: 97 pgs: 97 active+clean; 3.7 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 54 KiB/s wr, 19 op/s 2024-09-19T06:19:22.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:21 smithi059 ceph-mon[35138]: pgmap v214: 97 pgs: 97 active+clean; 3.7 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 54 KiB/s wr, 19 op/s 2024-09-19T06:19:22.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:21 smithi003 ceph-mon[30893]: pgmap v214: 97 pgs: 97 active+clean; 3.7 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 54 KiB/s wr, 19 op/s 2024-09-19T06:19:22.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:21 smithi071 ceph-mon[35662]: pgmap v214: 97 pgs: 97 active+clean; 3.7 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 54 KiB/s wr, 19 op/s 2024-09-19T06:19:24.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:23 smithi059 ceph-mon[35138]: pgmap v215: 97 pgs: 97 active+clean; 3.7 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-09-19T06:19:24.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:23 smithi003 ceph-mon[30893]: pgmap v215: 97 pgs: 97 active+clean; 3.7 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-09-19T06:19:24.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:23 smithi071 ceph-mon[35662]: pgmap v215: 97 pgs: 97 active+clean; 3.7 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-09-19T06:19:26.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:25 smithi059 ceph-mon[35138]: pgmap v216: 97 pgs: 97 active+clean; 3.9 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 22 op/s 2024-09-19T06:19:26.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:25 smithi003 ceph-mon[30893]: pgmap v216: 97 pgs: 97 active+clean; 3.9 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 22 op/s 2024-09-19T06:19:26.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:25 smithi071 ceph-mon[35662]: pgmap v216: 97 pgs: 97 active+clean; 3.9 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 22 op/s 2024-09-19T06:19:27.261 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.259+0000 7f0dcac00640 1 -- 172.21.15.3:0/1015857279 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0dc4102ae0 msgr2=0x7f0dc4102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.259+0000 7f0dcac00640 1 --2- 172.21.15.3:0/1015857279 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0dc4102ae0 0x7f0dc4102ec0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0db8009900 tx=0x7f0db802a480 comp rx=0 tx=0).stop 2024-09-19T06:19:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.259+0000 7f0dcac00640 1 -- 172.21.15.3:0/1015857279 shutdown_connections 2024-09-19T06:19:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.259+0000 7f0dcac00640 1 --2- 172.21.15.3:0/1015857279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dc410bf30 0x7f0dc410e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.259+0000 7f0dcac00640 1 --2- 172.21.15.3:0/1015857279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc4103400 0x7f0dc410b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.259+0000 7f0dcac00640 1 --2- 172.21.15.3:0/1015857279 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0dc4102ae0 0x7f0dc4102ec0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.259+0000 7f0dcac00640 1 -- 172.21.15.3:0/1015857279 >> 172.21.15.3:0/1015857279 conn(0x7f0dc40777f0 msgr2=0x7f0dc40feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.259+0000 7f0dcac00640 1 -- 172.21.15.3:0/1015857279 shutdown_connections 2024-09-19T06:19:27.262 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.259+0000 7f0dcac00640 1 -- 172.21.15.3:0/1015857279 wait complete. 2024-09-19T06:19:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.260+0000 7f0dcac00640 1 Processor -- start 2024-09-19T06:19:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.260+0000 7f0dcac00640 1 -- start start 2024-09-19T06:19:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.261+0000 7f0dcac00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0dc4102ae0 0x7f0dc419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.261+0000 7f0dcac00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dc4103400 0x7f0dc419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.261+0000 7f0dcac00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc410bf30 0x7f0dc419ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:27.264 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.261+0000 7f0dcac00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc4111d60 con 0x7f0dc4102ae0 2024-09-19T06:19:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.261+0000 7f0dcac00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc4111be0 con 0x7f0dc410bf30 2024-09-19T06:19:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.261+0000 7f0dcac00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc4111ee0 con 0x7f0dc4103400 2024-09-19T06:19:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.261+0000 7f0dc9800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0dc4102ae0 0x7f0dc419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.261+0000 7f0dc9800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0dc4102ae0 0x7f0dc419a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50678/0 (socket says 172.21.15.3:50678) 2024-09-19T06:19:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.261+0000 7f0dc9800640 1 -- 172.21.15.3:0/2869357697 learned_addr learned my addr 172.21.15.3:0/2869357697 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.261+0000 7f0dc8e00640 1 --2- 172.21.15.3:0/2869357697 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dc4103400 0x7f0dc419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.261+0000 7f0dca200640 1 --2- 172.21.15.3:0/2869357697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc410bf30 0x7f0dc419ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.261+0000 7f0dc9800640 1 -- 172.21.15.3:0/2869357697 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dc4103400 msgr2=0x7f0dc419a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.261+0000 7f0dc9800640 1 --2- 172.21.15.3:0/2869357697 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dc4103400 0x7f0dc419a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.261+0000 7f0dc9800640 1 -- 172.21.15.3:0/2869357697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc410bf30 msgr2=0x7f0dc419ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.261+0000 7f0dc9800640 1 --2- 172.21.15.3:0/2869357697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc410bf30 0x7f0dc419ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.261+0000 7f0dc9800640 1 -- 172.21.15.3:0/2869357697 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc419f440 con 0x7f0dc4102ae0 2024-09-19T06:19:27.265 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.262+0000 7f0dc9800640 1 --2- 172.21.15.3:0/2869357697 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0dc4102ae0 0x7f0dc419a450 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0db8004770 tx=0x7f0db8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:27.266 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.262+0000 7f0dc2000640 1 -- 172.21.15.3:0/2869357697 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db803f070 con 0x7f0dc4102ae0 2024-09-19T06:19:27.266 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.262+0000 7f0dc2000640 1 -- 172.21.15.3:0/2869357697 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0db8031ca0 con 0x7f0dc4102ae0 2024-09-19T06:19:27.266 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.262+0000 7f0dc2000640 1 -- 172.21.15.3:0/2869357697 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db8035030 con 0x7f0dc4102ae0 2024-09-19T06:19:27.266 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.262+0000 7f0dcac00640 1 -- 172.21.15.3:0/2869357697 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dc419f6d0 con 0x7f0dc4102ae0 2024-09-19T06:19:27.266 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.262+0000 7f0dcac00640 1 -- 172.21.15.3:0/2869357697 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dc41a6fc0 con 0x7f0dc4102ae0 2024-09-19T06:19:27.268 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.266+0000 7f0dcf216740 1 Processor -- start 2024-09-19T06:19:27.268 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.266+0000 7f0dcf216740 1 -- start start 2024-09-19T06:19:27.269 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.267+0000 7f0dcf216740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b93b3b0 0x55ad3b93b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:27.269 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.267+0000 7f0dcf216740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad3b93bcd0 0x55ad3b946030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.267+0000 7f0dcf216740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad3b946570 0x55ad3b948960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.267+0000 7f0dcf216740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ad3b8a1100 con 0x55ad3b93b3b0 2024-09-19T06:19:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.267+0000 7f0dcf216740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ad3b8491b0 con 0x55ad3b946570 2024-09-19T06:19:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.267+0000 7f0dcf216740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ad3b89d0c0 con 0x55ad3b93bcd0 2024-09-19T06:19:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.267+0000 7f0dc2000640 1 -- 172.21.15.3:0/2869357697 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f0db8042070 con 0x7f0dc4102ae0 2024-09-19T06:19:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.267+0000 7f0dca200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b93b3b0 0x55ad3b93b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.267+0000 7f0dc9800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad3b93bcd0 0x55ad3b946030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.267+0000 7f0dca200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b93b3b0 0x55ad3b93b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50682/0 (socket says 172.21.15.3:50682) 2024-09-19T06:19:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.267+0000 7f0dca200640 1 -- 172.21.15.3:0/871399091 learned_addr learned my addr 172.21.15.3:0/871399091 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.267+0000 7f0dc8e00640 1 --2- 172.21.15.3:0/871399091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad3b946570 0x55ad3b948960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.268+0000 7f0dca200640 1 -- 172.21.15.3:0/871399091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad3b93bcd0 msgr2=0x55ad3b946030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.268+0000 7f0dca200640 1 --2- 172.21.15.3:0/871399091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad3b93bcd0 0x55ad3b946030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.268+0000 7f0dca200640 1 -- 172.21.15.3:0/871399091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad3b946570 msgr2=0x55ad3b948960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.268+0000 7f0dca200640 1 --2- 172.21.15.3:0/871399091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad3b946570 0x55ad3b948960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.268+0000 7f0dca200640 1 -- 172.21.15.3:0/871399091 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad3b5b4210 con 0x55ad3b93b3b0 2024-09-19T06:19:27.275 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.268+0000 7f0dca200640 1 --2- 172.21.15.3:0/871399091 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b93b3b0 0x55ad3b93b790 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc009f50 tx=0x7f0dbc0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d7dc142807a503 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:27.275 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.268+0000 7f0db6a00640 1 -- 172.21.15.3:0/871399091 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc004d20 con 0x55ad3b93b3b0 2024-09-19T06:19:27.275 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.268+0000 7f0db6a00640 1 -- 172.21.15.3:0/871399091 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dbc004050 con 0x55ad3b93b3b0 2024-09-19T06:19:27.275 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.268+0000 7f0db6a00640 1 -- 172.21.15.3:0/871399091 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc005280 con 0x55ad3b93b3b0 2024-09-19T06:19:27.275 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.269+0000 7f0dc2000640 1 --2- 172.21.15.3:0/2869357697 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0dac0a3420 0x7f0dac0a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:27.275 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.269+0000 7f0dc2000640 1 -- 172.21.15.3:0/2869357697 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f0db80f02f0 con 0x7f0dc4102ae0 2024-09-19T06:19:27.275 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.269+0000 7f0dc9800640 1 --2- 172.21.15.3:0/2869357697 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0dac0a3420 0x7f0dac0a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:27.275 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.269+0000 7f0dcf216740 1 -- 172.21.15.3:0/871399091 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b93b3b0 msgr2=0x55ad3b93b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:27.275 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.269+0000 7f0dcf216740 1 --2- 172.21.15.3:0/871399091 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b93b3b0 0x55ad3b93b790 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc009f50 tx=0x7f0dbc0118d0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.275 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.269+0000 7f0dcf216740 1 -- 172.21.15.3:0/871399091 shutdown_connections 2024-09-19T06:19:27.275 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.269+0000 7f0dcf216740 1 --2- 172.21.15.3:0/871399091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad3b946570 0x55ad3b948960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.276 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.269+0000 7f0dcf216740 1 --2- 172.21.15.3:0/871399091 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad3b93bcd0 0x55ad3b946030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.276 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.269+0000 7f0dcf216740 1 --2- 172.21.15.3:0/871399091 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b93b3b0 0x55ad3b93b790 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.276 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.269+0000 7f0dcf216740 1 -- 172.21.15.3:0/871399091 >> 172.21.15.3:0/871399091 conn(0x55ad3b937920 msgr2=0x55ad3b937d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:27.276 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.269+0000 7f0dcf216740 1 -- 172.21.15.3:0/871399091 shutdown_connections 2024-09-19T06:19:27.276 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.270+0000 7f0dcf216740 1 -- 172.21.15.3:0/871399091 wait complete. 2024-09-19T06:19:27.276 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.270+0000 7f0dc9800640 1 --2- 172.21.15.3:0/2869357697 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0dac0a3420 0x7f0dac0a58e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55ad3b938780 tx=0x7f0db80f3da0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:27.276 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.270+0000 7f0dcf216740 1 -- start start 2024-09-19T06:19:27.276 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.270+0000 7f0dcf216740 1 Processor -- start 2024-09-19T06:19:27.276 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.271+0000 7f0dcf216740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad3b93b3b0 0x55ad3b9435b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.271+0000 7f0dcf216740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b93bcd0 0x55ad3b943af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.271+0000 7f0dcf216740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad3b946570 0x55ad3b944030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.271+0000 7f0dcf216740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ad3b9490e0 con 0x55ad3b93bcd0 2024-09-19T06:19:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.271+0000 7f0dcf216740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ad3b82a090 con 0x55ad3b946570 2024-09-19T06:19:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.271+0000 7f0dcf216740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ad3b949260 con 0x55ad3b93b3b0 2024-09-19T06:19:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.271+0000 7f0dcf216740 10 client.0 _ll_register_callbacks cb 0x55ad3b87ef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.271+0000 7f0dc8e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b93bcd0 0x55ad3b943af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.271+0000 7f0dc8e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b93bcd0 0x55ad3b943af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50686/0 (socket says 172.21.15.3:50686) 2024-09-19T06:19:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.271+0000 7f0dc8e00640 1 -- 172.21.15.3:0/4159255193 learned_addr learned my addr 172.21.15.3:0/4159255193 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.271+0000 7f0dca200640 1 --2- 172.21.15.3:0/4159255193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad3b946570 0x55ad3b944030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.271+0000 7f0dca200640 1 --2- 172.21.15.3:0/4159255193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad3b93b3b0 0x55ad3b9435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.271+0000 7f0dc8e00640 1 -- 172.21.15.3:0/4159255193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad3b93b3b0 msgr2=0x55ad3b9435b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.271+0000 7f0dc8e00640 1 --2- 172.21.15.3:0/4159255193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad3b93b3b0 0x55ad3b9435b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.271+0000 7f0dc8e00640 1 -- 172.21.15.3:0/4159255193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad3b946570 msgr2=0x55ad3b944030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.271+0000 7f0dc8e00640 1 --2- 172.21.15.3:0/4159255193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad3b946570 0x55ad3b944030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.271+0000 7f0dc8e00640 1 -- 172.21.15.3:0/4159255193 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad3b680620 con 0x55ad3b93bcd0 2024-09-19T06:19:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.271+0000 7f0dca200640 1 --2- 172.21.15.3:0/4159255193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad3b93b3b0 0x55ad3b9435b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.272+0000 7f0dc8e00640 1 --2- 172.21.15.3:0/4159255193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b93bcd0 0x55ad3b943af0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0db0012700 tx=0x7f0db0012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80548db1dcf518fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.272+0000 7f0dab400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:19:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.272+0000 7f0dab400640 1 -- 172.21.15.3:0/4159255193 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db000f920 con 0x55ad3b93bcd0 2024-09-19T06:19:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.272+0000 7f0dcf216740 1 -- 172.21.15.3:0/4159255193 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dbc004050 con 0x55ad3b93bcd0 2024-09-19T06:19:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.272+0000 7f0dab400640 1 -- 172.21.15.3:0/4159255193 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f0db000fac0 con 0x55ad3b93bcd0 2024-09-19T06:19:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.272+0000 7f0dab400640 1 -- 172.21.15.3:0/4159255193 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0db000fcc0 con 0x55ad3b93bcd0 2024-09-19T06:19:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.272+0000 7f0dcf216740 10 client.17142 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.272+0000 7f0dcf216740 1 -- 172.21.15.3:0/4159255193 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ad3b954f50 con 0x55ad3b93bcd0 2024-09-19T06:19:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.272+0000 7f0dab400640 1 -- 172.21.15.3:0/4159255193 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dbc004050 con 0x55ad3b93bcd0 2024-09-19T06:19:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.273+0000 7f0dab400640 1 -- 172.21.15.3:0/4159255193 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0db0010430 con 0x55ad3b93bcd0 2024-09-19T06:19:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.273+0000 7f0dcf216740 10 client.17142 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.273+0000 7f0dcf216740 10 client.17142 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.273+0000 7f0dcf216740 20 client.17142 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.273+0000 7f0dcf216740 1 --2- 172.21.15.3:0/4159255193 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ad3b956480 0x55ad3b958870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.273+0000 7f0dcf216740 4 client.17142 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.273+0000 7f0dcf216740 1 -- 172.21.15.3:0/4159255193 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad3b8ae830 con 0x55ad3b956480 2024-09-19T06:19:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.273+0000 7f0dca200640 1 --2- 172.21.15.3:0/4159255193 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ad3b956480 0x55ad3b958870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.274+0000 7f0dca200640 1 --2- 172.21.15.3:0/4159255193 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ad3b956480 0x55ad3b958870 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=619457d11dd301c0 server_cookie=d20cec62d4b66591 in_seq=0 out_seq=0 2024-09-19T06:19:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.274+0000 7f0dab400640 10 client.17142 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.274+0000 7f0dab400640 1 -- 172.21.15.3:0/4159255193 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ad3b8ae830 con 0x55ad3b956480 2024-09-19T06:19:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.274+0000 7f0dab400640 10 client.17142 handle_command_reply: tid=0 2024-09-19T06:19:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.274+0000 7f0dcf216740 1 client.17142 shutdown 2024-09-19T06:19:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.275+0000 7f0dcf216740 1 -- 172.21.15.3:0/4159255193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b93bcd0 msgr2=0x55ad3b943af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.275+0000 7f0dcf216740 1 --2- 172.21.15.3:0/4159255193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b93bcd0 0x55ad3b943af0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0db0012700 tx=0x7f0db0012bc0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.275+0000 7f0dcf216740 1 -- 172.21.15.3:0/4159255193 shutdown_connections 2024-09-19T06:19:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.275+0000 7f0dcf216740 1 --2- 172.21.15.3:0/4159255193 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ad3b956480 0x55ad3b958870 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.275+0000 7f0dcf216740 1 --2- 172.21.15.3:0/4159255193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad3b946570 0x55ad3b944030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.275+0000 7f0dcf216740 1 --2- 172.21.15.3:0/4159255193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b93bcd0 0x55ad3b943af0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.275+0000 7f0dcf216740 1 --2- 172.21.15.3:0/4159255193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad3b93b3b0 0x55ad3b9435b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.275+0000 7f0dab400640 0 client.17142 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.275+0000 7f0dcf216740 1 -- 172.21.15.3:0/4159255193 >> 172.21.15.3:0/4159255193 conn(0x55ad3b937920 msgr2=0x55ad3b93d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.275+0000 7f0dcf216740 1 -- 172.21.15.3:0/4159255193 shutdown_connections 2024-09-19T06:19:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.275+0000 7f0dcf216740 1 -- 172.21.15.3:0/4159255193 wait complete. 2024-09-19T06:19:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.275+0000 7f0dcf216740 20 client.17142 trim_cache size 0 max 16384 2024-09-19T06:19:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.290+0000 7f0dcf216740 1 Processor -- start 2024-09-19T06:19:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.290+0000 7f0dcf216740 1 -- start start 2024-09-19T06:19:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.291+0000 7f0dcf216740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad3b93b3b0 0x55ad3b943e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.291+0000 7f0dcf216740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad3b93bcd0 0x55ad3b95e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.291+0000 7f0dcf216740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b946570 0x55ad3b95e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.291+0000 7f0dcf216740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc41afa20 con 0x55ad3b946570 2024-09-19T06:19:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.291+0000 7f0dcf216740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc41b1560 con 0x55ad3b93b3b0 2024-09-19T06:19:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.291+0000 7f0dcf216740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc41b00f0 con 0x55ad3b93bcd0 2024-09-19T06:19:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.291+0000 7f0dca200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad3b93b3b0 0x55ad3b943e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.291+0000 7f0dca200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b946570 0x55ad3b95e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.291+0000 7f0dc8e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad3b93bcd0 0x55ad3b95e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.291+0000 7f0dc8e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad3b93bcd0 0x55ad3b95e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:50016/0 (socket says 172.21.15.3:50016) 2024-09-19T06:19:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.291+0000 7f0dc8e00640 1 -- 172.21.15.3:0/3622631980 learned_addr learned my addr 172.21.15.3:0/3622631980 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.291+0000 7f0dca200640 1 -- 172.21.15.3:0/3622631980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad3b93bcd0 msgr2=0x55ad3b95e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.291+0000 7f0dca200640 1 --2- 172.21.15.3:0/3622631980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad3b93bcd0 0x55ad3b95e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.291+0000 7f0dca200640 1 -- 172.21.15.3:0/3622631980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad3b93b3b0 msgr2=0x55ad3b943e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.291+0000 7f0dca200640 1 --2- 172.21.15.3:0/3622631980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad3b93b3b0 0x55ad3b943e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.291+0000 7f0dca200640 1 -- 172.21.15.3:0/3622631980 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad3b93bb00 con 0x55ad3b946570 2024-09-19T06:19:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.292+0000 7f0dca200640 1 --2- 172.21.15.3:0/3622631980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b946570 0x55ad3b95e650 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc012fd0 tx=0x7f0dbc0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2fe5f7be867d93b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.292+0000 7f0db6000640 1 -- 172.21.15.3:0/3622631980 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc004d00 con 0x55ad3b946570 2024-09-19T06:19:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.292+0000 7f0db6000640 1 -- 172.21.15.3:0/3622631980 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dbc005040 con 0x55ad3b946570 2024-09-19T06:19:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.292+0000 7f0db6000640 1 -- 172.21.15.3:0/3622631980 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00f6e0 con 0x55ad3b946570 2024-09-19T06:19:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.293+0000 7f0dcf216740 1 -- 172.21.15.3:0/3622631980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b946570 msgr2=0x55ad3b95e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.293+0000 7f0dcf216740 1 --2- 172.21.15.3:0/3622631980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b946570 0x55ad3b95e650 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc012fd0 tx=0x7f0dbc0047b0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.293+0000 7f0dcf216740 1 -- 172.21.15.3:0/3622631980 shutdown_connections 2024-09-19T06:19:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.293+0000 7f0dcf216740 1 --2- 172.21.15.3:0/3622631980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b946570 0x55ad3b95e650 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.293+0000 7f0dcf216740 1 --2- 172.21.15.3:0/3622631980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad3b93bcd0 0x55ad3b95e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.293+0000 7f0dcf216740 1 --2- 172.21.15.3:0/3622631980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad3b93b3b0 0x55ad3b943e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.293+0000 7f0dcf216740 1 -- 172.21.15.3:0/3622631980 >> 172.21.15.3:0/3622631980 conn(0x55ad3b937920 msgr2=0x55ad3b93e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.293+0000 7f0dcf216740 1 -- 172.21.15.3:0/3622631980 shutdown_connections 2024-09-19T06:19:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.293+0000 7f0dcf216740 1 -- 172.21.15.3:0/3622631980 wait complete. 2024-09-19T06:19:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.293+0000 7f0dcf216740 1 -- start start 2024-09-19T06:19:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.293+0000 7f0dcf216740 1 Processor -- start 2024-09-19T06:19:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.294+0000 7f0dcf216740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b93b3b0 0x55ad3b9496a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.294+0000 7f0dcf216740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad3b93bcd0 0x55ad3b949be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.294+0000 7f0dcf216740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad3b946570 0x55ad3b9bf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.294+0000 7f0dcf216740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc41b0e90 con 0x55ad3b93b3b0 2024-09-19T06:19:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.294+0000 7f0dcf216740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc41b07c0 con 0x55ad3b946570 2024-09-19T06:19:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.294+0000 7f0dcf216740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc41ada20 con 0x55ad3b93bcd0 2024-09-19T06:19:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.294+0000 7f0dcf216740 10 client.0 _ll_register_callbacks cb 0x7f0db0009840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.294+0000 7f0dca200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b93b3b0 0x55ad3b9496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.294+0000 7f0dca200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b93b3b0 0x55ad3b9496a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50706/0 (socket says 172.21.15.3:50706) 2024-09-19T06:19:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.294+0000 7f0dca200640 1 -- 172.21.15.3:0/756442554 learned_addr learned my addr 172.21.15.3:0/756442554 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.294+0000 7f0dc8e00640 1 --2- 172.21.15.3:0/756442554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad3b93bcd0 0x55ad3b949be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.294+0000 7f0dca200640 1 --2- 172.21.15.3:0/756442554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad3b946570 0x55ad3b9bf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.295+0000 7f0dca200640 1 -- 172.21.15.3:0/756442554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad3b93bcd0 msgr2=0x55ad3b949be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.295+0000 7f0dca200640 1 --2- 172.21.15.3:0/756442554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad3b93bcd0 0x55ad3b949be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.295+0000 7f0dca200640 1 -- 172.21.15.3:0/756442554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad3b946570 msgr2=0x55ad3b9bf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.295+0000 7f0dca200640 1 --2- 172.21.15.3:0/756442554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad3b946570 0x55ad3b9bf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.295+0000 7f0dca200640 1 -- 172.21.15.3:0/756442554 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad3b9bf610 con 0x55ad3b93b3b0 2024-09-19T06:19:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.295+0000 7f0dca200640 1 --2- 172.21.15.3:0/756442554 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b93b3b0 0x55ad3b9496a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc005c40 tx=0x7f0dbc005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04c8c4b61ee967a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.295+0000 7f0dab400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:19:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.295+0000 7f0dab400640 1 -- 172.21.15.3:0/756442554 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc004050 con 0x55ad3b93b3b0 2024-09-19T06:19:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.295+0000 7f0dab400640 1 -- 172.21.15.3:0/756442554 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f0dbc004c90 con 0x55ad3b93b3b0 2024-09-19T06:19:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.295+0000 7f0dcf216740 1 -- 172.21.15.3:0/756442554 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dbc005040 con 0x55ad3b93b3b0 2024-09-19T06:19:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.295+0000 7f0dab400640 1 -- 172.21.15.3:0/756442554 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0dbc045050 con 0x55ad3b93b3b0 2024-09-19T06:19:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.295+0000 7f0dcf216740 10 client.17148 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.296+0000 7f0dcf216740 1 -- 172.21.15.3:0/756442554 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ad3b9c0780 con 0x55ad3b93b3b0 2024-09-19T06:19:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.296+0000 7f0dab400640 1 -- 172.21.15.3:0/756442554 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dbc005040 con 0x55ad3b93b3b0 2024-09-19T06:19:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.296+0000 7f0dab400640 1 -- 172.21.15.3:0/756442554 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0dbc028450 con 0x55ad3b93b3b0 2024-09-19T06:19:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.296+0000 7f0dcf216740 10 client.17148 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.296+0000 7f0dcf216740 10 client.17148 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.296+0000 7f0dcf216740 20 client.17148 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.296+0000 7f0dcf216740 1 --2- 172.21.15.3:0/756442554 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ad3b9c0c00 0x55ad3b9c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.296+0000 7f0dcf216740 4 client.17148 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:19:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.296+0000 7f0dcf216740 1 -- 172.21.15.3:0/756442554 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ad3b8a8b80 con 0x55ad3b9c0c00 2024-09-19T06:19:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.296+0000 7f0dc8e00640 1 --2- 172.21.15.3:0/756442554 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ad3b9c0c00 0x55ad3b9c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.297+0000 7f0dc8e00640 1 --2- 172.21.15.3:0/756442554 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ad3b9c0c00 0x55ad3b9c2ff0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a1ca139d2c8bc35 server_cookie=98d95f91eabfbe88 in_seq=0 out_seq=0 2024-09-19T06:19:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.297+0000 7f0dab400640 10 client.17148 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.311+0000 7f0dab400640 1 -- 172.21.15.3:0/756442554 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ad3b8a8b80 con 0x55ad3b9c0c00 2024-09-19T06:19:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.311+0000 7f0dab400640 10 client.17148 handle_command_reply: tid=0 2024-09-19T06:19:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.311+0000 7f0dcf216740 1 client.17148 shutdown 2024-09-19T06:19:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.311+0000 7f0dcf216740 1 -- 172.21.15.3:0/756442554 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b93b3b0 msgr2=0x55ad3b9496a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.311+0000 7f0dcf216740 1 --2- 172.21.15.3:0/756442554 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b93b3b0 0x55ad3b9496a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc005c40 tx=0x7f0dbc005bd0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.311+0000 7f0dcf216740 1 -- 172.21.15.3:0/756442554 shutdown_connections 2024-09-19T06:19:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.311+0000 7f0dcf216740 1 --2- 172.21.15.3:0/756442554 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ad3b9c0c00 0x55ad3b9c2ff0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.311+0000 7f0dcf216740 1 --2- 172.21.15.3:0/756442554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ad3b946570 0x55ad3b9bf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.311+0000 7f0dcf216740 1 --2- 172.21.15.3:0/756442554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ad3b93bcd0 0x55ad3b949be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.311+0000 7f0dab400640 0 client.17148 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.311+0000 7f0dcf216740 1 --2- 172.21.15.3:0/756442554 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ad3b93b3b0 0x55ad3b9496a0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.314 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.311+0000 7f0dcf216740 1 -- 172.21.15.3:0/756442554 >> 172.21.15.3:0/756442554 conn(0x55ad3b937920 msgr2=0x55ad3b93ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:27.315 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.312+0000 7f0dcf216740 1 -- 172.21.15.3:0/756442554 shutdown_connections 2024-09-19T06:19:27.315 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.312+0000 7f0dcf216740 1 -- 172.21.15.3:0/756442554 wait complete. 2024-09-19T06:19:27.315 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.312+0000 7f0dcf216740 20 client.17148 trim_cache size 0 max 16384 2024-09-19T06:19:27.315 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:19:27.315 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:19:27.315 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:19:27.315 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:19:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.312+0000 7f0dcac00640 1 -- 172.21.15.3:0/2869357697 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0dac0a3420 msgr2=0x7f0dac0a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.312+0000 7f0dcac00640 1 --2- 172.21.15.3:0/2869357697 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0dac0a3420 0x7f0dac0a58e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55ad3b938780 tx=0x7f0db80f3da0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.312+0000 7f0dcac00640 1 -- 172.21.15.3:0/2869357697 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0dc4102ae0 msgr2=0x7f0dc419a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.312+0000 7f0dcac00640 1 --2- 172.21.15.3:0/2869357697 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0dc4102ae0 0x7f0dc419a450 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0db8004770 tx=0x7f0db8003c10 comp rx=0 tx=0).stop 2024-09-19T06:19:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.313+0000 7f0dcac00640 1 -- 172.21.15.3:0/2869357697 shutdown_connections 2024-09-19T06:19:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.313+0000 7f0dcac00640 1 --2- 172.21.15.3:0/2869357697 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0dac0a3420 0x7f0dac0a58e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.313+0000 7f0dcac00640 1 --2- 172.21.15.3:0/2869357697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dc410bf30 0x7f0dc419ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.313+0000 7f0dcac00640 1 --2- 172.21.15.3:0/2869357697 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0dc4103400 0x7f0dc419a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.313+0000 7f0dcac00640 1 --2- 172.21.15.3:0/2869357697 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0dc4102ae0 0x7f0dc419a450 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.313+0000 7f0dcac00640 1 -- 172.21.15.3:0/2869357697 >> 172.21.15.3:0/2869357697 conn(0x7f0dc40777f0 msgr2=0x7f0dc41006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.313+0000 7f0dcac00640 1 -- 172.21.15.3:0/2869357697 shutdown_connections 2024-09-19T06:19:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:27.313+0000 7f0dcac00640 1 -- 172.21.15.3:0/2869357697 wait complete. 2024-09-19T06:19:28.159 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:19:28.215 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:27 smithi003 ceph-mon[30893]: pgmap v217: 97 pgs: 97 active+clean; 3.9 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 16 op/s 2024-09-19T06:19:28.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:27 smithi059 ceph-mon[35138]: pgmap v217: 97 pgs: 97 active+clean; 3.9 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 16 op/s 2024-09-19T06:19:28.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:27 smithi071 ceph-mon[35662]: pgmap v217: 97 pgs: 97 active+clean; 3.9 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 16 op/s 2024-09-19T06:19:28.553 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:29.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.137+0000 7f7fa2400640 1 -- 172.21.15.3:0/3646781653 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f9c106f10 msgr2=0x7f7f9c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:29.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.137+0000 7f7fa2400640 1 --2- 172.21.15.3:0/3646781653 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f9c106f10 0x7f7f9c10ea90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f7f94009ca0 tx=0x7f7f9402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.137+0000 7f7fa2400640 1 -- 172.21.15.3:0/3646781653 shutdown_connections 2024-09-19T06:19:29.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.137+0000 7f7fa2400640 1 --2- 172.21.15.3:0/3646781653 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f9c106f10 0x7f7f9c10ea90 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.137+0000 7f7fa2400640 1 --2- 172.21.15.3:0/3646781653 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f9c102790 0x7f7f9c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.137+0000 7f7fa2400640 1 --2- 172.21.15.3:0/3646781653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f9c101de0 0x7f7f9c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.137+0000 7f7fa2400640 1 -- 172.21.15.3:0/3646781653 >> 172.21.15.3:0/3646781653 conn(0x7f7f9c0fd8c0 msgr2=0x7f7f9c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:29.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.137+0000 7f7fa2400640 1 -- 172.21.15.3:0/3646781653 shutdown_connections 2024-09-19T06:19:29.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.137+0000 7f7fa2400640 1 -- 172.21.15.3:0/3646781653 wait complete. 2024-09-19T06:19:29.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.138+0000 7f7fa2400640 1 Processor -- start 2024-09-19T06:19:29.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.138+0000 7f7fa2400640 1 -- start start 2024-09-19T06:19:29.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.138+0000 7f7fa2400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f9c101de0 0x7f7f9c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:29.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.138+0000 7f7fa2400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f9c102790 0x7f7f9c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:29.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.138+0000 7f7fa2400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f9c106f10 0x7f7f9c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:29.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.138+0000 7f7fa2400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c111fc0 con 0x7f7f9c106f10 2024-09-19T06:19:29.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.138+0000 7f7fa2400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c111e40 con 0x7f7f9c102790 2024-09-19T06:19:29.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.138+0000 7f7fa2400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c112140 con 0x7f7f9c101de0 2024-09-19T06:19:29.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.139+0000 7f7f9b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f9c101de0 0x7f7f9c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:29.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.139+0000 7f7f9be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f9c106f10 0x7f7f9c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:29.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.139+0000 7f7f93e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f9c102790 0x7f7f9c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:29.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.139+0000 7f7f9b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f9c101de0 0x7f7f9c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:50046/0 (socket says 172.21.15.3:50046) 2024-09-19T06:19:29.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.139+0000 7f7f9b400640 1 -- 172.21.15.3:0/1338279371 learned_addr learned my addr 172.21.15.3:0/1338279371 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:29.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.139+0000 7f7f9b400640 1 -- 172.21.15.3:0/1338279371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f9c102790 msgr2=0x7f7f9c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:29.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.139+0000 7f7f9b400640 1 --2- 172.21.15.3:0/1338279371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f9c102790 0x7f7f9c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.139+0000 7f7f9b400640 1 -- 172.21.15.3:0/1338279371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f9c106f10 msgr2=0x7f7f9c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:29.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.139+0000 7f7f9b400640 1 --2- 172.21.15.3:0/1338279371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f9c106f10 0x7f7f9c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.139+0000 7f7f9b400640 1 -- 172.21.15.3:0/1338279371 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f9c1a68b0 con 0x7f7f9c101de0 2024-09-19T06:19:29.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.140+0000 7f7f9b400640 1 --2- 172.21.15.3:0/1338279371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f9c101de0 0x7f7f9c0744f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c00e9f0 tx=0x7f7f8c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:29.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.140+0000 7f7f98c00640 1 -- 172.21.15.3:0/1338279371 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c00cd80 con 0x7f7f9c101de0 2024-09-19T06:19:29.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.140+0000 7f7fa2400640 1 -- 172.21.15.3:0/1338279371 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f9c1a6ba0 con 0x7f7f9c101de0 2024-09-19T06:19:29.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.140+0000 7f7f98c00640 1 -- 172.21.15.3:0/1338279371 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f8c010910 con 0x7f7f9c101de0 2024-09-19T06:19:29.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.140+0000 7f7f98c00640 1 -- 172.21.15.3:0/1338279371 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c0188f0 con 0x7f7f9c101de0 2024-09-19T06:19:29.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.140+0000 7f7fa2400640 1 -- 172.21.15.3:0/1338279371 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f9c1a7130 con 0x7f7f9c101de0 2024-09-19T06:19:29.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.143+0000 7f7fa4dd4740 1 Processor -- start 2024-09-19T06:19:29.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.143+0000 7f7f98c00640 1 -- 172.21.15.3:0/1338279371 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f7f8c010ac0 con 0x7f7f9c101de0 2024-09-19T06:19:29.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.143+0000 7f7fa4dd4740 1 -- start start 2024-09-19T06:19:29.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.144+0000 7f7fa4dd4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6c8b90 0x5650de6c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:29.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.144+0000 7f7fa4dd4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5650de6c94b0 0x5650de6d3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:29.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.144+0000 7f7fa4dd4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650de6d3d70 0x5650de6d6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:29.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.144+0000 7f7fa4dd4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5650de62f3e0 con 0x5650de6c94b0 2024-09-19T06:19:29.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.144+0000 7f7fa4dd4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5650de5d6d80 con 0x5650de6c8b90 2024-09-19T06:19:29.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.144+0000 7f7fa4dd4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5650de62b3a0 con 0x5650de6d3d70 2024-09-19T06:19:29.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.144+0000 7f7f9be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6c8b90 0x5650de6c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:29.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.144+0000 7f7f9be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6c8b90 0x5650de6c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55014/0 (socket says 172.21.15.3:55014) 2024-09-19T06:19:29.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.144+0000 7f7f9be00640 1 -- 172.21.15.3:0/1877232368 learned_addr learned my addr 172.21.15.3:0/1877232368 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:29.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.144+0000 7f7f9b400640 1 --2- 172.21.15.3:0/1877232368 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5650de6c94b0 0x5650de6d3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:29.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.144+0000 7f7f93e00640 1 --2- 172.21.15.3:0/1877232368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650de6d3d70 0x5650de6d6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:29.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.145+0000 7f7f93e00640 1 -- 172.21.15.3:0/1877232368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6c8b90 msgr2=0x5650de6c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:29.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.145+0000 7f7f93e00640 1 --2- 172.21.15.3:0/1877232368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6c8b90 0x5650de6c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.145+0000 7f7f93e00640 1 -- 172.21.15.3:0/1877232368 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5650de6c94b0 msgr2=0x5650de6d3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:29.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.145+0000 7f7f93e00640 1 --2- 172.21.15.3:0/1877232368 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5650de6c94b0 0x5650de6d3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.145+0000 7f7f93e00640 1 -- 172.21.15.3:0/1877232368 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650de5f5ae0 con 0x5650de6d3d70 2024-09-19T06:19:29.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.145+0000 7f7f9be00640 1 --2- 172.21.15.3:0/1877232368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6c8b90 0x5650de6c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:29.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.145+0000 7f7f98c00640 1 --2- 172.21.15.3:0/1338279371 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7f800a33b0 0x7f7f800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:29.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.145+0000 7f7f93e00640 1 --2- 172.21.15.3:0/1877232368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650de6d3d70 0x5650de6d6160 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7f8400bb40 tx=0x7f7f840103d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23d643f000b41b6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:29.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.145+0000 7f7f98c00640 1 -- 172.21.15.3:0/1338279371 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f7f8c0d0160 con 0x7f7f9c101de0 2024-09-19T06:19:29.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.145+0000 7f7f90c00640 1 -- 172.21.15.3:0/1877232368 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84004030 con 0x5650de6d3d70 2024-09-19T06:19:29.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.145+0000 7f7f90c00640 1 -- 172.21.15.3:0/1877232368 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f840041d0 con 0x5650de6d3d70 2024-09-19T06:19:29.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.145+0000 7f7f90c00640 1 -- 172.21.15.3:0/1877232368 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f840116a0 con 0x5650de6d3d70 2024-09-19T06:19:29.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.145+0000 7f7f9be00640 1 --2- 172.21.15.3:0/1338279371 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7f800a33b0 0x7f7f800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:29.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.146+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/1877232368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650de6d3d70 msgr2=0x5650de6d6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:29.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.146+0000 7f7fa4dd4740 1 --2- 172.21.15.3:0/1877232368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650de6d3d70 0x5650de6d6160 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7f8400bb40 tx=0x7f7f840103d0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.146+0000 7f7f9be00640 1 --2- 172.21.15.3:0/1338279371 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7f800a33b0 0x7f7f800a5870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7f9402aeb0 tx=0x7f7f94005d80 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:29.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.146+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/1877232368 shutdown_connections 2024-09-19T06:19:29.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.146+0000 7f7fa4dd4740 1 --2- 172.21.15.3:0/1877232368 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650de6d3d70 0x5650de6d6160 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.146+0000 7f7fa4dd4740 1 --2- 172.21.15.3:0/1877232368 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5650de6c94b0 0x5650de6d3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.146+0000 7f7fa4dd4740 1 --2- 172.21.15.3:0/1877232368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6c8b90 0x5650de6c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.146+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/1877232368 >> 172.21.15.3:0/1877232368 conn(0x5650de6c5120 msgr2=0x5650de6c5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:29.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.146+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/1877232368 shutdown_connections 2024-09-19T06:19:29.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.147+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/1877232368 wait complete. 2024-09-19T06:19:29.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.147+0000 7f7fa4dd4740 1 -- start start 2024-09-19T06:19:29.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.147+0000 7f7fa4dd4740 1 Processor -- start 2024-09-19T06:19:29.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.148+0000 7f7fa4dd4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6c8b90 0x5650de6d0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:29.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.148+0000 7f7fa4dd4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650de6c94b0 0x5650de6d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:29.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.148+0000 7f7fa4dd4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5650de6d3d70 0x5650de6d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:29.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.148+0000 7f7fa4dd4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5650de6d69e0 con 0x5650de6d3d70 2024-09-19T06:19:29.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.148+0000 7f7fa4dd4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5650de5ea0f0 con 0x5650de6c8b90 2024-09-19T06:19:29.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.148+0000 7f7fa4dd4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5650de6d6b60 con 0x5650de6c94b0 2024-09-19T06:19:29.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.148+0000 7f7fa4dd4740 10 client.0 _ll_register_callbacks cb 0x5650de5db9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:29.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.148+0000 7f7f9b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6c8b90 0x5650de6d0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:29.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.148+0000 7f7f9be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5650de6d3d70 0x5650de6d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:29.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.148+0000 7f7f9b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6c8b90 0x5650de6d0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55028/0 (socket says 172.21.15.3:55028) 2024-09-19T06:19:29.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.148+0000 7f7f9b400640 1 -- 172.21.15.3:0/2182333947 learned_addr learned my addr 172.21.15.3:0/2182333947 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:29.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.148+0000 7f7f93e00640 1 --2- 172.21.15.3:0/2182333947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650de6c94b0 0x5650de6d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:29.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.148+0000 7f7f9b400640 1 -- 172.21.15.3:0/2182333947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650de6c94b0 msgr2=0x5650de6d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:29.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.148+0000 7f7f9b400640 1 --2- 172.21.15.3:0/2182333947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650de6c94b0 0x5650de6d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.148+0000 7f7f9b400640 1 -- 172.21.15.3:0/2182333947 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5650de6d3d70 msgr2=0x5650de6d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:29.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.148+0000 7f7f9b400640 1 --2- 172.21.15.3:0/2182333947 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5650de6d3d70 0x5650de6d16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.148+0000 7f7f9b400640 1 -- 172.21.15.3:0/2182333947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650de3a03c0 con 0x5650de6c8b90 2024-09-19T06:19:29.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.149+0000 7f7f9b400640 1 --2- 172.21.15.3:0/2182333947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6c8b90 0x5650de6d0c40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c09c160 tx=0x7f7f8c0987d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=323385b560513dc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:29.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.149+0000 7f7f89600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:19:29.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.149+0000 7f7f89600640 1 -- 172.21.15.3:0/2182333947 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c0cdca0 con 0x5650de6c8b90 2024-09-19T06:19:29.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.149+0000 7f7f89600640 1 -- 172.21.15.3:0/2182333947 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f7f8c0d2110 con 0x5650de6c8b90 2024-09-19T06:19:29.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.149+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/2182333947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f840041d0 con 0x5650de6c8b90 2024-09-19T06:19:29.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.149+0000 7f7f89600640 1 -- 172.21.15.3:0/2182333947 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7f8c09c460 con 0x5650de6c8b90 2024-09-19T06:19:29.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.149+0000 7f7fa4dd4740 10 client.27200 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:29.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.149+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/2182333947 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5650de6e26c0 con 0x5650de6c8b90 2024-09-19T06:19:29.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.149+0000 7f7f89600640 1 -- 172.21.15.3:0/2182333947 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f840041d0 con 0x5650de6c8b90 2024-09-19T06:19:29.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.150+0000 7f7f89600640 1 -- 172.21.15.3:0/2182333947 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f7f8c09b8b0 con 0x5650de6c8b90 2024-09-19T06:19:29.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.150+0000 7f7fa4dd4740 10 client.27200 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:29.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.150+0000 7f7fa4dd4740 10 client.27200 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:29.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.150+0000 7f7fa4dd4740 20 client.27200 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:29.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.150+0000 7f7fa4dd4740 1 --2- 172.21.15.3:0/2182333947 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5650de6e3b80 0x5650de6e5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:29.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.150+0000 7f7fa4dd4740 4 client.27200 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:29.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.150+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/2182333947 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650de63c950 con 0x5650de6e3b80 2024-09-19T06:19:29.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.150+0000 7f7f93e00640 1 --2- 172.21.15.3:0/2182333947 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5650de6e3b80 0x5650de6e5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:29.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.151+0000 7f7f93e00640 1 --2- 172.21.15.3:0/2182333947 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5650de6e3b80 0x5650de6e5f90 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6be3f7e257c045e3 server_cookie=c52d67eebb52712f in_seq=0 out_seq=0 2024-09-19T06:19:29.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.151+0000 7f7f89600640 10 client.27200 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:29.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.151+0000 7f7f89600640 1 -- 172.21.15.3:0/2182333947 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5650de63c950 con 0x5650de6e3b80 2024-09-19T06:19:29.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.151+0000 7f7f89600640 10 client.27200 handle_command_reply: tid=0 2024-09-19T06:19:29.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.151+0000 7f7fa4dd4740 1 client.27200 shutdown 2024-09-19T06:19:29.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.152+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/2182333947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6c8b90 msgr2=0x5650de6d0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:29.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.152+0000 7f7fa4dd4740 1 --2- 172.21.15.3:0/2182333947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6c8b90 0x5650de6d0c40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c09c160 tx=0x7f7f8c0987d0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.152+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/2182333947 shutdown_connections 2024-09-19T06:19:29.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.152+0000 7f7fa4dd4740 1 --2- 172.21.15.3:0/2182333947 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5650de6e3b80 0x5650de6e5f90 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.152+0000 7f7fa4dd4740 1 --2- 172.21.15.3:0/2182333947 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5650de6d3d70 0x5650de6d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.152+0000 7f7fa4dd4740 1 --2- 172.21.15.3:0/2182333947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650de6c94b0 0x5650de6d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.152+0000 7f7fa4dd4740 1 --2- 172.21.15.3:0/2182333947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6c8b90 0x5650de6d0c40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.152+0000 7f7f89600640 0 client.27200 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:29.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.152+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/2182333947 >> 172.21.15.3:0/2182333947 conn(0x5650de6c5120 msgr2=0x5650de6cae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:29.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.152+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/2182333947 shutdown_connections 2024-09-19T06:19:29.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.152+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/2182333947 wait complete. 2024-09-19T06:19:29.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.152+0000 7f7fa4dd4740 20 client.27200 trim_cache size 0 max 16384 2024-09-19T06:19:29.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.170+0000 7f7fa4dd4740 1 Processor -- start 2024-09-19T06:19:29.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.170+0000 7f7fa4dd4740 1 -- start start 2024-09-19T06:19:29.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.170+0000 7f7fa4dd4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5650de6c8b90 0x5650de6cad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:29.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.170+0000 7f7fa4dd4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650de6c94b0 0x5650de6eb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:29.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.171+0000 7f7fa4dd4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6d3d70 0x5650de6ebd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:29.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.171+0000 7f7fa4dd4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c1afb80 con 0x5650de6c8b90 2024-09-19T06:19:29.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.171+0000 7f7fa4dd4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c1b16c0 con 0x5650de6d3d70 2024-09-19T06:19:29.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.171+0000 7f7fa4dd4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c1b0250 con 0x5650de6c94b0 2024-09-19T06:19:29.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.171+0000 7f7f9b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5650de6c8b90 0x5650de6cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:29.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.171+0000 7f7f9b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5650de6c8b90 0x5650de6cad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50754/0 (socket says 172.21.15.3:50754) 2024-09-19T06:19:29.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.171+0000 7f7f9b400640 1 -- 172.21.15.3:0/1559745185 learned_addr learned my addr 172.21.15.3:0/1559745185 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:29.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.171+0000 7f7f93e00640 1 --2- 172.21.15.3:0/1559745185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650de6c94b0 0x5650de6eb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:29.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.171+0000 7f7f9be00640 1 --2- 172.21.15.3:0/1559745185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6d3d70 0x5650de6ebd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:29.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.171+0000 7f7f93e00640 1 -- 172.21.15.3:0/1559745185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6d3d70 msgr2=0x5650de6ebd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:29.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.171+0000 7f7f93e00640 1 --2- 172.21.15.3:0/1559745185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6d3d70 0x5650de6ebd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.171+0000 7f7f93e00640 1 -- 172.21.15.3:0/1559745185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5650de6c8b90 msgr2=0x5650de6cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:29.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.171+0000 7f7f93e00640 1 --2- 172.21.15.3:0/1559745185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5650de6c8b90 0x5650de6cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.171+0000 7f7f93e00640 1 -- 172.21.15.3:0/1559745185 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650de6c4f50 con 0x5650de6c94b0 2024-09-19T06:19:29.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.171+0000 7f7f9b400640 1 --2- 172.21.15.3:0/1559745185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5650de6c8b90 0x5650de6cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:29.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.172+0000 7f7f93e00640 1 --2- 172.21.15.3:0/1559745185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650de6c94b0 0x5650de6eb830 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7f84003d90 tx=0x7f7f84003df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e305239f40bd362 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:29.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.172+0000 7f7f8be00640 1 -- 172.21.15.3:0/1559745185 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84010cc0 con 0x5650de6c94b0 2024-09-19T06:19:29.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.172+0000 7f7f8be00640 1 -- 172.21.15.3:0/1559745185 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f84010e60 con 0x5650de6c94b0 2024-09-19T06:19:29.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.172+0000 7f7f8be00640 1 -- 172.21.15.3:0/1559745185 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f840055b0 con 0x5650de6c94b0 2024-09-19T06:19:29.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.172+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/1559745185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650de6c94b0 msgr2=0x5650de6eb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:29.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.172+0000 7f7fa4dd4740 1 --2- 172.21.15.3:0/1559745185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650de6c94b0 0x5650de6eb830 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7f84003d90 tx=0x7f7f84003df0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.173+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/1559745185 shutdown_connections 2024-09-19T06:19:29.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.173+0000 7f7fa4dd4740 1 --2- 172.21.15.3:0/1559745185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6d3d70 0x5650de6ebd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.173+0000 7f7fa4dd4740 1 --2- 172.21.15.3:0/1559745185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650de6c94b0 0x5650de6eb830 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.173+0000 7f7fa4dd4740 1 --2- 172.21.15.3:0/1559745185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5650de6c8b90 0x5650de6cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.173+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/1559745185 >> 172.21.15.3:0/1559745185 conn(0x5650de6c5120 msgr2=0x5650de6ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:29.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.173+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/1559745185 shutdown_connections 2024-09-19T06:19:29.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.173+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/1559745185 wait complete. 2024-09-19T06:19:29.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.173+0000 7f7fa4dd4740 1 -- start start 2024-09-19T06:19:29.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.173+0000 7f7fa4dd4740 1 Processor -- start 2024-09-19T06:19:29.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.174+0000 7f7fa4dd4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5650de6c8b90 0x5650de6dc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:29.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.174+0000 7f7fa4dd4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6c94b0 0x5650de6d7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:29.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.174+0000 7f7fa4dd4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650de6d3d70 0x5650de6d7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:29.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.174+0000 7f7fa4dd4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c1b0ff0 con 0x5650de6c8b90 2024-09-19T06:19:29.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.174+0000 7f7fa4dd4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c1b0920 con 0x5650de6c94b0 2024-09-19T06:19:29.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.174+0000 7f7fa4dd4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c1adb80 con 0x5650de6d3d70 2024-09-19T06:19:29.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.174+0000 7f7fa4dd4740 10 client.0 _ll_register_callbacks cb 0x7f7f8c009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:29.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.174+0000 7f7f9b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5650de6c8b90 0x5650de6dc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:29.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.174+0000 7f7f9b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5650de6c8b90 0x5650de6dc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50768/0 (socket says 172.21.15.3:50768) 2024-09-19T06:19:29.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.174+0000 7f7f9b400640 1 -- 172.21.15.3:0/1040407875 learned_addr learned my addr 172.21.15.3:0/1040407875 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:29.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.174+0000 7f7f93e00640 1 --2- 172.21.15.3:0/1040407875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6c94b0 0x5650de6d7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:29.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.174+0000 7f7f9be00640 1 --2- 172.21.15.3:0/1040407875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650de6d3d70 0x5650de6d7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:29.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.174+0000 7f7f9b400640 1 -- 172.21.15.3:0/1040407875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650de6d3d70 msgr2=0x5650de6d7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:29.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.174+0000 7f7f9b400640 1 --2- 172.21.15.3:0/1040407875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650de6d3d70 0x5650de6d7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.174+0000 7f7f9b400640 1 -- 172.21.15.3:0/1040407875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6c94b0 msgr2=0x5650de6d7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:29.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.174+0000 7f7f9b400640 1 --2- 172.21.15.3:0/1040407875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6c94b0 0x5650de6d7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.174+0000 7f7f9b400640 1 -- 172.21.15.3:0/1040407875 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650de6d8590 con 0x5650de6c8b90 2024-09-19T06:19:29.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.174+0000 7f7f9be00640 1 --2- 172.21.15.3:0/1040407875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650de6d3d70 0x5650de6d7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:29.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.174+0000 7f7f93e00640 1 --2- 172.21.15.3:0/1040407875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6c94b0 0x5650de6d7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:29.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.175+0000 7f7f9b400640 1 --2- 172.21.15.3:0/1040407875 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5650de6c8b90 0x5650de6dc4d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c0988c0 tx=0x7f7f8c0cdcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656b563cbe299343 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:29.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.175+0000 7f7f89600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:19:29.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.175+0000 7f7f89600640 1 -- 172.21.15.3:0/1040407875 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c010630 con 0x5650de6c8b90 2024-09-19T06:19:29.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.175+0000 7f7f89600640 1 -- 172.21.15.3:0/1040407875 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f7f8c0981b0 con 0x5650de6c8b90 2024-09-19T06:19:29.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.175+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/1040407875 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f84010e60 con 0x5650de6c8b90 2024-09-19T06:19:29.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.175+0000 7f7f89600640 1 -- 172.21.15.3:0/1040407875 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7f8c0b53a0 con 0x5650de6c8b90 2024-09-19T06:19:29.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.175+0000 7f7fa4dd4740 10 client.17166 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:29.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.175+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/1040407875 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5650de74e7e0 con 0x5650de6c8b90 2024-09-19T06:19:29.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.175+0000 7f7f89600640 1 -- 172.21.15.3:0/1040407875 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f84010e60 con 0x5650de6c8b90 2024-09-19T06:19:29.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.176+0000 7f7f89600640 1 -- 172.21.15.3:0/1040407875 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f7f8c0a18f0 con 0x5650de6c8b90 2024-09-19T06:19:29.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.176+0000 7f7fa4dd4740 10 client.17166 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:29.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.176+0000 7f7fa4dd4740 10 client.17166 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:29.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.176+0000 7f7fa4dd4740 20 client.17166 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:29.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.176+0000 7f7fa4dd4740 1 --2- 172.21.15.3:0/1040407875 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5650de74eea0 0x5650de7512c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:29.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.176+0000 7f7fa4dd4740 4 client.17166 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:19:29.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.176+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/1040407875 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5650de636e60 con 0x5650de74eea0 2024-09-19T06:19:29.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.176+0000 7f7f93e00640 1 --2- 172.21.15.3:0/1040407875 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5650de74eea0 0x5650de7512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:29.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.177+0000 7f7f93e00640 1 --2- 172.21.15.3:0/1040407875 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5650de74eea0 0x5650de7512c0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cd6111b60a263ae server_cookie=99623688984e05d5 in_seq=0 out_seq=0 2024-09-19T06:19:29.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.177+0000 7f7f89600640 10 client.17166 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:29.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.177+0000 7f7f89600640 1 -- 172.21.15.3:0/1040407875 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5650de636e60 con 0x5650de74eea0 2024-09-19T06:19:29.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.177+0000 7f7f89600640 10 client.17166 handle_command_reply: tid=0 2024-09-19T06:19:29.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.177+0000 7f7fa4dd4740 1 client.17166 shutdown 2024-09-19T06:19:29.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.177+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/1040407875 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5650de6c8b90 msgr2=0x5650de6dc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:29.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.177+0000 7f7fa4dd4740 1 --2- 172.21.15.3:0/1040407875 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5650de6c8b90 0x5650de6dc4d0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c0988c0 tx=0x7f7f8c0cdcd0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.177+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/1040407875 shutdown_connections 2024-09-19T06:19:29.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.177+0000 7f7fa4dd4740 1 --2- 172.21.15.3:0/1040407875 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5650de74eea0 0x5650de7512c0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.177+0000 7f7fa4dd4740 1 --2- 172.21.15.3:0/1040407875 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5650de6d3d70 0x5650de6d7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.177+0000 7f7fa4dd4740 1 --2- 172.21.15.3:0/1040407875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5650de6c94b0 0x5650de6d7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.177+0000 7f7fa4dd4740 1 --2- 172.21.15.3:0/1040407875 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5650de6c8b90 0x5650de6dc4d0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.177+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/1040407875 >> 172.21.15.3:0/1040407875 conn(0x5650de6c5120 msgr2=0x5650de6cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:29.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.177+0000 7f7f89600640 0 client.17166 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:29.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.177+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/1040407875 shutdown_connections 2024-09-19T06:19:29.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.177+0000 7f7fa4dd4740 1 -- 172.21.15.3:0/1040407875 wait complete. 2024-09-19T06:19:29.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.178+0000 7f7fa4dd4740 20 client.17166 trim_cache size 0 max 16384 2024-09-19T06:19:29.185 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:19:29.185 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "no active scrubs running", 2024-09-19T06:19:29.185 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": {} 2024-09-19T06:19:29.186 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:19:29.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.178+0000 7f7fa2400640 1 -- 172.21.15.3:0/1338279371 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7f800a33b0 msgr2=0x7f7f800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:29.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.178+0000 7f7fa2400640 1 --2- 172.21.15.3:0/1338279371 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7f800a33b0 0x7f7f800a5870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7f9402aeb0 tx=0x7f7f94005d80 comp rx=0 tx=0).stop 2024-09-19T06:19:29.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.178+0000 7f7fa2400640 1 -- 172.21.15.3:0/1338279371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f9c101de0 msgr2=0x7f7f9c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:29.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.178+0000 7f7fa2400640 1 --2- 172.21.15.3:0/1338279371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f9c101de0 0x7f7f9c0744f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c00e9f0 tx=0x7f7f8c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.178+0000 7f7fa2400640 1 -- 172.21.15.3:0/1338279371 shutdown_connections 2024-09-19T06:19:29.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.178+0000 7f7fa2400640 1 --2- 172.21.15.3:0/1338279371 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7f800a33b0 0x7f7f800a5870 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.178+0000 7f7fa2400640 1 --2- 172.21.15.3:0/1338279371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7f9c106f10 0x7f7f9c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.178+0000 7f7fa2400640 1 --2- 172.21.15.3:0/1338279371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f9c102790 0x7f7f9c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.178+0000 7f7fa2400640 1 --2- 172.21.15.3:0/1338279371 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7f9c101de0 0x7f7f9c0744f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:29.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.178+0000 7f7fa2400640 1 -- 172.21.15.3:0/1338279371 >> 172.21.15.3:0/1338279371 conn(0x7f7f9c0fd8c0 msgr2=0x7f7f9c0fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:29.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.178+0000 7f7fa2400640 1 -- 172.21.15.3:0/1338279371 shutdown_connections 2024-09-19T06:19:29.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:29.179+0000 7f7fa2400640 1 -- 172.21.15.3:0/1338279371 wait complete. 2024-09-19T06:19:30.090 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:29 smithi003 ceph-mon[30893]: pgmap v218: 97 pgs: 97 active+clean; 4.1 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 68 KiB/s wr, 25 op/s 2024-09-19T06:19:30.133 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:19:30.134 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:19:30.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:29 smithi059 ceph-mon[35138]: pgmap v218: 97 pgs: 97 active+clean; 4.1 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 68 KiB/s wr, 25 op/s 2024-09-19T06:19:30.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:29 smithi071 ceph-mon[35662]: pgmap v218: 97 pgs: 97 active+clean; 4.1 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 68 KiB/s wr, 25 op/s 2024-09-19T06:19:30.523 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:31.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.141+0000 7f5696400640 1 -- 172.21.15.3:0/2735509657 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f569010e280 msgr2=0x7f5690110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:31.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.141+0000 7f5696400640 1 --2- 172.21.15.3:0/2735509657 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f569010e280 0x7f5690110670 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5688009ca0 tx=0x7f568802a950 comp rx=0 tx=0).stop 2024-09-19T06:19:31.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.141+0000 7f5696400640 1 -- 172.21.15.3:0/2735509657 shutdown_connections 2024-09-19T06:19:31.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.141+0000 7f5696400640 1 --2- 172.21.15.3:0/2735509657 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f569010e280 0x7f5690110670 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:31.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.141+0000 7f5696400640 1 --2- 172.21.15.3:0/2735509657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5690074e30 0x7f569010dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:31.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.141+0000 7f5696400640 1 --2- 172.21.15.3:0/2735509657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5690074510 0x7f56900748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:31.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.141+0000 7f5696400640 1 -- 172.21.15.3:0/2735509657 >> 172.21.15.3:0/2735509657 conn(0x7f56900fd740 msgr2=0x7f56900ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:31.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.141+0000 7f5696400640 1 -- 172.21.15.3:0/2735509657 shutdown_connections 2024-09-19T06:19:31.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.141+0000 7f5696400640 1 -- 172.21.15.3:0/2735509657 wait complete. 2024-09-19T06:19:31.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.142+0000 7f5696400640 1 Processor -- start 2024-09-19T06:19:31.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.142+0000 7f5696400640 1 -- start start 2024-09-19T06:19:31.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.142+0000 7f5696400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5690074510 0x7f569019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:31.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.142+0000 7f5696400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5690074e30 0x7f569019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:31.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.142+0000 7f5696400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f569010e280 0x7f569019ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:31.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.142+0000 7f5696400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5690114000 con 0x7f569010e280 2024-09-19T06:19:31.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.142+0000 7f5696400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5690113e80 con 0x7f5690074510 2024-09-19T06:19:31.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.142+0000 7f5696400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5690114180 con 0x7f5690074e30 2024-09-19T06:19:31.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.143+0000 7f5695a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f569010e280 0x7f569019ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:31.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.143+0000 7f5695000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5690074510 0x7f569019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:31.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.143+0000 7f5687e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5690074e30 0x7f569019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:31.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.143+0000 7f5695000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5690074510 0x7f569019a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55062/0 (socket says 172.21.15.3:55062) 2024-09-19T06:19:31.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.143+0000 7f5695000640 1 -- 172.21.15.3:0/29551491 learned_addr learned my addr 172.21.15.3:0/29551491 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:31.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.143+0000 7f5695a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f569010e280 0x7f569019ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50778/0 (socket says 172.21.15.3:50778) 2024-09-19T06:19:31.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.143+0000 7f5695000640 1 -- 172.21.15.3:0/29551491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5690074e30 msgr2=0x7f569019a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:31.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.143+0000 7f5695000640 1 --2- 172.21.15.3:0/29551491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5690074e30 0x7f569019a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:31.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.143+0000 7f5695000640 1 -- 172.21.15.3:0/29551491 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f569010e280 msgr2=0x7f569019ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:31.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.143+0000 7f5695000640 1 --2- 172.21.15.3:0/29551491 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f569010e280 0x7f569019ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:31.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.143+0000 7f5695000640 1 -- 172.21.15.3:0/29551491 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f569019f420 con 0x7f5690074510 2024-09-19T06:19:31.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.143+0000 7f5695a00640 1 --2- 172.21.15.3:0/29551491 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f569010e280 0x7f569019ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:31.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.143+0000 7f5695000640 1 --2- 172.21.15.3:0/29551491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5690074510 0x7f569019a470 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f568000e9f0 tx=0x7f568000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:31.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.144+0000 7f568e000640 1 -- 172.21.15.3:0/29551491 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568000cd80 con 0x7f5690074510 2024-09-19T06:19:31.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.144+0000 7f5696400640 1 -- 172.21.15.3:0/29551491 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f569019f710 con 0x7f5690074510 2024-09-19T06:19:31.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.144+0000 7f568e000640 1 -- 172.21.15.3:0/29551491 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5680005500 con 0x7f5690074510 2024-09-19T06:19:31.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.144+0000 7f568e000640 1 -- 172.21.15.3:0/29551491 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5680010690 con 0x7f5690074510 2024-09-19T06:19:31.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.144+0000 7f5696400640 1 -- 172.21.15.3:0/29551491 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56901a6ff0 con 0x7f5690074510 2024-09-19T06:19:31.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.145+0000 7f5696400640 1 -- 172.21.15.3:0/29551491 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56900748f0 con 0x7f5690074510 2024-09-19T06:19:31.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.147+0000 7f568e000640 1 -- 172.21.15.3:0/29551491 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f56800046c0 con 0x7f5690074510 2024-09-19T06:19:31.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.148+0000 7f568e000640 1 --2- 172.21.15.3:0/29551491 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f56740a3430 0x7f56740a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:31.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.148+0000 7f568e000640 1 -- 172.21.15.3:0/29551491 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f56800d02f0 con 0x7f5690074510 2024-09-19T06:19:31.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.149+0000 7f5687e00640 1 --2- 172.21.15.3:0/29551491 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f56740a3430 0x7f56740a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:31.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.149+0000 7f5687e00640 1 --2- 172.21.15.3:0/29551491 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f56740a3430 0x7f56740a58f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f569010f5a0 tx=0x7f5678005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:31.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.151+0000 7f568e000640 1 -- 172.21.15.3:0/29551491 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5680054210 con 0x7f5690074510 2024-09-19T06:19:31.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.373+0000 7f5696400640 1 -- 172.21.15.3:0/29551491 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f569019b7d0 con 0x7f5690074510 2024-09-19T06:19:31.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.375+0000 7f568e000640 1 -- 172.21.15.3:0/29551491 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7f568009cc40 con 0x7f5690074510 2024-09-19T06:19:31.376 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:19:31.376 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"btime":"2024-09-19T06:12:22:958217+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:12:22.060987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24532,24515,24514,14517]},"id":1}]} 2024-09-19T06:19:31.376 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2024-09-19T06:19:31.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.376+0000 7f5696400640 1 -- 172.21.15.3:0/29551491 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f56740a3430 msgr2=0x7f56740a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:31.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.376+0000 7f5696400640 1 --2- 172.21.15.3:0/29551491 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f56740a3430 0x7f56740a58f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f569010f5a0 tx=0x7f5678005f90 comp rx=0 tx=0).stop 2024-09-19T06:19:31.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.376+0000 7f5696400640 1 -- 172.21.15.3:0/29551491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5690074510 msgr2=0x7f569019a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:31.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.376+0000 7f5696400640 1 --2- 172.21.15.3:0/29551491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5690074510 0x7f569019a470 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f568000e9f0 tx=0x7f568000edf0 comp rx=0 tx=0).stop 2024-09-19T06:19:31.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.376+0000 7f5696400640 1 -- 172.21.15.3:0/29551491 shutdown_connections 2024-09-19T06:19:31.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.376+0000 7f5696400640 1 --2- 172.21.15.3:0/29551491 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f56740a3430 0x7f56740a58f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:31.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.377+0000 7f5696400640 1 --2- 172.21.15.3:0/29551491 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f569010e280 0x7f569019ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:31.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.377+0000 7f5696400640 1 --2- 172.21.15.3:0/29551491 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5690074e30 0x7f569019a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:31.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.377+0000 7f5696400640 1 --2- 172.21.15.3:0/29551491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5690074510 0x7f569019a470 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:31.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.377+0000 7f5696400640 1 -- 172.21.15.3:0/29551491 >> 172.21.15.3:0/29551491 conn(0x7f56900fd740 msgr2=0x7f56900fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:31.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.377+0000 7f5696400640 1 -- 172.21.15.3:0/29551491 shutdown_connections 2024-09-19T06:19:31.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:31.377+0000 7f5696400640 1 -- 172.21.15.3:0/29551491 wait complete. 2024-09-19T06:19:32.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:31 smithi003 ceph-mon[30893]: pgmap v219: 97 pgs: 97 active+clean; 4.1 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:19:32.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:31 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/29551491' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:19:32.171 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:19:32.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:31 smithi059 ceph-mon[35138]: pgmap v219: 97 pgs: 97 active+clean; 4.1 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:19:32.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:31 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/29551491' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:19:32.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:31 smithi071 ceph-mon[35662]: pgmap v219: 97 pgs: 97 active+clean; 4.1 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:19:32.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:31 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/29551491' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:19:32.551 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:33.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.108+0000 7f5afd400640 1 -- 172.21.15.3:0/3856206448 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5af8109140 msgr2=0x7f5af8110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:33.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.108+0000 7f5afd400640 1 --2- 172.21.15.3:0/3856206448 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5af8109140 0x7f5af8110cc0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5af0009ca0 tx=0x7f5af002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.108+0000 7f5afd400640 1 -- 172.21.15.3:0/3856206448 shutdown_connections 2024-09-19T06:19:33.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.108+0000 7f5afd400640 1 --2- 172.21.15.3:0/3856206448 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5af8109140 0x7f5af8110cc0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.108+0000 7f5afd400640 1 --2- 172.21.15.3:0/3856206448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5af81049c0 0x7f5af8108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.108+0000 7f5afd400640 1 --2- 172.21.15.3:0/3856206448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5af8104010 0x7f5af81043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.108+0000 7f5afd400640 1 -- 172.21.15.3:0/3856206448 >> 172.21.15.3:0/3856206448 conn(0x7f5af80ffa50 msgr2=0x7f5af8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:33.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.109+0000 7f5afd400640 1 -- 172.21.15.3:0/3856206448 shutdown_connections 2024-09-19T06:19:33.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.109+0000 7f5afd400640 1 -- 172.21.15.3:0/3856206448 wait complete. 2024-09-19T06:19:33.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.109+0000 7f5afd400640 1 Processor -- start 2024-09-19T06:19:33.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.110+0000 7f5afd400640 1 -- start start 2024-09-19T06:19:33.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.110+0000 7f5afd400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5af8104010 0x7f5af8076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:33.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.110+0000 7f5afd400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5af81049c0 0x7f5af8076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:33.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.110+0000 7f5afd400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5af8109140 0x7f5af8077180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:33.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.110+0000 7f5afd400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5af81141c0 con 0x7f5af8104010 2024-09-19T06:19:33.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.110+0000 7f5afd400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5af8114040 con 0x7f5af8109140 2024-09-19T06:19:33.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.110+0000 7f5afd400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5af8114340 con 0x7f5af81049c0 2024-09-19T06:19:33.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.110+0000 7f5af6800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5af8104010 0x7f5af8076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:33.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.110+0000 7f5af6800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5af8104010 0x7f5af8076700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50798/0 (socket says 172.21.15.3:50798) 2024-09-19T06:19:33.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.110+0000 7f5af6800640 1 -- 172.21.15.3:0/601179678 learned_addr learned my addr 172.21.15.3:0/601179678 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:33.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.110+0000 7f5aefe00640 1 --2- 172.21.15.3:0/601179678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5af81049c0 0x7f5af8076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:33.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.110+0000 7f5af7200640 1 --2- 172.21.15.3:0/601179678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5af8109140 0x7f5af8077180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:33.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.111+0000 7f5af6800640 1 -- 172.21.15.3:0/601179678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5af81049c0 msgr2=0x7f5af8076c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:33.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.111+0000 7f5af6800640 1 --2- 172.21.15.3:0/601179678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5af81049c0 0x7f5af8076c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.111+0000 7f5af6800640 1 -- 172.21.15.3:0/601179678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5af8109140 msgr2=0x7f5af8077180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:33.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.111+0000 7f5af6800640 1 --2- 172.21.15.3:0/601179678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5af8109140 0x7f5af8077180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.111+0000 7f5af6800640 1 -- 172.21.15.3:0/601179678 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af81aad60 con 0x7f5af8104010 2024-09-19T06:19:33.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.111+0000 7f5aefe00640 1 --2- 172.21.15.3:0/601179678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5af81049c0 0x7f5af8076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:33.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.111+0000 7f5af6800640 1 --2- 172.21.15.3:0/601179678 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5af8104010 0x7f5af8076700 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5ae800ea20 tx=0x7f5ae800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:33.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.111+0000 7f5aef400640 1 -- 172.21.15.3:0/601179678 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae800cd80 con 0x7f5af8104010 2024-09-19T06:19:33.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.111+0000 7f5aef400640 1 -- 172.21.15.3:0/601179678 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ae8010910 con 0x7f5af8104010 2024-09-19T06:19:33.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.111+0000 7f5afd400640 1 -- 172.21.15.3:0/601179678 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af81aaff0 con 0x7f5af8104010 2024-09-19T06:19:33.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.111+0000 7f5aef400640 1 -- 172.21.15.3:0/601179678 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8018920 con 0x7f5af8104010 2024-09-19T06:19:33.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.111+0000 7f5afd400640 1 -- 172.21.15.3:0/601179678 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af81ab500 con 0x7f5af8104010 2024-09-19T06:19:33.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.114+0000 7f5aef400640 1 -- 172.21.15.3:0/601179678 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f5ae8010ac0 con 0x7f5af8104010 2024-09-19T06:19:33.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.115+0000 7f5affed3740 1 Processor -- start 2024-09-19T06:19:33.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.115+0000 7f5affed3740 1 -- start start 2024-09-19T06:19:33.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.115+0000 7f5affed3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628f8e4dc70 0x5628f8e4e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:33.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.115+0000 7f5affed3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f8e4e590 0x5628f8e58910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:33.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.115+0000 7f5affed3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e58e50 0x5628f8e5b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:33.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.115+0000 7f5affed3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5628f8db43e0 con 0x5628f8e58e50 2024-09-19T06:19:33.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.115+0000 7f5affed3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5628f8d5bd80 con 0x5628f8e4dc70 2024-09-19T06:19:33.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.115+0000 7f5affed3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5628f8db03a0 con 0x5628f8e4e590 2024-09-19T06:19:33.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.115+0000 7f5af6800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f8e4e590 0x5628f8e58910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:33.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.115+0000 7f5aefe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e58e50 0x5628f8e5b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:33.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.115+0000 7f5af6800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f8e4e590 0x5628f8e58910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:50124/0 (socket says 172.21.15.3:50124) 2024-09-19T06:19:33.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.115+0000 7f5af6800640 1 -- 172.21.15.3:0/1940888924 learned_addr learned my addr 172.21.15.3:0/1940888924 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:33.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.116+0000 7f5af7200640 1 --2- 172.21.15.3:0/1940888924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628f8e4dc70 0x5628f8e4e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:33.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.116+0000 7f5aefe00640 1 -- 172.21.15.3:0/1940888924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f8e4e590 msgr2=0x5628f8e58910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:33.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.116+0000 7f5aefe00640 1 --2- 172.21.15.3:0/1940888924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f8e4e590 0x5628f8e58910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.116+0000 7f5aefe00640 1 -- 172.21.15.3:0/1940888924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628f8e4dc70 msgr2=0x5628f8e4e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:33.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.116+0000 7f5aefe00640 1 --2- 172.21.15.3:0/1940888924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628f8e4dc70 0x5628f8e4e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.116+0000 7f5aefe00640 1 -- 172.21.15.3:0/1940888924 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628f8d7aae0 con 0x5628f8e58e50 2024-09-19T06:19:33.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.116+0000 7f5af6800640 1 --2- 172.21.15.3:0/1940888924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f8e4e590 0x5628f8e58910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:33.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.116+0000 7f5aef400640 1 --2- 172.21.15.3:0/601179678 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f5adc0a33b0 0x7f5adc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:33.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.116+0000 7f5aef400640 1 -- 172.21.15.3:0/601179678 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f5ae80d0140 con 0x7f5af8104010 2024-09-19T06:19:33.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.116+0000 7f5aefe00640 1 --2- 172.21.15.3:0/1940888924 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e58e50 0x5628f8e5b240 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5af8077f50 tx=0x7f5ae00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af870e15d9421599 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:33.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.116+0000 7f5af7200640 1 --2- 172.21.15.3:0/601179678 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f5adc0a33b0 0x7f5adc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:33.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.117+0000 7f5ae7400640 1 -- 172.21.15.3:0/1940888924 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0004310 con 0x5628f8e58e50 2024-09-19T06:19:33.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.117+0000 7f5ae7400640 1 -- 172.21.15.3:0/1940888924 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ae00044b0 con 0x5628f8e58e50 2024-09-19T06:19:33.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.117+0000 7f5ae7400640 1 -- 172.21.15.3:0/1940888924 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae00035f0 con 0x5628f8e58e50 2024-09-19T06:19:33.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.117+0000 7f5affed3740 1 -- 172.21.15.3:0/1940888924 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e58e50 msgr2=0x5628f8e5b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:33.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.117+0000 7f5af7200640 1 --2- 172.21.15.3:0/601179678 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f5adc0a33b0 0x7f5adc0a5870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5af0006010 tx=0x7f5af0005d80 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:33.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.117+0000 7f5affed3740 1 --2- 172.21.15.3:0/1940888924 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e58e50 0x5628f8e5b240 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5af8077f50 tx=0x7f5ae00118d0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.118+0000 7f5affed3740 1 -- 172.21.15.3:0/1940888924 shutdown_connections 2024-09-19T06:19:33.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.118+0000 7f5affed3740 1 --2- 172.21.15.3:0/1940888924 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e58e50 0x5628f8e5b240 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.118+0000 7f5affed3740 1 --2- 172.21.15.3:0/1940888924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f8e4e590 0x5628f8e58910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.118+0000 7f5affed3740 1 --2- 172.21.15.3:0/1940888924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628f8e4dc70 0x5628f8e4e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.118+0000 7f5affed3740 1 -- 172.21.15.3:0/1940888924 >> 172.21.15.3:0/1940888924 conn(0x5628f8e4a200 msgr2=0x5628f8e4a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:33.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.118+0000 7f5affed3740 1 -- 172.21.15.3:0/1940888924 shutdown_connections 2024-09-19T06:19:33.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.118+0000 7f5affed3740 1 -- 172.21.15.3:0/1940888924 wait complete. 2024-09-19T06:19:33.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.118+0000 7f5affed3740 1 -- start start 2024-09-19T06:19:33.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.118+0000 7f5affed3740 1 Processor -- start 2024-09-19T06:19:33.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.119+0000 7f5affed3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628f8e4dc70 0x5628f8e55cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:33.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.119+0000 7f5affed3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e4e590 0x5628f8e561f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:33.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.119+0000 7f5affed3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f8e58e50 0x5628f8e56730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:33.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.119+0000 7f5affed3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5628f8e5ba20 con 0x5628f8e4e590 2024-09-19T06:19:33.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.119+0000 7f5affed3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5628f8d6f0f0 con 0x5628f8e4dc70 2024-09-19T06:19:33.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.119+0000 7f5affed3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5628f8e5bba0 con 0x5628f8e58e50 2024-09-19T06:19:33.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.119+0000 7f5affed3740 10 client.0 _ll_register_callbacks cb 0x5628f8d56bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:33.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.119+0000 7f5aefe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e4e590 0x5628f8e561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:33.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.119+0000 7f5aefe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e4e590 0x5628f8e561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50816/0 (socket says 172.21.15.3:50816) 2024-09-19T06:19:33.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.119+0000 7f5aefe00640 1 -- 172.21.15.3:0/791245786 learned_addr learned my addr 172.21.15.3:0/791245786 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:33.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.119+0000 7f5af6800640 1 --2- 172.21.15.3:0/791245786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628f8e4dc70 0x5628f8e55cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:33.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.119+0000 7f5af7200640 1 --2- 172.21.15.3:0/791245786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f8e58e50 0x5628f8e56730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:33.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.120+0000 7f5aefe00640 1 -- 172.21.15.3:0/791245786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f8e58e50 msgr2=0x5628f8e56730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:33.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.120+0000 7f5aefe00640 1 --2- 172.21.15.3:0/791245786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f8e58e50 0x5628f8e56730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.120+0000 7f5aefe00640 1 -- 172.21.15.3:0/791245786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628f8e4dc70 msgr2=0x5628f8e55cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:33.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.120+0000 7f5aefe00640 1 --2- 172.21.15.3:0/791245786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628f8e4dc70 0x5628f8e55cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.120+0000 7f5aefe00640 1 -- 172.21.15.3:0/791245786 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628f8b253c0 con 0x5628f8e4e590 2024-09-19T06:19:33.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.120+0000 7f5af6800640 1 --2- 172.21.15.3:0/791245786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628f8e4dc70 0x5628f8e55cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:33.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.120+0000 7f5aefe00640 1 --2- 172.21.15.3:0/791245786 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e4e590 0x5628f8e561f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00049a0 tx=0x7f5ae00049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b69019b982d42493 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:33.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.120+0000 7f5adbe00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:19:33.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.120+0000 7f5adbe00640 1 -- 172.21.15.3:0/791245786 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0028020 con 0x5628f8e4e590 2024-09-19T06:19:33.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.120+0000 7f5adbe00640 1 -- 172.21.15.3:0/791245786 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f5ae00051c0 con 0x5628f8e4e590 2024-09-19T06:19:33.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.120+0000 7f5affed3740 1 -- 172.21.15.3:0/791245786 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ae00044b0 con 0x5628f8e4e590 2024-09-19T06:19:33.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.121+0000 7f5adbe00640 1 -- 172.21.15.3:0/791245786 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5ae0033050 con 0x5628f8e4e590 2024-09-19T06:19:33.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.121+0000 7f5affed3740 10 client.17184 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:33.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.121+0000 7f5affed3740 1 -- 172.21.15.3:0/791245786 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5628f8e679e0 con 0x5628f8e4e590 2024-09-19T06:19:33.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.121+0000 7f5adbe00640 1 -- 172.21.15.3:0/791245786 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ae00044b0 con 0x5628f8e4e590 2024-09-19T06:19:33.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.121+0000 7f5adbe00640 1 -- 172.21.15.3:0/791245786 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f5ae0018070 con 0x5628f8e4e590 2024-09-19T06:19:33.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.121+0000 7f5affed3740 10 client.17184 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:33.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.121+0000 7f5affed3740 10 client.17184 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:19:33.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.121+0000 7f5affed3740 20 client.17184 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:33.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.121+0000 7f5affed3740 1 --2- 172.21.15.3:0/791245786 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5628f8e68d90 0x5628f8e6b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:33.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.121+0000 7f5affed3740 4 client.17184 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:33.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.121+0000 7f5affed3740 1 -- 172.21.15.3:0/791245786 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628f8dc1950 con 0x5628f8e68d90 2024-09-19T06:19:33.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.122+0000 7f5af6800640 1 --2- 172.21.15.3:0/791245786 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5628f8e68d90 0x5628f8e6b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:33.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.122+0000 7f5af6800640 1 --2- 172.21.15.3:0/791245786 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5628f8e68d90 0x5628f8e6b180 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d93de5eff891b6b3 server_cookie=ed8962d0774b078f in_seq=0 out_seq=0 2024-09-19T06:19:33.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.122+0000 7f5adbe00640 10 client.17184 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:19:33.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.123+0000 7f5adbe00640 1 -- 172.21.15.3:0/791245786 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5628f8dc1950 con 0x5628f8e68d90 2024-09-19T06:19:33.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.123+0000 7f5adbe00640 10 client.17184 handle_command_reply: tid=0 2024-09-19T06:19:33.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.123+0000 7f5affed3740 1 client.17184 shutdown 2024-09-19T06:19:33.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.123+0000 7f5affed3740 1 -- 172.21.15.3:0/791245786 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e4e590 msgr2=0x5628f8e561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:33.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.123+0000 7f5affed3740 1 --2- 172.21.15.3:0/791245786 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e4e590 0x5628f8e561f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00049a0 tx=0x7f5ae00049d0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.123+0000 7f5affed3740 1 -- 172.21.15.3:0/791245786 shutdown_connections 2024-09-19T06:19:33.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.123+0000 7f5affed3740 1 --2- 172.21.15.3:0/791245786 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5628f8e68d90 0x5628f8e6b180 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.123+0000 7f5affed3740 1 --2- 172.21.15.3:0/791245786 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f8e58e50 0x5628f8e56730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.123+0000 7f5affed3740 1 --2- 172.21.15.3:0/791245786 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e4e590 0x5628f8e561f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.123+0000 7f5affed3740 1 --2- 172.21.15.3:0/791245786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628f8e4dc70 0x5628f8e55cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.123+0000 7f5adbe00640 0 client.17184 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:19:33.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.123+0000 7f5affed3740 1 -- 172.21.15.3:0/791245786 >> 172.21.15.3:0/791245786 conn(0x5628f8e4a200 msgr2=0x5628f8e4fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:33.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.123+0000 7f5affed3740 1 -- 172.21.15.3:0/791245786 shutdown_connections 2024-09-19T06:19:33.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.123+0000 7f5affed3740 1 -- 172.21.15.3:0/791245786 wait complete. 2024-09-19T06:19:33.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.123+0000 7f5affed3740 20 client.17184 trim_cache size 0 max 16384 2024-09-19T06:19:33.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.137+0000 7f5affed3740 1 Processor -- start 2024-09-19T06:19:33.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.137+0000 7f5affed3740 1 -- start start 2024-09-19T06:19:33.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.138+0000 7f5affed3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f8e4dc70 0x5628f8e709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:33.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.138+0000 7f5affed3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e4e590 0x5628f8e70ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:33.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.138+0000 7f5affed3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628f8e58e50 0x5628f8e57510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:33.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.138+0000 7f5affed3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5af81b4090 con 0x5628f8e4e590 2024-09-19T06:19:33.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.138+0000 7f5affed3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5af81b5bd0 con 0x5628f8e58e50 2024-09-19T06:19:33.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.138+0000 7f5affed3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5af81b4760 con 0x5628f8e4dc70 2024-09-19T06:19:33.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.138+0000 7f5aefe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e4e590 0x5628f8e70ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:33.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.138+0000 7f5aefe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e4e590 0x5628f8e70ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50830/0 (socket says 172.21.15.3:50830) 2024-09-19T06:19:33.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.138+0000 7f5aefe00640 1 -- 172.21.15.3:0/3767403084 learned_addr learned my addr 172.21.15.3:0/3767403084 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:33.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.138+0000 7f5af7200640 1 --2- 172.21.15.3:0/3767403084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628f8e58e50 0x5628f8e57510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:33.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.138+0000 7f5af6800640 1 --2- 172.21.15.3:0/3767403084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f8e4dc70 0x5628f8e709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:33.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.138+0000 7f5aefe00640 1 -- 172.21.15.3:0/3767403084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f8e4dc70 msgr2=0x5628f8e709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:33.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.138+0000 7f5aefe00640 1 --2- 172.21.15.3:0/3767403084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f8e4dc70 0x5628f8e709b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.138+0000 7f5aefe00640 1 -- 172.21.15.3:0/3767403084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628f8e58e50 msgr2=0x5628f8e57510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:33.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.138+0000 7f5aefe00640 1 --2- 172.21.15.3:0/3767403084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628f8e58e50 0x5628f8e57510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.138+0000 7f5aefe00640 1 -- 172.21.15.3:0/3767403084 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628f8e4a030 con 0x5628f8e4e590 2024-09-19T06:19:33.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.139+0000 7f5aefe00640 1 --2- 172.21.15.3:0/3767403084 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e4e590 0x5628f8e70ef0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0004970 tx=0x7f5ae0004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5430d8a3589f4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:33.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.139+0000 7f5ae6a00640 1 -- 172.21.15.3:0/3767403084 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0028070 con 0x5628f8e4e590 2024-09-19T06:19:33.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.139+0000 7f5ae6a00640 1 -- 172.21.15.3:0/3767403084 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ae001f040 con 0x5628f8e4e590 2024-09-19T06:19:33.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.139+0000 7f5ae6a00640 1 -- 172.21.15.3:0/3767403084 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae000fc30 con 0x5628f8e4e590 2024-09-19T06:19:33.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.140+0000 7f5affed3740 1 -- 172.21.15.3:0/3767403084 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e4e590 msgr2=0x5628f8e70ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:33.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.140+0000 7f5affed3740 1 --2- 172.21.15.3:0/3767403084 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e4e590 0x5628f8e70ef0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0004970 tx=0x7f5ae0004c80 comp rx=0 tx=0).stop 2024-09-19T06:19:33.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.140+0000 7f5affed3740 1 -- 172.21.15.3:0/3767403084 shutdown_connections 2024-09-19T06:19:33.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.140+0000 7f5affed3740 1 --2- 172.21.15.3:0/3767403084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628f8e58e50 0x5628f8e57510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.140+0000 7f5affed3740 1 --2- 172.21.15.3:0/3767403084 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e4e590 0x5628f8e70ef0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.140+0000 7f5affed3740 1 --2- 172.21.15.3:0/3767403084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f8e4dc70 0x5628f8e709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.140+0000 7f5affed3740 1 -- 172.21.15.3:0/3767403084 >> 172.21.15.3:0/3767403084 conn(0x5628f8e4a200 msgr2=0x5628f8e54da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:33.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.140+0000 7f5affed3740 1 -- 172.21.15.3:0/3767403084 shutdown_connections 2024-09-19T06:19:33.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.140+0000 7f5affed3740 1 -- 172.21.15.3:0/3767403084 wait complete. 2024-09-19T06:19:33.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.140+0000 7f5affed3740 1 -- start start 2024-09-19T06:19:33.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.141+0000 7f5affed3740 1 Processor -- start 2024-09-19T06:19:33.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.141+0000 7f5affed3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e4dc70 0x5628f8e61210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:33.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.141+0000 7f5affed3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628f8e4e590 0x5628f8e59ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:33.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.141+0000 7f5affed3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f8e58e50 0x5628f8e59ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:33.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.141+0000 7f5affed3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5af81b5500 con 0x5628f8e4dc70 2024-09-19T06:19:33.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.141+0000 7f5affed3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f5af81b4e30 con 0x5628f8e4e590 2024-09-19T06:19:33.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.141+0000 7f5affed3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f5af81b2090 con 0x5628f8e58e50 2024-09-19T06:19:33.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.141+0000 7f5affed3740 10 client.0 _ll_register_callbacks cb 0x7f5ae0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:33.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.141+0000 7f5af6800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e4dc70 0x5628f8e61210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:33.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.141+0000 7f5af7200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f8e58e50 0x5628f8e59ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:33.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.141+0000 7f5af6800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e4dc70 0x5628f8e61210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50834/0 (socket says 172.21.15.3:50834) 2024-09-19T06:19:33.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.141+0000 7f5af6800640 1 -- 172.21.15.3:0/170809246 learned_addr learned my addr 172.21.15.3:0/170809246 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:33.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.141+0000 7f5aefe00640 1 --2- 172.21.15.3:0/170809246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628f8e4e590 0x5628f8e59ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:33.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.142+0000 7f5aefe00640 1 -- 172.21.15.3:0/170809246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f8e58e50 msgr2=0x5628f8e59ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:33.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.142+0000 7f5aefe00640 1 --2- 172.21.15.3:0/170809246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f8e58e50 0x5628f8e59ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.142+0000 7f5aefe00640 1 -- 172.21.15.3:0/170809246 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e4dc70 msgr2=0x5628f8e61210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:33.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.142+0000 7f5aefe00640 1 --2- 172.21.15.3:0/170809246 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e4dc70 0x5628f8e61210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.142+0000 7f5aefe00640 1 -- 172.21.15.3:0/170809246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628f8e4ae90 con 0x5628f8e4e590 2024-09-19T06:19:33.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.142+0000 7f5af6800640 1 --2- 172.21.15.3:0/170809246 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e4dc70 0x5628f8e61210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:33.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.142+0000 7f5aefe00640 1 --2- 172.21.15.3:0/170809246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628f8e4e590 0x5628f8e59ab0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0004970 tx=0x7f5ae0004b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=897d99c70401a119 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:33.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.142+0000 7f5adbe00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:19:33.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.143+0000 7f5adbe00640 1 -- 172.21.15.3:0/170809246 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0028070 con 0x5628f8e4e590 2024-09-19T06:19:33.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.143+0000 7f5adbe00640 1 -- 172.21.15.3:0/170809246 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f5ae000fc10 con 0x5628f8e4e590 2024-09-19T06:19:33.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.143+0000 7f5affed3740 1 -- 172.21.15.3:0/170809246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ae001f040 con 0x5628f8e4e590 2024-09-19T06:19:33.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.143+0000 7f5adbe00640 1 -- 172.21.15.3:0/170809246 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5ae000fe10 con 0x5628f8e4e590 2024-09-19T06:19:33.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.143+0000 7f5affed3740 10 client.27230 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:33.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.143+0000 7f5affed3740 1 -- 172.21.15.3:0/170809246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5628f8e45770 con 0x5628f8e4e590 2024-09-19T06:19:33.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.143+0000 7f5adbe00640 1 -- 172.21.15.3:0/170809246 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ae001f040 con 0x5628f8e4e590 2024-09-19T06:19:33.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.143+0000 7f5adbe00640 1 -- 172.21.15.3:0/170809246 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f5ae0018070 con 0x5628f8e4e590 2024-09-19T06:19:33.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.144+0000 7f5affed3740 10 client.27230 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:33.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.144+0000 7f5affed3740 10 client.27230 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:19:33.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.144+0000 7f5affed3740 20 client.27230 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:33.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.144+0000 7f5affed3740 1 --2- 172.21.15.3:0/170809246 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5628f8ed3980 0x5628f8ed5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:33.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.144+0000 7f5affed3740 4 client.27230 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:19:33.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.144+0000 7f5affed3740 1 -- 172.21.15.3:0/170809246 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5628f8dbbe60 con 0x5628f8ed3980 2024-09-19T06:19:33.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.144+0000 7f5af6800640 1 --2- 172.21.15.3:0/170809246 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5628f8ed3980 0x5628f8ed5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:33.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.144+0000 7f5af6800640 1 --2- 172.21.15.3:0/170809246 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5628f8ed3980 0x5628f8ed5d70 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=618c7c56963de0cf server_cookie=825274b25d8f22ac in_seq=0 out_seq=0 2024-09-19T06:19:33.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.144+0000 7f5adbe00640 10 client.27230 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:19:33.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.145+0000 7f5adbe00640 1 -- 172.21.15.3:0/170809246 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5628f8dbbe60 con 0x5628f8ed3980 2024-09-19T06:19:33.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.145+0000 7f5adbe00640 10 client.27230 handle_command_reply: tid=0 2024-09-19T06:19:33.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.145+0000 7f5affed3740 1 client.27230 shutdown 2024-09-19T06:19:33.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.145+0000 7f5affed3740 1 -- 172.21.15.3:0/170809246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628f8e4e590 msgr2=0x5628f8e59ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:33.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.145+0000 7f5affed3740 1 --2- 172.21.15.3:0/170809246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628f8e4e590 0x5628f8e59ab0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0004970 tx=0x7f5ae0004b70 comp rx=0 tx=0).stop 2024-09-19T06:19:33.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.145+0000 7f5affed3740 1 -- 172.21.15.3:0/170809246 shutdown_connections 2024-09-19T06:19:33.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.145+0000 7f5affed3740 1 --2- 172.21.15.3:0/170809246 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5628f8ed3980 0x5628f8ed5d70 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.145+0000 7f5affed3740 1 --2- 172.21.15.3:0/170809246 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5628f8e58e50 0x5628f8e59ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.145+0000 7f5affed3740 1 --2- 172.21.15.3:0/170809246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5628f8e4e590 0x5628f8e59ab0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.145+0000 7f5affed3740 1 --2- 172.21.15.3:0/170809246 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5628f8e4dc70 0x5628f8e61210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.145+0000 7f5adbe00640 0 client.27230 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:19:33.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.145+0000 7f5affed3740 1 -- 172.21.15.3:0/170809246 >> 172.21.15.3:0/170809246 conn(0x5628f8e4a200 msgr2=0x5628f8e4f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:33.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.145+0000 7f5affed3740 1 -- 172.21.15.3:0/170809246 shutdown_connections 2024-09-19T06:19:33.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.145+0000 7f5affed3740 1 -- 172.21.15.3:0/170809246 wait complete. 2024-09-19T06:19:33.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.145+0000 7f5affed3740 20 client.27230 trim_cache size 0 max 16384 2024-09-19T06:19:33.154 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:19:33.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.146+0000 7f5afd400640 1 -- 172.21.15.3:0/601179678 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f5adc0a33b0 msgr2=0x7f5adc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:33.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.146+0000 7f5afd400640 1 --2- 172.21.15.3:0/601179678 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f5adc0a33b0 0x7f5adc0a5870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5af0006010 tx=0x7f5af0005d80 comp rx=0 tx=0).stop 2024-09-19T06:19:33.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.146+0000 7f5afd400640 1 -- 172.21.15.3:0/601179678 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5af8104010 msgr2=0x7f5af8076700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:33.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.146+0000 7f5afd400640 1 --2- 172.21.15.3:0/601179678 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5af8104010 0x7f5af8076700 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5ae800ea20 tx=0x7f5ae800eee0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.146+0000 7f5afd400640 1 -- 172.21.15.3:0/601179678 shutdown_connections 2024-09-19T06:19:33.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.146+0000 7f5afd400640 1 --2- 172.21.15.3:0/601179678 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f5adc0a33b0 0x7f5adc0a5870 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.146+0000 7f5afd400640 1 --2- 172.21.15.3:0/601179678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5af8109140 0x7f5af8077180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.146+0000 7f5afd400640 1 --2- 172.21.15.3:0/601179678 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f5af81049c0 0x7f5af8076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.146+0000 7f5afd400640 1 --2- 172.21.15.3:0/601179678 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5af8104010 0x7f5af8076700 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:33.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.146+0000 7f5afd400640 1 -- 172.21.15.3:0/601179678 >> 172.21.15.3:0/601179678 conn(0x7f5af80ffa50 msgr2=0x7f5af8100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:33.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.146+0000 7f5afd400640 1 -- 172.21.15.3:0/601179678 shutdown_connections 2024-09-19T06:19:33.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:33.146+0000 7f5afd400640 1 -- 172.21.15.3:0/601179678 wait complete. 2024-09-19T06:19:33.983 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:19:34.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:33 smithi059 ceph-mon[35138]: pgmap v220: 97 pgs: 97 active+clean; 4.1 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:19:34.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:33 smithi003 ceph-mon[30893]: pgmap v220: 97 pgs: 97 active+clean; 4.1 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:19:34.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:33 smithi071 ceph-mon[35662]: pgmap v220: 97 pgs: 97 active+clean; 4.1 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:19:34.361 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:34.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.969+0000 7ff677c00640 1 -- 172.21.15.3:0/609047245 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff670104010 msgr2=0x7ff6701043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:34.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.969+0000 7ff677c00640 1 --2- 172.21.15.3:0/609047245 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff670104010 0x7ff6701043f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff664009900 tx=0x7ff66402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:19:34.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.970+0000 7ff677c00640 1 -- 172.21.15.3:0/609047245 shutdown_connections 2024-09-19T06:19:34.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.970+0000 7ff677c00640 1 --2- 172.21.15.3:0/609047245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff670109140 0x7ff670110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:34.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.970+0000 7ff677c00640 1 --2- 172.21.15.3:0/609047245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff6701049c0 0x7ff670108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:34.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.970+0000 7ff677c00640 1 --2- 172.21.15.3:0/609047245 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff670104010 0x7ff6701043f0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:34.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.970+0000 7ff677c00640 1 -- 172.21.15.3:0/609047245 >> 172.21.15.3:0/609047245 conn(0x7ff6700ffa50 msgr2=0x7ff670101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:34.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.970+0000 7ff677c00640 1 -- 172.21.15.3:0/609047245 shutdown_connections 2024-09-19T06:19:34.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.971+0000 7ff677c00640 1 -- 172.21.15.3:0/609047245 wait complete. 2024-09-19T06:19:34.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.971+0000 7ff677c00640 1 Processor -- start 2024-09-19T06:19:34.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.972+0000 7ff677c00640 1 -- start start 2024-09-19T06:19:34.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.972+0000 7ff677c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff670104010 0x7ff67019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:34.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.972+0000 7ff677c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6701049c0 0x7ff67019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:34.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.972+0000 7ff677c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff670109140 0x7ff67019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:34.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.972+0000 7ff677c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff6701141b0 con 0x7ff6701049c0 2024-09-19T06:19:34.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.972+0000 7ff677c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff670114030 con 0x7ff670104010 2024-09-19T06:19:34.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.972+0000 7ff677c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff670114330 con 0x7ff670109140 2024-09-19T06:19:34.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.972+0000 7ff66fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6701049c0 0x7ff67019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:34.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.972+0000 7ff66fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6701049c0 0x7ff67019abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40254/0 (socket says 172.21.15.3:40254) 2024-09-19T06:19:34.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.972+0000 7ff66fe00640 1 -- 172.21.15.3:0/26190130 learned_addr learned my addr 172.21.15.3:0/26190130 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:34.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.972+0000 7ff675c00640 1 --2- 172.21.15.3:0/26190130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff670109140 0x7ff67019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:34.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.972+0000 7ff675200640 1 --2- 172.21.15.3:0/26190130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff670104010 0x7ff67019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:34.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.973+0000 7ff675c00640 1 -- 172.21.15.3:0/26190130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff670104010 msgr2=0x7ff67019a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:34.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.973+0000 7ff675c00640 1 --2- 172.21.15.3:0/26190130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff670104010 0x7ff67019a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:34.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.973+0000 7ff675c00640 1 -- 172.21.15.3:0/26190130 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6701049c0 msgr2=0x7ff67019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.973+0000 7ff675c00640 1 --2- 172.21.15.3:0/26190130 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6701049c0 0x7ff67019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.973+0000 7ff675c00640 1 -- 172.21.15.3:0/26190130 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67019f620 con 0x7ff670109140 2024-09-19T06:19:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.973+0000 7ff66fe00640 1 --2- 172.21.15.3:0/26190130 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6701049c0 0x7ff67019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.973+0000 7ff675c00640 1 --2- 172.21.15.3:0/26190130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff670109140 0x7ff67019ef40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff66800ec50 tx=0x7ff66800c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.973+0000 7ff66d600640 1 -- 172.21.15.3:0/26190130 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff668003b70 con 0x7ff670109140 2024-09-19T06:19:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.974+0000 7ff677c00640 1 -- 172.21.15.3:0/26190130 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67019f910 con 0x7ff670109140 2024-09-19T06:19:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.974+0000 7ff66d600640 1 -- 172.21.15.3:0/26190130 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff668003d10 con 0x7ff670109140 2024-09-19T06:19:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.974+0000 7ff66d600640 1 -- 172.21.15.3:0/26190130 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff668010890 con 0x7ff670109140 2024-09-19T06:19:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.974+0000 7ff677c00640 1 -- 172.21.15.3:0/26190130 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6701a71f0 con 0x7ff670109140 2024-09-19T06:19:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.977+0000 7ff67a6cd740 1 Processor -- start 2024-09-19T06:19:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.977+0000 7ff66d600640 1 -- 172.21.15.3:0/26190130 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7ff668003fc0 con 0x7ff670109140 2024-09-19T06:19:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.977+0000 7ff67a6cd740 1 -- start start 2024-09-19T06:19:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.977+0000 7ff67a6cd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cda9c45c70 0x55cda9c46050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:34.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.977+0000 7ff67a6cd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c46590 0x55cda9c50910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:34.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.977+0000 7ff67a6cd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c50e50 0x55cda9c53240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:34.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.977+0000 7ff67a6cd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55cda9bac3e0 con 0x55cda9c46590 2024-09-19T06:19:34.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.977+0000 7ff67a6cd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55cda9b53d80 con 0x55cda9c50e50 2024-09-19T06:19:34.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.977+0000 7ff67a6cd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cda9ba83a0 con 0x55cda9c45c70 2024-09-19T06:19:34.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.977+0000 7ff675200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c46590 0x55cda9c50910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:34.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.977+0000 7ff675200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c46590 0x55cda9c50910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40270/0 (socket says 172.21.15.3:40270) 2024-09-19T06:19:34.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.977+0000 7ff675200640 1 -- 172.21.15.3:0/3962846004 learned_addr learned my addr 172.21.15.3:0/3962846004 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:34.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.978+0000 7ff66fe00640 1 --2- 172.21.15.3:0/3962846004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cda9c45c70 0x55cda9c46050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:34.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.978+0000 7ff66fe00640 1 --2- 172.21.15.3:0/3962846004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c50e50 0x55cda9c53240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:34.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.978+0000 7ff675200640 1 -- 172.21.15.3:0/3962846004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cda9c45c70 msgr2=0x55cda9c46050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:34.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.978+0000 7ff675200640 1 --2- 172.21.15.3:0/3962846004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cda9c45c70 0x55cda9c46050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:34.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.978+0000 7ff675200640 1 -- 172.21.15.3:0/3962846004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c50e50 msgr2=0x55cda9c53240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:34.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.978+0000 7ff675200640 1 --2- 172.21.15.3:0/3962846004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c50e50 0x55cda9c53240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:34.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.978+0000 7ff675200640 1 -- 172.21.15.3:0/3962846004 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cda9b72ae0 con 0x55cda9c46590 2024-09-19T06:19:34.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.978+0000 7ff66fe00640 1 --2- 172.21.15.3:0/3962846004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c50e50 0x55cda9c53240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:34.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.978+0000 7ff66d600640 1 --2- 172.21.15.3:0/26190130 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff6580a3430 0x7ff6580a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:34.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.978+0000 7ff66d600640 1 -- 172.21.15.3:0/26190130 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7ff6680d02a0 con 0x7ff670109140 2024-09-19T06:19:34.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.978+0000 7ff675200640 1 --2- 172.21.15.3:0/3962846004 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c46590 0x55cda9c50910 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff664009900 tx=0x7ff664005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821cb3674c1be1c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:34.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.979+0000 7ff66fe00640 1 --2- 172.21.15.3:0/26190130 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff6580a3430 0x7ff6580a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:34.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.979+0000 7ff662000640 1 -- 172.21.15.3:0/3962846004 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff664035040 con 0x55cda9c46590 2024-09-19T06:19:34.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.979+0000 7ff662000640 1 -- 172.21.15.3:0/3962846004 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff664004400 con 0x55cda9c46590 2024-09-19T06:19:34.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.979+0000 7ff662000640 1 -- 172.21.15.3:0/3962846004 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6640035f0 con 0x55cda9c46590 2024-09-19T06:19:34.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.980+0000 7ff67a6cd740 1 -- 172.21.15.3:0/3962846004 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c46590 msgr2=0x55cda9c50910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:34.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.980+0000 7ff67a6cd740 1 --2- 172.21.15.3:0/3962846004 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c46590 0x55cda9c50910 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff664009900 tx=0x7ff664005de0 comp rx=0 tx=0).stop 2024-09-19T06:19:34.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.980+0000 7ff66fe00640 1 --2- 172.21.15.3:0/26190130 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff6580a3430 0x7ff6580a58f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55cda9c43580 tx=0x7ff65c013040 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:34.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.980+0000 7ff67a6cd740 1 -- 172.21.15.3:0/3962846004 shutdown_connections 2024-09-19T06:19:34.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.980+0000 7ff67a6cd740 1 --2- 172.21.15.3:0/3962846004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c50e50 0x55cda9c53240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:34.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.980+0000 7ff67a6cd740 1 --2- 172.21.15.3:0/3962846004 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c46590 0x55cda9c50910 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:34.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.980+0000 7ff67a6cd740 1 --2- 172.21.15.3:0/3962846004 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cda9c45c70 0x55cda9c46050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:34.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.980+0000 7ff67a6cd740 1 -- 172.21.15.3:0/3962846004 >> 172.21.15.3:0/3962846004 conn(0x55cda9c42200 msgr2=0x55cda9c425e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:34.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.980+0000 7ff67a6cd740 1 -- 172.21.15.3:0/3962846004 shutdown_connections 2024-09-19T06:19:34.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.980+0000 7ff67a6cd740 1 -- 172.21.15.3:0/3962846004 wait complete. 2024-09-19T06:19:34.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.980+0000 7ff67a6cd740 1 -- start start 2024-09-19T06:19:34.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.981+0000 7ff67a6cd740 1 Processor -- start 2024-09-19T06:19:34.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.981+0000 7ff67a6cd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c45c70 0x55cda9c4dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:34.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.981+0000 7ff67a6cd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c46590 0x55cda9c4e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:34.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.981+0000 7ff67a6cd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cda9c50e50 0x55cda9c4e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:34.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.981+0000 7ff67a6cd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55cda9c53a20 con 0x55cda9c45c70 2024-09-19T06:19:34.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.981+0000 7ff67a6cd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55cda9b670f0 con 0x55cda9c46590 2024-09-19T06:19:34.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.981+0000 7ff67a6cd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cda9c53ba0 con 0x55cda9c50e50 2024-09-19T06:19:34.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.981+0000 7ff67a6cd740 10 client.0 _ll_register_callbacks cb 0x55cda9b4ebd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:34.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.981+0000 7ff675200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c45c70 0x55cda9c4dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:34.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.981+0000 7ff66fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c46590 0x55cda9c4e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:34.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.982+0000 7ff675200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c45c70 0x55cda9c4dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40274/0 (socket says 172.21.15.3:40274) 2024-09-19T06:19:34.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.982+0000 7ff675200640 1 -- 172.21.15.3:0/2668532739 learned_addr learned my addr 172.21.15.3:0/2668532739 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:34.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.982+0000 7ff66fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c46590 0x55cda9c4e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:41036/0 (socket says 172.21.15.3:41036) 2024-09-19T06:19:34.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.982+0000 7ff675c00640 1 --2- 172.21.15.3:0/2668532739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cda9c50e50 0x55cda9c4e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:34.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.982+0000 7ff675200640 1 -- 172.21.15.3:0/2668532739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cda9c50e50 msgr2=0x55cda9c4e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:34.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.982+0000 7ff675200640 1 --2- 172.21.15.3:0/2668532739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cda9c50e50 0x55cda9c4e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:34.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.982+0000 7ff675200640 1 -- 172.21.15.3:0/2668532739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c46590 msgr2=0x55cda9c4e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:34.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.982+0000 7ff675200640 1 --2- 172.21.15.3:0/2668532739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c46590 0x55cda9c4e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:34.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.982+0000 7ff675200640 1 -- 172.21.15.3:0/2668532739 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cda991d3c0 con 0x55cda9c45c70 2024-09-19T06:19:34.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.982+0000 7ff675c00640 1 --2- 172.21.15.3:0/2668532739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cda9c50e50 0x55cda9c4e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:34.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.982+0000 7ff66fe00640 1 --2- 172.21.15.3:0/2668532739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c46590 0x55cda9c4e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:34.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.982+0000 7ff675200640 1 --2- 172.21.15.3:0/2668532739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c45c70 0x55cda9c4dd80 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff664004920 tx=0x7ff66402a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf9e01073e7f0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:34.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.982+0000 7ff656a00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:19:34.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.983+0000 7ff656a00640 1 -- 172.21.15.3:0/2668532739 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff664052060 con 0x55cda9c45c70 2024-09-19T06:19:34.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.983+0000 7ff656a00640 1 -- 172.21.15.3:0/2668532739 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7ff664004200 con 0x55cda9c45c70 2024-09-19T06:19:34.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.983+0000 7ff67a6cd740 1 -- 172.21.15.3:0/2668532739 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff664004400 con 0x55cda9c45c70 2024-09-19T06:19:34.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.983+0000 7ff656a00640 1 -- 172.21.15.3:0/2668532739 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff664035070 con 0x55cda9c45c70 2024-09-19T06:19:34.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.983+0000 7ff67a6cd740 10 client.17202 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:34.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.983+0000 7ff67a6cd740 1 -- 172.21.15.3:0/2668532739 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cda9c5fab0 con 0x55cda9c45c70 2024-09-19T06:19:34.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.983+0000 7ff656a00640 1 -- 172.21.15.3:0/2668532739 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff664004400 con 0x55cda9c45c70 2024-09-19T06:19:34.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.984+0000 7ff656a00640 1 -- 172.21.15.3:0/2668532739 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff6640319f0 con 0x55cda9c45c70 2024-09-19T06:19:34.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.984+0000 7ff67a6cd740 10 client.17202 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:34.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.984+0000 7ff67a6cd740 10 client.17202 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:19:34.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.984+0000 7ff67a6cd740 20 client.17202 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:34.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.984+0000 7ff67a6cd740 1 --2- 172.21.15.3:0/2668532739 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55cda9c60e00 0x55cda9c631f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:34.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.984+0000 7ff67a6cd740 4 client.17202 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:34.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.984+0000 7ff67a6cd740 1 -- 172.21.15.3:0/2668532739 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cda9bb9950 con 0x55cda9c60e00 2024-09-19T06:19:34.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.984+0000 7ff66fe00640 1 --2- 172.21.15.3:0/2668532739 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55cda9c60e00 0x55cda9c631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:34.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.985+0000 7ff66fe00640 1 --2- 172.21.15.3:0/2668532739 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55cda9c60e00 0x55cda9c631f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5a01d9a276e87365 server_cookie=8e288bffd75ed55d in_seq=0 out_seq=0 2024-09-19T06:19:34.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.985+0000 7ff656a00640 10 client.17202 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:19:34.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.986+0000 7ff656a00640 1 -- 172.21.15.3:0/2668532739 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cda9bb9950 con 0x55cda9c60e00 2024-09-19T06:19:34.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.986+0000 7ff656a00640 10 client.17202 handle_command_reply: tid=0 2024-09-19T06:19:34.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.986+0000 7ff67a6cd740 1 client.17202 shutdown 2024-09-19T06:19:34.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.986+0000 7ff67a6cd740 1 -- 172.21.15.3:0/2668532739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c45c70 msgr2=0x55cda9c4dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:34.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.986+0000 7ff67a6cd740 1 --2- 172.21.15.3:0/2668532739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c45c70 0x55cda9c4dd80 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff664004920 tx=0x7ff66402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:19:34.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.986+0000 7ff67a6cd740 1 -- 172.21.15.3:0/2668532739 shutdown_connections 2024-09-19T06:19:34.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.986+0000 7ff67a6cd740 1 --2- 172.21.15.3:0/2668532739 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cda9c50e50 0x55cda9c4e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:34.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.986+0000 7ff67a6cd740 1 --2- 172.21.15.3:0/2668532739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c46590 0x55cda9c4e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:34.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.986+0000 7ff67a6cd740 1 --2- 172.21.15.3:0/2668532739 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55cda9c60e00 0x55cda9c631f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:34.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.986+0000 7ff67a6cd740 1 --2- 172.21.15.3:0/2668532739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c45c70 0x55cda9c4dd80 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:34.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.986+0000 7ff67a6cd740 1 -- 172.21.15.3:0/2668532739 >> 172.21.15.3:0/2668532739 conn(0x55cda9c42200 msgr2=0x55cda9c47ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:34.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.986+0000 7ff656a00640 0 client.17202 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:19:34.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.986+0000 7ff67a6cd740 1 -- 172.21.15.3:0/2668532739 shutdown_connections 2024-09-19T06:19:34.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.986+0000 7ff67a6cd740 1 -- 172.21.15.3:0/2668532739 wait complete. 2024-09-19T06:19:34.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:34.986+0000 7ff67a6cd740 20 client.17202 trim_cache size 0 max 16384 2024-09-19T06:19:35.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.009+0000 7ff67a6cd740 1 Processor -- start 2024-09-19T06:19:35.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.009+0000 7ff67a6cd740 1 -- start start 2024-09-19T06:19:35.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.009+0000 7ff67a6cd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c45c70 0x55cda9c68790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:35.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.009+0000 7ff67a6cd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cda9c46590 0x55cda9c68cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:35.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.009+0000 7ff67a6cd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c50e50 0x55cda9c4b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:35.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.009+0000 7ff67a6cd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff6701afb90 con 0x55cda9c45c70 2024-09-19T06:19:35.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.009+0000 7ff67a6cd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff6701b16d0 con 0x55cda9c50e50 2024-09-19T06:19:35.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.009+0000 7ff67a6cd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff6701b0260 con 0x55cda9c46590 2024-09-19T06:19:35.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.010+0000 7ff675200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c45c70 0x55cda9c68790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:35.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.010+0000 7ff675c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c50e50 0x55cda9c4b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:35.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.010+0000 7ff675200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c45c70 0x55cda9c68790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40278/0 (socket says 172.21.15.3:40278) 2024-09-19T06:19:35.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.010+0000 7ff675200640 1 -- 172.21.15.3:0/3956132779 learned_addr learned my addr 172.21.15.3:0/3956132779 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:35.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.010+0000 7ff66fe00640 1 --2- 172.21.15.3:0/3956132779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cda9c46590 0x55cda9c68cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:35.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.010+0000 7ff675c00640 1 -- 172.21.15.3:0/3956132779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cda9c46590 msgr2=0x55cda9c68cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:35.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.010+0000 7ff675c00640 1 --2- 172.21.15.3:0/3956132779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cda9c46590 0x55cda9c68cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:35.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.010+0000 7ff675c00640 1 -- 172.21.15.3:0/3956132779 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c45c70 msgr2=0x55cda9c68790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:35.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.010+0000 7ff675c00640 1 --2- 172.21.15.3:0/3956132779 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c45c70 0x55cda9c68790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:35.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.010+0000 7ff675c00640 1 -- 172.21.15.3:0/3956132779 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cda9c42030 con 0x55cda9c50e50 2024-09-19T06:19:35.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.010+0000 7ff675c00640 1 --2- 172.21.15.3:0/3956132779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c50e50 0x55cda9c4b000 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff6680cd960 tx=0x7ff66809c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44342730e7227213 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:35.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.010+0000 7ff661600640 1 -- 172.21.15.3:0/3956132779 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66809cbf0 con 0x55cda9c50e50 2024-09-19T06:19:35.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.011+0000 7ff661600640 1 -- 172.21.15.3:0/3956132779 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff66809c4f0 con 0x55cda9c50e50 2024-09-19T06:19:35.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.011+0000 7ff661600640 1 -- 172.21.15.3:0/3956132779 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6680b54f0 con 0x55cda9c50e50 2024-09-19T06:19:35.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.011+0000 7ff67a6cd740 1 -- 172.21.15.3:0/3956132779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c50e50 msgr2=0x55cda9c4b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:35.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.011+0000 7ff67a6cd740 1 --2- 172.21.15.3:0/3956132779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c50e50 0x55cda9c4b000 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff6680cd960 tx=0x7ff66809c380 comp rx=0 tx=0).stop 2024-09-19T06:19:35.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.011+0000 7ff67a6cd740 1 -- 172.21.15.3:0/3956132779 shutdown_connections 2024-09-19T06:19:35.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.011+0000 7ff67a6cd740 1 --2- 172.21.15.3:0/3956132779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c50e50 0x55cda9c4b000 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:35.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.011+0000 7ff67a6cd740 1 --2- 172.21.15.3:0/3956132779 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cda9c46590 0x55cda9c68cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:35.014 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.011+0000 7ff67a6cd740 1 --2- 172.21.15.3:0/3956132779 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c45c70 0x55cda9c68790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:35.014 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.011+0000 7ff67a6cd740 1 -- 172.21.15.3:0/3956132779 >> 172.21.15.3:0/3956132779 conn(0x55cda9c42200 msgr2=0x55cda9c47ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:35.014 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.011+0000 7ff67a6cd740 1 -- 172.21.15.3:0/3956132779 shutdown_connections 2024-09-19T06:19:35.014 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.011+0000 7ff67a6cd740 1 -- 172.21.15.3:0/3956132779 wait complete. 2024-09-19T06:19:35.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.012+0000 7ff67a6cd740 1 -- start start 2024-09-19T06:19:35.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.012+0000 7ff67a6cd740 1 Processor -- start 2024-09-19T06:19:35.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.012+0000 7ff67a6cd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c45c70 0x55cda9c595d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:35.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.012+0000 7ff67a6cd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cda9c46590 0x55cda9c4ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:35.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.012+0000 7ff67a6cd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c50e50 0x55cda9c4b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:35.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.012+0000 7ff67a6cd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff6701b1000 con 0x55cda9c45c70 2024-09-19T06:19:35.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.013+0000 7ff67a6cd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff6701b0930 con 0x55cda9c50e50 2024-09-19T06:19:35.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.013+0000 7ff67a6cd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff6701adb90 con 0x55cda9c46590 2024-09-19T06:19:35.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.013+0000 7ff67a6cd740 10 client.0 _ll_register_callbacks cb 0x7ff65c009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:35.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.013+0000 7ff675200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c45c70 0x55cda9c595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:35.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.013+0000 7ff675200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c45c70 0x55cda9c595d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40294/0 (socket says 172.21.15.3:40294) 2024-09-19T06:19:35.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.013+0000 7ff675200640 1 -- 172.21.15.3:0/1741541892 learned_addr learned my addr 172.21.15.3:0/1741541892 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:35.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.013+0000 7ff675c00640 1 --2- 172.21.15.3:0/1741541892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c50e50 0x55cda9c4b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:35.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.013+0000 7ff66fe00640 1 --2- 172.21.15.3:0/1741541892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cda9c46590 0x55cda9c4ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:35.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.013+0000 7ff675200640 1 -- 172.21.15.3:0/1741541892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cda9c46590 msgr2=0x55cda9c4ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:35.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.013+0000 7ff675200640 1 --2- 172.21.15.3:0/1741541892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cda9c46590 0x55cda9c4ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:35.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.013+0000 7ff675200640 1 -- 172.21.15.3:0/1741541892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c50e50 msgr2=0x55cda9c4b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:35.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.013+0000 7ff675200640 1 --2- 172.21.15.3:0/1741541892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c50e50 0x55cda9c4b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:35.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.013+0000 7ff675200640 1 -- 172.21.15.3:0/1741541892 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cda9c3d770 con 0x55cda9c45c70 2024-09-19T06:19:35.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.013+0000 7ff66fe00640 1 --2- 172.21.15.3:0/1741541892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cda9c46590 0x55cda9c4ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:35.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.013+0000 7ff675c00640 1 --2- 172.21.15.3:0/1741541892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c50e50 0x55cda9c4b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:35.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.014+0000 7ff675200640 1 --2- 172.21.15.3:0/1741541892 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c45c70 0x55cda9c595d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff664001eb0 tx=0x7ff6640317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cebfde67f24a709 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:35.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.014+0000 7ff656a00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:19:35.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.014+0000 7ff656a00640 1 -- 172.21.15.3:0/1741541892 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff664052070 con 0x55cda9c45c70 2024-09-19T06:19:35.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.014+0000 7ff656a00640 1 -- 172.21.15.3:0/1741541892 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7ff6640319d0 con 0x55cda9c45c70 2024-09-19T06:19:35.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.014+0000 7ff67a6cd740 1 -- 172.21.15.3:0/1741541892 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff66809c4f0 con 0x55cda9c45c70 2024-09-19T06:19:35.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.014+0000 7ff656a00640 1 -- 172.21.15.3:0/1741541892 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff664064050 con 0x55cda9c45c70 2024-09-19T06:19:35.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.014+0000 7ff67a6cd740 10 client.17208 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:35.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.014+0000 7ff67a6cd740 1 -- 172.21.15.3:0/1741541892 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cda9ccb610 con 0x55cda9c45c70 2024-09-19T06:19:35.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.015+0000 7ff656a00640 1 -- 172.21.15.3:0/1741541892 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff66809c4f0 con 0x55cda9c45c70 2024-09-19T06:19:35.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.015+0000 7ff656a00640 1 -- 172.21.15.3:0/1741541892 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff664003710 con 0x55cda9c45c70 2024-09-19T06:19:35.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.015+0000 7ff67a6cd740 10 client.17208 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:35.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.015+0000 7ff67a6cd740 10 client.17208 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:19:35.019 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.015+0000 7ff67a6cd740 20 client.17208 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:35.019 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.015+0000 7ff67a6cd740 1 --2- 172.21.15.3:0/1741541892 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55cda9ccbcd0 0x55cda9cce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:35.019 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.015+0000 7ff67a6cd740 4 client.17208 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:19:35.019 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.015+0000 7ff67a6cd740 1 -- 172.21.15.3:0/1741541892 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cda9bb3e60 con 0x55cda9ccbcd0 2024-09-19T06:19:35.019 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.015+0000 7ff66fe00640 1 --2- 172.21.15.3:0/1741541892 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55cda9ccbcd0 0x55cda9cce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:35.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.016+0000 7ff66fe00640 1 --2- 172.21.15.3:0/1741541892 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55cda9ccbcd0 0x55cda9cce0c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7cbae883b3048a58 server_cookie=505befe7c6586a17 in_seq=0 out_seq=0 2024-09-19T06:19:35.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.016+0000 7ff656a00640 10 client.17208 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:19:35.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.016+0000 7ff656a00640 1 -- 172.21.15.3:0/1741541892 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cda9bb3e60 con 0x55cda9ccbcd0 2024-09-19T06:19:35.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.016+0000 7ff656a00640 10 client.17208 handle_command_reply: tid=0 2024-09-19T06:19:35.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.016+0000 7ff67a6cd740 1 client.17208 shutdown 2024-09-19T06:19:35.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.016+0000 7ff67a6cd740 1 -- 172.21.15.3:0/1741541892 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c45c70 msgr2=0x55cda9c595d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:35.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.016+0000 7ff67a6cd740 1 --2- 172.21.15.3:0/1741541892 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c45c70 0x55cda9c595d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff664001eb0 tx=0x7ff6640317e0 comp rx=0 tx=0).stop 2024-09-19T06:19:35.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.016+0000 7ff67a6cd740 1 -- 172.21.15.3:0/1741541892 shutdown_connections 2024-09-19T06:19:35.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.016+0000 7ff67a6cd740 1 --2- 172.21.15.3:0/1741541892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cda9c50e50 0x55cda9c4b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:35.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.016+0000 7ff67a6cd740 1 --2- 172.21.15.3:0/1741541892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cda9c46590 0x55cda9c4ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:35.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.016+0000 7ff67a6cd740 1 --2- 172.21.15.3:0/1741541892 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55cda9ccbcd0 0x55cda9cce0c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:35.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.016+0000 7ff67a6cd740 1 --2- 172.21.15.3:0/1741541892 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cda9c45c70 0x55cda9c595d0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:35.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.016+0000 7ff67a6cd740 1 -- 172.21.15.3:0/1741541892 >> 172.21.15.3:0/1741541892 conn(0x55cda9c42200 msgr2=0x55cda9c47630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:35.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.016+0000 7ff656a00640 0 client.17208 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:19:35.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.017+0000 7ff67a6cd740 1 -- 172.21.15.3:0/1741541892 shutdown_connections 2024-09-19T06:19:35.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.017+0000 7ff67a6cd740 1 -- 172.21.15.3:0/1741541892 wait complete. 2024-09-19T06:19:35.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.017+0000 7ff67a6cd740 20 client.17208 trim_cache size 0 max 16384 2024-09-19T06:19:35.021 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:19:35.022 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.017+0000 7ff677c00640 1 -- 172.21.15.3:0/26190130 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff6580a3430 msgr2=0x7ff6580a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:35.022 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.017+0000 7ff677c00640 1 --2- 172.21.15.3:0/26190130 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff6580a3430 0x7ff6580a58f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55cda9c43580 tx=0x7ff65c013040 comp rx=0 tx=0).stop 2024-09-19T06:19:35.022 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.017+0000 7ff677c00640 1 -- 172.21.15.3:0/26190130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff670109140 msgr2=0x7ff67019ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:35.022 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.017+0000 7ff677c00640 1 --2- 172.21.15.3:0/26190130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff670109140 0x7ff67019ef40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff66800ec50 tx=0x7ff66800c6a0 comp rx=0 tx=0).stop 2024-09-19T06:19:35.022 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.017+0000 7ff677c00640 1 -- 172.21.15.3:0/26190130 shutdown_connections 2024-09-19T06:19:35.022 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.017+0000 7ff677c00640 1 --2- 172.21.15.3:0/26190130 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff6580a3430 0x7ff6580a58f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:35.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.017+0000 7ff677c00640 1 --2- 172.21.15.3:0/26190130 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff670109140 0x7ff67019ef40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:35.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.017+0000 7ff677c00640 1 --2- 172.21.15.3:0/26190130 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff6701049c0 0x7ff67019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:35.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.017+0000 7ff677c00640 1 --2- 172.21.15.3:0/26190130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff670104010 0x7ff67019a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:35.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.017+0000 7ff677c00640 1 -- 172.21.15.3:0/26190130 >> 172.21.15.3:0/26190130 conn(0x7ff6700ffa50 msgr2=0x7ff670100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:35.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.018+0000 7ff677c00640 1 -- 172.21.15.3:0/26190130 shutdown_connections 2024-09-19T06:19:35.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:35.018+0000 7ff677c00640 1 -- 172.21.15.3:0/26190130 wait complete. 2024-09-19T06:19:35.867 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:19:36.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:35 smithi003 ceph-mon[30893]: pgmap v221: 97 pgs: 97 active+clean; 4.3 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 22 op/s 2024-09-19T06:19:36.246 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:36.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:35 smithi059 ceph-mon[35138]: pgmap v221: 97 pgs: 97 active+clean; 4.3 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 22 op/s 2024-09-19T06:19:36.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:35 smithi071 ceph-mon[35662]: pgmap v221: 97 pgs: 97 active+clean; 4.3 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 22 op/s 2024-09-19T06:19:36.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.827+0000 7f7342600640 1 -- 172.21.15.3:0/318268720 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f733c077040 msgr2=0x7f733c112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:36.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.827+0000 7f7342600640 1 --2- 172.21.15.3:0/318268720 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f733c077040 0x7f733c112330 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7324009900 tx=0x7f732402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.827+0000 7f7342600640 1 -- 172.21.15.3:0/318268720 shutdown_connections 2024-09-19T06:19:36.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.827+0000 7f7342600640 1 --2- 172.21.15.3:0/318268720 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f733c112870 0x7f733c114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.827+0000 7f7342600640 1 --2- 172.21.15.3:0/318268720 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f733c077040 0x7f733c112330 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.827+0000 7f7342600640 1 --2- 172.21.15.3:0/318268720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f733c076720 0x7f733c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.827+0000 7f7342600640 1 -- 172.21.15.3:0/318268720 >> 172.21.15.3:0/318268720 conn(0x7f733c0ff910 msgr2=0x7f733c101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:36.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.828+0000 7f7342600640 1 -- 172.21.15.3:0/318268720 shutdown_connections 2024-09-19T06:19:36.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.828+0000 7f7342600640 1 -- 172.21.15.3:0/318268720 wait complete. 2024-09-19T06:19:36.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.829+0000 7f7342600640 1 Processor -- start 2024-09-19T06:19:36.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.829+0000 7f7342600640 1 -- start start 2024-09-19T06:19:36.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.829+0000 7f7342600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f733c076720 0x7f733c1a4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:36.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.829+0000 7f7342600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f733c077040 0x7f733c1a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:36.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.829+0000 7f7342600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f733c112870 0x7f733c19e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:36.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.829+0000 7f7342600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f733c1183f0 con 0x7f733c112870 2024-09-19T06:19:36.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.829+0000 7f7342600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f733c118270 con 0x7f733c076720 2024-09-19T06:19:36.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.829+0000 7f7342600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f733c118570 con 0x7f733c077040 2024-09-19T06:19:36.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.829+0000 7f7341c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f733c112870 0x7f733c19e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:36.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.829+0000 7f7341c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f733c112870 0x7f733c19e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40320/0 (socket says 172.21.15.3:40320) 2024-09-19T06:19:36.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.829+0000 7f7333e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f733c077040 0x7f733c1a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:36.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.829+0000 7f7341c00640 1 -- 172.21.15.3:0/4170787356 learned_addr learned my addr 172.21.15.3:0/4170787356 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:36.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.829+0000 7f7341200640 1 --2- 172.21.15.3:0/4170787356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f733c076720 0x7f733c1a4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:36.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.830+0000 7f7333e00640 1 -- 172.21.15.3:0/4170787356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f733c076720 msgr2=0x7f733c1a4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:36.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.830+0000 7f7333e00640 1 --2- 172.21.15.3:0/4170787356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f733c076720 0x7f733c1a4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.830+0000 7f7333e00640 1 -- 172.21.15.3:0/4170787356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f733c112870 msgr2=0x7f733c19e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:36.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.830+0000 7f7333e00640 1 --2- 172.21.15.3:0/4170787356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f733c112870 0x7f733c19e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.830+0000 7f7333e00640 1 -- 172.21.15.3:0/4170787356 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f733c19ef70 con 0x7f733c077040 2024-09-19T06:19:36.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.830+0000 7f7341c00640 1 --2- 172.21.15.3:0/4170787356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f733c112870 0x7f733c19e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:36.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.830+0000 7f7333e00640 1 --2- 172.21.15.3:0/4170787356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f733c077040 0x7f733c1a4b70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7324005940 tx=0x7f7324004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:36.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.831+0000 7f733a000640 1 -- 172.21.15.3:0/4170787356 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732403f030 con 0x7f733c077040 2024-09-19T06:19:36.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.831+0000 7f733a000640 1 -- 172.21.15.3:0/4170787356 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7324003ad0 con 0x7f733c077040 2024-09-19T06:19:36.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.831+0000 7f7342600640 1 -- 172.21.15.3:0/4170787356 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f733c19f200 con 0x7f733c077040 2024-09-19T06:19:36.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.831+0000 7f733a000640 1 -- 172.21.15.3:0/4170787356 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7324035070 con 0x7f733c077040 2024-09-19T06:19:36.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.831+0000 7f7342600640 1 -- 172.21.15.3:0/4170787356 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f733c1ab3e0 con 0x7f733c077040 2024-09-19T06:19:36.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.834+0000 7f73467d0740 1 Processor -- start 2024-09-19T06:19:36.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.834+0000 7f733a000640 1 -- 172.21.15.3:0/4170787356 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f7324042030 con 0x7f733c077040 2024-09-19T06:19:36.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.834+0000 7f73467d0740 1 -- start start 2024-09-19T06:19:36.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.834+0000 7f73467d0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b269f32e40 0x55b269f33220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:36.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.834+0000 7f73467d0740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b269f33760 0x55b269f3dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:36.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.834+0000 7f73467d0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b269f3e020 0x55b269f40410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:36.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.834+0000 7f73467d0740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b269e993e0 con 0x55b269f33760 2024-09-19T06:19:36.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.834+0000 7f73467d0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b269e40d80 con 0x55b269f32e40 2024-09-19T06:19:36.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.834+0000 7f73467d0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b269e953a0 con 0x55b269f3e020 2024-09-19T06:19:36.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.835+0000 7f7341c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b269f32e40 0x55b269f33220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:36.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.835+0000 7f7341200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b269f33760 0x55b269f3dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:36.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.835+0000 7f7341c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b269f32e40 0x55b269f33220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:41068/0 (socket says 172.21.15.3:41068) 2024-09-19T06:19:36.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.835+0000 7f7341c00640 1 -- 172.21.15.3:0/2732183243 learned_addr learned my addr 172.21.15.3:0/2732183243 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:36.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.835+0000 7f7333e00640 1 --2- 172.21.15.3:0/2732183243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b269f3e020 0x55b269f40410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:36.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.835+0000 7f7341c00640 1 -- 172.21.15.3:0/2732183243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b269f3e020 msgr2=0x55b269f40410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:36.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.835+0000 7f7341c00640 1 --2- 172.21.15.3:0/2732183243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b269f3e020 0x55b269f40410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.835+0000 7f7341c00640 1 -- 172.21.15.3:0/2732183243 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b269f33760 msgr2=0x55b269f3dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:36.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.835+0000 7f7341c00640 1 --2- 172.21.15.3:0/2732183243 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b269f33760 0x55b269f3dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.835+0000 7f7341c00640 1 -- 172.21.15.3:0/2732183243 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b269e5fae0 con 0x55b269f32e40 2024-09-19T06:19:36.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.835+0000 7f7341200640 1 --2- 172.21.15.3:0/2732183243 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b269f33760 0x55b269f3dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:36.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.836+0000 7f7341c00640 1 --2- 172.21.15.3:0/2732183243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b269f32e40 0x55b269f33220 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7334011780 tx=0x7f7334011c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3b96d5e369472e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:36.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.836+0000 7f733a000640 1 --2- 172.21.15.3:0/4170787356 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f73200a3430 0x7f73200a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:36.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.836+0000 7f733a000640 1 -- 172.21.15.3:0/4170787356 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f73240effc0 con 0x7f733c077040 2024-09-19T06:19:36.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.836+0000 7f7332000640 1 -- 172.21.15.3:0/2732183243 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733400fae0 con 0x55b269f32e40 2024-09-19T06:19:36.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.836+0000 7f7332000640 1 -- 172.21.15.3:0/2732183243 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7334011e90 con 0x55b269f32e40 2024-09-19T06:19:36.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.836+0000 7f7332000640 1 -- 172.21.15.3:0/2732183243 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733401a650 con 0x55b269f32e40 2024-09-19T06:19:36.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.836+0000 7f7341200640 1 --2- 172.21.15.3:0/4170787356 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f73200a3430 0x7f73200a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:36.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.837+0000 7f73467d0740 1 -- 172.21.15.3:0/2732183243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b269f32e40 msgr2=0x55b269f33220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:36.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.837+0000 7f73467d0740 1 --2- 172.21.15.3:0/2732183243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b269f32e40 0x55b269f33220 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7334011780 tx=0x7f7334011c40 comp rx=0 tx=0).stop 2024-09-19T06:19:36.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.837+0000 7f7341200640 1 --2- 172.21.15.3:0/4170787356 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f73200a3430 0x7f73200a58f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55b269f30230 tx=0x7f732c005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:36.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.837+0000 7f73467d0740 1 -- 172.21.15.3:0/2732183243 shutdown_connections 2024-09-19T06:19:36.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.837+0000 7f73467d0740 1 --2- 172.21.15.3:0/2732183243 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b269f3e020 0x55b269f40410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.837+0000 7f73467d0740 1 --2- 172.21.15.3:0/2732183243 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b269f33760 0x55b269f3dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.837+0000 7f73467d0740 1 --2- 172.21.15.3:0/2732183243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b269f32e40 0x55b269f33220 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.837+0000 7f73467d0740 1 -- 172.21.15.3:0/2732183243 >> 172.21.15.3:0/2732183243 conn(0x55b269f2f3d0 msgr2=0x55b269f2f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:36.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.837+0000 7f73467d0740 1 -- 172.21.15.3:0/2732183243 shutdown_connections 2024-09-19T06:19:36.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.837+0000 7f73467d0740 1 -- 172.21.15.3:0/2732183243 wait complete. 2024-09-19T06:19:36.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.837+0000 7f73467d0740 1 -- start start 2024-09-19T06:19:36.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.838+0000 7f73467d0740 1 Processor -- start 2024-09-19T06:19:36.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.838+0000 7f73467d0740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b269f32e40 0x55b269f3af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:36.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.838+0000 7f73467d0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b269f33760 0x55b269f3b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:36.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.838+0000 7f73467d0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b269f3e020 0x55b269f3b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:36.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.838+0000 7f73467d0740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b269f40bf0 con 0x55b269f32e40 2024-09-19T06:19:36.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.838+0000 7f73467d0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b269e540f0 con 0x55b269f33760 2024-09-19T06:19:36.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.838+0000 7f73467d0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b269f40d70 con 0x55b269f3e020 2024-09-19T06:19:36.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.838+0000 7f73467d0740 10 client.0 _ll_register_callbacks cb 0x55b269e3bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:36.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.838+0000 7f7341c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b269f3e020 0x55b269f3b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:36.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.838+0000 7f7341200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b269f32e40 0x55b269f3af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:36.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.839+0000 7f7341200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b269f32e40 0x55b269f3af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40352/0 (socket says 172.21.15.3:40352) 2024-09-19T06:19:36.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.839+0000 7f7341c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b269f3e020 0x55b269f3b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:35894/0 (socket says 172.21.15.3:35894) 2024-09-19T06:19:36.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.839+0000 7f7341200640 1 -- 172.21.15.3:0/191671138 learned_addr learned my addr 172.21.15.3:0/191671138 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:36.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.839+0000 7f7333e00640 1 --2- 172.21.15.3:0/191671138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b269f33760 0x55b269f3b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:36.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.839+0000 7f7341c00640 1 -- 172.21.15.3:0/191671138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b269f33760 msgr2=0x55b269f3b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:36.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.839+0000 7f7341c00640 1 --2- 172.21.15.3:0/191671138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b269f33760 0x55b269f3b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.839+0000 7f7341c00640 1 -- 172.21.15.3:0/191671138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b269f32e40 msgr2=0x55b269f3af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:36.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.839+0000 7f7341c00640 1 --2- 172.21.15.3:0/191671138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b269f32e40 0x55b269f3af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.839+0000 7f7341c00640 1 -- 172.21.15.3:0/191671138 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b269c0a3c0 con 0x55b269f3e020 2024-09-19T06:19:36.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.839+0000 7f7341c00640 1 --2- 172.21.15.3:0/191671138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b269f3e020 0x55b269f3b980 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f733401c040 tx=0x7f7334004cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3435f29532bb5892 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:36.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.839+0000 7f732aa00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:19:36.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.840+0000 7f732aa00640 1 -- 172.21.15.3:0/191671138 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7334028020 con 0x55b269f3e020 2024-09-19T06:19:36.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.840+0000 7f73467d0740 1 -- 172.21.15.3:0/191671138 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7334011e90 con 0x55b269f3e020 2024-09-19T06:19:36.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.840+0000 7f732aa00640 1 -- 172.21.15.3:0/191671138 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f7334012660 con 0x55b269f3e020 2024-09-19T06:19:36.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.840+0000 7f732aa00640 1 -- 172.21.15.3:0/191671138 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7334012880 con 0x55b269f3e020 2024-09-19T06:19:36.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.840+0000 7f73467d0740 10 client.27253 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:36.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.840+0000 7f73467d0740 1 -- 172.21.15.3:0/191671138 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b269f4cc30 con 0x55b269f3e020 2024-09-19T06:19:36.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.840+0000 7f732aa00640 1 -- 172.21.15.3:0/191671138 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7334011e90 con 0x55b269f3e020 2024-09-19T06:19:36.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.840+0000 7f732aa00640 1 -- 172.21.15.3:0/191671138 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f733400f040 con 0x55b269f3e020 2024-09-19T06:19:36.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.841+0000 7f73467d0740 10 client.27253 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:36.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.841+0000 7f73467d0740 10 client.27253 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:19:36.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.841+0000 7f73467d0740 20 client.27253 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:36.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.841+0000 7f73467d0740 1 --2- 172.21.15.3:0/191671138 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55b269f4e040 0x55b269f50430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:36.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.841+0000 7f73467d0740 4 client.27253 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:36.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.841+0000 7f73467d0740 1 -- 172.21.15.3:0/191671138 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b269ea6950 con 0x55b269f4e040 2024-09-19T06:19:36.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.841+0000 7f7341200640 1 --2- 172.21.15.3:0/191671138 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55b269f4e040 0x55b269f50430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:36.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.842+0000 7f7341200640 1 --2- 172.21.15.3:0/191671138 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55b269f4e040 0x55b269f50430 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1b0092659914e0d6 server_cookie=514000aa3cd8caba in_seq=0 out_seq=0 2024-09-19T06:19:36.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.842+0000 7f732aa00640 10 client.27253 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:19:36.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.842+0000 7f732aa00640 1 -- 172.21.15.3:0/191671138 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b269ea6950 con 0x55b269f4e040 2024-09-19T06:19:36.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.842+0000 7f732aa00640 10 client.27253 handle_command_reply: tid=0 2024-09-19T06:19:36.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.842+0000 7f73467d0740 1 client.27253 shutdown 2024-09-19T06:19:36.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.843+0000 7f73467d0740 1 -- 172.21.15.3:0/191671138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b269f3e020 msgr2=0x55b269f3b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:36.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.843+0000 7f73467d0740 1 --2- 172.21.15.3:0/191671138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b269f3e020 0x55b269f3b980 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f733401c040 tx=0x7f7334004cf0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.843+0000 7f73467d0740 1 -- 172.21.15.3:0/191671138 shutdown_connections 2024-09-19T06:19:36.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.843+0000 7f73467d0740 1 --2- 172.21.15.3:0/191671138 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55b269f4e040 0x55b269f50430 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.843+0000 7f73467d0740 1 --2- 172.21.15.3:0/191671138 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b269f3e020 0x55b269f3b980 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.843+0000 7f73467d0740 1 --2- 172.21.15.3:0/191671138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b269f33760 0x55b269f3b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.843+0000 7f73467d0740 1 --2- 172.21.15.3:0/191671138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b269f32e40 0x55b269f3af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.843+0000 7f73467d0740 1 -- 172.21.15.3:0/191671138 >> 172.21.15.3:0/191671138 conn(0x55b269f2f3d0 msgr2=0x55b269f35100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:36.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.843+0000 7f732aa00640 0 client.27253 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:19:36.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.843+0000 7f73467d0740 1 -- 172.21.15.3:0/191671138 shutdown_connections 2024-09-19T06:19:36.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.843+0000 7f73467d0740 1 -- 172.21.15.3:0/191671138 wait complete. 2024-09-19T06:19:36.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.843+0000 7f73467d0740 20 client.27253 trim_cache size 0 max 16384 2024-09-19T06:19:36.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.857+0000 7f73467d0740 1 Processor -- start 2024-09-19T06:19:36.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.857+0000 7f73467d0740 1 -- start start 2024-09-19T06:19:36.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.857+0000 7f73467d0740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b269f32e40 0x55b269f55a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:36.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.857+0000 7f73467d0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b269f33760 0x55b269f55f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:36.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.857+0000 7f73467d0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b269f3e020 0x55b269f396a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:36.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.857+0000 7f73467d0740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f733c1b3e20 con 0x55b269f32e40 2024-09-19T06:19:36.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.857+0000 7f73467d0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f733c1b5960 con 0x55b269f3e020 2024-09-19T06:19:36.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.857+0000 7f73467d0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f733c1b44f0 con 0x55b269f33760 2024-09-19T06:19:36.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.858+0000 7f7341200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b269f32e40 0x55b269f55a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:36.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.858+0000 7f7333e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b269f33760 0x55b269f55f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:36.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.858+0000 7f7341200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b269f32e40 0x55b269f55a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40364/0 (socket says 172.21.15.3:40364) 2024-09-19T06:19:36.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.858+0000 7f7341200640 1 -- 172.21.15.3:0/1327944146 learned_addr learned my addr 172.21.15.3:0/1327944146 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:36.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.858+0000 7f7341c00640 1 --2- 172.21.15.3:0/1327944146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b269f3e020 0x55b269f396a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:36.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.858+0000 7f7333e00640 1 -- 172.21.15.3:0/1327944146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b269f3e020 msgr2=0x55b269f396a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:36.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.858+0000 7f7333e00640 1 --2- 172.21.15.3:0/1327944146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b269f3e020 0x55b269f396a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.858+0000 7f7333e00640 1 -- 172.21.15.3:0/1327944146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b269f32e40 msgr2=0x55b269f55a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:36.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.858+0000 7f7333e00640 1 --2- 172.21.15.3:0/1327944146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b269f32e40 0x55b269f55a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.858+0000 7f7333e00640 1 -- 172.21.15.3:0/1327944146 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b269f2f200 con 0x55b269f33760 2024-09-19T06:19:36.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.858+0000 7f7341200640 1 --2- 172.21.15.3:0/1327944146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b269f32e40 0x55b269f55a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:36.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.858+0000 7f7333e00640 1 --2- 172.21.15.3:0/1327944146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b269f33760 0x55b269f55f70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f73240ed680 tx=0x7f73240f3a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=173bd9e1d7cbfad0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:36.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.859+0000 7f7331600640 1 -- 172.21.15.3:0/1327944146 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7324049040 con 0x55b269f33760 2024-09-19T06:19:36.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.859+0000 7f7331600640 1 -- 172.21.15.3:0/1327944146 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73240dae50 con 0x55b269f33760 2024-09-19T06:19:36.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.859+0000 7f7331600640 1 -- 172.21.15.3:0/1327944146 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73240c4e80 con 0x55b269f33760 2024-09-19T06:19:36.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.859+0000 7f73467d0740 1 -- 172.21.15.3:0/1327944146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b269f33760 msgr2=0x55b269f55f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:36.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.859+0000 7f73467d0740 1 --2- 172.21.15.3:0/1327944146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b269f33760 0x55b269f55f70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f73240ed680 tx=0x7f73240f3a70 comp rx=0 tx=0).stop 2024-09-19T06:19:36.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.859+0000 7f73467d0740 1 -- 172.21.15.3:0/1327944146 shutdown_connections 2024-09-19T06:19:36.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.859+0000 7f73467d0740 1 --2- 172.21.15.3:0/1327944146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b269f3e020 0x55b269f396a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.859+0000 7f73467d0740 1 --2- 172.21.15.3:0/1327944146 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b269f33760 0x55b269f55f70 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.859+0000 7f73467d0740 1 --2- 172.21.15.3:0/1327944146 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b269f32e40 0x55b269f55a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.859+0000 7f73467d0740 1 -- 172.21.15.3:0/1327944146 >> 172.21.15.3:0/1327944146 conn(0x55b269f2f3d0 msgr2=0x55b269f2e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:36.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.859+0000 7f73467d0740 1 -- 172.21.15.3:0/1327944146 shutdown_connections 2024-09-19T06:19:36.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.859+0000 7f73467d0740 1 -- 172.21.15.3:0/1327944146 wait complete. 2024-09-19T06:19:36.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.860+0000 7f73467d0740 1 -- start start 2024-09-19T06:19:36.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.860+0000 7f73467d0740 1 Processor -- start 2024-09-19T06:19:36.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.860+0000 7f73467d0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b269f32e40 0x55b269f46440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:36.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.860+0000 7f73467d0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b269f33760 0x55b269f41770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:36.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.860+0000 7f73467d0740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b269f3e020 0x55b269f41cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:36.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.860+0000 7f73467d0740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f733c1b5290 con 0x55b269f3e020 2024-09-19T06:19:36.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.860+0000 7f73467d0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f733c1b4bc0 con 0x55b269f33760 2024-09-19T06:19:36.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.860+0000 7f73467d0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f733c1b1e20 con 0x55b269f32e40 2024-09-19T06:19:36.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.861+0000 7f73467d0740 10 client.0 _ll_register_callbacks cb 0x7f732c0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:36.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.861+0000 7f7333e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b269f33760 0x55b269f41770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:36.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.861+0000 7f7333e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b269f33760 0x55b269f41770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:41082/0 (socket says 172.21.15.3:41082) 2024-09-19T06:19:36.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.861+0000 7f7333e00640 1 -- 172.21.15.3:0/1014619578 learned_addr learned my addr 172.21.15.3:0/1014619578 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:36.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.861+0000 7f7341200640 1 --2- 172.21.15.3:0/1014619578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b269f32e40 0x55b269f46440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:36.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.861+0000 7f7341c00640 1 --2- 172.21.15.3:0/1014619578 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b269f3e020 0x55b269f41cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:36.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.861+0000 7f7333e00640 1 -- 172.21.15.3:0/1014619578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b269f32e40 msgr2=0x55b269f46440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:36.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.861+0000 7f7333e00640 1 --2- 172.21.15.3:0/1014619578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b269f32e40 0x55b269f46440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.861+0000 7f7333e00640 1 -- 172.21.15.3:0/1014619578 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b269f3e020 msgr2=0x55b269f41cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:36.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.861+0000 7f7333e00640 1 --2- 172.21.15.3:0/1014619578 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b269f3e020 0x55b269f41cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.861+0000 7f7333e00640 1 -- 172.21.15.3:0/1014619578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b269f421f0 con 0x55b269f33760 2024-09-19T06:19:36.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.861+0000 7f7333e00640 1 --2- 172.21.15.3:0/1014619578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b269f33760 0x55b269f41770 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f732403d040 tx=0x7f73240b8650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b66d6e7dbb2f32bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:36.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.861+0000 7f732aa00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:19:36.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.862+0000 7f732aa00640 1 -- 172.21.15.3:0/1014619578 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7324049040 con 0x55b269f33760 2024-09-19T06:19:36.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.862+0000 7f73467d0740 1 -- 172.21.15.3:0/1014619578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73240dae50 con 0x55b269f33760 2024-09-19T06:19:36.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.862+0000 7f732aa00640 1 -- 172.21.15.3:0/1014619578 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f73240d5120 con 0x55b269f33760 2024-09-19T06:19:36.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.862+0000 7f732aa00640 1 -- 172.21.15.3:0/1014619578 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f73240bbe00 con 0x55b269f33760 2024-09-19T06:19:36.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.862+0000 7f73467d0740 10 client.27266 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:36.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.862+0000 7f73467d0740 1 -- 172.21.15.3:0/1014619578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b269fb8730 con 0x55b269f33760 2024-09-19T06:19:36.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.862+0000 7f732aa00640 1 -- 172.21.15.3:0/1014619578 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73240dae50 con 0x55b269f33760 2024-09-19T06:19:36.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.862+0000 7f732aa00640 1 -- 172.21.15.3:0/1014619578 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f73240b8930 con 0x55b269f33760 2024-09-19T06:19:36.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.862+0000 7f73467d0740 10 client.27266 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:36.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.862+0000 7f73467d0740 10 client.27266 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:19:36.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.862+0000 7f73467d0740 20 client.27266 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:36.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.862+0000 7f73467d0740 1 --2- 172.21.15.3:0/1014619578 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55b269fb8c20 0x55b269fbb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:36.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.862+0000 7f73467d0740 4 client.27266 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:19:36.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.862+0000 7f73467d0740 1 -- 172.21.15.3:0/1014619578 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b269ea0e60 con 0x55b269fb8c20 2024-09-19T06:19:36.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.863+0000 7f7341200640 1 --2- 172.21.15.3:0/1014619578 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55b269fb8c20 0x55b269fbb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:36.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.863+0000 7f7341200640 1 --2- 172.21.15.3:0/1014619578 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55b269fb8c20 0x55b269fbb010 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=24aa51bdc110422f server_cookie=88688fee6fe2fde8 in_seq=0 out_seq=0 2024-09-19T06:19:36.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.863+0000 7f732aa00640 10 client.27266 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:19:36.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.863+0000 7f732aa00640 1 -- 172.21.15.3:0/1014619578 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b269ea0e60 con 0x55b269fb8c20 2024-09-19T06:19:36.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.864+0000 7f732aa00640 10 client.27266 handle_command_reply: tid=0 2024-09-19T06:19:36.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.864+0000 7f73467d0740 1 client.27266 shutdown 2024-09-19T06:19:36.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.864+0000 7f73467d0740 1 -- 172.21.15.3:0/1014619578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b269f33760 msgr2=0x55b269f41770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:36.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.864+0000 7f73467d0740 1 --2- 172.21.15.3:0/1014619578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b269f33760 0x55b269f41770 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f732403d040 tx=0x7f73240b8650 comp rx=0 tx=0).stop 2024-09-19T06:19:36.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.864+0000 7f73467d0740 1 -- 172.21.15.3:0/1014619578 shutdown_connections 2024-09-19T06:19:36.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.864+0000 7f73467d0740 1 --2- 172.21.15.3:0/1014619578 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55b269fb8c20 0x55b269fbb010 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.864+0000 7f73467d0740 1 --2- 172.21.15.3:0/1014619578 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b269f3e020 0x55b269f41cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.864+0000 7f73467d0740 1 --2- 172.21.15.3:0/1014619578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b269f33760 0x55b269f41770 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.864+0000 7f73467d0740 1 --2- 172.21.15.3:0/1014619578 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b269f32e40 0x55b269f46440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.864+0000 7f73467d0740 1 -- 172.21.15.3:0/1014619578 >> 172.21.15.3:0/1014619578 conn(0x55b269f2f3d0 msgr2=0x55b269f3aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:36.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.864+0000 7f732aa00640 0 client.27266 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:19:36.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.864+0000 7f73467d0740 1 -- 172.21.15.3:0/1014619578 shutdown_connections 2024-09-19T06:19:36.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.864+0000 7f73467d0740 1 -- 172.21.15.3:0/1014619578 wait complete. 2024-09-19T06:19:36.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.864+0000 7f73467d0740 20 client.27266 trim_cache size 0 max 16384 2024-09-19T06:19:36.870 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:19:36.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.865+0000 7f7342600640 1 -- 172.21.15.3:0/4170787356 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f73200a3430 msgr2=0x7f73200a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:36.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.865+0000 7f7342600640 1 --2- 172.21.15.3:0/4170787356 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f73200a3430 0x7f73200a58f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55b269f30230 tx=0x7f732c005f90 comp rx=0 tx=0).stop 2024-09-19T06:19:36.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.865+0000 7f7342600640 1 -- 172.21.15.3:0/4170787356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f733c077040 msgr2=0x7f733c1a4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:36.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.865+0000 7f7342600640 1 --2- 172.21.15.3:0/4170787356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f733c077040 0x7f733c1a4b70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7324005940 tx=0x7f7324004270 comp rx=0 tx=0).stop 2024-09-19T06:19:36.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.865+0000 7f7342600640 1 -- 172.21.15.3:0/4170787356 shutdown_connections 2024-09-19T06:19:36.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.865+0000 7f7342600640 1 --2- 172.21.15.3:0/4170787356 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f73200a3430 0x7f73200a58f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.865+0000 7f7342600640 1 --2- 172.21.15.3:0/4170787356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f733c112870 0x7f733c19e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.865+0000 7f7342600640 1 --2- 172.21.15.3:0/4170787356 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f733c077040 0x7f733c1a4b70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.865+0000 7f7342600640 1 --2- 172.21.15.3:0/4170787356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f733c076720 0x7f733c1a4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:36.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.865+0000 7f7342600640 1 -- 172.21.15.3:0/4170787356 >> 172.21.15.3:0/4170787356 conn(0x7f733c0ff910 msgr2=0x7f733c101d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:36.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.865+0000 7f7342600640 1 -- 172.21.15.3:0/4170787356 shutdown_connections 2024-09-19T06:19:36.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:36.865+0000 7f7342600640 1 -- 172.21.15.3:0/4170787356 wait complete. 2024-09-19T06:19:37.656 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:19:38.038 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:38.228 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:37 smithi003 ceph-mon[30893]: pgmap v222: 97 pgs: 97 active+clean; 4.3 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:19:38.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:37 smithi059 ceph-mon[35138]: pgmap v222: 97 pgs: 97 active+clean; 4.3 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:19:38.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:37 smithi071 ceph-mon[35662]: pgmap v222: 97 pgs: 97 active+clean; 4.3 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:19:38.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.624+0000 7f8cfca00640 1 -- 172.21.15.3:0/1586449910 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cf81047e0 msgr2=0x7f8cf8108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:38.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.624+0000 7f8cfca00640 1 --2- 172.21.15.3:0/1586449910 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cf81047e0 0x7f8cf8108830 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009900 tx=0x7f8ce002a410 comp rx=0 tx=0).stop 2024-09-19T06:19:38.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.624+0000 7f8cfca00640 1 -- 172.21.15.3:0/1586449910 shutdown_connections 2024-09-19T06:19:38.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.624+0000 7f8cfca00640 1 --2- 172.21.15.3:0/1586449910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cf8108f60 0x7f8cf8110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.624+0000 7f8cfca00640 1 --2- 172.21.15.3:0/1586449910 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cf81047e0 0x7f8cf8108830 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.624+0000 7f8cfca00640 1 --2- 172.21.15.3:0/1586449910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cf8103e30 0x7f8cf8104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.624+0000 7f8cfca00640 1 -- 172.21.15.3:0/1586449910 >> 172.21.15.3:0/1586449910 conn(0x7f8cf80ff8d0 msgr2=0x7f8cf8101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:38.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.624+0000 7f8cfca00640 1 -- 172.21.15.3:0/1586449910 shutdown_connections 2024-09-19T06:19:38.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.624+0000 7f8cfca00640 1 -- 172.21.15.3:0/1586449910 wait complete. 2024-09-19T06:19:38.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.625+0000 7f8cfca00640 1 Processor -- start 2024-09-19T06:19:38.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.625+0000 7f8cfca00640 1 -- start start 2024-09-19T06:19:38.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.625+0000 7f8cfca00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cf8103e30 0x7f8cf819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:38.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.625+0000 7f8cfca00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cf81047e0 0x7f8cf819a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:38.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.625+0000 7f8cfca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cf8108f60 0x7f8cf819ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:38.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.625+0000 7f8cfca00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf8113fc0 con 0x7f8cf8103e30 2024-09-19T06:19:38.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.625+0000 7f8cfca00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf8113e40 con 0x7f8cf8108f60 2024-09-19T06:19:38.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.625+0000 7f8cfca00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf8114140 con 0x7f8cf81047e0 2024-09-19T06:19:38.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.625+0000 7f8cf6800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cf8103e30 0x7f8cf819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:38.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.625+0000 7f8cefe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cf81047e0 0x7f8cf819a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:38.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.626+0000 7f8cf7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cf8108f60 0x7f8cf819ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:38.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.626+0000 7f8cf6800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cf8103e30 0x7f8cf819a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40404/0 (socket says 172.21.15.3:40404) 2024-09-19T06:19:38.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.626+0000 7f8cefe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cf81047e0 0x7f8cf819a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:35938/0 (socket says 172.21.15.3:35938) 2024-09-19T06:19:38.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.626+0000 7f8cf6800640 1 -- 172.21.15.3:0/1670634945 learned_addr learned my addr 172.21.15.3:0/1670634945 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:38.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.626+0000 7f8cf6800640 1 -- 172.21.15.3:0/1670634945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cf81047e0 msgr2=0x7f8cf819a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:38.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.626+0000 7f8cf6800640 1 --2- 172.21.15.3:0/1670634945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cf81047e0 0x7f8cf819a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.626+0000 7f8cf6800640 1 -- 172.21.15.3:0/1670634945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cf8108f60 msgr2=0x7f8cf819ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:38.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.626+0000 7f8cf6800640 1 --2- 172.21.15.3:0/1670634945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cf8108f60 0x7f8cf819ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.626+0000 7f8cf6800640 1 -- 172.21.15.3:0/1670634945 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf819f430 con 0x7f8cf8103e30 2024-09-19T06:19:38.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.626+0000 7f8cf6800640 1 --2- 172.21.15.3:0/1670634945 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cf8103e30 0x7f8cf819a480 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800e9f0 tx=0x7f8ce800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:38.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.626+0000 7f8cef400640 1 -- 172.21.15.3:0/1670634945 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce800cd80 con 0x7f8cf8103e30 2024-09-19T06:19:38.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.627+0000 7f8cef400640 1 -- 172.21.15.3:0/1670634945 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ce8010910 con 0x7f8cf8103e30 2024-09-19T06:19:38.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.627+0000 7f8cfca00640 1 -- 172.21.15.3:0/1670634945 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf819f720 con 0x7f8cf8103e30 2024-09-19T06:19:38.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.627+0000 7f8cef400640 1 -- 172.21.15.3:0/1670634945 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8018990 con 0x7f8cf8103e30 2024-09-19T06:19:38.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.627+0000 7f8cfca00640 1 -- 172.21.15.3:0/1670634945 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf81a7000 con 0x7f8cf8103e30 2024-09-19T06:19:38.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.630+0000 7f8cfffbc740 1 Processor -- start 2024-09-19T06:19:38.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.630+0000 7f8cef400640 1 -- 172.21.15.3:0/1670634945 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f8ce8010ac0 con 0x7f8cf8103e30 2024-09-19T06:19:38.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.630+0000 7f8cfffbc740 1 -- start start 2024-09-19T06:19:38.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.630+0000 7f8cfffbc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c58e40 0x556f67c59220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:38.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.630+0000 7f8cfffbc740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556f67c59760 0x556f67c63ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:38.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.630+0000 7f8cfffbc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f67c64020 0x556f67c66410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:38.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.630+0000 7f8cfffbc740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556f67bbf3e0 con 0x556f67c59760 2024-09-19T06:19:38.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.630+0000 7f8cfffbc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556f67b66d80 con 0x556f67c64020 2024-09-19T06:19:38.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.630+0000 7f8cfffbc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556f67bbb3a0 con 0x556f67c58e40 2024-09-19T06:19:38.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.630+0000 7f8cf6800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556f67c59760 0x556f67c63ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:38.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.630+0000 7f8cf7200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c58e40 0x556f67c59220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:38.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.630+0000 7f8cefe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f67c64020 0x556f67c66410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:38.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.630+0000 7f8cf7200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c58e40 0x556f67c59220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:35946/0 (socket says 172.21.15.3:35946) 2024-09-19T06:19:38.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.630+0000 7f8cf7200640 1 -- 172.21.15.3:0/1044396609 learned_addr learned my addr 172.21.15.3:0/1044396609 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:38.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.631+0000 7f8cf7200640 1 -- 172.21.15.3:0/1044396609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f67c64020 msgr2=0x556f67c66410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:38.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.631+0000 7f8cf7200640 1 --2- 172.21.15.3:0/1044396609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f67c64020 0x556f67c66410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.631+0000 7f8cf7200640 1 -- 172.21.15.3:0/1044396609 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556f67c59760 msgr2=0x556f67c63ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:38.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.631+0000 7f8cf7200640 1 --2- 172.21.15.3:0/1044396609 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556f67c59760 0x556f67c63ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.631+0000 7f8cf7200640 1 -- 172.21.15.3:0/1044396609 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f67b85ae0 con 0x556f67c58e40 2024-09-19T06:19:38.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.631+0000 7f8cf7200640 1 --2- 172.21.15.3:0/1044396609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c58e40 0x556f67c59220 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009f50 tx=0x7f8cf00118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20f9424294f5d3d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:38.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.631+0000 7f8ce7400640 1 -- 172.21.15.3:0/1044396609 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0004d20 con 0x556f67c58e40 2024-09-19T06:19:38.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.632+0000 7f8cef400640 1 --2- 172.21.15.3:0/1670634945 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8cdc0a33b0 0x7f8cdc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:38.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.632+0000 7f8ce7400640 1 -- 172.21.15.3:0/1044396609 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8cf0004050 con 0x556f67c58e40 2024-09-19T06:19:38.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.632+0000 7f8ce7400640 1 -- 172.21.15.3:0/1044396609 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0005280 con 0x556f67c58e40 2024-09-19T06:19:38.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.632+0000 7f8cef400640 1 -- 172.21.15.3:0/1670634945 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f8ce80d00c0 con 0x7f8cf8103e30 2024-09-19T06:19:38.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.632+0000 7f8cf6800640 1 --2- 172.21.15.3:0/1670634945 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8cdc0a33b0 0x7f8cdc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:38.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.632+0000 7f8cfffbc740 1 -- 172.21.15.3:0/1044396609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c58e40 msgr2=0x556f67c59220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:38.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.632+0000 7f8cfffbc740 1 --2- 172.21.15.3:0/1044396609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c58e40 0x556f67c59220 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009f50 tx=0x7f8cf00118d0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.632+0000 7f8cfffbc740 1 -- 172.21.15.3:0/1044396609 shutdown_connections 2024-09-19T06:19:38.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.632+0000 7f8cfffbc740 1 --2- 172.21.15.3:0/1044396609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f67c64020 0x556f67c66410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.632+0000 7f8cfffbc740 1 --2- 172.21.15.3:0/1044396609 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556f67c59760 0x556f67c63ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.632+0000 7f8cfffbc740 1 --2- 172.21.15.3:0/1044396609 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c58e40 0x556f67c59220 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.632+0000 7f8cfffbc740 1 -- 172.21.15.3:0/1044396609 >> 172.21.15.3:0/1044396609 conn(0x556f67c553d0 msgr2=0x556f67c557b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:38.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.632+0000 7f8cf6800640 1 --2- 172.21.15.3:0/1670634945 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8cdc0a33b0 0x7f8cdc0a5870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x556f67c56230 tx=0x7f8ce8000bc0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:38.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.633+0000 7f8cfffbc740 1 -- 172.21.15.3:0/1044396609 shutdown_connections 2024-09-19T06:19:38.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.633+0000 7f8cfffbc740 1 -- 172.21.15.3:0/1044396609 wait complete. 2024-09-19T06:19:38.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.633+0000 7f8cfffbc740 1 -- start start 2024-09-19T06:19:38.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.633+0000 7f8cfffbc740 1 Processor -- start 2024-09-19T06:19:38.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.634+0000 7f8cfffbc740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556f67c58e40 0x556f67c60f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:38.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.634+0000 7f8cfffbc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c59760 0x556f67c61490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:38.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.634+0000 7f8cfffbc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f67c64020 0x556f67c619d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:38.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.634+0000 7f8cfffbc740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556f67c66bf0 con 0x556f67c58e40 2024-09-19T06:19:38.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.634+0000 7f8cfffbc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556f67b7a0f0 con 0x556f67c64020 2024-09-19T06:19:38.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.634+0000 7f8cfffbc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556f67c66d70 con 0x556f67c59760 2024-09-19T06:19:38.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.634+0000 7f8cfffbc740 10 client.0 _ll_register_callbacks cb 0x556f67b61bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:38.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.634+0000 7f8cf7200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556f67c58e40 0x556f67c60f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:38.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.634+0000 7f8cf7200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556f67c58e40 0x556f67c60f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40418/0 (socket says 172.21.15.3:40418) 2024-09-19T06:19:38.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.634+0000 7f8cf7200640 1 -- 172.21.15.3:0/3097524488 learned_addr learned my addr 172.21.15.3:0/3097524488 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:38.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.634+0000 7f8cefe00640 1 --2- 172.21.15.3:0/3097524488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c59760 0x556f67c61490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:38.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.634+0000 7f8cf7200640 1 --2- 172.21.15.3:0/3097524488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f67c64020 0x556f67c619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:38.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.634+0000 7f8cf7200640 1 -- 172.21.15.3:0/3097524488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c59760 msgr2=0x556f67c61490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:38.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.635+0000 7f8cf7200640 1 --2- 172.21.15.3:0/3097524488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c59760 0x556f67c61490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.635+0000 7f8cf7200640 1 -- 172.21.15.3:0/3097524488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f67c64020 msgr2=0x556f67c619d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:38.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.635+0000 7f8cf7200640 1 --2- 172.21.15.3:0/3097524488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f67c64020 0x556f67c619d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.635+0000 7f8cf7200640 1 -- 172.21.15.3:0/3097524488 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f679303c0 con 0x556f67c58e40 2024-09-19T06:19:38.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.635+0000 7f8cefe00640 1 --2- 172.21.15.3:0/3097524488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c59760 0x556f67c61490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:38.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.635+0000 7f8cf7200640 1 --2- 172.21.15.3:0/3097524488 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556f67c58e40 0x556f67c60f50 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009250 tx=0x7f8cf0004820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf68a407e05c623 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:38.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.635+0000 7f8cdbe00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:19:38.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.635+0000 7f8cdbe00640 1 -- 172.21.15.3:0/3097524488 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf002b070 con 0x556f67c58e40 2024-09-19T06:19:38.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.635+0000 7f8cfffbc740 1 -- 172.21.15.3:0/3097524488 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cf0004050 con 0x556f67c58e40 2024-09-19T06:19:38.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.635+0000 7f8cdbe00640 1 -- 172.21.15.3:0/3097524488 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f8cf0025450 con 0x556f67c58e40 2024-09-19T06:19:38.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.636+0000 7f8cdbe00640 1 -- 172.21.15.3:0/3097524488 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8cf0025650 con 0x556f67c58e40 2024-09-19T06:19:38.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.636+0000 7f8cfffbc740 10 client.17238 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:38.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.636+0000 7f8cfffbc740 1 -- 172.21.15.3:0/3097524488 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556f67c72c80 con 0x556f67c58e40 2024-09-19T06:19:38.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.636+0000 7f8cdbe00640 1 -- 172.21.15.3:0/3097524488 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8cf0004050 con 0x556f67c58e40 2024-09-19T06:19:38.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.636+0000 7f8cdbe00640 1 -- 172.21.15.3:0/3097524488 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8cf000f640 con 0x556f67c58e40 2024-09-19T06:19:38.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.636+0000 7f8cfffbc740 10 client.17238 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:38.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.636+0000 7f8cfffbc740 10 client.17238 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:19:38.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.636+0000 7f8cfffbc740 20 client.17238 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:38.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.636+0000 7f8cfffbc740 1 --2- 172.21.15.3:0/3097524488 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x556f67c740e0 0x556f67c764d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:38.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.636+0000 7f8cfffbc740 4 client.17238 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:38.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.636+0000 7f8cfffbc740 1 -- 172.21.15.3:0/3097524488 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f67bcc950 con 0x556f67c740e0 2024-09-19T06:19:38.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.637+0000 7f8cefe00640 1 --2- 172.21.15.3:0/3097524488 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x556f67c740e0 0x556f67c764d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:38.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.637+0000 7f8cefe00640 1 --2- 172.21.15.3:0/3097524488 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x556f67c740e0 0x556f67c764d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e5edcb9b25f0a83 server_cookie=5d991147e2183d6b in_seq=0 out_seq=0 2024-09-19T06:19:38.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.637+0000 7f8cdbe00640 10 client.17238 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:19:38.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.638+0000 7f8cdbe00640 1 -- 172.21.15.3:0/3097524488 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556f67bcc950 con 0x556f67c740e0 2024-09-19T06:19:38.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.638+0000 7f8cdbe00640 10 client.17238 handle_command_reply: tid=0 2024-09-19T06:19:38.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.638+0000 7f8cfffbc740 1 client.17238 shutdown 2024-09-19T06:19:38.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.638+0000 7f8cfffbc740 1 -- 172.21.15.3:0/3097524488 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556f67c58e40 msgr2=0x556f67c60f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:38.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.638+0000 7f8cfffbc740 1 --2- 172.21.15.3:0/3097524488 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556f67c58e40 0x556f67c60f50 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009250 tx=0x7f8cf0004820 comp rx=0 tx=0).stop 2024-09-19T06:19:38.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.638+0000 7f8cfffbc740 1 -- 172.21.15.3:0/3097524488 shutdown_connections 2024-09-19T06:19:38.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.638+0000 7f8cfffbc740 1 --2- 172.21.15.3:0/3097524488 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x556f67c740e0 0x556f67c764d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.638+0000 7f8cfffbc740 1 --2- 172.21.15.3:0/3097524488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f67c64020 0x556f67c619d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.638+0000 7f8cfffbc740 1 --2- 172.21.15.3:0/3097524488 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c59760 0x556f67c61490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.638+0000 7f8cfffbc740 1 --2- 172.21.15.3:0/3097524488 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556f67c58e40 0x556f67c60f50 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.638+0000 7f8cdbe00640 0 client.17238 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:19:38.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.638+0000 7f8cfffbc740 1 -- 172.21.15.3:0/3097524488 >> 172.21.15.3:0/3097524488 conn(0x556f67c553d0 msgr2=0x556f67c5b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:38.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.639+0000 7f8cfffbc740 1 -- 172.21.15.3:0/3097524488 shutdown_connections 2024-09-19T06:19:38.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.639+0000 7f8cfffbc740 1 -- 172.21.15.3:0/3097524488 wait complete. 2024-09-19T06:19:38.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.639+0000 7f8cfffbc740 20 client.17238 trim_cache size 0 max 16384 2024-09-19T06:19:38.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.653+0000 7f8cfffbc740 1 Processor -- start 2024-09-19T06:19:38.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.653+0000 7f8cfffbc740 1 -- start start 2024-09-19T06:19:38.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.653+0000 7f8cfffbc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f67c58e40 0x556f67c60830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:38.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.653+0000 7f8cfffbc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c59760 0x556f67c5af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:38.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.653+0000 7f8cfffbc740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556f67c64020 0x556f67c7bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:38.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.653+0000 7f8cfffbc740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81afab0 con 0x556f67c64020 2024-09-19T06:19:38.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.653+0000 7f8cfffbc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81b15f0 con 0x556f67c58e40 2024-09-19T06:19:38.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.653+0000 7f8cfffbc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81b0180 con 0x556f67c59760 2024-09-19T06:19:38.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.653+0000 7f8cf7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f67c58e40 0x556f67c60830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:38.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.653+0000 7f8cefe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c59760 0x556f67c5af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:38.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.653+0000 7f8cf7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f67c58e40 0x556f67c60830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:41126/0 (socket says 172.21.15.3:41126) 2024-09-19T06:19:38.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.653+0000 7f8cf7200640 1 -- 172.21.15.3:0/3736243687 learned_addr learned my addr 172.21.15.3:0/3736243687 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:38.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.653+0000 7f8cefe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c59760 0x556f67c5af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:35956/0 (socket says 172.21.15.3:35956) 2024-09-19T06:19:38.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.653+0000 7f8cf7200640 1 --2- 172.21.15.3:0/3736243687 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556f67c64020 0x556f67c7bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:38.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.654+0000 7f8cefe00640 1 -- 172.21.15.3:0/3736243687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f67c58e40 msgr2=0x556f67c60830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:38.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.654+0000 7f8cefe00640 1 --2- 172.21.15.3:0/3736243687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f67c58e40 0x556f67c60830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.654+0000 7f8cefe00640 1 -- 172.21.15.3:0/3736243687 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556f67c64020 msgr2=0x556f67c7bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:38.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.654+0000 7f8cefe00640 1 --2- 172.21.15.3:0/3736243687 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556f67c64020 0x556f67c7bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.654+0000 7f8cefe00640 1 -- 172.21.15.3:0/3736243687 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f67c59590 con 0x556f67c59760 2024-09-19T06:19:38.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.654+0000 7f8cefe00640 1 --2- 172.21.15.3:0/3736243687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c59760 0x556f67c5af60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0005940 tx=0x7f8ce00319a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9945a9aaf3f8ba3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:38.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.654+0000 7f8ce6a00640 1 -- 172.21.15.3:0/3736243687 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0035040 con 0x556f67c59760 2024-09-19T06:19:38.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.654+0000 7f8ce6a00640 1 -- 172.21.15.3:0/3736243687 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ce0005500 con 0x556f67c59760 2024-09-19T06:19:38.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.654+0000 7f8ce6a00640 1 -- 172.21.15.3:0/3736243687 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0004a40 con 0x556f67c59760 2024-09-19T06:19:38.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.655+0000 7f8cfffbc740 1 -- 172.21.15.3:0/3736243687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c59760 msgr2=0x556f67c5af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:38.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.655+0000 7f8cfffbc740 1 --2- 172.21.15.3:0/3736243687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c59760 0x556f67c5af60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0005940 tx=0x7f8ce00319a0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.655+0000 7f8cfffbc740 1 -- 172.21.15.3:0/3736243687 shutdown_connections 2024-09-19T06:19:38.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.655+0000 7f8cfffbc740 1 --2- 172.21.15.3:0/3736243687 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556f67c64020 0x556f67c7bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.655+0000 7f8cfffbc740 1 --2- 172.21.15.3:0/3736243687 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c59760 0x556f67c5af60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.655+0000 7f8cfffbc740 1 --2- 172.21.15.3:0/3736243687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f67c58e40 0x556f67c60830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.655+0000 7f8cfffbc740 1 -- 172.21.15.3:0/3736243687 >> 172.21.15.3:0/3736243687 conn(0x556f67c553d0 msgr2=0x556f67c5a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:38.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.655+0000 7f8cfffbc740 1 -- 172.21.15.3:0/3736243687 shutdown_connections 2024-09-19T06:19:38.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.655+0000 7f8cfffbc740 1 -- 172.21.15.3:0/3736243687 wait complete. 2024-09-19T06:19:38.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.656+0000 7f8cfffbc740 1 -- start start 2024-09-19T06:19:38.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.656+0000 7f8cfffbc740 1 Processor -- start 2024-09-19T06:19:38.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.657+0000 7f8cfffbc740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556f67c58e40 0x556f67c6c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:38.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.657+0000 7f8cfffbc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c59760 0x556f67c6c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:38.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.657+0000 7f8cfffbc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f67c64020 0x556f67c678f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:38.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.657+0000 7f8cfffbc740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81b0f20 con 0x556f67c58e40 2024-09-19T06:19:38.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.657+0000 7f8cfffbc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81b0850 con 0x556f67c64020 2024-09-19T06:19:38.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.657+0000 7f8cfffbc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81adab0 con 0x556f67c59760 2024-09-19T06:19:38.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.657+0000 7f8cfffbc740 10 client.0 _ll_register_callbacks cb 0x7f8ce8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:38.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.657+0000 7f8cf7200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556f67c58e40 0x556f67c6c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:38.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.657+0000 7f8cefe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c59760 0x556f67c6c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:38.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.657+0000 7f8cf7200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556f67c58e40 0x556f67c6c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40438/0 (socket says 172.21.15.3:40438) 2024-09-19T06:19:38.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.657+0000 7f8cf7200640 1 -- 172.21.15.3:0/3539005630 learned_addr learned my addr 172.21.15.3:0/3539005630 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:38.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.657+0000 7f8cf7200640 1 --2- 172.21.15.3:0/3539005630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f67c64020 0x556f67c678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:38.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.657+0000 7f8cefe00640 1 -- 172.21.15.3:0/3539005630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f67c64020 msgr2=0x556f67c678f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:38.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.657+0000 7f8cefe00640 1 --2- 172.21.15.3:0/3539005630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f67c64020 0x556f67c678f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.657+0000 7f8cefe00640 1 -- 172.21.15.3:0/3539005630 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556f67c58e40 msgr2=0x556f67c6c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:38.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.657+0000 7f8cefe00640 1 --2- 172.21.15.3:0/3539005630 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556f67c58e40 0x556f67c6c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.657+0000 7f8cefe00640 1 -- 172.21.15.3:0/3539005630 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f67c68120 con 0x556f67c59760 2024-09-19T06:19:38.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.657+0000 7f8cf7200640 1 --2- 172.21.15.3:0/3539005630 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556f67c58e40 0x556f67c6c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:38.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.658+0000 7f8cefe00640 1 --2- 172.21.15.3:0/3539005630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c59760 0x556f67c6c8d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x556f67c72c50 tx=0x7f8ce0009850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6c9be3672aa9e1f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:38.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.658+0000 7f8cdbe00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:19:38.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.658+0000 7f8cdbe00640 1 -- 172.21.15.3:0/3539005630 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce0056020 con 0x556f67c59760 2024-09-19T06:19:38.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.658+0000 7f8cfffbc740 1 -- 172.21.15.3:0/3539005630 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ce0005500 con 0x556f67c59760 2024-09-19T06:19:38.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.658+0000 7f8cdbe00640 1 -- 172.21.15.3:0/3539005630 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f8ce00035f0 con 0x556f67c59760 2024-09-19T06:19:38.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.658+0000 7f8cdbe00640 1 -- 172.21.15.3:0/3539005630 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8ce0035030 con 0x556f67c59760 2024-09-19T06:19:38.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.658+0000 7f8cfffbc740 10 client.27277 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:38.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.658+0000 7f8cfffbc740 1 -- 172.21.15.3:0/3539005630 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556f67cde7e0 con 0x556f67c59760 2024-09-19T06:19:38.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.659+0000 7f8cdbe00640 1 -- 172.21.15.3:0/3539005630 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ce0005500 con 0x556f67c59760 2024-09-19T06:19:38.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.659+0000 7f8cdbe00640 1 -- 172.21.15.3:0/3539005630 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8ce00486a0 con 0x556f67c59760 2024-09-19T06:19:38.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.659+0000 7f8cfffbc740 10 client.27277 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:38.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.659+0000 7f8cfffbc740 10 client.27277 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:19:38.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.659+0000 7f8cfffbc740 20 client.27277 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:38.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.659+0000 7f8cfffbc740 1 --2- 172.21.15.3:0/3539005630 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x556f67cdeed0 0x556f67ce12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:38.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.659+0000 7f8cfffbc740 4 client.27277 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:19:38.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.659+0000 7f8cfffbc740 1 -- 172.21.15.3:0/3539005630 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556f67bc6e60 con 0x556f67cdeed0 2024-09-19T06:19:38.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.659+0000 7f8cf7200640 1 --2- 172.21.15.3:0/3539005630 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x556f67cdeed0 0x556f67ce12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:38.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.660+0000 7f8cf7200640 1 --2- 172.21.15.3:0/3539005630 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x556f67cdeed0 0x556f67ce12f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8a0c825ace5456ce server_cookie=d0fc7be69c662afc in_seq=0 out_seq=0 2024-09-19T06:19:38.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.660+0000 7f8cdbe00640 10 client.27277 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:19:38.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.660+0000 7f8cdbe00640 1 -- 172.21.15.3:0/3539005630 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556f67bc6e60 con 0x556f67cdeed0 2024-09-19T06:19:38.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.660+0000 7f8cdbe00640 10 client.27277 handle_command_reply: tid=0 2024-09-19T06:19:38.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.660+0000 7f8cfffbc740 1 client.27277 shutdown 2024-09-19T06:19:38.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.660+0000 7f8cfffbc740 1 -- 172.21.15.3:0/3539005630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c59760 msgr2=0x556f67c6c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:38.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.660+0000 7f8cfffbc740 1 --2- 172.21.15.3:0/3539005630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c59760 0x556f67c6c8d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x556f67c72c50 tx=0x7f8ce0009850 comp rx=0 tx=0).stop 2024-09-19T06:19:38.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.660+0000 7f8cfffbc740 1 -- 172.21.15.3:0/3539005630 shutdown_connections 2024-09-19T06:19:38.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.660+0000 7f8cfffbc740 1 --2- 172.21.15.3:0/3539005630 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x556f67cdeed0 0x556f67ce12f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.660+0000 7f8cfffbc740 1 --2- 172.21.15.3:0/3539005630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556f67c64020 0x556f67c678f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.660+0000 7f8cfffbc740 1 --2- 172.21.15.3:0/3539005630 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556f67c59760 0x556f67c6c8d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.660+0000 7f8cfffbc740 1 --2- 172.21.15.3:0/3539005630 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556f67c58e40 0x556f67c6c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.660+0000 7f8cdbe00640 0 client.27277 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:19:38.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.660+0000 7f8cfffbc740 1 -- 172.21.15.3:0/3539005630 >> 172.21.15.3:0/3539005630 conn(0x556f67c553d0 msgr2=0x556f67c5b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:38.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.661+0000 7f8cfffbc740 1 -- 172.21.15.3:0/3539005630 shutdown_connections 2024-09-19T06:19:38.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.661+0000 7f8cfffbc740 1 -- 172.21.15.3:0/3539005630 wait complete. 2024-09-19T06:19:38.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.661+0000 7f8cfffbc740 20 client.27277 trim_cache size 0 max 16384 2024-09-19T06:19:38.665 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:19:38.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.661+0000 7f8cfca00640 1 -- 172.21.15.3:0/1670634945 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8cdc0a33b0 msgr2=0x7f8cdc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:38.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.661+0000 7f8cfca00640 1 --2- 172.21.15.3:0/1670634945 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8cdc0a33b0 0x7f8cdc0a5870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x556f67c56230 tx=0x7f8ce8000bc0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.661+0000 7f8cfca00640 1 -- 172.21.15.3:0/1670634945 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cf8103e30 msgr2=0x7f8cf819a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:38.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.661+0000 7f8cfca00640 1 --2- 172.21.15.3:0/1670634945 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cf8103e30 0x7f8cf819a480 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800e9f0 tx=0x7f8ce800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.661+0000 7f8cfca00640 1 -- 172.21.15.3:0/1670634945 shutdown_connections 2024-09-19T06:19:38.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.661+0000 7f8cfca00640 1 --2- 172.21.15.3:0/1670634945 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8cdc0a33b0 0x7f8cdc0a5870 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.661+0000 7f8cfca00640 1 --2- 172.21.15.3:0/1670634945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8cf8108f60 0x7f8cf819ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.661+0000 7f8cfca00640 1 --2- 172.21.15.3:0/1670634945 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8cf81047e0 0x7f8cf819a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.661+0000 7f8cfca00640 1 --2- 172.21.15.3:0/1670634945 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8cf8103e30 0x7f8cf819a480 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:38.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.661+0000 7f8cfca00640 1 -- 172.21.15.3:0/1670634945 >> 172.21.15.3:0/1670634945 conn(0x7f8cf80ff8d0 msgr2=0x7f8cf8100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:38.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.662+0000 7f8cfca00640 1 -- 172.21.15.3:0/1670634945 shutdown_connections 2024-09-19T06:19:38.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:38.662+0000 7f8cfca00640 1 -- 172.21.15.3:0/1670634945 wait complete. 2024-09-19T06:19:39.598 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:19:39.980 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:40.275 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:39 smithi003 ceph-mon[30893]: pgmap v223: 97 pgs: 97 active+clean; 4.5 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-19T06:19:40.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:39 smithi059 ceph-mon[35138]: pgmap v223: 97 pgs: 97 active+clean; 4.5 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-19T06:19:40.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:39 smithi071 ceph-mon[35662]: pgmap v223: 97 pgs: 97 active+clean; 4.5 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-19T06:19:40.433 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.432+0000 7f0009000640 1 -- 172.21.15.3:0/682427925 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0004077040 msgr2=0x7f0004112430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:40.433 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.432+0000 7f0009000640 1 --2- 172.21.15.3:0/682427925 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0004077040 0x7f0004112430 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7effec009900 tx=0x7effec02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.433 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.432+0000 7f0009000640 1 -- 172.21.15.3:0/682427925 shutdown_connections 2024-09-19T06:19:40.433 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.432+0000 7f0009000640 1 --2- 172.21.15.3:0/682427925 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0004112970 0x7f0004114d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.433 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.432+0000 7f0009000640 1 --2- 172.21.15.3:0/682427925 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0004077040 0x7f0004112430 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.433 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.432+0000 7f0009000640 1 --2- 172.21.15.3:0/682427925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0004076720 0x7f0004076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.434 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.432+0000 7f0009000640 1 -- 172.21.15.3:0/682427925 >> 172.21.15.3:0/682427925 conn(0x7f00040ff970 msgr2=0x7f0004101d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:40.434 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.432+0000 7f0009000640 1 -- 172.21.15.3:0/682427925 shutdown_connections 2024-09-19T06:19:40.434 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.432+0000 7f0009000640 1 -- 172.21.15.3:0/682427925 wait complete. 2024-09-19T06:19:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.433+0000 7f0009000640 1 Processor -- start 2024-09-19T06:19:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.433+0000 7f0009000640 1 -- start start 2024-09-19T06:19:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.433+0000 7f0009000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0004076720 0x7f00041a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.433+0000 7f0009000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0004077040 0x7f00041a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.433+0000 7f0009000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0004112970 0x7f000419e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.433+0000 7f0009000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0004118520 con 0x7f0004112970 2024-09-19T06:19:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.433+0000 7f0009000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f00041183a0 con 0x7f0004076720 2024-09-19T06:19:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.433+0000 7f0009000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f00041186a0 con 0x7f0004077040 2024-09-19T06:19:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.434+0000 7f0002800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0004112970 0x7f000419e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.434+0000 7f0001e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0004076720 0x7f00041a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.434+0000 7f0002800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0004112970 0x7f000419e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40458/0 (socket says 172.21.15.3:40458) 2024-09-19T06:19:40.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.434+0000 7f0002800640 1 -- 172.21.15.3:0/2445050989 learned_addr learned my addr 172.21.15.3:0/2445050989 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.434+0000 7efffbe00640 1 --2- 172.21.15.3:0/2445050989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0004077040 0x7f00041a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.434+0000 7f0002800640 1 -- 172.21.15.3:0/2445050989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0004077040 msgr2=0x7f00041a4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.434+0000 7f0002800640 1 --2- 172.21.15.3:0/2445050989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0004077040 0x7f00041a4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.434+0000 7f0002800640 1 -- 172.21.15.3:0/2445050989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0004076720 msgr2=0x7f00041a46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.434+0000 7f0002800640 1 --2- 172.21.15.3:0/2445050989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0004076720 0x7f00041a46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.434+0000 7f0002800640 1 -- 172.21.15.3:0/2445050989 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000419f020 con 0x7f0004112970 2024-09-19T06:19:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.434+0000 7f0001e00640 1 --2- 172.21.15.3:0/2445050989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0004076720 0x7f00041a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.434+0000 7f0002800640 1 --2- 172.21.15.3:0/2445050989 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0004112970 0x7f000419e850 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7efffc00eb40 tx=0x7efffc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.435+0000 7efffaa00640 1 -- 172.21.15.3:0/2445050989 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc004b20 con 0x7f0004112970 2024-09-19T06:19:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.435+0000 7efffaa00640 1 -- 172.21.15.3:0/2445050989 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efffc004cc0 con 0x7f0004112970 2024-09-19T06:19:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.435+0000 7f0009000640 1 -- 172.21.15.3:0/2445050989 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f000419f310 con 0x7f0004112970 2024-09-19T06:19:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.435+0000 7efffaa00640 1 -- 172.21.15.3:0/2445050989 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc010850 con 0x7f0004112970 2024-09-19T06:19:40.437 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.435+0000 7f0009000640 1 -- 172.21.15.3:0/2445050989 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00041ab530 con 0x7f0004112970 2024-09-19T06:19:40.438 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.438+0000 7f000bde4740 1 Processor -- start 2024-09-19T06:19:40.439 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.438+0000 7efffaa00640 1 -- 172.21.15.3:0/2445050989 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7efffc005020 con 0x7f0004112970 2024-09-19T06:19:40.439 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.438+0000 7f000bde4740 1 -- start start 2024-09-19T06:19:40.440 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.438+0000 7f000bde4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556eae0441e0 0x556eae0445c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.438+0000 7f000bde4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae044b00 0x556eae04ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.438+0000 7f000bde4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae04f3a0 0x556eae051790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.438+0000 7f000bde4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556eadfaa100 con 0x556eae04f3a0 2024-09-19T06:19:40.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.438+0000 7f000bde4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556eadf521b0 con 0x556eae044b00 2024-09-19T06:19:40.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.438+0000 7f000bde4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556eadfa60c0 con 0x556eae0441e0 2024-09-19T06:19:40.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.439+0000 7f0001e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae044b00 0x556eae04ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.439+0000 7efffbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556eae0441e0 0x556eae0445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.439+0000 7f0001e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae044b00 0x556eae04ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:41168/0 (socket says 172.21.15.3:41168) 2024-09-19T06:19:40.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.439+0000 7f0001e00640 1 -- 172.21.15.3:0/2390239228 learned_addr learned my addr 172.21.15.3:0/2390239228 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:40.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.439+0000 7efffbe00640 1 --2- 172.21.15.3:0/2390239228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae04f3a0 0x556eae051790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.439+0000 7f0001e00640 1 -- 172.21.15.3:0/2390239228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556eae0441e0 msgr2=0x556eae0445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:40.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.439+0000 7f0001e00640 1 --2- 172.21.15.3:0/2390239228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556eae0441e0 0x556eae0445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.439+0000 7f0001e00640 1 -- 172.21.15.3:0/2390239228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae04f3a0 msgr2=0x556eae051790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.439+0000 7f0001e00640 1 --2- 172.21.15.3:0/2390239228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae04f3a0 0x556eae051790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.439+0000 7f0001e00640 1 -- 172.21.15.3:0/2390239228 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556eadcbd210 con 0x556eae044b00 2024-09-19T06:19:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.439+0000 7efffbe00640 1 --2- 172.21.15.3:0/2390239228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae04f3a0 0x556eae051790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.439+0000 7efffaa00640 1 --2- 172.21.15.3:0/2445050989 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7effe80a33b0 0x7effe80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.439+0000 7f0001e00640 1 --2- 172.21.15.3:0/2390239228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae044b00 0x556eae04ee60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efff4010480 tx=0x7efff4010940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63640f34eeb5f0de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.439+0000 7efffaa00640 1 -- 172.21.15.3:0/2445050989 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7efffc0d0430 con 0x7f0004112970 2024-09-19T06:19:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.440+0000 7efffbe00640 1 --2- 172.21.15.3:0/2445050989 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7effe80a33b0 0x7effe80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.440+0000 7efff3400640 1 -- 172.21.15.3:0/2390239228 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff4011760 con 0x556eae044b00 2024-09-19T06:19:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.440+0000 7efff3400640 1 -- 172.21.15.3:0/2390239228 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efff4011de0 con 0x556eae044b00 2024-09-19T06:19:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.440+0000 7efff3400640 1 -- 172.21.15.3:0/2390239228 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff400e430 con 0x556eae044b00 2024-09-19T06:19:40.445 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.440+0000 7f000bde4740 1 -- 172.21.15.3:0/2390239228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae044b00 msgr2=0x556eae04ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:40.445 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.440+0000 7f000bde4740 1 --2- 172.21.15.3:0/2390239228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae044b00 0x556eae04ee60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efff4010480 tx=0x7efff4010940 comp rx=0 tx=0).stop 2024-09-19T06:19:40.445 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.440+0000 7efffbe00640 1 --2- 172.21.15.3:0/2445050989 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7effe80a33b0 0x7effe80a5870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7effec000c00 tx=0x7effec02a3f0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.440+0000 7f000bde4740 1 -- 172.21.15.3:0/2390239228 shutdown_connections 2024-09-19T06:19:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.440+0000 7f000bde4740 1 --2- 172.21.15.3:0/2390239228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae04f3a0 0x556eae051790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.440+0000 7f000bde4740 1 --2- 172.21.15.3:0/2390239228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae044b00 0x556eae04ee60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.440+0000 7f000bde4740 1 --2- 172.21.15.3:0/2390239228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556eae0441e0 0x556eae0445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.440+0000 7f000bde4740 1 -- 172.21.15.3:0/2390239228 >> 172.21.15.3:0/2390239228 conn(0x556eae040750 msgr2=0x556eae040b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.441+0000 7f000bde4740 1 -- 172.21.15.3:0/2390239228 shutdown_connections 2024-09-19T06:19:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.441+0000 7f000bde4740 1 -- 172.21.15.3:0/2390239228 wait complete. 2024-09-19T06:19:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.441+0000 7f000bde4740 1 -- start start 2024-09-19T06:19:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.441+0000 7f000bde4740 1 Processor -- start 2024-09-19T06:19:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.442+0000 7f000bde4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae0441e0 0x556eae04c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.442+0000 7f000bde4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556eae044b00 0x556eae04c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.442+0000 7f000bde4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae04f3a0 0x556eae04cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.442+0000 7f000bde4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556eae051f70 con 0x556eae04f3a0 2024-09-19T06:19:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.442+0000 7f000bde4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556eadf33090 con 0x556eae0441e0 2024-09-19T06:19:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.442+0000 7f000bde4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556eae0520f0 con 0x556eae044b00 2024-09-19T06:19:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.442+0000 7f000bde4740 10 client.0 _ll_register_callbacks cb 0x556eadf87f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.442+0000 7f0002800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae04f3a0 0x556eae04cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.442+0000 7f0001e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae0441e0 0x556eae04c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.442+0000 7f0002800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae04f3a0 0x556eae04cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40472/0 (socket says 172.21.15.3:40472) 2024-09-19T06:19:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.442+0000 7f0002800640 1 -- 172.21.15.3:0/1041393949 learned_addr learned my addr 172.21.15.3:0/1041393949 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.442+0000 7f0001e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae0441e0 0x556eae04c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:41172/0 (socket says 172.21.15.3:41172) 2024-09-19T06:19:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.442+0000 7efffbe00640 1 --2- 172.21.15.3:0/1041393949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556eae044b00 0x556eae04c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.442+0000 7f0002800640 1 -- 172.21.15.3:0/1041393949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556eae044b00 msgr2=0x556eae04c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.442+0000 7f0002800640 1 --2- 172.21.15.3:0/1041393949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556eae044b00 0x556eae04c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.442+0000 7f0002800640 1 -- 172.21.15.3:0/1041393949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae0441e0 msgr2=0x556eae04c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:40.447 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.442+0000 7f0002800640 1 --2- 172.21.15.3:0/1041393949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae0441e0 0x556eae04c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.442+0000 7f0002800640 1 -- 172.21.15.3:0/1041393949 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556eadd89620 con 0x556eae04f3a0 2024-09-19T06:19:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.443+0000 7f0002800640 1 --2- 172.21.15.3:0/1041393949 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae04f3a0 0x556eae04cde0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7efffc09c650 tx=0x7efffc09c020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7b6b8fb9bb49a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.443+0000 7effe7e00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:19:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.443+0000 7effe7e00640 1 -- 172.21.15.3:0/1041393949 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc09c6c0 con 0x556eae04f3a0 2024-09-19T06:19:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.443+0000 7effe7e00640 1 -- 172.21.15.3:0/1041393949 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7efffc0b0be0 con 0x556eae04f3a0 2024-09-19T06:19:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.443+0000 7f000bde4740 1 -- 172.21.15.3:0/1041393949 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efff4011de0 con 0x556eae04f3a0 2024-09-19T06:19:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.443+0000 7effe7e00640 1 -- 172.21.15.3:0/1041393949 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efffc0a0a70 con 0x556eae04f3a0 2024-09-19T06:19:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.443+0000 7f000bde4740 10 client.17256 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.443+0000 7f000bde4740 1 -- 172.21.15.3:0/1041393949 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556eae05db60 con 0x556eae04f3a0 2024-09-19T06:19:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.443+0000 7effe7e00640 1 -- 172.21.15.3:0/1041393949 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efff4011de0 con 0x556eae04f3a0 2024-09-19T06:19:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.443+0000 7effe7e00640 1 -- 172.21.15.3:0/1041393949 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7efffc0d0070 con 0x556eae04f3a0 2024-09-19T06:19:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.443+0000 7f000bde4740 10 client.17256 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.443+0000 7f000bde4740 10 client.17256 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:40.449 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.444+0000 7f000bde4740 20 client.17256 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:40.449 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.444+0000 7f000bde4740 1 --2- 172.21.15.3:0/1041393949 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x556eae05f020 0x556eae061410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.449 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.444+0000 7f000bde4740 4 client.17256 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:40.449 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.444+0000 7f000bde4740 1 -- 172.21.15.3:0/1041393949 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556eadfb7830 con 0x556eae05f020 2024-09-19T06:19:40.449 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.444+0000 7f0001e00640 1 --2- 172.21.15.3:0/1041393949 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x556eae05f020 0x556eae061410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.449 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.445+0000 7f0001e00640 1 --2- 172.21.15.3:0/1041393949 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x556eae05f020 0x556eae061410 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6277d13846b3cf6f server_cookie=72e00f1c5c81b1d1 in_seq=0 out_seq=0 2024-09-19T06:19:40.449 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.445+0000 7effe7e00640 10 client.17256 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:40.450 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.445+0000 7effe7e00640 1 -- 172.21.15.3:0/1041393949 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556eadfb7830 con 0x556eae05f020 2024-09-19T06:19:40.450 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.445+0000 7effe7e00640 10 client.17256 handle_command_reply: tid=0 2024-09-19T06:19:40.450 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.445+0000 7f000bde4740 1 client.17256 shutdown 2024-09-19T06:19:40.450 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.446+0000 7f000bde4740 1 -- 172.21.15.3:0/1041393949 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae04f3a0 msgr2=0x556eae04cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:40.450 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.446+0000 7f000bde4740 1 --2- 172.21.15.3:0/1041393949 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae04f3a0 0x556eae04cde0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7efffc09c650 tx=0x7efffc09c020 comp rx=0 tx=0).stop 2024-09-19T06:19:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.446+0000 7f000bde4740 1 -- 172.21.15.3:0/1041393949 shutdown_connections 2024-09-19T06:19:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.446+0000 7f000bde4740 1 --2- 172.21.15.3:0/1041393949 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x556eae05f020 0x556eae061410 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.446+0000 7f000bde4740 1 --2- 172.21.15.3:0/1041393949 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae04f3a0 0x556eae04cde0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.446+0000 7f000bde4740 1 --2- 172.21.15.3:0/1041393949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556eae044b00 0x556eae04c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.446+0000 7f000bde4740 1 --2- 172.21.15.3:0/1041393949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae0441e0 0x556eae04c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.446+0000 7f000bde4740 1 -- 172.21.15.3:0/1041393949 >> 172.21.15.3:0/1041393949 conn(0x556eae040750 msgr2=0x556eae046460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.446+0000 7effe7e00640 0 client.17256 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.446+0000 7f000bde4740 1 -- 172.21.15.3:0/1041393949 shutdown_connections 2024-09-19T06:19:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.446+0000 7f000bde4740 1 -- 172.21.15.3:0/1041393949 wait complete. 2024-09-19T06:19:40.451 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.446+0000 7f000bde4740 20 client.17256 trim_cache size 0 max 16384 2024-09-19T06:19:40.462 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.461+0000 7f000bde4740 1 Processor -- start 2024-09-19T06:19:40.462 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.461+0000 7f000bde4740 1 -- start start 2024-09-19T06:19:40.462 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.461+0000 7f000bde4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae0441e0 0x556eae066ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.462+0000 7f000bde4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556eae044b00 0x556eae067220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.462+0000 7f000bde4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae04f3a0 0x556eae03f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.462+0000 7f000bde4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f00041b3fa0 con 0x556eae04f3a0 2024-09-19T06:19:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.462+0000 7f000bde4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f00041b5ae0 con 0x556eae0441e0 2024-09-19T06:19:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.462+0000 7f000bde4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f00041b4670 con 0x556eae044b00 2024-09-19T06:19:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.462+0000 7f0001e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae0441e0 0x556eae066ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.463 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.462+0000 7efffbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556eae044b00 0x556eae067220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.462+0000 7f0001e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae0441e0 0x556eae066ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:41178/0 (socket says 172.21.15.3:41178) 2024-09-19T06:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.462+0000 7f0001e00640 1 -- 172.21.15.3:0/2264402237 learned_addr learned my addr 172.21.15.3:0/2264402237 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.462+0000 7efffbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556eae044b00 0x556eae067220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:36004/0 (socket says 172.21.15.3:36004) 2024-09-19T06:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.462+0000 7f0002800640 1 --2- 172.21.15.3:0/2264402237 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae04f3a0 0x556eae03f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.462+0000 7f0001e00640 1 -- 172.21.15.3:0/2264402237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556eae044b00 msgr2=0x556eae067220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.462+0000 7f0001e00640 1 --2- 172.21.15.3:0/2264402237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556eae044b00 0x556eae067220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.462+0000 7f0001e00640 1 -- 172.21.15.3:0/2264402237 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae04f3a0 msgr2=0x556eae03f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.462+0000 7f0001e00640 1 --2- 172.21.15.3:0/2264402237 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae04f3a0 0x556eae03f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.462+0000 7f0001e00640 1 -- 172.21.15.3:0/2264402237 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556eae03bd60 con 0x556eae0441e0 2024-09-19T06:19:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.462+0000 7f0002800640 1 --2- 172.21.15.3:0/2264402237 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae04f3a0 0x556eae03f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.463+0000 7f0001e00640 1 --2- 172.21.15.3:0/2264402237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae0441e0 0x556eae066ce0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efff4010480 tx=0x7efff401c610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c69d92920b9c3c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.463+0000 7efff2a00640 1 -- 172.21.15.3:0/2264402237 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff401cc60 con 0x556eae0441e0 2024-09-19T06:19:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.463+0000 7efff2a00640 1 -- 172.21.15.3:0/2264402237 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efff401c700 con 0x556eae0441e0 2024-09-19T06:19:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.463+0000 7efff2a00640 1 -- 172.21.15.3:0/2264402237 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff4004660 con 0x556eae0441e0 2024-09-19T06:19:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.464+0000 7f000bde4740 1 -- 172.21.15.3:0/2264402237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae0441e0 msgr2=0x556eae066ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.464+0000 7f000bde4740 1 --2- 172.21.15.3:0/2264402237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae0441e0 0x556eae066ce0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efff4010480 tx=0x7efff401c610 comp rx=0 tx=0).stop 2024-09-19T06:19:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.464+0000 7f000bde4740 1 -- 172.21.15.3:0/2264402237 shutdown_connections 2024-09-19T06:19:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.464+0000 7f000bde4740 1 --2- 172.21.15.3:0/2264402237 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae04f3a0 0x556eae03f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.464+0000 7f000bde4740 1 --2- 172.21.15.3:0/2264402237 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556eae044b00 0x556eae067220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.464+0000 7f000bde4740 1 --2- 172.21.15.3:0/2264402237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae0441e0 0x556eae066ce0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.464+0000 7f000bde4740 1 -- 172.21.15.3:0/2264402237 >> 172.21.15.3:0/2264402237 conn(0x556eae040750 msgr2=0x556eae040b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.464+0000 7f000bde4740 1 -- 172.21.15.3:0/2264402237 shutdown_connections 2024-09-19T06:19:40.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.464+0000 7f000bde4740 1 -- 172.21.15.3:0/2264402237 wait complete. 2024-09-19T06:19:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.465+0000 7f000bde4740 1 -- start start 2024-09-19T06:19:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.465+0000 7f000bde4740 1 Processor -- start 2024-09-19T06:19:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.465+0000 7f000bde4740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556eae0441e0 0x556eae0c1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.465+0000 7f000bde4740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae044b00 0x556eae0c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.469 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.465+0000 7f000bde4740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae04f3a0 0x556eae052830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.465+0000 7f000bde4740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f00041b5410 con 0x556eae044b00 2024-09-19T06:19:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.465+0000 7f000bde4740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f00041b4d40 con 0x556eae04f3a0 2024-09-19T06:19:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.465+0000 7f000bde4740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f00041b1fa0 con 0x556eae0441e0 2024-09-19T06:19:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.465+0000 7f000bde4740 10 client.0 _ll_register_callbacks cb 0x7efffc005920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.465+0000 7efffbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae044b00 0x556eae0c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.465+0000 7f0002800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae04f3a0 0x556eae052830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.466+0000 7efffbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae044b00 0x556eae0c24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40494/0 (socket says 172.21.15.3:40494) 2024-09-19T06:19:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.466+0000 7efffbe00640 1 -- 172.21.15.3:0/4013118022 learned_addr learned my addr 172.21.15.3:0/4013118022 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.466+0000 7f0001e00640 1 --2- 172.21.15.3:0/4013118022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556eae0441e0 0x556eae0c1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.466+0000 7f0002800640 1 -- 172.21.15.3:0/4013118022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556eae0441e0 msgr2=0x556eae0c1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.466+0000 7f0002800640 1 --2- 172.21.15.3:0/4013118022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556eae0441e0 0x556eae0c1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.470 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.466+0000 7f0002800640 1 -- 172.21.15.3:0/4013118022 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae044b00 msgr2=0x556eae0c24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.466+0000 7f0002800640 1 --2- 172.21.15.3:0/4013118022 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae044b00 0x556eae0c24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.466+0000 7f0002800640 1 -- 172.21.15.3:0/4013118022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556eae052f70 con 0x556eae04f3a0 2024-09-19T06:19:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.466+0000 7efffbe00640 1 --2- 172.21.15.3:0/4013118022 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae044b00 0x556eae0c24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.466+0000 7f0001e00640 1 --2- 172.21.15.3:0/4013118022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556eae0441e0 0x556eae0c1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.466+0000 7f0002800640 1 --2- 172.21.15.3:0/4013118022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae04f3a0 0x556eae052830 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7efffc00eb10 tx=0x7efffc009590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2562444e975c93d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.466+0000 7effe7e00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:19:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.467+0000 7effe7e00640 1 -- 172.21.15.3:0/4013118022 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc082020 con 0x556eae04f3a0 2024-09-19T06:19:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.467+0000 7effe7e00640 1 -- 172.21.15.3:0/4013118022 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7efffc0b0de0 con 0x556eae04f3a0 2024-09-19T06:19:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.467+0000 7f000bde4740 1 -- 172.21.15.3:0/4013118022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efff401c700 con 0x556eae04f3a0 2024-09-19T06:19:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.467+0000 7effe7e00640 1 -- 172.21.15.3:0/4013118022 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efffc0ab050 con 0x556eae04f3a0 2024-09-19T06:19:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.467+0000 7f000bde4740 10 client.27302 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.467+0000 7f000bde4740 1 -- 172.21.15.3:0/4013118022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556eae0c9830 con 0x556eae04f3a0 2024-09-19T06:19:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.467+0000 7effe7e00640 1 -- 172.21.15.3:0/4013118022 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efff401c700 con 0x556eae04f3a0 2024-09-19T06:19:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.468+0000 7effe7e00640 1 -- 172.21.15.3:0/4013118022 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7efffc0d0040 con 0x556eae04f3a0 2024-09-19T06:19:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.468+0000 7f000bde4740 10 client.27302 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.468+0000 7f000bde4740 10 client.27302 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.468+0000 7f000bde4740 20 client.27302 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.468+0000 7f000bde4740 1 --2- 172.21.15.3:0/4013118022 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x556eae0c9fa0 0x556eae0cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.468+0000 7f000bde4740 4 client.27302 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:19:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.468+0000 7f000bde4740 1 -- 172.21.15.3:0/4013118022 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556eadfb1b80 con 0x556eae0c9fa0 2024-09-19T06:19:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.468+0000 7f0001e00640 1 --2- 172.21.15.3:0/4013118022 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x556eae0c9fa0 0x556eae0cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.469+0000 7f0001e00640 1 --2- 172.21.15.3:0/4013118022 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x556eae0c9fa0 0x556eae0cc3c0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fd93deb5f7cd17d server_cookie=300b8812c9f7c313 in_seq=0 out_seq=0 2024-09-19T06:19:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.469+0000 7effe7e00640 10 client.27302 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.483+0000 7effe7e00640 1 -- 172.21.15.3:0/4013118022 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556eadfb1b80 con 0x556eae0c9fa0 2024-09-19T06:19:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.483+0000 7effe7e00640 10 client.27302 handle_command_reply: tid=0 2024-09-19T06:19:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.483+0000 7f000bde4740 1 client.27302 shutdown 2024-09-19T06:19:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.483+0000 7f000bde4740 1 -- 172.21.15.3:0/4013118022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae04f3a0 msgr2=0x556eae052830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.483+0000 7f000bde4740 1 --2- 172.21.15.3:0/4013118022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae04f3a0 0x556eae052830 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7efffc00eb10 tx=0x7efffc009590 comp rx=0 tx=0).stop 2024-09-19T06:19:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.484+0000 7f000bde4740 1 -- 172.21.15.3:0/4013118022 shutdown_connections 2024-09-19T06:19:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.484+0000 7f000bde4740 1 --2- 172.21.15.3:0/4013118022 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x556eae0c9fa0 0x556eae0cc3c0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.484+0000 7f000bde4740 1 --2- 172.21.15.3:0/4013118022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556eae04f3a0 0x556eae052830 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.484+0000 7f000bde4740 1 --2- 172.21.15.3:0/4013118022 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556eae044b00 0x556eae0c24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.484+0000 7f000bde4740 1 --2- 172.21.15.3:0/4013118022 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556eae0441e0 0x556eae0c1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.484+0000 7effe7e00640 0 client.27302 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.484+0000 7f000bde4740 1 -- 172.21.15.3:0/4013118022 >> 172.21.15.3:0/4013118022 conn(0x556eae040750 msgr2=0x556eae04c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.484+0000 7f000bde4740 1 -- 172.21.15.3:0/4013118022 shutdown_connections 2024-09-19T06:19:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.484+0000 7f000bde4740 1 -- 172.21.15.3:0/4013118022 wait complete. 2024-09-19T06:19:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.484+0000 7f000bde4740 20 client.27302 trim_cache size 0 max 16384 2024-09-19T06:19:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:19:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:19:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:19:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:19:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.485+0000 7f0009000640 1 -- 172.21.15.3:0/2445050989 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7effe80a33b0 msgr2=0x7effe80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.485+0000 7f0009000640 1 --2- 172.21.15.3:0/2445050989 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7effe80a33b0 0x7effe80a5870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7effec000c00 tx=0x7effec02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.485+0000 7f0009000640 1 -- 172.21.15.3:0/2445050989 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0004112970 msgr2=0x7f000419e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.485+0000 7f0009000640 1 --2- 172.21.15.3:0/2445050989 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0004112970 0x7f000419e850 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7efffc00eb40 tx=0x7efffc00c2d0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.485+0000 7f0009000640 1 -- 172.21.15.3:0/2445050989 shutdown_connections 2024-09-19T06:19:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.485+0000 7f0009000640 1 --2- 172.21.15.3:0/2445050989 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7effe80a33b0 0x7effe80a5870 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.485+0000 7f0009000640 1 --2- 172.21.15.3:0/2445050989 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0004112970 0x7f000419e850 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.485+0000 7f0009000640 1 --2- 172.21.15.3:0/2445050989 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0004077040 0x7f00041a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.485+0000 7f0009000640 1 --2- 172.21.15.3:0/2445050989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0004076720 0x7f00041a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.485+0000 7f0009000640 1 -- 172.21.15.3:0/2445050989 >> 172.21.15.3:0/2445050989 conn(0x7f00040ff970 msgr2=0x7f0004101d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.485+0000 7f0009000640 1 -- 172.21.15.3:0/2445050989 shutdown_connections 2024-09-19T06:19:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:40.485+0000 7f0009000640 1 -- 172.21.15.3:0/2445050989 wait complete. 2024-09-19T06:19:40.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.578+0000 7fef5bc00640 1 -- 172.21.15.3:0/2492631881 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef54103ff0 msgr2=0x7fef541043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:40.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.578+0000 7fef5bc00640 1 --2- 172.21.15.3:0/2492631881 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef54103ff0 0x7fef541043d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fef48009900 tx=0x7fef4802a410 comp rx=0 tx=0).stop 2024-09-19T06:19:40.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.578+0000 7fef5bc00640 1 -- 172.21.15.3:0/2492631881 shutdown_connections 2024-09-19T06:19:40.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.578+0000 7fef5bc00640 1 --2- 172.21.15.3:0/2492631881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef54109120 0x7fef54110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.578+0000 7fef5bc00640 1 --2- 172.21.15.3:0/2492631881 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef541049a0 0x7fef541089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.578+0000 7fef5bc00640 1 --2- 172.21.15.3:0/2492631881 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef54103ff0 0x7fef541043d0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.578+0000 7fef5bc00640 1 -- 172.21.15.3:0/2492631881 >> 172.21.15.3:0/2492631881 conn(0x7fef540ffa90 msgr2=0x7fef54101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:40.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.578+0000 7fef5bc00640 1 -- 172.21.15.3:0/2492631881 shutdown_connections 2024-09-19T06:19:40.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.578+0000 7fef5bc00640 1 -- 172.21.15.3:0/2492631881 wait complete. 2024-09-19T06:19:40.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.579+0000 7fef5bc00640 1 Processor -- start 2024-09-19T06:19:40.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.579+0000 7fef5bc00640 1 -- start start 2024-09-19T06:19:40.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.580+0000 7fef5bc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef54103ff0 0x7fef5419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.580+0000 7fef5bc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef541049a0 0x7fef5419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.581 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.580+0000 7fef5bc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef54109120 0x7fef5419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.580+0000 7fef5bc00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fef54114140 con 0x7fef54109120 2024-09-19T06:19:40.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.580+0000 7fef5bc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fef54113fc0 con 0x7fef541049a0 2024-09-19T06:19:40.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.580+0000 7fef5bc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fef541142c0 con 0x7fef54103ff0 2024-09-19T06:19:40.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.580+0000 7fef59200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef54103ff0 0x7fef5419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.580+0000 7fef59c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef54109120 0x7fef5419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.580+0000 7fef59200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef54103ff0 0x7fef5419a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:36030/0 (socket says 172.21.15.3:36030) 2024-09-19T06:19:40.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.580+0000 7fef59200640 1 -- 172.21.15.3:0/1881894347 learned_addr learned my addr 172.21.15.3:0/1881894347 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:40.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.580+0000 7fef53e00640 1 --2- 172.21.15.3:0/1881894347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef541049a0 0x7fef5419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.580+0000 7fef59200640 1 -- 172.21.15.3:0/1881894347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef541049a0 msgr2=0x7fef5419ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:40.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.580+0000 7fef59200640 1 --2- 172.21.15.3:0/1881894347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef541049a0 0x7fef5419ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.580+0000 7fef59200640 1 -- 172.21.15.3:0/1881894347 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef54109120 msgr2=0x7fef5419eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:40.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.580+0000 7fef59200640 1 --2- 172.21.15.3:0/1881894347 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef54109120 0x7fef5419eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.581+0000 7fef59200640 1 -- 172.21.15.3:0/1881894347 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef5419f5b0 con 0x7fef54103ff0 2024-09-19T06:19:40.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.581+0000 7fef59c00640 1 --2- 172.21.15.3:0/1881894347 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef54109120 0x7fef5419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:40.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.581+0000 7fef59200640 1 --2- 172.21.15.3:0/1881894347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef54103ff0 0x7fef5419a600 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fef48006010 tx=0x7fef480042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:40.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.581+0000 7fef51600640 1 -- 172.21.15.3:0/1881894347 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4803f030 con 0x7fef54103ff0 2024-09-19T06:19:40.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.581+0000 7fef5bc00640 1 -- 172.21.15.3:0/1881894347 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef5419f840 con 0x7fef54103ff0 2024-09-19T06:19:40.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.581+0000 7fef51600640 1 -- 172.21.15.3:0/1881894347 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef48003ce0 con 0x7fef54103ff0 2024-09-19T06:19:40.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.581+0000 7fef51600640 1 -- 172.21.15.3:0/1881894347 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef48035070 con 0x7fef54103ff0 2024-09-19T06:19:40.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.582+0000 7fef5bc00640 1 -- 172.21.15.3:0/1881894347 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef541a7180 con 0x7fef54103ff0 2024-09-19T06:19:40.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.584+0000 7fef5e67f740 1 Processor -- start 2024-09-19T06:19:40.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.585+0000 7fef5e67f740 1 -- start start 2024-09-19T06:19:40.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.585+0000 7fef51600640 1 -- 172.21.15.3:0/1881894347 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fef48042030 con 0x7fef54103ff0 2024-09-19T06:19:40.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.585+0000 7fef5e67f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600d8cbcc70 0x5600d8cbd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.585+0000 7fef5e67f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600d8cbd590 0x5600d8cc7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.586 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.585+0000 7fef5e67f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cc7e50 0x5600d8cca240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.585+0000 7fef5e67f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5600d8c233e0 con 0x5600d8cbcc70 2024-09-19T06:19:40.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.585+0000 7fef5e67f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5600d8bcad80 con 0x5600d8cbd590 2024-09-19T06:19:40.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.585+0000 7fef5e67f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5600d8c1f3a0 con 0x5600d8cc7e50 2024-09-19T06:19:40.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.585+0000 7fef59c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600d8cbcc70 0x5600d8cbd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.585+0000 7fef59c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600d8cbcc70 0x5600d8cbd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40534/0 (socket says 172.21.15.3:40534) 2024-09-19T06:19:40.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.585+0000 7fef59c00640 1 -- 172.21.15.3:0/3609564781 learned_addr learned my addr 172.21.15.3:0/3609564781 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:40.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.585+0000 7fef53e00640 1 --2- 172.21.15.3:0/3609564781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cc7e50 0x5600d8cca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.587 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.585+0000 7fef59200640 1 --2- 172.21.15.3:0/3609564781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600d8cbd590 0x5600d8cc7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.586+0000 7fef59c00640 1 -- 172.21.15.3:0/3609564781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cc7e50 msgr2=0x5600d8cca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:40.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.586+0000 7fef59c00640 1 --2- 172.21.15.3:0/3609564781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cc7e50 0x5600d8cca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.586+0000 7fef59c00640 1 -- 172.21.15.3:0/3609564781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600d8cbd590 msgr2=0x5600d8cc7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:40.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.586+0000 7fef59c00640 1 --2- 172.21.15.3:0/3609564781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600d8cbd590 0x5600d8cc7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.586+0000 7fef59c00640 1 -- 172.21.15.3:0/3609564781 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600d8be9ae0 con 0x5600d8cbcc70 2024-09-19T06:19:40.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.586+0000 7fef53e00640 1 --2- 172.21.15.3:0/3609564781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cc7e50 0x5600d8cca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:40.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.586+0000 7fef59200640 1 --2- 172.21.15.3:0/3609564781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600d8cbd590 0x5600d8cc7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:40.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.586+0000 7fef59c00640 1 --2- 172.21.15.3:0/3609564781 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600d8cbcc70 0x5600d8cbd050 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fef4c0107a0 tx=0x7fef4c010c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31c9fd46c13bc6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:40.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.587+0000 7fef51600640 1 --2- 172.21.15.3:0/1881894347 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fef3c0a3430 0x7fef3c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.587+0000 7fef46000640 1 -- 172.21.15.3:0/3609564781 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c003b70 con 0x5600d8cbcc70 2024-09-19T06:19:40.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.587+0000 7fef46000640 1 -- 172.21.15.3:0/3609564781 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef4c010e50 con 0x5600d8cbcc70 2024-09-19T06:19:40.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.587+0000 7fef46000640 1 -- 172.21.15.3:0/3609564781 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4c004640 con 0x5600d8cbcc70 2024-09-19T06:19:40.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.587+0000 7fef51600640 1 -- 172.21.15.3:0/1881894347 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7fef480f0260 con 0x7fef54103ff0 2024-09-19T06:19:40.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.587+0000 7fef59200640 1 --2- 172.21.15.3:0/1881894347 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fef3c0a3430 0x7fef3c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.587+0000 7fef5e67f740 1 -- 172.21.15.3:0/3609564781 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600d8cbcc70 msgr2=0x5600d8cbd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:40.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.587+0000 7fef5e67f740 1 --2- 172.21.15.3:0/3609564781 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600d8cbcc70 0x5600d8cbd050 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fef4c0107a0 tx=0x7fef4c010c60 comp rx=0 tx=0).stop 2024-09-19T06:19:40.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.588+0000 7fef59200640 1 --2- 172.21.15.3:0/1881894347 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fef3c0a3430 0x7fef3c0a58f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x5600d8cba060 tx=0x7fef4802a410 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:40.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.588+0000 7fef5e67f740 1 -- 172.21.15.3:0/3609564781 shutdown_connections 2024-09-19T06:19:40.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.588+0000 7fef5e67f740 1 --2- 172.21.15.3:0/3609564781 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cc7e50 0x5600d8cca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.588+0000 7fef5e67f740 1 --2- 172.21.15.3:0/3609564781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600d8cbd590 0x5600d8cc7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.588+0000 7fef5e67f740 1 --2- 172.21.15.3:0/3609564781 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600d8cbcc70 0x5600d8cbd050 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.588+0000 7fef5e67f740 1 -- 172.21.15.3:0/3609564781 >> 172.21.15.3:0/3609564781 conn(0x5600d8cb9200 msgr2=0x5600d8cb95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:40.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.588+0000 7fef5e67f740 1 -- 172.21.15.3:0/3609564781 shutdown_connections 2024-09-19T06:19:40.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.588+0000 7fef5e67f740 1 -- 172.21.15.3:0/3609564781 wait complete. 2024-09-19T06:19:40.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.588+0000 7fef5e67f740 1 -- start start 2024-09-19T06:19:40.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.589+0000 7fef5e67f740 1 Processor -- start 2024-09-19T06:19:40.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.589+0000 7fef5e67f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600d8cbcc70 0x5600d8cc4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.589+0000 7fef5e67f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600d8cbd590 0x5600d8cc52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.589+0000 7fef5e67f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cc7e50 0x5600d8cc57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.589+0000 7fef5e67f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5600d8ccaa20 con 0x5600d8cbd590 2024-09-19T06:19:40.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.589+0000 7fef5e67f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5600d8bde0f0 con 0x5600d8cbcc70 2024-09-19T06:19:40.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.589+0000 7fef5e67f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5600d8ccaba0 con 0x5600d8cc7e50 2024-09-19T06:19:40.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.589+0000 7fef5e67f740 10 client.0 _ll_register_callbacks cb 0x5600d8bc5bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:40.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.589+0000 7fef53e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600d8cbd590 0x5600d8cc52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.589+0000 7fef53e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600d8cbd590 0x5600d8cc52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40540/0 (socket says 172.21.15.3:40540) 2024-09-19T06:19:40.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.589+0000 7fef59c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600d8cbcc70 0x5600d8cc4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.589+0000 7fef53e00640 1 -- 172.21.15.3:0/42286122 learned_addr learned my addr 172.21.15.3:0/42286122 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:40.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.589+0000 7fef59c00640 1 --2- 172.21.15.3:0/42286122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cc7e50 0x5600d8cc57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.590+0000 7fef53e00640 1 -- 172.21.15.3:0/42286122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cc7e50 msgr2=0x5600d8cc57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:40.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.590+0000 7fef53e00640 1 --2- 172.21.15.3:0/42286122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cc7e50 0x5600d8cc57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.590+0000 7fef53e00640 1 -- 172.21.15.3:0/42286122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600d8cbcc70 msgr2=0x5600d8cc4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:40.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.590+0000 7fef53e00640 1 --2- 172.21.15.3:0/42286122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600d8cbcc70 0x5600d8cc4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.590+0000 7fef53e00640 1 -- 172.21.15.3:0/42286122 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600d89943c0 con 0x5600d8cbd590 2024-09-19T06:19:40.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.590+0000 7fef53e00640 1 --2- 172.21.15.3:0/42286122 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600d8cbd590 0x5600d8cc52b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fef400126e0 tx=0x7fef40012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178b8494332caa3b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:40.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.590+0000 7fef3aa00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:19:40.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.590+0000 7fef3aa00640 1 -- 172.21.15.3:0/42286122 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40004050 con 0x5600d8cbd590 2024-09-19T06:19:40.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.590+0000 7fef3aa00640 1 -- 172.21.15.3:0/42286122 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7fef400041f0 con 0x5600d8cbd590 2024-09-19T06:19:40.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.590+0000 7fef5e67f740 1 -- 172.21.15.3:0/42286122 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef4c010e50 con 0x5600d8cbd590 2024-09-19T06:19:40.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.591+0000 7fef3aa00640 1 -- 172.21.15.3:0/42286122 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fef400043f0 con 0x5600d8cbd590 2024-09-19T06:19:40.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.591+0000 7fef5e67f740 10 client.17274 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:40.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.591+0000 7fef5e67f740 1 -- 172.21.15.3:0/42286122 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5600d8cd6af0 con 0x5600d8cbd590 2024-09-19T06:19:40.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.591+0000 7fef3aa00640 1 -- 172.21.15.3:0/42286122 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef4c010e50 con 0x5600d8cbd590 2024-09-19T06:19:40.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.591+0000 7fef3aa00640 1 -- 172.21.15.3:0/42286122 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fef40003ce0 con 0x5600d8cbd590 2024-09-19T06:19:40.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.591+0000 7fef5e67f740 10 client.17274 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:40.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.591+0000 7fef5e67f740 10 client.17274 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:40.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.591+0000 7fef5e67f740 20 client.17274 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:40.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.591+0000 7fef5e67f740 1 --2- 172.21.15.3:0/42286122 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5600d8cd7f00 0x5600d8cda2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.591+0000 7fef5e67f740 4 client.17274 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:40.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.591+0000 7fef5e67f740 1 -- 172.21.15.3:0/42286122 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600d8c30950 con 0x5600d8cd7f00 2024-09-19T06:19:40.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.592+0000 7fef59c00640 1 --2- 172.21.15.3:0/42286122 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5600d8cd7f00 0x5600d8cda2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.592+0000 7fef59c00640 1 --2- 172.21.15.3:0/42286122 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5600d8cd7f00 0x5600d8cda2f0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebe03958ec2ce2d0 server_cookie=a3cd605b71af6229 in_seq=0 out_seq=0 2024-09-19T06:19:40.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.592+0000 7fef3aa00640 10 client.17274 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:40.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.593+0000 7fef3aa00640 1 -- 172.21.15.3:0/42286122 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5600d8c30950 con 0x5600d8cd7f00 2024-09-19T06:19:40.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.593+0000 7fef3aa00640 10 client.17274 handle_command_reply: tid=0 2024-09-19T06:19:40.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.593+0000 7fef5e67f740 1 client.17274 shutdown 2024-09-19T06:19:40.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.593+0000 7fef5e67f740 1 -- 172.21.15.3:0/42286122 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600d8cbd590 msgr2=0x5600d8cc52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:40.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.593+0000 7fef5e67f740 1 --2- 172.21.15.3:0/42286122 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600d8cbd590 0x5600d8cc52b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fef400126e0 tx=0x7fef40012ba0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.593+0000 7fef5e67f740 1 -- 172.21.15.3:0/42286122 shutdown_connections 2024-09-19T06:19:40.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.593+0000 7fef5e67f740 1 --2- 172.21.15.3:0/42286122 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5600d8cd7f00 0x5600d8cda2f0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.593+0000 7fef5e67f740 1 --2- 172.21.15.3:0/42286122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cc7e50 0x5600d8cc57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.593+0000 7fef5e67f740 1 --2- 172.21.15.3:0/42286122 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600d8cbd590 0x5600d8cc52b0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.593+0000 7fef5e67f740 1 --2- 172.21.15.3:0/42286122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600d8cbcc70 0x5600d8cc4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.593+0000 7fef5e67f740 1 -- 172.21.15.3:0/42286122 >> 172.21.15.3:0/42286122 conn(0x5600d8cb9200 msgr2=0x5600d8cbef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:40.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.594+0000 7fef3aa00640 0 client.17274 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:40.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.594+0000 7fef5e67f740 1 -- 172.21.15.3:0/42286122 shutdown_connections 2024-09-19T06:19:40.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.594+0000 7fef5e67f740 1 -- 172.21.15.3:0/42286122 wait complete. 2024-09-19T06:19:40.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.594+0000 7fef5e67f740 20 client.17274 trim_cache size 0 max 16384 2024-09-19T06:19:40.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.608+0000 7fef5e67f740 1 Processor -- start 2024-09-19T06:19:40.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.608+0000 7fef5e67f740 1 -- start start 2024-09-19T06:19:40.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.608+0000 7fef5e67f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600d8cbcc70 0x5600d8cbf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.608+0000 7fef5e67f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cbd590 0x5600d8cc6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.608+0000 7fef5e67f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600d8cc7e50 0x5600d8cdfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.608+0000 7fef5e67f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fef541afb60 con 0x5600d8cbcc70 2024-09-19T06:19:40.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.608+0000 7fef5e67f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fef541b16a0 con 0x5600d8cc7e50 2024-09-19T06:19:40.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.608+0000 7fef5e67f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fef541b0230 con 0x5600d8cbd590 2024-09-19T06:19:40.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.608+0000 7fef53e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cbd590 0x5600d8cc6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.608+0000 7fef59c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600d8cbcc70 0x5600d8cbf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.609+0000 7fef53e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cbd590 0x5600d8cc6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:36062/0 (socket says 172.21.15.3:36062) 2024-09-19T06:19:40.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.609+0000 7fef53e00640 1 -- 172.21.15.3:0/81047286 learned_addr learned my addr 172.21.15.3:0/81047286 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:40.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.609+0000 7fef59c00640 1 --2- 172.21.15.3:0/81047286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600d8cc7e50 0x5600d8cdfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.609+0000 7fef53e00640 1 -- 172.21.15.3:0/81047286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600d8cc7e50 msgr2=0x5600d8cdfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:40.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.609+0000 7fef53e00640 1 --2- 172.21.15.3:0/81047286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600d8cc7e50 0x5600d8cdfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.609+0000 7fef53e00640 1 -- 172.21.15.3:0/81047286 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600d8cbcc70 msgr2=0x5600d8cbf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:40.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.609+0000 7fef53e00640 1 --2- 172.21.15.3:0/81047286 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600d8cbcc70 0x5600d8cbf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.609+0000 7fef53e00640 1 -- 172.21.15.3:0/81047286 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600d8cb4770 con 0x5600d8cbd590 2024-09-19T06:19:40.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.609+0000 7fef53e00640 1 --2- 172.21.15.3:0/81047286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cbd590 0x5600d8cc6ce0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fef40000c00 tx=0x7fef4000f810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e08c3e2a2c5d2e9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:40.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.610+0000 7fef45600640 1 -- 172.21.15.3:0/81047286 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40028040 con 0x5600d8cbd590 2024-09-19T06:19:40.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.610+0000 7fef45600640 1 -- 172.21.15.3:0/81047286 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef40010840 con 0x5600d8cbd590 2024-09-19T06:19:40.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.610+0000 7fef45600640 1 -- 172.21.15.3:0/81047286 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef400054e0 con 0x5600d8cbd590 2024-09-19T06:19:40.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.610+0000 7fef5e67f740 1 -- 172.21.15.3:0/81047286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cbd590 msgr2=0x5600d8cc6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:40.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.610+0000 7fef5e67f740 1 --2- 172.21.15.3:0/81047286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cbd590 0x5600d8cc6ce0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fef40000c00 tx=0x7fef4000f810 comp rx=0 tx=0).stop 2024-09-19T06:19:40.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.610+0000 7fef5e67f740 1 -- 172.21.15.3:0/81047286 shutdown_connections 2024-09-19T06:19:40.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.610+0000 7fef5e67f740 1 --2- 172.21.15.3:0/81047286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600d8cc7e50 0x5600d8cdfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.610+0000 7fef5e67f740 1 --2- 172.21.15.3:0/81047286 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cbd590 0x5600d8cc6ce0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.610+0000 7fef5e67f740 1 --2- 172.21.15.3:0/81047286 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600d8cbcc70 0x5600d8cbf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.610+0000 7fef5e67f740 1 -- 172.21.15.3:0/81047286 >> 172.21.15.3:0/81047286 conn(0x5600d8cb9200 msgr2=0x5600d8cc65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:40.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.611+0000 7fef5e67f740 1 -- 172.21.15.3:0/81047286 shutdown_connections 2024-09-19T06:19:40.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.611+0000 7fef5e67f740 1 -- 172.21.15.3:0/81047286 wait complete. 2024-09-19T06:19:40.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.611+0000 7fef5e67f740 1 -- start start 2024-09-19T06:19:40.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.611+0000 7fef5e67f740 1 Processor -- start 2024-09-19T06:19:40.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.612+0000 7fef5e67f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600d8cbcc70 0x5600d8cd0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.612+0000 7fef5e67f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cbd590 0x5600d8ccb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.612+0000 7fef5e67f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600d8cc7e50 0x5600d8ccbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.612+0000 7fef5e67f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fef541b0fd0 con 0x5600d8cc7e50 2024-09-19T06:19:40.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.612+0000 7fef5e67f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fef541b0900 con 0x5600d8cbcc70 2024-09-19T06:19:40.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.612+0000 7fef5e67f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fef541adb60 con 0x5600d8cbd590 2024-09-19T06:19:40.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.612+0000 7fef5e67f740 10 client.0 _ll_register_callbacks cb 0x7fef40009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:40.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.612+0000 7fef53e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cbd590 0x5600d8ccb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.612+0000 7fef53e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cbd590 0x5600d8ccb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:36070/0 (socket says 172.21.15.3:36070) 2024-09-19T06:19:40.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.612+0000 7fef53e00640 1 -- 172.21.15.3:0/4070464394 learned_addr learned my addr 172.21.15.3:0/4070464394 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:40.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.613+0000 7fef59c00640 1 --2- 172.21.15.3:0/4070464394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600d8cbcc70 0x5600d8cd0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.613+0000 7fef59c00640 1 --2- 172.21.15.3:0/4070464394 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600d8cc7e50 0x5600d8ccbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.613+0000 7fef53e00640 1 -- 172.21.15.3:0/4070464394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600d8cbcc70 msgr2=0x5600d8cd0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.613+0000 7fef53e00640 1 --2- 172.21.15.3:0/4070464394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600d8cbcc70 0x5600d8cd0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.613+0000 7fef53e00640 1 -- 172.21.15.3:0/4070464394 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600d8cc7e50 msgr2=0x5600d8ccbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.613+0000 7fef53e00640 1 --2- 172.21.15.3:0/4070464394 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600d8cc7e50 0x5600d8ccbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.613+0000 7fef53e00640 1 -- 172.21.15.3:0/4070464394 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600d8cba2b0 con 0x5600d8cbd590 2024-09-19T06:19:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.613+0000 7fef53e00640 1 --2- 172.21.15.3:0/4070464394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cbd590 0x5600d8ccb670 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fef400105c0 tx=0x7fef40009850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a742e4d394711865 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.613+0000 7fef3aa00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:19:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.614+0000 7fef3aa00640 1 -- 172.21.15.3:0/4070464394 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40010c00 con 0x5600d8cbd590 2024-09-19T06:19:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.614+0000 7fef3aa00640 1 -- 172.21.15.3:0/4070464394 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7fef40010da0 con 0x5600d8cbd590 2024-09-19T06:19:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.614+0000 7fef5e67f740 1 -- 172.21.15.3:0/4070464394 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef40010840 con 0x5600d8cbd590 2024-09-19T06:19:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.614+0000 7fef3aa00640 1 -- 172.21.15.3:0/4070464394 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fef400051e0 con 0x5600d8cbd590 2024-09-19T06:19:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.614+0000 7fef5e67f740 10 client.27313 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:40.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.614+0000 7fef5e67f740 1 -- 172.21.15.3:0/4070464394 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5600d8d42810 con 0x5600d8cbd590 2024-09-19T06:19:40.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.614+0000 7fef3aa00640 1 -- 172.21.15.3:0/4070464394 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef40010840 con 0x5600d8cbd590 2024-09-19T06:19:40.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.615+0000 7fef3aa00640 1 -- 172.21.15.3:0/4070464394 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fef40004c90 con 0x5600d8cbd590 2024-09-19T06:19:40.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.615+0000 7fef5e67f740 10 client.27313 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:40.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.615+0000 7fef5e67f740 10 client.27313 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:40.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.615+0000 7fef5e67f740 20 client.27313 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:40.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.615+0000 7fef5e67f740 1 --2- 172.21.15.3:0/4070464394 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5600d8d42e40 0x5600d8d45260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:40.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.615+0000 7fef5e67f740 4 client.27313 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:19:40.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.615+0000 7fef5e67f740 1 -- 172.21.15.3:0/4070464394 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5600d8c2ae60 con 0x5600d8d42e40 2024-09-19T06:19:40.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.615+0000 7fef59c00640 1 --2- 172.21.15.3:0/4070464394 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5600d8d42e40 0x5600d8d45260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:40.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.616+0000 7fef59c00640 1 --2- 172.21.15.3:0/4070464394 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5600d8d42e40 0x5600d8d45260 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=402fc0597d3c6d29 server_cookie=45e0700b0c375274 in_seq=0 out_seq=0 2024-09-19T06:19:40.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.616+0000 7fef3aa00640 10 client.27313 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:40.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.616+0000 7fef3aa00640 1 -- 172.21.15.3:0/4070464394 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5600d8c2ae60 con 0x5600d8d42e40 2024-09-19T06:19:40.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.616+0000 7fef3aa00640 10 client.27313 handle_command_reply: tid=0 2024-09-19T06:19:40.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.616+0000 7fef5e67f740 1 client.27313 shutdown 2024-09-19T06:19:40.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.616+0000 7fef5e67f740 1 -- 172.21.15.3:0/4070464394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cbd590 msgr2=0x5600d8ccb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:40.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.616+0000 7fef5e67f740 1 --2- 172.21.15.3:0/4070464394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cbd590 0x5600d8ccb670 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fef400105c0 tx=0x7fef40009850 comp rx=0 tx=0).stop 2024-09-19T06:19:40.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.616+0000 7fef5e67f740 1 -- 172.21.15.3:0/4070464394 shutdown_connections 2024-09-19T06:19:40.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.616+0000 7fef5e67f740 1 --2- 172.21.15.3:0/4070464394 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5600d8d42e40 0x5600d8d45260 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.616+0000 7fef5e67f740 1 --2- 172.21.15.3:0/4070464394 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600d8cc7e50 0x5600d8ccbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.616+0000 7fef5e67f740 1 --2- 172.21.15.3:0/4070464394 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600d8cbd590 0x5600d8ccb670 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.616+0000 7fef5e67f740 1 --2- 172.21.15.3:0/4070464394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600d8cbcc70 0x5600d8cd0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.616+0000 7fef5e67f740 1 -- 172.21.15.3:0/4070464394 >> 172.21.15.3:0/4070464394 conn(0x5600d8cb9200 msgr2=0x5600d8cc6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:40.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.616+0000 7fef3aa00640 0 client.27313 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:40.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.617+0000 7fef5e67f740 1 -- 172.21.15.3:0/4070464394 shutdown_connections 2024-09-19T06:19:40.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.617+0000 7fef5e67f740 1 -- 172.21.15.3:0/4070464394 wait complete. 2024-09-19T06:19:40.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.617+0000 7fef5e67f740 20 client.27313 trim_cache size 0 max 16384 2024-09-19T06:19:40.620 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:19:40.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.617+0000 7fef5bc00640 1 -- 172.21.15.3:0/1881894347 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fef3c0a3430 msgr2=0x7fef3c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:40.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.617+0000 7fef5bc00640 1 --2- 172.21.15.3:0/1881894347 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fef3c0a3430 0x7fef3c0a58f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x5600d8cba060 tx=0x7fef4802a410 comp rx=0 tx=0).stop 2024-09-19T06:19:40.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.618+0000 7fef5bc00640 1 -- 172.21.15.3:0/1881894347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef54103ff0 msgr2=0x7fef5419a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:40.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.618+0000 7fef5bc00640 1 --2- 172.21.15.3:0/1881894347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef54103ff0 0x7fef5419a600 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fef48006010 tx=0x7fef480042f0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.618+0000 7fef5bc00640 1 -- 172.21.15.3:0/1881894347 shutdown_connections 2024-09-19T06:19:40.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.618+0000 7fef5bc00640 1 --2- 172.21.15.3:0/1881894347 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fef3c0a3430 0x7fef3c0a58f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.618+0000 7fef5bc00640 1 --2- 172.21.15.3:0/1881894347 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef54109120 0x7fef5419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.618+0000 7fef5bc00640 1 --2- 172.21.15.3:0/1881894347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef541049a0 0x7fef5419ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.618+0000 7fef5bc00640 1 --2- 172.21.15.3:0/1881894347 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef54103ff0 0x7fef5419a600 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:40.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.618+0000 7fef5bc00640 1 -- 172.21.15.3:0/1881894347 >> 172.21.15.3:0/1881894347 conn(0x7fef540ffa90 msgr2=0x7fef54100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:40.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.618+0000 7fef5bc00640 1 -- 172.21.15.3:0/1881894347 shutdown_connections 2024-09-19T06:19:40.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:40.618+0000 7fef5bc00640 1 -- 172.21.15.3:0/1881894347 wait complete. 2024-09-19T06:19:41.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:40 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:19:41.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:40 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:19:41.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:40 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:19:42.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:41 smithi059 ceph-mon[35138]: pgmap v224: 97 pgs: 97 active+clean; 4.5 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-09-19T06:19:42.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:41 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:19:42.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:41 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:19:42.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:41 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:19:42.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:41 smithi003 ceph-mon[30893]: pgmap v224: 97 pgs: 97 active+clean; 4.5 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-09-19T06:19:42.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:41 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:19:42.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:41 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:19:42.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:41 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:19:42.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:41 smithi071 ceph-mon[35662]: pgmap v224: 97 pgs: 97 active+clean; 4.5 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-09-19T06:19:42.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:41 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:19:42.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:41 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:19:42.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:41 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:19:42.465 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:19:42.466 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:19:42.857 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:43.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.435+0000 7f1d46e00640 1 -- 172.21.15.3:0/2384794212 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d40074590 msgr2=0x7f1d40074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:43.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.435+0000 7f1d46e00640 1 --2- 172.21.15.3:0/2384794212 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d40074590 0x7f1d40074970 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1d30009900 tx=0x7f1d3002a480 comp rx=0 tx=0).stop 2024-09-19T06:19:43.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.435+0000 7f1d46e00640 1 -- 172.21.15.3:0/2384794212 shutdown_connections 2024-09-19T06:19:43.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.435+0000 7f1d46e00640 1 --2- 172.21.15.3:0/2384794212 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d40112b90 0x7f1d40114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.435+0000 7f1d46e00640 1 --2- 172.21.15.3:0/2384794212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d40074eb0 0x7f1d40112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.435+0000 7f1d46e00640 1 --2- 172.21.15.3:0/2384794212 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d40074590 0x7f1d40074970 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.435+0000 7f1d46e00640 1 -- 172.21.15.3:0/2384794212 >> 172.21.15.3:0/2384794212 conn(0x7f1d400fd8c0 msgr2=0x7f1d400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:43.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.435+0000 7f1d46e00640 1 -- 172.21.15.3:0/2384794212 shutdown_connections 2024-09-19T06:19:43.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.435+0000 7f1d46e00640 1 -- 172.21.15.3:0/2384794212 wait complete. 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.436+0000 7f1d46e00640 1 Processor -- start 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.436+0000 7f1d46e00640 1 -- start start 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.437+0000 7f1d46e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d40074590 0x7f1d4019eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.437+0000 7f1d46e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d40074eb0 0x7f1d4019f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.437+0000 7f1d46e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d40112b90 0x7f1d401a33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.437+0000 7f1d46e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1d401185a0 con 0x7f1d40074eb0 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.437+0000 7f1d46e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1d40118420 con 0x7f1d40112b90 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.437+0000 7f1d46e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1d40118720 con 0x7f1d40074590 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.437+0000 7f1d37400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d40074eb0 0x7f1d4019f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.437+0000 7f1d37400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d40074eb0 0x7f1d4019f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40564/0 (socket says 172.21.15.3:40564) 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.437+0000 7f1d37400640 1 -- 172.21.15.3:0/2994451971 learned_addr learned my addr 172.21.15.3:0/2994451971 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:43.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.437+0000 7f1d3fe00640 1 --2- 172.21.15.3:0/2994451971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d40074590 0x7f1d4019eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.437+0000 7f1d44e00640 1 --2- 172.21.15.3:0/2994451971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d40112b90 0x7f1d401a33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.437+0000 7f1d37400640 1 -- 172.21.15.3:0/2994451971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d40074590 msgr2=0x7f1d4019eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:43.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.437+0000 7f1d37400640 1 --2- 172.21.15.3:0/2994451971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d40074590 0x7f1d4019eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.437+0000 7f1d37400640 1 -- 172.21.15.3:0/2994451971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d40112b90 msgr2=0x7f1d401a33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:43.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.437+0000 7f1d37400640 1 --2- 172.21.15.3:0/2994451971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d40112b90 0x7f1d401a33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.437+0000 7f1d37400640 1 -- 172.21.15.3:0/2994451971 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d401a3b20 con 0x7f1d40074eb0 2024-09-19T06:19:43.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.438+0000 7f1d37400640 1 --2- 172.21.15.3:0/2994451971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d40074eb0 0x7f1d4019f030 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800e9f0 tx=0x7f1d2800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:43.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.438+0000 7f1d3d600640 1 -- 172.21.15.3:0/2994451971 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2800cd80 con 0x7f1d40074eb0 2024-09-19T06:19:43.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.438+0000 7f1d46e00640 1 -- 172.21.15.3:0/2994451971 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d401a3e10 con 0x7f1d40074eb0 2024-09-19T06:19:43.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.438+0000 7f1d3d600640 1 -- 172.21.15.3:0/2994451971 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d28010910 con 0x7f1d40074eb0 2024-09-19T06:19:43.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.438+0000 7f1d3d600640 1 -- 172.21.15.3:0/2994451971 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d280188f0 con 0x7f1d40074eb0 2024-09-19T06:19:43.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.438+0000 7f1d46e00640 1 -- 172.21.15.3:0/2994451971 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d401ab6a0 con 0x7f1d40074eb0 2024-09-19T06:19:43.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.441+0000 7f1d49844740 1 Processor -- start 2024-09-19T06:19:43.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.441+0000 7f1d3d600640 1 -- 172.21.15.3:0/2994451971 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f1d28010ac0 con 0x7f1d40074eb0 2024-09-19T06:19:43.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.441+0000 7f1d49844740 1 -- start start 2024-09-19T06:19:43.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.442+0000 7f1d49844740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d3ac0 0x558bf27d3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.442+0000 7f1d49844740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bf27d43e0 0x558bf27de760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.442+0000 7f1d49844740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558bf27deca0 0x558bf27e1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.442+0000 7f1d49844740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558bf273a290 con 0x558bf27d3ac0 2024-09-19T06:19:43.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.442+0000 7f1d49844740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558bf26e1b40 con 0x558bf27deca0 2024-09-19T06:19:43.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.442+0000 7f1d49844740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558bf2736250 con 0x558bf27d43e0 2024-09-19T06:19:43.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.442+0000 7f1d44e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d3ac0 0x558bf27d3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.442+0000 7f1d44e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d3ac0 0x558bf27d3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40574/0 (socket says 172.21.15.3:40574) 2024-09-19T06:19:43.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.442+0000 7f1d44e00640 1 -- 172.21.15.3:0/180424114 learned_addr learned my addr 172.21.15.3:0/180424114 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:43.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.442+0000 7f1d3fe00640 1 --2- 172.21.15.3:0/180424114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bf27d43e0 0x558bf27de760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.442+0000 7f1d37400640 1 --2- 172.21.15.3:0/180424114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558bf27deca0 0x558bf27e1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.442+0000 7f1d44e00640 1 -- 172.21.15.3:0/180424114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bf27d43e0 msgr2=0x558bf27de760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:43.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.442+0000 7f1d44e00640 1 --2- 172.21.15.3:0/180424114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bf27d43e0 0x558bf27de760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.442+0000 7f1d44e00640 1 -- 172.21.15.3:0/180424114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558bf27deca0 msgr2=0x558bf27e1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:43.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.442+0000 7f1d44e00640 1 --2- 172.21.15.3:0/180424114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558bf27deca0 0x558bf27e1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.442+0000 7f1d44e00640 1 -- 172.21.15.3:0/180424114 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bf24ab6a0 con 0x558bf27d3ac0 2024-09-19T06:19:43.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.442+0000 7f1d37400640 1 --2- 172.21.15.3:0/180424114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558bf27deca0 0x558bf27e1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:43.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.443+0000 7f1d3d600640 1 --2- 172.21.15.3:0/2994451971 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1d240a3430 0x7f1d240a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.443+0000 7f1d44e00640 1 --2- 172.21.15.3:0/180424114 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d3ac0 0x558bf27d3ea0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1d38009f30 tx=0x7f1d380118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ecdd2cf9a6fd8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:43.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.443+0000 7f1d3d600640 1 -- 172.21.15.3:0/2994451971 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f1d280d00e0 con 0x7f1d40074eb0 2024-09-19T06:19:43.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.443+0000 7f1d3fe00640 1 --2- 172.21.15.3:0/2994451971 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1d240a3430 0x7f1d240a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.443+0000 7f1d35600640 1 -- 172.21.15.3:0/180424114 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d38004d20 con 0x558bf27d3ac0 2024-09-19T06:19:43.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.443+0000 7f1d35600640 1 -- 172.21.15.3:0/180424114 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d38004050 con 0x558bf27d3ac0 2024-09-19T06:19:43.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.443+0000 7f1d35600640 1 -- 172.21.15.3:0/180424114 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d38005220 con 0x558bf27d3ac0 2024-09-19T06:19:43.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.444+0000 7f1d49844740 1 -- 172.21.15.3:0/180424114 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d3ac0 msgr2=0x558bf27d3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:43.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.444+0000 7f1d49844740 1 --2- 172.21.15.3:0/180424114 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d3ac0 0x558bf27d3ea0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1d38009f30 tx=0x7f1d380118d0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.444+0000 7f1d3fe00640 1 --2- 172.21.15.3:0/2994451971 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1d240a3430 0x7f1d240a58f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1d30000c00 tx=0x7f1d30005b50 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:43.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.444+0000 7f1d49844740 1 -- 172.21.15.3:0/180424114 shutdown_connections 2024-09-19T06:19:43.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.444+0000 7f1d49844740 1 --2- 172.21.15.3:0/180424114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558bf27deca0 0x558bf27e1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.444+0000 7f1d49844740 1 --2- 172.21.15.3:0/180424114 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bf27d43e0 0x558bf27de760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.444+0000 7f1d49844740 1 --2- 172.21.15.3:0/180424114 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d3ac0 0x558bf27d3ea0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.444+0000 7f1d49844740 1 -- 172.21.15.3:0/180424114 >> 172.21.15.3:0/180424114 conn(0x558bf27d0050 msgr2=0x558bf27d0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:43.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.444+0000 7f1d49844740 1 -- 172.21.15.3:0/180424114 shutdown_connections 2024-09-19T06:19:43.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.444+0000 7f1d49844740 1 -- 172.21.15.3:0/180424114 wait complete. 2024-09-19T06:19:43.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.445+0000 7f1d49844740 1 -- start start 2024-09-19T06:19:43.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.445+0000 7f1d49844740 1 Processor -- start 2024-09-19T06:19:43.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.445+0000 7f1d49844740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d3ac0 0x558bf27de580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.445+0000 7f1d49844740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bf27d43e0 0x558bf27db830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.445+0000 7f1d49844740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558bf27deca0 0x558bf27dbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.445+0000 7f1d49844740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558bf27e1910 con 0x558bf27d3ac0 2024-09-19T06:19:43.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.445+0000 7f1d49844740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558bf26f4fa0 con 0x558bf27deca0 2024-09-19T06:19:43.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.445+0000 7f1d49844740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558bf27e1a90 con 0x558bf27d43e0 2024-09-19T06:19:43.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.445+0000 7f1d49844740 10 client.0 _ll_register_callbacks cb 0x558bf2448ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:43.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.445+0000 7f1d3fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d3ac0 0x558bf27de580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.445+0000 7f1d3fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d3ac0 0x558bf27de580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40590/0 (socket says 172.21.15.3:40590) 2024-09-19T06:19:43.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.445+0000 7f1d3fe00640 1 -- 172.21.15.3:0/2111863656 learned_addr learned my addr 172.21.15.3:0/2111863656 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:43.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.445+0000 7f1d44e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558bf27deca0 0x558bf27dbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.446+0000 7f1d37400640 1 --2- 172.21.15.3:0/2111863656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bf27d43e0 0x558bf27db830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.446+0000 7f1d3fe00640 1 -- 172.21.15.3:0/2111863656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bf27d43e0 msgr2=0x558bf27db830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:43.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.446+0000 7f1d3fe00640 1 --2- 172.21.15.3:0/2111863656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bf27d43e0 0x558bf27db830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.446+0000 7f1d3fe00640 1 -- 172.21.15.3:0/2111863656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558bf27deca0 msgr2=0x558bf27dbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:43.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.446+0000 7f1d3fe00640 1 --2- 172.21.15.3:0/2111863656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558bf27deca0 0x558bf27dbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.446+0000 7f1d3fe00640 1 -- 172.21.15.3:0/2111863656 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bf27dc550 con 0x558bf27d3ac0 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.446+0000 7f1d44e00640 1 --2- 172.21.15.3:0/2111863656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558bf27deca0 0x558bf27dbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.446+0000 7f1d3fe00640 1 --2- 172.21.15.3:0/2111863656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d3ac0 0x558bf27de580 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1d30009900 tx=0x7f1d30009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af4c189c9cb5642 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.446+0000 7f1d2e000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.446+0000 7f1d2e000640 1 -- 172.21.15.3:0/2111863656 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3004e070 con 0x558bf27d3ac0 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.447+0000 7f1d2e000640 1 -- 172.21.15.3:0/2111863656 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f1d30004b90 con 0x558bf27d3ac0 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.447+0000 7f1d49844740 1 -- 172.21.15.3:0/2111863656 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d38004050 con 0x558bf27d3ac0 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.447+0000 7f1d2e000640 1 -- 172.21.15.3:0/2111863656 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1d3005a050 con 0x558bf27d3ac0 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.447+0000 7f1d49844740 10 client.17292 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.447+0000 7f1d49844740 1 -- 172.21.15.3:0/2111863656 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558bf27ed820 con 0x558bf27d3ac0 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.447+0000 7f1d2e000640 1 -- 172.21.15.3:0/2111863656 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d38004050 con 0x558bf27d3ac0 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.447+0000 7f1d2e000640 1 -- 172.21.15.3:0/2111863656 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f1d300036a0 con 0x558bf27d3ac0 2024-09-19T06:19:43.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.447+0000 7f1d49844740 10 client.17292 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.447+0000 7f1d49844740 10 client.17292 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.447+0000 7f1d49844740 20 client.17292 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.448+0000 7f1d49844740 1 --2- 172.21.15.3:0/2111863656 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558bf27eec30 0x558bf27f10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.448+0000 7f1d49844740 4 client.17292 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.448+0000 7f1d49844740 1 -- 172.21.15.3:0/2111863656 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558bf2747800 con 0x558bf27eec30 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.448+0000 7f1d37400640 1 --2- 172.21.15.3:0/2111863656 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558bf27eec30 0x558bf27f10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.448+0000 7f1d37400640 1 --2- 172.21.15.3:0/2111863656 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558bf27eec30 0x558bf27f10a0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d00434a24840971 server_cookie=b49f5045bc23ccb3 in_seq=0 out_seq=0 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.448+0000 7f1d2e000640 10 client.17292 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.449+0000 7f1d2e000640 1 -- 172.21.15.3:0/2111863656 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558bf2747800 con 0x558bf27eec30 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.449+0000 7f1d2e000640 10 client.17292 handle_command_reply: tid=0 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.449+0000 7f1d49844740 1 client.17292 shutdown 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.449+0000 7f1d49844740 1 -- 172.21.15.3:0/2111863656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d3ac0 msgr2=0x558bf27de580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.449+0000 7f1d49844740 1 --2- 172.21.15.3:0/2111863656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d3ac0 0x558bf27de580 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1d30009900 tx=0x7f1d30009260 comp rx=0 tx=0).stop 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.450+0000 7f1d49844740 1 -- 172.21.15.3:0/2111863656 shutdown_connections 2024-09-19T06:19:43.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.450+0000 7f1d49844740 1 --2- 172.21.15.3:0/2111863656 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558bf27eec30 0x558bf27f10a0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.450+0000 7f1d49844740 1 --2- 172.21.15.3:0/2111863656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558bf27deca0 0x558bf27dbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.450+0000 7f1d49844740 1 --2- 172.21.15.3:0/2111863656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bf27d43e0 0x558bf27db830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.450+0000 7f1d49844740 1 --2- 172.21.15.3:0/2111863656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d3ac0 0x558bf27de580 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.450+0000 7f1d2e000640 0 client.17292 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:43.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.450+0000 7f1d49844740 1 -- 172.21.15.3:0/2111863656 >> 172.21.15.3:0/2111863656 conn(0x558bf27d0050 msgr2=0x558bf27cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:43.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.450+0000 7f1d49844740 1 -- 172.21.15.3:0/2111863656 shutdown_connections 2024-09-19T06:19:43.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.450+0000 7f1d49844740 1 -- 172.21.15.3:0/2111863656 wait complete. 2024-09-19T06:19:43.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.450+0000 7f1d49844740 20 client.17292 trim_cache size 0 max 16384 2024-09-19T06:19:43.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.468+0000 7f1d49844740 1 Processor -- start 2024-09-19T06:19:43.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.469+0000 7f1d49844740 1 -- start start 2024-09-19T06:19:43.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.469+0000 7f1d49844740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558bf27d0050 0x558bf27d6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.469+0000 7f1d49844740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d3ac0 0x558bf27dd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.469+0000 7f1d49844740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bf27d43e0 0x558bf27f6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.469+0000 7f1d49844740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1d401b3f40 con 0x558bf27d3ac0 2024-09-19T06:19:43.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.469+0000 7f1d49844740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1d401b5a80 con 0x558bf27d0050 2024-09-19T06:19:43.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.469+0000 7f1d49844740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1d401b4610 con 0x558bf27d43e0 2024-09-19T06:19:43.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.469+0000 7f1d37400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d3ac0 0x558bf27dd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.469+0000 7f1d37400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d3ac0 0x558bf27dd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:40598/0 (socket says 172.21.15.3:40598) 2024-09-19T06:19:43.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.469+0000 7f1d37400640 1 -- 172.21.15.3:0/4202721815 learned_addr learned my addr 172.21.15.3:0/4202721815 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:43.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.469+0000 7f1d44e00640 1 --2- 172.21.15.3:0/4202721815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bf27d43e0 0x558bf27f6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.469+0000 7f1d3fe00640 1 --2- 172.21.15.3:0/4202721815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558bf27d0050 0x558bf27d6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.470+0000 7f1d44e00640 1 -- 172.21.15.3:0/4202721815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558bf27d0050 msgr2=0x558bf27d6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:43.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.470+0000 7f1d44e00640 1 --2- 172.21.15.3:0/4202721815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558bf27d0050 0x558bf27d6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.470+0000 7f1d44e00640 1 -- 172.21.15.3:0/4202721815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d3ac0 msgr2=0x558bf27dd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:43.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.470+0000 7f1d44e00640 1 --2- 172.21.15.3:0/4202721815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d3ac0 0x558bf27dd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.470+0000 7f1d44e00640 1 -- 172.21.15.3:0/4202721815 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bf27d1100 con 0x558bf27d43e0 2024-09-19T06:19:43.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.470+0000 7f1d37400640 1 --2- 172.21.15.3:0/4202721815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d3ac0 0x558bf27dd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:43.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.470+0000 7f1d44e00640 1 --2- 172.21.15.3:0/4202721815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bf27d43e0 0x558bf27f6960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1d38000f80 tx=0x7f1d38009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8d76ae629fba4ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:43.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.470+0000 7f1d34c00640 1 -- 172.21.15.3:0/4202721815 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d380042d0 con 0x558bf27d43e0 2024-09-19T06:19:43.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.470+0000 7f1d34c00640 1 -- 172.21.15.3:0/4202721815 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d38004d20 con 0x558bf27d43e0 2024-09-19T06:19:43.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.470+0000 7f1d34c00640 1 -- 172.21.15.3:0/4202721815 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d380057b0 con 0x558bf27d43e0 2024-09-19T06:19:43.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.471+0000 7f1d49844740 1 -- 172.21.15.3:0/4202721815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bf27d43e0 msgr2=0x558bf27f6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:43.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.471+0000 7f1d49844740 1 --2- 172.21.15.3:0/4202721815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bf27d43e0 0x558bf27f6960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1d38000f80 tx=0x7f1d38009bf0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.471+0000 7f1d49844740 1 -- 172.21.15.3:0/4202721815 shutdown_connections 2024-09-19T06:19:43.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.471+0000 7f1d49844740 1 --2- 172.21.15.3:0/4202721815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bf27d43e0 0x558bf27f6960 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.471+0000 7f1d49844740 1 --2- 172.21.15.3:0/4202721815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d3ac0 0x558bf27dd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.471+0000 7f1d49844740 1 --2- 172.21.15.3:0/4202721815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558bf27d0050 0x558bf27d6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.471+0000 7f1d49844740 1 -- 172.21.15.3:0/4202721815 >> 172.21.15.3:0/4202721815 conn(0x558bf27d7220 msgr2=0x558bf27dd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:43.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.471+0000 7f1d49844740 1 -- 172.21.15.3:0/4202721815 shutdown_connections 2024-09-19T06:19:43.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.471+0000 7f1d49844740 1 -- 172.21.15.3:0/4202721815 wait complete. 2024-09-19T06:19:43.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.472+0000 7f1d49844740 1 -- start start 2024-09-19T06:19:43.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.472+0000 7f1d49844740 1 Processor -- start 2024-09-19T06:19:43.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.473+0000 7f1d49844740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558bf27d0050 0x558bf27e3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.473+0000 7f1d49844740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bf27d3ac0 0x558bf27e3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.473+0000 7f1d49844740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d43e0 0x558bf28518f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.473+0000 7f1d49844740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1d401b53b0 con 0x558bf27d43e0 2024-09-19T06:19:43.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.473+0000 7f1d49844740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1d401b4ce0 con 0x558bf27d0050 2024-09-19T06:19:43.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.473+0000 7f1d49844740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1d401b1f40 con 0x558bf27d3ac0 2024-09-19T06:19:43.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.473+0000 7f1d49844740 10 client.0 _ll_register_callbacks cb 0x7f1d30009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:43.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.473+0000 7f1d37400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bf27d3ac0 0x558bf27e3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.473+0000 7f1d44e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d43e0 0x558bf28518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.473+0000 7f1d3fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558bf27d0050 0x558bf27e3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.473+0000 7f1d37400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bf27d3ac0 0x558bf27e3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:36116/0 (socket says 172.21.15.3:36116) 2024-09-19T06:19:43.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.473+0000 7f1d37400640 1 -- 172.21.15.3:0/3990752144 learned_addr learned my addr 172.21.15.3:0/3990752144 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:43.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.473+0000 7f1d3fe00640 1 -- 172.21.15.3:0/3990752144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bf27d3ac0 msgr2=0x558bf27e3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:43.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.473+0000 7f1d3fe00640 1 --2- 172.21.15.3:0/3990752144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bf27d3ac0 0x558bf27e3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.473+0000 7f1d3fe00640 1 -- 172.21.15.3:0/3990752144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d43e0 msgr2=0x558bf28518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:43.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.473+0000 7f1d3fe00640 1 --2- 172.21.15.3:0/3990752144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d43e0 0x558bf28518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.473+0000 7f1d3fe00640 1 -- 172.21.15.3:0/3990752144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bf2851fb0 con 0x558bf27d0050 2024-09-19T06:19:43.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.473+0000 7f1d37400640 1 --2- 172.21.15.3:0/3990752144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bf27d3ac0 0x558bf27e3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:43.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.473+0000 7f1d44e00640 1 --2- 172.21.15.3:0/3990752144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d43e0 0x558bf28518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:43.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.474+0000 7f1d3fe00640 1 --2- 172.21.15.3:0/3990752144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558bf27d0050 0x558bf27e3630 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1d30003c60 tx=0x7f1d30003680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c7aff5d2c3b0865 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:43.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.474+0000 7f1d2e000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:19:43.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.474+0000 7f1d2e000640 1 -- 172.21.15.3:0/3990752144 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d30062070 con 0x558bf27d0050 2024-09-19T06:19:43.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.474+0000 7f1d49844740 1 -- 172.21.15.3:0/3990752144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d38004d20 con 0x558bf27d0050 2024-09-19T06:19:43.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.474+0000 7f1d2e000640 1 -- 172.21.15.3:0/3990752144 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f1d30003ee0 con 0x558bf27d0050 2024-09-19T06:19:43.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.475+0000 7f1d2e000640 1 -- 172.21.15.3:0/3990752144 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1d3006e050 con 0x558bf27d0050 2024-09-19T06:19:43.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.475+0000 7f1d49844740 10 client.27338 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:43.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.475+0000 7f1d49844740 1 -- 172.21.15.3:0/3990752144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558bf285a510 con 0x558bf27d0050 2024-09-19T06:19:43.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.475+0000 7f1d2e000640 1 -- 172.21.15.3:0/3990752144 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d38004d20 con 0x558bf27d0050 2024-09-19T06:19:43.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.475+0000 7f1d2e000640 1 -- 172.21.15.3:0/3990752144 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f1d30032b30 con 0x558bf27d0050 2024-09-19T06:19:43.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.475+0000 7f1d49844740 10 client.27338 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:43.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.475+0000 7f1d49844740 10 client.27338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:43.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.475+0000 7f1d49844740 20 client.27338 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:43.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.475+0000 7f1d49844740 1 --2- 172.21.15.3:0/3990752144 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558bf27deca0 0x558bf285cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:43.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.475+0000 7f1d49844740 4 client.27338 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:19:43.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.475+0000 7f1d49844740 1 -- 172.21.15.3:0/3990752144 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558bf2741d10 con 0x558bf27deca0 2024-09-19T06:19:43.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.476+0000 7f1d37400640 1 --2- 172.21.15.3:0/3990752144 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558bf27deca0 0x558bf285cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:43.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.476+0000 7f1d37400640 1 --2- 172.21.15.3:0/3990752144 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558bf27deca0 0x558bf285cc40 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b3e288d2eb87f00 server_cookie=dae619f785d09911 in_seq=0 out_seq=0 2024-09-19T06:19:43.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.476+0000 7f1d2e000640 10 client.27338 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:43.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.477+0000 7f1d2e000640 1 -- 172.21.15.3:0/3990752144 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558bf2741d10 con 0x558bf27deca0 2024-09-19T06:19:43.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.477+0000 7f1d2e000640 10 client.27338 handle_command_reply: tid=0 2024-09-19T06:19:43.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.477+0000 7f1d49844740 1 client.27338 shutdown 2024-09-19T06:19:43.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.478+0000 7f1d49844740 1 -- 172.21.15.3:0/3990752144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558bf27d0050 msgr2=0x558bf27e3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:43.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.478+0000 7f1d49844740 1 --2- 172.21.15.3:0/3990752144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558bf27d0050 0x558bf27e3630 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1d30003c60 tx=0x7f1d30003680 comp rx=0 tx=0).stop 2024-09-19T06:19:43.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.478+0000 7f1d49844740 1 -- 172.21.15.3:0/3990752144 shutdown_connections 2024-09-19T06:19:43.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.478+0000 7f1d49844740 1 --2- 172.21.15.3:0/3990752144 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x558bf27deca0 0x558bf285cc40 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.478+0000 7f1d49844740 1 --2- 172.21.15.3:0/3990752144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558bf27d43e0 0x558bf28518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.478+0000 7f1d49844740 1 --2- 172.21.15.3:0/3990752144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558bf27d3ac0 0x558bf27e3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.478+0000 7f1d49844740 1 --2- 172.21.15.3:0/3990752144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558bf27d0050 0x558bf27e3630 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.478+0000 7f1d2e000640 0 client.27338 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:43.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.478+0000 7f1d49844740 1 -- 172.21.15.3:0/3990752144 >> 172.21.15.3:0/3990752144 conn(0x558bf27d7220 msgr2=0x558bf27cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:43.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.478+0000 7f1d49844740 1 -- 172.21.15.3:0/3990752144 shutdown_connections 2024-09-19T06:19:43.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.478+0000 7f1d49844740 1 -- 172.21.15.3:0/3990752144 wait complete. 2024-09-19T06:19:43.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.478+0000 7f1d49844740 20 client.27338 trim_cache size 0 max 16384 2024-09-19T06:19:43.481 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:19:43.481 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": 0, 2024-09-19T06:19:43.482 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_tag": "d8cb93a2-b2f5-48fe-9bb7-ba7f2b7a5be8", 2024-09-19T06:19:43.482 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": "asynchronous" 2024-09-19T06:19:43.482 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:19:43.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.479+0000 7f1d46e00640 1 -- 172.21.15.3:0/2994451971 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1d240a3430 msgr2=0x7f1d240a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:43.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.479+0000 7f1d46e00640 1 --2- 172.21.15.3:0/2994451971 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1d240a3430 0x7f1d240a58f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1d30000c00 tx=0x7f1d30005b50 comp rx=0 tx=0).stop 2024-09-19T06:19:43.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.479+0000 7f1d46e00640 1 -- 172.21.15.3:0/2994451971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d40074eb0 msgr2=0x7f1d4019f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:43.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.479+0000 7f1d46e00640 1 --2- 172.21.15.3:0/2994451971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d40074eb0 0x7f1d4019f030 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800e9f0 tx=0x7f1d2800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.479+0000 7f1d46e00640 1 -- 172.21.15.3:0/2994451971 shutdown_connections 2024-09-19T06:19:43.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.479+0000 7f1d46e00640 1 --2- 172.21.15.3:0/2994451971 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1d240a3430 0x7f1d240a58f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.479+0000 7f1d46e00640 1 --2- 172.21.15.3:0/2994451971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d40112b90 0x7f1d401a33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.479+0000 7f1d46e00640 1 --2- 172.21.15.3:0/2994451971 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d40074eb0 0x7f1d4019f030 secure :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800e9f0 tx=0x7f1d2800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.479+0000 7f1d46e00640 1 --2- 172.21.15.3:0/2994451971 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1d40074590 0x7f1d4019eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:43.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.479+0000 7f1d46e00640 1 -- 172.21.15.3:0/2994451971 >> 172.21.15.3:0/2994451971 conn(0x7f1d400fd8c0 msgr2=0x7f1d400ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:43.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.480+0000 7f1d46e00640 1 -- 172.21.15.3:0/2994451971 shutdown_connections 2024-09-19T06:19:43.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:43.480+0000 7f1d46e00640 1 -- 172.21.15.3:0/2994451971 wait complete. 2024-09-19T06:19:44.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:43 smithi059 ceph-mon[35138]: pgmap v225: 97 pgs: 97 active+clean; 4.5 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-09-19T06:19:44.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:43 smithi003 ceph-mon[30893]: pgmap v225: 97 pgs: 97 active+clean; 4.5 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-09-19T06:19:44.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:43 smithi071 ceph-mon[35662]: pgmap v225: 97 pgs: 97 active+clean; 4.5 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-09-19T06:19:44.436 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:19:44.817 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:45.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:44 smithi059 ceph-mon[35138]: scrub queued for path: / 2024-09-19T06:19:45.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:44 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:19:45.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:44 smithi059 ceph-mon[35138]: scrub summary: active paths [/] 2024-09-19T06:19:45.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:44 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:19:45.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:44 smithi003 ceph-mon[30893]: scrub queued for path: / 2024-09-19T06:19:45.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:44 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:19:45.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:44 smithi003 ceph-mon[30893]: scrub summary: active paths [/] 2024-09-19T06:19:45.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:44 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:19:45.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:44 smithi071 ceph-mon[35662]: scrub queued for path: / 2024-09-19T06:19:45.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:44 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:19:45.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:44 smithi071 ceph-mon[35662]: scrub summary: active paths [/] 2024-09-19T06:19:45.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:44 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:19:45.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.651+0000 7fcc15600640 1 -- 172.21.15.3:0/3659736689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc10103e30 msgr2=0x7fcc10104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:45.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.651+0000 7fcc15600640 1 --2- 172.21.15.3:0/3659736689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc10103e30 0x7fcc10104210 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fcc00009900 tx=0x7fcc0002a410 comp rx=0 tx=0).stop 2024-09-19T06:19:45.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.651+0000 7fcc15600640 1 -- 172.21.15.3:0/3659736689 shutdown_connections 2024-09-19T06:19:45.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.651+0000 7fcc15600640 1 --2- 172.21.15.3:0/3659736689 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc10108f60 0x7fcc10110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.651+0000 7fcc15600640 1 --2- 172.21.15.3:0/3659736689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc101047e0 0x7fcc10108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.651+0000 7fcc15600640 1 --2- 172.21.15.3:0/3659736689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc10103e30 0x7fcc10104210 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.651+0000 7fcc15600640 1 -- 172.21.15.3:0/3659736689 >> 172.21.15.3:0/3659736689 conn(0x7fcc100ff8d0 msgr2=0x7fcc10101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:45.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.652+0000 7fcc15600640 1 -- 172.21.15.3:0/3659736689 shutdown_connections 2024-09-19T06:19:45.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.652+0000 7fcc15600640 1 -- 172.21.15.3:0/3659736689 wait complete. 2024-09-19T06:19:45.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.653+0000 7fcc15600640 1 Processor -- start 2024-09-19T06:19:45.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.653+0000 7fcc15600640 1 -- start start 2024-09-19T06:19:45.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.653+0000 7fcc15600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc10103e30 0x7fcc1019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:45.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.653+0000 7fcc15600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc101047e0 0x7fcc1019a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:45.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.653+0000 7fcc15600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc10108f60 0x7fcc1019ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:45.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.653+0000 7fcc15600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcc10114010 con 0x7fcc10108f60 2024-09-19T06:19:45.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.653+0000 7fcc15600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcc10113e90 con 0x7fcc101047e0 2024-09-19T06:19:45.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.653+0000 7fcc15600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcc10114190 con 0x7fcc10103e30 2024-09-19T06:19:45.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.654+0000 7fcc14c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc10108f60 0x7fcc1019ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:45.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.654+0000 7fcc0fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc10103e30 0x7fcc1019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:45.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.654+0000 7fcc07400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc101047e0 0x7fcc1019a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:45.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.654+0000 7fcc0fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc10103e30 0x7fcc1019a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:55900/0 (socket says 172.21.15.3:55900) 2024-09-19T06:19:45.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.654+0000 7fcc0fe00640 1 -- 172.21.15.3:0/3141726819 learned_addr learned my addr 172.21.15.3:0/3141726819 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:45.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.654+0000 7fcc14c00640 1 -- 172.21.15.3:0/3141726819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc10103e30 msgr2=0x7fcc1019a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:45.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.654+0000 7fcc14c00640 1 --2- 172.21.15.3:0/3141726819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc10103e30 0x7fcc1019a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.654+0000 7fcc14c00640 1 -- 172.21.15.3:0/3141726819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc101047e0 msgr2=0x7fcc1019a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:45.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.654+0000 7fcc14c00640 1 --2- 172.21.15.3:0/3141726819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc101047e0 0x7fcc1019a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.654+0000 7fcc14c00640 1 -- 172.21.15.3:0/3141726819 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc1019f400 con 0x7fcc10108f60 2024-09-19T06:19:45.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.655+0000 7fcc14c00640 1 --2- 172.21.15.3:0/3141726819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc10108f60 0x7fcc1019ed20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fcc08009fd0 tx=0x7fcc0800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:45.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.655+0000 7fcc0d600640 1 -- 172.21.15.3:0/3141726819 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0800ce20 con 0x7fcc10108f60 2024-09-19T06:19:45.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.655+0000 7fcc15600640 1 -- 172.21.15.3:0/3141726819 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc1019f6f0 con 0x7fcc10108f60 2024-09-19T06:19:45.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.655+0000 7fcc0d600640 1 -- 172.21.15.3:0/3141726819 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc08005020 con 0x7fcc10108f60 2024-09-19T06:19:45.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.655+0000 7fcc0d600640 1 -- 172.21.15.3:0/3141726819 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc08010720 con 0x7fcc10108f60 2024-09-19T06:19:45.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.655+0000 7fcc15600640 1 -- 172.21.15.3:0/3141726819 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc101a6fd0 con 0x7fcc10108f60 2024-09-19T06:19:45.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.658+0000 7fcc197f3740 1 Processor -- start 2024-09-19T06:19:45.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.658+0000 7fcc0d600640 1 -- 172.21.15.3:0/3141726819 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fcc08005540 con 0x7fcc10108f60 2024-09-19T06:19:45.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.658+0000 7fcc197f3740 1 -- start start 2024-09-19T06:19:45.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.659+0000 7fcc197f3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643d4121d50 0x5643d4122130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:45.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.659+0000 7fcc197f3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d4122670 0x5643d412c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:45.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.659+0000 7fcc197f3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643d412cf30 0x5643d412f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:45.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.659+0000 7fcc197f3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5643d40883e0 con 0x5643d4122670 2024-09-19T06:19:45.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.659+0000 7fcc197f3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5643d402fd80 con 0x5643d412cf30 2024-09-19T06:19:45.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.659+0000 7fcc197f3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5643d40843a0 con 0x5643d4121d50 2024-09-19T06:19:45.660 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.659+0000 7fcc07400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643d4121d50 0x5643d4122130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:45.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.659+0000 7fcc07400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643d4121d50 0x5643d4122130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:55904/0 (socket says 172.21.15.3:55904) 2024-09-19T06:19:45.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.659+0000 7fcc07400640 1 -- 172.21.15.3:0/3298810729 learned_addr learned my addr 172.21.15.3:0/3298810729 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:45.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.659+0000 7fcc0fe00640 1 --2- 172.21.15.3:0/3298810729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d4122670 0x5643d412c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:45.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.659+0000 7fcc07400640 1 --2- 172.21.15.3:0/3298810729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643d412cf30 0x5643d412f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:45.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.660+0000 7fcc07400640 1 -- 172.21.15.3:0/3298810729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643d412cf30 msgr2=0x5643d412f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:45.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.660+0000 7fcc07400640 1 --2- 172.21.15.3:0/3298810729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643d412cf30 0x5643d412f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.660+0000 7fcc07400640 1 -- 172.21.15.3:0/3298810729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d4122670 msgr2=0x5643d412c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:45.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.660+0000 7fcc07400640 1 --2- 172.21.15.3:0/3298810729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d4122670 0x5643d412c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.660+0000 7fcc07400640 1 -- 172.21.15.3:0/3298810729 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643d404eae0 con 0x5643d4121d50 2024-09-19T06:19:45.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.660+0000 7fcc07400640 1 --2- 172.21.15.3:0/3298810729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643d4121d50 0x5643d4122130 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8009fd0 tx=0x7fcbf8009370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac83b66d446f40a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:45.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.660+0000 7fcc0d600640 1 --2- 172.21.15.3:0/3141726819 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcbf40a33b0 0x7fcbf40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:45.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.660+0000 7fcc05200640 1 -- 172.21.15.3:0/3298810729 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf800f790 con 0x5643d4121d50 2024-09-19T06:19:45.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.660+0000 7fcc05200640 1 -- 172.21.15.3:0/3298810729 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbf800fe10 con 0x5643d4121d50 2024-09-19T06:19:45.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.660+0000 7fcc05200640 1 -- 172.21.15.3:0/3298810729 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf801fdb0 con 0x5643d4121d50 2024-09-19T06:19:45.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.660+0000 7fcc0d600640 1 -- 172.21.15.3:0/3141726819 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7fcc080d0340 con 0x7fcc10108f60 2024-09-19T06:19:45.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.660+0000 7fcc0fe00640 1 --2- 172.21.15.3:0/3141726819 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcbf40a33b0 0x7fcbf40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:45.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.661+0000 7fcc197f3740 1 -- 172.21.15.3:0/3298810729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643d4121d50 msgr2=0x5643d4122130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:45.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.661+0000 7fcc197f3740 1 --2- 172.21.15.3:0/3298810729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643d4121d50 0x5643d4122130 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8009fd0 tx=0x7fcbf8009370 comp rx=0 tx=0).stop 2024-09-19T06:19:45.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.661+0000 7fcc0fe00640 1 --2- 172.21.15.3:0/3141726819 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcbf40a33b0 0x7fcbf40a5870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcc000096c0 tx=0x7fcc000046c0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:45.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.661+0000 7fcc197f3740 1 -- 172.21.15.3:0/3298810729 shutdown_connections 2024-09-19T06:19:45.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.661+0000 7fcc197f3740 1 --2- 172.21.15.3:0/3298810729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643d412cf30 0x5643d412f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.661+0000 7fcc197f3740 1 --2- 172.21.15.3:0/3298810729 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d4122670 0x5643d412c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.661+0000 7fcc197f3740 1 --2- 172.21.15.3:0/3298810729 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643d4121d50 0x5643d4122130 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.661+0000 7fcc197f3740 1 -- 172.21.15.3:0/3298810729 >> 172.21.15.3:0/3298810729 conn(0x5643d411e2e0 msgr2=0x5643d411e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:45.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.661+0000 7fcc197f3740 1 -- 172.21.15.3:0/3298810729 shutdown_connections 2024-09-19T06:19:45.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.661+0000 7fcc197f3740 1 -- 172.21.15.3:0/3298810729 wait complete. 2024-09-19T06:19:45.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.662+0000 7fcc197f3740 1 -- start start 2024-09-19T06:19:45.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.662+0000 7fcc197f3740 1 Processor -- start 2024-09-19T06:19:45.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.663+0000 7fcc197f3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d4121d50 0x5643d4129e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:45.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.663+0000 7fcc197f3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643d4122670 0x5643d412a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:45.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.663+0000 7fcc197f3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643d412cf30 0x5643d412a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:45.665 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.663+0000 7fcc197f3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5643d412fba0 con 0x5643d4121d50 2024-09-19T06:19:45.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.663+0000 7fcc197f3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5643d40430f0 con 0x5643d412cf30 2024-09-19T06:19:45.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.663+0000 7fcc197f3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5643d412fd20 con 0x5643d4122670 2024-09-19T06:19:45.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.663+0000 7fcc197f3740 10 client.0 _ll_register_callbacks cb 0x5643d40349e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:45.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.663+0000 7fcc0fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d4121d50 0x5643d4129e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:45.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.663+0000 7fcc0fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d4121d50 0x5643d4129e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45426/0 (socket says 172.21.15.3:45426) 2024-09-19T06:19:45.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.663+0000 7fcc0fe00640 1 -- 172.21.15.3:0/933766479 learned_addr learned my addr 172.21.15.3:0/933766479 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:45.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.663+0000 7fcc14c00640 1 --2- 172.21.15.3:0/933766479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643d412cf30 0x5643d412a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:45.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.663+0000 7fcc07400640 1 --2- 172.21.15.3:0/933766479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643d4122670 0x5643d412a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:45.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.663+0000 7fcc0fe00640 1 -- 172.21.15.3:0/933766479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643d4122670 msgr2=0x5643d412a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:45.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.663+0000 7fcc0fe00640 1 --2- 172.21.15.3:0/933766479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643d4122670 0x5643d412a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.663+0000 7fcc0fe00640 1 -- 172.21.15.3:0/933766479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643d412cf30 msgr2=0x5643d412a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:45.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.663+0000 7fcc0fe00640 1 --2- 172.21.15.3:0/933766479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643d412cf30 0x5643d412a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.663+0000 7fcc0fe00640 1 -- 172.21.15.3:0/933766479 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643d3df93c0 con 0x5643d4121d50 2024-09-19T06:19:45.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.664+0000 7fcc0fe00640 1 --2- 172.21.15.3:0/933766479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d4121d50 0x5643d4129e90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fcc00006010 tx=0x7fcc00009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc1033ed6744fd5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:45.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.664+0000 7fcbfd600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:19:45.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.664+0000 7fcbfd600640 1 -- 172.21.15.3:0/933766479 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0004e070 con 0x5643d4121d50 2024-09-19T06:19:45.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.664+0000 7fcbfd600640 1 -- 172.21.15.3:0/933766479 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7fcc00031c70 con 0x5643d4121d50 2024-09-19T06:19:45.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.664+0000 7fcc197f3740 1 -- 172.21.15.3:0/933766479 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbf800fe10 con 0x5643d4121d50 2024-09-19T06:19:45.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.664+0000 7fcbfd600640 1 -- 172.21.15.3:0/933766479 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcc0005a050 con 0x5643d4121d50 2024-09-19T06:19:45.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.664+0000 7fcc197f3740 10 client.17310 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:45.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.664+0000 7fcc197f3740 1 -- 172.21.15.3:0/933766479 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5643d413b900 con 0x5643d4121d50 2024-09-19T06:19:45.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.665+0000 7fcbfd600640 1 -- 172.21.15.3:0/933766479 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbf800fe10 con 0x5643d4121d50 2024-09-19T06:19:45.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.665+0000 7fcbfd600640 1 -- 172.21.15.3:0/933766479 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fcc0004a680 con 0x5643d4121d50 2024-09-19T06:19:45.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.665+0000 7fcc197f3740 10 client.17310 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:45.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.665+0000 7fcc197f3740 10 client.17310 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:45.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.665+0000 7fcc197f3740 20 client.17310 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:45.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.665+0000 7fcc197f3740 1 --2- 172.21.15.3:0/933766479 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5643d413cdd0 0x5643d413f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:45.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.665+0000 7fcc197f3740 4 client.17310 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:45.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.665+0000 7fcc197f3740 1 -- 172.21.15.3:0/933766479 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643d4095950 con 0x5643d413cdd0 2024-09-19T06:19:45.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.666+0000 7fcc07400640 1 --2- 172.21.15.3:0/933766479 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5643d413cdd0 0x5643d413f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:45.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.666+0000 7fcc07400640 1 --2- 172.21.15.3:0/933766479 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5643d413cdd0 0x5643d413f230 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78aecf37d6935239 server_cookie=4f67dd161a298268 in_seq=0 out_seq=0 2024-09-19T06:19:45.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.666+0000 7fcbfd600640 10 client.17310 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:45.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.667+0000 7fcbfd600640 1 -- 172.21.15.3:0/933766479 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5643d4095950 con 0x5643d413cdd0 2024-09-19T06:19:45.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.667+0000 7fcbfd600640 10 client.17310 handle_command_reply: tid=0 2024-09-19T06:19:45.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.667+0000 7fcc197f3740 1 client.17310 shutdown 2024-09-19T06:19:45.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.667+0000 7fcc197f3740 1 -- 172.21.15.3:0/933766479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d4121d50 msgr2=0x5643d4129e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:45.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.667+0000 7fcc197f3740 1 --2- 172.21.15.3:0/933766479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d4121d50 0x5643d4129e90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fcc00006010 tx=0x7fcc00009260 comp rx=0 tx=0).stop 2024-09-19T06:19:45.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.667+0000 7fcc197f3740 1 -- 172.21.15.3:0/933766479 shutdown_connections 2024-09-19T06:19:45.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.667+0000 7fcc197f3740 1 --2- 172.21.15.3:0/933766479 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5643d413cdd0 0x5643d413f230 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.667+0000 7fcc197f3740 1 --2- 172.21.15.3:0/933766479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643d412cf30 0x5643d412a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.667+0000 7fcc197f3740 1 --2- 172.21.15.3:0/933766479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643d4122670 0x5643d412a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.667+0000 7fcc197f3740 1 --2- 172.21.15.3:0/933766479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d4121d50 0x5643d4129e90 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.667+0000 7fcc197f3740 1 -- 172.21.15.3:0/933766479 >> 172.21.15.3:0/933766479 conn(0x5643d411e2e0 msgr2=0x5643d4124010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:45.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.667+0000 7fcbfd600640 0 client.17310 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:45.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.668+0000 7fcc197f3740 1 -- 172.21.15.3:0/933766479 shutdown_connections 2024-09-19T06:19:45.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.668+0000 7fcc197f3740 1 -- 172.21.15.3:0/933766479 wait complete. 2024-09-19T06:19:45.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.668+0000 7fcc197f3740 20 client.17310 trim_cache size 0 max 16384 2024-09-19T06:19:45.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.686+0000 7fcc197f3740 1 Processor -- start 2024-09-19T06:19:45.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.686+0000 7fcc197f3740 1 -- start start 2024-09-19T06:19:45.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.686+0000 7fcc197f3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643d4121d50 0x5643d4124800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:45.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.686+0000 7fcc197f3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643d4122670 0x5643d412be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:45.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.686+0000 7fcc197f3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d412cf30 0x5643d4144b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:45.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.686+0000 7fcc197f3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcc101af910 con 0x5643d412cf30 2024-09-19T06:19:45.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.686+0000 7fcc197f3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcc101b1450 con 0x5643d4122670 2024-09-19T06:19:45.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.686+0000 7fcc197f3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcc101affe0 con 0x5643d4121d50 2024-09-19T06:19:45.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.687+0000 7fcc14c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d412cf30 0x5643d4144b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:45.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.687+0000 7fcc14c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d412cf30 0x5643d4144b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45432/0 (socket says 172.21.15.3:45432) 2024-09-19T06:19:45.689 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.687+0000 7fcc14c00640 1 -- 172.21.15.3:0/1425206537 learned_addr learned my addr 172.21.15.3:0/1425206537 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:45.689 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.687+0000 7fcc0fe00640 1 --2- 172.21.15.3:0/1425206537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643d4121d50 0x5643d4124800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:45.689 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.687+0000 7fcc07400640 1 --2- 172.21.15.3:0/1425206537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643d4122670 0x5643d412be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:45.689 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.687+0000 7fcc14c00640 1 -- 172.21.15.3:0/1425206537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643d4121d50 msgr2=0x5643d4124800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:45.689 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.687+0000 7fcc14c00640 1 --2- 172.21.15.3:0/1425206537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643d4121d50 0x5643d4124800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.689 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.687+0000 7fcc14c00640 1 -- 172.21.15.3:0/1425206537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643d4122670 msgr2=0x5643d412be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:45.689 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.687+0000 7fcc14c00640 1 --2- 172.21.15.3:0/1425206537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643d4122670 0x5643d412be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.689 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.687+0000 7fcc14c00640 1 -- 172.21.15.3:0/1425206537 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643d4121b80 con 0x5643d412cf30 2024-09-19T06:19:45.689 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.687+0000 7fcc14c00640 1 --2- 172.21.15.3:0/1425206537 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d412cf30 0x5643d4144b00 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fcc0800c760 tx=0x7fcc080058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd35d23e7c4114e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:45.689 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.688+0000 7fcbffe00640 1 -- 172.21.15.3:0/1425206537 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc080b4070 con 0x5643d412cf30 2024-09-19T06:19:45.689 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.688+0000 7fcbffe00640 1 -- 172.21.15.3:0/1425206537 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc080a0940 con 0x5643d412cf30 2024-09-19T06:19:45.689 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.688+0000 7fcbffe00640 1 -- 172.21.15.3:0/1425206537 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc08098c00 con 0x5643d412cf30 2024-09-19T06:19:45.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.688+0000 7fcc197f3740 1 -- 172.21.15.3:0/1425206537 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d412cf30 msgr2=0x5643d4144b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:45.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.688+0000 7fcc197f3740 1 --2- 172.21.15.3:0/1425206537 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d412cf30 0x5643d4144b00 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fcc0800c760 tx=0x7fcc080058b0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.688+0000 7fcc197f3740 1 -- 172.21.15.3:0/1425206537 shutdown_connections 2024-09-19T06:19:45.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.688+0000 7fcc197f3740 1 --2- 172.21.15.3:0/1425206537 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d412cf30 0x5643d4144b00 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.688+0000 7fcc197f3740 1 --2- 172.21.15.3:0/1425206537 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643d4122670 0x5643d412be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.688+0000 7fcc197f3740 1 --2- 172.21.15.3:0/1425206537 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643d4121d50 0x5643d4124800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.688+0000 7fcc197f3740 1 -- 172.21.15.3:0/1425206537 >> 172.21.15.3:0/1425206537 conn(0x5643d411e2e0 msgr2=0x5643d412b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:45.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.688+0000 7fcc197f3740 1 -- 172.21.15.3:0/1425206537 shutdown_connections 2024-09-19T06:19:45.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.688+0000 7fcc197f3740 1 -- 172.21.15.3:0/1425206537 wait complete. 2024-09-19T06:19:45.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.689+0000 7fcc197f3740 1 -- start start 2024-09-19T06:19:45.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.689+0000 7fcc197f3740 1 Processor -- start 2024-09-19T06:19:45.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.690+0000 7fcc197f3740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d4121d50 0x5643d4135180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:45.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.690+0000 7fcc197f3740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643d4122670 0x5643d41356c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:45.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.690+0000 7fcc197f3740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643d412cf30 0x5643d4131f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:45.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.690+0000 7fcc197f3740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcc101b0d80 con 0x5643d4121d50 2024-09-19T06:19:45.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.690+0000 7fcc197f3740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fcc101b06b0 con 0x5643d412cf30 2024-09-19T06:19:45.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.690+0000 7fcc197f3740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fcc101ad910 con 0x5643d4122670 2024-09-19T06:19:45.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.690+0000 7fcc197f3740 10 client.0 _ll_register_callbacks cb 0x7fcc000043a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:45.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.690+0000 7fcc0fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d4121d50 0x5643d4135180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:45.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.690+0000 7fcc0fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d4121d50 0x5643d4135180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45442/0 (socket says 172.21.15.3:45442) 2024-09-19T06:19:45.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.690+0000 7fcc0fe00640 1 -- 172.21.15.3:0/585605912 learned_addr learned my addr 172.21.15.3:0/585605912 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:45.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.690+0000 7fcc14c00640 1 --2- 172.21.15.3:0/585605912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643d412cf30 0x5643d4131f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:45.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.690+0000 7fcc07400640 1 --2- 172.21.15.3:0/585605912 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643d4122670 0x5643d41356c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:45.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.690+0000 7fcc0fe00640 1 -- 172.21.15.3:0/585605912 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643d4122670 msgr2=0x5643d41356c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:45.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.690+0000 7fcc0fe00640 1 --2- 172.21.15.3:0/585605912 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643d4122670 0x5643d41356c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.690+0000 7fcc0fe00640 1 -- 172.21.15.3:0/585605912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643d412cf30 msgr2=0x5643d4131f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:45.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.690+0000 7fcc0fe00640 1 --2- 172.21.15.3:0/585605912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643d412cf30 0x5643d4131f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.690+0000 7fcc0fe00640 1 -- 172.21.15.3:0/585605912 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643d41326b0 con 0x5643d4121d50 2024-09-19T06:19:45.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.691+0000 7fcc0fe00640 1 --2- 172.21.15.3:0/585605912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d4121d50 0x5643d4135180 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fcc00031550 tx=0x7fcc00032df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed7398dbcaa6894c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:45.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.691+0000 7fcbfd600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:19:45.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.691+0000 7fcbfd600640 1 -- 172.21.15.3:0/585605912 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc00063020 con 0x5643d4121d50 2024-09-19T06:19:45.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.691+0000 7fcbfd600640 1 -- 172.21.15.3:0/585605912 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7fcc0003d450 con 0x5643d4121d50 2024-09-19T06:19:45.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.691+0000 7fcc197f3740 1 -- 172.21.15.3:0/585605912 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc080a0940 con 0x5643d4121d50 2024-09-19T06:19:45.695 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.691+0000 7fcbfd600640 1 -- 172.21.15.3:0/585605912 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcc0006e050 con 0x5643d4121d50 2024-09-19T06:19:45.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.691+0000 7fcc197f3740 10 client.17316 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:45.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.691+0000 7fcc197f3740 1 -- 172.21.15.3:0/585605912 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5643d41a84f0 con 0x5643d4121d50 2024-09-19T06:19:45.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.692+0000 7fcbfd600640 1 -- 172.21.15.3:0/585605912 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc080a0940 con 0x5643d4121d50 2024-09-19T06:19:45.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.692+0000 7fcbfd600640 1 -- 172.21.15.3:0/585605912 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fcc000535d0 con 0x5643d4121d50 2024-09-19T06:19:45.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.692+0000 7fcc197f3740 10 client.17316 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:45.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.692+0000 7fcc197f3740 10 client.17316 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:45.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.692+0000 7fcc197f3740 20 client.17316 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:45.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.692+0000 7fcc197f3740 1 --2- 172.21.15.3:0/585605912 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5643d41a8cc0 0x5643d41ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:45.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.692+0000 7fcc197f3740 4 client.17316 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:19:45.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.692+0000 7fcc197f3740 1 -- 172.21.15.3:0/585605912 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5643d408fe60 con 0x5643d41a8cc0 2024-09-19T06:19:45.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.692+0000 7fcc07400640 1 --2- 172.21.15.3:0/585605912 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5643d41a8cc0 0x5643d41ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:45.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.693+0000 7fcc07400640 1 --2- 172.21.15.3:0/585605912 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5643d41a8cc0 0x5643d41ab0e0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d56c87c1badaef7d server_cookie=9fbe60dd989c0993 in_seq=0 out_seq=0 2024-09-19T06:19:45.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.693+0000 7fcbfd600640 10 client.17316 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:45.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.693+0000 7fcbfd600640 1 -- 172.21.15.3:0/585605912 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5643d408fe60 con 0x5643d41a8cc0 2024-09-19T06:19:45.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.693+0000 7fcbfd600640 10 client.17316 handle_command_reply: tid=0 2024-09-19T06:19:45.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.693+0000 7fcc197f3740 1 client.17316 shutdown 2024-09-19T06:19:45.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.693+0000 7fcc197f3740 1 -- 172.21.15.3:0/585605912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d4121d50 msgr2=0x5643d4135180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:45.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.693+0000 7fcc197f3740 1 --2- 172.21.15.3:0/585605912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d4121d50 0x5643d4135180 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fcc00031550 tx=0x7fcc00032df0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.694+0000 7fcc197f3740 1 -- 172.21.15.3:0/585605912 shutdown_connections 2024-09-19T06:19:45.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.694+0000 7fcc197f3740 1 --2- 172.21.15.3:0/585605912 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5643d41a8cc0 0x5643d41ab0e0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.694+0000 7fcc197f3740 1 --2- 172.21.15.3:0/585605912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643d412cf30 0x5643d4131f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.694+0000 7fcc197f3740 1 --2- 172.21.15.3:0/585605912 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643d4122670 0x5643d41356c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.694+0000 7fcc197f3740 1 --2- 172.21.15.3:0/585605912 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5643d4121d50 0x5643d4135180 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.694+0000 7fcc197f3740 1 -- 172.21.15.3:0/585605912 >> 172.21.15.3:0/585605912 conn(0x5643d411e2e0 msgr2=0x5643d412a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:45.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.694+0000 7fcbfd600640 0 client.17316 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:45.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.694+0000 7fcc197f3740 1 -- 172.21.15.3:0/585605912 shutdown_connections 2024-09-19T06:19:45.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.694+0000 7fcc197f3740 1 -- 172.21.15.3:0/585605912 wait complete. 2024-09-19T06:19:45.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.694+0000 7fcc197f3740 20 client.17316 trim_cache size 0 max 16384 2024-09-19T06:19:45.698 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:19:45.698 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "no active scrubs running", 2024-09-19T06:19:45.698 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": {} 2024-09-19T06:19:45.698 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:19:45.699 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.694+0000 7fcc15600640 1 -- 172.21.15.3:0/3141726819 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcbf40a33b0 msgr2=0x7fcbf40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:45.699 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.694+0000 7fcc15600640 1 --2- 172.21.15.3:0/3141726819 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcbf40a33b0 0x7fcbf40a5870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcc000096c0 tx=0x7fcc000046c0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.699 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.695+0000 7fcc15600640 1 -- 172.21.15.3:0/3141726819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc10108f60 msgr2=0x7fcc1019ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:45.699 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.695+0000 7fcc15600640 1 --2- 172.21.15.3:0/3141726819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc10108f60 0x7fcc1019ed20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fcc08009fd0 tx=0x7fcc0800ef10 comp rx=0 tx=0).stop 2024-09-19T06:19:45.699 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.695+0000 7fcc15600640 1 -- 172.21.15.3:0/3141726819 shutdown_connections 2024-09-19T06:19:45.699 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.695+0000 7fcc15600640 1 --2- 172.21.15.3:0/3141726819 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fcbf40a33b0 0x7fcbf40a5870 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.699 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.695+0000 7fcc15600640 1 --2- 172.21.15.3:0/3141726819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcc10108f60 0x7fcc1019ed20 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.699 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.695+0000 7fcc15600640 1 --2- 172.21.15.3:0/3141726819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc101047e0 0x7fcc1019a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.699 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.695+0000 7fcc15600640 1 --2- 172.21.15.3:0/3141726819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fcc10103e30 0x7fcc1019a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:45.699 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.695+0000 7fcc15600640 1 -- 172.21.15.3:0/3141726819 >> 172.21.15.3:0/3141726819 conn(0x7fcc100ff8d0 msgr2=0x7fcc10100bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:45.699 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.695+0000 7fcc15600640 1 -- 172.21.15.3:0/3141726819 shutdown_connections 2024-09-19T06:19:45.699 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:45.695+0000 7fcc15600640 1 -- 172.21.15.3:0/3141726819 wait complete. 2024-09-19T06:19:46.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:45 smithi059 ceph-mon[35138]: pgmap v226: 97 pgs: 97 active+clean; 4.7 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 23 op/s 2024-09-19T06:19:46.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:45 smithi059 ceph-mon[35138]: scrub summary: idle 2024-09-19T06:19:46.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:45 smithi003 ceph-mon[30893]: pgmap v226: 97 pgs: 97 active+clean; 4.7 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 23 op/s 2024-09-19T06:19:46.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:45 smithi003 ceph-mon[30893]: scrub summary: idle 2024-09-19T06:19:46.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:45 smithi071 ceph-mon[35662]: pgmap v226: 97 pgs: 97 active+clean; 4.7 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 23 op/s 2024-09-19T06:19:46.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:45 smithi071 ceph-mon[35662]: scrub summary: idle 2024-09-19T06:19:46.523 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:19:46.523 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:19:46.904 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:47.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.500+0000 7fbe0ce00640 1 -- 172.21.15.3:0/1662384852 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe08109140 msgr2=0x7fbe08110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:47.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.500+0000 7fbe0ce00640 1 --2- 172.21.15.3:0/1662384852 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe08109140 0x7fbe08110cc0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009ca0 tx=0x7fbe0002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:19:47.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.500+0000 7fbe0ce00640 1 -- 172.21.15.3:0/1662384852 shutdown_connections 2024-09-19T06:19:47.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.500+0000 7fbe0ce00640 1 --2- 172.21.15.3:0/1662384852 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe08109140 0x7fbe08110cc0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:47.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.500+0000 7fbe0ce00640 1 --2- 172.21.15.3:0/1662384852 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe081049c0 0x7fbe08108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:47.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.500+0000 7fbe0ce00640 1 --2- 172.21.15.3:0/1662384852 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe08104010 0x7fbe081043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:47.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.500+0000 7fbe0ce00640 1 -- 172.21.15.3:0/1662384852 >> 172.21.15.3:0/1662384852 conn(0x7fbe080ffa50 msgr2=0x7fbe08101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:47.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.500+0000 7fbe0ce00640 1 -- 172.21.15.3:0/1662384852 shutdown_connections 2024-09-19T06:19:47.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.500+0000 7fbe0ce00640 1 -- 172.21.15.3:0/1662384852 wait complete. 2024-09-19T06:19:47.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.501+0000 7fbe0ce00640 1 Processor -- start 2024-09-19T06:19:47.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.501+0000 7fbe0ce00640 1 -- start start 2024-09-19T06:19:47.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.501+0000 7fbe0ce00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe08104010 0x7fbe0819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:47.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.501+0000 7fbe0ce00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe081049c0 0x7fbe0819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:47.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.501+0000 7fbe0ce00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe08109140 0x7fbe0819ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:47.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.501+0000 7fbe0ce00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbe08114170 con 0x7fbe08104010 2024-09-19T06:19:47.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.501+0000 7fbe0ce00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbe08113ff0 con 0x7fbe08109140 2024-09-19T06:19:47.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.501+0000 7fbe0ce00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbe081142f0 con 0x7fbe081049c0 2024-09-19T06:19:47.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.501+0000 7fbe05e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe08104010 0x7fbe0819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:47.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.501+0000 7fbe05e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe08104010 0x7fbe0819a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45460/0 (socket says 172.21.15.3:45460) 2024-09-19T06:19:47.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.501+0000 7fbe05e00640 1 -- 172.21.15.3:0/325449869 learned_addr learned my addr 172.21.15.3:0/325449869 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:47.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.502+0000 7fbdfd400640 1 --2- 172.21.15.3:0/325449869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe081049c0 0x7fbe0819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:47.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.502+0000 7fbe06800640 1 --2- 172.21.15.3:0/325449869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe08109140 0x7fbe0819ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:47.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.502+0000 7fbe05e00640 1 -- 172.21.15.3:0/325449869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe081049c0 msgr2=0x7fbe0819ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:47.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.502+0000 7fbe05e00640 1 --2- 172.21.15.3:0/325449869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe081049c0 0x7fbe0819ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:47.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.502+0000 7fbe05e00640 1 -- 172.21.15.3:0/325449869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe08109140 msgr2=0x7fbe0819ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:47.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.502+0000 7fbe05e00640 1 --2- 172.21.15.3:0/325449869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe08109140 0x7fbe0819ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:47.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.502+0000 7fbe05e00640 1 -- 172.21.15.3:0/325449869 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0819f5e0 con 0x7fbe08104010 2024-09-19T06:19:47.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.502+0000 7fbe05e00640 1 --2- 172.21.15.3:0/325449869 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe08104010 0x7fbe0819a630 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800d950 tx=0x7fbdf800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:47.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.503+0000 7fbdff400640 1 -- 172.21.15.3:0/325449869 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8017030 con 0x7fbe08104010 2024-09-19T06:19:47.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.503+0000 7fbe0ce00640 1 -- 172.21.15.3:0/325449869 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe0819f8d0 con 0x7fbe08104010 2024-09-19T06:19:47.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.503+0000 7fbdff400640 1 -- 172.21.15.3:0/325449869 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbdf8004020 con 0x7fbe08104010 2024-09-19T06:19:47.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.503+0000 7fbdff400640 1 -- 172.21.15.3:0/325449869 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf80047a0 con 0x7fbe08104010 2024-09-19T06:19:47.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.503+0000 7fbe0ce00640 1 -- 172.21.15.3:0/325449869 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe081a71b0 con 0x7fbe08104010 2024-09-19T06:19:47.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.504+0000 7fbe0ce00640 1 -- 172.21.15.3:0/325449869 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe081043f0 con 0x7fbe08104010 2024-09-19T06:19:47.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.506+0000 7fbdff400640 1 -- 172.21.15.3:0/325449869 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fbdf80041d0 con 0x7fbe08104010 2024-09-19T06:19:47.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.507+0000 7fbdff400640 1 --2- 172.21.15.3:0/325449869 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbdec0a33b0 0x7fbdec0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:47.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.507+0000 7fbdff400640 1 -- 172.21.15.3:0/325449869 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7fbdf80cf6e0 con 0x7fbe08104010 2024-09-19T06:19:47.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.507+0000 7fbdfd400640 1 --2- 172.21.15.3:0/325449869 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbdec0a33b0 0x7fbdec0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:47.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.508+0000 7fbdfd400640 1 --2- 172.21.15.3:0/325449869 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbdec0a33b0 0x7fbdec0a5870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbe0810ab10 tx=0x7fbdf000b390 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:47.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.511+0000 7fbdff400640 1 -- 172.21.15.3:0/325449869 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbdf809c030 con 0x7fbe08104010 2024-09-19T06:19:47.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.734+0000 7fbe0ce00640 1 -- 172.21.15.3:0/325449869 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe0810c3b0 con 0x7fbe08104010 2024-09-19T06:19:47.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.735+0000 7fbdff400640 1 -- 172.21.15.3:0/325449869 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7fbdf809b930 con 0x7fbe08104010 2024-09-19T06:19:47.737 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:19:47.737 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"btime":"2024-09-19T06:12:22:958217+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:12:22.060987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24532,24515,24514,14517]},"id":1}]} 2024-09-19T06:19:47.738 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2024-09-19T06:19:47.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.737+0000 7fbe0ce00640 1 -- 172.21.15.3:0/325449869 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbdec0a33b0 msgr2=0x7fbdec0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:47.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.737+0000 7fbe0ce00640 1 --2- 172.21.15.3:0/325449869 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbdec0a33b0 0x7fbdec0a5870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbe0810ab10 tx=0x7fbdf000b390 comp rx=0 tx=0).stop 2024-09-19T06:19:47.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.737+0000 7fbe0ce00640 1 -- 172.21.15.3:0/325449869 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe08104010 msgr2=0x7fbe0819a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:47.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.737+0000 7fbe0ce00640 1 --2- 172.21.15.3:0/325449869 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe08104010 0x7fbe0819a630 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800d950 tx=0x7fbdf800de10 comp rx=0 tx=0).stop 2024-09-19T06:19:47.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.737+0000 7fbe0ce00640 1 -- 172.21.15.3:0/325449869 shutdown_connections 2024-09-19T06:19:47.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.737+0000 7fbe0ce00640 1 --2- 172.21.15.3:0/325449869 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbdec0a33b0 0x7fbdec0a5870 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:47.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.738+0000 7fbe0ce00640 1 --2- 172.21.15.3:0/325449869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe08109140 0x7fbe0819ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:47.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.738+0000 7fbe0ce00640 1 --2- 172.21.15.3:0/325449869 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe081049c0 0x7fbe0819ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:47.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.738+0000 7fbe0ce00640 1 --2- 172.21.15.3:0/325449869 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe08104010 0x7fbe0819a630 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:47.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.738+0000 7fbe0ce00640 1 -- 172.21.15.3:0/325449869 >> 172.21.15.3:0/325449869 conn(0x7fbe080ffa50 msgr2=0x7fbe08100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:47.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.738+0000 7fbe0ce00640 1 -- 172.21.15.3:0/325449869 shutdown_connections 2024-09-19T06:19:47.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:47.738+0000 7fbe0ce00640 1 -- 172.21.15.3:0/325449869 wait complete. 2024-09-19T06:19:48.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:47 smithi003 ceph-mon[30893]: pgmap v227: 97 pgs: 97 active+clean; 4.7 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 16 op/s 2024-09-19T06:19:48.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:47 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/325449869' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:19:48.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:47 smithi059 ceph-mon[35138]: pgmap v227: 97 pgs: 97 active+clean; 4.7 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 16 op/s 2024-09-19T06:19:48.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:47 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/325449869' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:19:48.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:47 smithi071 ceph-mon[35662]: pgmap v227: 97 pgs: 97 active+clean; 4.7 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 16 op/s 2024-09-19T06:19:48.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:47 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/325449869' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:19:48.523 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:19:48.902 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:49.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.518+0000 7efd9e000640 1 -- 172.21.15.3:0/4027224272 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd98074ee0 msgr2=0x7efd9810dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:49.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.518+0000 7efd9e000640 1 --2- 172.21.15.3:0/4027224272 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd98074ee0 0x7efd9810dd20 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7efd84009860 tx=0x7efd8402a3d0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.518+0000 7efd9e000640 1 -- 172.21.15.3:0/4027224272 shutdown_connections 2024-09-19T06:19:49.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.518+0000 7efd9e000640 1 --2- 172.21.15.3:0/4027224272 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd9810e260 0x7efd98110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.518+0000 7efd9e000640 1 --2- 172.21.15.3:0/4027224272 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd98074ee0 0x7efd9810dd20 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.518+0000 7efd9e000640 1 --2- 172.21.15.3:0/4027224272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd980745c0 0x7efd980749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.518+0000 7efd9e000640 1 -- 172.21.15.3:0/4027224272 >> 172.21.15.3:0/4027224272 conn(0x7efd980fd740 msgr2=0x7efd980ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:49.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.518+0000 7efd9e000640 1 -- 172.21.15.3:0/4027224272 shutdown_connections 2024-09-19T06:19:49.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.518+0000 7efd9e000640 1 -- 172.21.15.3:0/4027224272 wait complete. 2024-09-19T06:19:49.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.519+0000 7efd9e000640 1 Processor -- start 2024-09-19T06:19:49.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.520+0000 7efd9e000640 1 -- start start 2024-09-19T06:19:49.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.520+0000 7efd9e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd980745c0 0x7efd9819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.520+0000 7efd9e000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd98074ee0 0x7efd9819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.520+0000 7efd9e000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd9810e260 0x7efd9819ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.520+0000 7efd9e000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7efd98114000 con 0x7efd9810e260 2024-09-19T06:19:49.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.520+0000 7efd9e000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efd98113e80 con 0x7efd980745c0 2024-09-19T06:19:49.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.520+0000 7efd9e000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efd98114180 con 0x7efd98074ee0 2024-09-19T06:19:49.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.520+0000 7efd9d600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd9810e260 0x7efd9819ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.520+0000 7efd97e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd98074ee0 0x7efd9819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.520+0000 7efd9d600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd9810e260 0x7efd9819ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45470/0 (socket says 172.21.15.3:45470) 2024-09-19T06:19:49.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.521+0000 7efd9d600640 1 -- 172.21.15.3:0/562937716 learned_addr learned my addr 172.21.15.3:0/562937716 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:49.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.520+0000 7efd9cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd980745c0 0x7efd9819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.520+0000 7efd97e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd98074ee0 0x7efd9819a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:55968/0 (socket says 172.21.15.3:55968) 2024-09-19T06:19:49.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.521+0000 7efd9d600640 1 -- 172.21.15.3:0/562937716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd98074ee0 msgr2=0x7efd9819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:49.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.521+0000 7efd9d600640 1 --2- 172.21.15.3:0/562937716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd98074ee0 0x7efd9819a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.521+0000 7efd9d600640 1 -- 172.21.15.3:0/562937716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd980745c0 msgr2=0x7efd9819a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:49.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.521+0000 7efd9d600640 1 --2- 172.21.15.3:0/562937716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd980745c0 0x7efd9819a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.521+0000 7efd9d600640 1 -- 172.21.15.3:0/562937716 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9819f450 con 0x7efd9810e260 2024-09-19T06:19:49.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.521+0000 7efd9cc00640 1 --2- 172.21.15.3:0/562937716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd980745c0 0x7efd9819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:49.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.521+0000 7efd9d600640 1 --2- 172.21.15.3:0/562937716 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd9810e260 0x7efd9819ed70 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7efd9000e9d0 tx=0x7efd9000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:49.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.521+0000 7efd95600640 1 -- 172.21.15.3:0/562937716 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9000cd80 con 0x7efd9810e260 2024-09-19T06:19:49.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.522+0000 7efd95600640 1 -- 172.21.15.3:0/562937716 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd90005020 con 0x7efd9810e260 2024-09-19T06:19:49.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.522+0000 7efd9e000640 1 -- 172.21.15.3:0/562937716 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd9819f740 con 0x7efd9810e260 2024-09-19T06:19:49.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.522+0000 7efd95600640 1 -- 172.21.15.3:0/562937716 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd900116d0 con 0x7efd9810e260 2024-09-19T06:19:49.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.522+0000 7efd9e000640 1 -- 172.21.15.3:0/562937716 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd981a7020 con 0x7efd9810e260 2024-09-19T06:19:49.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.525+0000 7efd95600640 1 -- 172.21.15.3:0/562937716 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7efd900051d0 con 0x7efd9810e260 2024-09-19T06:19:49.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.525+0000 7efda2268740 1 Processor -- start 2024-09-19T06:19:49.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.525+0000 7efda2268740 1 -- start start 2024-09-19T06:19:49.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.525+0000 7efda2268740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559eee64de40 0x559eee64e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.525+0000 7efda2268740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559eee64e760 0x559eee658ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.525+0000 7efda2268740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee659020 0x559eee65b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.525+0000 7efda2268740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x559eee5b43e0 con 0x559eee64e760 2024-09-19T06:19:49.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.525+0000 7efda2268740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559eee55bd80 con 0x559eee64de40 2024-09-19T06:19:49.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.525+0000 7efda2268740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559eee5b03a0 con 0x559eee659020 2024-09-19T06:19:49.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.526+0000 7efd9cc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559eee64e760 0x559eee658ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.526+0000 7efd97e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559eee64de40 0x559eee64e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.526+0000 7efd9cc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559eee64e760 0x559eee658ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45478/0 (socket says 172.21.15.3:45478) 2024-09-19T06:19:49.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.526+0000 7efd9cc00640 1 -- 172.21.15.3:0/2519134355 learned_addr learned my addr 172.21.15.3:0/2519134355 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:49.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.526+0000 7efd97e00640 1 --2- 172.21.15.3:0/2519134355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee659020 0x559eee65b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.526+0000 7efd9cc00640 1 -- 172.21.15.3:0/2519134355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee659020 msgr2=0x559eee65b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:49.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.526+0000 7efd9cc00640 1 --2- 172.21.15.3:0/2519134355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee659020 0x559eee65b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.526+0000 7efd9cc00640 1 -- 172.21.15.3:0/2519134355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559eee64de40 msgr2=0x559eee64e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:49.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.526+0000 7efd9cc00640 1 --2- 172.21.15.3:0/2519134355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559eee64de40 0x559eee64e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.526+0000 7efd9cc00640 1 -- 172.21.15.3:0/2519134355 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559eee57aae0 con 0x559eee64e760 2024-09-19T06:19:49.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.526+0000 7efd97e00640 1 --2- 172.21.15.3:0/2519134355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee659020 0x559eee65b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:49.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.526+0000 7efd95600640 1 --2- 172.21.15.3:0/562937716 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7efd800a33b0 0x7efd800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.526+0000 7efd9cc00640 1 --2- 172.21.15.3:0/2519134355 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559eee64e760 0x559eee658ae0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7efd8c0114f0 tx=0x7efd8c0119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8767bac138c21d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:49.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.527+0000 7efd95600640 1 -- 172.21.15.3:0/562937716 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7efd900d0290 con 0x7efd9810e260 2024-09-19T06:19:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.527+0000 7efd89c00640 1 -- 172.21.15.3:0/2519134355 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c011250 con 0x559eee64e760 2024-09-19T06:19:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.527+0000 7efd97e00640 1 --2- 172.21.15.3:0/562937716 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7efd800a33b0 0x7efd800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.527+0000 7efd89c00640 1 -- 172.21.15.3:0/2519134355 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd8c005500 con 0x559eee64e760 2024-09-19T06:19:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.527+0000 7efd89c00640 1 -- 172.21.15.3:0/2519134355 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c00f820 con 0x559eee64e760 2024-09-19T06:19:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.528+0000 7efda2268740 1 -- 172.21.15.3:0/2519134355 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559eee64e760 msgr2=0x559eee658ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.528+0000 7efd97e00640 1 --2- 172.21.15.3:0/562937716 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7efd800a33b0 0x7efd800a5870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efd9810f660 tx=0x7efd84043040 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.528+0000 7efda2268740 1 --2- 172.21.15.3:0/2519134355 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559eee64e760 0x559eee658ae0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7efd8c0114f0 tx=0x7efd8c0119b0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.528+0000 7efda2268740 1 -- 172.21.15.3:0/2519134355 shutdown_connections 2024-09-19T06:19:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.528+0000 7efda2268740 1 --2- 172.21.15.3:0/2519134355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee659020 0x559eee65b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.528+0000 7efda2268740 1 --2- 172.21.15.3:0/2519134355 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559eee64e760 0x559eee658ae0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.528+0000 7efda2268740 1 --2- 172.21.15.3:0/2519134355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559eee64de40 0x559eee64e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.528+0000 7efda2268740 1 -- 172.21.15.3:0/2519134355 >> 172.21.15.3:0/2519134355 conn(0x559eee64a3d0 msgr2=0x559eee64a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:49.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.528+0000 7efda2268740 1 -- 172.21.15.3:0/2519134355 shutdown_connections 2024-09-19T06:19:49.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.528+0000 7efda2268740 1 -- 172.21.15.3:0/2519134355 wait complete. 2024-09-19T06:19:49.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.529+0000 7efda2268740 1 -- start start 2024-09-19T06:19:49.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.529+0000 7efda2268740 1 Processor -- start 2024-09-19T06:19:49.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.529+0000 7efda2268740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee64de40 0x559eee655f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.529+0000 7efda2268740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559eee64e760 0x559eee656480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.529+0000 7efda2268740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559eee659020 0x559eee6569c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.529+0000 7efda2268740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x559eee65bbf0 con 0x559eee659020 2024-09-19T06:19:49.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.529+0000 7efda2268740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559eee56f0f0 con 0x559eee64e760 2024-09-19T06:19:49.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.529+0000 7efda2268740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559eee65bd70 con 0x559eee64de40 2024-09-19T06:19:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.529+0000 7efda2268740 10 client.0 _ll_register_callbacks cb 0x559eee556bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.530+0000 7efd97e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559eee64e760 0x559eee656480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.530+0000 7efd9d600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559eee659020 0x559eee6569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.530+0000 7efd9cc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee64de40 0x559eee655f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.530+0000 7efd97e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559eee64e760 0x559eee656480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:34066/0 (socket says 172.21.15.3:34066) 2024-09-19T06:19:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.530+0000 7efd97e00640 1 -- 172.21.15.3:0/1971180193 learned_addr learned my addr 172.21.15.3:0/1971180193 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.530+0000 7efd9cc00640 1 -- 172.21.15.3:0/1971180193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559eee64e760 msgr2=0x559eee656480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.530+0000 7efd9cc00640 1 --2- 172.21.15.3:0/1971180193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559eee64e760 0x559eee656480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.530+0000 7efd9cc00640 1 -- 172.21.15.3:0/1971180193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559eee659020 msgr2=0x559eee6569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.530+0000 7efd9cc00640 1 --2- 172.21.15.3:0/1971180193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559eee659020 0x559eee6569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.530+0000 7efd9cc00640 1 -- 172.21.15.3:0/1971180193 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559eee3253c0 con 0x559eee64de40 2024-09-19T06:19:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.530+0000 7efd9d600640 1 --2- 172.21.15.3:0/1971180193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559eee659020 0x559eee6569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:49.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.531+0000 7efd9cc00640 1 --2- 172.21.15.3:0/1971180193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee64de40 0x559eee655f40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efd8c01b040 tx=0x7efd8c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aff00382ad2f8ce1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:49.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.531+0000 7efd7e000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:19:49.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.531+0000 7efd7e000640 1 -- 172.21.15.3:0/1971180193 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c004f70 con 0x559eee64de40 2024-09-19T06:19:49.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.531+0000 7efda2268740 1 -- 172.21.15.3:0/1971180193 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd8c005500 con 0x559eee64de40 2024-09-19T06:19:49.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.531+0000 7efd7e000640 1 -- 172.21.15.3:0/1971180193 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7efd8c005110 con 0x559eee64de40 2024-09-19T06:19:49.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.531+0000 7efd7e000640 1 -- 172.21.15.3:0/1971180193 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efd8c033050 con 0x559eee64de40 2024-09-19T06:19:49.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.531+0000 7efda2268740 10 client.27367 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:49.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.531+0000 7efda2268740 1 -- 172.21.15.3:0/1971180193 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559eee667c60 con 0x559eee64de40 2024-09-19T06:19:49.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.531+0000 7efd7e000640 1 -- 172.21.15.3:0/1971180193 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd8c005500 con 0x559eee64de40 2024-09-19T06:19:49.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.532+0000 7efd7e000640 1 -- 172.21.15.3:0/1971180193 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7efd8c02e560 con 0x559eee64de40 2024-09-19T06:19:49.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.532+0000 7efda2268740 10 client.27367 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:49.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.532+0000 7efda2268740 10 client.27367 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:19:49.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.532+0000 7efda2268740 20 client.27367 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:49.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.532+0000 7efda2268740 1 --2- 172.21.15.3:0/1971180193 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x559eee669060 0x559eee66b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.532+0000 7efda2268740 4 client.27367 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:49.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.532+0000 7efda2268740 1 -- 172.21.15.3:0/1971180193 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559eee5c1950 con 0x559eee669060 2024-09-19T06:19:49.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.532+0000 7efd97e00640 1 --2- 172.21.15.3:0/1971180193 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x559eee669060 0x559eee66b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.533+0000 7efd97e00640 1 --2- 172.21.15.3:0/1971180193 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x559eee669060 0x559eee66b450 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b8003879ccf98b32 server_cookie=7e86393d4218ce4e in_seq=0 out_seq=0 2024-09-19T06:19:49.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.533+0000 7efd7e000640 10 client.27367 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:19:49.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.533+0000 7efd7e000640 1 -- 172.21.15.3:0/1971180193 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559eee5c1950 con 0x559eee669060 2024-09-19T06:19:49.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.533+0000 7efd7e000640 10 client.27367 handle_command_reply: tid=0 2024-09-19T06:19:49.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.533+0000 7efda2268740 1 client.27367 shutdown 2024-09-19T06:19:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.534+0000 7efda2268740 1 -- 172.21.15.3:0/1971180193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee64de40 msgr2=0x559eee655f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.534+0000 7efda2268740 1 --2- 172.21.15.3:0/1971180193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee64de40 0x559eee655f40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efd8c01b040 tx=0x7efd8c004ad0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.534+0000 7efda2268740 1 -- 172.21.15.3:0/1971180193 shutdown_connections 2024-09-19T06:19:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.534+0000 7efda2268740 1 --2- 172.21.15.3:0/1971180193 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x559eee669060 0x559eee66b450 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.534+0000 7efda2268740 1 --2- 172.21.15.3:0/1971180193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559eee659020 0x559eee6569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.534+0000 7efda2268740 1 --2- 172.21.15.3:0/1971180193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559eee64e760 0x559eee656480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.534+0000 7efda2268740 1 --2- 172.21.15.3:0/1971180193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee64de40 0x559eee655f40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.534+0000 7efd7e000640 0 client.27367 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:19:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.534+0000 7efda2268740 1 -- 172.21.15.3:0/1971180193 >> 172.21.15.3:0/1971180193 conn(0x559eee64a3d0 msgr2=0x559eee650100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.534+0000 7efda2268740 1 -- 172.21.15.3:0/1971180193 shutdown_connections 2024-09-19T06:19:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.534+0000 7efda2268740 1 -- 172.21.15.3:0/1971180193 wait complete. 2024-09-19T06:19:49.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.534+0000 7efda2268740 20 client.27367 trim_cache size 0 max 16384 2024-09-19T06:19:49.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.548+0000 7efda2268740 1 Processor -- start 2024-09-19T06:19:49.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.548+0000 7efda2268740 1 -- start start 2024-09-19T06:19:49.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.548+0000 7efda2268740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559eee64de40 0x559eee6508f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.548+0000 7efda2268740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee64e760 0x559eee670bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.548+0000 7efda2268740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559eee659020 0x559eee671100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.548+0000 7efda2268740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7efd981afae0 con 0x559eee659020 2024-09-19T06:19:49.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.548+0000 7efda2268740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efd981b1620 con 0x559eee64de40 2024-09-19T06:19:49.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.548+0000 7efda2268740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efd981b01b0 con 0x559eee64e760 2024-09-19T06:19:49.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.549+0000 7efd9cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559eee64de40 0x559eee6508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.549+0000 7efd97e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee64e760 0x559eee670bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.549+0000 7efd97e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee64e760 0x559eee670bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:55994/0 (socket says 172.21.15.3:55994) 2024-09-19T06:19:49.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.549+0000 7efd97e00640 1 -- 172.21.15.3:0/2797314025 learned_addr learned my addr 172.21.15.3:0/2797314025 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:49.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.549+0000 7efd9d600640 1 --2- 172.21.15.3:0/2797314025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559eee659020 0x559eee671100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.549+0000 7efd97e00640 1 -- 172.21.15.3:0/2797314025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559eee64de40 msgr2=0x559eee6508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:49.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.549+0000 7efd97e00640 1 --2- 172.21.15.3:0/2797314025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559eee64de40 0x559eee6508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.549+0000 7efd97e00640 1 -- 172.21.15.3:0/2797314025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559eee659020 msgr2=0x559eee671100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:49.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.549+0000 7efd97e00640 1 --2- 172.21.15.3:0/2797314025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559eee659020 0x559eee671100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.549+0000 7efd97e00640 1 -- 172.21.15.3:0/2797314025 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559eee650e30 con 0x559eee64e760 2024-09-19T06:19:49.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.549+0000 7efd9cc00640 1 --2- 172.21.15.3:0/2797314025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559eee64de40 0x559eee6508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:49.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.549+0000 7efd97e00640 1 --2- 172.21.15.3:0/2797314025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee64e760 0x559eee670bc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efd8402a8f0 tx=0x7efd84005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87a6f0df23861426 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:49.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.549+0000 7efd89200640 1 -- 172.21.15.3:0/2797314025 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd840043c0 con 0x559eee64e760 2024-09-19T06:19:49.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.550+0000 7efd89200640 1 -- 172.21.15.3:0/2797314025 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd84003ad0 con 0x559eee64e760 2024-09-19T06:19:49.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.550+0000 7efd89200640 1 -- 172.21.15.3:0/2797314025 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd84056a30 con 0x559eee64e760 2024-09-19T06:19:49.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.550+0000 7efda2268740 1 -- 172.21.15.3:0/2797314025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee64e760 msgr2=0x559eee670bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:49.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.550+0000 7efda2268740 1 --2- 172.21.15.3:0/2797314025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee64e760 0x559eee670bc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efd8402a8f0 tx=0x7efd84005f90 comp rx=0 tx=0).stop 2024-09-19T06:19:49.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.550+0000 7efda2268740 1 -- 172.21.15.3:0/2797314025 shutdown_connections 2024-09-19T06:19:49.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.550+0000 7efda2268740 1 --2- 172.21.15.3:0/2797314025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559eee659020 0x559eee671100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.550+0000 7efda2268740 1 --2- 172.21.15.3:0/2797314025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee64e760 0x559eee670bc0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.550+0000 7efda2268740 1 --2- 172.21.15.3:0/2797314025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559eee64de40 0x559eee6508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.550+0000 7efda2268740 1 -- 172.21.15.3:0/2797314025 >> 172.21.15.3:0/2797314025 conn(0x559eee64a3d0 msgr2=0x559eee655070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:49.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.550+0000 7efda2268740 1 -- 172.21.15.3:0/2797314025 shutdown_connections 2024-09-19T06:19:49.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.550+0000 7efda2268740 1 -- 172.21.15.3:0/2797314025 wait complete. 2024-09-19T06:19:49.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.551+0000 7efda2268740 1 -- start start 2024-09-19T06:19:49.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.551+0000 7efda2268740 1 Processor -- start 2024-09-19T06:19:49.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.551+0000 7efda2268740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559eee64de40 0x559eee6611a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.551+0000 7efda2268740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559eee64e760 0x559eee6616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.551+0000 7efda2268740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee659020 0x559eee652790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.551+0000 7efda2268740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7efd981b0f50 con 0x559eee64e760 2024-09-19T06:19:49.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.551+0000 7efda2268740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7efd981b0880 con 0x559eee64de40 2024-09-19T06:19:49.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.551+0000 7efda2268740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7efd981adae0 con 0x559eee659020 2024-09-19T06:19:49.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.551+0000 7efda2268740 10 client.0 _ll_register_callbacks cb 0x7efd840096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:49.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.552+0000 7efd9cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559eee64de40 0x559eee6611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.552+0000 7efd9cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559eee64de40 0x559eee6611a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:34084/0 (socket says 172.21.15.3:34084) 2024-09-19T06:19:49.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.552+0000 7efd97e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559eee64e760 0x559eee6616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.552+0000 7efd9cc00640 1 -- 172.21.15.3:0/3976222695 learned_addr learned my addr 172.21.15.3:0/3976222695 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:49.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.552+0000 7efd9d600640 1 --2- 172.21.15.3:0/3976222695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee659020 0x559eee652790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.552+0000 7efd9cc00640 1 -- 172.21.15.3:0/3976222695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee659020 msgr2=0x559eee652790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:49.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.552+0000 7efd9cc00640 1 --2- 172.21.15.3:0/3976222695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee659020 0x559eee652790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.552+0000 7efd9cc00640 1 -- 172.21.15.3:0/3976222695 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559eee64e760 msgr2=0x559eee6616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:49.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.552+0000 7efd9cc00640 1 --2- 172.21.15.3:0/3976222695 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559eee64e760 0x559eee6616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.552+0000 7efd9cc00640 1 -- 172.21.15.3:0/3976222695 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559eee652e30 con 0x559eee64de40 2024-09-19T06:19:49.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.552+0000 7efd9d600640 1 --2- 172.21.15.3:0/3976222695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee659020 0x559eee652790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:49.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.552+0000 7efd9cc00640 1 --2- 172.21.15.3:0/3976222695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559eee64de40 0x559eee6611a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7efd8c02e930 tx=0x7efd8c011490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4821e4323192dd0a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:49.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.552+0000 7efd7e000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:19:49.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.553+0000 7efd7e000640 1 -- 172.21.15.3:0/3976222695 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c02e640 con 0x559eee64de40 2024-09-19T06:19:49.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.553+0000 7efd7e000640 1 -- 172.21.15.3:0/3976222695 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7efd8c004b40 con 0x559eee64de40 2024-09-19T06:19:49.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.553+0000 7efda2268740 1 -- 172.21.15.3:0/3976222695 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd84003ad0 con 0x559eee64de40 2024-09-19T06:19:49.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.553+0000 7efd7e000640 1 -- 172.21.15.3:0/3976222695 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7efd8c045050 con 0x559eee64de40 2024-09-19T06:19:49.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.553+0000 7efda2268740 10 client.27380 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:49.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.553+0000 7efda2268740 1 -- 172.21.15.3:0/3976222695 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559eee6d3510 con 0x559eee64de40 2024-09-19T06:19:49.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.554+0000 7efd7e000640 1 -- 172.21.15.3:0/3976222695 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd84003ad0 con 0x559eee64de40 2024-09-19T06:19:49.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.554+0000 7efd7e000640 1 -- 172.21.15.3:0/3976222695 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7efd8c00f890 con 0x559eee64de40 2024-09-19T06:19:49.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.554+0000 7efda2268740 10 client.27380 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:49.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.554+0000 7efda2268740 10 client.27380 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:19:49.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.554+0000 7efda2268740 20 client.27380 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:49.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.554+0000 7efda2268740 1 --2- 172.21.15.3:0/3976222695 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x559eee6d3b60 0x559eee6d5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:49.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.554+0000 7efda2268740 4 client.27380 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:19:49.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.554+0000 7efda2268740 1 -- 172.21.15.3:0/3976222695 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559eee5bbe60 con 0x559eee6d3b60 2024-09-19T06:19:49.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.554+0000 7efd97e00640 1 --2- 172.21.15.3:0/3976222695 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x559eee6d3b60 0x559eee6d5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:49.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.555+0000 7efd97e00640 1 --2- 172.21.15.3:0/3976222695 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x559eee6d3b60 0x559eee6d5f50 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2c8fda53fe4ec94a server_cookie=fa97c0e9979954d3 in_seq=0 out_seq=0 2024-09-19T06:19:49.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.555+0000 7efd7e000640 10 client.27380 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:19:49.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.555+0000 7efd7e000640 1 -- 172.21.15.3:0/3976222695 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559eee5bbe60 con 0x559eee6d3b60 2024-09-19T06:19:49.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.555+0000 7efd7e000640 10 client.27380 handle_command_reply: tid=0 2024-09-19T06:19:49.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.555+0000 7efda2268740 1 client.27380 shutdown 2024-09-19T06:19:49.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.555+0000 7efda2268740 1 -- 172.21.15.3:0/3976222695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559eee64de40 msgr2=0x559eee6611a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:49.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.555+0000 7efda2268740 1 --2- 172.21.15.3:0/3976222695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559eee64de40 0x559eee6611a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7efd8c02e930 tx=0x7efd8c011490 comp rx=0 tx=0).stop 2024-09-19T06:19:49.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.555+0000 7efda2268740 1 -- 172.21.15.3:0/3976222695 shutdown_connections 2024-09-19T06:19:49.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.555+0000 7efda2268740 1 --2- 172.21.15.3:0/3976222695 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x559eee6d3b60 0x559eee6d5f50 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.555+0000 7efda2268740 1 --2- 172.21.15.3:0/3976222695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559eee659020 0x559eee652790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.555+0000 7efda2268740 1 --2- 172.21.15.3:0/3976222695 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559eee64e760 0x559eee6616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.555+0000 7efd7e000640 0 client.27380 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:19:49.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.555+0000 7efda2268740 1 --2- 172.21.15.3:0/3976222695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559eee64de40 0x559eee6611a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.555+0000 7efda2268740 1 -- 172.21.15.3:0/3976222695 >> 172.21.15.3:0/3976222695 conn(0x559eee64a3d0 msgr2=0x559eee648c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:49.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.556+0000 7efda2268740 1 -- 172.21.15.3:0/3976222695 shutdown_connections 2024-09-19T06:19:49.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.556+0000 7efda2268740 1 -- 172.21.15.3:0/3976222695 wait complete. 2024-09-19T06:19:49.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.556+0000 7efda2268740 20 client.27380 trim_cache size 0 max 16384 2024-09-19T06:19:49.561 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:19:49.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.556+0000 7efd9e000640 1 -- 172.21.15.3:0/562937716 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7efd800a33b0 msgr2=0x7efd800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:49.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.556+0000 7efd9e000640 1 --2- 172.21.15.3:0/562937716 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7efd800a33b0 0x7efd800a5870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efd9810f660 tx=0x7efd84043040 comp rx=0 tx=0).stop 2024-09-19T06:19:49.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.556+0000 7efd9e000640 1 -- 172.21.15.3:0/562937716 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd9810e260 msgr2=0x7efd9819ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:49.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.556+0000 7efd9e000640 1 --2- 172.21.15.3:0/562937716 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd9810e260 0x7efd9819ed70 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7efd9000e9d0 tx=0x7efd9000ee90 comp rx=0 tx=0).stop 2024-09-19T06:19:49.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.557+0000 7efd9e000640 1 -- 172.21.15.3:0/562937716 shutdown_connections 2024-09-19T06:19:49.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.557+0000 7efd9e000640 1 --2- 172.21.15.3:0/562937716 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7efd800a33b0 0x7efd800a5870 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.557+0000 7efd9e000640 1 --2- 172.21.15.3:0/562937716 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efd9810e260 0x7efd9819ed70 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.557+0000 7efd9e000640 1 --2- 172.21.15.3:0/562937716 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7efd98074ee0 0x7efd9819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.557+0000 7efd9e000640 1 --2- 172.21.15.3:0/562937716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efd980745c0 0x7efd9819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:49.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.557+0000 7efd9e000640 1 -- 172.21.15.3:0/562937716 >> 172.21.15.3:0/562937716 conn(0x7efd980fd740 msgr2=0x7efd980fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:49.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.557+0000 7efd9e000640 1 -- 172.21.15.3:0/562937716 shutdown_connections 2024-09-19T06:19:49.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:49.557+0000 7efd9e000640 1 -- 172.21.15.3:0/562937716 wait complete. 2024-09-19T06:19:50.239 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:49 smithi003 ceph-mon[30893]: pgmap v228: 97 pgs: 97 active+clean; 4.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 23 op/s 2024-09-19T06:19:50.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:49 smithi059 ceph-mon[35138]: pgmap v228: 97 pgs: 97 active+clean; 4.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 23 op/s 2024-09-19T06:19:50.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:49 smithi071 ceph-mon[35662]: pgmap v228: 97 pgs: 97 active+clean; 4.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 23 op/s 2024-09-19T06:19:50.509 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:19:50.889 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:51.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.510+0000 7f76ff200640 1 -- 172.21.15.3:0/3240470813 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76f8109140 msgr2=0x7f76f8110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:51.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.510+0000 7f76ff200640 1 --2- 172.21.15.3:0/3240470813 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76f8109140 0x7f76f8110cc0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009ca0 tx=0x7f76f002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.510+0000 7f76ff200640 1 -- 172.21.15.3:0/3240470813 shutdown_connections 2024-09-19T06:19:51.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.510+0000 7f76ff200640 1 --2- 172.21.15.3:0/3240470813 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76f8109140 0x7f76f8110cc0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.510+0000 7f76ff200640 1 --2- 172.21.15.3:0/3240470813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76f81049c0 0x7f76f8108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.510+0000 7f76ff200640 1 --2- 172.21.15.3:0/3240470813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76f8104010 0x7f76f81043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.510+0000 7f76ff200640 1 -- 172.21.15.3:0/3240470813 >> 172.21.15.3:0/3240470813 conn(0x7f76f80ffa50 msgr2=0x7f76f8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:51.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.510+0000 7f76ff200640 1 -- 172.21.15.3:0/3240470813 shutdown_connections 2024-09-19T06:19:51.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.510+0000 7f76ff200640 1 -- 172.21.15.3:0/3240470813 wait complete. 2024-09-19T06:19:51.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.511+0000 7f76ff200640 1 Processor -- start 2024-09-19T06:19:51.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.511+0000 7f76ff200640 1 -- start start 2024-09-19T06:19:51.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.511+0000 7f76ff200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76f8104010 0x7f76f819a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:51.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.511+0000 7f76ff200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76f81049c0 0x7f76f819ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:51.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.511+0000 7f76ff200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76f8109140 0x7f76f819ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:51.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.511+0000 7f76ff200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f76f81141c0 con 0x7f76f8109140 2024-09-19T06:19:51.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.511+0000 7f76ff200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f76f8114040 con 0x7f76f8104010 2024-09-19T06:19:51.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.511+0000 7f76ff200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f76f8114340 con 0x7f76f81049c0 2024-09-19T06:19:51.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.511+0000 7f76fd200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76f8109140 0x7f76f819ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:51.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.512+0000 7f76fd200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76f8109140 0x7f76f819ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45526/0 (socket says 172.21.15.3:45526) 2024-09-19T06:19:51.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.512+0000 7f76ef400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76f81049c0 0x7f76f819ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:51.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.512+0000 7f76fd200640 1 -- 172.21.15.3:0/1913926634 learned_addr learned my addr 172.21.15.3:0/1913926634 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:51.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.512+0000 7f76f7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76f8104010 0x7f76f819a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:51.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.512+0000 7f76ef400640 1 -- 172.21.15.3:0/1913926634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76f8104010 msgr2=0x7f76f819a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.512+0000 7f76ef400640 1 --2- 172.21.15.3:0/1913926634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76f8104010 0x7f76f819a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.512+0000 7f76ef400640 1 -- 172.21.15.3:0/1913926634 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76f8109140 msgr2=0x7f76f819ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.512+0000 7f76ef400640 1 --2- 172.21.15.3:0/1913926634 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76f8109140 0x7f76f819ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.512+0000 7f76ef400640 1 -- 172.21.15.3:0/1913926634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f819f670 con 0x7f76f81049c0 2024-09-19T06:19:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.512+0000 7f76fd200640 1 --2- 172.21.15.3:0/1913926634 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76f8109140 0x7f76f819ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.512+0000 7f76ef400640 1 --2- 172.21.15.3:0/1913926634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76f81049c0 0x7f76f819ac00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f76e000e9f0 tx=0x7f76e000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.513+0000 7f76f5600640 1 -- 172.21.15.3:0/1913926634 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e000ccc0 con 0x7f76f81049c0 2024-09-19T06:19:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.513+0000 7f76f5600640 1 -- 172.21.15.3:0/1913926634 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76e0005020 con 0x7f76f81049c0 2024-09-19T06:19:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.513+0000 7f76ff200640 1 -- 172.21.15.3:0/1913926634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76f819f960 con 0x7f76f81049c0 2024-09-19T06:19:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.513+0000 7f76f5600640 1 -- 172.21.15.3:0/1913926634 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e00049e0 con 0x7f76f81049c0 2024-09-19T06:19:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.513+0000 7f76ff200640 1 -- 172.21.15.3:0/1913926634 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76f81a7240 con 0x7f76f81049c0 2024-09-19T06:19:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.516+0000 7f76f5600640 1 -- 172.21.15.3:0/1913926634 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f76e0005560 con 0x7f76f81049c0 2024-09-19T06:19:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.516+0000 7f7701c15740 1 Processor -- start 2024-09-19T06:19:51.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.516+0000 7f7701c15740 1 -- start start 2024-09-19T06:19:51.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.517+0000 7f7701c15740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4e4c78c70 0x55a4e4c79050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:51.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.517+0000 7f7701c15740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4e4c79590 0x55a4e4c83910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:51.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.517+0000 7f7701c15740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4e4c83e50 0x55a4e4c86240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:51.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.517+0000 7f7701c15740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a4e4bdf3e0 con 0x55a4e4c83e50 2024-09-19T06:19:51.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.517+0000 7f7701c15740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a4e4b86d80 con 0x55a4e4c78c70 2024-09-19T06:19:51.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.517+0000 7f7701c15740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a4e4bdb3a0 con 0x55a4e4c79590 2024-09-19T06:19:51.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.517+0000 7f76fd200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4e4c78c70 0x55a4e4c79050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:51.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.517+0000 7f76fd200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4e4c78c70 0x55a4e4c79050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:34110/0 (socket says 172.21.15.3:34110) 2024-09-19T06:19:51.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.517+0000 7f76fd200640 1 -- 172.21.15.3:0/2063206206 learned_addr learned my addr 172.21.15.3:0/2063206206 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:51.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.517+0000 7f76f7e00640 1 --2- 172.21.15.3:0/2063206206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4e4c79590 0x55a4e4c83910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:51.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.517+0000 7f76ef400640 1 --2- 172.21.15.3:0/2063206206 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4e4c83e50 0x55a4e4c86240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:51.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.517+0000 7f76fd200640 1 -- 172.21.15.3:0/2063206206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4e4c79590 msgr2=0x55a4e4c83910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:51.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.517+0000 7f76fd200640 1 --2- 172.21.15.3:0/2063206206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4e4c79590 0x55a4e4c83910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.517+0000 7f76fd200640 1 -- 172.21.15.3:0/2063206206 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4e4c83e50 msgr2=0x55a4e4c86240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:51.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.517+0000 7f76fd200640 1 --2- 172.21.15.3:0/2063206206 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4e4c83e50 0x55a4e4c86240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.518+0000 7f76fd200640 1 -- 172.21.15.3:0/2063206206 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4e4ba5ae0 con 0x55a4e4c78c70 2024-09-19T06:19:51.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.518+0000 7f76f7e00640 1 --2- 172.21.15.3:0/2063206206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4e4c79590 0x55a4e4c83910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:51.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.518+0000 7f76fd200640 1 --2- 172.21.15.3:0/2063206206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4e4c78c70 0x55a4e4c79050 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009a10 tx=0x7f76f0005ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1624ca1bba0f1876 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:51.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.518+0000 7f76f5600640 1 --2- 172.21.15.3:0/1913926634 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f76dc0a33b0 0x7f76dc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:51.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.518+0000 7f76ed600640 1 -- 172.21.15.3:0/2063206206 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f0003b70 con 0x55a4e4c78c70 2024-09-19T06:19:51.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.518+0000 7f76ed600640 1 -- 172.21.15.3:0/2063206206 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76f0036040 con 0x55a4e4c78c70 2024-09-19T06:19:51.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.518+0000 7f76ed600640 1 -- 172.21.15.3:0/2063206206 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f00045f0 con 0x55a4e4c78c70 2024-09-19T06:19:51.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.518+0000 7f76f5600640 1 -- 172.21.15.3:0/1913926634 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f76e00cfca0 con 0x7f76f81049c0 2024-09-19T06:19:51.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.519+0000 7f76f7e00640 1 --2- 172.21.15.3:0/1913926634 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f76dc0a33b0 0x7f76dc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:51.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.519+0000 7f7701c15740 1 -- 172.21.15.3:0/2063206206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4e4c78c70 msgr2=0x55a4e4c79050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:51.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.519+0000 7f7701c15740 1 --2- 172.21.15.3:0/2063206206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4e4c78c70 0x55a4e4c79050 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009a10 tx=0x7f76f0005ef0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.519+0000 7f7701c15740 1 -- 172.21.15.3:0/2063206206 shutdown_connections 2024-09-19T06:19:51.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.519+0000 7f7701c15740 1 --2- 172.21.15.3:0/2063206206 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4e4c83e50 0x55a4e4c86240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.519+0000 7f7701c15740 1 --2- 172.21.15.3:0/2063206206 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4e4c79590 0x55a4e4c83910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.519+0000 7f7701c15740 1 --2- 172.21.15.3:0/2063206206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4e4c78c70 0x55a4e4c79050 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.519+0000 7f7701c15740 1 -- 172.21.15.3:0/2063206206 >> 172.21.15.3:0/2063206206 conn(0x55a4e4c75200 msgr2=0x55a4e4c755e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:51.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.519+0000 7f7701c15740 1 -- 172.21.15.3:0/2063206206 shutdown_connections 2024-09-19T06:19:51.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.519+0000 7f76f7e00640 1 --2- 172.21.15.3:0/1913926634 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f76dc0a33b0 0x7f76dc0a5870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55a4e4c76060 tx=0x7f76e8005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:51.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.519+0000 7f7701c15740 1 -- 172.21.15.3:0/2063206206 wait complete. 2024-09-19T06:19:51.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.520+0000 7f7701c15740 1 -- start start 2024-09-19T06:19:51.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.520+0000 7f7701c15740 1 Processor -- start 2024-09-19T06:19:51.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.521+0000 7f7701c15740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4e4c78c70 0x55a4e4c80cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:51.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.521+0000 7f7701c15740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4e4c79590 0x55a4e4c81200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:51.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.521+0000 7f7701c15740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4e4c83e50 0x55a4e4c81740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:51.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.521+0000 7f7701c15740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a4e4c868a0 con 0x55a4e4c79590 2024-09-19T06:19:51.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.521+0000 7f7701c15740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a4e4b9a0f0 con 0x55a4e4c83e50 2024-09-19T06:19:51.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.521+0000 7f7701c15740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a4e4c86a20 con 0x55a4e4c78c70 2024-09-19T06:19:51.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.521+0000 7f7701c15740 10 client.0 _ll_register_callbacks cb 0x55a4e4b81bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:51.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.521+0000 7f76ef400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4e4c79590 0x55a4e4c81200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:51.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.521+0000 7f76ef400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4e4c79590 0x55a4e4c81200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45548/0 (socket says 172.21.15.3:45548) 2024-09-19T06:19:51.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.521+0000 7f76ef400640 1 -- 172.21.15.3:0/3233659767 learned_addr learned my addr 172.21.15.3:0/3233659767 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:51.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.521+0000 7f76fd200640 1 --2- 172.21.15.3:0/3233659767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4e4c83e50 0x55a4e4c81740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:51.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.521+0000 7f76f7e00640 1 --2- 172.21.15.3:0/3233659767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4e4c78c70 0x55a4e4c80cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:51.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.521+0000 7f76ef400640 1 -- 172.21.15.3:0/3233659767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4e4c78c70 msgr2=0x55a4e4c80cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:51.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.521+0000 7f76ef400640 1 --2- 172.21.15.3:0/3233659767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4e4c78c70 0x55a4e4c80cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.521+0000 7f76ef400640 1 -- 172.21.15.3:0/3233659767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4e4c83e50 msgr2=0x55a4e4c81740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.521+0000 7f76ef400640 1 --2- 172.21.15.3:0/3233659767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4e4c83e50 0x55a4e4c81740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.521+0000 7f76ef400640 1 -- 172.21.15.3:0/3233659767 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4e49503c0 con 0x55a4e4c79590 2024-09-19T06:19:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.521+0000 7f76f7e00640 1 --2- 172.21.15.3:0/3233659767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4e4c78c70 0x55a4e4c80cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.522+0000 7f76ef400640 1 --2- 172.21.15.3:0/3233659767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4e4c79590 0x55a4e4c81200 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f76e000c6a0 tx=0x7f76e009baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7171d8b88cd0cb71 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.522+0000 7f76e6000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:19:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.522+0000 7f76e6000640 1 -- 172.21.15.3:0/3233659767 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e001c040 con 0x55a4e4c79590 2024-09-19T06:19:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.522+0000 7f76e6000640 1 -- 172.21.15.3:0/3233659767 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f76e00a48d0 con 0x55a4e4c79590 2024-09-19T06:19:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.522+0000 7f7701c15740 1 -- 172.21.15.3:0/3233659767 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76f0036040 con 0x55a4e4c79590 2024-09-19T06:19:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.522+0000 7f76e6000640 1 -- 172.21.15.3:0/3233659767 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f76e00cd7f0 con 0x55a4e4c79590 2024-09-19T06:19:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.522+0000 7f7701c15740 10 client.17352 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.522+0000 7f7701c15740 1 -- 172.21.15.3:0/3233659767 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a4e4c92910 con 0x55a4e4c79590 2024-09-19T06:19:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.522+0000 7f76e6000640 1 -- 172.21.15.3:0/3233659767 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76f0036040 con 0x55a4e4c79590 2024-09-19T06:19:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.523+0000 7f76e6000640 1 -- 172.21.15.3:0/3233659767 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f76e00d5070 con 0x55a4e4c79590 2024-09-19T06:19:51.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.523+0000 7f7701c15740 10 client.17352 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:51.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.523+0000 7f7701c15740 10 client.17352 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:19:51.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.523+0000 7f7701c15740 20 client.17352 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:51.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.523+0000 7f7701c15740 1 --2- 172.21.15.3:0/3233659767 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55a4e4c93d20 0x55a4e4c96150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:51.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.523+0000 7f7701c15740 4 client.17352 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:51.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.523+0000 7f7701c15740 1 -- 172.21.15.3:0/3233659767 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4e4bec950 con 0x55a4e4c93d20 2024-09-19T06:19:51.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.523+0000 7f76f7e00640 1 --2- 172.21.15.3:0/3233659767 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55a4e4c93d20 0x55a4e4c96150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:51.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.524+0000 7f76f7e00640 1 --2- 172.21.15.3:0/3233659767 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55a4e4c93d20 0x55a4e4c96150 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=35281a9ae335bba1 server_cookie=e01dd9378ecbe891 in_seq=0 out_seq=0 2024-09-19T06:19:51.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.524+0000 7f76e6000640 10 client.17352 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:19:51.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.525+0000 7f76e6000640 1 -- 172.21.15.3:0/3233659767 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a4e4bec950 con 0x55a4e4c93d20 2024-09-19T06:19:51.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.525+0000 7f76e6000640 10 client.17352 handle_command_reply: tid=0 2024-09-19T06:19:51.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.525+0000 7f7701c15740 1 client.17352 shutdown 2024-09-19T06:19:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.525+0000 7f7701c15740 1 -- 172.21.15.3:0/3233659767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4e4c79590 msgr2=0x55a4e4c81200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.525+0000 7f7701c15740 1 --2- 172.21.15.3:0/3233659767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4e4c79590 0x55a4e4c81200 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f76e000c6a0 tx=0x7f76e009baf0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.525+0000 7f7701c15740 1 -- 172.21.15.3:0/3233659767 shutdown_connections 2024-09-19T06:19:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.525+0000 7f7701c15740 1 --2- 172.21.15.3:0/3233659767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4e4c83e50 0x55a4e4c81740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.525+0000 7f7701c15740 1 --2- 172.21.15.3:0/3233659767 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55a4e4c93d20 0x55a4e4c96150 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.525+0000 7f7701c15740 1 --2- 172.21.15.3:0/3233659767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4e4c79590 0x55a4e4c81200 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.525+0000 7f7701c15740 1 --2- 172.21.15.3:0/3233659767 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4e4c78c70 0x55a4e4c80cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.525+0000 7f7701c15740 1 -- 172.21.15.3:0/3233659767 >> 172.21.15.3:0/3233659767 conn(0x55a4e4c75200 msgr2=0x55a4e4c74380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.525+0000 7f76e6000640 0 client.17352 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:19:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.525+0000 7f7701c15740 1 -- 172.21.15.3:0/3233659767 shutdown_connections 2024-09-19T06:19:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.525+0000 7f7701c15740 1 -- 172.21.15.3:0/3233659767 wait complete. 2024-09-19T06:19:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.525+0000 7f7701c15740 20 client.17352 trim_cache size 0 max 16384 2024-09-19T06:19:51.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.539+0000 7f7701c15740 1 Processor -- start 2024-09-19T06:19:51.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.539+0000 7f7701c15740 1 -- start start 2024-09-19T06:19:51.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.539+0000 7f7701c15740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4e4c78c70 0x55a4e4c9ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:51.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.539+0000 7f7701c15740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4e4c79590 0x55a4e4c9bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:51.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.540+0000 7f7701c15740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4e4c83e50 0x55a4e4c7df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:51.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.540+0000 7f7701c15740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f76f81afad0 con 0x55a4e4c83e50 2024-09-19T06:19:51.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.540+0000 7f7701c15740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f76f81b1610 con 0x55a4e4c79590 2024-09-19T06:19:51.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.540+0000 7f7701c15740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f76f81b01a0 con 0x55a4e4c78c70 2024-09-19T06:19:51.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.540+0000 7f76fd200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4e4c83e50 0x55a4e4c7df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:51.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.540+0000 7f76f7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4e4c78c70 0x55a4e4c9ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:51.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.540+0000 7f76f7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4e4c78c70 0x55a4e4c9ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:56064/0 (socket says 172.21.15.3:56064) 2024-09-19T06:19:51.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.540+0000 7f76f7e00640 1 -- 172.21.15.3:0/1726491482 learned_addr learned my addr 172.21.15.3:0/1726491482 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:51.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.540+0000 7f76ef400640 1 --2- 172.21.15.3:0/1726491482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4e4c79590 0x55a4e4c9bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:51.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.540+0000 7f76f7e00640 1 -- 172.21.15.3:0/1726491482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4e4c79590 msgr2=0x55a4e4c9bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:51.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.540+0000 7f76f7e00640 1 --2- 172.21.15.3:0/1726491482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4e4c79590 0x55a4e4c9bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.540+0000 7f76f7e00640 1 -- 172.21.15.3:0/1726491482 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4e4c83e50 msgr2=0x55a4e4c7df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:51.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.540+0000 7f76f7e00640 1 --2- 172.21.15.3:0/1726491482 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4e4c83e50 0x55a4e4c7df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.540+0000 7f76f7e00640 1 -- 172.21.15.3:0/1726491482 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4e4c75030 con 0x55a4e4c78c70 2024-09-19T06:19:51.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.541+0000 7f76f7e00640 1 --2- 172.21.15.3:0/1726491482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4e4c78c70 0x55a4e4c9ba20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x55a4e4c96990 tx=0x7f76e8019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6949406b6b2555d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:51.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.541+0000 7f76ecc00640 1 -- 172.21.15.3:0/1726491482 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e802e030 con 0x55a4e4c78c70 2024-09-19T06:19:51.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.541+0000 7f76ecc00640 1 -- 172.21.15.3:0/1726491482 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76e8005500 con 0x55a4e4c78c70 2024-09-19T06:19:51.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.541+0000 7f76ecc00640 1 -- 172.21.15.3:0/1726491482 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8004d50 con 0x55a4e4c78c70 2024-09-19T06:19:51.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.541+0000 7f7701c15740 1 -- 172.21.15.3:0/1726491482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4e4c78c70 msgr2=0x55a4e4c9ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:51.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.541+0000 7f7701c15740 1 --2- 172.21.15.3:0/1726491482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4e4c78c70 0x55a4e4c9ba20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x55a4e4c96990 tx=0x7f76e8019000 comp rx=0 tx=0).stop 2024-09-19T06:19:51.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.542+0000 7f7701c15740 1 -- 172.21.15.3:0/1726491482 shutdown_connections 2024-09-19T06:19:51.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.542+0000 7f7701c15740 1 --2- 172.21.15.3:0/1726491482 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4e4c83e50 0x55a4e4c7df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.542+0000 7f7701c15740 1 --2- 172.21.15.3:0/1726491482 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4e4c79590 0x55a4e4c9bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.542+0000 7f7701c15740 1 --2- 172.21.15.3:0/1726491482 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4e4c78c70 0x55a4e4c9ba20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.542+0000 7f7701c15740 1 -- 172.21.15.3:0/1726491482 >> 172.21.15.3:0/1726491482 conn(0x55a4e4c75200 msgr2=0x55a4e4c82d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:51.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.542+0000 7f7701c15740 1 -- 172.21.15.3:0/1726491482 shutdown_connections 2024-09-19T06:19:51.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.542+0000 7f7701c15740 1 -- 172.21.15.3:0/1726491482 wait complete. 2024-09-19T06:19:51.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.542+0000 7f7701c15740 1 -- start start 2024-09-19T06:19:51.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.542+0000 7f7701c15740 1 Processor -- start 2024-09-19T06:19:51.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.543+0000 7f7701c15740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4e4c78c70 0x55a4e4c88090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:51.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.543+0000 7f7701c15740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4e4c79590 0x55a4e4c885d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:51.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.543+0000 7f7701c15740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4e4c83e50 0x55a4e4cfd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:51.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.543+0000 7f7701c15740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f76f81b0f40 con 0x55a4e4c83e50 2024-09-19T06:19:51.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.543+0000 7f7701c15740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f76f81b0870 con 0x55a4e4c78c70 2024-09-19T06:19:51.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.543+0000 7f7701c15740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f76f81adad0 con 0x55a4e4c79590 2024-09-19T06:19:51.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.543+0000 7f7701c15740 10 client.0 _ll_register_callbacks cb 0x7f76e000e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:51.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.543+0000 7f76fd200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4e4c83e50 0x55a4e4cfd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.543+0000 7f76fd200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4e4c83e50 0x55a4e4cfd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45578/0 (socket says 172.21.15.3:45578) 2024-09-19T06:19:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.543+0000 7f76fd200640 1 -- 172.21.15.3:0/180771876 learned_addr learned my addr 172.21.15.3:0/180771876 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.543+0000 7f76f7e00640 1 --2- 172.21.15.3:0/180771876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4e4c78c70 0x55a4e4c88090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.543+0000 7f76ef400640 1 --2- 172.21.15.3:0/180771876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4e4c79590 0x55a4e4c885d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.544+0000 7f76f7e00640 1 -- 172.21.15.3:0/180771876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4e4c79590 msgr2=0x55a4e4c885d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.544+0000 7f76f7e00640 1 --2- 172.21.15.3:0/180771876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4e4c79590 0x55a4e4c885d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.544+0000 7f76f7e00640 1 -- 172.21.15.3:0/180771876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4e4c83e50 msgr2=0x55a4e4cfd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.544+0000 7f76f7e00640 1 --2- 172.21.15.3:0/180771876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4e4c83e50 0x55a4e4cfd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.544+0000 7f76f7e00640 1 -- 172.21.15.3:0/180771876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4e4c75e90 con 0x55a4e4c78c70 2024-09-19T06:19:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.544+0000 7f76f7e00640 1 --2- 172.21.15.3:0/180771876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4e4c78c70 0x55a4e4c88090 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f76e801d520 tx=0x7f76e80056b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43b9ab6a166416b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.544+0000 7f76e6000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:19:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.544+0000 7f76e6000640 1 -- 172.21.15.3:0/180771876 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8041060 con 0x55a4e4c78c70 2024-09-19T06:19:51.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.544+0000 7f7701c15740 1 -- 172.21.15.3:0/180771876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76e8005500 con 0x55a4e4c78c70 2024-09-19T06:19:51.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.544+0000 7f76e6000640 1 -- 172.21.15.3:0/180771876 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f76e8039070 con 0x55a4e4c78c70 2024-09-19T06:19:51.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.545+0000 7f76e6000640 1 -- 172.21.15.3:0/180771876 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f76e802e030 con 0x55a4e4c78c70 2024-09-19T06:19:51.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.545+0000 7f7701c15740 10 client.27398 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:51.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.545+0000 7f7701c15740 1 -- 172.21.15.3:0/180771876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a4e4cfefe0 con 0x55a4e4c78c70 2024-09-19T06:19:51.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.545+0000 7f76e6000640 1 -- 172.21.15.3:0/180771876 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76e8005500 con 0x55a4e4c78c70 2024-09-19T06:19:51.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.545+0000 7f76e6000640 1 -- 172.21.15.3:0/180771876 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f76e802a440 con 0x55a4e4c78c70 2024-09-19T06:19:51.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.545+0000 7f7701c15740 10 client.27398 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:51.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.545+0000 7f7701c15740 10 client.27398 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:19:51.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.545+0000 7f7701c15740 20 client.27398 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:51.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.545+0000 7f7701c15740 1 --2- 172.21.15.3:0/180771876 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55a4e4cff650 0x55a4e4d01a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:51.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.545+0000 7f7701c15740 4 client.27398 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:19:51.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.545+0000 7f7701c15740 1 -- 172.21.15.3:0/180771876 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a4e4be6e60 con 0x55a4e4cff650 2024-09-19T06:19:51.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.546+0000 7f76ef400640 1 --2- 172.21.15.3:0/180771876 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55a4e4cff650 0x55a4e4d01a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:51.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.546+0000 7f76ef400640 1 --2- 172.21.15.3:0/180771876 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55a4e4cff650 0x55a4e4d01a40 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=702713906a50548e server_cookie=1b351cf40b2b9817 in_seq=0 out_seq=0 2024-09-19T06:19:51.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.546+0000 7f76e6000640 10 client.27398 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:19:51.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.546+0000 7f76e6000640 1 -- 172.21.15.3:0/180771876 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a4e4be6e60 con 0x55a4e4cff650 2024-09-19T06:19:51.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.546+0000 7f76e6000640 10 client.27398 handle_command_reply: tid=0 2024-09-19T06:19:51.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.546+0000 7f7701c15740 1 client.27398 shutdown 2024-09-19T06:19:51.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.546+0000 7f7701c15740 1 -- 172.21.15.3:0/180771876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4e4c78c70 msgr2=0x55a4e4c88090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:51.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.546+0000 7f7701c15740 1 --2- 172.21.15.3:0/180771876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4e4c78c70 0x55a4e4c88090 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f76e801d520 tx=0x7f76e80056b0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.547+0000 7f7701c15740 1 -- 172.21.15.3:0/180771876 shutdown_connections 2024-09-19T06:19:51.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.547+0000 7f7701c15740 1 --2- 172.21.15.3:0/180771876 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55a4e4cff650 0x55a4e4d01a40 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.547+0000 7f7701c15740 1 --2- 172.21.15.3:0/180771876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4e4c83e50 0x55a4e4cfd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.547+0000 7f7701c15740 1 --2- 172.21.15.3:0/180771876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4e4c79590 0x55a4e4c885d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.547+0000 7f7701c15740 1 --2- 172.21.15.3:0/180771876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4e4c78c70 0x55a4e4c88090 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.547+0000 7f76e6000640 0 client.27398 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:19:51.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.547+0000 7f7701c15740 1 -- 172.21.15.3:0/180771876 >> 172.21.15.3:0/180771876 conn(0x55a4e4c75200 msgr2=0x55a4e4c73b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:51.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.547+0000 7f7701c15740 1 -- 172.21.15.3:0/180771876 shutdown_connections 2024-09-19T06:19:51.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.547+0000 7f7701c15740 1 -- 172.21.15.3:0/180771876 wait complete. 2024-09-19T06:19:51.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.547+0000 7f7701c15740 20 client.27398 trim_cache size 0 max 16384 2024-09-19T06:19:51.553 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:19:51.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.547+0000 7f76ff200640 1 -- 172.21.15.3:0/1913926634 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f76dc0a33b0 msgr2=0x7f76dc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:51.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.547+0000 7f76ff200640 1 --2- 172.21.15.3:0/1913926634 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f76dc0a33b0 0x7f76dc0a5870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55a4e4c76060 tx=0x7f76e8005f90 comp rx=0 tx=0).stop 2024-09-19T06:19:51.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.547+0000 7f76ff200640 1 -- 172.21.15.3:0/1913926634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76f81049c0 msgr2=0x7f76f819ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:51.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.547+0000 7f76ff200640 1 --2- 172.21.15.3:0/1913926634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76f81049c0 0x7f76f819ac00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f76e000e9f0 tx=0x7f76e000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.548+0000 7f76ff200640 1 -- 172.21.15.3:0/1913926634 shutdown_connections 2024-09-19T06:19:51.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.548+0000 7f76ff200640 1 --2- 172.21.15.3:0/1913926634 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f76dc0a33b0 0x7f76dc0a5870 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.548+0000 7f76ff200640 1 --2- 172.21.15.3:0/1913926634 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76f8109140 0x7f76f819ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.548+0000 7f76ff200640 1 --2- 172.21.15.3:0/1913926634 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f76f81049c0 0x7f76f819ac00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.548+0000 7f76ff200640 1 --2- 172.21.15.3:0/1913926634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76f8104010 0x7f76f819a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:51.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.548+0000 7f76ff200640 1 -- 172.21.15.3:0/1913926634 >> 172.21.15.3:0/1913926634 conn(0x7f76f80ffa50 msgr2=0x7f76f8100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:51.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.548+0000 7f76ff200640 1 -- 172.21.15.3:0/1913926634 shutdown_connections 2024-09-19T06:19:51.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:51.548+0000 7f76ff200640 1 -- 172.21.15.3:0/1913926634 wait complete. 2024-09-19T06:19:52.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:51 smithi059 ceph-mon[35138]: pgmap v229: 97 pgs: 97 active+clean; 4.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 16 op/s 2024-09-19T06:19:52.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:51 smithi003 ceph-mon[30893]: pgmap v229: 97 pgs: 97 active+clean; 4.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 16 op/s 2024-09-19T06:19:52.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:51 smithi071 ceph-mon[35662]: pgmap v229: 97 pgs: 97 active+clean; 4.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 16 op/s 2024-09-19T06:19:52.494 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:19:52.873 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:53.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.437+0000 7f3977200640 1 -- 172.21.15.3:0/2275014140 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39781079c0 msgr2=0x7f3978107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.437+0000 7f3977200640 1 --2- 172.21.15.3:0/2275014140 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39781079c0 0x7f3978107da0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3968009930 tx=0x7f396802a420 comp rx=0 tx=0).stop 2024-09-19T06:19:53.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.437+0000 7f3977200640 1 -- 172.21.15.3:0/2275014140 shutdown_connections 2024-09-19T06:19:53.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.437+0000 7f3977200640 1 --2- 172.21.15.3:0/2275014140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3978102360 0x7f397810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.437+0000 7f3977200640 1 --2- 172.21.15.3:0/2275014140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39781019c0 0x7f3978101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.437+0000 7f3977200640 1 --2- 172.21.15.3:0/2275014140 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39781079c0 0x7f3978107da0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.437+0000 7f3977200640 1 -- 172.21.15.3:0/2275014140 >> 172.21.15.3:0/2275014140 conn(0x7f39780fd6e0 msgr2=0x7f39780ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:53.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.437+0000 7f3977200640 1 -- 172.21.15.3:0/2275014140 shutdown_connections 2024-09-19T06:19:53.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.437+0000 7f3977200640 1 -- 172.21.15.3:0/2275014140 wait complete. 2024-09-19T06:19:53.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.438+0000 7f3977200640 1 Processor -- start 2024-09-19T06:19:53.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.438+0000 7f3977200640 1 -- start start 2024-09-19T06:19:53.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.439+0000 7f3977200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39781019c0 0x7f397819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.439+0000 7f3977200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3978102360 0x7f397819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.439+0000 7f3977200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39781079c0 0x7f397819ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.439+0000 7f3977200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3978111d80 con 0x7f39781019c0 2024-09-19T06:19:53.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.439+0000 7f3977200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3978111c00 con 0x7f39781079c0 2024-09-19T06:19:53.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.439+0000 7f3977200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3978111f00 con 0x7f3978102360 2024-09-19T06:19:53.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.439+0000 7f3975e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39781019c0 0x7f397819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.439+0000 7f3975e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39781019c0 0x7f397819a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45600/0 (socket says 172.21.15.3:45600) 2024-09-19T06:19:53.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.439+0000 7f3975e00640 1 -- 172.21.15.3:0/1592886947 learned_addr learned my addr 172.21.15.3:0/1592886947 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:53.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.439+0000 7f3976800640 1 --2- 172.21.15.3:0/1592886947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39781079c0 0x7f397819ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.439+0000 7f3975400640 1 --2- 172.21.15.3:0/1592886947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3978102360 0x7f397819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.439+0000 7f3975e00640 1 -- 172.21.15.3:0/1592886947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3978102360 msgr2=0x7f397819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.439+0000 7f3975e00640 1 --2- 172.21.15.3:0/1592886947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3978102360 0x7f397819a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.439+0000 7f3975e00640 1 -- 172.21.15.3:0/1592886947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39781079c0 msgr2=0x7f397819ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.439+0000 7f3975e00640 1 --2- 172.21.15.3:0/1592886947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39781079c0 0x7f397819ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.439+0000 7f3975e00640 1 -- 172.21.15.3:0/1592886947 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397819f450 con 0x7f39781019c0 2024-09-19T06:19:53.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.439+0000 7f3976800640 1 --2- 172.21.15.3:0/1592886947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39781079c0 0x7f397819ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:53.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.440+0000 7f3975e00640 1 --2- 172.21.15.3:0/1592886947 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39781019c0 0x7f397819a4a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f3968009230 tx=0x7f3968004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:53.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.440+0000 7f396ea00640 1 -- 172.21.15.3:0/1592886947 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396803f030 con 0x7f39781019c0 2024-09-19T06:19:53.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.440+0000 7f396ea00640 1 -- 172.21.15.3:0/1592886947 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3968004440 con 0x7f39781019c0 2024-09-19T06:19:53.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.440+0000 7f3977200640 1 -- 172.21.15.3:0/1592886947 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f397819f6e0 con 0x7f39781019c0 2024-09-19T06:19:53.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.440+0000 7f396ea00640 1 -- 172.21.15.3:0/1592886947 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3968035070 con 0x7f39781019c0 2024-09-19T06:19:53.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.440+0000 7f3977200640 1 -- 172.21.15.3:0/1592886947 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39781a7020 con 0x7f39781019c0 2024-09-19T06:19:53.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.443+0000 7f396ea00640 1 -- 172.21.15.3:0/1592886947 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f3968042030 con 0x7f39781019c0 2024-09-19T06:19:53.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.444+0000 7f397effd740 1 Processor -- start 2024-09-19T06:19:53.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.444+0000 7f397effd740 1 -- start start 2024-09-19T06:19:53.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.444+0000 7f397effd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6416e40 0x558cf6417220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.444+0000 7f397effd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558cf6417760 0x558cf6421ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.444+0000 7f397effd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558cf6422020 0x558cf6424410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.444+0000 7f397effd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558cf637d3e0 con 0x558cf6417760 2024-09-19T06:19:53.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.445+0000 7f397effd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558cf6324d80 con 0x558cf6422020 2024-09-19T06:19:53.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.445+0000 7f397effd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558cf63793a0 con 0x558cf6416e40 2024-09-19T06:19:53.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.445+0000 7f396ea00640 1 --2- 172.21.15.3:0/1592886947 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f395c0a33b0 0x7f395c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.445+0000 7f3975400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558cf6422020 0x558cf6424410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.445+0000 7f3975e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558cf6417760 0x558cf6421ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.445+0000 7f3975400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558cf6422020 0x558cf6424410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:34154/0 (socket says 172.21.15.3:34154) 2024-09-19T06:19:53.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.445+0000 7f3975400640 1 -- 172.21.15.3:0/4179823108 learned_addr learned my addr 172.21.15.3:0/4179823108 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:53.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.445+0000 7f396ea00640 1 -- 172.21.15.3:0/1592886947 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f39680f0160 con 0x7f39781019c0 2024-09-19T06:19:53.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.445+0000 7f3976800640 1 --2- 172.21.15.3:0/4179823108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6416e40 0x558cf6417220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.445+0000 7f3976800640 1 --2- 172.21.15.3:0/1592886947 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f395c0a33b0 0x7f395c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.446+0000 7f3975e00640 1 -- 172.21.15.3:0/4179823108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6416e40 msgr2=0x558cf6417220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:53.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.446+0000 7f3975e00640 1 --2- 172.21.15.3:0/4179823108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6416e40 0x558cf6417220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.446+0000 7f3975e00640 1 -- 172.21.15.3:0/4179823108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558cf6422020 msgr2=0x558cf6424410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:53.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.446+0000 7f3975e00640 1 --2- 172.21.15.3:0/4179823108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558cf6422020 0x558cf6424410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.446+0000 7f3975e00640 1 -- 172.21.15.3:0/4179823108 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cf6343ae0 con 0x558cf6417760 2024-09-19T06:19:53.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.446+0000 7f3975400640 1 --2- 172.21.15.3:0/4179823108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558cf6422020 0x558cf6424410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:53.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.446+0000 7f3975e00640 1 --2- 172.21.15.3:0/4179823108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558cf6417760 0x558cf6421ae0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f39680ed820 tx=0x7f396808f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22086f0027684de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:53.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.446+0000 7f3963000640 1 -- 172.21.15.3:0/4179823108 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3968049070 con 0x558cf6417760 2024-09-19T06:19:53.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.446+0000 7f3963000640 1 -- 172.21.15.3:0/4179823108 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39680bc3b0 con 0x558cf6417760 2024-09-19T06:19:53.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.446+0000 7f3963000640 1 -- 172.21.15.3:0/4179823108 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39680bc610 con 0x558cf6417760 2024-09-19T06:19:53.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.446+0000 7f3976800640 1 --2- 172.21.15.3:0/1592886947 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f395c0a33b0 0x7f395c0a5870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3970005c40 tx=0x7f3970009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:53.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.447+0000 7f397effd740 1 -- 172.21.15.3:0/4179823108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558cf6417760 msgr2=0x558cf6421ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.447+0000 7f397effd740 1 --2- 172.21.15.3:0/4179823108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558cf6417760 0x558cf6421ae0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f39680ed820 tx=0x7f396808f1e0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.447+0000 7f397effd740 1 -- 172.21.15.3:0/4179823108 shutdown_connections 2024-09-19T06:19:53.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.447+0000 7f397effd740 1 --2- 172.21.15.3:0/4179823108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558cf6422020 0x558cf6424410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.447+0000 7f397effd740 1 --2- 172.21.15.3:0/4179823108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558cf6417760 0x558cf6421ae0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.447+0000 7f397effd740 1 --2- 172.21.15.3:0/4179823108 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6416e40 0x558cf6417220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.447+0000 7f397effd740 1 -- 172.21.15.3:0/4179823108 >> 172.21.15.3:0/4179823108 conn(0x558cf64133d0 msgr2=0x558cf64137b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:53.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.447+0000 7f397effd740 1 -- 172.21.15.3:0/4179823108 shutdown_connections 2024-09-19T06:19:53.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.447+0000 7f397effd740 1 -- 172.21.15.3:0/4179823108 wait complete. 2024-09-19T06:19:53.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.448+0000 7f397effd740 1 -- start start 2024-09-19T06:19:53.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.448+0000 7f397effd740 1 Processor -- start 2024-09-19T06:19:53.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.449+0000 7f397effd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558cf6416e40 0x558cf641efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.449+0000 7f397effd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6417760 0x558cf641f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.449+0000 7f397effd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558cf6422020 0x558cf641fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.449+0000 7f397effd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558cf64249b0 con 0x558cf6422020 2024-09-19T06:19:53.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.449+0000 7f397effd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558cf63380f0 con 0x558cf6416e40 2024-09-19T06:19:53.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.449+0000 7f397effd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558cf6424b30 con 0x558cf6417760 2024-09-19T06:19:53.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.449+0000 7f397effd740 10 client.0 _ll_register_callbacks cb 0x558cf631fbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:53.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.449+0000 7f3975e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558cf6416e40 0x558cf641efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.449+0000 7f3975400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6417760 0x558cf641f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.449+0000 7f3976800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558cf6422020 0x558cf641fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.449+0000 7f3975400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6417760 0x558cf641f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:56114/0 (socket says 172.21.15.3:56114) 2024-09-19T06:19:53.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.449+0000 7f3975e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558cf6416e40 0x558cf641efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:34170/0 (socket says 172.21.15.3:34170) 2024-09-19T06:19:53.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.449+0000 7f3975400640 1 -- 172.21.15.3:0/464208404 learned_addr learned my addr 172.21.15.3:0/464208404 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:53.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.449+0000 7f3975e00640 1 -- 172.21.15.3:0/464208404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6417760 msgr2=0x558cf641f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:53.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.449+0000 7f3975e00640 1 --2- 172.21.15.3:0/464208404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6417760 0x558cf641f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.449+0000 7f3975e00640 1 -- 172.21.15.3:0/464208404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558cf6422020 msgr2=0x558cf641fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:53.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.449+0000 7f3975e00640 1 --2- 172.21.15.3:0/464208404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558cf6422020 0x558cf641fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.449+0000 7f3975e00640 1 -- 172.21.15.3:0/464208404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cf60ee3c0 con 0x558cf6416e40 2024-09-19T06:19:53.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.449+0000 7f3975400640 1 --2- 172.21.15.3:0/464208404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6417760 0x558cf641f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:53.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.450+0000 7f3975e00640 1 --2- 172.21.15.3:0/464208404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558cf6416e40 0x558cf641efb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x558cf6417d00 tx=0x7f39680bc2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=598d02c60b2f81b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:53.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.450+0000 7f3957400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:19:53.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.450+0000 7f3957400640 1 -- 172.21.15.3:0/464208404 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3968049050 con 0x558cf6416e40 2024-09-19T06:19:53.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.450+0000 7f397effd740 1 -- 172.21.15.3:0/464208404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39680bc3b0 con 0x558cf6416e40 2024-09-19T06:19:53.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.450+0000 7f3957400640 1 -- 172.21.15.3:0/464208404 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f39680d52e0 con 0x558cf6416e40 2024-09-19T06:19:53.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.450+0000 7f3957400640 1 -- 172.21.15.3:0/464208404 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f39680edcb0 con 0x558cf6416e40 2024-09-19T06:19:53.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.450+0000 7f397effd740 10 client.27410 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:53.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.450+0000 7f397effd740 1 -- 172.21.15.3:0/464208404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558cf64249b0 con 0x558cf6416e40 2024-09-19T06:19:53.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.451+0000 7f3957400640 1 -- 172.21.15.3:0/464208404 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39680bc3b0 con 0x558cf6416e40 2024-09-19T06:19:53.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.451+0000 7f3957400640 1 -- 172.21.15.3:0/464208404 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3968031bd0 con 0x558cf6416e40 2024-09-19T06:19:53.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.451+0000 7f397effd740 10 client.27410 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:53.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.451+0000 7f397effd740 10 client.27410 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:19:53.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.451+0000 7f397effd740 20 client.27410 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:53.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.451+0000 7f397effd740 1 --2- 172.21.15.3:0/464208404 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x558cf6431ce0 0x558cf6434120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.451+0000 7f397effd740 4 client.27410 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:53.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.451+0000 7f397effd740 1 -- 172.21.15.3:0/464208404 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558cf638a950 con 0x558cf6431ce0 2024-09-19T06:19:53.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.451+0000 7f3975400640 1 --2- 172.21.15.3:0/464208404 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x558cf6431ce0 0x558cf6434120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.452+0000 7f3975400640 1 --2- 172.21.15.3:0/464208404 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x558cf6431ce0 0x558cf6434120 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9e8d6ce7b39ea13e server_cookie=ae68c5c4877f7864 in_seq=0 out_seq=0 2024-09-19T06:19:53.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.452+0000 7f3957400640 10 client.27410 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:19:53.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.453+0000 7f3957400640 1 -- 172.21.15.3:0/464208404 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558cf638a950 con 0x558cf6431ce0 2024-09-19T06:19:53.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.453+0000 7f3957400640 10 client.27410 handle_command_reply: tid=0 2024-09-19T06:19:53.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.453+0000 7f397effd740 1 client.27410 shutdown 2024-09-19T06:19:53.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.453+0000 7f397effd740 1 -- 172.21.15.3:0/464208404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558cf6416e40 msgr2=0x558cf641efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.453+0000 7f397effd740 1 --2- 172.21.15.3:0/464208404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558cf6416e40 0x558cf641efb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x558cf6417d00 tx=0x7f39680bc2b0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.453+0000 7f397effd740 1 -- 172.21.15.3:0/464208404 shutdown_connections 2024-09-19T06:19:53.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.453+0000 7f397effd740 1 --2- 172.21.15.3:0/464208404 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x558cf6431ce0 0x558cf6434120 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.453+0000 7f397effd740 1 --2- 172.21.15.3:0/464208404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558cf6422020 0x558cf641fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.453+0000 7f397effd740 1 --2- 172.21.15.3:0/464208404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6417760 0x558cf641f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.453+0000 7f3957400640 0 client.27410 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:19:53.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.453+0000 7f397effd740 1 --2- 172.21.15.3:0/464208404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558cf6416e40 0x558cf641efb0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.453+0000 7f397effd740 1 -- 172.21.15.3:0/464208404 >> 172.21.15.3:0/464208404 conn(0x558cf64133d0 msgr2=0x558cf64190b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:53.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.453+0000 7f397effd740 1 -- 172.21.15.3:0/464208404 shutdown_connections 2024-09-19T06:19:53.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.453+0000 7f397effd740 1 -- 172.21.15.3:0/464208404 wait complete. 2024-09-19T06:19:53.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.453+0000 7f397effd740 20 client.27410 trim_cache size 0 max 16384 2024-09-19T06:19:53.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.467+0000 7f397effd740 1 Processor -- start 2024-09-19T06:19:53.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.467+0000 7f397effd740 1 -- start start 2024-09-19T06:19:53.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.468+0000 7f397effd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558cf6416e40 0x558cf64399f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.468+0000 7f397effd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6417760 0x558cf6439f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.468+0000 7f397effd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558cf6422020 0x558cf6418890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.468+0000 7f397effd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f39781af9e0 con 0x558cf6422020 2024-09-19T06:19:53.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.468+0000 7f397effd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f39781b1520 con 0x558cf6416e40 2024-09-19T06:19:53.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.468+0000 7f397effd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f39781b00b0 con 0x558cf6417760 2024-09-19T06:19:53.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.468+0000 7f3976800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558cf6422020 0x558cf6418890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.468+0000 7f3975400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6417760 0x558cf6439f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.468+0000 7f3975e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558cf6416e40 0x558cf64399f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.468+0000 7f3976800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558cf6422020 0x558cf6418890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45628/0 (socket says 172.21.15.3:45628) 2024-09-19T06:19:53.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.468+0000 7f3976800640 1 -- 172.21.15.3:0/3966816695 learned_addr learned my addr 172.21.15.3:0/3966816695 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:53.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.468+0000 7f3975400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6417760 0x558cf6439f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:56116/0 (socket says 172.21.15.3:56116) 2024-09-19T06:19:53.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.469+0000 7f3975400640 1 -- 172.21.15.3:0/3966816695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558cf6416e40 msgr2=0x558cf64399f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:53.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.469+0000 7f3975400640 1 --2- 172.21.15.3:0/3966816695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558cf6416e40 0x558cf64399f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.469+0000 7f3975400640 1 -- 172.21.15.3:0/3966816695 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558cf6422020 msgr2=0x558cf6418890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:53.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.469+0000 7f3975400640 1 --2- 172.21.15.3:0/3966816695 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558cf6422020 0x558cf6418890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.469+0000 7f3975400640 1 -- 172.21.15.3:0/3966816695 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cf6416bc0 con 0x558cf6417760 2024-09-19T06:19:53.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.469+0000 7f3975400640 1 --2- 172.21.15.3:0/3966816695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6417760 0x558cf6439f30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x558cf6434930 tx=0x7f3964005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f7a106dcfb2d4cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:53.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.469+0000 7f3962600640 1 -- 172.21.15.3:0/3966816695 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3964004030 con 0x558cf6417760 2024-09-19T06:19:53.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.469+0000 7f3962600640 1 -- 172.21.15.3:0/3966816695 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f396400fd70 con 0x558cf6417760 2024-09-19T06:19:53.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.469+0000 7f3962600640 1 -- 172.21.15.3:0/3966816695 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39640039e0 con 0x558cf6417760 2024-09-19T06:19:53.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.470+0000 7f397effd740 1 -- 172.21.15.3:0/3966816695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6417760 msgr2=0x558cf6439f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.470+0000 7f397effd740 1 --2- 172.21.15.3:0/3966816695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6417760 0x558cf6439f30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x558cf6434930 tx=0x7f3964005f90 comp rx=0 tx=0).stop 2024-09-19T06:19:53.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.470+0000 7f397effd740 1 -- 172.21.15.3:0/3966816695 shutdown_connections 2024-09-19T06:19:53.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.470+0000 7f397effd740 1 --2- 172.21.15.3:0/3966816695 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558cf6422020 0x558cf6418890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.470+0000 7f397effd740 1 --2- 172.21.15.3:0/3966816695 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6417760 0x558cf6439f30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.470+0000 7f397effd740 1 --2- 172.21.15.3:0/3966816695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558cf6416e40 0x558cf64399f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.470+0000 7f397effd740 1 -- 172.21.15.3:0/3966816695 >> 172.21.15.3:0/3966816695 conn(0x558cf64133d0 msgr2=0x558cf641e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:53.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.470+0000 7f397effd740 1 -- 172.21.15.3:0/3966816695 shutdown_connections 2024-09-19T06:19:53.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.470+0000 7f397effd740 1 -- 172.21.15.3:0/3966816695 wait complete. 2024-09-19T06:19:53.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.471+0000 7f397effd740 1 -- start start 2024-09-19T06:19:53.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.471+0000 7f397effd740 1 Processor -- start 2024-09-19T06:19:53.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.471+0000 7f397effd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6416e40 0x558cf642a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.471+0000 7f397effd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558cf6417760 0x558cf642a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.471+0000 7f397effd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558cf6422020 0x558cf641bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.471+0000 7f397effd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f39781b0e50 con 0x558cf6422020 2024-09-19T06:19:53.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.471+0000 7f397effd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f39781b0780 con 0x558cf6417760 2024-09-19T06:19:53.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.471+0000 7f397effd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f39781ad9e0 con 0x558cf6416e40 2024-09-19T06:19:53.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.472+0000 7f397effd740 10 client.0 _ll_register_callbacks cb 0x7f39700099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:53.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.472+0000 7f3975e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6416e40 0x558cf642a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.472+0000 7f3975e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6416e40 0x558cf642a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:56122/0 (socket says 172.21.15.3:56122) 2024-09-19T06:19:53.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.472+0000 7f3975e00640 1 -- 172.21.15.3:0/1984517345 learned_addr learned my addr 172.21.15.3:0/1984517345 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:53.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.472+0000 7f3975400640 1 --2- 172.21.15.3:0/1984517345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558cf6417760 0x558cf642a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.472+0000 7f3976800640 1 --2- 172.21.15.3:0/1984517345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558cf6422020 0x558cf641bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.472+0000 7f3975e00640 1 -- 172.21.15.3:0/1984517345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558cf6417760 msgr2=0x558cf642a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:53.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.472+0000 7f3975e00640 1 --2- 172.21.15.3:0/1984517345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558cf6417760 0x558cf642a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.472+0000 7f3975e00640 1 -- 172.21.15.3:0/1984517345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558cf6422020 msgr2=0x558cf641bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:53.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.472+0000 7f3975e00640 1 --2- 172.21.15.3:0/1984517345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558cf6422020 0x558cf641bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.472+0000 7f3975e00640 1 -- 172.21.15.3:0/1984517345 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cf641c440 con 0x558cf6416e40 2024-09-19T06:19:53.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.472+0000 7f3976800640 1 --2- 172.21.15.3:0/1984517345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558cf6422020 0x558cf641bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:53.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.473+0000 7f3975e00640 1 --2- 172.21.15.3:0/1984517345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6416e40 0x558cf642a0a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f39680b8d80 tx=0x7f3968005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80617917fd265685 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:53.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.473+0000 7f3957400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:19:53.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.473+0000 7f3957400640 1 -- 172.21.15.3:0/1984517345 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3968049070 con 0x558cf6416e40 2024-09-19T06:19:53.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.473+0000 7f3957400640 1 -- 172.21.15.3:0/1984517345 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f39680c4d90 con 0x558cf6416e40 2024-09-19T06:19:53.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.473+0000 7f397effd740 1 -- 172.21.15.3:0/1984517345 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f396400fd70 con 0x558cf6416e40 2024-09-19T06:19:53.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.473+0000 7f3957400640 1 -- 172.21.15.3:0/1984517345 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f39680bbd10 con 0x558cf6416e40 2024-09-19T06:19:53.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.473+0000 7f397effd740 10 client.27409 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:53.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.473+0000 7f397effd740 1 -- 172.21.15.3:0/1984517345 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558cf641c440 con 0x558cf6416e40 2024-09-19T06:19:53.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.473+0000 7f3957400640 1 -- 172.21.15.3:0/1984517345 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f396400fd70 con 0x558cf6416e40 2024-09-19T06:19:53.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.474+0000 7f3957400640 1 -- 172.21.15.3:0/1984517345 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f39680bb800 con 0x558cf6416e40 2024-09-19T06:19:53.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.474+0000 7f397effd740 10 client.27409 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:53.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.474+0000 7f397effd740 10 client.27409 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:19:53.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.474+0000 7f397effd740 20 client.27409 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:53.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.474+0000 7f397effd740 1 --2- 172.21.15.3:0/1984517345 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x558cf64a52b0 0x558cf64a76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.474+0000 7f397effd740 4 client.27409 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:19:53.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.474+0000 7f397effd740 1 -- 172.21.15.3:0/1984517345 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558cf6384e60 con 0x558cf64a52b0 2024-09-19T06:19:53.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.474+0000 7f3975400640 1 --2- 172.21.15.3:0/1984517345 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x558cf64a52b0 0x558cf64a76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.475+0000 7f3975400640 1 --2- 172.21.15.3:0/1984517345 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x558cf64a52b0 0x558cf64a76a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=15e92c1826f75f10 server_cookie=91ceb6966d322c1c in_seq=0 out_seq=0 2024-09-19T06:19:53.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.475+0000 7f3957400640 10 client.27409 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:19:53.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.475+0000 7f3957400640 1 -- 172.21.15.3:0/1984517345 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558cf6384e60 con 0x558cf64a52b0 2024-09-19T06:19:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.475+0000 7f3957400640 10 client.27409 handle_command_reply: tid=0 2024-09-19T06:19:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.475+0000 7f397effd740 1 client.27409 shutdown 2024-09-19T06:19:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.475+0000 7f397effd740 1 -- 172.21.15.3:0/1984517345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6416e40 msgr2=0x558cf642a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.475+0000 7f397effd740 1 --2- 172.21.15.3:0/1984517345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6416e40 0x558cf642a0a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f39680b8d80 tx=0x7f3968005bd0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.475+0000 7f397effd740 1 -- 172.21.15.3:0/1984517345 shutdown_connections 2024-09-19T06:19:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.475+0000 7f397effd740 1 --2- 172.21.15.3:0/1984517345 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x558cf64a52b0 0x558cf64a76a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.475+0000 7f397effd740 1 --2- 172.21.15.3:0/1984517345 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558cf6422020 0x558cf641bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.475+0000 7f397effd740 1 --2- 172.21.15.3:0/1984517345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558cf6417760 0x558cf642a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.475+0000 7f3957400640 0 client.27409 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:19:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.475+0000 7f397effd740 1 --2- 172.21.15.3:0/1984517345 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558cf6416e40 0x558cf642a0a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.475+0000 7f397effd740 1 -- 172.21.15.3:0/1984517345 >> 172.21.15.3:0/1984517345 conn(0x558cf64133d0 msgr2=0x558cf6418890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.476+0000 7f397effd740 1 -- 172.21.15.3:0/1984517345 shutdown_connections 2024-09-19T06:19:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.476+0000 7f397effd740 1 -- 172.21.15.3:0/1984517345 wait complete. 2024-09-19T06:19:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.476+0000 7f397effd740 20 client.27409 trim_cache size 0 max 16384 2024-09-19T06:19:53.482 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:19:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.476+0000 7f3977200640 1 -- 172.21.15.3:0/1592886947 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f395c0a33b0 msgr2=0x7f395c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.476+0000 7f3977200640 1 --2- 172.21.15.3:0/1592886947 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f395c0a33b0 0x7f395c0a5870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3970005c40 tx=0x7f3970009500 comp rx=0 tx=0).stop 2024-09-19T06:19:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.476+0000 7f3977200640 1 -- 172.21.15.3:0/1592886947 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39781019c0 msgr2=0x7f397819a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.476+0000 7f3977200640 1 --2- 172.21.15.3:0/1592886947 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39781019c0 0x7f397819a4a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f3968009230 tx=0x7f3968004040 comp rx=0 tx=0).stop 2024-09-19T06:19:53.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.477+0000 7f3977200640 1 -- 172.21.15.3:0/1592886947 shutdown_connections 2024-09-19T06:19:53.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.477+0000 7f3977200640 1 --2- 172.21.15.3:0/1592886947 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f395c0a33b0 0x7f395c0a5870 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.477+0000 7f3977200640 1 --2- 172.21.15.3:0/1592886947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39781079c0 0x7f397819ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.477+0000 7f3977200640 1 --2- 172.21.15.3:0/1592886947 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3978102360 0x7f397819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.477+0000 7f3977200640 1 --2- 172.21.15.3:0/1592886947 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39781019c0 0x7f397819a4a0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.477+0000 7f3977200640 1 -- 172.21.15.3:0/1592886947 >> 172.21.15.3:0/1592886947 conn(0x7f39780fd6e0 msgr2=0x7f397810d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:53.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.477+0000 7f3977200640 1 -- 172.21.15.3:0/1592886947 shutdown_connections 2024-09-19T06:19:53.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:53.477+0000 7f3977200640 1 -- 172.21.15.3:0/1592886947 wait complete. 2024-09-19T06:19:53.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.603+0000 7f8a2d600640 1 -- 172.21.15.3:0/270530933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a28107ad0 msgr2=0x7f8a28107eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.603+0000 7f8a2d600640 1 --2- 172.21.15.3:0/270530933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a28107ad0 0x7f8a28107eb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8a18009900 tx=0x7f8a1802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.603+0000 7f8a2d600640 1 -- 172.21.15.3:0/270530933 shutdown_connections 2024-09-19T06:19:53.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.603+0000 7f8a2d600640 1 --2- 172.21.15.3:0/270530933 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8a28102460 0x7f8a2810e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.606 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.603+0000 7f8a2d600640 1 --2- 172.21.15.3:0/270530933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a28101ac0 0x7f8a28101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.606 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.603+0000 7f8a2d600640 1 --2- 172.21.15.3:0/270530933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a28107ad0 0x7f8a28107eb0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.606 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.603+0000 7f8a2d600640 1 -- 172.21.15.3:0/270530933 >> 172.21.15.3:0/270530933 conn(0x7f8a280fd7e0 msgr2=0x7f8a280ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:53.606 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.603+0000 7f8a2d600640 1 -- 172.21.15.3:0/270530933 shutdown_connections 2024-09-19T06:19:53.606 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.603+0000 7f8a2d600640 1 -- 172.21.15.3:0/270530933 wait complete. 2024-09-19T06:19:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.604+0000 7f8a2d600640 1 Processor -- start 2024-09-19T06:19:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.604+0000 7f8a2d600640 1 -- start start 2024-09-19T06:19:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.605+0000 7f8a2d600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a28101ac0 0x7f8a281983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.605+0000 7f8a2d600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a28102460 0x7f8a28198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.605+0000 7f8a2d600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8a28107ad0 0x7f8a2819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.608 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.605+0000 7f8a2d600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8a28111f10 con 0x7f8a28107ad0 2024-09-19T06:19:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.605+0000 7f8a2d600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8a28111d90 con 0x7f8a28102460 2024-09-19T06:19:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.605+0000 7f8a2d600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8a28112090 con 0x7f8a28101ac0 2024-09-19T06:19:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.605+0000 7f8a27400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8a28107ad0 0x7f8a2819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.605+0000 7f8a27400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8a28107ad0 0x7f8a2819cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45668/0 (socket says 172.21.15.3:45668) 2024-09-19T06:19:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.605+0000 7f8a27400640 1 -- 172.21.15.3:0/2180042374 learned_addr learned my addr 172.21.15.3:0/2180042374 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.605+0000 7f8a1fe00640 1 --2- 172.21.15.3:0/2180042374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a28102460 0x7f8a28198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.605+0000 7f8a26a00640 1 --2- 172.21.15.3:0/2180042374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a28101ac0 0x7f8a281983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.605+0000 7f8a27400640 1 -- 172.21.15.3:0/2180042374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a28101ac0 msgr2=0x7f8a281983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.605+0000 7f8a27400640 1 --2- 172.21.15.3:0/2180042374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a28101ac0 0x7f8a281983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.605+0000 7f8a27400640 1 -- 172.21.15.3:0/2180042374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a28102460 msgr2=0x7f8a28198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.605+0000 7f8a27400640 1 --2- 172.21.15.3:0/2180042374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a28102460 0x7f8a28198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.609 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.605+0000 7f8a27400640 1 -- 172.21.15.3:0/2180042374 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2819d3d0 con 0x7f8a28107ad0 2024-09-19T06:19:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.605+0000 7f8a1fe00640 1 --2- 172.21.15.3:0/2180042374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a28102460 0x7f8a28198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.606+0000 7f8a27400640 1 --2- 172.21.15.3:0/2180042374 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8a28107ad0 0x7f8a2819cca0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f8a2000eb10 tx=0x7f8a2000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.606+0000 7f8a1f400640 1 -- 172.21.15.3:0/2180042374 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a20004b20 con 0x7f8a28107ad0 2024-09-19T06:19:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.606+0000 7f8a2d600640 1 -- 172.21.15.3:0/2180042374 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a2819d6c0 con 0x7f8a28107ad0 2024-09-19T06:19:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.606+0000 7f8a1f400640 1 -- 172.21.15.3:0/2180042374 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a20004cc0 con 0x7f8a28107ad0 2024-09-19T06:19:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.606+0000 7f8a1f400640 1 -- 172.21.15.3:0/2180042374 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a20010760 con 0x7f8a28107ad0 2024-09-19T06:19:53.610 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.606+0000 7f8a2d600640 1 -- 172.21.15.3:0/2180042374 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a281a4f50 con 0x7f8a28107ad0 2024-09-19T06:19:53.612 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.610+0000 7f8a30649740 1 Processor -- start 2024-09-19T06:19:53.612 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.610+0000 7f8a1f400640 1 -- 172.21.15.3:0/2180042374 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f8a20005020 con 0x7f8a28107ad0 2024-09-19T06:19:53.612 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.611+0000 7f8a30649740 1 -- start start 2024-09-19T06:19:53.613 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.611+0000 7f8a30649740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ac1be1f0e0 0x55ac1be1f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.611+0000 7f8a30649740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ac1be1fa00 0x55ac1be2e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.611+0000 7f8a30649740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be2e7b0 0x55ac1be30ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.611+0000 7f8a30649740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ac1bd85100 con 0x55ac1be2e7b0 2024-09-19T06:19:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.611+0000 7f8a30649740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ac1bd2d1b0 con 0x55ac1be1fa00 2024-09-19T06:19:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.611+0000 7f8a30649740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ac1bd810c0 con 0x55ac1be1f0e0 2024-09-19T06:19:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.611+0000 7f8a1fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ac1be1f0e0 0x55ac1be1f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.611+0000 7f8a26a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ac1be1fa00 0x55ac1be2e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.612+0000 7f8a1fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ac1be1f0e0 0x55ac1be1f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:56162/0 (socket says 172.21.15.3:56162) 2024-09-19T06:19:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.612+0000 7f8a1fe00640 1 -- 172.21.15.3:0/1583119137 learned_addr learned my addr 172.21.15.3:0/1583119137 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.612+0000 7f8a1fe00640 1 --2- 172.21.15.3:0/1583119137 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be2e7b0 0x55ac1be30ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.614 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.612+0000 7f8a26a00640 1 -- 172.21.15.3:0/1583119137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ac1be1f0e0 msgr2=0x55ac1be1f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:53.615 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.612+0000 7f8a26a00640 1 --2- 172.21.15.3:0/1583119137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ac1be1f0e0 0x55ac1be1f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.615 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.612+0000 7f8a26a00640 1 -- 172.21.15.3:0/1583119137 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be2e7b0 msgr2=0x55ac1be30ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:53.615 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.612+0000 7f8a26a00640 1 --2- 172.21.15.3:0/1583119137 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be2e7b0 0x55ac1be30ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.615 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.612+0000 7f8a26a00640 1 -- 172.21.15.3:0/1583119137 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac1ba98210 con 0x55ac1be1fa00 2024-09-19T06:19:53.615 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.612+0000 7f8a1f400640 1 --2- 172.21.15.3:0/2180042374 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8a0c0a33b0 0x7f8a0c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.612+0000 7f8a1f400640 1 -- 172.21.15.3:0/2180042374 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f8a200d0240 con 0x7f8a28107ad0 2024-09-19T06:19:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.612+0000 7f8a26a00640 1 --2- 172.21.15.3:0/1583119137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ac1be1fa00 0x55ac1be2e270 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8a18005940 tx=0x7f8a18005dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e425d3434e235f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.612+0000 7f8a1fe00640 1 --2- 172.21.15.3:0/2180042374 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8a0c0a33b0 0x7f8a0c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.613+0000 7f8a17400640 1 -- 172.21.15.3:0/1583119137 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a18035030 con 0x55ac1be1fa00 2024-09-19T06:19:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.613+0000 7f8a17400640 1 -- 172.21.15.3:0/1583119137 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a18040070 con 0x55ac1be1fa00 2024-09-19T06:19:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.613+0000 7f8a17400640 1 -- 172.21.15.3:0/1583119137 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a18004c80 con 0x55ac1be1fa00 2024-09-19T06:19:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.613+0000 7f8a30649740 1 -- 172.21.15.3:0/1583119137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ac1be1fa00 msgr2=0x55ac1be2e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.613+0000 7f8a30649740 1 --2- 172.21.15.3:0/1583119137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ac1be1fa00 0x55ac1be2e270 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8a18005940 tx=0x7f8a18005dd0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.613+0000 7f8a1fe00640 1 --2- 172.21.15.3:0/2180042374 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8a0c0a33b0 0x7f8a0c0a5870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55ac1be20c60 tx=0x7f8a10005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.614+0000 7f8a30649740 1 -- 172.21.15.3:0/1583119137 shutdown_connections 2024-09-19T06:19:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.614+0000 7f8a30649740 1 --2- 172.21.15.3:0/1583119137 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be2e7b0 0x55ac1be30ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.614+0000 7f8a30649740 1 --2- 172.21.15.3:0/1583119137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ac1be1fa00 0x55ac1be2e270 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.614+0000 7f8a30649740 1 --2- 172.21.15.3:0/1583119137 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ac1be1f0e0 0x55ac1be1f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.614+0000 7f8a30649740 1 -- 172.21.15.3:0/1583119137 >> 172.21.15.3:0/1583119137 conn(0x55ac1be1b750 msgr2=0x55ac1be1bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.614+0000 7f8a30649740 1 -- 172.21.15.3:0/1583119137 shutdown_connections 2024-09-19T06:19:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.614+0000 7f8a30649740 1 -- 172.21.15.3:0/1583119137 wait complete. 2024-09-19T06:19:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.614+0000 7f8a30649740 1 -- start start 2024-09-19T06:19:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.614+0000 7f8a30649740 1 Processor -- start 2024-09-19T06:19:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.615+0000 7f8a30649740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ac1be1f0e0 0x55ac1be2b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.615+0000 7f8a30649740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ac1be1fa00 0x55ac1be2bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.615+0000 7f8a30649740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be2e7b0 0x55ac1be2c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.615+0000 7f8a30649740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ac1be313b0 con 0x55ac1be2e7b0 2024-09-19T06:19:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.615+0000 7f8a30649740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ac1bd0e090 con 0x55ac1be1fa00 2024-09-19T06:19:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.615+0000 7f8a30649740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ac1be31530 con 0x55ac1be1f0e0 2024-09-19T06:19:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.615+0000 7f8a30649740 10 client.0 _ll_register_callbacks cb 0x55ac1bd62f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.615+0000 7f8a27400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be2e7b0 0x55ac1be2c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.615+0000 7f8a27400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be2e7b0 0x55ac1be2c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45694/0 (socket says 172.21.15.3:45694) 2024-09-19T06:19:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.615+0000 7f8a27400640 1 -- 172.21.15.3:0/1783276063 learned_addr learned my addr 172.21.15.3:0/1783276063 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.615+0000 7f8a26a00640 1 --2- 172.21.15.3:0/1783276063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ac1be1f0e0 0x55ac1be2b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.615+0000 7f8a1fe00640 1 --2- 172.21.15.3:0/1783276063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ac1be1fa00 0x55ac1be2bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.616+0000 7f8a27400640 1 -- 172.21.15.3:0/1783276063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ac1be1f0e0 msgr2=0x55ac1be2b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.616+0000 7f8a27400640 1 --2- 172.21.15.3:0/1783276063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ac1be1f0e0 0x55ac1be2b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.616+0000 7f8a27400640 1 -- 172.21.15.3:0/1783276063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ac1be1fa00 msgr2=0x55ac1be2bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.616+0000 7f8a27400640 1 --2- 172.21.15.3:0/1783276063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ac1be1fa00 0x55ac1be2bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.616+0000 7f8a27400640 1 -- 172.21.15.3:0/1783276063 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac1bb64620 con 0x55ac1be2e7b0 2024-09-19T06:19:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.616+0000 7f8a27400640 1 --2- 172.21.15.3:0/1783276063 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be2e7b0 0x55ac1be2c140 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f8a20098950 tx=0x7f8a20098160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727133df0245d918 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.616+0000 7f8a0be00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:19:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.616+0000 7f8a0be00640 1 -- 172.21.15.3:0/1783276063 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a200a4ed0 con 0x55ac1be2e7b0 2024-09-19T06:19:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.616+0000 7f8a0be00640 1 -- 172.21.15.3:0/1783276063 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f8a20005310 con 0x55ac1be2e7b0 2024-09-19T06:19:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.616+0000 7f8a30649740 1 -- 172.21.15.3:0/1783276063 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a18040070 con 0x55ac1be2e7b0 2024-09-19T06:19:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.616+0000 7f8a0be00640 1 -- 172.21.15.3:0/1783276063 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8a2009cbf0 con 0x55ac1be2e7b0 2024-09-19T06:19:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.616+0000 7f8a30649740 10 client.17388 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.616+0000 7f8a30649740 1 -- 172.21.15.3:0/1783276063 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ac1be3d090 con 0x55ac1be2e7b0 2024-09-19T06:19:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.617+0000 7f8a0be00640 1 -- 172.21.15.3:0/1783276063 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a18040070 con 0x55ac1be2e7b0 2024-09-19T06:19:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.617+0000 7f8a0be00640 1 -- 172.21.15.3:0/1783276063 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8a200b5200 con 0x55ac1be2e7b0 2024-09-19T06:19:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.617+0000 7f8a30649740 10 client.17388 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.617+0000 7f8a30649740 10 client.17388 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.617+0000 7f8a30649740 20 client.17388 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.617+0000 7f8a30649740 1 --2- 172.21.15.3:0/1783276063 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ac1be3e550 0x55ac1be409c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.617+0000 7f8a30649740 4 client.17388 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.617+0000 7f8a30649740 1 -- 172.21.15.3:0/1783276063 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac1bd92830 con 0x55ac1be3e550 2024-09-19T06:19:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.618+0000 7f8a26a00640 1 --2- 172.21.15.3:0/1783276063 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ac1be3e550 0x55ac1be409c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.618+0000 7f8a26a00640 1 --2- 172.21.15.3:0/1783276063 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ac1be3e550 0x55ac1be409c0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6123cc2de5d5f989 server_cookie=db5e23ad957bcbce in_seq=0 out_seq=0 2024-09-19T06:19:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.618+0000 7f8a0be00640 10 client.17388 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.619+0000 7f8a0be00640 1 -- 172.21.15.3:0/1783276063 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ac1bd92830 con 0x55ac1be3e550 2024-09-19T06:19:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.619+0000 7f8a0be00640 10 client.17388 handle_command_reply: tid=0 2024-09-19T06:19:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.619+0000 7f8a30649740 1 client.17388 shutdown 2024-09-19T06:19:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.619+0000 7f8a30649740 1 -- 172.21.15.3:0/1783276063 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be2e7b0 msgr2=0x55ac1be2c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.619+0000 7f8a30649740 1 --2- 172.21.15.3:0/1783276063 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be2e7b0 0x55ac1be2c140 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f8a20098950 tx=0x7f8a20098160 comp rx=0 tx=0).stop 2024-09-19T06:19:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.619+0000 7f8a30649740 1 -- 172.21.15.3:0/1783276063 shutdown_connections 2024-09-19T06:19:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.619+0000 7f8a30649740 1 --2- 172.21.15.3:0/1783276063 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ac1be3e550 0x55ac1be409c0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.619+0000 7f8a30649740 1 --2- 172.21.15.3:0/1783276063 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be2e7b0 0x55ac1be2c140 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.619+0000 7f8a30649740 1 --2- 172.21.15.3:0/1783276063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ac1be1fa00 0x55ac1be2bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.619+0000 7f8a30649740 1 --2- 172.21.15.3:0/1783276063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ac1be1f0e0 0x55ac1be2b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.619+0000 7f8a0be00640 0 client.17388 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.619+0000 7f8a30649740 1 -- 172.21.15.3:0/1783276063 >> 172.21.15.3:0/1783276063 conn(0x55ac1be1b750 msgr2=0x55ac1be214b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.619+0000 7f8a30649740 1 -- 172.21.15.3:0/1783276063 shutdown_connections 2024-09-19T06:19:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.619+0000 7f8a30649740 1 -- 172.21.15.3:0/1783276063 wait complete. 2024-09-19T06:19:53.625 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.619+0000 7f8a30649740 20 client.17388 trim_cache size 0 max 16384 2024-09-19T06:19:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.634+0000 7f8a30649740 1 Processor -- start 2024-09-19T06:19:53.637 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.634+0000 7f8a30649740 1 -- start start 2024-09-19T06:19:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.635+0000 7f8a30649740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be1f0e0 0x55ac1be2d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.635+0000 7f8a30649740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ac1be1fa00 0x55ac1be462d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.635+0000 7f8a30649740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ac1be2e7b0 0x55ac1be46810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.635+0000 7f8a30649740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8a281ab770 con 0x55ac1be1f0e0 2024-09-19T06:19:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.635+0000 7f8a30649740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8a281ad2b0 con 0x55ac1be2e7b0 2024-09-19T06:19:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.635+0000 7f8a30649740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8a281abe40 con 0x55ac1be1fa00 2024-09-19T06:19:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.635+0000 7f8a26a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be1f0e0 0x55ac1be2d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.635+0000 7f8a26a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be1f0e0 0x55ac1be2d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45710/0 (socket says 172.21.15.3:45710) 2024-09-19T06:19:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.635+0000 7f8a26a00640 1 -- 172.21.15.3:0/1887615388 learned_addr learned my addr 172.21.15.3:0/1887615388 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.635+0000 7f8a27400640 1 --2- 172.21.15.3:0/1887615388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ac1be2e7b0 0x55ac1be46810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.635+0000 7f8a1fe00640 1 --2- 172.21.15.3:0/1887615388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ac1be1fa00 0x55ac1be462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.638 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.635+0000 7f8a26a00640 1 -- 172.21.15.3:0/1887615388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ac1be1fa00 msgr2=0x55ac1be462d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.635+0000 7f8a26a00640 1 --2- 172.21.15.3:0/1887615388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ac1be1fa00 0x55ac1be462d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.635+0000 7f8a26a00640 1 -- 172.21.15.3:0/1887615388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ac1be2e7b0 msgr2=0x55ac1be46810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.635+0000 7f8a26a00640 1 --2- 172.21.15.3:0/1887615388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ac1be2e7b0 0x55ac1be46810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.635+0000 7f8a26a00640 1 -- 172.21.15.3:0/1887615388 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac1be1b580 con 0x55ac1be1f0e0 2024-09-19T06:19:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.635+0000 7f8a1fe00640 1 --2- 172.21.15.3:0/1887615388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ac1be1fa00 0x55ac1be462d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:19:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.636+0000 7f8a26a00640 1 --2- 172.21.15.3:0/1887615388 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be1f0e0 0x55ac1be2d520 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8a18009900 tx=0x7f8a18004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec94266a327f1d72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.636+0000 7f8a16a00640 1 -- 172.21.15.3:0/1887615388 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a18035040 con 0x55ac1be1f0e0 2024-09-19T06:19:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.636+0000 7f8a16a00640 1 -- 172.21.15.3:0/1887615388 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a18040030 con 0x55ac1be1f0e0 2024-09-19T06:19:53.639 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.636+0000 7f8a16a00640 1 -- 172.21.15.3:0/1887615388 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a18049040 con 0x55ac1be1f0e0 2024-09-19T06:19:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.636+0000 7f8a30649740 1 -- 172.21.15.3:0/1887615388 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be1f0e0 msgr2=0x55ac1be2d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.636+0000 7f8a30649740 1 --2- 172.21.15.3:0/1887615388 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be1f0e0 0x55ac1be2d520 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f8a18009900 tx=0x7f8a18004860 comp rx=0 tx=0).stop 2024-09-19T06:19:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.636+0000 7f8a30649740 1 -- 172.21.15.3:0/1887615388 shutdown_connections 2024-09-19T06:19:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.636+0000 7f8a30649740 1 --2- 172.21.15.3:0/1887615388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ac1be2e7b0 0x55ac1be46810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.642 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.636+0000 7f8a30649740 1 --2- 172.21.15.3:0/1887615388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ac1be1fa00 0x55ac1be462d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.636+0000 7f8a30649740 1 --2- 172.21.15.3:0/1887615388 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be1f0e0 0x55ac1be2d520 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.636+0000 7f8a30649740 1 -- 172.21.15.3:0/1887615388 >> 172.21.15.3:0/1887615388 conn(0x55ac1be1b750 msgr2=0x55ac1be2ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.637+0000 7f8a30649740 1 -- 172.21.15.3:0/1887615388 shutdown_connections 2024-09-19T06:19:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.637+0000 7f8a30649740 1 -- 172.21.15.3:0/1887615388 wait complete. 2024-09-19T06:19:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.637+0000 7f8a30649740 1 -- start start 2024-09-19T06:19:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.637+0000 7f8a30649740 1 Processor -- start 2024-09-19T06:19:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.638+0000 7f8a30649740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ac1be1f0e0 0x55ac1be32580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.638+0000 7f8a30649740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be1fa00 0x55ac1be32ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.638+0000 7f8a30649740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ac1be2e7b0 0x55ac1be33000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.638+0000 7f8a30649740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8a281acbe0 con 0x55ac1be1fa00 2024-09-19T06:19:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.638+0000 7f8a30649740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8a281ac510 con 0x55ac1be1f0e0 2024-09-19T06:19:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.638+0000 7f8a30649740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8a281a9770 con 0x55ac1be2e7b0 2024-09-19T06:19:53.643 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.638+0000 7f8a30649740 10 client.0 _ll_register_callbacks cb 0x7f8a20098790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.638+0000 7f8a26a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ac1be1f0e0 0x55ac1be32580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.638+0000 7f8a1fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be1fa00 0x55ac1be32ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.638+0000 7f8a26a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ac1be1f0e0 0x55ac1be32580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:34232/0 (socket says 172.21.15.3:34232) 2024-09-19T06:19:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.638+0000 7f8a26a00640 1 -- 172.21.15.3:0/206078601 learned_addr learned my addr 172.21.15.3:0/206078601 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.638+0000 7f8a27400640 1 --2- 172.21.15.3:0/206078601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ac1be2e7b0 0x55ac1be33000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.638+0000 7f8a26a00640 1 -- 172.21.15.3:0/206078601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ac1be2e7b0 msgr2=0x55ac1be33000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.638+0000 7f8a26a00640 1 --2- 172.21.15.3:0/206078601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ac1be2e7b0 0x55ac1be33000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.638+0000 7f8a26a00640 1 -- 172.21.15.3:0/206078601 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be1fa00 msgr2=0x55ac1be32ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.638+0000 7f8a26a00640 1 --2- 172.21.15.3:0/206078601 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be1fa00 0x55ac1be32ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.639+0000 7f8a26a00640 1 -- 172.21.15.3:0/206078601 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac1be16d60 con 0x55ac1be1f0e0 2024-09-19T06:19:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.639+0000 7f8a1fe00640 1 --2- 172.21.15.3:0/206078601 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be1fa00 0x55ac1be32ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.639+0000 7f8a27400640 1 --2- 172.21.15.3:0/206078601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ac1be2e7b0 0x55ac1be33000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.639+0000 7f8a26a00640 1 --2- 172.21.15.3:0/206078601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ac1be1f0e0 0x55ac1be32580 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8a18031850 tx=0x7f8a180058d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e30dd441b5c60c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:53.644 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.639+0000 7f8a0be00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:19:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.639+0000 7f8a0be00640 1 -- 172.21.15.3:0/206078601 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a18049070 con 0x55ac1be1f0e0 2024-09-19T06:19:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.639+0000 7f8a30649740 1 -- 172.21.15.3:0/206078601 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a18040030 con 0x55ac1be1f0e0 2024-09-19T06:19:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.639+0000 7f8a0be00640 1 -- 172.21.15.3:0/206078601 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f8a18031af0 con 0x55ac1be1f0e0 2024-09-19T06:19:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.639+0000 7f8a0be00640 1 -- 172.21.15.3:0/206078601 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8a18067050 con 0x55ac1be1f0e0 2024-09-19T06:19:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.640+0000 7f8a30649740 10 client.27434 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.640+0000 7f8a30649740 1 -- 172.21.15.3:0/206078601 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ac1bea93b0 con 0x55ac1be1f0e0 2024-09-19T06:19:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.640+0000 7f8a0be00640 1 -- 172.21.15.3:0/206078601 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a18040030 con 0x55ac1be1f0e0 2024-09-19T06:19:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.640+0000 7f8a0be00640 1 -- 172.21.15.3:0/206078601 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8a180634f0 con 0x55ac1be1f0e0 2024-09-19T06:19:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.640+0000 7f8a30649740 10 client.27434 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.640+0000 7f8a30649740 10 client.27434 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.640+0000 7f8a30649740 20 client.27434 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.640+0000 7f8a30649740 1 --2- 172.21.15.3:0/206078601 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ac1bea9630 0x55ac1beaba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:53.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.640+0000 7f8a30649740 4 client.27434 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:19:53.646 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.640+0000 7f8a30649740 1 -- 172.21.15.3:0/206078601 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ac1bd8cb80 con 0x55ac1bea9630 2024-09-19T06:19:53.646 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.640+0000 7f8a1fe00640 1 --2- 172.21.15.3:0/206078601 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ac1bea9630 0x55ac1beaba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:53.646 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.641+0000 7f8a1fe00640 1 --2- 172.21.15.3:0/206078601 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ac1bea9630 0x55ac1beaba20 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e7d695b1d2bbee2 server_cookie=47754d64ae841c72 in_seq=0 out_seq=0 2024-09-19T06:19:53.646 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.641+0000 7f8a0be00640 10 client.27434 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:53.659 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.656+0000 7f8a0be00640 1 -- 172.21.15.3:0/206078601 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ac1bd8cb80 con 0x55ac1bea9630 2024-09-19T06:19:53.659 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.656+0000 7f8a0be00640 10 client.27434 handle_command_reply: tid=0 2024-09-19T06:19:53.659 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.656+0000 7f8a30649740 1 client.27434 shutdown 2024-09-19T06:19:53.659 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.657+0000 7f8a30649740 1 -- 172.21.15.3:0/206078601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ac1be1f0e0 msgr2=0x55ac1be32580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.659 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.657+0000 7f8a30649740 1 --2- 172.21.15.3:0/206078601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ac1be1f0e0 0x55ac1be32580 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8a18031850 tx=0x7f8a180058d0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.659 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.657+0000 7f8a30649740 1 -- 172.21.15.3:0/206078601 shutdown_connections 2024-09-19T06:19:53.659 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.657+0000 7f8a30649740 1 --2- 172.21.15.3:0/206078601 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ac1bea9630 0x55ac1beaba20 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.659 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.657+0000 7f8a30649740 1 --2- 172.21.15.3:0/206078601 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ac1be2e7b0 0x55ac1be33000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.659 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.657+0000 7f8a30649740 1 --2- 172.21.15.3:0/206078601 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ac1be1fa00 0x55ac1be32ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.659 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.657+0000 7f8a0be00640 0 client.27434 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:53.659 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.657+0000 7f8a30649740 1 --2- 172.21.15.3:0/206078601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ac1be1f0e0 0x55ac1be32580 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.659 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.657+0000 7f8a30649740 1 -- 172.21.15.3:0/206078601 >> 172.21.15.3:0/206078601 conn(0x55ac1be1b750 msgr2=0x55ac1be2bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:53.660 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.657+0000 7f8a30649740 1 -- 172.21.15.3:0/206078601 shutdown_connections 2024-09-19T06:19:53.660 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.657+0000 7f8a30649740 1 -- 172.21.15.3:0/206078601 wait complete. 2024-09-19T06:19:53.660 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.657+0000 7f8a30649740 20 client.27434 trim_cache size 0 max 16384 2024-09-19T06:19:53.660 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:19:53.660 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:19:53.660 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:19:53.660 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:19:53.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.658+0000 7f8a2d600640 1 -- 172.21.15.3:0/2180042374 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8a0c0a33b0 msgr2=0x7f8a0c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.658+0000 7f8a2d600640 1 --2- 172.21.15.3:0/2180042374 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8a0c0a33b0 0x7f8a0c0a5870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55ac1be20c60 tx=0x7f8a10005f90 comp rx=0 tx=0).stop 2024-09-19T06:19:53.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.658+0000 7f8a2d600640 1 -- 172.21.15.3:0/2180042374 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8a28107ad0 msgr2=0x7f8a2819cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:53.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.658+0000 7f8a2d600640 1 --2- 172.21.15.3:0/2180042374 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8a28107ad0 0x7f8a2819cca0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f8a2000eb10 tx=0x7f8a2000c2d0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.658+0000 7f8a2d600640 1 -- 172.21.15.3:0/2180042374 shutdown_connections 2024-09-19T06:19:53.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.658+0000 7f8a2d600640 1 --2- 172.21.15.3:0/2180042374 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8a0c0a33b0 0x7f8a0c0a5870 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.658+0000 7f8a2d600640 1 --2- 172.21.15.3:0/2180042374 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8a28107ad0 0x7f8a2819cca0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.658+0000 7f8a2d600640 1 --2- 172.21.15.3:0/2180042374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a28102460 0x7f8a28198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.658+0000 7f8a2d600640 1 --2- 172.21.15.3:0/2180042374 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8a28101ac0 0x7f8a281983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:53.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.658+0000 7f8a2d600640 1 -- 172.21.15.3:0/2180042374 >> 172.21.15.3:0/2180042374 conn(0x7f8a280fd7e0 msgr2=0x7f8a280fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:53.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.658+0000 7f8a2d600640 1 -- 172.21.15.3:0/2180042374 shutdown_connections 2024-09-19T06:19:53.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:19:53.658+0000 7f8a2d600640 1 -- 172.21.15.3:0/2180042374 wait complete. 2024-09-19T06:19:54.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:53 smithi059 ceph-mon[35138]: pgmap v230: 97 pgs: 97 active+clean; 4.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 16 op/s 2024-09-19T06:19:54.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:53 smithi003 ceph-mon[30893]: pgmap v230: 97 pgs: 97 active+clean; 4.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 16 op/s 2024-09-19T06:19:54.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:53 smithi071 ceph-mon[35662]: pgmap v230: 97 pgs: 97 active+clean; 4.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 16 op/s 2024-09-19T06:19:54.547 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:19:54.927 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:55.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.490+0000 7f1b8ee00640 1 -- 172.21.15.3:0/2867984069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b88101de0 msgr2=0x7f1b881021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:55.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.490+0000 7f1b8ee00640 1 --2- 172.21.15.3:0/2867984069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b88101de0 0x7f1b881021c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1b78009900 tx=0x7f1b7802a410 comp rx=0 tx=0).stop 2024-09-19T06:19:55.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.490+0000 7f1b8ee00640 1 -- 172.21.15.3:0/2867984069 shutdown_connections 2024-09-19T06:19:55.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.490+0000 7f1b8ee00640 1 --2- 172.21.15.3:0/2867984069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b88106f10 0x7f1b8810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.490+0000 7f1b8ee00640 1 --2- 172.21.15.3:0/2867984069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b88102790 0x7f1b881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.490+0000 7f1b8ee00640 1 --2- 172.21.15.3:0/2867984069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b88101de0 0x7f1b881021c0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.490+0000 7f1b8ee00640 1 -- 172.21.15.3:0/2867984069 >> 172.21.15.3:0/2867984069 conn(0x7f1b880fd8c0 msgr2=0x7f1b880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:55.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.491+0000 7f1b8ee00640 1 -- 172.21.15.3:0/2867984069 shutdown_connections 2024-09-19T06:19:55.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.491+0000 7f1b8ee00640 1 -- 172.21.15.3:0/2867984069 wait complete. 2024-09-19T06:19:55.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.492+0000 7f1b8ee00640 1 Processor -- start 2024-09-19T06:19:55.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.492+0000 7f1b8ee00640 1 -- start start 2024-09-19T06:19:55.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.492+0000 7f1b8ee00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b88101de0 0x7f1b88198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:55.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.493+0000 7f1b8ee00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b88102790 0x7f1b88198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:55.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.493+0000 7f1b8ee00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b88106f10 0x7f1b8819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:55.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.493+0000 7f1b8ee00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1b88111fc0 con 0x7f1b88102790 2024-09-19T06:19:55.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.493+0000 7f1b8ee00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1b88111e40 con 0x7f1b88101de0 2024-09-19T06:19:55.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.493+0000 7f1b8ee00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1b88112140 con 0x7f1b88106f10 2024-09-19T06:19:55.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.493+0000 7f1b7fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b88102790 0x7f1b88198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:55.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.493+0000 7f1b87e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b88101de0 0x7f1b88198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:55.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.493+0000 7f1b7fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b88102790 0x7f1b88198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52176/0 (socket says 172.21.15.3:52176) 2024-09-19T06:19:55.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.493+0000 7f1b7fe00640 1 -- 172.21.15.3:0/4141406972 learned_addr learned my addr 172.21.15.3:0/4141406972 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:55.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.493+0000 7f1b8ce00640 1 --2- 172.21.15.3:0/4141406972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b88106f10 0x7f1b8819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:55.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.493+0000 7f1b7fe00640 1 -- 172.21.15.3:0/4141406972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b88106f10 msgr2=0x7f1b8819cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:55.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.493+0000 7f1b7fe00640 1 --2- 172.21.15.3:0/4141406972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b88106f10 0x7f1b8819cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.493+0000 7f1b7fe00640 1 -- 172.21.15.3:0/4141406972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b88101de0 msgr2=0x7f1b88198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:55.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.493+0000 7f1b7fe00640 1 --2- 172.21.15.3:0/4141406972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b88101de0 0x7f1b88198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.493+0000 7f1b7fe00640 1 -- 172.21.15.3:0/4141406972 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b8819d3f0 con 0x7f1b88102790 2024-09-19T06:19:55.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.493+0000 7f1b8ce00640 1 --2- 172.21.15.3:0/4141406972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b88106f10 0x7f1b8819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:55.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.493+0000 7f1b87e00640 1 --2- 172.21.15.3:0/4141406972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b88101de0 0x7f1b88198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:55.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.494+0000 7f1b7fe00640 1 --2- 172.21.15.3:0/4141406972 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b88102790 0x7f1b88198980 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000e9f0 tx=0x7f1b7000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:55.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.494+0000 7f1b85600640 1 -- 172.21.15.3:0/4141406972 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7000cd80 con 0x7f1b88102790 2024-09-19T06:19:55.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.494+0000 7f1b85600640 1 -- 172.21.15.3:0/4141406972 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b70005500 con 0x7f1b88102790 2024-09-19T06:19:55.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.494+0000 7f1b8ee00640 1 -- 172.21.15.3:0/4141406972 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b8819d6e0 con 0x7f1b88102790 2024-09-19T06:19:55.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.494+0000 7f1b85600640 1 -- 172.21.15.3:0/4141406972 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b70010690 con 0x7f1b88102790 2024-09-19T06:19:55.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.494+0000 7f1b8ee00640 1 -- 172.21.15.3:0/4141406972 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b881a4fc0 con 0x7f1b88102790 2024-09-19T06:19:55.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.497+0000 7f1b913fd740 1 Processor -- start 2024-09-19T06:19:55.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.497+0000 7f1b85600640 1 -- 172.21.15.3:0/4141406972 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f1b700046c0 con 0x7f1b88102790 2024-09-19T06:19:55.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.497+0000 7f1b913fd740 1 -- start start 2024-09-19T06:19:55.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.498+0000 7f1b913fd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c1f9ec70 0x5582c1f9f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:55.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.498+0000 7f1b913fd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1f9f590 0x5582c1fa9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:55.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.498+0000 7f1b913fd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c1fa9e50 0x5582c1fac240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:55.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.498+0000 7f1b913fd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5582c1f053e0 con 0x5582c1f9f590 2024-09-19T06:19:55.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.498+0000 7f1b913fd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5582c1eacd80 con 0x5582c1f9ec70 2024-09-19T06:19:55.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.498+0000 7f1b913fd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5582c1f013a0 con 0x5582c1fa9e50 2024-09-19T06:19:55.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.498+0000 7f1b87e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1f9f590 0x5582c1fa9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:55.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.498+0000 7f1b87e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1f9f590 0x5582c1fa9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52188/0 (socket says 172.21.15.3:52188) 2024-09-19T06:19:55.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.498+0000 7f1b87e00640 1 -- 172.21.15.3:0/4058377829 learned_addr learned my addr 172.21.15.3:0/4058377829 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:55.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.498+0000 7f1b8ce00640 1 --2- 172.21.15.3:0/4058377829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c1f9ec70 0x5582c1f9f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:55.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.498+0000 7f1b7fe00640 1 --2- 172.21.15.3:0/4058377829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c1fa9e50 0x5582c1fac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:55.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.498+0000 7f1b87e00640 1 -- 172.21.15.3:0/4058377829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c1fa9e50 msgr2=0x5582c1fac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:55.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.498+0000 7f1b87e00640 1 --2- 172.21.15.3:0/4058377829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c1fa9e50 0x5582c1fac240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.498+0000 7f1b87e00640 1 -- 172.21.15.3:0/4058377829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c1f9ec70 msgr2=0x5582c1f9f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:55.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.498+0000 7f1b87e00640 1 --2- 172.21.15.3:0/4058377829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c1f9ec70 0x5582c1f9f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.498+0000 7f1b87e00640 1 -- 172.21.15.3:0/4058377829 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582c1ecbae0 con 0x5582c1f9f590 2024-09-19T06:19:55.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.499+0000 7f1b7fe00640 1 --2- 172.21.15.3:0/4058377829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c1fa9e50 0x5582c1fac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:19:55.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.499+0000 7f1b87e00640 1 --2- 172.21.15.3:0/4058377829 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1f9f590 0x5582c1fa9910 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1b78009900 tx=0x7f1b78005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=847946bbda42b820 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:55.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.499+0000 7f1b7d600640 1 -- 172.21.15.3:0/4058377829 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78035040 con 0x5582c1f9f590 2024-09-19T06:19:55.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.499+0000 7f1b7d600640 1 -- 172.21.15.3:0/4058377829 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b78004760 con 0x5582c1f9f590 2024-09-19T06:19:55.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.499+0000 7f1b7d600640 1 -- 172.21.15.3:0/4058377829 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b780038e0 con 0x5582c1f9f590 2024-09-19T06:19:55.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.499+0000 7f1b85600640 1 --2- 172.21.15.3:0/4141406972 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1b6c0a3430 0x7f1b6c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:55.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.500+0000 7f1b85600640 1 -- 172.21.15.3:0/4141406972 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f1b700d00d0 con 0x7f1b88102790 2024-09-19T06:19:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.500+0000 7f1b8ce00640 1 --2- 172.21.15.3:0/4141406972 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1b6c0a3430 0x7f1b6c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.500+0000 7f1b913fd740 1 -- 172.21.15.3:0/4058377829 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1f9f590 msgr2=0x5582c1fa9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.500+0000 7f1b913fd740 1 --2- 172.21.15.3:0/4058377829 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1f9f590 0x5582c1fa9910 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1b78009900 tx=0x7f1b78005de0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.500+0000 7f1b913fd740 1 -- 172.21.15.3:0/4058377829 shutdown_connections 2024-09-19T06:19:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.500+0000 7f1b913fd740 1 --2- 172.21.15.3:0/4058377829 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c1fa9e50 0x5582c1fac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.500+0000 7f1b913fd740 1 --2- 172.21.15.3:0/4058377829 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1f9f590 0x5582c1fa9910 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.500+0000 7f1b913fd740 1 --2- 172.21.15.3:0/4058377829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c1f9ec70 0x5582c1f9f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.500+0000 7f1b913fd740 1 -- 172.21.15.3:0/4058377829 >> 172.21.15.3:0/4058377829 conn(0x5582c1f9b200 msgr2=0x5582c1f9b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.500+0000 7f1b913fd740 1 -- 172.21.15.3:0/4058377829 shutdown_connections 2024-09-19T06:19:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.500+0000 7f1b913fd740 1 -- 172.21.15.3:0/4058377829 wait complete. 2024-09-19T06:19:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.500+0000 7f1b8ce00640 1 --2- 172.21.15.3:0/4141406972 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1b6c0a3430 0x7f1b6c0a58f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1b80009fd0 tx=0x7f1b80009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.501+0000 7f1b913fd740 1 -- start start 2024-09-19T06:19:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.501+0000 7f1b913fd740 1 Processor -- start 2024-09-19T06:19:55.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.501+0000 7f1b913fd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1f9ec70 0x5582c1fa6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.501+0000 7f1b913fd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c1f9f590 0x5582c1fa7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.501+0000 7f1b913fd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c1fa9e50 0x5582c1fa7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.501+0000 7f1b913fd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5582c1faca20 con 0x5582c1f9ec70 2024-09-19T06:19:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.501+0000 7f1b913fd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5582c1ec00f0 con 0x5582c1f9f590 2024-09-19T06:19:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.501+0000 7f1b913fd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5582c1facba0 con 0x5582c1fa9e50 2024-09-19T06:19:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.501+0000 7f1b913fd740 10 client.0 _ll_register_callbacks cb 0x5582c1ea7bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.502+0000 7f1b87e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1f9ec70 0x5582c1fa6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.502+0000 7f1b7fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c1f9f590 0x5582c1fa7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.502+0000 7f1b87e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1f9ec70 0x5582c1fa6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52200/0 (socket says 172.21.15.3:52200) 2024-09-19T06:19:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.502+0000 7f1b8ce00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c1fa9e50 0x5582c1fa7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.502+0000 7f1b87e00640 1 -- 172.21.15.3:0/2154915236 learned_addr learned my addr 172.21.15.3:0/2154915236 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.502+0000 7f1b87e00640 1 -- 172.21.15.3:0/2154915236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c1fa9e50 msgr2=0x5582c1fa7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:55.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.502+0000 7f1b87e00640 1 --2- 172.21.15.3:0/2154915236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c1fa9e50 0x5582c1fa7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.502+0000 7f1b87e00640 1 -- 172.21.15.3:0/2154915236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c1f9f590 msgr2=0x5582c1fa7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:55.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.502+0000 7f1b87e00640 1 --2- 172.21.15.3:0/2154915236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c1f9f590 0x5582c1fa7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.502+0000 7f1b87e00640 1 -- 172.21.15.3:0/2154915236 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582c1c763c0 con 0x5582c1f9ec70 2024-09-19T06:19:55.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.502+0000 7f1b8ce00640 1 --2- 172.21.15.3:0/2154915236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c1fa9e50 0x5582c1fa7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:55.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.503+0000 7f1b87e00640 1 --2- 172.21.15.3:0/2154915236 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1f9ec70 0x5582c1fa6ce0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1b7802aa00 tx=0x7f1b78004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e798acda129fadf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:55.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.503+0000 7f1b76000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:19:55.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.503+0000 7f1b76000640 1 -- 172.21.15.3:0/2154915236 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78052060 con 0x5582c1f9ec70 2024-09-19T06:19:55.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.503+0000 7f1b76000640 1 -- 172.21.15.3:0/2154915236 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f1b78005130 con 0x5582c1f9ec70 2024-09-19T06:19:55.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.503+0000 7f1b913fd740 1 -- 172.21.15.3:0/2154915236 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b78004760 con 0x5582c1f9ec70 2024-09-19T06:19:55.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.503+0000 7f1b76000640 1 -- 172.21.15.3:0/2154915236 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1b78035070 con 0x5582c1f9ec70 2024-09-19T06:19:55.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.503+0000 7f1b913fd740 10 client.17406 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:55.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.503+0000 7f1b913fd740 1 -- 172.21.15.3:0/2154915236 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5582c1fb89f0 con 0x5582c1f9ec70 2024-09-19T06:19:55.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.504+0000 7f1b76000640 1 -- 172.21.15.3:0/2154915236 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b78004760 con 0x5582c1f9ec70 2024-09-19T06:19:55.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.504+0000 7f1b76000640 1 -- 172.21.15.3:0/2154915236 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f1b780315b0 con 0x5582c1f9ec70 2024-09-19T06:19:55.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.504+0000 7f1b913fd740 10 client.17406 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:55.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.504+0000 7f1b913fd740 10 client.17406 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:19:55.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.504+0000 7f1b913fd740 20 client.17406 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:55.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.504+0000 7f1b913fd740 1 --2- 172.21.15.3:0/2154915236 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5582c1fb9d40 0x5582c1fbc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:55.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.504+0000 7f1b913fd740 4 client.17406 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:55.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.504+0000 7f1b913fd740 1 -- 172.21.15.3:0/2154915236 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582c1f12950 con 0x5582c1fb9d40 2024-09-19T06:19:55.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.504+0000 7f1b7fe00640 1 --2- 172.21.15.3:0/2154915236 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5582c1fb9d40 0x5582c1fbc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:55.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.505+0000 7f1b7fe00640 1 --2- 172.21.15.3:0/2154915236 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5582c1fb9d40 0x5582c1fbc130 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ab21ba5dba207441 server_cookie=8c8904bbbd09ac65 in_seq=0 out_seq=0 2024-09-19T06:19:55.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.505+0000 7f1b76000640 10 client.17406 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:19:55.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.505+0000 7f1b76000640 1 -- 172.21.15.3:0/2154915236 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5582c1f12950 con 0x5582c1fb9d40 2024-09-19T06:19:55.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.505+0000 7f1b76000640 10 client.17406 handle_command_reply: tid=0 2024-09-19T06:19:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.506+0000 7f1b913fd740 1 client.17406 shutdown 2024-09-19T06:19:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.506+0000 7f1b913fd740 1 -- 172.21.15.3:0/2154915236 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1f9ec70 msgr2=0x5582c1fa6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.506+0000 7f1b913fd740 1 --2- 172.21.15.3:0/2154915236 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1f9ec70 0x5582c1fa6ce0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1b7802aa00 tx=0x7f1b78004b40 comp rx=0 tx=0).stop 2024-09-19T06:19:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.506+0000 7f1b913fd740 1 -- 172.21.15.3:0/2154915236 shutdown_connections 2024-09-19T06:19:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.506+0000 7f1b913fd740 1 --2- 172.21.15.3:0/2154915236 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5582c1fb9d40 0x5582c1fbc130 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.506+0000 7f1b913fd740 1 --2- 172.21.15.3:0/2154915236 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c1fa9e50 0x5582c1fa7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.506+0000 7f1b913fd740 1 --2- 172.21.15.3:0/2154915236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c1f9f590 0x5582c1fa7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.506+0000 7f1b913fd740 1 --2- 172.21.15.3:0/2154915236 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1f9ec70 0x5582c1fa6ce0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.506+0000 7f1b913fd740 1 -- 172.21.15.3:0/2154915236 >> 172.21.15.3:0/2154915236 conn(0x5582c1f9b200 msgr2=0x5582c1f9a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.506+0000 7f1b76000640 0 client.17406 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:19:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.506+0000 7f1b913fd740 1 -- 172.21.15.3:0/2154915236 shutdown_connections 2024-09-19T06:19:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.506+0000 7f1b913fd740 1 -- 172.21.15.3:0/2154915236 wait complete. 2024-09-19T06:19:55.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.506+0000 7f1b913fd740 20 client.17406 trim_cache size 0 max 16384 2024-09-19T06:19:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.520+0000 7f1b913fd740 1 Processor -- start 2024-09-19T06:19:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.520+0000 7f1b913fd740 1 -- start start 2024-09-19T06:19:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.521+0000 7f1b913fd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c1f9ec70 0x5582c1fa2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.521+0000 7f1b913fd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1f9f590 0x5582c1fc1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.521+0000 7f1b913fd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c1fa9e50 0x5582c1fc1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.521+0000 7f1b913fd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881ad8f0 con 0x5582c1f9f590 2024-09-19T06:19:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.521+0000 7f1b913fd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881af430 con 0x5582c1fa9e50 2024-09-19T06:19:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.521+0000 7f1b913fd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881adfc0 con 0x5582c1f9ec70 2024-09-19T06:19:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.521+0000 7f1b7fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1f9f590 0x5582c1fc1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.521+0000 7f1b7fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1f9f590 0x5582c1fc1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52202/0 (socket says 172.21.15.3:52202) 2024-09-19T06:19:55.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.521+0000 7f1b7fe00640 1 -- 172.21.15.3:0/1336360942 learned_addr learned my addr 172.21.15.3:0/1336360942 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:55.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.521+0000 7f1b8ce00640 1 --2- 172.21.15.3:0/1336360942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c1fa9e50 0x5582c1fc1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:55.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.521+0000 7f1b87e00640 1 --2- 172.21.15.3:0/1336360942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c1f9ec70 0x5582c1fa2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:55.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.521+0000 7f1b7fe00640 1 -- 172.21.15.3:0/1336360942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c1f9ec70 msgr2=0x5582c1fa2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:55.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.521+0000 7f1b7fe00640 1 --2- 172.21.15.3:0/1336360942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c1f9ec70 0x5582c1fa2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.521+0000 7f1b7fe00640 1 -- 172.21.15.3:0/1336360942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c1fa9e50 msgr2=0x5582c1fc1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:55.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.521+0000 7f1b7fe00640 1 --2- 172.21.15.3:0/1336360942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c1fa9e50 0x5582c1fc1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.521+0000 7f1b7fe00640 1 -- 172.21.15.3:0/1336360942 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582c1fa1ae0 con 0x5582c1f9f590 2024-09-19T06:19:55.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.522+0000 7f1b7fe00640 1 --2- 172.21.15.3:0/1336360942 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1f9f590 0x5582c1fc1730 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000c6a0 tx=0x7f1b700d25e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6968bb27900d0449 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:55.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.522+0000 7f1b7cc00640 1 -- 172.21.15.3:0/1336360942 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7009c150 con 0x5582c1f9f590 2024-09-19T06:19:55.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.522+0000 7f1b7cc00640 1 -- 172.21.15.3:0/1336360942 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b7009ca80 con 0x5582c1f9f590 2024-09-19T06:19:55.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.522+0000 7f1b7cc00640 1 -- 172.21.15.3:0/1336360942 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7009bce0 con 0x5582c1f9f590 2024-09-19T06:19:55.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.523+0000 7f1b913fd740 1 -- 172.21.15.3:0/1336360942 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1f9f590 msgr2=0x5582c1fc1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:55.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.523+0000 7f1b913fd740 1 --2- 172.21.15.3:0/1336360942 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1f9f590 0x5582c1fc1730 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000c6a0 tx=0x7f1b700d25e0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.523+0000 7f1b913fd740 1 -- 172.21.15.3:0/1336360942 shutdown_connections 2024-09-19T06:19:55.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.523+0000 7f1b913fd740 1 --2- 172.21.15.3:0/1336360942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c1fa9e50 0x5582c1fc1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.523+0000 7f1b913fd740 1 --2- 172.21.15.3:0/1336360942 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1f9f590 0x5582c1fc1730 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.523+0000 7f1b913fd740 1 --2- 172.21.15.3:0/1336360942 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c1f9ec70 0x5582c1fa2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.523+0000 7f1b913fd740 1 -- 172.21.15.3:0/1336360942 >> 172.21.15.3:0/1336360942 conn(0x5582c1f9b200 msgr2=0x5582c1fa8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:55.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.523+0000 7f1b913fd740 1 -- 172.21.15.3:0/1336360942 shutdown_connections 2024-09-19T06:19:55.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.523+0000 7f1b913fd740 1 -- 172.21.15.3:0/1336360942 wait complete. 2024-09-19T06:19:55.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.523+0000 7f1b913fd740 1 -- start start 2024-09-19T06:19:55.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.524+0000 7f1b913fd740 1 Processor -- start 2024-09-19T06:19:55.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.524+0000 7f1b913fd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c1f9ec70 0x5582c1fad350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:55.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.524+0000 7f1b913fd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c1f9f590 0x5582c1fad890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:55.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.524+0000 7f1b913fd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1fa9e50 0x5582c2026b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:55.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.524+0000 7f1b913fd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881aed60 con 0x5582c1fa9e50 2024-09-19T06:19:55.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.524+0000 7f1b913fd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881ae690 con 0x5582c1f9ec70 2024-09-19T06:19:55.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.524+0000 7f1b913fd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881ab8f0 con 0x5582c1f9f590 2024-09-19T06:19:55.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.524+0000 7f1b913fd740 10 client.0 _ll_register_callbacks cb 0x7f1b80009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:55.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.524+0000 7f1b87e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c1f9ec70 0x5582c1fad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:55.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.524+0000 7f1b87e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c1f9ec70 0x5582c1fad350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:34986/0 (socket says 172.21.15.3:34986) 2024-09-19T06:19:55.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.524+0000 7f1b87e00640 1 -- 172.21.15.3:0/1320994886 learned_addr learned my addr 172.21.15.3:0/1320994886 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:55.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.524+0000 7f1b8ce00640 1 --2- 172.21.15.3:0/1320994886 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1fa9e50 0x5582c2026b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:55.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.524+0000 7f1b7fe00640 1 --2- 172.21.15.3:0/1320994886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c1f9f590 0x5582c1fad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:55.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.525+0000 7f1b87e00640 1 -- 172.21.15.3:0/1320994886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c1f9f590 msgr2=0x5582c1fad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:55.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.525+0000 7f1b87e00640 1 --2- 172.21.15.3:0/1320994886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c1f9f590 0x5582c1fad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.525+0000 7f1b87e00640 1 -- 172.21.15.3:0/1320994886 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1fa9e50 msgr2=0x5582c2026b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:55.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.525+0000 7f1b87e00640 1 --2- 172.21.15.3:0/1320994886 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1fa9e50 0x5582c2026b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.525+0000 7f1b87e00640 1 -- 172.21.15.3:0/1320994886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582c2027140 con 0x5582c1f9ec70 2024-09-19T06:19:55.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.525+0000 7f1b7fe00640 1 --2- 172.21.15.3:0/1320994886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c1f9f590 0x5582c1fad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:55.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.525+0000 7f1b87e00640 1 --2- 172.21.15.3:0/1320994886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c1f9ec70 0x5582c1fad350 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1b780092a0 tx=0x7f1b78032e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ae0b2b380664214 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:55.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.525+0000 7f1b76000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:19:55.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.525+0000 7f1b76000640 1 -- 172.21.15.3:0/1320994886 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78052070 con 0x5582c1f9ec70 2024-09-19T06:19:55.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.525+0000 7f1b913fd740 1 -- 172.21.15.3:0/1320994886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b7009ca80 con 0x5582c1f9ec70 2024-09-19T06:19:55.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.525+0000 7f1b76000640 1 -- 172.21.15.3:0/1320994886 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f1b78005340 con 0x5582c1f9ec70 2024-09-19T06:19:55.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.526+0000 7f1b76000640 1 -- 172.21.15.3:0/1320994886 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1b78004760 con 0x5582c1f9ec70 2024-09-19T06:19:55.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.526+0000 7f1b913fd740 10 client.27452 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:55.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.526+0000 7f1b913fd740 1 -- 172.21.15.3:0/1320994886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5582c2028420 con 0x5582c1f9ec70 2024-09-19T06:19:55.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.526+0000 7f1b76000640 1 -- 172.21.15.3:0/1320994886 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b7009ca80 con 0x5582c1f9ec70 2024-09-19T06:19:55.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.526+0000 7f1b76000640 1 -- 172.21.15.3:0/1320994886 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f1b7805e070 con 0x5582c1f9ec70 2024-09-19T06:19:55.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.526+0000 7f1b913fd740 10 client.27452 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:55.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.526+0000 7f1b913fd740 10 client.27452 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:19:55.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.526+0000 7f1b913fd740 20 client.27452 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:55.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.526+0000 7f1b913fd740 1 --2- 172.21.15.3:0/1320994886 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5582c2028a80 0x5582c202ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:55.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.526+0000 7f1b913fd740 4 client.27452 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:19:55.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.526+0000 7f1b913fd740 1 -- 172.21.15.3:0/1320994886 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5582c1fa2900 con 0x5582c2028a80 2024-09-19T06:19:55.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.527+0000 7f1b7fe00640 1 --2- 172.21.15.3:0/1320994886 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5582c2028a80 0x5582c202ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:55.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.527+0000 7f1b7fe00640 1 --2- 172.21.15.3:0/1320994886 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5582c2028a80 0x5582c202ae70 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5b448ad274db3c90 server_cookie=5e0ec71f402c14af in_seq=0 out_seq=0 2024-09-19T06:19:55.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.527+0000 7f1b76000640 10 client.27452 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:19:55.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.527+0000 7f1b76000640 1 -- 172.21.15.3:0/1320994886 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5582c1fa2900 con 0x5582c2028a80 2024-09-19T06:19:55.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.527+0000 7f1b76000640 10 client.27452 handle_command_reply: tid=0 2024-09-19T06:19:55.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.527+0000 7f1b913fd740 1 client.27452 shutdown 2024-09-19T06:19:55.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.528+0000 7f1b913fd740 1 -- 172.21.15.3:0/1320994886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c1f9ec70 msgr2=0x5582c1fad350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:55.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.528+0000 7f1b913fd740 1 --2- 172.21.15.3:0/1320994886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c1f9ec70 0x5582c1fad350 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1b780092a0 tx=0x7f1b78032e10 comp rx=0 tx=0).stop 2024-09-19T06:19:55.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.528+0000 7f1b913fd740 1 -- 172.21.15.3:0/1320994886 shutdown_connections 2024-09-19T06:19:55.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.528+0000 7f1b913fd740 1 --2- 172.21.15.3:0/1320994886 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5582c2028a80 0x5582c202ae70 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.528+0000 7f1b913fd740 1 --2- 172.21.15.3:0/1320994886 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5582c1fa9e50 0x5582c2026b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.528+0000 7f1b913fd740 1 --2- 172.21.15.3:0/1320994886 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5582c1f9f590 0x5582c1fad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.528+0000 7f1b913fd740 1 --2- 172.21.15.3:0/1320994886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5582c1f9ec70 0x5582c1fad350 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.528+0000 7f1b76000640 0 client.27452 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:19:55.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.528+0000 7f1b913fd740 1 -- 172.21.15.3:0/1320994886 >> 172.21.15.3:0/1320994886 conn(0x5582c1f9b200 msgr2=0x5582c1f99b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:55.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.528+0000 7f1b913fd740 1 -- 172.21.15.3:0/1320994886 shutdown_connections 2024-09-19T06:19:55.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.528+0000 7f1b913fd740 1 -- 172.21.15.3:0/1320994886 wait complete. 2024-09-19T06:19:55.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.528+0000 7f1b913fd740 20 client.27452 trim_cache size 0 max 16384 2024-09-19T06:19:55.535 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:19:55.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.529+0000 7f1b8ee00640 1 -- 172.21.15.3:0/4141406972 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1b6c0a3430 msgr2=0x7f1b6c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:55.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.529+0000 7f1b8ee00640 1 --2- 172.21.15.3:0/4141406972 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1b6c0a3430 0x7f1b6c0a58f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1b80009fd0 tx=0x7f1b80009500 comp rx=0 tx=0).stop 2024-09-19T06:19:55.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.529+0000 7f1b8ee00640 1 -- 172.21.15.3:0/4141406972 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b88102790 msgr2=0x7f1b88198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:55.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.529+0000 7f1b8ee00640 1 --2- 172.21.15.3:0/4141406972 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b88102790 0x7f1b88198980 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000e9f0 tx=0x7f1b7000edf0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.529+0000 7f1b8ee00640 1 -- 172.21.15.3:0/4141406972 shutdown_connections 2024-09-19T06:19:55.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.529+0000 7f1b8ee00640 1 --2- 172.21.15.3:0/4141406972 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1b6c0a3430 0x7f1b6c0a58f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.529+0000 7f1b8ee00640 1 --2- 172.21.15.3:0/4141406972 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1b88106f10 0x7f1b8819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.529+0000 7f1b8ee00640 1 --2- 172.21.15.3:0/4141406972 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b88102790 0x7f1b88198980 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.529+0000 7f1b8ee00640 1 --2- 172.21.15.3:0/4141406972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b88101de0 0x7f1b88198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:55.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.529+0000 7f1b8ee00640 1 -- 172.21.15.3:0/4141406972 >> 172.21.15.3:0/4141406972 conn(0x7f1b880fd8c0 msgr2=0x7f1b880febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:55.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.529+0000 7f1b8ee00640 1 -- 172.21.15.3:0/4141406972 shutdown_connections 2024-09-19T06:19:55.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:55.529+0000 7f1b8ee00640 1 -- 172.21.15.3:0/4141406972 wait complete. 2024-09-19T06:19:56.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:55 smithi059 ceph-mon[35138]: pgmap v231: 97 pgs: 97 active+clean; 5.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 23 op/s 2024-09-19T06:19:56.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:55 smithi003 ceph-mon[30893]: pgmap v231: 97 pgs: 97 active+clean; 5.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 23 op/s 2024-09-19T06:19:56.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:55 smithi071 ceph-mon[35662]: pgmap v231: 97 pgs: 97 active+clean; 5.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 23 op/s 2024-09-19T06:19:56.483 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:19:56.865 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:19:57.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.442+0000 7fe1e5400640 1 -- 172.21.15.3:0/1019063461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe1e01049c0 msgr2=0x7fe1e0108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:57.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.442+0000 7fe1e5400640 1 --2- 172.21.15.3:0/1019063461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe1e01049c0 0x7fe1e0108a10 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8009900 tx=0x7fe1c802a400 comp rx=0 tx=0).stop 2024-09-19T06:19:57.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.442+0000 7fe1e5400640 1 -- 172.21.15.3:0/1019063461 shutdown_connections 2024-09-19T06:19:57.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.442+0000 7fe1e5400640 1 --2- 172.21.15.3:0/1019063461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1e0109140 0x7fe1e0110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.442+0000 7fe1e5400640 1 --2- 172.21.15.3:0/1019063461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe1e01049c0 0x7fe1e0108a10 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.442+0000 7fe1e5400640 1 --2- 172.21.15.3:0/1019063461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1e0104010 0x7fe1e01043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.442+0000 7fe1e5400640 1 -- 172.21.15.3:0/1019063461 >> 172.21.15.3:0/1019063461 conn(0x7fe1e00ffa50 msgr2=0x7fe1e0101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:57.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.443+0000 7fe1e5400640 1 -- 172.21.15.3:0/1019063461 shutdown_connections 2024-09-19T06:19:57.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.443+0000 7fe1e5400640 1 -- 172.21.15.3:0/1019063461 wait complete. 2024-09-19T06:19:57.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.444+0000 7fe1e5400640 1 Processor -- start 2024-09-19T06:19:57.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.444+0000 7fe1e5400640 1 -- start start 2024-09-19T06:19:57.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.444+0000 7fe1e5400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1e0104010 0x7fe1e019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:57.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.444+0000 7fe1e5400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe1e01049c0 0x7fe1e019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:57.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.445+0000 7fe1e5400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1e0109140 0x7fe1e019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:57.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.445+0000 7fe1e5400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e0114160 con 0x7fe1e01049c0 2024-09-19T06:19:57.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.445+0000 7fe1e5400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e0113fe0 con 0x7fe1e0104010 2024-09-19T06:19:57.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.445+0000 7fe1e5400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e01142e0 con 0x7fe1e0109140 2024-09-19T06:19:57.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.445+0000 7fe1de800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1e0104010 0x7fe1e019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:57.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.445+0000 7fe1de800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1e0104010 0x7fe1e019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:35002/0 (socket says 172.21.15.3:35002) 2024-09-19T06:19:57.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.445+0000 7fe1d5e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe1e01049c0 0x7fe1e019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:57.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.445+0000 7fe1de800640 1 -- 172.21.15.3:0/2689634684 learned_addr learned my addr 172.21.15.3:0/2689634684 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:57.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.445+0000 7fe1df200640 1 --2- 172.21.15.3:0/2689634684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1e0109140 0x7fe1e019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:57.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.445+0000 7fe1de800640 1 -- 172.21.15.3:0/2689634684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1e0109140 msgr2=0x7fe1e019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:57.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.445+0000 7fe1de800640 1 --2- 172.21.15.3:0/2689634684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1e0109140 0x7fe1e019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.445+0000 7fe1de800640 1 -- 172.21.15.3:0/2689634684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe1e01049c0 msgr2=0x7fe1e019aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:57.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.445+0000 7fe1de800640 1 --2- 172.21.15.3:0/2689634684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe1e01049c0 0x7fe1e019aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.445+0000 7fe1de800640 1 -- 172.21.15.3:0/2689634684 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e019f610 con 0x7fe1e0104010 2024-09-19T06:19:57.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.446+0000 7fe1de800640 1 --2- 172.21.15.3:0/2689634684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1e0104010 0x7fe1e019a660 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000d950 tx=0x7fe1d000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:57.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.446+0000 7fe1d7e00640 1 -- 172.21.15.3:0/2689634684 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0017070 con 0x7fe1e0104010 2024-09-19T06:19:57.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.446+0000 7fe1e5400640 1 -- 172.21.15.3:0/2689634684 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e019f900 con 0x7fe1e0104010 2024-09-19T06:19:57.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.446+0000 7fe1d7e00640 1 -- 172.21.15.3:0/2689634684 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1d0009c30 con 0x7fe1e0104010 2024-09-19T06:19:57.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.446+0000 7fe1d7e00640 1 -- 172.21.15.3:0/2689634684 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d000f6b0 con 0x7fe1e0104010 2024-09-19T06:19:57.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.446+0000 7fe1e5400640 1 -- 172.21.15.3:0/2689634684 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e01a71e0 con 0x7fe1e0104010 2024-09-19T06:19:57.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.449+0000 7fe1e7e37740 1 Processor -- start 2024-09-19T06:19:57.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.449+0000 7fe1d7e00640 1 -- 172.21.15.3:0/2689634684 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fe1d00109d0 con 0x7fe1e0104010 2024-09-19T06:19:57.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.450+0000 7fe1e7e37740 1 -- start start 2024-09-19T06:19:57.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.450+0000 7fe1e7e37740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56385f631c70 0x56385f632050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:57.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.450+0000 7fe1e7e37740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56385f632590 0x56385f63c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:57.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.450+0000 7fe1e7e37740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56385f63ce50 0x56385f63f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:57.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.450+0000 7fe1e7e37740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56385f5983e0 con 0x56385f632590 2024-09-19T06:19:57.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.450+0000 7fe1e7e37740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56385f53fd80 con 0x56385f63ce50 2024-09-19T06:19:57.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.450+0000 7fe1e7e37740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56385f5943a0 con 0x56385f631c70 2024-09-19T06:19:57.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.450+0000 7fe1de800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56385f632590 0x56385f63c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:57.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.450+0000 7fe1df200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56385f631c70 0x56385f632050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:57.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.450+0000 7fe1de800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56385f632590 0x56385f63c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52240/0 (socket says 172.21.15.3:52240) 2024-09-19T06:19:57.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.450+0000 7fe1de800640 1 -- 172.21.15.3:0/2433362192 learned_addr learned my addr 172.21.15.3:0/2433362192 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:57.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.450+0000 7fe1df200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56385f631c70 0x56385f632050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:57604/0 (socket says 172.21.15.3:57604) 2024-09-19T06:19:57.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.450+0000 7fe1d5e00640 1 --2- 172.21.15.3:0/2433362192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56385f63ce50 0x56385f63f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:57.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.451+0000 7fe1df200640 1 -- 172.21.15.3:0/2433362192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56385f63ce50 msgr2=0x56385f63f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:57.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.451+0000 7fe1df200640 1 --2- 172.21.15.3:0/2433362192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56385f63ce50 0x56385f63f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.451+0000 7fe1df200640 1 -- 172.21.15.3:0/2433362192 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56385f632590 msgr2=0x56385f63c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:57.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.451+0000 7fe1df200640 1 --2- 172.21.15.3:0/2433362192 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56385f632590 0x56385f63c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.451+0000 7fe1df200640 1 -- 172.21.15.3:0/2433362192 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56385f55eae0 con 0x56385f631c70 2024-09-19T06:19:57.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.451+0000 7fe1d7e00640 1 --2- 172.21.15.3:0/2689634684 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe1c40a33b0 0x7fe1c40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:57.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.451+0000 7fe1df200640 1 --2- 172.21.15.3:0/2433362192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56385f631c70 0x56385f632050 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009da0 tx=0x7fe1d8010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=805f491eddf80d89 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:57.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.451+0000 7fe1d7e00640 1 -- 172.21.15.3:0/2689634684 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7fe1d00cfa20 con 0x7fe1e0104010 2024-09-19T06:19:57.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.451+0000 7fe1cf400640 1 -- 172.21.15.3:0/2433362192 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8016070 con 0x56385f631c70 2024-09-19T06:19:57.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.451+0000 7fe1de800640 1 --2- 172.21.15.3:0/2689634684 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe1c40a33b0 0x7fe1c40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:57.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.451+0000 7fe1cf400640 1 -- 172.21.15.3:0/2433362192 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1d8010e50 con 0x56385f631c70 2024-09-19T06:19:57.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.451+0000 7fe1cf400640 1 -- 172.21.15.3:0/2433362192 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8012760 con 0x56385f631c70 2024-09-19T06:19:57.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.452+0000 7fe1de800640 1 --2- 172.21.15.3:0/2689634684 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe1c40a33b0 0x7fe1c40a5870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe1d009b970 tx=0x7fe1d00d5530 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:57.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.452+0000 7fe1e7e37740 1 -- 172.21.15.3:0/2433362192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56385f631c70 msgr2=0x56385f632050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:57.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.452+0000 7fe1e7e37740 1 --2- 172.21.15.3:0/2433362192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56385f631c70 0x56385f632050 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009da0 tx=0x7fe1d8010740 comp rx=0 tx=0).stop 2024-09-19T06:19:57.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.452+0000 7fe1e7e37740 1 -- 172.21.15.3:0/2433362192 shutdown_connections 2024-09-19T06:19:57.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.452+0000 7fe1e7e37740 1 --2- 172.21.15.3:0/2433362192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56385f63ce50 0x56385f63f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.452+0000 7fe1e7e37740 1 --2- 172.21.15.3:0/2433362192 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56385f632590 0x56385f63c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.452+0000 7fe1e7e37740 1 --2- 172.21.15.3:0/2433362192 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56385f631c70 0x56385f632050 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.452+0000 7fe1e7e37740 1 -- 172.21.15.3:0/2433362192 >> 172.21.15.3:0/2433362192 conn(0x56385f62e200 msgr2=0x56385f62e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:57.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.452+0000 7fe1e7e37740 1 -- 172.21.15.3:0/2433362192 shutdown_connections 2024-09-19T06:19:57.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.452+0000 7fe1e7e37740 1 -- 172.21.15.3:0/2433362192 wait complete. 2024-09-19T06:19:57.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.453+0000 7fe1e7e37740 1 -- start start 2024-09-19T06:19:57.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.453+0000 7fe1e7e37740 1 Processor -- start 2024-09-19T06:19:57.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.453+0000 7fe1e7e37740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56385f631c70 0x56385f639d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:57.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.454+0000 7fe1e7e37740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56385f632590 0x56385f63a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:57.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.454+0000 7fe1e7e37740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56385f63ce50 0x56385f63a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:57.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.454+0000 7fe1e7e37740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56385f63fa20 con 0x56385f632590 2024-09-19T06:19:57.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.454+0000 7fe1e7e37740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56385f5530f0 con 0x56385f631c70 2024-09-19T06:19:57.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.454+0000 7fe1e7e37740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56385f63fba0 con 0x56385f63ce50 2024-09-19T06:19:57.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.454+0000 7fe1e7e37740 10 client.0 _ll_register_callbacks cb 0x56385f53abd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:57.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.454+0000 7fe1d5e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56385f632590 0x56385f63a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:57.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.454+0000 7fe1d5e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56385f632590 0x56385f63a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52242/0 (socket says 172.21.15.3:52242) 2024-09-19T06:19:57.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.454+0000 7fe1d5e00640 1 -- 172.21.15.3:0/1700192357 learned_addr learned my addr 172.21.15.3:0/1700192357 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:57.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.454+0000 7fe1df200640 1 --2- 172.21.15.3:0/1700192357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56385f631c70 0x56385f639d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:57.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.454+0000 7fe1df200640 1 --2- 172.21.15.3:0/1700192357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56385f63ce50 0x56385f63a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:57.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.454+0000 7fe1d5e00640 1 -- 172.21.15.3:0/1700192357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56385f63ce50 msgr2=0x56385f63a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:57.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.454+0000 7fe1d5e00640 1 --2- 172.21.15.3:0/1700192357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56385f63ce50 0x56385f63a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.454+0000 7fe1d5e00640 1 -- 172.21.15.3:0/1700192357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56385f631c70 msgr2=0x56385f639d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:57.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.454+0000 7fe1d5e00640 1 --2- 172.21.15.3:0/1700192357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56385f631c70 0x56385f639d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.454+0000 7fe1d5e00640 1 -- 172.21.15.3:0/1700192357 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56385f3093c0 con 0x56385f632590 2024-09-19T06:19:57.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.455+0000 7fe1d5e00640 1 --2- 172.21.15.3:0/1700192357 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56385f632590 0x56385f63a2d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe1c802a920 tx=0x7fe1c80319b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3211bccf8d99b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:57.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.455+0000 7fe1c3e00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:19:57.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.455+0000 7fe1c3e00640 1 -- 172.21.15.3:0/1700192357 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8035040 con 0x56385f632590 2024-09-19T06:19:57.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.455+0000 7fe1c3e00640 1 -- 172.21.15.3:0/1700192357 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7fe1c8005020 con 0x56385f632590 2024-09-19T06:19:57.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.455+0000 7fe1e7e37740 1 -- 172.21.15.3:0/1700192357 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1d8010e50 con 0x56385f632590 2024-09-19T06:19:57.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.455+0000 7fe1c3e00640 1 -- 172.21.15.3:0/1700192357 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe1c8005220 con 0x56385f632590 2024-09-19T06:19:57.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.455+0000 7fe1e7e37740 10 client.17424 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:57.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.455+0000 7fe1e7e37740 1 -- 172.21.15.3:0/1700192357 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56385f64bab0 con 0x56385f632590 2024-09-19T06:19:57.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.456+0000 7fe1c3e00640 1 -- 172.21.15.3:0/1700192357 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1d8010e50 con 0x56385f632590 2024-09-19T06:19:57.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.456+0000 7fe1c3e00640 1 -- 172.21.15.3:0/1700192357 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe1c8003680 con 0x56385f632590 2024-09-19T06:19:57.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.456+0000 7fe1e7e37740 10 client.17424 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:57.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.456+0000 7fe1e7e37740 10 client.17424 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:57.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.456+0000 7fe1e7e37740 20 client.17424 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:57.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.456+0000 7fe1e7e37740 1 --2- 172.21.15.3:0/1700192357 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56385f64cf70 0x56385f64f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:57.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.456+0000 7fe1e7e37740 4 client.17424 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:19:57.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.456+0000 7fe1e7e37740 1 -- 172.21.15.3:0/1700192357 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56385f5a5950 con 0x56385f64cf70 2024-09-19T06:19:57.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.456+0000 7fe1df200640 1 --2- 172.21.15.3:0/1700192357 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56385f64cf70 0x56385f64f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:57.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.457+0000 7fe1df200640 1 --2- 172.21.15.3:0/1700192357 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56385f64cf70 0x56385f64f360 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=799fce6e6ed5fc71 server_cookie=14962604c8dbe337 in_seq=0 out_seq=0 2024-09-19T06:19:57.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.457+0000 7fe1c3e00640 10 client.17424 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:57.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.458+0000 7fe1c3e00640 1 -- 172.21.15.3:0/1700192357 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56385f5a5950 con 0x56385f64cf70 2024-09-19T06:19:57.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.458+0000 7fe1c3e00640 10 client.17424 handle_command_reply: tid=0 2024-09-19T06:19:57.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.458+0000 7fe1e7e37740 1 client.17424 shutdown 2024-09-19T06:19:57.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.458+0000 7fe1e7e37740 1 -- 172.21.15.3:0/1700192357 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56385f632590 msgr2=0x56385f63a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:57.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.458+0000 7fe1e7e37740 1 --2- 172.21.15.3:0/1700192357 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56385f632590 0x56385f63a2d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe1c802a920 tx=0x7fe1c80319b0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.458+0000 7fe1e7e37740 1 -- 172.21.15.3:0/1700192357 shutdown_connections 2024-09-19T06:19:57.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.458+0000 7fe1e7e37740 1 --2- 172.21.15.3:0/1700192357 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56385f64cf70 0x56385f64f360 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.458+0000 7fe1e7e37740 1 --2- 172.21.15.3:0/1700192357 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56385f63ce50 0x56385f63a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.458+0000 7fe1e7e37740 1 --2- 172.21.15.3:0/1700192357 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56385f632590 0x56385f63a2d0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.458+0000 7fe1e7e37740 1 --2- 172.21.15.3:0/1700192357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56385f631c70 0x56385f639d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.458+0000 7fe1e7e37740 1 -- 172.21.15.3:0/1700192357 >> 172.21.15.3:0/1700192357 conn(0x56385f62e200 msgr2=0x56385f633f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:57.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.458+0000 7fe1c3e00640 0 client.17424 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:57.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.459+0000 7fe1e7e37740 1 -- 172.21.15.3:0/1700192357 shutdown_connections 2024-09-19T06:19:57.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.459+0000 7fe1e7e37740 1 -- 172.21.15.3:0/1700192357 wait complete. 2024-09-19T06:19:57.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.459+0000 7fe1e7e37740 20 client.17424 trim_cache size 0 max 16384 2024-09-19T06:19:57.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.472+0000 7fe1e7e37740 1 Processor -- start 2024-09-19T06:19:57.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.473+0000 7fe1e7e37740 1 -- start start 2024-09-19T06:19:57.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.473+0000 7fe1e7e37740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56385f631c70 0x56385f63bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:57.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.473+0000 7fe1e7e37740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56385f632590 0x56385f654c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:57.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.473+0000 7fe1e7e37740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56385f63ce50 0x56385f655170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:57.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.473+0000 7fe1e7e37740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e01afc10 con 0x56385f63ce50 2024-09-19T06:19:57.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.473+0000 7fe1e7e37740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e01b1750 con 0x56385f631c70 2024-09-19T06:19:57.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.473+0000 7fe1e7e37740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e01b02e0 con 0x56385f632590 2024-09-19T06:19:57.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.473+0000 7fe1df200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56385f631c70 0x56385f63bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:57.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.473+0000 7fe1df200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56385f631c70 0x56385f63bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:35012/0 (socket says 172.21.15.3:35012) 2024-09-19T06:19:57.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.473+0000 7fe1df200640 1 -- 172.21.15.3:0/2562607952 learned_addr learned my addr 172.21.15.3:0/2562607952 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:57.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.473+0000 7fe1d5e00640 1 --2- 172.21.15.3:0/2562607952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56385f632590 0x56385f654c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:57.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.473+0000 7fe1df200640 1 --2- 172.21.15.3:0/2562607952 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56385f63ce50 0x56385f655170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:57.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.474+0000 7fe1df200640 1 -- 172.21.15.3:0/2562607952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56385f632590 msgr2=0x56385f654c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:57.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.474+0000 7fe1df200640 1 --2- 172.21.15.3:0/2562607952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56385f632590 0x56385f654c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.474+0000 7fe1df200640 1 -- 172.21.15.3:0/2562607952 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56385f63ce50 msgr2=0x56385f655170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:57.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.474+0000 7fe1df200640 1 --2- 172.21.15.3:0/2562607952 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56385f63ce50 0x56385f655170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.474+0000 7fe1df200640 1 -- 172.21.15.3:0/2562607952 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56385f629770 con 0x56385f631c70 2024-09-19T06:19:57.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.474+0000 7fe1d5e00640 1 --2- 172.21.15.3:0/2562607952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56385f632590 0x56385f654c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:57.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.474+0000 7fe1df200640 1 --2- 172.21.15.3:0/2562607952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56385f631c70 0x56385f63bd00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8000f80 tx=0x7fe1d8005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66d050925173b1e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:57.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.474+0000 7fe1cea00640 1 -- 172.21.15.3:0/2562607952 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8016040 con 0x56385f631c70 2024-09-19T06:19:57.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.474+0000 7fe1cea00640 1 -- 172.21.15.3:0/2562607952 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1d8030070 con 0x56385f631c70 2024-09-19T06:19:57.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.474+0000 7fe1cea00640 1 -- 172.21.15.3:0/2562607952 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d802a610 con 0x56385f631c70 2024-09-19T06:19:57.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.475+0000 7fe1e7e37740 1 -- 172.21.15.3:0/2562607952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56385f631c70 msgr2=0x56385f63bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:57.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.475+0000 7fe1e7e37740 1 --2- 172.21.15.3:0/2562607952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56385f631c70 0x56385f63bd00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8000f80 tx=0x7fe1d8005a20 comp rx=0 tx=0).stop 2024-09-19T06:19:57.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.475+0000 7fe1e7e37740 1 -- 172.21.15.3:0/2562607952 shutdown_connections 2024-09-19T06:19:57.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.475+0000 7fe1e7e37740 1 --2- 172.21.15.3:0/2562607952 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56385f63ce50 0x56385f655170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.475+0000 7fe1e7e37740 1 --2- 172.21.15.3:0/2562607952 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56385f632590 0x56385f654c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.475+0000 7fe1e7e37740 1 --2- 172.21.15.3:0/2562607952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56385f631c70 0x56385f63bd00 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.475+0000 7fe1e7e37740 1 -- 172.21.15.3:0/2562607952 >> 172.21.15.3:0/2562607952 conn(0x56385f62e200 msgr2=0x56385f63b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:57.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.475+0000 7fe1e7e37740 1 -- 172.21.15.3:0/2562607952 shutdown_connections 2024-09-19T06:19:57.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.475+0000 7fe1e7e37740 1 -- 172.21.15.3:0/2562607952 wait complete. 2024-09-19T06:19:57.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.476+0000 7fe1e7e37740 1 -- start start 2024-09-19T06:19:57.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.476+0000 7fe1e7e37740 1 Processor -- start 2024-09-19T06:19:57.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.476+0000 7fe1e7e37740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56385f631c70 0x56385f640ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:57.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.476+0000 7fe1e7e37740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56385f632590 0x56385f6410e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:57.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.476+0000 7fe1e7e37740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56385f63ce50 0x56385f641620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:57.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.476+0000 7fe1e7e37740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e01b1080 con 0x56385f631c70 2024-09-19T06:19:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.476+0000 7fe1e7e37740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e01b09b0 con 0x56385f632590 2024-09-19T06:19:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.476+0000 7fe1e7e37740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e01adc10 con 0x56385f63ce50 2024-09-19T06:19:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.476+0000 7fe1e7e37740 10 client.0 _ll_register_callbacks cb 0x7fe1c8009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:19:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.477+0000 7fe1d5e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56385f632590 0x56385f6410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.477+0000 7fe1df200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56385f631c70 0x56385f640ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.477+0000 7fe1d5e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56385f632590 0x56385f6410e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:35026/0 (socket says 172.21.15.3:35026) 2024-09-19T06:19:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.477+0000 7fe1d5e00640 1 -- 172.21.15.3:0/3547728321 learned_addr learned my addr 172.21.15.3:0/3547728321 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:19:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.477+0000 7fe1df200640 1 --2- 172.21.15.3:0/3547728321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56385f63ce50 0x56385f641620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.477+0000 7fe1d5e00640 1 -- 172.21.15.3:0/3547728321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56385f63ce50 msgr2=0x56385f641620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:57.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.477+0000 7fe1d5e00640 1 --2- 172.21.15.3:0/3547728321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56385f63ce50 0x56385f641620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.477+0000 7fe1d5e00640 1 -- 172.21.15.3:0/3547728321 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56385f631c70 msgr2=0x56385f640ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:19:57.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.477+0000 7fe1d5e00640 1 --2- 172.21.15.3:0/3547728321 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56385f631c70 0x56385f640ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.477+0000 7fe1d5e00640 1 -- 172.21.15.3:0/3547728321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56385f6b6c50 con 0x56385f632590 2024-09-19T06:19:57.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.477+0000 7fe1df200640 1 --2- 172.21.15.3:0/3547728321 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56385f631c70 0x56385f640ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:19:57.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.477+0000 7fe1d5e00640 1 --2- 172.21.15.3:0/3547728321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56385f632590 0x56385f6410e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8003ad0 tx=0x7fe1c8000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a486e498960d08a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:19:57.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.477+0000 7fe1c3e00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:19:57.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.478+0000 7fe1c3e00640 1 -- 172.21.15.3:0/3547728321 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8035070 con 0x56385f632590 2024-09-19T06:19:57.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.478+0000 7fe1c3e00640 1 -- 172.21.15.3:0/3547728321 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7fe1c80035f0 con 0x56385f632590 2024-09-19T06:19:57.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.478+0000 7fe1e7e37740 1 -- 172.21.15.3:0/3547728321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1d8030070 con 0x56385f632590 2024-09-19T06:19:57.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.478+0000 7fe1c3e00640 1 -- 172.21.15.3:0/3547728321 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe1c8051040 con 0x56385f632590 2024-09-19T06:19:57.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.478+0000 7fe1e7e37740 10 client.27470 fetch_fsmap learned FSMap version 29 2024-09-19T06:19:57.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.478+0000 7fe1e7e37740 1 -- 172.21.15.3:0/3547728321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56385f6b7f60 con 0x56385f632590 2024-09-19T06:19:57.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.478+0000 7fe1c3e00640 1 -- 172.21.15.3:0/3547728321 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1d8030070 con 0x56385f632590 2024-09-19T06:19:57.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.479+0000 7fe1c3e00640 1 -- 172.21.15.3:0/3547728321 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe1c803dc20 con 0x56385f632590 2024-09-19T06:19:57.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.479+0000 7fe1e7e37740 10 client.27470 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:19:57.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.479+0000 7fe1e7e37740 10 client.27470 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:19:57.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.479+0000 7fe1e7e37740 20 client.27470 populate_metadata read hostname 'smithi003' 2024-09-19T06:19:57.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.479+0000 7fe1e7e37740 1 --2- 172.21.15.3:0/3547728321 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56385f6b8760 0x56385f6bab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:19:57.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.479+0000 7fe1e7e37740 4 client.27470 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:19:57.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.479+0000 7fe1e7e37740 1 -- 172.21.15.3:0/3547728321 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56385f59fe60 con 0x56385f6b8760 2024-09-19T06:19:57.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.479+0000 7fe1df200640 1 --2- 172.21.15.3:0/3547728321 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56385f6b8760 0x56385f6bab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:19:57.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.480+0000 7fe1df200640 1 --2- 172.21.15.3:0/3547728321 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56385f6b8760 0x56385f6bab80 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93279aad4d9be124 server_cookie=224e93a3a043fe40 in_seq=0 out_seq=0 2024-09-19T06:19:57.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.480+0000 7fe1c3e00640 10 client.27470 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:57.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.480+0000 7fe1c3e00640 1 -- 172.21.15.3:0/3547728321 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56385f59fe60 con 0x56385f6b8760 2024-09-19T06:19:57.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.480+0000 7fe1c3e00640 10 client.27470 handle_command_reply: tid=0 2024-09-19T06:19:57.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.480+0000 7fe1e7e37740 1 client.27470 shutdown 2024-09-19T06:19:57.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.480+0000 7fe1e7e37740 1 -- 172.21.15.3:0/3547728321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56385f632590 msgr2=0x56385f6410e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:57.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.480+0000 7fe1e7e37740 1 --2- 172.21.15.3:0/3547728321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56385f632590 0x56385f6410e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8003ad0 tx=0x7fe1c8000bc0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.480+0000 7fe1e7e37740 1 -- 172.21.15.3:0/3547728321 shutdown_connections 2024-09-19T06:19:57.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.480+0000 7fe1e7e37740 1 --2- 172.21.15.3:0/3547728321 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56385f6b8760 0x56385f6bab80 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.480+0000 7fe1e7e37740 1 --2- 172.21.15.3:0/3547728321 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56385f63ce50 0x56385f641620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.480+0000 7fe1e7e37740 1 --2- 172.21.15.3:0/3547728321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56385f632590 0x56385f6410e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.480+0000 7fe1e7e37740 1 --2- 172.21.15.3:0/3547728321 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56385f631c70 0x56385f640ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.480+0000 7fe1c3e00640 0 client.27470 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:19:57.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.480+0000 7fe1e7e37740 1 -- 172.21.15.3:0/3547728321 >> 172.21.15.3:0/3547728321 conn(0x56385f62e200 msgr2=0x56385f63be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:57.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.481+0000 7fe1e7e37740 1 -- 172.21.15.3:0/3547728321 shutdown_connections 2024-09-19T06:19:57.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.481+0000 7fe1e7e37740 1 -- 172.21.15.3:0/3547728321 wait complete. 2024-09-19T06:19:57.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.481+0000 7fe1e7e37740 20 client.27470 trim_cache size 0 max 16384 2024-09-19T06:19:57.488 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:19:57.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.482+0000 7fe1e5400640 1 -- 172.21.15.3:0/2689634684 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe1c40a33b0 msgr2=0x7fe1c40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:57.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.482+0000 7fe1e5400640 1 --2- 172.21.15.3:0/2689634684 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe1c40a33b0 0x7fe1c40a5870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe1d009b970 tx=0x7fe1d00d5530 comp rx=0 tx=0).stop 2024-09-19T06:19:57.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.482+0000 7fe1e5400640 1 -- 172.21.15.3:0/2689634684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1e0104010 msgr2=0x7fe1e019a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:19:57.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.482+0000 7fe1e5400640 1 --2- 172.21.15.3:0/2689634684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1e0104010 0x7fe1e019a660 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000d950 tx=0x7fe1d000de10 comp rx=0 tx=0).stop 2024-09-19T06:19:57.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.482+0000 7fe1e5400640 1 -- 172.21.15.3:0/2689634684 shutdown_connections 2024-09-19T06:19:57.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.482+0000 7fe1e5400640 1 --2- 172.21.15.3:0/2689634684 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe1c40a33b0 0x7fe1c40a5870 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.482+0000 7fe1e5400640 1 --2- 172.21.15.3:0/2689634684 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe1e0109140 0x7fe1e019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.482+0000 7fe1e5400640 1 --2- 172.21.15.3:0/2689634684 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe1e01049c0 0x7fe1e019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.482+0000 7fe1e5400640 1 --2- 172.21.15.3:0/2689634684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1e0104010 0x7fe1e019a660 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:19:57.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.482+0000 7fe1e5400640 1 -- 172.21.15.3:0/2689634684 >> 172.21.15.3:0/2689634684 conn(0x7fe1e00ffa50 msgr2=0x7fe1e0100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:19:57.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.482+0000 7fe1e5400640 1 -- 172.21.15.3:0/2689634684 shutdown_connections 2024-09-19T06:19:57.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:19:57.482+0000 7fe1e5400640 1 -- 172.21.15.3:0/2689634684 wait complete. 2024-09-19T06:19:58.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:57 smithi059 ceph-mon[35138]: pgmap v232: 97 pgs: 97 active+clean; 5.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-19T06:19:58.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:57 smithi003 ceph-mon[30893]: pgmap v232: 97 pgs: 97 active+clean; 5.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-19T06:19:58.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:57 smithi071 ceph-mon[35662]: pgmap v232: 97 pgs: 97 active+clean; 5.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-19T06:19:59.524 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:19:59.525 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:19:59.918 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:00.131 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:19:59 smithi003 ceph-mon[30893]: pgmap v233: 97 pgs: 97 active+clean; 5.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 22 op/s 2024-09-19T06:20:00.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:19:59 smithi059 ceph-mon[35138]: pgmap v233: 97 pgs: 97 active+clean; 5.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 22 op/s 2024-09-19T06:20:00.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:19:59 smithi071 ceph-mon[35662]: pgmap v233: 97 pgs: 97 active+clean; 5.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 22 op/s 2024-09-19T06:20:00.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.559+0000 7faeea800640 1 -- 172.21.15.3:0/2006539144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faee4103ff0 msgr2=0x7faee41043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:00.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.559+0000 7faeea800640 1 --2- 172.21.15.3:0/2006539144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faee4103ff0 0x7faee41043d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7faed4009860 tx=0x7faed402a340 comp rx=0 tx=0).stop 2024-09-19T06:20:00.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.560+0000 7faeea800640 1 -- 172.21.15.3:0/2006539144 shutdown_connections 2024-09-19T06:20:00.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.560+0000 7faeea800640 1 --2- 172.21.15.3:0/2006539144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faee4109120 0x7faee4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.560+0000 7faeea800640 1 --2- 172.21.15.3:0/2006539144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faee41049a0 0x7faee41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.560+0000 7faeea800640 1 --2- 172.21.15.3:0/2006539144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faee4103ff0 0x7faee41043d0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.560+0000 7faeea800640 1 -- 172.21.15.3:0/2006539144 >> 172.21.15.3:0/2006539144 conn(0x7faee40ffa90 msgr2=0x7faee4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:00.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.560+0000 7faeea800640 1 -- 172.21.15.3:0/2006539144 shutdown_connections 2024-09-19T06:20:00.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.560+0000 7faeea800640 1 -- 172.21.15.3:0/2006539144 wait complete. 2024-09-19T06:20:00.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.561+0000 7faeea800640 1 Processor -- start 2024-09-19T06:20:00.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.561+0000 7faeea800640 1 -- start start 2024-09-19T06:20:00.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.561+0000 7faeea800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faee4103ff0 0x7faee419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.561+0000 7faeea800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faee41049a0 0x7faee419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.561+0000 7faeea800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faee4109120 0x7faee419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.561+0000 7faeea800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7faee4114140 con 0x7faee4103ff0 2024-09-19T06:20:00.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.561+0000 7faeea800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faee4113fc0 con 0x7faee41049a0 2024-09-19T06:20:00.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.561+0000 7faeea800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faee41142c0 con 0x7faee4109120 2024-09-19T06:20:00.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.562+0000 7faee3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faee4103ff0 0x7faee419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.562+0000 7faee2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faee41049a0 0x7faee419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.562+0000 7faee3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faee4103ff0 0x7faee419a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52268/0 (socket says 172.21.15.3:52268) 2024-09-19T06:20:00.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.562+0000 7faee3400640 1 -- 172.21.15.3:0/2287040751 learned_addr learned my addr 172.21.15.3:0/2287040751 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:00.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.562+0000 7faee3e00640 1 --2- 172.21.15.3:0/2287040751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faee4109120 0x7faee419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.562+0000 7faee3400640 1 -- 172.21.15.3:0/2287040751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faee4109120 msgr2=0x7faee419eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:00.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.562+0000 7faee3400640 1 --2- 172.21.15.3:0/2287040751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faee4109120 0x7faee419eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.562+0000 7faee3400640 1 -- 172.21.15.3:0/2287040751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faee41049a0 msgr2=0x7faee419ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:00.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.562+0000 7faee3400640 1 --2- 172.21.15.3:0/2287040751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faee41049a0 0x7faee419ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.562+0000 7faee3400640 1 -- 172.21.15.3:0/2287040751 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee419f5b0 con 0x7faee4103ff0 2024-09-19T06:20:00.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.563+0000 7faee3400640 1 --2- 172.21.15.3:0/2287040751 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faee4103ff0 0x7faee419a600 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7faed4035040 tx=0x7faed4033d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:00.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.563+0000 7faedbe00640 1 -- 172.21.15.3:0/2287040751 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed403f020 con 0x7faee4103ff0 2024-09-19T06:20:00.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.563+0000 7faedbe00640 1 -- 172.21.15.3:0/2287040751 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faed4032770 con 0x7faee4103ff0 2024-09-19T06:20:00.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.563+0000 7faeea800640 1 -- 172.21.15.3:0/2287040751 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee419f840 con 0x7faee4103ff0 2024-09-19T06:20:00.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.563+0000 7faedbe00640 1 -- 172.21.15.3:0/2287040751 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed4037040 con 0x7faee4103ff0 2024-09-19T06:20:00.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.563+0000 7faeea800640 1 -- 172.21.15.3:0/2287040751 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee41a7180 con 0x7faee4103ff0 2024-09-19T06:20:00.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.566+0000 7faeed257740 1 Processor -- start 2024-09-19T06:20:00.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.567+0000 7faeed257740 1 -- start start 2024-09-19T06:20:00.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.567+0000 7faeed257740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564397863ac0 0x564397863ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.567+0000 7faeed257740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643978643e0 0x56439786e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.567+0000 7faeed257740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56439786eca0 0x564397871090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.567+0000 7faeed257740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5643977ca290 con 0x564397863ac0 2024-09-19T06:20:00.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.567+0000 7faeed257740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564397771b40 con 0x5643978643e0 2024-09-19T06:20:00.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.567+0000 7faeed257740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5643977c6250 con 0x56439786eca0 2024-09-19T06:20:00.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.567+0000 7faee3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564397863ac0 0x564397863ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.567+0000 7faee3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564397863ac0 0x564397863ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52270/0 (socket says 172.21.15.3:52270) 2024-09-19T06:20:00.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.567+0000 7faee3e00640 1 -- 172.21.15.3:0/249599358 learned_addr learned my addr 172.21.15.3:0/249599358 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:00.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.567+0000 7faee2a00640 1 --2- 172.21.15.3:0/249599358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56439786eca0 0x564397871090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.568+0000 7faee3e00640 1 -- 172.21.15.3:0/249599358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56439786eca0 msgr2=0x564397871090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:00.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.568+0000 7faee3e00640 1 --2- 172.21.15.3:0/249599358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56439786eca0 0x564397871090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.568+0000 7faee3e00640 1 -- 172.21.15.3:0/249599358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643978643e0 msgr2=0x56439786e760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:20:00.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.568+0000 7faee3e00640 1 --2- 172.21.15.3:0/249599358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643978643e0 0x56439786e760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.568+0000 7faee3e00640 1 -- 172.21.15.3:0/249599358 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56439753b6a0 con 0x564397863ac0 2024-09-19T06:20:00.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.568+0000 7faee3e00640 1 --2- 172.21.15.3:0/249599358 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564397863ac0 0x564397863ea0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7faedc00e480 tx=0x7faedc0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82db387301437c03 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:00.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.568+0000 7faedbe00640 1 -- 172.21.15.3:0/2287040751 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7faed4042020 con 0x7faee4103ff0 2024-09-19T06:20:00.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.568+0000 7faed8c00640 1 -- 172.21.15.3:0/249599358 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc003970 con 0x564397863ac0 2024-09-19T06:20:00.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.569+0000 7faed8c00640 1 -- 172.21.15.3:0/249599358 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faedc00d7d0 con 0x564397863ac0 2024-09-19T06:20:00.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.569+0000 7faed8c00640 1 -- 172.21.15.3:0/249599358 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc004580 con 0x564397863ac0 2024-09-19T06:20:00.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.569+0000 7faeed257740 1 -- 172.21.15.3:0/249599358 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564397863ac0 msgr2=0x564397863ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:00.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.569+0000 7faeed257740 1 --2- 172.21.15.3:0/249599358 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564397863ac0 0x564397863ea0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7faedc00e480 tx=0x7faedc0095c0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.570+0000 7faeed257740 1 -- 172.21.15.3:0/249599358 shutdown_connections 2024-09-19T06:20:00.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.570+0000 7faeed257740 1 --2- 172.21.15.3:0/249599358 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56439786eca0 0x564397871090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.570+0000 7faeed257740 1 --2- 172.21.15.3:0/249599358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643978643e0 0x56439786e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.570+0000 7faeed257740 1 --2- 172.21.15.3:0/249599358 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564397863ac0 0x564397863ea0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.570+0000 7faeed257740 1 -- 172.21.15.3:0/249599358 >> 172.21.15.3:0/249599358 conn(0x564397860050 msgr2=0x564397860430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:00.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.570+0000 7faeed257740 1 -- 172.21.15.3:0/249599358 shutdown_connections 2024-09-19T06:20:00.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.570+0000 7faeed257740 1 -- 172.21.15.3:0/249599358 wait complete. 2024-09-19T06:20:00.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.570+0000 7faedbe00640 1 --2- 172.21.15.3:0/2287040751 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7faec80a3340 0x7faec80a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.570+0000 7faedbe00640 1 -- 172.21.15.3:0/2287040751 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7faed40ef7d0 con 0x7faee4103ff0 2024-09-19T06:20:00.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.570+0000 7faeed257740 1 -- start start 2024-09-19T06:20:00.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.570+0000 7faee2a00640 1 --2- 172.21.15.3:0/2287040751 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7faec80a3340 0x7faec80a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.571+0000 7faeed257740 1 Processor -- start 2024-09-19T06:20:00.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.571+0000 7faeed257740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564397863ac0 0x56439786e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.571+0000 7faeed257740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643978643e0 0x56439786b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.571+0000 7faeed257740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56439786eca0 0x56439786bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.571+0000 7faeed257740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x564397871910 con 0x56439786eca0 2024-09-19T06:20:00.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.571+0000 7faeed257740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564397784fa0 con 0x5643978643e0 2024-09-19T06:20:00.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.571+0000 7faeed257740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564397871a90 con 0x564397863ac0 2024-09-19T06:20:00.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.571+0000 7faeed257740 10 client.0 _ll_register_callbacks cb 0x5643974d8ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:00.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.571+0000 7faee2a00640 1 --2- 172.21.15.3:0/2287040751 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7faec80a3340 0x7faec80a5800 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x5643978613d0 tx=0x7faed0005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:00.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.571+0000 7faee3400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564397863ac0 0x56439786e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.571+0000 7faee3400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564397863ac0 0x56439786e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:57674/0 (socket says 172.21.15.3:57674) 2024-09-19T06:20:00.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.571+0000 7faee3400640 1 -- 172.21.15.3:0/3362225222 learned_addr learned my addr 172.21.15.3:0/3362225222 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:00.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.571+0000 7faee2a00640 1 --2- 172.21.15.3:0/3362225222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643978643e0 0x56439786b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.572+0000 7faee3e00640 1 --2- 172.21.15.3:0/3362225222 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56439786eca0 0x56439786bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.572+0000 7faee3400640 1 -- 172.21.15.3:0/3362225222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643978643e0 msgr2=0x56439786b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:00.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.572+0000 7faee3400640 1 --2- 172.21.15.3:0/3362225222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643978643e0 0x56439786b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.572+0000 7faee3400640 1 -- 172.21.15.3:0/3362225222 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56439786eca0 msgr2=0x56439786bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:00.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.572+0000 7faee3400640 1 --2- 172.21.15.3:0/3362225222 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56439786eca0 0x56439786bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.572+0000 7faee3400640 1 -- 172.21.15.3:0/3362225222 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56439786c770 con 0x564397863ac0 2024-09-19T06:20:00.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.572+0000 7faee3e00640 1 --2- 172.21.15.3:0/3362225222 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56439786eca0 0x56439786bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:00.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.572+0000 7faee3400640 1 --2- 172.21.15.3:0/3362225222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564397863ac0 0x56439786e6a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7faed4031000 tx=0x7faed40bb730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95da61a011177d81 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:00.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.572+0000 7faecd600640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:20:00.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.572+0000 7faecd600640 1 -- 172.21.15.3:0/3362225222 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed40bce60 con 0x564397863ac0 2024-09-19T06:20:00.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.572+0000 7faecd600640 1 -- 172.21.15.3:0/3362225222 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7faed40a60b0 con 0x564397863ac0 2024-09-19T06:20:00.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.572+0000 7faeed257740 1 -- 172.21.15.3:0/3362225222 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faedc00d7d0 con 0x564397863ac0 2024-09-19T06:20:00.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.573+0000 7faecd600640 1 -- 172.21.15.3:0/3362225222 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faed40d9050 con 0x564397863ac0 2024-09-19T06:20:00.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.573+0000 7faeed257740 10 client.27472 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:00.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.573+0000 7faeed257740 1 -- 172.21.15.3:0/3362225222 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564397871910 con 0x564397863ac0 2024-09-19T06:20:00.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.573+0000 7faecd600640 1 -- 172.21.15.3:0/3362225222 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faedc00d7d0 con 0x564397863ac0 2024-09-19T06:20:00.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.573+0000 7faecd600640 1 -- 172.21.15.3:0/3362225222 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7faed403a030 con 0x564397863ac0 2024-09-19T06:20:00.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.573+0000 7faeed257740 10 client.27472 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:00.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.573+0000 7faeed257740 10 client.27472 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:00.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.573+0000 7faeed257740 20 client.27472 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:00.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.573+0000 7faeed257740 1 --2- 172.21.15.3:0/3362225222 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56439787ed30 0x564397881150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.573+0000 7faeed257740 4 client.27472 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:00.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.573+0000 7faeed257740 1 -- 172.21.15.3:0/3362225222 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643977d7800 con 0x56439787ed30 2024-09-19T06:20:00.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.574+0000 7faee2a00640 1 --2- 172.21.15.3:0/3362225222 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56439787ed30 0x564397881150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.574+0000 7faee2a00640 1 --2- 172.21.15.3:0/3362225222 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56439787ed30 0x564397881150 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a29d8e6da1733da server_cookie=745155d33e6fc932 in_seq=0 out_seq=0 2024-09-19T06:20:00.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.574+0000 7faecd600640 10 client.27472 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:00.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.575+0000 7faecd600640 1 -- 172.21.15.3:0/3362225222 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5643977d7800 con 0x56439787ed30 2024-09-19T06:20:00.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.575+0000 7faecd600640 10 client.27472 handle_command_reply: tid=0 2024-09-19T06:20:00.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.575+0000 7faeed257740 1 client.27472 shutdown 2024-09-19T06:20:00.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.575+0000 7faeed257740 1 -- 172.21.15.3:0/3362225222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564397863ac0 msgr2=0x56439786e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:00.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.575+0000 7faeed257740 1 --2- 172.21.15.3:0/3362225222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564397863ac0 0x56439786e6a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7faed4031000 tx=0x7faed40bb730 comp rx=0 tx=0).stop 2024-09-19T06:20:00.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.575+0000 7faeed257740 1 -- 172.21.15.3:0/3362225222 shutdown_connections 2024-09-19T06:20:00.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.575+0000 7faeed257740 1 --2- 172.21.15.3:0/3362225222 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56439787ed30 0x564397881150 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.575+0000 7faeed257740 1 --2- 172.21.15.3:0/3362225222 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56439786eca0 0x56439786bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.575+0000 7faeed257740 1 --2- 172.21.15.3:0/3362225222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643978643e0 0x56439786b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.575+0000 7faeed257740 1 --2- 172.21.15.3:0/3362225222 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564397863ac0 0x56439786e6a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.575+0000 7faecd600640 0 client.27472 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:00.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.575+0000 7faeed257740 1 -- 172.21.15.3:0/3362225222 >> 172.21.15.3:0/3362225222 conn(0x564397860050 msgr2=0x564397865d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:00.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.576+0000 7faeed257740 1 -- 172.21.15.3:0/3362225222 shutdown_connections 2024-09-19T06:20:00.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.576+0000 7faeed257740 1 -- 172.21.15.3:0/3362225222 wait complete. 2024-09-19T06:20:00.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.576+0000 7faeed257740 20 client.27472 trim_cache size 0 max 16384 2024-09-19T06:20:00.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.612+0000 7faeed257740 1 Processor -- start 2024-09-19T06:20:00.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.612+0000 7faeed257740 1 -- start start 2024-09-19T06:20:00.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.613+0000 7faeed257740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564397863ac0 0x56439785f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.613+0000 7faeed257740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643978643e0 0x564397886a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.613+0000 7faeed257740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56439786eca0 0x564397886f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.613+0000 7faeed257740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7faee41afb40 con 0x564397863ac0 2024-09-19T06:20:00.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.613+0000 7faeed257740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faee41b1680 con 0x5643978643e0 2024-09-19T06:20:00.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.613+0000 7faeed257740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faee41b0210 con 0x56439786eca0 2024-09-19T06:20:00.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.613+0000 7faee3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564397863ac0 0x56439785f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.613+0000 7faee2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643978643e0 0x564397886a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.613+0000 7faee2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643978643e0 0x564397886a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:35068/0 (socket says 172.21.15.3:35068) 2024-09-19T06:20:00.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.613+0000 7faee3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564397863ac0 0x56439785f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52294/0 (socket says 172.21.15.3:52294) 2024-09-19T06:20:00.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.613+0000 7faee2a00640 1 -- 172.21.15.3:0/3909106296 learned_addr learned my addr 172.21.15.3:0/3909106296 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:00.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.613+0000 7faee3e00640 1 --2- 172.21.15.3:0/3909106296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56439786eca0 0x564397886f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.614+0000 7faee3400640 1 -- 172.21.15.3:0/3909106296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56439786eca0 msgr2=0x564397886f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:00.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.614+0000 7faee3400640 1 --2- 172.21.15.3:0/3909106296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56439786eca0 0x564397886f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.614+0000 7faee3400640 1 -- 172.21.15.3:0/3909106296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643978643e0 msgr2=0x564397886a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:00.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.614+0000 7faee3400640 1 --2- 172.21.15.3:0/3909106296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643978643e0 0x564397886a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.614+0000 7faee3400640 1 -- 172.21.15.3:0/3909106296 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643978817b0 con 0x564397863ac0 2024-09-19T06:20:00.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.614+0000 7faee2a00640 1 --2- 172.21.15.3:0/3909106296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643978643e0 0x564397886a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:00.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.614+0000 7faee3400640 1 --2- 172.21.15.3:0/3909106296 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564397863ac0 0x56439785f0b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7faed40b7f90 tx=0x7faed40bb7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4617fdb689c508c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:00.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.614+0000 7faecfe00640 1 -- 172.21.15.3:0/3909106296 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed40bbb30 con 0x564397863ac0 2024-09-19T06:20:00.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.614+0000 7faecfe00640 1 -- 172.21.15.3:0/3909106296 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faed40c47a0 con 0x564397863ac0 2024-09-19T06:20:00.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.614+0000 7faecfe00640 1 -- 172.21.15.3:0/3909106296 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed40a60e0 con 0x564397863ac0 2024-09-19T06:20:00.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.615+0000 7faeed257740 1 -- 172.21.15.3:0/3909106296 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564397863ac0 msgr2=0x56439785f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:00.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.615+0000 7faeed257740 1 --2- 172.21.15.3:0/3909106296 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564397863ac0 0x56439785f0b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7faed40b7f90 tx=0x7faed40bb7a0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.615+0000 7faeed257740 1 -- 172.21.15.3:0/3909106296 shutdown_connections 2024-09-19T06:20:00.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.615+0000 7faeed257740 1 --2- 172.21.15.3:0/3909106296 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56439786eca0 0x564397886f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.615+0000 7faeed257740 1 --2- 172.21.15.3:0/3909106296 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5643978643e0 0x564397886a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.615+0000 7faeed257740 1 --2- 172.21.15.3:0/3909106296 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564397863ac0 0x56439785f0b0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.615+0000 7faeed257740 1 -- 172.21.15.3:0/3909106296 >> 172.21.15.3:0/3909106296 conn(0x564397860050 msgr2=0x56439785e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:00.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.616+0000 7faeed257740 1 -- 172.21.15.3:0/3909106296 shutdown_connections 2024-09-19T06:20:00.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.616+0000 7faeed257740 1 -- 172.21.15.3:0/3909106296 wait complete. 2024-09-19T06:20:00.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.616+0000 7faeed257740 1 -- start start 2024-09-19T06:20:00.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.616+0000 7faeed257740 1 Processor -- start 2024-09-19T06:20:00.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.617+0000 7faeed257740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564397863ac0 0x564397874d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.617+0000 7faeed257740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643978643e0 0x5643978752b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.617+0000 7faeed257740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56439786eca0 0x564397875830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.617+0000 7faeed257740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7faee41b0fb0 con 0x56439786eca0 2024-09-19T06:20:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.617+0000 7faeed257740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7faee41b08e0 con 0x564397863ac0 2024-09-19T06:20:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.617+0000 7faeed257740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7faee41adb40 con 0x5643978643e0 2024-09-19T06:20:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.617+0000 7faeed257740 10 client.0 _ll_register_callbacks cb 0x7faed40097b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.617+0000 7faee3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564397863ac0 0x564397874d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.617+0000 7faee3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56439786eca0 0x564397875830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.617+0000 7faee3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564397863ac0 0x564397874d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:35080/0 (socket says 172.21.15.3:35080) 2024-09-19T06:20:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.617+0000 7faee3400640 1 -- 172.21.15.3:0/2039321554 learned_addr learned my addr 172.21.15.3:0/2039321554 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.617+0000 7faee2a00640 1 --2- 172.21.15.3:0/2039321554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643978643e0 0x5643978752b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.618+0000 7faee3400640 1 -- 172.21.15.3:0/2039321554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643978643e0 msgr2=0x5643978752b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:00.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.618+0000 7faee3400640 1 --2- 172.21.15.3:0/2039321554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643978643e0 0x5643978752b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.618+0000 7faee3400640 1 -- 172.21.15.3:0/2039321554 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56439786eca0 msgr2=0x564397875830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:00.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.618+0000 7faee3400640 1 --2- 172.21.15.3:0/2039321554 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56439786eca0 0x564397875830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.618+0000 7faee3400640 1 -- 172.21.15.3:0/2039321554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564397867570 con 0x564397863ac0 2024-09-19T06:20:00.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.618+0000 7faee3400640 1 --2- 172.21.15.3:0/2039321554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564397863ac0 0x564397874d70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7faed40bba70 tx=0x7faed4030ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46451781ab03ad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:00.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.618+0000 7faecd600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:20:00.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.618+0000 7faecd600640 1 -- 172.21.15.3:0/2039321554 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed40bce60 con 0x564397863ac0 2024-09-19T06:20:00.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.618+0000 7faecd600640 1 -- 172.21.15.3:0/2039321554 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7faed40a60b0 con 0x564397863ac0 2024-09-19T06:20:00.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.618+0000 7faeed257740 1 -- 172.21.15.3:0/2039321554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faed40c47a0 con 0x564397863ac0 2024-09-19T06:20:00.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.619+0000 7faecd600640 1 -- 172.21.15.3:0/2039321554 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faed40a62b0 con 0x564397863ac0 2024-09-19T06:20:00.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.619+0000 7faeed257740 10 client.27485 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:00.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.619+0000 7faeed257740 1 -- 172.21.15.3:0/2039321554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5643978638f0 con 0x564397863ac0 2024-09-19T06:20:00.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.619+0000 7faecd600640 1 -- 172.21.15.3:0/2039321554 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faed40c47a0 con 0x564397863ac0 2024-09-19T06:20:00.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.619+0000 7faecd600640 1 -- 172.21.15.3:0/2039321554 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7faed40bb110 con 0x564397863ac0 2024-09-19T06:20:00.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.619+0000 7faeed257740 10 client.27485 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:00.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.619+0000 7faeed257740 10 client.27485 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:00.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.619+0000 7faeed257740 20 client.27485 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:00.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.619+0000 7faeed257740 1 --2- 172.21.15.3:0/2039321554 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5643978e9f20 0x5643978ec310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:00.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.619+0000 7faeed257740 4 client.27485 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:20:00.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.619+0000 7faeed257740 1 -- 172.21.15.3:0/2039321554 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5643977d1d10 con 0x5643978e9f20 2024-09-19T06:20:00.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.620+0000 7faee2a00640 1 --2- 172.21.15.3:0/2039321554 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5643978e9f20 0x5643978ec310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:00.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.620+0000 7faee2a00640 1 --2- 172.21.15.3:0/2039321554 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5643978e9f20 0x5643978ec310 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=876c320002deca74 server_cookie=b27b741cc41d2ba7 in_seq=0 out_seq=0 2024-09-19T06:20:00.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.620+0000 7faecd600640 10 client.27485 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:00.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.621+0000 7faecd600640 1 -- 172.21.15.3:0/2039321554 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5643977d1d10 con 0x5643978e9f20 2024-09-19T06:20:00.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.621+0000 7faecd600640 10 client.27485 handle_command_reply: tid=0 2024-09-19T06:20:00.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.621+0000 7faeed257740 1 client.27485 shutdown 2024-09-19T06:20:00.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.621+0000 7faeed257740 1 -- 172.21.15.3:0/2039321554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564397863ac0 msgr2=0x564397874d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:00.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.621+0000 7faeed257740 1 --2- 172.21.15.3:0/2039321554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564397863ac0 0x564397874d70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7faed40bba70 tx=0x7faed4030ac0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.621+0000 7faeed257740 1 -- 172.21.15.3:0/2039321554 shutdown_connections 2024-09-19T06:20:00.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.621+0000 7faeed257740 1 --2- 172.21.15.3:0/2039321554 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5643978e9f20 0x5643978ec310 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.621+0000 7faeed257740 1 --2- 172.21.15.3:0/2039321554 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56439786eca0 0x564397875830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.621+0000 7faeed257740 1 --2- 172.21.15.3:0/2039321554 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5643978643e0 0x5643978752b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.621+0000 7faeed257740 1 --2- 172.21.15.3:0/2039321554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564397863ac0 0x564397874d70 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.621+0000 7faeed257740 1 -- 172.21.15.3:0/2039321554 >> 172.21.15.3:0/2039321554 conn(0x564397860050 msgr2=0x56439785f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:00.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.622+0000 7faecd600640 0 client.27485 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:00.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.622+0000 7faeed257740 1 -- 172.21.15.3:0/2039321554 shutdown_connections 2024-09-19T06:20:00.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.622+0000 7faeed257740 1 -- 172.21.15.3:0/2039321554 wait complete. 2024-09-19T06:20:00.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.622+0000 7faeed257740 20 client.27485 trim_cache size 0 max 16384 2024-09-19T06:20:00.626 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:20:00.626 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": 0, 2024-09-19T06:20:00.626 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_tag": "13124717-067d-4119-b192-eada21e7d5eb", 2024-09-19T06:20:00.626 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": "asynchronous" 2024-09-19T06:20:00.626 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:20:00.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.623+0000 7faeea800640 1 -- 172.21.15.3:0/2287040751 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7faec80a3340 msgr2=0x7faec80a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:00.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.623+0000 7faeea800640 1 --2- 172.21.15.3:0/2287040751 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7faec80a3340 0x7faec80a5800 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x5643978613d0 tx=0x7faed0005f90 comp rx=0 tx=0).stop 2024-09-19T06:20:00.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.623+0000 7faeea800640 1 -- 172.21.15.3:0/2287040751 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faee4103ff0 msgr2=0x7faee419a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:00.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.623+0000 7faeea800640 1 --2- 172.21.15.3:0/2287040751 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faee4103ff0 0x7faee419a600 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7faed4035040 tx=0x7faed4033d90 comp rx=0 tx=0).stop 2024-09-19T06:20:00.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.623+0000 7faeea800640 1 -- 172.21.15.3:0/2287040751 shutdown_connections 2024-09-19T06:20:00.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.623+0000 7faeea800640 1 --2- 172.21.15.3:0/2287040751 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7faec80a3340 0x7faec80a5800 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.623+0000 7faeea800640 1 --2- 172.21.15.3:0/2287040751 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7faee4109120 0x7faee419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.623+0000 7faeea800640 1 --2- 172.21.15.3:0/2287040751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faee41049a0 0x7faee419ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.623+0000 7faeea800640 1 --2- 172.21.15.3:0/2287040751 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faee4103ff0 0x7faee419a600 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:00.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.623+0000 7faeea800640 1 -- 172.21.15.3:0/2287040751 >> 172.21.15.3:0/2287040751 conn(0x7faee40ffa90 msgr2=0x7faee4100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:00.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.623+0000 7faeea800640 1 -- 172.21.15.3:0/2287040751 shutdown_connections 2024-09-19T06:20:00.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:00.623+0000 7faeea800640 1 -- 172.21.15.3:0/2287040751 wait complete. 2024-09-19T06:20:01.138 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:00 smithi003 ceph-mon[30893]: overall HEALTH_OK 2024-09-19T06:20:01.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:00 smithi059 ceph-mon[35138]: overall HEALTH_OK 2024-09-19T06:20:01.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:00 smithi071 ceph-mon[35662]: overall HEALTH_OK 2024-09-19T06:20:01.620 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:20:02.007 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:02.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:01 smithi059 ceph-mon[35138]: pgmap v234: 97 pgs: 97 active+clean; 5.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-19T06:20:02.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:01 smithi059 ceph-mon[35138]: scrub queued for path: / 2024-09-19T06:20:02.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:01 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:02.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:01 smithi059 ceph-mon[35138]: scrub summary: active paths [/] 2024-09-19T06:20:02.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:01 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:02.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:01 smithi003 ceph-mon[30893]: pgmap v234: 97 pgs: 97 active+clean; 5.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-19T06:20:02.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:01 smithi003 ceph-mon[30893]: scrub queued for path: / 2024-09-19T06:20:02.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:01 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:02.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:01 smithi003 ceph-mon[30893]: scrub summary: active paths [/] 2024-09-19T06:20:02.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:01 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:02.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:01 smithi071 ceph-mon[35662]: pgmap v234: 97 pgs: 97 active+clean; 5.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-19T06:20:02.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:01 smithi071 ceph-mon[35662]: scrub queued for path: / 2024-09-19T06:20:02.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:01 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:02.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:01 smithi071 ceph-mon[35662]: scrub summary: active paths [/] 2024-09-19T06:20:02.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:01 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:02.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.767+0000 7f459d000640 1 -- 172.21.15.3:0/2927164294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f459810e430 msgr2=0x7f4598110820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:02.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.767+0000 7f459d000640 1 --2- 172.21.15.3:0/2927164294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f459810e430 0x7f4598110820 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4590009ca0 tx=0x7f459002a950 comp rx=0 tx=0).stop 2024-09-19T06:20:02.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.767+0000 7f459d000640 1 -- 172.21.15.3:0/2927164294 shutdown_connections 2024-09-19T06:20:02.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.767+0000 7f459d000640 1 --2- 172.21.15.3:0/2927164294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f459810e430 0x7f4598110820 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.768+0000 7f459d000640 1 --2- 172.21.15.3:0/2927164294 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4598074ee0 0x7f459810def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.768+0000 7f459d000640 1 --2- 172.21.15.3:0/2927164294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45980745c0 0x7f45980749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.768+0000 7f459d000640 1 -- 172.21.15.3:0/2927164294 >> 172.21.15.3:0/2927164294 conn(0x7f45980fd8b0 msgr2=0x7f45980ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:02.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.768+0000 7f459d000640 1 -- 172.21.15.3:0/2927164294 shutdown_connections 2024-09-19T06:20:02.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.768+0000 7f459d000640 1 -- 172.21.15.3:0/2927164294 wait complete. 2024-09-19T06:20:02.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.769+0000 7f459d000640 1 Processor -- start 2024-09-19T06:20:02.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.769+0000 7f459d000640 1 -- start start 2024-09-19T06:20:02.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.769+0000 7f459d000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45980745c0 0x7f459819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.769+0000 7f459d000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4598074ee0 0x7f459819ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.769+0000 7f459d000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f459810e430 0x7f459819efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.769+0000 7f459d000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4598114180 con 0x7f45980745c0 2024-09-19T06:20:02.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.769+0000 7f459d000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4598114000 con 0x7f4598074ee0 2024-09-19T06:20:02.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.769+0000 7f459d000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4598114300 con 0x7f459810e430 2024-09-19T06:20:02.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.769+0000 7f4595e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45980745c0 0x7f459819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.769+0000 7f458fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4598074ee0 0x7f459819ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.769+0000 7f4595e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45980745c0 0x7f459819a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52320/0 (socket says 172.21.15.3:52320) 2024-09-19T06:20:02.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.769+0000 7f4595e00640 1 -- 172.21.15.3:0/4191963325 learned_addr learned my addr 172.21.15.3:0/4191963325 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:02.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.770+0000 7f4596800640 1 --2- 172.21.15.3:0/4191963325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f459810e430 0x7f459819efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.770+0000 7f4596800640 1 -- 172.21.15.3:0/4191963325 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4598074ee0 msgr2=0x7f459819ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:02.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.770+0000 7f4596800640 1 --2- 172.21.15.3:0/4191963325 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4598074ee0 0x7f459819ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.770+0000 7f4596800640 1 -- 172.21.15.3:0/4191963325 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45980745c0 msgr2=0x7f459819a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:02.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.770+0000 7f4596800640 1 --2- 172.21.15.3:0/4191963325 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45980745c0 0x7f459819a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.770+0000 7f4596800640 1 -- 172.21.15.3:0/4191963325 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459819f690 con 0x7f459810e430 2024-09-19T06:20:02.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.770+0000 7f458fe00640 1 --2- 172.21.15.3:0/4191963325 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4598074ee0 0x7f459819ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:02.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.770+0000 7f4595e00640 1 --2- 172.21.15.3:0/4191963325 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45980745c0 0x7f459819a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:02.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.770+0000 7f4596800640 1 --2- 172.21.15.3:0/4191963325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f459810e430 0x7f459819efb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f459002ae70 tx=0x7f459002f3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:02.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.771+0000 7f458ea00640 1 -- 172.21.15.3:0/4191963325 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4590034040 con 0x7f459810e430 2024-09-19T06:20:02.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.771+0000 7f459d000640 1 -- 172.21.15.3:0/4191963325 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f459819f920 con 0x7f459810e430 2024-09-19T06:20:02.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.771+0000 7f458ea00640 1 -- 172.21.15.3:0/4191963325 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4590030920 con 0x7f459810e430 2024-09-19T06:20:02.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.771+0000 7f458ea00640 1 -- 172.21.15.3:0/4191963325 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45900045b0 con 0x7f459810e430 2024-09-19T06:20:02.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.771+0000 7f459d000640 1 -- 172.21.15.3:0/4191963325 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45981a7260 con 0x7f459810e430 2024-09-19T06:20:02.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.775+0000 7f459fa5e740 1 Processor -- start 2024-09-19T06:20:02.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.775+0000 7f458ea00640 1 -- 172.21.15.3:0/4191963325 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f4590037020 con 0x7f459810e430 2024-09-19T06:20:02.777 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.775+0000 7f459fa5e740 1 -- start start 2024-09-19T06:20:02.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.776+0000 7f459fa5e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc95b90 0x56042cc95f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.776+0000 7f459fa5e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cc964b0 0x56042cca0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.776+0000 7f459fa5e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56042cca0d70 0x56042cca3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.776+0000 7f459fa5e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56042cbfc3e0 con 0x56042cc964b0 2024-09-19T06:20:02.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.776+0000 7f459fa5e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56042cba3d80 con 0x56042cc95b90 2024-09-19T06:20:02.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.776+0000 7f459fa5e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56042cbf83a0 con 0x56042cca0d70 2024-09-19T06:20:02.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.776+0000 7f4595e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cc964b0 0x56042cca0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.776+0000 7f4595e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cc964b0 0x56042cca0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52324/0 (socket says 172.21.15.3:52324) 2024-09-19T06:20:02.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.776+0000 7f4595e00640 1 -- 172.21.15.3:0/2454411821 learned_addr learned my addr 172.21.15.3:0/2454411821 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:02.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.776+0000 7f458fe00640 1 --2- 172.21.15.3:0/2454411821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc95b90 0x56042cc95f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.776+0000 7f458fe00640 1 --2- 172.21.15.3:0/2454411821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56042cca0d70 0x56042cca3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.776+0000 7f4595e00640 1 -- 172.21.15.3:0/2454411821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56042cca0d70 msgr2=0x56042cca3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:02.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.776+0000 7f4595e00640 1 --2- 172.21.15.3:0/2454411821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56042cca0d70 0x56042cca3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.777+0000 7f4595e00640 1 -- 172.21.15.3:0/2454411821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc95b90 msgr2=0x56042cc95f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:02.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.777+0000 7f4595e00640 1 --2- 172.21.15.3:0/2454411821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc95b90 0x56042cc95f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.777+0000 7f4595e00640 1 -- 172.21.15.3:0/2454411821 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56042cbc2ae0 con 0x56042cc964b0 2024-09-19T06:20:02.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.777+0000 7f458fe00640 1 --2- 172.21.15.3:0/2454411821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc95b90 0x56042cc95f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:02.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.777+0000 7f4595e00640 1 --2- 172.21.15.3:0/2454411821 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cc964b0 0x56042cca0830 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4588011750 tx=0x7f4588011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2e85f77400be9a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:02.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.777+0000 7f458ea00640 1 --2- 172.21.15.3:0/4191963325 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f457c0a3430 0x7f457c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.777+0000 7f458ea00640 1 -- 172.21.15.3:0/4191963325 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f45900f0940 con 0x7f459810e430 2024-09-19T06:20:02.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.777+0000 7f4587400640 1 -- 172.21.15.3:0/2454411821 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458801e070 con 0x56042cc964b0 2024-09-19T06:20:02.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.777+0000 7f458fe00640 1 --2- 172.21.15.3:0/4191963325 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f457c0a3430 0x7f457c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.777+0000 7f4587400640 1 -- 172.21.15.3:0/2454411821 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f458800fba0 con 0x56042cc964b0 2024-09-19T06:20:02.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.777+0000 7f4587400640 1 -- 172.21.15.3:0/2454411821 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458800e5f0 con 0x56042cc964b0 2024-09-19T06:20:02.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.778+0000 7f459fa5e740 1 -- 172.21.15.3:0/2454411821 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cc964b0 msgr2=0x56042cca0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:02.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.778+0000 7f459fa5e740 1 --2- 172.21.15.3:0/2454411821 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cc964b0 0x56042cca0830 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4588011750 tx=0x7f4588011c10 comp rx=0 tx=0).stop 2024-09-19T06:20:02.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.778+0000 7f458fe00640 1 --2- 172.21.15.3:0/4191963325 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f457c0a3430 0x7f457c0a58f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x56042cc934a0 tx=0x7f45800096a0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:02.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.778+0000 7f459fa5e740 1 -- 172.21.15.3:0/2454411821 shutdown_connections 2024-09-19T06:20:02.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.778+0000 7f459fa5e740 1 --2- 172.21.15.3:0/2454411821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56042cca0d70 0x56042cca3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.778+0000 7f459fa5e740 1 --2- 172.21.15.3:0/2454411821 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cc964b0 0x56042cca0830 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.778+0000 7f459fa5e740 1 --2- 172.21.15.3:0/2454411821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc95b90 0x56042cc95f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.778+0000 7f459fa5e740 1 -- 172.21.15.3:0/2454411821 >> 172.21.15.3:0/2454411821 conn(0x56042cc92120 msgr2=0x56042cc92500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:02.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.778+0000 7f459fa5e740 1 -- 172.21.15.3:0/2454411821 shutdown_connections 2024-09-19T06:20:02.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.778+0000 7f459fa5e740 1 -- 172.21.15.3:0/2454411821 wait complete. 2024-09-19T06:20:02.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.779+0000 7f459fa5e740 1 -- start start 2024-09-19T06:20:02.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.779+0000 7f459fa5e740 1 Processor -- start 2024-09-19T06:20:02.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.779+0000 7f459fa5e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cc95b90 0x56042cc9dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.779+0000 7f459fa5e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc964b0 0x56042cc9e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.779+0000 7f459fa5e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56042cca0d70 0x56042cc9e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.779+0000 7f459fa5e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56042cca39e0 con 0x56042cc95b90 2024-09-19T06:20:02.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.779+0000 7f459fa5e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56042cbb70f0 con 0x56042cc964b0 2024-09-19T06:20:02.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.779+0000 7f459fa5e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56042cca3b60 con 0x56042cca0d70 2024-09-19T06:20:02.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.780+0000 7f459fa5e740 10 client.0 _ll_register_callbacks cb 0x56042cba89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:02.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.780+0000 7f4595e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cc95b90 0x56042cc9dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.780+0000 7f4595e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cc95b90 0x56042cc9dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52336/0 (socket says 172.21.15.3:52336) 2024-09-19T06:20:02.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.780+0000 7f4595e00640 1 -- 172.21.15.3:0/3257230109 learned_addr learned my addr 172.21.15.3:0/3257230109 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:02.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.780+0000 7f458fe00640 1 --2- 172.21.15.3:0/3257230109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc964b0 0x56042cc9e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.780+0000 7f4596800640 1 --2- 172.21.15.3:0/3257230109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56042cca0d70 0x56042cc9e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.780+0000 7f4595e00640 1 -- 172.21.15.3:0/3257230109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56042cca0d70 msgr2=0x56042cc9e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:02.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.780+0000 7f4595e00640 1 --2- 172.21.15.3:0/3257230109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56042cca0d70 0x56042cc9e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.780+0000 7f4595e00640 1 -- 172.21.15.3:0/3257230109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc964b0 msgr2=0x56042cc9e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:02.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.780+0000 7f4595e00640 1 --2- 172.21.15.3:0/3257230109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc964b0 0x56042cc9e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.780+0000 7f4595e00640 1 -- 172.21.15.3:0/3257230109 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56042c96d3c0 con 0x56042cc95b90 2024-09-19T06:20:02.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.781+0000 7f4595e00640 1 --2- 172.21.15.3:0/3257230109 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cc95b90 0x56042cc9dce0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f458801c040 tx=0x7f458800ff80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac69896257d1dc04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:02.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.781+0000 7f457be00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:20:02.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.781+0000 7f457be00640 1 -- 172.21.15.3:0/3257230109 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458801e040 con 0x56042cc95b90 2024-09-19T06:20:02.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.781+0000 7f457be00640 1 -- 172.21.15.3:0/3257230109 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f4588019430 con 0x56042cc95b90 2024-09-19T06:20:02.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.781+0000 7f459fa5e740 1 -- 172.21.15.3:0/3257230109 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f458800fba0 con 0x56042cc95b90 2024-09-19T06:20:02.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.781+0000 7f457be00640 1 -- 172.21.15.3:0/3257230109 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4588030050 con 0x56042cc95b90 2024-09-19T06:20:02.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.781+0000 7f459fa5e740 10 client.17460 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:02.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.781+0000 7f459fa5e740 1 -- 172.21.15.3:0/3257230109 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56042ccaf710 con 0x56042cc95b90 2024-09-19T06:20:02.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.782+0000 7f457be00640 1 -- 172.21.15.3:0/3257230109 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f458800fba0 con 0x56042cc95b90 2024-09-19T06:20:02.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.782+0000 7f457be00640 1 -- 172.21.15.3:0/3257230109 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4588021070 con 0x56042cc95b90 2024-09-19T06:20:02.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.782+0000 7f459fa5e740 10 client.17460 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:02.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.782+0000 7f459fa5e740 10 client.17460 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:02.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.782+0000 7f459fa5e740 20 client.17460 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:02.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.782+0000 7f459fa5e740 1 --2- 172.21.15.3:0/3257230109 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56042ccb0b70 0x56042ccb2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.782+0000 7f459fa5e740 4 client.17460 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:02.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.782+0000 7f459fa5e740 1 -- 172.21.15.3:0/3257230109 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56042cc09950 con 0x56042ccb0b70 2024-09-19T06:20:02.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.782+0000 7f458fe00640 1 --2- 172.21.15.3:0/3257230109 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56042ccb0b70 0x56042ccb2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.783+0000 7f458fe00640 1 --2- 172.21.15.3:0/3257230109 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56042ccb0b70 0x56042ccb2f60 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ff094aff7a1bf59 server_cookie=659ed34726081801 in_seq=0 out_seq=0 2024-09-19T06:20:02.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.783+0000 7f457be00640 10 client.17460 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:02.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.784+0000 7f457be00640 1 -- 172.21.15.3:0/3257230109 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56042cc09950 con 0x56042ccb0b70 2024-09-19T06:20:02.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.784+0000 7f457be00640 10 client.17460 handle_command_reply: tid=0 2024-09-19T06:20:02.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.784+0000 7f459fa5e740 1 client.17460 shutdown 2024-09-19T06:20:02.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.784+0000 7f459fa5e740 1 -- 172.21.15.3:0/3257230109 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cc95b90 msgr2=0x56042cc9dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:02.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.784+0000 7f459fa5e740 1 --2- 172.21.15.3:0/3257230109 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cc95b90 0x56042cc9dce0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f458801c040 tx=0x7f458800ff80 comp rx=0 tx=0).stop 2024-09-19T06:20:02.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.784+0000 7f459fa5e740 1 -- 172.21.15.3:0/3257230109 shutdown_connections 2024-09-19T06:20:02.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.784+0000 7f459fa5e740 1 --2- 172.21.15.3:0/3257230109 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56042ccb0b70 0x56042ccb2f60 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.784+0000 7f459fa5e740 1 --2- 172.21.15.3:0/3257230109 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56042cca0d70 0x56042cc9e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.784+0000 7f459fa5e740 1 --2- 172.21.15.3:0/3257230109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc964b0 0x56042cc9e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.784+0000 7f459fa5e740 1 --2- 172.21.15.3:0/3257230109 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cc95b90 0x56042cc9dce0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.784+0000 7f459fa5e740 1 -- 172.21.15.3:0/3257230109 >> 172.21.15.3:0/3257230109 conn(0x56042cc92120 msgr2=0x56042cc97e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:02.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.784+0000 7f457be00640 0 client.17460 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:02.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.784+0000 7f459fa5e740 1 -- 172.21.15.3:0/3257230109 shutdown_connections 2024-09-19T06:20:02.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.784+0000 7f459fa5e740 1 -- 172.21.15.3:0/3257230109 wait complete. 2024-09-19T06:20:02.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.785+0000 7f459fa5e740 20 client.17460 trim_cache size 0 max 16384 2024-09-19T06:20:02.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.803+0000 7f459fa5e740 1 Processor -- start 2024-09-19T06:20:02.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.803+0000 7f459fa5e740 1 -- start start 2024-09-19T06:20:02.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.803+0000 7f459fa5e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc95b90 0x56042cc985f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.803+0000 7f459fa5e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56042cc964b0 0x56042ccb8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.803+0000 7f459fa5e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cca0d70 0x56042ccb8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.803+0000 7f459fa5e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f45981afac0 con 0x56042cca0d70 2024-09-19T06:20:02.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.803+0000 7f459fa5e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f45981b1600 con 0x56042cc95b90 2024-09-19T06:20:02.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.803+0000 7f459fa5e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f45981b0190 con 0x56042cc964b0 2024-09-19T06:20:02.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.803+0000 7f4595e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc95b90 0x56042cc985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.803+0000 7f4595e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc95b90 0x56042cc985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:35122/0 (socket says 172.21.15.3:35122) 2024-09-19T06:20:02.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.803+0000 7f4596800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cca0d70 0x56042ccb8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.803+0000 7f4595e00640 1 -- 172.21.15.3:0/3666811656 learned_addr learned my addr 172.21.15.3:0/3666811656 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:02.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.803+0000 7f458fe00640 1 --2- 172.21.15.3:0/3666811656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56042cc964b0 0x56042ccb8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.804+0000 7f4595e00640 1 -- 172.21.15.3:0/3666811656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56042cc964b0 msgr2=0x56042ccb8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:02.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.804+0000 7f4595e00640 1 --2- 172.21.15.3:0/3666811656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56042cc964b0 0x56042ccb8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.804+0000 7f4595e00640 1 -- 172.21.15.3:0/3666811656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cca0d70 msgr2=0x56042ccb8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:02.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.804+0000 7f4595e00640 1 --2- 172.21.15.3:0/3666811656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cca0d70 0x56042ccb8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.804+0000 7f4595e00640 1 -- 172.21.15.3:0/3666811656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56042cca0650 con 0x56042cc95b90 2024-09-19T06:20:02.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.804+0000 7f4595e00640 1 --2- 172.21.15.3:0/3666811656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc95b90 0x56042cc985f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f45880053d0 tx=0x7f4588005d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a59bf2c12c4fa5da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:02.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.804+0000 7f4586a00640 1 -- 172.21.15.3:0/3666811656 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588039070 con 0x56042cc95b90 2024-09-19T06:20:02.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.804+0000 7f4586a00640 1 -- 172.21.15.3:0/3666811656 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4588015030 con 0x56042cc95b90 2024-09-19T06:20:02.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.804+0000 7f4586a00640 1 -- 172.21.15.3:0/3666811656 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458801e070 con 0x56042cc95b90 2024-09-19T06:20:02.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.805+0000 7f459fa5e740 1 -- 172.21.15.3:0/3666811656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc95b90 msgr2=0x56042cc985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:02.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.805+0000 7f459fa5e740 1 --2- 172.21.15.3:0/3666811656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc95b90 0x56042cc985f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f45880053d0 tx=0x7f4588005d30 comp rx=0 tx=0).stop 2024-09-19T06:20:02.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.805+0000 7f459fa5e740 1 -- 172.21.15.3:0/3666811656 shutdown_connections 2024-09-19T06:20:02.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.805+0000 7f459fa5e740 1 --2- 172.21.15.3:0/3666811656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cca0d70 0x56042ccb8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.805+0000 7f459fa5e740 1 --2- 172.21.15.3:0/3666811656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56042cc964b0 0x56042ccb8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.805+0000 7f459fa5e740 1 --2- 172.21.15.3:0/3666811656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc95b90 0x56042cc985f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.805+0000 7f459fa5e740 1 -- 172.21.15.3:0/3666811656 >> 172.21.15.3:0/3666811656 conn(0x56042cc92120 msgr2=0x56042cc9cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:02.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.805+0000 7f459fa5e740 1 -- 172.21.15.3:0/3666811656 shutdown_connections 2024-09-19T06:20:02.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.805+0000 7f459fa5e740 1 -- 172.21.15.3:0/3666811656 wait complete. 2024-09-19T06:20:02.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.805+0000 7f459fa5e740 1 -- start start 2024-09-19T06:20:02.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.806+0000 7f459fa5e740 1 Processor -- start 2024-09-19T06:20:02.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.806+0000 7f459fa5e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc95b90 0x56042cca3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.806+0000 7f459fa5e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56042cc964b0 0x56042cca43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.806+0000 7f459fa5e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cca0d70 0x56042cd19700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.806+0000 7f459fa5e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f45981b0f30 con 0x56042cca0d70 2024-09-19T06:20:02.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.806+0000 7f459fa5e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f45981b0860 con 0x56042cc95b90 2024-09-19T06:20:02.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.806+0000 7f459fa5e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f45981adac0 con 0x56042cc964b0 2024-09-19T06:20:02.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.806+0000 7f459fa5e740 10 client.0 _ll_register_callbacks cb 0x7f45880115d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:02.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.806+0000 7f4596800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cca0d70 0x56042cd19700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.806+0000 7f4595e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc95b90 0x56042cca3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.806+0000 7f458fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56042cc964b0 0x56042cca43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.806+0000 7f4595e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc95b90 0x56042cca3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:35128/0 (socket says 172.21.15.3:35128) 2024-09-19T06:20:02.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.806+0000 7f4596800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cca0d70 0x56042cd19700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52350/0 (socket says 172.21.15.3:52350) 2024-09-19T06:20:02.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.806+0000 7f4596800640 1 -- 172.21.15.3:0/3635946391 learned_addr learned my addr 172.21.15.3:0/3635946391 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:02.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.807+0000 7f4595e00640 1 -- 172.21.15.3:0/3635946391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56042cc964b0 msgr2=0x56042cca43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:02.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.807+0000 7f4595e00640 1 --2- 172.21.15.3:0/3635946391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56042cc964b0 0x56042cca43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.807+0000 7f4595e00640 1 -- 172.21.15.3:0/3635946391 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cca0d70 msgr2=0x56042cd19700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:02.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.807+0000 7f4595e00640 1 --2- 172.21.15.3:0/3635946391 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cca0d70 0x56042cd19700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.807+0000 7f4595e00640 1 -- 172.21.15.3:0/3635946391 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56042cd19c40 con 0x56042cc95b90 2024-09-19T06:20:02.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.807+0000 7f4595e00640 1 --2- 172.21.15.3:0/3635946391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc95b90 0x56042cca3e80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f458800fd20 tx=0x7f4588005550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94e9e97c3e1a97c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:02.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.807+0000 7f457be00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:20:02.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.807+0000 7f457be00640 1 -- 172.21.15.3:0/3635946391 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588039030 con 0x56042cc95b90 2024-09-19T06:20:02.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.808+0000 7f459fa5e740 1 -- 172.21.15.3:0/3635946391 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4588015030 con 0x56042cc95b90 2024-09-19T06:20:02.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.808+0000 7f457be00640 1 -- 172.21.15.3:0/3635946391 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8571+0+0 (secure 0 0 0) 0x7f458800f9a0 con 0x56042cc95b90 2024-09-19T06:20:02.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.808+0000 7f457be00640 1 -- 172.21.15.3:0/3635946391 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f458801e040 con 0x56042cc95b90 2024-09-19T06:20:02.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.808+0000 7f459fa5e740 10 client.27503 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:02.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.808+0000 7f459fa5e740 1 -- 172.21.15.3:0/3635946391 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56042cd1add0 con 0x56042cc95b90 2024-09-19T06:20:02.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.808+0000 7f457be00640 1 -- 172.21.15.3:0/3635946391 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4588015030 con 0x56042cc95b90 2024-09-19T06:20:02.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.808+0000 7f457be00640 1 -- 172.21.15.3:0/3635946391 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4588021040 con 0x56042cc95b90 2024-09-19T06:20:02.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.808+0000 7f459fa5e740 10 client.27503 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:02.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.808+0000 7f459fa5e740 10 client.27503 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:02.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.808+0000 7f459fa5e740 20 client.27503 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:02.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.808+0000 7f459fa5e740 1 --2- 172.21.15.3:0/3635946391 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56042cd1b430 0x56042cd1d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:02.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.809+0000 7f459fa5e740 4 client.27503 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:20:02.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.809+0000 7f459fa5e740 1 -- 172.21.15.3:0/3635946391 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56042cc03e60 con 0x56042cd1b430 2024-09-19T06:20:02.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.809+0000 7f458fe00640 1 --2- 172.21.15.3:0/3635946391 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56042cd1b430 0x56042cd1d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:02.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.809+0000 7f458fe00640 1 --2- 172.21.15.3:0/3635946391 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56042cd1b430 0x56042cd1d820 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1d721a27e68a415 server_cookie=ffe9ec092d6aefe3 in_seq=0 out_seq=0 2024-09-19T06:20:02.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.809+0000 7f457be00640 10 client.27503 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:02.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.810+0000 7f457be00640 1 -- 172.21.15.3:0/3635946391 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56042cc03e60 con 0x56042cd1b430 2024-09-19T06:20:02.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.810+0000 7f457be00640 10 client.27503 handle_command_reply: tid=0 2024-09-19T06:20:02.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.810+0000 7f459fa5e740 1 client.27503 shutdown 2024-09-19T06:20:02.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.810+0000 7f459fa5e740 1 -- 172.21.15.3:0/3635946391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc95b90 msgr2=0x56042cca3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:02.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.810+0000 7f459fa5e740 1 --2- 172.21.15.3:0/3635946391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc95b90 0x56042cca3e80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f458800fd20 tx=0x7f4588005550 comp rx=0 tx=0).stop 2024-09-19T06:20:02.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.810+0000 7f459fa5e740 1 -- 172.21.15.3:0/3635946391 shutdown_connections 2024-09-19T06:20:02.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.810+0000 7f459fa5e740 1 --2- 172.21.15.3:0/3635946391 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56042cd1b430 0x56042cd1d820 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.810+0000 7f459fa5e740 1 --2- 172.21.15.3:0/3635946391 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56042cca0d70 0x56042cd19700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.810+0000 7f459fa5e740 1 --2- 172.21.15.3:0/3635946391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56042cc964b0 0x56042cca43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.810+0000 7f459fa5e740 1 --2- 172.21.15.3:0/3635946391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56042cc95b90 0x56042cca3e80 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.810+0000 7f457be00640 0 client.27503 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:02.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.810+0000 7f459fa5e740 1 -- 172.21.15.3:0/3635946391 >> 172.21.15.3:0/3635946391 conn(0x56042cc92120 msgr2=0x56042cc9f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:02.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.810+0000 7f459fa5e740 1 -- 172.21.15.3:0/3635946391 shutdown_connections 2024-09-19T06:20:02.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.810+0000 7f459fa5e740 1 -- 172.21.15.3:0/3635946391 wait complete. 2024-09-19T06:20:02.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.810+0000 7f459fa5e740 20 client.27503 trim_cache size 0 max 16384 2024-09-19T06:20:02.817 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:20:02.817 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:20:02.817 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": { 2024-09-19T06:20:02.817 INFO:teuthology.orchestra.run.smithi003.stdout: "13124717-067d-4119-b192-eada21e7d5eb": { 2024-09-19T06:20:02.817 INFO:teuthology.orchestra.run.smithi003.stdout: "path": "/", 2024-09-19T06:20:02.817 INFO:teuthology.orchestra.run.smithi003.stdout: "tag": "13124717-067d-4119-b192-eada21e7d5eb", 2024-09-19T06:20:02.817 INFO:teuthology.orchestra.run.smithi003.stdout: "options": "recursive,force" 2024-09-19T06:20:02.817 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:20:02.817 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:20:02.817 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:20:02.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.811+0000 7f459d000640 1 -- 172.21.15.3:0/4191963325 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f457c0a3430 msgr2=0x7f457c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:02.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.811+0000 7f459d000640 1 --2- 172.21.15.3:0/4191963325 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f457c0a3430 0x7f457c0a58f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x56042cc934a0 tx=0x7f45800096a0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.811+0000 7f459d000640 1 -- 172.21.15.3:0/4191963325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f459810e430 msgr2=0x7f459819efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:02.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.811+0000 7f459d000640 1 --2- 172.21.15.3:0/4191963325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f459810e430 0x7f459819efb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f459002ae70 tx=0x7f459002f3a0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.811+0000 7f459d000640 1 -- 172.21.15.3:0/4191963325 shutdown_connections 2024-09-19T06:20:02.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.811+0000 7f459d000640 1 --2- 172.21.15.3:0/4191963325 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f457c0a3430 0x7f457c0a58f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.811+0000 7f459d000640 1 --2- 172.21.15.3:0/4191963325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f459810e430 0x7f459819efb0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.811+0000 7f459d000640 1 --2- 172.21.15.3:0/4191963325 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4598074ee0 0x7f459819ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.811+0000 7f459d000640 1 --2- 172.21.15.3:0/4191963325 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45980745c0 0x7f459819a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:02.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.811+0000 7f459d000640 1 -- 172.21.15.3:0/4191963325 >> 172.21.15.3:0/4191963325 conn(0x7f45980fd8b0 msgr2=0x7f45980fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:02.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.811+0000 7f459d000640 1 -- 172.21.15.3:0/4191963325 shutdown_connections 2024-09-19T06:20:02.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:02.811+0000 7f459d000640 1 -- 172.21.15.3:0/4191963325 wait complete. 2024-09-19T06:20:03.657 INFO:tasks.cephfs.filesystem:scrub status for tag:13124717-067d-4119-b192-eada21e7d5eb - {'path': '/', 'tag': '13124717-067d-4119-b192-eada21e7d5eb', 'options': 'recursive,force'} 2024-09-19T06:20:04.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:03 smithi059 ceph-mon[35138]: pgmap v235: 97 pgs: 97 active+clean; 5.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-19T06:20:04.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:03 smithi003 ceph-mon[30893]: pgmap v235: 97 pgs: 97 active+clean; 5.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-19T06:20:04.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:03 smithi071 ceph-mon[35662]: pgmap v235: 97 pgs: 97 active+clean; 5.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-19T06:20:04.539 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.539 INFO:tasks.workunit.client.0.smithi003.stdout:313/600: open fd = 3 2024-09-19T06:20:04.539 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.539 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.540 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.540 INFO:tasks.workunit.client.0.smithi003.stdout:314/600: open fd = 3 2024-09-19T06:20:04.540 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.540 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.540 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.540 INFO:tasks.workunit.client.0.smithi003.stdout:315/600: open fd = 3 2024-09-19T06:20:04.540 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.540 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.540 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.540 INFO:tasks.workunit.client.0.smithi003.stdout:316/600: open fd = 3 2024-09-19T06:20:04.540 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.540 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.540 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.541 INFO:tasks.workunit.client.0.smithi003.stdout:317/600: open fd = 3 2024-09-19T06:20:04.541 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.541 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.541 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.541 INFO:tasks.workunit.client.0.smithi003.stdout:318/600: open fd = 3 2024-09-19T06:20:04.541 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.541 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.541 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.541 INFO:tasks.workunit.client.0.smithi003.stdout:319/600: open fd = 3 2024-09-19T06:20:04.541 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.541 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.541 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.541 INFO:tasks.workunit.client.0.smithi003.stdout:320/600: open fd = 3 2024-09-19T06:20:04.541 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.542 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.542 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.542 INFO:tasks.workunit.client.0.smithi003.stdout:321/600: open fd = 3 2024-09-19T06:20:04.542 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.542 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.542 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.542 INFO:tasks.workunit.client.0.smithi003.stdout:322/600: open fd = 3 2024-09-19T06:20:04.542 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.542 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.542 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.543 INFO:tasks.workunit.client.0.smithi003.stdout:323/600: open fd = 3 2024-09-19T06:20:04.543 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.543 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.543 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.543 INFO:tasks.workunit.client.0.smithi003.stdout:324/600: open fd = 3 2024-09-19T06:20:04.543 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.543 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.543 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.543 INFO:tasks.workunit.client.0.smithi003.stdout:325/600: open fd = 3 2024-09-19T06:20:04.543 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.543 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.543 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.543 INFO:tasks.workunit.client.0.smithi003.stdout:326/600: open fd = 3 2024-09-19T06:20:04.543 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.544 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.544 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.544 INFO:tasks.workunit.client.0.smithi003.stdout:327/600: open fd = 3 2024-09-19T06:20:04.544 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.544 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.544 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.544 INFO:tasks.workunit.client.0.smithi003.stdout:328/600: open fd = 3 2024-09-19T06:20:04.544 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.544 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.544 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.544 INFO:tasks.workunit.client.0.smithi003.stdout:329/600: open fd = 3 2024-09-19T06:20:04.544 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.544 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.544 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.545 INFO:tasks.workunit.client.0.smithi003.stdout:330/600: open fd = 3 2024-09-19T06:20:04.545 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.545 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.545 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.545 INFO:tasks.workunit.client.0.smithi003.stdout:331/600: open fd = 3 2024-09-19T06:20:04.545 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.545 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.545 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.545 INFO:tasks.workunit.client.0.smithi003.stdout:332/600: open fd = 3 2024-09-19T06:20:04.545 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.545 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.545 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.545 INFO:tasks.workunit.client.0.smithi003.stdout:333/600: open fd = 3 2024-09-19T06:20:04.545 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.546 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.546 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.546 INFO:tasks.workunit.client.0.smithi003.stdout:334/600: open fd = 3 2024-09-19T06:20:04.546 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.546 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.546 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.546 INFO:tasks.workunit.client.0.smithi003.stdout:335/600: open fd = 3 2024-09-19T06:20:04.546 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.546 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.546 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.546 INFO:tasks.workunit.client.0.smithi003.stdout:336/600: open fd = 3 2024-09-19T06:20:04.546 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.546 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.546 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.547 INFO:tasks.workunit.client.0.smithi003.stdout:337/600: open fd = 3 2024-09-19T06:20:04.547 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.547 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.547 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.547 INFO:tasks.workunit.client.0.smithi003.stdout:338/600: open fd = 3 2024-09-19T06:20:04.547 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.547 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.547 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.547 INFO:tasks.workunit.client.0.smithi003.stdout:339/600: open fd = 3 2024-09-19T06:20:04.547 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.547 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.547 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.547 INFO:tasks.workunit.client.0.smithi003.stdout:340/600: open fd = 3 2024-09-19T06:20:04.548 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.548 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.548 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.548 INFO:tasks.workunit.client.0.smithi003.stdout:341/600: open fd = 3 2024-09-19T06:20:04.548 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.548 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.548 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.548 INFO:tasks.workunit.client.0.smithi003.stdout:342/600: open fd = 3 2024-09-19T06:20:04.548 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.548 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.548 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.548 INFO:tasks.workunit.client.0.smithi003.stdout:343/600: open fd = 3 2024-09-19T06:20:04.548 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.548 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.549 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.549 INFO:tasks.workunit.client.0.smithi003.stdout:344/600: open fd = 3 2024-09-19T06:20:04.549 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.549 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.550 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.550 INFO:tasks.workunit.client.0.smithi003.stdout:345/600: open fd = 3 2024-09-19T06:20:04.550 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.550 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.550 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.550 INFO:tasks.workunit.client.0.smithi003.stdout:346/600: open fd = 3 2024-09-19T06:20:04.550 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.550 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.551 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.551 INFO:tasks.workunit.client.0.smithi003.stdout:347/600: open fd = 3 2024-09-19T06:20:04.551 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.551 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.551 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.551 INFO:tasks.workunit.client.0.smithi003.stdout:348/600: open fd = 3 2024-09-19T06:20:04.551 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.551 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.552 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.552 INFO:tasks.workunit.client.0.smithi003.stdout:349/600: open fd = 3 2024-09-19T06:20:04.552 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.552 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.552 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.552 INFO:tasks.workunit.client.0.smithi003.stdout:350/600: open fd = 3 2024-09-19T06:20:04.552 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.552 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.552 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.552 INFO:tasks.workunit.client.0.smithi003.stdout:351/600: open fd = 3 2024-09-19T06:20:04.552 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.552 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.552 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.553 INFO:tasks.workunit.client.0.smithi003.stdout:352/600: open fd = 3 2024-09-19T06:20:04.553 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.553 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.553 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.553 INFO:tasks.workunit.client.0.smithi003.stdout:353/600: open fd = 3 2024-09-19T06:20:04.553 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.553 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.553 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.553 INFO:tasks.workunit.client.0.smithi003.stdout:354/600: open fd = 3 2024-09-19T06:20:04.553 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.553 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.553 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.553 INFO:tasks.workunit.client.0.smithi003.stdout:355/600: open fd = 3 2024-09-19T06:20:04.554 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.554 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.554 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.554 INFO:tasks.workunit.client.0.smithi003.stdout:356/600: open fd = 3 2024-09-19T06:20:04.554 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.554 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.554 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.554 INFO:tasks.workunit.client.0.smithi003.stdout:357/600: open fd = 3 2024-09-19T06:20:04.554 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.554 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.555 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.555 INFO:tasks.workunit.client.0.smithi003.stdout:358/600: open fd = 3 2024-09-19T06:20:04.555 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.555 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.555 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.555 INFO:tasks.workunit.client.0.smithi003.stdout:359/600: open fd = 3 2024-09-19T06:20:04.555 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.555 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.555 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.555 INFO:tasks.workunit.client.0.smithi003.stdout:360/600: open fd = 3 2024-09-19T06:20:04.555 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.555 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.555 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.555 INFO:tasks.workunit.client.0.smithi003.stdout:361/600: open fd = 3 2024-09-19T06:20:04.556 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.556 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.556 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.556 INFO:tasks.workunit.client.0.smithi003.stdout:362/600: open fd = 3 2024-09-19T06:20:04.556 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.556 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.556 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.556 INFO:tasks.workunit.client.0.smithi003.stdout:363/600: open fd = 3 2024-09-19T06:20:04.556 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.556 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.556 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.556 INFO:tasks.workunit.client.0.smithi003.stdout:364/600: open fd = 3 2024-09-19T06:20:04.556 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.557 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.557 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.557 INFO:tasks.workunit.client.0.smithi003.stdout:365/600: open fd = 3 2024-09-19T06:20:04.557 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.557 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.557 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.557 INFO:tasks.workunit.client.0.smithi003.stdout:366/600: open fd = 3 2024-09-19T06:20:04.557 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.557 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.557 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.557 INFO:tasks.workunit.client.0.smithi003.stdout:367/600: open fd = 3 2024-09-19T06:20:04.557 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.557 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.557 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.558 INFO:tasks.workunit.client.0.smithi003.stdout:368/600: open fd = 3 2024-09-19T06:20:04.558 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.558 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.558 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.558 INFO:tasks.workunit.client.0.smithi003.stdout:369/600: open fd = 3 2024-09-19T06:20:04.558 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.558 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.558 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.558 INFO:tasks.workunit.client.0.smithi003.stdout:370/600: open fd = 3 2024-09-19T06:20:04.558 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.558 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.558 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.558 INFO:tasks.workunit.client.0.smithi003.stdout:371/600: open fd = 3 2024-09-19T06:20:04.558 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.559 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.559 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.559 INFO:tasks.workunit.client.0.smithi003.stdout:372/600: open fd = 3 2024-09-19T06:20:04.559 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.559 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.559 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.559 INFO:tasks.workunit.client.0.smithi003.stdout:373/600: open fd = 3 2024-09-19T06:20:04.559 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.559 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.559 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:04.559 INFO:tasks.workunit.client.0.smithi003.stdout:374/600: open fd = 3 2024-09-19T06:20:04.559 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.560 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:20:04.560 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:20:06.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:05 smithi059 ceph-mon[35138]: pgmap v236: 97 pgs: 97 active+clean; 5.6 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 104 KiB/s wr, 41 op/s 2024-09-19T06:20:06.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:05 smithi059 ceph-mon[35138]: scrub summary: idle 2024-09-19T06:20:06.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:05 smithi003 ceph-mon[30893]: pgmap v236: 97 pgs: 97 active+clean; 5.6 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 104 KiB/s wr, 41 op/s 2024-09-19T06:20:06.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:05 smithi003 ceph-mon[30893]: scrub summary: idle 2024-09-19T06:20:06.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:05 smithi071 ceph-mon[35662]: pgmap v236: 97 pgs: 97 active+clean; 5.6 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 104 KiB/s wr, 41 op/s 2024-09-19T06:20:06.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:05 smithi071 ceph-mon[35662]: scrub summary: idle 2024-09-19T06:20:06.789 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.786+0000 7f742cc00640 1 -- 172.21.15.3:0/2867705704 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7428107940 msgr2=0x7f7428107d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:06.790 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.786+0000 7f742cc00640 1 --2- 172.21.15.3:0/2867705704 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7428107940 0x7f7428107d20 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7418009930 tx=0x7f741802a440 comp rx=0 tx=0).stop 2024-09-19T06:20:06.790 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.786+0000 7f742cc00640 1 -- 172.21.15.3:0/2867705704 shutdown_connections 2024-09-19T06:20:06.790 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.786+0000 7f742cc00640 1 --2- 172.21.15.3:0/2867705704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74281022d0 0x7f742810e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.790 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.786+0000 7f742cc00640 1 --2- 172.21.15.3:0/2867705704 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7428101930 0x7f7428101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.790 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.786+0000 7f742cc00640 1 --2- 172.21.15.3:0/2867705704 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7428107940 0x7f7428107d20 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.790 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.786+0000 7f742cc00640 1 -- 172.21.15.3:0/2867705704 >> 172.21.15.3:0/2867705704 conn(0x7f74280fd630 msgr2=0x7f74280ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:06.790 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.787+0000 7f742cc00640 1 -- 172.21.15.3:0/2867705704 shutdown_connections 2024-09-19T06:20:06.790 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.787+0000 7f742cc00640 1 -- 172.21.15.3:0/2867705704 wait complete. 2024-09-19T06:20:06.790 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.788+0000 7f742cc00640 1 Processor -- start 2024-09-19T06:20:06.791 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.788+0000 7f742cc00640 1 -- start start 2024-09-19T06:20:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.788+0000 7f742cc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7428101930 0x7f742819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.788+0000 7f742cc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74281022d0 0x7f742819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.788+0000 7f742cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7428107940 0x7f742819ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.788+0000 7f742cc00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7428111d50 con 0x7f74281022d0 2024-09-19T06:20:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.788+0000 7f742cc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7428111bd0 con 0x7f7428107940 2024-09-19T06:20:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.788+0000 7f742cc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7428111ed0 con 0x7f7428101930 2024-09-19T06:20:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.788+0000 7f7427400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7428101930 0x7f742819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.788+0000 7f741fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74281022d0 0x7f742819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.788+0000 7f7427400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7428101930 0x7f742819a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:49138/0 (socket says 172.21.15.3:49138) 2024-09-19T06:20:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.788+0000 7f741fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74281022d0 0x7f742819a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38008/0 (socket says 172.21.15.3:38008) 2024-09-19T06:20:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.788+0000 7f7427400640 1 -- 172.21.15.3:0/1074022992 learned_addr learned my addr 172.21.15.3:0/1074022992 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.788+0000 7f7427e00640 1 --2- 172.21.15.3:0/1074022992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7428107940 0x7f742819ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.789+0000 7f7427400640 1 -- 172.21.15.3:0/1074022992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7428107940 msgr2=0x7f742819ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.789+0000 7f7427400640 1 --2- 172.21.15.3:0/1074022992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7428107940 0x7f742819ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.795 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.789+0000 7f7427400640 1 -- 172.21.15.3:0/1074022992 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74281022d0 msgr2=0x7f742819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:06.795 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.789+0000 7f7427400640 1 --2- 172.21.15.3:0/1074022992 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74281022d0 0x7f742819a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.795 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.789+0000 7f7427400640 1 -- 172.21.15.3:0/1074022992 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f742819f490 con 0x7f7428101930 2024-09-19T06:20:06.795 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.789+0000 7f7427400640 1 --2- 172.21.15.3:0/1074022992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7428101930 0x7f742819a4a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7418009230 tx=0x7f7418004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:06.795 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.789+0000 7f7424c00640 1 -- 172.21.15.3:0/1074022992 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741803f030 con 0x7f7428101930 2024-09-19T06:20:06.795 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.790+0000 7f742cc00640 1 -- 172.21.15.3:0/1074022992 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f742819f720 con 0x7f7428101930 2024-09-19T06:20:06.795 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.790+0000 7f7424c00640 1 -- 172.21.15.3:0/1074022992 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7418004440 con 0x7f7428101930 2024-09-19T06:20:06.795 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.790+0000 7f7424c00640 1 -- 172.21.15.3:0/1074022992 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7418035070 con 0x7f7428101930 2024-09-19T06:20:06.795 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.790+0000 7f742cc00640 1 -- 172.21.15.3:0/1074022992 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74281a7010 con 0x7f7428101930 2024-09-19T06:20:06.804 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.793+0000 7f74310b8740 1 Processor -- start 2024-09-19T06:20:06.804 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.793+0000 7f74310b8740 1 -- start start 2024-09-19T06:20:06.804 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.793+0000 7f7424c00640 1 -- 172.21.15.3:0/1074022992 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f7418042030 con 0x7f7428101930 2024-09-19T06:20:06.804 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.793+0000 7f74310b8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0b3b0 0x55acdbb0b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:06.804 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.793+0000 7f74310b8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55acdbb0bcd0 0x55acdbb16030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:06.804 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.793+0000 7f74310b8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55acdbb16570 0x55acdbb18960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:06.805 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.793+0000 7f74310b8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55acdba71100 con 0x55acdbb16570 2024-09-19T06:20:06.805 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.793+0000 7f74310b8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55acdba191b0 con 0x55acdbb0bcd0 2024-09-19T06:20:06.805 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.793+0000 7f74310b8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55acdba6d0c0 con 0x55acdbb0b3b0 2024-09-19T06:20:06.805 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.793+0000 7f741fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55acdbb16570 0x55acdbb18960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:06.805 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.794+0000 7f7427e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0b3b0 0x55acdbb0b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:06.805 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.794+0000 7f7427400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55acdbb0bcd0 0x55acdbb16030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:06.805 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.794+0000 7f7427e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0b3b0 0x55acdbb0b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:49144/0 (socket says 172.21.15.3:49144) 2024-09-19T06:20:06.805 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.794+0000 7f7427e00640 1 -- 172.21.15.3:0/4152355759 learned_addr learned my addr 172.21.15.3:0/4152355759 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.794+0000 7f7427e00640 1 -- 172.21.15.3:0/4152355759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55acdbb0bcd0 msgr2=0x55acdbb16030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.794+0000 7f7427e00640 1 --2- 172.21.15.3:0/4152355759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55acdbb0bcd0 0x55acdbb16030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.794+0000 7f7427e00640 1 -- 172.21.15.3:0/4152355759 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55acdbb16570 msgr2=0x55acdbb18960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.794+0000 7f7427e00640 1 --2- 172.21.15.3:0/4152355759 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55acdbb16570 0x55acdbb18960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.794+0000 7f7427e00640 1 -- 172.21.15.3:0/4152355759 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acdb784210 con 0x55acdbb0b3b0 2024-09-19T06:20:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.794+0000 7f7427e00640 1 --2- 172.21.15.3:0/4152355759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0b3b0 0x55acdbb0b790 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7420009f60 tx=0x7f7420009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b232fee99b3e80c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.795+0000 7f7424c00640 1 --2- 172.21.15.3:0/1074022992 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f740c0a3420 0x7f740c0a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.795+0000 7f7417e00640 1 -- 172.21.15.3:0/4152355759 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742001e070 con 0x55acdbb0b3b0 2024-09-19T06:20:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.795+0000 7f7417e00640 1 -- 172.21.15.3:0/4152355759 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7420003c30 con 0x55acdbb0b3b0 2024-09-19T06:20:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.795+0000 7f7417e00640 1 -- 172.21.15.3:0/4152355759 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742000f980 con 0x55acdbb0b3b0 2024-09-19T06:20:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.795+0000 7f7424c00640 1 -- 172.21.15.3:0/1074022992 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8615+0+0 (secure 0 0 0) 0x7f74180efd00 con 0x7f7428101930 2024-09-19T06:20:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.795+0000 7f7427400640 1 --2- 172.21.15.3:0/1074022992 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f740c0a3420 0x7f740c0a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.795+0000 7f74310b8740 1 -- 172.21.15.3:0/4152355759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0b3b0 msgr2=0x55acdbb0b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.795+0000 7f74310b8740 1 --2- 172.21.15.3:0/4152355759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0b3b0 0x55acdbb0b790 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7420009f60 tx=0x7f7420009f90 comp rx=0 tx=0).stop 2024-09-19T06:20:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.796+0000 7f7427400640 1 --2- 172.21.15.3:0/1074022992 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f740c0a3420 0x7f740c0a58e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55acdbb08780 tx=0x7f74180f37b0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.796+0000 7f74310b8740 1 -- 172.21.15.3:0/4152355759 shutdown_connections 2024-09-19T06:20:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.796+0000 7f74310b8740 1 --2- 172.21.15.3:0/4152355759 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55acdbb16570 0x55acdbb18960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.796+0000 7f74310b8740 1 --2- 172.21.15.3:0/4152355759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55acdbb0bcd0 0x55acdbb16030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.796+0000 7f74310b8740 1 --2- 172.21.15.3:0/4152355759 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0b3b0 0x55acdbb0b790 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.796+0000 7f74310b8740 1 -- 172.21.15.3:0/4152355759 >> 172.21.15.3:0/4152355759 conn(0x55acdbb07920 msgr2=0x55acdbb07d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.796+0000 7f74310b8740 1 -- 172.21.15.3:0/4152355759 shutdown_connections 2024-09-19T06:20:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.796+0000 7f74310b8740 1 -- 172.21.15.3:0/4152355759 wait complete. 2024-09-19T06:20:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.796+0000 7f74310b8740 1 -- start start 2024-09-19T06:20:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.796+0000 7f74310b8740 1 Processor -- start 2024-09-19T06:20:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.797+0000 7f74310b8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55acdbb0b3b0 0x55acdbb13690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.797+0000 7f74310b8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0bcd0 0x55acdbb13bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.797+0000 7f74310b8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55acdbb16570 0x55acdbb14110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.797+0000 7f74310b8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55acdbb18ff0 con 0x55acdbb16570 2024-09-19T06:20:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.797+0000 7f74310b8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55acdb9fa090 con 0x55acdbb0b3b0 2024-09-19T06:20:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.797+0000 7f74310b8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55acdbb19170 con 0x55acdbb0bcd0 2024-09-19T06:20:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.797+0000 7f74310b8740 10 client.0 _ll_register_callbacks cb 0x55acdba4ef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.797+0000 7f7427e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55acdbb16570 0x55acdbb14110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.797+0000 7f7427e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55acdbb16570 0x55acdbb14110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38040/0 (socket says 172.21.15.3:38040) 2024-09-19T06:20:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.797+0000 7f7427e00640 1 -- 172.21.15.3:0/1891462318 learned_addr learned my addr 172.21.15.3:0/1891462318 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.797+0000 7f741fe00640 1 --2- 172.21.15.3:0/1891462318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0bcd0 0x55acdbb13bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.797+0000 7f7427e00640 1 --2- 172.21.15.3:0/1891462318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55acdbb0b3b0 0x55acdbb13690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.798+0000 7f741fe00640 1 -- 172.21.15.3:0/1891462318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55acdbb0b3b0 msgr2=0x55acdbb13690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.798+0000 7f741fe00640 1 --2- 172.21.15.3:0/1891462318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55acdbb0b3b0 0x55acdbb13690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.798+0000 7f741fe00640 1 -- 172.21.15.3:0/1891462318 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55acdbb16570 msgr2=0x55acdbb14110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.798+0000 7f741fe00640 1 --2- 172.21.15.3:0/1891462318 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55acdbb16570 0x55acdbb14110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.798+0000 7f741fe00640 1 -- 172.21.15.3:0/1891462318 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acdb850620 con 0x55acdbb0bcd0 2024-09-19T06:20:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.798+0000 7f741fe00640 1 --2- 172.21.15.3:0/1891462318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0bcd0 0x55acdbb13bd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x55acdbb0df50 tx=0x7f7410012b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82adb90e2bebf9a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.798+0000 7f7414c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:20:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.798+0000 7f7414c00640 1 -- 172.21.15.3:0/1891462318 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741000f8f0 con 0x55acdbb0bcd0 2024-09-19T06:20:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.798+0000 7f74310b8740 1 -- 172.21.15.3:0/1891462318 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7420003c30 con 0x55acdbb0bcd0 2024-09-19T06:20:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.798+0000 7f7414c00640 1 -- 172.21.15.3:0/1891462318 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8615+0+0 (secure 0 0 0) 0x7f741000fa90 con 0x55acdbb0bcd0 2024-09-19T06:20:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.798+0000 7f7414c00640 1 -- 172.21.15.3:0/1891462318 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f741000fc90 con 0x55acdbb0bcd0 2024-09-19T06:20:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.798+0000 7f74310b8740 10 client.27508 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.798+0000 7f74310b8740 1 -- 172.21.15.3:0/1891462318 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55acdbb24fa0 con 0x55acdbb0bcd0 2024-09-19T06:20:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.799+0000 7f7414c00640 1 -- 172.21.15.3:0/1891462318 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7420003c30 con 0x55acdbb0bcd0 2024-09-19T06:20:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.799+0000 7f7414c00640 1 -- 172.21.15.3:0/1891462318 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f741001c420 con 0x55acdbb0bcd0 2024-09-19T06:20:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.799+0000 7f74310b8740 10 client.27508 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.799+0000 7f74310b8740 10 client.27508 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.799+0000 7f74310b8740 20 client.27508 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.799+0000 7f74310b8740 1 --2- 172.21.15.3:0/1891462318 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55acdbb264d0 0x55acdbb288c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.799+0000 7f74310b8740 4 client.27508 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.799+0000 7f74310b8740 1 -- 172.21.15.3:0/1891462318 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55acdba7e830 con 0x55acdbb264d0 2024-09-19T06:20:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.799+0000 7f7427e00640 1 --2- 172.21.15.3:0/1891462318 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55acdbb264d0 0x55acdbb288c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.800+0000 7f7427e00640 1 --2- 172.21.15.3:0/1891462318 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55acdbb264d0 0x55acdbb288c0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2306a26d8509a361 server_cookie=77fad7c40aed6df8 in_seq=0 out_seq=0 2024-09-19T06:20:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.800+0000 7f7414c00640 10 client.27508 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.801+0000 7f7414c00640 1 -- 172.21.15.3:0/1891462318 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55acdba7e830 con 0x55acdbb264d0 2024-09-19T06:20:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.801+0000 7f7414c00640 10 client.27508 handle_command_reply: tid=0 2024-09-19T06:20:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.801+0000 7f74310b8740 1 client.27508 shutdown 2024-09-19T06:20:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.801+0000 7f74310b8740 1 -- 172.21.15.3:0/1891462318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0bcd0 msgr2=0x55acdbb13bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.801+0000 7f74310b8740 1 --2- 172.21.15.3:0/1891462318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0bcd0 0x55acdbb13bd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x55acdbb0df50 tx=0x7f7410012b60 comp rx=0 tx=0).stop 2024-09-19T06:20:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.801+0000 7f74310b8740 1 -- 172.21.15.3:0/1891462318 shutdown_connections 2024-09-19T06:20:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.801+0000 7f74310b8740 1 --2- 172.21.15.3:0/1891462318 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55acdbb264d0 0x55acdbb288c0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.801+0000 7f74310b8740 1 --2- 172.21.15.3:0/1891462318 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55acdbb16570 0x55acdbb14110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.801+0000 7f74310b8740 1 --2- 172.21.15.3:0/1891462318 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0bcd0 0x55acdbb13bd0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.801+0000 7f74310b8740 1 --2- 172.21.15.3:0/1891462318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55acdbb0b3b0 0x55acdbb13690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.801+0000 7f74310b8740 1 -- 172.21.15.3:0/1891462318 >> 172.21.15.3:0/1891462318 conn(0x55acdbb07920 msgr2=0x55acdbb0d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.801+0000 7f7414c00640 0 client.27508 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.801+0000 7f74310b8740 1 -- 172.21.15.3:0/1891462318 shutdown_connections 2024-09-19T06:20:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.801+0000 7f74310b8740 1 -- 172.21.15.3:0/1891462318 wait complete. 2024-09-19T06:20:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.801+0000 7f74310b8740 20 client.27508 trim_cache size 0 max 16384 2024-09-19T06:20:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.816+0000 7f74310b8740 1 Processor -- start 2024-09-19T06:20:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.817+0000 7f74310b8740 1 -- start start 2024-09-19T06:20:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.817+0000 7f74310b8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0b3b0 0x55acdbb11f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.817+0000 7f74310b8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55acdbb0bcd0 0x55acdbb12480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.817+0000 7f74310b8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55acdbb16570 0x55acdbb2e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.817+0000 7f74310b8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f74281afae0 con 0x55acdbb0bcd0 2024-09-19T06:20:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.817+0000 7f74310b8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f74281b1620 con 0x55acdbb16570 2024-09-19T06:20:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.817+0000 7f74310b8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f74281b01b0 con 0x55acdbb0b3b0 2024-09-19T06:20:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.817+0000 7f741fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55acdbb0bcd0 0x55acdbb12480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.817+0000 7f741fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55acdbb0bcd0 0x55acdbb12480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38046/0 (socket says 172.21.15.3:38046) 2024-09-19T06:20:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.817+0000 7f741fe00640 1 -- 172.21.15.3:0/3604599550 learned_addr learned my addr 172.21.15.3:0/3604599550 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.817+0000 7f7427e00640 1 --2- 172.21.15.3:0/3604599550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0b3b0 0x55acdbb11f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.817+0000 7f7427e00640 1 --2- 172.21.15.3:0/3604599550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55acdbb16570 0x55acdbb2e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.817+0000 7f741fe00640 1 -- 172.21.15.3:0/3604599550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0b3b0 msgr2=0x55acdbb11f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.817+0000 7f741fe00640 1 --2- 172.21.15.3:0/3604599550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0b3b0 0x55acdbb11f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.817+0000 7f741fe00640 1 -- 172.21.15.3:0/3604599550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55acdbb16570 msgr2=0x55acdbb2e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.817+0000 7f741fe00640 1 --2- 172.21.15.3:0/3604599550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55acdbb16570 0x55acdbb2e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.817+0000 7f741fe00640 1 -- 172.21.15.3:0/3604599550 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acdbb22330 con 0x55acdbb0bcd0 2024-09-19T06:20:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.817+0000 7f7427e00640 1 --2- 172.21.15.3:0/3604599550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0b3b0 0x55acdbb11f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.818+0000 7f741fe00640 1 --2- 172.21.15.3:0/3604599550 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55acdbb0bcd0 0x55acdbb12480 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f741001ca30 tx=0x7f741000f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3d4a2fd2b1202a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.818+0000 7f7417400640 1 -- 172.21.15.3:0/3604599550 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741001ce60 con 0x55acdbb0bcd0 2024-09-19T06:20:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.818+0000 7f7417400640 1 -- 172.21.15.3:0/3604599550 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74100055f0 con 0x55acdbb0bcd0 2024-09-19T06:20:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.818+0000 7f7417400640 1 -- 172.21.15.3:0/3604599550 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74100035f0 con 0x55acdbb0bcd0 2024-09-19T06:20:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.818+0000 7f74310b8740 1 -- 172.21.15.3:0/3604599550 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55acdbb0bcd0 msgr2=0x55acdbb12480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.818+0000 7f74310b8740 1 --2- 172.21.15.3:0/3604599550 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55acdbb0bcd0 0x55acdbb12480 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f741001ca30 tx=0x7f741000f810 comp rx=0 tx=0).stop 2024-09-19T06:20:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.819+0000 7f74310b8740 1 -- 172.21.15.3:0/3604599550 shutdown_connections 2024-09-19T06:20:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.819+0000 7f74310b8740 1 --2- 172.21.15.3:0/3604599550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55acdbb16570 0x55acdbb2e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.819+0000 7f74310b8740 1 --2- 172.21.15.3:0/3604599550 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55acdbb0bcd0 0x55acdbb12480 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.819+0000 7f74310b8740 1 --2- 172.21.15.3:0/3604599550 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0b3b0 0x55acdbb11f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.819+0000 7f74310b8740 1 -- 172.21.15.3:0/3604599550 >> 172.21.15.3:0/3604599550 conn(0x55acdbb07920 msgr2=0x55acdbb0c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.819+0000 7f74310b8740 1 -- 172.21.15.3:0/3604599550 shutdown_connections 2024-09-19T06:20:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.819+0000 7f74310b8740 1 -- 172.21.15.3:0/3604599550 wait complete. 2024-09-19T06:20:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.819+0000 7f74310b8740 1 -- start start 2024-09-19T06:20:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.819+0000 7f74310b8740 1 Processor -- start 2024-09-19T06:20:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.820+0000 7f74310b8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55acdbb0b3b0 0x55acdbb19460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.820+0000 7f74310b8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0bcd0 0x55acdbb199a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.820+0000 7f74310b8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55acdbb16570 0x55acdbb19ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.820+0000 7f74310b8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f74281b0f50 con 0x55acdbb16570 2024-09-19T06:20:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.820+0000 7f74310b8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f74281b0880 con 0x55acdbb0b3b0 2024-09-19T06:20:06.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.820+0000 7f74310b8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f74281adae0 con 0x55acdbb0bcd0 2024-09-19T06:20:06.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.820+0000 7f74310b8740 10 client.0 _ll_register_callbacks cb 0x7f7410009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:06.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.820+0000 7f7427e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55acdbb16570 0x55acdbb19ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:06.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.820+0000 7f7427e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55acdbb0b3b0 0x55acdbb19460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:06.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.820+0000 7f741fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0bcd0 0x55acdbb199a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:06.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.820+0000 7f7427e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55acdbb0b3b0 0x55acdbb19460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:52020/0 (socket says 172.21.15.3:52020) 2024-09-19T06:20:06.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.820+0000 7f7427e00640 1 -- 172.21.15.3:0/1730374819 learned_addr learned my addr 172.21.15.3:0/1730374819 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:06.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.820+0000 7f741fe00640 1 -- 172.21.15.3:0/1730374819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55acdbb0b3b0 msgr2=0x55acdbb19460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:06.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.820+0000 7f741fe00640 1 --2- 172.21.15.3:0/1730374819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55acdbb0b3b0 0x55acdbb19460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.820+0000 7f741fe00640 1 -- 172.21.15.3:0/1730374819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55acdbb16570 msgr2=0x55acdbb19ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.820+0000 7f741fe00640 1 --2- 172.21.15.3:0/1730374819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55acdbb16570 0x55acdbb19ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.820+0000 7f741fe00640 1 -- 172.21.15.3:0/1730374819 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acdbb8f210 con 0x55acdbb0bcd0 2024-09-19T06:20:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.821+0000 7f741fe00640 1 --2- 172.21.15.3:0/1730374819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0bcd0 0x55acdbb199a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x55acdba4ef80 tx=0x7f7410005340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5895eac8d27c1a91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.821+0000 7f7414c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:20:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.821+0000 7f7414c00640 1 -- 172.21.15.3:0/1730374819 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7410005430 con 0x55acdbb0bcd0 2024-09-19T06:20:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.821+0000 7f74310b8740 1 -- 172.21.15.3:0/1730374819 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74100055f0 con 0x55acdbb0bcd0 2024-09-19T06:20:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.821+0000 7f7414c00640 1 -- 172.21.15.3:0/1730374819 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8615+0+0 (secure 0 0 0) 0x7f741001cc70 con 0x55acdbb0bcd0 2024-09-19T06:20:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.821+0000 7f7414c00640 1 -- 172.21.15.3:0/1730374819 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f74100035f0 con 0x55acdbb0bcd0 2024-09-19T06:20:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.821+0000 7f74310b8740 10 client.27514 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.821+0000 7f74310b8740 1 -- 172.21.15.3:0/1730374819 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55acdbb90500 con 0x55acdbb0bcd0 2024-09-19T06:20:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.821+0000 7f7414c00640 1 -- 172.21.15.3:0/1730374819 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74100055f0 con 0x55acdbb0bcd0 2024-09-19T06:20:06.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.822+0000 7f7414c00640 1 -- 172.21.15.3:0/1730374819 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f741002b070 con 0x55acdbb0bcd0 2024-09-19T06:20:06.830 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.822+0000 7f74310b8740 10 client.27514 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:06.830 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.822+0000 7f74310b8740 10 client.27514 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:06.830 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.822+0000 7f74310b8740 20 client.27514 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:06.830 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.822+0000 7f74310b8740 1 --2- 172.21.15.3:0/1730374819 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55acdbb90b60 0x55acdbb92f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:06.830 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.822+0000 7f74310b8740 4 client.27514 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:20:06.830 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.822+0000 7f74310b8740 1 -- 172.21.15.3:0/1730374819 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55acdba78b80 con 0x55acdbb90b60 2024-09-19T06:20:06.830 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.822+0000 7f7427e00640 1 --2- 172.21.15.3:0/1730374819 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55acdbb90b60 0x55acdbb92f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:06.830 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.822+0000 7f7427e00640 1 --2- 172.21.15.3:0/1730374819 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55acdbb90b60 0x55acdbb92f50 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dedf1ef5995a4a36 server_cookie=862811b8c8a8ddfc in_seq=0 out_seq=0 2024-09-19T06:20:06.830 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.822+0000 7f7414c00640 10 client.27514 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.837+0000 7f7414c00640 1 -- 172.21.15.3:0/1730374819 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55acdba78b80 con 0x55acdbb90b60 2024-09-19T06:20:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.837+0000 7f7414c00640 10 client.27514 handle_command_reply: tid=0 2024-09-19T06:20:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.837+0000 7f74310b8740 1 client.27514 shutdown 2024-09-19T06:20:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.838+0000 7f74310b8740 1 -- 172.21.15.3:0/1730374819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0bcd0 msgr2=0x55acdbb199a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.838+0000 7f74310b8740 1 --2- 172.21.15.3:0/1730374819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0bcd0 0x55acdbb199a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x55acdba4ef80 tx=0x7f7410005340 comp rx=0 tx=0).stop 2024-09-19T06:20:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.838+0000 7f74310b8740 1 -- 172.21.15.3:0/1730374819 shutdown_connections 2024-09-19T06:20:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.838+0000 7f74310b8740 1 --2- 172.21.15.3:0/1730374819 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55acdbb90b60 0x55acdbb92f50 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.838+0000 7f74310b8740 1 --2- 172.21.15.3:0/1730374819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55acdbb16570 0x55acdbb19ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.838+0000 7f74310b8740 1 --2- 172.21.15.3:0/1730374819 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55acdbb0bcd0 0x55acdbb199a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.838+0000 7f74310b8740 1 --2- 172.21.15.3:0/1730374819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55acdbb0b3b0 0x55acdbb19460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.838+0000 7f7414c00640 0 client.27514 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.838+0000 7f74310b8740 1 -- 172.21.15.3:0/1730374819 >> 172.21.15.3:0/1730374819 conn(0x55acdbb07920 msgr2=0x55acdbb11ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.838+0000 7f74310b8740 1 -- 172.21.15.3:0/1730374819 shutdown_connections 2024-09-19T06:20:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.838+0000 7f74310b8740 1 -- 172.21.15.3:0/1730374819 wait complete. 2024-09-19T06:20:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.838+0000 7f74310b8740 20 client.27514 trim_cache size 0 max 16384 2024-09-19T06:20:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:20:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:20:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:20:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:20:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.839+0000 7f742cc00640 1 -- 172.21.15.3:0/1074022992 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f740c0a3420 msgr2=0x7f740c0a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.839+0000 7f742cc00640 1 --2- 172.21.15.3:0/1074022992 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f740c0a3420 0x7f740c0a58e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55acdbb08780 tx=0x7f74180f37b0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.839+0000 7f742cc00640 1 -- 172.21.15.3:0/1074022992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7428101930 msgr2=0x7f742819a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.839+0000 7f742cc00640 1 --2- 172.21.15.3:0/1074022992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7428101930 0x7f742819a4a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7418009230 tx=0x7f7418004040 comp rx=0 tx=0).stop 2024-09-19T06:20:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.839+0000 7f742cc00640 1 -- 172.21.15.3:0/1074022992 shutdown_connections 2024-09-19T06:20:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.839+0000 7f742cc00640 1 --2- 172.21.15.3:0/1074022992 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f740c0a3420 0x7f740c0a58e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.839+0000 7f742cc00640 1 --2- 172.21.15.3:0/1074022992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7428107940 0x7f742819ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.839+0000 7f742cc00640 1 --2- 172.21.15.3:0/1074022992 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f74281022d0 0x7f742819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.839+0000 7f742cc00640 1 --2- 172.21.15.3:0/1074022992 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7428101930 0x7f742819a4a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.839+0000 7f742cc00640 1 -- 172.21.15.3:0/1074022992 >> 172.21.15.3:0/1074022992 conn(0x7f74280fd630 msgr2=0x7f742810cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.839+0000 7f742cc00640 1 -- 172.21.15.3:0/1074022992 shutdown_connections 2024-09-19T06:20:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:06.839+0000 7f742cc00640 1 -- 172.21.15.3:0/1074022992 wait complete. 2024-09-19T06:20:07.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:07 smithi059 ceph-mon[35138]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T06:20:07.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:07 smithi003 ceph-mon[30893]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T06:20:07.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:07 smithi071 ceph-mon[35662]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T06:20:08.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:08 smithi059 ceph-mon[35138]: pgmap v238: 97 pgs: 97 active+clean; 5.6 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 104 KiB/s wr, 41 op/s 2024-09-19T06:20:08.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:08 smithi003 ceph-mon[30893]: pgmap v238: 97 pgs: 97 active+clean; 5.6 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 104 KiB/s wr, 41 op/s 2024-09-19T06:20:08.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:08 smithi071 ceph-mon[35662]: pgmap v238: 97 pgs: 97 active+clean; 5.6 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 104 KiB/s wr, 41 op/s 2024-09-19T06:20:10.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:10 smithi059 ceph-mon[35138]: pgmap v239: 97 pgs: 97 active+clean; 1.8 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 108 KiB/s wr, 41 op/s 2024-09-19T06:20:10.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:10 smithi003 ceph-mon[30893]: pgmap v239: 97 pgs: 97 active+clean; 1.8 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 108 KiB/s wr, 41 op/s 2024-09-19T06:20:10.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:10 smithi071 ceph-mon[35662]: pgmap v239: 97 pgs: 97 active+clean; 1.8 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 108 KiB/s wr, 41 op/s 2024-09-19T06:20:12.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:12 smithi003 ceph-mon[30893]: pgmap v240: 97 pgs: 97 active+clean; 1.8 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 108 KiB/s wr, 41 op/s 2024-09-19T06:20:12.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:12 smithi003 ceph-mon[30893]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T06:20:12.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:12 smithi059 ceph-mon[35138]: pgmap v240: 97 pgs: 97 active+clean; 1.8 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 108 KiB/s wr, 41 op/s 2024-09-19T06:20:12.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:12 smithi059 ceph-mon[35138]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T06:20:12.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:12 smithi071 ceph-mon[35662]: pgmap v240: 97 pgs: 97 active+clean; 1.8 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 108 KiB/s wr, 41 op/s 2024-09-19T06:20:12.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:12 smithi071 ceph-mon[35662]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T06:20:14.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:14 smithi059 ceph-mon[35138]: pgmap v242: 97 pgs: 97 active+clean; 1.8 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 14 op/s 2024-09-19T06:20:14.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:14 smithi003 ceph-mon[30893]: pgmap v242: 97 pgs: 97 active+clean; 1.8 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 14 op/s 2024-09-19T06:20:14.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:14 smithi071 ceph-mon[35662]: pgmap v242: 97 pgs: 97 active+clean; 1.8 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 14 op/s 2024-09-19T06:20:16.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:16 smithi059 ceph-mon[35138]: pgmap v243: 97 pgs: 97 active+clean; 2.0 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 59 KiB/s wr, 22 op/s 2024-09-19T06:20:16.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:16 smithi003 ceph-mon[30893]: pgmap v243: 97 pgs: 97 active+clean; 2.0 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 59 KiB/s wr, 22 op/s 2024-09-19T06:20:16.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:16 smithi071 ceph-mon[35662]: pgmap v243: 97 pgs: 97 active+clean; 2.0 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 59 KiB/s wr, 22 op/s 2024-09-19T06:20:18.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:18 smithi059 ceph-mon[35138]: pgmap v244: 97 pgs: 97 active+clean; 2.0 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 50 KiB/s wr, 19 op/s 2024-09-19T06:20:18.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:18 smithi003 ceph-mon[30893]: pgmap v244: 97 pgs: 97 active+clean; 2.0 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 50 KiB/s wr, 19 op/s 2024-09-19T06:20:18.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:18 smithi071 ceph-mon[35662]: pgmap v244: 97 pgs: 97 active+clean; 2.0 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 50 KiB/s wr, 19 op/s 2024-09-19T06:20:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.967+0000 7ffbcbe00640 1 -- 172.21.15.3:0/989920193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbcc107930 msgr2=0x7ffbcc107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.967+0000 7ffbcbe00640 1 --2- 172.21.15.3:0/989920193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbcc107930 0x7ffbcc107d10 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc009930 tx=0x7ffbbc02a420 comp rx=0 tx=0).stop 2024-09-19T06:20:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.967+0000 7ffbcbe00640 1 -- 172.21.15.3:0/989920193 shutdown_connections 2024-09-19T06:20:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.967+0000 7ffbcbe00640 1 --2- 172.21.15.3:0/989920193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbcc1022c0 0x7ffbcc10e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.967+0000 7ffbcbe00640 1 --2- 172.21.15.3:0/989920193 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbcc101920 0x7ffbcc101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.967+0000 7ffbcbe00640 1 --2- 172.21.15.3:0/989920193 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbcc107930 0x7ffbcc107d10 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.967+0000 7ffbcbe00640 1 -- 172.21.15.3:0/989920193 >> 172.21.15.3:0/989920193 conn(0x7ffbcc0fd600 msgr2=0x7ffbcc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.968+0000 7ffbcbe00640 1 -- 172.21.15.3:0/989920193 shutdown_connections 2024-09-19T06:20:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.968+0000 7ffbcbe00640 1 -- 172.21.15.3:0/989920193 wait complete. 2024-09-19T06:20:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.968+0000 7ffbcbe00640 1 Processor -- start 2024-09-19T06:20:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.969+0000 7ffbcbe00640 1 -- start start 2024-09-19T06:20:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.969+0000 7ffbcbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbcc101920 0x7ffbcc19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.969+0000 7ffbcbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbcc1022c0 0x7ffbcc19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.969+0000 7ffbcbe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbcc107930 0x7ffbcc19ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.969+0000 7ffbcbe00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc111dc0 con 0x7ffbcc1022c0 2024-09-19T06:20:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.969+0000 7ffbcbe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc111c40 con 0x7ffbcc101920 2024-09-19T06:20:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.969+0000 7ffbcbe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc111f40 con 0x7ffbcc107930 2024-09-19T06:20:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.969+0000 7ffbca000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbcc1022c0 0x7ffbcc19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.969+0000 7ffbca000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbcc1022c0 0x7ffbcc19a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44840/0 (socket says 172.21.15.3:44840) 2024-09-19T06:20:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.969+0000 7ffbca000640 1 -- 172.21.15.3:0/615314104 learned_addr learned my addr 172.21.15.3:0/615314104 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.969+0000 7ffbcb400640 1 --2- 172.21.15.3:0/615314104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbcc107930 0x7ffbcc19ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.969+0000 7ffbcaa00640 1 --2- 172.21.15.3:0/615314104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbcc101920 0x7ffbcc19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.970+0000 7ffbca000640 1 -- 172.21.15.3:0/615314104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbcc107930 msgr2=0x7ffbcc19ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.970+0000 7ffbca000640 1 --2- 172.21.15.3:0/615314104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbcc107930 0x7ffbcc19ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.970+0000 7ffbca000640 1 -- 172.21.15.3:0/615314104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbcc101920 msgr2=0x7ffbcc19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.970+0000 7ffbca000640 1 --2- 172.21.15.3:0/615314104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbcc101920 0x7ffbcc19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.970+0000 7ffbca000640 1 -- 172.21.15.3:0/615314104 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbcc19f460 con 0x7ffbcc1022c0 2024-09-19T06:20:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.970+0000 7ffbca000640 1 --2- 172.21.15.3:0/615314104 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbcc1022c0 0x7ffbcc19a9b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800d950 tx=0x7ffbb800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.970+0000 7ffbc3400640 1 -- 172.21.15.3:0/615314104 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8017030 con 0x7ffbcc1022c0 2024-09-19T06:20:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.970+0000 7ffbc3400640 1 -- 172.21.15.3:0/615314104 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbb8004020 con 0x7ffbcc1022c0 2024-09-19T06:20:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.970+0000 7ffbc3400640 1 -- 172.21.15.3:0/615314104 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8005650 con 0x7ffbcc1022c0 2024-09-19T06:20:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.970+0000 7ffbcbe00640 1 -- 172.21.15.3:0/615314104 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbcc19f750 con 0x7ffbcc1022c0 2024-09-19T06:20:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.970+0000 7ffbcbe00640 1 -- 172.21.15.3:0/615314104 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbcc1a6fe0 con 0x7ffbcc1022c0 2024-09-19T06:20:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.973+0000 7ffbd4abe740 1 Processor -- start 2024-09-19T06:20:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.974+0000 7ffbc3400640 1 -- 172.21.15.3:0/615314104 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7ffbb80041d0 con 0x7ffbcc1022c0 2024-09-19T06:20:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.974+0000 7ffbd4abe740 1 -- start start 2024-09-19T06:20:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.974+0000 7ffbd4abe740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560de904e3b0 0x560de904e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.974+0000 7ffbd4abe740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de904ecd0 0x560de9059030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.974+0000 7ffbd4abe740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560de9059570 0x560de905b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.974+0000 7ffbd4abe740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560de8fb4100 con 0x560de904ecd0 2024-09-19T06:20:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.974+0000 7ffbd4abe740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560de8f5c1b0 con 0x560de904e3b0 2024-09-19T06:20:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.974+0000 7ffbd4abe740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560de8fb00c0 con 0x560de9059570 2024-09-19T06:20:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.974+0000 7ffbcaa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de904ecd0 0x560de9059030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.974+0000 7ffbcb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560de904e3b0 0x560de904e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.974+0000 7ffbcaa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de904ecd0 0x560de9059030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44854/0 (socket says 172.21.15.3:44854) 2024-09-19T06:20:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.974+0000 7ffbcaa00640 1 -- 172.21.15.3:0/3997577303 learned_addr learned my addr 172.21.15.3:0/3997577303 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.974+0000 7ffbca000640 1 --2- 172.21.15.3:0/3997577303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560de9059570 0x560de905b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.975+0000 7ffbcaa00640 1 -- 172.21.15.3:0/3997577303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560de9059570 msgr2=0x560de905b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.975+0000 7ffbcaa00640 1 --2- 172.21.15.3:0/3997577303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560de9059570 0x560de905b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.975+0000 7ffbcaa00640 1 -- 172.21.15.3:0/3997577303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560de904e3b0 msgr2=0x560de904e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.975+0000 7ffbcaa00640 1 --2- 172.21.15.3:0/3997577303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560de904e3b0 0x560de904e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.975+0000 7ffbcaa00640 1 -- 172.21.15.3:0/3997577303 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560de8cc7210 con 0x560de904ecd0 2024-09-19T06:20:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.975+0000 7ffbcb400640 1 --2- 172.21.15.3:0/3997577303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560de904e3b0 0x560de904e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.975+0000 7ffbcaa00640 1 --2- 172.21.15.3:0/3997577303 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de904ecd0 0x560de9059030 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc009930 tx=0x7ffbbc005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7950b6e15f2056b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.975+0000 7ffbc3400640 1 --2- 172.21.15.3:0/615314104 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ffbb00a33a0 0x7ffbb00a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.975+0000 7ffbb7e00640 1 -- 172.21.15.3:0/3997577303 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc035040 con 0x560de904ecd0 2024-09-19T06:20:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.975+0000 7ffbb7e00640 1 -- 172.21.15.3:0/3997577303 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbbc004480 con 0x560de904ecd0 2024-09-19T06:20:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.975+0000 7ffbc3400640 1 -- 172.21.15.3:0/615314104 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7ffbb80cf720 con 0x7ffbcc1022c0 2024-09-19T06:20:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.975+0000 7ffbb7e00640 1 -- 172.21.15.3:0/3997577303 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc0035f0 con 0x560de904ecd0 2024-09-19T06:20:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.976+0000 7ffbcb400640 1 --2- 172.21.15.3:0/615314104 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ffbb00a33a0 0x7ffbb00a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.976+0000 7ffbd4abe740 1 -- 172.21.15.3:0/3997577303 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de904ecd0 msgr2=0x560de9059030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.976+0000 7ffbd4abe740 1 --2- 172.21.15.3:0/3997577303 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de904ecd0 0x560de9059030 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc009930 tx=0x7ffbbc005bf0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.976+0000 7ffbd4abe740 1 -- 172.21.15.3:0/3997577303 shutdown_connections 2024-09-19T06:20:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.976+0000 7ffbd4abe740 1 --2- 172.21.15.3:0/3997577303 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560de9059570 0x560de905b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.976+0000 7ffbd4abe740 1 --2- 172.21.15.3:0/3997577303 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de904ecd0 0x560de9059030 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.976+0000 7ffbd4abe740 1 --2- 172.21.15.3:0/3997577303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560de904e3b0 0x560de904e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.976+0000 7ffbcb400640 1 --2- 172.21.15.3:0/615314104 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ffbb00a33a0 0x7ffbb00a5860 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4005fd0 tx=0x7ffbc4009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.976+0000 7ffbd4abe740 1 -- 172.21.15.3:0/3997577303 >> 172.21.15.3:0/3997577303 conn(0x560de904a920 msgr2=0x560de904ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.976+0000 7ffbd4abe740 1 -- 172.21.15.3:0/3997577303 shutdown_connections 2024-09-19T06:20:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.976+0000 7ffbd4abe740 1 -- 172.21.15.3:0/3997577303 wait complete. 2024-09-19T06:20:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.977+0000 7ffbd4abe740 1 -- start start 2024-09-19T06:20:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.977+0000 7ffbd4abe740 1 Processor -- start 2024-09-19T06:20:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.977+0000 7ffbd4abe740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de904e3b0 0x560de9056570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.977+0000 7ffbd4abe740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560de904ecd0 0x560de9056ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.977+0000 7ffbd4abe740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560de9059570 0x560de9056ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.978+0000 7ffbd4abe740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560de905c0b0 con 0x560de904e3b0 2024-09-19T06:20:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.978+0000 7ffbd4abe740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560de8f3d090 con 0x560de9059570 2024-09-19T06:20:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.978+0000 7ffbd4abe740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560de905c230 con 0x560de904ecd0 2024-09-19T06:20:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.978+0000 7ffbd4abe740 10 client.0 _ll_register_callbacks cb 0x560de8f91f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.978+0000 7ffbcaa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de904e3b0 0x560de9056570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.978+0000 7ffbcaa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de904e3b0 0x560de9056570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44860/0 (socket says 172.21.15.3:44860) 2024-09-19T06:20:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.978+0000 7ffbcaa00640 1 -- 172.21.15.3:0/2121766224 learned_addr learned my addr 172.21.15.3:0/2121766224 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.978+0000 7ffbca000640 1 --2- 172.21.15.3:0/2121766224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560de904ecd0 0x560de9056ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.978+0000 7ffbcb400640 1 --2- 172.21.15.3:0/2121766224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560de9059570 0x560de9056ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.978+0000 7ffbcaa00640 1 -- 172.21.15.3:0/2121766224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560de904ecd0 msgr2=0x560de9056ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.978+0000 7ffbcaa00640 1 --2- 172.21.15.3:0/2121766224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560de904ecd0 0x560de9056ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.978+0000 7ffbcaa00640 1 -- 172.21.15.3:0/2121766224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560de9059570 msgr2=0x560de9056ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.978+0000 7ffbcaa00640 1 --2- 172.21.15.3:0/2121766224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560de9059570 0x560de9056ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.978+0000 7ffbcaa00640 1 -- 172.21.15.3:0/2121766224 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560de8d93620 con 0x560de904e3b0 2024-09-19T06:20:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.978+0000 7ffbcb400640 1 --2- 172.21.15.3:0/2121766224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560de9059570 0x560de9056ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.979+0000 7ffbcaa00640 1 --2- 172.21.15.3:0/2121766224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de904e3b0 0x560de9056570 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc02a940 tx=0x7ffbbc004ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15814c4661687797 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.979+0000 7ffbb4c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:20:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.979+0000 7ffbb4c00640 1 -- 172.21.15.3:0/2121766224 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc052060 con 0x560de904e3b0 2024-09-19T06:20:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.979+0000 7ffbd4abe740 1 -- 172.21.15.3:0/2121766224 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbbc004480 con 0x560de904e3b0 2024-09-19T06:20:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.979+0000 7ffbb4c00640 1 -- 172.21.15.3:0/2121766224 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7ffbbc004280 con 0x560de904e3b0 2024-09-19T06:20:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.979+0000 7ffbb4c00640 1 -- 172.21.15.3:0/2121766224 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffbbc035050 con 0x560de904e3b0 2024-09-19T06:20:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.979+0000 7ffbd4abe740 10 client.17496 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.979+0000 7ffbd4abe740 1 -- 172.21.15.3:0/2121766224 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560de9067e10 con 0x560de904e3b0 2024-09-19T06:20:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.979+0000 7ffbb4c00640 1 -- 172.21.15.3:0/2121766224 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbbc004480 con 0x560de904e3b0 2024-09-19T06:20:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.980+0000 7ffbb4c00640 1 -- 172.21.15.3:0/2121766224 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ffbbc031880 con 0x560de904e3b0 2024-09-19T06:20:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.980+0000 7ffbd4abe740 10 client.17496 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.980+0000 7ffbd4abe740 10 client.17496 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.980+0000 7ffbd4abe740 20 client.17496 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.980+0000 7ffbd4abe740 1 --2- 172.21.15.3:0/2121766224 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x560de9069160 0x560de906b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.980+0000 7ffbd4abe740 4 client.17496 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.980+0000 7ffbd4abe740 1 -- 172.21.15.3:0/2121766224 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560de8fc1830 con 0x560de9069160 2024-09-19T06:20:19.988 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.980+0000 7ffbca000640 1 --2- 172.21.15.3:0/2121766224 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x560de9069160 0x560de906b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.981+0000 7ffbca000640 1 --2- 172.21.15.3:0/2121766224 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x560de9069160 0x560de906b550 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fcd9e5f497d0528 server_cookie=36a3e81aab27a427 in_seq=0 out_seq=0 2024-09-19T06:20:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.981+0000 7ffbb4c00640 10 client.17496 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.981+0000 7ffbb4c00640 1 -- 172.21.15.3:0/2121766224 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560de8fc1830 con 0x560de9069160 2024-09-19T06:20:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.981+0000 7ffbb4c00640 10 client.17496 handle_command_reply: tid=0 2024-09-19T06:20:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.981+0000 7ffbd4abe740 1 client.17496 shutdown 2024-09-19T06:20:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.982+0000 7ffbd4abe740 1 -- 172.21.15.3:0/2121766224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de904e3b0 msgr2=0x560de9056570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.982+0000 7ffbd4abe740 1 --2- 172.21.15.3:0/2121766224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de904e3b0 0x560de9056570 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc02a940 tx=0x7ffbbc004ea0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.982+0000 7ffbd4abe740 1 -- 172.21.15.3:0/2121766224 shutdown_connections 2024-09-19T06:20:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.982+0000 7ffbd4abe740 1 --2- 172.21.15.3:0/2121766224 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x560de9069160 0x560de906b550 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.982+0000 7ffbd4abe740 1 --2- 172.21.15.3:0/2121766224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560de9059570 0x560de9056ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.982+0000 7ffbb4c00640 0 client.17496 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.982+0000 7ffbd4abe740 1 --2- 172.21.15.3:0/2121766224 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560de904ecd0 0x560de9056ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.982+0000 7ffbd4abe740 1 --2- 172.21.15.3:0/2121766224 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de904e3b0 0x560de9056570 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.982+0000 7ffbd4abe740 1 -- 172.21.15.3:0/2121766224 >> 172.21.15.3:0/2121766224 conn(0x560de904a920 msgr2=0x560de9050680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.982+0000 7ffbd4abe740 1 -- 172.21.15.3:0/2121766224 shutdown_connections 2024-09-19T06:20:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.982+0000 7ffbd4abe740 1 -- 172.21.15.3:0/2121766224 wait complete. 2024-09-19T06:20:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.982+0000 7ffbd4abe740 20 client.17496 trim_cache size 0 max 16384 2024-09-19T06:20:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.997+0000 7ffbd4abe740 1 Processor -- start 2024-09-19T06:20:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.997+0000 7ffbd4abe740 1 -- start start 2024-09-19T06:20:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.997+0000 7ffbd4abe740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560de904e3b0 0x560de9050de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.997+0000 7ffbd4abe740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560de904ecd0 0x560de9070b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.997+0000 7ffbd4abe740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de9059570 0x560de9071060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.998+0000 7ffbd4abe740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc1af9f0 con 0x560de9059570 2024-09-19T06:20:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.998+0000 7ffbd4abe740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc1b1530 con 0x560de904e3b0 2024-09-19T06:20:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.998+0000 7ffbd4abe740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc1b00c0 con 0x560de904ecd0 2024-09-19T06:20:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.998+0000 7ffbcb400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de9059570 0x560de9071060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.998+0000 7ffbcb400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de9059570 0x560de9071060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44874/0 (socket says 172.21.15.3:44874) 2024-09-19T06:20:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.998+0000 7ffbcb400640 1 -- 172.21.15.3:0/3858702562 learned_addr learned my addr 172.21.15.3:0/3858702562 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.998+0000 7ffbcaa00640 1 --2- 172.21.15.3:0/3858702562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560de904e3b0 0x560de9050de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.998+0000 7ffbca000640 1 --2- 172.21.15.3:0/3858702562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560de904ecd0 0x560de9070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.998+0000 7ffbcb400640 1 -- 172.21.15.3:0/3858702562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560de904ecd0 msgr2=0x560de9070b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.998+0000 7ffbcb400640 1 --2- 172.21.15.3:0/3858702562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560de904ecd0 0x560de9070b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.998+0000 7ffbcb400640 1 -- 172.21.15.3:0/3858702562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560de904e3b0 msgr2=0x560de9050de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.998+0000 7ffbcb400640 1 --2- 172.21.15.3:0/3858702562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560de904e3b0 0x560de9050de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.998+0000 7ffbcb400640 1 -- 172.21.15.3:0/3858702562 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560de904a1b0 con 0x560de9059570 2024-09-19T06:20:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.998+0000 7ffbcaa00640 1 --2- 172.21.15.3:0/3858702562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560de904e3b0 0x560de9050de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.999+0000 7ffbcb400640 1 --2- 172.21.15.3:0/3858702562 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de9059570 0x560de9071060 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ffbc40123a0 tx=0x7ffbc4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da30d8e61143385 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.999+0000 7ffbb7400640 1 -- 172.21.15.3:0/3858702562 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4003970 con 0x560de9059570 2024-09-19T06:20:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.999+0000 7ffbb7400640 1 -- 172.21.15.3:0/3858702562 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbc4004050 con 0x560de9059570 2024-09-19T06:20:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.999+0000 7ffbb7400640 1 -- 172.21.15.3:0/3858702562 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4011620 con 0x560de9059570 2024-09-19T06:20:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.999+0000 7ffbd4abe740 1 -- 172.21.15.3:0/3858702562 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de9059570 msgr2=0x560de9071060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.999+0000 7ffbd4abe740 1 --2- 172.21.15.3:0/3858702562 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de9059570 0x560de9071060 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ffbc40123a0 tx=0x7ffbc4017000 comp rx=0 tx=0).stop 2024-09-19T06:20:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.999+0000 7ffbd4abe740 1 -- 172.21.15.3:0/3858702562 shutdown_connections 2024-09-19T06:20:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.999+0000 7ffbd4abe740 1 --2- 172.21.15.3:0/3858702562 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de9059570 0x560de9071060 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.999+0000 7ffbd4abe740 1 --2- 172.21.15.3:0/3858702562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560de904ecd0 0x560de9070b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.999+0000 7ffbd4abe740 1 --2- 172.21.15.3:0/3858702562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560de904e3b0 0x560de9050de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:19.999+0000 7ffbd4abe740 1 -- 172.21.15.3:0/3858702562 >> 172.21.15.3:0/3858702562 conn(0x560de904a920 msgr2=0x560de9055640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.000+0000 7ffbd4abe740 1 -- 172.21.15.3:0/3858702562 shutdown_connections 2024-09-19T06:20:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.000+0000 7ffbd4abe740 1 -- 172.21.15.3:0/3858702562 wait complete. 2024-09-19T06:20:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.000+0000 7ffbd4abe740 1 -- start start 2024-09-19T06:20:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.000+0000 7ffbd4abe740 1 Processor -- start 2024-09-19T06:20:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.001+0000 7ffbd4abe740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560de904e3b0 0x560de9061900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.001+0000 7ffbd4abe740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de904ecd0 0x560de905cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.001+0000 7ffbd4abe740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560de9059570 0x560de905d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.001+0000 7ffbd4abe740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc1b0e60 con 0x560de904ecd0 2024-09-19T06:20:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.001+0000 7ffbd4abe740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc1b0790 con 0x560de9059570 2024-09-19T06:20:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.001+0000 7ffbd4abe740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc1ad9f0 con 0x560de904e3b0 2024-09-19T06:20:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.001+0000 7ffbd4abe740 10 client.0 _ll_register_callbacks cb 0x7ffbc4009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.001+0000 7ffbca000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de904ecd0 0x560de905cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.001+0000 7ffbca000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de904ecd0 0x560de905cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44880/0 (socket says 172.21.15.3:44880) 2024-09-19T06:20:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.001+0000 7ffbca000640 1 -- 172.21.15.3:0/1199998344 learned_addr learned my addr 172.21.15.3:0/1199998344 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.001+0000 7ffbcb400640 1 --2- 172.21.15.3:0/1199998344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560de9059570 0x560de905d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.001+0000 7ffbcaa00640 1 --2- 172.21.15.3:0/1199998344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560de904e3b0 0x560de9061900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.001+0000 7ffbca000640 1 -- 172.21.15.3:0/1199998344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560de904e3b0 msgr2=0x560de9061900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.001+0000 7ffbca000640 1 --2- 172.21.15.3:0/1199998344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560de904e3b0 0x560de9061900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.001+0000 7ffbca000640 1 -- 172.21.15.3:0/1199998344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560de9059570 msgr2=0x560de905d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.001+0000 7ffbca000640 1 --2- 172.21.15.3:0/1199998344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560de9059570 0x560de905d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.001+0000 7ffbca000640 1 -- 172.21.15.3:0/1199998344 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560de905d6a0 con 0x560de904ecd0 2024-09-19T06:20:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.001+0000 7ffbcb400640 1 --2- 172.21.15.3:0/1199998344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560de9059570 0x560de905d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.002+0000 7ffbca000640 1 --2- 172.21.15.3:0/1199998344 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de904ecd0 0x560de905cc20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8086010 tx=0x7ffbb80050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf8b5e264f94368 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.002+0000 7ffbb4c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:20:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.002+0000 7ffbb4c00640 1 -- 172.21.15.3:0/1199998344 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb80d5020 con 0x560de904ecd0 2024-09-19T06:20:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.002+0000 7ffbb4c00640 1 -- 172.21.15.3:0/1199998344 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7ffbb8097fe0 con 0x560de904ecd0 2024-09-19T06:20:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.002+0000 7ffbd4abe740 1 -- 172.21.15.3:0/1199998344 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbc4004050 con 0x560de904ecd0 2024-09-19T06:20:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.002+0000 7ffbb4c00640 1 -- 172.21.15.3:0/1199998344 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffbb809c070 con 0x560de904ecd0 2024-09-19T06:20:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.002+0000 7ffbd4abe740 10 client.17502 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:20.008 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.002+0000 7ffbd4abe740 1 -- 172.21.15.3:0/1199998344 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560de90d3850 con 0x560de904ecd0 2024-09-19T06:20:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.002+0000 7ffbb4c00640 1 -- 172.21.15.3:0/1199998344 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbc4004050 con 0x560de904ecd0 2024-09-19T06:20:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.003+0000 7ffbb4c00640 1 -- 172.21.15.3:0/1199998344 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ffbb80b4b70 con 0x560de904ecd0 2024-09-19T06:20:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.003+0000 7ffbd4abe740 10 client.17502 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.003+0000 7ffbd4abe740 10 client.17502 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.003+0000 7ffbd4abe740 20 client.17502 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.003+0000 7ffbd4abe740 1 --2- 172.21.15.3:0/1199998344 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x560de90d3f70 0x560de90d6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.003+0000 7ffbd4abe740 4 client.17502 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:20:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.003+0000 7ffbd4abe740 1 -- 172.21.15.3:0/1199998344 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560de8fbbb80 con 0x560de90d3f70 2024-09-19T06:20:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.003+0000 7ffbcaa00640 1 --2- 172.21.15.3:0/1199998344 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x560de90d3f70 0x560de90d6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.004+0000 7ffbb4c00640 10 client.17502 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:20.009 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.004+0000 7ffbcaa00640 1 --2- 172.21.15.3:0/1199998344 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x560de90d3f70 0x560de90d6360 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dd8ba3b27f2b861 server_cookie=862fe5ebcc824dc2 in_seq=0 out_seq=0 2024-09-19T06:20:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.018+0000 7ffbb4c00640 1 -- 172.21.15.3:0/1199998344 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560de8fbbb80 con 0x560de90d3f70 2024-09-19T06:20:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.018+0000 7ffbb4c00640 10 client.17502 handle_command_reply: tid=0 2024-09-19T06:20:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.018+0000 7ffbd4abe740 1 client.17502 shutdown 2024-09-19T06:20:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.018+0000 7ffbd4abe740 1 -- 172.21.15.3:0/1199998344 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de904ecd0 msgr2=0x560de905cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.018+0000 7ffbd4abe740 1 --2- 172.21.15.3:0/1199998344 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de904ecd0 0x560de905cc20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8086010 tx=0x7ffbb80050b0 comp rx=0 tx=0).stop 2024-09-19T06:20:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.018+0000 7ffbd4abe740 1 -- 172.21.15.3:0/1199998344 shutdown_connections 2024-09-19T06:20:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.018+0000 7ffbd4abe740 1 --2- 172.21.15.3:0/1199998344 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x560de90d3f70 0x560de90d6360 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.018+0000 7ffbd4abe740 1 --2- 172.21.15.3:0/1199998344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560de9059570 0x560de905d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.018+0000 7ffbd4abe740 1 --2- 172.21.15.3:0/1199998344 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560de904ecd0 0x560de905cc20 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.018+0000 7ffbb4c00640 0 client.17502 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.018+0000 7ffbd4abe740 1 --2- 172.21.15.3:0/1199998344 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560de904e3b0 0x560de9061900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.018+0000 7ffbd4abe740 1 -- 172.21.15.3:0/1199998344 >> 172.21.15.3:0/1199998344 conn(0x560de904a920 msgr2=0x560de90491a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.019+0000 7ffbd4abe740 1 -- 172.21.15.3:0/1199998344 shutdown_connections 2024-09-19T06:20:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.019+0000 7ffbd4abe740 1 -- 172.21.15.3:0/1199998344 wait complete. 2024-09-19T06:20:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.019+0000 7ffbd4abe740 20 client.17502 trim_cache size 0 max 16384 2024-09-19T06:20:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:20:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:20:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:20:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:20:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.019+0000 7ffbcbe00640 1 -- 172.21.15.3:0/615314104 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ffbb00a33a0 msgr2=0x7ffbb00a5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.019+0000 7ffbcbe00640 1 --2- 172.21.15.3:0/615314104 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ffbb00a33a0 0x7ffbb00a5860 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4005fd0 tx=0x7ffbc4009500 comp rx=0 tx=0).stop 2024-09-19T06:20:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.019+0000 7ffbcbe00640 1 -- 172.21.15.3:0/615314104 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbcc1022c0 msgr2=0x7ffbcc19a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.019+0000 7ffbcbe00640 1 --2- 172.21.15.3:0/615314104 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbcc1022c0 0x7ffbcc19a9b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ffbb800d950 tx=0x7ffbb800dd50 comp rx=0 tx=0).stop 2024-09-19T06:20:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.020+0000 7ffbcbe00640 1 -- 172.21.15.3:0/615314104 shutdown_connections 2024-09-19T06:20:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.020+0000 7ffbcbe00640 1 --2- 172.21.15.3:0/615314104 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ffbb00a33a0 0x7ffbb00a5860 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.020+0000 7ffbcbe00640 1 --2- 172.21.15.3:0/615314104 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbcc107930 0x7ffbcc19ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.020+0000 7ffbcbe00640 1 --2- 172.21.15.3:0/615314104 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbcc1022c0 0x7ffbcc19a9b0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.020+0000 7ffbcbe00640 1 --2- 172.21.15.3:0/615314104 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbcc101920 0x7ffbcc19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.020+0000 7ffbcbe00640 1 -- 172.21.15.3:0/615314104 >> 172.21.15.3:0/615314104 conn(0x7ffbcc0fd600 msgr2=0x7ffbcc0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.020+0000 7ffbcbe00640 1 -- 172.21.15.3:0/615314104 shutdown_connections 2024-09-19T06:20:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:20.020+0000 7ffbcbe00640 1 -- 172.21.15.3:0/615314104 wait complete. 2024-09-19T06:20:20.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:20 smithi059 ceph-mon[35138]: pgmap v245: 97 pgs: 97 active+clean; 2.2 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:20:20.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:20 smithi003 ceph-mon[30893]: pgmap v245: 97 pgs: 97 active+clean; 2.2 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:20:20.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:20 smithi071 ceph-mon[35662]: pgmap v245: 97 pgs: 97 active+clean; 2.2 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:20:22.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:22 smithi059 ceph-mon[35138]: pgmap v246: 97 pgs: 97 active+clean; 2.2 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:20:22.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:22 smithi003 ceph-mon[30893]: pgmap v246: 97 pgs: 97 active+clean; 2.2 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:20:22.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:22 smithi071 ceph-mon[35662]: pgmap v246: 97 pgs: 97 active+clean; 2.2 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:20:24.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:24 smithi059 ceph-mon[35138]: pgmap v247: 97 pgs: 97 active+clean; 2.2 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 14 op/s 2024-09-19T06:20:24.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:24 smithi003 ceph-mon[30893]: pgmap v247: 97 pgs: 97 active+clean; 2.2 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 14 op/s 2024-09-19T06:20:24.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:24 smithi071 ceph-mon[35662]: pgmap v247: 97 pgs: 97 active+clean; 2.2 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 14 op/s 2024-09-19T06:20:26.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:26 smithi003 ceph-mon[30893]: pgmap v248: 97 pgs: 97 active+clean; 2.4 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 22 op/s 2024-09-19T06:20:26.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:26 smithi071 ceph-mon[35662]: pgmap v248: 97 pgs: 97 active+clean; 2.4 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 22 op/s 2024-09-19T06:20:26.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:26 smithi059 ceph-mon[35138]: pgmap v248: 97 pgs: 97 active+clean; 2.4 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 22 op/s 2024-09-19T06:20:28.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:28 smithi003 ceph-mon[30893]: pgmap v249: 97 pgs: 97 active+clean; 2.4 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:20:28.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:28 smithi071 ceph-mon[35662]: pgmap v249: 97 pgs: 97 active+clean; 2.4 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:20:28.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:28 smithi059 ceph-mon[35138]: pgmap v249: 97 pgs: 97 active+clean; 2.4 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:20:30.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:30 smithi003 ceph-mon[30893]: pgmap v250: 97 pgs: 97 active+clean; 2.6 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 22 op/s 2024-09-19T06:20:30.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:30 smithi071 ceph-mon[35662]: pgmap v250: 97 pgs: 97 active+clean; 2.6 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 22 op/s 2024-09-19T06:20:30.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:30 smithi059 ceph-mon[35138]: pgmap v250: 97 pgs: 97 active+clean; 2.6 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 22 op/s 2024-09-19T06:20:32.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:32 smithi003 ceph-mon[30893]: pgmap v251: 97 pgs: 97 active+clean; 2.6 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:20:32.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:32 smithi071 ceph-mon[35662]: pgmap v251: 97 pgs: 97 active+clean; 2.6 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:20:32.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:32 smithi059 ceph-mon[35138]: pgmap v251: 97 pgs: 97 active+clean; 2.6 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:20:33.145 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.143+0000 7f6643a00640 1 -- 172.21.15.3:0/1780384805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f663c077040 msgr2=0x7f663c112430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:33.145 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.143+0000 7f6643a00640 1 --2- 172.21.15.3:0/1780384805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f663c077040 0x7f663c112430 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6628009860 tx=0x7f662802a340 comp rx=0 tx=0).stop 2024-09-19T06:20:33.145 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.143+0000 7f6643a00640 1 -- 172.21.15.3:0/1780384805 shutdown_connections 2024-09-19T06:20:33.146 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.143+0000 7f6643a00640 1 --2- 172.21.15.3:0/1780384805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663c112970 0x7f663c114d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.146 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.143+0000 7f6643a00640 1 --2- 172.21.15.3:0/1780384805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f663c077040 0x7f663c112430 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.146 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.143+0000 7f6643a00640 1 --2- 172.21.15.3:0/1780384805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f663c076720 0x7f663c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.146 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.143+0000 7f6643a00640 1 -- 172.21.15.3:0/1780384805 >> 172.21.15.3:0/1780384805 conn(0x7f663c0ff970 msgr2=0x7f663c101d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:33.146 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.143+0000 7f6643a00640 1 -- 172.21.15.3:0/1780384805 shutdown_connections 2024-09-19T06:20:33.146 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.143+0000 7f6643a00640 1 -- 172.21.15.3:0/1780384805 wait complete. 2024-09-19T06:20:33.148 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.144+0000 7f6643a00640 1 Processor -- start 2024-09-19T06:20:33.148 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.144+0000 7f6643a00640 1 -- start start 2024-09-19T06:20:33.148 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.145+0000 7f6643a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f663c076720 0x7f663c1a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.148 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.145+0000 7f6643a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663c077040 0x7f663c1a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.148 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.145+0000 7f6643a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f663c112970 0x7f663c19e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.148 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.145+0000 7f6643a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f663c1184c0 con 0x7f663c112970 2024-09-19T06:20:33.148 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.145+0000 7f6643a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f663c118340 con 0x7f663c077040 2024-09-19T06:20:33.148 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.145+0000 7f6643a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f663c118640 con 0x7f663c076720 2024-09-19T06:20:33.149 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.145+0000 7f6641a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f663c112970 0x7f663c19e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.149 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.145+0000 7f6641a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f663c112970 0x7f663c19e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53624/0 (socket says 172.21.15.3:53624) 2024-09-19T06:20:33.149 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.145+0000 7f6641a00640 1 -- 172.21.15.3:0/4131606396 learned_addr learned my addr 172.21.15.3:0/4131606396 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:33.149 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.145+0000 7f6641000640 1 --2- 172.21.15.3:0/4131606396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f663c076720 0x7f663c1a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.149 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.145+0000 7f663be00640 1 --2- 172.21.15.3:0/4131606396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663c077040 0x7f663c1a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.149 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.145+0000 7f6641a00640 1 -- 172.21.15.3:0/4131606396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f663c076720 msgr2=0x7f663c1a4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:33.149 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.145+0000 7f6641a00640 1 --2- 172.21.15.3:0/4131606396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f663c076720 0x7f663c1a4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.149 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.145+0000 7f6641a00640 1 -- 172.21.15.3:0/4131606396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663c077040 msgr2=0x7f663c1a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:33.149 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.145+0000 7f6641a00640 1 --2- 172.21.15.3:0/4131606396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663c077040 0x7f663c1a4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.149 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.146+0000 7f6641a00640 1 -- 172.21.15.3:0/4131606396 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f663c19f060 con 0x7f663c112970 2024-09-19T06:20:33.149 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.146+0000 7f6641a00640 1 --2- 172.21.15.3:0/4131606396 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f663c112970 0x7f663c19e8e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f6634009c90 tx=0x7f663400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:33.149 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.146+0000 7f6639600640 1 -- 172.21.15.3:0/4131606396 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6634003b70 con 0x7f663c112970 2024-09-19T06:20:33.149 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.146+0000 7f6639600640 1 -- 172.21.15.3:0/4131606396 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6634003d10 con 0x7f663c112970 2024-09-19T06:20:33.149 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.146+0000 7f6639600640 1 -- 172.21.15.3:0/4131606396 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66340108d0 con 0x7f663c112970 2024-09-19T06:20:33.149 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.146+0000 7f6643a00640 1 -- 172.21.15.3:0/4131606396 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f663c19f350 con 0x7f663c112970 2024-09-19T06:20:33.150 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.146+0000 7f6643a00640 1 -- 172.21.15.3:0/4131606396 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f663c1ab5f0 con 0x7f663c112970 2024-09-19T06:20:33.151 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.149+0000 7f6646a21740 1 Processor -- start 2024-09-19T06:20:33.151 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.149+0000 7f6639600640 1 -- 172.21.15.3:0/4131606396 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f6634003fe0 con 0x7f663c112970 2024-09-19T06:20:33.152 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.150+0000 7f6646a21740 1 -- start start 2024-09-19T06:20:33.152 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.150+0000 7f6646a21740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560bf18d01e0 0x560bf18d05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.152 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.150+0000 7f6646a21740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560bf18d0b00 0x560bf18dae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.152 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.150+0000 7f6646a21740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18db3a0 0x560bf18dd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.152 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.150+0000 7f6646a21740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560bf1836100 con 0x560bf18db3a0 2024-09-19T06:20:33.152 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.150+0000 7f6646a21740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560bf17de1b0 con 0x560bf18d01e0 2024-09-19T06:20:33.152 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.150+0000 7f6646a21740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560bf18320c0 con 0x560bf18d0b00 2024-09-19T06:20:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.150+0000 7f6641000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560bf18d0b00 0x560bf18dae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.150+0000 7f663be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560bf18d01e0 0x560bf18d05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.150+0000 7f6641000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560bf18d0b00 0x560bf18dae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:53004/0 (socket says 172.21.15.3:53004) 2024-09-19T06:20:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.150+0000 7f6641000640 1 -- 172.21.15.3:0/164239713 learned_addr learned my addr 172.21.15.3:0/164239713 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.151+0000 7f663be00640 1 --2- 172.21.15.3:0/164239713 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18db3a0 0x560bf18dd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.151+0000 7f6641000640 1 -- 172.21.15.3:0/164239713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560bf18d01e0 msgr2=0x560bf18d05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:33.155 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.151+0000 7f6641000640 1 --2- 172.21.15.3:0/164239713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560bf18d01e0 0x560bf18d05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.155 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.151+0000 7f6641000640 1 -- 172.21.15.3:0/164239713 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18db3a0 msgr2=0x560bf18dd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:33.155 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.151+0000 7f6641000640 1 --2- 172.21.15.3:0/164239713 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18db3a0 0x560bf18dd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.155 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.151+0000 7f6641000640 1 -- 172.21.15.3:0/164239713 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bf1549210 con 0x560bf18d0b00 2024-09-19T06:20:33.155 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.151+0000 7f6641000640 1 --2- 172.21.15.3:0/164239713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560bf18d0b00 0x560bf18dae60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6630009c90 tx=0x7f6630011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9283082de7124920 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:33.155 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.151+0000 7f6639600640 1 --2- 172.21.15.3:0/4131606396 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f66240a3430 0x7f66240a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.155 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.151+0000 7f662e000640 1 -- 172.21.15.3:0/164239713 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6630004230 con 0x560bf18d0b00 2024-09-19T06:20:33.155 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.151+0000 7f662e000640 1 -- 172.21.15.3:0/164239713 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66300043d0 con 0x560bf18d0b00 2024-09-19T06:20:33.155 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.151+0000 7f662e000640 1 -- 172.21.15.3:0/164239713 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6630019880 con 0x560bf18d0b00 2024-09-19T06:20:33.155 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.151+0000 7f6639600640 1 -- 172.21.15.3:0/4131606396 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f66340d0280 con 0x7f663c112970 2024-09-19T06:20:33.155 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.152+0000 7f663be00640 1 --2- 172.21.15.3:0/4131606396 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f66240a3430 0x7f66240a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.155 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.152+0000 7f6646a21740 1 -- 172.21.15.3:0/164239713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560bf18d0b00 msgr2=0x560bf18dae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:33.155 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.152+0000 7f6646a21740 1 --2- 172.21.15.3:0/164239713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560bf18d0b00 0x560bf18dae60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6630009c90 tx=0x7f6630011810 comp rx=0 tx=0).stop 2024-09-19T06:20:33.155 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.152+0000 7f6646a21740 1 -- 172.21.15.3:0/164239713 shutdown_connections 2024-09-19T06:20:33.156 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.152+0000 7f6646a21740 1 --2- 172.21.15.3:0/164239713 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18db3a0 0x560bf18dd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.156 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.152+0000 7f6646a21740 1 --2- 172.21.15.3:0/164239713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560bf18d0b00 0x560bf18dae60 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.156 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.152+0000 7f6646a21740 1 --2- 172.21.15.3:0/164239713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560bf18d01e0 0x560bf18d05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.156 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.152+0000 7f6646a21740 1 -- 172.21.15.3:0/164239713 >> 172.21.15.3:0/164239713 conn(0x560bf18cc750 msgr2=0x560bf18ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:33.156 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.152+0000 7f663be00640 1 --2- 172.21.15.3:0/4131606396 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f66240a3430 0x7f66240a58f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f662802a930 tx=0x7f66280058d0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:33.156 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.152+0000 7f6646a21740 1 -- 172.21.15.3:0/164239713 shutdown_connections 2024-09-19T06:20:33.156 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.152+0000 7f6646a21740 1 -- 172.21.15.3:0/164239713 wait complete. 2024-09-19T06:20:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.153+0000 7f6646a21740 1 -- start start 2024-09-19T06:20:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.153+0000 7f6646a21740 1 Processor -- start 2024-09-19T06:20:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.153+0000 7f6646a21740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18d01e0 0x560bf18d82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.153+0000 7f6646a21740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560bf18d0b00 0x560bf18d8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.153+0000 7f6646a21740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560bf18db3a0 0x560bf18d8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.153+0000 7f6646a21740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560bf18ddf70 con 0x560bf18d01e0 2024-09-19T06:20:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.153+0000 7f6646a21740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560bf17bf090 con 0x560bf18db3a0 2024-09-19T06:20:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.153+0000 7f6646a21740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560bf18de0f0 con 0x560bf18d0b00 2024-09-19T06:20:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.153+0000 7f6646a21740 10 client.0 _ll_register_callbacks cb 0x560bf1813f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.154+0000 7f6641000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18d01e0 0x560bf18d82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.154+0000 7f6641a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560bf18db3a0 0x560bf18d8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.154+0000 7f6641000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18d01e0 0x560bf18d82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53650/0 (socket says 172.21.15.3:53650) 2024-09-19T06:20:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.154+0000 7f6641000640 1 -- 172.21.15.3:0/2033508632 learned_addr learned my addr 172.21.15.3:0/2033508632 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.154+0000 7f663be00640 1 --2- 172.21.15.3:0/2033508632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560bf18d0b00 0x560bf18d8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.154+0000 7f6641a00640 1 -- 172.21.15.3:0/2033508632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560bf18d0b00 msgr2=0x560bf18d8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.154+0000 7f6641a00640 1 --2- 172.21.15.3:0/2033508632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560bf18d0b00 0x560bf18d8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.154+0000 7f6641a00640 1 -- 172.21.15.3:0/2033508632 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18d01e0 msgr2=0x560bf18d82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.154+0000 7f6641a00640 1 --2- 172.21.15.3:0/2033508632 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18d01e0 0x560bf18d82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.154+0000 7f6641a00640 1 -- 172.21.15.3:0/2033508632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bf1615620 con 0x560bf18db3a0 2024-09-19T06:20:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.154+0000 7f663be00640 1 --2- 172.21.15.3:0/2033508632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560bf18d0b00 0x560bf18d8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.154+0000 7f6641a00640 1 --2- 172.21.15.3:0/2033508632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560bf18db3a0 0x560bf18d8d70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f66340cd940 tx=0x7f663409c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=970d8fbb1a7aa38a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.154+0000 7f6622a00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:20:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.154+0000 7f6622a00640 1 -- 172.21.15.3:0/2033508632 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66340b4020 con 0x560bf18db3a0 2024-09-19T06:20:33.161 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.154+0000 7f6646a21740 1 -- 172.21.15.3:0/2033508632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66300043d0 con 0x560bf18db3a0 2024-09-19T06:20:33.162 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.155+0000 7f6622a00640 1 -- 172.21.15.3:0/2033508632 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f66340b5450 con 0x560bf18db3a0 2024-09-19T06:20:33.162 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.155+0000 7f6622a00640 1 -- 172.21.15.3:0/2033508632 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f663409c4d0 con 0x560bf18db3a0 2024-09-19T06:20:33.162 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.155+0000 7f6646a21740 10 client.27551 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:33.162 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.155+0000 7f6646a21740 1 -- 172.21.15.3:0/2033508632 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560bf18e9b90 con 0x560bf18db3a0 2024-09-19T06:20:33.162 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.155+0000 7f6622a00640 1 -- 172.21.15.3:0/2033508632 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f663407e080 con 0x560bf18db3a0 2024-09-19T06:20:33.162 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.155+0000 7f6622a00640 1 -- 172.21.15.3:0/2033508632 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f663409b920 con 0x560bf18db3a0 2024-09-19T06:20:33.162 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.155+0000 7f6646a21740 10 client.27551 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:33.162 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.155+0000 7f6646a21740 10 client.27551 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:33.162 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.155+0000 7f6646a21740 20 client.27551 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:33.162 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.155+0000 7f6646a21740 1 --2- 172.21.15.3:0/2033508632 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x560bf18eb000 0x560bf18ed3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.162 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.155+0000 7f6646a21740 4 client.27551 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:33.162 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.155+0000 7f6646a21740 1 -- 172.21.15.3:0/2033508632 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560bf1843830 con 0x560bf18eb000 2024-09-19T06:20:33.162 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.156+0000 7f6641000640 1 --2- 172.21.15.3:0/2033508632 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x560bf18eb000 0x560bf18ed3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.162 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.156+0000 7f6641000640 1 --2- 172.21.15.3:0/2033508632 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x560bf18eb000 0x560bf18ed3f0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4696100531947f72 server_cookie=9053f5b52f0304e8 in_seq=0 out_seq=0 2024-09-19T06:20:33.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.156+0000 7f6622a00640 10 client.27551 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:33.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.157+0000 7f6622a00640 1 -- 172.21.15.3:0/2033508632 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560bf1843830 con 0x560bf18eb000 2024-09-19T06:20:33.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.157+0000 7f6622a00640 10 client.27551 handle_command_reply: tid=0 2024-09-19T06:20:33.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.157+0000 7f6646a21740 1 client.27551 shutdown 2024-09-19T06:20:33.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.157+0000 7f6646a21740 1 -- 172.21.15.3:0/2033508632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560bf18db3a0 msgr2=0x560bf18d8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:33.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.157+0000 7f6646a21740 1 --2- 172.21.15.3:0/2033508632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560bf18db3a0 0x560bf18d8d70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f66340cd940 tx=0x7f663409c390 comp rx=0 tx=0).stop 2024-09-19T06:20:33.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.157+0000 7f6646a21740 1 -- 172.21.15.3:0/2033508632 shutdown_connections 2024-09-19T06:20:33.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.157+0000 7f6646a21740 1 --2- 172.21.15.3:0/2033508632 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x560bf18eb000 0x560bf18ed3f0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.157+0000 7f6646a21740 1 --2- 172.21.15.3:0/2033508632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560bf18db3a0 0x560bf18d8d70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.157+0000 7f6646a21740 1 --2- 172.21.15.3:0/2033508632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560bf18d0b00 0x560bf18d8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.157+0000 7f6622a00640 0 client.27551 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:33.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.157+0000 7f6646a21740 1 --2- 172.21.15.3:0/2033508632 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18d01e0 0x560bf18d82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.157+0000 7f6646a21740 1 -- 172.21.15.3:0/2033508632 >> 172.21.15.3:0/2033508632 conn(0x560bf18cc750 msgr2=0x560bf18d2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:33.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.157+0000 7f6646a21740 1 -- 172.21.15.3:0/2033508632 shutdown_connections 2024-09-19T06:20:33.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.157+0000 7f6646a21740 1 -- 172.21.15.3:0/2033508632 wait complete. 2024-09-19T06:20:33.164 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.158+0000 7f6646a21740 20 client.27551 trim_cache size 0 max 16384 2024-09-19T06:20:33.175 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.172+0000 7f6646a21740 1 Processor -- start 2024-09-19T06:20:33.175 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.173+0000 7f6646a21740 1 -- start start 2024-09-19T06:20:33.175 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.173+0000 7f6646a21740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560bf18d01e0 0x560bf18da150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.175 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.173+0000 7f6646a21740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560bf18d0b00 0x560bf18f2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.176 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.173+0000 7f6646a21740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18db3a0 0x560bf18f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.176 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.173+0000 7f6646a21740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f663c1b3f50 con 0x560bf18db3a0 2024-09-19T06:20:33.176 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.173+0000 7f6646a21740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f663c1b5a90 con 0x560bf18d0b00 2024-09-19T06:20:33.176 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.173+0000 7f6646a21740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f663c1b4620 con 0x560bf18d01e0 2024-09-19T06:20:33.176 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.173+0000 7f6641a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18db3a0 0x560bf18f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.176 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.173+0000 7f6641a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18db3a0 0x560bf18f31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53666/0 (socket says 172.21.15.3:53666) 2024-09-19T06:20:33.176 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.173+0000 7f6641a00640 1 -- 172.21.15.3:0/1100989182 learned_addr learned my addr 172.21.15.3:0/1100989182 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:33.176 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.173+0000 7f663be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560bf18d0b00 0x560bf18f2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.176 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.173+0000 7f6641000640 1 --2- 172.21.15.3:0/1100989182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560bf18d01e0 0x560bf18da150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.176 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.173+0000 7f6641a00640 1 -- 172.21.15.3:0/1100989182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560bf18d01e0 msgr2=0x560bf18da150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:33.176 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.174+0000 7f6641a00640 1 --2- 172.21.15.3:0/1100989182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560bf18d01e0 0x560bf18da150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.176 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.174+0000 7f6641a00640 1 -- 172.21.15.3:0/1100989182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560bf18d0b00 msgr2=0x560bf18f2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:33.177 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.174+0000 7f6641a00640 1 --2- 172.21.15.3:0/1100989182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560bf18d0b00 0x560bf18f2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.177 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.174+0000 7f6641a00640 1 -- 172.21.15.3:0/1100989182 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bf18eda20 con 0x560bf18db3a0 2024-09-19T06:20:33.177 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.174+0000 7f6641a00640 1 --2- 172.21.15.3:0/1100989182 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18db3a0 0x560bf18f31f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f663400cba0 tx=0x7f66340d01b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648a941479d6facd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:33.180 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.174+0000 7f662d600640 1 -- 172.21.15.3:0/1100989182 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66340b4070 con 0x560bf18db3a0 2024-09-19T06:20:33.180 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.174+0000 7f662d600640 1 -- 172.21.15.3:0/1100989182 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66300043d0 con 0x560bf18db3a0 2024-09-19T06:20:33.180 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.174+0000 7f662d600640 1 -- 172.21.15.3:0/1100989182 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663409b920 con 0x560bf18db3a0 2024-09-19T06:20:33.181 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.175+0000 7f6646a21740 1 -- 172.21.15.3:0/1100989182 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18db3a0 msgr2=0x560bf18f31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:33.181 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.175+0000 7f6646a21740 1 --2- 172.21.15.3:0/1100989182 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18db3a0 0x560bf18f31f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f663400cba0 tx=0x7f66340d01b0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.181 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.175+0000 7f6646a21740 1 -- 172.21.15.3:0/1100989182 shutdown_connections 2024-09-19T06:20:33.181 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.175+0000 7f6646a21740 1 --2- 172.21.15.3:0/1100989182 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18db3a0 0x560bf18f31f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.181 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.175+0000 7f6646a21740 1 --2- 172.21.15.3:0/1100989182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560bf18d0b00 0x560bf18f2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.181 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.175+0000 7f6646a21740 1 --2- 172.21.15.3:0/1100989182 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560bf18d01e0 0x560bf18da150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.181 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.175+0000 7f6646a21740 1 -- 172.21.15.3:0/1100989182 >> 172.21.15.3:0/1100989182 conn(0x560bf18cc750 msgr2=0x560bf18d9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:33.181 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.175+0000 7f6646a21740 1 -- 172.21.15.3:0/1100989182 shutdown_connections 2024-09-19T06:20:33.181 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.175+0000 7f6646a21740 1 -- 172.21.15.3:0/1100989182 wait complete. 2024-09-19T06:20:33.181 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.175+0000 7f6646a21740 1 -- start start 2024-09-19T06:20:33.181 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.175+0000 7f6646a21740 1 Processor -- start 2024-09-19T06:20:33.181 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.176+0000 7f6646a21740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18d01e0 0x560bf18e38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.181 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.176+0000 7f6646a21740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560bf18d0b00 0x560bf18dec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.182 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.176+0000 7f6646a21740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560bf18db3a0 0x560bf18df140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.182 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.176+0000 7f6646a21740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f663c1b53c0 con 0x560bf18d01e0 2024-09-19T06:20:33.182 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.176+0000 7f6646a21740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f663c1b4cf0 con 0x560bf18db3a0 2024-09-19T06:20:33.182 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.176+0000 7f6646a21740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f663c1b1f50 con 0x560bf18d0b00 2024-09-19T06:20:33.182 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.176+0000 7f6646a21740 10 client.0 _ll_register_callbacks cb 0x7f6634004800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:33.182 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.176+0000 7f6641000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18d01e0 0x560bf18e38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.182 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.176+0000 7f6641000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18d01e0 0x560bf18e38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53670/0 (socket says 172.21.15.3:53670) 2024-09-19T06:20:33.182 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.176+0000 7f6641000640 1 -- 172.21.15.3:0/4130288432 learned_addr learned my addr 172.21.15.3:0/4130288432 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:33.182 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.176+0000 7f663be00640 1 --2- 172.21.15.3:0/4130288432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560bf18d0b00 0x560bf18dec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.182 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.176+0000 7f6641a00640 1 --2- 172.21.15.3:0/4130288432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560bf18db3a0 0x560bf18df140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.182 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.176+0000 7f6641000640 1 -- 172.21.15.3:0/4130288432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560bf18d0b00 msgr2=0x560bf18dec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:33.182 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.176+0000 7f6641000640 1 --2- 172.21.15.3:0/4130288432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560bf18d0b00 0x560bf18dec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.182 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.176+0000 7f6641000640 1 -- 172.21.15.3:0/4130288432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560bf18db3a0 msgr2=0x560bf18df140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:33.182 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.176+0000 7f6641000640 1 --2- 172.21.15.3:0/4130288432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560bf18db3a0 0x560bf18df140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.182 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.176+0000 7f6641000640 1 -- 172.21.15.3:0/4130288432 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bf18c7d60 con 0x560bf18d01e0 2024-09-19T06:20:33.183 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.177+0000 7f6641000640 1 --2- 172.21.15.3:0/4130288432 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18d01e0 0x560bf18e38e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6630009660 tx=0x7f66300193e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6cf68861a742527 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:33.183 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.177+0000 7f6622a00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:20:33.183 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.177+0000 7f6622a00640 1 -- 172.21.15.3:0/4130288432 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663001f040 con 0x560bf18d01e0 2024-09-19T06:20:33.183 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.177+0000 7f6622a00640 1 -- 172.21.15.3:0/4130288432 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f6630004180 con 0x560bf18d01e0 2024-09-19T06:20:33.183 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.177+0000 7f6646a21740 1 -- 172.21.15.3:0/4130288432 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66300043d0 con 0x560bf18d01e0 2024-09-19T06:20:33.183 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.177+0000 7f6622a00640 1 -- 172.21.15.3:0/4130288432 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f663003a050 con 0x560bf18d01e0 2024-09-19T06:20:33.183 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.177+0000 7f6646a21740 10 client.17520 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:33.183 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.177+0000 7f6646a21740 1 -- 172.21.15.3:0/4130288432 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560bf1955a20 con 0x560bf18d01e0 2024-09-19T06:20:33.183 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.178+0000 7f6622a00640 1 -- 172.21.15.3:0/4130288432 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66300043d0 con 0x560bf18d01e0 2024-09-19T06:20:33.183 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.178+0000 7f6622a00640 1 -- 172.21.15.3:0/4130288432 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6630018070 con 0x560bf18d01e0 2024-09-19T06:20:33.183 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.178+0000 7f6646a21740 10 client.17520 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:33.183 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.178+0000 7f6646a21740 10 client.17520 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:33.183 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.178+0000 7f6646a21740 20 client.17520 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:33.183 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.178+0000 7f6646a21740 1 --2- 172.21.15.3:0/4130288432 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x560bf1956000 0x560bf19583f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:33.183 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.178+0000 7f6646a21740 4 client.17520 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:20:33.184 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.178+0000 7f6646a21740 1 -- 172.21.15.3:0/4130288432 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560bf183db80 con 0x560bf1956000 2024-09-19T06:20:33.184 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.178+0000 7f663be00640 1 --2- 172.21.15.3:0/4130288432 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x560bf1956000 0x560bf19583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:33.184 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.179+0000 7f663be00640 1 --2- 172.21.15.3:0/4130288432 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x560bf1956000 0x560bf19583f0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98d33967c371385e server_cookie=c434d2983f0c01af in_seq=0 out_seq=0 2024-09-19T06:20:33.184 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.179+0000 7f6622a00640 10 client.17520 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.194+0000 7f6622a00640 1 -- 172.21.15.3:0/4130288432 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560bf183db80 con 0x560bf1956000 2024-09-19T06:20:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.194+0000 7f6622a00640 10 client.17520 handle_command_reply: tid=0 2024-09-19T06:20:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.194+0000 7f6646a21740 1 client.17520 shutdown 2024-09-19T06:20:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.194+0000 7f6646a21740 1 -- 172.21.15.3:0/4130288432 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18d01e0 msgr2=0x560bf18e38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.194+0000 7f6646a21740 1 --2- 172.21.15.3:0/4130288432 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18d01e0 0x560bf18e38e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6630009660 tx=0x7f66300193e0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.194+0000 7f6646a21740 1 -- 172.21.15.3:0/4130288432 shutdown_connections 2024-09-19T06:20:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.194+0000 7f6646a21740 1 --2- 172.21.15.3:0/4130288432 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x560bf1956000 0x560bf19583f0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.194+0000 7f6646a21740 1 --2- 172.21.15.3:0/4130288432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560bf18db3a0 0x560bf18df140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.194+0000 7f6646a21740 1 --2- 172.21.15.3:0/4130288432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560bf18d0b00 0x560bf18dec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.194+0000 7f6622a00640 0 client.17520 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.194+0000 7f6646a21740 1 --2- 172.21.15.3:0/4130288432 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560bf18d01e0 0x560bf18e38e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.194+0000 7f6646a21740 1 -- 172.21.15.3:0/4130288432 >> 172.21.15.3:0/4130288432 conn(0x560bf18cc750 msgr2=0x560bf18cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.194+0000 7f6646a21740 1 -- 172.21.15.3:0/4130288432 shutdown_connections 2024-09-19T06:20:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.194+0000 7f6646a21740 1 -- 172.21.15.3:0/4130288432 wait complete. 2024-09-19T06:20:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.194+0000 7f6646a21740 20 client.17520 trim_cache size 0 max 16384 2024-09-19T06:20:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:20:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:20:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:20:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:20:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.195+0000 7f6643a00640 1 -- 172.21.15.3:0/4131606396 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f66240a3430 msgr2=0x7f66240a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.195+0000 7f6643a00640 1 --2- 172.21.15.3:0/4131606396 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f66240a3430 0x7f66240a58f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f662802a930 tx=0x7f66280058d0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.195+0000 7f6643a00640 1 -- 172.21.15.3:0/4131606396 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f663c112970 msgr2=0x7f663c19e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.195+0000 7f6643a00640 1 --2- 172.21.15.3:0/4131606396 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f663c112970 0x7f663c19e8e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f6634009c90 tx=0x7f663400c6a0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.195+0000 7f6643a00640 1 -- 172.21.15.3:0/4131606396 shutdown_connections 2024-09-19T06:20:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.195+0000 7f6643a00640 1 --2- 172.21.15.3:0/4131606396 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f66240a3430 0x7f66240a58f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.195+0000 7f6643a00640 1 --2- 172.21.15.3:0/4131606396 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f663c112970 0x7f663c19e8e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.195+0000 7f6643a00640 1 --2- 172.21.15.3:0/4131606396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663c077040 0x7f663c1a4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.195+0000 7f6643a00640 1 --2- 172.21.15.3:0/4131606396 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f663c076720 0x7f663c1a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.195+0000 7f6643a00640 1 -- 172.21.15.3:0/4131606396 >> 172.21.15.3:0/4131606396 conn(0x7f663c0ff970 msgr2=0x7f663c101d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.195+0000 7f6643a00640 1 -- 172.21.15.3:0/4131606396 shutdown_connections 2024-09-19T06:20:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:33.195+0000 7f6643a00640 1 -- 172.21.15.3:0/4131606396 wait complete. 2024-09-19T06:20:33.658 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:20:34.046 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:34.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:34 smithi003 ceph-mon[30893]: pgmap v252: 97 pgs: 97 active+clean; 2.6 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:20:34.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:34 smithi071 ceph-mon[35662]: pgmap v252: 97 pgs: 97 active+clean; 2.6 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:20:34.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:34 smithi059 ceph-mon[35138]: pgmap v252: 97 pgs: 97 active+clean; 2.6 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:20:34.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.609+0000 7fc182000640 1 -- 172.21.15.3:0/3499381646 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc17c0745c0 msgr2=0x7fc17c0749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:34.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.609+0000 7fc182000640 1 --2- 172.21.15.3:0/3499381646 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc17c0745c0 0x7fc17c0749a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009900 tx=0x7fc16c02a480 comp rx=0 tx=0).stop 2024-09-19T06:20:34.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.609+0000 7fc182000640 1 -- 172.21.15.3:0/3499381646 shutdown_connections 2024-09-19T06:20:34.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.609+0000 7fc182000640 1 --2- 172.21.15.3:0/3499381646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17c10e430 0x7fc17c110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.609+0000 7fc182000640 1 --2- 172.21.15.3:0/3499381646 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc17c074ee0 0x7fc17c10def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.609+0000 7fc182000640 1 --2- 172.21.15.3:0/3499381646 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc17c0745c0 0x7fc17c0749a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.609+0000 7fc182000640 1 -- 172.21.15.3:0/3499381646 >> 172.21.15.3:0/3499381646 conn(0x7fc17c0fd8b0 msgr2=0x7fc17c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:34.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.609+0000 7fc182000640 1 -- 172.21.15.3:0/3499381646 shutdown_connections 2024-09-19T06:20:34.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.609+0000 7fc182000640 1 -- 172.21.15.3:0/3499381646 wait complete. 2024-09-19T06:20:34.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.610+0000 7fc182000640 1 Processor -- start 2024-09-19T06:20:34.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.610+0000 7fc182000640 1 -- start start 2024-09-19T06:20:34.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.611+0000 7fc182000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc17c0745c0 0x7fc17c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:34.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.611+0000 7fc182000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17c074ee0 0x7fc17c19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:34.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.611+0000 7fc182000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc17c10e430 0x7fc17c19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:34.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.611+0000 7fc182000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c1141d0 con 0x7fc17c0745c0 2024-09-19T06:20:34.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.611+0000 7fc182000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c114050 con 0x7fc17c074ee0 2024-09-19T06:20:34.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.611+0000 7fc182000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c114350 con 0x7fc17c10e430 2024-09-19T06:20:34.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.611+0000 7fc17b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc17c0745c0 0x7fc17c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:34.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.611+0000 7fc17b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc17c0745c0 0x7fc17c19a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60072/0 (socket says 172.21.15.3:60072) 2024-09-19T06:20:34.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.611+0000 7fc17b400640 1 -- 172.21.15.3:0/3860224616 learned_addr learned my addr 172.21.15.3:0/3860224616 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:34.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.611+0000 7fc17aa00640 1 --2- 172.21.15.3:0/3860224616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17c074ee0 0x7fc17c19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:34.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.611+0000 7fc17be00640 1 --2- 172.21.15.3:0/3860224616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc17c10e430 0x7fc17c19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:34.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.612+0000 7fc17b400640 1 -- 172.21.15.3:0/3860224616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc17c10e430 msgr2=0x7fc17c19ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:34.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.612+0000 7fc17b400640 1 --2- 172.21.15.3:0/3860224616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc17c10e430 0x7fc17c19ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.612+0000 7fc17b400640 1 -- 172.21.15.3:0/3860224616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17c074ee0 msgr2=0x7fc17c19ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:34.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.612+0000 7fc17b400640 1 --2- 172.21.15.3:0/3860224616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17c074ee0 0x7fc17c19ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.612+0000 7fc17b400640 1 -- 172.21.15.3:0/3860224616 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17c19f600 con 0x7fc17c0745c0 2024-09-19T06:20:34.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.612+0000 7fc17b400640 1 --2- 172.21.15.3:0/3860224616 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc17c0745c0 0x7fc17c19a650 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc16c004770 tx=0x7fc16c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:34.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.612+0000 7fc173e00640 1 -- 172.21.15.3:0/3860224616 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c03f070 con 0x7fc17c0745c0 2024-09-19T06:20:34.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.612+0000 7fc173e00640 1 -- 172.21.15.3:0/3860224616 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc16c031ca0 con 0x7fc17c0745c0 2024-09-19T06:20:34.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.612+0000 7fc182000640 1 -- 172.21.15.3:0/3860224616 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc17c19f890 con 0x7fc17c0745c0 2024-09-19T06:20:34.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.612+0000 7fc173e00640 1 -- 172.21.15.3:0/3860224616 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c035030 con 0x7fc17c0745c0 2024-09-19T06:20:34.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.613+0000 7fc182000640 1 -- 172.21.15.3:0/3860224616 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc17c1a71d0 con 0x7fc17c0745c0 2024-09-19T06:20:34.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.616+0000 7fc173e00640 1 -- 172.21.15.3:0/3860224616 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fc16c042070 con 0x7fc17c0745c0 2024-09-19T06:20:34.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.616+0000 7fc184acd740 1 Processor -- start 2024-09-19T06:20:34.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.616+0000 7fc184acd740 1 -- start start 2024-09-19T06:20:34.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.616+0000 7fc184acd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a59f4ab90 0x559a59f4af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:34.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.616+0000 7fc184acd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f4b4b0 0x559a59f55830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:34.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.616+0000 7fc184acd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a59f55d70 0x559a59f58160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:34.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.616+0000 7fc184acd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x559a59eb13e0 con 0x559a59f4b4b0 2024-09-19T06:20:34.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.616+0000 7fc184acd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559a59e58d80 con 0x559a59f4ab90 2024-09-19T06:20:34.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.616+0000 7fc184acd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559a59ead3a0 con 0x559a59f55d70 2024-09-19T06:20:34.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.616+0000 7fc17b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f4b4b0 0x559a59f55830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:34.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.617+0000 7fc17be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a59f4ab90 0x559a59f4af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:34.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.617+0000 7fc17be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a59f4ab90 0x559a59f4af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:45972/0 (socket says 172.21.15.3:45972) 2024-09-19T06:20:34.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.617+0000 7fc17b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f4b4b0 0x559a59f55830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60082/0 (socket says 172.21.15.3:60082) 2024-09-19T06:20:34.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.617+0000 7fc17be00640 1 -- 172.21.15.3:0/3268882073 learned_addr learned my addr 172.21.15.3:0/3268882073 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:34.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.617+0000 7fc17aa00640 1 --2- 172.21.15.3:0/3268882073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a59f55d70 0x559a59f58160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:34.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.617+0000 7fc17be00640 1 -- 172.21.15.3:0/3268882073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a59f55d70 msgr2=0x559a59f58160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:34.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.617+0000 7fc17be00640 1 --2- 172.21.15.3:0/3268882073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a59f55d70 0x559a59f58160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.617+0000 7fc17be00640 1 -- 172.21.15.3:0/3268882073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f4b4b0 msgr2=0x559a59f55830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:34.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.617+0000 7fc17be00640 1 --2- 172.21.15.3:0/3268882073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f4b4b0 0x559a59f55830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.617+0000 7fc17be00640 1 -- 172.21.15.3:0/3268882073 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a59e77ae0 con 0x559a59f4ab90 2024-09-19T06:20:34.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.617+0000 7fc17be00640 1 --2- 172.21.15.3:0/3268882073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a59f4ab90 0x559a59f4af70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc174007e60 tx=0x7fc17400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c927a8177086f5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:34.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.618+0000 7fc173e00640 1 --2- 172.21.15.3:0/3860224616 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc1600a33b0 0x7fc1600a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:34.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.618+0000 7fc167e00640 1 -- 172.21.15.3:0/3268882073 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc174010840 con 0x559a59f4ab90 2024-09-19T06:20:34.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.618+0000 7fc167e00640 1 -- 172.21.15.3:0/3268882073 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1740183f0 con 0x559a59f4ab90 2024-09-19T06:20:34.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.618+0000 7fc167e00640 1 -- 172.21.15.3:0/3268882073 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc174017600 con 0x559a59f4ab90 2024-09-19T06:20:34.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.618+0000 7fc17b400640 1 --2- 172.21.15.3:0/3860224616 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc1600a33b0 0x7fc1600a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:34.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.618+0000 7fc173e00640 1 -- 172.21.15.3:0/3860224616 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7fc16c0f0180 con 0x7fc17c0745c0 2024-09-19T06:20:34.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.619+0000 7fc184acd740 1 -- 172.21.15.3:0/3268882073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a59f4ab90 msgr2=0x559a59f4af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:34.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.619+0000 7fc17b400640 1 --2- 172.21.15.3:0/3860224616 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc1600a33b0 0x7fc1600a5870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x559a59f47f80 tx=0x7fc16c0f3c30 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:34.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.619+0000 7fc184acd740 1 --2- 172.21.15.3:0/3268882073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a59f4ab90 0x559a59f4af70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc174007e60 tx=0x7fc17400f790 comp rx=0 tx=0).stop 2024-09-19T06:20:34.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.619+0000 7fc184acd740 1 -- 172.21.15.3:0/3268882073 shutdown_connections 2024-09-19T06:20:34.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.619+0000 7fc184acd740 1 --2- 172.21.15.3:0/3268882073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a59f55d70 0x559a59f58160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.619+0000 7fc184acd740 1 --2- 172.21.15.3:0/3268882073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f4b4b0 0x559a59f55830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.619+0000 7fc184acd740 1 --2- 172.21.15.3:0/3268882073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a59f4ab90 0x559a59f4af70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.619+0000 7fc184acd740 1 -- 172.21.15.3:0/3268882073 >> 172.21.15.3:0/3268882073 conn(0x559a59f47120 msgr2=0x559a59f47500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:34.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.619+0000 7fc184acd740 1 -- 172.21.15.3:0/3268882073 shutdown_connections 2024-09-19T06:20:34.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.619+0000 7fc184acd740 1 -- 172.21.15.3:0/3268882073 wait complete. 2024-09-19T06:20:34.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.619+0000 7fc184acd740 1 -- start start 2024-09-19T06:20:34.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.620+0000 7fc184acd740 1 Processor -- start 2024-09-19T06:20:34.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.620+0000 7fc184acd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a59f4ab90 0x559a59f52cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:34.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.620+0000 7fc184acd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f4b4b0 0x559a59f53210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:34.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.620+0000 7fc184acd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a59f55d70 0x559a59f53750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:34.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.620+0000 7fc184acd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x559a59f589e0 con 0x559a59f4b4b0 2024-09-19T06:20:34.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.620+0000 7fc184acd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559a59e6c0f0 con 0x559a59f55d70 2024-09-19T06:20:34.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.620+0000 7fc184acd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559a59f58b60 con 0x559a59f4ab90 2024-09-19T06:20:34.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.620+0000 7fc184acd740 10 client.0 _ll_register_callbacks cb 0x559a59e5d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:34.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.620+0000 7fc17aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f4b4b0 0x559a59f53210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:34.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.621+0000 7fc17aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f4b4b0 0x559a59f53210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60088/0 (socket says 172.21.15.3:60088) 2024-09-19T06:20:34.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.621+0000 7fc17aa00640 1 -- 172.21.15.3:0/421415707 learned_addr learned my addr 172.21.15.3:0/421415707 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:34.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.621+0000 7fc17be00640 1 --2- 172.21.15.3:0/421415707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a59f55d70 0x559a59f53750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:34.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.621+0000 7fc17be00640 1 --2- 172.21.15.3:0/421415707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a59f4ab90 0x559a59f52cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:34.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.621+0000 7fc17aa00640 1 -- 172.21.15.3:0/421415707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a59f4ab90 msgr2=0x559a59f52cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:34.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.621+0000 7fc17aa00640 1 --2- 172.21.15.3:0/421415707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a59f4ab90 0x559a59f52cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.621+0000 7fc17aa00640 1 -- 172.21.15.3:0/421415707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a59f55d70 msgr2=0x559a59f53750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:34.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.621+0000 7fc17aa00640 1 --2- 172.21.15.3:0/421415707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a59f55d70 0x559a59f53750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.621+0000 7fc17aa00640 1 -- 172.21.15.3:0/421415707 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a59c223c0 con 0x559a59f4b4b0 2024-09-19T06:20:34.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.621+0000 7fc17aa00640 1 --2- 172.21.15.3:0/421415707 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f4b4b0 0x559a59f53210 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc16800bad0 tx=0x7fc16800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91618dfcf21a263 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:34.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.621+0000 7fc164c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:20:34.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.622+0000 7fc164c00640 1 -- 172.21.15.3:0/421415707 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc168003e20 con 0x559a59f4b4b0 2024-09-19T06:20:34.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.622+0000 7fc164c00640 1 -- 172.21.15.3:0/421415707 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7fc168011440 con 0x559a59f4b4b0 2024-09-19T06:20:34.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.622+0000 7fc184acd740 1 -- 172.21.15.3:0/421415707 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1740183f0 con 0x559a59f4b4b0 2024-09-19T06:20:34.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.622+0000 7fc164c00640 1 -- 172.21.15.3:0/421415707 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc168011640 con 0x559a59f4b4b0 2024-09-19T06:20:34.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.622+0000 7fc184acd740 10 client.17532 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:34.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.622+0000 7fc184acd740 1 -- 172.21.15.3:0/421415707 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559a59f64770 con 0x559a59f4b4b0 2024-09-19T06:20:34.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.622+0000 7fc164c00640 1 -- 172.21.15.3:0/421415707 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1740183f0 con 0x559a59f4b4b0 2024-09-19T06:20:34.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.622+0000 7fc164c00640 1 -- 172.21.15.3:0/421415707 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc1680239e0 con 0x559a59f4b4b0 2024-09-19T06:20:34.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.622+0000 7fc184acd740 10 client.17532 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:34.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.622+0000 7fc184acd740 10 client.17532 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:34.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.622+0000 7fc184acd740 20 client.17532 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:34.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.623+0000 7fc184acd740 1 --2- 172.21.15.3:0/421415707 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x559a59f65cd0 0x559a59f680f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:34.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.623+0000 7fc184acd740 4 client.17532 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:34.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.623+0000 7fc184acd740 1 -- 172.21.15.3:0/421415707 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a59ebe950 con 0x559a59f65cd0 2024-09-19T06:20:34.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.623+0000 7fc17be00640 1 --2- 172.21.15.3:0/421415707 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x559a59f65cd0 0x559a59f680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:34.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.623+0000 7fc17be00640 1 --2- 172.21.15.3:0/421415707 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x559a59f65cd0 0x559a59f680f0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=567f7111b7b44487 server_cookie=d0c42d7e3c00070d in_seq=0 out_seq=0 2024-09-19T06:20:34.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.623+0000 7fc164c00640 10 client.17532 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:34.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.624+0000 7fc164c00640 1 -- 172.21.15.3:0/421415707 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559a59ebe950 con 0x559a59f65cd0 2024-09-19T06:20:34.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.624+0000 7fc164c00640 10 client.17532 handle_command_reply: tid=0 2024-09-19T06:20:34.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.624+0000 7fc184acd740 1 client.17532 shutdown 2024-09-19T06:20:34.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.624+0000 7fc184acd740 1 -- 172.21.15.3:0/421415707 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f4b4b0 msgr2=0x559a59f53210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:34.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.624+0000 7fc184acd740 1 --2- 172.21.15.3:0/421415707 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f4b4b0 0x559a59f53210 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc16800bad0 tx=0x7fc16800bf90 comp rx=0 tx=0).stop 2024-09-19T06:20:34.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.624+0000 7fc184acd740 1 -- 172.21.15.3:0/421415707 shutdown_connections 2024-09-19T06:20:34.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.624+0000 7fc184acd740 1 --2- 172.21.15.3:0/421415707 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x559a59f65cd0 0x559a59f680f0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.625+0000 7fc184acd740 1 --2- 172.21.15.3:0/421415707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a59f55d70 0x559a59f53750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.625+0000 7fc184acd740 1 --2- 172.21.15.3:0/421415707 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f4b4b0 0x559a59f53210 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.625+0000 7fc184acd740 1 --2- 172.21.15.3:0/421415707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a59f4ab90 0x559a59f52cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.625+0000 7fc184acd740 1 -- 172.21.15.3:0/421415707 >> 172.21.15.3:0/421415707 conn(0x559a59f47120 msgr2=0x559a59f4ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:34.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.625+0000 7fc164c00640 0 client.17532 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:34.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.625+0000 7fc184acd740 1 -- 172.21.15.3:0/421415707 shutdown_connections 2024-09-19T06:20:34.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.625+0000 7fc184acd740 1 -- 172.21.15.3:0/421415707 wait complete. 2024-09-19T06:20:34.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.625+0000 7fc184acd740 20 client.17532 trim_cache size 0 max 16384 2024-09-19T06:20:34.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.643+0000 7fc184acd740 1 Processor -- start 2024-09-19T06:20:34.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.643+0000 7fc184acd740 1 -- start start 2024-09-19T06:20:34.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.643+0000 7fc184acd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a59f4ab90 0x559a59f535a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:34.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.643+0000 7fc184acd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a59f4b4b0 0x559a59f6d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:34.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.643+0000 7fc184acd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f55d70 0x559a59f6dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:34.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.643+0000 7fc184acd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c1afb10 con 0x559a59f55d70 2024-09-19T06:20:34.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.643+0000 7fc184acd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c1b1650 con 0x559a59f4ab90 2024-09-19T06:20:34.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.643+0000 7fc184acd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c1b01e0 con 0x559a59f4b4b0 2024-09-19T06:20:34.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.643+0000 7fc17be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a59f4ab90 0x559a59f535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:34.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.643+0000 7fc17be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a59f4ab90 0x559a59f535a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:45982/0 (socket says 172.21.15.3:45982) 2024-09-19T06:20:34.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.643+0000 7fc17be00640 1 -- 172.21.15.3:0/3290268773 learned_addr learned my addr 172.21.15.3:0/3290268773 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:34.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.643+0000 7fc17aa00640 1 --2- 172.21.15.3:0/3290268773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a59f4b4b0 0x559a59f6d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:34.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.644+0000 7fc17be00640 1 --2- 172.21.15.3:0/3290268773 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f55d70 0x559a59f6dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:34.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.644+0000 7fc17aa00640 1 -- 172.21.15.3:0/3290268773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a59f4ab90 msgr2=0x559a59f535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:34.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.644+0000 7fc17aa00640 1 --2- 172.21.15.3:0/3290268773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a59f4ab90 0x559a59f535a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.644+0000 7fc17aa00640 1 -- 172.21.15.3:0/3290268773 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f55d70 msgr2=0x559a59f6dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:34.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.644+0000 7fc17aa00640 1 --2- 172.21.15.3:0/3290268773 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f55d70 0x559a59f6dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.644+0000 7fc17aa00640 1 -- 172.21.15.3:0/3290268773 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a59f51220 con 0x559a59f4b4b0 2024-09-19T06:20:34.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.644+0000 7fc17aa00640 1 --2- 172.21.15.3:0/3290268773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a59f4b4b0 0x559a59f6d9a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc168023e50 tx=0x7fc168005cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10620e85e9c71731 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:34.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.644+0000 7fc167400640 1 -- 172.21.15.3:0/3290268773 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc168000e60 con 0x559a59f4b4b0 2024-09-19T06:20:34.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.644+0000 7fc167400640 1 -- 172.21.15.3:0/3290268773 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc168005850 con 0x559a59f4b4b0 2024-09-19T06:20:34.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.644+0000 7fc167400640 1 -- 172.21.15.3:0/3290268773 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16801bac0 con 0x559a59f4b4b0 2024-09-19T06:20:34.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.645+0000 7fc184acd740 1 -- 172.21.15.3:0/3290268773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a59f4b4b0 msgr2=0x559a59f6d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:34.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.645+0000 7fc184acd740 1 --2- 172.21.15.3:0/3290268773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a59f4b4b0 0x559a59f6d9a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc168023e50 tx=0x7fc168005cd0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.645+0000 7fc184acd740 1 -- 172.21.15.3:0/3290268773 shutdown_connections 2024-09-19T06:20:34.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.645+0000 7fc184acd740 1 --2- 172.21.15.3:0/3290268773 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f55d70 0x559a59f6dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.645+0000 7fc184acd740 1 --2- 172.21.15.3:0/3290268773 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a59f4b4b0 0x559a59f6d9a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.645+0000 7fc184acd740 1 --2- 172.21.15.3:0/3290268773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a59f4ab90 0x559a59f535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.645+0000 7fc184acd740 1 -- 172.21.15.3:0/3290268773 >> 172.21.15.3:0/3290268773 conn(0x559a59f47120 msgr2=0x559a59f51dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:34.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.645+0000 7fc184acd740 1 -- 172.21.15.3:0/3290268773 shutdown_connections 2024-09-19T06:20:34.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.645+0000 7fc184acd740 1 -- 172.21.15.3:0/3290268773 wait complete. 2024-09-19T06:20:34.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.646+0000 7fc184acd740 1 -- start start 2024-09-19T06:20:34.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.646+0000 7fc184acd740 1 Processor -- start 2024-09-19T06:20:34.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.646+0000 7fc184acd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a59f4ab90 0x559a59f5e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:34.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.646+0000 7fc184acd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f4b4b0 0x559a59f595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:34.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.646+0000 7fc184acd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a59f55d70 0x559a59f59b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:34.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.646+0000 7fc184acd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c1b0f80 con 0x559a59f4b4b0 2024-09-19T06:20:34.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.646+0000 7fc184acd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c1b08b0 con 0x559a59f4ab90 2024-09-19T06:20:34.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.646+0000 7fc184acd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c1adb10 con 0x559a59f55d70 2024-09-19T06:20:34.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.646+0000 7fc184acd740 10 client.0 _ll_register_callbacks cb 0x7fc1680043c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:34.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.647+0000 7fc17aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f4b4b0 0x559a59f595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:34.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.647+0000 7fc17aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f4b4b0 0x559a59f595f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60096/0 (socket says 172.21.15.3:60096) 2024-09-19T06:20:34.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.647+0000 7fc17aa00640 1 -- 172.21.15.3:0/2140701497 learned_addr learned my addr 172.21.15.3:0/2140701497 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:34.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.647+0000 7fc17be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a59f4ab90 0x559a59f5e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:34.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.647+0000 7fc17be00640 1 --2- 172.21.15.3:0/2140701497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a59f55d70 0x559a59f59b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:34.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.647+0000 7fc17aa00640 1 -- 172.21.15.3:0/2140701497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a59f55d70 msgr2=0x559a59f59b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:34.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.647+0000 7fc17aa00640 1 --2- 172.21.15.3:0/2140701497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a59f55d70 0x559a59f59b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.647+0000 7fc17aa00640 1 -- 172.21.15.3:0/2140701497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a59f4ab90 msgr2=0x559a59f5e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:34.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.647+0000 7fc17aa00640 1 --2- 172.21.15.3:0/2140701497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a59f4ab90 0x559a59f5e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.647+0000 7fc17aa00640 1 -- 172.21.15.3:0/2140701497 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a59f5a0f0 con 0x559a59f4b4b0 2024-09-19T06:20:34.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.647+0000 7fc17be00640 1 --2- 172.21.15.3:0/2140701497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a59f55d70 0x559a59f59b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:34.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.647+0000 7fc17aa00640 1 --2- 172.21.15.3:0/2140701497 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f4b4b0 0x559a59f595f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc16800baa0 tx=0x7fc168005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3cd6636b4ea7b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:34.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.647+0000 7fc164c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:20:34.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.648+0000 7fc164c00640 1 -- 172.21.15.3:0/2140701497 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16801bb50 con 0x559a59f4b4b0 2024-09-19T06:20:34.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.648+0000 7fc164c00640 1 -- 172.21.15.3:0/2140701497 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7fc16801bcf0 con 0x559a59f4b4b0 2024-09-19T06:20:34.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.648+0000 7fc184acd740 1 -- 172.21.15.3:0/2140701497 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc168005850 con 0x559a59f4b4b0 2024-09-19T06:20:34.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.648+0000 7fc164c00640 1 -- 172.21.15.3:0/2140701497 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc1680117e0 con 0x559a59f4b4b0 2024-09-19T06:20:34.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.648+0000 7fc184acd740 10 client.17538 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:34.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.648+0000 7fc184acd740 1 -- 172.21.15.3:0/2140701497 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559a59fd0750 con 0x559a59f4b4b0 2024-09-19T06:20:34.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.648+0000 7fc164c00640 1 -- 172.21.15.3:0/2140701497 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc168005850 con 0x559a59f4b4b0 2024-09-19T06:20:34.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.649+0000 7fc164c00640 1 -- 172.21.15.3:0/2140701497 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fc16803c070 con 0x559a59f4b4b0 2024-09-19T06:20:34.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.649+0000 7fc184acd740 10 client.17538 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:34.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.649+0000 7fc184acd740 10 client.17538 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:34.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.649+0000 7fc184acd740 20 client.17538 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:34.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.649+0000 7fc184acd740 1 --2- 172.21.15.3:0/2140701497 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x559a59fd0d90 0x559a59fd31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:34.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.649+0000 7fc184acd740 4 client.17538 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:20:34.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.649+0000 7fc184acd740 1 -- 172.21.15.3:0/2140701497 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559a59eb8e60 con 0x559a59fd0d90 2024-09-19T06:20:34.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.649+0000 7fc17be00640 1 --2- 172.21.15.3:0/2140701497 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x559a59fd0d90 0x559a59fd31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:34.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.650+0000 7fc17be00640 1 --2- 172.21.15.3:0/2140701497 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x559a59fd0d90 0x559a59fd31b0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9ab7b47cbaafafd server_cookie=4b424c8eae58607c in_seq=0 out_seq=0 2024-09-19T06:20:34.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.650+0000 7fc164c00640 10 client.17538 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:34.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.650+0000 7fc164c00640 1 -- 172.21.15.3:0/2140701497 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559a59eb8e60 con 0x559a59fd0d90 2024-09-19T06:20:34.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.650+0000 7fc164c00640 10 client.17538 handle_command_reply: tid=0 2024-09-19T06:20:34.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.650+0000 7fc184acd740 1 client.17538 shutdown 2024-09-19T06:20:34.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.650+0000 7fc184acd740 1 -- 172.21.15.3:0/2140701497 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f4b4b0 msgr2=0x559a59f595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:34.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.650+0000 7fc184acd740 1 --2- 172.21.15.3:0/2140701497 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f4b4b0 0x559a59f595f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc16800baa0 tx=0x7fc168005e50 comp rx=0 tx=0).stop 2024-09-19T06:20:34.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.650+0000 7fc184acd740 1 -- 172.21.15.3:0/2140701497 shutdown_connections 2024-09-19T06:20:34.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.650+0000 7fc184acd740 1 --2- 172.21.15.3:0/2140701497 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x559a59fd0d90 0x559a59fd31b0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.650+0000 7fc184acd740 1 --2- 172.21.15.3:0/2140701497 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559a59f55d70 0x559a59f59b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.650+0000 7fc184acd740 1 --2- 172.21.15.3:0/2140701497 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559a59f4b4b0 0x559a59f595f0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.650+0000 7fc184acd740 1 --2- 172.21.15.3:0/2140701497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559a59f4ab90 0x559a59f5e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.650+0000 7fc164c00640 0 client.17538 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:34.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.650+0000 7fc184acd740 1 -- 172.21.15.3:0/2140701497 >> 172.21.15.3:0/2140701497 conn(0x559a59f47120 msgr2=0x559a59f54530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:34.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.650+0000 7fc184acd740 1 -- 172.21.15.3:0/2140701497 shutdown_connections 2024-09-19T06:20:34.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.650+0000 7fc184acd740 1 -- 172.21.15.3:0/2140701497 wait complete. 2024-09-19T06:20:34.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.651+0000 7fc184acd740 20 client.17538 trim_cache size 0 max 16384 2024-09-19T06:20:34.656 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:20:34.656 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "no active scrubs running", 2024-09-19T06:20:34.656 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": {} 2024-09-19T06:20:34.656 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:20:34.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.651+0000 7fc182000640 1 -- 172.21.15.3:0/3860224616 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc1600a33b0 msgr2=0x7fc1600a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:34.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.651+0000 7fc182000640 1 --2- 172.21.15.3:0/3860224616 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc1600a33b0 0x7fc1600a5870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x559a59f47f80 tx=0x7fc16c0f3c30 comp rx=0 tx=0).stop 2024-09-19T06:20:34.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.651+0000 7fc182000640 1 -- 172.21.15.3:0/3860224616 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc17c0745c0 msgr2=0x7fc17c19a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:34.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.651+0000 7fc182000640 1 --2- 172.21.15.3:0/3860224616 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc17c0745c0 0x7fc17c19a650 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc16c004770 tx=0x7fc16c003c10 comp rx=0 tx=0).stop 2024-09-19T06:20:34.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.651+0000 7fc182000640 1 -- 172.21.15.3:0/3860224616 shutdown_connections 2024-09-19T06:20:34.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.651+0000 7fc182000640 1 --2- 172.21.15.3:0/3860224616 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fc1600a33b0 0x7fc1600a5870 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.651+0000 7fc182000640 1 --2- 172.21.15.3:0/3860224616 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fc17c10e430 0x7fc17c19ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.651+0000 7fc182000640 1 --2- 172.21.15.3:0/3860224616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17c074ee0 0x7fc17c19ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.651+0000 7fc182000640 1 --2- 172.21.15.3:0/3860224616 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc17c0745c0 0x7fc17c19a650 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:34.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.651+0000 7fc182000640 1 -- 172.21.15.3:0/3860224616 >> 172.21.15.3:0/3860224616 conn(0x7fc17c0fd8b0 msgr2=0x7fc17c0fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:34.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.651+0000 7fc182000640 1 -- 172.21.15.3:0/3860224616 shutdown_connections 2024-09-19T06:20:34.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:34.652+0000 7fc182000640 1 -- 172.21.15.3:0/3860224616 wait complete. 2024-09-19T06:20:35.621 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:20:35.621 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:20:36.001 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:36.328 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:36 smithi003 ceph-mon[30893]: pgmap v253: 97 pgs: 97 active+clean; 2.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 68 KiB/s wr, 25 op/s 2024-09-19T06:20:36.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:36 smithi071 ceph-mon[35662]: pgmap v253: 97 pgs: 97 active+clean; 2.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 68 KiB/s wr, 25 op/s 2024-09-19T06:20:36.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:36 smithi059 ceph-mon[35138]: pgmap v253: 97 pgs: 97 active+clean; 2.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 68 KiB/s wr, 25 op/s 2024-09-19T06:20:36.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.572+0000 7fea5fe00640 1 -- 172.21.15.3:0/470535450 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea581049a0 msgr2=0x7fea581089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:36.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.572+0000 7fea5fe00640 1 --2- 172.21.15.3:0/470535450 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea581049a0 0x7fea581089f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fea44009900 tx=0x7fea4402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.572+0000 7fea5fe00640 1 -- 172.21.15.3:0/470535450 shutdown_connections 2024-09-19T06:20:36.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.572+0000 7fea5fe00640 1 --2- 172.21.15.3:0/470535450 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea58109120 0x7fea58110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.572+0000 7fea5fe00640 1 --2- 172.21.15.3:0/470535450 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea581049a0 0x7fea581089f0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.572+0000 7fea5fe00640 1 --2- 172.21.15.3:0/470535450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea58103ff0 0x7fea581043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.572+0000 7fea5fe00640 1 -- 172.21.15.3:0/470535450 >> 172.21.15.3:0/470535450 conn(0x7fea580ffa90 msgr2=0x7fea58101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:36.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.572+0000 7fea5fe00640 1 -- 172.21.15.3:0/470535450 shutdown_connections 2024-09-19T06:20:36.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.572+0000 7fea5fe00640 1 -- 172.21.15.3:0/470535450 wait complete. 2024-09-19T06:20:36.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.573+0000 7fea5fe00640 1 Processor -- start 2024-09-19T06:20:36.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.573+0000 7fea5fe00640 1 -- start start 2024-09-19T06:20:36.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.573+0000 7fea5fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea58103ff0 0x7fea5819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:36.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.573+0000 7fea5fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea581049a0 0x7fea5819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:36.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.573+0000 7fea5fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea58109120 0x7fea5819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:36.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.573+0000 7fea5fe00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fea58114190 con 0x7fea581049a0 2024-09-19T06:20:36.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.574+0000 7fea5fe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fea58114010 con 0x7fea58109120 2024-09-19T06:20:36.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.574+0000 7fea5fe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fea58114310 con 0x7fea58103ff0 2024-09-19T06:20:36.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.574+0000 7fea5ca00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea581049a0 0x7fea5819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:36.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.574+0000 7fea5d400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea58103ff0 0x7fea5819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:36.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.574+0000 7fea5ca00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea581049a0 0x7fea5819ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60120/0 (socket says 172.21.15.3:60120) 2024-09-19T06:20:36.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.574+0000 7fea5ca00640 1 -- 172.21.15.3:0/1805221448 learned_addr learned my addr 172.21.15.3:0/1805221448 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:36.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.574+0000 7fea5de00640 1 --2- 172.21.15.3:0/1805221448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea58109120 0x7fea5819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:36.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.574+0000 7fea5d400640 1 -- 172.21.15.3:0/1805221448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea58109120 msgr2=0x7fea5819eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:36.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.574+0000 7fea5d400640 1 --2- 172.21.15.3:0/1805221448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea58109120 0x7fea5819eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.574+0000 7fea5d400640 1 -- 172.21.15.3:0/1805221448 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea581049a0 msgr2=0x7fea5819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:36.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.574+0000 7fea5d400640 1 --2- 172.21.15.3:0/1805221448 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea581049a0 0x7fea5819ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.574+0000 7fea5d400640 1 -- 172.21.15.3:0/1805221448 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea5819f5a0 con 0x7fea58103ff0 2024-09-19T06:20:36.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.575+0000 7fea5d400640 1 --2- 172.21.15.3:0/1805221448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea58103ff0 0x7fea5819a5f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00e9f0 tx=0x7fea4c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:36.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.575+0000 7fea56000640 1 -- 172.21.15.3:0/1805221448 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c00ccc0 con 0x7fea58103ff0 2024-09-19T06:20:36.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.575+0000 7fea5fe00640 1 -- 172.21.15.3:0/1805221448 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea5819f890 con 0x7fea58103ff0 2024-09-19T06:20:36.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.575+0000 7fea56000640 1 -- 172.21.15.3:0/1805221448 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea4c010910 con 0x7fea58103ff0 2024-09-19T06:20:36.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.575+0000 7fea5fe00640 1 -- 172.21.15.3:0/1805221448 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea581a7170 con 0x7fea58103ff0 2024-09-19T06:20:36.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.575+0000 7fea56000640 1 -- 172.21.15.3:0/1805221448 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c018880 con 0x7fea58103ff0 2024-09-19T06:20:36.579 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.576+0000 7fea5fe00640 1 -- 172.21.15.3:0/1805221448 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea581043d0 con 0x7fea58103ff0 2024-09-19T06:20:36.580 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.579+0000 7fea56000640 1 -- 172.21.15.3:0/1805221448 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fea4c010ac0 con 0x7fea58103ff0 2024-09-19T06:20:36.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.580+0000 7fea56000640 1 --2- 172.21.15.3:0/1805221448 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fea400a3430 0x7fea400a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:36.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.580+0000 7fea56000640 1 -- 172.21.15.3:0/1805221448 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7fea4c0d0290 con 0x7fea58103ff0 2024-09-19T06:20:36.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.580+0000 7fea5ca00640 1 --2- 172.21.15.3:0/1805221448 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fea400a3430 0x7fea400a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:36.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.581+0000 7fea5ca00640 1 --2- 172.21.15.3:0/1805221448 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fea400a3430 0x7fea400a58f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fea440096c0 tx=0x7fea440046c0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:36.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.582+0000 7fea56000640 1 -- 172.21.15.3:0/1805221448 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fea4c09c590 con 0x7fea58103ff0 2024-09-19T06:20:36.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.803+0000 7fea5fe00640 1 -- 172.21.15.3:0/1805221448 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea581a73a0 con 0x7fea58103ff0 2024-09-19T06:20:36.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.804+0000 7fea56000640 1 -- 172.21.15.3:0/1805221448 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7fea4c0a0890 con 0x7fea58103ff0 2024-09-19T06:20:36.807 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:20:36.807 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"btime":"2024-09-19T06:12:22:958217+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:12:22.060987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24532,24515,24514,14517]},"id":1}]} 2024-09-19T06:20:36.807 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2024-09-19T06:20:36.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.807+0000 7fea5fe00640 1 -- 172.21.15.3:0/1805221448 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fea400a3430 msgr2=0x7fea400a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:36.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.807+0000 7fea5fe00640 1 --2- 172.21.15.3:0/1805221448 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fea400a3430 0x7fea400a58f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fea440096c0 tx=0x7fea440046c0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.807+0000 7fea5fe00640 1 -- 172.21.15.3:0/1805221448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea58103ff0 msgr2=0x7fea5819a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:36.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.807+0000 7fea5fe00640 1 --2- 172.21.15.3:0/1805221448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea58103ff0 0x7fea5819a5f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00e9f0 tx=0x7fea4c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.807+0000 7fea5fe00640 1 -- 172.21.15.3:0/1805221448 shutdown_connections 2024-09-19T06:20:36.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.807+0000 7fea5fe00640 1 --2- 172.21.15.3:0/1805221448 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fea400a3430 0x7fea400a58f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.807+0000 7fea5fe00640 1 --2- 172.21.15.3:0/1805221448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea58109120 0x7fea5819eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.807+0000 7fea5fe00640 1 --2- 172.21.15.3:0/1805221448 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea581049a0 0x7fea5819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.807+0000 7fea5fe00640 1 --2- 172.21.15.3:0/1805221448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea58103ff0 0x7fea5819a5f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:36.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.807+0000 7fea5fe00640 1 -- 172.21.15.3:0/1805221448 >> 172.21.15.3:0/1805221448 conn(0x7fea580ffa90 msgr2=0x7fea58101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:36.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.807+0000 7fea5fe00640 1 -- 172.21.15.3:0/1805221448 shutdown_connections 2024-09-19T06:20:36.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:36.807+0000 7fea5fe00640 1 -- 172.21.15.3:0/1805221448 wait complete. 2024-09-19T06:20:37.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:37 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1805221448' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:20:37.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:37 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1805221448' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:20:37.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:37 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1805221448' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:20:37.623 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:20:38.006 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:38.316 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:38 smithi003 ceph-mon[30893]: pgmap v254: 97 pgs: 97 active+clean; 2.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:20:38.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:38 smithi071 ceph-mon[35662]: pgmap v254: 97 pgs: 97 active+clean; 2.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:20:38.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:38 smithi059 ceph-mon[35138]: pgmap v254: 97 pgs: 97 active+clean; 2.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:20:38.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.684+0000 7fbc49000640 1 -- 172.21.15.3:0/504955381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc44109140 msgr2=0x7fbc44110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:38.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.684+0000 7fbc49000640 1 --2- 172.21.15.3:0/504955381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc44109140 0x7fbc44110cc0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c009ca0 tx=0x7fbc3c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.685+0000 7fbc49000640 1 -- 172.21.15.3:0/504955381 shutdown_connections 2024-09-19T06:20:38.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.685+0000 7fbc49000640 1 --2- 172.21.15.3:0/504955381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc44109140 0x7fbc44110cc0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.685+0000 7fbc49000640 1 --2- 172.21.15.3:0/504955381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc441049c0 0x7fbc44108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.685+0000 7fbc49000640 1 --2- 172.21.15.3:0/504955381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc44104010 0x7fbc441043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.685+0000 7fbc49000640 1 -- 172.21.15.3:0/504955381 >> 172.21.15.3:0/504955381 conn(0x7fbc440ffa50 msgr2=0x7fbc44101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:38.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.685+0000 7fbc49000640 1 -- 172.21.15.3:0/504955381 shutdown_connections 2024-09-19T06:20:38.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.685+0000 7fbc49000640 1 -- 172.21.15.3:0/504955381 wait complete. 2024-09-19T06:20:38.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.686+0000 7fbc49000640 1 Processor -- start 2024-09-19T06:20:38.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.686+0000 7fbc49000640 1 -- start start 2024-09-19T06:20:38.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.686+0000 7fbc49000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc44104010 0x7fbc4419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.686+0000 7fbc49000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc441049c0 0x7fbc4419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.686+0000 7fbc49000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc44109140 0x7fbc4419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.686+0000 7fbc49000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbc441141c0 con 0x7fbc44104010 2024-09-19T06:20:38.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.686+0000 7fbc49000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbc44114040 con 0x7fbc44109140 2024-09-19T06:20:38.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.686+0000 7fbc49000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbc44114340 con 0x7fbc441049c0 2024-09-19T06:20:38.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.687+0000 7fbc41e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc44104010 0x7fbc4419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.687+0000 7fbc42800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc44109140 0x7fbc4419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.687+0000 7fbc3be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc441049c0 0x7fbc4419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.687+0000 7fbc42800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc44109140 0x7fbc4419ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:46014/0 (socket says 172.21.15.3:46014) 2024-09-19T06:20:38.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.687+0000 7fbc42800640 1 -- 172.21.15.3:0/3433859505 learned_addr learned my addr 172.21.15.3:0/3433859505 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:38.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.687+0000 7fbc3be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc441049c0 0x7fbc4419ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:56430/0 (socket says 172.21.15.3:56430) 2024-09-19T06:20:38.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.687+0000 7fbc3be00640 1 -- 172.21.15.3:0/3433859505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc44109140 msgr2=0x7fbc4419ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:38.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.687+0000 7fbc3be00640 1 --2- 172.21.15.3:0/3433859505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc44109140 0x7fbc4419ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.687+0000 7fbc3be00640 1 -- 172.21.15.3:0/3433859505 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc44104010 msgr2=0x7fbc4419a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:38.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.687+0000 7fbc3be00640 1 --2- 172.21.15.3:0/3433859505 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc44104010 0x7fbc4419a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.687+0000 7fbc3be00640 1 -- 172.21.15.3:0/3433859505 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4419f670 con 0x7fbc441049c0 2024-09-19T06:20:38.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.687+0000 7fbc41e00640 1 --2- 172.21.15.3:0/3433859505 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc44104010 0x7fbc4419a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:38.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.687+0000 7fbc3be00640 1 --2- 172.21.15.3:0/3433859505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc441049c0 0x7fbc4419ac00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00e9f0 tx=0x7fbc2c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:38.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.688+0000 7fbc3aa00640 1 -- 172.21.15.3:0/3433859505 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c00cd80 con 0x7fbc441049c0 2024-09-19T06:20:38.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.688+0000 7fbc3aa00640 1 -- 172.21.15.3:0/3433859505 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc2c0035f0 con 0x7fbc441049c0 2024-09-19T06:20:38.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.688+0000 7fbc49000640 1 -- 172.21.15.3:0/3433859505 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc4419f960 con 0x7fbc441049c0 2024-09-19T06:20:38.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.688+0000 7fbc3aa00640 1 -- 172.21.15.3:0/3433859505 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c010690 con 0x7fbc441049c0 2024-09-19T06:20:38.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.688+0000 7fbc49000640 1 -- 172.21.15.3:0/3433859505 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc441a7240 con 0x7fbc441049c0 2024-09-19T06:20:38.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.691+0000 7fbc4ba40740 1 Processor -- start 2024-09-19T06:20:38.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.692+0000 7fbc4ba40740 1 -- start start 2024-09-19T06:20:38.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.692+0000 7fbc4ba40740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372dfc70 0x55ba372e0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.692+0000 7fbc4ba40740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372e0590 0x55ba372ea910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.692+0000 7fbc4ba40740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ba372eae50 0x55ba372ed240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.692+0000 7fbc4ba40740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ba372463e0 con 0x55ba372dfc70 2024-09-19T06:20:38.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.692+0000 7fbc4ba40740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ba371edd80 con 0x55ba372e0590 2024-09-19T06:20:38.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.692+0000 7fbc4ba40740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ba372423a0 con 0x55ba372eae50 2024-09-19T06:20:38.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.692+0000 7fbc42800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372dfc70 0x55ba372e0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.692+0000 7fbc3aa00640 1 -- 172.21.15.3:0/3433859505 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fbc2c003b30 con 0x7fbc441049c0 2024-09-19T06:20:38.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.692+0000 7fbc41e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372e0590 0x55ba372ea910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.693+0000 7fbc42800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372dfc70 0x55ba372e0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60142/0 (socket says 172.21.15.3:60142) 2024-09-19T06:20:38.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.693+0000 7fbc42800640 1 -- 172.21.15.3:0/669989812 learned_addr learned my addr 172.21.15.3:0/669989812 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:38.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.693+0000 7fbc41e00640 1 -- 172.21.15.3:0/669989812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ba372eae50 msgr2=0x55ba372ed240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:38.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.693+0000 7fbc41e00640 1 --2- 172.21.15.3:0/669989812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ba372eae50 0x55ba372ed240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.693+0000 7fbc41e00640 1 -- 172.21.15.3:0/669989812 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372dfc70 msgr2=0x55ba372e0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:38.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.693+0000 7fbc41e00640 1 --2- 172.21.15.3:0/669989812 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372dfc70 0x55ba372e0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.693+0000 7fbc41e00640 1 -- 172.21.15.3:0/669989812 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba3720cae0 con 0x55ba372e0590 2024-09-19T06:20:38.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.693+0000 7fbc41e00640 1 --2- 172.21.15.3:0/669989812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372e0590 0x55ba372ea910 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009fd0 tx=0x7fbc340118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42a1e7061c0624ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:38.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.693+0000 7fbc33400640 1 -- 172.21.15.3:0/669989812 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc34004310 con 0x55ba372e0590 2024-09-19T06:20:38.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.694+0000 7fbc33400640 1 -- 172.21.15.3:0/669989812 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc340044b0 con 0x55ba372e0590 2024-09-19T06:20:38.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.694+0000 7fbc33400640 1 -- 172.21.15.3:0/669989812 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc34003650 con 0x55ba372e0590 2024-09-19T06:20:38.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.694+0000 7fbc3aa00640 1 --2- 172.21.15.3:0/3433859505 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbc280a33b0 0x7fbc280a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.694+0000 7fbc3aa00640 1 -- 172.21.15.3:0/3433859505 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7fbc2c0cfff0 con 0x7fbc441049c0 2024-09-19T06:20:38.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.694+0000 7fbc4ba40740 1 -- 172.21.15.3:0/669989812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372e0590 msgr2=0x55ba372ea910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:38.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.694+0000 7fbc4ba40740 1 --2- 172.21.15.3:0/669989812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372e0590 0x55ba372ea910 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009fd0 tx=0x7fbc340118d0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.694+0000 7fbc42800640 1 --2- 172.21.15.3:0/3433859505 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbc280a33b0 0x7fbc280a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.694+0000 7fbc4ba40740 1 -- 172.21.15.3:0/669989812 shutdown_connections 2024-09-19T06:20:38.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.694+0000 7fbc4ba40740 1 --2- 172.21.15.3:0/669989812 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ba372eae50 0x55ba372ed240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.694+0000 7fbc4ba40740 1 --2- 172.21.15.3:0/669989812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372e0590 0x55ba372ea910 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.694+0000 7fbc4ba40740 1 --2- 172.21.15.3:0/669989812 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372dfc70 0x55ba372e0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.694+0000 7fbc4ba40740 1 -- 172.21.15.3:0/669989812 >> 172.21.15.3:0/669989812 conn(0x55ba372dc200 msgr2=0x55ba372dc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:38.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.695+0000 7fbc4ba40740 1 -- 172.21.15.3:0/669989812 shutdown_connections 2024-09-19T06:20:38.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.695+0000 7fbc4ba40740 1 -- 172.21.15.3:0/669989812 wait complete. 2024-09-19T06:20:38.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.695+0000 7fbc42800640 1 --2- 172.21.15.3:0/3433859505 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbc280a33b0 0x7fbc280a5870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c02f3f0 tx=0x7fbc3c005d80 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:38.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.695+0000 7fbc4ba40740 1 -- start start 2024-09-19T06:20:38.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.695+0000 7fbc4ba40740 1 Processor -- start 2024-09-19T06:20:38.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.696+0000 7fbc4ba40740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372dfc70 0x55ba372e7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.696+0000 7fbc4ba40740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372e0590 0x55ba372e8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.696+0000 7fbc4ba40740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ba372eae50 0x55ba372e8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.696+0000 7fbc4ba40740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ba372eda20 con 0x55ba372e0590 2024-09-19T06:20:38.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.696+0000 7fbc4ba40740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ba372010f0 con 0x55ba372dfc70 2024-09-19T06:20:38.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.696+0000 7fbc4ba40740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ba372edba0 con 0x55ba372eae50 2024-09-19T06:20:38.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.696+0000 7fbc4ba40740 10 client.0 _ll_register_callbacks cb 0x55ba371e8bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:38.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.696+0000 7fbc41e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372dfc70 0x55ba372e7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.696+0000 7fbc3be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372e0590 0x55ba372e8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.696+0000 7fbc41e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372dfc70 0x55ba372e7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:46038/0 (socket says 172.21.15.3:46038) 2024-09-19T06:20:38.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.696+0000 7fbc41e00640 1 -- 172.21.15.3:0/2641443127 learned_addr learned my addr 172.21.15.3:0/2641443127 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:38.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.696+0000 7fbc42800640 1 --2- 172.21.15.3:0/2641443127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ba372eae50 0x55ba372e8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.697+0000 7fbc3be00640 1 -- 172.21.15.3:0/2641443127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ba372eae50 msgr2=0x55ba372e8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:38.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.697+0000 7fbc3be00640 1 --2- 172.21.15.3:0/2641443127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ba372eae50 0x55ba372e8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.697+0000 7fbc3be00640 1 -- 172.21.15.3:0/2641443127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372dfc70 msgr2=0x55ba372e7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:38.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.697+0000 7fbc3be00640 1 --2- 172.21.15.3:0/2641443127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372dfc70 0x55ba372e7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.697+0000 7fbc3be00640 1 -- 172.21.15.3:0/2641443127 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba36fb73c0 con 0x55ba372e0590 2024-09-19T06:20:38.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.697+0000 7fbc41e00640 1 --2- 172.21.15.3:0/2641443127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372dfc70 0x55ba372e7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:38.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.697+0000 7fbc3be00640 1 --2- 172.21.15.3:0/2641443127 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372e0590 0x55ba372e8320 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c0cd6f0 tx=0x7fbc2c09c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b4c6352fb0710d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:38.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.697+0000 7fbc27e00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:20:38.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.697+0000 7fbc27e00640 1 -- 172.21.15.3:0/2641443127 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c0a4ef0 con 0x55ba372e0590 2024-09-19T06:20:38.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.697+0000 7fbc27e00640 1 -- 172.21.15.3:0/2641443127 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7fbc2c0d20e0 con 0x55ba372e0590 2024-09-19T06:20:38.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.697+0000 7fbc4ba40740 1 -- 172.21.15.3:0/2641443127 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc340044b0 con 0x55ba372e0590 2024-09-19T06:20:38.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.697+0000 7fbc27e00640 1 -- 172.21.15.3:0/2641443127 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbc2c009430 con 0x55ba372e0590 2024-09-19T06:20:38.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.697+0000 7fbc4ba40740 10 client.17556 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:38.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.697+0000 7fbc4ba40740 1 -- 172.21.15.3:0/2641443127 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ba372f9b00 con 0x55ba372e0590 2024-09-19T06:20:38.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.698+0000 7fbc27e00640 1 -- 172.21.15.3:0/2641443127 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc340044b0 con 0x55ba372e0590 2024-09-19T06:20:38.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.698+0000 7fbc27e00640 1 -- 172.21.15.3:0/2641443127 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fbc2c0a0200 con 0x55ba372e0590 2024-09-19T06:20:38.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.698+0000 7fbc4ba40740 10 client.17556 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:38.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.698+0000 7fbc4ba40740 10 client.17556 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:20:38.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.698+0000 7fbc4ba40740 20 client.17556 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:38.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.698+0000 7fbc4ba40740 1 --2- 172.21.15.3:0/2641443127 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55ba372faf10 0x55ba372fd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.698+0000 7fbc4ba40740 4 client.17556 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:38.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.698+0000 7fbc4ba40740 1 -- 172.21.15.3:0/2641443127 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba37253950 con 0x55ba372faf10 2024-09-19T06:20:38.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.698+0000 7fbc41e00640 1 --2- 172.21.15.3:0/2641443127 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55ba372faf10 0x55ba372fd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.699+0000 7fbc41e00640 1 --2- 172.21.15.3:0/2641443127 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55ba372faf10 0x55ba372fd300 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=46004a4262168b7a server_cookie=d8d15d0c4f25ba01 in_seq=0 out_seq=0 2024-09-19T06:20:38.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.699+0000 7fbc27e00640 10 client.17556 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:20:38.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.700+0000 7fbc27e00640 1 -- 172.21.15.3:0/2641443127 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ba37253950 con 0x55ba372faf10 2024-09-19T06:20:38.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.700+0000 7fbc27e00640 10 client.17556 handle_command_reply: tid=0 2024-09-19T06:20:38.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.700+0000 7fbc4ba40740 1 client.17556 shutdown 2024-09-19T06:20:38.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.700+0000 7fbc4ba40740 1 -- 172.21.15.3:0/2641443127 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372e0590 msgr2=0x55ba372e8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:38.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.700+0000 7fbc4ba40740 1 --2- 172.21.15.3:0/2641443127 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372e0590 0x55ba372e8320 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c0cd6f0 tx=0x7fbc2c09c980 comp rx=0 tx=0).stop 2024-09-19T06:20:38.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.700+0000 7fbc4ba40740 1 -- 172.21.15.3:0/2641443127 shutdown_connections 2024-09-19T06:20:38.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.700+0000 7fbc4ba40740 1 --2- 172.21.15.3:0/2641443127 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55ba372faf10 0x55ba372fd300 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.700+0000 7fbc4ba40740 1 --2- 172.21.15.3:0/2641443127 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ba372eae50 0x55ba372e8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.700+0000 7fbc4ba40740 1 --2- 172.21.15.3:0/2641443127 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372e0590 0x55ba372e8320 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.700+0000 7fbc4ba40740 1 --2- 172.21.15.3:0/2641443127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372dfc70 0x55ba372e7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.700+0000 7fbc4ba40740 1 -- 172.21.15.3:0/2641443127 >> 172.21.15.3:0/2641443127 conn(0x55ba372dc200 msgr2=0x55ba372e1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:38.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.700+0000 7fbc27e00640 0 client.17556 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:20:38.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.700+0000 7fbc4ba40740 1 -- 172.21.15.3:0/2641443127 shutdown_connections 2024-09-19T06:20:38.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.700+0000 7fbc4ba40740 1 -- 172.21.15.3:0/2641443127 wait complete. 2024-09-19T06:20:38.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.700+0000 7fbc4ba40740 20 client.17556 trim_cache size 0 max 16384 2024-09-19T06:20:38.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.714+0000 7fbc4ba40740 1 Processor -- start 2024-09-19T06:20:38.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.714+0000 7fbc4ba40740 1 -- start start 2024-09-19T06:20:38.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.714+0000 7fbc4ba40740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372dfc70 0x55ba372e9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.714+0000 7fbc4ba40740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ba372e0590 0x55ba37302b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.715+0000 7fbc4ba40740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372eae50 0x55ba37303070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.715+0000 7fbc4ba40740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbc441afb50 con 0x55ba372dfc70 2024-09-19T06:20:38.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.715+0000 7fbc4ba40740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbc441b1690 con 0x55ba372eae50 2024-09-19T06:20:38.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.715+0000 7fbc4ba40740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbc441b0220 con 0x55ba372e0590 2024-09-19T06:20:38.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.715+0000 7fbc41e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372dfc70 0x55ba372e9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.715+0000 7fbc41e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372dfc70 0x55ba372e9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60160/0 (socket says 172.21.15.3:60160) 2024-09-19T06:20:38.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.715+0000 7fbc41e00640 1 -- 172.21.15.3:0/1653294204 learned_addr learned my addr 172.21.15.3:0/1653294204 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:38.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.715+0000 7fbc42800640 1 --2- 172.21.15.3:0/1653294204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372eae50 0x55ba37303070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.715+0000 7fbc3be00640 1 --2- 172.21.15.3:0/1653294204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ba372e0590 0x55ba37302b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.715+0000 7fbc41e00640 1 -- 172.21.15.3:0/1653294204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ba372e0590 msgr2=0x55ba37302b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:38.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.715+0000 7fbc41e00640 1 --2- 172.21.15.3:0/1653294204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ba372e0590 0x55ba37302b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.715+0000 7fbc41e00640 1 -- 172.21.15.3:0/1653294204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372eae50 msgr2=0x55ba37303070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:38.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.715+0000 7fbc41e00640 1 --2- 172.21.15.3:0/1653294204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372eae50 0x55ba37303070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.715+0000 7fbc41e00640 1 -- 172.21.15.3:0/1653294204 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba372dd390 con 0x55ba372dfc70 2024-09-19T06:20:38.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.716+0000 7fbc41e00640 1 --2- 172.21.15.3:0/1653294204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372dfc70 0x55ba372e9d50 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fbc340058c0 tx=0x7fbc34004c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec63bd00de8fe9e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:38.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.716+0000 7fbc32a00640 1 -- 172.21.15.3:0/1653294204 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc34004860 con 0x55ba372dfc70 2024-09-19T06:20:38.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.716+0000 7fbc32a00640 1 -- 172.21.15.3:0/1653294204 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc340053b0 con 0x55ba372dfc70 2024-09-19T06:20:38.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.716+0000 7fbc32a00640 1 -- 172.21.15.3:0/1653294204 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc34003aa0 con 0x55ba372dfc70 2024-09-19T06:20:38.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.716+0000 7fbc4ba40740 1 -- 172.21.15.3:0/1653294204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372dfc70 msgr2=0x55ba372e9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:38.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.716+0000 7fbc4ba40740 1 --2- 172.21.15.3:0/1653294204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372dfc70 0x55ba372e9d50 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fbc340058c0 tx=0x7fbc34004c10 comp rx=0 tx=0).stop 2024-09-19T06:20:38.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.717+0000 7fbc4ba40740 1 -- 172.21.15.3:0/1653294204 shutdown_connections 2024-09-19T06:20:38.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.717+0000 7fbc4ba40740 1 --2- 172.21.15.3:0/1653294204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372eae50 0x55ba37303070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.717+0000 7fbc4ba40740 1 --2- 172.21.15.3:0/1653294204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ba372e0590 0x55ba37302b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.717+0000 7fbc4ba40740 1 --2- 172.21.15.3:0/1653294204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372dfc70 0x55ba372e9d50 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.717+0000 7fbc4ba40740 1 -- 172.21.15.3:0/1653294204 >> 172.21.15.3:0/1653294204 conn(0x55ba372dc200 msgr2=0x55ba372e9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:38.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.717+0000 7fbc4ba40740 1 -- 172.21.15.3:0/1653294204 shutdown_connections 2024-09-19T06:20:38.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.717+0000 7fbc4ba40740 1 -- 172.21.15.3:0/1653294204 wait complete. 2024-09-19T06:20:38.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.717+0000 7fbc4ba40740 1 -- start start 2024-09-19T06:20:38.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.717+0000 7fbc4ba40740 1 Processor -- start 2024-09-19T06:20:38.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.718+0000 7fbc4ba40740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ba372dfc70 0x55ba372e4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.718+0000 7fbc4ba40740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372e0590 0x55ba372e5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.718+0000 7fbc4ba40740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372eae50 0x55ba372e5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.718+0000 7fbc4ba40740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbc441b0fc0 con 0x55ba372e0590 2024-09-19T06:20:38.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.718+0000 7fbc4ba40740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbc441b08f0 con 0x55ba372eae50 2024-09-19T06:20:38.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.718+0000 7fbc4ba40740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbc441adb50 con 0x55ba372dfc70 2024-09-19T06:20:38.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.718+0000 7fbc4ba40740 10 client.0 _ll_register_callbacks cb 0x7fbc2c003e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:38.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.718+0000 7fbc3be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372e0590 0x55ba372e5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.718+0000 7fbc42800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372eae50 0x55ba372e5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.718+0000 7fbc41e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ba372dfc70 0x55ba372e4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.718+0000 7fbc3be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372e0590 0x55ba372e5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60162/0 (socket says 172.21.15.3:60162) 2024-09-19T06:20:38.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.718+0000 7fbc42800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372eae50 0x55ba372e5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:46056/0 (socket says 172.21.15.3:46056) 2024-09-19T06:20:38.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.718+0000 7fbc3be00640 1 -- 172.21.15.3:0/3216990448 learned_addr learned my addr 172.21.15.3:0/3216990448 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:38.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.719+0000 7fbc42800640 1 -- 172.21.15.3:0/3216990448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ba372dfc70 msgr2=0x55ba372e4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:38.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.719+0000 7fbc42800640 1 --2- 172.21.15.3:0/3216990448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ba372dfc70 0x55ba372e4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.719+0000 7fbc42800640 1 -- 172.21.15.3:0/3216990448 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372e0590 msgr2=0x55ba372e5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:38.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.719+0000 7fbc42800640 1 --2- 172.21.15.3:0/3216990448 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372e0590 0x55ba372e5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.719+0000 7fbc42800640 1 -- 172.21.15.3:0/3216990448 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba37364ca0 con 0x55ba372eae50 2024-09-19T06:20:38.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.719+0000 7fbc42800640 1 --2- 172.21.15.3:0/3216990448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372eae50 0x55ba372e5a70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c005e30 tx=0x7fbc3c02a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d8f4fbc613be88e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:38.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.719+0000 7fbc27e00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:20:38.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.719+0000 7fbc27e00640 1 -- 172.21.15.3:0/3216990448 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c031660 con 0x55ba372eae50 2024-09-19T06:20:38.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.719+0000 7fbc4ba40740 1 -- 172.21.15.3:0/3216990448 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc340053b0 con 0x55ba372eae50 2024-09-19T06:20:38.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.719+0000 7fbc27e00640 1 -- 172.21.15.3:0/3216990448 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7fbc3c042030 con 0x55ba372eae50 2024-09-19T06:20:38.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.720+0000 7fbc27e00640 1 -- 172.21.15.3:0/3216990448 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbc3c031800 con 0x55ba372eae50 2024-09-19T06:20:38.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.720+0000 7fbc4ba40740 10 client.27596 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:38.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.720+0000 7fbc4ba40740 1 -- 172.21.15.3:0/3216990448 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ba37365fb0 con 0x55ba372eae50 2024-09-19T06:20:38.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.720+0000 7fbc27e00640 1 -- 172.21.15.3:0/3216990448 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc340053b0 con 0x55ba372eae50 2024-09-19T06:20:38.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.720+0000 7fbc27e00640 1 -- 172.21.15.3:0/3216990448 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fbc3c02f7c0 con 0x55ba372eae50 2024-09-19T06:20:38.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.720+0000 7fbc4ba40740 10 client.27596 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:38.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.720+0000 7fbc4ba40740 10 client.27596 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:20:38.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.720+0000 7fbc4ba40740 20 client.27596 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:38.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.720+0000 7fbc4ba40740 1 --2- 172.21.15.3:0/3216990448 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55ba373666b0 0x55ba37368ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:38.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.720+0000 7fbc4ba40740 4 client.27596 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:38.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.720+0000 7fbc4ba40740 1 -- 172.21.15.3:0/3216990448 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ba3724de60 con 0x55ba373666b0 2024-09-19T06:20:38.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.720+0000 7fbc41e00640 1 --2- 172.21.15.3:0/3216990448 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55ba373666b0 0x55ba37368ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:38.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.721+0000 7fbc41e00640 1 --2- 172.21.15.3:0/3216990448 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55ba373666b0 0x55ba37368ad0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f2e546d189877858 server_cookie=6f564bbc57b51470 in_seq=0 out_seq=0 2024-09-19T06:20:38.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.721+0000 7fbc27e00640 10 client.27596 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:20:38.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.721+0000 7fbc27e00640 1 -- 172.21.15.3:0/3216990448 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ba3724de60 con 0x55ba373666b0 2024-09-19T06:20:38.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.721+0000 7fbc27e00640 10 client.27596 handle_command_reply: tid=0 2024-09-19T06:20:38.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.721+0000 7fbc4ba40740 1 client.27596 shutdown 2024-09-19T06:20:38.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.721+0000 7fbc4ba40740 1 -- 172.21.15.3:0/3216990448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372eae50 msgr2=0x55ba372e5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:38.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.721+0000 7fbc4ba40740 1 --2- 172.21.15.3:0/3216990448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372eae50 0x55ba372e5a70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c005e30 tx=0x7fbc3c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.722+0000 7fbc4ba40740 1 -- 172.21.15.3:0/3216990448 shutdown_connections 2024-09-19T06:20:38.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.722+0000 7fbc4ba40740 1 --2- 172.21.15.3:0/3216990448 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55ba373666b0 0x55ba37368ad0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.722+0000 7fbc4ba40740 1 --2- 172.21.15.3:0/3216990448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ba372eae50 0x55ba372e5a70 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.722+0000 7fbc4ba40740 1 --2- 172.21.15.3:0/3216990448 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ba372e0590 0x55ba372e5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.722+0000 7fbc4ba40740 1 --2- 172.21.15.3:0/3216990448 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ba372dfc70 0x55ba372e4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.722+0000 7fbc4ba40740 1 -- 172.21.15.3:0/3216990448 >> 172.21.15.3:0/3216990448 conn(0x55ba372dc200 msgr2=0x55ba372db380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:38.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.722+0000 7fbc27e00640 0 client.27596 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:20:38.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.722+0000 7fbc4ba40740 1 -- 172.21.15.3:0/3216990448 shutdown_connections 2024-09-19T06:20:38.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.722+0000 7fbc4ba40740 1 -- 172.21.15.3:0/3216990448 wait complete. 2024-09-19T06:20:38.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.722+0000 7fbc4ba40740 20 client.27596 trim_cache size 0 max 16384 2024-09-19T06:20:38.731 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:20:38.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.723+0000 7fbc49000640 1 -- 172.21.15.3:0/3433859505 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbc280a33b0 msgr2=0x7fbc280a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:38.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.723+0000 7fbc49000640 1 --2- 172.21.15.3:0/3433859505 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbc280a33b0 0x7fbc280a5870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c02f3f0 tx=0x7fbc3c005d80 comp rx=0 tx=0).stop 2024-09-19T06:20:38.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.723+0000 7fbc49000640 1 -- 172.21.15.3:0/3433859505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc441049c0 msgr2=0x7fbc4419ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:38.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.723+0000 7fbc49000640 1 --2- 172.21.15.3:0/3433859505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc441049c0 0x7fbc4419ac00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c00e9f0 tx=0x7fbc2c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.723+0000 7fbc49000640 1 -- 172.21.15.3:0/3433859505 shutdown_connections 2024-09-19T06:20:38.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.723+0000 7fbc49000640 1 --2- 172.21.15.3:0/3433859505 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbc280a33b0 0x7fbc280a5870 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.723+0000 7fbc49000640 1 --2- 172.21.15.3:0/3433859505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc44109140 0x7fbc4419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.723+0000 7fbc49000640 1 --2- 172.21.15.3:0/3433859505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc441049c0 0x7fbc4419ac00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.723+0000 7fbc49000640 1 --2- 172.21.15.3:0/3433859505 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc44104010 0x7fbc4419a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:38.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.723+0000 7fbc49000640 1 -- 172.21.15.3:0/3433859505 >> 172.21.15.3:0/3433859505 conn(0x7fbc440ffa50 msgr2=0x7fbc44100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:38.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.723+0000 7fbc49000640 1 -- 172.21.15.3:0/3433859505 shutdown_connections 2024-09-19T06:20:38.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:38.723+0000 7fbc49000640 1 -- 172.21.15.3:0/3433859505 wait complete. 2024-09-19T06:20:39.542 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:20:39.926 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:40.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:40 smithi003 ceph-mon[30893]: pgmap v255: 97 pgs: 97 active+clean; 3.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-19T06:20:40.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:40 smithi071 ceph-mon[35662]: pgmap v255: 97 pgs: 97 active+clean; 3.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-19T06:20:40.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:40 smithi059 ceph-mon[35138]: pgmap v255: 97 pgs: 97 active+clean; 3.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-19T06:20:40.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.664+0000 7fd8db600640 1 -- 172.21.15.3:0/4027370437 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8d4109140 msgr2=0x7fd8d4110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:40.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.664+0000 7fd8db600640 1 --2- 172.21.15.3:0/4027370437 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8d4109140 0x7fd8d4110cc0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc009ca0 tx=0x7fd8cc02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.664+0000 7fd8db600640 1 -- 172.21.15.3:0/4027370437 shutdown_connections 2024-09-19T06:20:40.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.664+0000 7fd8db600640 1 --2- 172.21.15.3:0/4027370437 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8d4109140 0x7fd8d4110cc0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.664+0000 7fd8db600640 1 --2- 172.21.15.3:0/4027370437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d41049c0 0x7fd8d4108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.664+0000 7fd8db600640 1 --2- 172.21.15.3:0/4027370437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8d4104010 0x7fd8d41043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.664+0000 7fd8db600640 1 -- 172.21.15.3:0/4027370437 >> 172.21.15.3:0/4027370437 conn(0x7fd8d40ffa50 msgr2=0x7fd8d4101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:40.666 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.664+0000 7fd8db600640 1 -- 172.21.15.3:0/4027370437 shutdown_connections 2024-09-19T06:20:40.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.664+0000 7fd8db600640 1 -- 172.21.15.3:0/4027370437 wait complete. 2024-09-19T06:20:40.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.665+0000 7fd8db600640 1 Processor -- start 2024-09-19T06:20:40.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.665+0000 7fd8db600640 1 -- start start 2024-09-19T06:20:40.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.666+0000 7fd8db600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8d4104010 0x7fd8d419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:40.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.666+0000 7fd8db600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8d41049c0 0x7fd8d419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:40.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.666+0000 7fd8db600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d4109140 0x7fd8d419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:40.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.666+0000 7fd8db600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d41141c0 con 0x7fd8d4104010 2024-09-19T06:20:40.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.666+0000 7fd8db600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d4114040 con 0x7fd8d4109140 2024-09-19T06:20:40.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.666+0000 7fd8db600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d4114340 con 0x7fd8d41049c0 2024-09-19T06:20:40.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.666+0000 7fd8d8c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8d4104010 0x7fd8d419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:40.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.666+0000 7fd8d8c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8d4104010 0x7fd8d419a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60180/0 (socket says 172.21.15.3:60180) 2024-09-19T06:20:40.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.666+0000 7fd8d8c00640 1 -- 172.21.15.3:0/2204520911 learned_addr learned my addr 172.21.15.3:0/2204520911 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:40.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.666+0000 7fd8d3e00640 1 --2- 172.21.15.3:0/2204520911 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8d41049c0 0x7fd8d419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:40.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.666+0000 7fd8d9600640 1 --2- 172.21.15.3:0/2204520911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d4109140 0x7fd8d419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:40.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.667+0000 7fd8d8c00640 1 -- 172.21.15.3:0/2204520911 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8d41049c0 msgr2=0x7fd8d419ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:40.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.667+0000 7fd8d8c00640 1 --2- 172.21.15.3:0/2204520911 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8d41049c0 0x7fd8d419ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.667+0000 7fd8d8c00640 1 -- 172.21.15.3:0/2204520911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d4109140 msgr2=0x7fd8d419ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:40.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.667+0000 7fd8d8c00640 1 --2- 172.21.15.3:0/2204520911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d4109140 0x7fd8d419ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.667+0000 7fd8d8c00640 1 -- 172.21.15.3:0/2204520911 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d419f670 con 0x7fd8d4104010 2024-09-19T06:20:40.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.667+0000 7fd8d8c00640 1 --2- 172.21.15.3:0/2204520911 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8d4104010 0x7fd8d419a6c0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd8c800e9f0 tx=0x7fd8c800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:40.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.667+0000 7fd8d1600640 1 -- 172.21.15.3:0/2204520911 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c800cd80 con 0x7fd8d4104010 2024-09-19T06:20:40.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.667+0000 7fd8d1600640 1 -- 172.21.15.3:0/2204520911 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8c8005500 con 0x7fd8d4104010 2024-09-19T06:20:40.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.667+0000 7fd8db600640 1 -- 172.21.15.3:0/2204520911 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d419f960 con 0x7fd8d4104010 2024-09-19T06:20:40.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.667+0000 7fd8d1600640 1 -- 172.21.15.3:0/2204520911 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8010690 con 0x7fd8d4104010 2024-09-19T06:20:40.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.668+0000 7fd8db600640 1 -- 172.21.15.3:0/2204520911 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d41a7240 con 0x7fd8d4104010 2024-09-19T06:20:40.672 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.670+0000 7fd8ddfd7740 1 Processor -- start 2024-09-19T06:20:40.672 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.671+0000 7fd8d1600640 1 -- 172.21.15.3:0/2204520911 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fd8c80046c0 con 0x7fd8d4104010 2024-09-19T06:20:40.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.671+0000 7fd8ddfd7740 1 -- start start 2024-09-19T06:20:40.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.671+0000 7fd8ddfd7740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da847c70 0x5574da848050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:40.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.671+0000 7fd8ddfd7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da848590 0x5574da852910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:40.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.671+0000 7fd8ddfd7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5574da852e50 0x5574da855240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:40.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.671+0000 7fd8ddfd7740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5574da7ae3e0 con 0x5574da847c70 2024-09-19T06:20:40.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.671+0000 7fd8ddfd7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5574da755d80 con 0x5574da848590 2024-09-19T06:20:40.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.671+0000 7fd8ddfd7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5574da7aa3a0 con 0x5574da852e50 2024-09-19T06:20:40.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.671+0000 7fd8d9600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da847c70 0x5574da848050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:40.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.671+0000 7fd8d3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5574da852e50 0x5574da855240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:40.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.671+0000 7fd8d9600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da847c70 0x5574da848050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60192/0 (socket says 172.21.15.3:60192) 2024-09-19T06:20:40.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.671+0000 7fd8d9600640 1 -- 172.21.15.3:0/1415335764 learned_addr learned my addr 172.21.15.3:0/1415335764 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:40.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.671+0000 7fd8d8c00640 1 --2- 172.21.15.3:0/1415335764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da848590 0x5574da852910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:40.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.672+0000 7fd8d3e00640 1 -- 172.21.15.3:0/1415335764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da848590 msgr2=0x5574da852910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:40.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.672+0000 7fd8d3e00640 1 --2- 172.21.15.3:0/1415335764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da848590 0x5574da852910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.672+0000 7fd8d3e00640 1 -- 172.21.15.3:0/1415335764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da847c70 msgr2=0x5574da848050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:40.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.672+0000 7fd8d3e00640 1 --2- 172.21.15.3:0/1415335764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da847c70 0x5574da848050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.672+0000 7fd8d3e00640 1 -- 172.21.15.3:0/1415335764 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574da774ae0 con 0x5574da852e50 2024-09-19T06:20:40.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.672+0000 7fd8d8c00640 1 --2- 172.21.15.3:0/1415335764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da848590 0x5574da852910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:40.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.672+0000 7fd8d3e00640 1 --2- 172.21.15.3:0/1415335764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5574da852e50 0x5574da855240 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0009bf0 tx=0x7fd8c0011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a210e61f7ecb7f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:40.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.672+0000 7fd8c5c00640 1 -- 172.21.15.3:0/1415335764 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0004050 con 0x5574da852e50 2024-09-19T06:20:40.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.672+0000 7fd8c5c00640 1 -- 172.21.15.3:0/1415335764 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8c0005500 con 0x5574da852e50 2024-09-19T06:20:40.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.673+0000 7fd8c5c00640 1 -- 172.21.15.3:0/1415335764 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0004dd0 con 0x5574da852e50 2024-09-19T06:20:40.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.673+0000 7fd8d1600640 1 --2- 172.21.15.3:0/2204520911 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd8bc0a33b0 0x7fd8bc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:40.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.673+0000 7fd8d1600640 1 -- 172.21.15.3:0/2204520911 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7fd8c80d0160 con 0x7fd8d4104010 2024-09-19T06:20:40.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.673+0000 7fd8d9600640 1 --2- 172.21.15.3:0/2204520911 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd8bc0a33b0 0x7fd8bc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:40.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.673+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/1415335764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5574da852e50 msgr2=0x5574da855240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:40.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.673+0000 7fd8ddfd7740 1 --2- 172.21.15.3:0/1415335764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5574da852e50 0x5574da855240 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0009bf0 tx=0x7fd8c0011810 comp rx=0 tx=0).stop 2024-09-19T06:20:40.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.673+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/1415335764 shutdown_connections 2024-09-19T06:20:40.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.673+0000 7fd8ddfd7740 1 --2- 172.21.15.3:0/1415335764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5574da852e50 0x5574da855240 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.673+0000 7fd8ddfd7740 1 --2- 172.21.15.3:0/1415335764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da848590 0x5574da852910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.673+0000 7fd8ddfd7740 1 --2- 172.21.15.3:0/1415335764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da847c70 0x5574da848050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.673+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/1415335764 >> 172.21.15.3:0/1415335764 conn(0x5574da844200 msgr2=0x5574da8445e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:40.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.674+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/1415335764 shutdown_connections 2024-09-19T06:20:40.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.674+0000 7fd8d9600640 1 --2- 172.21.15.3:0/2204520911 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd8bc0a33b0 0x7fd8bc0a5870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc009a60 tx=0x7fd8cc005d80 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:40.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.674+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/1415335764 wait complete. 2024-09-19T06:20:40.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.674+0000 7fd8ddfd7740 1 -- start start 2024-09-19T06:20:40.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.674+0000 7fd8ddfd7740 1 Processor -- start 2024-09-19T06:20:40.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.675+0000 7fd8ddfd7740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da847c70 0x5574da84fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:40.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.675+0000 7fd8ddfd7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5574da848590 0x5574da850230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:40.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.675+0000 7fd8ddfd7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da852e50 0x5574da850770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:40.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.675+0000 7fd8ddfd7740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5574da855a20 con 0x5574da847c70 2024-09-19T06:20:40.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.675+0000 7fd8ddfd7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5574da7690f0 con 0x5574da852e50 2024-09-19T06:20:40.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.675+0000 7fd8ddfd7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5574da855ba0 con 0x5574da848590 2024-09-19T06:20:40.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.675+0000 7fd8ddfd7740 10 client.0 _ll_register_callbacks cb 0x5574da750bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:40.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.675+0000 7fd8d8c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da847c70 0x5574da84fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:40.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.675+0000 7fd8d3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5574da848590 0x5574da850230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:40.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.675+0000 7fd8d8c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da847c70 0x5574da84fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60204/0 (socket says 172.21.15.3:60204) 2024-09-19T06:20:40.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.675+0000 7fd8d8c00640 1 -- 172.21.15.3:0/3087526527 learned_addr learned my addr 172.21.15.3:0/3087526527 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:40.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.675+0000 7fd8d9600640 1 --2- 172.21.15.3:0/3087526527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da852e50 0x5574da850770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:40.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.676+0000 7fd8d8c00640 1 -- 172.21.15.3:0/3087526527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5574da848590 msgr2=0x5574da850230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:40.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.676+0000 7fd8d8c00640 1 --2- 172.21.15.3:0/3087526527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5574da848590 0x5574da850230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.676+0000 7fd8d8c00640 1 -- 172.21.15.3:0/3087526527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da852e50 msgr2=0x5574da850770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:40.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.676+0000 7fd8d8c00640 1 --2- 172.21.15.3:0/3087526527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da852e50 0x5574da850770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.676+0000 7fd8d8c00640 1 -- 172.21.15.3:0/3087526527 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574da51f3c0 con 0x5574da847c70 2024-09-19T06:20:40.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.676+0000 7fd8d3e00640 1 --2- 172.21.15.3:0/3087526527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5574da848590 0x5574da850230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:40.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.676+0000 7fd8d9600640 1 --2- 172.21.15.3:0/3087526527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da852e50 0x5574da850770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:40.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.676+0000 7fd8d8c00640 1 --2- 172.21.15.3:0/3087526527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da847c70 0x5574da84fcf0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd8c800e9c0 tx=0x7fd8c8004ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf5b779b1ee5c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:40.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.676+0000 7fd8ba000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:20:40.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.676+0000 7fd8ba000640 1 -- 172.21.15.3:0/3087526527 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c809bdb0 con 0x5574da847c70 2024-09-19T06:20:40.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.676+0000 7fd8ba000640 1 -- 172.21.15.3:0/3087526527 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7fd8c80a4e30 con 0x5574da847c70 2024-09-19T06:20:40.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.676+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/3087526527 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8c0005500 con 0x5574da847c70 2024-09-19T06:20:40.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.676+0000 7fd8ba000640 1 -- 172.21.15.3:0/3087526527 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd8c809cb50 con 0x5574da847c70 2024-09-19T06:20:40.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.677+0000 7fd8ddfd7740 10 client.17574 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:40.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.677+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/3087526527 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5574da861a70 con 0x5574da847c70 2024-09-19T06:20:40.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.677+0000 7fd8ba000640 1 -- 172.21.15.3:0/3087526527 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8c0005500 con 0x5574da847c70 2024-09-19T06:20:40.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.677+0000 7fd8ba000640 1 -- 172.21.15.3:0/3087526527 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd8c80d3bc0 con 0x5574da847c70 2024-09-19T06:20:40.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.677+0000 7fd8ddfd7740 10 client.17574 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:40.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.677+0000 7fd8ddfd7740 10 client.17574 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:20:40.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.677+0000 7fd8ddfd7740 20 client.17574 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:40.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.677+0000 7fd8ddfd7740 1 --2- 172.21.15.3:0/3087526527 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x5574da862e80 0x5574da8652f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:40.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.677+0000 7fd8ddfd7740 4 client.17574 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:40.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.677+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/3087526527 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5574da7bb950 con 0x5574da862e80 2024-09-19T06:20:40.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.678+0000 7fd8d3e00640 1 --2- 172.21.15.3:0/3087526527 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x5574da862e80 0x5574da8652f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:40.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.678+0000 7fd8d3e00640 1 --2- 172.21.15.3:0/3087526527 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x5574da862e80 0x5574da8652f0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e2362a691b5fb786 server_cookie=b6d0319f6195bf51 in_seq=0 out_seq=0 2024-09-19T06:20:40.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.678+0000 7fd8ba000640 10 client.17574 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:20:40.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.679+0000 7fd8ba000640 1 -- 172.21.15.3:0/3087526527 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5574da7bb950 con 0x5574da862e80 2024-09-19T06:20:40.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.679+0000 7fd8ba000640 10 client.17574 handle_command_reply: tid=0 2024-09-19T06:20:40.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.679+0000 7fd8ddfd7740 1 client.17574 shutdown 2024-09-19T06:20:40.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.679+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/3087526527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da847c70 msgr2=0x5574da84fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:40.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.679+0000 7fd8ddfd7740 1 --2- 172.21.15.3:0/3087526527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da847c70 0x5574da84fcf0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd8c800e9c0 tx=0x7fd8c8004ba0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.679+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/3087526527 shutdown_connections 2024-09-19T06:20:40.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.679+0000 7fd8ddfd7740 1 --2- 172.21.15.3:0/3087526527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da852e50 0x5574da850770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.679+0000 7fd8ddfd7740 1 --2- 172.21.15.3:0/3087526527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5574da848590 0x5574da850230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.679+0000 7fd8ddfd7740 1 --2- 172.21.15.3:0/3087526527 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x5574da862e80 0x5574da8652f0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.679+0000 7fd8ddfd7740 1 --2- 172.21.15.3:0/3087526527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da847c70 0x5574da84fcf0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.679+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/3087526527 >> 172.21.15.3:0/3087526527 conn(0x5574da844200 msgr2=0x5574da849f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:40.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.679+0000 7fd8ba000640 0 client.17574 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:20:40.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.680+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/3087526527 shutdown_connections 2024-09-19T06:20:40.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.680+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/3087526527 wait complete. 2024-09-19T06:20:40.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.680+0000 7fd8ddfd7740 20 client.17574 trim_cache size 0 max 16384 2024-09-19T06:20:40.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.693+0000 7fd8ddfd7740 1 Processor -- start 2024-09-19T06:20:40.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.694+0000 7fd8ddfd7740 1 -- start start 2024-09-19T06:20:40.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.694+0000 7fd8ddfd7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da847c70 0x5574da851c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:40.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.694+0000 7fd8ddfd7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5574da848590 0x5574da86abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:40.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.694+0000 7fd8ddfd7740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da852e50 0x5574da86b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:40.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.694+0000 7fd8ddfd7740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d41afbf0 con 0x5574da852e50 2024-09-19T06:20:40.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.694+0000 7fd8ddfd7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d41b1730 con 0x5574da847c70 2024-09-19T06:20:40.696 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.694+0000 7fd8ddfd7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d41b02c0 con 0x5574da848590 2024-09-19T06:20:40.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.694+0000 7fd8d9600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da852e50 0x5574da86b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:40.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.694+0000 7fd8d9600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da852e50 0x5574da86b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60212/0 (socket says 172.21.15.3:60212) 2024-09-19T06:20:40.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.694+0000 7fd8d9600640 1 -- 172.21.15.3:0/2045974227 learned_addr learned my addr 172.21.15.3:0/2045974227 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:40.697 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.694+0000 7fd8d8c00640 1 --2- 172.21.15.3:0/2045974227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da847c70 0x5574da851c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:40.698 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.694+0000 7fd8d3e00640 1 --2- 172.21.15.3:0/2045974227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5574da848590 0x5574da86abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:40.698 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.695+0000 7fd8d8c00640 1 -- 172.21.15.3:0/2045974227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5574da848590 msgr2=0x5574da86abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:40.698 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.695+0000 7fd8d8c00640 1 --2- 172.21.15.3:0/2045974227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5574da848590 0x5574da86abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.698 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.695+0000 7fd8d8c00640 1 -- 172.21.15.3:0/2045974227 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da852e50 msgr2=0x5574da86b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:40.698 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.695+0000 7fd8d8c00640 1 --2- 172.21.15.3:0/2045974227 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da852e50 0x5574da86b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.698 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.695+0000 7fd8d8c00640 1 -- 172.21.15.3:0/2045974227 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574da849180 con 0x5574da847c70 2024-09-19T06:20:40.698 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.695+0000 7fd8d9600640 1 --2- 172.21.15.3:0/2045974227 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da852e50 0x5574da86b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:40.698 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.695+0000 7fd8d3e00640 1 --2- 172.21.15.3:0/2045974227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5574da848590 0x5574da86abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:40.698 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.695+0000 7fd8d8c00640 1 --2- 172.21.15.3:0/2045974227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da847c70 0x5574da851c60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd8c809c3e0 tx=0x7fd8c8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0fe307cbc4dc478 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:40.698 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.695+0000 7fd8c5200640 1 -- 172.21.15.3:0/2045974227 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c809bdb0 con 0x5574da847c70 2024-09-19T06:20:40.698 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.695+0000 7fd8c5200640 1 -- 172.21.15.3:0/2045974227 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8c80b5220 con 0x5574da847c70 2024-09-19T06:20:40.698 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.695+0000 7fd8c5200640 1 -- 172.21.15.3:0/2045974227 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c809c220 con 0x5574da847c70 2024-09-19T06:20:40.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.696+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/2045974227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da847c70 msgr2=0x5574da851c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:40.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.696+0000 7fd8ddfd7740 1 --2- 172.21.15.3:0/2045974227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da847c70 0x5574da851c60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd8c809c3e0 tx=0x7fd8c8004a40 comp rx=0 tx=0).stop 2024-09-19T06:20:40.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.696+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/2045974227 shutdown_connections 2024-09-19T06:20:40.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.696+0000 7fd8ddfd7740 1 --2- 172.21.15.3:0/2045974227 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da852e50 0x5574da86b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.696+0000 7fd8ddfd7740 1 --2- 172.21.15.3:0/2045974227 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5574da848590 0x5574da86abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.696+0000 7fd8ddfd7740 1 --2- 172.21.15.3:0/2045974227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da847c70 0x5574da851c60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.696+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/2045974227 >> 172.21.15.3:0/2045974227 conn(0x5574da844200 msgr2=0x5574da851550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:40.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.696+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/2045974227 shutdown_connections 2024-09-19T06:20:40.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.696+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/2045974227 wait complete. 2024-09-19T06:20:40.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.697+0000 7fd8ddfd7740 1 -- start start 2024-09-19T06:20:40.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.697+0000 7fd8ddfd7740 1 Processor -- start 2024-09-19T06:20:40.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.697+0000 7fd8ddfd7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5574da847c70 0x5574da85b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:40.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.697+0000 7fd8ddfd7740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da848590 0x5574da85b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:40.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.697+0000 7fd8ddfd7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da852e50 0x5574da856750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:40.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.697+0000 7fd8ddfd7740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d41b1060 con 0x5574da848590 2024-09-19T06:20:40.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.697+0000 7fd8ddfd7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d41b0990 con 0x5574da852e50 2024-09-19T06:20:40.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.697+0000 7fd8ddfd7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d41adbf0 con 0x5574da847c70 2024-09-19T06:20:40.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.697+0000 7fd8ddfd7740 10 client.0 _ll_register_callbacks cb 0x7fd8c80980b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:40.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.698+0000 7fd8d9600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da852e50 0x5574da856750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:40.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.698+0000 7fd8d8c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5574da847c70 0x5574da85b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:40.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.698+0000 7fd8d9600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da852e50 0x5574da856750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:46094/0 (socket says 172.21.15.3:46094) 2024-09-19T06:20:40.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.698+0000 7fd8d9600640 1 -- 172.21.15.3:0/3138412317 learned_addr learned my addr 172.21.15.3:0/3138412317 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:40.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.698+0000 7fd8d3e00640 1 --2- 172.21.15.3:0/3138412317 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da848590 0x5574da85b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:40.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.698+0000 7fd8d9600640 1 -- 172.21.15.3:0/3138412317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5574da847c70 msgr2=0x5574da85b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:40.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.698+0000 7fd8d9600640 1 --2- 172.21.15.3:0/3138412317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5574da847c70 0x5574da85b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.698+0000 7fd8d9600640 1 -- 172.21.15.3:0/3138412317 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da848590 msgr2=0x5574da85b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:40.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.698+0000 7fd8d9600640 1 --2- 172.21.15.3:0/3138412317 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da848590 0x5574da85b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.698+0000 7fd8d9600640 1 -- 172.21.15.3:0/3138412317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574da856f80 con 0x5574da852e50 2024-09-19T06:20:40.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.698+0000 7fd8d8c00640 1 --2- 172.21.15.3:0/3138412317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5574da847c70 0x5574da85b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:40.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.698+0000 7fd8d9600640 1 --2- 172.21.15.3:0/3138412317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da852e50 0x5574da856750 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc032010 tx=0x7fd8cc0095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f029e4795c0a001b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:40.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.698+0000 7fd8ba000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:20:40.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.699+0000 7fd8ba000640 1 -- 172.21.15.3:0/3138412317 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc059060 con 0x5574da852e50 2024-09-19T06:20:40.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.699+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/3138412317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5574da7b5e60 con 0x5574da852e50 2024-09-19T06:20:40.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.699+0000 7fd8ba000640 1 -- 172.21.15.3:0/3138412317 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7fd8cc0318e0 con 0x5574da852e50 2024-09-19T06:20:40.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.699+0000 7fd8ba000640 1 -- 172.21.15.3:0/3138412317 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd8cc004040 con 0x5574da852e50 2024-09-19T06:20:40.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.699+0000 7fd8ddfd7740 10 client.27614 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:40.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.699+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/3138412317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5574da8cd8b0 con 0x5574da852e50 2024-09-19T06:20:40.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.700+0000 7fd8ba000640 1 -- 172.21.15.3:0/3138412317 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5574da7b5e60 con 0x5574da852e50 2024-09-19T06:20:40.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.700+0000 7fd8ba000640 1 -- 172.21.15.3:0/3138412317 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd8cc02fb90 con 0x5574da852e50 2024-09-19T06:20:40.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.700+0000 7fd8ddfd7740 10 client.27614 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:40.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.700+0000 7fd8ddfd7740 10 client.27614 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:20:40.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.700+0000 7fd8ddfd7740 20 client.27614 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:40.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.700+0000 7fd8ddfd7740 1 --2- 172.21.15.3:0/3138412317 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x5574da8cdf80 0x5574da8d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:40.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.700+0000 7fd8ddfd7740 4 client.27614 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:40.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.700+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/3138412317 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5574da732010 con 0x5574da8cdf80 2024-09-19T06:20:40.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.700+0000 7fd8d8c00640 1 --2- 172.21.15.3:0/3138412317 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x5574da8cdf80 0x5574da8d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:40.705 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.701+0000 7fd8d8c00640 1 --2- 172.21.15.3:0/3138412317 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x5574da8cdf80 0x5574da8d0370 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=19b88963dda63ef1 server_cookie=6dd6e754b880d4d6 in_seq=0 out_seq=0 2024-09-19T06:20:40.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.701+0000 7fd8ba000640 10 client.27614 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:20:40.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.701+0000 7fd8ba000640 1 -- 172.21.15.3:0/3138412317 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5574da732010 con 0x5574da8cdf80 2024-09-19T06:20:40.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.701+0000 7fd8ba000640 10 client.27614 handle_command_reply: tid=0 2024-09-19T06:20:40.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.701+0000 7fd8ddfd7740 1 client.27614 shutdown 2024-09-19T06:20:40.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.701+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/3138412317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da852e50 msgr2=0x5574da856750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:40.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.701+0000 7fd8ddfd7740 1 --2- 172.21.15.3:0/3138412317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da852e50 0x5574da856750 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc032010 tx=0x7fd8cc0095c0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.701+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/3138412317 shutdown_connections 2024-09-19T06:20:40.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.701+0000 7fd8ddfd7740 1 --2- 172.21.15.3:0/3138412317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5574da852e50 0x5574da856750 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.701+0000 7fd8ddfd7740 1 --2- 172.21.15.3:0/3138412317 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x5574da8cdf80 0x5574da8d0370 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.701+0000 7fd8ddfd7740 1 --2- 172.21.15.3:0/3138412317 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5574da848590 0x5574da85b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.701+0000 7fd8ddfd7740 1 --2- 172.21.15.3:0/3138412317 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5574da847c70 0x5574da85b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.701+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/3138412317 >> 172.21.15.3:0/3138412317 conn(0x5574da844200 msgr2=0x5574da85e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:40.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.701+0000 7fd8ba000640 0 client.27614 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:20:40.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.701+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/3138412317 shutdown_connections 2024-09-19T06:20:40.706 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.701+0000 7fd8ddfd7740 1 -- 172.21.15.3:0/3138412317 wait complete. 2024-09-19T06:20:40.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.701+0000 7fd8ddfd7740 20 client.27614 trim_cache size 0 max 16384 2024-09-19T06:20:40.707 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:20:40.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.702+0000 7fd8db600640 1 -- 172.21.15.3:0/2204520911 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd8bc0a33b0 msgr2=0x7fd8bc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.702+0000 7fd8db600640 1 --2- 172.21.15.3:0/2204520911 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd8bc0a33b0 0x7fd8bc0a5870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc009a60 tx=0x7fd8cc005d80 comp rx=0 tx=0).stop 2024-09-19T06:20:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.702+0000 7fd8db600640 1 -- 172.21.15.3:0/2204520911 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8d4104010 msgr2=0x7fd8d419a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.702+0000 7fd8db600640 1 --2- 172.21.15.3:0/2204520911 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8d4104010 0x7fd8d419a6c0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd8c800e9f0 tx=0x7fd8c800edf0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.702+0000 7fd8db600640 1 -- 172.21.15.3:0/2204520911 shutdown_connections 2024-09-19T06:20:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.702+0000 7fd8db600640 1 --2- 172.21.15.3:0/2204520911 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd8bc0a33b0 0x7fd8bc0a5870 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.702+0000 7fd8db600640 1 --2- 172.21.15.3:0/2204520911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8d4109140 0x7fd8d419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.702+0000 7fd8db600640 1 --2- 172.21.15.3:0/2204520911 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd8d41049c0 0x7fd8d419ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.702+0000 7fd8db600640 1 --2- 172.21.15.3:0/2204520911 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd8d4104010 0x7fd8d419a6c0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.702+0000 7fd8db600640 1 -- 172.21.15.3:0/2204520911 >> 172.21.15.3:0/2204520911 conn(0x7fd8d40ffa50 msgr2=0x7fd8d4100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.702+0000 7fd8db600640 1 -- 172.21.15.3:0/2204520911 shutdown_connections 2024-09-19T06:20:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:40.702+0000 7fd8db600640 1 -- 172.21.15.3:0/2204520911 wait complete. 2024-09-19T06:20:41.543 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:20:41.939 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:42.325 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:42 smithi003 ceph-mon[30893]: pgmap v256: 97 pgs: 97 active+clean; 3.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:20:42.325 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:42 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:20:42.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:42 smithi071 ceph-mon[35662]: pgmap v256: 97 pgs: 97 active+clean; 3.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:20:42.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:42 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:20:42.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:42 smithi059 ceph-mon[35138]: pgmap v256: 97 pgs: 97 active+clean; 3.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:20:42.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:42 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:20:42.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.591+0000 7f2d54400640 1 -- 172.21.15.3:0/2163123057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d4c1049a0 msgr2=0x7f2d4c1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:42.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.591+0000 7f2d54400640 1 --2- 172.21.15.3:0/2163123057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d4c1049a0 0x7f2d4c1089f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2d38009900 tx=0x7f2d3802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.591+0000 7f2d54400640 1 -- 172.21.15.3:0/2163123057 shutdown_connections 2024-09-19T06:20:42.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.591+0000 7f2d54400640 1 --2- 172.21.15.3:0/2163123057 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d4c109120 0x7f2d4c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.591+0000 7f2d54400640 1 --2- 172.21.15.3:0/2163123057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d4c1049a0 0x7f2d4c1089f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.591+0000 7f2d54400640 1 --2- 172.21.15.3:0/2163123057 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d4c103ff0 0x7f2d4c1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.591+0000 7f2d54400640 1 -- 172.21.15.3:0/2163123057 >> 172.21.15.3:0/2163123057 conn(0x7f2d4c0ffa90 msgr2=0x7f2d4c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:42.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.591+0000 7f2d54400640 1 -- 172.21.15.3:0/2163123057 shutdown_connections 2024-09-19T06:20:42.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.591+0000 7f2d54400640 1 -- 172.21.15.3:0/2163123057 wait complete. 2024-09-19T06:20:42.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.592+0000 7f2d54400640 1 Processor -- start 2024-09-19T06:20:42.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.592+0000 7f2d54400640 1 -- start start 2024-09-19T06:20:42.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.592+0000 7f2d54400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d4c103ff0 0x7f2d4c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.592+0000 7f2d54400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d4c1049a0 0x7f2d4c19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.592+0000 7f2d54400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d4c109120 0x7f2d4c19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.592+0000 7f2d54400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4c114170 con 0x7f2d4c109120 2024-09-19T06:20:42.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.592+0000 7f2d54400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4c113ff0 con 0x7f2d4c103ff0 2024-09-19T06:20:42.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.592+0000 7f2d54400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4c1142f0 con 0x7f2d4c1049a0 2024-09-19T06:20:42.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.593+0000 7f2d51000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d4c1049a0 0x7f2d4c19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.593+0000 7f2d51000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d4c1049a0 0x7f2d4c19ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:56542/0 (socket says 172.21.15.3:56542) 2024-09-19T06:20:42.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.593+0000 7f2d51000640 1 -- 172.21.15.3:0/2882578196 learned_addr learned my addr 172.21.15.3:0/2882578196 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:42.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.593+0000 7f2d52400640 1 --2- 172.21.15.3:0/2882578196 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d4c109120 0x7f2d4c19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.593+0000 7f2d51a00640 1 --2- 172.21.15.3:0/2882578196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d4c103ff0 0x7f2d4c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.593+0000 7f2d51000640 1 -- 172.21.15.3:0/2882578196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d4c103ff0 msgr2=0x7f2d4c19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:42.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.593+0000 7f2d51000640 1 --2- 172.21.15.3:0/2882578196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d4c103ff0 0x7f2d4c19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.593+0000 7f2d51000640 1 -- 172.21.15.3:0/2882578196 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d4c109120 msgr2=0x7f2d4c19ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:42.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.593+0000 7f2d51000640 1 --2- 172.21.15.3:0/2882578196 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d4c109120 0x7f2d4c19ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.593+0000 7f2d51000640 1 -- 172.21.15.3:0/2882578196 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d4c19f600 con 0x7f2d4c1049a0 2024-09-19T06:20:42.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.593+0000 7f2d51a00640 1 --2- 172.21.15.3:0/2882578196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d4c103ff0 0x7f2d4c19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:42.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.593+0000 7f2d52400640 1 --2- 172.21.15.3:0/2882578196 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d4c109120 0x7f2d4c19ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:42.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.594+0000 7f2d51000640 1 --2- 172.21.15.3:0/2882578196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d4c1049a0 0x7f2d4c19ab90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2d38004770 tx=0x7f2d38003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:42.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.594+0000 7f2d4a000640 1 -- 172.21.15.3:0/2882578196 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d3803f070 con 0x7f2d4c1049a0 2024-09-19T06:20:42.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.594+0000 7f2d4a000640 1 -- 172.21.15.3:0/2882578196 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d38031ca0 con 0x7f2d4c1049a0 2024-09-19T06:20:42.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.594+0000 7f2d54400640 1 -- 172.21.15.3:0/2882578196 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d4c19f890 con 0x7f2d4c1049a0 2024-09-19T06:20:42.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.594+0000 7f2d4a000640 1 -- 172.21.15.3:0/2882578196 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d38035030 con 0x7f2d4c1049a0 2024-09-19T06:20:42.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.595+0000 7f2d54400640 1 -- 172.21.15.3:0/2882578196 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d4c1a71d0 con 0x7f2d4c1049a0 2024-09-19T06:20:42.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.598+0000 7f2d56fec740 1 Processor -- start 2024-09-19T06:20:42.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.598+0000 7f2d56fec740 1 -- start start 2024-09-19T06:20:42.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.598+0000 7f2d56fec740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d1c70 0x563a259d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.598+0000 7f2d56fec740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259d2590 0x563a259dc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.598+0000 7f2d56fec740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a259dce50 0x563a259df240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.598+0000 7f2d56fec740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563a259383e0 con 0x563a259d1c70 2024-09-19T06:20:42.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.598+0000 7f2d56fec740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563a258dfd80 con 0x563a259d2590 2024-09-19T06:20:42.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.598+0000 7f2d56fec740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563a259343a0 con 0x563a259dce50 2024-09-19T06:20:42.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.599+0000 7f2d52400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d1c70 0x563a259d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.599+0000 7f2d51a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259d2590 0x563a259dc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.599+0000 7f2d52400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d1c70 0x563a259d2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60234/0 (socket says 172.21.15.3:60234) 2024-09-19T06:20:42.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.599+0000 7f2d51a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259d2590 0x563a259dc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:46116/0 (socket says 172.21.15.3:46116) 2024-09-19T06:20:42.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.599+0000 7f2d52400640 1 -- 172.21.15.3:0/2418223177 learned_addr learned my addr 172.21.15.3:0/2418223177 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:42.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.599+0000 7f2d51a00640 1 -- 172.21.15.3:0/2418223177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a259dce50 msgr2=0x563a259df240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T06:20:42.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.599+0000 7f2d51a00640 1 --2- 172.21.15.3:0/2418223177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a259dce50 0x563a259df240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.599+0000 7f2d51a00640 1 -- 172.21.15.3:0/2418223177 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d1c70 msgr2=0x563a259d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:42.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.599+0000 7f2d51a00640 1 --2- 172.21.15.3:0/2418223177 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d1c70 0x563a259d2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.599+0000 7f2d51a00640 1 -- 172.21.15.3:0/2418223177 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a258feae0 con 0x563a259d2590 2024-09-19T06:20:42.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.599+0000 7f2d4a000640 1 -- 172.21.15.3:0/2882578196 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f2d38042070 con 0x7f2d4c1049a0 2024-09-19T06:20:42.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.599+0000 7f2d51a00640 1 --2- 172.21.15.3:0/2418223177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259d2590 0x563a259dc910 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2d40009fd0 tx=0x7f2d400118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=911149a847b2e48e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:42.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.600+0000 7f2d3ea00640 1 -- 172.21.15.3:0/2418223177 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d40004030 con 0x563a259d2590 2024-09-19T06:20:42.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.600+0000 7f2d3ea00640 1 -- 172.21.15.3:0/2418223177 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d40005500 con 0x563a259d2590 2024-09-19T06:20:42.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.600+0000 7f2d3ea00640 1 -- 172.21.15.3:0/2418223177 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d40004e10 con 0x563a259d2590 2024-09-19T06:20:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.600+0000 7f2d56fec740 1 -- 172.21.15.3:0/2418223177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259d2590 msgr2=0x563a259dc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.600+0000 7f2d56fec740 1 --2- 172.21.15.3:0/2418223177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259d2590 0x563a259dc910 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2d40009fd0 tx=0x7f2d400118d0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.601+0000 7f2d56fec740 1 -- 172.21.15.3:0/2418223177 shutdown_connections 2024-09-19T06:20:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.601+0000 7f2d56fec740 1 --2- 172.21.15.3:0/2418223177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a259dce50 0x563a259df240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.601+0000 7f2d56fec740 1 --2- 172.21.15.3:0/2418223177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259d2590 0x563a259dc910 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.601+0000 7f2d56fec740 1 --2- 172.21.15.3:0/2418223177 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d1c70 0x563a259d2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.601+0000 7f2d56fec740 1 -- 172.21.15.3:0/2418223177 >> 172.21.15.3:0/2418223177 conn(0x563a259ce200 msgr2=0x563a259ce5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.601+0000 7f2d56fec740 1 -- 172.21.15.3:0/2418223177 shutdown_connections 2024-09-19T06:20:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.601+0000 7f2d56fec740 1 -- 172.21.15.3:0/2418223177 wait complete. 2024-09-19T06:20:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.601+0000 7f2d56fec740 1 -- start start 2024-09-19T06:20:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.601+0000 7f2d56fec740 1 Processor -- start 2024-09-19T06:20:42.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.601+0000 7f2d4a000640 1 --2- 172.21.15.3:0/2882578196 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2d340a3340 0x7f2d340a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.602+0000 7f2d4a000640 1 -- 172.21.15.3:0/2882578196 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f2d380f0390 con 0x7f2d4c1049a0 2024-09-19T06:20:42.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.602+0000 7f2d52400640 1 --2- 172.21.15.3:0/2882578196 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2d340a3340 0x7f2d340a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.602+0000 7f2d56fec740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259d1c70 0x563a259d9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.602+0000 7f2d56fec740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d2590 0x563a259da340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.602+0000 7f2d56fec740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a259dce50 0x563a259da880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.602+0000 7f2d56fec740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563a259dfa20 con 0x563a259d2590 2024-09-19T06:20:42.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.602+0000 7f2d56fec740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563a258f30f0 con 0x563a259d1c70 2024-09-19T06:20:42.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.602+0000 7f2d56fec740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563a259dfba0 con 0x563a259dce50 2024-09-19T06:20:42.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.602+0000 7f2d56fec740 10 client.0 _ll_register_callbacks cb 0x563a258dabd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:42.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.602+0000 7f2d51a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259d1c70 0x563a259d9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.602+0000 7f2d51a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259d1c70 0x563a259d9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:46118/0 (socket says 172.21.15.3:46118) 2024-09-19T06:20:42.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.602+0000 7f2d51a00640 1 -- 172.21.15.3:0/564680683 learned_addr learned my addr 172.21.15.3:0/564680683 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:42.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.602+0000 7f2d51000640 1 --2- 172.21.15.3:0/564680683 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d2590 0x563a259da340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.603+0000 7f2d52400640 1 --2- 172.21.15.3:0/564680683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a259dce50 0x563a259da880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.603+0000 7f2d51a00640 1 -- 172.21.15.3:0/564680683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a259dce50 msgr2=0x563a259da880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:42.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.603+0000 7f2d51a00640 1 --2- 172.21.15.3:0/564680683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a259dce50 0x563a259da880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.603+0000 7f2d51a00640 1 -- 172.21.15.3:0/564680683 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d2590 msgr2=0x563a259da340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:42.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.603+0000 7f2d51a00640 1 --2- 172.21.15.3:0/564680683 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d2590 0x563a259da340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.603+0000 7f2d51a00640 1 -- 172.21.15.3:0/564680683 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a256a93c0 con 0x563a259d1c70 2024-09-19T06:20:42.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.603+0000 7f2d51000640 1 --2- 172.21.15.3:0/564680683 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d2590 0x563a259da340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:42.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.603+0000 7f2d52400640 1 --2- 172.21.15.3:0/564680683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a259dce50 0x563a259da880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:42.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.603+0000 7f2d52400640 1 --2- 172.21.15.3:0/2882578196 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2d340a3340 0x7f2d340a5800 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2d44005fd0 tx=0x7f2d44009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:42.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.603+0000 7f2d51a00640 1 --2- 172.21.15.3:0/564680683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259d1c70 0x563a259d9e00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2d400049f0 tx=0x7f2d40005260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b809933c191f0d4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:42.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.603+0000 7f2d33400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:20:42.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.603+0000 7f2d33400640 1 -- 172.21.15.3:0/564680683 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d40028070 con 0x563a259d1c70 2024-09-19T06:20:42.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.604+0000 7f2d56fec740 1 -- 172.21.15.3:0/564680683 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d40005500 con 0x563a259d1c70 2024-09-19T06:20:42.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.604+0000 7f2d33400640 1 -- 172.21.15.3:0/564680683 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f2d4000f5a0 con 0x563a259d1c70 2024-09-19T06:20:42.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.604+0000 7f2d33400640 1 -- 172.21.15.3:0/564680683 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2d40034050 con 0x563a259d1c70 2024-09-19T06:20:42.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.604+0000 7f2d56fec740 10 client.27626 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:42.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.604+0000 7f2d56fec740 1 -- 172.21.15.3:0/564680683 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563a259ebb00 con 0x563a259d1c70 2024-09-19T06:20:42.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.604+0000 7f2d33400640 1 -- 172.21.15.3:0/564680683 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d40005500 con 0x563a259d1c70 2024-09-19T06:20:42.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.604+0000 7f2d33400640 1 -- 172.21.15.3:0/564680683 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2d40019730 con 0x563a259d1c70 2024-09-19T06:20:42.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.604+0000 7f2d56fec740 10 client.27626 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:42.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.604+0000 7f2d56fec740 10 client.27626 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:20:42.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.604+0000 7f2d56fec740 20 client.27626 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:42.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.605+0000 7f2d56fec740 1 --2- 172.21.15.3:0/564680683 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x563a259ecf10 0x563a259ef300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.605+0000 7f2d56fec740 4 client.27626 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:42.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.605+0000 7f2d56fec740 1 -- 172.21.15.3:0/564680683 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a25945950 con 0x563a259ecf10 2024-09-19T06:20:42.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.605+0000 7f2d51000640 1 --2- 172.21.15.3:0/564680683 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x563a259ecf10 0x563a259ef300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.605+0000 7f2d51000640 1 --2- 172.21.15.3:0/564680683 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x563a259ecf10 0x563a259ef300 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f0934c276a9002d3 server_cookie=f12a83e4f7cc18b5 in_seq=0 out_seq=0 2024-09-19T06:20:42.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.605+0000 7f2d33400640 10 client.27626 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:20:42.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.606+0000 7f2d33400640 1 -- 172.21.15.3:0/564680683 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563a25945950 con 0x563a259ecf10 2024-09-19T06:20:42.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.606+0000 7f2d33400640 10 client.27626 handle_command_reply: tid=0 2024-09-19T06:20:42.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.606+0000 7f2d56fec740 1 client.27626 shutdown 2024-09-19T06:20:42.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.607+0000 7f2d56fec740 1 -- 172.21.15.3:0/564680683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259d1c70 msgr2=0x563a259d9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:42.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.607+0000 7f2d56fec740 1 --2- 172.21.15.3:0/564680683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259d1c70 0x563a259d9e00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2d400049f0 tx=0x7f2d40005260 comp rx=0 tx=0).stop 2024-09-19T06:20:42.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.607+0000 7f2d56fec740 1 -- 172.21.15.3:0/564680683 shutdown_connections 2024-09-19T06:20:42.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.607+0000 7f2d56fec740 1 --2- 172.21.15.3:0/564680683 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x563a259ecf10 0x563a259ef300 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.607+0000 7f2d56fec740 1 --2- 172.21.15.3:0/564680683 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a259dce50 0x563a259da880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.607+0000 7f2d56fec740 1 --2- 172.21.15.3:0/564680683 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d2590 0x563a259da340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.607+0000 7f2d56fec740 1 --2- 172.21.15.3:0/564680683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259d1c70 0x563a259d9e00 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.607+0000 7f2d56fec740 1 -- 172.21.15.3:0/564680683 >> 172.21.15.3:0/564680683 conn(0x563a259ce200 msgr2=0x563a259d3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:42.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.607+0000 7f2d33400640 0 client.27626 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:20:42.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.607+0000 7f2d56fec740 1 -- 172.21.15.3:0/564680683 shutdown_connections 2024-09-19T06:20:42.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.607+0000 7f2d56fec740 1 -- 172.21.15.3:0/564680683 wait complete. 2024-09-19T06:20:42.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.607+0000 7f2d56fec740 20 client.27626 trim_cache size 0 max 16384 2024-09-19T06:20:42.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.621+0000 7f2d56fec740 1 Processor -- start 2024-09-19T06:20:42.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.621+0000 7f2d56fec740 1 -- start start 2024-09-19T06:20:42.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.622+0000 7f2d56fec740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a259d1c70 0x563a259ef380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.622+0000 7f2d56fec740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d2590 0x563a259f4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.622+0000 7f2d56fec740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259dce50 0x563a259f4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.622+0000 7f2d56fec740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4c1afb70 con 0x563a259d2590 2024-09-19T06:20:42.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.622+0000 7f2d56fec740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4c1b16b0 con 0x563a259dce50 2024-09-19T06:20:42.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.622+0000 7f2d56fec740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4c1b0240 con 0x563a259d1c70 2024-09-19T06:20:42.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.622+0000 7f2d51000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d2590 0x563a259f4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.622+0000 7f2d51000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d2590 0x563a259f4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60246/0 (socket says 172.21.15.3:60246) 2024-09-19T06:20:42.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.622+0000 7f2d51a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a259d1c70 0x563a259ef380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.622+0000 7f2d51000640 1 -- 172.21.15.3:0/4041337651 learned_addr learned my addr 172.21.15.3:0/4041337651 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:42.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.622+0000 7f2d52400640 1 --2- 172.21.15.3:0/4041337651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259dce50 0x563a259f4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.622+0000 7f2d51a00640 1 -- 172.21.15.3:0/4041337651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259dce50 msgr2=0x563a259f4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:42.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.622+0000 7f2d51a00640 1 --2- 172.21.15.3:0/4041337651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259dce50 0x563a259f4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.622+0000 7f2d51a00640 1 -- 172.21.15.3:0/4041337651 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d2590 msgr2=0x563a259f4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:42.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.622+0000 7f2d51a00640 1 --2- 172.21.15.3:0/4041337651 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d2590 0x563a259f4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.622+0000 7f2d51a00640 1 -- 172.21.15.3:0/4041337651 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a259c9770 con 0x563a259d1c70 2024-09-19T06:20:42.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.623+0000 7f2d51000640 1 --2- 172.21.15.3:0/4041337651 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d2590 0x563a259f4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:42.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.623+0000 7f2d51a00640 1 --2- 172.21.15.3:0/4041337651 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a259d1c70 0x563a259ef380 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2d40009230 tx=0x7f2d400059b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8aab7d3456a66876 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:42.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.623+0000 7f2d3e000640 1 -- 172.21.15.3:0/4041337651 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d40028070 con 0x563a259d1c70 2024-09-19T06:20:42.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.623+0000 7f2d3e000640 1 -- 172.21.15.3:0/4041337651 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d40019930 con 0x563a259d1c70 2024-09-19T06:20:42.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.623+0000 7f2d3e000640 1 -- 172.21.15.3:0/4041337651 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4000f800 con 0x563a259d1c70 2024-09-19T06:20:42.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.624+0000 7f2d56fec740 1 -- 172.21.15.3:0/4041337651 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a259d1c70 msgr2=0x563a259ef380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:42.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.624+0000 7f2d56fec740 1 --2- 172.21.15.3:0/4041337651 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a259d1c70 0x563a259ef380 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2d40009230 tx=0x7f2d400059b0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.624+0000 7f2d56fec740 1 -- 172.21.15.3:0/4041337651 shutdown_connections 2024-09-19T06:20:42.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.624+0000 7f2d56fec740 1 --2- 172.21.15.3:0/4041337651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259dce50 0x563a259f4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.624+0000 7f2d56fec740 1 --2- 172.21.15.3:0/4041337651 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d2590 0x563a259f4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.624+0000 7f2d56fec740 1 --2- 172.21.15.3:0/4041337651 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a259d1c70 0x563a259ef380 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.624+0000 7f2d56fec740 1 -- 172.21.15.3:0/4041337651 >> 172.21.15.3:0/4041337651 conn(0x563a259ce200 msgr2=0x563a259d8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:42.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.624+0000 7f2d56fec740 1 -- 172.21.15.3:0/4041337651 shutdown_connections 2024-09-19T06:20:42.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.624+0000 7f2d56fec740 1 -- 172.21.15.3:0/4041337651 wait complete. 2024-09-19T06:20:42.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.625+0000 7f2d56fec740 1 -- start start 2024-09-19T06:20:42.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.625+0000 7f2d56fec740 1 Processor -- start 2024-09-19T06:20:42.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.625+0000 7f2d56fec740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259d1c70 0x563a259dfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.625+0000 7f2d56fec740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d2590 0x563a259e02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.625+0000 7f2d56fec740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a259dce50 0x563a259e0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.625+0000 7f2d56fec740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4c1b0fe0 con 0x563a259d2590 2024-09-19T06:20:42.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.625+0000 7f2d56fec740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4c1b0910 con 0x563a259d1c70 2024-09-19T06:20:42.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.625+0000 7f2d56fec740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4c1adb70 con 0x563a259dce50 2024-09-19T06:20:42.628 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.625+0000 7f2d56fec740 10 client.0 _ll_register_callbacks cb 0x7f2d44009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:42.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.626+0000 7f2d51a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259d1c70 0x563a259dfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.626+0000 7f2d51a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259d1c70 0x563a259dfdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:46138/0 (socket says 172.21.15.3:46138) 2024-09-19T06:20:42.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.626+0000 7f2d51a00640 1 -- 172.21.15.3:0/1226460559 learned_addr learned my addr 172.21.15.3:0/1226460559 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:42.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.626+0000 7f2d51000640 1 --2- 172.21.15.3:0/1226460559 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d2590 0x563a259e02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.626+0000 7f2d52400640 1 --2- 172.21.15.3:0/1226460559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a259dce50 0x563a259e0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.626+0000 7f2d51a00640 1 -- 172.21.15.3:0/1226460559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a259dce50 msgr2=0x563a259e0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:42.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.626+0000 7f2d51a00640 1 --2- 172.21.15.3:0/1226460559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a259dce50 0x563a259e0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.626+0000 7f2d51a00640 1 -- 172.21.15.3:0/1226460559 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d2590 msgr2=0x563a259e02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:42.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.626+0000 7f2d51a00640 1 --2- 172.21.15.3:0/1226460559 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d2590 0x563a259e02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.626+0000 7f2d51a00640 1 -- 172.21.15.3:0/1226460559 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a25a55c50 con 0x563a259d1c70 2024-09-19T06:20:42.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.626+0000 7f2d51000640 1 --2- 172.21.15.3:0/1226460559 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d2590 0x563a259e02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:42.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.626+0000 7f2d51a00640 1 --2- 172.21.15.3:0/1226460559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259d1c70 0x563a259dfdb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2d400196b0 tx=0x7f2d400196e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c48742ea067bc61 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:42.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.626+0000 7f2d33400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:20:42.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.627+0000 7f2d33400640 1 -- 172.21.15.3:0/1226460559 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4003f070 con 0x563a259d1c70 2024-09-19T06:20:42.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.627+0000 7f2d56fec740 1 -- 172.21.15.3:0/1226460559 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d40019930 con 0x563a259d1c70 2024-09-19T06:20:42.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.627+0000 7f2d33400640 1 -- 172.21.15.3:0/1226460559 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f2d4000f5a0 con 0x563a259d1c70 2024-09-19T06:20:42.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.627+0000 7f2d33400640 1 -- 172.21.15.3:0/1226460559 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2d4004b050 con 0x563a259d1c70 2024-09-19T06:20:42.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.627+0000 7f2d56fec740 10 client.27632 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:42.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.627+0000 7f2d56fec740 1 -- 172.21.15.3:0/1226460559 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563a25a56f10 con 0x563a259d1c70 2024-09-19T06:20:42.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.627+0000 7f2d33400640 1 -- 172.21.15.3:0/1226460559 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d40019930 con 0x563a259d1c70 2024-09-19T06:20:42.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.627+0000 7f2d33400640 1 -- 172.21.15.3:0/1226460559 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2d4000fcc0 con 0x563a259d1c70 2024-09-19T06:20:42.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.627+0000 7f2d56fec740 10 client.27632 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:42.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.627+0000 7f2d56fec740 10 client.27632 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:20:42.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.627+0000 7f2d56fec740 20 client.27632 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:42.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.627+0000 7f2d56fec740 1 --2- 172.21.15.3:0/1226460559 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x563a25a57570 0x563a25a59960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:42.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.627+0000 7f2d56fec740 4 client.27632 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:42.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.627+0000 7f2d56fec740 1 -- 172.21.15.3:0/1226460559 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563a2593fe60 con 0x563a25a57570 2024-09-19T06:20:42.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.628+0000 7f2d51000640 1 --2- 172.21.15.3:0/1226460559 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x563a25a57570 0x563a25a59960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:42.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.628+0000 7f2d51000640 1 --2- 172.21.15.3:0/1226460559 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x563a25a57570 0x563a25a59960 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5659b230dc2084e server_cookie=a64260ab86aa6bce in_seq=0 out_seq=0 2024-09-19T06:20:42.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.628+0000 7f2d33400640 10 client.27632 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:20:42.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.628+0000 7f2d33400640 1 -- 172.21.15.3:0/1226460559 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563a2593fe60 con 0x563a25a57570 2024-09-19T06:20:42.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.628+0000 7f2d33400640 10 client.27632 handle_command_reply: tid=0 2024-09-19T06:20:42.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.628+0000 7f2d56fec740 1 client.27632 shutdown 2024-09-19T06:20:42.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.629+0000 7f2d56fec740 1 -- 172.21.15.3:0/1226460559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259d1c70 msgr2=0x563a259dfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:42.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.629+0000 7f2d56fec740 1 --2- 172.21.15.3:0/1226460559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259d1c70 0x563a259dfdb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2d400196b0 tx=0x7f2d400196e0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.629+0000 7f2d56fec740 1 -- 172.21.15.3:0/1226460559 shutdown_connections 2024-09-19T06:20:42.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.629+0000 7f2d56fec740 1 --2- 172.21.15.3:0/1226460559 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x563a25a57570 0x563a25a59960 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.629+0000 7f2d56fec740 1 --2- 172.21.15.3:0/1226460559 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563a259dce50 0x563a259e0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.629+0000 7f2d56fec740 1 --2- 172.21.15.3:0/1226460559 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563a259d2590 0x563a259e02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.629+0000 7f2d33400640 0 client.27632 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:20:42.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.629+0000 7f2d56fec740 1 --2- 172.21.15.3:0/1226460559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563a259d1c70 0x563a259dfdb0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.629+0000 7f2d56fec740 1 -- 172.21.15.3:0/1226460559 >> 172.21.15.3:0/1226460559 conn(0x563a259ce200 msgr2=0x563a259d36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:42.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.629+0000 7f2d56fec740 1 -- 172.21.15.3:0/1226460559 shutdown_connections 2024-09-19T06:20:42.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.629+0000 7f2d56fec740 1 -- 172.21.15.3:0/1226460559 wait complete. 2024-09-19T06:20:42.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.629+0000 7f2d56fec740 20 client.27632 trim_cache size 0 max 16384 2024-09-19T06:20:42.634 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:20:42.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.630+0000 7f2d54400640 1 -- 172.21.15.3:0/2882578196 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2d340a3340 msgr2=0x7f2d340a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:42.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.630+0000 7f2d54400640 1 --2- 172.21.15.3:0/2882578196 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2d340a3340 0x7f2d340a5800 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2d44005fd0 tx=0x7f2d44009500 comp rx=0 tx=0).stop 2024-09-19T06:20:42.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.630+0000 7f2d54400640 1 -- 172.21.15.3:0/2882578196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d4c1049a0 msgr2=0x7f2d4c19ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:42.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.630+0000 7f2d54400640 1 --2- 172.21.15.3:0/2882578196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d4c1049a0 0x7f2d4c19ab90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2d38004770 tx=0x7f2d38003c10 comp rx=0 tx=0).stop 2024-09-19T06:20:42.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.630+0000 7f2d54400640 1 -- 172.21.15.3:0/2882578196 shutdown_connections 2024-09-19T06:20:42.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.630+0000 7f2d54400640 1 --2- 172.21.15.3:0/2882578196 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2d340a3340 0x7f2d340a5800 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.630+0000 7f2d54400640 1 --2- 172.21.15.3:0/2882578196 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d4c109120 0x7f2d4c19ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.630+0000 7f2d54400640 1 --2- 172.21.15.3:0/2882578196 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d4c1049a0 0x7f2d4c19ab90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.630+0000 7f2d54400640 1 --2- 172.21.15.3:0/2882578196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d4c103ff0 0x7f2d4c19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:42.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.630+0000 7f2d54400640 1 -- 172.21.15.3:0/2882578196 >> 172.21.15.3:0/2882578196 conn(0x7f2d4c0ffa90 msgr2=0x7f2d4c100da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:42.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.630+0000 7f2d54400640 1 -- 172.21.15.3:0/2882578196 shutdown_connections 2024-09-19T06:20:42.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:42.630+0000 7f2d54400640 1 -- 172.21.15.3:0/2882578196 wait complete. 2024-09-19T06:20:43.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:43 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:20:43.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:43 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:20:43.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:43 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:20:43.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:43 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:20:43.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:43 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:20:43.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:43 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:20:43.486 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:20:43.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:43 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:20:43.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:43 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:20:43.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:43 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:20:43.866 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:44.284 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:44 smithi003 ceph-mon[30893]: pgmap v257: 97 pgs: 97 active+clean; 3.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:20:44.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:44 smithi071 ceph-mon[35662]: pgmap v257: 97 pgs: 97 active+clean; 3.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:20:44.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.396+0000 7f2cde800640 1 -- 172.21.15.3:0/1126712169 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2cd81047e0 msgr2=0x7f2cd8108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:44.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.396+0000 7f2cde800640 1 --2- 172.21.15.3:0/1126712169 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2cd81047e0 0x7f2cd8108830 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4009900 tx=0x7f2cc402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.396+0000 7f2cde800640 1 -- 172.21.15.3:0/1126712169 shutdown_connections 2024-09-19T06:20:44.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.396+0000 7f2cde800640 1 --2- 172.21.15.3:0/1126712169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd8108f60 0x7f2cd8110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.396+0000 7f2cde800640 1 --2- 172.21.15.3:0/1126712169 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2cd81047e0 0x7f2cd8108830 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.396+0000 7f2cde800640 1 --2- 172.21.15.3:0/1126712169 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2cd8103e30 0x7f2cd8104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.396+0000 7f2cde800640 1 -- 172.21.15.3:0/1126712169 >> 172.21.15.3:0/1126712169 conn(0x7f2cd80ff910 msgr2=0x7f2cd8101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:44.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.396+0000 7f2cde800640 1 -- 172.21.15.3:0/1126712169 shutdown_connections 2024-09-19T06:20:44.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.396+0000 7f2cde800640 1 -- 172.21.15.3:0/1126712169 wait complete. 2024-09-19T06:20:44.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.397+0000 7f2cde800640 1 Processor -- start 2024-09-19T06:20:44.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.397+0000 7f2cde800640 1 -- start start 2024-09-19T06:20:44.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.398+0000 7f2cde800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2cd8103e30 0x7f2cd819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:44.400 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.398+0000 7f2cde800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd81047e0 0x7f2cd819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:44.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.398+0000 7f2cde800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2cd8108f60 0x7f2cd819ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:44.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.398+0000 7f2cde800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd8113fc0 con 0x7f2cd8108f60 2024-09-19T06:20:44.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.398+0000 7f2cde800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd8113e40 con 0x7f2cd81047e0 2024-09-19T06:20:44.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.398+0000 7f2cde800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd8114140 con 0x7f2cd8103e30 2024-09-19T06:20:44.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.398+0000 7f2cdde00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2cd8108f60 0x7f2cd819ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:44.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.398+0000 7f2cdca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd81047e0 0x7f2cd819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:44.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.398+0000 7f2cdde00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2cd8108f60 0x7f2cd819ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57252/0 (socket says 172.21.15.3:57252) 2024-09-19T06:20:44.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.398+0000 7f2cdde00640 1 -- 172.21.15.3:0/3374273749 learned_addr learned my addr 172.21.15.3:0/3374273749 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:44.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.398+0000 7f2cdd400640 1 --2- 172.21.15.3:0/3374273749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2cd8103e30 0x7f2cd819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:44.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.398+0000 7f2cdca00640 1 -- 172.21.15.3:0/3374273749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2cd8103e30 msgr2=0x7f2cd819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:44.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.398+0000 7f2cdca00640 1 --2- 172.21.15.3:0/3374273749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2cd8103e30 0x7f2cd819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.399+0000 7f2cdca00640 1 -- 172.21.15.3:0/3374273749 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2cd8108f60 msgr2=0x7f2cd819ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:44.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.399+0000 7f2cdca00640 1 --2- 172.21.15.3:0/3374273749 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2cd8108f60 0x7f2cd819ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.399+0000 7f2cdca00640 1 -- 172.21.15.3:0/3374273749 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd819f470 con 0x7f2cd81047e0 2024-09-19T06:20:44.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.399+0000 7f2cdde00640 1 --2- 172.21.15.3:0/3374273749 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2cd8108f60 0x7f2cd819ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:44.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.399+0000 7f2cdca00640 1 --2- 172.21.15.3:0/3374273749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd81047e0 0x7f2cd819aa00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4005940 tx=0x7f2cc40040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:44.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.399+0000 7f2cd6000640 1 -- 172.21.15.3:0/3374273749 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc403f030 con 0x7f2cd81047e0 2024-09-19T06:20:44.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.399+0000 7f2cde800640 1 -- 172.21.15.3:0/3374273749 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cd819f700 con 0x7f2cd81047e0 2024-09-19T06:20:44.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.399+0000 7f2cd6000640 1 -- 172.21.15.3:0/3374273749 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cc40044c0 con 0x7f2cd81047e0 2024-09-19T06:20:44.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.399+0000 7f2cd6000640 1 -- 172.21.15.3:0/3374273749 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4035070 con 0x7f2cd81047e0 2024-09-19T06:20:44.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.400+0000 7f2cde800640 1 -- 172.21.15.3:0/3374273749 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cd81a7040 con 0x7f2cd81047e0 2024-09-19T06:20:44.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.402+0000 7f2ce28db740 1 Processor -- start 2024-09-19T06:20:44.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.403+0000 7f2cd6000640 1 -- 172.21.15.3:0/3374273749 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f2cc4042030 con 0x7f2cd81047e0 2024-09-19T06:20:44.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.403+0000 7f2ce28db740 1 -- start start 2024-09-19T06:20:44.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.403+0000 7f2ce28db740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56138d78fe40 0x56138d790220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:44.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.403+0000 7f2ce28db740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56138d790760 0x56138d79aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:44.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.403+0000 7f2ce28db740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d79b020 0x56138d79d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:44.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.403+0000 7f2ce28db740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56138d6f63e0 con 0x56138d79b020 2024-09-19T06:20:44.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.403+0000 7f2ce28db740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56138d69dd80 con 0x56138d78fe40 2024-09-19T06:20:44.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.403+0000 7f2ce28db740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56138d6f23a0 con 0x56138d790760 2024-09-19T06:20:44.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.403+0000 7f2cdd400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56138d790760 0x56138d79aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:44.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.403+0000 7f2cdd400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56138d790760 0x56138d79aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:51460/0 (socket says 172.21.15.3:51460) 2024-09-19T06:20:44.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.403+0000 7f2cdd400640 1 -- 172.21.15.3:0/3713178164 learned_addr learned my addr 172.21.15.3:0/3713178164 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:44.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.403+0000 7f2cdde00640 1 --2- 172.21.15.3:0/3713178164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56138d78fe40 0x56138d790220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:44.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.404+0000 7f2cdca00640 1 --2- 172.21.15.3:0/3713178164 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d79b020 0x56138d79d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:44.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.404+0000 7f2cdd400640 1 -- 172.21.15.3:0/3713178164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56138d78fe40 msgr2=0x56138d790220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:44.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.404+0000 7f2cdd400640 1 --2- 172.21.15.3:0/3713178164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56138d78fe40 0x56138d790220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.404+0000 7f2cdd400640 1 -- 172.21.15.3:0/3713178164 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d79b020 msgr2=0x56138d79d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:44.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.404+0000 7f2cdd400640 1 --2- 172.21.15.3:0/3713178164 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d79b020 0x56138d79d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.404+0000 7f2cdd400640 1 -- 172.21.15.3:0/3713178164 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56138d6bcae0 con 0x56138d790760 2024-09-19T06:20:44.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.404+0000 7f2cdde00640 1 --2- 172.21.15.3:0/3713178164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56138d78fe40 0x56138d790220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:44.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.404+0000 7f2cdd400640 1 --2- 172.21.15.3:0/3713178164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56138d790760 0x56138d79aae0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc009d20 tx=0x7f2ccc011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c79e6e1fc62950da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:44.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.404+0000 7f2cd6000640 1 --2- 172.21.15.3:0/3374273749 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2cc00a33b0 0x7f2cc00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:44.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.405+0000 7f2cd6000640 1 -- 172.21.15.3:0/3374273749 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f2cc40efff0 con 0x7f2cd81047e0 2024-09-19T06:20:44.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.405+0000 7f2cca600640 1 -- 172.21.15.3:0/3713178164 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc01e070 con 0x56138d790760 2024-09-19T06:20:44.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.405+0000 7f2cca600640 1 -- 172.21.15.3:0/3713178164 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ccc009e10 con 0x56138d790760 2024-09-19T06:20:44.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.405+0000 7f2cdde00640 1 --2- 172.21.15.3:0/3374273749 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2cc00a33b0 0x7f2cc00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:44.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.405+0000 7f2cca600640 1 -- 172.21.15.3:0/3713178164 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc00e9c0 con 0x56138d790760 2024-09-19T06:20:44.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.405+0000 7f2ce28db740 1 -- 172.21.15.3:0/3713178164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56138d790760 msgr2=0x56138d79aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:44.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.405+0000 7f2ce28db740 1 --2- 172.21.15.3:0/3713178164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56138d790760 0x56138d79aae0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc009d20 tx=0x7f2ccc011810 comp rx=0 tx=0).stop 2024-09-19T06:20:44.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.405+0000 7f2cdde00640 1 --2- 172.21.15.3:0/3374273749 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2cc00a33b0 0x7f2cc00a5870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00049d0 tx=0x7f2cd0009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:44.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.405+0000 7f2ce28db740 1 -- 172.21.15.3:0/3713178164 shutdown_connections 2024-09-19T06:20:44.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.405+0000 7f2ce28db740 1 --2- 172.21.15.3:0/3713178164 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d79b020 0x56138d79d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.405+0000 7f2ce28db740 1 --2- 172.21.15.3:0/3713178164 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56138d790760 0x56138d79aae0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.405+0000 7f2ce28db740 1 --2- 172.21.15.3:0/3713178164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56138d78fe40 0x56138d790220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.405+0000 7f2ce28db740 1 -- 172.21.15.3:0/3713178164 >> 172.21.15.3:0/3713178164 conn(0x56138d78c3d0 msgr2=0x56138d78c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:44.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.405+0000 7f2ce28db740 1 -- 172.21.15.3:0/3713178164 shutdown_connections 2024-09-19T06:20:44.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.406+0000 7f2ce28db740 1 -- 172.21.15.3:0/3713178164 wait complete. 2024-09-19T06:20:44.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.406+0000 7f2ce28db740 1 -- start start 2024-09-19T06:20:44.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.406+0000 7f2ce28db740 1 Processor -- start 2024-09-19T06:20:44.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.407+0000 7f2ce28db740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56138d78fe40 0x56138d797ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:44.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.407+0000 7f2ce28db740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56138d790760 0x56138d798420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:44.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.407+0000 7f2ce28db740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d79b020 0x56138d798960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:44.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.407+0000 7f2ce28db740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56138d79dbf0 con 0x56138d79b020 2024-09-19T06:20:44.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.407+0000 7f2ce28db740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56138d6b10f0 con 0x56138d78fe40 2024-09-19T06:20:44.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.407+0000 7f2ce28db740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56138d79dd70 con 0x56138d790760 2024-09-19T06:20:44.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.407+0000 7f2ce28db740 10 client.0 _ll_register_callbacks cb 0x56138d698bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:44.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.407+0000 7f2cdde00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d79b020 0x56138d798960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:44.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.407+0000 7f2cdde00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d79b020 0x56138d798960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57276/0 (socket says 172.21.15.3:57276) 2024-09-19T06:20:44.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.407+0000 7f2cdde00640 1 -- 172.21.15.3:0/3672123943 learned_addr learned my addr 172.21.15.3:0/3672123943 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:44.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.407+0000 7f2cdd400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56138d78fe40 0x56138d797ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:44.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.407+0000 7f2cdca00640 1 --2- 172.21.15.3:0/3672123943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56138d790760 0x56138d798420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:44.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.407+0000 7f2cdde00640 1 -- 172.21.15.3:0/3672123943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56138d790760 msgr2=0x56138d798420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:44.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.407+0000 7f2cdde00640 1 --2- 172.21.15.3:0/3672123943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56138d790760 0x56138d798420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.408+0000 7f2cdde00640 1 -- 172.21.15.3:0/3672123943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56138d78fe40 msgr2=0x56138d797ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:44.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.408+0000 7f2cdde00640 1 --2- 172.21.15.3:0/3672123943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56138d78fe40 0x56138d797ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.408+0000 7f2cdde00640 1 -- 172.21.15.3:0/3672123943 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56138d4673c0 con 0x56138d79b020 2024-09-19T06:20:44.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.408+0000 7f2cdd400640 1 --2- 172.21.15.3:0/3672123943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56138d78fe40 0x56138d797ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:44.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.408+0000 7f2cdde00640 1 --2- 172.21.15.3:0/3672123943 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d79b020 0x56138d798960 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0012290 tx=0x7f2cd0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc6a894d7b36981 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:44.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.408+0000 7f2cbea00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:20:44.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.408+0000 7f2cbea00640 1 -- 172.21.15.3:0/3672123943 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0011cd0 con 0x56138d79b020 2024-09-19T06:20:44.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.408+0000 7f2cbea00640 1 -- 172.21.15.3:0/3672123943 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f2cd0029440 con 0x56138d79b020 2024-09-19T06:20:44.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.408+0000 7f2ce28db740 1 -- 172.21.15.3:0/3672123943 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ccc009e10 con 0x56138d79b020 2024-09-19T06:20:44.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.408+0000 7f2cbea00640 1 -- 172.21.15.3:0/3672123943 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2cd0011e70 con 0x56138d79b020 2024-09-19T06:20:44.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.408+0000 7f2ce28db740 10 client.17610 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:44.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.408+0000 7f2ce28db740 1 -- 172.21.15.3:0/3672123943 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56138d7a9c60 con 0x56138d79b020 2024-09-19T06:20:44.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.409+0000 7f2cbea00640 1 -- 172.21.15.3:0/3672123943 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ccc009e10 con 0x56138d79b020 2024-09-19T06:20:44.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.409+0000 7f2cbea00640 1 -- 172.21.15.3:0/3672123943 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2cd0027020 con 0x56138d79b020 2024-09-19T06:20:44.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.409+0000 7f2ce28db740 10 client.17610 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:44.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.409+0000 7f2ce28db740 10 client.17610 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:20:44.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.409+0000 7f2ce28db740 20 client.17610 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:44.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.409+0000 7f2ce28db740 1 --2- 172.21.15.3:0/3672123943 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56138d7ab120 0x56138d7ad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:44.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.409+0000 7f2ce28db740 4 client.17610 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:44.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.409+0000 7f2ce28db740 1 -- 172.21.15.3:0/3672123943 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56138d703950 con 0x56138d7ab120 2024-09-19T06:20:44.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.409+0000 7f2cdd400640 1 --2- 172.21.15.3:0/3672123943 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56138d7ab120 0x56138d7ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:44.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.410+0000 7f2cdd400640 1 --2- 172.21.15.3:0/3672123943 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56138d7ab120 0x56138d7ad570 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5c217a384339a2ef server_cookie=c95ff3c7cf7eed37 in_seq=0 out_seq=0 2024-09-19T06:20:44.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.410+0000 7f2cbea00640 10 client.17610 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:20:44.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.411+0000 7f2cbea00640 1 -- 172.21.15.3:0/3672123943 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56138d703950 con 0x56138d7ab120 2024-09-19T06:20:44.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.411+0000 7f2cbea00640 10 client.17610 handle_command_reply: tid=0 2024-09-19T06:20:44.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.411+0000 7f2ce28db740 1 client.17610 shutdown 2024-09-19T06:20:44.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.411+0000 7f2ce28db740 1 -- 172.21.15.3:0/3672123943 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d79b020 msgr2=0x56138d798960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:44.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.411+0000 7f2ce28db740 1 --2- 172.21.15.3:0/3672123943 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d79b020 0x56138d798960 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0012290 tx=0x7f2cd0004ab0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.411+0000 7f2ce28db740 1 -- 172.21.15.3:0/3672123943 shutdown_connections 2024-09-19T06:20:44.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.411+0000 7f2ce28db740 1 --2- 172.21.15.3:0/3672123943 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56138d7ab120 0x56138d7ad570 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.411+0000 7f2ce28db740 1 --2- 172.21.15.3:0/3672123943 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d79b020 0x56138d798960 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.411+0000 7f2ce28db740 1 --2- 172.21.15.3:0/3672123943 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56138d790760 0x56138d798420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.411+0000 7f2ce28db740 1 --2- 172.21.15.3:0/3672123943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56138d78fe40 0x56138d797ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.411+0000 7f2ce28db740 1 -- 172.21.15.3:0/3672123943 >> 172.21.15.3:0/3672123943 conn(0x56138d78c3d0 msgr2=0x56138d7920b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:44.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.411+0000 7f2cbea00640 0 client.17610 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:20:44.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.411+0000 7f2ce28db740 1 -- 172.21.15.3:0/3672123943 shutdown_connections 2024-09-19T06:20:44.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.411+0000 7f2ce28db740 1 -- 172.21.15.3:0/3672123943 wait complete. 2024-09-19T06:20:44.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.412+0000 7f2ce28db740 20 client.17610 trim_cache size 0 max 16384 2024-09-19T06:20:44.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.425+0000 7f2ce28db740 1 Processor -- start 2024-09-19T06:20:44.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.425+0000 7f2ce28db740 1 -- start start 2024-09-19T06:20:44.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.426+0000 7f2ce28db740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56138d78fe40 0x56138d7928a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:44.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.426+0000 7f2ce28db740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d790760 0x56138d78b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:44.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.426+0000 7f2ce28db740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56138d79b020 0x56138d7b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:44.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.426+0000 7f2ce28db740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd81af9a0 con 0x56138d790760 2024-09-19T06:20:44.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.426+0000 7f2ce28db740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd81b14e0 con 0x56138d79b020 2024-09-19T06:20:44.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.426+0000 7f2ce28db740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd81b0070 con 0x56138d78fe40 2024-09-19T06:20:44.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.426+0000 7f2cdca00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d790760 0x56138d78b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:44.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.426+0000 7f2cdca00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d790760 0x56138d78b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57284/0 (socket says 172.21.15.3:57284) 2024-09-19T06:20:44.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.426+0000 7f2cdca00640 1 -- 172.21.15.3:0/3112405355 learned_addr learned my addr 172.21.15.3:0/3112405355 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:44.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.426+0000 7f2cdd400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56138d78fe40 0x56138d7928a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:44.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.426+0000 7f2cdde00640 1 --2- 172.21.15.3:0/3112405355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56138d79b020 0x56138d7b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:44.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.426+0000 7f2cdca00640 1 -- 172.21.15.3:0/3112405355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56138d78fe40 msgr2=0x56138d7928a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:44.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.426+0000 7f2cdca00640 1 --2- 172.21.15.3:0/3112405355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56138d78fe40 0x56138d7928a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.426+0000 7f2cdca00640 1 -- 172.21.15.3:0/3112405355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56138d79b020 msgr2=0x56138d7b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:44.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.426+0000 7f2cdca00640 1 --2- 172.21.15.3:0/3112405355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56138d79b020 0x56138d7b2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.427+0000 7f2cdca00640 1 -- 172.21.15.3:0/3112405355 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56138d79d770 con 0x56138d790760 2024-09-19T06:20:44.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.427+0000 7f2cdd400640 1 --2- 172.21.15.3:0/3112405355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56138d78fe40 0x56138d7928a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:44.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.427+0000 7f2cdde00640 1 --2- 172.21.15.3:0/3112405355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56138d79b020 0x56138d7b2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:44.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.427+0000 7f2cdca00640 1 --2- 172.21.15.3:0/3112405355 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d790760 0x56138d78b380 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4006010 tx=0x7f2cc4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7eb0c39f1370734 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:44.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.427+0000 7f2cc9c00640 1 -- 172.21.15.3:0/3112405355 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc40ede60 con 0x56138d790760 2024-09-19T06:20:44.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.427+0000 7f2cc9c00640 1 -- 172.21.15.3:0/3112405355 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cc40bc350 con 0x56138d790760 2024-09-19T06:20:44.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.427+0000 7f2cc9c00640 1 -- 172.21.15.3:0/3112405355 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4049040 con 0x56138d790760 2024-09-19T06:20:44.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.428+0000 7f2ce28db740 1 -- 172.21.15.3:0/3112405355 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d790760 msgr2=0x56138d78b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:44.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.428+0000 7f2ce28db740 1 --2- 172.21.15.3:0/3112405355 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d790760 0x56138d78b380 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4006010 tx=0x7f2cc4000bc0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.428+0000 7f2ce28db740 1 -- 172.21.15.3:0/3112405355 shutdown_connections 2024-09-19T06:20:44.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.428+0000 7f2ce28db740 1 --2- 172.21.15.3:0/3112405355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56138d79b020 0x56138d7b2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.428+0000 7f2ce28db740 1 --2- 172.21.15.3:0/3112405355 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d790760 0x56138d78b380 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.428+0000 7f2ce28db740 1 --2- 172.21.15.3:0/3112405355 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56138d78fe40 0x56138d7928a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.428+0000 7f2ce28db740 1 -- 172.21.15.3:0/3112405355 >> 172.21.15.3:0/3112405355 conn(0x56138d78c3d0 msgr2=0x56138d78ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:44.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.428+0000 7f2ce28db740 1 -- 172.21.15.3:0/3112405355 shutdown_connections 2024-09-19T06:20:44.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.428+0000 7f2ce28db740 1 -- 172.21.15.3:0/3112405355 wait complete. 2024-09-19T06:20:44.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.428+0000 7f2ce28db740 1 -- start start 2024-09-19T06:20:44.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.428+0000 7f2ce28db740 1 Processor -- start 2024-09-19T06:20:44.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.429+0000 7f2ce28db740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56138d78fe40 0x56138d79e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:44.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.429+0000 7f2ce28db740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d790760 0x56138d79ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:44.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.429+0000 7f2ce28db740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56138d79b020 0x56138d813e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:44.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.429+0000 7f2ce28db740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd81b0e10 con 0x56138d790760 2024-09-19T06:20:44.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.429+0000 7f2ce28db740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd81b0740 con 0x56138d78fe40 2024-09-19T06:20:44.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.429+0000 7f2ce28db740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd81ad9a0 con 0x56138d79b020 2024-09-19T06:20:44.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.429+0000 7f2ce28db740 10 client.0 _ll_register_callbacks cb 0x7f2cd00128e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:44.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.429+0000 7f2cdca00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d790760 0x56138d79ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:44.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.429+0000 7f2cdca00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d790760 0x56138d79ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57290/0 (socket says 172.21.15.3:57290) 2024-09-19T06:20:44.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.429+0000 7f2cdca00640 1 -- 172.21.15.3:0/3719961245 learned_addr learned my addr 172.21.15.3:0/3719961245 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:44.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.429+0000 7f2cdde00640 1 --2- 172.21.15.3:0/3719961245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56138d79b020 0x56138d813e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:44.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.429+0000 7f2cdd400640 1 --2- 172.21.15.3:0/3719961245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56138d78fe40 0x56138d79e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:44.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.430+0000 7f2cdca00640 1 -- 172.21.15.3:0/3719961245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56138d79b020 msgr2=0x56138d813e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:44.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.430+0000 7f2cdca00640 1 --2- 172.21.15.3:0/3719961245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56138d79b020 0x56138d813e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.430+0000 7f2cdca00640 1 -- 172.21.15.3:0/3719961245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56138d78fe40 msgr2=0x56138d79e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:44.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.430+0000 7f2cdca00640 1 --2- 172.21.15.3:0/3719961245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56138d78fe40 0x56138d79e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.430+0000 7f2cdca00640 1 -- 172.21.15.3:0/3719961245 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56138d814340 con 0x56138d790760 2024-09-19T06:20:44.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.430+0000 7f2cdde00640 1 --2- 172.21.15.3:0/3719961245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56138d79b020 0x56138d813e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:44.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.430+0000 7f2cdd400640 1 --2- 172.21.15.3:0/3719961245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56138d78fe40 0x56138d79e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:44.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.430+0000 7f2cdca00640 1 --2- 172.21.15.3:0/3719961245 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d790760 0x56138d79ea60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40ed7c0 tx=0x7f2cc40ed700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70bf6c980be8e7d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:44.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.430+0000 7f2cbea00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:20:44.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.430+0000 7f2cbea00640 1 -- 172.21.15.3:0/3719961245 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc40ede60 con 0x56138d790760 2024-09-19T06:20:44.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.430+0000 7f2cbea00640 1 -- 172.21.15.3:0/3719961245 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f2cc40f20f0 con 0x56138d790760 2024-09-19T06:20:44.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.430+0000 7f2ce28db740 1 -- 172.21.15.3:0/3719961245 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cc40bc350 con 0x56138d790760 2024-09-19T06:20:44.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.431+0000 7f2cbea00640 1 -- 172.21.15.3:0/3719961245 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2cc40bbcb0 con 0x56138d790760 2024-09-19T06:20:44.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.431+0000 7f2ce28db740 10 client.17616 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:44.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.431+0000 7f2ce28db740 1 -- 172.21.15.3:0/3719961245 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56138d815640 con 0x56138d790760 2024-09-19T06:20:44.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.431+0000 7f2cbea00640 1 -- 172.21.15.3:0/3719961245 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cc40bc350 con 0x56138d790760 2024-09-19T06:20:44.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.431+0000 7f2cbea00640 1 -- 172.21.15.3:0/3719961245 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2cc40d50f0 con 0x56138d790760 2024-09-19T06:20:44.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.431+0000 7f2ce28db740 10 client.17616 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:44.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.431+0000 7f2ce28db740 10 client.17616 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:20:44.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.431+0000 7f2ce28db740 20 client.17616 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:44.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.431+0000 7f2ce28db740 1 --2- 172.21.15.3:0/3719961245 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56138d815d10 0x56138d818130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:44.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.431+0000 7f2ce28db740 4 client.17616 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:44.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.431+0000 7f2ce28db740 1 -- 172.21.15.3:0/3719961245 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56138d6fde60 con 0x56138d815d10 2024-09-19T06:20:44.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.431+0000 7f2cdd400640 1 --2- 172.21.15.3:0/3719961245 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56138d815d10 0x56138d818130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:44.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.432+0000 7f2cdd400640 1 --2- 172.21.15.3:0/3719961245 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56138d815d10 0x56138d818130 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6d50c27e6ce0ac71 server_cookie=397b7c4e4e4ed874 in_seq=0 out_seq=0 2024-09-19T06:20:44.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.432+0000 7f2cbea00640 10 client.17616 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:20:44.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.432+0000 7f2cbea00640 1 -- 172.21.15.3:0/3719961245 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56138d6fde60 con 0x56138d815d10 2024-09-19T06:20:44.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.432+0000 7f2cbea00640 10 client.17616 handle_command_reply: tid=0 2024-09-19T06:20:44.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.432+0000 7f2ce28db740 1 client.17616 shutdown 2024-09-19T06:20:44.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.432+0000 7f2ce28db740 1 -- 172.21.15.3:0/3719961245 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d790760 msgr2=0x56138d79ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:44.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.432+0000 7f2ce28db740 1 --2- 172.21.15.3:0/3719961245 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d790760 0x56138d79ea60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40ed7c0 tx=0x7f2cc40ed700 comp rx=0 tx=0).stop 2024-09-19T06:20:44.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.432+0000 7f2ce28db740 1 -- 172.21.15.3:0/3719961245 shutdown_connections 2024-09-19T06:20:44.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.432+0000 7f2ce28db740 1 --2- 172.21.15.3:0/3719961245 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56138d815d10 0x56138d818130 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.432+0000 7f2ce28db740 1 --2- 172.21.15.3:0/3719961245 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56138d79b020 0x56138d813e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.433+0000 7f2ce28db740 1 --2- 172.21.15.3:0/3719961245 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56138d790760 0x56138d79ea60 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.433+0000 7f2ce28db740 1 --2- 172.21.15.3:0/3719961245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56138d78fe40 0x56138d79e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.433+0000 7f2ce28db740 1 -- 172.21.15.3:0/3719961245 >> 172.21.15.3:0/3719961245 conn(0x56138d78c3d0 msgr2=0x56138d799f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:44.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.433+0000 7f2cbea00640 0 client.17616 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:20:44.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.433+0000 7f2ce28db740 1 -- 172.21.15.3:0/3719961245 shutdown_connections 2024-09-19T06:20:44.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.433+0000 7f2ce28db740 1 -- 172.21.15.3:0/3719961245 wait complete. 2024-09-19T06:20:44.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.433+0000 7f2ce28db740 20 client.17616 trim_cache size 0 max 16384 2024-09-19T06:20:44.440 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:20:44.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.434+0000 7f2cde800640 1 -- 172.21.15.3:0/3374273749 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2cc00a33b0 msgr2=0x7f2cc00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:44.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.434+0000 7f2cde800640 1 --2- 172.21.15.3:0/3374273749 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2cc00a33b0 0x7f2cc00a5870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00049d0 tx=0x7f2cd0009500 comp rx=0 tx=0).stop 2024-09-19T06:20:44.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.434+0000 7f2cde800640 1 -- 172.21.15.3:0/3374273749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd81047e0 msgr2=0x7f2cd819aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:44.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.434+0000 7f2cde800640 1 --2- 172.21.15.3:0/3374273749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd81047e0 0x7f2cd819aa00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4005940 tx=0x7f2cc40040c0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.434+0000 7f2cde800640 1 -- 172.21.15.3:0/3374273749 shutdown_connections 2024-09-19T06:20:44.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.434+0000 7f2cde800640 1 --2- 172.21.15.3:0/3374273749 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2cc00a33b0 0x7f2cc00a5870 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.434+0000 7f2cde800640 1 --2- 172.21.15.3:0/3374273749 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2cd8108f60 0x7f2cd819ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.434+0000 7f2cde800640 1 --2- 172.21.15.3:0/3374273749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cd81047e0 0x7f2cd819aa00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.434+0000 7f2cde800640 1 --2- 172.21.15.3:0/3374273749 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2cd8103e30 0x7f2cd819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:44.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.434+0000 7f2cde800640 1 -- 172.21.15.3:0/3374273749 >> 172.21.15.3:0/3374273749 conn(0x7f2cd80ff910 msgr2=0x7f2cd8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:44.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.434+0000 7f2cde800640 1 -- 172.21.15.3:0/3374273749 shutdown_connections 2024-09-19T06:20:44.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:44.434+0000 7f2cde800640 1 -- 172.21.15.3:0/3374273749 wait complete. 2024-09-19T06:20:44.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:44 smithi059 ceph-mon[35138]: pgmap v257: 97 pgs: 97 active+clean; 3.1 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:20:45.464 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:20:45.843 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:46.302 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:46 smithi003 ceph-mon[30893]: pgmap v258: 97 pgs: 97 active+clean; 3.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 22 op/s 2024-09-19T06:20:46.317 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.315+0000 7f4b8fe00640 1 -- 172.21.15.3:0/3989884525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b90102ae0 msgr2=0x7f4b90102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.317 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.315+0000 7f4b8fe00640 1 --2- 172.21.15.3:0/3989884525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b90102ae0 0x7f4b90102ec0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009900 tx=0x7f4b8002a480 comp rx=0 tx=0).stop 2024-09-19T06:20:46.318 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.316+0000 7f4b8fe00640 1 -- 172.21.15.3:0/3989884525 shutdown_connections 2024-09-19T06:20:46.318 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.316+0000 7f4b8fe00640 1 --2- 172.21.15.3:0/3989884525 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b9010bf30 0x7f4b9010e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.318 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.316+0000 7f4b8fe00640 1 --2- 172.21.15.3:0/3989884525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b90103400 0x7f4b9010b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.318 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.316+0000 7f4b8fe00640 1 --2- 172.21.15.3:0/3989884525 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b90102ae0 0x7f4b90102ec0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.318 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.316+0000 7f4b8fe00640 1 -- 172.21.15.3:0/3989884525 >> 172.21.15.3:0/3989884525 conn(0x7f4b900777f0 msgr2=0x7f4b900feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:46.318 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.316+0000 7f4b8fe00640 1 -- 172.21.15.3:0/3989884525 shutdown_connections 2024-09-19T06:20:46.318 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.316+0000 7f4b8fe00640 1 -- 172.21.15.3:0/3989884525 wait complete. 2024-09-19T06:20:46.319 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.317+0000 7f4b8fe00640 1 Processor -- start 2024-09-19T06:20:46.319 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.317+0000 7f4b8fe00640 1 -- start start 2024-09-19T06:20:46.319 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.317+0000 7f4b8fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b90102ae0 0x7f4b9019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.317+0000 7f4b8fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b90103400 0x7f4b9019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.317+0000 7f4b8fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b9010bf30 0x7f4b9019ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.317+0000 7f4b8fe00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4b90111d60 con 0x7f4b90103400 2024-09-19T06:20:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.317+0000 7f4b8fe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4b90111be0 con 0x7f4b90102ae0 2024-09-19T06:20:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.317+0000 7f4b8fe00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4b90111ee0 con 0x7f4b9010bf30 2024-09-19T06:20:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.317+0000 7f4b8e000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b90103400 0x7f4b9019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.317+0000 7f4b8f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b9010bf30 0x7f4b9019ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.317+0000 7f4b8f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b9010bf30 0x7f4b9019ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:51518/0 (socket says 172.21.15.3:51518) 2024-09-19T06:20:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.317+0000 7f4b8f400640 1 -- 172.21.15.3:0/3579589178 learned_addr learned my addr 172.21.15.3:0/3579589178 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.317+0000 7f4b8ea00640 1 --2- 172.21.15.3:0/3579589178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b90102ae0 0x7f4b9019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.318+0000 7f4b8f400640 1 -- 172.21.15.3:0/3579589178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b90102ae0 msgr2=0x7f4b9019a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.318+0000 7f4b8f400640 1 --2- 172.21.15.3:0/3579589178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b90102ae0 0x7f4b9019a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.320 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.318+0000 7f4b8f400640 1 -- 172.21.15.3:0/3579589178 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b90103400 msgr2=0x7f4b9019a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.318+0000 7f4b8f400640 1 --2- 172.21.15.3:0/3579589178 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b90103400 0x7f4b9019a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.318+0000 7f4b8f400640 1 -- 172.21.15.3:0/3579589178 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9019f430 con 0x7f4b9010bf30 2024-09-19T06:20:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.318+0000 7f4b8f400640 1 --2- 172.21.15.3:0/3579589178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b9010bf30 0x7f4b9019ed00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4b8800eb10 tx=0x7f4b8800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.318+0000 7f4b87400640 1 -- 172.21.15.3:0/3579589178 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b88004b20 con 0x7f4b9010bf30 2024-09-19T06:20:46.321 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.318+0000 7f4b87400640 1 -- 172.21.15.3:0/3579589178 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b88004cc0 con 0x7f4b9010bf30 2024-09-19T06:20:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.318+0000 7f4b8fe00640 1 -- 172.21.15.3:0/3579589178 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b9019f720 con 0x7f4b9010bf30 2024-09-19T06:20:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.318+0000 7f4b87400640 1 -- 172.21.15.3:0/3579589178 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b88010760 con 0x7f4b9010bf30 2024-09-19T06:20:46.322 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.319+0000 7f4b8fe00640 1 -- 172.21.15.3:0/3579589178 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b901a6fb0 con 0x7f4b9010bf30 2024-09-19T06:20:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.321+0000 7f4b987d6740 1 Processor -- start 2024-09-19T06:20:46.323 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.322+0000 7f4b87400640 1 -- 172.21.15.3:0/3579589178 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f4b88005020 con 0x7f4b9010bf30 2024-09-19T06:20:46.324 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.322+0000 7f4b987d6740 1 -- start start 2024-09-19T06:20:46.324 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.322+0000 7f4b987d6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e443b0 0x564bc0e44790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.324 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.322+0000 7f4b987d6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bc0e44cd0 0x564bc0e4f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.324 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.322+0000 7f4b987d6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e4f570 0x564bc0e51960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.324 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.322+0000 7f4b987d6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x564bc0daa100 con 0x564bc0e4f570 2024-09-19T06:20:46.324 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.322+0000 7f4b987d6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564bc0d521b0 con 0x564bc0e443b0 2024-09-19T06:20:46.324 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.322+0000 7f4b987d6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564bc0da60c0 con 0x564bc0e44cd0 2024-09-19T06:20:46.326 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.323+0000 7f4b8e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e443b0 0x564bc0e44790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.326 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.323+0000 7f4b8e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e443b0 0x564bc0e44790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40100/0 (socket says 172.21.15.3:40100) 2024-09-19T06:20:46.326 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.323+0000 7f4b8e000640 1 -- 172.21.15.3:0/1769337579 learned_addr learned my addr 172.21.15.3:0/1769337579 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:46.326 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.323+0000 7f4b8ea00640 1 --2- 172.21.15.3:0/1769337579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bc0e44cd0 0x564bc0e4f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.326 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.323+0000 7f4b8e000640 1 --2- 172.21.15.3:0/1769337579 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e4f570 0x564bc0e51960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.326 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.323+0000 7f4b8e000640 1 -- 172.21.15.3:0/1769337579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bc0e44cd0 msgr2=0x564bc0e4f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:46.326 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.323+0000 7f4b8e000640 1 --2- 172.21.15.3:0/1769337579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bc0e44cd0 0x564bc0e4f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.326 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.323+0000 7f4b8e000640 1 -- 172.21.15.3:0/1769337579 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e4f570 msgr2=0x564bc0e51960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:46.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.323+0000 7f4b8e000640 1 --2- 172.21.15.3:0/1769337579 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e4f570 0x564bc0e51960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.323+0000 7f4b8e000640 1 -- 172.21.15.3:0/1769337579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bc0abd210 con 0x564bc0e443b0 2024-09-19T06:20:46.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.323+0000 7f4b87400640 1 --2- 172.21.15.3:0/3579589178 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f4b740a3420 0x7f4b740a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.323+0000 7f4b87400640 1 -- 172.21.15.3:0/3579589178 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f4b880d01e0 con 0x7f4b9010bf30 2024-09-19T06:20:46.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.324+0000 7f4b8e000640 1 --2- 172.21.15.3:0/1769337579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e443b0 0x564bc0e44790 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c012790 tx=0x7f4b7c00b5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8573a3b140333898 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:46.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.324+0000 7f4b8ea00640 1 --2- 172.21.15.3:0/3579589178 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f4b740a3420 0x7f4b740a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.324+0000 7f4b7be00640 1 -- 172.21.15.3:0/1769337579 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c012dd0 con 0x564bc0e443b0 2024-09-19T06:20:46.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.324+0000 7f4b7be00640 1 -- 172.21.15.3:0/1769337579 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b7c010770 con 0x564bc0e443b0 2024-09-19T06:20:46.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.324+0000 7f4b7be00640 1 -- 172.21.15.3:0/1769337579 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c0037f0 con 0x564bc0e443b0 2024-09-19T06:20:46.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.325+0000 7f4b987d6740 1 -- 172.21.15.3:0/1769337579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e443b0 msgr2=0x564bc0e44790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.325+0000 7f4b987d6740 1 --2- 172.21.15.3:0/1769337579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e443b0 0x564bc0e44790 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c012790 tx=0x7f4b7c00b5a0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.325+0000 7f4b8ea00640 1 --2- 172.21.15.3:0/3579589178 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f4b740a3420 0x7f4b740a58e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4b80000c00 tx=0x7f4b80005b50 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:46.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.325+0000 7f4b987d6740 1 -- 172.21.15.3:0/1769337579 shutdown_connections 2024-09-19T06:20:46.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.325+0000 7f4b987d6740 1 --2- 172.21.15.3:0/1769337579 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e4f570 0x564bc0e51960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.325+0000 7f4b987d6740 1 --2- 172.21.15.3:0/1769337579 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bc0e44cd0 0x564bc0e4f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.325+0000 7f4b987d6740 1 --2- 172.21.15.3:0/1769337579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e443b0 0x564bc0e44790 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.325+0000 7f4b987d6740 1 -- 172.21.15.3:0/1769337579 >> 172.21.15.3:0/1769337579 conn(0x564bc0e40920 msgr2=0x564bc0e40d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:46.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.325+0000 7f4b987d6740 1 -- 172.21.15.3:0/1769337579 shutdown_connections 2024-09-19T06:20:46.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.325+0000 7f4b987d6740 1 -- 172.21.15.3:0/1769337579 wait complete. 2024-09-19T06:20:46.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.325+0000 7f4b987d6740 1 -- start start 2024-09-19T06:20:46.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.326+0000 7f4b987d6740 1 Processor -- start 2024-09-19T06:20:46.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.326+0000 7f4b987d6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e443b0 0x564bc0e4c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.326+0000 7f4b987d6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bc0e44cd0 0x564bc0e4cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.326+0000 7f4b987d6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e4f570 0x564bc0e4d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.326+0000 7f4b987d6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x564bc0e51ff0 con 0x564bc0e4f570 2024-09-19T06:20:46.331 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.326+0000 7f4b987d6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x564bc0d33090 con 0x564bc0e443b0 2024-09-19T06:20:46.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.326+0000 7f4b987d6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564bc0e52170 con 0x564bc0e44cd0 2024-09-19T06:20:46.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.326+0000 7f4b987d6740 10 client.0 _ll_register_callbacks cb 0x564bc0d87f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:46.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.326+0000 7f4b8f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e4f570 0x564bc0e4d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.327+0000 7f4b8f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e4f570 0x564bc0e4d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57326/0 (socket says 172.21.15.3:57326) 2024-09-19T06:20:46.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.327+0000 7f4b8f400640 1 -- 172.21.15.3:0/1753983667 learned_addr learned my addr 172.21.15.3:0/1753983667 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:46.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.327+0000 7f4b8e000640 1 --2- 172.21.15.3:0/1753983667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bc0e44cd0 0x564bc0e4cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.327+0000 7f4b8ea00640 1 --2- 172.21.15.3:0/1753983667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e443b0 0x564bc0e4c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.327+0000 7f4b8f400640 1 -- 172.21.15.3:0/1753983667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bc0e44cd0 msgr2=0x564bc0e4cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:46.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.327+0000 7f4b8f400640 1 --2- 172.21.15.3:0/1753983667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bc0e44cd0 0x564bc0e4cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.327+0000 7f4b8f400640 1 -- 172.21.15.3:0/1753983667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e443b0 msgr2=0x564bc0e4c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:46.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.327+0000 7f4b8f400640 1 --2- 172.21.15.3:0/1753983667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e443b0 0x564bc0e4c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.332 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.327+0000 7f4b8f400640 1 -- 172.21.15.3:0/1753983667 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bc0b89620 con 0x564bc0e4f570 2024-09-19T06:20:46.333 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.327+0000 7f4b8f400640 1 --2- 172.21.15.3:0/1753983667 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e4f570 0x564bc0e4d120 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f4b88098e60 tx=0x7f4b8809bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86da195699793 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:46.333 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.327+0000 7f4b78c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:20:46.333 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.327+0000 7f4b78c00640 1 -- 172.21.15.3:0/1753983667 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b880a4e70 con 0x564bc0e4f570 2024-09-19T06:20:46.333 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.327+0000 7f4b987d6740 1 -- 172.21.15.3:0/1753983667 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b7c010770 con 0x564bc0e4f570 2024-09-19T06:20:46.333 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.327+0000 7f4b78c00640 1 -- 172.21.15.3:0/1753983667 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f4b88005310 con 0x564bc0e4f570 2024-09-19T06:20:46.333 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.328+0000 7f4b78c00640 1 -- 172.21.15.3:0/1753983667 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4b8809c490 con 0x564bc0e4f570 2024-09-19T06:20:46.333 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.328+0000 7f4b987d6740 10 client.17628 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:46.333 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.328+0000 7f4b987d6740 1 -- 172.21.15.3:0/1753983667 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564bc0e5deb0 con 0x564bc0e4f570 2024-09-19T06:20:46.333 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.328+0000 7f4b78c00640 1 -- 172.21.15.3:0/1753983667 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b7c010770 con 0x564bc0e4f570 2024-09-19T06:20:46.333 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.328+0000 7f4b78c00640 1 -- 172.21.15.3:0/1753983667 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4b880b5200 con 0x564bc0e4f570 2024-09-19T06:20:46.333 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.328+0000 7f4b987d6740 10 client.17628 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:46.333 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.328+0000 7f4b987d6740 10 client.17628 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:46.334 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.328+0000 7f4b987d6740 20 client.17628 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:46.334 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.328+0000 7f4b987d6740 1 --2- 172.21.15.3:0/1753983667 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564bc0e5f320 0x564bc0e61710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.334 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.328+0000 7f4b987d6740 4 client.17628 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:46.334 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.328+0000 7f4b987d6740 1 -- 172.21.15.3:0/1753983667 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564bc0db7830 con 0x564bc0e5f320 2024-09-19T06:20:46.334 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.329+0000 7f4b8ea00640 1 --2- 172.21.15.3:0/1753983667 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564bc0e5f320 0x564bc0e61710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.335 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.329+0000 7f4b8ea00640 1 --2- 172.21.15.3:0/1753983667 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564bc0e5f320 0x564bc0e61710 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3fecb5dc9ba56ef server_cookie=facd344c0117d55d in_seq=0 out_seq=0 2024-09-19T06:20:46.335 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.329+0000 7f4b78c00640 10 client.17628 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:46.335 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.330+0000 7f4b78c00640 1 -- 172.21.15.3:0/1753983667 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564bc0db7830 con 0x564bc0e5f320 2024-09-19T06:20:46.335 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.330+0000 7f4b78c00640 10 client.17628 handle_command_reply: tid=0 2024-09-19T06:20:46.335 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.330+0000 7f4b987d6740 1 client.17628 shutdown 2024-09-19T06:20:46.335 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.330+0000 7f4b987d6740 1 -- 172.21.15.3:0/1753983667 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e4f570 msgr2=0x564bc0e4d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.336 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.330+0000 7f4b987d6740 1 --2- 172.21.15.3:0/1753983667 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e4f570 0x564bc0e4d120 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f4b88098e60 tx=0x7f4b8809bfd0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.336 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.330+0000 7f4b987d6740 1 -- 172.21.15.3:0/1753983667 shutdown_connections 2024-09-19T06:20:46.336 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.330+0000 7f4b987d6740 1 --2- 172.21.15.3:0/1753983667 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564bc0e5f320 0x564bc0e61710 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.336 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.330+0000 7f4b987d6740 1 --2- 172.21.15.3:0/1753983667 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e4f570 0x564bc0e4d120 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.336 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.330+0000 7f4b987d6740 1 --2- 172.21.15.3:0/1753983667 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bc0e44cd0 0x564bc0e4cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.336 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.330+0000 7f4b987d6740 1 --2- 172.21.15.3:0/1753983667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e443b0 0x564bc0e4c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.336 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.330+0000 7f4b987d6740 1 -- 172.21.15.3:0/1753983667 >> 172.21.15.3:0/1753983667 conn(0x564bc0e40920 msgr2=0x564bc0e46630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:46.336 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.330+0000 7f4b78c00640 0 client.17628 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:46.336 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.331+0000 7f4b987d6740 1 -- 172.21.15.3:0/1753983667 shutdown_connections 2024-09-19T06:20:46.336 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.331+0000 7f4b987d6740 1 -- 172.21.15.3:0/1753983667 wait complete. 2024-09-19T06:20:46.336 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.331+0000 7f4b987d6740 20 client.17628 trim_cache size 0 max 16384 2024-09-19T06:20:46.348 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.346+0000 7f4b987d6740 1 Processor -- start 2024-09-19T06:20:46.348 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.346+0000 7f4b987d6740 1 -- start start 2024-09-19T06:20:46.348 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.346+0000 7f4b987d6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e443b0 0x564bc0e46e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.348 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.346+0000 7f4b987d6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bc0e44cd0 0x564bc0e3f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.348 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.346+0000 7f4b987d6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e4f570 0x564bc0e66fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.348 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.346+0000 7f4b987d6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4b901af990 con 0x564bc0e4f570 2024-09-19T06:20:46.348 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.346+0000 7f4b987d6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4b901b14d0 con 0x564bc0e443b0 2024-09-19T06:20:46.348 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.346+0000 7f4b987d6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4b901b0060 con 0x564bc0e44cd0 2024-09-19T06:20:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.347+0000 7f4b8f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e4f570 0x564bc0e66fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.347+0000 7f4b8ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e443b0 0x564bc0e46e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.347+0000 7f4b8f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e4f570 0x564bc0e66fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57334/0 (socket says 172.21.15.3:57334) 2024-09-19T06:20:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.347+0000 7f4b8ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e443b0 0x564bc0e46e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40112/0 (socket says 172.21.15.3:40112) 2024-09-19T06:20:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.347+0000 7f4b8f400640 1 -- 172.21.15.3:0/1157759145 learned_addr learned my addr 172.21.15.3:0/1157759145 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.347+0000 7f4b8e000640 1 --2- 172.21.15.3:0/1157759145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bc0e44cd0 0x564bc0e3f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.347+0000 7f4b8ea00640 1 -- 172.21.15.3:0/1157759145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bc0e44cd0 msgr2=0x564bc0e3f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.347+0000 7f4b8ea00640 1 --2- 172.21.15.3:0/1157759145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bc0e44cd0 0x564bc0e3f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.347+0000 7f4b8ea00640 1 -- 172.21.15.3:0/1157759145 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e4f570 msgr2=0x564bc0e66fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.347+0000 7f4b8ea00640 1 --2- 172.21.15.3:0/1157759145 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e4f570 0x564bc0e66fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.347+0000 7f4b8ea00640 1 -- 172.21.15.3:0/1157759145 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bc0e3ac20 con 0x564bc0e443b0 2024-09-19T06:20:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.347+0000 7f4b8ea00640 1 --2- 172.21.15.3:0/1157759145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e443b0 0x564bc0e46e20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4b8002aa70 tx=0x7f4b8003f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a716fe6510ebfe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:46.350 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.348+0000 7f4b7b400640 1 -- 172.21.15.3:0/1157759145 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80035040 con 0x564bc0e443b0 2024-09-19T06:20:46.351 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.348+0000 7f4b7b400640 1 -- 172.21.15.3:0/1157759145 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b8005a070 con 0x564bc0e443b0 2024-09-19T06:20:46.351 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.348+0000 7f4b7b400640 1 -- 172.21.15.3:0/1157759145 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b800035f0 con 0x564bc0e443b0 2024-09-19T06:20:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.348+0000 7f4b987d6740 1 -- 172.21.15.3:0/1157759145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e443b0 msgr2=0x564bc0e46e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.348+0000 7f4b987d6740 1 --2- 172.21.15.3:0/1157759145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e443b0 0x564bc0e46e20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4b8002aa70 tx=0x7f4b8003f000 comp rx=0 tx=0).stop 2024-09-19T06:20:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.349+0000 7f4b987d6740 1 -- 172.21.15.3:0/1157759145 shutdown_connections 2024-09-19T06:20:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.349+0000 7f4b987d6740 1 --2- 172.21.15.3:0/1157759145 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e4f570 0x564bc0e66fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.349+0000 7f4b987d6740 1 --2- 172.21.15.3:0/1157759145 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bc0e44cd0 0x564bc0e3f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.349+0000 7f4b987d6740 1 --2- 172.21.15.3:0/1157759145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e443b0 0x564bc0e46e20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.349+0000 7f4b987d6740 1 -- 172.21.15.3:0/1157759145 >> 172.21.15.3:0/1157759145 conn(0x564bc0e40920 msgr2=0x564bc0e3f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.349+0000 7f4b987d6740 1 -- 172.21.15.3:0/1157759145 shutdown_connections 2024-09-19T06:20:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.349+0000 7f4b987d6740 1 -- 172.21.15.3:0/1157759145 wait complete. 2024-09-19T06:20:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.349+0000 7f4b987d6740 1 -- start start 2024-09-19T06:20:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.349+0000 7f4b987d6740 1 Processor -- start 2024-09-19T06:20:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.350+0000 7f4b987d6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e443b0 0x564bc0e57890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.350+0000 7f4b987d6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e44cd0 0x564bc0e52bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.350+0000 7f4b987d6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bc0e4f570 0x564bc0e530f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.350+0000 7f4b987d6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4b901b0e00 con 0x564bc0e443b0 2024-09-19T06:20:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.350+0000 7f4b987d6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4b901b0730 con 0x564bc0e44cd0 2024-09-19T06:20:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.350+0000 7f4b987d6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4b901ad990 con 0x564bc0e4f570 2024-09-19T06:20:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.350+0000 7f4b987d6740 10 client.0 _ll_register_callbacks cb 0x7f4b88098730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.350+0000 7f4b8ea00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e443b0 0x564bc0e57890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.355 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.350+0000 7f4b8ea00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e443b0 0x564bc0e57890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57340/0 (socket says 172.21.15.3:57340) 2024-09-19T06:20:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.350+0000 7f4b8ea00640 1 -- 172.21.15.3:0/2204103933 learned_addr learned my addr 172.21.15.3:0/2204103933 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.350+0000 7f4b8e000640 1 --2- 172.21.15.3:0/2204103933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e44cd0 0x564bc0e52bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.350+0000 7f4b8f400640 1 --2- 172.21.15.3:0/2204103933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bc0e4f570 0x564bc0e530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.351+0000 7f4b8ea00640 1 -- 172.21.15.3:0/2204103933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bc0e4f570 msgr2=0x564bc0e530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.351+0000 7f4b8ea00640 1 --2- 172.21.15.3:0/2204103933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bc0e4f570 0x564bc0e530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.351+0000 7f4b8ea00640 1 -- 172.21.15.3:0/2204103933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e44cd0 msgr2=0x564bc0e52bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.351+0000 7f4b8ea00640 1 --2- 172.21.15.3:0/2204103933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e44cd0 0x564bc0e52bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.351+0000 7f4b8ea00640 1 -- 172.21.15.3:0/2204103933 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bc0e53630 con 0x564bc0e443b0 2024-09-19T06:20:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.351+0000 7f4b8e000640 1 --2- 172.21.15.3:0/2204103933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e44cd0 0x564bc0e52bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.351+0000 7f4b8f400640 1 --2- 172.21.15.3:0/2204103933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bc0e4f570 0x564bc0e530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.351+0000 7f4b8ea00640 1 --2- 172.21.15.3:0/2204103933 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e443b0 0x564bc0e57890 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4b80031550 tx=0x7f4b80032d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26acee5eabf7edc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.351+0000 7f4b78c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:20:46.356 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.351+0000 7f4b78c00640 1 -- 172.21.15.3:0/2204103933 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b800037f0 con 0x564bc0e443b0 2024-09-19T06:20:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.351+0000 7f4b78c00640 1 -- 172.21.15.3:0/2204103933 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f4b80005610 con 0x564bc0e443b0 2024-09-19T06:20:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.351+0000 7f4b987d6740 1 -- 172.21.15.3:0/2204103933 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b8005a070 con 0x564bc0e443b0 2024-09-19T06:20:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.352+0000 7f4b78c00640 1 -- 172.21.15.3:0/2204103933 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4b80003990 con 0x564bc0e443b0 2024-09-19T06:20:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.352+0000 7f4b987d6740 10 client.17634 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.352+0000 7f4b987d6740 1 -- 172.21.15.3:0/2204103933 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564bc0ec9ca0 con 0x564bc0e443b0 2024-09-19T06:20:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.352+0000 7f4b78c00640 1 -- 172.21.15.3:0/2204103933 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b8005a070 con 0x564bc0e443b0 2024-09-19T06:20:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.352+0000 7f4b78c00640 1 -- 172.21.15.3:0/2204103933 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4b8006d070 con 0x564bc0e443b0 2024-09-19T06:20:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.352+0000 7f4b987d6740 10 client.17634 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.352+0000 7f4b987d6740 10 client.17634 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.352+0000 7f4b987d6740 20 client.17634 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.352+0000 7f4b987d6740 1 --2- 172.21.15.3:0/2204103933 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564bc0eca360 0x564bc0ecc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.352+0000 7f4b987d6740 4 client.17634 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:20:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.352+0000 7f4b987d6740 1 -- 172.21.15.3:0/2204103933 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564bc0db1b80 con 0x564bc0eca360 2024-09-19T06:20:46.358 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.352+0000 7f4b8e000640 1 --2- 172.21.15.3:0/2204103933 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564bc0eca360 0x564bc0ecc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.358 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.353+0000 7f4b8e000640 1 --2- 172.21.15.3:0/2204103933 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564bc0eca360 0x564bc0ecc780 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76f92b12e512eec6 server_cookie=6adc665eac19a8ac in_seq=0 out_seq=0 2024-09-19T06:20:46.358 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.353+0000 7f4b78c00640 10 client.17634 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:46.369 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.367+0000 7f4b78c00640 1 -- 172.21.15.3:0/2204103933 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564bc0db1b80 con 0x564bc0eca360 2024-09-19T06:20:46.369 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.367+0000 7f4b78c00640 10 client.17634 handle_command_reply: tid=0 2024-09-19T06:20:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.367+0000 7f4b987d6740 1 client.17634 shutdown 2024-09-19T06:20:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.367+0000 7f4b987d6740 1 -- 172.21.15.3:0/2204103933 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e443b0 msgr2=0x564bc0e57890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.367+0000 7f4b987d6740 1 --2- 172.21.15.3:0/2204103933 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e443b0 0x564bc0e57890 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4b80031550 tx=0x7f4b80032d40 comp rx=0 tx=0).stop 2024-09-19T06:20:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.368+0000 7f4b987d6740 1 -- 172.21.15.3:0/2204103933 shutdown_connections 2024-09-19T06:20:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.368+0000 7f4b987d6740 1 --2- 172.21.15.3:0/2204103933 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564bc0eca360 0x564bc0ecc780 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.368+0000 7f4b987d6740 1 --2- 172.21.15.3:0/2204103933 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564bc0e4f570 0x564bc0e530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.368+0000 7f4b987d6740 1 --2- 172.21.15.3:0/2204103933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564bc0e44cd0 0x564bc0e52bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.368+0000 7f4b987d6740 1 --2- 172.21.15.3:0/2204103933 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564bc0e443b0 0x564bc0e57890 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.368+0000 7f4b987d6740 1 -- 172.21.15.3:0/2204103933 >> 172.21.15.3:0/2204103933 conn(0x564bc0e40920 msgr2=0x564bc0e5aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.368+0000 7f4b78c00640 0 client.17634 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.368+0000 7f4b987d6740 1 -- 172.21.15.3:0/2204103933 shutdown_connections 2024-09-19T06:20:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.368+0000 7f4b987d6740 1 -- 172.21.15.3:0/2204103933 wait complete. 2024-09-19T06:20:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.368+0000 7f4b987d6740 20 client.17634 trim_cache size 0 max 16384 2024-09-19T06:20:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:20:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:20:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:20:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:20:46.372 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.369+0000 7f4b8fe00640 1 -- 172.21.15.3:0/3579589178 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f4b740a3420 msgr2=0x7f4b740a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.372 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.369+0000 7f4b8fe00640 1 --2- 172.21.15.3:0/3579589178 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f4b740a3420 0x7f4b740a58e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4b80000c00 tx=0x7f4b80005b50 comp rx=0 tx=0).stop 2024-09-19T06:20:46.372 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.369+0000 7f4b8fe00640 1 -- 172.21.15.3:0/3579589178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b9010bf30 msgr2=0x7f4b9019ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.372 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.369+0000 7f4b8fe00640 1 --2- 172.21.15.3:0/3579589178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b9010bf30 0x7f4b9019ed00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4b8800eb10 tx=0x7f4b8800c2d0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.373 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.369+0000 7f4b8fe00640 1 -- 172.21.15.3:0/3579589178 shutdown_connections 2024-09-19T06:20:46.373 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.369+0000 7f4b8fe00640 1 --2- 172.21.15.3:0/3579589178 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f4b740a3420 0x7f4b740a58e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.373 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.369+0000 7f4b8fe00640 1 --2- 172.21.15.3:0/3579589178 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4b9010bf30 0x7f4b9019ed00 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.373 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.369+0000 7f4b8fe00640 1 --2- 172.21.15.3:0/3579589178 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b90103400 0x7f4b9019a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.373 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.369+0000 7f4b8fe00640 1 --2- 172.21.15.3:0/3579589178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b90102ae0 0x7f4b9019a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.373 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.369+0000 7f4b8fe00640 1 -- 172.21.15.3:0/3579589178 >> 172.21.15.3:0/3579589178 conn(0x7f4b900777f0 msgr2=0x7f4b90100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:46.373 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.369+0000 7f4b8fe00640 1 -- 172.21.15.3:0/3579589178 shutdown_connections 2024-09-19T06:20:46.373 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:46.369+0000 7f4b8fe00640 1 -- 172.21.15.3:0/3579589178 wait complete. 2024-09-19T06:20:46.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.425+0000 7f7a94a00640 1 -- 172.21.15.3:0/1860999348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a90074f40 msgr2=0x7f7a9010de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.425+0000 7f7a94a00640 1 --2- 172.21.15.3:0/1860999348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a90074f40 0x7f7a9010de80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c009900 tx=0x7f7a7c02a480 comp rx=0 tx=0).stop 2024-09-19T06:20:46.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.425+0000 7f7a94a00640 1 -- 172.21.15.3:0/1860999348 shutdown_connections 2024-09-19T06:20:46.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.425+0000 7f7a94a00640 1 --2- 172.21.15.3:0/1860999348 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a9010e3c0 0x7f7a90110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.425+0000 7f7a94a00640 1 --2- 172.21.15.3:0/1860999348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a90074f40 0x7f7a9010de80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.425+0000 7f7a94a00640 1 --2- 172.21.15.3:0/1860999348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a90074620 0x7f7a90074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.425+0000 7f7a94a00640 1 -- 172.21.15.3:0/1860999348 >> 172.21.15.3:0/1860999348 conn(0x7f7a900fd8c0 msgr2=0x7f7a900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:46.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.425+0000 7f7a94a00640 1 -- 172.21.15.3:0/1860999348 shutdown_connections 2024-09-19T06:20:46.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.425+0000 7f7a94a00640 1 -- 172.21.15.3:0/1860999348 wait complete. 2024-09-19T06:20:46.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.426+0000 7f7a94a00640 1 Processor -- start 2024-09-19T06:20:46.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.426+0000 7f7a94a00640 1 -- start start 2024-09-19T06:20:46.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.426+0000 7f7a94a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a90074620 0x7f7a9019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.426+0000 7f7a94a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a90074f40 0x7f7a9019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.426+0000 7f7a94a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a9010e3c0 0x7f7a9019ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.426+0000 7f7a94a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7a90114160 con 0x7f7a90074f40 2024-09-19T06:20:46.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.426+0000 7f7a94a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7a90113fe0 con 0x7f7a90074620 2024-09-19T06:20:46.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.426+0000 7f7a94a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7a901142e0 con 0x7f7a9010e3c0 2024-09-19T06:20:46.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.427+0000 7f7a8d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a90074f40 0x7f7a9019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.427+0000 7f7a8de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a90074620 0x7f7a9019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.427+0000 7f7a8d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a90074f40 0x7f7a9019abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57360/0 (socket says 172.21.15.3:57360) 2024-09-19T06:20:46.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.427+0000 7f7a8de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a90074620 0x7f7a9019a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40132/0 (socket says 172.21.15.3:40132) 2024-09-19T06:20:46.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.427+0000 7f7a8d400640 1 -- 172.21.15.3:0/1323294310 learned_addr learned my addr 172.21.15.3:0/1323294310 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:46.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.427+0000 7f7a8e800640 1 --2- 172.21.15.3:0/1323294310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a9010e3c0 0x7f7a9019ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.427+0000 7f7a8de00640 1 -- 172.21.15.3:0/1323294310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a9010e3c0 msgr2=0x7f7a9019ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.427+0000 7f7a8de00640 1 --2- 172.21.15.3:0/1323294310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a9010e3c0 0x7f7a9019ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.427+0000 7f7a8de00640 1 -- 172.21.15.3:0/1323294310 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a90074f40 msgr2=0x7f7a9019abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.427+0000 7f7a8de00640 1 --2- 172.21.15.3:0/1323294310 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a90074f40 0x7f7a9019abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.427+0000 7f7a8de00640 1 -- 172.21.15.3:0/1323294310 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9019f650 con 0x7f7a90074620 2024-09-19T06:20:46.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.427+0000 7f7a8de00640 1 --2- 172.21.15.3:0/1323294310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a90074620 0x7f7a9019a6a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000e9f0 tx=0x7f7a8000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:46.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.428+0000 7f7a86a00640 1 -- 172.21.15.3:0/1323294310 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8000ccc0 con 0x7f7a90074620 2024-09-19T06:20:46.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.428+0000 7f7a94a00640 1 -- 172.21.15.3:0/1323294310 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a9019f940 con 0x7f7a90074620 2024-09-19T06:20:46.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.428+0000 7f7a86a00640 1 -- 172.21.15.3:0/1323294310 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a80005020 con 0x7f7a90074620 2024-09-19T06:20:46.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.428+0000 7f7a86a00640 1 -- 172.21.15.3:0/1323294310 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a800049e0 con 0x7f7a90074620 2024-09-19T06:20:46.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.428+0000 7f7a94a00640 1 -- 172.21.15.3:0/1323294310 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a901a7220 con 0x7f7a90074620 2024-09-19T06:20:46.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.431+0000 7f7a97643740 1 Processor -- start 2024-09-19T06:20:46.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.431+0000 7f7a97643740 1 -- start start 2024-09-19T06:20:46.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.431+0000 7f7a97643740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f7768c70 0x55a4f7769050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.431+0000 7f7a97643740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f7769590 0x55a4f7773910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.431+0000 7f7a97643740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f7773e50 0x55a4f7776240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.431+0000 7f7a97643740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a4f76cf3e0 con 0x55a4f7769590 2024-09-19T06:20:46.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.431+0000 7f7a97643740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a4f7676d80 con 0x55a4f7773e50 2024-09-19T06:20:46.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.431+0000 7f7a97643740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a4f76cb3a0 con 0x55a4f7768c70 2024-09-19T06:20:46.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.432+0000 7f7a86a00640 1 -- 172.21.15.3:0/1323294310 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f7a80005560 con 0x7f7a90074620 2024-09-19T06:20:46.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.432+0000 7f7a8e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f7768c70 0x55a4f7769050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.432+0000 7f7a8d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f7773e50 0x55a4f7776240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.432+0000 7f7a8e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f7768c70 0x55a4f7769050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:51562/0 (socket says 172.21.15.3:51562) 2024-09-19T06:20:46.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.432+0000 7f7a8e800640 1 -- 172.21.15.3:0/2384700809 learned_addr learned my addr 172.21.15.3:0/2384700809 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:46.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.432+0000 7f7a8de00640 1 --2- 172.21.15.3:0/2384700809 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f7769590 0x55a4f7773910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.432+0000 7f7a8d400640 1 -- 172.21.15.3:0/2384700809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f7768c70 msgr2=0x55a4f7769050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:46.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.432+0000 7f7a8d400640 1 --2- 172.21.15.3:0/2384700809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f7768c70 0x55a4f7769050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.432+0000 7f7a8d400640 1 -- 172.21.15.3:0/2384700809 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f7769590 msgr2=0x55a4f7773910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:46.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.432+0000 7f7a8d400640 1 --2- 172.21.15.3:0/2384700809 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f7769590 0x55a4f7773910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.432+0000 7f7a8d400640 1 -- 172.21.15.3:0/2384700809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4f7695ae0 con 0x55a4f7773e50 2024-09-19T06:20:46.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.433+0000 7f7a8d400640 1 --2- 172.21.15.3:0/2384700809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f7773e50 0x55a4f7776240 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c009230 tx=0x7f7a7c005dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41069c6a2df4bdf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:46.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.433+0000 7f7a7b000640 1 -- 172.21.15.3:0/2384700809 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c040070 con 0x55a4f7773e50 2024-09-19T06:20:46.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.433+0000 7f7a7b000640 1 -- 172.21.15.3:0/2384700809 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a7c004030 con 0x55a4f7773e50 2024-09-19T06:20:46.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.433+0000 7f7a7b000640 1 -- 172.21.15.3:0/2384700809 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c035040 con 0x55a4f7773e50 2024-09-19T06:20:46.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.433+0000 7f7a86a00640 1 --2- 172.21.15.3:0/1323294310 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7a740a33b0 0x7f7a740a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.433+0000 7f7a86a00640 1 -- 172.21.15.3:0/1323294310 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f7a800cfdd0 con 0x7f7a90074620 2024-09-19T06:20:46.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.434+0000 7f7a97643740 1 -- 172.21.15.3:0/2384700809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f7773e50 msgr2=0x55a4f7776240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.434+0000 7f7a97643740 1 --2- 172.21.15.3:0/2384700809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f7773e50 0x55a4f7776240 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c009230 tx=0x7f7a7c005dd0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.434+0000 7f7a8e800640 1 --2- 172.21.15.3:0/1323294310 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7a740a33b0 0x7f7a740a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.434+0000 7f7a97643740 1 -- 172.21.15.3:0/2384700809 shutdown_connections 2024-09-19T06:20:46.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.434+0000 7f7a97643740 1 --2- 172.21.15.3:0/2384700809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f7773e50 0x55a4f7776240 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.434+0000 7f7a97643740 1 --2- 172.21.15.3:0/2384700809 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f7769590 0x55a4f7773910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.434+0000 7f7a97643740 1 --2- 172.21.15.3:0/2384700809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f7768c70 0x55a4f7769050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.434+0000 7f7a97643740 1 -- 172.21.15.3:0/2384700809 >> 172.21.15.3:0/2384700809 conn(0x55a4f7765200 msgr2=0x55a4f77655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:46.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.434+0000 7f7a97643740 1 -- 172.21.15.3:0/2384700809 shutdown_connections 2024-09-19T06:20:46.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.434+0000 7f7a97643740 1 -- 172.21.15.3:0/2384700809 wait complete. 2024-09-19T06:20:46.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.434+0000 7f7a8e800640 1 --2- 172.21.15.3:0/1323294310 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7a740a33b0 0x7f7a740a5870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7a88005fd0 tx=0x7f7a88009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:46.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.435+0000 7f7a97643740 1 -- start start 2024-09-19T06:20:46.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.435+0000 7f7a97643740 1 Processor -- start 2024-09-19T06:20:46.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.435+0000 7f7a97643740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f7768c70 0x55a4f7770d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.435+0000 7f7a97643740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f7769590 0x55a4f7771270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.435+0000 7f7a97643740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f7773e50 0x55a4f77717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.435+0000 7f7a97643740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a4f7776a20 con 0x55a4f7773e50 2024-09-19T06:20:46.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.435+0000 7f7a97643740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a4f768a0f0 con 0x55a4f7769590 2024-09-19T06:20:46.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.435+0000 7f7a97643740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a4f7776ba0 con 0x55a4f7768c70 2024-09-19T06:20:46.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.436+0000 7f7a97643740 10 client.0 _ll_register_callbacks cb 0x55a4f7671bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:46.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.436+0000 7f7a8e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f7773e50 0x55a4f77717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.436+0000 7f7a8d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f7769590 0x55a4f7771270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.436+0000 7f7a8e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f7773e50 0x55a4f77717b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57374/0 (socket says 172.21.15.3:57374) 2024-09-19T06:20:46.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.436+0000 7f7a8e800640 1 -- 172.21.15.3:0/3938407997 learned_addr learned my addr 172.21.15.3:0/3938407997 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.436+0000 7f7a8de00640 1 --2- 172.21.15.3:0/3938407997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f7768c70 0x55a4f7770d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.436+0000 7f7a8d400640 1 -- 172.21.15.3:0/3938407997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f7768c70 msgr2=0x55a4f7770d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.436+0000 7f7a8d400640 1 --2- 172.21.15.3:0/3938407997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f7768c70 0x55a4f7770d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.436+0000 7f7a8d400640 1 -- 172.21.15.3:0/3938407997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f7773e50 msgr2=0x55a4f77717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.436+0000 7f7a8d400640 1 --2- 172.21.15.3:0/3938407997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f7773e50 0x55a4f77717b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.436+0000 7f7a8d400640 1 -- 172.21.15.3:0/3938407997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4f74403c0 con 0x55a4f7769590 2024-09-19T06:20:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.437+0000 7f7a8d400640 1 --2- 172.21.15.3:0/3938407997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f7769590 0x55a4f7771270 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c031550 tx=0x7f7a7c004410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37231a0a6679a264 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.437+0000 7f7a6f400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:20:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.437+0000 7f7a6f400640 1 -- 172.21.15.3:0/3938407997 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c040050 con 0x55a4f7769590 2024-09-19T06:20:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.437+0000 7f7a6f400640 1 -- 172.21.15.3:0/3938407997 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f7a7c0315b0 con 0x55a4f7769590 2024-09-19T06:20:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.437+0000 7f7a97643740 1 -- 172.21.15.3:0/3938407997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a7c004030 con 0x55a4f7769590 2024-09-19T06:20:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.437+0000 7f7a6f400640 1 -- 172.21.15.3:0/3938407997 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7a7c035040 con 0x55a4f7769590 2024-09-19T06:20:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.437+0000 7f7a97643740 10 client.27680 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:46.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.437+0000 7f7a97643740 1 -- 172.21.15.3:0/3938407997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a4f7782a60 con 0x55a4f7769590 2024-09-19T06:20:46.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.437+0000 7f7a6f400640 1 -- 172.21.15.3:0/3938407997 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a7c004030 con 0x55a4f7769590 2024-09-19T06:20:46.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.438+0000 7f7a6f400640 1 -- 172.21.15.3:0/3938407997 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f7a7c04c070 con 0x55a4f7769590 2024-09-19T06:20:46.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.438+0000 7f7a97643740 10 client.27680 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:46.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.438+0000 7f7a97643740 10 client.27680 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:46.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.438+0000 7f7a97643740 20 client.27680 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:46.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.438+0000 7f7a97643740 1 --2- 172.21.15.3:0/3938407997 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a4f7783db0 0x55a4f77861a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.438+0000 7f7a97643740 4 client.27680 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:46.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.438+0000 7f7a97643740 1 -- 172.21.15.3:0/3938407997 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4f76dc950 con 0x55a4f7783db0 2024-09-19T06:20:46.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.438+0000 7f7a8de00640 1 --2- 172.21.15.3:0/3938407997 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a4f7783db0 0x55a4f77861a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.439+0000 7f7a8de00640 1 --2- 172.21.15.3:0/3938407997 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a4f7783db0 0x55a4f77861a0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c209abdf09c222fc server_cookie=e69aec316fa9597d in_seq=0 out_seq=0 2024-09-19T06:20:46.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.439+0000 7f7a6f400640 10 client.27680 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:46.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.439+0000 7f7a6f400640 1 -- 172.21.15.3:0/3938407997 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a4f76dc950 con 0x55a4f7783db0 2024-09-19T06:20:46.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.439+0000 7f7a6f400640 10 client.27680 handle_command_reply: tid=0 2024-09-19T06:20:46.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.439+0000 7f7a97643740 1 client.27680 shutdown 2024-09-19T06:20:46.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.440+0000 7f7a97643740 1 -- 172.21.15.3:0/3938407997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f7769590 msgr2=0x55a4f7771270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.440+0000 7f7a97643740 1 --2- 172.21.15.3:0/3938407997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f7769590 0x55a4f7771270 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c031550 tx=0x7f7a7c004410 comp rx=0 tx=0).stop 2024-09-19T06:20:46.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.440+0000 7f7a97643740 1 -- 172.21.15.3:0/3938407997 shutdown_connections 2024-09-19T06:20:46.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.440+0000 7f7a97643740 1 --2- 172.21.15.3:0/3938407997 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a4f7783db0 0x55a4f77861a0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.440+0000 7f7a97643740 1 --2- 172.21.15.3:0/3938407997 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f7773e50 0x55a4f77717b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.440+0000 7f7a97643740 1 --2- 172.21.15.3:0/3938407997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f7769590 0x55a4f7771270 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.440+0000 7f7a6f400640 0 client.27680 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:46.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.440+0000 7f7a97643740 1 --2- 172.21.15.3:0/3938407997 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f7768c70 0x55a4f7770d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.440+0000 7f7a97643740 1 -- 172.21.15.3:0/3938407997 >> 172.21.15.3:0/3938407997 conn(0x55a4f7765200 msgr2=0x55a4f776af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:46.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.440+0000 7f7a97643740 1 -- 172.21.15.3:0/3938407997 shutdown_connections 2024-09-19T06:20:46.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.440+0000 7f7a97643740 1 -- 172.21.15.3:0/3938407997 wait complete. 2024-09-19T06:20:46.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.440+0000 7f7a97643740 20 client.27680 trim_cache size 0 max 16384 2024-09-19T06:20:46.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.454+0000 7f7a97643740 1 Processor -- start 2024-09-19T06:20:46.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.454+0000 7f7a97643740 1 -- start start 2024-09-19T06:20:46.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.454+0000 7f7a97643740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f7768c70 0x55a4f778b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.454+0000 7f7a97643740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f7769590 0x55a4f778bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.454+0000 7f7a97643740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f7773e50 0x55a4f7763b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.454+0000 7f7a97643740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7a901afa70 con 0x55a4f7773e50 2024-09-19T06:20:46.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.454+0000 7f7a97643740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7a901b15b0 con 0x55a4f7769590 2024-09-19T06:20:46.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.454+0000 7f7a97643740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7a901b0140 con 0x55a4f7768c70 2024-09-19T06:20:46.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.454+0000 7f7a8e800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f7773e50 0x55a4f7763b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.454+0000 7f7a8de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f7768c70 0x55a4f778b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.454+0000 7f7a8de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f7768c70 0x55a4f778b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:51570/0 (socket says 172.21.15.3:51570) 2024-09-19T06:20:46.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.454+0000 7f7a8de00640 1 -- 172.21.15.3:0/519400037 learned_addr learned my addr 172.21.15.3:0/519400037 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:46.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.454+0000 7f7a8d400640 1 --2- 172.21.15.3:0/519400037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f7769590 0x55a4f778bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.455+0000 7f7a8de00640 1 -- 172.21.15.3:0/519400037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f7769590 msgr2=0x55a4f778bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:46.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.455+0000 7f7a8de00640 1 --2- 172.21.15.3:0/519400037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f7769590 0x55a4f778bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.455+0000 7f7a8de00640 1 -- 172.21.15.3:0/519400037 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f7773e50 msgr2=0x55a4f7763b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:46.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.455+0000 7f7a8de00640 1 --2- 172.21.15.3:0/519400037 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f7773e50 0x55a4f7763b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.455+0000 7f7a8de00640 1 -- 172.21.15.3:0/519400037 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4f7768aa0 con 0x55a4f7768c70 2024-09-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.455+0000 7f7a8de00640 1 --2- 172.21.15.3:0/519400037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f7768c70 0x55a4f778b770 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7a8009bfb0 tx=0x7f7a800bc040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75c2f3d24d20f363 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.455+0000 7f7a7a600640 1 -- 172.21.15.3:0/519400037 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a800b4070 con 0x55a4f7768c70 2024-09-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.455+0000 7f7a7a600640 1 -- 172.21.15.3:0/519400037 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a8009c720 con 0x55a4f7768c70 2024-09-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.455+0000 7f7a7a600640 1 -- 172.21.15.3:0/519400037 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8001c040 con 0x55a4f7768c70 2024-09-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.456+0000 7f7a97643740 1 -- 172.21.15.3:0/519400037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f7768c70 msgr2=0x55a4f778b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.456+0000 7f7a97643740 1 --2- 172.21.15.3:0/519400037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f7768c70 0x55a4f778b770 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7a8009bfb0 tx=0x7f7a800bc040 comp rx=0 tx=0).stop 2024-09-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.456+0000 7f7a97643740 1 -- 172.21.15.3:0/519400037 shutdown_connections 2024-09-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.456+0000 7f7a97643740 1 --2- 172.21.15.3:0/519400037 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f7773e50 0x55a4f7763b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.456+0000 7f7a97643740 1 --2- 172.21.15.3:0/519400037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f7769590 0x55a4f778bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.456+0000 7f7a97643740 1 --2- 172.21.15.3:0/519400037 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f7768c70 0x55a4f778b770 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.456+0000 7f7a97643740 1 -- 172.21.15.3:0/519400037 >> 172.21.15.3:0/519400037 conn(0x55a4f7765200 msgr2=0x55a4f7772db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:46.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.456+0000 7f7a97643740 1 -- 172.21.15.3:0/519400037 shutdown_connections 2024-09-19T06:20:46.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.456+0000 7f7a97643740 1 -- 172.21.15.3:0/519400037 wait complete. 2024-09-19T06:20:46.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.456+0000 7f7a97643740 1 -- start start 2024-09-19T06:20:46.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.457+0000 7f7a97643740 1 Processor -- start 2024-09-19T06:20:46.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.457+0000 7f7a97643740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f7768c70 0x55a4f777c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.457+0000 7f7a97643740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f7769590 0x55a4f7777a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.457+0000 7f7a97643740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f7773e50 0x55a4f77781b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.457+0000 7f7a97643740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7a901b0ee0 con 0x55a4f7769590 2024-09-19T06:20:46.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.457+0000 7f7a97643740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7a901b0810 con 0x55a4f7773e50 2024-09-19T06:20:46.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.457+0000 7f7a97643740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7a901ada70 con 0x55a4f7768c70 2024-09-19T06:20:46.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.457+0000 7f7a97643740 10 client.0 _ll_register_callbacks cb 0x7f7a880099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:46.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.458+0000 7f7a8de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f7768c70 0x55a4f777c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.458+0000 7f7a8e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f7773e50 0x55a4f77781b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.458+0000 7f7a8d400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f7769590 0x55a4f7777a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.458+0000 7f7a8de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f7768c70 0x55a4f777c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:51586/0 (socket says 172.21.15.3:51586) 2024-09-19T06:20:46.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.458+0000 7f7a8de00640 1 -- 172.21.15.3:0/3776852514 learned_addr learned my addr 172.21.15.3:0/3776852514 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:46.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.458+0000 7f7a8e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f7773e50 0x55a4f77781b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40164/0 (socket says 172.21.15.3:40164) 2024-09-19T06:20:46.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.458+0000 7f7a8d400640 1 -- 172.21.15.3:0/3776852514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f7768c70 msgr2=0x55a4f777c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:46.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.458+0000 7f7a8d400640 1 --2- 172.21.15.3:0/3776852514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f7768c70 0x55a4f777c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.458+0000 7f7a8d400640 1 -- 172.21.15.3:0/3776852514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f7773e50 msgr2=0x55a4f77781b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:46.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.458+0000 7f7a8d400640 1 --2- 172.21.15.3:0/3776852514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f7773e50 0x55a4f77781b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.458+0000 7f7a8d400640 1 -- 172.21.15.3:0/3776852514 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4f7760770 con 0x55a4f7769590 2024-09-19T06:20:46.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.458+0000 7f7a8e800640 1 --2- 172.21.15.3:0/3776852514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f7773e50 0x55a4f77781b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:46.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.458+0000 7f7a8d400640 1 --2- 172.21.15.3:0/3776852514 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f7769590 0x55a4f7777a20 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c009a20 tx=0x7f7a7c009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f0768b8c2e1045 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:46.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.458+0000 7f7a6f400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:20:46.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.459+0000 7f7a6f400640 1 -- 172.21.15.3:0/3776852514 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c040070 con 0x55a4f7769590 2024-09-19T06:20:46.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.459+0000 7f7a6f400640 1 -- 172.21.15.3:0/3776852514 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f7a7c004740 con 0x55a4f7769590 2024-09-19T06:20:46.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.459+0000 7f7a97643740 1 -- 172.21.15.3:0/3776852514 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a8009c720 con 0x55a4f7769590 2024-09-19T06:20:46.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.459+0000 7f7a6f400640 1 -- 172.21.15.3:0/3776852514 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7a7c0315b0 con 0x55a4f7769590 2024-09-19T06:20:46.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.459+0000 7f7a97643740 10 client.17652 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:46.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.459+0000 7f7a97643740 1 -- 172.21.15.3:0/3776852514 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a4f77ee730 con 0x55a4f7769590 2024-09-19T06:20:46.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.459+0000 7f7a6f400640 1 -- 172.21.15.3:0/3776852514 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a8009c720 con 0x55a4f7769590 2024-09-19T06:20:46.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.459+0000 7f7a6f400640 1 -- 172.21.15.3:0/3776852514 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f7a7c066070 con 0x55a4f7769590 2024-09-19T06:20:46.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.460+0000 7f7a97643740 10 client.17652 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:46.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.460+0000 7f7a97643740 10 client.17652 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:46.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.460+0000 7f7a97643740 20 client.17652 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:46.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.460+0000 7f7a97643740 1 --2- 172.21.15.3:0/3776852514 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a4f77eee50 0x55a4f77f1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:46.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.460+0000 7f7a97643740 4 client.17652 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:46.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.460+0000 7f7a97643740 1 -- 172.21.15.3:0/3776852514 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a4f76d6e60 con 0x55a4f77eee50 2024-09-19T06:20:46.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.460+0000 7f7a8de00640 1 --2- 172.21.15.3:0/3776852514 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a4f77eee50 0x55a4f77f1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:46.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.461+0000 7f7a8de00640 1 --2- 172.21.15.3:0/3776852514 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a4f77eee50 0x55a4f77f1270 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d7b1e222602cdc7 server_cookie=73aa16dd78dfb36a in_seq=0 out_seq=0 2024-09-19T06:20:46.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.461+0000 7f7a6f400640 10 client.17652 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:46.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.461+0000 7f7a6f400640 1 -- 172.21.15.3:0/3776852514 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a4f76d6e60 con 0x55a4f77eee50 2024-09-19T06:20:46.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.461+0000 7f7a6f400640 10 client.17652 handle_command_reply: tid=0 2024-09-19T06:20:46.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.461+0000 7f7a97643740 1 client.17652 shutdown 2024-09-19T06:20:46.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.461+0000 7f7a97643740 1 -- 172.21.15.3:0/3776852514 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f7769590 msgr2=0x55a4f7777a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.461+0000 7f7a97643740 1 --2- 172.21.15.3:0/3776852514 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f7769590 0x55a4f7777a20 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c009a20 tx=0x7f7a7c009610 comp rx=0 tx=0).stop 2024-09-19T06:20:46.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.461+0000 7f7a97643740 1 -- 172.21.15.3:0/3776852514 shutdown_connections 2024-09-19T06:20:46.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.461+0000 7f7a97643740 1 --2- 172.21.15.3:0/3776852514 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a4f77eee50 0x55a4f77f1270 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.461+0000 7f7a97643740 1 --2- 172.21.15.3:0/3776852514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f7773e50 0x55a4f77781b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.461+0000 7f7a97643740 1 --2- 172.21.15.3:0/3776852514 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f7769590 0x55a4f7777a20 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.461+0000 7f7a97643740 1 --2- 172.21.15.3:0/3776852514 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f7768c70 0x55a4f777c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.461+0000 7f7a97643740 1 -- 172.21.15.3:0/3776852514 >> 172.21.15.3:0/3776852514 conn(0x55a4f7765200 msgr2=0x55a4f7763b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:46.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.461+0000 7f7a6f400640 0 client.17652 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:46.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.461+0000 7f7a97643740 1 -- 172.21.15.3:0/3776852514 shutdown_connections 2024-09-19T06:20:46.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.461+0000 7f7a97643740 1 -- 172.21.15.3:0/3776852514 wait complete. 2024-09-19T06:20:46.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.462+0000 7f7a97643740 20 client.17652 trim_cache size 0 max 16384 2024-09-19T06:20:46.467 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:20:46.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.462+0000 7f7a94a00640 1 -- 172.21.15.3:0/1323294310 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7a740a33b0 msgr2=0x7f7a740a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.462+0000 7f7a94a00640 1 --2- 172.21.15.3:0/1323294310 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7a740a33b0 0x7f7a740a5870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7a88005fd0 tx=0x7f7a88009500 comp rx=0 tx=0).stop 2024-09-19T06:20:46.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.462+0000 7f7a94a00640 1 -- 172.21.15.3:0/1323294310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a90074620 msgr2=0x7f7a9019a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:46.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.462+0000 7f7a94a00640 1 --2- 172.21.15.3:0/1323294310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a90074620 0x7f7a9019a6a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000e9f0 tx=0x7f7a8000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.462+0000 7f7a94a00640 1 -- 172.21.15.3:0/1323294310 shutdown_connections 2024-09-19T06:20:46.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.462+0000 7f7a94a00640 1 --2- 172.21.15.3:0/1323294310 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7a740a33b0 0x7f7a740a5870 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.462+0000 7f7a94a00640 1 --2- 172.21.15.3:0/1323294310 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7a9010e3c0 0x7f7a9019ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.462+0000 7f7a94a00640 1 --2- 172.21.15.3:0/1323294310 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a90074f40 0x7f7a9019abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.462+0000 7f7a94a00640 1 --2- 172.21.15.3:0/1323294310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a90074620 0x7f7a9019a6a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:46.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.462+0000 7f7a94a00640 1 -- 172.21.15.3:0/1323294310 >> 172.21.15.3:0/1323294310 conn(0x7f7a900fd8c0 msgr2=0x7f7a900fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:46.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.463+0000 7f7a94a00640 1 -- 172.21.15.3:0/1323294310 shutdown_connections 2024-09-19T06:20:46.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:46.463+0000 7f7a94a00640 1 -- 172.21.15.3:0/1323294310 wait complete. 2024-09-19T06:20:46.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:46 smithi059 ceph-mon[35138]: pgmap v258: 97 pgs: 97 active+clean; 3.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 22 op/s 2024-09-19T06:20:46.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:46 smithi071 ceph-mon[35662]: pgmap v258: 97 pgs: 97 active+clean; 3.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 22 op/s 2024-09-19T06:20:48.257 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:20:48.258 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:20:48.388 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:48 smithi071 ceph-mon[35662]: pgmap v259: 97 pgs: 97 active+clean; 3.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-09-19T06:20:48.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:48 smithi059 ceph-mon[35138]: pgmap v259: 97 pgs: 97 active+clean; 3.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-09-19T06:20:48.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:48 smithi003 ceph-mon[30893]: pgmap v259: 97 pgs: 97 active+clean; 3.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-09-19T06:20:48.650 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:49.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.232+0000 7f864b400640 1 -- 172.21.15.3:0/2166014803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8644076720 msgr2=0x7f8644076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:49.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.232+0000 7f864b400640 1 --2- 172.21.15.3:0/2166014803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8644076720 0x7f8644076b00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f8634009900 tx=0x7f863402a410 comp rx=0 tx=0).stop 2024-09-19T06:20:49.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.232+0000 7f864b400640 1 -- 172.21.15.3:0/2166014803 shutdown_connections 2024-09-19T06:20:49.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.232+0000 7f864b400640 1 --2- 172.21.15.3:0/2166014803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8644112a30 0x7f8644114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.232+0000 7f864b400640 1 --2- 172.21.15.3:0/2166014803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8644077040 0x7f86441124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.232+0000 7f864b400640 1 --2- 172.21.15.3:0/2166014803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8644076720 0x7f8644076b00 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.232+0000 7f864b400640 1 -- 172.21.15.3:0/2166014803 >> 172.21.15.3:0/2166014803 conn(0x7f86440ffa90 msgr2=0x7f8644101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:49.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.232+0000 7f864b400640 1 -- 172.21.15.3:0/2166014803 shutdown_connections 2024-09-19T06:20:49.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.232+0000 7f864b400640 1 -- 172.21.15.3:0/2166014803 wait complete. 2024-09-19T06:20:49.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.233+0000 7f864b400640 1 Processor -- start 2024-09-19T06:20:49.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.233+0000 7f864b400640 1 -- start start 2024-09-19T06:20:49.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.233+0000 7f864b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8644076720 0x7f86441a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.233+0000 7f864b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8644077040 0x7f86441a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.233+0000 7f864b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8644112a30 0x7f864419e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.233+0000 7f864b400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f86441185f0 con 0x7f8644077040 2024-09-19T06:20:49.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.233+0000 7f864b400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8644118470 con 0x7f8644076720 2024-09-19T06:20:49.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.233+0000 7f864b400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8644118770 con 0x7f8644112a30 2024-09-19T06:20:49.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.234+0000 7f8648a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8644076720 0x7f86441a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.234+0000 7f863be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8644077040 0x7f86441a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.234+0000 7f8648a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8644076720 0x7f86441a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40174/0 (socket says 172.21.15.3:40174) 2024-09-19T06:20:49.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.234+0000 7f8648a00640 1 -- 172.21.15.3:0/1350570410 learned_addr learned my addr 172.21.15.3:0/1350570410 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:49.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.234+0000 7f8649400640 1 --2- 172.21.15.3:0/1350570410 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8644112a30 0x7f864419e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.234+0000 7f8648a00640 1 -- 172.21.15.3:0/1350570410 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8644112a30 msgr2=0x7f864419e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:49.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.234+0000 7f8648a00640 1 --2- 172.21.15.3:0/1350570410 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8644112a30 0x7f864419e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.234+0000 7f8648a00640 1 -- 172.21.15.3:0/1350570410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8644077040 msgr2=0x7f86441a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:49.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.234+0000 7f8648a00640 1 --2- 172.21.15.3:0/1350570410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8644077040 0x7f86441a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.234+0000 7f8648a00640 1 -- 172.21.15.3:0/1350570410 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f864419ef90 con 0x7f8644076720 2024-09-19T06:20:49.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.234+0000 7f863be00640 1 --2- 172.21.15.3:0/1350570410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8644077040 0x7f86441a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:49.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.235+0000 7f8648a00640 1 --2- 172.21.15.3:0/1350570410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8644076720 0x7f86441a46a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8634004770 tx=0x7f8634003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:49.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.235+0000 7f8642000640 1 -- 172.21.15.3:0/1350570410 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863403f070 con 0x7f8644076720 2024-09-19T06:20:49.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.235+0000 7f864b400640 1 -- 172.21.15.3:0/1350570410 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f864419f220 con 0x7f8644076720 2024-09-19T06:20:49.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.235+0000 7f8642000640 1 -- 172.21.15.3:0/1350570410 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8634031ca0 con 0x7f8644076720 2024-09-19T06:20:49.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.235+0000 7f8642000640 1 -- 172.21.15.3:0/1350570410 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8634035030 con 0x7f8644076720 2024-09-19T06:20:49.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.235+0000 7f864b400640 1 -- 172.21.15.3:0/1350570410 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86441ab570 con 0x7f8644076720 2024-09-19T06:20:49.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.238+0000 7f864de41740 1 Processor -- start 2024-09-19T06:20:49.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.238+0000 7f864de41740 1 -- start start 2024-09-19T06:20:49.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.238+0000 7f8642000640 1 -- 172.21.15.3:0/1350570410 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f8634042070 con 0x7f8644076720 2024-09-19T06:20:49.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.238+0000 7f864de41740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa43ac0 0x55f20aa43ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.238+0000 7f864de41740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f20aa443e0 0x55f20aa4e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.238+0000 7f864de41740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f20aa4eca0 0x55f20aa51090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.238+0000 7f864de41740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55f20a9aa290 con 0x55f20aa443e0 2024-09-19T06:20:49.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.238+0000 7f864de41740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f20a951b40 con 0x55f20aa43ac0 2024-09-19T06:20:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.238+0000 7f864de41740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f20a9a6250 con 0x55f20aa4eca0 2024-09-19T06:20:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.239+0000 7f8648a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f20aa443e0 0x55f20aa4e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.239+0000 7f8649400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa43ac0 0x55f20aa43ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.239+0000 7f8648a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f20aa443e0 0x55f20aa4e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57408/0 (socket says 172.21.15.3:57408) 2024-09-19T06:20:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.239+0000 7f8648a00640 1 -- 172.21.15.3:0/1266397689 learned_addr learned my addr 172.21.15.3:0/1266397689 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.239+0000 7f8649400640 1 -- 172.21.15.3:0/1266397689 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f20aa4eca0 msgr2=0x55f20aa51090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.239+0000 7f8649400640 1 --2- 172.21.15.3:0/1266397689 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f20aa4eca0 0x55f20aa51090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.239+0000 7f8649400640 1 -- 172.21.15.3:0/1266397689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f20aa443e0 msgr2=0x55f20aa4e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.239+0000 7f8649400640 1 --2- 172.21.15.3:0/1266397689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f20aa443e0 0x55f20aa4e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.239+0000 7f8649400640 1 -- 172.21.15.3:0/1266397689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f20a71b6a0 con 0x55f20aa43ac0 2024-09-19T06:20:49.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.240+0000 7f8649400640 1 --2- 172.21.15.3:0/1266397689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa43ac0 0x55f20aa43ea0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f864407aa10 tx=0x7f863c010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a74a53336422cb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:49.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.240+0000 7f8642000640 1 --2- 172.21.15.3:0/1350570410 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f86280a3430 0x7f86280a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.240+0000 7f8639c00640 1 -- 172.21.15.3:0/1266397689 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c016070 con 0x55f20aa43ac0 2024-09-19T06:20:49.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.240+0000 7f8639c00640 1 -- 172.21.15.3:0/1266397689 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f863c004d20 con 0x55f20aa43ac0 2024-09-19T06:20:49.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.240+0000 7f8639c00640 1 -- 172.21.15.3:0/1266397689 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c012810 con 0x55f20aa43ac0 2024-09-19T06:20:49.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.240+0000 7f8642000640 1 -- 172.21.15.3:0/1350570410 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f86340f0380 con 0x7f8644076720 2024-09-19T06:20:49.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.240+0000 7f8648a00640 1 --2- 172.21.15.3:0/1350570410 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f86280a3430 0x7f86280a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.241+0000 7f864de41740 1 -- 172.21.15.3:0/1266397689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa43ac0 msgr2=0x55f20aa43ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:49.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.241+0000 7f864de41740 1 --2- 172.21.15.3:0/1266397689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa43ac0 0x55f20aa43ea0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f864407aa10 tx=0x7f863c010740 comp rx=0 tx=0).stop 2024-09-19T06:20:49.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.241+0000 7f864de41740 1 -- 172.21.15.3:0/1266397689 shutdown_connections 2024-09-19T06:20:49.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.241+0000 7f864de41740 1 --2- 172.21.15.3:0/1266397689 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f20aa4eca0 0x55f20aa51090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.241+0000 7f864de41740 1 --2- 172.21.15.3:0/1266397689 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f20aa443e0 0x55f20aa4e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.241+0000 7f864de41740 1 --2- 172.21.15.3:0/1266397689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa43ac0 0x55f20aa43ea0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.241+0000 7f864de41740 1 -- 172.21.15.3:0/1266397689 >> 172.21.15.3:0/1266397689 conn(0x55f20aa40050 msgr2=0x55f20aa40430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:49.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.241+0000 7f8648a00640 1 --2- 172.21.15.3:0/1350570410 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f86280a3430 0x7f86280a58f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f86340bc380 tx=0x7f86340f3e30 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:49.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.241+0000 7f864de41740 1 -- 172.21.15.3:0/1266397689 shutdown_connections 2024-09-19T06:20:49.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.241+0000 7f864de41740 1 -- 172.21.15.3:0/1266397689 wait complete. 2024-09-19T06:20:49.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.241+0000 7f864de41740 1 -- start start 2024-09-19T06:20:49.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.242+0000 7f864de41740 1 Processor -- start 2024-09-19T06:20:49.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.242+0000 7f864de41740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa43ac0 0x55f20aa4e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.242+0000 7f864de41740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f20aa443e0 0x55f20aa4b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.242+0000 7f864de41740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f20aa4eca0 0x55f20aa4bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.242+0000 7f864de41740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55f20aa51910 con 0x55f20aa443e0 2024-09-19T06:20:49.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.242+0000 7f864de41740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f20a964fa0 con 0x55f20aa43ac0 2024-09-19T06:20:49.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.242+0000 7f864de41740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f20aa51a90 con 0x55f20aa4eca0 2024-09-19T06:20:49.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.242+0000 7f864de41740 10 client.0 _ll_register_callbacks cb 0x55f20a6b8ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:49.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.242+0000 7f8649400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa43ac0 0x55f20aa4e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.242+0000 7f863be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f20aa443e0 0x55f20aa4b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.242+0000 7f8649400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa43ac0 0x55f20aa4e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40200/0 (socket says 172.21.15.3:40200) 2024-09-19T06:20:49.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.242+0000 7f8649400640 1 -- 172.21.15.3:0/146641275 learned_addr learned my addr 172.21.15.3:0/146641275 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:49.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.243+0000 7f8649400640 1 --2- 172.21.15.3:0/146641275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f20aa4eca0 0x55f20aa4bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.243+0000 7f863be00640 1 -- 172.21.15.3:0/146641275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f20aa4eca0 msgr2=0x55f20aa4bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:49.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.243+0000 7f863be00640 1 --2- 172.21.15.3:0/146641275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f20aa4eca0 0x55f20aa4bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.243+0000 7f863be00640 1 -- 172.21.15.3:0/146641275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa43ac0 msgr2=0x55f20aa4e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:49.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.243+0000 7f863be00640 1 --2- 172.21.15.3:0/146641275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa43ac0 0x55f20aa4e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.243+0000 7f863be00640 1 -- 172.21.15.3:0/146641275 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f20aa4c6d0 con 0x55f20aa443e0 2024-09-19T06:20:49.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.243+0000 7f8649400640 1 --2- 172.21.15.3:0/146641275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa43ac0 0x55f20aa4e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:49.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.243+0000 7f863be00640 1 --2- 172.21.15.3:0/146641275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f20aa443e0 0x55f20aa4b900 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f8644079220 tx=0x7f862c011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7605e9a3247e5fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:49.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.243+0000 7f8632000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:20:49.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.243+0000 7f8632000640 1 -- 172.21.15.3:0/146641275 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c00f890 con 0x55f20aa443e0 2024-09-19T06:20:49.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.244+0000 7f864de41740 1 -- 172.21.15.3:0/146641275 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f863c004d20 con 0x55f20aa443e0 2024-09-19T06:20:49.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.244+0000 7f8632000640 1 -- 172.21.15.3:0/146641275 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f862c00fa30 con 0x55f20aa443e0 2024-09-19T06:20:49.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.244+0000 7f8632000640 1 -- 172.21.15.3:0/146641275 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f862c00fc30 con 0x55f20aa443e0 2024-09-19T06:20:49.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.244+0000 7f864de41740 10 client.17664 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:49.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.244+0000 7f864de41740 1 -- 172.21.15.3:0/146641275 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f20aa5d970 con 0x55f20aa443e0 2024-09-19T06:20:49.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.244+0000 7f8632000640 1 -- 172.21.15.3:0/146641275 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f863c004d20 con 0x55f20aa443e0 2024-09-19T06:20:49.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.244+0000 7f8632000640 1 -- 172.21.15.3:0/146641275 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f862c018070 con 0x55f20aa443e0 2024-09-19T06:20:49.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.244+0000 7f864de41740 10 client.17664 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:49.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.244+0000 7f864de41740 10 client.17664 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:49.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.244+0000 7f864de41740 20 client.17664 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:49.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.245+0000 7f864de41740 1 --2- 172.21.15.3:0/146641275 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f20aa5ee20 0x55f20aa61240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.245+0000 7f864de41740 4 client.17664 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:49.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.245+0000 7f864de41740 1 -- 172.21.15.3:0/146641275 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f20a9b7800 con 0x55f20aa5ee20 2024-09-19T06:20:49.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.245+0000 7f8649400640 1 --2- 172.21.15.3:0/146641275 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f20aa5ee20 0x55f20aa61240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.246+0000 7f8649400640 1 --2- 172.21.15.3:0/146641275 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f20aa5ee20 0x55f20aa61240 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f87cf511c5b113e server_cookie=84116e6198881fb2 in_seq=0 out_seq=0 2024-09-19T06:20:49.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.246+0000 7f8632000640 10 client.17664 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:49.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.246+0000 7f8632000640 1 -- 172.21.15.3:0/146641275 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f20a9b7800 con 0x55f20aa5ee20 2024-09-19T06:20:49.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.246+0000 7f8632000640 10 client.17664 handle_command_reply: tid=0 2024-09-19T06:20:49.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.246+0000 7f864de41740 1 client.17664 shutdown 2024-09-19T06:20:49.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.247+0000 7f864de41740 1 -- 172.21.15.3:0/146641275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f20aa443e0 msgr2=0x55f20aa4b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:49.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.247+0000 7f864de41740 1 --2- 172.21.15.3:0/146641275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f20aa443e0 0x55f20aa4b900 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f8644079220 tx=0x7f862c011db0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.247+0000 7f864de41740 1 -- 172.21.15.3:0/146641275 shutdown_connections 2024-09-19T06:20:49.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.247+0000 7f864de41740 1 --2- 172.21.15.3:0/146641275 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f20aa5ee20 0x55f20aa61240 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.247+0000 7f864de41740 1 --2- 172.21.15.3:0/146641275 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f20aa4eca0 0x55f20aa4bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.247+0000 7f864de41740 1 --2- 172.21.15.3:0/146641275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f20aa443e0 0x55f20aa4b900 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.247+0000 7f864de41740 1 --2- 172.21.15.3:0/146641275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa43ac0 0x55f20aa4e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.247+0000 7f864de41740 1 -- 172.21.15.3:0/146641275 >> 172.21.15.3:0/146641275 conn(0x55f20aa40050 msgr2=0x55f20aa45d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:49.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.247+0000 7f8632000640 0 client.17664 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:49.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.247+0000 7f864de41740 1 -- 172.21.15.3:0/146641275 shutdown_connections 2024-09-19T06:20:49.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.247+0000 7f864de41740 1 -- 172.21.15.3:0/146641275 wait complete. 2024-09-19T06:20:49.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.247+0000 7f864de41740 20 client.17664 trim_cache size 0 max 16384 2024-09-19T06:20:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.265+0000 7f864de41740 1 Processor -- start 2024-09-19T06:20:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.265+0000 7f864de41740 1 -- start start 2024-09-19T06:20:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.266+0000 7f864de41740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f20aa43ac0 0x55f20aa4a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.266+0000 7f864de41740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f20aa443e0 0x55f20aa66af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.266+0000 7f864de41740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa4eca0 0x55f20aa67030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.266+0000 7f864de41740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f86441b3fe0 con 0x55f20aa43ac0 2024-09-19T06:20:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.266+0000 7f864de41740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f86441b5b20 con 0x55f20aa4eca0 2024-09-19T06:20:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.266+0000 7f864de41740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f86441b46b0 con 0x55f20aa443e0 2024-09-19T06:20:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.266+0000 7f8649400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f20aa43ac0 0x55f20aa4a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.266+0000 7f8649400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f20aa43ac0 0x55f20aa4a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57430/0 (socket says 172.21.15.3:57430) 2024-09-19T06:20:49.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.266+0000 7f8649400640 1 -- 172.21.15.3:0/713511813 learned_addr learned my addr 172.21.15.3:0/713511813 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:49.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.266+0000 7f863be00640 1 --2- 172.21.15.3:0/713511813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f20aa443e0 0x55f20aa66af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.266+0000 7f8649400640 1 --2- 172.21.15.3:0/713511813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa4eca0 0x55f20aa67030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.267+0000 7f8649400640 1 -- 172.21.15.3:0/713511813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f20aa443e0 msgr2=0x55f20aa66af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.267+0000 7f8649400640 1 --2- 172.21.15.3:0/713511813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f20aa443e0 0x55f20aa66af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.267+0000 7f8649400640 1 -- 172.21.15.3:0/713511813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa4eca0 msgr2=0x55f20aa67030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:49.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.267+0000 7f8649400640 1 --2- 172.21.15.3:0/713511813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa4eca0 0x55f20aa67030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.267+0000 7f8649400640 1 -- 172.21.15.3:0/713511813 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f20aa43840 con 0x55f20aa43ac0 2024-09-19T06:20:49.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.267+0000 7f863be00640 1 --2- 172.21.15.3:0/713511813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f20aa443e0 0x55f20aa66af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:49.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.267+0000 7f8649400640 1 --2- 172.21.15.3:0/713511813 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f20aa43ac0 0x55f20aa4a860 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f863c0059d0 tx=0x7f863c009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3949cc635324e66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:49.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.267+0000 7f8639200640 1 -- 172.21.15.3:0/713511813 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c016040 con 0x55f20aa43ac0 2024-09-19T06:20:49.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.267+0000 7f8639200640 1 -- 172.21.15.3:0/713511813 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f863c0055b0 con 0x55f20aa43ac0 2024-09-19T06:20:49.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.267+0000 7f8639200640 1 -- 172.21.15.3:0/713511813 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c023040 con 0x55f20aa43ac0 2024-09-19T06:20:49.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.268+0000 7f864de41740 1 -- 172.21.15.3:0/713511813 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f20aa43ac0 msgr2=0x55f20aa4a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:49.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.268+0000 7f864de41740 1 --2- 172.21.15.3:0/713511813 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f20aa43ac0 0x55f20aa4a860 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f863c0059d0 tx=0x7f863c009600 comp rx=0 tx=0).stop 2024-09-19T06:20:49.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.268+0000 7f864de41740 1 -- 172.21.15.3:0/713511813 shutdown_connections 2024-09-19T06:20:49.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.268+0000 7f864de41740 1 --2- 172.21.15.3:0/713511813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa4eca0 0x55f20aa67030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.268+0000 7f864de41740 1 --2- 172.21.15.3:0/713511813 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f20aa443e0 0x55f20aa66af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.268+0000 7f864de41740 1 --2- 172.21.15.3:0/713511813 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f20aa43ac0 0x55f20aa4a860 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.268+0000 7f864de41740 1 -- 172.21.15.3:0/713511813 >> 172.21.15.3:0/713511813 conn(0x55f20aa40050 msgr2=0x55f20aa46f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:49.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.268+0000 7f864de41740 1 -- 172.21.15.3:0/713511813 shutdown_connections 2024-09-19T06:20:49.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.268+0000 7f864de41740 1 -- 172.21.15.3:0/713511813 wait complete. 2024-09-19T06:20:49.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.268+0000 7f864de41740 1 -- start start 2024-09-19T06:20:49.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.269+0000 7f864de41740 1 Processor -- start 2024-09-19T06:20:49.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.269+0000 7f864de41740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f20aa43ac0 0x55f20aa52c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.269+0000 7f864de41740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa443e0 0x55f20aa531d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.269+0000 7f864de41740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f20aa4eca0 0x55f20aa53710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.269+0000 7f864de41740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f86441b5450 con 0x55f20aa43ac0 2024-09-19T06:20:49.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.269+0000 7f864de41740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f86441b4d80 con 0x55f20aa443e0 2024-09-19T06:20:49.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.269+0000 7f864de41740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f86441b1fe0 con 0x55f20aa4eca0 2024-09-19T06:20:49.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.269+0000 7f864de41740 10 client.0 _ll_register_callbacks cb 0x7f862c009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:49.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.269+0000 7f863be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa443e0 0x55f20aa531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.269+0000 7f863be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa443e0 0x55f20aa531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40220/0 (socket says 172.21.15.3:40220) 2024-09-19T06:20:49.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.269+0000 7f863be00640 1 -- 172.21.15.3:0/3904544827 learned_addr learned my addr 172.21.15.3:0/3904544827 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:49.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.269+0000 7f8649400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f20aa43ac0 0x55f20aa52c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.270+0000 7f8649400640 1 --2- 172.21.15.3:0/3904544827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f20aa4eca0 0x55f20aa53710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.270+0000 7f863be00640 1 -- 172.21.15.3:0/3904544827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f20aa4eca0 msgr2=0x55f20aa53710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.270+0000 7f863be00640 1 --2- 172.21.15.3:0/3904544827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f20aa4eca0 0x55f20aa53710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.270+0000 7f863be00640 1 -- 172.21.15.3:0/3904544827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f20aa43ac0 msgr2=0x55f20aa52c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.270+0000 7f863be00640 1 --2- 172.21.15.3:0/3904544827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f20aa43ac0 0x55f20aa52c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.270+0000 7f863be00640 1 -- 172.21.15.3:0/3904544827 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f20aac8d10 con 0x55f20aa443e0 2024-09-19T06:20:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.270+0000 7f8649400640 1 --2- 172.21.15.3:0/3904544827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f20aa4eca0 0x55f20aa53710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.270+0000 7f863be00640 1 --2- 172.21.15.3:0/3904544827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa443e0 0x55f20aa531d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f862c014020 tx=0x7f862c01a4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32ae234dc268593 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.270+0000 7f8632000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:20:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.270+0000 7f8632000640 1 -- 172.21.15.3:0/3904544827 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f862c030060 con 0x55f20aa443e0 2024-09-19T06:20:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.270+0000 7f864de41740 1 -- 172.21.15.3:0/3904544827 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f863c0055b0 con 0x55f20aa443e0 2024-09-19T06:20:49.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.270+0000 7f8632000640 1 -- 172.21.15.3:0/3904544827 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f862c00f990 con 0x55f20aa443e0 2024-09-19T06:20:49.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.271+0000 7f8632000640 1 -- 172.21.15.3:0/3904544827 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f862c01a9a0 con 0x55f20aa443e0 2024-09-19T06:20:49.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.271+0000 7f864de41740 10 client.27704 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:49.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.271+0000 7f864de41740 1 -- 172.21.15.3:0/3904544827 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f20aaca010 con 0x55f20aa443e0 2024-09-19T06:20:49.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.271+0000 7f8632000640 1 -- 172.21.15.3:0/3904544827 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f863c0055b0 con 0x55f20aa443e0 2024-09-19T06:20:49.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.271+0000 7f8632000640 1 -- 172.21.15.3:0/3904544827 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f862c018070 con 0x55f20aa443e0 2024-09-19T06:20:49.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.271+0000 7f864de41740 10 client.27704 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:49.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.271+0000 7f864de41740 10 client.27704 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:49.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.271+0000 7f864de41740 20 client.27704 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:49.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.271+0000 7f864de41740 1 --2- 172.21.15.3:0/3904544827 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f20aaca790 0x55f20aaccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:49.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.271+0000 7f864de41740 4 client.27704 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:20:49.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.271+0000 7f864de41740 1 -- 172.21.15.3:0/3904544827 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f20a9b1d10 con 0x55f20aaca790 2024-09-19T06:20:49.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.271+0000 7f8649400640 1 --2- 172.21.15.3:0/3904544827 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f20aaca790 0x55f20aaccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:49.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.272+0000 7f8649400640 1 --2- 172.21.15.3:0/3904544827 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f20aaca790 0x55f20aaccbb0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6b8a0dc4bb32473 server_cookie=d6f005a5f44900f2 in_seq=0 out_seq=0 2024-09-19T06:20:49.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.272+0000 7f8632000640 10 client.27704 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:49.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.273+0000 7f8632000640 1 -- 172.21.15.3:0/3904544827 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f20a9b1d10 con 0x55f20aaca790 2024-09-19T06:20:49.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.273+0000 7f8632000640 10 client.27704 handle_command_reply: tid=0 2024-09-19T06:20:49.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.273+0000 7f864de41740 1 client.27704 shutdown 2024-09-19T06:20:49.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.273+0000 7f864de41740 1 -- 172.21.15.3:0/3904544827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa443e0 msgr2=0x55f20aa531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:49.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.273+0000 7f864de41740 1 --2- 172.21.15.3:0/3904544827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa443e0 0x55f20aa531d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f862c014020 tx=0x7f862c01a4a0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.273+0000 7f864de41740 1 -- 172.21.15.3:0/3904544827 shutdown_connections 2024-09-19T06:20:49.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.274+0000 7f864de41740 1 --2- 172.21.15.3:0/3904544827 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f20aaca790 0x55f20aaccbb0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.274+0000 7f864de41740 1 --2- 172.21.15.3:0/3904544827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f20aa4eca0 0x55f20aa53710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.274+0000 7f864de41740 1 --2- 172.21.15.3:0/3904544827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f20aa443e0 0x55f20aa531d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.274+0000 7f864de41740 1 --2- 172.21.15.3:0/3904544827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f20aa43ac0 0x55f20aa52c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.274+0000 7f8632000640 0 client.27704 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:49.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.274+0000 7f864de41740 1 -- 172.21.15.3:0/3904544827 >> 172.21.15.3:0/3904544827 conn(0x55f20aa40050 msgr2=0x55f20aa3e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:49.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.274+0000 7f864de41740 1 -- 172.21.15.3:0/3904544827 shutdown_connections 2024-09-19T06:20:49.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.274+0000 7f864de41740 1 -- 172.21.15.3:0/3904544827 wait complete. 2024-09-19T06:20:49.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.274+0000 7f864de41740 20 client.27704 trim_cache size 0 max 16384 2024-09-19T06:20:49.280 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:20:49.280 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": 0, 2024-09-19T06:20:49.280 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_tag": "997f2217-f42c-483e-bf9c-9f8ad9ec250a", 2024-09-19T06:20:49.280 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": "asynchronous" 2024-09-19T06:20:49.280 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:20:49.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.275+0000 7f864b400640 1 -- 172.21.15.3:0/1350570410 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f86280a3430 msgr2=0x7f86280a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:49.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.275+0000 7f864b400640 1 --2- 172.21.15.3:0/1350570410 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f86280a3430 0x7f86280a58f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f86340bc380 tx=0x7f86340f3e30 comp rx=0 tx=0).stop 2024-09-19T06:20:49.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.275+0000 7f864b400640 1 -- 172.21.15.3:0/1350570410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8644076720 msgr2=0x7f86441a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:49.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.275+0000 7f864b400640 1 --2- 172.21.15.3:0/1350570410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8644076720 0x7f86441a46a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8634004770 tx=0x7f8634003c10 comp rx=0 tx=0).stop 2024-09-19T06:20:49.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.275+0000 7f864b400640 1 -- 172.21.15.3:0/1350570410 shutdown_connections 2024-09-19T06:20:49.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.275+0000 7f864b400640 1 --2- 172.21.15.3:0/1350570410 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f86280a3430 0x7f86280a58f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.275+0000 7f864b400640 1 --2- 172.21.15.3:0/1350570410 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8644112a30 0x7f864419e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.275+0000 7f864b400640 1 --2- 172.21.15.3:0/1350570410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8644077040 0x7f86441a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.275+0000 7f864b400640 1 --2- 172.21.15.3:0/1350570410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8644076720 0x7f86441a46a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:49.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.275+0000 7f864b400640 1 -- 172.21.15.3:0/1350570410 >> 172.21.15.3:0/1350570410 conn(0x7f86440ffa90 msgr2=0x7f8644101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:49.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.275+0000 7f864b400640 1 -- 172.21.15.3:0/1350570410 shutdown_connections 2024-09-19T06:20:49.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:49.275+0000 7f864b400640 1 -- 172.21.15.3:0/1350570410 wait complete. 2024-09-19T06:20:50.040 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:20:50.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:50 smithi003 ceph-mon[30893]: pgmap v260: 97 pgs: 97 active+clean; 3.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-19T06:20:50.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:50 smithi003 ceph-mon[30893]: scrub queued for path: / 2024-09-19T06:20:50.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:50 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:50.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:50 smithi003 ceph-mon[30893]: scrub summary: active paths [/] 2024-09-19T06:20:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:50 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:50.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:50 smithi003 ceph-mon[30893]: scrub summary: idle 2024-09-19T06:20:50.419 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:50.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:50 smithi059 ceph-mon[35138]: pgmap v260: 97 pgs: 97 active+clean; 3.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-19T06:20:50.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:50 smithi059 ceph-mon[35138]: scrub queued for path: / 2024-09-19T06:20:50.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:50 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:50.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:50 smithi059 ceph-mon[35138]: scrub summary: active paths [/] 2024-09-19T06:20:50.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:50 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:50.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:50 smithi059 ceph-mon[35138]: scrub summary: idle 2024-09-19T06:20:50.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:50 smithi071 ceph-mon[35662]: pgmap v260: 97 pgs: 97 active+clean; 3.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-19T06:20:50.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:50 smithi071 ceph-mon[35662]: scrub queued for path: / 2024-09-19T06:20:50.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:50 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:50.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:50 smithi071 ceph-mon[35662]: scrub summary: active paths [/] 2024-09-19T06:20:50.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:50 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:20:50.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:50 smithi071 ceph-mon[35662]: scrub summary: idle 2024-09-19T06:20:51.022 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.020+0000 7f9c96000640 1 -- 172.21.15.3:0/700387278 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c90112870 msgr2=0x7f9c90114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:51.022 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.020+0000 7f9c96000640 1 --2- 172.21.15.3:0/700387278 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c90112870 0x7f9c90114c60 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009ca0 tx=0x7f9c8802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.020+0000 7f9c96000640 1 -- 172.21.15.3:0/700387278 shutdown_connections 2024-09-19T06:20:51.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.020+0000 7f9c96000640 1 --2- 172.21.15.3:0/700387278 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c90112870 0x7f9c90114c60 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.020+0000 7f9c96000640 1 --2- 172.21.15.3:0/700387278 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c90077040 0x7f9c90112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.020+0000 7f9c96000640 1 --2- 172.21.15.3:0/700387278 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c90076720 0x7f9c90076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.020+0000 7f9c96000640 1 -- 172.21.15.3:0/700387278 >> 172.21.15.3:0/700387278 conn(0x7f9c900ff8d0 msgr2=0x7f9c90101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:51.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.020+0000 7f9c96000640 1 -- 172.21.15.3:0/700387278 shutdown_connections 2024-09-19T06:20:51.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.020+0000 7f9c96000640 1 -- 172.21.15.3:0/700387278 wait complete. 2024-09-19T06:20:51.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.022+0000 7f9c96000640 1 Processor -- start 2024-09-19T06:20:51.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.022+0000 7f9c96000640 1 -- start start 2024-09-19T06:20:51.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.022+0000 7f9c96000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c90076720 0x7f9c901a45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:51.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.022+0000 7f9c96000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c90077040 0x7f9c901a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:51.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.022+0000 7f9c96000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c90112870 0x7f9c9019e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:51.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.022+0000 7f9c96000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9c90118400 con 0x7f9c90112870 2024-09-19T06:20:51.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.022+0000 7f9c96000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9c90118280 con 0x7f9c90076720 2024-09-19T06:20:51.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.022+0000 7f9c96000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9c90118580 con 0x7f9c90077040 2024-09-19T06:20:51.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.023+0000 7f9c94c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c90076720 0x7f9c901a45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:51.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.023+0000 7f9c94c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c90076720 0x7f9c901a45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40232/0 (socket says 172.21.15.3:40232) 2024-09-19T06:20:51.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.023+0000 7f9c94c00640 1 -- 172.21.15.3:0/2836526064 learned_addr learned my addr 172.21.15.3:0/2836526064 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:51.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.023+0000 7f9c95600640 1 --2- 172.21.15.3:0/2836526064 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c90112870 0x7f9c9019e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:51.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.023+0000 7f9c8fe00640 1 --2- 172.21.15.3:0/2836526064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c90077040 0x7f9c901a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:51.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.023+0000 7f9c94c00640 1 -- 172.21.15.3:0/2836526064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c90077040 msgr2=0x7f9c901a4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:51.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.023+0000 7f9c94c00640 1 --2- 172.21.15.3:0/2836526064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c90077040 0x7f9c901a4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.023+0000 7f9c94c00640 1 -- 172.21.15.3:0/2836526064 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c90112870 msgr2=0x7f9c9019e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:51.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.023+0000 7f9c94c00640 1 --2- 172.21.15.3:0/2836526064 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c90112870 0x7f9c9019e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.023+0000 7f9c94c00640 1 -- 172.21.15.3:0/2836526064 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c9019ef20 con 0x7f9c90076720 2024-09-19T06:20:51.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.023+0000 7f9c94c00640 1 --2- 172.21.15.3:0/2836526064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c90076720 0x7f9c901a45e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400d950 tx=0x7f9c8400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:51.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.024+0000 7f9c8d600640 1 -- 172.21.15.3:0/2836526064 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c84017030 con 0x7f9c90076720 2024-09-19T06:20:51.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.024+0000 7f9c96000640 1 -- 172.21.15.3:0/2836526064 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c9019f210 con 0x7f9c90076720 2024-09-19T06:20:51.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.024+0000 7f9c8d600640 1 -- 172.21.15.3:0/2836526064 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c84004020 con 0x7f9c90076720 2024-09-19T06:20:51.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.024+0000 7f9c8d600640 1 -- 172.21.15.3:0/2836526064 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c840047a0 con 0x7f9c90076720 2024-09-19T06:20:51.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.024+0000 7f9c96000640 1 -- 172.21.15.3:0/2836526064 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c901ab560 con 0x7f9c90076720 2024-09-19T06:20:51.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.027+0000 7f9c9a228740 1 Processor -- start 2024-09-19T06:20:51.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.027+0000 7f9c9a228740 1 -- start start 2024-09-19T06:20:51.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.027+0000 7f9c9a228740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c002d17d50 0x55c002d18130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:51.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.027+0000 7f9c9a228740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 0x55c002d229f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:51.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.027+0000 7f9c9a228740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c002d22f30 0x55c002d25320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:51.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.027+0000 7f9c9a228740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55c002c7e3e0 con 0x55c002d18670 2024-09-19T06:20:51.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.027+0000 7f9c9a228740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c002c25d80 con 0x55c002d22f30 2024-09-19T06:20:51.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.027+0000 7f9c9a228740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c002c7a3a0 con 0x55c002d17d50 2024-09-19T06:20:51.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.029+0000 7f9c95600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c002d17d50 0x55c002d18130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:51.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.029+0000 7f9c95600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c002d17d50 0x55c002d18130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:51674/0 (socket says 172.21.15.3:51674) 2024-09-19T06:20:51.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.029+0000 7f9c95600640 1 -- 172.21.15.3:0/3030816583 learned_addr learned my addr 172.21.15.3:0/3030816583 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:51.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.029+0000 7f9c8fe00640 1 --2- 172.21.15.3:0/3030816583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c002d22f30 0x55c002d25320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:51.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.029+0000 7f9c8d600640 1 -- 172.21.15.3:0/2836526064 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f9c840041d0 con 0x7f9c90076720 2024-09-19T06:20:51.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.029+0000 7f9c95600640 1 -- 172.21.15.3:0/3030816583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c002d22f30 msgr2=0x55c002d25320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:51.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.029+0000 7f9c95600640 1 --2- 172.21.15.3:0/3030816583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c002d22f30 0x55c002d25320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.029+0000 7f9c95600640 1 -- 172.21.15.3:0/3030816583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 msgr2=0x55c002d229f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:51.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.029+0000 7f9c94c00640 1 --2- 172.21.15.3:0/3030816583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 0x55c002d229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:51.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.029+0000 7f9c95600640 1 --2- 172.21.15.3:0/3030816583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 0x55c002d229f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.029+0000 7f9c95600640 1 -- 172.21.15.3:0/3030816583 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c002c44ae0 con 0x55c002d17d50 2024-09-19T06:20:51.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.029+0000 7f9c94c00640 1 --2- 172.21.15.3:0/3030816583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 0x55c002d229f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:20:51.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.029+0000 7f9c95600640 1 --2- 172.21.15.3:0/3030816583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c002d17d50 0x55c002d18130 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9c88004af0 tx=0x7f9c8802f3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccfeacc5940a645a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:51.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.029+0000 7f9c81c00640 1 -- 172.21.15.3:0/3030816583 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c88003970 con 0x55c002d17d50 2024-09-19T06:20:51.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.029+0000 7f9c81c00640 1 -- 172.21.15.3:0/3030816583 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c88036030 con 0x55c002d17d50 2024-09-19T06:20:51.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.029+0000 7f9c81c00640 1 -- 172.21.15.3:0/3030816583 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c880043c0 con 0x55c002d17d50 2024-09-19T06:20:51.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.029+0000 7f9c8d600640 1 --2- 172.21.15.3:0/2836526064 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9c780a3430 0x7f9c780a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:51.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.029+0000 7f9c9a228740 1 -- 172.21.15.3:0/3030816583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c002d17d50 msgr2=0x55c002d18130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:51.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.029+0000 7f9c9a228740 1 --2- 172.21.15.3:0/3030816583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c002d17d50 0x55c002d18130 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9c88004af0 tx=0x7f9c8802f3c0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.030+0000 7f9c9a228740 1 -- 172.21.15.3:0/3030816583 shutdown_connections 2024-09-19T06:20:51.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.030+0000 7f9c9a228740 1 --2- 172.21.15.3:0/3030816583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c002d22f30 0x55c002d25320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.030+0000 7f9c8d600640 1 -- 172.21.15.3:0/2836526064 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f9c840cf6b0 con 0x7f9c90076720 2024-09-19T06:20:51.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.030+0000 7f9c9a228740 1 --2- 172.21.15.3:0/3030816583 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 0x55c002d229f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.030+0000 7f9c9a228740 1 --2- 172.21.15.3:0/3030816583 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c002d17d50 0x55c002d18130 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.030+0000 7f9c9a228740 1 -- 172.21.15.3:0/3030816583 >> 172.21.15.3:0/3030816583 conn(0x55c002d142e0 msgr2=0x55c002d146c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:51.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.030+0000 7f9c94c00640 1 --2- 172.21.15.3:0/2836526064 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9c780a3430 0x7f9c780a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:51.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.030+0000 7f9c9a228740 1 -- 172.21.15.3:0/3030816583 shutdown_connections 2024-09-19T06:20:51.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.030+0000 7f9c9a228740 1 -- 172.21.15.3:0/3030816583 wait complete. 2024-09-19T06:20:51.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.031+0000 7f9c94c00640 1 --2- 172.21.15.3:0/2836526064 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9c780a3430 0x7f9c780a58f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55c002d15140 tx=0x7f9c84000bc0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:51.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.031+0000 7f9c9a228740 1 -- start start 2024-09-19T06:20:51.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.031+0000 7f9c9a228740 1 Processor -- start 2024-09-19T06:20:51.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.031+0000 7f9c9a228740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c002d17d50 0x55c002d1fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:51.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.031+0000 7f9c9a228740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 0x55c002d20330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:51.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.031+0000 7f9c9a228740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c002d22f30 0x55c002d20870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:51.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.031+0000 7f9c9a228740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55c002d25a20 con 0x55c002d18670 2024-09-19T06:20:51.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.031+0000 7f9c9a228740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c002c390f0 con 0x55c002d17d50 2024-09-19T06:20:51.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.031+0000 7f9c9a228740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c002d25ba0 con 0x55c002d22f30 2024-09-19T06:20:51.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.031+0000 7f9c9a228740 10 client.0 _ll_register_callbacks cb 0x55c002c2a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:51.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.032+0000 7f9c95600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c002d17d50 0x55c002d1fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:51.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.032+0000 7f9c95600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c002d17d50 0x55c002d1fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40238/0 (socket says 172.21.15.3:40238) 2024-09-19T06:20:51.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.032+0000 7f9c95600640 1 -- 172.21.15.3:0/811072014 learned_addr learned my addr 172.21.15.3:0/811072014 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:51.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.032+0000 7f9c8fe00640 1 --2- 172.21.15.3:0/811072014 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 0x55c002d20330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:51.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.032+0000 7f9c95600640 1 --2- 172.21.15.3:0/811072014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c002d22f30 0x55c002d20870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:51.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.032+0000 7f9c8fe00640 1 -- 172.21.15.3:0/811072014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c002d22f30 msgr2=0x55c002d20870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:51.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.032+0000 7f9c8fe00640 1 --2- 172.21.15.3:0/811072014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c002d22f30 0x55c002d20870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.032+0000 7f9c8fe00640 1 -- 172.21.15.3:0/811072014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c002d17d50 msgr2=0x55c002d1fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:51.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.032+0000 7f9c8fe00640 1 --2- 172.21.15.3:0/811072014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c002d17d50 0x55c002d1fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.032+0000 7f9c8fe00640 1 -- 172.21.15.3:0/811072014 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0029ef3c0 con 0x55c002d18670 2024-09-19T06:20:51.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.032+0000 7f9c8fe00640 1 --2- 172.21.15.3:0/811072014 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 0x55c002d20330 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00b9c0 tx=0x7f9c7c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33195f78c1313bb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:51.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.032+0000 7f9c76000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:20:51.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.033+0000 7f9c76000640 1 -- 172.21.15.3:0/811072014 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c003e20 con 0x55c002d18670 2024-09-19T06:20:51.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.033+0000 7f9c76000640 1 -- 172.21.15.3:0/811072014 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f9c7c005020 con 0x55c002d18670 2024-09-19T06:20:51.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.033+0000 7f9c9a228740 1 -- 172.21.15.3:0/811072014 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c88036030 con 0x55c002d18670 2024-09-19T06:20:51.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.033+0000 7f9c76000640 1 -- 172.21.15.3:0/811072014 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9c7c005220 con 0x55c002d18670 2024-09-19T06:20:51.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.033+0000 7f9c9a228740 10 client.17679 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:51.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.033+0000 7f9c9a228740 1 -- 172.21.15.3:0/811072014 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c002d316a0 con 0x55c002d18670 2024-09-19T06:20:51.041 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.033+0000 7f9c76000640 1 -- 172.21.15.3:0/811072014 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c88036030 con 0x55c002d18670 2024-09-19T06:20:51.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.035+0000 7f9c76000640 1 -- 172.21.15.3:0/811072014 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9c7c022070 con 0x55c002d18670 2024-09-19T06:20:51.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.035+0000 7f9c9a228740 10 client.17679 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:51.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.035+0000 7f9c9a228740 10 client.17679 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:51.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.035+0000 7f9c9a228740 20 client.17679 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:51.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.035+0000 7f9c9a228740 1 --2- 172.21.15.3:0/811072014 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55c002d32b60 0x55c002d34f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:51.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.035+0000 7f9c9a228740 4 client.17679 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:51.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.035+0000 7f9c9a228740 1 -- 172.21.15.3:0/811072014 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c002c8b950 con 0x55c002d32b60 2024-09-19T06:20:51.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.035+0000 7f9c95600640 1 --2- 172.21.15.3:0/811072014 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55c002d32b60 0x55c002d34f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:51.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.036+0000 7f9c95600640 1 --2- 172.21.15.3:0/811072014 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55c002d32b60 0x55c002d34f50 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c55319228ff5f19 server_cookie=4e9239b389ce27e in_seq=0 out_seq=0 2024-09-19T06:20:51.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.036+0000 7f9c76000640 10 client.17679 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:51.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.036+0000 7f9c76000640 1 -- 172.21.15.3:0/811072014 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c002c8b950 con 0x55c002d32b60 2024-09-19T06:20:51.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.036+0000 7f9c76000640 10 client.17679 handle_command_reply: tid=0 2024-09-19T06:20:51.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.036+0000 7f9c9a228740 1 client.17679 shutdown 2024-09-19T06:20:51.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.037+0000 7f9c9a228740 1 -- 172.21.15.3:0/811072014 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 msgr2=0x55c002d20330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:51.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.037+0000 7f9c9a228740 1 --2- 172.21.15.3:0/811072014 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 0x55c002d20330 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00b9c0 tx=0x7f9c7c00be80 comp rx=0 tx=0).stop 2024-09-19T06:20:51.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.037+0000 7f9c9a228740 1 -- 172.21.15.3:0/811072014 shutdown_connections 2024-09-19T06:20:51.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.037+0000 7f9c9a228740 1 --2- 172.21.15.3:0/811072014 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55c002d32b60 0x55c002d34f50 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.037+0000 7f9c9a228740 1 --2- 172.21.15.3:0/811072014 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c002d22f30 0x55c002d20870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.037+0000 7f9c9a228740 1 --2- 172.21.15.3:0/811072014 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 0x55c002d20330 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.037+0000 7f9c9a228740 1 --2- 172.21.15.3:0/811072014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c002d17d50 0x55c002d1fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.037+0000 7f9c76000640 0 client.17679 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:51.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.037+0000 7f9c9a228740 1 -- 172.21.15.3:0/811072014 >> 172.21.15.3:0/811072014 conn(0x55c002d142e0 msgr2=0x55c002d1a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:51.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.037+0000 7f9c9a228740 1 -- 172.21.15.3:0/811072014 shutdown_connections 2024-09-19T06:20:51.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.037+0000 7f9c9a228740 1 -- 172.21.15.3:0/811072014 wait complete. 2024-09-19T06:20:51.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.037+0000 7f9c9a228740 20 client.17679 trim_cache size 0 max 16384 2024-09-19T06:20:51.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.055+0000 7f9c9a228740 1 Processor -- start 2024-09-19T06:20:51.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.055+0000 7f9c9a228740 1 -- start start 2024-09-19T06:20:51.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.055+0000 7f9c9a228740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c002d17d50 0x55c002d1a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:51.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.055+0000 7f9c9a228740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 0x55c002d13270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:51.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.055+0000 7f9c9a228740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c002d22f30 0x55c002d3a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:51.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.055+0000 7f9c9a228740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9c901b3dc0 con 0x55c002d18670 2024-09-19T06:20:51.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.055+0000 7f9c9a228740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9c901b5900 con 0x55c002d22f30 2024-09-19T06:20:51.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.055+0000 7f9c9a228740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9c901b4490 con 0x55c002d17d50 2024-09-19T06:20:51.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.055+0000 7f9c8fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 0x55c002d13270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:51.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.055+0000 7f9c8fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 0x55c002d13270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57494/0 (socket says 172.21.15.3:57494) 2024-09-19T06:20:51.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.055+0000 7f9c8fe00640 1 -- 172.21.15.3:0/1372189042 learned_addr learned my addr 172.21.15.3:0/1372189042 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:51.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.055+0000 7f9c95600640 1 --2- 172.21.15.3:0/1372189042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c002d17d50 0x55c002d1a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:51.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.055+0000 7f9c95600640 1 --2- 172.21.15.3:0/1372189042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c002d22f30 0x55c002d3a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:51.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.055+0000 7f9c8fe00640 1 -- 172.21.15.3:0/1372189042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c002d17d50 msgr2=0x55c002d1a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:51.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.055+0000 7f9c8fe00640 1 --2- 172.21.15.3:0/1372189042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c002d17d50 0x55c002d1a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.055+0000 7f9c8fe00640 1 -- 172.21.15.3:0/1372189042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c002d22f30 msgr2=0x55c002d3a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:51.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.055+0000 7f9c8fe00640 1 --2- 172.21.15.3:0/1372189042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c002d22f30 0x55c002d3a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.055+0000 7f9c8fe00640 1 -- 172.21.15.3:0/1372189042 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c002d15390 con 0x55c002d18670 2024-09-19T06:20:51.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.055+0000 7f9c8fe00640 1 --2- 172.21.15.3:0/1372189042 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 0x55c002d13270 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c001eb0 tx=0x7f9c7c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a72cc4b53b9c33fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:51.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.055+0000 7f9c81200640 1 -- 172.21.15.3:0/1372189042 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c000e60 con 0x55c002d18670 2024-09-19T06:20:51.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.056+0000 7f9c81200640 1 -- 172.21.15.3:0/1372189042 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c7c003e20 con 0x55c002d18670 2024-09-19T06:20:51.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.056+0000 7f9c81200640 1 -- 172.21.15.3:0/1372189042 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c028040 con 0x55c002d18670 2024-09-19T06:20:51.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.056+0000 7f9c9a228740 1 -- 172.21.15.3:0/1372189042 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 msgr2=0x55c002d13270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:51.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.056+0000 7f9c9a228740 1 --2- 172.21.15.3:0/1372189042 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 0x55c002d13270 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c001eb0 tx=0x7f9c7c004530 comp rx=0 tx=0).stop 2024-09-19T06:20:51.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.056+0000 7f9c9a228740 1 -- 172.21.15.3:0/1372189042 shutdown_connections 2024-09-19T06:20:51.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.056+0000 7f9c9a228740 1 --2- 172.21.15.3:0/1372189042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c002d22f30 0x55c002d3a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.056+0000 7f9c9a228740 1 --2- 172.21.15.3:0/1372189042 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 0x55c002d13270 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.056+0000 7f9c9a228740 1 --2- 172.21.15.3:0/1372189042 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c002d17d50 0x55c002d1a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.056+0000 7f9c9a228740 1 -- 172.21.15.3:0/1372189042 >> 172.21.15.3:0/1372189042 conn(0x55c002d142e0 msgr2=0x55c002d12b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:51.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.056+0000 7f9c9a228740 1 -- 172.21.15.3:0/1372189042 shutdown_connections 2024-09-19T06:20:51.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.056+0000 7f9c9a228740 1 -- 172.21.15.3:0/1372189042 wait complete. 2024-09-19T06:20:51.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.058+0000 7f9c9a228740 1 -- start start 2024-09-19T06:20:51.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.058+0000 7f9c9a228740 1 Processor -- start 2024-09-19T06:20:51.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.059+0000 7f9c9a228740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c002d17d50 0x55c002d2b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:51.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.059+0000 7f9c9a228740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 0x55c002d23fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:51.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.059+0000 7f9c9a228740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c002d22f30 0x55c002d24730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:51.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.059+0000 7f9c9a228740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9c901b5230 con 0x55c002d18670 2024-09-19T06:20:51.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.059+0000 7f9c9a228740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9c901b4b60 con 0x55c002d17d50 2024-09-19T06:20:51.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.059+0000 7f9c9a228740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9c901b1dc0 con 0x55c002d22f30 2024-09-19T06:20:51.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.059+0000 7f9c9a228740 10 client.0 _ll_register_callbacks cb 0x7f9c7c004420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:51.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.059+0000 7f9c8fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 0x55c002d23fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:51.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.059+0000 7f9c95600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c002d17d50 0x55c002d2b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:51.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.059+0000 7f9c95600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c002d17d50 0x55c002d2b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40250/0 (socket says 172.21.15.3:40250) 2024-09-19T06:20:51.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.059+0000 7f9c95600640 1 -- 172.21.15.3:0/2831856424 learned_addr learned my addr 172.21.15.3:0/2831856424 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:51.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.059+0000 7f9c8fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 0x55c002d23fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57502/0 (socket says 172.21.15.3:57502) 2024-09-19T06:20:51.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.059+0000 7f9c95600640 1 --2- 172.21.15.3:0/2831856424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c002d22f30 0x55c002d24730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:51.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.059+0000 7f9c95600640 1 -- 172.21.15.3:0/2831856424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c002d22f30 msgr2=0x55c002d24730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:51.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.059+0000 7f9c95600640 1 --2- 172.21.15.3:0/2831856424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c002d22f30 0x55c002d24730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.059+0000 7f9c95600640 1 -- 172.21.15.3:0/2831856424 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 msgr2=0x55c002d23fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:51.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.059+0000 7f9c95600640 1 --2- 172.21.15.3:0/2831856424 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 0x55c002d23fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.059+0000 7f9c95600640 1 -- 172.21.15.3:0/2831856424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c002d29220 con 0x55c002d17d50 2024-09-19T06:20:51.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.060+0000 7f9c95600640 1 --2- 172.21.15.3:0/2831856424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c002d17d50 0x55c002d2b700 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009ca0 tx=0x7f9c88031ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a33e2a31ff927d17 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:51.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.060+0000 7f9c76000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:20:51.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.060+0000 7f9c76000640 1 -- 172.21.15.3:0/2831856424 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c88031830 con 0x55c002d17d50 2024-09-19T06:20:51.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.060+0000 7f9c9a228740 1 -- 172.21.15.3:0/2831856424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c7c003e20 con 0x55c002d17d50 2024-09-19T06:20:51.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.060+0000 7f9c76000640 1 -- 172.21.15.3:0/2831856424 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f9c8804a030 con 0x55c002d17d50 2024-09-19T06:20:51.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.060+0000 7f9c76000640 1 -- 172.21.15.3:0/2831856424 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9c88003970 con 0x55c002d17d50 2024-09-19T06:20:51.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.060+0000 7f9c9a228740 10 client.27722 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:51.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.060+0000 7f9c9a228740 1 -- 172.21.15.3:0/2831856424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c002d9da40 con 0x55c002d17d50 2024-09-19T06:20:51.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.060+0000 7f9c76000640 1 -- 172.21.15.3:0/2831856424 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c7c003e20 con 0x55c002d17d50 2024-09-19T06:20:51.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.061+0000 7f9c76000640 1 -- 172.21.15.3:0/2831856424 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9c88043070 con 0x55c002d17d50 2024-09-19T06:20:51.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.061+0000 7f9c9a228740 10 client.27722 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:51.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.061+0000 7f9c9a228740 10 client.27722 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:51.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.061+0000 7f9c9a228740 20 client.27722 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:51.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.061+0000 7f9c9a228740 1 --2- 172.21.15.3:0/2831856424 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55c002d9de40 0x55c002da0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:51.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.061+0000 7f9c9a228740 4 client.27722 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:20:51.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.061+0000 7f9c9a228740 1 -- 172.21.15.3:0/2831856424 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c002c85e60 con 0x55c002d9de40 2024-09-19T06:20:51.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.061+0000 7f9c8fe00640 1 --2- 172.21.15.3:0/2831856424 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55c002d9de40 0x55c002da0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:51.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.062+0000 7f9c8fe00640 1 --2- 172.21.15.3:0/2831856424 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55c002d9de40 0x55c002da0230 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=376ff965d2fe05a6 server_cookie=d56a0f6ff69231c6 in_seq=0 out_seq=0 2024-09-19T06:20:51.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.062+0000 7f9c76000640 10 client.27722 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:51.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.062+0000 7f9c76000640 1 -- 172.21.15.3:0/2831856424 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55c002c85e60 con 0x55c002d9de40 2024-09-19T06:20:51.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.062+0000 7f9c76000640 10 client.27722 handle_command_reply: tid=0 2024-09-19T06:20:51.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.062+0000 7f9c9a228740 1 client.27722 shutdown 2024-09-19T06:20:51.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.062+0000 7f9c9a228740 1 -- 172.21.15.3:0/2831856424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c002d17d50 msgr2=0x55c002d2b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:51.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.062+0000 7f9c9a228740 1 --2- 172.21.15.3:0/2831856424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c002d17d50 0x55c002d2b700 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009ca0 tx=0x7f9c88031ad0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.062+0000 7f9c9a228740 1 -- 172.21.15.3:0/2831856424 shutdown_connections 2024-09-19T06:20:51.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.062+0000 7f9c9a228740 1 --2- 172.21.15.3:0/2831856424 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55c002d9de40 0x55c002da0230 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.062+0000 7f9c9a228740 1 --2- 172.21.15.3:0/2831856424 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c002d22f30 0x55c002d24730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.062+0000 7f9c76000640 0 client.27722 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:51.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.062+0000 7f9c9a228740 1 --2- 172.21.15.3:0/2831856424 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c002d18670 0x55c002d23fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.062+0000 7f9c9a228740 1 --2- 172.21.15.3:0/2831856424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c002d17d50 0x55c002d2b700 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.062+0000 7f9c9a228740 1 -- 172.21.15.3:0/2831856424 >> 172.21.15.3:0/2831856424 conn(0x55c002d142e0 msgr2=0x55c002d1e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:51.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.062+0000 7f9c9a228740 1 -- 172.21.15.3:0/2831856424 shutdown_connections 2024-09-19T06:20:51.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.062+0000 7f9c9a228740 1 -- 172.21.15.3:0/2831856424 wait complete. 2024-09-19T06:20:51.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.062+0000 7f9c9a228740 20 client.27722 trim_cache size 0 max 16384 2024-09-19T06:20:51.068 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:20:51.068 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "no active scrubs running", 2024-09-19T06:20:51.068 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": {} 2024-09-19T06:20:51.068 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:20:51.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.063+0000 7f9c96000640 1 -- 172.21.15.3:0/2836526064 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9c780a3430 msgr2=0x7f9c780a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:51.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.063+0000 7f9c96000640 1 --2- 172.21.15.3:0/2836526064 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9c780a3430 0x7f9c780a58f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55c002d15140 tx=0x7f9c84000bc0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.063+0000 7f9c96000640 1 -- 172.21.15.3:0/2836526064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c90076720 msgr2=0x7f9c901a45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:51.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.063+0000 7f9c96000640 1 --2- 172.21.15.3:0/2836526064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c90076720 0x7f9c901a45e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400d950 tx=0x7f9c8400de10 comp rx=0 tx=0).stop 2024-09-19T06:20:51.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.063+0000 7f9c96000640 1 -- 172.21.15.3:0/2836526064 shutdown_connections 2024-09-19T06:20:51.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.063+0000 7f9c96000640 1 --2- 172.21.15.3:0/2836526064 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9c780a3430 0x7f9c780a58f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.063+0000 7f9c96000640 1 --2- 172.21.15.3:0/2836526064 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c90112870 0x7f9c9019e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.063+0000 7f9c96000640 1 --2- 172.21.15.3:0/2836526064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c90077040 0x7f9c901a4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.063+0000 7f9c96000640 1 --2- 172.21.15.3:0/2836526064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c90076720 0x7f9c901a45e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:51.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.063+0000 7f9c96000640 1 -- 172.21.15.3:0/2836526064 >> 172.21.15.3:0/2836526064 conn(0x7f9c900ff8d0 msgr2=0x7f9c90101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:51.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.063+0000 7f9c96000640 1 -- 172.21.15.3:0/2836526064 shutdown_connections 2024-09-19T06:20:51.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:51.063+0000 7f9c96000640 1 -- 172.21.15.3:0/2836526064 wait complete. 2024-09-19T06:20:51.849 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:20:51.850 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:20:52.228 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:52.368 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:52 smithi003 ceph-mon[30893]: pgmap v261: 97 pgs: 97 active+clean; 3.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:20:52.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:52 smithi059 ceph-mon[35138]: pgmap v261: 97 pgs: 97 active+clean; 3.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:20:52.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:52 smithi071 ceph-mon[35662]: pgmap v261: 97 pgs: 97 active+clean; 3.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:20:52.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.842+0000 7f346ac00640 1 -- 172.21.15.3:0/521139871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3464074f40 msgr2=0x7f346410de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:52.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.842+0000 7f346ac00640 1 --2- 172.21.15.3:0/521139871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3464074f40 0x7f346410de80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3450009900 tx=0x7f345002a480 comp rx=0 tx=0).stop 2024-09-19T06:20:52.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.842+0000 7f346ac00640 1 -- 172.21.15.3:0/521139871 shutdown_connections 2024-09-19T06:20:52.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.842+0000 7f346ac00640 1 --2- 172.21.15.3:0/521139871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f346410e3c0 0x7f3464110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.842+0000 7f346ac00640 1 --2- 172.21.15.3:0/521139871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3464074f40 0x7f346410de80 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.842+0000 7f346ac00640 1 --2- 172.21.15.3:0/521139871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3464074620 0x7f3464074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.842+0000 7f346ac00640 1 -- 172.21.15.3:0/521139871 >> 172.21.15.3:0/521139871 conn(0x7f34640fd8c0 msgr2=0x7f34640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:52.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.842+0000 7f346ac00640 1 -- 172.21.15.3:0/521139871 shutdown_connections 2024-09-19T06:20:52.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.842+0000 7f346ac00640 1 -- 172.21.15.3:0/521139871 wait complete. 2024-09-19T06:20:52.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.843+0000 7f346ac00640 1 Processor -- start 2024-09-19T06:20:52.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.843+0000 7f346ac00640 1 -- start start 2024-09-19T06:20:52.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.844+0000 7f346ac00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3464074620 0x7f346419a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:52.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.844+0000 7f346ac00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3464074f40 0x7f346419aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:52.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.844+0000 7f346ac00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f346410e3c0 0x7f346419df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:52.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.844+0000 7f346ac00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3464114160 con 0x7f3464074620 2024-09-19T06:20:52.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.844+0000 7f346ac00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3464113fe0 con 0x7f346410e3c0 2024-09-19T06:20:52.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.844+0000 7f346ac00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f34641142e0 con 0x7f3464074f40 2024-09-19T06:20:52.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.844+0000 7f3463e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3464074620 0x7f346419a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:52.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.844+0000 7f3463e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3464074620 0x7f346419a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57506/0 (socket says 172.21.15.3:57506) 2024-09-19T06:20:52.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.844+0000 7f3463e00640 1 -- 172.21.15.3:0/1340936922 learned_addr learned my addr 172.21.15.3:0/1340936922 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:52.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.844+0000 7f3468c00640 1 --2- 172.21.15.3:0/1340936922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f346410e3c0 0x7f346419df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:52.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.844+0000 7f3463400640 1 --2- 172.21.15.3:0/1340936922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3464074f40 0x7f346419aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:52.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.845+0000 7f3463e00640 1 -- 172.21.15.3:0/1340936922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3464074f40 msgr2=0x7f346419aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:52.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.845+0000 7f3463e00640 1 --2- 172.21.15.3:0/1340936922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3464074f40 0x7f346419aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.845+0000 7f3463e00640 1 -- 172.21.15.3:0/1340936922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f346410e3c0 msgr2=0x7f346419df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:52.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.845+0000 7f3463e00640 1 --2- 172.21.15.3:0/1340936922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f346410e3c0 0x7f346419df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:52.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.845+0000 7f3463e00640 1 -- 172.21.15.3:0/1340936922 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f346419e6b0 con 0x7f3464074620 2024-09-19T06:20:52.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.845+0000 7f3468c00640 1 --2- 172.21.15.3:0/1340936922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f346410e3c0 0x7f346419df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:52.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.845+0000 7f3463e00640 1 --2- 172.21.15.3:0/1340936922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3464074620 0x7f346419a760 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f345400e9f0 tx=0x7f345400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:52.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.845+0000 7f3460c00640 1 -- 172.21.15.3:0/1340936922 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345400cd80 con 0x7f3464074620 2024-09-19T06:20:52.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.845+0000 7f3460c00640 1 -- 172.21.15.3:0/1340936922 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3454010910 con 0x7f3464074620 2024-09-19T06:20:52.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.845+0000 7f346ac00640 1 -- 172.21.15.3:0/1340936922 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f346419e9a0 con 0x7f3464074620 2024-09-19T06:20:52.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.845+0000 7f3460c00640 1 -- 172.21.15.3:0/1340936922 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3454018990 con 0x7f3464074620 2024-09-19T06:20:52.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.845+0000 7f346ac00640 1 -- 172.21.15.3:0/1340936922 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34641a7310 con 0x7f3464074620 2024-09-19T06:20:52.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.847+0000 7f346ac00640 1 -- 172.21.15.3:0/1340936922 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3464074a00 con 0x7f3464074620 2024-09-19T06:20:52.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.848+0000 7f3460c00640 1 -- 172.21.15.3:0/1340936922 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f3454010ac0 con 0x7f3464074620 2024-09-19T06:20:52.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.850+0000 7f3460c00640 1 --2- 172.21.15.3:0/1340936922 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f34480a3430 0x7f34480a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:52.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.850+0000 7f3460c00640 1 -- 172.21.15.3:0/1340936922 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f34540cffe0 con 0x7f3464074620 2024-09-19T06:20:52.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.850+0000 7f3463400640 1 --2- 172.21.15.3:0/1340936922 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f34480a3430 0x7f34480a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:52.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.851+0000 7f3463400640 1 --2- 172.21.15.3:0/1340936922 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f34480a3430 0x7f34480a58f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3450009230 tx=0x7f34500058d0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:52.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:52.854+0000 7f3460c00640 1 -- 172.21.15.3:0/1340936922 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f345409c320 con 0x7f3464074620 2024-09-19T06:20:53.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:53.080+0000 7f346ac00640 1 -- 172.21.15.3:0/1340936922 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3464109540 con 0x7f3464074620 2024-09-19T06:20:53.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:53.081+0000 7f3460c00640 1 -- 172.21.15.3:0/1340936922 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7f34540a0620 con 0x7f3464074620 2024-09-19T06:20:53.082 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:20:53.083 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"btime":"2024-09-19T06:12:22:958217+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:12:22.060987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24532,24515,24514,14517]},"id":1}]} 2024-09-19T06:20:53.083 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2024-09-19T06:20:53.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:53.084+0000 7f346ac00640 1 -- 172.21.15.3:0/1340936922 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f34480a3430 msgr2=0x7f34480a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:53.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:53.084+0000 7f346ac00640 1 --2- 172.21.15.3:0/1340936922 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f34480a3430 0x7f34480a58f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3450009230 tx=0x7f34500058d0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:53.084+0000 7f346ac00640 1 -- 172.21.15.3:0/1340936922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3464074620 msgr2=0x7f346419a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:53.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:53.084+0000 7f346ac00640 1 --2- 172.21.15.3:0/1340936922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3464074620 0x7f346419a760 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f345400e9f0 tx=0x7f345400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:53.084+0000 7f346ac00640 1 -- 172.21.15.3:0/1340936922 shutdown_connections 2024-09-19T06:20:53.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:53.084+0000 7f346ac00640 1 --2- 172.21.15.3:0/1340936922 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f34480a3430 0x7f34480a58f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:53.084+0000 7f346ac00640 1 --2- 172.21.15.3:0/1340936922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f346410e3c0 0x7f346419df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:53.084+0000 7f346ac00640 1 --2- 172.21.15.3:0/1340936922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3464074f40 0x7f346419aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:53.084+0000 7f346ac00640 1 --2- 172.21.15.3:0/1340936922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3464074620 0x7f346419a760 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:53.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:53.084+0000 7f346ac00640 1 -- 172.21.15.3:0/1340936922 >> 172.21.15.3:0/1340936922 conn(0x7f34640fd8c0 msgr2=0x7f34640fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:53.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:53.084+0000 7f346ac00640 1 -- 172.21.15.3:0/1340936922 shutdown_connections 2024-09-19T06:20:53.086 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:53.084+0000 7f346ac00640 1 -- 172.21.15.3:0/1340936922 wait complete. 2024-09-19T06:20:53.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:53 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1340936922' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:20:53.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:53 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1340936922' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:20:53.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:53 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1340936922' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:20:53.876 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:20:54.256 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:54.395 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:54 smithi003 ceph-mon[30893]: pgmap v262: 97 pgs: 97 active+clean; 3.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:20:54.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:54 smithi059 ceph-mon[35138]: pgmap v262: 97 pgs: 97 active+clean; 3.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:20:54.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:54 smithi071 ceph-mon[35662]: pgmap v262: 97 pgs: 97 active+clean; 3.5 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:20:54.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.827+0000 7fb81b200640 1 -- 172.21.15.3:0/3622336011 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb814101de0 msgr2=0x7fb8141021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:54.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.827+0000 7fb81b200640 1 --2- 172.21.15.3:0/3622336011 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb814101de0 0x7fb8141021c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb804009900 tx=0x7fb80402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.827+0000 7fb81b200640 1 -- 172.21.15.3:0/3622336011 shutdown_connections 2024-09-19T06:20:54.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.827+0000 7fb81b200640 1 --2- 172.21.15.3:0/3622336011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb814106f10 0x7fb81410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.827+0000 7fb81b200640 1 --2- 172.21.15.3:0/3622336011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb814102790 0x7fb8141067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.827+0000 7fb81b200640 1 --2- 172.21.15.3:0/3622336011 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb814101de0 0x7fb8141021c0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.827+0000 7fb81b200640 1 -- 172.21.15.3:0/3622336011 >> 172.21.15.3:0/3622336011 conn(0x7fb8140fd8c0 msgr2=0x7fb8140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:54.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.828+0000 7fb81b200640 1 -- 172.21.15.3:0/3622336011 shutdown_connections 2024-09-19T06:20:54.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.828+0000 7fb81b200640 1 -- 172.21.15.3:0/3622336011 wait complete. 2024-09-19T06:20:54.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.828+0000 7fb81b200640 1 Processor -- start 2024-09-19T06:20:54.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.829+0000 7fb81b200640 1 -- start start 2024-09-19T06:20:54.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.829+0000 7fb81b200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb814101de0 0x7fb81419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:54.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.829+0000 7fb81b200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb814102790 0x7fb81419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:54.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.829+0000 7fb81b200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb814106f10 0x7fb81419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:54.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.829+0000 7fb81b200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb814111f30 con 0x7fb814106f10 2024-09-19T06:20:54.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.829+0000 7fb81b200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb814111db0 con 0x7fb814102790 2024-09-19T06:20:54.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.829+0000 7fb81b200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb8141120b0 con 0x7fb814101de0 2024-09-19T06:20:54.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.829+0000 7fb819200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb814106f10 0x7fb81419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:54.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.829+0000 7fb819200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb814106f10 0x7fb81419eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54734/0 (socket says 172.21.15.3:54734) 2024-09-19T06:20:54.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.829+0000 7fb813e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb814101de0 0x7fb81419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:54.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.829+0000 7fb819200640 1 -- 172.21.15.3:0/288349521 learned_addr learned my addr 172.21.15.3:0/288349521 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:54.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.829+0000 7fb80be00640 1 --2- 172.21.15.3:0/288349521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb814102790 0x7fb81419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:54.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.830+0000 7fb819200640 1 -- 172.21.15.3:0/288349521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb814101de0 msgr2=0x7fb81419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:54.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.830+0000 7fb819200640 1 --2- 172.21.15.3:0/288349521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb814101de0 0x7fb81419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.830+0000 7fb819200640 1 -- 172.21.15.3:0/288349521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb814102790 msgr2=0x7fb81419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:54.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.830+0000 7fb819200640 1 --2- 172.21.15.3:0/288349521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb814102790 0x7fb81419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.830+0000 7fb819200640 1 -- 172.21.15.3:0/288349521 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81419f5d0 con 0x7fb814106f10 2024-09-19T06:20:54.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.830+0000 7fb819200640 1 --2- 172.21.15.3:0/288349521 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb814106f10 0x7fb81419eef0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb80c009fd0 tx=0x7fb80c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:54.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.830+0000 7fb811600640 1 -- 172.21.15.3:0/288349521 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c017070 con 0x7fb814106f10 2024-09-19T06:20:54.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.830+0000 7fb811600640 1 -- 172.21.15.3:0/288349521 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb80c003e50 con 0x7fb814106f10 2024-09-19T06:20:54.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.830+0000 7fb811600640 1 -- 172.21.15.3:0/288349521 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c0106c0 con 0x7fb814106f10 2024-09-19T06:20:54.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.830+0000 7fb81b200640 1 -- 172.21.15.3:0/288349521 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb81419f8c0 con 0x7fb814106f10 2024-09-19T06:20:54.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.830+0000 7fb81b200640 1 -- 172.21.15.3:0/288349521 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8141a71a0 con 0x7fb814106f10 2024-09-19T06:20:54.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.834+0000 7fb81de34740 1 Processor -- start 2024-09-19T06:20:54.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.834+0000 7fb811600640 1 -- 172.21.15.3:0/288349521 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fb80c003970 con 0x7fb814106f10 2024-09-19T06:20:54.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.834+0000 7fb81de34740 1 -- start start 2024-09-19T06:20:54.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.834+0000 7fb81de34740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557987798c70 0x557987799050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:54.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.834+0000 7fb81de34740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987799590 0x5579877a3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:54.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.834+0000 7fb81de34740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579877a3e50 0x5579877a6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:54.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.834+0000 7fb81de34740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5579876ff3e0 con 0x557987799590 2024-09-19T06:20:54.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.834+0000 7fb81de34740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5579876a6d80 con 0x557987798c70 2024-09-19T06:20:54.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.834+0000 7fb81de34740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5579876fb3a0 con 0x5579877a3e50 2024-09-19T06:20:54.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.835+0000 7fb813e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987799590 0x5579877a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:54.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.835+0000 7fb813e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987799590 0x5579877a3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54746/0 (socket says 172.21.15.3:54746) 2024-09-19T06:20:54.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.835+0000 7fb813e00640 1 -- 172.21.15.3:0/2111882421 learned_addr learned my addr 172.21.15.3:0/2111882421 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:54.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.835+0000 7fb80be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557987798c70 0x557987799050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:54.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.835+0000 7fb80be00640 1 --2- 172.21.15.3:0/2111882421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579877a3e50 0x5579877a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:54.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.835+0000 7fb813e00640 1 -- 172.21.15.3:0/2111882421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579877a3e50 msgr2=0x5579877a6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:54.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.835+0000 7fb813e00640 1 --2- 172.21.15.3:0/2111882421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579877a3e50 0x5579877a6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.835+0000 7fb813e00640 1 -- 172.21.15.3:0/2111882421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557987798c70 msgr2=0x557987799050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:54.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.835+0000 7fb813e00640 1 --2- 172.21.15.3:0/2111882421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557987798c70 0x557987799050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.835+0000 7fb813e00640 1 -- 172.21.15.3:0/2111882421 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579876c5ae0 con 0x557987799590 2024-09-19T06:20:54.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.835+0000 7fb80be00640 1 --2- 172.21.15.3:0/2111882421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557987798c70 0x557987799050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:54.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.835+0000 7fb811600640 1 --2- 172.21.15.3:0/288349521 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb7f80a3430 0x7fb7f80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:54.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.835+0000 7fb813e00640 1 --2- 172.21.15.3:0/2111882421 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987799590 0x5579877a3910 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb804009900 tx=0x7fb804005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce9d6f864999c3b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:54.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.835+0000 7fb811600640 1 -- 172.21.15.3:0/288349521 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7fb80c0cf9a0 con 0x7fb814106f10 2024-09-19T06:20:54.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.836+0000 7fb80be00640 1 --2- 172.21.15.3:0/288349521 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb7f80a3430 0x7fb7f80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:54.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.836+0000 7fb809600640 1 -- 172.21.15.3:0/2111882421 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb804040070 con 0x557987799590 2024-09-19T06:20:54.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.836+0000 7fb809600640 1 -- 172.21.15.3:0/2111882421 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8040319f0 con 0x557987799590 2024-09-19T06:20:54.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.836+0000 7fb809600640 1 -- 172.21.15.3:0/2111882421 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb804035040 con 0x557987799590 2024-09-19T06:20:54.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.836+0000 7fb81de34740 1 -- 172.21.15.3:0/2111882421 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987799590 msgr2=0x5579877a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:54.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.836+0000 7fb81de34740 1 --2- 172.21.15.3:0/2111882421 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987799590 0x5579877a3910 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb804009900 tx=0x7fb804005e80 comp rx=0 tx=0).stop 2024-09-19T06:20:54.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.836+0000 7fb80be00640 1 --2- 172.21.15.3:0/288349521 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb7f80a3430 0x7fb7f80a58f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x557987796580 tx=0x7fb7fc014040 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:54.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.836+0000 7fb81de34740 1 -- 172.21.15.3:0/2111882421 shutdown_connections 2024-09-19T06:20:54.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.836+0000 7fb81de34740 1 --2- 172.21.15.3:0/2111882421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579877a3e50 0x5579877a6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.836+0000 7fb81de34740 1 --2- 172.21.15.3:0/2111882421 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987799590 0x5579877a3910 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.836+0000 7fb81de34740 1 --2- 172.21.15.3:0/2111882421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557987798c70 0x557987799050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.836+0000 7fb81de34740 1 -- 172.21.15.3:0/2111882421 >> 172.21.15.3:0/2111882421 conn(0x557987795200 msgr2=0x5579877955e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:54.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.837+0000 7fb81de34740 1 -- 172.21.15.3:0/2111882421 shutdown_connections 2024-09-19T06:20:54.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.837+0000 7fb81de34740 1 -- 172.21.15.3:0/2111882421 wait complete. 2024-09-19T06:20:54.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.837+0000 7fb81de34740 1 -- start start 2024-09-19T06:20:54.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.837+0000 7fb81de34740 1 Processor -- start 2024-09-19T06:20:54.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.838+0000 7fb81de34740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987798c70 0x5579877a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:54.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.838+0000 7fb81de34740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557987799590 0x5579877a1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:54.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.838+0000 7fb81de34740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579877a3e50 0x5579877a1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:54.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.838+0000 7fb81de34740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5579877a6a20 con 0x557987798c70 2024-09-19T06:20:54.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.838+0000 7fb81de34740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5579876ba0f0 con 0x557987799590 2024-09-19T06:20:54.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.838+0000 7fb81de34740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5579877a6ba0 con 0x5579877a3e50 2024-09-19T06:20:54.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.838+0000 7fb81de34740 10 client.0 _ll_register_callbacks cb 0x5579876a1bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:54.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.838+0000 7fb813e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987798c70 0x5579877a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:54.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.838+0000 7fb813e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987798c70 0x5579877a0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54750/0 (socket says 172.21.15.3:54750) 2024-09-19T06:20:54.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.838+0000 7fb813e00640 1 -- 172.21.15.3:0/1292094929 learned_addr learned my addr 172.21.15.3:0/1292094929 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:54.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.838+0000 7fb80be00640 1 --2- 172.21.15.3:0/1292094929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557987799590 0x5579877a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:54.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.838+0000 7fb819200640 1 --2- 172.21.15.3:0/1292094929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579877a3e50 0x5579877a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:54.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.838+0000 7fb813e00640 1 -- 172.21.15.3:0/1292094929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579877a3e50 msgr2=0x5579877a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:54.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.838+0000 7fb813e00640 1 --2- 172.21.15.3:0/1292094929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579877a3e50 0x5579877a1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.854 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.838+0000 7fb813e00640 1 -- 172.21.15.3:0/1292094929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557987799590 msgr2=0x5579877a1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.838+0000 7fb813e00640 1 --2- 172.21.15.3:0/1292094929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557987799590 0x5579877a1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.838+0000 7fb813e00640 1 -- 172.21.15.3:0/1292094929 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579874703c0 con 0x557987798c70 2024-09-19T06:20:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.838+0000 7fb819200640 1 --2- 172.21.15.3:0/1292094929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579877a3e50 0x5579877a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.839+0000 7fb813e00640 1 --2- 172.21.15.3:0/1292094929 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987798c70 0x5579877a0ce0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb80402a430 tx=0x7fb804005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d496c660b914 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.839+0000 7fb802000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:20:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.839+0000 7fb802000640 1 -- 172.21.15.3:0/1292094929 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80404d060 con 0x557987798c70 2024-09-19T06:20:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.839+0000 7fb802000640 1 -- 172.21.15.3:0/1292094929 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7fb804004230 con 0x557987798c70 2024-09-19T06:20:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.839+0000 7fb81de34740 1 -- 172.21.15.3:0/1292094929 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8040319f0 con 0x557987798c70 2024-09-19T06:20:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.839+0000 7fb802000640 1 -- 172.21.15.3:0/1292094929 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb804040070 con 0x557987798c70 2024-09-19T06:20:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.839+0000 7fb81de34740 10 client.17703 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.839+0000 7fb81de34740 1 -- 172.21.15.3:0/1292094929 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5579877b29f0 con 0x557987798c70 2024-09-19T06:20:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.839+0000 7fb802000640 1 -- 172.21.15.3:0/1292094929 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8040319f0 con 0x557987798c70 2024-09-19T06:20:54.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.840+0000 7fb802000640 1 -- 172.21.15.3:0/1292094929 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb8040039c0 con 0x557987798c70 2024-09-19T06:20:54.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.840+0000 7fb81de34740 10 client.17703 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:54.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.840+0000 7fb81de34740 10 client.17703 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:20:54.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.840+0000 7fb81de34740 20 client.17703 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:54.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.840+0000 7fb81de34740 1 --2- 172.21.15.3:0/1292094929 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5579877b3d40 0x5579877b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:54.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.840+0000 7fb81de34740 4 client.17703 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:54.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.840+0000 7fb81de34740 1 -- 172.21.15.3:0/1292094929 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55798770c950 con 0x5579877b3d40 2024-09-19T06:20:54.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.840+0000 7fb80be00640 1 --2- 172.21.15.3:0/1292094929 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5579877b3d40 0x5579877b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:54.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.841+0000 7fb80be00640 1 --2- 172.21.15.3:0/1292094929 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5579877b3d40 0x5579877b6130 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d9e0948be6f20472 server_cookie=f4b405685ad1d6d9 in_seq=0 out_seq=0 2024-09-19T06:20:54.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.841+0000 7fb802000640 10 client.17703 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:20:54.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.841+0000 7fb802000640 1 -- 172.21.15.3:0/1292094929 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55798770c950 con 0x5579877b3d40 2024-09-19T06:20:54.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.841+0000 7fb802000640 10 client.17703 handle_command_reply: tid=0 2024-09-19T06:20:54.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.841+0000 7fb81de34740 1 client.17703 shutdown 2024-09-19T06:20:54.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.842+0000 7fb81de34740 1 -- 172.21.15.3:0/1292094929 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987798c70 msgr2=0x5579877a0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:54.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.842+0000 7fb81de34740 1 --2- 172.21.15.3:0/1292094929 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987798c70 0x5579877a0ce0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb80402a430 tx=0x7fb804005250 comp rx=0 tx=0).stop 2024-09-19T06:20:54.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.842+0000 7fb81de34740 1 -- 172.21.15.3:0/1292094929 shutdown_connections 2024-09-19T06:20:54.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.842+0000 7fb81de34740 1 --2- 172.21.15.3:0/1292094929 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5579877b3d40 0x5579877b6130 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.842+0000 7fb81de34740 1 --2- 172.21.15.3:0/1292094929 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579877a3e50 0x5579877a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.842+0000 7fb81de34740 1 --2- 172.21.15.3:0/1292094929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557987799590 0x5579877a1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.842+0000 7fb81de34740 1 --2- 172.21.15.3:0/1292094929 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987798c70 0x5579877a0ce0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.842+0000 7fb81de34740 1 -- 172.21.15.3:0/1292094929 >> 172.21.15.3:0/1292094929 conn(0x557987795200 msgr2=0x557987794380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:54.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.842+0000 7fb802000640 0 client.17703 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:20:54.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.842+0000 7fb81de34740 1 -- 172.21.15.3:0/1292094929 shutdown_connections 2024-09-19T06:20:54.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.842+0000 7fb81de34740 1 -- 172.21.15.3:0/1292094929 wait complete. 2024-09-19T06:20:54.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.842+0000 7fb81de34740 20 client.17703 trim_cache size 0 max 16384 2024-09-19T06:20:54.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.856+0000 7fb81de34740 1 Processor -- start 2024-09-19T06:20:54.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.856+0000 7fb81de34740 1 -- start start 2024-09-19T06:20:54.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.857+0000 7fb81de34740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987798c70 0x55798779b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:54.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.857+0000 7fb81de34740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557987799590 0x5579877a2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:54.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.857+0000 7fb81de34740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579877a3e50 0x5579877bb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:54.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.857+0000 7fb81de34740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb8141afaf0 con 0x557987798c70 2024-09-19T06:20:54.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.857+0000 7fb81de34740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb8141b1630 con 0x557987799590 2024-09-19T06:20:54.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.857+0000 7fb81de34740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb8141b01c0 con 0x5579877a3e50 2024-09-19T06:20:54.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.857+0000 7fb813e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987798c70 0x55798779b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:54.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.857+0000 7fb813e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987798c70 0x55798779b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54762/0 (socket says 172.21.15.3:54762) 2024-09-19T06:20:54.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.857+0000 7fb813e00640 1 -- 172.21.15.3:0/715467860 learned_addr learned my addr 172.21.15.3:0/715467860 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:54.860 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.857+0000 7fb80be00640 1 --2- 172.21.15.3:0/715467860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557987799590 0x5579877a2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:54.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.857+0000 7fb819200640 1 --2- 172.21.15.3:0/715467860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579877a3e50 0x5579877bb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:54.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.857+0000 7fb813e00640 1 -- 172.21.15.3:0/715467860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579877a3e50 msgr2=0x5579877bb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:54.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.857+0000 7fb813e00640 1 --2- 172.21.15.3:0/715467860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579877a3e50 0x5579877bb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.857+0000 7fb813e00640 1 -- 172.21.15.3:0/715467860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557987799590 msgr2=0x5579877a2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:54.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.857+0000 7fb813e00640 1 --2- 172.21.15.3:0/715467860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557987799590 0x5579877a2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.857+0000 7fb813e00640 1 -- 172.21.15.3:0/715467860 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557987790770 con 0x557987798c70 2024-09-19T06:20:54.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.857+0000 7fb80be00640 1 --2- 172.21.15.3:0/715467860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557987799590 0x5579877a2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:54.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.858+0000 7fb813e00640 1 --2- 172.21.15.3:0/715467860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987798c70 0x55798779b640 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb804003d60 tx=0x7fb8040055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f157d81cb6fed76e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:54.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.858+0000 7fb808c00640 1 -- 172.21.15.3:0/715467860 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80404d070 con 0x557987798c70 2024-09-19T06:20:54.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.858+0000 7fb808c00640 1 -- 172.21.15.3:0/715467860 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb804005850 con 0x557987798c70 2024-09-19T06:20:54.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.858+0000 7fb808c00640 1 -- 172.21.15.3:0/715467860 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb804035040 con 0x557987798c70 2024-09-19T06:20:54.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.858+0000 7fb81de34740 1 -- 172.21.15.3:0/715467860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987798c70 msgr2=0x55798779b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:54.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.858+0000 7fb81de34740 1 --2- 172.21.15.3:0/715467860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987798c70 0x55798779b640 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb804003d60 tx=0x7fb8040055d0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.859+0000 7fb81de34740 1 -- 172.21.15.3:0/715467860 shutdown_connections 2024-09-19T06:20:54.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.859+0000 7fb81de34740 1 --2- 172.21.15.3:0/715467860 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579877a3e50 0x5579877bb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.859+0000 7fb81de34740 1 --2- 172.21.15.3:0/715467860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557987799590 0x5579877a2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.859+0000 7fb81de34740 1 --2- 172.21.15.3:0/715467860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987798c70 0x55798779b640 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.859+0000 7fb81de34740 1 -- 172.21.15.3:0/715467860 >> 172.21.15.3:0/715467860 conn(0x557987795200 msgr2=0x5579877a2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:54.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.859+0000 7fb81de34740 1 -- 172.21.15.3:0/715467860 shutdown_connections 2024-09-19T06:20:54.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.859+0000 7fb81de34740 1 -- 172.21.15.3:0/715467860 wait complete. 2024-09-19T06:20:54.862 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.859+0000 7fb81de34740 1 -- start start 2024-09-19T06:20:54.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.859+0000 7fb81de34740 1 Processor -- start 2024-09-19T06:20:54.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.860+0000 7fb81de34740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987798c70 0x5579877ac160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:54.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.860+0000 7fb81de34740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557987799590 0x5579877ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:54.865 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.860+0000 7fb81de34740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579877a3e50 0x5579877a76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:54.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.860+0000 7fb81de34740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb8141b0f60 con 0x557987798c70 2024-09-19T06:20:54.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.860+0000 7fb81de34740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb8141b0890 con 0x557987799590 2024-09-19T06:20:54.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.860+0000 7fb81de34740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb8141adaf0 con 0x5579877a3e50 2024-09-19T06:20:54.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.860+0000 7fb81de34740 10 client.0 _ll_register_callbacks cb 0x7fb804005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:54.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.860+0000 7fb813e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987798c70 0x5579877ac160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:54.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.860+0000 7fb813e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987798c70 0x5579877ac160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54764/0 (socket says 172.21.15.3:54764) 2024-09-19T06:20:54.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.860+0000 7fb813e00640 1 -- 172.21.15.3:0/734136610 learned_addr learned my addr 172.21.15.3:0/734136610 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:54.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.860+0000 7fb819200640 1 --2- 172.21.15.3:0/734136610 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579877a3e50 0x5579877a76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:54.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.860+0000 7fb80be00640 1 --2- 172.21.15.3:0/734136610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557987799590 0x5579877ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:54.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.861+0000 7fb813e00640 1 -- 172.21.15.3:0/734136610 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579877a3e50 msgr2=0x5579877a76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:54.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.861+0000 7fb813e00640 1 --2- 172.21.15.3:0/734136610 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579877a3e50 0x5579877a76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.861+0000 7fb813e00640 1 -- 172.21.15.3:0/734136610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557987799590 msgr2=0x5579877ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:54.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.861+0000 7fb813e00640 1 --2- 172.21.15.3:0/734136610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557987799590 0x5579877ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.861+0000 7fb813e00640 1 -- 172.21.15.3:0/734136610 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579877a7f10 con 0x557987798c70 2024-09-19T06:20:54.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.861+0000 7fb80be00640 1 --2- 172.21.15.3:0/734136610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557987799590 0x5579877ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:54.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.861+0000 7fb813e00640 1 --2- 172.21.15.3:0/734136610 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987798c70 0x5579877ac160 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb804031b50 tx=0x7fb804031b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1851f277f6c3d949 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:54.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.861+0000 7fb802000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:20:54.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.861+0000 7fb802000640 1 -- 172.21.15.3:0/734136610 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80404d070 con 0x557987798c70 2024-09-19T06:20:54.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.861+0000 7fb81de34740 1 -- 172.21.15.3:0/734136610 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb804005850 con 0x557987798c70 2024-09-19T06:20:54.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.861+0000 7fb802000640 1 -- 172.21.15.3:0/734136610 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7fb804004360 con 0x557987798c70 2024-09-19T06:20:54.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.862+0000 7fb802000640 1 -- 172.21.15.3:0/734136610 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb804035040 con 0x557987798c70 2024-09-19T06:20:54.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.862+0000 7fb81de34740 10 client.17709 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:54.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.862+0000 7fb81de34740 1 -- 172.21.15.3:0/734136610 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55798781e3f0 con 0x557987798c70 2024-09-19T06:20:54.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.862+0000 7fb802000640 1 -- 172.21.15.3:0/734136610 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb804005850 con 0x557987798c70 2024-09-19T06:20:54.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.862+0000 7fb802000640 1 -- 172.21.15.3:0/734136610 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb80406b070 con 0x557987798c70 2024-09-19T06:20:54.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.862+0000 7fb81de34740 10 client.17709 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:54.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.862+0000 7fb81de34740 10 client.17709 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:20:54.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.862+0000 7fb81de34740 20 client.17709 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:54.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.862+0000 7fb81de34740 1 --2- 172.21.15.3:0/734136610 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55798781e9a0 0x557987820d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:54.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.862+0000 7fb81de34740 4 client.17709 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:54.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.862+0000 7fb81de34740 1 -- 172.21.15.3:0/734136610 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557987706e60 con 0x55798781e9a0 2024-09-19T06:20:54.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.862+0000 7fb80be00640 1 --2- 172.21.15.3:0/734136610 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55798781e9a0 0x557987820d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:54.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.863+0000 7fb80be00640 1 --2- 172.21.15.3:0/734136610 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55798781e9a0 0x557987820d90 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7d1256b289ac2fa2 server_cookie=fac6aa1aa67cd02d in_seq=0 out_seq=0 2024-09-19T06:20:54.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.863+0000 7fb802000640 10 client.17709 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:20:54.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.863+0000 7fb802000640 1 -- 172.21.15.3:0/734136610 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557987706e60 con 0x55798781e9a0 2024-09-19T06:20:54.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.863+0000 7fb802000640 10 client.17709 handle_command_reply: tid=0 2024-09-19T06:20:54.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.863+0000 7fb81de34740 1 client.17709 shutdown 2024-09-19T06:20:54.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.863+0000 7fb81de34740 1 -- 172.21.15.3:0/734136610 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987798c70 msgr2=0x5579877ac160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:54.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.863+0000 7fb81de34740 1 --2- 172.21.15.3:0/734136610 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987798c70 0x5579877ac160 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb804031b50 tx=0x7fb804031b80 comp rx=0 tx=0).stop 2024-09-19T06:20:54.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.864+0000 7fb81de34740 1 -- 172.21.15.3:0/734136610 shutdown_connections 2024-09-19T06:20:54.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.864+0000 7fb81de34740 1 --2- 172.21.15.3:0/734136610 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55798781e9a0 0x557987820d90 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.864+0000 7fb81de34740 1 --2- 172.21.15.3:0/734136610 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5579877a3e50 0x5579877a76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.864+0000 7fb81de34740 1 --2- 172.21.15.3:0/734136610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557987799590 0x5579877ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.864+0000 7fb81de34740 1 --2- 172.21.15.3:0/734136610 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557987798c70 0x5579877ac160 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.864+0000 7fb81de34740 1 -- 172.21.15.3:0/734136610 >> 172.21.15.3:0/734136610 conn(0x557987795200 msgr2=0x5579877a2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:54.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.864+0000 7fb802000640 0 client.17709 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:20:54.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.864+0000 7fb81de34740 1 -- 172.21.15.3:0/734136610 shutdown_connections 2024-09-19T06:20:54.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.864+0000 7fb81de34740 1 -- 172.21.15.3:0/734136610 wait complete. 2024-09-19T06:20:54.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.864+0000 7fb81de34740 20 client.17709 trim_cache size 0 max 16384 2024-09-19T06:20:54.869 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:20:54.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.865+0000 7fb81b200640 1 -- 172.21.15.3:0/288349521 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb7f80a3430 msgr2=0x7fb7f80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:54.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.865+0000 7fb81b200640 1 --2- 172.21.15.3:0/288349521 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb7f80a3430 0x7fb7f80a58f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x557987796580 tx=0x7fb7fc014040 comp rx=0 tx=0).stop 2024-09-19T06:20:54.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.865+0000 7fb81b200640 1 -- 172.21.15.3:0/288349521 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb814106f10 msgr2=0x7fb81419eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:54.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.865+0000 7fb81b200640 1 --2- 172.21.15.3:0/288349521 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb814106f10 0x7fb81419eef0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb80c009fd0 tx=0x7fb80c00b260 comp rx=0 tx=0).stop 2024-09-19T06:20:54.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.865+0000 7fb81b200640 1 -- 172.21.15.3:0/288349521 shutdown_connections 2024-09-19T06:20:54.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.865+0000 7fb81b200640 1 --2- 172.21.15.3:0/288349521 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb7f80a3430 0x7fb7f80a58f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.865+0000 7fb81b200640 1 --2- 172.21.15.3:0/288349521 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb814106f10 0x7fb81419eef0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.865+0000 7fb81b200640 1 --2- 172.21.15.3:0/288349521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb814102790 0x7fb81419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.865+0000 7fb81b200640 1 --2- 172.21.15.3:0/288349521 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb814101de0 0x7fb81419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:54.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.865+0000 7fb81b200640 1 -- 172.21.15.3:0/288349521 >> 172.21.15.3:0/288349521 conn(0x7fb8140fd8c0 msgr2=0x7fb8140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:54.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.865+0000 7fb81b200640 1 -- 172.21.15.3:0/288349521 shutdown_connections 2024-09-19T06:20:54.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:54.865+0000 7fb81b200640 1 -- 172.21.15.3:0/288349521 wait complete. 2024-09-19T06:20:55.902 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:20:56.284 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:56.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:56 smithi003 ceph-mon[30893]: pgmap v263: 97 pgs: 97 active+clean; 3.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 23 op/s 2024-09-19T06:20:56.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:56 smithi059 ceph-mon[35138]: pgmap v263: 97 pgs: 97 active+clean; 3.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 23 op/s 2024-09-19T06:20:56.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:56 smithi071 ceph-mon[35662]: pgmap v263: 97 pgs: 97 active+clean; 3.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 23 op/s 2024-09-19T06:20:56.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.873+0000 7f97a2a00640 1 -- 172.21.15.3:0/4246982306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f979c0745c0 msgr2=0x7f979c0749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:56.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.873+0000 7f97a2a00640 1 --2- 172.21.15.3:0/4246982306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f979c0745c0 0x7f979c0749a0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f978c009900 tx=0x7f978c02a490 comp rx=0 tx=0).stop 2024-09-19T06:20:56.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.873+0000 7f97a2a00640 1 -- 172.21.15.3:0/4246982306 shutdown_connections 2024-09-19T06:20:56.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.873+0000 7f97a2a00640 1 --2- 172.21.15.3:0/4246982306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f979c10e430 0x7f979c110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.873+0000 7f97a2a00640 1 --2- 172.21.15.3:0/4246982306 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f979c074ee0 0x7f979c10def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.873+0000 7f97a2a00640 1 --2- 172.21.15.3:0/4246982306 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f979c0745c0 0x7f979c0749a0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.873+0000 7f97a2a00640 1 -- 172.21.15.3:0/4246982306 >> 172.21.15.3:0/4246982306 conn(0x7f979c0fd8b0 msgr2=0x7f979c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:56.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.873+0000 7f97a2a00640 1 -- 172.21.15.3:0/4246982306 shutdown_connections 2024-09-19T06:20:56.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.873+0000 7f97a2a00640 1 -- 172.21.15.3:0/4246982306 wait complete. 2024-09-19T06:20:56.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.874+0000 7f97a2a00640 1 Processor -- start 2024-09-19T06:20:56.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.874+0000 7f97a2a00640 1 -- start start 2024-09-19T06:20:56.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.874+0000 7f97a2a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f979c0745c0 0x7f979c19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.874+0000 7f97a2a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f979c074ee0 0x7f979c19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.874+0000 7f97a2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f979c10e430 0x7f979c19efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.874+0000 7f97a2a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f979c1141d0 con 0x7f979c0745c0 2024-09-19T06:20:56.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.874+0000 7f97a2a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f979c114050 con 0x7f979c10e430 2024-09-19T06:20:56.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.874+0000 7f97a2a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f979c114350 con 0x7f979c074ee0 2024-09-19T06:20:56.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.875+0000 7f979be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f979c0745c0 0x7f979c19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.875+0000 7f979be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f979c0745c0 0x7f979c19a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54782/0 (socket says 172.21.15.3:54782) 2024-09-19T06:20:56.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.875+0000 7f979be00640 1 -- 172.21.15.3:0/3467050791 learned_addr learned my addr 172.21.15.3:0/3467050791 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:56.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.875+0000 7f97a0a00640 1 --2- 172.21.15.3:0/3467050791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f979c10e430 0x7f979c19efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.875+0000 7f9793400640 1 --2- 172.21.15.3:0/3467050791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f979c074ee0 0x7f979c19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.875+0000 7f979be00640 1 -- 172.21.15.3:0/3467050791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f979c074ee0 msgr2=0x7f979c19ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:56.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.875+0000 7f979be00640 1 --2- 172.21.15.3:0/3467050791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f979c074ee0 0x7f979c19ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.875+0000 7f979be00640 1 -- 172.21.15.3:0/3467050791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f979c10e430 msgr2=0x7f979c19efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:56.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.875+0000 7f979be00640 1 --2- 172.21.15.3:0/3467050791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f979c10e430 0x7f979c19efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.875+0000 7f979be00640 1 -- 172.21.15.3:0/3467050791 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979c19f6a0 con 0x7f979c0745c0 2024-09-19T06:20:56.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.875+0000 7f97a0a00640 1 --2- 172.21.15.3:0/3467050791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f979c10e430 0x7f979c19efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:56.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.876+0000 7f979be00640 1 --2- 172.21.15.3:0/3467050791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f979c0745c0 0x7f979c19a6f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f978c004770 tx=0x7f978c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:56.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.876+0000 7f9799600640 1 -- 172.21.15.3:0/3467050791 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c03f070 con 0x7f979c0745c0 2024-09-19T06:20:56.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.876+0000 7f9799600640 1 -- 172.21.15.3:0/3467050791 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f978c031ca0 con 0x7f979c0745c0 2024-09-19T06:20:56.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.876+0000 7f9799600640 1 -- 172.21.15.3:0/3467050791 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c035030 con 0x7f979c0745c0 2024-09-19T06:20:56.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.876+0000 7f97a2a00640 1 -- 172.21.15.3:0/3467050791 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f979c19f930 con 0x7f979c0745c0 2024-09-19T06:20:56.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.876+0000 7f97a2a00640 1 -- 172.21.15.3:0/3467050791 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f979c19fdc0 con 0x7f979c0745c0 2024-09-19T06:20:56.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.879+0000 7f97a55ef740 1 Processor -- start 2024-09-19T06:20:56.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.879+0000 7f97a55ef740 1 -- start start 2024-09-19T06:20:56.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.879+0000 7f9799600640 1 -- 172.21.15.3:0/3467050791 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f978c042070 con 0x7f979c0745c0 2024-09-19T06:20:56.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.879+0000 7f97a55ef740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126f0c70 0x55f9126f1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.879+0000 7f97a55ef740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9126f1590 0x55f9126fb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.880+0000 7f97a55ef740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f9126fbe50 0x55f9126fe240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.880+0000 7f97a55ef740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55f9126573e0 con 0x55f9126fbe50 2024-09-19T06:20:56.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.880+0000 7f97a55ef740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f9125fed80 con 0x55f9126f0c70 2024-09-19T06:20:56.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.880+0000 7f97a55ef740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f9126533a0 con 0x55f9126f1590 2024-09-19T06:20:56.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.880+0000 7f97a0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126f0c70 0x55f9126f1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.880+0000 7f97a0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126f0c70 0x55f9126f1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:50696/0 (socket says 172.21.15.3:50696) 2024-09-19T06:20:56.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.880+0000 7f97a0a00640 1 -- 172.21.15.3:0/3773553479 learned_addr learned my addr 172.21.15.3:0/3773553479 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:56.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.880+0000 7f979be00640 1 --2- 172.21.15.3:0/3773553479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9126f1590 0x55f9126fb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.880+0000 7f9793400640 1 --2- 172.21.15.3:0/3773553479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f9126fbe50 0x55f9126fe240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.880+0000 7f97a0a00640 1 -- 172.21.15.3:0/3773553479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9126f1590 msgr2=0x55f9126fb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:56.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.880+0000 7f97a0a00640 1 --2- 172.21.15.3:0/3773553479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9126f1590 0x55f9126fb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.880+0000 7f97a0a00640 1 -- 172.21.15.3:0/3773553479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f9126fbe50 msgr2=0x55f9126fe240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:56.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.880+0000 7f97a0a00640 1 --2- 172.21.15.3:0/3773553479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f9126fbe50 0x55f9126fe240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.880+0000 7f97a0a00640 1 -- 172.21.15.3:0/3773553479 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f91261dae0 con 0x55f9126f0c70 2024-09-19T06:20:56.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.881+0000 7f97a0a00640 1 --2- 172.21.15.3:0/3773553479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126f0c70 0x55f9126f1050 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9794011790 tx=0x7f9794011c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2cf15c828056f02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:56.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.881+0000 7f9791200640 1 -- 172.21.15.3:0/3773553479 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979400fc60 con 0x55f9126f0c70 2024-09-19T06:20:56.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.881+0000 7f9791200640 1 -- 172.21.15.3:0/3773553479 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9794003e50 con 0x55f9126f0c70 2024-09-19T06:20:56.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.881+0000 7f9791200640 1 -- 172.21.15.3:0/3773553479 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9794019430 con 0x55f9126f0c70 2024-09-19T06:20:56.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.881+0000 7f9799600640 1 --2- 172.21.15.3:0/3467050791 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f97800a3430 0x7f97800a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.882+0000 7f9799600640 1 -- 172.21.15.3:0/3467050791 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f978c0f0270 con 0x7f979c0745c0 2024-09-19T06:20:56.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.882+0000 7f979be00640 1 --2- 172.21.15.3:0/3467050791 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f97800a3430 0x7f97800a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.882+0000 7f97a55ef740 1 -- 172.21.15.3:0/3773553479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126f0c70 msgr2=0x55f9126f1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:56.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.882+0000 7f97a55ef740 1 --2- 172.21.15.3:0/3773553479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126f0c70 0x55f9126f1050 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9794011790 tx=0x7f9794011c50 comp rx=0 tx=0).stop 2024-09-19T06:20:56.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.882+0000 7f97a55ef740 1 -- 172.21.15.3:0/3773553479 shutdown_connections 2024-09-19T06:20:56.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.882+0000 7f97a55ef740 1 --2- 172.21.15.3:0/3773553479 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f9126fbe50 0x55f9126fe240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.882+0000 7f97a55ef740 1 --2- 172.21.15.3:0/3773553479 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9126f1590 0x55f9126fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.882+0000 7f97a55ef740 1 --2- 172.21.15.3:0/3773553479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126f0c70 0x55f9126f1050 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.882+0000 7f97a55ef740 1 -- 172.21.15.3:0/3773553479 >> 172.21.15.3:0/3773553479 conn(0x55f9126ed200 msgr2=0x55f9126ed5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:56.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.882+0000 7f97a55ef740 1 -- 172.21.15.3:0/3773553479 shutdown_connections 2024-09-19T06:20:56.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.882+0000 7f97a55ef740 1 -- 172.21.15.3:0/3773553479 wait complete. 2024-09-19T06:20:56.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.882+0000 7f979be00640 1 --2- 172.21.15.3:0/3467050791 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f97800a3430 0x7f97800a58f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f978c0eda40 tx=0x7f978c0f3dc0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:56.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.883+0000 7f97a55ef740 1 -- start start 2024-09-19T06:20:56.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.883+0000 7f97a55ef740 1 Processor -- start 2024-09-19T06:20:56.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.883+0000 7f97a55ef740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f9126f0c70 0x55f9126f8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.883+0000 7f97a55ef740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126f1590 0x55f9126f9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.884+0000 7f97a55ef740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9126fbe50 0x55f9126f9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.884+0000 7f97a55ef740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55f9126fea20 con 0x55f9126f0c70 2024-09-19T06:20:56.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.884+0000 7f97a55ef740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f9126120f0 con 0x55f9126f1590 2024-09-19T06:20:56.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.884+0000 7f97a55ef740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f9126feba0 con 0x55f9126fbe50 2024-09-19T06:20:56.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.884+0000 7f97a55ef740 10 client.0 _ll_register_callbacks cb 0x55f9125f9bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:56.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.884+0000 7f97a0a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f9126f0c70 0x55f9126f8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.884+0000 7f9793400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126f1590 0x55f9126f9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.884+0000 7f9793400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126f1590 0x55f9126f9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:50706/0 (socket says 172.21.15.3:50706) 2024-09-19T06:20:56.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.884+0000 7f9793400640 1 -- 172.21.15.3:0/17877821 learned_addr learned my addr 172.21.15.3:0/17877821 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:56.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.884+0000 7f97a0a00640 1 --2- 172.21.15.3:0/17877821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9126fbe50 0x55f9126f9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.884+0000 7f9793400640 1 -- 172.21.15.3:0/17877821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9126fbe50 msgr2=0x55f9126f9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:56.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.884+0000 7f9793400640 1 --2- 172.21.15.3:0/17877821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9126fbe50 0x55f9126f9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.884+0000 7f9793400640 1 -- 172.21.15.3:0/17877821 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f9126f0c70 msgr2=0x55f9126f8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:56.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.884+0000 7f9793400640 1 --2- 172.21.15.3:0/17877821 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f9126f0c70 0x55f9126f8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.884+0000 7f9793400640 1 -- 172.21.15.3:0/17877821 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9123c83c0 con 0x55f9126f1590 2024-09-19T06:20:56.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.885+0000 7f9793400640 1 --2- 172.21.15.3:0/17877821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126f1590 0x55f9126f9230 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9784012730 tx=0x7f9784012bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1698a904269e81a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:56.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.885+0000 7f9789600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:20:56.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.885+0000 7f9789600640 1 -- 172.21.15.3:0/17877821 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978400f8c0 con 0x55f9126f1590 2024-09-19T06:20:56.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.885+0000 7f9789600640 1 -- 172.21.15.3:0/17877821 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f978400fa60 con 0x55f9126f1590 2024-09-19T06:20:56.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.885+0000 7f97a55ef740 1 -- 172.21.15.3:0/17877821 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9794003e50 con 0x55f9126f1590 2024-09-19T06:20:56.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.885+0000 7f9789600640 1 -- 172.21.15.3:0/17877821 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f978400fca0 con 0x55f9126f1590 2024-09-19T06:20:56.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.885+0000 7f97a55ef740 10 client.27758 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:56.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.885+0000 7f97a55ef740 1 -- 172.21.15.3:0/17877821 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f91270aa70 con 0x55f9126f1590 2024-09-19T06:20:56.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.886+0000 7f9789600640 1 -- 172.21.15.3:0/17877821 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9794003e50 con 0x55f9126f1590 2024-09-19T06:20:56.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.886+0000 7f9789600640 1 -- 172.21.15.3:0/17877821 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9784023070 con 0x55f9126f1590 2024-09-19T06:20:56.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.886+0000 7f97a55ef740 10 client.27758 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:56.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.886+0000 7f97a55ef740 10 client.27758 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:20:56.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.886+0000 7f97a55ef740 20 client.27758 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:56.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.886+0000 7f97a55ef740 1 --2- 172.21.15.3:0/17877821 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55f91270bf30 0x55f91270e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.889 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.886+0000 7f97a55ef740 4 client.27758 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:56.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.886+0000 7f97a55ef740 1 -- 172.21.15.3:0/17877821 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f912664950 con 0x55f91270bf30 2024-09-19T06:20:56.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.886+0000 7f97a0a00640 1 --2- 172.21.15.3:0/17877821 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55f91270bf30 0x55f91270e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.887+0000 7f97a0a00640 1 --2- 172.21.15.3:0/17877821 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55f91270bf30 0x55f91270e320 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b13460b506a35647 server_cookie=44ac7fcf9f456d85 in_seq=0 out_seq=0 2024-09-19T06:20:56.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.887+0000 7f9789600640 10 client.27758 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:20:56.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.888+0000 7f9789600640 1 -- 172.21.15.3:0/17877821 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f912664950 con 0x55f91270bf30 2024-09-19T06:20:56.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.888+0000 7f9789600640 10 client.27758 handle_command_reply: tid=0 2024-09-19T06:20:56.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.888+0000 7f97a55ef740 1 client.27758 shutdown 2024-09-19T06:20:56.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.888+0000 7f97a55ef740 1 -- 172.21.15.3:0/17877821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126f1590 msgr2=0x55f9126f9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:56.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.888+0000 7f97a55ef740 1 --2- 172.21.15.3:0/17877821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126f1590 0x55f9126f9230 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9784012730 tx=0x7f9784012bf0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.888+0000 7f97a55ef740 1 -- 172.21.15.3:0/17877821 shutdown_connections 2024-09-19T06:20:56.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.888+0000 7f97a55ef740 1 --2- 172.21.15.3:0/17877821 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9126fbe50 0x55f9126f9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.888+0000 7f97a55ef740 1 --2- 172.21.15.3:0/17877821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126f1590 0x55f9126f9230 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.888+0000 7f97a55ef740 1 --2- 172.21.15.3:0/17877821 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55f91270bf30 0x55f91270e320 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.888+0000 7f97a55ef740 1 --2- 172.21.15.3:0/17877821 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f9126f0c70 0x55f9126f8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.888+0000 7f97a55ef740 1 -- 172.21.15.3:0/17877821 >> 172.21.15.3:0/17877821 conn(0x55f9126ed200 msgr2=0x55f9126ec380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:56.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.888+0000 7f9789600640 0 client.27758 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:20:56.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.888+0000 7f97a55ef740 1 -- 172.21.15.3:0/17877821 shutdown_connections 2024-09-19T06:20:56.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.888+0000 7f97a55ef740 1 -- 172.21.15.3:0/17877821 wait complete. 2024-09-19T06:20:56.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.888+0000 7f97a55ef740 20 client.27758 trim_cache size 0 max 16384 2024-09-19T06:20:56.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.902+0000 7f97a55ef740 1 Processor -- start 2024-09-19T06:20:56.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.902+0000 7f97a55ef740 1 -- start start 2024-09-19T06:20:56.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.902+0000 7f97a55ef740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9126f0c70 0x55f9126f36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.902+0000 7f97a55ef740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f9126f1590 0x55f9126fac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.902+0000 7f97a55ef740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126fbe50 0x55f912713c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.902+0000 7f97a55ef740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f979c1afbe0 con 0x55f9126f1590 2024-09-19T06:20:56.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.903+0000 7f97a55ef740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f979c1b1720 con 0x55f9126fbe50 2024-09-19T06:20:56.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.903+0000 7f97a55ef740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f979c1b02b0 con 0x55f9126f0c70 2024-09-19T06:20:56.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.903+0000 7f9793400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f9126f1590 0x55f9126fac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.903+0000 7f9793400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f9126f1590 0x55f9126fac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54822/0 (socket says 172.21.15.3:54822) 2024-09-19T06:20:56.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.903+0000 7f9793400640 1 -- 172.21.15.3:0/4120642142 learned_addr learned my addr 172.21.15.3:0/4120642142 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:56.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.903+0000 7f97a0a00640 1 --2- 172.21.15.3:0/4120642142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126fbe50 0x55f912713c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.903+0000 7f97a0a00640 1 --2- 172.21.15.3:0/4120642142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9126f0c70 0x55f9126f36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.903+0000 7f9793400640 1 -- 172.21.15.3:0/4120642142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9126f0c70 msgr2=0x55f9126f36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:56.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.903+0000 7f9793400640 1 --2- 172.21.15.3:0/4120642142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9126f0c70 0x55f9126f36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.903+0000 7f9793400640 1 -- 172.21.15.3:0/4120642142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126fbe50 msgr2=0x55f912713c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:56.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.903+0000 7f9793400640 1 --2- 172.21.15.3:0/4120642142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126fbe50 0x55f912713c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.903+0000 7f9793400640 1 -- 172.21.15.3:0/4120642142 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9126ee2b0 con 0x55f9126f1590 2024-09-19T06:20:56.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.903+0000 7f97a0a00640 1 --2- 172.21.15.3:0/4120642142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9126f0c70 0x55f9126f36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:56.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.904+0000 7f9793400640 1 --2- 172.21.15.3:0/4120642142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f9126f1590 0x55f9126fac60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9784010580 tx=0x7f97840096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f838e05fdb45cc80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:56.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.904+0000 7f978be00640 1 -- 172.21.15.3:0/4120642142 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9784029030 con 0x55f9126f1590 2024-09-19T06:20:56.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.904+0000 7f978be00640 1 -- 172.21.15.3:0/4120642142 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9784010830 con 0x55f9126f1590 2024-09-19T06:20:56.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.904+0000 7f978be00640 1 -- 172.21.15.3:0/4120642142 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9784005230 con 0x55f9126f1590 2024-09-19T06:20:56.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.904+0000 7f97a55ef740 1 -- 172.21.15.3:0/4120642142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f9126f1590 msgr2=0x55f9126fac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:56.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.904+0000 7f97a55ef740 1 --2- 172.21.15.3:0/4120642142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f9126f1590 0x55f9126fac60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9784010580 tx=0x7f97840096c0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.905+0000 7f97a55ef740 1 -- 172.21.15.3:0/4120642142 shutdown_connections 2024-09-19T06:20:56.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.905+0000 7f97a55ef740 1 --2- 172.21.15.3:0/4120642142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126fbe50 0x55f912713c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.905+0000 7f97a55ef740 1 --2- 172.21.15.3:0/4120642142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f9126f1590 0x55f9126fac60 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.905+0000 7f97a55ef740 1 --2- 172.21.15.3:0/4120642142 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9126f0c70 0x55f9126f36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.905+0000 7f97a55ef740 1 -- 172.21.15.3:0/4120642142 >> 172.21.15.3:0/4120642142 conn(0x55f9126ed200 msgr2=0x55f9126fa550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:56.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.905+0000 7f97a55ef740 1 -- 172.21.15.3:0/4120642142 shutdown_connections 2024-09-19T06:20:56.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.905+0000 7f97a55ef740 1 -- 172.21.15.3:0/4120642142 wait complete. 2024-09-19T06:20:56.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.905+0000 7f97a55ef740 1 -- start start 2024-09-19T06:20:56.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.905+0000 7f97a55ef740 1 Processor -- start 2024-09-19T06:20:56.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.906+0000 7f97a55ef740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126f0c70 0x55f9126ff530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.906+0000 7f97a55ef740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f9126f1590 0x55f9126ffa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.906+0000 7f97a55ef740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9126fbe50 0x55f91276ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.906+0000 7f97a55ef740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f979c1b1050 con 0x55f9126f1590 2024-09-19T06:20:56.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.906+0000 7f97a55ef740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f979c1b0980 con 0x55f9126f0c70 2024-09-19T06:20:56.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.906+0000 7f97a55ef740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f979c1adbe0 con 0x55f9126fbe50 2024-09-19T06:20:56.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.906+0000 7f97a55ef740 10 client.0 _ll_register_callbacks cb 0x7f9784009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:56.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.906+0000 7f9793400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f9126f1590 0x55f9126ffa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.906+0000 7f97a0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126f0c70 0x55f9126ff530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.906+0000 7f97a0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126f0c70 0x55f9126ff530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:50718/0 (socket says 172.21.15.3:50718) 2024-09-19T06:20:56.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.906+0000 7f97a0a00640 1 -- 172.21.15.3:0/95956693 learned_addr learned my addr 172.21.15.3:0/95956693 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:56.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.906+0000 7f9793400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f9126f1590 0x55f9126ffa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54834/0 (socket says 172.21.15.3:54834) 2024-09-19T06:20:56.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.906+0000 7f97a0a00640 1 --2- 172.21.15.3:0/95956693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9126fbe50 0x55f91276ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.907+0000 7f9793400640 1 -- 172.21.15.3:0/95956693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9126fbe50 msgr2=0x55f91276ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:56.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.907+0000 7f9793400640 1 --2- 172.21.15.3:0/95956693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9126fbe50 0x55f91276ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.907+0000 7f9793400640 1 -- 172.21.15.3:0/95956693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126f0c70 msgr2=0x55f9126ff530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:56.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.907+0000 7f9793400640 1 --2- 172.21.15.3:0/95956693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126f0c70 0x55f9126ff530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.907+0000 7f9793400640 1 -- 172.21.15.3:0/95956693 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9126e8770 con 0x55f9126f1590 2024-09-19T06:20:56.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.907+0000 7f9793400640 1 --2- 172.21.15.3:0/95956693 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f9126f1590 0x55f9126ffa70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x55f9126deed0 tx=0x7f9784010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae407a4c5d3b3f8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:56.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.907+0000 7f9789600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:20:56.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.907+0000 7f9789600640 1 -- 172.21.15.3:0/95956693 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9784033060 con 0x55f9126f1590 2024-09-19T06:20:56.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.907+0000 7f97a55ef740 1 -- 172.21.15.3:0/95956693 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9784010830 con 0x55f9126f1590 2024-09-19T06:20:56.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.907+0000 7f9789600640 1 -- 172.21.15.3:0/95956693 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f97840051b0 con 0x55f9126f1590 2024-09-19T06:20:56.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.908+0000 7f9789600640 1 -- 172.21.15.3:0/95956693 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9784029040 con 0x55f9126f1590 2024-09-19T06:20:56.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.908+0000 7f97a55ef740 10 client.17727 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:56.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.908+0000 7f97a55ef740 1 -- 172.21.15.3:0/95956693 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f912776430 con 0x55f9126f1590 2024-09-19T06:20:56.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.908+0000 7f9789600640 1 -- 172.21.15.3:0/95956693 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9784010830 con 0x55f9126f1590 2024-09-19T06:20:56.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.908+0000 7f9789600640 1 -- 172.21.15.3:0/95956693 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9784023040 con 0x55f9126f1590 2024-09-19T06:20:56.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.908+0000 7f97a55ef740 10 client.17727 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:56.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.908+0000 7f97a55ef740 10 client.17727 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:20:56.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.908+0000 7f97a55ef740 20 client.17727 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:56.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.908+0000 7f97a55ef740 1 --2- 172.21.15.3:0/95956693 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55f912776a30 0x55f912778e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:56.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.908+0000 7f97a55ef740 4 client.17727 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:56.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.908+0000 7f97a55ef740 1 -- 172.21.15.3:0/95956693 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f91265ee60 con 0x55f912776a30 2024-09-19T06:20:56.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.909+0000 7f97a0a00640 1 --2- 172.21.15.3:0/95956693 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55f912776a30 0x55f912778e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:56.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.909+0000 7f97a0a00640 1 --2- 172.21.15.3:0/95956693 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55f912776a30 0x55f912778e50 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=27e72100ceb377df server_cookie=70a77b44447f6b1a in_seq=0 out_seq=0 2024-09-19T06:20:56.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.909+0000 7f9789600640 10 client.17727 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:20:56.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.909+0000 7f9789600640 1 -- 172.21.15.3:0/95956693 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f91265ee60 con 0x55f912776a30 2024-09-19T06:20:56.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.909+0000 7f9789600640 10 client.17727 handle_command_reply: tid=0 2024-09-19T06:20:56.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.909+0000 7f97a55ef740 1 client.17727 shutdown 2024-09-19T06:20:56.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.910+0000 7f97a55ef740 1 -- 172.21.15.3:0/95956693 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f9126f1590 msgr2=0x55f9126ffa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:56.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.910+0000 7f97a55ef740 1 --2- 172.21.15.3:0/95956693 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f9126f1590 0x55f9126ffa70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x55f9126deed0 tx=0x7f9784010e80 comp rx=0 tx=0).stop 2024-09-19T06:20:56.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.910+0000 7f97a55ef740 1 -- 172.21.15.3:0/95956693 shutdown_connections 2024-09-19T06:20:56.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.910+0000 7f97a55ef740 1 --2- 172.21.15.3:0/95956693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f9126fbe50 0x55f91276ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.910+0000 7f97a55ef740 1 --2- 172.21.15.3:0/95956693 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55f912776a30 0x55f912778e50 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.910+0000 7f97a55ef740 1 --2- 172.21.15.3:0/95956693 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f9126f1590 0x55f9126ffa70 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.910+0000 7f97a55ef740 1 --2- 172.21.15.3:0/95956693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f9126f0c70 0x55f9126ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.910+0000 7f97a55ef740 1 -- 172.21.15.3:0/95956693 >> 172.21.15.3:0/95956693 conn(0x55f9126ed200 msgr2=0x55f9126fad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:56.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.910+0000 7f9789600640 0 client.17727 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:20:56.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.910+0000 7f97a55ef740 1 -- 172.21.15.3:0/95956693 shutdown_connections 2024-09-19T06:20:56.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.910+0000 7f97a55ef740 1 -- 172.21.15.3:0/95956693 wait complete. 2024-09-19T06:20:56.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.910+0000 7f97a55ef740 20 client.17727 trim_cache size 0 max 16384 2024-09-19T06:20:56.914 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:20:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.911+0000 7f97a2a00640 1 -- 172.21.15.3:0/3467050791 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f97800a3430 msgr2=0x7f97800a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.911+0000 7f97a2a00640 1 --2- 172.21.15.3:0/3467050791 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f97800a3430 0x7f97800a58f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f978c0eda40 tx=0x7f978c0f3dc0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.911+0000 7f97a2a00640 1 -- 172.21.15.3:0/3467050791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f979c0745c0 msgr2=0x7f979c19a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.911+0000 7f97a2a00640 1 --2- 172.21.15.3:0/3467050791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f979c0745c0 0x7f979c19a6f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f978c004770 tx=0x7f978c003c10 comp rx=0 tx=0).stop 2024-09-19T06:20:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.911+0000 7f97a2a00640 1 -- 172.21.15.3:0/3467050791 shutdown_connections 2024-09-19T06:20:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.911+0000 7f97a2a00640 1 --2- 172.21.15.3:0/3467050791 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f97800a3430 0x7f97800a58f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.911+0000 7f97a2a00640 1 --2- 172.21.15.3:0/3467050791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f979c10e430 0x7f979c19efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.911+0000 7f97a2a00640 1 --2- 172.21.15.3:0/3467050791 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f979c074ee0 0x7f979c19ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.911+0000 7f97a2a00640 1 --2- 172.21.15.3:0/3467050791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f979c0745c0 0x7f979c19a6f0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:56.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.911+0000 7f97a2a00640 1 -- 172.21.15.3:0/3467050791 >> 172.21.15.3:0/3467050791 conn(0x7f979c0fd8b0 msgr2=0x7f979c0fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:56.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.911+0000 7f97a2a00640 1 -- 172.21.15.3:0/3467050791 shutdown_connections 2024-09-19T06:20:56.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:56.911+0000 7f97a2a00640 1 -- 172.21.15.3:0/3467050791 wait complete. 2024-09-19T06:20:57.821 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:20:58.201 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:20:58.392 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:20:58 smithi003 ceph-mon[30893]: pgmap v264: 97 pgs: 97 active+clean; 3.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 16 op/s 2024-09-19T06:20:58.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:20:58 smithi059 ceph-mon[35138]: pgmap v264: 97 pgs: 97 active+clean; 3.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 16 op/s 2024-09-19T06:20:58.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:20:58 smithi071 ceph-mon[35662]: pgmap v264: 97 pgs: 97 active+clean; 3.7 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 16 op/s 2024-09-19T06:20:58.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.801+0000 7fe60be00640 1 -- 172.21.15.3:0/617562247 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe60c103e30 msgr2=0x7fe60c104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:58.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.801+0000 7fe60be00640 1 --2- 172.21.15.3:0/617562247 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe60c103e30 0x7fe60c104210 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009900 tx=0x7fe5fc02a410 comp rx=0 tx=0).stop 2024-09-19T06:20:58.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.801+0000 7fe60be00640 1 -- 172.21.15.3:0/617562247 shutdown_connections 2024-09-19T06:20:58.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.801+0000 7fe60be00640 1 --2- 172.21.15.3:0/617562247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe60c108f60 0x7fe60c110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.801+0000 7fe60be00640 1 --2- 172.21.15.3:0/617562247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe60c1047e0 0x7fe60c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.801+0000 7fe60be00640 1 --2- 172.21.15.3:0/617562247 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe60c103e30 0x7fe60c104210 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.801+0000 7fe60be00640 1 -- 172.21.15.3:0/617562247 >> 172.21.15.3:0/617562247 conn(0x7fe60c0ff910 msgr2=0x7fe60c101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:58.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.801+0000 7fe60be00640 1 -- 172.21.15.3:0/617562247 shutdown_connections 2024-09-19T06:20:58.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.801+0000 7fe60be00640 1 -- 172.21.15.3:0/617562247 wait complete. 2024-09-19T06:20:58.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.802+0000 7fe60be00640 1 Processor -- start 2024-09-19T06:20:58.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.802+0000 7fe60be00640 1 -- start start 2024-09-19T06:20:58.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.802+0000 7fe60be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe60c103e30 0x7fe60c19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.802+0000 7fe60be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe60c1047e0 0x7fe60c19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.802+0000 7fe60be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe60c108f60 0x7fe60c19ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.803+0000 7fe60be00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c114010 con 0x7fe60c103e30 2024-09-19T06:20:58.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.803+0000 7fe60be00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c113e90 con 0x7fe60c1047e0 2024-09-19T06:20:58.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.803+0000 7fe60be00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c114190 con 0x7fe60c108f60 2024-09-19T06:20:58.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.803+0000 7fe60aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe60c103e30 0x7fe60c19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.803+0000 7fe60aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe60c103e30 0x7fe60c19a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54854/0 (socket says 172.21.15.3:54854) 2024-09-19T06:20:58.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.803+0000 7fe60aa00640 1 -- 172.21.15.3:0/2380943153 learned_addr learned my addr 172.21.15.3:0/2380943153 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:58.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.803+0000 7fe603e00640 1 --2- 172.21.15.3:0/2380943153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe60c1047e0 0x7fe60c19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.803+0000 7fe60b400640 1 --2- 172.21.15.3:0/2380943153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe60c108f60 0x7fe60c19ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.803+0000 7fe60aa00640 1 -- 172.21.15.3:0/2380943153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe60c108f60 msgr2=0x7fe60c19ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:58.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.803+0000 7fe60aa00640 1 --2- 172.21.15.3:0/2380943153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe60c108f60 0x7fe60c19ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.803+0000 7fe60aa00640 1 -- 172.21.15.3:0/2380943153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe60c1047e0 msgr2=0x7fe60c19a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:58.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.803+0000 7fe60aa00640 1 --2- 172.21.15.3:0/2380943153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe60c1047e0 0x7fe60c19a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.803+0000 7fe60aa00640 1 -- 172.21.15.3:0/2380943153 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60c19f400 con 0x7fe60c103e30 2024-09-19T06:20:58.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.803+0000 7fe603e00640 1 --2- 172.21.15.3:0/2380943153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe60c1047e0 0x7fe60c19a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:58.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.804+0000 7fe60aa00640 1 --2- 172.21.15.3:0/2380943153 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe60c103e30 0x7fe60c19a450 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc004770 tx=0x7fe5fc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:58.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.804+0000 7fe603400640 1 -- 172.21.15.3:0/2380943153 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc03f070 con 0x7fe60c103e30 2024-09-19T06:20:58.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.804+0000 7fe603400640 1 -- 172.21.15.3:0/2380943153 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5fc031ca0 con 0x7fe60c103e30 2024-09-19T06:20:58.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.804+0000 7fe60be00640 1 -- 172.21.15.3:0/2380943153 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe60c19f690 con 0x7fe60c103e30 2024-09-19T06:20:58.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.804+0000 7fe603400640 1 -- 172.21.15.3:0/2380943153 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc035030 con 0x7fe60c103e30 2024-09-19T06:20:58.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.804+0000 7fe60be00640 1 -- 172.21.15.3:0/2380943153 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe60c1a6fd0 con 0x7fe60c103e30 2024-09-19T06:20:58.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.807+0000 7fe603400640 1 -- 172.21.15.3:0/2380943153 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fe5fc042070 con 0x7fe60c103e30 2024-09-19T06:20:58.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.807+0000 7fe614091740 1 Processor -- start 2024-09-19T06:20:58.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.807+0000 7fe614091740 1 -- start start 2024-09-19T06:20:58.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.808+0000 7fe614091740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558aa5629e40 0x558aa562a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.808+0000 7fe614091740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558aa562a760 0x558aa5634ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.808+0000 7fe614091740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558aa5635020 0x558aa5637410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.808+0000 7fe614091740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558aa55903e0 con 0x558aa5629e40 2024-09-19T06:20:58.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.808+0000 7fe614091740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558aa5537d80 con 0x558aa562a760 2024-09-19T06:20:58.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.808+0000 7fe614091740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558aa558c3a0 con 0x558aa5635020 2024-09-19T06:20:58.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.808+0000 7fe60b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558aa5629e40 0x558aa562a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.808+0000 7fe60b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558aa5629e40 0x558aa562a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54864/0 (socket says 172.21.15.3:54864) 2024-09-19T06:20:58.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.808+0000 7fe60b400640 1 -- 172.21.15.3:0/3001443585 learned_addr learned my addr 172.21.15.3:0/3001443585 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:58.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.808+0000 7fe60aa00640 1 --2- 172.21.15.3:0/3001443585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558aa562a760 0x558aa5634ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.808+0000 7fe603e00640 1 --2- 172.21.15.3:0/3001443585 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558aa5635020 0x558aa5637410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.809+0000 7fe60b400640 1 -- 172.21.15.3:0/3001443585 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558aa5635020 msgr2=0x558aa5637410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:58.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.809+0000 7fe60b400640 1 --2- 172.21.15.3:0/3001443585 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558aa5635020 0x558aa5637410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.809+0000 7fe60b400640 1 -- 172.21.15.3:0/3001443585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558aa562a760 msgr2=0x558aa5634ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:58.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.809+0000 7fe60b400640 1 --2- 172.21.15.3:0/3001443585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558aa562a760 0x558aa5634ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.809+0000 7fe60b400640 1 -- 172.21.15.3:0/3001443585 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558aa5556ae0 con 0x558aa5629e40 2024-09-19T06:20:58.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.809+0000 7fe603e00640 1 --2- 172.21.15.3:0/3001443585 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558aa5635020 0x558aa5637410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:20:58.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.809+0000 7fe603400640 1 --2- 172.21.15.3:0/2380943153 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe5f00a3430 0x7fe5f00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.809+0000 7fe60b400640 1 --2- 172.21.15.3:0/3001443585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558aa5629e40 0x558aa562a220 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fe604009f50 tx=0x7fe6040118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2352aa67834efbd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:58.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.809+0000 7fe603400640 1 -- 172.21.15.3:0/2380943153 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7fe5fc0f02c0 con 0x7fe60c103e30 2024-09-19T06:20:58.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.810+0000 7fe60aa00640 1 --2- 172.21.15.3:0/2380943153 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe5f00a3430 0x7fe5f00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.810+0000 7fe5fb400640 1 -- 172.21.15.3:0/3001443585 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe604004d20 con 0x558aa5629e40 2024-09-19T06:20:58.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.810+0000 7fe5fb400640 1 -- 172.21.15.3:0/3001443585 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe604004050 con 0x558aa5629e40 2024-09-19T06:20:58.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.810+0000 7fe5fb400640 1 -- 172.21.15.3:0/3001443585 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe604005280 con 0x558aa5629e40 2024-09-19T06:20:58.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.810+0000 7fe614091740 1 -- 172.21.15.3:0/3001443585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558aa5629e40 msgr2=0x558aa562a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:58.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.810+0000 7fe60aa00640 1 --2- 172.21.15.3:0/2380943153 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe5f00a3430 0x7fe5f00a58f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x558aa5627230 tx=0x7fe5fc0f3d70 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:58.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.810+0000 7fe614091740 1 --2- 172.21.15.3:0/3001443585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558aa5629e40 0x558aa562a220 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fe604009f50 tx=0x7fe6040118d0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.810+0000 7fe614091740 1 -- 172.21.15.3:0/3001443585 shutdown_connections 2024-09-19T06:20:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.810+0000 7fe614091740 1 --2- 172.21.15.3:0/3001443585 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558aa5635020 0x558aa5637410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.810+0000 7fe614091740 1 --2- 172.21.15.3:0/3001443585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558aa562a760 0x558aa5634ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.810+0000 7fe614091740 1 --2- 172.21.15.3:0/3001443585 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558aa5629e40 0x558aa562a220 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.811+0000 7fe614091740 1 -- 172.21.15.3:0/3001443585 >> 172.21.15.3:0/3001443585 conn(0x558aa56263d0 msgr2=0x558aa56267b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.811+0000 7fe614091740 1 -- 172.21.15.3:0/3001443585 shutdown_connections 2024-09-19T06:20:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.811+0000 7fe614091740 1 -- 172.21.15.3:0/3001443585 wait complete. 2024-09-19T06:20:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.811+0000 7fe614091740 1 -- start start 2024-09-19T06:20:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.811+0000 7fe614091740 1 Processor -- start 2024-09-19T06:20:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.812+0000 7fe614091740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558aa5629e40 0x558aa5631f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.812+0000 7fe614091740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558aa562a760 0x558aa5632460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.812+0000 7fe614091740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558aa5635020 0x558aa56329a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.812+0000 7fe614091740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x558aa5637bf0 con 0x558aa5629e40 2024-09-19T06:20:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.812+0000 7fe614091740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x558aa554b0f0 con 0x558aa5635020 2024-09-19T06:20:58.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.812+0000 7fe614091740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x558aa5637d70 con 0x558aa562a760 2024-09-19T06:20:58.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.812+0000 7fe614091740 10 client.0 _ll_register_callbacks cb 0x558aa5532bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:58.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.812+0000 7fe60b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558aa5629e40 0x558aa5631f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.812+0000 7fe60b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558aa5629e40 0x558aa5631f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54868/0 (socket says 172.21.15.3:54868) 2024-09-19T06:20:58.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.812+0000 7fe60b400640 1 -- 172.21.15.3:0/3351166847 learned_addr learned my addr 172.21.15.3:0/3351166847 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:58.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.812+0000 7fe603e00640 1 --2- 172.21.15.3:0/3351166847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558aa562a760 0x558aa5632460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.812+0000 7fe60b400640 1 --2- 172.21.15.3:0/3351166847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558aa5635020 0x558aa56329a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.813+0000 7fe603e00640 1 -- 172.21.15.3:0/3351166847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558aa5635020 msgr2=0x558aa56329a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:58.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.813+0000 7fe603e00640 1 --2- 172.21.15.3:0/3351166847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558aa5635020 0x558aa56329a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.813+0000 7fe603e00640 1 -- 172.21.15.3:0/3351166847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558aa5629e40 msgr2=0x558aa5631f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:58.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.813+0000 7fe603e00640 1 --2- 172.21.15.3:0/3351166847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558aa5629e40 0x558aa5631f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.813+0000 7fe603e00640 1 -- 172.21.15.3:0/3351166847 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558aa53013c0 con 0x558aa562a760 2024-09-19T06:20:58.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.813+0000 7fe60b400640 1 --2- 172.21.15.3:0/3351166847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558aa5629e40 0x558aa5631f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:20:58.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.813+0000 7fe603e00640 1 --2- 172.21.15.3:0/3351166847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558aa562a760 0x558aa5632460 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe5f40129e0 tx=0x7fe5f4012ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3aad080e81247f2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:58.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.813+0000 7fe5efe00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:20:58.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.813+0000 7fe5efe00640 1 -- 172.21.15.3:0/3351166847 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f400fa10 con 0x558aa562a760 2024-09-19T06:20:58.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.813+0000 7fe614091740 1 -- 172.21.15.3:0/3351166847 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe604004050 con 0x558aa562a760 2024-09-19T06:20:58.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.814+0000 7fe5efe00640 1 -- 172.21.15.3:0/3351166847 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7fe5f400fbb0 con 0x558aa562a760 2024-09-19T06:20:58.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.814+0000 7fe5efe00640 1 -- 172.21.15.3:0/3351166847 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe5f400fdb0 con 0x558aa562a760 2024-09-19T06:20:58.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.814+0000 7fe614091740 10 client.27757 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:58.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.814+0000 7fe614091740 1 -- 172.21.15.3:0/3351166847 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558aa5643cf0 con 0x558aa562a760 2024-09-19T06:20:58.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.814+0000 7fe5efe00640 1 -- 172.21.15.3:0/3351166847 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe604004050 con 0x558aa562a760 2024-09-19T06:20:58.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.814+0000 7fe5efe00640 1 -- 172.21.15.3:0/3351166847 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe5f401c470 con 0x558aa562a760 2024-09-19T06:20:58.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.814+0000 7fe614091740 10 client.27757 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:58.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.814+0000 7fe614091740 10 client.27757 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:20:58.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.814+0000 7fe614091740 20 client.27757 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:58.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.814+0000 7fe614091740 1 --2- 172.21.15.3:0/3351166847 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x558aa5645100 0x558aa56474f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.815+0000 7fe614091740 4 client.27757 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:58.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.815+0000 7fe614091740 1 -- 172.21.15.3:0/3351166847 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558aa559d950 con 0x558aa5645100 2024-09-19T06:20:58.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.815+0000 7fe60b400640 1 --2- 172.21.15.3:0/3351166847 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x558aa5645100 0x558aa56474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.816+0000 7fe60b400640 1 --2- 172.21.15.3:0/3351166847 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x558aa5645100 0x558aa56474f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=efeb4413bddb705e server_cookie=f24ebaa9d44abdd3 in_seq=0 out_seq=0 2024-09-19T06:20:58.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.816+0000 7fe5efe00640 10 client.27757 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:20:58.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.816+0000 7fe5efe00640 1 -- 172.21.15.3:0/3351166847 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558aa559d950 con 0x558aa5645100 2024-09-19T06:20:58.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.816+0000 7fe5efe00640 10 client.27757 handle_command_reply: tid=0 2024-09-19T06:20:58.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.816+0000 7fe614091740 1 client.27757 shutdown 2024-09-19T06:20:58.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.817+0000 7fe614091740 1 -- 172.21.15.3:0/3351166847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558aa562a760 msgr2=0x558aa5632460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:58.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.817+0000 7fe614091740 1 --2- 172.21.15.3:0/3351166847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558aa562a760 0x558aa5632460 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe5f40129e0 tx=0x7fe5f4012ea0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.817+0000 7fe614091740 1 -- 172.21.15.3:0/3351166847 shutdown_connections 2024-09-19T06:20:58.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.817+0000 7fe614091740 1 --2- 172.21.15.3:0/3351166847 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x558aa5645100 0x558aa56474f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.817+0000 7fe614091740 1 --2- 172.21.15.3:0/3351166847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558aa5635020 0x558aa56329a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.817+0000 7fe614091740 1 --2- 172.21.15.3:0/3351166847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558aa562a760 0x558aa5632460 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.817+0000 7fe614091740 1 --2- 172.21.15.3:0/3351166847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558aa5629e40 0x558aa5631f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.817+0000 7fe5efe00640 0 client.27757 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:20:58.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.817+0000 7fe614091740 1 -- 172.21.15.3:0/3351166847 >> 172.21.15.3:0/3351166847 conn(0x558aa56263d0 msgr2=0x558aa562c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:58.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.817+0000 7fe614091740 1 -- 172.21.15.3:0/3351166847 shutdown_connections 2024-09-19T06:20:58.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.817+0000 7fe614091740 1 -- 172.21.15.3:0/3351166847 wait complete. 2024-09-19T06:20:58.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.817+0000 7fe614091740 20 client.27757 trim_cache size 0 max 16384 2024-09-19T06:20:58.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.831+0000 7fe614091740 1 Processor -- start 2024-09-19T06:20:58.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.831+0000 7fe614091740 1 -- start start 2024-09-19T06:20:58.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.831+0000 7fe614091740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558aa5629e40 0x558aa562c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.831+0000 7fe614091740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558aa562a760 0x558aa56253a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.832 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.831+0000 7fe614091740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558aa5635020 0x558aa564ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.831+0000 7fe614091740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c1af960 con 0x558aa5635020 2024-09-19T06:20:58.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.831+0000 7fe614091740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c1b14a0 con 0x558aa562a760 2024-09-19T06:20:58.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.831+0000 7fe614091740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c1b0030 con 0x558aa5629e40 2024-09-19T06:20:58.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.832+0000 7fe603e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558aa562a760 0x558aa56253a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.832+0000 7fe603e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558aa562a760 0x558aa56253a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:50766/0 (socket says 172.21.15.3:50766) 2024-09-19T06:20:58.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.832+0000 7fe603e00640 1 -- 172.21.15.3:0/4010450126 learned_addr learned my addr 172.21.15.3:0/4010450126 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:58.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.832+0000 7fe60b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558aa5635020 0x558aa564ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.832+0000 7fe60b400640 1 --2- 172.21.15.3:0/4010450126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558aa5629e40 0x558aa562c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.832+0000 7fe603e00640 1 -- 172.21.15.3:0/4010450126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558aa5629e40 msgr2=0x558aa562c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:58.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.832+0000 7fe603e00640 1 --2- 172.21.15.3:0/4010450126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558aa5629e40 0x558aa562c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.832+0000 7fe603e00640 1 -- 172.21.15.3:0/4010450126 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558aa5635020 msgr2=0x558aa564ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:58.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.832+0000 7fe603e00640 1 --2- 172.21.15.3:0/4010450126 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558aa5635020 0x558aa564ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.832+0000 7fe603e00640 1 -- 172.21.15.3:0/4010450126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558aa5629c70 con 0x558aa562a760 2024-09-19T06:20:58.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.832+0000 7fe603e00640 1 --2- 172.21.15.3:0/4010450126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558aa562a760 0x558aa56253a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe5f401c840 tx=0x7fe5f401c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f417d450c09284e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:58.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.833+0000 7fe5faa00640 1 -- 172.21.15.3:0/4010450126 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f400fa10 con 0x558aa562a760 2024-09-19T06:20:58.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.833+0000 7fe5faa00640 1 -- 172.21.15.3:0/4010450126 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5f400fbb0 con 0x558aa562a760 2024-09-19T06:20:58.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.833+0000 7fe5faa00640 1 -- 172.21.15.3:0/4010450126 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f40055c0 con 0x558aa562a760 2024-09-19T06:20:58.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.833+0000 7fe614091740 1 -- 172.21.15.3:0/4010450126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558aa562a760 msgr2=0x558aa56253a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:58.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.833+0000 7fe614091740 1 --2- 172.21.15.3:0/4010450126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558aa562a760 0x558aa56253a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe5f401c840 tx=0x7fe5f401c730 comp rx=0 tx=0).stop 2024-09-19T06:20:58.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.833+0000 7fe614091740 1 -- 172.21.15.3:0/4010450126 shutdown_connections 2024-09-19T06:20:58.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.833+0000 7fe614091740 1 --2- 172.21.15.3:0/4010450126 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558aa5635020 0x558aa564ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.833+0000 7fe614091740 1 --2- 172.21.15.3:0/4010450126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558aa562a760 0x558aa56253a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.833+0000 7fe614091740 1 --2- 172.21.15.3:0/4010450126 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558aa5629e40 0x558aa562c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.833+0000 7fe614091740 1 -- 172.21.15.3:0/4010450126 >> 172.21.15.3:0/4010450126 conn(0x558aa56263d0 msgr2=0x558aa5624c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:58.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.833+0000 7fe614091740 1 -- 172.21.15.3:0/4010450126 shutdown_connections 2024-09-19T06:20:58.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.833+0000 7fe614091740 1 -- 172.21.15.3:0/4010450126 wait complete. 2024-09-19T06:20:58.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.834+0000 7fe614091740 1 -- start start 2024-09-19T06:20:58.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.834+0000 7fe614091740 1 Processor -- start 2024-09-19T06:20:58.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.834+0000 7fe614091740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558aa5629e40 0x558aa5639450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.834+0000 7fe614091740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558aa562a760 0x558aa5639990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.834+0000 7fe614091740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558aa5635020 0x558aa56aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.834+0000 7fe614091740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c1b0dd0 con 0x558aa5635020 2024-09-19T06:20:58.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.834+0000 7fe614091740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c1b0700 con 0x558aa562a760 2024-09-19T06:20:58.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.834+0000 7fe614091740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c1ad960 con 0x558aa5629e40 2024-09-19T06:20:58.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.835+0000 7fe614091740 10 client.0 _ll_register_callbacks cb 0x7fe5f4009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:58.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.835+0000 7fe603e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558aa562a760 0x558aa5639990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.835+0000 7fe603e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558aa562a760 0x558aa5639990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:50772/0 (socket says 172.21.15.3:50772) 2024-09-19T06:20:58.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.835+0000 7fe60b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558aa5629e40 0x558aa5639450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.835+0000 7fe603e00640 1 -- 172.21.15.3:0/2179908753 learned_addr learned my addr 172.21.15.3:0/2179908753 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:58.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.835+0000 7fe60b400640 1 --2- 172.21.15.3:0/2179908753 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558aa5635020 0x558aa56aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.835+0000 7fe603e00640 1 -- 172.21.15.3:0/2179908753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558aa5629e40 msgr2=0x558aa5639450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:58.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.835+0000 7fe603e00640 1 --2- 172.21.15.3:0/2179908753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558aa5629e40 0x558aa5639450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.835+0000 7fe603e00640 1 -- 172.21.15.3:0/2179908753 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558aa5635020 msgr2=0x558aa56aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:58.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.835+0000 7fe603e00640 1 --2- 172.21.15.3:0/2179908753 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558aa5635020 0x558aa56aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.835+0000 7fe603e00640 1 -- 172.21.15.3:0/2179908753 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558aa56af310 con 0x558aa562a760 2024-09-19T06:20:58.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.835+0000 7fe603e00640 1 --2- 172.21.15.3:0/2179908753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558aa562a760 0x558aa5639990 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe5f401c840 tx=0x7fe5f4005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e537a92dbdbfe6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:58.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.835+0000 7fe5efe00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:20:58.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.836+0000 7fe5efe00640 1 -- 172.21.15.3:0/2179908753 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4032060 con 0x558aa562a760 2024-09-19T06:20:58.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.836+0000 7fe614091740 1 -- 172.21.15.3:0/2179908753 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5f400fbb0 con 0x558aa562a760 2024-09-19T06:20:58.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.836+0000 7fe5efe00640 1 -- 172.21.15.3:0/2179908753 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7fe5f4018040 con 0x558aa562a760 2024-09-19T06:20:58.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.836+0000 7fe5efe00640 1 -- 172.21.15.3:0/2179908753 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe5f400fa10 con 0x558aa562a760 2024-09-19T06:20:58.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.836+0000 7fe614091740 10 client.27782 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:58.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.836+0000 7fe614091740 1 -- 172.21.15.3:0/2179908753 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558aa56b0610 con 0x558aa562a760 2024-09-19T06:20:58.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.836+0000 7fe5efe00640 1 -- 172.21.15.3:0/2179908753 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5f400fbb0 con 0x558aa562a760 2024-09-19T06:20:58.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.837+0000 7fe5efe00640 1 -- 172.21.15.3:0/2179908753 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe5f4003890 con 0x558aa562a760 2024-09-19T06:20:58.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.837+0000 7fe614091740 10 client.27782 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:58.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.837+0000 7fe614091740 10 client.27782 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:20:58.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.837+0000 7fe614091740 20 client.27782 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:58.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.837+0000 7fe614091740 1 --2- 172.21.15.3:0/2179908753 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x558aa56b0cd0 0x558aa56b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:58.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.837+0000 7fe614091740 4 client.27782 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:20:58.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.837+0000 7fe614091740 1 -- 172.21.15.3:0/2179908753 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558aa5597e60 con 0x558aa56b0cd0 2024-09-19T06:20:58.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.837+0000 7fe60b400640 1 --2- 172.21.15.3:0/2179908753 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x558aa56b0cd0 0x558aa56b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:58.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.837+0000 7fe60b400640 1 --2- 172.21.15.3:0/2179908753 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x558aa56b0cd0 0x558aa56b30f0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d4fa2fdf96d4a00e server_cookie=44b56889b0efe152 in_seq=0 out_seq=0 2024-09-19T06:20:58.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.837+0000 7fe5efe00640 10 client.27782 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:20:58.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.838+0000 7fe5efe00640 1 -- 172.21.15.3:0/2179908753 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558aa5597e60 con 0x558aa56b0cd0 2024-09-19T06:20:58.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.838+0000 7fe5efe00640 10 client.27782 handle_command_reply: tid=0 2024-09-19T06:20:58.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.838+0000 7fe614091740 1 client.27782 shutdown 2024-09-19T06:20:58.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.838+0000 7fe614091740 1 -- 172.21.15.3:0/2179908753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558aa562a760 msgr2=0x558aa5639990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:58.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.838+0000 7fe614091740 1 --2- 172.21.15.3:0/2179908753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558aa562a760 0x558aa5639990 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe5f401c840 tx=0x7fe5f4005270 comp rx=0 tx=0).stop 2024-09-19T06:20:58.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.838+0000 7fe614091740 1 -- 172.21.15.3:0/2179908753 shutdown_connections 2024-09-19T06:20:58.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.838+0000 7fe614091740 1 --2- 172.21.15.3:0/2179908753 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x558aa56b0cd0 0x558aa56b30f0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.838+0000 7fe614091740 1 --2- 172.21.15.3:0/2179908753 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x558aa5635020 0x558aa56aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.838+0000 7fe614091740 1 --2- 172.21.15.3:0/2179908753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558aa562a760 0x558aa5639990 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.838+0000 7fe614091740 1 --2- 172.21.15.3:0/2179908753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x558aa5629e40 0x558aa5639450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.838+0000 7fe5efe00640 0 client.27782 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:20:58.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.838+0000 7fe614091740 1 -- 172.21.15.3:0/2179908753 >> 172.21.15.3:0/2179908753 conn(0x558aa56263d0 msgr2=0x558aa5624c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:58.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.838+0000 7fe614091740 1 -- 172.21.15.3:0/2179908753 shutdown_connections 2024-09-19T06:20:58.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.838+0000 7fe614091740 1 -- 172.21.15.3:0/2179908753 wait complete. 2024-09-19T06:20:58.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.838+0000 7fe614091740 20 client.27782 trim_cache size 0 max 16384 2024-09-19T06:20:58.842 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:20:58.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.839+0000 7fe60be00640 1 -- 172.21.15.3:0/2380943153 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe5f00a3430 msgr2=0x7fe5f00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:58.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.839+0000 7fe60be00640 1 --2- 172.21.15.3:0/2380943153 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe5f00a3430 0x7fe5f00a58f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x558aa5627230 tx=0x7fe5fc0f3d70 comp rx=0 tx=0).stop 2024-09-19T06:20:58.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.839+0000 7fe60be00640 1 -- 172.21.15.3:0/2380943153 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe60c103e30 msgr2=0x7fe60c19a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:58.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.839+0000 7fe60be00640 1 --2- 172.21.15.3:0/2380943153 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe60c103e30 0x7fe60c19a450 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc004770 tx=0x7fe5fc003c10 comp rx=0 tx=0).stop 2024-09-19T06:20:58.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.839+0000 7fe60be00640 1 -- 172.21.15.3:0/2380943153 shutdown_connections 2024-09-19T06:20:58.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.839+0000 7fe60be00640 1 --2- 172.21.15.3:0/2380943153 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe5f00a3430 0x7fe5f00a58f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.839+0000 7fe60be00640 1 --2- 172.21.15.3:0/2380943153 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe60c108f60 0x7fe60c19ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.839+0000 7fe60be00640 1 --2- 172.21.15.3:0/2380943153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe60c1047e0 0x7fe60c19a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.839+0000 7fe60be00640 1 --2- 172.21.15.3:0/2380943153 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe60c103e30 0x7fe60c19a450 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:58.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.839+0000 7fe60be00640 1 -- 172.21.15.3:0/2380943153 >> 172.21.15.3:0/2380943153 conn(0x7fe60c0ff910 msgr2=0x7fe60c100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:58.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.839+0000 7fe60be00640 1 -- 172.21.15.3:0/2380943153 shutdown_connections 2024-09-19T06:20:58.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:20:58.839+0000 7fe60be00640 1 -- 172.21.15.3:0/2380943153 wait complete. 2024-09-19T06:20:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.487+0000 7ff79d800640 1 -- 172.21.15.3:0/2493255871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff798109090 msgr2=0x7ff798110be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.487+0000 7ff79d800640 1 --2- 172.21.15.3:0/2493255871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff798109090 0x7ff798110be0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7ff790009ca0 tx=0x7ff79002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.487+0000 7ff79d800640 1 -- 172.21.15.3:0/2493255871 shutdown_connections 2024-09-19T06:20:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.487+0000 7ff79d800640 1 --2- 172.21.15.3:0/2493255871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff798109090 0x7ff798110be0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.487+0000 7ff79d800640 1 --2- 172.21.15.3:0/2493255871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7981048f0 0x7ff798108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.487+0000 7ff79d800640 1 --2- 172.21.15.3:0/2493255871 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff798103f40 0x7ff798104320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.487+0000 7ff79d800640 1 -- 172.21.15.3:0/2493255871 >> 172.21.15.3:0/2493255871 conn(0x7ff7980ff970 msgr2=0x7ff798101d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.488+0000 7ff79d800640 1 -- 172.21.15.3:0/2493255871 shutdown_connections 2024-09-19T06:20:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.488+0000 7ff79d800640 1 -- 172.21.15.3:0/2493255871 wait complete. 2024-09-19T06:20:59.491 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.488+0000 7ff79d800640 1 Processor -- start 2024-09-19T06:20:59.491 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.489+0000 7ff79d800640 1 -- start start 2024-09-19T06:20:59.491 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.489+0000 7ff79d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff798103f40 0x7ff79819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.489+0000 7ff79d800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff798109090 0x7ff79819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.489+0000 7ff79d800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff79819ee60 0x7ff79819f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.489+0000 7ff79d800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff798114110 con 0x7ff798109090 2024-09-19T06:20:59.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.489+0000 7ff79d800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff798113f90 con 0x7ff798103f40 2024-09-19T06:20:59.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.489+0000 7ff79d800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff798114290 con 0x7ff79819ee60 2024-09-19T06:20:59.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.489+0000 7ff796000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff798109090 0x7ff79819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.489+0000 7ff796a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff798103f40 0x7ff79819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.489+0000 7ff796a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff798103f40 0x7ff79819a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:50800/0 (socket says 172.21.15.3:50800) 2024-09-19T06:20:59.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.489+0000 7ff796000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff798109090 0x7ff79819aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54902/0 (socket says 172.21.15.3:54902) 2024-09-19T06:20:59.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.489+0000 7ff796a00640 1 -- 172.21.15.3:0/451836063 learned_addr learned my addr 172.21.15.3:0/451836063 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:59.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.489+0000 7ff797400640 1 --2- 172.21.15.3:0/451836063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff79819ee60 0x7ff79819f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.490+0000 7ff796000640 1 -- 172.21.15.3:0/451836063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff79819ee60 msgr2=0x7ff79819f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.490+0000 7ff796000640 1 --2- 172.21.15.3:0/451836063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff79819ee60 0x7ff79819f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.490+0000 7ff796000640 1 -- 172.21.15.3:0/451836063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff798103f40 msgr2=0x7ff79819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.490+0000 7ff796000640 1 --2- 172.21.15.3:0/451836063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff798103f40 0x7ff79819a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.490+0000 7ff796000640 1 -- 172.21.15.3:0/451836063 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff79819f950 con 0x7ff798109090 2024-09-19T06:20:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.490+0000 7ff796000640 1 --2- 172.21.15.3:0/451836063 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff798109090 0x7ff79819aae0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7ff78400e9c0 tx=0x7ff78400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.490+0000 7ff78f400640 1 -- 172.21.15.3:0/451836063 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78400ccc0 con 0x7ff798109090 2024-09-19T06:20:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.490+0000 7ff78f400640 1 -- 172.21.15.3:0/451836063 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff784010910 con 0x7ff798109090 2024-09-19T06:20:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.490+0000 7ff79d800640 1 -- 172.21.15.3:0/451836063 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff79819fc40 con 0x7ff798109090 2024-09-19T06:20:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.490+0000 7ff78f400640 1 -- 172.21.15.3:0/451836063 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7840188c0 con 0x7ff798109090 2024-09-19T06:20:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.491+0000 7ff79d800640 1 -- 172.21.15.3:0/451836063 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7981a7430 con 0x7ff798109090 2024-09-19T06:20:59.494 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.493+0000 7ff7a083e740 1 Processor -- start 2024-09-19T06:20:59.494 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.493+0000 7ff7a083e740 1 -- start start 2024-09-19T06:20:59.495 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.494+0000 7ff7a083e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608928381e0 0x5608928385c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.495 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.494+0000 7ff7a083e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560892838b00 0x560892842e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.495 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.494+0000 7ff7a083e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5608928433a0 0x560892845790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.495 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.494+0000 7ff7a083e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56089279e100 con 0x560892838b00 2024-09-19T06:20:59.496 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.494+0000 7ff7a083e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5608927461b0 con 0x5608928381e0 2024-09-19T06:20:59.496 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.494+0000 7ff7a083e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56089279a0c0 con 0x5608928433a0 2024-09-19T06:20:59.496 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.494+0000 7ff796a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560892838b00 0x560892842e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.496 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.494+0000 7ff796a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560892838b00 0x560892842e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54912/0 (socket says 172.21.15.3:54912) 2024-09-19T06:20:59.496 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.494+0000 7ff796a00640 1 -- 172.21.15.3:0/716758172 learned_addr learned my addr 172.21.15.3:0/716758172 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:59.496 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.494+0000 7ff78f400640 1 -- 172.21.15.3:0/451836063 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7ff784010ac0 con 0x7ff798109090 2024-09-19T06:20:59.496 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.494+0000 7ff797400640 1 --2- 172.21.15.3:0/716758172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608928381e0 0x5608928385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.496 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.494+0000 7ff796a00640 1 -- 172.21.15.3:0/716758172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5608928433a0 msgr2=0x560892845790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:59.496 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.494+0000 7ff796a00640 1 --2- 172.21.15.3:0/716758172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5608928433a0 0x560892845790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.496 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.494+0000 7ff796a00640 1 -- 172.21.15.3:0/716758172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608928381e0 msgr2=0x5608928385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:59.496 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.494+0000 7ff796a00640 1 --2- 172.21.15.3:0/716758172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608928381e0 0x5608928385c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.496 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.494+0000 7ff796a00640 1 -- 172.21.15.3:0/716758172 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608924b1210 con 0x560892838b00 2024-09-19T06:20:59.497 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.495+0000 7ff796a00640 1 --2- 172.21.15.3:0/716758172 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560892838b00 0x560892842e60 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7ff788009e10 tx=0x7ff788011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fca4b3db4fadc2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.495+0000 7ff783e00640 1 -- 172.21.15.3:0/716758172 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78801e070 con 0x560892838b00 2024-09-19T06:20:59.501 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.495+0000 7ff783e00640 1 -- 172.21.15.3:0/716758172 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff788019b10 con 0x560892838b00 2024-09-19T06:20:59.501 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.495+0000 7ff783e00640 1 -- 172.21.15.3:0/716758172 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78800fbf0 con 0x560892838b00 2024-09-19T06:20:59.501 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.495+0000 7ff78f400640 1 --2- 172.21.15.3:0/451836063 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff77c0a33b0 0x7ff77c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.501 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.496+0000 7ff78f400640 1 -- 172.21.15.3:0/451836063 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7ff7840d00a0 con 0x7ff798109090 2024-09-19T06:20:59.501 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.496+0000 7ff7a083e740 1 -- 172.21.15.3:0/716758172 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560892838b00 msgr2=0x560892842e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:59.501 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.496+0000 7ff7a083e740 1 --2- 172.21.15.3:0/716758172 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560892838b00 0x560892842e60 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7ff788009e10 tx=0x7ff788011810 comp rx=0 tx=0).stop 2024-09-19T06:20:59.501 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.496+0000 7ff797400640 1 --2- 172.21.15.3:0/451836063 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff77c0a33b0 0x7ff77c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.501 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.496+0000 7ff7a083e740 1 -- 172.21.15.3:0/716758172 shutdown_connections 2024-09-19T06:20:59.501 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.496+0000 7ff7a083e740 1 --2- 172.21.15.3:0/716758172 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5608928433a0 0x560892845790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.501 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.496+0000 7ff7a083e740 1 --2- 172.21.15.3:0/716758172 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560892838b00 0x560892842e60 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.501 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.496+0000 7ff7a083e740 1 --2- 172.21.15.3:0/716758172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608928381e0 0x5608928385c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.496+0000 7ff7a083e740 1 -- 172.21.15.3:0/716758172 >> 172.21.15.3:0/716758172 conn(0x560892834750 msgr2=0x560892834b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.496+0000 7ff7a083e740 1 -- 172.21.15.3:0/716758172 shutdown_connections 2024-09-19T06:20:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.496+0000 7ff7a083e740 1 -- 172.21.15.3:0/716758172 wait complete. 2024-09-19T06:20:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.497+0000 7ff797400640 1 --2- 172.21.15.3:0/451836063 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff77c0a33b0 0x7ff77c0a5870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff790006010 tx=0x7ff790005d80 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.497+0000 7ff7a083e740 1 -- start start 2024-09-19T06:20:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.497+0000 7ff7a083e740 1 Processor -- start 2024-09-19T06:20:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.497+0000 7ff7a083e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5608928381e0 0x5608928403e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.497+0000 7ff7a083e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560892838b00 0x560892840920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.497+0000 7ff7a083e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608928433a0 0x560892840e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.497+0000 7ff7a083e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560892845f70 con 0x560892838b00 2024-09-19T06:20:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.497+0000 7ff7a083e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560892727090 con 0x5608928433a0 2024-09-19T06:20:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.497+0000 7ff7a083e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5608928460f0 con 0x5608928381e0 2024-09-19T06:20:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.497+0000 7ff7a083e740 10 client.0 _ll_register_callbacks cb 0x56089277bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.498+0000 7ff796a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5608928381e0 0x5608928403e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.498+0000 7ff796a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5608928381e0 0x5608928403e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:49372/0 (socket says 172.21.15.3:49372) 2024-09-19T06:20:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.498+0000 7ff796a00640 1 -- 172.21.15.3:0/3580099753 learned_addr learned my addr 172.21.15.3:0/3580099753 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.498+0000 7ff796000640 1 --2- 172.21.15.3:0/3580099753 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560892838b00 0x560892840920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.498+0000 7ff797400640 1 --2- 172.21.15.3:0/3580099753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608928433a0 0x560892840e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.498+0000 7ff796a00640 1 -- 172.21.15.3:0/3580099753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608928433a0 msgr2=0x560892840e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.498+0000 7ff796a00640 1 --2- 172.21.15.3:0/3580099753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608928433a0 0x560892840e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.498+0000 7ff796a00640 1 -- 172.21.15.3:0/3580099753 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560892838b00 msgr2=0x560892840920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.498+0000 7ff796a00640 1 --2- 172.21.15.3:0/3580099753 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560892838b00 0x560892840920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.498+0000 7ff796a00640 1 -- 172.21.15.3:0/3580099753 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56089257d620 con 0x5608928381e0 2024-09-19T06:20:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.498+0000 7ff796a00640 1 --2- 172.21.15.3:0/3580099753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5608928381e0 0x5608928403e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff78801c040 tx=0x7ff788004250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a8af618081b30e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.498+0000 7ff780c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:20:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.499+0000 7ff780c00640 1 -- 172.21.15.3:0/3580099753 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78801e050 con 0x5608928381e0 2024-09-19T06:20:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.499+0000 7ff7a083e740 1 -- 172.21.15.3:0/3580099753 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff788019b10 con 0x5608928381e0 2024-09-19T06:20:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.499+0000 7ff780c00640 1 -- 172.21.15.3:0/3580099753 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7ff78800fb70 con 0x5608928381e0 2024-09-19T06:20:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.499+0000 7ff780c00640 1 -- 172.21.15.3:0/3580099753 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff788033050 con 0x5608928381e0 2024-09-19T06:20:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.499+0000 7ff7a083e740 10 client.27772 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.499+0000 7ff7a083e740 1 -- 172.21.15.3:0/3580099753 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560892851c60 con 0x5608928381e0 2024-09-19T06:20:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.499+0000 7ff780c00640 1 -- 172.21.15.3:0/3580099753 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff788019b10 con 0x5608928381e0 2024-09-19T06:20:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.499+0000 7ff780c00640 1 -- 172.21.15.3:0/3580099753 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff788003710 con 0x5608928381e0 2024-09-19T06:20:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.500+0000 7ff7a083e740 10 client.27772 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.500+0000 7ff7a083e740 10 client.27772 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.500+0000 7ff7a083e740 20 client.27772 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.500+0000 7ff7a083e740 1 --2- 172.21.15.3:0/3580099753 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5608928530d0 0x5608928554c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.500+0000 7ff7a083e740 4 client.27772 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:20:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.500+0000 7ff7a083e740 1 -- 172.21.15.3:0/3580099753 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608927ab830 con 0x5608928530d0 2024-09-19T06:20:59.505 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.500+0000 7ff796000640 1 --2- 172.21.15.3:0/3580099753 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5608928530d0 0x5608928554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.506 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.500+0000 7ff796000640 1 --2- 172.21.15.3:0/3580099753 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5608928530d0 0x5608928554c0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=945859741752dcf server_cookie=372e7f96bebbe28d in_seq=0 out_seq=0 2024-09-19T06:20:59.506 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.500+0000 7ff780c00640 10 client.27772 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:59.506 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.501+0000 7ff780c00640 1 -- 172.21.15.3:0/3580099753 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5608927ab830 con 0x5608928530d0 2024-09-19T06:20:59.506 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.501+0000 7ff780c00640 10 client.27772 handle_command_reply: tid=0 2024-09-19T06:20:59.506 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.501+0000 7ff7a083e740 1 client.27772 shutdown 2024-09-19T06:20:59.506 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.501+0000 7ff7a083e740 1 -- 172.21.15.3:0/3580099753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5608928381e0 msgr2=0x5608928403e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:59.506 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.501+0000 7ff7a083e740 1 --2- 172.21.15.3:0/3580099753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5608928381e0 0x5608928403e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff78801c040 tx=0x7ff788004250 comp rx=0 tx=0).stop 2024-09-19T06:20:59.506 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.502+0000 7ff7a083e740 1 -- 172.21.15.3:0/3580099753 shutdown_connections 2024-09-19T06:20:59.506 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.502+0000 7ff7a083e740 1 --2- 172.21.15.3:0/3580099753 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5608928530d0 0x5608928554c0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.506 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.502+0000 7ff7a083e740 1 --2- 172.21.15.3:0/3580099753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608928433a0 0x560892840e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.502+0000 7ff780c00640 0 client.27772 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.502+0000 7ff7a083e740 1 --2- 172.21.15.3:0/3580099753 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560892838b00 0x560892840920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.502+0000 7ff7a083e740 1 --2- 172.21.15.3:0/3580099753 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5608928381e0 0x5608928403e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.502+0000 7ff7a083e740 1 -- 172.21.15.3:0/3580099753 >> 172.21.15.3:0/3580099753 conn(0x560892834750 msgr2=0x56089283a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.502+0000 7ff7a083e740 1 -- 172.21.15.3:0/3580099753 shutdown_connections 2024-09-19T06:20:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.502+0000 7ff7a083e740 1 -- 172.21.15.3:0/3580099753 wait complete. 2024-09-19T06:20:59.507 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.502+0000 7ff7a083e740 20 client.27772 trim_cache size 0 max 16384 2024-09-19T06:20:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.517+0000 7ff7a083e740 1 Processor -- start 2024-09-19T06:20:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.517+0000 7ff7a083e740 1 -- start start 2024-09-19T06:20:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.517+0000 7ff7a083e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5608928381e0 0x56089285abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.517+0000 7ff7a083e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560892838b00 0x56089285b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.517+0000 7ff7a083e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5608928433a0 0x56089283d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.517+0000 7ff7a083e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff7981afc50 con 0x5608928433a0 2024-09-19T06:20:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.517+0000 7ff7a083e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff7981b1790 con 0x560892838b00 2024-09-19T06:20:59.518 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.517+0000 7ff7a083e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff7981b0320 con 0x5608928381e0 2024-09-19T06:20:59.520 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.518+0000 7ff797400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5608928433a0 0x56089283d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.520 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.518+0000 7ff796a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5608928381e0 0x56089285abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.520 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.518+0000 7ff797400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5608928433a0 0x56089283d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54938/0 (socket says 172.21.15.3:54938) 2024-09-19T06:20:59.520 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.518+0000 7ff797400640 1 -- 172.21.15.3:0/3591865132 learned_addr learned my addr 172.21.15.3:0/3591865132 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:59.520 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.518+0000 7ff796000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560892838b00 0x56089285b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.520 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.518+0000 7ff796a00640 1 -- 172.21.15.3:0/3591865132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560892838b00 msgr2=0x56089285b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:59.520 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.518+0000 7ff796a00640 1 --2- 172.21.15.3:0/3591865132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560892838b00 0x56089285b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.521 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.518+0000 7ff796a00640 1 -- 172.21.15.3:0/3591865132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5608928433a0 msgr2=0x56089283d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:59.521 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.518+0000 7ff796a00640 1 --2- 172.21.15.3:0/3591865132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5608928433a0 0x56089283d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.521 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.518+0000 7ff796a00640 1 -- 172.21.15.3:0/3591865132 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560892845b00 con 0x5608928381e0 2024-09-19T06:20:59.521 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.518+0000 7ff796a00640 1 --2- 172.21.15.3:0/3591865132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5608928381e0 0x56089285abe0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff78801c010 tx=0x7ff788009d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d86c404bf434e874 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:59.521 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.518+0000 7ff783400640 1 -- 172.21.15.3:0/3591865132 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78803c070 con 0x5608928381e0 2024-09-19T06:20:59.521 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.518+0000 7ff783400640 1 -- 172.21.15.3:0/3591865132 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff788015030 con 0x5608928381e0 2024-09-19T06:20:59.521 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.518+0000 7ff783400640 1 -- 172.21.15.3:0/3591865132 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78801e040 con 0x5608928381e0 2024-09-19T06:20:59.521 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.519+0000 7ff7a083e740 1 -- 172.21.15.3:0/3591865132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5608928381e0 msgr2=0x56089285abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:59.521 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.519+0000 7ff7a083e740 1 --2- 172.21.15.3:0/3591865132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5608928381e0 0x56089285abe0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff78801c010 tx=0x7ff788009d10 comp rx=0 tx=0).stop 2024-09-19T06:20:59.521 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.519+0000 7ff7a083e740 1 -- 172.21.15.3:0/3591865132 shutdown_connections 2024-09-19T06:20:59.521 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.519+0000 7ff7a083e740 1 --2- 172.21.15.3:0/3591865132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5608928433a0 0x56089283d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.521 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.519+0000 7ff7a083e740 1 --2- 172.21.15.3:0/3591865132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560892838b00 0x56089285b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.521 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.519+0000 7ff7a083e740 1 --2- 172.21.15.3:0/3591865132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5608928381e0 0x56089285abe0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.521 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.519+0000 7ff7a083e740 1 -- 172.21.15.3:0/3591865132 >> 172.21.15.3:0/3591865132 conn(0x560892834750 msgr2=0x56089283f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:59.522 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.519+0000 7ff7a083e740 1 -- 172.21.15.3:0/3591865132 shutdown_connections 2024-09-19T06:20:59.522 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.519+0000 7ff7a083e740 1 -- 172.21.15.3:0/3591865132 wait complete. 2024-09-19T06:20:59.522 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.520+0000 7ff7a083e740 1 -- start start 2024-09-19T06:20:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.520+0000 7ff7a083e740 1 Processor -- start 2024-09-19T06:20:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.520+0000 7ff7a083e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5608928381e0 0x56089284b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.520+0000 7ff7a083e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560892838b00 0x56089284bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.520+0000 7ff7a083e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608928433a0 0x56089283cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.520+0000 7ff7a083e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff7981b10c0 con 0x5608928381e0 2024-09-19T06:20:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.520+0000 7ff7a083e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff7981b09f0 con 0x5608928433a0 2024-09-19T06:20:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.520+0000 7ff7a083e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff7981adc50 con 0x560892838b00 2024-09-19T06:20:59.524 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.520+0000 7ff7a083e740 10 client.0 _ll_register_callbacks cb 0x7ff78801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:20:59.525 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.520+0000 7ff796a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5608928381e0 0x56089284b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.525 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.520+0000 7ff796a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5608928381e0 0x56089284b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54950/0 (socket says 172.21.15.3:54950) 2024-09-19T06:20:59.525 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.521+0000 7ff796a00640 1 -- 172.21.15.3:0/73673748 learned_addr learned my addr 172.21.15.3:0/73673748 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:20:59.525 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.521+0000 7ff796000640 1 --2- 172.21.15.3:0/73673748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560892838b00 0x56089284bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.525 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.521+0000 7ff797400640 1 --2- 172.21.15.3:0/73673748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608928433a0 0x56089283cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.525 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.521+0000 7ff796a00640 1 -- 172.21.15.3:0/73673748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560892838b00 msgr2=0x56089284bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:59.525 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.521+0000 7ff796a00640 1 --2- 172.21.15.3:0/73673748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560892838b00 0x56089284bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.525 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.521+0000 7ff796a00640 1 -- 172.21.15.3:0/73673748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608928433a0 msgr2=0x56089283cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:20:59.525 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.521+0000 7ff796a00640 1 --2- 172.21.15.3:0/73673748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608928433a0 0x56089283cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.525 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.521+0000 7ff796a00640 1 -- 172.21.15.3:0/73673748 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56089283d740 con 0x5608928381e0 2024-09-19T06:20:59.525 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.521+0000 7ff796a00640 1 --2- 172.21.15.3:0/73673748 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5608928381e0 0x56089284b6c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff788003cb0 tx=0x7ff788005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0ba722c7e69d1b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:20:59.525 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.521+0000 7ff780c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:20:59.525 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.521+0000 7ff780c00640 1 -- 172.21.15.3:0/73673748 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff788045060 con 0x5608928381e0 2024-09-19T06:20:59.525 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.521+0000 7ff7a083e740 1 -- 172.21.15.3:0/73673748 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff788015030 con 0x5608928381e0 2024-09-19T06:20:59.526 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.521+0000 7ff780c00640 1 -- 172.21.15.3:0/73673748 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7ff788003d30 con 0x5608928381e0 2024-09-19T06:20:59.526 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.522+0000 7ff780c00640 1 -- 172.21.15.3:0/73673748 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff78803c040 con 0x5608928381e0 2024-09-19T06:20:59.526 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.522+0000 7ff7a083e740 10 client.17763 fetch_fsmap learned FSMap version 29 2024-09-19T06:20:59.526 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.522+0000 7ff7a083e740 1 -- 172.21.15.3:0/73673748 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5608928bd7e0 con 0x5608928381e0 2024-09-19T06:20:59.526 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.522+0000 7ff780c00640 1 -- 172.21.15.3:0/73673748 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff788015030 con 0x5608928381e0 2024-09-19T06:20:59.526 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.522+0000 7ff780c00640 1 -- 172.21.15.3:0/73673748 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff78800f850 con 0x5608928381e0 2024-09-19T06:20:59.526 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.522+0000 7ff7a083e740 10 client.17763 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:20:59.526 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.522+0000 7ff7a083e740 10 client.17763 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:20:59.526 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.522+0000 7ff7a083e740 20 client.17763 populate_metadata read hostname 'smithi003' 2024-09-19T06:20:59.526 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.522+0000 7ff7a083e740 1 --2- 172.21.15.3:0/73673748 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5608928bdde0 0x5608928c01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:20:59.526 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.522+0000 7ff7a083e740 4 client.17763 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:20:59.526 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.522+0000 7ff7a083e740 1 -- 172.21.15.3:0/73673748 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5608927a5b80 con 0x5608928bdde0 2024-09-19T06:20:59.526 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.523+0000 7ff796000640 1 --2- 172.21.15.3:0/73673748 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5608928bdde0 0x5608928c01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:20:59.527 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.523+0000 7ff796000640 1 --2- 172.21.15.3:0/73673748 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5608928bdde0 0x5608928c01d0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6ac8612367d537b server_cookie=e37e5681e8cd016b in_seq=0 out_seq=0 2024-09-19T06:20:59.527 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.523+0000 7ff780c00640 10 client.17763 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:59.538 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.537+0000 7ff780c00640 1 -- 172.21.15.3:0/73673748 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5608927a5b80 con 0x5608928bdde0 2024-09-19T06:20:59.539 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.537+0000 7ff780c00640 10 client.17763 handle_command_reply: tid=0 2024-09-19T06:20:59.539 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.537+0000 7ff7a083e740 1 client.17763 shutdown 2024-09-19T06:20:59.539 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.537+0000 7ff7a083e740 1 -- 172.21.15.3:0/73673748 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5608928381e0 msgr2=0x56089284b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:59.539 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.537+0000 7ff7a083e740 1 --2- 172.21.15.3:0/73673748 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5608928381e0 0x56089284b6c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7ff788003cb0 tx=0x7ff788005740 comp rx=0 tx=0).stop 2024-09-19T06:20:59.539 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.538+0000 7ff7a083e740 1 -- 172.21.15.3:0/73673748 shutdown_connections 2024-09-19T06:20:59.539 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.538+0000 7ff7a083e740 1 --2- 172.21.15.3:0/73673748 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5608928bdde0 0x5608928c01d0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.539 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.538+0000 7ff7a083e740 1 --2- 172.21.15.3:0/73673748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608928433a0 0x56089283cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.539 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.538+0000 7ff7a083e740 1 --2- 172.21.15.3:0/73673748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560892838b00 0x56089284bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.539 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.538+0000 7ff7a083e740 1 --2- 172.21.15.3:0/73673748 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5608928381e0 0x56089284b6c0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.539 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.538+0000 7ff780c00640 0 client.17763 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:20:59.539 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.538+0000 7ff7a083e740 1 -- 172.21.15.3:0/73673748 >> 172.21.15.3:0/73673748 conn(0x560892834750 msgr2=0x560892839bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:59.539 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.538+0000 7ff7a083e740 1 -- 172.21.15.3:0/73673748 shutdown_connections 2024-09-19T06:20:59.539 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.538+0000 7ff7a083e740 1 -- 172.21.15.3:0/73673748 wait complete. 2024-09-19T06:20:59.540 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.538+0000 7ff7a083e740 20 client.17763 trim_cache size 0 max 16384 2024-09-19T06:20:59.540 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:20:59.540 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:20:59.540 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:20:59.540 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:20:59.541 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.539+0000 7ff79d800640 1 -- 172.21.15.3:0/451836063 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff77c0a33b0 msgr2=0x7ff77c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:59.541 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.539+0000 7ff79d800640 1 --2- 172.21.15.3:0/451836063 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff77c0a33b0 0x7ff77c0a5870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff790006010 tx=0x7ff790005d80 comp rx=0 tx=0).stop 2024-09-19T06:20:59.541 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.539+0000 7ff79d800640 1 -- 172.21.15.3:0/451836063 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff798109090 msgr2=0x7ff79819aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:20:59.541 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.539+0000 7ff79d800640 1 --2- 172.21.15.3:0/451836063 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff798109090 0x7ff79819aae0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7ff78400e9c0 tx=0x7ff78400ee80 comp rx=0 tx=0).stop 2024-09-19T06:20:59.541 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.539+0000 7ff79d800640 1 -- 172.21.15.3:0/451836063 shutdown_connections 2024-09-19T06:20:59.541 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.539+0000 7ff79d800640 1 --2- 172.21.15.3:0/451836063 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff77c0a33b0 0x7ff77c0a5870 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.541 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.539+0000 7ff79d800640 1 --2- 172.21.15.3:0/451836063 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff79819ee60 0x7ff79819f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.541 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.539+0000 7ff79d800640 1 --2- 172.21.15.3:0/451836063 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff798109090 0x7ff79819aae0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.542 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.539+0000 7ff79d800640 1 --2- 172.21.15.3:0/451836063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff798103f40 0x7ff79819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:20:59.542 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.539+0000 7ff79d800640 1 -- 172.21.15.3:0/451836063 >> 172.21.15.3:0/451836063 conn(0x7ff7980ff970 msgr2=0x7ff798100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:20:59.542 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.539+0000 7ff79d800640 1 -- 172.21.15.3:0/451836063 shutdown_connections 2024-09-19T06:20:59.542 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:20:59.539+0000 7ff79d800640 1 -- 172.21.15.3:0/451836063 wait complete. 2024-09-19T06:20:59.761 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:21:00.141 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:00.452 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:00 smithi003 ceph-mon[30893]: pgmap v265: 97 pgs: 97 active+clean; 3.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 23 op/s 2024-09-19T06:21:00.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:00 smithi059 ceph-mon[35138]: pgmap v265: 97 pgs: 97 active+clean; 3.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 23 op/s 2024-09-19T06:21:00.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:00 smithi071 ceph-mon[35662]: pgmap v265: 97 pgs: 97 active+clean; 3.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 61 KiB/s wr, 23 op/s 2024-09-19T06:21:00.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.767+0000 7f2417e00640 1 -- 172.21.15.3:0/570107231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24181047e0 msgr2=0x7f2418108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:00.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.767+0000 7f2417e00640 1 --2- 172.21.15.3:0/570107231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24181047e0 0x7f2418108830 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2404009860 tx=0x7f240402a340 comp rx=0 tx=0).stop 2024-09-19T06:21:00.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.767+0000 7f2417e00640 1 -- 172.21.15.3:0/570107231 shutdown_connections 2024-09-19T06:21:00.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.767+0000 7f2417e00640 1 --2- 172.21.15.3:0/570107231 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2418108f60 0x7f2418110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.767+0000 7f2417e00640 1 --2- 172.21.15.3:0/570107231 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f24181047e0 0x7f2418108830 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.767+0000 7f2417e00640 1 --2- 172.21.15.3:0/570107231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2418103e30 0x7f2418104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.767+0000 7f2417e00640 1 -- 172.21.15.3:0/570107231 >> 172.21.15.3:0/570107231 conn(0x7f24180ff8d0 msgr2=0x7f2418101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:00.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.767+0000 7f2417e00640 1 -- 172.21.15.3:0/570107231 shutdown_connections 2024-09-19T06:21:00.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.767+0000 7f2417e00640 1 -- 172.21.15.3:0/570107231 wait complete. 2024-09-19T06:21:00.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.768+0000 7f2417e00640 1 Processor -- start 2024-09-19T06:21:00.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.769+0000 7f2417e00640 1 -- start start 2024-09-19T06:21:00.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.769+0000 7f2417e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2418103e30 0x7f241819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:00.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.769+0000 7f2417e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24181047e0 0x7f241819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:00.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.769+0000 7f2417e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2418108f60 0x7f241819ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:00.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.769+0000 7f2417e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2418113fc0 con 0x7f2418103e30 2024-09-19T06:21:00.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.769+0000 7f2417e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2418113e40 con 0x7f24181047e0 2024-09-19T06:21:00.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.769+0000 7f2417e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2418114140 con 0x7f2418108f60 2024-09-19T06:21:00.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.769+0000 7f2416a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2418103e30 0x7f241819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:00.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.769+0000 7f2416a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2418103e30 0x7f241819a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54966/0 (socket says 172.21.15.3:54966) 2024-09-19T06:21:00.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.769+0000 7f2416a00640 1 -- 172.21.15.3:0/3026706432 learned_addr learned my addr 172.21.15.3:0/3026706432 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:00.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.769+0000 7f2416000640 1 --2- 172.21.15.3:0/3026706432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24181047e0 0x7f241819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:00.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.770+0000 7f2417400640 1 --2- 172.21.15.3:0/3026706432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2418108f60 0x7f241819ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:00.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.770+0000 7f2416a00640 1 -- 172.21.15.3:0/3026706432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2418108f60 msgr2=0x7f241819ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:00.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.770+0000 7f2416a00640 1 --2- 172.21.15.3:0/3026706432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2418108f60 0x7f241819ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.770+0000 7f2416a00640 1 -- 172.21.15.3:0/3026706432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24181047e0 msgr2=0x7f241819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:00.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.770+0000 7f2416a00640 1 --2- 172.21.15.3:0/3026706432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24181047e0 0x7f241819aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.770+0000 7f2416a00640 1 -- 172.21.15.3:0/3026706432 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f241819f470 con 0x7f2418103e30 2024-09-19T06:21:00.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.770+0000 7f2416a00640 1 --2- 172.21.15.3:0/3026706432 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2418103e30 0x7f241819a4c0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f240800e9f0 tx=0x7f240800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:00.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.771+0000 7f240f400640 1 -- 172.21.15.3:0/3026706432 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240800cd80 con 0x7f2418103e30 2024-09-19T06:21:00.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.771+0000 7f240f400640 1 -- 172.21.15.3:0/3026706432 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2408010910 con 0x7f2418103e30 2024-09-19T06:21:00.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.771+0000 7f240f400640 1 -- 172.21.15.3:0/3026706432 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2408018990 con 0x7f2418103e30 2024-09-19T06:21:00.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.771+0000 7f2417e00640 1 -- 172.21.15.3:0/3026706432 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f241819f760 con 0x7f2418103e30 2024-09-19T06:21:00.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.771+0000 7f2417e00640 1 -- 172.21.15.3:0/3026706432 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24181a7040 con 0x7f2418103e30 2024-09-19T06:21:00.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.774+0000 7f240f400640 1 -- 172.21.15.3:0/3026706432 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f2408010ac0 con 0x7f2418103e30 2024-09-19T06:21:00.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.774+0000 7f24205e5740 1 Processor -- start 2024-09-19T06:21:00.775 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.774+0000 7f24205e5740 1 -- start start 2024-09-19T06:21:00.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.774+0000 7f24205e5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600bef25e40 0x5600bef26220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:00.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.774+0000 7f24205e5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600bef26760 0x5600bef30ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:00.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.774+0000 7f24205e5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600bef31020 0x5600bef33410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:00.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.774+0000 7f24205e5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5600bee8c3e0 con 0x5600bef26760 2024-09-19T06:21:00.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.774+0000 7f24205e5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5600bee33d80 con 0x5600bef31020 2024-09-19T06:21:00.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.774+0000 7f24205e5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5600bee883a0 con 0x5600bef25e40 2024-09-19T06:21:00.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.775+0000 7f2416a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600bef26760 0x5600bef30ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:00.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.775+0000 7f2417400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600bef25e40 0x5600bef26220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:00.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.775+0000 7f2417400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600bef25e40 0x5600bef26220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:49430/0 (socket says 172.21.15.3:49430) 2024-09-19T06:21:00.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.775+0000 7f2417400640 1 -- 172.21.15.3:0/3372820494 learned_addr learned my addr 172.21.15.3:0/3372820494 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:00.776 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.775+0000 7f2416000640 1 --2- 172.21.15.3:0/3372820494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600bef31020 0x5600bef33410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:00.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.775+0000 7f2416000640 1 -- 172.21.15.3:0/3372820494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600bef25e40 msgr2=0x5600bef26220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:00.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.775+0000 7f2416000640 1 --2- 172.21.15.3:0/3372820494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600bef25e40 0x5600bef26220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.775+0000 7f2416000640 1 -- 172.21.15.3:0/3372820494 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600bef26760 msgr2=0x5600bef30ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:00.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.775+0000 7f2416000640 1 --2- 172.21.15.3:0/3372820494 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600bef26760 0x5600bef30ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.775+0000 7f2416000640 1 -- 172.21.15.3:0/3372820494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600bee52ae0 con 0x5600bef31020 2024-09-19T06:21:00.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.776+0000 7f2416000640 1 --2- 172.21.15.3:0/3372820494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600bef31020 0x5600bef33410 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2404035040 tx=0x7f2404009510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8fc87bcf27862b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:00.778 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.776+0000 7f240f400640 1 --2- 172.21.15.3:0/3026706432 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f23fc0a33b0 0x7f23fc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:00.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.776+0000 7f2403e00640 1 -- 172.21.15.3:0/3372820494 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2404041020 con 0x5600bef31020 2024-09-19T06:21:00.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.776+0000 7f2403e00640 1 -- 172.21.15.3:0/3372820494 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2404030e50 con 0x5600bef31020 2024-09-19T06:21:00.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.776+0000 7f240f400640 1 -- 172.21.15.3:0/3026706432 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f24080d00c0 con 0x7f2418103e30 2024-09-19T06:21:00.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.776+0000 7f2403e00640 1 -- 172.21.15.3:0/3372820494 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2404037040 con 0x5600bef31020 2024-09-19T06:21:00.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.776+0000 7f2417400640 1 --2- 172.21.15.3:0/3026706432 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f23fc0a33b0 0x7f23fc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:00.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.777+0000 7f24205e5740 1 -- 172.21.15.3:0/3372820494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600bef31020 msgr2=0x5600bef33410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:00.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.777+0000 7f24205e5740 1 --2- 172.21.15.3:0/3372820494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600bef31020 0x5600bef33410 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2404035040 tx=0x7f2404009510 comp rx=0 tx=0).stop 2024-09-19T06:21:00.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.777+0000 7f2417400640 1 --2- 172.21.15.3:0/3026706432 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f23fc0a33b0 0x7f23fc0a5870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2410005c40 tx=0x7f2410010040 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:00.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.777+0000 7f24205e5740 1 -- 172.21.15.3:0/3372820494 shutdown_connections 2024-09-19T06:21:00.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.777+0000 7f24205e5740 1 --2- 172.21.15.3:0/3372820494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600bef31020 0x5600bef33410 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.777+0000 7f24205e5740 1 --2- 172.21.15.3:0/3372820494 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600bef26760 0x5600bef30ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.777+0000 7f24205e5740 1 --2- 172.21.15.3:0/3372820494 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600bef25e40 0x5600bef26220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.777+0000 7f24205e5740 1 -- 172.21.15.3:0/3372820494 >> 172.21.15.3:0/3372820494 conn(0x5600bef223d0 msgr2=0x5600bef227b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:00.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.777+0000 7f24205e5740 1 -- 172.21.15.3:0/3372820494 shutdown_connections 2024-09-19T06:21:00.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.777+0000 7f24205e5740 1 -- 172.21.15.3:0/3372820494 wait complete. 2024-09-19T06:21:00.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.777+0000 7f24205e5740 1 -- start start 2024-09-19T06:21:00.782 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.778+0000 7f24205e5740 1 Processor -- start 2024-09-19T06:21:00.782 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.778+0000 7f24205e5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600bef25e40 0x5600bef2de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:00.782 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.778+0000 7f24205e5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600bef26760 0x5600bef2e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:00.782 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.778+0000 7f24205e5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600bef31020 0x5600bef2e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:00.782 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.778+0000 7f24205e5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5600bef33bf0 con 0x5600bef26760 2024-09-19T06:21:00.782 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.778+0000 7f24205e5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5600bee470f0 con 0x5600bef25e40 2024-09-19T06:21:00.782 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.778+0000 7f24205e5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5600bef33d70 con 0x5600bef31020 2024-09-19T06:21:00.782 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.778+0000 7f24205e5740 10 client.0 _ll_register_callbacks cb 0x5600bee2ebd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:00.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.778+0000 7f2416a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600bef25e40 0x5600bef2de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:00.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.778+0000 7f2416000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600bef26760 0x5600bef2e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:00.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.778+0000 7f2416a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600bef25e40 0x5600bef2de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:50864/0 (socket says 172.21.15.3:50864) 2024-09-19T06:21:00.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.778+0000 7f2416a00640 1 -- 172.21.15.3:0/16357967 learned_addr learned my addr 172.21.15.3:0/16357967 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:00.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.779+0000 7f2417400640 1 --2- 172.21.15.3:0/16357967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600bef31020 0x5600bef2e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:00.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.779+0000 7f2416a00640 1 -- 172.21.15.3:0/16357967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600bef31020 msgr2=0x5600bef2e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:00.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.779+0000 7f2416a00640 1 --2- 172.21.15.3:0/16357967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600bef31020 0x5600bef2e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.779+0000 7f2416a00640 1 -- 172.21.15.3:0/16357967 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600bef26760 msgr2=0x5600bef2e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:00.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.779+0000 7f2416a00640 1 --2- 172.21.15.3:0/16357967 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600bef26760 0x5600bef2e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.779+0000 7f2416a00640 1 -- 172.21.15.3:0/16357967 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600bebfd3c0 con 0x5600bef25e40 2024-09-19T06:21:00.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.779+0000 7f2416000640 1 --2- 172.21.15.3:0/16357967 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600bef26760 0x5600bef2e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:00.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.779+0000 7f2416a00640 1 --2- 172.21.15.3:0/16357967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600bef25e40 0x5600bef2de80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f240800c6a0 tx=0x7f2408098660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4e1d164d76ffced server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:00.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.779+0000 7f2400c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:21:00.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.779+0000 7f2400c00640 1 -- 172.21.15.3:0/16357967 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240809bd20 con 0x5600bef25e40 2024-09-19T06:21:00.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.779+0000 7f2400c00640 1 -- 172.21.15.3:0/16357967 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f24080d20d0 con 0x5600bef25e40 2024-09-19T06:21:00.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.779+0000 7f24205e5740 1 -- 172.21.15.3:0/16357967 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2404030e50 con 0x5600bef25e40 2024-09-19T06:21:00.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.780+0000 7f2400c00640 1 -- 172.21.15.3:0/16357967 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f24080cdc00 con 0x5600bef25e40 2024-09-19T06:21:00.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.780+0000 7f24205e5740 10 client.27812 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:00.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.780+0000 7f24205e5740 1 -- 172.21.15.3:0/16357967 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5600bef3fbb0 con 0x5600bef25e40 2024-09-19T06:21:00.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.780+0000 7f2400c00640 1 -- 172.21.15.3:0/16357967 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2404030e50 con 0x5600bef25e40 2024-09-19T06:21:00.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.780+0000 7f2400c00640 1 -- 172.21.15.3:0/16357967 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f24080bc150 con 0x5600bef25e40 2024-09-19T06:21:00.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.780+0000 7f24205e5740 10 client.27812 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:00.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.780+0000 7f24205e5740 10 client.27812 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:21:00.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.780+0000 7f24205e5740 20 client.27812 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:00.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.780+0000 7f24205e5740 1 --2- 172.21.15.3:0/16357967 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5600bef40f00 0x5600bef43370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:00.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.780+0000 7f24205e5740 4 client.27812 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:00.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.780+0000 7f24205e5740 1 -- 172.21.15.3:0/16357967 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600bee99950 con 0x5600bef40f00 2024-09-19T06:21:00.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.781+0000 7f2416000640 1 --2- 172.21.15.3:0/16357967 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5600bef40f00 0x5600bef43370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:00.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.781+0000 7f2416000640 1 --2- 172.21.15.3:0/16357967 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5600bef40f00 0x5600bef43370 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9b2c74699a6e4f5b server_cookie=97562ca4d7c37be in_seq=0 out_seq=0 2024-09-19T06:21:00.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.781+0000 7f2400c00640 10 client.27812 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:21:00.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.782+0000 7f2400c00640 1 -- 172.21.15.3:0/16357967 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5600bee99950 con 0x5600bef40f00 2024-09-19T06:21:00.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.782+0000 7f2400c00640 10 client.27812 handle_command_reply: tid=0 2024-09-19T06:21:00.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.782+0000 7f24205e5740 1 client.27812 shutdown 2024-09-19T06:21:00.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.782+0000 7f24205e5740 1 -- 172.21.15.3:0/16357967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600bef25e40 msgr2=0x5600bef2de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:00.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.782+0000 7f24205e5740 1 --2- 172.21.15.3:0/16357967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600bef25e40 0x5600bef2de80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f240800c6a0 tx=0x7f2408098660 comp rx=0 tx=0).stop 2024-09-19T06:21:00.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.782+0000 7f24205e5740 1 -- 172.21.15.3:0/16357967 shutdown_connections 2024-09-19T06:21:00.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.782+0000 7f24205e5740 1 --2- 172.21.15.3:0/16357967 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5600bef40f00 0x5600bef43370 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.782+0000 7f24205e5740 1 --2- 172.21.15.3:0/16357967 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600bef31020 0x5600bef2e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.782+0000 7f24205e5740 1 --2- 172.21.15.3:0/16357967 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600bef26760 0x5600bef2e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.782+0000 7f24205e5740 1 --2- 172.21.15.3:0/16357967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600bef25e40 0x5600bef2de80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.782+0000 7f2400c00640 0 client.27812 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:21:00.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.782+0000 7f24205e5740 1 -- 172.21.15.3:0/16357967 >> 172.21.15.3:0/16357967 conn(0x5600bef223d0 msgr2=0x5600bef28100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:00.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.783+0000 7f24205e5740 1 -- 172.21.15.3:0/16357967 shutdown_connections 2024-09-19T06:21:00.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.783+0000 7f24205e5740 1 -- 172.21.15.3:0/16357967 wait complete. 2024-09-19T06:21:00.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.783+0000 7f24205e5740 20 client.27812 trim_cache size 0 max 16384 2024-09-19T06:21:00.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.796+0000 7f24205e5740 1 Processor -- start 2024-09-19T06:21:00.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.797+0000 7f24205e5740 1 -- start start 2024-09-19T06:21:00.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.797+0000 7f24205e5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600bef25e40 0x5600bef288a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:00.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.797+0000 7f24205e5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600bef26760 0x5600bef2fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:00.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.797+0000 7f24205e5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600bef31020 0x5600bef48c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:00.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.797+0000 7f24205e5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f24181afa20 con 0x5600bef25e40 2024-09-19T06:21:00.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.797+0000 7f24205e5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f24181b1560 con 0x5600bef31020 2024-09-19T06:21:00.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.797+0000 7f24205e5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f24181b00f0 con 0x5600bef26760 2024-09-19T06:21:00.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.797+0000 7f2416a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600bef25e40 0x5600bef288a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:00.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.797+0000 7f2416a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600bef25e40 0x5600bef288a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54978/0 (socket says 172.21.15.3:54978) 2024-09-19T06:21:00.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.797+0000 7f2416a00640 1 -- 172.21.15.3:0/1203873010 learned_addr learned my addr 172.21.15.3:0/1203873010 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:00.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.797+0000 7f2416000640 1 --2- 172.21.15.3:0/1203873010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600bef26760 0x5600bef2fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:00.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.797+0000 7f2417400640 1 --2- 172.21.15.3:0/1203873010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600bef31020 0x5600bef48c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:00.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.798+0000 7f2416a00640 1 -- 172.21.15.3:0/1203873010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600bef26760 msgr2=0x5600bef2fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:00.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.798+0000 7f2416a00640 1 --2- 172.21.15.3:0/1203873010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600bef26760 0x5600bef2fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.798+0000 7f2416a00640 1 -- 172.21.15.3:0/1203873010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600bef31020 msgr2=0x5600bef48c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:00.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.798+0000 7f2416a00640 1 --2- 172.21.15.3:0/1203873010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600bef31020 0x5600bef48c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.798+0000 7f2416a00640 1 -- 172.21.15.3:0/1203873010 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600bef439f0 con 0x5600bef25e40 2024-09-19T06:21:00.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.798+0000 7f2416a00640 1 --2- 172.21.15.3:0/1203873010 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600bef25e40 0x5600bef288a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2408018460 tx=0x7f2408098040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d01993494057d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:00.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.798+0000 7f2403400640 1 -- 172.21.15.3:0/1203873010 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2408018c00 con 0x5600bef25e40 2024-09-19T06:21:00.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.798+0000 7f2403400640 1 -- 172.21.15.3:0/1203873010 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f240809c3c0 con 0x5600bef25e40 2024-09-19T06:21:00.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.798+0000 7f2403400640 1 -- 172.21.15.3:0/1203873010 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240809b810 con 0x5600bef25e40 2024-09-19T06:21:00.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.799+0000 7f24205e5740 1 -- 172.21.15.3:0/1203873010 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600bef25e40 msgr2=0x5600bef288a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:00.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.799+0000 7f24205e5740 1 --2- 172.21.15.3:0/1203873010 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600bef25e40 0x5600bef288a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2408018460 tx=0x7f2408098040 comp rx=0 tx=0).stop 2024-09-19T06:21:00.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.799+0000 7f24205e5740 1 -- 172.21.15.3:0/1203873010 shutdown_connections 2024-09-19T06:21:00.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.799+0000 7f24205e5740 1 --2- 172.21.15.3:0/1203873010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600bef31020 0x5600bef48c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.799+0000 7f24205e5740 1 --2- 172.21.15.3:0/1203873010 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600bef26760 0x5600bef2fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.799+0000 7f24205e5740 1 --2- 172.21.15.3:0/1203873010 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600bef25e40 0x5600bef288a0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.799+0000 7f24205e5740 1 -- 172.21.15.3:0/1203873010 >> 172.21.15.3:0/1203873010 conn(0x5600bef223d0 msgr2=0x5600bef2f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:00.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.799+0000 7f24205e5740 1 -- 172.21.15.3:0/1203873010 shutdown_connections 2024-09-19T06:21:00.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.799+0000 7f24205e5740 1 -- 172.21.15.3:0/1203873010 wait complete. 2024-09-19T06:21:00.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.800+0000 7f24205e5740 1 -- start start 2024-09-19T06:21:00.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.800+0000 7f24205e5740 1 Processor -- start 2024-09-19T06:21:00.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.800+0000 7f24205e5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600bef25e40 0x5600bef34cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:00.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.800+0000 7f24205e5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600bef26760 0x5600bef35210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:00.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.800+0000 7f24205e5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600bef31020 0x5600bef35750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:00.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.800+0000 7f24205e5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f24181b0e90 con 0x5600bef31020 2024-09-19T06:21:00.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.800+0000 7f24205e5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f24181b07c0 con 0x5600bef26760 2024-09-19T06:21:00.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.800+0000 7f24205e5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f24181ada20 con 0x5600bef25e40 2024-09-19T06:21:00.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.800+0000 7f24205e5740 10 client.0 _ll_register_callbacks cb 0x7f240800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:00.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.801+0000 7f2417400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600bef31020 0x5600bef35750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:00.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.801+0000 7f2416a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600bef25e40 0x5600bef34cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:00.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.801+0000 7f2416a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600bef25e40 0x5600bef34cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:49454/0 (socket says 172.21.15.3:49454) 2024-09-19T06:21:00.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.801+0000 7f2416a00640 1 -- 172.21.15.3:0/429508626 learned_addr learned my addr 172.21.15.3:0/429508626 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:00.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.801+0000 7f2416000640 1 --2- 172.21.15.3:0/429508626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600bef26760 0x5600bef35210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:00.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.801+0000 7f2416a00640 1 -- 172.21.15.3:0/429508626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600bef26760 msgr2=0x5600bef35210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:00.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.801+0000 7f2416a00640 1 --2- 172.21.15.3:0/429508626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600bef26760 0x5600bef35210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.801+0000 7f2416a00640 1 -- 172.21.15.3:0/429508626 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600bef31020 msgr2=0x5600bef35750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:00.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.801+0000 7f2416a00640 1 --2- 172.21.15.3:0/429508626 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600bef31020 0x5600bef35750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.801+0000 7f2416a00640 1 -- 172.21.15.3:0/429508626 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600befb3470 con 0x5600bef25e40 2024-09-19T06:21:00.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.801+0000 7f2417400640 1 --2- 172.21.15.3:0/429508626 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600bef31020 0x5600bef35750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:00.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.801+0000 7f2416a00640 1 --2- 172.21.15.3:0/429508626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600bef25e40 0x5600bef34cd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2408000c00 tx=0x7f2408098790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e00c9578b4239649 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:00.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.801+0000 7f2400c00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:21:00.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.802+0000 7f2400c00640 1 -- 172.21.15.3:0/429508626 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24080b4020 con 0x5600bef25e40 2024-09-19T06:21:00.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.802+0000 7f2400c00640 1 -- 172.21.15.3:0/429508626 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f2408018b30 con 0x5600bef25e40 2024-09-19T06:21:00.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.802+0000 7f24205e5740 1 -- 172.21.15.3:0/429508626 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f240809c3c0 con 0x5600bef25e40 2024-09-19T06:21:00.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.802+0000 7f2400c00640 1 -- 172.21.15.3:0/429508626 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f240809b810 con 0x5600bef25e40 2024-09-19T06:21:00.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.802+0000 7f24205e5740 10 client.27796 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:00.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.802+0000 7f24205e5740 1 -- 172.21.15.3:0/429508626 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5600befb4700 con 0x5600bef25e40 2024-09-19T06:21:00.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.802+0000 7f2400c00640 1 -- 172.21.15.3:0/429508626 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f240809c3c0 con 0x5600bef25e40 2024-09-19T06:21:00.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.802+0000 7f2400c00640 1 -- 172.21.15.3:0/429508626 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2408098110 con 0x5600bef25e40 2024-09-19T06:21:00.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.802+0000 7f24205e5740 10 client.27796 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:00.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.802+0000 7f24205e5740 10 client.27796 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:21:00.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.802+0000 7f24205e5740 20 client.27796 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:00.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.802+0000 7f24205e5740 1 --2- 172.21.15.3:0/429508626 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5600befb4ac0 0x5600befb6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:00.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.802+0000 7f24205e5740 4 client.27796 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:00.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.802+0000 7f24205e5740 1 -- 172.21.15.3:0/429508626 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5600bee93e60 con 0x5600befb4ac0 2024-09-19T06:21:00.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.803+0000 7f2416000640 1 --2- 172.21.15.3:0/429508626 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5600befb4ac0 0x5600befb6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:00.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.803+0000 7f2416000640 1 --2- 172.21.15.3:0/429508626 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5600befb4ac0 0x5600befb6ee0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bc5bc10de652c672 server_cookie=2f07754e692fc7bb in_seq=0 out_seq=0 2024-09-19T06:21:00.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.803+0000 7f2400c00640 10 client.27796 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:21:00.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.803+0000 7f2400c00640 1 -- 172.21.15.3:0/429508626 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5600bee93e60 con 0x5600befb4ac0 2024-09-19T06:21:00.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.803+0000 7f2400c00640 10 client.27796 handle_command_reply: tid=0 2024-09-19T06:21:00.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.803+0000 7f24205e5740 1 client.27796 shutdown 2024-09-19T06:21:00.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.804+0000 7f24205e5740 1 -- 172.21.15.3:0/429508626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600bef25e40 msgr2=0x5600bef34cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:00.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.804+0000 7f24205e5740 1 --2- 172.21.15.3:0/429508626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600bef25e40 0x5600bef34cd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2408000c00 tx=0x7f2408098790 comp rx=0 tx=0).stop 2024-09-19T06:21:00.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.804+0000 7f24205e5740 1 -- 172.21.15.3:0/429508626 shutdown_connections 2024-09-19T06:21:00.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.804+0000 7f24205e5740 1 --2- 172.21.15.3:0/429508626 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5600befb4ac0 0x5600befb6ee0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.804+0000 7f24205e5740 1 --2- 172.21.15.3:0/429508626 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5600bef31020 0x5600bef35750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.804+0000 7f24205e5740 1 --2- 172.21.15.3:0/429508626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600bef26760 0x5600bef35210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.804+0000 7f24205e5740 1 --2- 172.21.15.3:0/429508626 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5600bef25e40 0x5600bef34cd0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.804+0000 7f2400c00640 0 client.27796 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:21:00.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.804+0000 7f24205e5740 1 -- 172.21.15.3:0/429508626 >> 172.21.15.3:0/429508626 conn(0x5600bef223d0 msgr2=0x5600bef2e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:00.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.804+0000 7f24205e5740 1 -- 172.21.15.3:0/429508626 shutdown_connections 2024-09-19T06:21:00.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.804+0000 7f24205e5740 1 -- 172.21.15.3:0/429508626 wait complete. 2024-09-19T06:21:00.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.804+0000 7f24205e5740 20 client.27796 trim_cache size 0 max 16384 2024-09-19T06:21:00.809 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:21:00.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.804+0000 7f2417e00640 1 -- 172.21.15.3:0/3026706432 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f23fc0a33b0 msgr2=0x7f23fc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:00.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.804+0000 7f2417e00640 1 --2- 172.21.15.3:0/3026706432 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f23fc0a33b0 0x7f23fc0a5870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2410005c40 tx=0x7f2410010040 comp rx=0 tx=0).stop 2024-09-19T06:21:00.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.804+0000 7f2417e00640 1 -- 172.21.15.3:0/3026706432 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2418103e30 msgr2=0x7f241819a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:00.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.804+0000 7f2417e00640 1 --2- 172.21.15.3:0/3026706432 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2418103e30 0x7f241819a4c0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f240800e9f0 tx=0x7f240800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.805+0000 7f2417e00640 1 -- 172.21.15.3:0/3026706432 shutdown_connections 2024-09-19T06:21:00.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.805+0000 7f2417e00640 1 --2- 172.21.15.3:0/3026706432 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f23fc0a33b0 0x7f23fc0a5870 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.805+0000 7f2417e00640 1 --2- 172.21.15.3:0/3026706432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2418108f60 0x7f241819ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.805+0000 7f2417e00640 1 --2- 172.21.15.3:0/3026706432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24181047e0 0x7f241819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.805+0000 7f2417e00640 1 --2- 172.21.15.3:0/3026706432 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2418103e30 0x7f241819a4c0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:00.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.805+0000 7f2417e00640 1 -- 172.21.15.3:0/3026706432 >> 172.21.15.3:0/3026706432 conn(0x7f24180ff8d0 msgr2=0x7f2418100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:00.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.805+0000 7f2417e00640 1 -- 172.21.15.3:0/3026706432 shutdown_connections 2024-09-19T06:21:00.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:00.805+0000 7f2417e00640 1 -- 172.21.15.3:0/3026706432 wait complete. 2024-09-19T06:21:02.022 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:21:02.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:02 smithi003 ceph-mon[30893]: pgmap v266: 97 pgs: 97 active+clean; 3.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-09-19T06:21:02.407 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:02.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:02 smithi059 ceph-mon[35138]: pgmap v266: 97 pgs: 97 active+clean; 3.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-09-19T06:21:02.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:02 smithi071 ceph-mon[35662]: pgmap v266: 97 pgs: 97 active+clean; 3.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-09-19T06:21:03.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.036+0000 7f0d1ae00640 1 -- 172.21.15.3:0/93731295 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d14108f60 msgr2=0x7f0d14110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:03.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.036+0000 7f0d1ae00640 1 --2- 172.21.15.3:0/93731295 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d14108f60 0x7f0d14110ae0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c009ca0 tx=0x7f0d0c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.036+0000 7f0d1ae00640 1 -- 172.21.15.3:0/93731295 shutdown_connections 2024-09-19T06:21:03.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.036+0000 7f0d1ae00640 1 --2- 172.21.15.3:0/93731295 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d14108f60 0x7f0d14110ae0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.036+0000 7f0d1ae00640 1 --2- 172.21.15.3:0/93731295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d141047e0 0x7f0d14108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.036+0000 7f0d1ae00640 1 --2- 172.21.15.3:0/93731295 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d14103e30 0x7f0d14104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.036+0000 7f0d1ae00640 1 -- 172.21.15.3:0/93731295 >> 172.21.15.3:0/93731295 conn(0x7f0d140ff8d0 msgr2=0x7f0d14101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:03.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.037+0000 7f0d1ae00640 1 -- 172.21.15.3:0/93731295 shutdown_connections 2024-09-19T06:21:03.038 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.037+0000 7f0d1ae00640 1 -- 172.21.15.3:0/93731295 wait complete. 2024-09-19T06:21:03.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.037+0000 7f0d1ae00640 1 Processor -- start 2024-09-19T06:21:03.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.038+0000 7f0d1ae00640 1 -- start start 2024-09-19T06:21:03.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.038+0000 7f0d1ae00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d14103e30 0x7f0d1419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.038+0000 7f0d1ae00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d141047e0 0x7f0d1419a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.038+0000 7f0d1ae00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d14108f60 0x7f0d1419ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.038+0000 7f0d1ae00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0d14114010 con 0x7f0d14103e30 2024-09-19T06:21:03.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.038+0000 7f0d1ae00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0d14113e90 con 0x7f0d141047e0 2024-09-19T06:21:03.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.038+0000 7f0d1ae00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0d14114190 con 0x7f0d14108f60 2024-09-19T06:21:03.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.038+0000 7f0d19a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d14103e30 0x7f0d1419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.038+0000 7f0d19a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d14103e30 0x7f0d1419a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55018/0 (socket says 172.21.15.3:55018) 2024-09-19T06:21:03.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.038+0000 7f0d19000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d141047e0 0x7f0d1419a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.038+0000 7f0d19a00640 1 -- 172.21.15.3:0/3345317414 learned_addr learned my addr 172.21.15.3:0/3345317414 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:03.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.038+0000 7f0d1a400640 1 --2- 172.21.15.3:0/3345317414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d14108f60 0x7f0d1419ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.039+0000 7f0d19a00640 1 -- 172.21.15.3:0/3345317414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d14108f60 msgr2=0x7f0d1419ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:03.041 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.039+0000 7f0d19a00640 1 --2- 172.21.15.3:0/3345317414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d14108f60 0x7f0d1419ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.041 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.039+0000 7f0d19a00640 1 -- 172.21.15.3:0/3345317414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d141047e0 msgr2=0x7f0d1419a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:03.041 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.039+0000 7f0d19a00640 1 --2- 172.21.15.3:0/3345317414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d141047e0 0x7f0d1419a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.041 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.039+0000 7f0d19a00640 1 -- 172.21.15.3:0/3345317414 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d1419f3c0 con 0x7f0d14103e30 2024-09-19T06:21:03.041 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.039+0000 7f0d19a00640 1 --2- 172.21.15.3:0/3345317414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d14103e30 0x7f0d1419a410 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f0d0800e9f0 tx=0x7f0d0800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:03.041 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.039+0000 7f0d12000640 1 -- 172.21.15.3:0/3345317414 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0800cd80 con 0x7f0d14103e30 2024-09-19T06:21:03.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.039+0000 7f0d1ae00640 1 -- 172.21.15.3:0/3345317414 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d1419f6b0 con 0x7f0d14103e30 2024-09-19T06:21:03.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.039+0000 7f0d12000640 1 -- 172.21.15.3:0/3345317414 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d08005500 con 0x7f0d14103e30 2024-09-19T06:21:03.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.039+0000 7f0d12000640 1 -- 172.21.15.3:0/3345317414 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d08010690 con 0x7f0d14103e30 2024-09-19T06:21:03.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.040+0000 7f0d1ae00640 1 -- 172.21.15.3:0/3345317414 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d141a6f90 con 0x7f0d14103e30 2024-09-19T06:21:03.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.043+0000 7f0d1efdf740 1 Processor -- start 2024-09-19T06:21:03.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.043+0000 7f0d12000640 1 -- 172.21.15.3:0/3345317414 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f0d080046c0 con 0x7f0d14103e30 2024-09-19T06:21:03.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.043+0000 7f0d1efdf740 1 -- start start 2024-09-19T06:21:03.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.043+0000 7f0d1efdf740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580a11c2e40 0x5580a11c3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.043+0000 7f0d1efdf740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c3760 0x5580a11cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.043+0000 7f0d1efdf740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580a11ce020 0x5580a11d0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.043+0000 7f0d1efdf740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5580a11293e0 con 0x5580a11ce020 2024-09-19T06:21:03.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.043+0000 7f0d1efdf740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5580a10d0d80 con 0x5580a11c2e40 2024-09-19T06:21:03.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.043+0000 7f0d1efdf740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5580a11253a0 con 0x5580a11c3760 2024-09-19T06:21:03.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.044+0000 7f0d1a400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580a11c2e40 0x5580a11c3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.044+0000 7f0d1a400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580a11c2e40 0x5580a11c3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:50910/0 (socket says 172.21.15.3:50910) 2024-09-19T06:21:03.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.044+0000 7f0d1a400640 1 -- 172.21.15.3:0/3916149422 learned_addr learned my addr 172.21.15.3:0/3916149422 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:03.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.044+0000 7f0d19a00640 1 --2- 172.21.15.3:0/3916149422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c3760 0x5580a11cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.046 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.044+0000 7f0d19000640 1 --2- 172.21.15.3:0/3916149422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580a11ce020 0x5580a11d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.044+0000 7f0d1a400640 1 -- 172.21.15.3:0/3916149422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c3760 msgr2=0x5580a11cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:03.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.044+0000 7f0d1a400640 1 --2- 172.21.15.3:0/3916149422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c3760 0x5580a11cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.044+0000 7f0d1a400640 1 -- 172.21.15.3:0/3916149422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580a11ce020 msgr2=0x5580a11d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:03.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.044+0000 7f0d1a400640 1 --2- 172.21.15.3:0/3916149422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580a11ce020 0x5580a11d0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.044+0000 7f0d1a400640 1 -- 172.21.15.3:0/3916149422 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580a10efae0 con 0x5580a11c2e40 2024-09-19T06:21:03.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.045+0000 7f0d1a400640 1 --2- 172.21.15.3:0/3916149422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580a11c2e40 0x5580a11c3220 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c009ca0 tx=0x7f0d0c02f3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7ae3c69814ae0b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:03.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.045+0000 7f0d06a00640 1 -- 172.21.15.3:0/3916149422 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c003970 con 0x5580a11c2e40 2024-09-19T06:21:03.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.045+0000 7f0d06a00640 1 -- 172.21.15.3:0/3916149422 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d0c036030 con 0x5580a11c2e40 2024-09-19T06:21:03.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.045+0000 7f0d06a00640 1 -- 172.21.15.3:0/3916149422 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c0043c0 con 0x5580a11c2e40 2024-09-19T06:21:03.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.045+0000 7f0d12000640 1 --2- 172.21.15.3:0/3345317414 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0cfc0a33b0 0x7f0cfc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.046+0000 7f0d12000640 1 -- 172.21.15.3:0/3345317414 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f0d080d0190 con 0x7f0d14103e30 2024-09-19T06:21:03.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.046+0000 7f0d19a00640 1 --2- 172.21.15.3:0/3345317414 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0cfc0a33b0 0x7f0cfc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.046+0000 7f0d1efdf740 1 -- 172.21.15.3:0/3916149422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580a11c2e40 msgr2=0x5580a11c3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:03.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.046+0000 7f0d1efdf740 1 --2- 172.21.15.3:0/3916149422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580a11c2e40 0x5580a11c3220 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c009ca0 tx=0x7f0d0c02f3c0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.046+0000 7f0d1efdf740 1 -- 172.21.15.3:0/3916149422 shutdown_connections 2024-09-19T06:21:03.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.046+0000 7f0d1efdf740 1 --2- 172.21.15.3:0/3916149422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580a11ce020 0x5580a11d0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.046+0000 7f0d1efdf740 1 --2- 172.21.15.3:0/3916149422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c3760 0x5580a11cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.046+0000 7f0d1efdf740 1 --2- 172.21.15.3:0/3916149422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580a11c2e40 0x5580a11c3220 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.046+0000 7f0d1efdf740 1 -- 172.21.15.3:0/3916149422 >> 172.21.15.3:0/3916149422 conn(0x5580a11bf3d0 msgr2=0x5580a11bf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:03.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.046+0000 7f0d19a00640 1 --2- 172.21.15.3:0/3345317414 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0cfc0a33b0 0x7f0cfc0a5870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x5580a11c0230 tx=0x7f0d08098040 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:03.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.047+0000 7f0d1efdf740 1 -- 172.21.15.3:0/3916149422 shutdown_connections 2024-09-19T06:21:03.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.047+0000 7f0d1efdf740 1 -- 172.21.15.3:0/3916149422 wait complete. 2024-09-19T06:21:03.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.047+0000 7f0d1efdf740 1 -- start start 2024-09-19T06:21:03.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.047+0000 7f0d1efdf740 1 Processor -- start 2024-09-19T06:21:03.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.048+0000 7f0d1efdf740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580a11c2e40 0x5580a11caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.048+0000 7f0d1efdf740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c3760 0x5580a11cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.048+0000 7f0d1efdf740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580a11ce020 0x5580a11cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.048+0000 7f0d1efdf740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5580a11d0a70 con 0x5580a11c2e40 2024-09-19T06:21:03.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.048+0000 7f0d1efdf740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5580a10e40f0 con 0x5580a11ce020 2024-09-19T06:21:03.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.048+0000 7f0d1efdf740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5580a11d0bf0 con 0x5580a11c3760 2024-09-19T06:21:03.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.048+0000 7f0d1efdf740 10 client.0 _ll_register_callbacks cb 0x5580a10cbbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:03.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.048+0000 7f0d1a400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580a11c2e40 0x5580a11caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.048+0000 7f0d19000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c3760 0x5580a11cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.048+0000 7f0d19000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c3760 0x5580a11cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:49496/0 (socket says 172.21.15.3:49496) 2024-09-19T06:21:03.050 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.048+0000 7f0d19000640 1 -- 172.21.15.3:0/3665624201 learned_addr learned my addr 172.21.15.3:0/3665624201 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:03.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.049+0000 7f0d19000640 1 -- 172.21.15.3:0/3665624201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580a11ce020 msgr2=0x5580a11cb980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:21:03.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.049+0000 7f0d19000640 1 --2- 172.21.15.3:0/3665624201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580a11ce020 0x5580a11cb980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.049+0000 7f0d19000640 1 -- 172.21.15.3:0/3665624201 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580a11c2e40 msgr2=0x5580a11caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:03.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.049+0000 7f0d19000640 1 --2- 172.21.15.3:0/3665624201 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580a11c2e40 0x5580a11caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.049+0000 7f0d19000640 1 -- 172.21.15.3:0/3665624201 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580a0e9a3c0 con 0x5580a11c3760 2024-09-19T06:21:03.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.049+0000 7f0d19000640 1 --2- 172.21.15.3:0/3665624201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c3760 0x5580a11cb440 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000be80 tx=0x7f0d00012820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=973e690ca7ce6b71 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:03.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.049+0000 7f0cfb400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:21:03.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.049+0000 7f0cfb400640 1 -- 172.21.15.3:0/3665624201 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d00004220 con 0x5580a11c3760 2024-09-19T06:21:03.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.049+0000 7f0cfb400640 1 -- 172.21.15.3:0/3665624201 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f0d000043c0 con 0x5580a11c3760 2024-09-19T06:21:03.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.049+0000 7f0d1efdf740 1 -- 172.21.15.3:0/3665624201 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d0c036030 con 0x5580a11c3760 2024-09-19T06:21:03.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.050+0000 7f0cfb400640 1 -- 172.21.15.3:0/3665624201 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0d00005020 con 0x5580a11c3760 2024-09-19T06:21:03.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.050+0000 7f0d1efdf740 10 client.27808 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:03.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.050+0000 7f0d1efdf740 1 -- 172.21.15.3:0/3665624201 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5580a11dcb10 con 0x5580a11c3760 2024-09-19T06:21:03.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.050+0000 7f0cfb400640 1 -- 172.21.15.3:0/3665624201 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d0c036030 con 0x5580a11c3760 2024-09-19T06:21:03.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.051+0000 7f0cfb400640 1 -- 172.21.15.3:0/3665624201 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0d00022070 con 0x5580a11c3760 2024-09-19T06:21:03.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.051+0000 7f0d1efdf740 10 client.27808 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:03.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.051+0000 7f0d1efdf740 10 client.27808 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:03.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.051+0000 7f0d1efdf740 20 client.27808 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:03.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.051+0000 7f0d1efdf740 1 --2- 172.21.15.3:0/3665624201 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5580a11ddfd0 0x5580a11e0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.051+0000 7f0d1efdf740 4 client.27808 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:03.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.051+0000 7f0d1efdf740 1 -- 172.21.15.3:0/3665624201 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5580a1136950 con 0x5580a11ddfd0 2024-09-19T06:21:03.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.051+0000 7f0d1a400640 1 --2- 172.21.15.3:0/3665624201 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5580a11ddfd0 0x5580a11e0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.052+0000 7f0d1a400640 1 --2- 172.21.15.3:0/3665624201 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5580a11ddfd0 0x5580a11e0450 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf65f956a214bbbb server_cookie=dea03f21daa41aad in_seq=0 out_seq=0 2024-09-19T06:21:03.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.052+0000 7f0cfb400640 10 client.27808 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:03.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.053+0000 7f0cfb400640 1 -- 172.21.15.3:0/3665624201 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5580a1136950 con 0x5580a11ddfd0 2024-09-19T06:21:03.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.053+0000 7f0cfb400640 10 client.27808 handle_command_reply: tid=0 2024-09-19T06:21:03.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.053+0000 7f0d1efdf740 1 client.27808 shutdown 2024-09-19T06:21:03.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.053+0000 7f0d1efdf740 1 -- 172.21.15.3:0/3665624201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c3760 msgr2=0x5580a11cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:03.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.053+0000 7f0d1efdf740 1 --2- 172.21.15.3:0/3665624201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c3760 0x5580a11cb440 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000be80 tx=0x7f0d00012820 comp rx=0 tx=0).stop 2024-09-19T06:21:03.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.053+0000 7f0d1efdf740 1 -- 172.21.15.3:0/3665624201 shutdown_connections 2024-09-19T06:21:03.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.053+0000 7f0d1efdf740 1 --2- 172.21.15.3:0/3665624201 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5580a11ddfd0 0x5580a11e0450 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.053+0000 7f0d1efdf740 1 --2- 172.21.15.3:0/3665624201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580a11ce020 0x5580a11cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.053+0000 7f0d1efdf740 1 --2- 172.21.15.3:0/3665624201 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c3760 0x5580a11cb440 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.053+0000 7f0d1efdf740 1 --2- 172.21.15.3:0/3665624201 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580a11c2e40 0x5580a11caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.053+0000 7f0cfb400640 0 client.27808 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:03.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.053+0000 7f0d1efdf740 1 -- 172.21.15.3:0/3665624201 >> 172.21.15.3:0/3665624201 conn(0x5580a11bf3d0 msgr2=0x5580a11c50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:03.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.053+0000 7f0d1efdf740 1 -- 172.21.15.3:0/3665624201 shutdown_connections 2024-09-19T06:21:03.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.053+0000 7f0d1efdf740 1 -- 172.21.15.3:0/3665624201 wait complete. 2024-09-19T06:21:03.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.053+0000 7f0d1efdf740 20 client.27808 trim_cache size 0 max 16384 2024-09-19T06:21:03.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.067+0000 7f0d1efdf740 1 Processor -- start 2024-09-19T06:21:03.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.067+0000 7f0d1efdf740 1 -- start start 2024-09-19T06:21:03.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.067+0000 7f0d1efdf740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580a11c2e40 0x5580a11c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.067+0000 7f0d1efdf740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c3760 0x5580a11cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.067+0000 7f0d1efdf740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580a11ce020 0x5580a11e5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.068+0000 7f0d1efdf740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0d141af8e0 con 0x5580a11c2e40 2024-09-19T06:21:03.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.068+0000 7f0d1efdf740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0d141b1420 con 0x5580a11ce020 2024-09-19T06:21:03.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.068+0000 7f0d1efdf740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0d141affb0 con 0x5580a11c3760 2024-09-19T06:21:03.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.068+0000 7f0d1a400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580a11c2e40 0x5580a11c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.068+0000 7f0d1a400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580a11c2e40 0x5580a11c58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55050/0 (socket says 172.21.15.3:55050) 2024-09-19T06:21:03.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.068+0000 7f0d19000640 1 --2- 172.21.15.3:0/757698999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c3760 0x5580a11cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.068+0000 7f0d1a400640 1 -- 172.21.15.3:0/757698999 learned_addr learned my addr 172.21.15.3:0/757698999 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:03.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.068+0000 7f0d1a400640 1 --2- 172.21.15.3:0/757698999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580a11ce020 0x5580a11e5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.068+0000 7f0d19000640 1 -- 172.21.15.3:0/757698999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580a11ce020 msgr2=0x5580a11e5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:03.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.068+0000 7f0d19000640 1 --2- 172.21.15.3:0/757698999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580a11ce020 0x5580a11e5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.068+0000 7f0d19000640 1 -- 172.21.15.3:0/757698999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580a11c2e40 msgr2=0x5580a11c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:03.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.068+0000 7f0d19000640 1 --2- 172.21.15.3:0/757698999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580a11c2e40 0x5580a11c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.068+0000 7f0d19000640 1 -- 172.21.15.3:0/757698999 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580a11c0060 con 0x5580a11c3760 2024-09-19T06:21:03.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.068+0000 7f0d1a400640 1 --2- 172.21.15.3:0/757698999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580a11c2e40 0x5580a11c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:03.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.069+0000 7f0d19000640 1 --2- 172.21.15.3:0/757698999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c3760 0x5580a11cce70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0d00010820 tx=0x7f0d0000b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef0ce2e631d90fd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:03.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.069+0000 7f0d06000640 1 -- 172.21.15.3:0/757698999 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d00028070 con 0x5580a11c3760 2024-09-19T06:21:03.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.069+0000 7f0d06000640 1 -- 172.21.15.3:0/757698999 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d00010c90 con 0x5580a11c3760 2024-09-19T06:21:03.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.069+0000 7f0d06000640 1 -- 172.21.15.3:0/757698999 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d00004ca0 con 0x5580a11c3760 2024-09-19T06:21:03.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.069+0000 7f0d1efdf740 1 -- 172.21.15.3:0/757698999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c3760 msgr2=0x5580a11cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:03.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.069+0000 7f0d1efdf740 1 --2- 172.21.15.3:0/757698999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c3760 0x5580a11cce70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0d00010820 tx=0x7f0d0000b710 comp rx=0 tx=0).stop 2024-09-19T06:21:03.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.070+0000 7f0d1efdf740 1 -- 172.21.15.3:0/757698999 shutdown_connections 2024-09-19T06:21:03.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.070+0000 7f0d1efdf740 1 --2- 172.21.15.3:0/757698999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580a11ce020 0x5580a11e5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.070+0000 7f0d1efdf740 1 --2- 172.21.15.3:0/757698999 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c3760 0x5580a11cce70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.070+0000 7f0d1efdf740 1 --2- 172.21.15.3:0/757698999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580a11c2e40 0x5580a11c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.070+0000 7f0d1efdf740 1 -- 172.21.15.3:0/757698999 >> 172.21.15.3:0/757698999 conn(0x5580a11bf3d0 msgr2=0x5580a11cc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:03.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.070+0000 7f0d1efdf740 1 -- 172.21.15.3:0/757698999 shutdown_connections 2024-09-19T06:21:03.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.070+0000 7f0d1efdf740 1 -- 172.21.15.3:0/757698999 wait complete. 2024-09-19T06:21:03.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.070+0000 7f0d1efdf740 1 -- start start 2024-09-19T06:21:03.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.070+0000 7f0d1efdf740 1 Processor -- start 2024-09-19T06:21:03.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.071+0000 7f0d1efdf740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c2e40 0x5580a11d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.071+0000 7f0d1efdf740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580a11c3760 0x5580a11d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.071+0000 7f0d1efdf740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580a11ce020 0x5580a11d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.071+0000 7f0d1efdf740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0d141b0d50 con 0x5580a11ce020 2024-09-19T06:21:03.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.071+0000 7f0d1efdf740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0d141b0680 con 0x5580a11c3760 2024-09-19T06:21:03.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.071+0000 7f0d1efdf740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0d141ad8e0 con 0x5580a11c2e40 2024-09-19T06:21:03.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.071+0000 7f0d1efdf740 10 client.0 _ll_register_callbacks cb 0x7f0d0000ba60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:03.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.071+0000 7f0d1a400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c2e40 0x5580a11d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.071+0000 7f0d1a400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580a11ce020 0x5580a11d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.071+0000 7f0d1a400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c2e40 0x5580a11d1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:49506/0 (socket says 172.21.15.3:49506) 2024-09-19T06:21:03.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.071+0000 7f0d1a400640 1 -- 172.21.15.3:0/2001818395 learned_addr learned my addr 172.21.15.3:0/2001818395 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:03.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.071+0000 7f0d19000640 1 --2- 172.21.15.3:0/2001818395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580a11c3760 0x5580a11d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.071+0000 7f0d1a400640 1 -- 172.21.15.3:0/2001818395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580a11c3760 msgr2=0x5580a11d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:03.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.071+0000 7f0d1a400640 1 --2- 172.21.15.3:0/2001818395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580a11c3760 0x5580a11d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.071+0000 7f0d1a400640 1 -- 172.21.15.3:0/2001818395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580a11ce020 msgr2=0x5580a11d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:03.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.071+0000 7f0d1a400640 1 --2- 172.21.15.3:0/2001818395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580a11ce020 0x5580a11d2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.071+0000 7f0d1a400640 1 -- 172.21.15.3:0/2001818395 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580a1247f40 con 0x5580a11c2e40 2024-09-19T06:21:03.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.072+0000 7f0d1a400640 1 --2- 172.21.15.3:0/2001818395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c2e40 0x5580a11d1df0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c02ade0 tx=0x7f0d0c005df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c7c34460aa8b62b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:03.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.072+0000 7f0cfb400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:21:03.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.072+0000 7f0cfb400640 1 -- 172.21.15.3:0/2001818395 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c064060 con 0x5580a11c2e40 2024-09-19T06:21:03.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.072+0000 7f0d1efdf740 1 -- 172.21.15.3:0/2001818395 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d00010c90 con 0x5580a11c2e40 2024-09-19T06:21:03.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.072+0000 7f0cfb400640 1 -- 172.21.15.3:0/2001818395 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f0d0c003970 con 0x5580a11c2e40 2024-09-19T06:21:03.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.072+0000 7f0cfb400640 1 -- 172.21.15.3:0/2001818395 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0d0c04a040 con 0x5580a11c2e40 2024-09-19T06:21:03.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.072+0000 7f0d1efdf740 10 client.27814 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:03.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.072+0000 7f0d1efdf740 1 -- 172.21.15.3:0/2001818395 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5580a1249220 con 0x5580a11c2e40 2024-09-19T06:21:03.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.073+0000 7f0cfb400640 1 -- 172.21.15.3:0/2001818395 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d00010c90 con 0x5580a11c2e40 2024-09-19T06:21:03.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.073+0000 7f0cfb400640 1 -- 172.21.15.3:0/2001818395 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0d0c05b040 con 0x5580a11c2e40 2024-09-19T06:21:03.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.073+0000 7f0d1efdf740 10 client.27814 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:03.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.073+0000 7f0d1efdf740 10 client.27814 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:03.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.073+0000 7f0d1efdf740 20 client.27814 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:03.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.073+0000 7f0d1efdf740 1 --2- 172.21.15.3:0/2001818395 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5580a1249670 0x5580a124ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:03.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.073+0000 7f0d1efdf740 4 client.27814 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:03.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.073+0000 7f0d1efdf740 1 -- 172.21.15.3:0/2001818395 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5580a1130e60 con 0x5580a1249670 2024-09-19T06:21:03.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.073+0000 7f0d19000640 1 --2- 172.21.15.3:0/2001818395 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5580a1249670 0x5580a124ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:03.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.074+0000 7f0d19000640 1 --2- 172.21.15.3:0/2001818395 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5580a1249670 0x5580a124ba60 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5eb55554ab169151 server_cookie=c3978cd896e4d933 in_seq=0 out_seq=0 2024-09-19T06:21:03.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.074+0000 7f0cfb400640 10 client.27814 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:03.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.074+0000 7f0cfb400640 1 -- 172.21.15.3:0/2001818395 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5580a1130e60 con 0x5580a1249670 2024-09-19T06:21:03.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.074+0000 7f0cfb400640 10 client.27814 handle_command_reply: tid=0 2024-09-19T06:21:03.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.074+0000 7f0d1efdf740 1 client.27814 shutdown 2024-09-19T06:21:03.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.074+0000 7f0d1efdf740 1 -- 172.21.15.3:0/2001818395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c2e40 msgr2=0x5580a11d1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:03.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.074+0000 7f0d1efdf740 1 --2- 172.21.15.3:0/2001818395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c2e40 0x5580a11d1df0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c02ade0 tx=0x7f0d0c005df0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.075+0000 7f0d1efdf740 1 -- 172.21.15.3:0/2001818395 shutdown_connections 2024-09-19T06:21:03.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.075+0000 7f0d1efdf740 1 --2- 172.21.15.3:0/2001818395 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5580a1249670 0x5580a124ba60 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.075+0000 7f0d1efdf740 1 --2- 172.21.15.3:0/2001818395 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5580a11ce020 0x5580a11d2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.075+0000 7f0d1efdf740 1 --2- 172.21.15.3:0/2001818395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5580a11c3760 0x5580a11d2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.075+0000 7f0d1efdf740 1 --2- 172.21.15.3:0/2001818395 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5580a11c2e40 0x5580a11d1df0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.075+0000 7f0d1efdf740 1 -- 172.21.15.3:0/2001818395 >> 172.21.15.3:0/2001818395 conn(0x5580a11bf3d0 msgr2=0x5580a11cb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:03.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.075+0000 7f0cfb400640 0 client.27814 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:03.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.075+0000 7f0d1efdf740 1 -- 172.21.15.3:0/2001818395 shutdown_connections 2024-09-19T06:21:03.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.075+0000 7f0d1efdf740 1 -- 172.21.15.3:0/2001818395 wait complete. 2024-09-19T06:21:03.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.075+0000 7f0d1efdf740 20 client.27814 trim_cache size 0 max 16384 2024-09-19T06:21:03.081 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:21:03.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.075+0000 7f0d1ae00640 1 -- 172.21.15.3:0/3345317414 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0cfc0a33b0 msgr2=0x7f0cfc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:03.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.075+0000 7f0d1ae00640 1 --2- 172.21.15.3:0/3345317414 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0cfc0a33b0 0x7f0cfc0a5870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x5580a11c0230 tx=0x7f0d08098040 comp rx=0 tx=0).stop 2024-09-19T06:21:03.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.075+0000 7f0d1ae00640 1 -- 172.21.15.3:0/3345317414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d14103e30 msgr2=0x7f0d1419a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:03.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.075+0000 7f0d1ae00640 1 --2- 172.21.15.3:0/3345317414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d14103e30 0x7f0d1419a410 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f0d0800e9f0 tx=0x7f0d0800edf0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.076+0000 7f0d1ae00640 1 -- 172.21.15.3:0/3345317414 shutdown_connections 2024-09-19T06:21:03.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.076+0000 7f0d1ae00640 1 --2- 172.21.15.3:0/3345317414 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0cfc0a33b0 0x7f0cfc0a5870 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.076+0000 7f0d1ae00640 1 --2- 172.21.15.3:0/3345317414 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0d14108f60 0x7f0d1419ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.076+0000 7f0d1ae00640 1 --2- 172.21.15.3:0/3345317414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d141047e0 0x7f0d1419a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.076+0000 7f0d1ae00640 1 --2- 172.21.15.3:0/3345317414 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0d14103e30 0x7f0d1419a410 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:03.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.076+0000 7f0d1ae00640 1 -- 172.21.15.3:0/3345317414 >> 172.21.15.3:0/3345317414 conn(0x7f0d140ff8d0 msgr2=0x7f0d14100410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:03.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.076+0000 7f0d1ae00640 1 -- 172.21.15.3:0/3345317414 shutdown_connections 2024-09-19T06:21:03.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:03.076+0000 7f0d1ae00640 1 -- 172.21.15.3:0/3345317414 wait complete. 2024-09-19T06:21:04.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:04 smithi003 ceph-mon[30893]: pgmap v267: 97 pgs: 97 active+clean; 3.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-09-19T06:21:04.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:04 smithi059 ceph-mon[35138]: pgmap v267: 97 pgs: 97 active+clean; 3.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-09-19T06:21:04.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:04 smithi071 ceph-mon[35662]: pgmap v267: 97 pgs: 97 active+clean; 3.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-09-19T06:21:05.022 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:21:05.023 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:21:05.428 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:06.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.014+0000 7f0264800640 1 -- 172.21.15.3:0/1118056505 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f025c077040 msgr2=0x7f025c1124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:06.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.014+0000 7f0264800640 1 --2- 172.21.15.3:0/1118056505 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f025c077040 0x7f025c1124f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f024c009900 tx=0x7f024c02a410 comp rx=0 tx=0).stop 2024-09-19T06:21:06.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.014+0000 7f0264800640 1 -- 172.21.15.3:0/1118056505 shutdown_connections 2024-09-19T06:21:06.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.014+0000 7f0264800640 1 --2- 172.21.15.3:0/1118056505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f025c112a30 0x7f025c114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.014+0000 7f0264800640 1 --2- 172.21.15.3:0/1118056505 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f025c077040 0x7f025c1124f0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.014+0000 7f0264800640 1 --2- 172.21.15.3:0/1118056505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c076720 0x7f025c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.014+0000 7f0264800640 1 -- 172.21.15.3:0/1118056505 >> 172.21.15.3:0/1118056505 conn(0x7f025c0ffa90 msgr2=0x7f025c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:06.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.014+0000 7f0264800640 1 -- 172.21.15.3:0/1118056505 shutdown_connections 2024-09-19T06:21:06.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.014+0000 7f0264800640 1 -- 172.21.15.3:0/1118056505 wait complete. 2024-09-19T06:21:06.019 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.015+0000 7f0264800640 1 Processor -- start 2024-09-19T06:21:06.019 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.015+0000 7f0264800640 1 -- start start 2024-09-19T06:21:06.019 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.016+0000 7f0264800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f025c076720 0x7f025c1a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.019 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.016+0000 7f0264800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c077040 0x7f025c1a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.016+0000 7f0264800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f025c112a30 0x7f025c19e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.016+0000 7f0264800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f025c1185b0 con 0x7f025c112a30 2024-09-19T06:21:06.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.016+0000 7f0264800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f025c118430 con 0x7f025c077040 2024-09-19T06:21:06.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.016+0000 7f0264800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f025c118730 con 0x7f025c076720 2024-09-19T06:21:06.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.016+0000 7f0262800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f025c112a30 0x7f025c19e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.016+0000 7f0261e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f025c076720 0x7f025c1a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.016+0000 7f0262800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f025c112a30 0x7f025c19e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45146/0 (socket says 172.21.15.3:45146) 2024-09-19T06:21:06.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.016+0000 7f0262800640 1 -- 172.21.15.3:0/293613763 learned_addr learned my addr 172.21.15.3:0/293613763 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:06.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.016+0000 7f0261400640 1 --2- 172.21.15.3:0/293613763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c077040 0x7f025c1a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.017+0000 7f0262800640 1 -- 172.21.15.3:0/293613763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f025c076720 msgr2=0x7f025c1a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:06.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.017+0000 7f0262800640 1 --2- 172.21.15.3:0/293613763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f025c076720 0x7f025c1a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.017+0000 7f0262800640 1 -- 172.21.15.3:0/293613763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c077040 msgr2=0x7f025c1a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:06.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.017+0000 7f0262800640 1 --2- 172.21.15.3:0/293613763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c077040 0x7f025c1a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.017+0000 7f0262800640 1 -- 172.21.15.3:0/293613763 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f025c19eff0 con 0x7f025c112a30 2024-09-19T06:21:06.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.017+0000 7f0261e00640 1 --2- 172.21.15.3:0/293613763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f025c076720 0x7f025c1a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:06.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.017+0000 7f0261400640 1 --2- 172.21.15.3:0/293613763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c077040 0x7f025c1a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:06.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.017+0000 7f0262800640 1 --2- 172.21.15.3:0/293613763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f025c112a30 0x7f025c19e8c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f0258009fd0 tx=0x7f025800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:06.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.017+0000 7f0256a00640 1 -- 172.21.15.3:0/293613763 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0258004d20 con 0x7f025c112a30 2024-09-19T06:21:06.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.017+0000 7f0256a00640 1 -- 172.21.15.3:0/293613763 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0258005020 con 0x7f025c112a30 2024-09-19T06:21:06.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.017+0000 7f0256a00640 1 -- 172.21.15.3:0/293613763 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02580116d0 con 0x7f025c112a30 2024-09-19T06:21:06.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.018+0000 7f0264800640 1 -- 172.21.15.3:0/293613763 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f025c19f2e0 con 0x7f025c112a30 2024-09-19T06:21:06.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.018+0000 7f0264800640 1 -- 172.21.15.3:0/293613763 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f025c1ab5d0 con 0x7f025c112a30 2024-09-19T06:21:06.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.021+0000 7f0256a00640 1 -- 172.21.15.3:0/293613763 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f02580051d0 con 0x7f025c112a30 2024-09-19T06:21:06.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.021+0000 7f02673e0740 1 Processor -- start 2024-09-19T06:21:06.023 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.021+0000 7f02673e0740 1 -- start start 2024-09-19T06:21:06.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.021+0000 7f02673e0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55723e296ac0 0x55723e296ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.021+0000 7f02673e0740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55723e2973e0 0x55723e2a1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.021+0000 7f02673e0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55723e2a1ca0 0x55723e2a4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.021+0000 7f02673e0740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55723e1fd290 con 0x55723e2973e0 2024-09-19T06:21:06.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.021+0000 7f02673e0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55723e1a4b40 con 0x55723e2a1ca0 2024-09-19T06:21:06.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.021+0000 7f02673e0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55723e1f9250 con 0x55723e296ac0 2024-09-19T06:21:06.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.022+0000 7f0261e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55723e2973e0 0x55723e2a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.022+0000 7f0261400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55723e296ac0 0x55723e296ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.022+0000 7f0261400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55723e296ac0 0x55723e296ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:37588/0 (socket says 172.21.15.3:37588) 2024-09-19T06:21:06.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.022+0000 7f0261e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55723e2973e0 0x55723e2a1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45150/0 (socket says 172.21.15.3:45150) 2024-09-19T06:21:06.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.022+0000 7f0261400640 1 -- 172.21.15.3:0/712552714 learned_addr learned my addr 172.21.15.3:0/712552714 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:06.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.022+0000 7f0261400640 1 --2- 172.21.15.3:0/712552714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55723e2a1ca0 0x55723e2a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.022+0000 7f0261e00640 1 -- 172.21.15.3:0/712552714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55723e296ac0 msgr2=0x55723e296ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:06.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.022+0000 7f0261e00640 1 --2- 172.21.15.3:0/712552714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55723e296ac0 0x55723e296ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.022+0000 7f0261e00640 1 -- 172.21.15.3:0/712552714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55723e2a1ca0 msgr2=0x55723e2a4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:06.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.022+0000 7f0261e00640 1 --2- 172.21.15.3:0/712552714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55723e2a1ca0 0x55723e2a4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.022+0000 7f0261e00640 1 -- 172.21.15.3:0/712552714 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55723df6e6a0 con 0x55723e2973e0 2024-09-19T06:21:06.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.023+0000 7f0256a00640 1 --2- 172.21.15.3:0/293613763 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f02440a3430 0x7f02440a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.023+0000 7f0261e00640 1 --2- 172.21.15.3:0/712552714 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55723e2973e0 0x55723e2a1760 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f0250009fa0 tx=0x7f02500118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8652eb20c24bee38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:06.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.023+0000 7f0256a00640 1 -- 172.21.15.3:0/293613763 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8615+0+0 (secure 0 0 0) 0x7f02580d01a0 con 0x7f025c112a30 2024-09-19T06:21:06.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.023+0000 7f0261400640 1 --2- 172.21.15.3:0/293613763 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f02440a3430 0x7f02440a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.023+0000 7f024b000640 1 -- 172.21.15.3:0/712552714 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0250004030 con 0x55723e2973e0 2024-09-19T06:21:06.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.023+0000 7f024b000640 1 -- 172.21.15.3:0/712552714 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0250005500 con 0x55723e2973e0 2024-09-19T06:21:06.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.023+0000 7f024b000640 1 -- 172.21.15.3:0/712552714 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0250004da0 con 0x55723e2973e0 2024-09-19T06:21:06.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.024+0000 7f02673e0740 1 -- 172.21.15.3:0/712552714 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55723e2973e0 msgr2=0x55723e2a1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:06.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.024+0000 7f0261400640 1 --2- 172.21.15.3:0/293613763 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f02440a3430 0x7f02440a58f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55723e2943d0 tx=0x7f024c0058d0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:06.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.024+0000 7f02673e0740 1 --2- 172.21.15.3:0/712552714 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55723e2973e0 0x55723e2a1760 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f0250009fa0 tx=0x7f02500118d0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.024+0000 7f02673e0740 1 -- 172.21.15.3:0/712552714 shutdown_connections 2024-09-19T06:21:06.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.024+0000 7f02673e0740 1 --2- 172.21.15.3:0/712552714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55723e2a1ca0 0x55723e2a4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.024+0000 7f02673e0740 1 --2- 172.21.15.3:0/712552714 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55723e2973e0 0x55723e2a1760 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.024+0000 7f02673e0740 1 --2- 172.21.15.3:0/712552714 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55723e296ac0 0x55723e296ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.024+0000 7f02673e0740 1 -- 172.21.15.3:0/712552714 >> 172.21.15.3:0/712552714 conn(0x55723e293050 msgr2=0x55723e293430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:06.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.024+0000 7f02673e0740 1 -- 172.21.15.3:0/712552714 shutdown_connections 2024-09-19T06:21:06.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.024+0000 7f02673e0740 1 -- 172.21.15.3:0/712552714 wait complete. 2024-09-19T06:21:06.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.025+0000 7f02673e0740 1 -- start start 2024-09-19T06:21:06.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.025+0000 7f02673e0740 1 Processor -- start 2024-09-19T06:21:06.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.025+0000 7f02673e0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55723e296ac0 0x55723e2a1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.025+0000 7f02673e0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55723e2973e0 0x55723e29e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.025+0000 7f02673e0740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55723e2a1ca0 0x55723e29ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.025+0000 7f02673e0740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55723e2a4910 con 0x55723e2a1ca0 2024-09-19T06:21:06.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.025+0000 7f02673e0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55723e1b7fa0 con 0x55723e296ac0 2024-09-19T06:21:06.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.025+0000 7f02673e0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55723e2a4a90 con 0x55723e2973e0 2024-09-19T06:21:06.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.025+0000 7f02673e0740 10 client.0 _ll_register_callbacks cb 0x55723df0bba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:06.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.026+0000 7f0261e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55723e296ac0 0x55723e2a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.026+0000 7f0262800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55723e2a1ca0 0x55723e29ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.026+0000 7f0261e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55723e296ac0 0x55723e2a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:49270/0 (socket says 172.21.15.3:49270) 2024-09-19T06:21:06.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.026+0000 7f0261400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55723e2973e0 0x55723e29e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.026+0000 7f0261e00640 1 -- 172.21.15.3:0/568844269 learned_addr learned my addr 172.21.15.3:0/568844269 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:06.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.026+0000 7f0261e00640 1 -- 172.21.15.3:0/568844269 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55723e2973e0 msgr2=0x55723e29e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:06.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.026+0000 7f0261e00640 1 --2- 172.21.15.3:0/568844269 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55723e2973e0 0x55723e29e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.026+0000 7f0261e00640 1 -- 172.21.15.3:0/568844269 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55723e2a1ca0 msgr2=0x55723e29ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:06.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.026+0000 7f0261e00640 1 --2- 172.21.15.3:0/568844269 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55723e2a1ca0 0x55723e29ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.026+0000 7f0261e00640 1 -- 172.21.15.3:0/568844269 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55723e29f550 con 0x55723e296ac0 2024-09-19T06:21:06.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.026+0000 7f0262800640 1 --2- 172.21.15.3:0/568844269 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55723e2a1ca0 0x55723e29ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:06.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.026+0000 7f0261e00640 1 --2- 172.21.15.3:0/568844269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55723e296ac0 0x55723e2a1580 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0250004600 tx=0x7f02500051f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d45b1071fbd68f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:06.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.026+0000 7f023f400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:21:06.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.027+0000 7f023f400640 1 -- 172.21.15.3:0/568844269 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0250028020 con 0x55723e296ac0 2024-09-19T06:21:06.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.027+0000 7f02673e0740 1 -- 172.21.15.3:0/568844269 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0250005500 con 0x55723e296ac0 2024-09-19T06:21:06.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.027+0000 7f023f400640 1 -- 172.21.15.3:0/568844269 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8615+0+0 (secure 0 0 0) 0x7f02500046c0 con 0x55723e296ac0 2024-09-19T06:21:06.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.027+0000 7f023f400640 1 -- 172.21.15.3:0/568844269 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0250033050 con 0x55723e296ac0 2024-09-19T06:21:06.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.027+0000 7f02673e0740 10 client.27845 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:06.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.027+0000 7f02673e0740 1 -- 172.21.15.3:0/568844269 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55723e2b0800 con 0x55723e296ac0 2024-09-19T06:21:06.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.027+0000 7f023f400640 1 -- 172.21.15.3:0/568844269 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0250005500 con 0x55723e296ac0 2024-09-19T06:21:06.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.028+0000 7f023f400640 1 -- 172.21.15.3:0/568844269 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0250023470 con 0x55723e296ac0 2024-09-19T06:21:06.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.028+0000 7f02673e0740 10 client.27845 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:06.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.028+0000 7f02673e0740 10 client.27845 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:06.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.028+0000 7f02673e0740 20 client.27845 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:06.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.028+0000 7f02673e0740 1 --2- 172.21.15.3:0/568844269 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55723e2b1c10 0x55723e2b4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.028+0000 7f02673e0740 4 client.27845 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:06.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.028+0000 7f02673e0740 1 -- 172.21.15.3:0/568844269 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55723e20a800 con 0x55723e2b1c10 2024-09-19T06:21:06.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.028+0000 7f0261400640 1 --2- 172.21.15.3:0/568844269 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55723e2b1c10 0x55723e2b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.029+0000 7f0261400640 1 --2- 172.21.15.3:0/568844269 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55723e2b1c10 0x55723e2b4000 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78e5be5782d1900c server_cookie=f43c0e2bd4a06961 in_seq=0 out_seq=0 2024-09-19T06:21:06.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.029+0000 7f023f400640 10 client.27845 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:06.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.029+0000 7f023f400640 1 -- 172.21.15.3:0/568844269 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55723e20a800 con 0x55723e2b1c10 2024-09-19T06:21:06.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.029+0000 7f023f400640 10 client.27845 handle_command_reply: tid=0 2024-09-19T06:21:06.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.029+0000 7f02673e0740 1 client.27845 shutdown 2024-09-19T06:21:06.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.030+0000 7f02673e0740 1 -- 172.21.15.3:0/568844269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55723e296ac0 msgr2=0x55723e2a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:06.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.030+0000 7f02673e0740 1 --2- 172.21.15.3:0/568844269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55723e296ac0 0x55723e2a1580 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0250004600 tx=0x7f02500051f0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.030+0000 7f02673e0740 1 -- 172.21.15.3:0/568844269 shutdown_connections 2024-09-19T06:21:06.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.030+0000 7f02673e0740 1 --2- 172.21.15.3:0/568844269 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55723e2b1c10 0x55723e2b4000 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.030+0000 7f02673e0740 1 --2- 172.21.15.3:0/568844269 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55723e2a1ca0 0x55723e29ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.030+0000 7f02673e0740 1 --2- 172.21.15.3:0/568844269 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55723e2973e0 0x55723e29e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.030+0000 7f02673e0740 1 --2- 172.21.15.3:0/568844269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55723e296ac0 0x55723e2a1580 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.030+0000 7f023f400640 0 client.27845 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:06.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.030+0000 7f02673e0740 1 -- 172.21.15.3:0/568844269 >> 172.21.15.3:0/568844269 conn(0x55723e293050 msgr2=0x55723e298d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:06.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.030+0000 7f02673e0740 1 -- 172.21.15.3:0/568844269 shutdown_connections 2024-09-19T06:21:06.034 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.030+0000 7f02673e0740 1 -- 172.21.15.3:0/568844269 wait complete. 2024-09-19T06:21:06.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.030+0000 7f02673e0740 20 client.27845 trim_cache size 0 max 16384 2024-09-19T06:21:06.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.049+0000 7f02673e0740 1 Processor -- start 2024-09-19T06:21:06.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.049+0000 7f02673e0740 1 -- start start 2024-09-19T06:21:06.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.050+0000 7f02673e0740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55723e296ac0 0x55723e2a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.050+0000 7f02673e0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55723e2973e0 0x55723e2b9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.050+0000 7f02673e0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55723e2a1ca0 0x55723e2b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.050+0000 7f02673e0740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f025c1b40d0 con 0x55723e296ac0 2024-09-19T06:21:06.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.050+0000 7f02673e0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f025c1b5c10 con 0x55723e2a1ca0 2024-09-19T06:21:06.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.050+0000 7f02673e0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f025c1b47a0 con 0x55723e2973e0 2024-09-19T06:21:06.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.050+0000 7f0261400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55723e2973e0 0x55723e2b9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.050+0000 7f0261e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55723e296ac0 0x55723e2a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.050+0000 7f0261400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55723e2973e0 0x55723e2b9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:37592/0 (socket says 172.21.15.3:37592) 2024-09-19T06:21:06.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.050+0000 7f0261400640 1 -- 172.21.15.3:0/2960341743 learned_addr learned my addr 172.21.15.3:0/2960341743 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:06.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.050+0000 7f0261e00640 1 --2- 172.21.15.3:0/2960341743 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55723e296ac0 0x55723e2a10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45170/0 (socket says 172.21.15.3:45170) 2024-09-19T06:21:06.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.050+0000 7f0262800640 1 --2- 172.21.15.3:0/2960341743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55723e2a1ca0 0x55723e2b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.050+0000 7f0261400640 1 -- 172.21.15.3:0/2960341743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55723e2a1ca0 msgr2=0x55723e2b9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:06.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.050+0000 7f0261400640 1 --2- 172.21.15.3:0/2960341743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55723e2a1ca0 0x55723e2b9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.050+0000 7f0261400640 1 -- 172.21.15.3:0/2960341743 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55723e296ac0 msgr2=0x55723e2a10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:06.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.050+0000 7f0261400640 1 --2- 172.21.15.3:0/2960341743 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55723e296ac0 0x55723e2a10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.050+0000 7f0261400640 1 -- 172.21.15.3:0/2960341743 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55723e296840 con 0x55723e2973e0 2024-09-19T06:21:06.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.051+0000 7f0261400640 1 --2- 172.21.15.3:0/2960341743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55723e2973e0 0x55723e2b9790 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f024c009230 tx=0x7f024c02a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c38b7a6ae5fe9e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:06.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.051+0000 7f024a600640 1 -- 172.21.15.3:0/2960341743 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c035040 con 0x55723e2973e0 2024-09-19T06:21:06.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.051+0000 7f024a600640 1 -- 172.21.15.3:0/2960341743 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f024c058070 con 0x55723e2973e0 2024-09-19T06:21:06.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.051+0000 7f024a600640 1 -- 172.21.15.3:0/2960341743 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c0035f0 con 0x55723e2973e0 2024-09-19T06:21:06.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.052+0000 7f02673e0740 1 -- 172.21.15.3:0/2960341743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55723e2973e0 msgr2=0x55723e2b9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:06.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.052+0000 7f02673e0740 1 --2- 172.21.15.3:0/2960341743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55723e2973e0 0x55723e2b9790 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f024c009230 tx=0x7f024c02a410 comp rx=0 tx=0).stop 2024-09-19T06:21:06.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.052+0000 7f02673e0740 1 -- 172.21.15.3:0/2960341743 shutdown_connections 2024-09-19T06:21:06.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.052+0000 7f02673e0740 1 --2- 172.21.15.3:0/2960341743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55723e2a1ca0 0x55723e2b9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.052+0000 7f02673e0740 1 --2- 172.21.15.3:0/2960341743 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55723e2973e0 0x55723e2b9790 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.052+0000 7f02673e0740 1 --2- 172.21.15.3:0/2960341743 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55723e296ac0 0x55723e2a10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.052+0000 7f02673e0740 1 -- 172.21.15.3:0/2960341743 >> 172.21.15.3:0/2960341743 conn(0x55723e293050 msgr2=0x55723e298d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:06.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.052+0000 7f02673e0740 1 -- 172.21.15.3:0/2960341743 shutdown_connections 2024-09-19T06:21:06.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.052+0000 7f02673e0740 1 -- 172.21.15.3:0/2960341743 wait complete. 2024-09-19T06:21:06.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.053+0000 7f02673e0740 1 -- start start 2024-09-19T06:21:06.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.053+0000 7f02673e0740 1 Processor -- start 2024-09-19T06:21:06.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.053+0000 7f02673e0740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55723e296ac0 0x55723e2aa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.053+0000 7f02673e0740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55723e2973e0 0x55723e2a5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.053+0000 7f02673e0740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55723e2a1ca0 0x55723e2a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.053+0000 7f02673e0740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f025c1b5540 con 0x55723e2a1ca0 2024-09-19T06:21:06.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.053+0000 7f02673e0740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f025c1b4e70 con 0x55723e296ac0 2024-09-19T06:21:06.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.053+0000 7f02673e0740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f025c1b20d0 con 0x55723e2973e0 2024-09-19T06:21:06.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.053+0000 7f02673e0740 10 client.0 _ll_register_callbacks cb 0x7f024c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:06.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.054+0000 7f0261e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55723e296ac0 0x55723e2aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.054+0000 7f0261e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55723e296ac0 0x55723e2aa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:49278/0 (socket says 172.21.15.3:49278) 2024-09-19T06:21:06.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.054+0000 7f0262800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55723e2a1ca0 0x55723e2a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.054+0000 7f0261e00640 1 -- 172.21.15.3:0/477873701 learned_addr learned my addr 172.21.15.3:0/477873701 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:06.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.054+0000 7f0261400640 1 --2- 172.21.15.3:0/477873701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55723e2973e0 0x55723e2a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.054+0000 7f0261e00640 1 -- 172.21.15.3:0/477873701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55723e2973e0 msgr2=0x55723e2a5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:06.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.054+0000 7f0261e00640 1 --2- 172.21.15.3:0/477873701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55723e2973e0 0x55723e2a5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.054+0000 7f0261e00640 1 -- 172.21.15.3:0/477873701 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55723e2a1ca0 msgr2=0x55723e2a5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:06.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.054+0000 7f0261e00640 1 --2- 172.21.15.3:0/477873701 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55723e2a1ca0 0x55723e2a5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.054+0000 7f0261e00640 1 -- 172.21.15.3:0/477873701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55723e2a6630 con 0x55723e296ac0 2024-09-19T06:21:06.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.054+0000 7f0261e00640 1 --2- 172.21.15.3:0/477873701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55723e296ac0 0x55723e2aa530 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0250023a30 tx=0x7f0250005da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e94e692a9095785 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:06.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.054+0000 7f023f400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:21:06.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.055+0000 7f023f400640 1 -- 172.21.15.3:0/477873701 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025003c060 con 0x55723e296ac0 2024-09-19T06:21:06.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.055+0000 7f023f400640 1 -- 172.21.15.3:0/477873701 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8615+0+0 (secure 0 0 0) 0x7f0250023ab0 con 0x55723e296ac0 2024-09-19T06:21:06.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.055+0000 7f02673e0740 1 -- 172.21.15.3:0/477873701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f024c058070 con 0x55723e296ac0 2024-09-19T06:21:06.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.055+0000 7f023f400640 1 -- 172.21.15.3:0/477873701 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0250028050 con 0x55723e296ac0 2024-09-19T06:21:06.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.055+0000 7f02673e0740 10 client.27851 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:06.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.055+0000 7f02673e0740 1 -- 172.21.15.3:0/477873701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55723e31c870 con 0x55723e296ac0 2024-09-19T06:21:06.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.055+0000 7f023f400640 1 -- 172.21.15.3:0/477873701 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f024c058070 con 0x55723e296ac0 2024-09-19T06:21:06.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.055+0000 7f023f400640 1 -- 172.21.15.3:0/477873701 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f025000f630 con 0x55723e296ac0 2024-09-19T06:21:06.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.056+0000 7f02673e0740 10 client.27851 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:06.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.056+0000 7f02673e0740 10 client.27851 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:06.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.056+0000 7f02673e0740 20 client.27851 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:06.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.056+0000 7f02673e0740 1 --2- 172.21.15.3:0/477873701 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55723e31cee0 0x55723e31f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:06.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.056+0000 7f02673e0740 4 client.27851 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:21:06.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.056+0000 7f02673e0740 1 -- 172.21.15.3:0/477873701 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55723e204d10 con 0x55723e31cee0 2024-09-19T06:21:06.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.056+0000 7f0261400640 1 --2- 172.21.15.3:0/477873701 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55723e31cee0 0x55723e31f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:06.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.056+0000 7f0261400640 1 --2- 172.21.15.3:0/477873701 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55723e31cee0 0x55723e31f300 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ecf08ea196a5d9b server_cookie=8e5f4c426b94704e in_seq=0 out_seq=0 2024-09-19T06:21:06.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.056+0000 7f023f400640 10 client.27851 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:06.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.058+0000 7f023f400640 1 -- 172.21.15.3:0/477873701 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55723e204d10 con 0x55723e31cee0 2024-09-19T06:21:06.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.058+0000 7f023f400640 10 client.27851 handle_command_reply: tid=0 2024-09-19T06:21:06.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.058+0000 7f02673e0740 1 client.27851 shutdown 2024-09-19T06:21:06.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.058+0000 7f02673e0740 1 -- 172.21.15.3:0/477873701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55723e296ac0 msgr2=0x55723e2aa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:06.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.058+0000 7f02673e0740 1 --2- 172.21.15.3:0/477873701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55723e296ac0 0x55723e2aa530 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0250023a30 tx=0x7f0250005da0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.058+0000 7f02673e0740 1 -- 172.21.15.3:0/477873701 shutdown_connections 2024-09-19T06:21:06.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.058+0000 7f02673e0740 1 --2- 172.21.15.3:0/477873701 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55723e31cee0 0x55723e31f300 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.058+0000 7f02673e0740 1 --2- 172.21.15.3:0/477873701 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55723e2a1ca0 0x55723e2a5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.058+0000 7f02673e0740 1 --2- 172.21.15.3:0/477873701 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55723e2973e0 0x55723e2a5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.058+0000 7f02673e0740 1 --2- 172.21.15.3:0/477873701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55723e296ac0 0x55723e2aa530 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.058+0000 7f023f400640 0 client.27851 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:06.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.058+0000 7f02673e0740 1 -- 172.21.15.3:0/477873701 >> 172.21.15.3:0/477873701 conn(0x55723e293050 msgr2=0x55723e29cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:06.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.058+0000 7f02673e0740 1 -- 172.21.15.3:0/477873701 shutdown_connections 2024-09-19T06:21:06.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.058+0000 7f02673e0740 1 -- 172.21.15.3:0/477873701 wait complete. 2024-09-19T06:21:06.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.058+0000 7f02673e0740 20 client.27851 trim_cache size 0 max 16384 2024-09-19T06:21:06.063 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:21:06.063 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": 0, 2024-09-19T06:21:06.063 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_tag": "ec620769-24f0-4ed8-9580-803d742b3e67", 2024-09-19T06:21:06.063 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": "asynchronous" 2024-09-19T06:21:06.063 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:21:06.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.059+0000 7f0264800640 1 -- 172.21.15.3:0/293613763 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f02440a3430 msgr2=0x7f02440a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:06.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.059+0000 7f0264800640 1 --2- 172.21.15.3:0/293613763 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f02440a3430 0x7f02440a58f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55723e2943d0 tx=0x7f024c0058d0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.059+0000 7f0264800640 1 -- 172.21.15.3:0/293613763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f025c112a30 msgr2=0x7f025c19e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:06.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.059+0000 7f0264800640 1 --2- 172.21.15.3:0/293613763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f025c112a30 0x7f025c19e8c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f0258009fd0 tx=0x7f025800ee60 comp rx=0 tx=0).stop 2024-09-19T06:21:06.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.059+0000 7f0264800640 1 -- 172.21.15.3:0/293613763 shutdown_connections 2024-09-19T06:21:06.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.059+0000 7f0264800640 1 --2- 172.21.15.3:0/293613763 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f02440a3430 0x7f02440a58f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.059+0000 7f0264800640 1 --2- 172.21.15.3:0/293613763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f025c112a30 0x7f025c19e8c0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.059+0000 7f0264800640 1 --2- 172.21.15.3:0/293613763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c077040 0x7f025c1a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.059+0000 7f0264800640 1 --2- 172.21.15.3:0/293613763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f025c076720 0x7f025c1a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:06.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.059+0000 7f0264800640 1 -- 172.21.15.3:0/293613763 >> 172.21.15.3:0/293613763 conn(0x7f025c0ffa90 msgr2=0x7f025c101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:06.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.060+0000 7f0264800640 1 -- 172.21.15.3:0/293613763 shutdown_connections 2024-09-19T06:21:06.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:06.060+0000 7f0264800640 1 -- 172.21.15.3:0/293613763 wait complete. 2024-09-19T06:21:06.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:06 smithi003 ceph-mon[30893]: pgmap v268: 97 pgs: 97 active+clean; 4.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 106 KiB/s wr, 40 op/s 2024-09-19T06:21:06.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:06 smithi003 ceph-mon[30893]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T06:21:06.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:06 smithi003 ceph-mon[30893]: scrub queued for path: / 2024-09-19T06:21:06.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:06 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:06.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:06 smithi003 ceph-mon[30893]: scrub summary: active paths [/] 2024-09-19T06:21:06.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:06 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:06.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:06 smithi059 ceph-mon[35138]: pgmap v268: 97 pgs: 97 active+clean; 4.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 106 KiB/s wr, 40 op/s 2024-09-19T06:21:06.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:06 smithi059 ceph-mon[35138]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T06:21:06.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:06 smithi059 ceph-mon[35138]: scrub queued for path: / 2024-09-19T06:21:06.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:06 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:06.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:06 smithi059 ceph-mon[35138]: scrub summary: active paths [/] 2024-09-19T06:21:06.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:06 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:06.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:06 smithi071 ceph-mon[35662]: pgmap v268: 97 pgs: 97 active+clean; 4.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 106 KiB/s wr, 40 op/s 2024-09-19T06:21:06.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:06 smithi071 ceph-mon[35662]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T06:21:06.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:06 smithi071 ceph-mon[35662]: scrub queued for path: / 2024-09-19T06:21:06.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:06 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:06.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:06 smithi071 ceph-mon[35662]: scrub summary: active paths [/] 2024-09-19T06:21:06.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:06 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:07.056 INFO:tasks.workunit.client.0.smithi003.stdout:375/600: open fd = 3 2024-09-19T06:21:07.056 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.056 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.056 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.056 INFO:tasks.workunit.client.0.smithi003.stdout:376/600: open fd = 3 2024-09-19T06:21:07.056 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.057 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.057 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.057 INFO:tasks.workunit.client.0.smithi003.stdout:377/600: open fd = 3 2024-09-19T06:21:07.057 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.057 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.057 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.057 INFO:tasks.workunit.client.0.smithi003.stdout:378/600: open fd = 3 2024-09-19T06:21:07.057 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.057 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.057 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.057 INFO:tasks.workunit.client.0.smithi003.stdout:379/600: open fd = 3 2024-09-19T06:21:07.057 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.057 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.058 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.058 INFO:tasks.workunit.client.0.smithi003.stdout:380/600: open fd = 3 2024-09-19T06:21:07.058 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.058 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.058 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.058 INFO:tasks.workunit.client.0.smithi003.stdout:381/600: open fd = 3 2024-09-19T06:21:07.058 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.058 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.058 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.058 INFO:tasks.workunit.client.0.smithi003.stdout:382/600: open fd = 3 2024-09-19T06:21:07.058 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.059 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.059 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.059 INFO:tasks.workunit.client.0.smithi003.stdout:383/600: open fd = 3 2024-09-19T06:21:07.059 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.059 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.059 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.059 INFO:tasks.workunit.client.0.smithi003.stdout:384/600: open fd = 3 2024-09-19T06:21:07.059 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.059 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.059 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.059 INFO:tasks.workunit.client.0.smithi003.stdout:385/600: open fd = 3 2024-09-19T06:21:07.059 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.059 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.059 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.059 INFO:tasks.workunit.client.0.smithi003.stdout:386/600: open fd = 3 2024-09-19T06:21:07.060 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.060 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.060 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.060 INFO:tasks.workunit.client.0.smithi003.stdout:387/600: open fd = 3 2024-09-19T06:21:07.060 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.060 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.060 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.060 INFO:tasks.workunit.client.0.smithi003.stdout:388/600: open fd = 3 2024-09-19T06:21:07.060 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.060 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.060 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.060 INFO:tasks.workunit.client.0.smithi003.stdout:389/600: open fd = 3 2024-09-19T06:21:07.060 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.060 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.061 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.061 INFO:tasks.workunit.client.0.smithi003.stdout:390/600: open fd = 3 2024-09-19T06:21:07.061 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.061 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.061 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.061 INFO:tasks.workunit.client.0.smithi003.stdout:391/600: open fd = 3 2024-09-19T06:21:07.061 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.061 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.061 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.061 INFO:tasks.workunit.client.0.smithi003.stdout:392/600: open fd = 3 2024-09-19T06:21:07.061 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.062 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.062 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.062 INFO:tasks.workunit.client.0.smithi003.stdout:393/600: open fd = 3 2024-09-19T06:21:07.062 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.062 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.062 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.062 INFO:tasks.workunit.client.0.smithi003.stdout:394/600: open fd = 3 2024-09-19T06:21:07.062 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.062 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.062 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.062 INFO:tasks.workunit.client.0.smithi003.stdout:395/600: open fd = 3 2024-09-19T06:21:07.062 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.062 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.063 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.063 INFO:tasks.workunit.client.0.smithi003.stdout:396/600: open fd = 3 2024-09-19T06:21:07.063 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.063 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.063 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.063 INFO:tasks.workunit.client.0.smithi003.stdout:397/600: open fd = 3 2024-09-19T06:21:07.063 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.063 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.063 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.063 INFO:tasks.workunit.client.0.smithi003.stdout:398/600: open fd = 3 2024-09-19T06:21:07.063 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.063 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.063 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.064 INFO:tasks.workunit.client.0.smithi003.stdout:399/600: open fd = 3 2024-09-19T06:21:07.064 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.064 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.064 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.064 INFO:tasks.workunit.client.0.smithi003.stdout:400/600: open fd = 3 2024-09-19T06:21:07.064 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.064 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.064 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.064 INFO:tasks.workunit.client.0.smithi003.stdout:401/600: open fd = 3 2024-09-19T06:21:07.064 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.065 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.065 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.065 INFO:tasks.workunit.client.0.smithi003.stdout:402/600: open fd = 3 2024-09-19T06:21:07.065 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.065 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.065 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.065 INFO:tasks.workunit.client.0.smithi003.stdout:403/600: open fd = 3 2024-09-19T06:21:07.065 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.066 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.066 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.066 INFO:tasks.workunit.client.0.smithi003.stdout:404/600: open fd = 3 2024-09-19T06:21:07.066 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.066 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.066 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.066 INFO:tasks.workunit.client.0.smithi003.stdout:405/600: open fd = 3 2024-09-19T06:21:07.066 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.066 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.067 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.067 INFO:tasks.workunit.client.0.smithi003.stdout:406/600: open fd = 3 2024-09-19T06:21:07.067 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.067 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.067 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.067 INFO:tasks.workunit.client.0.smithi003.stdout:407/600: open fd = 3 2024-09-19T06:21:07.067 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.067 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.068 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.068 INFO:tasks.workunit.client.0.smithi003.stdout:408/600: open fd = 3 2024-09-19T06:21:07.068 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.068 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.068 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.069 INFO:tasks.workunit.client.0.smithi003.stdout:409/600: open fd = 3 2024-09-19T06:21:07.069 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.069 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.069 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.069 INFO:tasks.workunit.client.0.smithi003.stdout:410/600: open fd = 3 2024-09-19T06:21:07.069 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.070 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.070 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.070 INFO:tasks.workunit.client.0.smithi003.stdout:411/600: open fd = 3 2024-09-19T06:21:07.070 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.070 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.070 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.070 INFO:tasks.workunit.client.0.smithi003.stdout:412/600: open fd = 3 2024-09-19T06:21:07.070 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.070 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.070 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.070 INFO:tasks.workunit.client.0.smithi003.stdout:413/600: open fd = 3 2024-09-19T06:21:07.070 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.071 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.071 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.071 INFO:tasks.workunit.client.0.smithi003.stdout:414/600: open fd = 3 2024-09-19T06:21:07.071 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.071 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.071 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.072 INFO:tasks.workunit.client.0.smithi003.stdout:415/600: open fd = 3 2024-09-19T06:21:07.072 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.072 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.072 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.072 INFO:tasks.workunit.client.0.smithi003.stdout:416/600: open fd = 3 2024-09-19T06:21:07.072 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.072 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.072 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.072 INFO:tasks.workunit.client.0.smithi003.stdout:417/600: open fd = 3 2024-09-19T06:21:07.072 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.072 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.072 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.072 INFO:tasks.workunit.client.0.smithi003.stdout:418/600: open fd = 3 2024-09-19T06:21:07.073 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.073 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.073 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.073 INFO:tasks.workunit.client.0.smithi003.stdout:419/600: open fd = 3 2024-09-19T06:21:07.073 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.073 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.073 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.073 INFO:tasks.workunit.client.0.smithi003.stdout:420/600: open fd = 3 2024-09-19T06:21:07.073 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.073 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.073 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.073 INFO:tasks.workunit.client.0.smithi003.stdout:421/600: open fd = 3 2024-09-19T06:21:07.073 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.074 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.074 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.074 INFO:tasks.workunit.client.0.smithi003.stdout:422/600: open fd = 3 2024-09-19T06:21:07.074 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.074 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.074 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.074 INFO:tasks.workunit.client.0.smithi003.stdout:423/600: open fd = 3 2024-09-19T06:21:07.074 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.074 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.074 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.074 INFO:tasks.workunit.client.0.smithi003.stdout:424/600: open fd = 3 2024-09-19T06:21:07.074 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.075 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.075 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.075 INFO:tasks.workunit.client.0.smithi003.stdout:425/600: open fd = 3 2024-09-19T06:21:07.075 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.075 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.075 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.075 INFO:tasks.workunit.client.0.smithi003.stdout:426/600: open fd = 3 2024-09-19T06:21:07.075 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.075 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.075 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.075 INFO:tasks.workunit.client.0.smithi003.stdout:427/600: open fd = 3 2024-09-19T06:21:07.075 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.075 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.076 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.076 INFO:tasks.workunit.client.0.smithi003.stdout:428/600: open fd = 3 2024-09-19T06:21:07.076 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.076 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.076 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.076 INFO:tasks.workunit.client.0.smithi003.stdout:429/600: open fd = 3 2024-09-19T06:21:07.076 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.076 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.076 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.076 INFO:tasks.workunit.client.0.smithi003.stdout:430/600: open fd = 3 2024-09-19T06:21:07.076 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.076 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.077 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.077 INFO:tasks.workunit.client.0.smithi003.stdout:431/600: open fd = 3 2024-09-19T06:21:07.077 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.077 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.077 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.077 INFO:tasks.workunit.client.0.smithi003.stdout:432/600: open fd = 3 2024-09-19T06:21:07.077 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.077 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.077 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.077 INFO:tasks.workunit.client.0.smithi003.stdout:433/600: open fd = 3 2024-09-19T06:21:07.077 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.077 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.078 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.078 INFO:tasks.workunit.client.0.smithi003.stdout:434/600: open fd = 3 2024-09-19T06:21:07.078 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.078 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.078 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.078 INFO:tasks.workunit.client.0.smithi003.stdout:435/600: open fd = 3 2024-09-19T06:21:07.078 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.078 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.078 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.078 INFO:tasks.workunit.client.0.smithi003.stdout:436/600: open fd = 3 2024-09-19T06:21:07.078 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.078 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:21:07.078 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:21:07.270 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:21:07.649 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:08.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.238+0000 7f8e11400640 1 -- 172.21.15.3:0/4180435419 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e0c102790 msgr2=0x7f8e0c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:08.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.238+0000 7f8e11400640 1 --2- 172.21.15.3:0/4180435419 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e0c102790 0x7f8e0c1067e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f8df4009900 tx=0x7f8df402a410 comp rx=0 tx=0).stop 2024-09-19T06:21:08.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.238+0000 7f8e11400640 1 -- 172.21.15.3:0/4180435419 shutdown_connections 2024-09-19T06:21:08.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.238+0000 7f8e11400640 1 --2- 172.21.15.3:0/4180435419 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e0c106f10 0x7f8e0c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.238+0000 7f8e11400640 1 --2- 172.21.15.3:0/4180435419 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e0c102790 0x7f8e0c1067e0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.238+0000 7f8e11400640 1 --2- 172.21.15.3:0/4180435419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e0c101de0 0x7f8e0c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.238+0000 7f8e11400640 1 -- 172.21.15.3:0/4180435419 >> 172.21.15.3:0/4180435419 conn(0x7f8e0c0fd8c0 msgr2=0x7f8e0c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:08.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.238+0000 7f8e11400640 1 -- 172.21.15.3:0/4180435419 shutdown_connections 2024-09-19T06:21:08.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.238+0000 7f8e11400640 1 -- 172.21.15.3:0/4180435419 wait complete. 2024-09-19T06:21:08.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.239+0000 7f8e11400640 1 Processor -- start 2024-09-19T06:21:08.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.239+0000 7f8e11400640 1 -- start start 2024-09-19T06:21:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.240+0000 7f8e11400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e0c101de0 0x7f8e0c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.240+0000 7f8e11400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e0c102790 0x7f8e0c1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.240+0000 7f8e11400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e0c106f10 0x7f8e0c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.240+0000 7f8e11400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c111fc0 con 0x7f8e0c106f10 2024-09-19T06:21:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.240+0000 7f8e11400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c111e40 con 0x7f8e0c101de0 2024-09-19T06:21:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.240+0000 7f8e11400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c112140 con 0x7f8e0c102790 2024-09-19T06:21:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.240+0000 7f8e01e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e0c102790 0x7f8e0c1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.240+0000 7f8e0b200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e0c106f10 0x7f8e0c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.240+0000 7f8e01e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e0c102790 0x7f8e0c1989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:37622/0 (socket says 172.21.15.3:37622) 2024-09-19T06:21:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.240+0000 7f8e0a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e0c101de0 0x7f8e0c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.240+0000 7f8e01e00640 1 -- 172.21.15.3:0/858534924 learned_addr learned my addr 172.21.15.3:0/858534924 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.241+0000 7f8e0a800640 1 -- 172.21.15.3:0/858534924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e0c102790 msgr2=0x7f8e0c1989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.241+0000 7f8e0a800640 1 --2- 172.21.15.3:0/858534924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e0c102790 0x7f8e0c1989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.241+0000 7f8e0a800640 1 -- 172.21.15.3:0/858534924 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e0c106f10 msgr2=0x7f8e0c19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:08.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.241+0000 7f8e0a800640 1 --2- 172.21.15.3:0/858534924 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e0c106f10 0x7f8e0c19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.241+0000 7f8e0a800640 1 -- 172.21.15.3:0/858534924 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e0c19d410 con 0x7f8e0c101de0 2024-09-19T06:21:08.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.241+0000 7f8e0b200640 1 --2- 172.21.15.3:0/858534924 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e0c106f10 0x7f8e0c19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:08.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.241+0000 7f8e0a800640 1 --2- 172.21.15.3:0/858534924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e0c101de0 0x7f8e0c198460 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00e9f0 tx=0x7f8dfc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:08.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.241+0000 7f8e03e00640 1 -- 172.21.15.3:0/858534924 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc00cd80 con 0x7f8e0c101de0 2024-09-19T06:21:08.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.241+0000 7f8e03e00640 1 -- 172.21.15.3:0/858534924 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dfc0035f0 con 0x7f8e0c101de0 2024-09-19T06:21:08.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.241+0000 7f8e03e00640 1 -- 172.21.15.3:0/858534924 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc010690 con 0x7f8e0c101de0 2024-09-19T06:21:08.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.241+0000 7f8e11400640 1 -- 172.21.15.3:0/858534924 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e0c19d700 con 0x7f8e0c101de0 2024-09-19T06:21:08.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.241+0000 7f8e11400640 1 -- 172.21.15.3:0/858534924 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e0c1a4fe0 con 0x7f8e0c101de0 2024-09-19T06:21:08.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.244+0000 7f8e13e0e740 1 Processor -- start 2024-09-19T06:21:08.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.244+0000 7f8e03e00640 1 -- 172.21.15.3:0/858534924 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f8dfc003b30 con 0x7f8e0c101de0 2024-09-19T06:21:08.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.245+0000 7f8e13e0e740 1 -- start start 2024-09-19T06:21:08.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.245+0000 7f8e13e0e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b60429cb90 0x55b60429cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:08.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.245+0000 7f8e13e0e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60429d4b0 0x55b6042a7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:08.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.245+0000 7f8e13e0e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6042a7d70 0x55b6042aa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:08.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.245+0000 7f8e13e0e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b6042033e0 con 0x55b6042a7d70 2024-09-19T06:21:08.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.245+0000 7f8e13e0e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b6041aad80 con 0x55b60429d4b0 2024-09-19T06:21:08.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.245+0000 7f8e13e0e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b6041ff3a0 con 0x55b60429cb90 2024-09-19T06:21:08.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.245+0000 7f8e01e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6042a7d70 0x55b6042aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:08.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.245+0000 7f8e01e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6042a7d70 0x55b6042aa160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45198/0 (socket says 172.21.15.3:45198) 2024-09-19T06:21:08.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.245+0000 7f8e01e00640 1 -- 172.21.15.3:0/6548949 learned_addr learned my addr 172.21.15.3:0/6548949 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:08.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.245+0000 7f8e0b200640 1 --2- 172.21.15.3:0/6548949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b60429cb90 0x55b60429cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:08.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.245+0000 7f8e0a800640 1 --2- 172.21.15.3:0/6548949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60429d4b0 0x55b6042a7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:08.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.246+0000 7f8e01e00640 1 -- 172.21.15.3:0/6548949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b60429cb90 msgr2=0x55b60429cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:08.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.246+0000 7f8e01e00640 1 --2- 172.21.15.3:0/6548949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b60429cb90 0x55b60429cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.246+0000 7f8e01e00640 1 -- 172.21.15.3:0/6548949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60429d4b0 msgr2=0x55b6042a7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:08.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.246+0000 7f8e01e00640 1 --2- 172.21.15.3:0/6548949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60429d4b0 0x55b6042a7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.246+0000 7f8e01e00640 1 -- 172.21.15.3:0/6548949 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6041c9ae0 con 0x55b6042a7d70 2024-09-19T06:21:08.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.246+0000 7f8e0b200640 1 --2- 172.21.15.3:0/6548949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b60429cb90 0x55b60429cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:08.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.246+0000 7f8e0a800640 1 --2- 172.21.15.3:0/6548949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60429d4b0 0x55b6042a7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:08.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.246+0000 7f8e01e00640 1 --2- 172.21.15.3:0/6548949 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6042a7d70 0x55b6042aa160 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8df4006010 tx=0x7f8df4005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad58567e4fe1b6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:08.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.246+0000 7f8e03e00640 1 --2- 172.21.15.3:0/858534924 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8df00a34b0 0x7f8df00a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:08.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.246+0000 7f8e03e00640 1 -- 172.21.15.3:0/858534924 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8615+0+0 (secure 0 0 0) 0x7f8dfc0d0070 con 0x7f8e0c101de0 2024-09-19T06:21:08.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.246+0000 7f8dfb400640 1 -- 172.21.15.3:0/6548949 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df4040070 con 0x55b6042a7d70 2024-09-19T06:21:08.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.247+0000 7f8dfb400640 1 -- 172.21.15.3:0/6548949 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8df4004400 con 0x55b6042a7d70 2024-09-19T06:21:08.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.247+0000 7f8dfb400640 1 -- 172.21.15.3:0/6548949 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df4035040 con 0x55b6042a7d70 2024-09-19T06:21:08.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.247+0000 7f8e0b200640 1 --2- 172.21.15.3:0/858534924 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8df00a34b0 0x7f8df00a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:08.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.247+0000 7f8e13e0e740 1 -- 172.21.15.3:0/6548949 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6042a7d70 msgr2=0x55b6042aa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:08.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.247+0000 7f8e0b200640 1 --2- 172.21.15.3:0/858534924 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8df00a34b0 0x7f8df00a5970 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8e04009fd0 tx=0x7f8e04009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:08.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.247+0000 7f8e13e0e740 1 --2- 172.21.15.3:0/6548949 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6042a7d70 0x55b6042aa160 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8df4006010 tx=0x7f8df4005c00 comp rx=0 tx=0).stop 2024-09-19T06:21:08.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.247+0000 7f8e13e0e740 1 -- 172.21.15.3:0/6548949 shutdown_connections 2024-09-19T06:21:08.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.247+0000 7f8e13e0e740 1 --2- 172.21.15.3:0/6548949 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6042a7d70 0x55b6042aa160 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.247+0000 7f8e13e0e740 1 --2- 172.21.15.3:0/6548949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60429d4b0 0x55b6042a7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.247+0000 7f8e13e0e740 1 --2- 172.21.15.3:0/6548949 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b60429cb90 0x55b60429cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.247+0000 7f8e13e0e740 1 -- 172.21.15.3:0/6548949 >> 172.21.15.3:0/6548949 conn(0x55b604299120 msgr2=0x55b604299500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:08.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.248+0000 7f8e13e0e740 1 -- 172.21.15.3:0/6548949 shutdown_connections 2024-09-19T06:21:08.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.248+0000 7f8e13e0e740 1 -- 172.21.15.3:0/6548949 wait complete. 2024-09-19T06:21:08.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.248+0000 7f8e13e0e740 1 -- start start 2024-09-19T06:21:08.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.248+0000 7f8e13e0e740 1 Processor -- start 2024-09-19T06:21:08.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.249+0000 7f8e13e0e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60429cb90 0x55b6042a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:08.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.249+0000 7f8e13e0e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b60429d4b0 0x55b6042a5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:08.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.249+0000 7f8e13e0e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6042a7d70 0x55b6042a56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:08.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.249+0000 7f8e13e0e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b6042aa9e0 con 0x55b60429d4b0 2024-09-19T06:21:08.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.249+0000 7f8e13e0e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b6041be0f0 con 0x55b60429cb90 2024-09-19T06:21:08.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.249+0000 7f8e13e0e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b6042aab60 con 0x55b6042a7d70 2024-09-19T06:21:08.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.249+0000 7f8e13e0e740 10 client.0 _ll_register_callbacks cb 0x55b6041af9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:08.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.249+0000 7f8e01e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b60429d4b0 0x55b6042a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:08.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.249+0000 7f8e0a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60429cb90 0x55b6042a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:08.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.249+0000 7f8e0a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60429cb90 0x55b6042a4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:49306/0 (socket says 172.21.15.3:49306) 2024-09-19T06:21:08.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.249+0000 7f8e0a800640 1 -- 172.21.15.3:0/1924821069 learned_addr learned my addr 172.21.15.3:0/1924821069 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:08.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.249+0000 7f8e0b200640 1 --2- 172.21.15.3:0/1924821069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6042a7d70 0x55b6042a56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:08.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.250+0000 7f8e0a800640 1 -- 172.21.15.3:0/1924821069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6042a7d70 msgr2=0x55b6042a56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:08.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.250+0000 7f8e0a800640 1 --2- 172.21.15.3:0/1924821069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6042a7d70 0x55b6042a56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.250+0000 7f8e0a800640 1 -- 172.21.15.3:0/1924821069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b60429d4b0 msgr2=0x55b6042a5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:08.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.250+0000 7f8e0a800640 1 --2- 172.21.15.3:0/1924821069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b60429d4b0 0x55b6042a5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.250+0000 7f8e0a800640 1 -- 172.21.15.3:0/1924821069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b603f743c0 con 0x55b60429cb90 2024-09-19T06:21:08.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.250+0000 7f8e01e00640 1 --2- 172.21.15.3:0/1924821069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b60429d4b0 0x55b6042a5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:08.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.250+0000 7f8e0a800640 1 --2- 172.21.15.3:0/1924821069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60429cb90 0x55b6042a4c40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc01f000 tx=0x7f8dfc09c150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b353164ada6f97d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:08.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.250+0000 7f8defe00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:21:08.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.250+0000 7f8defe00640 1 -- 172.21.15.3:0/1924821069 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc09c990 con 0x55b60429cb90 2024-09-19T06:21:08.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.250+0000 7f8defe00640 1 -- 172.21.15.3:0/1924821069 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8615+0+0 (secure 0 0 0) 0x7f8dfc0cd980 con 0x55b60429cb90 2024-09-19T06:21:08.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.250+0000 7f8e13e0e740 1 -- 172.21.15.3:0/1924821069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8df4004400 con 0x55b60429cb90 2024-09-19T06:21:08.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.251+0000 7f8defe00640 1 -- 172.21.15.3:0/1924821069 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8dfc09c290 con 0x55b60429cb90 2024-09-19T06:21:08.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.251+0000 7f8e13e0e740 10 client.27863 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:08.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.251+0000 7f8e13e0e740 1 -- 172.21.15.3:0/1924821069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b6042b66d0 con 0x55b60429cb90 2024-09-19T06:21:08.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.251+0000 7f8defe00640 1 -- 172.21.15.3:0/1924821069 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8df4004400 con 0x55b60429cb90 2024-09-19T06:21:08.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.251+0000 7f8defe00640 1 -- 172.21.15.3:0/1924821069 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8dfc0d20d0 con 0x55b60429cb90 2024-09-19T06:21:08.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.251+0000 7f8e13e0e740 10 client.27863 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:08.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.251+0000 7f8e13e0e740 10 client.27863 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:08.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.251+0000 7f8e13e0e740 20 client.27863 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:08.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.251+0000 7f8e13e0e740 1 --2- 172.21.15.3:0/1924821069 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b6042b7ae0 0x55b6042b9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:08.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.251+0000 7f8e13e0e740 4 client.27863 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:08.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.251+0000 7f8e13e0e740 1 -- 172.21.15.3:0/1924821069 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b604210950 con 0x55b6042b7ae0 2024-09-19T06:21:08.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.252+0000 7f8e01e00640 1 --2- 172.21.15.3:0/1924821069 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b6042b7ae0 0x55b6042b9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:08.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.252+0000 7f8e01e00640 1 --2- 172.21.15.3:0/1924821069 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b6042b7ae0 0x55b6042b9f50 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e82a76a0d6fe2c2c server_cookie=67a475089d6ee083 in_seq=0 out_seq=0 2024-09-19T06:21:08.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.252+0000 7f8defe00640 10 client.27863 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:08.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.253+0000 7f8defe00640 1 -- 172.21.15.3:0/1924821069 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b604210950 con 0x55b6042b7ae0 2024-09-19T06:21:08.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.253+0000 7f8defe00640 10 client.27863 handle_command_reply: tid=0 2024-09-19T06:21:08.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.253+0000 7f8e13e0e740 1 client.27863 shutdown 2024-09-19T06:21:08.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.253+0000 7f8e13e0e740 1 -- 172.21.15.3:0/1924821069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60429cb90 msgr2=0x55b6042a4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:08.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.253+0000 7f8e13e0e740 1 --2- 172.21.15.3:0/1924821069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60429cb90 0x55b6042a4c40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc01f000 tx=0x7f8dfc09c150 comp rx=0 tx=0).stop 2024-09-19T06:21:08.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.253+0000 7f8e13e0e740 1 -- 172.21.15.3:0/1924821069 shutdown_connections 2024-09-19T06:21:08.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.253+0000 7f8e13e0e740 1 --2- 172.21.15.3:0/1924821069 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b6042b7ae0 0x55b6042b9f50 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.253+0000 7f8e13e0e740 1 --2- 172.21.15.3:0/1924821069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b6042a7d70 0x55b6042a56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.253+0000 7f8e13e0e740 1 --2- 172.21.15.3:0/1924821069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b60429d4b0 0x55b6042a5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.253+0000 7f8e13e0e740 1 --2- 172.21.15.3:0/1924821069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60429cb90 0x55b6042a4c40 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.253+0000 7f8e13e0e740 1 -- 172.21.15.3:0/1924821069 >> 172.21.15.3:0/1924821069 conn(0x55b604299120 msgr2=0x55b60429ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:08.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.253+0000 7f8defe00640 0 client.27863 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:08.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.253+0000 7f8e13e0e740 1 -- 172.21.15.3:0/1924821069 shutdown_connections 2024-09-19T06:21:08.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.254+0000 7f8e13e0e740 1 -- 172.21.15.3:0/1924821069 wait complete. 2024-09-19T06:21:08.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.254+0000 7f8e13e0e740 20 client.27863 trim_cache size 0 max 16384 2024-09-19T06:21:08.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.271+0000 7f8e13e0e740 1 Processor -- start 2024-09-19T06:21:08.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.271+0000 7f8e13e0e740 1 -- start start 2024-09-19T06:21:08.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.272+0000 7f8e13e0e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b60429cb90 0x55b6042a3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:08.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.272+0000 7f8e13e0e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60429d4b0 0x55b60429ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:08.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.272+0000 7f8e13e0e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6042a7d70 0x55b6042bf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:08.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.272+0000 7f8e13e0e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c1ab810 con 0x55b6042a7d70 2024-09-19T06:21:08.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.272+0000 7f8e13e0e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c1ad350 con 0x55b60429d4b0 2024-09-19T06:21:08.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.272+0000 7f8e13e0e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c1abee0 con 0x55b60429cb90 2024-09-19T06:21:08.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.272+0000 7f8e0b200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6042a7d70 0x55b6042bf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:08.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.272+0000 7f8e01e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60429d4b0 0x55b60429ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:08.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.272+0000 7f8e0b200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6042a7d70 0x55b6042bf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45226/0 (socket says 172.21.15.3:45226) 2024-09-19T06:21:08.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.272+0000 7f8e0b200640 1 -- 172.21.15.3:0/1252903690 learned_addr learned my addr 172.21.15.3:0/1252903690 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:08.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.272+0000 7f8e0a800640 1 --2- 172.21.15.3:0/1252903690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b60429cb90 0x55b6042a3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:08.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.273+0000 7f8e01e00640 1 -- 172.21.15.3:0/1252903690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b60429cb90 msgr2=0x55b6042a3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:08.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.273+0000 7f8e01e00640 1 --2- 172.21.15.3:0/1252903690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b60429cb90 0x55b6042a3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.273+0000 7f8e01e00640 1 -- 172.21.15.3:0/1252903690 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6042a7d70 msgr2=0x55b6042bf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:08.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.273+0000 7f8e01e00640 1 --2- 172.21.15.3:0/1252903690 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6042a7d70 0x55b6042bf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.273+0000 7f8e01e00640 1 -- 172.21.15.3:0/1252903690 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6042a3bf0 con 0x55b60429d4b0 2024-09-19T06:21:08.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.273+0000 7f8e01e00640 1 --2- 172.21.15.3:0/1252903690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60429d4b0 0x55b60429ecf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8df402aa00 tx=0x7f8df4009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cefc6742fdd6aec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:08.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.273+0000 7f8dfaa00640 1 -- 172.21.15.3:0/1252903690 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df4040040 con 0x55b60429d4b0 2024-09-19T06:21:08.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.273+0000 7f8dfaa00640 1 -- 172.21.15.3:0/1252903690 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8df4004a20 con 0x55b60429d4b0 2024-09-19T06:21:08.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.273+0000 7f8dfaa00640 1 -- 172.21.15.3:0/1252903690 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df4035040 con 0x55b60429d4b0 2024-09-19T06:21:08.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.274+0000 7f8e13e0e740 1 -- 172.21.15.3:0/1252903690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60429d4b0 msgr2=0x55b60429ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:08.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.274+0000 7f8e13e0e740 1 --2- 172.21.15.3:0/1252903690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60429d4b0 0x55b60429ecf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8df402aa00 tx=0x7f8df4009260 comp rx=0 tx=0).stop 2024-09-19T06:21:08.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.274+0000 7f8e13e0e740 1 -- 172.21.15.3:0/1252903690 shutdown_connections 2024-09-19T06:21:08.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.274+0000 7f8e13e0e740 1 --2- 172.21.15.3:0/1252903690 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b6042a7d70 0x55b6042bf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.274+0000 7f8e13e0e740 1 --2- 172.21.15.3:0/1252903690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b60429d4b0 0x55b60429ecf0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.274+0000 7f8e13e0e740 1 --2- 172.21.15.3:0/1252903690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b60429cb90 0x55b6042a3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.274+0000 7f8e13e0e740 1 -- 172.21.15.3:0/1252903690 >> 172.21.15.3:0/1252903690 conn(0x55b604299120 msgr2=0x55b60429e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:08.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.274+0000 7f8e13e0e740 1 -- 172.21.15.3:0/1252903690 shutdown_connections 2024-09-19T06:21:08.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.274+0000 7f8e13e0e740 1 -- 172.21.15.3:0/1252903690 wait complete. 2024-09-19T06:21:08.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.274+0000 7f8e13e0e740 1 -- start start 2024-09-19T06:21:08.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.275+0000 7f8e13e0e740 1 Processor -- start 2024-09-19T06:21:08.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.275+0000 7f8e13e0e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b60429cb90 0x55b6042b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:08.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.275+0000 7f8e13e0e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b60429d4b0 0x55b6042b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:08.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.275+0000 7f8e13e0e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6042a7d70 0x55b6042ab750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:08.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.275+0000 7f8e13e0e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c1acc80 con 0x55b60429cb90 2024-09-19T06:21:08.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.275+0000 7f8e13e0e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c1ac5b0 con 0x55b6042a7d70 2024-09-19T06:21:08.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.275+0000 7f8e13e0e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c1a9810 con 0x55b60429d4b0 2024-09-19T06:21:08.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.275+0000 7f8e13e0e740 10 client.0 _ll_register_callbacks cb 0x7f8dfc0d37d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:08.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.275+0000 7f8e0a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b60429cb90 0x55b6042b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:08.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.275+0000 7f8e0a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b60429cb90 0x55b6042b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45242/0 (socket says 172.21.15.3:45242) 2024-09-19T06:21:08.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.275+0000 7f8e0a800640 1 -- 172.21.15.3:0/4015596277 learned_addr learned my addr 172.21.15.3:0/4015596277 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:08.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.275+0000 7f8e01e00640 1 --2- 172.21.15.3:0/4015596277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b60429d4b0 0x55b6042b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:08.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.275+0000 7f8e0b200640 1 --2- 172.21.15.3:0/4015596277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6042a7d70 0x55b6042ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:08.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.276+0000 7f8e01e00640 1 -- 172.21.15.3:0/4015596277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6042a7d70 msgr2=0x55b6042ab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:08.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.276+0000 7f8e01e00640 1 --2- 172.21.15.3:0/4015596277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6042a7d70 0x55b6042ab750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.276+0000 7f8e01e00640 1 -- 172.21.15.3:0/4015596277 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b60429cb90 msgr2=0x55b6042b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:08.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.276+0000 7f8e01e00640 1 --2- 172.21.15.3:0/4015596277 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b60429cb90 0x55b6042b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.276+0000 7f8e01e00640 1 -- 172.21.15.3:0/4015596277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6042abf80 con 0x55b60429d4b0 2024-09-19T06:21:08.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.276+0000 7f8e01e00640 1 --2- 172.21.15.3:0/4015596277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b60429d4b0 0x55b6042b06c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55b6042a60d0 tx=0x7f8df4005dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86e788d8f9f6efa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:08.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.276+0000 7f8defe00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:21:08.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.276+0000 7f8defe00640 1 -- 172.21.15.3:0/4015596277 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df4060060 con 0x55b60429d4b0 2024-09-19T06:21:08.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.276+0000 7f8e13e0e740 1 -- 172.21.15.3:0/4015596277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8df4004a20 con 0x55b60429d4b0 2024-09-19T06:21:08.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.276+0000 7f8defe00640 1 -- 172.21.15.3:0/4015596277 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8615+0+0 (secure 0 0 0) 0x7f8df40317b0 con 0x55b60429d4b0 2024-09-19T06:21:08.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.277+0000 7f8defe00640 1 -- 172.21.15.3:0/4015596277 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8df4035030 con 0x55b60429d4b0 2024-09-19T06:21:08.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.277+0000 7f8e13e0e740 10 client.27850 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:08.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.277+0000 7f8e13e0e740 1 -- 172.21.15.3:0/4015596277 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b604322490 con 0x55b60429d4b0 2024-09-19T06:21:08.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.277+0000 7f8defe00640 1 -- 172.21.15.3:0/4015596277 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8df4004a20 con 0x55b60429d4b0 2024-09-19T06:21:08.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.277+0000 7f8defe00640 1 -- 172.21.15.3:0/4015596277 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8df4003d50 con 0x55b60429d4b0 2024-09-19T06:21:08.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.277+0000 7f8e13e0e740 10 client.27850 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:08.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.277+0000 7f8e13e0e740 10 client.27850 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:08.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.277+0000 7f8e13e0e740 20 client.27850 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:08.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.277+0000 7f8e13e0e740 1 --2- 172.21.15.3:0/4015596277 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b604322770 0x55b604324b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:08.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.277+0000 7f8e13e0e740 4 client.27850 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:21:08.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.277+0000 7f8e13e0e740 1 -- 172.21.15.3:0/4015596277 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b60420ae60 con 0x55b604322770 2024-09-19T06:21:08.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.278+0000 7f8e0a800640 1 --2- 172.21.15.3:0/4015596277 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b604322770 0x55b604324b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:08.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.278+0000 7f8e0a800640 1 --2- 172.21.15.3:0/4015596277 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b604322770 0x55b604324b60 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60a4dc9acc8c7f89 server_cookie=f237ab2880b0fdcc in_seq=0 out_seq=0 2024-09-19T06:21:08.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.278+0000 7f8defe00640 10 client.27850 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:08.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.278+0000 7f8defe00640 1 -- 172.21.15.3:0/4015596277 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b60420ae60 con 0x55b604322770 2024-09-19T06:21:08.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.278+0000 7f8defe00640 10 client.27850 handle_command_reply: tid=0 2024-09-19T06:21:08.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.278+0000 7f8e13e0e740 1 client.27850 shutdown 2024-09-19T06:21:08.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.279+0000 7f8e13e0e740 1 -- 172.21.15.3:0/4015596277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b60429d4b0 msgr2=0x55b6042b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:08.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.279+0000 7f8e13e0e740 1 --2- 172.21.15.3:0/4015596277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b60429d4b0 0x55b6042b06c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55b6042a60d0 tx=0x7f8df4005dd0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.279+0000 7f8e13e0e740 1 -- 172.21.15.3:0/4015596277 shutdown_connections 2024-09-19T06:21:08.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.279+0000 7f8e13e0e740 1 --2- 172.21.15.3:0/4015596277 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b604322770 0x55b604324b60 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.279+0000 7f8e13e0e740 1 --2- 172.21.15.3:0/4015596277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b6042a7d70 0x55b6042ab750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.279+0000 7f8e13e0e740 1 --2- 172.21.15.3:0/4015596277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b60429d4b0 0x55b6042b06c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.279+0000 7f8e13e0e740 1 --2- 172.21.15.3:0/4015596277 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b60429cb90 0x55b6042b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.279+0000 7f8defe00640 0 client.27850 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:08.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.279+0000 7f8e13e0e740 1 -- 172.21.15.3:0/4015596277 >> 172.21.15.3:0/4015596277 conn(0x55b604299120 msgr2=0x55b6042981c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:08.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.279+0000 7f8e13e0e740 1 -- 172.21.15.3:0/4015596277 shutdown_connections 2024-09-19T06:21:08.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.279+0000 7f8e13e0e740 1 -- 172.21.15.3:0/4015596277 wait complete. 2024-09-19T06:21:08.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.279+0000 7f8e13e0e740 20 client.27850 trim_cache size 0 max 16384 2024-09-19T06:21:08.285 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:21:08.285 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:21:08.285 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": { 2024-09-19T06:21:08.285 INFO:teuthology.orchestra.run.smithi003.stdout: "ec620769-24f0-4ed8-9580-803d742b3e67": { 2024-09-19T06:21:08.285 INFO:teuthology.orchestra.run.smithi003.stdout: "path": "/", 2024-09-19T06:21:08.286 INFO:teuthology.orchestra.run.smithi003.stdout: "tag": "ec620769-24f0-4ed8-9580-803d742b3e67", 2024-09-19T06:21:08.286 INFO:teuthology.orchestra.run.smithi003.stdout: "options": "recursive,force" 2024-09-19T06:21:08.286 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:21:08.286 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:21:08.286 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:21:08.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.280+0000 7f8e11400640 1 -- 172.21.15.3:0/858534924 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8df00a34b0 msgr2=0x7f8df00a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:08.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.280+0000 7f8e11400640 1 --2- 172.21.15.3:0/858534924 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8df00a34b0 0x7f8df00a5970 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8e04009fd0 tx=0x7f8e04009500 comp rx=0 tx=0).stop 2024-09-19T06:21:08.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.280+0000 7f8e11400640 1 -- 172.21.15.3:0/858534924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e0c101de0 msgr2=0x7f8e0c198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:08.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.280+0000 7f8e11400640 1 --2- 172.21.15.3:0/858534924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e0c101de0 0x7f8e0c198460 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00e9f0 tx=0x7f8dfc00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.280+0000 7f8e11400640 1 -- 172.21.15.3:0/858534924 shutdown_connections 2024-09-19T06:21:08.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.280+0000 7f8e11400640 1 --2- 172.21.15.3:0/858534924 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8df00a34b0 0x7f8df00a5970 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.280+0000 7f8e11400640 1 --2- 172.21.15.3:0/858534924 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e0c106f10 0x7f8e0c19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.280+0000 7f8e11400640 1 --2- 172.21.15.3:0/858534924 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e0c102790 0x7f8e0c1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.280+0000 7f8e11400640 1 --2- 172.21.15.3:0/858534924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e0c101de0 0x7f8e0c198460 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:08.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.280+0000 7f8e11400640 1 -- 172.21.15.3:0/858534924 >> 172.21.15.3:0/858534924 conn(0x7f8e0c0fd8c0 msgr2=0x7f8e0c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:08.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.280+0000 7f8e11400640 1 -- 172.21.15.3:0/858534924 shutdown_connections 2024-09-19T06:21:08.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:08.280+0000 7f8e11400640 1 -- 172.21.15.3:0/858534924 wait complete. 2024-09-19T06:21:08.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:08 smithi059 ceph-mon[35138]: pgmap v270: 97 pgs: 97 active+clean; 4.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 106 KiB/s wr, 39 op/s 2024-09-19T06:21:08.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:08 smithi003 ceph-mon[30893]: pgmap v270: 97 pgs: 97 active+clean; 4.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 106 KiB/s wr, 39 op/s 2024-09-19T06:21:08.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:08 smithi071 ceph-mon[35662]: pgmap v270: 97 pgs: 97 active+clean; 4.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 106 KiB/s wr, 39 op/s 2024-09-19T06:21:09.221 INFO:tasks.cephfs.filesystem:scrub status for tag:ec620769-24f0-4ed8-9580-803d742b3e67 - {'path': '/', 'tag': 'ec620769-24f0-4ed8-9580-803d742b3e67', 'options': 'recursive,force'} 2024-09-19T06:21:10.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:10 smithi059 ceph-mon[35138]: pgmap v271: 97 pgs: 97 active+clean; 4.4 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 108 KiB/s wr, 40 op/s 2024-09-19T06:21:10.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:10 smithi059 ceph-mon[35138]: scrub summary: idle 2024-09-19T06:21:10.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:10 smithi003 ceph-mon[30893]: pgmap v271: 97 pgs: 97 active+clean; 4.4 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 108 KiB/s wr, 40 op/s 2024-09-19T06:21:10.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:10 smithi003 ceph-mon[30893]: scrub summary: idle 2024-09-19T06:21:10.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:10 smithi071 ceph-mon[35662]: pgmap v271: 97 pgs: 97 active+clean; 4.4 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 108 KiB/s wr, 40 op/s 2024-09-19T06:21:10.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:10 smithi071 ceph-mon[35662]: scrub summary: idle 2024-09-19T06:21:12.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:12 smithi059 ceph-mon[35138]: pgmap v272: 97 pgs: 97 active+clean; 4.4 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 108 KiB/s wr, 40 op/s 2024-09-19T06:21:12.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:12 smithi059 ceph-mon[35138]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T06:21:12.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:12 smithi003 ceph-mon[30893]: pgmap v272: 97 pgs: 97 active+clean; 4.4 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 108 KiB/s wr, 40 op/s 2024-09-19T06:21:12.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:12 smithi003 ceph-mon[30893]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T06:21:12.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:12 smithi071 ceph-mon[35662]: pgmap v272: 97 pgs: 97 active+clean; 4.4 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 108 KiB/s wr, 40 op/s 2024-09-19T06:21:12.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:12 smithi071 ceph-mon[35662]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T06:21:12.669 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.667+0000 7f7d7b800640 1 -- 172.21.15.3:0/504827918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d741048f0 msgr2=0x7f7d74108930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:12.669 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.667+0000 7f7d7b800640 1 --2- 172.21.15.3:0/504827918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d741048f0 0x7f7d74108930 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7d60009860 tx=0x7f7d6002a340 comp rx=0 tx=0).stop 2024-09-19T06:21:12.669 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.667+0000 7f7d7b800640 1 -- 172.21.15.3:0/504827918 shutdown_connections 2024-09-19T06:21:12.669 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.667+0000 7f7d7b800640 1 --2- 172.21.15.3:0/504827918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d74109090 0x7f7d74110be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.669 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.667+0000 7f7d7b800640 1 --2- 172.21.15.3:0/504827918 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d741048f0 0x7f7d74108930 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.669 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.667+0000 7f7d7b800640 1 --2- 172.21.15.3:0/504827918 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7d74103f40 0x7f7d74104320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.670 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.667+0000 7f7d7b800640 1 -- 172.21.15.3:0/504827918 >> 172.21.15.3:0/504827918 conn(0x7f7d740ff970 msgr2=0x7f7d74101d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:12.670 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.667+0000 7f7d7b800640 1 -- 172.21.15.3:0/504827918 shutdown_connections 2024-09-19T06:21:12.670 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.667+0000 7f7d7b800640 1 -- 172.21.15.3:0/504827918 wait complete. 2024-09-19T06:21:12.672 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.668+0000 7f7d7b800640 1 Processor -- start 2024-09-19T06:21:12.672 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.668+0000 7f7d7b800640 1 -- start start 2024-09-19T06:21:12.672 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.668+0000 7f7d7b800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d74103f40 0x7f7d7419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:12.672 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.668+0000 7f7d7b800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d74109090 0x7f7d7419ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:12.672 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.669+0000 7f7d7b800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7d7419f000 0x7f7d7419f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:12.672 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.669+0000 7f7d7b800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7d741140b0 con 0x7f7d7419f000 2024-09-19T06:21:12.672 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.669+0000 7f7d7b800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7d74113f30 con 0x7f7d74103f40 2024-09-19T06:21:12.672 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.669+0000 7f7d7b800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7d74114230 con 0x7f7d74109090 2024-09-19T06:21:12.672 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.669+0000 7f7d78e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d74103f40 0x7f7d7419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:12.672 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.669+0000 7f7d79800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7d7419f000 0x7f7d7419f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:12.673 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.669+0000 7f7d78e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d74103f40 0x7f7d7419a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:49342/0 (socket says 172.21.15.3:49342) 2024-09-19T06:21:12.673 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.669+0000 7f7d78e00640 1 -- 172.21.15.3:0/1885130932 learned_addr learned my addr 172.21.15.3:0/1885130932 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:12.673 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.669+0000 7f7d73e00640 1 --2- 172.21.15.3:0/1885130932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d74109090 0x7f7d7419ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:12.673 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.669+0000 7f7d79800640 1 -- 172.21.15.3:0/1885130932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d74109090 msgr2=0x7f7d7419ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:12.673 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.669+0000 7f7d79800640 1 --2- 172.21.15.3:0/1885130932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d74109090 0x7f7d7419ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.673 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.669+0000 7f7d79800640 1 -- 172.21.15.3:0/1885130932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d74103f40 msgr2=0x7f7d7419a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:12.673 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.669+0000 7f7d79800640 1 --2- 172.21.15.3:0/1885130932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d74103f40 0x7f7d7419a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.673 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.669+0000 7f7d79800640 1 -- 172.21.15.3:0/1885130932 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d7419faf0 con 0x7f7d7419f000 2024-09-19T06:21:12.673 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.669+0000 7f7d78e00640 1 --2- 172.21.15.3:0/1885130932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d74103f40 0x7f7d7419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:12.673 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.670+0000 7f7d79800640 1 --2- 172.21.15.3:0/1885130932 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7d7419f000 0x7f7d7419f4b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00e970 tx=0x7f7d6c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:12.673 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.670+0000 7f7d71600640 1 -- 172.21.15.3:0/1885130932 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c00ccc0 con 0x7f7d7419f000 2024-09-19T06:21:12.673 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.670+0000 7f7d7b800640 1 -- 172.21.15.3:0/1885130932 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d7419fde0 con 0x7f7d7419f000 2024-09-19T06:21:12.673 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.670+0000 7f7d71600640 1 -- 172.21.15.3:0/1885130932 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d6c005020 con 0x7f7d7419f000 2024-09-19T06:21:12.674 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.670+0000 7f7d71600640 1 -- 172.21.15.3:0/1885130932 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c004a00 con 0x7f7d7419f000 2024-09-19T06:21:12.674 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.670+0000 7f7d7b800640 1 -- 172.21.15.3:0/1885130932 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d741a75a0 con 0x7f7d7419f000 2024-09-19T06:21:12.675 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.674+0000 7f7d7e672740 1 Processor -- start 2024-09-19T06:21:12.676 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.674+0000 7f7d71600640 1 -- 172.21.15.3:0/1885130932 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f7d6c0051d0 con 0x7f7d7419f000 2024-09-19T06:21:12.676 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.675+0000 7f7d7e672740 1 -- start start 2024-09-19T06:21:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.675+0000 7f7d7e672740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e91d61e0 0x5576e91d65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.675+0000 7f7d7e672740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91d6b00 0x5576e91e0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.675+0000 7f7d7e672740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e91e13a0 0x5576e91e3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.675+0000 7f7d7e672740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5576e913c100 con 0x5576e91d6b00 2024-09-19T06:21:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.675+0000 7f7d7e672740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5576e90e41b0 con 0x5576e91e13a0 2024-09-19T06:21:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.675+0000 7f7d7e672740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5576e91380c0 con 0x5576e91d61e0 2024-09-19T06:21:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.675+0000 7f7d78e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91d6b00 0x5576e91e0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.675+0000 7f7d78e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91d6b00 0x5576e91e0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45276/0 (socket says 172.21.15.3:45276) 2024-09-19T06:21:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.675+0000 7f7d78e00640 1 -- 172.21.15.3:0/2013082468 learned_addr learned my addr 172.21.15.3:0/2013082468 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.675+0000 7f7d73e00640 1 --2- 172.21.15.3:0/2013082468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e91d61e0 0x5576e91d65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.676+0000 7f7d73e00640 1 --2- 172.21.15.3:0/2013082468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e91e13a0 0x5576e91e3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.676+0000 7f7d78e00640 1 -- 172.21.15.3:0/2013082468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e91d61e0 msgr2=0x5576e91d65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.676+0000 7f7d71600640 1 --2- 172.21.15.3:0/1885130932 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7d5c0a33b0 0x7f7d5c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.676+0000 7f7d78e00640 1 --2- 172.21.15.3:0/2013082468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e91d61e0 0x5576e91d65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.676+0000 7f7d78e00640 1 -- 172.21.15.3:0/2013082468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e91e13a0 msgr2=0x5576e91e3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.676+0000 7f7d78e00640 1 --2- 172.21.15.3:0/2013082468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e91e13a0 0x5576e91e3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.676+0000 7f7d78e00640 1 -- 172.21.15.3:0/2013082468 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576e8e4f210 con 0x5576e91d6b00 2024-09-19T06:21:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.676+0000 7f7d73e00640 1 --2- 172.21.15.3:0/2013082468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e91e13a0 0x5576e91e3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.676+0000 7f7d71600640 1 -- 172.21.15.3:0/1885130932 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f7d6c0cfca0 con 0x7f7d7419f000 2024-09-19T06:21:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.676+0000 7f7d79800640 1 --2- 172.21.15.3:0/1885130932 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7d5c0a33b0 0x7f7d5c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.676+0000 7f7d78e00640 1 --2- 172.21.15.3:0/2013082468 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91d6b00 0x5576e91e0e60 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009c30 tx=0x7f7d6800ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce80fc7db28a996 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:12.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.676+0000 7f7d66000640 1 -- 172.21.15.3:0/2013082468 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6800cdc0 con 0x5576e91d6b00 2024-09-19T06:21:12.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.677+0000 7f7d66000640 1 -- 172.21.15.3:0/2013082468 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d6801d070 con 0x5576e91d6b00 2024-09-19T06:21:12.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.677+0000 7f7d66000640 1 -- 172.21.15.3:0/2013082468 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6800b6d0 con 0x5576e91d6b00 2024-09-19T06:21:12.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.677+0000 7f7d7e672740 1 -- 172.21.15.3:0/2013082468 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91d6b00 msgr2=0x5576e91e0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:12.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.677+0000 7f7d79800640 1 --2- 172.21.15.3:0/1885130932 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7d5c0a33b0 0x7f7d5c0a5870 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c0cd3c0 tx=0x7f7d6c0046c0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:12.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.677+0000 7f7d7e672740 1 --2- 172.21.15.3:0/2013082468 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91d6b00 0x5576e91e0e60 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009c30 tx=0x7f7d6800ede0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.677+0000 7f7d7e672740 1 -- 172.21.15.3:0/2013082468 shutdown_connections 2024-09-19T06:21:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.677+0000 7f7d7e672740 1 --2- 172.21.15.3:0/2013082468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e91e13a0 0x5576e91e3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.677+0000 7f7d7e672740 1 --2- 172.21.15.3:0/2013082468 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91d6b00 0x5576e91e0e60 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.677+0000 7f7d7e672740 1 --2- 172.21.15.3:0/2013082468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e91d61e0 0x5576e91d65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.677+0000 7f7d7e672740 1 -- 172.21.15.3:0/2013082468 >> 172.21.15.3:0/2013082468 conn(0x5576e91d2750 msgr2=0x5576e91d2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.678+0000 7f7d7e672740 1 -- 172.21.15.3:0/2013082468 shutdown_connections 2024-09-19T06:21:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.678+0000 7f7d7e672740 1 -- 172.21.15.3:0/2013082468 wait complete. 2024-09-19T06:21:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.678+0000 7f7d7e672740 1 -- start start 2024-09-19T06:21:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.678+0000 7f7d7e672740 1 Processor -- start 2024-09-19T06:21:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.679+0000 7f7d7e672740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e91d61e0 0x5576e91de350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.679+0000 7f7d7e672740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91d6b00 0x5576e91de890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.679+0000 7f7d7e672740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e91e13a0 0x5576e91dedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:12.684 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.679+0000 7f7d7e672740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5576e91e3f70 con 0x5576e91d6b00 2024-09-19T06:21:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.679+0000 7f7d7e672740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5576e90c5090 con 0x5576e91d61e0 2024-09-19T06:21:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.679+0000 7f7d7e672740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5576e91e40f0 con 0x5576e91e13a0 2024-09-19T06:21:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.679+0000 7f7d7e672740 10 client.0 _ll_register_callbacks cb 0x5576e9119f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.679+0000 7f7d73e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e91d61e0 0x5576e91de350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.679+0000 7f7d73e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e91d61e0 0x5576e91de350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:49364/0 (socket says 172.21.15.3:49364) 2024-09-19T06:21:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.679+0000 7f7d73e00640 1 -- 172.21.15.3:0/2849929897 learned_addr learned my addr 172.21.15.3:0/2849929897 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.679+0000 7f7d78e00640 1 --2- 172.21.15.3:0/2849929897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91d6b00 0x5576e91de890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.679+0000 7f7d73e00640 1 --2- 172.21.15.3:0/2849929897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e91e13a0 0x5576e91dedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.679+0000 7f7d73e00640 1 -- 172.21.15.3:0/2849929897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e91e13a0 msgr2=0x5576e91dedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.679+0000 7f7d73e00640 1 --2- 172.21.15.3:0/2849929897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e91e13a0 0x5576e91dedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.685 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.679+0000 7f7d73e00640 1 -- 172.21.15.3:0/2849929897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91d6b00 msgr2=0x5576e91de890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.679+0000 7f7d73e00640 1 --2- 172.21.15.3:0/2849929897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91d6b00 0x5576e91de890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.679+0000 7f7d73e00640 1 -- 172.21.15.3:0/2849929897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576e8f1b620 con 0x5576e91d61e0 2024-09-19T06:21:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.680+0000 7f7d73e00640 1 --2- 172.21.15.3:0/2849929897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e91d61e0 0x5576e91de350 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7d60009860 tx=0x7f7d6002c040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47824e9ed9e72543 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.680+0000 7f7d5aa00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:21:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.680+0000 7f7d5aa00640 1 -- 172.21.15.3:0/2849929897 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d60037040 con 0x5576e91d61e0 2024-09-19T06:21:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.680+0000 7f7d7e672740 1 -- 172.21.15.3:0/2849929897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d6801d070 con 0x5576e91d61e0 2024-09-19T06:21:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.680+0000 7f7d5aa00640 1 -- 172.21.15.3:0/2849929897 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f7d60030760 con 0x5576e91d61e0 2024-09-19T06:21:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.680+0000 7f7d5aa00640 1 -- 172.21.15.3:0/2849929897 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7d60030960 con 0x5576e91d61e0 2024-09-19T06:21:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.680+0000 7f7d7e672740 10 client.27881 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.680+0000 7f7d7e672740 1 -- 172.21.15.3:0/2849929897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5576e91efb40 con 0x5576e91d61e0 2024-09-19T06:21:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.681+0000 7f7d5aa00640 1 -- 172.21.15.3:0/2849929897 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d6801d070 con 0x5576e91d61e0 2024-09-19T06:21:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.681+0000 7f7d5aa00640 1 -- 172.21.15.3:0/2849929897 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f7d6003d040 con 0x5576e91d61e0 2024-09-19T06:21:12.686 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.681+0000 7f7d7e672740 10 client.27881 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:12.687 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.681+0000 7f7d7e672740 10 client.27881 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:12.687 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.681+0000 7f7d7e672740 20 client.27881 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:12.687 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.681+0000 7f7d7e672740 1 --2- 172.21.15.3:0/2849929897 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5576e91f0fb0 0x5576e91f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:12.687 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.681+0000 7f7d7e672740 4 client.27881 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:12.687 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.681+0000 7f7d7e672740 1 -- 172.21.15.3:0/2849929897 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576e9149830 con 0x5576e91f0fb0 2024-09-19T06:21:12.687 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.681+0000 7f7d78e00640 1 --2- 172.21.15.3:0/2849929897 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5576e91f0fb0 0x5576e91f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:12.688 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.682+0000 7f7d78e00640 1 --2- 172.21.15.3:0/2849929897 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5576e91f0fb0 0x5576e91f33a0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4f3a0f1d9cad0b2 server_cookie=b737134ba4ce4118 in_seq=0 out_seq=0 2024-09-19T06:21:12.689 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.682+0000 7f7d5aa00640 10 client.27881 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:12.689 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.683+0000 7f7d5aa00640 1 -- 172.21.15.3:0/2849929897 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5576e9149830 con 0x5576e91f0fb0 2024-09-19T06:21:12.689 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.683+0000 7f7d5aa00640 10 client.27881 handle_command_reply: tid=0 2024-09-19T06:21:12.689 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.683+0000 7f7d7e672740 1 client.27881 shutdown 2024-09-19T06:21:12.689 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.683+0000 7f7d7e672740 1 -- 172.21.15.3:0/2849929897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e91d61e0 msgr2=0x5576e91de350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:12.689 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.683+0000 7f7d7e672740 1 --2- 172.21.15.3:0/2849929897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e91d61e0 0x5576e91de350 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7d60009860 tx=0x7f7d6002c040 comp rx=0 tx=0).stop 2024-09-19T06:21:12.689 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.683+0000 7f7d7e672740 1 -- 172.21.15.3:0/2849929897 shutdown_connections 2024-09-19T06:21:12.689 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.683+0000 7f7d7e672740 1 --2- 172.21.15.3:0/2849929897 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5576e91f0fb0 0x5576e91f33a0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.689 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.683+0000 7f7d7e672740 1 --2- 172.21.15.3:0/2849929897 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e91e13a0 0x5576e91dedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.689 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.683+0000 7f7d7e672740 1 --2- 172.21.15.3:0/2849929897 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91d6b00 0x5576e91de890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.689 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.683+0000 7f7d7e672740 1 --2- 172.21.15.3:0/2849929897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e91d61e0 0x5576e91de350 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.683+0000 7f7d5aa00640 0 client.27881 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.683+0000 7f7d7e672740 1 -- 172.21.15.3:0/2849929897 >> 172.21.15.3:0/2849929897 conn(0x5576e91d2750 msgr2=0x5576e91d8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.684+0000 7f7d7e672740 1 -- 172.21.15.3:0/2849929897 shutdown_connections 2024-09-19T06:21:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.684+0000 7f7d7e672740 1 -- 172.21.15.3:0/2849929897 wait complete. 2024-09-19T06:21:12.690 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.684+0000 7f7d7e672740 20 client.27881 trim_cache size 0 max 16384 2024-09-19T06:21:12.702 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.699+0000 7f7d7e672740 1 Processor -- start 2024-09-19T06:21:12.702 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.699+0000 7f7d7e672740 1 -- start start 2024-09-19T06:21:12.702 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.699+0000 7f7d7e672740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e91d61e0 0x5576e91d8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:12.702 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.699+0000 7f7d7e672740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e91d6b00 0x5576e91f8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:12.702 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.699+0000 7f7d7e672740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91e13a0 0x5576e91f9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:12.702 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.699+0000 7f7d7e672740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7d741afc10 con 0x5576e91e13a0 2024-09-19T06:21:12.702 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.699+0000 7f7d7e672740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7d741b1750 con 0x5576e91d6b00 2024-09-19T06:21:12.702 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.699+0000 7f7d7e672740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7d741b02e0 con 0x5576e91d61e0 2024-09-19T06:21:12.702 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.700+0000 7f7d73e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91e13a0 0x5576e91f9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:12.703 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.700+0000 7f7d73e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91e13a0 0x5576e91f9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45290/0 (socket says 172.21.15.3:45290) 2024-09-19T06:21:12.703 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.700+0000 7f7d78e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e91d6b00 0x5576e91f8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:12.703 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.700+0000 7f7d73e00640 1 -- 172.21.15.3:0/2821079084 learned_addr learned my addr 172.21.15.3:0/2821079084 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:12.703 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.700+0000 7f7d73e00640 1 --2- 172.21.15.3:0/2821079084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e91d61e0 0x5576e91d8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:12.703 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.700+0000 7f7d73e00640 1 -- 172.21.15.3:0/2821079084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e91d61e0 msgr2=0x5576e91d8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:12.703 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.700+0000 7f7d73e00640 1 --2- 172.21.15.3:0/2821079084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e91d61e0 0x5576e91d8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.703 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.700+0000 7f7d73e00640 1 -- 172.21.15.3:0/2821079084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e91d6b00 msgr2=0x5576e91f8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:12.703 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.700+0000 7f7d73e00640 1 --2- 172.21.15.3:0/2821079084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e91d6b00 0x5576e91f8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.703 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.700+0000 7f7d73e00640 1 -- 172.21.15.3:0/2821079084 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576e91d5f60 con 0x5576e91e13a0 2024-09-19T06:21:12.703 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.700+0000 7f7d73e00640 1 --2- 172.21.15.3:0/2821079084 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91e13a0 0x5576e91f9180 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f7d60001eb0 tx=0x7f7d60030b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c57d09a212af64 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:12.707 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.701+0000 7f7d65600640 1 -- 172.21.15.3:0/2821079084 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d60037030 con 0x5576e91e13a0 2024-09-19T06:21:12.707 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.701+0000 7f7d65600640 1 -- 172.21.15.3:0/2821079084 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d60030760 con 0x5576e91e13a0 2024-09-19T06:21:12.707 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.701+0000 7f7d65600640 1 -- 172.21.15.3:0/2821079084 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d60003e90 con 0x5576e91e13a0 2024-09-19T06:21:12.707 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.701+0000 7f7d7e672740 1 -- 172.21.15.3:0/2821079084 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91e13a0 msgr2=0x5576e91f9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:12.707 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.701+0000 7f7d7e672740 1 --2- 172.21.15.3:0/2821079084 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91e13a0 0x5576e91f9180 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f7d60001eb0 tx=0x7f7d60030b00 comp rx=0 tx=0).stop 2024-09-19T06:21:12.707 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.701+0000 7f7d7e672740 1 -- 172.21.15.3:0/2821079084 shutdown_connections 2024-09-19T06:21:12.707 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.701+0000 7f7d7e672740 1 --2- 172.21.15.3:0/2821079084 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91e13a0 0x5576e91f9180 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.707 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.701+0000 7f7d7e672740 1 --2- 172.21.15.3:0/2821079084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e91d6b00 0x5576e91f8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.708 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.701+0000 7f7d7e672740 1 --2- 172.21.15.3:0/2821079084 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e91d61e0 0x5576e91d8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.708 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.701+0000 7f7d7e672740 1 -- 172.21.15.3:0/2821079084 >> 172.21.15.3:0/2821079084 conn(0x5576e91d2750 msgr2=0x5576e91d1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:12.708 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.701+0000 7f7d7e672740 1 -- 172.21.15.3:0/2821079084 shutdown_connections 2024-09-19T06:21:12.708 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.701+0000 7f7d7e672740 1 -- 172.21.15.3:0/2821079084 wait complete. 2024-09-19T06:21:12.708 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.702+0000 7f7d7e672740 1 -- start start 2024-09-19T06:21:12.708 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.702+0000 7f7d7e672740 1 Processor -- start 2024-09-19T06:21:12.708 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.702+0000 7f7d7e672740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e91d61e0 0x5576e91e9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:12.708 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.702+0000 7f7d7e672740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91d6b00 0x5576e91e9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:12.708 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.702+0000 7f7d7e672740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e91e13a0 0x5576e91e6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:12.708 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.702+0000 7f7d7e672740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7d741b1080 con 0x5576e91d6b00 2024-09-19T06:21:12.708 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.702+0000 7f7d7e672740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7d741b09b0 con 0x5576e91e13a0 2024-09-19T06:21:12.709 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.702+0000 7f7d7e672740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7d741adc10 con 0x5576e91d61e0 2024-09-19T06:21:12.709 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.702+0000 7f7d7e672740 10 client.0 _ll_register_callbacks cb 0x7f7d6c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:12.709 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.703+0000 7f7d78e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91d6b00 0x5576e91e9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:12.709 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.703+0000 7f7d78e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91d6b00 0x5576e91e9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45296/0 (socket says 172.21.15.3:45296) 2024-09-19T06:21:12.709 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.703+0000 7f7d78e00640 1 -- 172.21.15.3:0/4014526070 learned_addr learned my addr 172.21.15.3:0/4014526070 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:12.709 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.703+0000 7f7d73e00640 1 --2- 172.21.15.3:0/4014526070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e91d61e0 0x5576e91e9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:12.709 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.703+0000 7f7d73e00640 1 --2- 172.21.15.3:0/4014526070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e91e13a0 0x5576e91e6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:12.709 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.703+0000 7f7d78e00640 1 -- 172.21.15.3:0/4014526070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e91d61e0 msgr2=0x5576e91e9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:12.709 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.703+0000 7f7d78e00640 1 --2- 172.21.15.3:0/4014526070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e91d61e0 0x5576e91e9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.709 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.703+0000 7f7d78e00640 1 -- 172.21.15.3:0/4014526070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e91e13a0 msgr2=0x5576e91e6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:12.709 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.703+0000 7f7d78e00640 1 --2- 172.21.15.3:0/4014526070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e91e13a0 0x5576e91e6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.703+0000 7f7d78e00640 1 -- 172.21.15.3:0/4014526070 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576e91e6760 con 0x5576e91d6b00 2024-09-19T06:21:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.703+0000 7f7d73e00640 1 --2- 172.21.15.3:0/4014526070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e91e13a0 0x5576e91e6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:21:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.703+0000 7f7d78e00640 1 --2- 172.21.15.3:0/4014526070 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91d6b00 0x5576e91e9790 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7d68010fd0 tx=0x7f7d680099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa4e883e8a81a73 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.703+0000 7f7d5aa00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:21:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.703+0000 7f7d5aa00640 1 -- 172.21.15.3:0/4014526070 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6800cbc0 con 0x5576e91d6b00 2024-09-19T06:21:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.703+0000 7f7d5aa00640 1 -- 172.21.15.3:0/4014526070 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f7d68003b70 con 0x5576e91d6b00 2024-09-19T06:21:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.703+0000 7f7d7e672740 1 -- 172.21.15.3:0/4014526070 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d60030760 con 0x5576e91d6b00 2024-09-19T06:21:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.704+0000 7f7d5aa00640 1 -- 172.21.15.3:0/4014526070 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7d68037050 con 0x5576e91d6b00 2024-09-19T06:21:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.704+0000 7f7d7e672740 10 client.17853 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.704+0000 7f7d7e672740 1 -- 172.21.15.3:0/4014526070 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5576e925c290 con 0x5576e91d6b00 2024-09-19T06:21:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.704+0000 7f7d5aa00640 1 -- 172.21.15.3:0/4014526070 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d60030760 con 0x5576e91d6b00 2024-09-19T06:21:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.704+0000 7f7d5aa00640 1 -- 172.21.15.3:0/4014526070 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f7d60030d10 con 0x5576e91d6b00 2024-09-19T06:21:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.704+0000 7f7d7e672740 10 client.17853 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.704+0000 7f7d7e672740 10 client.17853 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.704+0000 7f7d7e672740 20 client.17853 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.704+0000 7f7d7e672740 1 --2- 172.21.15.3:0/4014526070 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5576e925c780 0x5576e925eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.704+0000 7f7d7e672740 4 client.17853 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:21:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.704+0000 7f7d7e672740 1 -- 172.21.15.3:0/4014526070 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5576e9143b80 con 0x5576e925c780 2024-09-19T06:21:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.705+0000 7f7d73e00640 1 --2- 172.21.15.3:0/4014526070 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5576e925c780 0x5576e925eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.705+0000 7f7d73e00640 1 --2- 172.21.15.3:0/4014526070 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5576e925c780 0x5576e925eba0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7b9a6f47c1bd7d server_cookie=e749556c61ecb498 in_seq=0 out_seq=0 2024-09-19T06:21:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.705+0000 7f7d5aa00640 10 client.17853 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.721+0000 7f7d5aa00640 1 -- 172.21.15.3:0/4014526070 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5576e9143b80 con 0x5576e925c780 2024-09-19T06:21:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.721+0000 7f7d5aa00640 10 client.17853 handle_command_reply: tid=0 2024-09-19T06:21:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.721+0000 7f7d7e672740 1 client.17853 shutdown 2024-09-19T06:21:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.721+0000 7f7d7e672740 1 -- 172.21.15.3:0/4014526070 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91d6b00 msgr2=0x5576e91e9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.721+0000 7f7d7e672740 1 --2- 172.21.15.3:0/4014526070 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91d6b00 0x5576e91e9790 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7d68010fd0 tx=0x7f7d680099c0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.721+0000 7f7d7e672740 1 -- 172.21.15.3:0/4014526070 shutdown_connections 2024-09-19T06:21:12.723 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.721+0000 7f7d7e672740 1 --2- 172.21.15.3:0/4014526070 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5576e925c780 0x5576e925eba0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.721+0000 7f7d7e672740 1 --2- 172.21.15.3:0/4014526070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e91e13a0 0x5576e91e6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.721+0000 7f7d7e672740 1 --2- 172.21.15.3:0/4014526070 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e91d6b00 0x5576e91e9790 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.721+0000 7f7d5aa00640 0 client.17853 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.721+0000 7f7d7e672740 1 --2- 172.21.15.3:0/4014526070 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e91d61e0 0x5576e91e9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.721+0000 7f7d7e672740 1 -- 172.21.15.3:0/4014526070 >> 172.21.15.3:0/4014526070 conn(0x5576e91d2750 msgr2=0x5576e91df940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.721+0000 7f7d7e672740 1 -- 172.21.15.3:0/4014526070 shutdown_connections 2024-09-19T06:21:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.721+0000 7f7d7e672740 1 -- 172.21.15.3:0/4014526070 wait complete. 2024-09-19T06:21:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.721+0000 7f7d7e672740 20 client.17853 trim_cache size 0 max 16384 2024-09-19T06:21:12.724 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:21:12.725 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:21:12.725 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:21:12.725 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:21:12.725 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.722+0000 7f7d7b800640 1 -- 172.21.15.3:0/1885130932 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7d5c0a33b0 msgr2=0x7f7d5c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:12.725 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.722+0000 7f7d7b800640 1 --2- 172.21.15.3:0/1885130932 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7d5c0a33b0 0x7f7d5c0a5870 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c0cd3c0 tx=0x7f7d6c0046c0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.726 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.722+0000 7f7d7b800640 1 -- 172.21.15.3:0/1885130932 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7d7419f000 msgr2=0x7f7d7419f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:12.726 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.722+0000 7f7d7b800640 1 --2- 172.21.15.3:0/1885130932 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7d7419f000 0x7f7d7419f4b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00e970 tx=0x7f7d6c00ee30 comp rx=0 tx=0).stop 2024-09-19T06:21:12.726 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.722+0000 7f7d7b800640 1 -- 172.21.15.3:0/1885130932 shutdown_connections 2024-09-19T06:21:12.726 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.722+0000 7f7d7b800640 1 --2- 172.21.15.3:0/1885130932 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7d5c0a33b0 0x7f7d5c0a5870 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.726 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.722+0000 7f7d7b800640 1 --2- 172.21.15.3:0/1885130932 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7d7419f000 0x7f7d7419f4b0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.726 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.722+0000 7f7d7b800640 1 --2- 172.21.15.3:0/1885130932 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7d74109090 0x7f7d7419ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.726 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.722+0000 7f7d7b800640 1 --2- 172.21.15.3:0/1885130932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d74103f40 0x7f7d7419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:12.726 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.722+0000 7f7d7b800640 1 -- 172.21.15.3:0/1885130932 >> 172.21.15.3:0/1885130932 conn(0x7f7d740ff970 msgr2=0x7f7d74100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:12.726 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.722+0000 7f7d7b800640 1 -- 172.21.15.3:0/1885130932 shutdown_connections 2024-09-19T06:21:12.726 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:12.722+0000 7f7d7b800640 1 -- 172.21.15.3:0/1885130932 wait complete. 2024-09-19T06:21:14.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:14 smithi059 ceph-mon[35138]: pgmap v274: 97 pgs: 97 active+clean; 4.4 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 30 KiB/s wr, 12 op/s 2024-09-19T06:21:14.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:14 smithi003 ceph-mon[30893]: pgmap v274: 97 pgs: 97 active+clean; 4.4 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 30 KiB/s wr, 12 op/s 2024-09-19T06:21:14.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:14 smithi071 ceph-mon[35662]: pgmap v274: 97 pgs: 97 active+clean; 4.4 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 30 KiB/s wr, 12 op/s 2024-09-19T06:21:16.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:16 smithi059 ceph-mon[35138]: pgmap v275: 97 pgs: 97 active+clean; 4.6 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 22 op/s 2024-09-19T06:21:16.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:16 smithi003 ceph-mon[30893]: pgmap v275: 97 pgs: 97 active+clean; 4.6 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 22 op/s 2024-09-19T06:21:16.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:16 smithi071 ceph-mon[35662]: pgmap v275: 97 pgs: 97 active+clean; 4.6 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 22 op/s 2024-09-19T06:21:18.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:18 smithi059 ceph-mon[35138]: pgmap v276: 97 pgs: 97 active+clean; 4.6 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 55 KiB/s wr, 20 op/s 2024-09-19T06:21:18.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:18 smithi003 ceph-mon[30893]: pgmap v276: 97 pgs: 97 active+clean; 4.6 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 55 KiB/s wr, 20 op/s 2024-09-19T06:21:18.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:18 smithi071 ceph-mon[35662]: pgmap v276: 97 pgs: 97 active+clean; 4.6 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 55 KiB/s wr, 20 op/s 2024-09-19T06:21:20.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:20 smithi059 ceph-mon[35138]: pgmap v277: 97 pgs: 97 active+clean; 4.8 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 50 KiB/s wr, 18 op/s 2024-09-19T06:21:20.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:20 smithi003 ceph-mon[30893]: pgmap v277: 97 pgs: 97 active+clean; 4.8 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 50 KiB/s wr, 18 op/s 2024-09-19T06:21:20.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:20 smithi071 ceph-mon[35662]: pgmap v277: 97 pgs: 97 active+clean; 4.8 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 50 KiB/s wr, 18 op/s 2024-09-19T06:21:22.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:22 smithi059 ceph-mon[35138]: pgmap v278: 97 pgs: 97 active+clean; 4.8 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 50 KiB/s wr, 18 op/s 2024-09-19T06:21:22.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:22 smithi003 ceph-mon[30893]: pgmap v278: 97 pgs: 97 active+clean; 4.8 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 50 KiB/s wr, 18 op/s 2024-09-19T06:21:22.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:22 smithi071 ceph-mon[35662]: pgmap v278: 97 pgs: 97 active+clean; 4.8 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 50 KiB/s wr, 18 op/s 2024-09-19T06:21:24.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:24 smithi059 ceph-mon[35138]: pgmap v279: 97 pgs: 97 active+clean; 4.8 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 17 op/s 2024-09-19T06:21:24.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:24 smithi003 ceph-mon[30893]: pgmap v279: 97 pgs: 97 active+clean; 4.8 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 17 op/s 2024-09-19T06:21:24.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:24 smithi071 ceph-mon[35662]: pgmap v279: 97 pgs: 97 active+clean; 4.8 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 17 op/s 2024-09-19T06:21:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.849+0000 7fa1f7a00640 1 -- 172.21.15.3:0/3851552553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1f0103f40 msgr2=0x7fa1f0104320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.850+0000 7fa1f7a00640 1 --2- 172.21.15.3:0/3851552553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1f0103f40 0x7fa1f0104320 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009900 tx=0x7fa1e402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.850+0000 7fa1f7a00640 1 -- 172.21.15.3:0/3851552553 shutdown_connections 2024-09-19T06:21:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.850+0000 7fa1f7a00640 1 --2- 172.21.15.3:0/3851552553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1f0109090 0x7fa1f0110be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.850+0000 7fa1f7a00640 1 --2- 172.21.15.3:0/3851552553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1f01048f0 0x7fa1f0108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.850+0000 7fa1f7a00640 1 --2- 172.21.15.3:0/3851552553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1f0103f40 0x7fa1f0104320 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.850+0000 7fa1f7a00640 1 -- 172.21.15.3:0/3851552553 >> 172.21.15.3:0/3851552553 conn(0x7fa1f00ff970 msgr2=0x7fa1f0101d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.850+0000 7fa1f7a00640 1 -- 172.21.15.3:0/3851552553 shutdown_connections 2024-09-19T06:21:25.852 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.850+0000 7fa1f7a00640 1 -- 172.21.15.3:0/3851552553 wait complete. 2024-09-19T06:21:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.851+0000 7fa1f7a00640 1 Processor -- start 2024-09-19T06:21:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.851+0000 7fa1f7a00640 1 -- start start 2024-09-19T06:21:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.851+0000 7fa1f7a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1f0103f40 0x7fa1f019a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.851+0000 7fa1f7a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1f0109090 0x7fa1f019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.851+0000 7fa1f7a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1f019ef80 0x7fa1f019f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.851+0000 7fa1f7a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f0114130 con 0x7fa1f019ef80 2024-09-19T06:21:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.851+0000 7fa1f7a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f0113fb0 con 0x7fa1f0103f40 2024-09-19T06:21:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.851+0000 7fa1f7a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01142b0 con 0x7fa1f0109090 2024-09-19T06:21:25.854 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.851+0000 7fa1f5000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1f0103f40 0x7fa1f019a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.851+0000 7fa1f5a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1f019ef80 0x7fa1f019f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.851+0000 7fa1f5000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1f0103f40 0x7fa1f019a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55938/0 (socket says 172.21.15.3:55938) 2024-09-19T06:21:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.852+0000 7fa1f5000640 1 -- 172.21.15.3:0/3111723675 learned_addr learned my addr 172.21.15.3:0/3111723675 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.852+0000 7fa1efe00640 1 --2- 172.21.15.3:0/3111723675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1f0109090 0x7fa1f019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.852+0000 7fa1f5a00640 1 -- 172.21.15.3:0/3111723675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1f0109090 msgr2=0x7fa1f019ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.852+0000 7fa1f5a00640 1 --2- 172.21.15.3:0/3111723675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1f0109090 0x7fa1f019ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.852+0000 7fa1f5a00640 1 -- 172.21.15.3:0/3111723675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1f0103f40 msgr2=0x7fa1f019a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.852+0000 7fa1f5a00640 1 --2- 172.21.15.3:0/3111723675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1f0103f40 0x7fa1f019a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.852+0000 7fa1f5a00640 1 -- 172.21.15.3:0/3111723675 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f019fa70 con 0x7fa1f019ef80 2024-09-19T06:21:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.852+0000 7fa1f5a00640 1 --2- 172.21.15.3:0/3111723675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1f019ef80 0x7fa1f019f430 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800e940 tx=0x7fa1e800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:25.856 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.853+0000 7fa1ed600640 1 -- 172.21.15.3:0/3111723675 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8004d20 con 0x7fa1f019ef80 2024-09-19T06:21:25.856 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.853+0000 7fa1ed600640 1 -- 172.21.15.3:0/3111723675 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1e8005020 con 0x7fa1f019ef80 2024-09-19T06:21:25.856 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.853+0000 7fa1f7a00640 1 -- 172.21.15.3:0/3111723675 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f019fd60 con 0x7fa1f019ef80 2024-09-19T06:21:25.856 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.853+0000 7fa1ed600640 1 -- 172.21.15.3:0/3111723675 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e80116b0 con 0x7fa1f019ef80 2024-09-19T06:21:25.856 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.853+0000 7fa1f7a00640 1 -- 172.21.15.3:0/3111723675 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f01a7550 con 0x7fa1f019ef80 2024-09-19T06:21:25.858 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.857+0000 7fa1fa9da740 1 Processor -- start 2024-09-19T06:21:25.859 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.857+0000 7fa1ed600640 1 -- 172.21.15.3:0/3111723675 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fa1e80054d0 con 0x7fa1f019ef80 2024-09-19T06:21:25.859 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.857+0000 7fa1fa9da740 1 -- start start 2024-09-19T06:21:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.857+0000 7fa1fa9da740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e4237e1e0 0x562e4237e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.858+0000 7fa1fa9da740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e4237eb00 0x562e42388e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.858+0000 7fa1fa9da740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e423893a0 0x562e4238b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.858+0000 7fa1fa9da740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562e422e4100 con 0x562e4237eb00 2024-09-19T06:21:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.858+0000 7fa1fa9da740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562e4228c1b0 con 0x562e423893a0 2024-09-19T06:21:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.858+0000 7fa1fa9da740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562e422e00c0 con 0x562e4237e1e0 2024-09-19T06:21:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.858+0000 7fa1efe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e423893a0 0x562e4238b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.858+0000 7fa1f5000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e4237eb00 0x562e42388e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.858+0000 7fa1efe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e423893a0 0x562e4238b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55948/0 (socket says 172.21.15.3:55948) 2024-09-19T06:21:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.858+0000 7fa1efe00640 1 -- 172.21.15.3:0/504262970 learned_addr learned my addr 172.21.15.3:0/504262970 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.858+0000 7fa1efe00640 1 --2- 172.21.15.3:0/504262970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e4237e1e0 0x562e4237e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.858+0000 7fa1f5000640 1 -- 172.21.15.3:0/504262970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e4237e1e0 msgr2=0x562e4237e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.858+0000 7fa1f5000640 1 --2- 172.21.15.3:0/504262970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e4237e1e0 0x562e4237e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.858+0000 7fa1f5000640 1 -- 172.21.15.3:0/504262970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e423893a0 msgr2=0x562e4238b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.858+0000 7fa1f5000640 1 --2- 172.21.15.3:0/504262970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e423893a0 0x562e4238b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.858+0000 7fa1f5000640 1 -- 172.21.15.3:0/504262970 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e41ff7210 con 0x562e4237eb00 2024-09-19T06:21:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.858+0000 7fa1efe00640 1 --2- 172.21.15.3:0/504262970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e423893a0 0x562e4238b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.859+0000 7fa1f5000640 1 --2- 172.21.15.3:0/504262970 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e4237eb00 0x562e42388e60 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4031550 tx=0x7fa1e4005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33cedcf8d4e0036b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.859+0000 7fa1ed600640 1 --2- 172.21.15.3:0/3111723675 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa1d80a33b0 0x7fa1d80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.859+0000 7fa1e2000640 1 -- 172.21.15.3:0/504262970 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4040070 con 0x562e4237eb00 2024-09-19T06:21:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.859+0000 7fa1ed600640 1 -- 172.21.15.3:0/3111723675 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7fa1e80d00f0 con 0x7fa1f019ef80 2024-09-19T06:21:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.859+0000 7fa1e2000640 1 -- 172.21.15.3:0/504262970 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1e40043c0 con 0x562e4237eb00 2024-09-19T06:21:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.859+0000 7fa1e2000640 1 -- 172.21.15.3:0/504262970 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4035040 con 0x562e4237eb00 2024-09-19T06:21:25.863 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.859+0000 7fa1efe00640 1 --2- 172.21.15.3:0/3111723675 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa1d80a33b0 0x7fa1d80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:25.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.860+0000 7fa1fa9da740 1 -- 172.21.15.3:0/504262970 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e4237eb00 msgr2=0x562e42388e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:25.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.860+0000 7fa1fa9da740 1 --2- 172.21.15.3:0/504262970 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e4237eb00 0x562e42388e60 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4031550 tx=0x7fa1e4005c00 comp rx=0 tx=0).stop 2024-09-19T06:21:25.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.860+0000 7fa1efe00640 1 --2- 172.21.15.3:0/3111723675 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa1d80a33b0 0x7fa1d80a5870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x562e4237bad0 tx=0x7fa1dc005850 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:25.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.860+0000 7fa1fa9da740 1 -- 172.21.15.3:0/504262970 shutdown_connections 2024-09-19T06:21:25.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.860+0000 7fa1fa9da740 1 --2- 172.21.15.3:0/504262970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e423893a0 0x562e4238b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.860+0000 7fa1fa9da740 1 --2- 172.21.15.3:0/504262970 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e4237eb00 0x562e42388e60 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.860+0000 7fa1fa9da740 1 --2- 172.21.15.3:0/504262970 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e4237e1e0 0x562e4237e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.860+0000 7fa1fa9da740 1 -- 172.21.15.3:0/504262970 >> 172.21.15.3:0/504262970 conn(0x562e4237a750 msgr2=0x562e4237ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:25.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.860+0000 7fa1fa9da740 1 -- 172.21.15.3:0/504262970 shutdown_connections 2024-09-19T06:21:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.860+0000 7fa1fa9da740 1 -- 172.21.15.3:0/504262970 wait complete. 2024-09-19T06:21:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.860+0000 7fa1fa9da740 1 -- start start 2024-09-19T06:21:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.861+0000 7fa1fa9da740 1 Processor -- start 2024-09-19T06:21:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.861+0000 7fa1fa9da740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e4237e1e0 0x562e42386360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.861+0000 7fa1fa9da740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e4237eb00 0x562e423868a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.861+0000 7fa1fa9da740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e423893a0 0x562e42386de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.861+0000 7fa1fa9da740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562e4238bf70 con 0x562e4237e1e0 2024-09-19T06:21:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.861+0000 7fa1fa9da740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562e4226d090 con 0x562e4237eb00 2024-09-19T06:21:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.861+0000 7fa1fa9da740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562e4238c0f0 con 0x562e423893a0 2024-09-19T06:21:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.861+0000 7fa1fa9da740 10 client.0 _ll_register_callbacks cb 0x562e422c1f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.861+0000 7fa1f5000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e4237e1e0 0x562e42386360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.861+0000 7fa1efe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e4237eb00 0x562e423868a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.861+0000 7fa1f5000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e4237e1e0 0x562e42386360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52866/0 (socket says 172.21.15.3:52866) 2024-09-19T06:21:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.861+0000 7fa1efe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e4237eb00 0x562e423868a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55964/0 (socket says 172.21.15.3:55964) 2024-09-19T06:21:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.861+0000 7fa1f5000640 1 -- 172.21.15.3:0/557383979 learned_addr learned my addr 172.21.15.3:0/557383979 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.862+0000 7fa1f5a00640 1 --2- 172.21.15.3:0/557383979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e423893a0 0x562e42386de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.862+0000 7fa1efe00640 1 -- 172.21.15.3:0/557383979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e423893a0 msgr2=0x562e42386de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.862+0000 7fa1efe00640 1 --2- 172.21.15.3:0/557383979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e423893a0 0x562e42386de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.862+0000 7fa1efe00640 1 -- 172.21.15.3:0/557383979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e4237e1e0 msgr2=0x562e42386360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.862+0000 7fa1efe00640 1 --2- 172.21.15.3:0/557383979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e4237e1e0 0x562e42386360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.862+0000 7fa1efe00640 1 -- 172.21.15.3:0/557383979 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e420c3620 con 0x562e4237eb00 2024-09-19T06:21:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.862+0000 7fa1efe00640 1 --2- 172.21.15.3:0/557383979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e4237eb00 0x562e423868a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc009530 tx=0x7fa1dc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1aa5632c558ecd59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.862+0000 7fa1d6a00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:21:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.862+0000 7fa1d6a00640 1 -- 172.21.15.3:0/557383979 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc02d060 con 0x562e4237eb00 2024-09-19T06:21:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.862+0000 7fa1fa9da740 1 -- 172.21.15.3:0/557383979 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1e40043c0 con 0x562e4237eb00 2024-09-19T06:21:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.862+0000 7fa1d6a00640 1 -- 172.21.15.3:0/557383979 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7fa1dc01a070 con 0x562e4237eb00 2024-09-19T06:21:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.863+0000 7fa1d6a00640 1 -- 172.21.15.3:0/557383979 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa1dc020b80 con 0x562e4237eb00 2024-09-19T06:21:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.863+0000 7fa1fa9da740 10 client.27896 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.863+0000 7fa1fa9da740 1 -- 172.21.15.3:0/557383979 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562e42397ca0 con 0x562e4237eb00 2024-09-19T06:21:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.863+0000 7fa1d6a00640 1 -- 172.21.15.3:0/557383979 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1e40043c0 con 0x562e4237eb00 2024-09-19T06:21:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.863+0000 7fa1d6a00640 1 -- 172.21.15.3:0/557383979 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa1dc027030 con 0x562e4237eb00 2024-09-19T06:21:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.863+0000 7fa1fa9da740 10 client.27896 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.863+0000 7fa1fa9da740 10 client.27896 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.863+0000 7fa1fa9da740 20 client.27896 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.863+0000 7fa1fa9da740 1 --2- 172.21.15.3:0/557383979 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562e42399110 0x562e4239b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.863+0000 7fa1fa9da740 4 client.27896 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.863+0000 7fa1fa9da740 1 -- 172.21.15.3:0/557383979 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e422f1830 con 0x562e42399110 2024-09-19T06:21:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.864+0000 7fa1f5000640 1 --2- 172.21.15.3:0/557383979 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562e42399110 0x562e4239b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.864+0000 7fa1f5000640 1 --2- 172.21.15.3:0/557383979 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562e42399110 0x562e4239b540 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7d1baa1752360ed server_cookie=db43d12995a6658b in_seq=0 out_seq=0 2024-09-19T06:21:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.864+0000 7fa1d6a00640 10 client.27896 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.865+0000 7fa1d6a00640 1 -- 172.21.15.3:0/557383979 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562e422f1830 con 0x562e42399110 2024-09-19T06:21:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.865+0000 7fa1d6a00640 10 client.27896 handle_command_reply: tid=0 2024-09-19T06:21:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.865+0000 7fa1fa9da740 1 client.27896 shutdown 2024-09-19T06:21:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.865+0000 7fa1fa9da740 1 -- 172.21.15.3:0/557383979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e4237eb00 msgr2=0x562e423868a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.865+0000 7fa1fa9da740 1 --2- 172.21.15.3:0/557383979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e4237eb00 0x562e423868a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc009530 tx=0x7fa1dc0046c0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.865+0000 7fa1fa9da740 1 -- 172.21.15.3:0/557383979 shutdown_connections 2024-09-19T06:21:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.865+0000 7fa1fa9da740 1 --2- 172.21.15.3:0/557383979 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562e42399110 0x562e4239b540 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.865+0000 7fa1fa9da740 1 --2- 172.21.15.3:0/557383979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e423893a0 0x562e42386de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.865+0000 7fa1fa9da740 1 --2- 172.21.15.3:0/557383979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e4237eb00 0x562e423868a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.865+0000 7fa1fa9da740 1 --2- 172.21.15.3:0/557383979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e4237e1e0 0x562e42386360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.872 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.865+0000 7fa1fa9da740 1 -- 172.21.15.3:0/557383979 >> 172.21.15.3:0/557383979 conn(0x562e4237a750 msgr2=0x562e42380460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:25.872 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.865+0000 7fa1d6a00640 0 client.27896 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:25.872 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.865+0000 7fa1fa9da740 1 -- 172.21.15.3:0/557383979 shutdown_connections 2024-09-19T06:21:25.872 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.865+0000 7fa1fa9da740 1 -- 172.21.15.3:0/557383979 wait complete. 2024-09-19T06:21:25.872 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.866+0000 7fa1fa9da740 20 client.27896 trim_cache size 0 max 16384 2024-09-19T06:21:25.883 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.881+0000 7fa1fa9da740 1 Processor -- start 2024-09-19T06:21:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.881+0000 7fa1fa9da740 1 -- start start 2024-09-19T06:21:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.881+0000 7fa1fa9da740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e4237e1e0 0x562e423756a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.881+0000 7fa1fa9da740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e4237eb00 0x562e423a0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.881+0000 7fa1fa9da740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e423893a0 0x562e423a1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.881+0000 7fa1fa9da740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01afb90 con 0x562e423893a0 2024-09-19T06:21:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.881+0000 7fa1fa9da740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01b16d0 con 0x562e4237e1e0 2024-09-19T06:21:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.881+0000 7fa1fa9da740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01b0260 con 0x562e4237eb00 2024-09-19T06:21:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.881+0000 7fa1f5000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e4237e1e0 0x562e423756a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.881+0000 7fa1f5000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e4237e1e0 0x562e423756a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55974/0 (socket says 172.21.15.3:55974) 2024-09-19T06:21:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.881+0000 7fa1f5000640 1 -- 172.21.15.3:0/607822304 learned_addr learned my addr 172.21.15.3:0/607822304 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.882+0000 7fa1efe00640 1 --2- 172.21.15.3:0/607822304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e4237eb00 0x562e423a0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.882+0000 7fa1f5a00640 1 --2- 172.21.15.3:0/607822304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e423893a0 0x562e423a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.882+0000 7fa1f5000640 1 -- 172.21.15.3:0/607822304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e4237eb00 msgr2=0x562e423a0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.882+0000 7fa1f5000640 1 --2- 172.21.15.3:0/607822304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e4237eb00 0x562e423a0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.882+0000 7fa1f5000640 1 -- 172.21.15.3:0/607822304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e423893a0 msgr2=0x562e423a1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.882+0000 7fa1f5000640 1 --2- 172.21.15.3:0/607822304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e423893a0 0x562e423a1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.882+0000 7fa1f5000640 1 -- 172.21.15.3:0/607822304 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e423852f0 con 0x562e4237e1e0 2024-09-19T06:21:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.882+0000 7fa1f5a00640 1 --2- 172.21.15.3:0/607822304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e423893a0 0x562e423a1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.882+0000 7fa1f5000640 1 --2- 172.21.15.3:0/607822304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e4237e1e0 0x562e423756a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa1e40099f0 tx=0x7fa1e4047040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56eb79231f0f4cdf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:25.888 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.882+0000 7fa1e1600640 1 -- 172.21.15.3:0/607822304 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4040040 con 0x562e4237e1e0 2024-09-19T06:21:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.882+0000 7fa1e1600640 1 -- 172.21.15.3:0/607822304 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1e4004340 con 0x562e4237e1e0 2024-09-19T06:21:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.882+0000 7fa1e1600640 1 -- 172.21.15.3:0/607822304 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4035040 con 0x562e4237e1e0 2024-09-19T06:21:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.883+0000 7fa1fa9da740 1 -- 172.21.15.3:0/607822304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e4237e1e0 msgr2=0x562e423756a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.883+0000 7fa1fa9da740 1 --2- 172.21.15.3:0/607822304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e4237e1e0 0x562e423756a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa1e40099f0 tx=0x7fa1e4047040 comp rx=0 tx=0).stop 2024-09-19T06:21:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.883+0000 7fa1fa9da740 1 -- 172.21.15.3:0/607822304 shutdown_connections 2024-09-19T06:21:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.883+0000 7fa1fa9da740 1 --2- 172.21.15.3:0/607822304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e423893a0 0x562e423a1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.883+0000 7fa1fa9da740 1 --2- 172.21.15.3:0/607822304 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e4237eb00 0x562e423a0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.883+0000 7fa1fa9da740 1 --2- 172.21.15.3:0/607822304 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e4237e1e0 0x562e423756a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.883+0000 7fa1fa9da740 1 -- 172.21.15.3:0/607822304 >> 172.21.15.3:0/607822304 conn(0x562e4237a750 msgr2=0x562e423882d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.883+0000 7fa1fa9da740 1 -- 172.21.15.3:0/607822304 shutdown_connections 2024-09-19T06:21:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.883+0000 7fa1fa9da740 1 -- 172.21.15.3:0/607822304 wait complete. 2024-09-19T06:21:25.889 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.883+0000 7fa1fa9da740 1 -- start start 2024-09-19T06:21:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.884+0000 7fa1fa9da740 1 Processor -- start 2024-09-19T06:21:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.884+0000 7fa1fa9da740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e4237e1e0 0x562e4238d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.884+0000 7fa1fa9da740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e4237eb00 0x562e4238d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.884+0000 7fa1fa9da740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e423893a0 0x562e4238ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.884+0000 7fa1fa9da740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01b1000 con 0x562e4237e1e0 2024-09-19T06:21:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.884+0000 7fa1fa9da740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01b0930 con 0x562e423893a0 2024-09-19T06:21:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.884+0000 7fa1fa9da740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01adb90 con 0x562e4237eb00 2024-09-19T06:21:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.884+0000 7fa1fa9da740 10 client.0 _ll_register_callbacks cb 0x7fa1dc009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.884+0000 7fa1f5000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e4237e1e0 0x562e4238d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.884+0000 7fa1efe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e4237eb00 0x562e4238d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.884+0000 7fa1f5a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e423893a0 0x562e4238ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.884+0000 7fa1efe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e4237eb00 0x562e4238d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:46978/0 (socket says 172.21.15.3:46978) 2024-09-19T06:21:25.891 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.884+0000 7fa1efe00640 1 -- 172.21.15.3:0/2781408391 learned_addr learned my addr 172.21.15.3:0/2781408391 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:25.891 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.884+0000 7fa1f5000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e4237e1e0 0x562e4238d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52878/0 (socket says 172.21.15.3:52878) 2024-09-19T06:21:25.891 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.885+0000 7fa1efe00640 1 -- 172.21.15.3:0/2781408391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e423893a0 msgr2=0x562e4238ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:25.891 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.885+0000 7fa1efe00640 1 --2- 172.21.15.3:0/2781408391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e423893a0 0x562e4238ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.891 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.885+0000 7fa1efe00640 1 -- 172.21.15.3:0/2781408391 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e4237e1e0 msgr2=0x562e4238d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:25.891 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.885+0000 7fa1efe00640 1 --2- 172.21.15.3:0/2781408391 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e4237e1e0 0x562e4238d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.891 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.885+0000 7fa1efe00640 1 -- 172.21.15.3:0/2781408391 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e424030c0 con 0x562e4237eb00 2024-09-19T06:21:25.891 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.885+0000 7fa1f5000640 1 --2- 172.21.15.3:0/2781408391 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e4237e1e0 0x562e4238d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:25.891 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.885+0000 7fa1f5a00640 1 --2- 172.21.15.3:0/2781408391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e423893a0 0x562e4238ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:25.891 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.885+0000 7fa1efe00640 1 --2- 172.21.15.3:0/2781408391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e4237eb00 0x562e4238d880 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc0058c0 tx=0x7fa1dc01eb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72e8bcc04fdecf42 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:25.891 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.885+0000 7fa1d6a00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:21:25.891 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.885+0000 7fa1d6a00640 1 -- 172.21.15.3:0/2781408391 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc03f060 con 0x562e4237eb00 2024-09-19T06:21:25.891 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.885+0000 7fa1fa9da740 1 -- 172.21.15.3:0/2781408391 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1e4004340 con 0x562e4237eb00 2024-09-19T06:21:25.891 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.885+0000 7fa1d6a00640 1 -- 172.21.15.3:0/2781408391 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7fa1dc0116b0 con 0x562e4237eb00 2024-09-19T06:21:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.885+0000 7fa1d6a00640 1 -- 172.21.15.3:0/2781408391 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa1dc00ebb0 con 0x562e4237eb00 2024-09-19T06:21:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.886+0000 7fa1fa9da740 10 client.27886 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.886+0000 7fa1fa9da740 1 -- 172.21.15.3:0/2781408391 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562e424043d0 con 0x562e4237eb00 2024-09-19T06:21:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.886+0000 7fa1d6a00640 1 -- 172.21.15.3:0/2781408391 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1e4004340 con 0x562e4237eb00 2024-09-19T06:21:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.886+0000 7fa1d6a00640 1 -- 172.21.15.3:0/2781408391 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa1dc027040 con 0x562e4237eb00 2024-09-19T06:21:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.886+0000 7fa1fa9da740 10 client.27886 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.886+0000 7fa1fa9da740 10 client.27886 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.886+0000 7fa1fa9da740 20 client.27886 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.886+0000 7fa1fa9da740 1 --2- 172.21.15.3:0/2781408391 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562e42404af0 0x562e42406f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.886+0000 7fa1fa9da740 4 client.27886 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:21:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.886+0000 7fa1fa9da740 1 -- 172.21.15.3:0/2781408391 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562e42375d80 con 0x562e42404af0 2024-09-19T06:21:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.886+0000 7fa1f5000640 1 --2- 172.21.15.3:0/2781408391 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562e42404af0 0x562e42406f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:25.893 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.887+0000 7fa1f5000640 1 --2- 172.21.15.3:0/2781408391 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562e42404af0 0x562e42406f10 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e30650fbdb47d634 server_cookie=fb4e64bfc23b336a in_seq=0 out_seq=0 2024-09-19T06:21:25.893 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.887+0000 7fa1d6a00640 10 client.27886 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:25.905 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.903+0000 7fa1d6a00640 1 -- 172.21.15.3:0/2781408391 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562e42375d80 con 0x562e42404af0 2024-09-19T06:21:25.905 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.903+0000 7fa1d6a00640 10 client.27886 handle_command_reply: tid=0 2024-09-19T06:21:25.905 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.903+0000 7fa1fa9da740 1 client.27886 shutdown 2024-09-19T06:21:25.905 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.903+0000 7fa1fa9da740 1 -- 172.21.15.3:0/2781408391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e4237eb00 msgr2=0x562e4238d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:25.905 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.903+0000 7fa1fa9da740 1 --2- 172.21.15.3:0/2781408391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e4237eb00 0x562e4238d880 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc0058c0 tx=0x7fa1dc01eb40 comp rx=0 tx=0).stop 2024-09-19T06:21:25.905 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.903+0000 7fa1fa9da740 1 -- 172.21.15.3:0/2781408391 shutdown_connections 2024-09-19T06:21:25.905 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.903+0000 7fa1fa9da740 1 --2- 172.21.15.3:0/2781408391 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562e42404af0 0x562e42406f10 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.905 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.903+0000 7fa1fa9da740 1 --2- 172.21.15.3:0/2781408391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562e423893a0 0x562e4238ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.903+0000 7fa1fa9da740 1 --2- 172.21.15.3:0/2781408391 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562e4237eb00 0x562e4238d880 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.903+0000 7fa1d6a00640 0 client.27886 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.903+0000 7fa1fa9da740 1 --2- 172.21.15.3:0/2781408391 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562e4237e1e0 0x562e4238d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.903+0000 7fa1fa9da740 1 -- 172.21.15.3:0/2781408391 >> 172.21.15.3:0/2781408391 conn(0x562e4237a750 msgr2=0x562e42379010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.903+0000 7fa1fa9da740 1 -- 172.21.15.3:0/2781408391 shutdown_connections 2024-09-19T06:21:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.903+0000 7fa1fa9da740 1 -- 172.21.15.3:0/2781408391 wait complete. 2024-09-19T06:21:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.903+0000 7fa1fa9da740 20 client.27886 trim_cache size 0 max 16384 2024-09-19T06:21:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:21:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:21:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:21:25.907 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:21:25.907 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.904+0000 7fa1f7a00640 1 -- 172.21.15.3:0/3111723675 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa1d80a33b0 msgr2=0x7fa1d80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:25.907 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.904+0000 7fa1f7a00640 1 --2- 172.21.15.3:0/3111723675 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa1d80a33b0 0x7fa1d80a5870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x562e4237bad0 tx=0x7fa1dc005850 comp rx=0 tx=0).stop 2024-09-19T06:21:25.907 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.904+0000 7fa1f7a00640 1 -- 172.21.15.3:0/3111723675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1f019ef80 msgr2=0x7fa1f019f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:25.907 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.904+0000 7fa1f7a00640 1 --2- 172.21.15.3:0/3111723675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1f019ef80 0x7fa1f019f430 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800e940 tx=0x7fa1e800ee00 comp rx=0 tx=0).stop 2024-09-19T06:21:25.907 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.904+0000 7fa1f7a00640 1 -- 172.21.15.3:0/3111723675 shutdown_connections 2024-09-19T06:21:25.907 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.904+0000 7fa1f7a00640 1 --2- 172.21.15.3:0/3111723675 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa1d80a33b0 0x7fa1d80a5870 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.904+0000 7fa1f7a00640 1 --2- 172.21.15.3:0/3111723675 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa1f019ef80 0x7fa1f019f430 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.904+0000 7fa1f7a00640 1 --2- 172.21.15.3:0/3111723675 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa1f0109090 0x7fa1f019ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.904+0000 7fa1f7a00640 1 --2- 172.21.15.3:0/3111723675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1f0103f40 0x7fa1f019a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.904+0000 7fa1f7a00640 1 -- 172.21.15.3:0/3111723675 >> 172.21.15.3:0/3111723675 conn(0x7fa1f00ff970 msgr2=0x7fa1f0100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.904+0000 7fa1f7a00640 1 -- 172.21.15.3:0/3111723675 shutdown_connections 2024-09-19T06:21:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:25.904+0000 7fa1f7a00640 1 -- 172.21.15.3:0/3111723675 wait complete. 2024-09-19T06:21:26.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:26 smithi059 ceph-mon[35138]: pgmap v280: 97 pgs: 97 active+clean; 5.0 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-19T06:21:26.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:26 smithi003 ceph-mon[30893]: pgmap v280: 97 pgs: 97 active+clean; 5.0 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-19T06:21:26.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:26 smithi071 ceph-mon[35662]: pgmap v280: 97 pgs: 97 active+clean; 5.0 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-19T06:21:28.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:28 smithi059 ceph-mon[35138]: pgmap v281: 97 pgs: 97 active+clean; 5.0 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-09-19T06:21:28.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:28 smithi003 ceph-mon[30893]: pgmap v281: 97 pgs: 97 active+clean; 5.0 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-09-19T06:21:28.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:28 smithi071 ceph-mon[35662]: pgmap v281: 97 pgs: 97 active+clean; 5.0 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-09-19T06:21:30.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:30 smithi059 ceph-mon[35138]: pgmap v282: 97 pgs: 97 active+clean; 5.3 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-19T06:21:30.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:30 smithi003 ceph-mon[30893]: pgmap v282: 97 pgs: 97 active+clean; 5.3 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-19T06:21:30.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:30 smithi071 ceph-mon[35662]: pgmap v282: 97 pgs: 97 active+clean; 5.3 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-19T06:21:32.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:32 smithi059 ceph-mon[35138]: pgmap v283: 97 pgs: 97 active+clean; 5.3 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 16 op/s 2024-09-19T06:21:32.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:32 smithi003 ceph-mon[30893]: pgmap v283: 97 pgs: 97 active+clean; 5.3 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 16 op/s 2024-09-19T06:21:32.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:32 smithi071 ceph-mon[35662]: pgmap v283: 97 pgs: 97 active+clean; 5.3 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 16 op/s 2024-09-19T06:21:34.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:34 smithi059 ceph-mon[35138]: pgmap v284: 97 pgs: 97 active+clean; 5.3 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 16 op/s 2024-09-19T06:21:34.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:34 smithi003 ceph-mon[30893]: pgmap v284: 97 pgs: 97 active+clean; 5.3 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 16 op/s 2024-09-19T06:21:34.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:34 smithi071 ceph-mon[35662]: pgmap v284: 97 pgs: 97 active+clean; 5.3 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 16 op/s 2024-09-19T06:21:36.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:36 smithi059 ceph-mon[35138]: pgmap v285: 97 pgs: 97 active+clean; 5.5 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 23 op/s 2024-09-19T06:21:36.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:36 smithi003 ceph-mon[30893]: pgmap v285: 97 pgs: 97 active+clean; 5.5 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 23 op/s 2024-09-19T06:21:36.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:36 smithi071 ceph-mon[35662]: pgmap v285: 97 pgs: 97 active+clean; 5.5 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 23 op/s 2024-09-19T06:21:38.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:38 smithi059 ceph-mon[35138]: pgmap v286: 97 pgs: 97 active+clean; 5.5 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 16 op/s 2024-09-19T06:21:38.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:38 smithi003 ceph-mon[30893]: pgmap v286: 97 pgs: 97 active+clean; 5.5 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 16 op/s 2024-09-19T06:21:38.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:38 smithi071 ceph-mon[35662]: pgmap v286: 97 pgs: 97 active+clean; 5.5 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 16 op/s 2024-09-19T06:21:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.033+0000 7fa018200640 1 -- 172.21.15.3:0/3591199805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa010077040 msgr2=0x7fa010112430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.033+0000 7fa018200640 1 --2- 172.21.15.3:0/3591199805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa010077040 0x7fa010112430 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009900 tx=0x7f9ffc02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.033+0000 7fa018200640 1 -- 172.21.15.3:0/3591199805 shutdown_connections 2024-09-19T06:21:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.033+0000 7fa018200640 1 --2- 172.21.15.3:0/3591199805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa010112970 0x7fa010114d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.033+0000 7fa018200640 1 --2- 172.21.15.3:0/3591199805 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa010077040 0x7fa010112430 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.033+0000 7fa018200640 1 --2- 172.21.15.3:0/3591199805 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa010076720 0x7fa010076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.033+0000 7fa018200640 1 -- 172.21.15.3:0/3591199805 >> 172.21.15.3:0/3591199805 conn(0x7fa0100ff970 msgr2=0x7fa010101d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.033+0000 7fa018200640 1 -- 172.21.15.3:0/3591199805 shutdown_connections 2024-09-19T06:21:39.036 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.033+0000 7fa018200640 1 -- 172.21.15.3:0/3591199805 wait complete. 2024-09-19T06:21:39.037 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.034+0000 7fa018200640 1 Processor -- start 2024-09-19T06:21:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.034+0000 7fa018200640 1 -- start start 2024-09-19T06:21:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.034+0000 7fa018200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa010076720 0x7fa0101a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.034+0000 7fa018200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa010077040 0x7fa0101a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.034+0000 7fa018200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa010112970 0x7fa01019e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.034+0000 7fa018200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa010118530 con 0x7fa010076720 2024-09-19T06:21:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.034+0000 7fa018200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa0101183b0 con 0x7fa010112970 2024-09-19T06:21:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.034+0000 7fa018200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa0101186b0 con 0x7fa010077040 2024-09-19T06:21:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.035+0000 7fa015800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa010076720 0x7fa0101a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.035+0000 7fa015800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa010076720 0x7fa0101a46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53022/0 (socket says 172.21.15.3:53022) 2024-09-19T06:21:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.035+0000 7fa015800640 1 -- 172.21.15.3:0/981291650 learned_addr learned my addr 172.21.15.3:0/981291650 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.035+0000 7fa016200640 1 --2- 172.21.15.3:0/981291650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa010112970 0x7fa01019e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.035+0000 7fa014e00640 1 --2- 172.21.15.3:0/981291650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa010077040 0x7fa0101a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.035+0000 7fa015800640 1 -- 172.21.15.3:0/981291650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa010077040 msgr2=0x7fa0101a4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.035+0000 7fa015800640 1 --2- 172.21.15.3:0/981291650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa010077040 0x7fa0101a4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.035+0000 7fa015800640 1 -- 172.21.15.3:0/981291650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa010112970 msgr2=0x7fa01019e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.035+0000 7fa015800640 1 --2- 172.21.15.3:0/981291650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa010112970 0x7fa01019e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.035+0000 7fa015800640 1 -- 172.21.15.3:0/981291650 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa01019f020 con 0x7fa010076720 2024-09-19T06:21:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.035+0000 7fa015800640 1 --2- 172.21.15.3:0/981291650 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa010076720 0x7fa0101a46e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa00400e9f0 tx=0x7fa00400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.036+0000 7fa00e000640 1 -- 172.21.15.3:0/981291650 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00400cd80 con 0x7fa010076720 2024-09-19T06:21:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.036+0000 7fa018200640 1 -- 172.21.15.3:0/981291650 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa01019f310 con 0x7fa010076720 2024-09-19T06:21:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.036+0000 7fa00e000640 1 -- 172.21.15.3:0/981291650 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa004005500 con 0x7fa010076720 2024-09-19T06:21:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.036+0000 7fa018200640 1 -- 172.21.15.3:0/981291650 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0101ab530 con 0x7fa010076720 2024-09-19T06:21:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.036+0000 7fa00e000640 1 -- 172.21.15.3:0/981291650 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa004018630 con 0x7fa010076720 2024-09-19T06:21:39.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.039+0000 7fa01b091740 1 Processor -- start 2024-09-19T06:21:39.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.039+0000 7fa00e000640 1 -- 172.21.15.3:0/981291650 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fa0040046c0 con 0x7fa010076720 2024-09-19T06:21:39.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.039+0000 7fa01b091740 1 -- start start 2024-09-19T06:21:39.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.039+0000 7fa01b091740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a443c1e0 0x55c3a443c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.039+0000 7fa01b091740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443cb00 0x55c3a4446e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.039+0000 7fa01b091740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c3a44473a0 0x55c3a4449790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.039+0000 7fa01b091740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55c3a43a2100 con 0x55c3a443c1e0 2024-09-19T06:21:39.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.039+0000 7fa01b091740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c3a434a1b0 con 0x55c3a443cb00 2024-09-19T06:21:39.041 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.039+0000 7fa01b091740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c3a439e0c0 con 0x55c3a44473a0 2024-09-19T06:21:39.044 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.040+0000 7fa016200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a443c1e0 0x55c3a443c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.044 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.040+0000 7fa014e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c3a44473a0 0x55c3a4449790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.044 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.040+0000 7fa015800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443cb00 0x55c3a4446e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.044 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.040+0000 7fa016200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a443c1e0 0x55c3a443c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53034/0 (socket says 172.21.15.3:53034) 2024-09-19T06:21:39.044 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.040+0000 7fa014e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c3a44473a0 0x55c3a4449790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:51290/0 (socket says 172.21.15.3:51290) 2024-09-19T06:21:39.044 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.040+0000 7fa016200640 1 -- 172.21.15.3:0/4101621338 learned_addr learned my addr 172.21.15.3:0/4101621338 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:39.044 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.040+0000 7fa015800640 1 -- 172.21.15.3:0/4101621338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c3a44473a0 msgr2=0x55c3a4449790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.040+0000 7fa015800640 1 --2- 172.21.15.3:0/4101621338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c3a44473a0 0x55c3a4449790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.040+0000 7fa015800640 1 -- 172.21.15.3:0/4101621338 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a443c1e0 msgr2=0x55c3a443c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.040+0000 7fa015800640 1 --2- 172.21.15.3:0/4101621338 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a443c1e0 0x55c3a443c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.040+0000 7fa015800640 1 -- 172.21.15.3:0/4101621338 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3a40b5210 con 0x55c3a443cb00 2024-09-19T06:21:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.040+0000 7fa016200640 1 --2- 172.21.15.3:0/4101621338 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a443c1e0 0x55c3a443c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.040+0000 7fa00e000640 1 --2- 172.21.15.3:0/981291650 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9ff80a33b0 0x7f9ff80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.040+0000 7fa015800640 1 --2- 172.21.15.3:0/4101621338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443cb00 0x55c3a4446e60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa0040cd950 tx=0x7fa0040d8780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44677df7bb615cce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.041+0000 7fa00e000640 1 -- 172.21.15.3:0/981291650 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7fa0040d0290 con 0x7fa010076720 2024-09-19T06:21:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.041+0000 7fa016200640 1 --2- 172.21.15.3:0/981291650 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9ff80a33b0 0x7f9ff80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.041+0000 7fa002a00640 1 -- 172.21.15.3:0/4101621338 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa004098780 con 0x55c3a443cb00 2024-09-19T06:21:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.041+0000 7fa002a00640 1 -- 172.21.15.3:0/4101621338 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa00409cbe0 con 0x55c3a443cb00 2024-09-19T06:21:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.041+0000 7fa002a00640 1 -- 172.21.15.3:0/4101621338 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00409be40 con 0x55c3a443cb00 2024-09-19T06:21:39.046 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.041+0000 7fa01b091740 1 -- 172.21.15.3:0/4101621338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443cb00 msgr2=0x55c3a4446e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:39.046 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.041+0000 7fa016200640 1 --2- 172.21.15.3:0/981291650 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9ff80a33b0 0x7f9ff80a5870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa0080116f0 tx=0x7fa0080096a0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:39.046 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.041+0000 7fa01b091740 1 --2- 172.21.15.3:0/4101621338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443cb00 0x55c3a4446e60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa0040cd950 tx=0x7fa0040d8780 comp rx=0 tx=0).stop 2024-09-19T06:21:39.046 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.042+0000 7fa01b091740 1 -- 172.21.15.3:0/4101621338 shutdown_connections 2024-09-19T06:21:39.046 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.042+0000 7fa01b091740 1 --2- 172.21.15.3:0/4101621338 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c3a44473a0 0x55c3a4449790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.046 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.042+0000 7fa01b091740 1 --2- 172.21.15.3:0/4101621338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443cb00 0x55c3a4446e60 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.046 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.042+0000 7fa01b091740 1 --2- 172.21.15.3:0/4101621338 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a443c1e0 0x55c3a443c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.046 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.042+0000 7fa01b091740 1 -- 172.21.15.3:0/4101621338 >> 172.21.15.3:0/4101621338 conn(0x55c3a4438750 msgr2=0x55c3a4438b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:39.046 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.042+0000 7fa01b091740 1 -- 172.21.15.3:0/4101621338 shutdown_connections 2024-09-19T06:21:39.046 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.042+0000 7fa01b091740 1 -- 172.21.15.3:0/4101621338 wait complete. 2024-09-19T06:21:39.046 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.042+0000 7fa01b091740 1 -- start start 2024-09-19T06:21:39.046 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.042+0000 7fa01b091740 1 Processor -- start 2024-09-19T06:21:39.050 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.043+0000 7fa01b091740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443c1e0 0x55c3a4444390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.050 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.043+0000 7fa01b091740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c3a443cb00 0x55c3a44448d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.050 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.043+0000 7fa01b091740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a44473a0 0x55c3a4444e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.050 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.043+0000 7fa01b091740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55c3a4449f70 con 0x55c3a44473a0 2024-09-19T06:21:39.050 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.043+0000 7fa01b091740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55c3a432b090 con 0x55c3a443c1e0 2024-09-19T06:21:39.050 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.043+0000 7fa01b091740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55c3a444a0f0 con 0x55c3a443cb00 2024-09-19T06:21:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.043+0000 7fa01b091740 10 client.0 _ll_register_callbacks cb 0x55c3a437ff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.043+0000 7fa015800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443c1e0 0x55c3a4444390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.043+0000 7fa016200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a44473a0 0x55c3a4444e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.043+0000 7fa015800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443c1e0 0x55c3a4444390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:43290/0 (socket says 172.21.15.3:43290) 2024-09-19T06:21:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.043+0000 7fa015800640 1 -- 172.21.15.3:0/2861040988 learned_addr learned my addr 172.21.15.3:0/2861040988 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.043+0000 7fa014e00640 1 --2- 172.21.15.3:0/2861040988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c3a443cb00 0x55c3a44448d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.044+0000 7fa015800640 1 -- 172.21.15.3:0/2861040988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c3a443cb00 msgr2=0x55c3a44448d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.044+0000 7fa015800640 1 --2- 172.21.15.3:0/2861040988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c3a443cb00 0x55c3a44448d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.044+0000 7fa015800640 1 -- 172.21.15.3:0/2861040988 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a44473a0 msgr2=0x55c3a4444e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.044+0000 7fa015800640 1 --2- 172.21.15.3:0/2861040988 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a44473a0 0x55c3a4444e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.044+0000 7fa015800640 1 -- 172.21.15.3:0/2861040988 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3a4181620 con 0x55c3a443c1e0 2024-09-19T06:21:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.044+0000 7fa015800640 1 --2- 172.21.15.3:0/2861040988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443c1e0 0x55c3a4444390 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa0040049d0 tx=0x7fa0040cde60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1bc32282e14c1a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.044+0000 7f9ff7400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:21:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.044+0000 7f9ff7400640 1 -- 172.21.15.3:0/2861040988 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0040b5060 con 0x55c3a443c1e0 2024-09-19T06:21:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.044+0000 7fa01b091740 1 -- 172.21.15.3:0/2861040988 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa00409cbe0 con 0x55c3a443c1e0 2024-09-19T06:21:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.044+0000 7f9ff7400640 1 -- 172.21.15.3:0/2861040988 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7fa00409c950 con 0x55c3a443c1e0 2024-09-19T06:21:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.044+0000 7f9ff7400640 1 -- 172.21.15.3:0/2861040988 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa00409c020 con 0x55c3a443c1e0 2024-09-19T06:21:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.044+0000 7fa01b091740 10 client.27914 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.044+0000 7fa01b091740 1 -- 172.21.15.3:0/2861040988 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c3a4449f70 con 0x55c3a443c1e0 2024-09-19T06:21:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.045+0000 7f9ff7400640 1 -- 172.21.15.3:0/2861040988 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa00409cbe0 con 0x55c3a443c1e0 2024-09-19T06:21:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.045+0000 7f9ff7400640 1 -- 172.21.15.3:0/2861040988 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa0040a4cc0 con 0x55c3a443c1e0 2024-09-19T06:21:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.045+0000 7fa01b091740 10 client.27914 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.045+0000 7fa01b091740 10 client.27914 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.045+0000 7fa01b091740 20 client.27914 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.045+0000 7fa01b091740 1 --2- 172.21.15.3:0/2861040988 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55c3a4456d10 0x55c3a4459100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.045+0000 7fa01b091740 4 client.27914 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.045+0000 7fa01b091740 1 -- 172.21.15.3:0/2861040988 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3a43af830 con 0x55c3a4456d10 2024-09-19T06:21:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.045+0000 7fa014e00640 1 --2- 172.21.15.3:0/2861040988 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55c3a4456d10 0x55c3a4459100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.046+0000 7fa014e00640 1 --2- 172.21.15.3:0/2861040988 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55c3a4456d10 0x55c3a4459100 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a0f745f3106478e server_cookie=483a066c12106fe7 in_seq=0 out_seq=0 2024-09-19T06:21:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.046+0000 7f9ff7400640 10 client.27914 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.047+0000 7f9ff7400640 1 -- 172.21.15.3:0/2861040988 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c3a43af830 con 0x55c3a4456d10 2024-09-19T06:21:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.047+0000 7f9ff7400640 10 client.27914 handle_command_reply: tid=0 2024-09-19T06:21:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.047+0000 7fa01b091740 1 client.27914 shutdown 2024-09-19T06:21:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.047+0000 7fa01b091740 1 -- 172.21.15.3:0/2861040988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443c1e0 msgr2=0x55c3a4444390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.047+0000 7fa01b091740 1 --2- 172.21.15.3:0/2861040988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443c1e0 0x55c3a4444390 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa0040049d0 tx=0x7fa0040cde60 comp rx=0 tx=0).stop 2024-09-19T06:21:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.047+0000 7fa01b091740 1 -- 172.21.15.3:0/2861040988 shutdown_connections 2024-09-19T06:21:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.047+0000 7fa01b091740 1 --2- 172.21.15.3:0/2861040988 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55c3a4456d10 0x55c3a4459100 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.047+0000 7fa01b091740 1 --2- 172.21.15.3:0/2861040988 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a44473a0 0x55c3a4444e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.053 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.047+0000 7f9ff7400640 0 client.27914 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.047+0000 7fa01b091740 1 --2- 172.21.15.3:0/2861040988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c3a443cb00 0x55c3a44448d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.047+0000 7fa01b091740 1 --2- 172.21.15.3:0/2861040988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443c1e0 0x55c3a4444390 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.047+0000 7fa01b091740 1 -- 172.21.15.3:0/2861040988 >> 172.21.15.3:0/2861040988 conn(0x55c3a4438750 msgr2=0x55c3a443e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.047+0000 7fa01b091740 1 -- 172.21.15.3:0/2861040988 shutdown_connections 2024-09-19T06:21:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.047+0000 7fa01b091740 1 -- 172.21.15.3:0/2861040988 wait complete. 2024-09-19T06:21:39.054 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.048+0000 7fa01b091740 20 client.27914 trim_cache size 0 max 16384 2024-09-19T06:21:39.066 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.063+0000 7fa01b091740 1 Processor -- start 2024-09-19T06:21:39.066 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.063+0000 7fa01b091740 1 -- start start 2024-09-19T06:21:39.066 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.063+0000 7fa01b091740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443c1e0 0x55c3a4442c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.066 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.063+0000 7fa01b091740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c3a443cb00 0x55c3a443ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.066 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.063+0000 7fa01b091740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a44473a0 0x55c3a445e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.066 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.063+0000 7fa01b091740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa0101b3f90 con 0x55c3a44473a0 2024-09-19T06:21:39.066 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.063+0000 7fa01b091740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa0101b5ad0 con 0x55c3a443c1e0 2024-09-19T06:21:39.066 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.063+0000 7fa01b091740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa0101b4660 con 0x55c3a443cb00 2024-09-19T06:21:39.066 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.063+0000 7fa016200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a44473a0 0x55c3a445e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.066 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.063+0000 7fa014e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c3a443cb00 0x55c3a443ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.066 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.064+0000 7fa015800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443c1e0 0x55c3a4442c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.064+0000 7fa016200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a44473a0 0x55c3a445e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53040/0 (socket says 172.21.15.3:53040) 2024-09-19T06:21:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.064+0000 7fa015800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443c1e0 0x55c3a4442c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:43302/0 (socket says 172.21.15.3:43302) 2024-09-19T06:21:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.064+0000 7fa016200640 1 -- 172.21.15.3:0/2709477839 learned_addr learned my addr 172.21.15.3:0/2709477839 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.064+0000 7fa015800640 1 -- 172.21.15.3:0/2709477839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c3a443cb00 msgr2=0x55c3a443ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.064+0000 7fa015800640 1 --2- 172.21.15.3:0/2709477839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c3a443cb00 0x55c3a443ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.064+0000 7fa015800640 1 -- 172.21.15.3:0/2709477839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a44473a0 msgr2=0x55c3a445e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.064+0000 7fa015800640 1 --2- 172.21.15.3:0/2709477839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a44473a0 0x55c3a445e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.064+0000 7fa015800640 1 -- 172.21.15.3:0/2709477839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3a443c930 con 0x55c3a443c1e0 2024-09-19T06:21:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.064+0000 7fa014e00640 1 --2- 172.21.15.3:0/2709477839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c3a443cb00 0x55c3a443ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:39.067 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.064+0000 7fa015800640 1 --2- 172.21.15.3:0/2709477839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443c1e0 0x55c3a4442c40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa00409c470 tx=0x7fa0040d8780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c64be1e7268bddaa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:39.070 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.064+0000 7fa002000640 1 -- 172.21.15.3:0/2709477839 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0040b5040 con 0x55c3a443c1e0 2024-09-19T06:21:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.064+0000 7fa002000640 1 -- 172.21.15.3:0/2709477839 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa00409cbe0 con 0x55c3a443c1e0 2024-09-19T06:21:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.064+0000 7fa002000640 1 -- 172.21.15.3:0/2709477839 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00409c2b0 con 0x55c3a443c1e0 2024-09-19T06:21:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.065+0000 7fa01b091740 1 -- 172.21.15.3:0/2709477839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443c1e0 msgr2=0x55c3a4442c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.065+0000 7fa01b091740 1 --2- 172.21.15.3:0/2709477839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443c1e0 0x55c3a4442c40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa00409c470 tx=0x7fa0040d8780 comp rx=0 tx=0).stop 2024-09-19T06:21:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.065+0000 7fa01b091740 1 -- 172.21.15.3:0/2709477839 shutdown_connections 2024-09-19T06:21:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.065+0000 7fa01b091740 1 --2- 172.21.15.3:0/2709477839 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a44473a0 0x55c3a445e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.065+0000 7fa01b091740 1 --2- 172.21.15.3:0/2709477839 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c3a443cb00 0x55c3a443ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.065+0000 7fa01b091740 1 --2- 172.21.15.3:0/2709477839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443c1e0 0x55c3a4442c40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.065+0000 7fa01b091740 1 -- 172.21.15.3:0/2709477839 >> 172.21.15.3:0/2709477839 conn(0x55c3a4438750 msgr2=0x55c3a4446300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.065+0000 7fa01b091740 1 -- 172.21.15.3:0/2709477839 shutdown_connections 2024-09-19T06:21:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.065+0000 7fa01b091740 1 -- 172.21.15.3:0/2709477839 wait complete. 2024-09-19T06:21:39.071 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.065+0000 7fa01b091740 1 -- start start 2024-09-19T06:21:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.066+0000 7fa01b091740 1 Processor -- start 2024-09-19T06:21:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.066+0000 7fa01b091740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443c1e0 0x55c3a444f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.066+0000 7fa01b091740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a443cb00 0x55c3a444ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.066+0000 7fa01b091740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c3a44473a0 0x55c3a444b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.066+0000 7fa01b091740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa0101b5400 con 0x55c3a443cb00 2024-09-19T06:21:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.066+0000 7fa01b091740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa0101b4d30 con 0x55c3a443c1e0 2024-09-19T06:21:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.066+0000 7fa01b091740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa0101b1f90 con 0x55c3a44473a0 2024-09-19T06:21:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.066+0000 7fa01b091740 10 client.0 _ll_register_callbacks cb 0x7fa008009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.066+0000 7fa014e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a443cb00 0x55c3a444ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.066+0000 7fa015800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443c1e0 0x55c3a444f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.066+0000 7fa016200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c3a44473a0 0x55c3a444b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.066+0000 7fa015800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443c1e0 0x55c3a444f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:43310/0 (socket says 172.21.15.3:43310) 2024-09-19T06:21:39.072 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.066+0000 7fa014e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a443cb00 0x55c3a444ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53056/0 (socket says 172.21.15.3:53056) 2024-09-19T06:21:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.066+0000 7fa015800640 1 -- 172.21.15.3:0/539193200 learned_addr learned my addr 172.21.15.3:0/539193200 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.067+0000 7fa016200640 1 -- 172.21.15.3:0/539193200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443c1e0 msgr2=0x55c3a444f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.067+0000 7fa016200640 1 --2- 172.21.15.3:0/539193200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443c1e0 0x55c3a444f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.067+0000 7fa016200640 1 -- 172.21.15.3:0/539193200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a443cb00 msgr2=0x55c3a444ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.067+0000 7fa016200640 1 --2- 172.21.15.3:0/539193200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a443cb00 0x55c3a444ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.067+0000 7fa016200640 1 -- 172.21.15.3:0/539193200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3a444b9c0 con 0x55c3a44473a0 2024-09-19T06:21:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.067+0000 7fa014e00640 1 --2- 172.21.15.3:0/539193200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a443cb00 0x55c3a444ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.067+0000 7fa015800640 1 --2- 172.21.15.3:0/539193200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443c1e0 0x55c3a444f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.067+0000 7fa016200640 1 --2- 172.21.15.3:0/539193200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c3a44473a0 0x55c3a444b190 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa008005fd0 tx=0x7fa008004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc9b6e5c8e6b5322 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.067+0000 7f9ff7400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:21:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.067+0000 7f9ff7400640 1 -- 172.21.15.3:0/539193200 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa00802e060 con 0x55c3a44473a0 2024-09-19T06:21:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.067+0000 7fa01b091740 1 -- 172.21.15.3:0/539193200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa00409cbe0 con 0x55c3a44473a0 2024-09-19T06:21:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.067+0000 7f9ff7400640 1 -- 172.21.15.3:0/539193200 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7fa00801e630 con 0x55c3a44473a0 2024-09-19T06:21:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.068+0000 7f9ff7400640 1 -- 172.21.15.3:0/539193200 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa00801e830 con 0x55c3a44473a0 2024-09-19T06:21:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.068+0000 7fa01b091740 10 client.27904 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.068+0000 7fa01b091740 1 -- 172.21.15.3:0/539193200 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c3a44c16b0 con 0x55c3a44473a0 2024-09-19T06:21:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.068+0000 7f9ff7400640 1 -- 172.21.15.3:0/539193200 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa00409cbe0 con 0x55c3a44473a0 2024-09-19T06:21:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.068+0000 7f9ff7400640 1 -- 172.21.15.3:0/539193200 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa00801dae0 con 0x55c3a44473a0 2024-09-19T06:21:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.068+0000 7fa01b091740 10 client.27904 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.068+0000 7fa01b091740 10 client.27904 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.068+0000 7fa01b091740 20 client.27904 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.068+0000 7fa01b091740 1 --2- 172.21.15.3:0/539193200 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55c3a44c1e30 0x55c3a44c4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.068+0000 7fa01b091740 4 client.27904 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:21:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.068+0000 7fa01b091740 1 -- 172.21.15.3:0/539193200 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c3a43a9b80 con 0x55c3a44c1e30 2024-09-19T06:21:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.068+0000 7fa015800640 1 --2- 172.21.15.3:0/539193200 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55c3a44c1e30 0x55c3a44c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:39.075 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.069+0000 7fa015800640 1 --2- 172.21.15.3:0/539193200 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55c3a44c1e30 0x55c3a44c4250 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=109eb0490214a2cd server_cookie=c4b6848842974194 in_seq=0 out_seq=0 2024-09-19T06:21:39.075 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.069+0000 7f9ff7400640 10 client.27904 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:39.086 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.083+0000 7f9ff7400640 1 -- 172.21.15.3:0/539193200 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c3a43a9b80 con 0x55c3a44c1e30 2024-09-19T06:21:39.086 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.083+0000 7f9ff7400640 10 client.27904 handle_command_reply: tid=0 2024-09-19T06:21:39.086 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.083+0000 7fa01b091740 1 client.27904 shutdown 2024-09-19T06:21:39.086 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.084+0000 7fa01b091740 1 -- 172.21.15.3:0/539193200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c3a44473a0 msgr2=0x55c3a444b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:39.086 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.084+0000 7fa01b091740 1 --2- 172.21.15.3:0/539193200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c3a44473a0 0x55c3a444b190 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa008005fd0 tx=0x7fa008004a40 comp rx=0 tx=0).stop 2024-09-19T06:21:39.087 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.084+0000 7fa01b091740 1 -- 172.21.15.3:0/539193200 shutdown_connections 2024-09-19T06:21:39.087 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.084+0000 7fa01b091740 1 --2- 172.21.15.3:0/539193200 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55c3a44c1e30 0x55c3a44c4250 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.087 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.084+0000 7fa01b091740 1 --2- 172.21.15.3:0/539193200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55c3a44473a0 0x55c3a444b190 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.087 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.084+0000 7fa01b091740 1 --2- 172.21.15.3:0/539193200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55c3a443cb00 0x55c3a444ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.087 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.084+0000 7fa01b091740 1 --2- 172.21.15.3:0/539193200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3a443c1e0 0x55c3a444f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.087 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.084+0000 7f9ff7400640 0 client.27904 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:39.087 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.084+0000 7fa01b091740 1 -- 172.21.15.3:0/539193200 >> 172.21.15.3:0/539193200 conn(0x55c3a4438750 msgr2=0x55c3a44459d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:39.087 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.084+0000 7fa01b091740 1 -- 172.21.15.3:0/539193200 shutdown_connections 2024-09-19T06:21:39.087 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.084+0000 7fa01b091740 1 -- 172.21.15.3:0/539193200 wait complete. 2024-09-19T06:21:39.087 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.084+0000 7fa01b091740 20 client.27904 trim_cache size 0 max 16384 2024-09-19T06:21:39.088 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:21:39.088 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:21:39.088 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:21:39.088 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:21:39.089 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.085+0000 7fa018200640 1 -- 172.21.15.3:0/981291650 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9ff80a33b0 msgr2=0x7f9ff80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:39.089 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.085+0000 7fa018200640 1 --2- 172.21.15.3:0/981291650 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9ff80a33b0 0x7f9ff80a5870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa0080116f0 tx=0x7fa0080096a0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.089 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.085+0000 7fa018200640 1 -- 172.21.15.3:0/981291650 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa010076720 msgr2=0x7fa0101a46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:39.089 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.085+0000 7fa018200640 1 --2- 172.21.15.3:0/981291650 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa010076720 0x7fa0101a46e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa00400e9f0 tx=0x7fa00400edf0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.089 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.085+0000 7fa018200640 1 -- 172.21.15.3:0/981291650 shutdown_connections 2024-09-19T06:21:39.089 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.085+0000 7fa018200640 1 --2- 172.21.15.3:0/981291650 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9ff80a33b0 0x7f9ff80a5870 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.089 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.085+0000 7fa018200640 1 --2- 172.21.15.3:0/981291650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa010112970 0x7fa01019e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.089 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.085+0000 7fa018200640 1 --2- 172.21.15.3:0/981291650 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa010077040 0x7fa0101a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.089 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.085+0000 7fa018200640 1 --2- 172.21.15.3:0/981291650 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa010076720 0x7fa0101a46e0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:39.089 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.085+0000 7fa018200640 1 -- 172.21.15.3:0/981291650 >> 172.21.15.3:0/981291650 conn(0x7fa0100ff970 msgr2=0x7fa010113ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:39.089 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.085+0000 7fa018200640 1 -- 172.21.15.3:0/981291650 shutdown_connections 2024-09-19T06:21:39.090 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:39.085+0000 7fa018200640 1 -- 172.21.15.3:0/981291650 wait complete. 2024-09-19T06:21:39.222 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:21:39.603 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:40.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.197+0000 7f1adc800640 1 -- 172.21.15.3:0/3819071509 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ad41049a0 msgr2=0x7f1ad41089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:40.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.197+0000 7f1adc800640 1 --2- 172.21.15.3:0/3819071509 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ad41049a0 0x7f1ad41089f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4009900 tx=0x7f1ac402a400 comp rx=0 tx=0).stop 2024-09-19T06:21:40.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.197+0000 7f1adc800640 1 -- 172.21.15.3:0/3819071509 shutdown_connections 2024-09-19T06:21:40.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.197+0000 7f1adc800640 1 --2- 172.21.15.3:0/3819071509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad4109120 0x7f1ad4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.197+0000 7f1adc800640 1 --2- 172.21.15.3:0/3819071509 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ad41049a0 0x7f1ad41089f0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.197+0000 7f1adc800640 1 --2- 172.21.15.3:0/3819071509 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ad4103ff0 0x7f1ad41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.197+0000 7f1adc800640 1 -- 172.21.15.3:0/3819071509 >> 172.21.15.3:0/3819071509 conn(0x7f1ad40ffa90 msgr2=0x7f1ad4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:40.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.197+0000 7f1adc800640 1 -- 172.21.15.3:0/3819071509 shutdown_connections 2024-09-19T06:21:40.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.197+0000 7f1adc800640 1 -- 172.21.15.3:0/3819071509 wait complete. 2024-09-19T06:21:40.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.198+0000 7f1adc800640 1 Processor -- start 2024-09-19T06:21:40.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.198+0000 7f1adc800640 1 -- start start 2024-09-19T06:21:40.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.198+0000 7f1adc800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ad4103ff0 0x7f1ad419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:40.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.198+0000 7f1adc800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ad41049a0 0x7f1ad419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:40.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.198+0000 7f1adc800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad4109120 0x7f1ad419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:40.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.198+0000 7f1adc800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad4114140 con 0x7f1ad41049a0 2024-09-19T06:21:40.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.198+0000 7f1adc800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad4113fc0 con 0x7f1ad4109120 2024-09-19T06:21:40.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.198+0000 7f1adc800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad41142c0 con 0x7f1ad4103ff0 2024-09-19T06:21:40.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.199+0000 7f1ad9400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ad41049a0 0x7f1ad419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:40.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.199+0000 7f1ad9400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ad41049a0 0x7f1ad419ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53084/0 (socket says 172.21.15.3:53084) 2024-09-19T06:21:40.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.199+0000 7f1ad9400640 1 -- 172.21.15.3:0/1572297754 learned_addr learned my addr 172.21.15.3:0/1572297754 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:40.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.199+0000 7f1ad9e00640 1 --2- 172.21.15.3:0/1572297754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ad4103ff0 0x7f1ad419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:40.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.199+0000 7f1ada800640 1 --2- 172.21.15.3:0/1572297754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad4109120 0x7f1ad419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:40.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.199+0000 7f1ad9400640 1 -- 172.21.15.3:0/1572297754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ad4103ff0 msgr2=0x7f1ad419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:40.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.199+0000 7f1ad9400640 1 --2- 172.21.15.3:0/1572297754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ad4103ff0 0x7f1ad419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.199+0000 7f1ad9400640 1 -- 172.21.15.3:0/1572297754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad4109120 msgr2=0x7f1ad419eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:40.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.199+0000 7f1ad9400640 1 --2- 172.21.15.3:0/1572297754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad4109120 0x7f1ad419eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.199+0000 7f1ad9400640 1 -- 172.21.15.3:0/1572297754 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad419f5d0 con 0x7f1ad41049a0 2024-09-19T06:21:40.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.199+0000 7f1ad9e00640 1 --2- 172.21.15.3:0/1572297754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ad4103ff0 0x7f1ad419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:40.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.200+0000 7f1ad9400640 1 --2- 172.21.15.3:0/1572297754 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ad41049a0 0x7f1ad419ab60 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4006010 tx=0x7f1ac4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:40.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.200+0000 7f1acea00640 1 -- 172.21.15.3:0/1572297754 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac403f030 con 0x7f1ad41049a0 2024-09-19T06:21:40.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.200+0000 7f1acea00640 1 -- 172.21.15.3:0/1572297754 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ac4004440 con 0x7f1ad41049a0 2024-09-19T06:21:40.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.200+0000 7f1adc800640 1 -- 172.21.15.3:0/1572297754 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ad419f860 con 0x7f1ad41049a0 2024-09-19T06:21:40.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.200+0000 7f1acea00640 1 -- 172.21.15.3:0/1572297754 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4035070 con 0x7f1ad41049a0 2024-09-19T06:21:40.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.200+0000 7f1adc800640 1 -- 172.21.15.3:0/1572297754 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ad41a71a0 con 0x7f1ad41049a0 2024-09-19T06:21:40.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.203+0000 7f1acea00640 1 -- 172.21.15.3:0/1572297754 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f1ac4042030 con 0x7f1ad41049a0 2024-09-19T06:21:40.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.203+0000 7f1adf1cf740 1 Processor -- start 2024-09-19T06:21:40.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.203+0000 7f1adf1cf740 1 -- start start 2024-09-19T06:21:40.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.204+0000 7f1adf1cf740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8c2b90 0x556c6a8c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:40.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.204+0000 7f1adf1cf740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556c6a8c34b0 0x556c6a8cd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:40.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.204+0000 7f1adf1cf740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c6a8cdd70 0x556c6a8d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:40.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.204+0000 7f1adf1cf740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556c6a8293e0 con 0x556c6a8c2b90 2024-09-19T06:21:40.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.204+0000 7f1adf1cf740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556c6a7d0d80 con 0x556c6a8c34b0 2024-09-19T06:21:40.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.204+0000 7f1adf1cf740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556c6a8253a0 con 0x556c6a8cdd70 2024-09-19T06:21:40.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.204+0000 7f1ada800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8c2b90 0x556c6a8c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:40.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.204+0000 7f1ad9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556c6a8c34b0 0x556c6a8cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:40.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.204+0000 7f1ada800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8c2b90 0x556c6a8c2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53094/0 (socket says 172.21.15.3:53094) 2024-09-19T06:21:40.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.204+0000 7f1ada800640 1 -- 172.21.15.3:0/4061937273 learned_addr learned my addr 172.21.15.3:0/4061937273 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:40.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.204+0000 7f1ad9400640 1 --2- 172.21.15.3:0/4061937273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c6a8cdd70 0x556c6a8d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:40.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.204+0000 7f1ad9e00640 1 -- 172.21.15.3:0/4061937273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c6a8cdd70 msgr2=0x556c6a8d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:40.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.204+0000 7f1ad9e00640 1 --2- 172.21.15.3:0/4061937273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c6a8cdd70 0x556c6a8d0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.204+0000 7f1ad9e00640 1 -- 172.21.15.3:0/4061937273 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8c2b90 msgr2=0x556c6a8c2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:40.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.204+0000 7f1ad9e00640 1 --2- 172.21.15.3:0/4061937273 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8c2b90 0x556c6a8c2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.204+0000 7f1ad9e00640 1 -- 172.21.15.3:0/4061937273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c6a7efae0 con 0x556c6a8c34b0 2024-09-19T06:21:40.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.205+0000 7f1ad9e00640 1 --2- 172.21.15.3:0/4061937273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556c6a8c34b0 0x556c6a8cd830 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009fd0 tx=0x7f1ac80118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b6e17e5040dd774 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:40.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.205+0000 7f1acea00640 1 --2- 172.21.15.3:0/1572297754 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1abc0a33b0 0x7f1abc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:40.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.205+0000 7f1ac3000640 1 -- 172.21.15.3:0/4061937273 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8004310 con 0x556c6a8c34b0 2024-09-19T06:21:40.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.205+0000 7f1ac3000640 1 -- 172.21.15.3:0/4061937273 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ac80044b0 con 0x556c6a8c34b0 2024-09-19T06:21:40.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.205+0000 7f1ac3000640 1 -- 172.21.15.3:0/4061937273 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8003650 con 0x556c6a8c34b0 2024-09-19T06:21:40.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.205+0000 7f1ada800640 1 --2- 172.21.15.3:0/1572297754 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1abc0a33b0 0x7f1abc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:40.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.205+0000 7f1acea00640 1 -- 172.21.15.3:0/1572297754 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f1ac40f0100 con 0x7f1ad41049a0 2024-09-19T06:21:40.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.206+0000 7f1adf1cf740 1 -- 172.21.15.3:0/4061937273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556c6a8c34b0 msgr2=0x556c6a8cd830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:40.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.206+0000 7f1adf1cf740 1 --2- 172.21.15.3:0/4061937273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556c6a8c34b0 0x556c6a8cd830 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009fd0 tx=0x7f1ac80118d0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.206+0000 7f1adf1cf740 1 -- 172.21.15.3:0/4061937273 shutdown_connections 2024-09-19T06:21:40.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.206+0000 7f1adf1cf740 1 --2- 172.21.15.3:0/4061937273 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c6a8cdd70 0x556c6a8d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.206+0000 7f1adf1cf740 1 --2- 172.21.15.3:0/4061937273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556c6a8c34b0 0x556c6a8cd830 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.206+0000 7f1adf1cf740 1 --2- 172.21.15.3:0/4061937273 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8c2b90 0x556c6a8c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.206+0000 7f1ada800640 1 --2- 172.21.15.3:0/1572297754 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1abc0a33b0 0x7f1abc0a5870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0011630 tx=0x7f1ad0009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:40.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.206+0000 7f1adf1cf740 1 -- 172.21.15.3:0/4061937273 >> 172.21.15.3:0/4061937273 conn(0x556c6a8bf120 msgr2=0x556c6a8bf500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:40.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.206+0000 7f1adf1cf740 1 -- 172.21.15.3:0/4061937273 shutdown_connections 2024-09-19T06:21:40.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.206+0000 7f1adf1cf740 1 -- 172.21.15.3:0/4061937273 wait complete. 2024-09-19T06:21:40.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.206+0000 7f1adf1cf740 1 -- start start 2024-09-19T06:21:40.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.207+0000 7f1adf1cf740 1 Processor -- start 2024-09-19T06:21:40.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.207+0000 7f1adf1cf740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c6a8c2b90 0x556c6a8cac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:40.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.207+0000 7f1adf1cf740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8c34b0 0x556c6a8cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:40.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.207+0000 7f1adf1cf740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556c6a8cdd70 0x556c6a8cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:40.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.207+0000 7f1adf1cf740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556c6a8d09e0 con 0x556c6a8c34b0 2024-09-19T06:21:40.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.207+0000 7f1adf1cf740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556c6a7e40f0 con 0x556c6a8cdd70 2024-09-19T06:21:40.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.207+0000 7f1adf1cf740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556c6a8d0b60 con 0x556c6a8c2b90 2024-09-19T06:21:40.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.207+0000 7f1adf1cf740 10 client.0 _ll_register_callbacks cb 0x556c6a7d59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:40.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.207+0000 7f1ad9400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8c34b0 0x556c6a8cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:40.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.207+0000 7f1ad9e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c6a8c2b90 0x556c6a8cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:40.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.207+0000 7f1ad9400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8c34b0 0x556c6a8cb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53104/0 (socket says 172.21.15.3:53104) 2024-09-19T06:21:40.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.207+0000 7f1ad9400640 1 -- 172.21.15.3:0/3938304144 learned_addr learned my addr 172.21.15.3:0/3938304144 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:40.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.208+0000 7f1ada800640 1 --2- 172.21.15.3:0/3938304144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556c6a8cdd70 0x556c6a8cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:40.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.208+0000 7f1ad9400640 1 -- 172.21.15.3:0/3938304144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c6a8c2b90 msgr2=0x556c6a8cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:40.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.208+0000 7f1ad9400640 1 --2- 172.21.15.3:0/3938304144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c6a8c2b90 0x556c6a8cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.208+0000 7f1ad9400640 1 -- 172.21.15.3:0/3938304144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556c6a8cdd70 msgr2=0x556c6a8cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:40.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.208+0000 7f1ad9400640 1 --2- 172.21.15.3:0/3938304144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556c6a8cdd70 0x556c6a8cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.208+0000 7f1ad9400640 1 -- 172.21.15.3:0/3938304144 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c6a59a3c0 con 0x556c6a8c34b0 2024-09-19T06:21:40.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.208+0000 7f1ad9400640 1 --2- 172.21.15.3:0/3938304144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8c34b0 0x556c6a8cb150 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40bc390 tx=0x7f1ac40b8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd1b7ade5a3050 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:40.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.208+0000 7f1ab7400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:21:40.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.208+0000 7f1ab7400640 1 -- 172.21.15.3:0/3938304144 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4049050 con 0x556c6a8c34b0 2024-09-19T06:21:40.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.209+0000 7f1ab7400640 1 -- 172.21.15.3:0/3938304144 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f1ac40eda40 con 0x556c6a8c34b0 2024-09-19T06:21:40.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.209+0000 7f1adf1cf740 1 -- 172.21.15.3:0/3938304144 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ac80044b0 con 0x556c6a8c34b0 2024-09-19T06:21:40.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.209+0000 7f1ab7400640 1 -- 172.21.15.3:0/3938304144 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1ac40bbf40 con 0x556c6a8c34b0 2024-09-19T06:21:40.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.209+0000 7f1adf1cf740 10 client.17901 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:40.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.209+0000 7f1adf1cf740 1 -- 172.21.15.3:0/3938304144 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556c6a8dc640 con 0x556c6a8c34b0 2024-09-19T06:21:40.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.209+0000 7f1ab7400640 1 -- 172.21.15.3:0/3938304144 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ac80044b0 con 0x556c6a8c34b0 2024-09-19T06:21:40.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.209+0000 7f1ab7400640 1 -- 172.21.15.3:0/3938304144 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f1ac40f2110 con 0x556c6a8c34b0 2024-09-19T06:21:40.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.209+0000 7f1adf1cf740 10 client.17901 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:40.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.209+0000 7f1adf1cf740 10 client.17901 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:40.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.209+0000 7f1adf1cf740 20 client.17901 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:40.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.209+0000 7f1adf1cf740 1 --2- 172.21.15.3:0/3938304144 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x556c6a8ddaa0 0x556c6a8dfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:40.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.209+0000 7f1adf1cf740 4 client.17901 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:40.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.209+0000 7f1adf1cf740 1 -- 172.21.15.3:0/3938304144 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c6a836950 con 0x556c6a8ddaa0 2024-09-19T06:21:40.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.210+0000 7f1ad9e00640 1 --2- 172.21.15.3:0/3938304144 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x556c6a8ddaa0 0x556c6a8dfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:40.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.211+0000 7f1ad9e00640 1 --2- 172.21.15.3:0/3938304144 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x556c6a8ddaa0 0x556c6a8dfec0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2c3cba05dcfc90c server_cookie=153341835b5791e9 in_seq=0 out_seq=0 2024-09-19T06:21:40.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.211+0000 7f1ab7400640 10 client.17901 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:40.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.211+0000 7f1ab7400640 1 -- 172.21.15.3:0/3938304144 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556c6a836950 con 0x556c6a8ddaa0 2024-09-19T06:21:40.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.211+0000 7f1ab7400640 10 client.17901 handle_command_reply: tid=0 2024-09-19T06:21:40.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.211+0000 7f1adf1cf740 1 client.17901 shutdown 2024-09-19T06:21:40.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.212+0000 7f1adf1cf740 1 -- 172.21.15.3:0/3938304144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8c34b0 msgr2=0x556c6a8cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:40.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.212+0000 7f1adf1cf740 1 --2- 172.21.15.3:0/3938304144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8c34b0 0x556c6a8cb150 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40bc390 tx=0x7f1ac40b8040 comp rx=0 tx=0).stop 2024-09-19T06:21:40.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.212+0000 7f1adf1cf740 1 -- 172.21.15.3:0/3938304144 shutdown_connections 2024-09-19T06:21:40.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.212+0000 7f1adf1cf740 1 --2- 172.21.15.3:0/3938304144 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x556c6a8ddaa0 0x556c6a8dfec0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.212+0000 7f1adf1cf740 1 --2- 172.21.15.3:0/3938304144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556c6a8cdd70 0x556c6a8cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.212+0000 7f1adf1cf740 1 --2- 172.21.15.3:0/3938304144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8c34b0 0x556c6a8cb150 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.212+0000 7f1adf1cf740 1 --2- 172.21.15.3:0/3938304144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c6a8c2b90 0x556c6a8cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.212+0000 7f1adf1cf740 1 -- 172.21.15.3:0/3938304144 >> 172.21.15.3:0/3938304144 conn(0x556c6a8bf120 msgr2=0x556c6a8c4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:40.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.212+0000 7f1ab7400640 0 client.17901 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:40.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.212+0000 7f1adf1cf740 1 -- 172.21.15.3:0/3938304144 shutdown_connections 2024-09-19T06:21:40.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.212+0000 7f1adf1cf740 1 -- 172.21.15.3:0/3938304144 wait complete. 2024-09-19T06:21:40.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.212+0000 7f1adf1cf740 20 client.17901 trim_cache size 0 max 16384 2024-09-19T06:21:40.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.230+0000 7f1adf1cf740 1 Processor -- start 2024-09-19T06:21:40.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.230+0000 7f1adf1cf740 1 -- start start 2024-09-19T06:21:40.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.230+0000 7f1adf1cf740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c6a8c2b90 0x556c6a8e57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:40.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.230+0000 7f1adf1cf740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556c6a8c34b0 0x556c6a8e5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:40.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.230+0000 7f1adf1cf740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8cdd70 0x556c6a8c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:40.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.230+0000 7f1adf1cf740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad41afb10 con 0x556c6a8cdd70 2024-09-19T06:21:40.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.230+0000 7f1adf1cf740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad41b1650 con 0x556c6a8c34b0 2024-09-19T06:21:40.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.230+0000 7f1adf1cf740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad41b01e0 con 0x556c6a8c2b90 2024-09-19T06:21:40.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.231+0000 7f1ada800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8cdd70 0x556c6a8c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:40.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.231+0000 7f1ada800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8cdd70 0x556c6a8c7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53108/0 (socket says 172.21.15.3:53108) 2024-09-19T06:21:40.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.231+0000 7f1ada800640 1 -- 172.21.15.3:0/1343551632 learned_addr learned my addr 172.21.15.3:0/1343551632 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:40.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.231+0000 7f1ad9e00640 1 --2- 172.21.15.3:0/1343551632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c6a8c2b90 0x556c6a8e57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:40.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.231+0000 7f1ad9400640 1 --2- 172.21.15.3:0/1343551632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556c6a8c34b0 0x556c6a8e5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:40.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.231+0000 7f1ad9e00640 1 -- 172.21.15.3:0/1343551632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556c6a8c34b0 msgr2=0x556c6a8e5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:40.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.231+0000 7f1ad9e00640 1 --2- 172.21.15.3:0/1343551632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556c6a8c34b0 0x556c6a8e5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.231+0000 7f1ad9e00640 1 -- 172.21.15.3:0/1343551632 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8cdd70 msgr2=0x556c6a8c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:40.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.231+0000 7f1ad9e00640 1 --2- 172.21.15.3:0/1343551632 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8cdd70 0x556c6a8c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.231+0000 7f1ad9e00640 1 -- 172.21.15.3:0/1343551632 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c6a8cd580 con 0x556c6a8c2b90 2024-09-19T06:21:40.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.231+0000 7f1ad9400640 1 --2- 172.21.15.3:0/1343551632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556c6a8c34b0 0x556c6a8e5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:40.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.231+0000 7f1ada800640 1 --2- 172.21.15.3:0/1343551632 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8cdd70 0x556c6a8c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:40.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.232+0000 7f1ad9e00640 1 --2- 172.21.15.3:0/1343551632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c6a8c2b90 0x556c6a8e57d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8011dd0 tx=0x7f1ac8004c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=476e4a5895ee16f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:40.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.232+0000 7f1ac2600640 1 -- 172.21.15.3:0/1343551632 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8033070 con 0x556c6a8c2b90 2024-09-19T06:21:40.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.232+0000 7f1ac2600640 1 -- 172.21.15.3:0/1343551632 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ac80054e0 con 0x556c6a8c2b90 2024-09-19T06:21:40.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.232+0000 7f1ac2600640 1 -- 172.21.15.3:0/1343551632 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8004900 con 0x556c6a8c2b90 2024-09-19T06:21:40.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.232+0000 7f1adf1cf740 1 -- 172.21.15.3:0/1343551632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c6a8c2b90 msgr2=0x556c6a8e57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:40.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.233+0000 7f1adf1cf740 1 --2- 172.21.15.3:0/1343551632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c6a8c2b90 0x556c6a8e57d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8011dd0 tx=0x7f1ac8004c10 comp rx=0 tx=0).stop 2024-09-19T06:21:40.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.233+0000 7f1adf1cf740 1 -- 172.21.15.3:0/1343551632 shutdown_connections 2024-09-19T06:21:40.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.233+0000 7f1adf1cf740 1 --2- 172.21.15.3:0/1343551632 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8cdd70 0x556c6a8c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.233+0000 7f1adf1cf740 1 --2- 172.21.15.3:0/1343551632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556c6a8c34b0 0x556c6a8e5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.233+0000 7f1adf1cf740 1 --2- 172.21.15.3:0/1343551632 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c6a8c2b90 0x556c6a8e57d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.233+0000 7f1adf1cf740 1 -- 172.21.15.3:0/1343551632 >> 172.21.15.3:0/1343551632 conn(0x556c6a8bf120 msgr2=0x556c6a8ccc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:40.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.233+0000 7f1adf1cf740 1 -- 172.21.15.3:0/1343551632 shutdown_connections 2024-09-19T06:21:40.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.233+0000 7f1adf1cf740 1 -- 172.21.15.3:0/1343551632 wait complete. 2024-09-19T06:21:40.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.233+0000 7f1adf1cf740 1 -- start start 2024-09-19T06:21:40.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.233+0000 7f1adf1cf740 1 Processor -- start 2024-09-19T06:21:40.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.234+0000 7f1adf1cf740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8c2b90 0x556c6a8d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:40.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.234+0000 7f1adf1cf740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556c6a8c34b0 0x556c6a8d2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:40.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.234+0000 7f1adf1cf740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c6a8cdd70 0x556c6a9417e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:40.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.234+0000 7f1adf1cf740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad41b0f80 con 0x556c6a8c2b90 2024-09-19T06:21:40.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.234+0000 7f1adf1cf740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad41b08b0 con 0x556c6a8c34b0 2024-09-19T06:21:40.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.234+0000 7f1adf1cf740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad41adb10 con 0x556c6a8cdd70 2024-09-19T06:21:40.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.234+0000 7f1adf1cf740 10 client.0 _ll_register_callbacks cb 0x7f1ac40f36e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:40.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.234+0000 7f1ad9e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8c2b90 0x556c6a8d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:40.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.234+0000 7f1ad9e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8c2b90 0x556c6a8d23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53118/0 (socket says 172.21.15.3:53118) 2024-09-19T06:21:40.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.234+0000 7f1ad9e00640 1 -- 172.21.15.3:0/487413279 learned_addr learned my addr 172.21.15.3:0/487413279 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:40.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.234+0000 7f1ad9400640 1 --2- 172.21.15.3:0/487413279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556c6a8c34b0 0x556c6a8d2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:40.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.234+0000 7f1ada800640 1 --2- 172.21.15.3:0/487413279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c6a8cdd70 0x556c6a9417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:40.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.234+0000 7f1ad9e00640 1 -- 172.21.15.3:0/487413279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c6a8cdd70 msgr2=0x556c6a9417e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:40.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.234+0000 7f1ad9e00640 1 --2- 172.21.15.3:0/487413279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c6a8cdd70 0x556c6a9417e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.235+0000 7f1ad9e00640 1 -- 172.21.15.3:0/487413279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556c6a8c34b0 msgr2=0x556c6a8d2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:40.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.235+0000 7f1ad9e00640 1 --2- 172.21.15.3:0/487413279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556c6a8c34b0 0x556c6a8d2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.235+0000 7f1ad9e00640 1 -- 172.21.15.3:0/487413279 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c6a941e20 con 0x556c6a8c2b90 2024-09-19T06:21:40.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.235+0000 7f1ad9e00640 1 --2- 172.21.15.3:0/487413279 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8c2b90 0x556c6a8d23f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009d60 tx=0x7f1ac8011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3e1b395be2fcd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:40.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.235+0000 7f1ab7400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:21:40.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.235+0000 7f1ab7400640 1 -- 172.21.15.3:0/487413279 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8033070 con 0x556c6a8c2b90 2024-09-19T06:21:40.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.235+0000 7f1ab7400640 1 -- 172.21.15.3:0/487413279 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f1ac80052d0 con 0x556c6a8c2b90 2024-09-19T06:21:40.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.235+0000 7f1adf1cf740 1 -- 172.21.15.3:0/487413279 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ac80054e0 con 0x556c6a8c2b90 2024-09-19T06:21:40.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.235+0000 7f1ab7400640 1 -- 172.21.15.3:0/487413279 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1ac8045050 con 0x556c6a8c2b90 2024-09-19T06:21:40.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.235+0000 7f1adf1cf740 10 client.17907 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:40.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.236+0000 7f1adf1cf740 1 -- 172.21.15.3:0/487413279 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556c6a949180 con 0x556c6a8c2b90 2024-09-19T06:21:40.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.236+0000 7f1ab7400640 1 -- 172.21.15.3:0/487413279 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ac80054e0 con 0x556c6a8c2b90 2024-09-19T06:21:40.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.236+0000 7f1ab7400640 1 -- 172.21.15.3:0/487413279 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f1ac8003ad0 con 0x556c6a8c2b90 2024-09-19T06:21:40.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.236+0000 7f1adf1cf740 10 client.17907 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:40.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.236+0000 7f1adf1cf740 10 client.17907 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:40.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.236+0000 7f1adf1cf740 20 client.17907 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:40.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.236+0000 7f1adf1cf740 1 --2- 172.21.15.3:0/487413279 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x556c6a949640 0x556c6a94ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:40.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.236+0000 7f1adf1cf740 4 client.17907 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:21:40.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.236+0000 7f1adf1cf740 1 -- 172.21.15.3:0/487413279 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556c6a830e60 con 0x556c6a949640 2024-09-19T06:21:40.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.236+0000 7f1ad9400640 1 --2- 172.21.15.3:0/487413279 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x556c6a949640 0x556c6a94ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:40.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.237+0000 7f1ad9400640 1 --2- 172.21.15.3:0/487413279 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x556c6a949640 0x556c6a94ba30 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ebd3f291a079437 server_cookie=4dd815ed13aff3f4 in_seq=0 out_seq=0 2024-09-19T06:21:40.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.237+0000 7f1ab7400640 10 client.17907 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:40.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.237+0000 7f1ab7400640 1 -- 172.21.15.3:0/487413279 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556c6a830e60 con 0x556c6a949640 2024-09-19T06:21:40.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.237+0000 7f1ab7400640 10 client.17907 handle_command_reply: tid=0 2024-09-19T06:21:40.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.237+0000 7f1adf1cf740 1 client.17907 shutdown 2024-09-19T06:21:40.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.237+0000 7f1adf1cf740 1 -- 172.21.15.3:0/487413279 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8c2b90 msgr2=0x556c6a8d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:40.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.237+0000 7f1adf1cf740 1 --2- 172.21.15.3:0/487413279 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8c2b90 0x556c6a8d23f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009d60 tx=0x7f1ac8011f10 comp rx=0 tx=0).stop 2024-09-19T06:21:40.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.237+0000 7f1adf1cf740 1 -- 172.21.15.3:0/487413279 shutdown_connections 2024-09-19T06:21:40.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.237+0000 7f1adf1cf740 1 --2- 172.21.15.3:0/487413279 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x556c6a949640 0x556c6a94ba30 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.237+0000 7f1adf1cf740 1 --2- 172.21.15.3:0/487413279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556c6a8cdd70 0x556c6a9417e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.237+0000 7f1adf1cf740 1 --2- 172.21.15.3:0/487413279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556c6a8c34b0 0x556c6a8d2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.237+0000 7f1adf1cf740 1 --2- 172.21.15.3:0/487413279 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556c6a8c2b90 0x556c6a8d23f0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.237+0000 7f1adf1cf740 1 -- 172.21.15.3:0/487413279 >> 172.21.15.3:0/487413279 conn(0x556c6a8bf120 msgr2=0x556c6a8c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:40.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.237+0000 7f1ab7400640 0 client.17907 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:40.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.238+0000 7f1adf1cf740 1 -- 172.21.15.3:0/487413279 shutdown_connections 2024-09-19T06:21:40.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.238+0000 7f1adf1cf740 1 -- 172.21.15.3:0/487413279 wait complete. 2024-09-19T06:21:40.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.238+0000 7f1adf1cf740 20 client.17907 trim_cache size 0 max 16384 2024-09-19T06:21:40.246 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:21:40.246 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "no active scrubs running", 2024-09-19T06:21:40.246 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": {} 2024-09-19T06:21:40.246 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:21:40.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.238+0000 7f1adc800640 1 -- 172.21.15.3:0/1572297754 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1abc0a33b0 msgr2=0x7f1abc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:40.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.238+0000 7f1adc800640 1 --2- 172.21.15.3:0/1572297754 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1abc0a33b0 0x7f1abc0a5870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0011630 tx=0x7f1ad0009500 comp rx=0 tx=0).stop 2024-09-19T06:21:40.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.238+0000 7f1adc800640 1 -- 172.21.15.3:0/1572297754 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ad41049a0 msgr2=0x7f1ad419ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:40.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.238+0000 7f1adc800640 1 --2- 172.21.15.3:0/1572297754 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ad41049a0 0x7f1ad419ab60 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4006010 tx=0x7f1ac4004040 comp rx=0 tx=0).stop 2024-09-19T06:21:40.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.239+0000 7f1adc800640 1 -- 172.21.15.3:0/1572297754 shutdown_connections 2024-09-19T06:21:40.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.239+0000 7f1adc800640 1 --2- 172.21.15.3:0/1572297754 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f1abc0a33b0 0x7f1abc0a5870 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.239+0000 7f1adc800640 1 --2- 172.21.15.3:0/1572297754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad4109120 0x7f1ad419eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.239+0000 7f1adc800640 1 --2- 172.21.15.3:0/1572297754 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1ad41049a0 0x7f1ad419ab60 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.239+0000 7f1adc800640 1 --2- 172.21.15.3:0/1572297754 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1ad4103ff0 0x7f1ad419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:40.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.239+0000 7f1adc800640 1 -- 172.21.15.3:0/1572297754 >> 172.21.15.3:0/1572297754 conn(0x7f1ad40ffa90 msgr2=0x7f1ad4100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:40.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.239+0000 7f1adc800640 1 -- 172.21.15.3:0/1572297754 shutdown_connections 2024-09-19T06:21:40.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:40.239+0000 7f1adc800640 1 -- 172.21.15.3:0/1572297754 wait complete. 2024-09-19T06:21:40.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:40 smithi003 ceph-mon[30893]: pgmap v287: 97 pgs: 97 active+clean; 5.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 23 op/s 2024-09-19T06:21:40.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:40 smithi059 ceph-mon[35138]: pgmap v287: 97 pgs: 97 active+clean; 5.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 23 op/s 2024-09-19T06:21:40.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:40 smithi071 ceph-mon[35662]: pgmap v287: 97 pgs: 97 active+clean; 5.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 23 op/s 2024-09-19T06:21:41.271 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:21:41.271 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:21:41.648 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:42.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.238+0000 7f4605200640 1 -- 172.21.15.3:0/3240134122 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f46001047e0 msgr2=0x7f4600108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:42.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.238+0000 7f4605200640 1 --2- 172.21.15.3:0/3240134122 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f46001047e0 0x7f4600108830 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f45e8009900 tx=0x7f45e802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:21:42.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.238+0000 7f4605200640 1 -- 172.21.15.3:0/3240134122 shutdown_connections 2024-09-19T06:21:42.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.238+0000 7f4605200640 1 --2- 172.21.15.3:0/3240134122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4600108f60 0x7f4600110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:42.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.238+0000 7f4605200640 1 --2- 172.21.15.3:0/3240134122 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f46001047e0 0x7f4600108830 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:42.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.238+0000 7f4605200640 1 --2- 172.21.15.3:0/3240134122 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4600103e30 0x7f4600104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:42.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.238+0000 7f4605200640 1 -- 172.21.15.3:0/3240134122 >> 172.21.15.3:0/3240134122 conn(0x7f46000ff910 msgr2=0x7f4600101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:42.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.238+0000 7f4605200640 1 -- 172.21.15.3:0/3240134122 shutdown_connections 2024-09-19T06:21:42.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.238+0000 7f4605200640 1 -- 172.21.15.3:0/3240134122 wait complete. 2024-09-19T06:21:42.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.239+0000 7f4605200640 1 Processor -- start 2024-09-19T06:21:42.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.239+0000 7f4605200640 1 -- start start 2024-09-19T06:21:42.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.240+0000 7f4605200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4600103e30 0x7f460019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:42.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.240+0000 7f4605200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46001047e0 0x7f460019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:42.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.240+0000 7f4605200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4600108f60 0x7f460019ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:42.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.240+0000 7f4605200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4600113fc0 con 0x7f4600108f60 2024-09-19T06:21:42.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.240+0000 7f4605200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4600113e40 con 0x7f4600103e30 2024-09-19T06:21:42.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.240+0000 7f4605200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f4600114140 con 0x7f46001047e0 2024-09-19T06:21:42.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.240+0000 7f45ffe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4600108f60 0x7f460019ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:42.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.240+0000 7f45ffe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4600108f60 0x7f460019ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53128/0 (socket says 172.21.15.3:53128) 2024-09-19T06:21:42.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.240+0000 7f45ffe00640 1 -- 172.21.15.3:0/348761790 learned_addr learned my addr 172.21.15.3:0/348761790 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:42.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.240+0000 7f45ff400640 1 --2- 172.21.15.3:0/348761790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4600103e30 0x7f460019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:42.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.240+0000 7f45f7e00640 1 --2- 172.21.15.3:0/348761790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46001047e0 0x7f460019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:42.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.240+0000 7f45ffe00640 1 -- 172.21.15.3:0/348761790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46001047e0 msgr2=0x7f460019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:42.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.240+0000 7f45ffe00640 1 --2- 172.21.15.3:0/348761790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46001047e0 0x7f460019aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:42.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.240+0000 7f45ffe00640 1 -- 172.21.15.3:0/348761790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4600103e30 msgr2=0x7f460019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:42.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.240+0000 7f45ffe00640 1 --2- 172.21.15.3:0/348761790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4600103e30 0x7f460019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:42.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.240+0000 7f45ffe00640 1 -- 172.21.15.3:0/348761790 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f460019f470 con 0x7f4600108f60 2024-09-19T06:21:42.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.240+0000 7f45ff400640 1 --2- 172.21.15.3:0/348761790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4600103e30 0x7f460019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:42.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.241+0000 7f45ffe00640 1 --2- 172.21.15.3:0/348761790 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4600108f60 0x7f460019ed90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f45f800eb10 tx=0x7f45f800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:42.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.241+0000 7f45fcc00640 1 -- 172.21.15.3:0/348761790 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8004b20 con 0x7f4600108f60 2024-09-19T06:21:42.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.241+0000 7f4605200640 1 -- 172.21.15.3:0/348761790 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f460019f760 con 0x7f4600108f60 2024-09-19T06:21:42.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.241+0000 7f45fcc00640 1 -- 172.21.15.3:0/348761790 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45f8004cc0 con 0x7f4600108f60 2024-09-19T06:21:42.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.241+0000 7f45fcc00640 1 -- 172.21.15.3:0/348761790 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8010760 con 0x7f4600108f60 2024-09-19T06:21:42.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.241+0000 7f4605200640 1 -- 172.21.15.3:0/348761790 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46001a7040 con 0x7f4600108f60 2024-09-19T06:21:42.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.242+0000 7f4605200640 1 -- 172.21.15.3:0/348761790 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4600105310 con 0x7f4600108f60 2024-09-19T06:21:42.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.244+0000 7f45fcc00640 1 -- 172.21.15.3:0/348761790 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f45f8005020 con 0x7f4600108f60 2024-09-19T06:21:42.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.245+0000 7f45fcc00640 1 --2- 172.21.15.3:0/348761790 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f45e40a3430 0x7f45e40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:42.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.246+0000 7f45fcc00640 1 -- 172.21.15.3:0/348761790 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f45f80d01e0 con 0x7f4600108f60 2024-09-19T06:21:42.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.246+0000 7f45ff400640 1 --2- 172.21.15.3:0/348761790 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f45e40a3430 0x7f45e40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:42.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.246+0000 7f45ff400640 1 --2- 172.21.15.3:0/348761790 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f45e40a3430 0x7f45e40a58f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009fc0 tx=0x7f45f0005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:42.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.250+0000 7f45fcc00640 1 -- 172.21.15.3:0/348761790 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f45f809cb90 con 0x7f4600108f60 2024-09-19T06:21:42.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.477+0000 7f4605200640 1 -- 172.21.15.3:0/348761790 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f460010bc10 con 0x7f4600108f60 2024-09-19T06:21:42.479 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:42 smithi003 ceph-mon[30893]: pgmap v288: 97 pgs: 97 active+clean; 5.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-09-19T06:21:42.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.478+0000 7f45fcc00640 1 -- 172.21.15.3:0/348761790 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7f45f809c490 con 0x7f4600108f60 2024-09-19T06:21:42.480 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:21:42.480 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"btime":"2024-09-19T06:12:22:958217+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:12:22.060987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24532,24515,24514,14517]},"id":1}]} 2024-09-19T06:21:42.481 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2024-09-19T06:21:42.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.480+0000 7f4605200640 1 -- 172.21.15.3:0/348761790 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f45e40a3430 msgr2=0x7f45e40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:42.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.480+0000 7f4605200640 1 --2- 172.21.15.3:0/348761790 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f45e40a3430 0x7f45e40a58f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009fc0 tx=0x7f45f0005f90 comp rx=0 tx=0).stop 2024-09-19T06:21:42.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.480+0000 7f4605200640 1 -- 172.21.15.3:0/348761790 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4600108f60 msgr2=0x7f460019ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:42.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.480+0000 7f4605200640 1 --2- 172.21.15.3:0/348761790 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4600108f60 0x7f460019ed90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f45f800eb10 tx=0x7f45f800c2d0 comp rx=0 tx=0).stop 2024-09-19T06:21:42.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.481+0000 7f4605200640 1 -- 172.21.15.3:0/348761790 shutdown_connections 2024-09-19T06:21:42.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.481+0000 7f4605200640 1 --2- 172.21.15.3:0/348761790 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f45e40a3430 0x7f45e40a58f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:42.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.481+0000 7f4605200640 1 --2- 172.21.15.3:0/348761790 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4600108f60 0x7f460019ed90 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:42.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.481+0000 7f4605200640 1 --2- 172.21.15.3:0/348761790 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f46001047e0 0x7f460019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:42.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.481+0000 7f4605200640 1 --2- 172.21.15.3:0/348761790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4600103e30 0x7f460019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:42.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.481+0000 7f4605200640 1 -- 172.21.15.3:0/348761790 >> 172.21.15.3:0/348761790 conn(0x7f46000ff910 msgr2=0x7f4600100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:42.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.481+0000 7f4605200640 1 -- 172.21.15.3:0/348761790 shutdown_connections 2024-09-19T06:21:42.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:42.481+0000 7f4605200640 1 -- 172.21.15.3:0/348761790 wait complete. 2024-09-19T06:21:42.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:42 smithi059 ceph-mon[35138]: pgmap v288: 97 pgs: 97 active+clean; 5.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-09-19T06:21:42.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:42 smithi071 ceph-mon[35662]: pgmap v288: 97 pgs: 97 active+clean; 5.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-09-19T06:21:43.298 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:21:43.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:43 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/348761790' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:21:43.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:43 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:21:43.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:43 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/348761790' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:21:43.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:43 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:21:43.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:43 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/348761790' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:21:43.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:43 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:21:43.693 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:44.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.284+0000 7f9ec6400640 1 -- 172.21.15.3:0/4055498756 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ec01049a0 msgr2=0x7f9ec01089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:44.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.284+0000 7f9ec6400640 1 --2- 172.21.15.3:0/4055498756 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ec01049a0 0x7f9ec01089f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009900 tx=0x7f9ea802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.284+0000 7f9ec6400640 1 -- 172.21.15.3:0/4055498756 shutdown_connections 2024-09-19T06:21:44.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.284+0000 7f9ec6400640 1 --2- 172.21.15.3:0/4055498756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ec0109120 0x7f9ec0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.284+0000 7f9ec6400640 1 --2- 172.21.15.3:0/4055498756 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ec01049a0 0x7f9ec01089f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.284+0000 7f9ec6400640 1 --2- 172.21.15.3:0/4055498756 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ec0103ff0 0x7f9ec01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.284+0000 7f9ec6400640 1 -- 172.21.15.3:0/4055498756 >> 172.21.15.3:0/4055498756 conn(0x7f9ec00ffa90 msgr2=0x7f9ec0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:44.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.284+0000 7f9ec6400640 1 -- 172.21.15.3:0/4055498756 shutdown_connections 2024-09-19T06:21:44.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.284+0000 7f9ec6400640 1 -- 172.21.15.3:0/4055498756 wait complete. 2024-09-19T06:21:44.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.285+0000 7f9ec6400640 1 Processor -- start 2024-09-19T06:21:44.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.285+0000 7f9ec6400640 1 -- start start 2024-09-19T06:21:44.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.285+0000 7f9ec6400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ec0103ff0 0x7f9ec019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:44.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.285+0000 7f9ec6400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ec01049a0 0x7f9ec019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:44.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.285+0000 7f9ec6400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ec0109120 0x7f9ec019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:44.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.285+0000 7f9ec6400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec0114170 con 0x7f9ec0109120 2024-09-19T06:21:44.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.285+0000 7f9ec6400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec0113ff0 con 0x7f9ec01049a0 2024-09-19T06:21:44.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.285+0000 7f9ec6400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec01142f0 con 0x7f9ec0103ff0 2024-09-19T06:21:44.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.286+0000 7f9ebf400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ec0103ff0 0x7f9ec019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:44.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.286+0000 7f9ebf400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ec0103ff0 0x7f9ec019a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:58158/0 (socket says 172.21.15.3:58158) 2024-09-19T06:21:44.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.286+0000 7f9ebf400640 1 -- 172.21.15.3:0/1883939946 learned_addr learned my addr 172.21.15.3:0/1883939946 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:44.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.286+0000 7f9eb7e00640 1 --2- 172.21.15.3:0/1883939946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ec01049a0 0x7f9ec019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:44.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.286+0000 7f9ebfe00640 1 --2- 172.21.15.3:0/1883939946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ec0109120 0x7f9ec019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:44.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.286+0000 7f9ebf400640 1 -- 172.21.15.3:0/1883939946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ec01049a0 msgr2=0x7f9ec019ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:44.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.286+0000 7f9ebf400640 1 --2- 172.21.15.3:0/1883939946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ec01049a0 0x7f9ec019ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.286+0000 7f9ebf400640 1 -- 172.21.15.3:0/1883939946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ec0109120 msgr2=0x7f9ec019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:44.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.286+0000 7f9ebf400640 1 --2- 172.21.15.3:0/1883939946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ec0109120 0x7f9ec019ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.286+0000 7f9ebf400640 1 -- 172.21.15.3:0/1883939946 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec019f600 con 0x7f9ec0103ff0 2024-09-19T06:21:44.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.286+0000 7f9ebfe00640 1 --2- 172.21.15.3:0/1883939946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ec0109120 0x7f9ec019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:44.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.286+0000 7f9ebf400640 1 --2- 172.21.15.3:0/1883939946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ec0103ff0 0x7f9ec019a650 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000e9f0 tx=0x7f9eb000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:44.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.287+0000 7f9ebcc00640 1 -- 172.21.15.3:0/1883939946 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb000cd80 con 0x7f9ec0103ff0 2024-09-19T06:21:44.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.287+0000 7f9ebcc00640 1 -- 172.21.15.3:0/1883939946 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9eb0010910 con 0x7f9ec0103ff0 2024-09-19T06:21:44.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.287+0000 7f9ebcc00640 1 -- 172.21.15.3:0/1883939946 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0018990 con 0x7f9ec0103ff0 2024-09-19T06:21:44.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.287+0000 7f9ec6400640 1 -- 172.21.15.3:0/1883939946 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ec019f8f0 con 0x7f9ec0103ff0 2024-09-19T06:21:44.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.287+0000 7f9ec6400640 1 -- 172.21.15.3:0/1883939946 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ec01a71d0 con 0x7f9ec0103ff0 2024-09-19T06:21:44.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.290+0000 7f9ec8fca740 1 Processor -- start 2024-09-19T06:21:44.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.290+0000 7f9ec8fca740 1 -- start start 2024-09-19T06:21:44.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.290+0000 7f9ebcc00640 1 -- 172.21.15.3:0/1883939946 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f9eb0010ac0 con 0x7f9ec0103ff0 2024-09-19T06:21:44.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.290+0000 7f9ec8fca740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fb8ceac70 0x561fb8ceb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:44.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.290+0000 7f9ec8fca740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561fb8ceb590 0x561fb8cf5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:44.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.290+0000 7f9ec8fca740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561fb8cf5e50 0x561fb8cf8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:44.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.290+0000 7f9ec8fca740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561fb8c513e0 con 0x561fb8ceb590 2024-09-19T06:21:44.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.290+0000 7f9ec8fca740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561fb8bf8d80 con 0x561fb8ceac70 2024-09-19T06:21:44.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.290+0000 7f9ec8fca740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561fb8c4d3a0 con 0x561fb8cf5e50 2024-09-19T06:21:44.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.291+0000 7f9ebfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fb8ceac70 0x561fb8ceb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:44.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.291+0000 7f9ebfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fb8ceac70 0x561fb8ceb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40776/0 (socket says 172.21.15.3:40776) 2024-09-19T06:21:44.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.291+0000 7f9ebf400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561fb8ceb590 0x561fb8cf5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:44.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.291+0000 7f9ebfe00640 1 -- 172.21.15.3:0/2724309202 learned_addr learned my addr 172.21.15.3:0/2724309202 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:44.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.291+0000 7f9eb7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561fb8cf5e50 0x561fb8cf8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:44.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.291+0000 7f9ebfe00640 1 -- 172.21.15.3:0/2724309202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561fb8cf5e50 msgr2=0x561fb8cf8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:44.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.291+0000 7f9ebfe00640 1 --2- 172.21.15.3:0/2724309202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561fb8cf5e50 0x561fb8cf8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.291+0000 7f9ebfe00640 1 -- 172.21.15.3:0/2724309202 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561fb8ceb590 msgr2=0x561fb8cf5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:44.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.291+0000 7f9ebfe00640 1 --2- 172.21.15.3:0/2724309202 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561fb8ceb590 0x561fb8cf5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.291+0000 7f9ebfe00640 1 -- 172.21.15.3:0/2724309202 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fb8c17ae0 con 0x561fb8ceac70 2024-09-19T06:21:44.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.292+0000 7f9ebfe00640 1 --2- 172.21.15.3:0/2724309202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fb8ceac70 0x561fb8ceb050 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8009fd0 tx=0x7f9eb8010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0ce788983609aeb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:44.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.292+0000 7f9ebcc00640 1 --2- 172.21.15.3:0/1883939946 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9ea40a3430 0x7f9ea40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:44.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.292+0000 7f9eb4c00640 1 -- 172.21.15.3:0/2724309202 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8011700 con 0x561fb8ceac70 2024-09-19T06:21:44.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.292+0000 7f9eb4c00640 1 -- 172.21.15.3:0/2724309202 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9eb8011d80 con 0x561fb8ceac70 2024-09-19T06:21:44.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.292+0000 7f9eb4c00640 1 -- 172.21.15.3:0/2724309202 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb800e3c0 con 0x561fb8ceac70 2024-09-19T06:21:44.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.292+0000 7f9ebcc00640 1 -- 172.21.15.3:0/1883939946 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f9eb00d0110 con 0x7f9ec0103ff0 2024-09-19T06:21:44.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.292+0000 7f9ebf400640 1 --2- 172.21.15.3:0/1883939946 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9ea40a3430 0x7f9ea40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:44.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.293+0000 7f9ec8fca740 1 -- 172.21.15.3:0/2724309202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fb8ceac70 msgr2=0x561fb8ceb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:44.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.293+0000 7f9ec8fca740 1 --2- 172.21.15.3:0/2724309202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fb8ceac70 0x561fb8ceb050 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8009fd0 tx=0x7f9eb8010860 comp rx=0 tx=0).stop 2024-09-19T06:21:44.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.293+0000 7f9ec8fca740 1 -- 172.21.15.3:0/2724309202 shutdown_connections 2024-09-19T06:21:44.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.293+0000 7f9ec8fca740 1 --2- 172.21.15.3:0/2724309202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561fb8cf5e50 0x561fb8cf8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.293+0000 7f9ec8fca740 1 --2- 172.21.15.3:0/2724309202 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561fb8ceb590 0x561fb8cf5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.293+0000 7f9ec8fca740 1 --2- 172.21.15.3:0/2724309202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fb8ceac70 0x561fb8ceb050 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.293+0000 7f9ec8fca740 1 -- 172.21.15.3:0/2724309202 >> 172.21.15.3:0/2724309202 conn(0x561fb8ce7200 msgr2=0x561fb8ce75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:44.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.293+0000 7f9ebf400640 1 --2- 172.21.15.3:0/1883939946 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9ea40a3430 0x7f9ea40a58f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x561fb8ce8060 tx=0x7f9eb00d3bc0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:44.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.293+0000 7f9ec8fca740 1 -- 172.21.15.3:0/2724309202 shutdown_connections 2024-09-19T06:21:44.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.293+0000 7f9ec8fca740 1 -- 172.21.15.3:0/2724309202 wait complete. 2024-09-19T06:21:44.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.293+0000 7f9ec8fca740 1 -- start start 2024-09-19T06:21:44.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.294+0000 7f9ec8fca740 1 Processor -- start 2024-09-19T06:21:44.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.294+0000 7f9ec8fca740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fb8ceac70 0x561fb8cf2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:44.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.294+0000 7f9ec8fca740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561fb8ceb590 0x561fb8cf3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:44.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.294+0000 7f9ec8fca740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561fb8cf5e50 0x561fb8cf37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:44.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.294+0000 7f9ec8fca740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x561fb8cf8a20 con 0x561fb8cf5e50 2024-09-19T06:21:44.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.294+0000 7f9ec8fca740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x561fb8c0c0f0 con 0x561fb8ceac70 2024-09-19T06:21:44.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.294+0000 7f9ec8fca740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x561fb8cf8ba0 con 0x561fb8ceb590 2024-09-19T06:21:44.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.294+0000 7f9ec8fca740 10 client.0 _ll_register_callbacks cb 0x561fb8bf3bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:44.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.295+0000 7f9eb7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561fb8ceb590 0x561fb8cf3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:44.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.295+0000 7f9ebfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fb8ceac70 0x561fb8cf2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:44.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.295+0000 7f9ebfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561fb8cf5e50 0x561fb8cf37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:44.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.295+0000 7f9eb7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561fb8ceb590 0x561fb8cf3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:58168/0 (socket says 172.21.15.3:58168) 2024-09-19T06:21:44.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.295+0000 7f9eb7e00640 1 -- 172.21.15.3:0/3774480291 learned_addr learned my addr 172.21.15.3:0/3774480291 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:44.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.295+0000 7f9ebfe00640 1 -- 172.21.15.3:0/3774480291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561fb8ceb590 msgr2=0x561fb8cf3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:44.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.295+0000 7f9ebfe00640 1 --2- 172.21.15.3:0/3774480291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561fb8ceb590 0x561fb8cf3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.295+0000 7f9ebfe00640 1 -- 172.21.15.3:0/3774480291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fb8ceac70 msgr2=0x561fb8cf2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:44.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.295+0000 7f9ebfe00640 1 --2- 172.21.15.3:0/3774480291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fb8ceac70 0x561fb8cf2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.295+0000 7f9ebfe00640 1 -- 172.21.15.3:0/3774480291 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fb89c23c0 con 0x561fb8cf5e50 2024-09-19T06:21:44.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.295+0000 7f9eb7e00640 1 --2- 172.21.15.3:0/3774480291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561fb8ceb590 0x561fb8cf3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:44.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.295+0000 7f9ebfe00640 1 --2- 172.21.15.3:0/3774480291 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561fb8cf5e50 0x561fb8cf37c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8005fd0 tx=0x7f9eb8010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff172c7a98bf24 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:44.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.295+0000 7f9ead600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:21:44.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.296+0000 7f9ead600640 1 -- 172.21.15.3:0/3774480291 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8024040 con 0x561fb8cf5e50 2024-09-19T06:21:44.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.296+0000 7f9ead600640 1 -- 172.21.15.3:0/3774480291 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f9eb80119f0 con 0x561fb8cf5e50 2024-09-19T06:21:44.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.296+0000 7f9ec8fca740 1 -- 172.21.15.3:0/3774480291 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9eb8011d80 con 0x561fb8cf5e50 2024-09-19T06:21:44.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.296+0000 7f9ead600640 1 -- 172.21.15.3:0/3774480291 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9eb8033430 con 0x561fb8cf5e50 2024-09-19T06:21:44.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.296+0000 7f9ec8fca740 10 client.17925 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:44.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.296+0000 7f9ec8fca740 1 -- 172.21.15.3:0/3774480291 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561fb8d04a60 con 0x561fb8cf5e50 2024-09-19T06:21:44.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.296+0000 7f9ead600640 1 -- 172.21.15.3:0/3774480291 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9eb8011d80 con 0x561fb8cf5e50 2024-09-19T06:21:44.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.297+0000 7f9ead600640 1 -- 172.21.15.3:0/3774480291 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9eb802b4c0 con 0x561fb8cf5e50 2024-09-19T06:21:44.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.297+0000 7f9ec8fca740 10 client.17925 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:44.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.297+0000 7f9ec8fca740 10 client.17925 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:21:44.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.297+0000 7f9ec8fca740 20 client.17925 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:44.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.297+0000 7f9ec8fca740 1 --2- 172.21.15.3:0/3774480291 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x561fb8d05e70 0x561fb8d08260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:44.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.297+0000 7f9ec8fca740 4 client.17925 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:44.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.297+0000 7f9ec8fca740 1 -- 172.21.15.3:0/3774480291 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561fb8c5e950 con 0x561fb8d05e70 2024-09-19T06:21:44.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.297+0000 7f9eb7e00640 1 --2- 172.21.15.3:0/3774480291 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x561fb8d05e70 0x561fb8d08260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:44.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.298+0000 7f9eb7e00640 1 --2- 172.21.15.3:0/3774480291 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x561fb8d05e70 0x561fb8d08260 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cefe7b418ea58a3f server_cookie=545311f46234ab45 in_seq=0 out_seq=0 2024-09-19T06:21:44.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.298+0000 7f9ead600640 10 client.17925 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:21:44.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.298+0000 7f9ead600640 1 -- 172.21.15.3:0/3774480291 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561fb8c5e950 con 0x561fb8d05e70 2024-09-19T06:21:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.298+0000 7f9ead600640 10 client.17925 handle_command_reply: tid=0 2024-09-19T06:21:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.298+0000 7f9ec8fca740 1 client.17925 shutdown 2024-09-19T06:21:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.299+0000 7f9ec8fca740 1 -- 172.21.15.3:0/3774480291 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561fb8cf5e50 msgr2=0x561fb8cf37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.299+0000 7f9ec8fca740 1 --2- 172.21.15.3:0/3774480291 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561fb8cf5e50 0x561fb8cf37c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8005fd0 tx=0x7f9eb8010fd0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.299+0000 7f9ec8fca740 1 -- 172.21.15.3:0/3774480291 shutdown_connections 2024-09-19T06:21:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.299+0000 7f9ec8fca740 1 --2- 172.21.15.3:0/3774480291 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x561fb8d05e70 0x561fb8d08260 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.299+0000 7f9ec8fca740 1 --2- 172.21.15.3:0/3774480291 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561fb8cf5e50 0x561fb8cf37c0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.299+0000 7f9ec8fca740 1 --2- 172.21.15.3:0/3774480291 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561fb8ceb590 0x561fb8cf3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.299+0000 7f9ec8fca740 1 --2- 172.21.15.3:0/3774480291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fb8ceac70 0x561fb8cf2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.299+0000 7f9ec8fca740 1 -- 172.21.15.3:0/3774480291 >> 172.21.15.3:0/3774480291 conn(0x561fb8ce7200 msgr2=0x561fb8cecf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.299+0000 7f9ead600640 0 client.17925 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:21:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.299+0000 7f9ec8fca740 1 -- 172.21.15.3:0/3774480291 shutdown_connections 2024-09-19T06:21:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.299+0000 7f9ec8fca740 1 -- 172.21.15.3:0/3774480291 wait complete. 2024-09-19T06:21:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.299+0000 7f9ec8fca740 20 client.17925 trim_cache size 0 max 16384 2024-09-19T06:21:44.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.313+0000 7f9ec8fca740 1 Processor -- start 2024-09-19T06:21:44.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.313+0000 7f9ec8fca740 1 -- start start 2024-09-19T06:21:44.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.313+0000 7f9ec8fca740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fb8ceac70 0x561fb8cf4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:44.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.314+0000 7f9ec8fca740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561fb8ceb590 0x561fb8d0d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:44.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.314+0000 7f9ec8fca740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561fb8cf5e50 0x561fb8d0de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:44.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.314+0000 7f9ec8fca740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec01afc70 con 0x561fb8cf5e50 2024-09-19T06:21:44.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.314+0000 7f9ec8fca740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec01b17b0 con 0x561fb8ceac70 2024-09-19T06:21:44.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.314+0000 7f9ec8fca740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec01b0340 con 0x561fb8ceb590 2024-09-19T06:21:44.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.314+0000 7f9ebfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561fb8cf5e50 0x561fb8d0de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:44.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.314+0000 7f9ebfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561fb8cf5e50 0x561fb8d0de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33132/0 (socket says 172.21.15.3:33132) 2024-09-19T06:21:44.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.314+0000 7f9ebfe00640 1 -- 172.21.15.3:0/2385039404 learned_addr learned my addr 172.21.15.3:0/2385039404 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:44.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.314+0000 7f9eb7e00640 1 --2- 172.21.15.3:0/2385039404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561fb8ceb590 0x561fb8d0d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:44.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.314+0000 7f9ebfe00640 1 --2- 172.21.15.3:0/2385039404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fb8ceac70 0x561fb8cf4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:44.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.314+0000 7f9ebfe00640 1 -- 172.21.15.3:0/2385039404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561fb8ceb590 msgr2=0x561fb8d0d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:44.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.314+0000 7f9ebfe00640 1 --2- 172.21.15.3:0/2385039404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561fb8ceb590 0x561fb8d0d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.314+0000 7f9ebfe00640 1 -- 172.21.15.3:0/2385039404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fb8ceac70 msgr2=0x561fb8cf4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:44.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.314+0000 7f9ebfe00640 1 --2- 172.21.15.3:0/2385039404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fb8ceac70 0x561fb8cf4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.314+0000 7f9ebfe00640 1 -- 172.21.15.3:0/2385039404 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fb8ce2770 con 0x561fb8cf5e50 2024-09-19T06:21:44.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.315+0000 7f9ebfe00640 1 --2- 172.21.15.3:0/2385039404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561fb8cf5e50 0x561fb8d0de30 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8009690 tx=0x7f9eb8010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5203576f6aba04f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:44.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.315+0000 7f9eafe00640 1 -- 172.21.15.3:0/2385039404 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb801baf0 con 0x561fb8cf5e50 2024-09-19T06:21:44.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.315+0000 7f9eafe00640 1 -- 172.21.15.3:0/2385039404 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9eb802bb00 con 0x561fb8cf5e50 2024-09-19T06:21:44.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.315+0000 7f9eafe00640 1 -- 172.21.15.3:0/2385039404 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8005280 con 0x561fb8cf5e50 2024-09-19T06:21:44.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.315+0000 7f9ec8fca740 1 -- 172.21.15.3:0/2385039404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561fb8cf5e50 msgr2=0x561fb8d0de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:44.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.315+0000 7f9ec8fca740 1 --2- 172.21.15.3:0/2385039404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561fb8cf5e50 0x561fb8d0de30 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8009690 tx=0x7f9eb8010860 comp rx=0 tx=0).stop 2024-09-19T06:21:44.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.316+0000 7f9ec8fca740 1 -- 172.21.15.3:0/2385039404 shutdown_connections 2024-09-19T06:21:44.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.316+0000 7f9ec8fca740 1 --2- 172.21.15.3:0/2385039404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561fb8cf5e50 0x561fb8d0de30 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.316+0000 7f9ec8fca740 1 --2- 172.21.15.3:0/2385039404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561fb8ceb590 0x561fb8d0d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.316+0000 7f9ec8fca740 1 --2- 172.21.15.3:0/2385039404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fb8ceac70 0x561fb8cf4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.316+0000 7f9ec8fca740 1 -- 172.21.15.3:0/2385039404 >> 172.21.15.3:0/2385039404 conn(0x561fb8ce7200 msgr2=0x561fb8cf45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:44.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.316+0000 7f9ec8fca740 1 -- 172.21.15.3:0/2385039404 shutdown_connections 2024-09-19T06:21:44.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.316+0000 7f9ec8fca740 1 -- 172.21.15.3:0/2385039404 wait complete. 2024-09-19T06:21:44.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.316+0000 7f9ec8fca740 1 -- start start 2024-09-19T06:21:44.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.316+0000 7f9ec8fca740 1 Processor -- start 2024-09-19T06:21:44.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.317+0000 7f9ec8fca740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561fb8ceac70 0x561fb8cfe3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:44.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.317+0000 7f9ec8fca740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fb8ceb590 0x561fb8cef8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:44.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.317+0000 7f9ec8fca740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561fb8cf5e50 0x561fb8cefe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:44.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.317+0000 7f9ec8fca740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec01b10e0 con 0x561fb8ceac70 2024-09-19T06:21:44.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.317+0000 7f9ec8fca740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec01b0a10 con 0x561fb8ceb590 2024-09-19T06:21:44.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.317+0000 7f9ec8fca740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec01adc70 con 0x561fb8cf5e50 2024-09-19T06:21:44.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.317+0000 7f9ec8fca740 10 client.0 _ll_register_callbacks cb 0x7f9eb00d3a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:44.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.317+0000 7f9ebfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561fb8ceac70 0x561fb8cfe3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:44.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.317+0000 7f9ebfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561fb8ceac70 0x561fb8cfe3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33136/0 (socket says 172.21.15.3:33136) 2024-09-19T06:21:44.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.317+0000 7f9ebfe00640 1 -- 172.21.15.3:0/1709524501 learned_addr learned my addr 172.21.15.3:0/1709524501 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:44.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.317+0000 7f9eb7e00640 1 --2- 172.21.15.3:0/1709524501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fb8ceb590 0x561fb8cef8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:44.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.317+0000 7f9ebfe00640 1 --2- 172.21.15.3:0/1709524501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561fb8cf5e50 0x561fb8cefe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:44.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.318+0000 7f9eb7e00640 1 -- 172.21.15.3:0/1709524501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561fb8cf5e50 msgr2=0x561fb8cefe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:44.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.318+0000 7f9eb7e00640 1 --2- 172.21.15.3:0/1709524501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561fb8cf5e50 0x561fb8cefe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.318+0000 7f9eb7e00640 1 -- 172.21.15.3:0/1709524501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561fb8ceac70 msgr2=0x561fb8cfe3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:44.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.318+0000 7f9eb7e00640 1 --2- 172.21.15.3:0/1709524501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561fb8ceac70 0x561fb8cfe3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.318+0000 7f9eb7e00640 1 -- 172.21.15.3:0/1709524501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fb8ce7e90 con 0x561fb8ceb590 2024-09-19T06:21:44.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.318+0000 7f9eb7e00640 1 --2- 172.21.15.3:0/1709524501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fb8ceb590 0x561fb8cef8f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8005c40 tx=0x7f9ea80045b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64c3f350e628365f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:44.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.318+0000 7f9ead600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:21:44.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.318+0000 7f9ead600640 1 -- 172.21.15.3:0/1709524501 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8035040 con 0x561fb8ceb590 2024-09-19T06:21:44.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.318+0000 7f9ead600640 1 -- 172.21.15.3:0/1709524501 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f9ea8005510 con 0x561fb8ceb590 2024-09-19T06:21:44.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.318+0000 7f9ec8fca740 1 -- 172.21.15.3:0/1709524501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9eb802bb00 con 0x561fb8ceb590 2024-09-19T06:21:44.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.319+0000 7f9ead600640 1 -- 172.21.15.3:0/1709524501 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9ea80046c0 con 0x561fb8ceb590 2024-09-19T06:21:44.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.319+0000 7f9ec8fca740 10 client.27962 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:44.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.319+0000 7f9ec8fca740 1 -- 172.21.15.3:0/1709524501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561fb8d70650 con 0x561fb8ceb590 2024-09-19T06:21:44.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.319+0000 7f9ead600640 1 -- 172.21.15.3:0/1709524501 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9eb802bb00 con 0x561fb8ceb590 2024-09-19T06:21:44.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.319+0000 7f9ead600640 1 -- 172.21.15.3:0/1709524501 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9ea8031bb0 con 0x561fb8ceb590 2024-09-19T06:21:44.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.319+0000 7f9ec8fca740 10 client.27962 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:44.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.319+0000 7f9ec8fca740 10 client.27962 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:21:44.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.319+0000 7f9ec8fca740 20 client.27962 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:44.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.319+0000 7f9ec8fca740 1 --2- 172.21.15.3:0/1709524501 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x561fb8d70d20 0x561fb8d73140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:44.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.319+0000 7f9ec8fca740 4 client.27962 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:44.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.319+0000 7f9ec8fca740 1 -- 172.21.15.3:0/1709524501 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561fb8c58e60 con 0x561fb8d70d20 2024-09-19T06:21:44.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.320+0000 7f9ebfe00640 1 --2- 172.21.15.3:0/1709524501 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x561fb8d70d20 0x561fb8d73140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:44.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.320+0000 7f9ebfe00640 1 --2- 172.21.15.3:0/1709524501 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x561fb8d70d20 0x561fb8d73140 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a49aef0c5d1ef380 server_cookie=d168a60795393bf5 in_seq=0 out_seq=0 2024-09-19T06:21:44.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.320+0000 7f9ead600640 10 client.27962 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:21:44.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.320+0000 7f9ead600640 1 -- 172.21.15.3:0/1709524501 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561fb8c58e60 con 0x561fb8d70d20 2024-09-19T06:21:44.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.320+0000 7f9ead600640 10 client.27962 handle_command_reply: tid=0 2024-09-19T06:21:44.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.320+0000 7f9ec8fca740 1 client.27962 shutdown 2024-09-19T06:21:44.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.320+0000 7f9ec8fca740 1 -- 172.21.15.3:0/1709524501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fb8ceb590 msgr2=0x561fb8cef8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:44.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.320+0000 7f9ec8fca740 1 --2- 172.21.15.3:0/1709524501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fb8ceb590 0x561fb8cef8f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8005c40 tx=0x7f9ea80045b0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.321+0000 7f9ec8fca740 1 -- 172.21.15.3:0/1709524501 shutdown_connections 2024-09-19T06:21:44.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.321+0000 7f9ec8fca740 1 --2- 172.21.15.3:0/1709524501 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x561fb8d70d20 0x561fb8d73140 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.321+0000 7f9ec8fca740 1 --2- 172.21.15.3:0/1709524501 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561fb8cf5e50 0x561fb8cefe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.321+0000 7f9ec8fca740 1 --2- 172.21.15.3:0/1709524501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561fb8ceb590 0x561fb8cef8f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.321+0000 7f9ec8fca740 1 --2- 172.21.15.3:0/1709524501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561fb8ceac70 0x561fb8cfe3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.321+0000 7f9ead600640 0 client.27962 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:21:44.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.321+0000 7f9ec8fca740 1 -- 172.21.15.3:0/1709524501 >> 172.21.15.3:0/1709524501 conn(0x561fb8ce7200 msgr2=0x561fb8cf4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:44.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.321+0000 7f9ec8fca740 1 -- 172.21.15.3:0/1709524501 shutdown_connections 2024-09-19T06:21:44.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.321+0000 7f9ec8fca740 1 -- 172.21.15.3:0/1709524501 wait complete. 2024-09-19T06:21:44.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.321+0000 7f9ec8fca740 20 client.27962 trim_cache size 0 max 16384 2024-09-19T06:21:44.329 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:21:44.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.322+0000 7f9ec6400640 1 -- 172.21.15.3:0/1883939946 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9ea40a3430 msgr2=0x7f9ea40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:44.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.322+0000 7f9ec6400640 1 --2- 172.21.15.3:0/1883939946 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9ea40a3430 0x7f9ea40a58f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x561fb8ce8060 tx=0x7f9eb00d3bc0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.322+0000 7f9ec6400640 1 -- 172.21.15.3:0/1883939946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ec0103ff0 msgr2=0x7f9ec019a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:44.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.322+0000 7f9ec6400640 1 --2- 172.21.15.3:0/1883939946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ec0103ff0 0x7f9ec019a650 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000e9f0 tx=0x7f9eb000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.322+0000 7f9ec6400640 1 -- 172.21.15.3:0/1883939946 shutdown_connections 2024-09-19T06:21:44.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.322+0000 7f9ec6400640 1 --2- 172.21.15.3:0/1883939946 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9ea40a3430 0x7f9ea40a58f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.322+0000 7f9ec6400640 1 --2- 172.21.15.3:0/1883939946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ec0109120 0x7f9ec019ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.322+0000 7f9ec6400640 1 --2- 172.21.15.3:0/1883939946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ec01049a0 0x7f9ec019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.322+0000 7f9ec6400640 1 --2- 172.21.15.3:0/1883939946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9ec0103ff0 0x7f9ec019a650 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:44.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.322+0000 7f9ec6400640 1 -- 172.21.15.3:0/1883939946 >> 172.21.15.3:0/1883939946 conn(0x7f9ec00ffa90 msgr2=0x7f9ec0100da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:44.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.322+0000 7f9ec6400640 1 -- 172.21.15.3:0/1883939946 shutdown_connections 2024-09-19T06:21:44.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:44.322+0000 7f9ec6400640 1 -- 172.21.15.3:0/1883939946 wait complete. 2024-09-19T06:21:44.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:44 smithi059 ceph-mon[35138]: pgmap v289: 97 pgs: 97 active+clean; 5.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-09-19T06:21:44.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:44 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:21:44.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:44 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:21:44.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:44 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:21:44.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:44 smithi003 ceph-mon[30893]: pgmap v289: 97 pgs: 97 active+clean; 5.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-09-19T06:21:44.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:44 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:21:44.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:44 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:21:44.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:44 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:21:44.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:44 smithi071 ceph-mon[35662]: pgmap v289: 97 pgs: 97 active+clean; 5.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 14 op/s 2024-09-19T06:21:44.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:44 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:21:44.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:44 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:21:44.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:44 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:21:45.434 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:21:45.815 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:46.288 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:46 smithi003 ceph-mon[30893]: pgmap v290: 97 pgs: 97 active+clean; 1.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 23 op/s 2024-09-19T06:21:46.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.401+0000 7fe221400640 1 -- 172.21.15.3:0/2771297330 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe21c103ff0 msgr2=0x7fe21c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:46.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.401+0000 7fe221400640 1 --2- 172.21.15.3:0/2771297330 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe21c103ff0 0x7fe21c1043d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fe20c009900 tx=0x7fe20c02a410 comp rx=0 tx=0).stop 2024-09-19T06:21:46.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.401+0000 7fe221400640 1 -- 172.21.15.3:0/2771297330 shutdown_connections 2024-09-19T06:21:46.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.401+0000 7fe221400640 1 --2- 172.21.15.3:0/2771297330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe21c109120 0x7fe21c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.401+0000 7fe221400640 1 --2- 172.21.15.3:0/2771297330 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe21c1049a0 0x7fe21c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.401+0000 7fe221400640 1 --2- 172.21.15.3:0/2771297330 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe21c103ff0 0x7fe21c1043d0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.401+0000 7fe221400640 1 -- 172.21.15.3:0/2771297330 >> 172.21.15.3:0/2771297330 conn(0x7fe21c0ffa90 msgr2=0x7fe21c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:46.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.401+0000 7fe221400640 1 -- 172.21.15.3:0/2771297330 shutdown_connections 2024-09-19T06:21:46.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.401+0000 7fe221400640 1 -- 172.21.15.3:0/2771297330 wait complete. 2024-09-19T06:21:46.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.402+0000 7fe221400640 1 Processor -- start 2024-09-19T06:21:46.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.403+0000 7fe221400640 1 -- start start 2024-09-19T06:21:46.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.403+0000 7fe221400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe21c103ff0 0x7fe21c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.403+0000 7fe221400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe21c1049a0 0x7fe21c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.403+0000 7fe221400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe21c109120 0x7fe21c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.403+0000 7fe221400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c114140 con 0x7fe21c1049a0 2024-09-19T06:21:46.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.403+0000 7fe221400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c113fc0 con 0x7fe21c109120 2024-09-19T06:21:46.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.403+0000 7fe221400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c1142c0 con 0x7fe21c103ff0 2024-09-19T06:21:46.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.403+0000 7fe21a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe21c103ff0 0x7fe21c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.403+0000 7fe219e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe21c1049a0 0x7fe21c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.403+0000 7fe21a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe21c103ff0 0x7fe21c19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:58212/0 (socket says 172.21.15.3:58212) 2024-09-19T06:21:46.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.403+0000 7fe21a800640 1 -- 172.21.15.3:0/3433408657 learned_addr learned my addr 172.21.15.3:0/3433408657 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:46.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.403+0000 7fe21b200640 1 --2- 172.21.15.3:0/3433408657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe21c109120 0x7fe21c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.404+0000 7fe21a800640 1 -- 172.21.15.3:0/3433408657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe21c109120 msgr2=0x7fe21c19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:46.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.404+0000 7fe21a800640 1 --2- 172.21.15.3:0/3433408657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe21c109120 0x7fe21c19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.404+0000 7fe21a800640 1 -- 172.21.15.3:0/3433408657 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe21c1049a0 msgr2=0x7fe21c19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:46.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.404+0000 7fe21a800640 1 --2- 172.21.15.3:0/3433408657 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe21c1049a0 0x7fe21c19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.404+0000 7fe21a800640 1 -- 172.21.15.3:0/3433408657 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21c19f5b0 con 0x7fe21c103ff0 2024-09-19T06:21:46.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.404+0000 7fe21a800640 1 --2- 172.21.15.3:0/3433408657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe21c103ff0 0x7fe21c19a600 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe20c006010 tx=0x7fe20c004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:46.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.405+0000 7fe213400640 1 -- 172.21.15.3:0/3433408657 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20c03f030 con 0x7fe21c103ff0 2024-09-19T06:21:46.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.405+0000 7fe221400640 1 -- 172.21.15.3:0/3433408657 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe21c19f840 con 0x7fe21c103ff0 2024-09-19T06:21:46.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.405+0000 7fe213400640 1 -- 172.21.15.3:0/3433408657 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe20c004440 con 0x7fe21c103ff0 2024-09-19T06:21:46.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.405+0000 7fe213400640 1 -- 172.21.15.3:0/3433408657 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20c035070 con 0x7fe21c103ff0 2024-09-19T06:21:46.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.405+0000 7fe221400640 1 -- 172.21.15.3:0/3433408657 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe21c1a7180 con 0x7fe21c103ff0 2024-09-19T06:21:46.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.407+0000 7fe223e95740 1 Processor -- start 2024-09-19T06:21:46.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.408+0000 7fe223e95740 1 -- start start 2024-09-19T06:21:46.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.408+0000 7fe213400640 1 -- 172.21.15.3:0/3433408657 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fe20c042030 con 0x7fe21c103ff0 2024-09-19T06:21:46.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.408+0000 7fe223e95740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b1ac70 0x556307b1b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.408+0000 7fe223e95740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556307b1b590 0x556307b25910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.408+0000 7fe223e95740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b25e50 0x556307b28240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.408+0000 7fe223e95740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556307a813e0 con 0x556307b1ac70 2024-09-19T06:21:46.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.408+0000 7fe223e95740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556307a28d80 con 0x556307b25e50 2024-09-19T06:21:46.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.408+0000 7fe223e95740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556307a7d3a0 con 0x556307b1b590 2024-09-19T06:21:46.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.408+0000 7fe21a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556307b1b590 0x556307b25910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.408+0000 7fe219e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b25e50 0x556307b28240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.408+0000 7fe21b200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b1ac70 0x556307b1b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.409+0000 7fe21a800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556307b1b590 0x556307b25910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:58214/0 (socket says 172.21.15.3:58214) 2024-09-19T06:21:46.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.409+0000 7fe21a800640 1 -- 172.21.15.3:0/1956926385 learned_addr learned my addr 172.21.15.3:0/1956926385 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:46.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.409+0000 7fe219e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b25e50 0x556307b28240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40842/0 (socket says 172.21.15.3:40842) 2024-09-19T06:21:46.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.409+0000 7fe21a800640 1 -- 172.21.15.3:0/1956926385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b25e50 msgr2=0x556307b28240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:46.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.409+0000 7fe21a800640 1 --2- 172.21.15.3:0/1956926385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b25e50 0x556307b28240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.409+0000 7fe21a800640 1 -- 172.21.15.3:0/1956926385 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b1ac70 msgr2=0x556307b1b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:46.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.409+0000 7fe21a800640 1 --2- 172.21.15.3:0/1956926385 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b1ac70 0x556307b1b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.409+0000 7fe21a800640 1 -- 172.21.15.3:0/1956926385 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556307a47ae0 con 0x556307b1b590 2024-09-19T06:21:46.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.409+0000 7fe21a800640 1 --2- 172.21.15.3:0/1956926385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556307b1b590 0x556307b25910 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe20c0ed710 tx=0x7fe20c0f83b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a95f4d12b9ff79c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:46.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.410+0000 7fe213400640 1 --2- 172.21.15.3:0/3433408657 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe2000a33b0 0x7fe2000a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.410+0000 7fe207400640 1 -- 172.21.15.3:0/1956926385 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20c0b86b0 con 0x556307b1b590 2024-09-19T06:21:46.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.410+0000 7fe207400640 1 -- 172.21.15.3:0/1956926385 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe20c0fd030 con 0x556307b1b590 2024-09-19T06:21:46.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.410+0000 7fe207400640 1 -- 172.21.15.3:0/1956926385 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20c0bbb90 con 0x556307b1b590 2024-09-19T06:21:46.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.410+0000 7fe213400640 1 -- 172.21.15.3:0/3433408657 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7fe20c0f0110 con 0x7fe21c103ff0 2024-09-19T06:21:46.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.410+0000 7fe21b200640 1 --2- 172.21.15.3:0/3433408657 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe2000a33b0 0x7fe2000a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.410+0000 7fe223e95740 1 -- 172.21.15.3:0/1956926385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556307b1b590 msgr2=0x556307b25910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:46.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.410+0000 7fe223e95740 1 --2- 172.21.15.3:0/1956926385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556307b1b590 0x556307b25910 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe20c0ed710 tx=0x7fe20c0f83b0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.411+0000 7fe223e95740 1 -- 172.21.15.3:0/1956926385 shutdown_connections 2024-09-19T06:21:46.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.411+0000 7fe223e95740 1 --2- 172.21.15.3:0/1956926385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b25e50 0x556307b28240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.411+0000 7fe223e95740 1 --2- 172.21.15.3:0/1956926385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556307b1b590 0x556307b25910 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.411+0000 7fe223e95740 1 --2- 172.21.15.3:0/1956926385 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b1ac70 0x556307b1b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.411+0000 7fe223e95740 1 -- 172.21.15.3:0/1956926385 >> 172.21.15.3:0/1956926385 conn(0x556307b17200 msgr2=0x556307b175e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:46.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.411+0000 7fe223e95740 1 -- 172.21.15.3:0/1956926385 shutdown_connections 2024-09-19T06:21:46.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.411+0000 7fe21b200640 1 --2- 172.21.15.3:0/3433408657 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe2000a33b0 0x7fe2000a5870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe214005fd0 tx=0x7fe214009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:46.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.411+0000 7fe223e95740 1 -- 172.21.15.3:0/1956926385 wait complete. 2024-09-19T06:21:46.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.411+0000 7fe223e95740 1 -- start start 2024-09-19T06:21:46.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.411+0000 7fe223e95740 1 Processor -- start 2024-09-19T06:21:46.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.412+0000 7fe223e95740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556307b1ac70 0x556307b22c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.412+0000 7fe223e95740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b1b590 0x556307b23170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.412+0000 7fe223e95740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b25e50 0x556307b236b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.412+0000 7fe223e95740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556307b287e0 con 0x556307b1b590 2024-09-19T06:21:46.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.412+0000 7fe223e95740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556307a3c0f0 con 0x556307b25e50 2024-09-19T06:21:46.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.412+0000 7fe223e95740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556307b28960 con 0x556307b1ac70 2024-09-19T06:21:46.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.412+0000 7fe223e95740 10 client.0 _ll_register_callbacks cb 0x556307a23bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:46.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.412+0000 7fe219e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b1b590 0x556307b23170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.412+0000 7fe219e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b1b590 0x556307b23170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33166/0 (socket says 172.21.15.3:33166) 2024-09-19T06:21:46.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.412+0000 7fe219e00640 1 -- 172.21.15.3:0/2825673599 learned_addr learned my addr 172.21.15.3:0/2825673599 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:46.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.412+0000 7fe21a800640 1 --2- 172.21.15.3:0/2825673599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556307b1ac70 0x556307b22c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.412+0000 7fe21b200640 1 --2- 172.21.15.3:0/2825673599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b25e50 0x556307b236b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.413+0000 7fe219e00640 1 -- 172.21.15.3:0/2825673599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556307b1ac70 msgr2=0x556307b22c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:46.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.413+0000 7fe219e00640 1 --2- 172.21.15.3:0/2825673599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556307b1ac70 0x556307b22c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.413+0000 7fe219e00640 1 -- 172.21.15.3:0/2825673599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b25e50 msgr2=0x556307b236b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:46.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.413+0000 7fe219e00640 1 --2- 172.21.15.3:0/2825673599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b25e50 0x556307b236b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.413+0000 7fe219e00640 1 -- 172.21.15.3:0/2825673599 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563077f23c0 con 0x556307b1b590 2024-09-19T06:21:46.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.413+0000 7fe21a800640 1 --2- 172.21.15.3:0/2825673599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556307b1ac70 0x556307b22c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:46.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.413+0000 7fe21b200640 1 --2- 172.21.15.3:0/2825673599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b25e50 0x556307b236b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:46.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.413+0000 7fe219e00640 1 --2- 172.21.15.3:0/2825673599 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b1b590 0x556307b23170 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fe208012720 tx=0x7fe208012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d744fa7c863c77e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:46.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.413+0000 7fe1fbe00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:21:46.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.413+0000 7fe1fbe00640 1 -- 172.21.15.3:0/2825673599 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20800f8c0 con 0x556307b1b590 2024-09-19T06:21:46.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.413+0000 7fe223e95740 1 -- 172.21.15.3:0/2825673599 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe20c0fd030 con 0x556307b1b590 2024-09-19T06:21:46.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.413+0000 7fe1fbe00640 1 -- 172.21.15.3:0/2825673599 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7fe20800fa60 con 0x556307b1b590 2024-09-19T06:21:46.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.414+0000 7fe1fbe00640 1 -- 172.21.15.3:0/2825673599 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe20800fc60 con 0x556307b1b590 2024-09-19T06:21:46.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.414+0000 7fe223e95740 10 client.17943 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:46.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.414+0000 7fe223e95740 1 -- 172.21.15.3:0/2825673599 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556307b34740 con 0x556307b1b590 2024-09-19T06:21:46.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.414+0000 7fe1fbe00640 1 -- 172.21.15.3:0/2825673599 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe20c0fd030 con 0x556307b1b590 2024-09-19T06:21:46.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.414+0000 7fe1fbe00640 1 -- 172.21.15.3:0/2825673599 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe208010430 con 0x556307b1b590 2024-09-19T06:21:46.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.414+0000 7fe223e95740 10 client.17943 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:46.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.414+0000 7fe223e95740 10 client.17943 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:21:46.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.414+0000 7fe223e95740 20 client.17943 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:46.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.414+0000 7fe223e95740 1 --2- 172.21.15.3:0/2825673599 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x556307b35ba0 0x556307b38040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.414+0000 7fe223e95740 4 client.17943 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:46.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.414+0000 7fe223e95740 1 -- 172.21.15.3:0/2825673599 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556307a8e950 con 0x556307b35ba0 2024-09-19T06:21:46.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.415+0000 7fe21a800640 1 --2- 172.21.15.3:0/2825673599 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x556307b35ba0 0x556307b38040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.415+0000 7fe21a800640 1 --2- 172.21.15.3:0/2825673599 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x556307b35ba0 0x556307b38040 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5d5fe0548d83bdf3 server_cookie=19ab77362991b53d in_seq=0 out_seq=0 2024-09-19T06:21:46.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.415+0000 7fe1fbe00640 10 client.17943 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:21:46.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.416+0000 7fe1fbe00640 1 -- 172.21.15.3:0/2825673599 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556307a8e950 con 0x556307b35ba0 2024-09-19T06:21:46.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.416+0000 7fe1fbe00640 10 client.17943 handle_command_reply: tid=0 2024-09-19T06:21:46.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.416+0000 7fe223e95740 1 client.17943 shutdown 2024-09-19T06:21:46.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.416+0000 7fe223e95740 1 -- 172.21.15.3:0/2825673599 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b1b590 msgr2=0x556307b23170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:46.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.416+0000 7fe223e95740 1 --2- 172.21.15.3:0/2825673599 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b1b590 0x556307b23170 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fe208012720 tx=0x7fe208012be0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.416+0000 7fe223e95740 1 -- 172.21.15.3:0/2825673599 shutdown_connections 2024-09-19T06:21:46.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.416+0000 7fe223e95740 1 --2- 172.21.15.3:0/2825673599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b25e50 0x556307b236b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.416+0000 7fe223e95740 1 --2- 172.21.15.3:0/2825673599 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x556307b35ba0 0x556307b38040 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.416+0000 7fe223e95740 1 --2- 172.21.15.3:0/2825673599 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b1b590 0x556307b23170 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.416+0000 7fe223e95740 1 --2- 172.21.15.3:0/2825673599 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556307b1ac70 0x556307b22c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.416+0000 7fe223e95740 1 -- 172.21.15.3:0/2825673599 >> 172.21.15.3:0/2825673599 conn(0x556307b17200 msgr2=0x556307b16380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:46.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.416+0000 7fe1fbe00640 0 client.17943 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:21:46.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.417+0000 7fe223e95740 1 -- 172.21.15.3:0/2825673599 shutdown_connections 2024-09-19T06:21:46.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.417+0000 7fe223e95740 1 -- 172.21.15.3:0/2825673599 wait complete. 2024-09-19T06:21:46.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.417+0000 7fe223e95740 20 client.17943 trim_cache size 0 max 16384 2024-09-19T06:21:46.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.430+0000 7fe223e95740 1 Processor -- start 2024-09-19T06:21:46.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.431+0000 7fe223e95740 1 -- start start 2024-09-19T06:21:46.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.431+0000 7fe223e95740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b1ac70 0x556307b3d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.431+0000 7fe223e95740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556307b1b590 0x556307b3de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.431+0000 7fe223e95740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b25e50 0x556307b1fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.431+0000 7fe223e95740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c1afba0 con 0x556307b25e50 2024-09-19T06:21:46.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.431+0000 7fe223e95740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c1b16e0 con 0x556307b1ac70 2024-09-19T06:21:46.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.431+0000 7fe223e95740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c1b0270 con 0x556307b1b590 2024-09-19T06:21:46.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.431+0000 7fe21b200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b25e50 0x556307b1fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.431+0000 7fe21a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b1ac70 0x556307b3d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.431+0000 7fe21b200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b25e50 0x556307b1fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33174/0 (socket says 172.21.15.3:33174) 2024-09-19T06:21:46.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.431+0000 7fe21b200640 1 -- 172.21.15.3:0/3606019067 learned_addr learned my addr 172.21.15.3:0/3606019067 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:46.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.431+0000 7fe219e00640 1 --2- 172.21.15.3:0/3606019067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556307b1b590 0x556307b3de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.432+0000 7fe21b200640 1 -- 172.21.15.3:0/3606019067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556307b1b590 msgr2=0x556307b3de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:46.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.432+0000 7fe21b200640 1 --2- 172.21.15.3:0/3606019067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556307b1b590 0x556307b3de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.432+0000 7fe21b200640 1 -- 172.21.15.3:0/3606019067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b1ac70 msgr2=0x556307b3d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:46.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.432+0000 7fe21b200640 1 --2- 172.21.15.3:0/3606019067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b1ac70 0x556307b3d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.432+0000 7fe21b200640 1 -- 172.21.15.3:0/3606019067 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556307b12770 con 0x556307b25e50 2024-09-19T06:21:46.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.432+0000 7fe21a800640 1 --2- 172.21.15.3:0/3606019067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b1ac70 0x556307b3d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:46.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.432+0000 7fe219e00640 1 --2- 172.21.15.3:0/3606019067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556307b1b590 0x556307b3de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:46.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.432+0000 7fe21b200640 1 --2- 172.21.15.3:0/3606019067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b25e50 0x556307b1fef0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe214003ef0 tx=0x7fe214016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9aa438c2bcae5b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:46.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.432+0000 7fe206a00640 1 -- 172.21.15.3:0/3606019067 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214004680 con 0x556307b25e50 2024-09-19T06:21:46.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.432+0000 7fe206a00640 1 -- 172.21.15.3:0/3606019067 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe214004820 con 0x556307b25e50 2024-09-19T06:21:46.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.432+0000 7fe206a00640 1 -- 172.21.15.3:0/3606019067 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21401e750 con 0x556307b25e50 2024-09-19T06:21:46.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.433+0000 7fe223e95740 1 -- 172.21.15.3:0/3606019067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b25e50 msgr2=0x556307b1fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:46.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.433+0000 7fe223e95740 1 --2- 172.21.15.3:0/3606019067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b25e50 0x556307b1fef0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe214003ef0 tx=0x7fe214016000 comp rx=0 tx=0).stop 2024-09-19T06:21:46.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.433+0000 7fe223e95740 1 -- 172.21.15.3:0/3606019067 shutdown_connections 2024-09-19T06:21:46.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.433+0000 7fe223e95740 1 --2- 172.21.15.3:0/3606019067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b25e50 0x556307b1fef0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.433+0000 7fe223e95740 1 --2- 172.21.15.3:0/3606019067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556307b1b590 0x556307b3de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.433+0000 7fe223e95740 1 --2- 172.21.15.3:0/3606019067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b1ac70 0x556307b3d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.433+0000 7fe223e95740 1 -- 172.21.15.3:0/3606019067 >> 172.21.15.3:0/3606019067 conn(0x556307b17200 msgr2=0x556307b24cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:46.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.433+0000 7fe223e95740 1 -- 172.21.15.3:0/3606019067 shutdown_connections 2024-09-19T06:21:46.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.433+0000 7fe223e95740 1 -- 172.21.15.3:0/3606019067 wait complete. 2024-09-19T06:21:46.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.434+0000 7fe223e95740 1 -- start start 2024-09-19T06:21:46.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.434+0000 7fe223e95740 1 Processor -- start 2024-09-19T06:21:46.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.434+0000 7fe223e95740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b1ac70 0x556307b1fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.434+0000 7fe223e95740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556307b1b590 0x556307b20250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.434+0000 7fe223e95740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b25e50 0x556307b20790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.434+0000 7fe223e95740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c1b1010 con 0x556307b25e50 2024-09-19T06:21:46.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.434+0000 7fe223e95740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c1b0940 con 0x556307b1ac70 2024-09-19T06:21:46.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.434+0000 7fe223e95740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c1adba0 con 0x556307b1b590 2024-09-19T06:21:46.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.434+0000 7fe223e95740 10 client.0 _ll_register_callbacks cb 0x7fe208009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:46.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.435+0000 7fe21a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b1ac70 0x556307b1fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.435+0000 7fe21a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b1ac70 0x556307b1fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40868/0 (socket says 172.21.15.3:40868) 2024-09-19T06:21:46.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.435+0000 7fe21a800640 1 -- 172.21.15.3:0/1348379809 learned_addr learned my addr 172.21.15.3:0/1348379809 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:46.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.435+0000 7fe219e00640 1 --2- 172.21.15.3:0/1348379809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556307b1b590 0x556307b20250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.435+0000 7fe21b200640 1 --2- 172.21.15.3:0/1348379809 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b25e50 0x556307b20790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.435+0000 7fe21a800640 1 -- 172.21.15.3:0/1348379809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556307b1b590 msgr2=0x556307b20250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:46.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.435+0000 7fe21a800640 1 --2- 172.21.15.3:0/1348379809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556307b1b590 0x556307b20250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.435+0000 7fe21a800640 1 -- 172.21.15.3:0/1348379809 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b25e50 msgr2=0x556307b20790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:46.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.435+0000 7fe21a800640 1 --2- 172.21.15.3:0/1348379809 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b25e50 0x556307b20790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.435+0000 7fe21a800640 1 -- 172.21.15.3:0/1348379809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556307b17e90 con 0x556307b1ac70 2024-09-19T06:21:46.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.435+0000 7fe21b200640 1 --2- 172.21.15.3:0/1348379809 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b25e50 0x556307b20790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:46.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.435+0000 7fe21a800640 1 --2- 172.21.15.3:0/1348379809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b1ac70 0x556307b1fd10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe20c0bc110 tx=0x7fe20c0058f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f64a80f6518b3986 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:46.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.435+0000 7fe1fbe00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:21:46.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.436+0000 7fe1fbe00640 1 -- 172.21.15.3:0/1348379809 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20c049040 con 0x556307b1ac70 2024-09-19T06:21:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.436+0000 7fe1fbe00640 1 -- 172.21.15.3:0/1348379809 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7fe20c0ba710 con 0x556307b1ac70 2024-09-19T06:21:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.436+0000 7fe223e95740 1 -- 172.21.15.3:0/1348379809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe214004820 con 0x556307b1ac70 2024-09-19T06:21:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.436+0000 7fe1fbe00640 1 -- 172.21.15.3:0/1348379809 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe20c0bbd70 con 0x556307b1ac70 2024-09-19T06:21:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.436+0000 7fe223e95740 10 client.27980 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.436+0000 7fe223e95740 1 -- 172.21.15.3:0/1348379809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556307ba0a00 con 0x556307b1ac70 2024-09-19T06:21:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.436+0000 7fe1fbe00640 1 -- 172.21.15.3:0/1348379809 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe214004820 con 0x556307b1ac70 2024-09-19T06:21:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.436+0000 7fe1fbe00640 1 -- 172.21.15.3:0/1348379809 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fe20c0b8a80 con 0x556307b1ac70 2024-09-19T06:21:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.436+0000 7fe223e95740 10 client.27980 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.436+0000 7fe223e95740 10 client.27980 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:21:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.436+0000 7fe223e95740 20 client.27980 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.436+0000 7fe223e95740 1 --2- 172.21.15.3:0/1348379809 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x556307ba0e00 0x556307ba31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.436+0000 7fe223e95740 4 client.27980 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.436+0000 7fe223e95740 1 -- 172.21.15.3:0/1348379809 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556307a88e60 con 0x556307ba0e00 2024-09-19T06:21:46.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.437+0000 7fe219e00640 1 --2- 172.21.15.3:0/1348379809 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x556307ba0e00 0x556307ba31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:46.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.437+0000 7fe219e00640 1 --2- 172.21.15.3:0/1348379809 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x556307ba0e00 0x556307ba31f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=eb2125c0edea701c server_cookie=a22770d18e248494 in_seq=0 out_seq=0 2024-09-19T06:21:46.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.437+0000 7fe1fbe00640 10 client.27980 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:21:46.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.437+0000 7fe1fbe00640 1 -- 172.21.15.3:0/1348379809 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556307a88e60 con 0x556307ba0e00 2024-09-19T06:21:46.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.437+0000 7fe1fbe00640 10 client.27980 handle_command_reply: tid=0 2024-09-19T06:21:46.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.437+0000 7fe223e95740 1 client.27980 shutdown 2024-09-19T06:21:46.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.438+0000 7fe223e95740 1 -- 172.21.15.3:0/1348379809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b1ac70 msgr2=0x556307b1fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:46.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.438+0000 7fe223e95740 1 --2- 172.21.15.3:0/1348379809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b1ac70 0x556307b1fd10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe20c0bc110 tx=0x7fe20c0058f0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.438+0000 7fe223e95740 1 -- 172.21.15.3:0/1348379809 shutdown_connections 2024-09-19T06:21:46.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.438+0000 7fe223e95740 1 --2- 172.21.15.3:0/1348379809 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x556307ba0e00 0x556307ba31f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.438+0000 7fe223e95740 1 --2- 172.21.15.3:0/1348379809 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556307b25e50 0x556307b20790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.438+0000 7fe223e95740 1 --2- 172.21.15.3:0/1348379809 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556307b1b590 0x556307b20250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.438+0000 7fe223e95740 1 --2- 172.21.15.3:0/1348379809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556307b1ac70 0x556307b1fd10 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.438+0000 7fe223e95740 1 -- 172.21.15.3:0/1348379809 >> 172.21.15.3:0/1348379809 conn(0x556307b17200 msgr2=0x556307b1c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:46.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.438+0000 7fe1fbe00640 0 client.27980 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:21:46.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.438+0000 7fe223e95740 1 -- 172.21.15.3:0/1348379809 shutdown_connections 2024-09-19T06:21:46.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.438+0000 7fe223e95740 1 -- 172.21.15.3:0/1348379809 wait complete. 2024-09-19T06:21:46.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.438+0000 7fe223e95740 20 client.27980 trim_cache size 0 max 16384 2024-09-19T06:21:46.444 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:21:46.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.439+0000 7fe221400640 1 -- 172.21.15.3:0/3433408657 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe2000a33b0 msgr2=0x7fe2000a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:46.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.439+0000 7fe221400640 1 --2- 172.21.15.3:0/3433408657 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe2000a33b0 0x7fe2000a5870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe214005fd0 tx=0x7fe214009500 comp rx=0 tx=0).stop 2024-09-19T06:21:46.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.439+0000 7fe221400640 1 -- 172.21.15.3:0/3433408657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe21c103ff0 msgr2=0x7fe21c19a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:46.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.439+0000 7fe221400640 1 --2- 172.21.15.3:0/3433408657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe21c103ff0 0x7fe21c19a600 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe20c006010 tx=0x7fe20c004040 comp rx=0 tx=0).stop 2024-09-19T06:21:46.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.439+0000 7fe221400640 1 -- 172.21.15.3:0/3433408657 shutdown_connections 2024-09-19T06:21:46.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.439+0000 7fe221400640 1 --2- 172.21.15.3:0/3433408657 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe2000a33b0 0x7fe2000a5870 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.439+0000 7fe221400640 1 --2- 172.21.15.3:0/3433408657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe21c109120 0x7fe21c19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.439+0000 7fe221400640 1 --2- 172.21.15.3:0/3433408657 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe21c1049a0 0x7fe21c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.439+0000 7fe221400640 1 --2- 172.21.15.3:0/3433408657 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe21c103ff0 0x7fe21c19a600 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:46.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.439+0000 7fe221400640 1 -- 172.21.15.3:0/3433408657 >> 172.21.15.3:0/3433408657 conn(0x7fe21c0ffa90 msgr2=0x7fe21c100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:46.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.439+0000 7fe221400640 1 -- 172.21.15.3:0/3433408657 shutdown_connections 2024-09-19T06:21:46.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:46.439+0000 7fe221400640 1 -- 172.21.15.3:0/3433408657 wait complete. 2024-09-19T06:21:46.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:46 smithi059 ceph-mon[35138]: pgmap v290: 97 pgs: 97 active+clean; 1.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 23 op/s 2024-09-19T06:21:46.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:46 smithi071 ceph-mon[35662]: pgmap v290: 97 pgs: 97 active+clean; 1.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 23 op/s 2024-09-19T06:21:47.518 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:21:47.895 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:48.323 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:48 smithi003 ceph-mon[30893]: pgmap v291: 97 pgs: 97 active+clean; 1.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 16 op/s 2024-09-19T06:21:48.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.436+0000 7f6c37a00640 1 -- 172.21.15.3:0/1426162713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c30101de0 msgr2=0x7f6c301021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:48.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.436+0000 7f6c37a00640 1 --2- 172.21.15.3:0/1426162713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c30101de0 0x7f6c301021c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009860 tx=0x7f6c2002a340 comp rx=0 tx=0).stop 2024-09-19T06:21:48.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.437+0000 7f6c37a00640 1 -- 172.21.15.3:0/1426162713 shutdown_connections 2024-09-19T06:21:48.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.437+0000 7f6c37a00640 1 --2- 172.21.15.3:0/1426162713 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c30106f10 0x7f6c3010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.437+0000 7f6c37a00640 1 --2- 172.21.15.3:0/1426162713 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c30102790 0x7f6c301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.437+0000 7f6c37a00640 1 --2- 172.21.15.3:0/1426162713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c30101de0 0x7f6c301021c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.437+0000 7f6c37a00640 1 -- 172.21.15.3:0/1426162713 >> 172.21.15.3:0/1426162713 conn(0x7f6c300fd8c0 msgr2=0x7f6c300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:48.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.437+0000 7f6c37a00640 1 -- 172.21.15.3:0/1426162713 shutdown_connections 2024-09-19T06:21:48.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.437+0000 7f6c37a00640 1 -- 172.21.15.3:0/1426162713 wait complete. 2024-09-19T06:21:48.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.438+0000 7f6c37a00640 1 Processor -- start 2024-09-19T06:21:48.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.438+0000 7f6c37a00640 1 -- start start 2024-09-19T06:21:48.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.438+0000 7f6c37a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c30101de0 0x7f6c3019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.438+0000 7f6c37a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c30102790 0x7f6c3019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.438+0000 7f6c37a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c30106f10 0x7f6c3019ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.438+0000 7f6c37a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6c30111f70 con 0x7f6c30102790 2024-09-19T06:21:48.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.438+0000 7f6c37a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6c30111df0 con 0x7f6c30101de0 2024-09-19T06:21:48.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.438+0000 7f6c37a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6c301120f0 con 0x7f6c30106f10 2024-09-19T06:21:48.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.438+0000 7f6c27e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c30102790 0x7f6c3019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.438+0000 7f6c35a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c30106f10 0x7f6c3019ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.438+0000 7f6c27e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c30102790 0x7f6c3019abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33196/0 (socket says 172.21.15.3:33196) 2024-09-19T06:21:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.438+0000 7f6c27e00640 1 -- 172.21.15.3:0/3083869235 learned_addr learned my addr 172.21.15.3:0/3083869235 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.438+0000 7f6c35000640 1 --2- 172.21.15.3:0/3083869235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c30101de0 0x7f6c3019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.439+0000 7f6c27e00640 1 -- 172.21.15.3:0/3083869235 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c30106f10 msgr2=0x7f6c3019ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.439+0000 7f6c27e00640 1 --2- 172.21.15.3:0/3083869235 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c30106f10 0x7f6c3019ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.439+0000 7f6c27e00640 1 -- 172.21.15.3:0/3083869235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c30101de0 msgr2=0x7f6c3019a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.439+0000 7f6c27e00640 1 --2- 172.21.15.3:0/3083869235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c30101de0 0x7f6c3019a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.439+0000 7f6c27e00640 1 -- 172.21.15.3:0/3083869235 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c3019f650 con 0x7f6c30102790 2024-09-19T06:21:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.439+0000 7f6c27e00640 1 --2- 172.21.15.3:0/3083869235 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c30102790 0x7f6c3019abe0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800e9c0 tx=0x7f6c1800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.439+0000 7f6c2e000640 1 -- 172.21.15.3:0/3083869235 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1800ccc0 con 0x7f6c30102790 2024-09-19T06:21:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.439+0000 7f6c37a00640 1 -- 172.21.15.3:0/3083869235 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c3019f940 con 0x7f6c30102790 2024-09-19T06:21:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.439+0000 7f6c2e000640 1 -- 172.21.15.3:0/3083869235 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c18005500 con 0x7f6c30102790 2024-09-19T06:21:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.440+0000 7f6c37a00640 1 -- 172.21.15.3:0/3083869235 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c301a7220 con 0x7f6c30102790 2024-09-19T06:21:48.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.440+0000 7f6c2e000640 1 -- 172.21.15.3:0/3083869235 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c18018430 con 0x7f6c30102790 2024-09-19T06:21:48.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.443+0000 7f6c3a5be740 1 Processor -- start 2024-09-19T06:21:48.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.443+0000 7f6c3a5be740 1 -- start start 2024-09-19T06:21:48.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.443+0000 7f6c2e000640 1 -- 172.21.15.3:0/3083869235 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f6c180046c0 con 0x7f6c30102790 2024-09-19T06:21:48.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.443+0000 7f6c3a5be740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed27bf3c70 0x55ed27bf4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.443+0000 7f6c3a5be740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bf4590 0x55ed27bfe910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.443+0000 7f6c3a5be740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed27bfee50 0x55ed27c01240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.443+0000 7f6c3a5be740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ed27b5a3e0 con 0x55ed27bf4590 2024-09-19T06:21:48.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.443+0000 7f6c3a5be740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ed27b01d80 con 0x55ed27bfee50 2024-09-19T06:21:48.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.443+0000 7f6c3a5be740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ed27b563a0 con 0x55ed27bf3c70 2024-09-19T06:21:48.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.443+0000 7f6c35000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bf4590 0x55ed27bfe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.443+0000 7f6c27e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed27bfee50 0x55ed27c01240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.470 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.443+0000 7f6c35a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed27bf3c70 0x55ed27bf4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.443+0000 7f6c35000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bf4590 0x55ed27bfe910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33206/0 (socket says 172.21.15.3:33206) 2024-09-19T06:21:48.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.444+0000 7f6c35000640 1 -- 172.21.15.3:0/3899637673 learned_addr learned my addr 172.21.15.3:0/3899637673 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:48.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.444+0000 7f6c35a00640 1 -- 172.21.15.3:0/3899637673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed27bfee50 msgr2=0x55ed27c01240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:48.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.444+0000 7f6c35a00640 1 --2- 172.21.15.3:0/3899637673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed27bfee50 0x55ed27c01240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.444+0000 7f6c35a00640 1 -- 172.21.15.3:0/3899637673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bf4590 msgr2=0x55ed27bfe910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:48.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.444+0000 7f6c35a00640 1 --2- 172.21.15.3:0/3899637673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bf4590 0x55ed27bfe910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.444+0000 7f6c35a00640 1 -- 172.21.15.3:0/3899637673 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed27b20ae0 con 0x55ed27bf3c70 2024-09-19T06:21:48.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.444+0000 7f6c35a00640 1 --2- 172.21.15.3:0/3899637673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed27bf3c70 0x55ed27bf4050 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6c28009eb0 tx=0x7f6c28010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba8c4ff5b97ccba7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:48.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.444+0000 7f6c26000640 1 -- 172.21.15.3:0/3899637673 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c28016070 con 0x55ed27bf3c70 2024-09-19T06:21:48.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.444+0000 7f6c26000640 1 -- 172.21.15.3:0/3899637673 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c28004d20 con 0x55ed27bf3c70 2024-09-19T06:21:48.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.444+0000 7f6c26000640 1 -- 172.21.15.3:0/3899637673 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c28012810 con 0x55ed27bf3c70 2024-09-19T06:21:48.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.444+0000 7f6c2e000640 1 --2- 172.21.15.3:0/3083869235 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6c140a33b0 0x7f6c140a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.445+0000 7f6c2e000640 1 -- 172.21.15.3:0/3083869235 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f6c180d01b0 con 0x7f6c30102790 2024-09-19T06:21:48.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.445+0000 7f6c35000640 1 --2- 172.21.15.3:0/3083869235 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6c140a33b0 0x7f6c140a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.445+0000 7f6c3a5be740 1 -- 172.21.15.3:0/3899637673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed27bf3c70 msgr2=0x55ed27bf4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:48.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.445+0000 7f6c3a5be740 1 --2- 172.21.15.3:0/3899637673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed27bf3c70 0x55ed27bf4050 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6c28009eb0 tx=0x7f6c28010740 comp rx=0 tx=0).stop 2024-09-19T06:21:48.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.445+0000 7f6c3a5be740 1 -- 172.21.15.3:0/3899637673 shutdown_connections 2024-09-19T06:21:48.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.445+0000 7f6c3a5be740 1 --2- 172.21.15.3:0/3899637673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed27bfee50 0x55ed27c01240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.445+0000 7f6c3a5be740 1 --2- 172.21.15.3:0/3899637673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bf4590 0x55ed27bfe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.445+0000 7f6c3a5be740 1 --2- 172.21.15.3:0/3899637673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed27bf3c70 0x55ed27bf4050 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.445+0000 7f6c3a5be740 1 -- 172.21.15.3:0/3899637673 >> 172.21.15.3:0/3899637673 conn(0x55ed27bf0200 msgr2=0x55ed27bf05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:48.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.445+0000 7f6c3a5be740 1 -- 172.21.15.3:0/3899637673 shutdown_connections 2024-09-19T06:21:48.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.445+0000 7f6c3a5be740 1 -- 172.21.15.3:0/3899637673 wait complete. 2024-09-19T06:21:48.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.446+0000 7f6c35000640 1 --2- 172.21.15.3:0/3083869235 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6c140a33b0 0x7f6c140a5870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55ed27bf1060 tx=0x7f6c200058d0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:48.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.446+0000 7f6c3a5be740 1 -- start start 2024-09-19T06:21:48.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.446+0000 7f6c3a5be740 1 Processor -- start 2024-09-19T06:21:48.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.447+0000 7f6c3a5be740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed27bf3c70 0x55ed27bfbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.447+0000 7f6c3a5be740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bf4590 0x55ed27bfc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.447+0000 7f6c3a5be740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed27bfee50 0x55ed27bfc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.447+0000 7f6c3a5be740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ed27c01a20 con 0x55ed27bf4590 2024-09-19T06:21:48.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.447+0000 7f6c3a5be740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ed27b150f0 con 0x55ed27bfee50 2024-09-19T06:21:48.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.447+0000 7f6c3a5be740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ed27c01ba0 con 0x55ed27bf3c70 2024-09-19T06:21:48.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.447+0000 7f6c3a5be740 10 client.0 _ll_register_callbacks cb 0x55ed27afcbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:48.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.447+0000 7f6c27e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bf4590 0x55ed27bfc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.447+0000 7f6c35000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed27bf3c70 0x55ed27bfbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.447+0000 7f6c27e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bf4590 0x55ed27bfc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33214/0 (socket says 172.21.15.3:33214) 2024-09-19T06:21:48.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.447+0000 7f6c35a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed27bfee50 0x55ed27bfc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.447+0000 7f6c27e00640 1 -- 172.21.15.3:0/180901157 learned_addr learned my addr 172.21.15.3:0/180901157 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.447+0000 7f6c27e00640 1 -- 172.21.15.3:0/180901157 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed27bf3c70 msgr2=0x55ed27bfbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.447+0000 7f6c27e00640 1 --2- 172.21.15.3:0/180901157 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed27bf3c70 0x55ed27bfbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.447+0000 7f6c27e00640 1 -- 172.21.15.3:0/180901157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed27bfee50 msgr2=0x55ed27bfc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.447+0000 7f6c27e00640 1 --2- 172.21.15.3:0/180901157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed27bfee50 0x55ed27bfc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.447+0000 7f6c27e00640 1 -- 172.21.15.3:0/180901157 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed278cb3c0 con 0x55ed27bf4590 2024-09-19T06:21:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.447+0000 7f6c35000640 1 --2- 172.21.15.3:0/180901157 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed27bf3c70 0x55ed27bfbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.447+0000 7f6c35a00640 1 --2- 172.21.15.3:0/180901157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed27bfee50 0x55ed27bfc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.448+0000 7f6c27e00640 1 --2- 172.21.15.3:0/180901157 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bf4590 0x55ed27bfc240 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800c6a0 tx=0x7f6c18000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939fe7917fbac787 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.448+0000 7f6c1ea00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:21:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.448+0000 7f6c1ea00640 1 -- 172.21.15.3:0/180901157 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1809bf40 con 0x55ed27bf4590 2024-09-19T06:21:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.448+0000 7f6c3a5be740 1 -- 172.21.15.3:0/180901157 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c28004d20 con 0x55ed27bf4590 2024-09-19T06:21:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.448+0000 7f6c1ea00640 1 -- 172.21.15.3:0/180901157 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f6c1809b850 con 0x55ed27bf4590 2024-09-19T06:21:48.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.448+0000 7f6c1ea00640 1 -- 172.21.15.3:0/180901157 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6c180cdd00 con 0x55ed27bf4590 2024-09-19T06:21:48.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.448+0000 7f6c3a5be740 10 client.17961 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:48.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.448+0000 7f6c3a5be740 1 -- 172.21.15.3:0/180901157 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ed27c0da60 con 0x55ed27bf4590 2024-09-19T06:21:48.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.449+0000 7f6c1ea00640 1 -- 172.21.15.3:0/180901157 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c28004d20 con 0x55ed27bf4590 2024-09-19T06:21:48.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.449+0000 7f6c1ea00640 1 -- 172.21.15.3:0/180901157 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6c180b50f0 con 0x55ed27bf4590 2024-09-19T06:21:48.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.449+0000 7f6c3a5be740 10 client.17961 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:48.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.449+0000 7f6c3a5be740 10 client.17961 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:21:48.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.449+0000 7f6c3a5be740 20 client.17961 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:48.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.449+0000 7f6c3a5be740 1 --2- 172.21.15.3:0/180901157 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55ed27c0ef20 0x55ed27c11350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.449+0000 7f6c3a5be740 4 client.17961 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:48.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.449+0000 7f6c3a5be740 1 -- 172.21.15.3:0/180901157 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed27b67950 con 0x55ed27c0ef20 2024-09-19T06:21:48.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.449+0000 7f6c35000640 1 --2- 172.21.15.3:0/180901157 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55ed27c0ef20 0x55ed27c11350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.450+0000 7f6c35000640 1 --2- 172.21.15.3:0/180901157 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55ed27c0ef20 0x55ed27c11350 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2a151592f42323f5 server_cookie=dfa67ec559032b7d in_seq=0 out_seq=0 2024-09-19T06:21:48.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.450+0000 7f6c1ea00640 10 client.17961 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:21:48.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.451+0000 7f6c1ea00640 1 -- 172.21.15.3:0/180901157 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ed27b67950 con 0x55ed27c0ef20 2024-09-19T06:21:48.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.451+0000 7f6c1ea00640 10 client.17961 handle_command_reply: tid=0 2024-09-19T06:21:48.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.451+0000 7f6c3a5be740 1 client.17961 shutdown 2024-09-19T06:21:48.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.451+0000 7f6c3a5be740 1 -- 172.21.15.3:0/180901157 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bf4590 msgr2=0x55ed27bfc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:48.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.451+0000 7f6c3a5be740 1 --2- 172.21.15.3:0/180901157 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bf4590 0x55ed27bfc240 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800c6a0 tx=0x7f6c18000bc0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.451+0000 7f6c3a5be740 1 -- 172.21.15.3:0/180901157 shutdown_connections 2024-09-19T06:21:48.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.451+0000 7f6c3a5be740 1 --2- 172.21.15.3:0/180901157 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55ed27c0ef20 0x55ed27c11350 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.451+0000 7f6c3a5be740 1 --2- 172.21.15.3:0/180901157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed27bfee50 0x55ed27bfc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.451+0000 7f6c1ea00640 0 client.17961 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:21:48.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.451+0000 7f6c3a5be740 1 --2- 172.21.15.3:0/180901157 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bf4590 0x55ed27bfc240 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.451+0000 7f6c3a5be740 1 --2- 172.21.15.3:0/180901157 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed27bf3c70 0x55ed27bfbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.451+0000 7f6c3a5be740 1 -- 172.21.15.3:0/180901157 >> 172.21.15.3:0/180901157 conn(0x55ed27bf0200 msgr2=0x55ed27bf5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:48.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.451+0000 7f6c3a5be740 1 -- 172.21.15.3:0/180901157 shutdown_connections 2024-09-19T06:21:48.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.451+0000 7f6c3a5be740 1 -- 172.21.15.3:0/180901157 wait complete. 2024-09-19T06:21:48.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.451+0000 7f6c3a5be740 20 client.17961 trim_cache size 0 max 16384 2024-09-19T06:21:48.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.466+0000 7f6c3a5be740 1 Processor -- start 2024-09-19T06:21:48.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.466+0000 7f6c3a5be740 1 -- start start 2024-09-19T06:21:48.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.466+0000 7f6c3a5be740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed27bf3c70 0x55ed27bfdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.466+0000 7f6c3a5be740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bf4590 0x55ed27c16c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.466+0000 7f6c3a5be740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed27bfee50 0x55ed27c17160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.466+0000 7f6c3a5be740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6c301afbf0 con 0x55ed27bf4590 2024-09-19T06:21:48.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.466+0000 7f6c3a5be740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6c301b1730 con 0x55ed27bf3c70 2024-09-19T06:21:48.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.466+0000 7f6c3a5be740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6c301b02c0 con 0x55ed27bfee50 2024-09-19T06:21:48.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.467+0000 7f6c27e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bf4590 0x55ed27c16c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.467+0000 7f6c27e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bf4590 0x55ed27c16c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33218/0 (socket says 172.21.15.3:33218) 2024-09-19T06:21:48.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.467+0000 7f6c27e00640 1 -- 172.21.15.3:0/424278572 learned_addr learned my addr 172.21.15.3:0/424278572 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:48.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.467+0000 7f6c35000640 1 --2- 172.21.15.3:0/424278572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed27bf3c70 0x55ed27bfdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.467+0000 7f6c35a00640 1 --2- 172.21.15.3:0/424278572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed27bfee50 0x55ed27c17160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.467+0000 7f6c27e00640 1 -- 172.21.15.3:0/424278572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed27bfee50 msgr2=0x55ed27c17160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:48.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.467+0000 7f6c27e00640 1 --2- 172.21.15.3:0/424278572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed27bfee50 0x55ed27c17160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.467+0000 7f6c27e00640 1 -- 172.21.15.3:0/424278572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed27bf3c70 msgr2=0x55ed27bfdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:48.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.467+0000 7f6c27e00640 1 --2- 172.21.15.3:0/424278572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed27bf3c70 0x55ed27bfdc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.467+0000 7f6c27e00640 1 -- 172.21.15.3:0/424278572 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed27bf0030 con 0x55ed27bf4590 2024-09-19T06:21:48.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.467+0000 7f6c35a00640 1 --2- 172.21.15.3:0/424278572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed27bfee50 0x55ed27c17160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:48.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.467+0000 7f6c35000640 1 --2- 172.21.15.3:0/424278572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed27bf3c70 0x55ed27bfdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:48.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.467+0000 7f6c27e00640 1 --2- 172.21.15.3:0/424278572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bf4590 0x55ed27c16c20 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f6c1809c100 tx=0x7f6c18009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324c9a07bcf75535 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:48.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.468+0000 7f6c25600640 1 -- 172.21.15.3:0/424278572 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c180056b0 con 0x55ed27bf4590 2024-09-19T06:21:48.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.468+0000 7f6c25600640 1 -- 172.21.15.3:0/424278572 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c1809c400 con 0x55ed27bf4590 2024-09-19T06:21:48.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.468+0000 7f6c25600640 1 -- 172.21.15.3:0/424278572 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1809bd60 con 0x55ed27bf4590 2024-09-19T06:21:48.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.468+0000 7f6c3a5be740 1 -- 172.21.15.3:0/424278572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bf4590 msgr2=0x55ed27c16c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:48.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.468+0000 7f6c3a5be740 1 --2- 172.21.15.3:0/424278572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bf4590 0x55ed27c16c20 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f6c1809c100 tx=0x7f6c18009f90 comp rx=0 tx=0).stop 2024-09-19T06:21:48.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.468+0000 7f6c3a5be740 1 -- 172.21.15.3:0/424278572 shutdown_connections 2024-09-19T06:21:48.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.468+0000 7f6c3a5be740 1 --2- 172.21.15.3:0/424278572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed27bfee50 0x55ed27c17160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.468+0000 7f6c3a5be740 1 --2- 172.21.15.3:0/424278572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bf4590 0x55ed27c16c20 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.468+0000 7f6c3a5be740 1 --2- 172.21.15.3:0/424278572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed27bf3c70 0x55ed27bfdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.468+0000 7f6c3a5be740 1 -- 172.21.15.3:0/424278572 >> 172.21.15.3:0/424278572 conn(0x55ed27bf0200 msgr2=0x55ed27bfd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:48.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.468+0000 7f6c3a5be740 1 -- 172.21.15.3:0/424278572 shutdown_connections 2024-09-19T06:21:48.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.469+0000 7f6c3a5be740 1 -- 172.21.15.3:0/424278572 wait complete. 2024-09-19T06:21:48.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.469+0000 7f6c3a5be740 1 -- start start 2024-09-19T06:21:48.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.469+0000 7f6c3a5be740 1 Processor -- start 2024-09-19T06:21:48.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.470+0000 7f6c3a5be740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed27bf3c70 0x55ed27c02e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.470+0000 7f6c3a5be740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed27bf4590 0x55ed27c03370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.470+0000 7f6c3a5be740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bfee50 0x55ed27c038b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.470+0000 7f6c3a5be740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6c301b1060 con 0x55ed27bfee50 2024-09-19T06:21:48.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.470+0000 7f6c3a5be740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6c301b0990 con 0x55ed27bf4590 2024-09-19T06:21:48.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.470+0000 7f6c3a5be740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6c301adbf0 con 0x55ed27bf3c70 2024-09-19T06:21:48.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.470+0000 7f6c3a5be740 10 client.0 _ll_register_callbacks cb 0x7f6c180d3950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:48.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.470+0000 7f6c27e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed27bf4590 0x55ed27c03370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.484 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.470+0000 7f6c27e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed27bf4590 0x55ed27c03370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40924/0 (socket says 172.21.15.3:40924) 2024-09-19T06:21:48.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.470+0000 7f6c27e00640 1 -- 172.21.15.3:0/635785520 learned_addr learned my addr 172.21.15.3:0/635785520 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:48.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.470+0000 7f6c35a00640 1 --2- 172.21.15.3:0/635785520 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bfee50 0x55ed27c038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.470+0000 7f6c35000640 1 --2- 172.21.15.3:0/635785520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed27bf3c70 0x55ed27c02e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.470+0000 7f6c27e00640 1 -- 172.21.15.3:0/635785520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed27bf3c70 msgr2=0x55ed27c02e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:48.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.470+0000 7f6c27e00640 1 --2- 172.21.15.3:0/635785520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed27bf3c70 0x55ed27c02e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.470+0000 7f6c27e00640 1 -- 172.21.15.3:0/635785520 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bfee50 msgr2=0x55ed27c038b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:48.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.470+0000 7f6c27e00640 1 --2- 172.21.15.3:0/635785520 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bfee50 0x55ed27c038b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.470+0000 7f6c27e00640 1 -- 172.21.15.3:0/635785520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed27bf0e90 con 0x55ed27bf4590 2024-09-19T06:21:48.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.470+0000 7f6c35a00640 1 --2- 172.21.15.3:0/635785520 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bfee50 0x55ed27c038b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:48.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.471+0000 7f6c27e00640 1 --2- 172.21.15.3:0/635785520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed27bf4590 0x55ed27c03370 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6c180d3a00 tx=0x7f6c1809bb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a3d74492845a6ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:48.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.471+0000 7f6c1ea00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:21:48.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.471+0000 7f6c1ea00640 1 -- 172.21.15.3:0/635785520 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1809bd60 con 0x55ed27bf4590 2024-09-19T06:21:48.485 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.471+0000 7f6c3a5be740 1 -- 172.21.15.3:0/635785520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ed27b61e60 con 0x55ed27bf4590 2024-09-19T06:21:48.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.471+0000 7f6c1ea00640 1 -- 172.21.15.3:0/635785520 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f6c18005000 con 0x55ed27bf4590 2024-09-19T06:21:48.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.471+0000 7f6c1ea00640 1 -- 172.21.15.3:0/635785520 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6c1809bf40 con 0x55ed27bf4590 2024-09-19T06:21:48.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.471+0000 7f6c3a5be740 10 client.27998 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:48.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.471+0000 7f6c3a5be740 1 -- 172.21.15.3:0/635785520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ed27bf12b0 con 0x55ed27bf4590 2024-09-19T06:21:48.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.471+0000 7f6c1ea00640 1 -- 172.21.15.3:0/635785520 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55ed27b61e60 con 0x55ed27bf4590 2024-09-19T06:21:48.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.472+0000 7f6c1ea00640 1 -- 172.21.15.3:0/635785520 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6c180a1940 con 0x55ed27bf4590 2024-09-19T06:21:48.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.472+0000 7f6c3a5be740 10 client.27998 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:48.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.472+0000 7f6c3a5be740 10 client.27998 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:21:48.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.472+0000 7f6c3a5be740 20 client.27998 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:48.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.472+0000 7f6c3a5be740 1 --2- 172.21.15.3:0/635785520 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55ed27c7a240 0x55ed27c7c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:48.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.472+0000 7f6c3a5be740 4 client.27998 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:48.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.472+0000 7f6c3a5be740 1 -- 172.21.15.3:0/635785520 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ed27ade010 con 0x55ed27c7a240 2024-09-19T06:21:48.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.472+0000 7f6c35000640 1 --2- 172.21.15.3:0/635785520 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55ed27c7a240 0x55ed27c7c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:48.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.473+0000 7f6c35000640 1 --2- 172.21.15.3:0/635785520 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55ed27c7a240 0x55ed27c7c660 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=302fed3674635a server_cookie=2d10d4caa3c1d38f in_seq=0 out_seq=0 2024-09-19T06:21:48.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.473+0000 7f6c1ea00640 10 client.27998 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:21:48.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.473+0000 7f6c1ea00640 1 -- 172.21.15.3:0/635785520 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ed27ade010 con 0x55ed27c7a240 2024-09-19T06:21:48.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.473+0000 7f6c1ea00640 10 client.27998 handle_command_reply: tid=0 2024-09-19T06:21:48.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.473+0000 7f6c3a5be740 1 client.27998 shutdown 2024-09-19T06:21:48.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.473+0000 7f6c3a5be740 1 -- 172.21.15.3:0/635785520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed27bf4590 msgr2=0x55ed27c03370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:48.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.473+0000 7f6c3a5be740 1 --2- 172.21.15.3:0/635785520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed27bf4590 0x55ed27c03370 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6c180d3a00 tx=0x7f6c1809bb80 comp rx=0 tx=0).stop 2024-09-19T06:21:48.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.473+0000 7f6c3a5be740 1 -- 172.21.15.3:0/635785520 shutdown_connections 2024-09-19T06:21:48.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.473+0000 7f6c3a5be740 1 --2- 172.21.15.3:0/635785520 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55ed27c7a240 0x55ed27c7c660 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.473+0000 7f6c3a5be740 1 --2- 172.21.15.3:0/635785520 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ed27bfee50 0x55ed27c038b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.487 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.473+0000 7f6c3a5be740 1 --2- 172.21.15.3:0/635785520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ed27bf4590 0x55ed27c03370 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.473+0000 7f6c1ea00640 0 client.27998 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:21:48.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.473+0000 7f6c3a5be740 1 --2- 172.21.15.3:0/635785520 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ed27bf3c70 0x55ed27c02e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.473+0000 7f6c3a5be740 1 -- 172.21.15.3:0/635785520 >> 172.21.15.3:0/635785520 conn(0x55ed27bf0200 msgr2=0x55ed27bef380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:48.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.473+0000 7f6c3a5be740 1 -- 172.21.15.3:0/635785520 shutdown_connections 2024-09-19T06:21:48.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.473+0000 7f6c3a5be740 1 -- 172.21.15.3:0/635785520 wait complete. 2024-09-19T06:21:48.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.473+0000 7f6c3a5be740 20 client.27998 trim_cache size 0 max 16384 2024-09-19T06:21:48.488 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:21:48.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.474+0000 7f6c37a00640 1 -- 172.21.15.3:0/3083869235 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6c140a33b0 msgr2=0x7f6c140a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:48.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.474+0000 7f6c37a00640 1 --2- 172.21.15.3:0/3083869235 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6c140a33b0 0x7f6c140a5870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55ed27bf1060 tx=0x7f6c200058d0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.474+0000 7f6c37a00640 1 -- 172.21.15.3:0/3083869235 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c30102790 msgr2=0x7f6c3019abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:48.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.474+0000 7f6c37a00640 1 --2- 172.21.15.3:0/3083869235 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c30102790 0x7f6c3019abe0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800e9c0 tx=0x7f6c1800ee80 comp rx=0 tx=0).stop 2024-09-19T06:21:48.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.474+0000 7f6c37a00640 1 -- 172.21.15.3:0/3083869235 shutdown_connections 2024-09-19T06:21:48.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.474+0000 7f6c37a00640 1 --2- 172.21.15.3:0/3083869235 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f6c140a33b0 0x7f6c140a5870 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.474+0000 7f6c37a00640 1 --2- 172.21.15.3:0/3083869235 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6c30106f10 0x7f6c3019ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.474+0000 7f6c37a00640 1 --2- 172.21.15.3:0/3083869235 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6c30102790 0x7f6c3019abe0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.474+0000 7f6c37a00640 1 --2- 172.21.15.3:0/3083869235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c30101de0 0x7f6c3019a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:48.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.474+0000 7f6c37a00640 1 -- 172.21.15.3:0/3083869235 >> 172.21.15.3:0/3083869235 conn(0x7f6c300fd8c0 msgr2=0x7f6c300fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:48.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.474+0000 7f6c37a00640 1 -- 172.21.15.3:0/3083869235 shutdown_connections 2024-09-19T06:21:48.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:48.474+0000 7f6c37a00640 1 -- 172.21.15.3:0/3083869235 wait complete. 2024-09-19T06:21:48.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:48 smithi059 ceph-mon[35138]: pgmap v291: 97 pgs: 97 active+clean; 1.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 16 op/s 2024-09-19T06:21:48.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:48 smithi071 ceph-mon[35662]: pgmap v291: 97 pgs: 97 active+clean; 1.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 16 op/s 2024-09-19T06:21:49.418 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:21:49.798 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:50.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.372+0000 7fd7ee000640 1 -- 172.21.15.3:0/103506461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7e81079c0 msgr2=0x7fd7e8107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:50.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.372+0000 7fd7ee000640 1 --2- 172.21.15.3:0/103506461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7e81079c0 0x7fd7e8107da0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009930 tx=0x7fd7dc02a420 comp rx=0 tx=0).stop 2024-09-19T06:21:50.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.372+0000 7fd7ee000640 1 -- 172.21.15.3:0/103506461 shutdown_connections 2024-09-19T06:21:50.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.372+0000 7fd7ee000640 1 --2- 172.21.15.3:0/103506461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7e8102360 0x7fd7e810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.372+0000 7fd7ee000640 1 --2- 172.21.15.3:0/103506461 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7e81019c0 0x7fd7e8101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.372+0000 7fd7ee000640 1 --2- 172.21.15.3:0/103506461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7e81079c0 0x7fd7e8107da0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.372+0000 7fd7ee000640 1 -- 172.21.15.3:0/103506461 >> 172.21.15.3:0/103506461 conn(0x7fd7e80fd6e0 msgr2=0x7fd7e80ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:50.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.372+0000 7fd7ee000640 1 -- 172.21.15.3:0/103506461 shutdown_connections 2024-09-19T06:21:50.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.372+0000 7fd7ee000640 1 -- 172.21.15.3:0/103506461 wait complete. 2024-09-19T06:21:50.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.373+0000 7fd7ee000640 1 Processor -- start 2024-09-19T06:21:50.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.373+0000 7fd7ee000640 1 -- start start 2024-09-19T06:21:50.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.374+0000 7fd7ee000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7e81019c0 0x7fd7e80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.374+0000 7fd7ee000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7e8102360 0x7fd7e8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.374+0000 7fd7ee000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7e81079c0 0x7fd7e8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.374+0000 7fd7ee000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e8111d80 con 0x7fd7e8102360 2024-09-19T06:21:50.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.374+0000 7fd7ee000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e8111c00 con 0x7fd7e81079c0 2024-09-19T06:21:50.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.374+0000 7fd7ee000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e8111f00 con 0x7fd7e81019c0 2024-09-19T06:21:50.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.374+0000 7fd7e7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7e8102360 0x7fd7e8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.374+0000 7fd7e7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7e8102360 0x7fd7e8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33238/0 (socket says 172.21.15.3:33238) 2024-09-19T06:21:50.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.374+0000 7fd7e7e00640 1 -- 172.21.15.3:0/2174809824 learned_addr learned my addr 172.21.15.3:0/2174809824 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:50.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.374+0000 7fd7ed600640 1 --2- 172.21.15.3:0/2174809824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7e81079c0 0x7fd7e8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.374+0000 7fd7ecc00640 1 --2- 172.21.15.3:0/2174809824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7e81019c0 0x7fd7e80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.374+0000 7fd7e7e00640 1 -- 172.21.15.3:0/2174809824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7e81019c0 msgr2=0x7fd7e80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:50.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.374+0000 7fd7e7e00640 1 --2- 172.21.15.3:0/2174809824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7e81019c0 0x7fd7e80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.374+0000 7fd7e7e00640 1 -- 172.21.15.3:0/2174809824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7e81079c0 msgr2=0x7fd7e8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:50.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.374+0000 7fd7e7e00640 1 --2- 172.21.15.3:0/2174809824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7e81079c0 0x7fd7e8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.374+0000 7fd7e7e00640 1 -- 172.21.15.3:0/2174809824 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e81a67c0 con 0x7fd7e8102360 2024-09-19T06:21:50.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.375+0000 7fd7e7e00640 1 --2- 172.21.15.3:0/2174809824 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7e8102360 0x7fd7e8074a30 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400d950 tx=0x7fd7d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:50.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.375+0000 7fd7e5600640 1 -- 172.21.15.3:0/2174809824 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4017070 con 0x7fd7e8102360 2024-09-19T06:21:50.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.375+0000 7fd7e5600640 1 -- 172.21.15.3:0/2174809824 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7d4009c30 con 0x7fd7e8102360 2024-09-19T06:21:50.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.375+0000 7fd7e5600640 1 -- 172.21.15.3:0/2174809824 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d400f6b0 con 0x7fd7e8102360 2024-09-19T06:21:50.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.375+0000 7fd7ee000640 1 -- 172.21.15.3:0/2174809824 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e81a6ab0 con 0x7fd7e8102360 2024-09-19T06:21:50.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.375+0000 7fd7ee000640 1 -- 172.21.15.3:0/2174809824 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e81a6fa0 con 0x7fd7e8102360 2024-09-19T06:21:50.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.378+0000 7fd7f20d9740 1 Processor -- start 2024-09-19T06:21:50.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.378+0000 7fd7e5600640 1 -- 172.21.15.3:0/2174809824 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fd7d40109d0 con 0x7fd7e8102360 2024-09-19T06:21:50.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.378+0000 7fd7f20d9740 1 -- start start 2024-09-19T06:21:50.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.379+0000 7fd7f20d9740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56512c4e9e40 0x56512c4ea220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.379+0000 7fd7f20d9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56512c4ea760 0x56512c4f4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.379+0000 7fd7f20d9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56512c4f5020 0x56512c4f7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.379+0000 7fd7f20d9740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56512c4503e0 con 0x56512c4e9e40 2024-09-19T06:21:50.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.379+0000 7fd7f20d9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56512c3f7d80 con 0x56512c4f5020 2024-09-19T06:21:50.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.379+0000 7fd7f20d9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56512c44c3a0 con 0x56512c4ea760 2024-09-19T06:21:50.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.379+0000 7fd7ed600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56512c4e9e40 0x56512c4ea220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.379+0000 7fd7ed600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56512c4e9e40 0x56512c4ea220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33254/0 (socket says 172.21.15.3:33254) 2024-09-19T06:21:50.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.379+0000 7fd7ed600640 1 -- 172.21.15.3:0/1797846404 learned_addr learned my addr 172.21.15.3:0/1797846404 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:50.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.379+0000 7fd7ecc00640 1 --2- 172.21.15.3:0/1797846404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56512c4ea760 0x56512c4f4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.379+0000 7fd7e7e00640 1 --2- 172.21.15.3:0/1797846404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56512c4f5020 0x56512c4f7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.380+0000 7fd7ecc00640 1 -- 172.21.15.3:0/1797846404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56512c4f5020 msgr2=0x56512c4f7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:50.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.380+0000 7fd7ecc00640 1 --2- 172.21.15.3:0/1797846404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56512c4f5020 0x56512c4f7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.380+0000 7fd7ecc00640 1 -- 172.21.15.3:0/1797846404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56512c4e9e40 msgr2=0x56512c4ea220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:50.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.380+0000 7fd7ecc00640 1 --2- 172.21.15.3:0/1797846404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56512c4e9e40 0x56512c4ea220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.380+0000 7fd7ecc00640 1 -- 172.21.15.3:0/1797846404 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56512c416ae0 con 0x56512c4ea760 2024-09-19T06:21:50.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.380+0000 7fd7ecc00640 1 --2- 172.21.15.3:0/1797846404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56512c4ea760 0x56512c4f4ae0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc005940 tx=0x7fd7dc005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58edbecd5d5db1b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:50.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.380+0000 7fd7d9c00640 1 -- 172.21.15.3:0/1797846404 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc040070 con 0x56512c4ea760 2024-09-19T06:21:50.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.380+0000 7fd7d9c00640 1 -- 172.21.15.3:0/1797846404 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7dc0319f0 con 0x56512c4ea760 2024-09-19T06:21:50.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.380+0000 7fd7d9c00640 1 -- 172.21.15.3:0/1797846404 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc035040 con 0x56512c4ea760 2024-09-19T06:21:50.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.381+0000 7fd7e5600640 1 --2- 172.21.15.3:0/2174809824 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd7d00a33b0 0x7fd7d00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.381+0000 7fd7e5600640 1 -- 172.21.15.3:0/2174809824 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7fd7d40cf970 con 0x7fd7e8102360 2024-09-19T06:21:50.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.381+0000 7fd7ed600640 1 --2- 172.21.15.3:0/2174809824 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd7d00a33b0 0x7fd7d00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.381+0000 7fd7f20d9740 1 -- 172.21.15.3:0/1797846404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56512c4ea760 msgr2=0x56512c4f4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:50.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.381+0000 7fd7f20d9740 1 --2- 172.21.15.3:0/1797846404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56512c4ea760 0x56512c4f4ae0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc005940 tx=0x7fd7dc005c00 comp rx=0 tx=0).stop 2024-09-19T06:21:50.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.381+0000 7fd7f20d9740 1 -- 172.21.15.3:0/1797846404 shutdown_connections 2024-09-19T06:21:50.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.381+0000 7fd7f20d9740 1 --2- 172.21.15.3:0/1797846404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56512c4f5020 0x56512c4f7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.381+0000 7fd7f20d9740 1 --2- 172.21.15.3:0/1797846404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56512c4ea760 0x56512c4f4ae0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.381+0000 7fd7f20d9740 1 --2- 172.21.15.3:0/1797846404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56512c4e9e40 0x56512c4ea220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.381+0000 7fd7f20d9740 1 -- 172.21.15.3:0/1797846404 >> 172.21.15.3:0/1797846404 conn(0x56512c4e63d0 msgr2=0x56512c4e67b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:50.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.382+0000 7fd7f20d9740 1 -- 172.21.15.3:0/1797846404 shutdown_connections 2024-09-19T06:21:50.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.382+0000 7fd7f20d9740 1 -- 172.21.15.3:0/1797846404 wait complete. 2024-09-19T06:21:50.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.382+0000 7fd7ed600640 1 --2- 172.21.15.3:0/2174809824 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd7d00a33b0 0x7fd7d00a5870 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0005f40 tx=0x7fd7e00096a0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:50.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.382+0000 7fd7f20d9740 1 -- start start 2024-09-19T06:21:50.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.382+0000 7fd7f20d9740 1 Processor -- start 2024-09-19T06:21:50.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.383+0000 7fd7f20d9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56512c4e9e40 0x56512c4f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.383+0000 7fd7f20d9740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56512c4ea760 0x56512c4f2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.383+0000 7fd7f20d9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56512c4f5020 0x56512c4f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.383+0000 7fd7f20d9740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56512c4f7bf0 con 0x56512c4ea760 2024-09-19T06:21:50.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.383+0000 7fd7f20d9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56512c40b0f0 con 0x56512c4f5020 2024-09-19T06:21:50.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.383+0000 7fd7f20d9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56512c4f7d70 con 0x56512c4e9e40 2024-09-19T06:21:50.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.383+0000 7fd7f20d9740 10 client.0 _ll_register_callbacks cb 0x56512c3f2bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:50.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.383+0000 7fd7e7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56512c4ea760 0x56512c4f2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.383+0000 7fd7e7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56512c4ea760 0x56512c4f2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33262/0 (socket says 172.21.15.3:33262) 2024-09-19T06:21:50.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.383+0000 7fd7e7e00640 1 -- 172.21.15.3:0/2185111959 learned_addr learned my addr 172.21.15.3:0/2185111959 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:50.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.383+0000 7fd7ed600640 1 --2- 172.21.15.3:0/2185111959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56512c4f5020 0x56512c4f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.383+0000 7fd7ecc00640 1 --2- 172.21.15.3:0/2185111959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56512c4e9e40 0x56512c4f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.384+0000 7fd7e7e00640 1 -- 172.21.15.3:0/2185111959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56512c4e9e40 msgr2=0x56512c4f1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:50.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.384+0000 7fd7e7e00640 1 --2- 172.21.15.3:0/2185111959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56512c4e9e40 0x56512c4f1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.384+0000 7fd7e7e00640 1 -- 172.21.15.3:0/2185111959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56512c4f5020 msgr2=0x56512c4f28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:50.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.384+0000 7fd7e7e00640 1 --2- 172.21.15.3:0/2185111959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56512c4f5020 0x56512c4f28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.384+0000 7fd7e7e00640 1 -- 172.21.15.3:0/2185111959 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56512c1c13c0 con 0x56512c4ea760 2024-09-19T06:21:50.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.384+0000 7fd7e7e00640 1 --2- 172.21.15.3:0/2185111959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56512c4ea760 0x56512c4f2380 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009610 tx=0x7fd7d4010cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e295d7fc2cfa2b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.384+0000 7fd7ce000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:21:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.384+0000 7fd7ce000640 1 -- 172.21.15.3:0/2185111959 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d40d5020 con 0x56512c4ea760 2024-09-19T06:21:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.384+0000 7fd7ce000640 1 -- 172.21.15.3:0/2185111959 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7fd7d409b0c0 con 0x56512c4ea760 2024-09-19T06:21:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.384+0000 7fd7f20d9740 1 -- 172.21.15.3:0/2185111959 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7dc0319f0 con 0x56512c4ea760 2024-09-19T06:21:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.385+0000 7fd7ce000640 1 -- 172.21.15.3:0/2185111959 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd7d4020070 con 0x56512c4ea760 2024-09-19T06:21:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.385+0000 7fd7f20d9740 10 client.17979 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.385+0000 7fd7f20d9740 1 -- 172.21.15.3:0/2185111959 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56512c503b60 con 0x56512c4ea760 2024-09-19T06:21:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.385+0000 7fd7ce000640 1 -- 172.21.15.3:0/2185111959 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7dc0319f0 con 0x56512c4ea760 2024-09-19T06:21:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.385+0000 7fd7ce000640 1 -- 172.21.15.3:0/2185111959 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd7d40979c0 con 0x56512c4ea760 2024-09-19T06:21:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.385+0000 7fd7f20d9740 10 client.17979 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.385+0000 7fd7f20d9740 10 client.17979 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:21:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.385+0000 7fd7f20d9740 20 client.17979 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.385+0000 7fd7f20d9740 1 --2- 172.21.15.3:0/2185111959 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56512c505020 0x56512c507430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.385+0000 7fd7f20d9740 4 client.17979 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.385+0000 7fd7f20d9740 1 -- 172.21.15.3:0/2185111959 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56512c45d950 con 0x56512c505020 2024-09-19T06:21:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.386+0000 7fd7ecc00640 1 --2- 172.21.15.3:0/2185111959 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56512c505020 0x56512c507430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.386+0000 7fd7ecc00640 1 --2- 172.21.15.3:0/2185111959 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56512c505020 0x56512c507430 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ec8f89f6d51b0b30 server_cookie=2f816e8976fb0446 in_seq=0 out_seq=0 2024-09-19T06:21:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.386+0000 7fd7ce000640 10 client.17979 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:21:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.387+0000 7fd7ce000640 1 -- 172.21.15.3:0/2185111959 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56512c45d950 con 0x56512c505020 2024-09-19T06:21:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.387+0000 7fd7ce000640 10 client.17979 handle_command_reply: tid=0 2024-09-19T06:21:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.387+0000 7fd7f20d9740 1 client.17979 shutdown 2024-09-19T06:21:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.387+0000 7fd7f20d9740 1 -- 172.21.15.3:0/2185111959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56512c4ea760 msgr2=0x56512c4f2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.387+0000 7fd7f20d9740 1 --2- 172.21.15.3:0/2185111959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56512c4ea760 0x56512c4f2380 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009610 tx=0x7fd7d4010cc0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.387+0000 7fd7f20d9740 1 -- 172.21.15.3:0/2185111959 shutdown_connections 2024-09-19T06:21:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.387+0000 7fd7f20d9740 1 --2- 172.21.15.3:0/2185111959 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56512c505020 0x56512c507430 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.387+0000 7fd7f20d9740 1 --2- 172.21.15.3:0/2185111959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56512c4f5020 0x56512c4f28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.387+0000 7fd7f20d9740 1 --2- 172.21.15.3:0/2185111959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56512c4ea760 0x56512c4f2380 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.387+0000 7fd7f20d9740 1 --2- 172.21.15.3:0/2185111959 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56512c4e9e40 0x56512c4f1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.387+0000 7fd7f20d9740 1 -- 172.21.15.3:0/2185111959 >> 172.21.15.3:0/2185111959 conn(0x56512c4e63d0 msgr2=0x56512c4ec100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:50.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.387+0000 7fd7ce000640 0 client.17979 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:21:50.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.388+0000 7fd7f20d9740 1 -- 172.21.15.3:0/2185111959 shutdown_connections 2024-09-19T06:21:50.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.388+0000 7fd7f20d9740 1 -- 172.21.15.3:0/2185111959 wait complete. 2024-09-19T06:21:50.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.388+0000 7fd7f20d9740 20 client.17979 trim_cache size 0 max 16384 2024-09-19T06:21:50.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.401+0000 7fd7f20d9740 1 Processor -- start 2024-09-19T06:21:50.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.401+0000 7fd7f20d9740 1 -- start start 2024-09-19T06:21:50.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.402+0000 7fd7f20d9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56512c4e9e40 0x56512c50cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.402+0000 7fd7f20d9740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56512c4ea760 0x56512c50d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.402+0000 7fd7f20d9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56512c4f5020 0x56512c4f36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.402+0000 7fd7f20d9740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e81afac0 con 0x56512c4ea760 2024-09-19T06:21:50.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.402+0000 7fd7f20d9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e81b1600 con 0x56512c4e9e40 2024-09-19T06:21:50.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.402+0000 7fd7f20d9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e81b0190 con 0x56512c4f5020 2024-09-19T06:21:50.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.402+0000 7fd7e7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56512c4ea760 0x56512c50d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.402+0000 7fd7ecc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56512c4e9e40 0x56512c50cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.402+0000 7fd7ecc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56512c4e9e40 0x56512c50cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40948/0 (socket says 172.21.15.3:40948) 2024-09-19T06:21:50.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.402+0000 7fd7ecc00640 1 -- 172.21.15.3:0/1027217460 learned_addr learned my addr 172.21.15.3:0/1027217460 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:50.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.402+0000 7fd7ed600640 1 --2- 172.21.15.3:0/1027217460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56512c4f5020 0x56512c4f36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.403+0000 7fd7ecc00640 1 -- 172.21.15.3:0/1027217460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56512c4f5020 msgr2=0x56512c4f36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:50.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.403+0000 7fd7ecc00640 1 --2- 172.21.15.3:0/1027217460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56512c4f5020 0x56512c4f36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.403+0000 7fd7ecc00640 1 -- 172.21.15.3:0/1027217460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56512c4ea760 msgr2=0x56512c50d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:50.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.403+0000 7fd7ecc00640 1 --2- 172.21.15.3:0/1027217460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56512c4ea760 0x56512c50d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.403+0000 7fd7ecc00640 1 -- 172.21.15.3:0/1027217460 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56512c4e6200 con 0x56512c4e9e40 2024-09-19T06:21:50.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.403+0000 7fd7e7e00640 1 --2- 172.21.15.3:0/1027217460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56512c4ea760 0x56512c50d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:50.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.403+0000 7fd7ecc00640 1 --2- 172.21.15.3:0/1027217460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56512c4e9e40 0x56512c50cd00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x56512c4e7230 tx=0x7fd7dc0058d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7b30512555b0a88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:50.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.403+0000 7fd7d9200640 1 -- 172.21.15.3:0/1027217460 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc040040 con 0x56512c4e9e40 2024-09-19T06:21:50.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.403+0000 7fd7d9200640 1 -- 172.21.15.3:0/1027217460 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7dc004230 con 0x56512c4e9e40 2024-09-19T06:21:50.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.403+0000 7fd7d9200640 1 -- 172.21.15.3:0/1027217460 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc035040 con 0x56512c4e9e40 2024-09-19T06:21:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.404+0000 7fd7f20d9740 1 -- 172.21.15.3:0/1027217460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56512c4e9e40 msgr2=0x56512c50cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.404+0000 7fd7f20d9740 1 --2- 172.21.15.3:0/1027217460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56512c4e9e40 0x56512c50cd00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x56512c4e7230 tx=0x7fd7dc0058d0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.404+0000 7fd7f20d9740 1 -- 172.21.15.3:0/1027217460 shutdown_connections 2024-09-19T06:21:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.404+0000 7fd7f20d9740 1 --2- 172.21.15.3:0/1027217460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56512c4f5020 0x56512c4f36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.404+0000 7fd7f20d9740 1 --2- 172.21.15.3:0/1027217460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56512c4ea760 0x56512c50d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.404+0000 7fd7f20d9740 1 --2- 172.21.15.3:0/1027217460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56512c4e9e40 0x56512c50cd00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.404+0000 7fd7f20d9740 1 -- 172.21.15.3:0/1027217460 >> 172.21.15.3:0/1027217460 conn(0x56512c4e63d0 msgr2=0x56512c4f0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.404+0000 7fd7f20d9740 1 -- 172.21.15.3:0/1027217460 shutdown_connections 2024-09-19T06:21:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.404+0000 7fd7f20d9740 1 -- 172.21.15.3:0/1027217460 wait complete. 2024-09-19T06:21:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.404+0000 7fd7f20d9740 1 -- start start 2024-09-19T06:21:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.405+0000 7fd7f20d9740 1 Processor -- start 2024-09-19T06:21:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.405+0000 7fd7f20d9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56512c4ea760 0x56512c4fd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.405+0000 7fd7f20d9740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56512c4f5020 0x56512c4f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.405+0000 7fd7f20d9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56512c4f6070 0x56512c4f64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.405+0000 7fd7f20d9740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e81b0f30 con 0x56512c4f5020 2024-09-19T06:21:50.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.405+0000 7fd7f20d9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e81b0860 con 0x56512c4ea760 2024-09-19T06:21:50.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.405+0000 7fd7f20d9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e81adac0 con 0x56512c4f6070 2024-09-19T06:21:50.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.405+0000 7fd7f20d9740 10 client.0 _ll_register_callbacks cb 0x7fd7d4097f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:50.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.405+0000 7fd7ecc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56512c4ea760 0x56512c4fd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.405+0000 7fd7e7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56512c4f5020 0x56512c4f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.405+0000 7fd7ecc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56512c4ea760 0x56512c4fd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40962/0 (socket says 172.21.15.3:40962) 2024-09-19T06:21:50.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.405+0000 7fd7ecc00640 1 -- 172.21.15.3:0/2553663046 learned_addr learned my addr 172.21.15.3:0/2553663046 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:50.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.406+0000 7fd7ed600640 1 --2- 172.21.15.3:0/2553663046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56512c4f6070 0x56512c4f64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.406+0000 7fd7ecc00640 1 -- 172.21.15.3:0/2553663046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56512c4f6070 msgr2=0x56512c4f64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:50.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.406+0000 7fd7ecc00640 1 --2- 172.21.15.3:0/2553663046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56512c4f6070 0x56512c4f64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.406+0000 7fd7ecc00640 1 -- 172.21.15.3:0/2553663046 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56512c4f5020 msgr2=0x56512c4f5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:50.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.406+0000 7fd7ecc00640 1 --2- 172.21.15.3:0/2553663046 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56512c4f5020 0x56512c4f5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.406+0000 7fd7ecc00640 1 -- 172.21.15.3:0/2553663046 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56512c4fdbe0 con 0x56512c4ea760 2024-09-19T06:21:50.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.406+0000 7fd7ecc00640 1 --2- 172.21.15.3:0/2553663046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56512c4ea760 0x56512c4fd3f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc005940 tx=0x7fd7dc005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84756aca5f988fcd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:50.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.406+0000 7fd7ce000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:21:50.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.406+0000 7fd7ce000640 1 -- 172.21.15.3:0/2553663046 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc035040 con 0x56512c4ea760 2024-09-19T06:21:50.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.407+0000 7fd7f20d9740 1 -- 172.21.15.3:0/2553663046 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7dc004230 con 0x56512c4ea760 2024-09-19T06:21:50.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.407+0000 7fd7ce000640 1 -- 172.21.15.3:0/2553663046 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7fd7dc003e90 con 0x56512c4ea760 2024-09-19T06:21:50.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.407+0000 7fd7ce000640 1 -- 172.21.15.3:0/2553663046 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd7dc06a050 con 0x56512c4ea760 2024-09-19T06:21:50.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.407+0000 7fd7f20d9740 10 client.28016 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:50.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.407+0000 7fd7f20d9740 1 -- 172.21.15.3:0/2553663046 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56512c56fd30 con 0x56512c4ea760 2024-09-19T06:21:50.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.407+0000 7fd7ce000640 1 -- 172.21.15.3:0/2553663046 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7dc004230 con 0x56512c4ea760 2024-09-19T06:21:50.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.407+0000 7fd7ce000640 1 -- 172.21.15.3:0/2553663046 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd7dc05ba10 con 0x56512c4ea760 2024-09-19T06:21:50.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.408+0000 7fd7f20d9740 10 client.28016 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:50.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.408+0000 7fd7f20d9740 10 client.28016 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:21:50.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.408+0000 7fd7f20d9740 20 client.28016 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:50.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.408+0000 7fd7f20d9740 1 --2- 172.21.15.3:0/2553663046 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56512c56ff60 0x56512c572350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:50.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.408+0000 7fd7f20d9740 4 client.28016 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:50.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.408+0000 7fd7f20d9740 1 -- 172.21.15.3:0/2553663046 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56512c457e60 con 0x56512c56ff60 2024-09-19T06:21:50.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.408+0000 7fd7e7e00640 1 --2- 172.21.15.3:0/2553663046 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56512c56ff60 0x56512c572350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:50.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.408+0000 7fd7e7e00640 1 --2- 172.21.15.3:0/2553663046 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56512c56ff60 0x56512c572350 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=32e96821a7c1f5b4 server_cookie=93e27f7ca6b7f2b9 in_seq=0 out_seq=0 2024-09-19T06:21:50.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.408+0000 7fd7ce000640 10 client.28016 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:21:50.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.409+0000 7fd7ce000640 1 -- 172.21.15.3:0/2553663046 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56512c457e60 con 0x56512c56ff60 2024-09-19T06:21:50.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.409+0000 7fd7ce000640 10 client.28016 handle_command_reply: tid=0 2024-09-19T06:21:50.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.409+0000 7fd7f20d9740 1 client.28016 shutdown 2024-09-19T06:21:50.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.409+0000 7fd7f20d9740 1 -- 172.21.15.3:0/2553663046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56512c4ea760 msgr2=0x56512c4fd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:50.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.409+0000 7fd7f20d9740 1 --2- 172.21.15.3:0/2553663046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56512c4ea760 0x56512c4fd3f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc005940 tx=0x7fd7dc005e80 comp rx=0 tx=0).stop 2024-09-19T06:21:50.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.409+0000 7fd7f20d9740 1 -- 172.21.15.3:0/2553663046 shutdown_connections 2024-09-19T06:21:50.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.409+0000 7fd7f20d9740 1 --2- 172.21.15.3:0/2553663046 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x56512c56ff60 0x56512c572350 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.409+0000 7fd7f20d9740 1 --2- 172.21.15.3:0/2553663046 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56512c4f6070 0x56512c4f64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.409+0000 7fd7f20d9740 1 --2- 172.21.15.3:0/2553663046 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56512c4f5020 0x56512c4f5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.409+0000 7fd7f20d9740 1 --2- 172.21.15.3:0/2553663046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56512c4ea760 0x56512c4fd3f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.409+0000 7fd7f20d9740 1 -- 172.21.15.3:0/2553663046 >> 172.21.15.3:0/2553663046 conn(0x56512c4e63d0 msgr2=0x56512c4f1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:50.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.409+0000 7fd7ce000640 0 client.28016 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:21:50.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.409+0000 7fd7f20d9740 1 -- 172.21.15.3:0/2553663046 shutdown_connections 2024-09-19T06:21:50.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.409+0000 7fd7f20d9740 1 -- 172.21.15.3:0/2553663046 wait complete. 2024-09-19T06:21:50.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.409+0000 7fd7f20d9740 20 client.28016 trim_cache size 0 max 16384 2024-09-19T06:21:50.414 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:21:50.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.410+0000 7fd7ee000640 1 -- 172.21.15.3:0/2174809824 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd7d00a33b0 msgr2=0x7fd7d00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:50.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.410+0000 7fd7ee000640 1 --2- 172.21.15.3:0/2174809824 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd7d00a33b0 0x7fd7d00a5870 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0005f40 tx=0x7fd7e00096a0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.410+0000 7fd7ee000640 1 -- 172.21.15.3:0/2174809824 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7e8102360 msgr2=0x7fd7e8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:50.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.410+0000 7fd7ee000640 1 --2- 172.21.15.3:0/2174809824 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7e8102360 0x7fd7e8074a30 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400d950 tx=0x7fd7d400de10 comp rx=0 tx=0).stop 2024-09-19T06:21:50.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.410+0000 7fd7ee000640 1 -- 172.21.15.3:0/2174809824 shutdown_connections 2024-09-19T06:21:50.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.410+0000 7fd7ee000640 1 --2- 172.21.15.3:0/2174809824 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd7d00a33b0 0x7fd7d00a5870 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.410+0000 7fd7ee000640 1 --2- 172.21.15.3:0/2174809824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7e81079c0 0x7fd7e8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.410+0000 7fd7ee000640 1 --2- 172.21.15.3:0/2174809824 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd7e8102360 0x7fd7e8074a30 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.410+0000 7fd7ee000640 1 --2- 172.21.15.3:0/2174809824 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd7e81019c0 0x7fd7e80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:50.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.410+0000 7fd7ee000640 1 -- 172.21.15.3:0/2174809824 >> 172.21.15.3:0/2174809824 conn(0x7fd7e80fd6e0 msgr2=0x7fd7e80fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:50.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.410+0000 7fd7ee000640 1 -- 172.21.15.3:0/2174809824 shutdown_connections 2024-09-19T06:21:50.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:50.410+0000 7fd7ee000640 1 -- 172.21.15.3:0/2174809824 wait complete. 2024-09-19T06:21:50.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:50 smithi059 ceph-mon[35138]: pgmap v292: 97 pgs: 97 active+clean; 2.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 61 KiB/s wr, 22 op/s 2024-09-19T06:21:50.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:50 smithi003 ceph-mon[30893]: pgmap v292: 97 pgs: 97 active+clean; 2.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 61 KiB/s wr, 22 op/s 2024-09-19T06:21:50.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:50 smithi071 ceph-mon[35662]: pgmap v292: 97 pgs: 97 active+clean; 2.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 61 KiB/s wr, 22 op/s 2024-09-19T06:21:51.209 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:21:51.591 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:52.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.181+0000 7f307d000640 1 -- 172.21.15.3:0/2773682499 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3078106f20 msgr2=0x7f307810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.181+0000 7f307d000640 1 --2- 172.21.15.3:0/2773682499 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3078106f20 0x7f307810eaa0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f3070009ca0 tx=0x7f307002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.181+0000 7f307d000640 1 -- 172.21.15.3:0/2773682499 shutdown_connections 2024-09-19T06:21:52.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.181+0000 7f307d000640 1 --2- 172.21.15.3:0/2773682499 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3078106f20 0x7f307810eaa0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.181+0000 7f307d000640 1 --2- 172.21.15.3:0/2773682499 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30781027a0 0x7f30781067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.181+0000 7f307d000640 1 --2- 172.21.15.3:0/2773682499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3078101df0 0x7f30781021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.181+0000 7f307d000640 1 -- 172.21.15.3:0/2773682499 >> 172.21.15.3:0/2773682499 conn(0x7f30780fd8b0 msgr2=0x7f30780ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:52.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.181+0000 7f307d000640 1 -- 172.21.15.3:0/2773682499 shutdown_connections 2024-09-19T06:21:52.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.181+0000 7f307d000640 1 -- 172.21.15.3:0/2773682499 wait complete. 2024-09-19T06:21:52.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.182+0000 7f307d000640 1 Processor -- start 2024-09-19T06:21:52.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.183+0000 7f307d000640 1 -- start start 2024-09-19T06:21:52.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.183+0000 7f307d000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3078101df0 0x7f307819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.183+0000 7f307d000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30781027a0 0x7f307819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.183+0000 7f307d000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3078106f20 0x7f307819ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.183+0000 7f307d000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3078111f80 con 0x7f3078106f20 2024-09-19T06:21:52.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.183+0000 7f307d000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3078111e00 con 0x7f3078101df0 2024-09-19T06:21:52.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.183+0000 7f307d000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3078112100 con 0x7f30781027a0 2024-09-19T06:21:52.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.183+0000 7f3076800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3078106f20 0x7f307819ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.183+0000 7f306fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30781027a0 0x7f307819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.183+0000 7f3075e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3078101df0 0x7f307819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.183+0000 7f306fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30781027a0 0x7f307819aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:58384/0 (socket says 172.21.15.3:58384) 2024-09-19T06:21:52.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.183+0000 7f306fe00640 1 -- 172.21.15.3:0/4272504820 learned_addr learned my addr 172.21.15.3:0/4272504820 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:52.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.183+0000 7f3075e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3078101df0 0x7f307819a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40988/0 (socket says 172.21.15.3:40988) 2024-09-19T06:21:52.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.184+0000 7f3076800640 1 -- 172.21.15.3:0/4272504820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30781027a0 msgr2=0x7f307819aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.184+0000 7f3076800640 1 --2- 172.21.15.3:0/4272504820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30781027a0 0x7f307819aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.184+0000 7f3076800640 1 -- 172.21.15.3:0/4272504820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3078101df0 msgr2=0x7f307819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.184+0000 7f3076800640 1 --2- 172.21.15.3:0/4272504820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3078101df0 0x7f307819a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.184+0000 7f3076800640 1 -- 172.21.15.3:0/4272504820 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307819f560 con 0x7f3078106f20 2024-09-19T06:21:52.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.184+0000 7f306fe00640 1 --2- 172.21.15.3:0/4272504820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30781027a0 0x7f307819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:52.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.184+0000 7f3076800640 1 --2- 172.21.15.3:0/4272504820 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3078106f20 0x7f307819ee80 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f307002ade0 tx=0x7f30700319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:52.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.185+0000 7f306ea00640 1 -- 172.21.15.3:0/4272504820 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3070003c30 con 0x7f3078106f20 2024-09-19T06:21:52.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.185+0000 7f307d000640 1 -- 172.21.15.3:0/4272504820 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f307819f7f0 con 0x7f3078106f20 2024-09-19T06:21:52.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.185+0000 7f306ea00640 1 -- 172.21.15.3:0/4272504820 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3070003dd0 con 0x7f3078106f20 2024-09-19T06:21:52.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.185+0000 7f307d000640 1 -- 172.21.15.3:0/4272504820 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30781a7130 con 0x7f3078106f20 2024-09-19T06:21:52.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.185+0000 7f306ea00640 1 -- 172.21.15.3:0/4272504820 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307002fcc0 con 0x7f3078106f20 2024-09-19T06:21:52.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.188+0000 7f306ea00640 1 -- 172.21.15.3:0/4272504820 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f3070004050 con 0x7f3078106f20 2024-09-19T06:21:52.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.188+0000 7f307fc01740 1 Processor -- start 2024-09-19T06:21:52.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.188+0000 7f307fc01740 1 -- start start 2024-09-19T06:21:52.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.189+0000 7f307fc01740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b16fda9c70 0x55b16fdaa050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.189+0000 7f307fc01740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b16fdaa590 0x55b16fdb4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.189+0000 7f307fc01740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b16fdb4e50 0x55b16fdb7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.189+0000 7f307fc01740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b16fd103e0 con 0x55b16fdb4e50 2024-09-19T06:21:52.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.189+0000 7f307fc01740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b16fcb7d80 con 0x55b16fdaa590 2024-09-19T06:21:52.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.189+0000 7f307fc01740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b16fd0c3a0 con 0x55b16fda9c70 2024-09-19T06:21:52.192 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.189+0000 7f306fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b16fdb4e50 0x55b16fdb7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.192 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.189+0000 7f3075e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b16fdaa590 0x55b16fdb4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.192 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.189+0000 7f306fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b16fda9c70 0x55b16fdaa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.189+0000 7f3075e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b16fdaa590 0x55b16fdb4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:40990/0 (socket says 172.21.15.3:40990) 2024-09-19T06:21:52.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.189+0000 7f3075e00640 1 -- 172.21.15.3:0/4188357910 learned_addr learned my addr 172.21.15.3:0/4188357910 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:52.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.190+0000 7f3075e00640 1 -- 172.21.15.3:0/4188357910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b16fda9c70 msgr2=0x55b16fdaa050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:52.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.190+0000 7f3075e00640 1 --2- 172.21.15.3:0/4188357910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b16fda9c70 0x55b16fdaa050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.190+0000 7f3075e00640 1 -- 172.21.15.3:0/4188357910 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b16fdb4e50 msgr2=0x55b16fdb7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:52.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.190+0000 7f3075e00640 1 --2- 172.21.15.3:0/4188357910 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b16fdb4e50 0x55b16fdb7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.190+0000 7f3075e00640 1 -- 172.21.15.3:0/4188357910 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b16fcd6ae0 con 0x55b16fdaa590 2024-09-19T06:21:52.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.190+0000 7f306ea00640 1 --2- 172.21.15.3:0/4272504820 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f305c0a33b0 0x7f305c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.190+0000 7f3075e00640 1 --2- 172.21.15.3:0/4188357910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b16fdaa590 0x55b16fdb4910 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f306800bcd0 tx=0x7f30680107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88c276668acf04f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:52.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.190+0000 7f306ea00640 1 -- 172.21.15.3:0/4272504820 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f30700f0ec0 con 0x7f3078106f20 2024-09-19T06:21:52.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.190+0000 7f306fe00640 1 --2- 172.21.15.3:0/4272504820 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f305c0a33b0 0x7f305c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.191+0000 7f3067400640 1 -- 172.21.15.3:0/4188357910 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3068005220 con 0x55b16fdaa590 2024-09-19T06:21:52.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.191+0000 7f3067400640 1 -- 172.21.15.3:0/4188357910 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3068004c80 con 0x55b16fdaa590 2024-09-19T06:21:52.194 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.191+0000 7f3067400640 1 -- 172.21.15.3:0/4188357910 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30680117c0 con 0x55b16fdaa590 2024-09-19T06:21:52.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.191+0000 7f307fc01740 1 -- 172.21.15.3:0/4188357910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b16fdaa590 msgr2=0x55b16fdb4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.191+0000 7f307fc01740 1 --2- 172.21.15.3:0/4188357910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b16fdaa590 0x55b16fdb4910 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f306800bcd0 tx=0x7f30680107a0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.191+0000 7f306fe00640 1 --2- 172.21.15.3:0/4272504820 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f305c0a33b0 0x7f305c0a5870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55b16fda7580 tx=0x7f3060004730 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:52.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.191+0000 7f307fc01740 1 -- 172.21.15.3:0/4188357910 shutdown_connections 2024-09-19T06:21:52.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.191+0000 7f307fc01740 1 --2- 172.21.15.3:0/4188357910 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b16fdb4e50 0x55b16fdb7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.191+0000 7f307fc01740 1 --2- 172.21.15.3:0/4188357910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b16fdaa590 0x55b16fdb4910 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.191+0000 7f307fc01740 1 --2- 172.21.15.3:0/4188357910 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b16fda9c70 0x55b16fdaa050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.191+0000 7f307fc01740 1 -- 172.21.15.3:0/4188357910 >> 172.21.15.3:0/4188357910 conn(0x55b16fda6200 msgr2=0x55b16fda65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:52.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.192+0000 7f307fc01740 1 -- 172.21.15.3:0/4188357910 shutdown_connections 2024-09-19T06:21:52.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.192+0000 7f307fc01740 1 -- 172.21.15.3:0/4188357910 wait complete. 2024-09-19T06:21:52.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.192+0000 7f307fc01740 1 -- start start 2024-09-19T06:21:52.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.192+0000 7f307fc01740 1 Processor -- start 2024-09-19T06:21:52.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.193+0000 7f307fc01740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b16fda9c70 0x55b16fdb1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.193+0000 7f307fc01740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b16fdaa590 0x55b16fdb22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.193+0000 7f307fc01740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b16fdb4e50 0x55b16fdb2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.193+0000 7f307fc01740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b16fdb7a20 con 0x55b16fdb4e50 2024-09-19T06:21:52.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.193+0000 7f307fc01740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b16fccb0f0 con 0x55b16fda9c70 2024-09-19T06:21:52.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.193+0000 7f307fc01740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b16fdb7ba0 con 0x55b16fdaa590 2024-09-19T06:21:52.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.193+0000 7f307fc01740 10 client.0 _ll_register_callbacks cb 0x55b16fcb2bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:52.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.193+0000 7f3076800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b16fdb4e50 0x55b16fdb2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.193+0000 7f3076800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b16fdb4e50 0x55b16fdb2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33334/0 (socket says 172.21.15.3:33334) 2024-09-19T06:21:52.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.193+0000 7f3076800640 1 -- 172.21.15.3:0/2070133060 learned_addr learned my addr 172.21.15.3:0/2070133060 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:52.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.193+0000 7f306fe00640 1 --2- 172.21.15.3:0/2070133060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b16fdaa590 0x55b16fdb22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.193+0000 7f3075e00640 1 --2- 172.21.15.3:0/2070133060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b16fda9c70 0x55b16fdb1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.194+0000 7f3076800640 1 -- 172.21.15.3:0/2070133060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b16fdaa590 msgr2=0x55b16fdb22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:52.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.194+0000 7f3076800640 1 --2- 172.21.15.3:0/2070133060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b16fdaa590 0x55b16fdb22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.194+0000 7f3076800640 1 -- 172.21.15.3:0/2070133060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b16fda9c70 msgr2=0x55b16fdb1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:52.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.194+0000 7f3076800640 1 --2- 172.21.15.3:0/2070133060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b16fda9c70 0x55b16fdb1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.194+0000 7f3076800640 1 -- 172.21.15.3:0/2070133060 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b16fa813c0 con 0x55b16fdb4e50 2024-09-19T06:21:52.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.194+0000 7f3076800640 1 --2- 172.21.15.3:0/2070133060 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b16fdb4e50 0x55b16fdb2810 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f30700bcfb0 tx=0x7f30700bcee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da3172365fe3797 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:52.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.194+0000 7f305be00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:21:52.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.194+0000 7f305be00640 1 -- 172.21.15.3:0/2070133060 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30700dbe60 con 0x55b16fdb4e50 2024-09-19T06:21:52.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.194+0000 7f307fc01740 1 -- 172.21.15.3:0/2070133060 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3068004c80 con 0x55b16fdb4e50 2024-09-19T06:21:52.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.194+0000 7f305be00640 1 -- 172.21.15.3:0/2070133060 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f30700b9920 con 0x55b16fdb4e50 2024-09-19T06:21:52.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.195+0000 7f305be00640 1 -- 172.21.15.3:0/2070133060 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f30700bd9b0 con 0x55b16fdb4e50 2024-09-19T06:21:52.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.195+0000 7f307fc01740 10 client.17997 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:52.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.195+0000 7f307fc01740 1 -- 172.21.15.3:0/2070133060 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b16fdb7a20 con 0x55b16fdb4e50 2024-09-19T06:21:52.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.195+0000 7f305be00640 1 -- 172.21.15.3:0/2070133060 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3068004c80 con 0x55b16fdb4e50 2024-09-19T06:21:52.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.195+0000 7f305be00640 1 -- 172.21.15.3:0/2070133060 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f30700dd0c0 con 0x55b16fdb4e50 2024-09-19T06:21:52.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.195+0000 7f307fc01740 10 client.17997 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:52.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.195+0000 7f307fc01740 10 client.17997 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:52.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.195+0000 7f307fc01740 20 client.17997 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:52.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.195+0000 7f307fc01740 1 --2- 172.21.15.3:0/2070133060 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b16fdc4e30 0x55b16fdc7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.196+0000 7f307fc01740 4 client.17997 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:52.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.196+0000 7f307fc01740 1 -- 172.21.15.3:0/2070133060 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b16fd1d950 con 0x55b16fdc4e30 2024-09-19T06:21:52.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.196+0000 7f3075e00640 1 --2- 172.21.15.3:0/2070133060 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b16fdc4e30 0x55b16fdc7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.197+0000 7f3075e00640 1 --2- 172.21.15.3:0/2070133060 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b16fdc4e30 0x55b16fdc7280 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cc4954d893b88b7 server_cookie=7391f015160be3dc in_seq=0 out_seq=0 2024-09-19T06:21:52.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.197+0000 7f305be00640 10 client.17997 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:52.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.197+0000 7f305be00640 1 -- 172.21.15.3:0/2070133060 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b16fd1d950 con 0x55b16fdc4e30 2024-09-19T06:21:52.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.197+0000 7f305be00640 10 client.17997 handle_command_reply: tid=0 2024-09-19T06:21:52.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.197+0000 7f307fc01740 1 client.17997 shutdown 2024-09-19T06:21:52.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.198+0000 7f307fc01740 1 -- 172.21.15.3:0/2070133060 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b16fdb4e50 msgr2=0x55b16fdb2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.198+0000 7f307fc01740 1 --2- 172.21.15.3:0/2070133060 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b16fdb4e50 0x55b16fdb2810 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f30700bcfb0 tx=0x7f30700bcee0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.198+0000 7f307fc01740 1 -- 172.21.15.3:0/2070133060 shutdown_connections 2024-09-19T06:21:52.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.198+0000 7f307fc01740 1 --2- 172.21.15.3:0/2070133060 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b16fdc4e30 0x55b16fdc7280 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.198+0000 7f307fc01740 1 --2- 172.21.15.3:0/2070133060 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b16fdb4e50 0x55b16fdb2810 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.198+0000 7f307fc01740 1 --2- 172.21.15.3:0/2070133060 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b16fdaa590 0x55b16fdb22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.198+0000 7f307fc01740 1 --2- 172.21.15.3:0/2070133060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b16fda9c70 0x55b16fdb1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.198+0000 7f307fc01740 1 -- 172.21.15.3:0/2070133060 >> 172.21.15.3:0/2070133060 conn(0x55b16fda6200 msgr2=0x55b16fdabee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:52.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.198+0000 7f305be00640 0 client.17997 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:52.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.198+0000 7f307fc01740 1 -- 172.21.15.3:0/2070133060 shutdown_connections 2024-09-19T06:21:52.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.198+0000 7f307fc01740 1 -- 172.21.15.3:0/2070133060 wait complete. 2024-09-19T06:21:52.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.198+0000 7f307fc01740 20 client.17997 trim_cache size 0 max 16384 2024-09-19T06:21:52.214 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.212+0000 7f7eea400640 1 -- 172.21.15.3:0/1069087872 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ee41022d0 msgr2=0x7f7ee410e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.214 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.212+0000 7f7eea400640 1 --2- 172.21.15.3:0/1069087872 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ee41022d0 0x7f7ee410e800 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009cd0 tx=0x7f7edc02a8e0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.214 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.212+0000 7f7eea400640 1 -- 172.21.15.3:0/1069087872 shutdown_connections 2024-09-19T06:21:52.215 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.212+0000 7f7eea400640 1 --2- 172.21.15.3:0/1069087872 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ee41022d0 0x7f7ee410e800 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.215 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.212+0000 7f7eea400640 1 --2- 172.21.15.3:0/1069087872 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ee4101930 0x7f7ee4101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.215 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.212+0000 7f7eea400640 1 --2- 172.21.15.3:0/1069087872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ee4107940 0x7f7ee4107d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.215 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.212+0000 7f7eea400640 1 -- 172.21.15.3:0/1069087872 >> 172.21.15.3:0/1069087872 conn(0x7f7ee40fd630 msgr2=0x7f7ee40ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:52.215 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.213+0000 7f7eea400640 1 -- 172.21.15.3:0/1069087872 shutdown_connections 2024-09-19T06:21:52.215 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.213+0000 7f7eea400640 1 -- 172.21.15.3:0/1069087872 wait complete. 2024-09-19T06:21:52.216 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.214+0000 7f7eea400640 1 Processor -- start 2024-09-19T06:21:52.216 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.214+0000 7f7eea400640 1 -- start start 2024-09-19T06:21:52.217 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.214+0000 7f7eea400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ee4101930 0x7f7ee419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.217 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.214+0000 7f7eea400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ee41022d0 0x7f7ee419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.217 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.214+0000 7f7eea400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ee4107940 0x7f7ee419ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.217 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.214+0000 7f7eea400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee4111dd0 con 0x7f7ee4107940 2024-09-19T06:21:52.217 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.214+0000 7f7eea400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee4111c50 con 0x7f7ee41022d0 2024-09-19T06:21:52.217 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.214+0000 7f7eea400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee4111f50 con 0x7f7ee4101930 2024-09-19T06:21:52.217 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.214+0000 7f7ee9000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ee4101930 0x7f7ee419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.217 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.214+0000 7f7ee9000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ee4101930 0x7f7ee419a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:58430/0 (socket says 172.21.15.3:58430) 2024-09-19T06:21:52.217 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.214+0000 7f7ee9000640 1 -- 172.21.15.3:0/952904025 learned_addr learned my addr 172.21.15.3:0/952904025 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:52.217 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.215+0000 7f7ee3e00640 1 --2- 172.21.15.3:0/952904025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ee41022d0 0x7f7ee419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.217 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.215+0000 7f7ee9a00640 1 --2- 172.21.15.3:0/952904025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ee4107940 0x7f7ee419ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.217 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.215+0000 7f7ee9000640 1 -- 172.21.15.3:0/952904025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ee41022d0 msgr2=0x7f7ee419a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.217 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.215+0000 7f7ee9000640 1 --2- 172.21.15.3:0/952904025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ee41022d0 0x7f7ee419a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.218 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.215+0000 7f7ee9000640 1 -- 172.21.15.3:0/952904025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ee4107940 msgr2=0x7f7ee419ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.218 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.215+0000 7f7ee9000640 1 --2- 172.21.15.3:0/952904025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ee4107940 0x7f7ee419ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.218 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.215+0000 7f7ee9000640 1 -- 172.21.15.3:0/952904025 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee419f460 con 0x7f7ee4101930 2024-09-19T06:21:52.218 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.215+0000 7f7ee9a00640 1 --2- 172.21.15.3:0/952904025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ee4107940 0x7f7ee419ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:52.218 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.215+0000 7f7ee9000640 1 --2- 172.21.15.3:0/952904025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ee4101930 0x7f7ee419a470 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7ed800e9f0 tx=0x7f7ed800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:52.219 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.215+0000 7f7ee1600640 1 -- 172.21.15.3:0/952904025 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed800cd80 con 0x7f7ee4101930 2024-09-19T06:21:52.219 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.215+0000 7f7ee1600640 1 -- 172.21.15.3:0/952904025 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ed8010910 con 0x7f7ee4101930 2024-09-19T06:21:52.219 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.215+0000 7f7ee1600640 1 -- 172.21.15.3:0/952904025 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8018990 con 0x7f7ee4101930 2024-09-19T06:21:52.219 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.215+0000 7f7eea400640 1 -- 172.21.15.3:0/952904025 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ee419f750 con 0x7f7ee4101930 2024-09-19T06:21:52.219 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.216+0000 7f7eea400640 1 -- 172.21.15.3:0/952904025 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ee41a6fe0 con 0x7f7ee4101930 2024-09-19T06:21:52.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.217+0000 7f307fc01740 1 Processor -- start 2024-09-19T06:21:52.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.218+0000 7f307fc01740 1 -- start start 2024-09-19T06:21:52.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.218+0000 7f307fc01740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b16fda9c70 0x55b16fdac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.218+0000 7f307fc01740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b16fdaa590 0x55b16fdccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.218+0000 7f307fc01740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b16fdb4e50 0x55b16fdcd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.218+0000 7f307fc01740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f30781afb90 con 0x55b16fdaa590 2024-09-19T06:21:52.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.218+0000 7f307fc01740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f30781b16d0 con 0x55b16fda9c70 2024-09-19T06:21:52.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.218+0000 7f307fc01740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f30781b0260 con 0x55b16fdb4e50 2024-09-19T06:21:52.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.218+0000 7f306fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b16fdaa590 0x55b16fdccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.218+0000 7f3076800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b16fdb4e50 0x55b16fdcd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.218+0000 7f3075e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b16fda9c70 0x55b16fdac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.218+0000 7f3076800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b16fdb4e50 0x55b16fdcd0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:58446/0 (socket says 172.21.15.3:58446) 2024-09-19T06:21:52.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.218+0000 7f3076800640 1 -- 172.21.15.3:0/3266481734 learned_addr learned my addr 172.21.15.3:0/3266481734 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:52.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.219+0000 7f3076800640 1 -- 172.21.15.3:0/3266481734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b16fda9c70 msgr2=0x55b16fdac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:52.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.219+0000 7f3076800640 1 --2- 172.21.15.3:0/3266481734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b16fda9c70 0x55b16fdac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.219+0000 7f3076800640 1 -- 172.21.15.3:0/3266481734 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b16fdaa590 msgr2=0x55b16fdccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:52.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.219+0000 7f3076800640 1 --2- 172.21.15.3:0/3266481734 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b16fdaa590 0x55b16fdccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.219+0000 7f3076800640 1 -- 172.21.15.3:0/3266481734 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b16fda1770 con 0x55b16fdb4e50 2024-09-19T06:21:52.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.219+0000 7f306fe00640 1 --2- 172.21.15.3:0/3266481734 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b16fdaa590 0x55b16fdccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:52.222 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.219+0000 7f7eee800740 1 Processor -- start 2024-09-19T06:21:52.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.219+0000 7f3076800640 1 --2- 172.21.15.3:0/3266481734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b16fdb4e50 0x55b16fdcd0d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f30700c5960 tx=0x7f30700bb7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=770e8f415d85afcd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:52.222 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.219+0000 7f7eee800740 1 -- start start 2024-09-19T06:21:52.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.219+0000 7f3066a00640 1 -- 172.21.15.3:0/3266481734 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30700dbe60 con 0x55b16fdb4e50 2024-09-19T06:21:52.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.219+0000 7f3066a00640 1 -- 172.21.15.3:0/3266481734 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3070036030 con 0x55b16fdb4e50 2024-09-19T06:21:52.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.219+0000 7f3066a00640 1 -- 172.21.15.3:0/3266481734 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30700c1660 con 0x55b16fdb4e50 2024-09-19T06:21:52.224 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.220+0000 7f7eee800740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b944353b0 0x556b94435790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.224 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.220+0000 7f7eee800740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b94435cd0 0x556b94440030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.224 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.220+0000 7f7eee800740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b94440570 0x556b94442960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.224 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.220+0000 7f7eee800740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556b9439b100 con 0x556b94440570 2024-09-19T06:21:52.224 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.220+0000 7f7eee800740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556b943431b0 con 0x556b944353b0 2024-09-19T06:21:52.224 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.220+0000 7f7eee800740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556b943970c0 con 0x556b94435cd0 2024-09-19T06:21:52.224 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.220+0000 7f7ee1600640 1 -- 172.21.15.3:0/952904025 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f7ed8010ac0 con 0x7f7ee4101930 2024-09-19T06:21:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.220+0000 7f7ee3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b94440570 0x556b94442960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.220+0000 7f7ee9a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b944353b0 0x556b94435790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.220+0000 7f7ee3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b94440570 0x556b94442960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33360/0 (socket says 172.21.15.3:33360) 2024-09-19T06:21:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.220+0000 7f7ee3e00640 1 -- 172.21.15.3:0/2975226505 learned_addr learned my addr 172.21.15.3:0/2975226505 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.220+0000 7f7ee9000640 1 --2- 172.21.15.3:0/2975226505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b94435cd0 0x556b94440030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.220+0000 7f7ee3e00640 1 -- 172.21.15.3:0/2975226505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b94435cd0 msgr2=0x556b94440030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.220+0000 7f7ee3e00640 1 --2- 172.21.15.3:0/2975226505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b94435cd0 0x556b94440030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.220+0000 7f7ee3e00640 1 -- 172.21.15.3:0/2975226505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b944353b0 msgr2=0x556b94435790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.221+0000 7f7ee3e00640 1 --2- 172.21.15.3:0/2975226505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b944353b0 0x556b94435790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.221+0000 7f7ee3e00640 1 -- 172.21.15.3:0/2975226505 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b940ae210 con 0x556b94440570 2024-09-19T06:21:52.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.220+0000 7f307fc01740 1 -- 172.21.15.3:0/3266481734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b16fdb4e50 msgr2=0x55b16fdcd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.220+0000 7f307fc01740 1 --2- 172.21.15.3:0/3266481734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b16fdb4e50 0x55b16fdcd0d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f30700c5960 tx=0x7f30700bb7c0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.220+0000 7f307fc01740 1 -- 172.21.15.3:0/3266481734 shutdown_connections 2024-09-19T06:21:52.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.220+0000 7f307fc01740 1 --2- 172.21.15.3:0/3266481734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b16fdb4e50 0x55b16fdcd0d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.220+0000 7f307fc01740 1 --2- 172.21.15.3:0/3266481734 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b16fdaa590 0x55b16fdccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.220+0000 7f307fc01740 1 --2- 172.21.15.3:0/3266481734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b16fda9c70 0x55b16fdac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.220+0000 7f307fc01740 1 -- 172.21.15.3:0/3266481734 >> 172.21.15.3:0/3266481734 conn(0x55b16fda6200 msgr2=0x55b16fdb3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:52.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.221+0000 7f307fc01740 1 -- 172.21.15.3:0/3266481734 shutdown_connections 2024-09-19T06:21:52.226 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.221+0000 7f7ee3e00640 1 --2- 172.21.15.3:0/2975226505 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b94440570 0x556b94442960 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0009ca0 tx=0x7f7ed0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d531b3d90f6972e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:52.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.221+0000 7f307fc01740 1 -- 172.21.15.3:0/3266481734 wait complete. 2024-09-19T06:21:52.227 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.221+0000 7f7ed6000640 1 -- 172.21.15.3:0/2975226505 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed001e070 con 0x556b94440570 2024-09-19T06:21:52.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.221+0000 7f307fc01740 1 -- start start 2024-09-19T06:21:52.228 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.221+0000 7f7ed6000640 1 -- 172.21.15.3:0/2975226505 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ed0019b10 con 0x556b94440570 2024-09-19T06:21:52.228 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.222+0000 7f7ed6000640 1 -- 172.21.15.3:0/2975226505 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed000ea80 con 0x556b94440570 2024-09-19T06:21:52.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.222+0000 7f307fc01740 1 Processor -- start 2024-09-19T06:21:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.222+0000 7f7ee1600640 1 --2- 172.21.15.3:0/952904025 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7ecc0a3420 0x7f7ecc0a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.222+0000 7f7ee1600640 1 -- 172.21.15.3:0/952904025 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f7ed80cffd0 con 0x7f7ee4101930 2024-09-19T06:21:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.222+0000 7f7ee9a00640 1 --2- 172.21.15.3:0/952904025 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7ecc0a3420 0x7f7ecc0a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.222+0000 7f7eee800740 1 -- 172.21.15.3:0/2975226505 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b94440570 msgr2=0x556b94442960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.222+0000 7f7eee800740 1 --2- 172.21.15.3:0/2975226505 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b94440570 0x556b94442960 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0009ca0 tx=0x7f7ed0011810 comp rx=0 tx=0).stop 2024-09-19T06:21:52.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.222+0000 7f307fc01740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b16fda9c70 0x55b16fdb8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.222+0000 7f307fc01740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b16fdaa590 0x55b16fdb8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.222+0000 7f307fc01740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b16fdb4e50 0x55b16fdb9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.222+0000 7f307fc01740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f30781b1000 con 0x55b16fda9c70 2024-09-19T06:21:52.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.222+0000 7f307fc01740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f30781b0930 con 0x55b16fdaa590 2024-09-19T06:21:52.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.222+0000 7f307fc01740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f30781adb90 con 0x55b16fdb4e50 2024-09-19T06:21:52.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.222+0000 7f307fc01740 10 client.0 _ll_register_callbacks cb 0x7f3070009bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:52.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.223+0000 7f306fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b16fdaa590 0x55b16fdb8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.223+0000 7f306fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b16fdaa590 0x55b16fdb8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:41050/0 (socket says 172.21.15.3:41050) 2024-09-19T06:21:52.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.223+0000 7f306fe00640 1 -- 172.21.15.3:0/1614053607 learned_addr learned my addr 172.21.15.3:0/1614053607 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:52.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.223+0000 7f3076800640 1 --2- 172.21.15.3:0/1614053607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b16fdb4e50 0x55b16fdb9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.223+0000 7f3075e00640 1 --2- 172.21.15.3:0/1614053607 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b16fda9c70 0x55b16fdb8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.231 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.223+0000 7f7eee800740 1 -- 172.21.15.3:0/2975226505 shutdown_connections 2024-09-19T06:21:52.231 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.223+0000 7f7eee800740 1 --2- 172.21.15.3:0/2975226505 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b94440570 0x556b94442960 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.231 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.223+0000 7f7eee800740 1 --2- 172.21.15.3:0/2975226505 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b94435cd0 0x556b94440030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.231 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.223+0000 7f7eee800740 1 --2- 172.21.15.3:0/2975226505 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b944353b0 0x556b94435790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.231 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.223+0000 7f7eee800740 1 -- 172.21.15.3:0/2975226505 >> 172.21.15.3:0/2975226505 conn(0x556b94431920 msgr2=0x556b94431d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:52.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.223+0000 7f306fe00640 1 -- 172.21.15.3:0/1614053607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b16fdb4e50 msgr2=0x55b16fdb9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:52.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.223+0000 7f306fe00640 1 --2- 172.21.15.3:0/1614053607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b16fdb4e50 0x55b16fdb9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.223+0000 7f306fe00640 1 -- 172.21.15.3:0/1614053607 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b16fda9c70 msgr2=0x55b16fdb8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:52.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.223+0000 7f306fe00640 1 --2- 172.21.15.3:0/1614053607 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b16fda9c70 0x55b16fdb8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.223+0000 7f306fe00640 1 -- 172.21.15.3:0/1614053607 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b16fe2eb60 con 0x55b16fdaa590 2024-09-19T06:21:52.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.223+0000 7f3076800640 1 --2- 172.21.15.3:0/1614053607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b16fdb4e50 0x55b16fdb9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:52.232 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.223+0000 7f7eee800740 1 -- 172.21.15.3:0/2975226505 shutdown_connections 2024-09-19T06:21:52.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.223+0000 7f3075e00640 1 --2- 172.21.15.3:0/1614053607 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b16fda9c70 0x55b16fdb8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:52.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.224+0000 7f306fe00640 1 --2- 172.21.15.3:0/1614053607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b16fdaa590 0x55b16fdb8fc0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f306000bfd0 tx=0x7f30600046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7844ca11774b212b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:52.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.224+0000 7f305be00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:21:52.233 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.224+0000 7f7eee800740 1 -- 172.21.15.3:0/2975226505 wait complete. 2024-09-19T06:21:52.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.224+0000 7f305be00640 1 -- 172.21.15.3:0/1614053607 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3060021bb0 con 0x55b16fdaa590 2024-09-19T06:21:52.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.224+0000 7f305be00640 1 -- 172.21.15.3:0/1614053607 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f3060021d50 con 0x55b16fdaa590 2024-09-19T06:21:52.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.224+0000 7f307fc01740 1 -- 172.21.15.3:0/1614053607 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3070036030 con 0x55b16fdaa590 2024-09-19T06:21:52.234 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.224+0000 7f7ee9a00640 1 --2- 172.21.15.3:0/952904025 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7ecc0a3420 0x7f7ecc0a58e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7edc004af0 tx=0x7f7edc004a40 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:52.234 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.224+0000 7f7eee800740 1 -- start start 2024-09-19T06:21:52.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.224+0000 7f305be00640 1 -- 172.21.15.3:0/1614053607 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3060012020 con 0x55b16fdaa590 2024-09-19T06:21:52.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.224+0000 7f307fc01740 10 client.28043 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:52.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.224+0000 7f307fc01740 1 -- 172.21.15.3:0/1614053607 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b16fe2fdb0 con 0x55b16fdaa590 2024-09-19T06:21:52.235 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.225+0000 7f7eee800740 1 Processor -- start 2024-09-19T06:21:52.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.225+0000 7f305be00640 1 -- 172.21.15.3:0/1614053607 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3070036030 con 0x55b16fdaa590 2024-09-19T06:21:52.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.225+0000 7f305be00640 1 -- 172.21.15.3:0/1614053607 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3060011440 con 0x55b16fdaa590 2024-09-19T06:21:52.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.225+0000 7f307fc01740 10 client.28043 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:52.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.225+0000 7f307fc01740 10 client.28043 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:52.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.225+0000 7f307fc01740 20 client.28043 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:52.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.225+0000 7f307fc01740 1 --2- 172.21.15.3:0/1614053607 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b16fe30590 0x55b16fe329b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.236 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.225+0000 7f7eee800740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b944353b0 0x556b9443d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.236 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.225+0000 7f7eee800740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b94435cd0 0x556b9443daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.236 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.225+0000 7f7eee800740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b94440570 0x556b9443e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.225+0000 7f307fc01740 4 client.28043 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:21:52.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.225+0000 7f307fc01740 1 -- 172.21.15.3:0/1614053607 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b16fd17e60 con 0x55b16fe30590 2024-09-19T06:21:52.237 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.225+0000 7f7eee800740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x556b94442ff0 con 0x556b944353b0 2024-09-19T06:21:52.237 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.225+0000 7f7eee800740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x556b94324090 con 0x556b94440570 2024-09-19T06:21:52.237 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.225+0000 7f7eee800740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x556b94443170 con 0x556b94435cd0 2024-09-19T06:21:52.237 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.225+0000 7f7eee800740 10 client.0 _ll_register_callbacks cb 0x556b94378f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:52.237 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.225+0000 7f7ee9000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b944353b0 0x556b9443d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.237 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.226+0000 7f7ee9a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b94440570 0x556b9443e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.237 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.226+0000 7f7ee9000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b944353b0 0x556b9443d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33374/0 (socket says 172.21.15.3:33374) 2024-09-19T06:21:52.237 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.226+0000 7f7ee9000640 1 -- 172.21.15.3:0/1341082896 learned_addr learned my addr 172.21.15.3:0/1341082896 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:52.237 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.226+0000 7f7ee3e00640 1 --2- 172.21.15.3:0/1341082896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b94435cd0 0x556b9443daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.226+0000 7f3075e00640 1 --2- 172.21.15.3:0/1614053607 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b16fe30590 0x55b16fe329b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.226+0000 7f7ee9000640 1 -- 172.21.15.3:0/1341082896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b94435cd0 msgr2=0x556b9443daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.226+0000 7f7ee9000640 1 --2- 172.21.15.3:0/1341082896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b94435cd0 0x556b9443daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.226+0000 7f7ee9000640 1 -- 172.21.15.3:0/1341082896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b94440570 msgr2=0x556b9443e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.226+0000 7f7ee9000640 1 --2- 172.21.15.3:0/1341082896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b94440570 0x556b9443e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.226+0000 7f7ee9000640 1 -- 172.21.15.3:0/1341082896 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b9417a620 con 0x556b944353b0 2024-09-19T06:21:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.226+0000 7f7ee9000640 1 --2- 172.21.15.3:0/1341082896 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b944353b0 0x556b9443d5b0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7ed800e9c0 tx=0x7f7ed80d3710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45cd9bbc64228d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.226+0000 7f7ecaa00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:21:52.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.226+0000 7f3075e00640 1 --2- 172.21.15.3:0/1614053607 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b16fe30590 0x55b16fe329b0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=786b9a45df0e2e00 server_cookie=4c2418b07b12c938 in_seq=0 out_seq=0 2024-09-19T06:21:52.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.226+0000 7f305be00640 10 client.28043 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.227+0000 7f7ecaa00640 1 -- 172.21.15.3:0/1341082896 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed809bbe0 con 0x556b944353b0 2024-09-19T06:21:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.227+0000 7f7ecaa00640 1 -- 172.21.15.3:0/1341082896 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f7ed80988f0 con 0x556b944353b0 2024-09-19T06:21:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.227+0000 7f7eee800740 1 -- 172.21.15.3:0/1341082896 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ed0019b10 con 0x556b944353b0 2024-09-19T06:21:52.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.227+0000 7f305be00640 1 -- 172.21.15.3:0/1614053607 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b16fd17e60 con 0x55b16fe30590 2024-09-19T06:21:52.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.227+0000 7f305be00640 10 client.28043 handle_command_reply: tid=0 2024-09-19T06:21:52.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.227+0000 7f307fc01740 1 client.28043 shutdown 2024-09-19T06:21:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.227+0000 7f7ecaa00640 1 -- 172.21.15.3:0/1341082896 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7ed809c980 con 0x556b944353b0 2024-09-19T06:21:52.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.227+0000 7f307fc01740 1 -- 172.21.15.3:0/1614053607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b16fdaa590 msgr2=0x55b16fdb8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.227+0000 7f307fc01740 1 --2- 172.21.15.3:0/1614053607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b16fdaa590 0x55b16fdb8fc0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f306000bfd0 tx=0x7f30600046c0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.227+0000 7f307fc01740 1 -- 172.21.15.3:0/1614053607 shutdown_connections 2024-09-19T06:21:52.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.227+0000 7f307fc01740 1 --2- 172.21.15.3:0/1614053607 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55b16fe30590 0x55b16fe329b0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.227+0000 7f7eee800740 10 client.18015 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.227+0000 7f7eee800740 1 -- 172.21.15.3:0/1341082896 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556b94445d50 con 0x556b944353b0 2024-09-19T06:21:52.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.227+0000 7f307fc01740 1 --2- 172.21.15.3:0/1614053607 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b16fdb4e50 0x55b16fdb9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.227+0000 7f307fc01740 1 --2- 172.21.15.3:0/1614053607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b16fdaa590 0x55b16fdb8fc0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.227+0000 7f307fc01740 1 --2- 172.21.15.3:0/1614053607 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b16fda9c70 0x55b16fdb8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.227+0000 7f305be00640 0 client.28043 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:52.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.227+0000 7f307fc01740 1 -- 172.21.15.3:0/1614053607 >> 172.21.15.3:0/1614053607 conn(0x55b16fda6200 msgr2=0x55b16fda5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:52.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.227+0000 7f307fc01740 1 -- 172.21.15.3:0/1614053607 shutdown_connections 2024-09-19T06:21:52.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.228+0000 7f307fc01740 1 -- 172.21.15.3:0/1614053607 wait complete. 2024-09-19T06:21:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.228+0000 7f7ecaa00640 1 -- 172.21.15.3:0/1341082896 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ed0019b10 con 0x556b944353b0 2024-09-19T06:21:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.228+0000 7f7ecaa00640 1 -- 172.21.15.3:0/1341082896 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f7ed80d2160 con 0x556b944353b0 2024-09-19T06:21:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.228+0000 7f7eee800740 10 client.18015 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.228+0000 7f7eee800740 10 client.18015 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.228+0000 7f7eee800740 20 client.18015 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:52.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.228+0000 7f307fc01740 20 client.28043 trim_cache size 0 max 16384 2024-09-19T06:21:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.228+0000 7f7eee800740 1 --2- 172.21.15.3:0/1341082896 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x556b944471c0 0x556b94449630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.228+0000 7f7eee800740 4 client.18015 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.228+0000 7f7eee800740 1 -- 172.21.15.3:0/1341082896 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b943a8830 con 0x556b944471c0 2024-09-19T06:21:52.244 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:21:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.228+0000 7f7ee3e00640 1 --2- 172.21.15.3:0/1341082896 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x556b944471c0 0x556b94449630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.229+0000 7f307d000640 1 -- 172.21.15.3:0/4272504820 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f305c0a33b0 msgr2=0x7f305c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.229+0000 7f307d000640 1 --2- 172.21.15.3:0/4272504820 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f305c0a33b0 0x7f305c0a5870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55b16fda7580 tx=0x7f3060004730 comp rx=0 tx=0).stop 2024-09-19T06:21:52.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.229+0000 7f307d000640 1 -- 172.21.15.3:0/4272504820 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3078106f20 msgr2=0x7f307819ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.229+0000 7f307d000640 1 --2- 172.21.15.3:0/4272504820 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3078106f20 0x7f307819ee80 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f307002ade0 tx=0x7f30700319f0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.229+0000 7f307d000640 1 -- 172.21.15.3:0/4272504820 shutdown_connections 2024-09-19T06:21:52.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.229+0000 7f307d000640 1 --2- 172.21.15.3:0/4272504820 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f305c0a33b0 0x7f305c0a5870 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.229+0000 7f307d000640 1 --2- 172.21.15.3:0/4272504820 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3078106f20 0x7f307819ee80 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.229+0000 7f307d000640 1 --2- 172.21.15.3:0/4272504820 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f30781027a0 0x7f307819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.229+0000 7f307d000640 1 --2- 172.21.15.3:0/4272504820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3078101df0 0x7f307819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.229+0000 7f307d000640 1 -- 172.21.15.3:0/4272504820 >> 172.21.15.3:0/4272504820 conn(0x7f30780fd8b0 msgr2=0x7f30780fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:52.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.229+0000 7f307d000640 1 -- 172.21.15.3:0/4272504820 shutdown_connections 2024-09-19T06:21:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.229+0000 7f7ee3e00640 1 --2- 172.21.15.3:0/1341082896 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x556b944471c0 0x556b94449630 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fe1db7eaa9d8d32 server_cookie=dc52b23b011f288a in_seq=0 out_seq=0 2024-09-19T06:21:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.229+0000 7f7ecaa00640 10 client.18015 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:52.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:52.229+0000 7f307d000640 1 -- 172.21.15.3:0/4272504820 wait complete. 2024-09-19T06:21:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.230+0000 7f7ecaa00640 1 -- 172.21.15.3:0/1341082896 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556b943a8830 con 0x556b944471c0 2024-09-19T06:21:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.230+0000 7f7ecaa00640 10 client.18015 handle_command_reply: tid=0 2024-09-19T06:21:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.230+0000 7f7eee800740 1 client.18015 shutdown 2024-09-19T06:21:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.230+0000 7f7eee800740 1 -- 172.21.15.3:0/1341082896 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b944353b0 msgr2=0x556b9443d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.230+0000 7f7eee800740 1 --2- 172.21.15.3:0/1341082896 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b944353b0 0x556b9443d5b0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7ed800e9c0 tx=0x7f7ed80d3710 comp rx=0 tx=0).stop 2024-09-19T06:21:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.230+0000 7f7eee800740 1 -- 172.21.15.3:0/1341082896 shutdown_connections 2024-09-19T06:21:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.230+0000 7f7eee800740 1 --2- 172.21.15.3:0/1341082896 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x556b944471c0 0x556b94449630 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.230+0000 7f7eee800740 1 --2- 172.21.15.3:0/1341082896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b94440570 0x556b9443e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.230+0000 7f7eee800740 1 --2- 172.21.15.3:0/1341082896 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b94435cd0 0x556b9443daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.249 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.230+0000 7f7eee800740 1 --2- 172.21.15.3:0/1341082896 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b944353b0 0x556b9443d5b0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.249 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.230+0000 7f7eee800740 1 -- 172.21.15.3:0/1341082896 >> 172.21.15.3:0/1341082896 conn(0x556b94431920 msgr2=0x556b94437630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:52.249 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.230+0000 7f7ecaa00640 0 client.18015 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:52.249 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.230+0000 7f7eee800740 1 -- 172.21.15.3:0/1341082896 shutdown_connections 2024-09-19T06:21:52.249 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.230+0000 7f7eee800740 1 -- 172.21.15.3:0/1341082896 wait complete. 2024-09-19T06:21:52.249 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.231+0000 7f7eee800740 20 client.18015 trim_cache size 0 max 16384 2024-09-19T06:21:52.251 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.247+0000 7f7eee800740 1 Processor -- start 2024-09-19T06:21:52.251 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.247+0000 7f7eee800740 1 -- start start 2024-09-19T06:21:52.251 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.247+0000 7f7eee800740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b944353b0 0x556b9446ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.251 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.247+0000 7f7eee800740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b94435cd0 0x556b9446b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.251 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.247+0000 7f7eee800740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b94440570 0x556b9443a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.252 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.247+0000 7f7eee800740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41ab570 con 0x556b944353b0 2024-09-19T06:21:52.252 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.247+0000 7f7eee800740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41ad0b0 con 0x556b94440570 2024-09-19T06:21:52.252 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.247+0000 7f7eee800740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41abc40 con 0x556b94435cd0 2024-09-19T06:21:52.252 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.248+0000 7f7ee9000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b944353b0 0x556b9446ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.252 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.248+0000 7f7ee9a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b94440570 0x556b9443a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.252 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.248+0000 7f7ee9a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b94440570 0x556b9443a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:41078/0 (socket says 172.21.15.3:41078) 2024-09-19T06:21:52.252 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.248+0000 7f7ee9000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b944353b0 0x556b9446ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33390/0 (socket says 172.21.15.3:33390) 2024-09-19T06:21:52.252 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.248+0000 7f7ee9a00640 1 -- 172.21.15.3:0/3211576803 learned_addr learned my addr 172.21.15.3:0/3211576803 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:52.252 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.248+0000 7f7ee3e00640 1 --2- 172.21.15.3:0/3211576803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b94435cd0 0x556b9446b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.252 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.248+0000 7f7ee9000640 1 -- 172.21.15.3:0/3211576803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b94435cd0 msgr2=0x556b9446b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:52.252 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.248+0000 7f7ee9000640 1 --2- 172.21.15.3:0/3211576803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b94435cd0 0x556b9446b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.252 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.248+0000 7f7ee9000640 1 -- 172.21.15.3:0/3211576803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b94440570 msgr2=0x556b9443a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:52.252 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.248+0000 7f7ee9000640 1 --2- 172.21.15.3:0/3211576803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b94440570 0x556b9443a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.253 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.248+0000 7f7ee9000640 1 -- 172.21.15.3:0/3211576803 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b9442bc20 con 0x556b944353b0 2024-09-19T06:21:52.253 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.248+0000 7f7ee9a00640 1 --2- 172.21.15.3:0/3211576803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b94440570 0x556b9443a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:52.253 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.248+0000 7f7ee3e00640 1 --2- 172.21.15.3:0/3211576803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b94435cd0 0x556b9446b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:52.253 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.248+0000 7f7ee9000640 1 --2- 172.21.15.3:0/3211576803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b944353b0 0x556b9446ae70 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f7ed809a530 tx=0x7f7ed8018420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e9d54471bb03aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:52.253 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.249+0000 7f7ed5600640 1 -- 172.21.15.3:0/3211576803 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed809c050 con 0x556b944353b0 2024-09-19T06:21:52.253 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.249+0000 7f7ed5600640 1 -- 172.21.15.3:0/3211576803 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ed809c280 con 0x556b944353b0 2024-09-19T06:21:52.253 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.249+0000 7f7ed5600640 1 -- 172.21.15.3:0/3211576803 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed80d3df0 con 0x556b944353b0 2024-09-19T06:21:52.253 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.249+0000 7f7eee800740 1 -- 172.21.15.3:0/3211576803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b944353b0 msgr2=0x556b9446ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.253 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.249+0000 7f7eee800740 1 --2- 172.21.15.3:0/3211576803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b944353b0 0x556b9446ae70 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f7ed809a530 tx=0x7f7ed8018420 comp rx=0 tx=0).stop 2024-09-19T06:21:52.253 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.249+0000 7f7eee800740 1 -- 172.21.15.3:0/3211576803 shutdown_connections 2024-09-19T06:21:52.253 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.249+0000 7f7eee800740 1 --2- 172.21.15.3:0/3211576803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b94440570 0x556b9443a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.253 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.249+0000 7f7eee800740 1 --2- 172.21.15.3:0/3211576803 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b94435cd0 0x556b9446b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.253 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.249+0000 7f7eee800740 1 --2- 172.21.15.3:0/3211576803 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b944353b0 0x556b9446ae70 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.249+0000 7f7eee800740 1 -- 172.21.15.3:0/3211576803 >> 172.21.15.3:0/3211576803 conn(0x556b94431920 msgr2=0x556b94431d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.250+0000 7f7eee800740 1 -- 172.21.15.3:0/3211576803 shutdown_connections 2024-09-19T06:21:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.250+0000 7f7eee800740 1 -- 172.21.15.3:0/3211576803 wait complete. 2024-09-19T06:21:52.256 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.250+0000 7f7eee800740 1 -- start start 2024-09-19T06:21:52.256 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.250+0000 7f7eee800740 1 Processor -- start 2024-09-19T06:21:52.256 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.251+0000 7f7eee800740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b944353b0 0x556b9444f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.251+0000 7f7eee800740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b94435cd0 0x556b9443a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.251+0000 7f7eee800740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b94440570 0x556b9443aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.251+0000 7f7eee800740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41ac9e0 con 0x556b94435cd0 2024-09-19T06:21:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.251+0000 7f7eee800740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41ac310 con 0x556b94440570 2024-09-19T06:21:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.251+0000 7f7eee800740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee41a9590 con 0x556b944353b0 2024-09-19T06:21:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.251+0000 7f7eee800740 10 client.0 _ll_register_callbacks cb 0x7f7ed80d3810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.251+0000 7f7ee3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b94435cd0 0x556b9443a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.251+0000 7f7ee3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b94435cd0 0x556b9443a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33392/0 (socket says 172.21.15.3:33392) 2024-09-19T06:21:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.251+0000 7f7ee3e00640 1 -- 172.21.15.3:0/2600338152 learned_addr learned my addr 172.21.15.3:0/2600338152 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.251+0000 7f7ee9000640 1 --2- 172.21.15.3:0/2600338152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b944353b0 0x556b9444f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.251+0000 7f7ee9a00640 1 --2- 172.21.15.3:0/2600338152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b94440570 0x556b9443aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.251+0000 7f7ee3e00640 1 -- 172.21.15.3:0/2600338152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b944353b0 msgr2=0x556b9444f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.251+0000 7f7ee3e00640 1 --2- 172.21.15.3:0/2600338152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b944353b0 0x556b9444f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.251+0000 7f7ee3e00640 1 -- 172.21.15.3:0/2600338152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b94440570 msgr2=0x556b9443aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.251+0000 7f7ee3e00640 1 --2- 172.21.15.3:0/2600338152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b94440570 0x556b9443aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.251+0000 7f7ee3e00640 1 -- 172.21.15.3:0/2600338152 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b944cae30 con 0x556b94435cd0 2024-09-19T06:21:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.252+0000 7f7ee9a00640 1 --2- 172.21.15.3:0/2600338152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b94440570 0x556b9443aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.252+0000 7f7ee3e00640 1 --2- 172.21.15.3:0/2600338152 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b94435cd0 0x556b9443a480 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0009c70 tx=0x7f7ed00096b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898c6c649e111b2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.252+0000 7f7ecaa00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:21:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.252+0000 7f7ecaa00640 1 -- 172.21.15.3:0/2600338152 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0033020 con 0x556b94435cd0 2024-09-19T06:21:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.252+0000 7f7ecaa00640 1 -- 172.21.15.3:0/2600338152 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f7ed00197d0 con 0x556b94435cd0 2024-09-19T06:21:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.252+0000 7f7eee800740 1 -- 172.21.15.3:0/2600338152 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ed809c280 con 0x556b94435cd0 2024-09-19T06:21:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.252+0000 7f7ecaa00640 1 -- 172.21.15.3:0/2600338152 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7ed003e050 con 0x556b94435cd0 2024-09-19T06:21:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.252+0000 7f7eee800740 10 client.18021 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.252+0000 7f7eee800740 1 -- 172.21.15.3:0/2600338152 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556b944cbfc0 con 0x556b94435cd0 2024-09-19T06:21:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.253+0000 7f7ecaa00640 1 -- 172.21.15.3:0/2600338152 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ed809c280 con 0x556b94435cd0 2024-09-19T06:21:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.253+0000 7f7ecaa00640 1 -- 172.21.15.3:0/2600338152 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f7ed0004780 con 0x556b94435cd0 2024-09-19T06:21:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.253+0000 7f7eee800740 10 client.18021 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.253+0000 7f7eee800740 10 client.18021 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.253+0000 7f7eee800740 20 client.18021 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.253+0000 7f7eee800740 1 --2- 172.21.15.3:0/2600338152 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x556b944cc630 0x556b944cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.253+0000 7f7eee800740 4 client.18021 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:21:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.253+0000 7f7eee800740 1 -- 172.21.15.3:0/2600338152 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556b943a2b80 con 0x556b944cc630 2024-09-19T06:21:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.253+0000 7f7ee9000640 1 --2- 172.21.15.3:0/2600338152 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x556b944cc630 0x556b944cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.254+0000 7f7ee9000640 1 --2- 172.21.15.3:0/2600338152 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x556b944cc630 0x556b944cea50 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93b2a8979deca556 server_cookie=241645afd4199b8b in_seq=0 out_seq=0 2024-09-19T06:21:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.254+0000 7f7ecaa00640 10 client.18021 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:52.270 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.268+0000 7f7ecaa00640 1 -- 172.21.15.3:0/2600338152 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556b943a2b80 con 0x556b944cc630 2024-09-19T06:21:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.268+0000 7f7ecaa00640 10 client.18021 handle_command_reply: tid=0 2024-09-19T06:21:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.268+0000 7f7eee800740 1 client.18021 shutdown 2024-09-19T06:21:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.268+0000 7f7eee800740 1 -- 172.21.15.3:0/2600338152 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b94435cd0 msgr2=0x556b9443a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.268+0000 7f7eee800740 1 --2- 172.21.15.3:0/2600338152 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b94435cd0 0x556b9443a480 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0009c70 tx=0x7f7ed00096b0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.268+0000 7f7eee800740 1 -- 172.21.15.3:0/2600338152 shutdown_connections 2024-09-19T06:21:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.268+0000 7f7eee800740 1 --2- 172.21.15.3:0/2600338152 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x556b944cc630 0x556b944cea50 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.268+0000 7f7eee800740 1 --2- 172.21.15.3:0/2600338152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b94440570 0x556b9443aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.268+0000 7f7eee800740 1 --2- 172.21.15.3:0/2600338152 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x556b94435cd0 0x556b9443a480 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.268+0000 7f7eee800740 1 --2- 172.21.15.3:0/2600338152 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x556b944353b0 0x556b9444f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.268+0000 7f7ecaa00640 0 client.18021 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.268+0000 7f7eee800740 1 -- 172.21.15.3:0/2600338152 >> 172.21.15.3:0/2600338152 conn(0x556b94431920 msgr2=0x556b94453d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.269+0000 7f7eee800740 1 -- 172.21.15.3:0/2600338152 shutdown_connections 2024-09-19T06:21:52.271 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.269+0000 7f7eee800740 1 -- 172.21.15.3:0/2600338152 wait complete. 2024-09-19T06:21:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.269+0000 7f7eee800740 20 client.18021 trim_cache size 0 max 16384 2024-09-19T06:21:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:21:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:21:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:21:52.272 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:21:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.269+0000 7f7eea400640 1 -- 172.21.15.3:0/952904025 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7ecc0a3420 msgr2=0x7f7ecc0a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.269+0000 7f7eea400640 1 --2- 172.21.15.3:0/952904025 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7ecc0a3420 0x7f7ecc0a58e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7edc004af0 tx=0x7f7edc004a40 comp rx=0 tx=0).stop 2024-09-19T06:21:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.269+0000 7f7eea400640 1 -- 172.21.15.3:0/952904025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ee4101930 msgr2=0x7f7ee419a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.269+0000 7f7eea400640 1 --2- 172.21.15.3:0/952904025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ee4101930 0x7f7ee419a470 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7ed800e9f0 tx=0x7f7ed800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.270+0000 7f7eea400640 1 -- 172.21.15.3:0/952904025 shutdown_connections 2024-09-19T06:21:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.270+0000 7f7eea400640 1 --2- 172.21.15.3:0/952904025 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7ecc0a3420 0x7f7ecc0a58e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.270+0000 7f7eea400640 1 --2- 172.21.15.3:0/952904025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ee4107940 0x7f7ee419ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.270+0000 7f7eea400640 1 --2- 172.21.15.3:0/952904025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ee41022d0 0x7f7ee419a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.270+0000 7f7eea400640 1 --2- 172.21.15.3:0/952904025 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7ee4101930 0x7f7ee419a470 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:52.273 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.270+0000 7f7eea400640 1 -- 172.21.15.3:0/952904025 >> 172.21.15.3:0/952904025 conn(0x7f7ee40fd630 msgr2=0x7f7ee410cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:52.274 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.270+0000 7f7eea400640 1 -- 172.21.15.3:0/952904025 shutdown_connections 2024-09-19T06:21:52.274 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:21:52.270+0000 7f7eea400640 1 -- 172.21.15.3:0/952904025 wait complete. 2024-09-19T06:21:52.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:52 smithi003 ceph-mon[30893]: pgmap v293: 97 pgs: 97 active+clean; 2.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:21:52.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:52 smithi059 ceph-mon[35138]: pgmap v293: 97 pgs: 97 active+clean; 2.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:21:52.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:52 smithi071 ceph-mon[35662]: pgmap v293: 97 pgs: 97 active+clean; 2.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:21:54.258 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:21:54.259 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:21:54.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:54 smithi059 ceph-mon[35138]: pgmap v294: 97 pgs: 97 active+clean; 2.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:21:54.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:54 smithi003 ceph-mon[30893]: pgmap v294: 97 pgs: 97 active+clean; 2.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:21:54.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:54 smithi071 ceph-mon[35662]: pgmap v294: 97 pgs: 97 active+clean; 2.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:21:54.653 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:55.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.277+0000 7f6300800640 1 -- 172.21.15.3:0/2088505738 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62f8102790 msgr2=0x7f62f81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:55.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.277+0000 7f6300800640 1 --2- 172.21.15.3:0/2088505738 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62f8102790 0x7f62f81067e0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009900 tx=0x7f62e802a410 comp rx=0 tx=0).stop 2024-09-19T06:21:55.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.277+0000 7f6300800640 1 -- 172.21.15.3:0/2088505738 shutdown_connections 2024-09-19T06:21:55.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.277+0000 7f6300800640 1 --2- 172.21.15.3:0/2088505738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62f8106f10 0x7f62f810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.277+0000 7f6300800640 1 --2- 172.21.15.3:0/2088505738 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62f8102790 0x7f62f81067e0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.277+0000 7f6300800640 1 --2- 172.21.15.3:0/2088505738 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62f8101de0 0x7f62f81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.277+0000 7f6300800640 1 -- 172.21.15.3:0/2088505738 >> 172.21.15.3:0/2088505738 conn(0x7f62f80fd8c0 msgr2=0x7f62f80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:55.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.277+0000 7f6300800640 1 -- 172.21.15.3:0/2088505738 shutdown_connections 2024-09-19T06:21:55.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.277+0000 7f6300800640 1 -- 172.21.15.3:0/2088505738 wait complete. 2024-09-19T06:21:55.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.278+0000 7f6300800640 1 Processor -- start 2024-09-19T06:21:55.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.278+0000 7f6300800640 1 -- start start 2024-09-19T06:21:55.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.278+0000 7f6300800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62f8101de0 0x7f62f819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:55.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.278+0000 7f6300800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62f8102790 0x7f62f819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:55.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.279+0000 7f6300800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62f8106f10 0x7f62f819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:55.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.279+0000 7f6300800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f62f8111f80 con 0x7f62f8106f10 2024-09-19T06:21:55.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.279+0000 7f6300800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f62f8111e00 con 0x7f62f8102790 2024-09-19T06:21:55.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.279+0000 7f6300800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f62f8112100 con 0x7f62f8101de0 2024-09-19T06:21:55.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.279+0000 7f62fde00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62f8101de0 0x7f62f819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:55.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.279+0000 7f62fde00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62f8101de0 0x7f62f819a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:43044/0 (socket says 172.21.15.3:43044) 2024-09-19T06:21:55.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.279+0000 7f62fd400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62f8102790 0x7f62f819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:55.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.279+0000 7f62fde00640 1 -- 172.21.15.3:0/1050529979 learned_addr learned my addr 172.21.15.3:0/1050529979 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:55.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.279+0000 7f62fe800640 1 --2- 172.21.15.3:0/1050529979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62f8106f10 0x7f62f819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:55.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.279+0000 7f62fe800640 1 -- 172.21.15.3:0/1050529979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62f8101de0 msgr2=0x7f62f819a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:55.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.279+0000 7f62fe800640 1 --2- 172.21.15.3:0/1050529979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62f8101de0 0x7f62f819a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.279+0000 7f62fe800640 1 -- 172.21.15.3:0/1050529979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62f8102790 msgr2=0x7f62f819abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:55.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.279+0000 7f62fe800640 1 --2- 172.21.15.3:0/1050529979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62f8102790 0x7f62f819abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.279+0000 7f62fe800640 1 -- 172.21.15.3:0/1050529979 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f819f620 con 0x7f62f8106f10 2024-09-19T06:21:55.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.280+0000 7f62fe800640 1 --2- 172.21.15.3:0/1050529979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62f8106f10 0x7f62f819ef40 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f62f4009fd0 tx=0x7f62f400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:55.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.280+0000 7f62f2a00640 1 -- 172.21.15.3:0/1050529979 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f400ce20 con 0x7f62f8106f10 2024-09-19T06:21:55.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.280+0000 7f6300800640 1 -- 172.21.15.3:0/1050529979 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f819f910 con 0x7f62f8106f10 2024-09-19T06:21:55.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.280+0000 7f62f2a00640 1 -- 172.21.15.3:0/1050529979 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62f4005020 con 0x7f62f8106f10 2024-09-19T06:21:55.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.280+0000 7f62f2a00640 1 -- 172.21.15.3:0/1050529979 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f4010720 con 0x7f62f8106f10 2024-09-19T06:21:55.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.280+0000 7f6300800640 1 -- 172.21.15.3:0/1050529979 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f81a71f0 con 0x7f62f8106f10 2024-09-19T06:21:55.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.283+0000 7f62f2a00640 1 -- 172.21.15.3:0/1050529979 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f62f4005540 con 0x7f62f8106f10 2024-09-19T06:21:55.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.283+0000 7f6303448740 1 Processor -- start 2024-09-19T06:21:55.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.284+0000 7f6303448740 1 -- start start 2024-09-19T06:21:55.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.284+0000 7f6303448740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2de2ac0 0x563ab2de2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:55.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.284+0000 7f6303448740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ab2de33e0 0x563ab2ded760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:55.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.284+0000 7f6303448740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ab2dedca0 0x563ab2df0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:55.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.284+0000 7f6303448740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563ab2d49290 con 0x563ab2de2ac0 2024-09-19T06:21:55.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.284+0000 7f6303448740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563ab2cf0b40 con 0x563ab2dedca0 2024-09-19T06:21:55.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.284+0000 7f6303448740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563ab2d45250 con 0x563ab2de33e0 2024-09-19T06:21:55.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.284+0000 7f62fd400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2de2ac0 0x563ab2de2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:55.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.284+0000 7f62fd400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2de2ac0 0x563ab2de2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50684/0 (socket says 172.21.15.3:50684) 2024-09-19T06:21:55.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.284+0000 7f62fd400640 1 -- 172.21.15.3:0/3542257406 learned_addr learned my addr 172.21.15.3:0/3542257406 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:55.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.284+0000 7f62fde00640 1 --2- 172.21.15.3:0/3542257406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ab2de33e0 0x563ab2ded760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:55.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.285+0000 7f62fd400640 1 --2- 172.21.15.3:0/3542257406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ab2dedca0 0x563ab2df0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:55.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.285+0000 7f62fde00640 1 -- 172.21.15.3:0/3542257406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ab2dedca0 msgr2=0x563ab2df0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:55.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.285+0000 7f62fde00640 1 --2- 172.21.15.3:0/3542257406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ab2dedca0 0x563ab2df0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.285+0000 7f62fde00640 1 -- 172.21.15.3:0/3542257406 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2de2ac0 msgr2=0x563ab2de2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:55.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.285+0000 7f62fde00640 1 --2- 172.21.15.3:0/3542257406 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2de2ac0 0x563ab2de2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.285+0000 7f62fde00640 1 -- 172.21.15.3:0/3542257406 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ab2aba6a0 con 0x563ab2de33e0 2024-09-19T06:21:55.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.285+0000 7f62fd400640 1 --2- 172.21.15.3:0/3542257406 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2de2ac0 0x563ab2de2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:55.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.285+0000 7f62f2a00640 1 --2- 172.21.15.3:0/1050529979 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f62e00a33b0 0x7f62e00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:55.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.285+0000 7f62f2a00640 1 -- 172.21.15.3:0/1050529979 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f62f40d0430 con 0x7f62f8106f10 2024-09-19T06:21:55.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.285+0000 7f62fde00640 1 --2- 172.21.15.3:0/3542257406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ab2de33e0 0x563ab2ded760 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009c80 tx=0x7f62ec011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb98baf461d4fc63 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:55.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.286+0000 7f62fd400640 1 --2- 172.21.15.3:0/1050529979 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f62e00a33b0 0x7f62e00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:55.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.286+0000 7f62e7000640 1 -- 172.21.15.3:0/3542257406 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec004230 con 0x563ab2de33e0 2024-09-19T06:21:55.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.286+0000 7f62e7000640 1 -- 172.21.15.3:0/3542257406 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62ec0043d0 con 0x563ab2de33e0 2024-09-19T06:21:55.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.286+0000 7f62e7000640 1 -- 172.21.15.3:0/3542257406 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec004cd0 con 0x563ab2de33e0 2024-09-19T06:21:55.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.286+0000 7f6303448740 1 -- 172.21.15.3:0/3542257406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ab2de33e0 msgr2=0x563ab2ded760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:55.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.286+0000 7f6303448740 1 --2- 172.21.15.3:0/3542257406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ab2de33e0 0x563ab2ded760 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009c80 tx=0x7f62ec011810 comp rx=0 tx=0).stop 2024-09-19T06:21:55.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.286+0000 7f62fd400640 1 --2- 172.21.15.3:0/1050529979 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f62e00a33b0 0x7f62e00a5870 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f62e8031550 tx=0x7f62e8005bc0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:55.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.287+0000 7f6303448740 1 -- 172.21.15.3:0/3542257406 shutdown_connections 2024-09-19T06:21:55.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.287+0000 7f6303448740 1 --2- 172.21.15.3:0/3542257406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ab2dedca0 0x563ab2df0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.287+0000 7f6303448740 1 --2- 172.21.15.3:0/3542257406 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ab2de33e0 0x563ab2ded760 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.287+0000 7f6303448740 1 --2- 172.21.15.3:0/3542257406 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2de2ac0 0x563ab2de2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.287+0000 7f6303448740 1 -- 172.21.15.3:0/3542257406 >> 172.21.15.3:0/3542257406 conn(0x563ab2ddf050 msgr2=0x563ab2ddf430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:55.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.287+0000 7f6303448740 1 -- 172.21.15.3:0/3542257406 shutdown_connections 2024-09-19T06:21:55.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.287+0000 7f6303448740 1 -- 172.21.15.3:0/3542257406 wait complete. 2024-09-19T06:21:55.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.287+0000 7f6303448740 1 -- start start 2024-09-19T06:21:55.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.287+0000 7f6303448740 1 Processor -- start 2024-09-19T06:21:55.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.288+0000 7f6303448740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2de2ac0 0x563ab2ded550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:55.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.288+0000 7f6303448740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ab2de33e0 0x563ab2dea850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:55.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.288+0000 7f6303448740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ab2dedca0 0x563ab2dead90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:55.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.288+0000 7f6303448740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563ab2df0910 con 0x563ab2de2ac0 2024-09-19T06:21:55.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.288+0000 7f6303448740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563ab2d03fa0 con 0x563ab2dedca0 2024-09-19T06:21:55.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.288+0000 7f6303448740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563ab2df0a90 con 0x563ab2de33e0 2024-09-19T06:21:55.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.288+0000 7f6303448740 10 client.0 _ll_register_callbacks cb 0x563ab2a57ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:55.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.288+0000 7f62fd400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ab2de33e0 0x563ab2dea850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:55.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.288+0000 7f62fde00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2de2ac0 0x563ab2ded550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:55.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.288+0000 7f62fd400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ab2de33e0 0x563ab2dea850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:43064/0 (socket says 172.21.15.3:43064) 2024-09-19T06:21:55.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.288+0000 7f62fe800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ab2dedca0 0x563ab2dead90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:55.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.288+0000 7f62fd400640 1 -- 172.21.15.3:0/2773596818 learned_addr learned my addr 172.21.15.3:0/2773596818 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:55.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.289+0000 7f62fd400640 1 -- 172.21.15.3:0/2773596818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ab2dedca0 msgr2=0x563ab2dead90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:55.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.289+0000 7f62fd400640 1 --2- 172.21.15.3:0/2773596818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ab2dedca0 0x563ab2dead90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.289+0000 7f62fd400640 1 -- 172.21.15.3:0/2773596818 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2de2ac0 msgr2=0x563ab2ded550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:55.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.289+0000 7f62fd400640 1 --2- 172.21.15.3:0/2773596818 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2de2ac0 0x563ab2ded550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.289+0000 7f62fd400640 1 -- 172.21.15.3:0/2773596818 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ab2deb570 con 0x563ab2de33e0 2024-09-19T06:21:55.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.289+0000 7f62fde00640 1 --2- 172.21.15.3:0/2773596818 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2de2ac0 0x563ab2ded550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:55.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.289+0000 7f62fd400640 1 --2- 172.21.15.3:0/2773596818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ab2de33e0 0x563ab2dea850 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f62e8004350 tx=0x7f62e8005b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97f3362de1099ab4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:55.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.289+0000 7f62db400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:21:55.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.289+0000 7f62db400640 1 -- 172.21.15.3:0/2773596818 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e8035040 con 0x563ab2de33e0 2024-09-19T06:21:55.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.289+0000 7f62db400640 1 -- 172.21.15.3:0/2773596818 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f62e80048c0 con 0x563ab2de33e0 2024-09-19T06:21:55.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.289+0000 7f6303448740 1 -- 172.21.15.3:0/2773596818 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62ec0043d0 con 0x563ab2de33e0 2024-09-19T06:21:55.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.290+0000 7f62db400640 1 -- 172.21.15.3:0/2773596818 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f62e8004ac0 con 0x563ab2de33e0 2024-09-19T06:21:55.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.290+0000 7f6303448740 10 client.28048 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:55.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.290+0000 7f6303448740 1 -- 172.21.15.3:0/2773596818 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563ab2dfc7d0 con 0x563ab2de33e0 2024-09-19T06:21:55.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.290+0000 7f62db400640 1 -- 172.21.15.3:0/2773596818 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62ec0043d0 con 0x563ab2de33e0 2024-09-19T06:21:55.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.290+0000 7f62db400640 1 -- 172.21.15.3:0/2773596818 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f62e80035f0 con 0x563ab2de33e0 2024-09-19T06:21:55.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.291+0000 7f6303448740 10 client.28048 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:55.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.291+0000 7f6303448740 10 client.28048 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:55.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.291+0000 7f6303448740 20 client.28048 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:55.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.291+0000 7f6303448740 1 --2- 172.21.15.3:0/2773596818 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563ab2dfdc90 0x563ab2e00080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:55.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.291+0000 7f6303448740 4 client.28048 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:55.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.291+0000 7f6303448740 1 -- 172.21.15.3:0/2773596818 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ab2d56800 con 0x563ab2dfdc90 2024-09-19T06:21:55.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.291+0000 7f62fde00640 1 --2- 172.21.15.3:0/2773596818 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563ab2dfdc90 0x563ab2e00080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:55.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.292+0000 7f62fde00640 1 --2- 172.21.15.3:0/2773596818 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563ab2dfdc90 0x563ab2e00080 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf7dd96260a1a34c server_cookie=6a23a5706bf81923 in_seq=0 out_seq=0 2024-09-19T06:21:55.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.292+0000 7f62db400640 10 client.28048 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:55.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.293+0000 7f62db400640 1 -- 172.21.15.3:0/2773596818 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563ab2d56800 con 0x563ab2dfdc90 2024-09-19T06:21:55.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.293+0000 7f62db400640 10 client.28048 handle_command_reply: tid=0 2024-09-19T06:21:55.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.293+0000 7f6303448740 1 client.28048 shutdown 2024-09-19T06:21:55.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.293+0000 7f6303448740 1 -- 172.21.15.3:0/2773596818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ab2de33e0 msgr2=0x563ab2dea850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:55.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.293+0000 7f6303448740 1 --2- 172.21.15.3:0/2773596818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ab2de33e0 0x563ab2dea850 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f62e8004350 tx=0x7f62e8005b50 comp rx=0 tx=0).stop 2024-09-19T06:21:55.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.293+0000 7f6303448740 1 -- 172.21.15.3:0/2773596818 shutdown_connections 2024-09-19T06:21:55.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.293+0000 7f6303448740 1 --2- 172.21.15.3:0/2773596818 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563ab2dfdc90 0x563ab2e00080 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.293+0000 7f6303448740 1 --2- 172.21.15.3:0/2773596818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ab2dedca0 0x563ab2dead90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.293+0000 7f6303448740 1 --2- 172.21.15.3:0/2773596818 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ab2de33e0 0x563ab2dea850 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.293+0000 7f6303448740 1 --2- 172.21.15.3:0/2773596818 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2de2ac0 0x563ab2ded550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.293+0000 7f62db400640 0 client.28048 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:55.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.293+0000 7f6303448740 1 -- 172.21.15.3:0/2773596818 >> 172.21.15.3:0/2773596818 conn(0x563ab2ddf050 msgr2=0x563ab2de4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:55.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.293+0000 7f6303448740 1 -- 172.21.15.3:0/2773596818 shutdown_connections 2024-09-19T06:21:55.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.293+0000 7f6303448740 1 -- 172.21.15.3:0/2773596818 wait complete. 2024-09-19T06:21:55.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.293+0000 7f6303448740 20 client.28048 trim_cache size 0 max 16384 2024-09-19T06:21:55.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.311+0000 7f6303448740 1 Processor -- start 2024-09-19T06:21:55.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.311+0000 7f6303448740 1 -- start start 2024-09-19T06:21:55.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.312+0000 7f6303448740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ab2ddf050 0x563ab2dec720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:55.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.312+0000 7f6303448740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2de2ac0 0x563ab2dde0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:55.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.312+0000 7f6303448740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ab2de33e0 0x563ab2df5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:55.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.312+0000 7f6303448740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f62f81afbd0 con 0x563ab2de2ac0 2024-09-19T06:21:55.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.312+0000 7f6303448740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f62f81b1710 con 0x563ab2de33e0 2024-09-19T06:21:55.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.312+0000 7f6303448740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f62f81b02a0 con 0x563ab2ddf050 2024-09-19T06:21:55.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.312+0000 7f62fd400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2de2ac0 0x563ab2dde0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:55.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.312+0000 7f62fd400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2de2ac0 0x563ab2dde0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50700/0 (socket says 172.21.15.3:50700) 2024-09-19T06:21:55.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.312+0000 7f62fd400640 1 -- 172.21.15.3:0/4214010996 learned_addr learned my addr 172.21.15.3:0/4214010996 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:55.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.312+0000 7f62fde00640 1 --2- 172.21.15.3:0/4214010996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ab2ddf050 0x563ab2dec720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:55.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.312+0000 7f62fe800640 1 --2- 172.21.15.3:0/4214010996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ab2de33e0 0x563ab2df5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:55.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.312+0000 7f62fd400640 1 -- 172.21.15.3:0/4214010996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ab2ddf050 msgr2=0x563ab2dec720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:55.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.312+0000 7f62fd400640 1 --2- 172.21.15.3:0/4214010996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ab2ddf050 0x563ab2dec720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.312+0000 7f62fd400640 1 -- 172.21.15.3:0/4214010996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ab2de33e0 msgr2=0x563ab2df5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:55.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.312+0000 7f62fd400640 1 --2- 172.21.15.3:0/4214010996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ab2de33e0 0x563ab2df5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.312+0000 7f62fd400640 1 -- 172.21.15.3:0/4214010996 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ab2e006b0 con 0x563ab2de2ac0 2024-09-19T06:21:55.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.313+0000 7f62fd400640 1 --2- 172.21.15.3:0/4214010996 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2de2ac0 0x563ab2dde0b0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f62e8003a30 tx=0x7f62e8005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a296d4a02e6a0a37 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:55.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.313+0000 7f62e6600640 1 -- 172.21.15.3:0/4214010996 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e8035040 con 0x563ab2de2ac0 2024-09-19T06:21:55.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.313+0000 7f62e6600640 1 -- 172.21.15.3:0/4214010996 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62e80046c0 con 0x563ab2de2ac0 2024-09-19T06:21:55.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.313+0000 7f62e6600640 1 -- 172.21.15.3:0/4214010996 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e8032820 con 0x563ab2de2ac0 2024-09-19T06:21:55.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.314+0000 7f6303448740 1 -- 172.21.15.3:0/4214010996 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2de2ac0 msgr2=0x563ab2dde0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:55.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.314+0000 7f6303448740 1 --2- 172.21.15.3:0/4214010996 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2de2ac0 0x563ab2dde0b0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f62e8003a30 tx=0x7f62e8005770 comp rx=0 tx=0).stop 2024-09-19T06:21:55.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.314+0000 7f6303448740 1 -- 172.21.15.3:0/4214010996 shutdown_connections 2024-09-19T06:21:55.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.314+0000 7f6303448740 1 --2- 172.21.15.3:0/4214010996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ab2de33e0 0x563ab2df5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.314+0000 7f6303448740 1 --2- 172.21.15.3:0/4214010996 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2de2ac0 0x563ab2dde0b0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.314+0000 7f6303448740 1 --2- 172.21.15.3:0/4214010996 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ab2ddf050 0x563ab2dec720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.314+0000 7f6303448740 1 -- 172.21.15.3:0/4214010996 >> 172.21.15.3:0/4214010996 conn(0x563ab2deaef0 msgr2=0x563ab2ddd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:55.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.314+0000 7f6303448740 1 -- 172.21.15.3:0/4214010996 shutdown_connections 2024-09-19T06:21:55.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.314+0000 7f6303448740 1 -- 172.21.15.3:0/4214010996 wait complete. 2024-09-19T06:21:55.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.314+0000 7f6303448740 1 -- start start 2024-09-19T06:21:55.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.314+0000 7f6303448740 1 Processor -- start 2024-09-19T06:21:55.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.315+0000 7f6303448740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2ddf050 0x563ab2df43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:55.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.315+0000 7f6303448740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ab2de2ac0 0x563ab2df4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:55.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.315+0000 7f6303448740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ab2de33e0 0x563ab2e61890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:55.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.315+0000 7f6303448740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f62f81b1040 con 0x563ab2ddf050 2024-09-19T06:21:55.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.315+0000 7f6303448740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f62f81b0970 con 0x563ab2de2ac0 2024-09-19T06:21:55.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.315+0000 7f6303448740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f62f81adbd0 con 0x563ab2de33e0 2024-09-19T06:21:55.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.315+0000 7f6303448740 10 client.0 _ll_register_callbacks cb 0x7f62e80042a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:55.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.315+0000 7f62fde00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2ddf050 0x563ab2df43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:55.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.315+0000 7f62fde00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2ddf050 0x563ab2df43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50702/0 (socket says 172.21.15.3:50702) 2024-09-19T06:21:55.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.315+0000 7f62fde00640 1 -- 172.21.15.3:0/116682090 learned_addr learned my addr 172.21.15.3:0/116682090 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:55.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.315+0000 7f62fe800640 1 --2- 172.21.15.3:0/116682090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ab2de33e0 0x563ab2e61890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:55.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.315+0000 7f62fd400640 1 --2- 172.21.15.3:0/116682090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ab2de2ac0 0x563ab2df4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:55.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.316+0000 7f62fde00640 1 -- 172.21.15.3:0/116682090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ab2de33e0 msgr2=0x563ab2e61890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:55.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.316+0000 7f62fde00640 1 --2- 172.21.15.3:0/116682090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ab2de33e0 0x563ab2e61890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.316+0000 7f62fde00640 1 -- 172.21.15.3:0/116682090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ab2de2ac0 msgr2=0x563ab2df4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:55.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.316+0000 7f62fde00640 1 --2- 172.21.15.3:0/116682090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ab2de2ac0 0x563ab2df4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.316+0000 7f62fde00640 1 -- 172.21.15.3:0/116682090 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ab2e61f30 con 0x563ab2ddf050 2024-09-19T06:21:55.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.316+0000 7f62fd400640 1 --2- 172.21.15.3:0/116682090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ab2de2ac0 0x563ab2df4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:55.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.316+0000 7f62fde00640 1 --2- 172.21.15.3:0/116682090 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2ddf050 0x563ab2df43c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009bd0 tx=0x7f62ec011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580b2a2da9d11c35 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:55.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.316+0000 7f62db400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:21:55.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.316+0000 7f62db400640 1 -- 172.21.15.3:0/116682090 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62ec01e040 con 0x563ab2ddf050 2024-09-19T06:21:55.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.316+0000 7f62db400640 1 -- 172.21.15.3:0/116682090 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f62ec004230 con 0x563ab2ddf050 2024-09-19T06:21:55.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.316+0000 7f6303448740 1 -- 172.21.15.3:0/116682090 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62e80046c0 con 0x563ab2ddf050 2024-09-19T06:21:55.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.317+0000 7f62db400640 1 -- 172.21.15.3:0/116682090 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f62ec037050 con 0x563ab2ddf050 2024-09-19T06:21:55.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.317+0000 7f6303448740 10 client.18039 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:55.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.317+0000 7f6303448740 1 -- 172.21.15.3:0/116682090 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563ab2e69360 con 0x563ab2ddf050 2024-09-19T06:21:55.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.317+0000 7f62db400640 1 -- 172.21.15.3:0/116682090 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62e80046c0 con 0x563ab2ddf050 2024-09-19T06:21:55.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.317+0000 7f62db400640 1 -- 172.21.15.3:0/116682090 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f62ec02e070 con 0x563ab2ddf050 2024-09-19T06:21:55.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.317+0000 7f6303448740 10 client.18039 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:55.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.317+0000 7f6303448740 10 client.18039 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:55.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.317+0000 7f6303448740 20 client.18039 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:55.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.317+0000 7f6303448740 1 --2- 172.21.15.3:0/116682090 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563ab2dedca0 0x563ab2e6b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:55.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.317+0000 7f6303448740 4 client.18039 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:21:55.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.317+0000 7f6303448740 1 -- 172.21.15.3:0/116682090 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563ab2d50d10 con 0x563ab2dedca0 2024-09-19T06:21:55.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.318+0000 7f62fd400640 1 --2- 172.21.15.3:0/116682090 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563ab2dedca0 0x563ab2e6b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:55.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.318+0000 7f62fd400640 1 --2- 172.21.15.3:0/116682090 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563ab2dedca0 0x563ab2e6b990 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64ceddaeff3e513c server_cookie=20c88cdb1a0d6d3b in_seq=0 out_seq=0 2024-09-19T06:21:55.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.318+0000 7f62db400640 10 client.18039 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:55.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.319+0000 7f62db400640 1 -- 172.21.15.3:0/116682090 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563ab2d50d10 con 0x563ab2dedca0 2024-09-19T06:21:55.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.319+0000 7f62db400640 10 client.18039 handle_command_reply: tid=0 2024-09-19T06:21:55.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.319+0000 7f6303448740 1 client.18039 shutdown 2024-09-19T06:21:55.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.319+0000 7f6303448740 1 -- 172.21.15.3:0/116682090 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2ddf050 msgr2=0x563ab2df43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:55.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.319+0000 7f6303448740 1 --2- 172.21.15.3:0/116682090 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2ddf050 0x563ab2df43c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009bd0 tx=0x7f62ec011e40 comp rx=0 tx=0).stop 2024-09-19T06:21:55.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.320+0000 7f6303448740 1 -- 172.21.15.3:0/116682090 shutdown_connections 2024-09-19T06:21:55.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.320+0000 7f6303448740 1 --2- 172.21.15.3:0/116682090 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563ab2dedca0 0x563ab2e6b990 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.320+0000 7f6303448740 1 --2- 172.21.15.3:0/116682090 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563ab2de33e0 0x563ab2e61890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.320+0000 7f6303448740 1 --2- 172.21.15.3:0/116682090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563ab2de2ac0 0x563ab2df4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.320+0000 7f6303448740 1 --2- 172.21.15.3:0/116682090 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563ab2ddf050 0x563ab2df43c0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.320+0000 7f6303448740 1 -- 172.21.15.3:0/116682090 >> 172.21.15.3:0/116682090 conn(0x563ab2deaef0 msgr2=0x563ab2dde1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:55.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.320+0000 7f62db400640 0 client.18039 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:55.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.320+0000 7f6303448740 1 -- 172.21.15.3:0/116682090 shutdown_connections 2024-09-19T06:21:55.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.320+0000 7f6303448740 1 -- 172.21.15.3:0/116682090 wait complete. 2024-09-19T06:21:55.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.320+0000 7f6303448740 20 client.18039 trim_cache size 0 max 16384 2024-09-19T06:21:55.327 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:21:55.327 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": 0, 2024-09-19T06:21:55.327 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_tag": "1574f27f-ae25-4216-b639-b23e66d6e5ec", 2024-09-19T06:21:55.327 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": "asynchronous" 2024-09-19T06:21:55.327 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:21:55.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.321+0000 7f6300800640 1 -- 172.21.15.3:0/1050529979 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f62e00a33b0 msgr2=0x7f62e00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:55.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.321+0000 7f6300800640 1 --2- 172.21.15.3:0/1050529979 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f62e00a33b0 0x7f62e00a5870 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f62e8031550 tx=0x7f62e8005bc0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.321+0000 7f6300800640 1 -- 172.21.15.3:0/1050529979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62f8106f10 msgr2=0x7f62f819ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:55.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.321+0000 7f6300800640 1 --2- 172.21.15.3:0/1050529979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62f8106f10 0x7f62f819ef40 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f62f4009fd0 tx=0x7f62f400ef10 comp rx=0 tx=0).stop 2024-09-19T06:21:55.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.321+0000 7f6300800640 1 -- 172.21.15.3:0/1050529979 shutdown_connections 2024-09-19T06:21:55.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.321+0000 7f6300800640 1 --2- 172.21.15.3:0/1050529979 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f62e00a33b0 0x7f62e00a5870 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.321+0000 7f6300800640 1 --2- 172.21.15.3:0/1050529979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62f8106f10 0x7f62f819ef40 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.321+0000 7f6300800640 1 --2- 172.21.15.3:0/1050529979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62f8102790 0x7f62f819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.321+0000 7f6300800640 1 --2- 172.21.15.3:0/1050529979 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f62f8101de0 0x7f62f819a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:55.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.321+0000 7f6300800640 1 -- 172.21.15.3:0/1050529979 >> 172.21.15.3:0/1050529979 conn(0x7f62f80fd8c0 msgr2=0x7f62f80feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:55.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.321+0000 7f6300800640 1 -- 172.21.15.3:0/1050529979 shutdown_connections 2024-09-19T06:21:55.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:55.321+0000 7f6300800640 1 -- 172.21.15.3:0/1050529979 wait complete. 2024-09-19T06:21:56.278 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:21:56.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:56 smithi059 ceph-mon[35138]: pgmap v295: 97 pgs: 97 active+clean; 2.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 67 KiB/s wr, 24 op/s 2024-09-19T06:21:56.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:56 smithi059 ceph-mon[35138]: scrub queued for path: / 2024-09-19T06:21:56.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:56 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:56.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:56 smithi059 ceph-mon[35138]: scrub summary: active paths [/] 2024-09-19T06:21:56.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:56 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:56.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:56 smithi003 ceph-mon[30893]: pgmap v295: 97 pgs: 97 active+clean; 2.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 67 KiB/s wr, 24 op/s 2024-09-19T06:21:56.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:56 smithi003 ceph-mon[30893]: scrub queued for path: / 2024-09-19T06:21:56.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:56 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:56.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:56 smithi003 ceph-mon[30893]: scrub summary: active paths [/] 2024-09-19T06:21:56.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:56 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:56.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:56 smithi071 ceph-mon[35662]: pgmap v295: 97 pgs: 97 active+clean; 2.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 67 KiB/s wr, 24 op/s 2024-09-19T06:21:56.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:56 smithi071 ceph-mon[35662]: scrub queued for path: / 2024-09-19T06:21:56.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:56 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:56.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:56 smithi071 ceph-mon[35662]: scrub summary: active paths [/] 2024-09-19T06:21:56.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:56 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:21:56.660 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:21:57.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.251+0000 7f090fc00640 1 -- 172.21.15.3:0/2024415763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0908109140 msgr2=0x7f0908110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:57.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.251+0000 7f090fc00640 1 --2- 172.21.15.3:0/2024415763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0908109140 0x7f0908110cc0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f0900009ca0 tx=0x7f090002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.251+0000 7f090fc00640 1 -- 172.21.15.3:0/2024415763 shutdown_connections 2024-09-19T06:21:57.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.251+0000 7f090fc00640 1 --2- 172.21.15.3:0/2024415763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0908109140 0x7f0908110cc0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.251+0000 7f090fc00640 1 --2- 172.21.15.3:0/2024415763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09081049c0 0x7f0908108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.251+0000 7f090fc00640 1 --2- 172.21.15.3:0/2024415763 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0908104010 0x7f09081043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.251+0000 7f090fc00640 1 -- 172.21.15.3:0/2024415763 >> 172.21.15.3:0/2024415763 conn(0x7f09080ffa50 msgr2=0x7f0908101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:57.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.251+0000 7f090fc00640 1 -- 172.21.15.3:0/2024415763 shutdown_connections 2024-09-19T06:21:57.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.251+0000 7f090fc00640 1 -- 172.21.15.3:0/2024415763 wait complete. 2024-09-19T06:21:57.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.252+0000 7f090fc00640 1 Processor -- start 2024-09-19T06:21:57.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.252+0000 7f090fc00640 1 -- start start 2024-09-19T06:21:57.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.252+0000 7f090fc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0908104010 0x7f090819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.252+0000 7f090fc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09081049c0 0x7f090819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.252+0000 7f090fc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0908109140 0x7f090819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.252+0000 7f090fc00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f09081141a0 con 0x7f09081049c0 2024-09-19T06:21:57.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.252+0000 7f090fc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0908114020 con 0x7f0908104010 2024-09-19T06:21:57.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.252+0000 7f090fc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0908114320 con 0x7f0908109140 2024-09-19T06:21:57.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.253+0000 7f0907e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09081049c0 0x7f090819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.253+0000 7f090d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0908104010 0x7f090819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.253+0000 7f090d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0908104010 0x7f090819a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:51398/0 (socket says 172.21.15.3:51398) 2024-09-19T06:21:57.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.253+0000 7f0907e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09081049c0 0x7f090819abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50708/0 (socket says 172.21.15.3:50708) 2024-09-19T06:21:57.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.253+0000 7f090d200640 1 -- 172.21.15.3:0/1270243160 learned_addr learned my addr 172.21.15.3:0/1270243160 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:57.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.253+0000 7f090dc00640 1 --2- 172.21.15.3:0/1270243160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0908109140 0x7f090819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.253+0000 7f0907e00640 1 -- 172.21.15.3:0/1270243160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0908109140 msgr2=0x7f090819ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:57.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.253+0000 7f0907e00640 1 --2- 172.21.15.3:0/1270243160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0908109140 0x7f090819ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.253+0000 7f0907e00640 1 -- 172.21.15.3:0/1270243160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0908104010 msgr2=0x7f090819a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:57.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.253+0000 7f0907e00640 1 --2- 172.21.15.3:0/1270243160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0908104010 0x7f090819a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.253+0000 7f0907e00640 1 -- 172.21.15.3:0/1270243160 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f090819f650 con 0x7f09081049c0 2024-09-19T06:21:57.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.253+0000 7f090d200640 1 --2- 172.21.15.3:0/1270243160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0908104010 0x7f090819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:57.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.253+0000 7f0907e00640 1 --2- 172.21.15.3:0/1270243160 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09081049c0 0x7f090819abe0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f08f400e9f0 tx=0x7f08f400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:57.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.254+0000 7f0905600640 1 -- 172.21.15.3:0/1270243160 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f400cd80 con 0x7f09081049c0 2024-09-19T06:21:57.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.254+0000 7f0905600640 1 -- 172.21.15.3:0/1270243160 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08f40035f0 con 0x7f09081049c0 2024-09-19T06:21:57.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.254+0000 7f090fc00640 1 -- 172.21.15.3:0/1270243160 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f090819f940 con 0x7f09081049c0 2024-09-19T06:21:57.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.254+0000 7f0905600640 1 -- 172.21.15.3:0/1270243160 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f4010690 con 0x7f09081049c0 2024-09-19T06:21:57.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.254+0000 7f090fc00640 1 -- 172.21.15.3:0/1270243160 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09081a7220 con 0x7f09081049c0 2024-09-19T06:21:57.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.257+0000 7f0905600640 1 -- 172.21.15.3:0/1270243160 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f08f4003b30 con 0x7f09081049c0 2024-09-19T06:21:57.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.257+0000 7f0912693740 1 Processor -- start 2024-09-19T06:21:57.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.257+0000 7f0912693740 1 -- start start 2024-09-19T06:21:57.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.258+0000 7f0912693740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17015b90 0x555b17015f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.258+0000 7f0912693740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b170164b0 0x555b17020830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.258+0000 7f0912693740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b17020d70 0x555b17023160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.258+0000 7f0912693740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x555b16f7c3e0 con 0x555b17015b90 2024-09-19T06:21:57.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.258+0000 7f0912693740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555b16f23d80 con 0x555b170164b0 2024-09-19T06:21:57.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.258+0000 7f0912693740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555b16f783a0 con 0x555b17020d70 2024-09-19T06:21:57.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.258+0000 7f090dc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17015b90 0x555b17015f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.258+0000 7f0907e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b17020d70 0x555b17023160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.258+0000 7f090d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b170164b0 0x555b17020830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.258+0000 7f0907e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b17020d70 0x555b17023160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:43118/0 (socket says 172.21.15.3:43118) 2024-09-19T06:21:57.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.258+0000 7f0907e00640 1 -- 172.21.15.3:0/389491673 learned_addr learned my addr 172.21.15.3:0/389491673 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:57.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.258+0000 7f090dc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17015b90 0x555b17015f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50714/0 (socket says 172.21.15.3:50714) 2024-09-19T06:21:57.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.258+0000 7f090d200640 1 -- 172.21.15.3:0/389491673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b17020d70 msgr2=0x555b17023160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:57.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.259+0000 7f090d200640 1 --2- 172.21.15.3:0/389491673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b17020d70 0x555b17023160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.259+0000 7f090d200640 1 -- 172.21.15.3:0/389491673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17015b90 msgr2=0x555b17015f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:57.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.259+0000 7f090d200640 1 --2- 172.21.15.3:0/389491673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17015b90 0x555b17015f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.259+0000 7f090d200640 1 -- 172.21.15.3:0/389491673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b16f42ae0 con 0x555b170164b0 2024-09-19T06:21:57.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.259+0000 7f090d200640 1 --2- 172.21.15.3:0/389491673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b170164b0 0x555b17020830 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0114f0 tx=0x7f08fc0119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cda5654d94a95455 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:57.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.259+0000 7f0905600640 1 --2- 172.21.15.3:0/1270243160 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f08f00a33b0 0x7f08f00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.259+0000 7f08fa000640 1 -- 172.21.15.3:0/389491673 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08fc01e070 con 0x555b170164b0 2024-09-19T06:21:57.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.259+0000 7f08fa000640 1 -- 172.21.15.3:0/389491673 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08fc0035f0 con 0x555b170164b0 2024-09-19T06:21:57.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.259+0000 7f08fa000640 1 -- 172.21.15.3:0/389491673 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08fc00f820 con 0x555b170164b0 2024-09-19T06:21:57.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.259+0000 7f0905600640 1 -- 172.21.15.3:0/1270243160 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f08f40cffe0 con 0x7f09081049c0 2024-09-19T06:21:57.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.259+0000 7f090dc00640 1 --2- 172.21.15.3:0/1270243160 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f08f00a33b0 0x7f08f00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.260+0000 7f0912693740 1 -- 172.21.15.3:0/389491673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b170164b0 msgr2=0x555b17020830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:57.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.260+0000 7f0912693740 1 --2- 172.21.15.3:0/389491673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b170164b0 0x555b17020830 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0114f0 tx=0x7f08fc0119b0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.260+0000 7f0912693740 1 -- 172.21.15.3:0/389491673 shutdown_connections 2024-09-19T06:21:57.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.260+0000 7f0912693740 1 --2- 172.21.15.3:0/389491673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b17020d70 0x555b17023160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.260+0000 7f0912693740 1 --2- 172.21.15.3:0/389491673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b170164b0 0x555b17020830 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.260+0000 7f0912693740 1 --2- 172.21.15.3:0/389491673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17015b90 0x555b17015f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.260+0000 7f0912693740 1 -- 172.21.15.3:0/389491673 >> 172.21.15.3:0/389491673 conn(0x555b17012120 msgr2=0x555b17012500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:57.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.260+0000 7f090dc00640 1 --2- 172.21.15.3:0/1270243160 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f08f00a33b0 0x7f08f00a5870 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0900006010 tx=0x7f0900005d80 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:57.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.260+0000 7f0912693740 1 -- 172.21.15.3:0/389491673 shutdown_connections 2024-09-19T06:21:57.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.260+0000 7f0912693740 1 -- 172.21.15.3:0/389491673 wait complete. 2024-09-19T06:21:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.261+0000 7f0912693740 1 -- start start 2024-09-19T06:21:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.261+0000 7f0912693740 1 Processor -- start 2024-09-19T06:21:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.262+0000 7f0912693740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17015b90 0x555b1701dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.262+0000 7f0912693740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b170164b0 0x555b1701e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.262+0000 7f0912693740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b17020d70 0x555b1701e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.262+0000 7f0912693740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x555b170239e0 con 0x555b17015b90 2024-09-19T06:21:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.262+0000 7f0912693740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555b16f370f0 con 0x555b17020d70 2024-09-19T06:21:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.262+0000 7f0912693740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555b17023b60 con 0x555b170164b0 2024-09-19T06:21:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.262+0000 7f0912693740 10 client.0 _ll_register_callbacks cb 0x555b16f289e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.262+0000 7f090d200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17015b90 0x555b1701dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.262+0000 7f090dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b17020d70 0x555b1701e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.262+0000 7f090d200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17015b90 0x555b1701dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50726/0 (socket says 172.21.15.3:50726) 2024-09-19T06:21:57.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.262+0000 7f090d200640 1 -- 172.21.15.3:0/1102505882 learned_addr learned my addr 172.21.15.3:0/1102505882 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:57.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.262+0000 7f0907e00640 1 --2- 172.21.15.3:0/1102505882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b170164b0 0x555b1701e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.262+0000 7f090d200640 1 -- 172.21.15.3:0/1102505882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b170164b0 msgr2=0x555b1701e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:57.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.262+0000 7f090d200640 1 --2- 172.21.15.3:0/1102505882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b170164b0 0x555b1701e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.262+0000 7f090d200640 1 -- 172.21.15.3:0/1102505882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b17020d70 msgr2=0x555b1701e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:57.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.262+0000 7f090d200640 1 --2- 172.21.15.3:0/1102505882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b17020d70 0x555b1701e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.262+0000 7f090d200640 1 -- 172.21.15.3:0/1102505882 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b16ced3c0 con 0x555b17015b90 2024-09-19T06:21:57.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.262+0000 7f090dc00640 1 --2- 172.21.15.3:0/1102505882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b17020d70 0x555b1701e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:57.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.263+0000 7f090d200640 1 --2- 172.21.15.3:0/1102505882 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17015b90 0x555b1701dba0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f08fc004630 tx=0x7f08fc0041f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94759ad9983e7332 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:57.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.263+0000 7f08eea00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:21:57.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.263+0000 7f08eea00640 1 -- 172.21.15.3:0/1102505882 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08fc01e070 con 0x555b17015b90 2024-09-19T06:21:57.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.263+0000 7f08eea00640 1 -- 172.21.15.3:0/1102505882 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f08fc005240 con 0x555b17015b90 2024-09-19T06:21:57.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.263+0000 7f0912693740 1 -- 172.21.15.3:0/1102505882 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08fc0035f0 con 0x555b17015b90 2024-09-19T06:21:57.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.263+0000 7f08eea00640 1 -- 172.21.15.3:0/1102505882 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f08fc030050 con 0x555b17015b90 2024-09-19T06:21:57.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.263+0000 7f0912693740 10 client.18051 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:57.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.263+0000 7f0912693740 1 -- 172.21.15.3:0/1102505882 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555b1702f5e0 con 0x555b17015b90 2024-09-19T06:21:57.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.264+0000 7f08eea00640 1 -- 172.21.15.3:0/1102505882 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08fc0035f0 con 0x555b17015b90 2024-09-19T06:21:57.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.264+0000 7f08eea00640 1 -- 172.21.15.3:0/1102505882 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f08fc02b030 con 0x555b17015b90 2024-09-19T06:21:57.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.264+0000 7f0912693740 10 client.18051 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:57.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.264+0000 7f0912693740 10 client.18051 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:57.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.264+0000 7f0912693740 20 client.18051 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:57.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.264+0000 7f0912693740 1 --2- 172.21.15.3:0/1102505882 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x555b17030aa0 0x555b17032e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.264+0000 7f0912693740 4 client.18051 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:21:57.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.264+0000 7f0912693740 1 -- 172.21.15.3:0/1102505882 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b16f89950 con 0x555b17030aa0 2024-09-19T06:21:57.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.265+0000 7f0907e00640 1 --2- 172.21.15.3:0/1102505882 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x555b17030aa0 0x555b17032e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.265+0000 7f0907e00640 1 --2- 172.21.15.3:0/1102505882 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x555b17030aa0 0x555b17032e90 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be13ccb8137e66ff server_cookie=52acab1cc17aa8c9 in_seq=0 out_seq=0 2024-09-19T06:21:57.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.265+0000 7f08eea00640 10 client.18051 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:57.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.266+0000 7f08eea00640 1 -- 172.21.15.3:0/1102505882 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555b16f89950 con 0x555b17030aa0 2024-09-19T06:21:57.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.266+0000 7f08eea00640 10 client.18051 handle_command_reply: tid=0 2024-09-19T06:21:57.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.266+0000 7f0912693740 1 client.18051 shutdown 2024-09-19T06:21:57.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.266+0000 7f0912693740 1 -- 172.21.15.3:0/1102505882 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17015b90 msgr2=0x555b1701dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:57.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.266+0000 7f0912693740 1 --2- 172.21.15.3:0/1102505882 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17015b90 0x555b1701dba0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f08fc004630 tx=0x7f08fc0041f0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.266+0000 7f0912693740 1 -- 172.21.15.3:0/1102505882 shutdown_connections 2024-09-19T06:21:57.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.266+0000 7f0912693740 1 --2- 172.21.15.3:0/1102505882 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x555b17030aa0 0x555b17032e90 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.266+0000 7f0912693740 1 --2- 172.21.15.3:0/1102505882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b17020d70 0x555b1701e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.266+0000 7f0912693740 1 --2- 172.21.15.3:0/1102505882 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b170164b0 0x555b1701e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.266+0000 7f0912693740 1 --2- 172.21.15.3:0/1102505882 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17015b90 0x555b1701dba0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.266+0000 7f0912693740 1 -- 172.21.15.3:0/1102505882 >> 172.21.15.3:0/1102505882 conn(0x555b17012120 msgr2=0x555b17017e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:57.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.266+0000 7f08eea00640 0 client.18051 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:57.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.266+0000 7f0912693740 1 -- 172.21.15.3:0/1102505882 shutdown_connections 2024-09-19T06:21:57.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.266+0000 7f0912693740 1 -- 172.21.15.3:0/1102505882 wait complete. 2024-09-19T06:21:57.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.267+0000 7f0912693740 20 client.18051 trim_cache size 0 max 16384 2024-09-19T06:21:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.285+0000 7f0912693740 1 Processor -- start 2024-09-19T06:21:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.285+0000 7f0912693740 1 -- start start 2024-09-19T06:21:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.285+0000 7f0912693740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17015b90 0x555b1701fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.285+0000 7f0912693740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b170164b0 0x555b17038600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.285+0000 7f0912693740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b17020d70 0x555b17038b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.285+0000 7f0912693740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f09081afc90 con 0x555b17015b90 2024-09-19T06:21:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.285+0000 7f0912693740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f09081b17d0 con 0x555b17020d70 2024-09-19T06:21:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.285+0000 7f0912693740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f09081b0360 con 0x555b170164b0 2024-09-19T06:21:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.285+0000 7f090d200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17015b90 0x555b1701fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.285+0000 7f090d200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17015b90 0x555b1701fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50740/0 (socket says 172.21.15.3:50740) 2024-09-19T06:21:57.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.285+0000 7f090d200640 1 -- 172.21.15.3:0/1314377624 learned_addr learned my addr 172.21.15.3:0/1314377624 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:57.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.285+0000 7f090dc00640 1 --2- 172.21.15.3:0/1314377624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b17020d70 0x555b17038b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.285+0000 7f0907e00640 1 --2- 172.21.15.3:0/1314377624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b170164b0 0x555b17038600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.286+0000 7f090d200640 1 -- 172.21.15.3:0/1314377624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b170164b0 msgr2=0x555b17038600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:57.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.286+0000 7f090d200640 1 --2- 172.21.15.3:0/1314377624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b170164b0 0x555b17038600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.286+0000 7f090d200640 1 -- 172.21.15.3:0/1314377624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b17020d70 msgr2=0x555b17038b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:57.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.286+0000 7f090d200640 1 --2- 172.21.15.3:0/1314377624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b17020d70 0x555b17038b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.286+0000 7f090d200640 1 -- 172.21.15.3:0/1314377624 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b170132b0 con 0x555b17015b90 2024-09-19T06:21:57.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.286+0000 7f090dc00640 1 --2- 172.21.15.3:0/1314377624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b17020d70 0x555b17038b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:21:57.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.286+0000 7f090d200640 1 --2- 172.21.15.3:0/1314377624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17015b90 0x555b1701fb10 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0119f0 tx=0x7f08fc005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f70dbc7b718fcd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:57.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.286+0000 7f08f9600640 1 -- 172.21.15.3:0/1314377624 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08fc01e070 con 0x555b17015b90 2024-09-19T06:21:57.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.286+0000 7f08f9600640 1 -- 172.21.15.3:0/1314377624 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08fc01f040 con 0x555b17015b90 2024-09-19T06:21:57.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.286+0000 7f08f9600640 1 -- 172.21.15.3:0/1314377624 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08fc00fa60 con 0x555b17015b90 2024-09-19T06:21:57.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.287+0000 7f0912693740 1 -- 172.21.15.3:0/1314377624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17015b90 msgr2=0x555b1701fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:57.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.287+0000 7f0912693740 1 --2- 172.21.15.3:0/1314377624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17015b90 0x555b1701fb10 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0119f0 tx=0x7f08fc005e40 comp rx=0 tx=0).stop 2024-09-19T06:21:57.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.287+0000 7f0912693740 1 -- 172.21.15.3:0/1314377624 shutdown_connections 2024-09-19T06:21:57.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.287+0000 7f0912693740 1 --2- 172.21.15.3:0/1314377624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b17020d70 0x555b17038b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.287+0000 7f0912693740 1 --2- 172.21.15.3:0/1314377624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b170164b0 0x555b17038600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.287+0000 7f0912693740 1 --2- 172.21.15.3:0/1314377624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17015b90 0x555b1701fb10 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.287+0000 7f0912693740 1 -- 172.21.15.3:0/1314377624 >> 172.21.15.3:0/1314377624 conn(0x555b17012120 msgr2=0x555b1701f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:57.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.287+0000 7f0912693740 1 -- 172.21.15.3:0/1314377624 shutdown_connections 2024-09-19T06:21:57.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.287+0000 7f0912693740 1 -- 172.21.15.3:0/1314377624 wait complete. 2024-09-19T06:21:57.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.287+0000 7f0912693740 1 -- start start 2024-09-19T06:21:57.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.288+0000 7f0912693740 1 Processor -- start 2024-09-19T06:21:57.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.288+0000 7f0912693740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b170164b0 0x555b1701a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.288+0000 7f0912693740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b17020d70 0x555b1701aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.288+0000 7f0912693740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17027db0 0x555b17028230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.288+0000 7f0912693740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f09081b1100 con 0x555b17027db0 2024-09-19T06:21:57.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.288+0000 7f0912693740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f09081b0a30 con 0x555b170164b0 2024-09-19T06:21:57.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.288+0000 7f0912693740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f09081adc90 con 0x555b17020d70 2024-09-19T06:21:57.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.288+0000 7f0912693740 10 client.0 _ll_register_callbacks cb 0x7f08f40d3960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:21:57.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.288+0000 7f090dc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17027db0 0x555b17028230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.288+0000 7f0907e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b17020d70 0x555b1701aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.288+0000 7f090d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b170164b0 0x555b1701a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.288+0000 7f0907e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b17020d70 0x555b1701aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:43136/0 (socket says 172.21.15.3:43136) 2024-09-19T06:21:57.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.288+0000 7f090dc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17027db0 0x555b17028230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50750/0 (socket says 172.21.15.3:50750) 2024-09-19T06:21:57.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.288+0000 7f090d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b170164b0 0x555b1701a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:51414/0 (socket says 172.21.15.3:51414) 2024-09-19T06:21:57.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.288+0000 7f0907e00640 1 -- 172.21.15.3:0/4134937316 learned_addr learned my addr 172.21.15.3:0/4134937316 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:21:57.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.289+0000 7f0907e00640 1 -- 172.21.15.3:0/4134937316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b170164b0 msgr2=0x555b1701a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:57.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.289+0000 7f0907e00640 1 --2- 172.21.15.3:0/4134937316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b170164b0 0x555b1701a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.289+0000 7f0907e00640 1 -- 172.21.15.3:0/4134937316 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17027db0 msgr2=0x555b17028230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:21:57.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.289+0000 7f0907e00640 1 --2- 172.21.15.3:0/4134937316 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17027db0 0x555b17028230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.289+0000 7f0907e00640 1 -- 172.21.15.3:0/4134937316 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b17028770 con 0x555b17020d70 2024-09-19T06:21:57.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.289+0000 7f090d200640 1 --2- 172.21.15.3:0/4134937316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b170164b0 0x555b1701a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:21:57.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.289+0000 7f0907e00640 1 --2- 172.21.15.3:0/4134937316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b17020d70 0x555b1701aab0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f08f409c1c0 tx=0x7f08f40d0310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=427faf570fa37ef5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:21:57.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.289+0000 7f08eea00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:21:57.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.289+0000 7f08eea00640 1 -- 172.21.15.3:0/4134937316 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f40b4060 con 0x555b17020d70 2024-09-19T06:21:57.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.289+0000 7f0912693740 1 -- 172.21.15.3:0/4134937316 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08fc01f040 con 0x555b17020d70 2024-09-19T06:21:57.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.289+0000 7f08eea00640 1 -- 172.21.15.3:0/4134937316 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8571+0+0 (secure 0 0 0) 0x7f08f409a530 con 0x555b17020d70 2024-09-19T06:21:57.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.290+0000 7f08eea00640 1 -- 172.21.15.3:0/4134937316 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f08f409c230 con 0x555b17020d70 2024-09-19T06:21:57.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.290+0000 7f0912693740 10 client.28072 fetch_fsmap learned FSMap version 29 2024-09-19T06:21:57.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.290+0000 7f0912693740 1 -- 172.21.15.3:0/4134937316 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555b17029a40 con 0x555b17020d70 2024-09-19T06:21:57.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.290+0000 7f08eea00640 1 -- 172.21.15.3:0/4134937316 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f08fc01f040 con 0x555b17020d70 2024-09-19T06:21:57.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.290+0000 7f08eea00640 1 -- 172.21.15.3:0/4134937316 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f08f40988a0 con 0x555b17020d70 2024-09-19T06:21:57.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.290+0000 7f0912693740 10 client.28072 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:21:57.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.290+0000 7f0912693740 10 client.28072 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:21:57.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.290+0000 7f0912693740 20 client.28072 populate_metadata read hostname 'smithi003' 2024-09-19T06:21:57.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.290+0000 7f0912693740 1 --2- 172.21.15.3:0/4134937316 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x555b1709ba80 0x555b1709de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:21:57.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.290+0000 7f0912693740 4 client.28072 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:21:57.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.290+0000 7f0912693740 1 -- 172.21.15.3:0/4134937316 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555b16f83e60 con 0x555b1709ba80 2024-09-19T06:21:57.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.291+0000 7f090d200640 1 --2- 172.21.15.3:0/4134937316 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x555b1709ba80 0x555b1709de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:21:57.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.291+0000 7f090d200640 1 --2- 172.21.15.3:0/4134937316 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x555b1709ba80 0x555b1709de70 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6580f32053b1579c server_cookie=52fce64466f0f906 in_seq=0 out_seq=0 2024-09-19T06:21:57.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.291+0000 7f08eea00640 10 client.28072 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:57.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.291+0000 7f08eea00640 1 -- 172.21.15.3:0/4134937316 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x555b16f83e60 con 0x555b1709ba80 2024-09-19T06:21:57.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.291+0000 7f08eea00640 10 client.28072 handle_command_reply: tid=0 2024-09-19T06:21:57.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.291+0000 7f0912693740 1 client.28072 shutdown 2024-09-19T06:21:57.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.292+0000 7f0912693740 1 -- 172.21.15.3:0/4134937316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b17020d70 msgr2=0x555b1701aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:57.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.292+0000 7f0912693740 1 --2- 172.21.15.3:0/4134937316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b17020d70 0x555b1701aab0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f08f409c1c0 tx=0x7f08f40d0310 comp rx=0 tx=0).stop 2024-09-19T06:21:57.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.292+0000 7f0912693740 1 -- 172.21.15.3:0/4134937316 shutdown_connections 2024-09-19T06:21:57.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.292+0000 7f0912693740 1 --2- 172.21.15.3:0/4134937316 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x555b1709ba80 0x555b1709de70 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.292+0000 7f0912693740 1 --2- 172.21.15.3:0/4134937316 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555b17027db0 0x555b17028230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.292+0000 7f0912693740 1 --2- 172.21.15.3:0/4134937316 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555b17020d70 0x555b1701aab0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.292+0000 7f08eea00640 0 client.28072 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:21:57.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.292+0000 7f0912693740 1 --2- 172.21.15.3:0/4134937316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b170164b0 0x555b1701a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.292+0000 7f0912693740 1 -- 172.21.15.3:0/4134937316 >> 172.21.15.3:0/4134937316 conn(0x555b17012120 msgr2=0x555b170111c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:57.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.292+0000 7f0912693740 1 -- 172.21.15.3:0/4134937316 shutdown_connections 2024-09-19T06:21:57.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.292+0000 7f0912693740 1 -- 172.21.15.3:0/4134937316 wait complete. 2024-09-19T06:21:57.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.292+0000 7f0912693740 20 client.28072 trim_cache size 0 max 16384 2024-09-19T06:21:57.299 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:21:57.299 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:21:57.299 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": { 2024-09-19T06:21:57.299 INFO:teuthology.orchestra.run.smithi003.stdout: "1574f27f-ae25-4216-b639-b23e66d6e5ec": { 2024-09-19T06:21:57.299 INFO:teuthology.orchestra.run.smithi003.stdout: "path": "/", 2024-09-19T06:21:57.299 INFO:teuthology.orchestra.run.smithi003.stdout: "tag": "1574f27f-ae25-4216-b639-b23e66d6e5ec", 2024-09-19T06:21:57.299 INFO:teuthology.orchestra.run.smithi003.stdout: "options": "recursive,force" 2024-09-19T06:21:57.299 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:21:57.299 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:21:57.300 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:21:57.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.293+0000 7f090fc00640 1 -- 172.21.15.3:0/1270243160 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f08f00a33b0 msgr2=0x7f08f00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:57.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.293+0000 7f090fc00640 1 --2- 172.21.15.3:0/1270243160 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f08f00a33b0 0x7f08f00a5870 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0900006010 tx=0x7f0900005d80 comp rx=0 tx=0).stop 2024-09-19T06:21:57.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.293+0000 7f090fc00640 1 -- 172.21.15.3:0/1270243160 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09081049c0 msgr2=0x7f090819abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:21:57.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.293+0000 7f090fc00640 1 --2- 172.21.15.3:0/1270243160 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09081049c0 0x7f090819abe0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f08f400e9f0 tx=0x7f08f400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.293+0000 7f090fc00640 1 -- 172.21.15.3:0/1270243160 shutdown_connections 2024-09-19T06:21:57.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.293+0000 7f090fc00640 1 --2- 172.21.15.3:0/1270243160 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f08f00a33b0 0x7f08f00a5870 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.293+0000 7f090fc00640 1 --2- 172.21.15.3:0/1270243160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0908109140 0x7f090819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.293+0000 7f090fc00640 1 --2- 172.21.15.3:0/1270243160 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09081049c0 0x7f090819abe0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.293+0000 7f090fc00640 1 --2- 172.21.15.3:0/1270243160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0908104010 0x7f090819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:21:57.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.293+0000 7f090fc00640 1 -- 172.21.15.3:0/1270243160 >> 172.21.15.3:0/1270243160 conn(0x7f09080ffa50 msgr2=0x7f0908100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:21:57.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.293+0000 7f090fc00640 1 -- 172.21.15.3:0/1270243160 shutdown_connections 2024-09-19T06:21:57.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:21:57.293+0000 7f090fc00640 1 -- 172.21.15.3:0/1270243160 wait complete. 2024-09-19T06:21:58.100 INFO:tasks.cephfs.filesystem:scrub status for tag:1574f27f-ae25-4216-b639-b23e66d6e5ec - {'path': '/', 'tag': '1574f27f-ae25-4216-b639-b23e66d6e5ec', 'options': 'recursive,force'} 2024-09-19T06:21:58.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:21:58 smithi003 ceph-mon[30893]: pgmap v296: 97 pgs: 97 active+clean; 2.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:21:58.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:21:58 smithi059 ceph-mon[35138]: pgmap v296: 97 pgs: 97 active+clean; 2.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:21:58.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:21:58 smithi071 ceph-mon[35662]: pgmap v296: 97 pgs: 97 active+clean; 2.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:22:00.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:00 smithi059 ceph-mon[35138]: pgmap v297: 97 pgs: 97 active+clean; 2.5 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 60 KiB/s wr, 23 op/s 2024-09-19T06:22:00.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:00 smithi059 ceph-mon[35138]: scrub summary: idle 2024-09-19T06:22:00.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:00 smithi003 ceph-mon[30893]: pgmap v297: 97 pgs: 97 active+clean; 2.5 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 60 KiB/s wr, 23 op/s 2024-09-19T06:22:00.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:00 smithi003 ceph-mon[30893]: scrub summary: idle 2024-09-19T06:22:00.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:00 smithi071 ceph-mon[35662]: pgmap v297: 97 pgs: 97 active+clean; 2.5 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 60 KiB/s wr, 23 op/s 2024-09-19T06:22:00.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:00 smithi071 ceph-mon[35662]: scrub summary: idle 2024-09-19T06:22:02.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:02 smithi059 ceph-mon[35138]: pgmap v298: 97 pgs: 97 active+clean; 2.5 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 16 op/s 2024-09-19T06:22:02.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:02 smithi003 ceph-mon[30893]: pgmap v298: 97 pgs: 97 active+clean; 2.5 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 16 op/s 2024-09-19T06:22:02.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:02 smithi071 ceph-mon[35662]: pgmap v298: 97 pgs: 97 active+clean; 2.5 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 16 op/s 2024-09-19T06:22:04.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:04 smithi059 ceph-mon[35138]: pgmap v299: 97 pgs: 97 active+clean; 2.5 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 16 op/s 2024-09-19T06:22:04.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:04 smithi003 ceph-mon[30893]: pgmap v299: 97 pgs: 97 active+clean; 2.5 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 16 op/s 2024-09-19T06:22:04.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:04 smithi071 ceph-mon[35662]: pgmap v299: 97 pgs: 97 active+clean; 2.5 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 16 op/s 2024-09-19T06:22:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.399+0000 7facd7600640 1 -- 172.21.15.3:0/948627840 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facd0112970 msgr2=0x7facd0114d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.399+0000 7facd7600640 1 --2- 172.21.15.3:0/948627840 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facd0112970 0x7facd0114d60 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7facc8009ca0 tx=0x7facc802a8b0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.401 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.399+0000 7facd7600640 1 -- 172.21.15.3:0/948627840 shutdown_connections 2024-09-19T06:22:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.399+0000 7facd7600640 1 --2- 172.21.15.3:0/948627840 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facd0112970 0x7facd0114d60 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.399+0000 7facd7600640 1 --2- 172.21.15.3:0/948627840 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facd0077040 0x7facd0112430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.399+0000 7facd7600640 1 --2- 172.21.15.3:0/948627840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facd0076720 0x7facd0076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.399+0000 7facd7600640 1 -- 172.21.15.3:0/948627840 >> 172.21.15.3:0/948627840 conn(0x7facd00ff970 msgr2=0x7facd0101d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.399+0000 7facd7600640 1 -- 172.21.15.3:0/948627840 shutdown_connections 2024-09-19T06:22:05.402 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.399+0000 7facd7600640 1 -- 172.21.15.3:0/948627840 wait complete. 2024-09-19T06:22:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.400+0000 7facd7600640 1 Processor -- start 2024-09-19T06:22:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.400+0000 7facd7600640 1 -- start start 2024-09-19T06:22:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.401+0000 7facd7600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facd0076720 0x7facd01a4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:05.404 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.401+0000 7facd7600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facd0077040 0x7facd01a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.401+0000 7facd7600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facd0112970 0x7facd019e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.401+0000 7facd7600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7facd0118520 con 0x7facd0076720 2024-09-19T06:22:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.401+0000 7facd7600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7facd01183a0 con 0x7facd0077040 2024-09-19T06:22:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.401+0000 7facd7600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7facd01186a0 con 0x7facd0112970 2024-09-19T06:22:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.401+0000 7facd4c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facd0076720 0x7facd01a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.401+0000 7facd4c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facd0076720 0x7facd01a4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56258/0 (socket says 172.21.15.3:56258) 2024-09-19T06:22:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.401+0000 7facd4c00640 1 -- 172.21.15.3:0/4001855623 learned_addr learned my addr 172.21.15.3:0/4001855623 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.401+0000 7facc7e00640 1 --2- 172.21.15.3:0/4001855623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facd0077040 0x7facd01a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.401+0000 7facd5600640 1 --2- 172.21.15.3:0/4001855623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facd0112970 0x7facd019e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.402+0000 7facd4c00640 1 -- 172.21.15.3:0/4001855623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facd0112970 msgr2=0x7facd019e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.402+0000 7facd4c00640 1 --2- 172.21.15.3:0/4001855623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facd0112970 0x7facd019e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.405 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.402+0000 7facd4c00640 1 -- 172.21.15.3:0/4001855623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facd0077040 msgr2=0x7facd01a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.402+0000 7facd4c00640 1 --2- 172.21.15.3:0/4001855623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facd0077040 0x7facd01a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.402+0000 7facd4c00640 1 -- 172.21.15.3:0/4001855623 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd019efa0 con 0x7facd0076720 2024-09-19T06:22:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.402+0000 7facd4c00640 1 --2- 172.21.15.3:0/4001855623 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facd0076720 0x7facd01a4660 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7facc000e9f0 tx=0x7facc000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.402+0000 7facce000640 1 -- 172.21.15.3:0/4001855623 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc000cd80 con 0x7facd0076720 2024-09-19T06:22:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.402+0000 7facce000640 1 -- 172.21.15.3:0/4001855623 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facc0010910 con 0x7facd0076720 2024-09-19T06:22:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.402+0000 7facd7600640 1 -- 172.21.15.3:0/4001855623 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facd019f290 con 0x7facd0076720 2024-09-19T06:22:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.402+0000 7facce000640 1 -- 172.21.15.3:0/4001855623 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc0018990 con 0x7facd0076720 2024-09-19T06:22:05.406 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.402+0000 7facd7600640 1 -- 172.21.15.3:0/4001855623 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facd01ab4b0 con 0x7facd0076720 2024-09-19T06:22:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.406+0000 7facda600740 1 Processor -- start 2024-09-19T06:22:05.407 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.406+0000 7facda600740 1 -- start start 2024-09-19T06:22:05.408 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.406+0000 7facda600740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b62c1e0 0x55625b62c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.406+0000 7facda600740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55625b62cb00 0x55625b636e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.406+0000 7facda600740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55625b6373a0 0x55625b639790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.406+0000 7facda600740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55625b592100 con 0x55625b62cb00 2024-09-19T06:22:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.406+0000 7facda600740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55625b53a1b0 con 0x55625b62c1e0 2024-09-19T06:22:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.406+0000 7facda600740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55625b58e0c0 con 0x55625b6373a0 2024-09-19T06:22:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.406+0000 7facce000640 1 -- 172.21.15.3:0/4001855623 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7facc0010ac0 con 0x7facd0076720 2024-09-19T06:22:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.407+0000 7facd5600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b62c1e0 0x55625b62c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.407+0000 7facd5600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b62c1e0 0x55625b62c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:60154/0 (socket says 172.21.15.3:60154) 2024-09-19T06:22:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.407+0000 7facd5600640 1 -- 172.21.15.3:0/1743215040 learned_addr learned my addr 172.21.15.3:0/1743215040 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.407+0000 7facd4c00640 1 --2- 172.21.15.3:0/1743215040 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55625b62cb00 0x55625b636e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:05.409 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.407+0000 7facc7e00640 1 --2- 172.21.15.3:0/1743215040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55625b6373a0 0x55625b639790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.407+0000 7facd5600640 1 -- 172.21.15.3:0/1743215040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55625b6373a0 msgr2=0x55625b639790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.407+0000 7facd5600640 1 --2- 172.21.15.3:0/1743215040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55625b6373a0 0x55625b639790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.407+0000 7facd5600640 1 -- 172.21.15.3:0/1743215040 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55625b62cb00 msgr2=0x55625b636e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:05.410 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.407+0000 7facd5600640 1 --2- 172.21.15.3:0/1743215040 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55625b62cb00 0x55625b636e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.407+0000 7facd5600640 1 -- 172.21.15.3:0/1743215040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55625b2a5210 con 0x55625b62c1e0 2024-09-19T06:22:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.408+0000 7facd5600640 1 --2- 172.21.15.3:0/1743215040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b62c1e0 0x55625b62c5c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7facc8009ca0 tx=0x7facc8005f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c48a515b17a06f65 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.408+0000 7facc5c00640 1 -- 172.21.15.3:0/1743215040 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc8030760 con 0x55625b62c1e0 2024-09-19T06:22:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.409+0000 7facc5c00640 1 -- 172.21.15.3:0/1743215040 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facc8036030 con 0x55625b62c1e0 2024-09-19T06:22:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.409+0000 7facc5c00640 1 -- 172.21.15.3:0/1743215040 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc8004440 con 0x55625b62c1e0 2024-09-19T06:22:05.411 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.409+0000 7facce000640 1 --2- 172.21.15.3:0/4001855623 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7facb40a33b0 0x7facb40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:05.412 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.409+0000 7facce000640 1 -- 172.21.15.3:0/4001855623 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8615+0+0 (secure 0 0 0) 0x7facc00d00f0 con 0x7facd0076720 2024-09-19T06:22:05.412 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.409+0000 7facd4c00640 1 --2- 172.21.15.3:0/4001855623 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7facb40a33b0 0x7facb40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:05.412 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.410+0000 7facda600740 1 -- 172.21.15.3:0/1743215040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b62c1e0 msgr2=0x55625b62c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:05.412 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.410+0000 7facda600740 1 --2- 172.21.15.3:0/1743215040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b62c1e0 0x55625b62c5c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7facc8009ca0 tx=0x7facc8005f80 comp rx=0 tx=0).stop 2024-09-19T06:22:05.412 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.410+0000 7facda600740 1 -- 172.21.15.3:0/1743215040 shutdown_connections 2024-09-19T06:22:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.410+0000 7facda600740 1 --2- 172.21.15.3:0/1743215040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55625b6373a0 0x55625b639790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.410+0000 7facda600740 1 --2- 172.21.15.3:0/1743215040 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55625b62cb00 0x55625b636e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.410+0000 7facda600740 1 --2- 172.21.15.3:0/1743215040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b62c1e0 0x55625b62c5c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.410+0000 7facda600740 1 -- 172.21.15.3:0/1743215040 >> 172.21.15.3:0/1743215040 conn(0x55625b628750 msgr2=0x55625b628b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.411+0000 7facd4c00640 1 --2- 172.21.15.3:0/4001855623 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7facb40a33b0 0x7facb40a5870 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55625b6295b0 tx=0x7facc0000bc0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.411+0000 7facda600740 1 -- 172.21.15.3:0/1743215040 shutdown_connections 2024-09-19T06:22:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.411+0000 7facda600740 1 -- 172.21.15.3:0/1743215040 wait complete. 2024-09-19T06:22:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.412+0000 7facda600740 1 -- start start 2024-09-19T06:22:05.414 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.412+0000 7facda600740 1 Processor -- start 2024-09-19T06:22:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.412+0000 7facda600740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55625b62c1e0 0x55625b634330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.413+0000 7facda600740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55625b62cb00 0x55625b634870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.413+0000 7facda600740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b6373a0 0x55625b634db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.413+0000 7facda600740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55625b639f70 con 0x55625b62cb00 2024-09-19T06:22:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.413+0000 7facda600740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55625b51b090 con 0x55625b6373a0 2024-09-19T06:22:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.413+0000 7facda600740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55625b63a0f0 con 0x55625b62c1e0 2024-09-19T06:22:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.413+0000 7facda600740 10 client.0 _ll_register_callbacks cb 0x55625b56ff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.413+0000 7facd5600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55625b62c1e0 0x55625b634330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.413+0000 7facc7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55625b62cb00 0x55625b634870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.413+0000 7facd5600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55625b62c1e0 0x55625b634330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:54286/0 (socket says 172.21.15.3:54286) 2024-09-19T06:22:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.413+0000 7facd5600640 1 -- 172.21.15.3:0/3197765213 learned_addr learned my addr 172.21.15.3:0/3197765213 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.413+0000 7facd5600640 1 --2- 172.21.15.3:0/3197765213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b6373a0 0x55625b634db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.413+0000 7facc7e00640 1 -- 172.21.15.3:0/3197765213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55625b62c1e0 msgr2=0x55625b634330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.413+0000 7facc7e00640 1 --2- 172.21.15.3:0/3197765213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55625b62c1e0 0x55625b634330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.413+0000 7facc7e00640 1 -- 172.21.15.3:0/3197765213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b6373a0 msgr2=0x55625b634db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.413+0000 7facc7e00640 1 --2- 172.21.15.3:0/3197765213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b6373a0 0x55625b634db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.413+0000 7facc7e00640 1 -- 172.21.15.3:0/3197765213 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55625b371620 con 0x55625b62cb00 2024-09-19T06:22:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.413+0000 7facd5600640 1 --2- 172.21.15.3:0/3197765213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55625b62c1e0 0x55625b634330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.414+0000 7facc7e00640 1 --2- 172.21.15.3:0/3197765213 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55625b62cb00 0x55625b634870 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x55625b62ed80 tx=0x7facb8012b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea9ebc6f0c5afb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.414+0000 7facbe000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:22:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.414+0000 7facbe000640 1 -- 172.21.15.3:0/3197765213 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb8004050 con 0x55625b62cb00 2024-09-19T06:22:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.414+0000 7facda600740 1 -- 172.21.15.3:0/3197765213 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facc8036030 con 0x55625b62cb00 2024-09-19T06:22:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.414+0000 7facbe000640 1 -- 172.21.15.3:0/3197765213 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8615+0+0 (secure 0 0 0) 0x7facb80041f0 con 0x55625b62cb00 2024-09-19T06:22:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.414+0000 7facbe000640 1 -- 172.21.15.3:0/3197765213 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7facb80043f0 con 0x55625b62cb00 2024-09-19T06:22:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.414+0000 7facda600740 10 client.18069 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.414+0000 7facda600740 1 -- 172.21.15.3:0/3197765213 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55625b645c10 con 0x55625b62cb00 2024-09-19T06:22:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.414+0000 7facbe000640 1 -- 172.21.15.3:0/3197765213 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facc8036030 con 0x55625b62cb00 2024-09-19T06:22:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.415+0000 7facbe000640 1 -- 172.21.15.3:0/3197765213 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7facb8003ba0 con 0x55625b62cb00 2024-09-19T06:22:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.415+0000 7facda600740 10 client.18069 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.415+0000 7facda600740 10 client.18069 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.415+0000 7facda600740 20 client.18069 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.415+0000 7facda600740 1 --2- 172.21.15.3:0/3197765213 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55625b647120 0x55625b649510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.415+0000 7facda600740 4 client.18069 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.415+0000 7facda600740 1 -- 172.21.15.3:0/3197765213 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55625b59f830 con 0x55625b647120 2024-09-19T06:22:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.415+0000 7facd5600640 1 --2- 172.21.15.3:0/3197765213 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55625b647120 0x55625b649510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.416+0000 7facd5600640 1 --2- 172.21.15.3:0/3197765213 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55625b647120 0x55625b649510 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c10f6398ae75a08 server_cookie=8e30d215159fd677 in_seq=0 out_seq=0 2024-09-19T06:22:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.416+0000 7facbe000640 10 client.18069 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.416+0000 7facbe000640 1 -- 172.21.15.3:0/3197765213 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55625b59f830 con 0x55625b647120 2024-09-19T06:22:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.416+0000 7facbe000640 10 client.18069 handle_command_reply: tid=0 2024-09-19T06:22:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.416+0000 7facda600740 1 client.18069 shutdown 2024-09-19T06:22:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.417+0000 7facda600740 1 -- 172.21.15.3:0/3197765213 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55625b62cb00 msgr2=0x55625b634870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.417+0000 7facda600740 1 --2- 172.21.15.3:0/3197765213 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55625b62cb00 0x55625b634870 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x55625b62ed80 tx=0x7facb8012b60 comp rx=0 tx=0).stop 2024-09-19T06:22:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.417+0000 7facda600740 1 -- 172.21.15.3:0/3197765213 shutdown_connections 2024-09-19T06:22:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.417+0000 7facda600740 1 --2- 172.21.15.3:0/3197765213 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55625b647120 0x55625b649510 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.417+0000 7facda600740 1 --2- 172.21.15.3:0/3197765213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b6373a0 0x55625b634db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.417+0000 7facda600740 1 --2- 172.21.15.3:0/3197765213 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55625b62cb00 0x55625b634870 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.417+0000 7facda600740 1 --2- 172.21.15.3:0/3197765213 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55625b62c1e0 0x55625b634330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.417+0000 7facbe000640 0 client.18069 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.417+0000 7facda600740 1 -- 172.21.15.3:0/3197765213 >> 172.21.15.3:0/3197765213 conn(0x55625b628750 msgr2=0x55625b62e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.417+0000 7facda600740 1 -- 172.21.15.3:0/3197765213 shutdown_connections 2024-09-19T06:22:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.417+0000 7facda600740 1 -- 172.21.15.3:0/3197765213 wait complete. 2024-09-19T06:22:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.417+0000 7facda600740 20 client.18069 trim_cache size 0 max 16384 2024-09-19T06:22:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.432+0000 7facda600740 1 Processor -- start 2024-09-19T06:22:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.432+0000 7facda600740 1 -- start start 2024-09-19T06:22:05.435 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.433+0000 7facda600740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55625b62c1e0 0x55625b64edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:05.435 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.433+0000 7facda600740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55625b62cb00 0x55625b64f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:05.435 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.433+0000 7facda600740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b6373a0 0x55625b62dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:05.435 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.433+0000 7facda600740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7facd01b3f80 con 0x55625b62cb00 2024-09-19T06:22:05.435 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.433+0000 7facda600740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7facd01b5ac0 con 0x55625b6373a0 2024-09-19T06:22:05.435 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.433+0000 7facda600740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7facd01b4650 con 0x55625b62c1e0 2024-09-19T06:22:05.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.433+0000 7facc7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55625b62cb00 0x55625b64f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:05.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.433+0000 7facc7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55625b62cb00 0x55625b64f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56288/0 (socket says 172.21.15.3:56288) 2024-09-19T06:22:05.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.433+0000 7facc7e00640 1 -- 172.21.15.3:0/108475350 learned_addr learned my addr 172.21.15.3:0/108475350 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:05.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.433+0000 7facd5600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b6373a0 0x55625b62dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:05.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.433+0000 7facd5600640 1 --2- 172.21.15.3:0/108475350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55625b62c1e0 0x55625b64edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:05.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.433+0000 7facc7e00640 1 -- 172.21.15.3:0/108475350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55625b62c1e0 msgr2=0x55625b64edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:05.436 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.433+0000 7facc7e00640 1 --2- 172.21.15.3:0/108475350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55625b62c1e0 0x55625b64edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.433+0000 7facc7e00640 1 -- 172.21.15.3:0/108475350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b6373a0 msgr2=0x55625b62dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.433+0000 7facc7e00640 1 --2- 172.21.15.3:0/108475350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b6373a0 0x55625b62dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.433+0000 7facc7e00640 1 -- 172.21.15.3:0/108475350 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55625b639b00 con 0x55625b62cb00 2024-09-19T06:22:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.434+0000 7facd5600640 1 --2- 172.21.15.3:0/108475350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b6373a0 0x55625b62dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.434+0000 7facc7e00640 1 --2- 172.21.15.3:0/108475350 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55625b62cb00 0x55625b64f310 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7facb8010480 tx=0x7facb8010880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18702f8c78c2fed5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.434+0000 7facc5200640 1 -- 172.21.15.3:0/108475350 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb8028070 con 0x55625b62cb00 2024-09-19T06:22:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.434+0000 7facc5200640 1 -- 172.21.15.3:0/108475350 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facb8003fc0 con 0x55625b62cb00 2024-09-19T06:22:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.434+0000 7facc5200640 1 -- 172.21.15.3:0/108475350 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb800fc30 con 0x55625b62cb00 2024-09-19T06:22:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.435+0000 7facda600740 1 -- 172.21.15.3:0/108475350 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55625b62cb00 msgr2=0x55625b64f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.435+0000 7facda600740 1 --2- 172.21.15.3:0/108475350 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55625b62cb00 0x55625b64f310 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7facb8010480 tx=0x7facb8010880 comp rx=0 tx=0).stop 2024-09-19T06:22:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.435+0000 7facda600740 1 -- 172.21.15.3:0/108475350 shutdown_connections 2024-09-19T06:22:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.435+0000 7facda600740 1 --2- 172.21.15.3:0/108475350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b6373a0 0x55625b62dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.435+0000 7facda600740 1 --2- 172.21.15.3:0/108475350 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55625b62cb00 0x55625b64f310 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.435+0000 7facda600740 1 --2- 172.21.15.3:0/108475350 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55625b62c1e0 0x55625b64edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.435+0000 7facda600740 1 -- 172.21.15.3:0/108475350 >> 172.21.15.3:0/108475350 conn(0x55625b628750 msgr2=0x55625b628b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.435+0000 7facda600740 1 -- 172.21.15.3:0/108475350 shutdown_connections 2024-09-19T06:22:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.435+0000 7facda600740 1 -- 172.21.15.3:0/108475350 wait complete. 2024-09-19T06:22:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.435+0000 7facda600740 1 -- start start 2024-09-19T06:22:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.436+0000 7facda600740 1 Processor -- start 2024-09-19T06:22:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.436+0000 7facda600740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55625b62c1e0 0x55625b63f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.436+0000 7facda600740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b62cb00 0x55625b630ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.436+0000 7facda600740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55625b6373a0 0x55625b631530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.436+0000 7facda600740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7facd01b53f0 con 0x55625b62c1e0 2024-09-19T06:22:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.436+0000 7facda600740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7facd01b4d20 con 0x55625b62cb00 2024-09-19T06:22:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.436+0000 7facda600740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7facd01b1f80 con 0x55625b6373a0 2024-09-19T06:22:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.436+0000 7facda600740 10 client.0 _ll_register_callbacks cb 0x7facb8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.436+0000 7facd5600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55625b62c1e0 0x55625b63f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.436+0000 7facc7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b62cb00 0x55625b630ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.436+0000 7facc7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b62cb00 0x55625b630ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:60182/0 (socket says 172.21.15.3:60182) 2024-09-19T06:22:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.436+0000 7facd5600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55625b62c1e0 0x55625b63f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56302/0 (socket says 172.21.15.3:56302) 2024-09-19T06:22:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.436+0000 7facc7e00640 1 -- 172.21.15.3:0/495887854 learned_addr learned my addr 172.21.15.3:0/495887854 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.437+0000 7facd5600640 1 --2- 172.21.15.3:0/495887854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55625b6373a0 0x55625b631530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.437+0000 7facc7e00640 1 -- 172.21.15.3:0/495887854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55625b6373a0 msgr2=0x55625b631530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.437+0000 7facc7e00640 1 --2- 172.21.15.3:0/495887854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55625b6373a0 0x55625b631530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.437+0000 7facc7e00640 1 -- 172.21.15.3:0/495887854 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55625b62c1e0 msgr2=0x55625b63f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:05.441 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.437+0000 7facc7e00640 1 --2- 172.21.15.3:0/495887854 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55625b62c1e0 0x55625b63f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.437+0000 7facc7e00640 1 -- 172.21.15.3:0/495887854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55625b631d60 con 0x55625b62cb00 2024-09-19T06:22:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.437+0000 7facc7e00640 1 --2- 172.21.15.3:0/495887854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b62cb00 0x55625b630ff0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7facb8012ba0 tx=0x7facb8010d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68b33d72fc434fe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.437+0000 7facbe000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:22:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.438+0000 7facbe000640 1 -- 172.21.15.3:0/495887854 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb8039060 con 0x55625b62cb00 2024-09-19T06:22:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.438+0000 7facda600740 1 -- 172.21.15.3:0/495887854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facb8003fc0 con 0x55625b62cb00 2024-09-19T06:22:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.438+0000 7facbe000640 1 -- 172.21.15.3:0/495887854 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8615+0+0 (secure 0 0 0) 0x7facb800f9d0 con 0x55625b62cb00 2024-09-19T06:22:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.438+0000 7facbe000640 1 -- 172.21.15.3:0/495887854 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7facb8028070 con 0x55625b62cb00 2024-09-19T06:22:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.438+0000 7facda600740 10 client.28106 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.438+0000 7facda600740 1 -- 172.21.15.3:0/495887854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55625b6b1c60 con 0x55625b62cb00 2024-09-19T06:22:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.439+0000 7facbe000640 1 -- 172.21.15.3:0/495887854 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facb8003fc0 con 0x55625b62cb00 2024-09-19T06:22:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.439+0000 7facbe000640 1 -- 172.21.15.3:0/495887854 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7facb80035f0 con 0x55625b62cb00 2024-09-19T06:22:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.439+0000 7facda600740 10 client.28106 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.439+0000 7facda600740 10 client.28106 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.439+0000 7facda600740 20 client.28106 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.439+0000 7facda600740 1 --2- 172.21.15.3:0/495887854 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55625b6b2330 0x55625b6b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.439+0000 7facda600740 4 client.28106 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:22:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.439+0000 7facda600740 1 -- 172.21.15.3:0/495887854 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55625b599b80 con 0x55625b6b2330 2024-09-19T06:22:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.439+0000 7facd5600640 1 --2- 172.21.15.3:0/495887854 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55625b6b2330 0x55625b6b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.440+0000 7facd5600640 1 --2- 172.21.15.3:0/495887854 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55625b6b2330 0x55625b6b4750 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=791c30bc6f185076 server_cookie=df7eb41ff0cfe6fd in_seq=0 out_seq=0 2024-09-19T06:22:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.440+0000 7facbe000640 10 client.28106 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:05.463 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.461+0000 7facbe000640 1 -- 172.21.15.3:0/495887854 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55625b599b80 con 0x55625b6b2330 2024-09-19T06:22:05.463 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.461+0000 7facbe000640 10 client.28106 handle_command_reply: tid=0 2024-09-19T06:22:05.463 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.461+0000 7facda600740 1 client.28106 shutdown 2024-09-19T06:22:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.461+0000 7facda600740 1 -- 172.21.15.3:0/495887854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b62cb00 msgr2=0x55625b630ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.461+0000 7facda600740 1 --2- 172.21.15.3:0/495887854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b62cb00 0x55625b630ff0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7facb8012ba0 tx=0x7facb8010d60 comp rx=0 tx=0).stop 2024-09-19T06:22:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.461+0000 7facda600740 1 -- 172.21.15.3:0/495887854 shutdown_connections 2024-09-19T06:22:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.461+0000 7facda600740 1 --2- 172.21.15.3:0/495887854 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55625b6b2330 0x55625b6b4750 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.461+0000 7facda600740 1 --2- 172.21.15.3:0/495887854 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55625b6373a0 0x55625b631530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.461+0000 7facda600740 1 --2- 172.21.15.3:0/495887854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55625b62cb00 0x55625b630ff0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.461+0000 7facbe000640 0 client.28106 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.461+0000 7facda600740 1 --2- 172.21.15.3:0/495887854 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55625b62c1e0 0x55625b63f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.461+0000 7facda600740 1 -- 172.21.15.3:0/495887854 >> 172.21.15.3:0/495887854 conn(0x55625b628750 msgr2=0x55625b62dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.462+0000 7facda600740 1 -- 172.21.15.3:0/495887854 shutdown_connections 2024-09-19T06:22:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.462+0000 7facda600740 1 -- 172.21.15.3:0/495887854 wait complete. 2024-09-19T06:22:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.462+0000 7facda600740 20 client.28106 trim_cache size 0 max 16384 2024-09-19T06:22:05.465 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:22:05.465 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:22:05.465 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:22:05.465 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:22:05.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.462+0000 7facd7600640 1 -- 172.21.15.3:0/4001855623 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7facb40a33b0 msgr2=0x7facb40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:05.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.462+0000 7facd7600640 1 --2- 172.21.15.3:0/4001855623 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7facb40a33b0 0x7facb40a5870 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55625b6295b0 tx=0x7facc0000bc0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.462+0000 7facd7600640 1 -- 172.21.15.3:0/4001855623 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facd0076720 msgr2=0x7facd01a4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:05.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.462+0000 7facd7600640 1 --2- 172.21.15.3:0/4001855623 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facd0076720 0x7facd01a4660 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7facc000e9f0 tx=0x7facc000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.462+0000 7facd7600640 1 -- 172.21.15.3:0/4001855623 shutdown_connections 2024-09-19T06:22:05.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.462+0000 7facd7600640 1 --2- 172.21.15.3:0/4001855623 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7facb40a33b0 0x7facb40a5870 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.462+0000 7facd7600640 1 --2- 172.21.15.3:0/4001855623 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facd0112970 0x7facd019e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.462+0000 7facd7600640 1 --2- 172.21.15.3:0/4001855623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facd0077040 0x7facd01a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.462+0000 7facd7600640 1 --2- 172.21.15.3:0/4001855623 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facd0076720 0x7facd01a4660 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:05.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.462+0000 7facd7600640 1 -- 172.21.15.3:0/4001855623 >> 172.21.15.3:0/4001855623 conn(0x7facd00ff970 msgr2=0x7facd0101d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:05.466 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.463+0000 7facd7600640 1 -- 172.21.15.3:0/4001855623 shutdown_connections 2024-09-19T06:22:05.467 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:05.463+0000 7facd7600640 1 -- 172.21.15.3:0/4001855623 wait complete. 2024-09-19T06:22:06.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:06 smithi059 ceph-mon[35138]: pgmap v300: 97 pgs: 97 active+clean; 2.7 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 103 KiB/s wr, 40 op/s 2024-09-19T06:22:06.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:06 smithi059 ceph-mon[35138]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T06:22:06.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:06 smithi003 ceph-mon[30893]: pgmap v300: 97 pgs: 97 active+clean; 2.7 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 103 KiB/s wr, 40 op/s 2024-09-19T06:22:06.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:06 smithi003 ceph-mon[30893]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T06:22:06.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:06 smithi071 ceph-mon[35662]: pgmap v300: 97 pgs: 97 active+clean; 2.7 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 103 KiB/s wr, 40 op/s 2024-09-19T06:22:06.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:06 smithi071 ceph-mon[35662]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T06:22:08.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:08 smithi059 ceph-mon[35138]: pgmap v302: 97 pgs: 97 active+clean; 2.7 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 94 KiB/s wr, 37 op/s 2024-09-19T06:22:08.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:08 smithi003 ceph-mon[30893]: pgmap v302: 97 pgs: 97 active+clean; 2.7 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 94 KiB/s wr, 37 op/s 2024-09-19T06:22:08.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:08 smithi071 ceph-mon[35662]: pgmap v302: 97 pgs: 97 active+clean; 2.7 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 94 KiB/s wr, 37 op/s 2024-09-19T06:22:09.567 INFO:tasks.workunit.client.0.smithi003.stdout:437/600: open fd = 3 2024-09-19T06:22:09.567 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.567 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.567 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.567 INFO:tasks.workunit.client.0.smithi003.stdout:438/600: open fd = 3 2024-09-19T06:22:09.567 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.567 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.567 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.567 INFO:tasks.workunit.client.0.smithi003.stdout:439/600: open fd = 3 2024-09-19T06:22:09.567 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.567 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.567 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.568 INFO:tasks.workunit.client.0.smithi003.stdout:440/600: open fd = 3 2024-09-19T06:22:09.568 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.568 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.568 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.568 INFO:tasks.workunit.client.0.smithi003.stdout:441/600: open fd = 3 2024-09-19T06:22:09.568 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.568 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.568 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.568 INFO:tasks.workunit.client.0.smithi003.stdout:442/600: open fd = 3 2024-09-19T06:22:09.568 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.568 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.569 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.569 INFO:tasks.workunit.client.0.smithi003.stdout:443/600: open fd = 3 2024-09-19T06:22:09.569 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.569 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.569 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.569 INFO:tasks.workunit.client.0.smithi003.stdout:444/600: open fd = 3 2024-09-19T06:22:09.569 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.569 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.569 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.569 INFO:tasks.workunit.client.0.smithi003.stdout:445/600: open fd = 3 2024-09-19T06:22:09.569 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.570 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.570 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.570 INFO:tasks.workunit.client.0.smithi003.stdout:446/600: open fd = 3 2024-09-19T06:22:09.570 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.570 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.570 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.570 INFO:tasks.workunit.client.0.smithi003.stdout:447/600: open fd = 3 2024-09-19T06:22:09.570 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.570 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.570 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.570 INFO:tasks.workunit.client.0.smithi003.stdout:448/600: open fd = 3 2024-09-19T06:22:09.570 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.571 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.571 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.571 INFO:tasks.workunit.client.0.smithi003.stdout:449/600: open fd = 3 2024-09-19T06:22:09.571 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.571 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.571 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.571 INFO:tasks.workunit.client.0.smithi003.stdout:450/600: open fd = 3 2024-09-19T06:22:09.571 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.571 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.571 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.571 INFO:tasks.workunit.client.0.smithi003.stdout:451/600: open fd = 3 2024-09-19T06:22:09.572 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.572 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.572 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.572 INFO:tasks.workunit.client.0.smithi003.stdout:452/600: open fd = 3 2024-09-19T06:22:09.572 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.572 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.572 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.572 INFO:tasks.workunit.client.0.smithi003.stdout:453/600: open fd = 3 2024-09-19T06:22:09.572 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.572 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.572 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.572 INFO:tasks.workunit.client.0.smithi003.stdout:454/600: open fd = 3 2024-09-19T06:22:09.573 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.573 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.573 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.573 INFO:tasks.workunit.client.0.smithi003.stdout:455/600: open fd = 3 2024-09-19T06:22:09.573 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.573 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.573 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.573 INFO:tasks.workunit.client.0.smithi003.stdout:456/600: open fd = 3 2024-09-19T06:22:09.573 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.573 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.573 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.573 INFO:tasks.workunit.client.0.smithi003.stdout:457/600: open fd = 3 2024-09-19T06:22:09.573 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.573 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.574 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.574 INFO:tasks.workunit.client.0.smithi003.stdout:458/600: open fd = 3 2024-09-19T06:22:09.574 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.574 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.574 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.574 INFO:tasks.workunit.client.0.smithi003.stdout:459/600: open fd = 3 2024-09-19T06:22:09.574 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.574 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.574 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.574 INFO:tasks.workunit.client.0.smithi003.stdout:460/600: open fd = 3 2024-09-19T06:22:09.574 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.574 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.574 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.574 INFO:tasks.workunit.client.0.smithi003.stdout:461/600: open fd = 3 2024-09-19T06:22:09.575 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.575 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.575 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.575 INFO:tasks.workunit.client.0.smithi003.stdout:462/600: open fd = 3 2024-09-19T06:22:09.575 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.575 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.575 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.575 INFO:tasks.workunit.client.0.smithi003.stdout:463/600: open fd = 3 2024-09-19T06:22:09.575 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.575 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.575 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.575 INFO:tasks.workunit.client.0.smithi003.stdout:464/600: open fd = 3 2024-09-19T06:22:09.575 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.575 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.575 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.576 INFO:tasks.workunit.client.0.smithi003.stdout:465/600: open fd = 3 2024-09-19T06:22:09.576 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.576 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.576 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.576 INFO:tasks.workunit.client.0.smithi003.stdout:466/600: open fd = 3 2024-09-19T06:22:09.576 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.576 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.576 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.576 INFO:tasks.workunit.client.0.smithi003.stdout:467/600: open fd = 3 2024-09-19T06:22:09.576 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.576 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.576 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.576 INFO:tasks.workunit.client.0.smithi003.stdout:468/600: open fd = 3 2024-09-19T06:22:09.576 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.577 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.577 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.577 INFO:tasks.workunit.client.0.smithi003.stdout:469/600: open fd = 3 2024-09-19T06:22:09.577 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.577 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.577 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.577 INFO:tasks.workunit.client.0.smithi003.stdout:470/600: open fd = 3 2024-09-19T06:22:09.577 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.577 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.577 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.577 INFO:tasks.workunit.client.0.smithi003.stdout:471/600: open fd = 3 2024-09-19T06:22:09.577 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.577 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.577 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.578 INFO:tasks.workunit.client.0.smithi003.stdout:472/600: open fd = 3 2024-09-19T06:22:09.578 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.578 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.578 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.578 INFO:tasks.workunit.client.0.smithi003.stdout:473/600: open fd = 3 2024-09-19T06:22:09.578 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.578 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.578 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.578 INFO:tasks.workunit.client.0.smithi003.stdout:474/600: open fd = 3 2024-09-19T06:22:09.578 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.578 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.578 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.578 INFO:tasks.workunit.client.0.smithi003.stdout:475/600: open fd = 3 2024-09-19T06:22:09.579 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.579 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.579 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.579 INFO:tasks.workunit.client.0.smithi003.stdout:476/600: open fd = 3 2024-09-19T06:22:09.579 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.579 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.579 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.579 INFO:tasks.workunit.client.0.smithi003.stdout:477/600: open fd = 3 2024-09-19T06:22:09.579 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.579 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.579 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.579 INFO:tasks.workunit.client.0.smithi003.stdout:478/600: open fd = 3 2024-09-19T06:22:09.579 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.580 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.580 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.580 INFO:tasks.workunit.client.0.smithi003.stdout:479/600: open fd = 3 2024-09-19T06:22:09.580 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.580 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.580 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.580 INFO:tasks.workunit.client.0.smithi003.stdout:480/600: open fd = 3 2024-09-19T06:22:09.580 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.580 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.580 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.580 INFO:tasks.workunit.client.0.smithi003.stdout:481/600: open fd = 3 2024-09-19T06:22:09.580 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.580 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.580 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.581 INFO:tasks.workunit.client.0.smithi003.stdout:482/600: open fd = 3 2024-09-19T06:22:09.581 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.581 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.581 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.581 INFO:tasks.workunit.client.0.smithi003.stdout:483/600: open fd = 3 2024-09-19T06:22:09.581 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.581 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.581 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.581 INFO:tasks.workunit.client.0.smithi003.stdout:484/600: open fd = 3 2024-09-19T06:22:09.581 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.581 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.581 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.581 INFO:tasks.workunit.client.0.smithi003.stdout:485/600: open fd = 3 2024-09-19T06:22:09.581 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.581 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.582 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.582 INFO:tasks.workunit.client.0.smithi003.stdout:486/600: open fd = 3 2024-09-19T06:22:09.582 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.582 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.582 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.582 INFO:tasks.workunit.client.0.smithi003.stdout:487/600: open fd = 3 2024-09-19T06:22:09.582 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.582 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.582 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.582 INFO:tasks.workunit.client.0.smithi003.stdout:488/600: open fd = 3 2024-09-19T06:22:09.582 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.582 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.582 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.582 INFO:tasks.workunit.client.0.smithi003.stdout:489/600: open fd = 3 2024-09-19T06:22:09.583 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.583 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.583 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.583 INFO:tasks.workunit.client.0.smithi003.stdout:490/600: open fd = 3 2024-09-19T06:22:09.583 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.583 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.583 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.583 INFO:tasks.workunit.client.0.smithi003.stdout:491/600: open fd = 3 2024-09-19T06:22:09.583 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.583 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.583 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.583 INFO:tasks.workunit.client.0.smithi003.stdout:492/600: open fd = 3 2024-09-19T06:22:09.583 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.584 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.584 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.584 INFO:tasks.workunit.client.0.smithi003.stdout:493/600: open fd = 3 2024-09-19T06:22:09.584 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.584 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.584 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.584 INFO:tasks.workunit.client.0.smithi003.stdout:494/600: open fd = 3 2024-09-19T06:22:09.584 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.584 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.584 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.584 INFO:tasks.workunit.client.0.smithi003.stdout:495/600: open fd = 3 2024-09-19T06:22:09.584 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.584 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.585 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.585 INFO:tasks.workunit.client.0.smithi003.stdout:496/600: open fd = 3 2024-09-19T06:22:09.585 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.585 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.585 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.585 INFO:tasks.workunit.client.0.smithi003.stdout:497/600: open fd = 3 2024-09-19T06:22:09.585 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.585 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.585 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:09.585 INFO:tasks.workunit.client.0.smithi003.stdout:498/600: open fd = 3 2024-09-19T06:22:09.585 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.585 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:22:09.585 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:22:10.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:10 smithi059 ceph-mon[35138]: pgmap v303: 97 pgs: 97 active+clean; 3.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 104 KiB/s wr, 39 op/s 2024-09-19T06:22:10.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:10 smithi003 ceph-mon[30893]: pgmap v303: 97 pgs: 97 active+clean; 3.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 104 KiB/s wr, 39 op/s 2024-09-19T06:22:10.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:10 smithi071 ceph-mon[35662]: pgmap v303: 97 pgs: 97 active+clean; 3.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 104 KiB/s wr, 39 op/s 2024-09-19T06:22:12.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:12 smithi059 ceph-mon[35138]: pgmap v304: 97 pgs: 97 active+clean; 3.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 104 KiB/s wr, 39 op/s 2024-09-19T06:22:12.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:12 smithi059 ceph-mon[35138]: osdmap e97: 12 total, 12 up, 12 in 2024-09-19T06:22:12.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:12 smithi003 ceph-mon[30893]: pgmap v304: 97 pgs: 97 active+clean; 3.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 104 KiB/s wr, 39 op/s 2024-09-19T06:22:12.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:12 smithi003 ceph-mon[30893]: osdmap e97: 12 total, 12 up, 12 in 2024-09-19T06:22:12.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:12 smithi071 ceph-mon[35662]: pgmap v304: 97 pgs: 97 active+clean; 3.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 104 KiB/s wr, 39 op/s 2024-09-19T06:22:12.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:12 smithi071 ceph-mon[35662]: osdmap e97: 12 total, 12 up, 12 in 2024-09-19T06:22:14.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:14 smithi059 ceph-mon[35138]: pgmap v306: 97 pgs: 97 active+clean; 3.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 13 op/s 2024-09-19T06:22:14.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:14 smithi003 ceph-mon[30893]: pgmap v306: 97 pgs: 97 active+clean; 3.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 13 op/s 2024-09-19T06:22:14.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:14 smithi071 ceph-mon[35662]: pgmap v306: 97 pgs: 97 active+clean; 3.0 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 13 op/s 2024-09-19T06:22:16.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:16 smithi059 ceph-mon[35138]: pgmap v307: 97 pgs: 97 active+clean; 3.2 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 54 KiB/s wr, 19 op/s 2024-09-19T06:22:16.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:16 smithi003 ceph-mon[30893]: pgmap v307: 97 pgs: 97 active+clean; 3.2 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 54 KiB/s wr, 19 op/s 2024-09-19T06:22:16.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:16 smithi071 ceph-mon[35662]: pgmap v307: 97 pgs: 97 active+clean; 3.2 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 54 KiB/s wr, 19 op/s 2024-09-19T06:22:18.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:18 smithi059 ceph-mon[35138]: pgmap v308: 97 pgs: 97 active+clean; 3.2 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 51 KiB/s wr, 18 op/s 2024-09-19T06:22:18.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:18 smithi003 ceph-mon[30893]: pgmap v308: 97 pgs: 97 active+clean; 3.2 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 51 KiB/s wr, 18 op/s 2024-09-19T06:22:18.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:18 smithi071 ceph-mon[35662]: pgmap v308: 97 pgs: 97 active+clean; 3.2 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 51 KiB/s wr, 18 op/s 2024-09-19T06:22:18.596 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.595+0000 7f9666000640 1 -- 172.21.15.3:0/3502159301 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9660109bf0 msgr2=0x7f9660109fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:18.596 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.595+0000 7f9666000640 1 --2- 172.21.15.3:0/3502159301 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9660109bf0 0x7f9660109fd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9654009930 tx=0x7f965402a420 comp rx=0 tx=0).stop 2024-09-19T06:22:18.596 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.595+0000 7f9666000640 1 -- 172.21.15.3:0/3502159301 shutdown_connections 2024-09-19T06:22:18.596 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.595+0000 7f9666000640 1 --2- 172.21.15.3:0/3502159301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96601044d0 0x7f96601109b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.596 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.595+0000 7f9666000640 1 --2- 172.21.15.3:0/3502159301 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9660103b30 0x7f9660103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.597 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.595+0000 7f9666000640 1 --2- 172.21.15.3:0/3502159301 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9660109bf0 0x7f9660109fd0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.597 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.595+0000 7f9666000640 1 -- 172.21.15.3:0/3502159301 >> 172.21.15.3:0/3502159301 conn(0x7f96600ff810 msgr2=0x7f9660101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:18.597 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.595+0000 7f9666000640 1 -- 172.21.15.3:0/3502159301 shutdown_connections 2024-09-19T06:22:18.597 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.595+0000 7f9666000640 1 -- 172.21.15.3:0/3502159301 wait complete. 2024-09-19T06:22:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.596+0000 7f9666000640 1 Processor -- start 2024-09-19T06:22:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.596+0000 7f9666000640 1 -- start start 2024-09-19T06:22:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.597+0000 7f9666000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9660103b30 0x7f966019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.597+0000 7f9666000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96601044d0 0x7f966019a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.597+0000 7f9666000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9660109bf0 0x7f966019ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.597+0000 7f9666000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9660113f90 con 0x7f9660109bf0 2024-09-19T06:22:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.597+0000 7f9666000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9660113e10 con 0x7f9660103b30 2024-09-19T06:22:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.597+0000 7f9666000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9660114110 con 0x7f96601044d0 2024-09-19T06:22:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.597+0000 7f9665600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9660109bf0 0x7f966019ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:18.598 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.597+0000 7f9665600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9660109bf0 0x7f966019ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37332/0 (socket says 172.21.15.3:37332) 2024-09-19T06:22:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.597+0000 7f9665600640 1 -- 172.21.15.3:0/1977300294 learned_addr learned my addr 172.21.15.3:0/1977300294 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.597+0000 7f965fe00640 1 --2- 172.21.15.3:0/1977300294 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96601044d0 0x7f966019a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:18.599 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.597+0000 7f9664c00640 1 --2- 172.21.15.3:0/1977300294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9660103b30 0x7f966019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.598+0000 7f9665600640 1 -- 172.21.15.3:0/1977300294 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96601044d0 msgr2=0x7f966019a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.598+0000 7f9665600640 1 --2- 172.21.15.3:0/1977300294 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96601044d0 0x7f966019a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.598+0000 7f9665600640 1 -- 172.21.15.3:0/1977300294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9660103b30 msgr2=0x7f966019a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.598+0000 7f9665600640 1 --2- 172.21.15.3:0/1977300294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9660103b30 0x7f966019a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.598+0000 7f9665600640 1 -- 172.21.15.3:0/1977300294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f966019f470 con 0x7f9660109bf0 2024-09-19T06:22:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.598+0000 7f9665600640 1 --2- 172.21.15.3:0/1977300294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9660109bf0 0x7f966019ed40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f965800eb10 tx=0x7f965800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.598+0000 7f965d600640 1 -- 172.21.15.3:0/1977300294 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9658004b20 con 0x7f9660109bf0 2024-09-19T06:22:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.598+0000 7f965d600640 1 -- 172.21.15.3:0/1977300294 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9658004cc0 con 0x7f9660109bf0 2024-09-19T06:22:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.598+0000 7f9666000640 1 -- 172.21.15.3:0/1977300294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f966019f760 con 0x7f9660109bf0 2024-09-19T06:22:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.598+0000 7f965d600640 1 -- 172.21.15.3:0/1977300294 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9658010760 con 0x7f9660109bf0 2024-09-19T06:22:18.600 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.598+0000 7f9666000640 1 -- 172.21.15.3:0/1977300294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96601a6ff0 con 0x7f9660109bf0 2024-09-19T06:22:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.601+0000 7f966a499740 1 Processor -- start 2024-09-19T06:22:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.601+0000 7f965d600640 1 -- 172.21.15.3:0/1977300294 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f9658005020 con 0x7f9660109bf0 2024-09-19T06:22:18.602 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.602+0000 7f966a499740 1 -- start start 2024-09-19T06:22:18.604 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.602+0000 7f966a499740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d3a7853b0 0x563d3a785790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:18.604 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.602+0000 7f966a499740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a785cd0 0x563d3a790030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:18.604 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.602+0000 7f966a499740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a790570 0x563d3a792960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:18.604 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.602+0000 7f966a499740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563d3a6eb100 con 0x563d3a790570 2024-09-19T06:22:18.604 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.602+0000 7f966a499740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563d3a6931b0 con 0x563d3a785cd0 2024-09-19T06:22:18.604 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.602+0000 7f966a499740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563d3a6e70c0 con 0x563d3a7853b0 2024-09-19T06:22:18.604 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.602+0000 7f965fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a790570 0x563d3a792960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:18.604 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.602+0000 7f965fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a790570 0x563d3a792960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37348/0 (socket says 172.21.15.3:37348) 2024-09-19T06:22:18.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.602+0000 7f965fe00640 1 -- 172.21.15.3:0/2206661055 learned_addr learned my addr 172.21.15.3:0/2206661055 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:18.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.602+0000 7f9664c00640 1 --2- 172.21.15.3:0/2206661055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a785cd0 0x563d3a790030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:18.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.602+0000 7f965fe00640 1 --2- 172.21.15.3:0/2206661055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d3a7853b0 0x563d3a785790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:18.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.603+0000 7f965fe00640 1 -- 172.21.15.3:0/2206661055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d3a7853b0 msgr2=0x563d3a785790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:18.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.603+0000 7f965fe00640 1 --2- 172.21.15.3:0/2206661055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d3a7853b0 0x563d3a785790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.603+0000 7f965fe00640 1 -- 172.21.15.3:0/2206661055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a785cd0 msgr2=0x563d3a790030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:18.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.603+0000 7f965fe00640 1 --2- 172.21.15.3:0/2206661055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a785cd0 0x563d3a790030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.603+0000 7f965fe00640 1 -- 172.21.15.3:0/2206661055 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d3a3fe210 con 0x563d3a790570 2024-09-19T06:22:18.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.603+0000 7f965fe00640 1 --2- 172.21.15.3:0/2206661055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a790570 0x563d3a792960 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f964c0058c0 tx=0x7f964c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb8da9f39509ad6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:18.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.603+0000 7f9651c00640 1 -- 172.21.15.3:0/2206661055 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c004030 con 0x563d3a790570 2024-09-19T06:22:18.605 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.603+0000 7f9651c00640 1 -- 172.21.15.3:0/2206661055 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f964c005500 con 0x563d3a790570 2024-09-19T06:22:18.606 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.603+0000 7f9651c00640 1 -- 172.21.15.3:0/2206661055 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c004d70 con 0x563d3a790570 2024-09-19T06:22:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.604+0000 7f965d600640 1 --2- 172.21.15.3:0/1977300294 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f96480a33a0 0x7f96480a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.604+0000 7f966a499740 1 -- 172.21.15.3:0/2206661055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a790570 msgr2=0x563d3a792960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.604+0000 7f966a499740 1 --2- 172.21.15.3:0/2206661055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a790570 0x563d3a792960 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f964c0058c0 tx=0x7f964c005850 comp rx=0 tx=0).stop 2024-09-19T06:22:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.604+0000 7f965d600640 1 -- 172.21.15.3:0/1977300294 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f96580d03e0 con 0x7f9660109bf0 2024-09-19T06:22:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.604+0000 7f966a499740 1 -- 172.21.15.3:0/2206661055 shutdown_connections 2024-09-19T06:22:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.604+0000 7f966a499740 1 --2- 172.21.15.3:0/2206661055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a790570 0x563d3a792960 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.609 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.604+0000 7f966a499740 1 --2- 172.21.15.3:0/2206661055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a785cd0 0x563d3a790030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.610 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.604+0000 7f966a499740 1 --2- 172.21.15.3:0/2206661055 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d3a7853b0 0x563d3a785790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.610 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.604+0000 7f966a499740 1 -- 172.21.15.3:0/2206661055 >> 172.21.15.3:0/2206661055 conn(0x563d3a781920 msgr2=0x563d3a781d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:18.610 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.604+0000 7f9664c00640 1 --2- 172.21.15.3:0/1977300294 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f96480a33a0 0x7f96480a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:18.610 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.604+0000 7f966a499740 1 -- 172.21.15.3:0/2206661055 shutdown_connections 2024-09-19T06:22:18.610 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.604+0000 7f966a499740 1 -- 172.21.15.3:0/2206661055 wait complete. 2024-09-19T06:22:18.610 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.605+0000 7f966a499740 1 -- start start 2024-09-19T06:22:18.610 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.605+0000 7f9664c00640 1 --2- 172.21.15.3:0/1977300294 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f96480a33a0 0x7f96480a5860 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9654006010 tx=0x7f9654000bc0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:18.610 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.605+0000 7f966a499740 1 Processor -- start 2024-09-19T06:22:18.610 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.605+0000 7f966a499740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a7853b0 0x563d3a78d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:18.610 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.605+0000 7f966a499740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d3a785cd0 0x563d3a78db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:18.610 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.605+0000 7f966a499740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a790570 0x563d3a78e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:18.610 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.605+0000 7f966a499740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563d3a792ff0 con 0x563d3a7853b0 2024-09-19T06:22:18.611 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.605+0000 7f966a499740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563d3a674090 con 0x563d3a790570 2024-09-19T06:22:18.611 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.605+0000 7f966a499740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563d3a793170 con 0x563d3a785cd0 2024-09-19T06:22:18.611 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.605+0000 7f966a499740 10 client.0 _ll_register_callbacks cb 0x563d3a6c8f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:18.611 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.606+0000 7f9664c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a7853b0 0x563d3a78d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:18.611 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.606+0000 7f9665600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a790570 0x563d3a78e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:18.611 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.606+0000 7f9665600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a790570 0x563d3a78e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:45254/0 (socket says 172.21.15.3:45254) 2024-09-19T06:22:18.611 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.606+0000 7f9665600640 1 -- 172.21.15.3:0/1991353635 learned_addr learned my addr 172.21.15.3:0/1991353635 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:18.611 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.606+0000 7f9664c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a7853b0 0x563d3a78d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37362/0 (socket says 172.21.15.3:37362) 2024-09-19T06:22:18.611 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.606+0000 7f965fe00640 1 --2- 172.21.15.3:0/1991353635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d3a785cd0 0x563d3a78db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:18.611 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.606+0000 7f9665600640 1 -- 172.21.15.3:0/1991353635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d3a785cd0 msgr2=0x563d3a78db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:18.611 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.606+0000 7f9665600640 1 --2- 172.21.15.3:0/1991353635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d3a785cd0 0x563d3a78db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.611 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.606+0000 7f9665600640 1 -- 172.21.15.3:0/1991353635 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a7853b0 msgr2=0x563d3a78d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:18.611 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.606+0000 7f9665600640 1 --2- 172.21.15.3:0/1991353635 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a7853b0 0x563d3a78d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.611 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.606+0000 7f9665600640 1 -- 172.21.15.3:0/1991353635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d3a4ca620 con 0x563d3a790570 2024-09-19T06:22:18.612 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.606+0000 7f9665600640 1 --2- 172.21.15.3:0/1991353635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a790570 0x563d3a78e0c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f96580a4d70 tx=0x7f965809c230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15adef8345d7de67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:18.612 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.606+0000 7f9646000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:22:18.612 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.607+0000 7f9646000640 1 -- 172.21.15.3:0/1991353635 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9658005510 con 0x563d3a790570 2024-09-19T06:22:18.612 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.607+0000 7f9646000640 1 -- 172.21.15.3:0/1991353635 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f965809ba80 con 0x563d3a790570 2024-09-19T06:22:18.612 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.607+0000 7f966a499740 1 -- 172.21.15.3:0/1991353635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f964c005500 con 0x563d3a790570 2024-09-19T06:22:18.612 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.607+0000 7f9646000640 1 -- 172.21.15.3:0/1991353635 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f96580a09e0 con 0x563d3a790570 2024-09-19T06:22:18.612 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.607+0000 7f966a499740 10 client.28118 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:18.612 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.607+0000 7f966a499740 1 -- 172.21.15.3:0/1991353635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563d3a79eec0 con 0x563d3a790570 2024-09-19T06:22:18.612 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.607+0000 7f9646000640 1 -- 172.21.15.3:0/1991353635 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f964c005500 con 0x563d3a790570 2024-09-19T06:22:18.612 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.607+0000 7f9646000640 1 -- 172.21.15.3:0/1991353635 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f965809b4f0 con 0x563d3a790570 2024-09-19T06:22:18.612 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.607+0000 7f966a499740 10 client.28118 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:18.612 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.607+0000 7f966a499740 10 client.28118 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:18.612 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.608+0000 7f966a499740 20 client.28118 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:18.613 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.608+0000 7f966a499740 1 --2- 172.21.15.3:0/1991353635 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563d3a7a0380 0x563d3a7a2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:18.613 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.608+0000 7f966a499740 4 client.28118 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:18.613 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.608+0000 7f966a499740 1 -- 172.21.15.3:0/1991353635 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d3a6f8830 con 0x563d3a7a0380 2024-09-19T06:22:18.613 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.608+0000 7f9664c00640 1 --2- 172.21.15.3:0/1991353635 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563d3a7a0380 0x563d3a7a2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:18.613 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.608+0000 7f9664c00640 1 --2- 172.21.15.3:0/1991353635 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563d3a7a0380 0x563d3a7a2790 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75c329446889bc57 server_cookie=a2c24b6778c2768f in_seq=0 out_seq=0 2024-09-19T06:22:18.613 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.608+0000 7f9646000640 10 client.28118 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.609+0000 7f9646000640 1 -- 172.21.15.3:0/1991353635 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563d3a6f8830 con 0x563d3a7a0380 2024-09-19T06:22:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.609+0000 7f9646000640 10 client.28118 handle_command_reply: tid=0 2024-09-19T06:22:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.609+0000 7f966a499740 1 client.28118 shutdown 2024-09-19T06:22:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.609+0000 7f966a499740 1 -- 172.21.15.3:0/1991353635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a790570 msgr2=0x563d3a78e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.609+0000 7f966a499740 1 --2- 172.21.15.3:0/1991353635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a790570 0x563d3a78e0c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f96580a4d70 tx=0x7f965809c230 comp rx=0 tx=0).stop 2024-09-19T06:22:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.610+0000 7f966a499740 1 -- 172.21.15.3:0/1991353635 shutdown_connections 2024-09-19T06:22:18.614 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.610+0000 7f966a499740 1 --2- 172.21.15.3:0/1991353635 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563d3a7a0380 0x563d3a7a2790 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.610+0000 7f966a499740 1 --2- 172.21.15.3:0/1991353635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a790570 0x563d3a78e0c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.610+0000 7f9646000640 0 client.28118 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.610+0000 7f966a499740 1 --2- 172.21.15.3:0/1991353635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d3a785cd0 0x563d3a78db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.610+0000 7f966a499740 1 --2- 172.21.15.3:0/1991353635 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a7853b0 0x563d3a78d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.610+0000 7f966a499740 1 -- 172.21.15.3:0/1991353635 >> 172.21.15.3:0/1991353635 conn(0x563d3a781920 msgr2=0x563d3a7876a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.610+0000 7f966a499740 1 -- 172.21.15.3:0/1991353635 shutdown_connections 2024-09-19T06:22:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.610+0000 7f966a499740 1 -- 172.21.15.3:0/1991353635 wait complete. 2024-09-19T06:22:18.615 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.610+0000 7f966a499740 20 client.28118 trim_cache size 0 max 16384 2024-09-19T06:22:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.625+0000 7f966a499740 1 Processor -- start 2024-09-19T06:22:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.625+0000 7f966a499740 1 -- start start 2024-09-19T06:22:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.625+0000 7f966a499740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a7853b0 0x563d3a7811b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.625+0000 7f966a499740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d3a785cd0 0x563d3a787590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.625+0000 7f966a499740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a790570 0x563d3a7a80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.625+0000 7f966a499740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f96601afaa0 con 0x563d3a790570 2024-09-19T06:22:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.625+0000 7f966a499740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f96601b15e0 con 0x563d3a7853b0 2024-09-19T06:22:18.626 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.625+0000 7f966a499740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f96601b0170 con 0x563d3a785cd0 2024-09-19T06:22:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.626+0000 7f9665600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a790570 0x563d3a7a80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.626+0000 7f9664c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a7853b0 0x563d3a7811b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:18.628 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.626+0000 7f9664c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a7853b0 0x563d3a7811b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:45256/0 (socket says 172.21.15.3:45256) 2024-09-19T06:22:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.626+0000 7f9664c00640 1 -- 172.21.15.3:0/3579355003 learned_addr learned my addr 172.21.15.3:0/3579355003 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.626+0000 7f965fe00640 1 --2- 172.21.15.3:0/3579355003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d3a785cd0 0x563d3a787590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.626+0000 7f9664c00640 1 -- 172.21.15.3:0/3579355003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d3a785cd0 msgr2=0x563d3a787590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.626+0000 7f9664c00640 1 --2- 172.21.15.3:0/3579355003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d3a785cd0 0x563d3a787590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.626+0000 7f9664c00640 1 -- 172.21.15.3:0/3579355003 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a790570 msgr2=0x563d3a7a80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.626+0000 7f9664c00640 1 --2- 172.21.15.3:0/3579355003 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a790570 0x563d3a7a80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.626+0000 7f9664c00640 1 -- 172.21.15.3:0/3579355003 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d3a782ab0 con 0x563d3a7853b0 2024-09-19T06:22:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.626+0000 7f9665600640 1 --2- 172.21.15.3:0/3579355003 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a790570 0x563d3a7a80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.626+0000 7f9664c00640 1 --2- 172.21.15.3:0/3579355003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a7853b0 0x563d3a7811b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9654054fd0 tx=0x7f965403f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4711b4eb9ab41e12 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.627+0000 7f9651200640 1 -- 172.21.15.3:0/3579355003 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9654035040 con 0x563d3a7853b0 2024-09-19T06:22:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.627+0000 7f9651200640 1 -- 172.21.15.3:0/3579355003 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f965405a070 con 0x563d3a7853b0 2024-09-19T06:22:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.627+0000 7f9651200640 1 -- 172.21.15.3:0/3579355003 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96540035f0 con 0x563d3a7853b0 2024-09-19T06:22:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.627+0000 7f966a499740 1 -- 172.21.15.3:0/3579355003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a7853b0 msgr2=0x563d3a7811b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:18.629 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.627+0000 7f966a499740 1 --2- 172.21.15.3:0/3579355003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a7853b0 0x563d3a7811b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9654054fd0 tx=0x7f965403f000 comp rx=0 tx=0).stop 2024-09-19T06:22:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.627+0000 7f966a499740 1 -- 172.21.15.3:0/3579355003 shutdown_connections 2024-09-19T06:22:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.627+0000 7f966a499740 1 --2- 172.21.15.3:0/3579355003 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a790570 0x563d3a7a80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.627+0000 7f966a499740 1 --2- 172.21.15.3:0/3579355003 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d3a785cd0 0x563d3a787590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.627+0000 7f966a499740 1 --2- 172.21.15.3:0/3579355003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a7853b0 0x563d3a7811b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.627+0000 7f966a499740 1 -- 172.21.15.3:0/3579355003 >> 172.21.15.3:0/3579355003 conn(0x563d3a781920 msgr2=0x563d3a786e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.627+0000 7f966a499740 1 -- 172.21.15.3:0/3579355003 shutdown_connections 2024-09-19T06:22:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.627+0000 7f966a499740 1 -- 172.21.15.3:0/3579355003 wait complete. 2024-09-19T06:22:18.630 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.628+0000 7f966a499740 1 -- start start 2024-09-19T06:22:18.632 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.628+0000 7f966a499740 1 Processor -- start 2024-09-19T06:22:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.628+0000 7f966a499740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a7853b0 0x563d3a7984a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.628+0000 7f966a499740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d3a785cd0 0x563d3a7989e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.629+0000 7f966a499740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a790570 0x563d3a795470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.629+0000 7f966a499740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f96601b0f10 con 0x563d3a7853b0 2024-09-19T06:22:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.629+0000 7f966a499740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f96601b0840 con 0x563d3a790570 2024-09-19T06:22:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.629+0000 7f966a499740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f96601adaa0 con 0x563d3a785cd0 2024-09-19T06:22:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.629+0000 7f966a499740 10 client.0 _ll_register_callbacks cb 0x7f9658098940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.629+0000 7f9664c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a7853b0 0x563d3a7984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.629+0000 7f9665600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a790570 0x563d3a795470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.629+0000 7f9664c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a7853b0 0x563d3a7984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:37390/0 (socket says 172.21.15.3:37390) 2024-09-19T06:22:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.629+0000 7f9664c00640 1 -- 172.21.15.3:0/2582422039 learned_addr learned my addr 172.21.15.3:0/2582422039 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.629+0000 7f965fe00640 1 --2- 172.21.15.3:0/2582422039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d3a785cd0 0x563d3a7989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:18.633 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.629+0000 7f9665600640 1 -- 172.21.15.3:0/2582422039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d3a785cd0 msgr2=0x563d3a7989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.629+0000 7f9665600640 1 --2- 172.21.15.3:0/2582422039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d3a785cd0 0x563d3a7989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.629+0000 7f9665600640 1 -- 172.21.15.3:0/2582422039 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a7853b0 msgr2=0x563d3a7984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.629+0000 7f9665600640 1 --2- 172.21.15.3:0/2582422039 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a7853b0 0x563d3a7984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.629+0000 7f9665600640 1 -- 172.21.15.3:0/2582422039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d3a78b580 con 0x563d3a790570 2024-09-19T06:22:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.629+0000 7f9664c00640 1 --2- 172.21.15.3:0/2582422039 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a7853b0 0x563d3a7984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.629+0000 7f9665600640 1 --2- 172.21.15.3:0/2582422039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a790570 0x563d3a795470 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9658099000 tx=0x7f965809c2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c84f8adc9b14b34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.629+0000 7f9646000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:22:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.630+0000 7f9646000640 1 -- 172.21.15.3:0/2582422039 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9658005510 con 0x563d3a790570 2024-09-19T06:22:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.630+0000 7f966a499740 1 -- 172.21.15.3:0/2582422039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f965405a070 con 0x563d3a790570 2024-09-19T06:22:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.630+0000 7f9646000640 1 -- 172.21.15.3:0/2582422039 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f96580b0b50 con 0x563d3a790570 2024-09-19T06:22:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.630+0000 7f9646000640 1 -- 172.21.15.3:0/2582422039 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f96580a1f40 con 0x563d3a790570 2024-09-19T06:22:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.630+0000 7f966a499740 10 client.28124 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.630+0000 7f966a499740 1 -- 172.21.15.3:0/2582422039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563d3a80b570 con 0x563d3a790570 2024-09-19T06:22:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.630+0000 7f9646000640 1 -- 172.21.15.3:0/2582422039 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f965405a070 con 0x563d3a790570 2024-09-19T06:22:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.630+0000 7f9646000640 1 -- 172.21.15.3:0/2582422039 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f965807e020 con 0x563d3a790570 2024-09-19T06:22:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.630+0000 7f966a499740 10 client.28124 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.630+0000 7f966a499740 10 client.28124 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.630+0000 7f966a499740 20 client.28124 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.630+0000 7f966a499740 1 --2- 172.21.15.3:0/2582422039 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563d3a80bb50 0x563d3a80df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.630+0000 7f966a499740 4 client.28124 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:22:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.630+0000 7f966a499740 1 -- 172.21.15.3:0/2582422039 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563d3a6f2b80 con 0x563d3a80bb50 2024-09-19T06:22:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.631+0000 7f9664c00640 1 --2- 172.21.15.3:0/2582422039 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563d3a80bb50 0x563d3a80df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.631+0000 7f9664c00640 1 --2- 172.21.15.3:0/2582422039 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563d3a80bb50 0x563d3a80df40 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1084668c86e8613 server_cookie=7631ee3e375a9b0d in_seq=0 out_seq=0 2024-09-19T06:22:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.631+0000 7f9646000640 10 client.28124 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.650+0000 7f9646000640 1 -- 172.21.15.3:0/2582422039 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563d3a6f2b80 con 0x563d3a80bb50 2024-09-19T06:22:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.650+0000 7f9646000640 10 client.28124 handle_command_reply: tid=0 2024-09-19T06:22:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.650+0000 7f966a499740 1 client.28124 shutdown 2024-09-19T06:22:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.650+0000 7f966a499740 1 -- 172.21.15.3:0/2582422039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a790570 msgr2=0x563d3a795470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.650+0000 7f966a499740 1 --2- 172.21.15.3:0/2582422039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a790570 0x563d3a795470 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9658099000 tx=0x7f965809c2a0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.650+0000 7f966a499740 1 -- 172.21.15.3:0/2582422039 shutdown_connections 2024-09-19T06:22:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.650+0000 7f966a499740 1 --2- 172.21.15.3:0/2582422039 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563d3a80bb50 0x563d3a80df40 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.650+0000 7f966a499740 1 --2- 172.21.15.3:0/2582422039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563d3a790570 0x563d3a795470 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.650+0000 7f966a499740 1 --2- 172.21.15.3:0/2582422039 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563d3a785cd0 0x563d3a7989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.650+0000 7f9646000640 0 client.28124 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.650+0000 7f966a499740 1 --2- 172.21.15.3:0/2582422039 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563d3a7853b0 0x563d3a7984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.650+0000 7f966a499740 1 -- 172.21.15.3:0/2582422039 >> 172.21.15.3:0/2582422039 conn(0x563d3a781920 msgr2=0x563d3a78de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.651+0000 7f966a499740 1 -- 172.21.15.3:0/2582422039 shutdown_connections 2024-09-19T06:22:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.651+0000 7f966a499740 1 -- 172.21.15.3:0/2582422039 wait complete. 2024-09-19T06:22:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.651+0000 7f966a499740 20 client.28124 trim_cache size 0 max 16384 2024-09-19T06:22:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:22:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:22:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:22:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:22:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.652+0000 7f9666000640 1 -- 172.21.15.3:0/1977300294 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f96480a33a0 msgr2=0x7f96480a5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.652+0000 7f9666000640 1 --2- 172.21.15.3:0/1977300294 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f96480a33a0 0x7f96480a5860 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9654006010 tx=0x7f9654000bc0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.652+0000 7f9666000640 1 -- 172.21.15.3:0/1977300294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9660109bf0 msgr2=0x7f966019ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.652+0000 7f9666000640 1 --2- 172.21.15.3:0/1977300294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9660109bf0 0x7f966019ed40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f965800eb10 tx=0x7f965800c2d0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.652+0000 7f9666000640 1 -- 172.21.15.3:0/1977300294 shutdown_connections 2024-09-19T06:22:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.652+0000 7f9666000640 1 --2- 172.21.15.3:0/1977300294 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f96480a33a0 0x7f96480a5860 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.652+0000 7f9666000640 1 --2- 172.21.15.3:0/1977300294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9660109bf0 0x7f966019ed40 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.652+0000 7f9666000640 1 --2- 172.21.15.3:0/1977300294 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f96601044d0 0x7f966019a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.652+0000 7f9666000640 1 --2- 172.21.15.3:0/1977300294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9660103b30 0x7f966019a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.652+0000 7f9666000640 1 -- 172.21.15.3:0/1977300294 >> 172.21.15.3:0/1977300294 conn(0x7f96600ff810 msgr2=0x7f9660100ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.652+0000 7f9666000640 1 -- 172.21.15.3:0/1977300294 shutdown_connections 2024-09-19T06:22:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:18.652+0000 7f9666000640 1 -- 172.21.15.3:0/1977300294 wait complete. 2024-09-19T06:22:20.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:20 smithi059 ceph-mon[35138]: pgmap v309: 97 pgs: 97 active+clean; 3.4 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:22:20.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:20 smithi003 ceph-mon[30893]: pgmap v309: 97 pgs: 97 active+clean; 3.4 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:22:20.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:20 smithi071 ceph-mon[35662]: pgmap v309: 97 pgs: 97 active+clean; 3.4 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:22:22.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:22 smithi059 ceph-mon[35138]: pgmap v310: 97 pgs: 97 active+clean; 3.4 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:22:22.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:22 smithi003 ceph-mon[30893]: pgmap v310: 97 pgs: 97 active+clean; 3.4 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:22:22.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:22 smithi071 ceph-mon[35662]: pgmap v310: 97 pgs: 97 active+clean; 3.4 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:22:24.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:24 smithi059 ceph-mon[35138]: pgmap v311: 97 pgs: 97 active+clean; 3.4 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 39 KiB/s wr, 14 op/s 2024-09-19T06:22:24.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:24 smithi003 ceph-mon[30893]: pgmap v311: 97 pgs: 97 active+clean; 3.4 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 39 KiB/s wr, 14 op/s 2024-09-19T06:22:24.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:24 smithi071 ceph-mon[35662]: pgmap v311: 97 pgs: 97 active+clean; 3.4 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 39 KiB/s wr, 14 op/s 2024-09-19T06:22:26.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:26 smithi059 ceph-mon[35138]: pgmap v312: 97 pgs: 97 active+clean; 3.6 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-19T06:22:26.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:26 smithi003 ceph-mon[30893]: pgmap v312: 97 pgs: 97 active+clean; 3.6 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-19T06:22:26.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:26 smithi071 ceph-mon[35662]: pgmap v312: 97 pgs: 97 active+clean; 3.6 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-19T06:22:28.102 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:22:28.493 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:28.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:28 smithi059 ceph-mon[35138]: pgmap v313: 97 pgs: 97 active+clean; 3.6 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:22:28.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:28 smithi003 ceph-mon[30893]: pgmap v313: 97 pgs: 97 active+clean; 3.6 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:22:28.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:28 smithi071 ceph-mon[35662]: pgmap v313: 97 pgs: 97 active+clean; 3.6 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 15 op/s 2024-09-19T06:22:29.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.127+0000 7f94d4200640 1 -- 172.21.15.3:0/1629120710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94cc106f20 msgr2=0x7f94cc10eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:29.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.127+0000 7f94d4200640 1 --2- 172.21.15.3:0/1629120710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94cc106f20 0x7f94cc10eaa0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f94c4009900 tx=0x7f94c402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.127+0000 7f94d4200640 1 -- 172.21.15.3:0/1629120710 shutdown_connections 2024-09-19T06:22:29.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.127+0000 7f94d4200640 1 --2- 172.21.15.3:0/1629120710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94cc106f20 0x7f94cc10eaa0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.127+0000 7f94d4200640 1 --2- 172.21.15.3:0/1629120710 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94cc1027a0 0x7f94cc1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.127+0000 7f94d4200640 1 --2- 172.21.15.3:0/1629120710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94cc101df0 0x7f94cc1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.127+0000 7f94d4200640 1 -- 172.21.15.3:0/1629120710 >> 172.21.15.3:0/1629120710 conn(0x7f94cc0fd8b0 msgr2=0x7f94cc0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:29.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.127+0000 7f94d4200640 1 -- 172.21.15.3:0/1629120710 shutdown_connections 2024-09-19T06:22:29.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.127+0000 7f94d4200640 1 -- 172.21.15.3:0/1629120710 wait complete. 2024-09-19T06:22:29.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.128+0000 7f94d4200640 1 Processor -- start 2024-09-19T06:22:29.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.128+0000 7f94d4200640 1 -- start start 2024-09-19T06:22:29.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.129+0000 7f94d4200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94cc101df0 0x7f94cc1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.129+0000 7f94d4200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94cc1027a0 0x7f94cc198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.129+0000 7f94d4200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94cc106f20 0x7f94cc19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.129+0000 7f94d4200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc111fd0 con 0x7f94cc101df0 2024-09-19T06:22:29.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.129+0000 7f94d4200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc111e50 con 0x7f94cc106f20 2024-09-19T06:22:29.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.129+0000 7f94d4200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc112150 con 0x7f94cc1027a0 2024-09-19T06:22:29.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.129+0000 7f94d1800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94cc101df0 0x7f94cc1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.129+0000 7f94d1800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94cc101df0 0x7f94cc1983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58382/0 (socket says 172.21.15.3:58382) 2024-09-19T06:22:29.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.129+0000 7f94d1800640 1 -- 172.21.15.3:0/3045342416 learned_addr learned my addr 172.21.15.3:0/3045342416 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:29.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.129+0000 7f94d2200640 1 --2- 172.21.15.3:0/3045342416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94cc106f20 0x7f94cc19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.129+0000 7f94d0e00640 1 --2- 172.21.15.3:0/3045342416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94cc1027a0 0x7f94cc198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.129+0000 7f94d1800640 1 -- 172.21.15.3:0/3045342416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94cc1027a0 msgr2=0x7f94cc198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:29.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.129+0000 7f94d1800640 1 --2- 172.21.15.3:0/3045342416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94cc1027a0 0x7f94cc198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.129+0000 7f94d1800640 1 -- 172.21.15.3:0/3045342416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94cc106f20 msgr2=0x7f94cc19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:29.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.129+0000 7f94d1800640 1 --2- 172.21.15.3:0/3045342416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94cc106f20 0x7f94cc19cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.129+0000 7f94d1800640 1 -- 172.21.15.3:0/3045342416 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94cc19d380 con 0x7f94cc101df0 2024-09-19T06:22:29.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.130+0000 7f94d1800640 1 --2- 172.21.15.3:0/3045342416 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94cc101df0 0x7f94cc1983d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f94c000ebc0 tx=0x7f94c000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:29.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.130+0000 7f94ca000640 1 -- 172.21.15.3:0/3045342416 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c0010630 con 0x7f94cc101df0 2024-09-19T06:22:29.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.130+0000 7f94ca000640 1 -- 172.21.15.3:0/3045342416 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94c0010cb0 con 0x7f94cc101df0 2024-09-19T06:22:29.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.130+0000 7f94d4200640 1 -- 172.21.15.3:0/3045342416 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94cc19d670 con 0x7f94cc101df0 2024-09-19T06:22:29.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.130+0000 7f94ca000640 1 -- 172.21.15.3:0/3045342416 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c0018bd0 con 0x7f94cc101df0 2024-09-19T06:22:29.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.130+0000 7f94d4200640 1 -- 172.21.15.3:0/3045342416 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94cc1a4f50 con 0x7f94cc101df0 2024-09-19T06:22:29.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.133+0000 7f94ca000640 1 -- 172.21.15.3:0/3045342416 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f94c00107d0 con 0x7f94cc101df0 2024-09-19T06:22:29.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.133+0000 7f94d6ca1740 1 Processor -- start 2024-09-19T06:22:29.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.134+0000 7f94d6ca1740 1 -- start start 2024-09-19T06:22:29.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.134+0000 7f94d6ca1740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeaab90 0x562a7aeaaf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.134+0000 7f94d6ca1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a7aeab4b0 0x562a7aeb5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.134+0000 7f94d6ca1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a7aeb5d70 0x562a7aeb8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.134+0000 7f94d6ca1740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562a7ae113e0 con 0x562a7aeaab90 2024-09-19T06:22:29.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.134+0000 7f94d6ca1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562a7adb8d80 con 0x562a7aeab4b0 2024-09-19T06:22:29.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.134+0000 7f94d6ca1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562a7ae0d3a0 con 0x562a7aeb5d70 2024-09-19T06:22:29.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.134+0000 7f94d2200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeaab90 0x562a7aeaaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.134+0000 7f94d2200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeaab90 0x562a7aeaaf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58394/0 (socket says 172.21.15.3:58394) 2024-09-19T06:22:29.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.134+0000 7f94d2200640 1 -- 172.21.15.3:0/1796507833 learned_addr learned my addr 172.21.15.3:0/1796507833 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.134+0000 7f94d0e00640 1 --2- 172.21.15.3:0/1796507833 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a7aeb5d70 0x562a7aeb8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.134+0000 7f94d1800640 1 --2- 172.21.15.3:0/1796507833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a7aeab4b0 0x562a7aeb5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.135+0000 7f94d0e00640 1 -- 172.21.15.3:0/1796507833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a7aeab4b0 msgr2=0x562a7aeb5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.135+0000 7f94d0e00640 1 --2- 172.21.15.3:0/1796507833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a7aeab4b0 0x562a7aeb5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.135+0000 7f94d0e00640 1 -- 172.21.15.3:0/1796507833 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeaab90 msgr2=0x562a7aeaaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.135+0000 7f94d0e00640 1 --2- 172.21.15.3:0/1796507833 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeaab90 0x562a7aeaaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.135+0000 7f94d0e00640 1 -- 172.21.15.3:0/1796507833 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a7add7ae0 con 0x562a7aeb5d70 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.135+0000 7f94d2200640 1 --2- 172.21.15.3:0/1796507833 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeaab90 0x562a7aeaaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.135+0000 7f94ca000640 1 --2- 172.21.15.3:0/3045342416 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f94b40a33b0 0x7f94b40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.135+0000 7f94ca000640 1 -- 172.21.15.3:0/3045342416 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f94c00d03d0 con 0x7f94cc101df0 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.135+0000 7f94d0e00640 1 --2- 172.21.15.3:0/1796507833 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a7aeb5d70 0x562a7aeb8160 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f94b8009bf0 tx=0x7f94b8011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6350b75703283244 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:29.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.135+0000 7f94d2200640 1 --2- 172.21.15.3:0/3045342416 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f94b40a33b0 0x7f94b40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.136+0000 7f94bea00640 1 -- 172.21.15.3:0/1796507833 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b8004310 con 0x562a7aeb5d70 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.136+0000 7f94bea00640 1 -- 172.21.15.3:0/1796507833 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94b80044b0 con 0x562a7aeb5d70 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.136+0000 7f94bea00640 1 -- 172.21.15.3:0/1796507833 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b8019ae0 con 0x562a7aeb5d70 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.136+0000 7f94d6ca1740 1 -- 172.21.15.3:0/1796507833 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a7aeb5d70 msgr2=0x562a7aeb8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.136+0000 7f94d6ca1740 1 --2- 172.21.15.3:0/1796507833 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a7aeb5d70 0x562a7aeb8160 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f94b8009bf0 tx=0x7f94b8011440 comp rx=0 tx=0).stop 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.136+0000 7f94d2200640 1 --2- 172.21.15.3:0/3045342416 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f94b40a33b0 0x7f94b40a5870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f94c4006010 tx=0x7f94c40046c0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.136+0000 7f94d6ca1740 1 -- 172.21.15.3:0/1796507833 shutdown_connections 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.136+0000 7f94d6ca1740 1 --2- 172.21.15.3:0/1796507833 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a7aeb5d70 0x562a7aeb8160 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.136+0000 7f94d6ca1740 1 --2- 172.21.15.3:0/1796507833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a7aeab4b0 0x562a7aeb5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.136+0000 7f94d6ca1740 1 --2- 172.21.15.3:0/1796507833 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeaab90 0x562a7aeaaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.136+0000 7f94d6ca1740 1 -- 172.21.15.3:0/1796507833 >> 172.21.15.3:0/1796507833 conn(0x562a7aea7120 msgr2=0x562a7aea7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.137+0000 7f94d6ca1740 1 -- 172.21.15.3:0/1796507833 shutdown_connections 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.137+0000 7f94d6ca1740 1 -- 172.21.15.3:0/1796507833 wait complete. 2024-09-19T06:22:29.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.137+0000 7f94d6ca1740 1 -- start start 2024-09-19T06:22:29.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.137+0000 7f94d6ca1740 1 Processor -- start 2024-09-19T06:22:29.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.138+0000 7f94d6ca1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a7aeaab90 0x562a7aeb2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.138+0000 7f94d6ca1740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeab4b0 0x562a7aeb3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.138+0000 7f94d6ca1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a7aeb5d70 0x562a7aeb3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.138+0000 7f94d6ca1740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x562a7aeb89e0 con 0x562a7aeab4b0 2024-09-19T06:22:29.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.138+0000 7f94d6ca1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x562a7adcc0f0 con 0x562a7aeb5d70 2024-09-19T06:22:29.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.138+0000 7f94d6ca1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x562a7aeb8b60 con 0x562a7aeaab90 2024-09-19T06:22:29.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.138+0000 7f94d6ca1740 10 client.0 _ll_register_callbacks cb 0x562a7adbd9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:29.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.138+0000 7f94d0e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeab4b0 0x562a7aeb3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.138+0000 7f94d0e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeab4b0 0x562a7aeb3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58398/0 (socket says 172.21.15.3:58398) 2024-09-19T06:22:29.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.138+0000 7f94d0e00640 1 -- 172.21.15.3:0/3582448132 learned_addr learned my addr 172.21.15.3:0/3582448132 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:29.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.138+0000 7f94d1800640 1 --2- 172.21.15.3:0/3582448132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a7aeaab90 0x562a7aeb2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.138+0000 7f94d2200640 1 --2- 172.21.15.3:0/3582448132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a7aeb5d70 0x562a7aeb3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.139+0000 7f94d0e00640 1 -- 172.21.15.3:0/3582448132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a7aeaab90 msgr2=0x562a7aeb2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:29.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.139+0000 7f94d0e00640 1 --2- 172.21.15.3:0/3582448132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a7aeaab90 0x562a7aeb2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.139+0000 7f94d0e00640 1 -- 172.21.15.3:0/3582448132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a7aeb5d70 msgr2=0x562a7aeb3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:29.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.139+0000 7f94d0e00640 1 --2- 172.21.15.3:0/3582448132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a7aeb5d70 0x562a7aeb3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.139+0000 7f94d0e00640 1 -- 172.21.15.3:0/3582448132 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a7ab823c0 con 0x562a7aeab4b0 2024-09-19T06:22:29.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.139+0000 7f94d0e00640 1 --2- 172.21.15.3:0/3582448132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeab4b0 0x562a7aeb3150 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f94b8005bc0 tx=0x7f94b8019a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380381a4fc5ba573 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:29.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.139+0000 7f94b3400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:22:29.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.139+0000 7f94b3400640 1 -- 172.21.15.3:0/3582448132 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b801f040 con 0x562a7aeab4b0 2024-09-19T06:22:29.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.139+0000 7f94d6ca1740 1 -- 172.21.15.3:0/3582448132 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94b80044b0 con 0x562a7aeab4b0 2024-09-19T06:22:29.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.139+0000 7f94b3400640 1 -- 172.21.15.3:0/3582448132 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f94b8005250 con 0x562a7aeab4b0 2024-09-19T06:22:29.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.140+0000 7f94b3400640 1 -- 172.21.15.3:0/3582448132 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f94b8032050 con 0x562a7aeab4b0 2024-09-19T06:22:29.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.140+0000 7f94d6ca1740 10 client.18105 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:29.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.140+0000 7f94d6ca1740 1 -- 172.21.15.3:0/3582448132 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562a7aec8a50 con 0x562a7aeab4b0 2024-09-19T06:22:29.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.140+0000 7f94b3400640 1 -- 172.21.15.3:0/3582448132 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94b80044b0 con 0x562a7aeab4b0 2024-09-19T06:22:29.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.140+0000 7f94b3400640 1 -- 172.21.15.3:0/3582448132 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f94b8018070 con 0x562a7aeab4b0 2024-09-19T06:22:29.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.140+0000 7f94d6ca1740 10 client.18105 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:29.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.140+0000 7f94d6ca1740 10 client.18105 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:29.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.140+0000 7f94d6ca1740 20 client.18105 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:29.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.140+0000 7f94d6ca1740 1 --2- 172.21.15.3:0/3582448132 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562a7aec9f10 0x562a7aecc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.140+0000 7f94d6ca1740 4 client.18105 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:29.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.140+0000 7f94d6ca1740 1 -- 172.21.15.3:0/3582448132 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a7ae1e950 con 0x562a7aec9f10 2024-09-19T06:22:29.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.141+0000 7f94d1800640 1 --2- 172.21.15.3:0/3582448132 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562a7aec9f10 0x562a7aecc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.141+0000 7f94d1800640 1 --2- 172.21.15.3:0/3582448132 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562a7aec9f10 0x562a7aecc300 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dc6fc98aec811e5 server_cookie=862caec4265b25d4 in_seq=0 out_seq=0 2024-09-19T06:22:29.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.141+0000 7f94b3400640 10 client.18105 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:29.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.142+0000 7f94b3400640 1 -- 172.21.15.3:0/3582448132 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562a7ae1e950 con 0x562a7aec9f10 2024-09-19T06:22:29.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.142+0000 7f94b3400640 10 client.18105 handle_command_reply: tid=0 2024-09-19T06:22:29.147 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.142+0000 7f94d6ca1740 1 client.18105 shutdown 2024-09-19T06:22:29.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.142+0000 7f94d6ca1740 1 -- 172.21.15.3:0/3582448132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeab4b0 msgr2=0x562a7aeb3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:29.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.142+0000 7f94d6ca1740 1 --2- 172.21.15.3:0/3582448132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeab4b0 0x562a7aeb3150 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f94b8005bc0 tx=0x7f94b8019a90 comp rx=0 tx=0).stop 2024-09-19T06:22:29.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.142+0000 7f94d6ca1740 1 -- 172.21.15.3:0/3582448132 shutdown_connections 2024-09-19T06:22:29.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.142+0000 7f94d6ca1740 1 --2- 172.21.15.3:0/3582448132 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562a7aec9f10 0x562a7aecc300 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.142+0000 7f94d6ca1740 1 --2- 172.21.15.3:0/3582448132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a7aeb5d70 0x562a7aeb3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.142+0000 7f94d6ca1740 1 --2- 172.21.15.3:0/3582448132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeab4b0 0x562a7aeb3150 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.142+0000 7f94d6ca1740 1 --2- 172.21.15.3:0/3582448132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a7aeaab90 0x562a7aeb2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.142+0000 7f94d6ca1740 1 -- 172.21.15.3:0/3582448132 >> 172.21.15.3:0/3582448132 conn(0x562a7aea7120 msgr2=0x562a7aeace50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:29.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.142+0000 7f94b3400640 0 client.18105 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:29.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.143+0000 7f94d6ca1740 1 -- 172.21.15.3:0/3582448132 shutdown_connections 2024-09-19T06:22:29.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.143+0000 7f94d6ca1740 1 -- 172.21.15.3:0/3582448132 wait complete. 2024-09-19T06:22:29.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.143+0000 7f94d6ca1740 20 client.18105 trim_cache size 0 max 16384 2024-09-19T06:22:29.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.161+0000 7f94d6ca1740 1 Processor -- start 2024-09-19T06:22:29.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.161+0000 7f94d6ca1740 1 -- start start 2024-09-19T06:22:29.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.161+0000 7f94d6ca1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a7aeaab90 0x562a7aed1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.161+0000 7f94d6ca1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a7aeab4b0 0x562a7aed1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.161+0000 7f94d6ca1740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeb5d70 0x562a7aeac630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.161+0000 7f94d6ca1740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc1ab780 con 0x562a7aeb5d70 2024-09-19T06:22:29.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.161+0000 7f94d6ca1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc1ad2c0 con 0x562a7aeaab90 2024-09-19T06:22:29.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.161+0000 7f94d6ca1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc1abe50 con 0x562a7aeab4b0 2024-09-19T06:22:29.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.161+0000 7f94d2200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeb5d70 0x562a7aeac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.162+0000 7f94d2200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeb5d70 0x562a7aeac630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58402/0 (socket says 172.21.15.3:58402) 2024-09-19T06:22:29.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.162+0000 7f94d1800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a7aeaab90 0x562a7aed1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.162+0000 7f94d2200640 1 -- 172.21.15.3:0/4160040417 learned_addr learned my addr 172.21.15.3:0/4160040417 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:29.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.162+0000 7f94d0e00640 1 --2- 172.21.15.3:0/4160040417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a7aeab4b0 0x562a7aed1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.162+0000 7f94d1800640 1 -- 172.21.15.3:0/4160040417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a7aeab4b0 msgr2=0x562a7aed1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:29.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.162+0000 7f94d1800640 1 --2- 172.21.15.3:0/4160040417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a7aeab4b0 0x562a7aed1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.162+0000 7f94d1800640 1 -- 172.21.15.3:0/4160040417 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeb5d70 msgr2=0x562a7aeac630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:29.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.162+0000 7f94d1800640 1 --2- 172.21.15.3:0/4160040417 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeb5d70 0x562a7aeac630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.162+0000 7f94d1800640 1 -- 172.21.15.3:0/4160040417 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a7aea6f50 con 0x562a7aeaab90 2024-09-19T06:22:29.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.162+0000 7f94d1800640 1 --2- 172.21.15.3:0/4160040417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a7aeaab90 0x562a7aed1a90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f94c00cda90 tx=0x7f94c00d2820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b3527c7d0bd70a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:29.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.162+0000 7f94be000640 1 -- 172.21.15.3:0/4160040417 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c0010e60 con 0x562a7aeaab90 2024-09-19T06:22:29.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.162+0000 7f94be000640 1 -- 172.21.15.3:0/4160040417 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94c009c6d0 con 0x562a7aeaab90 2024-09-19T06:22:29.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.162+0000 7f94be000640 1 -- 172.21.15.3:0/4160040417 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c009a9d0 con 0x562a7aeaab90 2024-09-19T06:22:29.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.163+0000 7f94d6ca1740 1 -- 172.21.15.3:0/4160040417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a7aeaab90 msgr2=0x562a7aed1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:29.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.163+0000 7f94d6ca1740 1 --2- 172.21.15.3:0/4160040417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a7aeaab90 0x562a7aed1a90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f94c00cda90 tx=0x7f94c00d2820 comp rx=0 tx=0).stop 2024-09-19T06:22:29.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.163+0000 7f94d6ca1740 1 -- 172.21.15.3:0/4160040417 shutdown_connections 2024-09-19T06:22:29.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.163+0000 7f94d6ca1740 1 --2- 172.21.15.3:0/4160040417 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeb5d70 0x562a7aeac630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.163+0000 7f94d6ca1740 1 --2- 172.21.15.3:0/4160040417 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a7aeab4b0 0x562a7aed1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.163+0000 7f94d6ca1740 1 --2- 172.21.15.3:0/4160040417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a7aeaab90 0x562a7aed1a90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.163+0000 7f94d6ca1740 1 -- 172.21.15.3:0/4160040417 >> 172.21.15.3:0/4160040417 conn(0x562a7aea7120 msgr2=0x562a7aeb1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:29.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.163+0000 7f94d6ca1740 1 -- 172.21.15.3:0/4160040417 shutdown_connections 2024-09-19T06:22:29.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.163+0000 7f94d6ca1740 1 -- 172.21.15.3:0/4160040417 wait complete. 2024-09-19T06:22:29.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.164+0000 7f94d6ca1740 1 -- start start 2024-09-19T06:22:29.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.164+0000 7f94d6ca1740 1 Processor -- start 2024-09-19T06:22:29.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.164+0000 7f94d6ca1740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a7aeaab90 0x562a7aec26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.164+0000 7f94d6ca1740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeab4b0 0x562a7aeb9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.164+0000 7f94d6ca1740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a7aeb5d70 0x562a7aeb9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.164+0000 7f94d6ca1740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc1acbf0 con 0x562a7aeab4b0 2024-09-19T06:22:29.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.164+0000 7f94d6ca1740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc1ac520 con 0x562a7aeaab90 2024-09-19T06:22:29.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.164+0000 7f94d6ca1740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f94cc1a9780 con 0x562a7aeb5d70 2024-09-19T06:22:29.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.164+0000 7f94d6ca1740 10 client.0 _ll_register_callbacks cb 0x7f94b8009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:29.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.165+0000 7f94d1800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a7aeaab90 0x562a7aec26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.165+0000 7f94d0e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeab4b0 0x562a7aeb9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.165+0000 7f94d0e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeab4b0 0x562a7aeb9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58408/0 (socket says 172.21.15.3:58408) 2024-09-19T06:22:29.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.165+0000 7f94d2200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a7aeb5d70 0x562a7aeb9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.165+0000 7f94d1800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a7aeaab90 0x562a7aec26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:51624/0 (socket says 172.21.15.3:51624) 2024-09-19T06:22:29.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.165+0000 7f94d0e00640 1 -- 172.21.15.3:0/3311334373 learned_addr learned my addr 172.21.15.3:0/3311334373 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:29.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.165+0000 7f94d1800640 1 -- 172.21.15.3:0/3311334373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a7aeb5d70 msgr2=0x562a7aeb9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:29.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.165+0000 7f94d1800640 1 --2- 172.21.15.3:0/3311334373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a7aeb5d70 0x562a7aeb9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.165+0000 7f94d1800640 1 -- 172.21.15.3:0/3311334373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeab4b0 msgr2=0x562a7aeb9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:29.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.165+0000 7f94d1800640 1 --2- 172.21.15.3:0/3311334373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeab4b0 0x562a7aeb9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.165+0000 7f94d1800640 1 -- 172.21.15.3:0/3311334373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a7aeba390 con 0x562a7aeaab90 2024-09-19T06:22:29.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.165+0000 7f94d0e00640 1 --2- 172.21.15.3:0/3311334373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeab4b0 0x562a7aeb9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:29.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.165+0000 7f94d1800640 1 --2- 172.21.15.3:0/3311334373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a7aeaab90 0x562a7aec26b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f94c0018620 tx=0x7f94c0010ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94f4873fafe73cd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:29.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.165+0000 7f94b3400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:22:29.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.166+0000 7f94b3400640 1 -- 172.21.15.3:0/3311334373 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c0010e60 con 0x562a7aeaab90 2024-09-19T06:22:29.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.166+0000 7f94d6ca1740 1 -- 172.21.15.3:0/3311334373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94c009c6d0 con 0x562a7aeaab90 2024-09-19T06:22:29.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.166+0000 7f94b3400640 1 -- 172.21.15.3:0/3311334373 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f94c009a9d0 con 0x562a7aeaab90 2024-09-19T06:22:29.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.166+0000 7f94b3400640 1 -- 172.21.15.3:0/3311334373 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f94c009c030 con 0x562a7aeaab90 2024-09-19T06:22:29.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.166+0000 7f94d6ca1740 10 client.28142 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:29.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.166+0000 7f94d6ca1740 1 -- 172.21.15.3:0/3311334373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562a7aebee50 con 0x562a7aeaab90 2024-09-19T06:22:29.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.166+0000 7f94b3400640 1 -- 172.21.15.3:0/3311334373 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94c009c6d0 con 0x562a7aeaab90 2024-09-19T06:22:29.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.166+0000 7f94b3400640 1 -- 172.21.15.3:0/3311334373 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f94c00b2c00 con 0x562a7aeaab90 2024-09-19T06:22:29.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.166+0000 7f94d6ca1740 10 client.28142 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:29.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.166+0000 7f94d6ca1740 10 client.28142 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:29.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.166+0000 7f94d6ca1740 20 client.28142 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:29.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.166+0000 7f94d6ca1740 1 --2- 172.21.15.3:0/3311334373 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562a7af39630 0x562a7af3ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:29.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.166+0000 7f94d6ca1740 4 client.28142 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:22:29.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.166+0000 7f94d6ca1740 1 -- 172.21.15.3:0/3311334373 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562a7ae18e60 con 0x562a7af39630 2024-09-19T06:22:29.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.167+0000 7f94d0e00640 1 --2- 172.21.15.3:0/3311334373 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562a7af39630 0x562a7af3ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:29.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.167+0000 7f94d0e00640 1 --2- 172.21.15.3:0/3311334373 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562a7af39630 0x562a7af3ba50 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56cec58fe6df2b44 server_cookie=674cbd40210826b4 in_seq=0 out_seq=0 2024-09-19T06:22:29.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.167+0000 7f94b3400640 10 client.28142 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:29.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.167+0000 7f94b3400640 1 -- 172.21.15.3:0/3311334373 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562a7ae18e60 con 0x562a7af39630 2024-09-19T06:22:29.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.167+0000 7f94b3400640 10 client.28142 handle_command_reply: tid=0 2024-09-19T06:22:29.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.167+0000 7f94d6ca1740 1 client.28142 shutdown 2024-09-19T06:22:29.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.168+0000 7f94d6ca1740 1 -- 172.21.15.3:0/3311334373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a7aeaab90 msgr2=0x562a7aec26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:29.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.168+0000 7f94d6ca1740 1 --2- 172.21.15.3:0/3311334373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a7aeaab90 0x562a7aec26b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f94c0018620 tx=0x7f94c0010ae0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.168+0000 7f94d6ca1740 1 -- 172.21.15.3:0/3311334373 shutdown_connections 2024-09-19T06:22:29.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.168+0000 7f94d6ca1740 1 --2- 172.21.15.3:0/3311334373 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x562a7af39630 0x562a7af3ba50 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.168+0000 7f94d6ca1740 1 --2- 172.21.15.3:0/3311334373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x562a7aeb5d70 0x562a7aeb9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.168+0000 7f94d6ca1740 1 --2- 172.21.15.3:0/3311334373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x562a7aeab4b0 0x562a7aeb9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.168+0000 7f94b3400640 0 client.28142 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:29.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.168+0000 7f94d6ca1740 1 --2- 172.21.15.3:0/3311334373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562a7aeaab90 0x562a7aec26b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.168+0000 7f94d6ca1740 1 -- 172.21.15.3:0/3311334373 >> 172.21.15.3:0/3311334373 conn(0x562a7aea7120 msgr2=0x562a7aeb4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:29.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.168+0000 7f94d6ca1740 1 -- 172.21.15.3:0/3311334373 shutdown_connections 2024-09-19T06:22:29.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.168+0000 7f94d6ca1740 1 -- 172.21.15.3:0/3311334373 wait complete. 2024-09-19T06:22:29.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.168+0000 7f94d6ca1740 20 client.28142 trim_cache size 0 max 16384 2024-09-19T06:22:29.174 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:22:29.174 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "no active scrubs running", 2024-09-19T06:22:29.174 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": {} 2024-09-19T06:22:29.174 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:22:29.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.169+0000 7f94d4200640 1 -- 172.21.15.3:0/3045342416 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f94b40a33b0 msgr2=0x7f94b40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:29.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.169+0000 7f94d4200640 1 --2- 172.21.15.3:0/3045342416 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f94b40a33b0 0x7f94b40a5870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f94c4006010 tx=0x7f94c40046c0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.169+0000 7f94d4200640 1 -- 172.21.15.3:0/3045342416 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94cc101df0 msgr2=0x7f94cc1983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:29.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.169+0000 7f94d4200640 1 --2- 172.21.15.3:0/3045342416 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94cc101df0 0x7f94cc1983d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f94c000ebc0 tx=0x7f94c000c6a0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.169+0000 7f94d4200640 1 -- 172.21.15.3:0/3045342416 shutdown_connections 2024-09-19T06:22:29.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.169+0000 7f94d4200640 1 --2- 172.21.15.3:0/3045342416 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f94b40a33b0 0x7f94b40a5870 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.169+0000 7f94d4200640 1 --2- 172.21.15.3:0/3045342416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94cc106f20 0x7f94cc19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.169+0000 7f94d4200640 1 --2- 172.21.15.3:0/3045342416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f94cc1027a0 0x7f94cc198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.169+0000 7f94d4200640 1 --2- 172.21.15.3:0/3045342416 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f94cc101df0 0x7f94cc1983d0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:29.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.169+0000 7f94d4200640 1 -- 172.21.15.3:0/3045342416 >> 172.21.15.3:0/3045342416 conn(0x7f94cc0fd8b0 msgr2=0x7f94cc0fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:29.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.169+0000 7f94d4200640 1 -- 172.21.15.3:0/3045342416 shutdown_connections 2024-09-19T06:22:29.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:29.169+0000 7f94d4200640 1 -- 172.21.15.3:0/3045342416 wait complete. 2024-09-19T06:22:30.235 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:22:30.235 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:22:30.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:30 smithi059 ceph-mon[35138]: pgmap v314: 97 pgs: 97 active+clean; 3.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 64 KiB/s wr, 22 op/s 2024-09-19T06:22:30.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:30 smithi003 ceph-mon[30893]: pgmap v314: 97 pgs: 97 active+clean; 3.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 64 KiB/s wr, 22 op/s 2024-09-19T06:22:30.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:30 smithi071 ceph-mon[35662]: pgmap v314: 97 pgs: 97 active+clean; 3.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 64 KiB/s wr, 22 op/s 2024-09-19T06:22:30.614 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:31.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.175+0000 7f7ca3e00640 1 -- 172.21.15.3:0/96919200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c9c103ff0 msgr2=0x7f7c9c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:31.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.175+0000 7f7ca3e00640 1 --2- 172.21.15.3:0/96919200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c9c103ff0 0x7f7c9c1043d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f7c90009900 tx=0x7f7c9002a3f0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.175+0000 7f7ca3e00640 1 -- 172.21.15.3:0/96919200 shutdown_connections 2024-09-19T06:22:31.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.175+0000 7f7ca3e00640 1 --2- 172.21.15.3:0/96919200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c9c109120 0x7f7c9c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.175+0000 7f7ca3e00640 1 --2- 172.21.15.3:0/96919200 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c9c1049a0 0x7f7c9c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.175+0000 7f7ca3e00640 1 --2- 172.21.15.3:0/96919200 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c9c103ff0 0x7f7c9c1043d0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.175+0000 7f7ca3e00640 1 -- 172.21.15.3:0/96919200 >> 172.21.15.3:0/96919200 conn(0x7f7c9c0ffa90 msgr2=0x7f7c9c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:31.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.176+0000 7f7ca3e00640 1 -- 172.21.15.3:0/96919200 shutdown_connections 2024-09-19T06:22:31.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.176+0000 7f7ca3e00640 1 -- 172.21.15.3:0/96919200 wait complete. 2024-09-19T06:22:31.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.176+0000 7f7ca3e00640 1 Processor -- start 2024-09-19T06:22:31.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.177+0000 7f7ca3e00640 1 -- start start 2024-09-19T06:22:31.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.177+0000 7f7ca3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c9c103ff0 0x7f7c9c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.177+0000 7f7ca3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c9c1049a0 0x7f7c9c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.177+0000 7f7ca3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c9c109120 0x7f7c9c19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.177+0000 7f7ca3e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c114170 con 0x7f7c9c1049a0 2024-09-19T06:22:31.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.177+0000 7f7ca3e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c113ff0 con 0x7f7c9c103ff0 2024-09-19T06:22:31.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.177+0000 7f7ca3e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c1142f0 con 0x7f7c9c109120 2024-09-19T06:22:31.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.177+0000 7f7ca0a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c9c1049a0 0x7f7c9c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.177+0000 7f7ca1400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c9c103ff0 0x7f7c9c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.177+0000 7f7ca1400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c9c103ff0 0x7f7c9c19a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:51642/0 (socket says 172.21.15.3:51642) 2024-09-19T06:22:31.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.177+0000 7f7ca0a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c9c1049a0 0x7f7c9c19abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58430/0 (socket says 172.21.15.3:58430) 2024-09-19T06:22:31.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.177+0000 7f7ca1400640 1 -- 172.21.15.3:0/3933490437 learned_addr learned my addr 172.21.15.3:0/3933490437 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:31.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.177+0000 7f7ca1e00640 1 --2- 172.21.15.3:0/3933490437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c9c109120 0x7f7c9c19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.178+0000 7f7ca1400640 1 -- 172.21.15.3:0/3933490437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c9c109120 msgr2=0x7f7c9c19ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:31.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.178+0000 7f7ca1400640 1 --2- 172.21.15.3:0/3933490437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c9c109120 0x7f7c9c19ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.178+0000 7f7ca1400640 1 -- 172.21.15.3:0/3933490437 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c9c1049a0 msgr2=0x7f7c9c19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:31.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.178+0000 7f7ca1400640 1 --2- 172.21.15.3:0/3933490437 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c9c1049a0 0x7f7c9c19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.178+0000 7f7ca1400640 1 -- 172.21.15.3:0/3933490437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9c19f620 con 0x7f7c9c103ff0 2024-09-19T06:22:31.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.178+0000 7f7ca1e00640 1 --2- 172.21.15.3:0/3933490437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c9c109120 0x7f7c9c19ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:31.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.178+0000 7f7ca1400640 1 --2- 172.21.15.3:0/3933490437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c9c103ff0 0x7f7c9c19a670 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7c90004770 tx=0x7f7c90003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:31.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.178+0000 7f7c9a000640 1 -- 172.21.15.3:0/3933490437 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9003f070 con 0x7f7c9c103ff0 2024-09-19T06:22:31.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.179+0000 7f7ca3e00640 1 -- 172.21.15.3:0/3933490437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c9c19f8b0 con 0x7f7c9c103ff0 2024-09-19T06:22:31.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.179+0000 7f7c9a000640 1 -- 172.21.15.3:0/3933490437 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c90031ca0 con 0x7f7c9c103ff0 2024-09-19T06:22:31.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.179+0000 7f7c9a000640 1 -- 172.21.15.3:0/3933490437 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c90035030 con 0x7f7c9c103ff0 2024-09-19T06:22:31.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.179+0000 7f7ca3e00640 1 -- 172.21.15.3:0/3933490437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c9c1a71f0 con 0x7f7c9c103ff0 2024-09-19T06:22:31.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.180+0000 7f7ca3e00640 1 -- 172.21.15.3:0/3933490437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c9c1043d0 con 0x7f7c9c103ff0 2024-09-19T06:22:31.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.182+0000 7f7c9a000640 1 -- 172.21.15.3:0/3933490437 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f7c90042070 con 0x7f7c9c103ff0 2024-09-19T06:22:31.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.183+0000 7f7c9a000640 1 --2- 172.21.15.3:0/3933490437 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7c840a3430 0x7f7c840a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.183+0000 7f7c9a000640 1 -- 172.21.15.3:0/3933490437 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f7c900f08e0 con 0x7f7c9c103ff0 2024-09-19T06:22:31.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.184+0000 7f7ca0a00640 1 --2- 172.21.15.3:0/3933490437 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7c840a3430 0x7f7c840a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.184+0000 7f7ca0a00640 1 --2- 172.21.15.3:0/3933490437 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7c840a3430 0x7f7c840a58f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c0fff40 tx=0x7f7c88005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:31.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.185+0000 7f7c9a000640 1 -- 172.21.15.3:0/3933490437 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7c900bcca0 con 0x7f7c9c103ff0 2024-09-19T06:22:31.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.414+0000 7f7ca3e00640 1 -- 172.21.15.3:0/3933490437 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c9c10c300 con 0x7f7c9c103ff0 2024-09-19T06:22:31.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.415+0000 7f7c9a000640 1 -- 172.21.15.3:0/3933490437 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7f7c900c0fa0 con 0x7f7c9c103ff0 2024-09-19T06:22:31.417 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:22:31.417 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"btime":"2024-09-19T06:12:22:958217+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:12:22.060987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24532,24515,24514,14517]},"id":1}]} 2024-09-19T06:22:31.418 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2024-09-19T06:22:31.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.418+0000 7f7ca3e00640 1 -- 172.21.15.3:0/3933490437 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7c840a3430 msgr2=0x7f7c840a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:31.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.418+0000 7f7ca3e00640 1 --2- 172.21.15.3:0/3933490437 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7c840a3430 0x7f7c840a58f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c0fff40 tx=0x7f7c88005f90 comp rx=0 tx=0).stop 2024-09-19T06:22:31.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.418+0000 7f7ca3e00640 1 -- 172.21.15.3:0/3933490437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c9c103ff0 msgr2=0x7f7c9c19a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:31.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.418+0000 7f7ca3e00640 1 --2- 172.21.15.3:0/3933490437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c9c103ff0 0x7f7c9c19a670 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7c90004770 tx=0x7f7c90003c10 comp rx=0 tx=0).stop 2024-09-19T06:22:31.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.418+0000 7f7ca3e00640 1 -- 172.21.15.3:0/3933490437 shutdown_connections 2024-09-19T06:22:31.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.418+0000 7f7ca3e00640 1 --2- 172.21.15.3:0/3933490437 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7c840a3430 0x7f7c840a58f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.418+0000 7f7ca3e00640 1 --2- 172.21.15.3:0/3933490437 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7c9c109120 0x7f7c9c19ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.418+0000 7f7ca3e00640 1 --2- 172.21.15.3:0/3933490437 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c9c1049a0 0x7f7c9c19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.418+0000 7f7ca3e00640 1 --2- 172.21.15.3:0/3933490437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c9c103ff0 0x7f7c9c19a670 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.418+0000 7f7ca3e00640 1 -- 172.21.15.3:0/3933490437 >> 172.21.15.3:0/3933490437 conn(0x7f7c9c0ffa90 msgr2=0x7f7c9c100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:31.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.418+0000 7f7ca3e00640 1 -- 172.21.15.3:0/3933490437 shutdown_connections 2024-09-19T06:22:31.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:31.418+0000 7f7ca3e00640 1 -- 172.21.15.3:0/3933490437 wait complete. 2024-09-19T06:22:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.774+0000 7fbe2cc00640 1 -- 172.21.15.3:0/4042424826 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe28109090 msgr2=0x7fbe28110be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.774+0000 7fbe2cc00640 1 --2- 172.21.15.3:0/4042424826 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe28109090 0x7fbe28110be0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fbe20009ca0 tx=0x7fbe2002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.774+0000 7fbe2cc00640 1 -- 172.21.15.3:0/4042424826 shutdown_connections 2024-09-19T06:22:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.774+0000 7fbe2cc00640 1 --2- 172.21.15.3:0/4042424826 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe28109090 0x7fbe28110be0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.774+0000 7fbe2cc00640 1 --2- 172.21.15.3:0/4042424826 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe281048f0 0x7fbe28108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.774+0000 7fbe2cc00640 1 --2- 172.21.15.3:0/4042424826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe28103f40 0x7fbe28104320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.774+0000 7fbe2cc00640 1 -- 172.21.15.3:0/4042424826 >> 172.21.15.3:0/4042424826 conn(0x7fbe280ff970 msgr2=0x7fbe28101d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.774+0000 7fbe2cc00640 1 -- 172.21.15.3:0/4042424826 shutdown_connections 2024-09-19T06:22:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.774+0000 7fbe2cc00640 1 -- 172.21.15.3:0/4042424826 wait complete. 2024-09-19T06:22:31.778 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.775+0000 7fbe2cc00640 1 Processor -- start 2024-09-19T06:22:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.775+0000 7fbe2cc00640 1 -- start start 2024-09-19T06:22:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.776+0000 7fbe2cc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe28103f40 0x7fbe2819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.776+0000 7fbe2cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe28109090 0x7fbe2819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.776+0000 7fbe2cc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe2819ee60 0x7fbe2819f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.776+0000 7fbe2cc00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbe28114130 con 0x7fbe2819ee60 2024-09-19T06:22:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.776+0000 7fbe2cc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbe28113fb0 con 0x7fbe28109090 2024-09-19T06:22:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.776+0000 7fbe2cc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbe281142b0 con 0x7fbe28103f40 2024-09-19T06:22:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.776+0000 7fbe26800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe2819ee60 0x7fbe2819f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.776+0000 7fbe26800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe2819ee60 0x7fbe2819f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58448/0 (socket says 172.21.15.3:58448) 2024-09-19T06:22:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.776+0000 7fbe26800640 1 -- 172.21.15.3:0/1738804373 learned_addr learned my addr 172.21.15.3:0/1738804373 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.776+0000 7fbe25400640 1 --2- 172.21.15.3:0/1738804373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe28109090 0x7fbe2819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.776+0000 7fbe25e00640 1 --2- 172.21.15.3:0/1738804373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe28103f40 0x7fbe2819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.776+0000 7fbe26800640 1 -- 172.21.15.3:0/1738804373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe28103f40 msgr2=0x7fbe2819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.776+0000 7fbe26800640 1 --2- 172.21.15.3:0/1738804373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe28103f40 0x7fbe2819a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.776+0000 7fbe26800640 1 -- 172.21.15.3:0/1738804373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe28109090 msgr2=0x7fbe2819aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.776+0000 7fbe26800640 1 --2- 172.21.15.3:0/1738804373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe28109090 0x7fbe2819aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.776+0000 7fbe26800640 1 -- 172.21.15.3:0/1738804373 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2819f950 con 0x7fbe2819ee60 2024-09-19T06:22:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.777+0000 7fbe26800640 1 --2- 172.21.15.3:0/1738804373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe2819ee60 0x7fbe2819f310 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fbe20033040 tx=0x7fbe20003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.777+0000 7fbe1ea00640 1 -- 172.21.15.3:0/1738804373 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe20031650 con 0x7fbe2819ee60 2024-09-19T06:22:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.777+0000 7fbe2cc00640 1 -- 172.21.15.3:0/1738804373 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe2819fbe0 con 0x7fbe2819ee60 2024-09-19T06:22:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.777+0000 7fbe1ea00640 1 -- 172.21.15.3:0/1738804373 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe200317f0 con 0x7fbe2819ee60 2024-09-19T06:22:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.777+0000 7fbe1ea00640 1 -- 172.21.15.3:0/1738804373 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2002fa60 con 0x7fbe2819ee60 2024-09-19T06:22:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.777+0000 7fbe2cc00640 1 -- 172.21.15.3:0/1738804373 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe281a7430 con 0x7fbe2819ee60 2024-09-19T06:22:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.780+0000 7fbe1ea00640 1 -- 172.21.15.3:0/1738804373 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fbe2002fc00 con 0x7fbe2819ee60 2024-09-19T06:22:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.780+0000 7fbe2fc57740 1 Processor -- start 2024-09-19T06:22:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.781+0000 7fbe2fc57740 1 -- start start 2024-09-19T06:22:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.781+0000 7fbe2fc57740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d121e0 0x5630d7d125c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.781+0000 7fbe2fc57740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d12b00 0x5630d7d1ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.781+0000 7fbe2fc57740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5630d7d1d3a0 0x5630d7d1f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.781+0000 7fbe2fc57740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5630d7c78100 con 0x5630d7d12b00 2024-09-19T06:22:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.781+0000 7fbe2fc57740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5630d7c201b0 con 0x5630d7d121e0 2024-09-19T06:22:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.781+0000 7fbe2fc57740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5630d7c740c0 con 0x5630d7d1d3a0 2024-09-19T06:22:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.781+0000 7fbe25e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d12b00 0x5630d7d1ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.781+0000 7fbe25400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d121e0 0x5630d7d125c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.781+0000 7fbe25400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d121e0 0x5630d7d125c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:51658/0 (socket says 172.21.15.3:51658) 2024-09-19T06:22:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.781+0000 7fbe25400640 1 -- 172.21.15.3:0/1486244806 learned_addr learned my addr 172.21.15.3:0/1486244806 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.781+0000 7fbe25e00640 1 --2- 172.21.15.3:0/1486244806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d12b00 0x5630d7d1ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58458/0 (socket says 172.21.15.3:58458) 2024-09-19T06:22:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.781+0000 7fbe25400640 1 --2- 172.21.15.3:0/1486244806 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5630d7d1d3a0 0x5630d7d1f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.782+0000 7fbe25e00640 1 -- 172.21.15.3:0/1486244806 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5630d7d1d3a0 msgr2=0x5630d7d1f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.782+0000 7fbe25e00640 1 --2- 172.21.15.3:0/1486244806 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5630d7d1d3a0 0x5630d7d1f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.782+0000 7fbe25e00640 1 -- 172.21.15.3:0/1486244806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d121e0 msgr2=0x5630d7d125c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.782+0000 7fbe25e00640 1 --2- 172.21.15.3:0/1486244806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d121e0 0x5630d7d125c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.782+0000 7fbe25e00640 1 -- 172.21.15.3:0/1486244806 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630d798b210 con 0x5630d7d12b00 2024-09-19T06:22:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.782+0000 7fbe25400640 1 --2- 172.21.15.3:0/1486244806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d121e0 0x5630d7d125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.782+0000 7fbe25e00640 1 --2- 172.21.15.3:0/1486244806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d12b00 0x5630d7d1ce60 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800bbf0 tx=0x7fbe180107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8133c7da583ea316 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.782+0000 7fbe1ea00640 1 --2- 172.21.15.3:0/1738804373 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbe0c0a33b0 0x7fbe0c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.782+0000 7fbe13000640 1 -- 172.21.15.3:0/1486244806 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18004030 con 0x5630d7d12b00 2024-09-19T06:22:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.782+0000 7fbe1ea00640 1 -- 172.21.15.3:0/1738804373 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7fbe200f1210 con 0x7fbe2819ee60 2024-09-19T06:22:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.782+0000 7fbe13000640 1 -- 172.21.15.3:0/1486244806 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe180041d0 con 0x5630d7d12b00 2024-09-19T06:22:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.782+0000 7fbe13000640 1 -- 172.21.15.3:0/1486244806 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe180116a0 con 0x5630d7d12b00 2024-09-19T06:22:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.782+0000 7fbe25400640 1 --2- 172.21.15.3:0/1738804373 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbe0c0a33b0 0x7fbe0c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.783+0000 7fbe2fc57740 1 -- 172.21.15.3:0/1486244806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d12b00 msgr2=0x5630d7d1ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.783+0000 7fbe2fc57740 1 --2- 172.21.15.3:0/1486244806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d12b00 0x5630d7d1ce60 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800bbf0 tx=0x7fbe180107a0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.783+0000 7fbe25400640 1 --2- 172.21.15.3:0/1738804373 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbe0c0a33b0 0x7fbe0c0a5870 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x5630d7d0fad0 tx=0x7fbe14004730 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.783+0000 7fbe2fc57740 1 -- 172.21.15.3:0/1486244806 shutdown_connections 2024-09-19T06:22:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.783+0000 7fbe2fc57740 1 --2- 172.21.15.3:0/1486244806 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5630d7d1d3a0 0x5630d7d1f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.783+0000 7fbe2fc57740 1 --2- 172.21.15.3:0/1486244806 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d12b00 0x5630d7d1ce60 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.783+0000 7fbe2fc57740 1 --2- 172.21.15.3:0/1486244806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d121e0 0x5630d7d125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.783+0000 7fbe2fc57740 1 -- 172.21.15.3:0/1486244806 >> 172.21.15.3:0/1486244806 conn(0x5630d7d0e750 msgr2=0x5630d7d0eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.783+0000 7fbe2fc57740 1 -- 172.21.15.3:0/1486244806 shutdown_connections 2024-09-19T06:22:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.783+0000 7fbe2fc57740 1 -- 172.21.15.3:0/1486244806 wait complete. 2024-09-19T06:22:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.784+0000 7fbe2fc57740 1 -- start start 2024-09-19T06:22:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.784+0000 7fbe2fc57740 1 Processor -- start 2024-09-19T06:22:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.784+0000 7fbe2fc57740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d121e0 0x5630d7d1a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.784+0000 7fbe2fc57740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d12b00 0x5630d7d1a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.784+0000 7fbe2fc57740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5630d7d1d3a0 0x5630d7d1adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.784+0000 7fbe2fc57740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5630d7d1ff70 con 0x5630d7d12b00 2024-09-19T06:22:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.784+0000 7fbe2fc57740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5630d7c01090 con 0x5630d7d121e0 2024-09-19T06:22:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.784+0000 7fbe2fc57740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5630d7d200f0 con 0x5630d7d1d3a0 2024-09-19T06:22:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.785+0000 7fbe2fc57740 10 client.0 _ll_register_callbacks cb 0x5630d7c55f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.785+0000 7fbe25e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d121e0 0x5630d7d1a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.785+0000 7fbe25400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d12b00 0x5630d7d1a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.785+0000 7fbe25e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d121e0 0x5630d7d1a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:51666/0 (socket says 172.21.15.3:51666) 2024-09-19T06:22:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.785+0000 7fbe25e00640 1 -- 172.21.15.3:0/3742461270 learned_addr learned my addr 172.21.15.3:0/3742461270 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.785+0000 7fbe26800640 1 --2- 172.21.15.3:0/3742461270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5630d7d1d3a0 0x5630d7d1adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.785+0000 7fbe25e00640 1 -- 172.21.15.3:0/3742461270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5630d7d1d3a0 msgr2=0x5630d7d1adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.785+0000 7fbe25e00640 1 --2- 172.21.15.3:0/3742461270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5630d7d1d3a0 0x5630d7d1adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.785+0000 7fbe25e00640 1 -- 172.21.15.3:0/3742461270 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d12b00 msgr2=0x5630d7d1a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.785+0000 7fbe25e00640 1 --2- 172.21.15.3:0/3742461270 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d12b00 0x5630d7d1a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.785+0000 7fbe25e00640 1 -- 172.21.15.3:0/3742461270 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630d7a57620 con 0x5630d7d121e0 2024-09-19T06:22:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.785+0000 7fbe25e00640 1 --2- 172.21.15.3:0/3742461270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d121e0 0x5630d7d1a340 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbe18011010 tx=0x7fbe18003b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d4092435f852e72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.785+0000 7fbe07400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:22:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.786+0000 7fbe07400640 1 -- 172.21.15.3:0/3742461270 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18004380 con 0x5630d7d121e0 2024-09-19T06:22:31.791 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.786+0000 7fbe2fc57740 1 -- 172.21.15.3:0/3742461270 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe180041d0 con 0x5630d7d121e0 2024-09-19T06:22:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.786+0000 7fbe07400640 1 -- 172.21.15.3:0/3742461270 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7fbe180035f0 con 0x5630d7d121e0 2024-09-19T06:22:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.786+0000 7fbe07400640 1 -- 172.21.15.3:0/3742461270 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbe180037f0 con 0x5630d7d121e0 2024-09-19T06:22:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.786+0000 7fbe2fc57740 10 client.28160 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.786+0000 7fbe2fc57740 1 -- 172.21.15.3:0/3742461270 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5630d7d2bc30 con 0x5630d7d121e0 2024-09-19T06:22:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.786+0000 7fbe07400640 1 -- 172.21.15.3:0/3742461270 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe180041d0 con 0x5630d7d121e0 2024-09-19T06:22:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.787+0000 7fbe07400640 1 -- 172.21.15.3:0/3742461270 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fbe18004ac0 con 0x5630d7d121e0 2024-09-19T06:22:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.787+0000 7fbe2fc57740 10 client.28160 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.787+0000 7fbe2fc57740 10 client.28160 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.787+0000 7fbe2fc57740 20 client.28160 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.787+0000 7fbe2fc57740 1 --2- 172.21.15.3:0/3742461270 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5630d7d2d0f0 0x5630d7d2f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.787+0000 7fbe2fc57740 4 client.28160 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.787+0000 7fbe2fc57740 1 -- 172.21.15.3:0/3742461270 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630d7c85830 con 0x5630d7d2d0f0 2024-09-19T06:22:31.792 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.787+0000 7fbe25400640 1 --2- 172.21.15.3:0/3742461270 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5630d7d2d0f0 0x5630d7d2f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.788+0000 7fbe25400640 1 --2- 172.21.15.3:0/3742461270 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5630d7d2d0f0 0x5630d7d2f4e0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eddb6407859e86c9 server_cookie=67cc6482988587f0 in_seq=0 out_seq=0 2024-09-19T06:22:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.788+0000 7fbe07400640 10 client.28160 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.788+0000 7fbe07400640 1 -- 172.21.15.3:0/3742461270 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5630d7c85830 con 0x5630d7d2d0f0 2024-09-19T06:22:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.788+0000 7fbe07400640 10 client.28160 handle_command_reply: tid=0 2024-09-19T06:22:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.788+0000 7fbe2fc57740 1 client.28160 shutdown 2024-09-19T06:22:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.789+0000 7fbe2fc57740 1 -- 172.21.15.3:0/3742461270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d121e0 msgr2=0x5630d7d1a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.789+0000 7fbe2fc57740 1 --2- 172.21.15.3:0/3742461270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d121e0 0x5630d7d1a340 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbe18011010 tx=0x7fbe18003b80 comp rx=0 tx=0).stop 2024-09-19T06:22:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.789+0000 7fbe2fc57740 1 -- 172.21.15.3:0/3742461270 shutdown_connections 2024-09-19T06:22:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.789+0000 7fbe2fc57740 1 --2- 172.21.15.3:0/3742461270 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5630d7d2d0f0 0x5630d7d2f4e0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.789+0000 7fbe2fc57740 1 --2- 172.21.15.3:0/3742461270 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5630d7d1d3a0 0x5630d7d1adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.789+0000 7fbe2fc57740 1 --2- 172.21.15.3:0/3742461270 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d12b00 0x5630d7d1a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.789+0000 7fbe07400640 0 client.28160 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:31.795 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.789+0000 7fbe2fc57740 1 --2- 172.21.15.3:0/3742461270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d121e0 0x5630d7d1a340 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.795 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.789+0000 7fbe2fc57740 1 -- 172.21.15.3:0/3742461270 >> 172.21.15.3:0/3742461270 conn(0x5630d7d0e750 msgr2=0x5630d7d144b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:31.795 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.789+0000 7fbe2fc57740 1 -- 172.21.15.3:0/3742461270 shutdown_connections 2024-09-19T06:22:31.795 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.789+0000 7fbe2fc57740 1 -- 172.21.15.3:0/3742461270 wait complete. 2024-09-19T06:22:31.795 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.789+0000 7fbe2fc57740 20 client.28160 trim_cache size 0 max 16384 2024-09-19T06:22:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.805+0000 7fbe2fc57740 1 Processor -- start 2024-09-19T06:22:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.805+0000 7fbe2fc57740 1 -- start start 2024-09-19T06:22:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.805+0000 7fbe2fc57740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5630d7d121e0 0x5630d7d34c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.805+0000 7fbe2fc57740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d12b00 0x5630d7d351b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.805+0000 7fbe2fc57740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d1d3a0 0x5630d7d13c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.805+0000 7fbe2fc57740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbe281afab0 con 0x5630d7d12b00 2024-09-19T06:22:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.805+0000 7fbe2fc57740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbe281b15f0 con 0x5630d7d1d3a0 2024-09-19T06:22:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.805+0000 7fbe2fc57740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbe281b0180 con 0x5630d7d121e0 2024-09-19T06:22:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.805+0000 7fbe25400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d12b00 0x5630d7d351b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.805+0000 7fbe25400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d12b00 0x5630d7d351b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58486/0 (socket says 172.21.15.3:58486) 2024-09-19T06:22:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.805+0000 7fbe25400640 1 -- 172.21.15.3:0/401904380 learned_addr learned my addr 172.21.15.3:0/401904380 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.806+0000 7fbe25e00640 1 --2- 172.21.15.3:0/401904380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5630d7d121e0 0x5630d7d34c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.806+0000 7fbe26800640 1 --2- 172.21.15.3:0/401904380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d1d3a0 0x5630d7d13c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.806+0000 7fbe25400640 1 -- 172.21.15.3:0/401904380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5630d7d121e0 msgr2=0x5630d7d34c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.806+0000 7fbe25400640 1 --2- 172.21.15.3:0/401904380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5630d7d121e0 0x5630d7d34c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.806+0000 7fbe25400640 1 -- 172.21.15.3:0/401904380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d1d3a0 msgr2=0x5630d7d13c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.806+0000 7fbe25400640 1 --2- 172.21.15.3:0/401904380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d1d3a0 0x5630d7d13c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.806+0000 7fbe25400640 1 -- 172.21.15.3:0/401904380 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630d7d09d60 con 0x5630d7d12b00 2024-09-19T06:22:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.806+0000 7fbe25e00640 1 --2- 172.21.15.3:0/401904380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5630d7d121e0 0x5630d7d34c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.806+0000 7fbe26800640 1 --2- 172.21.15.3:0/401904380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d1d3a0 0x5630d7d13c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.806+0000 7fbe25400640 1 --2- 172.21.15.3:0/401904380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d12b00 0x5630d7d351b0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x5630d7d19bb0 tx=0x7fbe14013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54bbe2b2a38c72d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.806+0000 7fbe12600640 1 -- 172.21.15.3:0/401904380 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe14011c60 con 0x5630d7d12b00 2024-09-19T06:22:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.806+0000 7fbe12600640 1 -- 172.21.15.3:0/401904380 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe14011e00 con 0x5630d7d12b00 2024-09-19T06:22:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.806+0000 7fbe12600640 1 -- 172.21.15.3:0/401904380 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe14004e00 con 0x5630d7d12b00 2024-09-19T06:22:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.807+0000 7fbe2fc57740 1 -- 172.21.15.3:0/401904380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d12b00 msgr2=0x5630d7d351b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.807+0000 7fbe2fc57740 1 --2- 172.21.15.3:0/401904380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d12b00 0x5630d7d351b0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x5630d7d19bb0 tx=0x7fbe14013040 comp rx=0 tx=0).stop 2024-09-19T06:22:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.807+0000 7fbe2fc57740 1 -- 172.21.15.3:0/401904380 shutdown_connections 2024-09-19T06:22:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.807+0000 7fbe2fc57740 1 --2- 172.21.15.3:0/401904380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d1d3a0 0x5630d7d13c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.807+0000 7fbe2fc57740 1 --2- 172.21.15.3:0/401904380 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d12b00 0x5630d7d351b0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.807+0000 7fbe2fc57740 1 --2- 172.21.15.3:0/401904380 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5630d7d121e0 0x5630d7d34c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.807+0000 7fbe2fc57740 1 -- 172.21.15.3:0/401904380 >> 172.21.15.3:0/401904380 conn(0x5630d7d0e750 msgr2=0x5630d7d15680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.807+0000 7fbe2fc57740 1 -- 172.21.15.3:0/401904380 shutdown_connections 2024-09-19T06:22:31.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.807+0000 7fbe2fc57740 1 -- 172.21.15.3:0/401904380 wait complete. 2024-09-19T06:22:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.808+0000 7fbe2fc57740 1 -- start start 2024-09-19T06:22:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.808+0000 7fbe2fc57740 1 Processor -- start 2024-09-19T06:22:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.808+0000 7fbe2fc57740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5630d7d121e0 0x5630d7d25340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.808+0000 7fbe2fc57740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d12b00 0x5630d7d25880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.808+0000 7fbe2fc57740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d1d3a0 0x5630d7d16590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.808+0000 7fbe2fc57740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbe281b0f20 con 0x5630d7d1d3a0 2024-09-19T06:22:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.808+0000 7fbe2fc57740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbe281b0850 con 0x5630d7d12b00 2024-09-19T06:22:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.808+0000 7fbe2fc57740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbe281adab0 con 0x5630d7d121e0 2024-09-19T06:22:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.808+0000 7fbe2fc57740 10 client.0 _ll_register_callbacks cb 0x7fbe14009a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.809+0000 7fbe26800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d1d3a0 0x5630d7d16590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.809+0000 7fbe26800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d1d3a0 0x5630d7d16590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58496/0 (socket says 172.21.15.3:58496) 2024-09-19T06:22:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.809+0000 7fbe26800640 1 -- 172.21.15.3:0/2641053838 learned_addr learned my addr 172.21.15.3:0/2641053838 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:31.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.809+0000 7fbe25400640 1 --2- 172.21.15.3:0/2641053838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d12b00 0x5630d7d25880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.809+0000 7fbe25e00640 1 --2- 172.21.15.3:0/2641053838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5630d7d121e0 0x5630d7d25340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.809+0000 7fbe26800640 1 -- 172.21.15.3:0/2641053838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5630d7d121e0 msgr2=0x5630d7d25340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.809+0000 7fbe26800640 1 --2- 172.21.15.3:0/2641053838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5630d7d121e0 0x5630d7d25340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.809+0000 7fbe26800640 1 -- 172.21.15.3:0/2641053838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d12b00 msgr2=0x5630d7d25880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.809+0000 7fbe26800640 1 --2- 172.21.15.3:0/2641053838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d12b00 0x5630d7d25880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.809+0000 7fbe26800640 1 -- 172.21.15.3:0/2641053838 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630d7d25ef0 con 0x5630d7d1d3a0 2024-09-19T06:22:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.809+0000 7fbe26800640 1 --2- 172.21.15.3:0/2641053838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d1d3a0 0x5630d7d16590 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fbe200b99d0 tx=0x7fbe200bd0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d84a8ef4ad73d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.809+0000 7fbe07400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:22:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.809+0000 7fbe07400640 1 -- 172.21.15.3:0/2641053838 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe200d5070 con 0x5630d7d1d3a0 2024-09-19T06:22:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.809+0000 7fbe07400640 1 -- 172.21.15.3:0/2641053838 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7fbe200c5d50 con 0x5630d7d1d3a0 2024-09-19T06:22:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.809+0000 7fbe2fc57740 1 -- 172.21.15.3:0/2641053838 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe14011e00 con 0x5630d7d1d3a0 2024-09-19T06:22:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.810+0000 7fbe07400640 1 -- 172.21.15.3:0/2641053838 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbe200bdc70 con 0x5630d7d1d3a0 2024-09-19T06:22:31.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.810+0000 7fbe2fc57740 10 client.18135 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.810+0000 7fbe2fc57740 1 -- 172.21.15.3:0/2641053838 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5630d7d97200 con 0x5630d7d1d3a0 2024-09-19T06:22:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.810+0000 7fbe07400640 1 -- 172.21.15.3:0/2641053838 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe14011e00 con 0x5630d7d1d3a0 2024-09-19T06:22:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.810+0000 7fbe07400640 1 -- 172.21.15.3:0/2641053838 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fbe200d6260 con 0x5630d7d1d3a0 2024-09-19T06:22:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.810+0000 7fbe2fc57740 10 client.18135 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.810+0000 7fbe2fc57740 10 client.18135 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.810+0000 7fbe2fc57740 20 client.18135 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.810+0000 7fbe2fc57740 1 --2- 172.21.15.3:0/2641053838 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5630d7d97950 0x5630d7d99d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.810+0000 7fbe2fc57740 4 client.18135 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:22:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.810+0000 7fbe2fc57740 1 -- 172.21.15.3:0/2641053838 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5630d7c7fb80 con 0x5630d7d97950 2024-09-19T06:22:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.810+0000 7fbe25e00640 1 --2- 172.21.15.3:0/2641053838 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5630d7d97950 0x5630d7d99d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.811+0000 7fbe25e00640 1 --2- 172.21.15.3:0/2641053838 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5630d7d97950 0x5630d7d99d70 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=279a6debf8e43624 server_cookie=d94bce7d1a971683 in_seq=0 out_seq=0 2024-09-19T06:22:31.816 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.811+0000 7fbe07400640 10 client.18135 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.824+0000 7fbe07400640 1 -- 172.21.15.3:0/2641053838 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5630d7c7fb80 con 0x5630d7d97950 2024-09-19T06:22:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.824+0000 7fbe07400640 10 client.18135 handle_command_reply: tid=0 2024-09-19T06:22:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.824+0000 7fbe2fc57740 1 client.18135 shutdown 2024-09-19T06:22:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.824+0000 7fbe2fc57740 1 -- 172.21.15.3:0/2641053838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d1d3a0 msgr2=0x5630d7d16590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.824+0000 7fbe2fc57740 1 --2- 172.21.15.3:0/2641053838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d1d3a0 0x5630d7d16590 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fbe200b99d0 tx=0x7fbe200bd0b0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.824+0000 7fbe2fc57740 1 -- 172.21.15.3:0/2641053838 shutdown_connections 2024-09-19T06:22:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.824+0000 7fbe2fc57740 1 --2- 172.21.15.3:0/2641053838 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5630d7d97950 0x5630d7d99d70 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.824+0000 7fbe2fc57740 1 --2- 172.21.15.3:0/2641053838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5630d7d1d3a0 0x5630d7d16590 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.824+0000 7fbe2fc57740 1 --2- 172.21.15.3:0/2641053838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5630d7d12b00 0x5630d7d25880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.824+0000 7fbe2fc57740 1 --2- 172.21.15.3:0/2641053838 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5630d7d121e0 0x5630d7d25340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.824+0000 7fbe07400640 0 client.18135 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.824+0000 7fbe2fc57740 1 -- 172.21.15.3:0/2641053838 >> 172.21.15.3:0/2641053838 conn(0x5630d7d0e750 msgr2=0x5630d7d13c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.825+0000 7fbe2fc57740 1 -- 172.21.15.3:0/2641053838 shutdown_connections 2024-09-19T06:22:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.825+0000 7fbe2fc57740 1 -- 172.21.15.3:0/2641053838 wait complete. 2024-09-19T06:22:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.825+0000 7fbe2fc57740 20 client.18135 trim_cache size 0 max 16384 2024-09-19T06:22:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:22:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:22:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:22:31.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:22:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.825+0000 7fbe2cc00640 1 -- 172.21.15.3:0/1738804373 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbe0c0a33b0 msgr2=0x7fbe0c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.825+0000 7fbe2cc00640 1 --2- 172.21.15.3:0/1738804373 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbe0c0a33b0 0x7fbe0c0a5870 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x5630d7d0fad0 tx=0x7fbe14004730 comp rx=0 tx=0).stop 2024-09-19T06:22:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.825+0000 7fbe2cc00640 1 -- 172.21.15.3:0/1738804373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe2819ee60 msgr2=0x7fbe2819f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.825+0000 7fbe2cc00640 1 --2- 172.21.15.3:0/1738804373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe2819ee60 0x7fbe2819f310 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fbe20033040 tx=0x7fbe20003f10 comp rx=0 tx=0).stop 2024-09-19T06:22:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.825+0000 7fbe2cc00640 1 -- 172.21.15.3:0/1738804373 shutdown_connections 2024-09-19T06:22:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.825+0000 7fbe2cc00640 1 --2- 172.21.15.3:0/1738804373 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbe0c0a33b0 0x7fbe0c0a5870 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.825+0000 7fbe2cc00640 1 --2- 172.21.15.3:0/1738804373 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbe2819ee60 0x7fbe2819f310 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.825+0000 7fbe2cc00640 1 --2- 172.21.15.3:0/1738804373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe28109090 0x7fbe2819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.825+0000 7fbe2cc00640 1 --2- 172.21.15.3:0/1738804373 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbe28103f40 0x7fbe2819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:31.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.825+0000 7fbe2cc00640 1 -- 172.21.15.3:0/1738804373 >> 172.21.15.3:0/1738804373 conn(0x7fbe280ff970 msgr2=0x7fbe28100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:31.830 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.826+0000 7fbe2cc00640 1 -- 172.21.15.3:0/1738804373 shutdown_connections 2024-09-19T06:22:31.830 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:31.826+0000 7fbe2cc00640 1 -- 172.21.15.3:0/1738804373 wait complete. 2024-09-19T06:22:32.250 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:22:32.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:32 smithi059 ceph-mon[35138]: pgmap v315: 97 pgs: 97 active+clean; 3.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 45 KiB/s wr, 16 op/s 2024-09-19T06:22:32.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:32 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/3933490437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:22:32.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:32 smithi003 ceph-mon[30893]: pgmap v315: 97 pgs: 97 active+clean; 3.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 45 KiB/s wr, 16 op/s 2024-09-19T06:22:32.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:32 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3933490437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:22:32.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:32 smithi071 ceph-mon[35662]: pgmap v315: 97 pgs: 97 active+clean; 3.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 45 KiB/s wr, 16 op/s 2024-09-19T06:22:32.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:32 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/3933490437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:22:32.632 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:33.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.245+0000 7ffbd3000640 1 -- 172.21.15.3:0/531357703 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbcc102360 msgr2=0x7ffbcc10e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:33.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.245+0000 7ffbd3000640 1 --2- 172.21.15.3:0/531357703 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbcc102360 0x7ffbcc10e890 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4009cd0 tx=0x7ffbc402a8f0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.245+0000 7ffbd3000640 1 -- 172.21.15.3:0/531357703 shutdown_connections 2024-09-19T06:22:33.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.245+0000 7ffbd3000640 1 --2- 172.21.15.3:0/531357703 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbcc102360 0x7ffbcc10e890 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.245+0000 7ffbd3000640 1 --2- 172.21.15.3:0/531357703 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbcc1019c0 0x7ffbcc101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.245+0000 7ffbd3000640 1 --2- 172.21.15.3:0/531357703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbcc1079c0 0x7ffbcc107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.245+0000 7ffbd3000640 1 -- 172.21.15.3:0/531357703 >> 172.21.15.3:0/531357703 conn(0x7ffbcc0fd740 msgr2=0x7ffbcc0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:33.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.245+0000 7ffbd3000640 1 -- 172.21.15.3:0/531357703 shutdown_connections 2024-09-19T06:22:33.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.245+0000 7ffbd3000640 1 -- 172.21.15.3:0/531357703 wait complete. 2024-09-19T06:22:33.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.246+0000 7ffbd3000640 1 Processor -- start 2024-09-19T06:22:33.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.246+0000 7ffbd3000640 1 -- start start 2024-09-19T06:22:33.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.247+0000 7ffbd3000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbcc1019c0 0x7ffbcc19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.247+0000 7ffbd3000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbcc102360 0x7ffbcc19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.247+0000 7ffbd3000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbcc1079c0 0x7ffbcc19edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.247+0000 7ffbd3000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc111dc0 con 0x7ffbcc1019c0 2024-09-19T06:22:33.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.247+0000 7ffbd3000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc111c40 con 0x7ffbcc102360 2024-09-19T06:22:33.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.247+0000 7ffbd3000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc111f40 con 0x7ffbcc1079c0 2024-09-19T06:22:33.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.247+0000 7ffbd1c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbcc1019c0 0x7ffbcc19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.247+0000 7ffbd1c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbcc1019c0 0x7ffbcc19a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58528/0 (socket says 172.21.15.3:58528) 2024-09-19T06:22:33.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.247+0000 7ffbd1c00640 1 -- 172.21.15.3:0/3956729690 learned_addr learned my addr 172.21.15.3:0/3956729690 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:33.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.247+0000 7ffbd1200640 1 --2- 172.21.15.3:0/3956729690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbcc102360 0x7ffbcc19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.247+0000 7ffbd2600640 1 --2- 172.21.15.3:0/3956729690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbcc1079c0 0x7ffbcc19edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.248+0000 7ffbd1c00640 1 -- 172.21.15.3:0/3956729690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbcc1079c0 msgr2=0x7ffbcc19edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:33.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.248+0000 7ffbd1c00640 1 --2- 172.21.15.3:0/3956729690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbcc1079c0 0x7ffbcc19edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.248+0000 7ffbd1c00640 1 -- 172.21.15.3:0/3956729690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbcc102360 msgr2=0x7ffbcc19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:33.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.248+0000 7ffbd1c00640 1 --2- 172.21.15.3:0/3956729690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbcc102360 0x7ffbcc19aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.248+0000 7ffbd1c00640 1 -- 172.21.15.3:0/3956729690 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbcc19f490 con 0x7ffbcc1019c0 2024-09-19T06:22:33.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.248+0000 7ffbd1200640 1 --2- 172.21.15.3:0/3956729690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbcc102360 0x7ffbcc19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:33.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.248+0000 7ffbd1c00640 1 --2- 172.21.15.3:0/3956729690 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbcc1019c0 0x7ffbcc19a4e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7ffbc000ea60 tx=0x7ffbc000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:33.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.248+0000 7ffbca000640 1 -- 172.21.15.3:0/3956729690 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc000cde0 con 0x7ffbcc1019c0 2024-09-19T06:22:33.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.248+0000 7ffbd3000640 1 -- 172.21.15.3:0/3956729690 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbcc19f780 con 0x7ffbcc1019c0 2024-09-19T06:22:33.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.248+0000 7ffbca000640 1 -- 172.21.15.3:0/3956729690 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbc00035f0 con 0x7ffbcc1019c0 2024-09-19T06:22:33.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.248+0000 7ffbca000640 1 -- 172.21.15.3:0/3956729690 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0005220 con 0x7ffbcc1019c0 2024-09-19T06:22:33.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.248+0000 7ffbd3000640 1 -- 172.21.15.3:0/3956729690 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbcc1a7060 con 0x7ffbcc1019c0 2024-09-19T06:22:33.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.252+0000 7ffbd71db740 1 Processor -- start 2024-09-19T06:22:33.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.252+0000 7ffbca000640 1 -- 172.21.15.3:0/3956729690 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7ffbc00037a0 con 0x7ffbcc1019c0 2024-09-19T06:22:33.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.252+0000 7ffbd71db740 1 -- start start 2024-09-19T06:22:33.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.252+0000 7ffbd71db740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea42223e40 0x55ea42224220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.252+0000 7ffbd71db740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42224760 0x55ea4222eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.252+0000 7ffbd71db740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea4222f020 0x55ea42231410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.252+0000 7ffbd71db740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ea4218a3e0 con 0x55ea42224760 2024-09-19T06:22:33.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.252+0000 7ffbd71db740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ea42131d80 con 0x55ea4222f020 2024-09-19T06:22:33.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.252+0000 7ffbd71db740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ea421863a0 con 0x55ea42223e40 2024-09-19T06:22:33.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.253+0000 7ffbd2600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea42223e40 0x55ea42224220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.253+0000 7ffbd2600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea42223e40 0x55ea42224220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:40770/0 (socket says 172.21.15.3:40770) 2024-09-19T06:22:33.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.253+0000 7ffbd2600640 1 -- 172.21.15.3:0/503401528 learned_addr learned my addr 172.21.15.3:0/503401528 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:33.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.253+0000 7ffbd1c00640 1 --2- 172.21.15.3:0/503401528 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42224760 0x55ea4222eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.253+0000 7ffbd1200640 1 --2- 172.21.15.3:0/503401528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea4222f020 0x55ea42231410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.253+0000 7ffbd2600640 1 -- 172.21.15.3:0/503401528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea4222f020 msgr2=0x55ea42231410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:33.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.253+0000 7ffbd2600640 1 --2- 172.21.15.3:0/503401528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea4222f020 0x55ea42231410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.253+0000 7ffbd2600640 1 -- 172.21.15.3:0/503401528 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42224760 msgr2=0x55ea4222eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:33.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.253+0000 7ffbd2600640 1 --2- 172.21.15.3:0/503401528 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42224760 0x55ea4222eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.253+0000 7ffbd2600640 1 -- 172.21.15.3:0/503401528 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea42150ae0 con 0x55ea42223e40 2024-09-19T06:22:33.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.253+0000 7ffbd2600640 1 --2- 172.21.15.3:0/503401528 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea42223e40 0x55ea42224220 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4004aa0 tx=0x7ffbc4009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c8a4bb664baa1f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:33.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.253+0000 7ffbca000640 1 --2- 172.21.15.3:0/3956729690 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ffbb40a33b0 0x7ffbb40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.254+0000 7ffbca000640 1 -- 172.21.15.3:0/3956729690 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7ffbc00cff70 con 0x7ffbcc1019c0 2024-09-19T06:22:33.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.254+0000 7ffbbea00640 1 -- 172.21.15.3:0/503401528 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4030660 con 0x55ea42223e40 2024-09-19T06:22:33.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.254+0000 7ffbd1c00640 1 --2- 172.21.15.3:0/3956729690 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ffbb40a33b0 0x7ffbb40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.254+0000 7ffbbea00640 1 -- 172.21.15.3:0/503401528 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbc4036030 con 0x55ea42223e40 2024-09-19T06:22:33.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.254+0000 7ffbbea00640 1 -- 172.21.15.3:0/503401528 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc40043a0 con 0x55ea42223e40 2024-09-19T06:22:33.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.255+0000 7ffbd71db740 1 -- 172.21.15.3:0/503401528 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea42223e40 msgr2=0x55ea42224220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:33.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.255+0000 7ffbd71db740 1 --2- 172.21.15.3:0/503401528 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea42223e40 0x55ea42224220 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4004aa0 tx=0x7ffbc4009360 comp rx=0 tx=0).stop 2024-09-19T06:22:33.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.255+0000 7ffbd1c00640 1 --2- 172.21.15.3:0/3956729690 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ffbb40a33b0 0x7ffbb40a5870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55ea42221230 tx=0x7ffbc00d3a20 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:33.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.255+0000 7ffbd71db740 1 -- 172.21.15.3:0/503401528 shutdown_connections 2024-09-19T06:22:33.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.255+0000 7ffbd71db740 1 --2- 172.21.15.3:0/503401528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea4222f020 0x55ea42231410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.255+0000 7ffbd71db740 1 --2- 172.21.15.3:0/503401528 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42224760 0x55ea4222eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.255+0000 7ffbd71db740 1 --2- 172.21.15.3:0/503401528 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea42223e40 0x55ea42224220 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.255+0000 7ffbd71db740 1 -- 172.21.15.3:0/503401528 >> 172.21.15.3:0/503401528 conn(0x55ea422203d0 msgr2=0x55ea422207b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:33.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.255+0000 7ffbd71db740 1 -- 172.21.15.3:0/503401528 shutdown_connections 2024-09-19T06:22:33.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.255+0000 7ffbd71db740 1 -- 172.21.15.3:0/503401528 wait complete. 2024-09-19T06:22:33.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.255+0000 7ffbd71db740 1 -- start start 2024-09-19T06:22:33.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.256+0000 7ffbd71db740 1 Processor -- start 2024-09-19T06:22:33.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.256+0000 7ffbd71db740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea42223e40 0x55ea4222bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.256+0000 7ffbd71db740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42224760 0x55ea4222c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.256+0000 7ffbd71db740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea4222f020 0x55ea4222c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.256+0000 7ffbd71db740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ea42231bf0 con 0x55ea42224760 2024-09-19T06:22:33.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.256+0000 7ffbd71db740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ea421450f0 con 0x55ea4222f020 2024-09-19T06:22:33.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.256+0000 7ffbd71db740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ea42231d70 con 0x55ea42223e40 2024-09-19T06:22:33.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.256+0000 7ffbd71db740 10 client.0 _ll_register_callbacks cb 0x55ea4212cbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:33.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.256+0000 7ffbd1200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42224760 0x55ea4222c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.256+0000 7ffbd2600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea42223e40 0x55ea4222bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.256+0000 7ffbd2600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea42223e40 0x55ea4222bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:40778/0 (socket says 172.21.15.3:40778) 2024-09-19T06:22:33.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.256+0000 7ffbd2600640 1 -- 172.21.15.3:0/4203622248 learned_addr learned my addr 172.21.15.3:0/4203622248 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:33.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.256+0000 7ffbd1200640 1 --2- 172.21.15.3:0/4203622248 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42224760 0x55ea4222c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58542/0 (socket says 172.21.15.3:58542) 2024-09-19T06:22:33.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.257+0000 7ffbd2600640 1 --2- 172.21.15.3:0/4203622248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea4222f020 0x55ea4222c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.257+0000 7ffbd1200640 1 -- 172.21.15.3:0/4203622248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea42223e40 msgr2=0x55ea4222bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:33.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.257+0000 7ffbd1200640 1 --2- 172.21.15.3:0/4203622248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea42223e40 0x55ea4222bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.257+0000 7ffbd1200640 1 -- 172.21.15.3:0/4203622248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea4222f020 msgr2=0x55ea4222c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:33.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.257+0000 7ffbd1200640 1 --2- 172.21.15.3:0/4203622248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea4222f020 0x55ea4222c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.257+0000 7ffbd1200640 1 -- 172.21.15.3:0/4203622248 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea41efb3c0 con 0x55ea42224760 2024-09-19T06:22:33.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.257+0000 7ffbd1200640 1 --2- 172.21.15.3:0/4203622248 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42224760 0x55ea4222c430 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8012cf0 tx=0x7ffbb800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc1d8b91ff36a9a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:33.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.257+0000 7ffbb3400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:22:33.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.257+0000 7ffbb3400640 1 -- 172.21.15.3:0/4203622248 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb800fe60 con 0x55ea42224760 2024-09-19T06:22:33.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.257+0000 7ffbd71db740 1 -- 172.21.15.3:0/4203622248 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbc4036030 con 0x55ea42224760 2024-09-19T06:22:33.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.257+0000 7ffbb3400640 1 -- 172.21.15.3:0/4203622248 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7ffbb8012110 con 0x55ea42224760 2024-09-19T06:22:33.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.258+0000 7ffbb3400640 1 -- 172.21.15.3:0/4203622248 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffbb8004050 con 0x55ea42224760 2024-09-19T06:22:33.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.258+0000 7ffbd71db740 10 client.18147 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:33.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.258+0000 7ffbd71db740 1 -- 172.21.15.3:0/4203622248 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ea4223dc70 con 0x55ea42224760 2024-09-19T06:22:33.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.258+0000 7ffbb3400640 1 -- 172.21.15.3:0/4203622248 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbc4036030 con 0x55ea42224760 2024-09-19T06:22:33.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.258+0000 7ffbb3400640 1 -- 172.21.15.3:0/4203622248 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ffbb8023070 con 0x55ea42224760 2024-09-19T06:22:33.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.258+0000 7ffbd71db740 10 client.18147 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:33.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.258+0000 7ffbd71db740 10 client.18147 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:22:33.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.258+0000 7ffbd71db740 20 client.18147 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:33.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.258+0000 7ffbd71db740 1 --2- 172.21.15.3:0/4203622248 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55ea4223f180 0x55ea422415a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.258+0000 7ffbd71db740 4 client.18147 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:33.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.258+0000 7ffbd71db740 1 -- 172.21.15.3:0/4203622248 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea42197950 con 0x55ea4223f180 2024-09-19T06:22:33.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.259+0000 7ffbd2600640 1 --2- 172.21.15.3:0/4203622248 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55ea4223f180 0x55ea422415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.259+0000 7ffbd2600640 1 --2- 172.21.15.3:0/4203622248 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55ea4223f180 0x55ea422415a0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e91ee4f8b21d1a97 server_cookie=126fa18773ed5c3b in_seq=0 out_seq=0 2024-09-19T06:22:33.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.259+0000 7ffbb3400640 10 client.18147 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:22:33.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.260+0000 7ffbb3400640 1 -- 172.21.15.3:0/4203622248 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ea42197950 con 0x55ea4223f180 2024-09-19T06:22:33.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.260+0000 7ffbb3400640 10 client.18147 handle_command_reply: tid=0 2024-09-19T06:22:33.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.260+0000 7ffbd71db740 1 client.18147 shutdown 2024-09-19T06:22:33.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.260+0000 7ffbd71db740 1 -- 172.21.15.3:0/4203622248 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42224760 msgr2=0x55ea4222c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:33.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.260+0000 7ffbd71db740 1 --2- 172.21.15.3:0/4203622248 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42224760 0x55ea4222c430 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8012cf0 tx=0x7ffbb800f790 comp rx=0 tx=0).stop 2024-09-19T06:22:33.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.260+0000 7ffbd71db740 1 -- 172.21.15.3:0/4203622248 shutdown_connections 2024-09-19T06:22:33.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.260+0000 7ffbd71db740 1 --2- 172.21.15.3:0/4203622248 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55ea4223f180 0x55ea422415a0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.260+0000 7ffbd71db740 1 --2- 172.21.15.3:0/4203622248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea4222f020 0x55ea4222c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.260+0000 7ffbd71db740 1 --2- 172.21.15.3:0/4203622248 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42224760 0x55ea4222c430 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.260+0000 7ffbd71db740 1 --2- 172.21.15.3:0/4203622248 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea42223e40 0x55ea4222bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.260+0000 7ffbb3400640 0 client.18147 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:22:33.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.260+0000 7ffbd71db740 1 -- 172.21.15.3:0/4203622248 >> 172.21.15.3:0/4203622248 conn(0x55ea422203d0 msgr2=0x55ea42226100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:33.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.260+0000 7ffbd71db740 1 -- 172.21.15.3:0/4203622248 shutdown_connections 2024-09-19T06:22:33.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.261+0000 7ffbd71db740 1 -- 172.21.15.3:0/4203622248 wait complete. 2024-09-19T06:22:33.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.261+0000 7ffbd71db740 20 client.18147 trim_cache size 0 max 16384 2024-09-19T06:22:33.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.274+0000 7ffbd71db740 1 Processor -- start 2024-09-19T06:22:33.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.274+0000 7ffbd71db740 1 -- start start 2024-09-19T06:22:33.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.275+0000 7ffbd71db740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42223e40 0x55ea422268a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.275+0000 7ffbd71db740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea42224760 0x55ea42246e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.275+0000 7ffbd71db740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea4222f020 0x55ea42247390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.275+0000 7ffbd71db740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc1afaf0 con 0x55ea42223e40 2024-09-19T06:22:33.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.275+0000 7ffbd71db740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc1b1630 con 0x55ea42224760 2024-09-19T06:22:33.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.275+0000 7ffbd71db740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc1b01c0 con 0x55ea4222f020 2024-09-19T06:22:33.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.275+0000 7ffbd2600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42223e40 0x55ea422268a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.275+0000 7ffbd2600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42223e40 0x55ea422268a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58558/0 (socket says 172.21.15.3:58558) 2024-09-19T06:22:33.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.275+0000 7ffbd2600640 1 -- 172.21.15.3:0/4287590077 learned_addr learned my addr 172.21.15.3:0/4287590077 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:33.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.275+0000 7ffbd1200640 1 --2- 172.21.15.3:0/4287590077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea42224760 0x55ea42246e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.275+0000 7ffbd2600640 1 -- 172.21.15.3:0/4287590077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea4222f020 msgr2=0x55ea42247390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:33.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.275+0000 7ffbd2600640 1 --2- 172.21.15.3:0/4287590077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea4222f020 0x55ea42247390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.275+0000 7ffbd2600640 1 -- 172.21.15.3:0/4287590077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea42224760 msgr2=0x55ea42246e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:33.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.275+0000 7ffbd2600640 1 --2- 172.21.15.3:0/4287590077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea42224760 0x55ea42246e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.275+0000 7ffbd2600640 1 -- 172.21.15.3:0/4287590077 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea42223c70 con 0x55ea42223e40 2024-09-19T06:22:33.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.275+0000 7ffbd1200640 1 --2- 172.21.15.3:0/4287590077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea42224760 0x55ea42246e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:33.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.276+0000 7ffbd2600640 1 --2- 172.21.15.3:0/4287590077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42223e40 0x55ea422268a0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4009bf0 tx=0x7ffbc4003ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822706ef97d9715 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:33.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.276+0000 7ffbbe000640 1 -- 172.21.15.3:0/4287590077 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4003a90 con 0x55ea42223e40 2024-09-19T06:22:33.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.276+0000 7ffbbe000640 1 -- 172.21.15.3:0/4287590077 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbc4036040 con 0x55ea42223e40 2024-09-19T06:22:33.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.276+0000 7ffbbe000640 1 -- 172.21.15.3:0/4287590077 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4004200 con 0x55ea42223e40 2024-09-19T06:22:33.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.277+0000 7ffbd71db740 1 -- 172.21.15.3:0/4287590077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42223e40 msgr2=0x55ea422268a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:33.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.277+0000 7ffbd71db740 1 --2- 172.21.15.3:0/4287590077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42223e40 0x55ea422268a0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4009bf0 tx=0x7ffbc4003ed0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.277+0000 7ffbd71db740 1 -- 172.21.15.3:0/4287590077 shutdown_connections 2024-09-19T06:22:33.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.277+0000 7ffbd71db740 1 --2- 172.21.15.3:0/4287590077 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea4222f020 0x55ea42247390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.277+0000 7ffbd71db740 1 --2- 172.21.15.3:0/4287590077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea42224760 0x55ea42246e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.277+0000 7ffbd71db740 1 --2- 172.21.15.3:0/4287590077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42223e40 0x55ea422268a0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.277+0000 7ffbd71db740 1 -- 172.21.15.3:0/4287590077 >> 172.21.15.3:0/4287590077 conn(0x55ea422203d0 msgr2=0x55ea4222df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:33.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.277+0000 7ffbd71db740 1 -- 172.21.15.3:0/4287590077 shutdown_connections 2024-09-19T06:22:33.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.277+0000 7ffbd71db740 1 -- 172.21.15.3:0/4287590077 wait complete. 2024-09-19T06:22:33.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.277+0000 7ffbd71db740 1 -- start start 2024-09-19T06:22:33.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.277+0000 7ffbd71db740 1 Processor -- start 2024-09-19T06:22:33.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.278+0000 7ffbd71db740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea42223e40 0x55ea42232d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.278+0000 7ffbd71db740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42224760 0x55ea42233290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.278+0000 7ffbd71db740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea4222f020 0x55ea422337d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.278+0000 7ffbd71db740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc1b0f60 con 0x55ea42224760 2024-09-19T06:22:33.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.278+0000 7ffbd71db740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc1b0890 con 0x55ea4222f020 2024-09-19T06:22:33.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.278+0000 7ffbd71db740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc1adaf0 con 0x55ea42223e40 2024-09-19T06:22:33.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.278+0000 7ffbd71db740 10 client.0 _ll_register_callbacks cb 0x7ffbb8009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:33.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.278+0000 7ffbd1200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42224760 0x55ea42233290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.278+0000 7ffbd1200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42224760 0x55ea42233290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58566/0 (socket says 172.21.15.3:58566) 2024-09-19T06:22:33.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.278+0000 7ffbd1200640 1 -- 172.21.15.3:0/1179808276 learned_addr learned my addr 172.21.15.3:0/1179808276 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:33.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.278+0000 7ffbd2600640 1 --2- 172.21.15.3:0/1179808276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea4222f020 0x55ea422337d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.278+0000 7ffbd2600640 1 --2- 172.21.15.3:0/1179808276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea42223e40 0x55ea42232d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.278+0000 7ffbd1200640 1 -- 172.21.15.3:0/1179808276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea42223e40 msgr2=0x55ea42232d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:33.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.278+0000 7ffbd1200640 1 --2- 172.21.15.3:0/1179808276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea42223e40 0x55ea42232d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.278+0000 7ffbd1200640 1 -- 172.21.15.3:0/1179808276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea4222f020 msgr2=0x55ea422337d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:33.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.278+0000 7ffbd1200640 1 --2- 172.21.15.3:0/1179808276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea4222f020 0x55ea422337d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.278+0000 7ffbd1200640 1 -- 172.21.15.3:0/1179808276 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea422a8e70 con 0x55ea42224760 2024-09-19T06:22:33.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.278+0000 7ffbd2600640 1 --2- 172.21.15.3:0/1179808276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea4222f020 0x55ea422337d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:33.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.279+0000 7ffbd1200640 1 --2- 172.21.15.3:0/1179808276 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42224760 0x55ea42233290 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x55ea4222b780 tx=0x7ffbb800fe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27e14d75d1fb532 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:33.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.279+0000 7ffbb3400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:22:33.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.279+0000 7ffbb3400640 1 -- 172.21.15.3:0/1179808276 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8029040 con 0x55ea42224760 2024-09-19T06:22:33.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.279+0000 7ffbd71db740 1 -- 172.21.15.3:0/1179808276 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbc4036040 con 0x55ea42224760 2024-09-19T06:22:33.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.279+0000 7ffbb3400640 1 -- 172.21.15.3:0/1179808276 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7ffbb8005260 con 0x55ea42224760 2024-09-19T06:22:33.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.279+0000 7ffbb3400640 1 -- 172.21.15.3:0/1179808276 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffbb8005460 con 0x55ea42224760 2024-09-19T06:22:33.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.279+0000 7ffbd71db740 10 client.18153 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:33.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.279+0000 7ffbd71db740 1 -- 172.21.15.3:0/1179808276 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ea422aa130 con 0x55ea42224760 2024-09-19T06:22:33.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.280+0000 7ffbb3400640 1 -- 172.21.15.3:0/1179808276 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffbc4036040 con 0x55ea42224760 2024-09-19T06:22:33.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.280+0000 7ffbb3400640 1 -- 172.21.15.3:0/1179808276 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ffbb8023040 con 0x55ea42224760 2024-09-19T06:22:33.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.280+0000 7ffbd71db740 10 client.18153 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:33.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.280+0000 7ffbd71db740 10 client.18153 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:22:33.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.280+0000 7ffbd71db740 20 client.18153 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:33.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.280+0000 7ffbd71db740 1 --2- 172.21.15.3:0/1179808276 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55ea422aa840 0x55ea422acc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:33.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.280+0000 7ffbd71db740 4 client.18153 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:22:33.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.280+0000 7ffbd71db740 1 -- 172.21.15.3:0/1179808276 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ea42191e60 con 0x55ea422aa840 2024-09-19T06:22:33.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.280+0000 7ffbd2600640 1 --2- 172.21.15.3:0/1179808276 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55ea422aa840 0x55ea422acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:33.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.281+0000 7ffbb3400640 10 client.18153 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:22:33.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.281+0000 7ffbd2600640 1 --2- 172.21.15.3:0/1179808276 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55ea422aa840 0x55ea422acc60 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fe963908769fad3c server_cookie=e74d79e501c92a97 in_seq=0 out_seq=0 2024-09-19T06:22:33.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.281+0000 7ffbb3400640 1 -- 172.21.15.3:0/1179808276 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ea42191e60 con 0x55ea422aa840 2024-09-19T06:22:33.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.281+0000 7ffbb3400640 10 client.18153 handle_command_reply: tid=0 2024-09-19T06:22:33.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.281+0000 7ffbd71db740 1 client.18153 shutdown 2024-09-19T06:22:33.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.281+0000 7ffbd71db740 1 -- 172.21.15.3:0/1179808276 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42224760 msgr2=0x55ea42233290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:33.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.281+0000 7ffbd71db740 1 --2- 172.21.15.3:0/1179808276 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42224760 0x55ea42233290 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x55ea4222b780 tx=0x7ffbb800fe60 comp rx=0 tx=0).stop 2024-09-19T06:22:33.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.281+0000 7ffbd71db740 1 -- 172.21.15.3:0/1179808276 shutdown_connections 2024-09-19T06:22:33.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.281+0000 7ffbd71db740 1 --2- 172.21.15.3:0/1179808276 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55ea422aa840 0x55ea422acc60 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.281+0000 7ffbd71db740 1 --2- 172.21.15.3:0/1179808276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ea4222f020 0x55ea422337d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.281+0000 7ffbd71db740 1 --2- 172.21.15.3:0/1179808276 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ea42224760 0x55ea42233290 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.281+0000 7ffbd71db740 1 --2- 172.21.15.3:0/1179808276 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ea42223e40 0x55ea42232d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.281+0000 7ffbb3400640 0 client.18153 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:22:33.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.281+0000 7ffbd71db740 1 -- 172.21.15.3:0/1179808276 >> 172.21.15.3:0/1179808276 conn(0x55ea422203d0 msgr2=0x55ea4221ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:33.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.281+0000 7ffbd71db740 1 -- 172.21.15.3:0/1179808276 shutdown_connections 2024-09-19T06:22:33.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.281+0000 7ffbd71db740 1 -- 172.21.15.3:0/1179808276 wait complete. 2024-09-19T06:22:33.450 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:22:33.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.281+0000 7ffbd71db740 20 client.18153 trim_cache size 0 max 16384 2024-09-19T06:22:33.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.282+0000 7ffbd3000640 1 -- 172.21.15.3:0/3956729690 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ffbb40a33b0 msgr2=0x7ffbb40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:33.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.282+0000 7ffbd3000640 1 --2- 172.21.15.3:0/3956729690 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ffbb40a33b0 0x7ffbb40a5870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55ea42221230 tx=0x7ffbc00d3a20 comp rx=0 tx=0).stop 2024-09-19T06:22:33.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.282+0000 7ffbd3000640 1 -- 172.21.15.3:0/3956729690 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbcc1019c0 msgr2=0x7ffbcc19a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:33.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.282+0000 7ffbd3000640 1 --2- 172.21.15.3:0/3956729690 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbcc1019c0 0x7ffbcc19a4e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7ffbc000ea60 tx=0x7ffbc000ef20 comp rx=0 tx=0).stop 2024-09-19T06:22:33.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.282+0000 7ffbd3000640 1 -- 172.21.15.3:0/3956729690 shutdown_connections 2024-09-19T06:22:33.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.282+0000 7ffbd3000640 1 --2- 172.21.15.3:0/3956729690 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ffbb40a33b0 0x7ffbb40a5870 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.282+0000 7ffbd3000640 1 --2- 172.21.15.3:0/3956729690 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ffbcc1079c0 0x7ffbcc19edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.282+0000 7ffbd3000640 1 --2- 172.21.15.3:0/3956729690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffbcc102360 0x7ffbcc19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.282+0000 7ffbd3000640 1 --2- 172.21.15.3:0/3956729690 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ffbcc1019c0 0x7ffbcc19a4e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:33.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.282+0000 7ffbd3000640 1 -- 172.21.15.3:0/3956729690 >> 172.21.15.3:0/3956729690 conn(0x7ffbcc0fd740 msgr2=0x7ffbcc10cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:33.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.282+0000 7ffbd3000640 1 -- 172.21.15.3:0/3956729690 shutdown_connections 2024-09-19T06:22:33.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:33.282+0000 7ffbd3000640 1 -- 172.21.15.3:0/3956729690 wait complete. 2024-09-19T06:22:34.326 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:22:34.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:34 smithi059 ceph-mon[35138]: pgmap v316: 97 pgs: 97 active+clean; 3.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 45 KiB/s wr, 16 op/s 2024-09-19T06:22:34.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:34 smithi003 ceph-mon[30893]: pgmap v316: 97 pgs: 97 active+clean; 3.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 45 KiB/s wr, 16 op/s 2024-09-19T06:22:34.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:34 smithi071 ceph-mon[35662]: pgmap v316: 97 pgs: 97 active+clean; 3.8 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 45 KiB/s wr, 16 op/s 2024-09-19T06:22:34.709 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:35.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.279+0000 7f3c4ac00640 1 -- 172.21.15.3:0/75680590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c44074eb0 msgr2=0x7f3c44112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:35.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.279+0000 7f3c4ac00640 1 --2- 172.21.15.3:0/75680590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c44074eb0 0x7f3c44112650 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009900 tx=0x7f3c3002a480 comp rx=0 tx=0).stop 2024-09-19T06:22:35.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.280+0000 7f3c4ac00640 1 -- 172.21.15.3:0/75680590 shutdown_connections 2024-09-19T06:22:35.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.280+0000 7f3c4ac00640 1 --2- 172.21.15.3:0/75680590 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c44112b90 0x7f3c44114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.280+0000 7f3c4ac00640 1 --2- 172.21.15.3:0/75680590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c44074eb0 0x7f3c44112650 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.280+0000 7f3c4ac00640 1 --2- 172.21.15.3:0/75680590 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c44074590 0x7f3c44074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.280+0000 7f3c4ac00640 1 -- 172.21.15.3:0/75680590 >> 172.21.15.3:0/75680590 conn(0x7f3c440fd8c0 msgr2=0x7f3c440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:35.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.280+0000 7f3c4ac00640 1 -- 172.21.15.3:0/75680590 shutdown_connections 2024-09-19T06:22:35.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.280+0000 7f3c4ac00640 1 -- 172.21.15.3:0/75680590 wait complete. 2024-09-19T06:22:35.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.281+0000 7f3c4ac00640 1 Processor -- start 2024-09-19T06:22:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.281+0000 7f3c4ac00640 1 -- start start 2024-09-19T06:22:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.281+0000 7f3c4ac00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c44074590 0x7f3c441a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.281+0000 7f3c4ac00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c44074eb0 0x7f3c441a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.281+0000 7f3c4ac00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c44112b90 0x7f3c4419e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.281+0000 7f3c4ac00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3c44118560 con 0x7f3c44074eb0 2024-09-19T06:22:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.281+0000 7f3c4ac00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3c441183e0 con 0x7f3c44074590 2024-09-19T06:22:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.281+0000 7f3c4ac00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3c441186e0 con 0x7f3c44112b90 2024-09-19T06:22:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.281+0000 7f3c43400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c44074eb0 0x7f3c441a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.282+0000 7f3c43e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c44074590 0x7f3c441a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.282+0000 7f3c48c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c44112b90 0x7f3c4419e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.282+0000 7f3c43e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c44074590 0x7f3c441a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:34564/0 (socket says 172.21.15.3:34564) 2024-09-19T06:22:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.282+0000 7f3c43e00640 1 -- 172.21.15.3:0/74747446 learned_addr learned my addr 172.21.15.3:0/74747446 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:35.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.282+0000 7f3c43e00640 1 -- 172.21.15.3:0/74747446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c44112b90 msgr2=0x7f3c4419e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:35.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.282+0000 7f3c43e00640 1 --2- 172.21.15.3:0/74747446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c44112b90 0x7f3c4419e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.282+0000 7f3c43e00640 1 -- 172.21.15.3:0/74747446 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c44074eb0 msgr2=0x7f3c441a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:35.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.282+0000 7f3c43e00640 1 --2- 172.21.15.3:0/74747446 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c44074eb0 0x7f3c441a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.282+0000 7f3c43e00640 1 -- 172.21.15.3:0/74747446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4419f000 con 0x7f3c44074590 2024-09-19T06:22:35.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.282+0000 7f3c43e00640 1 --2- 172.21.15.3:0/74747446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c44074590 0x7f3c441a4710 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400ea60 tx=0x7f3c3400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:35.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.283+0000 7f3c40c00640 1 -- 172.21.15.3:0/74747446 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3400cde0 con 0x7f3c44074590 2024-09-19T06:22:35.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.283+0000 7f3c40c00640 1 -- 172.21.15.3:0/74747446 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c340035f0 con 0x7f3c44074590 2024-09-19T06:22:35.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.283+0000 7f3c4ac00640 1 -- 172.21.15.3:0/74747446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c4419f2f0 con 0x7f3c44074590 2024-09-19T06:22:35.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.283+0000 7f3c40c00640 1 -- 172.21.15.3:0/74747446 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c34010670 con 0x7f3c44074590 2024-09-19T06:22:35.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.283+0000 7f3c4ac00640 1 -- 172.21.15.3:0/74747446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c441ab5e0 con 0x7f3c44074590 2024-09-19T06:22:35.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.287+0000 7f3c4d686740 1 Processor -- start 2024-09-19T06:22:35.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.287+0000 7f3c4d686740 1 -- start start 2024-09-19T06:22:35.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.287+0000 7f3c4d686740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed626c70 0x555eed627050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:35.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.287+0000 7f3c4d686740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eed627590 0x555eed631910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:35.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.287+0000 7f3c4d686740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eed631e50 0x555eed634240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:35.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.287+0000 7f3c4d686740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x555eed58d3e0 con 0x555eed626c70 2024-09-19T06:22:35.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.287+0000 7f3c4d686740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555eed534d80 con 0x555eed631e50 2024-09-19T06:22:35.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.287+0000 7f3c4d686740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555eed5893a0 con 0x555eed627590 2024-09-19T06:22:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.288+0000 7f3c48c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed626c70 0x555eed627050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.288+0000 7f3c48c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed626c70 0x555eed627050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50206/0 (socket says 172.21.15.3:50206) 2024-09-19T06:22:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.288+0000 7f3c48c00640 1 -- 172.21.15.3:0/301930892 learned_addr learned my addr 172.21.15.3:0/301930892 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.288+0000 7f3c40c00640 1 -- 172.21.15.3:0/74747446 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f3c340037a0 con 0x7f3c44074590 2024-09-19T06:22:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.288+0000 7f3c43400640 1 --2- 172.21.15.3:0/301930892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eed631e50 0x555eed634240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.288+0000 7f3c43e00640 1 --2- 172.21.15.3:0/301930892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eed627590 0x555eed631910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.288+0000 7f3c48c00640 1 -- 172.21.15.3:0/301930892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eed627590 msgr2=0x555eed631910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.288+0000 7f3c48c00640 1 --2- 172.21.15.3:0/301930892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eed627590 0x555eed631910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.288+0000 7f3c48c00640 1 -- 172.21.15.3:0/301930892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eed631e50 msgr2=0x555eed634240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.288+0000 7f3c48c00640 1 --2- 172.21.15.3:0/301930892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eed631e50 0x555eed634240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.288+0000 7f3c48c00640 1 -- 172.21.15.3:0/301930892 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eed553ae0 con 0x555eed626c70 2024-09-19T06:22:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.288+0000 7f3c43e00640 1 --2- 172.21.15.3:0/301930892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eed627590 0x555eed631910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:22:35.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.289+0000 7f3c48c00640 1 --2- 172.21.15.3:0/301930892 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed626c70 0x555eed627050 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009f30 tx=0x7f3c3c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d141cb1da7f83629 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:35.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.289+0000 7f3c39200640 1 -- 172.21.15.3:0/301930892 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c004d20 con 0x555eed626c70 2024-09-19T06:22:35.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.289+0000 7f3c39200640 1 -- 172.21.15.3:0/301930892 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c3c004050 con 0x555eed626c70 2024-09-19T06:22:35.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.289+0000 7f3c39200640 1 -- 172.21.15.3:0/301930892 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c005260 con 0x555eed626c70 2024-09-19T06:22:35.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.290+0000 7f3c40c00640 1 --2- 172.21.15.3:0/74747446 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3c280a33b0 0x7f3c280a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:35.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.290+0000 7f3c40c00640 1 -- 172.21.15.3:0/74747446 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f3c340d0060 con 0x7f3c44074590 2024-09-19T06:22:35.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.290+0000 7f3c4d686740 1 -- 172.21.15.3:0/301930892 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed626c70 msgr2=0x555eed627050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:35.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.290+0000 7f3c4d686740 1 --2- 172.21.15.3:0/301930892 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed626c70 0x555eed627050 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009f30 tx=0x7f3c3c0118d0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.290+0000 7f3c43e00640 1 --2- 172.21.15.3:0/74747446 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3c280a33b0 0x7f3c280a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:35.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.290+0000 7f3c4d686740 1 -- 172.21.15.3:0/301930892 shutdown_connections 2024-09-19T06:22:35.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.290+0000 7f3c4d686740 1 --2- 172.21.15.3:0/301930892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eed631e50 0x555eed634240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.290+0000 7f3c4d686740 1 --2- 172.21.15.3:0/301930892 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eed627590 0x555eed631910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.290+0000 7f3c4d686740 1 --2- 172.21.15.3:0/301930892 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed626c70 0x555eed627050 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.290+0000 7f3c4d686740 1 -- 172.21.15.3:0/301930892 >> 172.21.15.3:0/301930892 conn(0x555eed623200 msgr2=0x555eed6235e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.290+0000 7f3c4d686740 1 -- 172.21.15.3:0/301930892 shutdown_connections 2024-09-19T06:22:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.290+0000 7f3c4d686740 1 -- 172.21.15.3:0/301930892 wait complete. 2024-09-19T06:22:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.291+0000 7f3c43e00640 1 --2- 172.21.15.3:0/74747446 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3c280a33b0 0x7f3c280a5870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x555eed624060 tx=0x7f3c3400ef90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.291+0000 7f3c4d686740 1 -- start start 2024-09-19T06:22:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.291+0000 7f3c4d686740 1 Processor -- start 2024-09-19T06:22:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.292+0000 7f3c4d686740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eed626c70 0x555eed62ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.292+0000 7f3c4d686740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eed627590 0x555eed62f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.292+0000 7f3c4d686740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed631e50 0x555eed62f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.292+0000 7f3c4d686740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x555eed634a70 con 0x555eed631e50 2024-09-19T06:22:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.292+0000 7f3c4d686740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555eed5480f0 con 0x555eed627590 2024-09-19T06:22:35.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.292+0000 7f3c4d686740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555eed634bf0 con 0x555eed626c70 2024-09-19T06:22:35.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.292+0000 7f3c4d686740 10 client.0 _ll_register_callbacks cb 0x555eed52fbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:35.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.292+0000 7f3c48c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eed626c70 0x555eed62ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:35.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.292+0000 7f3c43400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eed627590 0x555eed62f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:35.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.292+0000 7f3c43400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eed627590 0x555eed62f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:34590/0 (socket says 172.21.15.3:34590) 2024-09-19T06:22:35.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.292+0000 7f3c43400640 1 -- 172.21.15.3:0/755526131 learned_addr learned my addr 172.21.15.3:0/755526131 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:35.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.292+0000 7f3c48c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eed626c70 0x555eed62ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:33450/0 (socket says 172.21.15.3:33450) 2024-09-19T06:22:35.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.292+0000 7f3c48c00640 1 --2- 172.21.15.3:0/755526131 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed631e50 0x555eed62f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:35.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.292+0000 7f3c43400640 1 -- 172.21.15.3:0/755526131 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eed626c70 msgr2=0x555eed62ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:35.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.292+0000 7f3c43400640 1 --2- 172.21.15.3:0/755526131 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eed626c70 0x555eed62ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.292+0000 7f3c43400640 1 -- 172.21.15.3:0/755526131 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed631e50 msgr2=0x555eed62f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:35.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.292+0000 7f3c43400640 1 --2- 172.21.15.3:0/755526131 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed631e50 0x555eed62f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.292+0000 7f3c43400640 1 -- 172.21.15.3:0/755526131 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555eed2fe3c0 con 0x555eed627590 2024-09-19T06:22:35.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.292+0000 7f3c48c00640 1 --2- 172.21.15.3:0/755526131 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed631e50 0x555eed62f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:35.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.293+0000 7f3c43400640 1 --2- 172.21.15.3:0/755526131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eed627590 0x555eed62f1d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3c3002a9a0 tx=0x7f3c300317e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1af548084ec38943 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:35.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.293+0000 7f3c2d600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:22:35.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.293+0000 7f3c2d600640 1 -- 172.21.15.3:0/755526131 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c30035040 con 0x555eed627590 2024-09-19T06:22:35.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.293+0000 7f3c4d686740 1 -- 172.21.15.3:0/755526131 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c3c004050 con 0x555eed627590 2024-09-19T06:22:35.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.293+0000 7f3c2d600640 1 -- 172.21.15.3:0/755526131 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f3c30004240 con 0x555eed627590 2024-09-19T06:22:35.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.293+0000 7f3c2d600640 1 -- 172.21.15.3:0/755526131 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3c30004440 con 0x555eed627590 2024-09-19T06:22:35.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.293+0000 7f3c4d686740 10 client.28196 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:35.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.293+0000 7f3c4d686740 1 -- 172.21.15.3:0/755526131 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555eed640970 con 0x555eed627590 2024-09-19T06:22:35.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.294+0000 7f3c2d600640 1 -- 172.21.15.3:0/755526131 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c3c004050 con 0x555eed627590 2024-09-19T06:22:35.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.294+0000 7f3c2d600640 1 -- 172.21.15.3:0/755526131 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3c3004d070 con 0x555eed627590 2024-09-19T06:22:35.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.294+0000 7f3c4d686740 10 client.28196 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:35.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.294+0000 7f3c4d686740 10 client.28196 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:22:35.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.294+0000 7f3c4d686740 20 client.28196 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:35.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.294+0000 7f3c4d686740 1 --2- 172.21.15.3:0/755526131 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x555eed641e30 0x555eed644250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:35.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.294+0000 7f3c4d686740 4 client.28196 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:35.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.294+0000 7f3c4d686740 1 -- 172.21.15.3:0/755526131 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555eed59a950 con 0x555eed641e30 2024-09-19T06:22:35.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.294+0000 7f3c48c00640 1 --2- 172.21.15.3:0/755526131 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x555eed641e30 0x555eed644250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:35.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.295+0000 7f3c48c00640 1 --2- 172.21.15.3:0/755526131 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x555eed641e30 0x555eed644250 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=dcdb8f8ab1ef1237 server_cookie=6662daf2ae9f12dd in_seq=0 out_seq=0 2024-09-19T06:22:35.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.295+0000 7f3c2d600640 10 client.28196 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:22:35.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.295+0000 7f3c2d600640 1 -- 172.21.15.3:0/755526131 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555eed59a950 con 0x555eed641e30 2024-09-19T06:22:35.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.295+0000 7f3c2d600640 10 client.28196 handle_command_reply: tid=0 2024-09-19T06:22:35.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.296+0000 7f3c4d686740 1 client.28196 shutdown 2024-09-19T06:22:35.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.296+0000 7f3c4d686740 1 -- 172.21.15.3:0/755526131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eed627590 msgr2=0x555eed62f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:35.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.296+0000 7f3c4d686740 1 --2- 172.21.15.3:0/755526131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eed627590 0x555eed62f1d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3c3002a9a0 tx=0x7f3c300317e0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.296+0000 7f3c4d686740 1 -- 172.21.15.3:0/755526131 shutdown_connections 2024-09-19T06:22:35.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.296+0000 7f3c4d686740 1 --2- 172.21.15.3:0/755526131 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x555eed641e30 0x555eed644250 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.296+0000 7f3c4d686740 1 --2- 172.21.15.3:0/755526131 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed631e50 0x555eed62f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.296+0000 7f3c4d686740 1 --2- 172.21.15.3:0/755526131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eed627590 0x555eed62f1d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.296+0000 7f3c4d686740 1 --2- 172.21.15.3:0/755526131 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eed626c70 0x555eed62ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.296+0000 7f3c2d600640 0 client.28196 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:22:35.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.296+0000 7f3c4d686740 1 -- 172.21.15.3:0/755526131 >> 172.21.15.3:0/755526131 conn(0x555eed623200 msgr2=0x555eed622380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:35.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.296+0000 7f3c4d686740 1 -- 172.21.15.3:0/755526131 shutdown_connections 2024-09-19T06:22:35.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.296+0000 7f3c4d686740 1 -- 172.21.15.3:0/755526131 wait complete. 2024-09-19T06:22:35.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.296+0000 7f3c4d686740 20 client.28196 trim_cache size 0 max 16384 2024-09-19T06:22:35.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.310+0000 7f3c4d686740 1 Processor -- start 2024-09-19T06:22:35.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.310+0000 7f3c4d686740 1 -- start start 2024-09-19T06:22:35.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.310+0000 7f3c4d686740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed626c70 0x555eed630fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:35.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.310+0000 7f3c4d686740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eed627590 0x555eed649b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:35.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.310+0000 7f3c4d686740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eed631e50 0x555eed64a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:35.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.310+0000 7f3c4d686740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3c441b3f70 con 0x555eed626c70 2024-09-19T06:22:35.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.310+0000 7f3c4d686740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3c441b5ab0 con 0x555eed631e50 2024-09-19T06:22:35.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.310+0000 7f3c4d686740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3c441b4640 con 0x555eed627590 2024-09-19T06:22:35.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.310+0000 7f3c48c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed626c70 0x555eed630fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:35.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.311+0000 7f3c48c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed626c70 0x555eed630fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50226/0 (socket says 172.21.15.3:50226) 2024-09-19T06:22:35.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.311+0000 7f3c48c00640 1 -- 172.21.15.3:0/2951084746 learned_addr learned my addr 172.21.15.3:0/2951084746 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:35.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.311+0000 7f3c43400640 1 --2- 172.21.15.3:0/2951084746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eed627590 0x555eed649b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:35.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.311+0000 7f3c48c00640 1 --2- 172.21.15.3:0/2951084746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eed631e50 0x555eed64a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:35.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.311+0000 7f3c48c00640 1 -- 172.21.15.3:0/2951084746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eed627590 msgr2=0x555eed649b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:35.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.311+0000 7f3c48c00640 1 --2- 172.21.15.3:0/2951084746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eed627590 0x555eed649b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.311+0000 7f3c48c00640 1 -- 172.21.15.3:0/2951084746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eed631e50 msgr2=0x555eed64a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:35.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.311+0000 7f3c48c00640 1 --2- 172.21.15.3:0/2951084746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eed631e50 0x555eed64a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.311+0000 7f3c48c00640 1 -- 172.21.15.3:0/2951084746 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eed623030 con 0x555eed626c70 2024-09-19T06:22:35.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.311+0000 7f3c48c00640 1 --2- 172.21.15.3:0/2951084746 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed626c70 0x555eed630fc0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c014040 tx=0x7f3c3c004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1184a3b0f01b37c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:35.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.311+0000 7f3c2fe00640 1 -- 172.21.15.3:0/2951084746 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c004250 con 0x555eed626c70 2024-09-19T06:22:35.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.311+0000 7f3c2fe00640 1 -- 172.21.15.3:0/2951084746 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c3c028450 con 0x555eed626c70 2024-09-19T06:22:35.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.312+0000 7f3c2fe00640 1 -- 172.21.15.3:0/2951084746 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c00f6e0 con 0x555eed626c70 2024-09-19T06:22:35.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.312+0000 7f3c4d686740 1 -- 172.21.15.3:0/2951084746 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed626c70 msgr2=0x555eed630fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:35.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.312+0000 7f3c4d686740 1 --2- 172.21.15.3:0/2951084746 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed626c70 0x555eed630fc0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c014040 tx=0x7f3c3c004b60 comp rx=0 tx=0).stop 2024-09-19T06:22:35.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.312+0000 7f3c4d686740 1 -- 172.21.15.3:0/2951084746 shutdown_connections 2024-09-19T06:22:35.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.312+0000 7f3c4d686740 1 --2- 172.21.15.3:0/2951084746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eed631e50 0x555eed64a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.312+0000 7f3c4d686740 1 --2- 172.21.15.3:0/2951084746 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eed627590 0x555eed649b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.312+0000 7f3c4d686740 1 --2- 172.21.15.3:0/2951084746 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed626c70 0x555eed630fc0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.312+0000 7f3c4d686740 1 -- 172.21.15.3:0/2951084746 >> 172.21.15.3:0/2951084746 conn(0x555eed623200 msgr2=0x555eed62dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:35.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.312+0000 7f3c4d686740 1 -- 172.21.15.3:0/2951084746 shutdown_connections 2024-09-19T06:22:35.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.312+0000 7f3c4d686740 1 -- 172.21.15.3:0/2951084746 wait complete. 2024-09-19T06:22:35.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.313+0000 7f3c4d686740 1 -- start start 2024-09-19T06:22:35.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.313+0000 7f3c4d686740 1 Processor -- start 2024-09-19T06:22:35.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.314+0000 7f3c4d686740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed626c70 0x555eed635da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:35.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.314+0000 7f3c4d686740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eed627590 0x555eed6362e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:35.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.314+0000 7f3c4d686740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eed631e50 0x555eed636820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:35.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.314+0000 7f3c4d686740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3c441b53e0 con 0x555eed626c70 2024-09-19T06:22:35.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.314+0000 7f3c4d686740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3c441b4d10 con 0x555eed627590 2024-09-19T06:22:35.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.314+0000 7f3c4d686740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3c441b1f70 con 0x555eed631e50 2024-09-19T06:22:35.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.314+0000 7f3c4d686740 10 client.0 _ll_register_callbacks cb 0x7f3c30009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:35.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.314+0000 7f3c48c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed626c70 0x555eed635da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:35.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.314+0000 7f3c43400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eed627590 0x555eed6362e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:35.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.314+0000 7f3c48c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed626c70 0x555eed635da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50236/0 (socket says 172.21.15.3:50236) 2024-09-19T06:22:35.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.314+0000 7f3c48c00640 1 -- 172.21.15.3:0/3024320693 learned_addr learned my addr 172.21.15.3:0/3024320693 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:35.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.315+0000 7f3c48c00640 1 --2- 172.21.15.3:0/3024320693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eed631e50 0x555eed636820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:35.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.315+0000 7f3c48c00640 1 -- 172.21.15.3:0/3024320693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eed631e50 msgr2=0x555eed636820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:35.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.315+0000 7f3c48c00640 1 --2- 172.21.15.3:0/3024320693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eed631e50 0x555eed636820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.315+0000 7f3c48c00640 1 -- 172.21.15.3:0/3024320693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eed627590 msgr2=0x555eed6362e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:35.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.315+0000 7f3c48c00640 1 --2- 172.21.15.3:0/3024320693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eed627590 0x555eed6362e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.315+0000 7f3c48c00640 1 -- 172.21.15.3:0/3024320693 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555eed6abcf0 con 0x555eed626c70 2024-09-19T06:22:35.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.315+0000 7f3c43400640 1 --2- 172.21.15.3:0/3024320693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eed627590 0x555eed6362e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:35.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.315+0000 7f3c48c00640 1 --2- 172.21.15.3:0/3024320693 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed626c70 0x555eed635da0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009f30 tx=0x7f3c3c003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49e664c6425d023 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:35.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.315+0000 7f3c2d600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:22:35.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.315+0000 7f3c2d600640 1 -- 172.21.15.3:0/3024320693 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c040020 con 0x555eed626c70 2024-09-19T06:22:35.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.315+0000 7f3c2d600640 1 -- 172.21.15.3:0/3024320693 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f3c3c004050 con 0x555eed626c70 2024-09-19T06:22:35.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.315+0000 7f3c4d686740 1 -- 172.21.15.3:0/3024320693 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c3c028450 con 0x555eed626c70 2024-09-19T06:22:35.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.316+0000 7f3c2d600640 1 -- 172.21.15.3:0/3024320693 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3c3c04b050 con 0x555eed626c70 2024-09-19T06:22:35.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.316+0000 7f3c4d686740 10 client.18171 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:35.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.316+0000 7f3c4d686740 1 -- 172.21.15.3:0/3024320693 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555eed6acfd0 con 0x555eed626c70 2024-09-19T06:22:35.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.316+0000 7f3c2d600640 1 -- 172.21.15.3:0/3024320693 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c3c028450 con 0x555eed626c70 2024-09-19T06:22:35.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.317+0000 7f3c2d600640 1 -- 172.21.15.3:0/3024320693 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3c3c00f750 con 0x555eed626c70 2024-09-19T06:22:35.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.317+0000 7f3c4d686740 10 client.18171 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:35.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.317+0000 7f3c4d686740 10 client.18171 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:22:35.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.317+0000 7f3c4d686740 20 client.18171 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:35.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.317+0000 7f3c4d686740 1 --2- 172.21.15.3:0/3024320693 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x555eed6ad4f0 0x555eed6af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:35.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.317+0000 7f3c4d686740 4 client.18171 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:22:35.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.317+0000 7f3c4d686740 1 -- 172.21.15.3:0/3024320693 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555eed594e60 con 0x555eed6ad4f0 2024-09-19T06:22:35.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.317+0000 7f3c43400640 1 --2- 172.21.15.3:0/3024320693 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x555eed6ad4f0 0x555eed6af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:35.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.318+0000 7f3c43400640 1 --2- 172.21.15.3:0/3024320693 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x555eed6ad4f0 0x555eed6af8e0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e73fd33a818dbdc0 server_cookie=e7684575bfb2f3f7 in_seq=0 out_seq=0 2024-09-19T06:22:35.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.318+0000 7f3c2d600640 10 client.18171 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:22:35.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.318+0000 7f3c2d600640 1 -- 172.21.15.3:0/3024320693 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555eed594e60 con 0x555eed6ad4f0 2024-09-19T06:22:35.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.318+0000 7f3c2d600640 10 client.18171 handle_command_reply: tid=0 2024-09-19T06:22:35.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.318+0000 7f3c4d686740 1 client.18171 shutdown 2024-09-19T06:22:35.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.318+0000 7f3c4d686740 1 -- 172.21.15.3:0/3024320693 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed626c70 msgr2=0x555eed635da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:35.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.318+0000 7f3c4d686740 1 --2- 172.21.15.3:0/3024320693 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed626c70 0x555eed635da0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009f30 tx=0x7f3c3c003eb0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.318+0000 7f3c4d686740 1 -- 172.21.15.3:0/3024320693 shutdown_connections 2024-09-19T06:22:35.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.318+0000 7f3c4d686740 1 --2- 172.21.15.3:0/3024320693 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555eed631e50 0x555eed636820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.318+0000 7f3c4d686740 1 --2- 172.21.15.3:0/3024320693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555eed627590 0x555eed6362e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.318+0000 7f3c4d686740 1 --2- 172.21.15.3:0/3024320693 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x555eed6ad4f0 0x555eed6af8e0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.318+0000 7f3c4d686740 1 --2- 172.21.15.3:0/3024320693 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555eed626c70 0x555eed635da0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.318+0000 7f3c2d600640 0 client.18171 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:22:35.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.318+0000 7f3c4d686740 1 -- 172.21.15.3:0/3024320693 >> 172.21.15.3:0/3024320693 conn(0x555eed623200 msgr2=0x555eed622380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:35.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.319+0000 7f3c4d686740 1 -- 172.21.15.3:0/3024320693 shutdown_connections 2024-09-19T06:22:35.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.319+0000 7f3c4d686740 1 -- 172.21.15.3:0/3024320693 wait complete. 2024-09-19T06:22:35.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.319+0000 7f3c4d686740 20 client.18171 trim_cache size 0 max 16384 2024-09-19T06:22:35.324 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:22:35.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.319+0000 7f3c4ac00640 1 -- 172.21.15.3:0/74747446 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3c280a33b0 msgr2=0x7f3c280a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:35.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.319+0000 7f3c4ac00640 1 --2- 172.21.15.3:0/74747446 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3c280a33b0 0x7f3c280a5870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x555eed624060 tx=0x7f3c3400ef90 comp rx=0 tx=0).stop 2024-09-19T06:22:35.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.319+0000 7f3c4ac00640 1 -- 172.21.15.3:0/74747446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c44074590 msgr2=0x7f3c441a4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:35.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.319+0000 7f3c4ac00640 1 --2- 172.21.15.3:0/74747446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c44074590 0x7f3c441a4710 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400ea60 tx=0x7f3c3400ef20 comp rx=0 tx=0).stop 2024-09-19T06:22:35.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.319+0000 7f3c4ac00640 1 -- 172.21.15.3:0/74747446 shutdown_connections 2024-09-19T06:22:35.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.319+0000 7f3c4ac00640 1 --2- 172.21.15.3:0/74747446 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3c280a33b0 0x7f3c280a5870 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.319+0000 7f3c4ac00640 1 --2- 172.21.15.3:0/74747446 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3c44112b90 0x7f3c4419e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.319+0000 7f3c4ac00640 1 --2- 172.21.15.3:0/74747446 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3c44074eb0 0x7f3c441a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.319+0000 7f3c4ac00640 1 --2- 172.21.15.3:0/74747446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c44074590 0x7f3c441a4710 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:35.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.319+0000 7f3c4ac00640 1 -- 172.21.15.3:0/74747446 >> 172.21.15.3:0/74747446 conn(0x7f3c440fd8c0 msgr2=0x7f3c440ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:35.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.320+0000 7f3c4ac00640 1 -- 172.21.15.3:0/74747446 shutdown_connections 2024-09-19T06:22:35.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:35.320+0000 7f3c4ac00640 1 -- 172.21.15.3:0/74747446 wait complete. 2024-09-19T06:22:36.240 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:22:36.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:36 smithi003 ceph-mon[30893]: pgmap v317: 97 pgs: 97 active+clean; 4.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 68 KiB/s wr, 25 op/s 2024-09-19T06:22:36.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:36 smithi071 ceph-mon[35662]: pgmap v317: 97 pgs: 97 active+clean; 4.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 68 KiB/s wr, 25 op/s 2024-09-19T06:22:36.619 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:36.799 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:36 smithi059 ceph-mon[35138]: pgmap v317: 97 pgs: 97 active+clean; 4.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 68 KiB/s wr, 25 op/s 2024-09-19T06:22:37.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.206+0000 7f0fa2800640 1 -- 172.21.15.3:0/2131936328 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f9c103ff0 msgr2=0x7f0f9c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:37.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.206+0000 7f0fa2800640 1 --2- 172.21.15.3:0/2131936328 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f9c103ff0 0x7f0f9c1043d0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c009900 tx=0x7f0f8c02a410 comp rx=0 tx=0).stop 2024-09-19T06:22:37.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.207+0000 7f0fa2800640 1 -- 172.21.15.3:0/2131936328 shutdown_connections 2024-09-19T06:22:37.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.207+0000 7f0fa2800640 1 --2- 172.21.15.3:0/2131936328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f9c109120 0x7f0f9c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.207+0000 7f0fa2800640 1 --2- 172.21.15.3:0/2131936328 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f9c1049a0 0x7f0f9c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.207+0000 7f0fa2800640 1 --2- 172.21.15.3:0/2131936328 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f9c103ff0 0x7f0f9c1043d0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.207+0000 7f0fa2800640 1 -- 172.21.15.3:0/2131936328 >> 172.21.15.3:0/2131936328 conn(0x7f0f9c0ffa90 msgr2=0x7f0f9c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:37.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.207+0000 7f0fa2800640 1 -- 172.21.15.3:0/2131936328 shutdown_connections 2024-09-19T06:22:37.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.207+0000 7f0fa2800640 1 -- 172.21.15.3:0/2131936328 wait complete. 2024-09-19T06:22:37.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.208+0000 7f0fa2800640 1 Processor -- start 2024-09-19T06:22:37.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.208+0000 7f0fa2800640 1 -- start start 2024-09-19T06:22:37.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.208+0000 7f0fa2800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f9c103ff0 0x7f0f9c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.208+0000 7f0fa2800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f9c1049a0 0x7f0f9c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.208+0000 7f0fa2800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f9c109120 0x7f0f9c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.208+0000 7f0fa2800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c114140 con 0x7f0f9c1049a0 2024-09-19T06:22:37.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.208+0000 7f0fa2800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c113fc0 con 0x7f0f9c103ff0 2024-09-19T06:22:37.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.208+0000 7f0fa2800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c1142c0 con 0x7f0f9c109120 2024-09-19T06:22:37.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.208+0000 7f0f9aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f9c1049a0 0x7f0f9c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.208+0000 7f0f9aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f9c1049a0 0x7f0f9c19ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50258/0 (socket says 172.21.15.3:50258) 2024-09-19T06:22:37.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.208+0000 7f0f9aa00640 1 -- 172.21.15.3:0/1516289887 learned_addr learned my addr 172.21.15.3:0/1516289887 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:37.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.209+0000 7f0f9b400640 1 --2- 172.21.15.3:0/1516289887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f9c103ff0 0x7f0f9c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.209+0000 7f0f9be00640 1 --2- 172.21.15.3:0/1516289887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f9c109120 0x7f0f9c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.209+0000 7f0f9aa00640 1 -- 172.21.15.3:0/1516289887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f9c109120 msgr2=0x7f0f9c19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:37.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.209+0000 7f0f9aa00640 1 --2- 172.21.15.3:0/1516289887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f9c109120 0x7f0f9c19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.209+0000 7f0f9aa00640 1 -- 172.21.15.3:0/1516289887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f9c103ff0 msgr2=0x7f0f9c19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:37.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.209+0000 7f0f9aa00640 1 --2- 172.21.15.3:0/1516289887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f9c103ff0 0x7f0f9c19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.209+0000 7f0f9aa00640 1 -- 172.21.15.3:0/1516289887 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f9c19f5b0 con 0x7f0f9c1049a0 2024-09-19T06:22:37.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.209+0000 7f0f9b400640 1 --2- 172.21.15.3:0/1516289887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f9c103ff0 0x7f0f9c19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:37.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.209+0000 7f0f9aa00640 1 --2- 172.21.15.3:0/1516289887 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f9c1049a0 0x7f0f9c19ab40 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800e9f0 tx=0x7f0f8800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:37.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.210+0000 7f0f93e00640 1 -- 172.21.15.3:0/1516289887 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8800cd80 con 0x7f0f9c1049a0 2024-09-19T06:22:37.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.210+0000 7f0f93e00640 1 -- 172.21.15.3:0/1516289887 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f88005500 con 0x7f0f9c1049a0 2024-09-19T06:22:37.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.210+0000 7f0f93e00640 1 -- 172.21.15.3:0/1516289887 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f88010690 con 0x7f0f9c1049a0 2024-09-19T06:22:37.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.210+0000 7f0fa2800640 1 -- 172.21.15.3:0/1516289887 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f9c19f8a0 con 0x7f0f9c1049a0 2024-09-19T06:22:37.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.210+0000 7f0fa2800640 1 -- 172.21.15.3:0/1516289887 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f9c1a7180 con 0x7f0f9c1049a0 2024-09-19T06:22:37.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.214+0000 7f0fa53e6740 1 Processor -- start 2024-09-19T06:22:37.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.214+0000 7f0fa53e6740 1 -- start start 2024-09-19T06:22:37.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.215+0000 7f0fa53e6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d10cc70 0x55be7d10d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.215+0000 7f0fa53e6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be7d10d590 0x55be7d117910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.215+0000 7f0fa53e6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d117e50 0x55be7d11a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.215+0000 7f0fa53e6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55be7d0733e0 con 0x55be7d117e50 2024-09-19T06:22:37.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.215+0000 7f0fa53e6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55be7d01ad80 con 0x55be7d10cc70 2024-09-19T06:22:37.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.215+0000 7f0fa53e6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55be7d06f3a0 con 0x55be7d10d590 2024-09-19T06:22:37.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.215+0000 7f0f9be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d10cc70 0x55be7d10d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.215+0000 7f0f93e00640 1 -- 172.21.15.3:0/1516289887 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f0f880046c0 con 0x7f0f9c1049a0 2024-09-19T06:22:37.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.215+0000 7f0f9be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d10cc70 0x55be7d10d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:34632/0 (socket says 172.21.15.3:34632) 2024-09-19T06:22:37.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.215+0000 7f0f9be00640 1 -- 172.21.15.3:0/2366483181 learned_addr learned my addr 172.21.15.3:0/2366483181 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:37.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.215+0000 7f0f9b400640 1 --2- 172.21.15.3:0/2366483181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be7d10d590 0x55be7d117910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.215+0000 7f0f9aa00640 1 --2- 172.21.15.3:0/2366483181 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d117e50 0x55be7d11a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.215+0000 7f0f9be00640 1 -- 172.21.15.3:0/2366483181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be7d10d590 msgr2=0x55be7d117910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:37.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.215+0000 7f0f9be00640 1 --2- 172.21.15.3:0/2366483181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be7d10d590 0x55be7d117910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.215+0000 7f0f9be00640 1 -- 172.21.15.3:0/2366483181 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d117e50 msgr2=0x55be7d11a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:37.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.215+0000 7f0f9be00640 1 --2- 172.21.15.3:0/2366483181 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d117e50 0x55be7d11a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.215+0000 7f0f9be00640 1 -- 172.21.15.3:0/2366483181 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be7d039ae0 con 0x55be7d10cc70 2024-09-19T06:22:37.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.216+0000 7f0f9aa00640 1 --2- 172.21.15.3:0/2366483181 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d117e50 0x55be7d11a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:22:37.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.216+0000 7f0f9be00640 1 --2- 172.21.15.3:0/2366483181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d10cc70 0x55be7d10d050 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009f50 tx=0x7f0f940118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3324a09406c2de8a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:37.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.216+0000 7f0f90c00640 1 -- 172.21.15.3:0/2366483181 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f94004d20 con 0x55be7d10cc70 2024-09-19T06:22:37.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.216+0000 7f0f90c00640 1 -- 172.21.15.3:0/2366483181 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f94004050 con 0x55be7d10cc70 2024-09-19T06:22:37.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.216+0000 7f0f90c00640 1 -- 172.21.15.3:0/2366483181 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f94005280 con 0x55be7d10cc70 2024-09-19T06:22:37.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.217+0000 7f0fa53e6740 1 -- 172.21.15.3:0/2366483181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d10cc70 msgr2=0x55be7d10d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:37.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.217+0000 7f0fa53e6740 1 --2- 172.21.15.3:0/2366483181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d10cc70 0x55be7d10d050 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009f50 tx=0x7f0f940118d0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.217+0000 7f0fa53e6740 1 -- 172.21.15.3:0/2366483181 shutdown_connections 2024-09-19T06:22:37.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.217+0000 7f0fa53e6740 1 --2- 172.21.15.3:0/2366483181 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d117e50 0x55be7d11a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.217+0000 7f0fa53e6740 1 --2- 172.21.15.3:0/2366483181 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be7d10d590 0x55be7d117910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.217+0000 7f0fa53e6740 1 --2- 172.21.15.3:0/2366483181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d10cc70 0x55be7d10d050 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.217+0000 7f0fa53e6740 1 -- 172.21.15.3:0/2366483181 >> 172.21.15.3:0/2366483181 conn(0x55be7d109200 msgr2=0x55be7d1095e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:37.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.217+0000 7f0fa53e6740 1 -- 172.21.15.3:0/2366483181 shutdown_connections 2024-09-19T06:22:37.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.217+0000 7f0fa53e6740 1 -- 172.21.15.3:0/2366483181 wait complete. 2024-09-19T06:22:37.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.217+0000 7f0f93e00640 1 --2- 172.21.15.3:0/1516289887 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0f800a3340 0x7f0f800a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.218+0000 7f0f93e00640 1 -- 172.21.15.3:0/1516289887 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f0f880d0130 con 0x7f0f9c1049a0 2024-09-19T06:22:37.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.218+0000 7f0f9b400640 1 --2- 172.21.15.3:0/1516289887 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0f800a3340 0x7f0f800a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.218+0000 7f0fa53e6740 1 -- start start 2024-09-19T06:22:37.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.218+0000 7f0fa53e6740 1 Processor -- start 2024-09-19T06:22:37.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.218+0000 7f0fa53e6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d10cc70 0x55be7d114ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.218+0000 7f0f9b400640 1 --2- 172.21.15.3:0/1516289887 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0f800a3340 0x7f0f800a5800 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c009230 tx=0x7f0f8c0058d0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:37.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.218+0000 7f0fa53e6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be7d10d590 0x55be7d1151e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.218+0000 7f0fa53e6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d117e50 0x55be7d115720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.218+0000 7f0fa53e6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55be7d11aa20 con 0x55be7d10cc70 2024-09-19T06:22:37.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.218+0000 7f0fa53e6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55be7d02e0f0 con 0x55be7d117e50 2024-09-19T06:22:37.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.218+0000 7f0fa53e6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55be7d11aba0 con 0x55be7d10d590 2024-09-19T06:22:37.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.219+0000 7f0fa53e6740 10 client.0 _ll_register_callbacks cb 0x55be7d015bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:37.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.219+0000 7f0f9be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d117e50 0x55be7d115720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.219+0000 7f0f9b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d10cc70 0x55be7d114ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.219+0000 7f0f9be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d117e50 0x55be7d115720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:34642/0 (socket says 172.21.15.3:34642) 2024-09-19T06:22:37.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.219+0000 7f0f9be00640 1 -- 172.21.15.3:0/1572438776 learned_addr learned my addr 172.21.15.3:0/1572438776 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:37.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.219+0000 7f0f9aa00640 1 --2- 172.21.15.3:0/1572438776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be7d10d590 0x55be7d1151e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.219+0000 7f0f9be00640 1 -- 172.21.15.3:0/1572438776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be7d10d590 msgr2=0x55be7d1151e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:37.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.219+0000 7f0f9be00640 1 --2- 172.21.15.3:0/1572438776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be7d10d590 0x55be7d1151e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.219+0000 7f0f9be00640 1 -- 172.21.15.3:0/1572438776 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d10cc70 msgr2=0x55be7d114ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:37.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.219+0000 7f0f9be00640 1 --2- 172.21.15.3:0/1572438776 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d10cc70 0x55be7d114ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.219+0000 7f0f9be00640 1 -- 172.21.15.3:0/1572438776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be7cde43c0 con 0x55be7d117e50 2024-09-19T06:22:37.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.220+0000 7f0f9be00640 1 --2- 172.21.15.3:0/1572438776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d117e50 0x55be7d115720 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009250 tx=0x7f0f94004cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=400d16a83661ccdc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:37.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.220+0000 7f0f85600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:22:37.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.220+0000 7f0f85600640 1 -- 172.21.15.3:0/1572438776 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f94029070 con 0x55be7d117e50 2024-09-19T06:22:37.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.220+0000 7f0fa53e6740 1 -- 172.21.15.3:0/1572438776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f94004050 con 0x55be7d117e50 2024-09-19T06:22:37.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.220+0000 7f0f85600640 1 -- 172.21.15.3:0/1572438776 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f0f9400f480 con 0x55be7d117e50 2024-09-19T06:22:37.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.220+0000 7f0f85600640 1 -- 172.21.15.3:0/1572438776 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0f94035050 con 0x55be7d117e50 2024-09-19T06:22:37.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.220+0000 7f0fa53e6740 10 client.28214 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:37.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.220+0000 7f0fa53e6740 1 -- 172.21.15.3:0/1572438776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55be7d126930 con 0x55be7d117e50 2024-09-19T06:22:37.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.220+0000 7f0f85600640 1 -- 172.21.15.3:0/1572438776 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f94004050 con 0x55be7d117e50 2024-09-19T06:22:37.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.221+0000 7f0f85600640 1 -- 172.21.15.3:0/1572438776 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0f94019720 con 0x55be7d117e50 2024-09-19T06:22:37.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.221+0000 7f0fa53e6740 10 client.28214 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:37.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.221+0000 7f0fa53e6740 10 client.28214 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:22:37.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.221+0000 7f0fa53e6740 20 client.28214 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:37.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.221+0000 7f0fa53e6740 1 --2- 172.21.15.3:0/1572438776 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55be7d127ce0 0x55be7d12a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.221+0000 7f0fa53e6740 4 client.28214 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:37.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.221+0000 7f0fa53e6740 1 -- 172.21.15.3:0/1572438776 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be7d080950 con 0x55be7d127ce0 2024-09-19T06:22:37.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.221+0000 7f0f9b400640 1 --2- 172.21.15.3:0/1572438776 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55be7d127ce0 0x55be7d12a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.222+0000 7f0f9b400640 1 --2- 172.21.15.3:0/1572438776 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55be7d127ce0 0x55be7d12a0d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=48c1847a0ebc0a7e server_cookie=91c2e4fedd870fc5 in_seq=0 out_seq=0 2024-09-19T06:22:37.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.222+0000 7f0f85600640 10 client.28214 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:22:37.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.222+0000 7f0f85600640 1 -- 172.21.15.3:0/1572438776 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55be7d080950 con 0x55be7d127ce0 2024-09-19T06:22:37.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.222+0000 7f0f85600640 10 client.28214 handle_command_reply: tid=0 2024-09-19T06:22:37.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.222+0000 7f0fa53e6740 1 client.28214 shutdown 2024-09-19T06:22:37.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.223+0000 7f0fa53e6740 1 -- 172.21.15.3:0/1572438776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d117e50 msgr2=0x55be7d115720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:37.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.223+0000 7f0fa53e6740 1 --2- 172.21.15.3:0/1572438776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d117e50 0x55be7d115720 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009250 tx=0x7f0f94004cb0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.223+0000 7f0fa53e6740 1 -- 172.21.15.3:0/1572438776 shutdown_connections 2024-09-19T06:22:37.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.223+0000 7f0fa53e6740 1 --2- 172.21.15.3:0/1572438776 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55be7d127ce0 0x55be7d12a0d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.223+0000 7f0fa53e6740 1 --2- 172.21.15.3:0/1572438776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d117e50 0x55be7d115720 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.223+0000 7f0fa53e6740 1 --2- 172.21.15.3:0/1572438776 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be7d10d590 0x55be7d1151e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.223+0000 7f0fa53e6740 1 --2- 172.21.15.3:0/1572438776 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d10cc70 0x55be7d114ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.223+0000 7f0f85600640 0 client.28214 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:22:37.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.223+0000 7f0fa53e6740 1 -- 172.21.15.3:0/1572438776 >> 172.21.15.3:0/1572438776 conn(0x55be7d109200 msgr2=0x55be7d10eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:37.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.223+0000 7f0fa53e6740 1 -- 172.21.15.3:0/1572438776 shutdown_connections 2024-09-19T06:22:37.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.223+0000 7f0fa53e6740 1 -- 172.21.15.3:0/1572438776 wait complete. 2024-09-19T06:22:37.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.223+0000 7f0fa53e6740 20 client.28214 trim_cache size 0 max 16384 2024-09-19T06:22:37.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.237+0000 7f0fa53e6740 1 Processor -- start 2024-09-19T06:22:37.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.237+0000 7f0fa53e6740 1 -- start start 2024-09-19T06:22:37.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.237+0000 7f0fa53e6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be7d10cc70 0x55be7d114490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.237+0000 7f0fa53e6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d10d590 0x55be7d12f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.237+0000 7f0fa53e6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d117e50 0x55be7d12fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.237+0000 7f0fa53e6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c1afab0 con 0x55be7d117e50 2024-09-19T06:22:37.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.237+0000 7f0fa53e6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c1b15f0 con 0x55be7d10d590 2024-09-19T06:22:37.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.237+0000 7f0fa53e6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c1b0180 con 0x55be7d10cc70 2024-09-19T06:22:37.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.237+0000 7f0f9be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d117e50 0x55be7d12fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.237+0000 7f0f9be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d117e50 0x55be7d12fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50282/0 (socket says 172.21.15.3:50282) 2024-09-19T06:22:37.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.237+0000 7f0f9be00640 1 -- 172.21.15.3:0/988342922 learned_addr learned my addr 172.21.15.3:0/988342922 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:37.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.237+0000 7f0f9b400640 1 --2- 172.21.15.3:0/988342922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be7d10cc70 0x55be7d114490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.238+0000 7f0f9aa00640 1 --2- 172.21.15.3:0/988342922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d10d590 0x55be7d12f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.238+0000 7f0f9be00640 1 -- 172.21.15.3:0/988342922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be7d10cc70 msgr2=0x55be7d114490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:37.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.238+0000 7f0f9be00640 1 --2- 172.21.15.3:0/988342922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be7d10cc70 0x55be7d114490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.238+0000 7f0f9be00640 1 -- 172.21.15.3:0/988342922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d10d590 msgr2=0x55be7d12f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:37.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.238+0000 7f0f9be00640 1 --2- 172.21.15.3:0/988342922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d10d590 0x55be7d12f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.238+0000 7f0f9be00640 1 -- 172.21.15.3:0/988342922 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be7d109030 con 0x55be7d117e50 2024-09-19T06:22:37.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.238+0000 7f0f9b400640 1 --2- 172.21.15.3:0/988342922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be7d10cc70 0x55be7d114490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:37.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.238+0000 7f0f9aa00640 1 --2- 172.21.15.3:0/988342922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d10d590 0x55be7d12f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:37.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.238+0000 7f0f9be00640 1 --2- 172.21.15.3:0/988342922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d117e50 0x55be7d12fd50 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f0f94011dd0 tx=0x7f0f94009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d88c3dc05c2918a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:37.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.238+0000 7f0f87e00640 1 -- 172.21.15.3:0/988342922 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f94029040 con 0x55be7d117e50 2024-09-19T06:22:37.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.238+0000 7f0f87e00640 1 -- 172.21.15.3:0/988342922 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f94004720 con 0x55be7d117e50 2024-09-19T06:22:37.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.238+0000 7f0f87e00640 1 -- 172.21.15.3:0/988342922 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f940225c0 con 0x55be7d117e50 2024-09-19T06:22:37.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.239+0000 7f0fa53e6740 1 -- 172.21.15.3:0/988342922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d117e50 msgr2=0x55be7d12fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:37.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.239+0000 7f0fa53e6740 1 --2- 172.21.15.3:0/988342922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d117e50 0x55be7d12fd50 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f0f94011dd0 tx=0x7f0f94009fd0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.239+0000 7f0fa53e6740 1 -- 172.21.15.3:0/988342922 shutdown_connections 2024-09-19T06:22:37.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.239+0000 7f0fa53e6740 1 --2- 172.21.15.3:0/988342922 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d117e50 0x55be7d12fd50 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.239+0000 7f0fa53e6740 1 --2- 172.21.15.3:0/988342922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d10d590 0x55be7d12f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.239+0000 7f0fa53e6740 1 --2- 172.21.15.3:0/988342922 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be7d10cc70 0x55be7d114490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.239+0000 7f0fa53e6740 1 -- 172.21.15.3:0/988342922 >> 172.21.15.3:0/988342922 conn(0x55be7d109200 msgr2=0x55be7d116d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:37.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.239+0000 7f0fa53e6740 1 -- 172.21.15.3:0/988342922 shutdown_connections 2024-09-19T06:22:37.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.239+0000 7f0fa53e6740 1 -- 172.21.15.3:0/988342922 wait complete. 2024-09-19T06:22:37.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.240+0000 7f0fa53e6740 1 -- start start 2024-09-19T06:22:37.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.240+0000 7f0fa53e6740 1 Processor -- start 2024-09-19T06:22:37.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.240+0000 7f0fa53e6740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d10cc70 0x55be7d120510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.241+0000 7f0fa53e6740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be7d10d590 0x55be7d11b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.241+0000 7f0fa53e6740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d117e50 0x55be7d11bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.241+0000 7f0fa53e6740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c1b0f20 con 0x55be7d10cc70 2024-09-19T06:22:37.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.241+0000 7f0fa53e6740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c1b0850 con 0x55be7d117e50 2024-09-19T06:22:37.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.241+0000 7f0fa53e6740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c1adab0 con 0x55be7d10d590 2024-09-19T06:22:37.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.241+0000 7f0fa53e6740 10 client.0 _ll_register_callbacks cb 0x7f0f88005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:37.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.241+0000 7f0f9b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d10cc70 0x55be7d120510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.241+0000 7f0f9b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d10cc70 0x55be7d120510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50284/0 (socket says 172.21.15.3:50284) 2024-09-19T06:22:37.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.241+0000 7f0f9b400640 1 -- 172.21.15.3:0/1086154180 learned_addr learned my addr 172.21.15.3:0/1086154180 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:37.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.241+0000 7f0f9aa00640 1 --2- 172.21.15.3:0/1086154180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be7d10d590 0x55be7d11b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.241+0000 7f0f9be00640 1 --2- 172.21.15.3:0/1086154180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d117e50 0x55be7d11bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.241+0000 7f0f9b400640 1 -- 172.21.15.3:0/1086154180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be7d10d590 msgr2=0x55be7d11b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:37.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.241+0000 7f0f9b400640 1 --2- 172.21.15.3:0/1086154180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be7d10d590 0x55be7d11b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.241+0000 7f0f9b400640 1 -- 172.21.15.3:0/1086154180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d117e50 msgr2=0x55be7d11bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:37.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.241+0000 7f0f9b400640 1 --2- 172.21.15.3:0/1086154180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d117e50 0x55be7d11bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.241+0000 7f0f9b400640 1 -- 172.21.15.3:0/1086154180 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be7d109e90 con 0x55be7d10cc70 2024-09-19T06:22:37.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.242+0000 7f0f9b400640 1 --2- 172.21.15.3:0/1086154180 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d10cc70 0x55be7d120510 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c02a930 tx=0x7f0f8c03f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aa654a951689914 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:37.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.242+0000 7f0f85600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:22:37.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.242+0000 7f0f85600640 1 -- 172.21.15.3:0/1086154180 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c057070 con 0x55be7d10cc70 2024-09-19T06:22:37.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.242+0000 7f0f85600640 1 -- 172.21.15.3:0/1086154180 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f0f8c005220 con 0x55be7d10cc70 2024-09-19T06:22:37.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.242+0000 7f0fa53e6740 1 -- 172.21.15.3:0/1086154180 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f94004720 con 0x55be7d10cc70 2024-09-19T06:22:37.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.242+0000 7f0f85600640 1 -- 172.21.15.3:0/1086154180 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0f8c062050 con 0x55be7d10cc70 2024-09-19T06:22:37.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.242+0000 7f0fa53e6740 10 client.18186 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:37.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.242+0000 7f0fa53e6740 1 -- 172.21.15.3:0/1086154180 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55be7d104770 con 0x55be7d10cc70 2024-09-19T06:22:37.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.243+0000 7f0f85600640 1 -- 172.21.15.3:0/1086154180 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f94004720 con 0x55be7d10cc70 2024-09-19T06:22:37.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.243+0000 7f0f85600640 1 -- 172.21.15.3:0/1086154180 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0f8c004850 con 0x55be7d10cc70 2024-09-19T06:22:37.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.243+0000 7f0fa53e6740 10 client.18186 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:37.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.243+0000 7f0fa53e6740 10 client.18186 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:22:37.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.243+0000 7f0fa53e6740 20 client.18186 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:37.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.243+0000 7f0fa53e6740 1 --2- 172.21.15.3:0/1086154180 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55be7d192b10 0x55be7d194f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:37.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.243+0000 7f0fa53e6740 4 client.18186 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:22:37.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.243+0000 7f0fa53e6740 1 -- 172.21.15.3:0/1086154180 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55be7d07ae60 con 0x55be7d192b10 2024-09-19T06:22:37.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.243+0000 7f0f9aa00640 1 --2- 172.21.15.3:0/1086154180 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55be7d192b10 0x55be7d194f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:37.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.244+0000 7f0f9aa00640 1 --2- 172.21.15.3:0/1086154180 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55be7d192b10 0x55be7d194f30 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ba3f2613a6c00a04 server_cookie=12fea258caaecddd in_seq=0 out_seq=0 2024-09-19T06:22:37.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.244+0000 7f0f85600640 10 client.18186 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:22:37.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.244+0000 7f0f85600640 1 -- 172.21.15.3:0/1086154180 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55be7d07ae60 con 0x55be7d192b10 2024-09-19T06:22:37.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.244+0000 7f0f85600640 10 client.18186 handle_command_reply: tid=0 2024-09-19T06:22:37.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.244+0000 7f0fa53e6740 1 client.18186 shutdown 2024-09-19T06:22:37.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.244+0000 7f0fa53e6740 1 -- 172.21.15.3:0/1086154180 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d10cc70 msgr2=0x55be7d120510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:37.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.244+0000 7f0fa53e6740 1 --2- 172.21.15.3:0/1086154180 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d10cc70 0x55be7d120510 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c02a930 tx=0x7f0f8c03f070 comp rx=0 tx=0).stop 2024-09-19T06:22:37.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.244+0000 7f0fa53e6740 1 -- 172.21.15.3:0/1086154180 shutdown_connections 2024-09-19T06:22:37.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.244+0000 7f0fa53e6740 1 --2- 172.21.15.3:0/1086154180 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x55be7d192b10 0x55be7d194f30 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.244+0000 7f0fa53e6740 1 --2- 172.21.15.3:0/1086154180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be7d117e50 0x55be7d11bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.244+0000 7f0fa53e6740 1 --2- 172.21.15.3:0/1086154180 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55be7d10d590 0x55be7d11b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.244+0000 7f0fa53e6740 1 --2- 172.21.15.3:0/1086154180 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55be7d10cc70 0x55be7d120510 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.244+0000 7f0fa53e6740 1 -- 172.21.15.3:0/1086154180 >> 172.21.15.3:0/1086154180 conn(0x55be7d109200 msgr2=0x55be7d115490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:37.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.244+0000 7f0f85600640 0 client.18186 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:22:37.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.244+0000 7f0fa53e6740 1 -- 172.21.15.3:0/1086154180 shutdown_connections 2024-09-19T06:22:37.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.244+0000 7f0fa53e6740 1 -- 172.21.15.3:0/1086154180 wait complete. 2024-09-19T06:22:37.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.245+0000 7f0fa53e6740 20 client.18186 trim_cache size 0 max 16384 2024-09-19T06:22:37.250 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:22:37.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.245+0000 7f0fa2800640 1 -- 172.21.15.3:0/1516289887 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0f800a3340 msgr2=0x7f0f800a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:37.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.245+0000 7f0fa2800640 1 --2- 172.21.15.3:0/1516289887 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0f800a3340 0x7f0f800a5800 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c009230 tx=0x7f0f8c0058d0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.245+0000 7f0fa2800640 1 -- 172.21.15.3:0/1516289887 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f9c1049a0 msgr2=0x7f0f9c19ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:37.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.245+0000 7f0fa2800640 1 --2- 172.21.15.3:0/1516289887 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f9c1049a0 0x7f0f9c19ab40 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f0f8800e9f0 tx=0x7f0f8800edf0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.245+0000 7f0fa2800640 1 -- 172.21.15.3:0/1516289887 shutdown_connections 2024-09-19T06:22:37.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.245+0000 7f0fa2800640 1 --2- 172.21.15.3:0/1516289887 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0f800a3340 0x7f0f800a5800 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.245+0000 7f0fa2800640 1 --2- 172.21.15.3:0/1516289887 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f9c109120 0x7f0f9c19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.245+0000 7f0fa2800640 1 --2- 172.21.15.3:0/1516289887 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f9c1049a0 0x7f0f9c19ab40 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.245+0000 7f0fa2800640 1 --2- 172.21.15.3:0/1516289887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f9c103ff0 0x7f0f9c19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:37.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.245+0000 7f0fa2800640 1 -- 172.21.15.3:0/1516289887 >> 172.21.15.3:0/1516289887 conn(0x7f0f9c0ffa90 msgr2=0x7f0f9c100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:37.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.246+0000 7f0fa2800640 1 -- 172.21.15.3:0/1516289887 shutdown_connections 2024-09-19T06:22:37.251 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:37.246+0000 7f0fa2800640 1 -- 172.21.15.3:0/1516289887 wait complete. 2024-09-19T06:22:38.203 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:22:38.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:38 smithi003 ceph-mon[30893]: pgmap v318: 97 pgs: 97 active+clean; 4.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 16 op/s 2024-09-19T06:22:38.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:38 smithi071 ceph-mon[35662]: pgmap v318: 97 pgs: 97 active+clean; 4.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 16 op/s 2024-09-19T06:22:38.586 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:38.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:38 smithi059 ceph-mon[35138]: pgmap v318: 97 pgs: 97 active+clean; 4.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 16 op/s 2024-09-19T06:22:39.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.318+0000 7fafbe200640 1 -- 172.21.15.3:0/2506499788 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fafb810e280 msgr2=0x7fafb8110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:39.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.318+0000 7fafbe200640 1 --2- 172.21.15.3:0/2506499788 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fafb810e280 0x7fafb8110670 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fafb0009ca0 tx=0x7fafb002a950 comp rx=0 tx=0).stop 2024-09-19T06:22:39.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.318+0000 7fafbe200640 1 -- 172.21.15.3:0/2506499788 shutdown_connections 2024-09-19T06:22:39.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.318+0000 7fafbe200640 1 --2- 172.21.15.3:0/2506499788 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fafb810e280 0x7fafb8110670 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.318+0000 7fafbe200640 1 --2- 172.21.15.3:0/2506499788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafb8074e30 0x7fafb810dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.318+0000 7fafbe200640 1 --2- 172.21.15.3:0/2506499788 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafb8074510 0x7fafb80748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.318+0000 7fafbe200640 1 -- 172.21.15.3:0/2506499788 >> 172.21.15.3:0/2506499788 conn(0x7fafb80fd740 msgr2=0x7fafb80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:39.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.318+0000 7fafbe200640 1 -- 172.21.15.3:0/2506499788 shutdown_connections 2024-09-19T06:22:39.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.318+0000 7fafbe200640 1 -- 172.21.15.3:0/2506499788 wait complete. 2024-09-19T06:22:39.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.319+0000 7fafbe200640 1 Processor -- start 2024-09-19T06:22:39.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.320+0000 7fafbe200640 1 -- start start 2024-09-19T06:22:39.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.320+0000 7fafbe200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafb8074510 0x7fafb819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.320+0000 7fafbe200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fafb8074e30 0x7fafb819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.320+0000 7fafbe200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafb810e280 0x7fafb819ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.320+0000 7fafbe200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fafb8113fb0 con 0x7fafb8074e30 2024-09-19T06:22:39.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.320+0000 7fafbe200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fafb8113e30 con 0x7fafb810e280 2024-09-19T06:22:39.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.320+0000 7fafbe200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fafb8114130 con 0x7fafb8074510 2024-09-19T06:22:39.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.320+0000 7fafbce00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafb8074510 0x7fafb819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.320+0000 7fafafe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fafb8074e30 0x7fafb819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.320+0000 7fafbce00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafb8074510 0x7fafb819a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:33538/0 (socket says 172.21.15.3:33538) 2024-09-19T06:22:39.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.320+0000 7fafafe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fafb8074e30 0x7fafb819a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50298/0 (socket says 172.21.15.3:50298) 2024-09-19T06:22:39.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.321+0000 7fafbce00640 1 -- 172.21.15.3:0/676560361 learned_addr learned my addr 172.21.15.3:0/676560361 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:39.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.321+0000 7fafbd800640 1 --2- 172.21.15.3:0/676560361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafb810e280 0x7fafb819ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.321+0000 7fafbce00640 1 -- 172.21.15.3:0/676560361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafb810e280 msgr2=0x7fafb819ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:39.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.321+0000 7fafbce00640 1 --2- 172.21.15.3:0/676560361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafb810e280 0x7fafb819ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.321+0000 7fafbce00640 1 -- 172.21.15.3:0/676560361 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fafb8074e30 msgr2=0x7fafb819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:39.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.321+0000 7fafbce00640 1 --2- 172.21.15.3:0/676560361 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fafb8074e30 0x7fafb819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.321+0000 7fafbce00640 1 -- 172.21.15.3:0/676560361 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb819f440 con 0x7fafb8074510 2024-09-19T06:22:39.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.321+0000 7fafafe00640 1 --2- 172.21.15.3:0/676560361 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fafb8074e30 0x7fafb819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:39.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.321+0000 7fafbce00640 1 --2- 172.21.15.3:0/676560361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafb8074510 0x7fafb819a490 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fafa800e9f0 tx=0x7fafa800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:39.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.322+0000 7fafb6000640 1 -- 172.21.15.3:0/676560361 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa800cd80 con 0x7fafb8074510 2024-09-19T06:22:39.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.322+0000 7fafb6000640 1 -- 172.21.15.3:0/676560361 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafa8005500 con 0x7fafb8074510 2024-09-19T06:22:39.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.322+0000 7fafb6000640 1 -- 172.21.15.3:0/676560361 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa8010690 con 0x7fafb8074510 2024-09-19T06:22:39.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.322+0000 7fafbe200640 1 -- 172.21.15.3:0/676560361 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb819f730 con 0x7fafb8074510 2024-09-19T06:22:39.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.322+0000 7fafbe200640 1 -- 172.21.15.3:0/676560361 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb81a7010 con 0x7fafb8074510 2024-09-19T06:22:39.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.325+0000 7fafb6000640 1 -- 172.21.15.3:0/676560361 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fafa80046c0 con 0x7fafb8074510 2024-09-19T06:22:39.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.325+0000 7fafc2428740 1 Processor -- start 2024-09-19T06:22:39.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.325+0000 7fafc2428740 1 -- start start 2024-09-19T06:22:39.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.325+0000 7fafc2428740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acc6e40 0x55d32acc7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.325+0000 7fafc2428740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d32acc7760 0x55d32acd1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.326+0000 7fafc2428740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d32acd2020 0x55d32acd4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.326+0000 7fafc2428740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d32ac2d3e0 con 0x55d32acc6e40 2024-09-19T06:22:39.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.326+0000 7fafc2428740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d32abd4d80 con 0x55d32acc7760 2024-09-19T06:22:39.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.326+0000 7fafc2428740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d32ac293a0 con 0x55d32acd2020 2024-09-19T06:22:39.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.326+0000 7fafbd800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acc6e40 0x55d32acc7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.326+0000 7fafbd800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acc6e40 0x55d32acc7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50310/0 (socket says 172.21.15.3:50310) 2024-09-19T06:22:39.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.326+0000 7fafbd800640 1 -- 172.21.15.3:0/3671845765 learned_addr learned my addr 172.21.15.3:0/3671845765 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:39.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.326+0000 7fafbce00640 1 --2- 172.21.15.3:0/3671845765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d32acc7760 0x55d32acd1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.326+0000 7fafafe00640 1 --2- 172.21.15.3:0/3671845765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d32acd2020 0x55d32acd4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.326+0000 7fafbd800640 1 -- 172.21.15.3:0/3671845765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d32acd2020 msgr2=0x55d32acd4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:39.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.326+0000 7fafbd800640 1 --2- 172.21.15.3:0/3671845765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d32acd2020 0x55d32acd4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.326+0000 7fafbd800640 1 -- 172.21.15.3:0/3671845765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d32acc7760 msgr2=0x55d32acd1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:39.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.326+0000 7fafbd800640 1 --2- 172.21.15.3:0/3671845765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d32acc7760 0x55d32acd1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.326+0000 7fafbd800640 1 -- 172.21.15.3:0/3671845765 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d32abf3ae0 con 0x55d32acc6e40 2024-09-19T06:22:39.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.327+0000 7fafb6000640 1 --2- 172.21.15.3:0/676560361 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7faf9c0a3430 0x7faf9c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.327+0000 7fafbd800640 1 --2- 172.21.15.3:0/3671845765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acc6e40 0x55d32acc7220 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fafb80754f0 tx=0x7fafb00093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17b0b70846f4762 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:39.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.327+0000 7fafb6000640 1 -- 172.21.15.3:0/676560361 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7fafa80d0130 con 0x7fafb8074510 2024-09-19T06:22:39.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.327+0000 7fafbce00640 1 --2- 172.21.15.3:0/676560361 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7faf9c0a3430 0x7faf9c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.327+0000 7fafae000640 1 -- 172.21.15.3:0/3671845765 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0048070 con 0x55d32acc6e40 2024-09-19T06:22:39.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.327+0000 7fafae000640 1 -- 172.21.15.3:0/3671845765 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafb002f940 con 0x55d32acc6e40 2024-09-19T06:22:39.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.327+0000 7fafae000640 1 -- 172.21.15.3:0/3671845765 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0034040 con 0x55d32acc6e40 2024-09-19T06:22:39.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.328+0000 7fafc2428740 1 -- 172.21.15.3:0/3671845765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acc6e40 msgr2=0x55d32acc7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:39.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.328+0000 7fafc2428740 1 --2- 172.21.15.3:0/3671845765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acc6e40 0x55d32acc7220 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fafb80754f0 tx=0x7fafb00093e0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.328+0000 7fafbce00640 1 --2- 172.21.15.3:0/676560361 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7faf9c0a3430 0x7faf9c0a58f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55d32acc4230 tx=0x7fafa80bc040 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:39.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.328+0000 7fafc2428740 1 -- 172.21.15.3:0/3671845765 shutdown_connections 2024-09-19T06:22:39.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.328+0000 7fafc2428740 1 --2- 172.21.15.3:0/3671845765 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d32acd2020 0x55d32acd4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.328+0000 7fafc2428740 1 --2- 172.21.15.3:0/3671845765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d32acc7760 0x55d32acd1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.328+0000 7fafc2428740 1 --2- 172.21.15.3:0/3671845765 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acc6e40 0x55d32acc7220 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.328+0000 7fafc2428740 1 -- 172.21.15.3:0/3671845765 >> 172.21.15.3:0/3671845765 conn(0x55d32acc33d0 msgr2=0x55d32acc37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:39.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.328+0000 7fafc2428740 1 -- 172.21.15.3:0/3671845765 shutdown_connections 2024-09-19T06:22:39.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.328+0000 7fafc2428740 1 -- 172.21.15.3:0/3671845765 wait complete. 2024-09-19T06:22:39.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.329+0000 7fafc2428740 1 -- start start 2024-09-19T06:22:39.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.329+0000 7fafc2428740 1 Processor -- start 2024-09-19T06:22:39.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.329+0000 7fafc2428740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d32acc6e40 0x55d32acceef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.329+0000 7fafc2428740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acc7760 0x55d32accf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.329+0000 7fafc2428740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d32acd2020 0x55d32accf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.329+0000 7fafc2428740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55d32acd4bf0 con 0x55d32acc7760 2024-09-19T06:22:39.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.329+0000 7fafc2428740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55d32abe80f0 con 0x55d32acd2020 2024-09-19T06:22:39.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.329+0000 7fafc2428740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55d32acd4d70 con 0x55d32acc6e40 2024-09-19T06:22:39.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.330+0000 7fafc2428740 10 client.0 _ll_register_callbacks cb 0x55d32abcfbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:39.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.330+0000 7fafafe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acc7760 0x55d32accf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.330+0000 7fafbd800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d32acc6e40 0x55d32acceef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.330+0000 7fafbd800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d32acd2020 0x55d32accf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.330+0000 7fafbd800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d32acc6e40 0x55d32acceef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:33566/0 (socket says 172.21.15.3:33566) 2024-09-19T06:22:39.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.330+0000 7fafbd800640 1 -- 172.21.15.3:0/576493451 learned_addr learned my addr 172.21.15.3:0/576493451 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:39.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.330+0000 7fafafe00640 1 -- 172.21.15.3:0/576493451 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d32acc6e40 msgr2=0x55d32acceef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:39.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.330+0000 7fafafe00640 1 --2- 172.21.15.3:0/576493451 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d32acc6e40 0x55d32acceef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.330+0000 7fafafe00640 1 -- 172.21.15.3:0/576493451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d32acd2020 msgr2=0x55d32accf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:39.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.330+0000 7fafafe00640 1 --2- 172.21.15.3:0/576493451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d32acd2020 0x55d32accf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.330+0000 7fafafe00640 1 -- 172.21.15.3:0/576493451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d32a99e3c0 con 0x55d32acc7760 2024-09-19T06:22:39.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.330+0000 7fafbd800640 1 --2- 172.21.15.3:0/576493451 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d32acc6e40 0x55d32acceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:39.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.331+0000 7fafafe00640 1 --2- 172.21.15.3:0/576493451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acc7760 0x55d32accf430 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fafa0012cf0 tx=0x7fafa000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a7e14fd8d6880e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:39.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.331+0000 7fafa6a00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:22:39.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.331+0000 7fafa6a00640 1 -- 172.21.15.3:0/576493451 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa0012110 con 0x55d32acc7760 2024-09-19T06:22:39.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.331+0000 7fafa6a00640 1 -- 172.21.15.3:0/576493451 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7fafa0004050 con 0x55d32acc7760 2024-09-19T06:22:39.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.331+0000 7fafc2428740 1 -- 172.21.15.3:0/576493451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafb002f940 con 0x55d32acc7760 2024-09-19T06:22:39.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.331+0000 7fafa6a00640 1 -- 172.21.15.3:0/576493451 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fafa00122b0 con 0x55d32acc7760 2024-09-19T06:22:39.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.331+0000 7fafc2428740 10 client.18198 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:39.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.331+0000 7fafc2428740 1 -- 172.21.15.3:0/576493451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d32ace0c70 con 0x55d32acc7760 2024-09-19T06:22:39.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.332+0000 7fafa6a00640 1 -- 172.21.15.3:0/576493451 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafb002f940 con 0x55d32acc7760 2024-09-19T06:22:39.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.332+0000 7fafa6a00640 1 -- 172.21.15.3:0/576493451 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fafa00104c0 con 0x55d32acc7760 2024-09-19T06:22:39.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.332+0000 7fafc2428740 10 client.18198 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:39.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.332+0000 7fafc2428740 10 client.18198 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:22:39.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.332+0000 7fafc2428740 20 client.18198 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:39.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.332+0000 7fafc2428740 1 --2- 172.21.15.3:0/576493451 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55d32ace2180 0x55d32ace45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.332+0000 7fafc2428740 4 client.18198 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:39.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.332+0000 7fafc2428740 1 -- 172.21.15.3:0/576493451 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d32ac3a950 con 0x55d32ace2180 2024-09-19T06:22:39.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.332+0000 7fafbd800640 1 --2- 172.21.15.3:0/576493451 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55d32ace2180 0x55d32ace45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.333+0000 7fafbd800640 1 --2- 172.21.15.3:0/576493451 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55d32ace2180 0x55d32ace45a0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d223bade86f747db server_cookie=dce6289f2154cfaf in_seq=0 out_seq=0 2024-09-19T06:22:39.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.333+0000 7fafa6a00640 10 client.18198 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:22:39.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.334+0000 7fafa6a00640 1 -- 172.21.15.3:0/576493451 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d32ac3a950 con 0x55d32ace2180 2024-09-19T06:22:39.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.334+0000 7fafa6a00640 10 client.18198 handle_command_reply: tid=0 2024-09-19T06:22:39.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.334+0000 7fafc2428740 1 client.18198 shutdown 2024-09-19T06:22:39.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.334+0000 7fafc2428740 1 -- 172.21.15.3:0/576493451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acc7760 msgr2=0x55d32accf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:39.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.334+0000 7fafc2428740 1 --2- 172.21.15.3:0/576493451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acc7760 0x55d32accf430 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fafa0012cf0 tx=0x7fafa000f790 comp rx=0 tx=0).stop 2024-09-19T06:22:39.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.334+0000 7fafc2428740 1 -- 172.21.15.3:0/576493451 shutdown_connections 2024-09-19T06:22:39.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.334+0000 7fafc2428740 1 --2- 172.21.15.3:0/576493451 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55d32ace2180 0x55d32ace45a0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.334+0000 7fafc2428740 1 --2- 172.21.15.3:0/576493451 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d32acd2020 0x55d32accf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.334+0000 7fafc2428740 1 --2- 172.21.15.3:0/576493451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acc7760 0x55d32accf430 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.334+0000 7fafc2428740 1 --2- 172.21.15.3:0/576493451 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d32acc6e40 0x55d32acceef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.334+0000 7fafc2428740 1 -- 172.21.15.3:0/576493451 >> 172.21.15.3:0/576493451 conn(0x55d32acc33d0 msgr2=0x55d32acc9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:39.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.334+0000 7fafa6a00640 0 client.18198 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:22:39.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.334+0000 7fafc2428740 1 -- 172.21.15.3:0/576493451 shutdown_connections 2024-09-19T06:22:39.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.335+0000 7fafc2428740 1 -- 172.21.15.3:0/576493451 wait complete. 2024-09-19T06:22:39.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.335+0000 7fafc2428740 20 client.18198 trim_cache size 0 max 16384 2024-09-19T06:22:39.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.349+0000 7fafc2428740 1 Processor -- start 2024-09-19T06:22:39.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.349+0000 7fafc2428740 1 -- start start 2024-09-19T06:22:39.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.349+0000 7fafc2428740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d32acc6e40 0x55d32accf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.349+0000 7fafc2428740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acc7760 0x55d32ace9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.349+0000 7fafc2428740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d32acd2020 0x55d32acea390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.349+0000 7fafc2428740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fafb81af980 con 0x55d32acc7760 2024-09-19T06:22:39.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.349+0000 7fafc2428740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fafb81b14c0 con 0x55d32acd2020 2024-09-19T06:22:39.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.349+0000 7fafc2428740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fafb81b0050 con 0x55d32acc6e40 2024-09-19T06:22:39.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.350+0000 7fafafe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acc7760 0x55d32ace9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.350+0000 7fafafe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acc7760 0x55d32ace9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50338/0 (socket says 172.21.15.3:50338) 2024-09-19T06:22:39.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.350+0000 7fafafe00640 1 -- 172.21.15.3:0/590495633 learned_addr learned my addr 172.21.15.3:0/590495633 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:39.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.350+0000 7fafbd800640 1 --2- 172.21.15.3:0/590495633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d32acc6e40 0x55d32accf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.350+0000 7fafbd800640 1 --2- 172.21.15.3:0/590495633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d32acd2020 0x55d32acea390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.350+0000 7fafafe00640 1 -- 172.21.15.3:0/590495633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d32acc6e40 msgr2=0x55d32accf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:39.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.350+0000 7fafafe00640 1 --2- 172.21.15.3:0/590495633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d32acc6e40 0x55d32accf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.350+0000 7fafafe00640 1 -- 172.21.15.3:0/590495633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d32acd2020 msgr2=0x55d32acea390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:39.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.350+0000 7fafafe00640 1 --2- 172.21.15.3:0/590495633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d32acd2020 0x55d32acea390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.350+0000 7fafafe00640 1 -- 172.21.15.3:0/590495633 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d32acc2e70 con 0x55d32acc7760 2024-09-19T06:22:39.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.350+0000 7fafafe00640 1 --2- 172.21.15.3:0/590495633 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acc7760 0x55d32ace9e50 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fafa0001eb0 tx=0x7fafa000fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e392d8cbed714e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:39.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.351+0000 7fafad600640 1 -- 172.21.15.3:0/590495633 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa0028070 con 0x55d32acc7760 2024-09-19T06:22:39.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.351+0000 7fafad600640 1 -- 172.21.15.3:0/590495633 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafa00055c0 con 0x55d32acc7760 2024-09-19T06:22:39.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.351+0000 7fafad600640 1 -- 172.21.15.3:0/590495633 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa0003850 con 0x55d32acc7760 2024-09-19T06:22:39.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.351+0000 7fafc2428740 1 -- 172.21.15.3:0/590495633 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acc7760 msgr2=0x55d32ace9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:39.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.351+0000 7fafc2428740 1 --2- 172.21.15.3:0/590495633 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acc7760 0x55d32ace9e50 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fafa0001eb0 tx=0x7fafa000fc90 comp rx=0 tx=0).stop 2024-09-19T06:22:39.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.351+0000 7fafc2428740 1 -- 172.21.15.3:0/590495633 shutdown_connections 2024-09-19T06:22:39.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.351+0000 7fafc2428740 1 --2- 172.21.15.3:0/590495633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d32acd2020 0x55d32acea390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.351+0000 7fafc2428740 1 --2- 172.21.15.3:0/590495633 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acc7760 0x55d32ace9e50 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.351+0000 7fafc2428740 1 --2- 172.21.15.3:0/590495633 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d32acc6e40 0x55d32accf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.351+0000 7fafc2428740 1 -- 172.21.15.3:0/590495633 >> 172.21.15.3:0/590495633 conn(0x55d32acc33d0 msgr2=0x55d32accdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:39.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.351+0000 7fafc2428740 1 -- 172.21.15.3:0/590495633 shutdown_connections 2024-09-19T06:22:39.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.352+0000 7fafc2428740 1 -- 172.21.15.3:0/590495633 wait complete. 2024-09-19T06:22:39.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.352+0000 7fafc2428740 1 -- start start 2024-09-19T06:22:39.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.352+0000 7fafc2428740 1 Processor -- start 2024-09-19T06:22:39.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.353+0000 7fafc2428740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d32acc6e40 0x55d32acda350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.353+0000 7fafc2428740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d32acc7760 0x55d32acda890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.353+0000 7fafc2428740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acd2020 0x55d32acd58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.353+0000 7fafc2428740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fafb81b0df0 con 0x55d32acd2020 2024-09-19T06:22:39.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.353+0000 7fafc2428740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fafb81b0720 con 0x55d32acc6e40 2024-09-19T06:22:39.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.353+0000 7fafc2428740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fafb81ad980 con 0x55d32acc7760 2024-09-19T06:22:39.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.353+0000 7fafc2428740 10 client.0 _ll_register_callbacks cb 0x7fafa0009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:39.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.353+0000 7fafbd800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d32acc6e40 0x55d32acda350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.353+0000 7fafbd800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acd2020 0x55d32acd58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.353+0000 7fafafe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d32acc7760 0x55d32acda890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.353+0000 7fafbd800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acd2020 0x55d32acd58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50348/0 (socket says 172.21.15.3:50348) 2024-09-19T06:22:39.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.353+0000 7fafbd800640 1 -- 172.21.15.3:0/1109206351 learned_addr learned my addr 172.21.15.3:0/1109206351 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:39.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.353+0000 7fafbd800640 1 -- 172.21.15.3:0/1109206351 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d32acc7760 msgr2=0x55d32acda890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:39.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.353+0000 7fafbd800640 1 --2- 172.21.15.3:0/1109206351 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d32acc7760 0x55d32acda890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.353+0000 7fafbd800640 1 -- 172.21.15.3:0/1109206351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d32acc6e40 msgr2=0x55d32acda350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:39.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.353+0000 7fafbd800640 1 --2- 172.21.15.3:0/1109206351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d32acc6e40 0x55d32acda350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.353+0000 7fafbd800640 1 -- 172.21.15.3:0/1109206351 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d32acd6100 con 0x55d32acd2020 2024-09-19T06:22:39.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.353+0000 7fafafe00640 1 --2- 172.21.15.3:0/1109206351 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d32acc7760 0x55d32acda890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:39.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.354+0000 7fafbd800640 1 --2- 172.21.15.3:0/1109206351 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acd2020 0x55d32acd58d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fafb0002230 tx=0x7fafb0003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3786e18812668591 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:39.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.354+0000 7fafa6a00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:22:39.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.354+0000 7fafa6a00640 1 -- 172.21.15.3:0/1109206351 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0048040 con 0x55d32acd2020 2024-09-19T06:22:39.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.354+0000 7fafc2428740 1 -- 172.21.15.3:0/1109206351 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafa00055c0 con 0x55d32acd2020 2024-09-19T06:22:39.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.354+0000 7fafa6a00640 1 -- 172.21.15.3:0/1109206351 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7fafb0003fb0 con 0x55d32acd2020 2024-09-19T06:22:39.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.354+0000 7fafa6a00640 1 -- 172.21.15.3:0/1109206351 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fafb002fc10 con 0x55d32acd2020 2024-09-19T06:22:39.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.354+0000 7fafc2428740 10 client.18204 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:39.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.354+0000 7fafc2428740 1 -- 172.21.15.3:0/1109206351 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d32ad55290 con 0x55d32acd2020 2024-09-19T06:22:39.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.355+0000 7fafa6a00640 1 -- 172.21.15.3:0/1109206351 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fafa00055c0 con 0x55d32acd2020 2024-09-19T06:22:39.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.355+0000 7fafa6a00640 1 -- 172.21.15.3:0/1109206351 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fafb0005140 con 0x55d32acd2020 2024-09-19T06:22:39.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.355+0000 7fafc2428740 10 client.18204 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:39.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.355+0000 7fafc2428740 10 client.18204 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:22:39.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.355+0000 7fafc2428740 20 client.18204 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:39.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.355+0000 7fafc2428740 1 --2- 172.21.15.3:0/1109206351 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55d32ad55570 0x55d32ad57960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:39.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.355+0000 7fafc2428740 4 client.18204 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:22:39.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.355+0000 7fafc2428740 1 -- 172.21.15.3:0/1109206351 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d32ac34e60 con 0x55d32ad55570 2024-09-19T06:22:39.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.355+0000 7fafafe00640 1 --2- 172.21.15.3:0/1109206351 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55d32ad55570 0x55d32ad57960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:39.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.356+0000 7fafafe00640 1 --2- 172.21.15.3:0/1109206351 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55d32ad55570 0x55d32ad57960 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=346a59ee92c3c381 server_cookie=e31acd675cdecfdc in_seq=0 out_seq=0 2024-09-19T06:22:39.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.356+0000 7fafa6a00640 10 client.18204 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:22:39.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.356+0000 7fafa6a00640 1 -- 172.21.15.3:0/1109206351 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d32ac34e60 con 0x55d32ad55570 2024-09-19T06:22:39.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.356+0000 7fafa6a00640 10 client.18204 handle_command_reply: tid=0 2024-09-19T06:22:39.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.356+0000 7fafc2428740 1 client.18204 shutdown 2024-09-19T06:22:39.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.356+0000 7fafc2428740 1 -- 172.21.15.3:0/1109206351 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acd2020 msgr2=0x55d32acd58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:39.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.356+0000 7fafc2428740 1 --2- 172.21.15.3:0/1109206351 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acd2020 0x55d32acd58d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fafb0002230 tx=0x7fafb0003cd0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.356+0000 7fafc2428740 1 -- 172.21.15.3:0/1109206351 shutdown_connections 2024-09-19T06:22:39.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.356+0000 7fafc2428740 1 --2- 172.21.15.3:0/1109206351 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55d32ad55570 0x55d32ad57960 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.356+0000 7fafc2428740 1 --2- 172.21.15.3:0/1109206351 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55d32acd2020 0x55d32acd58d0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.356+0000 7fafc2428740 1 --2- 172.21.15.3:0/1109206351 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55d32acc7760 0x55d32acda890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.356+0000 7fafc2428740 1 --2- 172.21.15.3:0/1109206351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d32acc6e40 0x55d32acda350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.356+0000 7fafc2428740 1 -- 172.21.15.3:0/1109206351 >> 172.21.15.3:0/1109206351 conn(0x55d32acc33d0 msgr2=0x55d32acd0750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:39.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.356+0000 7fafa6a00640 0 client.18204 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:22:39.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.357+0000 7fafc2428740 1 -- 172.21.15.3:0/1109206351 shutdown_connections 2024-09-19T06:22:39.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.357+0000 7fafc2428740 1 -- 172.21.15.3:0/1109206351 wait complete. 2024-09-19T06:22:39.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.357+0000 7fafc2428740 20 client.18204 trim_cache size 0 max 16384 2024-09-19T06:22:39.362 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:22:39.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.357+0000 7fafbe200640 1 -- 172.21.15.3:0/676560361 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7faf9c0a3430 msgr2=0x7faf9c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:39.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.357+0000 7fafbe200640 1 --2- 172.21.15.3:0/676560361 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7faf9c0a3430 0x7faf9c0a58f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55d32acc4230 tx=0x7fafa80bc040 comp rx=0 tx=0).stop 2024-09-19T06:22:39.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.357+0000 7fafbe200640 1 -- 172.21.15.3:0/676560361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafb8074510 msgr2=0x7fafb819a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:39.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.357+0000 7fafbe200640 1 --2- 172.21.15.3:0/676560361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafb8074510 0x7fafb819a490 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fafa800e9f0 tx=0x7fafa800edf0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.357+0000 7fafbe200640 1 -- 172.21.15.3:0/676560361 shutdown_connections 2024-09-19T06:22:39.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.357+0000 7fafbe200640 1 --2- 172.21.15.3:0/676560361 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7faf9c0a3430 0x7faf9c0a58f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.357+0000 7fafbe200640 1 --2- 172.21.15.3:0/676560361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafb810e280 0x7fafb819ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.357+0000 7fafbe200640 1 --2- 172.21.15.3:0/676560361 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fafb8074e30 0x7fafb819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.357+0000 7fafbe200640 1 --2- 172.21.15.3:0/676560361 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fafb8074510 0x7fafb819a490 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:39.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.357+0000 7fafbe200640 1 -- 172.21.15.3:0/676560361 >> 172.21.15.3:0/676560361 conn(0x7fafb80fd740 msgr2=0x7fafb80fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:39.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.358+0000 7fafbe200640 1 -- 172.21.15.3:0/676560361 shutdown_connections 2024-09-19T06:22:39.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:39.358+0000 7fafbe200640 1 -- 172.21.15.3:0/676560361 wait complete. 2024-09-19T06:22:40.295 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:22:40.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:40 smithi003 ceph-mon[30893]: pgmap v319: 97 pgs: 97 active+clean; 4.3 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-19T06:22:40.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:40 smithi071 ceph-mon[35662]: pgmap v319: 97 pgs: 97 active+clean; 4.3 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-19T06:22:40.675 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:40.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:40 smithi059 ceph-mon[35138]: pgmap v319: 97 pgs: 97 active+clean; 4.3 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-19T06:22:41.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.301+0000 7f95ed800640 1 -- 172.21.15.3:0/2442249132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95e8103e30 msgr2=0x7f95e8104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:41.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.301+0000 7f95ed800640 1 --2- 172.21.15.3:0/2442249132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95e8103e30 0x7f95e8104210 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009900 tx=0x7f95d802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.301+0000 7f95ed800640 1 -- 172.21.15.3:0/2442249132 shutdown_connections 2024-09-19T06:22:41.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.301+0000 7f95ed800640 1 --2- 172.21.15.3:0/2442249132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e8108f60 0x7f95e8110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.301+0000 7f95ed800640 1 --2- 172.21.15.3:0/2442249132 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95e81047e0 0x7f95e8108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.301+0000 7f95ed800640 1 --2- 172.21.15.3:0/2442249132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95e8103e30 0x7f95e8104210 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.301+0000 7f95ed800640 1 -- 172.21.15.3:0/2442249132 >> 172.21.15.3:0/2442249132 conn(0x7f95e80ff910 msgr2=0x7f95e8101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:41.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.302+0000 7f95ed800640 1 -- 172.21.15.3:0/2442249132 shutdown_connections 2024-09-19T06:22:41.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.302+0000 7f95ed800640 1 -- 172.21.15.3:0/2442249132 wait complete. 2024-09-19T06:22:41.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.302+0000 7f95ed800640 1 Processor -- start 2024-09-19T06:22:41.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.303+0000 7f95ed800640 1 -- start start 2024-09-19T06:22:41.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.303+0000 7f95ed800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e8103e30 0x7f95e819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.303+0000 7f95ed800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95e81047e0 0x7f95e819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.303+0000 7f95ed800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95e8108f60 0x7f95e819ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.303+0000 7f95ed800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f95e8113f80 con 0x7f95e81047e0 2024-09-19T06:22:41.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.303+0000 7f95ed800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f95e8113e00 con 0x7f95e8103e30 2024-09-19T06:22:41.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.303+0000 7f95ed800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f95e8114100 con 0x7f95e8108f60 2024-09-19T06:22:41.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.303+0000 7f95e7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95e81047e0 0x7f95e819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.303+0000 7f95e7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95e81047e0 0x7f95e819a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50368/0 (socket says 172.21.15.3:50368) 2024-09-19T06:22:41.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.303+0000 7f95e7400640 1 -- 172.21.15.3:0/2144443387 learned_addr learned my addr 172.21.15.3:0/2144443387 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:41.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.303+0000 7f95e7e00640 1 --2- 172.21.15.3:0/2144443387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e8103e30 0x7f95e819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.303+0000 7f95ece00640 1 --2- 172.21.15.3:0/2144443387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95e8108f60 0x7f95e819ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.304+0000 7f95e7400640 1 -- 172.21.15.3:0/2144443387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95e8108f60 msgr2=0x7f95e819ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:41.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.304+0000 7f95e7400640 1 --2- 172.21.15.3:0/2144443387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95e8108f60 0x7f95e819ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.304+0000 7f95e7400640 1 -- 172.21.15.3:0/2144443387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e8103e30 msgr2=0x7f95e819a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:41.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.304+0000 7f95e7400640 1 --2- 172.21.15.3:0/2144443387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e8103e30 0x7f95e819a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.304+0000 7f95e7400640 1 -- 172.21.15.3:0/2144443387 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e819f440 con 0x7f95e81047e0 2024-09-19T06:22:41.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.304+0000 7f95e7400640 1 --2- 172.21.15.3:0/2144443387 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95e81047e0 0x7f95e819a9d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f95d400e9f0 tx=0x7f95d400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:41.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.304+0000 7f95e4c00640 1 -- 172.21.15.3:0/2144443387 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d400cd80 con 0x7f95e81047e0 2024-09-19T06:22:41.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.304+0000 7f95e4c00640 1 -- 172.21.15.3:0/2144443387 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95d4010910 con 0x7f95e81047e0 2024-09-19T06:22:41.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.304+0000 7f95e4c00640 1 -- 172.21.15.3:0/2144443387 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d4018990 con 0x7f95e81047e0 2024-09-19T06:22:41.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.304+0000 7f95ed800640 1 -- 172.21.15.3:0/2144443387 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e819f730 con 0x7f95e81047e0 2024-09-19T06:22:41.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.305+0000 7f95ed800640 1 -- 172.21.15.3:0/2144443387 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e81a7010 con 0x7f95e81047e0 2024-09-19T06:22:41.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.308+0000 7f95f19cc740 1 Processor -- start 2024-09-19T06:22:41.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.308+0000 7f95e4c00640 1 -- 172.21.15.3:0/2144443387 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f95d4010ac0 con 0x7f95e81047e0 2024-09-19T06:22:41.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.308+0000 7f95f19cc740 1 -- start start 2024-09-19T06:22:41.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.308+0000 7f95f19cc740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a6fe40 0x564404a70220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.308+0000 7f95f19cc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564404a70760 0x564404a7aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.308+0000 7f95f19cc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564404a7b020 0x564404a7d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.308+0000 7f95f19cc740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5644049d63e0 con 0x564404a6fe40 2024-09-19T06:22:41.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.308+0000 7f95f19cc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56440497dd80 con 0x564404a70760 2024-09-19T06:22:41.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.308+0000 7f95f19cc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5644049d23a0 con 0x564404a7b020 2024-09-19T06:22:41.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.309+0000 7f95e7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564404a70760 0x564404a7aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.309+0000 7f95ece00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a6fe40 0x564404a70220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.309+0000 7f95e7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564404a70760 0x564404a7aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:34734/0 (socket says 172.21.15.3:34734) 2024-09-19T06:22:41.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.309+0000 7f95e7e00640 1 -- 172.21.15.3:0/3771528764 learned_addr learned my addr 172.21.15.3:0/3771528764 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:41.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.309+0000 7f95e7400640 1 --2- 172.21.15.3:0/3771528764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564404a7b020 0x564404a7d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.309+0000 7f95e7e00640 1 -- 172.21.15.3:0/3771528764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564404a7b020 msgr2=0x564404a7d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:41.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.309+0000 7f95e7e00640 1 --2- 172.21.15.3:0/3771528764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564404a7b020 0x564404a7d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.309+0000 7f95e7e00640 1 -- 172.21.15.3:0/3771528764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a6fe40 msgr2=0x564404a70220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:41.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.309+0000 7f95e7e00640 1 --2- 172.21.15.3:0/3771528764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a6fe40 0x564404a70220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.309+0000 7f95e7e00640 1 -- 172.21.15.3:0/3771528764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56440499cae0 con 0x564404a70760 2024-09-19T06:22:41.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.309+0000 7f95ece00640 1 --2- 172.21.15.3:0/3771528764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a6fe40 0x564404a70220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:41.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.310+0000 7f95e4c00640 1 --2- 172.21.15.3:0/2144443387 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f95cc0a3430 0x7f95cc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.310+0000 7f95e7e00640 1 --2- 172.21.15.3:0/3771528764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564404a70760 0x564404a7aae0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009900 tx=0x7f95d8005be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe1f691987e08652 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:41.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.310+0000 7f95e4c00640 1 -- 172.21.15.3:0/2144443387 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f95d40cffe0 con 0x7f95e81047e0 2024-09-19T06:22:41.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.310+0000 7f95ece00640 1 --2- 172.21.15.3:0/2144443387 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f95cc0a3430 0x7f95cc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.310+0000 7f95dd600640 1 -- 172.21.15.3:0/3771528764 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d8040070 con 0x564404a70760 2024-09-19T06:22:41.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.310+0000 7f95dd600640 1 -- 172.21.15.3:0/3771528764 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95d8031870 con 0x564404a70760 2024-09-19T06:22:41.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.310+0000 7f95dd600640 1 -- 172.21.15.3:0/3771528764 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d8035040 con 0x564404a70760 2024-09-19T06:22:41.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.311+0000 7f95f19cc740 1 -- 172.21.15.3:0/3771528764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564404a70760 msgr2=0x564404a7aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:41.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.311+0000 7f95ece00640 1 --2- 172.21.15.3:0/2144443387 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f95cc0a3430 0x7f95cc0a58f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f95e0009fd0 tx=0x7f95e0009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:41.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.311+0000 7f95f19cc740 1 --2- 172.21.15.3:0/3771528764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564404a70760 0x564404a7aae0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009900 tx=0x7f95d8005be0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.311+0000 7f95f19cc740 1 -- 172.21.15.3:0/3771528764 shutdown_connections 2024-09-19T06:22:41.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.311+0000 7f95f19cc740 1 --2- 172.21.15.3:0/3771528764 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564404a7b020 0x564404a7d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.311+0000 7f95f19cc740 1 --2- 172.21.15.3:0/3771528764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564404a70760 0x564404a7aae0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.311+0000 7f95f19cc740 1 --2- 172.21.15.3:0/3771528764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a6fe40 0x564404a70220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.311+0000 7f95f19cc740 1 -- 172.21.15.3:0/3771528764 >> 172.21.15.3:0/3771528764 conn(0x564404a6c3d0 msgr2=0x564404a6c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:41.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.311+0000 7f95f19cc740 1 -- 172.21.15.3:0/3771528764 shutdown_connections 2024-09-19T06:22:41.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.311+0000 7f95f19cc740 1 -- 172.21.15.3:0/3771528764 wait complete. 2024-09-19T06:22:41.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.312+0000 7f95f19cc740 1 -- start start 2024-09-19T06:22:41.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.312+0000 7f95f19cc740 1 Processor -- start 2024-09-19T06:22:41.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.312+0000 7f95f19cc740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a6fe40 0x564404a77e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.312+0000 7f95f19cc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564404a70760 0x564404a78370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.312+0000 7f95f19cc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564404a7b020 0x564404a788b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.312+0000 7f95f19cc740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x564404a7dbf0 con 0x564404a6fe40 2024-09-19T06:22:41.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.312+0000 7f95f19cc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5644049910f0 con 0x564404a7b020 2024-09-19T06:22:41.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.312+0000 7f95f19cc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x564404a7dd70 con 0x564404a70760 2024-09-19T06:22:41.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.313+0000 7f95f19cc740 10 client.0 _ll_register_callbacks cb 0x564404978bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:41.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.313+0000 7f95e7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a6fe40 0x564404a77e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.313+0000 7f95e7e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a6fe40 0x564404a77e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50384/0 (socket says 172.21.15.3:50384) 2024-09-19T06:22:41.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.313+0000 7f95e7e00640 1 -- 172.21.15.3:0/4010713793 learned_addr learned my addr 172.21.15.3:0/4010713793 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:41.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.313+0000 7f95ece00640 1 --2- 172.21.15.3:0/4010713793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564404a7b020 0x564404a788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.313+0000 7f95e7400640 1 --2- 172.21.15.3:0/4010713793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564404a70760 0x564404a78370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.313+0000 7f95e7e00640 1 -- 172.21.15.3:0/4010713793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564404a70760 msgr2=0x564404a78370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:41.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.313+0000 7f95e7e00640 1 --2- 172.21.15.3:0/4010713793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564404a70760 0x564404a78370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.313+0000 7f95e7e00640 1 -- 172.21.15.3:0/4010713793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564404a7b020 msgr2=0x564404a788b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:41.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.313+0000 7f95e7e00640 1 --2- 172.21.15.3:0/4010713793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564404a7b020 0x564404a788b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.313+0000 7f95e7e00640 1 -- 172.21.15.3:0/4010713793 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644047473c0 con 0x564404a6fe40 2024-09-19T06:22:41.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.314+0000 7f95e7e00640 1 --2- 172.21.15.3:0/4010713793 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a6fe40 0x564404a77e30 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f95d8000c00 tx=0x7f95d8005400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28706e6db902a0ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:41.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.314+0000 7f95d2000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:22:41.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.314+0000 7f95d2000640 1 -- 172.21.15.3:0/4010713793 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d804c020 con 0x564404a6fe40 2024-09-19T06:22:41.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.314+0000 7f95d2000640 1 -- 172.21.15.3:0/4010713793 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f95d8004260 con 0x564404a6fe40 2024-09-19T06:22:41.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.314+0000 7f95f19cc740 1 -- 172.21.15.3:0/4010713793 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95d8031870 con 0x564404a6fe40 2024-09-19T06:22:41.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.314+0000 7f95d2000640 1 -- 172.21.15.3:0/4010713793 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f95d8057050 con 0x564404a6fe40 2024-09-19T06:22:41.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.314+0000 7f95f19cc740 10 client.18216 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:41.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.314+0000 7f95f19cc740 1 -- 172.21.15.3:0/4010713793 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564404a89b50 con 0x564404a6fe40 2024-09-19T06:22:41.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.315+0000 7f95d2000640 1 -- 172.21.15.3:0/4010713793 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95d8031870 con 0x564404a6fe40 2024-09-19T06:22:41.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.315+0000 7f95d2000640 1 -- 172.21.15.3:0/4010713793 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f95d8003680 con 0x564404a6fe40 2024-09-19T06:22:41.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.315+0000 7f95f19cc740 10 client.18216 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:41.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.315+0000 7f95f19cc740 10 client.18216 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:41.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.315+0000 7f95f19cc740 20 client.18216 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:41.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.315+0000 7f95f19cc740 1 --2- 172.21.15.3:0/4010713793 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564404a8aea0 0x564404a8d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.315+0000 7f95f19cc740 4 client.18216 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:41.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.315+0000 7f95f19cc740 1 -- 172.21.15.3:0/4010713793 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644049e3950 con 0x564404a8aea0 2024-09-19T06:22:41.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.315+0000 7f95e7400640 1 --2- 172.21.15.3:0/4010713793 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564404a8aea0 0x564404a8d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.316+0000 7f95e7400640 1 --2- 172.21.15.3:0/4010713793 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564404a8aea0 0x564404a8d290 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72c732a21c7f46ce server_cookie=a3200edf0ee31dfa in_seq=0 out_seq=0 2024-09-19T06:22:41.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.316+0000 7f95d2000640 10 client.18216 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:41.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.317+0000 7f95d2000640 1 -- 172.21.15.3:0/4010713793 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5644049e3950 con 0x564404a8aea0 2024-09-19T06:22:41.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.317+0000 7f95d2000640 10 client.18216 handle_command_reply: tid=0 2024-09-19T06:22:41.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.317+0000 7f95f19cc740 1 client.18216 shutdown 2024-09-19T06:22:41.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.317+0000 7f95f19cc740 1 -- 172.21.15.3:0/4010713793 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a6fe40 msgr2=0x564404a77e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:41.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.317+0000 7f95f19cc740 1 --2- 172.21.15.3:0/4010713793 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a6fe40 0x564404a77e30 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f95d8000c00 tx=0x7f95d8005400 comp rx=0 tx=0).stop 2024-09-19T06:22:41.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.317+0000 7f95f19cc740 1 -- 172.21.15.3:0/4010713793 shutdown_connections 2024-09-19T06:22:41.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.317+0000 7f95f19cc740 1 --2- 172.21.15.3:0/4010713793 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564404a8aea0 0x564404a8d290 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.317+0000 7f95f19cc740 1 --2- 172.21.15.3:0/4010713793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564404a7b020 0x564404a788b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.317+0000 7f95f19cc740 1 --2- 172.21.15.3:0/4010713793 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564404a70760 0x564404a78370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.317+0000 7f95f19cc740 1 --2- 172.21.15.3:0/4010713793 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a6fe40 0x564404a77e30 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.317+0000 7f95d2000640 0 client.18216 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:41.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.317+0000 7f95f19cc740 1 -- 172.21.15.3:0/4010713793 >> 172.21.15.3:0/4010713793 conn(0x564404a6c3d0 msgr2=0x564404a72100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:41.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.317+0000 7f95f19cc740 1 -- 172.21.15.3:0/4010713793 shutdown_connections 2024-09-19T06:22:41.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.317+0000 7f95f19cc740 1 -- 172.21.15.3:0/4010713793 wait complete. 2024-09-19T06:22:41.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.317+0000 7f95f19cc740 20 client.18216 trim_cache size 0 max 16384 2024-09-19T06:22:41.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.331+0000 7f95f19cc740 1 Processor -- start 2024-09-19T06:22:41.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.331+0000 7f95f19cc740 1 -- start start 2024-09-19T06:22:41.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.332+0000 7f95f19cc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564404a6fe40 0x564404a928c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.332+0000 7f95f19cc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564404a70760 0x564404a92e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.332+0000 7f95f19cc740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a7b020 0x564404a77df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.332+0000 7f95f19cc740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f95e81af980 con 0x564404a7b020 2024-09-19T06:22:41.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.332+0000 7f95f19cc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f95e81b14c0 con 0x564404a70760 2024-09-19T06:22:41.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.332+0000 7f95f19cc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f95e81b0050 con 0x564404a6fe40 2024-09-19T06:22:41.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.332+0000 7f95ece00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a7b020 0x564404a77df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.332+0000 7f95ece00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a7b020 0x564404a77df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50396/0 (socket says 172.21.15.3:50396) 2024-09-19T06:22:41.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.332+0000 7f95e7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564404a70760 0x564404a92e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.332+0000 7f95ece00640 1 -- 172.21.15.3:0/3883764217 learned_addr learned my addr 172.21.15.3:0/3883764217 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:41.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.332+0000 7f95e7e00640 1 --2- 172.21.15.3:0/3883764217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564404a6fe40 0x564404a928c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.332+0000 7f95ece00640 1 -- 172.21.15.3:0/3883764217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564404a6fe40 msgr2=0x564404a928c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:41.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.332+0000 7f95ece00640 1 --2- 172.21.15.3:0/3883764217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564404a6fe40 0x564404a928c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.332+0000 7f95ece00640 1 -- 172.21.15.3:0/3883764217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564404a70760 msgr2=0x564404a92e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:41.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.332+0000 7f95ece00640 1 --2- 172.21.15.3:0/3883764217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564404a70760 0x564404a92e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.332+0000 7f95ece00640 1 -- 172.21.15.3:0/3883764217 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564404a6c200 con 0x564404a7b020 2024-09-19T06:22:41.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.333+0000 7f95ece00640 1 --2- 172.21.15.3:0/3883764217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a7b020 0x564404a77df0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f95e00114e0 tx=0x7f95e0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e683e65423dcee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:41.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.333+0000 7f95dcc00640 1 -- 172.21.15.3:0/3883764217 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e0003970 con 0x564404a7b020 2024-09-19T06:22:41.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.333+0000 7f95dcc00640 1 -- 172.21.15.3:0/3883764217 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95e0004020 con 0x564404a7b020 2024-09-19T06:22:41.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.333+0000 7f95dcc00640 1 -- 172.21.15.3:0/3883764217 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e0010ab0 con 0x564404a7b020 2024-09-19T06:22:41.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.334+0000 7f95f19cc740 1 -- 172.21.15.3:0/3883764217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a7b020 msgr2=0x564404a77df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:41.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.334+0000 7f95f19cc740 1 --2- 172.21.15.3:0/3883764217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a7b020 0x564404a77df0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f95e00114e0 tx=0x7f95e0019000 comp rx=0 tx=0).stop 2024-09-19T06:22:41.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.334+0000 7f95f19cc740 1 -- 172.21.15.3:0/3883764217 shutdown_connections 2024-09-19T06:22:41.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.334+0000 7f95f19cc740 1 --2- 172.21.15.3:0/3883764217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a7b020 0x564404a77df0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.334+0000 7f95f19cc740 1 --2- 172.21.15.3:0/3883764217 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564404a70760 0x564404a92e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.334+0000 7f95f19cc740 1 --2- 172.21.15.3:0/3883764217 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564404a6fe40 0x564404a928c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.334+0000 7f95f19cc740 1 -- 172.21.15.3:0/3883764217 >> 172.21.15.3:0/3883764217 conn(0x564404a6c3d0 msgr2=0x564404a79eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:41.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.334+0000 7f95f19cc740 1 -- 172.21.15.3:0/3883764217 shutdown_connections 2024-09-19T06:22:41.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.334+0000 7f95f19cc740 1 -- 172.21.15.3:0/3883764217 wait complete. 2024-09-19T06:22:41.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.334+0000 7f95f19cc740 1 -- start start 2024-09-19T06:22:41.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.334+0000 7f95f19cc740 1 Processor -- start 2024-09-19T06:22:41.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.335+0000 7f95f19cc740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564404a6fe40 0x564404a83790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.335+0000 7f95f19cc740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a70760 0x564404a7eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.335+0000 7f95f19cc740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564404a7b020 0x564404a7f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.335+0000 7f95f19cc740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f95e81b0df0 con 0x564404a70760 2024-09-19T06:22:41.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.335+0000 7f95f19cc740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f95e81b0720 con 0x564404a7b020 2024-09-19T06:22:41.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.335+0000 7f95f19cc740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f95e81ad980 con 0x564404a6fe40 2024-09-19T06:22:41.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.335+0000 7f95f19cc740 10 client.0 _ll_register_callbacks cb 0x7f95e0009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:41.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.335+0000 7f95e7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564404a6fe40 0x564404a83790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.335+0000 7f95e7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a70760 0x564404a7eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.335+0000 7f95e7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564404a6fe40 0x564404a83790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:33644/0 (socket says 172.21.15.3:33644) 2024-09-19T06:22:41.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.335+0000 7f95e7e00640 1 -- 172.21.15.3:0/2420322956 learned_addr learned my addr 172.21.15.3:0/2420322956 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:41.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.335+0000 7f95ece00640 1 --2- 172.21.15.3:0/2420322956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564404a7b020 0x564404a7f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.336+0000 7f95e7e00640 1 -- 172.21.15.3:0/2420322956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564404a7b020 msgr2=0x564404a7f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:41.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.336+0000 7f95e7e00640 1 --2- 172.21.15.3:0/2420322956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564404a7b020 0x564404a7f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.336+0000 7f95e7e00640 1 -- 172.21.15.3:0/2420322956 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a70760 msgr2=0x564404a7eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:41.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.336+0000 7f95e7e00640 1 --2- 172.21.15.3:0/2420322956 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a70760 0x564404a7eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.336+0000 7f95e7e00640 1 -- 172.21.15.3:0/2420322956 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564404a7f8a0 con 0x564404a6fe40 2024-09-19T06:22:41.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.336+0000 7f95e7400640 1 --2- 172.21.15.3:0/2420322956 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a70760 0x564404a7eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:41.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.336+0000 7f95e7e00640 1 --2- 172.21.15.3:0/2420322956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564404a6fe40 0x564404a83790 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009900 tx=0x7f95d8005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45ff2c6bcf7f27f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:41.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.336+0000 7f95d2000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:22:41.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.336+0000 7f95d2000640 1 -- 172.21.15.3:0/2420322956 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d804c040 con 0x564404a6fe40 2024-09-19T06:22:41.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.336+0000 7f95f19cc740 1 -- 172.21.15.3:0/2420322956 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95e0004020 con 0x564404a6fe40 2024-09-19T06:22:41.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.336+0000 7f95d2000640 1 -- 172.21.15.3:0/2420322956 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f95d80035f0 con 0x564404a6fe40 2024-09-19T06:22:41.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.337+0000 7f95d2000640 1 -- 172.21.15.3:0/2420322956 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f95d8069050 con 0x564404a6fe40 2024-09-19T06:22:41.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.337+0000 7f95f19cc740 10 client.28234 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:41.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.337+0000 7f95f19cc740 1 -- 172.21.15.3:0/2420322956 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564404af5920 con 0x564404a6fe40 2024-09-19T06:22:41.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.337+0000 7f95d2000640 1 -- 172.21.15.3:0/2420322956 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95e0004020 con 0x564404a6fe40 2024-09-19T06:22:41.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.337+0000 7f95d2000640 1 -- 172.21.15.3:0/2420322956 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f95d8004260 con 0x564404a6fe40 2024-09-19T06:22:41.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.337+0000 7f95f19cc740 10 client.28234 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:41.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.337+0000 7f95f19cc740 10 client.28234 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:41.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.337+0000 7f95f19cc740 20 client.28234 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:41.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.337+0000 7f95f19cc740 1 --2- 172.21.15.3:0/2420322956 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564404af5f70 0x564404af8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:41.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.337+0000 7f95f19cc740 4 client.28234 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:22:41.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.337+0000 7f95f19cc740 1 -- 172.21.15.3:0/2420322956 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5644049dde60 con 0x564404af5f70 2024-09-19T06:22:41.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.338+0000 7f95e7400640 1 --2- 172.21.15.3:0/2420322956 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564404af5f70 0x564404af8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:41.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.338+0000 7f95e7400640 1 --2- 172.21.15.3:0/2420322956 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564404af5f70 0x564404af8360 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f8bdb1e6f8eb6cc server_cookie=fb441b247b9a6dc in_seq=0 out_seq=0 2024-09-19T06:22:41.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.338+0000 7f95d2000640 10 client.28234 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:41.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.338+0000 7f95d2000640 1 -- 172.21.15.3:0/2420322956 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5644049dde60 con 0x564404af5f70 2024-09-19T06:22:41.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.338+0000 7f95d2000640 10 client.28234 handle_command_reply: tid=0 2024-09-19T06:22:41.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.338+0000 7f95f19cc740 1 client.28234 shutdown 2024-09-19T06:22:41.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.338+0000 7f95f19cc740 1 -- 172.21.15.3:0/2420322956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564404a6fe40 msgr2=0x564404a83790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:41.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.338+0000 7f95f19cc740 1 --2- 172.21.15.3:0/2420322956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564404a6fe40 0x564404a83790 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009900 tx=0x7f95d8005dc0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.338+0000 7f95f19cc740 1 -- 172.21.15.3:0/2420322956 shutdown_connections 2024-09-19T06:22:41.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.338+0000 7f95f19cc740 1 --2- 172.21.15.3:0/2420322956 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x564404af5f70 0x564404af8360 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.338+0000 7f95f19cc740 1 --2- 172.21.15.3:0/2420322956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564404a7b020 0x564404a7f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.338+0000 7f95f19cc740 1 --2- 172.21.15.3:0/2420322956 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x564404a70760 0x564404a7eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.338+0000 7f95f19cc740 1 --2- 172.21.15.3:0/2420322956 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x564404a6fe40 0x564404a83790 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.339+0000 7f95f19cc740 1 -- 172.21.15.3:0/2420322956 >> 172.21.15.3:0/2420322956 conn(0x564404a6c3d0 msgr2=0x564404a71890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:41.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.339+0000 7f95d2000640 0 client.28234 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:41.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.339+0000 7f95f19cc740 1 -- 172.21.15.3:0/2420322956 shutdown_connections 2024-09-19T06:22:41.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.339+0000 7f95f19cc740 1 -- 172.21.15.3:0/2420322956 wait complete. 2024-09-19T06:22:41.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.339+0000 7f95f19cc740 20 client.28234 trim_cache size 0 max 16384 2024-09-19T06:22:41.345 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:22:41.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.339+0000 7f95ed800640 1 -- 172.21.15.3:0/2144443387 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f95cc0a3430 msgr2=0x7f95cc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:41.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.339+0000 7f95ed800640 1 --2- 172.21.15.3:0/2144443387 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f95cc0a3430 0x7f95cc0a58f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f95e0009fd0 tx=0x7f95e0009500 comp rx=0 tx=0).stop 2024-09-19T06:22:41.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.339+0000 7f95ed800640 1 -- 172.21.15.3:0/2144443387 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95e81047e0 msgr2=0x7f95e819a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:41.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.339+0000 7f95ed800640 1 --2- 172.21.15.3:0/2144443387 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95e81047e0 0x7f95e819a9d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f95d400e9f0 tx=0x7f95d400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.340+0000 7f95ed800640 1 -- 172.21.15.3:0/2144443387 shutdown_connections 2024-09-19T06:22:41.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.340+0000 7f95ed800640 1 --2- 172.21.15.3:0/2144443387 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f95cc0a3430 0x7f95cc0a58f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.340+0000 7f95ed800640 1 --2- 172.21.15.3:0/2144443387 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f95e8108f60 0x7f95e819ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.340+0000 7f95ed800640 1 --2- 172.21.15.3:0/2144443387 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f95e81047e0 0x7f95e819a9d0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.340+0000 7f95ed800640 1 --2- 172.21.15.3:0/2144443387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95e8103e30 0x7f95e819a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:41.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.340+0000 7f95ed800640 1 -- 172.21.15.3:0/2144443387 >> 172.21.15.3:0/2144443387 conn(0x7f95e80ff910 msgr2=0x7f95e8100ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:41.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.340+0000 7f95ed800640 1 -- 172.21.15.3:0/2144443387 shutdown_connections 2024-09-19T06:22:41.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:41.340+0000 7f95ed800640 1 -- 172.21.15.3:0/2144443387 wait complete. 2024-09-19T06:22:42.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:42 smithi003 ceph-mon[30893]: pgmap v320: 97 pgs: 97 active+clean; 4.3 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 15 op/s 2024-09-19T06:22:42.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:42 smithi071 ceph-mon[35662]: pgmap v320: 97 pgs: 97 active+clean; 4.3 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 15 op/s 2024-09-19T06:22:42.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:42 smithi059 ceph-mon[35138]: pgmap v320: 97 pgs: 97 active+clean; 4.3 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 15 op/s 2024-09-19T06:22:43.256 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:22:43.257 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:22:43.650 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:44.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.255+0000 7f9f02400640 1 -- 172.21.15.3:0/3888874362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9efc112a30 msgr2=0x7f9efc114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:44.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.255+0000 7f9f02400640 1 --2- 172.21.15.3:0/3888874362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9efc112a30 0x7f9efc114e20 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4009ca0 tx=0x7f9ef402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.256+0000 7f9f02400640 1 -- 172.21.15.3:0/3888874362 shutdown_connections 2024-09-19T06:22:44.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.256+0000 7f9f02400640 1 --2- 172.21.15.3:0/3888874362 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9efc112a30 0x7f9efc114e20 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.256+0000 7f9f02400640 1 --2- 172.21.15.3:0/3888874362 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9efc077040 0x7f9efc1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.256+0000 7f9f02400640 1 --2- 172.21.15.3:0/3888874362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9efc076720 0x7f9efc076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.256+0000 7f9f02400640 1 -- 172.21.15.3:0/3888874362 >> 172.21.15.3:0/3888874362 conn(0x7f9efc0ffa90 msgr2=0x7f9efc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:44.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.256+0000 7f9f02400640 1 -- 172.21.15.3:0/3888874362 shutdown_connections 2024-09-19T06:22:44.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.256+0000 7f9f02400640 1 -- 172.21.15.3:0/3888874362 wait complete. 2024-09-19T06:22:44.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.257+0000 7f9f02400640 1 Processor -- start 2024-09-19T06:22:44.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.257+0000 7f9f02400640 1 -- start start 2024-09-19T06:22:44.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.257+0000 7f9f02400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9efc076720 0x7f9efc1a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.257+0000 7f9f02400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9efc077040 0x7f9efc1a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.257+0000 7f9f02400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9efc112a30 0x7f9efc19e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.257+0000 7f9f02400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc118590 con 0x7f9efc112a30 2024-09-19T06:22:44.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.257+0000 7f9f02400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc118410 con 0x7f9efc076720 2024-09-19T06:22:44.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.257+0000 7f9f02400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc118710 con 0x7f9efc077040 2024-09-19T06:22:44.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.257+0000 7f9efbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9efc112a30 0x7f9efc19e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.257+0000 7f9efbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9efc112a30 0x7f9efc19e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59038/0 (socket says 172.21.15.3:59038) 2024-09-19T06:22:44.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.257+0000 7f9efaa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9efc077040 0x7f9efc1a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.257+0000 7f9efbe00640 1 -- 172.21.15.3:0/2165089404 learned_addr learned my addr 172.21.15.3:0/2165089404 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:44.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.257+0000 7f9efb400640 1 --2- 172.21.15.3:0/2165089404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9efc076720 0x7f9efc1a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.258+0000 7f9efbe00640 1 -- 172.21.15.3:0/2165089404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9efc077040 msgr2=0x7f9efc1a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:44.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.258+0000 7f9efbe00640 1 --2- 172.21.15.3:0/2165089404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9efc077040 0x7f9efc1a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.258+0000 7f9efbe00640 1 -- 172.21.15.3:0/2165089404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9efc076720 msgr2=0x7f9efc1a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:44.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.258+0000 7f9efbe00640 1 --2- 172.21.15.3:0/2165089404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9efc076720 0x7f9efc1a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.258+0000 7f9efbe00640 1 -- 172.21.15.3:0/2165089404 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9efc19f000 con 0x7f9efc112a30 2024-09-19T06:22:44.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.258+0000 7f9efb400640 1 --2- 172.21.15.3:0/2165089404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9efc076720 0x7f9efc1a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:44.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.258+0000 7f9efbe00640 1 --2- 172.21.15.3:0/2165089404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9efc112a30 0x7f9efc19e8d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f9ef402ade0 tx=0x7f9ef40319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:44.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.258+0000 7f9ef3e00640 1 -- 172.21.15.3:0/2165089404 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4003b70 con 0x7f9efc112a30 2024-09-19T06:22:44.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.258+0000 7f9f02400640 1 -- 172.21.15.3:0/2165089404 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9efc19f290 con 0x7f9efc112a30 2024-09-19T06:22:44.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.258+0000 7f9ef3e00640 1 -- 172.21.15.3:0/2165089404 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ef4003d10 con 0x7f9efc112a30 2024-09-19T06:22:44.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.258+0000 7f9ef3e00640 1 -- 172.21.15.3:0/2165089404 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef402fc40 con 0x7f9efc112a30 2024-09-19T06:22:44.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.259+0000 7f9f02400640 1 -- 172.21.15.3:0/2165089404 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9efc1ab5e0 con 0x7f9efc112a30 2024-09-19T06:22:44.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.261+0000 7f9ef3e00640 1 -- 172.21.15.3:0/2165089404 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f9ef4004050 con 0x7f9efc112a30 2024-09-19T06:22:44.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.261+0000 7f9f04de8740 1 Processor -- start 2024-09-19T06:22:44.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.262+0000 7f9f04de8740 1 -- start start 2024-09-19T06:22:44.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.262+0000 7f9f04de8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559295eb2ac0 0x559295eb2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.262+0000 7f9f04de8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559295eb33e0 0x559295ebd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.262+0000 7f9f04de8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559295ebdca0 0x559295ec0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.262+0000 7f9f04de8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x559295e19290 con 0x559295ebdca0 2024-09-19T06:22:44.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.262+0000 7f9f04de8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559295dc0b40 con 0x559295eb2ac0 2024-09-19T06:22:44.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.262+0000 7f9f04de8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559295e15250 con 0x559295eb33e0 2024-09-19T06:22:44.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.262+0000 7f9efb400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559295eb33e0 0x559295ebd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.262+0000 7f9efb400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559295eb33e0 0x559295ebd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:58828/0 (socket says 172.21.15.3:58828) 2024-09-19T06:22:44.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.262+0000 7f9efb400640 1 -- 172.21.15.3:0/3545592261 learned_addr learned my addr 172.21.15.3:0/3545592261 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.262+0000 7f9efaa00640 1 --2- 172.21.15.3:0/3545592261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559295eb2ac0 0x559295eb2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.263+0000 7f9efaa00640 1 --2- 172.21.15.3:0/3545592261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559295ebdca0 0x559295ec0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.263+0000 7f9efb400640 1 -- 172.21.15.3:0/3545592261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559295eb2ac0 msgr2=0x559295eb2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.263+0000 7f9efb400640 1 --2- 172.21.15.3:0/3545592261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559295eb2ac0 0x559295eb2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.263+0000 7f9efb400640 1 -- 172.21.15.3:0/3545592261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559295ebdca0 msgr2=0x559295ec0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.263+0000 7f9efb400640 1 --2- 172.21.15.3:0/3545592261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559295ebdca0 0x559295ec0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.263+0000 7f9efb400640 1 -- 172.21.15.3:0/3545592261 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559295b8a6a0 con 0x559295eb33e0 2024-09-19T06:22:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.263+0000 7f9efaa00640 1 --2- 172.21.15.3:0/3545592261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559295ebdca0 0x559295ec0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:22:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.263+0000 7f9efb400640 1 --2- 172.21.15.3:0/3545592261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559295eb33e0 0x559295ebd760 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0114f0 tx=0x7f9eec0119b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=491cc5cf5b8b6c6d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.263+0000 7f9ef0c00640 1 -- 172.21.15.3:0/3545592261 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec005020 con 0x559295eb33e0 2024-09-19T06:22:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.263+0000 7f9ef0c00640 1 -- 172.21.15.3:0/3545592261 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9eec0047a0 con 0x559295eb33e0 2024-09-19T06:22:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.263+0000 7f9ef3e00640 1 --2- 172.21.15.3:0/2165089404 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9ee00a3430 0x7f9ee00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.263+0000 7f9ef0c00640 1 -- 172.21.15.3:0/3545592261 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec00f9c0 con 0x559295eb33e0 2024-09-19T06:22:44.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.264+0000 7f9ef3e00640 1 -- 172.21.15.3:0/2165089404 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f9ef40f0dd0 con 0x7f9efc112a30 2024-09-19T06:22:44.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.264+0000 7f9efaa00640 1 --2- 172.21.15.3:0/2165089404 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9ee00a3430 0x7f9ee00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.264+0000 7f9f04de8740 1 -- 172.21.15.3:0/3545592261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559295eb33e0 msgr2=0x559295ebd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:44.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.264+0000 7f9f04de8740 1 --2- 172.21.15.3:0/3545592261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559295eb33e0 0x559295ebd760 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0114f0 tx=0x7f9eec0119b0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.264+0000 7f9f04de8740 1 -- 172.21.15.3:0/3545592261 shutdown_connections 2024-09-19T06:22:44.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.264+0000 7f9f04de8740 1 --2- 172.21.15.3:0/3545592261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559295ebdca0 0x559295ec0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.264+0000 7f9f04de8740 1 --2- 172.21.15.3:0/3545592261 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559295eb33e0 0x559295ebd760 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.264+0000 7f9f04de8740 1 --2- 172.21.15.3:0/3545592261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559295eb2ac0 0x559295eb2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.264+0000 7f9f04de8740 1 -- 172.21.15.3:0/3545592261 >> 172.21.15.3:0/3545592261 conn(0x559295eaf050 msgr2=0x559295eaf430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:44.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.264+0000 7f9f04de8740 1 -- 172.21.15.3:0/3545592261 shutdown_connections 2024-09-19T06:22:44.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.265+0000 7f9f04de8740 1 -- 172.21.15.3:0/3545592261 wait complete. 2024-09-19T06:22:44.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.265+0000 7f9efaa00640 1 --2- 172.21.15.3:0/2165089404 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9ee00a3430 0x7f9ee00a58f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x559295eb03d0 tx=0x7f9ee8005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:44.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.265+0000 7f9f04de8740 1 -- start start 2024-09-19T06:22:44.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.265+0000 7f9f04de8740 1 Processor -- start 2024-09-19T06:22:44.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.266+0000 7f9f04de8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559295eb2ac0 0x559295ebd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.266+0000 7f9f04de8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559295eb33e0 0x559295eba7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.266+0000 7f9f04de8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559295ebdca0 0x559295ebad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.266+0000 7f9f04de8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x559295ec0910 con 0x559295eb33e0 2024-09-19T06:22:44.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.266+0000 7f9f04de8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x559295dd3fa0 con 0x559295eb2ac0 2024-09-19T06:22:44.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.266+0000 7f9f04de8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x559295ec0a90 con 0x559295ebdca0 2024-09-19T06:22:44.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.266+0000 7f9f04de8740 10 client.0 _ll_register_callbacks cb 0x559295b27ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:44.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.266+0000 7f9efb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559295eb2ac0 0x559295ebd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.266+0000 7f9efb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559295eb2ac0 0x559295ebd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:50198/0 (socket says 172.21.15.3:50198) 2024-09-19T06:22:44.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.266+0000 7f9efb400640 1 -- 172.21.15.3:0/3174636628 learned_addr learned my addr 172.21.15.3:0/3174636628 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:44.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.266+0000 7f9efbe00640 1 --2- 172.21.15.3:0/3174636628 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559295ebdca0 0x559295ebad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.266+0000 7f9efaa00640 1 --2- 172.21.15.3:0/3174636628 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559295eb33e0 0x559295eba7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.266+0000 7f9efb400640 1 -- 172.21.15.3:0/3174636628 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559295ebdca0 msgr2=0x559295ebad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:44.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.266+0000 7f9efb400640 1 --2- 172.21.15.3:0/3174636628 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559295ebdca0 0x559295ebad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.266+0000 7f9efb400640 1 -- 172.21.15.3:0/3174636628 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559295eb33e0 msgr2=0x559295eba7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:44.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.266+0000 7f9efb400640 1 --2- 172.21.15.3:0/3174636628 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559295eb33e0 0x559295eba7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.266+0000 7f9efb400640 1 -- 172.21.15.3:0/3174636628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559295ebb530 con 0x559295eb2ac0 2024-09-19T06:22:44.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.267+0000 7f9efb400640 1 --2- 172.21.15.3:0/3174636628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559295eb2ac0 0x559295ebd540 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0093b0 tx=0x7f9eec0045f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e917c66e8b6da8ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:44.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.267+0000 7f9ee5600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:22:44.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.267+0000 7f9ee5600640 1 -- 172.21.15.3:0/3174636628 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec028020 con 0x559295eb2ac0 2024-09-19T06:22:44.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.267+0000 7f9f04de8740 1 -- 172.21.15.3:0/3174636628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9eec0047a0 con 0x559295eb2ac0 2024-09-19T06:22:44.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.267+0000 7f9ee5600640 1 -- 172.21.15.3:0/3174636628 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f9eec016040 con 0x559295eb2ac0 2024-09-19T06:22:44.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.267+0000 7f9ee5600640 1 -- 172.21.15.3:0/3174636628 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9eec033050 con 0x559295eb2ac0 2024-09-19T06:22:44.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.267+0000 7f9f04de8740 10 client.28268 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:44.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.267+0000 7f9f04de8740 1 -- 172.21.15.3:0/3174636628 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559295ecc700 con 0x559295eb2ac0 2024-09-19T06:22:44.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.268+0000 7f9ee5600640 1 -- 172.21.15.3:0/3174636628 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9eec0047a0 con 0x559295eb2ac0 2024-09-19T06:22:44.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.268+0000 7f9ee5600640 1 -- 172.21.15.3:0/3174636628 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9eec00fb50 con 0x559295eb2ac0 2024-09-19T06:22:44.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.268+0000 7f9f04de8740 10 client.28268 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:44.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.268+0000 7f9f04de8740 10 client.28268 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:44.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.268+0000 7f9f04de8740 20 client.28268 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:44.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.268+0000 7f9f04de8740 1 --2- 172.21.15.3:0/3174636628 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x559295ecdb10 0x559295ecff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.268+0000 7f9f04de8740 4 client.28268 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:44.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.268+0000 7f9f04de8740 1 -- 172.21.15.3:0/3174636628 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559295e26800 con 0x559295ecdb10 2024-09-19T06:22:44.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.268+0000 7f9efaa00640 1 --2- 172.21.15.3:0/3174636628 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x559295ecdb10 0x559295ecff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.269+0000 7f9efaa00640 1 --2- 172.21.15.3:0/3174636628 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x559295ecdb10 0x559295ecff00 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a14bbbb6e0f558e4 server_cookie=7c212e4e5c4b55c3 in_seq=0 out_seq=0 2024-09-19T06:22:44.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.269+0000 7f9ee5600640 10 client.28268 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:44.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.269+0000 7f9ee5600640 1 -- 172.21.15.3:0/3174636628 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559295e26800 con 0x559295ecdb10 2024-09-19T06:22:44.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.269+0000 7f9ee5600640 10 client.28268 handle_command_reply: tid=0 2024-09-19T06:22:44.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.270+0000 7f9f04de8740 1 client.28268 shutdown 2024-09-19T06:22:44.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.270+0000 7f9f04de8740 1 -- 172.21.15.3:0/3174636628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559295eb2ac0 msgr2=0x559295ebd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:44.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.270+0000 7f9f04de8740 1 --2- 172.21.15.3:0/3174636628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559295eb2ac0 0x559295ebd540 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0093b0 tx=0x7f9eec0045f0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.270+0000 7f9f04de8740 1 -- 172.21.15.3:0/3174636628 shutdown_connections 2024-09-19T06:22:44.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.270+0000 7f9f04de8740 1 --2- 172.21.15.3:0/3174636628 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x559295ecdb10 0x559295ecff00 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.270+0000 7f9f04de8740 1 --2- 172.21.15.3:0/3174636628 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559295ebdca0 0x559295ebad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.270+0000 7f9f04de8740 1 --2- 172.21.15.3:0/3174636628 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559295eb33e0 0x559295eba7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.270+0000 7f9f04de8740 1 --2- 172.21.15.3:0/3174636628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559295eb2ac0 0x559295ebd540 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.270+0000 7f9f04de8740 1 -- 172.21.15.3:0/3174636628 >> 172.21.15.3:0/3174636628 conn(0x559295eaf050 msgr2=0x559295eb4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:44.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.270+0000 7f9ee5600640 0 client.28268 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:44.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.270+0000 7f9f04de8740 1 -- 172.21.15.3:0/3174636628 shutdown_connections 2024-09-19T06:22:44.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.270+0000 7f9f04de8740 1 -- 172.21.15.3:0/3174636628 wait complete. 2024-09-19T06:22:44.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.270+0000 7f9f04de8740 20 client.28268 trim_cache size 0 max 16384 2024-09-19T06:22:44.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.289+0000 7f9f04de8740 1 Processor -- start 2024-09-19T06:22:44.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.289+0000 7f9f04de8740 1 -- start start 2024-09-19T06:22:44.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.289+0000 7f9f04de8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559295eb2ac0 0x559295eb96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.289+0000 7f9f04de8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559295eb33e0 0x559295ed5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.289+0000 7f9f04de8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559295ebdca0 0x559295ed5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.289+0000 7f9f04de8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc1b3ff0 con 0x559295eb2ac0 2024-09-19T06:22:44.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.289+0000 7f9f04de8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc1b5b30 con 0x559295eb33e0 2024-09-19T06:22:44.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.289+0000 7f9f04de8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc1b46c0 con 0x559295ebdca0 2024-09-19T06:22:44.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.290+0000 7f9efb400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559295eb2ac0 0x559295eb96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.290+0000 7f9efaa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559295eb33e0 0x559295ed5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.290+0000 7f9efb400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559295eb2ac0 0x559295eb96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59070/0 (socket says 172.21.15.3:59070) 2024-09-19T06:22:44.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.290+0000 7f9efb400640 1 -- 172.21.15.3:0/4000454069 learned_addr learned my addr 172.21.15.3:0/4000454069 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:44.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.290+0000 7f9efbe00640 1 --2- 172.21.15.3:0/4000454069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559295ebdca0 0x559295ed5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.290+0000 7f9efaa00640 1 -- 172.21.15.3:0/4000454069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559295ebdca0 msgr2=0x559295ed5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:44.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.290+0000 7f9efaa00640 1 --2- 172.21.15.3:0/4000454069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559295ebdca0 0x559295ed5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.290+0000 7f9efaa00640 1 -- 172.21.15.3:0/4000454069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559295eb2ac0 msgr2=0x559295eb96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:44.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.290+0000 7f9efaa00640 1 --2- 172.21.15.3:0/4000454069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559295eb2ac0 0x559295eb96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.290+0000 7f9efaa00640 1 -- 172.21.15.3:0/4000454069 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559295eaee80 con 0x559295eb33e0 2024-09-19T06:22:44.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.290+0000 7f9efb400640 1 --2- 172.21.15.3:0/4000454069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559295eb2ac0 0x559295eb96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:44.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.291+0000 7f9efaa00640 1 --2- 172.21.15.3:0/4000454069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559295eb33e0 0x559295ed5760 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x559295ebbe30 tx=0x7f9ee8013050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0b7aefd93a7103c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:44.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.291+0000 7f9ee7e00640 1 -- 172.21.15.3:0/4000454069 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8005220 con 0x559295eb33e0 2024-09-19T06:22:44.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.291+0000 7f9ee7e00640 1 -- 172.21.15.3:0/4000454069 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ee801de50 con 0x559295eb33e0 2024-09-19T06:22:44.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.291+0000 7f9ee7e00640 1 -- 172.21.15.3:0/4000454069 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee802a8b0 con 0x559295eb33e0 2024-09-19T06:22:44.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.292+0000 7f9f04de8740 1 -- 172.21.15.3:0/4000454069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559295eb33e0 msgr2=0x559295ed5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:44.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.292+0000 7f9f04de8740 1 --2- 172.21.15.3:0/4000454069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559295eb33e0 0x559295ed5760 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x559295ebbe30 tx=0x7f9ee8013050 comp rx=0 tx=0).stop 2024-09-19T06:22:44.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.292+0000 7f9f04de8740 1 -- 172.21.15.3:0/4000454069 shutdown_connections 2024-09-19T06:22:44.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.292+0000 7f9f04de8740 1 --2- 172.21.15.3:0/4000454069 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559295ebdca0 0x559295ed5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.292+0000 7f9f04de8740 1 --2- 172.21.15.3:0/4000454069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559295eb33e0 0x559295ed5760 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.292+0000 7f9f04de8740 1 --2- 172.21.15.3:0/4000454069 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559295eb2ac0 0x559295eb96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.292+0000 7f9f04de8740 1 -- 172.21.15.3:0/4000454069 >> 172.21.15.3:0/4000454069 conn(0x559295eaf050 msgr2=0x559295eb8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:44.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.292+0000 7f9f04de8740 1 -- 172.21.15.3:0/4000454069 shutdown_connections 2024-09-19T06:22:44.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.292+0000 7f9f04de8740 1 -- 172.21.15.3:0/4000454069 wait complete. 2024-09-19T06:22:44.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.292+0000 7f9f04de8740 1 -- start start 2024-09-19T06:22:44.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.293+0000 7f9f04de8740 1 Processor -- start 2024-09-19T06:22:44.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.293+0000 7f9f04de8740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559295eb2ac0 0x559295ec6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.293+0000 7f9f04de8740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559295eb33e0 0x559295ec37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.293+0000 7f9f04de8740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559295ebdca0 0x559295ec3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.293+0000 7f9f04de8740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc1b5460 con 0x559295ebdca0 2024-09-19T06:22:44.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.293+0000 7f9f04de8740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc1b4d90 con 0x559295eb33e0 2024-09-19T06:22:44.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.293+0000 7f9f04de8740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9efc1b1ff0 con 0x559295eb2ac0 2024-09-19T06:22:44.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.293+0000 7f9f04de8740 10 client.0 _ll_register_callbacks cb 0x7f9eec009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:44.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.293+0000 7f9efb400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559295eb2ac0 0x559295ec6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.293+0000 7f9efb400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559295eb2ac0 0x559295ec6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:58860/0 (socket says 172.21.15.3:58860) 2024-09-19T06:22:44.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.293+0000 7f9efb400640 1 -- 172.21.15.3:0/3052686973 learned_addr learned my addr 172.21.15.3:0/3052686973 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:44.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.293+0000 7f9efaa00640 1 --2- 172.21.15.3:0/3052686973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559295eb33e0 0x559295ec37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.294+0000 7f9efbe00640 1 --2- 172.21.15.3:0/3052686973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559295ebdca0 0x559295ec3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.294+0000 7f9efb400640 1 -- 172.21.15.3:0/3052686973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559295eb33e0 msgr2=0x559295ec37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:44.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.294+0000 7f9efb400640 1 --2- 172.21.15.3:0/3052686973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559295eb33e0 0x559295ec37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.294+0000 7f9efb400640 1 -- 172.21.15.3:0/3052686973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559295ebdca0 msgr2=0x559295ec3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:44.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.294+0000 7f9efb400640 1 --2- 172.21.15.3:0/3052686973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559295ebdca0 0x559295ec3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.294+0000 7f9efb400640 1 -- 172.21.15.3:0/3052686973 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559295ec4530 con 0x559295eb2ac0 2024-09-19T06:22:44.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.294+0000 7f9efb400640 1 --2- 172.21.15.3:0/3052686973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559295eb2ac0 0x559295ec6450 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0093b0 tx=0x7f9eec004580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f4ef4cb74195447 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:44.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.294+0000 7f9ee5600640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:22:44.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.295+0000 7f9ee5600640 1 -- 172.21.15.3:0/3052686973 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec028070 con 0x559295eb2ac0 2024-09-19T06:22:44.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.295+0000 7f9ee5600640 1 -- 172.21.15.3:0/3052686973 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f9eec004d60 con 0x559295eb2ac0 2024-09-19T06:22:44.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.295+0000 7f9f04de8740 1 -- 172.21.15.3:0/3052686973 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ee801de50 con 0x559295eb2ac0 2024-09-19T06:22:44.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.297+0000 7f9ee5600640 1 -- 172.21.15.3:0/3052686973 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9eec003970 con 0x559295eb2ac0 2024-09-19T06:22:44.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.297+0000 7f9f04de8740 10 client.28252 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:44.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.297+0000 7f9f04de8740 1 -- 172.21.15.3:0/3052686973 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559295f387b0 con 0x559295eb2ac0 2024-09-19T06:22:44.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.298+0000 7f9ee5600640 1 -- 172.21.15.3:0/3052686973 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ee801de50 con 0x559295eb2ac0 2024-09-19T06:22:44.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.298+0000 7f9ee5600640 1 -- 172.21.15.3:0/3052686973 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9eec00f630 con 0x559295eb2ac0 2024-09-19T06:22:44.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.298+0000 7f9f04de8740 10 client.28252 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:44.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.298+0000 7f9f04de8740 10 client.28252 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:44.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.298+0000 7f9f04de8740 20 client.28252 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:44.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.298+0000 7f9f04de8740 1 --2- 172.21.15.3:0/3052686973 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x559295f38ef0 0x559295f3b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.298+0000 7f9f04de8740 4 client.28252 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:22:44.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.298+0000 7f9f04de8740 1 -- 172.21.15.3:0/3052686973 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559295e20d10 con 0x559295f38ef0 2024-09-19T06:22:44.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.298+0000 7f9efaa00640 1 --2- 172.21.15.3:0/3052686973 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x559295f38ef0 0x559295f3b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.299+0000 7f9efaa00640 1 --2- 172.21.15.3:0/3052686973 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x559295f38ef0 0x559295f3b310 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a9edf6cbe432288 server_cookie=371bf4543c1c99c1 in_seq=0 out_seq=0 2024-09-19T06:22:44.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.299+0000 7f9ee5600640 10 client.28252 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:44.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.300+0000 7f9ee5600640 1 -- 172.21.15.3:0/3052686973 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559295e20d10 con 0x559295f38ef0 2024-09-19T06:22:44.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.300+0000 7f9ee5600640 10 client.28252 handle_command_reply: tid=0 2024-09-19T06:22:44.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.300+0000 7f9f04de8740 1 client.28252 shutdown 2024-09-19T06:22:44.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.300+0000 7f9f04de8740 1 -- 172.21.15.3:0/3052686973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559295eb2ac0 msgr2=0x559295ec6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:44.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.300+0000 7f9f04de8740 1 --2- 172.21.15.3:0/3052686973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559295eb2ac0 0x559295ec6450 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9eec0093b0 tx=0x7f9eec004580 comp rx=0 tx=0).stop 2024-09-19T06:22:44.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.301+0000 7f9f04de8740 1 -- 172.21.15.3:0/3052686973 shutdown_connections 2024-09-19T06:22:44.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.301+0000 7f9f04de8740 1 --2- 172.21.15.3:0/3052686973 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x559295f38ef0 0x559295f3b310 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.301+0000 7f9ee5600640 0 client.28252 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:44.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.301+0000 7f9f04de8740 1 --2- 172.21.15.3:0/3052686973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x559295ebdca0 0x559295ec3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.301+0000 7f9f04de8740 1 --2- 172.21.15.3:0/3052686973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559295eb33e0 0x559295ec37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.301+0000 7f9f04de8740 1 --2- 172.21.15.3:0/3052686973 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x559295eb2ac0 0x559295ec6450 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.301+0000 7f9f04de8740 1 -- 172.21.15.3:0/3052686973 >> 172.21.15.3:0/3052686973 conn(0x559295eaf050 msgr2=0x559295eb97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:44.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.301+0000 7f9f04de8740 1 -- 172.21.15.3:0/3052686973 shutdown_connections 2024-09-19T06:22:44.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.301+0000 7f9f04de8740 1 -- 172.21.15.3:0/3052686973 wait complete. 2024-09-19T06:22:44.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.301+0000 7f9f04de8740 20 client.28252 trim_cache size 0 max 16384 2024-09-19T06:22:44.304 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:22:44.305 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": 0, 2024-09-19T06:22:44.305 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_tag": "9684b263-a0c8-473a-9336-d3a977819e8c", 2024-09-19T06:22:44.305 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": "asynchronous" 2024-09-19T06:22:44.305 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:22:44.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.302+0000 7f9f02400640 1 -- 172.21.15.3:0/2165089404 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9ee00a3430 msgr2=0x7f9ee00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.302+0000 7f9f02400640 1 --2- 172.21.15.3:0/2165089404 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9ee00a3430 0x7f9ee00a58f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x559295eb03d0 tx=0x7f9ee8005f90 comp rx=0 tx=0).stop 2024-09-19T06:22:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.302+0000 7f9f02400640 1 -- 172.21.15.3:0/2165089404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9efc112a30 msgr2=0x7f9efc19e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.302+0000 7f9f02400640 1 --2- 172.21.15.3:0/2165089404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9efc112a30 0x7f9efc19e8d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f9ef402ade0 tx=0x7f9ef40319f0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.303+0000 7f9f02400640 1 -- 172.21.15.3:0/2165089404 shutdown_connections 2024-09-19T06:22:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.303+0000 7f9f02400640 1 --2- 172.21.15.3:0/2165089404 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9ee00a3430 0x7f9ee00a58f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.303+0000 7f9f02400640 1 --2- 172.21.15.3:0/2165089404 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9efc112a30 0x7f9efc19e8d0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.303+0000 7f9f02400640 1 --2- 172.21.15.3:0/2165089404 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9efc077040 0x7f9efc1a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.303+0000 7f9f02400640 1 --2- 172.21.15.3:0/2165089404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9efc076720 0x7f9efc1a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.303+0000 7f9f02400640 1 -- 172.21.15.3:0/2165089404 >> 172.21.15.3:0/2165089404 conn(0x7f9efc0ffa90 msgr2=0x7f9efc101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.303+0000 7f9f02400640 1 -- 172.21.15.3:0/2165089404 shutdown_connections 2024-09-19T06:22:44.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:44.303+0000 7f9f02400640 1 -- 172.21.15.3:0/2165089404 wait complete. 2024-09-19T06:22:44.316 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:44 smithi003 ceph-mon[30893]: pgmap v321: 97 pgs: 97 active+clean; 4.3 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 15 op/s 2024-09-19T06:22:44.316 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:44 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:22:44.580 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:44 smithi071 ceph-mon[35662]: pgmap v321: 97 pgs: 97 active+clean; 4.3 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 15 op/s 2024-09-19T06:22:44.580 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:44 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:22:44.601 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:44 smithi059 ceph-mon[35138]: pgmap v321: 97 pgs: 97 active+clean; 4.3 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 15 op/s 2024-09-19T06:22:44.601 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:44 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:22:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.943+0000 7f9c75c00640 1 -- 172.21.15.3:0/3453972843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c70109bf0 msgr2=0x7f9c70109fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.943+0000 7f9c75c00640 1 --2- 172.21.15.3:0/3453972843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c70109bf0 0x7f9c70109fd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9c60009930 tx=0x7f9c6002a420 comp rx=0 tx=0).stop 2024-09-19T06:22:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.943+0000 7f9c75c00640 1 -- 172.21.15.3:0/3453972843 shutdown_connections 2024-09-19T06:22:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.943+0000 7f9c75c00640 1 --2- 172.21.15.3:0/3453972843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c701044d0 0x7f9c701109b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.943+0000 7f9c75c00640 1 --2- 172.21.15.3:0/3453972843 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c70103b30 0x7f9c70103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.943+0000 7f9c75c00640 1 --2- 172.21.15.3:0/3453972843 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c70109bf0 0x7f9c70109fd0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.943+0000 7f9c75c00640 1 -- 172.21.15.3:0/3453972843 >> 172.21.15.3:0/3453972843 conn(0x7f9c700ff810 msgr2=0x7f9c70101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.943+0000 7f9c75c00640 1 -- 172.21.15.3:0/3453972843 shutdown_connections 2024-09-19T06:22:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.943+0000 7f9c75c00640 1 -- 172.21.15.3:0/3453972843 wait complete. 2024-09-19T06:22:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.944+0000 7f9c75c00640 1 Processor -- start 2024-09-19T06:22:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.944+0000 7f9c75c00640 1 -- start start 2024-09-19T06:22:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.944+0000 7f9c75c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c70103b30 0x7f9c7019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.945+0000 7f9c75c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c701044d0 0x7f9c7019a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.945+0000 7f9c75c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c70109bf0 0x7f9c7019ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.945+0000 7f9c75c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9c70113f90 con 0x7f9c701044d0 2024-09-19T06:22:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.945+0000 7f9c75c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9c70113e10 con 0x7f9c70103b30 2024-09-19T06:22:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.945+0000 7f9c75c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9c70114110 con 0x7f9c70109bf0 2024-09-19T06:22:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.945+0000 7f9c75200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c70109bf0 0x7f9c7019ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.945+0000 7f9c6f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c701044d0 0x7f9c7019a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.945+0000 7f9c75200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c70109bf0 0x7f9c7019ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:58878/0 (socket says 172.21.15.3:58878) 2024-09-19T06:22:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.945+0000 7f9c75200640 1 -- 172.21.15.3:0/3336824709 learned_addr learned my addr 172.21.15.3:0/3336824709 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.945+0000 7f9c6fe00640 1 --2- 172.21.15.3:0/3336824709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c70103b30 0x7f9c7019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.945+0000 7f9c6f400640 1 -- 172.21.15.3:0/3336824709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c70109bf0 msgr2=0x7f9c7019ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.945+0000 7f9c6f400640 1 --2- 172.21.15.3:0/3336824709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c70109bf0 0x7f9c7019ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.945+0000 7f9c6f400640 1 -- 172.21.15.3:0/3336824709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c70103b30 msgr2=0x7f9c7019a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.945+0000 7f9c6f400640 1 --2- 172.21.15.3:0/3336824709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c70103b30 0x7f9c7019a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.945+0000 7f9c6f400640 1 -- 172.21.15.3:0/3336824709 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c7019f470 con 0x7f9c701044d0 2024-09-19T06:22:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.946+0000 7f9c6f400640 1 --2- 172.21.15.3:0/3336824709 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c701044d0 0x7f9c7019a9c0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00e9f0 tx=0x7f9c5c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.946+0000 7f9c6cc00640 1 -- 172.21.15.3:0/3336824709 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c00ccc0 con 0x7f9c701044d0 2024-09-19T06:22:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.946+0000 7f9c75c00640 1 -- 172.21.15.3:0/3336824709 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c7019f760 con 0x7f9c701044d0 2024-09-19T06:22:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.946+0000 7f9c6cc00640 1 -- 172.21.15.3:0/3336824709 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c5c010910 con 0x7f9c701044d0 2024-09-19T06:22:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.946+0000 7f9c6cc00640 1 -- 172.21.15.3:0/3336824709 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c018960 con 0x7f9c701044d0 2024-09-19T06:22:44.950 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.946+0000 7f9c75c00640 1 -- 172.21.15.3:0/3336824709 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c701a6ff0 con 0x7f9c701044d0 2024-09-19T06:22:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.949+0000 7f9c7a035740 1 Processor -- start 2024-09-19T06:22:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.949+0000 7f9c7a035740 1 -- start start 2024-09-19T06:22:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.949+0000 7f9c7a035740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff54283b0 0x55cff5428790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.949+0000 7f9c7a035740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cff5428cd0 0x55cff5433030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.950+0000 7f9c7a035740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff5433570 0x55cff5435960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.950+0000 7f9c7a035740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55cff538e100 con 0x55cff5428cd0 2024-09-19T06:22:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.950+0000 7f9c7a035740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55cff53361b0 con 0x55cff5433570 2024-09-19T06:22:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.950+0000 7f9c7a035740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cff538a0c0 con 0x55cff54283b0 2024-09-19T06:22:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.950+0000 7f9c6cc00640 1 -- 172.21.15.3:0/3336824709 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f9c5c010ac0 con 0x7f9c701044d0 2024-09-19T06:22:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.950+0000 7f9c75200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff54283b0 0x55cff5428790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.950+0000 7f9c6fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cff5428cd0 0x55cff5433030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.950+0000 7f9c75200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff54283b0 0x55cff5428790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:58894/0 (socket says 172.21.15.3:58894) 2024-09-19T06:22:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.950+0000 7f9c75200640 1 -- 172.21.15.3:0/66701893 learned_addr learned my addr 172.21.15.3:0/66701893 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.950+0000 7f9c75200640 1 -- 172.21.15.3:0/66701893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff5433570 msgr2=0x55cff5435960 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T06:22:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.950+0000 7f9c75200640 1 --2- 172.21.15.3:0/66701893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff5433570 0x55cff5435960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.950+0000 7f9c75200640 1 -- 172.21.15.3:0/66701893 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cff5428cd0 msgr2=0x55cff5433030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.950+0000 7f9c75200640 1 --2- 172.21.15.3:0/66701893 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cff5428cd0 0x55cff5433030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.950+0000 7f9c75200640 1 -- 172.21.15.3:0/66701893 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff50a1210 con 0x55cff54283b0 2024-09-19T06:22:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.950+0000 7f9c6fe00640 1 --2- 172.21.15.3:0/66701893 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cff5428cd0 0x55cff5433030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.951+0000 7f9c75200640 1 --2- 172.21.15.3:0/66701893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff54283b0 0x55cff5428790 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9c68011470 tx=0x7f9c68011930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6d0ef4da2dd93cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.951+0000 7f9c65600640 1 -- 172.21.15.3:0/66701893 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c68004b20 con 0x55cff54283b0 2024-09-19T06:22:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.951+0000 7f9c65600640 1 -- 172.21.15.3:0/66701893 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c68004cc0 con 0x55cff54283b0 2024-09-19T06:22:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.951+0000 7f9c65600640 1 -- 172.21.15.3:0/66701893 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c68005480 con 0x55cff54283b0 2024-09-19T06:22:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.951+0000 7f9c6cc00640 1 --2- 172.21.15.3:0/3336824709 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9c540a3420 0x7f9c540a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.951+0000 7f9c6cc00640 1 -- 172.21.15.3:0/3336824709 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f9c5c0d00c0 con 0x7f9c701044d0 2024-09-19T06:22:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.951+0000 7f9c7a035740 1 -- 172.21.15.3:0/66701893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff54283b0 msgr2=0x55cff5428790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.951+0000 7f9c7a035740 1 --2- 172.21.15.3:0/66701893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff54283b0 0x55cff5428790 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9c68011470 tx=0x7f9c68011930 comp rx=0 tx=0).stop 2024-09-19T06:22:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.952+0000 7f9c6fe00640 1 --2- 172.21.15.3:0/3336824709 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9c540a3420 0x7f9c540a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.952+0000 7f9c7a035740 1 -- 172.21.15.3:0/66701893 shutdown_connections 2024-09-19T06:22:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.952+0000 7f9c7a035740 1 --2- 172.21.15.3:0/66701893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff5433570 0x55cff5435960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.952+0000 7f9c7a035740 1 --2- 172.21.15.3:0/66701893 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cff5428cd0 0x55cff5433030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.952+0000 7f9c7a035740 1 --2- 172.21.15.3:0/66701893 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff54283b0 0x55cff5428790 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.952+0000 7f9c7a035740 1 -- 172.21.15.3:0/66701893 >> 172.21.15.3:0/66701893 conn(0x55cff5424920 msgr2=0x55cff5424d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.952+0000 7f9c7a035740 1 -- 172.21.15.3:0/66701893 shutdown_connections 2024-09-19T06:22:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.952+0000 7f9c7a035740 1 -- 172.21.15.3:0/66701893 wait complete. 2024-09-19T06:22:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.952+0000 7f9c6fe00640 1 --2- 172.21.15.3:0/3336824709 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9c540a3420 0x7f9c540a58e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9c60006010 tx=0x7f9c60000bc0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.952+0000 7f9c7a035740 1 -- start start 2024-09-19T06:22:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.953+0000 7f9c7a035740 1 Processor -- start 2024-09-19T06:22:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.953+0000 7f9c7a035740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff54283b0 0x55cff5430480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.953+0000 7f9c7a035740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff5428cd0 0x55cff54309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.953+0000 7f9c7a035740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cff5433570 0x55cff5430f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.953+0000 7f9c7a035740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55cff54360e0 con 0x55cff5433570 2024-09-19T06:22:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.953+0000 7f9c7a035740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55cff5317090 con 0x55cff5428cd0 2024-09-19T06:22:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.953+0000 7f9c7a035740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cff5436260 con 0x55cff54283b0 2024-09-19T06:22:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.953+0000 7f9c7a035740 10 client.0 _ll_register_callbacks cb 0x55cff536bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.953+0000 7f9c6fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff54283b0 0x55cff5430480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.953+0000 7f9c6fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff54283b0 0x55cff5430480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:58904/0 (socket says 172.21.15.3:58904) 2024-09-19T06:22:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.953+0000 7f9c6fe00640 1 -- 172.21.15.3:0/1134761385 learned_addr learned my addr 172.21.15.3:0/1134761385 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.953+0000 7f9c75200640 1 --2- 172.21.15.3:0/1134761385 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cff5433570 0x55cff5430f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.953+0000 7f9c6f400640 1 --2- 172.21.15.3:0/1134761385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff5428cd0 0x55cff54309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.954+0000 7f9c6f400640 1 -- 172.21.15.3:0/1134761385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff54283b0 msgr2=0x55cff5430480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.954+0000 7f9c6f400640 1 --2- 172.21.15.3:0/1134761385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff54283b0 0x55cff5430480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.954+0000 7f9c6f400640 1 -- 172.21.15.3:0/1134761385 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cff5433570 msgr2=0x55cff5430f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.954+0000 7f9c6f400640 1 --2- 172.21.15.3:0/1134761385 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cff5433570 0x55cff5430f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.954+0000 7f9c6f400640 1 -- 172.21.15.3:0/1134761385 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cff516d620 con 0x55cff5428cd0 2024-09-19T06:22:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.954+0000 7f9c6fe00640 1 --2- 172.21.15.3:0/1134761385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff54283b0 0x55cff5430480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.954+0000 7f9c6f400640 1 --2- 172.21.15.3:0/1134761385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff5428cd0 0x55cff54309c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c0cd780 tx=0x7f9c5c09c030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64542dda13cd7e2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.954+0000 7f9c5a000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:22:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.954+0000 7f9c5a000640 1 -- 172.21.15.3:0/1134761385 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c0cdc10 con 0x55cff5428cd0 2024-09-19T06:22:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.954+0000 7f9c7a035740 1 -- 172.21.15.3:0/1134761385 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c68004cc0 con 0x55cff5428cd0 2024-09-19T06:22:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.954+0000 7f9c5a000640 1 -- 172.21.15.3:0/1134761385 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f9c5c09b810 con 0x55cff5428cd0 2024-09-19T06:22:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.954+0000 7f9c5a000640 1 -- 172.21.15.3:0/1134761385 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9c5c0d2310 con 0x55cff5428cd0 2024-09-19T06:22:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.954+0000 7f9c7a035740 10 client.28283 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.954+0000 7f9c7a035740 1 -- 172.21.15.3:0/1134761385 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cff5441db0 con 0x55cff5428cd0 2024-09-19T06:22:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.955+0000 7f9c5a000640 1 -- 172.21.15.3:0/1134761385 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c68004cc0 con 0x55cff5428cd0 2024-09-19T06:22:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.955+0000 7f9c5a000640 1 -- 172.21.15.3:0/1134761385 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9c5c018c90 con 0x55cff5428cd0 2024-09-19T06:22:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.955+0000 7f9c7a035740 10 client.28283 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.955+0000 7f9c7a035740 10 client.28283 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.955+0000 7f9c7a035740 20 client.28283 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.955+0000 7f9c7a035740 1 --2- 172.21.15.3:0/1134761385 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55cff5443220 0x55cff5445610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.955+0000 7f9c7a035740 4 client.28283 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.955+0000 7f9c7a035740 1 -- 172.21.15.3:0/1134761385 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cff539b830 con 0x55cff5443220 2024-09-19T06:22:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.955+0000 7f9c6fe00640 1 --2- 172.21.15.3:0/1134761385 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55cff5443220 0x55cff5445610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.956+0000 7f9c6fe00640 1 --2- 172.21.15.3:0/1134761385 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55cff5443220 0x55cff5445610 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27e4668d68817ea server_cookie=619e1a191f10029a in_seq=0 out_seq=0 2024-09-19T06:22:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.956+0000 7f9c5a000640 10 client.28283 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.957+0000 7f9c5a000640 1 -- 172.21.15.3:0/1134761385 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cff539b830 con 0x55cff5443220 2024-09-19T06:22:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.957+0000 7f9c5a000640 10 client.28283 handle_command_reply: tid=0 2024-09-19T06:22:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.957+0000 7f9c7a035740 1 client.28283 shutdown 2024-09-19T06:22:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.957+0000 7f9c7a035740 1 -- 172.21.15.3:0/1134761385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff5428cd0 msgr2=0x55cff54309c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.957+0000 7f9c7a035740 1 --2- 172.21.15.3:0/1134761385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff5428cd0 0x55cff54309c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c0cd780 tx=0x7f9c5c09c030 comp rx=0 tx=0).stop 2024-09-19T06:22:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.957+0000 7f9c7a035740 1 -- 172.21.15.3:0/1134761385 shutdown_connections 2024-09-19T06:22:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.957+0000 7f9c7a035740 1 --2- 172.21.15.3:0/1134761385 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55cff5443220 0x55cff5445610 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.957+0000 7f9c7a035740 1 --2- 172.21.15.3:0/1134761385 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cff5433570 0x55cff5430f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.957+0000 7f9c5a000640 0 client.28283 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.957+0000 7f9c7a035740 1 --2- 172.21.15.3:0/1134761385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff5428cd0 0x55cff54309c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.957+0000 7f9c7a035740 1 --2- 172.21.15.3:0/1134761385 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff54283b0 0x55cff5430480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.957+0000 7f9c7a035740 1 -- 172.21.15.3:0/1134761385 >> 172.21.15.3:0/1134761385 conn(0x55cff5424920 msgr2=0x55cff542a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.957+0000 7f9c7a035740 1 -- 172.21.15.3:0/1134761385 shutdown_connections 2024-09-19T06:22:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.957+0000 7f9c7a035740 1 -- 172.21.15.3:0/1134761385 wait complete. 2024-09-19T06:22:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.957+0000 7f9c7a035740 20 client.28283 trim_cache size 0 max 16384 2024-09-19T06:22:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.972+0000 7f9c7a035740 1 Processor -- start 2024-09-19T06:22:44.975 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.972+0000 7f9c7a035740 1 -- start start 2024-09-19T06:22:44.975 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.973+0000 7f9c7a035740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff54283b0 0x55cff541f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.975 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.973+0000 7f9c7a035740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff5428cd0 0x55cff54322e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.975 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.973+0000 7f9c7a035740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cff5433570 0x55cff544ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.975 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.973+0000 7f9c7a035740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9c701afa60 con 0x55cff5433570 2024-09-19T06:22:44.975 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.973+0000 7f9c7a035740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9c701b15a0 con 0x55cff5428cd0 2024-09-19T06:22:44.975 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.973+0000 7f9c7a035740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9c701b0130 con 0x55cff54283b0 2024-09-19T06:22:44.975 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.973+0000 7f9c75200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cff5433570 0x55cff544ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.975 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.973+0000 7f9c6f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff5428cd0 0x55cff54322e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.975 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.973+0000 7f9c6fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff54283b0 0x55cff541f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.975 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.973+0000 7f9c75200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cff5433570 0x55cff544ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59114/0 (socket says 172.21.15.3:59114) 2024-09-19T06:22:44.976 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.973+0000 7f9c6f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff5428cd0 0x55cff54322e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:50244/0 (socket says 172.21.15.3:50244) 2024-09-19T06:22:44.976 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.973+0000 7f9c75200640 1 -- 172.21.15.3:0/2944960135 learned_addr learned my addr 172.21.15.3:0/2944960135 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.973+0000 7f9c6f400640 1 -- 172.21.15.3:0/2944960135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff54283b0 msgr2=0x55cff541f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.973+0000 7f9c6f400640 1 --2- 172.21.15.3:0/2944960135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff54283b0 0x55cff541f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.973+0000 7f9c6f400640 1 -- 172.21.15.3:0/2944960135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cff5433570 msgr2=0x55cff544ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.973+0000 7f9c6f400640 1 --2- 172.21.15.3:0/2944960135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cff5433570 0x55cff544ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.973+0000 7f9c6f400640 1 -- 172.21.15.3:0/2944960135 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff5428b00 con 0x55cff5428cd0 2024-09-19T06:22:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.974+0000 7f9c6f400640 1 --2- 172.21.15.3:0/2944960135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff5428cd0 0x55cff54322e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c09c350 tx=0x7f9c5c009700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7f462b3fb2a1209 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.974+0000 7f9c64c00640 1 -- 172.21.15.3:0/2944960135 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c0a4f80 con 0x55cff5428cd0 2024-09-19T06:22:44.980 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.974+0000 7f9c64c00640 1 -- 172.21.15.3:0/2944960135 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c5c0b5120 con 0x55cff5428cd0 2024-09-19T06:22:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.974+0000 7f9c64c00640 1 -- 172.21.15.3:0/2944960135 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c0105c0 con 0x55cff5428cd0 2024-09-19T06:22:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.974+0000 7f9c7a035740 1 -- 172.21.15.3:0/2944960135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff5428cd0 msgr2=0x55cff54322e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.974+0000 7f9c7a035740 1 --2- 172.21.15.3:0/2944960135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff5428cd0 0x55cff54322e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c09c350 tx=0x7f9c5c009700 comp rx=0 tx=0).stop 2024-09-19T06:22:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.974+0000 7f9c7a035740 1 -- 172.21.15.3:0/2944960135 shutdown_connections 2024-09-19T06:22:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.974+0000 7f9c7a035740 1 --2- 172.21.15.3:0/2944960135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cff5433570 0x55cff544ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.974+0000 7f9c7a035740 1 --2- 172.21.15.3:0/2944960135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff5428cd0 0x55cff54322e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.974+0000 7f9c7a035740 1 --2- 172.21.15.3:0/2944960135 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff54283b0 0x55cff541f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.974+0000 7f9c7a035740 1 -- 172.21.15.3:0/2944960135 >> 172.21.15.3:0/2944960135 conn(0x55cff5424920 msgr2=0x55cff5431bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:44.981 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.975+0000 7f9c7a035740 1 -- 172.21.15.3:0/2944960135 shutdown_connections 2024-09-19T06:22:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.975+0000 7f9c7a035740 1 -- 172.21.15.3:0/2944960135 wait complete. 2024-09-19T06:22:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.975+0000 7f9c7a035740 1 -- start start 2024-09-19T06:22:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.975+0000 7f9c7a035740 1 Processor -- start 2024-09-19T06:22:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.975+0000 7f9c7a035740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff54283b0 0x55cff543b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.976+0000 7f9c7a035740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cff5428cd0 0x55cff543bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.976+0000 7f9c7a035740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff5433570 0x55cff542cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.976+0000 7f9c7a035740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9c701b0ed0 con 0x55cff5428cd0 2024-09-19T06:22:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.976+0000 7f9c7a035740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9c701b0800 con 0x55cff54283b0 2024-09-19T06:22:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.976+0000 7f9c7a035740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9c701ada60 con 0x55cff5433570 2024-09-19T06:22:44.982 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.976+0000 7f9c7a035740 10 client.0 _ll_register_callbacks cb 0x7f9c5c09c240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.976+0000 7f9c6f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cff5428cd0 0x55cff543bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.976+0000 7f9c75200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff5433570 0x55cff542cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.976+0000 7f9c75200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff5433570 0x55cff542cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:58920/0 (socket says 172.21.15.3:58920) 2024-09-19T06:22:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.976+0000 7f9c75200640 1 -- 172.21.15.3:0/744199732 learned_addr learned my addr 172.21.15.3:0/744199732 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.976+0000 7f9c6fe00640 1 --2- 172.21.15.3:0/744199732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff54283b0 0x55cff543b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.976+0000 7f9c6f400640 1 -- 172.21.15.3:0/744199732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff5433570 msgr2=0x55cff542cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.976+0000 7f9c6f400640 1 --2- 172.21.15.3:0/744199732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff5433570 0x55cff542cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.976+0000 7f9c6f400640 1 -- 172.21.15.3:0/744199732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff54283b0 msgr2=0x55cff543b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.976+0000 7f9c6f400640 1 --2- 172.21.15.3:0/744199732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff54283b0 0x55cff543b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.976+0000 7f9c6f400640 1 -- 172.21.15.3:0/744199732 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cff542d720 con 0x55cff5428cd0 2024-09-19T06:22:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.977+0000 7f9c6f400640 1 --2- 172.21.15.3:0/744199732 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cff5428cd0 0x55cff543bce0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c09c580 tx=0x7f9c5c0bc420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e9db0b06b00bbc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.977+0000 7f9c5a000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:22:44.983 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.977+0000 7f9c5a000640 1 -- 172.21.15.3:0/744199732 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c0b52d0 con 0x55cff5428cd0 2024-09-19T06:22:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.977+0000 7f9c5a000640 1 -- 172.21.15.3:0/744199732 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f9c5c09ba20 con 0x55cff5428cd0 2024-09-19T06:22:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.977+0000 7f9c7a035740 1 -- 172.21.15.3:0/744199732 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c5c0b5120 con 0x55cff5428cd0 2024-09-19T06:22:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.977+0000 7f9c5a000640 1 -- 172.21.15.3:0/744199732 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9c5c0a4f80 con 0x55cff5428cd0 2024-09-19T06:22:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.977+0000 7f9c7a035740 10 client.18255 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.977+0000 7f9c7a035740 1 -- 172.21.15.3:0/744199732 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cff54ada40 con 0x55cff5428cd0 2024-09-19T06:22:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.977+0000 7f9c5a000640 1 -- 172.21.15.3:0/744199732 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c5c0b5120 con 0x55cff5428cd0 2024-09-19T06:22:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.977+0000 7f9c5a000640 1 -- 172.21.15.3:0/744199732 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9c5c098230 con 0x55cff5428cd0 2024-09-19T06:22:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.978+0000 7f9c7a035740 10 client.18255 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.978+0000 7f9c7a035740 10 client.18255 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.978+0000 7f9c7a035740 20 client.18255 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.978+0000 7f9c7a035740 1 --2- 172.21.15.3:0/744199732 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55cff54adf90 0x55cff54b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.978+0000 7f9c7a035740 4 client.18255 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:22:44.984 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.978+0000 7f9c7a035740 1 -- 172.21.15.3:0/744199732 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cff5395b80 con 0x55cff54adf90 2024-09-19T06:22:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.978+0000 7f9c6fe00640 1 --2- 172.21.15.3:0/744199732 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55cff54adf90 0x55cff54b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.978+0000 7f9c6fe00640 1 --2- 172.21.15.3:0/744199732 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55cff54adf90 0x55cff54b03b0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f35648677e01b028 server_cookie=7bf9c2bc24da8767 in_seq=0 out_seq=0 2024-09-19T06:22:44.985 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.978+0000 7f9c5a000640 10 client.18255 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:44.992 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.990+0000 7f9c5a000640 1 -- 172.21.15.3:0/744199732 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cff5395b80 con 0x55cff54adf90 2024-09-19T06:22:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.990+0000 7f9c5a000640 10 client.18255 handle_command_reply: tid=0 2024-09-19T06:22:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.990+0000 7f9c7a035740 1 client.18255 shutdown 2024-09-19T06:22:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.990+0000 7f9c7a035740 1 -- 172.21.15.3:0/744199732 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cff5428cd0 msgr2=0x55cff543bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.990+0000 7f9c7a035740 1 --2- 172.21.15.3:0/744199732 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cff5428cd0 0x55cff543bce0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c09c580 tx=0x7f9c5c0bc420 comp rx=0 tx=0).stop 2024-09-19T06:22:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.990+0000 7f9c7a035740 1 -- 172.21.15.3:0/744199732 shutdown_connections 2024-09-19T06:22:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.990+0000 7f9c7a035740 1 --2- 172.21.15.3:0/744199732 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55cff54adf90 0x55cff54b03b0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.990+0000 7f9c7a035740 1 --2- 172.21.15.3:0/744199732 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cff5433570 0x55cff542cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.990+0000 7f9c7a035740 1 --2- 172.21.15.3:0/744199732 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cff5428cd0 0x55cff543bce0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.990+0000 7f9c7a035740 1 --2- 172.21.15.3:0/744199732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cff54283b0 0x55cff543b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.993 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.990+0000 7f9c7a035740 1 -- 172.21.15.3:0/744199732 >> 172.21.15.3:0/744199732 conn(0x55cff5424920 msgr2=0x55cff542a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.990+0000 7f9c5a000640 0 client.18255 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.991+0000 7f9c7a035740 1 -- 172.21.15.3:0/744199732 shutdown_connections 2024-09-19T06:22:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.991+0000 7f9c7a035740 1 -- 172.21.15.3:0/744199732 wait complete. 2024-09-19T06:22:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.991+0000 7f9c7a035740 20 client.18255 trim_cache size 0 max 16384 2024-09-19T06:22:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:22:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:22:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:22:44.994 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:22:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.991+0000 7f9c75c00640 1 -- 172.21.15.3:0/3336824709 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9c540a3420 msgr2=0x7f9c540a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.991+0000 7f9c75c00640 1 --2- 172.21.15.3:0/3336824709 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9c540a3420 0x7f9c540a58e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9c60006010 tx=0x7f9c60000bc0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.991+0000 7f9c75c00640 1 -- 172.21.15.3:0/3336824709 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c701044d0 msgr2=0x7f9c7019a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.991+0000 7f9c75c00640 1 --2- 172.21.15.3:0/3336824709 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c701044d0 0x7f9c7019a9c0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00e9f0 tx=0x7f9c5c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.991+0000 7f9c75c00640 1 -- 172.21.15.3:0/3336824709 shutdown_connections 2024-09-19T06:22:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.991+0000 7f9c75c00640 1 --2- 172.21.15.3:0/3336824709 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9c540a3420 0x7f9c540a58e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.995 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.991+0000 7f9c75c00640 1 --2- 172.21.15.3:0/3336824709 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9c70109bf0 0x7f9c7019ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.991+0000 7f9c75c00640 1 --2- 172.21.15.3:0/3336824709 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9c701044d0 0x7f9c7019a9c0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.991+0000 7f9c75c00640 1 --2- 172.21.15.3:0/3336824709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c70103b30 0x7f9c7019a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.991+0000 7f9c75c00640 1 -- 172.21.15.3:0/3336824709 >> 172.21.15.3:0/3336824709 conn(0x7f9c700ff810 msgr2=0x7f9c70100ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.992+0000 7f9c75c00640 1 -- 172.21.15.3:0/3336824709 shutdown_connections 2024-09-19T06:22:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:44.992+0000 7f9c75c00640 1 -- 172.21.15.3:0/3336824709 wait complete. 2024-09-19T06:22:45.213 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:22:45.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:45 smithi003 ceph-mon[30893]: scrub queued for path: / 2024-09-19T06:22:45.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:45 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:45.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:45 smithi003 ceph-mon[30893]: scrub summary: active paths [/] 2024-09-19T06:22:45.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:45 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:45.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:45 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:45.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:45 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:45.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:45 smithi003 ceph-mon[30893]: pgmap v322: 97 pgs: 97 active+clean; 4.4 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 58 KiB/s wr, 22 op/s 2024-09-19T06:22:45.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:45 smithi003 ceph-mon[30893]: scrub summary: idle 2024-09-19T06:22:45.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:45 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:45.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:45 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:45.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:45 smithi059 ceph-mon[35138]: scrub queued for path: / 2024-09-19T06:22:45.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:45 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:45.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:45 smithi059 ceph-mon[35138]: scrub summary: active paths [/] 2024-09-19T06:22:45.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:45 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:45.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:45 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:45.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:45 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:45.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:45 smithi059 ceph-mon[35138]: pgmap v322: 97 pgs: 97 active+clean; 4.4 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 58 KiB/s wr, 22 op/s 2024-09-19T06:22:45.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:45 smithi059 ceph-mon[35138]: scrub summary: idle 2024-09-19T06:22:45.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:45 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:45.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:45 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:45.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:45 smithi071 ceph-mon[35662]: scrub queued for path: / 2024-09-19T06:22:45.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:45 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:45.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:45 smithi071 ceph-mon[35662]: scrub summary: active paths [/] 2024-09-19T06:22:45.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:45 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:22:45.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:45 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:45.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:45 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:45.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:45 smithi071 ceph-mon[35662]: pgmap v322: 97 pgs: 97 active+clean; 4.4 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 58 KiB/s wr, 22 op/s 2024-09-19T06:22:45.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:45 smithi071 ceph-mon[35662]: scrub summary: idle 2024-09-19T06:22:45.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:45 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:45.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:45 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:46.483 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:46.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:46 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:46.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:46 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:46.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:46 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:46.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:46 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:46.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:46 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:46.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:46 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:46.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:46 smithi059 ceph-mon[35138]: Adjusting osd_memory_target on smithi071 to 176.0M 2024-09-19T06:22:46.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:46 smithi059 ceph-mon[35138]: Unable to set osd_memory_target on smithi071 to 184573132: error parsing value: Value '184573132' is below minimum 939524096 2024-09-19T06:22:46.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:46 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:46.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:46 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:46.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:46 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:46.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:46 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:46.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:46 smithi059 ceph-mon[35138]: Adjusting osd_memory_target on smithi059 to 177.0M 2024-09-19T06:22:46.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:46 smithi059 ceph-mon[35138]: Unable to set osd_memory_target on smithi059 to 185698508: error parsing value: Value '185698508' is below minimum 939524096 2024-09-19T06:22:46.801 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:46 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:46.801 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:46 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:46.801 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:46 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:46.801 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:46 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:46.801 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:46 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:46.801 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:46 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:46.801 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:46 smithi003 ceph-mon[30893]: Adjusting osd_memory_target on smithi071 to 176.0M 2024-09-19T06:22:46.802 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:46 smithi003 ceph-mon[30893]: Unable to set osd_memory_target on smithi071 to 184573132: error parsing value: Value '184573132' is below minimum 939524096 2024-09-19T06:22:46.802 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:46 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:46.802 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:46 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:46.802 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:46 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:46.802 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:46 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:46.802 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:46 smithi003 ceph-mon[30893]: Adjusting osd_memory_target on smithi059 to 177.0M 2024-09-19T06:22:46.802 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:46 smithi003 ceph-mon[30893]: Unable to set osd_memory_target on smithi059 to 185698508: error parsing value: Value '185698508' is below minimum 939524096 2024-09-19T06:22:46.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:46 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:46.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:46 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:46.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:46 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:46.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:46 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:46.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:46 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:46.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:46 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:46.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:46 smithi071 ceph-mon[35662]: Adjusting osd_memory_target on smithi071 to 176.0M 2024-09-19T06:22:46.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:46 smithi071 ceph-mon[35662]: Unable to set osd_memory_target on smithi071 to 184573132: error parsing value: Value '184573132' is below minimum 939524096 2024-09-19T06:22:46.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:46 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:46.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:46 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:46.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:46 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:46.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:46 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:46.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:46 smithi071 ceph-mon[35662]: Adjusting osd_memory_target on smithi059 to 177.0M 2024-09-19T06:22:46.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:46 smithi071 ceph-mon[35662]: Unable to set osd_memory_target on smithi059 to 185698508: error parsing value: Value '185698508' is below minimum 939524096 2024-09-19T06:22:47.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.054+0000 7f2d1e600640 1 -- 172.21.15.3:0/3963778468 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d1810e280 msgr2=0x7f2d18110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:47.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.054+0000 7f2d1e600640 1 --2- 172.21.15.3:0/3963778468 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d1810e280 0x7f2d18110670 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f2d10009ca0 tx=0x7f2d1002a950 comp rx=0 tx=0).stop 2024-09-19T06:22:47.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.054+0000 7f2d1e600640 1 -- 172.21.15.3:0/3963778468 shutdown_connections 2024-09-19T06:22:47.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.054+0000 7f2d1e600640 1 --2- 172.21.15.3:0/3963778468 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d1810e280 0x7f2d18110670 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.054+0000 7f2d1e600640 1 --2- 172.21.15.3:0/3963778468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d18074e30 0x7f2d1810dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.054+0000 7f2d1e600640 1 --2- 172.21.15.3:0/3963778468 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d18074510 0x7f2d180748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.054+0000 7f2d1e600640 1 -- 172.21.15.3:0/3963778468 >> 172.21.15.3:0/3963778468 conn(0x7f2d180fd740 msgr2=0x7f2d180ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:47.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.054+0000 7f2d1e600640 1 -- 172.21.15.3:0/3963778468 shutdown_connections 2024-09-19T06:22:47.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.054+0000 7f2d1e600640 1 -- 172.21.15.3:0/3963778468 wait complete. 2024-09-19T06:22:47.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.055+0000 7f2d1e600640 1 Processor -- start 2024-09-19T06:22:47.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.055+0000 7f2d1e600640 1 -- start start 2024-09-19T06:22:47.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.056+0000 7f2d1e600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d18074510 0x7f2d181019a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:47.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.056+0000 7f2d1e600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d18074e30 0x7f2d18101ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:47.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.056+0000 7f2d1e600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d1810e280 0x7f2d18102420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:47.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.056+0000 7f2d1e600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2d18113fc0 con 0x7f2d1810e280 2024-09-19T06:22:47.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.056+0000 7f2d1e600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2d18113e40 con 0x7f2d18074e30 2024-09-19T06:22:47.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.056+0000 7f2d1e600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2d18114140 con 0x7f2d18074510 2024-09-19T06:22:47.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.056+0000 7f2d17e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d18074e30 0x7f2d18101ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:47.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.056+0000 7f2d17e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d18074e30 0x7f2d18101ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:50258/0 (socket says 172.21.15.3:50258) 2024-09-19T06:22:47.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.056+0000 7f2d17e00640 1 -- 172.21.15.3:0/2863003827 learned_addr learned my addr 172.21.15.3:0/2863003827 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:47.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.056+0000 7f2d1d200640 1 --2- 172.21.15.3:0/2863003827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d18074510 0x7f2d181019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:47.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.056+0000 7f2d1dc00640 1 --2- 172.21.15.3:0/2863003827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d1810e280 0x7f2d18102420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:47.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.057+0000 7f2d17e00640 1 -- 172.21.15.3:0/2863003827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d18074510 msgr2=0x7f2d181019a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:47.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.057+0000 7f2d17e00640 1 --2- 172.21.15.3:0/2863003827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d18074510 0x7f2d181019a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.057+0000 7f2d17e00640 1 -- 172.21.15.3:0/2863003827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d1810e280 msgr2=0x7f2d18102420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:47.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.057+0000 7f2d17e00640 1 --2- 172.21.15.3:0/2863003827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d1810e280 0x7f2d18102420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.057+0000 7f2d17e00640 1 -- 172.21.15.3:0/2863003827 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d181aab20 con 0x7f2d18074e30 2024-09-19T06:22:47.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.057+0000 7f2d17e00640 1 --2- 172.21.15.3:0/2863003827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d18074e30 0x7f2d18101ee0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400ea50 tx=0x7f2d0400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:47.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.057+0000 7f2d15600640 1 -- 172.21.15.3:0/2863003827 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0400cd60 con 0x7f2d18074e30 2024-09-19T06:22:47.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.057+0000 7f2d1e600640 1 -- 172.21.15.3:0/2863003827 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d181aae10 con 0x7f2d18074e30 2024-09-19T06:22:47.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.057+0000 7f2d15600640 1 -- 172.21.15.3:0/2863003827 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d04010910 con 0x7f2d18074e30 2024-09-19T06:22:47.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.057+0000 7f2d15600640 1 -- 172.21.15.3:0/2863003827 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04018950 con 0x7f2d18074e30 2024-09-19T06:22:47.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.058+0000 7f2d1e600640 1 -- 172.21.15.3:0/2863003827 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d181ab2c0 con 0x7f2d18074e30 2024-09-19T06:22:47.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.061+0000 7f2d227fa740 1 Processor -- start 2024-09-19T06:22:47.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.061+0000 7f2d15600640 1 -- 172.21.15.3:0/2863003827 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f2d04010ac0 con 0x7f2d18074e30 2024-09-19T06:22:47.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.061+0000 7f2d227fa740 1 -- start start 2024-09-19T06:22:47.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.061+0000 7f2d227fa740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557720896d50 0x557720897130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:47.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.061+0000 7f2d227fa740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720897670 0x5577208a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:47.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.062+0000 7f2d227fa740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577208a1f30 0x5577208a4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:47.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.062+0000 7f2d227fa740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5577207fd3e0 con 0x557720897670 2024-09-19T06:22:47.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.062+0000 7f2d227fa740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5577207a4d80 con 0x557720896d50 2024-09-19T06:22:47.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.062+0000 7f2d227fa740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5577207f93a0 con 0x5577208a1f30 2024-09-19T06:22:47.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.062+0000 7f2d1d200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720897670 0x5577208a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:47.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.062+0000 7f2d1d200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720897670 0x5577208a19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59164/0 (socket says 172.21.15.3:59164) 2024-09-19T06:22:47.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.062+0000 7f2d1d200640 1 -- 172.21.15.3:0/3946727288 learned_addr learned my addr 172.21.15.3:0/3946727288 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:47.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.062+0000 7f2d1dc00640 1 --2- 172.21.15.3:0/3946727288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557720896d50 0x557720897130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:47.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.062+0000 7f2d17e00640 1 --2- 172.21.15.3:0/3946727288 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577208a1f30 0x5577208a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:47.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.062+0000 7f2d1dc00640 1 -- 172.21.15.3:0/3946727288 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577208a1f30 msgr2=0x5577208a4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:47.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.062+0000 7f2d1dc00640 1 --2- 172.21.15.3:0/3946727288 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577208a1f30 0x5577208a4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.062+0000 7f2d1dc00640 1 -- 172.21.15.3:0/3946727288 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720897670 msgr2=0x5577208a19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:47.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.062+0000 7f2d1dc00640 1 --2- 172.21.15.3:0/3946727288 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720897670 0x5577208a19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.062+0000 7f2d1dc00640 1 -- 172.21.15.3:0/3946727288 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577207c3ae0 con 0x557720896d50 2024-09-19T06:22:47.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.063+0000 7f2d15600640 1 --2- 172.21.15.3:0/2863003827 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2d000a3430 0x7f2d000a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:47.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.063+0000 7f2d1dc00640 1 --2- 172.21.15.3:0/3946727288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557720896d50 0x557720897130 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2d1002af40 tx=0x7f2d10005f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcf5d4c4aaf3c316 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:47.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.063+0000 7f2d15600640 1 -- 172.21.15.3:0/2863003827 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f2d040d0000 con 0x7f2d18074e30 2024-09-19T06:22:47.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.063+0000 7f2d1d200640 1 --2- 172.21.15.3:0/2863003827 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2d000a3430 0x7f2d000a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:47.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.063+0000 7f2d0a000640 1 -- 172.21.15.3:0/3946727288 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d10048070 con 0x557720896d50 2024-09-19T06:22:47.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.063+0000 7f2d0a000640 1 -- 172.21.15.3:0/3946727288 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d10003e50 con 0x557720896d50 2024-09-19T06:22:47.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.063+0000 7f2d0a000640 1 -- 172.21.15.3:0/3946727288 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d10034040 con 0x557720896d50 2024-09-19T06:22:47.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.064+0000 7f2d227fa740 1 -- 172.21.15.3:0/3946727288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557720896d50 msgr2=0x557720897130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:47.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.064+0000 7f2d1d200640 1 --2- 172.21.15.3:0/2863003827 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2d000a3430 0x7f2d000a58f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x557720894140 tx=0x7f2d0c005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:47.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.064+0000 7f2d227fa740 1 --2- 172.21.15.3:0/3946727288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557720896d50 0x557720897130 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2d1002af40 tx=0x7f2d10005f80 comp rx=0 tx=0).stop 2024-09-19T06:22:47.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.064+0000 7f2d227fa740 1 -- 172.21.15.3:0/3946727288 shutdown_connections 2024-09-19T06:22:47.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.064+0000 7f2d227fa740 1 --2- 172.21.15.3:0/3946727288 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577208a1f30 0x5577208a4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.064+0000 7f2d227fa740 1 --2- 172.21.15.3:0/3946727288 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720897670 0x5577208a19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.064+0000 7f2d227fa740 1 --2- 172.21.15.3:0/3946727288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557720896d50 0x557720897130 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.064+0000 7f2d227fa740 1 -- 172.21.15.3:0/3946727288 >> 172.21.15.3:0/3946727288 conn(0x5577208932e0 msgr2=0x5577208936c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:47.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.065+0000 7f2d227fa740 1 -- 172.21.15.3:0/3946727288 shutdown_connections 2024-09-19T06:22:47.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.065+0000 7f2d227fa740 1 -- 172.21.15.3:0/3946727288 wait complete. 2024-09-19T06:22:47.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.065+0000 7f2d227fa740 1 -- start start 2024-09-19T06:22:47.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.065+0000 7f2d227fa740 1 Processor -- start 2024-09-19T06:22:47.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.066+0000 7f2d227fa740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720896d50 0x55772089eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:47.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.066+0000 7f2d227fa740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557720897670 0x55772089f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:47.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.066+0000 7f2d227fa740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577208a1f30 0x55772089f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:47.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.066+0000 7f2d227fa740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5577208a4ba0 con 0x557720896d50 2024-09-19T06:22:47.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.066+0000 7f2d227fa740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5577207b80f0 con 0x5577208a1f30 2024-09-19T06:22:47.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.066+0000 7f2d227fa740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5577208a4d20 con 0x557720897670 2024-09-19T06:22:47.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.066+0000 7f2d227fa740 10 client.0 _ll_register_callbacks cb 0x5577207a99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:47.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.066+0000 7f2d1d200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720896d50 0x55772089eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:47.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.066+0000 7f2d1d200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720896d50 0x55772089eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59174/0 (socket says 172.21.15.3:59174) 2024-09-19T06:22:47.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.066+0000 7f2d1d200640 1 -- 172.21.15.3:0/3240802960 learned_addr learned my addr 172.21.15.3:0/3240802960 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:47.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.066+0000 7f2d17e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557720897670 0x55772089f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:47.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.067+0000 7f2d1dc00640 1 --2- 172.21.15.3:0/3240802960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577208a1f30 0x55772089f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:47.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.067+0000 7f2d17e00640 1 -- 172.21.15.3:0/3240802960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577208a1f30 msgr2=0x55772089f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:47.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.067+0000 7f2d17e00640 1 --2- 172.21.15.3:0/3240802960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577208a1f30 0x55772089f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.067+0000 7f2d17e00640 1 -- 172.21.15.3:0/3240802960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720896d50 msgr2=0x55772089eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:47.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.067+0000 7f2d17e00640 1 --2- 172.21.15.3:0/3240802960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720896d50 0x55772089eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.067+0000 7f2d17e00640 1 -- 172.21.15.3:0/3240802960 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55772056e3c0 con 0x557720897670 2024-09-19T06:22:47.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.067+0000 7f2d1d200640 1 --2- 172.21.15.3:0/3240802960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720896d50 0x55772089eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:47.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.067+0000 7f2d17e00640 1 --2- 172.21.15.3:0/3240802960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557720897670 0x55772089f3f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2d040cd6c0 tx=0x7f2d04009700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71fcc8aecdc54cc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:47.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.067+0000 7f2cfea00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:22:47.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.068+0000 7f2cfea00640 1 -- 172.21.15.3:0/3240802960 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0409bc60 con 0x557720897670 2024-09-19T06:22:47.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.068+0000 7f2cfea00640 1 -- 172.21.15.3:0/3240802960 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f2d040a4c30 con 0x557720897670 2024-09-19T06:22:47.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.068+0000 7f2d227fa740 1 -- 172.21.15.3:0/3240802960 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d10003e50 con 0x557720897670 2024-09-19T06:22:47.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.068+0000 7f2cfea00640 1 -- 172.21.15.3:0/3240802960 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2d0409c300 con 0x557720897670 2024-09-19T06:22:47.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.068+0000 7f2d227fa740 10 client.28282 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:47.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.068+0000 7f2d227fa740 1 -- 172.21.15.3:0/3240802960 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5577208b0920 con 0x557720897670 2024-09-19T06:22:47.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.068+0000 7f2cfea00640 1 -- 172.21.15.3:0/3240802960 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d10003e50 con 0x557720897670 2024-09-19T06:22:47.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.068+0000 7f2cfea00640 1 -- 172.21.15.3:0/3240802960 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2d040bc0b0 con 0x557720897670 2024-09-19T06:22:47.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.068+0000 7f2d227fa740 10 client.28282 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:47.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.068+0000 7f2d227fa740 10 client.28282 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:47.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.069+0000 7f2d227fa740 20 client.28282 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:47.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.069+0000 7f2d227fa740 1 --2- 172.21.15.3:0/3240802960 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5577208b1de0 0x5577208b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:47.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.069+0000 7f2d227fa740 4 client.28282 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:47.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.069+0000 7f2d227fa740 1 -- 172.21.15.3:0/3240802960 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55772080a950 con 0x5577208b1de0 2024-09-19T06:22:47.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.069+0000 7f2d1d200640 1 --2- 172.21.15.3:0/3240802960 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5577208b1de0 0x5577208b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:47.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.070+0000 7f2d1d200640 1 --2- 172.21.15.3:0/3240802960 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5577208b1de0 0x5577208b41d0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87736d62b8595c74 server_cookie=59c4a07290f25b46 in_seq=0 out_seq=0 2024-09-19T06:22:47.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.070+0000 7f2cfea00640 10 client.28282 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:47.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.070+0000 7f2cfea00640 1 -- 172.21.15.3:0/3240802960 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55772080a950 con 0x5577208b1de0 2024-09-19T06:22:47.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.070+0000 7f2cfea00640 10 client.28282 handle_command_reply: tid=0 2024-09-19T06:22:47.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.070+0000 7f2d227fa740 1 client.28282 shutdown 2024-09-19T06:22:47.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.071+0000 7f2d227fa740 1 -- 172.21.15.3:0/3240802960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557720897670 msgr2=0x55772089f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:47.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.071+0000 7f2d227fa740 1 --2- 172.21.15.3:0/3240802960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557720897670 0x55772089f3f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2d040cd6c0 tx=0x7f2d04009700 comp rx=0 tx=0).stop 2024-09-19T06:22:47.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.071+0000 7f2d227fa740 1 -- 172.21.15.3:0/3240802960 shutdown_connections 2024-09-19T06:22:47.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.071+0000 7f2d227fa740 1 --2- 172.21.15.3:0/3240802960 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5577208b1de0 0x5577208b41d0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.071+0000 7f2d227fa740 1 --2- 172.21.15.3:0/3240802960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577208a1f30 0x55772089f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.071+0000 7f2d227fa740 1 --2- 172.21.15.3:0/3240802960 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557720897670 0x55772089f3f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.071+0000 7f2d227fa740 1 --2- 172.21.15.3:0/3240802960 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720896d50 0x55772089eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.071+0000 7f2d227fa740 1 -- 172.21.15.3:0/3240802960 >> 172.21.15.3:0/3240802960 conn(0x5577208932e0 msgr2=0x557720899010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:47.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.071+0000 7f2cfea00640 0 client.28282 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:47.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.071+0000 7f2d227fa740 1 -- 172.21.15.3:0/3240802960 shutdown_connections 2024-09-19T06:22:47.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.071+0000 7f2d227fa740 1 -- 172.21.15.3:0/3240802960 wait complete. 2024-09-19T06:22:47.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.071+0000 7f2d227fa740 20 client.28282 trim_cache size 0 max 16384 2024-09-19T06:22:47.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.090+0000 7f2d227fa740 1 Processor -- start 2024-09-19T06:22:47.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.090+0000 7f2d227fa740 1 -- start start 2024-09-19T06:22:47.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.090+0000 7f2d227fa740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720896d50 0x5577208936c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:47.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.090+0000 7f2d227fa740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557720897670 0x5577208a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:47.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.090+0000 7f2d227fa740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577208a1f30 0x5577208b9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:47.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.090+0000 7f2d227fa740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2d181b3d80 con 0x557720896d50 2024-09-19T06:22:47.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.090+0000 7f2d227fa740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2d181b58c0 con 0x5577208a1f30 2024-09-19T06:22:47.092 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.090+0000 7f2d227fa740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2d181b4450 con 0x557720897670 2024-09-19T06:22:47.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.090+0000 7f2d1d200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720896d50 0x5577208936c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:47.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.090+0000 7f2d1d200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720896d50 0x5577208936c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59186/0 (socket says 172.21.15.3:59186) 2024-09-19T06:22:47.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.091+0000 7f2d1dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577208a1f30 0x5577208b9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:47.093 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.091+0000 7f2d1d200640 1 -- 172.21.15.3:0/965849750 learned_addr learned my addr 172.21.15.3:0/965849750 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:47.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.091+0000 7f2d17e00640 1 --2- 172.21.15.3:0/965849750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557720897670 0x5577208a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:47.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.091+0000 7f2d17e00640 1 -- 172.21.15.3:0/965849750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577208a1f30 msgr2=0x5577208b9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:47.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.091+0000 7f2d17e00640 1 --2- 172.21.15.3:0/965849750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577208a1f30 0x5577208b9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.091+0000 7f2d17e00640 1 -- 172.21.15.3:0/965849750 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720896d50 msgr2=0x5577208936c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:47.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.091+0000 7f2d17e00640 1 --2- 172.21.15.3:0/965849750 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720896d50 0x5577208936c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.091+0000 7f2d17e00640 1 -- 172.21.15.3:0/965849750 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55772089de60 con 0x557720897670 2024-09-19T06:22:47.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.091+0000 7f2d1d200640 1 --2- 172.21.15.3:0/965849750 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720896d50 0x5577208936c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:47.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.091+0000 7f2d17e00640 1 --2- 172.21.15.3:0/965849750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557720897670 0x5577208a0e20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400c6a0 tx=0x7f2d04009770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faec35a767c00c70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:47.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.092+0000 7f2d09600640 1 -- 172.21.15.3:0/965849750 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0409bc60 con 0x557720897670 2024-09-19T06:22:47.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.092+0000 7f2d09600640 1 -- 172.21.15.3:0/965849750 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d040a0600 con 0x557720897670 2024-09-19T06:22:47.094 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.092+0000 7f2d09600640 1 -- 172.21.15.3:0/965849750 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0409c0d0 con 0x557720897670 2024-09-19T06:22:47.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.092+0000 7f2d227fa740 1 -- 172.21.15.3:0/965849750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557720897670 msgr2=0x5577208a0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:47.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.092+0000 7f2d227fa740 1 --2- 172.21.15.3:0/965849750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557720897670 0x5577208a0e20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400c6a0 tx=0x7f2d04009770 comp rx=0 tx=0).stop 2024-09-19T06:22:47.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.092+0000 7f2d227fa740 1 -- 172.21.15.3:0/965849750 shutdown_connections 2024-09-19T06:22:47.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.092+0000 7f2d227fa740 1 --2- 172.21.15.3:0/965849750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5577208a1f30 0x5577208b9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.092+0000 7f2d227fa740 1 --2- 172.21.15.3:0/965849750 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557720897670 0x5577208a0e20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.092+0000 7f2d227fa740 1 --2- 172.21.15.3:0/965849750 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720896d50 0x5577208936c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.092+0000 7f2d227fa740 1 -- 172.21.15.3:0/965849750 >> 172.21.15.3:0/965849750 conn(0x5577208932e0 msgr2=0x5577208a0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:47.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.093+0000 7f2d227fa740 1 -- 172.21.15.3:0/965849750 shutdown_connections 2024-09-19T06:22:47.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.093+0000 7f2d227fa740 1 -- 172.21.15.3:0/965849750 wait complete. 2024-09-19T06:22:47.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.093+0000 7f2d227fa740 1 -- start start 2024-09-19T06:22:47.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.093+0000 7f2d227fa740 1 Processor -- start 2024-09-19T06:22:47.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.094+0000 7f2d227fa740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557720896d50 0x5577208aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:47.097 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.094+0000 7f2d227fa740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720897670 0x5577208a56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:47.097 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.094+0000 7f2d227fa740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577208a1f30 0x5577208a5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:47.097 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.094+0000 7f2d227fa740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2d181b51f0 con 0x557720897670 2024-09-19T06:22:47.097 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.094+0000 7f2d227fa740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2d181b4b20 con 0x557720896d50 2024-09-19T06:22:47.097 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.094+0000 7f2d227fa740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2d181b1d80 con 0x5577208a1f30 2024-09-19T06:22:47.097 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.094+0000 7f2d227fa740 10 client.0 _ll_register_callbacks cb 0x7f2d040d3720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:47.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.094+0000 7f2d17e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720897670 0x5577208a56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:47.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.094+0000 7f2d1d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557720896d50 0x5577208aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:47.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.094+0000 7f2d1dc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577208a1f30 0x5577208a5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:47.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.094+0000 7f2d17e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720897670 0x5577208a56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59194/0 (socket says 172.21.15.3:59194) 2024-09-19T06:22:47.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.094+0000 7f2d17e00640 1 -- 172.21.15.3:0/3004110804 learned_addr learned my addr 172.21.15.3:0/3004110804 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:47.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.095+0000 7f2d1d200640 1 -- 172.21.15.3:0/3004110804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577208a1f30 msgr2=0x5577208a5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:47.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.095+0000 7f2d1d200640 1 --2- 172.21.15.3:0/3004110804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577208a1f30 0x5577208a5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.095+0000 7f2d1d200640 1 -- 172.21.15.3:0/3004110804 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720897670 msgr2=0x5577208a56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:47.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.095+0000 7f2d1d200640 1 --2- 172.21.15.3:0/3004110804 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720897670 0x5577208a56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.095+0000 7f2d1d200640 1 -- 172.21.15.3:0/3004110804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577208a6150 con 0x557720896d50 2024-09-19T06:22:47.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.095+0000 7f2d17e00640 1 --2- 172.21.15.3:0/3004110804 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720897670 0x5577208a56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:47.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.095+0000 7f2d1dc00640 1 --2- 172.21.15.3:0/3004110804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577208a1f30 0x5577208a5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:47.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.095+0000 7f2d1d200640 1 --2- 172.21.15.3:0/3004110804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557720896d50 0x5577208aa3a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c01e980 tx=0x7f2d0c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc204051223fbe58 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:47.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.095+0000 7f2cfea00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:22:47.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.095+0000 7f2cfea00640 1 -- 172.21.15.3:0/3004110804 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c02d4d0 con 0x557720896d50 2024-09-19T06:22:47.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.095+0000 7f2cfea00640 1 -- 172.21.15.3:0/3004110804 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f2d0c02d670 con 0x557720896d50 2024-09-19T06:22:47.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.095+0000 7f2d227fa740 1 -- 172.21.15.3:0/3004110804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d040a0600 con 0x557720896d50 2024-09-19T06:22:47.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.096+0000 7f2cfea00640 1 -- 172.21.15.3:0/3004110804 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2d0c042050 con 0x557720896d50 2024-09-19T06:22:47.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.096+0000 7f2d227fa740 10 client.28307 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:47.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.096+0000 7f2d227fa740 1 -- 172.21.15.3:0/3004110804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55772091c780 con 0x557720896d50 2024-09-19T06:22:47.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.096+0000 7f2cfea00640 1 -- 172.21.15.3:0/3004110804 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d040a0600 con 0x557720896d50 2024-09-19T06:22:47.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.097+0000 7f2cfea00640 1 -- 172.21.15.3:0/3004110804 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2d0c034b30 con 0x557720896d50 2024-09-19T06:22:47.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.097+0000 7f2d227fa740 10 client.28307 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:47.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.097+0000 7f2d227fa740 10 client.28307 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:47.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.097+0000 7f2d227fa740 20 client.28307 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:47.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.097+0000 7f2d227fa740 1 --2- 172.21.15.3:0/3004110804 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55772091cf00 0x55772091f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:47.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.097+0000 7f2d227fa740 4 client.28307 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:22:47.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.097+0000 7f2d227fa740 1 -- 172.21.15.3:0/3004110804 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557720804e60 con 0x55772091cf00 2024-09-19T06:22:47.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.097+0000 7f2d17e00640 1 --2- 172.21.15.3:0/3004110804 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55772091cf00 0x55772091f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:47.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.098+0000 7f2d17e00640 1 --2- 172.21.15.3:0/3004110804 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55772091cf00 0x55772091f320 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=133e5cda798afc0d server_cookie=1a96116d7a4c6f13 in_seq=0 out_seq=0 2024-09-19T06:22:47.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.098+0000 7f2cfea00640 10 client.28307 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:47.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.098+0000 7f2cfea00640 1 -- 172.21.15.3:0/3004110804 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557720804e60 con 0x55772091cf00 2024-09-19T06:22:47.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.098+0000 7f2cfea00640 10 client.28307 handle_command_reply: tid=0 2024-09-19T06:22:47.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.098+0000 7f2d227fa740 1 client.28307 shutdown 2024-09-19T06:22:47.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.098+0000 7f2d227fa740 1 -- 172.21.15.3:0/3004110804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557720896d50 msgr2=0x5577208aa3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:47.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.098+0000 7f2d227fa740 1 --2- 172.21.15.3:0/3004110804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557720896d50 0x5577208aa3a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c01e980 tx=0x7f2d0c004730 comp rx=0 tx=0).stop 2024-09-19T06:22:47.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.098+0000 7f2d227fa740 1 -- 172.21.15.3:0/3004110804 shutdown_connections 2024-09-19T06:22:47.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.098+0000 7f2d227fa740 1 --2- 172.21.15.3:0/3004110804 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55772091cf00 0x55772091f320 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.098+0000 7f2d227fa740 1 --2- 172.21.15.3:0/3004110804 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5577208a1f30 0x5577208a5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.098+0000 7f2d227fa740 1 --2- 172.21.15.3:0/3004110804 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557720897670 0x5577208a56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.098+0000 7f2d227fa740 1 --2- 172.21.15.3:0/3004110804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557720896d50 0x5577208aa3a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.098+0000 7f2d227fa740 1 -- 172.21.15.3:0/3004110804 >> 172.21.15.3:0/3004110804 conn(0x5577208932e0 msgr2=0x557720899010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:47.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.098+0000 7f2cfea00640 0 client.28307 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:47.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.099+0000 7f2d227fa740 1 -- 172.21.15.3:0/3004110804 shutdown_connections 2024-09-19T06:22:47.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.099+0000 7f2d227fa740 1 -- 172.21.15.3:0/3004110804 wait complete. 2024-09-19T06:22:47.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.099+0000 7f2d227fa740 20 client.28307 trim_cache size 0 max 16384 2024-09-19T06:22:47.103 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:22:47.103 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "no active scrubs running", 2024-09-19T06:22:47.104 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": {} 2024-09-19T06:22:47.104 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:22:47.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.099+0000 7f2d1e600640 1 -- 172.21.15.3:0/2863003827 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2d000a3430 msgr2=0x7f2d000a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:47.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.099+0000 7f2d1e600640 1 --2- 172.21.15.3:0/2863003827 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2d000a3430 0x7f2d000a58f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x557720894140 tx=0x7f2d0c005f90 comp rx=0 tx=0).stop 2024-09-19T06:22:47.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.099+0000 7f2d1e600640 1 -- 172.21.15.3:0/2863003827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d18074e30 msgr2=0x7f2d18101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:47.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.099+0000 7f2d1e600640 1 --2- 172.21.15.3:0/2863003827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d18074e30 0x7f2d18101ee0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400ea50 tx=0x7f2d0400ef10 comp rx=0 tx=0).stop 2024-09-19T06:22:47.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.100+0000 7f2d1e600640 1 -- 172.21.15.3:0/2863003827 shutdown_connections 2024-09-19T06:22:47.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.100+0000 7f2d1e600640 1 --2- 172.21.15.3:0/2863003827 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2d000a3430 0x7f2d000a58f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.100+0000 7f2d1e600640 1 --2- 172.21.15.3:0/2863003827 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d1810e280 0x7f2d18102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.100+0000 7f2d1e600640 1 --2- 172.21.15.3:0/2863003827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d18074e30 0x7f2d18101ee0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.100+0000 7f2d1e600640 1 --2- 172.21.15.3:0/2863003827 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2d18074510 0x7f2d181019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:47.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.100+0000 7f2d1e600640 1 -- 172.21.15.3:0/2863003827 >> 172.21.15.3:0/2863003827 conn(0x7f2d180fd740 msgr2=0x7f2d180fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:47.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.100+0000 7f2d1e600640 1 -- 172.21.15.3:0/2863003827 shutdown_connections 2024-09-19T06:22:47.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:47.100+0000 7f2d1e600640 1 -- 172.21.15.3:0/2863003827 wait complete. 2024-09-19T06:22:47.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:47 smithi059 ceph-mon[35138]: pgmap v323: 97 pgs: 97 active+clean; 4.4 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-19T06:22:47.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:47 smithi003 ceph-mon[30893]: pgmap v323: 97 pgs: 97 active+clean; 4.4 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-19T06:22:47.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:47 smithi071 ceph-mon[35662]: pgmap v323: 97 pgs: 97 active+clean; 4.4 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-19T06:22:48.034 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:22:48.035 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:22:48.444 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:49.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.104+0000 7fbc2b200640 1 -- 172.21.15.3:0/1480995229 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc2c102360 msgr2=0x7fbc2c10e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:49.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.104+0000 7fbc2b200640 1 --2- 172.21.15.3:0/1480995229 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc2c102360 0x7fbc2c10e890 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fbc24009cd0 tx=0x7fbc2402a8e0 comp rx=0 tx=0).stop 2024-09-19T06:22:49.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.104+0000 7fbc2b200640 1 -- 172.21.15.3:0/1480995229 shutdown_connections 2024-09-19T06:22:49.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.104+0000 7fbc2b200640 1 --2- 172.21.15.3:0/1480995229 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc2c102360 0x7fbc2c10e890 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:49.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.104+0000 7fbc2b200640 1 --2- 172.21.15.3:0/1480995229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2c1019c0 0x7fbc2c101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:49.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.104+0000 7fbc2b200640 1 --2- 172.21.15.3:0/1480995229 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc2c1079c0 0x7fbc2c107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:49.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.104+0000 7fbc2b200640 1 -- 172.21.15.3:0/1480995229 >> 172.21.15.3:0/1480995229 conn(0x7fbc2c0fd740 msgr2=0x7fbc2c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:49.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.104+0000 7fbc2b200640 1 -- 172.21.15.3:0/1480995229 shutdown_connections 2024-09-19T06:22:49.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.104+0000 7fbc2b200640 1 -- 172.21.15.3:0/1480995229 wait complete. 2024-09-19T06:22:49.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.105+0000 7fbc2b200640 1 Processor -- start 2024-09-19T06:22:49.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.105+0000 7fbc2b200640 1 -- start start 2024-09-19T06:22:49.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.106+0000 7fbc2b200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc2c1019c0 0x7fbc2c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:49.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.106+0000 7fbc2b200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2c102360 0x7fbc2c19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:49.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.106+0000 7fbc2b200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc2c1079c0 0x7fbc2c19ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:49.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.106+0000 7fbc2b200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2c111e10 con 0x7fbc2c1079c0 2024-09-19T06:22:49.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.106+0000 7fbc2b200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2c111c90 con 0x7fbc2c102360 2024-09-19T06:22:49.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.106+0000 7fbc2b200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2c111f90 con 0x7fbc2c1019c0 2024-09-19T06:22:49.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.106+0000 7fbc2a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc2c1079c0 0x7fbc2c19ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:49.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.106+0000 7fbc29e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc2c1019c0 0x7fbc2c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:49.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.106+0000 7fbc29400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2c102360 0x7fbc2c19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:49.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.106+0000 7fbc29e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc2c1019c0 0x7fbc2c19a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:59014/0 (socket says 172.21.15.3:59014) 2024-09-19T06:22:49.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.106+0000 7fbc2a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc2c1079c0 0x7fbc2c19ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59212/0 (socket says 172.21.15.3:59212) 2024-09-19T06:22:49.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.106+0000 7fbc29e00640 1 -- 172.21.15.3:0/4007619968 learned_addr learned my addr 172.21.15.3:0/4007619968 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:49.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.106+0000 7fbc29400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2c102360 0x7fbc2c19a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:50302/0 (socket says 172.21.15.3:50302) 2024-09-19T06:22:49.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.107+0000 7fbc29400640 1 -- 172.21.15.3:0/4007619968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc2c1019c0 msgr2=0x7fbc2c19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:49.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.107+0000 7fbc29400640 1 --2- 172.21.15.3:0/4007619968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc2c1019c0 0x7fbc2c19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:49.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.107+0000 7fbc29400640 1 -- 172.21.15.3:0/4007619968 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc2c1079c0 msgr2=0x7fbc2c19ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:49.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.107+0000 7fbc29400640 1 --2- 172.21.15.3:0/4007619968 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc2c1079c0 0x7fbc2c19ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:49.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.107+0000 7fbc29400640 1 -- 172.21.15.3:0/4007619968 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2c19f450 con 0x7fbc2c102360 2024-09-19T06:22:49.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.107+0000 7fbc2a800640 1 --2- 172.21.15.3:0/4007619968 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc2c1079c0 0x7fbc2c19ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:49.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.107+0000 7fbc29400640 1 --2- 172.21.15.3:0/4007619968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2c102360 0x7fbc2c19a9e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800e9f0 tx=0x7fbc1800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:49.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.107+0000 7fbc22a00640 1 -- 172.21.15.3:0/4007619968 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1800cd80 con 0x7fbc2c102360 2024-09-19T06:22:49.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.107+0000 7fbc22a00640 1 -- 172.21.15.3:0/4007619968 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc180035f0 con 0x7fbc2c102360 2024-09-19T06:22:49.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.107+0000 7fbc2b200640 1 -- 172.21.15.3:0/4007619968 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc2c19f740 con 0x7fbc2c102360 2024-09-19T06:22:49.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.108+0000 7fbc22a00640 1 -- 172.21.15.3:0/4007619968 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc18010690 con 0x7fbc2c102360 2024-09-19T06:22:49.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.108+0000 7fbc2b200640 1 -- 172.21.15.3:0/4007619968 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc2c1a7020 con 0x7fbc2c102360 2024-09-19T06:22:49.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.109+0000 7fbc2b200640 1 -- 172.21.15.3:0/4007619968 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc2c101e20 con 0x7fbc2c102360 2024-09-19T06:22:49.113 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.112+0000 7fbc22a00640 1 -- 172.21.15.3:0/4007619968 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fbc18003b30 con 0x7fbc2c102360 2024-09-19T06:22:49.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.113+0000 7fbc22a00640 1 --2- 172.21.15.3:0/4007619968 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbc100a33b0 0x7fbc100a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:49.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.113+0000 7fbc22a00640 1 -- 172.21.15.3:0/4007619968 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7fbc180d02b0 con 0x7fbc2c102360 2024-09-19T06:22:49.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.113+0000 7fbc29e00640 1 --2- 172.21.15.3:0/4007619968 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbc100a33b0 0x7fbc100a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:49.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.114+0000 7fbc29e00640 1 --2- 172.21.15.3:0/4007619968 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbc100a33b0 0x7fbc100a5870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c009c50 tx=0x7fbc1c005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:49.116 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.114+0000 7fbc22a00640 1 -- 172.21.15.3:0/4007619968 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbc1809cc00 con 0x7fbc2c102360 2024-09-19T06:22:49.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.346+0000 7fbc2b200640 1 -- 172.21.15.3:0/4007619968 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc2c19b800 con 0x7fbc2c102360 2024-09-19T06:22:49.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.347+0000 7fbc22a00640 1 -- 172.21.15.3:0/4007619968 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7fbc2c19b800 con 0x7fbc2c102360 2024-09-19T06:22:49.349 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:22:49.350 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"btime":"2024-09-19T06:12:22:958217+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:12:22.060987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24532,24515,24514,14517]},"id":1}]} 2024-09-19T06:22:49.350 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2024-09-19T06:22:49.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.349+0000 7fbc2b200640 1 -- 172.21.15.3:0/4007619968 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbc100a33b0 msgr2=0x7fbc100a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:49.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.349+0000 7fbc2b200640 1 --2- 172.21.15.3:0/4007619968 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbc100a33b0 0x7fbc100a5870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c009c50 tx=0x7fbc1c005f90 comp rx=0 tx=0).stop 2024-09-19T06:22:49.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.349+0000 7fbc2b200640 1 -- 172.21.15.3:0/4007619968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2c102360 msgr2=0x7fbc2c19a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:49.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.349+0000 7fbc2b200640 1 --2- 172.21.15.3:0/4007619968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2c102360 0x7fbc2c19a9e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800e9f0 tx=0x7fbc1800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:22:49.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.350+0000 7fbc2b200640 1 -- 172.21.15.3:0/4007619968 shutdown_connections 2024-09-19T06:22:49.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.350+0000 7fbc2b200640 1 --2- 172.21.15.3:0/4007619968 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fbc100a33b0 0x7fbc100a5870 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:49.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.350+0000 7fbc2b200640 1 --2- 172.21.15.3:0/4007619968 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbc2c1079c0 0x7fbc2c19ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:49.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.350+0000 7fbc2b200640 1 --2- 172.21.15.3:0/4007619968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2c102360 0x7fbc2c19a9e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:49.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.350+0000 7fbc2b200640 1 --2- 172.21.15.3:0/4007619968 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fbc2c1019c0 0x7fbc2c19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:49.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.350+0000 7fbc2b200640 1 -- 172.21.15.3:0/4007619968 >> 172.21.15.3:0/4007619968 conn(0x7fbc2c0fd740 msgr2=0x7fbc2c0fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:49.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.350+0000 7fbc2b200640 1 -- 172.21.15.3:0/4007619968 shutdown_connections 2024-09-19T06:22:49.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:49.350+0000 7fbc2b200640 1 -- 172.21.15.3:0/4007619968 wait complete. 2024-09-19T06:22:49.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:49 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:49.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:49 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:49.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:49 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:49.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:49 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:49.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:49 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:49.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:49 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:49.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:49 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:22:49.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:49 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:22:49.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:49 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:49.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:49 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:49.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:49 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:49.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:49 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:49.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:49 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:49.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:49 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:49.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:49 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:49.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:49 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:22:49.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:49 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:22:49.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:49 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:49.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:49 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:49.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:49 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:49.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:49 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:49.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:49 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:49.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:49 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:49.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:49 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:22:49.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:49 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:22:49.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:49 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:22:49.789 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:49 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:22:50.500 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:22:50.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:50 smithi003 ceph-mon[30893]: pgmap v324: 97 pgs: 97 active+clean; 4.7 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 23 op/s 2024-09-19T06:22:50.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:50 smithi003 ceph-mon[30893]: Adjusting osd_memory_target on smithi003 to 177.5M 2024-09-19T06:22:50.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:50 smithi003 ceph-mon[30893]: Unable to set osd_memory_target on smithi003 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-19T06:22:50.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:50 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/4007619968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:22:50.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:50 smithi071 ceph-mon[35662]: pgmap v324: 97 pgs: 97 active+clean; 4.7 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 23 op/s 2024-09-19T06:22:50.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:50 smithi071 ceph-mon[35662]: Adjusting osd_memory_target on smithi003 to 177.5M 2024-09-19T06:22:50.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:50 smithi071 ceph-mon[35662]: Unable to set osd_memory_target on smithi003 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-19T06:22:50.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:50 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/4007619968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:22:50.689 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:50 smithi059 ceph-mon[35138]: pgmap v324: 97 pgs: 97 active+clean; 4.7 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 23 op/s 2024-09-19T06:22:50.690 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:50 smithi059 ceph-mon[35138]: Adjusting osd_memory_target on smithi003 to 177.5M 2024-09-19T06:22:50.690 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:50 smithi059 ceph-mon[35138]: Unable to set osd_memory_target on smithi003 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-19T06:22:50.690 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:50 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/4007619968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:22:50.887 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:51.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.514+0000 7fb038000640 1 -- 172.21.15.3:0/1767382462 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb030077040 msgr2=0x7fb0301124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:51.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.514+0000 7fb038000640 1 --2- 172.21.15.3:0/1767382462 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb030077040 0x7fb0301124f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fb01c009900 tx=0x7fb01c02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.514+0000 7fb038000640 1 -- 172.21.15.3:0/1767382462 shutdown_connections 2024-09-19T06:22:51.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.514+0000 7fb038000640 1 --2- 172.21.15.3:0/1767382462 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb030112a30 0x7fb030114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.514+0000 7fb038000640 1 --2- 172.21.15.3:0/1767382462 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb030077040 0x7fb0301124f0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.514+0000 7fb038000640 1 --2- 172.21.15.3:0/1767382462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb030076720 0x7fb030076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.514+0000 7fb038000640 1 -- 172.21.15.3:0/1767382462 >> 172.21.15.3:0/1767382462 conn(0x7fb0300ffa90 msgr2=0x7fb030101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:51.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.514+0000 7fb038000640 1 -- 172.21.15.3:0/1767382462 shutdown_connections 2024-09-19T06:22:51.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.514+0000 7fb038000640 1 -- 172.21.15.3:0/1767382462 wait complete. 2024-09-19T06:22:51.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.515+0000 7fb038000640 1 Processor -- start 2024-09-19T06:22:51.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.515+0000 7fb038000640 1 -- start start 2024-09-19T06:22:51.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.516+0000 7fb038000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb030076720 0x7fb0301a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:51.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.516+0000 7fb038000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb030077040 0x7fb0301a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:51.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.516+0000 7fb038000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb030112a30 0x7fb03019e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:51.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.516+0000 7fb038000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb0301185b0 con 0x7fb030076720 2024-09-19T06:22:51.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.516+0000 7fb038000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb030118430 con 0x7fb030112a30 2024-09-19T06:22:51.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.516+0000 7fb038000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb030118730 con 0x7fb030077040 2024-09-19T06:22:51.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.516+0000 7fb035600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb030076720 0x7fb0301a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:51.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.516+0000 7fb035600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb030076720 0x7fb0301a4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59230/0 (socket says 172.21.15.3:59230) 2024-09-19T06:22:51.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.516+0000 7fb035600640 1 -- 172.21.15.3:0/279495919 learned_addr learned my addr 172.21.15.3:0/279495919 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:51.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.516+0000 7fb034c00640 1 --2- 172.21.15.3:0/279495919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb030077040 0x7fb0301a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:51.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.516+0000 7fb036000640 1 --2- 172.21.15.3:0/279495919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb030112a30 0x7fb03019e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:51.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.516+0000 7fb035600640 1 -- 172.21.15.3:0/279495919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb030077040 msgr2=0x7fb0301a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:51.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.516+0000 7fb035600640 1 --2- 172.21.15.3:0/279495919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb030077040 0x7fb0301a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.516+0000 7fb035600640 1 -- 172.21.15.3:0/279495919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb030112a30 msgr2=0x7fb03019e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:51.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.516+0000 7fb035600640 1 --2- 172.21.15.3:0/279495919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb030112a30 0x7fb03019e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.516+0000 7fb035600640 1 -- 172.21.15.3:0/279495919 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb03019eff0 con 0x7fb030076720 2024-09-19T06:22:51.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.517+0000 7fb035600640 1 --2- 172.21.15.3:0/279495919 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb030076720 0x7fb0301a4700 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fb02400e9f0 tx=0x7fb02400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:51.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.517+0000 7fb02e000640 1 -- 172.21.15.3:0/279495919 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02400cd80 con 0x7fb030076720 2024-09-19T06:22:51.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.517+0000 7fb02e000640 1 -- 172.21.15.3:0/279495919 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb024010910 con 0x7fb030076720 2024-09-19T06:22:51.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.517+0000 7fb038000640 1 -- 172.21.15.3:0/279495919 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb03019f2e0 con 0x7fb030076720 2024-09-19T06:22:51.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.517+0000 7fb02e000640 1 -- 172.21.15.3:0/279495919 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb024018990 con 0x7fb030076720 2024-09-19T06:22:51.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.517+0000 7fb038000640 1 -- 172.21.15.3:0/279495919 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0301ab5d0 con 0x7fb030076720 2024-09-19T06:22:51.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.521+0000 7fb03aa5e740 1 Processor -- start 2024-09-19T06:22:51.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.522+0000 7fb02e000640 1 -- 172.21.15.3:0/279495919 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fb024010ac0 con 0x7fb030076720 2024-09-19T06:22:51.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.522+0000 7fb03aa5e740 1 -- start start 2024-09-19T06:22:51.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.522+0000 7fb03aa5e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f918ec70 0x5647f918f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:51.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.522+0000 7fb03aa5e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647f918f590 0x5647f9199910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:51.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.522+0000 7fb03aa5e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f9199e50 0x5647f919c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:51.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.522+0000 7fb03aa5e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5647f90f53e0 con 0x5647f9199e50 2024-09-19T06:22:51.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.522+0000 7fb03aa5e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5647f909cd80 con 0x5647f918ec70 2024-09-19T06:22:51.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.522+0000 7fb03aa5e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5647f90f13a0 con 0x5647f918f590 2024-09-19T06:22:51.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.522+0000 7fb034c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f9199e50 0x5647f919c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:51.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.522+0000 7fb036000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f918ec70 0x5647f918f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:51.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.522+0000 7fb035600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647f918f590 0x5647f9199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:51.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.522+0000 7fb036000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f918ec70 0x5647f918f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:50324/0 (socket says 172.21.15.3:50324) 2024-09-19T06:22:51.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.522+0000 7fb036000640 1 -- 172.21.15.3:0/1750112342 learned_addr learned my addr 172.21.15.3:0/1750112342 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:51.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.523+0000 7fb036000640 1 -- 172.21.15.3:0/1750112342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647f918f590 msgr2=0x5647f9199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.523+0000 7fb036000640 1 --2- 172.21.15.3:0/1750112342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647f918f590 0x5647f9199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.523+0000 7fb036000640 1 -- 172.21.15.3:0/1750112342 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f9199e50 msgr2=0x5647f919c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.523+0000 7fb036000640 1 --2- 172.21.15.3:0/1750112342 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f9199e50 0x5647f919c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.523+0000 7fb036000640 1 -- 172.21.15.3:0/1750112342 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647f90bbae0 con 0x5647f918ec70 2024-09-19T06:22:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.523+0000 7fb036000640 1 --2- 172.21.15.3:0/1750112342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f918ec70 0x5647f918f050 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb028009f30 tx=0x7fb0280118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a35beda3432fcedf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.523+0000 7fb02e000640 1 --2- 172.21.15.3:0/279495919 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb0180a3430 0x7fb0180a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.523+0000 7fb022600640 1 -- 172.21.15.3:0/1750112342 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028004d20 con 0x5647f918ec70 2024-09-19T06:22:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.524+0000 7fb022600640 1 -- 172.21.15.3:0/1750112342 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb028004050 con 0x5647f918ec70 2024-09-19T06:22:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.524+0000 7fb022600640 1 -- 172.21.15.3:0/1750112342 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028005260 con 0x5647f918ec70 2024-09-19T06:22:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.524+0000 7fb02e000640 1 -- 172.21.15.3:0/279495919 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7fb0240cffe0 con 0x7fb030076720 2024-09-19T06:22:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.524+0000 7fb035600640 1 --2- 172.21.15.3:0/279495919 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb0180a3430 0x7fb0180a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:51.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.524+0000 7fb03aa5e740 1 -- 172.21.15.3:0/1750112342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f918ec70 msgr2=0x5647f918f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:51.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.524+0000 7fb03aa5e740 1 --2- 172.21.15.3:0/1750112342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f918ec70 0x5647f918f050 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb028009f30 tx=0x7fb0280118d0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.524+0000 7fb035600640 1 --2- 172.21.15.3:0/279495919 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb0180a3430 0x7fb0180a58f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x5647f918c060 tx=0x7fb0240d3ad0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:51.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.524+0000 7fb03aa5e740 1 -- 172.21.15.3:0/1750112342 shutdown_connections 2024-09-19T06:22:51.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.524+0000 7fb03aa5e740 1 --2- 172.21.15.3:0/1750112342 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f9199e50 0x5647f919c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.524+0000 7fb03aa5e740 1 --2- 172.21.15.3:0/1750112342 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647f918f590 0x5647f9199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.524+0000 7fb03aa5e740 1 --2- 172.21.15.3:0/1750112342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f918ec70 0x5647f918f050 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.525+0000 7fb03aa5e740 1 -- 172.21.15.3:0/1750112342 >> 172.21.15.3:0/1750112342 conn(0x5647f918b200 msgr2=0x5647f918b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:51.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.525+0000 7fb03aa5e740 1 -- 172.21.15.3:0/1750112342 shutdown_connections 2024-09-19T06:22:51.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.525+0000 7fb03aa5e740 1 -- 172.21.15.3:0/1750112342 wait complete. 2024-09-19T06:22:51.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.525+0000 7fb03aa5e740 1 -- start start 2024-09-19T06:22:51.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.525+0000 7fb03aa5e740 1 Processor -- start 2024-09-19T06:22:51.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.526+0000 7fb03aa5e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647f918ec70 0x5647f9196d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:51.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.526+0000 7fb03aa5e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f918f590 0x5647f9197260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:51.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.526+0000 7fb03aa5e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f9199e50 0x5647f91977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:51.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.526+0000 7fb03aa5e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5647f919ca20 con 0x5647f918f590 2024-09-19T06:22:51.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.526+0000 7fb03aa5e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5647f90b00f0 con 0x5647f9199e50 2024-09-19T06:22:51.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.526+0000 7fb03aa5e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5647f919cba0 con 0x5647f918ec70 2024-09-19T06:22:51.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.526+0000 7fb03aa5e740 10 client.0 _ll_register_callbacks cb 0x5647f9097bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:51.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.526+0000 7fb034c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f918f590 0x5647f9197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:51.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.526+0000 7fb034c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f918f590 0x5647f9197260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59238/0 (socket says 172.21.15.3:59238) 2024-09-19T06:22:51.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.526+0000 7fb034c00640 1 -- 172.21.15.3:0/3217705662 learned_addr learned my addr 172.21.15.3:0/3217705662 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:51.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.526+0000 7fb036000640 1 --2- 172.21.15.3:0/3217705662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647f918ec70 0x5647f9196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.526+0000 7fb036000640 1 --2- 172.21.15.3:0/3217705662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f9199e50 0x5647f91977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.527+0000 7fb034c00640 1 -- 172.21.15.3:0/3217705662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647f918ec70 msgr2=0x5647f9196d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.527+0000 7fb034c00640 1 --2- 172.21.15.3:0/3217705662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647f918ec70 0x5647f9196d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.527+0000 7fb034c00640 1 -- 172.21.15.3:0/3217705662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f9199e50 msgr2=0x5647f91977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.527+0000 7fb034c00640 1 --2- 172.21.15.3:0/3217705662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f9199e50 0x5647f91977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.527+0000 7fb034c00640 1 -- 172.21.15.3:0/3217705662 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647f8e663c0 con 0x5647f918f590 2024-09-19T06:22:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.527+0000 7fb036000640 1 --2- 172.21.15.3:0/3217705662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f9199e50 0x5647f91977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.527+0000 7fb034c00640 1 --2- 172.21.15.3:0/3217705662 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f918f590 0x5647f9197260 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb01c009900 tx=0x7fb01c0317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2cc0a697879f60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.527+0000 7fb016a00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:22:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.527+0000 7fb016a00640 1 -- 172.21.15.3:0/3217705662 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c035040 con 0x5647f918f590 2024-09-19T06:22:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.527+0000 7fb016a00640 1 -- 172.21.15.3:0/3217705662 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7fb01c004460 con 0x5647f918f590 2024-09-19T06:22:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.527+0000 7fb03aa5e740 1 -- 172.21.15.3:0/3217705662 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb028004050 con 0x5647f918f590 2024-09-19T06:22:51.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.528+0000 7fb016a00640 1 -- 172.21.15.3:0/3217705662 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb01c005020 con 0x5647f918f590 2024-09-19T06:22:51.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.528+0000 7fb03aa5e740 10 client.18291 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:51.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.528+0000 7fb03aa5e740 1 -- 172.21.15.3:0/3217705662 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5647f91a8a40 con 0x5647f918f590 2024-09-19T06:22:51.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.528+0000 7fb016a00640 1 -- 172.21.15.3:0/3217705662 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb028004050 con 0x5647f918f590 2024-09-19T06:22:51.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.528+0000 7fb016a00640 1 -- 172.21.15.3:0/3217705662 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb01c0035f0 con 0x5647f918f590 2024-09-19T06:22:51.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.528+0000 7fb03aa5e740 10 client.18291 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:51.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.528+0000 7fb03aa5e740 10 client.18291 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:22:51.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.528+0000 7fb03aa5e740 20 client.18291 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:51.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.528+0000 7fb03aa5e740 1 --2- 172.21.15.3:0/3217705662 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5647f91a9f50 0x5647f91ac370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:51.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.528+0000 7fb03aa5e740 4 client.18291 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:51.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.528+0000 7fb03aa5e740 1 -- 172.21.15.3:0/3217705662 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647f9102950 con 0x5647f91a9f50 2024-09-19T06:22:51.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.529+0000 7fb036000640 1 --2- 172.21.15.3:0/3217705662 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5647f91a9f50 0x5647f91ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:51.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.529+0000 7fb036000640 1 --2- 172.21.15.3:0/3217705662 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5647f91a9f50 0x5647f91ac370 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a1e0bbf6cb282bfd server_cookie=729c0a9b7a8a6141 in_seq=0 out_seq=0 2024-09-19T06:22:51.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.529+0000 7fb016a00640 10 client.18291 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:22:51.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.530+0000 7fb016a00640 1 -- 172.21.15.3:0/3217705662 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5647f9102950 con 0x5647f91a9f50 2024-09-19T06:22:51.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.530+0000 7fb016a00640 10 client.18291 handle_command_reply: tid=0 2024-09-19T06:22:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.530+0000 7fb03aa5e740 1 client.18291 shutdown 2024-09-19T06:22:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.530+0000 7fb03aa5e740 1 -- 172.21.15.3:0/3217705662 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f918f590 msgr2=0x5647f9197260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.530+0000 7fb03aa5e740 1 --2- 172.21.15.3:0/3217705662 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f918f590 0x5647f9197260 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb01c009900 tx=0x7fb01c0317e0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.530+0000 7fb03aa5e740 1 -- 172.21.15.3:0/3217705662 shutdown_connections 2024-09-19T06:22:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.530+0000 7fb03aa5e740 1 --2- 172.21.15.3:0/3217705662 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5647f91a9f50 0x5647f91ac370 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.530+0000 7fb03aa5e740 1 --2- 172.21.15.3:0/3217705662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f9199e50 0x5647f91977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.530+0000 7fb03aa5e740 1 --2- 172.21.15.3:0/3217705662 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f918f590 0x5647f9197260 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.530+0000 7fb03aa5e740 1 --2- 172.21.15.3:0/3217705662 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647f918ec70 0x5647f9196d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.530+0000 7fb016a00640 0 client.18291 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:22:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.530+0000 7fb03aa5e740 1 -- 172.21.15.3:0/3217705662 >> 172.21.15.3:0/3217705662 conn(0x5647f918b200 msgr2=0x5647f918a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.530+0000 7fb03aa5e740 1 -- 172.21.15.3:0/3217705662 shutdown_connections 2024-09-19T06:22:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.530+0000 7fb03aa5e740 1 -- 172.21.15.3:0/3217705662 wait complete. 2024-09-19T06:22:51.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.530+0000 7fb03aa5e740 20 client.18291 trim_cache size 0 max 16384 2024-09-19T06:22:51.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.544+0000 7fb03aa5e740 1 Processor -- start 2024-09-19T06:22:51.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.544+0000 7fb03aa5e740 1 -- start start 2024-09-19T06:22:51.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.545+0000 7fb03aa5e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647f918ec70 0x5647f91975f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:51.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.545+0000 7fb03aa5e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f918f590 0x5647f91b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:51.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.545+0000 7fb03aa5e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f9199e50 0x5647f91b2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:51.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.545+0000 7fb03aa5e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb0301b3f40 con 0x5647f9199e50 2024-09-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.545+0000 7fb03aa5e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb0301b5a80 con 0x5647f918f590 2024-09-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.545+0000 7fb03aa5e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb0301b4610 con 0x5647f918ec70 2024-09-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.545+0000 7fb036000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f9199e50 0x5647f91b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.545+0000 7fb034c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f918f590 0x5647f91b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.545+0000 7fb036000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f9199e50 0x5647f91b2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59252/0 (socket says 172.21.15.3:59252) 2024-09-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.545+0000 7fb036000640 1 -- 172.21.15.3:0/1612617233 learned_addr learned my addr 172.21.15.3:0/1612617233 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.545+0000 7fb036000640 1 --2- 172.21.15.3:0/1612617233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647f918ec70 0x5647f91975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.546+0000 7fb034c00640 1 -- 172.21.15.3:0/1612617233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647f918ec70 msgr2=0x5647f91975f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.546+0000 7fb034c00640 1 --2- 172.21.15.3:0/1612617233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647f918ec70 0x5647f91975f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.546+0000 7fb034c00640 1 -- 172.21.15.3:0/1612617233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f9199e50 msgr2=0x5647f91b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.546+0000 7fb034c00640 1 --2- 172.21.15.3:0/1612617233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f9199e50 0x5647f91b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.546+0000 7fb034c00640 1 -- 172.21.15.3:0/1612617233 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647f91ac9d0 con 0x5647f918f590 2024-09-19T06:22:51.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.546+0000 7fb036000640 1 --2- 172.21.15.3:0/1612617233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f9199e50 0x5647f91b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:51.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.546+0000 7fb034c00640 1 --2- 172.21.15.3:0/1612617233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f918f590 0x5647f91b1c20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb01c031550 tx=0x7fb01c02a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de499d49ecc7c9e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:51.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.546+0000 7fb021c00640 1 -- 172.21.15.3:0/1612617233 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c035030 con 0x5647f918f590 2024-09-19T06:22:51.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.547+0000 7fb021c00640 1 -- 172.21.15.3:0/1612617233 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb01c041070 con 0x5647f918f590 2024-09-19T06:22:51.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.547+0000 7fb021c00640 1 -- 172.21.15.3:0/1612617233 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c051070 con 0x5647f918f590 2024-09-19T06:22:51.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.547+0000 7fb03aa5e740 1 -- 172.21.15.3:0/1612617233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f918f590 msgr2=0x5647f91b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:51.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.547+0000 7fb03aa5e740 1 --2- 172.21.15.3:0/1612617233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f918f590 0x5647f91b1c20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb01c031550 tx=0x7fb01c02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.547+0000 7fb03aa5e740 1 -- 172.21.15.3:0/1612617233 shutdown_connections 2024-09-19T06:22:51.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.547+0000 7fb03aa5e740 1 --2- 172.21.15.3:0/1612617233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f9199e50 0x5647f91b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.547+0000 7fb03aa5e740 1 --2- 172.21.15.3:0/1612617233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f918f590 0x5647f91b1c20 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.547+0000 7fb03aa5e740 1 --2- 172.21.15.3:0/1612617233 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647f918ec70 0x5647f91975f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.547+0000 7fb03aa5e740 1 -- 172.21.15.3:0/1612617233 >> 172.21.15.3:0/1612617233 conn(0x5647f918b200 msgr2=0x5647f9198da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:51.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.548+0000 7fb03aa5e740 1 -- 172.21.15.3:0/1612617233 shutdown_connections 2024-09-19T06:22:51.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.548+0000 7fb03aa5e740 1 -- 172.21.15.3:0/1612617233 wait complete. 2024-09-19T06:22:51.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.548+0000 7fb03aa5e740 1 -- start start 2024-09-19T06:22:51.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.548+0000 7fb03aa5e740 1 Processor -- start 2024-09-19T06:22:51.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.549+0000 7fb03aa5e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f918ec70 0x5647f919da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:51.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.549+0000 7fb03aa5e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f918f590 0x5647f919dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:51.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.549+0000 7fb03aa5e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647f9199e50 0x5647f919e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:51.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.549+0000 7fb03aa5e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb0301b53b0 con 0x5647f918f590 2024-09-19T06:22:51.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.549+0000 7fb03aa5e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb0301b4ce0 con 0x5647f918ec70 2024-09-19T06:22:51.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.549+0000 7fb03aa5e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb0301b1f40 con 0x5647f9199e50 2024-09-19T06:22:51.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.549+0000 7fb03aa5e740 10 client.0 _ll_register_callbacks cb 0x7fb01c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:51.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.549+0000 7fb036000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f918ec70 0x5647f919da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:51.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.549+0000 7fb034c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f918f590 0x5647f919dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:51.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.549+0000 7fb036000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f918ec70 0x5647f919da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:50340/0 (socket says 172.21.15.3:50340) 2024-09-19T06:22:51.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.549+0000 7fb036000640 1 -- 172.21.15.3:0/349229485 learned_addr learned my addr 172.21.15.3:0/349229485 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:51.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.549+0000 7fb036000640 1 --2- 172.21.15.3:0/349229485 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647f9199e50 0x5647f919e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:51.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.549+0000 7fb036000640 1 -- 172.21.15.3:0/349229485 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647f9199e50 msgr2=0x5647f919e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:51.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.549+0000 7fb036000640 1 --2- 172.21.15.3:0/349229485 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647f9199e50 0x5647f919e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.550+0000 7fb036000640 1 -- 172.21.15.3:0/349229485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f918f590 msgr2=0x5647f919dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:51.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.550+0000 7fb036000640 1 --2- 172.21.15.3:0/349229485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f918f590 0x5647f919dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.550+0000 7fb036000640 1 -- 172.21.15.3:0/349229485 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647f9213bf0 con 0x5647f918ec70 2024-09-19T06:22:51.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.550+0000 7fb034c00640 1 --2- 172.21.15.3:0/349229485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f918f590 0x5647f919dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:51.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.550+0000 7fb036000640 1 --2- 172.21.15.3:0/349229485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f918ec70 0x5647f919da70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb028009f00 tx=0x7fb028009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8934965a1225dc4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:51.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.550+0000 7fb016a00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:22:51.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.550+0000 7fb016a00640 1 -- 172.21.15.3:0/349229485 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb028004540 con 0x5647f918ec70 2024-09-19T06:22:51.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.550+0000 7fb016a00640 1 -- 172.21.15.3:0/349229485 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7fb0280046e0 con 0x5647f918ec70 2024-09-19T06:22:51.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.550+0000 7fb03aa5e740 1 -- 172.21.15.3:0/349229485 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb01c041070 con 0x5647f918ec70 2024-09-19T06:22:51.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.550+0000 7fb016a00640 1 -- 172.21.15.3:0/349229485 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb028043050 con 0x5647f918ec70 2024-09-19T06:22:51.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.551+0000 7fb03aa5e740 10 client.28331 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:51.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.551+0000 7fb03aa5e740 1 -- 172.21.15.3:0/349229485 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5647f9214df0 con 0x5647f918ec70 2024-09-19T06:22:51.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.551+0000 7fb016a00640 1 -- 172.21.15.3:0/349229485 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb01c041070 con 0x5647f918ec70 2024-09-19T06:22:51.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.551+0000 7fb016a00640 1 -- 172.21.15.3:0/349229485 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb028025040 con 0x5647f918ec70 2024-09-19T06:22:51.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.551+0000 7fb03aa5e740 10 client.28331 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:51.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.551+0000 7fb03aa5e740 10 client.28331 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:22:51.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.551+0000 7fb03aa5e740 20 client.28331 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:51.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.551+0000 7fb03aa5e740 1 --2- 172.21.15.3:0/349229485 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5647f9215320 0x5647f9217710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:51.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.551+0000 7fb03aa5e740 4 client.28331 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:22:51.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.551+0000 7fb03aa5e740 1 -- 172.21.15.3:0/349229485 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5647f90fce60 con 0x5647f9215320 2024-09-19T06:22:51.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.552+0000 7fb034c00640 1 --2- 172.21.15.3:0/349229485 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5647f9215320 0x5647f9217710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:51.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.552+0000 7fb034c00640 1 --2- 172.21.15.3:0/349229485 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5647f9215320 0x5647f9217710 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bc24121c57b49fea server_cookie=6af2a5bd14f55594 in_seq=0 out_seq=0 2024-09-19T06:22:51.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.552+0000 7fb016a00640 10 client.28331 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:22:51.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.552+0000 7fb016a00640 1 -- 172.21.15.3:0/349229485 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5647f90fce60 con 0x5647f9215320 2024-09-19T06:22:51.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.552+0000 7fb016a00640 10 client.28331 handle_command_reply: tid=0 2024-09-19T06:22:51.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.553+0000 7fb03aa5e740 1 client.28331 shutdown 2024-09-19T06:22:51.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.553+0000 7fb03aa5e740 1 -- 172.21.15.3:0/349229485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f918ec70 msgr2=0x5647f919da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:51.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.553+0000 7fb03aa5e740 1 --2- 172.21.15.3:0/349229485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f918ec70 0x5647f919da70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb028009f00 tx=0x7fb028009500 comp rx=0 tx=0).stop 2024-09-19T06:22:51.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.553+0000 7fb03aa5e740 1 -- 172.21.15.3:0/349229485 shutdown_connections 2024-09-19T06:22:51.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.553+0000 7fb03aa5e740 1 --2- 172.21.15.3:0/349229485 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x5647f9215320 0x5647f9217710 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.553+0000 7fb03aa5e740 1 --2- 172.21.15.3:0/349229485 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5647f9199e50 0x5647f919e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.553+0000 7fb03aa5e740 1 --2- 172.21.15.3:0/349229485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5647f918f590 0x5647f919dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.553+0000 7fb03aa5e740 1 --2- 172.21.15.3:0/349229485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5647f918ec70 0x5647f919da70 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.553+0000 7fb016a00640 0 client.28331 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:22:51.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.553+0000 7fb03aa5e740 1 -- 172.21.15.3:0/349229485 >> 172.21.15.3:0/349229485 conn(0x5647f918b200 msgr2=0x5647f9189b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:51.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.553+0000 7fb03aa5e740 1 -- 172.21.15.3:0/349229485 shutdown_connections 2024-09-19T06:22:51.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.553+0000 7fb03aa5e740 1 -- 172.21.15.3:0/349229485 wait complete. 2024-09-19T06:22:51.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.553+0000 7fb03aa5e740 20 client.28331 trim_cache size 0 max 16384 2024-09-19T06:22:51.558 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:22:51.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.554+0000 7fb038000640 1 -- 172.21.15.3:0/279495919 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb0180a3430 msgr2=0x7fb0180a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:51.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.554+0000 7fb038000640 1 --2- 172.21.15.3:0/279495919 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb0180a3430 0x7fb0180a58f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x5647f918c060 tx=0x7fb0240d3ad0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.554+0000 7fb038000640 1 -- 172.21.15.3:0/279495919 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb030076720 msgr2=0x7fb0301a4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:51.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.554+0000 7fb038000640 1 --2- 172.21.15.3:0/279495919 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb030076720 0x7fb0301a4700 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fb02400e9f0 tx=0x7fb02400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.554+0000 7fb038000640 1 -- 172.21.15.3:0/279495919 shutdown_connections 2024-09-19T06:22:51.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.554+0000 7fb038000640 1 --2- 172.21.15.3:0/279495919 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb0180a3430 0x7fb0180a58f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.554+0000 7fb038000640 1 --2- 172.21.15.3:0/279495919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb030112a30 0x7fb03019e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.554+0000 7fb038000640 1 --2- 172.21.15.3:0/279495919 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb030077040 0x7fb0301a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.554+0000 7fb038000640 1 --2- 172.21.15.3:0/279495919 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb030076720 0x7fb0301a4700 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:51.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.554+0000 7fb038000640 1 -- 172.21.15.3:0/279495919 >> 172.21.15.3:0/279495919 conn(0x7fb0300ffa90 msgr2=0x7fb030101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:51.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.554+0000 7fb038000640 1 -- 172.21.15.3:0/279495919 shutdown_connections 2024-09-19T06:22:51.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:51.554+0000 7fb038000640 1 -- 172.21.15.3:0/279495919 wait complete. 2024-09-19T06:22:52.578 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:52 smithi003 ceph-mon[30893]: pgmap v325: 97 pgs: 97 active+clean; 4.7 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 KiB/s wr, 16 op/s 2024-09-19T06:22:52.581 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:22:52.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:52 smithi071 ceph-mon[35662]: pgmap v325: 97 pgs: 97 active+clean; 4.7 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 KiB/s wr, 16 op/s 2024-09-19T06:22:52.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:52 smithi059 ceph-mon[35138]: pgmap v325: 97 pgs: 97 active+clean; 4.7 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 KiB/s wr, 16 op/s 2024-09-19T06:22:52.962 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:53.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.524+0000 7fa81a400640 1 -- 172.21.15.3:0/967678692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa814102790 msgr2=0x7fa8141067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:53.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.524+0000 7fa81a400640 1 --2- 172.21.15.3:0/967678692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa814102790 0x7fa8141067e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc009900 tx=0x7fa7fc02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.524+0000 7fa81a400640 1 -- 172.21.15.3:0/967678692 shutdown_connections 2024-09-19T06:22:53.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.524+0000 7fa81a400640 1 --2- 172.21.15.3:0/967678692 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa814106f10 0x7fa81410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.524+0000 7fa81a400640 1 --2- 172.21.15.3:0/967678692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa814102790 0x7fa8141067e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.524+0000 7fa81a400640 1 --2- 172.21.15.3:0/967678692 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa814101de0 0x7fa8141021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.524+0000 7fa81a400640 1 -- 172.21.15.3:0/967678692 >> 172.21.15.3:0/967678692 conn(0x7fa8140fd8c0 msgr2=0x7fa8140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:53.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.524+0000 7fa81a400640 1 -- 172.21.15.3:0/967678692 shutdown_connections 2024-09-19T06:22:53.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.524+0000 7fa81a400640 1 -- 172.21.15.3:0/967678692 wait complete. 2024-09-19T06:22:53.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.525+0000 7fa81a400640 1 Processor -- start 2024-09-19T06:22:53.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.526+0000 7fa81a400640 1 -- start start 2024-09-19T06:22:53.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.526+0000 7fa81a400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa814101de0 0x7fa8140744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:53.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.526+0000 7fa81a400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa814102790 0x7fa814074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:53.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.526+0000 7fa81a400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa814106f10 0x7fa814074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:53.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.526+0000 7fa81a400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa814111fc0 con 0x7fa814101de0 2024-09-19T06:22:53.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.526+0000 7fa81a400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa814111e40 con 0x7fa814106f10 2024-09-19T06:22:53.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.526+0000 7fa81a400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa814112140 con 0x7fa814102790 2024-09-19T06:22:53.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.526+0000 7fa813400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa814101de0 0x7fa8140744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:53.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.526+0000 7fa813e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa814106f10 0x7fa814074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:53.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.526+0000 7fa80aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa814102790 0x7fa814074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:53.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.526+0000 7fa813400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa814101de0 0x7fa8140744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59286/0 (socket says 172.21.15.3:59286) 2024-09-19T06:22:53.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.527+0000 7fa813e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa814106f10 0x7fa814074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:50358/0 (socket says 172.21.15.3:50358) 2024-09-19T06:22:53.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.527+0000 7fa80aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa814102790 0x7fa814074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:59092/0 (socket says 172.21.15.3:59092) 2024-09-19T06:22:53.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.527+0000 7fa813400640 1 -- 172.21.15.3:0/2730426279 learned_addr learned my addr 172.21.15.3:0/2730426279 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:53.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.527+0000 7fa813e00640 1 -- 172.21.15.3:0/2730426279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa814102790 msgr2=0x7fa814074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:53.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.527+0000 7fa813e00640 1 --2- 172.21.15.3:0/2730426279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa814102790 0x7fa814074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.527+0000 7fa813e00640 1 -- 172.21.15.3:0/2730426279 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa814101de0 msgr2=0x7fa8140744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:53.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.527+0000 7fa813e00640 1 --2- 172.21.15.3:0/2730426279 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa814101de0 0x7fa8140744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.527+0000 7fa813e00640 1 -- 172.21.15.3:0/2730426279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8141a68f0 con 0x7fa814106f10 2024-09-19T06:22:53.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.527+0000 7fa813e00640 1 --2- 172.21.15.3:0/2730426279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa814106f10 0x7fa814074f70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009fd0 tx=0x7fa80c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:53.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.527+0000 7fa810c00640 1 -- 172.21.15.3:0/2730426279 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c00ce20 con 0x7fa814106f10 2024-09-19T06:22:53.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.527+0000 7fa810c00640 1 -- 172.21.15.3:0/2730426279 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa80c005020 con 0x7fa814106f10 2024-09-19T06:22:53.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.527+0000 7fa810c00640 1 -- 172.21.15.3:0/2730426279 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c010720 con 0x7fa814106f10 2024-09-19T06:22:53.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.528+0000 7fa81a400640 1 -- 172.21.15.3:0/2730426279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8141a6be0 con 0x7fa814106f10 2024-09-19T06:22:53.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.528+0000 7fa81a400640 1 -- 172.21.15.3:0/2730426279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8141a70a0 con 0x7fa814106f10 2024-09-19T06:22:53.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.531+0000 7fa81ce36740 1 Processor -- start 2024-09-19T06:22:53.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.532+0000 7fa810c00640 1 -- 172.21.15.3:0/2730426279 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fa80c005540 con 0x7fa814106f10 2024-09-19T06:22:53.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.532+0000 7fa81ce36740 1 -- start start 2024-09-19T06:22:53.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.532+0000 7fa81ce36740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f268bc70 0x55a4f268c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:53.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.532+0000 7fa81ce36740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f268c590 0x55a4f2696910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:53.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.532+0000 7fa81ce36740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f2696e50 0x55a4f2699240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:53.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.532+0000 7fa81ce36740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a4f25f23e0 con 0x55a4f268c590 2024-09-19T06:22:53.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.532+0000 7fa81ce36740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a4f2599d80 con 0x55a4f268bc70 2024-09-19T06:22:53.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.532+0000 7fa81ce36740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a4f25ee3a0 con 0x55a4f2696e50 2024-09-19T06:22:53.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.533+0000 7fa813400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f268c590 0x55a4f2696910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:53.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.533+0000 7fa813400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f268c590 0x55a4f2696910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59300/0 (socket says 172.21.15.3:59300) 2024-09-19T06:22:53.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.533+0000 7fa80aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f268bc70 0x55a4f268c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:53.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.533+0000 7fa813400640 1 -- 172.21.15.3:0/3593393258 learned_addr learned my addr 172.21.15.3:0/3593393258 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:53.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.533+0000 7fa80aa00640 1 --2- 172.21.15.3:0/3593393258 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f2696e50 0x55a4f2699240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:53.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.533+0000 7fa813400640 1 -- 172.21.15.3:0/3593393258 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f2696e50 msgr2=0x55a4f2699240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:53.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.533+0000 7fa813400640 1 --2- 172.21.15.3:0/3593393258 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f2696e50 0x55a4f2699240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.533+0000 7fa813400640 1 -- 172.21.15.3:0/3593393258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f268bc70 msgr2=0x55a4f268c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:53.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.533+0000 7fa813400640 1 --2- 172.21.15.3:0/3593393258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f268bc70 0x55a4f268c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.533+0000 7fa813400640 1 -- 172.21.15.3:0/3593393258 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4f25b8ae0 con 0x55a4f268c590 2024-09-19T06:22:53.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.533+0000 7fa80aa00640 1 --2- 172.21.15.3:0/3593393258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f268bc70 0x55a4f268c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:53.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.533+0000 7fa813400640 1 --2- 172.21.15.3:0/3593393258 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f268c590 0x55a4f2696910 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa80400b7e0 tx=0x7fa80400bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e5f98d172da3ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:53.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.534+0000 7fa808c00640 1 -- 172.21.15.3:0/3593393258 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa804003dd0 con 0x55a4f268c590 2024-09-19T06:22:53.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.534+0000 7fa808c00640 1 -- 172.21.15.3:0/3593393258 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa804015070 con 0x55a4f268c590 2024-09-19T06:22:53.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.534+0000 7fa808c00640 1 -- 172.21.15.3:0/3593393258 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa804010760 con 0x55a4f268c590 2024-09-19T06:22:53.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.534+0000 7fa810c00640 1 --2- 172.21.15.3:0/2730426279 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa7f80a33b0 0x7fa7f80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:53.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.534+0000 7fa810c00640 1 -- 172.21.15.3:0/2730426279 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7fa80c0d0420 con 0x7fa814106f10 2024-09-19T06:22:53.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.534+0000 7fa80aa00640 1 --2- 172.21.15.3:0/2730426279 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa7f80a33b0 0x7fa7f80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:53.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.534+0000 7fa81ce36740 1 -- 172.21.15.3:0/3593393258 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f268c590 msgr2=0x55a4f2696910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:53.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.534+0000 7fa81ce36740 1 --2- 172.21.15.3:0/3593393258 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f268c590 0x55a4f2696910 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa80400b7e0 tx=0x7fa80400bca0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.535+0000 7fa81ce36740 1 -- 172.21.15.3:0/3593393258 shutdown_connections 2024-09-19T06:22:53.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.535+0000 7fa81ce36740 1 --2- 172.21.15.3:0/3593393258 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f2696e50 0x55a4f2699240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.535+0000 7fa81ce36740 1 --2- 172.21.15.3:0/3593393258 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f268c590 0x55a4f2696910 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.535+0000 7fa81ce36740 1 --2- 172.21.15.3:0/3593393258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f268bc70 0x55a4f268c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.535+0000 7fa81ce36740 1 -- 172.21.15.3:0/3593393258 >> 172.21.15.3:0/3593393258 conn(0x55a4f2688200 msgr2=0x55a4f26885e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:53.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.535+0000 7fa81ce36740 1 -- 172.21.15.3:0/3593393258 shutdown_connections 2024-09-19T06:22:53.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.535+0000 7fa81ce36740 1 -- 172.21.15.3:0/3593393258 wait complete. 2024-09-19T06:22:53.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.535+0000 7fa80aa00640 1 --2- 172.21.15.3:0/2730426279 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa7f80a33b0 0x7fa7f80a5870 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc000c00 tx=0x7fa7fc005bc0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:53.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.535+0000 7fa81ce36740 1 -- start start 2024-09-19T06:22:53.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.536+0000 7fa81ce36740 1 Processor -- start 2024-09-19T06:22:53.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.536+0000 7fa81ce36740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f268bc70 0x55a4f2693c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:53.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.536+0000 7fa81ce36740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f268c590 0x55a4f26941d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:53.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.536+0000 7fa81ce36740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f2696e50 0x55a4f2694710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:53.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.536+0000 7fa81ce36740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a4f2699a20 con 0x55a4f2696e50 2024-09-19T06:22:53.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.536+0000 7fa81ce36740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a4f25ad0f0 con 0x55a4f268bc70 2024-09-19T06:22:53.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.536+0000 7fa81ce36740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a4f2699ba0 con 0x55a4f268c590 2024-09-19T06:22:53.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.536+0000 7fa81ce36740 10 client.0 _ll_register_callbacks cb 0x55a4f2594bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:53.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.536+0000 7fa813e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f2696e50 0x55a4f2694710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:53.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.536+0000 7fa80aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f268c590 0x55a4f26941d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:53.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.536+0000 7fa813e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f2696e50 0x55a4f2694710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59306/0 (socket says 172.21.15.3:59306) 2024-09-19T06:22:53.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.536+0000 7fa813e00640 1 -- 172.21.15.3:0/760155527 learned_addr learned my addr 172.21.15.3:0/760155527 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:53.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.536+0000 7fa813400640 1 --2- 172.21.15.3:0/760155527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f268bc70 0x55a4f2693c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:53.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.537+0000 7fa813e00640 1 -- 172.21.15.3:0/760155527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f268c590 msgr2=0x55a4f26941d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:53.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.537+0000 7fa813e00640 1 --2- 172.21.15.3:0/760155527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f268c590 0x55a4f26941d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.537+0000 7fa813e00640 1 -- 172.21.15.3:0/760155527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f268bc70 msgr2=0x55a4f2693c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:53.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.537+0000 7fa813e00640 1 --2- 172.21.15.3:0/760155527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f268bc70 0x55a4f2693c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.537+0000 7fa813e00640 1 -- 172.21.15.3:0/760155527 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4f23633c0 con 0x55a4f2696e50 2024-09-19T06:22:53.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.537+0000 7fa813e00640 1 --2- 172.21.15.3:0/760155527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f2696e50 0x55a4f2694710 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa80c099040 tx=0x7fa80c09ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebe6e0e3d5d57205 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:53.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.537+0000 7fa801600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:22:53.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.537+0000 7fa801600640 1 -- 172.21.15.3:0/760155527 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c0a52e0 con 0x55a4f2696e50 2024-09-19T06:22:53.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.537+0000 7fa81ce36740 1 -- 172.21.15.3:0/760155527 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa804015070 con 0x55a4f2696e50 2024-09-19T06:22:53.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.537+0000 7fa801600640 1 -- 172.21.15.3:0/760155527 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7fa80c098ce0 con 0x55a4f2696e50 2024-09-19T06:22:53.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.537+0000 7fa801600640 1 -- 172.21.15.3:0/760155527 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa80c0a4e50 con 0x55a4f2696e50 2024-09-19T06:22:53.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.537+0000 7fa81ce36740 10 client.18309 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:53.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.538+0000 7fa81ce36740 1 -- 172.21.15.3:0/760155527 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a4f26a5a10 con 0x55a4f2696e50 2024-09-19T06:22:53.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.538+0000 7fa801600640 1 -- 172.21.15.3:0/760155527 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa804015070 con 0x55a4f2696e50 2024-09-19T06:22:53.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.538+0000 7fa801600640 1 -- 172.21.15.3:0/760155527 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa80c09bac0 con 0x55a4f2696e50 2024-09-19T06:22:53.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.538+0000 7fa81ce36740 10 client.18309 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:53.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.538+0000 7fa81ce36740 10 client.18309 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:22:53.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.538+0000 7fa81ce36740 20 client.18309 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:53.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.538+0000 7fa81ce36740 1 --2- 172.21.15.3:0/760155527 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55a4f26a6ed0 0x55a4f26a9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:53.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.538+0000 7fa81ce36740 4 client.18309 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:53.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.538+0000 7fa81ce36740 1 -- 172.21.15.3:0/760155527 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4f25ff950 con 0x55a4f26a6ed0 2024-09-19T06:22:53.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.538+0000 7fa813400640 1 --2- 172.21.15.3:0/760155527 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55a4f26a6ed0 0x55a4f26a9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:53.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.539+0000 7fa813400640 1 --2- 172.21.15.3:0/760155527 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55a4f26a6ed0 0x55a4f26a9320 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=daba0bbcedcc8c7b server_cookie=afd8cceac58a3e7f in_seq=0 out_seq=0 2024-09-19T06:22:53.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.539+0000 7fa801600640 10 client.18309 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:22:53.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.540+0000 7fa801600640 1 -- 172.21.15.3:0/760155527 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a4f25ff950 con 0x55a4f26a6ed0 2024-09-19T06:22:53.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.540+0000 7fa801600640 10 client.18309 handle_command_reply: tid=0 2024-09-19T06:22:53.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.540+0000 7fa81ce36740 1 client.18309 shutdown 2024-09-19T06:22:53.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.540+0000 7fa81ce36740 1 -- 172.21.15.3:0/760155527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f2696e50 msgr2=0x55a4f2694710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:53.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.540+0000 7fa81ce36740 1 --2- 172.21.15.3:0/760155527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f2696e50 0x55a4f2694710 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa80c099040 tx=0x7fa80c09ce30 comp rx=0 tx=0).stop 2024-09-19T06:22:53.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.540+0000 7fa81ce36740 1 -- 172.21.15.3:0/760155527 shutdown_connections 2024-09-19T06:22:53.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.540+0000 7fa81ce36740 1 --2- 172.21.15.3:0/760155527 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55a4f26a6ed0 0x55a4f26a9320 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.540+0000 7fa81ce36740 1 --2- 172.21.15.3:0/760155527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f2696e50 0x55a4f2694710 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.540+0000 7fa81ce36740 1 --2- 172.21.15.3:0/760155527 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f268c590 0x55a4f26941d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.540+0000 7fa81ce36740 1 --2- 172.21.15.3:0/760155527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f268bc70 0x55a4f2693c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.540+0000 7fa801600640 0 client.18309 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:22:53.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.540+0000 7fa81ce36740 1 -- 172.21.15.3:0/760155527 >> 172.21.15.3:0/760155527 conn(0x55a4f2688200 msgr2=0x55a4f2687380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:53.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.540+0000 7fa81ce36740 1 -- 172.21.15.3:0/760155527 shutdown_connections 2024-09-19T06:22:53.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.540+0000 7fa81ce36740 1 -- 172.21.15.3:0/760155527 wait complete. 2024-09-19T06:22:53.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.540+0000 7fa81ce36740 20 client.18309 trim_cache size 0 max 16384 2024-09-19T06:22:53.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.554+0000 7fa81ce36740 1 Processor -- start 2024-09-19T06:22:53.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.554+0000 7fa81ce36740 1 -- start start 2024-09-19T06:22:53.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.554+0000 7fa81ce36740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f268bc70 0x55a4f2693550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:53.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.554+0000 7fa81ce36740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f268c590 0x55a4f26aec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:53.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.554+0000 7fa81ce36740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f2696e50 0x55a4f26af180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:53.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.554+0000 7fa81ce36740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa8141afb50 con 0x55a4f2696e50 2024-09-19T06:22:53.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.554+0000 7fa81ce36740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa8141b1690 con 0x55a4f268bc70 2024-09-19T06:22:53.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.554+0000 7fa81ce36740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa8141b0220 con 0x55a4f268c590 2024-09-19T06:22:53.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.555+0000 7fa813e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f2696e50 0x55a4f26af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:53.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.555+0000 7fa80aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f268c590 0x55a4f26aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:53.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.555+0000 7fa813400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f268bc70 0x55a4f2693550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:53.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.555+0000 7fa80aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f268c590 0x55a4f26aec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:59124/0 (socket says 172.21.15.3:59124) 2024-09-19T06:22:53.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.555+0000 7fa80aa00640 1 -- 172.21.15.3:0/2355193382 learned_addr learned my addr 172.21.15.3:0/2355193382 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:53.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.555+0000 7fa813400640 1 -- 172.21.15.3:0/2355193382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f268c590 msgr2=0x55a4f26aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:53.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.555+0000 7fa813400640 1 --2- 172.21.15.3:0/2355193382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f268c590 0x55a4f26aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.555+0000 7fa813400640 1 -- 172.21.15.3:0/2355193382 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f2696e50 msgr2=0x55a4f26af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:53.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.555+0000 7fa813400640 1 --2- 172.21.15.3:0/2355193382 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f2696e50 0x55a4f26af180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.555+0000 7fa813400640 1 -- 172.21.15.3:0/2355193382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4f2688030 con 0x55a4f268bc70 2024-09-19T06:22:53.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.555+0000 7fa813e00640 1 --2- 172.21.15.3:0/2355193382 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f2696e50 0x55a4f26af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:53.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.556+0000 7fa813400640 1 --2- 172.21.15.3:0/2355193382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f268bc70 0x55a4f2693550 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa804000c00 tx=0x7fa804013040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dccccb229f44c62 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:53.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.556+0000 7fa803e00640 1 -- 172.21.15.3:0/2355193382 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa804003f10 con 0x55a4f268bc70 2024-09-19T06:22:53.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.556+0000 7fa803e00640 1 -- 172.21.15.3:0/2355193382 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa804015070 con 0x55a4f268bc70 2024-09-19T06:22:53.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.556+0000 7fa803e00640 1 -- 172.21.15.3:0/2355193382 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa804004630 con 0x55a4f268bc70 2024-09-19T06:22:53.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.556+0000 7fa81ce36740 1 -- 172.21.15.3:0/2355193382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f268bc70 msgr2=0x55a4f2693550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:53.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.556+0000 7fa81ce36740 1 --2- 172.21.15.3:0/2355193382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f268bc70 0x55a4f2693550 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa804000c00 tx=0x7fa804013040 comp rx=0 tx=0).stop 2024-09-19T06:22:53.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.557+0000 7fa81ce36740 1 -- 172.21.15.3:0/2355193382 shutdown_connections 2024-09-19T06:22:53.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.557+0000 7fa81ce36740 1 --2- 172.21.15.3:0/2355193382 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f2696e50 0x55a4f26af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.557+0000 7fa81ce36740 1 --2- 172.21.15.3:0/2355193382 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f268c590 0x55a4f26aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.557+0000 7fa81ce36740 1 --2- 172.21.15.3:0/2355193382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f268bc70 0x55a4f2693550 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.557+0000 7fa81ce36740 1 -- 172.21.15.3:0/2355193382 >> 172.21.15.3:0/2355193382 conn(0x55a4f2688200 msgr2=0x55a4f2692d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:53.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.557+0000 7fa81ce36740 1 -- 172.21.15.3:0/2355193382 shutdown_connections 2024-09-19T06:22:53.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.557+0000 7fa81ce36740 1 -- 172.21.15.3:0/2355193382 wait complete. 2024-09-19T06:22:53.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.557+0000 7fa81ce36740 1 -- start start 2024-09-19T06:22:53.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.557+0000 7fa81ce36740 1 Processor -- start 2024-09-19T06:22:53.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.558+0000 7fa81ce36740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f268bc70 0x55a4f269f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:53.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.558+0000 7fa81ce36740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f268c590 0x55a4f269a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:53.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.558+0000 7fa81ce36740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f2696e50 0x55a4f269ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:53.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.558+0000 7fa81ce36740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa8141b0fc0 con 0x55a4f2696e50 2024-09-19T06:22:53.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.558+0000 7fa81ce36740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa8141b08f0 con 0x55a4f268bc70 2024-09-19T06:22:53.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.558+0000 7fa81ce36740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa8141adb50 con 0x55a4f268c590 2024-09-19T06:22:53.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.558+0000 7fa81ce36740 10 client.0 _ll_register_callbacks cb 0x7fa80c005830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:53.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.558+0000 7fa813e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f2696e50 0x55a4f269ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:53.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.558+0000 7fa813e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f2696e50 0x55a4f269ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:59324/0 (socket says 172.21.15.3:59324) 2024-09-19T06:22:53.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.558+0000 7fa813e00640 1 -- 172.21.15.3:0/1512017555 learned_addr learned my addr 172.21.15.3:0/1512017555 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:53.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.558+0000 7fa813400640 1 --2- 172.21.15.3:0/1512017555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f268bc70 0x55a4f269f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:53.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.558+0000 7fa80aa00640 1 --2- 172.21.15.3:0/1512017555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f268c590 0x55a4f269a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:53.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.559+0000 7fa813e00640 1 -- 172.21.15.3:0/1512017555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f268c590 msgr2=0x55a4f269a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:53.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.559+0000 7fa813e00640 1 --2- 172.21.15.3:0/1512017555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f268c590 0x55a4f269a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.559+0000 7fa813e00640 1 -- 172.21.15.3:0/1512017555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f268bc70 msgr2=0x55a4f269f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:53.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.559+0000 7fa813e00640 1 --2- 172.21.15.3:0/1512017555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f268bc70 0x55a4f269f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.559+0000 7fa813e00640 1 -- 172.21.15.3:0/1512017555 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4f2683770 con 0x55a4f2696e50 2024-09-19T06:22:53.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.559+0000 7fa813e00640 1 --2- 172.21.15.3:0/1512017555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f2696e50 0x55a4f269ac60 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa80c09be90 tx=0x7fa80c005940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef9b8a1c5aa649a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:53.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.559+0000 7fa801600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:22:53.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.559+0000 7fa801600640 1 -- 172.21.15.3:0/1512017555 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c085060 con 0x55a4f2696e50 2024-09-19T06:22:53.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.559+0000 7fa801600640 1 -- 172.21.15.3:0/1512017555 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7fa80c09bac0 con 0x55a4f2696e50 2024-09-19T06:22:53.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.559+0000 7fa81ce36740 1 -- 172.21.15.3:0/1512017555 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa804015070 con 0x55a4f2696e50 2024-09-19T06:22:53.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.559+0000 7fa801600640 1 -- 172.21.15.3:0/1512017555 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa80c0ac050 con 0x55a4f2696e50 2024-09-19T06:22:53.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.559+0000 7fa81ce36740 10 client.18315 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:53.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.559+0000 7fa81ce36740 1 -- 172.21.15.3:0/1512017555 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a4f27118a0 con 0x55a4f2696e50 2024-09-19T06:22:53.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.560+0000 7fa801600640 1 -- 172.21.15.3:0/1512017555 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa804015070 con 0x55a4f2696e50 2024-09-19T06:22:53.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.560+0000 7fa801600640 1 -- 172.21.15.3:0/1512017555 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa80c07d070 con 0x55a4f2696e50 2024-09-19T06:22:53.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.560+0000 7fa81ce36740 10 client.18315 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:53.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.560+0000 7fa81ce36740 10 client.18315 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:22:53.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.560+0000 7fa81ce36740 20 client.18315 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:53.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.560+0000 7fa81ce36740 1 --2- 172.21.15.3:0/1512017555 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55a4f2711fc0 0x55a4f27143e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:53.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.560+0000 7fa81ce36740 4 client.18315 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:22:53.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.560+0000 7fa81ce36740 1 -- 172.21.15.3:0/1512017555 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a4f25f9e60 con 0x55a4f2711fc0 2024-09-19T06:22:53.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.560+0000 7fa813400640 1 --2- 172.21.15.3:0/1512017555 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55a4f2711fc0 0x55a4f27143e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:53.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.561+0000 7fa813400640 1 --2- 172.21.15.3:0/1512017555 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55a4f2711fc0 0x55a4f27143e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=621b98cb7b2bfa34 server_cookie=1c2e39b4cce4abe1 in_seq=0 out_seq=0 2024-09-19T06:22:53.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.561+0000 7fa801600640 10 client.18315 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:22:53.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.561+0000 7fa801600640 1 -- 172.21.15.3:0/1512017555 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a4f25f9e60 con 0x55a4f2711fc0 2024-09-19T06:22:53.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.561+0000 7fa801600640 10 client.18315 handle_command_reply: tid=0 2024-09-19T06:22:53.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.561+0000 7fa81ce36740 1 client.18315 shutdown 2024-09-19T06:22:53.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.561+0000 7fa81ce36740 1 -- 172.21.15.3:0/1512017555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f2696e50 msgr2=0x55a4f269ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:53.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.561+0000 7fa81ce36740 1 --2- 172.21.15.3:0/1512017555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f2696e50 0x55a4f269ac60 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa80c09be90 tx=0x7fa80c005940 comp rx=0 tx=0).stop 2024-09-19T06:22:53.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.561+0000 7fa81ce36740 1 -- 172.21.15.3:0/1512017555 shutdown_connections 2024-09-19T06:22:53.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.561+0000 7fa81ce36740 1 --2- 172.21.15.3:0/1512017555 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55a4f2711fc0 0x55a4f27143e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.561+0000 7fa81ce36740 1 --2- 172.21.15.3:0/1512017555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a4f2696e50 0x55a4f269ac60 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.561+0000 7fa81ce36740 1 --2- 172.21.15.3:0/1512017555 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a4f268c590 0x55a4f269a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.561+0000 7fa81ce36740 1 --2- 172.21.15.3:0/1512017555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a4f268bc70 0x55a4f269f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.561+0000 7fa81ce36740 1 -- 172.21.15.3:0/1512017555 >> 172.21.15.3:0/1512017555 conn(0x55a4f2688200 msgr2=0x55a4f268d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:53.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.561+0000 7fa801600640 0 client.18315 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:22:53.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.562+0000 7fa81ce36740 1 -- 172.21.15.3:0/1512017555 shutdown_connections 2024-09-19T06:22:53.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.562+0000 7fa81ce36740 1 -- 172.21.15.3:0/1512017555 wait complete. 2024-09-19T06:22:53.574 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.562+0000 7fa81ce36740 20 client.18315 trim_cache size 0 max 16384 2024-09-19T06:22:53.574 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:22:53.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.562+0000 7fa81a400640 1 -- 172.21.15.3:0/2730426279 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa7f80a33b0 msgr2=0x7fa7f80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:53.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.562+0000 7fa81a400640 1 --2- 172.21.15.3:0/2730426279 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa7f80a33b0 0x7fa7f80a5870 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc000c00 tx=0x7fa7fc005bc0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.562+0000 7fa81a400640 1 -- 172.21.15.3:0/2730426279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa814106f10 msgr2=0x7fa814074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:53.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.562+0000 7fa81a400640 1 --2- 172.21.15.3:0/2730426279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa814106f10 0x7fa814074f70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009fd0 tx=0x7fa80c00ef10 comp rx=0 tx=0).stop 2024-09-19T06:22:53.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.562+0000 7fa81a400640 1 -- 172.21.15.3:0/2730426279 shutdown_connections 2024-09-19T06:22:53.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.562+0000 7fa81a400640 1 --2- 172.21.15.3:0/2730426279 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa7f80a33b0 0x7fa7f80a5870 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.562+0000 7fa81a400640 1 --2- 172.21.15.3:0/2730426279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa814106f10 0x7fa814074f70 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.562+0000 7fa81a400640 1 --2- 172.21.15.3:0/2730426279 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa814102790 0x7fa814074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.562+0000 7fa81a400640 1 --2- 172.21.15.3:0/2730426279 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa814101de0 0x7fa8140744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:53.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.562+0000 7fa81a400640 1 -- 172.21.15.3:0/2730426279 >> 172.21.15.3:0/2730426279 conn(0x7fa8140fd8c0 msgr2=0x7fa8140febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:53.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.563+0000 7fa81a400640 1 -- 172.21.15.3:0/2730426279 shutdown_connections 2024-09-19T06:22:53.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:53.563+0000 7fa81a400640 1 -- 172.21.15.3:0/2730426279 wait complete. 2024-09-19T06:22:54.350 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:22:54.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:54 smithi003 ceph-mon[30893]: pgmap v326: 97 pgs: 97 active+clean; 4.7 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 KiB/s wr, 16 op/s 2024-09-19T06:22:54.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:54 smithi071 ceph-mon[35662]: pgmap v326: 97 pgs: 97 active+clean; 4.7 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 KiB/s wr, 16 op/s 2024-09-19T06:22:54.730 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:54.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:54 smithi059 ceph-mon[35138]: pgmap v326: 97 pgs: 97 active+clean; 4.7 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 KiB/s wr, 16 op/s 2024-09-19T06:22:55.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.552+0000 7fda35800640 1 -- 172.21.15.3:0/1326664260 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda30109140 msgr2=0x7fda30110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:55.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.552+0000 7fda35800640 1 --2- 172.21.15.3:0/1326664260 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda30109140 0x7fda30110cc0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fda28009900 tx=0x7fda2802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.553+0000 7fda35800640 1 -- 172.21.15.3:0/1326664260 shutdown_connections 2024-09-19T06:22:55.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.553+0000 7fda35800640 1 --2- 172.21.15.3:0/1326664260 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda30109140 0x7fda30110cc0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.553+0000 7fda35800640 1 --2- 172.21.15.3:0/1326664260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda301049c0 0x7fda30108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.553+0000 7fda35800640 1 --2- 172.21.15.3:0/1326664260 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda30104010 0x7fda301043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.553+0000 7fda35800640 1 -- 172.21.15.3:0/1326664260 >> 172.21.15.3:0/1326664260 conn(0x7fda300ffa50 msgr2=0x7fda30101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:55.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.553+0000 7fda35800640 1 -- 172.21.15.3:0/1326664260 shutdown_connections 2024-09-19T06:22:55.555 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.553+0000 7fda35800640 1 -- 172.21.15.3:0/1326664260 wait complete. 2024-09-19T06:22:55.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.554+0000 7fda35800640 1 Processor -- start 2024-09-19T06:22:55.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.554+0000 7fda35800640 1 -- start start 2024-09-19T06:22:55.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.554+0000 7fda35800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda30104010 0x7fda3019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:55.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.554+0000 7fda35800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda301049c0 0x7fda3019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:55.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.554+0000 7fda35800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda30109140 0x7fda3019ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:55.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.554+0000 7fda35800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fda301141a0 con 0x7fda301049c0 2024-09-19T06:22:55.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.554+0000 7fda35800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fda30114020 con 0x7fda30109140 2024-09-19T06:22:55.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.554+0000 7fda35800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fda30114320 con 0x7fda30104010 2024-09-19T06:22:55.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.554+0000 7fda26000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda301049c0 0x7fda3019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:55.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.555+0000 7fda2ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda30104010 0x7fda3019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:55.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.555+0000 7fda2ea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda30104010 0x7fda3019a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:52236/0 (socket says 172.21.15.3:52236) 2024-09-19T06:22:55.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.555+0000 7fda2ea00640 1 -- 172.21.15.3:0/93331408 learned_addr learned my addr 172.21.15.3:0/93331408 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:55.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.555+0000 7fda2f400640 1 --2- 172.21.15.3:0/93331408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda30109140 0x7fda3019ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:55.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.555+0000 7fda2ea00640 1 -- 172.21.15.3:0/93331408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda30109140 msgr2=0x7fda3019ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:55.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.555+0000 7fda2ea00640 1 --2- 172.21.15.3:0/93331408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda30109140 0x7fda3019ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.555+0000 7fda2ea00640 1 -- 172.21.15.3:0/93331408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda301049c0 msgr2=0x7fda3019abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:55.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.555+0000 7fda2ea00640 1 --2- 172.21.15.3:0/93331408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda301049c0 0x7fda3019abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.555+0000 7fda2ea00640 1 -- 172.21.15.3:0/93331408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3019f650 con 0x7fda30104010 2024-09-19T06:22:55.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.555+0000 7fda26000640 1 --2- 172.21.15.3:0/93331408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda301049c0 0x7fda3019abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:55.558 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.555+0000 7fda2ea00640 1 --2- 172.21.15.3:0/93331408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda30104010 0x7fda3019a6a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fda2000ebc0 tx=0x7fda2000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:55.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.556+0000 7fda27e00640 1 -- 172.21.15.3:0/93331408 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20010630 con 0x7fda30104010 2024-09-19T06:22:55.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.556+0000 7fda35800640 1 -- 172.21.15.3:0/93331408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda3019f940 con 0x7fda30104010 2024-09-19T06:22:55.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.556+0000 7fda27e00640 1 -- 172.21.15.3:0/93331408 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda20010cb0 con 0x7fda30104010 2024-09-19T06:22:55.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.556+0000 7fda27e00640 1 -- 172.21.15.3:0/93331408 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20018bd0 con 0x7fda30104010 2024-09-19T06:22:55.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.556+0000 7fda35800640 1 -- 172.21.15.3:0/93331408 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda301a7220 con 0x7fda30104010 2024-09-19T06:22:55.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.559+0000 7fda382cd740 1 Processor -- start 2024-09-19T06:22:55.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.559+0000 7fda382cd740 1 -- start start 2024-09-19T06:22:55.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.559+0000 7fda27e00640 1 -- 172.21.15.3:0/93331408 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fda200107d0 con 0x7fda30104010 2024-09-19T06:22:55.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.559+0000 7fda382cd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563569135c70 0x563569136050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:55.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.559+0000 7fda382cd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563569136590 0x563569140910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:55.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.559+0000 7fda382cd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569140e50 0x563569143240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:55.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.559+0000 7fda382cd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56356909c3e0 con 0x563569140e50 2024-09-19T06:22:55.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.559+0000 7fda382cd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563569043d80 con 0x563569136590 2024-09-19T06:22:55.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.559+0000 7fda382cd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5635690983a0 con 0x563569135c70 2024-09-19T06:22:55.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.559+0000 7fda2f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563569135c70 0x563569136050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:55.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.560+0000 7fda2f400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563569135c70 0x563569136050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:52250/0 (socket says 172.21.15.3:52250) 2024-09-19T06:22:55.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.560+0000 7fda2f400640 1 -- 172.21.15.3:0/4034304337 learned_addr learned my addr 172.21.15.3:0/4034304337 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:55.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.560+0000 7fda2ea00640 1 --2- 172.21.15.3:0/4034304337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563569136590 0x563569140910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:55.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.560+0000 7fda26000640 1 --2- 172.21.15.3:0/4034304337 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569140e50 0x563569143240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:55.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.560+0000 7fda2f400640 1 -- 172.21.15.3:0/4034304337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563569136590 msgr2=0x563569140910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:55.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.560+0000 7fda2f400640 1 --2- 172.21.15.3:0/4034304337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563569136590 0x563569140910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.560+0000 7fda2f400640 1 -- 172.21.15.3:0/4034304337 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569140e50 msgr2=0x563569143240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:55.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.560+0000 7fda2f400640 1 --2- 172.21.15.3:0/4034304337 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569140e50 0x563569143240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.560+0000 7fda2f400640 1 -- 172.21.15.3:0/4034304337 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563569062ae0 con 0x563569135c70 2024-09-19T06:22:55.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.560+0000 7fda26000640 1 --2- 172.21.15.3:0/4034304337 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569140e50 0x563569143240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:55.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.560+0000 7fda2f400640 1 --2- 172.21.15.3:0/4034304337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563569135c70 0x563569136050 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fda2802a9e0 tx=0x7fda28005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f12464df54275098 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:55.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.561+0000 7fda1fe00640 1 -- 172.21.15.3:0/4034304337 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda28040070 con 0x563569135c70 2024-09-19T06:22:55.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.561+0000 7fda1fe00640 1 -- 172.21.15.3:0/4034304337 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda28004300 con 0x563569135c70 2024-09-19T06:22:55.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.561+0000 7fda1fe00640 1 -- 172.21.15.3:0/4034304337 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda28035040 con 0x563569135c70 2024-09-19T06:22:55.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.561+0000 7fda27e00640 1 --2- 172.21.15.3:0/93331408 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fda140a3430 0x7fda140a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:55.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.561+0000 7fda27e00640 1 -- 172.21.15.3:0/93331408 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7fda200d0310 con 0x7fda30104010 2024-09-19T06:22:55.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.561+0000 7fda2ea00640 1 --2- 172.21.15.3:0/93331408 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fda140a3430 0x7fda140a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:55.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.561+0000 7fda382cd740 1 -- 172.21.15.3:0/4034304337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563569135c70 msgr2=0x563569136050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:55.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.561+0000 7fda382cd740 1 --2- 172.21.15.3:0/4034304337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563569135c70 0x563569136050 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fda2802a9e0 tx=0x7fda28005c00 comp rx=0 tx=0).stop 2024-09-19T06:22:55.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.561+0000 7fda382cd740 1 -- 172.21.15.3:0/4034304337 shutdown_connections 2024-09-19T06:22:55.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.561+0000 7fda382cd740 1 --2- 172.21.15.3:0/4034304337 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569140e50 0x563569143240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.561+0000 7fda382cd740 1 --2- 172.21.15.3:0/4034304337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563569136590 0x563569140910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.561+0000 7fda382cd740 1 --2- 172.21.15.3:0/4034304337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563569135c70 0x563569136050 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.561+0000 7fda382cd740 1 -- 172.21.15.3:0/4034304337 >> 172.21.15.3:0/4034304337 conn(0x563569132200 msgr2=0x5635691325e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:55.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.562+0000 7fda382cd740 1 -- 172.21.15.3:0/4034304337 shutdown_connections 2024-09-19T06:22:55.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.562+0000 7fda382cd740 1 -- 172.21.15.3:0/4034304337 wait complete. 2024-09-19T06:22:55.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.562+0000 7fda2ea00640 1 --2- 172.21.15.3:0/93331408 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fda140a3430 0x7fda140a58f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x563569133060 tx=0x7fda200d3dc0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:55.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.562+0000 7fda382cd740 1 -- start start 2024-09-19T06:22:55.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.563+0000 7fda382cd740 1 Processor -- start 2024-09-19T06:22:55.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.563+0000 7fda382cd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569135c70 0x56356913dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:55.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.563+0000 7fda382cd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563569136590 0x56356913e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:55.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.563+0000 7fda382cd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563569140e50 0x56356913e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:55.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.563+0000 7fda382cd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563569143a20 con 0x563569135c70 2024-09-19T06:22:55.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.563+0000 7fda382cd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5635690570f0 con 0x563569136590 2024-09-19T06:22:55.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.563+0000 7fda382cd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563569143ba0 con 0x563569140e50 2024-09-19T06:22:55.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.563+0000 7fda382cd740 10 client.0 _ll_register_callbacks cb 0x56356903ebd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:55.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.563+0000 7fda2f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569135c70 0x56356913dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:55.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.563+0000 7fda2f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569135c70 0x56356913dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56030/0 (socket says 172.21.15.3:56030) 2024-09-19T06:22:55.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.563+0000 7fda2f400640 1 -- 172.21.15.3:0/220047615 learned_addr learned my addr 172.21.15.3:0/220047615 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:55.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.563+0000 7fda26000640 1 --2- 172.21.15.3:0/220047615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563569136590 0x56356913e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:55.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.564+0000 7fda2f400640 1 --2- 172.21.15.3:0/220047615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563569140e50 0x56356913e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:55.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.564+0000 7fda26000640 1 -- 172.21.15.3:0/220047615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563569140e50 msgr2=0x56356913e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:55.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.564+0000 7fda26000640 1 --2- 172.21.15.3:0/220047615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563569140e50 0x56356913e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.564+0000 7fda26000640 1 -- 172.21.15.3:0/220047615 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569135c70 msgr2=0x56356913dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:55.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.564+0000 7fda26000640 1 --2- 172.21.15.3:0/220047615 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569135c70 0x56356913dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.564+0000 7fda26000640 1 -- 172.21.15.3:0/220047615 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563568e0d3c0 con 0x563569136590 2024-09-19T06:22:55.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.564+0000 7fda2f400640 1 --2- 172.21.15.3:0/220047615 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569135c70 0x56356913dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:55.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.564+0000 7fda26000640 1 --2- 172.21.15.3:0/220047615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563569136590 0x56356913e2a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fda180129e0 tx=0x7fda18012ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73f51e71f370e224 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:55.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.564+0000 7fda1cc00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:22:55.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.565+0000 7fda1cc00640 1 -- 172.21.15.3:0/220047615 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1800fa10 con 0x563569136590 2024-09-19T06:22:55.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.565+0000 7fda382cd740 1 -- 172.21.15.3:0/220047615 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda28004300 con 0x563569136590 2024-09-19T06:22:55.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.565+0000 7fda1cc00640 1 -- 172.21.15.3:0/220047615 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7fda1800fbb0 con 0x563569136590 2024-09-19T06:22:55.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.565+0000 7fda1cc00640 1 -- 172.21.15.3:0/220047615 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fda1800fdb0 con 0x563569136590 2024-09-19T06:22:55.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.565+0000 7fda382cd740 10 client.28361 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:55.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.565+0000 7fda382cd740 1 -- 172.21.15.3:0/220047615 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56356914fb40 con 0x563569136590 2024-09-19T06:22:55.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.565+0000 7fda1cc00640 1 -- 172.21.15.3:0/220047615 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda28004300 con 0x563569136590 2024-09-19T06:22:55.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.566+0000 7fda1cc00640 1 -- 172.21.15.3:0/220047615 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fda180105f0 con 0x563569136590 2024-09-19T06:22:55.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.566+0000 7fda382cd740 10 client.28361 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:55.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.566+0000 7fda382cd740 10 client.28361 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:22:55.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.566+0000 7fda382cd740 20 client.28361 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:55.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.566+0000 7fda382cd740 1 --2- 172.21.15.3:0/220047615 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x563569150f50 0x563569153360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:55.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.566+0000 7fda382cd740 4 client.28361 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:55.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.566+0000 7fda382cd740 1 -- 172.21.15.3:0/220047615 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635690a9950 con 0x563569150f50 2024-09-19T06:22:55.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.566+0000 7fda2f400640 1 --2- 172.21.15.3:0/220047615 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x563569150f50 0x563569153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:55.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.567+0000 7fda2f400640 1 --2- 172.21.15.3:0/220047615 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x563569150f50 0x563569153360 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a23a0ad618555774 server_cookie=9b407b4e5fbf3afc in_seq=0 out_seq=0 2024-09-19T06:22:55.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.567+0000 7fda1cc00640 10 client.28361 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:22:55.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.568+0000 7fda1cc00640 1 -- 172.21.15.3:0/220047615 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5635690a9950 con 0x563569150f50 2024-09-19T06:22:55.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.568+0000 7fda1cc00640 10 client.28361 handle_command_reply: tid=0 2024-09-19T06:22:55.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.568+0000 7fda382cd740 1 client.28361 shutdown 2024-09-19T06:22:55.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.568+0000 7fda382cd740 1 -- 172.21.15.3:0/220047615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563569136590 msgr2=0x56356913e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:55.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.568+0000 7fda382cd740 1 --2- 172.21.15.3:0/220047615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563569136590 0x56356913e2a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fda180129e0 tx=0x7fda18012ea0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.568+0000 7fda382cd740 1 -- 172.21.15.3:0/220047615 shutdown_connections 2024-09-19T06:22:55.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.568+0000 7fda382cd740 1 --2- 172.21.15.3:0/220047615 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x563569150f50 0x563569153360 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.568+0000 7fda382cd740 1 --2- 172.21.15.3:0/220047615 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563569140e50 0x56356913e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.568+0000 7fda382cd740 1 --2- 172.21.15.3:0/220047615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563569136590 0x56356913e2a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.568+0000 7fda382cd740 1 --2- 172.21.15.3:0/220047615 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569135c70 0x56356913dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.568+0000 7fda382cd740 1 -- 172.21.15.3:0/220047615 >> 172.21.15.3:0/220047615 conn(0x563569132200 msgr2=0x563569131380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:55.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.568+0000 7fda1cc00640 0 client.28361 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:22:55.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.568+0000 7fda382cd740 1 -- 172.21.15.3:0/220047615 shutdown_connections 2024-09-19T06:22:55.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.568+0000 7fda382cd740 1 -- 172.21.15.3:0/220047615 wait complete. 2024-09-19T06:22:55.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.568+0000 7fda382cd740 20 client.28361 trim_cache size 0 max 16384 2024-09-19T06:22:55.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.582+0000 7fda382cd740 1 Processor -- start 2024-09-19T06:22:55.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.582+0000 7fda382cd740 1 -- start start 2024-09-19T06:22:55.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.582+0000 7fda382cd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563569135c70 0x5635691386d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:55.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.582+0000 7fda382cd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569136590 0x56356913fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:55.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.582+0000 7fda382cd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563569140e50 0x563569158c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:55.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.582+0000 7fda382cd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fda301afc70 con 0x563569136590 2024-09-19T06:22:55.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.582+0000 7fda382cd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fda301b17b0 con 0x563569135c70 2024-09-19T06:22:55.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.582+0000 7fda382cd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fda301b0340 con 0x563569140e50 2024-09-19T06:22:55.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.583+0000 7fda26000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569136590 0x56356913fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:55.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.583+0000 7fda2f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563569135c70 0x5635691386d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:55.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.583+0000 7fda26000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569136590 0x56356913fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56032/0 (socket says 172.21.15.3:56032) 2024-09-19T06:22:55.585 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.583+0000 7fda26000640 1 -- 172.21.15.3:0/3214120940 learned_addr learned my addr 172.21.15.3:0/3214120940 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:55.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.583+0000 7fda2f400640 1 --2- 172.21.15.3:0/3214120940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563569140e50 0x563569158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:55.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.583+0000 7fda26000640 1 -- 172.21.15.3:0/3214120940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563569140e50 msgr2=0x563569158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:55.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.583+0000 7fda26000640 1 --2- 172.21.15.3:0/3214120940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563569140e50 0x563569158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.583+0000 7fda26000640 1 -- 172.21.15.3:0/3214120940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563569135c70 msgr2=0x5635691386d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:55.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.583+0000 7fda26000640 1 --2- 172.21.15.3:0/3214120940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563569135c70 0x5635691386d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.583+0000 7fda26000640 1 -- 172.21.15.3:0/3214120940 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56356912d770 con 0x563569136590 2024-09-19T06:22:55.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.583+0000 7fda2f400640 1 --2- 172.21.15.3:0/3214120940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563569140e50 0x563569158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:22:55.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.583+0000 7fda26000640 1 --2- 172.21.15.3:0/3214120940 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569136590 0x56356913fcd0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fda18010a10 tx=0x7fda1800fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db34fe1cfb5dbcb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:55.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.584+0000 7fda1f400640 1 -- 172.21.15.3:0/3214120940 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda18028070 con 0x563569136590 2024-09-19T06:22:55.588 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.584+0000 7fda1f400640 1 -- 172.21.15.3:0/3214120940 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda180050e0 con 0x563569136590 2024-09-19T06:22:55.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.584+0000 7fda1f400640 1 -- 172.21.15.3:0/3214120940 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda18003850 con 0x563569136590 2024-09-19T06:22:55.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.584+0000 7fda382cd740 1 -- 172.21.15.3:0/3214120940 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569136590 msgr2=0x56356913fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:55.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.584+0000 7fda382cd740 1 --2- 172.21.15.3:0/3214120940 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569136590 0x56356913fcd0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fda18010a10 tx=0x7fda1800fca0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.584+0000 7fda382cd740 1 -- 172.21.15.3:0/3214120940 shutdown_connections 2024-09-19T06:22:55.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.584+0000 7fda382cd740 1 --2- 172.21.15.3:0/3214120940 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563569140e50 0x563569158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.584+0000 7fda382cd740 1 --2- 172.21.15.3:0/3214120940 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569136590 0x56356913fcd0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.584+0000 7fda382cd740 1 --2- 172.21.15.3:0/3214120940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563569135c70 0x5635691386d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.584+0000 7fda382cd740 1 -- 172.21.15.3:0/3214120940 >> 172.21.15.3:0/3214120940 conn(0x563569132200 msgr2=0x56356913f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:55.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.584+0000 7fda382cd740 1 -- 172.21.15.3:0/3214120940 shutdown_connections 2024-09-19T06:22:55.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.584+0000 7fda382cd740 1 -- 172.21.15.3:0/3214120940 wait complete. 2024-09-19T06:22:55.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.585+0000 7fda382cd740 1 -- start start 2024-09-19T06:22:55.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.585+0000 7fda382cd740 1 Processor -- start 2024-09-19T06:22:55.589 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.585+0000 7fda382cd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563569135c70 0x5635691495a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:55.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.585+0000 7fda382cd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569136590 0x563569144920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:55.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.586+0000 7fda382cd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563569140e50 0x563569144e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:55.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.586+0000 7fda382cd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fda301b10e0 con 0x563569136590 2024-09-19T06:22:55.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.586+0000 7fda382cd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fda301b0a10 con 0x563569140e50 2024-09-19T06:22:55.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.586+0000 7fda382cd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fda301adc70 con 0x563569135c70 2024-09-19T06:22:55.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.586+0000 7fda382cd740 10 client.0 _ll_register_callbacks cb 0x7fda18009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:55.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.586+0000 7fda26000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569136590 0x563569144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:55.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.586+0000 7fda26000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569136590 0x563569144920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56042/0 (socket says 172.21.15.3:56042) 2024-09-19T06:22:55.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.586+0000 7fda26000640 1 -- 172.21.15.3:0/902118744 learned_addr learned my addr 172.21.15.3:0/902118744 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:55.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.586+0000 7fda2f400640 1 --2- 172.21.15.3:0/902118744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563569135c70 0x5635691495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:55.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.586+0000 7fda2f400640 1 --2- 172.21.15.3:0/902118744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563569140e50 0x563569144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:55.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.586+0000 7fda26000640 1 -- 172.21.15.3:0/902118744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563569135c70 msgr2=0x5635691495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:55.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.586+0000 7fda26000640 1 --2- 172.21.15.3:0/902118744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563569135c70 0x5635691495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.590 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.586+0000 7fda26000640 1 -- 172.21.15.3:0/902118744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563569140e50 msgr2=0x563569144e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:55.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.586+0000 7fda26000640 1 --2- 172.21.15.3:0/902118744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563569140e50 0x563569144e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.586+0000 7fda26000640 1 -- 172.21.15.3:0/902118744 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563569145690 con 0x563569136590 2024-09-19T06:22:55.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.587+0000 7fda26000640 1 --2- 172.21.15.3:0/902118744 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569136590 0x563569144920 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fda18015040 tx=0x7fda18010660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9ad34cd2e3455e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:55.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.587+0000 7fda1cc00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:22:55.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.587+0000 7fda1cc00640 1 -- 172.21.15.3:0/902118744 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda18003800 con 0x563569136590 2024-09-19T06:22:55.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.587+0000 7fda1cc00640 1 -- 172.21.15.3:0/902118744 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7fda180039a0 con 0x563569136590 2024-09-19T06:22:55.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.587+0000 7fda382cd740 1 -- 172.21.15.3:0/902118744 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda180050e0 con 0x563569136590 2024-09-19T06:22:55.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.587+0000 7fda1cc00640 1 -- 172.21.15.3:0/902118744 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fda18028020 con 0x563569136590 2024-09-19T06:22:55.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.587+0000 7fda382cd740 10 client.18333 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:55.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.587+0000 7fda382cd740 1 -- 172.21.15.3:0/902118744 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5635691bbbd0 con 0x563569136590 2024-09-19T06:22:55.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.587+0000 7fda1cc00640 1 -- 172.21.15.3:0/902118744 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda180050e0 con 0x563569136590 2024-09-19T06:22:55.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.588+0000 7fda1cc00640 1 -- 172.21.15.3:0/902118744 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fda1801c950 con 0x563569136590 2024-09-19T06:22:55.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.588+0000 7fda382cd740 10 client.18333 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:55.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.588+0000 7fda382cd740 10 client.18333 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:22:55.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.588+0000 7fda382cd740 20 client.18333 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:55.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.588+0000 7fda382cd740 1 --2- 172.21.15.3:0/902118744 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5635691bc250 0x5635691be670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:55.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.588+0000 7fda382cd740 4 client.18333 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:22:55.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.588+0000 7fda382cd740 1 -- 172.21.15.3:0/902118744 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5635690a3e60 con 0x5635691bc250 2024-09-19T06:22:55.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.588+0000 7fda2f400640 1 --2- 172.21.15.3:0/902118744 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5635691bc250 0x5635691be670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:55.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.589+0000 7fda2f400640 1 --2- 172.21.15.3:0/902118744 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5635691bc250 0x5635691be670 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c1ac14a60a524122 server_cookie=4970c4d3ef52b336 in_seq=0 out_seq=0 2024-09-19T06:22:55.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.589+0000 7fda1cc00640 10 client.18333 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:22:55.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.589+0000 7fda1cc00640 1 -- 172.21.15.3:0/902118744 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5635690a3e60 con 0x5635691bc250 2024-09-19T06:22:55.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.589+0000 7fda1cc00640 10 client.18333 handle_command_reply: tid=0 2024-09-19T06:22:55.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.589+0000 7fda382cd740 1 client.18333 shutdown 2024-09-19T06:22:55.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.589+0000 7fda382cd740 1 -- 172.21.15.3:0/902118744 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569136590 msgr2=0x563569144920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:55.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.589+0000 7fda382cd740 1 --2- 172.21.15.3:0/902118744 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569136590 0x563569144920 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fda18015040 tx=0x7fda18010660 comp rx=0 tx=0).stop 2024-09-19T06:22:55.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.589+0000 7fda382cd740 1 -- 172.21.15.3:0/902118744 shutdown_connections 2024-09-19T06:22:55.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.589+0000 7fda382cd740 1 --2- 172.21.15.3:0/902118744 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5635691bc250 0x5635691be670 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.589+0000 7fda382cd740 1 --2- 172.21.15.3:0/902118744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563569140e50 0x563569144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.589+0000 7fda382cd740 1 --2- 172.21.15.3:0/902118744 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563569136590 0x563569144920 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.589+0000 7fda382cd740 1 --2- 172.21.15.3:0/902118744 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563569135c70 0x5635691495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.589+0000 7fda1cc00640 0 client.18333 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:22:55.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.589+0000 7fda382cd740 1 -- 172.21.15.3:0/902118744 >> 172.21.15.3:0/902118744 conn(0x563569132200 msgr2=0x563569131380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:55.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.589+0000 7fda382cd740 1 -- 172.21.15.3:0/902118744 shutdown_connections 2024-09-19T06:22:55.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.589+0000 7fda382cd740 1 -- 172.21.15.3:0/902118744 wait complete. 2024-09-19T06:22:55.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.589+0000 7fda382cd740 20 client.18333 trim_cache size 0 max 16384 2024-09-19T06:22:55.596 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:22:55.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.590+0000 7fda35800640 1 -- 172.21.15.3:0/93331408 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fda140a3430 msgr2=0x7fda140a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:55.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.590+0000 7fda35800640 1 --2- 172.21.15.3:0/93331408 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fda140a3430 0x7fda140a58f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x563569133060 tx=0x7fda200d3dc0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.590+0000 7fda35800640 1 -- 172.21.15.3:0/93331408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda30104010 msgr2=0x7fda3019a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:55.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.590+0000 7fda35800640 1 --2- 172.21.15.3:0/93331408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda30104010 0x7fda3019a6a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fda2000ebc0 tx=0x7fda2000c6a0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.590+0000 7fda35800640 1 -- 172.21.15.3:0/93331408 shutdown_connections 2024-09-19T06:22:55.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.590+0000 7fda35800640 1 --2- 172.21.15.3:0/93331408 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fda140a3430 0x7fda140a58f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.590+0000 7fda35800640 1 --2- 172.21.15.3:0/93331408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fda30109140 0x7fda3019ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.590+0000 7fda35800640 1 --2- 172.21.15.3:0/93331408 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda301049c0 0x7fda3019abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.590+0000 7fda35800640 1 --2- 172.21.15.3:0/93331408 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fda30104010 0x7fda3019a6a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:55.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.590+0000 7fda35800640 1 -- 172.21.15.3:0/93331408 >> 172.21.15.3:0/93331408 conn(0x7fda300ffa50 msgr2=0x7fda30100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:55.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.590+0000 7fda35800640 1 -- 172.21.15.3:0/93331408 shutdown_connections 2024-09-19T06:22:55.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:55.590+0000 7fda35800640 1 -- 172.21.15.3:0/93331408 wait complete. 2024-09-19T06:22:56.421 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:22:56.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:56 smithi003 ceph-mon[30893]: pgmap v327: 97 pgs: 97 active+clean; 4.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 23 op/s 2024-09-19T06:22:56.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:56 smithi071 ceph-mon[35662]: pgmap v327: 97 pgs: 97 active+clean; 4.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 23 op/s 2024-09-19T06:22:56.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:56 smithi059 ceph-mon[35138]: pgmap v327: 97 pgs: 97 active+clean; 4.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 23 op/s 2024-09-19T06:22:56.799 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:57.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.395+0000 7feda8600640 1 -- 172.21.15.3:0/508303921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feda0109120 msgr2=0x7feda0110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:57.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.395+0000 7feda8600640 1 --2- 172.21.15.3:0/508303921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feda0109120 0x7feda0110ca0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fed98009ca0 tx=0x7fed9802a8c0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.395+0000 7feda8600640 1 -- 172.21.15.3:0/508303921 shutdown_connections 2024-09-19T06:22:57.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.395+0000 7feda8600640 1 --2- 172.21.15.3:0/508303921 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feda0109120 0x7feda0110ca0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.395+0000 7feda8600640 1 --2- 172.21.15.3:0/508303921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feda01049a0 0x7feda01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.395+0000 7feda8600640 1 --2- 172.21.15.3:0/508303921 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feda0103ff0 0x7feda01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.395+0000 7feda8600640 1 -- 172.21.15.3:0/508303921 >> 172.21.15.3:0/508303921 conn(0x7feda00ffa90 msgr2=0x7feda0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:57.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.395+0000 7feda8600640 1 -- 172.21.15.3:0/508303921 shutdown_connections 2024-09-19T06:22:57.399 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.395+0000 7feda8600640 1 -- 172.21.15.3:0/508303921 wait complete. 2024-09-19T06:22:57.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.396+0000 7feda8600640 1 Processor -- start 2024-09-19T06:22:57.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.397+0000 7feda8600640 1 -- start start 2024-09-19T06:22:57.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.397+0000 7feda8600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feda0103ff0 0x7feda019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:57.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.397+0000 7feda8600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feda01049a0 0x7feda019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:57.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.397+0000 7feda8600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feda0109120 0x7feda019eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:57.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.397+0000 7feda8600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7feda0114130 con 0x7feda01049a0 2024-09-19T06:22:57.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.397+0000 7feda8600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7feda0113fb0 con 0x7feda0103ff0 2024-09-19T06:22:57.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.397+0000 7feda8600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7feda01142b0 con 0x7feda0109120 2024-09-19T06:22:57.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.397+0000 7feda5200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feda01049a0 0x7feda019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:57.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.397+0000 7feda6600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feda0109120 0x7feda019eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:57.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.397+0000 7feda5c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feda0103ff0 0x7feda019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:57.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.397+0000 7feda6600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feda0109120 0x7feda019eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:52294/0 (socket says 172.21.15.3:52294) 2024-09-19T06:22:57.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.397+0000 7feda5c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feda0103ff0 0x7feda019a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:41566/0 (socket says 172.21.15.3:41566) 2024-09-19T06:22:57.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.397+0000 7feda6600640 1 -- 172.21.15.3:0/1001955287 learned_addr learned my addr 172.21.15.3:0/1001955287 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:57.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.398+0000 7feda5200640 1 -- 172.21.15.3:0/1001955287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feda0109120 msgr2=0x7feda019eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:57.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.398+0000 7feda5200640 1 --2- 172.21.15.3:0/1001955287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feda0109120 0x7feda019eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.402 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.398+0000 7feda5200640 1 -- 172.21.15.3:0/1001955287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feda0103ff0 msgr2=0x7feda019a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:57.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.398+0000 7feda5200640 1 --2- 172.21.15.3:0/1001955287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feda0103ff0 0x7feda019a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.398+0000 7feda5200640 1 -- 172.21.15.3:0/1001955287 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda019f5c0 con 0x7feda01049a0 2024-09-19T06:22:57.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.398+0000 7feda5200640 1 --2- 172.21.15.3:0/1001955287 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feda01049a0 0x7feda019ab50 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00e9f0 tx=0x7fed8c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:57.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.398+0000 7fed9e000640 1 -- 172.21.15.3:0/1001955287 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c00cd80 con 0x7feda01049a0 2024-09-19T06:22:57.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.399+0000 7feda8600640 1 -- 172.21.15.3:0/1001955287 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda019f8b0 con 0x7feda01049a0 2024-09-19T06:22:57.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.399+0000 7fed9e000640 1 -- 172.21.15.3:0/1001955287 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed8c0035f0 con 0x7feda01049a0 2024-09-19T06:22:57.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.399+0000 7fed9e000640 1 -- 172.21.15.3:0/1001955287 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c010690 con 0x7feda01049a0 2024-09-19T06:22:57.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.399+0000 7feda8600640 1 -- 172.21.15.3:0/1001955287 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda01a7190 con 0x7feda01049a0 2024-09-19T06:22:57.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.402+0000 7fed9e000640 1 -- 172.21.15.3:0/1001955287 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fed8c003b30 con 0x7feda01049a0 2024-09-19T06:22:57.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.402+0000 7fedab084740 1 Processor -- start 2024-09-19T06:22:57.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.402+0000 7fedab084740 1 -- start start 2024-09-19T06:22:57.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.402+0000 7fedab084740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0d7094c70 0x55a0d7095050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:57.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.402+0000 7fedab084740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d7095590 0x55a0d709f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:57.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.402+0000 7fedab084740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0d709fe50 0x55a0d70a2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:57.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.402+0000 7fedab084740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a0d6ffb3e0 con 0x55a0d7095590 2024-09-19T06:22:57.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.402+0000 7fedab084740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a0d6fa2d80 con 0x55a0d709fe50 2024-09-19T06:22:57.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.402+0000 7fedab084740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a0d6ff73a0 con 0x55a0d7094c70 2024-09-19T06:22:57.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.403+0000 7feda5200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0d709fe50 0x55a0d70a2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:57.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.403+0000 7feda5c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d7095590 0x55a0d709f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:57.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.403+0000 7feda5200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0d709fe50 0x55a0d70a2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:41580/0 (socket says 172.21.15.3:41580) 2024-09-19T06:22:57.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.403+0000 7feda5200640 1 -- 172.21.15.3:0/1405975377 learned_addr learned my addr 172.21.15.3:0/1405975377 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:57.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.403+0000 7feda6600640 1 --2- 172.21.15.3:0/1405975377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0d7094c70 0x55a0d7095050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:57.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.403+0000 7feda5200640 1 -- 172.21.15.3:0/1405975377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0d7094c70 msgr2=0x55a0d7095050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:57.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.403+0000 7feda5200640 1 --2- 172.21.15.3:0/1405975377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0d7094c70 0x55a0d7095050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.403+0000 7feda5200640 1 -- 172.21.15.3:0/1405975377 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d7095590 msgr2=0x55a0d709f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:57.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.403+0000 7feda5200640 1 --2- 172.21.15.3:0/1405975377 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d7095590 0x55a0d709f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.403+0000 7feda5200640 1 -- 172.21.15.3:0/1405975377 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0d6fc1ae0 con 0x55a0d709fe50 2024-09-19T06:22:57.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.403+0000 7fed9e000640 1 --2- 172.21.15.3:0/1001955287 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fed880a33b0 0x7fed880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:57.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.403+0000 7feda5200640 1 --2- 172.21.15.3:0/1405975377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0d709fe50 0x55a0d70a2240 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fed8c0cd630 tx=0x7fed8c0d8570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=412eec515a7f0bdf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:57.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.404+0000 7fed9e000640 1 -- 172.21.15.3:0/1001955287 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7fed8c0cfff0 con 0x7feda01049a0 2024-09-19T06:22:57.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.404+0000 7feda6600640 1 --2- 172.21.15.3:0/1001955287 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fed880a33b0 0x7fed880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:57.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.404+0000 7fed92a00640 1 -- 172.21.15.3:0/1405975377 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c098520 con 0x55a0d709fe50 2024-09-19T06:22:57.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.404+0000 7fed92a00640 1 -- 172.21.15.3:0/1405975377 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed8c009450 con 0x55a0d709fe50 2024-09-19T06:22:57.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.404+0000 7fed92a00640 1 -- 172.21.15.3:0/1405975377 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c09bbe0 con 0x55a0d709fe50 2024-09-19T06:22:57.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.405+0000 7fedab084740 1 -- 172.21.15.3:0/1405975377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0d709fe50 msgr2=0x55a0d70a2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:57.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.405+0000 7fedab084740 1 --2- 172.21.15.3:0/1405975377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0d709fe50 0x55a0d70a2240 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fed8c0cd630 tx=0x7fed8c0d8570 comp rx=0 tx=0).stop 2024-09-19T06:22:57.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.405+0000 7feda6600640 1 --2- 172.21.15.3:0/1001955287 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fed880a33b0 0x7fed880a5870 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fed98004af0 tx=0x7fed98004a80 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:57.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.405+0000 7fedab084740 1 -- 172.21.15.3:0/1405975377 shutdown_connections 2024-09-19T06:22:57.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.405+0000 7fedab084740 1 --2- 172.21.15.3:0/1405975377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0d709fe50 0x55a0d70a2240 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.405+0000 7fedab084740 1 --2- 172.21.15.3:0/1405975377 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d7095590 0x55a0d709f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.405+0000 7fedab084740 1 --2- 172.21.15.3:0/1405975377 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0d7094c70 0x55a0d7095050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.405+0000 7fedab084740 1 -- 172.21.15.3:0/1405975377 >> 172.21.15.3:0/1405975377 conn(0x55a0d7091200 msgr2=0x55a0d70915e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:57.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.405+0000 7fedab084740 1 -- 172.21.15.3:0/1405975377 shutdown_connections 2024-09-19T06:22:57.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.405+0000 7fedab084740 1 -- 172.21.15.3:0/1405975377 wait complete. 2024-09-19T06:22:57.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.405+0000 7fedab084740 1 -- start start 2024-09-19T06:22:57.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.406+0000 7fedab084740 1 Processor -- start 2024-09-19T06:22:57.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.406+0000 7fedab084740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d7094c70 0x55a0d709cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:57.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.406+0000 7fedab084740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0d7095590 0x55a0d709d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:57.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.406+0000 7fedab084740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0d709fe50 0x55a0d709d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:57.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.406+0000 7fedab084740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a0d70a2a20 con 0x55a0d7094c70 2024-09-19T06:22:57.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.406+0000 7fedab084740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a0d6fb60f0 con 0x55a0d7095590 2024-09-19T06:22:57.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.406+0000 7fedab084740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a0d70a2ba0 con 0x55a0d709fe50 2024-09-19T06:22:57.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.406+0000 7fedab084740 10 client.0 _ll_register_callbacks cb 0x55a0d6f9dbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:57.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.406+0000 7feda5c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d7094c70 0x55a0d709cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:57.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.406+0000 7feda5200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0d7095590 0x55a0d709d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:57.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.407+0000 7feda5200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0d7095590 0x55a0d709d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:41582/0 (socket says 172.21.15.3:41582) 2024-09-19T06:22:57.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.407+0000 7feda5200640 1 -- 172.21.15.3:0/483522409 learned_addr learned my addr 172.21.15.3:0/483522409 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:57.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.407+0000 7feda6600640 1 --2- 172.21.15.3:0/483522409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0d709fe50 0x55a0d709d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:57.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.407+0000 7feda5200640 1 -- 172.21.15.3:0/483522409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0d709fe50 msgr2=0x55a0d709d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:57.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.407+0000 7feda5200640 1 --2- 172.21.15.3:0/483522409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0d709fe50 0x55a0d709d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.407+0000 7feda5200640 1 -- 172.21.15.3:0/483522409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d7094c70 msgr2=0x55a0d709cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:57.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.407+0000 7feda5200640 1 --2- 172.21.15.3:0/483522409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d7094c70 0x55a0d709cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.407+0000 7feda5200640 1 -- 172.21.15.3:0/483522409 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0d6d6c3c0 con 0x55a0d7095590 2024-09-19T06:22:57.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.407+0000 7feda5c00640 1 --2- 172.21.15.3:0/483522409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d7094c70 0x55a0d709cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:57.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.407+0000 7feda6600640 1 --2- 172.21.15.3:0/483522409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0d709fe50 0x55a0d709d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:57.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.407+0000 7feda5200640 1 --2- 172.21.15.3:0/483522409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0d7095590 0x55a0d709d260 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fed8c0a49c0 tx=0x7fed8c0d8fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e1f10247a3eaec8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:57.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.407+0000 7fed87400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:22:57.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.408+0000 7fed87400640 1 -- 172.21.15.3:0/483522409 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c0b5060 con 0x55a0d7095590 2024-09-19T06:22:57.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.408+0000 7fedab084740 1 -- 172.21.15.3:0/483522409 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed8c009450 con 0x55a0d7095590 2024-09-19T06:22:57.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.408+0000 7fed87400640 1 -- 172.21.15.3:0/483522409 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7fed8c0b5200 con 0x55a0d7095590 2024-09-19T06:22:57.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.408+0000 7fed87400640 1 -- 172.21.15.3:0/483522409 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fed8c09bdc0 con 0x55a0d7095590 2024-09-19T06:22:57.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.408+0000 7fedab084740 10 client.28379 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:57.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.408+0000 7fedab084740 1 -- 172.21.15.3:0/483522409 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a0d70a2a20 con 0x55a0d7095590 2024-09-19T06:22:57.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.408+0000 7fed87400640 1 -- 172.21.15.3:0/483522409 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed8c009450 con 0x55a0d7095590 2024-09-19T06:22:57.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.408+0000 7fed87400640 1 -- 172.21.15.3:0/483522409 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fed8c0988f0 con 0x55a0d7095590 2024-09-19T06:22:57.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.408+0000 7fedab084740 10 client.28379 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:57.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.408+0000 7fedab084740 10 client.28379 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:22:57.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.408+0000 7fedab084740 20 client.28379 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:57.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.408+0000 7fedab084740 1 --2- 172.21.15.3:0/483522409 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55a0d70afbc0 0x55a0d70b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:57.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.409+0000 7fedab084740 4 client.28379 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:57.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.409+0000 7fedab084740 1 -- 172.21.15.3:0/483522409 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0d7008950 con 0x55a0d70afbc0 2024-09-19T06:22:57.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.409+0000 7feda5c00640 1 --2- 172.21.15.3:0/483522409 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55a0d70afbc0 0x55a0d70b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:57.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.409+0000 7feda5c00640 1 --2- 172.21.15.3:0/483522409 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55a0d70afbc0 0x55a0d70b1fb0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5f4de3a068005640 server_cookie=955d20a554a28518 in_seq=0 out_seq=0 2024-09-19T06:22:57.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.409+0000 7fed87400640 10 client.28379 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:22:57.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.410+0000 7fed87400640 1 -- 172.21.15.3:0/483522409 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a0d7008950 con 0x55a0d70afbc0 2024-09-19T06:22:57.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.410+0000 7fed87400640 10 client.28379 handle_command_reply: tid=0 2024-09-19T06:22:57.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.410+0000 7fedab084740 1 client.28379 shutdown 2024-09-19T06:22:57.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.411+0000 7fedab084740 1 -- 172.21.15.3:0/483522409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0d7095590 msgr2=0x55a0d709d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:57.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.411+0000 7fedab084740 1 --2- 172.21.15.3:0/483522409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0d7095590 0x55a0d709d260 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fed8c0a49c0 tx=0x7fed8c0d8fb0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.411+0000 7fedab084740 1 -- 172.21.15.3:0/483522409 shutdown_connections 2024-09-19T06:22:57.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.411+0000 7fedab084740 1 --2- 172.21.15.3:0/483522409 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55a0d70afbc0 0x55a0d70b1fb0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.411+0000 7fedab084740 1 --2- 172.21.15.3:0/483522409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0d709fe50 0x55a0d709d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.411+0000 7fedab084740 1 --2- 172.21.15.3:0/483522409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0d7095590 0x55a0d709d260 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.411+0000 7fedab084740 1 --2- 172.21.15.3:0/483522409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d7094c70 0x55a0d709cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.411+0000 7fed87400640 0 client.28379 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:22:57.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.411+0000 7fedab084740 1 -- 172.21.15.3:0/483522409 >> 172.21.15.3:0/483522409 conn(0x55a0d7091200 msgr2=0x55a0d7096f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:57.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.411+0000 7fedab084740 1 -- 172.21.15.3:0/483522409 shutdown_connections 2024-09-19T06:22:57.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.411+0000 7fedab084740 1 -- 172.21.15.3:0/483522409 wait complete. 2024-09-19T06:22:57.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.411+0000 7fedab084740 20 client.28379 trim_cache size 0 max 16384 2024-09-19T06:22:57.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.425+0000 7fedab084740 1 Processor -- start 2024-09-19T06:22:57.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.425+0000 7fedab084740 1 -- start start 2024-09-19T06:22:57.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.425+0000 7fedab084740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0d7094c70 0x55a0d7090270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:57.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.425+0000 7fedab084740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0d7095590 0x55a0d70b7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:57.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.425+0000 7fedab084740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d709fe50 0x55a0d70b7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:57.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.425+0000 7fedab084740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7feda01afbd0 con 0x55a0d709fe50 2024-09-19T06:22:57.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.425+0000 7fedab084740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7feda01b1710 con 0x55a0d7095590 2024-09-19T06:22:57.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.425+0000 7fedab084740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7feda01b02a0 con 0x55a0d7094c70 2024-09-19T06:22:57.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.425+0000 7feda6600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d709fe50 0x55a0d70b7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:57.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.426+0000 7feda6600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d709fe50 0x55a0d70b7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56082/0 (socket says 172.21.15.3:56082) 2024-09-19T06:22:57.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.426+0000 7feda6600640 1 -- 172.21.15.3:0/230493081 learned_addr learned my addr 172.21.15.3:0/230493081 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:57.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.426+0000 7feda5c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0d7094c70 0x55a0d7090270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:57.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.426+0000 7feda5200640 1 --2- 172.21.15.3:0/230493081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0d7095590 0x55a0d70b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:57.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.426+0000 7feda5c00640 1 -- 172.21.15.3:0/230493081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0d7095590 msgr2=0x55a0d70b7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:57.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.426+0000 7feda5c00640 1 --2- 172.21.15.3:0/230493081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0d7095590 0x55a0d70b7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.426+0000 7feda5c00640 1 -- 172.21.15.3:0/230493081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d709fe50 msgr2=0x55a0d70b7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:57.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.426+0000 7feda5c00640 1 --2- 172.21.15.3:0/230493081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d709fe50 0x55a0d70b7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.426+0000 7feda5c00640 1 -- 172.21.15.3:0/230493081 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0d708c770 con 0x55a0d7094c70 2024-09-19T06:22:57.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.426+0000 7feda6600640 1 --2- 172.21.15.3:0/230493081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d709fe50 0x55a0d70b7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:57.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.426+0000 7feda5c00640 1 --2- 172.21.15.3:0/230493081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0d7094c70 0x55a0d7090270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00c880 tx=0x7fed94005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=395f5c4a61cb8b2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:57.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.427+0000 7fed92000640 1 -- 172.21.15.3:0/230493081 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed94005020 con 0x55a0d7094c70 2024-09-19T06:22:57.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.427+0000 7fed92000640 1 -- 172.21.15.3:0/230493081 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed9400f870 con 0x55a0d7094c70 2024-09-19T06:22:57.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.427+0000 7fed92000640 1 -- 172.21.15.3:0/230493081 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed94004a00 con 0x55a0d7094c70 2024-09-19T06:22:57.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.427+0000 7fedab084740 1 -- 172.21.15.3:0/230493081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0d7094c70 msgr2=0x55a0d7090270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:57.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.427+0000 7fedab084740 1 --2- 172.21.15.3:0/230493081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0d7094c70 0x55a0d7090270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00c880 tx=0x7fed94005f90 comp rx=0 tx=0).stop 2024-09-19T06:22:57.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.427+0000 7fedab084740 1 -- 172.21.15.3:0/230493081 shutdown_connections 2024-09-19T06:22:57.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.427+0000 7fedab084740 1 --2- 172.21.15.3:0/230493081 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d709fe50 0x55a0d70b7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.427+0000 7fedab084740 1 --2- 172.21.15.3:0/230493081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0d7095590 0x55a0d70b7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.427+0000 7fedab084740 1 --2- 172.21.15.3:0/230493081 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0d7094c70 0x55a0d7090270 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.427+0000 7fedab084740 1 -- 172.21.15.3:0/230493081 >> 172.21.15.3:0/230493081 conn(0x55a0d7091200 msgr2=0x55a0d708fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:57.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.427+0000 7fedab084740 1 -- 172.21.15.3:0/230493081 shutdown_connections 2024-09-19T06:22:57.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.427+0000 7fedab084740 1 -- 172.21.15.3:0/230493081 wait complete. 2024-09-19T06:22:57.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.428+0000 7fedab084740 1 -- start start 2024-09-19T06:22:57.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.428+0000 7fedab084740 1 Processor -- start 2024-09-19T06:22:57.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.428+0000 7fedab084740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d7094c70 0x55a0d70a3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:57.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.428+0000 7fedab084740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0d7095590 0x55a0d70a42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:57.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.428+0000 7fedab084740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0d709fe50 0x55a0d70a47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:57.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.428+0000 7fedab084740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7feda01b1040 con 0x55a0d7094c70 2024-09-19T06:22:57.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.428+0000 7fedab084740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7feda01b0970 con 0x55a0d7095590 2024-09-19T06:22:57.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.428+0000 7fedab084740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7feda01adbd0 con 0x55a0d709fe50 2024-09-19T06:22:57.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.429+0000 7fedab084740 10 client.0 _ll_register_callbacks cb 0x7fed940097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:57.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.429+0000 7feda5c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d7094c70 0x55a0d70a3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:57.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.429+0000 7feda5c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d7094c70 0x55a0d70a3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56084/0 (socket says 172.21.15.3:56084) 2024-09-19T06:22:57.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.429+0000 7feda5c00640 1 -- 172.21.15.3:0/2002062493 learned_addr learned my addr 172.21.15.3:0/2002062493 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:57.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.429+0000 7feda5200640 1 --2- 172.21.15.3:0/2002062493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0d7095590 0x55a0d70a42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:57.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.429+0000 7feda6600640 1 --2- 172.21.15.3:0/2002062493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0d709fe50 0x55a0d70a47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:57.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.429+0000 7feda5c00640 1 -- 172.21.15.3:0/2002062493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0d709fe50 msgr2=0x55a0d70a47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:57.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.429+0000 7feda5c00640 1 --2- 172.21.15.3:0/2002062493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0d709fe50 0x55a0d70a47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.429+0000 7feda5c00640 1 -- 172.21.15.3:0/2002062493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0d7095590 msgr2=0x55a0d70a42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:57.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.429+0000 7feda5c00640 1 --2- 172.21.15.3:0/2002062493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0d7095590 0x55a0d70a42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.429+0000 7feda5c00640 1 -- 172.21.15.3:0/2002062493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0d7091e90 con 0x55a0d7094c70 2024-09-19T06:22:57.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.430+0000 7feda5c00640 1 --2- 172.21.15.3:0/2002062493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d7094c70 0x55a0d70a3d70 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fed94014010 tx=0x7fed94012f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6d54af47f31ac7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:57.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.430+0000 7fed87400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:22:57.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.430+0000 7fed87400640 1 -- 172.21.15.3:0/2002062493 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed94012110 con 0x55a0d7094c70 2024-09-19T06:22:57.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.430+0000 7fed87400640 1 -- 172.21.15.3:0/2002062493 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7fed9400fc30 con 0x55a0d7094c70 2024-09-19T06:22:57.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.430+0000 7fedab084740 1 -- 172.21.15.3:0/2002062493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed9400f870 con 0x55a0d7094c70 2024-09-19T06:22:57.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.430+0000 7fed87400640 1 -- 172.21.15.3:0/2002062493 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fed9400fe30 con 0x55a0d7094c70 2024-09-19T06:22:57.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.430+0000 7fedab084740 10 client.18351 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:57.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.430+0000 7fedab084740 1 -- 172.21.15.3:0/2002062493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a0d711a920 con 0x55a0d7094c70 2024-09-19T06:22:57.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.430+0000 7fed87400640 1 -- 172.21.15.3:0/2002062493 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed9400f870 con 0x55a0d7094c70 2024-09-19T06:22:57.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.431+0000 7fed87400640 1 -- 172.21.15.3:0/2002062493 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fed94010430 con 0x55a0d7094c70 2024-09-19T06:22:57.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.431+0000 7fedab084740 10 client.18351 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:57.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.431+0000 7fedab084740 10 client.18351 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:22:57.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.431+0000 7fedab084740 20 client.18351 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:57.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.431+0000 7fedab084740 1 --2- 172.21.15.3:0/2002062493 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55a0d711afd0 0x55a0d711d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:57.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.431+0000 7fedab084740 4 client.18351 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:22:57.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.431+0000 7fedab084740 1 -- 172.21.15.3:0/2002062493 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a0d7002e60 con 0x55a0d711afd0 2024-09-19T06:22:57.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.431+0000 7feda5200640 1 --2- 172.21.15.3:0/2002062493 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55a0d711afd0 0x55a0d711d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:57.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.432+0000 7feda5200640 1 --2- 172.21.15.3:0/2002062493 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55a0d711afd0 0x55a0d711d410 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=deb516378aba891f server_cookie=d78d6890ab65da82 in_seq=0 out_seq=0 2024-09-19T06:22:57.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.432+0000 7fed87400640 10 client.18351 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:22:57.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.432+0000 7fed87400640 1 -- 172.21.15.3:0/2002062493 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a0d7002e60 con 0x55a0d711afd0 2024-09-19T06:22:57.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.432+0000 7fed87400640 10 client.18351 handle_command_reply: tid=0 2024-09-19T06:22:57.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.432+0000 7fedab084740 1 client.18351 shutdown 2024-09-19T06:22:57.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.432+0000 7fedab084740 1 -- 172.21.15.3:0/2002062493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d7094c70 msgr2=0x55a0d70a3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:57.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.432+0000 7fedab084740 1 --2- 172.21.15.3:0/2002062493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d7094c70 0x55a0d70a3d70 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fed94014010 tx=0x7fed94012f40 comp rx=0 tx=0).stop 2024-09-19T06:22:57.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.432+0000 7fedab084740 1 -- 172.21.15.3:0/2002062493 shutdown_connections 2024-09-19T06:22:57.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.432+0000 7fedab084740 1 --2- 172.21.15.3:0/2002062493 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x55a0d711afd0 0x55a0d711d410 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.432+0000 7fedab084740 1 --2- 172.21.15.3:0/2002062493 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0d709fe50 0x55a0d70a47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.432+0000 7fedab084740 1 --2- 172.21.15.3:0/2002062493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0d7095590 0x55a0d70a42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.432+0000 7fedab084740 1 --2- 172.21.15.3:0/2002062493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0d7094c70 0x55a0d70a3d70 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.432+0000 7fed87400640 0 client.18351 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:22:57.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.432+0000 7fedab084740 1 -- 172.21.15.3:0/2002062493 >> 172.21.15.3:0/2002062493 conn(0x55a0d7091200 msgr2=0x55a0d7090380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:57.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.432+0000 7fedab084740 1 -- 172.21.15.3:0/2002062493 shutdown_connections 2024-09-19T06:22:57.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.432+0000 7fedab084740 1 -- 172.21.15.3:0/2002062493 wait complete. 2024-09-19T06:22:57.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.432+0000 7fedab084740 20 client.18351 trim_cache size 0 max 16384 2024-09-19T06:22:57.441 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:22:57.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.433+0000 7feda8600640 1 -- 172.21.15.3:0/1001955287 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fed880a33b0 msgr2=0x7fed880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:57.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.433+0000 7feda8600640 1 --2- 172.21.15.3:0/1001955287 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fed880a33b0 0x7fed880a5870 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fed98004af0 tx=0x7fed98004a80 comp rx=0 tx=0).stop 2024-09-19T06:22:57.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.433+0000 7feda8600640 1 -- 172.21.15.3:0/1001955287 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feda01049a0 msgr2=0x7feda019ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:57.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.433+0000 7feda8600640 1 --2- 172.21.15.3:0/1001955287 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feda01049a0 0x7feda019ab50 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00e9f0 tx=0x7fed8c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.433+0000 7feda8600640 1 -- 172.21.15.3:0/1001955287 shutdown_connections 2024-09-19T06:22:57.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.433+0000 7feda8600640 1 --2- 172.21.15.3:0/1001955287 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fed880a33b0 0x7fed880a5870 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.433+0000 7feda8600640 1 --2- 172.21.15.3:0/1001955287 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7feda0109120 0x7feda019eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.433+0000 7feda8600640 1 --2- 172.21.15.3:0/1001955287 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feda01049a0 0x7feda019ab50 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.433+0000 7feda8600640 1 --2- 172.21.15.3:0/1001955287 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feda0103ff0 0x7feda019a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:57.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.433+0000 7feda8600640 1 -- 172.21.15.3:0/1001955287 >> 172.21.15.3:0/1001955287 conn(0x7feda00ffa90 msgr2=0x7feda01005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:57.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.433+0000 7feda8600640 1 -- 172.21.15.3:0/1001955287 shutdown_connections 2024-09-19T06:22:57.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:57.433+0000 7feda8600640 1 -- 172.21.15.3:0/1001955287 wait complete. 2024-09-19T06:22:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.108+0000 7f8e3ae00640 1 -- 172.21.15.3:0/2555294941 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e34109090 msgr2=0x7f8e34110be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.108+0000 7f8e3ae00640 1 --2- 172.21.15.3:0/2555294941 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e34109090 0x7f8e34110be0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c009ca0 tx=0x7f8e2c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.110 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.108+0000 7f8e3ae00640 1 -- 172.21.15.3:0/2555294941 shutdown_connections 2024-09-19T06:22:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.108+0000 7f8e3ae00640 1 --2- 172.21.15.3:0/2555294941 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e34109090 0x7f8e34110be0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.108+0000 7f8e3ae00640 1 --2- 172.21.15.3:0/2555294941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e341048f0 0x7f8e34108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.108+0000 7f8e3ae00640 1 --2- 172.21.15.3:0/2555294941 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e34103f40 0x7f8e34104320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.108+0000 7f8e3ae00640 1 -- 172.21.15.3:0/2555294941 >> 172.21.15.3:0/2555294941 conn(0x7f8e340ff970 msgr2=0x7f8e34101d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.108+0000 7f8e3ae00640 1 -- 172.21.15.3:0/2555294941 shutdown_connections 2024-09-19T06:22:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.108+0000 7f8e3ae00640 1 -- 172.21.15.3:0/2555294941 wait complete. 2024-09-19T06:22:58.111 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.109+0000 7f8e3ae00640 1 Processor -- start 2024-09-19T06:22:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.109+0000 7f8e3ae00640 1 -- start start 2024-09-19T06:22:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.109+0000 7f8e3ae00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e34103f40 0x7f8e34076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.109+0000 7f8e3ae00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e34109090 0x7f8e34076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.109+0000 7f8e3ae00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e34077180 0x7f8e341aab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.109+0000 7f8e3ae00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8e34114130 con 0x7f8e34109090 2024-09-19T06:22:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.109+0000 7f8e3ae00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8e34113fb0 con 0x7f8e34103f40 2024-09-19T06:22:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.109+0000 7f8e3ae00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8e341142b0 con 0x7f8e34077180 2024-09-19T06:22:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.110+0000 7f8e33400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e34109090 0x7f8e34076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.110+0000 7f8e33e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e34103f40 0x7f8e34076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.110+0000 7f8e33400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e34109090 0x7f8e34076c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56106/0 (socket says 172.21.15.3:56106) 2024-09-19T06:22:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.110+0000 7f8e33400640 1 -- 172.21.15.3:0/4001972337 learned_addr learned my addr 172.21.15.3:0/4001972337 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:58.113 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.110+0000 7f8e38e00640 1 --2- 172.21.15.3:0/4001972337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e34077180 0x7f8e341aab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.110+0000 7f8e33e00640 1 -- 172.21.15.3:0/4001972337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e34077180 msgr2=0x7f8e341aab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.110+0000 7f8e33e00640 1 --2- 172.21.15.3:0/4001972337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e34077180 0x7f8e341aab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.110+0000 7f8e33e00640 1 -- 172.21.15.3:0/4001972337 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e34109090 msgr2=0x7f8e34076c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.110+0000 7f8e33e00640 1 --2- 172.21.15.3:0/4001972337 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e34109090 0x7f8e34076c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.110+0000 7f8e33e00640 1 -- 172.21.15.3:0/4001972337 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e341ab0b0 con 0x7f8e34103f40 2024-09-19T06:22:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.110+0000 7f8e33e00640 1 --2- 172.21.15.3:0/4001972337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e34103f40 0x7f8e34076700 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400e9f0 tx=0x7f8e2400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.111+0000 7f8e30c00640 1 -- 172.21.15.3:0/4001972337 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2400ccc0 con 0x7f8e34103f40 2024-09-19T06:22:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.111+0000 7f8e3ae00640 1 -- 172.21.15.3:0/4001972337 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e341ab3a0 con 0x7f8e34103f40 2024-09-19T06:22:58.114 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.111+0000 7f8e30c00640 1 -- 172.21.15.3:0/4001972337 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e24005020 con 0x7f8e34103f40 2024-09-19T06:22:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.111+0000 7f8e30c00640 1 -- 172.21.15.3:0/4001972337 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e240049e0 con 0x7f8e34103f40 2024-09-19T06:22:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.111+0000 7f8e3ae00640 1 -- 172.21.15.3:0/4001972337 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e341ab870 con 0x7f8e34103f40 2024-09-19T06:22:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.114+0000 7f8e3dc87740 1 Processor -- start 2024-09-19T06:22:58.115 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.114+0000 7f8e3dc87740 1 -- start start 2024-09-19T06:22:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.114+0000 7f8e3dc87740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb98261e0 0x55cbb98265c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.114+0000 7f8e3dc87740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb9826b00 0x55cbb9830e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.114+0000 7f8e3dc87740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb98313a0 0x55cbb9833790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:58.117 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.114+0000 7f8e3dc87740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55cbb978c100 con 0x55cbb9826b00 2024-09-19T06:22:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.114+0000 7f8e3dc87740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55cbb97341b0 con 0x55cbb98313a0 2024-09-19T06:22:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.114+0000 7f8e3dc87740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cbb97880c0 con 0x55cbb98261e0 2024-09-19T06:22:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.114+0000 7f8e30c00640 1 -- 172.21.15.3:0/4001972337 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f8e24005560 con 0x7f8e34103f40 2024-09-19T06:22:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.114+0000 7f8e38e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb98261e0 0x55cbb98265c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.114+0000 7f8e38e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb98261e0 0x55cbb98265c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:52338/0 (socket says 172.21.15.3:52338) 2024-09-19T06:22:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.114+0000 7f8e38e00640 1 -- 172.21.15.3:0/1868395166 learned_addr learned my addr 172.21.15.3:0/1868395166 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.114+0000 7f8e33e00640 1 --2- 172.21.15.3:0/1868395166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb9826b00 0x55cbb9830e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.115+0000 7f8e33400640 1 --2- 172.21.15.3:0/1868395166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb98313a0 0x55cbb9833790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.115+0000 7f8e38e00640 1 -- 172.21.15.3:0/1868395166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb98313a0 msgr2=0x55cbb9833790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.115+0000 7f8e38e00640 1 --2- 172.21.15.3:0/1868395166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb98313a0 0x55cbb9833790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.115+0000 7f8e38e00640 1 -- 172.21.15.3:0/1868395166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb9826b00 msgr2=0x55cbb9830e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.115+0000 7f8e38e00640 1 --2- 172.21.15.3:0/1868395166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb9826b00 0x55cbb9830e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.118 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.115+0000 7f8e38e00640 1 -- 172.21.15.3:0/1868395166 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbb949f210 con 0x55cbb98261e0 2024-09-19T06:22:58.119 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.115+0000 7f8e38e00640 1 --2- 172.21.15.3:0/1868395166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb98261e0 0x55cbb98265c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c009870 tx=0x7f8e2c0098a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93c5fe0f083f8075 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:58.119 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.115+0000 7f8e29600640 1 -- 172.21.15.3:0/1868395166 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c031db0 con 0x55cbb98261e0 2024-09-19T06:22:58.119 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.115+0000 7f8e29600640 1 -- 172.21.15.3:0/1868395166 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e2c036040 con 0x55cbb98261e0 2024-09-19T06:22:58.119 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.115+0000 7f8e30c00640 1 --2- 172.21.15.3:0/4001972337 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8e180a33b0 0x7f8e180a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:58.119 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.115+0000 7f8e29600640 1 -- 172.21.15.3:0/1868395166 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c0043c0 con 0x55cbb98261e0 2024-09-19T06:22:58.119 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.116+0000 7f8e30c00640 1 -- 172.21.15.3:0/4001972337 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f8e240cfdb0 con 0x7f8e34103f40 2024-09-19T06:22:58.119 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.116+0000 7f8e33e00640 1 --2- 172.21.15.3:0/4001972337 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8e180a33b0 0x7f8e180a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.116+0000 7f8e3dc87740 1 -- 172.21.15.3:0/1868395166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb98261e0 msgr2=0x55cbb98265c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.116+0000 7f8e3dc87740 1 --2- 172.21.15.3:0/1868395166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb98261e0 0x55cbb98265c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c009870 tx=0x7f8e2c0098a0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.116+0000 7f8e3dc87740 1 -- 172.21.15.3:0/1868395166 shutdown_connections 2024-09-19T06:22:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.116+0000 7f8e3dc87740 1 --2- 172.21.15.3:0/1868395166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb98313a0 0x55cbb9833790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.116+0000 7f8e3dc87740 1 --2- 172.21.15.3:0/1868395166 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb9826b00 0x55cbb9830e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.116+0000 7f8e3dc87740 1 --2- 172.21.15.3:0/1868395166 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb98261e0 0x55cbb98265c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.116+0000 7f8e3dc87740 1 -- 172.21.15.3:0/1868395166 >> 172.21.15.3:0/1868395166 conn(0x55cbb9822750 msgr2=0x55cbb9822b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.116+0000 7f8e3dc87740 1 -- 172.21.15.3:0/1868395166 shutdown_connections 2024-09-19T06:22:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.116+0000 7f8e33e00640 1 --2- 172.21.15.3:0/4001972337 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8e180a33b0 0x7f8e180a5870 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55cbb98235b0 tx=0x7f8e240054d0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.117+0000 7f8e3dc87740 1 -- 172.21.15.3:0/1868395166 wait complete. 2024-09-19T06:22:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.117+0000 7f8e3dc87740 1 -- start start 2024-09-19T06:22:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.117+0000 7f8e3dc87740 1 Processor -- start 2024-09-19T06:22:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.118+0000 7f8e3dc87740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb98261e0 0x55cbb982e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.118+0000 7f8e3dc87740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb9826b00 0x55cbb982e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.118+0000 7f8e3dc87740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb98313a0 0x55cbb982ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.118+0000 7f8e3dc87740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55cbb9833f70 con 0x55cbb9826b00 2024-09-19T06:22:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.118+0000 7f8e3dc87740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55cbb9715090 con 0x55cbb98261e0 2024-09-19T06:22:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.118+0000 7f8e3dc87740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55cbb98340f0 con 0x55cbb98313a0 2024-09-19T06:22:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.118+0000 7f8e3dc87740 10 client.0 _ll_register_callbacks cb 0x55cbb9769f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.118+0000 7f8e33400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb9826b00 0x55cbb982e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.118+0000 7f8e33400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb9826b00 0x55cbb982e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56136/0 (socket says 172.21.15.3:56136) 2024-09-19T06:22:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.118+0000 7f8e33400640 1 -- 172.21.15.3:0/4041267772 learned_addr learned my addr 172.21.15.3:0/4041267772 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.118+0000 7f8e38e00640 1 --2- 172.21.15.3:0/4041267772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb98261e0 0x55cbb982e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.118+0000 7f8e38e00640 1 --2- 172.21.15.3:0/4041267772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb98313a0 0x55cbb982ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.118+0000 7f8e33400640 1 -- 172.21.15.3:0/4041267772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb98313a0 msgr2=0x55cbb982ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.118+0000 7f8e33400640 1 --2- 172.21.15.3:0/4041267772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb98313a0 0x55cbb982ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.118+0000 7f8e33400640 1 -- 172.21.15.3:0/4041267772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb98261e0 msgr2=0x55cbb982e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.118+0000 7f8e33400640 1 --2- 172.21.15.3:0/4041267772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb98261e0 0x55cbb982e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.118+0000 7f8e33400640 1 -- 172.21.15.3:0/4041267772 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbb956b620 con 0x55cbb9826b00 2024-09-19T06:22:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.119+0000 7f8e33400640 1 --2- 172.21.15.3:0/4041267772 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb9826b00 0x55cbb982e800 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f8e200126d0 tx=0x7f8e20012ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76242496a6ec2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.119+0000 7f8e1e000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:22:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.119+0000 7f8e1e000640 1 -- 172.21.15.3:0/4041267772 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e20004050 con 0x55cbb9826b00 2024-09-19T06:22:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.119+0000 7f8e1e000640 1 -- 172.21.15.3:0/4041267772 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f8e200041f0 con 0x55cbb9826b00 2024-09-19T06:22:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.119+0000 7f8e3dc87740 1 -- 172.21.15.3:0/4041267772 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e2c036040 con 0x55cbb9826b00 2024-09-19T06:22:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.119+0000 7f8e1e000640 1 -- 172.21.15.3:0/4041267772 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8e200043f0 con 0x55cbb9826b00 2024-09-19T06:22:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.119+0000 7f8e3dc87740 10 client.18363 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.119+0000 7f8e3dc87740 1 -- 172.21.15.3:0/4041267772 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cbb983fb90 con 0x55cbb9826b00 2024-09-19T06:22:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.120+0000 7f8e1e000640 1 -- 172.21.15.3:0/4041267772 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e2c036040 con 0x55cbb9826b00 2024-09-19T06:22:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.120+0000 7f8e1e000640 1 -- 172.21.15.3:0/4041267772 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8e20003990 con 0x55cbb9826b00 2024-09-19T06:22:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.120+0000 7f8e3dc87740 10 client.18363 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:58.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.120+0000 7f8e3dc87740 10 client.18363 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:58.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.120+0000 7f8e3dc87740 20 client.18363 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:58.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.120+0000 7f8e3dc87740 1 --2- 172.21.15.3:0/4041267772 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55cbb9841050 0x55cbb9843440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:58.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.120+0000 7f8e3dc87740 4 client.18363 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:58.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.120+0000 7f8e3dc87740 1 -- 172.21.15.3:0/4041267772 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cbb9799830 con 0x55cbb9841050 2024-09-19T06:22:58.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.120+0000 7f8e38e00640 1 --2- 172.21.15.3:0/4041267772 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55cbb9841050 0x55cbb9843440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:58.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.121+0000 7f8e38e00640 1 --2- 172.21.15.3:0/4041267772 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55cbb9841050 0x55cbb9843440 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e52cb86aa14f8b7f server_cookie=e2e288a7816cf1c8 in_seq=0 out_seq=0 2024-09-19T06:22:58.126 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.121+0000 7f8e1e000640 10 client.18363 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:58.127 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.122+0000 7f8e1e000640 1 -- 172.21.15.3:0/4041267772 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cbb9799830 con 0x55cbb9841050 2024-09-19T06:22:58.127 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.122+0000 7f8e1e000640 10 client.18363 handle_command_reply: tid=0 2024-09-19T06:22:58.127 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.122+0000 7f8e3dc87740 1 client.18363 shutdown 2024-09-19T06:22:58.127 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.122+0000 7f8e3dc87740 1 -- 172.21.15.3:0/4041267772 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb9826b00 msgr2=0x55cbb982e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.122+0000 7f8e3dc87740 1 --2- 172.21.15.3:0/4041267772 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb9826b00 0x55cbb982e800 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f8e200126d0 tx=0x7f8e20012ad0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.122+0000 7f8e3dc87740 1 -- 172.21.15.3:0/4041267772 shutdown_connections 2024-09-19T06:22:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.122+0000 7f8e3dc87740 1 --2- 172.21.15.3:0/4041267772 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55cbb9841050 0x55cbb9843440 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.122+0000 7f8e3dc87740 1 --2- 172.21.15.3:0/4041267772 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb98313a0 0x55cbb982ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.122+0000 7f8e1e000640 0 client.18363 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.122+0000 7f8e3dc87740 1 --2- 172.21.15.3:0/4041267772 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb9826b00 0x55cbb982e800 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.122+0000 7f8e3dc87740 1 --2- 172.21.15.3:0/4041267772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb98261e0 0x55cbb982e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.122+0000 7f8e3dc87740 1 -- 172.21.15.3:0/4041267772 >> 172.21.15.3:0/4041267772 conn(0x55cbb9822750 msgr2=0x55cbb98284b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.122+0000 7f8e3dc87740 1 -- 172.21.15.3:0/4041267772 shutdown_connections 2024-09-19T06:22:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.122+0000 7f8e3dc87740 1 -- 172.21.15.3:0/4041267772 wait complete. 2024-09-19T06:22:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.122+0000 7f8e3dc87740 20 client.18363 trim_cache size 0 max 16384 2024-09-19T06:22:58.140 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.137+0000 7f8e3dc87740 1 Processor -- start 2024-09-19T06:22:58.140 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.137+0000 7f8e3dc87740 1 -- start start 2024-09-19T06:22:58.140 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.138+0000 7f8e3dc87740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb98261e0 0x55cbb9848d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:58.140 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.138+0000 7f8e3dc87740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb9826b00 0x55cbb9849250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:58.140 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.138+0000 7f8e3dc87740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb98313a0 0x55cbb982b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:58.140 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.138+0000 7f8e3dc87740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8e341b4030 con 0x55cbb9826b00 2024-09-19T06:22:58.140 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.138+0000 7f8e3dc87740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8e341b5b70 con 0x55cbb98313a0 2024-09-19T06:22:58.140 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.138+0000 7f8e3dc87740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8e341b4700 con 0x55cbb98261e0 2024-09-19T06:22:58.141 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.138+0000 7f8e33400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb9826b00 0x55cbb9849250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:58.141 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.138+0000 7f8e33400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb9826b00 0x55cbb9849250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56150/0 (socket says 172.21.15.3:56150) 2024-09-19T06:22:58.141 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.138+0000 7f8e33400640 1 -- 172.21.15.3:0/2162508208 learned_addr learned my addr 172.21.15.3:0/2162508208 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:58.141 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.138+0000 7f8e38e00640 1 --2- 172.21.15.3:0/2162508208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb98313a0 0x55cbb982b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:58.141 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.138+0000 7f8e38e00640 1 --2- 172.21.15.3:0/2162508208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb98261e0 0x55cbb9848d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:58.141 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.138+0000 7f8e33400640 1 -- 172.21.15.3:0/2162508208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb98261e0 msgr2=0x55cbb9848d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:58.141 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.138+0000 7f8e33400640 1 --2- 172.21.15.3:0/2162508208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb98261e0 0x55cbb9848d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.141 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.138+0000 7f8e33400640 1 -- 172.21.15.3:0/2162508208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb98313a0 msgr2=0x55cbb982b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:58.141 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.138+0000 7f8e33400640 1 --2- 172.21.15.3:0/2162508208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb98313a0 0x55cbb982b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.141 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.138+0000 7f8e33400640 1 -- 172.21.15.3:0/2162508208 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbb9822580 con 0x55cbb9826b00 2024-09-19T06:22:58.141 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.138+0000 7f8e38e00640 1 --2- 172.21.15.3:0/2162508208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb98313a0 0x55cbb982b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:58.145 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.139+0000 7f8e33400640 1 --2- 172.21.15.3:0/2162508208 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb9826b00 0x55cbb9849250 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f8e20009d40 tx=0x7f8e20010610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464957b3d9158314 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:58.145 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.139+0000 7f8e28c00640 1 -- 172.21.15.3:0/2162508208 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e20028040 con 0x55cbb9826b00 2024-09-19T06:22:58.145 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.139+0000 7f8e28c00640 1 -- 172.21.15.3:0/2162508208 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e20003ad0 con 0x55cbb9826b00 2024-09-19T06:22:58.145 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.139+0000 7f8e28c00640 1 -- 172.21.15.3:0/2162508208 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e200052c0 con 0x55cbb9826b00 2024-09-19T06:22:58.145 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.139+0000 7f8e3dc87740 1 -- 172.21.15.3:0/2162508208 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb9826b00 msgr2=0x55cbb9849250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:58.145 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.139+0000 7f8e3dc87740 1 --2- 172.21.15.3:0/2162508208 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb9826b00 0x55cbb9849250 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f8e20009d40 tx=0x7f8e20010610 comp rx=0 tx=0).stop 2024-09-19T06:22:58.145 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.140+0000 7f8e3dc87740 1 -- 172.21.15.3:0/2162508208 shutdown_connections 2024-09-19T06:22:58.145 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.140+0000 7f8e3dc87740 1 --2- 172.21.15.3:0/2162508208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb98313a0 0x55cbb982b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.145 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.140+0000 7f8e3dc87740 1 --2- 172.21.15.3:0/2162508208 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb9826b00 0x55cbb9849250 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.145 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.140+0000 7f8e3dc87740 1 --2- 172.21.15.3:0/2162508208 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb98261e0 0x55cbb9848d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.145 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.140+0000 7f8e3dc87740 1 -- 172.21.15.3:0/2162508208 >> 172.21.15.3:0/2162508208 conn(0x55cbb9822750 msgr2=0x55cbb9830230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.140+0000 7f8e3dc87740 1 -- 172.21.15.3:0/2162508208 shutdown_connections 2024-09-19T06:22:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.140+0000 7f8e3dc87740 1 -- 172.21.15.3:0/2162508208 wait complete. 2024-09-19T06:22:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.140+0000 7f8e3dc87740 1 -- start start 2024-09-19T06:22:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.140+0000 7f8e3dc87740 1 Processor -- start 2024-09-19T06:22:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.141+0000 7f8e3dc87740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb98261e0 0x55cbb98354a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.141+0000 7f8e3dc87740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb9826b00 0x55cbb98359e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.141+0000 7f8e3dc87740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb98313a0 0x55cbb98aace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.141+0000 7f8e3dc87740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8e341b54a0 con 0x55cbb98261e0 2024-09-19T06:22:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.141+0000 7f8e3dc87740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f8e341b4dd0 con 0x55cbb9826b00 2024-09-19T06:22:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.141+0000 7f8e3dc87740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f8e341b2030 con 0x55cbb98313a0 2024-09-19T06:22:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.141+0000 7f8e3dc87740 10 client.0 _ll_register_callbacks cb 0x7f8e200096e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.141+0000 7f8e38e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb98261e0 0x55cbb98354a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:58.146 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.141+0000 7f8e38e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb98261e0 0x55cbb98354a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56164/0 (socket says 172.21.15.3:56164) 2024-09-19T06:22:58.147 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.141+0000 7f8e38e00640 1 -- 172.21.15.3:0/4221967189 learned_addr learned my addr 172.21.15.3:0/4221967189 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:58.147 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.141+0000 7f8e33400640 1 --2- 172.21.15.3:0/4221967189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb9826b00 0x55cbb98359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:58.147 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.141+0000 7f8e38e00640 1 --2- 172.21.15.3:0/4221967189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb98313a0 0x55cbb98aace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:58.147 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.141+0000 7f8e38e00640 1 -- 172.21.15.3:0/4221967189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb98313a0 msgr2=0x55cbb98aace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:58.147 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.141+0000 7f8e38e00640 1 --2- 172.21.15.3:0/4221967189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb98313a0 0x55cbb98aace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.147 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.141+0000 7f8e38e00640 1 -- 172.21.15.3:0/4221967189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb9826b00 msgr2=0x55cbb98359e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:58.147 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.141+0000 7f8e38e00640 1 --2- 172.21.15.3:0/4221967189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb9826b00 0x55cbb98359e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.147 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.141+0000 7f8e38e00640 1 -- 172.21.15.3:0/4221967189 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbb98233e0 con 0x55cbb98261e0 2024-09-19T06:22:58.147 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.141+0000 7f8e33400640 1 --2- 172.21.15.3:0/4221967189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb9826b00 0x55cbb98359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:58.147 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.142+0000 7f8e38e00640 1 --2- 172.21.15.3:0/4221967189 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb98261e0 0x55cbb98354a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c02f470 tx=0x7f8e20009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfba22fa4e4da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:58.147 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.142+0000 7f8e1e000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:22:58.147 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.142+0000 7f8e1e000640 1 -- 172.21.15.3:0/4221967189 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c003b70 con 0x55cbb98261e0 2024-09-19T06:22:58.147 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.142+0000 7f8e3dc87740 1 -- 172.21.15.3:0/4221967189 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e20003ad0 con 0x55cbb98261e0 2024-09-19T06:22:58.148 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.142+0000 7f8e1e000640 1 -- 172.21.15.3:0/4221967189 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f8e2c003d10 con 0x55cbb98261e0 2024-09-19T06:22:58.148 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.142+0000 7f8e1e000640 1 -- 172.21.15.3:0/4221967189 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8e2c0040d0 con 0x55cbb98261e0 2024-09-19T06:22:58.148 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.142+0000 7f8e3dc87740 10 client.18369 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:58.148 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.142+0000 7f8e3dc87740 1 -- 172.21.15.3:0/4221967189 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cbb981dd60 con 0x55cbb98261e0 2024-09-19T06:22:58.148 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.142+0000 7f8e1e000640 1 -- 172.21.15.3:0/4221967189 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e20003ad0 con 0x55cbb98261e0 2024-09-19T06:22:58.148 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.143+0000 7f8e1e000640 1 -- 172.21.15.3:0/4221967189 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8e2c02fba0 con 0x55cbb98261e0 2024-09-19T06:22:58.148 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.143+0000 7f8e3dc87740 10 client.18369 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:58.148 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.143+0000 7f8e3dc87740 10 client.18369 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:58.148 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.143+0000 7f8e3dc87740 20 client.18369 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:58.148 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.143+0000 7f8e3dc87740 1 --2- 172.21.15.3:0/4221967189 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55cbb98ac3f0 0x55cbb98ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:58.148 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.143+0000 7f8e3dc87740 4 client.18369 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:22:58.148 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.143+0000 7f8e3dc87740 1 -- 172.21.15.3:0/4221967189 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cbb9793b80 con 0x55cbb98ac3f0 2024-09-19T06:22:58.148 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.143+0000 7f8e33400640 1 --2- 172.21.15.3:0/4221967189 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55cbb98ac3f0 0x55cbb98ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:58.149 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.144+0000 7f8e33400640 1 --2- 172.21.15.3:0/4221967189 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55cbb98ac3f0 0x55cbb98ae7e0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7762ab8a804f383d server_cookie=44f48f661413f2d0 in_seq=0 out_seq=0 2024-09-19T06:22:58.149 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.144+0000 7f8e1e000640 10 client.18369 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:58.160 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.158+0000 7f8e1e000640 1 -- 172.21.15.3:0/4221967189 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cbb9793b80 con 0x55cbb98ac3f0 2024-09-19T06:22:58.160 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.158+0000 7f8e1e000640 10 client.18369 handle_command_reply: tid=0 2024-09-19T06:22:58.160 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.158+0000 7f8e3dc87740 1 client.18369 shutdown 2024-09-19T06:22:58.160 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.158+0000 7f8e3dc87740 1 -- 172.21.15.3:0/4221967189 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb98261e0 msgr2=0x55cbb98354a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:58.160 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.158+0000 7f8e3dc87740 1 --2- 172.21.15.3:0/4221967189 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb98261e0 0x55cbb98354a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c02f470 tx=0x7f8e20009d70 comp rx=0 tx=0).stop 2024-09-19T06:22:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.158+0000 7f8e3dc87740 1 -- 172.21.15.3:0/4221967189 shutdown_connections 2024-09-19T06:22:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.158+0000 7f8e3dc87740 1 --2- 172.21.15.3:0/4221967189 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55cbb98ac3f0 0x55cbb98ae7e0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.158+0000 7f8e3dc87740 1 --2- 172.21.15.3:0/4221967189 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55cbb98313a0 0x55cbb98aace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.158+0000 7f8e1e000640 0 client.18369 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.158+0000 7f8e3dc87740 1 --2- 172.21.15.3:0/4221967189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cbb9826b00 0x55cbb98359e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.158+0000 7f8e3dc87740 1 --2- 172.21.15.3:0/4221967189 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55cbb98261e0 0x55cbb98354a0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.158+0000 7f8e3dc87740 1 -- 172.21.15.3:0/4221967189 >> 172.21.15.3:0/4221967189 conn(0x55cbb9822750 msgr2=0x55cbb9828460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.158+0000 7f8e3dc87740 1 -- 172.21.15.3:0/4221967189 shutdown_connections 2024-09-19T06:22:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.158+0000 7f8e3dc87740 1 -- 172.21.15.3:0/4221967189 wait complete. 2024-09-19T06:22:58.161 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.158+0000 7f8e3dc87740 20 client.18369 trim_cache size 0 max 16384 2024-09-19T06:22:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:22:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:22:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:22:58.162 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:22:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.159+0000 7f8e3ae00640 1 -- 172.21.15.3:0/4001972337 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8e180a33b0 msgr2=0x7f8e180a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.159+0000 7f8e3ae00640 1 --2- 172.21.15.3:0/4001972337 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8e180a33b0 0x7f8e180a5870 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55cbb98235b0 tx=0x7f8e240054d0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.159+0000 7f8e3ae00640 1 -- 172.21.15.3:0/4001972337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e34103f40 msgr2=0x7f8e34076700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.159+0000 7f8e3ae00640 1 --2- 172.21.15.3:0/4001972337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e34103f40 0x7f8e34076700 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400e9f0 tx=0x7f8e2400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.159+0000 7f8e3ae00640 1 -- 172.21.15.3:0/4001972337 shutdown_connections 2024-09-19T06:22:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.159+0000 7f8e3ae00640 1 --2- 172.21.15.3:0/4001972337 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f8e180a33b0 0x7f8e180a5870 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.159+0000 7f8e3ae00640 1 --2- 172.21.15.3:0/4001972337 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f8e34077180 0x7f8e341aab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.159+0000 7f8e3ae00640 1 --2- 172.21.15.3:0/4001972337 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e34109090 0x7f8e34076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.159+0000 7f8e3ae00640 1 --2- 172.21.15.3:0/4001972337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e34103f40 0x7f8e34076700 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.159+0000 7f8e3ae00640 1 -- 172.21.15.3:0/4001972337 >> 172.21.15.3:0/4001972337 conn(0x7f8e340ff970 msgr2=0x7f8e34100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.159+0000 7f8e3ae00640 1 -- 172.21.15.3:0/4001972337 shutdown_connections 2024-09-19T06:22:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:22:58.159+0000 7f8e3ae00640 1 -- 172.21.15.3:0/4001972337 wait complete. 2024-09-19T06:22:58.365 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:22:58.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:22:58 smithi003 ceph-mon[30893]: pgmap v328: 97 pgs: 97 active+clean; 4.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-19T06:22:58.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:22:58 smithi071 ceph-mon[35662]: pgmap v328: 97 pgs: 97 active+clean; 4.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-19T06:22:58.748 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:22:58.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:22:58 smithi059 ceph-mon[35138]: pgmap v328: 97 pgs: 97 active+clean; 4.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 16 op/s 2024-09-19T06:22:59.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.309+0000 7f3a3a200640 1 -- 172.21.15.3:0/1201435140 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a34112a30 msgr2=0x7f3a34114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:59.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.309+0000 7f3a3a200640 1 --2- 172.21.15.3:0/1201435140 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a34112a30 0x7f3a34114e20 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c009ca0 tx=0x7f3a2c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.309+0000 7f3a3a200640 1 -- 172.21.15.3:0/1201435140 shutdown_connections 2024-09-19T06:22:59.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.309+0000 7f3a3a200640 1 --2- 172.21.15.3:0/1201435140 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a34112a30 0x7f3a34114e20 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.309+0000 7f3a3a200640 1 --2- 172.21.15.3:0/1201435140 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a34077040 0x7f3a341124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.309+0000 7f3a3a200640 1 --2- 172.21.15.3:0/1201435140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a34076720 0x7f3a34076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.309+0000 7f3a3a200640 1 -- 172.21.15.3:0/1201435140 >> 172.21.15.3:0/1201435140 conn(0x7f3a340ffa90 msgr2=0x7f3a34101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:59.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.309+0000 7f3a3a200640 1 -- 172.21.15.3:0/1201435140 shutdown_connections 2024-09-19T06:22:59.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.309+0000 7f3a3a200640 1 -- 172.21.15.3:0/1201435140 wait complete. 2024-09-19T06:22:59.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.310+0000 7f3a3a200640 1 Processor -- start 2024-09-19T06:22:59.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.310+0000 7f3a3a200640 1 -- start start 2024-09-19T06:22:59.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.310+0000 7f3a3a200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a34076720 0x7f3a341a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:59.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.310+0000 7f3a3a200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a34077040 0x7f3a341a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:59.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.310+0000 7f3a3a200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a34112a30 0x7f3a3419e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:59.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.310+0000 7f3a3a200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3a341185c0 con 0x7f3a34076720 2024-09-19T06:22:59.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.310+0000 7f3a3a200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3a34118440 con 0x7f3a34077040 2024-09-19T06:22:59.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.310+0000 7f3a3a200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3a34118740 con 0x7f3a34112a30 2024-09-19T06:22:59.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.310+0000 7f3a33400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a34076720 0x7f3a341a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:59.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.310+0000 7f3a2be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a34077040 0x7f3a341a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:59.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.310+0000 7f3a33400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a34076720 0x7f3a341a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56182/0 (socket says 172.21.15.3:56182) 2024-09-19T06:22:59.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.310+0000 7f3a33400640 1 -- 172.21.15.3:0/1025767780 learned_addr learned my addr 172.21.15.3:0/1025767780 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:59.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.311+0000 7f3a33e00640 1 --2- 172.21.15.3:0/1025767780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a34112a30 0x7f3a3419e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:59.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.311+0000 7f3a2be00640 1 -- 172.21.15.3:0/1025767780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a34112a30 msgr2=0x7f3a3419e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:59.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.311+0000 7f3a2be00640 1 --2- 172.21.15.3:0/1025767780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a34112a30 0x7f3a3419e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.311+0000 7f3a2be00640 1 -- 172.21.15.3:0/1025767780 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a34076720 msgr2=0x7f3a341a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:59.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.311+0000 7f3a2be00640 1 --2- 172.21.15.3:0/1025767780 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a34076720 0x7f3a341a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.311+0000 7f3a2be00640 1 -- 172.21.15.3:0/1025767780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3419efc0 con 0x7f3a34077040 2024-09-19T06:22:59.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.311+0000 7f3a33400640 1 --2- 172.21.15.3:0/1025767780 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a34076720 0x7f3a341a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:59.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.311+0000 7f3a2be00640 1 --2- 172.21.15.3:0/1025767780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a34077040 0x7f3a341a4c10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00e9f0 tx=0x7f3a1c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:59.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.312+0000 7f3a30c00640 1 -- 172.21.15.3:0/1025767780 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c00ccc0 con 0x7f3a34077040 2024-09-19T06:22:59.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.312+0000 7f3a3a200640 1 -- 172.21.15.3:0/1025767780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a3419f2b0 con 0x7f3a34077040 2024-09-19T06:22:59.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.312+0000 7f3a30c00640 1 -- 172.21.15.3:0/1025767780 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a1c010910 con 0x7f3a34077040 2024-09-19T06:22:59.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.312+0000 7f3a30c00640 1 -- 172.21.15.3:0/1025767780 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c018960 con 0x7f3a34077040 2024-09-19T06:22:59.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.312+0000 7f3a3a200640 1 -- 172.21.15.3:0/1025767780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a341ab5a0 con 0x7f3a34077040 2024-09-19T06:22:59.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.315+0000 7f3a3ce67740 1 Processor -- start 2024-09-19T06:22:59.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.315+0000 7f3a3ce67740 1 -- start start 2024-09-19T06:22:59.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.315+0000 7f3a30c00640 1 -- 172.21.15.3:0/1025767780 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f3a1c010ac0 con 0x7f3a34077040 2024-09-19T06:22:59.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.315+0000 7f3a3ce67740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5f1c70 0x55a0ef5f2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:59.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.315+0000 7f3a3ce67740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0ef5f2590 0x55a0ef5fc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:59.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.315+0000 7f3a3ce67740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5fce50 0x55a0ef5ff240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:59.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.315+0000 7f3a3ce67740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a0ef5583e0 con 0x55a0ef5fce50 2024-09-19T06:22:59.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.315+0000 7f3a3ce67740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a0ef4ffd80 con 0x55a0ef5f1c70 2024-09-19T06:22:59.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.315+0000 7f3a3ce67740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a0ef5543a0 con 0x55a0ef5f2590 2024-09-19T06:22:59.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.316+0000 7f3a33e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5f1c70 0x55a0ef5f2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:59.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.316+0000 7f3a33e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5f1c70 0x55a0ef5f2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:41686/0 (socket says 172.21.15.3:41686) 2024-09-19T06:22:59.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.316+0000 7f3a33e00640 1 -- 172.21.15.3:0/2224325476 learned_addr learned my addr 172.21.15.3:0/2224325476 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:59.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.316+0000 7f3a33400640 1 --2- 172.21.15.3:0/2224325476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0ef5f2590 0x55a0ef5fc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:59.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.316+0000 7f3a2be00640 1 --2- 172.21.15.3:0/2224325476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5fce50 0x55a0ef5ff240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:59.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.316+0000 7f3a33e00640 1 -- 172.21.15.3:0/2224325476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0ef5f2590 msgr2=0x55a0ef5fc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:59.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.316+0000 7f3a33e00640 1 --2- 172.21.15.3:0/2224325476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0ef5f2590 0x55a0ef5fc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.316+0000 7f3a33e00640 1 -- 172.21.15.3:0/2224325476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5fce50 msgr2=0x55a0ef5ff240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:59.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.316+0000 7f3a33e00640 1 --2- 172.21.15.3:0/2224325476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5fce50 0x55a0ef5ff240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.316+0000 7f3a33e00640 1 -- 172.21.15.3:0/2224325476 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0ef51eae0 con 0x55a0ef5f1c70 2024-09-19T06:22:59.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.316+0000 7f3a2be00640 1 --2- 172.21.15.3:0/2224325476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5fce50 0x55a0ef5ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:22:59.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.316+0000 7f3a33400640 1 --2- 172.21.15.3:0/2224325476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0ef5f2590 0x55a0ef5fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:59.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.316+0000 7f3a33e00640 1 --2- 172.21.15.3:0/2224325476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5f1c70 0x55a0ef5f2050 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3a3407aa10 tx=0x7f3a2c0093e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65036781f0f52170 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:59.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.317+0000 7f3a23e00640 1 -- 172.21.15.3:0/2224325476 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c031db0 con 0x55a0ef5f1c70 2024-09-19T06:22:59.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.317+0000 7f3a23e00640 1 -- 172.21.15.3:0/2224325476 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a2c036030 con 0x55a0ef5f1c70 2024-09-19T06:22:59.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.317+0000 7f3a23e00640 1 -- 172.21.15.3:0/2224325476 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c0042a0 con 0x55a0ef5f1c70 2024-09-19T06:22:59.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.317+0000 7f3a30c00640 1 --2- 172.21.15.3:0/1025767780 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3a180a3430 0x7f3a180a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:59.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.317+0000 7f3a3ce67740 1 -- 172.21.15.3:0/2224325476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5f1c70 msgr2=0x55a0ef5f2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:59.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.317+0000 7f3a3ce67740 1 --2- 172.21.15.3:0/2224325476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5f1c70 0x55a0ef5f2050 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3a3407aa10 tx=0x7f3a2c0093e0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.317+0000 7f3a30c00640 1 -- 172.21.15.3:0/1025767780 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f3a1c0d0000 con 0x7f3a34077040 2024-09-19T06:22:59.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.317+0000 7f3a3ce67740 1 -- 172.21.15.3:0/2224325476 shutdown_connections 2024-09-19T06:22:59.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.317+0000 7f3a33400640 1 --2- 172.21.15.3:0/1025767780 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3a180a3430 0x7f3a180a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:59.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.317+0000 7f3a3ce67740 1 --2- 172.21.15.3:0/2224325476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5fce50 0x55a0ef5ff240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.317+0000 7f3a3ce67740 1 --2- 172.21.15.3:0/2224325476 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0ef5f2590 0x55a0ef5fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.317+0000 7f3a3ce67740 1 --2- 172.21.15.3:0/2224325476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5f1c70 0x55a0ef5f2050 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.317+0000 7f3a3ce67740 1 -- 172.21.15.3:0/2224325476 >> 172.21.15.3:0/2224325476 conn(0x55a0ef5ee200 msgr2=0x55a0ef5ee5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:59.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.318+0000 7f3a3ce67740 1 -- 172.21.15.3:0/2224325476 shutdown_connections 2024-09-19T06:22:59.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.318+0000 7f3a3ce67740 1 -- 172.21.15.3:0/2224325476 wait complete. 2024-09-19T06:22:59.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.318+0000 7f3a33400640 1 --2- 172.21.15.3:0/1025767780 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3a180a3430 0x7f3a180a58f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55a0ef5ef060 tx=0x7f3a2400b4a0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:59.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.318+0000 7f3a3ce67740 1 -- start start 2024-09-19T06:22:59.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.318+0000 7f3a3ce67740 1 Processor -- start 2024-09-19T06:22:59.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.319+0000 7f3a3ce67740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5f1c70 0x55a0ef5f9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:59.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.319+0000 7f3a3ce67740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5f2590 0x55a0ef5fa250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:59.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.319+0000 7f3a3ce67740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0ef5fce50 0x55a0ef5fa790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:59.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.319+0000 7f3a3ce67740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55a0ef5ff8a0 con 0x55a0ef5f2590 2024-09-19T06:22:59.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.319+0000 7f3a3ce67740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55a0ef5130f0 con 0x55a0ef5f1c70 2024-09-19T06:22:59.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.319+0000 7f3a3ce67740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55a0ef5ffa20 con 0x55a0ef5fce50 2024-09-19T06:22:59.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.319+0000 7f3a3ce67740 10 client.0 _ll_register_callbacks cb 0x55a0ef4fabd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:59.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.319+0000 7f3a2be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5f2590 0x55a0ef5fa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:59.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.319+0000 7f3a33400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5f1c70 0x55a0ef5f9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:59.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.319+0000 7f3a2be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5f2590 0x55a0ef5fa250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56200/0 (socket says 172.21.15.3:56200) 2024-09-19T06:22:59.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.319+0000 7f3a2be00640 1 -- 172.21.15.3:0/3014095160 learned_addr learned my addr 172.21.15.3:0/3014095160 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:59.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.319+0000 7f3a33e00640 1 --2- 172.21.15.3:0/3014095160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0ef5fce50 0x55a0ef5fa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:59.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.320+0000 7f3a2be00640 1 -- 172.21.15.3:0/3014095160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0ef5fce50 msgr2=0x55a0ef5fa790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:59.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.320+0000 7f3a2be00640 1 --2- 172.21.15.3:0/3014095160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0ef5fce50 0x55a0ef5fa790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.320+0000 7f3a2be00640 1 -- 172.21.15.3:0/3014095160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5f1c70 msgr2=0x55a0ef5f9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:59.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.320+0000 7f3a2be00640 1 --2- 172.21.15.3:0/3014095160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5f1c70 0x55a0ef5f9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.320+0000 7f3a2be00640 1 -- 172.21.15.3:0/3014095160 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0ef2c93c0 con 0x55a0ef5f2590 2024-09-19T06:22:59.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.320+0000 7f3a33400640 1 --2- 172.21.15.3:0/3014095160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5f1c70 0x55a0ef5f9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:59.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.320+0000 7f3a33e00640 1 --2- 172.21.15.3:0/3014095160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0ef5fce50 0x55a0ef5fa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:59.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.320+0000 7f3a2be00640 1 --2- 172.21.15.3:0/3014095160 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5f2590 0x55a0ef5fa250 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00e9c0 tx=0x7f3a1c09c130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38f3025ad09e0b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:59.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.320+0000 7f3a20c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:22:59.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.321+0000 7f3a20c00640 1 -- 172.21.15.3:0/3014095160 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c0d2270 con 0x55a0ef5f2590 2024-09-19T06:22:59.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.321+0000 7f3a20c00640 1 -- 172.21.15.3:0/3014095160 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f3a1c0bc0b0 con 0x55a0ef5f2590 2024-09-19T06:22:59.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.321+0000 7f3a3ce67740 1 -- 172.21.15.3:0/3014095160 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a2c036030 con 0x55a0ef5f2590 2024-09-19T06:22:59.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.321+0000 7f3a20c00640 1 -- 172.21.15.3:0/3014095160 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3a1c09c360 con 0x55a0ef5f2590 2024-09-19T06:22:59.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.321+0000 7f3a3ce67740 10 client.18381 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:59.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.321+0000 7f3a3ce67740 1 -- 172.21.15.3:0/3014095160 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a0ef60b8b0 con 0x55a0ef5f2590 2024-09-19T06:22:59.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.321+0000 7f3a20c00640 1 -- 172.21.15.3:0/3014095160 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a2c036030 con 0x55a0ef5f2590 2024-09-19T06:22:59.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.322+0000 7f3a20c00640 1 -- 172.21.15.3:0/3014095160 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3a1c09b7b0 con 0x55a0ef5f2590 2024-09-19T06:22:59.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.322+0000 7f3a3ce67740 10 client.18381 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:59.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.322+0000 7f3a3ce67740 10 client.18381 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:59.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.322+0000 7f3a3ce67740 20 client.18381 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:59.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.322+0000 7f3a3ce67740 1 --2- 172.21.15.3:0/3014095160 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a0ef60ccc0 0x55a0ef60f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:59.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.322+0000 7f3a3ce67740 4 client.18381 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:22:59.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.322+0000 7f3a3ce67740 1 -- 172.21.15.3:0/3014095160 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0ef565950 con 0x55a0ef60ccc0 2024-09-19T06:22:59.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.322+0000 7f3a33400640 1 --2- 172.21.15.3:0/3014095160 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a0ef60ccc0 0x55a0ef60f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:59.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.323+0000 7f3a33400640 1 --2- 172.21.15.3:0/3014095160 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a0ef60ccc0 0x55a0ef60f110 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8981f3f6bf6a0158 server_cookie=8e58df75a00c1605 in_seq=0 out_seq=0 2024-09-19T06:22:59.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.323+0000 7f3a20c00640 10 client.18381 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:59.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.324+0000 7f3a20c00640 1 -- 172.21.15.3:0/3014095160 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a0ef565950 con 0x55a0ef60ccc0 2024-09-19T06:22:59.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.324+0000 7f3a20c00640 10 client.18381 handle_command_reply: tid=0 2024-09-19T06:22:59.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.324+0000 7f3a3ce67740 1 client.18381 shutdown 2024-09-19T06:22:59.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.324+0000 7f3a3ce67740 1 -- 172.21.15.3:0/3014095160 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5f2590 msgr2=0x55a0ef5fa250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:59.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.324+0000 7f3a3ce67740 1 --2- 172.21.15.3:0/3014095160 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5f2590 0x55a0ef5fa250 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00e9c0 tx=0x7f3a1c09c130 comp rx=0 tx=0).stop 2024-09-19T06:22:59.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.324+0000 7f3a3ce67740 1 -- 172.21.15.3:0/3014095160 shutdown_connections 2024-09-19T06:22:59.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.324+0000 7f3a3ce67740 1 --2- 172.21.15.3:0/3014095160 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a0ef60ccc0 0x55a0ef60f110 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.324+0000 7f3a3ce67740 1 --2- 172.21.15.3:0/3014095160 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0ef5fce50 0x55a0ef5fa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.324+0000 7f3a3ce67740 1 --2- 172.21.15.3:0/3014095160 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5f2590 0x55a0ef5fa250 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.324+0000 7f3a3ce67740 1 --2- 172.21.15.3:0/3014095160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5f1c70 0x55a0ef5f9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.324+0000 7f3a20c00640 0 client.18381 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:59.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.324+0000 7f3a3ce67740 1 -- 172.21.15.3:0/3014095160 >> 172.21.15.3:0/3014095160 conn(0x55a0ef5ee200 msgr2=0x55a0ef5ed380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:59.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.324+0000 7f3a3ce67740 1 -- 172.21.15.3:0/3014095160 shutdown_connections 2024-09-19T06:22:59.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.325+0000 7f3a3ce67740 1 -- 172.21.15.3:0/3014095160 wait complete. 2024-09-19T06:22:59.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.325+0000 7f3a3ce67740 20 client.18381 trim_cache size 0 max 16384 2024-09-19T06:22:59.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.338+0000 7f3a3ce67740 1 Processor -- start 2024-09-19T06:22:59.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.338+0000 7f3a3ce67740 1 -- start start 2024-09-19T06:22:59.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.339+0000 7f3a3ce67740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5f1c70 0x55a0ef5fbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:59.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.339+0000 7f3a3ce67740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5f2590 0x55a0ef6149e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:59.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.339+0000 7f3a3ce67740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0ef5fce50 0x55a0ef614f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:59.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.339+0000 7f3a3ce67740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3a341b3f30 con 0x55a0ef5f1c70 2024-09-19T06:22:59.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.339+0000 7f3a3ce67740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3a341b5a70 con 0x55a0ef5f2590 2024-09-19T06:22:59.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.339+0000 7f3a3ce67740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3a341b4600 con 0x55a0ef5fce50 2024-09-19T06:22:59.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.339+0000 7f3a33400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5f1c70 0x55a0ef5fbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:59.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.339+0000 7f3a33400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5f1c70 0x55a0ef5fbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56214/0 (socket says 172.21.15.3:56214) 2024-09-19T06:22:59.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.339+0000 7f3a33400640 1 -- 172.21.15.3:0/352639144 learned_addr learned my addr 172.21.15.3:0/352639144 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:59.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.339+0000 7f3a2be00640 1 --2- 172.21.15.3:0/352639144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5f2590 0x55a0ef6149e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:59.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.339+0000 7f3a33e00640 1 --2- 172.21.15.3:0/352639144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0ef5fce50 0x55a0ef614f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:59.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.340+0000 7f3a33400640 1 -- 172.21.15.3:0/352639144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0ef5fce50 msgr2=0x55a0ef614f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:59.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.340+0000 7f3a33400640 1 --2- 172.21.15.3:0/352639144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0ef5fce50 0x55a0ef614f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.340+0000 7f3a33400640 1 -- 172.21.15.3:0/352639144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5f2590 msgr2=0x55a0ef6149e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:59.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.340+0000 7f3a33400640 1 --2- 172.21.15.3:0/352639144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5f2590 0x55a0ef6149e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.340+0000 7f3a33400640 1 -- 172.21.15.3:0/352639144 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0ef5f23c0 con 0x55a0ef5f1c70 2024-09-19T06:22:59.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.340+0000 7f3a2be00640 1 --2- 172.21.15.3:0/352639144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5f2590 0x55a0ef6149e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:59.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.340+0000 7f3a33400640 1 --2- 172.21.15.3:0/352639144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5f1c70 0x55a0ef5fbc80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x55a0ef60f980 tx=0x7f3a24019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854149c9eda4069f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:59.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.340+0000 7f3a23400640 1 -- 172.21.15.3:0/352639144 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24004030 con 0x55a0ef5f1c70 2024-09-19T06:22:59.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.340+0000 7f3a23400640 1 -- 172.21.15.3:0/352639144 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a2402aa10 con 0x55a0ef5f1c70 2024-09-19T06:22:59.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.340+0000 7f3a23400640 1 -- 172.21.15.3:0/352639144 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24003970 con 0x55a0ef5f1c70 2024-09-19T06:22:59.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.341+0000 7f3a3ce67740 1 -- 172.21.15.3:0/352639144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5f1c70 msgr2=0x55a0ef5fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:59.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.341+0000 7f3a3ce67740 1 --2- 172.21.15.3:0/352639144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5f1c70 0x55a0ef5fbc80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x55a0ef60f980 tx=0x7f3a24019000 comp rx=0 tx=0).stop 2024-09-19T06:22:59.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.341+0000 7f3a3ce67740 1 -- 172.21.15.3:0/352639144 shutdown_connections 2024-09-19T06:22:59.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.341+0000 7f3a3ce67740 1 --2- 172.21.15.3:0/352639144 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0ef5fce50 0x55a0ef614f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.341+0000 7f3a3ce67740 1 --2- 172.21.15.3:0/352639144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5f2590 0x55a0ef6149e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.341+0000 7f3a3ce67740 1 --2- 172.21.15.3:0/352639144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5f1c70 0x55a0ef5fbc80 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.341+0000 7f3a3ce67740 1 -- 172.21.15.3:0/352639144 >> 172.21.15.3:0/352639144 conn(0x55a0ef5ee200 msgr2=0x55a0ef5fb570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:59.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.341+0000 7f3a3ce67740 1 -- 172.21.15.3:0/352639144 shutdown_connections 2024-09-19T06:22:59.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.341+0000 7f3a3ce67740 1 -- 172.21.15.3:0/352639144 wait complete. 2024-09-19T06:22:59.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.342+0000 7f3a3ce67740 1 -- start start 2024-09-19T06:22:59.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.342+0000 7f3a3ce67740 1 Processor -- start 2024-09-19T06:22:59.346 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.342+0000 7f3a3ce67740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5f1c70 0x55a0ef605340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:59.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.342+0000 7f3a3ce67740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0ef5f2590 0x55a0ef600670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:59.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.342+0000 7f3a3ce67740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5fce50 0x55a0ef600bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:59.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.342+0000 7f3a3ce67740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3a341b53a0 con 0x55a0ef5f1c70 2024-09-19T06:22:59.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.342+0000 7f3a3ce67740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3a341b4cd0 con 0x55a0ef5fce50 2024-09-19T06:22:59.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.342+0000 7f3a3ce67740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3a341b1f30 con 0x55a0ef5f2590 2024-09-19T06:22:59.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.342+0000 7f3a3ce67740 10 client.0 _ll_register_callbacks cb 0x7f3a1c00ce60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:22:59.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.343+0000 7f3a33400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5f1c70 0x55a0ef605340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:59.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.343+0000 7f3a33400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5f1c70 0x55a0ef605340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56216/0 (socket says 172.21.15.3:56216) 2024-09-19T06:22:59.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.343+0000 7f3a33400640 1 -- 172.21.15.3:0/3145306549 learned_addr learned my addr 172.21.15.3:0/3145306549 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:22:59.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.343+0000 7f3a33e00640 1 --2- 172.21.15.3:0/3145306549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5fce50 0x55a0ef600bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:59.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.343+0000 7f3a2be00640 1 --2- 172.21.15.3:0/3145306549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0ef5f2590 0x55a0ef600670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:59.347 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.343+0000 7f3a33400640 1 -- 172.21.15.3:0/3145306549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0ef5f2590 msgr2=0x55a0ef600670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:59.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.343+0000 7f3a33400640 1 --2- 172.21.15.3:0/3145306549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0ef5f2590 0x55a0ef600670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.343+0000 7f3a33400640 1 -- 172.21.15.3:0/3145306549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5fce50 msgr2=0x55a0ef600bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:22:59.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.343+0000 7f3a33400640 1 --2- 172.21.15.3:0/3145306549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5fce50 0x55a0ef600bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.343+0000 7f3a33400640 1 -- 172.21.15.3:0/3145306549 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0ef6013e0 con 0x55a0ef5f1c70 2024-09-19T06:22:59.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.343+0000 7f3a33e00640 1 --2- 172.21.15.3:0/3145306549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5fce50 0x55a0ef600bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:22:59.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.344+0000 7f3a33400640 1 --2- 172.21.15.3:0/3145306549 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5f1c70 0x55a0ef605340 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400b770 tx=0x7f3a2402ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d91281c538ec2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:22:59.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.344+0000 7f3a20c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:22:59.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.344+0000 7f3a20c00640 1 -- 172.21.15.3:0/3145306549 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24005240 con 0x55a0ef5f1c70 2024-09-19T06:22:59.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.344+0000 7f3a20c00640 1 -- 172.21.15.3:0/3145306549 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f3a240053e0 con 0x55a0ef5f1c70 2024-09-19T06:22:59.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.344+0000 7f3a3ce67740 1 -- 172.21.15.3:0/3145306549 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a2402aa10 con 0x55a0ef5f1c70 2024-09-19T06:22:59.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.344+0000 7f3a20c00640 1 -- 172.21.15.3:0/3145306549 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3a240055e0 con 0x55a0ef5f1c70 2024-09-19T06:22:59.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.344+0000 7f3a3ce67740 10 client.18387 fetch_fsmap learned FSMap version 29 2024-09-19T06:22:59.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.344+0000 7f3a3ce67740 1 -- 172.21.15.3:0/3145306549 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a0ef677940 con 0x55a0ef5f1c70 2024-09-19T06:22:59.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.344+0000 7f3a20c00640 1 -- 172.21.15.3:0/3145306549 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a2402aa10 con 0x55a0ef5f1c70 2024-09-19T06:22:59.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.345+0000 7f3a20c00640 1 -- 172.21.15.3:0/3145306549 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f3a24044070 con 0x55a0ef5f1c70 2024-09-19T06:22:59.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.345+0000 7f3a3ce67740 10 client.18387 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:22:59.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.345+0000 7f3a3ce67740 10 client.18387 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:22:59.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.345+0000 7f3a3ce67740 20 client.18387 populate_metadata read hostname 'smithi003' 2024-09-19T06:22:59.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.345+0000 7f3a3ce67740 1 --2- 172.21.15.3:0/3145306549 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a0ef677fa0 0x55a0ef67a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:22:59.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.345+0000 7f3a3ce67740 4 client.18387 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:22:59.349 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.345+0000 7f3a3ce67740 1 -- 172.21.15.3:0/3145306549 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a0ef55fe60 con 0x55a0ef677fa0 2024-09-19T06:22:59.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.345+0000 7f3a2be00640 1 --2- 172.21.15.3:0/3145306549 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a0ef677fa0 0x55a0ef67a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:22:59.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.346+0000 7f3a2be00640 1 --2- 172.21.15.3:0/3145306549 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a0ef677fa0 0x55a0ef67a390 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eaaf11d3ecbe6625 server_cookie=6a88a471b7a752d4 in_seq=0 out_seq=0 2024-09-19T06:22:59.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.346+0000 7f3a20c00640 10 client.18387 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:59.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.346+0000 7f3a20c00640 1 -- 172.21.15.3:0/3145306549 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a0ef55fe60 con 0x55a0ef677fa0 2024-09-19T06:22:59.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.346+0000 7f3a20c00640 10 client.18387 handle_command_reply: tid=0 2024-09-19T06:22:59.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.346+0000 7f3a3ce67740 1 client.18387 shutdown 2024-09-19T06:22:59.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.346+0000 7f3a3ce67740 1 -- 172.21.15.3:0/3145306549 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5f1c70 msgr2=0x55a0ef605340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:59.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.346+0000 7f3a3ce67740 1 --2- 172.21.15.3:0/3145306549 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5f1c70 0x55a0ef605340 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f3a2400b770 tx=0x7f3a2402ac50 comp rx=0 tx=0).stop 2024-09-19T06:22:59.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.346+0000 7f3a3ce67740 1 -- 172.21.15.3:0/3145306549 shutdown_connections 2024-09-19T06:22:59.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.346+0000 7f3a3ce67740 1 --2- 172.21.15.3:0/3145306549 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55a0ef677fa0 0x55a0ef67a390 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.346+0000 7f3a3ce67740 1 --2- 172.21.15.3:0/3145306549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0ef5fce50 0x55a0ef600bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.346+0000 7f3a3ce67740 1 --2- 172.21.15.3:0/3145306549 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55a0ef5f2590 0x55a0ef600670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.346+0000 7f3a3ce67740 1 --2- 172.21.15.3:0/3145306549 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55a0ef5f1c70 0x55a0ef605340 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.346+0000 7f3a3ce67740 1 -- 172.21.15.3:0/3145306549 >> 172.21.15.3:0/3145306549 conn(0x55a0ef5ee200 msgr2=0x55a0ef5ed380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:59.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.346+0000 7f3a20c00640 0 client.18387 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:22:59.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.346+0000 7f3a3ce67740 1 -- 172.21.15.3:0/3145306549 shutdown_connections 2024-09-19T06:22:59.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.346+0000 7f3a3ce67740 1 -- 172.21.15.3:0/3145306549 wait complete. 2024-09-19T06:22:59.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.346+0000 7f3a3ce67740 20 client.18387 trim_cache size 0 max 16384 2024-09-19T06:22:59.352 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:22:59.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.347+0000 7f3a3a200640 1 -- 172.21.15.3:0/1025767780 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3a180a3430 msgr2=0x7f3a180a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:59.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.347+0000 7f3a3a200640 1 --2- 172.21.15.3:0/1025767780 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3a180a3430 0x7f3a180a58f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55a0ef5ef060 tx=0x7f3a2400b4a0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.347+0000 7f3a3a200640 1 -- 172.21.15.3:0/1025767780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a34077040 msgr2=0x7f3a341a4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:22:59.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.347+0000 7f3a3a200640 1 --2- 172.21.15.3:0/1025767780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a34077040 0x7f3a341a4c10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00e9f0 tx=0x7f3a1c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.347+0000 7f3a3a200640 1 -- 172.21.15.3:0/1025767780 shutdown_connections 2024-09-19T06:22:59.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.347+0000 7f3a3a200640 1 --2- 172.21.15.3:0/1025767780 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3a180a3430 0x7f3a180a58f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.347+0000 7f3a3a200640 1 --2- 172.21.15.3:0/1025767780 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a34112a30 0x7f3a3419e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.347+0000 7f3a3a200640 1 --2- 172.21.15.3:0/1025767780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a34077040 0x7f3a341a4c10 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.347+0000 7f3a3a200640 1 --2- 172.21.15.3:0/1025767780 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a34076720 0x7f3a341a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:22:59.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.347+0000 7f3a3a200640 1 -- 172.21.15.3:0/1025767780 >> 172.21.15.3:0/1025767780 conn(0x7f3a340ffa90 msgr2=0x7f3a34101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:22:59.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.347+0000 7f3a3a200640 1 -- 172.21.15.3:0/1025767780 shutdown_connections 2024-09-19T06:22:59.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:22:59.347+0000 7f3a3a200640 1 -- 172.21.15.3:0/1025767780 wait complete. 2024-09-19T06:23:00.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:00 smithi003 ceph-mon[30893]: pgmap v329: 97 pgs: 97 active+clean; 5.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 64 KiB/s wr, 25 op/s 2024-09-19T06:23:00.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:00 smithi071 ceph-mon[35662]: pgmap v329: 97 pgs: 97 active+clean; 5.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 64 KiB/s wr, 25 op/s 2024-09-19T06:23:00.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:00 smithi059 ceph-mon[35138]: pgmap v329: 97 pgs: 97 active+clean; 5.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 64 KiB/s wr, 25 op/s 2024-09-19T06:23:01.192 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:23:01.192 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:23:01.579 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:02.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.171+0000 7f85bb200640 1 -- 172.21.15.3:0/231668076 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85bc102370 msgr2=0x7f85bc10e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:02.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.171+0000 7f85bb200640 1 --2- 172.21.15.3:0/231668076 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85bc102370 0x7f85bc10e8a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009cd0 tx=0x7f85b402a8f0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.171+0000 7f85bb200640 1 -- 172.21.15.3:0/231668076 shutdown_connections 2024-09-19T06:23:02.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.171+0000 7f85bb200640 1 --2- 172.21.15.3:0/231668076 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85bc102370 0x7f85bc10e8a0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.171+0000 7f85bb200640 1 --2- 172.21.15.3:0/231668076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85bc1019d0 0x7f85bc101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.171+0000 7f85bb200640 1 --2- 172.21.15.3:0/231668076 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85bc1079d0 0x7f85bc107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.171+0000 7f85bb200640 1 -- 172.21.15.3:0/231668076 >> 172.21.15.3:0/231668076 conn(0x7f85bc0fd710 msgr2=0x7f85bc0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:02.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.171+0000 7f85bb200640 1 -- 172.21.15.3:0/231668076 shutdown_connections 2024-09-19T06:23:02.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.171+0000 7f85bb200640 1 -- 172.21.15.3:0/231668076 wait complete. 2024-09-19T06:23:02.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.172+0000 7f85bb200640 1 Processor -- start 2024-09-19T06:23:02.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.173+0000 7f85bb200640 1 -- start start 2024-09-19T06:23:02.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.173+0000 7f85bb200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85bc1019d0 0x7f85bc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:02.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.173+0000 7f85bb200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85bc102370 0x7f85bc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:02.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.173+0000 7f85bb200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85bc1079d0 0x7f85bc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:02.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.173+0000 7f85bb200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc111e20 con 0x7f85bc1079d0 2024-09-19T06:23:02.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.173+0000 7f85bb200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc111ca0 con 0x7f85bc102370 2024-09-19T06:23:02.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.173+0000 7f85bb200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc111fa0 con 0x7f85bc1019d0 2024-09-19T06:23:02.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.173+0000 7f85b9e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85bc1019d0 0x7f85bc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:02.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.173+0000 7f85b1400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85bc102370 0x7f85bc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:02.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.173+0000 7f85b9e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85bc1019d0 0x7f85bc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:52436/0 (socket says 172.21.15.3:52436) 2024-09-19T06:23:02.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.173+0000 7f85b9e00640 1 -- 172.21.15.3:0/827670822 learned_addr learned my addr 172.21.15.3:0/827670822 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:02.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.173+0000 7f85ba800640 1 --2- 172.21.15.3:0/827670822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85bc1079d0 0x7f85bc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:02.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.174+0000 7f85b9e00640 1 -- 172.21.15.3:0/827670822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85bc102370 msgr2=0x7f85bc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:02.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.174+0000 7f85b9e00640 1 --2- 172.21.15.3:0/827670822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85bc102370 0x7f85bc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.174+0000 7f85b9e00640 1 -- 172.21.15.3:0/827670822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85bc1079d0 msgr2=0x7f85bc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:02.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.174+0000 7f85b9e00640 1 --2- 172.21.15.3:0/827670822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85bc1079d0 0x7f85bc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.174+0000 7f85b9e00640 1 -- 172.21.15.3:0/827670822 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85bc1a6720 con 0x7f85bc1019d0 2024-09-19T06:23:02.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.174+0000 7f85b9e00640 1 --2- 172.21.15.3:0/827670822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85bc1019d0 0x7f85bc0744f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00e9f0 tx=0x7f85ac00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:02.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.174+0000 7f85b3400640 1 -- 172.21.15.3:0/827670822 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac00cd80 con 0x7f85bc1019d0 2024-09-19T06:23:02.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.174+0000 7f85b3400640 1 -- 172.21.15.3:0/827670822 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85ac005500 con 0x7f85bc1019d0 2024-09-19T06:23:02.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.174+0000 7f85b3400640 1 -- 172.21.15.3:0/827670822 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac010690 con 0x7f85bc1019d0 2024-09-19T06:23:02.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.174+0000 7f85bb200640 1 -- 172.21.15.3:0/827670822 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85bc1a6a10 con 0x7f85bc1019d0 2024-09-19T06:23:02.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.175+0000 7f85bb200640 1 -- 172.21.15.3:0/827670822 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85bc1a6f00 con 0x7f85bc1019d0 2024-09-19T06:23:02.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.177+0000 7f85c3464740 1 Processor -- start 2024-09-19T06:23:02.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.178+0000 7f85c3464740 1 -- start start 2024-09-19T06:23:02.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.178+0000 7f85b3400640 1 -- 172.21.15.3:0/827670822 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f85ac0046c0 con 0x7f85bc1019d0 2024-09-19T06:23:02.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.178+0000 7f85c3464740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f14a696cb0 0x55f14a697090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:02.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.178+0000 7f85c3464740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f14a6975d0 0x55f14a6a1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:02.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.178+0000 7f85c3464740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a6a1e90 0x55f14a6a4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:02.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.178+0000 7f85c3464740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55f14a5fd290 con 0x55f14a6a1e90 2024-09-19T06:23:02.180 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.178+0000 7f85c3464740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f14a5a4b40 con 0x55f14a6975d0 2024-09-19T06:23:02.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.178+0000 7f85c3464740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f14a5f9250 con 0x55f14a696cb0 2024-09-19T06:23:02.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.178+0000 7f85ba800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f14a696cb0 0x55f14a697090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:02.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.178+0000 7f85ba800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f14a696cb0 0x55f14a697090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:52442/0 (socket says 172.21.15.3:52442) 2024-09-19T06:23:02.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.178+0000 7f85ba800640 1 -- 172.21.15.3:0/4141671652 learned_addr learned my addr 172.21.15.3:0/4141671652 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:02.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.178+0000 7f85b9e00640 1 --2- 172.21.15.3:0/4141671652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f14a6975d0 0x55f14a6a1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:02.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.178+0000 7f85b1400640 1 --2- 172.21.15.3:0/4141671652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a6a1e90 0x55f14a6a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:02.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.179+0000 7f85ba800640 1 -- 172.21.15.3:0/4141671652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f14a6975d0 msgr2=0x55f14a6a1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:02.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.179+0000 7f85ba800640 1 --2- 172.21.15.3:0/4141671652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f14a6975d0 0x55f14a6a1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.182 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.179+0000 7f85ba800640 1 -- 172.21.15.3:0/4141671652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a6a1e90 msgr2=0x55f14a6a4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:02.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.179+0000 7f85ba800640 1 --2- 172.21.15.3:0/4141671652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a6a1e90 0x55f14a6a4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.179+0000 7f85ba800640 1 -- 172.21.15.3:0/4141671652 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f14a36e6a0 con 0x55f14a696cb0 2024-09-19T06:23:02.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.179+0000 7f85ba800640 1 --2- 172.21.15.3:0/4141671652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f14a696cb0 0x55f14a697090 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009cd0 tx=0x7f85b4005f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61aedae736912837 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:02.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.179+0000 7f85ab000640 1 -- 172.21.15.3:0/4141671652 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b4030760 con 0x55f14a696cb0 2024-09-19T06:23:02.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.180+0000 7f85ab000640 1 -- 172.21.15.3:0/4141671652 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85b4036030 con 0x55f14a696cb0 2024-09-19T06:23:02.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.180+0000 7f85ab000640 1 -- 172.21.15.3:0/4141671652 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b40043a0 con 0x55f14a696cb0 2024-09-19T06:23:02.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.180+0000 7f85b3400640 1 --2- 172.21.15.3:0/827670822 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f85a00a3430 0x7f85a00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:02.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.180+0000 7f85b3400640 1 -- 172.21.15.3:0/827670822 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f85ac0d00a0 con 0x7f85bc1019d0 2024-09-19T06:23:02.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.180+0000 7f85b9e00640 1 --2- 172.21.15.3:0/827670822 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f85a00a3430 0x7f85a00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:02.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.180+0000 7f85c3464740 1 -- 172.21.15.3:0/4141671652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f14a696cb0 msgr2=0x55f14a697090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:02.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.180+0000 7f85c3464740 1 --2- 172.21.15.3:0/4141671652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f14a696cb0 0x55f14a697090 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009cd0 tx=0x7f85b4005f80 comp rx=0 tx=0).stop 2024-09-19T06:23:02.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.180+0000 7f85c3464740 1 -- 172.21.15.3:0/4141671652 shutdown_connections 2024-09-19T06:23:02.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.180+0000 7f85c3464740 1 --2- 172.21.15.3:0/4141671652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a6a1e90 0x55f14a6a4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.183 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.180+0000 7f85c3464740 1 --2- 172.21.15.3:0/4141671652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f14a6975d0 0x55f14a6a1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.180+0000 7f85c3464740 1 --2- 172.21.15.3:0/4141671652 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f14a696cb0 0x55f14a697090 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.180+0000 7f85c3464740 1 -- 172.21.15.3:0/4141671652 >> 172.21.15.3:0/4141671652 conn(0x55f14a693240 msgr2=0x55f14a693620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:02.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.181+0000 7f85c3464740 1 -- 172.21.15.3:0/4141671652 shutdown_connections 2024-09-19T06:23:02.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.181+0000 7f85b9e00640 1 --2- 172.21.15.3:0/827670822 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f85a00a3430 0x7f85a00a58f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55f14a6940a0 tx=0x7f85ac004a40 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:02.184 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.181+0000 7f85c3464740 1 -- 172.21.15.3:0/4141671652 wait complete. 2024-09-19T06:23:02.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.181+0000 7f85c3464740 1 -- start start 2024-09-19T06:23:02.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.182+0000 7f85c3464740 1 Processor -- start 2024-09-19T06:23:02.186 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.182+0000 7f85c3464740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f14a696cb0 0x55f14a6a1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:02.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.182+0000 7f85c3464740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a6975d0 0x55f14a69ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:02.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.182+0000 7f85c3464740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f14a6a1e90 0x55f14a69ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:02.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.182+0000 7f85c3464740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55f14a6a4b00 con 0x55f14a6975d0 2024-09-19T06:23:02.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.182+0000 7f85c3464740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55f14a5b7fa0 con 0x55f14a6a1e90 2024-09-19T06:23:02.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.182+0000 7f85c3464740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55f14a6a4c80 con 0x55f14a696cb0 2024-09-19T06:23:02.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.182+0000 7f85c3464740 10 client.0 _ll_register_callbacks cb 0x55f14a30bba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:02.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.182+0000 7f85b1400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a6975d0 0x55f14a69ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:02.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.182+0000 7f85b1400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a6975d0 0x55f14a69ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56260/0 (socket says 172.21.15.3:56260) 2024-09-19T06:23:02.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.182+0000 7f85b1400640 1 -- 172.21.15.3:0/1292877250 learned_addr learned my addr 172.21.15.3:0/1292877250 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:02.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.182+0000 7f85ba800640 1 --2- 172.21.15.3:0/1292877250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f14a696cb0 0x55f14a6a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:02.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.183+0000 7f85ba800640 1 --2- 172.21.15.3:0/1292877250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f14a6a1e90 0x55f14a69ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:02.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.183+0000 7f85b1400640 1 -- 172.21.15.3:0/1292877250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f14a696cb0 msgr2=0x55f14a6a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:02.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.183+0000 7f85b1400640 1 --2- 172.21.15.3:0/1292877250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f14a696cb0 0x55f14a6a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.183+0000 7f85b1400640 1 -- 172.21.15.3:0/1292877250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f14a6a1e90 msgr2=0x55f14a69ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:02.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.183+0000 7f85b1400640 1 --2- 172.21.15.3:0/1292877250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f14a6a1e90 0x55f14a69ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.183+0000 7f85b1400640 1 -- 172.21.15.3:0/1292877250 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f14a69f750 con 0x55f14a6975d0 2024-09-19T06:23:02.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.183+0000 7f85ba800640 1 --2- 172.21.15.3:0/1292877250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f14a6a1e90 0x55f14a69ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:02.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.183+0000 7f85b1400640 1 --2- 172.21.15.3:0/1292877250 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a6975d0 0x55f14a69ea30 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f85a4012700 tx=0x7f85a4012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a2ece7185562c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:02.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.183+0000 7f859f400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:23:02.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.184+0000 7f859f400640 1 -- 172.21.15.3:0/1292877250 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a400f8c0 con 0x55f14a6975d0 2024-09-19T06:23:02.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.184+0000 7f85c3464740 1 -- 172.21.15.3:0/1292877250 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85b4036030 con 0x55f14a6975d0 2024-09-19T06:23:02.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.184+0000 7f859f400640 1 -- 172.21.15.3:0/1292877250 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f85a400fa60 con 0x55f14a6975d0 2024-09-19T06:23:02.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.184+0000 7f859f400640 1 -- 172.21.15.3:0/1292877250 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f85a400fca0 con 0x55f14a6975d0 2024-09-19T06:23:02.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.184+0000 7f85c3464740 10 client.18399 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:02.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.184+0000 7f85c3464740 1 -- 172.21.15.3:0/1292877250 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f14a6b0a50 con 0x55f14a6975d0 2024-09-19T06:23:02.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.184+0000 7f859f400640 1 -- 172.21.15.3:0/1292877250 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85b4036030 con 0x55f14a6975d0 2024-09-19T06:23:02.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.184+0000 7f859f400640 1 -- 172.21.15.3:0/1292877250 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f85a4023070 con 0x55f14a6975d0 2024-09-19T06:23:02.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.185+0000 7f85c3464740 10 client.18399 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:02.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.185+0000 7f85c3464740 10 client.18399 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:02.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.185+0000 7f85c3464740 20 client.18399 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:02.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.185+0000 7f85c3464740 1 --2- 172.21.15.3:0/1292877250 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f14a6b1f10 0x55f14a6b4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:02.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.185+0000 7f85c3464740 4 client.18399 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:02.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.185+0000 7f85c3464740 1 -- 172.21.15.3:0/1292877250 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f14a60a800 con 0x55f14a6b1f10 2024-09-19T06:23:02.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.185+0000 7f85ba800640 1 --2- 172.21.15.3:0/1292877250 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f14a6b1f10 0x55f14a6b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:02.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.186+0000 7f85ba800640 1 --2- 172.21.15.3:0/1292877250 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f14a6b1f10 0x55f14a6b4330 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d75f2eaf766abaa3 server_cookie=3bbcb0e1530f4642 in_seq=0 out_seq=0 2024-09-19T06:23:02.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.186+0000 7f859f400640 10 client.18399 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:02.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.186+0000 7f859f400640 1 -- 172.21.15.3:0/1292877250 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f14a60a800 con 0x55f14a6b1f10 2024-09-19T06:23:02.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.186+0000 7f859f400640 10 client.18399 handle_command_reply: tid=0 2024-09-19T06:23:02.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.186+0000 7f85c3464740 1 client.18399 shutdown 2024-09-19T06:23:02.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.187+0000 7f85c3464740 1 -- 172.21.15.3:0/1292877250 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a6975d0 msgr2=0x55f14a69ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:02.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.187+0000 7f85c3464740 1 --2- 172.21.15.3:0/1292877250 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a6975d0 0x55f14a69ea30 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f85a4012700 tx=0x7f85a4012bc0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.187+0000 7f85c3464740 1 -- 172.21.15.3:0/1292877250 shutdown_connections 2024-09-19T06:23:02.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.187+0000 7f85c3464740 1 --2- 172.21.15.3:0/1292877250 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f14a6b1f10 0x55f14a6b4330 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.187+0000 7f85c3464740 1 --2- 172.21.15.3:0/1292877250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f14a6a1e90 0x55f14a69ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.187+0000 7f85c3464740 1 --2- 172.21.15.3:0/1292877250 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a6975d0 0x55f14a69ea30 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.187+0000 7f85c3464740 1 --2- 172.21.15.3:0/1292877250 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f14a696cb0 0x55f14a6a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.187+0000 7f85c3464740 1 -- 172.21.15.3:0/1292877250 >> 172.21.15.3:0/1292877250 conn(0x55f14a693240 msgr2=0x55f14a698f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:02.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.187+0000 7f859f400640 0 client.18399 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:02.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.187+0000 7f85c3464740 1 -- 172.21.15.3:0/1292877250 shutdown_connections 2024-09-19T06:23:02.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.187+0000 7f85c3464740 1 -- 172.21.15.3:0/1292877250 wait complete. 2024-09-19T06:23:02.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.187+0000 7f85c3464740 20 client.18399 trim_cache size 0 max 16384 2024-09-19T06:23:02.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.205+0000 7f85c3464740 1 Processor -- start 2024-09-19T06:23:02.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.205+0000 7f85c3464740 1 -- start start 2024-09-19T06:23:02.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.205+0000 7f85c3464740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a696cb0 0x55f14a6b9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:02.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.205+0000 7f85c3464740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f14a6975d0 0x55f14a6ba120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:02.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.205+0000 7f85c3464740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f14a6a1e90 0x55f14a6998f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:02.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.205+0000 7f85c3464740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc1af9b0 con 0x55f14a696cb0 2024-09-19T06:23:02.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.205+0000 7f85c3464740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc1b14f0 con 0x55f14a6975d0 2024-09-19T06:23:02.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.205+0000 7f85c3464740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc1b0080 con 0x55f14a6a1e90 2024-09-19T06:23:02.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.206+0000 7f85ba800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a696cb0 0x55f14a6b9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:02.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.206+0000 7f85ba800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a696cb0 0x55f14a6b9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56266/0 (socket says 172.21.15.3:56266) 2024-09-19T06:23:02.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.206+0000 7f85ba800640 1 -- 172.21.15.3:0/3152227016 learned_addr learned my addr 172.21.15.3:0/3152227016 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:02.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.206+0000 7f85b1400640 1 --2- 172.21.15.3:0/3152227016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f14a6975d0 0x55f14a6ba120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:02.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.206+0000 7f85ba800640 1 -- 172.21.15.3:0/3152227016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f14a6a1e90 msgr2=0x55f14a6998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:02.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.206+0000 7f85ba800640 1 --2- 172.21.15.3:0/3152227016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f14a6a1e90 0x55f14a6998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.206+0000 7f85ba800640 1 -- 172.21.15.3:0/3152227016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f14a6975d0 msgr2=0x55f14a6ba120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:02.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.206+0000 7f85ba800640 1 --2- 172.21.15.3:0/3152227016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f14a6975d0 0x55f14a6ba120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.206+0000 7f85ba800640 1 -- 172.21.15.3:0/3152227016 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f14a6add90 con 0x55f14a696cb0 2024-09-19T06:23:02.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.206+0000 7f85ba800640 1 --2- 172.21.15.3:0/3152227016 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a696cb0 0x55f14a6b9be0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f85b4004af0 tx=0x7f85b4031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c0840cad3bec72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:02.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.207+0000 7f85aa600640 1 -- 172.21.15.3:0/3152227016 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b4030b10 con 0x55f14a696cb0 2024-09-19T06:23:02.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.207+0000 7f85aa600640 1 -- 172.21.15.3:0/3152227016 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85b4036070 con 0x55f14a696cb0 2024-09-19T06:23:02.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.207+0000 7f85aa600640 1 -- 172.21.15.3:0/3152227016 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b4004490 con 0x55f14a696cb0 2024-09-19T06:23:02.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.207+0000 7f85c3464740 1 -- 172.21.15.3:0/3152227016 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a696cb0 msgr2=0x55f14a6b9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:02.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.207+0000 7f85c3464740 1 --2- 172.21.15.3:0/3152227016 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a696cb0 0x55f14a6b9be0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f85b4004af0 tx=0x7f85b4031000 comp rx=0 tx=0).stop 2024-09-19T06:23:02.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.207+0000 7f85c3464740 1 -- 172.21.15.3:0/3152227016 shutdown_connections 2024-09-19T06:23:02.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.207+0000 7f85c3464740 1 --2- 172.21.15.3:0/3152227016 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f14a6a1e90 0x55f14a6998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.207+0000 7f85c3464740 1 --2- 172.21.15.3:0/3152227016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f14a6975d0 0x55f14a6ba120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.207+0000 7f85c3464740 1 --2- 172.21.15.3:0/3152227016 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a696cb0 0x55f14a6b9be0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.207+0000 7f85c3464740 1 -- 172.21.15.3:0/3152227016 >> 172.21.15.3:0/3152227016 conn(0x55f14a693240 msgr2=0x55f14a69d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:02.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.208+0000 7f85c3464740 1 -- 172.21.15.3:0/3152227016 shutdown_connections 2024-09-19T06:23:02.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.208+0000 7f85c3464740 1 -- 172.21.15.3:0/3152227016 wait complete. 2024-09-19T06:23:02.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.208+0000 7f85c3464740 1 -- start start 2024-09-19T06:23:02.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.208+0000 7f85c3464740 1 Processor -- start 2024-09-19T06:23:02.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.209+0000 7f85c3464740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a696cb0 0x55f14a6aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:02.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.209+0000 7f85c3464740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f14a6975d0 0x55f14a6a57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:02.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.209+0000 7f85c3464740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f14a6a1e90 0x55f14a6a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:02.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.209+0000 7f85c3464740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc1b0e20 con 0x55f14a696cb0 2024-09-19T06:23:02.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.209+0000 7f85c3464740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc1b0750 con 0x55f14a6a1e90 2024-09-19T06:23:02.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.209+0000 7f85c3464740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc1ad9b0 con 0x55f14a6975d0 2024-09-19T06:23:02.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.209+0000 7f85c3464740 10 client.0 _ll_register_callbacks cb 0x7f85a4009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:02.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.209+0000 7f85ba800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a696cb0 0x55f14a6aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:02.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.209+0000 7f85ba800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a696cb0 0x55f14a6aa4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56268/0 (socket says 172.21.15.3:56268) 2024-09-19T06:23:02.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.209+0000 7f85ba800640 1 -- 172.21.15.3:0/3174181946 learned_addr learned my addr 172.21.15.3:0/3174181946 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:02.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.209+0000 7f85b1400640 1 --2- 172.21.15.3:0/3174181946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f14a6975d0 0x55f14a6a57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:02.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.209+0000 7f85ba800640 1 --2- 172.21.15.3:0/3174181946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f14a6a1e90 0x55f14a6a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:02.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.210+0000 7f85ba800640 1 -- 172.21.15.3:0/3174181946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f14a6975d0 msgr2=0x55f14a6a57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:02.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.210+0000 7f85ba800640 1 --2- 172.21.15.3:0/3174181946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f14a6975d0 0x55f14a6a57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.210+0000 7f85ba800640 1 -- 172.21.15.3:0/3174181946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f14a6a1e90 msgr2=0x55f14a6a5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:02.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.210+0000 7f85ba800640 1 --2- 172.21.15.3:0/3174181946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f14a6a1e90 0x55f14a6a5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.210+0000 7f85ba800640 1 -- 172.21.15.3:0/3174181946 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f14a6a6350 con 0x55f14a696cb0 2024-09-19T06:23:02.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.210+0000 7f85ba800640 1 --2- 172.21.15.3:0/3174181946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a696cb0 0x55f14a6aa4a0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f85b402ae10 tx=0x7f85b4030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c93c892625d5e00 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:02.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.210+0000 7f859f400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:23:02.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.210+0000 7f859f400640 1 -- 172.21.15.3:0/3174181946 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b4005050 con 0x55f14a696cb0 2024-09-19T06:23:02.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.210+0000 7f859f400640 1 -- 172.21.15.3:0/3174181946 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7f85b40051f0 con 0x55f14a696cb0 2024-09-19T06:23:02.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.210+0000 7f85c3464740 1 -- 172.21.15.3:0/3174181946 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85b4036070 con 0x55f14a696cb0 2024-09-19T06:23:02.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.210+0000 7f859f400640 1 -- 172.21.15.3:0/3174181946 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f85b40053f0 con 0x55f14a696cb0 2024-09-19T06:23:02.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.211+0000 7f85c3464740 10 client.18405 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:02.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.211+0000 7f85c3464740 1 -- 172.21.15.3:0/3174181946 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f14a71ca40 con 0x55f14a696cb0 2024-09-19T06:23:02.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.211+0000 7f859f400640 1 -- 172.21.15.3:0/3174181946 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85b4036070 con 0x55f14a696cb0 2024-09-19T06:23:02.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.211+0000 7f859f400640 1 -- 172.21.15.3:0/3174181946 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f85b406a020 con 0x55f14a696cb0 2024-09-19T06:23:02.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.211+0000 7f85c3464740 10 client.18405 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:02.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.211+0000 7f85c3464740 10 client.18405 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:02.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.211+0000 7f85c3464740 20 client.18405 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:02.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.211+0000 7f85c3464740 1 --2- 172.21.15.3:0/3174181946 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f14a71cc10 0x55f14a71f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:02.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.211+0000 7f85c3464740 4 client.18405 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:23:02.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.211+0000 7f85c3464740 1 -- 172.21.15.3:0/3174181946 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f14a604d10 con 0x55f14a71cc10 2024-09-19T06:23:02.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.212+0000 7f85b1400640 1 --2- 172.21.15.3:0/3174181946 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f14a71cc10 0x55f14a71f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:02.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.212+0000 7f85b1400640 1 --2- 172.21.15.3:0/3174181946 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f14a71cc10 0x55f14a71f000 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa00b4a420a837a1 server_cookie=38d6db16e038d740 in_seq=0 out_seq=0 2024-09-19T06:23:02.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.212+0000 7f859f400640 10 client.18405 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:02.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.213+0000 7f859f400640 1 -- 172.21.15.3:0/3174181946 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f14a604d10 con 0x55f14a71cc10 2024-09-19T06:23:02.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.213+0000 7f859f400640 10 client.18405 handle_command_reply: tid=0 2024-09-19T06:23:02.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.213+0000 7f85c3464740 1 client.18405 shutdown 2024-09-19T06:23:02.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.213+0000 7f85c3464740 1 -- 172.21.15.3:0/3174181946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a696cb0 msgr2=0x55f14a6aa4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:02.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.213+0000 7f85c3464740 1 --2- 172.21.15.3:0/3174181946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a696cb0 0x55f14a6aa4a0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f85b402ae10 tx=0x7f85b4030ec0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.213+0000 7f85c3464740 1 -- 172.21.15.3:0/3174181946 shutdown_connections 2024-09-19T06:23:02.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.213+0000 7f85c3464740 1 --2- 172.21.15.3:0/3174181946 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55f14a71cc10 0x55f14a71f000 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.213+0000 7f85c3464740 1 --2- 172.21.15.3:0/3174181946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f14a6a1e90 0x55f14a6a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.213+0000 7f85c3464740 1 --2- 172.21.15.3:0/3174181946 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55f14a6975d0 0x55f14a6a57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.213+0000 7f85c3464740 1 --2- 172.21.15.3:0/3174181946 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55f14a696cb0 0x55f14a6aa4a0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.213+0000 7f85c3464740 1 -- 172.21.15.3:0/3174181946 >> 172.21.15.3:0/3174181946 conn(0x55f14a693240 msgr2=0x55f14a691a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:02.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.213+0000 7f859f400640 0 client.18405 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:02.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.214+0000 7f85c3464740 1 -- 172.21.15.3:0/3174181946 shutdown_connections 2024-09-19T06:23:02.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.214+0000 7f85c3464740 1 -- 172.21.15.3:0/3174181946 wait complete. 2024-09-19T06:23:02.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.214+0000 7f85c3464740 20 client.18405 trim_cache size 0 max 16384 2024-09-19T06:23:02.219 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:23:02.219 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": 0, 2024-09-19T06:23:02.219 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_tag": "5b37a587-571c-4426-9814-46acfcebf0fb", 2024-09-19T06:23:02.219 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": "asynchronous" 2024-09-19T06:23:02.219 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:23:02.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.214+0000 7f85bb200640 1 -- 172.21.15.3:0/827670822 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f85a00a3430 msgr2=0x7f85a00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:02.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.214+0000 7f85bb200640 1 --2- 172.21.15.3:0/827670822 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f85a00a3430 0x7f85a00a58f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55f14a6940a0 tx=0x7f85ac004a40 comp rx=0 tx=0).stop 2024-09-19T06:23:02.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.214+0000 7f85bb200640 1 -- 172.21.15.3:0/827670822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85bc1019d0 msgr2=0x7f85bc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:02.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.214+0000 7f85bb200640 1 --2- 172.21.15.3:0/827670822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85bc1019d0 0x7f85bc0744f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00e9f0 tx=0x7f85ac00edf0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.214+0000 7f85bb200640 1 -- 172.21.15.3:0/827670822 shutdown_connections 2024-09-19T06:23:02.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.214+0000 7f85bb200640 1 --2- 172.21.15.3:0/827670822 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f85a00a3430 0x7f85a00a58f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.214+0000 7f85bb200640 1 --2- 172.21.15.3:0/827670822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f85bc1079d0 0x7f85bc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.214+0000 7f85bb200640 1 --2- 172.21.15.3:0/827670822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85bc102370 0x7f85bc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.214+0000 7f85bb200640 1 --2- 172.21.15.3:0/827670822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f85bc1019d0 0x7f85bc0744f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:02.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.214+0000 7f85bb200640 1 -- 172.21.15.3:0/827670822 >> 172.21.15.3:0/827670822 conn(0x7f85bc0fd710 msgr2=0x7f85bc0fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:02.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.215+0000 7f85bb200640 1 -- 172.21.15.3:0/827670822 shutdown_connections 2024-09-19T06:23:02.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:02.215+0000 7f85bb200640 1 -- 172.21.15.3:0/827670822 wait complete. 2024-09-19T06:23:02.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:02 smithi003 ceph-mon[30893]: pgmap v330: 97 pgs: 97 active+clean; 5.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-19T06:23:02.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:02 smithi071 ceph-mon[35662]: pgmap v330: 97 pgs: 97 active+clean; 5.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-19T06:23:02.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:02 smithi059 ceph-mon[35138]: pgmap v330: 97 pgs: 97 active+clean; 5.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-19T06:23:03.159 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:23:03.541 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:03.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:03 smithi003 ceph-mon[30893]: scrub queued for path: / 2024-09-19T06:23:03.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:03 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:03.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:03 smithi003 ceph-mon[30893]: scrub summary: active paths [/] 2024-09-19T06:23:03.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:03 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:03.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:03 smithi059 ceph-mon[35138]: scrub queued for path: / 2024-09-19T06:23:03.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:03 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:03.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:03 smithi059 ceph-mon[35138]: scrub summary: active paths [/] 2024-09-19T06:23:03.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:03 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:03.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:03 smithi071 ceph-mon[35662]: scrub queued for path: / 2024-09-19T06:23:03.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:03 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:03.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:03 smithi071 ceph-mon[35662]: scrub summary: active paths [/] 2024-09-19T06:23:03.836 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:03 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:04.125 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.122+0000 7faceb200640 1 -- 172.21.15.3:0/986907204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facec074770 msgr2=0x7facec074b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:04.125 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.122+0000 7faceb200640 1 --2- 172.21.15.3:0/986907204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facec074770 0x7facec074b50 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7facdc009900 tx=0x7facdc02a480 comp rx=0 tx=0).stop 2024-09-19T06:23:04.125 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.122+0000 7faceb200640 1 -- 172.21.15.3:0/986907204 shutdown_connections 2024-09-19T06:23:04.125 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.122+0000 7faceb200640 1 --2- 172.21.15.3:0/986907204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facec10e2f0 0x7facec110780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.125 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.122+0000 7faceb200640 1 --2- 172.21.15.3:0/986907204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec075090 0x7facec10dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.125 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.122+0000 7faceb200640 1 --2- 172.21.15.3:0/986907204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facec074770 0x7facec074b50 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.125 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.122+0000 7faceb200640 1 -- 172.21.15.3:0/986907204 >> 172.21.15.3:0/986907204 conn(0x7facec0fd700 msgr2=0x7facec0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:04.125 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.122+0000 7faceb200640 1 -- 172.21.15.3:0/986907204 shutdown_connections 2024-09-19T06:23:04.125 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.122+0000 7faceb200640 1 -- 172.21.15.3:0/986907204 wait complete. 2024-09-19T06:23:04.126 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.124+0000 7faceb200640 1 Processor -- start 2024-09-19T06:23:04.126 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.124+0000 7faceb200640 1 -- start start 2024-09-19T06:23:04.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.124+0000 7faceb200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facec074770 0x7facec19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:04.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.124+0000 7faceb200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facec075090 0x7facec19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:04.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.124+0000 7faceb200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec10e2f0 0x7facec19ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:04.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.124+0000 7faceb200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7facec1140c0 con 0x7facec075090 2024-09-19T06:23:04.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.124+0000 7faceb200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7facec113f40 con 0x7facec10e2f0 2024-09-19T06:23:04.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.124+0000 7faceb200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7facec114240 con 0x7facec074770 2024-09-19T06:23:04.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.125+0000 7face3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facec075090 0x7facec19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:04.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.125+0000 7face3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facec075090 0x7facec19aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49196/0 (socket says 172.21.15.3:49196) 2024-09-19T06:23:04.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.125+0000 7face3e00640 1 -- 172.21.15.3:0/738323663 learned_addr learned my addr 172.21.15.3:0/738323663 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:04.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.125+0000 7facea800640 1 --2- 172.21.15.3:0/738323663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec10e2f0 0x7facec19ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:04.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.125+0000 7face9e00640 1 --2- 172.21.15.3:0/738323663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facec074770 0x7facec19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:04.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.125+0000 7face3e00640 1 -- 172.21.15.3:0/738323663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facec074770 msgr2=0x7facec19a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:04.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.125+0000 7face3e00640 1 --2- 172.21.15.3:0/738323663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facec074770 0x7facec19a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.125+0000 7face3e00640 1 -- 172.21.15.3:0/738323663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec10e2f0 msgr2=0x7facec19ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:04.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.125+0000 7face3e00640 1 --2- 172.21.15.3:0/738323663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec10e2f0 0x7facec19ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.125+0000 7face3e00640 1 -- 172.21.15.3:0/738323663 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facec19f550 con 0x7facec075090 2024-09-19T06:23:04.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.125+0000 7face3e00640 1 --2- 172.21.15.3:0/738323663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facec075090 0x7facec19aae0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7facd400e9f0 tx=0x7facd400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:04.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.126+0000 7face2a00640 1 -- 172.21.15.3:0/738323663 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd400cd80 con 0x7facec075090 2024-09-19T06:23:04.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.126+0000 7face2a00640 1 -- 172.21.15.3:0/738323663 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facd4010910 con 0x7facec075090 2024-09-19T06:23:04.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.126+0000 7face2a00640 1 -- 172.21.15.3:0/738323663 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd4018990 con 0x7facec075090 2024-09-19T06:23:04.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.126+0000 7faceb200640 1 -- 172.21.15.3:0/738323663 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facec19f840 con 0x7facec075090 2024-09-19T06:23:04.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.126+0000 7faceb200640 1 -- 172.21.15.3:0/738323663 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facec1a7120 con 0x7facec075090 2024-09-19T06:23:04.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.129+0000 7facf3922740 1 Processor -- start 2024-09-19T06:23:04.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.129+0000 7face2a00640 1 -- 172.21.15.3:0/738323663 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7facd4010ac0 con 0x7facec075090 2024-09-19T06:23:04.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.129+0000 7facf3922740 1 -- start start 2024-09-19T06:23:04.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.130+0000 7facf3922740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2ca9d50 0x55e6f2caa130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:04.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.130+0000 7facf3922740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f2caa670 0x55e6f2cb49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:04.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.130+0000 7facf3922740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6f2cb4f30 0x55e6f2cb7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:04.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.130+0000 7facf3922740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e6f2c103e0 con 0x55e6f2cb4f30 2024-09-19T06:23:04.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.130+0000 7facf3922740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e6f2bb7d80 con 0x55e6f2ca9d50 2024-09-19T06:23:04.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.130+0000 7facf3922740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e6f2c0c3a0 con 0x55e6f2caa670 2024-09-19T06:23:04.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.130+0000 7facea800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2ca9d50 0x55e6f2caa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:04.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.130+0000 7face3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6f2cb4f30 0x55e6f2cb7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:04.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.130+0000 7facea800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2ca9d50 0x55e6f2caa130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:37402/0 (socket says 172.21.15.3:37402) 2024-09-19T06:23:04.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.130+0000 7facea800640 1 -- 172.21.15.3:0/3457450770 learned_addr learned my addr 172.21.15.3:0/3457450770 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:04.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.130+0000 7face9e00640 1 --2- 172.21.15.3:0/3457450770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f2caa670 0x55e6f2cb49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:04.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.130+0000 7facea800640 1 -- 172.21.15.3:0/3457450770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f2caa670 msgr2=0x55e6f2cb49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:04.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.130+0000 7facea800640 1 --2- 172.21.15.3:0/3457450770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f2caa670 0x55e6f2cb49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.131+0000 7facea800640 1 -- 172.21.15.3:0/3457450770 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6f2cb4f30 msgr2=0x55e6f2cb7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:04.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.131+0000 7facea800640 1 --2- 172.21.15.3:0/3457450770 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6f2cb4f30 0x55e6f2cb7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.131+0000 7facea800640 1 -- 172.21.15.3:0/3457450770 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6f2bd6ae0 con 0x55e6f2ca9d50 2024-09-19T06:23:04.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.131+0000 7face2a00640 1 --2- 172.21.15.3:0/738323663 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7facd00a3430 0x7facd00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:04.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.131+0000 7facea800640 1 --2- 172.21.15.3:0/3457450770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2ca9d50 0x55e6f2caa130 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7face4009f50 tx=0x7face40118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c91c8307394dd3cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:04.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.131+0000 7face2a00640 1 -- 172.21.15.3:0/738323663 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7facd40cffe0 con 0x7facec075090 2024-09-19T06:23:04.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.131+0000 7facdb400640 1 -- 172.21.15.3:0/3457450770 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4004d20 con 0x55e6f2ca9d50 2024-09-19T06:23:04.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.131+0000 7facdb400640 1 -- 172.21.15.3:0/3457450770 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7face4004050 con 0x55e6f2ca9d50 2024-09-19T06:23:04.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.131+0000 7face9e00640 1 --2- 172.21.15.3:0/738323663 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7facd00a3430 0x7facd00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:04.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.131+0000 7facdb400640 1 -- 172.21.15.3:0/3457450770 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face4005220 con 0x55e6f2ca9d50 2024-09-19T06:23:04.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.132+0000 7facf3922740 1 -- 172.21.15.3:0/3457450770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2ca9d50 msgr2=0x55e6f2caa130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:04.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.132+0000 7face9e00640 1 --2- 172.21.15.3:0/738323663 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7facd00a3430 0x7facd00a58f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7facdc009230 tx=0x7facdc0058d0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:04.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.132+0000 7facf3922740 1 --2- 172.21.15.3:0/3457450770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2ca9d50 0x55e6f2caa130 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7face4009f50 tx=0x7face40118d0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.132+0000 7facf3922740 1 -- 172.21.15.3:0/3457450770 shutdown_connections 2024-09-19T06:23:04.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.132+0000 7facf3922740 1 --2- 172.21.15.3:0/3457450770 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6f2cb4f30 0x55e6f2cb7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.132+0000 7facf3922740 1 --2- 172.21.15.3:0/3457450770 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f2caa670 0x55e6f2cb49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.132+0000 7facf3922740 1 --2- 172.21.15.3:0/3457450770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2ca9d50 0x55e6f2caa130 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.132+0000 7facf3922740 1 -- 172.21.15.3:0/3457450770 >> 172.21.15.3:0/3457450770 conn(0x55e6f2ca62e0 msgr2=0x55e6f2ca66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:04.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.132+0000 7facf3922740 1 -- 172.21.15.3:0/3457450770 shutdown_connections 2024-09-19T06:23:04.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.132+0000 7facf3922740 1 -- 172.21.15.3:0/3457450770 wait complete. 2024-09-19T06:23:04.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.133+0000 7facf3922740 1 -- start start 2024-09-19T06:23:04.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.133+0000 7facf3922740 1 Processor -- start 2024-09-19T06:23:04.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.133+0000 7facf3922740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f2ca9d50 0x55e6f2cb1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:04.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.133+0000 7facf3922740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2caa670 0x55e6f2cb2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:04.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.133+0000 7facf3922740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6f2cb4f30 0x55e6f2cb28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:04.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.134+0000 7facf3922740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e6f2cb7ba0 con 0x55e6f2cb4f30 2024-09-19T06:23:04.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.134+0000 7facf3922740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e6f2bcb0f0 con 0x55e6f2caa670 2024-09-19T06:23:04.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.134+0000 7facf3922740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e6f2cb7d20 con 0x55e6f2ca9d50 2024-09-19T06:23:04.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.134+0000 7facf3922740 10 client.0 _ll_register_callbacks cb 0x55e6f2bbc9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:04.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.134+0000 7face9e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f2ca9d50 0x55e6f2cb1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:04.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.134+0000 7face3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2caa670 0x55e6f2cb2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:04.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.134+0000 7face9e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f2ca9d50 0x55e6f2cb1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:35416/0 (socket says 172.21.15.3:35416) 2024-09-19T06:23:04.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.134+0000 7face9e00640 1 -- 172.21.15.3:0/1037798325 learned_addr learned my addr 172.21.15.3:0/1037798325 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:04.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.134+0000 7facea800640 1 --2- 172.21.15.3:0/1037798325 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6f2cb4f30 0x55e6f2cb28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:04.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.134+0000 7face3e00640 1 -- 172.21.15.3:0/1037798325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f2ca9d50 msgr2=0x55e6f2cb1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:04.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.134+0000 7face3e00640 1 --2- 172.21.15.3:0/1037798325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f2ca9d50 0x55e6f2cb1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.134+0000 7face3e00640 1 -- 172.21.15.3:0/1037798325 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6f2cb4f30 msgr2=0x55e6f2cb28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:04.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.134+0000 7face3e00640 1 --2- 172.21.15.3:0/1037798325 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6f2cb4f30 0x55e6f2cb28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.134+0000 7face3e00640 1 -- 172.21.15.3:0/1037798325 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6f29813c0 con 0x55e6f2caa670 2024-09-19T06:23:04.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.135+0000 7face3e00640 1 --2- 172.21.15.3:0/1037798325 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2caa670 0x55e6f2cb2360 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7facd40cd6e0 tx=0x7facd4009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31193838990fdf7e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:04.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.135+0000 7faccfe00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:23:04.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.135+0000 7faccfe00640 1 -- 172.21.15.3:0/1037798325 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd409bc80 con 0x55e6f2caa670 2024-09-19T06:23:04.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.135+0000 7faccfe00640 1 -- 172.21.15.3:0/1037798325 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7facd40d3c40 con 0x55e6f2caa670 2024-09-19T06:23:04.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.135+0000 7facf3922740 1 -- 172.21.15.3:0/1037798325 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7face4004050 con 0x55e6f2caa670 2024-09-19T06:23:04.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.135+0000 7faccfe00640 1 -- 172.21.15.3:0/1037798325 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7facd40cdb60 con 0x55e6f2caa670 2024-09-19T06:23:04.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.135+0000 7facf3922740 10 client.28451 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:04.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.135+0000 7facf3922740 1 -- 172.21.15.3:0/1037798325 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e6f2cc3850 con 0x55e6f2caa670 2024-09-19T06:23:04.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.135+0000 7faccfe00640 1 -- 172.21.15.3:0/1037798325 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7face4004050 con 0x55e6f2caa670 2024-09-19T06:23:04.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.136+0000 7faccfe00640 1 -- 172.21.15.3:0/1037798325 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7facd40a0200 con 0x55e6f2caa670 2024-09-19T06:23:04.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.136+0000 7facf3922740 10 client.28451 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:04.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.136+0000 7facf3922740 10 client.28451 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:04.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.136+0000 7facf3922740 20 client.28451 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:04.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.136+0000 7facf3922740 1 --2- 172.21.15.3:0/1037798325 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e6f2cc4d10 0x55e6f2cc7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:04.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.136+0000 7facf3922740 4 client.28451 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:04.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.136+0000 7facf3922740 1 -- 172.21.15.3:0/1037798325 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6f2c1d950 con 0x55e6f2cc4d10 2024-09-19T06:23:04.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.136+0000 7face9e00640 1 --2- 172.21.15.3:0/1037798325 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e6f2cc4d10 0x55e6f2cc7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:04.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.137+0000 7face9e00640 1 --2- 172.21.15.3:0/1037798325 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e6f2cc4d10 0x55e6f2cc7120 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c00a34b83bf0baa9 server_cookie=926e8b93e5637687 in_seq=0 out_seq=0 2024-09-19T06:23:04.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.137+0000 7faccfe00640 10 client.28451 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:04.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.137+0000 7faccfe00640 1 -- 172.21.15.3:0/1037798325 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e6f2c1d950 con 0x55e6f2cc4d10 2024-09-19T06:23:04.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.137+0000 7faccfe00640 10 client.28451 handle_command_reply: tid=0 2024-09-19T06:23:04.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.137+0000 7facf3922740 1 client.28451 shutdown 2024-09-19T06:23:04.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.138+0000 7facf3922740 1 -- 172.21.15.3:0/1037798325 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2caa670 msgr2=0x55e6f2cb2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:04.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.138+0000 7facf3922740 1 --2- 172.21.15.3:0/1037798325 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2caa670 0x55e6f2cb2360 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7facd40cd6e0 tx=0x7facd4009310 comp rx=0 tx=0).stop 2024-09-19T06:23:04.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.138+0000 7facf3922740 1 -- 172.21.15.3:0/1037798325 shutdown_connections 2024-09-19T06:23:04.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.138+0000 7facf3922740 1 --2- 172.21.15.3:0/1037798325 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e6f2cc4d10 0x55e6f2cc7120 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.138+0000 7facf3922740 1 --2- 172.21.15.3:0/1037798325 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6f2cb4f30 0x55e6f2cb28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.138+0000 7facf3922740 1 --2- 172.21.15.3:0/1037798325 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2caa670 0x55e6f2cb2360 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.138+0000 7faccfe00640 0 client.28451 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:04.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.138+0000 7facf3922740 1 --2- 172.21.15.3:0/1037798325 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f2ca9d50 0x55e6f2cb1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.138+0000 7facf3922740 1 -- 172.21.15.3:0/1037798325 >> 172.21.15.3:0/1037798325 conn(0x55e6f2ca62e0 msgr2=0x55e6f2cabfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:04.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.138+0000 7facf3922740 1 -- 172.21.15.3:0/1037798325 shutdown_connections 2024-09-19T06:23:04.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.138+0000 7facf3922740 1 -- 172.21.15.3:0/1037798325 wait complete. 2024-09-19T06:23:04.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.138+0000 7facf3922740 20 client.28451 trim_cache size 0 max 16384 2024-09-19T06:23:04.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.156+0000 7facf3922740 1 Processor -- start 2024-09-19T06:23:04.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.156+0000 7facf3922740 1 -- start start 2024-09-19T06:23:04.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.156+0000 7facf3922740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2ca9d50 0x55e6f2ca1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:04.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.156+0000 7facf3922740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6f2caa670 0x55e6f2cb3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:04.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.156+0000 7facf3922740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f2cb4f30 0x55e6f2ccc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:04.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.156+0000 7facf3922740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7facec1af9a0 con 0x55e6f2caa670 2024-09-19T06:23:04.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.156+0000 7facf3922740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7facec1b14e0 con 0x55e6f2ca9d50 2024-09-19T06:23:04.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.157+0000 7facf3922740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7facec1b0070 con 0x55e6f2cb4f30 2024-09-19T06:23:04.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.157+0000 7face3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6f2caa670 0x55e6f2cb3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:04.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.157+0000 7face9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2ca9d50 0x55e6f2ca1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:04.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.157+0000 7face9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2ca9d50 0x55e6f2ca1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:37418/0 (socket says 172.21.15.3:37418) 2024-09-19T06:23:04.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.157+0000 7face9e00640 1 -- 172.21.15.3:0/2531963934 learned_addr learned my addr 172.21.15.3:0/2531963934 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:04.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.157+0000 7facea800640 1 --2- 172.21.15.3:0/2531963934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f2cb4f30 0x55e6f2ccc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:04.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.157+0000 7face9e00640 1 -- 172.21.15.3:0/2531963934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f2cb4f30 msgr2=0x55e6f2ccc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:04.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.157+0000 7face9e00640 1 --2- 172.21.15.3:0/2531963934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f2cb4f30 0x55e6f2ccc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.157+0000 7face9e00640 1 -- 172.21.15.3:0/2531963934 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6f2caa670 msgr2=0x55e6f2cb3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:04.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.157+0000 7face9e00640 1 --2- 172.21.15.3:0/2531963934 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6f2caa670 0x55e6f2cb3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.157+0000 7face9e00640 1 -- 172.21.15.3:0/2531963934 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6f2cb4790 con 0x55e6f2ca9d50 2024-09-19T06:23:04.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.157+0000 7face3e00640 1 --2- 172.21.15.3:0/2531963934 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6f2caa670 0x55e6f2cb3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:04.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.158+0000 7face9e00640 1 --2- 172.21.15.3:0/2531963934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2ca9d50 0x55e6f2ca1060 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7facdc031970 tx=0x7facdc03f070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5ca9e933bba5a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:04.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.158+0000 7facdaa00640 1 -- 172.21.15.3:0/2531963934 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc035040 con 0x55e6f2ca9d50 2024-09-19T06:23:04.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.158+0000 7facdaa00640 1 -- 172.21.15.3:0/2531963934 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facdc004490 con 0x55e6f2ca9d50 2024-09-19T06:23:04.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.158+0000 7facdaa00640 1 -- 172.21.15.3:0/2531963934 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc054c60 con 0x55e6f2ca9d50 2024-09-19T06:23:04.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.158+0000 7facf3922740 1 -- 172.21.15.3:0/2531963934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2ca9d50 msgr2=0x55e6f2ca1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:04.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.158+0000 7facf3922740 1 --2- 172.21.15.3:0/2531963934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2ca9d50 0x55e6f2ca1060 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7facdc031970 tx=0x7facdc03f070 comp rx=0 tx=0).stop 2024-09-19T06:23:04.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.158+0000 7facf3922740 1 -- 172.21.15.3:0/2531963934 shutdown_connections 2024-09-19T06:23:04.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.158+0000 7facf3922740 1 --2- 172.21.15.3:0/2531963934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f2cb4f30 0x55e6f2ccc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.158+0000 7facf3922740 1 --2- 172.21.15.3:0/2531963934 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6f2caa670 0x55e6f2cb3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.158+0000 7facf3922740 1 --2- 172.21.15.3:0/2531963934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2ca9d50 0x55e6f2ca1060 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.158+0000 7facf3922740 1 -- 172.21.15.3:0/2531963934 >> 172.21.15.3:0/2531963934 conn(0x55e6f2ca62e0 msgr2=0x55e6f2cb3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:04.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.159+0000 7facf3922740 1 -- 172.21.15.3:0/2531963934 shutdown_connections 2024-09-19T06:23:04.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.159+0000 7facf3922740 1 -- 172.21.15.3:0/2531963934 wait complete. 2024-09-19T06:23:04.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.159+0000 7facf3922740 1 -- start start 2024-09-19T06:23:04.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.159+0000 7facf3922740 1 Processor -- start 2024-09-19T06:23:04.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.160+0000 7facf3922740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f2ca9d50 0x55e6f2caefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:04.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.160+0000 7facf3922740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2caa670 0x55e6f2caf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:04.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.160+0000 7facf3922740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6f2cb4f30 0x55e6f2cafa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:04.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.160+0000 7facf3922740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7facec1b0e10 con 0x55e6f2cb4f30 2024-09-19T06:23:04.165 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.160+0000 7facf3922740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7facec1b0740 con 0x55e6f2caa670 2024-09-19T06:23:04.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.160+0000 7facf3922740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7facec1ad9a0 con 0x55e6f2ca9d50 2024-09-19T06:23:04.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.160+0000 7facf3922740 10 client.0 _ll_register_callbacks cb 0x7facd400cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:04.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.160+0000 7facea800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6f2cb4f30 0x55e6f2cafa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:04.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.160+0000 7face3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2caa670 0x55e6f2caf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:04.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.160+0000 7facea800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6f2cb4f30 0x55e6f2cafa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49244/0 (socket says 172.21.15.3:49244) 2024-09-19T06:23:04.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.160+0000 7face9e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f2ca9d50 0x55e6f2caefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:04.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.160+0000 7facea800640 1 -- 172.21.15.3:0/2746402847 learned_addr learned my addr 172.21.15.3:0/2746402847 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:04.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.160+0000 7face3e00640 1 -- 172.21.15.3:0/2746402847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f2ca9d50 msgr2=0x55e6f2caefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:04.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.160+0000 7face3e00640 1 --2- 172.21.15.3:0/2746402847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f2ca9d50 0x55e6f2caefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.160+0000 7face3e00640 1 -- 172.21.15.3:0/2746402847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6f2cb4f30 msgr2=0x55e6f2cafa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:04.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.160+0000 7face3e00640 1 --2- 172.21.15.3:0/2746402847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6f2cb4f30 0x55e6f2cafa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.160+0000 7face3e00640 1 -- 172.21.15.3:0/2746402847 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6f2d2eaf0 con 0x55e6f2caa670 2024-09-19T06:23:04.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.161+0000 7face3e00640 1 --2- 172.21.15.3:0/2746402847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2caa670 0x55e6f2caf520 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x55e6f2cb33d0 tx=0x7facd400c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bdaff527df659c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:04.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.161+0000 7faccfe00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:23:04.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.161+0000 7faccfe00640 1 -- 172.21.15.3:0/2746402847 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd40a4ee0 con 0x55e6f2caa670 2024-09-19T06:23:04.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.161+0000 7faccfe00640 1 -- 172.21.15.3:0/2746402847 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8571+0+0 (secure 0 0 0) 0x7facd4010430 con 0x55e6f2caa670 2024-09-19T06:23:04.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.161+0000 7facf3922740 1 -- 172.21.15.3:0/2746402847 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facdc004490 con 0x55e6f2caa670 2024-09-19T06:23:04.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.161+0000 7faccfe00640 1 -- 172.21.15.3:0/2746402847 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7facd40d37c0 con 0x55e6f2caa670 2024-09-19T06:23:04.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.161+0000 7facf3922740 10 client.28457 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:04.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.161+0000 7facf3922740 1 -- 172.21.15.3:0/2746402847 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e6f2d2fde0 con 0x55e6f2caa670 2024-09-19T06:23:04.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.161+0000 7faccfe00640 1 -- 172.21.15.3:0/2746402847 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facdc004490 con 0x55e6f2caa670 2024-09-19T06:23:04.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.161+0000 7faccfe00640 1 -- 172.21.15.3:0/2746402847 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7facd40d1070 con 0x55e6f2caa670 2024-09-19T06:23:04.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.161+0000 7facf3922740 10 client.28457 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:04.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.161+0000 7facf3922740 10 client.28457 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:04.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.161+0000 7facf3922740 20 client.28457 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:04.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.162+0000 7facf3922740 1 --2- 172.21.15.3:0/2746402847 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e6f2d30310 0x55e6f2d32700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:04.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.162+0000 7facf3922740 4 client.28457 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:23:04.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.162+0000 7facf3922740 1 -- 172.21.15.3:0/2746402847 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e6f2c17e60 con 0x55e6f2d30310 2024-09-19T06:23:04.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.162+0000 7face9e00640 1 --2- 172.21.15.3:0/2746402847 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e6f2d30310 0x55e6f2d32700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:04.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.162+0000 7face9e00640 1 --2- 172.21.15.3:0/2746402847 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e6f2d30310 0x55e6f2d32700 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=510b7657cae0972b server_cookie=ad6fa5e1442ad521 in_seq=0 out_seq=0 2024-09-19T06:23:04.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.162+0000 7faccfe00640 10 client.28457 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:04.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.163+0000 7faccfe00640 1 -- 172.21.15.3:0/2746402847 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55e6f2c17e60 con 0x55e6f2d30310 2024-09-19T06:23:04.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.163+0000 7faccfe00640 10 client.28457 handle_command_reply: tid=0 2024-09-19T06:23:04.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.163+0000 7facf3922740 1 client.28457 shutdown 2024-09-19T06:23:04.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.163+0000 7facf3922740 1 -- 172.21.15.3:0/2746402847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2caa670 msgr2=0x55e6f2caf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:04.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.163+0000 7facf3922740 1 --2- 172.21.15.3:0/2746402847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2caa670 0x55e6f2caf520 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x55e6f2cb33d0 tx=0x7facd400c840 comp rx=0 tx=0).stop 2024-09-19T06:23:04.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.163+0000 7facf3922740 1 -- 172.21.15.3:0/2746402847 shutdown_connections 2024-09-19T06:23:04.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.163+0000 7facf3922740 1 --2- 172.21.15.3:0/2746402847 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e6f2d30310 0x55e6f2d32700 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.163+0000 7facf3922740 1 --2- 172.21.15.3:0/2746402847 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6f2cb4f30 0x55e6f2cafa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.163+0000 7facf3922740 1 --2- 172.21.15.3:0/2746402847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6f2caa670 0x55e6f2caf520 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.163+0000 7faccfe00640 0 client.28457 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:04.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.163+0000 7facf3922740 1 --2- 172.21.15.3:0/2746402847 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6f2ca9d50 0x55e6f2caefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.163+0000 7facf3922740 1 -- 172.21.15.3:0/2746402847 >> 172.21.15.3:0/2746402847 conn(0x55e6f2ca62e0 msgr2=0x55e6f2ca5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:04.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.163+0000 7facf3922740 1 -- 172.21.15.3:0/2746402847 shutdown_connections 2024-09-19T06:23:04.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.163+0000 7facf3922740 1 -- 172.21.15.3:0/2746402847 wait complete. 2024-09-19T06:23:04.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.163+0000 7facf3922740 20 client.28457 trim_cache size 0 max 16384 2024-09-19T06:23:04.169 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:23:04.169 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:23:04.169 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": { 2024-09-19T06:23:04.170 INFO:teuthology.orchestra.run.smithi003.stdout: "5b37a587-571c-4426-9814-46acfcebf0fb": { 2024-09-19T06:23:04.170 INFO:teuthology.orchestra.run.smithi003.stdout: "path": "/", 2024-09-19T06:23:04.170 INFO:teuthology.orchestra.run.smithi003.stdout: "tag": "5b37a587-571c-4426-9814-46acfcebf0fb", 2024-09-19T06:23:04.170 INFO:teuthology.orchestra.run.smithi003.stdout: "options": "recursive,force" 2024-09-19T06:23:04.170 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:23:04.170 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:23:04.170 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:23:04.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.164+0000 7faceb200640 1 -- 172.21.15.3:0/738323663 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7facd00a3430 msgr2=0x7facd00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:04.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.164+0000 7faceb200640 1 --2- 172.21.15.3:0/738323663 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7facd00a3430 0x7facd00a58f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7facdc009230 tx=0x7facdc0058d0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.164+0000 7faceb200640 1 -- 172.21.15.3:0/738323663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facec075090 msgr2=0x7facec19aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:04.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.164+0000 7faceb200640 1 --2- 172.21.15.3:0/738323663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facec075090 0x7facec19aae0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7facd400e9f0 tx=0x7facd400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.164+0000 7faceb200640 1 -- 172.21.15.3:0/738323663 shutdown_connections 2024-09-19T06:23:04.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.164+0000 7faceb200640 1 --2- 172.21.15.3:0/738323663 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7facd00a3430 0x7facd00a58f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.164+0000 7faceb200640 1 --2- 172.21.15.3:0/738323663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7facec10e2f0 0x7facec19ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.164+0000 7faceb200640 1 --2- 172.21.15.3:0/738323663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7facec075090 0x7facec19aae0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.164+0000 7faceb200640 1 --2- 172.21.15.3:0/738323663 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7facec074770 0x7facec19a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:04.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.164+0000 7faceb200640 1 -- 172.21.15.3:0/738323663 >> 172.21.15.3:0/738323663 conn(0x7facec0fd700 msgr2=0x7facec0fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:04.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.164+0000 7faceb200640 1 -- 172.21.15.3:0/738323663 shutdown_connections 2024-09-19T06:23:04.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:04.164+0000 7faceb200640 1 -- 172.21.15.3:0/738323663 wait complete. 2024-09-19T06:23:04.601 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:04 smithi003 ceph-mon[30893]: pgmap v331: 97 pgs: 97 active+clean; 5.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-19T06:23:04.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:04 smithi059 ceph-mon[35138]: pgmap v331: 97 pgs: 97 active+clean; 5.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-19T06:23:04.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:04 smithi071 ceph-mon[35662]: pgmap v331: 97 pgs: 97 active+clean; 5.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-19T06:23:04.978 INFO:tasks.cephfs.filesystem:scrub status for tag:5b37a587-571c-4426-9814-46acfcebf0fb - {'path': '/', 'tag': '5b37a587-571c-4426-9814-46acfcebf0fb', 'options': 'recursive,force'} 2024-09-19T06:23:05.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:05 smithi059 ceph-mon[35138]: scrub summary: idle 2024-09-19T06:23:05.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:05 smithi003 ceph-mon[30893]: scrub summary: idle 2024-09-19T06:23:05.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:05 smithi071 ceph-mon[35662]: scrub summary: idle 2024-09-19T06:23:06.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:06 smithi059 ceph-mon[35138]: pgmap v332: 97 pgs: 97 active+clean; 5.3 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 105 KiB/s wr, 40 op/s 2024-09-19T06:23:06.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:06 smithi059 ceph-mon[35138]: osdmap e98: 12 total, 12 up, 12 in 2024-09-19T06:23:06.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:06 smithi003 ceph-mon[30893]: pgmap v332: 97 pgs: 97 active+clean; 5.3 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 105 KiB/s wr, 40 op/s 2024-09-19T06:23:06.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:06 smithi003 ceph-mon[30893]: osdmap e98: 12 total, 12 up, 12 in 2024-09-19T06:23:06.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:06 smithi071 ceph-mon[35662]: pgmap v332: 97 pgs: 97 active+clean; 5.3 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 105 KiB/s wr, 40 op/s 2024-09-19T06:23:06.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:06 smithi071 ceph-mon[35662]: osdmap e98: 12 total, 12 up, 12 in 2024-09-19T06:23:08.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:08 smithi059 ceph-mon[35138]: pgmap v334: 97 pgs: 97 active+clean; 5.3 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 105 KiB/s wr, 41 op/s 2024-09-19T06:23:08.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:08 smithi003 ceph-mon[30893]: pgmap v334: 97 pgs: 97 active+clean; 5.3 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 105 KiB/s wr, 41 op/s 2024-09-19T06:23:08.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:08 smithi071 ceph-mon[35662]: pgmap v334: 97 pgs: 97 active+clean; 5.3 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 105 KiB/s wr, 41 op/s 2024-09-19T06:23:10.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:10 smithi059 ceph-mon[35138]: pgmap v335: 97 pgs: 97 active+clean; 5.5 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 100 KiB/s wr, 38 op/s 2024-09-19T06:23:10.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:10 smithi003 ceph-mon[30893]: pgmap v335: 97 pgs: 97 active+clean; 5.5 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 100 KiB/s wr, 38 op/s 2024-09-19T06:23:10.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:10 smithi071 ceph-mon[35662]: pgmap v335: 97 pgs: 97 active+clean; 5.5 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 100 KiB/s wr, 38 op/s 2024-09-19T06:23:11.290 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.288+0000 7f421c800640 1 -- 172.21.15.3:0/2805073682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4214107ad0 msgr2=0x7f4214107eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.288+0000 7f421c800640 1 --2- 172.21.15.3:0/2805073682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4214107ad0 0x7f4214107eb0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4208009900 tx=0x7f420802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.288+0000 7f421c800640 1 -- 172.21.15.3:0/2805073682 shutdown_connections 2024-09-19T06:23:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.288+0000 7f421c800640 1 --2- 172.21.15.3:0/2805073682 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4214102460 0x7f421410e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.288+0000 7f421c800640 1 --2- 172.21.15.3:0/2805073682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4214101ac0 0x7f4214101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.288+0000 7f421c800640 1 --2- 172.21.15.3:0/2805073682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4214107ad0 0x7f4214107eb0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.288+0000 7f421c800640 1 -- 172.21.15.3:0/2805073682 >> 172.21.15.3:0/2805073682 conn(0x7f42140fd7e0 msgr2=0x7f42140ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.288+0000 7f421c800640 1 -- 172.21.15.3:0/2805073682 shutdown_connections 2024-09-19T06:23:11.291 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.289+0000 7f421c800640 1 -- 172.21.15.3:0/2805073682 wait complete. 2024-09-19T06:23:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.289+0000 7f421c800640 1 Processor -- start 2024-09-19T06:23:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.290+0000 7f421c800640 1 -- start start 2024-09-19T06:23:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.290+0000 7f421c800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4214101ac0 0x7f421419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.290+0000 7f421c800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4214102460 0x7f421419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.290+0000 7f421c800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4214107ad0 0x7f421419eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.290+0000 7f421c800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4214111f60 con 0x7f4214107ad0 2024-09-19T06:23:11.293 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.290+0000 7f421c800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f4214111de0 con 0x7f4214102460 2024-09-19T06:23:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.290+0000 7f421c800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f42141120e0 con 0x7f4214101ac0 2024-09-19T06:23:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.290+0000 7f421a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4214107ad0 0x7f421419eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.290+0000 7f421a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4214107ad0 0x7f421419eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49272/0 (socket says 172.21.15.3:49272) 2024-09-19T06:23:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.290+0000 7f421a800640 1 -- 172.21.15.3:0/2579459254 learned_addr learned my addr 172.21.15.3:0/2579459254 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.290+0000 7f4219400640 1 --2- 172.21.15.3:0/2579459254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4214102460 0x7f421419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.290+0000 7f4219e00640 1 --2- 172.21.15.3:0/2579459254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4214101ac0 0x7f421419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.291+0000 7f421a800640 1 -- 172.21.15.3:0/2579459254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4214101ac0 msgr2=0x7f421419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.291+0000 7f421a800640 1 --2- 172.21.15.3:0/2579459254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4214101ac0 0x7f421419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.291+0000 7f421a800640 1 -- 172.21.15.3:0/2579459254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4214102460 msgr2=0x7f421419ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.291+0000 7f421a800640 1 --2- 172.21.15.3:0/2579459254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4214102460 0x7f421419ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.291+0000 7f421a800640 1 -- 172.21.15.3:0/2579459254 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f421419f5f0 con 0x7f4214107ad0 2024-09-19T06:23:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.291+0000 7f421a800640 1 --2- 172.21.15.3:0/2579459254 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4214107ad0 0x7f421419eec0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f421000efd0 tx=0x7f421000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.291+0000 7f420ea00640 1 -- 172.21.15.3:0/2579459254 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4210003b70 con 0x7f4214107ad0 2024-09-19T06:23:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.291+0000 7f420ea00640 1 -- 172.21.15.3:0/2579459254 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4210003d10 con 0x7f4214107ad0 2024-09-19T06:23:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.291+0000 7f421c800640 1 -- 172.21.15.3:0/2579459254 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f421419f8e0 con 0x7f4214107ad0 2024-09-19T06:23:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.291+0000 7f420ea00640 1 -- 172.21.15.3:0/2579459254 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42100109f0 con 0x7f4214107ad0 2024-09-19T06:23:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.291+0000 7f421c800640 1 -- 172.21.15.3:0/2579459254 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42141a7170 con 0x7f4214107ad0 2024-09-19T06:23:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.294+0000 7f421f7d2740 1 Processor -- start 2024-09-19T06:23:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.294+0000 7f420ea00640 1 -- 172.21.15.3:0/2579459254 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f4210004020 con 0x7f4214107ad0 2024-09-19T06:23:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.295+0000 7f421f7d2740 1 -- start start 2024-09-19T06:23:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.295+0000 7f421f7d2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563f4a2f01e0 0x563f4a2f05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.295+0000 7f421f7d2740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2f0b00 0x563f4a2fae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.295+0000 7f421f7d2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f4a2fb3a0 0x563f4a2fd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.295+0000 7f421f7d2740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563f4a256100 con 0x563f4a2f0b00 2024-09-19T06:23:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.295+0000 7f421f7d2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563f4a1fe1b0 con 0x563f4a2fb3a0 2024-09-19T06:23:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.295+0000 7f421f7d2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563f4a2520c0 con 0x563f4a2f01e0 2024-09-19T06:23:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.295+0000 7f4219e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2f0b00 0x563f4a2fae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.295+0000 7f4219e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2f0b00 0x563f4a2fae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49280/0 (socket says 172.21.15.3:49280) 2024-09-19T06:23:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.295+0000 7f4219e00640 1 -- 172.21.15.3:0/2093508603 learned_addr learned my addr 172.21.15.3:0/2093508603 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.295+0000 7f4219400640 1 --2- 172.21.15.3:0/2093508603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563f4a2f01e0 0x563f4a2f05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.295+0000 7f4219400640 1 --2- 172.21.15.3:0/2093508603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f4a2fb3a0 0x563f4a2fd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.296+0000 7f4219e00640 1 -- 172.21.15.3:0/2093508603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563f4a2f01e0 msgr2=0x563f4a2f05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.296+0000 7f4219e00640 1 --2- 172.21.15.3:0/2093508603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563f4a2f01e0 0x563f4a2f05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.296+0000 7f4219e00640 1 -- 172.21.15.3:0/2093508603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f4a2fb3a0 msgr2=0x563f4a2fd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.296+0000 7f4219e00640 1 --2- 172.21.15.3:0/2093508603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f4a2fb3a0 0x563f4a2fd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.296+0000 7f4219e00640 1 -- 172.21.15.3:0/2093508603 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f49f69210 con 0x563f4a2f0b00 2024-09-19T06:23:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.296+0000 7f420ea00640 1 --2- 172.21.15.3:0/2579459254 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f41fc0a3430 0x7f41fc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.296+0000 7f420ea00640 1 -- 172.21.15.3:0/2579459254 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8615+0+0 (secure 0 0 0) 0x7f42100d00f0 con 0x7f4214107ad0 2024-09-19T06:23:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.296+0000 7f4219e00640 1 --2- 172.21.15.3:0/2093508603 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2f0b00 0x563f4a2fae60 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f4208009230 tx=0x7f4208004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2321b3d766c5a87b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.296+0000 7f4219400640 1 --2- 172.21.15.3:0/2579459254 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f41fc0a3430 0x7f41fc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.296+0000 7f4203000640 1 -- 172.21.15.3:0/2093508603 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4208035040 con 0x563f4a2f0b00 2024-09-19T06:23:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.296+0000 7f4203000640 1 -- 172.21.15.3:0/2093508603 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4208005520 con 0x563f4a2f0b00 2024-09-19T06:23:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.296+0000 7f4203000640 1 -- 172.21.15.3:0/2093508603 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42080035f0 con 0x563f4a2f0b00 2024-09-19T06:23:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.297+0000 7f421f7d2740 1 -- 172.21.15.3:0/2093508603 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2f0b00 msgr2=0x563f4a2fae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.297+0000 7f421f7d2740 1 --2- 172.21.15.3:0/2093508603 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2f0b00 0x563f4a2fae60 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f4208009230 tx=0x7f4208004040 comp rx=0 tx=0).stop 2024-09-19T06:23:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.297+0000 7f4219400640 1 --2- 172.21.15.3:0/2579459254 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f41fc0a3430 0x7f41fc0a58f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x563f4a2edad0 tx=0x7f42040046c0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.297+0000 7f421f7d2740 1 -- 172.21.15.3:0/2093508603 shutdown_connections 2024-09-19T06:23:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.297+0000 7f421f7d2740 1 --2- 172.21.15.3:0/2093508603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f4a2fb3a0 0x563f4a2fd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.297+0000 7f421f7d2740 1 --2- 172.21.15.3:0/2093508603 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2f0b00 0x563f4a2fae60 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.297+0000 7f421f7d2740 1 --2- 172.21.15.3:0/2093508603 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563f4a2f01e0 0x563f4a2f05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.297+0000 7f421f7d2740 1 -- 172.21.15.3:0/2093508603 >> 172.21.15.3:0/2093508603 conn(0x563f4a2ec750 msgr2=0x563f4a2ecb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.297+0000 7f421f7d2740 1 -- 172.21.15.3:0/2093508603 shutdown_connections 2024-09-19T06:23:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.297+0000 7f421f7d2740 1 -- 172.21.15.3:0/2093508603 wait complete. 2024-09-19T06:23:11.306 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.298+0000 7f421f7d2740 1 -- start start 2024-09-19T06:23:11.306 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.298+0000 7f421f7d2740 1 Processor -- start 2024-09-19T06:23:11.306 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.299+0000 7f421f7d2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563f4a2f01e0 0x563f4a2f8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:11.306 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.299+0000 7f421f7d2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f4a2f0b00 0x563f4a2f88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:11.306 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.299+0000 7f421f7d2740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2fb3a0 0x563f4a2f8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:11.306 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.299+0000 7f421f7d2740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x563f4a2fdf70 con 0x563f4a2fb3a0 2024-09-19T06:23:11.306 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.299+0000 7f421f7d2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x563f4a1df090 con 0x563f4a2f0b00 2024-09-19T06:23:11.306 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.299+0000 7f421f7d2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x563f4a2fe0f0 con 0x563f4a2f01e0 2024-09-19T06:23:11.306 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.299+0000 7f421f7d2740 10 client.0 _ll_register_callbacks cb 0x563f4a233f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.299+0000 7f421a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2fb3a0 0x563f4a2f8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.299+0000 7f421a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2fb3a0 0x563f4a2f8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49284/0 (socket says 172.21.15.3:49284) 2024-09-19T06:23:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.299+0000 7f421a800640 1 -- 172.21.15.3:0/2574084831 learned_addr learned my addr 172.21.15.3:0/2574084831 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.299+0000 7f4219e00640 1 --2- 172.21.15.3:0/2574084831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563f4a2f01e0 0x563f4a2f8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.299+0000 7f4219400640 1 --2- 172.21.15.3:0/2574084831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f4a2f0b00 0x563f4a2f88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.299+0000 7f421a800640 1 -- 172.21.15.3:0/2574084831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563f4a2f01e0 msgr2=0x563f4a2f8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.299+0000 7f421a800640 1 --2- 172.21.15.3:0/2574084831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563f4a2f01e0 0x563f4a2f8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.299+0000 7f421a800640 1 -- 172.21.15.3:0/2574084831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f4a2f0b00 msgr2=0x563f4a2f88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.299+0000 7f421a800640 1 --2- 172.21.15.3:0/2574084831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f4a2f0b00 0x563f4a2f88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.307 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.299+0000 7f421a800640 1 -- 172.21.15.3:0/2574084831 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f4a035620 con 0x563f4a2fb3a0 2024-09-19T06:23:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.300+0000 7f421a800640 1 --2- 172.21.15.3:0/2574084831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2fb3a0 0x563f4a2f8e10 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f4210098ce0 tx=0x7f421009bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f02224bae2b3fd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.300+0000 7f41f7400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:23:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.300+0000 7f41f7400640 1 -- 172.21.15.3:0/2574084831 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42100b5060 con 0x563f4a2fb3a0 2024-09-19T06:23:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.300+0000 7f41f7400640 1 -- 172.21.15.3:0/2574084831 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8615+0+0 (secure 0 0 0) 0x7f4210004310 con 0x563f4a2fb3a0 2024-09-19T06:23:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.300+0000 7f421f7d2740 1 -- 172.21.15.3:0/2574084831 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4208005520 con 0x563f4a2fb3a0 2024-09-19T06:23:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.300+0000 7f41f7400640 1 -- 172.21.15.3:0/2574084831 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f421009ca10 con 0x563f4a2fb3a0 2024-09-19T06:23:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.300+0000 7f421f7d2740 10 client.18435 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.300+0000 7f421f7d2740 1 -- 172.21.15.3:0/2574084831 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563f4a309c20 con 0x563f4a2fb3a0 2024-09-19T06:23:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.300+0000 7f41f7400640 1 -- 172.21.15.3:0/2574084831 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4208005520 con 0x563f4a2fb3a0 2024-09-19T06:23:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.301+0000 7f41f7400640 1 -- 172.21.15.3:0/2574084831 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f421001f020 con 0x563f4a2fb3a0 2024-09-19T06:23:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.301+0000 7f421f7d2740 10 client.18435 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.301+0000 7f421f7d2740 10 client.18435 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:11.308 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.301+0000 7f421f7d2740 20 client.18435 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.301+0000 7f421f7d2740 1 --2- 172.21.15.3:0/2574084831 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563f4a30b0e0 0x563f4a30d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.301+0000 7f421f7d2740 4 client.18435 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.301+0000 7f421f7d2740 1 -- 172.21.15.3:0/2574084831 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f4a263830 con 0x563f4a30b0e0 2024-09-19T06:23:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.301+0000 7f4219e00640 1 --2- 172.21.15.3:0/2574084831 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563f4a30b0e0 0x563f4a30d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.302+0000 7f4219e00640 1 --2- 172.21.15.3:0/2574084831 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563f4a30b0e0 0x563f4a30d4d0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=443bb1b5c5328b8d server_cookie=80d91758d5b558ca in_seq=0 out_seq=0 2024-09-19T06:23:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.302+0000 7f41f7400640 10 client.18435 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.303+0000 7f41f7400640 1 -- 172.21.15.3:0/2574084831 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563f4a263830 con 0x563f4a30b0e0 2024-09-19T06:23:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.303+0000 7f41f7400640 10 client.18435 handle_command_reply: tid=0 2024-09-19T06:23:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.303+0000 7f421f7d2740 1 client.18435 shutdown 2024-09-19T06:23:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.303+0000 7f421f7d2740 1 -- 172.21.15.3:0/2574084831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2fb3a0 msgr2=0x563f4a2f8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.303+0000 7f421f7d2740 1 --2- 172.21.15.3:0/2574084831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2fb3a0 0x563f4a2f8e10 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f4210098ce0 tx=0x7f421009bed0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.303+0000 7f421f7d2740 1 -- 172.21.15.3:0/2574084831 shutdown_connections 2024-09-19T06:23:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.303+0000 7f421f7d2740 1 --2- 172.21.15.3:0/2574084831 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563f4a30b0e0 0x563f4a30d4d0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.309 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.303+0000 7f421f7d2740 1 --2- 172.21.15.3:0/2574084831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2fb3a0 0x563f4a2f8e10 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.303+0000 7f421f7d2740 1 --2- 172.21.15.3:0/2574084831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f4a2f0b00 0x563f4a2f88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.303+0000 7f421f7d2740 1 --2- 172.21.15.3:0/2574084831 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563f4a2f01e0 0x563f4a2f8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.303+0000 7f421f7d2740 1 -- 172.21.15.3:0/2574084831 >> 172.21.15.3:0/2574084831 conn(0x563f4a2ec750 msgr2=0x563f4a2f2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.303+0000 7f41f7400640 0 client.18435 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.303+0000 7f421f7d2740 1 -- 172.21.15.3:0/2574084831 shutdown_connections 2024-09-19T06:23:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.303+0000 7f421f7d2740 1 -- 172.21.15.3:0/2574084831 wait complete. 2024-09-19T06:23:11.310 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.303+0000 7f421f7d2740 20 client.18435 trim_cache size 0 max 16384 2024-09-19T06:23:11.322 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.319+0000 7f421f7d2740 1 Processor -- start 2024-09-19T06:23:11.322 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.319+0000 7f421f7d2740 1 -- start start 2024-09-19T06:23:11.322 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.319+0000 7f421f7d2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563f4a2f01e0 0x563f4a312d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:11.322 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.319+0000 7f421f7d2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f4a2f0b00 0x563f4a3132d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:11.322 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.319+0000 7f421f7d2740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2fb3a0 0x563f4a2f1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:11.322 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.319+0000 7f421f7d2740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f42141afbf0 con 0x563f4a2fb3a0 2024-09-19T06:23:11.322 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.319+0000 7f421f7d2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f42141b1730 con 0x563f4a2f0b00 2024-09-19T06:23:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.319+0000 7f421f7d2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f42141b02c0 con 0x563f4a2f01e0 2024-09-19T06:23:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.319+0000 7f421a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2fb3a0 0x563f4a2f1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.319+0000 7f421a800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2fb3a0 0x563f4a2f1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49298/0 (socket says 172.21.15.3:49298) 2024-09-19T06:23:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.319+0000 7f421a800640 1 -- 172.21.15.3:0/3760292889 learned_addr learned my addr 172.21.15.3:0/3760292889 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.319+0000 7f4219400640 1 --2- 172.21.15.3:0/3760292889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f4a2f0b00 0x563f4a3132d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.319+0000 7f4219e00640 1 --2- 172.21.15.3:0/3760292889 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563f4a2f01e0 0x563f4a312d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.320+0000 7f421a800640 1 -- 172.21.15.3:0/3760292889 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563f4a2f01e0 msgr2=0x563f4a312d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.320+0000 7f421a800640 1 --2- 172.21.15.3:0/3760292889 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563f4a2f01e0 0x563f4a312d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.320+0000 7f421a800640 1 -- 172.21.15.3:0/3760292889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f4a2f0b00 msgr2=0x563f4a3132d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:11.323 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.320+0000 7f421a800640 1 --2- 172.21.15.3:0/3760292889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f4a2f0b00 0x563f4a3132d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.324 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.320+0000 7f421a800640 1 -- 172.21.15.3:0/3760292889 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f4a2f0010 con 0x563f4a2fb3a0 2024-09-19T06:23:11.324 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.320+0000 7f4219400640 1 --2- 172.21.15.3:0/3760292889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f4a2f0b00 0x563f4a3132d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:11.324 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.320+0000 7f421a800640 1 --2- 172.21.15.3:0/3760292889 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2fb3a0 0x563f4a2f1c40 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f42100a4a50 tx=0x7f421009bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609fbb332af8e119 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:11.324 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.320+0000 7f4202600640 1 -- 172.21.15.3:0/3760292889 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42100b5040 con 0x563f4a2fb3a0 2024-09-19T06:23:11.324 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.320+0000 7f4202600640 1 -- 172.21.15.3:0/3760292889 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42100a4f80 con 0x563f4a2fb3a0 2024-09-19T06:23:11.324 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.320+0000 7f4202600640 1 -- 172.21.15.3:0/3760292889 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4210004b40 con 0x563f4a2fb3a0 2024-09-19T06:23:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.321+0000 7f421f7d2740 1 -- 172.21.15.3:0/3760292889 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2fb3a0 msgr2=0x563f4a2f1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.321+0000 7f421f7d2740 1 --2- 172.21.15.3:0/3760292889 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2fb3a0 0x563f4a2f1c40 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f42100a4a50 tx=0x7f421009bf60 comp rx=0 tx=0).stop 2024-09-19T06:23:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.321+0000 7f421f7d2740 1 -- 172.21.15.3:0/3760292889 shutdown_connections 2024-09-19T06:23:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.321+0000 7f421f7d2740 1 --2- 172.21.15.3:0/3760292889 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2fb3a0 0x563f4a2f1c40 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.321+0000 7f421f7d2740 1 --2- 172.21.15.3:0/3760292889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f4a2f0b00 0x563f4a3132d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.321+0000 7f421f7d2740 1 --2- 172.21.15.3:0/3760292889 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563f4a2f01e0 0x563f4a312d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.321+0000 7f421f7d2740 1 -- 172.21.15.3:0/3760292889 >> 172.21.15.3:0/3760292889 conn(0x563f4a2ec750 msgr2=0x563f4a2f3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.321+0000 7f421f7d2740 1 -- 172.21.15.3:0/3760292889 shutdown_connections 2024-09-19T06:23:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.321+0000 7f421f7d2740 1 -- 172.21.15.3:0/3760292889 wait complete. 2024-09-19T06:23:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.321+0000 7f421f7d2740 1 -- start start 2024-09-19T06:23:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.322+0000 7f421f7d2740 1 Processor -- start 2024-09-19T06:23:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.322+0000 7f421f7d2740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2f01e0 0x563f4a2feab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.322+0000 7f421f7d2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f4a2f0b00 0x563f4a2feff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.322+0000 7f421f7d2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563f4a2fb3a0 0x563f4a36dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.322+0000 7f421f7d2740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f42141b1060 con 0x563f4a2f01e0 2024-09-19T06:23:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.322+0000 7f421f7d2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f42141b0990 con 0x563f4a2f0b00 2024-09-19T06:23:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.322+0000 7f421f7d2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f42141adbf0 con 0x563f4a2fb3a0 2024-09-19T06:23:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.322+0000 7f421f7d2740 10 client.0 _ll_register_callbacks cb 0x7f42100baf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.322+0000 7f4219e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2f01e0 0x563f4a2feab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.322+0000 7f4219e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2f01e0 0x563f4a2feab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49312/0 (socket says 172.21.15.3:49312) 2024-09-19T06:23:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.322+0000 7f4219e00640 1 -- 172.21.15.3:0/2285679416 learned_addr learned my addr 172.21.15.3:0/2285679416 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.322+0000 7f421a800640 1 --2- 172.21.15.3:0/2285679416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563f4a2fb3a0 0x563f4a36dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.322+0000 7f4219400640 1 --2- 172.21.15.3:0/2285679416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f4a2f0b00 0x563f4a2feff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.323+0000 7f4219e00640 1 -- 172.21.15.3:0/2285679416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563f4a2fb3a0 msgr2=0x563f4a36dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.323+0000 7f4219e00640 1 --2- 172.21.15.3:0/2285679416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563f4a2fb3a0 0x563f4a36dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.323+0000 7f4219e00640 1 -- 172.21.15.3:0/2285679416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f4a2f0b00 msgr2=0x563f4a2feff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.323+0000 7f4219e00640 1 --2- 172.21.15.3:0/2285679416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f4a2f0b00 0x563f4a2feff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.323+0000 7f4219e00640 1 -- 172.21.15.3:0/2285679416 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f4a2e7d60 con 0x563f4a2f01e0 2024-09-19T06:23:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.323+0000 7f4219e00640 1 --2- 172.21.15.3:0/2285679416 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2f01e0 0x563f4a2feab0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f420802a9e0 tx=0x7f4208004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c680a3c234fef82e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.323+0000 7f41f7400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:23:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.323+0000 7f41f7400640 1 -- 172.21.15.3:0/2285679416 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4208035040 con 0x563f4a2f01e0 2024-09-19T06:23:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.323+0000 7f41f7400640 1 -- 172.21.15.3:0/2285679416 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8615+0+0 (secure 0 0 0) 0x7f42080048c0 con 0x563f4a2f01e0 2024-09-19T06:23:11.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.323+0000 7f421f7d2740 1 -- 172.21.15.3:0/2285679416 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42100a4f80 con 0x563f4a2f01e0 2024-09-19T06:23:11.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.323+0000 7f41f7400640 1 -- 172.21.15.3:0/2285679416 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f42080035f0 con 0x563f4a2f01e0 2024-09-19T06:23:11.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.323+0000 7f421f7d2740 10 client.18441 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:11.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.323+0000 7f421f7d2740 1 -- 172.21.15.3:0/2285679416 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563f4a3755b0 con 0x563f4a2f01e0 2024-09-19T06:23:11.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.324+0000 7f41f7400640 1 -- 172.21.15.3:0/2285679416 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42100a4f80 con 0x563f4a2f01e0 2024-09-19T06:23:11.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.324+0000 7f41f7400640 1 -- 172.21.15.3:0/2285679416 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4208005050 con 0x563f4a2f01e0 2024-09-19T06:23:11.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.324+0000 7f421f7d2740 10 client.18441 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:11.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.324+0000 7f421f7d2740 10 client.18441 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:11.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.324+0000 7f421f7d2740 20 client.18441 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:11.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.324+0000 7f421f7d2740 1 --2- 172.21.15.3:0/2285679416 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563f4a3758a0 0x563f4a377c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:11.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.324+0000 7f421f7d2740 4 client.18441 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:23:11.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.324+0000 7f421f7d2740 1 -- 172.21.15.3:0/2285679416 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563f4a25db80 con 0x563f4a3758a0 2024-09-19T06:23:11.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.324+0000 7f4219400640 1 --2- 172.21.15.3:0/2285679416 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563f4a3758a0 0x563f4a377c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:11.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.325+0000 7f4219400640 1 --2- 172.21.15.3:0/2285679416 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563f4a3758a0 0x563f4a377c90 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f72a741a2bb2eee server_cookie=67d652dc305c3a59 in_seq=0 out_seq=0 2024-09-19T06:23:11.330 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.325+0000 7f41f7400640 10 client.18441 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:11.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.339+0000 7f41f7400640 1 -- 172.21.15.3:0/2285679416 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563f4a25db80 con 0x563f4a3758a0 2024-09-19T06:23:11.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.339+0000 7f41f7400640 10 client.18441 handle_command_reply: tid=0 2024-09-19T06:23:11.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.339+0000 7f421f7d2740 1 client.18441 shutdown 2024-09-19T06:23:11.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.339+0000 7f421f7d2740 1 -- 172.21.15.3:0/2285679416 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2f01e0 msgr2=0x563f4a2feab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:11.342 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.339+0000 7f421f7d2740 1 --2- 172.21.15.3:0/2285679416 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2f01e0 0x563f4a2feab0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f420802a9e0 tx=0x7f4208004b40 comp rx=0 tx=0).stop 2024-09-19T06:23:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.339+0000 7f421f7d2740 1 -- 172.21.15.3:0/2285679416 shutdown_connections 2024-09-19T06:23:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.339+0000 7f421f7d2740 1 --2- 172.21.15.3:0/2285679416 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x563f4a3758a0 0x563f4a377c90 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.339+0000 7f421f7d2740 1 --2- 172.21.15.3:0/2285679416 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x563f4a2fb3a0 0x563f4a36dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.339+0000 7f421f7d2740 1 --2- 172.21.15.3:0/2285679416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563f4a2f0b00 0x563f4a2feff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.339+0000 7f41f7400640 0 client.18441 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.340+0000 7f421f7d2740 1 --2- 172.21.15.3:0/2285679416 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x563f4a2f01e0 0x563f4a2feab0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.340+0000 7f421f7d2740 1 -- 172.21.15.3:0/2285679416 >> 172.21.15.3:0/2285679416 conn(0x563f4a2ec750 msgr2=0x563f4a2f1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.340+0000 7f421f7d2740 1 -- 172.21.15.3:0/2285679416 shutdown_connections 2024-09-19T06:23:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.340+0000 7f421f7d2740 1 -- 172.21.15.3:0/2285679416 wait complete. 2024-09-19T06:23:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.340+0000 7f421f7d2740 20 client.18441 trim_cache size 0 max 16384 2024-09-19T06:23:11.344 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:23:11.344 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:23:11.344 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:23:11.344 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:23:11.345 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.341+0000 7f421c800640 1 -- 172.21.15.3:0/2579459254 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f41fc0a3430 msgr2=0x7f41fc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:11.345 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.341+0000 7f421c800640 1 --2- 172.21.15.3:0/2579459254 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f41fc0a3430 0x7f41fc0a58f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x563f4a2edad0 tx=0x7f42040046c0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.345 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.341+0000 7f421c800640 1 -- 172.21.15.3:0/2579459254 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4214107ad0 msgr2=0x7f421419eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:11.345 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.341+0000 7f421c800640 1 --2- 172.21.15.3:0/2579459254 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4214107ad0 0x7f421419eec0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f421000efd0 tx=0x7f421000c6a0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.345 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.341+0000 7f421c800640 1 -- 172.21.15.3:0/2579459254 shutdown_connections 2024-09-19T06:23:11.345 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.341+0000 7f421c800640 1 --2- 172.21.15.3:0/2579459254 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f41fc0a3430 0x7f41fc0a58f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.345 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.341+0000 7f421c800640 1 --2- 172.21.15.3:0/2579459254 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4214107ad0 0x7f421419eec0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.345 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.341+0000 7f421c800640 1 --2- 172.21.15.3:0/2579459254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4214102460 0x7f421419ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.345 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.341+0000 7f421c800640 1 --2- 172.21.15.3:0/2579459254 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f4214101ac0 0x7f421419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:11.346 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.341+0000 7f421c800640 1 -- 172.21.15.3:0/2579459254 >> 172.21.15.3:0/2579459254 conn(0x7f42140fd7e0 msgr2=0x7f42140fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:11.346 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.341+0000 7f421c800640 1 -- 172.21.15.3:0/2579459254 shutdown_connections 2024-09-19T06:23:11.346 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:11.341+0000 7f421c800640 1 -- 172.21.15.3:0/2579459254 wait complete. 2024-09-19T06:23:11.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:11 smithi059 ceph-mon[35138]: pgmap v336: 97 pgs: 97 active+clean; 5.5 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 100 KiB/s wr, 38 op/s 2024-09-19T06:23:11.834 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:11 smithi003 ceph-mon[30893]: pgmap v336: 97 pgs: 97 active+clean; 5.5 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 100 KiB/s wr, 38 op/s 2024-09-19T06:23:11.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:11 smithi071 ceph-mon[35662]: pgmap v336: 97 pgs: 97 active+clean; 5.5 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 100 KiB/s wr, 38 op/s 2024-09-19T06:23:12.082 INFO:tasks.workunit.client.0.smithi003.stdout:499/600: open fd = 3 2024-09-19T06:23:12.082 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.082 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.083 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.083 INFO:tasks.workunit.client.0.smithi003.stdout:500/600: open fd = 3 2024-09-19T06:23:12.083 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.083 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.083 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.083 INFO:tasks.workunit.client.0.smithi003.stdout:501/600: open fd = 3 2024-09-19T06:23:12.083 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.083 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.083 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.083 INFO:tasks.workunit.client.0.smithi003.stdout:502/600: open fd = 3 2024-09-19T06:23:12.083 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.083 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.083 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.083 INFO:tasks.workunit.client.0.smithi003.stdout:503/600: open fd = 3 2024-09-19T06:23:12.084 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.084 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.084 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.084 INFO:tasks.workunit.client.0.smithi003.stdout:504/600: open fd = 3 2024-09-19T06:23:12.084 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.084 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.084 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.084 INFO:tasks.workunit.client.0.smithi003.stdout:505/600: open fd = 3 2024-09-19T06:23:12.084 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.084 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.084 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.084 INFO:tasks.workunit.client.0.smithi003.stdout:506/600: open fd = 3 2024-09-19T06:23:12.084 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.084 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.084 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.085 INFO:tasks.workunit.client.0.smithi003.stdout:507/600: open fd = 3 2024-09-19T06:23:12.085 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.085 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.085 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.085 INFO:tasks.workunit.client.0.smithi003.stdout:508/600: open fd = 3 2024-09-19T06:23:12.085 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.085 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.085 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.085 INFO:tasks.workunit.client.0.smithi003.stdout:509/600: open fd = 3 2024-09-19T06:23:12.085 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.085 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.085 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.085 INFO:tasks.workunit.client.0.smithi003.stdout:510/600: open fd = 3 2024-09-19T06:23:12.085 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.085 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.086 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.086 INFO:tasks.workunit.client.0.smithi003.stdout:511/600: open fd = 3 2024-09-19T06:23:12.086 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.086 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.086 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.086 INFO:tasks.workunit.client.0.smithi003.stdout:512/600: open fd = 3 2024-09-19T06:23:12.086 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.086 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.086 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.086 INFO:tasks.workunit.client.0.smithi003.stdout:513/600: open fd = 3 2024-09-19T06:23:12.086 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.086 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.086 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.086 INFO:tasks.workunit.client.0.smithi003.stdout:514/600: open fd = 3 2024-09-19T06:23:12.086 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.087 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.087 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.087 INFO:tasks.workunit.client.0.smithi003.stdout:515/600: open fd = 3 2024-09-19T06:23:12.087 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.087 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.087 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.087 INFO:tasks.workunit.client.0.smithi003.stdout:516/600: open fd = 3 2024-09-19T06:23:12.087 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.087 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.087 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.087 INFO:tasks.workunit.client.0.smithi003.stdout:517/600: open fd = 3 2024-09-19T06:23:12.087 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.087 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.088 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.088 INFO:tasks.workunit.client.0.smithi003.stdout:518/600: open fd = 3 2024-09-19T06:23:12.088 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.088 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.088 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.088 INFO:tasks.workunit.client.0.smithi003.stdout:519/600: open fd = 3 2024-09-19T06:23:12.088 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.088 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.088 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.088 INFO:tasks.workunit.client.0.smithi003.stdout:520/600: open fd = 3 2024-09-19T06:23:12.088 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.088 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.088 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.088 INFO:tasks.workunit.client.0.smithi003.stdout:521/600: open fd = 3 2024-09-19T06:23:12.088 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.089 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.089 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.089 INFO:tasks.workunit.client.0.smithi003.stdout:522/600: open fd = 3 2024-09-19T06:23:12.089 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.089 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.089 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.089 INFO:tasks.workunit.client.0.smithi003.stdout:523/600: open fd = 3 2024-09-19T06:23:12.089 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.089 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.089 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.089 INFO:tasks.workunit.client.0.smithi003.stdout:524/600: open fd = 3 2024-09-19T06:23:12.089 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.089 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.089 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.090 INFO:tasks.workunit.client.0.smithi003.stdout:525/600: open fd = 3 2024-09-19T06:23:12.090 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.090 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.090 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.090 INFO:tasks.workunit.client.0.smithi003.stdout:526/600: open fd = 3 2024-09-19T06:23:12.090 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.090 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.090 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.090 INFO:tasks.workunit.client.0.smithi003.stdout:527/600: open fd = 3 2024-09-19T06:23:12.090 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.090 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.090 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.090 INFO:tasks.workunit.client.0.smithi003.stdout:528/600: open fd = 3 2024-09-19T06:23:12.090 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.091 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.091 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.091 INFO:tasks.workunit.client.0.smithi003.stdout:529/600: open fd = 3 2024-09-19T06:23:12.091 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.091 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.091 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.091 INFO:tasks.workunit.client.0.smithi003.stdout:530/600: open fd = 3 2024-09-19T06:23:12.091 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.091 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.091 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.091 INFO:tasks.workunit.client.0.smithi003.stdout:531/600: open fd = 3 2024-09-19T06:23:12.091 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.091 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.092 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.092 INFO:tasks.workunit.client.0.smithi003.stdout:532/600: open fd = 3 2024-09-19T06:23:12.092 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.092 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.092 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.092 INFO:tasks.workunit.client.0.smithi003.stdout:533/600: open fd = 3 2024-09-19T06:23:12.092 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.092 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.092 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.092 INFO:tasks.workunit.client.0.smithi003.stdout:534/600: open fd = 3 2024-09-19T06:23:12.092 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.092 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.092 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.092 INFO:tasks.workunit.client.0.smithi003.stdout:535/600: open fd = 3 2024-09-19T06:23:12.092 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.092 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.093 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.093 INFO:tasks.workunit.client.0.smithi003.stdout:536/600: open fd = 3 2024-09-19T06:23:12.093 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.093 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.093 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.093 INFO:tasks.workunit.client.0.smithi003.stdout:537/600: open fd = 3 2024-09-19T06:23:12.093 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.093 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.093 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.093 INFO:tasks.workunit.client.0.smithi003.stdout:538/600: open fd = 3 2024-09-19T06:23:12.093 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.093 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.093 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.093 INFO:tasks.workunit.client.0.smithi003.stdout:539/600: open fd = 3 2024-09-19T06:23:12.094 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.094 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.094 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.094 INFO:tasks.workunit.client.0.smithi003.stdout:540/600: open fd = 3 2024-09-19T06:23:12.094 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.094 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.094 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.094 INFO:tasks.workunit.client.0.smithi003.stdout:541/600: open fd = 3 2024-09-19T06:23:12.094 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.094 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.094 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.094 INFO:tasks.workunit.client.0.smithi003.stdout:542/600: open fd = 3 2024-09-19T06:23:12.094 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.094 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.094 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.095 INFO:tasks.workunit.client.0.smithi003.stdout:543/600: open fd = 3 2024-09-19T06:23:12.095 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.095 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.095 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.095 INFO:tasks.workunit.client.0.smithi003.stdout:544/600: open fd = 3 2024-09-19T06:23:12.095 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.095 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.095 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.095 INFO:tasks.workunit.client.0.smithi003.stdout:545/600: open fd = 3 2024-09-19T06:23:12.095 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.095 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.095 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.095 INFO:tasks.workunit.client.0.smithi003.stdout:546/600: open fd = 3 2024-09-19T06:23:12.095 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.095 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.096 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.096 INFO:tasks.workunit.client.0.smithi003.stdout:547/600: open fd = 3 2024-09-19T06:23:12.096 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.096 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.096 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.096 INFO:tasks.workunit.client.0.smithi003.stdout:548/600: open fd = 3 2024-09-19T06:23:12.096 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.096 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.096 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.096 INFO:tasks.workunit.client.0.smithi003.stdout:549/600: open fd = 3 2024-09-19T06:23:12.096 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.096 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.096 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.096 INFO:tasks.workunit.client.0.smithi003.stdout:550/600: open fd = 3 2024-09-19T06:23:12.097 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.097 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.097 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.097 INFO:tasks.workunit.client.0.smithi003.stdout:551/600: open fd = 3 2024-09-19T06:23:12.097 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.097 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.097 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.097 INFO:tasks.workunit.client.0.smithi003.stdout:552/600: open fd = 3 2024-09-19T06:23:12.097 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.097 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.097 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.097 INFO:tasks.workunit.client.0.smithi003.stdout:553/600: open fd = 3 2024-09-19T06:23:12.097 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.097 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.097 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.098 INFO:tasks.workunit.client.0.smithi003.stdout:554/600: open fd = 3 2024-09-19T06:23:12.098 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.098 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.098 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.098 INFO:tasks.workunit.client.0.smithi003.stdout:555/600: open fd = 3 2024-09-19T06:23:12.098 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.098 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.098 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.098 INFO:tasks.workunit.client.0.smithi003.stdout:556/600: open fd = 3 2024-09-19T06:23:12.098 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.098 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.098 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.098 INFO:tasks.workunit.client.0.smithi003.stdout:557/600: open fd = 3 2024-09-19T06:23:12.098 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.098 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.099 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.099 INFO:tasks.workunit.client.0.smithi003.stdout:558/600: open fd = 3 2024-09-19T06:23:12.099 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.099 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.099 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.099 INFO:tasks.workunit.client.0.smithi003.stdout:559/600: open fd = 3 2024-09-19T06:23:12.099 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.099 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.099 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:12.099 INFO:tasks.workunit.client.0.smithi003.stdout:560/600: open fd = 3 2024-09-19T06:23:12.099 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.099 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:12.099 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:13.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:12 smithi059 ceph-mon[35138]: osdmap e99: 12 total, 12 up, 12 in 2024-09-19T06:23:13.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:12 smithi003 ceph-mon[30893]: osdmap e99: 12 total, 12 up, 12 in 2024-09-19T06:23:13.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:12 smithi071 ceph-mon[35662]: osdmap e99: 12 total, 12 up, 12 in 2024-09-19T06:23:14.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:13 smithi059 ceph-mon[35138]: pgmap v338: 97 pgs: 97 active+clean; 5.5 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-09-19T06:23:14.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:13 smithi003 ceph-mon[30893]: pgmap v338: 97 pgs: 97 active+clean; 5.5 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-09-19T06:23:14.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:13 smithi071 ceph-mon[35662]: pgmap v338: 97 pgs: 97 active+clean; 5.5 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-09-19T06:23:16.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:15 smithi059 ceph-mon[35138]: pgmap v339: 97 pgs: 97 active+clean; 1.8 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 58 KiB/s wr, 21 op/s 2024-09-19T06:23:16.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:15 smithi003 ceph-mon[30893]: pgmap v339: 97 pgs: 97 active+clean; 1.8 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 58 KiB/s wr, 21 op/s 2024-09-19T06:23:16.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:15 smithi071 ceph-mon[35662]: pgmap v339: 97 pgs: 97 active+clean; 1.8 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 58 KiB/s wr, 21 op/s 2024-09-19T06:23:18.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:17 smithi059 ceph-mon[35138]: pgmap v340: 97 pgs: 97 active+clean; 1.8 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 54 KiB/s wr, 20 op/s 2024-09-19T06:23:18.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:17 smithi003 ceph-mon[30893]: pgmap v340: 97 pgs: 97 active+clean; 1.8 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 54 KiB/s wr, 20 op/s 2024-09-19T06:23:18.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:17 smithi071 ceph-mon[35662]: pgmap v340: 97 pgs: 97 active+clean; 1.8 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 54 KiB/s wr, 20 op/s 2024-09-19T06:23:20.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:19 smithi059 ceph-mon[35138]: pgmap v341: 97 pgs: 97 active+clean; 2.0 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 50 KiB/s wr, 19 op/s 2024-09-19T06:23:20.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:19 smithi003 ceph-mon[30893]: pgmap v341: 97 pgs: 97 active+clean; 2.0 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 50 KiB/s wr, 19 op/s 2024-09-19T06:23:20.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:19 smithi071 ceph-mon[35662]: pgmap v341: 97 pgs: 97 active+clean; 2.0 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 50 KiB/s wr, 19 op/s 2024-09-19T06:23:22.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:21 smithi059 ceph-mon[35138]: pgmap v342: 97 pgs: 97 active+clean; 2.0 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 50 KiB/s wr, 19 op/s 2024-09-19T06:23:22.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:21 smithi003 ceph-mon[30893]: pgmap v342: 97 pgs: 97 active+clean; 2.0 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 50 KiB/s wr, 19 op/s 2024-09-19T06:23:22.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:21 smithi071 ceph-mon[35662]: pgmap v342: 97 pgs: 97 active+clean; 2.0 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 50 KiB/s wr, 19 op/s 2024-09-19T06:23:24.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:23 smithi059 ceph-mon[35138]: pgmap v343: 97 pgs: 97 active+clean; 2.0 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 17 op/s 2024-09-19T06:23:24.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:23 smithi003 ceph-mon[30893]: pgmap v343: 97 pgs: 97 active+clean; 2.0 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 17 op/s 2024-09-19T06:23:24.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:23 smithi071 ceph-mon[35662]: pgmap v343: 97 pgs: 97 active+clean; 2.0 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 17 op/s 2024-09-19T06:23:24.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.469+0000 7fdf7e000640 1 -- 172.21.15.3:0/2268938931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf78076720 msgr2=0x7fdf78076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:24.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.469+0000 7fdf7e000640 1 --2- 172.21.15.3:0/2268938931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf78076720 0x7fdf78076b00 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fdf68009900 tx=0x7fdf6802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.471+0000 7fdf7e000640 1 -- 172.21.15.3:0/2268938931 shutdown_connections 2024-09-19T06:23:24.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.471+0000 7fdf7e000640 1 --2- 172.21.15.3:0/2268938931 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf78112970 0x7fdf78114d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.471+0000 7fdf7e000640 1 --2- 172.21.15.3:0/2268938931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf78077040 0x7fdf78112430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.471+0000 7fdf7e000640 1 --2- 172.21.15.3:0/2268938931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf78076720 0x7fdf78076b00 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.472 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.471+0000 7fdf7e000640 1 -- 172.21.15.3:0/2268938931 >> 172.21.15.3:0/2268938931 conn(0x7fdf780ff970 msgr2=0x7fdf78101d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:24.473 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.471+0000 7fdf7e000640 1 -- 172.21.15.3:0/2268938931 shutdown_connections 2024-09-19T06:23:24.473 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.471+0000 7fdf7e000640 1 -- 172.21.15.3:0/2268938931 wait complete. 2024-09-19T06:23:24.474 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.471+0000 7fdf7e000640 1 Processor -- start 2024-09-19T06:23:24.475 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.471+0000 7fdf7e000640 1 -- start start 2024-09-19T06:23:24.475 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.471+0000 7fdf7e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf78076720 0x7fdf781a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.475 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.471+0000 7fdf7e000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf78077040 0x7fdf781a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.475 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.471+0000 7fdf7e000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf78112970 0x7fdf7819e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.475 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.472+0000 7fdf7e000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdf78118520 con 0x7fdf78077040 2024-09-19T06:23:24.475 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.472+0000 7fdf7e000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdf781183a0 con 0x7fdf78076720 2024-09-19T06:23:24.475 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.472+0000 7fdf7e000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdf781186a0 con 0x7fdf78112970 2024-09-19T06:23:24.475 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.472+0000 7fdf6fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf78077040 0x7fdf781a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.475 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.472+0000 7fdf77400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf78076720 0x7fdf781a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.475 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.472+0000 7fdf77400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf78076720 0x7fdf781a4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:53808/0 (socket says 172.21.15.3:53808) 2024-09-19T06:23:24.476 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.472+0000 7fdf77400640 1 -- 172.21.15.3:0/3098939260 learned_addr learned my addr 172.21.15.3:0/3098939260 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:24.476 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.472+0000 7fdf6fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf78077040 0x7fdf781a4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43100/0 (socket says 172.21.15.3:43100) 2024-09-19T06:23:24.476 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.472+0000 7fdf77e00640 1 --2- 172.21.15.3:0/3098939260 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf78112970 0x7fdf7819e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.476 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.472+0000 7fdf77400640 1 -- 172.21.15.3:0/3098939260 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf78112970 msgr2=0x7fdf7819e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:24.476 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.472+0000 7fdf77400640 1 --2- 172.21.15.3:0/3098939260 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf78112970 0x7fdf7819e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.476 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.472+0000 7fdf77400640 1 -- 172.21.15.3:0/3098939260 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf78077040 msgr2=0x7fdf781a4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:24.476 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.472+0000 7fdf77400640 1 --2- 172.21.15.3:0/3098939260 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf78077040 0x7fdf781a4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.476 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.472+0000 7fdf77400640 1 -- 172.21.15.3:0/3098939260 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf7819efc0 con 0x7fdf78076720 2024-09-19T06:23:24.476 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.472+0000 7fdf77e00640 1 --2- 172.21.15.3:0/3098939260 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf78112970 0x7fdf7819e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:24.476 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.472+0000 7fdf6fe00640 1 --2- 172.21.15.3:0/3098939260 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf78077040 0x7fdf781a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:24.476 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.472+0000 7fdf77400640 1 --2- 172.21.15.3:0/3098939260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf78076720 0x7fdf781a4680 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdf68004770 tx=0x7fdf68003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:24.476 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.473+0000 7fdf74c00640 1 -- 172.21.15.3:0/3098939260 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6803f070 con 0x7fdf78076720 2024-09-19T06:23:24.476 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.473+0000 7fdf7e000640 1 -- 172.21.15.3:0/3098939260 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf7819f250 con 0x7fdf78076720 2024-09-19T06:23:24.477 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.473+0000 7fdf74c00640 1 -- 172.21.15.3:0/3098939260 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf68031ca0 con 0x7fdf78076720 2024-09-19T06:23:24.477 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.473+0000 7fdf74c00640 1 -- 172.21.15.3:0/3098939260 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf68035030 con 0x7fdf78076720 2024-09-19T06:23:24.477 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.473+0000 7fdf7e000640 1 -- 172.21.15.3:0/3098939260 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf781ab4d0 con 0x7fdf78076720 2024-09-19T06:23:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.476+0000 7fdf8107d740 1 Processor -- start 2024-09-19T06:23:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.476+0000 7fdf8107d740 1 -- start start 2024-09-19T06:23:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.476+0000 7fdf74c00640 1 -- 172.21.15.3:0/3098939260 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fdf68042070 con 0x7fdf78076720 2024-09-19T06:23:24.482 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.477+0000 7fdf8107d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648e056c1e0 0x5648e056c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.482 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.477+0000 7fdf8107d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648e056cb00 0x5648e0576e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.482 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.477+0000 7fdf8107d740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e05773a0 0x5648e0579790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.482 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.477+0000 7fdf8107d740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5648e04d2100 con 0x5648e05773a0 2024-09-19T06:23:24.482 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.477+0000 7fdf8107d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5648e047a1b0 con 0x5648e056cb00 2024-09-19T06:23:24.482 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.477+0000 7fdf8107d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5648e04ce0c0 con 0x5648e056c1e0 2024-09-19T06:23:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.477+0000 7fdf6fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e05773a0 0x5648e0579790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.477+0000 7fdf77400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648e056cb00 0x5648e0576e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.477+0000 7fdf6fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e05773a0 0x5648e0579790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43108/0 (socket says 172.21.15.3:43108) 2024-09-19T06:23:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.477+0000 7fdf6fe00640 1 -- 172.21.15.3:0/2287536346 learned_addr learned my addr 172.21.15.3:0/2287536346 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.477+0000 7fdf77e00640 1 --2- 172.21.15.3:0/2287536346 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648e056c1e0 0x5648e056c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.477+0000 7fdf6fe00640 1 -- 172.21.15.3:0/2287536346 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648e056c1e0 msgr2=0x5648e056c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.477+0000 7fdf6fe00640 1 --2- 172.21.15.3:0/2287536346 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648e056c1e0 0x5648e056c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.477+0000 7fdf6fe00640 1 -- 172.21.15.3:0/2287536346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648e056cb00 msgr2=0x5648e0576e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.477+0000 7fdf6fe00640 1 --2- 172.21.15.3:0/2287536346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648e056cb00 0x5648e0576e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.477+0000 7fdf6fe00640 1 -- 172.21.15.3:0/2287536346 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648e01e5210 con 0x5648e05773a0 2024-09-19T06:23:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.477+0000 7fdf77400640 1 --2- 172.21.15.3:0/2287536346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648e056cb00 0x5648e0576e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.477+0000 7fdf77e00640 1 --2- 172.21.15.3:0/2287536346 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648e056c1e0 0x5648e056c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.478+0000 7fdf6fe00640 1 --2- 172.21.15.3:0/2287536346 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e05773a0 0x5648e0579790 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fdf600114f0 tx=0x7fdf600119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab9d76f92f92174 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:24.484 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.478+0000 7fdf67e00640 1 -- 172.21.15.3:0/2287536346 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf60005020 con 0x5648e05773a0 2024-09-19T06:23:24.484 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.478+0000 7fdf74c00640 1 --2- 172.21.15.3:0/3098939260 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fdf5c0a33b0 0x7fdf5c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.484 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.478+0000 7fdf67e00640 1 -- 172.21.15.3:0/2287536346 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf600047a0 con 0x5648e05773a0 2024-09-19T06:23:24.484 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.478+0000 7fdf67e00640 1 -- 172.21.15.3:0/2287536346 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6000f980 con 0x5648e05773a0 2024-09-19T06:23:24.484 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.478+0000 7fdf74c00640 1 -- 172.21.15.3:0/3098939260 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7fdf680f0440 con 0x7fdf78076720 2024-09-19T06:23:24.484 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.478+0000 7fdf77e00640 1 --2- 172.21.15.3:0/3098939260 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fdf5c0a33b0 0x7fdf5c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.484 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.479+0000 7fdf8107d740 1 -- 172.21.15.3:0/2287536346 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e05773a0 msgr2=0x5648e0579790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:24.484 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.479+0000 7fdf8107d740 1 --2- 172.21.15.3:0/2287536346 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e05773a0 0x5648e0579790 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fdf600114f0 tx=0x7fdf600119b0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.484 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.479+0000 7fdf8107d740 1 -- 172.21.15.3:0/2287536346 shutdown_connections 2024-09-19T06:23:24.484 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.479+0000 7fdf8107d740 1 --2- 172.21.15.3:0/2287536346 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e05773a0 0x5648e0579790 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.484 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.479+0000 7fdf8107d740 1 --2- 172.21.15.3:0/2287536346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648e056cb00 0x5648e0576e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.484 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.479+0000 7fdf8107d740 1 --2- 172.21.15.3:0/2287536346 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648e056c1e0 0x5648e056c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.484 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.479+0000 7fdf8107d740 1 -- 172.21.15.3:0/2287536346 >> 172.21.15.3:0/2287536346 conn(0x5648e0568750 msgr2=0x5648e0568b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:24.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.479+0000 7fdf8107d740 1 -- 172.21.15.3:0/2287536346 shutdown_connections 2024-09-19T06:23:24.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.479+0000 7fdf77e00640 1 --2- 172.21.15.3:0/3098939260 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fdf5c0a33b0 0x7fdf5c0a5870 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdf7806b200 tx=0x7fdf70009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:24.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.479+0000 7fdf8107d740 1 -- 172.21.15.3:0/2287536346 wait complete. 2024-09-19T06:23:24.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.480+0000 7fdf8107d740 1 -- start start 2024-09-19T06:23:24.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.480+0000 7fdf8107d740 1 Processor -- start 2024-09-19T06:23:24.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.480+0000 7fdf8107d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648e056c1e0 0x5648e05742f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.480+0000 7fdf8107d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648e056cb00 0x5648e0574830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.480+0000 7fdf8107d740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e05773a0 0x5648e0574d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.480+0000 7fdf8107d740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5648e0579f70 con 0x5648e05773a0 2024-09-19T06:23:24.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.480+0000 7fdf8107d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5648e045b090 con 0x5648e056cb00 2024-09-19T06:23:24.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.480+0000 7fdf8107d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5648e057a0f0 con 0x5648e056c1e0 2024-09-19T06:23:24.485 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.480+0000 7fdf8107d740 10 client.0 _ll_register_callbacks cb 0x5648e04aff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:24.486 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.480+0000 7fdf77e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e05773a0 0x5648e0574d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.486 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.480+0000 7fdf6fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648e056cb00 0x5648e0574830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.486 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.480+0000 7fdf77400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648e056c1e0 0x5648e05742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.486 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.481+0000 7fdf6fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648e056cb00 0x5648e0574830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:53826/0 (socket says 172.21.15.3:53826) 2024-09-19T06:23:24.486 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.481+0000 7fdf6fe00640 1 -- 172.21.15.3:0/3321812572 learned_addr learned my addr 172.21.15.3:0/3321812572 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:24.486 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.481+0000 7fdf77400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648e056c1e0 0x5648e05742f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:58896/0 (socket says 172.21.15.3:58896) 2024-09-19T06:23:24.489 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.481+0000 7fdf6fe00640 1 -- 172.21.15.3:0/3321812572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648e056c1e0 msgr2=0x5648e05742f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:24.489 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.481+0000 7fdf6fe00640 1 --2- 172.21.15.3:0/3321812572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648e056c1e0 0x5648e05742f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.489 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.481+0000 7fdf6fe00640 1 -- 172.21.15.3:0/3321812572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e05773a0 msgr2=0x5648e0574d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:24.489 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.481+0000 7fdf6fe00640 1 --2- 172.21.15.3:0/3321812572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e05773a0 0x5648e0574d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.489 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.481+0000 7fdf6fe00640 1 -- 172.21.15.3:0/3321812572 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648e02b1620 con 0x5648e056cb00 2024-09-19T06:23:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.481+0000 7fdf77400640 1 --2- 172.21.15.3:0/3321812572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648e056c1e0 0x5648e05742f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.481+0000 7fdf6fe00640 1 --2- 172.21.15.3:0/3321812572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648e056cb00 0x5648e0574830 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdf600052b0 tx=0x7fdf600052e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=530b4fe7cb2a2cd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.481+0000 7fdf64c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:23:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.482+0000 7fdf64c00640 1 -- 172.21.15.3:0/3321812572 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf60004030 con 0x5648e056cb00 2024-09-19T06:23:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.482+0000 7fdf8107d740 1 -- 172.21.15.3:0/3321812572 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf600047a0 con 0x5648e056cb00 2024-09-19T06:23:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.482+0000 7fdf64c00640 1 -- 172.21.15.3:0/3321812572 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7fdf600041d0 con 0x5648e056cb00 2024-09-19T06:23:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.482+0000 7fdf64c00640 1 -- 172.21.15.3:0/3321812572 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdf60033050 con 0x5648e056cb00 2024-09-19T06:23:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.482+0000 7fdf8107d740 10 client.28487 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.482+0000 7fdf8107d740 1 -- 172.21.15.3:0/3321812572 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5648e0585b70 con 0x5648e056cb00 2024-09-19T06:23:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.482+0000 7fdf64c00640 1 -- 172.21.15.3:0/3321812572 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf600047a0 con 0x5648e056cb00 2024-09-19T06:23:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.483+0000 7fdf64c00640 1 -- 172.21.15.3:0/3321812572 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fdf600035f0 con 0x5648e056cb00 2024-09-19T06:23:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.483+0000 7fdf8107d740 10 client.28487 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.483+0000 7fdf8107d740 10 client.28487 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.483+0000 7fdf8107d740 20 client.28487 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.483+0000 7fdf8107d740 1 --2- 172.21.15.3:0/3321812572 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5648e0586fe0 0x5648e05893d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.483+0000 7fdf8107d740 4 client.28487 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.483+0000 7fdf8107d740 1 -- 172.21.15.3:0/3321812572 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648e04df830 con 0x5648e0586fe0 2024-09-19T06:23:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.483+0000 7fdf77400640 1 --2- 172.21.15.3:0/3321812572 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5648e0586fe0 0x5648e05893d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.484+0000 7fdf77400640 1 --2- 172.21.15.3:0/3321812572 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5648e0586fe0 0x5648e05893d0 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ad6dc8934f8869e server_cookie=3fdcfb628a85186d in_seq=0 out_seq=0 2024-09-19T06:23:24.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.484+0000 7fdf64c00640 10 client.28487 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:24.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.484+0000 7fdf64c00640 1 -- 172.21.15.3:0/3321812572 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5648e04df830 con 0x5648e0586fe0 2024-09-19T06:23:24.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.484+0000 7fdf64c00640 10 client.28487 handle_command_reply: tid=0 2024-09-19T06:23:24.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.484+0000 7fdf8107d740 1 client.28487 shutdown 2024-09-19T06:23:24.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.485+0000 7fdf8107d740 1 -- 172.21.15.3:0/3321812572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648e056cb00 msgr2=0x5648e0574830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:24.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.485+0000 7fdf8107d740 1 --2- 172.21.15.3:0/3321812572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648e056cb00 0x5648e0574830 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdf600052b0 tx=0x7fdf600052e0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.485+0000 7fdf8107d740 1 -- 172.21.15.3:0/3321812572 shutdown_connections 2024-09-19T06:23:24.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.485+0000 7fdf8107d740 1 --2- 172.21.15.3:0/3321812572 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5648e0586fe0 0x5648e05893d0 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.485+0000 7fdf8107d740 1 --2- 172.21.15.3:0/3321812572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e05773a0 0x5648e0574d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.492 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.485+0000 7fdf8107d740 1 --2- 172.21.15.3:0/3321812572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648e056cb00 0x5648e0574830 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.485+0000 7fdf8107d740 1 --2- 172.21.15.3:0/3321812572 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648e056c1e0 0x5648e05742f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.485+0000 7fdf64c00640 0 client.28487 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:24.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.485+0000 7fdf8107d740 1 -- 172.21.15.3:0/3321812572 >> 172.21.15.3:0/3321812572 conn(0x5648e0568750 msgr2=0x5648e056e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:24.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.485+0000 7fdf8107d740 1 -- 172.21.15.3:0/3321812572 shutdown_connections 2024-09-19T06:23:24.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.485+0000 7fdf8107d740 1 -- 172.21.15.3:0/3321812572 wait complete. 2024-09-19T06:23:24.493 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.485+0000 7fdf8107d740 20 client.28487 trim_cache size 0 max 16384 2024-09-19T06:23:24.503 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.501+0000 7fdf8107d740 1 Processor -- start 2024-09-19T06:23:24.503 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.501+0000 7fdf8107d740 1 -- start start 2024-09-19T06:23:24.503 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.501+0000 7fdf8107d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648e056c1e0 0x5648e058eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.503 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.501+0000 7fdf8107d740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e056cb00 0x5648e058f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.503 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.501+0000 7fdf8107d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648e05773a0 0x5648e05742b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.504 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.501+0000 7fdf8107d740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdf781b3f90 con 0x5648e056cb00 2024-09-19T06:23:24.504 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.501+0000 7fdf8107d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdf781b5ad0 con 0x5648e056c1e0 2024-09-19T06:23:24.504 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.501+0000 7fdf8107d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdf781b4660 con 0x5648e05773a0 2024-09-19T06:23:24.504 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.501+0000 7fdf6fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e056cb00 0x5648e058f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.504 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.501+0000 7fdf6fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e056cb00 0x5648e058f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43138/0 (socket says 172.21.15.3:43138) 2024-09-19T06:23:24.504 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.501+0000 7fdf6fe00640 1 -- 172.21.15.3:0/3586959438 learned_addr learned my addr 172.21.15.3:0/3586959438 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:24.504 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.501+0000 7fdf77400640 1 --2- 172.21.15.3:0/3586959438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648e056c1e0 0x5648e058eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.504 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.501+0000 7fdf77e00640 1 --2- 172.21.15.3:0/3586959438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648e05773a0 0x5648e05742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.504 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.502+0000 7fdf6fe00640 1 -- 172.21.15.3:0/3586959438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648e05773a0 msgr2=0x5648e05742b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:24.504 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.502+0000 7fdf6fe00640 1 --2- 172.21.15.3:0/3586959438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648e05773a0 0x5648e05742b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.505 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.502+0000 7fdf6fe00640 1 -- 172.21.15.3:0/3586959438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648e056c1e0 msgr2=0x5648e058eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:24.505 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.502+0000 7fdf6fe00640 1 --2- 172.21.15.3:0/3586959438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648e056c1e0 0x5648e058eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.505 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.502+0000 7fdf6fe00640 1 -- 172.21.15.3:0/3586959438 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648e0589960 con 0x5648e056cb00 2024-09-19T06:23:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.502+0000 7fdf6fe00640 1 --2- 172.21.15.3:0/3586959438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e056cb00 0x5648e058f0d0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fdf60000c00 tx=0x7fdf60005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbbab68f8f67a5db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:24.508 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.502+0000 7fdf67400640 1 -- 172.21.15.3:0/3586959438 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf600037f0 con 0x5648e056cb00 2024-09-19T06:23:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.502+0000 7fdf67400640 1 -- 172.21.15.3:0/3586959438 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf60016020 con 0x5648e056cb00 2024-09-19T06:23:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.502+0000 7fdf67400640 1 -- 172.21.15.3:0/3586959438 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf600246a0 con 0x5648e056cb00 2024-09-19T06:23:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.503+0000 7fdf8107d740 1 -- 172.21.15.3:0/3586959438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e056cb00 msgr2=0x5648e058f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.503+0000 7fdf8107d740 1 --2- 172.21.15.3:0/3586959438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e056cb00 0x5648e058f0d0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fdf60000c00 tx=0x7fdf60005710 comp rx=0 tx=0).stop 2024-09-19T06:23:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.503+0000 7fdf8107d740 1 -- 172.21.15.3:0/3586959438 shutdown_connections 2024-09-19T06:23:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.503+0000 7fdf8107d740 1 --2- 172.21.15.3:0/3586959438 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648e05773a0 0x5648e05742b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.503+0000 7fdf8107d740 1 --2- 172.21.15.3:0/3586959438 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e056cb00 0x5648e058f0d0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.503+0000 7fdf8107d740 1 --2- 172.21.15.3:0/3586959438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648e056c1e0 0x5648e058eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.503+0000 7fdf8107d740 1 -- 172.21.15.3:0/3586959438 >> 172.21.15.3:0/3586959438 conn(0x5648e0568750 msgr2=0x5648e0568b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.503+0000 7fdf8107d740 1 -- 172.21.15.3:0/3586959438 shutdown_connections 2024-09-19T06:23:24.509 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.503+0000 7fdf8107d740 1 -- 172.21.15.3:0/3586959438 wait complete. 2024-09-19T06:23:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.503+0000 7fdf8107d740 1 -- start start 2024-09-19T06:23:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.503+0000 7fdf8107d740 1 Processor -- start 2024-09-19T06:23:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.504+0000 7fdf8107d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648e056c1e0 0x5648e057a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.504+0000 7fdf8107d740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648e056cb00 0x5648e057a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.504+0000 7fdf8107d740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e05773a0 0x5648e05efb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.504+0000 7fdf8107d740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdf781b5400 con 0x5648e05773a0 2024-09-19T06:23:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.504+0000 7fdf8107d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdf781b4d30 con 0x5648e056c1e0 2024-09-19T06:23:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.504+0000 7fdf8107d740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdf781b1f90 con 0x5648e056cb00 2024-09-19T06:23:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.504+0000 7fdf8107d740 10 client.0 _ll_register_callbacks cb 0x7fdf680f3dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.504+0000 7fdf77e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e05773a0 0x5648e05efb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.504+0000 7fdf6fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648e056cb00 0x5648e057a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.504+0000 7fdf6fe00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648e056cb00 0x5648e057a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:58904/0 (socket says 172.21.15.3:58904) 2024-09-19T06:23:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.504+0000 7fdf6fe00640 1 -- 172.21.15.3:0/2731665353 learned_addr learned my addr 172.21.15.3:0/2731665353 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:24.511 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.504+0000 7fdf77400640 1 --2- 172.21.15.3:0/2731665353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648e056c1e0 0x5648e057a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.511 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.505+0000 7fdf77e00640 1 -- 172.21.15.3:0/2731665353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648e056cb00 msgr2=0x5648e057a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:24.511 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.505+0000 7fdf77e00640 1 --2- 172.21.15.3:0/2731665353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648e056cb00 0x5648e057a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.511 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.505+0000 7fdf77e00640 1 -- 172.21.15.3:0/2731665353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648e056c1e0 msgr2=0x5648e057a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:24.511 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.505+0000 7fdf77e00640 1 --2- 172.21.15.3:0/2731665353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648e056c1e0 0x5648e057a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.511 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.505+0000 7fdf77e00640 1 -- 172.21.15.3:0/2731665353 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648e056d110 con 0x5648e05773a0 2024-09-19T06:23:24.511 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.505+0000 7fdf77400640 1 --2- 172.21.15.3:0/2731665353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648e056c1e0 0x5648e057a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:24.511 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.505+0000 7fdf77e00640 1 --2- 172.21.15.3:0/2731665353 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e05773a0 0x5648e05efb50 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x5648e0583790 tx=0x7fdf70014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1062bb55426739ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:24.511 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.505+0000 7fdf64c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:23:24.511 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.505+0000 7fdf64c00640 1 -- 172.21.15.3:0/2731665353 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf70004d20 con 0x5648e05773a0 2024-09-19T06:23:24.511 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.505+0000 7fdf8107d740 1 -- 172.21.15.3:0/2731665353 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf60016020 con 0x5648e05773a0 2024-09-19T06:23:24.511 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.505+0000 7fdf64c00640 1 -- 172.21.15.3:0/2731665353 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7fdf70005020 con 0x5648e05773a0 2024-09-19T06:23:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.505+0000 7fdf64c00640 1 -- 172.21.15.3:0/2731665353 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdf70005220 con 0x5648e05773a0 2024-09-19T06:23:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.505+0000 7fdf8107d740 10 client.18459 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.505+0000 7fdf8107d740 1 -- 172.21.15.3:0/2731665353 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5648e056c010 con 0x5648e05773a0 2024-09-19T06:23:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.506+0000 7fdf64c00640 1 -- 172.21.15.3:0/2731665353 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf60016020 con 0x5648e05773a0 2024-09-19T06:23:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.506+0000 7fdf64c00640 1 -- 172.21.15.3:0/2731665353 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fdf7001cce0 con 0x5648e05773a0 2024-09-19T06:23:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.506+0000 7fdf8107d740 10 client.18459 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.506+0000 7fdf8107d740 10 client.18459 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.506+0000 7fdf8107d740 20 client.18459 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.506+0000 7fdf8107d740 1 --2- 172.21.15.3:0/2731665353 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5648e05f1660 0x5648e05f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.506+0000 7fdf8107d740 4 client.18459 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:23:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.506+0000 7fdf8107d740 1 -- 172.21.15.3:0/2731665353 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5648e04d9b80 con 0x5648e05f1660 2024-09-19T06:23:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.506+0000 7fdf77400640 1 --2- 172.21.15.3:0/2731665353 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5648e05f1660 0x5648e05f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.507+0000 7fdf77400640 1 --2- 172.21.15.3:0/2731665353 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5648e05f1660 0x5648e05f3a80 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae60c4cdecb4217 server_cookie=bff5a876323a27d9 in_seq=0 out_seq=0 2024-09-19T06:23:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.507+0000 7fdf64c00640 10 client.18459 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf64c00640 1 -- 172.21.15.3:0/2731665353 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5648e04d9b80 con 0x5648e05f1660 2024-09-19T06:23:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf64c00640 10 client.18459 handle_command_reply: tid=0 2024-09-19T06:23:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf8107d740 1 client.18459 shutdown 2024-09-19T06:23:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf8107d740 1 -- 172.21.15.3:0/2731665353 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e05773a0 msgr2=0x5648e05efb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf8107d740 1 --2- 172.21.15.3:0/2731665353 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e05773a0 0x5648e05efb50 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x5648e0583790 tx=0x7fdf70014040 comp rx=0 tx=0).stop 2024-09-19T06:23:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf8107d740 1 -- 172.21.15.3:0/2731665353 shutdown_connections 2024-09-19T06:23:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf8107d740 1 --2- 172.21.15.3:0/2731665353 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5648e05f1660 0x5648e05f3a80 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf8107d740 1 --2- 172.21.15.3:0/2731665353 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5648e05773a0 0x5648e05efb50 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf8107d740 1 --2- 172.21.15.3:0/2731665353 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5648e056cb00 0x5648e057a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf8107d740 1 --2- 172.21.15.3:0/2731665353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5648e056c1e0 0x5648e057a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf64c00640 0 client.18459 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf8107d740 1 -- 172.21.15.3:0/2731665353 >> 172.21.15.3:0/2731665353 conn(0x5648e0568750 msgr2=0x5648e056dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf8107d740 1 -- 172.21.15.3:0/2731665353 shutdown_connections 2024-09-19T06:23:24.525 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf8107d740 1 -- 172.21.15.3:0/2731665353 wait complete. 2024-09-19T06:23:24.525 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf8107d740 20 client.18459 trim_cache size 0 max 16384 2024-09-19T06:23:24.525 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:23:24.525 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:23:24.525 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:23:24.525 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:23:24.526 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf7e000640 1 -- 172.21.15.3:0/3098939260 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fdf5c0a33b0 msgr2=0x7fdf5c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:24.526 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf7e000640 1 --2- 172.21.15.3:0/3098939260 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fdf5c0a33b0 0x7fdf5c0a5870 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdf7806b200 tx=0x7fdf70009500 comp rx=0 tx=0).stop 2024-09-19T06:23:24.526 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf7e000640 1 -- 172.21.15.3:0/3098939260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf78076720 msgr2=0x7fdf781a4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:24.526 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf7e000640 1 --2- 172.21.15.3:0/3098939260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf78076720 0x7fdf781a4680 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdf68004770 tx=0x7fdf68003c10 comp rx=0 tx=0).stop 2024-09-19T06:23:24.526 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf7e000640 1 -- 172.21.15.3:0/3098939260 shutdown_connections 2024-09-19T06:23:24.526 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf7e000640 1 --2- 172.21.15.3:0/3098939260 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fdf5c0a33b0 0x7fdf5c0a5870 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf7e000640 1 --2- 172.21.15.3:0/3098939260 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdf78112970 0x7fdf7819e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf7e000640 1 --2- 172.21.15.3:0/3098939260 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf78077040 0x7fdf781a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf7e000640 1 --2- 172.21.15.3:0/3098939260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf78076720 0x7fdf781a4680 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.522+0000 7fdf7e000640 1 -- 172.21.15.3:0/3098939260 >> 172.21.15.3:0/3098939260 conn(0x7fdf780ff970 msgr2=0x7fdf78101d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.523+0000 7fdf7e000640 1 -- 172.21.15.3:0/3098939260 shutdown_connections 2024-09-19T06:23:24.527 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:24.523+0000 7fdf7e000640 1 -- 172.21.15.3:0/3098939260 wait complete. 2024-09-19T06:23:26.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:25 smithi059 ceph-mon[35138]: pgmap v344: 97 pgs: 97 active+clean; 2.2 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 59 KiB/s wr, 22 op/s 2024-09-19T06:23:26.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:25 smithi003 ceph-mon[30893]: pgmap v344: 97 pgs: 97 active+clean; 2.2 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 59 KiB/s wr, 22 op/s 2024-09-19T06:23:26.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:25 smithi071 ceph-mon[35662]: pgmap v344: 97 pgs: 97 active+clean; 2.2 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 59 KiB/s wr, 22 op/s 2024-09-19T06:23:28.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:27 smithi059 ceph-mon[35138]: pgmap v345: 97 pgs: 97 active+clean; 2.2 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-09-19T06:23:28.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:27 smithi003 ceph-mon[30893]: pgmap v345: 97 pgs: 97 active+clean; 2.2 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-09-19T06:23:28.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:27 smithi071 ceph-mon[35662]: pgmap v345: 97 pgs: 97 active+clean; 2.2 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-09-19T06:23:30.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:29 smithi059 ceph-mon[35138]: pgmap v346: 97 pgs: 97 active+clean; 2.4 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 59 KiB/s wr, 22 op/s 2024-09-19T06:23:30.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:29 smithi003 ceph-mon[30893]: pgmap v346: 97 pgs: 97 active+clean; 2.4 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 59 KiB/s wr, 22 op/s 2024-09-19T06:23:30.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:29 smithi071 ceph-mon[35662]: pgmap v346: 97 pgs: 97 active+clean; 2.4 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 59 KiB/s wr, 22 op/s 2024-09-19T06:23:32.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:31 smithi059 ceph-mon[35138]: pgmap v347: 97 pgs: 97 active+clean; 2.4 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-19T06:23:32.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:31 smithi003 ceph-mon[30893]: pgmap v347: 97 pgs: 97 active+clean; 2.4 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-19T06:23:32.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:31 smithi071 ceph-mon[35662]: pgmap v347: 97 pgs: 97 active+clean; 2.4 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-19T06:23:34.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:33 smithi059 ceph-mon[35138]: pgmap v348: 97 pgs: 97 active+clean; 2.4 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-19T06:23:34.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:33 smithi003 ceph-mon[30893]: pgmap v348: 97 pgs: 97 active+clean; 2.4 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-19T06:23:34.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:33 smithi071 ceph-mon[35662]: pgmap v348: 97 pgs: 97 active+clean; 2.4 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-19T06:23:34.980 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:23:35.373 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:35.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.930+0000 7fea56800640 1 -- 172.21.15.3:0/3010635825 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea501049c0 msgr2=0x7fea50108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:35.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.930+0000 7fea56800640 1 --2- 172.21.15.3:0/3010635825 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea501049c0 0x7fea50108a10 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fea38009900 tx=0x7fea3802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.930+0000 7fea56800640 1 -- 172.21.15.3:0/3010635825 shutdown_connections 2024-09-19T06:23:35.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.930+0000 7fea56800640 1 --2- 172.21.15.3:0/3010635825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea50109140 0x7fea50110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.930+0000 7fea56800640 1 --2- 172.21.15.3:0/3010635825 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea501049c0 0x7fea50108a10 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.930+0000 7fea56800640 1 --2- 172.21.15.3:0/3010635825 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea50104010 0x7fea501043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.930+0000 7fea56800640 1 -- 172.21.15.3:0/3010635825 >> 172.21.15.3:0/3010635825 conn(0x7fea500ffa50 msgr2=0x7fea50101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:35.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.930+0000 7fea56800640 1 -- 172.21.15.3:0/3010635825 shutdown_connections 2024-09-19T06:23:35.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.930+0000 7fea56800640 1 -- 172.21.15.3:0/3010635825 wait complete. 2024-09-19T06:23:35.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.931+0000 7fea56800640 1 Processor -- start 2024-09-19T06:23:35.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.931+0000 7fea56800640 1 -- start start 2024-09-19T06:23:35.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.932+0000 7fea56800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea50104010 0x7fea5019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:35.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.932+0000 7fea56800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea501049c0 0x7fea5019ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:35.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.932+0000 7fea56800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea50109140 0x7fea5019efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:35.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.932+0000 7fea56800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fea501141b0 con 0x7fea50104010 2024-09-19T06:23:35.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.932+0000 7fea56800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fea50114030 con 0x7fea501049c0 2024-09-19T06:23:35.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.932+0000 7fea56800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fea50114330 con 0x7fea50109140 2024-09-19T06:23:35.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.932+0000 7fea4f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea50104010 0x7fea5019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:35.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.932+0000 7fea4f400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea50104010 0x7fea5019a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60884/0 (socket says 172.21.15.3:60884) 2024-09-19T06:23:35.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.932+0000 7fea4f400640 1 -- 172.21.15.3:0/3457419228 learned_addr learned my addr 172.21.15.3:0/3457419228 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:35.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.932+0000 7fea47e00640 1 --2- 172.21.15.3:0/3457419228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea501049c0 0x7fea5019ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:35.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.932+0000 7fea4fe00640 1 --2- 172.21.15.3:0/3457419228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea50109140 0x7fea5019efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:35.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.933+0000 7fea4f400640 1 -- 172.21.15.3:0/3457419228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea50109140 msgr2=0x7fea5019efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:35.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.933+0000 7fea4f400640 1 --2- 172.21.15.3:0/3457419228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea50109140 0x7fea5019efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.934 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.933+0000 7fea4f400640 1 -- 172.21.15.3:0/3457419228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea501049c0 msgr2=0x7fea5019ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:35.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.933+0000 7fea4f400640 1 --2- 172.21.15.3:0/3457419228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea501049c0 0x7fea5019ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.933+0000 7fea4f400640 1 -- 172.21.15.3:0/3457419228 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea5019f6c0 con 0x7fea50104010 2024-09-19T06:23:35.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.933+0000 7fea4f400640 1 --2- 172.21.15.3:0/3457419228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea50104010 0x7fea5019a710 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fea4000e9f0 tx=0x7fea4000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:35.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.933+0000 7fea4cc00640 1 -- 172.21.15.3:0/3457419228 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4000cd80 con 0x7fea50104010 2024-09-19T06:23:35.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.933+0000 7fea56800640 1 -- 172.21.15.3:0/3457419228 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea5019f9b0 con 0x7fea50104010 2024-09-19T06:23:35.935 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.933+0000 7fea4cc00640 1 -- 172.21.15.3:0/3457419228 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea40005500 con 0x7fea50104010 2024-09-19T06:23:35.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.933+0000 7fea4cc00640 1 -- 172.21.15.3:0/3457419228 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea40010690 con 0x7fea50104010 2024-09-19T06:23:35.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.933+0000 7fea56800640 1 -- 172.21.15.3:0/3457419228 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea501a7290 con 0x7fea50104010 2024-09-19T06:23:35.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.936+0000 7fea4cc00640 1 -- 172.21.15.3:0/3457419228 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fea400046c0 con 0x7fea50104010 2024-09-19T06:23:35.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.937+0000 7fea591ed740 1 Processor -- start 2024-09-19T06:23:35.937 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.937+0000 7fea591ed740 1 -- start start 2024-09-19T06:23:35.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.937+0000 7fea591ed740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd4eb90 0x55e0bbd4ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:35.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.937+0000 7fea591ed740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0bbd4f4b0 0x55e0bbd59830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:35.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.937+0000 7fea591ed740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0bbd59d70 0x55e0bbd5c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:35.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.937+0000 7fea591ed740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e0bbcb53e0 con 0x55e0bbd4eb90 2024-09-19T06:23:35.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.937+0000 7fea591ed740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e0bbc5cd80 con 0x55e0bbd59d70 2024-09-19T06:23:35.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.937+0000 7fea591ed740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e0bbcb13a0 con 0x55e0bbd4f4b0 2024-09-19T06:23:35.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.937+0000 7fea4fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd4eb90 0x55e0bbd4ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:35.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.937+0000 7fea4fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd4eb90 0x55e0bbd4ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60886/0 (socket says 172.21.15.3:60886) 2024-09-19T06:23:35.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.937+0000 7fea4fe00640 1 -- 172.21.15.3:0/1218167247 learned_addr learned my addr 172.21.15.3:0/1218167247 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:35.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.937+0000 7fea4f400640 1 --2- 172.21.15.3:0/1218167247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0bbd4f4b0 0x55e0bbd59830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:35.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.937+0000 7fea47e00640 1 --2- 172.21.15.3:0/1218167247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0bbd59d70 0x55e0bbd5c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:35.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.938+0000 7fea4fe00640 1 -- 172.21.15.3:0/1218167247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0bbd4f4b0 msgr2=0x55e0bbd59830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:35.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.938+0000 7fea4fe00640 1 --2- 172.21.15.3:0/1218167247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0bbd4f4b0 0x55e0bbd59830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.938+0000 7fea4fe00640 1 -- 172.21.15.3:0/1218167247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0bbd59d70 msgr2=0x55e0bbd5c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:35.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.938+0000 7fea4fe00640 1 --2- 172.21.15.3:0/1218167247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0bbd59d70 0x55e0bbd5c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.938+0000 7fea4fe00640 1 -- 172.21.15.3:0/1218167247 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0bbc7bae0 con 0x55e0bbd4eb90 2024-09-19T06:23:35.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.938+0000 7fea4fe00640 1 --2- 172.21.15.3:0/1218167247 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd4eb90 0x55e0bbd4ef70 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fea48009f50 tx=0x7fea480118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3619daf5de85e7e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:35.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.938+0000 7fea44c00640 1 -- 172.21.15.3:0/1218167247 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea48004d20 con 0x55e0bbd4eb90 2024-09-19T06:23:35.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.939+0000 7fea44c00640 1 -- 172.21.15.3:0/1218167247 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea48004050 con 0x55e0bbd4eb90 2024-09-19T06:23:35.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.939+0000 7fea44c00640 1 -- 172.21.15.3:0/1218167247 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea48005280 con 0x55e0bbd4eb90 2024-09-19T06:23:35.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.939+0000 7fea4cc00640 1 --2- 172.21.15.3:0/3457419228 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fea340a33b0 0x7fea340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:35.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.939+0000 7fea4cc00640 1 -- 172.21.15.3:0/3457419228 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7fea400d0190 con 0x7fea50104010 2024-09-19T06:23:35.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.939+0000 7fea4f400640 1 --2- 172.21.15.3:0/3457419228 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fea340a33b0 0x7fea340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:35.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.939+0000 7fea591ed740 1 -- 172.21.15.3:0/1218167247 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd4eb90 msgr2=0x55e0bbd4ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:35.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.939+0000 7fea591ed740 1 --2- 172.21.15.3:0/1218167247 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd4eb90 0x55e0bbd4ef70 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fea48009f50 tx=0x7fea480118d0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.939+0000 7fea591ed740 1 -- 172.21.15.3:0/1218167247 shutdown_connections 2024-09-19T06:23:35.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.939+0000 7fea591ed740 1 --2- 172.21.15.3:0/1218167247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0bbd59d70 0x55e0bbd5c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.939+0000 7fea591ed740 1 --2- 172.21.15.3:0/1218167247 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0bbd4f4b0 0x55e0bbd59830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.939+0000 7fea591ed740 1 --2- 172.21.15.3:0/1218167247 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd4eb90 0x55e0bbd4ef70 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.939+0000 7fea591ed740 1 -- 172.21.15.3:0/1218167247 >> 172.21.15.3:0/1218167247 conn(0x55e0bbd4b120 msgr2=0x55e0bbd4b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:35.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.940+0000 7fea591ed740 1 -- 172.21.15.3:0/1218167247 shutdown_connections 2024-09-19T06:23:35.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.940+0000 7fea591ed740 1 -- 172.21.15.3:0/1218167247 wait complete. 2024-09-19T06:23:35.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.940+0000 7fea4f400640 1 --2- 172.21.15.3:0/3457419228 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fea340a33b0 0x7fea340a5870 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x55e0bbd4bf80 tx=0x7fea40098040 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:35.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.940+0000 7fea591ed740 1 -- start start 2024-09-19T06:23:35.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.940+0000 7fea591ed740 1 Processor -- start 2024-09-19T06:23:35.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.941+0000 7fea591ed740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0bbd4eb90 0x55e0bbd56c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:35.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.941+0000 7fea591ed740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0bbd4f4b0 0x55e0bbd571b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:35.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.941+0000 7fea591ed740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd59d70 0x55e0bbd576f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:35.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.941+0000 7fea591ed740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e0bbd5c9e0 con 0x55e0bbd59d70 2024-09-19T06:23:35.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.941+0000 7fea591ed740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e0bbc700f0 con 0x55e0bbd4eb90 2024-09-19T06:23:35.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.941+0000 7fea591ed740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e0bbd5cb60 con 0x55e0bbd4f4b0 2024-09-19T06:23:35.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.941+0000 7fea591ed740 10 client.0 _ll_register_callbacks cb 0x55e0bbc619e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:35.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.941+0000 7fea4fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd59d70 0x55e0bbd576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:35.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.941+0000 7fea4fe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd59d70 0x55e0bbd576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60894/0 (socket says 172.21.15.3:60894) 2024-09-19T06:23:35.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.941+0000 7fea4fe00640 1 -- 172.21.15.3:0/3355454388 learned_addr learned my addr 172.21.15.3:0/3355454388 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:35.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.941+0000 7fea47e00640 1 --2- 172.21.15.3:0/3355454388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0bbd4f4b0 0x55e0bbd571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:35.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.941+0000 7fea4fe00640 1 --2- 172.21.15.3:0/3355454388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0bbd4eb90 0x55e0bbd56c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:35.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.942+0000 7fea47e00640 1 -- 172.21.15.3:0/3355454388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0bbd4eb90 msgr2=0x55e0bbd56c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:35.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.942+0000 7fea47e00640 1 --2- 172.21.15.3:0/3355454388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0bbd4eb90 0x55e0bbd56c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.942+0000 7fea47e00640 1 -- 172.21.15.3:0/3355454388 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd59d70 msgr2=0x55e0bbd576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:35.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.942+0000 7fea47e00640 1 --2- 172.21.15.3:0/3355454388 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd59d70 0x55e0bbd576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.942+0000 7fea47e00640 1 -- 172.21.15.3:0/3355454388 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0bba263c0 con 0x55e0bbd4f4b0 2024-09-19T06:23:35.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.942+0000 7fea4fe00640 1 --2- 172.21.15.3:0/3355454388 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd59d70 0x55e0bbd576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:35.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.942+0000 7fea47e00640 1 --2- 172.21.15.3:0/3355454388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0bbd4f4b0 0x55e0bbd571b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fea3802a910 tx=0x7fea38004390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fce0194b45bcc7d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:35.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.942+0000 7fea3d600640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:23:35.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.942+0000 7fea3d600640 1 -- 172.21.15.3:0/3355454388 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea38035040 con 0x55e0bbd4f4b0 2024-09-19T06:23:35.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.943+0000 7fea591ed740 1 -- 172.21.15.3:0/3355454388 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea48004050 con 0x55e0bbd4f4b0 2024-09-19T06:23:35.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.943+0000 7fea3d600640 1 -- 172.21.15.3:0/3355454388 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7fea38005450 con 0x55e0bbd4f4b0 2024-09-19T06:23:35.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.943+0000 7fea3d600640 1 -- 172.21.15.3:0/3355454388 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fea38005650 con 0x55e0bbd4f4b0 2024-09-19T06:23:35.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.943+0000 7fea591ed740 10 client.28480 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:35.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.943+0000 7fea591ed740 1 -- 172.21.15.3:0/3355454388 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e0bbd686f0 con 0x55e0bbd4f4b0 2024-09-19T06:23:35.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.943+0000 7fea3d600640 1 -- 172.21.15.3:0/3355454388 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea48004050 con 0x55e0bbd4f4b0 2024-09-19T06:23:35.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.943+0000 7fea3d600640 1 -- 172.21.15.3:0/3355454388 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fea3804d070 con 0x55e0bbd4f4b0 2024-09-19T06:23:35.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.943+0000 7fea591ed740 10 client.28480 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:35.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.943+0000 7fea591ed740 10 client.28480 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:35.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.943+0000 7fea591ed740 20 client.28480 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:35.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.943+0000 7fea591ed740 1 --2- 172.21.15.3:0/3355454388 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e0bbd69b00 0x55e0bbd6bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:35.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.944+0000 7fea591ed740 4 client.28480 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:35.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.944+0000 7fea591ed740 1 -- 172.21.15.3:0/3355454388 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0bbcc2950 con 0x55e0bbd69b00 2024-09-19T06:23:35.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.944+0000 7fea4fe00640 1 --2- 172.21.15.3:0/3355454388 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e0bbd69b00 0x55e0bbd6bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:35.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.945+0000 7fea4fe00640 1 --2- 172.21.15.3:0/3355454388 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e0bbd69b00 0x55e0bbd6bef0 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f2ccfcff14cea59 server_cookie=ed26740bba833337 in_seq=0 out_seq=0 2024-09-19T06:23:35.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.945+0000 7fea3d600640 10 client.28480 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:35.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.945+0000 7fea3d600640 1 -- 172.21.15.3:0/3355454388 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e0bbcc2950 con 0x55e0bbd69b00 2024-09-19T06:23:35.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.945+0000 7fea3d600640 10 client.28480 handle_command_reply: tid=0 2024-09-19T06:23:35.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.946+0000 7fea591ed740 1 client.28480 shutdown 2024-09-19T06:23:35.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.946+0000 7fea591ed740 1 -- 172.21.15.3:0/3355454388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0bbd4f4b0 msgr2=0x55e0bbd571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:35.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.946+0000 7fea591ed740 1 --2- 172.21.15.3:0/3355454388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0bbd4f4b0 0x55e0bbd571b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fea3802a910 tx=0x7fea38004390 comp rx=0 tx=0).stop 2024-09-19T06:23:35.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.946+0000 7fea591ed740 1 -- 172.21.15.3:0/3355454388 shutdown_connections 2024-09-19T06:23:35.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.946+0000 7fea591ed740 1 --2- 172.21.15.3:0/3355454388 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e0bbd69b00 0x55e0bbd6bef0 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.946+0000 7fea591ed740 1 --2- 172.21.15.3:0/3355454388 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd59d70 0x55e0bbd576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.946+0000 7fea591ed740 1 --2- 172.21.15.3:0/3355454388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0bbd4f4b0 0x55e0bbd571b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.946+0000 7fea3d600640 0 client.28480 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:35.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.946+0000 7fea591ed740 1 --2- 172.21.15.3:0/3355454388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0bbd4eb90 0x55e0bbd56c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.946+0000 7fea591ed740 1 -- 172.21.15.3:0/3355454388 >> 172.21.15.3:0/3355454388 conn(0x55e0bbd4b120 msgr2=0x55e0bbd50e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:35.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.946+0000 7fea591ed740 1 -- 172.21.15.3:0/3355454388 shutdown_connections 2024-09-19T06:23:35.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.946+0000 7fea591ed740 1 -- 172.21.15.3:0/3355454388 wait complete. 2024-09-19T06:23:35.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.946+0000 7fea591ed740 20 client.28480 trim_cache size 0 max 16384 2024-09-19T06:23:35.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.964+0000 7fea591ed740 1 Processor -- start 2024-09-19T06:23:35.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.964+0000 7fea591ed740 1 -- start start 2024-09-19T06:23:35.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.965+0000 7fea591ed740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0bbd4eb90 0x55e0bbd58be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:35.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.965+0000 7fea591ed740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd4f4b0 0x55e0bbd717c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:35.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.965+0000 7fea591ed740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0bbd59d70 0x55e0bbd71d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:35.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.965+0000 7fea591ed740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fea501afbf0 con 0x55e0bbd4f4b0 2024-09-19T06:23:35.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.965+0000 7fea591ed740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fea501b1730 con 0x55e0bbd59d70 2024-09-19T06:23:35.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.965+0000 7fea591ed740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fea501b02c0 con 0x55e0bbd4eb90 2024-09-19T06:23:35.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.965+0000 7fea47e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd4f4b0 0x55e0bbd717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:35.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.965+0000 7fea4fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0bbd59d70 0x55e0bbd71d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:35.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.965+0000 7fea47e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd4f4b0 0x55e0bbd717c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60898/0 (socket says 172.21.15.3:60898) 2024-09-19T06:23:35.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.965+0000 7fea47e00640 1 -- 172.21.15.3:0/3203544177 learned_addr learned my addr 172.21.15.3:0/3203544177 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:35.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.965+0000 7fea4fe00640 1 --2- 172.21.15.3:0/3203544177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0bbd4eb90 0x55e0bbd58be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:35.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.965+0000 7fea47e00640 1 -- 172.21.15.3:0/3203544177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0bbd4eb90 msgr2=0x55e0bbd58be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:35.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.965+0000 7fea47e00640 1 --2- 172.21.15.3:0/3203544177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0bbd4eb90 0x55e0bbd58be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.965+0000 7fea47e00640 1 -- 172.21.15.3:0/3203544177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0bbd59d70 msgr2=0x55e0bbd71d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:35.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.965+0000 7fea47e00640 1 --2- 172.21.15.3:0/3203544177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0bbd59d70 0x55e0bbd71d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.965+0000 7fea47e00640 1 -- 172.21.15.3:0/3203544177 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0bbd51b40 con 0x55e0bbd4f4b0 2024-09-19T06:23:35.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.966+0000 7fea47e00640 1 --2- 172.21.15.3:0/3203544177 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd4f4b0 0x55e0bbd717c0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fea38031ac0 tx=0x7fea3802a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5d05084078e9e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:35.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.966+0000 7fea3fe00640 1 -- 172.21.15.3:0/3203544177 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea38053070 con 0x55e0bbd4f4b0 2024-09-19T06:23:35.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.966+0000 7fea3fe00640 1 -- 172.21.15.3:0/3203544177 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea38041070 con 0x55e0bbd4f4b0 2024-09-19T06:23:35.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.966+0000 7fea3fe00640 1 -- 172.21.15.3:0/3203544177 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea38035030 con 0x55e0bbd4f4b0 2024-09-19T06:23:35.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.967+0000 7fea591ed740 1 -- 172.21.15.3:0/3203544177 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd4f4b0 msgr2=0x55e0bbd717c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:35.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.967+0000 7fea591ed740 1 --2- 172.21.15.3:0/3203544177 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd4f4b0 0x55e0bbd717c0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fea38031ac0 tx=0x7fea3802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.967+0000 7fea591ed740 1 -- 172.21.15.3:0/3203544177 shutdown_connections 2024-09-19T06:23:35.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.967+0000 7fea591ed740 1 --2- 172.21.15.3:0/3203544177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0bbd59d70 0x55e0bbd71d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.967+0000 7fea591ed740 1 --2- 172.21.15.3:0/3203544177 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd4f4b0 0x55e0bbd717c0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.967+0000 7fea591ed740 1 --2- 172.21.15.3:0/3203544177 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0bbd4eb90 0x55e0bbd58be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.967+0000 7fea591ed740 1 -- 172.21.15.3:0/3203544177 >> 172.21.15.3:0/3203544177 conn(0x55e0bbd4b120 msgr2=0x55e0bbd584d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:35.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.967+0000 7fea591ed740 1 -- 172.21.15.3:0/3203544177 shutdown_connections 2024-09-19T06:23:35.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.967+0000 7fea591ed740 1 -- 172.21.15.3:0/3203544177 wait complete. 2024-09-19T06:23:35.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.967+0000 7fea591ed740 1 -- start start 2024-09-19T06:23:35.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.968+0000 7fea591ed740 1 Processor -- start 2024-09-19T06:23:35.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.968+0000 7fea591ed740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0bbd4eb90 0x55e0bbd53d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:35.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.968+0000 7fea591ed740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd4f4b0 0x55e0bbd54270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:35.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.968+0000 7fea591ed740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0bbd59d70 0x55e0bbd547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:35.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.968+0000 7fea591ed740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fea501b1060 con 0x55e0bbd4f4b0 2024-09-19T06:23:35.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.968+0000 7fea591ed740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fea501b0990 con 0x55e0bbd59d70 2024-09-19T06:23:35.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.968+0000 7fea591ed740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fea501adbf0 con 0x55e0bbd4eb90 2024-09-19T06:23:35.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.968+0000 7fea591ed740 10 client.0 _ll_register_callbacks cb 0x7fea38004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:35.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.968+0000 7fea47e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd4f4b0 0x55e0bbd54270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:35.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.968+0000 7fea47e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd4f4b0 0x55e0bbd54270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60908/0 (socket says 172.21.15.3:60908) 2024-09-19T06:23:35.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.968+0000 7fea47e00640 1 -- 172.21.15.3:0/531913760 learned_addr learned my addr 172.21.15.3:0/531913760 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:35.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.968+0000 7fea4fe00640 1 --2- 172.21.15.3:0/531913760 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0bbd4eb90 0x55e0bbd53d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:35.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.969+0000 7fea4fe00640 1 --2- 172.21.15.3:0/531913760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0bbd59d70 0x55e0bbd547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:35.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.969+0000 7fea47e00640 1 -- 172.21.15.3:0/531913760 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0bbd4eb90 msgr2=0x55e0bbd53d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:35.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.969+0000 7fea47e00640 1 --2- 172.21.15.3:0/531913760 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0bbd4eb90 0x55e0bbd53d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.969+0000 7fea47e00640 1 -- 172.21.15.3:0/531913760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0bbd59d70 msgr2=0x55e0bbd547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:35.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.969+0000 7fea47e00640 1 --2- 172.21.15.3:0/531913760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0bbd59d70 0x55e0bbd547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.969+0000 7fea47e00640 1 -- 172.21.15.3:0/531913760 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0bbdd3840 con 0x55e0bbd4f4b0 2024-09-19T06:23:35.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.969+0000 7fea4fe00640 1 --2- 172.21.15.3:0/531913760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0bbd59d70 0x55e0bbd547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:35.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.969+0000 7fea47e00640 1 --2- 172.21.15.3:0/531913760 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd4f4b0 0x55e0bbd54270 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fea38005b90 tx=0x7fea38031ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae68b4c27ec687d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:35.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.969+0000 7fea3d600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:23:35.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.970+0000 7fea3d600640 1 -- 172.21.15.3:0/531913760 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3805c030 con 0x55e0bbd4f4b0 2024-09-19T06:23:35.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.970+0000 7fea3d600640 1 -- 172.21.15.3:0/531913760 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7fea380046c0 con 0x55e0bbd4f4b0 2024-09-19T06:23:35.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.970+0000 7fea591ed740 1 -- 172.21.15.3:0/531913760 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea38041070 con 0x55e0bbd4f4b0 2024-09-19T06:23:35.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.970+0000 7fea3d600640 1 -- 172.21.15.3:0/531913760 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fea38066050 con 0x55e0bbd4f4b0 2024-09-19T06:23:35.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.970+0000 7fea591ed740 10 client.18477 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:35.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.970+0000 7fea591ed740 1 -- 172.21.15.3:0/531913760 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e0bbdd4b30 con 0x55e0bbd4f4b0 2024-09-19T06:23:35.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.970+0000 7fea3d600640 1 -- 172.21.15.3:0/531913760 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea38041070 con 0x55e0bbd4f4b0 2024-09-19T06:23:35.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.970+0000 7fea3d600640 1 -- 172.21.15.3:0/531913760 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fea3804d070 con 0x55e0bbd4f4b0 2024-09-19T06:23:35.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.970+0000 7fea591ed740 10 client.18477 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:35.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.970+0000 7fea591ed740 10 client.18477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:35.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.970+0000 7fea591ed740 20 client.18477 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:35.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.970+0000 7fea591ed740 1 --2- 172.21.15.3:0/531913760 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e0bbdd51e0 0x55e0bbdd7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:35.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.970+0000 7fea591ed740 4 client.18477 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:23:35.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.970+0000 7fea591ed740 1 -- 172.21.15.3:0/531913760 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e0bbcbce60 con 0x55e0bbdd51e0 2024-09-19T06:23:35.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.971+0000 7fea4fe00640 1 --2- 172.21.15.3:0/531913760 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e0bbdd51e0 0x55e0bbdd7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:35.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.972+0000 7fea4fe00640 1 --2- 172.21.15.3:0/531913760 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e0bbdd51e0 0x55e0bbdd7600 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99a7cce0485a838d server_cookie=e6ebf2a77d6399ec in_seq=0 out_seq=0 2024-09-19T06:23:35.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.972+0000 7fea3d600640 10 client.18477 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:35.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.972+0000 7fea3d600640 1 -- 172.21.15.3:0/531913760 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e0bbcbce60 con 0x55e0bbdd51e0 2024-09-19T06:23:35.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.972+0000 7fea3d600640 10 client.18477 handle_command_reply: tid=0 2024-09-19T06:23:35.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.972+0000 7fea591ed740 1 client.18477 shutdown 2024-09-19T06:23:35.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.972+0000 7fea591ed740 1 -- 172.21.15.3:0/531913760 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd4f4b0 msgr2=0x55e0bbd54270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:35.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.972+0000 7fea591ed740 1 --2- 172.21.15.3:0/531913760 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd4f4b0 0x55e0bbd54270 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fea38005b90 tx=0x7fea38031ed0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.975 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.972+0000 7fea591ed740 1 -- 172.21.15.3:0/531913760 shutdown_connections 2024-09-19T06:23:35.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.972+0000 7fea591ed740 1 --2- 172.21.15.3:0/531913760 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e0bbdd51e0 0x55e0bbdd7600 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.972+0000 7fea591ed740 1 --2- 172.21.15.3:0/531913760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e0bbd59d70 0x55e0bbd547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.972+0000 7fea591ed740 1 --2- 172.21.15.3:0/531913760 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e0bbd4f4b0 0x55e0bbd54270 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.972+0000 7fea591ed740 1 --2- 172.21.15.3:0/531913760 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e0bbd4eb90 0x55e0bbd53d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.972+0000 7fea591ed740 1 -- 172.21.15.3:0/531913760 >> 172.21.15.3:0/531913760 conn(0x55e0bbd4b120 msgr2=0x55e0bbd50e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:35.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.972+0000 7fea3d600640 0 client.18477 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:35.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.972+0000 7fea591ed740 1 -- 172.21.15.3:0/531913760 shutdown_connections 2024-09-19T06:23:35.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.972+0000 7fea591ed740 1 -- 172.21.15.3:0/531913760 wait complete. 2024-09-19T06:23:35.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.973+0000 7fea591ed740 20 client.18477 trim_cache size 0 max 16384 2024-09-19T06:23:35.976 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:23:35.977 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "no active scrubs running", 2024-09-19T06:23:35.977 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": {} 2024-09-19T06:23:35.977 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:23:35.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.973+0000 7fea56800640 1 -- 172.21.15.3:0/3457419228 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fea340a33b0 msgr2=0x7fea340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:35.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.973+0000 7fea56800640 1 --2- 172.21.15.3:0/3457419228 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fea340a33b0 0x7fea340a5870 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x55e0bbd4bf80 tx=0x7fea40098040 comp rx=0 tx=0).stop 2024-09-19T06:23:35.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.973+0000 7fea56800640 1 -- 172.21.15.3:0/3457419228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea50104010 msgr2=0x7fea5019a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:35.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.973+0000 7fea56800640 1 --2- 172.21.15.3:0/3457419228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea50104010 0x7fea5019a710 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fea4000e9f0 tx=0x7fea4000edf0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.973+0000 7fea56800640 1 -- 172.21.15.3:0/3457419228 shutdown_connections 2024-09-19T06:23:35.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.973+0000 7fea56800640 1 --2- 172.21.15.3:0/3457419228 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fea340a33b0 0x7fea340a5870 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.973+0000 7fea56800640 1 --2- 172.21.15.3:0/3457419228 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fea50109140 0x7fea5019efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.973+0000 7fea56800640 1 --2- 172.21.15.3:0/3457419228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea501049c0 0x7fea5019ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.973+0000 7fea56800640 1 --2- 172.21.15.3:0/3457419228 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea50104010 0x7fea5019a710 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:35.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.973+0000 7fea56800640 1 -- 172.21.15.3:0/3457419228 >> 172.21.15.3:0/3457419228 conn(0x7fea500ffa50 msgr2=0x7fea50100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:35.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.973+0000 7fea56800640 1 -- 172.21.15.3:0/3457419228 shutdown_connections 2024-09-19T06:23:35.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:35.974+0000 7fea56800640 1 -- 172.21.15.3:0/3457419228 wait complete. 2024-09-19T06:23:36.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:35 smithi003 ceph-mon[30893]: pgmap v349: 97 pgs: 97 active+clean; 2.6 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 59 KiB/s wr, 22 op/s 2024-09-19T06:23:36.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:36 smithi059 ceph-mon[35138]: pgmap v349: 97 pgs: 97 active+clean; 2.6 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 59 KiB/s wr, 22 op/s 2024-09-19T06:23:36.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:36 smithi071 ceph-mon[35662]: pgmap v349: 97 pgs: 97 active+clean; 2.6 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 59 KiB/s wr, 22 op/s 2024-09-19T06:23:37.012 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:23:37.012 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:23:37.411 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.641+0000 7f29fd800640 1 -- 172.21.15.3:0/342226721 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29f8103f30 msgr2=0x7f29f8104310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.641+0000 7f29fd800640 1 --2- 172.21.15.3:0/342226721 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29f8103f30 0x7f29f8104310 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f29e8009900 tx=0x7f29e802a410 comp rx=0 tx=0).stop 2024-09-19T06:23:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.641+0000 7f29fd800640 1 -- 172.21.15.3:0/342226721 shutdown_connections 2024-09-19T06:23:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.641+0000 7f29fd800640 1 --2- 172.21.15.3:0/342226721 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29f8109080 0x7f29f8110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.641+0000 7f29fd800640 1 --2- 172.21.15.3:0/342226721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29f81048e0 0x7f29f8108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.641+0000 7f29fd800640 1 --2- 172.21.15.3:0/342226721 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29f8103f30 0x7f29f8104310 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.641+0000 7f29fd800640 1 -- 172.21.15.3:0/342226721 >> 172.21.15.3:0/342226721 conn(0x7f29f80ff980 msgr2=0x7f29f8101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.641+0000 7f29fd800640 1 -- 172.21.15.3:0/342226721 shutdown_connections 2024-09-19T06:23:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.641+0000 7f29fd800640 1 -- 172.21.15.3:0/342226721 wait complete. 2024-09-19T06:23:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.642+0000 7f29fd800640 1 Processor -- start 2024-09-19T06:23:37.647 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.642+0000 7f29fd800640 1 -- start start 2024-09-19T06:23:37.647 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.643+0000 7f29fd800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29f8103f30 0x7f29f819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.647 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.643+0000 7f29fd800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29f8109080 0x7f29f819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.647 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.643+0000 7f29fd800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29f819eed0 0x7f29f819f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.647 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.643+0000 7f29fd800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f29f8114120 con 0x7f29f819eed0 2024-09-19T06:23:37.647 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.643+0000 7f29fd800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f29f8113fa0 con 0x7f29f8109080 2024-09-19T06:23:37.647 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.643+0000 7f29fd800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f29f81142a0 con 0x7f29f8103f30 2024-09-19T06:23:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.643+0000 7f29f7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29f819eed0 0x7f29f819f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.643+0000 7f29f7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29f819eed0 0x7f29f819f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60924/0 (socket says 172.21.15.3:60924) 2024-09-19T06:23:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.643+0000 7f29f7400640 1 -- 172.21.15.3:0/1064545214 learned_addr learned my addr 172.21.15.3:0/1064545214 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.643+0000 7f29f6a00640 1 --2- 172.21.15.3:0/1064545214 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29f8103f30 0x7f29f819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.643+0000 7f29efe00640 1 --2- 172.21.15.3:0/1064545214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29f8109080 0x7f29f819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.644+0000 7f29f7400640 1 -- 172.21.15.3:0/1064545214 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29f8103f30 msgr2=0x7f29f819a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.644+0000 7f29f7400640 1 --2- 172.21.15.3:0/1064545214 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29f8103f30 0x7f29f819a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.644+0000 7f29f7400640 1 -- 172.21.15.3:0/1064545214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29f8109080 msgr2=0x7f29f819ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.644+0000 7f29f7400640 1 --2- 172.21.15.3:0/1064545214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29f8109080 0x7f29f819ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.644+0000 7f29f7400640 1 -- 172.21.15.3:0/1064545214 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f819f9c0 con 0x7f29f819eed0 2024-09-19T06:23:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.644+0000 7f29f7400640 1 --2- 172.21.15.3:0/1064545214 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29f819eed0 0x7f29f819f380 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f29f000eb10 tx=0x7f29f000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:37.648 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.644+0000 7f29ef400640 1 -- 172.21.15.3:0/1064545214 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0004b20 con 0x7f29f819eed0 2024-09-19T06:23:37.649 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.644+0000 7f29ef400640 1 -- 172.21.15.3:0/1064545214 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29f0004cc0 con 0x7f29f819eed0 2024-09-19T06:23:37.649 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.644+0000 7f29fd800640 1 -- 172.21.15.3:0/1064545214 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f819fcb0 con 0x7f29f819eed0 2024-09-19T06:23:37.649 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.644+0000 7f29ef400640 1 -- 172.21.15.3:0/1064545214 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0010760 con 0x7f29f819eed0 2024-09-19T06:23:37.649 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.644+0000 7f29fd800640 1 -- 172.21.15.3:0/1064545214 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f81a74a0 con 0x7f29f819eed0 2024-09-19T06:23:37.651 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.647+0000 7f2a007f9740 1 Processor -- start 2024-09-19T06:23:37.651 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.647+0000 7f29ef400640 1 -- 172.21.15.3:0/1064545214 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f29f0005020 con 0x7f29f819eed0 2024-09-19T06:23:37.651 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.647+0000 7f2a007f9740 1 -- start start 2024-09-19T06:23:37.651 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.648+0000 7f2a007f9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6a7cc41e0 0x55e6a7cc45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.651 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.648+0000 7f2a007f9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6a7cc4b00 0x55e6a7ccee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.648+0000 7f2a007f9740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7ccf3a0 0x55e6a7cd1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.648+0000 7f2a007f9740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e6a7c2a100 con 0x55e6a7ccf3a0 2024-09-19T06:23:37.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.648+0000 7f2a007f9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e6a7bd21b0 con 0x55e6a7cc41e0 2024-09-19T06:23:37.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.648+0000 7f2a007f9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e6a7c260c0 con 0x55e6a7cc4b00 2024-09-19T06:23:37.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.648+0000 7f29efe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7ccf3a0 0x55e6a7cd1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.648+0000 7f29efe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7ccf3a0 0x55e6a7cd1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60940/0 (socket says 172.21.15.3:60940) 2024-09-19T06:23:37.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.648+0000 7f29efe00640 1 -- 172.21.15.3:0/141010614 learned_addr learned my addr 172.21.15.3:0/141010614 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:37.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.648+0000 7f29f6a00640 1 --2- 172.21.15.3:0/141010614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6a7cc4b00 0x55e6a7ccee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.648+0000 7f29efe00640 1 --2- 172.21.15.3:0/141010614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6a7cc41e0 0x55e6a7cc45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.652 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.649+0000 7f29efe00640 1 -- 172.21.15.3:0/141010614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6a7cc4b00 msgr2=0x55e6a7ccee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.649+0000 7f29efe00640 1 --2- 172.21.15.3:0/141010614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6a7cc4b00 0x55e6a7ccee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.649+0000 7f29efe00640 1 -- 172.21.15.3:0/141010614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6a7cc41e0 msgr2=0x55e6a7cc45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.649+0000 7f29efe00640 1 --2- 172.21.15.3:0/141010614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6a7cc41e0 0x55e6a7cc45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.649+0000 7f29efe00640 1 -- 172.21.15.3:0/141010614 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6a793d210 con 0x55e6a7ccf3a0 2024-09-19T06:23:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.649+0000 7f29f6a00640 1 --2- 172.21.15.3:0/141010614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6a7cc4b00 0x55e6a7ccee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.649+0000 7f29efe00640 1 --2- 172.21.15.3:0/141010614 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7ccf3a0 0x55e6a7cd1790 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f29e00058c0 tx=0x7f29e0005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7159217edfe96839 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.649+0000 7f29ef400640 1 --2- 172.21.15.3:0/1064545214 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f29dc0a33b0 0x7f29dc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.649+0000 7f29ef400640 1 -- 172.21.15.3:0/1064545214 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7f29f00d03f0 con 0x7f29f819eed0 2024-09-19T06:23:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.649+0000 7f29e7e00640 1 -- 172.21.15.3:0/141010614 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e0004030 con 0x55e6a7ccf3a0 2024-09-19T06:23:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.649+0000 7f29e7e00640 1 -- 172.21.15.3:0/141010614 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29e000fc70 con 0x55e6a7ccf3a0 2024-09-19T06:23:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.649+0000 7f29f6a00640 1 --2- 172.21.15.3:0/1064545214 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f29dc0a33b0 0x7f29dc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.653 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.649+0000 7f29e7e00640 1 -- 172.21.15.3:0/141010614 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e0003a20 con 0x55e6a7ccf3a0 2024-09-19T06:23:37.660 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.650+0000 7f29f6a00640 1 --2- 172.21.15.3:0/1064545214 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f29dc0a33b0 0x7f29dc0a5870 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f29e8000c00 tx=0x7f29e8005b50 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:37.660 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.650+0000 7f2a007f9740 1 -- 172.21.15.3:0/141010614 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7ccf3a0 msgr2=0x55e6a7cd1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:37.660 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.650+0000 7f2a007f9740 1 --2- 172.21.15.3:0/141010614 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7ccf3a0 0x55e6a7cd1790 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f29e00058c0 tx=0x7f29e0005850 comp rx=0 tx=0).stop 2024-09-19T06:23:37.660 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.650+0000 7f2a007f9740 1 -- 172.21.15.3:0/141010614 shutdown_connections 2024-09-19T06:23:37.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.650+0000 7f2a007f9740 1 --2- 172.21.15.3:0/141010614 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7ccf3a0 0x55e6a7cd1790 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.650+0000 7f2a007f9740 1 --2- 172.21.15.3:0/141010614 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6a7cc4b00 0x55e6a7ccee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.650+0000 7f2a007f9740 1 --2- 172.21.15.3:0/141010614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6a7cc41e0 0x55e6a7cc45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.650+0000 7f2a007f9740 1 -- 172.21.15.3:0/141010614 >> 172.21.15.3:0/141010614 conn(0x55e6a7cc0750 msgr2=0x55e6a7cc0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:37.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.650+0000 7f2a007f9740 1 -- 172.21.15.3:0/141010614 shutdown_connections 2024-09-19T06:23:37.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.650+0000 7f2a007f9740 1 -- 172.21.15.3:0/141010614 wait complete. 2024-09-19T06:23:37.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.651+0000 7f2a007f9740 1 -- start start 2024-09-19T06:23:37.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.651+0000 7f2a007f9740 1 Processor -- start 2024-09-19T06:23:37.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.651+0000 7f2a007f9740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7cc41e0 0x55e6a7ccc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.651+0000 7f2a007f9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6a7cc4b00 0x55e6a7ccc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.651+0000 7f2a007f9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6a7ccf3a0 0x55e6a7cccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.651+0000 7f2a007f9740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e6a7cd1fc0 con 0x55e6a7cc41e0 2024-09-19T06:23:37.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.651+0000 7f2a007f9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e6a7bb3090 con 0x55e6a7cc4b00 2024-09-19T06:23:37.661 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.651+0000 7f2a007f9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e6a7cd2140 con 0x55e6a7ccf3a0 2024-09-19T06:23:37.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.651+0000 7f2a007f9740 10 client.0 _ll_register_callbacks cb 0x55e6a7c07f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:37.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.652+0000 7f29f6a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7cc41e0 0x55e6a7ccc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.652+0000 7f29f6a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7cc41e0 0x55e6a7ccc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60956/0 (socket says 172.21.15.3:60956) 2024-09-19T06:23:37.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.652+0000 7f29f6a00640 1 -- 172.21.15.3:0/3583686656 learned_addr learned my addr 172.21.15.3:0/3583686656 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:37.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.652+0000 7f29efe00640 1 --2- 172.21.15.3:0/3583686656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6a7cc4b00 0x55e6a7ccc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.652+0000 7f29f7400640 1 --2- 172.21.15.3:0/3583686656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6a7ccf3a0 0x55e6a7cccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.652+0000 7f29f6a00640 1 -- 172.21.15.3:0/3583686656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6a7ccf3a0 msgr2=0x55e6a7cccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:37.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.652+0000 7f29f6a00640 1 --2- 172.21.15.3:0/3583686656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6a7ccf3a0 0x55e6a7cccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.652+0000 7f29f6a00640 1 -- 172.21.15.3:0/3583686656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6a7cc4b00 msgr2=0x55e6a7ccc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:37.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.652+0000 7f29f6a00640 1 --2- 172.21.15.3:0/3583686656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6a7cc4b00 0x55e6a7ccc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.652+0000 7f29f6a00640 1 -- 172.21.15.3:0/3583686656 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6a7a09620 con 0x55e6a7cc41e0 2024-09-19T06:23:37.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.652+0000 7f29f6a00640 1 --2- 172.21.15.3:0/3583686656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7cc41e0 0x55e6a7ccc300 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f29e8033000 tx=0x7f29e8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c604fa5fc99299b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:37.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.652+0000 7f29e4c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:23:37.662 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.653+0000 7f29e4c00640 1 -- 172.21.15.3:0/3583686656 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e804e070 con 0x55e6a7cc41e0 2024-09-19T06:23:37.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.653+0000 7f2a007f9740 1 -- 172.21.15.3:0/3583686656 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29e000fc70 con 0x55e6a7cc41e0 2024-09-19T06:23:37.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.653+0000 7f29e4c00640 1 -- 172.21.15.3:0/3583686656 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7f29e80048c0 con 0x55e6a7cc41e0 2024-09-19T06:23:37.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.653+0000 7f29e4c00640 1 -- 172.21.15.3:0/3583686656 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f29e805a050 con 0x55e6a7cc41e0 2024-09-19T06:23:37.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.653+0000 7f2a007f9740 10 client.18489 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:37.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.653+0000 7f2a007f9740 1 -- 172.21.15.3:0/3583686656 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e6a7cddc60 con 0x55e6a7cc41e0 2024-09-19T06:23:37.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.653+0000 7f29e4c00640 1 -- 172.21.15.3:0/3583686656 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29e000fc70 con 0x55e6a7cc41e0 2024-09-19T06:23:37.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.653+0000 7f29e4c00640 1 -- 172.21.15.3:0/3583686656 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f29e80035f0 con 0x55e6a7cc41e0 2024-09-19T06:23:37.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.653+0000 7f2a007f9740 10 client.18489 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:37.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.653+0000 7f2a007f9740 10 client.18489 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:37.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.654+0000 7f2a007f9740 20 client.18489 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:37.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.654+0000 7f2a007f9740 1 --2- 172.21.15.3:0/3583686656 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e6a7cdf0d0 0x55e6a7ce14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.663 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.654+0000 7f2a007f9740 4 client.18489 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:37.664 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.654+0000 7f2a007f9740 1 -- 172.21.15.3:0/3583686656 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6a7c37830 con 0x55e6a7cdf0d0 2024-09-19T06:23:37.664 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.654+0000 7f29efe00640 1 --2- 172.21.15.3:0/3583686656 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e6a7cdf0d0 0x55e6a7ce14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.664 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.655+0000 7f29efe00640 1 --2- 172.21.15.3:0/3583686656 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e6a7cdf0d0 0x55e6a7ce14e0 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40050568933951f9 server_cookie=8d3443cd0fcfdca4 in_seq=0 out_seq=0 2024-09-19T06:23:37.664 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.655+0000 7f29e4c00640 10 client.18489 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:37.664 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.655+0000 7f29e4c00640 1 -- 172.21.15.3:0/3583686656 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e6a7c37830 con 0x55e6a7cdf0d0 2024-09-19T06:23:37.664 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.655+0000 7f29e4c00640 10 client.18489 handle_command_reply: tid=0 2024-09-19T06:23:37.664 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.655+0000 7f2a007f9740 1 client.18489 shutdown 2024-09-19T06:23:37.664 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.656+0000 7f2a007f9740 1 -- 172.21.15.3:0/3583686656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7cc41e0 msgr2=0x55e6a7ccc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:37.664 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.656+0000 7f2a007f9740 1 --2- 172.21.15.3:0/3583686656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7cc41e0 0x55e6a7ccc300 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f29e8033000 tx=0x7f29e8009260 comp rx=0 tx=0).stop 2024-09-19T06:23:37.664 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.656+0000 7f2a007f9740 1 -- 172.21.15.3:0/3583686656 shutdown_connections 2024-09-19T06:23:37.664 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.656+0000 7f2a007f9740 1 --2- 172.21.15.3:0/3583686656 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e6a7cdf0d0 0x55e6a7ce14e0 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.665 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.656+0000 7f2a007f9740 1 --2- 172.21.15.3:0/3583686656 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6a7ccf3a0 0x55e6a7cccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.665 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.656+0000 7f2a007f9740 1 --2- 172.21.15.3:0/3583686656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6a7cc4b00 0x55e6a7ccc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.665 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.656+0000 7f2a007f9740 1 --2- 172.21.15.3:0/3583686656 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7cc41e0 0x55e6a7ccc300 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.665 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.656+0000 7f29e4c00640 0 client.18489 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:37.665 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.656+0000 7f2a007f9740 1 -- 172.21.15.3:0/3583686656 >> 172.21.15.3:0/3583686656 conn(0x55e6a7cc0750 msgr2=0x55e6a7cc6460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:37.665 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.656+0000 7f2a007f9740 1 -- 172.21.15.3:0/3583686656 shutdown_connections 2024-09-19T06:23:37.665 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.656+0000 7f2a007f9740 1 -- 172.21.15.3:0/3583686656 wait complete. 2024-09-19T06:23:37.665 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.656+0000 7f2a007f9740 20 client.18489 trim_cache size 0 max 16384 2024-09-19T06:23:37.674 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.671+0000 7f2a007f9740 1 Processor -- start 2024-09-19T06:23:37.674 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.671+0000 7f2a007f9740 1 -- start start 2024-09-19T06:23:37.674 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.671+0000 7f2a007f9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6a7cc41e0 0x55e6a7cce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.674 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.671+0000 7f2a007f9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6a7cc4b00 0x55e6a7ce6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.674 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.671+0000 7f2a007f9740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7ccf3a0 0x55e6a7ce7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.674 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.671+0000 7f2a007f9740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f29f81afb30 con 0x55e6a7ccf3a0 2024-09-19T06:23:37.675 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.671+0000 7f2a007f9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f29f81b1670 con 0x55e6a7cc41e0 2024-09-19T06:23:37.675 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.671+0000 7f2a007f9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f29f81b0200 con 0x55e6a7cc4b00 2024-09-19T06:23:37.675 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.671+0000 7f29f6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6a7cc41e0 0x55e6a7cce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.675 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.671+0000 7f29f7400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7ccf3a0 0x55e6a7ce7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.675 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.671+0000 7f29f6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6a7cc41e0 0x55e6a7cce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:36826/0 (socket says 172.21.15.3:36826) 2024-09-19T06:23:37.675 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.671+0000 7f29f6a00640 1 -- 172.21.15.3:0/4015092409 learned_addr learned my addr 172.21.15.3:0/4015092409 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:37.675 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.672+0000 7f29efe00640 1 --2- 172.21.15.3:0/4015092409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6a7cc4b00 0x55e6a7ce6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.675 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.672+0000 7f29f7400640 1 -- 172.21.15.3:0/4015092409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6a7cc4b00 msgr2=0x55e6a7ce6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:37.675 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.672+0000 7f29f7400640 1 --2- 172.21.15.3:0/4015092409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6a7cc4b00 0x55e6a7ce6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.675 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.672+0000 7f29f7400640 1 -- 172.21.15.3:0/4015092409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6a7cc41e0 msgr2=0x55e6a7cce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.672+0000 7f29f7400640 1 --2- 172.21.15.3:0/4015092409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6a7cc41e0 0x55e6a7cce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.672+0000 7f29f7400640 1 -- 172.21.15.3:0/4015092409 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6a7cbbd60 con 0x55e6a7ccf3a0 2024-09-19T06:23:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.672+0000 7f29f6a00640 1 --2- 172.21.15.3:0/4015092409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6a7cc41e0 0x55e6a7cce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.672+0000 7f29f7400640 1 --2- 172.21.15.3:0/4015092409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7ccf3a0 0x55e6a7ce7330 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f29f00cdab0 tx=0x7f29f00989a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2b6d993da65b24 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.672+0000 7f29e7400640 1 -- 172.21.15.3:0/4015092409 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f00b4070 con 0x55e6a7ccf3a0 2024-09-19T06:23:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.672+0000 7f29e7400640 1 -- 172.21.15.3:0/4015092409 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29f009cd40 con 0x55e6a7ccf3a0 2024-09-19T06:23:37.676 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.672+0000 7f29e7400640 1 -- 172.21.15.3:0/4015092409 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0098cb0 con 0x55e6a7ccf3a0 2024-09-19T06:23:37.679 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.673+0000 7f2a007f9740 1 -- 172.21.15.3:0/4015092409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7ccf3a0 msgr2=0x55e6a7ce7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.673+0000 7f2a007f9740 1 --2- 172.21.15.3:0/4015092409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7ccf3a0 0x55e6a7ce7330 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f29f00cdab0 tx=0x7f29f00989a0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.673+0000 7f2a007f9740 1 -- 172.21.15.3:0/4015092409 shutdown_connections 2024-09-19T06:23:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.673+0000 7f2a007f9740 1 --2- 172.21.15.3:0/4015092409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7ccf3a0 0x55e6a7ce7330 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.673+0000 7f2a007f9740 1 --2- 172.21.15.3:0/4015092409 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6a7cc4b00 0x55e6a7ce6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.673+0000 7f2a007f9740 1 --2- 172.21.15.3:0/4015092409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6a7cc41e0 0x55e6a7cce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.673+0000 7f2a007f9740 1 -- 172.21.15.3:0/4015092409 >> 172.21.15.3:0/4015092409 conn(0x55e6a7cc0750 msgr2=0x55e6a7ccda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.673+0000 7f2a007f9740 1 -- 172.21.15.3:0/4015092409 shutdown_connections 2024-09-19T06:23:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.673+0000 7f2a007f9740 1 -- 172.21.15.3:0/4015092409 wait complete. 2024-09-19T06:23:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.673+0000 7f2a007f9740 1 -- start start 2024-09-19T06:23:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.674+0000 7f2a007f9740 1 Processor -- start 2024-09-19T06:23:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.674+0000 7f2a007f9740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7cc41e0 0x55e6a7cc9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.674+0000 7f2a007f9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6a7cc4b00 0x55e6a7cc9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.674+0000 7f2a007f9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6a7ccf3a0 0x55e6a7cc9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.674+0000 7f2a007f9740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f29f81b0fa0 con 0x55e6a7cc41e0 2024-09-19T06:23:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.674+0000 7f2a007f9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f29f81b08d0 con 0x55e6a7cc4b00 2024-09-19T06:23:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.674+0000 7f2a007f9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f29f81adb30 con 0x55e6a7ccf3a0 2024-09-19T06:23:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.674+0000 7f2a007f9740 10 client.0 _ll_register_callbacks cb 0x7f29e8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.674+0000 7f29f6a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7cc41e0 0x55e6a7cc9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.674+0000 7f29f6a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7cc41e0 0x55e6a7cc9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60968/0 (socket says 172.21.15.3:60968) 2024-09-19T06:23:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.674+0000 7f29f6a00640 1 -- 172.21.15.3:0/72195360 learned_addr learned my addr 172.21.15.3:0/72195360 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.674+0000 7f29f7400640 1 --2- 172.21.15.3:0/72195360 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6a7ccf3a0 0x55e6a7cc9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.674+0000 7f29efe00640 1 --2- 172.21.15.3:0/72195360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6a7cc4b00 0x55e6a7cc9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.675+0000 7f29f6a00640 1 -- 172.21.15.3:0/72195360 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6a7ccf3a0 msgr2=0x55e6a7cc9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.675+0000 7f29f6a00640 1 --2- 172.21.15.3:0/72195360 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6a7ccf3a0 0x55e6a7cc9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.675+0000 7f29f6a00640 1 -- 172.21.15.3:0/72195360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6a7cc4b00 msgr2=0x55e6a7cc9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.675+0000 7f29f6a00640 1 --2- 172.21.15.3:0/72195360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6a7cc4b00 0x55e6a7cc9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.675+0000 7f29f6a00640 1 -- 172.21.15.3:0/72195360 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6a7ccc0d0 con 0x55e6a7cc41e0 2024-09-19T06:23:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.675+0000 7f29f6a00640 1 --2- 172.21.15.3:0/72195360 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7cc41e0 0x55e6a7cc9420 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f29e8003bb0 tx=0x7f29e8003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c629ba0aa24be4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.675+0000 7f29e4c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:23:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.675+0000 7f29e4c00640 1 -- 172.21.15.3:0/72195360 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e804e040 con 0x55e6a7cc41e0 2024-09-19T06:23:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.675+0000 7f29e4c00640 1 -- 172.21.15.3:0/72195360 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7f29e8003c30 con 0x55e6a7cc41e0 2024-09-19T06:23:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.675+0000 7f2a007f9740 1 -- 172.21.15.3:0/72195360 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29f009cd40 con 0x55e6a7cc41e0 2024-09-19T06:23:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.676+0000 7f29e4c00640 1 -- 172.21.15.3:0/72195360 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f29e8035040 con 0x55e6a7cc41e0 2024-09-19T06:23:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.676+0000 7f2a007f9740 10 client.18495 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.676+0000 7f2a007f9740 1 -- 172.21.15.3:0/72195360 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e6a7d49fd0 con 0x55e6a7cc41e0 2024-09-19T06:23:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.676+0000 7f29e4c00640 1 -- 172.21.15.3:0/72195360 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29f009cd40 con 0x55e6a7cc41e0 2024-09-19T06:23:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.676+0000 7f29e4c00640 1 -- 172.21.15.3:0/72195360 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f29e806e070 con 0x55e6a7cc41e0 2024-09-19T06:23:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.676+0000 7f2a007f9740 10 client.18495 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.676+0000 7f2a007f9740 10 client.18495 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.676+0000 7f2a007f9740 20 client.18495 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.676+0000 7f2a007f9740 1 --2- 172.21.15.3:0/72195360 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e6a7d4a6d0 0x55e6a7d4caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.676+0000 7f2a007f9740 4 client.18495 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:23:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.676+0000 7f2a007f9740 1 -- 172.21.15.3:0/72195360 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e6a7c31b80 con 0x55e6a7d4a6d0 2024-09-19T06:23:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.677+0000 7f29efe00640 1 --2- 172.21.15.3:0/72195360 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e6a7d4a6d0 0x55e6a7d4caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.677+0000 7f29efe00640 1 --2- 172.21.15.3:0/72195360 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e6a7d4a6d0 0x55e6a7d4caf0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3066ac7c87f2466f server_cookie=639ae3fd0d720c8c in_seq=0 out_seq=0 2024-09-19T06:23:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.677+0000 7f29e4c00640 10 client.18495 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:37.694 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.692+0000 7f29e4c00640 1 -- 172.21.15.3:0/72195360 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e6a7c31b80 con 0x55e6a7d4a6d0 2024-09-19T06:23:37.694 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.692+0000 7f29e4c00640 10 client.18495 handle_command_reply: tid=0 2024-09-19T06:23:37.694 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.692+0000 7f2a007f9740 1 client.18495 shutdown 2024-09-19T06:23:37.694 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.692+0000 7f2a007f9740 1 -- 172.21.15.3:0/72195360 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7cc41e0 msgr2=0x55e6a7cc9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:37.694 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.692+0000 7f2a007f9740 1 --2- 172.21.15.3:0/72195360 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7cc41e0 0x55e6a7cc9420 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f29e8003bb0 tx=0x7f29e8003820 comp rx=0 tx=0).stop 2024-09-19T06:23:37.694 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.692+0000 7f2a007f9740 1 -- 172.21.15.3:0/72195360 shutdown_connections 2024-09-19T06:23:37.694 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.692+0000 7f2a007f9740 1 --2- 172.21.15.3:0/72195360 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e6a7d4a6d0 0x55e6a7d4caf0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.695 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.692+0000 7f2a007f9740 1 --2- 172.21.15.3:0/72195360 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e6a7ccf3a0 0x55e6a7cc9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.695 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.692+0000 7f2a007f9740 1 --2- 172.21.15.3:0/72195360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e6a7cc4b00 0x55e6a7cc9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.695 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.692+0000 7f2a007f9740 1 --2- 172.21.15.3:0/72195360 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e6a7cc41e0 0x55e6a7cc9420 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.695 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.692+0000 7f29e4c00640 0 client.18495 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:37.695 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.692+0000 7f2a007f9740 1 -- 172.21.15.3:0/72195360 >> 172.21.15.3:0/72195360 conn(0x55e6a7cc0750 msgr2=0x55e6a7cc5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:37.696 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.693+0000 7f2a007f9740 1 -- 172.21.15.3:0/72195360 shutdown_connections 2024-09-19T06:23:37.696 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.693+0000 7f2a007f9740 1 -- 172.21.15.3:0/72195360 wait complete. 2024-09-19T06:23:37.696 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.693+0000 7f2a007f9740 20 client.18495 trim_cache size 0 max 16384 2024-09-19T06:23:37.696 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:23:37.696 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:23:37.696 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:23:37.696 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:23:37.697 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.694+0000 7f29fd800640 1 -- 172.21.15.3:0/1064545214 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f29dc0a33b0 msgr2=0x7f29dc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:37.697 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.694+0000 7f29fd800640 1 --2- 172.21.15.3:0/1064545214 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f29dc0a33b0 0x7f29dc0a5870 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f29e8000c00 tx=0x7f29e8005b50 comp rx=0 tx=0).stop 2024-09-19T06:23:37.697 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.694+0000 7f29fd800640 1 -- 172.21.15.3:0/1064545214 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29f819eed0 msgr2=0x7f29f819f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:37.697 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.694+0000 7f29fd800640 1 --2- 172.21.15.3:0/1064545214 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29f819eed0 0x7f29f819f380 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f29f000eb10 tx=0x7f29f000c2d0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.697 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.694+0000 7f29fd800640 1 -- 172.21.15.3:0/1064545214 shutdown_connections 2024-09-19T06:23:37.697 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.694+0000 7f29fd800640 1 --2- 172.21.15.3:0/1064545214 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f29dc0a33b0 0x7f29dc0a5870 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.694+0000 7f29fd800640 1 --2- 172.21.15.3:0/1064545214 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f29f819eed0 0x7f29f819f380 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.694+0000 7f29fd800640 1 --2- 172.21.15.3:0/1064545214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29f8109080 0x7f29f819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.694+0000 7f29fd800640 1 --2- 172.21.15.3:0/1064545214 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f29f8103f30 0x7f29f819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:37.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.694+0000 7f29fd800640 1 -- 172.21.15.3:0/1064545214 >> 172.21.15.3:0/1064545214 conn(0x7f29f80ff980 msgr2=0x7f29f8100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:37.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.694+0000 7f29fd800640 1 -- 172.21.15.3:0/1064545214 shutdown_connections 2024-09-19T06:23:37.698 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:37.694+0000 7f29fd800640 1 -- 172.21.15.3:0/1064545214 wait complete. 2024-09-19T06:23:38.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.154+0000 7f7e18e00640 1 -- 172.21.15.3:0/335464858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7e14109140 msgr2=0x7f7e14110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:38.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.154+0000 7f7e18e00640 1 --2- 172.21.15.3:0/335464858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7e14109140 0x7f7e14110cc0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009ca0 tx=0x7f7e0c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.154+0000 7f7e18e00640 1 -- 172.21.15.3:0/335464858 shutdown_connections 2024-09-19T06:23:38.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.154+0000 7f7e18e00640 1 --2- 172.21.15.3:0/335464858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7e14109140 0x7f7e14110cc0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.154+0000 7f7e18e00640 1 --2- 172.21.15.3:0/335464858 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e141049c0 0x7f7e14108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.154+0000 7f7e18e00640 1 --2- 172.21.15.3:0/335464858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e14104010 0x7f7e141043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.154+0000 7f7e18e00640 1 -- 172.21.15.3:0/335464858 >> 172.21.15.3:0/335464858 conn(0x7f7e140ffa50 msgr2=0x7f7e14101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:38.156 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.154+0000 7f7e18e00640 1 -- 172.21.15.3:0/335464858 shutdown_connections 2024-09-19T06:23:38.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.154+0000 7f7e18e00640 1 -- 172.21.15.3:0/335464858 wait complete. 2024-09-19T06:23:38.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.155+0000 7f7e18e00640 1 Processor -- start 2024-09-19T06:23:38.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.155+0000 7f7e18e00640 1 -- start start 2024-09-19T06:23:38.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.155+0000 7f7e18e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7e14104010 0x7f7e1419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:38.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.155+0000 7f7e18e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e141049c0 0x7f7e1419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:38.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.155+0000 7f7e18e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e14109140 0x7f7e1419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:38.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.155+0000 7f7e18e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7e141141c0 con 0x7f7e14104010 2024-09-19T06:23:38.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.155+0000 7f7e18e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7e14114040 con 0x7f7e141049c0 2024-09-19T06:23:38.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.155+0000 7f7e18e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7e14114340 con 0x7f7e14109140 2024-09-19T06:23:38.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.156+0000 7f7e11e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7e14104010 0x7f7e1419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:38.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.156+0000 7f7e11e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7e14104010 0x7f7e1419a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60988/0 (socket says 172.21.15.3:60988) 2024-09-19T06:23:38.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.156+0000 7f7e11e00640 1 -- 172.21.15.3:0/1198613378 learned_addr learned my addr 172.21.15.3:0/1198613378 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:38.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.156+0000 7f7e11400640 1 --2- 172.21.15.3:0/1198613378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e141049c0 0x7f7e1419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:38.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.156+0000 7f7e12800640 1 --2- 172.21.15.3:0/1198613378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e14109140 0x7f7e1419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:38.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.156+0000 7f7e11400640 1 -- 172.21.15.3:0/1198613378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e14109140 msgr2=0x7f7e1419ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:38.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.156+0000 7f7e11400640 1 --2- 172.21.15.3:0/1198613378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e14109140 0x7f7e1419ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.156+0000 7f7e11400640 1 -- 172.21.15.3:0/1198613378 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7e14104010 msgr2=0x7f7e1419a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:38.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.156+0000 7f7e11400640 1 --2- 172.21.15.3:0/1198613378 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7e14104010 0x7f7e1419a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.156+0000 7f7e11400640 1 -- 172.21.15.3:0/1198613378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1419f670 con 0x7f7e141049c0 2024-09-19T06:23:38.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.156+0000 7f7e11400640 1 --2- 172.21.15.3:0/1198613378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e141049c0 0x7f7e1419ac00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000e9f0 tx=0x7f7e0000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:38.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.157+0000 7f7e0aa00640 1 -- 172.21.15.3:0/1198613378 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0000ccc0 con 0x7f7e141049c0 2024-09-19T06:23:38.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.157+0000 7f7e0aa00640 1 -- 172.21.15.3:0/1198613378 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e00005020 con 0x7f7e141049c0 2024-09-19T06:23:38.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.157+0000 7f7e18e00640 1 -- 172.21.15.3:0/1198613378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e1419f960 con 0x7f7e141049c0 2024-09-19T06:23:38.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.157+0000 7f7e0aa00640 1 -- 172.21.15.3:0/1198613378 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e000049e0 con 0x7f7e141049c0 2024-09-19T06:23:38.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.157+0000 7f7e18e00640 1 -- 172.21.15.3:0/1198613378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e141a7240 con 0x7f7e141049c0 2024-09-19T06:23:38.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.158+0000 7f7e18e00640 1 -- 172.21.15.3:0/1198613378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e141043f0 con 0x7f7e141049c0 2024-09-19T06:23:38.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.160+0000 7f7e0aa00640 1 -- 172.21.15.3:0/1198613378 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f7e00005560 con 0x7f7e141049c0 2024-09-19T06:23:38.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.162+0000 7f7e0aa00640 1 --2- 172.21.15.3:0/1198613378 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7df80a33b0 0x7f7df80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:38.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.162+0000 7f7e0aa00640 1 -- 172.21.15.3:0/1198613378 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7f7e000cfca0 con 0x7f7e141049c0 2024-09-19T06:23:38.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.162+0000 7f7e11e00640 1 --2- 172.21.15.3:0/1198613378 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7df80a33b0 0x7f7df80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:38.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.163+0000 7f7e11e00640 1 --2- 172.21.15.3:0/1198613378 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7df80a33b0 0x7f7df80a5870 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009c90 tx=0x7f7e04005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:38.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.165+0000 7f7e0aa00640 1 -- 172.21.15.3:0/1198613378 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7e000051d0 con 0x7f7e141049c0 2024-09-19T06:23:38.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:38 smithi059 ceph-mon[35138]: pgmap v350: 97 pgs: 97 active+clean; 2.6 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:23:38.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:38 smithi003 ceph-mon[30893]: pgmap v350: 97 pgs: 97 active+clean; 2.6 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:23:38.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:38 smithi071 ceph-mon[35662]: pgmap v350: 97 pgs: 97 active+clean; 2.6 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:23:38.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.391+0000 7f7e18e00640 1 -- 172.21.15.3:0/1198613378 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e1410bdf0 con 0x7f7e141049c0 2024-09-19T06:23:38.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.393+0000 7f7e0aa00640 1 -- 172.21.15.3:0/1198613378 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7f7e0009c5f0 con 0x7f7e141049c0 2024-09-19T06:23:38.395 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:23:38.395 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"btime":"2024-09-19T06:12:22:958217+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:12:22.060987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24532,24515,24514,14517]},"id":1}]} 2024-09-19T06:23:38.395 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2024-09-19T06:23:38.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.395+0000 7f7e18e00640 1 -- 172.21.15.3:0/1198613378 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7df80a33b0 msgr2=0x7f7df80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:38.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.395+0000 7f7e18e00640 1 --2- 172.21.15.3:0/1198613378 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7df80a33b0 0x7f7df80a5870 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009c90 tx=0x7f7e04005f90 comp rx=0 tx=0).stop 2024-09-19T06:23:38.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.395+0000 7f7e18e00640 1 -- 172.21.15.3:0/1198613378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e141049c0 msgr2=0x7f7e1419ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:38.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.395+0000 7f7e18e00640 1 --2- 172.21.15.3:0/1198613378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e141049c0 0x7f7e1419ac00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000e9f0 tx=0x7f7e0000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.395+0000 7f7e18e00640 1 -- 172.21.15.3:0/1198613378 shutdown_connections 2024-09-19T06:23:38.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.395+0000 7f7e18e00640 1 --2- 172.21.15.3:0/1198613378 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7df80a33b0 0x7f7df80a5870 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.395+0000 7f7e18e00640 1 --2- 172.21.15.3:0/1198613378 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7e14109140 0x7f7e1419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.395+0000 7f7e18e00640 1 --2- 172.21.15.3:0/1198613378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e141049c0 0x7f7e1419ac00 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.395+0000 7f7e18e00640 1 --2- 172.21.15.3:0/1198613378 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7e14104010 0x7f7e1419a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:38.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.395+0000 7f7e18e00640 1 -- 172.21.15.3:0/1198613378 >> 172.21.15.3:0/1198613378 conn(0x7f7e140ffa50 msgr2=0x7f7e14100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:38.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.395+0000 7f7e18e00640 1 -- 172.21.15.3:0/1198613378 shutdown_connections 2024-09-19T06:23:38.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:38.396+0000 7f7e18e00640 1 -- 172.21.15.3:0/1198613378 wait complete. 2024-09-19T06:23:39.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:39 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1198613378' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:23:39.226 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:23:39.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:39 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1198613378' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:23:39.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:39 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1198613378' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:23:39.608 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:40.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:40 smithi059 ceph-mon[35138]: pgmap v351: 97 pgs: 97 active+clean; 2.8 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 66 KiB/s wr, 25 op/s 2024-09-19T06:23:40.307 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:40 smithi003 ceph-mon[30893]: pgmap v351: 97 pgs: 97 active+clean; 2.8 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 66 KiB/s wr, 25 op/s 2024-09-19T06:23:40.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:40 smithi071 ceph-mon[35662]: pgmap v351: 97 pgs: 97 active+clean; 2.8 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 66 KiB/s wr, 25 op/s 2024-09-19T06:23:40.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.305+0000 7ff1edc00640 1 -- 172.21.15.3:0/1482920277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1e8108f60 msgr2=0x7ff1e8110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:40.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.305+0000 7ff1edc00640 1 --2- 172.21.15.3:0/1482920277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1e8108f60 0x7ff1e8110ae0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0009be0 tx=0x7ff1e002a6c0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.305+0000 7ff1edc00640 1 -- 172.21.15.3:0/1482920277 shutdown_connections 2024-09-19T06:23:40.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.305+0000 7ff1edc00640 1 --2- 172.21.15.3:0/1482920277 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1e8108f60 0x7ff1e8110ae0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.305+0000 7ff1edc00640 1 --2- 172.21.15.3:0/1482920277 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1e81047e0 0x7ff1e8108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.305+0000 7ff1edc00640 1 --2- 172.21.15.3:0/1482920277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1e8103e30 0x7ff1e8104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.305+0000 7ff1edc00640 1 -- 172.21.15.3:0/1482920277 >> 172.21.15.3:0/1482920277 conn(0x7ff1e80ff8d0 msgr2=0x7ff1e8101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:40.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.305+0000 7ff1edc00640 1 -- 172.21.15.3:0/1482920277 shutdown_connections 2024-09-19T06:23:40.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.305+0000 7ff1edc00640 1 -- 172.21.15.3:0/1482920277 wait complete. 2024-09-19T06:23:40.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.306+0000 7ff1edc00640 1 Processor -- start 2024-09-19T06:23:40.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.306+0000 7ff1edc00640 1 -- start start 2024-09-19T06:23:40.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.306+0000 7ff1edc00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1e8103e30 0x7ff1e819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.306+0000 7ff1edc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1e81047e0 0x7ff1e819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.307+0000 7ff1edc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1e8108f60 0x7ff1e819ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.307+0000 7ff1edc00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e8113f70 con 0x7ff1e81047e0 2024-09-19T06:23:40.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.307+0000 7ff1edc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e8113df0 con 0x7ff1e8108f60 2024-09-19T06:23:40.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.307+0000 7ff1edc00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e81140f0 con 0x7ff1e8103e30 2024-09-19T06:23:40.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.307+0000 7ff1df400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1e81047e0 0x7ff1e819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.307+0000 7ff1e7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1e8103e30 0x7ff1e819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.372 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.307+0000 7ff1e7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1e8103e30 0x7ff1e819a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:34494/0 (socket says 172.21.15.3:34494) 2024-09-19T06:23:40.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.307+0000 7ff1e7e00640 1 -- 172.21.15.3:0/3910648088 learned_addr learned my addr 172.21.15.3:0/3910648088 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:40.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.307+0000 7ff1ed200640 1 --2- 172.21.15.3:0/3910648088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1e8108f60 0x7ff1e819ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.307+0000 7ff1e7e00640 1 -- 172.21.15.3:0/3910648088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1e8108f60 msgr2=0x7ff1e819ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:40.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.307+0000 7ff1e7e00640 1 --2- 172.21.15.3:0/3910648088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1e8108f60 0x7ff1e819ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.307+0000 7ff1e7e00640 1 -- 172.21.15.3:0/3910648088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1e81047e0 msgr2=0x7ff1e819a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:40.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.307+0000 7ff1e7e00640 1 --2- 172.21.15.3:0/3910648088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1e81047e0 0x7ff1e819a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.307+0000 7ff1e7e00640 1 -- 172.21.15.3:0/3910648088 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e819f3e0 con 0x7ff1e8103e30 2024-09-19T06:23:40.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.307+0000 7ff1ed200640 1 --2- 172.21.15.3:0/3910648088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1e8108f60 0x7ff1e819ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:40.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.308+0000 7ff1e7e00640 1 --2- 172.21.15.3:0/3910648088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1e8103e30 0x7ff1e819a430 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800e9c0 tx=0x7ff1d800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:40.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.308+0000 7ff1e5600640 1 -- 172.21.15.3:0/3910648088 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d800cde0 con 0x7ff1e8103e30 2024-09-19T06:23:40.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.308+0000 7ff1e5600640 1 -- 172.21.15.3:0/3910648088 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1d80035f0 con 0x7ff1e8103e30 2024-09-19T06:23:40.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.308+0000 7ff1e5600640 1 -- 172.21.15.3:0/3910648088 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8010690 con 0x7ff1e8103e30 2024-09-19T06:23:40.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.308+0000 7ff1edc00640 1 -- 172.21.15.3:0/3910648088 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e819f6d0 con 0x7ff1e8103e30 2024-09-19T06:23:40.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.308+0000 7ff1edc00640 1 -- 172.21.15.3:0/3910648088 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e81a6fb0 con 0x7ff1e8103e30 2024-09-19T06:23:40.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.311+0000 7ff1f1c83740 1 Processor -- start 2024-09-19T06:23:40.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.311+0000 7ff1f1c83740 1 -- start start 2024-09-19T06:23:40.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.311+0000 7ff1e5600640 1 -- 172.21.15.3:0/3910648088 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7ff1d80037a0 con 0x7ff1e8103e30 2024-09-19T06:23:40.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.311+0000 7ff1f1c83740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18be40 0x55ce5d18c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.312+0000 7ff1f1c83740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d18c760 0x55ce5d196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.312+0000 7ff1f1c83740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce5d197020 0x55ce5d199410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.312+0000 7ff1f1c83740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ce5d0f23e0 con 0x55ce5d18be40 2024-09-19T06:23:40.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.312+0000 7ff1f1c83740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ce5d099d80 con 0x55ce5d197020 2024-09-19T06:23:40.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.312+0000 7ff1f1c83740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ce5d0ee3a0 con 0x55ce5d18c760 2024-09-19T06:23:40.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.312+0000 7ff1df400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce5d197020 0x55ce5d199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.312+0000 7ff1ed200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18be40 0x55ce5d18c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.312+0000 7ff1e7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d18c760 0x55ce5d196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.312+0000 7ff1df400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce5d197020 0x55ce5d199410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:36874/0 (socket says 172.21.15.3:36874) 2024-09-19T06:23:40.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.312+0000 7ff1df400640 1 -- 172.21.15.3:0/2554580891 learned_addr learned my addr 172.21.15.3:0/2554580891 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:40.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.313+0000 7ff1e7e00640 1 -- 172.21.15.3:0/2554580891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce5d197020 msgr2=0x55ce5d199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:40.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.313+0000 7ff1e7e00640 1 --2- 172.21.15.3:0/2554580891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce5d197020 0x55ce5d199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.313+0000 7ff1e7e00640 1 -- 172.21.15.3:0/2554580891 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18be40 msgr2=0x55ce5d18c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:40.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.313+0000 7ff1e7e00640 1 --2- 172.21.15.3:0/2554580891 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18be40 0x55ce5d18c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.313+0000 7ff1e7e00640 1 -- 172.21.15.3:0/2554580891 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce5d0b8ae0 con 0x55ce5d18c760 2024-09-19T06:23:40.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.313+0000 7ff1ed200640 1 --2- 172.21.15.3:0/2554580891 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18be40 0x55ce5d18c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:40.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.313+0000 7ff1e7e00640 1 --2- 172.21.15.3:0/2554580891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d18c760 0x55ce5d196ae0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80cd7a0 tx=0x7ff1d80d85f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32915c2c80302188 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:40.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.314+0000 7ff1e5600640 1 --2- 172.21.15.3:0/3910648088 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff1cc0a3430 0x7ff1cc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.314+0000 7ff1dd600640 1 -- 172.21.15.3:0/2554580891 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d80e3070 con 0x55ce5d18c760 2024-09-19T06:23:40.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.314+0000 7ff1e5600640 1 -- 172.21.15.3:0/3910648088 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7ff1d80d00e0 con 0x7ff1e8103e30 2024-09-19T06:23:40.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.314+0000 7ff1ed200640 1 --2- 172.21.15.3:0/3910648088 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff1cc0a3430 0x7ff1cc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.314+0000 7ff1dd600640 1 -- 172.21.15.3:0/2554580891 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1d809ca30 con 0x55ce5d18c760 2024-09-19T06:23:40.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.314+0000 7ff1dd600640 1 -- 172.21.15.3:0/2554580891 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d809c100 con 0x55ce5d18c760 2024-09-19T06:23:40.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.315+0000 7ff1ed200640 1 --2- 172.21.15.3:0/3910648088 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff1cc0a3430 0x7ff1cc0a58f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0004af0 tx=0x7ff1e0004a40 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:40.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.315+0000 7ff1f1c83740 1 -- 172.21.15.3:0/2554580891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d18c760 msgr2=0x55ce5d196ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:40.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.315+0000 7ff1f1c83740 1 --2- 172.21.15.3:0/2554580891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d18c760 0x55ce5d196ae0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff1d80cd7a0 tx=0x7ff1d80d85f0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.315+0000 7ff1f1c83740 1 -- 172.21.15.3:0/2554580891 shutdown_connections 2024-09-19T06:23:40.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.315+0000 7ff1f1c83740 1 --2- 172.21.15.3:0/2554580891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce5d197020 0x55ce5d199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.315+0000 7ff1f1c83740 1 --2- 172.21.15.3:0/2554580891 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d18c760 0x55ce5d196ae0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.315+0000 7ff1f1c83740 1 --2- 172.21.15.3:0/2554580891 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18be40 0x55ce5d18c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.315+0000 7ff1f1c83740 1 -- 172.21.15.3:0/2554580891 >> 172.21.15.3:0/2554580891 conn(0x55ce5d1883d0 msgr2=0x55ce5d1887b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:40.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.315+0000 7ff1f1c83740 1 -- 172.21.15.3:0/2554580891 shutdown_connections 2024-09-19T06:23:40.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.315+0000 7ff1f1c83740 1 -- 172.21.15.3:0/2554580891 wait complete. 2024-09-19T06:23:40.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.316+0000 7ff1f1c83740 1 -- start start 2024-09-19T06:23:40.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.316+0000 7ff1f1c83740 1 Processor -- start 2024-09-19T06:23:40.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.317+0000 7ff1f1c83740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d18be40 0x55ce5d193f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.317+0000 7ff1f1c83740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18c760 0x55ce5d194440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.317+0000 7ff1f1c83740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce5d197020 0x55ce5d194980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.317+0000 7ff1f1c83740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ce5d199bf0 con 0x55ce5d18c760 2024-09-19T06:23:40.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.317+0000 7ff1f1c83740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ce5d0ad0f0 con 0x55ce5d197020 2024-09-19T06:23:40.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.317+0000 7ff1f1c83740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ce5d199d70 con 0x55ce5d18be40 2024-09-19T06:23:40.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.317+0000 7ff1f1c83740 10 client.0 _ll_register_callbacks cb 0x55ce5d094bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:40.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.317+0000 7ff1e7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d18be40 0x55ce5d193f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.317+0000 7ff1df400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18c760 0x55ce5d194440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.377 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.317+0000 7ff1e7e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d18be40 0x55ce5d193f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:34520/0 (socket says 172.21.15.3:34520) 2024-09-19T06:23:40.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.317+0000 7ff1e7e00640 1 -- 172.21.15.3:0/1371931853 learned_addr learned my addr 172.21.15.3:0/1371931853 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:40.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.317+0000 7ff1df400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18c760 0x55ce5d194440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32796/0 (socket says 172.21.15.3:32796) 2024-09-19T06:23:40.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.317+0000 7ff1ed200640 1 --2- 172.21.15.3:0/1371931853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce5d197020 0x55ce5d194980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.318+0000 7ff1e7e00640 1 -- 172.21.15.3:0/1371931853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce5d197020 msgr2=0x55ce5d194980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:40.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.318+0000 7ff1e7e00640 1 --2- 172.21.15.3:0/1371931853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce5d197020 0x55ce5d194980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.318+0000 7ff1e7e00640 1 -- 172.21.15.3:0/1371931853 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18c760 msgr2=0x55ce5d194440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:40.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.318+0000 7ff1e7e00640 1 --2- 172.21.15.3:0/1371931853 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18c760 0x55ce5d194440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.318+0000 7ff1e7e00640 1 -- 172.21.15.3:0/1371931853 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce5ce633c0 con 0x55ce5d18be40 2024-09-19T06:23:40.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.318+0000 7ff1e7e00640 1 --2- 172.21.15.3:0/1371931853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d18be40 0x55ce5d193f00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff1d809c2c0 tx=0x7ff1d8003e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e87eb48e0b089baa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:40.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.318+0000 7ff1d6000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:23:40.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.318+0000 7ff1d6000640 1 -- 172.21.15.3:0/1371931853 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d809bc90 con 0x55ce5d18be40 2024-09-19T06:23:40.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.318+0000 7ff1f1c83740 1 -- 172.21.15.3:0/1371931853 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1d809ca30 con 0x55ce5d18be40 2024-09-19T06:23:40.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.318+0000 7ff1d6000640 1 -- 172.21.15.3:0/1371931853 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7ff1d80cda20 con 0x55ce5d18be40 2024-09-19T06:23:40.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.318+0000 7ff1d6000640 1 -- 172.21.15.3:0/1371931853 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff1d809be70 con 0x55ce5d18be40 2024-09-19T06:23:40.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.318+0000 7ff1f1c83740 10 client.28522 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:40.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.318+0000 7ff1f1c83740 1 -- 172.21.15.3:0/1371931853 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ce5d199bf0 con 0x55ce5d18be40 2024-09-19T06:23:40.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.319+0000 7ff1d6000640 1 -- 172.21.15.3:0/1371931853 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1d809ca30 con 0x55ce5d18be40 2024-09-19T06:23:40.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.319+0000 7ff1d6000640 1 -- 172.21.15.3:0/1371931853 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff1d80b5100 con 0x55ce5d18be40 2024-09-19T06:23:40.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.319+0000 7ff1f1c83740 10 client.28522 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:40.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.319+0000 7ff1f1c83740 10 client.28522 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:23:40.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.319+0000 7ff1f1c83740 20 client.28522 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:40.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.319+0000 7ff1f1c83740 1 --2- 172.21.15.3:0/1371931853 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55ce5d1a6de0 0x55ce5d1a91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.319+0000 7ff1f1c83740 4 client.28522 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:40.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.319+0000 7ff1f1c83740 1 -- 172.21.15.3:0/1371931853 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce5d0ff950 con 0x55ce5d1a6de0 2024-09-19T06:23:40.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.319+0000 7ff1df400640 1 --2- 172.21.15.3:0/1371931853 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55ce5d1a6de0 0x55ce5d1a91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.379 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.320+0000 7ff1df400640 1 --2- 172.21.15.3:0/1371931853 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55ce5d1a6de0 0x55ce5d1a91d0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bec0dbacd42bd7dd server_cookie=d45601fd63e4b612 in_seq=0 out_seq=0 2024-09-19T06:23:40.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.320+0000 7ff1d6000640 10 client.28522 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:23:40.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.321+0000 7ff1d6000640 1 -- 172.21.15.3:0/1371931853 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ce5d0ff950 con 0x55ce5d1a6de0 2024-09-19T06:23:40.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.321+0000 7ff1d6000640 10 client.28522 handle_command_reply: tid=0 2024-09-19T06:23:40.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.321+0000 7ff1f1c83740 1 client.28522 shutdown 2024-09-19T06:23:40.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.321+0000 7ff1f1c83740 1 -- 172.21.15.3:0/1371931853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d18be40 msgr2=0x55ce5d193f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:40.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.321+0000 7ff1f1c83740 1 --2- 172.21.15.3:0/1371931853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d18be40 0x55ce5d193f00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff1d809c2c0 tx=0x7ff1d8003e10 comp rx=0 tx=0).stop 2024-09-19T06:23:40.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.321+0000 7ff1f1c83740 1 -- 172.21.15.3:0/1371931853 shutdown_connections 2024-09-19T06:23:40.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.321+0000 7ff1f1c83740 1 --2- 172.21.15.3:0/1371931853 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55ce5d1a6de0 0x55ce5d1a91d0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.321+0000 7ff1f1c83740 1 --2- 172.21.15.3:0/1371931853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce5d197020 0x55ce5d194980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.321+0000 7ff1d6000640 0 client.28522 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:23:40.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.321+0000 7ff1f1c83740 1 --2- 172.21.15.3:0/1371931853 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18c760 0x55ce5d194440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.380 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.321+0000 7ff1f1c83740 1 --2- 172.21.15.3:0/1371931853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d18be40 0x55ce5d193f00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.321+0000 7ff1f1c83740 1 -- 172.21.15.3:0/1371931853 >> 172.21.15.3:0/1371931853 conn(0x55ce5d1883d0 msgr2=0x55ce5d18e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:40.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.321+0000 7ff1f1c83740 1 -- 172.21.15.3:0/1371931853 shutdown_connections 2024-09-19T06:23:40.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.321+0000 7ff1f1c83740 1 -- 172.21.15.3:0/1371931853 wait complete. 2024-09-19T06:23:40.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.322+0000 7ff1f1c83740 20 client.28522 trim_cache size 0 max 16384 2024-09-19T06:23:40.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.335+0000 7ff1f1c83740 1 Processor -- start 2024-09-19T06:23:40.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.336+0000 7ff1f1c83740 1 -- start start 2024-09-19T06:23:40.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.336+0000 7ff1f1c83740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce5d18be40 0x55ce5d195e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.336+0000 7ff1f1c83740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18c760 0x55ce5d1ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.336+0000 7ff1f1c83740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d197020 0x55ce5d1aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.336+0000 7ff1f1c83740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e81afa90 con 0x55ce5d18c760 2024-09-19T06:23:40.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.336+0000 7ff1f1c83740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e81b15d0 con 0x55ce5d18be40 2024-09-19T06:23:40.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.336+0000 7ff1f1c83740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e81b0160 con 0x55ce5d197020 2024-09-19T06:23:40.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.336+0000 7ff1df400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18c760 0x55ce5d1ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.336+0000 7ff1df400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18c760 0x55ce5d1ae9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32808/0 (socket says 172.21.15.3:32808) 2024-09-19T06:23:40.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.336+0000 7ff1df400640 1 -- 172.21.15.3:0/2656908552 learned_addr learned my addr 172.21.15.3:0/2656908552 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:40.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.336+0000 7ff1e7e00640 1 --2- 172.21.15.3:0/2656908552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce5d18be40 0x55ce5d195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.336+0000 7ff1ed200640 1 --2- 172.21.15.3:0/2656908552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d197020 0x55ce5d1aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.337+0000 7ff1df400640 1 -- 172.21.15.3:0/2656908552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d197020 msgr2=0x55ce5d1aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:40.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.337+0000 7ff1df400640 1 --2- 172.21.15.3:0/2656908552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d197020 0x55ce5d1aeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.337+0000 7ff1df400640 1 -- 172.21.15.3:0/2656908552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce5d18be40 msgr2=0x55ce5d195e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:40.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.337+0000 7ff1df400640 1 --2- 172.21.15.3:0/2656908552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce5d18be40 0x55ce5d195e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.337+0000 7ff1df400640 1 -- 172.21.15.3:0/2656908552 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce5d188200 con 0x55ce5d18c760 2024-09-19T06:23:40.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.337+0000 7ff1e7e00640 1 --2- 172.21.15.3:0/2656908552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce5d18be40 0x55ce5d195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:40.382 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.337+0000 7ff1df400640 1 --2- 172.21.15.3:0/2656908552 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18c760 0x55ce5d1ae9a0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x55ce5d189750 tx=0x7ff1d0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edaac364955cae79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:40.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.337+0000 7ff1dcc00640 1 -- 172.21.15.3:0/2656908552 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0005220 con 0x55ce5d18c760 2024-09-19T06:23:40.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.337+0000 7ff1dcc00640 1 -- 172.21.15.3:0/2656908552 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1d0004c80 con 0x55ce5d18c760 2024-09-19T06:23:40.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.337+0000 7ff1dcc00640 1 -- 172.21.15.3:0/2656908552 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d001eb40 con 0x55ce5d18c760 2024-09-19T06:23:40.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.338+0000 7ff1f1c83740 1 -- 172.21.15.3:0/2656908552 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18c760 msgr2=0x55ce5d1ae9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:40.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.338+0000 7ff1f1c83740 1 --2- 172.21.15.3:0/2656908552 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18c760 0x55ce5d1ae9a0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x55ce5d189750 tx=0x7ff1d0005f90 comp rx=0 tx=0).stop 2024-09-19T06:23:40.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.338+0000 7ff1f1c83740 1 -- 172.21.15.3:0/2656908552 shutdown_connections 2024-09-19T06:23:40.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.338+0000 7ff1f1c83740 1 --2- 172.21.15.3:0/2656908552 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d197020 0x55ce5d1aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.338+0000 7ff1f1c83740 1 --2- 172.21.15.3:0/2656908552 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18c760 0x55ce5d1ae9a0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.338+0000 7ff1f1c83740 1 --2- 172.21.15.3:0/2656908552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce5d18be40 0x55ce5d195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.338+0000 7ff1f1c83740 1 -- 172.21.15.3:0/2656908552 >> 172.21.15.3:0/2656908552 conn(0x55ce5d1883d0 msgr2=0x55ce5d195760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:40.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.338+0000 7ff1f1c83740 1 -- 172.21.15.3:0/2656908552 shutdown_connections 2024-09-19T06:23:40.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.338+0000 7ff1f1c83740 1 -- 172.21.15.3:0/2656908552 wait complete. 2024-09-19T06:23:40.383 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.338+0000 7ff1f1c83740 1 -- start start 2024-09-19T06:23:40.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.339+0000 7ff1f1c83740 1 Processor -- start 2024-09-19T06:23:40.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.339+0000 7ff1f1c83740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce5d18be40 0x55ce5d19ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.339+0000 7ff1f1c83740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18c760 0x55ce5d19b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.339+0000 7ff1f1c83740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d197020 0x55ce5d19b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.339+0000 7ff1f1c83740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e81b0f00 con 0x55ce5d18c760 2024-09-19T06:23:40.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.339+0000 7ff1f1c83740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e81b0830 con 0x55ce5d18be40 2024-09-19T06:23:40.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.339+0000 7ff1f1c83740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e81ada90 con 0x55ce5d197020 2024-09-19T06:23:40.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.339+0000 7ff1f1c83740 10 client.0 _ll_register_callbacks cb 0x7ff1d80e1070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:40.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.339+0000 7ff1ed200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d197020 0x55ce5d19b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.339+0000 7ff1df400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18c760 0x55ce5d19b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.339+0000 7ff1ed200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d197020 0x55ce5d19b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:34540/0 (socket says 172.21.15.3:34540) 2024-09-19T06:23:40.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.339+0000 7ff1ed200640 1 -- 172.21.15.3:0/956418660 learned_addr learned my addr 172.21.15.3:0/956418660 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:40.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.339+0000 7ff1e7e00640 1 --2- 172.21.15.3:0/956418660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce5d18be40 0x55ce5d19ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.340+0000 7ff1ed200640 1 -- 172.21.15.3:0/956418660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce5d18be40 msgr2=0x55ce5d19ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:40.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.340+0000 7ff1ed200640 1 --2- 172.21.15.3:0/956418660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce5d18be40 0x55ce5d19ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.340+0000 7ff1ed200640 1 -- 172.21.15.3:0/956418660 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18c760 msgr2=0x55ce5d19b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:40.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.340+0000 7ff1ed200640 1 --2- 172.21.15.3:0/956418660 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18c760 0x55ce5d19b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.340+0000 7ff1ed200640 1 -- 172.21.15.3:0/956418660 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce5d210a70 con 0x55ce5d197020 2024-09-19T06:23:40.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.340+0000 7ff1df400640 1 --2- 172.21.15.3:0/956418660 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18c760 0x55ce5d19b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:40.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.340+0000 7ff1ed200640 1 --2- 172.21.15.3:0/956418660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d197020 0x55ce5d19b8d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0033000 tx=0x7ff1e002a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9709218254cbddb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:40.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.340+0000 7ff1d6000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:23:40.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.340+0000 7ff1d6000640 1 -- 172.21.15.3:0/956418660 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0036040 con 0x55ce5d197020 2024-09-19T06:23:40.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.341+0000 7ff1f1c83740 1 -- 172.21.15.3:0/956418660 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1d0004c80 con 0x55ce5d197020 2024-09-19T06:23:40.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.341+0000 7ff1d6000640 1 -- 172.21.15.3:0/956418660 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7ff1e00043c0 con 0x55ce5d197020 2024-09-19T06:23:40.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.341+0000 7ff1d6000640 1 -- 172.21.15.3:0/956418660 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff1e00045c0 con 0x55ce5d197020 2024-09-19T06:23:40.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.341+0000 7ff1f1c83740 10 client.28528 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:40.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.341+0000 7ff1f1c83740 1 -- 172.21.15.3:0/956418660 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ce5d211da0 con 0x55ce5d197020 2024-09-19T06:23:40.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.341+0000 7ff1d6000640 1 -- 172.21.15.3:0/956418660 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1d0004c80 con 0x55ce5d197020 2024-09-19T06:23:40.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.341+0000 7ff1d6000640 1 -- 172.21.15.3:0/956418660 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff1e0054020 con 0x55ce5d197020 2024-09-19T06:23:40.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.341+0000 7ff1f1c83740 10 client.28528 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:40.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.342+0000 7ff1f1c83740 10 client.28528 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:23:40.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.342+0000 7ff1f1c83740 20 client.28528 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:40.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.342+0000 7ff1f1c83740 1 --2- 172.21.15.3:0/956418660 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55ce5d2124d0 0x55ce5d2148f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:40.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.342+0000 7ff1f1c83740 4 client.28528 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:23:40.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.342+0000 7ff1f1c83740 1 -- 172.21.15.3:0/956418660 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ce5d0f9e60 con 0x55ce5d2124d0 2024-09-19T06:23:40.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.342+0000 7ff1e7e00640 1 --2- 172.21.15.3:0/956418660 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55ce5d2124d0 0x55ce5d2148f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:40.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.342+0000 7ff1e7e00640 1 --2- 172.21.15.3:0/956418660 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55ce5d2124d0 0x55ce5d2148f0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6f41aece4571ed8f server_cookie=467c1551dec82cf4 in_seq=0 out_seq=0 2024-09-19T06:23:40.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.342+0000 7ff1d6000640 10 client.28528 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:23:40.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.343+0000 7ff1d6000640 1 -- 172.21.15.3:0/956418660 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ce5d0f9e60 con 0x55ce5d2124d0 2024-09-19T06:23:40.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.343+0000 7ff1d6000640 10 client.28528 handle_command_reply: tid=0 2024-09-19T06:23:40.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.343+0000 7ff1f1c83740 1 client.28528 shutdown 2024-09-19T06:23:40.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.343+0000 7ff1f1c83740 1 -- 172.21.15.3:0/956418660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d197020 msgr2=0x55ce5d19b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:40.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.343+0000 7ff1f1c83740 1 --2- 172.21.15.3:0/956418660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d197020 0x55ce5d19b8d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0033000 tx=0x7ff1e002a6c0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.343+0000 7ff1f1c83740 1 -- 172.21.15.3:0/956418660 shutdown_connections 2024-09-19T06:23:40.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.343+0000 7ff1f1c83740 1 --2- 172.21.15.3:0/956418660 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x55ce5d2124d0 0x55ce5d2148f0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.343+0000 7ff1f1c83740 1 --2- 172.21.15.3:0/956418660 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ce5d197020 0x55ce5d19b8d0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.343+0000 7ff1f1c83740 1 --2- 172.21.15.3:0/956418660 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ce5d18c760 0x55ce5d19b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.343+0000 7ff1f1c83740 1 --2- 172.21.15.3:0/956418660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ce5d18be40 0x55ce5d19ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.343+0000 7ff1d6000640 0 client.28528 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:23:40.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.343+0000 7ff1f1c83740 1 -- 172.21.15.3:0/956418660 >> 172.21.15.3:0/956418660 conn(0x55ce5d1883d0 msgr2=0x55ce5d187490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:40.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.343+0000 7ff1f1c83740 1 -- 172.21.15.3:0/956418660 shutdown_connections 2024-09-19T06:23:40.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.343+0000 7ff1f1c83740 1 -- 172.21.15.3:0/956418660 wait complete. 2024-09-19T06:23:40.388 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:23:40.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.343+0000 7ff1f1c83740 20 client.28528 trim_cache size 0 max 16384 2024-09-19T06:23:40.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.344+0000 7ff1edc00640 1 -- 172.21.15.3:0/3910648088 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff1cc0a3430 msgr2=0x7ff1cc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:40.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.344+0000 7ff1edc00640 1 --2- 172.21.15.3:0/3910648088 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff1cc0a3430 0x7ff1cc0a58f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0004af0 tx=0x7ff1e0004a40 comp rx=0 tx=0).stop 2024-09-19T06:23:40.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.344+0000 7ff1edc00640 1 -- 172.21.15.3:0/3910648088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1e8103e30 msgr2=0x7ff1e819a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:40.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.344+0000 7ff1edc00640 1 --2- 172.21.15.3:0/3910648088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1e8103e30 0x7ff1e819a430 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800e9c0 tx=0x7ff1d800ee80 comp rx=0 tx=0).stop 2024-09-19T06:23:40.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.344+0000 7ff1edc00640 1 -- 172.21.15.3:0/3910648088 shutdown_connections 2024-09-19T06:23:40.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.344+0000 7ff1edc00640 1 --2- 172.21.15.3:0/3910648088 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff1cc0a3430 0x7ff1cc0a58f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.344+0000 7ff1edc00640 1 --2- 172.21.15.3:0/3910648088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1e8108f60 0x7ff1e819ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.344+0000 7ff1edc00640 1 --2- 172.21.15.3:0/3910648088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff1e81047e0 0x7ff1e819a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.344+0000 7ff1edc00640 1 --2- 172.21.15.3:0/3910648088 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff1e8103e30 0x7ff1e819a430 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:40.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.344+0000 7ff1edc00640 1 -- 172.21.15.3:0/3910648088 >> 172.21.15.3:0/3910648088 conn(0x7ff1e80ff8d0 msgr2=0x7ff1e8100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:40.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.344+0000 7ff1edc00640 1 -- 172.21.15.3:0/3910648088 shutdown_connections 2024-09-19T06:23:40.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:40.344+0000 7ff1edc00640 1 -- 172.21.15.3:0/3910648088 wait complete. 2024-09-19T06:23:41.287 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:23:41.665 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:42.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:42 smithi003 ceph-mon[30893]: pgmap v352: 97 pgs: 97 active+clean; 2.8 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:23:42.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.241+0000 7fd237800640 1 -- 172.21.15.3:0/488188980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd230076720 msgr2=0x7fd230076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:42.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.241+0000 7fd237800640 1 --2- 172.21.15.3:0/488188980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd230076720 0x7fd230076b00 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fd220009900 tx=0x7fd22002a410 comp rx=0 tx=0).stop 2024-09-19T06:23:42.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.241+0000 7fd237800640 1 -- 172.21.15.3:0/488188980 shutdown_connections 2024-09-19T06:23:42.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.241+0000 7fd237800640 1 --2- 172.21.15.3:0/488188980 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd230112a30 0x7fd230114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.241+0000 7fd237800640 1 --2- 172.21.15.3:0/488188980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd230077040 0x7fd2301124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.241+0000 7fd237800640 1 --2- 172.21.15.3:0/488188980 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd230076720 0x7fd230076b00 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.241+0000 7fd237800640 1 -- 172.21.15.3:0/488188980 >> 172.21.15.3:0/488188980 conn(0x7fd2300ffa90 msgr2=0x7fd230101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:42.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.241+0000 7fd237800640 1 -- 172.21.15.3:0/488188980 shutdown_connections 2024-09-19T06:23:42.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.241+0000 7fd237800640 1 -- 172.21.15.3:0/488188980 wait complete. 2024-09-19T06:23:42.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.242+0000 7fd237800640 1 Processor -- start 2024-09-19T06:23:42.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.242+0000 7fd237800640 1 -- start start 2024-09-19T06:23:42.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.242+0000 7fd237800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd230076720 0x7fd2301a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.242+0000 7fd237800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd230077040 0x7fd2301a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.242+0000 7fd237800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd230112a30 0x7fd23019e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.242+0000 7fd237800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd2301185c0 con 0x7fd230112a30 2024-09-19T06:23:42.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.242+0000 7fd237800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd230118440 con 0x7fd230077040 2024-09-19T06:23:42.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.242+0000 7fd237800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd230118740 con 0x7fd230076720 2024-09-19T06:23:42.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.243+0000 7fd235800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd230112a30 0x7fd23019e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.243+0000 7fd227e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd230077040 0x7fd2301a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.243+0000 7fd227e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd230077040 0x7fd2301a4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:36914/0 (socket says 172.21.15.3:36914) 2024-09-19T06:23:42.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.243+0000 7fd227e00640 1 -- 172.21.15.3:0/409921988 learned_addr learned my addr 172.21.15.3:0/409921988 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:42.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.243+0000 7fd234e00640 1 --2- 172.21.15.3:0/409921988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd230076720 0x7fd2301a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.243+0000 7fd235800640 1 -- 172.21.15.3:0/409921988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd230076720 msgr2=0x7fd2301a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:42.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.243+0000 7fd235800640 1 --2- 172.21.15.3:0/409921988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd230076720 0x7fd2301a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.243+0000 7fd235800640 1 -- 172.21.15.3:0/409921988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd230077040 msgr2=0x7fd2301a4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:42.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.243+0000 7fd235800640 1 --2- 172.21.15.3:0/409921988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd230077040 0x7fd2301a4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.243+0000 7fd235800640 1 -- 172.21.15.3:0/409921988 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd23019efe0 con 0x7fd230112a30 2024-09-19T06:23:42.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.243+0000 7fd227e00640 1 --2- 172.21.15.3:0/409921988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd230077040 0x7fd2301a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:42.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.244+0000 7fd235800640 1 --2- 172.21.15.3:0/409921988 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd230112a30 0x7fd23019e8b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd23007aa10 tx=0x7fd22800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:42.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.244+0000 7fd22e000640 1 -- 172.21.15.3:0/409921988 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22800cdf0 con 0x7fd230112a30 2024-09-19T06:23:42.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.244+0000 7fd237800640 1 -- 172.21.15.3:0/409921988 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd23019f2d0 con 0x7fd230112a30 2024-09-19T06:23:42.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.244+0000 7fd22e000640 1 -- 172.21.15.3:0/409921988 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd228005020 con 0x7fd230112a30 2024-09-19T06:23:42.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.244+0000 7fd22e000640 1 -- 172.21.15.3:0/409921988 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd228010690 con 0x7fd230112a30 2024-09-19T06:23:42.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.244+0000 7fd237800640 1 -- 172.21.15.3:0/409921988 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2301ab5c0 con 0x7fd230112a30 2024-09-19T06:23:42.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.247+0000 7fd23a27e740 1 Processor -- start 2024-09-19T06:23:42.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.247+0000 7fd22e000640 1 -- 172.21.15.3:0/409921988 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fd2280054d0 con 0x7fd230112a30 2024-09-19T06:23:42.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.247+0000 7fd23a27e740 1 -- start start 2024-09-19T06:23:42.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.248+0000 7fd23a27e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c7c70 0x55b8f85c8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.248+0000 7fd23a27e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8f85c8590 0x55b8f85d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.248+0000 7fd23a27e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8f85d2e50 0x55b8f85d5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.248+0000 7fd23a27e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b8f852e3e0 con 0x55b8f85c7c70 2024-09-19T06:23:42.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.248+0000 7fd23a27e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b8f84d5d80 con 0x55b8f85c8590 2024-09-19T06:23:42.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.248+0000 7fd23a27e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b8f852a3a0 con 0x55b8f85d2e50 2024-09-19T06:23:42.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.248+0000 7fd227e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c7c70 0x55b8f85c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.248+0000 7fd234e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8f85c8590 0x55b8f85d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.248+0000 7fd227e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c7c70 0x55b8f85c8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32850/0 (socket says 172.21.15.3:32850) 2024-09-19T06:23:42.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.248+0000 7fd227e00640 1 -- 172.21.15.3:0/2046053879 learned_addr learned my addr 172.21.15.3:0/2046053879 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:42.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.248+0000 7fd227e00640 1 --2- 172.21.15.3:0/2046053879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8f85d2e50 0x55b8f85d5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.248+0000 7fd227e00640 1 -- 172.21.15.3:0/2046053879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8f85d2e50 msgr2=0x55b8f85d5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:42.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.248+0000 7fd227e00640 1 --2- 172.21.15.3:0/2046053879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8f85d2e50 0x55b8f85d5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.248+0000 7fd227e00640 1 -- 172.21.15.3:0/2046053879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8f85c8590 msgr2=0x55b8f85d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:42.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.249+0000 7fd227e00640 1 --2- 172.21.15.3:0/2046053879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8f85c8590 0x55b8f85d2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.249+0000 7fd227e00640 1 -- 172.21.15.3:0/2046053879 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8f84f4ae0 con 0x55b8f85c7c70 2024-09-19T06:23:42.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.249+0000 7fd22e000640 1 --2- 172.21.15.3:0/409921988 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd2140a33b0 0x7fd2140a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.252 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.249+0000 7fd227e00640 1 --2- 172.21.15.3:0/2046053879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c7c70 0x55b8f85c8050 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fd2180097f0 tx=0x7fd218009cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=462e08dcd7d8b3d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:42.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.249+0000 7fd22e000640 1 -- 172.21.15.3:0/409921988 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7fd2280d03c0 con 0x7fd230112a30 2024-09-19T06:23:42.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.249+0000 7fd234e00640 1 --2- 172.21.15.3:0/409921988 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd2140a33b0 0x7fd2140a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.249+0000 7fd226000640 1 -- 172.21.15.3:0/2046053879 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21800fa00 con 0x55b8f85c7c70 2024-09-19T06:23:42.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.249+0000 7fd226000640 1 -- 172.21.15.3:0/2046053879 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd21800fba0 con 0x55b8f85c7c70 2024-09-19T06:23:42.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.249+0000 7fd226000640 1 -- 172.21.15.3:0/2046053879 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd218003c50 con 0x55b8f85c7c70 2024-09-19T06:23:42.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.250+0000 7fd23a27e740 1 -- 172.21.15.3:0/2046053879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c7c70 msgr2=0x55b8f85c8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:42.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.250+0000 7fd23a27e740 1 --2- 172.21.15.3:0/2046053879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c7c70 0x55b8f85c8050 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fd2180097f0 tx=0x7fd218009cc0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.250+0000 7fd234e00640 1 --2- 172.21.15.3:0/409921988 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd2140a33b0 0x7fd2140a5870 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd23019f9f0 tx=0x7fd2200058d0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:42.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.250+0000 7fd23a27e740 1 -- 172.21.15.3:0/2046053879 shutdown_connections 2024-09-19T06:23:42.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.250+0000 7fd23a27e740 1 --2- 172.21.15.3:0/2046053879 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8f85d2e50 0x55b8f85d5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.250+0000 7fd23a27e740 1 --2- 172.21.15.3:0/2046053879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8f85c8590 0x55b8f85d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.250+0000 7fd23a27e740 1 --2- 172.21.15.3:0/2046053879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c7c70 0x55b8f85c8050 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.250+0000 7fd23a27e740 1 -- 172.21.15.3:0/2046053879 >> 172.21.15.3:0/2046053879 conn(0x55b8f85c4200 msgr2=0x55b8f85c45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:42.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.250+0000 7fd23a27e740 1 -- 172.21.15.3:0/2046053879 shutdown_connections 2024-09-19T06:23:42.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.250+0000 7fd23a27e740 1 -- 172.21.15.3:0/2046053879 wait complete. 2024-09-19T06:23:42.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.251+0000 7fd23a27e740 1 -- start start 2024-09-19T06:23:42.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.251+0000 7fd23a27e740 1 Processor -- start 2024-09-19T06:23:42.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.252+0000 7fd23a27e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c7c70 0x55b8f85cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.252+0000 7fd23a27e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8f85c8590 0x55b8f85d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.252+0000 7fd23a27e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8f85d2e50 0x55b8f85d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.252+0000 7fd23a27e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55b8f85d5a20 con 0x55b8f85c7c70 2024-09-19T06:23:42.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.252+0000 7fd23a27e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55b8f84e90f0 con 0x55b8f85d2e50 2024-09-19T06:23:42.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.252+0000 7fd23a27e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55b8f85d5ba0 con 0x55b8f85c8590 2024-09-19T06:23:42.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.252+0000 7fd23a27e740 10 client.0 _ll_register_callbacks cb 0x55b8f84d0bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:42.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.252+0000 7fd234e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c7c70 0x55b8f85cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.252+0000 7fd234e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c7c70 0x55b8f85cfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32854/0 (socket says 172.21.15.3:32854) 2024-09-19T06:23:42.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.252+0000 7fd234e00640 1 -- 172.21.15.3:0/4110582876 learned_addr learned my addr 172.21.15.3:0/4110582876 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:42.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.252+0000 7fd227e00640 1 --2- 172.21.15.3:0/4110582876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8f85c8590 0x55b8f85d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.252+0000 7fd235800640 1 --2- 172.21.15.3:0/4110582876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8f85d2e50 0x55b8f85d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.253+0000 7fd234e00640 1 -- 172.21.15.3:0/4110582876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8f85c8590 msgr2=0x55b8f85d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:42.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.253+0000 7fd234e00640 1 --2- 172.21.15.3:0/4110582876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8f85c8590 0x55b8f85d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.253+0000 7fd234e00640 1 -- 172.21.15.3:0/4110582876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8f85d2e50 msgr2=0x55b8f85d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:42.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.253+0000 7fd234e00640 1 --2- 172.21.15.3:0/4110582876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8f85d2e50 0x55b8f85d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.253+0000 7fd234e00640 1 -- 172.21.15.3:0/4110582876 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8f829f3c0 con 0x55b8f85c7c70 2024-09-19T06:23:42.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.253+0000 7fd235800640 1 --2- 172.21.15.3:0/4110582876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8f85d2e50 0x55b8f85d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:42.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.253+0000 7fd234e00640 1 --2- 172.21.15.3:0/4110582876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c7c70 0x55b8f85cfd30 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fd2200042c0 tx=0x7fd220009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402f1110a357a8b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:42.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.253+0000 7fd21ea00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:23:42.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.253+0000 7fd21ea00640 1 -- 172.21.15.3:0/4110582876 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22004e070 con 0x55b8f85c7c70 2024-09-19T06:23:42.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.253+0000 7fd21ea00640 1 -- 172.21.15.3:0/4110582876 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7fd2200037f0 con 0x55b8f85c7c70 2024-09-19T06:23:42.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.253+0000 7fd23a27e740 1 -- 172.21.15.3:0/4110582876 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd21800fba0 con 0x55b8f85c7c70 2024-09-19T06:23:42.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.254+0000 7fd21ea00640 1 -- 172.21.15.3:0/4110582876 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd22005a050 con 0x55b8f85c7c70 2024-09-19T06:23:42.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.254+0000 7fd23a27e740 10 client.18531 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:42.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.254+0000 7fd23a27e740 1 -- 172.21.15.3:0/4110582876 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b8f85e1a60 con 0x55b8f85c7c70 2024-09-19T06:23:42.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.254+0000 7fd21ea00640 1 -- 172.21.15.3:0/4110582876 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd21800fba0 con 0x55b8f85c7c70 2024-09-19T06:23:42.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.254+0000 7fd21ea00640 1 -- 172.21.15.3:0/4110582876 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd22004ac10 con 0x55b8f85c7c70 2024-09-19T06:23:42.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.254+0000 7fd23a27e740 10 client.18531 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:42.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.254+0000 7fd23a27e740 10 client.18531 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:23:42.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.254+0000 7fd23a27e740 20 client.18531 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:42.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.254+0000 7fd23a27e740 1 --2- 172.21.15.3:0/4110582876 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55b8f85e2ec0 0x55b8f85e52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.254+0000 7fd23a27e740 4 client.18531 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:42.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.254+0000 7fd23a27e740 1 -- 172.21.15.3:0/4110582876 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8f853b950 con 0x55b8f85e2ec0 2024-09-19T06:23:42.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.255+0000 7fd227e00640 1 --2- 172.21.15.3:0/4110582876 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55b8f85e2ec0 0x55b8f85e52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.255+0000 7fd227e00640 1 --2- 172.21.15.3:0/4110582876 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55b8f85e2ec0 0x55b8f85e52d0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=dda9a108607359d1 server_cookie=97fe7841271aaee3 in_seq=0 out_seq=0 2024-09-19T06:23:42.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.255+0000 7fd21ea00640 10 client.18531 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:23:42.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.256+0000 7fd21ea00640 1 -- 172.21.15.3:0/4110582876 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b8f853b950 con 0x55b8f85e2ec0 2024-09-19T06:23:42.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.256+0000 7fd21ea00640 10 client.18531 handle_command_reply: tid=0 2024-09-19T06:23:42.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.256+0000 7fd23a27e740 1 client.18531 shutdown 2024-09-19T06:23:42.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.256+0000 7fd23a27e740 1 -- 172.21.15.3:0/4110582876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c7c70 msgr2=0x55b8f85cfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:42.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.256+0000 7fd23a27e740 1 --2- 172.21.15.3:0/4110582876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c7c70 0x55b8f85cfd30 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fd2200042c0 tx=0x7fd220009260 comp rx=0 tx=0).stop 2024-09-19T06:23:42.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.256+0000 7fd23a27e740 1 -- 172.21.15.3:0/4110582876 shutdown_connections 2024-09-19T06:23:42.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.256+0000 7fd23a27e740 1 --2- 172.21.15.3:0/4110582876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8f85d2e50 0x55b8f85d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.256+0000 7fd23a27e740 1 --2- 172.21.15.3:0/4110582876 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8f85c8590 0x55b8f85d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.256+0000 7fd23a27e740 1 --2- 172.21.15.3:0/4110582876 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55b8f85e2ec0 0x55b8f85e52d0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.256+0000 7fd23a27e740 1 --2- 172.21.15.3:0/4110582876 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c7c70 0x55b8f85cfd30 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.256+0000 7fd23a27e740 1 -- 172.21.15.3:0/4110582876 >> 172.21.15.3:0/4110582876 conn(0x55b8f85c4200 msgr2=0x55b8f85c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:42.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.256+0000 7fd21ea00640 0 client.18531 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:23:42.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.257+0000 7fd23a27e740 1 -- 172.21.15.3:0/4110582876 shutdown_connections 2024-09-19T06:23:42.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.257+0000 7fd23a27e740 1 -- 172.21.15.3:0/4110582876 wait complete. 2024-09-19T06:23:42.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.257+0000 7fd23a27e740 20 client.18531 trim_cache size 0 max 16384 2024-09-19T06:23:42.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.270+0000 7fd23a27e740 1 Processor -- start 2024-09-19T06:23:42.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.270+0000 7fd23a27e740 1 -- start start 2024-09-19T06:23:42.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.271+0000 7fd23a27e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8f85c7c70 0x55b8f85ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.271+0000 7fd23a27e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c8590 0x55b8f85d1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.271+0000 7fd23a27e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8f85d2e50 0x55b8f85eaba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.271+0000 7fd23a27e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd2301b3f20 con 0x55b8f85c8590 2024-09-19T06:23:42.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.271+0000 7fd23a27e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd2301b5a60 con 0x55b8f85c7c70 2024-09-19T06:23:42.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.271+0000 7fd23a27e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd2301b45f0 con 0x55b8f85d2e50 2024-09-19T06:23:42.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.271+0000 7fd227e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c8590 0x55b8f85d1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.271+0000 7fd234e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8f85c7c70 0x55b8f85ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.271+0000 7fd234e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8f85c7c70 0x55b8f85ca6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:36938/0 (socket says 172.21.15.3:36938) 2024-09-19T06:23:42.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.271+0000 7fd227e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c8590 0x55b8f85d1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32870/0 (socket says 172.21.15.3:32870) 2024-09-19T06:23:42.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.271+0000 7fd234e00640 1 -- 172.21.15.3:0/2876943388 learned_addr learned my addr 172.21.15.3:0/2876943388 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:42.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.271+0000 7fd235800640 1 --2- 172.21.15.3:0/2876943388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8f85d2e50 0x55b8f85eaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.271+0000 7fd234e00640 1 -- 172.21.15.3:0/2876943388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8f85d2e50 msgr2=0x55b8f85eaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:42.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.271+0000 7fd234e00640 1 --2- 172.21.15.3:0/2876943388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8f85d2e50 0x55b8f85eaba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.271+0000 7fd234e00640 1 -- 172.21.15.3:0/2876943388 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c8590 msgr2=0x55b8f85d1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:42.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.271+0000 7fd234e00640 1 --2- 172.21.15.3:0/2876943388 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c8590 0x55b8f85d1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.271+0000 7fd234e00640 1 -- 172.21.15.3:0/2876943388 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8f85c4030 con 0x55b8f85c7c70 2024-09-19T06:23:42.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.272+0000 7fd227e00640 1 --2- 172.21.15.3:0/2876943388 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c8590 0x55b8f85d1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:42.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.272+0000 7fd234e00640 1 --2- 172.21.15.3:0/2876943388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8f85c7c70 0x55b8f85ca6d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd22003d4f0 tx=0x7fd220005940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73cbd315c5f10562 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:42.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.272+0000 7fd225600640 1 -- 172.21.15.3:0/2876943388 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd220062020 con 0x55b8f85c7c70 2024-09-19T06:23:42.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.272+0000 7fd225600640 1 -- 172.21.15.3:0/2876943388 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2200035f0 con 0x55b8f85c7c70 2024-09-19T06:23:42.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.272+0000 7fd225600640 1 -- 172.21.15.3:0/2876943388 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22004e040 con 0x55b8f85c7c70 2024-09-19T06:23:42.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.273+0000 7fd23a27e740 1 -- 172.21.15.3:0/2876943388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8f85c7c70 msgr2=0x55b8f85ca6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:42.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.273+0000 7fd23a27e740 1 --2- 172.21.15.3:0/2876943388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8f85c7c70 0x55b8f85ca6d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd22003d4f0 tx=0x7fd220005940 comp rx=0 tx=0).stop 2024-09-19T06:23:42.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.273+0000 7fd23a27e740 1 -- 172.21.15.3:0/2876943388 shutdown_connections 2024-09-19T06:23:42.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.273+0000 7fd23a27e740 1 --2- 172.21.15.3:0/2876943388 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8f85d2e50 0x55b8f85eaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.273+0000 7fd23a27e740 1 --2- 172.21.15.3:0/2876943388 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c8590 0x55b8f85d1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.273+0000 7fd23a27e740 1 --2- 172.21.15.3:0/2876943388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8f85c7c70 0x55b8f85ca6d0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.273+0000 7fd23a27e740 1 -- 172.21.15.3:0/2876943388 >> 172.21.15.3:0/2876943388 conn(0x55b8f85c4200 msgr2=0x55b8f85d1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:42.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.273+0000 7fd23a27e740 1 -- 172.21.15.3:0/2876943388 shutdown_connections 2024-09-19T06:23:42.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.273+0000 7fd23a27e740 1 -- 172.21.15.3:0/2876943388 wait complete. 2024-09-19T06:23:42.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.273+0000 7fd23a27e740 1 -- start start 2024-09-19T06:23:42.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.274+0000 7fd23a27e740 1 Processor -- start 2024-09-19T06:23:42.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.274+0000 7fd23a27e740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c7c70 0x55b8f85db6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.274+0000 7fd23a27e740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8f85c8590 0x55b8f85d69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.274+0000 7fd23a27e740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8f85d2e50 0x55b8f85d7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.274+0000 7fd23a27e740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd2301b5390 con 0x55b8f85c7c70 2024-09-19T06:23:42.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.274+0000 7fd23a27e740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fd2301b4cc0 con 0x55b8f85c8590 2024-09-19T06:23:42.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.274+0000 7fd23a27e740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fd2301b1f20 con 0x55b8f85d2e50 2024-09-19T06:23:42.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.274+0000 7fd23a27e740 10 client.0 _ll_register_callbacks cb 0x7fd220009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:42.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.274+0000 7fd234e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c7c70 0x55b8f85db6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.274+0000 7fd234e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c7c70 0x55b8f85db6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:32874/0 (socket says 172.21.15.3:32874) 2024-09-19T06:23:42.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.274+0000 7fd234e00640 1 -- 172.21.15.3:0/772652856 learned_addr learned my addr 172.21.15.3:0/772652856 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:42.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.275+0000 7fd235800640 1 --2- 172.21.15.3:0/772652856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8f85d2e50 0x55b8f85d7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.275+0000 7fd227e00640 1 --2- 172.21.15.3:0/772652856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8f85c8590 0x55b8f85d69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.275+0000 7fd234e00640 1 -- 172.21.15.3:0/772652856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8f85d2e50 msgr2=0x55b8f85d7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:42.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.275+0000 7fd234e00640 1 --2- 172.21.15.3:0/772652856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8f85d2e50 0x55b8f85d7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.275+0000 7fd234e00640 1 -- 172.21.15.3:0/772652856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8f85c8590 msgr2=0x55b8f85d69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:42.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.275+0000 7fd234e00640 1 --2- 172.21.15.3:0/772652856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8f85c8590 0x55b8f85d69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.275+0000 7fd234e00640 1 -- 172.21.15.3:0/772652856 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8f85bf770 con 0x55b8f85c7c70 2024-09-19T06:23:42.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.275+0000 7fd227e00640 1 --2- 172.21.15.3:0/772652856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8f85c8590 0x55b8f85d69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:42.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.275+0000 7fd234e00640 1 --2- 172.21.15.3:0/772652856 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c7c70 0x55b8f85db6c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fd220006010 tx=0x7fd22003d8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f08bfa5d29bb63f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:42.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.275+0000 7fd21ea00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:23:42.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.275+0000 7fd21ea00640 1 -- 172.21.15.3:0/772652856 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd22006b020 con 0x55b8f85c7c70 2024-09-19T06:23:42.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.276+0000 7fd21ea00640 1 -- 172.21.15.3:0/772652856 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7fd2200039a0 con 0x55b8f85c7c70 2024-09-19T06:23:42.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.276+0000 7fd23a27e740 1 -- 172.21.15.3:0/772652856 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2200035f0 con 0x55b8f85c7c70 2024-09-19T06:23:42.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.276+0000 7fd21ea00640 1 -- 172.21.15.3:0/772652856 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd220076050 con 0x55b8f85c7c70 2024-09-19T06:23:42.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.276+0000 7fd23a27e740 10 client.18537 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:42.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.276+0000 7fd23a27e740 1 -- 172.21.15.3:0/772652856 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b8f864db30 con 0x55b8f85c7c70 2024-09-19T06:23:42.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.276+0000 7fd21ea00640 1 -- 172.21.15.3:0/772652856 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2200035f0 con 0x55b8f85c7c70 2024-09-19T06:23:42.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.276+0000 7fd21ea00640 1 -- 172.21.15.3:0/772652856 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fd22004a450 con 0x55b8f85c7c70 2024-09-19T06:23:42.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.276+0000 7fd23a27e740 10 client.18537 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:42.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.276+0000 7fd23a27e740 10 client.18537 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:23:42.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.276+0000 7fd23a27e740 20 client.18537 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:42.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.276+0000 7fd23a27e740 1 --2- 172.21.15.3:0/772652856 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55b8f864e130 0x55b8f8650520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:42.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.276+0000 7fd23a27e740 4 client.18537 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:23:42.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.277+0000 7fd23a27e740 1 -- 172.21.15.3:0/772652856 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b8f8535e60 con 0x55b8f864e130 2024-09-19T06:23:42.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.277+0000 7fd227e00640 1 --2- 172.21.15.3:0/772652856 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55b8f864e130 0x55b8f8650520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:42.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.277+0000 7fd227e00640 1 --2- 172.21.15.3:0/772652856 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55b8f864e130 0x55b8f8650520 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=675a3b1b8c55dab5 server_cookie=dbae43ba2d0b753d in_seq=0 out_seq=0 2024-09-19T06:23:42.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.277+0000 7fd21ea00640 10 client.18537 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:23:42.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.278+0000 7fd21ea00640 1 -- 172.21.15.3:0/772652856 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b8f8535e60 con 0x55b8f864e130 2024-09-19T06:23:42.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.278+0000 7fd21ea00640 10 client.18537 handle_command_reply: tid=0 2024-09-19T06:23:42.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.278+0000 7fd23a27e740 1 client.18537 shutdown 2024-09-19T06:23:42.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.278+0000 7fd23a27e740 1 -- 172.21.15.3:0/772652856 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c7c70 msgr2=0x55b8f85db6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:42.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.278+0000 7fd23a27e740 1 --2- 172.21.15.3:0/772652856 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c7c70 0x55b8f85db6c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fd220006010 tx=0x7fd22003d8b0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.278+0000 7fd23a27e740 1 -- 172.21.15.3:0/772652856 shutdown_connections 2024-09-19T06:23:42.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.278+0000 7fd23a27e740 1 --2- 172.21.15.3:0/772652856 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55b8f85d2e50 0x55b8f85d7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.278+0000 7fd23a27e740 1 --2- 172.21.15.3:0/772652856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b8f85c8590 0x55b8f85d69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.278+0000 7fd23a27e740 1 --2- 172.21.15.3:0/772652856 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55b8f864e130 0x55b8f8650520 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.278+0000 7fd23a27e740 1 --2- 172.21.15.3:0/772652856 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55b8f85c7c70 0x55b8f85db6c0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.278+0000 7fd23a27e740 1 -- 172.21.15.3:0/772652856 >> 172.21.15.3:0/772652856 conn(0x55b8f85c4200 msgr2=0x55b8f85c3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:42.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.278+0000 7fd21ea00640 0 client.18537 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:23:42.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.278+0000 7fd23a27e740 1 -- 172.21.15.3:0/772652856 shutdown_connections 2024-09-19T06:23:42.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.278+0000 7fd23a27e740 1 -- 172.21.15.3:0/772652856 wait complete. 2024-09-19T06:23:42.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.278+0000 7fd23a27e740 20 client.18537 trim_cache size 0 max 16384 2024-09-19T06:23:42.284 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:23:42.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.279+0000 7fd237800640 1 -- 172.21.15.3:0/409921988 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd2140a33b0 msgr2=0x7fd2140a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:42.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.279+0000 7fd237800640 1 --2- 172.21.15.3:0/409921988 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd2140a33b0 0x7fd2140a5870 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd23019f9f0 tx=0x7fd2200058d0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.279+0000 7fd237800640 1 -- 172.21.15.3:0/409921988 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd230112a30 msgr2=0x7fd23019e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:42.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.279+0000 7fd237800640 1 --2- 172.21.15.3:0/409921988 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd230112a30 0x7fd23019e8b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd23007aa10 tx=0x7fd22800ef10 comp rx=0 tx=0).stop 2024-09-19T06:23:42.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.279+0000 7fd237800640 1 -- 172.21.15.3:0/409921988 shutdown_connections 2024-09-19T06:23:42.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.279+0000 7fd237800640 1 --2- 172.21.15.3:0/409921988 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fd2140a33b0 0x7fd2140a5870 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.279+0000 7fd237800640 1 --2- 172.21.15.3:0/409921988 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd230112a30 0x7fd23019e8b0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.279+0000 7fd237800640 1 --2- 172.21.15.3:0/409921988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd230077040 0x7fd2301a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.279+0000 7fd237800640 1 --2- 172.21.15.3:0/409921988 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fd230076720 0x7fd2301a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:42.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.279+0000 7fd237800640 1 -- 172.21.15.3:0/409921988 >> 172.21.15.3:0/409921988 conn(0x7fd2300ffa90 msgr2=0x7fd230101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:42.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.279+0000 7fd237800640 1 -- 172.21.15.3:0/409921988 shutdown_connections 2024-09-19T06:23:42.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:42.279+0000 7fd237800640 1 -- 172.21.15.3:0/409921988 wait complete. 2024-09-19T06:23:42.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:42 smithi059 ceph-mon[35138]: pgmap v352: 97 pgs: 97 active+clean; 2.8 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:23:42.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:42 smithi071 ceph-mon[35662]: pgmap v352: 97 pgs: 97 active+clean; 2.8 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:23:43.265 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:23:43.647 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:44.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:44 smithi003 ceph-mon[30893]: pgmap v353: 97 pgs: 97 active+clean; 2.8 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:23:44.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.228+0000 7f5403200640 1 -- 172.21.15.3:0/210596848 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53fc109120 msgr2=0x7f53fc110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:44.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.228+0000 7f5403200640 1 --2- 172.21.15.3:0/210596848 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53fc109120 0x7f53fc110ca0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009ca0 tx=0x7f53f402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.228+0000 7f5403200640 1 -- 172.21.15.3:0/210596848 shutdown_connections 2024-09-19T06:23:44.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.228+0000 7f5403200640 1 --2- 172.21.15.3:0/210596848 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53fc109120 0x7f53fc110ca0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.228+0000 7f5403200640 1 --2- 172.21.15.3:0/210596848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53fc1049a0 0x7f53fc1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.228+0000 7f5403200640 1 --2- 172.21.15.3:0/210596848 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53fc103ff0 0x7f53fc1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.228+0000 7f5403200640 1 -- 172.21.15.3:0/210596848 >> 172.21.15.3:0/210596848 conn(0x7f53fc0ffa90 msgr2=0x7f53fc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:44.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.228+0000 7f5403200640 1 -- 172.21.15.3:0/210596848 shutdown_connections 2024-09-19T06:23:44.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.228+0000 7f5403200640 1 -- 172.21.15.3:0/210596848 wait complete. 2024-09-19T06:23:44.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.229+0000 7f5403200640 1 Processor -- start 2024-09-19T06:23:44.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.229+0000 7f5403200640 1 -- start start 2024-09-19T06:23:44.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.230+0000 7f5403200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53fc103ff0 0x7f53fc19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.230+0000 7f5403200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53fc1049a0 0x7f53fc19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.230+0000 7f5403200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53fc109120 0x7f53fc19ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.230+0000 7f5403200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc114180 con 0x7f53fc1049a0 2024-09-19T06:23:44.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.230+0000 7f5403200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc114000 con 0x7f53fc103ff0 2024-09-19T06:23:44.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.230+0000 7f5403200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc114300 con 0x7f53fc109120 2024-09-19T06:23:44.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.230+0000 7f53fb400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53fc1049a0 0x7f53fc19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.230+0000 7f53fbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53fc103ff0 0x7f53fc19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.230+0000 7f53fb400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53fc1049a0 0x7f53fc19aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38892/0 (socket says 172.21.15.3:38892) 2024-09-19T06:23:44.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.230+0000 7f53fb400640 1 -- 172.21.15.3:0/3024240723 learned_addr learned my addr 172.21.15.3:0/3024240723 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:44.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.230+0000 7f5401200640 1 --2- 172.21.15.3:0/3024240723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53fc109120 0x7f53fc19ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.231+0000 7f53fbe00640 1 -- 172.21.15.3:0/3024240723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53fc109120 msgr2=0x7f53fc19ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:44.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.231+0000 7f53fbe00640 1 --2- 172.21.15.3:0/3024240723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53fc109120 0x7f53fc19ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.231+0000 7f53fbe00640 1 -- 172.21.15.3:0/3024240723 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53fc1049a0 msgr2=0x7f53fc19aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:44.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.231+0000 7f53fbe00640 1 --2- 172.21.15.3:0/3024240723 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53fc1049a0 0x7f53fc19aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.231+0000 7f53fbe00640 1 -- 172.21.15.3:0/3024240723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53fc19f550 con 0x7f53fc103ff0 2024-09-19T06:23:44.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.231+0000 7f53fb400640 1 --2- 172.21.15.3:0/3024240723 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53fc1049a0 0x7f53fc19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:44.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.231+0000 7f53fbe00640 1 --2- 172.21.15.3:0/3024240723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53fc103ff0 0x7f53fc19a5a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00e9f0 tx=0x7f53ec00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:44.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.231+0000 7f53f8c00640 1 -- 172.21.15.3:0/3024240723 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec00ccc0 con 0x7f53fc103ff0 2024-09-19T06:23:44.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.231+0000 7f5403200640 1 -- 172.21.15.3:0/3024240723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53fc19f840 con 0x7f53fc103ff0 2024-09-19T06:23:44.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.231+0000 7f53f8c00640 1 -- 172.21.15.3:0/3024240723 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53ec010910 con 0x7f53fc103ff0 2024-09-19T06:23:44.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.231+0000 7f53f8c00640 1 -- 172.21.15.3:0/3024240723 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ec018960 con 0x7f53fc103ff0 2024-09-19T06:23:44.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.232+0000 7f5403200640 1 -- 172.21.15.3:0/3024240723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53fc1a7120 con 0x7f53fc103ff0 2024-09-19T06:23:44.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.235+0000 7f53f8c00640 1 -- 172.21.15.3:0/3024240723 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f53ec010ac0 con 0x7f53fc103ff0 2024-09-19T06:23:44.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.235+0000 7f5405bc7740 1 Processor -- start 2024-09-19T06:23:44.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.235+0000 7f5405bc7740 1 -- start start 2024-09-19T06:23:44.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.235+0000 7f5405bc7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6ddcc70 0x5576e6ddd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.235+0000 7f5405bc7740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e6ddd590 0x5576e6de7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.235+0000 7f5405bc7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e6de7e50 0x5576e6dea240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.235+0000 7f5405bc7740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5576e6d433e0 con 0x5576e6ddd590 2024-09-19T06:23:44.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.235+0000 7f5405bc7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5576e6cead80 con 0x5576e6de7e50 2024-09-19T06:23:44.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.235+0000 7f5405bc7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5576e6d3f3a0 con 0x5576e6ddcc70 2024-09-19T06:23:44.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.236+0000 7f5401200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6ddcc70 0x5576e6ddd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.236+0000 7f53fbe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e6ddd590 0x5576e6de7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.236+0000 7f5401200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6ddcc70 0x5576e6ddd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:52648/0 (socket says 172.21.15.3:52648) 2024-09-19T06:23:44.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.236+0000 7f5401200640 1 -- 172.21.15.3:0/3431451087 learned_addr learned my addr 172.21.15.3:0/3431451087 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:44.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.236+0000 7f53fb400640 1 --2- 172.21.15.3:0/3431451087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e6de7e50 0x5576e6dea240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.236+0000 7f5401200640 1 -- 172.21.15.3:0/3431451087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e6de7e50 msgr2=0x5576e6dea240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:44.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.236+0000 7f5401200640 1 --2- 172.21.15.3:0/3431451087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e6de7e50 0x5576e6dea240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.236+0000 7f5401200640 1 -- 172.21.15.3:0/3431451087 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e6ddd590 msgr2=0x5576e6de7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:44.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.236+0000 7f5401200640 1 --2- 172.21.15.3:0/3431451087 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e6ddd590 0x5576e6de7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.236+0000 7f5401200640 1 -- 172.21.15.3:0/3431451087 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576e6d09ae0 con 0x5576e6ddcc70 2024-09-19T06:23:44.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.237+0000 7f5401200640 1 --2- 172.21.15.3:0/3431451087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6ddcc70 0x5576e6ddd050 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009ca0 tx=0x7f53f40093e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9995a4bdf8914201 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:44.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.237+0000 7f53f8c00640 1 --2- 172.21.15.3:0/3024240723 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f53e00a33b0 0x7f53e00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.237+0000 7f53f8c00640 1 -- 172.21.15.3:0/3024240723 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7f53ec0d0140 con 0x7f53fc103ff0 2024-09-19T06:23:44.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.237+0000 7f53f1600640 1 -- 172.21.15.3:0/3431451087 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f4031db0 con 0x5576e6ddcc70 2024-09-19T06:23:44.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.237+0000 7f53fbe00640 1 --2- 172.21.15.3:0/3024240723 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f53e00a33b0 0x7f53e00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.237+0000 7f53f1600640 1 -- 172.21.15.3:0/3431451087 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53f4036030 con 0x5576e6ddcc70 2024-09-19T06:23:44.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.237+0000 7f53f1600640 1 -- 172.21.15.3:0/3431451087 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f4004330 con 0x5576e6ddcc70 2024-09-19T06:23:44.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.238+0000 7f5405bc7740 1 -- 172.21.15.3:0/3431451087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6ddcc70 msgr2=0x5576e6ddd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:44.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.238+0000 7f5405bc7740 1 --2- 172.21.15.3:0/3431451087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6ddcc70 0x5576e6ddd050 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009ca0 tx=0x7f53f40093e0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.238+0000 7f53fbe00640 1 --2- 172.21.15.3:0/3024240723 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f53e00a33b0 0x7f53e00a5870 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x5576e6dda060 tx=0x7f53ec0d3bf0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:44.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.238+0000 7f5405bc7740 1 -- 172.21.15.3:0/3431451087 shutdown_connections 2024-09-19T06:23:44.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.238+0000 7f5405bc7740 1 --2- 172.21.15.3:0/3431451087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e6de7e50 0x5576e6dea240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.238+0000 7f5405bc7740 1 --2- 172.21.15.3:0/3431451087 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e6ddd590 0x5576e6de7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.238+0000 7f5405bc7740 1 --2- 172.21.15.3:0/3431451087 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6ddcc70 0x5576e6ddd050 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.238+0000 7f5405bc7740 1 -- 172.21.15.3:0/3431451087 >> 172.21.15.3:0/3431451087 conn(0x5576e6dd9200 msgr2=0x5576e6dd95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:44.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.238+0000 7f5405bc7740 1 -- 172.21.15.3:0/3431451087 shutdown_connections 2024-09-19T06:23:44.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.238+0000 7f5405bc7740 1 -- 172.21.15.3:0/3431451087 wait complete. 2024-09-19T06:23:44.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.238+0000 7f5405bc7740 1 -- start start 2024-09-19T06:23:44.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.239+0000 7f5405bc7740 1 Processor -- start 2024-09-19T06:23:44.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.239+0000 7f5405bc7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6ddcc70 0x5576e6de4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.239+0000 7f5405bc7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e6ddd590 0x5576e6de5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.239+0000 7f5405bc7740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e6de7e50 0x5576e6de57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.239+0000 7f5405bc7740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5576e6dea8a0 con 0x5576e6de7e50 2024-09-19T06:23:44.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.239+0000 7f5405bc7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5576e6cfe0f0 con 0x5576e6ddd590 2024-09-19T06:23:44.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.239+0000 7f5405bc7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5576e6deaa20 con 0x5576e6ddcc70 2024-09-19T06:23:44.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.239+0000 7f5405bc7740 10 client.0 _ll_register_callbacks cb 0x5576e6ce5bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:44.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.239+0000 7f5401200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6ddcc70 0x5576e6de4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.240+0000 7f5401200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6ddcc70 0x5576e6de4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:52652/0 (socket says 172.21.15.3:52652) 2024-09-19T06:23:44.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.240+0000 7f5401200640 1 -- 172.21.15.3:0/2409193460 learned_addr learned my addr 172.21.15.3:0/2409193460 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:44.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.240+0000 7f53fb400640 1 --2- 172.21.15.3:0/2409193460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e6ddd590 0x5576e6de5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.240+0000 7f5401200640 1 --2- 172.21.15.3:0/2409193460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e6de7e50 0x5576e6de57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.240+0000 7f53fb400640 1 -- 172.21.15.3:0/2409193460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6ddcc70 msgr2=0x5576e6de4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:44.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.240+0000 7f53fb400640 1 --2- 172.21.15.3:0/2409193460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6ddcc70 0x5576e6de4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.240+0000 7f53fb400640 1 -- 172.21.15.3:0/2409193460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e6de7e50 msgr2=0x5576e6de57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:44.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.240+0000 7f53fb400640 1 --2- 172.21.15.3:0/2409193460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e6de7e50 0x5576e6de57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.240+0000 7f53fb400640 1 -- 172.21.15.3:0/2409193460 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576e6ab43c0 con 0x5576e6ddd590 2024-09-19T06:23:44.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.240+0000 7f53fb400640 1 --2- 172.21.15.3:0/2409193460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e6ddd590 0x5576e6de5280 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f53e8009620 tx=0x7f53e800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22491864509cdf5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:44.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.240+0000 7f53e6000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:23:44.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.241+0000 7f53e6000640 1 -- 172.21.15.3:0/2409193460 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e8012110 con 0x5576e6ddd590 2024-09-19T06:23:44.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.241+0000 7f5405bc7740 1 -- 172.21.15.3:0/2409193460 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53f4036030 con 0x5576e6ddd590 2024-09-19T06:23:44.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.241+0000 7f53e6000640 1 -- 172.21.15.3:0/2409193460 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7f53e8004050 con 0x5576e6ddd590 2024-09-19T06:23:44.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.241+0000 7f53e6000640 1 -- 172.21.15.3:0/2409193460 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f53e80122b0 con 0x5576e6ddd590 2024-09-19T06:23:44.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.241+0000 7f5405bc7740 10 client.28583 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:44.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.241+0000 7f5405bc7740 1 -- 172.21.15.3:0/2409193460 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5576e6df6940 con 0x5576e6ddd590 2024-09-19T06:23:44.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.241+0000 7f53e6000640 1 -- 172.21.15.3:0/2409193460 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53f4036030 con 0x5576e6ddd590 2024-09-19T06:23:44.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.241+0000 7f53e6000640 1 -- 172.21.15.3:0/2409193460 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f53e8010690 con 0x5576e6ddd590 2024-09-19T06:23:44.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.242+0000 7f5405bc7740 10 client.28583 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:44.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.242+0000 7f5405bc7740 10 client.28583 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:23:44.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.242+0000 7f5405bc7740 20 client.28583 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:44.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.242+0000 7f5405bc7740 1 --2- 172.21.15.3:0/2409193460 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5576e6df7e50 0x5576e6dfa270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.242+0000 7f5405bc7740 4 client.28583 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:44.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.242+0000 7f5405bc7740 1 -- 172.21.15.3:0/2409193460 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576e6d50950 con 0x5576e6df7e50 2024-09-19T06:23:44.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.242+0000 7f5401200640 1 --2- 172.21.15.3:0/2409193460 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5576e6df7e50 0x5576e6dfa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.242+0000 7f5401200640 1 --2- 172.21.15.3:0/2409193460 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5576e6df7e50 0x5576e6dfa270 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=77b41cc344ca1e0b server_cookie=b14e9766f8343bd6 in_seq=0 out_seq=0 2024-09-19T06:23:44.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.242+0000 7f53e6000640 10 client.28583 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:23:44.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.243+0000 7f53e6000640 1 -- 172.21.15.3:0/2409193460 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5576e6d50950 con 0x5576e6df7e50 2024-09-19T06:23:44.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.243+0000 7f53e6000640 10 client.28583 handle_command_reply: tid=0 2024-09-19T06:23:44.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.243+0000 7f5405bc7740 1 client.28583 shutdown 2024-09-19T06:23:44.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.243+0000 7f5405bc7740 1 -- 172.21.15.3:0/2409193460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e6ddd590 msgr2=0x5576e6de5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:44.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.243+0000 7f5405bc7740 1 --2- 172.21.15.3:0/2409193460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e6ddd590 0x5576e6de5280 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f53e8009620 tx=0x7f53e800f790 comp rx=0 tx=0).stop 2024-09-19T06:23:44.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.243+0000 7f5405bc7740 1 -- 172.21.15.3:0/2409193460 shutdown_connections 2024-09-19T06:23:44.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.243+0000 7f5405bc7740 1 --2- 172.21.15.3:0/2409193460 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5576e6df7e50 0x5576e6dfa270 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.244+0000 7f5405bc7740 1 --2- 172.21.15.3:0/2409193460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e6de7e50 0x5576e6de57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.244+0000 7f5405bc7740 1 --2- 172.21.15.3:0/2409193460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e6ddd590 0x5576e6de5280 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.244+0000 7f53e6000640 0 client.28583 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:23:44.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.244+0000 7f5405bc7740 1 --2- 172.21.15.3:0/2409193460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6ddcc70 0x5576e6de4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.244+0000 7f5405bc7740 1 -- 172.21.15.3:0/2409193460 >> 172.21.15.3:0/2409193460 conn(0x5576e6dd9200 msgr2=0x5576e6dd8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:44.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.244+0000 7f5405bc7740 1 -- 172.21.15.3:0/2409193460 shutdown_connections 2024-09-19T06:23:44.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.244+0000 7f5405bc7740 1 -- 172.21.15.3:0/2409193460 wait complete. 2024-09-19T06:23:44.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.244+0000 7f5405bc7740 20 client.28583 trim_cache size 0 max 16384 2024-09-19T06:23:44.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.257+0000 7f5405bc7740 1 Processor -- start 2024-09-19T06:23:44.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.258+0000 7f5405bc7740 1 -- start start 2024-09-19T06:23:44.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.258+0000 7f5405bc7740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e6ddcc70 0x5576e6de3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.258+0000 7f5405bc7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e6ddd590 0x5576e6de5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.258+0000 7f5405bc7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6de7e50 0x5576e6dffb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.258+0000 7f5405bc7740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc1afb40 con 0x5576e6ddcc70 2024-09-19T06:23:44.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.258+0000 7f5405bc7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc1b1680 con 0x5576e6ddd590 2024-09-19T06:23:44.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.258+0000 7f5405bc7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc1b0210 con 0x5576e6de7e50 2024-09-19T06:23:44.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.258+0000 7f5401200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e6ddcc70 0x5576e6de3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.258+0000 7f5401200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e6ddcc70 0x5576e6de3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38924/0 (socket says 172.21.15.3:38924) 2024-09-19T06:23:44.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.258+0000 7f5401200640 1 -- 172.21.15.3:0/2806011518 learned_addr learned my addr 172.21.15.3:0/2806011518 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:44.261 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.258+0000 7f53fb400640 1 --2- 172.21.15.3:0/2806011518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e6ddd590 0x5576e6de5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.259+0000 7f5401200640 1 --2- 172.21.15.3:0/2806011518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6de7e50 0x5576e6dffb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.259+0000 7f5401200640 1 -- 172.21.15.3:0/2806011518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6de7e50 msgr2=0x5576e6dffb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:44.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.259+0000 7f5401200640 1 --2- 172.21.15.3:0/2806011518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6de7e50 0x5576e6dffb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.259+0000 7f5401200640 1 -- 172.21.15.3:0/2806011518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e6ddd590 msgr2=0x5576e6de5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:44.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.259+0000 7f5401200640 1 --2- 172.21.15.3:0/2806011518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e6ddd590 0x5576e6de5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.259+0000 7f5401200640 1 -- 172.21.15.3:0/2806011518 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576e6ddd3c0 con 0x5576e6ddcc70 2024-09-19T06:23:44.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.259+0000 7f5401200640 1 --2- 172.21.15.3:0/2806011518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e6ddcc70 0x5576e6de3610 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f53f402aeb0 tx=0x7f53f4005df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5a9517b87b2018 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:44.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.259+0000 7f53f0c00640 1 -- 172.21.15.3:0/2806011518 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f405f070 con 0x5576e6ddcc70 2024-09-19T06:23:44.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.259+0000 7f53f0c00640 1 -- 172.21.15.3:0/2806011518 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53f4036040 con 0x5576e6ddcc70 2024-09-19T06:23:44.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.259+0000 7f53f0c00640 1 -- 172.21.15.3:0/2806011518 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f4004290 con 0x5576e6ddcc70 2024-09-19T06:23:44.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.260+0000 7f5405bc7740 1 -- 172.21.15.3:0/2806011518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e6ddcc70 msgr2=0x5576e6de3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:44.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.260+0000 7f5405bc7740 1 --2- 172.21.15.3:0/2806011518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e6ddcc70 0x5576e6de3610 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f53f402aeb0 tx=0x7f53f4005df0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.260+0000 7f5405bc7740 1 -- 172.21.15.3:0/2806011518 shutdown_connections 2024-09-19T06:23:44.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.260+0000 7f5405bc7740 1 --2- 172.21.15.3:0/2806011518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6de7e50 0x5576e6dffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.260+0000 7f5405bc7740 1 --2- 172.21.15.3:0/2806011518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e6ddd590 0x5576e6de5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.260+0000 7f5405bc7740 1 --2- 172.21.15.3:0/2806011518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e6ddcc70 0x5576e6de3610 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.260+0000 7f5405bc7740 1 -- 172.21.15.3:0/2806011518 >> 172.21.15.3:0/2806011518 conn(0x5576e6dd9200 msgr2=0x5576e6de6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:44.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.260+0000 7f5405bc7740 1 -- 172.21.15.3:0/2806011518 shutdown_connections 2024-09-19T06:23:44.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.260+0000 7f5405bc7740 1 -- 172.21.15.3:0/2806011518 wait complete. 2024-09-19T06:23:44.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.260+0000 7f5405bc7740 1 -- start start 2024-09-19T06:23:44.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.261+0000 7f5405bc7740 1 Processor -- start 2024-09-19T06:23:44.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.261+0000 7f5405bc7740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e6ddcc70 0x5576e6df0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.261+0000 7f5405bc7740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6ddd590 0x5576e6de1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.261+0000 7f5405bc7740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e6de7e50 0x5576e6de1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.261+0000 7f5405bc7740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc1b0fb0 con 0x5576e6de7e50 2024-09-19T06:23:44.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.261+0000 7f5405bc7740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc1b08e0 con 0x5576e6ddcc70 2024-09-19T06:23:44.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.261+0000 7f5405bc7740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc1adb40 con 0x5576e6ddd590 2024-09-19T06:23:44.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.261+0000 7f5405bc7740 10 client.0 _ll_register_callbacks cb 0x7f53e8009d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:44.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.261+0000 7f53fb400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6ddd590 0x5576e6de1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.261+0000 7f5401200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e6ddcc70 0x5576e6df0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.261+0000 7f53fb400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6ddd590 0x5576e6de1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:52660/0 (socket says 172.21.15.3:52660) 2024-09-19T06:23:44.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.262+0000 7f5401200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e6de7e50 0x5576e6de1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.262+0000 7f53fb400640 1 -- 172.21.15.3:0/440285204 learned_addr learned my addr 172.21.15.3:0/440285204 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:44.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.262+0000 7f53fb400640 1 -- 172.21.15.3:0/440285204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e6ddcc70 msgr2=0x5576e6df0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:44.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.262+0000 7f53fb400640 1 --2- 172.21.15.3:0/440285204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e6ddcc70 0x5576e6df0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.262+0000 7f53fb400640 1 -- 172.21.15.3:0/440285204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e6de7e50 msgr2=0x5576e6de1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:44.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.262+0000 7f53fb400640 1 --2- 172.21.15.3:0/440285204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e6de7e50 0x5576e6de1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.262+0000 7f53fb400640 1 -- 172.21.15.3:0/440285204 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576e6de23b0 con 0x5576e6ddd590 2024-09-19T06:23:44.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.262+0000 7f53fb400640 1 --2- 172.21.15.3:0/440285204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6ddd590 0x5576e6de1880 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x5576e6de6380 tx=0x7f53e8012110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcb67cb6ee958741 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:44.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.262+0000 7f53e6000640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:23:44.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.262+0000 7f53e6000640 1 -- 172.21.15.3:0/440285204 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e8028030 con 0x5576e6ddd590 2024-09-19T06:23:44.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.263+0000 7f5405bc7740 1 -- 172.21.15.3:0/440285204 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53f4036040 con 0x5576e6ddd590 2024-09-19T06:23:44.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.263+0000 7f53e6000640 1 -- 172.21.15.3:0/440285204 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7f53e8010780 con 0x5576e6ddd590 2024-09-19T06:23:44.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.263+0000 7f53e6000640 1 -- 172.21.15.3:0/440285204 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f53e803a050 con 0x5576e6ddd590 2024-09-19T06:23:44.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.263+0000 7f5405bc7740 10 client.28564 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:44.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.263+0000 7f5405bc7740 1 -- 172.21.15.3:0/440285204 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5576e6e628f0 con 0x5576e6ddd590 2024-09-19T06:23:44.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.263+0000 7f53e6000640 1 -- 172.21.15.3:0/440285204 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53f4036040 con 0x5576e6ddd590 2024-09-19T06:23:44.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.263+0000 7f53e6000640 1 -- 172.21.15.3:0/440285204 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f53e8035030 con 0x5576e6ddd590 2024-09-19T06:23:44.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.263+0000 7f5405bc7740 10 client.28564 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:44.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.263+0000 7f5405bc7740 10 client.28564 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:23:44.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.263+0000 7f5405bc7740 20 client.28564 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:44.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.263+0000 7f5405bc7740 1 --2- 172.21.15.3:0/440285204 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5576e6e63060 0x5576e6e65480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:44.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.263+0000 7f5405bc7740 4 client.28564 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:23:44.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.263+0000 7f5405bc7740 1 -- 172.21.15.3:0/440285204 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5576e6d4ae60 con 0x5576e6e63060 2024-09-19T06:23:44.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.264+0000 7f5401200640 1 --2- 172.21.15.3:0/440285204 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5576e6e63060 0x5576e6e65480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.264+0000 7f5401200640 1 --2- 172.21.15.3:0/440285204 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5576e6e63060 0x5576e6e65480 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3b73563934771967 server_cookie=7cd09d0b54ac1019 in_seq=0 out_seq=0 2024-09-19T06:23:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.264+0000 7f53e6000640 10 client.28564 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:23:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.264+0000 7f53e6000640 1 -- 172.21.15.3:0/440285204 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5576e6d4ae60 con 0x5576e6e63060 2024-09-19T06:23:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.264+0000 7f53e6000640 10 client.28564 handle_command_reply: tid=0 2024-09-19T06:23:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.264+0000 7f5405bc7740 1 client.28564 shutdown 2024-09-19T06:23:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.265+0000 7f5405bc7740 1 -- 172.21.15.3:0/440285204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6ddd590 msgr2=0x5576e6de1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.265+0000 7f5405bc7740 1 --2- 172.21.15.3:0/440285204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6ddd590 0x5576e6de1880 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x5576e6de6380 tx=0x7f53e8012110 comp rx=0 tx=0).stop 2024-09-19T06:23:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.265+0000 7f5405bc7740 1 -- 172.21.15.3:0/440285204 shutdown_connections 2024-09-19T06:23:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.265+0000 7f5405bc7740 1 --2- 172.21.15.3:0/440285204 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x5576e6e63060 0x5576e6e65480 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.265+0000 7f5405bc7740 1 --2- 172.21.15.3:0/440285204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5576e6de7e50 0x5576e6de1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.265+0000 7f5405bc7740 1 --2- 172.21.15.3:0/440285204 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5576e6ddd590 0x5576e6de1880 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.265+0000 7f5405bc7740 1 --2- 172.21.15.3:0/440285204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5576e6ddcc70 0x5576e6df0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.265+0000 7f53e6000640 0 client.28564 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:23:44.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.265+0000 7f5405bc7740 1 -- 172.21.15.3:0/440285204 >> 172.21.15.3:0/440285204 conn(0x5576e6dd9200 msgr2=0x5576e6dde6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:44.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.265+0000 7f5405bc7740 1 -- 172.21.15.3:0/440285204 shutdown_connections 2024-09-19T06:23:44.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.265+0000 7f5405bc7740 1 -- 172.21.15.3:0/440285204 wait complete. 2024-09-19T06:23:44.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.265+0000 7f5405bc7740 20 client.28564 trim_cache size 0 max 16384 2024-09-19T06:23:44.271 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:23:44.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.266+0000 7f5403200640 1 -- 172.21.15.3:0/3024240723 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f53e00a33b0 msgr2=0x7f53e00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:44.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.266+0000 7f5403200640 1 --2- 172.21.15.3:0/3024240723 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f53e00a33b0 0x7f53e00a5870 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x5576e6dda060 tx=0x7f53ec0d3bf0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.266+0000 7f5403200640 1 -- 172.21.15.3:0/3024240723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53fc103ff0 msgr2=0x7f53fc19a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:44.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.266+0000 7f5403200640 1 --2- 172.21.15.3:0/3024240723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53fc103ff0 0x7f53fc19a5a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00e9f0 tx=0x7f53ec00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.266+0000 7f5403200640 1 -- 172.21.15.3:0/3024240723 shutdown_connections 2024-09-19T06:23:44.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.266+0000 7f5403200640 1 --2- 172.21.15.3:0/3024240723 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f53e00a33b0 0x7f53e00a5870 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.266+0000 7f5403200640 1 --2- 172.21.15.3:0/3024240723 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f53fc109120 0x7f53fc19ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.266+0000 7f5403200640 1 --2- 172.21.15.3:0/3024240723 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f53fc1049a0 0x7f53fc19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.266+0000 7f5403200640 1 --2- 172.21.15.3:0/3024240723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53fc103ff0 0x7f53fc19a5a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:44.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.266+0000 7f5403200640 1 -- 172.21.15.3:0/3024240723 >> 172.21.15.3:0/3024240723 conn(0x7f53fc0ffa90 msgr2=0x7f53fc1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:44.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.266+0000 7f5403200640 1 -- 172.21.15.3:0/3024240723 shutdown_connections 2024-09-19T06:23:44.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:44.266+0000 7f5403200640 1 -- 172.21.15.3:0/3024240723 wait complete. 2024-09-19T06:23:44.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:44 smithi059 ceph-mon[35138]: pgmap v353: 97 pgs: 97 active+clean; 2.8 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:23:44.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:44 smithi071 ceph-mon[35662]: pgmap v353: 97 pgs: 97 active+clean; 2.8 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 15 op/s 2024-09-19T06:23:45.257 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:23:45.641 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:46.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:46 smithi003 ceph-mon[30893]: pgmap v354: 97 pgs: 97 active+clean; 3.0 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 59 KiB/s wr, 22 op/s 2024-09-19T06:23:46.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.269+0000 7fef84e00640 1 -- 172.21.15.3:0/1869221511 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef80106f10 msgr2=0x7fef8010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:46.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.269+0000 7fef84e00640 1 --2- 172.21.15.3:0/1869221511 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef80106f10 0x7fef8010ea90 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fef78009900 tx=0x7fef7802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.269+0000 7fef84e00640 1 -- 172.21.15.3:0/1869221511 shutdown_connections 2024-09-19T06:23:46.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.269+0000 7fef84e00640 1 --2- 172.21.15.3:0/1869221511 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef80106f10 0x7fef8010ea90 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.269+0000 7fef84e00640 1 --2- 172.21.15.3:0/1869221511 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef80102790 0x7fef801067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.269+0000 7fef84e00640 1 --2- 172.21.15.3:0/1869221511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef80101de0 0x7fef801021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.269+0000 7fef84e00640 1 -- 172.21.15.3:0/1869221511 >> 172.21.15.3:0/1869221511 conn(0x7fef800fd8c0 msgr2=0x7fef800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:46.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.269+0000 7fef84e00640 1 -- 172.21.15.3:0/1869221511 shutdown_connections 2024-09-19T06:23:46.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.269+0000 7fef84e00640 1 -- 172.21.15.3:0/1869221511 wait complete. 2024-09-19T06:23:46.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.270+0000 7fef84e00640 1 Processor -- start 2024-09-19T06:23:46.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.270+0000 7fef84e00640 1 -- start start 2024-09-19T06:23:46.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.270+0000 7fef84e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef80101de0 0x7fef8019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:46.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.270+0000 7fef84e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef80102790 0x7fef8019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:46.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.270+0000 7fef84e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef80106f10 0x7fef8019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:46.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.270+0000 7fef84e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fef80111fc0 con 0x7fef80101de0 2024-09-19T06:23:46.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.270+0000 7fef84e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fef80111e40 con 0x7fef80102790 2024-09-19T06:23:46.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.270+0000 7fef84e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fef80112140 con 0x7fef80106f10 2024-09-19T06:23:46.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.270+0000 7fef7de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef80101de0 0x7fef8019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:46.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.271+0000 7fef7de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef80101de0 0x7fef8019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38942/0 (socket says 172.21.15.3:38942) 2024-09-19T06:23:46.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.271+0000 7fef7e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef80106f10 0x7fef8019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:46.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.271+0000 7fef7de00640 1 -- 172.21.15.3:0/1206523323 learned_addr learned my addr 172.21.15.3:0/1206523323 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:46.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.271+0000 7fef75400640 1 --2- 172.21.15.3:0/1206523323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef80102790 0x7fef8019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:46.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.271+0000 7fef7e800640 1 -- 172.21.15.3:0/1206523323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef80102790 msgr2=0x7fef8019aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:46.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.271+0000 7fef7e800640 1 --2- 172.21.15.3:0/1206523323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef80102790 0x7fef8019aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.271+0000 7fef7e800640 1 -- 172.21.15.3:0/1206523323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef80101de0 msgr2=0x7fef8019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:46.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.271+0000 7fef7e800640 1 --2- 172.21.15.3:0/1206523323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef80101de0 0x7fef8019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.271+0000 7fef7e800640 1 -- 172.21.15.3:0/1206523323 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8019f610 con 0x7fef80106f10 2024-09-19T06:23:46.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.271+0000 7fef7de00640 1 --2- 172.21.15.3:0/1206523323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef80101de0 0x7fef8019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:46.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.271+0000 7fef7e800640 1 --2- 172.21.15.3:0/1206523323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef80106f10 0x7fef8019ef30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fef7802a910 tx=0x7fef78003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:46.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.272+0000 7fef77400640 1 -- 172.21.15.3:0/1206523323 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7803f070 con 0x7fef80106f10 2024-09-19T06:23:46.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.272+0000 7fef77400640 1 -- 172.21.15.3:0/1206523323 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef78031c90 con 0x7fef80106f10 2024-09-19T06:23:46.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.272+0000 7fef84e00640 1 -- 172.21.15.3:0/1206523323 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef8019f8a0 con 0x7fef80106f10 2024-09-19T06:23:46.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.272+0000 7fef77400640 1 -- 172.21.15.3:0/1206523323 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef78035030 con 0x7fef80106f10 2024-09-19T06:23:46.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.272+0000 7fef84e00640 1 -- 172.21.15.3:0/1206523323 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef8019fd50 con 0x7fef80106f10 2024-09-19T06:23:46.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.275+0000 7fef77400640 1 -- 172.21.15.3:0/1206523323 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fef78042070 con 0x7fef80106f10 2024-09-19T06:23:46.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.275+0000 7fef879f9740 1 Processor -- start 2024-09-19T06:23:46.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.275+0000 7fef879f9740 1 -- start start 2024-09-19T06:23:46.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.276+0000 7fef879f9740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6744c70 0x5595f6745050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:46.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.276+0000 7fef879f9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595f6745590 0x5595f674f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:46.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.276+0000 7fef879f9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595f674fe50 0x5595f6752240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:46.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.276+0000 7fef879f9740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5595f66ab3e0 con 0x5595f6744c70 2024-09-19T06:23:46.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.276+0000 7fef879f9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5595f6652d80 con 0x5595f674fe50 2024-09-19T06:23:46.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.276+0000 7fef879f9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5595f66a73a0 con 0x5595f6745590 2024-09-19T06:23:46.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.276+0000 7fef75400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6744c70 0x5595f6745050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:46.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.276+0000 7fef75400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6744c70 0x5595f6745050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38944/0 (socket says 172.21.15.3:38944) 2024-09-19T06:23:46.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.276+0000 7fef7de00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595f6745590 0x5595f674f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:46.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.276+0000 7fef75400640 1 -- 172.21.15.3:0/1597477566 learned_addr learned my addr 172.21.15.3:0/1597477566 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:46.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.276+0000 7fef75400640 1 --2- 172.21.15.3:0/1597477566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595f674fe50 0x5595f6752240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:46.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.276+0000 7fef77400640 1 --2- 172.21.15.3:0/1206523323 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fef640a33b0 0x7fef640a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:46.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.276+0000 7fef77400640 1 -- 172.21.15.3:0/1206523323 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7fef780f0300 con 0x7fef80106f10 2024-09-19T06:23:46.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.277+0000 7fef75400640 1 -- 172.21.15.3:0/1597477566 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595f6745590 msgr2=0x5595f674f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:46.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.277+0000 7fef75400640 1 --2- 172.21.15.3:0/1597477566 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595f6745590 0x5595f674f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.277+0000 7fef75400640 1 -- 172.21.15.3:0/1597477566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595f674fe50 msgr2=0x5595f6752240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:46.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.277+0000 7fef75400640 1 --2- 172.21.15.3:0/1597477566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595f674fe50 0x5595f6752240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.277+0000 7fef75400640 1 -- 172.21.15.3:0/1597477566 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595f6671ae0 con 0x5595f6744c70 2024-09-19T06:23:46.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.277+0000 7fef7e800640 1 --2- 172.21.15.3:0/1206523323 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fef640a33b0 0x7fef640a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:46.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.277+0000 7fef7de00640 1 --2- 172.21.15.3:0/1597477566 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595f6745590 0x5595f674f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:46.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.277+0000 7fef75400640 1 --2- 172.21.15.3:0/1597477566 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6744c70 0x5595f6745050 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x5595f6742580 tx=0x7fef68005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61340a163a35d84f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:46.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.278+0000 7fef6f400640 1 -- 172.21.15.3:0/1597477566 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef680131b0 con 0x5595f6744c70 2024-09-19T06:23:46.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.278+0000 7fef6f400640 1 -- 172.21.15.3:0/1597477566 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef68013ce0 con 0x5595f6744c70 2024-09-19T06:23:46.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.278+0000 7fef7e800640 1 --2- 172.21.15.3:0/1206523323 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fef640a33b0 0x7fef640a5870 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fef78006010 tx=0x7fef7802a3f0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:46.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.278+0000 7fef6f400640 1 -- 172.21.15.3:0/1597477566 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef680035f0 con 0x5595f6744c70 2024-09-19T06:23:46.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.278+0000 7fef879f9740 1 -- 172.21.15.3:0/1597477566 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6744c70 msgr2=0x5595f6745050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:46.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.278+0000 7fef879f9740 1 --2- 172.21.15.3:0/1597477566 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6744c70 0x5595f6745050 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x5595f6742580 tx=0x7fef68005850 comp rx=0 tx=0).stop 2024-09-19T06:23:46.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.278+0000 7fef879f9740 1 -- 172.21.15.3:0/1597477566 shutdown_connections 2024-09-19T06:23:46.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.278+0000 7fef879f9740 1 --2- 172.21.15.3:0/1597477566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595f674fe50 0x5595f6752240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.278+0000 7fef879f9740 1 --2- 172.21.15.3:0/1597477566 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595f6745590 0x5595f674f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.278+0000 7fef879f9740 1 --2- 172.21.15.3:0/1597477566 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6744c70 0x5595f6745050 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.278+0000 7fef879f9740 1 -- 172.21.15.3:0/1597477566 >> 172.21.15.3:0/1597477566 conn(0x5595f6741200 msgr2=0x5595f67415e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:46.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.278+0000 7fef879f9740 1 -- 172.21.15.3:0/1597477566 shutdown_connections 2024-09-19T06:23:46.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.279+0000 7fef879f9740 1 -- 172.21.15.3:0/1597477566 wait complete. 2024-09-19T06:23:46.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.279+0000 7fef879f9740 1 -- start start 2024-09-19T06:23:46.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.279+0000 7fef879f9740 1 Processor -- start 2024-09-19T06:23:46.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.280+0000 7fef879f9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595f6744c70 0x5595f674cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:46.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.280+0000 7fef879f9740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6745590 0x5595f674d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:46.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.280+0000 7fef879f9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595f674fe50 0x5595f674d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:46.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.280+0000 7fef879f9740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5595f6752a20 con 0x5595f6745590 2024-09-19T06:23:46.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.280+0000 7fef879f9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5595f66660f0 con 0x5595f6744c70 2024-09-19T06:23:46.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.280+0000 7fef879f9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5595f6752ba0 con 0x5595f674fe50 2024-09-19T06:23:46.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.280+0000 7fef879f9740 10 client.0 _ll_register_callbacks cb 0x5595f664dbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:46.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.280+0000 7fef75400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595f6744c70 0x5595f674cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:46.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.280+0000 7fef7de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6745590 0x5595f674d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:46.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.280+0000 7fef75400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595f6744c70 0x5595f674cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44352/0 (socket says 172.21.15.3:44352) 2024-09-19T06:23:46.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.280+0000 7fef75400640 1 -- 172.21.15.3:0/3104309619 learned_addr learned my addr 172.21.15.3:0/3104309619 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:46.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.280+0000 7fef75400640 1 --2- 172.21.15.3:0/3104309619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595f674fe50 0x5595f674d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:46.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.280+0000 7fef7de00640 1 -- 172.21.15.3:0/3104309619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595f674fe50 msgr2=0x5595f674d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:46.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.280+0000 7fef7de00640 1 --2- 172.21.15.3:0/3104309619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595f674fe50 0x5595f674d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.280+0000 7fef7de00640 1 -- 172.21.15.3:0/3104309619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595f6744c70 msgr2=0x5595f674cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:46.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.280+0000 7fef7de00640 1 --2- 172.21.15.3:0/3104309619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595f6744c70 0x5595f674cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.280+0000 7fef7de00640 1 -- 172.21.15.3:0/3104309619 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595f641c3c0 con 0x5595f6745590 2024-09-19T06:23:46.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.281+0000 7fef7de00640 1 --2- 172.21.15.3:0/3104309619 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6745590 0x5595f674d2f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fef7000efa0 tx=0x7fef7000efd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ff39ec206cd83c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:46.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.281+0000 7fef63e00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:23:46.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.281+0000 7fef63e00640 1 -- 172.21.15.3:0/3104309619 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef70004b20 con 0x5595f6745590 2024-09-19T06:23:46.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.281+0000 7fef63e00640 1 -- 172.21.15.3:0/3104309619 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7fef70004cc0 con 0x5595f6745590 2024-09-19T06:23:46.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.281+0000 7fef879f9740 1 -- 172.21.15.3:0/3104309619 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef68013ce0 con 0x5595f6745590 2024-09-19T06:23:46.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.281+0000 7fef63e00640 1 -- 172.21.15.3:0/3104309619 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fef7000f5d0 con 0x5595f6745590 2024-09-19T06:23:46.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.281+0000 7fef879f9740 10 client.18567 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:46.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.281+0000 7fef879f9740 1 -- 172.21.15.3:0/3104309619 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5595f675eae0 con 0x5595f6745590 2024-09-19T06:23:46.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.282+0000 7fef63e00640 1 -- 172.21.15.3:0/3104309619 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef68013ce0 con 0x5595f6745590 2024-09-19T06:23:46.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.282+0000 7fef63e00640 1 -- 172.21.15.3:0/3104309619 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fef70019070 con 0x5595f6745590 2024-09-19T06:23:46.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.282+0000 7fef879f9740 10 client.18567 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:46.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.282+0000 7fef879f9740 10 client.18567 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:23:46.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.282+0000 7fef879f9740 20 client.18567 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:46.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.282+0000 7fef879f9740 1 --2- 172.21.15.3:0/3104309619 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5595f675ffa0 0x5595f6762400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:46.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.282+0000 7fef879f9740 4 client.18567 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:46.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.282+0000 7fef879f9740 1 -- 172.21.15.3:0/3104309619 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595f66b8950 con 0x5595f675ffa0 2024-09-19T06:23:46.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.282+0000 7fef75400640 1 --2- 172.21.15.3:0/3104309619 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5595f675ffa0 0x5595f6762400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:46.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:46 smithi059 ceph-mon[35138]: pgmap v354: 97 pgs: 97 active+clean; 3.0 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 59 KiB/s wr, 22 op/s 2024-09-19T06:23:46.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.283+0000 7fef75400640 1 --2- 172.21.15.3:0/3104309619 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5595f675ffa0 0x5595f6762400 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=10c69f3bfce60e34 server_cookie=9f3bccd1a11b1995 in_seq=0 out_seq=0 2024-09-19T06:23:46.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.283+0000 7fef63e00640 10 client.18567 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:23:46.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.284+0000 7fef63e00640 1 -- 172.21.15.3:0/3104309619 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5595f66b8950 con 0x5595f675ffa0 2024-09-19T06:23:46.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.284+0000 7fef63e00640 10 client.18567 handle_command_reply: tid=0 2024-09-19T06:23:46.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.284+0000 7fef879f9740 1 client.18567 shutdown 2024-09-19T06:23:46.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.284+0000 7fef879f9740 1 -- 172.21.15.3:0/3104309619 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6745590 msgr2=0x5595f674d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:46.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.284+0000 7fef879f9740 1 --2- 172.21.15.3:0/3104309619 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6745590 0x5595f674d2f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fef7000efa0 tx=0x7fef7000efd0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.284+0000 7fef879f9740 1 -- 172.21.15.3:0/3104309619 shutdown_connections 2024-09-19T06:23:46.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.284+0000 7fef879f9740 1 --2- 172.21.15.3:0/3104309619 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5595f675ffa0 0x5595f6762400 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.284+0000 7fef879f9740 1 --2- 172.21.15.3:0/3104309619 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595f674fe50 0x5595f674d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.284+0000 7fef879f9740 1 --2- 172.21.15.3:0/3104309619 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6745590 0x5595f674d2f0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.284+0000 7fef63e00640 0 client.18567 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:23:46.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.284+0000 7fef879f9740 1 --2- 172.21.15.3:0/3104309619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595f6744c70 0x5595f674cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.284+0000 7fef879f9740 1 -- 172.21.15.3:0/3104309619 >> 172.21.15.3:0/3104309619 conn(0x5595f6741200 msgr2=0x5595f6746f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:46.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.284+0000 7fef879f9740 1 -- 172.21.15.3:0/3104309619 shutdown_connections 2024-09-19T06:23:46.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.284+0000 7fef879f9740 1 -- 172.21.15.3:0/3104309619 wait complete. 2024-09-19T06:23:46.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.284+0000 7fef879f9740 20 client.18567 trim_cache size 0 max 16384 2024-09-19T06:23:46.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.298+0000 7fef879f9740 1 Processor -- start 2024-09-19T06:23:46.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.298+0000 7fef879f9740 1 -- start start 2024-09-19T06:23:46.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.298+0000 7fef879f9740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6744c70 0x5595f6747720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:46.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.298+0000 7fef879f9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595f6745590 0x5595f6767cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:46.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.298+0000 7fef879f9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595f674fe50 0x5595f6768210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:46.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.298+0000 7fef879f9740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fef801afb30 con 0x5595f6744c70 2024-09-19T06:23:46.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.298+0000 7fef879f9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fef801b1670 con 0x5595f6745590 2024-09-19T06:23:46.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.298+0000 7fef879f9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fef801b0200 con 0x5595f674fe50 2024-09-19T06:23:46.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.299+0000 7fef75400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6744c70 0x5595f6747720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:46.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.299+0000 7fef7de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595f6745590 0x5595f6767cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:46.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.299+0000 7fef75400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6744c70 0x5595f6747720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38960/0 (socket says 172.21.15.3:38960) 2024-09-19T06:23:46.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.299+0000 7fef7de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595f6745590 0x5595f6767cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44354/0 (socket says 172.21.15.3:44354) 2024-09-19T06:23:46.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.299+0000 7fef75400640 1 -- 172.21.15.3:0/3416259673 learned_addr learned my addr 172.21.15.3:0/3416259673 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:46.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.299+0000 7fef75400640 1 --2- 172.21.15.3:0/3416259673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595f674fe50 0x5595f6768210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:46.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.299+0000 7fef7de00640 1 -- 172.21.15.3:0/3416259673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595f674fe50 msgr2=0x5595f6768210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:46.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.299+0000 7fef7de00640 1 --2- 172.21.15.3:0/3416259673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595f674fe50 0x5595f6768210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.299+0000 7fef7de00640 1 -- 172.21.15.3:0/3416259673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6744c70 msgr2=0x5595f6747720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:46.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.299+0000 7fef7de00640 1 --2- 172.21.15.3:0/3416259673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6744c70 0x5595f6747720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.299+0000 7fef7de00640 1 -- 172.21.15.3:0/3416259673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595f673c770 con 0x5595f6745590 2024-09-19T06:23:46.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.299+0000 7fef75400640 1 --2- 172.21.15.3:0/3416259673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595f674fe50 0x5595f6768210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:23:46.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.299+0000 7fef7de00640 1 --2- 172.21.15.3:0/3416259673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595f6745590 0x5595f6767cd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fef7001aaf0 tx=0x7fef70009570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f795d0f6bb409c7f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:46.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.300+0000 7fef6ea00640 1 -- 172.21.15.3:0/3416259673 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef70031070 con 0x5595f6745590 2024-09-19T06:23:46.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.300+0000 7fef6ea00640 1 -- 172.21.15.3:0/3416259673 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef7001a8d0 con 0x5595f6745590 2024-09-19T06:23:46.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.300+0000 7fef6ea00640 1 -- 172.21.15.3:0/3416259673 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7000fdf0 con 0x5595f6745590 2024-09-19T06:23:46.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.300+0000 7fef879f9740 1 -- 172.21.15.3:0/3416259673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595f6745590 msgr2=0x5595f6767cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:46.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.300+0000 7fef879f9740 1 --2- 172.21.15.3:0/3416259673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595f6745590 0x5595f6767cd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fef7001aaf0 tx=0x7fef70009570 comp rx=0 tx=0).stop 2024-09-19T06:23:46.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.301+0000 7fef879f9740 1 -- 172.21.15.3:0/3416259673 shutdown_connections 2024-09-19T06:23:46.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.301+0000 7fef879f9740 1 --2- 172.21.15.3:0/3416259673 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595f674fe50 0x5595f6768210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.301+0000 7fef879f9740 1 --2- 172.21.15.3:0/3416259673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595f6745590 0x5595f6767cd0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.301+0000 7fef879f9740 1 --2- 172.21.15.3:0/3416259673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6744c70 0x5595f6747720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.301+0000 7fef879f9740 1 -- 172.21.15.3:0/3416259673 >> 172.21.15.3:0/3416259673 conn(0x5595f6741200 msgr2=0x5595f674ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:46.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.301+0000 7fef879f9740 1 -- 172.21.15.3:0/3416259673 shutdown_connections 2024-09-19T06:23:46.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.301+0000 7fef879f9740 1 -- 172.21.15.3:0/3416259673 wait complete. 2024-09-19T06:23:46.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.301+0000 7fef879f9740 1 -- start start 2024-09-19T06:23:46.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.301+0000 7fef879f9740 1 Processor -- start 2024-09-19T06:23:46.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.302+0000 7fef879f9740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6744c70 0x5595f6753d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:46.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.302+0000 7fef879f9740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595f6745590 0x5595f6754250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:46.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.302+0000 7fef879f9740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595f674fe50 0x5595f6754790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:46.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.302+0000 7fef879f9740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fef801b0fa0 con 0x5595f6744c70 2024-09-19T06:23:46.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.302+0000 7fef879f9740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fef801b08d0 con 0x5595f6745590 2024-09-19T06:23:46.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.302+0000 7fef879f9740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fef801adb30 con 0x5595f674fe50 2024-09-19T06:23:46.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.302+0000 7fef879f9740 10 client.0 _ll_register_callbacks cb 0x7fef70009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:46.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.302+0000 7fef75400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6744c70 0x5595f6753d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:46.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.302+0000 7fef75400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6744c70 0x5595f6753d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38964/0 (socket says 172.21.15.3:38964) 2024-09-19T06:23:46.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.302+0000 7fef75400640 1 -- 172.21.15.3:0/3301627113 learned_addr learned my addr 172.21.15.3:0/3301627113 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:46.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.302+0000 7fef7de00640 1 --2- 172.21.15.3:0/3301627113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595f6745590 0x5595f6754250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:46.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.302+0000 7fef75400640 1 --2- 172.21.15.3:0/3301627113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595f674fe50 0x5595f6754790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:46.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.302+0000 7fef75400640 1 -- 172.21.15.3:0/3301627113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595f674fe50 msgr2=0x5595f6754790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:46.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.302+0000 7fef75400640 1 --2- 172.21.15.3:0/3301627113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595f674fe50 0x5595f6754790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.302+0000 7fef75400640 1 -- 172.21.15.3:0/3301627113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595f6745590 msgr2=0x5595f6754250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:46.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.302+0000 7fef75400640 1 --2- 172.21.15.3:0/3301627113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595f6745590 0x5595f6754250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.302+0000 7fef75400640 1 -- 172.21.15.3:0/3301627113 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595f67c9ea0 con 0x5595f6744c70 2024-09-19T06:23:46.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.303+0000 7fef75400640 1 --2- 172.21.15.3:0/3301627113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6744c70 0x5595f6753d10 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fef68006010 tx=0x7fef68012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e00a9a8f302b9248 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:46.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.303+0000 7fef63e00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:23:46.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.303+0000 7fef63e00640 1 -- 172.21.15.3:0/3301627113 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef68032060 con 0x5595f6744c70 2024-09-19T06:23:46.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.303+0000 7fef879f9740 1 -- 172.21.15.3:0/3301627113 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef7001a8d0 con 0x5595f6744c70 2024-09-19T06:23:46.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.303+0000 7fef63e00640 1 -- 172.21.15.3:0/3301627113 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7fef68029040 con 0x5595f6744c70 2024-09-19T06:23:46.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.303+0000 7fef63e00640 1 -- 172.21.15.3:0/3301627113 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fef6800fbf0 con 0x5595f6744c70 2024-09-19T06:23:46.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.303+0000 7fef879f9740 10 client.18573 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:46.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.303+0000 7fef879f9740 1 -- 172.21.15.3:0/3301627113 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5595f67cb0b0 con 0x5595f6744c70 2024-09-19T06:23:46.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.303+0000 7fef63e00640 1 -- 172.21.15.3:0/3301627113 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef7001a8d0 con 0x5595f6744c70 2024-09-19T06:23:46.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.304+0000 7fef63e00640 1 -- 172.21.15.3:0/3301627113 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fef68003850 con 0x5595f6744c70 2024-09-19T06:23:46.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.304+0000 7fef879f9740 10 client.18573 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:46.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.304+0000 7fef879f9740 10 client.18573 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:23:46.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.304+0000 7fef879f9740 20 client.18573 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:46.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.304+0000 7fef879f9740 1 --2- 172.21.15.3:0/3301627113 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5595f67cb590 0x5595f67cd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:46.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.304+0000 7fef879f9740 4 client.18573 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:23:46.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.304+0000 7fef879f9740 1 -- 172.21.15.3:0/3301627113 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5595f66b2e60 con 0x5595f67cb590 2024-09-19T06:23:46.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.304+0000 7fef7de00640 1 --2- 172.21.15.3:0/3301627113 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5595f67cb590 0x5595f67cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:46.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.305+0000 7fef7de00640 1 --2- 172.21.15.3:0/3301627113 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5595f67cb590 0x5595f67cd980 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fb235227ab440b4e server_cookie=9c3feb1adfcb329f in_seq=0 out_seq=0 2024-09-19T06:23:46.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.305+0000 7fef63e00640 10 client.18573 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:23:46.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.305+0000 7fef63e00640 1 -- 172.21.15.3:0/3301627113 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5595f66b2e60 con 0x5595f67cb590 2024-09-19T06:23:46.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.305+0000 7fef63e00640 10 client.18573 handle_command_reply: tid=0 2024-09-19T06:23:46.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.305+0000 7fef879f9740 1 client.18573 shutdown 2024-09-19T06:23:46.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.305+0000 7fef879f9740 1 -- 172.21.15.3:0/3301627113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6744c70 msgr2=0x5595f6753d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:46.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.305+0000 7fef879f9740 1 --2- 172.21.15.3:0/3301627113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6744c70 0x5595f6753d10 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fef68006010 tx=0x7fef68012040 comp rx=0 tx=0).stop 2024-09-19T06:23:46.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.305+0000 7fef879f9740 1 -- 172.21.15.3:0/3301627113 shutdown_connections 2024-09-19T06:23:46.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.305+0000 7fef879f9740 1 --2- 172.21.15.3:0/3301627113 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5595f67cb590 0x5595f67cd980 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.305+0000 7fef879f9740 1 --2- 172.21.15.3:0/3301627113 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5595f674fe50 0x5595f6754790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.305+0000 7fef879f9740 1 --2- 172.21.15.3:0/3301627113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5595f6745590 0x5595f6754250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.305+0000 7fef879f9740 1 --2- 172.21.15.3:0/3301627113 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5595f6744c70 0x5595f6753d10 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.305+0000 7fef879f9740 1 -- 172.21.15.3:0/3301627113 >> 172.21.15.3:0/3301627113 conn(0x5595f6741200 msgr2=0x5595f673fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:46.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.305+0000 7fef63e00640 0 client.18573 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:23:46.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.305+0000 7fef879f9740 1 -- 172.21.15.3:0/3301627113 shutdown_connections 2024-09-19T06:23:46.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.305+0000 7fef879f9740 1 -- 172.21.15.3:0/3301627113 wait complete. 2024-09-19T06:23:46.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.306+0000 7fef879f9740 20 client.18573 trim_cache size 0 max 16384 2024-09-19T06:23:46.312 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:23:46.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.306+0000 7fef84e00640 1 -- 172.21.15.3:0/1206523323 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fef640a33b0 msgr2=0x7fef640a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:46.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.306+0000 7fef84e00640 1 --2- 172.21.15.3:0/1206523323 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fef640a33b0 0x7fef640a5870 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fef78006010 tx=0x7fef7802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.306+0000 7fef84e00640 1 -- 172.21.15.3:0/1206523323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef80106f10 msgr2=0x7fef8019ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:46.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.306+0000 7fef84e00640 1 --2- 172.21.15.3:0/1206523323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef80106f10 0x7fef8019ef30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fef7802a910 tx=0x7fef78003b90 comp rx=0 tx=0).stop 2024-09-19T06:23:46.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.306+0000 7fef84e00640 1 -- 172.21.15.3:0/1206523323 shutdown_connections 2024-09-19T06:23:46.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.306+0000 7fef84e00640 1 --2- 172.21.15.3:0/1206523323 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fef640a33b0 0x7fef640a5870 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.306+0000 7fef84e00640 1 --2- 172.21.15.3:0/1206523323 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fef80106f10 0x7fef8019ef30 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.306+0000 7fef84e00640 1 --2- 172.21.15.3:0/1206523323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef80102790 0x7fef8019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.306+0000 7fef84e00640 1 --2- 172.21.15.3:0/1206523323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef80101de0 0x7fef8019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:46.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.306+0000 7fef84e00640 1 -- 172.21.15.3:0/1206523323 >> 172.21.15.3:0/1206523323 conn(0x7fef800fd8c0 msgr2=0x7fef800fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:46.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.307+0000 7fef84e00640 1 -- 172.21.15.3:0/1206523323 shutdown_connections 2024-09-19T06:23:46.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:46.307+0000 7fef84e00640 1 -- 172.21.15.3:0/1206523323 wait complete. 2024-09-19T06:23:46.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:46 smithi071 ceph-mon[35662]: pgmap v354: 97 pgs: 97 active+clean; 3.0 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 59 KiB/s wr, 22 op/s 2024-09-19T06:23:47.289 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:23:47.671 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:48.066 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:48 smithi003 ceph-mon[30893]: pgmap v355: 97 pgs: 97 active+clean; 3.0 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-19T06:23:48.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:48 smithi059 ceph-mon[35138]: pgmap v355: 97 pgs: 97 active+clean; 3.0 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-19T06:23:48.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.296+0000 7f2748a00640 1 -- 172.21.15.3:0/4081175602 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f27441027a0 msgr2=0x7f27441067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:48.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.296+0000 7f2748a00640 1 --2- 172.21.15.3:0/4081175602 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f27441027a0 0x7f27441067f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f272c009900 tx=0x7f272c02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.296+0000 7f2748a00640 1 -- 172.21.15.3:0/4081175602 shutdown_connections 2024-09-19T06:23:48.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.296+0000 7f2748a00640 1 --2- 172.21.15.3:0/4081175602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2744106f20 0x7f274410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.296+0000 7f2748a00640 1 --2- 172.21.15.3:0/4081175602 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f27441027a0 0x7f27441067f0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.296+0000 7f2748a00640 1 --2- 172.21.15.3:0/4081175602 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2744101df0 0x7f27441021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.296+0000 7f2748a00640 1 -- 172.21.15.3:0/4081175602 >> 172.21.15.3:0/4081175602 conn(0x7f27440fd8b0 msgr2=0x7f27440ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:48.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.296+0000 7f2748a00640 1 -- 172.21.15.3:0/4081175602 shutdown_connections 2024-09-19T06:23:48.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.296+0000 7f2748a00640 1 -- 172.21.15.3:0/4081175602 wait complete. 2024-09-19T06:23:48.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.297+0000 7f2748a00640 1 Processor -- start 2024-09-19T06:23:48.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.297+0000 7f2748a00640 1 -- start start 2024-09-19T06:23:48.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.298+0000 7f2748a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2744101df0 0x7f274419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.298+0000 7f2748a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27441027a0 0x7f274419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.298+0000 7f2748a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2744106f20 0x7f274419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.298+0000 7f2748a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2744111f80 con 0x7f2744101df0 2024-09-19T06:23:48.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.298+0000 7f2748a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2744111e00 con 0x7f27441027a0 2024-09-19T06:23:48.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.298+0000 7f2748a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2744112100 con 0x7f2744106f20 2024-09-19T06:23:48.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.298+0000 7f2741e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2744101df0 0x7f274419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.298+0000 7f2741e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2744101df0 0x7f274419a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38984/0 (socket says 172.21.15.3:38984) 2024-09-19T06:23:48.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.298+0000 7f273be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27441027a0 0x7f274419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.298+0000 7f2741e00640 1 -- 172.21.15.3:0/2946476734 learned_addr learned my addr 172.21.15.3:0/2946476734 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:48.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.298+0000 7f2742800640 1 --2- 172.21.15.3:0/2946476734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2744106f20 0x7f274419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.299+0000 7f273be00640 1 -- 172.21.15.3:0/2946476734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2744106f20 msgr2=0x7f274419ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:48.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.299+0000 7f273be00640 1 --2- 172.21.15.3:0/2946476734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2744106f20 0x7f274419ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.299+0000 7f273be00640 1 -- 172.21.15.3:0/2946476734 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2744101df0 msgr2=0x7f274419a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:48.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.299+0000 7f273be00640 1 --2- 172.21.15.3:0/2946476734 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2744101df0 0x7f274419a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.299+0000 7f273be00640 1 -- 172.21.15.3:0/2946476734 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f274419f5f0 con 0x7f27441027a0 2024-09-19T06:23:48.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.299+0000 7f273be00640 1 --2- 172.21.15.3:0/2946476734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27441027a0 0x7f274419ab80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f272c005940 tx=0x7f272c0040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:48.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.299+0000 7f273aa00640 1 -- 172.21.15.3:0/2946476734 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c03f030 con 0x7f27441027a0 2024-09-19T06:23:48.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.299+0000 7f273aa00640 1 -- 172.21.15.3:0/2946476734 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f272c0044c0 con 0x7f27441027a0 2024-09-19T06:23:48.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.299+0000 7f2748a00640 1 -- 172.21.15.3:0/2946476734 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f274419f880 con 0x7f27441027a0 2024-09-19T06:23:48.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.299+0000 7f273aa00640 1 -- 172.21.15.3:0/2946476734 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f272c035070 con 0x7f27441027a0 2024-09-19T06:23:48.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.299+0000 7f2748a00640 1 -- 172.21.15.3:0/2946476734 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27441a71c0 con 0x7f27441027a0 2024-09-19T06:23:48.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.302+0000 7f274b5d5740 1 Processor -- start 2024-09-19T06:23:48.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.302+0000 7f274b5d5740 1 -- start start 2024-09-19T06:23:48.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.303+0000 7f273aa00640 1 -- 172.21.15.3:0/2946476734 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f272c042030 con 0x7f27441027a0 2024-09-19T06:23:48.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.303+0000 7f274b5d5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5e4b90 0x55e49f5e4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.303+0000 7f274b5d5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e49f5e54b0 0x55e49f5f8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.303+0000 7f274b5d5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e49f5f8660 0x55e49f5faa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.303+0000 7f274b5d5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e49f54b3e0 con 0x55e49f5f8660 2024-09-19T06:23:48.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.303+0000 7f274b5d5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e49f4f2d80 con 0x55e49f5e54b0 2024-09-19T06:23:48.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.303+0000 7f274b5d5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e49f5473a0 con 0x55e49f5e4b90 2024-09-19T06:23:48.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.303+0000 7f2742800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5e4b90 0x55e49f5e4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.303+0000 7f2742800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5e4b90 0x55e49f5e4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:52736/0 (socket says 172.21.15.3:52736) 2024-09-19T06:23:48.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.303+0000 7f2742800640 1 -- 172.21.15.3:0/1739929671 learned_addr learned my addr 172.21.15.3:0/1739929671 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:48.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.303+0000 7f2741e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e49f5e54b0 0x55e49f5f8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.303+0000 7f273be00640 1 --2- 172.21.15.3:0/1739929671 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e49f5f8660 0x55e49f5faa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.304+0000 7f2742800640 1 -- 172.21.15.3:0/1739929671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e49f5e54b0 msgr2=0x55e49f5f8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:48.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.304+0000 7f2742800640 1 --2- 172.21.15.3:0/1739929671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e49f5e54b0 0x55e49f5f8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.304+0000 7f2742800640 1 -- 172.21.15.3:0/1739929671 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e49f5f8660 msgr2=0x55e49f5faa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:48.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.304+0000 7f2742800640 1 --2- 172.21.15.3:0/1739929671 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e49f5f8660 0x55e49f5faa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.304+0000 7f2742800640 1 -- 172.21.15.3:0/1739929671 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e49f511ae0 con 0x55e49f5e4b90 2024-09-19T06:23:48.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.304+0000 7f2742800640 1 --2- 172.21.15.3:0/1739929671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5e4b90 0x55e49f5e4f70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f273c009f60 tx=0x7f273c009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bf01393ad6c2c28 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:48.308 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.304+0000 7f2733000640 1 -- 172.21.15.3:0/1739929671 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273c01e070 con 0x55e49f5e4b90 2024-09-19T06:23:48.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.304+0000 7f2733000640 1 -- 172.21.15.3:0/1739929671 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f273c003c30 con 0x55e49f5e4b90 2024-09-19T06:23:48.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.304+0000 7f2733000640 1 -- 172.21.15.3:0/1739929671 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273c00f9c0 con 0x55e49f5e4b90 2024-09-19T06:23:48.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.305+0000 7f273aa00640 1 --2- 172.21.15.3:0/2946476734 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f27280a33b0 0x7f27280a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.305+0000 7f273aa00640 1 -- 172.21.15.3:0/2946476734 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7f272c0efff0 con 0x7f27441027a0 2024-09-19T06:23:48.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.305+0000 7f2741e00640 1 --2- 172.21.15.3:0/2946476734 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f27280a33b0 0x7f27280a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.305+0000 7f274b5d5740 1 -- 172.21.15.3:0/1739929671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5e4b90 msgr2=0x55e49f5e4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:48.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.305+0000 7f274b5d5740 1 --2- 172.21.15.3:0/1739929671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5e4b90 0x55e49f5e4f70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f273c009f60 tx=0x7f273c009f90 comp rx=0 tx=0).stop 2024-09-19T06:23:48.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.305+0000 7f274b5d5740 1 -- 172.21.15.3:0/1739929671 shutdown_connections 2024-09-19T06:23:48.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.305+0000 7f274b5d5740 1 --2- 172.21.15.3:0/1739929671 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e49f5f8660 0x55e49f5faa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.305+0000 7f274b5d5740 1 --2- 172.21.15.3:0/1739929671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e49f5e54b0 0x55e49f5f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.305+0000 7f274b5d5740 1 --2- 172.21.15.3:0/1739929671 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5e4b90 0x55e49f5e4f70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.305+0000 7f274b5d5740 1 -- 172.21.15.3:0/1739929671 >> 172.21.15.3:0/1739929671 conn(0x55e49f5e1200 msgr2=0x55e49f5e15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:48.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.305+0000 7f274b5d5740 1 -- 172.21.15.3:0/1739929671 shutdown_connections 2024-09-19T06:23:48.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.305+0000 7f274b5d5740 1 -- 172.21.15.3:0/1739929671 wait complete. 2024-09-19T06:23:48.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.306+0000 7f2741e00640 1 --2- 172.21.15.3:0/2946476734 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f27280a33b0 0x7f27280a5870 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2734009640 tx=0x7f2734005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:48.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.306+0000 7f274b5d5740 1 -- start start 2024-09-19T06:23:48.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.306+0000 7f274b5d5740 1 Processor -- start 2024-09-19T06:23:48.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.307+0000 7f274b5d5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e49f5e4b90 0x55e49f5f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.307+0000 7f274b5d5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e49f5e54b0 0x55e49f5f5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.307+0000 7f274b5d5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5f8660 0x55e49f5f6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.307+0000 7f274b5d5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55e49f5fb1d0 con 0x55e49f5e54b0 2024-09-19T06:23:48.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.307+0000 7f274b5d5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55e49f5060f0 con 0x55e49f5e4b90 2024-09-19T06:23:48.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.307+0000 7f274b5d5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55e49f5fb350 con 0x55e49f5f8660 2024-09-19T06:23:48.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.307+0000 7f274b5d5740 10 client.0 _ll_register_callbacks cb 0x55e49f4edbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:48.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.307+0000 7f273be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e49f5e54b0 0x55e49f5f5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.307+0000 7f2742800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5f8660 0x55e49f5f6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.307+0000 7f2741e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e49f5e4b90 0x55e49f5f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.307+0000 7f2742800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5f8660 0x55e49f5f6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:52746/0 (socket says 172.21.15.3:52746) 2024-09-19T06:23:48.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.307+0000 7f2742800640 1 -- 172.21.15.3:0/817684093 learned_addr learned my addr 172.21.15.3:0/817684093 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:48.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.308+0000 7f2742800640 1 -- 172.21.15.3:0/817684093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e49f5e4b90 msgr2=0x55e49f5f55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:48.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.308+0000 7f2742800640 1 --2- 172.21.15.3:0/817684093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e49f5e4b90 0x55e49f5f55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.308+0000 7f2742800640 1 -- 172.21.15.3:0/817684093 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e49f5e54b0 msgr2=0x55e49f5f5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:48.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.308+0000 7f2742800640 1 --2- 172.21.15.3:0/817684093 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e49f5e54b0 0x55e49f5f5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.308+0000 7f2742800640 1 -- 172.21.15.3:0/817684093 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e49f2bc3c0 con 0x55e49f5f8660 2024-09-19T06:23:48.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.308+0000 7f273be00640 1 --2- 172.21.15.3:0/817684093 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e49f5e54b0 0x55e49f5f5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:48.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.308+0000 7f2742800640 1 --2- 172.21.15.3:0/817684093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5f8660 0x55e49f5f6040 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f273c01c040 tx=0x7f273c0048a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae79df42cc7d15e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:48.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.308+0000 7f2727400640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:23:48.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.308+0000 7f2727400640 1 -- 172.21.15.3:0/817684093 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273c027020 con 0x55e49f5f8660 2024-09-19T06:23:48.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.308+0000 7f274b5d5740 1 -- 172.21.15.3:0/817684093 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f273c003c30 con 0x55e49f5f8660 2024-09-19T06:23:48.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.308+0000 7f2727400640 1 -- 172.21.15.3:0/817684093 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7f273c004050 con 0x55e49f5f8660 2024-09-19T06:23:48.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.309+0000 7f2727400640 1 -- 172.21.15.3:0/817684093 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f273c032050 con 0x55e49f5f8660 2024-09-19T06:23:48.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.309+0000 7f274b5d5740 10 client.28591 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:48.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.309+0000 7f274b5d5740 1 -- 172.21.15.3:0/817684093 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e49f607300 con 0x55e49f5f8660 2024-09-19T06:23:48.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.309+0000 7f2727400640 1 -- 172.21.15.3:0/817684093 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f273c003c30 con 0x55e49f5f8660 2024-09-19T06:23:48.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.309+0000 7f2727400640 1 -- 172.21.15.3:0/817684093 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f273c0052b0 con 0x55e49f5f8660 2024-09-19T06:23:48.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.309+0000 7f274b5d5740 10 client.28591 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:48.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.309+0000 7f274b5d5740 10 client.28591 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:48.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.309+0000 7f274b5d5740 20 client.28591 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:48.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.309+0000 7f274b5d5740 1 --2- 172.21.15.3:0/817684093 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e49f6086b0 0x55e49f60aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.310+0000 7f274b5d5740 4 client.28591 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:48.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.310+0000 7f274b5d5740 1 -- 172.21.15.3:0/817684093 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e49f558950 con 0x55e49f6086b0 2024-09-19T06:23:48.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.310+0000 7f2741e00640 1 --2- 172.21.15.3:0/817684093 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e49f6086b0 0x55e49f60aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.310+0000 7f2741e00640 1 --2- 172.21.15.3:0/817684093 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e49f6086b0 0x55e49f60aaa0 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cb3c9fbcc56c320 server_cookie=849be5729b7c3e2a in_seq=0 out_seq=0 2024-09-19T06:23:48.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.310+0000 7f2727400640 10 client.28591 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:48.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.311+0000 7f2727400640 1 -- 172.21.15.3:0/817684093 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e49f558950 con 0x55e49f6086b0 2024-09-19T06:23:48.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.311+0000 7f2727400640 10 client.28591 handle_command_reply: tid=0 2024-09-19T06:23:48.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.311+0000 7f274b5d5740 1 client.28591 shutdown 2024-09-19T06:23:48.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.312+0000 7f274b5d5740 1 -- 172.21.15.3:0/817684093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5f8660 msgr2=0x55e49f5f6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:48.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.312+0000 7f274b5d5740 1 --2- 172.21.15.3:0/817684093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5f8660 0x55e49f5f6040 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f273c01c040 tx=0x7f273c0048a0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.312+0000 7f274b5d5740 1 -- 172.21.15.3:0/817684093 shutdown_connections 2024-09-19T06:23:48.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.312+0000 7f274b5d5740 1 --2- 172.21.15.3:0/817684093 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e49f6086b0 0x55e49f60aaa0 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.312+0000 7f274b5d5740 1 --2- 172.21.15.3:0/817684093 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5f8660 0x55e49f5f6040 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.312+0000 7f274b5d5740 1 --2- 172.21.15.3:0/817684093 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e49f5e54b0 0x55e49f5f5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.312+0000 7f274b5d5740 1 --2- 172.21.15.3:0/817684093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e49f5e4b90 0x55e49f5f55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.312+0000 7f2727400640 0 client.28591 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:48.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.312+0000 7f274b5d5740 1 -- 172.21.15.3:0/817684093 >> 172.21.15.3:0/817684093 conn(0x55e49f5e1200 msgr2=0x55e49f5e0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:48.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.312+0000 7f274b5d5740 1 -- 172.21.15.3:0/817684093 shutdown_connections 2024-09-19T06:23:48.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.312+0000 7f274b5d5740 1 -- 172.21.15.3:0/817684093 wait complete. 2024-09-19T06:23:48.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.312+0000 7f274b5d5740 20 client.28591 trim_cache size 0 max 16384 2024-09-19T06:23:48.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.326+0000 7f274b5d5740 1 Processor -- start 2024-09-19T06:23:48.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.326+0000 7f274b5d5740 1 -- start start 2024-09-19T06:23:48.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.326+0000 7f274b5d5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5e4b90 0x55e49f610210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.326+0000 7f274b5d5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e49f5e54b0 0x55e49f610750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.326+0000 7f274b5d5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e49f5f8660 0x55e49f5dfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.326+0000 7f274b5d5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f27441ab7e0 con 0x55e49f5f8660 2024-09-19T06:23:48.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.326+0000 7f274b5d5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f27441ad320 con 0x55e49f5e54b0 2024-09-19T06:23:48.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.326+0000 7f274b5d5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f27441abeb0 con 0x55e49f5e4b90 2024-09-19T06:23:48.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.326+0000 7f2742800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e49f5f8660 0x55e49f5dfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.326+0000 7f2742800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e49f5f8660 0x55e49f5dfb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39018/0 (socket says 172.21.15.3:39018) 2024-09-19T06:23:48.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.327+0000 7f273be00640 1 --2- 172.21.15.3:0/3698287519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e49f5e54b0 0x55e49f610750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.327+0000 7f2742800640 1 -- 172.21.15.3:0/3698287519 learned_addr learned my addr 172.21.15.3:0/3698287519 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:48.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.327+0000 7f2741e00640 1 --2- 172.21.15.3:0/3698287519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5e4b90 0x55e49f610210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.327+0000 7f2741e00640 1 -- 172.21.15.3:0/3698287519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e49f5e54b0 msgr2=0x55e49f610750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:48.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.327+0000 7f2741e00640 1 --2- 172.21.15.3:0/3698287519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e49f5e54b0 0x55e49f610750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.327+0000 7f2741e00640 1 -- 172.21.15.3:0/3698287519 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e49f5f8660 msgr2=0x55e49f5dfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:48.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.327+0000 7f2741e00640 1 --2- 172.21.15.3:0/3698287519 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e49f5f8660 0x55e49f5dfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.327+0000 7f2741e00640 1 -- 172.21.15.3:0/3698287519 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e49f5e52e0 con 0x55e49f5e4b90 2024-09-19T06:23:48.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.327+0000 7f2741e00640 1 --2- 172.21.15.3:0/3698287519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5e4b90 0x55e49f610210 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x55e49f60b150 tx=0x7f2734019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd6b18948e8d3027 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:48.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.327+0000 7f2732600640 1 -- 172.21.15.3:0/3698287519 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273401de60 con 0x55e49f5e4b90 2024-09-19T06:23:48.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.328+0000 7f2732600640 1 -- 172.21.15.3:0/3698287519 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f273402a900 con 0x55e49f5e4b90 2024-09-19T06:23:48.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.328+0000 7f2732600640 1 -- 172.21.15.3:0/3698287519 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273400f9f0 con 0x55e49f5e4b90 2024-09-19T06:23:48.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.328+0000 7f274b5d5740 1 -- 172.21.15.3:0/3698287519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5e4b90 msgr2=0x55e49f610210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:48.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.328+0000 7f274b5d5740 1 --2- 172.21.15.3:0/3698287519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5e4b90 0x55e49f610210 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x55e49f60b150 tx=0x7f2734019000 comp rx=0 tx=0).stop 2024-09-19T06:23:48.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.328+0000 7f274b5d5740 1 -- 172.21.15.3:0/3698287519 shutdown_connections 2024-09-19T06:23:48.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.328+0000 7f274b5d5740 1 --2- 172.21.15.3:0/3698287519 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e49f5f8660 0x55e49f5dfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.328+0000 7f274b5d5740 1 --2- 172.21.15.3:0/3698287519 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e49f5e54b0 0x55e49f610750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.328+0000 7f274b5d5740 1 --2- 172.21.15.3:0/3698287519 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5e4b90 0x55e49f610210 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.328+0000 7f274b5d5740 1 -- 172.21.15.3:0/3698287519 >> 172.21.15.3:0/3698287519 conn(0x55e49f5e1200 msgr2=0x55e49f5f7640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:48.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.328+0000 7f274b5d5740 1 -- 172.21.15.3:0/3698287519 shutdown_connections 2024-09-19T06:23:48.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.328+0000 7f274b5d5740 1 -- 172.21.15.3:0/3698287519 wait complete. 2024-09-19T06:23:48.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.329+0000 7f274b5d5740 1 -- start start 2024-09-19T06:23:48.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.329+0000 7f274b5d5740 1 Processor -- start 2024-09-19T06:23:48.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.330+0000 7f274b5d5740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e49f5e4b90 0x55e49f600970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.330+0000 7f274b5d5740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5e54b0 0x55e49f600eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.330+0000 7f274b5d5740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e49f5f8660 0x55e49f5fbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.330+0000 7f274b5d5740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f27441acc50 con 0x55e49f5e4b90 2024-09-19T06:23:48.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.330+0000 7f274b5d5740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f27441ac580 con 0x55e49f5f8660 2024-09-19T06:23:48.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.330+0000 7f274b5d5740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f27441a9840 con 0x55e49f5e54b0 2024-09-19T06:23:48.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.330+0000 7f274b5d5740 10 client.0 _ll_register_callbacks cb 0x7f273c01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:48.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.330+0000 7f273be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5e54b0 0x55e49f600eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.330+0000 7f2742800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e49f5f8660 0x55e49f5fbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.330+0000 7f273be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5e54b0 0x55e49f600eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:52772/0 (socket says 172.21.15.3:52772) 2024-09-19T06:23:48.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.330+0000 7f2742800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e49f5f8660 0x55e49f5fbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44424/0 (socket says 172.21.15.3:44424) 2024-09-19T06:23:48.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.330+0000 7f273be00640 1 -- 172.21.15.3:0/1782912095 learned_addr learned my addr 172.21.15.3:0/1782912095 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:48.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.330+0000 7f2741e00640 1 --2- 172.21.15.3:0/1782912095 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e49f5e4b90 0x55e49f600970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.331+0000 7f2742800640 1 -- 172.21.15.3:0/1782912095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5e54b0 msgr2=0x55e49f600eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:48.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.331+0000 7f2742800640 1 --2- 172.21.15.3:0/1782912095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5e54b0 0x55e49f600eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.331+0000 7f2742800640 1 -- 172.21.15.3:0/1782912095 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e49f5e4b90 msgr2=0x55e49f600970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:48.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.331+0000 7f2742800640 1 --2- 172.21.15.3:0/1782912095 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e49f5e4b90 0x55e49f600970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.331+0000 7f2742800640 1 -- 172.21.15.3:0/1782912095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e49f5fc770 con 0x55e49f5f8660 2024-09-19T06:23:48.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.331+0000 7f273be00640 1 --2- 172.21.15.3:0/1782912095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5e54b0 0x55e49f600eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:48.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.331+0000 7f2742800640 1 --2- 172.21.15.3:0/1782912095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e49f5f8660 0x55e49f5fbf40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f273c000f80 tx=0x7f273c004910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa1c1052a87b03ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:48.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.331+0000 7f2727400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:23:48.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.331+0000 7f2727400640 1 -- 172.21.15.3:0/1782912095 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273c03b060 con 0x55e49f5f8660 2024-09-19T06:23:48.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.331+0000 7f274b5d5740 1 -- 172.21.15.3:0/1782912095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f273402a900 con 0x55e49f5f8660 2024-09-19T06:23:48.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.331+0000 7f2727400640 1 -- 172.21.15.3:0/1782912095 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7f273c0058f0 con 0x55e49f5f8660 2024-09-19T06:23:48.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.331+0000 7f2727400640 1 -- 172.21.15.3:0/1782912095 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f273c027070 con 0x55e49f5f8660 2024-09-19T06:23:48.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.332+0000 7f274b5d5740 10 client.28625 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:48.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.332+0000 7f274b5d5740 1 -- 172.21.15.3:0/1782912095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e49f672e00 con 0x55e49f5f8660 2024-09-19T06:23:48.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.332+0000 7f2727400640 1 -- 172.21.15.3:0/1782912095 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f273402a900 con 0x55e49f5f8660 2024-09-19T06:23:48.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.332+0000 7f2727400640 1 -- 172.21.15.3:0/1782912095 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f273c00f660 con 0x55e49f5f8660 2024-09-19T06:23:48.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.332+0000 7f274b5d5740 10 client.28625 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:48.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.332+0000 7f274b5d5740 10 client.28625 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:48.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.332+0000 7f274b5d5740 20 client.28625 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:48.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.332+0000 7f274b5d5740 1 --2- 172.21.15.3:0/1782912095 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e49f6734c0 0x55e49f6758b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.332+0000 7f274b5d5740 4 client.28625 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:23:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.332+0000 7f274b5d5740 1 -- 172.21.15.3:0/1782912095 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e49f552e60 con 0x55e49f6734c0 2024-09-19T06:23:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.332+0000 7f2741e00640 1 --2- 172.21.15.3:0/1782912095 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e49f6734c0 0x55e49f6758b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.333+0000 7f2741e00640 1 --2- 172.21.15.3:0/1782912095 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e49f6734c0 0x55e49f6758b0 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fbac940c0fad1fd server_cookie=d1ddff0cc3b2c885 in_seq=0 out_seq=0 2024-09-19T06:23:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.333+0000 7f2727400640 10 client.28625 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.333+0000 7f2727400640 1 -- 172.21.15.3:0/1782912095 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e49f552e60 con 0x55e49f6734c0 2024-09-19T06:23:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.333+0000 7f2727400640 10 client.28625 handle_command_reply: tid=0 2024-09-19T06:23:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.333+0000 7f274b5d5740 1 client.28625 shutdown 2024-09-19T06:23:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.333+0000 7f274b5d5740 1 -- 172.21.15.3:0/1782912095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e49f5f8660 msgr2=0x55e49f5fbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.333+0000 7f274b5d5740 1 --2- 172.21.15.3:0/1782912095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e49f5f8660 0x55e49f5fbf40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f273c000f80 tx=0x7f273c004910 comp rx=0 tx=0).stop 2024-09-19T06:23:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.333+0000 7f274b5d5740 1 -- 172.21.15.3:0/1782912095 shutdown_connections 2024-09-19T06:23:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.333+0000 7f274b5d5740 1 --2- 172.21.15.3:0/1782912095 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55e49f6734c0 0x55e49f6758b0 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.333+0000 7f274b5d5740 1 --2- 172.21.15.3:0/1782912095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e49f5f8660 0x55e49f5fbf40 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.333+0000 7f274b5d5740 1 --2- 172.21.15.3:0/1782912095 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55e49f5e54b0 0x55e49f600eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.333+0000 7f2727400640 0 client.28625 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.333+0000 7f274b5d5740 1 --2- 172.21.15.3:0/1782912095 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55e49f5e4b90 0x55e49f600970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.333+0000 7f274b5d5740 1 -- 172.21.15.3:0/1782912095 >> 172.21.15.3:0/1782912095 conn(0x55e49f5e1200 msgr2=0x55e49f5dfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.334+0000 7f274b5d5740 1 -- 172.21.15.3:0/1782912095 shutdown_connections 2024-09-19T06:23:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.334+0000 7f274b5d5740 1 -- 172.21.15.3:0/1782912095 wait complete. 2024-09-19T06:23:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.334+0000 7f274b5d5740 20 client.28625 trim_cache size 0 max 16384 2024-09-19T06:23:48.340 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:23:48.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.335+0000 7f2748a00640 1 -- 172.21.15.3:0/2946476734 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f27280a33b0 msgr2=0x7f27280a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:48.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.335+0000 7f2748a00640 1 --2- 172.21.15.3:0/2946476734 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f27280a33b0 0x7f27280a5870 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2734009640 tx=0x7f2734005f90 comp rx=0 tx=0).stop 2024-09-19T06:23:48.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.335+0000 7f2748a00640 1 -- 172.21.15.3:0/2946476734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27441027a0 msgr2=0x7f274419ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:48.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.335+0000 7f2748a00640 1 --2- 172.21.15.3:0/2946476734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27441027a0 0x7f274419ab80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f272c005940 tx=0x7f272c0040c0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.335+0000 7f2748a00640 1 -- 172.21.15.3:0/2946476734 shutdown_connections 2024-09-19T06:23:48.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.335+0000 7f2748a00640 1 --2- 172.21.15.3:0/2946476734 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f27280a33b0 0x7f27280a5870 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.335+0000 7f2748a00640 1 --2- 172.21.15.3:0/2946476734 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2744106f20 0x7f274419ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.335+0000 7f2748a00640 1 --2- 172.21.15.3:0/2946476734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27441027a0 0x7f274419ab80 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.335+0000 7f2748a00640 1 --2- 172.21.15.3:0/2946476734 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2744101df0 0x7f274419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:48.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.335+0000 7f2748a00640 1 -- 172.21.15.3:0/2946476734 >> 172.21.15.3:0/2946476734 conn(0x7f27440fd8b0 msgr2=0x7f27440feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:48.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.335+0000 7f2748a00640 1 -- 172.21.15.3:0/2946476734 shutdown_connections 2024-09-19T06:23:48.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:48.335+0000 7f2748a00640 1 -- 172.21.15.3:0/2946476734 wait complete. 2024-09-19T06:23:48.342 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:48 smithi071 ceph-mon[35662]: pgmap v355: 97 pgs: 97 active+clean; 3.0 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 15 op/s 2024-09-19T06:23:50.268 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T06:23:50.268 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T06:23:50.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:50 smithi059 ceph-mon[35138]: pgmap v356: 97 pgs: 97 active+clean; 3.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-19T06:23:50.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:50 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:23:50.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:50 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:23:50.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:50 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:23:50.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:50 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:23:50.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:50 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:23:50.317 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:50 smithi003 ceph-mon[30893]: pgmap v356: 97 pgs: 97 active+clean; 3.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-19T06:23:50.317 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:50 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:23:50.317 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:50 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:23:50.317 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:50 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:23:50.317 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:50 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:23:50.317 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:50 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:23:50.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:50 smithi071 ceph-mon[35662]: pgmap v356: 97 pgs: 97 active+clean; 3.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-19T06:23:50.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:50 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:23:50.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:50 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:23:50.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:50 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:23:50.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:50 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:23:50.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:50 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:23:50.649 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:50.812 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.810+0000 7fa182800640 1 -- 172.21.15.3:0/4139323864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa17c10e300 msgr2=0x7fa17c110750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:50.812 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.810+0000 7fa182800640 1 --2- 172.21.15.3:0/4139323864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa17c10e300 0x7fa17c110750 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fa174009ca0 tx=0x7fa17402a950 comp rx=0 tx=0).stop 2024-09-19T06:23:50.812 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.810+0000 7fa182800640 1 -- 172.21.15.3:0/4139323864 shutdown_connections 2024-09-19T06:23:50.812 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.810+0000 7fa182800640 1 --2- 172.21.15.3:0/4139323864 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa17c10e300 0x7fa17c110750 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.812 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.810+0000 7fa182800640 1 --2- 172.21.15.3:0/4139323864 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa17c074f40 0x7fa17c10ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.812 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.810+0000 7fa182800640 1 --2- 172.21.15.3:0/4139323864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa17c074620 0x7fa17c074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.812 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.810+0000 7fa182800640 1 -- 172.21.15.3:0/4139323864 >> 172.21.15.3:0/4139323864 conn(0x7fa17c0fd7e0 msgr2=0x7fa17c0ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:50.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.810+0000 7fa182800640 1 -- 172.21.15.3:0/4139323864 shutdown_connections 2024-09-19T06:23:50.813 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.810+0000 7fa182800640 1 -- 172.21.15.3:0/4139323864 wait complete. 2024-09-19T06:23:50.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.811+0000 7fa182800640 1 Processor -- start 2024-09-19T06:23:50.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.811+0000 7fa182800640 1 -- start start 2024-09-19T06:23:50.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.811+0000 7fa182800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa17c074620 0x7fa17c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:50.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.811+0000 7fa182800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa17c074f40 0x7fa17c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:50.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.811+0000 7fa182800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa17c10e300 0x7fa17c19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:50.814 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.811+0000 7fa182800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c114090 con 0x7fa17c10e300 2024-09-19T06:23:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.811+0000 7fa182800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c113f10 con 0x7fa17c074f40 2024-09-19T06:23:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.811+0000 7fa182800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c114210 con 0x7fa17c074620 2024-09-19T06:23:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.812+0000 7fa17be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa17c10e300 0x7fa17c19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.812+0000 7fa17b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa17c074620 0x7fa17c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.812+0000 7fa17be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa17c10e300 0x7fa17c19ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39046/0 (socket says 172.21.15.3:39046) 2024-09-19T06:23:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.812+0000 7fa17b400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa17c074620 0x7fa17c19a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:52780/0 (socket says 172.21.15.3:52780) 2024-09-19T06:23:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.812+0000 7fa17be00640 1 -- 172.21.15.3:0/4042567798 learned_addr learned my addr 172.21.15.3:0/4042567798 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.812+0000 7fa173e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa17c074f40 0x7fa17c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.812+0000 7fa17be00640 1 -- 172.21.15.3:0/4042567798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa17c074620 msgr2=0x7fa17c19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.812+0000 7fa17be00640 1 --2- 172.21.15.3:0/4042567798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa17c074620 0x7fa17c19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.812+0000 7fa17be00640 1 -- 172.21.15.3:0/4042567798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa17c074f40 msgr2=0x7fa17c19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:50.815 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.812+0000 7fa17be00640 1 --2- 172.21.15.3:0/4042567798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa17c074f40 0x7fa17c19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.812+0000 7fa17be00640 1 -- 172.21.15.3:0/4042567798 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17c19f630 con 0x7fa17c10e300 2024-09-19T06:23:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.812+0000 7fa17be00640 1 --2- 172.21.15.3:0/4042567798 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa17c10e300 0x7fa17c19ef00 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fa174004af0 tx=0x7fa17402f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.813+0000 7fa178c00640 1 -- 172.21.15.3:0/4042567798 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa174034040 con 0x7fa17c10e300 2024-09-19T06:23:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.813+0000 7fa178c00640 1 -- 172.21.15.3:0/4042567798 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa174030920 con 0x7fa17c10e300 2024-09-19T06:23:50.816 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.813+0000 7fa182800640 1 -- 172.21.15.3:0/4042567798 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa17c19f8c0 con 0x7fa17c10e300 2024-09-19T06:23:50.817 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.813+0000 7fa178c00640 1 -- 172.21.15.3:0/4042567798 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa174004670 con 0x7fa17c10e300 2024-09-19T06:23:50.817 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.813+0000 7fa182800640 1 -- 172.21.15.3:0/4042567798 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa17c1a71b0 con 0x7fa17c10e300 2024-09-19T06:23:50.818 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.817+0000 7fa185625740 1 Processor -- start 2024-09-19T06:23:50.819 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.817+0000 7fa178c00640 1 -- 172.21.15.3:0/4042567798 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fa174037020 con 0x7fa17c10e300 2024-09-19T06:23:50.819 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.817+0000 7fa185625740 1 -- start start 2024-09-19T06:23:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.817+0000 7fa185625740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c4d1e0 0x557601c4d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.817+0000 7fa185625740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557601c4db00 0x557601c57e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.817+0000 7fa185625740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557601c583a0 0x557601c5a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.817+0000 7fa185625740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557601bb3100 con 0x557601c4d1e0 2024-09-19T06:23:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.817+0000 7fa185625740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557601b5b1b0 con 0x557601c4db00 2024-09-19T06:23:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.817+0000 7fa185625740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557601baf0c0 con 0x557601c583a0 2024-09-19T06:23:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.818+0000 7fa173e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c4d1e0 0x557601c4d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.818+0000 7fa17b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557601c4db00 0x557601c57e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.818+0000 7fa173e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c4d1e0 0x557601c4d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39056/0 (socket says 172.21.15.3:39056) 2024-09-19T06:23:50.820 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.818+0000 7fa173e00640 1 -- 172.21.15.3:0/427581312 learned_addr learned my addr 172.21.15.3:0/427581312 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:50.821 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.818+0000 7fa173e00640 1 --2- 172.21.15.3:0/427581312 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557601c583a0 0x557601c5a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:50.821 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.819+0000 7fa173e00640 1 -- 172.21.15.3:0/427581312 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557601c583a0 msgr2=0x557601c5a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:50.822 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.819+0000 7fa173e00640 1 --2- 172.21.15.3:0/427581312 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557601c583a0 0x557601c5a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.822 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.819+0000 7fa173e00640 1 -- 172.21.15.3:0/427581312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557601c4db00 msgr2=0x557601c57e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:50.822 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.819+0000 7fa173e00640 1 --2- 172.21.15.3:0/427581312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557601c4db00 0x557601c57e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.822 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.819+0000 7fa173e00640 1 -- 172.21.15.3:0/427581312 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576018c6210 con 0x557601c4d1e0 2024-09-19T06:23:50.822 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.819+0000 7fa178c00640 1 --2- 172.21.15.3:0/4042567798 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa1600a33b0 0x7fa1600a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:50.822 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.819+0000 7fa173e00640 1 --2- 172.21.15.3:0/427581312 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c4d1e0 0x557601c4d5c0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fa164013590 tx=0x7fa164009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e7587957272ebf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:50.822 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.819+0000 7fa178c00640 1 -- 172.21.15.3:0/4042567798 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7fa1740f09b0 con 0x7fa17c10e300 2024-09-19T06:23:50.822 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.820+0000 7fa17b400640 1 --2- 172.21.15.3:0/4042567798 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa1600a33b0 0x7fa1600a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:50.822 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.820+0000 7fa170c00640 1 -- 172.21.15.3:0/427581312 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa164004230 con 0x557601c4d1e0 2024-09-19T06:23:50.822 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.820+0000 7fa170c00640 1 -- 172.21.15.3:0/427581312 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1640043d0 con 0x557601c4d1e0 2024-09-19T06:23:50.822 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.820+0000 7fa170c00640 1 -- 172.21.15.3:0/427581312 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa164011970 con 0x557601c4d1e0 2024-09-19T06:23:50.823 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.821+0000 7fa185625740 1 -- 172.21.15.3:0/427581312 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c4d1e0 msgr2=0x557601c4d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:50.823 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.821+0000 7fa17b400640 1 --2- 172.21.15.3:0/4042567798 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa1600a33b0 0x7fa1600a5870 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x557601c4a5b0 tx=0x7fa16c005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.821+0000 7fa185625740 1 --2- 172.21.15.3:0/427581312 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c4d1e0 0x557601c4d5c0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fa164013590 tx=0x7fa164009970 comp rx=0 tx=0).stop 2024-09-19T06:23:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.821+0000 7fa185625740 1 -- 172.21.15.3:0/427581312 shutdown_connections 2024-09-19T06:23:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.821+0000 7fa185625740 1 --2- 172.21.15.3:0/427581312 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557601c583a0 0x557601c5a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.821+0000 7fa185625740 1 --2- 172.21.15.3:0/427581312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557601c4db00 0x557601c57e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.821+0000 7fa185625740 1 --2- 172.21.15.3:0/427581312 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c4d1e0 0x557601c4d5c0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.821+0000 7fa185625740 1 -- 172.21.15.3:0/427581312 >> 172.21.15.3:0/427581312 conn(0x557601c49750 msgr2=0x557601c49b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.821+0000 7fa185625740 1 -- 172.21.15.3:0/427581312 shutdown_connections 2024-09-19T06:23:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.821+0000 7fa185625740 1 -- 172.21.15.3:0/427581312 wait complete. 2024-09-19T06:23:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.821+0000 7fa185625740 1 -- start start 2024-09-19T06:23:50.824 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.822+0000 7fa185625740 1 Processor -- start 2024-09-19T06:23:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.822+0000 7fa185625740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c4d1e0 0x557601c552e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.822+0000 7fa185625740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557601c4db00 0x557601c55820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.822+0000 7fa185625740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557601c583a0 0x557601c55d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.822+0000 7fa185625740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x557601c63780 con 0x557601c4d1e0 2024-09-19T06:23:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.822+0000 7fa185625740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x557601b3c090 con 0x557601c4db00 2024-09-19T06:23:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.822+0000 7fa185625740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x557601c63900 con 0x557601c583a0 2024-09-19T06:23:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.822+0000 7fa185625740 10 client.0 _ll_register_callbacks cb 0x557601b90f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.823+0000 7fa173e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557601c4db00 0x557601c55820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.823+0000 7fa17b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c4d1e0 0x557601c552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.823+0000 7fa173e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557601c4db00 0x557601c55820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44450/0 (socket says 172.21.15.3:44450) 2024-09-19T06:23:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.823+0000 7fa17b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c4d1e0 0x557601c552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39072/0 (socket says 172.21.15.3:39072) 2024-09-19T06:23:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.823+0000 7fa173e00640 1 -- 172.21.15.3:0/3092076928 learned_addr learned my addr 172.21.15.3:0/3092076928 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.823+0000 7fa17be00640 1 --2- 172.21.15.3:0/3092076928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557601c583a0 0x557601c55d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.823+0000 7fa173e00640 1 -- 172.21.15.3:0/3092076928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557601c583a0 msgr2=0x557601c55d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.823+0000 7fa173e00640 1 --2- 172.21.15.3:0/3092076928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557601c583a0 0x557601c55d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.823+0000 7fa173e00640 1 -- 172.21.15.3:0/3092076928 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c4d1e0 msgr2=0x557601c552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.823+0000 7fa173e00640 1 --2- 172.21.15.3:0/3092076928 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c4d1e0 0x557601c552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.823+0000 7fa173e00640 1 -- 172.21.15.3:0/3092076928 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557601992620 con 0x557601c4db00 2024-09-19T06:23:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.823+0000 7fa17b400640 1 --2- 172.21.15.3:0/3092076928 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c4d1e0 0x557601c552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.823+0000 7fa173e00640 1 --2- 172.21.15.3:0/3092076928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557601c4db00 0x557601c55820 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa164004230 tx=0x7fa164004260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=494b5bda3fca6ccb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.823+0000 7fa169600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:23:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.824+0000 7fa169600640 1 -- 172.21.15.3:0/3092076928 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa164005250 con 0x557601c4db00 2024-09-19T06:23:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.824+0000 7fa169600640 1 -- 172.21.15.3:0/3092076928 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7fa1640053f0 con 0x557601c4db00 2024-09-19T06:23:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.824+0000 7fa185625740 1 -- 172.21.15.3:0/3092076928 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1640043d0 con 0x557601c4db00 2024-09-19T06:23:50.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.824+0000 7fa169600640 1 -- 172.21.15.3:0/3092076928 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa1640055f0 con 0x557601c4db00 2024-09-19T06:23:50.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.824+0000 7fa185625740 10 client.28637 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:50.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.824+0000 7fa185625740 1 -- 172.21.15.3:0/3092076928 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557601c6f470 con 0x557601c4db00 2024-09-19T06:23:50.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.824+0000 7fa169600640 1 -- 172.21.15.3:0/3092076928 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1640043d0 con 0x557601c4db00 2024-09-19T06:23:50.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.825+0000 7fa169600640 1 -- 172.21.15.3:0/3092076928 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa1640119f0 con 0x557601c4db00 2024-09-19T06:23:50.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.825+0000 7fa185625740 10 client.28637 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:50.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.825+0000 7fa185625740 10 client.28637 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:50.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.825+0000 7fa185625740 20 client.28637 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:50.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.825+0000 7fa185625740 1 --2- 172.21.15.3:0/3092076928 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x557601c70880 0x557601c72c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:50.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.825+0000 7fa185625740 4 client.28637 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:50.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.825+0000 7fa185625740 1 -- 172.21.15.3:0/3092076928 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557601bc0830 con 0x557601c70880 2024-09-19T06:23:50.829 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.825+0000 7fa17b400640 1 --2- 172.21.15.3:0/3092076928 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x557601c70880 0x557601c72c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:50.830 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.826+0000 7fa17b400640 1 --2- 172.21.15.3:0/3092076928 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x557601c70880 0x557601c72c70 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1af5dd791b678eee server_cookie=40fef45740bc6f6a in_seq=0 out_seq=0 2024-09-19T06:23:50.831 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.826+0000 7fa169600640 10 client.28637 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:50.831 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.827+0000 7fa169600640 1 -- 172.21.15.3:0/3092076928 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557601bc0830 con 0x557601c70880 2024-09-19T06:23:50.831 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.827+0000 7fa169600640 10 client.28637 handle_command_reply: tid=0 2024-09-19T06:23:50.831 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.827+0000 7fa185625740 1 client.28637 shutdown 2024-09-19T06:23:50.831 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.827+0000 7fa185625740 1 -- 172.21.15.3:0/3092076928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557601c4db00 msgr2=0x557601c55820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:50.831 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.827+0000 7fa185625740 1 --2- 172.21.15.3:0/3092076928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557601c4db00 0x557601c55820 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa164004230 tx=0x7fa164004260 comp rx=0 tx=0).stop 2024-09-19T06:23:50.831 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.827+0000 7fa185625740 1 -- 172.21.15.3:0/3092076928 shutdown_connections 2024-09-19T06:23:50.831 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.827+0000 7fa185625740 1 --2- 172.21.15.3:0/3092076928 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x557601c70880 0x557601c72c70 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.831 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.827+0000 7fa185625740 1 --2- 172.21.15.3:0/3092076928 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557601c583a0 0x557601c55d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.831 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.827+0000 7fa185625740 1 --2- 172.21.15.3:0/3092076928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557601c4db00 0x557601c55820 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.831 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.827+0000 7fa185625740 1 --2- 172.21.15.3:0/3092076928 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c4d1e0 0x557601c552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.832 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.827+0000 7fa169600640 0 client.28637 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:50.832 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.827+0000 7fa185625740 1 -- 172.21.15.3:0/3092076928 >> 172.21.15.3:0/3092076928 conn(0x557601c49750 msgr2=0x557601c4f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:50.832 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.827+0000 7fa185625740 1 -- 172.21.15.3:0/3092076928 shutdown_connections 2024-09-19T06:23:50.832 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.827+0000 7fa185625740 1 -- 172.21.15.3:0/3092076928 wait complete. 2024-09-19T06:23:50.832 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.827+0000 7fa185625740 20 client.28637 trim_cache size 0 max 16384 2024-09-19T06:23:50.845 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.843+0000 7fa185625740 1 Processor -- start 2024-09-19T06:23:50.845 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.843+0000 7fa185625740 1 -- start start 2024-09-19T06:23:50.845 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.843+0000 7fa185625740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557601c4d1e0 0x557601c4fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:50.845 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.843+0000 7fa185625740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557601c4db00 0x557601c78360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:50.845 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.843+0000 7fa185625740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c583a0 0x557601c788a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:50.845 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.843+0000 7fa185625740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c1ab790 con 0x557601c583a0 2024-09-19T06:23:50.845 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.843+0000 7fa185625740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c1ad2d0 con 0x557601c4db00 2024-09-19T06:23:50.846 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.843+0000 7fa185625740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c1abe60 con 0x557601c4d1e0 2024-09-19T06:23:50.846 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.843+0000 7fa17be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c583a0 0x557601c788a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:50.846 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.843+0000 7fa17be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c583a0 0x557601c788a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39086/0 (socket says 172.21.15.3:39086) 2024-09-19T06:23:50.846 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.843+0000 7fa17be00640 1 -- 172.21.15.3:0/2360489822 learned_addr learned my addr 172.21.15.3:0/2360489822 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:50.846 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.843+0000 7fa17b400640 1 --2- 172.21.15.3:0/2360489822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557601c4d1e0 0x557601c4fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:50.846 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.843+0000 7fa173e00640 1 --2- 172.21.15.3:0/2360489822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557601c4db00 0x557601c78360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:50.846 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.844+0000 7fa17be00640 1 -- 172.21.15.3:0/2360489822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557601c4d1e0 msgr2=0x557601c4fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:50.846 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.844+0000 7fa17be00640 1 --2- 172.21.15.3:0/2360489822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557601c4d1e0 0x557601c4fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.846 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.844+0000 7fa17be00640 1 -- 172.21.15.3:0/2360489822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557601c4db00 msgr2=0x557601c78360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:50.846 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.844+0000 7fa17be00640 1 --2- 172.21.15.3:0/2360489822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557601c4db00 0x557601c78360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.846 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.844+0000 7fa17be00640 1 -- 172.21.15.3:0/2360489822 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557601c49580 con 0x557601c583a0 2024-09-19T06:23:50.850 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.844+0000 7fa17be00640 1 --2- 172.21.15.3:0/2360489822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c583a0 0x557601c788a0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fa1740b96e0 tx=0x7fa174005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ee9ee5be4bb1b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:50.850 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.844+0000 7fa16be00640 1 -- 172.21.15.3:0/2360489822 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1740da070 con 0x557601c583a0 2024-09-19T06:23:50.850 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.844+0000 7fa16be00640 1 -- 172.21.15.3:0/2360489822 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1740bcd10 con 0x557601c583a0 2024-09-19T06:23:50.850 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.844+0000 7fa16be00640 1 -- 172.21.15.3:0/2360489822 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1740b9380 con 0x557601c583a0 2024-09-19T06:23:50.850 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.845+0000 7fa185625740 1 -- 172.21.15.3:0/2360489822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c583a0 msgr2=0x557601c788a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:50.850 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.845+0000 7fa185625740 1 --2- 172.21.15.3:0/2360489822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c583a0 0x557601c788a0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fa1740b96e0 tx=0x7fa174005f70 comp rx=0 tx=0).stop 2024-09-19T06:23:50.850 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.845+0000 7fa185625740 1 -- 172.21.15.3:0/2360489822 shutdown_connections 2024-09-19T06:23:50.850 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.845+0000 7fa185625740 1 --2- 172.21.15.3:0/2360489822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c583a0 0x557601c788a0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.850 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.845+0000 7fa185625740 1 --2- 172.21.15.3:0/2360489822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557601c4db00 0x557601c78360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.850 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.845+0000 7fa185625740 1 --2- 172.21.15.3:0/2360489822 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557601c4d1e0 0x557601c4fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.850 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.845+0000 7fa185625740 1 -- 172.21.15.3:0/2360489822 >> 172.21.15.3:0/2360489822 conn(0x557601c49750 msgr2=0x557601c57250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:50.851 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.845+0000 7fa185625740 1 -- 172.21.15.3:0/2360489822 shutdown_connections 2024-09-19T06:23:50.851 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.845+0000 7fa185625740 1 -- 172.21.15.3:0/2360489822 wait complete. 2024-09-19T06:23:50.851 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.845+0000 7fa185625740 1 -- start start 2024-09-19T06:23:50.851 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.845+0000 7fa185625740 1 Processor -- start 2024-09-19T06:23:50.851 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.846+0000 7fa185625740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c4d1e0 0x557601c64830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:50.851 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.846+0000 7fa185625740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557601c4db00 0x557601c64d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:50.851 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.846+0000 7fa185625740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557601c583a0 0x557601c652b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:50.851 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.846+0000 7fa185625740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c1acc00 con 0x557601c4d1e0 2024-09-19T06:23:50.851 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.846+0000 7fa185625740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c1ac530 con 0x557601c4db00 2024-09-19T06:23:50.851 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.846+0000 7fa185625740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c1a97b0 con 0x557601c583a0 2024-09-19T06:23:50.851 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.846+0000 7fa185625740 10 client.0 _ll_register_callbacks cb 0x7fa16c0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:50.851 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.846+0000 7fa17b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c4d1e0 0x557601c64830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:50.851 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.846+0000 7fa173e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557601c4db00 0x557601c64d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:50.852 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.846+0000 7fa17be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557601c583a0 0x557601c652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:50.852 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.846+0000 7fa173e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557601c4db00 0x557601c64d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44474/0 (socket says 172.21.15.3:44474) 2024-09-19T06:23:50.852 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.846+0000 7fa173e00640 1 -- 172.21.15.3:0/2006508682 learned_addr learned my addr 172.21.15.3:0/2006508682 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:50.852 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.846+0000 7fa173e00640 1 -- 172.21.15.3:0/2006508682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557601c583a0 msgr2=0x557601c652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:50.852 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.846+0000 7fa173e00640 1 --2- 172.21.15.3:0/2006508682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557601c583a0 0x557601c652b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.852 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.846+0000 7fa173e00640 1 -- 172.21.15.3:0/2006508682 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c4d1e0 msgr2=0x557601c64830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:50.852 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.846+0000 7fa173e00640 1 --2- 172.21.15.3:0/2006508682 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c4d1e0 0x557601c64830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.852 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.846+0000 7fa173e00640 1 -- 172.21.15.3:0/2006508682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557601c4a3e0 con 0x557601c4db00 2024-09-19T06:23:50.852 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.847+0000 7fa173e00640 1 --2- 172.21.15.3:0/2006508682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557601c4db00 0x557601c64d70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa1640059f0 tx=0x7fa164015f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90345067f446d586 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:50.852 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.847+0000 7fa169600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:23:50.852 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.847+0000 7fa169600640 1 -- 172.21.15.3:0/2006508682 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa164037070 con 0x557601c4db00 2024-09-19T06:23:50.852 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.847+0000 7fa169600640 1 -- 172.21.15.3:0/2006508682 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7fa164004350 con 0x557601c4db00 2024-09-19T06:23:50.853 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.847+0000 7fa185625740 1 -- 172.21.15.3:0/2006508682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1740bcd10 con 0x557601c4db00 2024-09-19T06:23:50.853 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.847+0000 7fa169600640 1 -- 172.21.15.3:0/2006508682 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa164044050 con 0x557601c4db00 2024-09-19T06:23:50.853 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.847+0000 7fa185625740 10 client.28643 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:50.853 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.847+0000 7fa185625740 1 -- 172.21.15.3:0/2006508682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557601c44d60 con 0x557601c4db00 2024-09-19T06:23:50.853 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.847+0000 7fa169600640 1 -- 172.21.15.3:0/2006508682 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1740bcd10 con 0x557601c4db00 2024-09-19T06:23:50.853 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.848+0000 7fa169600640 1 -- 172.21.15.3:0/2006508682 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa1640119b0 con 0x557601c4db00 2024-09-19T06:23:50.853 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.848+0000 7fa185625740 10 client.28643 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:50.853 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.848+0000 7fa185625740 10 client.28643 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:50.853 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.848+0000 7fa185625740 20 client.28643 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:50.853 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.848+0000 7fa185625740 1 --2- 172.21.15.3:0/2006508682 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x557601cdb8e0 0x557601cddd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:50.853 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.848+0000 7fa185625740 4 client.28643 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T06:23:50.853 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.848+0000 7fa185625740 1 -- 172.21.15.3:0/2006508682 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557601bbab80 con 0x557601cdb8e0 2024-09-19T06:23:50.854 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.848+0000 7fa17b400640 1 --2- 172.21.15.3:0/2006508682 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x557601cdb8e0 0x557601cddd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:50.854 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.849+0000 7fa169600640 10 client.28643 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:50.854 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.848+0000 7fa17b400640 1 --2- 172.21.15.3:0/2006508682 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x557601cdb8e0 0x557601cddd00 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b20c66f5d063146 server_cookie=610466f74bf7d428 in_seq=0 out_seq=0 2024-09-19T06:23:50.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.863+0000 7fa169600640 1 -- 172.21.15.3:0/2006508682 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557601bbab80 con 0x557601cdb8e0 2024-09-19T06:23:50.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.863+0000 7fa169600640 10 client.28643 handle_command_reply: tid=0 2024-09-19T06:23:50.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.863+0000 7fa185625740 1 client.28643 shutdown 2024-09-19T06:23:50.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.864+0000 7fa185625740 1 -- 172.21.15.3:0/2006508682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557601c4db00 msgr2=0x557601c64d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:50.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.864+0000 7fa185625740 1 --2- 172.21.15.3:0/2006508682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557601c4db00 0x557601c64d70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa1640059f0 tx=0x7fa164015f80 comp rx=0 tx=0).stop 2024-09-19T06:23:50.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.864+0000 7fa185625740 1 -- 172.21.15.3:0/2006508682 shutdown_connections 2024-09-19T06:23:50.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.864+0000 7fa185625740 1 --2- 172.21.15.3:0/2006508682 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x557601cdb8e0 0x557601cddd00 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.864+0000 7fa185625740 1 --2- 172.21.15.3:0/2006508682 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x557601c583a0 0x557601c652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.864+0000 7fa185625740 1 --2- 172.21.15.3:0/2006508682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557601c4db00 0x557601c64d70 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.866 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.864+0000 7fa169600640 0 client.28643 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:50.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.864+0000 7fa185625740 1 --2- 172.21.15.3:0/2006508682 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x557601c4d1e0 0x557601c64830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.864+0000 7fa185625740 1 -- 172.21.15.3:0/2006508682 >> 172.21.15.3:0/2006508682 conn(0x557601c49750 msgr2=0x557601c56950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:50.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.864+0000 7fa185625740 1 -- 172.21.15.3:0/2006508682 shutdown_connections 2024-09-19T06:23:50.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.864+0000 7fa185625740 1 -- 172.21.15.3:0/2006508682 wait complete. 2024-09-19T06:23:50.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.864+0000 7fa185625740 20 client.28643 trim_cache size 0 max 16384 2024-09-19T06:23:50.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:{ 2024-09-19T06:23:50.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "message": "", 2024-09-19T06:23:50.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout: "return_code": 0 2024-09-19T06:23:50.867 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stdout:} 2024-09-19T06:23:50.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.865+0000 7fa182800640 1 -- 172.21.15.3:0/4042567798 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa1600a33b0 msgr2=0x7fa1600a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:50.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.865+0000 7fa182800640 1 --2- 172.21.15.3:0/4042567798 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa1600a33b0 0x7fa1600a5870 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x557601c4a5b0 tx=0x7fa16c005f90 comp rx=0 tx=0).stop 2024-09-19T06:23:50.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.865+0000 7fa182800640 1 -- 172.21.15.3:0/4042567798 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa17c10e300 msgr2=0x7fa17c19ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:50.868 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.865+0000 7fa182800640 1 --2- 172.21.15.3:0/4042567798 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa17c10e300 0x7fa17c19ef00 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fa174004af0 tx=0x7fa17402f3a0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.865+0000 7fa182800640 1 -- 172.21.15.3:0/4042567798 shutdown_connections 2024-09-19T06:23:50.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.865+0000 7fa182800640 1 --2- 172.21.15.3:0/4042567798 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fa1600a33b0 0x7fa1600a5870 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.865+0000 7fa182800640 1 --2- 172.21.15.3:0/4042567798 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa17c10e300 0x7fa17c19ef00 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.865+0000 7fa182800640 1 --2- 172.21.15.3:0/4042567798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa17c074f40 0x7fa17c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.865+0000 7fa182800640 1 --2- 172.21.15.3:0/4042567798 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fa17c074620 0x7fa17c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:50.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.865+0000 7fa182800640 1 -- 172.21.15.3:0/4042567798 >> 172.21.15.3:0/4042567798 conn(0x7fa17c0fd7e0 msgr2=0x7fa17c0fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:50.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.865+0000 7fa182800640 1 -- 172.21.15.3:0/4042567798 shutdown_connections 2024-09-19T06:23:50.869 INFO:teuthology.task.background_exec.ubuntu@smithi003.front.sepia.ceph.com.smithi003.stderr:2024-09-19T06:23:50.865+0000 7fa182800640 1 -- 172.21.15.3:0/4042567798 wait complete. 2024-09-19T06:23:51.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:51 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:23:51.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:51 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:23:51.085 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:51 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:23:51.233 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.210+0000 7f58db000640 1 -- 172.21.15.3:0/211931422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58d41049a0 msgr2=0x7f58d41089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:51.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.210+0000 7f58db000640 1 --2- 172.21.15.3:0/211931422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58d41049a0 0x7f58d41089f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f58c0009900 tx=0x7f58c002a410 comp rx=0 tx=0).stop 2024-09-19T06:23:51.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.210+0000 7f58db000640 1 -- 172.21.15.3:0/211931422 shutdown_connections 2024-09-19T06:23:51.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.210+0000 7f58db000640 1 --2- 172.21.15.3:0/211931422 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58d4109120 0x7f58d4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.210+0000 7f58db000640 1 --2- 172.21.15.3:0/211931422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58d41049a0 0x7f58d41089f0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.210+0000 7f58db000640 1 --2- 172.21.15.3:0/211931422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58d4103ff0 0x7f58d41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.210+0000 7f58db000640 1 -- 172.21.15.3:0/211931422 >> 172.21.15.3:0/211931422 conn(0x7f58d40ffa90 msgr2=0x7f58d4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:51.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.210+0000 7f58db000640 1 -- 172.21.15.3:0/211931422 shutdown_connections 2024-09-19T06:23:51.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.210+0000 7f58db000640 1 -- 172.21.15.3:0/211931422 wait complete. 2024-09-19T06:23:51.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.211+0000 7f58db000640 1 Processor -- start 2024-09-19T06:23:51.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.211+0000 7f58db000640 1 -- start start 2024-09-19T06:23:51.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.212+0000 7f58db000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58d4103ff0 0x7f58d419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:51.234 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.212+0000 7f58db000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58d41049a0 0x7f58d419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:51.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.212+0000 7f58db000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58d4109120 0x7f58d419eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:51.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.212+0000 7f58db000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f58d4114190 con 0x7f58d41049a0 2024-09-19T06:23:51.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.212+0000 7f58db000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f58d4114010 con 0x7f58d4109120 2024-09-19T06:23:51.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.212+0000 7f58db000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f58d4114310 con 0x7f58d4103ff0 2024-09-19T06:23:51.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.212+0000 7f58d3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58d41049a0 0x7f58d419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:51.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.212+0000 7f58d3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58d4103ff0 0x7f58d419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:51.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.212+0000 7f58d3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58d41049a0 0x7f58d419ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39106/0 (socket says 172.21.15.3:39106) 2024-09-19T06:23:51.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.212+0000 7f58d3400640 1 -- 172.21.15.3:0/4063792635 learned_addr learned my addr 172.21.15.3:0/4063792635 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:51.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.212+0000 7f58d9000640 1 --2- 172.21.15.3:0/4063792635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58d4109120 0x7f58d419eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:51.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.212+0000 7f58d3e00640 1 -- 172.21.15.3:0/4063792635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58d4109120 msgr2=0x7f58d419eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:51.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.212+0000 7f58d3e00640 1 --2- 172.21.15.3:0/4063792635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58d4109120 0x7f58d419eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.212+0000 7f58d3e00640 1 -- 172.21.15.3:0/4063792635 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58d41049a0 msgr2=0x7f58d419ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:51.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.212+0000 7f58d3e00640 1 --2- 172.21.15.3:0/4063792635 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58d41049a0 0x7f58d419ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.213+0000 7f58d3e00640 1 -- 172.21.15.3:0/4063792635 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d419f5a0 con 0x7f58d4103ff0 2024-09-19T06:23:51.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.213+0000 7f58d3400640 1 --2- 172.21.15.3:0/4063792635 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58d41049a0 0x7f58d419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:51.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.213+0000 7f58d3e00640 1 --2- 172.21.15.3:0/4063792635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58d4103ff0 0x7f58d419a5f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f58c400e9f0 tx=0x7f58c400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:51.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.213+0000 7f58d0c00640 1 -- 172.21.15.3:0/4063792635 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c400ccc0 con 0x7f58d4103ff0 2024-09-19T06:23:51.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.213+0000 7f58db000640 1 -- 172.21.15.3:0/4063792635 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d419f890 con 0x7f58d4103ff0 2024-09-19T06:23:51.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.213+0000 7f58d0c00640 1 -- 172.21.15.3:0/4063792635 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58c4010910 con 0x7f58d4103ff0 2024-09-19T06:23:51.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.213+0000 7f58d0c00640 1 -- 172.21.15.3:0/4063792635 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c4018960 con 0x7f58d4103ff0 2024-09-19T06:23:51.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.213+0000 7f58db000640 1 -- 172.21.15.3:0/4063792635 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d41a7170 con 0x7f58d4103ff0 2024-09-19T06:23:51.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.216+0000 7f58dda95740 1 Processor -- start 2024-09-19T06:23:51.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.216+0000 7f58dda95740 1 -- start start 2024-09-19T06:23:51.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.216+0000 7f58d0c00640 1 -- 172.21.15.3:0/4063792635 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f58c4010ac0 con 0x7f58d4103ff0 2024-09-19T06:23:51.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.216+0000 7f58dda95740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560298004ac0 0x560298004ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:51.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.217+0000 7f58dda95740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602980053e0 0x56029800f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:51.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.217+0000 7f58dda95740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56029800fca0 0x560298012090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:51.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.217+0000 7f58dda95740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560297f6b290 con 0x56029800fca0 2024-09-19T06:23:51.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.217+0000 7f58dda95740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560297f12b40 con 0x560298004ac0 2024-09-19T06:23:51.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.217+0000 7f58dda95740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560297f67250 con 0x5602980053e0 2024-09-19T06:23:51.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.217+0000 7f58d3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56029800fca0 0x560298012090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:51.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.217+0000 7f58d3400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56029800fca0 0x560298012090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39110/0 (socket says 172.21.15.3:39110) 2024-09-19T06:23:51.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.217+0000 7f58d3400640 1 -- 172.21.15.3:0/3679470553 learned_addr learned my addr 172.21.15.3:0/3679470553 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:51.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.217+0000 7f58d9000640 1 --2- 172.21.15.3:0/3679470553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560298004ac0 0x560298004ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:51.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.217+0000 7f58d3e00640 1 --2- 172.21.15.3:0/3679470553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602980053e0 0x56029800f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:51.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.217+0000 7f58d3400640 1 -- 172.21.15.3:0/3679470553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602980053e0 msgr2=0x56029800f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:51.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.217+0000 7f58d3400640 1 --2- 172.21.15.3:0/3679470553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602980053e0 0x56029800f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.217+0000 7f58d3400640 1 -- 172.21.15.3:0/3679470553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560298004ac0 msgr2=0x560298004ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:51.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.217+0000 7f58d3400640 1 --2- 172.21.15.3:0/3679470553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560298004ac0 0x560298004ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.217+0000 7f58d3400640 1 -- 172.21.15.3:0/3679470553 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560297cdc6a0 con 0x56029800fca0 2024-09-19T06:23:51.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.217+0000 7f58d9000640 1 --2- 172.21.15.3:0/3679470553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560298004ac0 0x560298004ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:51.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.218+0000 7f58d3400640 1 --2- 172.21.15.3:0/3679470553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56029800fca0 0x560298012090 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f58c0006010 tx=0x7f58c0005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1535bc45a0e053ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:51.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.218+0000 7f58c9600640 1 -- 172.21.15.3:0/3679470553 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c0040070 con 0x56029800fca0 2024-09-19T06:23:51.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.218+0000 7f58c9600640 1 -- 172.21.15.3:0/3679470553 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58c00047a0 con 0x56029800fca0 2024-09-19T06:23:51.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.218+0000 7f58c9600640 1 -- 172.21.15.3:0/3679470553 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c0035040 con 0x56029800fca0 2024-09-19T06:23:51.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.218+0000 7f58d0c00640 1 --2- 172.21.15.3:0/4063792635 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f58b80a3430 0x7f58b80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:51.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.218+0000 7f58d0c00640 1 -- 172.21.15.3:0/4063792635 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7f58c40d00a0 con 0x7f58d4103ff0 2024-09-19T06:23:51.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.219+0000 7f58d9000640 1 --2- 172.21.15.3:0/4063792635 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f58b80a3430 0x7f58b80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:51.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.219+0000 7f58dda95740 1 -- 172.21.15.3:0/3679470553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56029800fca0 msgr2=0x560298012090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:51.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.219+0000 7f58dda95740 1 --2- 172.21.15.3:0/3679470553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56029800fca0 0x560298012090 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f58c0006010 tx=0x7f58c0005dd0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.219+0000 7f58dda95740 1 -- 172.21.15.3:0/3679470553 shutdown_connections 2024-09-19T06:23:51.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.219+0000 7f58dda95740 1 --2- 172.21.15.3:0/3679470553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56029800fca0 0x560298012090 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.219+0000 7f58dda95740 1 --2- 172.21.15.3:0/3679470553 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602980053e0 0x56029800f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.219+0000 7f58dda95740 1 --2- 172.21.15.3:0/3679470553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560298004ac0 0x560298004ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.219+0000 7f58dda95740 1 -- 172.21.15.3:0/3679470553 >> 172.21.15.3:0/3679470553 conn(0x560298001050 msgr2=0x560298001430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:51.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.219+0000 7f58dda95740 1 -- 172.21.15.3:0/3679470553 shutdown_connections 2024-09-19T06:23:51.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.219+0000 7f58dda95740 1 -- 172.21.15.3:0/3679470553 wait complete. 2024-09-19T06:23:51.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.219+0000 7f58d9000640 1 --2- 172.21.15.3:0/4063792635 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f58b80a3430 0x7f58b80a58f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f58cc009fd0 tx=0x7f58cc009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:51.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.220+0000 7f58dda95740 1 -- start start 2024-09-19T06:23:51.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.220+0000 7f58dda95740 1 Processor -- start 2024-09-19T06:23:51.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.220+0000 7f58dda95740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560298004ac0 0x56029800f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:51.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.220+0000 7f58dda95740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602980053e0 0x56029800c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:51.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.220+0000 7f58dda95740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56029800fca0 0x56029800ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:51.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.220+0000 7f58dda95740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x560298012910 con 0x56029800fca0 2024-09-19T06:23:51.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.220+0000 7f58dda95740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560297f25fa0 con 0x560298004ac0 2024-09-19T06:23:51.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.220+0000 7f58dda95740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560298012a90 con 0x5602980053e0 2024-09-19T06:23:51.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.220+0000 7f58dda95740 10 client.0 _ll_register_callbacks cb 0x560297c79ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:51.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.221+0000 7f58d3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560298004ac0 0x56029800f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:51.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.221+0000 7f58d3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560298004ac0 0x56029800f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44508/0 (socket says 172.21.15.3:44508) 2024-09-19T06:23:51.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.221+0000 7f58d9000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56029800fca0 0x56029800ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:51.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.221+0000 7f58d3e00640 1 -- 172.21.15.3:0/1469481816 learned_addr learned my addr 172.21.15.3:0/1469481816 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:51.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.221+0000 7f58d3400640 1 --2- 172.21.15.3:0/1469481816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602980053e0 0x56029800c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:51.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.221+0000 7f58d3e00640 1 -- 172.21.15.3:0/1469481816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602980053e0 msgr2=0x56029800c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:51.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.221+0000 7f58d3e00640 1 --2- 172.21.15.3:0/1469481816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602980053e0 0x56029800c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.221+0000 7f58d3e00640 1 -- 172.21.15.3:0/1469481816 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56029800fca0 msgr2=0x56029800ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:51.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.221+0000 7f58d3e00640 1 --2- 172.21.15.3:0/1469481816 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56029800fca0 0x56029800ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.221+0000 7f58d3e00640 1 -- 172.21.15.3:0/1469481816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56029800d650 con 0x560298004ac0 2024-09-19T06:23:51.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.221+0000 7f58d3e00640 1 --2- 172.21.15.3:0/1469481816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560298004ac0 0x56029800f610 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f58c409c0a0 tx=0x7f58c4010ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f271de7a59dd5ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:51.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.221+0000 7f58be000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:23:51.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.221+0000 7f58be000640 1 -- 172.21.15.3:0/1469481816 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c409bd00 con 0x560298004ac0 2024-09-19T06:23:51.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.222+0000 7f58be000640 1 -- 172.21.15.3:0/1469481816 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7f58c40d20d0 con 0x560298004ac0 2024-09-19T06:23:51.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.222+0000 7f58dda95740 1 -- 172.21.15.3:0/1469481816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58c00047a0 con 0x560298004ac0 2024-09-19T06:23:51.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.222+0000 7f58be000640 1 -- 172.21.15.3:0/1469481816 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f58c40cdbe0 con 0x560298004ac0 2024-09-19T06:23:51.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.222+0000 7f58dda95740 10 client.28655 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:51.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.222+0000 7f58dda95740 1 -- 172.21.15.3:0/1469481816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56029801e850 con 0x560298004ac0 2024-09-19T06:23:51.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.222+0000 7f58be000640 1 -- 172.21.15.3:0/1469481816 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58c00047a0 con 0x560298004ac0 2024-09-19T06:23:51.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.222+0000 7f58be000640 1 -- 172.21.15.3:0/1469481816 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f58c409b7f0 con 0x560298004ac0 2024-09-19T06:23:51.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.222+0000 7f58dda95740 10 client.28655 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:51.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.222+0000 7f58dda95740 10 client.28655 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:51.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.222+0000 7f58dda95740 20 client.28655 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:51.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.222+0000 7f58dda95740 1 --2- 172.21.15.3:0/1469481816 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56029801fcd0 0x560298022140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:51.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.222+0000 7f58dda95740 4 client.28655 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:51.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.222+0000 7f58dda95740 1 -- 172.21.15.3:0/1469481816 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560297f78800 con 0x56029801fcd0 2024-09-19T06:23:51.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.223+0000 7f58d3400640 1 --2- 172.21.15.3:0/1469481816 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56029801fcd0 0x560298022140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:51.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.223+0000 7f58d3400640 1 --2- 172.21.15.3:0/1469481816 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56029801fcd0 0x560298022140 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb1c5bfa194799a0 server_cookie=6793f003a496de00 in_seq=0 out_seq=0 2024-09-19T06:23:51.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.223+0000 7f58be000640 10 client.28655 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:51.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.224+0000 7f58be000640 1 -- 172.21.15.3:0/1469481816 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560297f78800 con 0x56029801fcd0 2024-09-19T06:23:51.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.224+0000 7f58be000640 10 client.28655 handle_command_reply: tid=0 2024-09-19T06:23:51.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.224+0000 7f58dda95740 1 client.28655 shutdown 2024-09-19T06:23:51.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.224+0000 7f58dda95740 1 -- 172.21.15.3:0/1469481816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560298004ac0 msgr2=0x56029800f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:51.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.224+0000 7f58dda95740 1 --2- 172.21.15.3:0/1469481816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560298004ac0 0x56029800f610 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f58c409c0a0 tx=0x7f58c4010ee0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.224+0000 7f58dda95740 1 -- 172.21.15.3:0/1469481816 shutdown_connections 2024-09-19T06:23:51.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.224+0000 7f58dda95740 1 --2- 172.21.15.3:0/1469481816 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56029801fcd0 0x560298022140 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.224+0000 7f58dda95740 1 --2- 172.21.15.3:0/1469481816 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56029800fca0 0x56029800ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.224+0000 7f58dda95740 1 --2- 172.21.15.3:0/1469481816 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602980053e0 0x56029800c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.224+0000 7f58be000640 0 client.28655 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:51.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.224+0000 7f58dda95740 1 --2- 172.21.15.3:0/1469481816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560298004ac0 0x56029800f610 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.224+0000 7f58dda95740 1 -- 172.21.15.3:0/1469481816 >> 172.21.15.3:0/1469481816 conn(0x560298001050 msgr2=0x5602980001c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:51.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.224+0000 7f58dda95740 1 -- 172.21.15.3:0/1469481816 shutdown_connections 2024-09-19T06:23:51.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.224+0000 7f58dda95740 1 -- 172.21.15.3:0/1469481816 wait complete. 2024-09-19T06:23:51.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.225+0000 7f58dda95740 20 client.28655 trim_cache size 0 max 16384 2024-09-19T06:23:51.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.243+0000 7f58dda95740 1 Processor -- start 2024-09-19T06:23:51.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.243+0000 7f58dda95740 1 -- start start 2024-09-19T06:23:51.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.243+0000 7f58dda95740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560298004ac0 0x56029800e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:51.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.243+0000 7f58dda95740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602980053e0 0x560298027950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:51.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.243+0000 7f58dda95740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56029800fca0 0x560298027e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:51.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.243+0000 7f58dda95740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f58d41afb10 con 0x56029800fca0 2024-09-19T06:23:51.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.243+0000 7f58dda95740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f58d41b1650 con 0x5602980053e0 2024-09-19T06:23:51.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.243+0000 7f58dda95740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f58d41b01e0 con 0x560298004ac0 2024-09-19T06:23:51.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.244+0000 7f58d3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560298004ac0 0x56029800e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:51.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.244+0000 7f58d3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602980053e0 0x560298027950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:51.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.244+0000 7f58d3e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560298004ac0 0x56029800e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:52872/0 (socket says 172.21.15.3:52872) 2024-09-19T06:23:51.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.244+0000 7f58d3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602980053e0 0x560298027950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44510/0 (socket says 172.21.15.3:44510) 2024-09-19T06:23:51.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.244+0000 7f58d3e00640 1 -- 172.21.15.3:0/3279662562 learned_addr learned my addr 172.21.15.3:0/3279662562 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:51.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.244+0000 7f58d9000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56029800fca0 0x560298027e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:51.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.244+0000 7f58d3e00640 1 -- 172.21.15.3:0/3279662562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602980053e0 msgr2=0x560298027950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:51.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.244+0000 7f58d3e00640 1 --2- 172.21.15.3:0/3279662562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602980053e0 0x560298027950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.244+0000 7f58d3e00640 1 -- 172.21.15.3:0/3279662562 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56029800fca0 msgr2=0x560298027e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:51.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.244+0000 7f58d3e00640 1 --2- 172.21.15.3:0/3279662562 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56029800fca0 0x560298027e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.244+0000 7f58d3e00640 1 -- 172.21.15.3:0/3279662562 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560298022720 con 0x560298004ac0 2024-09-19T06:23:51.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.244+0000 7f58d3400640 1 --2- 172.21.15.3:0/3279662562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602980053e0 0x560298027950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:51.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.244+0000 7f58d3e00640 1 --2- 172.21.15.3:0/3279662562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560298004ac0 0x56029800e830 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f58c400c6a0 tx=0x7f58c40b5240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9db252c7d5ed020 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:51.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.245+0000 7f58c8c00640 1 -- 172.21.15.3:0/3279662562 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c40a4f60 con 0x560298004ac0 2024-09-19T06:23:51.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.245+0000 7f58c8c00640 1 -- 172.21.15.3:0/3279662562 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58c409c3a0 con 0x560298004ac0 2024-09-19T06:23:51.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.245+0000 7f58c8c00640 1 -- 172.21.15.3:0/3279662562 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c40bc0e0 con 0x560298004ac0 2024-09-19T06:23:51.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.245+0000 7f58dda95740 1 -- 172.21.15.3:0/3279662562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560298004ac0 msgr2=0x56029800e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:51.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.245+0000 7f58dda95740 1 --2- 172.21.15.3:0/3279662562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560298004ac0 0x56029800e830 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f58c400c6a0 tx=0x7f58c40b5240 comp rx=0 tx=0).stop 2024-09-19T06:23:51.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.245+0000 7f58dda95740 1 -- 172.21.15.3:0/3279662562 shutdown_connections 2024-09-19T06:23:51.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.245+0000 7f58dda95740 1 --2- 172.21.15.3:0/3279662562 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x56029800fca0 0x560298027e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.245+0000 7f58dda95740 1 --2- 172.21.15.3:0/3279662562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5602980053e0 0x560298027950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.245+0000 7f58dda95740 1 --2- 172.21.15.3:0/3279662562 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560298004ac0 0x56029800e830 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.245+0000 7f58dda95740 1 -- 172.21.15.3:0/3279662562 >> 172.21.15.3:0/3279662562 conn(0x560298001050 msgr2=0x56029800e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:51.249 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.245+0000 7f58dda95740 1 -- 172.21.15.3:0/3279662562 shutdown_connections 2024-09-19T06:23:51.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.245+0000 7f58dda95740 1 -- 172.21.15.3:0/3279662562 wait complete. 2024-09-19T06:23:51.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.246+0000 7f58dda95740 1 -- start start 2024-09-19T06:23:51.250 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.246+0000 7f58dda95740 1 Processor -- start 2024-09-19T06:23:51.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.246+0000 7f58dda95740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560298004ac0 0x5602980162c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:51.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.246+0000 7f58dda95740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602980053e0 0x560298016800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:51.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.246+0000 7f58dda95740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56029800fca0 0x560298083900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:51.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.246+0000 7f58dda95740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f58d41b0f80 con 0x560298004ac0 2024-09-19T06:23:51.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.246+0000 7f58dda95740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f58d41b08b0 con 0x56029800fca0 2024-09-19T06:23:51.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.246+0000 7f58dda95740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f58d41adb10 con 0x5602980053e0 2024-09-19T06:23:51.253 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.247+0000 7f58dda95740 10 client.0 _ll_register_callbacks cb 0x56029800d820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:51.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.247+0000 7f58d3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560298004ac0 0x5602980162c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:51.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.247+0000 7f58d3e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560298004ac0 0x5602980162c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39146/0 (socket says 172.21.15.3:39146) 2024-09-19T06:23:51.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.247+0000 7f58d3e00640 1 -- 172.21.15.3:0/2829022392 learned_addr learned my addr 172.21.15.3:0/2829022392 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:51.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.247+0000 7f58d9000640 1 --2- 172.21.15.3:0/2829022392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56029800fca0 0x560298083900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:51.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.247+0000 7f58d3400640 1 --2- 172.21.15.3:0/2829022392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602980053e0 0x560298016800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:51.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.247+0000 7f58d3e00640 1 -- 172.21.15.3:0/2829022392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602980053e0 msgr2=0x560298016800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:51.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.247+0000 7f58d3e00640 1 --2- 172.21.15.3:0/2829022392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602980053e0 0x560298016800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.247+0000 7f58d3e00640 1 -- 172.21.15.3:0/2829022392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56029800fca0 msgr2=0x560298083900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:51.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.247+0000 7f58d3e00640 1 --2- 172.21.15.3:0/2829022392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56029800fca0 0x560298083900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.247+0000 7f58d3e00640 1 -- 172.21.15.3:0/2829022392 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560298083f40 con 0x560298004ac0 2024-09-19T06:23:51.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.247+0000 7f58d3e00640 1 --2- 172.21.15.3:0/2829022392 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560298004ac0 0x5602980162c0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f58c40a4a30 tx=0x7f58c4010ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1af576ef6708b12 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:51.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.247+0000 7f58be000640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:23:51.254 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.248+0000 7f58be000640 1 -- 172.21.15.3:0/2829022392 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c40d3840 con 0x560298004ac0 2024-09-19T06:23:51.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.248+0000 7f58be000640 1 -- 172.21.15.3:0/2829022392 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7f58c40bc0b0 con 0x560298004ac0 2024-09-19T06:23:51.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.248+0000 7f58dda95740 1 -- 172.21.15.3:0/2829022392 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58c409c3a0 con 0x560298004ac0 2024-09-19T06:23:51.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.248+0000 7f58be000640 1 -- 172.21.15.3:0/2829022392 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f58c40a4f60 con 0x560298004ac0 2024-09-19T06:23:51.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.248+0000 7f58dda95740 10 client.18627 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:51.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.248+0000 7f58dda95740 1 -- 172.21.15.3:0/2829022392 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56029808b2f0 con 0x560298004ac0 2024-09-19T06:23:51.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.248+0000 7f58be000640 1 -- 172.21.15.3:0/2829022392 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58c409c3a0 con 0x560298004ac0 2024-09-19T06:23:51.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.248+0000 7f58be000640 1 -- 172.21.15.3:0/2829022392 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f58c40980f0 con 0x560298004ac0 2024-09-19T06:23:51.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.248+0000 7f58dda95740 10 client.18627 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:51.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.248+0000 7f58dda95740 10 client.18627 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:51.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.248+0000 7f58dda95740 20 client.18627 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:51.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.248+0000 7f58dda95740 1 --2- 172.21.15.3:0/2829022392 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56029808b6d0 0x56029808dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:51.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.249+0000 7f58dda95740 4 client.18627 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T06:23:51.255 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.249+0000 7f58dda95740 1 -- 172.21.15.3:0/2829022392 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560297f72d10 con 0x56029808b6d0 2024-09-19T06:23:51.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.249+0000 7f58d3400640 1 --2- 172.21.15.3:0/2829022392 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56029808b6d0 0x56029808dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:51.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.249+0000 7f58d3400640 1 --2- 172.21.15.3:0/2829022392 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56029808b6d0 0x56029808dac0 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abe4365a77cac32b server_cookie=5438127809aa1bac in_seq=0 out_seq=0 2024-09-19T06:23:51.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.249+0000 7f58be000640 10 client.18627 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:51.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.250+0000 7f58be000640 1 -- 172.21.15.3:0/2829022392 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560297f72d10 con 0x56029808b6d0 2024-09-19T06:23:51.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.250+0000 7f58be000640 10 client.18627 handle_command_reply: tid=0 2024-09-19T06:23:51.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.250+0000 7f58dda95740 1 client.18627 shutdown 2024-09-19T06:23:51.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.251+0000 7f58dda95740 1 -- 172.21.15.3:0/2829022392 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560298004ac0 msgr2=0x5602980162c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:51.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.251+0000 7f58dda95740 1 --2- 172.21.15.3:0/2829022392 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560298004ac0 0x5602980162c0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f58c40a4a30 tx=0x7f58c4010ee0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.251+0000 7f58dda95740 1 -- 172.21.15.3:0/2829022392 shutdown_connections 2024-09-19T06:23:51.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.251+0000 7f58dda95740 1 --2- 172.21.15.3:0/2829022392 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56029808b6d0 0x56029808dac0 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.251+0000 7f58dda95740 1 --2- 172.21.15.3:0/2829022392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56029800fca0 0x560298083900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.251+0000 7f58dda95740 1 --2- 172.21.15.3:0/2829022392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5602980053e0 0x560298016800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.251+0000 7f58be000640 0 client.18627 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:51.256 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.251+0000 7f58dda95740 1 --2- 172.21.15.3:0/2829022392 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560298004ac0 0x5602980162c0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.251+0000 7f58dda95740 1 -- 172.21.15.3:0/2829022392 >> 172.21.15.3:0/2829022392 conn(0x560298001050 msgr2=0x5602980001c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:51.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.251+0000 7f58dda95740 1 -- 172.21.15.3:0/2829022392 shutdown_connections 2024-09-19T06:23:51.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.251+0000 7f58dda95740 1 -- 172.21.15.3:0/2829022392 wait complete. 2024-09-19T06:23:51.257 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.251+0000 7f58dda95740 20 client.18627 trim_cache size 0 max 16384 2024-09-19T06:23:51.257 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:23:51.257 INFO:teuthology.orchestra.run.smithi003.stdout: "return_code": 0, 2024-09-19T06:23:51.257 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_tag": "c1680cfc-7b80-44e7-acca-3823bc4c8b24", 2024-09-19T06:23:51.257 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": "asynchronous" 2024-09-19T06:23:51.257 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:23:51.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.252+0000 7f58db000640 1 -- 172.21.15.3:0/4063792635 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f58b80a3430 msgr2=0x7f58b80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:51.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.252+0000 7f58db000640 1 --2- 172.21.15.3:0/4063792635 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f58b80a3430 0x7f58b80a58f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f58cc009fd0 tx=0x7f58cc009500 comp rx=0 tx=0).stop 2024-09-19T06:23:51.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.252+0000 7f58db000640 1 -- 172.21.15.3:0/4063792635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58d4103ff0 msgr2=0x7f58d419a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:51.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.252+0000 7f58db000640 1 --2- 172.21.15.3:0/4063792635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58d4103ff0 0x7f58d419a5f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f58c400e9f0 tx=0x7f58c400eeb0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.252+0000 7f58db000640 1 -- 172.21.15.3:0/4063792635 shutdown_connections 2024-09-19T06:23:51.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.252+0000 7f58db000640 1 --2- 172.21.15.3:0/4063792635 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f58b80a3430 0x7f58b80a58f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.252+0000 7f58db000640 1 --2- 172.21.15.3:0/4063792635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58d4109120 0x7f58d419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.252+0000 7f58db000640 1 --2- 172.21.15.3:0/4063792635 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f58d41049a0 0x7f58d419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.252+0000 7f58db000640 1 --2- 172.21.15.3:0/4063792635 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f58d4103ff0 0x7f58d419a5f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:51.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.252+0000 7f58db000640 1 -- 172.21.15.3:0/4063792635 >> 172.21.15.3:0/4063792635 conn(0x7f58d40ffa90 msgr2=0x7f58d4101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:51.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.252+0000 7f58db000640 1 -- 172.21.15.3:0/4063792635 shutdown_connections 2024-09-19T06:23:51.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:51.252+0000 7f58db000640 1 -- 172.21.15.3:0/4063792635 wait complete. 2024-09-19T06:23:51.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:51 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:23:51.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:51 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:23:51.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:51 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:23:51.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:51 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:23:51.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:51 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:23:51.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:51 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:23:52.264 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:23:52.407 INFO:tasks.workunit.client.0.smithi003.stdout:561/600: open fd = 3 2024-09-19T06:23:52.407 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.407 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.407 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.407 INFO:tasks.workunit.client.0.smithi003.stdout:562/600: open fd = 3 2024-09-19T06:23:52.407 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.408 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.408 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.408 INFO:tasks.workunit.client.0.smithi003.stdout:563/600: open fd = 3 2024-09-19T06:23:52.408 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.408 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.408 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.408 INFO:tasks.workunit.client.0.smithi003.stdout:564/600: open fd = 3 2024-09-19T06:23:52.408 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.408 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.408 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.408 INFO:tasks.workunit.client.0.smithi003.stdout:565/600: open fd = 3 2024-09-19T06:23:52.408 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.408 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.409 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.409 INFO:tasks.workunit.client.0.smithi003.stdout:566/600: open fd = 3 2024-09-19T06:23:52.409 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.409 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.409 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.409 INFO:tasks.workunit.client.0.smithi003.stdout:567/600: open fd = 3 2024-09-19T06:23:52.409 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.409 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.409 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.409 INFO:tasks.workunit.client.0.smithi003.stdout:568/600: open fd = 3 2024-09-19T06:23:52.409 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.409 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.409 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.409 INFO:tasks.workunit.client.0.smithi003.stdout:569/600: open fd = 3 2024-09-19T06:23:52.410 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.410 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.410 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.410 INFO:tasks.workunit.client.0.smithi003.stdout:570/600: open fd = 3 2024-09-19T06:23:52.410 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.410 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.410 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.410 INFO:tasks.workunit.client.0.smithi003.stdout:571/600: open fd = 3 2024-09-19T06:23:52.410 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.410 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.410 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.410 INFO:tasks.workunit.client.0.smithi003.stdout:572/600: open fd = 3 2024-09-19T06:23:52.410 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.411 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.411 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.411 INFO:tasks.workunit.client.0.smithi003.stdout:573/600: open fd = 3 2024-09-19T06:23:52.411 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.411 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.411 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.411 INFO:tasks.workunit.client.0.smithi003.stdout:574/600: open fd = 3 2024-09-19T06:23:52.411 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.411 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.411 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.411 INFO:tasks.workunit.client.0.smithi003.stdout:575/600: open fd = 3 2024-09-19T06:23:52.411 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.411 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.411 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.412 INFO:tasks.workunit.client.0.smithi003.stdout:576/600: open fd = 3 2024-09-19T06:23:52.412 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.412 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.412 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.412 INFO:tasks.workunit.client.0.smithi003.stdout:577/600: open fd = 3 2024-09-19T06:23:52.412 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.412 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.412 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.412 INFO:tasks.workunit.client.0.smithi003.stdout:578/600: open fd = 3 2024-09-19T06:23:52.412 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.412 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.412 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.412 INFO:tasks.workunit.client.0.smithi003.stdout:579/600: open fd = 3 2024-09-19T06:23:52.412 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.413 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.413 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.413 INFO:tasks.workunit.client.0.smithi003.stdout:580/600: open fd = 3 2024-09-19T06:23:52.413 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.413 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.413 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.413 INFO:tasks.workunit.client.0.smithi003.stdout:581/600: open fd = 3 2024-09-19T06:23:52.413 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.413 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.413 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.413 INFO:tasks.workunit.client.0.smithi003.stdout:582/600: open fd = 3 2024-09-19T06:23:52.413 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.413 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.414 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.414 INFO:tasks.workunit.client.0.smithi003.stdout:583/600: open fd = 3 2024-09-19T06:23:52.414 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.414 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.414 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.414 INFO:tasks.workunit.client.0.smithi003.stdout:584/600: open fd = 3 2024-09-19T06:23:52.414 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.414 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.414 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.414 INFO:tasks.workunit.client.0.smithi003.stdout:585/600: open fd = 3 2024-09-19T06:23:52.414 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.414 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.414 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.414 INFO:tasks.workunit.client.0.smithi003.stdout:586/600: open fd = 3 2024-09-19T06:23:52.415 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.415 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.415 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.415 INFO:tasks.workunit.client.0.smithi003.stdout:587/600: open fd = 3 2024-09-19T06:23:52.415 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.415 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.415 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.415 INFO:tasks.workunit.client.0.smithi003.stdout:588/600: open fd = 3 2024-09-19T06:23:52.415 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.415 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.415 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.415 INFO:tasks.workunit.client.0.smithi003.stdout:589/600: open fd = 3 2024-09-19T06:23:52.415 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.416 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.416 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.416 INFO:tasks.workunit.client.0.smithi003.stdout:590/600: open fd = 3 2024-09-19T06:23:52.416 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.416 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.416 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.416 INFO:tasks.workunit.client.0.smithi003.stdout:591/600: open fd = 3 2024-09-19T06:23:52.416 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.416 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.416 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.416 INFO:tasks.workunit.client.0.smithi003.stdout:592/600: open fd = 3 2024-09-19T06:23:52.416 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.416 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.416 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.417 INFO:tasks.workunit.client.0.smithi003.stdout:593/600: open fd = 3 2024-09-19T06:23:52.417 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.417 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.417 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.417 INFO:tasks.workunit.client.0.smithi003.stdout:594/600: open fd = 3 2024-09-19T06:23:52.417 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.417 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.417 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.417 INFO:tasks.workunit.client.0.smithi003.stdout:595/600: open fd = 3 2024-09-19T06:23:52.417 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.417 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.417 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.417 INFO:tasks.workunit.client.0.smithi003.stdout:596/600: open fd = 3 2024-09-19T06:23:52.417 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.418 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.418 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.418 INFO:tasks.workunit.client.0.smithi003.stdout:597/600: open fd = 3 2024-09-19T06:23:52.418 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.418 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.418 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.418 INFO:tasks.workunit.client.0.smithi003.stdout:598/600: open fd = 3 2024-09-19T06:23:52.418 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.418 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.418 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.418 INFO:tasks.workunit.client.0.smithi003.stdout:599/600: open fd = 3 2024-09-19T06:23:52.418 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.418 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.418 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.419 INFO:tasks.workunit.client.0.smithi003.stdout:600/600: open fd = 3 2024-09-19T06:23:52.419 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.419 INFO:tasks.workunit.client.0.smithi003.stdout:write ret = 32 2024-09-19T06:23:52.419 INFO:tasks.workunit.client.0.smithi003.stdout:pread ret = 64 2024-09-19T06:23:52.419 INFO:tasks.workunit.client.0.smithi003.stderr:+ echo OK 2024-09-19T06:23:52.420 INFO:tasks.workunit.client.0.smithi003.stdout:OK 2024-09-19T06:23:52.420 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T06:23:52.420 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T06:23:52.469 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:52 smithi003 ceph-mon[30893]: pgmap v357: 97 pgs: 97 active+clean; 3.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-09-19T06:23:52.490 INFO:tasks.workunit:Stopping ['fs/test_o_trunc.sh'] on client.0... 2024-09-19T06:23:52.490 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T06:23:52.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:52 smithi059 ceph-mon[35138]: pgmap v357: 97 pgs: 97 active+clean; 3.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-09-19T06:23:52.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:52 smithi071 ceph-mon[35662]: pgmap v357: 97 pgs: 97 active+clean; 3.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-09-19T06:23:52.661 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:23:53.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.271+0000 7f4612800640 1 -- 172.21.15.3:0/1000332067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f460c077040 msgr2=0x7f460c1124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:53.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.271+0000 7f4612800640 1 --2- 172.21.15.3:0/1000332067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f460c077040 0x7f460c1124f0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f45f8009900 tx=0x7f45f802a410 comp rx=0 tx=0).stop 2024-09-19T06:23:53.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.271+0000 7f4612800640 1 -- 172.21.15.3:0/1000332067 shutdown_connections 2024-09-19T06:23:53.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.271+0000 7f4612800640 1 --2- 172.21.15.3:0/1000332067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f460c112a30 0x7f460c114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.271+0000 7f4612800640 1 --2- 172.21.15.3:0/1000332067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f460c077040 0x7f460c1124f0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.271+0000 7f4612800640 1 --2- 172.21.15.3:0/1000332067 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f460c076720 0x7f460c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.271+0000 7f4612800640 1 -- 172.21.15.3:0/1000332067 >> 172.21.15.3:0/1000332067 conn(0x7f460c0ffa90 msgr2=0x7f460c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:53.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.271+0000 7f4612800640 1 -- 172.21.15.3:0/1000332067 shutdown_connections 2024-09-19T06:23:53.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.271+0000 7f4612800640 1 -- 172.21.15.3:0/1000332067 wait complete. 2024-09-19T06:23:53.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.272+0000 7f4612800640 1 Processor -- start 2024-09-19T06:23:53.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.272+0000 7f4612800640 1 -- start start 2024-09-19T06:23:53.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.272+0000 7f4612800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f460c076720 0x7f460c1a47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.272+0000 7f4612800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f460c077040 0x7f460c1a4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.272+0000 7f4612800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f460c112a30 0x7f460c19e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.272+0000 7f4612800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f460c1185a0 con 0x7f460c076720 2024-09-19T06:23:53.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.272+0000 7f4612800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f460c118420 con 0x7f460c112a30 2024-09-19T06:23:53.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.272+0000 7f4612800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f460c118720 con 0x7f460c077040 2024-09-19T06:23:53.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.273+0000 7f460b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f460c076720 0x7f460c1a47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.273+0000 7f460be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f460c112a30 0x7f460c19e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.273+0000 7f460b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f460c076720 0x7f460c1a47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39164/0 (socket says 172.21.15.3:39164) 2024-09-19T06:23:53.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.273+0000 7f460be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f460c112a30 0x7f460c19e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44534/0 (socket says 172.21.15.3:44534) 2024-09-19T06:23:53.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.273+0000 7f460b400640 1 -- 172.21.15.3:0/4219138320 learned_addr learned my addr 172.21.15.3:0/4219138320 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:53.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.273+0000 7f460aa00640 1 --2- 172.21.15.3:0/4219138320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f460c077040 0x7f460c1a4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.273+0000 7f460be00640 1 -- 172.21.15.3:0/4219138320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f460c077040 msgr2=0x7f460c1a4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:53.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.273+0000 7f460be00640 1 --2- 172.21.15.3:0/4219138320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f460c077040 0x7f460c1a4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.273+0000 7f460be00640 1 -- 172.21.15.3:0/4219138320 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f460c076720 msgr2=0x7f460c1a47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:53.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.273+0000 7f460be00640 1 --2- 172.21.15.3:0/4219138320 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f460c076720 0x7f460c1a47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.273+0000 7f460be00640 1 -- 172.21.15.3:0/4219138320 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f460c19f0e0 con 0x7f460c112a30 2024-09-19T06:23:53.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.273+0000 7f460b400640 1 --2- 172.21.15.3:0/4219138320 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f460c076720 0x7f460c1a47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:53.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.274+0000 7f460be00640 1 --2- 172.21.15.3:0/4219138320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f460c112a30 0x7f460c19e9b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f460c07aa10 tx=0x7f460400dea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:53.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.274+0000 7f4603e00640 1 -- 172.21.15.3:0/4219138320 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460400bd40 con 0x7f460c112a30 2024-09-19T06:23:53.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.274+0000 7f4603e00640 1 -- 172.21.15.3:0/4219138320 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4604003e50 con 0x7f460c112a30 2024-09-19T06:23:53.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.274+0000 7f4603e00640 1 -- 172.21.15.3:0/4219138320 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46040106c0 con 0x7f460c112a30 2024-09-19T06:23:53.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.274+0000 7f4612800640 1 -- 172.21.15.3:0/4219138320 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f460c19f3d0 con 0x7f460c112a30 2024-09-19T06:23:53.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.274+0000 7f4612800640 1 -- 172.21.15.3:0/4219138320 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f460c1ab6c0 con 0x7f460c112a30 2024-09-19T06:23:53.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.278+0000 7f46152c2740 1 Processor -- start 2024-09-19T06:23:53.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.278+0000 7f4603e00640 1 -- 172.21.15.3:0/4219138320 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f4604003970 con 0x7f460c112a30 2024-09-19T06:23:53.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.279+0000 7f46152c2740 1 -- start start 2024-09-19T06:23:53.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.279+0000 7f46152c2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d742fb90 0x5626d742ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.279+0000 7f46152c2740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d74304b0 0x5626d743a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.279+0000 7f46152c2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5626d743ad70 0x5626d743d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.279+0000 7f46152c2740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5626d73963e0 con 0x5626d74304b0 2024-09-19T06:23:53.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.279+0000 7f46152c2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5626d733dd80 con 0x5626d742fb90 2024-09-19T06:23:53.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.279+0000 7f46152c2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5626d73923a0 con 0x5626d743ad70 2024-09-19T06:23:53.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.279+0000 7f460b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d74304b0 0x5626d743a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.279+0000 7f460aa00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5626d743ad70 0x5626d743d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.279+0000 7f460b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d74304b0 0x5626d743a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39172/0 (socket says 172.21.15.3:39172) 2024-09-19T06:23:53.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.279+0000 7f460b400640 1 -- 172.21.15.3:0/1766952322 learned_addr learned my addr 172.21.15.3:0/1766952322 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:53.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.279+0000 7f460aa00640 1 --2- 172.21.15.3:0/1766952322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d742fb90 0x5626d742ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.280+0000 7f460b400640 1 -- 172.21.15.3:0/1766952322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5626d743ad70 msgr2=0x5626d743d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:53.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.280+0000 7f460b400640 1 --2- 172.21.15.3:0/1766952322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5626d743ad70 0x5626d743d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.280+0000 7f460b400640 1 -- 172.21.15.3:0/1766952322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d742fb90 msgr2=0x5626d742ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:53.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.280+0000 7f460b400640 1 --2- 172.21.15.3:0/1766952322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d742fb90 0x5626d742ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.280+0000 7f460b400640 1 -- 172.21.15.3:0/1766952322 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626d735cae0 con 0x5626d74304b0 2024-09-19T06:23:53.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.280+0000 7f460aa00640 1 --2- 172.21.15.3:0/1766952322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d742fb90 0x5626d742ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:53.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.280+0000 7f460b400640 1 --2- 172.21.15.3:0/1766952322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d74304b0 0x5626d743a830 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f45fc010580 tx=0x7f45fc010a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88b1ff929980dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:53.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.280+0000 7f4603e00640 1 --2- 172.21.15.3:0/4219138320 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f45f00a3430 0x7f45f00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.281+0000 7f4600c00640 1 -- 172.21.15.3:0/1766952322 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc005220 con 0x5626d74304b0 2024-09-19T06:23:53.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.281+0000 7f4603e00640 1 -- 172.21.15.3:0/4219138320 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7f46040cffb0 con 0x7f460c112a30 2024-09-19T06:23:53.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.281+0000 7f4600c00640 1 -- 172.21.15.3:0/1766952322 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45fc004c80 con 0x5626d74304b0 2024-09-19T06:23:53.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.281+0000 7f4600c00640 1 -- 172.21.15.3:0/1766952322 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc00eb70 con 0x5626d74304b0 2024-09-19T06:23:53.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.281+0000 7f460aa00640 1 --2- 172.21.15.3:0/4219138320 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f45f00a3430 0x7f45f00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.282+0000 7f46152c2740 1 -- 172.21.15.3:0/1766952322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d74304b0 msgr2=0x5626d743a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:53.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.282+0000 7f46152c2740 1 --2- 172.21.15.3:0/1766952322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d74304b0 0x5626d743a830 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f45fc010580 tx=0x7f45fc010a40 comp rx=0 tx=0).stop 2024-09-19T06:23:53.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.282+0000 7f460aa00640 1 --2- 172.21.15.3:0/4219138320 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f45f00a3430 0x7f45f00a58f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f45f8009230 tx=0x7f45f80058d0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:53.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.282+0000 7f46152c2740 1 -- 172.21.15.3:0/1766952322 shutdown_connections 2024-09-19T06:23:53.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.282+0000 7f46152c2740 1 --2- 172.21.15.3:0/1766952322 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5626d743ad70 0x5626d743d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.282+0000 7f46152c2740 1 --2- 172.21.15.3:0/1766952322 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d74304b0 0x5626d743a830 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.282+0000 7f46152c2740 1 --2- 172.21.15.3:0/1766952322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d742fb90 0x5626d742ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.282+0000 7f46152c2740 1 -- 172.21.15.3:0/1766952322 >> 172.21.15.3:0/1766952322 conn(0x5626d742c120 msgr2=0x5626d742c500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:53.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.282+0000 7f46152c2740 1 -- 172.21.15.3:0/1766952322 shutdown_connections 2024-09-19T06:23:53.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.282+0000 7f46152c2740 1 -- 172.21.15.3:0/1766952322 wait complete. 2024-09-19T06:23:53.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.283+0000 7f46152c2740 1 -- start start 2024-09-19T06:23:53.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.283+0000 7f46152c2740 1 Processor -- start 2024-09-19T06:23:53.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.284+0000 7f46152c2740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d742fb90 0x5626d7437cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.284+0000 7f46152c2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d74304b0 0x5626d7438230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.284+0000 7f46152c2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5626d743ad70 0x5626d7438770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.284+0000 7f46152c2740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5626d743d9e0 con 0x5626d742fb90 2024-09-19T06:23:53.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.284+0000 7f46152c2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5626d73510f0 con 0x5626d74304b0 2024-09-19T06:23:53.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.284+0000 7f46152c2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5626d743db60 con 0x5626d743ad70 2024-09-19T06:23:53.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.284+0000 7f46152c2740 10 client.0 _ll_register_callbacks cb 0x5626d73429e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:53.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.284+0000 7f460b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d742fb90 0x5626d7437cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.284+0000 7f460b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d742fb90 0x5626d7437cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39176/0 (socket says 172.21.15.3:39176) 2024-09-19T06:23:53.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.284+0000 7f460b400640 1 -- 172.21.15.3:0/2125144637 learned_addr learned my addr 172.21.15.3:0/2125144637 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:53.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.284+0000 7f460aa00640 1 --2- 172.21.15.3:0/2125144637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d74304b0 0x5626d7438230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.285+0000 7f460be00640 1 --2- 172.21.15.3:0/2125144637 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5626d743ad70 0x5626d7438770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.285+0000 7f460b400640 1 -- 172.21.15.3:0/2125144637 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5626d743ad70 msgr2=0x5626d7438770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:53.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.285+0000 7f460b400640 1 --2- 172.21.15.3:0/2125144637 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5626d743ad70 0x5626d7438770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.285+0000 7f460b400640 1 -- 172.21.15.3:0/2125144637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d74304b0 msgr2=0x5626d7438230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:53.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.285+0000 7f460b400640 1 --2- 172.21.15.3:0/2125144637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d74304b0 0x5626d7438230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.285+0000 7f460b400640 1 -- 172.21.15.3:0/2125144637 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626d71073c0 con 0x5626d742fb90 2024-09-19T06:23:53.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.285+0000 7f460b400640 1 --2- 172.21.15.3:0/2125144637 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d742fb90 0x5626d7437cf0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f45fc00e610 tx=0x7f45fc00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11da2bdbcdbbc53 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:53.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.285+0000 7f45f5600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:23:53.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.285+0000 7f45f5600640 1 -- 172.21.15.3:0/2125144637 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc02a060 con 0x5626d742fb90 2024-09-19T06:23:53.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.286+0000 7f45f5600640 1 -- 172.21.15.3:0/2125144637 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7f45fc0048d0 con 0x5626d742fb90 2024-09-19T06:23:53.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.286+0000 7f46152c2740 1 -- 172.21.15.3:0/2125144637 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45fc004c80 con 0x5626d742fb90 2024-09-19T06:23:53.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.286+0000 7f45f5600640 1 -- 172.21.15.3:0/2125144637 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f45fc004ad0 con 0x5626d742fb90 2024-09-19T06:23:53.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.286+0000 7f46152c2740 10 client.18639 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:53.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.286+0000 7f46152c2740 1 -- 172.21.15.3:0/2125144637 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5626d7449710 con 0x5626d742fb90 2024-09-19T06:23:53.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.286+0000 7f45f5600640 1 -- 172.21.15.3:0/2125144637 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45fc004c80 con 0x5626d742fb90 2024-09-19T06:23:53.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.286+0000 7f45f5600640 1 -- 172.21.15.3:0/2125144637 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f45fc01a480 con 0x5626d742fb90 2024-09-19T06:23:53.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.287+0000 7f46152c2740 10 client.18639 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:53.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.287+0000 7f46152c2740 10 client.18639 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:53.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.287+0000 7f46152c2740 20 client.18639 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:53.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.287+0000 7f46152c2740 1 --2- 172.21.15.3:0/2125144637 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5626d744abd0 0x5626d744cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.287+0000 7f46152c2740 4 client.18639 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:23:53.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.287+0000 7f46152c2740 1 -- 172.21.15.3:0/2125144637 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626d73a3950 con 0x5626d744abd0 2024-09-19T06:23:53.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.287+0000 7f460aa00640 1 --2- 172.21.15.3:0/2125144637 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5626d744abd0 0x5626d744cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.288+0000 7f460aa00640 1 --2- 172.21.15.3:0/2125144637 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5626d744abd0 0x5626d744cfc0 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7e280bc8f5c75cc server_cookie=84ca892606bc6abd in_seq=0 out_seq=0 2024-09-19T06:23:53.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.288+0000 7f45f5600640 10 client.18639 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:53.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.288+0000 7f45f5600640 1 -- 172.21.15.3:0/2125144637 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5626d73a3950 con 0x5626d744abd0 2024-09-19T06:23:53.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.288+0000 7f45f5600640 10 client.18639 handle_command_reply: tid=0 2024-09-19T06:23:53.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.288+0000 7f46152c2740 1 client.18639 shutdown 2024-09-19T06:23:53.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.289+0000 7f46152c2740 1 -- 172.21.15.3:0/2125144637 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d742fb90 msgr2=0x5626d7437cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:53.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.289+0000 7f46152c2740 1 --2- 172.21.15.3:0/2125144637 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d742fb90 0x5626d7437cf0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f45fc00e610 tx=0x7f45fc00b700 comp rx=0 tx=0).stop 2024-09-19T06:23:53.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.289+0000 7f46152c2740 1 -- 172.21.15.3:0/2125144637 shutdown_connections 2024-09-19T06:23:53.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.289+0000 7f46152c2740 1 --2- 172.21.15.3:0/2125144637 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5626d744abd0 0x5626d744cfc0 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.289+0000 7f46152c2740 1 --2- 172.21.15.3:0/2125144637 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5626d743ad70 0x5626d7438770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.289+0000 7f46152c2740 1 --2- 172.21.15.3:0/2125144637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d74304b0 0x5626d7438230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.289+0000 7f46152c2740 1 --2- 172.21.15.3:0/2125144637 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d742fb90 0x5626d7437cf0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.289+0000 7f46152c2740 1 -- 172.21.15.3:0/2125144637 >> 172.21.15.3:0/2125144637 conn(0x5626d742c120 msgr2=0x5626d7431e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:53.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.289+0000 7f45f5600640 0 client.18639 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:53.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.289+0000 7f46152c2740 1 -- 172.21.15.3:0/2125144637 shutdown_connections 2024-09-19T06:23:53.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.289+0000 7f46152c2740 1 -- 172.21.15.3:0/2125144637 wait complete. 2024-09-19T06:23:53.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.289+0000 7f46152c2740 20 client.18639 trim_cache size 0 max 16384 2024-09-19T06:23:53.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.307+0000 7f46152c2740 1 Processor -- start 2024-09-19T06:23:53.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.307+0000 7f46152c2740 1 -- start start 2024-09-19T06:23:53.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.308+0000 7f46152c2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d742fb90 0x5626d7452560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.308+0000 7f46152c2740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d74304b0 0x5626d7452aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.308+0000 7f46152c2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5626d743ad70 0x5626d7434f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.308+0000 7f46152c2740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f460c1b3fa0 con 0x5626d74304b0 2024-09-19T06:23:53.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.308+0000 7f46152c2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f460c1b5ae0 con 0x5626d742fb90 2024-09-19T06:23:53.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.308+0000 7f46152c2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f460c1b4670 con 0x5626d743ad70 2024-09-19T06:23:53.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.308+0000 7f460b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d742fb90 0x5626d7452560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.308+0000 7f460aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d74304b0 0x5626d7452aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.308+0000 7f460b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d742fb90 0x5626d7452560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:44560/0 (socket says 172.21.15.3:44560) 2024-09-19T06:23:53.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.308+0000 7f460b400640 1 -- 172.21.15.3:0/3522348392 learned_addr learned my addr 172.21.15.3:0/3522348392 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:53.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.308+0000 7f460be00640 1 --2- 172.21.15.3:0/3522348392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5626d743ad70 0x5626d7434f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.309+0000 7f460b400640 1 -- 172.21.15.3:0/3522348392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5626d743ad70 msgr2=0x5626d7434f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:53.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.309+0000 7f460b400640 1 --2- 172.21.15.3:0/3522348392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5626d743ad70 0x5626d7434f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.309+0000 7f460b400640 1 -- 172.21.15.3:0/3522348392 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d74304b0 msgr2=0x5626d7452aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:53.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.309+0000 7f460b400640 1 --2- 172.21.15.3:0/3522348392 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d74304b0 0x5626d7452aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.309+0000 7f460b400640 1 -- 172.21.15.3:0/3522348392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626d742f910 con 0x5626d742fb90 2024-09-19T06:23:53.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.309+0000 7f460aa00640 1 --2- 172.21.15.3:0/3522348392 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d74304b0 0x5626d7452aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:53.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.309+0000 7f460b400640 1 --2- 172.21.15.3:0/3522348392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d742fb90 0x5626d7452560 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f45fc010580 tx=0x7f45fc01a610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f19dc01590e850b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:53.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.309+0000 7f45f7e00640 1 -- 172.21.15.3:0/3522348392 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc01aac0 con 0x5626d742fb90 2024-09-19T06:23:53.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.309+0000 7f45f7e00640 1 -- 172.21.15.3:0/3522348392 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45fc01ac60 con 0x5626d742fb90 2024-09-19T06:23:53.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.309+0000 7f45f7e00640 1 -- 172.21.15.3:0/3522348392 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45fc004f80 con 0x5626d742fb90 2024-09-19T06:23:53.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.310+0000 7f46152c2740 1 -- 172.21.15.3:0/3522348392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d742fb90 msgr2=0x5626d7452560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:53.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.310+0000 7f46152c2740 1 --2- 172.21.15.3:0/3522348392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d742fb90 0x5626d7452560 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f45fc010580 tx=0x7f45fc01a610 comp rx=0 tx=0).stop 2024-09-19T06:23:53.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.310+0000 7f46152c2740 1 -- 172.21.15.3:0/3522348392 shutdown_connections 2024-09-19T06:23:53.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.310+0000 7f46152c2740 1 --2- 172.21.15.3:0/3522348392 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5626d743ad70 0x5626d7434f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.310+0000 7f46152c2740 1 --2- 172.21.15.3:0/3522348392 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d74304b0 0x5626d7452aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.310+0000 7f46152c2740 1 --2- 172.21.15.3:0/3522348392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d742fb90 0x5626d7452560 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.310+0000 7f46152c2740 1 -- 172.21.15.3:0/3522348392 >> 172.21.15.3:0/3522348392 conn(0x5626d742c120 msgr2=0x5626d7436de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:53.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.310+0000 7f46152c2740 1 -- 172.21.15.3:0/3522348392 shutdown_connections 2024-09-19T06:23:53.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.310+0000 7f46152c2740 1 -- 172.21.15.3:0/3522348392 wait complete. 2024-09-19T06:23:53.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.311+0000 7f46152c2740 1 -- start start 2024-09-19T06:23:53.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.311+0000 7f46152c2740 1 Processor -- start 2024-09-19T06:23:53.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.311+0000 7f46152c2740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5626d742fb90 0x5626d743ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.311+0000 7f46152c2740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d74304b0 0x5626d743f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.311+0000 7f46152c2740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d743ad70 0x5626d743f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.311+0000 7f46152c2740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f460c1b5410 con 0x5626d74304b0 2024-09-19T06:23:53.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.311+0000 7f46152c2740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f460c1b4d40 con 0x5626d743ad70 2024-09-19T06:23:53.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.311+0000 7f46152c2740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f460c1b1fa0 con 0x5626d742fb90 2024-09-19T06:23:53.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.312+0000 7f46152c2740 10 client.0 _ll_register_callbacks cb 0x7f45fc004e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:23:53.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.312+0000 7f460aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d74304b0 0x5626d743f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.312+0000 7f460aa00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d74304b0 0x5626d743f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:39194/0 (socket says 172.21.15.3:39194) 2024-09-19T06:23:53.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.312+0000 7f460aa00640 1 -- 172.21.15.3:0/2381788202 learned_addr learned my addr 172.21.15.3:0/2381788202 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:53.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.312+0000 7f460be00640 1 --2- 172.21.15.3:0/2381788202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d743ad70 0x5626d743f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.312+0000 7f460b400640 1 --2- 172.21.15.3:0/2381788202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5626d742fb90 0x5626d743ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.312+0000 7f460aa00640 1 -- 172.21.15.3:0/2381788202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5626d742fb90 msgr2=0x5626d743ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:53.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.312+0000 7f460aa00640 1 --2- 172.21.15.3:0/2381788202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5626d742fb90 0x5626d743ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.312+0000 7f460aa00640 1 -- 172.21.15.3:0/2381788202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d743ad70 msgr2=0x5626d743f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:23:53.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.312+0000 7f460aa00640 1 --2- 172.21.15.3:0/2381788202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d743ad70 0x5626d743f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.312+0000 7f460aa00640 1 -- 172.21.15.3:0/2381788202 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626d74b45e0 con 0x5626d74304b0 2024-09-19T06:23:53.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.312+0000 7f460be00640 1 --2- 172.21.15.3:0/2381788202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d743ad70 0x5626d743f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:23:53.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.313+0000 7f460aa00640 1 --2- 172.21.15.3:0/2381788202 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d74304b0 0x5626d743f0f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f45f802a930 tx=0x7f45f80314e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a7ba1ca4b8b479 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:53.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.313+0000 7f45f5600640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:23:53.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.313+0000 7f45f5600640 1 -- 172.21.15.3:0/2381788202 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f8035040 con 0x5626d74304b0 2024-09-19T06:23:53.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.313+0000 7f45f5600640 1 -- 172.21.15.3:0/2381788202 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7f45f80035f0 con 0x5626d74304b0 2024-09-19T06:23:53.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.313+0000 7f46152c2740 1 -- 172.21.15.3:0/2381788202 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45fc01ac60 con 0x5626d74304b0 2024-09-19T06:23:53.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.313+0000 7f45f5600640 1 -- 172.21.15.3:0/2381788202 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f45f80037f0 con 0x5626d74304b0 2024-09-19T06:23:53.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.313+0000 7f46152c2740 10 client.18645 fetch_fsmap learned FSMap version 29 2024-09-19T06:23:53.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.313+0000 7f46152c2740 1 -- 172.21.15.3:0/2381788202 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5626d74b5960 con 0x5626d74304b0 2024-09-19T06:23:53.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.314+0000 7f45f5600640 1 -- 172.21.15.3:0/2381788202 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45fc01ac60 con 0x5626d74304b0 2024-09-19T06:23:53.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.314+0000 7f45f5600640 1 -- 172.21.15.3:0/2381788202 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f45f8062070 con 0x5626d74304b0 2024-09-19T06:23:53.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.314+0000 7f46152c2740 10 client.18645 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:23:53.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.314+0000 7f46152c2740 10 client.18645 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:23:53.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.314+0000 7f46152c2740 20 client.18645 populate_metadata read hostname 'smithi003' 2024-09-19T06:23:53.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.314+0000 7f46152c2740 1 --2- 172.21.15.3:0/2381788202 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5626d74b60c0 0x5626d74b84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:53.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.314+0000 7f46152c2740 4 client.18645 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:23:53.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.314+0000 7f46152c2740 1 -- 172.21.15.3:0/2381788202 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5626d739de60 con 0x5626d74b60c0 2024-09-19T06:23:53.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.314+0000 7f460b400640 1 --2- 172.21.15.3:0/2381788202 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5626d74b60c0 0x5626d74b84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:53.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.315+0000 7f460b400640 1 --2- 172.21.15.3:0/2381788202 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5626d74b60c0 0x5626d74b84e0 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75a800c37af603f1 server_cookie=8496fe5617cdda68 in_seq=0 out_seq=0 2024-09-19T06:23:53.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.315+0000 7f45f5600640 10 client.18645 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:53.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.315+0000 7f45f5600640 1 -- 172.21.15.3:0/2381788202 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5626d739de60 con 0x5626d74b60c0 2024-09-19T06:23:53.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.315+0000 7f45f5600640 10 client.18645 handle_command_reply: tid=0 2024-09-19T06:23:53.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.315+0000 7f46152c2740 1 client.18645 shutdown 2024-09-19T06:23:53.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.315+0000 7f46152c2740 1 -- 172.21.15.3:0/2381788202 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d74304b0 msgr2=0x5626d743f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:53.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.315+0000 7f46152c2740 1 --2- 172.21.15.3:0/2381788202 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d74304b0 0x5626d743f0f0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f45f802a930 tx=0x7f45f80314e0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.315+0000 7f46152c2740 1 -- 172.21.15.3:0/2381788202 shutdown_connections 2024-09-19T06:23:53.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.315+0000 7f46152c2740 1 --2- 172.21.15.3:0/2381788202 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5626d74b60c0 0x5626d74b84e0 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.315+0000 7f46152c2740 1 --2- 172.21.15.3:0/2381788202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5626d743ad70 0x5626d743f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.315+0000 7f46152c2740 1 --2- 172.21.15.3:0/2381788202 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5626d74304b0 0x5626d743f0f0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.315+0000 7f46152c2740 1 --2- 172.21.15.3:0/2381788202 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5626d742fb90 0x5626d743ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.315+0000 7f46152c2740 1 -- 172.21.15.3:0/2381788202 >> 172.21.15.3:0/2381788202 conn(0x5626d742c120 msgr2=0x5626d74315e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:53.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.316+0000 7f45f5600640 0 client.18645 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:23:53.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.316+0000 7f46152c2740 1 -- 172.21.15.3:0/2381788202 shutdown_connections 2024-09-19T06:23:53.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.316+0000 7f46152c2740 1 -- 172.21.15.3:0/2381788202 wait complete. 2024-09-19T06:23:53.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.316+0000 7f46152c2740 20 client.18645 trim_cache size 0 max 16384 2024-09-19T06:23:53.321 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:23:53.321 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T06:23:53.321 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": { 2024-09-19T06:23:53.321 INFO:teuthology.orchestra.run.smithi003.stdout: "c1680cfc-7b80-44e7-acca-3823bc4c8b24": { 2024-09-19T06:23:53.322 INFO:teuthology.orchestra.run.smithi003.stdout: "path": "/", 2024-09-19T06:23:53.322 INFO:teuthology.orchestra.run.smithi003.stdout: "tag": "c1680cfc-7b80-44e7-acca-3823bc4c8b24", 2024-09-19T06:23:53.322 INFO:teuthology.orchestra.run.smithi003.stdout: "options": "recursive,force" 2024-09-19T06:23:53.322 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:23:53.322 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:23:53.322 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:23:53.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.316+0000 7f4612800640 1 -- 172.21.15.3:0/4219138320 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f45f00a3430 msgr2=0x7f45f00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:53.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.316+0000 7f4612800640 1 --2- 172.21.15.3:0/4219138320 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f45f00a3430 0x7f45f00a58f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f45f8009230 tx=0x7f45f80058d0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.316+0000 7f4612800640 1 -- 172.21.15.3:0/4219138320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f460c112a30 msgr2=0x7f460c19e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:53.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.316+0000 7f4612800640 1 --2- 172.21.15.3:0/4219138320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f460c112a30 0x7f460c19e9b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f460c07aa10 tx=0x7f460400dea0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.317+0000 7f4612800640 1 -- 172.21.15.3:0/4219138320 shutdown_connections 2024-09-19T06:23:53.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.317+0000 7f4612800640 1 --2- 172.21.15.3:0/4219138320 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f45f00a3430 0x7f45f00a58f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.317+0000 7f4612800640 1 --2- 172.21.15.3:0/4219138320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f460c112a30 0x7f460c19e9b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.317+0000 7f4612800640 1 --2- 172.21.15.3:0/4219138320 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f460c077040 0x7f460c1a4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.317+0000 7f4612800640 1 --2- 172.21.15.3:0/4219138320 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f460c076720 0x7f460c1a47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:53.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.317+0000 7f4612800640 1 -- 172.21.15.3:0/4219138320 >> 172.21.15.3:0/4219138320 conn(0x7f460c0ffa90 msgr2=0x7f460c101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:53.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.317+0000 7f4612800640 1 -- 172.21.15.3:0/4219138320 shutdown_connections 2024-09-19T06:23:53.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:53.317+0000 7f4612800640 1 -- 172.21.15.3:0/4219138320 wait complete. 2024-09-19T06:23:53.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:53 smithi059 ceph-mon[35138]: scrub queued for path: / 2024-09-19T06:23:53.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:53 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:53.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:53 smithi059 ceph-mon[35138]: scrub summary: active paths [/] 2024-09-19T06:23:53.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:53 smithi059 ceph-mon[35138]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:53.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:53 smithi003 ceph-mon[30893]: scrub queued for path: / 2024-09-19T06:23:53.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:53 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:53.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:53 smithi003 ceph-mon[30893]: scrub summary: active paths [/] 2024-09-19T06:23:53.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:53 smithi003 ceph-mon[30893]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:53.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:53 smithi071 ceph-mon[35662]: scrub queued for path: / 2024-09-19T06:23:53.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:53 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:53.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:53 smithi071 ceph-mon[35662]: scrub summary: active paths [/] 2024-09-19T06:23:53.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:53 smithi071 ceph-mon[35662]: scrub summary: idle+waiting paths [/] 2024-09-19T06:23:53.690 DEBUG:teuthology.parallel:result is None 2024-09-19T06:23:53.690 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T06:23:53.762 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T06:23:53.762 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-19T06:23:53.773 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi003.front.sepia.ceph.com 2024-09-19T06:23:53.784 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-19T06:23:53.793 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-19T06:23:53.793 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T06:23:53.793 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi003.front.sepia.ceph.com 2024-09-19T06:23:53.794 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-19T06:23:53.887 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-19T06:23:53.948 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T06:23:54.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.102+0000 7f0f28e00640 1 -- 172.21.15.3:0/3256949457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f2410e1e0 msgr2=0x7f0f241105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:54.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.102+0000 7f0f28e00640 1 --2- 172.21.15.3:0/3256949457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f2410e1e0 0x7f0f241105d0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c009ca0 tx=0x7f0f1c02a950 comp rx=0 tx=0).stop 2024-09-19T06:23:54.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.102+0000 7f0f28e00640 1 -- 172.21.15.3:0/3256949457 shutdown_connections 2024-09-19T06:23:54.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.102+0000 7f0f28e00640 1 --2- 172.21.15.3:0/3256949457 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f2410e1e0 0x7f0f241105d0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:54.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.102+0000 7f0f28e00640 1 --2- 172.21.15.3:0/3256949457 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f24074ec0 0x7f0f2410dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:54.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.102+0000 7f0f28e00640 1 --2- 172.21.15.3:0/3256949457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f240745a0 0x7f0f24074980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:54.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.102+0000 7f0f28e00640 1 -- 172.21.15.3:0/3256949457 >> 172.21.15.3:0/3256949457 conn(0x7f0f240fd600 msgr2=0x7f0f240ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:54.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.102+0000 7f0f28e00640 1 -- 172.21.15.3:0/3256949457 shutdown_connections 2024-09-19T06:23:54.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.102+0000 7f0f28e00640 1 -- 172.21.15.3:0/3256949457 wait complete. 2024-09-19T06:23:54.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.103+0000 7f0f28e00640 1 Processor -- start 2024-09-19T06:23:54.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.103+0000 7f0f28e00640 1 -- start start 2024-09-19T06:23:54.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.104+0000 7f0f28e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f240745a0 0x7f0f2419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:54.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.104+0000 7f0f28e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f24074ec0 0x7f0f2419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:54.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.104+0000 7f0f28e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f2410e1e0 0x7f0f2419ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:54.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.104+0000 7f0f28e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0f24113ef0 con 0x7f0f240745a0 2024-09-19T06:23:54.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.104+0000 7f0f28e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0f24113d70 con 0x7f0f24074ec0 2024-09-19T06:23:54.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.104+0000 7f0f28e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0f24114070 con 0x7f0f2410e1e0 2024-09-19T06:23:54.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.104+0000 7f0f23400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f240745a0 0x7f0f2419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:54.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.104+0000 7f0f22a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f24074ec0 0x7f0f2419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:54.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.104+0000 7f0f23e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f2410e1e0 0x7f0f2419ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:54.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.104+0000 7f0f22a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f24074ec0 0x7f0f2419a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:54984/0 (socket says 172.21.15.3:54984) 2024-09-19T06:23:54.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.104+0000 7f0f23400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f240745a0 0x7f0f2419a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57830/0 (socket says 172.21.15.3:57830) 2024-09-19T06:23:54.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.104+0000 7f0f23400640 1 -- 172.21.15.3:0/1208190529 learned_addr learned my addr 172.21.15.3:0/1208190529 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:54.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.104+0000 7f0f23e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f2410e1e0 0x7f0f2419ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:39070/0 (socket says 172.21.15.3:39070) 2024-09-19T06:23:54.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.104+0000 7f0f23e00640 1 -- 172.21.15.3:0/1208190529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f24074ec0 msgr2=0x7f0f2419a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:54.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.104+0000 7f0f23e00640 1 --2- 172.21.15.3:0/1208190529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f24074ec0 0x7f0f2419a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:54.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.104+0000 7f0f23e00640 1 -- 172.21.15.3:0/1208190529 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f240745a0 msgr2=0x7f0f2419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:54.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.104+0000 7f0f23e00640 1 --2- 172.21.15.3:0/1208190529 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f240745a0 0x7f0f2419a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:54.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.104+0000 7f0f23e00640 1 -- 172.21.15.3:0/1208190529 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f2419f470 con 0x7f0f2410e1e0 2024-09-19T06:23:54.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.105+0000 7f0f23e00640 1 --2- 172.21.15.3:0/1208190529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f2410e1e0 0x7f0f2419ed40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c005cc0 tx=0x7f0f1c02f3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:54.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.109+0000 7f0f1be00640 1 -- 172.21.15.3:0/1208190529 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c034040 con 0x7f0f2410e1e0 2024-09-19T06:23:54.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.109+0000 7f0f1be00640 1 -- 172.21.15.3:0/1208190529 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f1c030920 con 0x7f0f2410e1e0 2024-09-19T06:23:54.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.109+0000 7f0f1be00640 1 -- 172.21.15.3:0/1208190529 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c0045b0 con 0x7f0f2410e1e0 2024-09-19T06:23:54.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.109+0000 7f0f28e00640 1 -- 172.21.15.3:0/1208190529 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f2419f700 con 0x7f0f2410e1e0 2024-09-19T06:23:54.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.109+0000 7f0f28e00640 1 -- 172.21.15.3:0/1208190529 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f241a6ff0 con 0x7f0f2410e1e0 2024-09-19T06:23:54.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.110+0000 7f0f28e00640 1 -- 172.21.15.3:0/1208190529 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f24074980 con 0x7f0f2410e1e0 2024-09-19T06:23:54.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.112+0000 7f0f1be00640 1 -- 172.21.15.3:0/1208190529 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f0f1c037020 con 0x7f0f2410e1e0 2024-09-19T06:23:54.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.113+0000 7f0f1be00640 1 --2- 172.21.15.3:0/1208190529 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0f080a3420 0x7f0f080a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:54.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.114+0000 7f0f1be00640 1 -- 172.21.15.3:0/1208190529 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7f0f1c0f0af0 con 0x7f0f2410e1e0 2024-09-19T06:23:54.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.114+0000 7f0f23400640 1 --2- 172.21.15.3:0/1208190529 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0f080a3420 0x7f0f080a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:54.116 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.114+0000 7f0f23400640 1 --2- 172.21.15.3:0/1208190529 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0f080a3420 0x7f0f080a58e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0f14009d10 tx=0x7f0f14005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:54.118 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.116+0000 7f0f1be00640 1 -- 172.21.15.3:0/1208190529 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0f1c0bd550 con 0x7f0f2410e1e0 2024-09-19T06:23:54.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.322+0000 7f0f28e00640 1 -- 172.21.15.3:0/1208190529 --> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f0f241093c0 con 0x7f0f080a3420 2024-09-19T06:23:54.331 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:54 smithi003 ceph-mon[30893]: pgmap v358: 97 pgs: 97 active+clean; 3.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-09-19T06:23:54.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.332+0000 7f0f1be00640 1 -- 172.21.15.3:0/1208190529 <== mgr.15126 v2:172.21.15.3:6800/3015970538 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f0f241093c0 con 0x7f0f080a3420 2024-09-19T06:23:54.334 INFO:teuthology.orchestra.run.smithi003.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T06:12:34", "first": "2024-09-19T06:13:00", "last": "2024-09-19T06:23:00", "last_pruned": "2024-09-19T06:23:00", "created_count": 11, "pruned_count": 5, "active": true} 2024-09-19T06:23:54.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.334+0000 7f0f28e00640 1 -- 172.21.15.3:0/1208190529 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0f080a3420 msgr2=0x7f0f080a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:54.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.334+0000 7f0f28e00640 1 --2- 172.21.15.3:0/1208190529 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0f080a3420 0x7f0f080a58e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0f14009d10 tx=0x7f0f14005f90 comp rx=0 tx=0).stop 2024-09-19T06:23:54.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.334+0000 7f0f28e00640 1 -- 172.21.15.3:0/1208190529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f2410e1e0 msgr2=0x7f0f2419ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:54.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.334+0000 7f0f28e00640 1 --2- 172.21.15.3:0/1208190529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f2410e1e0 0x7f0f2419ed40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c005cc0 tx=0x7f0f1c02f3a0 comp rx=0 tx=0).stop 2024-09-19T06:23:54.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.334+0000 7f0f28e00640 1 -- 172.21.15.3:0/1208190529 shutdown_connections 2024-09-19T06:23:54.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.334+0000 7f0f28e00640 1 --2- 172.21.15.3:0/1208190529 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0f080a3420 0x7f0f080a58e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:54.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.334+0000 7f0f28e00640 1 --2- 172.21.15.3:0/1208190529 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0f2410e1e0 0x7f0f2419ed40 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:54.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.334+0000 7f0f28e00640 1 --2- 172.21.15.3:0/1208190529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f24074ec0 0x7f0f2419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:54.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.334+0000 7f0f28e00640 1 --2- 172.21.15.3:0/1208190529 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0f240745a0 0x7f0f2419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:54.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.334+0000 7f0f28e00640 1 -- 172.21.15.3:0/1208190529 >> 172.21.15.3:0/1208190529 conn(0x7f0f240fd600 msgr2=0x7f0f240fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:54.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.334+0000 7f0f28e00640 1 -- 172.21.15.3:0/1208190529 shutdown_connections 2024-09-19T06:23:54.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.334+0000 7f0f28e00640 1 -- 172.21.15.3:0/1208190529 wait complete. 2024-09-19T06:23:54.354 DEBUG:teuthology.orchestra.run.smithi003:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T06:23:54.372 INFO:tasks.cephfs.filesystem:scrub status for tag:c1680cfc-7b80-44e7-acca-3823bc4c8b24 - {'path': '/', 'tag': 'c1680cfc-7b80-44e7-acca-3823bc4c8b24', 'options': 'recursive,force'} 2024-09-19T06:23:54.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.511+0000 7f8522800640 1 -- 172.21.15.3:0/3286992415 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f851c109080 msgr2=0x7f851c110bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:54.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.511+0000 7f8522800640 1 --2- 172.21.15.3:0/3286992415 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f851c109080 0x7f851c110bd0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f8514009ca0 tx=0x7f851402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:23:54.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.511+0000 7f8522800640 1 -- 172.21.15.3:0/3286992415 shutdown_connections 2024-09-19T06:23:54.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.511+0000 7f8522800640 1 --2- 172.21.15.3:0/3286992415 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f851c109080 0x7f851c110bd0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:54.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.511+0000 7f8522800640 1 --2- 172.21.15.3:0/3286992415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f851c1048e0 0x7f851c108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:54.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.511+0000 7f8522800640 1 --2- 172.21.15.3:0/3286992415 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f851c103f30 0x7f851c104310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:54.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.511+0000 7f8522800640 1 -- 172.21.15.3:0/3286992415 >> 172.21.15.3:0/3286992415 conn(0x7f851c0ff980 msgr2=0x7f851c101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:54.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.511+0000 7f8522800640 1 -- 172.21.15.3:0/3286992415 shutdown_connections 2024-09-19T06:23:54.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.511+0000 7f8522800640 1 -- 172.21.15.3:0/3286992415 wait complete. 2024-09-19T06:23:54.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.512+0000 7f8522800640 1 Processor -- start 2024-09-19T06:23:54.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.512+0000 7f8522800640 1 -- start start 2024-09-19T06:23:54.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.513+0000 7f8522800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f851c103f30 0x7f851c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:54.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.513+0000 7f8522800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f851c109080 0x7f851c19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:54.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.513+0000 7f8522800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f851c19eef0 0x7f851c19f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:54.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.513+0000 7f8522800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f851c114120 con 0x7f851c103f30 2024-09-19T06:23:54.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.513+0000 7f8522800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f851c113fa0 con 0x7f851c109080 2024-09-19T06:23:54.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.513+0000 7f8522800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f851c1142a0 con 0x7f851c19eef0 2024-09-19T06:23:54.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.513+0000 7f851b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f851c103f30 0x7f851c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:54.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.513+0000 7f851b400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f851c103f30 0x7f851c19a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57844/0 (socket says 172.21.15.3:57844) 2024-09-19T06:23:54.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.513+0000 7f851b400640 1 -- 172.21.15.3:0/3220083259 learned_addr learned my addr 172.21.15.3:0/3220083259 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:23:54.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.513+0000 7f8513e00640 1 --2- 172.21.15.3:0/3220083259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f851c109080 0x7f851c19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:54.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.513+0000 7f851be00640 1 --2- 172.21.15.3:0/3220083259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f851c19eef0 0x7f851c19f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:54.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.513+0000 7f851b400640 1 -- 172.21.15.3:0/3220083259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f851c19eef0 msgr2=0x7f851c19f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:54.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.513+0000 7f851b400640 1 --2- 172.21.15.3:0/3220083259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f851c19eef0 0x7f851c19f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:54.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.513+0000 7f851b400640 1 -- 172.21.15.3:0/3220083259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f851c109080 msgr2=0x7f851c19ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:54.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.513+0000 7f851b400640 1 --2- 172.21.15.3:0/3220083259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f851c109080 0x7f851c19ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:54.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.513+0000 7f851b400640 1 -- 172.21.15.3:0/3220083259 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f851c19f9e0 con 0x7f851c103f30 2024-09-19T06:23:54.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.513+0000 7f851be00640 1 --2- 172.21.15.3:0/3220083259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f851c19eef0 0x7f851c19f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:23:54.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.514+0000 7f851b400640 1 --2- 172.21.15.3:0/3220083259 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f851c103f30 0x7f851c19a630 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f850c00d770 tx=0x7f850c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:54.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.514+0000 7f8518c00640 1 -- 172.21.15.3:0/3220083259 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c017070 con 0x7f851c103f30 2024-09-19T06:23:54.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.514+0000 7f8518c00640 1 -- 172.21.15.3:0/3220083259 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f850c005500 con 0x7f851c103f30 2024-09-19T06:23:54.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.514+0000 7f8518c00640 1 -- 172.21.15.3:0/3220083259 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850c004e00 con 0x7f851c103f30 2024-09-19T06:23:54.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.514+0000 7f8522800640 1 -- 172.21.15.3:0/3220083259 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f851c19fcd0 con 0x7f851c103f30 2024-09-19T06:23:54.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.514+0000 7f8522800640 1 -- 172.21.15.3:0/3220083259 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f851c1a7470 con 0x7f851c103f30 2024-09-19T06:23:54.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.515+0000 7f8522800640 1 -- 172.21.15.3:0/3220083259 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f851c104310 con 0x7f851c103f30 2024-09-19T06:23:54.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.517+0000 7f8518c00640 1 -- 172.21.15.3:0/3220083259 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f850c004fa0 con 0x7f851c103f30 2024-09-19T06:23:54.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.518+0000 7f8518c00640 1 --2- 172.21.15.3:0/3220083259 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f85000a33b0 0x7f85000a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:23:54.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.519+0000 7f8518c00640 1 -- 172.21.15.3:0/3220083259 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8571+0+0 (secure 0 0 0) 0x7f850c0cf830 con 0x7f851c103f30 2024-09-19T06:23:54.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.519+0000 7f8513e00640 1 --2- 172.21.15.3:0/3220083259 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f85000a33b0 0x7f85000a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:23:54.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.519+0000 7f8513e00640 1 --2- 172.21.15.3:0/3220083259 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f85000a33b0 0x7f85000a5870 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f851c101840 tx=0x7f850400b410 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:23:54.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.523+0000 7f8518c00640 1 -- 172.21.15.3:0/3220083259 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f850c09c180 con 0x7f851c103f30 2024-09-19T06:23:54.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:54 smithi059 ceph-mon[35138]: pgmap v358: 97 pgs: 97 active+clean; 3.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-09-19T06:23:54.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:54 smithi071 ceph-mon[35662]: pgmap v358: 97 pgs: 97 active+clean; 3.2 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 KiB/s wr, 13 op/s 2024-09-19T06:23:54.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.737+0000 7f8522800640 1 -- 172.21.15.3:0/3220083259 --> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f851c104950 con 0x7f85000a33b0 2024-09-19T06:23:54.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.746+0000 7f8518c00640 1 -- 172.21.15.3:0/3220083259 <== mgr.15126 v2:172.21.15.3:6800/3015970538 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f851c104950 con 0x7f85000a33b0 2024-09-19T06:23:54.748 INFO:teuthology.orchestra.run.smithi003.stdout:/ 1m 6m3h 2024-09-19T06:23:54.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.748+0000 7f8522800640 1 -- 172.21.15.3:0/3220083259 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f85000a33b0 msgr2=0x7f85000a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:54.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.748+0000 7f8522800640 1 --2- 172.21.15.3:0/3220083259 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f85000a33b0 0x7f85000a5870 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f851c101840 tx=0x7f850400b410 comp rx=0 tx=0).stop 2024-09-19T06:23:54.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.748+0000 7f8522800640 1 -- 172.21.15.3:0/3220083259 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f851c103f30 msgr2=0x7f851c19a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:23:54.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.748+0000 7f8522800640 1 --2- 172.21.15.3:0/3220083259 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f851c103f30 0x7f851c19a630 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f850c00d770 tx=0x7f850c00dc30 comp rx=0 tx=0).stop 2024-09-19T06:23:54.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.748+0000 7f8522800640 1 -- 172.21.15.3:0/3220083259 shutdown_connections 2024-09-19T06:23:54.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.748+0000 7f8522800640 1 --2- 172.21.15.3:0/3220083259 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f85000a33b0 0x7f85000a5870 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:54.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.748+0000 7f8522800640 1 --2- 172.21.15.3:0/3220083259 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f851c19eef0 0x7f851c19f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:54.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.748+0000 7f8522800640 1 --2- 172.21.15.3:0/3220083259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f851c109080 0x7f851c19ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:54.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.748+0000 7f8522800640 1 --2- 172.21.15.3:0/3220083259 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f851c103f30 0x7f851c19a630 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:23:54.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.748+0000 7f8522800640 1 -- 172.21.15.3:0/3220083259 >> 172.21.15.3:0/3220083259 conn(0x7f851c0ff980 msgr2=0x7f851c101d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:23:54.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.748+0000 7f8522800640 1 -- 172.21.15.3:0/3220083259 shutdown_connections 2024-09-19T06:23:54.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:23:54.748+0000 7f8522800640 1 -- 172.21.15.3:0/3220083259 wait complete. 2024-09-19T06:23:54.766 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-19T06:23:54.776 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-19T06:23:55.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:55 smithi059 ceph-mon[35138]: from='client.28657 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:23:55.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:55 smithi059 ceph-mon[35138]: scrub summary: idle 2024-09-19T06:23:55.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:55 smithi003 ceph-mon[30893]: from='client.28657 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:23:55.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:55 smithi003 ceph-mon[30893]: scrub summary: idle 2024-09-19T06:23:55.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:55 smithi071 ceph-mon[35662]: from='client.28657 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:23:55.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:55 smithi071 ceph-mon[35662]: scrub summary: idle 2024-09-19T06:23:56.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:56 smithi059 ceph-mon[35138]: pgmap v359: 97 pgs: 97 active+clean; 3.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-19T06:23:56.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:56 smithi059 ceph-mon[35138]: from='client.18657 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:23:56.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:56 smithi003 ceph-mon[30893]: pgmap v359: 97 pgs: 97 active+clean; 3.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-19T06:23:56.585 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:56 smithi003 ceph-mon[30893]: from='client.18657 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:23:56.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:56 smithi071 ceph-mon[35662]: pgmap v359: 97 pgs: 97 active+clean; 3.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 57 KiB/s wr, 23 op/s 2024-09-19T06:23:56.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:56 smithi071 ceph-mon[35662]: from='client.18657 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:23:58.387 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:23:58 smithi003 ceph-mon[30893]: pgmap v360: 97 pgs: 97 active+clean; 3.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-19T06:23:58.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:23:58 smithi059 ceph-mon[35138]: pgmap v360: 97 pgs: 97 active+clean; 3.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-19T06:23:58.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:23:58 smithi071 ceph-mon[35662]: pgmap v360: 97 pgs: 97 active+clean; 3.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 39 KiB/s wr, 16 op/s 2024-09-19T06:24:00.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:00 smithi003 ceph-mon[30893]: pgmap v361: 97 pgs: 97 active+clean; 3.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 43 KiB/s wr, 24 op/s 2024-09-19T06:24:00.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:00 smithi059 ceph-mon[35138]: pgmap v361: 97 pgs: 97 active+clean; 3.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 43 KiB/s wr, 24 op/s 2024-09-19T06:24:00.589 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:00 smithi071 ceph-mon[35662]: pgmap v361: 97 pgs: 97 active+clean; 3.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 43 KiB/s wr, 24 op/s 2024-09-19T06:24:02.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:02 smithi059 ceph-mon[35138]: pgmap v362: 97 pgs: 97 active+clean; 3.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 24 KiB/s wr, 18 op/s 2024-09-19T06:24:02.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:02 smithi003 ceph-mon[30893]: pgmap v362: 97 pgs: 97 active+clean; 3.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 24 KiB/s wr, 18 op/s 2024-09-19T06:24:02.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:02 smithi071 ceph-mon[35662]: pgmap v362: 97 pgs: 97 active+clean; 3.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 24 KiB/s wr, 18 op/s 2024-09-19T06:24:04.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:04 smithi059 ceph-mon[35138]: pgmap v363: 97 pgs: 97 active+clean; 3.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 24 KiB/s wr, 18 op/s 2024-09-19T06:24:04.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:04 smithi003 ceph-mon[30893]: pgmap v363: 97 pgs: 97 active+clean; 3.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 24 KiB/s wr, 18 op/s 2024-09-19T06:24:04.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:04 smithi071 ceph-mon[35662]: pgmap v363: 97 pgs: 97 active+clean; 3.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 24 KiB/s wr, 18 op/s 2024-09-19T06:24:06.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:06 smithi059 ceph-mon[35138]: pgmap v364: 97 pgs: 97 active+clean; 3.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 72 KiB/s wr, 39 op/s 2024-09-19T06:24:06.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:06 smithi003 ceph-mon[30893]: pgmap v364: 97 pgs: 97 active+clean; 3.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 72 KiB/s wr, 39 op/s 2024-09-19T06:24:06.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:06 smithi071 ceph-mon[35662]: pgmap v364: 97 pgs: 97 active+clean; 3.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 72 KiB/s wr, 39 op/s 2024-09-19T06:24:08.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:08 smithi059 ceph-mon[35138]: pgmap v365: 97 pgs: 97 active+clean; 3.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 51 KiB/s wr, 29 op/s 2024-09-19T06:24:08.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:08 smithi003 ceph-mon[30893]: pgmap v365: 97 pgs: 97 active+clean; 3.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 51 KiB/s wr, 29 op/s 2024-09-19T06:24:08.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:08 smithi071 ceph-mon[35662]: pgmap v365: 97 pgs: 97 active+clean; 3.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 51 KiB/s wr, 29 op/s 2024-09-19T06:24:10.403 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:10 smithi003 ceph-mon[30893]: pgmap v366: 97 pgs: 97 active+clean; 3.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 51 KiB/s wr, 34 op/s 2024-09-19T06:24:10.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:10 smithi059 ceph-mon[35138]: pgmap v366: 97 pgs: 97 active+clean; 3.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 51 KiB/s wr, 34 op/s 2024-09-19T06:24:10.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:10 smithi071 ceph-mon[35662]: pgmap v366: 97 pgs: 97 active+clean; 3.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 51 KiB/s wr, 34 op/s 2024-09-19T06:24:11.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:11 smithi003 ceph-mon[30893]: osdmap e100: 12 total, 12 up, 12 in 2024-09-19T06:24:11.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:11 smithi059 ceph-mon[35138]: osdmap e100: 12 total, 12 up, 12 in 2024-09-19T06:24:11.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:11 smithi071 ceph-mon[35662]: osdmap e100: 12 total, 12 up, 12 in 2024-09-19T06:24:12.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:12 smithi059 ceph-mon[35138]: pgmap v368: 97 pgs: 97 active+clean; 3.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 57 KiB/s wr, 31 op/s 2024-09-19T06:24:12.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:12 smithi003 ceph-mon[30893]: pgmap v368: 97 pgs: 97 active+clean; 3.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 57 KiB/s wr, 31 op/s 2024-09-19T06:24:12.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:12 smithi071 ceph-mon[35662]: pgmap v368: 97 pgs: 97 active+clean; 3.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 57 KiB/s wr, 31 op/s 2024-09-19T06:24:14.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:14 smithi059 ceph-mon[35138]: pgmap v369: 97 pgs: 97 active+clean; 3.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 57 KiB/s wr, 31 op/s 2024-09-19T06:24:14.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:14 smithi003 ceph-mon[30893]: pgmap v369: 97 pgs: 97 active+clean; 3.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 57 KiB/s wr, 31 op/s 2024-09-19T06:24:14.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:14 smithi071 ceph-mon[35662]: pgmap v369: 97 pgs: 97 active+clean; 3.5 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 57 KiB/s wr, 31 op/s 2024-09-19T06:24:16.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:16 smithi059 ceph-mon[35138]: pgmap v370: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-19T06:24:16.584 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:16 smithi003 ceph-mon[30893]: pgmap v370: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-19T06:24:16.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:16 smithi071 ceph-mon[35662]: pgmap v370: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-19T06:24:18.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:17 smithi059 ceph-mon[35138]: pgmap v371: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-19T06:24:18.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:17 smithi059 ceph-mon[35138]: osdmap e101: 12 total, 12 up, 12 in 2024-09-19T06:24:18.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:17 smithi003 ceph-mon[30893]: pgmap v371: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-19T06:24:18.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:17 smithi003 ceph-mon[30893]: osdmap e101: 12 total, 12 up, 12 in 2024-09-19T06:24:18.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:17 smithi071 ceph-mon[35662]: pgmap v371: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-19T06:24:18.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:17 smithi071 ceph-mon[35662]: osdmap e101: 12 total, 12 up, 12 in 2024-09-19T06:24:20.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:19 smithi059 ceph-mon[35138]: pgmap v373: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-09-19T06:24:20.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:19 smithi003 ceph-mon[30893]: pgmap v373: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-09-19T06:24:20.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:19 smithi071 ceph-mon[35662]: pgmap v373: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-09-19T06:24:22.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:21 smithi059 ceph-mon[35138]: pgmap v374: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-19T06:24:22.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:21 smithi003 ceph-mon[30893]: pgmap v374: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-19T06:24:22.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:21 smithi071 ceph-mon[35662]: pgmap v374: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-19T06:24:24.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:23 smithi059 ceph-mon[35138]: pgmap v375: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-19T06:24:24.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:23 smithi003 ceph-mon[30893]: pgmap v375: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-19T06:24:24.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:23 smithi071 ceph-mon[35662]: pgmap v375: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-09-19T06:24:24.373 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T06:24:24.768 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:25.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.400+0000 7f0b2d800640 1 -- 172.21.15.3:0/2668079453 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0b28109120 msgr2=0x7f0b28110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:25.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.400+0000 7f0b2d800640 1 --2- 172.21.15.3:0/2668079453 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0b28109120 0x7f0b28110ca0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f0b20009ca0 tx=0x7f0b2002a8c0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.400+0000 7f0b2d800640 1 -- 172.21.15.3:0/2668079453 shutdown_connections 2024-09-19T06:24:25.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.400+0000 7f0b2d800640 1 --2- 172.21.15.3:0/2668079453 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0b28109120 0x7f0b28110ca0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.400+0000 7f0b2d800640 1 --2- 172.21.15.3:0/2668079453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b281049a0 0x7f0b281089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.400+0000 7f0b2d800640 1 --2- 172.21.15.3:0/2668079453 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b28103ff0 0x7f0b281043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.400+0000 7f0b2d800640 1 -- 172.21.15.3:0/2668079453 >> 172.21.15.3:0/2668079453 conn(0x7f0b280ffa90 msgr2=0x7f0b28101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:25.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.400+0000 7f0b2d800640 1 -- 172.21.15.3:0/2668079453 shutdown_connections 2024-09-19T06:24:25.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.400+0000 7f0b2d800640 1 -- 172.21.15.3:0/2668079453 wait complete. 2024-09-19T06:24:25.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.401+0000 7f0b2d800640 1 Processor -- start 2024-09-19T06:24:25.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.401+0000 7f0b2d800640 1 -- start start 2024-09-19T06:24:25.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.402+0000 7f0b2d800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0b28103ff0 0x7f0b2819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:25.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.402+0000 7f0b2d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b281049a0 0x7f0b2819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:25.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.402+0000 7f0b2d800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b28109120 0x7f0b2819ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:25.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.402+0000 7f0b2d800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0b28114130 con 0x7f0b28103ff0 2024-09-19T06:24:25.405 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.402+0000 7f0b2d800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0b28113fb0 con 0x7f0b281049a0 2024-09-19T06:24:25.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.402+0000 7f0b2d800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0b281142b0 con 0x7f0b28109120 2024-09-19T06:24:25.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.402+0000 7f0b26a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0b28103ff0 0x7f0b2819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:25.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.402+0000 7f0b26a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0b28103ff0 0x7f0b2819a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44974/0 (socket says 172.21.15.3:44974) 2024-09-19T06:24:25.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.402+0000 7f0b26a00640 1 -- 172.21.15.3:0/986118156 learned_addr learned my addr 172.21.15.3:0/986118156 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:25.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.402+0000 7f0b1e000640 1 --2- 172.21.15.3:0/986118156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b281049a0 0x7f0b2819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:25.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.402+0000 7f0b27400640 1 --2- 172.21.15.3:0/986118156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b28109120 0x7f0b2819ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:25.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.403+0000 7f0b26a00640 1 -- 172.21.15.3:0/986118156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b28109120 msgr2=0x7f0b2819ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:25.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.403+0000 7f0b26a00640 1 --2- 172.21.15.3:0/986118156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b28109120 0x7f0b2819ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.403+0000 7f0b26a00640 1 -- 172.21.15.3:0/986118156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b281049a0 msgr2=0x7f0b2819aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:25.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.403+0000 7f0b26a00640 1 --2- 172.21.15.3:0/986118156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b281049a0 0x7f0b2819aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.403+0000 7f0b26a00640 1 -- 172.21.15.3:0/986118156 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b2819f540 con 0x7f0b28103ff0 2024-09-19T06:24:25.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.403+0000 7f0b1e000640 1 --2- 172.21.15.3:0/986118156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b281049a0 0x7f0b2819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:25.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.403+0000 7f0b26a00640 1 --2- 172.21.15.3:0/986118156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0b28103ff0 0x7f0b2819a590 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f0b1800e9f0 tx=0x7f0b1800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:25.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.403+0000 7f0b1fe00640 1 -- 172.21.15.3:0/986118156 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1800cd80 con 0x7f0b28103ff0 2024-09-19T06:24:25.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.403+0000 7f0b1fe00640 1 -- 172.21.15.3:0/986118156 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b18010910 con 0x7f0b28103ff0 2024-09-19T06:24:25.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.403+0000 7f0b1fe00640 1 -- 172.21.15.3:0/986118156 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b18018990 con 0x7f0b28103ff0 2024-09-19T06:24:25.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.403+0000 7f0b2d800640 1 -- 172.21.15.3:0/986118156 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b2819f830 con 0x7f0b28103ff0 2024-09-19T06:24:25.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.403+0000 7f0b2d800640 1 -- 172.21.15.3:0/986118156 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b281a7110 con 0x7f0b28103ff0 2024-09-19T06:24:25.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.407+0000 7f0b1fe00640 1 -- 172.21.15.3:0/986118156 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f0b18010ac0 con 0x7f0b28103ff0 2024-09-19T06:24:25.408 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.407+0000 7f0b30458740 1 Processor -- start 2024-09-19T06:24:25.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.407+0000 7f0b30458740 1 -- start start 2024-09-19T06:24:25.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.407+0000 7f0b30458740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ffae017b90 0x55ffae017f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:25.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.407+0000 7f0b30458740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ffae0184b0 0x55ffae022830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:25.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.407+0000 7f0b30458740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffae022d70 0x55ffae025160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:25.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.407+0000 7f0b30458740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ffadf7e3e0 con 0x55ffae017b90 2024-09-19T06:24:25.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.407+0000 7f0b30458740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ffadf25d80 con 0x55ffae022d70 2024-09-19T06:24:25.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.407+0000 7f0b30458740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ffadf7a3a0 con 0x55ffae0184b0 2024-09-19T06:24:25.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.408+0000 7f0b27400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ffae017b90 0x55ffae017f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:25.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.408+0000 7f0b27400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ffae017b90 0x55ffae017f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44986/0 (socket says 172.21.15.3:44986) 2024-09-19T06:24:25.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.408+0000 7f0b27400640 1 -- 172.21.15.3:0/159309073 learned_addr learned my addr 172.21.15.3:0/159309073 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:25.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.408+0000 7f0b1e000640 1 --2- 172.21.15.3:0/159309073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffae022d70 0x55ffae025160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:25.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.408+0000 7f0b26a00640 1 --2- 172.21.15.3:0/159309073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ffae0184b0 0x55ffae022830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:25.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.408+0000 7f0b27400640 1 -- 172.21.15.3:0/159309073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ffae0184b0 msgr2=0x55ffae022830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:25.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.408+0000 7f0b27400640 1 --2- 172.21.15.3:0/159309073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ffae0184b0 0x55ffae022830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.408+0000 7f0b27400640 1 -- 172.21.15.3:0/159309073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffae022d70 msgr2=0x55ffae025160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:25.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.408+0000 7f0b27400640 1 --2- 172.21.15.3:0/159309073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffae022d70 0x55ffae025160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.408+0000 7f0b27400640 1 -- 172.21.15.3:0/159309073 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffadf44ae0 con 0x55ffae017b90 2024-09-19T06:24:25.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.409+0000 7f0b1fe00640 1 --2- 172.21.15.3:0/986118156 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0b0c0a33b0 0x7f0b0c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:25.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.409+0000 7f0b27400640 1 --2- 172.21.15.3:0/159309073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ffae017b90 0x55ffae017f70 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f0b20009ca0 tx=0x7f0b20005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51bcd015bf10c2cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:25.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.409+0000 7f0b1fe00640 1 -- 172.21.15.3:0/986118156 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7f0b180d00c0 con 0x7f0b28103ff0 2024-09-19T06:24:25.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.409+0000 7f0b26a00640 1 --2- 172.21.15.3:0/986118156 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0b0c0a33b0 0x7f0b0c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:25.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.409+0000 7f0b17e00640 1 -- 172.21.15.3:0/159309073 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b20031db0 con 0x55ffae017b90 2024-09-19T06:24:25.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.409+0000 7f0b17e00640 1 -- 172.21.15.3:0/159309073 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b20036040 con 0x55ffae017b90 2024-09-19T06:24:25.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.409+0000 7f0b17e00640 1 -- 172.21.15.3:0/159309073 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b200042d0 con 0x55ffae017b90 2024-09-19T06:24:25.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.410+0000 7f0b30458740 1 -- 172.21.15.3:0/159309073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ffae017b90 msgr2=0x55ffae017f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:25.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.410+0000 7f0b30458740 1 --2- 172.21.15.3:0/159309073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ffae017b90 0x55ffae017f70 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f0b20009ca0 tx=0x7f0b20005f10 comp rx=0 tx=0).stop 2024-09-19T06:24:25.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.410+0000 7f0b26a00640 1 --2- 172.21.15.3:0/986118156 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0b0c0a33b0 0x7f0b0c0a5870 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55ffae014f80 tx=0x7f0b180d3b70 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:25.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.410+0000 7f0b30458740 1 -- 172.21.15.3:0/159309073 shutdown_connections 2024-09-19T06:24:25.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.410+0000 7f0b30458740 1 --2- 172.21.15.3:0/159309073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffae022d70 0x55ffae025160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.410+0000 7f0b30458740 1 --2- 172.21.15.3:0/159309073 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ffae0184b0 0x55ffae022830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.410+0000 7f0b30458740 1 --2- 172.21.15.3:0/159309073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ffae017b90 0x55ffae017f70 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.410+0000 7f0b30458740 1 -- 172.21.15.3:0/159309073 >> 172.21.15.3:0/159309073 conn(0x55ffae014120 msgr2=0x55ffae014500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:25.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.410+0000 7f0b30458740 1 -- 172.21.15.3:0/159309073 shutdown_connections 2024-09-19T06:24:25.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.410+0000 7f0b30458740 1 -- 172.21.15.3:0/159309073 wait complete. 2024-09-19T06:24:25.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.411+0000 7f0b30458740 1 -- start start 2024-09-19T06:24:25.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.411+0000 7f0b30458740 1 Processor -- start 2024-09-19T06:24:25.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.411+0000 7f0b30458740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffae017b90 0x55ffae01fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:25.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.411+0000 7f0b30458740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ffae0184b0 0x55ffae0201b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:25.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.411+0000 7f0b30458740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ffae022d70 0x55ffae0206f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:25.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.411+0000 7f0b30458740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ffae025860 con 0x55ffae0184b0 2024-09-19T06:24:25.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.411+0000 7f0b30458740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ffadf390f0 con 0x55ffae017b90 2024-09-19T06:24:25.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.411+0000 7f0b30458740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ffae0259e0 con 0x55ffae022d70 2024-09-19T06:24:25.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.411+0000 7f0b30458740 10 client.0 _ll_register_callbacks cb 0x55ffadf2a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:25.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.412+0000 7f0b27400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffae017b90 0x55ffae01fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:25.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.412+0000 7f0b27400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffae017b90 0x55ffae01fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55950/0 (socket says 172.21.15.3:55950) 2024-09-19T06:24:25.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.412+0000 7f0b1e000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ffae0184b0 0x55ffae0201b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:25.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.412+0000 7f0b27400640 1 -- 172.21.15.3:0/3457207902 learned_addr learned my addr 172.21.15.3:0/3457207902 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:25.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.412+0000 7f0b27400640 1 --2- 172.21.15.3:0/3457207902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ffae022d70 0x55ffae0206f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:25.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.412+0000 7f0b1e000640 1 -- 172.21.15.3:0/3457207902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ffae022d70 msgr2=0x55ffae0206f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:25.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.412+0000 7f0b1e000640 1 --2- 172.21.15.3:0/3457207902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ffae022d70 0x55ffae0206f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.412+0000 7f0b1e000640 1 -- 172.21.15.3:0/3457207902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffae017b90 msgr2=0x55ffae01fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:25.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.412+0000 7f0b1e000640 1 --2- 172.21.15.3:0/3457207902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffae017b90 0x55ffae01fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.412+0000 7f0b1e000640 1 -- 172.21.15.3:0/3457207902 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffadcef3c0 con 0x55ffae0184b0 2024-09-19T06:24:25.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.413+0000 7f0b1e000640 1 --2- 172.21.15.3:0/3457207902 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ffae0184b0 0x55ffae0201b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f0b2810aa90 tx=0x7f0b1000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d6d04f46b63ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:25.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.413+0000 7f0b14c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:24:25.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.413+0000 7f0b14c00640 1 -- 172.21.15.3:0/3457207902 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b10012110 con 0x55ffae0184b0 2024-09-19T06:24:25.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.413+0000 7f0b14c00640 1 -- 172.21.15.3:0/3457207902 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7f0b10004050 con 0x55ffae0184b0 2024-09-19T06:24:25.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.413+0000 7f0b30458740 1 -- 172.21.15.3:0/3457207902 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b20036040 con 0x55ffae0184b0 2024-09-19T06:24:25.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.413+0000 7f0b14c00640 1 -- 172.21.15.3:0/3457207902 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0b100122b0 con 0x55ffae0184b0 2024-09-19T06:24:25.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.413+0000 7f0b30458740 10 client.18669 fetch_fsmap learned FSMap version 29 2024-09-19T06:24:25.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.413+0000 7f0b30458740 1 -- 172.21.15.3:0/3457207902 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ffae0315d0 con 0x55ffae0184b0 2024-09-19T06:24:25.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.414+0000 7f0b14c00640 1 -- 172.21.15.3:0/3457207902 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b20036040 con 0x55ffae0184b0 2024-09-19T06:24:25.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.414+0000 7f0b14c00640 1 -- 172.21.15.3:0/3457207902 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0b100104c0 con 0x55ffae0184b0 2024-09-19T06:24:25.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.414+0000 7f0b30458740 10 client.18669 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:24:25.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.414+0000 7f0b30458740 10 client.18669 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:25.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.414+0000 7f0b30458740 20 client.18669 populate_metadata read hostname 'smithi003' 2024-09-19T06:24:25.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.414+0000 7f0b30458740 1 --2- 172.21.15.3:0/3457207902 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ffae032a90 0x55ffae034ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:25.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.414+0000 7f0b30458740 4 client.18669 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:24:25.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.414+0000 7f0b30458740 1 -- 172.21.15.3:0/3457207902 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffadf8b950 con 0x55ffae032a90 2024-09-19T06:24:25.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.414+0000 7f0b27400640 1 --2- 172.21.15.3:0/3457207902 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ffae032a90 0x55ffae034ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:25.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.415+0000 7f0b27400640 1 --2- 172.21.15.3:0/3457207902 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ffae032a90 0x55ffae034ec0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66e7b70351a321aa server_cookie=5d0bbd89e763cdee in_seq=0 out_seq=0 2024-09-19T06:24:25.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.415+0000 7f0b14c00640 10 client.18669 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:24:25.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.416+0000 7f0b14c00640 1 -- 172.21.15.3:0/3457207902 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ffadf8b950 con 0x55ffae032a90 2024-09-19T06:24:25.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.416+0000 7f0b14c00640 10 client.18669 handle_command_reply: tid=0 2024-09-19T06:24:25.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.416+0000 7f0b30458740 1 client.18669 shutdown 2024-09-19T06:24:25.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.416+0000 7f0b30458740 1 -- 172.21.15.3:0/3457207902 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ffae0184b0 msgr2=0x55ffae0201b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:25.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.416+0000 7f0b30458740 1 --2- 172.21.15.3:0/3457207902 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ffae0184b0 0x55ffae0201b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f0b2810aa90 tx=0x7f0b1000f790 comp rx=0 tx=0).stop 2024-09-19T06:24:25.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.416+0000 7f0b30458740 1 -- 172.21.15.3:0/3457207902 shutdown_connections 2024-09-19T06:24:25.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.416+0000 7f0b30458740 1 --2- 172.21.15.3:0/3457207902 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ffae032a90 0x55ffae034ec0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.416+0000 7f0b30458740 1 --2- 172.21.15.3:0/3457207902 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ffae022d70 0x55ffae0206f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.416+0000 7f0b30458740 1 --2- 172.21.15.3:0/3457207902 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ffae0184b0 0x55ffae0201b0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.416+0000 7f0b30458740 1 --2- 172.21.15.3:0/3457207902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffae017b90 0x55ffae01fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.416+0000 7f0b30458740 1 -- 172.21.15.3:0/3457207902 >> 172.21.15.3:0/3457207902 conn(0x55ffae014120 msgr2=0x55ffae019e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:25.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.416+0000 7f0b14c00640 0 client.18669 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:24:25.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.416+0000 7f0b30458740 1 -- 172.21.15.3:0/3457207902 shutdown_connections 2024-09-19T06:24:25.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.416+0000 7f0b30458740 1 -- 172.21.15.3:0/3457207902 wait complete. 2024-09-19T06:24:25.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.417+0000 7f0b30458740 20 client.18669 trim_cache size 0 max 16384 2024-09-19T06:24:25.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.434+0000 7f0b30458740 1 Processor -- start 2024-09-19T06:24:25.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.435+0000 7f0b30458740 1 -- start start 2024-09-19T06:24:25.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.435+0000 7f0b30458740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffae017b90 0x55ffae01a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:25.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.435+0000 7f0b30458740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ffae0184b0 0x55ffae03a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:25.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.435+0000 7f0b30458740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ffae022d70 0x55ffae03ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:25.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.435+0000 7f0b30458740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0b281afac0 con 0x55ffae022d70 2024-09-19T06:24:25.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.435+0000 7f0b30458740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0b281b1600 con 0x55ffae017b90 2024-09-19T06:24:25.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.435+0000 7f0b30458740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0b281b0190 con 0x55ffae0184b0 2024-09-19T06:24:25.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.435+0000 7f0b27400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffae017b90 0x55ffae01a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:25.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.435+0000 7f0b1e000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ffae0184b0 0x55ffae03a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:25.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.435+0000 7f0b27400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffae017b90 0x55ffae01a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:55954/0 (socket says 172.21.15.3:55954) 2024-09-19T06:24:25.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.435+0000 7f0b27400640 1 -- 172.21.15.3:0/1957341230 learned_addr learned my addr 172.21.15.3:0/1957341230 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:25.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.435+0000 7f0b1e000640 1 --2- 172.21.15.3:0/1957341230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ffae0184b0 0x55ffae03a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:49716/0 (socket says 172.21.15.3:49716) 2024-09-19T06:24:25.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.435+0000 7f0b27400640 1 --2- 172.21.15.3:0/1957341230 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ffae022d70 0x55ffae03ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:25.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.436+0000 7f0b1e000640 1 -- 172.21.15.3:0/1957341230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffae017b90 msgr2=0x55ffae01a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:25.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.436+0000 7f0b1e000640 1 --2- 172.21.15.3:0/1957341230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffae017b90 0x55ffae01a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.436+0000 7f0b1e000640 1 -- 172.21.15.3:0/1957341230 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ffae022d70 msgr2=0x55ffae03ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:25.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.436+0000 7f0b1e000640 1 --2- 172.21.15.3:0/1957341230 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ffae022d70 0x55ffae03ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.436+0000 7f0b1e000640 1 -- 172.21.15.3:0/1957341230 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffae0151d0 con 0x55ffae0184b0 2024-09-19T06:24:25.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.436+0000 7f0b1e000640 1 --2- 172.21.15.3:0/1957341230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ffae0184b0 0x55ffae03a7d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0b10010960 tx=0x7f0b10001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7d59e9dd3ee31f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:25.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.436+0000 7f0b17400640 1 -- 172.21.15.3:0/1957341230 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b10028070 con 0x55ffae0184b0 2024-09-19T06:24:25.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.436+0000 7f0b17400640 1 -- 172.21.15.3:0/1957341230 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b100055c0 con 0x55ffae0184b0 2024-09-19T06:24:25.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.436+0000 7f0b17400640 1 -- 172.21.15.3:0/1957341230 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b10003850 con 0x55ffae0184b0 2024-09-19T06:24:25.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.437+0000 7f0b30458740 1 -- 172.21.15.3:0/1957341230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ffae0184b0 msgr2=0x55ffae03a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:25.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.437+0000 7f0b30458740 1 --2- 172.21.15.3:0/1957341230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ffae0184b0 0x55ffae03a7d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0b10010960 tx=0x7f0b10001e70 comp rx=0 tx=0).stop 2024-09-19T06:24:25.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.437+0000 7f0b30458740 1 -- 172.21.15.3:0/1957341230 shutdown_connections 2024-09-19T06:24:25.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.437+0000 7f0b30458740 1 --2- 172.21.15.3:0/1957341230 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ffae022d70 0x55ffae03ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.437+0000 7f0b30458740 1 --2- 172.21.15.3:0/1957341230 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ffae0184b0 0x55ffae03a7d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.437+0000 7f0b30458740 1 --2- 172.21.15.3:0/1957341230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffae017b90 0x55ffae01a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.437+0000 7f0b30458740 1 -- 172.21.15.3:0/1957341230 >> 172.21.15.3:0/1957341230 conn(0x55ffae014120 msgr2=0x55ffae01e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:25.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.437+0000 7f0b30458740 1 -- 172.21.15.3:0/1957341230 shutdown_connections 2024-09-19T06:24:25.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.437+0000 7f0b30458740 1 -- 172.21.15.3:0/1957341230 wait complete. 2024-09-19T06:24:25.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.437+0000 7f0b30458740 1 -- start start 2024-09-19T06:24:25.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.438+0000 7f0b30458740 1 Processor -- start 2024-09-19T06:24:25.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.438+0000 7f0b30458740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ffae017b90 0x55ffae01cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:25.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.438+0000 7f0b30458740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ffae0184b0 0x55ffae01d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:25.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.438+0000 7f0b30458740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffae022d70 0x55ffae01d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:25.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.438+0000 7f0b30458740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0b281b0f30 con 0x55ffae0184b0 2024-09-19T06:24:25.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.438+0000 7f0b30458740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0b281b0860 con 0x55ffae022d70 2024-09-19T06:24:25.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.438+0000 7f0b30458740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0b281adac0 con 0x55ffae017b90 2024-09-19T06:24:25.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.438+0000 7f0b30458740 10 client.0 _ll_register_callbacks cb 0x7f0b10012930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:25.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.438+0000 7f0b1e000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ffae0184b0 0x55ffae01d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:25.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.438+0000 7f0b1e000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ffae0184b0 0x55ffae01d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45022/0 (socket says 172.21.15.3:45022) 2024-09-19T06:24:25.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.439+0000 7f0b1e000640 1 -- 172.21.15.3:0/1015666730 learned_addr learned my addr 172.21.15.3:0/1015666730 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:25.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.439+0000 7f0b27400640 1 --2- 172.21.15.3:0/1015666730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffae022d70 0x55ffae01d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:25.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.439+0000 7f0b27400640 1 --2- 172.21.15.3:0/1015666730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ffae017b90 0x55ffae01cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:25.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.439+0000 7f0b27400640 1 -- 172.21.15.3:0/1015666730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ffae017b90 msgr2=0x55ffae01cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:25.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.439+0000 7f0b27400640 1 --2- 172.21.15.3:0/1015666730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ffae017b90 0x55ffae01cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.439+0000 7f0b27400640 1 -- 172.21.15.3:0/1015666730 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ffae0184b0 msgr2=0x55ffae01d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:25.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.439+0000 7f0b27400640 1 --2- 172.21.15.3:0/1015666730 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ffae0184b0 0x55ffae01d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.439+0000 7f0b27400640 1 -- 172.21.15.3:0/1015666730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffae09c7a0 con 0x55ffae022d70 2024-09-19T06:24:25.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.439+0000 7f0b27400640 1 --2- 172.21.15.3:0/1015666730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffae022d70 0x55ffae01d6f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0b200316a0 tx=0x7f0b20005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3b4679c432dce43 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:25.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.439+0000 7f0b14c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:24:25.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.439+0000 7f0b14c00640 1 -- 172.21.15.3:0/1015666730 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2002f610 con 0x55ffae022d70 2024-09-19T06:24:25.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.439+0000 7f0b30458740 1 -- 172.21.15.3:0/1015666730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b100055c0 con 0x55ffae022d70 2024-09-19T06:24:25.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.440+0000 7f0b14c00640 1 -- 172.21.15.3:0/1015666730 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7f0b2002f7b0 con 0x55ffae022d70 2024-09-19T06:24:25.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.440+0000 7f0b14c00640 1 -- 172.21.15.3:0/1015666730 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0b2002f9b0 con 0x55ffae022d70 2024-09-19T06:24:25.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.440+0000 7f0b30458740 10 client.28709 fetch_fsmap learned FSMap version 29 2024-09-19T06:24:25.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.440+0000 7f0b30458740 1 -- 172.21.15.3:0/1015666730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ffae09dad0 con 0x55ffae022d70 2024-09-19T06:24:25.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.440+0000 7f0b14c00640 1 -- 172.21.15.3:0/1015666730 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b100055c0 con 0x55ffae022d70 2024-09-19T06:24:25.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.440+0000 7f0b14c00640 1 -- 172.21.15.3:0/1015666730 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0b20062020 con 0x55ffae022d70 2024-09-19T06:24:25.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.440+0000 7f0b30458740 10 client.28709 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:24:25.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.440+0000 7f0b30458740 10 client.28709 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:25.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.440+0000 7f0b30458740 20 client.28709 populate_metadata read hostname 'smithi003' 2024-09-19T06:24:25.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.440+0000 7f0b30458740 1 --2- 172.21.15.3:0/1015666730 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ffae09de10 0x55ffae0a0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:25.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.440+0000 7f0b30458740 4 client.28709 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T06:24:25.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.440+0000 7f0b30458740 1 -- 172.21.15.3:0/1015666730 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ffadf85e60 con 0x55ffae09de10 2024-09-19T06:24:25.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.441+0000 7f0b1e000640 1 --2- 172.21.15.3:0/1015666730 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ffae09de10 0x55ffae0a0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:25.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.441+0000 7f0b1e000640 1 --2- 172.21.15.3:0/1015666730 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ffae09de10 0x55ffae0a0200 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=468fe24f066726d0 server_cookie=7b00e43d030f38c in_seq=0 out_seq=0 2024-09-19T06:24:25.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.441+0000 7f0b14c00640 10 client.28709 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:24:25.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.441+0000 7f0b14c00640 1 -- 172.21.15.3:0/1015666730 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ffadf85e60 con 0x55ffae09de10 2024-09-19T06:24:25.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.441+0000 7f0b14c00640 10 client.28709 handle_command_reply: tid=0 2024-09-19T06:24:25.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.441+0000 7f0b30458740 1 client.28709 shutdown 2024-09-19T06:24:25.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.442+0000 7f0b30458740 1 -- 172.21.15.3:0/1015666730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffae022d70 msgr2=0x55ffae01d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:25.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.442+0000 7f0b30458740 1 --2- 172.21.15.3:0/1015666730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffae022d70 0x55ffae01d6f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0b200316a0 tx=0x7f0b20005f10 comp rx=0 tx=0).stop 2024-09-19T06:24:25.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.442+0000 7f0b30458740 1 -- 172.21.15.3:0/1015666730 shutdown_connections 2024-09-19T06:24:25.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.442+0000 7f0b30458740 1 --2- 172.21.15.3:0/1015666730 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x55ffae09de10 0x55ffae0a0200 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.442+0000 7f0b30458740 1 --2- 172.21.15.3:0/1015666730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffae022d70 0x55ffae01d6f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.442+0000 7f0b30458740 1 --2- 172.21.15.3:0/1015666730 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ffae0184b0 0x55ffae01d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.442+0000 7f0b30458740 1 --2- 172.21.15.3:0/1015666730 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ffae017b90 0x55ffae01cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.442+0000 7f0b30458740 1 -- 172.21.15.3:0/1015666730 >> 172.21.15.3:0/1015666730 conn(0x55ffae014120 msgr2=0x55ffae0129a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:25.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.442+0000 7f0b14c00640 0 client.28709 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:24:25.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.442+0000 7f0b30458740 1 -- 172.21.15.3:0/1015666730 shutdown_connections 2024-09-19T06:24:25.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.442+0000 7f0b30458740 1 -- 172.21.15.3:0/1015666730 wait complete. 2024-09-19T06:24:25.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.442+0000 7f0b30458740 20 client.28709 trim_cache size 0 max 16384 2024-09-19T06:24:25.448 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:24:25.448 INFO:teuthology.orchestra.run.smithi003.stdout: "status": "no active scrubs running", 2024-09-19T06:24:25.448 INFO:teuthology.orchestra.run.smithi003.stdout: "scrubs": {} 2024-09-19T06:24:25.449 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:24:25.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.443+0000 7f0b2d800640 1 -- 172.21.15.3:0/986118156 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0b0c0a33b0 msgr2=0x7f0b0c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:25.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.443+0000 7f0b2d800640 1 --2- 172.21.15.3:0/986118156 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0b0c0a33b0 0x7f0b0c0a5870 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55ffae014f80 tx=0x7f0b180d3b70 comp rx=0 tx=0).stop 2024-09-19T06:24:25.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.443+0000 7f0b2d800640 1 -- 172.21.15.3:0/986118156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0b28103ff0 msgr2=0x7f0b2819a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:25.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.443+0000 7f0b2d800640 1 --2- 172.21.15.3:0/986118156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0b28103ff0 0x7f0b2819a590 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f0b1800e9f0 tx=0x7f0b1800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.443+0000 7f0b2d800640 1 -- 172.21.15.3:0/986118156 shutdown_connections 2024-09-19T06:24:25.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.443+0000 7f0b2d800640 1 --2- 172.21.15.3:0/986118156 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f0b0c0a33b0 0x7f0b0c0a5870 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.443+0000 7f0b2d800640 1 --2- 172.21.15.3:0/986118156 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0b28109120 0x7f0b2819ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.443+0000 7f0b2d800640 1 --2- 172.21.15.3:0/986118156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b281049a0 0x7f0b2819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.443+0000 7f0b2d800640 1 --2- 172.21.15.3:0/986118156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0b28103ff0 0x7f0b2819a590 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:25.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.443+0000 7f0b2d800640 1 -- 172.21.15.3:0/986118156 >> 172.21.15.3:0/986118156 conn(0x7f0b280ffa90 msgr2=0x7f0b28101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:25.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.443+0000 7f0b2d800640 1 -- 172.21.15.3:0/986118156 shutdown_connections 2024-09-19T06:24:25.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:25.443+0000 7f0b2d800640 1 -- 172.21.15.3:0/986118156 wait complete. 2024-09-19T06:24:26.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:25 smithi059 ceph-mon[35138]: pgmap v376: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-19T06:24:26.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:25 smithi003 ceph-mon[30893]: pgmap v376: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-19T06:24:26.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:25 smithi071 ceph-mon[35662]: pgmap v376: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-19T06:24:26.479 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T06:24:26.479 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:24:26.862 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:27.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.432+0000 7fdc87e00640 1 -- 172.21.15.3:0/740056155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc881079c0 msgr2=0x7fdc88107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:27.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.432+0000 7fdc87e00640 1 --2- 172.21.15.3:0/740056155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc881079c0 0x7fdc88107da0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fdc78009900 tx=0x7fdc7802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.433+0000 7fdc87e00640 1 -- 172.21.15.3:0/740056155 shutdown_connections 2024-09-19T06:24:27.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.433+0000 7fdc87e00640 1 --2- 172.21.15.3:0/740056155 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc88102360 0x7fdc8810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.433+0000 7fdc87e00640 1 --2- 172.21.15.3:0/740056155 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc881019c0 0x7fdc88101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.433+0000 7fdc87e00640 1 --2- 172.21.15.3:0/740056155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc881079c0 0x7fdc88107da0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.433+0000 7fdc87e00640 1 -- 172.21.15.3:0/740056155 >> 172.21.15.3:0/740056155 conn(0x7fdc880fd740 msgr2=0x7fdc880ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:27.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.433+0000 7fdc87e00640 1 -- 172.21.15.3:0/740056155 shutdown_connections 2024-09-19T06:24:27.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.433+0000 7fdc87e00640 1 -- 172.21.15.3:0/740056155 wait complete. 2024-09-19T06:24:27.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.434+0000 7fdc87e00640 1 Processor -- start 2024-09-19T06:24:27.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.434+0000 7fdc87e00640 1 -- start start 2024-09-19T06:24:27.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.434+0000 7fdc87e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc881019c0 0x7fdc881982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:27.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.434+0000 7fdc87e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc88102360 0x7fdc88198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:27.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.434+0000 7fdc87e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc881079c0 0x7fdc8819cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:27.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.434+0000 7fdc87e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdc88111e10 con 0x7fdc881019c0 2024-09-19T06:24:27.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.434+0000 7fdc87e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fdc88111c90 con 0x7fdc881079c0 2024-09-19T06:24:27.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.434+0000 7fdc87e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fdc88111f90 con 0x7fdc88102360 2024-09-19T06:24:27.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.435+0000 7fdc86a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc881019c0 0x7fdc881982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:27.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.435+0000 7fdc87400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc881079c0 0x7fdc8819cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:27.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.435+0000 7fdc86a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc881019c0 0x7fdc881982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45040/0 (socket says 172.21.15.3:45040) 2024-09-19T06:24:27.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.435+0000 7fdc86a00640 1 -- 172.21.15.3:0/1900822028 learned_addr learned my addr 172.21.15.3:0/1900822028 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:27.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.435+0000 7fdc86000640 1 --2- 172.21.15.3:0/1900822028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc88102360 0x7fdc88198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:27.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.435+0000 7fdc87400640 1 -- 172.21.15.3:0/1900822028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc88102360 msgr2=0x7fdc88198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:27.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.435+0000 7fdc87400640 1 --2- 172.21.15.3:0/1900822028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc88102360 0x7fdc88198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.435+0000 7fdc87400640 1 -- 172.21.15.3:0/1900822028 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc881019c0 msgr2=0x7fdc881982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:27.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.435+0000 7fdc87400640 1 --2- 172.21.15.3:0/1900822028 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc881019c0 0x7fdc881982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.435+0000 7fdc87400640 1 -- 172.21.15.3:0/1900822028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc8819d270 con 0x7fdc881079c0 2024-09-19T06:24:27.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.435+0000 7fdc86a00640 1 --2- 172.21.15.3:0/1900822028 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc881019c0 0x7fdc881982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:27.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.435+0000 7fdc87400640 1 --2- 172.21.15.3:0/1900822028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc881079c0 0x7fdc8819cb90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fdc80009fd0 tx=0x7fdc8000b690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:27.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.436+0000 7fdc7f400640 1 -- 172.21.15.3:0/1900822028 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc80004b20 con 0x7fdc881079c0 2024-09-19T06:24:27.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.436+0000 7fdc87e00640 1 -- 172.21.15.3:0/1900822028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc8819d560 con 0x7fdc881079c0 2024-09-19T06:24:27.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.436+0000 7fdc7f400640 1 -- 172.21.15.3:0/1900822028 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc80004cc0 con 0x7fdc881079c0 2024-09-19T06:24:27.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.436+0000 7fdc7f400640 1 -- 172.21.15.3:0/1900822028 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc80005520 con 0x7fdc881079c0 2024-09-19T06:24:27.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.436+0000 7fdc87e00640 1 -- 172.21.15.3:0/1900822028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc88074420 con 0x7fdc881079c0 2024-09-19T06:24:27.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.437+0000 7fdc87e00640 1 -- 172.21.15.3:0/1900822028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc88101e20 con 0x7fdc881079c0 2024-09-19T06:24:27.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.439+0000 7fdc7f400640 1 -- 172.21.15.3:0/1900822028 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fdc80005910 con 0x7fdc881079c0 2024-09-19T06:24:27.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.440+0000 7fdc7f400640 1 --2- 172.21.15.3:0/1900822028 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fdc6c0a3430 0x7fdc6c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:27.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.441+0000 7fdc7f400640 1 -- 172.21.15.3:0/1900822028 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7fdc800d4510 con 0x7fdc881079c0 2024-09-19T06:24:27.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.441+0000 7fdc86a00640 1 --2- 172.21.15.3:0/1900822028 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fdc6c0a3430 0x7fdc6c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:27.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.441+0000 7fdc86a00640 1 --2- 172.21.15.3:0/1900822028 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fdc6c0a3430 0x7fdc6c0a58f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdc78000c00 tx=0x7fdc780046c0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:27.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.443+0000 7fdc7f400640 1 -- 172.21.15.3:0/1900822028 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdc800a0810 con 0x7fdc881079c0 2024-09-19T06:24:27.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.669+0000 7fdc87e00640 1 -- 172.21.15.3:0/1900822028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc88109f30 con 0x7fdc881079c0 2024-09-19T06:24:27.672 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.671+0000 7fdc7f400640 1 -- 172.21.15.3:0/1900822028 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7fdc800a4b10 con 0x7fdc881079c0 2024-09-19T06:24:27.673 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:24:27.673 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"btime":"2024-09-19T06:12:22:958217+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:12:22.060987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24532,24515,24514,14517]},"id":1}]} 2024-09-19T06:24:27.673 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2024-09-19T06:24:27.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.673+0000 7fdc87e00640 1 -- 172.21.15.3:0/1900822028 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fdc6c0a3430 msgr2=0x7fdc6c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:27.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.673+0000 7fdc87e00640 1 --2- 172.21.15.3:0/1900822028 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fdc6c0a3430 0x7fdc6c0a58f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdc78000c00 tx=0x7fdc780046c0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.673+0000 7fdc87e00640 1 -- 172.21.15.3:0/1900822028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc881079c0 msgr2=0x7fdc8819cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:27.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.673+0000 7fdc87e00640 1 --2- 172.21.15.3:0/1900822028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc881079c0 0x7fdc8819cb90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fdc80009fd0 tx=0x7fdc8000b690 comp rx=0 tx=0).stop 2024-09-19T06:24:27.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.673+0000 7fdc87e00640 1 -- 172.21.15.3:0/1900822028 shutdown_connections 2024-09-19T06:24:27.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.673+0000 7fdc87e00640 1 --2- 172.21.15.3:0/1900822028 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fdc6c0a3430 0x7fdc6c0a58f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.673+0000 7fdc87e00640 1 --2- 172.21.15.3:0/1900822028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc881079c0 0x7fdc8819cb90 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.673+0000 7fdc87e00640 1 --2- 172.21.15.3:0/1900822028 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fdc88102360 0x7fdc88198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.673+0000 7fdc87e00640 1 --2- 172.21.15.3:0/1900822028 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc881019c0 0x7fdc881982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:27.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.673+0000 7fdc87e00640 1 -- 172.21.15.3:0/1900822028 >> 172.21.15.3:0/1900822028 conn(0x7fdc880fd740 msgr2=0x7fdc880fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:27.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.674+0000 7fdc87e00640 1 -- 172.21.15.3:0/1900822028 shutdown_connections 2024-09-19T06:24:27.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:27.674+0000 7fdc87e00640 1 -- 172.21.15.3:0/1900822028 wait complete. 2024-09-19T06:24:28.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:27 smithi059 ceph-mon[35138]: pgmap v377: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-19T06:24:28.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:27 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1900822028' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:24:28.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:27 smithi003 ceph-mon[30893]: pgmap v377: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-19T06:24:28.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:27 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1900822028' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:24:28.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:27 smithi071 ceph-mon[35662]: pgmap v377: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-19T06:24:28.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:27 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1900822028' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:24:28.462 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T06:24:28.850 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:29.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.434+0000 7f023f200640 1 -- 172.21.15.3:0/3189997561 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f02401047e0 msgr2=0x7f0240108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:29.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.434+0000 7f023f200640 1 --2- 172.21.15.3:0/3189997561 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f02401047e0 0x7f0240108830 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f0228009900 tx=0x7f022802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.434+0000 7f023f200640 1 -- 172.21.15.3:0/3189997561 shutdown_connections 2024-09-19T06:24:29.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.434+0000 7f023f200640 1 --2- 172.21.15.3:0/3189997561 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0240108f60 0x7f0240110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.434+0000 7f023f200640 1 --2- 172.21.15.3:0/3189997561 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f02401047e0 0x7f0240108830 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.434+0000 7f023f200640 1 --2- 172.21.15.3:0/3189997561 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0240103e30 0x7f0240104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.434+0000 7f023f200640 1 -- 172.21.15.3:0/3189997561 >> 172.21.15.3:0/3189997561 conn(0x7f02400ff8d0 msgr2=0x7f0240101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:29.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.434+0000 7f023f200640 1 -- 172.21.15.3:0/3189997561 shutdown_connections 2024-09-19T06:24:29.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.434+0000 7f023f200640 1 -- 172.21.15.3:0/3189997561 wait complete. 2024-09-19T06:24:29.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.435+0000 7f023f200640 1 Processor -- start 2024-09-19T06:24:29.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.435+0000 7f023f200640 1 -- start start 2024-09-19T06:24:29.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.435+0000 7f023f200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0240103e30 0x7f0240110990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:29.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.435+0000 7f023f200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02401047e0 0x7f024010da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:29.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.435+0000 7f023f200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0240108f60 0x7f024010dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:29.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.436+0000 7f023f200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0240113fd0 con 0x7f0240103e30 2024-09-19T06:24:29.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.436+0000 7f023f200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0240113e50 con 0x7f0240108f60 2024-09-19T06:24:29.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.436+0000 7f023f200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0240114150 con 0x7f02401047e0 2024-09-19T06:24:29.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.436+0000 7f023de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0240103e30 0x7f0240110990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:29.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.436+0000 7f0237e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02401047e0 0x7f024010da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:29.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.436+0000 7f023de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0240103e30 0x7f0240110990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45068/0 (socket says 172.21.15.3:45068) 2024-09-19T06:24:29.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.436+0000 7f023de00640 1 -- 172.21.15.3:0/649185718 learned_addr learned my addr 172.21.15.3:0/649185718 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:29.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.436+0000 7f023e800640 1 --2- 172.21.15.3:0/649185718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0240108f60 0x7f024010dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:29.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.436+0000 7f023de00640 1 -- 172.21.15.3:0/649185718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02401047e0 msgr2=0x7f024010da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:29.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.436+0000 7f023de00640 1 --2- 172.21.15.3:0/649185718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02401047e0 0x7f024010da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.436+0000 7f023de00640 1 -- 172.21.15.3:0/649185718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0240108f60 msgr2=0x7f024010dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:29.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.436+0000 7f023de00640 1 --2- 172.21.15.3:0/649185718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0240108f60 0x7f024010dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.436+0000 7f023de00640 1 -- 172.21.15.3:0/649185718 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024010e860 con 0x7f0240103e30 2024-09-19T06:24:29.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.436+0000 7f0237e00640 1 --2- 172.21.15.3:0/649185718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02401047e0 0x7f024010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:29.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.437+0000 7f023de00640 1 --2- 172.21.15.3:0/649185718 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0240103e30 0x7f0240110990 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f023000d950 tx=0x7f023000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:29.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.437+0000 7f0236a00640 1 -- 172.21.15.3:0/649185718 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0230017070 con 0x7f0240103e30 2024-09-19T06:24:29.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.437+0000 7f0236a00640 1 -- 172.21.15.3:0/649185718 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0230009c30 con 0x7f0240103e30 2024-09-19T06:24:29.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.437+0000 7f023f200640 1 -- 172.21.15.3:0/649185718 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02401aae10 con 0x7f0240103e30 2024-09-19T06:24:29.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.437+0000 7f0236a00640 1 -- 172.21.15.3:0/649185718 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023000f6b0 con 0x7f0240103e30 2024-09-19T06:24:29.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.437+0000 7f023f200640 1 -- 172.21.15.3:0/649185718 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02401ab2d0 con 0x7f0240103e30 2024-09-19T06:24:29.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.440+0000 7f0247c97740 1 Processor -- start 2024-09-19T06:24:29.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.440+0000 7f0236a00640 1 -- 172.21.15.3:0/649185718 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f02300109d0 con 0x7f0240103e30 2024-09-19T06:24:29.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.440+0000 7f0247c97740 1 -- start start 2024-09-19T06:24:29.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.441+0000 7f0247c97740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c8bd39e40 0x555c8bd3a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:29.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.441+0000 7f0247c97740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd3a760 0x555c8bd44ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:29.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.441+0000 7f0247c97740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555c8bd45020 0x555c8bd47410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:29.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.441+0000 7f0247c97740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x555c8bca03e0 con 0x555c8bd3a760 2024-09-19T06:24:29.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.441+0000 7f0247c97740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555c8bc47d80 con 0x555c8bd39e40 2024-09-19T06:24:29.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.441+0000 7f0247c97740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555c8bc9c3a0 con 0x555c8bd45020 2024-09-19T06:24:29.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.441+0000 7f023de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd3a760 0x555c8bd44ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:29.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.441+0000 7f023de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd3a760 0x555c8bd44ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45082/0 (socket says 172.21.15.3:45082) 2024-09-19T06:24:29.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.441+0000 7f023e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c8bd39e40 0x555c8bd3a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:29.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.441+0000 7f023de00640 1 -- 172.21.15.3:0/612190977 learned_addr learned my addr 172.21.15.3:0/612190977 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:29.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.441+0000 7f0237e00640 1 --2- 172.21.15.3:0/612190977 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555c8bd45020 0x555c8bd47410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:29.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.441+0000 7f023de00640 1 -- 172.21.15.3:0/612190977 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555c8bd45020 msgr2=0x555c8bd47410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:29.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.441+0000 7f023de00640 1 --2- 172.21.15.3:0/612190977 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555c8bd45020 0x555c8bd47410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.442+0000 7f023de00640 1 -- 172.21.15.3:0/612190977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c8bd39e40 msgr2=0x555c8bd3a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:29.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.442+0000 7f023de00640 1 --2- 172.21.15.3:0/612190977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c8bd39e40 0x555c8bd3a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.442+0000 7f023de00640 1 -- 172.21.15.3:0/612190977 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c8bc66ae0 con 0x555c8bd3a760 2024-09-19T06:24:29.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.442+0000 7f0237e00640 1 --2- 172.21.15.3:0/612190977 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555c8bd45020 0x555c8bd47410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:29.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.442+0000 7f023e800640 1 --2- 172.21.15.3:0/612190977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c8bd39e40 0x555c8bd3a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:29.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.442+0000 7f0236a00640 1 --2- 172.21.15.3:0/649185718 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f02240a33b0 0x7f02240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:29.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.442+0000 7f023de00640 1 --2- 172.21.15.3:0/612190977 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd3a760 0x555c8bd44ae0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f02300ccf50 tx=0x7f02300d7670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93bbf34de1d7a1a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:29.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.442+0000 7f0236a00640 1 -- 172.21.15.3:0/649185718 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7f02300cf950 con 0x7f0240103e30 2024-09-19T06:24:29.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.442+0000 7f023e800640 1 --2- 172.21.15.3:0/649185718 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f02240a33b0 0x7f02240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:29.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.442+0000 7f022f400640 1 -- 172.21.15.3:0/612190977 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0230097ef0 con 0x555c8bd3a760 2024-09-19T06:24:29.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.442+0000 7f022f400640 1 -- 172.21.15.3:0/612190977 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0230009de0 con 0x555c8bd3a760 2024-09-19T06:24:29.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.442+0000 7f022f400640 1 -- 172.21.15.3:0/612190977 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023009b5b0 con 0x555c8bd3a760 2024-09-19T06:24:29.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.443+0000 7f0247c97740 1 -- 172.21.15.3:0/612190977 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd3a760 msgr2=0x555c8bd44ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:29.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.443+0000 7f0247c97740 1 --2- 172.21.15.3:0/612190977 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd3a760 0x555c8bd44ae0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f02300ccf50 tx=0x7f02300d7670 comp rx=0 tx=0).stop 2024-09-19T06:24:29.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.443+0000 7f023e800640 1 --2- 172.21.15.3:0/649185718 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f02240a33b0 0x7f02240a5870 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f024010a8d0 tx=0x7f0238009600 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:29.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.443+0000 7f0247c97740 1 -- 172.21.15.3:0/612190977 shutdown_connections 2024-09-19T06:24:29.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.443+0000 7f0247c97740 1 --2- 172.21.15.3:0/612190977 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555c8bd45020 0x555c8bd47410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.443+0000 7f0247c97740 1 --2- 172.21.15.3:0/612190977 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd3a760 0x555c8bd44ae0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.443+0000 7f0247c97740 1 --2- 172.21.15.3:0/612190977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c8bd39e40 0x555c8bd3a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.443+0000 7f0247c97740 1 -- 172.21.15.3:0/612190977 >> 172.21.15.3:0/612190977 conn(0x555c8bd363d0 msgr2=0x555c8bd367b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:29.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.443+0000 7f0247c97740 1 -- 172.21.15.3:0/612190977 shutdown_connections 2024-09-19T06:24:29.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.443+0000 7f0247c97740 1 -- 172.21.15.3:0/612190977 wait complete. 2024-09-19T06:24:29.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.444+0000 7f0247c97740 1 -- start start 2024-09-19T06:24:29.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.444+0000 7f0247c97740 1 Processor -- start 2024-09-19T06:24:29.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.445+0000 7f0247c97740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd39e40 0x555c8bd41f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:29.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.445+0000 7f0247c97740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c8bd3a760 0x555c8bd424b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:29.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.445+0000 7f0247c97740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555c8bd45020 0x555c8bd429f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:29.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.445+0000 7f0247c97740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x555c8bd47c40 con 0x555c8bd39e40 2024-09-19T06:24:29.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.445+0000 7f0247c97740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x555c8bc5b0f0 con 0x555c8bd3a760 2024-09-19T06:24:29.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.445+0000 7f0247c97740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x555c8bd47dc0 con 0x555c8bd45020 2024-09-19T06:24:29.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.445+0000 7f0247c97740 10 client.0 _ll_register_callbacks cb 0x555c8bc42bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:29.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.445+0000 7f023de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd39e40 0x555c8bd41f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:29.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.445+0000 7f0237e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c8bd3a760 0x555c8bd424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:29.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.445+0000 7f023de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd39e40 0x555c8bd41f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45098/0 (socket says 172.21.15.3:45098) 2024-09-19T06:24:29.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.445+0000 7f023de00640 1 -- 172.21.15.3:0/1284427136 learned_addr learned my addr 172.21.15.3:0/1284427136 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:29.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.445+0000 7f023e800640 1 --2- 172.21.15.3:0/1284427136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555c8bd45020 0x555c8bd429f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:29.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.445+0000 7f023de00640 1 -- 172.21.15.3:0/1284427136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555c8bd45020 msgr2=0x555c8bd429f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:29.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.445+0000 7f023de00640 1 --2- 172.21.15.3:0/1284427136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555c8bd45020 0x555c8bd429f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.445+0000 7f023de00640 1 -- 172.21.15.3:0/1284427136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c8bd3a760 msgr2=0x555c8bd424b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:29.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.445+0000 7f023de00640 1 --2- 172.21.15.3:0/1284427136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c8bd3a760 0x555c8bd424b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.446+0000 7f023de00640 1 -- 172.21.15.3:0/1284427136 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c8ba113c0 con 0x555c8bd39e40 2024-09-19T06:24:29.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.446+0000 7f0237e00640 1 --2- 172.21.15.3:0/1284427136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c8bd3a760 0x555c8bd424b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:29.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.446+0000 7f023de00640 1 --2- 172.21.15.3:0/1284427136 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd39e40 0x555c8bd41f70 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f02300d7b70 tx=0x7f0230005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3b699f5a3a8cd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:29.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.446+0000 7f0223e00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:24:29.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.446+0000 7f0223e00640 1 -- 172.21.15.3:0/1284427136 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0230020070 con 0x555c8bd39e40 2024-09-19T06:24:29.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.446+0000 7f0223e00640 1 -- 172.21.15.3:0/1284427136 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7f02300d5cb0 con 0x555c8bd39e40 2024-09-19T06:24:29.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.446+0000 7f0247c97740 1 -- 172.21.15.3:0/1284427136 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0230009de0 con 0x555c8bd39e40 2024-09-19T06:24:29.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.446+0000 7f0223e00640 1 -- 172.21.15.3:0/1284427136 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f023009b790 con 0x555c8bd39e40 2024-09-19T06:24:29.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.446+0000 7f0247c97740 10 client.18693 fetch_fsmap learned FSMap version 29 2024-09-19T06:24:29.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.446+0000 7f0247c97740 1 -- 172.21.15.3:0/1284427136 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555c8bd53ce0 con 0x555c8bd39e40 2024-09-19T06:24:29.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.447+0000 7f0223e00640 1 -- 172.21.15.3:0/1284427136 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0230009de0 con 0x555c8bd39e40 2024-09-19T06:24:29.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.447+0000 7f0223e00640 1 -- 172.21.15.3:0/1284427136 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f02300cd290 con 0x555c8bd39e40 2024-09-19T06:24:29.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.447+0000 7f0247c97740 10 client.18693 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:24:29.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.447+0000 7f0247c97740 10 client.18693 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:24:29.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.447+0000 7f0247c97740 20 client.18693 populate_metadata read hostname 'smithi003' 2024-09-19T06:24:29.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.447+0000 7f0247c97740 1 --2- 172.21.15.3:0/1284427136 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x555c8bd55030 0x555c8bd57420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:29.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.447+0000 7f0247c97740 4 client.18693 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:24:29.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.447+0000 7f0247c97740 1 -- 172.21.15.3:0/1284427136 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c8bcad950 con 0x555c8bd55030 2024-09-19T06:24:29.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.447+0000 7f0237e00640 1 --2- 172.21.15.3:0/1284427136 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x555c8bd55030 0x555c8bd57420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:29.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.448+0000 7f0237e00640 1 --2- 172.21.15.3:0/1284427136 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x555c8bd55030 0x555c8bd57420 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=512d3f4d9e7a4ec4 server_cookie=2174e259fb9e21a2 in_seq=0 out_seq=0 2024-09-19T06:24:29.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.448+0000 7f0223e00640 10 client.18693 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:24:29.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.449+0000 7f0223e00640 1 -- 172.21.15.3:0/1284427136 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555c8bcad950 con 0x555c8bd55030 2024-09-19T06:24:29.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.449+0000 7f0223e00640 10 client.18693 handle_command_reply: tid=0 2024-09-19T06:24:29.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.449+0000 7f0247c97740 1 client.18693 shutdown 2024-09-19T06:24:29.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.449+0000 7f0247c97740 1 -- 172.21.15.3:0/1284427136 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd39e40 msgr2=0x555c8bd41f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:29.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.449+0000 7f0247c97740 1 --2- 172.21.15.3:0/1284427136 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd39e40 0x555c8bd41f70 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f02300d7b70 tx=0x7f0230005880 comp rx=0 tx=0).stop 2024-09-19T06:24:29.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.449+0000 7f0247c97740 1 -- 172.21.15.3:0/1284427136 shutdown_connections 2024-09-19T06:24:29.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.449+0000 7f0247c97740 1 --2- 172.21.15.3:0/1284427136 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x555c8bd55030 0x555c8bd57420 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.449+0000 7f0247c97740 1 --2- 172.21.15.3:0/1284427136 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555c8bd45020 0x555c8bd429f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.449+0000 7f0247c97740 1 --2- 172.21.15.3:0/1284427136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c8bd3a760 0x555c8bd424b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.449+0000 7f0247c97740 1 --2- 172.21.15.3:0/1284427136 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd39e40 0x555c8bd41f70 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.449+0000 7f0247c97740 1 -- 172.21.15.3:0/1284427136 >> 172.21.15.3:0/1284427136 conn(0x555c8bd363d0 msgr2=0x555c8bd3c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:29.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.449+0000 7f0223e00640 0 client.18693 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:24:29.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.449+0000 7f0247c97740 1 -- 172.21.15.3:0/1284427136 shutdown_connections 2024-09-19T06:24:29.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.449+0000 7f0247c97740 1 -- 172.21.15.3:0/1284427136 wait complete. 2024-09-19T06:24:29.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.449+0000 7f0247c97740 20 client.18693 trim_cache size 0 max 16384 2024-09-19T06:24:29.464 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.463+0000 7f0247c97740 1 Processor -- start 2024-09-19T06:24:29.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.463+0000 7f0247c97740 1 -- start start 2024-09-19T06:24:29.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.463+0000 7f0247c97740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd39e40 0x555c8bd3c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:29.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.463+0000 7f0247c97740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555c8bd3a760 0x555c8bd3f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:29.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.463+0000 7f0247c97740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c8bd45020 0x555c8bd3f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:29.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.463+0000 7f0247c97740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f02401b3e10 con 0x555c8bd39e40 2024-09-19T06:24:29.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.463+0000 7f0247c97740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f02401b5950 con 0x555c8bd45020 2024-09-19T06:24:29.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.463+0000 7f0247c97740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f02401b44e0 con 0x555c8bd3a760 2024-09-19T06:24:29.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.463+0000 7f023de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd39e40 0x555c8bd3c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:29.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.464+0000 7f023de00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd39e40 0x555c8bd3c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45106/0 (socket says 172.21.15.3:45106) 2024-09-19T06:24:29.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.464+0000 7f023de00640 1 -- 172.21.15.3:0/2909516624 learned_addr learned my addr 172.21.15.3:0/2909516624 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:29.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.464+0000 7f023e800640 1 --2- 172.21.15.3:0/2909516624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c8bd45020 0x555c8bd3f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:29.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.464+0000 7f0237e00640 1 --2- 172.21.15.3:0/2909516624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555c8bd3a760 0x555c8bd3f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:29.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.464+0000 7f023de00640 1 -- 172.21.15.3:0/2909516624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555c8bd3a760 msgr2=0x555c8bd3f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:29.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.464+0000 7f023de00640 1 --2- 172.21.15.3:0/2909516624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555c8bd3a760 0x555c8bd3f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.464+0000 7f023de00640 1 -- 172.21.15.3:0/2909516624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c8bd45020 msgr2=0x555c8bd3f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:29.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.464+0000 7f023de00640 1 --2- 172.21.15.3:0/2909516624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c8bd45020 0x555c8bd3f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.464+0000 7f023de00640 1 -- 172.21.15.3:0/2909516624 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c8bd36200 con 0x555c8bd39e40 2024-09-19T06:24:29.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.464+0000 7f023e800640 1 --2- 172.21.15.3:0/2909516624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c8bd45020 0x555c8bd3f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:29.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.464+0000 7f023de00640 1 --2- 172.21.15.3:0/2909516624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd39e40 0x555c8bd3c8f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f023009be10 tx=0x7f0230098590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6910a665e41eb87 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:29.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.464+0000 7f022ea00640 1 -- 172.21.15.3:0/2909516624 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0230020070 con 0x555c8bd39e40 2024-09-19T06:24:29.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.465+0000 7f022ea00640 1 -- 172.21.15.3:0/2909516624 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0230009de0 con 0x555c8bd39e40 2024-09-19T06:24:29.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.465+0000 7f022ea00640 1 -- 172.21.15.3:0/2909516624 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023009ba20 con 0x555c8bd39e40 2024-09-19T06:24:29.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.465+0000 7f0247c97740 1 -- 172.21.15.3:0/2909516624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd39e40 msgr2=0x555c8bd3c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:29.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.465+0000 7f0247c97740 1 --2- 172.21.15.3:0/2909516624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd39e40 0x555c8bd3c8f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f023009be10 tx=0x7f0230098590 comp rx=0 tx=0).stop 2024-09-19T06:24:29.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.465+0000 7f0247c97740 1 -- 172.21.15.3:0/2909516624 shutdown_connections 2024-09-19T06:24:29.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.465+0000 7f0247c97740 1 --2- 172.21.15.3:0/2909516624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c8bd45020 0x555c8bd3f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.471 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.465+0000 7f0247c97740 1 --2- 172.21.15.3:0/2909516624 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555c8bd3a760 0x555c8bd3f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.465+0000 7f0247c97740 1 --2- 172.21.15.3:0/2909516624 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd39e40 0x555c8bd3c8f0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.465+0000 7f0247c97740 1 -- 172.21.15.3:0/2909516624 >> 172.21.15.3:0/2909516624 conn(0x555c8bd363d0 msgr2=0x555c8bd35490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:29.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.465+0000 7f0247c97740 1 -- 172.21.15.3:0/2909516624 shutdown_connections 2024-09-19T06:24:29.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.465+0000 7f0247c97740 1 -- 172.21.15.3:0/2909516624 wait complete. 2024-09-19T06:24:29.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.466+0000 7f0247c97740 1 -- start start 2024-09-19T06:24:29.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.466+0000 7f0247c97740 1 Processor -- start 2024-09-19T06:24:29.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.466+0000 7f0247c97740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c8bd39e40 0x555c8bd577e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:29.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.466+0000 7f0247c97740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd3a760 0x555c8bd57d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:29.472 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.466+0000 7f0247c97740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555c8bd45020 0x555c8bdb7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:29.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.466+0000 7f0247c97740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f02401b5280 con 0x555c8bd3a760 2024-09-19T06:24:29.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.467+0000 7f0247c97740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f02401b4bb0 con 0x555c8bd39e40 2024-09-19T06:24:29.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.467+0000 7f0247c97740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f02401b1e10 con 0x555c8bd45020 2024-09-19T06:24:29.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.467+0000 7f0247c97740 10 client.0 _ll_register_callbacks cb 0x7f0238009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:29.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.467+0000 7f0237e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd3a760 0x555c8bd57d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:29.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.467+0000 7f023e800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555c8bd45020 0x555c8bdb7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:29.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.467+0000 7f0237e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd3a760 0x555c8bd57d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45122/0 (socket says 172.21.15.3:45122) 2024-09-19T06:24:29.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.467+0000 7f0237e00640 1 -- 172.21.15.3:0/1139993492 learned_addr learned my addr 172.21.15.3:0/1139993492 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:29.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.467+0000 7f023de00640 1 --2- 172.21.15.3:0/1139993492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c8bd39e40 0x555c8bd577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:29.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.467+0000 7f0237e00640 1 -- 172.21.15.3:0/1139993492 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555c8bd45020 msgr2=0x555c8bdb7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:29.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.467+0000 7f0237e00640 1 --2- 172.21.15.3:0/1139993492 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555c8bd45020 0x555c8bdb7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.467+0000 7f0237e00640 1 -- 172.21.15.3:0/1139993492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c8bd39e40 msgr2=0x555c8bd577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:29.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.467+0000 7f0237e00640 1 --2- 172.21.15.3:0/1139993492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c8bd39e40 0x555c8bd577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.467+0000 7f0237e00640 1 -- 172.21.15.3:0/1139993492 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c8bdb7fd0 con 0x555c8bd3a760 2024-09-19T06:24:29.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.467+0000 7f023e800640 1 --2- 172.21.15.3:0/1139993492 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555c8bd45020 0x555c8bdb7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:29.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.468+0000 7f0237e00640 1 --2- 172.21.15.3:0/1139993492 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd3a760 0x555c8bd57d20 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f022802a9b0 tx=0x7f022802aa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee75e75f4396a1d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:29.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.468+0000 7f0223e00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:24:29.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.468+0000 7f0223e00640 1 -- 172.21.15.3:0/1139993492 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228035040 con 0x555c8bd3a760 2024-09-19T06:24:29.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.468+0000 7f0223e00640 1 -- 172.21.15.3:0/1139993492 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7f0228004760 con 0x555c8bd3a760 2024-09-19T06:24:29.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.468+0000 7f0247c97740 1 -- 172.21.15.3:0/1139993492 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0230009de0 con 0x555c8bd3a760 2024-09-19T06:24:29.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.468+0000 7f0223e00640 1 -- 172.21.15.3:0/1139993492 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0228004960 con 0x555c8bd3a760 2024-09-19T06:24:29.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.468+0000 7f0247c97740 10 client.18699 fetch_fsmap learned FSMap version 29 2024-09-19T06:24:29.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.468+0000 7f0247c97740 1 -- 172.21.15.3:0/1139993492 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555c8bdbf3f0 con 0x555c8bd3a760 2024-09-19T06:24:29.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.469+0000 7f0223e00640 1 -- 172.21.15.3:0/1139993492 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0230009de0 con 0x555c8bd3a760 2024-09-19T06:24:29.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.469+0000 7f0223e00640 1 -- 172.21.15.3:0/1139993492 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0228055070 con 0x555c8bd3a760 2024-09-19T06:24:29.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.469+0000 7f0247c97740 10 client.18699 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:24:29.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.469+0000 7f0247c97740 10 client.18699 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-09-19T06:24:29.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.469+0000 7f0247c97740 20 client.18699 populate_metadata read hostname 'smithi003' 2024-09-19T06:24:29.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.469+0000 7f0247c97740 1 --2- 172.21.15.3:0/1139993492 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x555c8bdbfb20 0x555c8bdc1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:29.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.469+0000 7f0247c97740 4 client.18699 mds_command: new command op to 14517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:24:29.475 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.469+0000 7f0247c97740 1 -- 172.21.15.3:0/1139993492 --> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555c8bca7e60 con 0x555c8bdbfb20 2024-09-19T06:24:29.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.469+0000 7f023de00640 1 --2- 172.21.15.3:0/1139993492 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x555c8bdbfb20 0x555c8bdc1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:29.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.470+0000 7f023de00640 1 --2- 172.21.15.3:0/1139993492 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x555c8bdbfb20 0x555c8bdc1f40 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1f230c966f930898 server_cookie=ec7daf29acfaa336 in_seq=0 out_seq=0 2024-09-19T06:24:29.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.470+0000 7f0223e00640 10 client.18699 ms_handle_connect on v2:172.21.15.3:6840/4189406134 2024-09-19T06:24:29.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.470+0000 7f0223e00640 1 -- 172.21.15.3:0/1139993492 <== mds.4 v2:172.21.15.3:6840/4189406134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555c8bca7e60 con 0x555c8bdbfb20 2024-09-19T06:24:29.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.470+0000 7f0223e00640 10 client.18699 handle_command_reply: tid=0 2024-09-19T06:24:29.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.470+0000 7f0247c97740 1 client.18699 shutdown 2024-09-19T06:24:29.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.470+0000 7f0247c97740 1 -- 172.21.15.3:0/1139993492 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd3a760 msgr2=0x555c8bd57d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:29.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.470+0000 7f0247c97740 1 --2- 172.21.15.3:0/1139993492 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd3a760 0x555c8bd57d20 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f022802a9b0 tx=0x7f022802aa70 comp rx=0 tx=0).stop 2024-09-19T06:24:29.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.470+0000 7f0247c97740 1 -- 172.21.15.3:0/1139993492 shutdown_connections 2024-09-19T06:24:29.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.470+0000 7f0247c97740 1 --2- 172.21.15.3:0/1139993492 >> [v2:172.21.15.3:6840/4189406134,v1:172.21.15.3:6841/4189406134] conn(0x555c8bdbfb20 0x555c8bdc1f40 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.470+0000 7f0247c97740 1 --2- 172.21.15.3:0/1139993492 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x555c8bd45020 0x555c8bdb7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.470+0000 7f0247c97740 1 --2- 172.21.15.3:0/1139993492 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x555c8bd3a760 0x555c8bd57d20 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.470+0000 7f0247c97740 1 --2- 172.21.15.3:0/1139993492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555c8bd39e40 0x555c8bd577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.470+0000 7f0223e00640 0 client.18699 ms_handle_reset on v2:172.21.15.3:6840/4189406134 2024-09-19T06:24:29.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.470+0000 7f0247c97740 1 -- 172.21.15.3:0/1139993492 >> 172.21.15.3:0/1139993492 conn(0x555c8bd363d0 msgr2=0x555c8bd437d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:29.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.471+0000 7f0247c97740 1 -- 172.21.15.3:0/1139993492 shutdown_connections 2024-09-19T06:24:29.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.471+0000 7f0247c97740 1 -- 172.21.15.3:0/1139993492 wait complete. 2024-09-19T06:24:29.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.471+0000 7f0247c97740 20 client.18699 trim_cache size 0 max 16384 2024-09-19T06:24:29.479 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:24:29.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.471+0000 7f023f200640 1 -- 172.21.15.3:0/649185718 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f02240a33b0 msgr2=0x7f02240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:29.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.471+0000 7f023f200640 1 --2- 172.21.15.3:0/649185718 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f02240a33b0 0x7f02240a5870 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f024010a8d0 tx=0x7f0238009600 comp rx=0 tx=0).stop 2024-09-19T06:24:29.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.471+0000 7f023f200640 1 -- 172.21.15.3:0/649185718 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0240103e30 msgr2=0x7f0240110990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:29.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.471+0000 7f023f200640 1 --2- 172.21.15.3:0/649185718 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0240103e30 0x7f0240110990 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f023000d950 tx=0x7f023000de10 comp rx=0 tx=0).stop 2024-09-19T06:24:29.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.472+0000 7f023f200640 1 -- 172.21.15.3:0/649185718 shutdown_connections 2024-09-19T06:24:29.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.472+0000 7f023f200640 1 --2- 172.21.15.3:0/649185718 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f02240a33b0 0x7f02240a5870 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.472+0000 7f023f200640 1 --2- 172.21.15.3:0/649185718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0240108f60 0x7f024010dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.472+0000 7f023f200640 1 --2- 172.21.15.3:0/649185718 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f02401047e0 0x7f024010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.472+0000 7f023f200640 1 --2- 172.21.15.3:0/649185718 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0240103e30 0x7f0240110990 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:29.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.472+0000 7f023f200640 1 -- 172.21.15.3:0/649185718 >> 172.21.15.3:0/649185718 conn(0x7f02400ff8d0 msgr2=0x7f0240100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:29.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.472+0000 7f023f200640 1 -- 172.21.15.3:0/649185718 shutdown_connections 2024-09-19T06:24:29.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:29.472+0000 7f023f200640 1 -- 172.21.15.3:0/649185718 wait complete. 2024-09-19T06:24:30.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:29 smithi059 ceph-mon[35138]: pgmap v378: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-19T06:24:30.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:29 smithi003 ceph-mon[30893]: pgmap v378: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-19T06:24:30.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:29 smithi071 ceph-mon[35662]: pgmap v378: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-19T06:24:30.665 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T06:24:31.048 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:31.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.612+0000 7f7dc5e00640 1 -- 172.21.15.3:0/1776789351 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dc01049a0 msgr2=0x7f7dc01089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:31.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.612+0000 7f7dc5e00640 1 --2- 172.21.15.3:0/1776789351 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dc01049a0 0x7f7dc01089f0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f7dac009900 tx=0x7f7dac02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.612+0000 7f7dc5e00640 1 -- 172.21.15.3:0/1776789351 shutdown_connections 2024-09-19T06:24:31.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.612+0000 7f7dc5e00640 1 --2- 172.21.15.3:0/1776789351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dc0109120 0x7f7dc0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.613+0000 7f7dc5e00640 1 --2- 172.21.15.3:0/1776789351 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dc01049a0 0x7f7dc01089f0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.613+0000 7f7dc5e00640 1 --2- 172.21.15.3:0/1776789351 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dc0103ff0 0x7f7dc01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.613+0000 7f7dc5e00640 1 -- 172.21.15.3:0/1776789351 >> 172.21.15.3:0/1776789351 conn(0x7f7dc00ffa90 msgr2=0x7f7dc0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:31.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.613+0000 7f7dc5e00640 1 -- 172.21.15.3:0/1776789351 shutdown_connections 2024-09-19T06:24:31.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.613+0000 7f7dc5e00640 1 -- 172.21.15.3:0/1776789351 wait complete. 2024-09-19T06:24:31.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.614+0000 7f7dc5e00640 1 Processor -- start 2024-09-19T06:24:31.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.614+0000 7f7dc5e00640 1 -- start start 2024-09-19T06:24:31.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.614+0000 7f7dc5e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dc0103ff0 0x7f7dc019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.614+0000 7f7dc5e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dc01049a0 0x7f7dc019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.614+0000 7f7dc5e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dc0109120 0x7f7dc019eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.614+0000 7f7dc5e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc0114190 con 0x7f7dc01049a0 2024-09-19T06:24:31.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.614+0000 7f7dc5e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc0114010 con 0x7f7dc0103ff0 2024-09-19T06:24:31.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.614+0000 7f7dc5e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc0114310 con 0x7f7dc0109120 2024-09-19T06:24:31.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.614+0000 7f7dbea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dc0103ff0 0x7f7dc019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.614+0000 7f7dbea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dc0103ff0 0x7f7dc019a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:56054/0 (socket says 172.21.15.3:56054) 2024-09-19T06:24:31.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.614+0000 7f7dbea00640 1 -- 172.21.15.3:0/3272439400 learned_addr learned my addr 172.21.15.3:0/3272439400 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:31.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.614+0000 7f7dbe000640 1 --2- 172.21.15.3:0/3272439400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dc01049a0 0x7f7dc019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.615+0000 7f7dbf400640 1 --2- 172.21.15.3:0/3272439400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dc0109120 0x7f7dc019eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.615+0000 7f7dbea00640 1 -- 172.21.15.3:0/3272439400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dc0109120 msgr2=0x7f7dc019eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:31.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.615+0000 7f7dbea00640 1 --2- 172.21.15.3:0/3272439400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dc0109120 0x7f7dc019eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.615+0000 7f7dbea00640 1 -- 172.21.15.3:0/3272439400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dc01049a0 msgr2=0x7f7dc019ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:31.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.615+0000 7f7dbea00640 1 --2- 172.21.15.3:0/3272439400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dc01049a0 0x7f7dc019ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.615+0000 7f7dbea00640 1 -- 172.21.15.3:0/3272439400 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc019f5c0 con 0x7f7dc0103ff0 2024-09-19T06:24:31.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.615+0000 7f7dbf400640 1 --2- 172.21.15.3:0/3272439400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dc0109120 0x7f7dc019eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:31.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.615+0000 7f7dbea00640 1 --2- 172.21.15.3:0/3272439400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dc0103ff0 0x7f7dc019a610 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7db000e9f0 tx=0x7f7db000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:31.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.615+0000 7f7dc4a00640 1 -- 172.21.15.3:0/3272439400 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db000cd80 con 0x7f7dc0103ff0 2024-09-19T06:24:31.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.615+0000 7f7dc5e00640 1 -- 172.21.15.3:0/3272439400 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc019f8b0 con 0x7f7dc0103ff0 2024-09-19T06:24:31.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.615+0000 7f7dc4a00640 1 -- 172.21.15.3:0/3272439400 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7db0005500 con 0x7f7dc0103ff0 2024-09-19T06:24:31.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.615+0000 7f7dc4a00640 1 -- 172.21.15.3:0/3272439400 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db0010690 con 0x7f7dc0103ff0 2024-09-19T06:24:31.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.616+0000 7f7dc5e00640 1 -- 172.21.15.3:0/3272439400 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc01a7190 con 0x7f7dc0103ff0 2024-09-19T06:24:31.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.619+0000 7f7dc87ce740 1 Processor -- start 2024-09-19T06:24:31.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.619+0000 7f7dc87ce740 1 -- start start 2024-09-19T06:24:31.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.620+0000 7f7dc87ce740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab8c70 0x55ddd7ab9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.620+0000 7f7dc87ce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ddd7ab9590 0x55ddd7ac3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.620+0000 7f7dc87ce740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ddd7ac3e50 0x55ddd7ac6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.620+0000 7f7dc87ce740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ddd7a1f3e0 con 0x55ddd7ab8c70 2024-09-19T06:24:31.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.620+0000 7f7dc87ce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ddd79c6d80 con 0x55ddd7ab9590 2024-09-19T06:24:31.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.620+0000 7f7dc87ce740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ddd7a1b3a0 con 0x55ddd7ac3e50 2024-09-19T06:24:31.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.620+0000 7f7dc4a00640 1 -- 172.21.15.3:0/3272439400 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f7db00046c0 con 0x7f7dc0103ff0 2024-09-19T06:24:31.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.620+0000 7f7dbf400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab8c70 0x55ddd7ab9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.620+0000 7f7dbe000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ddd7ac3e50 0x55ddd7ac6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.620+0000 7f7dbe000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ddd7ac3e50 0x55ddd7ac6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:49820/0 (socket says 172.21.15.3:49820) 2024-09-19T06:24:31.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.620+0000 7f7dbe000640 1 -- 172.21.15.3:0/3725931710 learned_addr learned my addr 172.21.15.3:0/3725931710 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:31.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.621+0000 7f7dbea00640 1 --2- 172.21.15.3:0/3725931710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ddd7ab9590 0x55ddd7ac3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.621+0000 7f7dbe000640 1 -- 172.21.15.3:0/3725931710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ddd7ab9590 msgr2=0x55ddd7ac3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:31.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.621+0000 7f7dbe000640 1 --2- 172.21.15.3:0/3725931710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ddd7ab9590 0x55ddd7ac3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.621+0000 7f7dbe000640 1 -- 172.21.15.3:0/3725931710 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab8c70 msgr2=0x55ddd7ab9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:31.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.621+0000 7f7dbe000640 1 --2- 172.21.15.3:0/3725931710 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab8c70 0x55ddd7ab9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.621+0000 7f7dbe000640 1 -- 172.21.15.3:0/3725931710 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddd79e5ae0 con 0x55ddd7ac3e50 2024-09-19T06:24:31.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.621+0000 7f7dbe000640 1 --2- 172.21.15.3:0/3725931710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ddd7ac3e50 0x55ddd7ac6240 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7dac009900 tx=0x7f7dac005de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2c8c8c74cca92b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:31.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.621+0000 7f7dabe00640 1 -- 172.21.15.3:0/3725931710 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dac035040 con 0x55ddd7ac3e50 2024-09-19T06:24:31.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.621+0000 7f7dabe00640 1 -- 172.21.15.3:0/3725931710 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dac004400 con 0x55ddd7ac3e50 2024-09-19T06:24:31.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.622+0000 7f7dabe00640 1 -- 172.21.15.3:0/3725931710 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dac0035f0 con 0x55ddd7ac3e50 2024-09-19T06:24:31.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.622+0000 7f7dc4a00640 1 --2- 172.21.15.3:0/3272439400 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7da40a33b0 0x7f7da40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.622+0000 7f7dc4a00640 1 -- 172.21.15.3:0/3272439400 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7f7db00d01e0 con 0x7f7dc0103ff0 2024-09-19T06:24:31.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.622+0000 7f7dbf400640 1 --2- 172.21.15.3:0/3272439400 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7da40a33b0 0x7f7da40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.622+0000 7f7dc87ce740 1 -- 172.21.15.3:0/3725931710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ddd7ac3e50 msgr2=0x55ddd7ac6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:31.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.622+0000 7f7dc87ce740 1 --2- 172.21.15.3:0/3725931710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ddd7ac3e50 0x55ddd7ac6240 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7dac009900 tx=0x7f7dac005de0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.622+0000 7f7dc87ce740 1 -- 172.21.15.3:0/3725931710 shutdown_connections 2024-09-19T06:24:31.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.622+0000 7f7dc87ce740 1 --2- 172.21.15.3:0/3725931710 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ddd7ac3e50 0x55ddd7ac6240 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.622+0000 7f7dc87ce740 1 --2- 172.21.15.3:0/3725931710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ddd7ab9590 0x55ddd7ac3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.622+0000 7f7dc87ce740 1 --2- 172.21.15.3:0/3725931710 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab8c70 0x55ddd7ab9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.622+0000 7f7dc87ce740 1 -- 172.21.15.3:0/3725931710 >> 172.21.15.3:0/3725931710 conn(0x55ddd7ab5200 msgr2=0x55ddd7ab55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:31.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.623+0000 7f7dc87ce740 1 -- 172.21.15.3:0/3725931710 shutdown_connections 2024-09-19T06:24:31.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.623+0000 7f7dc87ce740 1 -- 172.21.15.3:0/3725931710 wait complete. 2024-09-19T06:24:31.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.623+0000 7f7dbf400640 1 --2- 172.21.15.3:0/3272439400 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7da40a33b0 0x7f7da40a5870 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7db8005fd0 tx=0x7f7db8009500 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:31.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.623+0000 7f7dc87ce740 1 -- start start 2024-09-19T06:24:31.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.623+0000 7f7dc87ce740 1 Processor -- start 2024-09-19T06:24:31.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.624+0000 7f7dc87ce740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ddd7ab8c70 0x55ddd7ac0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.624+0000 7f7dc87ce740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab9590 0x55ddd7ac1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.624+0000 7f7dc87ce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ddd7ac3e50 0x55ddd7ac17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.624+0000 7f7dc87ce740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x55ddd7ac6a20 con 0x55ddd7ab9590 2024-09-19T06:24:31.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.624+0000 7f7dc87ce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x55ddd79da0f0 con 0x55ddd7ac3e50 2024-09-19T06:24:31.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.624+0000 7f7dc87ce740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x55ddd7ac6ba0 con 0x55ddd7ab8c70 2024-09-19T06:24:31.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.624+0000 7f7dc87ce740 10 client.0 _ll_register_callbacks cb 0x55ddd79c1bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:31.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.624+0000 7f7dbe000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab9590 0x55ddd7ac1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.624+0000 7f7dbea00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ddd7ab8c70 0x55ddd7ac0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.624+0000 7f7dbe000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab9590 0x55ddd7ac1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45140/0 (socket says 172.21.15.3:45140) 2024-09-19T06:24:31.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.624+0000 7f7dbe000640 1 -- 172.21.15.3:0/4127471853 learned_addr learned my addr 172.21.15.3:0/4127471853 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:31.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.624+0000 7f7dbf400640 1 --2- 172.21.15.3:0/4127471853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ddd7ac3e50 0x55ddd7ac17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.625+0000 7f7dbe000640 1 -- 172.21.15.3:0/4127471853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ddd7ab8c70 msgr2=0x55ddd7ac0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:31.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.625+0000 7f7dbe000640 1 --2- 172.21.15.3:0/4127471853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ddd7ab8c70 0x55ddd7ac0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.625+0000 7f7dbe000640 1 -- 172.21.15.3:0/4127471853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ddd7ac3e50 msgr2=0x55ddd7ac17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:31.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.625+0000 7f7dbe000640 1 --2- 172.21.15.3:0/4127471853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ddd7ac3e50 0x55ddd7ac17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.625+0000 7f7dbe000640 1 -- 172.21.15.3:0/4127471853 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddd77903c0 con 0x55ddd7ab9590 2024-09-19T06:24:31.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.625+0000 7f7dbe000640 1 --2- 172.21.15.3:0/4127471853 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab9590 0x55ddd7ac1280 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f7dac004600 tx=0x7f7dac02a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b44060250bd17fc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:31.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.625+0000 7f7da8c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:24:31.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.625+0000 7f7da8c00640 1 -- 172.21.15.3:0/4127471853 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dac035070 con 0x55ddd7ab9590 2024-09-19T06:24:31.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.625+0000 7f7da8c00640 1 -- 172.21.15.3:0/4127471853 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7f7dac004200 con 0x55ddd7ab9590 2024-09-19T06:24:31.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.625+0000 7f7dc87ce740 1 -- 172.21.15.3:0/4127471853 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dac004400 con 0x55ddd7ab9590 2024-09-19T06:24:31.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.625+0000 7f7da8c00640 1 -- 172.21.15.3:0/4127471853 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7dac009520 con 0x55ddd7ab9590 2024-09-19T06:24:31.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.625+0000 7f7dc87ce740 10 client.18711 fetch_fsmap learned FSMap version 29 2024-09-19T06:24:31.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.625+0000 7f7dc87ce740 1 -- 172.21.15.3:0/4127471853 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ddd7ad2a60 con 0x55ddd7ab9590 2024-09-19T06:24:31.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.626+0000 7f7da8c00640 1 -- 172.21.15.3:0/4127471853 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dac004400 con 0x55ddd7ab9590 2024-09-19T06:24:31.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.626+0000 7f7da8c00640 1 -- 172.21.15.3:0/4127471853 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f7dac003bf0 con 0x55ddd7ab9590 2024-09-19T06:24:31.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.626+0000 7f7dc87ce740 10 client.18711 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:24:31.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.626+0000 7f7dc87ce740 10 client.18711 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:24:31.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.626+0000 7f7dc87ce740 20 client.18711 populate_metadata read hostname 'smithi003' 2024-09-19T06:24:31.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.626+0000 7f7dc87ce740 1 --2- 172.21.15.3:0/4127471853 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55ddd7ad3db0 0x55ddd7ad61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.626+0000 7f7dc87ce740 4 client.18711 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:24:31.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.626+0000 7f7dc87ce740 1 -- 172.21.15.3:0/4127471853 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ddd7a2c950 con 0x55ddd7ad3db0 2024-09-19T06:24:31.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.627+0000 7f7dbea00640 1 --2- 172.21.15.3:0/4127471853 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55ddd7ad3db0 0x55ddd7ad61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.627+0000 7f7dbea00640 1 --2- 172.21.15.3:0/4127471853 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55ddd7ad3db0 0x55ddd7ad61a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e23c89825fe0ffc6 server_cookie=301e85ee875c7719 in_seq=0 out_seq=0 2024-09-19T06:24:31.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.627+0000 7f7da8c00640 10 client.18711 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:24:31.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.628+0000 7f7da8c00640 1 -- 172.21.15.3:0/4127471853 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ddd7a2c950 con 0x55ddd7ad3db0 2024-09-19T06:24:31.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.628+0000 7f7da8c00640 10 client.18711 handle_command_reply: tid=0 2024-09-19T06:24:31.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.628+0000 7f7dc87ce740 1 client.18711 shutdown 2024-09-19T06:24:31.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.628+0000 7f7dc87ce740 1 -- 172.21.15.3:0/4127471853 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab9590 msgr2=0x55ddd7ac1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:31.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.628+0000 7f7dc87ce740 1 --2- 172.21.15.3:0/4127471853 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab9590 0x55ddd7ac1280 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f7dac004600 tx=0x7f7dac02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.628+0000 7f7dc87ce740 1 -- 172.21.15.3:0/4127471853 shutdown_connections 2024-09-19T06:24:31.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.628+0000 7f7dc87ce740 1 --2- 172.21.15.3:0/4127471853 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ddd7ac3e50 0x55ddd7ac17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.628+0000 7f7dc87ce740 1 --2- 172.21.15.3:0/4127471853 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55ddd7ad3db0 0x55ddd7ad61a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.628+0000 7f7dc87ce740 1 --2- 172.21.15.3:0/4127471853 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab9590 0x55ddd7ac1280 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.628+0000 7f7dc87ce740 1 --2- 172.21.15.3:0/4127471853 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ddd7ab8c70 0x55ddd7ac0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.628+0000 7f7da8c00640 0 client.18711 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:24:31.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.628+0000 7f7dc87ce740 1 -- 172.21.15.3:0/4127471853 >> 172.21.15.3:0/4127471853 conn(0x55ddd7ab5200 msgr2=0x55ddd7abaf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:31.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.628+0000 7f7dc87ce740 1 -- 172.21.15.3:0/4127471853 shutdown_connections 2024-09-19T06:24:31.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.628+0000 7f7dc87ce740 1 -- 172.21.15.3:0/4127471853 wait complete. 2024-09-19T06:24:31.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.628+0000 7f7dc87ce740 20 client.18711 trim_cache size 0 max 16384 2024-09-19T06:24:31.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.642+0000 7f7dc87ce740 1 Processor -- start 2024-09-19T06:24:31.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.642+0000 7f7dc87ce740 1 -- start start 2024-09-19T06:24:31.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.642+0000 7f7dc87ce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ddd7ab8c70 0x55ddd7abdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.642+0000 7f7dc87ce740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab9590 0x55ddd7abe500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.643+0000 7f7dc87ce740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ddd7ac3e50 0x55ddd7aba710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.643+0000 7f7dc87ce740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc01afb70 con 0x55ddd7ab9590 2024-09-19T06:24:31.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.643+0000 7f7dc87ce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc01b16b0 con 0x55ddd7ab8c70 2024-09-19T06:24:31.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.643+0000 7f7dc87ce740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc01b0240 con 0x55ddd7ac3e50 2024-09-19T06:24:31.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.643+0000 7f7dbe000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab9590 0x55ddd7abe500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.643+0000 7f7dbe000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab9590 0x55ddd7abe500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45150/0 (socket says 172.21.15.3:45150) 2024-09-19T06:24:31.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.643+0000 7f7dbe000640 1 -- 172.21.15.3:0/1348165458 learned_addr learned my addr 172.21.15.3:0/1348165458 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:31.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.643+0000 7f7dbea00640 1 --2- 172.21.15.3:0/1348165458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ddd7ab8c70 0x55ddd7abdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.643+0000 7f7dbf400640 1 --2- 172.21.15.3:0/1348165458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ddd7ac3e50 0x55ddd7aba710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.643+0000 7f7dbe000640 1 -- 172.21.15.3:0/1348165458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ddd7ac3e50 msgr2=0x55ddd7aba710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:31.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.643+0000 7f7dbe000640 1 --2- 172.21.15.3:0/1348165458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ddd7ac3e50 0x55ddd7aba710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.643+0000 7f7dbe000640 1 -- 172.21.15.3:0/1348165458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ddd7ab8c70 msgr2=0x55ddd7abdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:31.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.643+0000 7f7dbe000640 1 --2- 172.21.15.3:0/1348165458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ddd7ab8c70 0x55ddd7abdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.643+0000 7f7dbe000640 1 -- 172.21.15.3:0/1348165458 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddd7ac36b0 con 0x55ddd7ab9590 2024-09-19T06:24:31.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.644+0000 7f7dbe000640 1 --2- 172.21.15.3:0/1348165458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab9590 0x55ddd7abe500 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f7dac004010 tx=0x7f7dac005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04ba3818a8c4024 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:31.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.644+0000 7f7dab400640 1 -- 172.21.15.3:0/1348165458 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dac035040 con 0x55ddd7ab9590 2024-09-19T06:24:31.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.644+0000 7f7dab400640 1 -- 172.21.15.3:0/1348165458 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dac0048d0 con 0x55ddd7ab9590 2024-09-19T06:24:31.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.644+0000 7f7dab400640 1 -- 172.21.15.3:0/1348165458 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dac0053e0 con 0x55ddd7ab9590 2024-09-19T06:24:31.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.644+0000 7f7dc87ce740 1 -- 172.21.15.3:0/1348165458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab9590 msgr2=0x55ddd7abe500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:31.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.644+0000 7f7dc87ce740 1 --2- 172.21.15.3:0/1348165458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab9590 0x55ddd7abe500 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f7dac004010 tx=0x7f7dac005bd0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.645+0000 7f7dc87ce740 1 -- 172.21.15.3:0/1348165458 shutdown_connections 2024-09-19T06:24:31.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.645+0000 7f7dc87ce740 1 --2- 172.21.15.3:0/1348165458 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ddd7ac3e50 0x55ddd7aba710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.645+0000 7f7dc87ce740 1 --2- 172.21.15.3:0/1348165458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab9590 0x55ddd7abe500 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.648 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.645+0000 7f7dc87ce740 1 --2- 172.21.15.3:0/1348165458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ddd7ab8c70 0x55ddd7abdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.645+0000 7f7dc87ce740 1 -- 172.21.15.3:0/1348165458 >> 172.21.15.3:0/1348165458 conn(0x55ddd7ab5200 msgr2=0x55ddd7abfe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:31.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.645+0000 7f7dc87ce740 1 -- 172.21.15.3:0/1348165458 shutdown_connections 2024-09-19T06:24:31.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.645+0000 7f7dc87ce740 1 -- 172.21.15.3:0/1348165458 wait complete. 2024-09-19T06:24:31.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.645+0000 7f7dc87ce740 1 -- start start 2024-09-19T06:24:31.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.645+0000 7f7dc87ce740 1 Processor -- start 2024-09-19T06:24:31.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.646+0000 7f7dc87ce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ddd7ab8c70 0x55ddd7ad99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.646+0000 7f7dc87ce740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab9590 0x55ddd7ad6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.646+0000 7f7dc87ce740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ddd7ac3e50 0x55ddd7ad72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.646+0000 7f7dc87ce740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc01b0fe0 con 0x55ddd7ab9590 2024-09-19T06:24:31.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.646+0000 7f7dc87ce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc01b0910 con 0x55ddd7ab8c70 2024-09-19T06:24:31.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.646+0000 7f7dc87ce740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc01adb70 con 0x55ddd7ac3e50 2024-09-19T06:24:31.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.646+0000 7f7dc87ce740 10 client.0 _ll_register_callbacks cb 0x7f7db80099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:31.649 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.646+0000 7f7dbe000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab9590 0x55ddd7ad6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.646+0000 7f7dbe000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab9590 0x55ddd7ad6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45166/0 (socket says 172.21.15.3:45166) 2024-09-19T06:24:31.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.646+0000 7f7dbe000640 1 -- 172.21.15.3:0/1472808775 learned_addr learned my addr 172.21.15.3:0/1472808775 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:31.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.646+0000 7f7dbea00640 1 --2- 172.21.15.3:0/1472808775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ddd7ab8c70 0x55ddd7ad99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.650 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.646+0000 7f7dbf400640 1 --2- 172.21.15.3:0/1472808775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ddd7ac3e50 0x55ddd7ad72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.647+0000 7f7dbe000640 1 -- 172.21.15.3:0/1472808775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ddd7ac3e50 msgr2=0x55ddd7ad72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.647+0000 7f7dbe000640 1 --2- 172.21.15.3:0/1472808775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ddd7ac3e50 0x55ddd7ad72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.647+0000 7f7dbe000640 1 -- 172.21.15.3:0/1472808775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ddd7ab8c70 msgr2=0x55ddd7ad99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.647+0000 7f7dbe000640 1 --2- 172.21.15.3:0/1472808775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ddd7ab8c70 0x55ddd7ad99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.647+0000 7f7dbe000640 1 -- 172.21.15.3:0/1472808775 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddd7ad7ae0 con 0x55ddd7ab9590 2024-09-19T06:24:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.647+0000 7f7dbea00640 1 --2- 172.21.15.3:0/1472808775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ddd7ab8c70 0x55ddd7ad99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.647+0000 7f7dbe000640 1 --2- 172.21.15.3:0/1472808775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab9590 0x55ddd7ad6d50 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f7dac031550 tx=0x7f7dac031910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9f46257af1310e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.647+0000 7f7da8c00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:24:31.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.647+0000 7f7da8c00640 1 -- 172.21.15.3:0/1472808775 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dac063060 con 0x55ddd7ab9590 2024-09-19T06:24:31.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.647+0000 7f7dc87ce740 1 -- 172.21.15.3:0/1472808775 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dac0048d0 con 0x55ddd7ab9590 2024-09-19T06:24:31.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.647+0000 7f7da8c00640 1 -- 172.21.15.3:0/1472808775 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7f7dac031b20 con 0x55ddd7ab9590 2024-09-19T06:24:31.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.648+0000 7f7da8c00640 1 -- 172.21.15.3:0/1472808775 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7dac035040 con 0x55ddd7ab9590 2024-09-19T06:24:31.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.648+0000 7f7dc87ce740 10 client.18717 fetch_fsmap learned FSMap version 29 2024-09-19T06:24:31.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.648+0000 7f7dc87ce740 1 -- 172.21.15.3:0/1472808775 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ddd7b3e780 con 0x55ddd7ab9590 2024-09-19T06:24:31.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.648+0000 7f7da8c00640 1 -- 172.21.15.3:0/1472808775 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dac0048d0 con 0x55ddd7ab9590 2024-09-19T06:24:31.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.648+0000 7f7da8c00640 1 -- 172.21.15.3:0/1472808775 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f7dac003780 con 0x55ddd7ab9590 2024-09-19T06:24:31.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.648+0000 7f7dc87ce740 10 client.18717 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:24:31.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.648+0000 7f7dc87ce740 10 client.18717 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-19T06:24:31.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.648+0000 7f7dc87ce740 20 client.18717 populate_metadata read hostname 'smithi003' 2024-09-19T06:24:31.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.648+0000 7f7dc87ce740 1 --2- 172.21.15.3:0/1472808775 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55ddd7b3ed30 0x55ddd7b41150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:31.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.648+0000 7f7dc87ce740 4 client.18717 mds_command: new command op to 24514 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:24:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.648+0000 7f7dc87ce740 1 -- 172.21.15.3:0/1472808775 --> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ddd7a26e60 con 0x55ddd7b3ed30 2024-09-19T06:24:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.648+0000 7f7dbea00640 1 --2- 172.21.15.3:0/1472808775 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55ddd7b3ed30 0x55ddd7b41150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.649+0000 7f7dbea00640 1 --2- 172.21.15.3:0/1472808775 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55ddd7b3ed30 0x55ddd7b41150 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=dd82392faaeb8b94 server_cookie=fe6ce30dc3ada329 in_seq=0 out_seq=0 2024-09-19T06:24:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.649+0000 7f7da8c00640 10 client.18717 ms_handle_connect on v2:172.21.15.71:6836/886513714 2024-09-19T06:24:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.649+0000 7f7da8c00640 1 -- 172.21.15.3:0/1472808775 <== mds.3 v2:172.21.15.71:6836/886513714 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ddd7a26e60 con 0x55ddd7b3ed30 2024-09-19T06:24:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.649+0000 7f7da8c00640 10 client.18717 handle_command_reply: tid=0 2024-09-19T06:24:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.649+0000 7f7dc87ce740 1 client.18717 shutdown 2024-09-19T06:24:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.649+0000 7f7dc87ce740 1 -- 172.21.15.3:0/1472808775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab9590 msgr2=0x55ddd7ad6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.649+0000 7f7dc87ce740 1 --2- 172.21.15.3:0/1472808775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab9590 0x55ddd7ad6d50 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f7dac031550 tx=0x7f7dac031910 comp rx=0 tx=0).stop 2024-09-19T06:24:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.649+0000 7f7dc87ce740 1 -- 172.21.15.3:0/1472808775 shutdown_connections 2024-09-19T06:24:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.649+0000 7f7dc87ce740 1 --2- 172.21.15.3:0/1472808775 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x55ddd7ac3e50 0x55ddd7ad72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.649+0000 7f7dc87ce740 1 --2- 172.21.15.3:0/1472808775 >> [v2:172.21.15.71:6836/886513714,v1:172.21.15.71:6837/886513714] conn(0x55ddd7b3ed30 0x55ddd7b41150 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.649+0000 7f7dc87ce740 1 --2- 172.21.15.3:0/1472808775 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x55ddd7ab9590 0x55ddd7ad6d50 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.649+0000 7f7dc87ce740 1 --2- 172.21.15.3:0/1472808775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ddd7ab8c70 0x55ddd7ad99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.649+0000 7f7dc87ce740 1 -- 172.21.15.3:0/1472808775 >> 172.21.15.3:0/1472808775 conn(0x55ddd7ab5200 msgr2=0x55ddd7ac0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:31.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.650+0000 7f7da8c00640 0 client.18717 ms_handle_reset on v2:172.21.15.71:6836/886513714 2024-09-19T06:24:31.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.650+0000 7f7dc87ce740 1 -- 172.21.15.3:0/1472808775 shutdown_connections 2024-09-19T06:24:31.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.650+0000 7f7dc87ce740 1 -- 172.21.15.3:0/1472808775 wait complete. 2024-09-19T06:24:31.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.650+0000 7f7dc87ce740 20 client.18717 trim_cache size 0 max 16384 2024-09-19T06:24:31.655 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:24:31.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.650+0000 7f7dc5e00640 1 -- 172.21.15.3:0/3272439400 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7da40a33b0 msgr2=0x7f7da40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:31.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.650+0000 7f7dc5e00640 1 --2- 172.21.15.3:0/3272439400 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7da40a33b0 0x7f7da40a5870 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7db8005fd0 tx=0x7f7db8009500 comp rx=0 tx=0).stop 2024-09-19T06:24:31.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.650+0000 7f7dc5e00640 1 -- 172.21.15.3:0/3272439400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dc0103ff0 msgr2=0x7f7dc019a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:31.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.650+0000 7f7dc5e00640 1 --2- 172.21.15.3:0/3272439400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dc0103ff0 0x7f7dc019a610 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7db000e9f0 tx=0x7f7db000edf0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.651+0000 7f7dc5e00640 1 -- 172.21.15.3:0/3272439400 shutdown_connections 2024-09-19T06:24:31.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.651+0000 7f7dc5e00640 1 --2- 172.21.15.3:0/3272439400 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f7da40a33b0 0x7f7da40a5870 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.656 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.651+0000 7f7dc5e00640 1 --2- 172.21.15.3:0/3272439400 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f7dc0109120 0x7f7dc019eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.651+0000 7f7dc5e00640 1 --2- 172.21.15.3:0/3272439400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7dc01049a0 0x7f7dc019ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.651+0000 7f7dc5e00640 1 --2- 172.21.15.3:0/3272439400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dc0103ff0 0x7f7dc019a610 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:31.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.651+0000 7f7dc5e00640 1 -- 172.21.15.3:0/3272439400 >> 172.21.15.3:0/3272439400 conn(0x7f7dc00ffa90 msgr2=0x7f7dc0100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:31.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.651+0000 7f7dc5e00640 1 -- 172.21.15.3:0/3272439400 shutdown_connections 2024-09-19T06:24:31.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:31.651+0000 7f7dc5e00640 1 -- 172.21.15.3:0/3272439400 wait complete. 2024-09-19T06:24:32.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:31 smithi059 ceph-mon[35138]: pgmap v379: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-19T06:24:32.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:31 smithi003 ceph-mon[30893]: pgmap v379: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-19T06:24:32.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:31 smithi071 ceph-mon[35662]: pgmap v379: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-19T06:24:32.542 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T06:24:32.923 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:33.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.505+0000 7fb21be00640 1 -- 172.21.15.3:0/3635768680 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb214109120 msgr2=0x7fb214110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:33.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.505+0000 7fb21be00640 1 --2- 172.21.15.3:0/3635768680 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb214109120 0x7fb214110ca0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009ca0 tx=0x7fb20c02a8c0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.505+0000 7fb21be00640 1 -- 172.21.15.3:0/3635768680 shutdown_connections 2024-09-19T06:24:33.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.505+0000 7fb21be00640 1 --2- 172.21.15.3:0/3635768680 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb214109120 0x7fb214110ca0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.505+0000 7fb21be00640 1 --2- 172.21.15.3:0/3635768680 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb2141049a0 0x7fb2141089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.505+0000 7fb21be00640 1 --2- 172.21.15.3:0/3635768680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb214103ff0 0x7fb2141043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.505+0000 7fb21be00640 1 -- 172.21.15.3:0/3635768680 >> 172.21.15.3:0/3635768680 conn(0x7fb2140ffa90 msgr2=0x7fb214101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:33.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.505+0000 7fb21be00640 1 -- 172.21.15.3:0/3635768680 shutdown_connections 2024-09-19T06:24:33.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.505+0000 7fb21be00640 1 -- 172.21.15.3:0/3635768680 wait complete. 2024-09-19T06:24:33.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.506+0000 7fb21be00640 1 Processor -- start 2024-09-19T06:24:33.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.506+0000 7fb21be00640 1 -- start start 2024-09-19T06:24:33.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.507+0000 7fb21be00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb214103ff0 0x7fb21419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:33.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.507+0000 7fb21be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2141049a0 0x7fb21419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:33.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.507+0000 7fb21be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb214109120 0x7fb21419ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:33.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.507+0000 7fb21be00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb214114150 con 0x7fb214109120 2024-09-19T06:24:33.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.507+0000 7fb21be00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb214113fd0 con 0x7fb2141049a0 2024-09-19T06:24:33.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.507+0000 7fb21be00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb2141142d0 con 0x7fb214103ff0 2024-09-19T06:24:33.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.507+0000 7fb219e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb214109120 0x7fb21419ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:33.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.507+0000 7fb219400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb214103ff0 0x7fb21419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:33.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.507+0000 7fb218a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2141049a0 0x7fb21419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:33.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.507+0000 7fb219400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb214103ff0 0x7fb21419a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:49868/0 (socket says 172.21.15.3:49868) 2024-09-19T06:24:33.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.507+0000 7fb219400640 1 -- 172.21.15.3:0/3411864914 learned_addr learned my addr 172.21.15.3:0/3411864914 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:33.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.507+0000 7fb219e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb214109120 0x7fb21419ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45186/0 (socket says 172.21.15.3:45186) 2024-09-19T06:24:33.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.507+0000 7fb218a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2141049a0 0x7fb21419aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:56110/0 (socket says 172.21.15.3:56110) 2024-09-19T06:24:33.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.508+0000 7fb219400640 1 -- 172.21.15.3:0/3411864914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2141049a0 msgr2=0x7fb21419aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:33.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.508+0000 7fb219400640 1 --2- 172.21.15.3:0/3411864914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2141049a0 0x7fb21419aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.508+0000 7fb219400640 1 -- 172.21.15.3:0/3411864914 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb214109120 msgr2=0x7fb21419ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:33.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.508+0000 7fb219400640 1 --2- 172.21.15.3:0/3411864914 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb214109120 0x7fb21419ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.508+0000 7fb219400640 1 -- 172.21.15.3:0/3411864914 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21419f560 con 0x7fb214103ff0 2024-09-19T06:24:33.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.508+0000 7fb219400640 1 --2- 172.21.15.3:0/3411864914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb214103ff0 0x7fb21419a5b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb20800e9f0 tx=0x7fb20800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:33.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.508+0000 7fb212000640 1 -- 172.21.15.3:0/3411864914 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20800cd80 con 0x7fb214103ff0 2024-09-19T06:24:33.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.508+0000 7fb212000640 1 -- 172.21.15.3:0/3411864914 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb208010910 con 0x7fb214103ff0 2024-09-19T06:24:33.511 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.508+0000 7fb212000640 1 -- 172.21.15.3:0/3411864914 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb208018990 con 0x7fb214103ff0 2024-09-19T06:24:33.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.508+0000 7fb21be00640 1 -- 172.21.15.3:0/3411864914 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb21419f850 con 0x7fb214103ff0 2024-09-19T06:24:33.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.508+0000 7fb21be00640 1 -- 172.21.15.3:0/3411864914 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2141a7130 con 0x7fb214103ff0 2024-09-19T06:24:33.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.511+0000 7fb21e7fe740 1 Processor -- start 2024-09-19T06:24:33.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.512+0000 7fb21e7fe740 1 -- start start 2024-09-19T06:24:33.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.512+0000 7fb212000640 1 -- 172.21.15.3:0/3411864914 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fb208010ac0 con 0x7fb214103ff0 2024-09-19T06:24:33.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.512+0000 7fb21e7fe740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510212c70 0x560510213050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:33.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.512+0000 7fb21e7fe740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510213590 0x56051021d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:33.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.512+0000 7fb21e7fe740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56051021de50 0x560510220240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:33.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.512+0000 7fb21e7fe740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5605101793e0 con 0x560510213590 2024-09-19T06:24:33.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.512+0000 7fb21e7fe740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x560510120d80 con 0x56051021de50 2024-09-19T06:24:33.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.512+0000 7fb21e7fe740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5605101753a0 con 0x560510212c70 2024-09-19T06:24:33.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.513+0000 7fb219400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510213590 0x56051021d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:33.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.513+0000 7fb219e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510212c70 0x560510213050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:33.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.513+0000 7fb219e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510212c70 0x560510213050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:49870/0 (socket says 172.21.15.3:49870) 2024-09-19T06:24:33.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.513+0000 7fb218a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56051021de50 0x560510220240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:33.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.513+0000 7fb219e00640 1 -- 172.21.15.3:0/1775158934 learned_addr learned my addr 172.21.15.3:0/1775158934 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:33.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.513+0000 7fb219e00640 1 -- 172.21.15.3:0/1775158934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56051021de50 msgr2=0x560510220240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:33.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.513+0000 7fb219e00640 1 --2- 172.21.15.3:0/1775158934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56051021de50 0x560510220240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.513+0000 7fb219e00640 1 -- 172.21.15.3:0/1775158934 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510213590 msgr2=0x56051021d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:33.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.513+0000 7fb219e00640 1 --2- 172.21.15.3:0/1775158934 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510213590 0x56051021d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.513+0000 7fb219e00640 1 -- 172.21.15.3:0/1775158934 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56051013fae0 con 0x560510212c70 2024-09-19T06:24:33.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.513+0000 7fb219e00640 1 --2- 172.21.15.3:0/1775158934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510212c70 0x560510213050 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009ca0 tx=0x7fb20c005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=794d10837fbbd52e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:33.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.514+0000 7fb206600640 1 -- 172.21.15.3:0/1775158934 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c031db0 con 0x560510212c70 2024-09-19T06:24:33.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.514+0000 7fb212000640 1 --2- 172.21.15.3:0/3411864914 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb1fc0a33b0 0x7fb1fc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:33.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.514+0000 7fb206600640 1 -- 172.21.15.3:0/1775158934 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb20c036040 con 0x560510212c70 2024-09-19T06:24:33.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.514+0000 7fb206600640 1 -- 172.21.15.3:0/1775158934 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c0042a0 con 0x560510212c70 2024-09-19T06:24:33.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.514+0000 7fb212000640 1 -- 172.21.15.3:0/3411864914 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7fb2080d00c0 con 0x7fb214103ff0 2024-09-19T06:24:33.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.514+0000 7fb219400640 1 --2- 172.21.15.3:0/3411864914 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb1fc0a33b0 0x7fb1fc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:33.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.514+0000 7fb21e7fe740 1 -- 172.21.15.3:0/1775158934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510212c70 msgr2=0x560510213050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:33.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.514+0000 7fb21e7fe740 1 --2- 172.21.15.3:0/1775158934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510212c70 0x560510213050 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009ca0 tx=0x7fb20c005f10 comp rx=0 tx=0).stop 2024-09-19T06:24:33.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.515+0000 7fb219400640 1 --2- 172.21.15.3:0/3411864914 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb1fc0a33b0 0x7fb1fc0a5870 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x560510210060 tx=0x7fb2080d3b70 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:33.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.515+0000 7fb21e7fe740 1 -- 172.21.15.3:0/1775158934 shutdown_connections 2024-09-19T06:24:33.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.515+0000 7fb21e7fe740 1 --2- 172.21.15.3:0/1775158934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56051021de50 0x560510220240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.515+0000 7fb21e7fe740 1 --2- 172.21.15.3:0/1775158934 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510213590 0x56051021d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.515+0000 7fb21e7fe740 1 --2- 172.21.15.3:0/1775158934 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510212c70 0x560510213050 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.515+0000 7fb21e7fe740 1 -- 172.21.15.3:0/1775158934 >> 172.21.15.3:0/1775158934 conn(0x56051020f200 msgr2=0x56051020f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:33.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.515+0000 7fb21e7fe740 1 -- 172.21.15.3:0/1775158934 shutdown_connections 2024-09-19T06:24:33.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.515+0000 7fb21e7fe740 1 -- 172.21.15.3:0/1775158934 wait complete. 2024-09-19T06:24:33.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.515+0000 7fb21e7fe740 1 -- start start 2024-09-19T06:24:33.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.515+0000 7fb21e7fe740 1 Processor -- start 2024-09-19T06:24:33.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.516+0000 7fb21e7fe740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510212c70 0x56051021acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:33.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.516+0000 7fb21e7fe740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510213590 0x56051021b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:33.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.516+0000 7fb21e7fe740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56051021de50 0x56051021b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:33.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.516+0000 7fb21e7fe740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5605102208a0 con 0x560510212c70 2024-09-19T06:24:33.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.516+0000 7fb21e7fe740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5605101340f0 con 0x56051021de50 2024-09-19T06:24:33.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.516+0000 7fb21e7fe740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x560510220a20 con 0x560510213590 2024-09-19T06:24:33.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.516+0000 7fb21e7fe740 10 client.0 _ll_register_callbacks cb 0x56051011bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:33.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.516+0000 7fb219e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510212c70 0x56051021acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:33.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.516+0000 7fb219e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510212c70 0x56051021acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45210/0 (socket says 172.21.15.3:45210) 2024-09-19T06:24:33.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.516+0000 7fb218a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510213590 0x56051021b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:33.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.516+0000 7fb219e00640 1 -- 172.21.15.3:0/238631995 learned_addr learned my addr 172.21.15.3:0/238631995 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:33.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.516+0000 7fb219e00640 1 --2- 172.21.15.3:0/238631995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56051021de50 0x56051021b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:33.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.517+0000 7fb219e00640 1 -- 172.21.15.3:0/238631995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510213590 msgr2=0x56051021b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:33.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.517+0000 7fb219e00640 1 --2- 172.21.15.3:0/238631995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510213590 0x56051021b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.517+0000 7fb219e00640 1 -- 172.21.15.3:0/238631995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56051021de50 msgr2=0x56051021b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:33.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.517+0000 7fb219e00640 1 --2- 172.21.15.3:0/238631995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56051021de50 0x56051021b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.517+0000 7fb219e00640 1 -- 172.21.15.3:0/238631995 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56050feea3c0 con 0x560510212c70 2024-09-19T06:24:33.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.517+0000 7fb218a00640 1 --2- 172.21.15.3:0/238631995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510213590 0x56051021b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:33.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.517+0000 7fb219e00640 1 --2- 172.21.15.3:0/238631995 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510212c70 0x56051021acf0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb20c031b50 tx=0x7fb20c031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eacc293c5821a3f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:33.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.517+0000 7fb1faa00640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:24:33.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.517+0000 7fb1faa00640 1 -- 172.21.15.3:0/238631995 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c057060 con 0x560510212c70 2024-09-19T06:24:33.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.517+0000 7fb21e7fe740 1 -- 172.21.15.3:0/238631995 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb20c036040 con 0x560510212c70 2024-09-19T06:24:33.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.517+0000 7fb1faa00640 1 -- 172.21.15.3:0/238631995 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7fb20c02fa20 con 0x560510212c70 2024-09-19T06:24:33.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.518+0000 7fb1faa00640 1 -- 172.21.15.3:0/238631995 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb20c04a040 con 0x560510212c70 2024-09-19T06:24:33.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.518+0000 7fb21e7fe740 10 client.18729 fetch_fsmap learned FSMap version 29 2024-09-19T06:24:33.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.518+0000 7fb21e7fe740 1 -- 172.21.15.3:0/238631995 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5605102208a0 con 0x560510212c70 2024-09-19T06:24:33.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.518+0000 7fb1faa00640 1 -- 172.21.15.3:0/238631995 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb20c036040 con 0x560510212c70 2024-09-19T06:24:33.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.518+0000 7fb1faa00640 1 -- 172.21.15.3:0/238631995 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb20c050040 con 0x560510212c70 2024-09-19T06:24:33.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.518+0000 7fb21e7fe740 10 client.18729 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:24:33.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.518+0000 7fb21e7fe740 10 client.18729 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:24:33.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.518+0000 7fb21e7fe740 20 client.18729 populate_metadata read hostname 'smithi003' 2024-09-19T06:24:33.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.518+0000 7fb21e7fe740 1 --2- 172.21.15.3:0/238631995 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x56051022da10 0x56051022fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:33.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.518+0000 7fb21e7fe740 4 client.18729 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:24:33.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.518+0000 7fb21e7fe740 1 -- 172.21.15.3:0/238631995 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560510186950 con 0x56051022da10 2024-09-19T06:24:33.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.519+0000 7fb218a00640 1 --2- 172.21.15.3:0/238631995 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x56051022da10 0x56051022fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:33.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.519+0000 7fb218a00640 1 --2- 172.21.15.3:0/238631995 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x56051022da10 0x56051022fe00 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b62bc1800cad370d server_cookie=cc621152c3399b7b in_seq=0 out_seq=0 2024-09-19T06:24:33.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.519+0000 7fb1faa00640 10 client.18729 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:24:33.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.520+0000 7fb1faa00640 1 -- 172.21.15.3:0/238631995 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560510186950 con 0x56051022da10 2024-09-19T06:24:33.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.520+0000 7fb1faa00640 10 client.18729 handle_command_reply: tid=0 2024-09-19T06:24:33.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.520+0000 7fb21e7fe740 1 client.18729 shutdown 2024-09-19T06:24:33.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.520+0000 7fb21e7fe740 1 -- 172.21.15.3:0/238631995 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510212c70 msgr2=0x56051021acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:33.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.520+0000 7fb21e7fe740 1 --2- 172.21.15.3:0/238631995 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510212c70 0x56051021acf0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb20c031b50 tx=0x7fb20c031a10 comp rx=0 tx=0).stop 2024-09-19T06:24:33.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.521+0000 7fb21e7fe740 1 -- 172.21.15.3:0/238631995 shutdown_connections 2024-09-19T06:24:33.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.521+0000 7fb21e7fe740 1 --2- 172.21.15.3:0/238631995 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x56051022da10 0x56051022fe00 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.521+0000 7fb21e7fe740 1 --2- 172.21.15.3:0/238631995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56051021de50 0x56051021b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.521+0000 7fb1faa00640 0 client.18729 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:24:33.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.521+0000 7fb21e7fe740 1 --2- 172.21.15.3:0/238631995 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510213590 0x56051021b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.521+0000 7fb21e7fe740 1 --2- 172.21.15.3:0/238631995 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510212c70 0x56051021acf0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.521+0000 7fb21e7fe740 1 -- 172.21.15.3:0/238631995 >> 172.21.15.3:0/238631995 conn(0x56051020f200 msgr2=0x56051020e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:33.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.521+0000 7fb21e7fe740 1 -- 172.21.15.3:0/238631995 shutdown_connections 2024-09-19T06:24:33.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.521+0000 7fb21e7fe740 1 -- 172.21.15.3:0/238631995 wait complete. 2024-09-19T06:24:33.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.521+0000 7fb21e7fe740 20 client.18729 trim_cache size 0 max 16384 2024-09-19T06:24:33.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.535+0000 7fb21e7fe740 1 Processor -- start 2024-09-19T06:24:33.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.535+0000 7fb21e7fe740 1 -- start start 2024-09-19T06:24:33.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.535+0000 7fb21e7fe740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510212c70 0x560510214dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:33.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.536+0000 7fb21e7fe740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510213590 0x560510235680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:33.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.536+0000 7fb21e7fe740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56051021de50 0x560510235bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:33.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.536+0000 7fb21e7fe740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb2141afad0 con 0x560510212c70 2024-09-19T06:24:33.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.536+0000 7fb21e7fe740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb2141b1610 con 0x56051021de50 2024-09-19T06:24:33.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.536+0000 7fb21e7fe740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb2141b01a0 con 0x560510213590 2024-09-19T06:24:33.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.536+0000 7fb219e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510212c70 0x560510214dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:33.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.536+0000 7fb219e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510212c70 0x560510214dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45212/0 (socket says 172.21.15.3:45212) 2024-09-19T06:24:33.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.536+0000 7fb219e00640 1 -- 172.21.15.3:0/3629230078 learned_addr learned my addr 172.21.15.3:0/3629230078 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:33.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.536+0000 7fb218a00640 1 --2- 172.21.15.3:0/3629230078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510213590 0x560510235680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:33.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.536+0000 7fb219e00640 1 --2- 172.21.15.3:0/3629230078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56051021de50 0x560510235bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:33.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.536+0000 7fb219e00640 1 -- 172.21.15.3:0/3629230078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510213590 msgr2=0x560510235680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:33.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.536+0000 7fb219e00640 1 --2- 172.21.15.3:0/3629230078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510213590 0x560510235680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.536+0000 7fb219e00640 1 -- 172.21.15.3:0/3629230078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56051021de50 msgr2=0x560510235bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:33.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.536+0000 7fb219e00640 1 --2- 172.21.15.3:0/3629230078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56051021de50 0x560510235bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.536+0000 7fb219e00640 1 -- 172.21.15.3:0/3629230078 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605102133c0 con 0x560510212c70 2024-09-19T06:24:33.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.536+0000 7fb218a00640 1 --2- 172.21.15.3:0/3629230078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510213590 0x560510235680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:33.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.537+0000 7fb219e00640 1 --2- 172.21.15.3:0/3629230078 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510212c70 0x560510214dd0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fb20c031b20 tx=0x7fb20c004a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d97ab77ca97b159 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:33.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.537+0000 7fb205c00640 1 -- 172.21.15.3:0/3629230078 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c057030 con 0x560510212c70 2024-09-19T06:24:33.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.537+0000 7fb205c00640 1 -- 172.21.15.3:0/3629230078 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb20c036070 con 0x560510212c70 2024-09-19T06:24:33.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.537+0000 7fb205c00640 1 -- 172.21.15.3:0/3629230078 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c02fa80 con 0x560510212c70 2024-09-19T06:24:33.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.537+0000 7fb21e7fe740 1 -- 172.21.15.3:0/3629230078 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510212c70 msgr2=0x560510214dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:33.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.538+0000 7fb21e7fe740 1 --2- 172.21.15.3:0/3629230078 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510212c70 0x560510214dd0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fb20c031b20 tx=0x7fb20c004a80 comp rx=0 tx=0).stop 2024-09-19T06:24:33.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.538+0000 7fb21e7fe740 1 -- 172.21.15.3:0/3629230078 shutdown_connections 2024-09-19T06:24:33.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.538+0000 7fb21e7fe740 1 --2- 172.21.15.3:0/3629230078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56051021de50 0x560510235bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.538+0000 7fb21e7fe740 1 --2- 172.21.15.3:0/3629230078 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510213590 0x560510235680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.538+0000 7fb21e7fe740 1 --2- 172.21.15.3:0/3629230078 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510212c70 0x560510214dd0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.538+0000 7fb21e7fe740 1 -- 172.21.15.3:0/3629230078 >> 172.21.15.3:0/3629230078 conn(0x56051020f200 msgr2=0x5605102146c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:33.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.538+0000 7fb21e7fe740 1 -- 172.21.15.3:0/3629230078 shutdown_connections 2024-09-19T06:24:33.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.538+0000 7fb21e7fe740 1 -- 172.21.15.3:0/3629230078 wait complete. 2024-09-19T06:24:33.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.538+0000 7fb21e7fe740 1 -- start start 2024-09-19T06:24:33.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.538+0000 7fb21e7fe740 1 Processor -- start 2024-09-19T06:24:33.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.539+0000 7fb21e7fe740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510212c70 0x5605102218e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:33.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.539+0000 7fb21e7fe740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510213590 0x560510221e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:33.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.539+0000 7fb21e7fe740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56051021de50 0x560510222360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:33.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.539+0000 7fb21e7fe740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb2141b0f40 con 0x560510212c70 2024-09-19T06:24:33.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.539+0000 7fb21e7fe740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb2141b0870 con 0x56051021de50 2024-09-19T06:24:33.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.539+0000 7fb21e7fe740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb2141adad0 con 0x560510213590 2024-09-19T06:24:33.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.539+0000 7fb21e7fe740 10 client.0 _ll_register_callbacks cb 0x7fb2080d3a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:33.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.539+0000 7fb219e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510212c70 0x5605102218e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:33.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.539+0000 7fb219e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510212c70 0x5605102218e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45226/0 (socket says 172.21.15.3:45226) 2024-09-19T06:24:33.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.539+0000 7fb219e00640 1 -- 172.21.15.3:0/2925416040 learned_addr learned my addr 172.21.15.3:0/2925416040 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:33.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.539+0000 7fb218a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510213590 0x560510221e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:33.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.539+0000 7fb219e00640 1 --2- 172.21.15.3:0/2925416040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56051021de50 0x560510222360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:33.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.540+0000 7fb218a00640 1 -- 172.21.15.3:0/2925416040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56051021de50 msgr2=0x560510222360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:33.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.540+0000 7fb218a00640 1 --2- 172.21.15.3:0/2925416040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56051021de50 0x560510222360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.540+0000 7fb218a00640 1 -- 172.21.15.3:0/2925416040 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510212c70 msgr2=0x5605102218e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:33.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.540+0000 7fb218a00640 1 --2- 172.21.15.3:0/2925416040 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510212c70 0x5605102218e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.540+0000 7fb218a00640 1 -- 172.21.15.3:0/2925416040 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560510297650 con 0x560510213590 2024-09-19T06:24:33.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.540+0000 7fb218a00640 1 --2- 172.21.15.3:0/2925416040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510213590 0x560510221e20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x56051021c2a0 tx=0x7fb200012d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfddce9cf6dae261 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:33.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.540+0000 7fb1faa00640 10 client.0 ms_handle_connect on v2:172.21.15.71:3300/0 2024-09-19T06:24:33.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.540+0000 7fb1faa00640 1 -- 172.21.15.3:0/2925416040 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb200004230 con 0x560510213590 2024-09-19T06:24:33.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.540+0000 7fb21e7fe740 1 -- 172.21.15.3:0/2925416040 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb20c036070 con 0x560510213590 2024-09-19T06:24:33.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.540+0000 7fb1faa00640 1 -- 172.21.15.3:0/2925416040 <== mon.1 v2:172.21.15.71:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7fb2000043d0 con 0x560510213590 2024-09-19T06:24:33.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.540+0000 7fb1faa00640 1 -- 172.21.15.3:0/2925416040 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb200005020 con 0x560510213590 2024-09-19T06:24:33.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.540+0000 7fb21e7fe740 10 client.28741 fetch_fsmap learned FSMap version 29 2024-09-19T06:24:33.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.540+0000 7fb21e7fe740 1 -- 172.21.15.3:0/2925416040 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560510298900 con 0x560510213590 2024-09-19T06:24:33.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.541+0000 7fb1faa00640 1 -- 172.21.15.3:0/2925416040 <== mon.1 v2:172.21.15.71:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb20c036070 con 0x560510213590 2024-09-19T06:24:33.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.541+0000 7fb1faa00640 1 -- 172.21.15.3:0/2925416040 <== mon.1 v2:172.21.15.71:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb20002e030 con 0x560510213590 2024-09-19T06:24:33.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.541+0000 7fb21e7fe740 10 client.28741 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:24:33.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.541+0000 7fb21e7fe740 10 client.28741 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-19T06:24:33.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.541+0000 7fb21e7fe740 20 client.28741 populate_metadata read hostname 'smithi003' 2024-09-19T06:24:33.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.541+0000 7fb21e7fe740 1 --2- 172.21.15.3:0/2925416040 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x560510299020 0x56051029b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:33.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.541+0000 7fb21e7fe740 4 client.28741 mds_command: new command op to 24515 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:24:33.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.541+0000 7fb21e7fe740 1 -- 172.21.15.3:0/2925416040 --> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560510180e60 con 0x560510299020 2024-09-19T06:24:33.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.542+0000 7fb219e00640 1 --2- 172.21.15.3:0/2925416040 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x560510299020 0x56051029b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:33.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.542+0000 7fb219e00640 1 --2- 172.21.15.3:0/2925416040 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x560510299020 0x56051029b410 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c962549e07bcaebb server_cookie=f2c2d259ddf8a72a in_seq=0 out_seq=0 2024-09-19T06:24:33.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.542+0000 7fb1faa00640 10 client.28741 ms_handle_connect on v2:172.21.15.59:6836/4286779405 2024-09-19T06:24:33.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.542+0000 7fb1faa00640 1 -- 172.21.15.3:0/2925416040 <== mds.2 v2:172.21.15.59:6836/4286779405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560510180e60 con 0x560510299020 2024-09-19T06:24:33.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.542+0000 7fb1faa00640 10 client.28741 handle_command_reply: tid=0 2024-09-19T06:24:33.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.542+0000 7fb21e7fe740 1 client.28741 shutdown 2024-09-19T06:24:33.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.543+0000 7fb21e7fe740 1 -- 172.21.15.3:0/2925416040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510213590 msgr2=0x560510221e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:33.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.543+0000 7fb21e7fe740 1 --2- 172.21.15.3:0/2925416040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510213590 0x560510221e20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x56051021c2a0 tx=0x7fb200012d30 comp rx=0 tx=0).stop 2024-09-19T06:24:33.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.543+0000 7fb21e7fe740 1 -- 172.21.15.3:0/2925416040 shutdown_connections 2024-09-19T06:24:33.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.543+0000 7fb21e7fe740 1 --2- 172.21.15.3:0/2925416040 >> [v2:172.21.15.59:6836/4286779405,v1:172.21.15.59:6837/4286779405] conn(0x560510299020 0x56051029b410 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.543+0000 7fb21e7fe740 1 --2- 172.21.15.3:0/2925416040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56051021de50 0x560510222360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.543+0000 7fb21e7fe740 1 --2- 172.21.15.3:0/2925416040 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x560510213590 0x560510221e20 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.543+0000 7fb1faa00640 0 client.28741 ms_handle_reset on v2:172.21.15.59:6836/4286779405 2024-09-19T06:24:33.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.543+0000 7fb21e7fe740 1 --2- 172.21.15.3:0/2925416040 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x560510212c70 0x5605102218e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.543+0000 7fb21e7fe740 1 -- 172.21.15.3:0/2925416040 >> 172.21.15.3:0/2925416040 conn(0x56051020f200 msgr2=0x560510214ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:33.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.543+0000 7fb21e7fe740 1 -- 172.21.15.3:0/2925416040 shutdown_connections 2024-09-19T06:24:33.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.543+0000 7fb21e7fe740 1 -- 172.21.15.3:0/2925416040 wait complete. 2024-09-19T06:24:33.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.543+0000 7fb21e7fe740 20 client.28741 trim_cache size 0 max 16384 2024-09-19T06:24:33.549 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:24:33.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.544+0000 7fb21be00640 1 -- 172.21.15.3:0/3411864914 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb1fc0a33b0 msgr2=0x7fb1fc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:33.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.544+0000 7fb21be00640 1 --2- 172.21.15.3:0/3411864914 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb1fc0a33b0 0x7fb1fc0a5870 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x560510210060 tx=0x7fb2080d3b70 comp rx=0 tx=0).stop 2024-09-19T06:24:33.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.544+0000 7fb21be00640 1 -- 172.21.15.3:0/3411864914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb214103ff0 msgr2=0x7fb21419a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:33.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.544+0000 7fb21be00640 1 --2- 172.21.15.3:0/3411864914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb214103ff0 0x7fb21419a5b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb20800e9f0 tx=0x7fb20800eeb0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.544+0000 7fb21be00640 1 -- 172.21.15.3:0/3411864914 shutdown_connections 2024-09-19T06:24:33.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.544+0000 7fb21be00640 1 --2- 172.21.15.3:0/3411864914 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb1fc0a33b0 0x7fb1fc0a5870 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.544+0000 7fb21be00640 1 --2- 172.21.15.3:0/3411864914 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb214109120 0x7fb21419ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.544+0000 7fb21be00640 1 --2- 172.21.15.3:0/3411864914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2141049a0 0x7fb21419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.544+0000 7fb21be00640 1 --2- 172.21.15.3:0/3411864914 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb214103ff0 0x7fb21419a5b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:33.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.544+0000 7fb21be00640 1 -- 172.21.15.3:0/3411864914 >> 172.21.15.3:0/3411864914 conn(0x7fb2140ffa90 msgr2=0x7fb214101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:33.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.544+0000 7fb21be00640 1 -- 172.21.15.3:0/3411864914 shutdown_connections 2024-09-19T06:24:33.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:33.544+0000 7fb21be00640 1 -- 172.21.15.3:0/3411864914 wait complete. 2024-09-19T06:24:34.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:33 smithi059 ceph-mon[35138]: pgmap v380: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-19T06:24:34.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:33 smithi003 ceph-mon[30893]: pgmap v380: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-19T06:24:34.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:33 smithi071 ceph-mon[35662]: pgmap v380: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-19T06:24:34.577 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T06:24:34.957 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:35.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.557+0000 7f180c200640 1 -- 172.21.15.3:0/1652184329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1804076720 msgr2=0x7f1804076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:35.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.557+0000 7f180c200640 1 --2- 172.21.15.3:0/1652184329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1804076720 0x7f1804076b00 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f17f8009900 tx=0x7f17f802a400 comp rx=0 tx=0).stop 2024-09-19T06:24:35.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.557+0000 7f180c200640 1 -- 172.21.15.3:0/1652184329 shutdown_connections 2024-09-19T06:24:35.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.557+0000 7f180c200640 1 --2- 172.21.15.3:0/1652184329 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1804112a30 0x7f1804114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.557+0000 7f180c200640 1 --2- 172.21.15.3:0/1652184329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1804077040 0x7f18041124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.557+0000 7f180c200640 1 --2- 172.21.15.3:0/1652184329 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1804076720 0x7f1804076b00 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.557+0000 7f180c200640 1 -- 172.21.15.3:0/1652184329 >> 172.21.15.3:0/1652184329 conn(0x7f18040ffa90 msgr2=0x7f1804101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:35.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.557+0000 7f180c200640 1 -- 172.21.15.3:0/1652184329 shutdown_connections 2024-09-19T06:24:35.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.557+0000 7f180c200640 1 -- 172.21.15.3:0/1652184329 wait complete. 2024-09-19T06:24:35.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.558+0000 7f180c200640 1 Processor -- start 2024-09-19T06:24:35.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.558+0000 7f180c200640 1 -- start start 2024-09-19T06:24:35.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.559+0000 7f180c200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1804076720 0x7f18041a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:35.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.559+0000 7f180c200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1804077040 0x7f18041a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:35.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.559+0000 7f180c200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1804112a30 0x7f180419e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:35.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.559+0000 7f180c200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1804118610 con 0x7f1804076720 2024-09-19T06:24:35.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.559+0000 7f180c200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1804118490 con 0x7f1804112a30 2024-09-19T06:24:35.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.559+0000 7f180c200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1804118790 con 0x7f1804077040 2024-09-19T06:24:35.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.559+0000 7f1809800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1804076720 0x7f18041a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:35.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.559+0000 7f1809800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1804076720 0x7f18041a46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36726/0 (socket says 172.21.15.3:36726) 2024-09-19T06:24:35.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.559+0000 7f1809800640 1 -- 172.21.15.3:0/4140286707 learned_addr learned my addr 172.21.15.3:0/4140286707 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:35.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.559+0000 7f1808e00640 1 --2- 172.21.15.3:0/4140286707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1804077040 0x7f18041a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:35.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.559+0000 7f180a200640 1 --2- 172.21.15.3:0/4140286707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1804112a30 0x7f180419e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:35.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.559+0000 7f1809800640 1 -- 172.21.15.3:0/4140286707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1804077040 msgr2=0x7f18041a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:35.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.559+0000 7f1809800640 1 --2- 172.21.15.3:0/4140286707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1804077040 0x7f18041a4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.559+0000 7f1809800640 1 -- 172.21.15.3:0/4140286707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1804112a30 msgr2=0x7f180419e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:35.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.559+0000 7f1809800640 1 --2- 172.21.15.3:0/4140286707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1804112a30 0x7f180419e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.559+0000 7f1809800640 1 -- 172.21.15.3:0/4140286707 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f180419efa0 con 0x7f1804076720 2024-09-19T06:24:35.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.560+0000 7f1809800640 1 --2- 172.21.15.3:0/4140286707 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1804076720 0x7f18041a46b0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f17f8004770 tx=0x7f17f8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:35.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.560+0000 7f1802000640 1 -- 172.21.15.3:0/4140286707 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f803f070 con 0x7f1804076720 2024-09-19T06:24:35.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.560+0000 7f1802000640 1 -- 172.21.15.3:0/4140286707 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17f8031ca0 con 0x7f1804076720 2024-09-19T06:24:35.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.560+0000 7f1802000640 1 -- 172.21.15.3:0/4140286707 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f8035030 con 0x7f1804076720 2024-09-19T06:24:35.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.560+0000 7f180c200640 1 -- 172.21.15.3:0/4140286707 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f180419f230 con 0x7f1804076720 2024-09-19T06:24:35.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.560+0000 7f180c200640 1 -- 172.21.15.3:0/4140286707 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18041ab580 con 0x7f1804076720 2024-09-19T06:24:35.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.564+0000 7f180ec8f740 1 Processor -- start 2024-09-19T06:24:35.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.564+0000 7f180ec8f740 1 -- start start 2024-09-19T06:24:35.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.565+0000 7f1802000640 1 -- 172.21.15.3:0/4140286707 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f17f8042070 con 0x7f1804076720 2024-09-19T06:24:35.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.565+0000 7f180ec8f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5653d63a9c70 0x5653d63aa050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:35.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.565+0000 7f180ec8f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5653d63aa590 0x5653d63b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:35.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.565+0000 7f180ec8f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653d63b4e50 0x5653d63b7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:35.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.565+0000 7f180ec8f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5653d63103e0 con 0x5653d63aa590 2024-09-19T06:24:35.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.565+0000 7f180ec8f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5653d62b7d80 con 0x5653d63b4e50 2024-09-19T06:24:35.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.565+0000 7f180ec8f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5653d630c3a0 con 0x5653d63a9c70 2024-09-19T06:24:35.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.565+0000 7f1809800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5653d63aa590 0x5653d63b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:35.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.565+0000 7f1808e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653d63b4e50 0x5653d63b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:35.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.565+0000 7f180a200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5653d63a9c70 0x5653d63aa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:35.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.565+0000 7f1809800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5653d63aa590 0x5653d63b4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36728/0 (socket says 172.21.15.3:36728) 2024-09-19T06:24:35.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.565+0000 7f1809800640 1 -- 172.21.15.3:0/1999308748 learned_addr learned my addr 172.21.15.3:0/1999308748 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:35.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.566+0000 7f180a200640 1 -- 172.21.15.3:0/1999308748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653d63b4e50 msgr2=0x5653d63b7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:35.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.566+0000 7f180a200640 1 --2- 172.21.15.3:0/1999308748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653d63b4e50 0x5653d63b7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.566+0000 7f180a200640 1 -- 172.21.15.3:0/1999308748 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5653d63aa590 msgr2=0x5653d63b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:35.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.566+0000 7f180a200640 1 --2- 172.21.15.3:0/1999308748 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5653d63aa590 0x5653d63b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.566+0000 7f180a200640 1 -- 172.21.15.3:0/1999308748 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653d62d6ae0 con 0x5653d63a9c70 2024-09-19T06:24:35.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.566+0000 7f1808e00640 1 --2- 172.21.15.3:0/1999308748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653d63b4e50 0x5653d63b7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:35.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.566+0000 7f180a200640 1 --2- 172.21.15.3:0/1999308748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5653d63a9c70 0x5653d63aa050 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f180407aa10 tx=0x7f17fc010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f36d192f3182558 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:35.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.566+0000 7f17f6a00640 1 -- 172.21.15.3:0/1999308748 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc016070 con 0x5653d63a9c70 2024-09-19T06:24:35.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.566+0000 7f17f6a00640 1 -- 172.21.15.3:0/1999308748 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17fc004d20 con 0x5653d63a9c70 2024-09-19T06:24:35.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.566+0000 7f17f6a00640 1 -- 172.21.15.3:0/1999308748 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc012810 con 0x5653d63a9c70 2024-09-19T06:24:35.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.566+0000 7f1802000640 1 --2- 172.21.15.3:0/4140286707 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f17ec0a3430 0x7f17ec0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:35.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.567+0000 7f1802000640 1 -- 172.21.15.3:0/4140286707 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7f17f80f0350 con 0x7f1804076720 2024-09-19T06:24:35.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.567+0000 7f1809800640 1 --2- 172.21.15.3:0/4140286707 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f17ec0a3430 0x7f17ec0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:35.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.567+0000 7f180ec8f740 1 -- 172.21.15.3:0/1999308748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5653d63a9c70 msgr2=0x5653d63aa050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:35.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.567+0000 7f180ec8f740 1 --2- 172.21.15.3:0/1999308748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5653d63a9c70 0x5653d63aa050 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f180407aa10 tx=0x7f17fc010740 comp rx=0 tx=0).stop 2024-09-19T06:24:35.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.567+0000 7f180ec8f740 1 -- 172.21.15.3:0/1999308748 shutdown_connections 2024-09-19T06:24:35.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.567+0000 7f180ec8f740 1 --2- 172.21.15.3:0/1999308748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653d63b4e50 0x5653d63b7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.567+0000 7f180ec8f740 1 --2- 172.21.15.3:0/1999308748 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5653d63aa590 0x5653d63b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.567+0000 7f180ec8f740 1 --2- 172.21.15.3:0/1999308748 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5653d63a9c70 0x5653d63aa050 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.567+0000 7f180ec8f740 1 -- 172.21.15.3:0/1999308748 >> 172.21.15.3:0/1999308748 conn(0x5653d63a6200 msgr2=0x5653d63a65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:35.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.567+0000 7f180ec8f740 1 -- 172.21.15.3:0/1999308748 shutdown_connections 2024-09-19T06:24:35.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.567+0000 7f180ec8f740 1 -- 172.21.15.3:0/1999308748 wait complete. 2024-09-19T06:24:35.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.567+0000 7f1809800640 1 --2- 172.21.15.3:0/4140286707 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f17ec0a3430 0x7f17ec0a58f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f17f80bc640 tx=0x7f17f80f3ea0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:35.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.568+0000 7f180ec8f740 1 -- start start 2024-09-19T06:24:35.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.568+0000 7f180ec8f740 1 Processor -- start 2024-09-19T06:24:35.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.569+0000 7f180ec8f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5653d63a9c70 0x5653d63b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:35.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.569+0000 7f180ec8f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653d63aa590 0x5653d63b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:35.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.569+0000 7f180ec8f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5653d63b4e50 0x5653d63b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:35.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.569+0000 7f180ec8f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5653d63b7a20 con 0x5653d63b4e50 2024-09-19T06:24:35.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.569+0000 7f180ec8f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5653d62cb0f0 con 0x5653d63aa590 2024-09-19T06:24:35.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.569+0000 7f180ec8f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5653d63b7ba0 con 0x5653d63a9c70 2024-09-19T06:24:35.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.569+0000 7f180ec8f740 10 client.0 _ll_register_callbacks cb 0x5653d62b2bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:35.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.569+0000 7f180a200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5653d63b4e50 0x5653d63b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:35.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.569+0000 7f180a200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5653d63b4e50 0x5653d63b27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36744/0 (socket says 172.21.15.3:36744) 2024-09-19T06:24:35.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.569+0000 7f180a200640 1 -- 172.21.15.3:0/2981201116 learned_addr learned my addr 172.21.15.3:0/2981201116 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:35.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.569+0000 7f1808e00640 1 --2- 172.21.15.3:0/2981201116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653d63aa590 0x5653d63b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:35.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.569+0000 7f180a200640 1 --2- 172.21.15.3:0/2981201116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5653d63a9c70 0x5653d63b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:35.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.569+0000 7f180a200640 1 -- 172.21.15.3:0/2981201116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5653d63a9c70 msgr2=0x5653d63b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:35.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.569+0000 7f180a200640 1 --2- 172.21.15.3:0/2981201116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5653d63a9c70 0x5653d63b1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.569+0000 7f180a200640 1 -- 172.21.15.3:0/2981201116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653d63aa590 msgr2=0x5653d63b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:35.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.569+0000 7f180a200640 1 --2- 172.21.15.3:0/2981201116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653d63aa590 0x5653d63b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.569+0000 7f180a200640 1 -- 172.21.15.3:0/2981201116 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653d60813c0 con 0x5653d63b4e50 2024-09-19T06:24:35.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.570+0000 7f1808e00640 1 --2- 172.21.15.3:0/2981201116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653d63aa590 0x5653d63b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:35.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.570+0000 7f180a200640 1 --2- 172.21.15.3:0/2981201116 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5653d63b4e50 0x5653d63b27b0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f17fc005cc0 tx=0x7f17fc005aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118920fe3d869d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:35.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.570+0000 7f17eb400640 10 client.0 ms_handle_connect on v2:172.21.15.3:3300/0 2024-09-19T06:24:35.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.570+0000 7f17eb400640 1 -- 172.21.15.3:0/2981201116 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc016030 con 0x5653d63b4e50 2024-09-19T06:24:35.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.570+0000 7f17eb400640 1 -- 172.21.15.3:0/2981201116 <== mon.0 v2:172.21.15.3:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7f17fc012bf0 con 0x5653d63b4e50 2024-09-19T06:24:35.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.570+0000 7f180ec8f740 1 -- 172.21.15.3:0/2981201116 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17fc004d20 con 0x5653d63b4e50 2024-09-19T06:24:35.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.570+0000 7f17eb400640 1 -- 172.21.15.3:0/2981201116 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f17fc023040 con 0x5653d63b4e50 2024-09-19T06:24:35.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.570+0000 7f180ec8f740 10 client.18747 fetch_fsmap learned FSMap version 29 2024-09-19T06:24:35.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.570+0000 7f180ec8f740 1 -- 172.21.15.3:0/2981201116 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5653d63c3a90 con 0x5653d63b4e50 2024-09-19T06:24:35.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.571+0000 7f17eb400640 1 -- 172.21.15.3:0/2981201116 <== mon.0 v2:172.21.15.3:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17fc004d20 con 0x5653d63b4e50 2024-09-19T06:24:35.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.571+0000 7f17eb400640 1 -- 172.21.15.3:0/2981201116 <== mon.0 v2:172.21.15.3:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f17fc00f040 con 0x5653d63b4e50 2024-09-19T06:24:35.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.571+0000 7f180ec8f740 10 client.18747 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:24:35.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.571+0000 7f180ec8f740 10 client.18747 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:24:35.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.571+0000 7f180ec8f740 20 client.18747 populate_metadata read hostname 'smithi003' 2024-09-19T06:24:35.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.571+0000 7f180ec8f740 1 --2- 172.21.15.3:0/2981201116 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5653d63c4e40 0x5653d63c7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:35.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.571+0000 7f180ec8f740 4 client.18747 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:24:35.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.571+0000 7f180ec8f740 1 -- 172.21.15.3:0/2981201116 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653d631d950 con 0x5653d63c4e40 2024-09-19T06:24:35.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.571+0000 7f1808e00640 1 --2- 172.21.15.3:0/2981201116 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5653d63c4e40 0x5653d63c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:35.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.572+0000 7f1808e00640 1 --2- 172.21.15.3:0/2981201116 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5653d63c4e40 0x5653d63c7230 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3fd4873eb4a519fc server_cookie=9d04718e29672b4c in_seq=0 out_seq=0 2024-09-19T06:24:35.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.572+0000 7f17eb400640 10 client.18747 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:24:35.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.573+0000 7f17eb400640 1 -- 172.21.15.3:0/2981201116 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5653d631d950 con 0x5653d63c4e40 2024-09-19T06:24:35.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.573+0000 7f17eb400640 10 client.18747 handle_command_reply: tid=0 2024-09-19T06:24:35.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.573+0000 7f180ec8f740 1 client.18747 shutdown 2024-09-19T06:24:35.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.573+0000 7f180ec8f740 1 -- 172.21.15.3:0/2981201116 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5653d63b4e50 msgr2=0x5653d63b27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:35.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.573+0000 7f180ec8f740 1 --2- 172.21.15.3:0/2981201116 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5653d63b4e50 0x5653d63b27b0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f17fc005cc0 tx=0x7f17fc005aa0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.573+0000 7f180ec8f740 1 -- 172.21.15.3:0/2981201116 shutdown_connections 2024-09-19T06:24:35.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.573+0000 7f180ec8f740 1 --2- 172.21.15.3:0/2981201116 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5653d63c4e40 0x5653d63c7230 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.573+0000 7f180ec8f740 1 --2- 172.21.15.3:0/2981201116 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5653d63b4e50 0x5653d63b27b0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.573+0000 7f180ec8f740 1 --2- 172.21.15.3:0/2981201116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653d63aa590 0x5653d63b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.573+0000 7f180ec8f740 1 --2- 172.21.15.3:0/2981201116 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5653d63a9c70 0x5653d63b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.573+0000 7f17eb400640 0 client.18747 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:24:35.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.573+0000 7f180ec8f740 1 -- 172.21.15.3:0/2981201116 >> 172.21.15.3:0/2981201116 conn(0x5653d63a6200 msgr2=0x5653d63abf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:35.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.573+0000 7f180ec8f740 1 -- 172.21.15.3:0/2981201116 shutdown_connections 2024-09-19T06:24:35.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.573+0000 7f180ec8f740 1 -- 172.21.15.3:0/2981201116 wait complete. 2024-09-19T06:24:35.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.574+0000 7f180ec8f740 20 client.18747 trim_cache size 0 max 16384 2024-09-19T06:24:35.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.587+0000 7f180ec8f740 1 Processor -- start 2024-09-19T06:24:35.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.587+0000 7f180ec8f740 1 -- start start 2024-09-19T06:24:35.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.587+0000 7f180ec8f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653d63a9c70 0x5653d63b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:35.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.588+0000 7f180ec8f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5653d63aa590 0x5653d63cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:35.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.588+0000 7f180ec8f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5653d63b4e50 0x5653d63cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:35.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.588+0000 7f180ec8f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f18041b3fa0 con 0x5653d63b4e50 2024-09-19T06:24:35.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.588+0000 7f180ec8f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f18041b5ae0 con 0x5653d63a9c70 2024-09-19T06:24:35.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.588+0000 7f180ec8f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f18041b4670 con 0x5653d63aa590 2024-09-19T06:24:35.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.588+0000 7f180a200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653d63a9c70 0x5653d63b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:35.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.588+0000 7f1808e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5653d63aa590 0x5653d63cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:35.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.588+0000 7f1808e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5653d63aa590 0x5653d63cc970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:33778/0 (socket says 172.21.15.3:33778) 2024-09-19T06:24:35.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.588+0000 7f1808e00640 1 -- 172.21.15.3:0/2731947064 learned_addr learned my addr 172.21.15.3:0/2731947064 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:35.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.588+0000 7f180a200640 1 --2- 172.21.15.3:0/2731947064 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5653d63b4e50 0x5653d63cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:35.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.588+0000 7f1808e00640 1 -- 172.21.15.3:0/2731947064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653d63a9c70 msgr2=0x5653d63b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:35.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.588+0000 7f1808e00640 1 --2- 172.21.15.3:0/2731947064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653d63a9c70 0x5653d63b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.588+0000 7f1808e00640 1 -- 172.21.15.3:0/2731947064 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5653d63b4e50 msgr2=0x5653d63cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:35.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.588+0000 7f1808e00640 1 --2- 172.21.15.3:0/2731947064 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5653d63b4e50 0x5653d63cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.588+0000 7f1808e00640 1 -- 172.21.15.3:0/2731947064 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653d63a1770 con 0x5653d63aa590 2024-09-19T06:24:35.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.589+0000 7f1808e00640 1 --2- 172.21.15.3:0/2731947064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5653d63aa590 0x5653d63cc970 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1804079370 tx=0x7f17f0005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92b012a180706931 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:35.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.589+0000 7f17f6000640 1 -- 172.21.15.3:0/2731947064 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f0005020 con 0x5653d63aa590 2024-09-19T06:24:35.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.589+0000 7f17f6000640 1 -- 172.21.15.3:0/2731947064 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17f000f7f0 con 0x5653d63aa590 2024-09-19T06:24:35.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.589+0000 7f17f6000640 1 -- 172.21.15.3:0/2731947064 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f0004a00 con 0x5653d63aa590 2024-09-19T06:24:35.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.589+0000 7f180ec8f740 1 -- 172.21.15.3:0/2731947064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5653d63aa590 msgr2=0x5653d63cc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:35.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.589+0000 7f180ec8f740 1 --2- 172.21.15.3:0/2731947064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5653d63aa590 0x5653d63cc970 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1804079370 tx=0x7f17f0005f90 comp rx=0 tx=0).stop 2024-09-19T06:24:35.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.590+0000 7f180ec8f740 1 -- 172.21.15.3:0/2731947064 shutdown_connections 2024-09-19T06:24:35.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.590+0000 7f180ec8f740 1 --2- 172.21.15.3:0/2731947064 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5653d63b4e50 0x5653d63cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.590+0000 7f180ec8f740 1 --2- 172.21.15.3:0/2731947064 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5653d63aa590 0x5653d63cc970 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.590+0000 7f180ec8f740 1 --2- 172.21.15.3:0/2731947064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653d63a9c70 0x5653d63b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.590+0000 7f180ec8f740 1 -- 172.21.15.3:0/2731947064 >> 172.21.15.3:0/2731947064 conn(0x5653d63a6200 msgr2=0x5653d63b3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:35.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.590+0000 7f180ec8f740 1 -- 172.21.15.3:0/2731947064 shutdown_connections 2024-09-19T06:24:35.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.590+0000 7f180ec8f740 1 -- 172.21.15.3:0/2731947064 wait complete. 2024-09-19T06:24:35.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.590+0000 7f180ec8f740 1 -- start start 2024-09-19T06:24:35.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.590+0000 7f180ec8f740 1 Processor -- start 2024-09-19T06:24:35.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.591+0000 7f180ec8f740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5653d63a9c70 0x5653d63bd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:35.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.591+0000 7f180ec8f740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653d63aa590 0x5653d63ae880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:35.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.591+0000 7f180ec8f740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5653d63b4e50 0x5653d63aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:35.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.591+0000 7f180ec8f740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f18041b5410 con 0x5653d63b4e50 2024-09-19T06:24:35.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.591+0000 7f180ec8f740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f18041b4d40 con 0x5653d63aa590 2024-09-19T06:24:35.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.591+0000 7f180ec8f740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f18041b1fa0 con 0x5653d63a9c70 2024-09-19T06:24:35.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.591+0000 7f180ec8f740 10 client.0 _ll_register_callbacks cb 0x7f17f80f3d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:35.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.591+0000 7f180a200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5653d63a9c70 0x5653d63bd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:35.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.591+0000 7f180a200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5653d63a9c70 0x5653d63bd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:33780/0 (socket says 172.21.15.3:33780) 2024-09-19T06:24:35.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.591+0000 7f180a200640 1 -- 172.21.15.3:0/2580924271 learned_addr learned my addr 172.21.15.3:0/2580924271 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:35.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.591+0000 7f1808e00640 1 --2- 172.21.15.3:0/2580924271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653d63aa590 0x5653d63ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:35.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.592+0000 7f180a200640 1 --2- 172.21.15.3:0/2580924271 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5653d63b4e50 0x5653d63aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:35.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.592+0000 7f1808e00640 1 -- 172.21.15.3:0/2580924271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5653d63a9c70 msgr2=0x5653d63bd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:35.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.592+0000 7f1808e00640 1 --2- 172.21.15.3:0/2580924271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5653d63a9c70 0x5653d63bd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.592+0000 7f1808e00640 1 -- 172.21.15.3:0/2580924271 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5653d63b4e50 msgr2=0x5653d63aedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:35.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.592+0000 7f1808e00640 1 --2- 172.21.15.3:0/2580924271 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5653d63b4e50 0x5653d63aedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.592+0000 7f1808e00640 1 -- 172.21.15.3:0/2580924271 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653d63acae0 con 0x5653d63aa590 2024-09-19T06:24:35.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.592+0000 7f1808e00640 1 --2- 172.21.15.3:0/2580924271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653d63aa590 0x5653d63ae880 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x5653d62b2d10 tx=0x7f17f00096d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa8813ab0d6a038c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:35.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.592+0000 7f17eb400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:24:35.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.592+0000 7f17eb400640 1 -- 172.21.15.3:0/2580924271 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f0012150 con 0x5653d63aa590 2024-09-19T06:24:35.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.593+0000 7f17eb400640 1 -- 172.21.15.3:0/2580924271 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7f17f000fbb0 con 0x5653d63aa590 2024-09-19T06:24:35.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.593+0000 7f180ec8f740 1 -- 172.21.15.3:0/2580924271 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17f000f7f0 con 0x5653d63aa590 2024-09-19T06:24:35.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.593+0000 7f17eb400640 1 -- 172.21.15.3:0/2580924271 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f17f003a050 con 0x5653d63aa590 2024-09-19T06:24:35.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.593+0000 7f180ec8f740 10 client.28787 fetch_fsmap learned FSMap version 29 2024-09-19T06:24:35.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.593+0000 7f180ec8f740 1 -- 172.21.15.3:0/2580924271 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5653d642f5a0 con 0x5653d63aa590 2024-09-19T06:24:35.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.593+0000 7f17eb400640 1 -- 172.21.15.3:0/2580924271 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17f000f7f0 con 0x5653d63aa590 2024-09-19T06:24:35.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.593+0000 7f17eb400640 1 -- 172.21.15.3:0/2580924271 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f17f0003a60 con 0x5653d63aa590 2024-09-19T06:24:35.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.593+0000 7f180ec8f740 10 client.28787 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:24:35.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.593+0000 7f180ec8f740 10 client.28787 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T06:24:35.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.593+0000 7f180ec8f740 20 client.28787 populate_metadata read hostname 'smithi003' 2024-09-19T06:24:35.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.593+0000 7f180ec8f740 1 --2- 172.21.15.3:0/2580924271 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5653d642fbf0 0x5653d6432010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:35.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.593+0000 7f180ec8f740 4 client.28787 mds_command: new command op to 24532 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:24:35.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.593+0000 7f180ec8f740 1 -- 172.21.15.3:0/2580924271 --> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5653d6317e60 con 0x5653d642fbf0 2024-09-19T06:24:35.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.594+0000 7f180a200640 1 --2- 172.21.15.3:0/2580924271 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5653d642fbf0 0x5653d6432010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:35.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.594+0000 7f180a200640 1 --2- 172.21.15.3:0/2580924271 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5653d642fbf0 0x5653d6432010 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b1779eba82d014a3 server_cookie=820a634567cf51e0 in_seq=0 out_seq=0 2024-09-19T06:24:35.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.594+0000 7f17eb400640 10 client.28787 ms_handle_connect on v2:172.21.15.71:6838/3577136418 2024-09-19T06:24:35.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.595+0000 7f17eb400640 1 -- 172.21.15.3:0/2580924271 <== mds.1 v2:172.21.15.71:6838/3577136418 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5653d6317e60 con 0x5653d642fbf0 2024-09-19T06:24:35.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.595+0000 7f17eb400640 10 client.28787 handle_command_reply: tid=0 2024-09-19T06:24:35.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.595+0000 7f180ec8f740 1 client.28787 shutdown 2024-09-19T06:24:35.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.595+0000 7f180ec8f740 1 -- 172.21.15.3:0/2580924271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653d63aa590 msgr2=0x5653d63ae880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:35.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.595+0000 7f180ec8f740 1 --2- 172.21.15.3:0/2580924271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653d63aa590 0x5653d63ae880 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x5653d62b2d10 tx=0x7f17f00096d0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.595+0000 7f180ec8f740 1 -- 172.21.15.3:0/2580924271 shutdown_connections 2024-09-19T06:24:35.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.595+0000 7f180ec8f740 1 --2- 172.21.15.3:0/2580924271 >> [v2:172.21.15.71:6838/3577136418,v1:172.21.15.71:6839/3577136418] conn(0x5653d642fbf0 0x5653d6432010 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.595+0000 7f180ec8f740 1 --2- 172.21.15.3:0/2580924271 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x5653d63b4e50 0x5653d63aedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.595+0000 7f180ec8f740 1 --2- 172.21.15.3:0/2580924271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5653d63aa590 0x5653d63ae880 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.595+0000 7f180ec8f740 1 --2- 172.21.15.3:0/2580924271 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x5653d63a9c70 0x5653d63bd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.595+0000 7f17eb400640 0 client.28787 ms_handle_reset on v2:172.21.15.71:6838/3577136418 2024-09-19T06:24:35.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.595+0000 7f180ec8f740 1 -- 172.21.15.3:0/2580924271 >> 172.21.15.3:0/2580924271 conn(0x5653d63a6200 msgr2=0x5653d63a5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:35.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.595+0000 7f180ec8f740 1 -- 172.21.15.3:0/2580924271 shutdown_connections 2024-09-19T06:24:35.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.595+0000 7f180ec8f740 1 -- 172.21.15.3:0/2580924271 wait complete. 2024-09-19T06:24:35.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.595+0000 7f180ec8f740 20 client.28787 trim_cache size 0 max 16384 2024-09-19T06:24:35.612 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:24:35.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.596+0000 7f180c200640 1 -- 172.21.15.3:0/4140286707 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f17ec0a3430 msgr2=0x7f17ec0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:35.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.596+0000 7f180c200640 1 --2- 172.21.15.3:0/4140286707 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f17ec0a3430 0x7f17ec0a58f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f17f80bc640 tx=0x7f17f80f3ea0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.596+0000 7f180c200640 1 -- 172.21.15.3:0/4140286707 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1804076720 msgr2=0x7f18041a46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:35.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.596+0000 7f180c200640 1 --2- 172.21.15.3:0/4140286707 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1804076720 0x7f18041a46b0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f17f8004770 tx=0x7f17f8003c10 comp rx=0 tx=0).stop 2024-09-19T06:24:35.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.596+0000 7f180c200640 1 -- 172.21.15.3:0/4140286707 shutdown_connections 2024-09-19T06:24:35.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.596+0000 7f180c200640 1 --2- 172.21.15.3:0/4140286707 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f17ec0a3430 0x7f17ec0a58f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.596+0000 7f180c200640 1 --2- 172.21.15.3:0/4140286707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1804112a30 0x7f180419e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.596+0000 7f180c200640 1 --2- 172.21.15.3:0/4140286707 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1804077040 0x7f18041a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.596+0000 7f180c200640 1 --2- 172.21.15.3:0/4140286707 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1804076720 0x7f18041a46b0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:35.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.596+0000 7f180c200640 1 -- 172.21.15.3:0/4140286707 >> 172.21.15.3:0/4140286707 conn(0x7f18040ffa90 msgr2=0x7f1804101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:35.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.597+0000 7f180c200640 1 -- 172.21.15.3:0/4140286707 shutdown_connections 2024-09-19T06:24:35.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:35.597+0000 7f180c200640 1 -- 172.21.15.3:0/4140286707 wait complete. 2024-09-19T06:24:36.288 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:36 smithi003 ceph-mon[30893]: pgmap v381: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-19T06:24:36.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:36 smithi059 ceph-mon[35138]: pgmap v381: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-19T06:24:36.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:36 smithi071 ceph-mon[35662]: pgmap v381: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-09-19T06:24:36.547 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T06:24:36.926 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:37.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.507+0000 7f2e3ac00640 1 -- 172.21.15.3:0/3062626054 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e34074eb0 msgr2=0x7f2e34112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:37.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.507+0000 7f2e3ac00640 1 --2- 172.21.15.3:0/3062626054 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e34074eb0 0x7f2e34112650 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c009900 tx=0x7f2e1c02a480 comp rx=0 tx=0).stop 2024-09-19T06:24:37.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.507+0000 7f2e3ac00640 1 -- 172.21.15.3:0/3062626054 shutdown_connections 2024-09-19T06:24:37.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.507+0000 7f2e3ac00640 1 --2- 172.21.15.3:0/3062626054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e34112b90 0x7f2e34114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.507+0000 7f2e3ac00640 1 --2- 172.21.15.3:0/3062626054 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e34074eb0 0x7f2e34112650 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.507+0000 7f2e3ac00640 1 --2- 172.21.15.3:0/3062626054 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e34074590 0x7f2e34074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.508+0000 7f2e3ac00640 1 -- 172.21.15.3:0/3062626054 >> 172.21.15.3:0/3062626054 conn(0x7f2e340fd8c0 msgr2=0x7f2e340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:37.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.508+0000 7f2e3ac00640 1 -- 172.21.15.3:0/3062626054 shutdown_connections 2024-09-19T06:24:37.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.508+0000 7f2e3ac00640 1 -- 172.21.15.3:0/3062626054 wait complete. 2024-09-19T06:24:37.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.509+0000 7f2e3ac00640 1 Processor -- start 2024-09-19T06:24:37.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.509+0000 7f2e3ac00640 1 -- start start 2024-09-19T06:24:37.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.509+0000 7f2e3ac00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e34074590 0x7f2e341a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:37.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.509+0000 7f2e3ac00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e34074eb0 0x7f2e341a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:37.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.509+0000 7f2e3ac00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e34112b90 0x7f2e3419e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:37.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.509+0000 7f2e3ac00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2e34118590 con 0x7f2e34112b90 2024-09-19T06:24:37.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.509+0000 7f2e3ac00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2e34118410 con 0x7f2e34074eb0 2024-09-19T06:24:37.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.509+0000 7f2e3ac00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2e34118710 con 0x7f2e34074590 2024-09-19T06:24:37.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.509+0000 7f2e33e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e34074590 0x7f2e341a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:37.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.509+0000 7f2e38c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e34112b90 0x7f2e3419e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:37.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.509+0000 7f2e33e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e34074590 0x7f2e341a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:33802/0 (socket says 172.21.15.3:33802) 2024-09-19T06:24:37.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.509+0000 7f2e33e00640 1 -- 172.21.15.3:0/3687441425 learned_addr learned my addr 172.21.15.3:0/3687441425 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:37.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.509+0000 7f2e2be00640 1 --2- 172.21.15.3:0/3687441425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e34074eb0 0x7f2e341a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:37.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.510+0000 7f2e33e00640 1 -- 172.21.15.3:0/3687441425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e34074eb0 msgr2=0x7f2e341a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:37.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.510+0000 7f2e33e00640 1 --2- 172.21.15.3:0/3687441425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e34074eb0 0x7f2e341a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.510+0000 7f2e33e00640 1 -- 172.21.15.3:0/3687441425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e34112b90 msgr2=0x7f2e3419e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:37.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.510+0000 7f2e33e00640 1 --2- 172.21.15.3:0/3687441425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e34112b90 0x7f2e3419e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.510+0000 7f2e33e00640 1 -- 172.21.15.3:0/3687441425 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3419f000 con 0x7f2e34074590 2024-09-19T06:24:37.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.510+0000 7f2e38c00640 1 --2- 172.21.15.3:0/3687441425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e34112b90 0x7f2e3419e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:37.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.510+0000 7f2e33e00640 1 --2- 172.21.15.3:0/3687441425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e34074590 0x7f2e341a4710 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400d950 tx=0x7f2e2400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:37.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.510+0000 7f2e31600640 1 -- 172.21.15.3:0/3687441425 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e24017070 con 0x7f2e34074590 2024-09-19T06:24:37.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.510+0000 7f2e3ac00640 1 -- 172.21.15.3:0/3687441425 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e3419f2f0 con 0x7f2e34074590 2024-09-19T06:24:37.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.510+0000 7f2e31600640 1 -- 172.21.15.3:0/3687441425 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e24009c30 con 0x7f2e34074590 2024-09-19T06:24:37.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.510+0000 7f2e31600640 1 -- 172.21.15.3:0/3687441425 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2400f6b0 con 0x7f2e34074590 2024-09-19T06:24:37.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.511+0000 7f2e3ac00640 1 -- 172.21.15.3:0/3687441425 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e341ab5e0 con 0x7f2e34074590 2024-09-19T06:24:37.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.514+0000 7f2e3d5cd740 1 Processor -- start 2024-09-19T06:24:37.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.514+0000 7f2e3d5cd740 1 -- start start 2024-09-19T06:24:37.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.514+0000 7f2e31600640 1 -- 172.21.15.3:0/3687441425 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f2e240109d0 con 0x7f2e34074590 2024-09-19T06:24:37.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.514+0000 7f2e3d5cd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561297730c70 0x561297731050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:37.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.514+0000 7f2e3d5cd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297731590 0x56129773b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:37.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.514+0000 7f2e3d5cd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129773be50 0x56129773e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:37.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.514+0000 7f2e3d5cd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x5612976973e0 con 0x561297730c70 2024-09-19T06:24:37.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.514+0000 7f2e3d5cd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x56129763ed80 con 0x56129773be50 2024-09-19T06:24:37.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.514+0000 7f2e3d5cd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x5612976933a0 con 0x561297731590 2024-09-19T06:24:37.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.514+0000 7f2e38c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561297730c70 0x561297731050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:37.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.514+0000 7f2e33e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297731590 0x56129773b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:37.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.514+0000 7f2e38c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561297730c70 0x561297731050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36784/0 (socket says 172.21.15.3:36784) 2024-09-19T06:24:37.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.515+0000 7f2e38c00640 1 -- 172.21.15.3:0/2014195557 learned_addr learned my addr 172.21.15.3:0/2014195557 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:37.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.515+0000 7f2e2be00640 1 --2- 172.21.15.3:0/2014195557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129773be50 0x56129773e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:37.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.515+0000 7f2e38c00640 1 -- 172.21.15.3:0/2014195557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297731590 msgr2=0x56129773b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:37.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.515+0000 7f2e38c00640 1 --2- 172.21.15.3:0/2014195557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297731590 0x56129773b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.515+0000 7f2e38c00640 1 -- 172.21.15.3:0/2014195557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129773be50 msgr2=0x56129773e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:37.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.515+0000 7f2e38c00640 1 --2- 172.21.15.3:0/2014195557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129773be50 0x56129773e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.515+0000 7f2e38c00640 1 -- 172.21.15.3:0/2014195557 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56129765dae0 con 0x561297730c70 2024-09-19T06:24:37.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.515+0000 7f2e38c00640 1 --2- 172.21.15.3:0/2014195557 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561297730c70 0x561297731050 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c011760 tx=0x7f2e2c011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b25fe14aa0249c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:37.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.516+0000 7f2e29200640 1 -- 172.21.15.3:0/2014195557 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c004d20 con 0x561297730c70 2024-09-19T06:24:37.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.516+0000 7f2e29200640 1 -- 172.21.15.3:0/2014195557 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e2c00f9a0 con 0x561297730c70 2024-09-19T06:24:37.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.516+0000 7f2e29200640 1 -- 172.21.15.3:0/2014195557 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c004530 con 0x561297730c70 2024-09-19T06:24:37.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.516+0000 7f2e31600640 1 --2- 172.21.15.3:0/3687441425 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2e180a3430 0x7f2e180a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:37.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.516+0000 7f2e31600640 1 -- 172.21.15.3:0/3687441425 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7f2e240cf900 con 0x7f2e34074590 2024-09-19T06:24:37.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.516+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/2014195557 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561297730c70 msgr2=0x561297731050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:37.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.516+0000 7f2e3d5cd740 1 --2- 172.21.15.3:0/2014195557 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561297730c70 0x561297731050 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c011760 tx=0x7f2e2c011c20 comp rx=0 tx=0).stop 2024-09-19T06:24:37.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.516+0000 7f2e33e00640 1 --2- 172.21.15.3:0/3687441425 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2e180a3430 0x7f2e180a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:37.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.517+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/2014195557 shutdown_connections 2024-09-19T06:24:37.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.517+0000 7f2e3d5cd740 1 --2- 172.21.15.3:0/2014195557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56129773be50 0x56129773e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.517+0000 7f2e3d5cd740 1 --2- 172.21.15.3:0/2014195557 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x561297731590 0x56129773b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.517+0000 7f2e3d5cd740 1 --2- 172.21.15.3:0/2014195557 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561297730c70 0x561297731050 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.517+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/2014195557 >> 172.21.15.3:0/2014195557 conn(0x56129772d200 msgr2=0x56129772d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:37.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.517+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/2014195557 shutdown_connections 2024-09-19T06:24:37.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.517+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/2014195557 wait complete. 2024-09-19T06:24:37.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.517+0000 7f2e33e00640 1 --2- 172.21.15.3:0/3687441425 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2e180a3430 0x7f2e180a58f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x56129772e060 tx=0x7f2e240d5530 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:37.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.517+0000 7f2e3d5cd740 1 -- start start 2024-09-19T06:24:37.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.517+0000 7f2e3d5cd740 1 Processor -- start 2024-09-19T06:24:37.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.518+0000 7f2e3d5cd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561297730c70 0x561297738d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:37.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.518+0000 7f2e3d5cd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561297731590 0x561297739260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:37.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.518+0000 7f2e3d5cd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56129773be50 0x5612977397a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:37.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.518+0000 7f2e3d5cd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x56129773ea20 con 0x561297730c70 2024-09-19T06:24:37.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.518+0000 7f2e3d5cd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x5612976520f0 con 0x561297731590 2024-09-19T06:24:37.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.518+0000 7f2e3d5cd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x56129773eba0 con 0x56129773be50 2024-09-19T06:24:37.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.518+0000 7f2e3d5cd740 10 client.0 _ll_register_callbacks cb 0x561297639bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:37.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.518+0000 7f2e38c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561297730c70 0x561297738d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:37.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.518+0000 7f2e38c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561297730c70 0x561297738d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36800/0 (socket says 172.21.15.3:36800) 2024-09-19T06:24:37.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.518+0000 7f2e38c00640 1 -- 172.21.15.3:0/547041815 learned_addr learned my addr 172.21.15.3:0/547041815 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:37.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.518+0000 7f2e2be00640 1 --2- 172.21.15.3:0/547041815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561297731590 0x561297739260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:37.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.518+0000 7f2e38c00640 1 --2- 172.21.15.3:0/547041815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56129773be50 0x5612977397a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:37.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.519+0000 7f2e2be00640 1 -- 172.21.15.3:0/547041815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56129773be50 msgr2=0x5612977397a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:37.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.519+0000 7f2e2be00640 1 --2- 172.21.15.3:0/547041815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56129773be50 0x5612977397a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.519+0000 7f2e2be00640 1 -- 172.21.15.3:0/547041815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561297730c70 msgr2=0x561297738d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:37.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.519+0000 7f2e2be00640 1 --2- 172.21.15.3:0/547041815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561297730c70 0x561297738d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.519+0000 7f2e2be00640 1 -- 172.21.15.3:0/547041815 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612974083c0 con 0x561297731590 2024-09-19T06:24:37.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.519+0000 7f2e2be00640 1 --2- 172.21.15.3:0/547041815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561297731590 0x561297739260 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c02aa70 tx=0x7f2e1c004420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0a44348bdece28c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:37.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.519+0000 7f2e21600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:24:37.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.519+0000 7f2e21600640 1 -- 172.21.15.3:0/547041815 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c035040 con 0x561297731590 2024-09-19T06:24:37.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.519+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/547041815 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e2c00f9a0 con 0x561297731590 2024-09-19T06:24:37.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.519+0000 7f2e21600640 1 -- 172.21.15.3:0/547041815 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7f2e1c005450 con 0x561297731590 2024-09-19T06:24:37.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.520+0000 7f2e21600640 1 -- 172.21.15.3:0/547041815 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2e1c005650 con 0x561297731590 2024-09-19T06:24:37.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.520+0000 7f2e3d5cd740 10 client.28799 fetch_fsmap learned FSMap version 29 2024-09-19T06:24:37.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.520+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/547041815 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56129774aa90 con 0x561297731590 2024-09-19T06:24:37.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.520+0000 7f2e21600640 1 -- 172.21.15.3:0/547041815 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e2c00f9a0 con 0x561297731590 2024-09-19T06:24:37.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.520+0000 7f2e21600640 1 -- 172.21.15.3:0/547041815 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2e1c04d070 con 0x561297731590 2024-09-19T06:24:37.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.520+0000 7f2e3d5cd740 10 client.28799 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:24:37.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.520+0000 7f2e3d5cd740 10 client.28799 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:37.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.520+0000 7f2e3d5cd740 20 client.28799 populate_metadata read hostname 'smithi003' 2024-09-19T06:24:37.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.520+0000 7f2e3d5cd740 1 --2- 172.21.15.3:0/547041815 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56129774bea0 0x56129774e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:37.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.520+0000 7f2e3d5cd740 4 client.28799 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T06:24:37.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.521+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/547041815 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612976a4950 con 0x56129774bea0 2024-09-19T06:24:37.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.521+0000 7f2e38c00640 1 --2- 172.21.15.3:0/547041815 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56129774bea0 0x56129774e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:37.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.521+0000 7f2e38c00640 1 --2- 172.21.15.3:0/547041815 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56129774bea0 0x56129774e290 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d03e5cc19b813a87 server_cookie=463cda6a715cf0ee in_seq=0 out_seq=0 2024-09-19T06:24:37.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.521+0000 7f2e21600640 10 client.28799 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:24:37.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.522+0000 7f2e21600640 1 -- 172.21.15.3:0/547041815 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5612976a4950 con 0x56129774bea0 2024-09-19T06:24:37.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.522+0000 7f2e21600640 10 client.28799 handle_command_reply: tid=0 2024-09-19T06:24:37.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.522+0000 7f2e3d5cd740 1 client.28799 shutdown 2024-09-19T06:24:37.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.523+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/547041815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561297731590 msgr2=0x561297739260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:37.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.523+0000 7f2e3d5cd740 1 --2- 172.21.15.3:0/547041815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561297731590 0x561297739260 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c02aa70 tx=0x7f2e1c004420 comp rx=0 tx=0).stop 2024-09-19T06:24:37.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.523+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/547041815 shutdown_connections 2024-09-19T06:24:37.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.523+0000 7f2e3d5cd740 1 --2- 172.21.15.3:0/547041815 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x56129774bea0 0x56129774e290 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.523+0000 7f2e3d5cd740 1 --2- 172.21.15.3:0/547041815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56129773be50 0x5612977397a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.523+0000 7f2e3d5cd740 1 --2- 172.21.15.3:0/547041815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561297731590 0x561297739260 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.523+0000 7f2e3d5cd740 1 --2- 172.21.15.3:0/547041815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561297730c70 0x561297738d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.523+0000 7f2e21600640 0 client.28799 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:24:37.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.523+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/547041815 >> 172.21.15.3:0/547041815 conn(0x56129772d200 msgr2=0x56129772c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:37.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.523+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/547041815 shutdown_connections 2024-09-19T06:24:37.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.523+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/547041815 wait complete. 2024-09-19T06:24:37.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.523+0000 7f2e3d5cd740 20 client.28799 trim_cache size 0 max 16384 2024-09-19T06:24:37.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.537+0000 7f2e3d5cd740 1 Processor -- start 2024-09-19T06:24:37.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.537+0000 7f2e3d5cd740 1 -- start start 2024-09-19T06:24:37.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.537+0000 7f2e3d5cd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561297730c70 0x56129772c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:37.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.537+0000 7f2e3d5cd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561297731590 0x561297753aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:37.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.537+0000 7f2e3d5cd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56129773be50 0x561297753fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:37.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.537+0000 7f2e3d5cd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2e341b3fc0 con 0x561297731590 2024-09-19T06:24:37.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.537+0000 7f2e3d5cd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2e341b5b00 con 0x561297730c70 2024-09-19T06:24:37.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.537+0000 7f2e3d5cd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2e341b4690 con 0x56129773be50 2024-09-19T06:24:37.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.538+0000 7f2e38c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561297730c70 0x56129772c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:37.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.538+0000 7f2e2be00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561297731590 0x561297753aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:37.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.538+0000 7f2e38c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561297730c70 0x56129772c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:36296/0 (socket says 172.21.15.3:36296) 2024-09-19T06:24:37.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.538+0000 7f2e38c00640 1 -- 172.21.15.3:0/1571064285 learned_addr learned my addr 172.21.15.3:0/1571064285 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:37.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.538+0000 7f2e38c00640 1 --2- 172.21.15.3:0/1571064285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56129773be50 0x561297753fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:37.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.538+0000 7f2e38c00640 1 -- 172.21.15.3:0/1571064285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56129773be50 msgr2=0x561297753fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:37.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.538+0000 7f2e38c00640 1 --2- 172.21.15.3:0/1571064285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56129773be50 0x561297753fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.538+0000 7f2e38c00640 1 -- 172.21.15.3:0/1571064285 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561297731590 msgr2=0x561297753aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:37.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.538+0000 7f2e38c00640 1 --2- 172.21.15.3:0/1571064285 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561297731590 0x561297753aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.538+0000 7f2e38c00640 1 -- 172.21.15.3:0/1571064285 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56129774e600 con 0x561297730c70 2024-09-19T06:24:37.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.538+0000 7f2e38c00640 1 --2- 172.21.15.3:0/1571064285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561297730c70 0x56129772c270 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c005c40 tx=0x7f2e2c0114f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=738894564964e342 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:37.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.539+0000 7f2e23e00640 1 -- 172.21.15.3:0/1571064285 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c003b50 con 0x561297730c70 2024-09-19T06:24:37.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.539+0000 7f2e23e00640 1 -- 172.21.15.3:0/1571064285 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e2c01f040 con 0x561297730c70 2024-09-19T06:24:37.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.539+0000 7f2e23e00640 1 -- 172.21.15.3:0/1571064285 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c029700 con 0x561297730c70 2024-09-19T06:24:37.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.539+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/1571064285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561297730c70 msgr2=0x56129772c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:37.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.539+0000 7f2e3d5cd740 1 --2- 172.21.15.3:0/1571064285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561297730c70 0x56129772c270 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c005c40 tx=0x7f2e2c0114f0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.539+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/1571064285 shutdown_connections 2024-09-19T06:24:37.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.539+0000 7f2e3d5cd740 1 --2- 172.21.15.3:0/1571064285 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56129773be50 0x561297753fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.539+0000 7f2e3d5cd740 1 --2- 172.21.15.3:0/1571064285 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561297731590 0x561297753aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.539+0000 7f2e3d5cd740 1 --2- 172.21.15.3:0/1571064285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561297730c70 0x56129772c270 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.539+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/1571064285 >> 172.21.15.3:0/1571064285 conn(0x56129772d200 msgr2=0x56129772bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:37.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.539+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/1571064285 shutdown_connections 2024-09-19T06:24:37.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.539+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/1571064285 wait complete. 2024-09-19T06:24:37.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.540+0000 7f2e3d5cd740 1 -- start start 2024-09-19T06:24:37.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.540+0000 7f2e3d5cd740 1 Processor -- start 2024-09-19T06:24:37.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.540+0000 7f2e3d5cd740 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561297730c70 0x56129773ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:37.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.540+0000 7f2e3d5cd740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561297731590 0x561297740460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:37.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.540+0000 7f2e3d5cd740 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56129773be50 0x5612977b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:37.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.540+0000 7f2e3d5cd740 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2e341b5430 con 0x561297730c70 2024-09-19T06:24:37.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.540+0000 7f2e3d5cd740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f2e341b4d60 con 0x561297731590 2024-09-19T06:24:37.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.540+0000 7f2e3d5cd740 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f2e341b1fc0 con 0x56129773be50 2024-09-19T06:24:37.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.540+0000 7f2e3d5cd740 10 client.0 _ll_register_callbacks cb 0x7f2e1c009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T06:24:37.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.541+0000 7f2e2be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561297731590 0x561297740460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:37.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.541+0000 7f2e2be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561297731590 0x561297740460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:36304/0 (socket says 172.21.15.3:36304) 2024-09-19T06:24:37.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.541+0000 7f2e2be00640 1 -- 172.21.15.3:0/3748054467 learned_addr learned my addr 172.21.15.3:0/3748054467 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:37.547 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.541+0000 7f2e38c00640 1 --2- 172.21.15.3:0/3748054467 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561297730c70 0x56129773ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:37.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.541+0000 7f2e2be00640 1 -- 172.21.15.3:0/3748054467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56129773be50 msgr2=0x5612977b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:37.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.541+0000 7f2e38c00640 1 --2- 172.21.15.3:0/3748054467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56129773be50 0x5612977b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:37.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.541+0000 7f2e2be00640 1 --2- 172.21.15.3:0/3748054467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56129773be50 0x5612977b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.541+0000 7f2e2be00640 1 -- 172.21.15.3:0/3748054467 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561297730c70 msgr2=0x56129773ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T06:24:37.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.541+0000 7f2e2be00640 1 --2- 172.21.15.3:0/3748054467 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561297730c70 0x56129773ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.541+0000 7f2e2be00640 1 -- 172.21.15.3:0/3748054467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561297740cf0 con 0x561297731590 2024-09-19T06:24:37.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.541+0000 7f2e38c00640 1 --2- 172.21.15.3:0/3748054467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56129773be50 0x5612977b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:24:37.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.541+0000 7f2e2be00640 1 --2- 172.21.15.3:0/3748054467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561297731590 0x561297740460 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x56129773a360 tx=0x7f2e1c004130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1c5b3f42e3f37c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:37.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.541+0000 7f2e21600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-09-19T06:24:37.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.542+0000 7f2e21600640 1 -- 172.21.15.3:0/3748054467 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c053040 con 0x561297731590 2024-09-19T06:24:37.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.542+0000 7f2e21600640 1 -- 172.21.15.3:0/3748054467 <== mon.2 v2:172.21.15.59:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7f2e1c0037f0 con 0x561297731590 2024-09-19T06:24:37.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.542+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/3748054467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e2c01f040 con 0x561297731590 2024-09-19T06:24:37.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.542+0000 7f2e21600640 1 -- 172.21.15.3:0/3748054467 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2e1c035040 con 0x561297731590 2024-09-19T06:24:37.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.542+0000 7f2e3d5cd740 10 client.28805 fetch_fsmap learned FSMap version 29 2024-09-19T06:24:37.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.542+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/3748054467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5612977b70b0 con 0x561297731590 2024-09-19T06:24:37.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.542+0000 7f2e21600640 1 -- 172.21.15.3:0/3748054467 <== mon.2 v2:172.21.15.59:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e2c01f040 con 0x561297731590 2024-09-19T06:24:37.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.543+0000 7f2e21600640 1 -- 172.21.15.3:0/3748054467 <== mon.2 v2:172.21.15.59:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f2e1c05f070 con 0x561297731590 2024-09-19T06:24:37.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.543+0000 7f2e3d5cd740 10 client.28805 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T06:24:37.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.543+0000 7f2e3d5cd740 10 client.28805 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T06:24:37.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.543+0000 7f2e3d5cd740 20 client.28805 populate_metadata read hostname 'smithi003' 2024-09-19T06:24:37.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.543+0000 7f2e3d5cd740 1 --2- 172.21.15.3:0/3748054467 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5612977b7860 0x5612977b9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:37.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.543+0000 7f2e3d5cd740 4 client.28805 mds_command: new command op to 24557 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T06:24:37.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.543+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/3748054467 --> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56129769ee60 con 0x5612977b7860 2024-09-19T06:24:37.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.543+0000 7f2e38c00640 1 --2- 172.21.15.3:0/3748054467 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5612977b7860 0x5612977b9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:37.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.543+0000 7f2e38c00640 1 --2- 172.21.15.3:0/3748054467 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5612977b7860 0x5612977b9c80 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6069bfd8fbbee938 server_cookie=74f7f99fb46cc87a in_seq=0 out_seq=0 2024-09-19T06:24:37.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.543+0000 7f2e21600640 10 client.28805 ms_handle_connect on v2:172.21.15.59:6838/3162585306 2024-09-19T06:24:37.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.544+0000 7f2e21600640 1 -- 172.21.15.3:0/3748054467 <== mds.0 v2:172.21.15.59:6838/3162585306 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56129769ee60 con 0x5612977b7860 2024-09-19T06:24:37.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.544+0000 7f2e21600640 10 client.28805 handle_command_reply: tid=0 2024-09-19T06:24:37.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.544+0000 7f2e3d5cd740 1 client.28805 shutdown 2024-09-19T06:24:37.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.544+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/3748054467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561297731590 msgr2=0x561297740460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:37.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.544+0000 7f2e3d5cd740 1 --2- 172.21.15.3:0/3748054467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561297731590 0x561297740460 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x56129773a360 tx=0x7f2e1c004130 comp rx=0 tx=0).stop 2024-09-19T06:24:37.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.544+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/3748054467 shutdown_connections 2024-09-19T06:24:37.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.544+0000 7f2e3d5cd740 1 --2- 172.21.15.3:0/3748054467 >> [v2:172.21.15.59:6838/3162585306,v1:172.21.15.59:6839/3162585306] conn(0x5612977b7860 0x5612977b9c80 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.544+0000 7f2e3d5cd740 1 --2- 172.21.15.3:0/3748054467 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x56129773be50 0x5612977b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.544+0000 7f2e3d5cd740 1 --2- 172.21.15.3:0/3748054467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561297731590 0x561297740460 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.544+0000 7f2e3d5cd740 1 --2- 172.21.15.3:0/3748054467 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x561297730c70 0x56129773ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.544+0000 7f2e21600640 0 client.28805 ms_handle_reset on v2:172.21.15.59:6838/3162585306 2024-09-19T06:24:37.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.544+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/3748054467 >> 172.21.15.3:0/3748054467 conn(0x56129772d200 msgr2=0x5612977394e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:37.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.544+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/3748054467 shutdown_connections 2024-09-19T06:24:37.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.544+0000 7f2e3d5cd740 1 -- 172.21.15.3:0/3748054467 wait complete. 2024-09-19T06:24:37.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.544+0000 7f2e3d5cd740 20 client.28805 trim_cache size 0 max 16384 2024-09-19T06:24:37.551 INFO:teuthology.orchestra.run.smithi003.stdout:[] 2024-09-19T06:24:37.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.545+0000 7f2e3ac00640 1 -- 172.21.15.3:0/3687441425 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2e180a3430 msgr2=0x7f2e180a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:37.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.545+0000 7f2e3ac00640 1 --2- 172.21.15.3:0/3687441425 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2e180a3430 0x7f2e180a58f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x56129772e060 tx=0x7f2e240d5530 comp rx=0 tx=0).stop 2024-09-19T06:24:37.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.545+0000 7f2e3ac00640 1 -- 172.21.15.3:0/3687441425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e34074590 msgr2=0x7f2e341a4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:37.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.545+0000 7f2e3ac00640 1 --2- 172.21.15.3:0/3687441425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e34074590 0x7f2e341a4710 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400d950 tx=0x7f2e2400de10 comp rx=0 tx=0).stop 2024-09-19T06:24:37.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.545+0000 7f2e3ac00640 1 -- 172.21.15.3:0/3687441425 shutdown_connections 2024-09-19T06:24:37.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.545+0000 7f2e3ac00640 1 --2- 172.21.15.3:0/3687441425 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f2e180a3430 0x7f2e180a58f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.545+0000 7f2e3ac00640 1 --2- 172.21.15.3:0/3687441425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e34112b90 0x7f2e3419e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.545+0000 7f2e3ac00640 1 --2- 172.21.15.3:0/3687441425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e34074eb0 0x7f2e341a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.545+0000 7f2e3ac00640 1 --2- 172.21.15.3:0/3687441425 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f2e34074590 0x7f2e341a4710 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:37.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.545+0000 7f2e3ac00640 1 -- 172.21.15.3:0/3687441425 >> 172.21.15.3:0/3687441425 conn(0x7f2e340fd8c0 msgr2=0x7f2e340ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:37.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.545+0000 7f2e3ac00640 1 -- 172.21.15.3:0/3687441425 shutdown_connections 2024-09-19T06:24:37.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:37.545+0000 7f2e3ac00640 1 -- 172.21.15.3:0/3687441425 wait complete. 2024-09-19T06:24:38.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:38 smithi059 ceph-mon[35138]: pgmap v382: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:24:38.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:38 smithi003 ceph-mon[30893]: pgmap v382: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:24:38.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:38 smithi071 ceph-mon[35662]: pgmap v382: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:24:38.582 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-19T06:24:38.583 INFO:tasks.fwd_scrub:done joining 2024-09-19T06:24:38.583 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T06:24:38.595 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T06:24:38.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.755+0000 7f6240000640 1 -- 172.21.15.3:0/912432011 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62381048d0 msgr2=0x7f6238108910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:38.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.755+0000 7f6240000640 1 --2- 172.21.15.3:0/912432011 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62381048d0 0x7f6238108910 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f6224009900 tx=0x7f622402a3f0 comp rx=0 tx=0).stop 2024-09-19T06:24:38.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.756+0000 7f6240000640 1 -- 172.21.15.3:0/912432011 shutdown_connections 2024-09-19T06:24:38.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.756+0000 7f6240000640 1 --2- 172.21.15.3:0/912432011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6238109070 0x7f6238110bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:38.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.756+0000 7f6240000640 1 --2- 172.21.15.3:0/912432011 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f62381048d0 0x7f6238108910 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:38.759 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.756+0000 7f6240000640 1 --2- 172.21.15.3:0/912432011 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f6238103f20 0x7f6238104300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:38.759 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.756+0000 7f6240000640 1 -- 172.21.15.3:0/912432011 >> 172.21.15.3:0/912432011 conn(0x7f62380ff950 msgr2=0x7f6238101d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:38.759 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.756+0000 7f6240000640 1 -- 172.21.15.3:0/912432011 shutdown_connections 2024-09-19T06:24:38.759 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.756+0000 7f6240000640 1 -- 172.21.15.3:0/912432011 wait complete. 2024-09-19T06:24:38.759 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.757+0000 7f6240000640 1 Processor -- start 2024-09-19T06:24:38.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.757+0000 7f6240000640 1 -- start start 2024-09-19T06:24:38.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.757+0000 7f6240000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6238103f20 0x7f623819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:38.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.757+0000 7f6240000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6238109070 0x7f623819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:38.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.757+0000 7f6240000640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f623819eeb0 0x7f623819f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:38.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.757+0000 7f6240000640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f62381140e0 con 0x7f6238109070 2024-09-19T06:24:38.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.757+0000 7f6240000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f6238113f60 con 0x7f6238103f20 2024-09-19T06:24:38.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.757+0000 7f6240000640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f6238114260 con 0x7f623819eeb0 2024-09-19T06:24:38.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.757+0000 7f623cc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6238109070 0x7f623819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:38.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.757+0000 7f623d600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6238103f20 0x7f623819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:38.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.757+0000 7f623cc00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6238109070 0x7f623819ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36844/0 (socket says 172.21.15.3:36844) 2024-09-19T06:24:38.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.757+0000 7f623cc00640 1 -- 172.21.15.3:0/2451366460 learned_addr learned my addr 172.21.15.3:0/2451366460 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:38.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.757+0000 7f623e000640 1 --2- 172.21.15.3:0/2451366460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f623819eeb0 0x7f623819f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:38.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.758+0000 7f623d600640 1 -- 172.21.15.3:0/2451366460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f623819eeb0 msgr2=0x7f623819f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:38.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.758+0000 7f623d600640 1 --2- 172.21.15.3:0/2451366460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f623819eeb0 0x7f623819f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:38.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.758+0000 7f623d600640 1 -- 172.21.15.3:0/2451366460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6238109070 msgr2=0x7f623819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:38.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.758+0000 7f623d600640 1 --2- 172.21.15.3:0/2451366460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6238109070 0x7f623819ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:38.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.758+0000 7f623d600640 1 -- 172.21.15.3:0/2451366460 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623819f9a0 con 0x7f6238103f20 2024-09-19T06:24:38.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.758+0000 7f623cc00640 1 --2- 172.21.15.3:0/2451366460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6238109070 0x7f623819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:38.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.758+0000 7f623d600640 1 --2- 172.21.15.3:0/2451366460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6238103f20 0x7f623819a5f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f622c00e9f0 tx=0x7f622c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:38.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.758+0000 7f6236000640 1 -- 172.21.15.3:0/2451366460 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c00ccc0 con 0x7f6238103f20 2024-09-19T06:24:38.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.758+0000 7f6240000640 1 -- 172.21.15.3:0/2451366460 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f623819fc90 con 0x7f6238103f20 2024-09-19T06:24:38.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.758+0000 7f6236000640 1 -- 172.21.15.3:0/2451366460 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f622c005020 con 0x7f6238103f20 2024-09-19T06:24:38.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.758+0000 7f6236000640 1 -- 172.21.15.3:0/2451366460 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c0049e0 con 0x7f6238103f20 2024-09-19T06:24:38.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.758+0000 7f6240000640 1 -- 172.21.15.3:0/2451366460 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62381a7480 con 0x7f6238103f20 2024-09-19T06:24:38.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.759+0000 7f6240000640 1 -- 172.21.15.3:0/2451366460 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6238104300 con 0x7f6238103f20 2024-09-19T06:24:38.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.762+0000 7f6236000640 1 -- 172.21.15.3:0/2451366460 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f622c005560 con 0x7f6238103f20 2024-09-19T06:24:38.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.763+0000 7f6236000640 1 --2- 172.21.15.3:0/2451366460 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f62200a33c0 0x7f62200a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:38.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.763+0000 7f6236000640 1 -- 172.21.15.3:0/2451366460 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7f622c0cfdc0 con 0x7f6238103f20 2024-09-19T06:24:38.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.763+0000 7f623cc00640 1 --2- 172.21.15.3:0/2451366460 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f62200a33c0 0x7f62200a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:38.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.764+0000 7f623cc00640 1 --2- 172.21.15.3:0/2451366460 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f62200a33c0 0x7f62200a5880 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f62381001c0 tx=0x7f6224031510 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:38.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.765+0000 7f6236000640 1 -- 172.21.15.3:0/2451366460 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f622c0051d0 con 0x7f6238103f20 2024-09-19T06:24:38.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.951+0000 7f6240000640 1 -- 172.21.15.3:0/2451366460 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f623810c2b0 con 0x7f6238103f20 2024-09-19T06:24:38.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.954+0000 7f6236000640 1 -- 172.21.15.3:0/2451366460 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+23048 (secure 0 0 0) 0x7f622c09c7a0 con 0x7f6238103f20 2024-09-19T06:24:38.955 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:24:38.955 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":101,"fsid":"782a5144-764c-11ef-bceb-c7b262605968","created":"2024-09-19T06:01:35.224753+0000","modified":"2024-09-19T06:24:16.969327+0000","last_up_change":"2024-09-19T06:09:02.478979+0000","last_in_change":"2024-09-19T06:08:38.865280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:04:56.654478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:09:58.426008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:10:01.215704+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":100,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd89ea4b-a24e-4946-80fc-1776b6d05e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6803","nonce":2061486638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6805","nonce":2061486638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6809","nonce":2061486638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6807","nonce":2061486638}]},"public_addr":"172.21.15.3:6803/2061486638","cluster_addr":"172.21.15.3:6805/2061486638","heartbeat_back_addr":"172.21.15.3:6809/2061486638","heartbeat_front_addr":"172.21.15.3:6807/2061486638","state":["exists","up"]},{"osd":1,"uuid":"e03ca275-8da5-402f-9cd2-654ca422b9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6801","nonce":129318538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6803","nonce":129318538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6807","nonce":129318538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6805","nonce":129318538}]},"public_addr":"172.21.15.59:6801/129318538","cluster_addr":"172.21.15.59:6803/129318538","heartbeat_back_addr":"172.21.15.59:6807/129318538","heartbeat_front_addr":"172.21.15.59:6805/129318538","state":["exists","up"]},{"osd":2,"uuid":"62b7d36d-6078-4027-93b2-009be70a6d80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6801","nonce":2436210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6803","nonce":2436210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6807","nonce":2436210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6805","nonce":2436210695}]},"public_addr":"172.21.15.71:6801/2436210695","cluster_addr":"172.21.15.71:6803/2436210695","heartbeat_back_addr":"172.21.15.71:6807/2436210695","heartbeat_front_addr":"172.21.15.71:6805/2436210695","state":["exists","up"]},{"osd":3,"uuid":"ba33cc45-0103-443d-b262-622a505d9806","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6811","nonce":3577306700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6813","nonce":3577306700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6817","nonce":3577306700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6815","nonce":3577306700}]},"public_addr":"172.21.15.3:6811/3577306700","cluster_addr":"172.21.15.3:6813/3577306700","heartbeat_back_addr":"172.21.15.3:6817/3577306700","heartbeat_front_addr":"172.21.15.3:6815/3577306700","state":["exists","up"]},{"osd":4,"uuid":"40564c0c-6335-4207-a8e0-8078c9bfd015","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6809","nonce":4002980986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6811","nonce":4002980986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6815","nonce":4002980986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6813","nonce":4002980986}]},"public_addr":"172.21.15.59:6809/4002980986","cluster_addr":"172.21.15.59:6811/4002980986","heartbeat_back_addr":"172.21.15.59:6815/4002980986","heartbeat_front_addr":"172.21.15.59:6813/4002980986","state":["exists","up"]},{"osd":5,"uuid":"4db04b82-3403-4fd5-9eb7-7b81ed6b1d26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6809","nonce":2455500497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6811","nonce":2455500497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6815","nonce":2455500497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6813","nonce":2455500497}]},"public_addr":"172.21.15.71:6809/2455500497","cluster_addr":"172.21.15.71:6811/2455500497","heartbeat_back_addr":"172.21.15.71:6815/2455500497","heartbeat_front_addr":"172.21.15.71:6813/2455500497","state":["exists","up"]},{"osd":6,"uuid":"42a74f01-c5d0-4fc6-a8ee-a8bd84d4ab4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6819","nonce":823411903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6821","nonce":823411903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6825","nonce":823411903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6823","nonce":823411903}]},"public_addr":"172.21.15.3:6819/823411903","cluster_addr":"172.21.15.3:6821/823411903","heartbeat_back_addr":"172.21.15.3:6825/823411903","heartbeat_front_addr":"172.21.15.3:6823/823411903","state":["exists","up"]},{"osd":7,"uuid":"8a9bc2ec-4292-465d-8a0d-dda78521a319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6817","nonce":2133603853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6819","nonce":2133603853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6823","nonce":2133603853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6821","nonce":2133603853}]},"public_addr":"172.21.15.59:6817/2133603853","cluster_addr":"172.21.15.59:6819/2133603853","heartbeat_back_addr":"172.21.15.59:6823/2133603853","heartbeat_front_addr":"172.21.15.59:6821/2133603853","state":["exists","up"]},{"osd":8,"uuid":"6099a5c4-3504-43ca-8c58-d23f9096cd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6817","nonce":905333117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6819","nonce":905333117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6823","nonce":905333117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6821","nonce":905333117}]},"public_addr":"172.21.15.71:6817/905333117","cluster_addr":"172.21.15.71:6819/905333117","heartbeat_back_addr":"172.21.15.71:6823/905333117","heartbeat_front_addr":"172.21.15.71:6821/905333117","state":["exists","up"]},{"osd":9,"uuid":"b5a8aac6-bb10-4db8-a056-25228fbe754c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6827","nonce":124909267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6829","nonce":124909267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6833","nonce":124909267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6831","nonce":124909267}]},"public_addr":"172.21.15.3:6827/124909267","cluster_addr":"172.21.15.3:6829/124909267","heartbeat_back_addr":"172.21.15.3:6833/124909267","heartbeat_front_addr":"172.21.15.3:6831/124909267","state":["exists","up"]},{"osd":10,"uuid":"e49f3aab-0804-4aea-ae3f-38f022ab5239","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6825","nonce":784134238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6827","nonce":784134238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6831","nonce":784134238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6829","nonce":784134238}]},"public_addr":"172.21.15.59:6825/784134238","cluster_addr":"172.21.15.59:6827/784134238","heartbeat_back_addr":"172.21.15.59:6831/784134238","heartbeat_front_addr":"172.21.15.59:6829/784134238","state":["exists","up"]},{"osd":11,"uuid":"6c6d6c23-bcf7-43e7-94d1-5f2ebaa15441","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6825","nonce":3502550915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6827","nonce":3502550915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6831","nonce":3502550915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6829","nonce":3502550915}]},"public_addr":"172.21.15.71:6825/3502550915","cluster_addr":"172.21.15.71:6827/3502550915","heartbeat_back_addr":"172.21.15.71:6831/3502550915","heartbeat_front_addr":"172.21.15.71:6829/3502550915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:01.683342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:28.058683+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:53.250819+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:05:23.267377+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:05:49.756289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:06:15.766613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:06:46.054328+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:12.579180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:37.976863+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:08.683966+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:35.120765+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:00.624411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/3104337397":"2024-09-20T06:12:22.409669+0000","172.21.15.3:0/4101082351":"2024-09-20T06:12:22.409669+0000","172.21.15.3:0/3358701720":"2024-09-20T06:12:22.409669+0000","172.21.15.3:0/1616091100":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/3155841850":"2024-09-20T06:12:22.409669+0000","172.21.15.3:6800/2386230415":"2024-09-20T06:02:01.122348+0000","172.21.15.3:0/2122482494":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6801/2386230415":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6800/1278931596":"2024-09-20T06:12:22.409669+0000","172.21.15.3:0/1658697906":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6801/518259590":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/953348594":"2024-09-20T06:02:01.122348+0000","172.21.15.3:0/2065281908":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/1458736313":"2024-09-20T06:02:30.039686+0000","172.21.15.3:6800/518259590":"2024-09-20T06:02:30.039686+0000","172.21.15.3:6801/1278931596":"2024-09-20T06:12:22.409669+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":7,"length":1},{"begin":19,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:24:38.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.955+0000 7f6240000640 1 -- 172.21.15.3:0/2451366460 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f62200a33c0 msgr2=0x7f62200a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:38.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.955+0000 7f6240000640 1 --2- 172.21.15.3:0/2451366460 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f62200a33c0 0x7f62200a5880 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f62381001c0 tx=0x7f6224031510 comp rx=0 tx=0).stop 2024-09-19T06:24:38.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.955+0000 7f6240000640 1 -- 172.21.15.3:0/2451366460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6238103f20 msgr2=0x7f623819a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:38.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.955+0000 7f6240000640 1 --2- 172.21.15.3:0/2451366460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6238103f20 0x7f623819a5f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f622c00e9f0 tx=0x7f622c00eeb0 comp rx=0 tx=0).stop 2024-09-19T06:24:38.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.955+0000 7f6240000640 1 -- 172.21.15.3:0/2451366460 shutdown_connections 2024-09-19T06:24:38.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.955+0000 7f6240000640 1 --2- 172.21.15.3:0/2451366460 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f62200a33c0 0x7f62200a5880 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:38.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.955+0000 7f6240000640 1 --2- 172.21.15.3:0/2451366460 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f623819eeb0 0x7f623819f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:38.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.955+0000 7f6240000640 1 --2- 172.21.15.3:0/2451366460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6238109070 0x7f623819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:38.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.955+0000 7f6240000640 1 --2- 172.21.15.3:0/2451366460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6238103f20 0x7f623819a5f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:38.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.955+0000 7f6240000640 1 -- 172.21.15.3:0/2451366460 >> 172.21.15.3:0/2451366460 conn(0x7f62380ff950 msgr2=0x7f6238100cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:38.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.955+0000 7f6240000640 1 -- 172.21.15.3:0/2451366460 shutdown_connections 2024-09-19T06:24:38.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:38.955+0000 7f6240000640 1 -- 172.21.15.3:0/2451366460 wait complete. 2024-09-19T06:24:38.974 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T06:04:56.654478+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T06:09:58.426008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T06:10:01.215704+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 19, 'snap_epoch': 100, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T06:24:38.975 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T06:24:39.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.136+0000 7f5872400640 1 -- 172.21.15.3:0/1380926327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f586c10bec0 msgr2=0x7f586c10e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:39.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.136+0000 7f5872400640 1 --2- 172.21.15.3:0/1380926327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f586c10bec0 0x7f586c10e340 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f5864009be0 tx=0x7f586402a750 comp rx=0 tx=0).stop 2024-09-19T06:24:39.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.136+0000 7f5872400640 1 -- 172.21.15.3:0/1380926327 shutdown_connections 2024-09-19T06:24:39.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.136+0000 7f5872400640 1 --2- 172.21.15.3:0/1380926327 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f586c10bec0 0x7f586c10e340 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:39.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.136+0000 7f5872400640 1 --2- 172.21.15.3:0/1380926327 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f586c103390 0x7f586c10b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:39.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.136+0000 7f5872400640 1 --2- 172.21.15.3:0/1380926327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f586c102a70 0x7f586c102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:39.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.136+0000 7f5872400640 1 -- 172.21.15.3:0/1380926327 >> 172.21.15.3:0/1380926327 conn(0x7f586c077780 msgr2=0x7f586c0feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:39.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.136+0000 7f5872400640 1 -- 172.21.15.3:0/1380926327 shutdown_connections 2024-09-19T06:24:39.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.136+0000 7f5872400640 1 -- 172.21.15.3:0/1380926327 wait complete. 2024-09-19T06:24:39.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.137+0000 7f5872400640 1 Processor -- start 2024-09-19T06:24:39.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.137+0000 7f5872400640 1 -- start start 2024-09-19T06:24:39.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.138+0000 7f5872400640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f586c102a70 0x7f586c19a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:39.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.138+0000 7f5872400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f586c103390 0x7f586c19a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:39.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.138+0000 7f5872400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f586c10bec0 0x7f586c19ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:39.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.138+0000 7f5872400640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f586c111c30 con 0x7f586c102a70 2024-09-19T06:24:39.141 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.138+0000 7f5872400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f586c111ab0 con 0x7f586c103390 2024-09-19T06:24:39.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.138+0000 7f5872400640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f586c111db0 con 0x7f586c10bec0 2024-09-19T06:24:39.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.138+0000 7f5871000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f586c102a70 0x7f586c19a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:39.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.138+0000 7f5871000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f586c102a70 0x7f586c19a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36860/0 (socket says 172.21.15.3:36860) 2024-09-19T06:24:39.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.138+0000 7f5871000640 1 -- 172.21.15.3:0/1421557518 learned_addr learned my addr 172.21.15.3:0/1421557518 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:39.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.138+0000 7f586be00640 1 --2- 172.21.15.3:0/1421557518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f586c103390 0x7f586c19a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:39.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.138+0000 7f5871a00640 1 --2- 172.21.15.3:0/1421557518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f586c10bec0 0x7f586c19ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:39.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.138+0000 7f5871000640 1 -- 172.21.15.3:0/1421557518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f586c10bec0 msgr2=0x7f586c19ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:39.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.138+0000 7f5871000640 1 --2- 172.21.15.3:0/1421557518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f586c10bec0 0x7f586c19ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:39.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.138+0000 7f5871000640 1 -- 172.21.15.3:0/1421557518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f586c103390 msgr2=0x7f586c19a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:39.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.138+0000 7f5871000640 1 --2- 172.21.15.3:0/1421557518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f586c103390 0x7f586c19a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:39.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.138+0000 7f5871000640 1 -- 172.21.15.3:0/1421557518 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f586c19f3a0 con 0x7f586c102a70 2024-09-19T06:24:39.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.138+0000 7f5871a00640 1 --2- 172.21.15.3:0/1421557518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f586c10bec0 0x7f586c19ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:39.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.139+0000 7f5871000640 1 --2- 172.21.15.3:0/1421557518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f586c102a70 0x7f586c19a3b0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f586000e9c0 tx=0x7f586000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:39.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.139+0000 7f5869600640 1 -- 172.21.15.3:0/1421557518 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586000cde0 con 0x7f586c102a70 2024-09-19T06:24:39.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.139+0000 7f5869600640 1 -- 172.21.15.3:0/1421557518 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58600035f0 con 0x7f586c102a70 2024-09-19T06:24:39.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.139+0000 7f5869600640 1 -- 172.21.15.3:0/1421557518 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5860010690 con 0x7f586c102a70 2024-09-19T06:24:39.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.139+0000 7f5872400640 1 -- 172.21.15.3:0/1421557518 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f586c19f690 con 0x7f586c102a70 2024-09-19T06:24:39.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.139+0000 7f5872400640 1 -- 172.21.15.3:0/1421557518 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f586c1a6f20 con 0x7f586c102a70 2024-09-19T06:24:39.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.140+0000 7f5872400640 1 -- 172.21.15.3:0/1421557518 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f586c102e50 con 0x7f586c102a70 2024-09-19T06:24:39.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.143+0000 7f5869600640 1 -- 172.21.15.3:0/1421557518 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f58600037a0 con 0x7f586c102a70 2024-09-19T06:24:39.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.144+0000 7f5869600640 1 --2- 172.21.15.3:0/1421557518 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f58540a3440 0x7f58540a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:39.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.144+0000 7f5869600640 1 -- 172.21.15.3:0/1421557518 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7f58600d00e0 con 0x7f586c102a70 2024-09-19T06:24:39.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.144+0000 7f586be00640 1 --2- 172.21.15.3:0/1421557518 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f58540a3440 0x7f58540a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:39.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.145+0000 7f586be00640 1 --2- 172.21.15.3:0/1421557518 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f58540a3440 0x7f58540a5900 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f586c102650 tx=0x7f5858005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:39.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.148+0000 7f5869600640 1 -- 172.21.15.3:0/1421557518 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f586009ca30 con 0x7f586c102a70 2024-09-19T06:24:39.230 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:39 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2451366460' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:24:39.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:39 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2451366460' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:24:39.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:39 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2451366460' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:24:39.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.336+0000 7f5872400640 1 -- 172.21.15.3:0/1421557518 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f586c1a7240 con 0x7f586c102a70 2024-09-19T06:24:39.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.337+0000 7f5869600640 1 -- 172.21.15.3:0/1421557518 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v101) ==== 93+0+10 (secure 0 0 0) 0x7f586009c330 con 0x7f586c102a70 2024-09-19T06:24:39.339 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2024-09-19T06:24:39.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.339+0000 7f5872400640 1 -- 172.21.15.3:0/1421557518 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f58540a3440 msgr2=0x7f58540a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:39.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.339+0000 7f5872400640 1 --2- 172.21.15.3:0/1421557518 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f58540a3440 0x7f58540a5900 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f586c102650 tx=0x7f5858005f90 comp rx=0 tx=0).stop 2024-09-19T06:24:39.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.340+0000 7f5872400640 1 -- 172.21.15.3:0/1421557518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f586c102a70 msgr2=0x7f586c19a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:39.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.340+0000 7f5872400640 1 --2- 172.21.15.3:0/1421557518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f586c102a70 0x7f586c19a3b0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f586000e9c0 tx=0x7f586000ee80 comp rx=0 tx=0).stop 2024-09-19T06:24:39.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.340+0000 7f5872400640 1 -- 172.21.15.3:0/1421557518 shutdown_connections 2024-09-19T06:24:39.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.340+0000 7f5872400640 1 --2- 172.21.15.3:0/1421557518 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f58540a3440 0x7f58540a5900 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:39.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.340+0000 7f5872400640 1 --2- 172.21.15.3:0/1421557518 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f586c10bec0 0x7f586c19ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:39.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.340+0000 7f5872400640 1 --2- 172.21.15.3:0/1421557518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f586c103390 0x7f586c19a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:39.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.340+0000 7f5872400640 1 --2- 172.21.15.3:0/1421557518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f586c102a70 0x7f586c19a3b0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:39.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.340+0000 7f5872400640 1 -- 172.21.15.3:0/1421557518 >> 172.21.15.3:0/1421557518 conn(0x7f586c077780 msgr2=0x7f586c0fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:39.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.340+0000 7f5872400640 1 -- 172.21.15.3:0/1421557518 shutdown_connections 2024-09-19T06:24:39.342 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.340+0000 7f5872400640 1 -- 172.21.15.3:0/1421557518 wait complete. 2024-09-19T06:24:39.358 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T06:24:39.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.519+0000 7f3ae5c00640 1 -- 172.21.15.3:0/496196239 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ae0109ad0 msgr2=0x7f3ae0109eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:39.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.519+0000 7f3ae5c00640 1 --2- 172.21.15.3:0/496196239 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ae0109ad0 0x7f3ae0109eb0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009930 tx=0x7f3ad002a420 comp rx=0 tx=0).stop 2024-09-19T06:24:39.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.520+0000 7f3ae5c00640 1 -- 172.21.15.3:0/496196239 shutdown_connections 2024-09-19T06:24:39.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.520+0000 7f3ae5c00640 1 --2- 172.21.15.3:0/496196239 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ae0104460 0x7f3ae0110990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:39.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.520+0000 7f3ae5c00640 1 --2- 172.21.15.3:0/496196239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ae0103ac0 0x7f3ae0103f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:39.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.520+0000 7f3ae5c00640 1 --2- 172.21.15.3:0/496196239 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ae0109ad0 0x7f3ae0109eb0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:39.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.520+0000 7f3ae5c00640 1 -- 172.21.15.3:0/496196239 >> 172.21.15.3:0/496196239 conn(0x7f3ae00ff7a0 msgr2=0x7f3ae0101bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:39.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.520+0000 7f3ae5c00640 1 -- 172.21.15.3:0/496196239 shutdown_connections 2024-09-19T06:24:39.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.520+0000 7f3ae5c00640 1 -- 172.21.15.3:0/496196239 wait complete. 2024-09-19T06:24:39.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.520+0000 7f3ae5c00640 1 Processor -- start 2024-09-19T06:24:39.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.521+0000 7f3ae5c00640 1 -- start start 2024-09-19T06:24:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.521+0000 7f3ae5c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ae0103ac0 0x7f3ae019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.521+0000 7f3ae5c00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ae0104460 0x7f3ae019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.521+0000 7f3ae5c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ae0109ad0 0x7f3ae019ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.521+0000 7f3ae5c00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0113f10 con 0x7f3ae0103ac0 2024-09-19T06:24:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.521+0000 7f3ae5c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0113d90 con 0x7f3ae0109ad0 2024-09-19T06:24:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.521+0000 7f3ae5c00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0114090 con 0x7f3ae0104460 2024-09-19T06:24:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.521+0000 7f3adfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ae0103ac0 0x7f3ae019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.521+0000 7f3adfe00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ae0103ac0 0x7f3ae019a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36880/0 (socket says 172.21.15.3:36880) 2024-09-19T06:24:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.521+0000 7f3adfe00640 1 -- 172.21.15.3:0/469632185 learned_addr learned my addr 172.21.15.3:0/469632185 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.521+0000 7f3ae5200640 1 --2- 172.21.15.3:0/469632185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ae0109ad0 0x7f3ae019ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.521+0000 7f3ad7e00640 1 --2- 172.21.15.3:0/469632185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ae0104460 0x7f3ae019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.522+0000 7f3adfe00640 1 -- 172.21.15.3:0/469632185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ae0104460 msgr2=0x7f3ae019a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:39.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.522+0000 7f3adfe00640 1 --2- 172.21.15.3:0/469632185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ae0104460 0x7f3ae019a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:39.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.522+0000 7f3adfe00640 1 -- 172.21.15.3:0/469632185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ae0109ad0 msgr2=0x7f3ae019ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:39.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.522+0000 7f3adfe00640 1 --2- 172.21.15.3:0/469632185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ae0109ad0 0x7f3ae019ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:39.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.522+0000 7f3adfe00640 1 -- 172.21.15.3:0/469632185 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae019f450 con 0x7f3ae0103ac0 2024-09-19T06:24:39.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.522+0000 7f3ad7e00640 1 --2- 172.21.15.3:0/469632185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ae0104460 0x7f3ae019a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:24:39.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.522+0000 7f3adfe00640 1 --2- 172.21.15.3:0/469632185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ae0103ac0 0x7f3ae019a460 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009230 tx=0x7f3ad0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:39.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.522+0000 7f3add600640 1 -- 172.21.15.3:0/469632185 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad003f030 con 0x7f3ae0103ac0 2024-09-19T06:24:39.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.522+0000 7f3add600640 1 -- 172.21.15.3:0/469632185 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ad0004440 con 0x7f3ae0103ac0 2024-09-19T06:24:39.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.522+0000 7f3add600640 1 -- 172.21.15.3:0/469632185 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0035070 con 0x7f3ae0103ac0 2024-09-19T06:24:39.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.522+0000 7f3ae5c00640 1 -- 172.21.15.3:0/469632185 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae019f6e0 con 0x7f3ae0103ac0 2024-09-19T06:24:39.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.522+0000 7f3ae5c00640 1 -- 172.21.15.3:0/469632185 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae01a6fd0 con 0x7f3ae0103ac0 2024-09-19T06:24:39.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.523+0000 7f3ae5c00640 1 -- 172.21.15.3:0/469632185 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ae0103f20 con 0x7f3ae0103ac0 2024-09-19T06:24:39.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.526+0000 7f3add600640 1 -- 172.21.15.3:0/469632185 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f3ad0042030 con 0x7f3ae0103ac0 2024-09-19T06:24:39.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.527+0000 7f3add600640 1 --2- 172.21.15.3:0/469632185 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3ac40a3440 0x7f3ac40a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:39.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.527+0000 7f3add600640 1 -- 172.21.15.3:0/469632185 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7f3ad00f0090 con 0x7f3ae0103ac0 2024-09-19T06:24:39.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.527+0000 7f3ad7e00640 1 --2- 172.21.15.3:0/469632185 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3ac40a3440 0x7f3ac40a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:39.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.528+0000 7f3ad7e00640 1 --2- 172.21.15.3:0/469632185 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3ac40a3440 0x7f3ac40a5900 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0101e60 tx=0x7f3ac8005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:39.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.531+0000 7f3add600640 1 -- 172.21.15.3:0/469632185 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3ad00bc9e0 con 0x7f3ae0103ac0 2024-09-19T06:24:39.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.716+0000 7f3ae5c00640 1 -- 172.21.15.3:0/469632185 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3ae010c030 con 0x7f3ae0103ac0 2024-09-19T06:24:39.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.717+0000 7f3add600640 1 -- 172.21.15.3:0/469632185 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v101) ==== 104+0+11 (secure 0 0 0) 0x7f3ad00bc2e0 con 0x7f3ae0103ac0 2024-09-19T06:24:39.719 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 32 2024-09-19T06:24:39.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.719+0000 7f3ae5c00640 1 -- 172.21.15.3:0/469632185 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3ac40a3440 msgr2=0x7f3ac40a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:39.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.719+0000 7f3ae5c00640 1 --2- 172.21.15.3:0/469632185 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3ac40a3440 0x7f3ac40a5900 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0101e60 tx=0x7f3ac8005f90 comp rx=0 tx=0).stop 2024-09-19T06:24:39.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.719+0000 7f3ae5c00640 1 -- 172.21.15.3:0/469632185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ae0103ac0 msgr2=0x7f3ae019a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:39.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.719+0000 7f3ae5c00640 1 --2- 172.21.15.3:0/469632185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ae0103ac0 0x7f3ae019a460 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009230 tx=0x7f3ad0004040 comp rx=0 tx=0).stop 2024-09-19T06:24:39.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.719+0000 7f3ae5c00640 1 -- 172.21.15.3:0/469632185 shutdown_connections 2024-09-19T06:24:39.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.719+0000 7f3ae5c00640 1 --2- 172.21.15.3:0/469632185 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3ac40a3440 0x7f3ac40a5900 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:39.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.719+0000 7f3ae5c00640 1 --2- 172.21.15.3:0/469632185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ae0109ad0 0x7f3ae019ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:39.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.719+0000 7f3ae5c00640 1 --2- 172.21.15.3:0/469632185 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3ae0104460 0x7f3ae019a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:39.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.719+0000 7f3ae5c00640 1 --2- 172.21.15.3:0/469632185 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3ae0103ac0 0x7f3ae019a460 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:39.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.719+0000 7f3ae5c00640 1 -- 172.21.15.3:0/469632185 >> 172.21.15.3:0/469632185 conn(0x7f3ae00ff7a0 msgr2=0x7f3ae0100020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:39.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.719+0000 7f3ae5c00640 1 -- 172.21.15.3:0/469632185 shutdown_connections 2024-09-19T06:24:39.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.719+0000 7f3ae5c00640 1 -- 172.21.15.3:0/469632185 wait complete. 2024-09-19T06:24:39.737 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T06:24:39.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.899+0000 7f1119e00640 1 -- 172.21.15.3:0/1629646198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1114076720 msgr2=0x7f1114076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:39.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.899+0000 7f1119e00640 1 --2- 172.21.15.3:0/1629646198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1114076720 0x7f1114076b00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1104009900 tx=0x7f110402a410 comp rx=0 tx=0).stop 2024-09-19T06:24:39.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.900+0000 7f1119e00640 1 -- 172.21.15.3:0/1629646198 shutdown_connections 2024-09-19T06:24:39.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.900+0000 7f1119e00640 1 --2- 172.21.15.3:0/1629646198 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1114112950 0x7f1114114d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:39.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.900+0000 7f1119e00640 1 --2- 172.21.15.3:0/1629646198 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1114077040 0x7f1114112410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:39.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.900+0000 7f1119e00640 1 --2- 172.21.15.3:0/1629646198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1114076720 0x7f1114076b00 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:39.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.900+0000 7f1119e00640 1 -- 172.21.15.3:0/1629646198 >> 172.21.15.3:0/1629646198 conn(0x7f11140ff930 msgr2=0x7f1114101d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:39.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.900+0000 7f1119e00640 1 -- 172.21.15.3:0/1629646198 shutdown_connections 2024-09-19T06:24:39.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.900+0000 7f1119e00640 1 -- 172.21.15.3:0/1629646198 wait complete. 2024-09-19T06:24:39.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.901+0000 7f1119e00640 1 Processor -- start 2024-09-19T06:24:39.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.901+0000 7f1119e00640 1 -- start start 2024-09-19T06:24:39.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.901+0000 7f1119e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1114076720 0x7f11141a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:39.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.901+0000 7f1119e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1114077040 0x7f11141a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:39.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.901+0000 7f1119e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1114112950 0x7f111419e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:39.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.901+0000 7f1119e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f11141184d0 con 0x7f1114076720 2024-09-19T06:24:39.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.901+0000 7f1119e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f1114118350 con 0x7f1114077040 2024-09-19T06:24:39.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.901+0000 7f1119e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f1114118650 con 0x7f1114112950 2024-09-19T06:24:39.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.901+0000 7f1112a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1114076720 0x7f11141a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:39.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.901+0000 7f1112a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1114076720 0x7f11141a46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36898/0 (socket says 172.21.15.3:36898) 2024-09-19T06:24:39.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.901+0000 7f1112a00640 1 -- 172.21.15.3:0/3705857348 learned_addr learned my addr 172.21.15.3:0/3705857348 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:39.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.901+0000 7f110a000640 1 --2- 172.21.15.3:0/3705857348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1114077040 0x7f11141a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:39.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.902+0000 7f1113400640 1 --2- 172.21.15.3:0/3705857348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1114112950 0x7f111419e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:39.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.902+0000 7f1112a00640 1 -- 172.21.15.3:0/3705857348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1114112950 msgr2=0x7f111419e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:39.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.902+0000 7f1112a00640 1 --2- 172.21.15.3:0/3705857348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1114112950 0x7f111419e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:39.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.902+0000 7f1112a00640 1 -- 172.21.15.3:0/3705857348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1114077040 msgr2=0x7f11141a4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:39.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.902+0000 7f1112a00640 1 --2- 172.21.15.3:0/3705857348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1114077040 0x7f11141a4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:39.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.902+0000 7f1112a00640 1 -- 172.21.15.3:0/3705857348 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111419f020 con 0x7f1114076720 2024-09-19T06:24:39.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.902+0000 7f110a000640 1 --2- 172.21.15.3:0/3705857348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1114077040 0x7f11141a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:39.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.902+0000 7f1112a00640 1 --2- 172.21.15.3:0/3705857348 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1114076720 0x7f11141a46f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f1104006010 tx=0x7f1104004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:39.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.902+0000 7f1118a00640 1 -- 172.21.15.3:0/3705857348 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110403f030 con 0x7f1114076720 2024-09-19T06:24:39.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.903+0000 7f1119e00640 1 -- 172.21.15.3:0/3705857348 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f111419f2b0 con 0x7f1114076720 2024-09-19T06:24:39.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.903+0000 7f1118a00640 1 -- 172.21.15.3:0/3705857348 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1104004440 con 0x7f1114076720 2024-09-19T06:24:39.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.903+0000 7f1118a00640 1 -- 172.21.15.3:0/3705857348 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1104035070 con 0x7f1114076720 2024-09-19T06:24:39.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.903+0000 7f1119e00640 1 -- 172.21.15.3:0/3705857348 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11141ab5b0 con 0x7f1114076720 2024-09-19T06:24:39.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.904+0000 7f1119e00640 1 -- 172.21.15.3:0/3705857348 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1114076b00 con 0x7f1114076720 2024-09-19T06:24:39.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.906+0000 7f1118a00640 1 -- 172.21.15.3:0/3705857348 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f1104042030 con 0x7f1114076720 2024-09-19T06:24:39.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.907+0000 7f1118a00640 1 --2- 172.21.15.3:0/3705857348 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f10f80a33c0 0x7f10f80a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:39.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.907+0000 7f1118a00640 1 -- 172.21.15.3:0/3705857348 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7f11040efff0 con 0x7f1114076720 2024-09-19T06:24:39.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.907+0000 7f110a000640 1 --2- 172.21.15.3:0/3705857348 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f10f80a33c0 0x7f10f80a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:39.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.908+0000 7f110a000640 1 --2- 172.21.15.3:0/3705857348 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f10f80a33c0 0x7f10f80a5880 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f11140792b0 tx=0x7f10fc005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:39.913 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:39.911+0000 7f1118a00640 1 -- 172.21.15.3:0/3705857348 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f11040bc940 con 0x7f1114076720 2024-09-19T06:24:40.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.097+0000 7f1119e00640 1 -- 172.21.15.3:0/3705857348 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f11141ab780 con 0x7f1114076720 2024-09-19T06:24:40.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.097+0000 7f1118a00640 1 -- 172.21.15.3:0/3705857348 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v101) ==== 100+0+11 (secure 0 0 0) 0x7f11040bc240 con 0x7f1114076720 2024-09-19T06:24:40.099 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 64 2024-09-19T06:24:40.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.099+0000 7f1119e00640 1 -- 172.21.15.3:0/3705857348 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f10f80a33c0 msgr2=0x7f10f80a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:40.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.099+0000 7f1119e00640 1 --2- 172.21.15.3:0/3705857348 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f10f80a33c0 0x7f10f80a5880 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f11140792b0 tx=0x7f10fc005f90 comp rx=0 tx=0).stop 2024-09-19T06:24:40.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.099+0000 7f1119e00640 1 -- 172.21.15.3:0/3705857348 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1114076720 msgr2=0x7f11141a46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:40.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.099+0000 7f1119e00640 1 --2- 172.21.15.3:0/3705857348 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1114076720 0x7f11141a46f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f1104006010 tx=0x7f1104004040 comp rx=0 tx=0).stop 2024-09-19T06:24:40.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.099+0000 7f1119e00640 1 -- 172.21.15.3:0/3705857348 shutdown_connections 2024-09-19T06:24:40.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.099+0000 7f1119e00640 1 --2- 172.21.15.3:0/3705857348 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f10f80a33c0 0x7f10f80a5880 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:40.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.099+0000 7f1119e00640 1 --2- 172.21.15.3:0/3705857348 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f1114112950 0x7f111419e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:40.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.099+0000 7f1119e00640 1 --2- 172.21.15.3:0/3705857348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1114077040 0x7f11141a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:40.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.099+0000 7f1119e00640 1 --2- 172.21.15.3:0/3705857348 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1114076720 0x7f11141a46f0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:40.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.099+0000 7f1119e00640 1 -- 172.21.15.3:0/3705857348 >> 172.21.15.3:0/3705857348 conn(0x7f11140ff930 msgr2=0x7f1114101d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:40.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.099+0000 7f1119e00640 1 -- 172.21.15.3:0/3705857348 shutdown_connections 2024-09-19T06:24:40.102 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.099+0000 7f1119e00640 1 -- 172.21.15.3:0/3705857348 wait complete. 2024-09-19T06:24:40.118 DEBUG:teuthology.orchestra.run.smithi003:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T06:24:40.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.274+0000 7fb169200640 1 -- 172.21.15.3:0/2409423443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1641048d0 msgr2=0x7fb164108910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:40.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.274+0000 7fb169200640 1 --2- 172.21.15.3:0/2409423443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1641048d0 0x7fb164108910 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fb14c009900 tx=0x7fb14c02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:24:40.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.274+0000 7fb169200640 1 -- 172.21.15.3:0/2409423443 shutdown_connections 2024-09-19T06:24:40.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.274+0000 7fb169200640 1 --2- 172.21.15.3:0/2409423443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb164109070 0x7fb164110bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:40.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.274+0000 7fb169200640 1 --2- 172.21.15.3:0/2409423443 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1641048d0 0x7fb164108910 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:40.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.274+0000 7fb169200640 1 --2- 172.21.15.3:0/2409423443 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb164103f20 0x7fb164104300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:40.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.274+0000 7fb169200640 1 -- 172.21.15.3:0/2409423443 >> 172.21.15.3:0/2409423443 conn(0x7fb1640ff950 msgr2=0x7fb164101d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:40.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.274+0000 7fb169200640 1 -- 172.21.15.3:0/2409423443 shutdown_connections 2024-09-19T06:24:40.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.274+0000 7fb169200640 1 -- 172.21.15.3:0/2409423443 wait complete. 2024-09-19T06:24:40.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.275+0000 7fb169200640 1 Processor -- start 2024-09-19T06:24:40.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.276+0000 7fb169200640 1 -- start start 2024-09-19T06:24:40.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.276+0000 7fb169200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb164103f20 0x7fb16419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:40.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.276+0000 7fb169200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb164109070 0x7fb16419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:40.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.276+0000 7fb169200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb16419eeb0 0x7fb16419f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:40.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.276+0000 7fb169200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb1641140e0 con 0x7fb16419eeb0 2024-09-19T06:24:40.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.276+0000 7fb169200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fb164113f60 con 0x7fb164109070 2024-09-19T06:24:40.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.276+0000 7fb169200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fb164114260 con 0x7fb164103f20 2024-09-19T06:24:40.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.276+0000 7fb161e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb164103f20 0x7fb16419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:40.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.276+0000 7fb161e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb164103f20 0x7fb16419a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:33928/0 (socket says 172.21.15.3:33928) 2024-09-19T06:24:40.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.276+0000 7fb161e00640 1 -- 172.21.15.3:0/1472025544 learned_addr learned my addr 172.21.15.3:0/1472025544 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:24:40.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.276+0000 7fb162800640 1 --2- 172.21.15.3:0/1472025544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb16419eeb0 0x7fb16419f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:40.279 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.276+0000 7fb159400640 1 --2- 172.21.15.3:0/1472025544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb164109070 0x7fb16419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:40.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.277+0000 7fb162800640 1 -- 172.21.15.3:0/1472025544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb164103f20 msgr2=0x7fb16419a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:40.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.277+0000 7fb162800640 1 --2- 172.21.15.3:0/1472025544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb164103f20 0x7fb16419a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:40.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.277+0000 7fb162800640 1 -- 172.21.15.3:0/1472025544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb164109070 msgr2=0x7fb16419ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:40.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.277+0000 7fb162800640 1 --2- 172.21.15.3:0/1472025544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb164109070 0x7fb16419ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:40.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.277+0000 7fb162800640 1 -- 172.21.15.3:0/1472025544 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb16419f9a0 con 0x7fb16419eeb0 2024-09-19T06:24:40.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.277+0000 7fb159400640 1 --2- 172.21.15.3:0/1472025544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb164109070 0x7fb16419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:24:40.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.277+0000 7fb162800640 1 --2- 172.21.15.3:0/1472025544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb16419eeb0 0x7fb16419f360 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb15c009fd0 tx=0x7fb15c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:40.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.277+0000 7fb15b400640 1 -- 172.21.15.3:0/1472025544 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c00ce20 con 0x7fb16419eeb0 2024-09-19T06:24:40.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.278+0000 7fb15b400640 1 -- 172.21.15.3:0/1472025544 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb15c005020 con 0x7fb16419eeb0 2024-09-19T06:24:40.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.278+0000 7fb15b400640 1 -- 172.21.15.3:0/1472025544 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c010720 con 0x7fb16419eeb0 2024-09-19T06:24:40.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.278+0000 7fb169200640 1 -- 172.21.15.3:0/1472025544 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb16419fc90 con 0x7fb16419eeb0 2024-09-19T06:24:40.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.278+0000 7fb169200640 1 -- 172.21.15.3:0/1472025544 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1641a7400 con 0x7fb16419eeb0 2024-09-19T06:24:40.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.279+0000 7fb169200640 1 -- 172.21.15.3:0/1472025544 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb164104300 con 0x7fb16419eeb0 2024-09-19T06:24:40.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.281+0000 7fb15b400640 1 -- 172.21.15.3:0/1472025544 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fb15c005540 con 0x7fb16419eeb0 2024-09-19T06:24:40.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.282+0000 7fb15b400640 1 --2- 172.21.15.3:0/1472025544 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb1480a3440 0x7fb1480a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:24:40.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.282+0000 7fb15b400640 1 -- 172.21.15.3:0/1472025544 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7fb15c0d0370 con 0x7fb16419eeb0 2024-09-19T06:24:40.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.282+0000 7fb161e00640 1 --2- 172.21.15.3:0/1472025544 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb1480a3440 0x7fb1480a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:24:40.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.283+0000 7fb161e00640 1 --2- 172.21.15.3:0/1472025544 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb1480a3440 0x7fb1480a5900 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb154009cd0 tx=0x7fb154005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:24:40.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.286+0000 7fb15b400640 1 -- 172.21.15.3:0/1472025544 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb15c09ccc0 con 0x7fb16419eeb0 2024-09-19T06:24:40.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:40 smithi059 ceph-mon[35138]: pgmap v383: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T06:24:40.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:40 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1421557518' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:24:40.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:40 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/469632185' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:24:40.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:40 smithi003 ceph-mon[30893]: pgmap v383: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T06:24:40.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:40 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1421557518' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:24:40.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:40 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/469632185' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:24:40.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:40 smithi071 ceph-mon[35662]: pgmap v383: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T06:24:40.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:40 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1421557518' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:24:40.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:40 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/469632185' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T06:24:40.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.527+0000 7fb169200640 1 -- 172.21.15.3:0/1472025544 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fb1641048d0 con 0x7fb16419eeb0 2024-09-19T06:24:40.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.538+0000 7fb15b400640 1 -- 172.21.15.3:0/1472025544 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v27) ==== 81+0+742862 (secure 0 0 0) 0x7fb15c09c5c0 con 0x7fb16419eeb0 2024-09-19T06:24:40.551 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:24:40.551 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:24:40.551 INFO:teuthology.orchestra.run.smithi003.stdout: "epoch": 27, 2024-09-19T06:24:40.552 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.552 INFO:teuthology.orchestra.run.smithi003.stdout: "active_gid": 15126, 2024-09-19T06:24:40.552 INFO:teuthology.orchestra.run.smithi003.stdout: "active_name": "x", 2024-09-19T06:24:40.552 INFO:teuthology.orchestra.run.smithi003.stdout: "active_addrs": { 2024-09-19T06:24:40.552 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2024-09-19T06:24:40.552 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.552 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v2", 2024-09-19T06:24:40.552 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6800", 2024-09-19T06:24:40.552 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 3015970538 2024-09-19T06:24:40.552 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.552 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.552 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2024-09-19T06:24:40.553 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:6801", 2024-09-19T06:24:40.553 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 3015970538 2024-09-19T06:24:40.553 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.553 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-19T06:24:40.553 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.553 INFO:teuthology.orchestra.run.smithi003.stdout: "active_addr": "172.21.15.3:6801/3015970538", 2024-09-19T06:24:40.553 INFO:teuthology.orchestra.run.smithi003.stdout: "active_change": "2024-09-19T06:12:22.409889+0000", 2024-09-19T06:24:40.553 INFO:teuthology.orchestra.run.smithi003.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T06:24:40.553 INFO:teuthology.orchestra.run.smithi003.stdout: "available": true, 2024-09-19T06:24:40.553 INFO:teuthology.orchestra.run.smithi003.stdout: "standbys": [ 2024-09-19T06:24:40.553 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.553 INFO:teuthology.orchestra.run.smithi003.stdout: "gid": 25148, 2024-09-19T06:24:40.554 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "y", 2024-09-19T06:24:40.554 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_features": 4540701547738038271, 2024-09-19T06:24:40.554 INFO:teuthology.orchestra.run.smithi003.stdout: "available_modules": [ 2024-09-19T06:24:40.554 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.554 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "alerts", 2024-09-19T06:24:40.554 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.554 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.554 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.554 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-19T06:24:40.554 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-19T06:24:40.554 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:40.554 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.554 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.555 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-19T06:24:40.555 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.555 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.555 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.555 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T06:24:40.555 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.555 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.555 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.555 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.555 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.555 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.555 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.555 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.555 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.556 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.556 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.556 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.556 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.556 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.556 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.556 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.556 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.556 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.556 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.556 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.556 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.556 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.557 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.557 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.557 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.557 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.557 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.557 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.557 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.557 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.557 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.557 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.557 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.557 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.557 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.558 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.558 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.558 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.558 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.558 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.558 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.558 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.558 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.558 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.558 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.558 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.558 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.558 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.559 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.559 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.559 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.559 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.559 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.559 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.559 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.559 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.559 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.559 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.559 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.559 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.559 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.560 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.560 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.560 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.560 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.560 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.560 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.560 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.560 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.560 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.560 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.560 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.560 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.560 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.561 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_destination": { 2024-09-19T06:24:40.561 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_destination", 2024-09-19T06:24:40.561 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.561 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.561 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.561 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.561 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.561 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.561 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.561 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Email address to send alerts to", 2024-09-19T06:24:40.561 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.561 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.561 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.562 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.562 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_from_name": { 2024-09-19T06:24:40.562 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_from_name", 2024-09-19T06:24:40.562 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.562 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.562 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.562 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "Ceph", 2024-09-19T06:24:40.562 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.562 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.562 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.562 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Email From: name", 2024-09-19T06:24:40.562 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.562 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.563 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.563 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.563 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_host": { 2024-09-19T06:24:40.563 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_host", 2024-09-19T06:24:40.563 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.563 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.563 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.563 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.563 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.563 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.563 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.563 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "SMTP server", 2024-09-19T06:24:40.563 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.563 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.564 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.564 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.564 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_password": { 2024-09-19T06:24:40.564 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_password", 2024-09-19T06:24:40.564 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.564 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.564 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.564 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.564 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.565 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.565 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.565 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Password to authenticate with", 2024-09-19T06:24:40.565 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.565 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.565 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.565 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.565 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_port": { 2024-09-19T06:24:40.565 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_port", 2024-09-19T06:24:40.565 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.565 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.565 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.565 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "465", 2024-09-19T06:24:40.565 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.566 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.566 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.566 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "SMTP port", 2024-09-19T06:24:40.566 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.566 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.566 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.566 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.566 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_sender": { 2024-09-19T06:24:40.566 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_sender", 2024-09-19T06:24:40.566 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.566 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.566 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.566 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.567 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.567 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.567 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.567 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "SMTP envelope sender", 2024-09-19T06:24:40.567 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.567 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.567 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.567 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.567 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_ssl": { 2024-09-19T06:24:40.567 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_ssl", 2024-09-19T06:24:40.567 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.567 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.568 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.568 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.568 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.568 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.568 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.568 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T06:24:40.568 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.568 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.568 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.568 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.568 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_user": { 2024-09-19T06:24:40.568 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_user", 2024-09-19T06:24:40.569 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.569 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.569 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.569 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.569 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.569 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.569 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.569 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "User to authenticate as", 2024-09-19T06:24:40.569 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.569 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.569 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.569 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.569 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.570 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.570 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.570 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "balancer", 2024-09-19T06:24:40.570 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.570 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.570 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.570 INFO:teuthology.orchestra.run.smithi003.stdout: "active": { 2024-09-19T06:24:40.570 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "active", 2024-09-19T06:24:40.570 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.570 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.570 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.570 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.570 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.571 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.571 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.571 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T06:24:40.571 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.571 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.571 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.571 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.571 INFO:teuthology.orchestra.run.smithi003.stdout: "begin_time": { 2024-09-19T06:24:40.571 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "begin_time", 2024-09-19T06:24:40.571 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.571 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.571 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.571 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0000", 2024-09-19T06:24:40.572 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.572 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.572 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.572 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T06:24:40.572 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:24:40.572 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.572 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.572 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.572 INFO:teuthology.orchestra.run.smithi003.stdout: "begin_weekday": { 2024-09-19T06:24:40.572 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "begin_weekday", 2024-09-19T06:24:40.572 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-19T06:24:40.572 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.572 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.573 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-19T06:24:40.573 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "0", 2024-09-19T06:24:40.573 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "6", 2024-09-19T06:24:40.573 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.573 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T06:24:40.573 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:24:40.573 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.573 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.573 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.573 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_compat_max_iterations": { 2024-09-19T06:24:40.573 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crush_compat_max_iterations", 2024-09-19T06:24:40.573 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-19T06:24:40.573 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.574 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.574 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "25", 2024-09-19T06:24:40.574 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1", 2024-09-19T06:24:40.574 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "250", 2024-09-19T06:24:40.574 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.574 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T06:24:40.575 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.575 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.575 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.575 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.575 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_compat_metrics": { 2024-09-19T06:24:40.575 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crush_compat_metrics", 2024-09-19T06:24:40.575 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.575 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.575 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.575 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T06:24:40.575 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.575 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.575 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.576 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T06:24:40.576 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T06:24:40.576 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.576 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.576 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.576 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_compat_step": { 2024-09-19T06:24:40.576 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crush_compat_step", 2024-09-19T06:24:40.576 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-19T06:24:40.576 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.576 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.576 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0.5", 2024-09-19T06:24:40.576 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "0.001", 2024-09-19T06:24:40.576 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "0.999", 2024-09-19T06:24:40.577 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.577 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "aggressiveness of optimization", 2024-09-19T06:24:40.577 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T06:24:40.577 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.577 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.577 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.577 INFO:teuthology.orchestra.run.smithi003.stdout: "end_time": { 2024-09-19T06:24:40.577 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "end_time", 2024-09-19T06:24:40.577 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.577 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.577 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.577 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "2359", 2024-09-19T06:24:40.577 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.577 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T06:24:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:24:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: "end_weekday": { 2024-09-19T06:24:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "end_weekday", 2024-09-19T06:24:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-19T06:24:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-19T06:24:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "0", 2024-09-19T06:24:40.578 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "6", 2024-09-19T06:24:40.579 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.579 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T06:24:40.579 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:24:40.579 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.579 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.579 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.579 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.579 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.579 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.579 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.579 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.579 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.579 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.580 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.580 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.580 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.580 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.580 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.580 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.580 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.580 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.580 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.580 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.580 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.580 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.580 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.580 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.581 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.581 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.581 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.581 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.581 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.581 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.581 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.581 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.581 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.581 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.581 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.581 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.582 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.582 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.582 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.582 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.582 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.582 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.582 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.582 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.582 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.582 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.582 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.582 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.582 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.583 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.583 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.583 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.583 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.583 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.583 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.583 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.583 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.583 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.583 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.583 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.583 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.583 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.584 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.584 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.584 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.584 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.584 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.584 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.584 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.584 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.584 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.584 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.584 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.584 INFO:teuthology.orchestra.run.smithi003.stdout: "min_score": { 2024-09-19T06:24:40.584 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "min_score", 2024-09-19T06:24:40.585 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-19T06:24:40.585 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.585 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.585 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-19T06:24:40.585 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.585 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.585 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.585 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T06:24:40.585 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.585 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.585 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.585 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.585 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": { 2024-09-19T06:24:40.585 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mode", 2024-09-19T06:24:40.586 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.586 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.586 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.586 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "upmap", 2024-09-19T06:24:40.586 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.586 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.586 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.586 INFO:teuthology.orchestra.run.smithi003.stdout: "crush-compat", 2024-09-19T06:24:40.586 INFO:teuthology.orchestra.run.smithi003.stdout: "none", 2024-09-19T06:24:40.586 INFO:teuthology.orchestra.run.smithi003.stdout: "read", 2024-09-19T06:24:40.586 INFO:teuthology.orchestra.run.smithi003.stdout: "upmap", 2024-09-19T06:24:40.586 INFO:teuthology.orchestra.run.smithi003.stdout: "upmap-read" 2024-09-19T06:24:40.586 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.587 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Balancer mode", 2024-09-19T06:24:40.587 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.587 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.587 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.587 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.587 INFO:teuthology.orchestra.run.smithi003.stdout: "pool_ids": { 2024-09-19T06:24:40.587 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "pool_ids", 2024-09-19T06:24:40.587 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.587 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.587 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.587 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.587 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.587 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.588 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.588 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T06:24:40.588 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.588 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.588 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.588 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.588 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-19T06:24:40.588 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-19T06:24:40.588 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:40.588 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.588 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.588 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-19T06:24:40.588 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.589 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.589 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.589 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T06:24:40.589 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.589 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.589 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.589 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.589 INFO:teuthology.orchestra.run.smithi003.stdout: "upmap_max_deviation": { 2024-09-19T06:24:40.589 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "upmap_max_deviation", 2024-09-19T06:24:40.589 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.589 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.589 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.589 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-19T06:24:40.589 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1", 2024-09-19T06:24:40.590 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.590 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.590 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T06:24:40.590 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T06:24:40.590 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.590 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.590 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.590 INFO:teuthology.orchestra.run.smithi003.stdout: "upmap_max_optimizations": { 2024-09-19T06:24:40.590 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "upmap_max_optimizations", 2024-09-19T06:24:40.590 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-19T06:24:40.590 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.590 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.590 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-19T06:24:40.591 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.591 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.591 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.591 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T06:24:40.591 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.591 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.591 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.591 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.591 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.591 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.591 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.591 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cephadm", 2024-09-19T06:24:40.591 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.591 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.592 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.592 INFO:teuthology.orchestra.run.smithi003.stdout: "agent_down_multiplier": { 2024-09-19T06:24:40.592 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "agent_down_multiplier", 2024-09-19T06:24:40.592 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-19T06:24:40.592 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.592 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.592 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "3.0", 2024-09-19T06:24:40.592 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.592 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.592 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.592 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T06:24:40.592 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.592 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.593 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.593 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.593 INFO:teuthology.orchestra.run.smithi003.stdout: "agent_refresh_rate": { 2024-09-19T06:24:40.593 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "agent_refresh_rate", 2024-09-19T06:24:40.593 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:40.593 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.593 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.593 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "20", 2024-09-19T06:24:40.593 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.593 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.593 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.593 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T06:24:40.593 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.594 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.594 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.594 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.594 INFO:teuthology.orchestra.run.smithi003.stdout: "agent_starting_port": { 2024-09-19T06:24:40.594 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "agent_starting_port", 2024-09-19T06:24:40.594 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.594 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.594 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.594 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "4721", 2024-09-19T06:24:40.594 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.594 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.594 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.594 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T06:24:40.595 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.595 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.595 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.595 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.595 INFO:teuthology.orchestra.run.smithi003.stdout: "allow_ptrace": { 2024-09-19T06:24:40.595 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "allow_ptrace", 2024-09-19T06:24:40.595 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.595 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.595 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.595 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.595 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.595 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.595 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.596 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T06:24:40.596 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T06:24:40.596 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.596 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.596 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.596 INFO:teuthology.orchestra.run.smithi003.stdout: "autotune_interval": { 2024-09-19T06:24:40.596 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "autotune_interval", 2024-09-19T06:24:40.596 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:40.596 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.596 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.596 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-19T06:24:40.596 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.597 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.597 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.597 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T06:24:40.597 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.597 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.597 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.597 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.597 INFO:teuthology.orchestra.run.smithi003.stdout: "autotune_memory_target_ratio": { 2024-09-19T06:24:40.597 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T06:24:40.597 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-19T06:24:40.597 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.597 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.597 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0.7", 2024-09-19T06:24:40.597 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.598 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.598 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.598 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T06:24:40.598 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.598 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.598 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.598 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.598 INFO:teuthology.orchestra.run.smithi003.stdout: "cephadm_log_destination": { 2024-09-19T06:24:40.598 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cephadm_log_destination", 2024-09-19T06:24:40.598 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.598 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.598 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.598 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.599 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.599 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.599 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.599 INFO:teuthology.orchestra.run.smithi003.stdout: "file", 2024-09-19T06:24:40.599 INFO:teuthology.orchestra.run.smithi003.stdout: "file,syslog", 2024-09-19T06:24:40.599 INFO:teuthology.orchestra.run.smithi003.stdout: "syslog" 2024-09-19T06:24:40.599 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.599 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T06:24:40.599 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.599 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.599 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.599 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.599 INFO:teuthology.orchestra.run.smithi003.stdout: "cgroups_split": { 2024-09-19T06:24:40.600 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cgroups_split", 2024-09-19T06:24:40.600 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.600 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.600 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.600 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.600 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.600 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.600 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.600 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T06:24:40.600 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.600 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.600 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.600 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.601 INFO:teuthology.orchestra.run.smithi003.stdout: "config_checks_enabled": { 2024-09-19T06:24:40.601 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "config_checks_enabled", 2024-09-19T06:24:40.601 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.601 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.601 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.601 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.601 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.601 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.601 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.601 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T06:24:40.602 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.602 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.602 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.602 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.602 INFO:teuthology.orchestra.run.smithi003.stdout: "config_dashboard": { 2024-09-19T06:24:40.602 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "config_dashboard", 2024-09-19T06:24:40.602 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.602 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.602 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.602 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.602 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.602 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.603 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.603 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T06:24:40.603 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.603 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.603 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.603 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.603 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_alertmanager": { 2024-09-19T06:24:40.603 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_alertmanager", 2024-09-19T06:24:40.603 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.603 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.603 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.603 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T06:24:40.603 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.603 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.604 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.604 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Prometheus container image", 2024-09-19T06:24:40.604 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.604 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.604 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.604 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.604 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_base": { 2024-09-19T06:24:40.604 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_base", 2024-09-19T06:24:40.604 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.604 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.604 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.604 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T06:24:40.604 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.605 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.605 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.605 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Container image name, without the tag", 2024-09-19T06:24:40.605 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.605 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.605 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.605 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.605 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_elasticsearch": { 2024-09-19T06:24:40.605 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_elasticsearch", 2024-09-19T06:24:40.605 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.605 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.605 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.605 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T06:24:40.606 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.606 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.606 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.606 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "elasticsearch container image", 2024-09-19T06:24:40.606 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.606 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.606 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.606 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.606 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_grafana": { 2024-09-19T06:24:40.606 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_grafana", 2024-09-19T06:24:40.606 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.606 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.606 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.606 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T06:24:40.607 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.607 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.607 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.607 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Prometheus container image", 2024-09-19T06:24:40.607 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.607 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.607 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.607 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.607 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_haproxy": { 2024-09-19T06:24:40.607 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_haproxy", 2024-09-19T06:24:40.607 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.607 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.607 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.608 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T06:24:40.608 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.608 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.608 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.608 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "HAproxy container image", 2024-09-19T06:24:40.608 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.608 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.608 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.608 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.608 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_jaeger_agent": { 2024-09-19T06:24:40.608 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_jaeger_agent", 2024-09-19T06:24:40.609 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.609 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.609 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.609 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T06:24:40.609 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.609 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.609 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.609 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Jaeger agent container image", 2024-09-19T06:24:40.609 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.609 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.609 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.609 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.609 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_jaeger_collector": { 2024-09-19T06:24:40.609 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_jaeger_collector", 2024-09-19T06:24:40.610 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.610 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.610 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.610 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T06:24:40.610 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.610 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.610 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.610 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Jaeger collector container image", 2024-09-19T06:24:40.610 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.610 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.610 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.610 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.610 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_jaeger_query": { 2024-09-19T06:24:40.611 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_jaeger_query", 2024-09-19T06:24:40.611 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.611 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.611 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.611 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T06:24:40.611 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.611 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.611 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.611 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Jaeger query container image", 2024-09-19T06:24:40.611 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.611 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.611 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.611 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.611 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_keepalived": { 2024-09-19T06:24:40.612 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_keepalived", 2024-09-19T06:24:40.612 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.612 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.612 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.612 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T06:24:40.612 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.612 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.612 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.612 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Keepalived container image", 2024-09-19T06:24:40.612 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.612 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.612 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.612 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.613 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_loki": { 2024-09-19T06:24:40.613 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_loki", 2024-09-19T06:24:40.613 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.613 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.613 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.613 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T06:24:40.613 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.613 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.613 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.613 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Loki container image", 2024-09-19T06:24:40.613 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.613 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.613 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.614 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.614 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_node_exporter": { 2024-09-19T06:24:40.614 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_node_exporter", 2024-09-19T06:24:40.614 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.614 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.614 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.614 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T06:24:40.614 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.614 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.614 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.614 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Prometheus container image", 2024-09-19T06:24:40.614 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.614 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.614 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.615 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.615 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_nvmeof": { 2024-09-19T06:24:40.615 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_nvmeof", 2024-09-19T06:24:40.615 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.615 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.615 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.615 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T06:24:40.615 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.615 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.615 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.615 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Nvme-of container image", 2024-09-19T06:24:40.615 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.615 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.616 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.616 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.616 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_prometheus": { 2024-09-19T06:24:40.616 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_prometheus", 2024-09-19T06:24:40.616 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.616 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.616 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.616 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T06:24:40.616 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.616 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.616 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.616 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Prometheus container image", 2024-09-19T06:24:40.616 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.617 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.617 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.617 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.617 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_promtail": { 2024-09-19T06:24:40.617 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_promtail", 2024-09-19T06:24:40.617 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.617 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.617 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.617 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T06:24:40.617 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.617 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.617 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.617 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Promtail container image", 2024-09-19T06:24:40.617 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.618 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.618 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.618 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.618 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_samba": { 2024-09-19T06:24:40.618 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_samba", 2024-09-19T06:24:40.618 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.618 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.618 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.618 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T06:24:40.618 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.618 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.618 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.618 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Samba/SMB container image", 2024-09-19T06:24:40.619 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.619 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.619 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.619 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.619 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_snmp_gateway": { 2024-09-19T06:24:40.619 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_snmp_gateway", 2024-09-19T06:24:40.619 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.619 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.619 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.619 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T06:24:40.619 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.619 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.619 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.619 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "SNMP Gateway container image", 2024-09-19T06:24:40.620 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.620 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.620 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.620 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.620 INFO:teuthology.orchestra.run.smithi003.stdout: "container_init": { 2024-09-19T06:24:40.620 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_init", 2024-09-19T06:24:40.620 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.620 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.620 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.620 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.620 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.620 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.621 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.621 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T06:24:40.621 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.621 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.621 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.621 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.621 INFO:teuthology.orchestra.run.smithi003.stdout: "daemon_cache_timeout": { 2024-09-19T06:24:40.621 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "daemon_cache_timeout", 2024-09-19T06:24:40.621 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:40.621 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.621 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.621 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-19T06:24:40.621 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.622 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.622 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.622 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T06:24:40.622 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.622 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.622 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.622 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.622 INFO:teuthology.orchestra.run.smithi003.stdout: "default_cephadm_command_timeout": { 2024-09-19T06:24:40.622 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T06:24:40.622 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.622 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.622 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.622 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "900", 2024-09-19T06:24:40.623 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.623 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.623 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.623 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T06:24:40.623 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.623 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.623 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.623 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.623 INFO:teuthology.orchestra.run.smithi003.stdout: "default_registry": { 2024-09-19T06:24:40.623 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "default_registry", 2024-09-19T06:24:40.623 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.623 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.623 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.624 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "docker.io", 2024-09-19T06:24:40.624 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.624 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.624 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.624 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T06:24:40.624 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.624 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.624 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.624 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.624 INFO:teuthology.orchestra.run.smithi003.stdout: "device_cache_timeout": { 2024-09-19T06:24:40.624 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "device_cache_timeout", 2024-09-19T06:24:40.624 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:40.624 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.625 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.625 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "1800", 2024-09-19T06:24:40.625 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.625 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.625 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.625 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "seconds to cache device inventory", 2024-09-19T06:24:40.625 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.625 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.625 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.625 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.625 INFO:teuthology.orchestra.run.smithi003.stdout: "device_enhanced_scan": { 2024-09-19T06:24:40.625 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "device_enhanced_scan", 2024-09-19T06:24:40.625 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.626 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.626 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.626 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.626 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.626 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.626 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.626 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T06:24:40.626 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.626 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.626 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.626 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.626 INFO:teuthology.orchestra.run.smithi003.stdout: "facts_cache_timeout": { 2024-09-19T06:24:40.626 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "facts_cache_timeout", 2024-09-19T06:24:40.626 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:40.627 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.627 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.627 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-19T06:24:40.627 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.627 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.627 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.627 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "seconds to cache host facts data", 2024-09-19T06:24:40.627 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.627 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.627 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.627 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.627 INFO:teuthology.orchestra.run.smithi003.stdout: "grafana_dashboards_path": { 2024-09-19T06:24:40.627 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "grafana_dashboards_path", 2024-09-19T06:24:40.628 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.628 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.628 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.628 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T06:24:40.628 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.628 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.628 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.628 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T06:24:40.628 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.628 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.628 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.628 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.628 INFO:teuthology.orchestra.run.smithi003.stdout: "host_check_interval": { 2024-09-19T06:24:40.628 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "host_check_interval", 2024-09-19T06:24:40.629 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:40.629 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.629 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.629 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-19T06:24:40.629 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.629 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.629 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.629 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to perform a host check", 2024-09-19T06:24:40.629 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.629 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.629 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.629 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.629 INFO:teuthology.orchestra.run.smithi003.stdout: "hw_monitoring": { 2024-09-19T06:24:40.630 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "hw_monitoring", 2024-09-19T06:24:40.630 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.630 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.630 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.630 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.630 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.630 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.630 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.630 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T06:24:40.630 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.630 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.630 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.630 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.630 INFO:teuthology.orchestra.run.smithi003.stdout: "inventory_list_all": { 2024-09-19T06:24:40.631 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "inventory_list_all", 2024-09-19T06:24:40.631 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.631 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.631 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.631 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.631 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.631 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.631 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.631 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T06:24:40.631 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.631 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.631 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.631 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.631 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.632 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.632 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.632 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.632 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.632 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.632 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.632 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.632 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.632 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.632 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.632 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.632 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.632 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.632 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.633 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.633 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.633 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.633 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.633 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.633 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.633 INFO:teuthology.orchestra.run.smithi003.stdout: "log_refresh_metadata": { 2024-09-19T06:24:40.633 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_refresh_metadata", 2024-09-19T06:24:40.633 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.633 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.633 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.633 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.634 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.634 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.634 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.634 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T06:24:40.634 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.634 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.634 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.634 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.634 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.634 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.634 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.634 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.634 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.635 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.635 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.635 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.635 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.635 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T06:24:40.635 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.635 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.635 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.635 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.635 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.635 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.635 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.635 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.636 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.636 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.636 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.636 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.636 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.636 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.636 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.636 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.636 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.636 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.636 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.636 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.636 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.637 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.637 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.637 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.637 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.637 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.637 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.637 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.637 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.637 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.637 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.637 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.637 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.637 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.638 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.638 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.638 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.638 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.638 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.638 INFO:teuthology.orchestra.run.smithi003.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T06:24:40.638 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T06:24:40.638 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.638 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.638 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.638 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.638 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.638 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.638 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.639 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T06:24:40.639 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.639 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.639 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.639 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.639 INFO:teuthology.orchestra.run.smithi003.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T06:24:40.639 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T06:24:40.639 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.639 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.639 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.639 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "*", 2024-09-19T06:24:40.639 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.639 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.640 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.640 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T06:24:40.640 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.640 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.640 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.640 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.640 INFO:teuthology.orchestra.run.smithi003.stdout: "max_count_per_host": { 2024-09-19T06:24:40.640 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_count_per_host", 2024-09-19T06:24:40.640 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.640 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.640 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.640 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-19T06:24:40.640 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.641 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.641 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.641 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "max number of daemons per service per host", 2024-09-19T06:24:40.641 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.641 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.641 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.641 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.641 INFO:teuthology.orchestra.run.smithi003.stdout: "max_osd_draining_count": { 2024-09-19T06:24:40.641 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_osd_draining_count", 2024-09-19T06:24:40.641 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.641 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.641 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.641 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-19T06:24:40.641 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.642 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.642 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.642 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T06:24:40.642 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.642 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.642 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.642 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.642 INFO:teuthology.orchestra.run.smithi003.stdout: "migration_current": { 2024-09-19T06:24:40.642 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "migration_current", 2024-09-19T06:24:40.642 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.642 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.642 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.642 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.642 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.643 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.643 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.643 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "internal - do not modify", 2024-09-19T06:24:40.643 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.643 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.643 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.643 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.643 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": { 2024-09-19T06:24:40.643 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mode", 2024-09-19T06:24:40.643 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.643 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.643 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.643 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "root", 2024-09-19T06:24:40.644 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.644 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.644 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.644 INFO:teuthology.orchestra.run.smithi003.stdout: "cephadm-package", 2024-09-19T06:24:40.644 INFO:teuthology.orchestra.run.smithi003.stdout: "root" 2024-09-19T06:24:40.644 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.644 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T06:24:40.644 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.644 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.644 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.644 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.644 INFO:teuthology.orchestra.run.smithi003.stdout: "oob_default_addr": { 2024-09-19T06:24:40.644 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "oob_default_addr", 2024-09-19T06:24:40.645 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.645 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.645 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.645 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "169.254.1.1", 2024-09-19T06:24:40.645 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.645 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.645 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.645 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T06:24:40.645 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.645 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.645 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.645 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.645 INFO:teuthology.orchestra.run.smithi003.stdout: "prometheus_alerts_path": { 2024-09-19T06:24:40.646 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "prometheus_alerts_path", 2024-09-19T06:24:40.646 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.646 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.646 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.646 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T06:24:40.646 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.646 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.646 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.646 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T06:24:40.646 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.646 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.646 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.646 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.646 INFO:teuthology.orchestra.run.smithi003.stdout: "registry_insecure": { 2024-09-19T06:24:40.647 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "registry_insecure", 2024-09-19T06:24:40.647 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.647 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.647 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.647 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.647 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.647 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.647 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.647 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T06:24:40.647 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.647 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.647 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.648 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.648 INFO:teuthology.orchestra.run.smithi003.stdout: "registry_password": { 2024-09-19T06:24:40.648 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "registry_password", 2024-09-19T06:24:40.648 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.648 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.648 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.648 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.648 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.648 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.648 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.648 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T06:24:40.648 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.648 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.649 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.649 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.649 INFO:teuthology.orchestra.run.smithi003.stdout: "registry_url": { 2024-09-19T06:24:40.649 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "registry_url", 2024-09-19T06:24:40.649 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.649 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.649 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.649 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.649 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.649 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.649 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.649 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T06:24:40.649 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.649 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.650 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.650 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.650 INFO:teuthology.orchestra.run.smithi003.stdout: "registry_username": { 2024-09-19T06:24:40.650 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "registry_username", 2024-09-19T06:24:40.650 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.650 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.650 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.650 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.650 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.650 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.650 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.650 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T06:24:40.650 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.651 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.651 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.651 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.651 INFO:teuthology.orchestra.run.smithi003.stdout: "secure_monitoring_stack": { 2024-09-19T06:24:40.651 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "secure_monitoring_stack", 2024-09-19T06:24:40.651 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.651 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.651 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.651 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.651 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.651 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.651 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.651 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T06:24:40.651 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.652 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.652 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.652 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.652 INFO:teuthology.orchestra.run.smithi003.stdout: "service_discovery_port": { 2024-09-19T06:24:40.652 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "service_discovery_port", 2024-09-19T06:24:40.652 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.652 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.652 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.652 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8765", 2024-09-19T06:24:40.652 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.652 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.652 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.652 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "cephadm service discovery port", 2024-09-19T06:24:40.653 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.653 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.653 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.653 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.653 INFO:teuthology.orchestra.run.smithi003.stdout: "ssh_config_file": { 2024-09-19T06:24:40.653 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ssh_config_file", 2024-09-19T06:24:40.653 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.653 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.653 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.653 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.653 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.653 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.653 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.654 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T06:24:40.654 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.654 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.654 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.654 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.654 INFO:teuthology.orchestra.run.smithi003.stdout: "use_agent": { 2024-09-19T06:24:40.654 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "use_agent", 2024-09-19T06:24:40.654 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.654 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.654 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.654 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.654 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.654 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.654 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.655 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T06:24:40.655 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.655 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.655 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.655 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.655 INFO:teuthology.orchestra.run.smithi003.stdout: "use_repo_digest": { 2024-09-19T06:24:40.655 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "use_repo_digest", 2024-09-19T06:24:40.655 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.655 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.655 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.655 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.655 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.655 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.656 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.656 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T06:24:40.656 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.656 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.656 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.656 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.656 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_on_failed_host_check": { 2024-09-19T06:24:40.656 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_on_failed_host_check", 2024-09-19T06:24:40.656 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.656 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.656 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.656 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.656 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.656 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.657 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.657 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T06:24:40.657 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.657 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.657 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.657 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.657 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_on_stray_daemons": { 2024-09-19T06:24:40.657 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_on_stray_daemons", 2024-09-19T06:24:40.657 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.657 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.657 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.657 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.657 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.657 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.658 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.658 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T06:24:40.658 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.658 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.658 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.658 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.658 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_on_stray_hosts": { 2024-09-19T06:24:40.658 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_on_stray_hosts", 2024-09-19T06:24:40.658 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.658 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.658 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.658 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.658 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.659 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.659 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.659 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T06:24:40.659 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.659 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.659 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.659 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.659 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.659 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.659 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.659 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crash", 2024-09-19T06:24:40.659 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.659 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.660 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.660 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.660 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.660 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.660 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.660 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.660 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.660 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.660 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.660 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.660 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.660 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.661 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.661 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.661 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.661 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.661 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.661 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.661 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.661 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.661 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.661 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.661 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.661 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.661 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.661 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.662 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.662 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.662 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.662 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.662 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.662 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.662 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.662 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.662 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.662 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.662 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.662 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.662 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.663 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.663 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.663 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.663 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.663 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.663 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.663 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.663 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.663 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.663 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.663 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.663 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.663 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.664 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.664 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.664 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.664 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.664 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.664 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.664 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.664 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.664 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.664 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.664 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.664 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.664 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.665 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.665 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.665 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.665 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.665 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.665 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.665 INFO:teuthology.orchestra.run.smithi003.stdout: "retain_interval": { 2024-09-19T06:24:40.665 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "retain_interval", 2024-09-19T06:24:40.665 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:40.665 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.665 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.665 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "31536000", 2024-09-19T06:24:40.665 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.665 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.666 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.666 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T06:24:40.666 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.666 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.666 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.666 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.666 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_recent_interval": { 2024-09-19T06:24:40.666 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_recent_interval", 2024-09-19T06:24:40.666 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:40.666 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.666 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.666 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "1209600", 2024-09-19T06:24:40.666 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.667 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.667 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.667 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T06:24:40.667 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.667 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.667 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.667 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.667 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.667 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.667 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.667 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "dashboard", 2024-09-19T06:24:40.667 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.667 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.667 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.668 INFO:teuthology.orchestra.run.smithi003.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T06:24:40.668 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T06:24:40.668 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.668 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.668 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.668 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-19T06:24:40.668 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.668 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.668 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.668 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.668 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.668 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.668 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.669 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.669 INFO:teuthology.orchestra.run.smithi003.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T06:24:40.669 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T06:24:40.669 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.669 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.669 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.669 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.669 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.669 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.669 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.669 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.669 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.669 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.669 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.670 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.670 INFO:teuthology.orchestra.run.smithi003.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T06:24:40.670 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T06:24:40.670 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.670 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.670 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.670 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.670 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.670 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.670 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.670 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.670 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.670 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.671 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.671 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.671 INFO:teuthology.orchestra.run.smithi003.stdout: "AUDIT_API_ENABLED": { 2024-09-19T06:24:40.671 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T06:24:40.671 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.671 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.671 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.671 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.671 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.671 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.671 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.671 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.671 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.671 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.672 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.672 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.672 INFO:teuthology.orchestra.run.smithi003.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T06:24:40.672 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T06:24:40.672 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.672 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.672 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.672 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.672 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.672 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.672 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.672 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.672 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.673 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.673 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.673 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.673 INFO:teuthology.orchestra.run.smithi003.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T06:24:40.673 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T06:24:40.673 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.673 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.673 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.673 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.673 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.673 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.673 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.673 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.673 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.674 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.674 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.674 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.674 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T06:24:40.675 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T06:24:40.675 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.675 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.675 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.675 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.675 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.675 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.675 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.675 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.675 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.675 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.675 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.675 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.676 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T06:24:40.676 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T06:24:40.676 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.676 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.676 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.676 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.676 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.676 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.676 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.676 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.676 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.676 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.676 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.677 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.677 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T06:24:40.677 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T06:24:40.677 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.677 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.677 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.677 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.677 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.677 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.677 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.677 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.677 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.677 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.678 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.678 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.678 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T06:24:40.678 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T06:24:40.678 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.678 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.678 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.678 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.678 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.678 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.678 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.678 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.678 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.678 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.679 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.679 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.679 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T06:24:40.679 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T06:24:40.679 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.679 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.679 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.679 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.679 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.679 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.679 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.679 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.679 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.680 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.680 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.680 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.680 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T06:24:40.680 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T06:24:40.680 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.680 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.680 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.680 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.680 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.680 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.680 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.680 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.681 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.681 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.681 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.681 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.681 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T06:24:40.681 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T06:24:40.681 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.681 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.681 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.681 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.681 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.681 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.681 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.681 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.682 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.682 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.682 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.682 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.682 INFO:teuthology.orchestra.run.smithi003.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T06:24:40.682 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T06:24:40.682 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.682 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.682 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.682 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.682 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.682 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.682 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.683 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.683 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.683 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.683 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.683 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.683 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T06:24:40.683 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T06:24:40.683 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.683 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.683 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.683 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "admin", 2024-09-19T06:24:40.683 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.683 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.683 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.684 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.684 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.684 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.684 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.684 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.684 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T06:24:40.684 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T06:24:40.684 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.684 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.684 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.684 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.684 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.684 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.685 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.685 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.685 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.685 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.685 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.685 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.685 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_API_URL": { 2024-09-19T06:24:40.685 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_API_URL", 2024-09-19T06:24:40.685 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.685 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.685 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.685 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.685 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.685 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.686 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.686 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.686 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.686 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.686 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.686 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.686 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T06:24:40.686 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T06:24:40.686 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.686 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.686 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.686 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "admin", 2024-09-19T06:24:40.686 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.687 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.687 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.687 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.687 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.687 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.687 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.687 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.687 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T06:24:40.687 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T06:24:40.687 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.687 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.687 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.687 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.687 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.688 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.688 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.688 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.688 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.688 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.688 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.688 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.688 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T06:24:40.688 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T06:24:40.688 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.688 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.689 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.689 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.689 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.689 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.689 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.689 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.689 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.689 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.689 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.689 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.689 INFO:teuthology.orchestra.run.smithi003.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T06:24:40.689 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T06:24:40.689 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.690 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.690 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.690 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.690 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.690 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.690 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.690 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.690 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.690 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.690 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.690 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.690 INFO:teuthology.orchestra.run.smithi003.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T06:24:40.690 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T06:24:40.690 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.691 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.691 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.691 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.691 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.691 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.691 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.691 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.691 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.691 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.691 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.691 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.691 INFO:teuthology.orchestra.run.smithi003.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T06:24:40.691 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T06:24:40.692 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.692 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.692 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.692 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.692 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.692 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.692 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.692 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.692 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.692 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.692 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.692 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.692 INFO:teuthology.orchestra.run.smithi003.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T06:24:40.693 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T06:24:40.693 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.693 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.693 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.693 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.693 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.693 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.693 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.693 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.693 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.693 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.693 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.693 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.694 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T06:24:40.694 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T06:24:40.694 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.694 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.694 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.694 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.694 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.694 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.694 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.694 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.694 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.694 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.694 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.694 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.695 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T06:24:40.695 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T06:24:40.695 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.695 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.695 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.695 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.695 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.695 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.695 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.695 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.695 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.695 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.695 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.696 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.696 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T06:24:40.696 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T06:24:40.696 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.696 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.696 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.696 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.696 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.696 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.696 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.696 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.696 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.696 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.696 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.697 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.697 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T06:24:40.697 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T06:24:40.697 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.697 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.697 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.697 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.697 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.697 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.697 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.697 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.697 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.697 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.698 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.698 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.698 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T06:24:40.698 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T06:24:40.698 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.698 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.698 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.698 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.698 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.698 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.698 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.698 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.698 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.698 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.699 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.699 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.699 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T06:24:40.699 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T06:24:40.699 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.699 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.699 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.699 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.699 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.699 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.699 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.699 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.699 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.700 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.700 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.700 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.700 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T06:24:40.700 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T06:24:40.700 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.700 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.700 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.700 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.700 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.700 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.700 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.700 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.700 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.701 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.701 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.701 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.701 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T06:24:40.701 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T06:24:40.701 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.701 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.701 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.701 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.701 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.701 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.701 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.701 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.702 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.702 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.702 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.702 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.702 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T06:24:40.702 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T06:24:40.702 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.702 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.702 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.703 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T06:24:40.703 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.703 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.703 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.703 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.703 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.703 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.703 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.703 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.703 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T06:24:40.703 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T06:24:40.703 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.703 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.704 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.704 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-19T06:24:40.704 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.704 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.704 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.704 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.704 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.704 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.704 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.704 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.704 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T06:24:40.704 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T06:24:40.705 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.705 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.705 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.705 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8", 2024-09-19T06:24:40.705 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.705 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.705 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.705 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.705 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.705 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.705 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.705 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.705 INFO:teuthology.orchestra.run.smithi003.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T06:24:40.705 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T06:24:40.706 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.706 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.706 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.706 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "45", 2024-09-19T06:24:40.706 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.706 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.706 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.706 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.706 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.706 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.706 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.706 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.706 INFO:teuthology.orchestra.run.smithi003.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T06:24:40.707 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T06:24:40.707 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.707 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.707 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.707 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.707 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.707 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.707 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.707 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.707 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.707 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.707 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.707 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.707 INFO:teuthology.orchestra.run.smithi003.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T06:24:40.708 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T06:24:40.708 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.708 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.708 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.708 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "admin", 2024-09-19T06:24:40.708 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.708 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.708 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.708 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.708 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.708 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.708 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.708 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.709 INFO:teuthology.orchestra.run.smithi003.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T06:24:40.709 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T06:24:40.709 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.709 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.709 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.709 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.709 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.709 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.709 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.709 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.709 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.709 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.709 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.710 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.710 INFO:teuthology.orchestra.run.smithi003.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T06:24:40.710 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T06:24:40.710 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.710 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.710 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.710 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.710 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.710 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.710 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.710 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.710 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.710 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.710 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.711 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.711 INFO:teuthology.orchestra.run.smithi003.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T06:24:40.711 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T06:24:40.711 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.711 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.711 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.711 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-19T06:24:40.711 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.711 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.711 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.711 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.711 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.711 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.712 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.712 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.712 INFO:teuthology.orchestra.run.smithi003.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T06:24:40.712 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T06:24:40.712 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.712 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.712 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.712 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-19T06:24:40.712 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.712 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.712 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.712 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.712 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.713 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.713 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.713 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.713 INFO:teuthology.orchestra.run.smithi003.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T06:24:40.713 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T06:24:40.713 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.713 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.713 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.713 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-19T06:24:40.713 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.713 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.713 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.713 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.713 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.714 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.714 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.714 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.714 INFO:teuthology.orchestra.run.smithi003.stdout: "cross_origin_url": { 2024-09-19T06:24:40.714 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cross_origin_url", 2024-09-19T06:24:40.714 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.714 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.714 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.714 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.714 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.714 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.714 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.714 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.714 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.715 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.715 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.715 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.715 INFO:teuthology.orchestra.run.smithi003.stdout: "crt_file": { 2024-09-19T06:24:40.715 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crt_file", 2024-09-19T06:24:40.715 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.715 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.715 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.715 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.715 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.715 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.715 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.715 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.715 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.716 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.716 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.716 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.716 INFO:teuthology.orchestra.run.smithi003.stdout: "debug": { 2024-09-19T06:24:40.716 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "debug", 2024-09-19T06:24:40.716 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.716 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.716 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.716 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.716 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.716 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.717 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.717 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Enable/disable debug options", 2024-09-19T06:24:40.717 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.717 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.717 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.717 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.717 INFO:teuthology.orchestra.run.smithi003.stdout: "jwt_token_ttl": { 2024-09-19T06:24:40.717 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "jwt_token_ttl", 2024-09-19T06:24:40.717 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.717 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.717 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.717 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "28800", 2024-09-19T06:24:40.717 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.717 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.718 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.718 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.718 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.718 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.718 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.718 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.718 INFO:teuthology.orchestra.run.smithi003.stdout: "key_file": { 2024-09-19T06:24:40.718 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "key_file", 2024-09-19T06:24:40.718 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.718 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.718 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.718 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.719 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.719 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.719 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.719 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.719 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.719 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.719 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.719 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.719 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.719 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.719 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.719 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.719 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.719 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.720 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.720 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.720 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.720 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.720 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.720 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.720 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.720 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.720 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.720 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.720 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.720 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.720 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.721 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.721 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.721 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.721 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.721 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.721 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.721 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.721 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.721 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.721 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.721 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.721 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.721 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.721 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.722 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.722 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.722 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.722 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.722 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.722 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.722 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.722 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.722 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.722 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.722 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.722 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.722 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.723 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.723 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.723 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.723 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.723 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.723 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.723 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.723 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.723 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.723 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.723 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.723 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.723 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.724 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.724 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.724 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.724 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.724 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.724 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.724 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.724 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.724 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.724 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.724 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.724 INFO:teuthology.orchestra.run.smithi003.stdout: "motd": { 2024-09-19T06:24:40.724 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "motd", 2024-09-19T06:24:40.725 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.725 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.725 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.725 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.725 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.725 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.725 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.725 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "The message of the day", 2024-09-19T06:24:40.725 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.725 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.725 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.725 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.725 INFO:teuthology.orchestra.run.smithi003.stdout: "redirect_resolve_ip_addr": { 2024-09-19T06:24:40.725 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T06:24:40.726 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.726 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.726 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.726 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.726 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.726 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.726 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.726 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.726 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.726 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.726 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.726 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.726 INFO:teuthology.orchestra.run.smithi003.stdout: "server_addr": { 2024-09-19T06:24:40.727 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_addr", 2024-09-19T06:24:40.727 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.727 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.727 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.727 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "::", 2024-09-19T06:24:40.727 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.727 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.727 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.727 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.727 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.727 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.727 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.727 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.727 INFO:teuthology.orchestra.run.smithi003.stdout: "server_port": { 2024-09-19T06:24:40.728 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_port", 2024-09-19T06:24:40.728 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.728 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.728 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.728 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8080", 2024-09-19T06:24:40.728 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.728 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.728 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.728 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.728 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.728 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.728 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.728 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.729 INFO:teuthology.orchestra.run.smithi003.stdout: "ssl": { 2024-09-19T06:24:40.729 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ssl", 2024-09-19T06:24:40.729 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.729 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.729 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.729 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.729 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.729 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.729 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.729 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.729 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.729 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.729 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.729 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.730 INFO:teuthology.orchestra.run.smithi003.stdout: "ssl_server_port": { 2024-09-19T06:24:40.730 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ssl_server_port", 2024-09-19T06:24:40.730 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.730 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.730 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.730 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8443", 2024-09-19T06:24:40.730 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.730 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.730 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.730 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.730 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.730 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.731 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.731 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.731 INFO:teuthology.orchestra.run.smithi003.stdout: "standby_behaviour": { 2024-09-19T06:24:40.731 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "standby_behaviour", 2024-09-19T06:24:40.731 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.731 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.731 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.731 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "redirect", 2024-09-19T06:24:40.731 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.731 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.731 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.731 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.731 INFO:teuthology.orchestra.run.smithi003.stdout: "redirect" 2024-09-19T06:24:40.732 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.732 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.732 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.732 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.732 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.732 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.732 INFO:teuthology.orchestra.run.smithi003.stdout: "standby_error_status_code": { 2024-09-19T06:24:40.732 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "standby_error_status_code", 2024-09-19T06:24:40.732 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.732 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.732 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.732 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "500", 2024-09-19T06:24:40.732 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "400", 2024-09-19T06:24:40.733 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "599", 2024-09-19T06:24:40.733 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.733 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.733 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.733 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.733 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.733 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.733 INFO:teuthology.orchestra.run.smithi003.stdout: "url_prefix": { 2024-09-19T06:24:40.733 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "url_prefix", 2024-09-19T06:24:40.733 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.733 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.733 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.733 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.734 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.734 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.734 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.734 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.734 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.734 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.734 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.734 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.734 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.734 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.734 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.734 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "devicehealth", 2024-09-19T06:24:40.734 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.735 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.735 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.735 INFO:teuthology.orchestra.run.smithi003.stdout: "enable_monitoring": { 2024-09-19T06:24:40.735 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "enable_monitoring", 2024-09-19T06:24:40.735 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.735 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.735 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.735 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.735 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.735 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.735 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.735 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "monitor device health metrics", 2024-09-19T06:24:40.735 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.735 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.736 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.736 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.736 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.736 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.736 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.736 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.736 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.736 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.736 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.736 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.736 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.736 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.737 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.737 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.737 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.737 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.737 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.737 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.737 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.737 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.737 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.737 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.737 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.737 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.737 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.738 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.738 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.738 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.738 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.738 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.738 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.738 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.738 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.738 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.738 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.738 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.738 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.738 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.738 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.739 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.739 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.739 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.739 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.739 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.739 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.739 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.739 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.739 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.739 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.739 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.739 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.739 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.740 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.740 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.740 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.740 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.740 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.740 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.740 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.740 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.740 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.740 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.740 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.740 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.740 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.740 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.741 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.741 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.741 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.741 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.741 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.741 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.741 INFO:teuthology.orchestra.run.smithi003.stdout: "mark_out_threshold": { 2024-09-19T06:24:40.741 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mark_out_threshold", 2024-09-19T06:24:40.741 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:40.741 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.741 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.741 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "2419200", 2024-09-19T06:24:40.741 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.741 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.742 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.742 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T06:24:40.742 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.742 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.742 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.742 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.742 INFO:teuthology.orchestra.run.smithi003.stdout: "pool_name": { 2024-09-19T06:24:40.742 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "pool_name", 2024-09-19T06:24:40.742 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.742 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.742 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.742 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "device_health_metrics", 2024-09-19T06:24:40.742 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.743 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.743 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.743 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T06:24:40.743 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.743 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.743 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.743 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.743 INFO:teuthology.orchestra.run.smithi003.stdout: "retention_period": { 2024-09-19T06:24:40.743 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "retention_period", 2024-09-19T06:24:40.743 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:40.743 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.743 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.743 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "15552000", 2024-09-19T06:24:40.743 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.744 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.744 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.744 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how long to retain device health metrics", 2024-09-19T06:24:40.744 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.744 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.744 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.744 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.744 INFO:teuthology.orchestra.run.smithi003.stdout: "scrape_frequency": { 2024-09-19T06:24:40.744 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "scrape_frequency", 2024-09-19T06:24:40.744 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:40.744 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.744 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.744 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "86400", 2024-09-19T06:24:40.744 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.745 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.745 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.745 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T06:24:40.745 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.745 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.745 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.745 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.745 INFO:teuthology.orchestra.run.smithi003.stdout: "self_heal": { 2024-09-19T06:24:40.745 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "self_heal", 2024-09-19T06:24:40.745 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.745 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.745 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.746 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.746 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.746 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.746 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.746 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T06:24:40.746 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.746 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.746 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.746 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.746 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-19T06:24:40.746 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-19T06:24:40.746 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:40.746 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.746 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.747 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-19T06:24:40.747 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.747 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.747 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.747 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T06:24:40.747 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.747 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.747 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.747 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.747 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_threshold": { 2024-09-19T06:24:40.747 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_threshold", 2024-09-19T06:24:40.747 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:40.747 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.748 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.748 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "7257600", 2024-09-19T06:24:40.748 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.748 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.748 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.748 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T06:24:40.748 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.748 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.748 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.748 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.748 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.748 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.748 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.749 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "diskprediction_local", 2024-09-19T06:24:40.749 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.749 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.749 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.749 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.749 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.749 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.749 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.749 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.749 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.749 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.749 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.749 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.749 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.750 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.750 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.750 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.750 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.750 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.750 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.750 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.750 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.750 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.750 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.750 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.750 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.750 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.751 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.751 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.751 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.751 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.751 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.751 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.751 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.751 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.751 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.751 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.751 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.751 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.751 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.751 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.752 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.752 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.752 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.752 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.752 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.752 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.752 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.752 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.752 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.752 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.752 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.752 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.752 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.753 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.753 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.753 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.753 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.753 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.753 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.753 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.753 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.753 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.753 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.753 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.753 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.753 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.753 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.754 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.754 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.754 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.754 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.754 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.754 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.754 INFO:teuthology.orchestra.run.smithi003.stdout: "predict_interval": { 2024-09-19T06:24:40.754 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "predict_interval", 2024-09-19T06:24:40.754 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.754 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.754 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.754 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "86400", 2024-09-19T06:24:40.754 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.754 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.755 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.755 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.755 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.755 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.755 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.755 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.755 INFO:teuthology.orchestra.run.smithi003.stdout: "predictor_model": { 2024-09-19T06:24:40.755 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "predictor_model", 2024-09-19T06:24:40.755 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.755 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.755 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.755 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "prophetstor", 2024-09-19T06:24:40.755 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.755 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.756 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.756 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.756 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.756 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.756 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.756 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.756 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-19T06:24:40.756 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-19T06:24:40.756 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.756 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.756 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.756 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-19T06:24:40.756 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.757 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.757 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.757 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.757 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.757 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.757 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.757 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.757 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.757 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.757 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.757 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "influx", 2024-09-19T06:24:40.757 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": false, 2024-09-19T06:24:40.757 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "influxdb python module not found", 2024-09-19T06:24:40.757 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.758 INFO:teuthology.orchestra.run.smithi003.stdout: "batch_size": { 2024-09-19T06:24:40.758 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "batch_size", 2024-09-19T06:24:40.758 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.758 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.758 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.758 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5000", 2024-09-19T06:24:40.758 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.758 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.758 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.758 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T06:24:40.758 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.758 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.758 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.758 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.759 INFO:teuthology.orchestra.run.smithi003.stdout: "database": { 2024-09-19T06:24:40.759 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "database", 2024-09-19T06:24:40.759 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.759 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.759 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.759 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "ceph", 2024-09-19T06:24:40.759 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.759 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.759 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.759 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T06:24:40.759 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.759 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.760 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.760 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.760 INFO:teuthology.orchestra.run.smithi003.stdout: "hostname": { 2024-09-19T06:24:40.760 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "hostname", 2024-09-19T06:24:40.760 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.760 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.760 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.760 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.760 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.760 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.760 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.760 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "InfluxDB server hostname", 2024-09-19T06:24:40.760 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.761 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.761 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.761 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.761 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-19T06:24:40.761 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-19T06:24:40.761 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:40.761 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.761 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.761 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "30", 2024-09-19T06:24:40.761 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "5", 2024-09-19T06:24:40.761 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.761 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.761 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T06:24:40.761 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.762 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.762 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.762 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.762 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.762 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.762 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.762 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.762 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.762 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.762 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.762 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.762 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.762 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.763 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.763 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.763 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.763 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.763 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.763 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.763 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.763 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.763 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.763 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.763 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.763 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.763 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.763 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.764 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.764 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.764 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.764 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.764 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.764 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.764 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.764 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.764 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.764 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.764 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.764 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.764 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.765 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.765 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.765 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.765 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.765 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.765 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.765 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.765 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.765 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.765 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.765 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.765 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.765 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.766 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.766 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.766 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.766 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.766 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.766 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.766 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.766 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.766 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.766 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.766 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.766 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.766 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.767 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.767 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.767 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.767 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.767 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.767 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.767 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.767 INFO:teuthology.orchestra.run.smithi003.stdout: "password": { 2024-09-19T06:24:40.767 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "password", 2024-09-19T06:24:40.767 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.767 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.767 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.767 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.767 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.768 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.768 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.768 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "password of InfluxDB server user", 2024-09-19T06:24:40.768 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.768 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.768 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.768 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.768 INFO:teuthology.orchestra.run.smithi003.stdout: "port": { 2024-09-19T06:24:40.768 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "port", 2024-09-19T06:24:40.768 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.768 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.768 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.768 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8086", 2024-09-19T06:24:40.769 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.769 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.769 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.769 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "InfluxDB server port", 2024-09-19T06:24:40.769 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.769 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.769 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.769 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.769 INFO:teuthology.orchestra.run.smithi003.stdout: "ssl": { 2024-09-19T06:24:40.769 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ssl", 2024-09-19T06:24:40.769 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.769 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.769 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.769 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "false", 2024-09-19T06:24:40.770 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.770 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.770 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.770 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:24:40.770 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.770 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.770 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.770 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.770 INFO:teuthology.orchestra.run.smithi003.stdout: "threads": { 2024-09-19T06:24:40.770 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "threads", 2024-09-19T06:24:40.770 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.770 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.770 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.770 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-19T06:24:40.771 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1", 2024-09-19T06:24:40.771 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "32", 2024-09-19T06:24:40.771 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.771 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T06:24:40.771 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.771 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.771 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.771 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.771 INFO:teuthology.orchestra.run.smithi003.stdout: "username": { 2024-09-19T06:24:40.771 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "username", 2024-09-19T06:24:40.771 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.771 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.771 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.771 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.772 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.772 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.772 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.772 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "username of InfluxDB server user", 2024-09-19T06:24:40.772 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.772 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.772 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.772 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.772 INFO:teuthology.orchestra.run.smithi003.stdout: "verify_ssl": { 2024-09-19T06:24:40.772 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "verify_ssl", 2024-09-19T06:24:40.772 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.772 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.773 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.773 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "true", 2024-09-19T06:24:40.773 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.773 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.773 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.773 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:24:40.773 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.773 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.773 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.773 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.773 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.773 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.773 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.773 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "insights", 2024-09-19T06:24:40.774 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.774 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.774 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.774 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.774 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.774 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.774 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.774 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.774 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.774 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.775 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.775 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.775 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.775 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.775 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.775 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.775 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.775 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.775 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.775 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.775 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.775 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.776 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.776 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.776 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.776 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.776 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.776 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.776 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.776 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.776 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.776 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.776 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.776 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.776 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.777 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.777 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.777 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.777 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.777 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.777 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.777 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.777 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.777 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.777 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.777 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.777 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.777 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.777 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.778 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.778 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.778 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.778 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.778 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.778 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.778 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.778 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.778 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.778 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.778 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.778 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.778 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.779 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.779 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.779 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.779 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.779 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.779 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.779 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.779 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.779 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.779 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.779 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.779 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.779 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.780 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.780 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "iostat", 2024-09-19T06:24:40.780 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.780 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.780 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.780 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.780 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.780 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.780 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.780 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.780 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.780 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.780 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.780 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.781 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.781 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.781 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.781 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.781 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.781 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.781 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.781 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.781 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.781 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.781 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.781 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.781 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.782 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.782 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.782 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.782 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.782 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.782 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.782 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.782 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.782 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.782 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.782 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.782 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.782 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.782 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.783 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.783 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.783 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.783 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.783 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.783 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.783 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.783 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.783 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.783 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.783 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.783 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.783 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.783 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.784 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.784 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.784 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.784 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.784 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.784 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.784 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.784 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.784 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.784 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.784 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.784 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.784 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.785 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.785 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.785 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.785 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.785 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.785 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.785 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.785 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.785 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.785 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.785 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "k8sevents", 2024-09-19T06:24:40.785 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.785 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.786 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.786 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_event_retention_days": { 2024-09-19T06:24:40.786 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ceph_event_retention_days", 2024-09-19T06:24:40.786 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.786 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.786 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.786 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "7", 2024-09-19T06:24:40.786 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.786 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.786 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.786 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T06:24:40.786 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.786 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.786 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.787 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.787 INFO:teuthology.orchestra.run.smithi003.stdout: "config_check_secs": { 2024-09-19T06:24:40.787 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "config_check_secs", 2024-09-19T06:24:40.787 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.787 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.787 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.787 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-19T06:24:40.787 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "10", 2024-09-19T06:24:40.787 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.787 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.787 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T06:24:40.787 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.787 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.788 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.788 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.788 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.788 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.788 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.788 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.788 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.788 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.788 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.788 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.788 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.788 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.788 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.789 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.789 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.789 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.789 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.789 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.789 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.789 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.789 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.789 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.789 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.789 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.789 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.789 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.790 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.790 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.790 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.790 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.790 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.790 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.790 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.790 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.790 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.790 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.790 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.790 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.790 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.791 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.791 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.791 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.791 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.791 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.791 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.791 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.791 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.791 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.791 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.791 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.791 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.791 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.791 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.792 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.792 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.792 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.792 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.792 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.792 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.792 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.792 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.792 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.792 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.792 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.792 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.792 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.793 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.793 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.793 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.793 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.793 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.793 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.793 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.793 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.793 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.793 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "localpool", 2024-09-19T06:24:40.793 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.793 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.793 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.794 INFO:teuthology.orchestra.run.smithi003.stdout: "failure_domain": { 2024-09-19T06:24:40.794 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "failure_domain", 2024-09-19T06:24:40.794 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.794 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.794 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.794 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "host", 2024-09-19T06:24:40.794 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.794 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.794 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.794 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "failure domain for any created local pool", 2024-09-19T06:24:40.794 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T06:24:40.794 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.794 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.794 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.795 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.795 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.795 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.795 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.795 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.795 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.795 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.795 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.795 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.795 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.795 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.795 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.795 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.796 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.796 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.796 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.796 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.796 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.796 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.796 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.796 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.796 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.796 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.796 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.796 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.796 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.797 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.797 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.797 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.797 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.797 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.797 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.797 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.797 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.797 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.797 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.797 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.797 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.797 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.797 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.798 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.798 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.798 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.798 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.798 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.798 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.798 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.798 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.798 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.798 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.798 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.798 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.798 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.798 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.799 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.799 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.799 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.799 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.799 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.799 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.799 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.799 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.799 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.799 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.799 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.799 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.799 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.800 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.800 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.800 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.800 INFO:teuthology.orchestra.run.smithi003.stdout: "min_size": { 2024-09-19T06:24:40.800 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "min_size", 2024-09-19T06:24:40.800 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.800 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.800 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.800 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.800 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.800 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.800 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.800 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "default min_size for any created local pool", 2024-09-19T06:24:40.801 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T06:24:40.801 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.801 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.801 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.801 INFO:teuthology.orchestra.run.smithi003.stdout: "num_rep": { 2024-09-19T06:24:40.801 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "num_rep", 2024-09-19T06:24:40.801 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.801 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.801 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.801 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "3", 2024-09-19T06:24:40.801 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.801 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.801 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.802 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "default replica count for any created local pool", 2024-09-19T06:24:40.802 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.802 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.802 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.802 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.802 INFO:teuthology.orchestra.run.smithi003.stdout: "pg_num": { 2024-09-19T06:24:40.802 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "pg_num", 2024-09-19T06:24:40.802 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.802 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.803 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.803 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "128", 2024-09-19T06:24:40.803 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.803 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.803 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.803 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T06:24:40.803 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.803 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.803 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.803 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.803 INFO:teuthology.orchestra.run.smithi003.stdout: "prefix": { 2024-09-19T06:24:40.803 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "prefix", 2024-09-19T06:24:40.803 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.804 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.804 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.804 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.804 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.804 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.804 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.804 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "name prefix for any created local pool", 2024-09-19T06:24:40.804 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.804 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.804 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.804 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.804 INFO:teuthology.orchestra.run.smithi003.stdout: "subtree": { 2024-09-19T06:24:40.804 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "subtree", 2024-09-19T06:24:40.805 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.805 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.805 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.805 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "rack", 2024-09-19T06:24:40.805 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.805 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.805 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.805 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T06:24:40.805 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T06:24:40.805 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.805 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.805 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.805 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.806 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.806 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.806 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mds_autoscaler", 2024-09-19T06:24:40.806 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.806 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.806 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.806 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.806 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.806 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.806 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.806 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.806 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.806 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.806 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.807 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.807 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.807 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.807 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.807 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.807 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.807 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.807 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.807 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.807 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.807 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.807 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.807 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.807 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.808 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.808 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.808 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.808 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.808 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.808 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.808 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.808 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.808 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.808 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.808 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.808 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.808 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.809 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.809 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.809 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.809 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.809 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.809 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.809 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.809 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.809 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.809 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.809 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.809 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.809 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.810 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.810 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.810 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.810 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.810 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.810 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.810 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.810 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.810 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.810 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.810 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.810 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.810 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.810 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.811 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.811 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.811 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.811 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.811 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.811 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.811 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.811 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.811 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.811 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.811 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.811 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mirroring", 2024-09-19T06:24:40.811 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.811 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.812 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.812 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.812 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.812 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.812 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.812 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.812 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.812 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.812 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.812 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.812 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.812 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.812 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.813 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.813 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.813 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.813 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.813 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.813 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.813 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.813 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.813 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.813 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.813 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.813 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.813 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.813 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.814 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.814 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.814 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.814 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.814 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.814 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.814 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.814 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.814 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.814 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.814 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.814 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.814 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.814 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.815 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.815 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.815 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.815 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.815 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.815 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.815 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.815 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.815 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.815 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.815 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.815 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.815 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.816 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.816 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.816 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.816 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.816 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.816 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.816 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.816 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.816 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.816 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.816 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.816 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.816 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.817 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.817 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.817 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.817 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.817 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.817 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.817 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.817 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "nfs", 2024-09-19T06:24:40.817 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.817 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.817 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.817 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.817 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.818 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.818 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.818 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.818 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.818 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.818 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.818 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.818 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.818 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.818 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.818 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.818 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.818 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.819 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.819 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.819 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.819 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.819 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.819 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.819 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.819 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.819 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.819 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.819 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.819 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.819 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.819 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.820 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.820 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.820 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.820 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.820 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.820 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.820 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.820 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.820 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.820 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.820 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.820 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.820 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.821 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.821 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.821 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.821 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.821 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.821 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.821 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.821 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.821 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.821 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.821 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.821 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.821 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.821 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.822 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.822 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.822 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.822 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.822 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.822 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.822 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.822 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.822 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.822 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.822 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.822 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.822 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.823 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.823 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.823 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.823 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.823 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "orchestrator", 2024-09-19T06:24:40.823 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.823 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.823 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.823 INFO:teuthology.orchestra.run.smithi003.stdout: "fail_fs": { 2024-09-19T06:24:40.823 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "fail_fs", 2024-09-19T06:24:40.823 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.823 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.823 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.823 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.824 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.824 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.824 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.824 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T06:24:40.824 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.824 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.824 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.824 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.824 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.824 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.824 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.824 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.824 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.825 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.825 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.825 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.825 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.825 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.825 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.825 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.825 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.825 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.825 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.825 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.825 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.825 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.825 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.826 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.826 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.826 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.826 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.826 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.826 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.826 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.826 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.826 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.826 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.826 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.826 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.826 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.826 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.827 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.827 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.827 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.827 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.827 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.827 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.827 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.827 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.827 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.827 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.827 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.827 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.827 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.827 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.828 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.828 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.828 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.828 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.828 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.828 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.828 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.828 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.828 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.828 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.828 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.828 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.828 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.829 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.829 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.829 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.829 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.829 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.829 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.829 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.829 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.829 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.829 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.829 INFO:teuthology.orchestra.run.smithi003.stdout: "orchestrator": { 2024-09-19T06:24:40.829 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "orchestrator", 2024-09-19T06:24:40.829 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.829 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.830 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.830 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.830 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.830 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.830 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.830 INFO:teuthology.orchestra.run.smithi003.stdout: "cephadm", 2024-09-19T06:24:40.830 INFO:teuthology.orchestra.run.smithi003.stdout: "rook", 2024-09-19T06:24:40.830 INFO:teuthology.orchestra.run.smithi003.stdout: "test_orchestrator" 2024-09-19T06:24:40.830 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.830 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Orchestrator backend", 2024-09-19T06:24:40.830 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.830 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.830 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.830 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.831 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.831 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.831 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.831 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "osd_perf_query", 2024-09-19T06:24:40.831 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.831 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.831 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.831 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.831 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.831 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.831 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.831 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.832 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.832 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.832 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.832 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.832 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.832 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.832 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.832 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.832 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.832 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.832 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.832 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.832 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.833 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.833 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.833 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.833 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.833 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.833 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.833 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.833 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.833 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.833 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.833 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.833 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.833 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.834 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.834 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.834 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.834 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.834 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.834 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.834 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.834 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.834 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.834 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.834 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.834 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.834 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.834 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.835 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.835 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.835 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.835 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.835 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.835 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.835 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.835 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.835 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.835 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.835 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.835 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.835 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.836 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.836 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.836 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.836 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.836 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.836 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.836 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.836 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.836 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.836 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.836 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.836 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.836 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.837 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.837 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.837 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "osd_support", 2024-09-19T06:24:40.837 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.837 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.837 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.837 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.837 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.837 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.837 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.837 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.837 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.838 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.838 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.838 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.838 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.838 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.838 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.838 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.838 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.838 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.838 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.838 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.838 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.838 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.838 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.839 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.839 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.839 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.839 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.839 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.839 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.839 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.839 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.839 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.839 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.839 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.839 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.839 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.840 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.840 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.840 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.840 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.840 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.840 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.840 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.840 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.840 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.840 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.840 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.840 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.840 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.841 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.841 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.841 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.841 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.841 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.841 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.841 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.841 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.841 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.841 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.841 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.841 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.841 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.841 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.842 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.842 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.842 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.842 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.842 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.842 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.842 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.842 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.842 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.842 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.842 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.842 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.842 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.843 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "pg_autoscaler", 2024-09-19T06:24:40.843 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.843 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.843 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.843 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.843 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.843 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.843 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.843 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.843 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.843 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.843 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.843 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.843 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.844 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.844 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.844 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.844 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.844 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.844 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.844 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.844 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.844 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.844 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.844 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.844 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.844 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.844 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.845 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.845 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.845 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.845 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.845 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.845 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.845 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.845 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.845 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.845 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.845 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.845 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.845 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.846 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.846 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.846 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.846 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.846 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.846 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.846 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.846 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.846 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.846 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.846 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.846 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.846 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.847 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.847 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.847 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.847 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.847 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.847 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.847 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.847 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.847 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.847 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.847 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.847 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.847 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.848 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.848 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.848 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.848 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.848 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.848 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.848 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.848 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-19T06:24:40.848 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-19T06:24:40.848 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:40.848 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.848 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.848 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-19T06:24:40.849 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.849 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.849 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.849 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.849 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.849 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.849 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.849 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.849 INFO:teuthology.orchestra.run.smithi003.stdout: "threshold": { 2024-09-19T06:24:40.849 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "threshold", 2024-09-19T06:24:40.849 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-19T06:24:40.849 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.849 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.849 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "3.0", 2024-09-19T06:24:40.850 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1.0", 2024-09-19T06:24:40.850 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.850 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.850 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "scaling threshold", 2024-09-19T06:24:40.850 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T06:24:40.850 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.850 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.850 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.850 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.850 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.850 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.850 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "progress", 2024-09-19T06:24:40.850 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.851 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.851 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.851 INFO:teuthology.orchestra.run.smithi003.stdout: "allow_pg_recovery_event": { 2024-09-19T06:24:40.851 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "allow_pg_recovery_event", 2024-09-19T06:24:40.851 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.851 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.851 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.851 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.851 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.851 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.851 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.851 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T06:24:40.851 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.851 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.852 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.852 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.852 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": { 2024-09-19T06:24:40.852 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "enabled", 2024-09-19T06:24:40.852 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.852 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.852 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.852 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.852 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.852 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.852 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.852 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.853 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.853 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.853 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.853 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.853 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.853 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.853 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.853 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.853 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.853 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.853 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.853 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.853 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.853 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.854 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.854 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.854 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.854 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.854 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.854 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.854 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.854 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.854 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.854 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.854 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.854 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.854 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.855 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.855 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.855 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.855 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.855 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.855 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.855 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.855 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.855 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.855 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.855 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.855 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.855 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.855 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.856 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.856 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.856 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.856 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.856 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.856 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.856 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.856 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.856 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.856 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.856 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.856 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.856 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.857 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.857 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.857 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.857 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.857 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.857 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.857 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.857 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.857 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.857 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.857 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.857 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.857 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.857 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.858 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.858 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.858 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.858 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.858 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.858 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.858 INFO:teuthology.orchestra.run.smithi003.stdout: "max_completed_events": { 2024-09-19T06:24:40.858 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_completed_events", 2024-09-19T06:24:40.858 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.858 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.858 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.858 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "50", 2024-09-19T06:24:40.858 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.859 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.859 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.859 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "number of past completed events to remember", 2024-09-19T06:24:40.859 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.859 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.859 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.859 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.859 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-19T06:24:40.859 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-19T06:24:40.859 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:40.859 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.859 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.859 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-19T06:24:40.859 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.860 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.860 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.860 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how long the module is going to sleep", 2024-09-19T06:24:40.860 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.860 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.860 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.860 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.860 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.860 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.860 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.860 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "prometheus", 2024-09-19T06:24:40.860 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.861 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.861 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.861 INFO:teuthology.orchestra.run.smithi003.stdout: "cache": { 2024-09-19T06:24:40.861 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cache", 2024-09-19T06:24:40.861 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.861 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.861 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.861 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.861 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.861 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.861 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.861 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.861 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.862 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.862 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.862 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.862 INFO:teuthology.orchestra.run.smithi003.stdout: "exclude_perf_counters": { 2024-09-19T06:24:40.862 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "exclude_perf_counters", 2024-09-19T06:24:40.862 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.862 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.862 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.862 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.862 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.862 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.862 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.862 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T06:24:40.863 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T06:24:40.863 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.863 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.863 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.863 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.863 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.863 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.863 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.863 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.863 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.863 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.863 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.863 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.863 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.864 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.864 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.864 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.864 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.864 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.864 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.864 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.864 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.864 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.864 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.864 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.864 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.865 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.865 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.865 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.865 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.865 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.865 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.865 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.865 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.865 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.865 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.865 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.865 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.866 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.866 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.866 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.866 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.866 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.866 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.866 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.866 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.866 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.866 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.866 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.866 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.866 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.866 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.867 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.867 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.867 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.867 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.867 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.867 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.867 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.867 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.867 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.867 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.867 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.867 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.867 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.867 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.868 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.868 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.868 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.868 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.868 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.868 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.868 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.868 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.868 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_stats_pools": { 2024-09-19T06:24:40.868 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rbd_stats_pools", 2024-09-19T06:24:40.868 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.868 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.868 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.869 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.869 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.869 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.869 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.869 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.869 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.869 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.869 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.869 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.869 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T06:24:40.869 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T06:24:40.869 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.869 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.869 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.870 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "300", 2024-09-19T06:24:40.870 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.870 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.870 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.870 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.870 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.870 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.870 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.870 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.870 INFO:teuthology.orchestra.run.smithi003.stdout: "scrape_interval": { 2024-09-19T06:24:40.870 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "scrape_interval", 2024-09-19T06:24:40.870 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-19T06:24:40.870 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.870 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.871 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "15.0", 2024-09-19T06:24:40.871 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.871 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.871 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.871 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.871 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.871 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.871 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.871 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.871 INFO:teuthology.orchestra.run.smithi003.stdout: "server_addr": { 2024-09-19T06:24:40.871 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_addr", 2024-09-19T06:24:40.871 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.871 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.872 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.872 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "::", 2024-09-19T06:24:40.872 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.872 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.872 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.872 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T06:24:40.872 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.872 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.872 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.872 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.872 INFO:teuthology.orchestra.run.smithi003.stdout: "server_port": { 2024-09-19T06:24:40.872 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_port", 2024-09-19T06:24:40.872 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.872 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.873 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.873 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "9283", 2024-09-19T06:24:40.873 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.873 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.873 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.873 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T06:24:40.873 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.873 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.873 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.873 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.873 INFO:teuthology.orchestra.run.smithi003.stdout: "stale_cache_strategy": { 2024-09-19T06:24:40.873 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "stale_cache_strategy", 2024-09-19T06:24:40.874 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.874 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.874 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.874 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "log", 2024-09-19T06:24:40.874 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.874 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.874 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.874 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.874 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.874 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.874 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.874 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.874 INFO:teuthology.orchestra.run.smithi003.stdout: "standby_behaviour": { 2024-09-19T06:24:40.875 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "standby_behaviour", 2024-09-19T06:24:40.875 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.875 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.875 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.875 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "default", 2024-09-19T06:24:40.875 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.875 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.875 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.875 INFO:teuthology.orchestra.run.smithi003.stdout: "default", 2024-09-19T06:24:40.875 INFO:teuthology.orchestra.run.smithi003.stdout: "error" 2024-09-19T06:24:40.875 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.875 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.875 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.876 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.876 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.876 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.876 INFO:teuthology.orchestra.run.smithi003.stdout: "standby_error_status_code": { 2024-09-19T06:24:40.876 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "standby_error_status_code", 2024-09-19T06:24:40.876 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.876 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.876 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.876 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "500", 2024-09-19T06:24:40.876 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "400", 2024-09-19T06:24:40.876 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "599", 2024-09-19T06:24:40.876 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.876 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.877 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.877 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.877 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.877 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.877 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.877 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.877 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.877 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rbd_support", 2024-09-19T06:24:40.877 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.877 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.877 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.877 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.877 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.877 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.878 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.878 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.878 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.878 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.878 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.878 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.878 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.878 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.878 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.878 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.878 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.878 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.878 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.878 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.879 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.879 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.879 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.879 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.879 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.879 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.879 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.879 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.879 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.879 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.879 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.879 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.879 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.880 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.880 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.880 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.880 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.880 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.880 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.880 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.880 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.880 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.880 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.880 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.880 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.880 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.880 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.881 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.881 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.881 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.881 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.881 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.881 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.881 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.881 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.881 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.881 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.881 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.881 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.881 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.882 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.882 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.882 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.882 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.882 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.882 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.882 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.882 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.882 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.882 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.882 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.882 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.882 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.882 INFO:teuthology.orchestra.run.smithi003.stdout: "max_concurrent_snap_create": { 2024-09-19T06:24:40.883 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_concurrent_snap_create", 2024-09-19T06:24:40.883 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.883 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.883 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.883 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-19T06:24:40.883 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.883 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.883 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.883 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.883 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.883 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.883 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.883 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.883 INFO:teuthology.orchestra.run.smithi003.stdout: "mirror_snapshot_schedule": { 2024-09-19T06:24:40.884 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T06:24:40.884 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.884 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.884 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.884 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.884 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.884 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.884 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.884 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.884 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.884 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.884 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.884 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.884 INFO:teuthology.orchestra.run.smithi003.stdout: "trash_purge_schedule": { 2024-09-19T06:24:40.885 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "trash_purge_schedule", 2024-09-19T06:24:40.885 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.885 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.885 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.885 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.885 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.885 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.885 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.885 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.885 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.885 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.885 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.885 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.886 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.886 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.886 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.886 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "restful", 2024-09-19T06:24:40.886 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.886 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.886 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.886 INFO:teuthology.orchestra.run.smithi003.stdout: "enable_auth": { 2024-09-19T06:24:40.886 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "enable_auth", 2024-09-19T06:24:40.886 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.886 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.886 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.886 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.887 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.887 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.887 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.887 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.887 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.887 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.887 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.887 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.887 INFO:teuthology.orchestra.run.smithi003.stdout: "key_file": { 2024-09-19T06:24:40.887 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "key_file", 2024-09-19T06:24:40.887 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.887 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.887 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.888 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.888 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.888 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.888 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.888 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.888 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.888 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.888 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.888 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.889 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.889 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.889 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.889 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.889 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.889 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.889 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.889 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.889 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.889 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.889 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.889 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.889 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.890 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.890 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.890 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.890 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.890 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.890 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.890 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.890 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.890 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.890 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.890 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.890 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.890 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.890 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.891 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.891 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.891 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.891 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.891 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.891 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.891 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.891 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.891 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.891 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.891 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.891 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.891 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.892 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.892 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.892 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.892 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.892 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.892 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.892 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.892 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.892 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.892 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.892 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.892 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.892 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.893 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.893 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.893 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.893 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.893 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.893 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.893 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.893 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.893 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.893 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.893 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.893 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.893 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.894 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.894 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.894 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.894 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.894 INFO:teuthology.orchestra.run.smithi003.stdout: "server_addr": { 2024-09-19T06:24:40.894 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_addr", 2024-09-19T06:24:40.894 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.894 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.894 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.894 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.894 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.894 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.894 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.894 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.895 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.895 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.895 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.895 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.895 INFO:teuthology.orchestra.run.smithi003.stdout: "server_port": { 2024-09-19T06:24:40.895 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_port", 2024-09-19T06:24:40.895 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.895 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.895 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.895 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.895 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.895 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.895 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.896 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.896 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.896 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.896 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.896 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.896 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.896 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.896 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.896 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rgw", 2024-09-19T06:24:40.896 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.896 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.896 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.896 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.897 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.897 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.897 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.897 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.897 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.897 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.897 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.897 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.897 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.897 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.897 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.897 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.897 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.897 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.898 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.898 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.898 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.898 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.898 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.898 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.898 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.898 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.898 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.898 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.898 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.898 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.898 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.898 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.899 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.899 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.899 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.899 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.899 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.899 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.899 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.899 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.899 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.899 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.899 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.899 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.899 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.900 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.900 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.900 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.900 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.900 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.900 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.900 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.900 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.900 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.900 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.900 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.900 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.900 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.901 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.901 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.901 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.901 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.901 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.901 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.901 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.901 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.901 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.901 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.901 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.901 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.901 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.902 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.902 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.902 INFO:teuthology.orchestra.run.smithi003.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T06:24:40.902 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T06:24:40.902 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.902 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.902 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.902 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-19T06:24:40.902 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.902 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.902 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.903 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T06:24:40.903 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.903 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.903 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.903 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.903 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.903 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.903 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.903 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rook", 2024-09-19T06:24:40.903 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.904 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.904 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.904 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.904 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.904 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.904 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.904 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.904 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.904 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.904 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.904 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.904 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.904 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.905 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.905 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.905 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.905 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.905 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.905 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.905 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.905 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.905 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.905 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.905 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.905 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.906 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.906 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.906 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.906 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.906 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.906 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.906 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.906 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.906 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.906 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.906 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.906 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.906 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.906 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.907 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.907 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.907 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.907 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.907 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.907 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.907 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.907 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.907 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.907 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.907 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.907 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.907 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.907 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.908 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.908 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.908 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.908 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.908 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.908 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.908 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.908 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.908 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.908 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.908 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.908 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.908 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.909 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.909 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.909 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.909 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.909 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.909 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.909 INFO:teuthology.orchestra.run.smithi003.stdout: "storage_class": { 2024-09-19T06:24:40.909 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "storage_class", 2024-09-19T06:24:40.909 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.909 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.909 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.909 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "local", 2024-09-19T06:24:40.909 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.910 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.910 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.910 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T06:24:40.910 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.910 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.910 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.910 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.910 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.910 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.910 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.910 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "selftest", 2024-09-19T06:24:40.910 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.910 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.910 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.911 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.911 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.911 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.911 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.911 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.911 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.911 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.911 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.911 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.911 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.911 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.911 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.911 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.911 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.912 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.912 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.912 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.912 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.912 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.912 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.912 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.912 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.912 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.912 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.912 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.912 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.912 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.913 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.913 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.913 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.913 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.913 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.913 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.913 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.913 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.913 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.913 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.913 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.913 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.913 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.913 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.914 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.914 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.914 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.914 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.914 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.914 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.914 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.914 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.914 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.914 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.914 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.914 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.914 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.914 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.915 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.915 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.915 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.915 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.915 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.915 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.915 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.915 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.915 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.915 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.915 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.915 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.915 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.916 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.916 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.916 INFO:teuthology.orchestra.run.smithi003.stdout: "roption1": { 2024-09-19T06:24:40.916 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "roption1", 2024-09-19T06:24:40.916 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.916 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.916 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.916 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.916 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.916 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.916 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.916 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.916 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.916 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.917 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.917 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.917 INFO:teuthology.orchestra.run.smithi003.stdout: "roption2": { 2024-09-19T06:24:40.917 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "roption2", 2024-09-19T06:24:40.917 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.917 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.917 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.917 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "xyz", 2024-09-19T06:24:40.917 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.917 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.917 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.917 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.917 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.918 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.918 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.918 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.918 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption1": { 2024-09-19T06:24:40.918 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption1", 2024-09-19T06:24:40.918 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.918 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.918 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.918 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.918 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.918 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.918 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.918 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.919 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.919 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.919 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.919 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.919 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption2": { 2024-09-19T06:24:40.919 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption2", 2024-09-19T06:24:40.919 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.919 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.919 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.919 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.919 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.919 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.919 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.920 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.920 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.920 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.920 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.920 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.920 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption3": { 2024-09-19T06:24:40.920 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption3", 2024-09-19T06:24:40.920 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-19T06:24:40.920 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.920 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.920 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.920 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.920 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.921 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.921 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.921 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.921 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.921 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.921 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.921 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption4": { 2024-09-19T06:24:40.921 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption4", 2024-09-19T06:24:40.921 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.921 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.921 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.921 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.921 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.922 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.922 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.922 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.922 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.922 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.922 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.922 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.922 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption5": { 2024-09-19T06:24:40.922 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption5", 2024-09-19T06:24:40.922 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.922 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.922 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.922 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.922 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.923 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.923 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.923 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.923 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.923 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.923 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.923 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.923 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption6": { 2024-09-19T06:24:40.923 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption6", 2024-09-19T06:24:40.923 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.923 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.923 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.923 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.924 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.924 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.924 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.924 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.924 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.924 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.924 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.924 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.924 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption7": { 2024-09-19T06:24:40.924 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption7", 2024-09-19T06:24:40.924 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.924 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.924 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.925 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.925 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1", 2024-09-19T06:24:40.925 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "42", 2024-09-19T06:24:40.925 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.925 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.925 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.925 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.925 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.925 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.925 INFO:teuthology.orchestra.run.smithi003.stdout: "testkey": { 2024-09-19T06:24:40.925 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "testkey", 2024-09-19T06:24:40.925 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.925 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.925 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.926 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.926 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.926 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.926 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.926 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.926 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.926 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.926 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.926 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.926 INFO:teuthology.orchestra.run.smithi003.stdout: "testlkey": { 2024-09-19T06:24:40.926 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "testlkey", 2024-09-19T06:24:40.926 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.926 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.927 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.927 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.927 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.927 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.927 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.927 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.927 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.927 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.927 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.927 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.927 INFO:teuthology.orchestra.run.smithi003.stdout: "testnewline": { 2024-09-19T06:24:40.927 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "testnewline", 2024-09-19T06:24:40.927 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.927 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.928 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.928 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.928 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.928 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.928 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.928 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.928 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.928 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.928 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.928 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.928 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.928 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.928 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.928 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "snap_schedule", 2024-09-19T06:24:40.929 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.929 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.929 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.929 INFO:teuthology.orchestra.run.smithi003.stdout: "allow_m_granularity": { 2024-09-19T06:24:40.929 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "allow_m_granularity", 2024-09-19T06:24:40.929 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.929 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.929 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.929 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.929 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.929 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.929 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.929 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T06:24:40.930 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.930 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.930 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.930 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.930 INFO:teuthology.orchestra.run.smithi003.stdout: "dump_on_update": { 2024-09-19T06:24:40.930 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "dump_on_update", 2024-09-19T06:24:40.930 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.930 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.930 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.930 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.930 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.930 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.930 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.930 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "dump database to debug log on update", 2024-09-19T06:24:40.931 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.931 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.931 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.931 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.931 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.931 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.931 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.931 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.931 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.931 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.931 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.931 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.931 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.931 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.932 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.932 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.932 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.932 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.932 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.932 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.932 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.932 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.932 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.932 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.932 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.932 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.933 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.933 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.933 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.933 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.933 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.933 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.933 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.933 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.933 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.933 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.933 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.933 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.933 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.934 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.934 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.934 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.934 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.934 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.934 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.934 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.934 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.934 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.934 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.934 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.934 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.934 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.935 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.935 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.935 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.935 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.935 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.935 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.935 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.935 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.935 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.935 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.935 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.935 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.935 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.936 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.936 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.936 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.936 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.936 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.936 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.936 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.936 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.936 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.936 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.936 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.936 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.936 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "stats", 2024-09-19T06:24:40.937 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.937 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.937 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.937 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.937 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.937 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.937 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.937 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.937 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.937 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.937 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.937 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.937 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.938 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.938 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.938 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.938 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.938 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.938 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.938 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.938 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.938 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.938 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.938 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.938 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.938 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.939 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.939 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.939 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.939 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.939 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.939 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.939 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.939 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.939 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.939 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.939 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.939 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.939 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.940 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.940 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.940 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.940 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.940 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.940 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.940 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.940 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.940 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.940 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.940 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.940 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.941 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.941 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.941 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.941 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.941 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.941 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.941 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.941 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.941 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.941 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.941 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.941 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.941 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.942 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.942 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.942 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.942 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.942 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.942 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.942 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.942 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.942 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.942 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.942 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.942 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.942 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "status", 2024-09-19T06:24:40.942 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.943 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.943 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.943 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.943 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.943 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.943 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.943 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.943 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.943 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.943 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.943 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.943 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.943 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.944 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.944 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.944 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.944 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.944 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.944 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.944 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.944 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.944 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.944 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.944 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.944 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.944 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.944 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.945 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.945 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.945 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.945 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.945 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.945 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.945 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.945 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.945 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.945 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.945 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.945 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.945 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.946 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.946 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.946 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.946 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.946 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.946 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.946 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.946 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.946 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.946 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.946 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.946 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.946 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.946 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.947 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.947 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.947 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.947 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.947 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.947 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.947 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.947 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.947 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.947 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.947 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.947 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.947 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.948 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.948 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.948 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.948 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.948 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.948 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.948 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.948 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.948 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "telegraf", 2024-09-19T06:24:40.948 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.948 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.948 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.949 INFO:teuthology.orchestra.run.smithi003.stdout: "address": { 2024-09-19T06:24:40.949 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "address", 2024-09-19T06:24:40.949 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.949 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.949 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.949 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T06:24:40.949 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.949 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.949 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.949 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.949 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.949 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.949 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.949 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.950 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-19T06:24:40.950 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-19T06:24:40.950 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:40.950 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.950 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.950 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "15", 2024-09-19T06:24:40.950 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.950 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.950 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.950 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.950 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.950 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.950 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.951 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.951 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.951 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.951 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.951 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.951 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.951 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.951 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.951 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.951 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.951 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.951 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.951 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.951 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.952 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.952 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.952 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.952 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.952 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.952 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.952 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.952 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.952 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.952 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.952 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.952 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.952 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.953 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.953 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.953 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.953 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.953 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.953 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.953 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.953 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.953 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.953 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.953 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.953 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.953 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.954 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.954 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.954 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.954 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.954 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.954 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.954 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.954 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.954 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.954 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.954 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.954 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.955 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.955 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.955 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.955 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.955 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.955 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.955 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.955 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.955 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.955 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.955 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.955 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.955 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.955 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.956 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.956 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.956 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.956 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.956 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.956 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.956 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.956 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.956 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "telemetry", 2024-09-19T06:24:40.956 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.956 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.956 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.956 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_basic": { 2024-09-19T06:24:40.957 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_basic", 2024-09-19T06:24:40.957 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.957 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.957 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.957 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.957 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.957 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.957 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.957 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T06:24:40.957 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.957 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.957 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.957 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.958 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_crash": { 2024-09-19T06:24:40.958 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_crash", 2024-09-19T06:24:40.958 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.958 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.958 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.958 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.958 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.958 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.958 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.958 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T06:24:40.958 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.958 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.958 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.958 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.959 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_device": { 2024-09-19T06:24:40.959 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_device", 2024-09-19T06:24:40.959 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.959 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.959 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.959 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.959 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.959 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.959 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.959 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T06:24:40.959 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.959 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.959 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.959 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.960 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_ident": { 2024-09-19T06:24:40.960 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_ident", 2024-09-19T06:24:40.960 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.960 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.960 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.960 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.960 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.960 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.960 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.960 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T06:24:40.960 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.960 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.960 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.961 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.961 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_perf": { 2024-09-19T06:24:40.961 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_perf", 2024-09-19T06:24:40.961 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.961 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.961 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.961 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.961 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.961 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.961 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.961 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T06:24:40.961 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.961 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.961 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.962 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.962 INFO:teuthology.orchestra.run.smithi003.stdout: "contact": { 2024-09-19T06:24:40.962 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "contact", 2024-09-19T06:24:40.962 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.962 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.962 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.962 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.962 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.962 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.962 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.962 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.962 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.962 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.963 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.963 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.963 INFO:teuthology.orchestra.run.smithi003.stdout: "description": { 2024-09-19T06:24:40.963 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "description", 2024-09-19T06:24:40.963 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.963 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.963 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.963 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.963 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.963 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.963 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.963 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.963 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.964 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.964 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.964 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.964 INFO:teuthology.orchestra.run.smithi003.stdout: "device_url": { 2024-09-19T06:24:40.964 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "device_url", 2024-09-19T06:24:40.964 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.964 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.964 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.964 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T06:24:40.964 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.964 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.964 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.964 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.964 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.965 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.965 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.965 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.965 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": { 2024-09-19T06:24:40.965 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "enabled", 2024-09-19T06:24:40.965 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.965 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.965 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.965 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.965 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.965 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.965 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.965 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.966 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.966 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.966 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.966 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.966 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-19T06:24:40.966 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-19T06:24:40.966 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.966 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.966 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.966 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "24", 2024-09-19T06:24:40.966 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "8", 2024-09-19T06:24:40.966 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.966 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.966 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.967 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.967 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.967 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.967 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.967 INFO:teuthology.orchestra.run.smithi003.stdout: "last_opt_revision": { 2024-09-19T06:24:40.967 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "last_opt_revision", 2024-09-19T06:24:40.967 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.967 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.967 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.967 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "1", 2024-09-19T06:24:40.967 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.967 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.967 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.967 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.968 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.968 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.968 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.968 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.968 INFO:teuthology.orchestra.run.smithi003.stdout: "leaderboard": { 2024-09-19T06:24:40.968 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "leaderboard", 2024-09-19T06:24:40.968 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.968 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.968 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.968 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.968 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.968 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.968 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.969 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.969 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.969 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.969 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.969 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.969 INFO:teuthology.orchestra.run.smithi003.stdout: "leaderboard_description": { 2024-09-19T06:24:40.969 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "leaderboard_description", 2024-09-19T06:24:40.969 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.969 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.969 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.969 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.969 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.969 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.970 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.970 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.970 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.970 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.970 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.970 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.970 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.970 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.970 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.970 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.970 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.970 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.970 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.970 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.971 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.971 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.971 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.971 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.971 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.971 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.971 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.971 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.971 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.971 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.971 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.971 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.971 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.972 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.972 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.972 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.972 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.972 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.972 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.972 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.972 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.972 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.972 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.972 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.972 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.972 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.973 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.973 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.973 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.973 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.973 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.973 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.973 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.973 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.973 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.973 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.973 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.973 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.973 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.974 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.974 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.974 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.974 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.974 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.974 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.974 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.974 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.974 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.974 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.974 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.974 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.974 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.974 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.975 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.975 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.975 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.975 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.975 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.975 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.975 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.975 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.975 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.975 INFO:teuthology.orchestra.run.smithi003.stdout: "organization": { 2024-09-19T06:24:40.975 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "organization", 2024-09-19T06:24:40.975 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.975 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.975 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.976 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.976 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.976 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.976 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.976 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.976 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.976 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.976 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.976 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.976 INFO:teuthology.orchestra.run.smithi003.stdout: "proxy": { 2024-09-19T06:24:40.976 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "proxy", 2024-09-19T06:24:40.977 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.977 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.977 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.977 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.977 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.977 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.977 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.977 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.977 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.977 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.977 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.977 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.977 INFO:teuthology.orchestra.run.smithi003.stdout: "url": { 2024-09-19T06:24:40.977 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "url", 2024-09-19T06:24:40.978 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.978 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.978 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.978 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T06:24:40.978 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.978 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.978 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.978 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.978 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.978 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.978 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.978 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.978 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.979 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.979 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.979 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "test_orchestrator", 2024-09-19T06:24:40.979 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.979 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.979 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.979 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.979 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.979 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.979 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.979 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.979 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.979 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.979 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.980 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.980 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.980 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.980 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.980 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.980 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.980 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.980 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.980 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.980 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.980 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.980 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.980 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.981 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.981 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.981 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.981 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.981 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.981 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.981 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.981 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.981 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.981 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.981 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.981 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.981 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.982 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.982 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.982 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.982 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.982 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.982 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.982 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.982 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.982 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.982 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.982 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.982 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.982 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.983 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.983 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.983 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.983 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.983 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.983 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.983 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.983 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.983 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.983 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.983 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.983 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.983 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.983 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.984 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.984 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.984 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.984 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.984 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.984 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.984 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.984 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.984 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.984 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.984 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.984 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.984 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "volumes", 2024-09-19T06:24:40.985 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.985 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.985 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.985 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.985 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.985 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.985 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.985 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.985 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.985 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.985 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.985 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.985 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.985 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.986 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.986 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.986 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.986 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.986 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.986 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.986 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.986 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.986 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.986 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.986 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:40.986 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:40.986 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.987 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.987 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.987 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.987 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.987 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.987 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.987 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.987 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.987 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.987 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.987 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.987 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:40.987 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:40.987 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.988 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.988 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.988 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:40.988 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.988 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.988 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.988 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.988 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.988 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.988 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.988 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.988 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.988 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.988 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.989 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.989 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.989 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.989 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.989 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:40.989 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:40.989 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.989 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.989 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.989 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.989 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.989 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.989 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.990 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.990 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.990 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.990 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.990 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.990 INFO:teuthology.orchestra.run.smithi003.stdout: "max_concurrent_clones": { 2024-09-19T06:24:40.990 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_concurrent_clones", 2024-09-19T06:24:40.990 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.990 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.990 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.990 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "4", 2024-09-19T06:24:40.990 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.990 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.991 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.991 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T06:24:40.991 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.991 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.991 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.991 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.991 INFO:teuthology.orchestra.run.smithi003.stdout: "periodic_async_work": { 2024-09-19T06:24:40.991 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "periodic_async_work", 2024-09-19T06:24:40.991 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.991 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.991 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.991 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:40.991 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.992 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.992 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.992 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Periodically check for async work", 2024-09-19T06:24:40.992 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.992 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.992 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.992 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.992 INFO:teuthology.orchestra.run.smithi003.stdout: "snapshot_clone_delay": { 2024-09-19T06:24:40.992 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "snapshot_clone_delay", 2024-09-19T06:24:40.992 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:40.992 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.992 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.992 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-19T06:24:40.993 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.993 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.993 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.993 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T06:24:40.993 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.993 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.993 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.993 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.993 INFO:teuthology.orchestra.run.smithi003.stdout: "snapshot_clone_no_wait": { 2024-09-19T06:24:40.993 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T06:24:40.993 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:40.993 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.993 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.994 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:40.994 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.994 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.994 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.994 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T06:24:40.994 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.994 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.994 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.994 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.994 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:40.994 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.994 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:40.994 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "zabbix", 2024-09-19T06:24:40.995 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:40.995 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:40.995 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:40.995 INFO:teuthology.orchestra.run.smithi003.stdout: "discovery_interval": { 2024-09-19T06:24:40.995 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "discovery_interval", 2024-09-19T06:24:40.995 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-19T06:24:40.995 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.995 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.995 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "100", 2024-09-19T06:24:40.995 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.995 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.995 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.995 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.995 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.996 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.996 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.996 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.996 INFO:teuthology.orchestra.run.smithi003.stdout: "identifier": { 2024-09-19T06:24:40.996 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "identifier", 2024-09-19T06:24:40.996 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.996 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.996 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.996 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.996 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.996 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.996 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.996 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.997 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.997 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.997 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.997 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.997 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-19T06:24:40.997 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-19T06:24:40.997 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:40.997 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.997 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:40.997 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-19T06:24:40.997 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.997 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.997 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:40.998 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.998 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.998 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.998 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.998 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.998 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:40.998 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:40.998 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:40.998 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:40.998 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:40.998 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:40.998 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:40.998 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:40.998 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:40.999 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:40.999 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:40.999 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:40.999 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:40.999 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:40.999 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:40.999 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:40.999 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:40.999 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:40.999 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:40.999 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:40.999 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:40.999 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.000 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.000 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.000 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.000 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.000 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.000 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.000 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.000 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.000 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.000 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.000 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.000 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.000 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.000 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.001 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.001 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.001 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.001 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.001 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.001 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.001 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.001 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.001 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.001 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.001 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.001 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.001 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.002 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.002 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.002 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.002 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.002 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.002 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.002 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.002 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.002 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.002 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.002 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.002 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.002 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.002 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.003 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.003 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.003 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.003 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.003 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.003 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.003 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.003 INFO:teuthology.orchestra.run.smithi003.stdout: "zabbix_host": { 2024-09-19T06:24:41.003 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "zabbix_host", 2024-09-19T06:24:41.003 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.004 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.004 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.004 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.004 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.004 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.004 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.004 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.004 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.004 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.004 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.004 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.004 INFO:teuthology.orchestra.run.smithi003.stdout: "zabbix_port": { 2024-09-19T06:24:41.004 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "zabbix_port", 2024-09-19T06:24:41.005 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.005 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.005 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.005 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10051", 2024-09-19T06:24:41.005 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.005 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.005 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.005 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.005 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.005 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.005 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.005 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.006 INFO:teuthology.orchestra.run.smithi003.stdout: "zabbix_sender": { 2024-09-19T06:24:41.006 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "zabbix_sender", 2024-09-19T06:24:41.006 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.006 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.006 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.006 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T06:24:41.006 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.006 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.006 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.006 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.006 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.006 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.006 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.006 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.007 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.007 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.007 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-19T06:24:41.007 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.007 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.007 INFO:teuthology.orchestra.run.smithi003.stdout: "gid": 25159, 2024-09-19T06:24:41.007 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "z", 2024-09-19T06:24:41.007 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr_features": 4540701547738038271, 2024-09-19T06:24:41.007 INFO:teuthology.orchestra.run.smithi003.stdout: "available_modules": [ 2024-09-19T06:24:41.007 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.007 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "alerts", 2024-09-19T06:24:41.007 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.007 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.007 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.008 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-19T06:24:41.008 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-19T06:24:41.008 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.008 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.008 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.008 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-19T06:24:41.008 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.008 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.008 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.008 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T06:24:41.008 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.008 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.008 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.008 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.009 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.009 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.009 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.009 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.009 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.009 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.009 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.009 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.009 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.009 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.009 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.009 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.009 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.010 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.010 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.010 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.010 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.010 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.010 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.010 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.010 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.010 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.010 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.010 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.010 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.010 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.010 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.010 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.011 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.011 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.011 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.011 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.011 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.011 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.011 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.011 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.011 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.011 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.011 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.011 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.011 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.012 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.012 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.012 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.012 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.012 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.012 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.012 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.012 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.012 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.012 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.012 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.012 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.012 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.012 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.013 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.013 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.013 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.013 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.013 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.013 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.013 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.013 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.013 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.013 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.013 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.013 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.014 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.014 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.014 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.014 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_destination": { 2024-09-19T06:24:41.014 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_destination", 2024-09-19T06:24:41.014 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.014 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.014 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.014 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.014 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.014 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.014 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.014 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Email address to send alerts to", 2024-09-19T06:24:41.014 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.015 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.015 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.015 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.015 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_from_name": { 2024-09-19T06:24:41.015 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_from_name", 2024-09-19T06:24:41.015 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.015 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.015 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.015 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "Ceph", 2024-09-19T06:24:41.015 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.015 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.015 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.015 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Email From: name", 2024-09-19T06:24:41.016 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.016 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.016 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.016 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.016 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_host": { 2024-09-19T06:24:41.016 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_host", 2024-09-19T06:24:41.016 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.016 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.016 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.016 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.016 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.016 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.016 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.017 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "SMTP server", 2024-09-19T06:24:41.017 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.017 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.017 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.017 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.017 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_password": { 2024-09-19T06:24:41.017 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_password", 2024-09-19T06:24:41.017 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.017 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.017 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.017 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.017 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.017 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.018 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.018 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Password to authenticate with", 2024-09-19T06:24:41.018 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.018 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.018 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.018 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.018 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_port": { 2024-09-19T06:24:41.018 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_port", 2024-09-19T06:24:41.018 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.018 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.018 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.018 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "465", 2024-09-19T06:24:41.018 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.018 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.019 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.019 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "SMTP port", 2024-09-19T06:24:41.019 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.019 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.019 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.019 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.019 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_sender": { 2024-09-19T06:24:41.019 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_sender", 2024-09-19T06:24:41.019 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.019 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.019 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.019 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.019 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.019 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.020 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.020 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "SMTP envelope sender", 2024-09-19T06:24:41.020 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.020 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.020 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.020 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.020 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_ssl": { 2024-09-19T06:24:41.020 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_ssl", 2024-09-19T06:24:41.020 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.020 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.020 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.020 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.020 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.021 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.021 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.021 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T06:24:41.021 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.021 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.021 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.021 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.021 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_user": { 2024-09-19T06:24:41.021 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_user", 2024-09-19T06:24:41.021 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.021 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.021 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.022 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.022 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.022 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.022 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.022 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "User to authenticate as", 2024-09-19T06:24:41.022 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.022 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.022 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.022 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.022 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.022 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.022 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.022 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "balancer", 2024-09-19T06:24:41.023 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.023 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.023 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.023 INFO:teuthology.orchestra.run.smithi003.stdout: "active": { 2024-09-19T06:24:41.023 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "active", 2024-09-19T06:24:41.023 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.023 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.023 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.023 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.023 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.023 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.023 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.023 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T06:24:41.024 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.024 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.024 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.024 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.024 INFO:teuthology.orchestra.run.smithi003.stdout: "begin_time": { 2024-09-19T06:24:41.024 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "begin_time", 2024-09-19T06:24:41.024 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.024 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.024 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.024 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0000", 2024-09-19T06:24:41.024 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.024 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.024 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.025 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T06:24:41.025 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:24:41.025 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.025 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.025 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.025 INFO:teuthology.orchestra.run.smithi003.stdout: "begin_weekday": { 2024-09-19T06:24:41.025 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "begin_weekday", 2024-09-19T06:24:41.025 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-19T06:24:41.025 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.025 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.025 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-19T06:24:41.025 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "0", 2024-09-19T06:24:41.025 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "6", 2024-09-19T06:24:41.026 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.026 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T06:24:41.026 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:24:41.026 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.026 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.026 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.026 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_compat_max_iterations": { 2024-09-19T06:24:41.026 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crush_compat_max_iterations", 2024-09-19T06:24:41.026 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-19T06:24:41.026 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.026 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.026 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "25", 2024-09-19T06:24:41.026 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1", 2024-09-19T06:24:41.026 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "250", 2024-09-19T06:24:41.027 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.027 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T06:24:41.027 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.027 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.027 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.027 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.027 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_compat_metrics": { 2024-09-19T06:24:41.027 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crush_compat_metrics", 2024-09-19T06:24:41.027 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.027 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.027 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.027 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T06:24:41.027 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.027 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.028 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.028 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T06:24:41.028 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T06:24:41.028 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.028 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.028 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.028 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_compat_step": { 2024-09-19T06:24:41.028 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crush_compat_step", 2024-09-19T06:24:41.028 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-19T06:24:41.028 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.028 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.028 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0.5", 2024-09-19T06:24:41.028 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "0.001", 2024-09-19T06:24:41.029 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "0.999", 2024-09-19T06:24:41.029 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.029 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "aggressiveness of optimization", 2024-09-19T06:24:41.029 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T06:24:41.029 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.029 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.029 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.029 INFO:teuthology.orchestra.run.smithi003.stdout: "end_time": { 2024-09-19T06:24:41.029 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "end_time", 2024-09-19T06:24:41.029 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.029 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.029 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.029 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "2359", 2024-09-19T06:24:41.030 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.030 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.030 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.030 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T06:24:41.030 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:24:41.030 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.030 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.030 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.030 INFO:teuthology.orchestra.run.smithi003.stdout: "end_weekday": { 2024-09-19T06:24:41.030 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "end_weekday", 2024-09-19T06:24:41.030 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-19T06:24:41.030 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.030 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.030 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-19T06:24:41.031 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "0", 2024-09-19T06:24:41.031 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "6", 2024-09-19T06:24:41.031 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.031 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T06:24:41.031 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:24:41.031 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.031 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.031 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.031 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.031 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.031 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.031 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.031 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.032 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.032 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.032 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.032 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.032 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.032 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.032 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.032 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.032 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.032 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.032 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.032 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.032 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.033 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.033 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.033 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.033 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.033 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.033 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.033 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.033 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.033 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.033 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.033 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.033 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.034 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.034 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.034 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.034 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.034 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.034 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.034 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.034 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.034 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.034 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.034 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.034 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.035 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.035 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.035 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.035 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.035 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.035 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.035 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.035 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.035 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.035 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.035 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.035 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.035 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.035 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.036 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.036 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.036 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.036 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.036 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.036 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.036 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.036 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.036 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.036 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.036 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.036 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.036 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.037 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.037 INFO:teuthology.orchestra.run.smithi003.stdout: "min_score": { 2024-09-19T06:24:41.037 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "min_score", 2024-09-19T06:24:41.037 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-19T06:24:41.037 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.037 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.037 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-19T06:24:41.037 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.037 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.037 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.037 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T06:24:41.037 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.037 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.038 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.038 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.038 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": { 2024-09-19T06:24:41.038 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mode", 2024-09-19T06:24:41.038 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.038 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.038 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.038 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "upmap", 2024-09-19T06:24:41.038 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.038 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.038 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.038 INFO:teuthology.orchestra.run.smithi003.stdout: "crush-compat", 2024-09-19T06:24:41.038 INFO:teuthology.orchestra.run.smithi003.stdout: "none", 2024-09-19T06:24:41.039 INFO:teuthology.orchestra.run.smithi003.stdout: "read", 2024-09-19T06:24:41.039 INFO:teuthology.orchestra.run.smithi003.stdout: "upmap", 2024-09-19T06:24:41.039 INFO:teuthology.orchestra.run.smithi003.stdout: "upmap-read" 2024-09-19T06:24:41.039 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.039 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Balancer mode", 2024-09-19T06:24:41.039 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.039 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.039 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.039 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.039 INFO:teuthology.orchestra.run.smithi003.stdout: "pool_ids": { 2024-09-19T06:24:41.039 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "pool_ids", 2024-09-19T06:24:41.039 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.039 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.039 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.040 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.040 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.040 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.040 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.040 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T06:24:41.040 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.040 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.040 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.040 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.040 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-19T06:24:41.040 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-19T06:24:41.040 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.041 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.041 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.041 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-19T06:24:41.041 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.041 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.041 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.041 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T06:24:41.041 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.041 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.041 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.041 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.041 INFO:teuthology.orchestra.run.smithi003.stdout: "upmap_max_deviation": { 2024-09-19T06:24:41.042 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "upmap_max_deviation", 2024-09-19T06:24:41.042 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.042 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.042 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.042 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-19T06:24:41.042 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1", 2024-09-19T06:24:41.042 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.042 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.042 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T06:24:41.042 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T06:24:41.042 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.042 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.042 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.042 INFO:teuthology.orchestra.run.smithi003.stdout: "upmap_max_optimizations": { 2024-09-19T06:24:41.043 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "upmap_max_optimizations", 2024-09-19T06:24:41.043 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-19T06:24:41.043 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.043 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.043 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-19T06:24:41.043 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.043 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.043 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.043 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T06:24:41.043 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.043 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.043 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.043 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.043 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.044 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.044 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.044 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cephadm", 2024-09-19T06:24:41.044 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.044 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.044 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.044 INFO:teuthology.orchestra.run.smithi003.stdout: "agent_down_multiplier": { 2024-09-19T06:24:41.044 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "agent_down_multiplier", 2024-09-19T06:24:41.044 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-19T06:24:41.044 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.044 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.044 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "3.0", 2024-09-19T06:24:41.044 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.045 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.045 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.045 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T06:24:41.045 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.045 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.045 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.045 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.045 INFO:teuthology.orchestra.run.smithi003.stdout: "agent_refresh_rate": { 2024-09-19T06:24:41.045 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "agent_refresh_rate", 2024-09-19T06:24:41.045 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.045 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.045 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.045 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "20", 2024-09-19T06:24:41.045 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.046 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.046 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.046 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T06:24:41.046 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.046 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.046 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.046 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.046 INFO:teuthology.orchestra.run.smithi003.stdout: "agent_starting_port": { 2024-09-19T06:24:41.046 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "agent_starting_port", 2024-09-19T06:24:41.046 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.046 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.046 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.046 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "4721", 2024-09-19T06:24:41.046 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.047 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.047 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.047 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T06:24:41.047 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.047 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.047 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.047 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.047 INFO:teuthology.orchestra.run.smithi003.stdout: "allow_ptrace": { 2024-09-19T06:24:41.047 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "allow_ptrace", 2024-09-19T06:24:41.047 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.047 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.047 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.048 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.048 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.048 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.048 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.048 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T06:24:41.048 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T06:24:41.048 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.048 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.048 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.048 INFO:teuthology.orchestra.run.smithi003.stdout: "autotune_interval": { 2024-09-19T06:24:41.048 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "autotune_interval", 2024-09-19T06:24:41.048 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.048 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.049 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.049 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-19T06:24:41.049 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.049 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.049 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.049 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T06:24:41.049 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.049 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.049 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.049 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.049 INFO:teuthology.orchestra.run.smithi003.stdout: "autotune_memory_target_ratio": { 2024-09-19T06:24:41.049 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T06:24:41.049 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-19T06:24:41.050 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.050 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.050 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0.7", 2024-09-19T06:24:41.050 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.050 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.050 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.050 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T06:24:41.050 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.050 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.050 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.050 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.050 INFO:teuthology.orchestra.run.smithi003.stdout: "cephadm_log_destination": { 2024-09-19T06:24:41.050 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cephadm_log_destination", 2024-09-19T06:24:41.051 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.051 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.051 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.051 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.051 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.051 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.051 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.051 INFO:teuthology.orchestra.run.smithi003.stdout: "file", 2024-09-19T06:24:41.051 INFO:teuthology.orchestra.run.smithi003.stdout: "file,syslog", 2024-09-19T06:24:41.051 INFO:teuthology.orchestra.run.smithi003.stdout: "syslog" 2024-09-19T06:24:41.051 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.051 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T06:24:41.051 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.051 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.052 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.052 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.052 INFO:teuthology.orchestra.run.smithi003.stdout: "cgroups_split": { 2024-09-19T06:24:41.052 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cgroups_split", 2024-09-19T06:24:41.052 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.052 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.052 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.052 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.052 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.052 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.052 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.052 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T06:24:41.052 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.053 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.053 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.053 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.053 INFO:teuthology.orchestra.run.smithi003.stdout: "config_checks_enabled": { 2024-09-19T06:24:41.053 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "config_checks_enabled", 2024-09-19T06:24:41.053 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.053 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.053 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.053 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.053 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.053 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.053 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.053 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T06:24:41.054 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.054 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.054 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.054 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.054 INFO:teuthology.orchestra.run.smithi003.stdout: "config_dashboard": { 2024-09-19T06:24:41.054 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "config_dashboard", 2024-09-19T06:24:41.054 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.054 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.054 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.054 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.054 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.054 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.054 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.055 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T06:24:41.055 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.055 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.055 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.055 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.055 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_alertmanager": { 2024-09-19T06:24:41.055 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_alertmanager", 2024-09-19T06:24:41.055 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.055 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.055 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.055 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T06:24:41.055 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.055 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.055 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.056 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Prometheus container image", 2024-09-19T06:24:41.056 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.056 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.056 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.056 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.056 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_base": { 2024-09-19T06:24:41.056 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_base", 2024-09-19T06:24:41.056 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.056 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.056 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.056 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T06:24:41.056 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.056 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.057 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.057 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Container image name, without the tag", 2024-09-19T06:24:41.057 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.057 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.057 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.057 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.057 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_elasticsearch": { 2024-09-19T06:24:41.057 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_elasticsearch", 2024-09-19T06:24:41.057 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.057 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.057 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.057 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T06:24:41.057 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.057 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.058 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.058 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "elasticsearch container image", 2024-09-19T06:24:41.058 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.058 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.058 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.058 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.058 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_grafana": { 2024-09-19T06:24:41.058 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_grafana", 2024-09-19T06:24:41.058 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.058 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.058 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.058 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T06:24:41.058 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.058 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.059 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.059 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Prometheus container image", 2024-09-19T06:24:41.059 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.059 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.059 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.059 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.059 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_haproxy": { 2024-09-19T06:24:41.059 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_haproxy", 2024-09-19T06:24:41.059 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.059 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.059 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.059 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T06:24:41.060 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.060 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.060 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.060 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "HAproxy container image", 2024-09-19T06:24:41.060 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.060 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.060 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.060 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.060 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_jaeger_agent": { 2024-09-19T06:24:41.060 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_jaeger_agent", 2024-09-19T06:24:41.060 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.060 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.060 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.061 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T06:24:41.061 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.061 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.061 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.061 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Jaeger agent container image", 2024-09-19T06:24:41.061 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.061 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.061 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.061 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.061 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_jaeger_collector": { 2024-09-19T06:24:41.061 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_jaeger_collector", 2024-09-19T06:24:41.061 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.062 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.062 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.062 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T06:24:41.062 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.062 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.062 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.062 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Jaeger collector container image", 2024-09-19T06:24:41.062 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.062 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.062 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.062 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.062 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_jaeger_query": { 2024-09-19T06:24:41.062 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_jaeger_query", 2024-09-19T06:24:41.062 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.063 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.063 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.063 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T06:24:41.063 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.063 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.063 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.063 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Jaeger query container image", 2024-09-19T06:24:41.063 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.063 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.063 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.063 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.063 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_keepalived": { 2024-09-19T06:24:41.063 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_keepalived", 2024-09-19T06:24:41.064 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.064 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.064 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.064 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T06:24:41.064 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.064 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.064 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.064 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Keepalived container image", 2024-09-19T06:24:41.064 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.064 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.064 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.064 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.064 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_loki": { 2024-09-19T06:24:41.065 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_loki", 2024-09-19T06:24:41.065 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.065 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.065 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.065 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T06:24:41.065 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.065 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.065 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.065 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Loki container image", 2024-09-19T06:24:41.065 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.065 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.065 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.065 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.066 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_node_exporter": { 2024-09-19T06:24:41.066 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_node_exporter", 2024-09-19T06:24:41.066 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.066 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.066 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.066 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T06:24:41.066 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.066 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.066 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.066 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Prometheus container image", 2024-09-19T06:24:41.066 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.066 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.066 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.067 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.067 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_nvmeof": { 2024-09-19T06:24:41.067 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_nvmeof", 2024-09-19T06:24:41.067 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.067 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.067 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.067 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T06:24:41.067 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.067 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.067 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.067 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Nvme-of container image", 2024-09-19T06:24:41.067 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.067 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.067 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.068 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.068 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_prometheus": { 2024-09-19T06:24:41.068 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_prometheus", 2024-09-19T06:24:41.068 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.068 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.068 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.068 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T06:24:41.068 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.068 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.068 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.068 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Prometheus container image", 2024-09-19T06:24:41.068 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.068 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.069 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.069 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.069 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_promtail": { 2024-09-19T06:24:41.069 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_promtail", 2024-09-19T06:24:41.069 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.069 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.069 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.069 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T06:24:41.069 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.069 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.069 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.069 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Promtail container image", 2024-09-19T06:24:41.069 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.069 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.070 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.070 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.070 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_samba": { 2024-09-19T06:24:41.070 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_samba", 2024-09-19T06:24:41.070 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.070 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.070 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.070 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T06:24:41.070 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.070 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.070 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.070 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Samba/SMB container image", 2024-09-19T06:24:41.070 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.070 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.071 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.071 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.071 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_snmp_gateway": { 2024-09-19T06:24:41.071 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_snmp_gateway", 2024-09-19T06:24:41.071 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.071 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.071 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.071 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T06:24:41.071 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.071 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.071 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.071 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "SNMP Gateway container image", 2024-09-19T06:24:41.071 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.072 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.072 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.072 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.072 INFO:teuthology.orchestra.run.smithi003.stdout: "container_init": { 2024-09-19T06:24:41.072 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_init", 2024-09-19T06:24:41.072 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.072 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.072 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.072 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.072 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.072 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.072 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.073 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T06:24:41.073 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.073 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.073 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.073 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.073 INFO:teuthology.orchestra.run.smithi003.stdout: "daemon_cache_timeout": { 2024-09-19T06:24:41.073 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "daemon_cache_timeout", 2024-09-19T06:24:41.073 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.073 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.073 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.073 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-19T06:24:41.073 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.073 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.073 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.074 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T06:24:41.074 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.074 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.074 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.074 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.074 INFO:teuthology.orchestra.run.smithi003.stdout: "default_cephadm_command_timeout": { 2024-09-19T06:24:41.074 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T06:24:41.074 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.074 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.074 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.074 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "900", 2024-09-19T06:24:41.074 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.074 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.075 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.075 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T06:24:41.075 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.075 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.075 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.075 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.075 INFO:teuthology.orchestra.run.smithi003.stdout: "default_registry": { 2024-09-19T06:24:41.075 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "default_registry", 2024-09-19T06:24:41.075 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.075 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.075 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.075 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "docker.io", 2024-09-19T06:24:41.075 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.076 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.076 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.076 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T06:24:41.076 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.076 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.076 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.076 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.076 INFO:teuthology.orchestra.run.smithi003.stdout: "device_cache_timeout": { 2024-09-19T06:24:41.076 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "device_cache_timeout", 2024-09-19T06:24:41.076 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.076 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.076 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.076 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "1800", 2024-09-19T06:24:41.077 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.077 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.077 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.077 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "seconds to cache device inventory", 2024-09-19T06:24:41.077 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.077 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.077 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.077 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.077 INFO:teuthology.orchestra.run.smithi003.stdout: "device_enhanced_scan": { 2024-09-19T06:24:41.077 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "device_enhanced_scan", 2024-09-19T06:24:41.077 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.077 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.077 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.078 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.078 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.078 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.078 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.078 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T06:24:41.078 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.078 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.078 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.078 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.078 INFO:teuthology.orchestra.run.smithi003.stdout: "facts_cache_timeout": { 2024-09-19T06:24:41.078 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "facts_cache_timeout", 2024-09-19T06:24:41.078 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.078 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.078 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.079 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-19T06:24:41.079 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.079 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.079 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.079 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "seconds to cache host facts data", 2024-09-19T06:24:41.079 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.079 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.079 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.079 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.079 INFO:teuthology.orchestra.run.smithi003.stdout: "grafana_dashboards_path": { 2024-09-19T06:24:41.079 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "grafana_dashboards_path", 2024-09-19T06:24:41.079 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.079 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.080 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.080 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T06:24:41.080 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.080 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.080 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.080 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T06:24:41.080 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.080 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.080 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.080 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.080 INFO:teuthology.orchestra.run.smithi003.stdout: "host_check_interval": { 2024-09-19T06:24:41.080 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "host_check_interval", 2024-09-19T06:24:41.081 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.081 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.081 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.081 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-19T06:24:41.081 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.081 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.081 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.081 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to perform a host check", 2024-09-19T06:24:41.081 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.081 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.081 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.081 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.081 INFO:teuthology.orchestra.run.smithi003.stdout: "hw_monitoring": { 2024-09-19T06:24:41.081 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "hw_monitoring", 2024-09-19T06:24:41.082 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.082 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.082 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.082 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.082 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.082 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.082 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.082 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T06:24:41.082 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.082 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.082 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.082 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.082 INFO:teuthology.orchestra.run.smithi003.stdout: "inventory_list_all": { 2024-09-19T06:24:41.083 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "inventory_list_all", 2024-09-19T06:24:41.083 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.083 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.083 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.083 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.083 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.083 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.083 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.083 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T06:24:41.083 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.083 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.083 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.083 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.083 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.084 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.084 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.084 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.084 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.084 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.084 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.084 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.084 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.084 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.084 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.084 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.084 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.084 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.085 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.085 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.085 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.085 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.085 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.085 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.085 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.085 INFO:teuthology.orchestra.run.smithi003.stdout: "log_refresh_metadata": { 2024-09-19T06:24:41.085 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_refresh_metadata", 2024-09-19T06:24:41.085 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.085 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.085 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.085 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.086 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.086 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.086 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.086 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T06:24:41.086 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.086 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.086 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.086 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.086 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.086 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.086 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.086 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.086 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.087 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.087 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.087 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.087 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.087 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T06:24:41.087 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.087 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.087 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.087 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.087 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.087 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.087 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.087 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.088 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.088 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.088 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.088 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.088 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.088 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.088 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.088 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.088 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.088 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.088 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.088 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.088 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.088 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.089 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.089 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.089 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.089 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.089 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.089 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.089 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.089 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.089 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.089 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.089 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.089 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.089 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.090 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.090 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.090 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.090 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.090 INFO:teuthology.orchestra.run.smithi003.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T06:24:41.090 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T06:24:41.090 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.090 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.090 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.090 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.090 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.090 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.090 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.090 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T06:24:41.091 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.091 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.091 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.091 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.091 INFO:teuthology.orchestra.run.smithi003.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T06:24:41.091 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T06:24:41.091 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.091 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.091 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.091 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "*", 2024-09-19T06:24:41.091 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.091 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.091 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.092 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T06:24:41.092 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.092 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.092 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.092 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.092 INFO:teuthology.orchestra.run.smithi003.stdout: "max_count_per_host": { 2024-09-19T06:24:41.092 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_count_per_host", 2024-09-19T06:24:41.092 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.092 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.092 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.092 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-19T06:24:41.092 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.092 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.092 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.093 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "max number of daemons per service per host", 2024-09-19T06:24:41.093 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.093 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.093 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.093 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.093 INFO:teuthology.orchestra.run.smithi003.stdout: "max_osd_draining_count": { 2024-09-19T06:24:41.093 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_osd_draining_count", 2024-09-19T06:24:41.093 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.093 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.093 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.093 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-19T06:24:41.093 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.093 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.094 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.094 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T06:24:41.094 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.094 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.094 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.094 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.094 INFO:teuthology.orchestra.run.smithi003.stdout: "migration_current": { 2024-09-19T06:24:41.094 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "migration_current", 2024-09-19T06:24:41.094 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.094 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.094 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.094 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.094 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.094 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.095 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.095 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "internal - do not modify", 2024-09-19T06:24:41.095 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.095 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.095 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.095 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.095 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": { 2024-09-19T06:24:41.095 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mode", 2024-09-19T06:24:41.095 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.095 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.095 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.095 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "root", 2024-09-19T06:24:41.095 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.095 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.096 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.096 INFO:teuthology.orchestra.run.smithi003.stdout: "cephadm-package", 2024-09-19T06:24:41.096 INFO:teuthology.orchestra.run.smithi003.stdout: "root" 2024-09-19T06:24:41.096 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.096 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T06:24:41.096 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.096 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.096 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.096 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.096 INFO:teuthology.orchestra.run.smithi003.stdout: "oob_default_addr": { 2024-09-19T06:24:41.096 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "oob_default_addr", 2024-09-19T06:24:41.096 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.096 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.097 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.097 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "169.254.1.1", 2024-09-19T06:24:41.097 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.097 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.097 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.097 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T06:24:41.097 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.097 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.097 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.097 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.097 INFO:teuthology.orchestra.run.smithi003.stdout: "prometheus_alerts_path": { 2024-09-19T06:24:41.097 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "prometheus_alerts_path", 2024-09-19T06:24:41.097 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.097 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.098 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.098 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T06:24:41.098 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.098 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.098 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.098 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T06:24:41.098 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.098 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.098 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.098 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.098 INFO:teuthology.orchestra.run.smithi003.stdout: "registry_insecure": { 2024-09-19T06:24:41.098 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "registry_insecure", 2024-09-19T06:24:41.099 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.099 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.099 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.099 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.099 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.099 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.099 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.099 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T06:24:41.099 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.099 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.099 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.099 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.099 INFO:teuthology.orchestra.run.smithi003.stdout: "registry_password": { 2024-09-19T06:24:41.100 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "registry_password", 2024-09-19T06:24:41.100 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.100 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.100 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.100 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.100 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.100 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.100 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.100 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T06:24:41.100 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.100 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.100 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.100 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.101 INFO:teuthology.orchestra.run.smithi003.stdout: "registry_url": { 2024-09-19T06:24:41.101 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "registry_url", 2024-09-19T06:24:41.101 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.101 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.101 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.101 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.101 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.101 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.101 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.101 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T06:24:41.101 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.101 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.101 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.102 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.102 INFO:teuthology.orchestra.run.smithi003.stdout: "registry_username": { 2024-09-19T06:24:41.102 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "registry_username", 2024-09-19T06:24:41.102 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.102 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.102 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.102 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.102 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.102 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.102 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.102 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T06:24:41.102 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.102 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.102 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.103 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.103 INFO:teuthology.orchestra.run.smithi003.stdout: "secure_monitoring_stack": { 2024-09-19T06:24:41.103 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "secure_monitoring_stack", 2024-09-19T06:24:41.103 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.103 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.103 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.103 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.103 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.103 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.103 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.104 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T06:24:41.104 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.104 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.104 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.104 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.104 INFO:teuthology.orchestra.run.smithi003.stdout: "service_discovery_port": { 2024-09-19T06:24:41.104 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "service_discovery_port", 2024-09-19T06:24:41.104 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.104 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.104 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.104 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8765", 2024-09-19T06:24:41.104 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.105 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.105 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.105 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "cephadm service discovery port", 2024-09-19T06:24:41.105 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.105 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.105 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.105 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.105 INFO:teuthology.orchestra.run.smithi003.stdout: "ssh_config_file": { 2024-09-19T06:24:41.105 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ssh_config_file", 2024-09-19T06:24:41.105 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.105 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.105 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.105 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.105 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.106 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.106 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.106 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T06:24:41.106 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.106 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.106 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.106 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.106 INFO:teuthology.orchestra.run.smithi003.stdout: "use_agent": { 2024-09-19T06:24:41.106 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "use_agent", 2024-09-19T06:24:41.106 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.106 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.106 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.106 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.106 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.107 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.107 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.107 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T06:24:41.107 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.107 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.107 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.107 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.107 INFO:teuthology.orchestra.run.smithi003.stdout: "use_repo_digest": { 2024-09-19T06:24:41.107 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "use_repo_digest", 2024-09-19T06:24:41.107 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.107 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.107 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.107 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.108 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.108 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.108 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.108 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T06:24:41.108 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.108 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.108 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.108 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.108 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_on_failed_host_check": { 2024-09-19T06:24:41.108 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_on_failed_host_check", 2024-09-19T06:24:41.108 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.108 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.109 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.109 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.109 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.109 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.109 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.109 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T06:24:41.109 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.109 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.109 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.109 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.109 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_on_stray_daemons": { 2024-09-19T06:24:41.109 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_on_stray_daemons", 2024-09-19T06:24:41.109 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.110 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.110 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.110 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.110 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.110 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.110 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.110 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T06:24:41.110 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.110 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.110 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.110 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.110 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_on_stray_hosts": { 2024-09-19T06:24:41.110 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_on_stray_hosts", 2024-09-19T06:24:41.110 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.111 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.111 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.111 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.111 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.111 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.111 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.111 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T06:24:41.111 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.111 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.111 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.111 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.111 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.111 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.112 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.112 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crash", 2024-09-19T06:24:41.112 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.112 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.112 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.112 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.112 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.112 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.112 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.112 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.112 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.112 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.112 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.113 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.113 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.113 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.113 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.113 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.113 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.113 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.113 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.113 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.113 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.113 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.113 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.113 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.114 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.114 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.114 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.114 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.114 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.114 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.114 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.114 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.114 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.114 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.114 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.114 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.114 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.115 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.115 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.115 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.115 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.115 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.115 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.115 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.115 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.115 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.115 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.115 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.115 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.115 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.116 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.116 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.116 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.116 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.116 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.116 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.116 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.116 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.116 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.116 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.116 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.116 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.116 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.117 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.117 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.117 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.117 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.117 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.117 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.117 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.117 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.117 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.117 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.117 INFO:teuthology.orchestra.run.smithi003.stdout: "retain_interval": { 2024-09-19T06:24:41.117 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "retain_interval", 2024-09-19T06:24:41.117 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.118 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.118 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.118 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "31536000", 2024-09-19T06:24:41.118 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.118 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.118 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.118 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T06:24:41.118 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.118 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.118 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.118 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.118 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_recent_interval": { 2024-09-19T06:24:41.119 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_recent_interval", 2024-09-19T06:24:41.119 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.119 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.119 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.119 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "1209600", 2024-09-19T06:24:41.119 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.119 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.119 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.119 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T06:24:41.119 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.119 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.119 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.119 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.120 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.120 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.120 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.120 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "dashboard", 2024-09-19T06:24:41.120 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.120 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.120 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.120 INFO:teuthology.orchestra.run.smithi003.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T06:24:41.120 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T06:24:41.120 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.120 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.120 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.120 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-19T06:24:41.120 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.121 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.121 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.121 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.121 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.121 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.121 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.121 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.121 INFO:teuthology.orchestra.run.smithi003.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T06:24:41.121 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T06:24:41.121 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.121 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.121 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.121 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.121 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.122 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.122 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.122 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.122 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.122 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.122 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.122 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.122 INFO:teuthology.orchestra.run.smithi003.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T06:24:41.122 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T06:24:41.122 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.122 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.122 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.122 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.123 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.123 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.123 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.123 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.123 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.123 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.123 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.123 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.123 INFO:teuthology.orchestra.run.smithi003.stdout: "AUDIT_API_ENABLED": { 2024-09-19T06:24:41.123 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T06:24:41.123 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.123 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.123 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.123 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.124 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.124 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.124 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.124 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.124 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.124 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.124 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.124 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.124 INFO:teuthology.orchestra.run.smithi003.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T06:24:41.124 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T06:24:41.124 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.124 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.124 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.125 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.125 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.125 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.125 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.125 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.125 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.125 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.125 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.125 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.125 INFO:teuthology.orchestra.run.smithi003.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T06:24:41.125 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T06:24:41.125 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.125 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.126 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.126 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.126 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.126 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.126 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.126 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.126 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.126 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.126 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.126 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.126 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T06:24:41.126 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T06:24:41.126 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.127 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.127 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.127 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.127 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.127 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.127 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.127 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.127 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.127 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.127 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.127 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.127 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T06:24:41.127 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T06:24:41.128 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.128 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.128 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.128 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.128 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.128 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.128 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.128 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.128 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.128 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.128 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.128 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.128 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T06:24:41.129 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T06:24:41.129 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.129 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.129 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.129 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.129 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.129 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.129 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.129 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.129 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.129 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.129 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.129 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.130 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T06:24:41.130 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T06:24:41.130 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.130 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.130 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.130 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.130 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.130 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.130 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.130 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.130 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.130 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.130 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.131 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.131 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T06:24:41.131 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T06:24:41.131 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.131 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.131 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.131 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.131 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.131 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.131 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.131 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.131 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.131 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.131 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.132 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.132 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T06:24:41.132 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T06:24:41.132 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.132 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.132 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.132 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.132 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.132 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.132 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.132 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.132 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.132 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.133 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.133 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.133 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T06:24:41.133 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T06:24:41.133 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.133 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.133 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.133 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.133 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.133 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.133 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.133 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.134 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.134 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.134 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.134 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.134 INFO:teuthology.orchestra.run.smithi003.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T06:24:41.134 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T06:24:41.134 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.134 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.134 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.134 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.134 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.134 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.134 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.134 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.135 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.135 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.135 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.135 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.135 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T06:24:41.135 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T06:24:41.135 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.135 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.135 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.135 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "admin", 2024-09-19T06:24:41.135 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.135 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.135 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.136 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.136 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.136 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.136 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.136 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.136 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T06:24:41.136 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T06:24:41.136 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.136 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.136 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.136 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.136 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.136 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.136 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.137 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.137 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.137 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.137 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.137 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.137 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_API_URL": { 2024-09-19T06:24:41.137 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_API_URL", 2024-09-19T06:24:41.137 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.137 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.137 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.137 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.137 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.137 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.137 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.138 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.138 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.138 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.138 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.138 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.138 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T06:24:41.138 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T06:24:41.138 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.138 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.138 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.138 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "admin", 2024-09-19T06:24:41.138 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.138 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.138 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.139 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.139 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.139 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.139 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.139 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.139 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T06:24:41.139 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T06:24:41.139 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.139 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.139 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.139 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.139 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.139 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.139 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.140 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.140 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.140 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.140 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.140 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.140 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T06:24:41.140 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T06:24:41.140 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.140 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.140 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.140 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T06:24:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T06:24:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.141 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.142 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.142 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.142 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.142 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.142 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.142 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.142 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.142 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.142 INFO:teuthology.orchestra.run.smithi003.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T06:24:41.142 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T06:24:41.142 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.142 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.142 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.143 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.143 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.143 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.143 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.143 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.143 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.143 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.143 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.143 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.143 INFO:teuthology.orchestra.run.smithi003.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T06:24:41.143 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T06:24:41.143 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.143 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.143 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.144 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.144 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.144 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.144 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.144 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.144 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.144 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.144 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.144 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.144 INFO:teuthology.orchestra.run.smithi003.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T06:24:41.144 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T06:24:41.144 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.144 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.145 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.145 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.145 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.145 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.145 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.145 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.145 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.145 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.145 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.145 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.145 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T06:24:41.145 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T06:24:41.145 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.146 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.146 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.146 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.146 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.146 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.146 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.146 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.146 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.146 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.146 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.146 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.146 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T06:24:41.146 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T06:24:41.147 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.147 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.147 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.147 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.147 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.147 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.147 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.147 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.147 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.147 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.147 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.147 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.147 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T06:24:41.148 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T06:24:41.148 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.148 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.148 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.148 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.148 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.148 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.148 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.148 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.148 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.148 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.148 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.148 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.148 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T06:24:41.149 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T06:24:41.149 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.149 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.149 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.149 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.149 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.149 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.149 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.149 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.149 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.149 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.149 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.149 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.149 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T06:24:41.150 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T06:24:41.150 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.150 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.150 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.150 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.150 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.150 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.150 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.150 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.150 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.150 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.150 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.150 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.151 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T06:24:41.151 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T06:24:41.151 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.151 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.151 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.151 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.151 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.151 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.151 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.151 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.151 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.151 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.151 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.151 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.152 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T06:24:41.152 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T06:24:41.152 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.152 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.152 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.152 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.152 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.152 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.152 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.152 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.152 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.152 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.153 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.153 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.153 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T06:24:41.153 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T06:24:41.153 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.153 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.153 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.153 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.153 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.153 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.153 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.153 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.153 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.154 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.154 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.154 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.154 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T06:24:41.154 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T06:24:41.154 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.154 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.154 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.154 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T06:24:41.154 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.154 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.154 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.154 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.155 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.155 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.155 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.155 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.155 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T06:24:41.155 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T06:24:41.155 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.155 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.155 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.155 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-19T06:24:41.155 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.155 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.155 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.156 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.156 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.156 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.156 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.156 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.156 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T06:24:41.156 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T06:24:41.156 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.156 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.156 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.156 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8", 2024-09-19T06:24:41.156 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.156 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.157 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.157 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.157 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.157 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.157 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.157 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.157 INFO:teuthology.orchestra.run.smithi003.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T06:24:41.157 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T06:24:41.157 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.157 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.157 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.157 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "45", 2024-09-19T06:24:41.157 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.158 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.158 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.158 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.158 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.158 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.158 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.158 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.158 INFO:teuthology.orchestra.run.smithi003.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T06:24:41.158 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T06:24:41.158 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.158 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.158 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.158 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.159 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.159 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.159 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.159 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.159 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.159 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.159 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.159 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.159 INFO:teuthology.orchestra.run.smithi003.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T06:24:41.159 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T06:24:41.159 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.159 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.159 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.160 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "admin", 2024-09-19T06:24:41.160 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.160 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.160 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.160 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.160 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.160 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.160 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.160 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.160 INFO:teuthology.orchestra.run.smithi003.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T06:24:41.160 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T06:24:41.160 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.160 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.160 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.161 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.161 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.161 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.161 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.161 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.161 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.161 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.161 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.161 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.161 INFO:teuthology.orchestra.run.smithi003.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T06:24:41.161 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T06:24:41.161 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.161 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.162 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.162 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.162 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.162 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.162 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.162 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.162 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.162 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.162 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.162 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.162 INFO:teuthology.orchestra.run.smithi003.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T06:24:41.162 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T06:24:41.162 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.162 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.163 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.163 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-19T06:24:41.163 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.163 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.163 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.163 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.163 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.163 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.163 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.163 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.163 INFO:teuthology.orchestra.run.smithi003.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T06:24:41.163 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T06:24:41.163 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.163 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.164 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.164 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-19T06:24:41.164 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.164 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.164 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.164 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.164 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.164 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.164 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.164 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.164 INFO:teuthology.orchestra.run.smithi003.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T06:24:41.164 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T06:24:41.164 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.165 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.165 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.165 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-19T06:24:41.165 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.165 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.165 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.165 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.165 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.165 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.165 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.165 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.165 INFO:teuthology.orchestra.run.smithi003.stdout: "cross_origin_url": { 2024-09-19T06:24:41.165 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cross_origin_url", 2024-09-19T06:24:41.165 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.166 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.166 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.166 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.166 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.166 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.166 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.166 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.166 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.166 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.166 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.166 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.166 INFO:teuthology.orchestra.run.smithi003.stdout: "crt_file": { 2024-09-19T06:24:41.166 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crt_file", 2024-09-19T06:24:41.166 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.167 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.167 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.167 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.167 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.167 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.167 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.167 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.167 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.167 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.167 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.167 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.167 INFO:teuthology.orchestra.run.smithi003.stdout: "debug": { 2024-09-19T06:24:41.168 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "debug", 2024-09-19T06:24:41.168 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.168 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.168 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.168 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.168 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.168 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.168 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.168 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Enable/disable debug options", 2024-09-19T06:24:41.168 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.168 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.168 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.168 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.169 INFO:teuthology.orchestra.run.smithi003.stdout: "jwt_token_ttl": { 2024-09-19T06:24:41.169 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "jwt_token_ttl", 2024-09-19T06:24:41.169 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.169 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.169 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.169 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "28800", 2024-09-19T06:24:41.169 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.169 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.169 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.169 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.169 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.169 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.169 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.169 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.170 INFO:teuthology.orchestra.run.smithi003.stdout: "key_file": { 2024-09-19T06:24:41.170 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "key_file", 2024-09-19T06:24:41.170 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.170 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.170 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.170 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.170 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.170 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.170 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.170 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.170 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.170 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.170 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.171 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.171 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.171 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.171 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.171 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.171 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.171 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.171 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.171 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.171 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.171 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.171 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.171 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.172 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.172 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.172 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.172 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.172 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.172 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.172 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.172 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.172 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.172 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.172 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.172 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.173 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.173 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.173 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.173 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.173 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.173 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.173 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.173 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.173 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.173 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.173 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.173 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.173 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.174 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.174 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.174 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.174 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.174 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.174 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.174 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.174 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.174 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.174 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.174 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.174 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.174 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.174 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.175 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.175 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.175 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.175 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.175 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.175 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.175 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.175 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.175 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.175 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.175 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.175 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.175 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.176 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.176 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.176 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.176 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.176 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.176 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.176 INFO:teuthology.orchestra.run.smithi003.stdout: "motd": { 2024-09-19T06:24:41.176 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "motd", 2024-09-19T06:24:41.176 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.176 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.176 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.176 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.176 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.176 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.177 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.177 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "The message of the day", 2024-09-19T06:24:41.177 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.177 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.177 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.177 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.177 INFO:teuthology.orchestra.run.smithi003.stdout: "redirect_resolve_ip_addr": { 2024-09-19T06:24:41.177 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T06:24:41.177 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.177 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.177 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.177 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.177 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.178 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.178 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.178 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.178 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.178 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.178 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.178 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.178 INFO:teuthology.orchestra.run.smithi003.stdout: "server_addr": { 2024-09-19T06:24:41.178 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_addr", 2024-09-19T06:24:41.178 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.178 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.178 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.178 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "::", 2024-09-19T06:24:41.178 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.179 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.179 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.179 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.179 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.179 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.179 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.179 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.179 INFO:teuthology.orchestra.run.smithi003.stdout: "server_port": { 2024-09-19T06:24:41.179 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_port", 2024-09-19T06:24:41.179 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.179 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.179 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.179 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8080", 2024-09-19T06:24:41.179 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.180 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.180 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.180 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.180 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.180 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.180 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.180 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.180 INFO:teuthology.orchestra.run.smithi003.stdout: "ssl": { 2024-09-19T06:24:41.180 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ssl", 2024-09-19T06:24:41.180 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.180 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.180 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.180 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.181 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.181 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.181 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.181 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.181 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.181 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.181 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.181 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.181 INFO:teuthology.orchestra.run.smithi003.stdout: "ssl_server_port": { 2024-09-19T06:24:41.181 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ssl_server_port", 2024-09-19T06:24:41.181 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.181 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.181 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.181 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8443", 2024-09-19T06:24:41.182 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.182 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.182 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.182 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.182 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.182 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.182 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.182 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.182 INFO:teuthology.orchestra.run.smithi003.stdout: "standby_behaviour": { 2024-09-19T06:24:41.182 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "standby_behaviour", 2024-09-19T06:24:41.182 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.182 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.182 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.183 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "redirect", 2024-09-19T06:24:41.183 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.183 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.183 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.183 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.183 INFO:teuthology.orchestra.run.smithi003.stdout: "redirect" 2024-09-19T06:24:41.183 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.183 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.183 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.183 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.183 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.183 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.183 INFO:teuthology.orchestra.run.smithi003.stdout: "standby_error_status_code": { 2024-09-19T06:24:41.184 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "standby_error_status_code", 2024-09-19T06:24:41.184 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.184 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.184 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.184 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "500", 2024-09-19T06:24:41.184 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "400", 2024-09-19T06:24:41.184 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "599", 2024-09-19T06:24:41.184 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.184 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.184 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.184 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.185 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.185 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.185 INFO:teuthology.orchestra.run.smithi003.stdout: "url_prefix": { 2024-09-19T06:24:41.185 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "url_prefix", 2024-09-19T06:24:41.185 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.185 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.185 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.185 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.185 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.185 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.185 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.185 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.186 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.186 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.186 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.186 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.186 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.186 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.186 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.186 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "devicehealth", 2024-09-19T06:24:41.186 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.186 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.186 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.186 INFO:teuthology.orchestra.run.smithi003.stdout: "enable_monitoring": { 2024-09-19T06:24:41.186 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "enable_monitoring", 2024-09-19T06:24:41.187 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.187 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.187 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.187 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.187 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.187 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.187 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.187 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "monitor device health metrics", 2024-09-19T06:24:41.187 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.187 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.187 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.187 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.187 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.187 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.187 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.188 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.188 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.188 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.188 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.188 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.188 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.188 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.188 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.188 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.188 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.188 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.188 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.189 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.189 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.189 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.189 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.189 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.189 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.189 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.189 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.189 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.189 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.189 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.189 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.189 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.190 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.190 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.190 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.190 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.190 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.190 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.190 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.190 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.190 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.190 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.190 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.190 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.190 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.191 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.191 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.191 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.191 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.191 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.191 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.191 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.191 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.191 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.191 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.191 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.191 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.191 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.191 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.192 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.192 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.192 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.192 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.192 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.192 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.192 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.192 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.192 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.192 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.192 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.192 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.192 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.193 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.193 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.193 INFO:teuthology.orchestra.run.smithi003.stdout: "mark_out_threshold": { 2024-09-19T06:24:41.193 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mark_out_threshold", 2024-09-19T06:24:41.193 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.193 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.193 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.193 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "2419200", 2024-09-19T06:24:41.193 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.193 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.193 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.193 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T06:24:41.193 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.193 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: "pool_name": { 2024-09-19T06:24:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "pool_name", 2024-09-19T06:24:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "device_health_metrics", 2024-09-19T06:24:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T06:24:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.195 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.195 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.195 INFO:teuthology.orchestra.run.smithi003.stdout: "retention_period": { 2024-09-19T06:24:41.195 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "retention_period", 2024-09-19T06:24:41.195 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.195 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.195 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.195 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "15552000", 2024-09-19T06:24:41.195 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.195 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.195 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.195 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how long to retain device health metrics", 2024-09-19T06:24:41.195 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.196 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.196 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.196 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.196 INFO:teuthology.orchestra.run.smithi003.stdout: "scrape_frequency": { 2024-09-19T06:24:41.196 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "scrape_frequency", 2024-09-19T06:24:41.196 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.196 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.196 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.196 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "86400", 2024-09-19T06:24:41.196 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.196 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.196 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.196 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T06:24:41.197 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.197 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.197 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.197 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.197 INFO:teuthology.orchestra.run.smithi003.stdout: "self_heal": { 2024-09-19T06:24:41.197 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "self_heal", 2024-09-19T06:24:41.197 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.197 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.197 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.197 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.197 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.197 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.198 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.198 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T06:24:41.198 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.198 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.198 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.198 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.198 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-19T06:24:41.198 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-19T06:24:41.198 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.198 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.198 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.198 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-19T06:24:41.199 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.199 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.199 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.199 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T06:24:41.199 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.199 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.199 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.199 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.199 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_threshold": { 2024-09-19T06:24:41.199 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_threshold", 2024-09-19T06:24:41.199 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.199 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.199 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.199 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "7257600", 2024-09-19T06:24:41.200 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.200 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.200 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.200 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T06:24:41.200 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.200 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.200 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.200 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.200 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.200 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.200 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.200 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "diskprediction_local", 2024-09-19T06:24:41.200 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.201 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.201 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.201 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.201 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.201 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.201 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.201 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.201 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.201 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.201 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.201 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.201 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.201 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.202 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.202 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.202 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.202 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.202 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.202 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.202 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.202 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.202 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.202 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.202 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.202 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.202 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.202 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.203 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.203 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.203 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.203 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.203 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.203 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.203 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.203 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.203 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.203 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.203 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.204 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.204 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.204 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.204 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.204 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.204 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.204 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.204 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.204 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.204 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.204 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.205 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.205 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.205 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.205 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.205 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.205 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.205 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.205 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.205 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.205 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.205 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.205 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.205 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.206 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.206 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.206 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.206 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.206 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.206 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.206 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.206 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.206 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.206 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.206 INFO:teuthology.orchestra.run.smithi003.stdout: "predict_interval": { 2024-09-19T06:24:41.206 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "predict_interval", 2024-09-19T06:24:41.206 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.206 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.207 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.207 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "86400", 2024-09-19T06:24:41.207 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.207 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.207 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.207 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.207 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.207 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.207 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.207 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.207 INFO:teuthology.orchestra.run.smithi003.stdout: "predictor_model": { 2024-09-19T06:24:41.207 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "predictor_model", 2024-09-19T06:24:41.207 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.208 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.208 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.208 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "prophetstor", 2024-09-19T06:24:41.208 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.208 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.208 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.208 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.208 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.208 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.208 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.208 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.208 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-19T06:24:41.208 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-19T06:24:41.208 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.209 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.209 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.209 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-19T06:24:41.209 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.209 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.209 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.209 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.209 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.209 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.209 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.209 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.209 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.209 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.210 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.210 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "influx", 2024-09-19T06:24:41.210 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": false, 2024-09-19T06:24:41.210 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "influxdb python module not found", 2024-09-19T06:24:41.210 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.210 INFO:teuthology.orchestra.run.smithi003.stdout: "batch_size": { 2024-09-19T06:24:41.210 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "batch_size", 2024-09-19T06:24:41.210 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.210 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.210 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.210 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5000", 2024-09-19T06:24:41.210 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.210 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.210 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.211 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T06:24:41.211 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.211 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.211 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.211 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.211 INFO:teuthology.orchestra.run.smithi003.stdout: "database": { 2024-09-19T06:24:41.211 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "database", 2024-09-19T06:24:41.211 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.211 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.211 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.211 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "ceph", 2024-09-19T06:24:41.211 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.212 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.212 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.212 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T06:24:41.212 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.212 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.212 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.212 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.212 INFO:teuthology.orchestra.run.smithi003.stdout: "hostname": { 2024-09-19T06:24:41.212 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "hostname", 2024-09-19T06:24:41.212 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.212 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.212 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.212 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.213 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.213 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.213 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.213 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "InfluxDB server hostname", 2024-09-19T06:24:41.213 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.213 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.213 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.213 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.213 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-19T06:24:41.213 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-19T06:24:41.213 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.213 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.213 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.214 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "30", 2024-09-19T06:24:41.214 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "5", 2024-09-19T06:24:41.214 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.214 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.214 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T06:24:41.214 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.214 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.214 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.214 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.214 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.214 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.214 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.215 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.215 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.215 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.215 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.215 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.215 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.215 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.215 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.215 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.215 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.215 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.215 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.215 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.215 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.216 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.216 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.216 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.216 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.216 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.216 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.216 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.216 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.216 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.216 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.216 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.216 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.216 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.217 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.217 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.217 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.217 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.217 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.217 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.217 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.217 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.217 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.217 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.217 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.217 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.217 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.217 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.218 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.218 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.218 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.218 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.218 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.218 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.218 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.218 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.218 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.218 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.218 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.218 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.218 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.219 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.219 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.219 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.219 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.219 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.219 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.219 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.219 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.219 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.219 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.219 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.219 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.219 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.219 INFO:teuthology.orchestra.run.smithi003.stdout: "password": { 2024-09-19T06:24:41.220 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "password", 2024-09-19T06:24:41.220 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.220 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.220 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.220 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.220 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.220 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.220 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.220 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "password of InfluxDB server user", 2024-09-19T06:24:41.220 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.220 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.220 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.220 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.221 INFO:teuthology.orchestra.run.smithi003.stdout: "port": { 2024-09-19T06:24:41.221 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "port", 2024-09-19T06:24:41.221 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.221 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.221 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.221 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8086", 2024-09-19T06:24:41.221 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.221 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.221 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.221 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "InfluxDB server port", 2024-09-19T06:24:41.221 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.221 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.221 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.222 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.222 INFO:teuthology.orchestra.run.smithi003.stdout: "ssl": { 2024-09-19T06:24:41.222 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ssl", 2024-09-19T06:24:41.222 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.222 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.222 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.222 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "false", 2024-09-19T06:24:41.222 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.222 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.222 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.222 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:24:41.222 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.222 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.222 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.222 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.223 INFO:teuthology.orchestra.run.smithi003.stdout: "threads": { 2024-09-19T06:24:41.223 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "threads", 2024-09-19T06:24:41.223 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.223 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.223 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.223 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-19T06:24:41.223 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1", 2024-09-19T06:24:41.223 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "32", 2024-09-19T06:24:41.223 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.223 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T06:24:41.223 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.223 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.223 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.223 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.223 INFO:teuthology.orchestra.run.smithi003.stdout: "username": { 2024-09-19T06:24:41.224 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "username", 2024-09-19T06:24:41.224 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.224 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.224 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.224 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.224 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.224 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.224 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.224 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "username of InfluxDB server user", 2024-09-19T06:24:41.224 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.224 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.224 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.224 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.225 INFO:teuthology.orchestra.run.smithi003.stdout: "verify_ssl": { 2024-09-19T06:24:41.225 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "verify_ssl", 2024-09-19T06:24:41.225 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.225 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.225 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.225 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "true", 2024-09-19T06:24:41.225 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.225 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.225 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.225 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:24:41.225 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.225 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.225 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.225 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.226 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.226 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.226 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.226 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "insights", 2024-09-19T06:24:41.226 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.226 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.226 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.226 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.226 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.226 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.226 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.226 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.226 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.227 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.227 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.227 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.227 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.227 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.227 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.227 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.227 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.227 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.227 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.227 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.227 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.227 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.227 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.228 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.228 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.228 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.228 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.228 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.228 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.228 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.228 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.228 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.228 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.228 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.228 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.228 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.229 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.229 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.229 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.229 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.229 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.229 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.229 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.229 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.229 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.229 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.229 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.229 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.229 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.229 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.230 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.230 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.230 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.230 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.230 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.230 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.230 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.230 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.230 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.230 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.230 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.230 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.230 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.230 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.231 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.231 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.231 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.231 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.231 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.231 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.231 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.231 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.231 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.231 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.231 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.231 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.231 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "iostat", 2024-09-19T06:24:41.231 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.232 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.232 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.232 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.232 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.232 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.232 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.232 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.232 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.232 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.232 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.232 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.232 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.233 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.233 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.233 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.233 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.233 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.233 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.233 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.233 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.233 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.233 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.233 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.233 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.233 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.234 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.234 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.234 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.234 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.234 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.234 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.234 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.234 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.234 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.234 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.234 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.234 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.234 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.234 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.235 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.235 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.235 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.235 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.235 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.235 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.235 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.235 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.235 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.235 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.235 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.235 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.235 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.236 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.236 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.236 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.236 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.236 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.236 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.236 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.236 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.236 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.236 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.236 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.236 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.236 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.236 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.237 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.237 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.237 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.237 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.237 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.237 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.237 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.237 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.237 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.237 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "k8sevents", 2024-09-19T06:24:41.237 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.237 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.237 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.238 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_event_retention_days": { 2024-09-19T06:24:41.238 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ceph_event_retention_days", 2024-09-19T06:24:41.238 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.238 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.238 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.238 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "7", 2024-09-19T06:24:41.238 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.238 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.238 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.238 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T06:24:41.238 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.238 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.238 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.239 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.239 INFO:teuthology.orchestra.run.smithi003.stdout: "config_check_secs": { 2024-09-19T06:24:41.239 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "config_check_secs", 2024-09-19T06:24:41.239 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.239 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.239 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.239 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-19T06:24:41.239 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "10", 2024-09-19T06:24:41.239 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.239 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.239 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T06:24:41.239 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.239 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.240 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.240 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.240 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.240 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.240 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.240 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.240 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.240 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.240 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.240 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.240 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.240 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.241 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.241 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.241 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.241 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.241 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.241 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.241 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.241 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.241 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.241 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.241 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.241 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.241 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.242 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.242 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.242 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.242 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.242 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.242 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.242 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.242 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.242 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.242 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.242 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.242 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.242 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.242 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.243 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.243 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.243 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.243 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.243 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.243 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.243 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.243 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.243 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.243 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.243 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.243 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.243 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.244 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.244 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.244 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.244 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.244 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.244 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.244 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.244 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.244 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.244 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.244 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.244 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.244 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.245 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.245 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.245 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.245 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.245 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.245 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.245 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.245 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.245 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.245 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.245 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "localpool", 2024-09-19T06:24:41.245 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.245 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.246 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.246 INFO:teuthology.orchestra.run.smithi003.stdout: "failure_domain": { 2024-09-19T06:24:41.246 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "failure_domain", 2024-09-19T06:24:41.246 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.246 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.246 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.246 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "host", 2024-09-19T06:24:41.246 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.246 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.246 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.246 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "failure domain for any created local pool", 2024-09-19T06:24:41.246 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T06:24:41.246 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.247 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.247 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.247 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.247 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.247 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.247 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.247 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.247 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.247 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.247 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.247 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.247 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.247 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.247 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.248 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.248 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.248 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.248 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.248 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.248 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.248 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.248 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.248 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.248 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.248 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.248 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.248 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.249 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.249 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.249 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.249 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.249 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.249 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.249 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.249 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.249 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.249 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.249 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.249 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.249 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.250 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.250 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.250 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.250 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.250 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.250 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.250 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.250 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.250 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.250 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.250 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.250 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.250 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.251 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.251 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.251 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.251 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.251 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.251 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.251 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.251 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.251 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.251 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.251 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.251 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.251 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.252 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.252 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.252 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.252 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.252 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.252 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.252 INFO:teuthology.orchestra.run.smithi003.stdout: "min_size": { 2024-09-19T06:24:41.252 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "min_size", 2024-09-19T06:24:41.252 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.252 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.252 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.252 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.252 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.252 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.253 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.253 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "default min_size for any created local pool", 2024-09-19T06:24:41.253 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T06:24:41.253 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.253 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.253 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.253 INFO:teuthology.orchestra.run.smithi003.stdout: "num_rep": { 2024-09-19T06:24:41.253 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "num_rep", 2024-09-19T06:24:41.253 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.253 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.254 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.254 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "3", 2024-09-19T06:24:41.254 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.254 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.254 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.254 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "default replica count for any created local pool", 2024-09-19T06:24:41.254 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.254 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.254 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.254 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.254 INFO:teuthology.orchestra.run.smithi003.stdout: "pg_num": { 2024-09-19T06:24:41.254 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "pg_num", 2024-09-19T06:24:41.255 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.255 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.255 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.255 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "128", 2024-09-19T06:24:41.255 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.255 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.255 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.255 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T06:24:41.255 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.255 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.255 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.255 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.255 INFO:teuthology.orchestra.run.smithi003.stdout: "prefix": { 2024-09-19T06:24:41.256 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "prefix", 2024-09-19T06:24:41.256 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.256 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.256 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.256 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.256 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.256 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.256 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.256 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "name prefix for any created local pool", 2024-09-19T06:24:41.256 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.256 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.256 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.256 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.256 INFO:teuthology.orchestra.run.smithi003.stdout: "subtree": { 2024-09-19T06:24:41.257 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "subtree", 2024-09-19T06:24:41.257 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.257 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.257 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.257 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "rack", 2024-09-19T06:24:41.257 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.257 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.257 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.257 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T06:24:41.257 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T06:24:41.257 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.257 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.257 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.258 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.258 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.258 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.258 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mds_autoscaler", 2024-09-19T06:24:41.258 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.258 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.258 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.258 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.258 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.258 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.258 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.258 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.258 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.258 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.259 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.259 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.259 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.259 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.259 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.259 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.259 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.259 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.259 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.259 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.259 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.259 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.259 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.259 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.260 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.260 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.260 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.260 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.260 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.260 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.260 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.260 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.260 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.260 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.260 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.260 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.260 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.261 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.261 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.261 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.261 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.261 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.261 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.261 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.261 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.261 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.261 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.261 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.261 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.261 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.261 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.262 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.262 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.262 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.262 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.262 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.262 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.262 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.262 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.262 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.262 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.262 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.262 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.262 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.263 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.263 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.263 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.263 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.263 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.263 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.263 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.263 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.263 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.263 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.263 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.263 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.263 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mirroring", 2024-09-19T06:24:41.263 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.263 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.264 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.264 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.264 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.264 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.264 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.264 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.264 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.264 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.264 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.264 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.264 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.264 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.264 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.265 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.265 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.265 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.265 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.265 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.265 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.265 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.265 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.265 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.265 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.265 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.265 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.265 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.266 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.266 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.266 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.266 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.266 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.266 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.266 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.266 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.266 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.266 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.266 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.266 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.266 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.266 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.267 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.267 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.267 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.267 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.267 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.267 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.267 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.267 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.267 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.267 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.267 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.267 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.267 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.268 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.268 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.268 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.268 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.268 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.268 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.268 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.268 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.268 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.268 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.268 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.268 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.269 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.269 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.269 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.269 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.269 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.269 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.269 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.269 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.269 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.269 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "nfs", 2024-09-19T06:24:41.269 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.269 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.269 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.270 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.270 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.270 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.270 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.270 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.270 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.270 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.270 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.270 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.270 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.270 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.270 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.270 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.271 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.271 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.271 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.271 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.271 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.271 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.271 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.271 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.271 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.271 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.271 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.271 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.271 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.272 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.272 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.272 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.272 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.272 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.272 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.272 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.272 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.272 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.272 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.272 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.272 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.272 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.273 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.273 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.273 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.273 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.273 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.273 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.273 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.273 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.273 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.273 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.273 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.273 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.273 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.273 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.274 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.274 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.274 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.274 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.274 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.274 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.274 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.274 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.274 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.274 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.274 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.274 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.274 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.275 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.275 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.275 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.275 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.275 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.275 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.275 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.275 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "orchestrator", 2024-09-19T06:24:41.275 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.275 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.275 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.275 INFO:teuthology.orchestra.run.smithi003.stdout: "fail_fs": { 2024-09-19T06:24:41.276 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "fail_fs", 2024-09-19T06:24:41.276 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.276 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.276 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.276 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.276 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.276 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.276 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.276 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T06:24:41.276 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.276 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.276 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.276 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.277 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.277 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.277 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.277 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.277 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.277 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.277 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.277 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.277 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.277 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.277 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.277 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.278 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.278 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.278 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.278 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.278 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.278 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.278 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.278 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.278 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.278 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.278 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.278 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.278 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.279 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.279 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.279 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.279 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.279 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.279 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.279 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.279 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.279 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.279 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.279 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.279 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.279 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.279 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.280 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.280 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.280 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.280 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.280 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.280 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.280 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.280 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.280 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.280 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.280 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.280 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.280 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.281 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.281 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.281 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.281 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.281 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.281 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.281 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.281 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.281 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.281 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.281 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.281 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.281 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.281 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.282 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.282 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.282 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.282 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.282 INFO:teuthology.orchestra.run.smithi003.stdout: "orchestrator": { 2024-09-19T06:24:41.282 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "orchestrator", 2024-09-19T06:24:41.282 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.282 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.282 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.282 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.282 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.282 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.282 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.282 INFO:teuthology.orchestra.run.smithi003.stdout: "cephadm", 2024-09-19T06:24:41.283 INFO:teuthology.orchestra.run.smithi003.stdout: "rook", 2024-09-19T06:24:41.283 INFO:teuthology.orchestra.run.smithi003.stdout: "test_orchestrator" 2024-09-19T06:24:41.283 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.283 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Orchestrator backend", 2024-09-19T06:24:41.283 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.283 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.283 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.283 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.283 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.283 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.283 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.283 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "osd_perf_query", 2024-09-19T06:24:41.284 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.284 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.284 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.284 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.284 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.284 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.284 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.284 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.284 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.284 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.284 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.284 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.285 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.285 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.285 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.285 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.285 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.285 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.285 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.285 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.285 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.285 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.285 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.285 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.285 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.286 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.286 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.286 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.286 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.286 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.286 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.286 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.286 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.286 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.286 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.286 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.286 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.286 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.287 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.287 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.287 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.287 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.287 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.287 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.287 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.287 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.287 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.287 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.287 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.287 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.287 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.288 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.288 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.288 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.288 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.288 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.288 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.288 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.288 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.288 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.288 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.288 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.288 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.288 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.289 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.289 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.289 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.289 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.289 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.289 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.289 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.289 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.289 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.289 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.289 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.289 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.289 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "osd_support", 2024-09-19T06:24:41.290 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.290 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.290 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.290 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.290 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.290 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.290 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.290 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.290 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.290 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.290 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.290 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.290 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.291 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.291 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.291 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.291 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.291 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.291 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.291 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.291 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.291 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.291 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.291 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.291 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.291 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.292 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.292 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.292 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.292 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.292 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.292 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.292 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.292 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.292 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.292 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.292 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.292 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.292 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.293 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.293 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.293 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.293 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.293 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.293 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.293 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.293 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.293 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.293 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.293 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.293 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.293 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.293 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.294 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.294 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.294 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.294 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.294 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.294 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.294 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.294 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.294 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.294 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.294 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.294 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.294 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.295 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.295 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.295 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.295 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.295 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.295 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.295 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.295 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.295 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.295 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.295 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "pg_autoscaler", 2024-09-19T06:24:41.295 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.295 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.296 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.296 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.296 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.296 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.296 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.296 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.296 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.296 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.296 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.296 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.296 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.296 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.296 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.297 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.297 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.297 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.297 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.297 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.297 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.297 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.297 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.297 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.297 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.297 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.297 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.297 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.298 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.298 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.298 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.298 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.298 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.298 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.298 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.298 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.298 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.298 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.298 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.298 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.298 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.299 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.299 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.299 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.299 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.299 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.299 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.299 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.299 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.299 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.299 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.299 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.299 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.299 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.300 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.300 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.300 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.300 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.300 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.300 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.300 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.300 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.300 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.300 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.300 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.300 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.300 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.301 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.301 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.301 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.301 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.301 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.301 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.301 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-19T06:24:41.301 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-19T06:24:41.301 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.301 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.301 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.301 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-19T06:24:41.301 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.302 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.302 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.302 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.302 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.302 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.302 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.302 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.302 INFO:teuthology.orchestra.run.smithi003.stdout: "threshold": { 2024-09-19T06:24:41.302 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "threshold", 2024-09-19T06:24:41.302 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-19T06:24:41.302 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.302 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.302 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "3.0", 2024-09-19T06:24:41.302 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1.0", 2024-09-19T06:24:41.303 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.303 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.303 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "scaling threshold", 2024-09-19T06:24:41.303 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T06:24:41.303 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.303 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.303 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.303 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.303 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.303 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.303 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "progress", 2024-09-19T06:24:41.303 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.303 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.304 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.304 INFO:teuthology.orchestra.run.smithi003.stdout: "allow_pg_recovery_event": { 2024-09-19T06:24:41.304 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "allow_pg_recovery_event", 2024-09-19T06:24:41.304 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.304 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.304 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.304 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.304 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.305 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.305 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.305 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T06:24:41.305 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.305 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.305 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.305 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.305 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": { 2024-09-19T06:24:41.305 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "enabled", 2024-09-19T06:24:41.305 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.305 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.305 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.305 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.306 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.306 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.306 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.306 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.306 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.306 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.306 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.306 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.306 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.306 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.306 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.306 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.306 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.307 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.307 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.307 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.307 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.307 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.307 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.307 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.307 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.307 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.307 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.307 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.307 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.307 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.308 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.308 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.308 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.308 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.308 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.308 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.308 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.308 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.308 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.308 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.308 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.308 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.308 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.309 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.309 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.309 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.309 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.309 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.309 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.309 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.309 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.309 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.309 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.309 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.309 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.309 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.309 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.310 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.310 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.310 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.310 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.310 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.310 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.310 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.310 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.310 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.310 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.310 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.310 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.310 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.311 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.311 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.311 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.311 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.311 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.311 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.311 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.311 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.311 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.311 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.311 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.311 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.311 INFO:teuthology.orchestra.run.smithi003.stdout: "max_completed_events": { 2024-09-19T06:24:41.311 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_completed_events", 2024-09-19T06:24:41.312 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.312 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.312 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.312 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "50", 2024-09-19T06:24:41.312 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.312 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.312 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.312 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "number of past completed events to remember", 2024-09-19T06:24:41.312 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.312 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.312 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.312 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.312 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-19T06:24:41.313 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-19T06:24:41.313 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.313 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.313 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.313 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-19T06:24:41.313 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.313 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.313 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.313 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how long the module is going to sleep", 2024-09-19T06:24:41.313 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.313 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.313 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.313 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.314 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.314 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.314 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.314 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "prometheus", 2024-09-19T06:24:41.314 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.314 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.314 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.314 INFO:teuthology.orchestra.run.smithi003.stdout: "cache": { 2024-09-19T06:24:41.314 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cache", 2024-09-19T06:24:41.314 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.314 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.314 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.314 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.314 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.315 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.315 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.315 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.315 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.315 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.315 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.315 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.315 INFO:teuthology.orchestra.run.smithi003.stdout: "exclude_perf_counters": { 2024-09-19T06:24:41.315 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "exclude_perf_counters", 2024-09-19T06:24:41.315 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.315 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.315 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.315 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.316 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.316 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.316 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.316 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T06:24:41.316 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T06:24:41.316 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.316 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.316 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.316 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.316 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.316 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.316 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.317 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.317 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.317 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.317 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.317 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.317 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.317 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.317 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.317 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.317 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.317 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.317 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.317 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.318 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.318 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.318 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.318 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.318 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.318 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.318 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.318 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.318 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.318 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.318 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.318 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.318 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.319 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.319 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.319 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.319 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.319 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.319 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.319 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.319 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.319 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.319 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.319 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.319 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.319 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.319 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.320 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.320 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.320 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.320 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.320 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.320 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.320 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.320 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.320 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.320 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.320 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.320 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.320 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.321 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.321 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.321 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.321 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.321 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.321 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.321 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.321 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.321 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.321 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.321 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.321 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.321 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.321 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_stats_pools": { 2024-09-19T06:24:41.322 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rbd_stats_pools", 2024-09-19T06:24:41.322 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.322 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.322 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.322 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.322 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.322 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.322 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.322 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.322 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.322 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.322 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.322 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.322 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T06:24:41.323 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T06:24:41.323 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.323 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.323 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.323 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "300", 2024-09-19T06:24:41.323 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.323 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.323 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.323 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.323 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.323 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.323 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.323 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.323 INFO:teuthology.orchestra.run.smithi003.stdout: "scrape_interval": { 2024-09-19T06:24:41.324 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "scrape_interval", 2024-09-19T06:24:41.324 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-19T06:24:41.324 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.324 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.324 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "15.0", 2024-09-19T06:24:41.324 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.324 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.324 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.324 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.324 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.324 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.324 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.324 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.325 INFO:teuthology.orchestra.run.smithi003.stdout: "server_addr": { 2024-09-19T06:24:41.325 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_addr", 2024-09-19T06:24:41.325 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.325 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.325 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.325 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "::", 2024-09-19T06:24:41.325 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.325 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.325 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.325 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T06:24:41.325 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.325 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.325 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.326 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.326 INFO:teuthology.orchestra.run.smithi003.stdout: "server_port": { 2024-09-19T06:24:41.326 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_port", 2024-09-19T06:24:41.326 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.326 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.326 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.326 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "9283", 2024-09-19T06:24:41.326 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.326 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.326 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.326 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T06:24:41.326 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.326 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.327 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.327 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.327 INFO:teuthology.orchestra.run.smithi003.stdout: "stale_cache_strategy": { 2024-09-19T06:24:41.327 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "stale_cache_strategy", 2024-09-19T06:24:41.327 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.327 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.327 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.327 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "log", 2024-09-19T06:24:41.327 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.327 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.327 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.327 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.328 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.328 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.328 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.328 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.328 INFO:teuthology.orchestra.run.smithi003.stdout: "standby_behaviour": { 2024-09-19T06:24:41.328 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "standby_behaviour", 2024-09-19T06:24:41.328 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.328 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.328 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.328 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "default", 2024-09-19T06:24:41.328 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.328 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.328 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.329 INFO:teuthology.orchestra.run.smithi003.stdout: "default", 2024-09-19T06:24:41.329 INFO:teuthology.orchestra.run.smithi003.stdout: "error" 2024-09-19T06:24:41.329 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.329 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.329 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.329 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.329 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.329 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.329 INFO:teuthology.orchestra.run.smithi003.stdout: "standby_error_status_code": { 2024-09-19T06:24:41.329 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "standby_error_status_code", 2024-09-19T06:24:41.329 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.329 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.329 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.330 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "500", 2024-09-19T06:24:41.330 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "400", 2024-09-19T06:24:41.330 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "599", 2024-09-19T06:24:41.330 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.330 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.330 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.330 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.330 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.330 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.330 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.330 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.330 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.330 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rbd_support", 2024-09-19T06:24:41.330 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.331 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.331 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.331 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.331 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.331 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.331 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.331 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.331 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.331 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.331 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.331 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.331 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.331 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.332 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.332 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.332 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.332 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.332 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.332 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.332 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.332 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.332 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.332 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.332 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.332 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.332 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.333 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.333 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.333 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.333 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.333 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.333 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.333 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.333 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.333 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.333 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.333 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.333 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.333 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.334 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.334 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.334 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.334 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.334 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.334 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.334 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.334 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.334 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.334 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.334 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.334 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.335 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.335 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.335 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.335 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.335 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.335 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.335 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.335 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.335 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.335 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.335 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.335 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.335 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.336 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.336 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.336 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.336 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.336 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.336 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.336 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.336 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.336 INFO:teuthology.orchestra.run.smithi003.stdout: "max_concurrent_snap_create": { 2024-09-19T06:24:41.336 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_concurrent_snap_create", 2024-09-19T06:24:41.336 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.336 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.336 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.336 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-19T06:24:41.337 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.337 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.337 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.337 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.337 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.337 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.337 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.337 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.337 INFO:teuthology.orchestra.run.smithi003.stdout: "mirror_snapshot_schedule": { 2024-09-19T06:24:41.337 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T06:24:41.337 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.337 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.337 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.338 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.338 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.338 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.338 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.338 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.338 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.338 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.338 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.338 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.338 INFO:teuthology.orchestra.run.smithi003.stdout: "trash_purge_schedule": { 2024-09-19T06:24:41.338 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "trash_purge_schedule", 2024-09-19T06:24:41.338 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.338 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.338 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.339 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.339 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.339 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.339 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.339 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.339 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.339 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.339 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.339 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.339 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.339 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.339 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.339 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "restful", 2024-09-19T06:24:41.340 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.340 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.340 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.340 INFO:teuthology.orchestra.run.smithi003.stdout: "enable_auth": { 2024-09-19T06:24:41.340 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "enable_auth", 2024-09-19T06:24:41.340 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.340 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.340 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.340 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.340 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.340 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.340 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.340 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.341 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.341 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.341 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.341 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.341 INFO:teuthology.orchestra.run.smithi003.stdout: "key_file": { 2024-09-19T06:24:41.341 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "key_file", 2024-09-19T06:24:41.341 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.341 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.341 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.341 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.341 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.341 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.341 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.342 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.342 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.342 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.342 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.342 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.342 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.342 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.342 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.342 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.342 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.342 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.342 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.342 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.343 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.343 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.343 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.343 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.343 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.343 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.343 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.343 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.343 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.343 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.343 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.343 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.343 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.344 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.344 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.344 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.344 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.344 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.344 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.344 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.344 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.344 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.344 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.344 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.344 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.345 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.345 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.345 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.345 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.345 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.345 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.345 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.345 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.345 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.345 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.345 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.345 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.345 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.346 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.346 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.346 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.346 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.346 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.346 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.346 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.346 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.346 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.346 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.346 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.346 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.346 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.347 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.347 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.347 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.347 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.347 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.347 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.347 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.347 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.347 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.347 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.347 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.347 INFO:teuthology.orchestra.run.smithi003.stdout: "server_addr": { 2024-09-19T06:24:41.347 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_addr", 2024-09-19T06:24:41.347 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.348 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.348 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.348 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.348 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.348 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.348 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.348 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.348 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.348 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.348 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.348 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.348 INFO:teuthology.orchestra.run.smithi003.stdout: "server_port": { 2024-09-19T06:24:41.349 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_port", 2024-09-19T06:24:41.349 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.349 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.349 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.349 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.349 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.349 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.349 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.349 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.349 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.349 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.349 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.349 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.349 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.350 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.350 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.350 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rgw", 2024-09-19T06:24:41.350 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.350 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.350 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.350 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.350 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.350 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.350 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.350 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.350 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.350 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.350 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.351 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.351 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.351 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.351 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.351 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.351 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.351 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.351 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.351 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.351 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.351 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.351 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.351 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.352 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.352 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.352 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.352 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.352 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.352 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.352 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.352 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.352 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.352 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.352 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.352 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.352 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.353 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.353 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.353 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.353 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.353 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.353 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.353 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.353 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.353 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.353 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.353 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.353 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.353 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.353 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.354 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.354 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.354 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.354 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.354 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.354 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.354 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.354 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.354 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.354 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.354 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.354 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.354 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.354 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.355 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.355 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.355 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.355 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.355 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.355 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.355 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.355 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.355 INFO:teuthology.orchestra.run.smithi003.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T06:24:41.355 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T06:24:41.355 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.355 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.355 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.356 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-19T06:24:41.356 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.356 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.356 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.356 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T06:24:41.356 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.356 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.356 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.356 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.356 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.356 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.356 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.357 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rook", 2024-09-19T06:24:41.357 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.357 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.357 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.357 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.357 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.357 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.357 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.357 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.357 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.357 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.357 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.357 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.358 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.358 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.358 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.358 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.358 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.358 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.358 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.358 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.358 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.358 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.358 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.358 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.358 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.358 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.359 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.359 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.359 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.359 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.359 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.359 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.359 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.359 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.359 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.359 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.359 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.359 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.359 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.360 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.360 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.360 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.360 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.360 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.360 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.360 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.360 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.360 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.360 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.360 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.360 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.361 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.361 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.361 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.361 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.361 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.361 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.361 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.361 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.361 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.361 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.361 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.361 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.361 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.362 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.362 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.362 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.362 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.362 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.362 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.362 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.362 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.362 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.362 INFO:teuthology.orchestra.run.smithi003.stdout: "storage_class": { 2024-09-19T06:24:41.362 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "storage_class", 2024-09-19T06:24:41.362 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.362 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.363 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.363 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "local", 2024-09-19T06:24:41.363 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.363 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.363 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.363 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T06:24:41.363 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.363 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.363 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.363 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.363 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.363 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.363 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.364 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "selftest", 2024-09-19T06:24:41.364 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.364 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.364 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.364 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.364 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.364 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.364 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.364 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.364 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.364 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.364 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.365 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.365 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.365 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.365 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.365 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.365 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.365 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.365 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.365 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.365 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.365 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.365 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.365 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.365 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.366 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.366 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.366 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.366 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.366 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.366 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.366 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.366 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.366 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.366 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.366 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.366 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.366 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.367 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.367 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.367 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.367 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.367 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.367 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.367 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.367 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.367 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.367 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.367 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.367 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.367 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.368 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.368 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.368 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.368 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.368 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.368 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.368 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.368 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.368 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.368 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.368 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.368 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.368 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.369 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.369 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.369 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.369 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.369 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.369 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.369 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.369 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.369 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.369 INFO:teuthology.orchestra.run.smithi003.stdout: "roption1": { 2024-09-19T06:24:41.369 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "roption1", 2024-09-19T06:24:41.369 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.369 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.370 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.370 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.370 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.370 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.370 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.370 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.370 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.370 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.370 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.370 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.370 INFO:teuthology.orchestra.run.smithi003.stdout: "roption2": { 2024-09-19T06:24:41.370 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "roption2", 2024-09-19T06:24:41.370 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.371 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.371 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.371 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "xyz", 2024-09-19T06:24:41.371 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.371 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.371 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.371 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.371 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.371 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.371 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.371 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.371 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption1": { 2024-09-19T06:24:41.371 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption1", 2024-09-19T06:24:41.372 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.372 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.372 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.372 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.372 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.372 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.372 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.372 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.372 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.372 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.372 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.372 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.372 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption2": { 2024-09-19T06:24:41.373 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption2", 2024-09-19T06:24:41.373 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.373 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.373 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.373 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.373 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.373 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.373 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.373 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.373 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.373 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.373 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.374 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.374 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption3": { 2024-09-19T06:24:41.374 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption3", 2024-09-19T06:24:41.374 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-19T06:24:41.374 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.374 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.374 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.374 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.374 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.374 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.374 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.374 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.374 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.375 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.375 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.375 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption4": { 2024-09-19T06:24:41.375 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption4", 2024-09-19T06:24:41.375 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.375 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.375 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.375 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.375 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.375 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.375 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.375 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.375 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.375 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.376 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.376 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.376 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption5": { 2024-09-19T06:24:41.376 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption5", 2024-09-19T06:24:41.376 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.376 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.376 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.376 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.376 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.376 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.376 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.376 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.376 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.377 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.377 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.377 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.377 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption6": { 2024-09-19T06:24:41.377 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption6", 2024-09-19T06:24:41.377 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.377 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.377 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.377 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.377 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.377 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.377 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.377 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.377 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.378 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.378 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.378 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.378 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption7": { 2024-09-19T06:24:41.378 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption7", 2024-09-19T06:24:41.378 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.378 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.378 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.378 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.378 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1", 2024-09-19T06:24:41.378 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "42", 2024-09-19T06:24:41.378 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.378 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.378 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.379 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.379 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.379 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.379 INFO:teuthology.orchestra.run.smithi003.stdout: "testkey": { 2024-09-19T06:24:41.379 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "testkey", 2024-09-19T06:24:41.379 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.379 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.379 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.379 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.379 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.379 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.379 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.379 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.380 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.380 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.380 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.380 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.380 INFO:teuthology.orchestra.run.smithi003.stdout: "testlkey": { 2024-09-19T06:24:41.380 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "testlkey", 2024-09-19T06:24:41.380 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.380 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.380 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.380 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.380 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.380 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.381 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.381 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.381 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.381 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.381 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.381 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.381 INFO:teuthology.orchestra.run.smithi003.stdout: "testnewline": { 2024-09-19T06:24:41.381 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "testnewline", 2024-09-19T06:24:41.381 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.381 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.381 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.381 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.381 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.382 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.382 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.382 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.382 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.382 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.382 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.382 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.382 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.382 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.382 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.382 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "snap_schedule", 2024-09-19T06:24:41.382 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.382 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.383 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.383 INFO:teuthology.orchestra.run.smithi003.stdout: "allow_m_granularity": { 2024-09-19T06:24:41.383 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "allow_m_granularity", 2024-09-19T06:24:41.383 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.383 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.383 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.383 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.383 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.383 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.383 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.383 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T06:24:41.383 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.383 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.384 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.384 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.384 INFO:teuthology.orchestra.run.smithi003.stdout: "dump_on_update": { 2024-09-19T06:24:41.384 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "dump_on_update", 2024-09-19T06:24:41.384 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.384 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.384 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.384 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.384 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.384 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.384 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.384 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "dump database to debug log on update", 2024-09-19T06:24:41.385 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.385 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.385 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.385 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.385 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.385 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.385 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.385 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.385 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.385 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.385 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.385 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.385 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.385 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.386 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.386 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.386 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.386 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.386 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.386 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.386 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.386 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.386 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.386 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.386 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.386 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.387 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.387 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.387 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.387 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.387 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.387 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.387 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.387 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.387 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.387 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.387 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.387 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.387 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.387 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.388 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.388 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.388 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.388 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.388 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.388 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.388 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.388 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.388 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.388 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.388 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.388 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.388 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.389 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.389 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.389 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.389 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.389 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.389 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.389 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.389 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.389 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.389 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.389 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.389 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.389 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.390 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.390 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.390 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.390 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.390 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.390 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.390 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.390 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.390 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.390 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.390 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.390 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "stats", 2024-09-19T06:24:41.390 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.391 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.391 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.391 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.391 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.391 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.391 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.391 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.391 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.391 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.391 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.391 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.391 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.391 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.392 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.392 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.392 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.392 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.392 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.392 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.392 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.392 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.392 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.392 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.392 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.392 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.392 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.392 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.393 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.393 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.393 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.393 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.393 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.393 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.393 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.393 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.393 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.393 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.393 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.393 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.393 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.394 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.394 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.394 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.394 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.394 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.394 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.394 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.394 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.394 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.394 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.394 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.394 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.394 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.395 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.395 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.395 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.395 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.395 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.395 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.395 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.395 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.395 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.395 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.395 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.395 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.395 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.396 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.396 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.396 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.396 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.396 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.396 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.396 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.396 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.396 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.396 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "status", 2024-09-19T06:24:41.396 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.396 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.396 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.397 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.397 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.397 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.397 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.397 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.397 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.397 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.397 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.397 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.397 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.397 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.397 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.397 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.398 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.398 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.398 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.398 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.398 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.398 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.398 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.398 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.398 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.398 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.398 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.398 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.398 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.399 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.399 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.399 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.399 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.399 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.399 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.399 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.399 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.399 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.399 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.399 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.399 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.399 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.400 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.400 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.400 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.400 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.400 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.400 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.400 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.400 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.400 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.400 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.400 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.400 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.400 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.401 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.401 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.401 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.401 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.401 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.401 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.401 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.401 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.401 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.401 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.401 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.401 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.401 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.402 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.402 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.402 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.402 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.402 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.402 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.402 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.402 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.402 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "telegraf", 2024-09-19T06:24:41.402 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.402 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.402 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.402 INFO:teuthology.orchestra.run.smithi003.stdout: "address": { 2024-09-19T06:24:41.403 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "address", 2024-09-19T06:24:41.403 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.403 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.403 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.403 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T06:24:41.403 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.403 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.403 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.403 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.403 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.403 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.403 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.403 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.404 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-19T06:24:41.404 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-19T06:24:41.404 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.404 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.404 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.404 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "15", 2024-09-19T06:24:41.404 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.404 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.404 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.405 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.405 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.405 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.405 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.405 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.405 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.405 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.405 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.405 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.405 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.405 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.405 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.405 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.406 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.406 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.406 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.406 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.406 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.406 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.406 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.406 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.406 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.406 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.406 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.406 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.406 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.406 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.407 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.407 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.407 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.407 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.407 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.407 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.407 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.407 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.407 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.407 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.407 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.407 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.407 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.407 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.408 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.408 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.408 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.408 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.408 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.408 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.408 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.408 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.408 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.408 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.408 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.408 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.408 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.409 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.409 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.409 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.409 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.409 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.409 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.409 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.409 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.409 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.409 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.409 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.409 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.409 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.410 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.410 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.410 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.410 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.410 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.410 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.410 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.410 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.410 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.410 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.410 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.410 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "telemetry", 2024-09-19T06:24:41.410 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.410 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.411 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.411 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_basic": { 2024-09-19T06:24:41.411 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_basic", 2024-09-19T06:24:41.411 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.411 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.411 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.411 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.411 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.411 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.411 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.411 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T06:24:41.411 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.411 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.412 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.412 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.412 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_crash": { 2024-09-19T06:24:41.412 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_crash", 2024-09-19T06:24:41.412 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.412 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.412 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.412 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.412 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.412 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.412 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.412 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T06:24:41.412 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.413 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.413 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.413 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.413 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_device": { 2024-09-19T06:24:41.413 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_device", 2024-09-19T06:24:41.413 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.413 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.413 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.413 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.413 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.413 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.413 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.413 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T06:24:41.414 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.414 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.414 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.414 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.414 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_ident": { 2024-09-19T06:24:41.414 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_ident", 2024-09-19T06:24:41.414 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.414 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.414 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.414 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.414 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.414 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.414 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.415 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T06:24:41.415 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.415 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.415 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.415 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.415 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_perf": { 2024-09-19T06:24:41.415 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_perf", 2024-09-19T06:24:41.415 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.415 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.415 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.415 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.415 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.415 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.416 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.416 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T06:24:41.416 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.416 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.416 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.416 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.416 INFO:teuthology.orchestra.run.smithi003.stdout: "contact": { 2024-09-19T06:24:41.416 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "contact", 2024-09-19T06:24:41.416 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.416 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.416 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.416 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.416 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.417 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.417 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.417 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.417 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.417 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.417 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.417 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.417 INFO:teuthology.orchestra.run.smithi003.stdout: "description": { 2024-09-19T06:24:41.417 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "description", 2024-09-19T06:24:41.417 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.417 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.417 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.417 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.418 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.418 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.418 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.418 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.418 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.418 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.418 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.418 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.418 INFO:teuthology.orchestra.run.smithi003.stdout: "device_url": { 2024-09-19T06:24:41.418 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "device_url", 2024-09-19T06:24:41.418 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.418 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.419 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.419 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T06:24:41.419 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.419 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.419 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.419 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.419 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.419 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.419 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.419 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.419 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": { 2024-09-19T06:24:41.419 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "enabled", 2024-09-19T06:24:41.419 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.419 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.420 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.420 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.420 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.420 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.420 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.420 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.420 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.420 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.420 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.420 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.420 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-19T06:24:41.420 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-19T06:24:41.421 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.421 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.421 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.421 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "24", 2024-09-19T06:24:41.421 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "8", 2024-09-19T06:24:41.421 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.421 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.421 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.421 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.421 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.421 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.421 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.421 INFO:teuthology.orchestra.run.smithi003.stdout: "last_opt_revision": { 2024-09-19T06:24:41.422 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "last_opt_revision", 2024-09-19T06:24:41.422 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.422 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.422 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.422 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "1", 2024-09-19T06:24:41.422 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.422 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.422 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.422 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.422 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.422 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.422 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.422 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.422 INFO:teuthology.orchestra.run.smithi003.stdout: "leaderboard": { 2024-09-19T06:24:41.423 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "leaderboard", 2024-09-19T06:24:41.423 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.423 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.423 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.423 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.423 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.423 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.423 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.423 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.423 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.423 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.423 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.423 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.423 INFO:teuthology.orchestra.run.smithi003.stdout: "leaderboard_description": { 2024-09-19T06:24:41.424 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "leaderboard_description", 2024-09-19T06:24:41.424 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.424 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.424 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.424 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.424 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.424 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.424 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.424 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.424 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.424 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.424 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.424 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.425 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.425 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.425 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.425 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.425 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.425 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.425 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.425 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.425 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.425 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.425 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.425 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.426 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.426 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.426 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.426 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.426 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.426 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.426 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.426 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.426 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.426 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.426 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.426 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.426 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.426 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.427 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.427 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.427 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.427 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.427 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.427 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.427 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.427 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.427 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.427 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.427 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.427 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.427 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.427 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.428 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.428 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.428 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.428 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.428 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.428 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.428 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.428 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.428 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.428 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.428 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.428 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.428 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.429 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.429 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.429 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.429 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.429 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.429 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.429 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.429 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.429 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.429 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.429 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.429 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.429 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.429 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.430 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.430 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.430 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.430 INFO:teuthology.orchestra.run.smithi003.stdout: "organization": { 2024-09-19T06:24:41.430 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "organization", 2024-09-19T06:24:41.430 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.430 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.430 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.430 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.430 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.430 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.430 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.430 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.430 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.431 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.431 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.431 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.431 INFO:teuthology.orchestra.run.smithi003.stdout: "proxy": { 2024-09-19T06:24:41.431 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "proxy", 2024-09-19T06:24:41.431 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.431 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.431 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.431 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.431 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.431 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.431 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.431 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.431 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.432 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.432 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.432 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.432 INFO:teuthology.orchestra.run.smithi003.stdout: "url": { 2024-09-19T06:24:41.432 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "url", 2024-09-19T06:24:41.432 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.432 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.432 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.432 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T06:24:41.432 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.432 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.432 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.432 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.433 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.433 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.433 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.433 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.433 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.433 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.433 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.433 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "test_orchestrator", 2024-09-19T06:24:41.433 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.433 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.433 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.433 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.433 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.434 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.434 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.434 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.434 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.434 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.434 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.434 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.434 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.434 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.434 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.434 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.434 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.434 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.435 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.435 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.435 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.435 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.435 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.435 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.435 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.435 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.435 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.435 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.435 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.435 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.435 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.435 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.436 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.436 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.436 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.436 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.436 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.436 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.436 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.436 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.436 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.436 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.436 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.436 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.437 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.437 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.437 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.437 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.437 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.437 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.437 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.437 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.437 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.437 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.437 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.437 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.437 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.438 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.438 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.438 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.438 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.438 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.438 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.438 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.438 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.438 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.438 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.438 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.438 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.438 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.439 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.439 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.439 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.439 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.439 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.439 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.439 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "volumes", 2024-09-19T06:24:41.439 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.439 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.439 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.439 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.439 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.439 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.439 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.440 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.440 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.440 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.440 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.440 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.440 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.440 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.440 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.440 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.440 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.440 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.440 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.440 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.440 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.441 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.441 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.441 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.441 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.441 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.441 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.441 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.441 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.441 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.441 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.441 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.441 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.441 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.442 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.442 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.442 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.442 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.442 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.442 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.442 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.442 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.442 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.442 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.442 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.442 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.442 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.443 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.443 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.443 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.443 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.443 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.443 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.443 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.443 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.443 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.443 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.443 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.443 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.443 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.443 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.444 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.444 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.444 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.444 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.444 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.444 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.444 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.444 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.444 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.444 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.444 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.444 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.444 INFO:teuthology.orchestra.run.smithi003.stdout: "max_concurrent_clones": { 2024-09-19T06:24:41.445 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_concurrent_clones", 2024-09-19T06:24:41.445 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.445 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.445 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.445 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "4", 2024-09-19T06:24:41.445 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.445 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.445 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.445 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T06:24:41.445 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.445 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.445 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.445 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.446 INFO:teuthology.orchestra.run.smithi003.stdout: "periodic_async_work": { 2024-09-19T06:24:41.446 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "periodic_async_work", 2024-09-19T06:24:41.446 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.446 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.446 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.446 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.446 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.446 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.446 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.446 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Periodically check for async work", 2024-09-19T06:24:41.446 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.446 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.446 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.447 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.447 INFO:teuthology.orchestra.run.smithi003.stdout: "snapshot_clone_delay": { 2024-09-19T06:24:41.447 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "snapshot_clone_delay", 2024-09-19T06:24:41.447 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.447 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.447 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.447 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-19T06:24:41.447 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.447 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.447 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.447 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T06:24:41.447 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.447 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.448 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.448 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.448 INFO:teuthology.orchestra.run.smithi003.stdout: "snapshot_clone_no_wait": { 2024-09-19T06:24:41.448 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T06:24:41.448 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.448 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.448 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.448 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.448 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.448 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.448 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.448 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T06:24:41.448 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.449 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.449 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.449 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.449 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.449 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.449 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.449 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "zabbix", 2024-09-19T06:24:41.449 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.449 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.449 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.449 INFO:teuthology.orchestra.run.smithi003.stdout: "discovery_interval": { 2024-09-19T06:24:41.449 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "discovery_interval", 2024-09-19T06:24:41.449 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-19T06:24:41.450 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.450 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.450 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "100", 2024-09-19T06:24:41.450 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.450 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.450 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.450 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.450 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.450 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.450 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.450 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.450 INFO:teuthology.orchestra.run.smithi003.stdout: "identifier": { 2024-09-19T06:24:41.450 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "identifier", 2024-09-19T06:24:41.451 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.451 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.451 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.451 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.451 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.451 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.451 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.451 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.451 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.451 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.451 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.451 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.451 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-19T06:24:41.451 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-19T06:24:41.452 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.452 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.452 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.452 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-19T06:24:41.452 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.452 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.452 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.452 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.452 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.452 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.452 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.452 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.452 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.453 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.453 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.453 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.453 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.453 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.453 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.453 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.453 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.453 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.453 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.453 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.453 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.453 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.453 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.454 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.454 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.454 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.454 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.454 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.454 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.454 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.454 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.454 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.454 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.454 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.454 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.454 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.455 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.455 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.455 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.455 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.455 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.455 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.455 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.455 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.455 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.455 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.455 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.455 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.455 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.455 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.456 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.456 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.456 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.456 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.456 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.456 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.456 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.456 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.456 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.456 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.456 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.456 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.456 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.457 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.457 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.457 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.457 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.457 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.457 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.457 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.457 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.457 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.457 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.457 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.457 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.457 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.458 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.458 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.458 INFO:teuthology.orchestra.run.smithi003.stdout: "zabbix_host": { 2024-09-19T06:24:41.458 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "zabbix_host", 2024-09-19T06:24:41.458 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.458 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.458 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.458 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.458 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.458 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.458 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.458 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.458 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.458 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.459 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.459 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.459 INFO:teuthology.orchestra.run.smithi003.stdout: "zabbix_port": { 2024-09-19T06:24:41.459 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "zabbix_port", 2024-09-19T06:24:41.459 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.459 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.459 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.459 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10051", 2024-09-19T06:24:41.459 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.459 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.459 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.459 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.459 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.460 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.460 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.460 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.460 INFO:teuthology.orchestra.run.smithi003.stdout: "zabbix_sender": { 2024-09-19T06:24:41.460 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "zabbix_sender", 2024-09-19T06:24:41.460 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.460 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.460 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.460 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T06:24:41.460 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.460 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.460 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.461 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.461 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.461 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.461 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.461 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.461 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.461 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.461 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-19T06:24:41.461 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.461 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.461 INFO:teuthology.orchestra.run.smithi003.stdout: "modules": [ 2024-09-19T06:24:41.461 INFO:teuthology.orchestra.run.smithi003.stdout: "cephadm", 2024-09-19T06:24:41.461 INFO:teuthology.orchestra.run.smithi003.stdout: "dashboard", 2024-09-19T06:24:41.462 INFO:teuthology.orchestra.run.smithi003.stdout: "iostat", 2024-09-19T06:24:41.462 INFO:teuthology.orchestra.run.smithi003.stdout: "nfs", 2024-09-19T06:24:41.462 INFO:teuthology.orchestra.run.smithi003.stdout: "restful", 2024-09-19T06:24:41.462 INFO:teuthology.orchestra.run.smithi003.stdout: "snap_schedule" 2024-09-19T06:24:41.462 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.462 INFO:teuthology.orchestra.run.smithi003.stdout: "available_modules": [ 2024-09-19T06:24:41.462 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.462 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "alerts", 2024-09-19T06:24:41.462 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.462 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.462 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.462 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-19T06:24:41.462 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-19T06:24:41.462 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.463 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.463 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.463 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-19T06:24:41.463 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.463 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.463 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.463 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T06:24:41.463 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.463 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.463 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.463 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.463 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.463 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.464 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.464 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.464 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.464 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.464 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.464 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.464 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.464 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.464 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.464 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.464 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.464 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.464 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.465 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.465 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.465 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.465 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.465 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.465 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.465 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.465 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.465 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.465 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.465 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.465 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.465 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.465 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.466 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.466 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.466 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.466 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.466 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.466 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.466 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.466 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.466 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.466 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.466 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.466 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.466 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.467 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.467 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.467 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.467 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.467 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.467 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.467 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.467 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.467 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.467 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.467 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.467 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.467 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.468 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.468 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.468 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.468 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.468 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.468 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.468 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.468 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.468 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.468 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.468 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.468 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.468 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.468 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.469 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.469 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_destination": { 2024-09-19T06:24:41.469 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_destination", 2024-09-19T06:24:41.469 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.469 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.469 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.469 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.469 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.469 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.469 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.469 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Email address to send alerts to", 2024-09-19T06:24:41.469 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.469 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.469 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.470 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.470 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_from_name": { 2024-09-19T06:24:41.470 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_from_name", 2024-09-19T06:24:41.470 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.470 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.470 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.470 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "Ceph", 2024-09-19T06:24:41.470 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.470 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.470 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.470 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Email From: name", 2024-09-19T06:24:41.470 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.470 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.471 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.471 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.471 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_host": { 2024-09-19T06:24:41.471 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_host", 2024-09-19T06:24:41.471 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.471 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.471 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.471 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.471 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.471 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.471 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.471 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "SMTP server", 2024-09-19T06:24:41.471 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.472 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.472 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.472 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.472 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_password": { 2024-09-19T06:24:41.472 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_password", 2024-09-19T06:24:41.472 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.472 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.472 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.472 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.472 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.472 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.472 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.472 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Password to authenticate with", 2024-09-19T06:24:41.472 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.473 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.473 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.473 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.473 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_port": { 2024-09-19T06:24:41.473 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_port", 2024-09-19T06:24:41.473 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.473 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.473 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.473 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "465", 2024-09-19T06:24:41.473 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.473 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.473 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.473 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "SMTP port", 2024-09-19T06:24:41.473 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.474 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.474 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.474 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.474 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_sender": { 2024-09-19T06:24:41.474 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_sender", 2024-09-19T06:24:41.474 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.474 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.474 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.474 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.474 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.474 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.474 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.474 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "SMTP envelope sender", 2024-09-19T06:24:41.475 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.475 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.475 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.475 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.475 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_ssl": { 2024-09-19T06:24:41.475 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_ssl", 2024-09-19T06:24:41.475 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.475 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.475 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.475 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.475 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.475 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.476 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.476 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T06:24:41.476 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.476 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.476 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.476 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.476 INFO:teuthology.orchestra.run.smithi003.stdout: "smtp_user": { 2024-09-19T06:24:41.476 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "smtp_user", 2024-09-19T06:24:41.476 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.476 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.476 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.476 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.476 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.476 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.477 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.477 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "User to authenticate as", 2024-09-19T06:24:41.477 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.477 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.477 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.477 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.477 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.477 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.477 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.477 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "balancer", 2024-09-19T06:24:41.477 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.477 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.478 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.478 INFO:teuthology.orchestra.run.smithi003.stdout: "active": { 2024-09-19T06:24:41.478 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "active", 2024-09-19T06:24:41.478 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.478 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.478 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.478 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.478 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.478 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.478 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.478 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T06:24:41.478 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.478 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.479 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.479 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.479 INFO:teuthology.orchestra.run.smithi003.stdout: "begin_time": { 2024-09-19T06:24:41.479 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "begin_time", 2024-09-19T06:24:41.479 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.479 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.479 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.479 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0000", 2024-09-19T06:24:41.479 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.479 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.479 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.479 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T06:24:41.479 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:24:41.480 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.480 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.480 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.480 INFO:teuthology.orchestra.run.smithi003.stdout: "begin_weekday": { 2024-09-19T06:24:41.480 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "begin_weekday", 2024-09-19T06:24:41.480 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-19T06:24:41.480 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.480 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.480 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-19T06:24:41.480 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "0", 2024-09-19T06:24:41.480 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "6", 2024-09-19T06:24:41.480 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.480 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T06:24:41.481 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:24:41.481 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.481 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.481 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.481 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_compat_max_iterations": { 2024-09-19T06:24:41.481 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crush_compat_max_iterations", 2024-09-19T06:24:41.481 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-19T06:24:41.481 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.481 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.481 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "25", 2024-09-19T06:24:41.481 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1", 2024-09-19T06:24:41.481 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "250", 2024-09-19T06:24:41.481 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.482 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T06:24:41.482 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.482 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.482 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.482 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.482 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_compat_metrics": { 2024-09-19T06:24:41.482 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crush_compat_metrics", 2024-09-19T06:24:41.482 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.482 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.482 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.482 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T06:24:41.482 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.482 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.483 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.483 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T06:24:41.483 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T06:24:41.483 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.483 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.483 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.483 INFO:teuthology.orchestra.run.smithi003.stdout: "crush_compat_step": { 2024-09-19T06:24:41.483 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crush_compat_step", 2024-09-19T06:24:41.483 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-19T06:24:41.483 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.483 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.483 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0.5", 2024-09-19T06:24:41.483 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "0.001", 2024-09-19T06:24:41.483 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "0.999", 2024-09-19T06:24:41.484 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.484 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "aggressiveness of optimization", 2024-09-19T06:24:41.484 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T06:24:41.484 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.484 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.484 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.484 INFO:teuthology.orchestra.run.smithi003.stdout: "end_time": { 2024-09-19T06:24:41.484 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "end_time", 2024-09-19T06:24:41.484 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.484 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.484 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.484 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "2359", 2024-09-19T06:24:41.485 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.485 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.485 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.485 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T06:24:41.485 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T06:24:41.485 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.485 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.485 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.485 INFO:teuthology.orchestra.run.smithi003.stdout: "end_weekday": { 2024-09-19T06:24:41.485 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "end_weekday", 2024-09-19T06:24:41.485 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-19T06:24:41.485 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.485 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.485 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-19T06:24:41.486 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "0", 2024-09-19T06:24:41.486 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "6", 2024-09-19T06:24:41.486 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.486 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T06:24:41.486 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T06:24:41.486 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.486 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.486 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.486 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.486 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.486 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.486 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.486 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.487 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.487 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.487 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.487 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.487 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.487 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.487 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.487 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.487 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.487 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.487 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.487 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.487 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.487 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.488 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.488 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.488 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.488 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.488 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.488 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.488 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.488 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.488 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.488 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.488 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.488 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.488 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.489 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.489 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.489 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.489 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.489 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.489 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.489 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.489 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.489 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.489 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.489 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.489 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.489 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.490 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.490 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.490 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.490 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.490 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.490 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.490 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.490 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.490 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.490 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.490 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.490 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.490 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.490 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.491 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.491 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.491 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.491 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.491 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.491 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.491 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.491 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.491 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.491 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.491 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.491 INFO:teuthology.orchestra.run.smithi003.stdout: "min_score": { 2024-09-19T06:24:41.491 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "min_score", 2024-09-19T06:24:41.491 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-19T06:24:41.492 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.492 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.492 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-19T06:24:41.492 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.492 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.492 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.492 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T06:24:41.492 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.492 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.492 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.492 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.492 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": { 2024-09-19T06:24:41.492 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mode", 2024-09-19T06:24:41.493 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.493 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.493 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.493 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "upmap", 2024-09-19T06:24:41.493 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.493 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.493 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.493 INFO:teuthology.orchestra.run.smithi003.stdout: "crush-compat", 2024-09-19T06:24:41.493 INFO:teuthology.orchestra.run.smithi003.stdout: "none", 2024-09-19T06:24:41.493 INFO:teuthology.orchestra.run.smithi003.stdout: "read", 2024-09-19T06:24:41.493 INFO:teuthology.orchestra.run.smithi003.stdout: "upmap", 2024-09-19T06:24:41.493 INFO:teuthology.orchestra.run.smithi003.stdout: "upmap-read" 2024-09-19T06:24:41.493 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.494 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Balancer mode", 2024-09-19T06:24:41.494 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.494 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.494 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.494 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.494 INFO:teuthology.orchestra.run.smithi003.stdout: "pool_ids": { 2024-09-19T06:24:41.494 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "pool_ids", 2024-09-19T06:24:41.494 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.494 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.494 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.494 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.494 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.494 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.494 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.495 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T06:24:41.495 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.495 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.495 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.495 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.495 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-19T06:24:41.495 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-19T06:24:41.495 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.495 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.495 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.495 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-19T06:24:41.495 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.495 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.496 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.496 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T06:24:41.496 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.496 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.496 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.496 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.496 INFO:teuthology.orchestra.run.smithi003.stdout: "upmap_max_deviation": { 2024-09-19T06:24:41.496 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "upmap_max_deviation", 2024-09-19T06:24:41.496 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.496 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.496 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.496 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-19T06:24:41.496 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1", 2024-09-19T06:24:41.496 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.497 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.497 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T06:24:41.497 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T06:24:41.497 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.497 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.497 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.497 INFO:teuthology.orchestra.run.smithi003.stdout: "upmap_max_optimizations": { 2024-09-19T06:24:41.497 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "upmap_max_optimizations", 2024-09-19T06:24:41.497 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-19T06:24:41.497 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.497 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.497 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-19T06:24:41.497 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.498 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.498 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.498 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T06:24:41.498 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.498 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.498 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.498 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.498 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.498 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.498 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.498 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cephadm", 2024-09-19T06:24:41.498 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.498 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.499 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.499 INFO:teuthology.orchestra.run.smithi003.stdout: "agent_down_multiplier": { 2024-09-19T06:24:41.499 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "agent_down_multiplier", 2024-09-19T06:24:41.499 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-19T06:24:41.499 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.499 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.499 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "3.0", 2024-09-19T06:24:41.499 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.499 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.499 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.499 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T06:24:41.499 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.499 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.499 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.500 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.500 INFO:teuthology.orchestra.run.smithi003.stdout: "agent_refresh_rate": { 2024-09-19T06:24:41.500 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "agent_refresh_rate", 2024-09-19T06:24:41.500 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.500 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.500 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.500 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "20", 2024-09-19T06:24:41.500 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.500 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.500 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.500 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T06:24:41.500 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.500 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.501 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.501 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.501 INFO:teuthology.orchestra.run.smithi003.stdout: "agent_starting_port": { 2024-09-19T06:24:41.501 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "agent_starting_port", 2024-09-19T06:24:41.501 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.501 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.501 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.501 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "4721", 2024-09-19T06:24:41.501 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.501 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.501 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.501 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T06:24:41.501 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.502 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.502 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.502 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.502 INFO:teuthology.orchestra.run.smithi003.stdout: "allow_ptrace": { 2024-09-19T06:24:41.502 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "allow_ptrace", 2024-09-19T06:24:41.502 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.502 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.502 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.502 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.502 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.502 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.502 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.502 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T06:24:41.502 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T06:24:41.503 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.503 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.503 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.503 INFO:teuthology.orchestra.run.smithi003.stdout: "autotune_interval": { 2024-09-19T06:24:41.503 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "autotune_interval", 2024-09-19T06:24:41.503 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.503 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.503 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.503 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-19T06:24:41.503 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.503 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.503 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.503 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T06:24:41.503 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.503 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.504 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.504 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.504 INFO:teuthology.orchestra.run.smithi003.stdout: "autotune_memory_target_ratio": { 2024-09-19T06:24:41.504 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T06:24:41.504 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-19T06:24:41.504 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.504 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.504 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0.7", 2024-09-19T06:24:41.504 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.504 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.504 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.504 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T06:24:41.504 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.505 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.505 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.505 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.505 INFO:teuthology.orchestra.run.smithi003.stdout: "cephadm_log_destination": { 2024-09-19T06:24:41.505 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cephadm_log_destination", 2024-09-19T06:24:41.505 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.505 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.505 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.505 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.505 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.505 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.505 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.505 INFO:teuthology.orchestra.run.smithi003.stdout: "file", 2024-09-19T06:24:41.506 INFO:teuthology.orchestra.run.smithi003.stdout: "file,syslog", 2024-09-19T06:24:41.506 INFO:teuthology.orchestra.run.smithi003.stdout: "syslog" 2024-09-19T06:24:41.506 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.506 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T06:24:41.506 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.506 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.506 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.506 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.506 INFO:teuthology.orchestra.run.smithi003.stdout: "cgroups_split": { 2024-09-19T06:24:41.506 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cgroups_split", 2024-09-19T06:24:41.506 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.506 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.506 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.506 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.507 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.507 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.507 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.507 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T06:24:41.507 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.507 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.507 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.507 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.507 INFO:teuthology.orchestra.run.smithi003.stdout: "config_checks_enabled": { 2024-09-19T06:24:41.507 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "config_checks_enabled", 2024-09-19T06:24:41.507 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.507 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.507 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.507 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.508 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.508 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.508 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.508 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T06:24:41.508 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.508 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.508 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.508 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.508 INFO:teuthology.orchestra.run.smithi003.stdout: "config_dashboard": { 2024-09-19T06:24:41.508 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "config_dashboard", 2024-09-19T06:24:41.508 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.508 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.508 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.509 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.509 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.509 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.509 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.509 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T06:24:41.509 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.509 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.509 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.509 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.509 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_alertmanager": { 2024-09-19T06:24:41.509 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_alertmanager", 2024-09-19T06:24:41.509 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.510 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.510 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.510 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T06:24:41.510 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.510 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.510 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.510 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Prometheus container image", 2024-09-19T06:24:41.510 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.510 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.510 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.510 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.510 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_base": { 2024-09-19T06:24:41.510 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_base", 2024-09-19T06:24:41.510 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.511 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.511 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.511 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T06:24:41.511 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.511 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.511 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.511 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Container image name, without the tag", 2024-09-19T06:24:41.511 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.511 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.511 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.511 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.511 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_elasticsearch": { 2024-09-19T06:24:41.511 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_elasticsearch", 2024-09-19T06:24:41.511 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.511 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.512 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.512 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T06:24:41.512 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.512 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.512 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.512 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "elasticsearch container image", 2024-09-19T06:24:41.512 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.512 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.512 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.512 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.512 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_grafana": { 2024-09-19T06:24:41.512 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_grafana", 2024-09-19T06:24:41.512 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.512 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.513 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.513 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T06:24:41.513 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.513 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.513 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.513 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Prometheus container image", 2024-09-19T06:24:41.513 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.513 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.513 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.513 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.513 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_haproxy": { 2024-09-19T06:24:41.513 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_haproxy", 2024-09-19T06:24:41.513 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.514 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.514 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.514 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T06:24:41.514 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.514 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.514 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.514 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "HAproxy container image", 2024-09-19T06:24:41.514 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.514 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.514 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.514 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.514 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_jaeger_agent": { 2024-09-19T06:24:41.514 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_jaeger_agent", 2024-09-19T06:24:41.514 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.515 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.515 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.515 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T06:24:41.515 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.515 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.515 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.515 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Jaeger agent container image", 2024-09-19T06:24:41.515 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.515 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.515 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.515 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.515 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_jaeger_collector": { 2024-09-19T06:24:41.515 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_jaeger_collector", 2024-09-19T06:24:41.516 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.516 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.516 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.516 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T06:24:41.516 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.516 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.516 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.516 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Jaeger collector container image", 2024-09-19T06:24:41.516 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.516 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.516 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.516 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.516 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_jaeger_query": { 2024-09-19T06:24:41.517 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_jaeger_query", 2024-09-19T06:24:41.517 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.517 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.517 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.517 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T06:24:41.517 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.517 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.517 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.517 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Jaeger query container image", 2024-09-19T06:24:41.517 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.517 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.517 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.517 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.518 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_keepalived": { 2024-09-19T06:24:41.518 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_keepalived", 2024-09-19T06:24:41.518 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.518 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.518 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.518 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T06:24:41.518 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.518 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.518 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.518 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Keepalived container image", 2024-09-19T06:24:41.518 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.518 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.518 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.519 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.519 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_loki": { 2024-09-19T06:24:41.519 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_loki", 2024-09-19T06:24:41.519 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.519 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.519 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.519 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T06:24:41.519 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.519 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.519 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.519 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Loki container image", 2024-09-19T06:24:41.519 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.519 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.520 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.520 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.520 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_node_exporter": { 2024-09-19T06:24:41.520 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_node_exporter", 2024-09-19T06:24:41.520 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.520 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.520 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.520 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T06:24:41.520 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.520 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.520 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.520 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Prometheus container image", 2024-09-19T06:24:41.520 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.520 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.521 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.521 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.521 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_nvmeof": { 2024-09-19T06:24:41.521 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_nvmeof", 2024-09-19T06:24:41.521 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.521 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.521 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.521 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T06:24:41.521 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.521 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.521 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.521 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Nvme-of container image", 2024-09-19T06:24:41.521 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.522 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.522 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.522 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.522 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_prometheus": { 2024-09-19T06:24:41.522 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_prometheus", 2024-09-19T06:24:41.522 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.522 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.522 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.522 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T06:24:41.522 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.522 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.522 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.522 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Prometheus container image", 2024-09-19T06:24:41.523 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.523 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.523 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.523 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.523 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_promtail": { 2024-09-19T06:24:41.523 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_promtail", 2024-09-19T06:24:41.523 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.523 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.523 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.523 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T06:24:41.523 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.523 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.523 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.524 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Promtail container image", 2024-09-19T06:24:41.524 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.524 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.524 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.524 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.524 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_samba": { 2024-09-19T06:24:41.524 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_samba", 2024-09-19T06:24:41.524 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.524 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.524 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.524 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T06:24:41.524 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.524 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.525 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.525 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Samba/SMB container image", 2024-09-19T06:24:41.525 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.525 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.525 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.525 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.525 INFO:teuthology.orchestra.run.smithi003.stdout: "container_image_snmp_gateway": { 2024-09-19T06:24:41.528 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_image_snmp_gateway", 2024-09-19T06:24:41.528 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.528 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.528 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.528 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T06:24:41.528 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.528 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.528 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.528 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "SNMP Gateway container image", 2024-09-19T06:24:41.528 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.528 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.528 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.529 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.529 INFO:teuthology.orchestra.run.smithi003.stdout: "container_init": { 2024-09-19T06:24:41.529 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "container_init", 2024-09-19T06:24:41.529 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.529 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.529 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.529 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.529 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.529 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.529 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.529 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T06:24:41.529 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.529 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.530 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.530 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.530 INFO:teuthology.orchestra.run.smithi003.stdout: "daemon_cache_timeout": { 2024-09-19T06:24:41.530 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "daemon_cache_timeout", 2024-09-19T06:24:41.530 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.530 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.530 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.530 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-19T06:24:41.530 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.530 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.530 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.530 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T06:24:41.530 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.531 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.531 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.531 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.531 INFO:teuthology.orchestra.run.smithi003.stdout: "default_cephadm_command_timeout": { 2024-09-19T06:24:41.531 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T06:24:41.531 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.531 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.531 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.531 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "900", 2024-09-19T06:24:41.531 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.531 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.531 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.531 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T06:24:41.532 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.532 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.532 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.532 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.532 INFO:teuthology.orchestra.run.smithi003.stdout: "default_registry": { 2024-09-19T06:24:41.532 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "default_registry", 2024-09-19T06:24:41.532 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.532 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.532 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.532 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "docker.io", 2024-09-19T06:24:41.532 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.532 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.532 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.533 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T06:24:41.533 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.533 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.533 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.533 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.533 INFO:teuthology.orchestra.run.smithi003.stdout: "device_cache_timeout": { 2024-09-19T06:24:41.533 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "device_cache_timeout", 2024-09-19T06:24:41.533 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.533 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.533 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.533 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "1800", 2024-09-19T06:24:41.533 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.534 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.534 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.534 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "seconds to cache device inventory", 2024-09-19T06:24:41.534 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.534 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.534 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.534 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.534 INFO:teuthology.orchestra.run.smithi003.stdout: "device_enhanced_scan": { 2024-09-19T06:24:41.534 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "device_enhanced_scan", 2024-09-19T06:24:41.534 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.534 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.534 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.534 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.534 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.535 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.535 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.535 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T06:24:41.535 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.535 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.535 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.535 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.535 INFO:teuthology.orchestra.run.smithi003.stdout: "facts_cache_timeout": { 2024-09-19T06:24:41.535 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "facts_cache_timeout", 2024-09-19T06:24:41.535 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.535 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.535 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.535 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-19T06:24:41.535 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.536 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.536 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.536 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "seconds to cache host facts data", 2024-09-19T06:24:41.536 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.536 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.536 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.536 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.536 INFO:teuthology.orchestra.run.smithi003.stdout: "grafana_dashboards_path": { 2024-09-19T06:24:41.536 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "grafana_dashboards_path", 2024-09-19T06:24:41.536 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.536 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.536 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.536 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T06:24:41.537 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.537 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.537 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.537 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T06:24:41.537 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.537 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.537 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.537 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.537 INFO:teuthology.orchestra.run.smithi003.stdout: "host_check_interval": { 2024-09-19T06:24:41.537 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "host_check_interval", 2024-09-19T06:24:41.537 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.537 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.537 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.537 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-19T06:24:41.538 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.538 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.538 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.538 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to perform a host check", 2024-09-19T06:24:41.538 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.538 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.538 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.538 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.538 INFO:teuthology.orchestra.run.smithi003.stdout: "hw_monitoring": { 2024-09-19T06:24:41.538 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "hw_monitoring", 2024-09-19T06:24:41.538 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.538 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.538 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.539 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.539 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.539 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.539 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.539 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T06:24:41.539 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.539 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.539 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.539 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.539 INFO:teuthology.orchestra.run.smithi003.stdout: "inventory_list_all": { 2024-09-19T06:24:41.539 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "inventory_list_all", 2024-09-19T06:24:41.539 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.539 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.539 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.540 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.540 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.540 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.540 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.540 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T06:24:41.540 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.540 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.540 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.540 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.540 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.540 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.540 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.540 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.540 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.541 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.541 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.541 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.541 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.541 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.541 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.541 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.541 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.541 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.541 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.541 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.541 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.541 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.542 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.542 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.542 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.542 INFO:teuthology.orchestra.run.smithi003.stdout: "log_refresh_metadata": { 2024-09-19T06:24:41.542 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_refresh_metadata", 2024-09-19T06:24:41.542 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.542 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.542 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.542 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.542 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.542 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.542 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.542 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T06:24:41.543 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.543 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.543 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.543 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.543 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.543 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.543 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.543 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.543 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.543 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.543 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.543 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.543 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.544 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T06:24:41.544 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.544 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.544 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.544 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.544 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.544 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.544 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.544 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.544 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.544 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.544 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.545 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.545 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.545 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.545 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.545 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.545 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.545 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.545 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.545 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.545 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.545 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.545 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.545 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.546 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.546 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.546 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.546 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.546 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.546 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.546 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.546 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.546 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.546 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.546 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.546 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.546 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.547 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.547 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.547 INFO:teuthology.orchestra.run.smithi003.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T06:24:41.547 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T06:24:41.547 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.547 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.547 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.547 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.547 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.547 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.547 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.547 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T06:24:41.547 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.548 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.548 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.548 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.548 INFO:teuthology.orchestra.run.smithi003.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T06:24:41.548 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T06:24:41.548 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.548 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.548 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.548 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "*", 2024-09-19T06:24:41.548 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.548 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.548 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.548 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T06:24:41.549 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.549 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.549 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.549 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.549 INFO:teuthology.orchestra.run.smithi003.stdout: "max_count_per_host": { 2024-09-19T06:24:41.549 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_count_per_host", 2024-09-19T06:24:41.549 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.549 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.549 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.549 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-19T06:24:41.549 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.549 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.549 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.550 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "max number of daemons per service per host", 2024-09-19T06:24:41.550 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.550 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.550 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.550 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.550 INFO:teuthology.orchestra.run.smithi003.stdout: "max_osd_draining_count": { 2024-09-19T06:24:41.550 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_osd_draining_count", 2024-09-19T06:24:41.550 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.550 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.550 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.550 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-19T06:24:41.550 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.550 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.550 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.551 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T06:24:41.551 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.551 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.551 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.551 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.551 INFO:teuthology.orchestra.run.smithi003.stdout: "migration_current": { 2024-09-19T06:24:41.551 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "migration_current", 2024-09-19T06:24:41.551 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.551 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.551 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.551 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.551 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.551 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.551 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.552 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "internal - do not modify", 2024-09-19T06:24:41.552 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.552 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.552 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.552 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.552 INFO:teuthology.orchestra.run.smithi003.stdout: "mode": { 2024-09-19T06:24:41.552 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mode", 2024-09-19T06:24:41.552 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.552 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.552 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.552 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "root", 2024-09-19T06:24:41.552 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.552 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.553 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.553 INFO:teuthology.orchestra.run.smithi003.stdout: "cephadm-package", 2024-09-19T06:24:41.553 INFO:teuthology.orchestra.run.smithi003.stdout: "root" 2024-09-19T06:24:41.553 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.553 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T06:24:41.553 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.553 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.553 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.553 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.553 INFO:teuthology.orchestra.run.smithi003.stdout: "oob_default_addr": { 2024-09-19T06:24:41.553 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "oob_default_addr", 2024-09-19T06:24:41.553 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.553 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.554 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.554 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "169.254.1.1", 2024-09-19T06:24:41.554 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.554 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.554 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.554 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T06:24:41.554 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.554 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.554 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.554 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.554 INFO:teuthology.orchestra.run.smithi003.stdout: "prometheus_alerts_path": { 2024-09-19T06:24:41.554 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "prometheus_alerts_path", 2024-09-19T06:24:41.554 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.554 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.555 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.555 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T06:24:41.555 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.555 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.555 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.555 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T06:24:41.555 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.555 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.555 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.555 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.555 INFO:teuthology.orchestra.run.smithi003.stdout: "registry_insecure": { 2024-09-19T06:24:41.555 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "registry_insecure", 2024-09-19T06:24:41.555 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.556 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.556 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.556 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.556 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.556 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.556 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.556 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T06:24:41.556 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.556 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.556 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.556 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.556 INFO:teuthology.orchestra.run.smithi003.stdout: "registry_password": { 2024-09-19T06:24:41.556 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "registry_password", 2024-09-19T06:24:41.557 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.557 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.557 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.557 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.557 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.557 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.557 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.557 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T06:24:41.557 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.557 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.557 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.557 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.557 INFO:teuthology.orchestra.run.smithi003.stdout: "registry_url": { 2024-09-19T06:24:41.558 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "registry_url", 2024-09-19T06:24:41.558 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.558 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.558 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.558 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.558 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.558 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.558 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.558 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T06:24:41.558 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.558 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.558 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.559 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.559 INFO:teuthology.orchestra.run.smithi003.stdout: "registry_username": { 2024-09-19T06:24:41.559 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "registry_username", 2024-09-19T06:24:41.559 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.559 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.559 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.559 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.559 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.559 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.559 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.559 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T06:24:41.559 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.559 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.560 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.560 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.560 INFO:teuthology.orchestra.run.smithi003.stdout: "secure_monitoring_stack": { 2024-09-19T06:24:41.560 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "secure_monitoring_stack", 2024-09-19T06:24:41.560 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.560 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.560 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.560 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.560 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.560 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.560 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.560 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T06:24:41.560 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.561 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.561 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.561 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.561 INFO:teuthology.orchestra.run.smithi003.stdout: "service_discovery_port": { 2024-09-19T06:24:41.561 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "service_discovery_port", 2024-09-19T06:24:41.561 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.561 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.561 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.561 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8765", 2024-09-19T06:24:41.561 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.561 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.561 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.561 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "cephadm service discovery port", 2024-09-19T06:24:41.562 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.562 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.562 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.562 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.562 INFO:teuthology.orchestra.run.smithi003.stdout: "ssh_config_file": { 2024-09-19T06:24:41.562 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ssh_config_file", 2024-09-19T06:24:41.562 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.562 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.562 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.562 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.562 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.562 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.562 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.563 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T06:24:41.563 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.563 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.563 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.563 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.563 INFO:teuthology.orchestra.run.smithi003.stdout: "use_agent": { 2024-09-19T06:24:41.563 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "use_agent", 2024-09-19T06:24:41.563 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.563 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.563 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.563 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.563 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.563 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.564 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.564 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T06:24:41.564 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.564 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.564 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.564 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.564 INFO:teuthology.orchestra.run.smithi003.stdout: "use_repo_digest": { 2024-09-19T06:24:41.564 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "use_repo_digest", 2024-09-19T06:24:41.564 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.564 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.564 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.564 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.565 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.565 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.565 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.565 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T06:24:41.565 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.565 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.565 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.565 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.565 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_on_failed_host_check": { 2024-09-19T06:24:41.565 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_on_failed_host_check", 2024-09-19T06:24:41.565 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.565 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.565 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.565 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.566 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.566 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.566 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.566 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T06:24:41.566 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.566 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.566 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.566 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.566 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_on_stray_daemons": { 2024-09-19T06:24:41.566 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_on_stray_daemons", 2024-09-19T06:24:41.566 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.566 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.567 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.567 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.567 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.567 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.567 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.567 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T06:24:41.567 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.567 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.567 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.567 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.567 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_on_stray_hosts": { 2024-09-19T06:24:41.567 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_on_stray_hosts", 2024-09-19T06:24:41.567 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.568 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.568 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.568 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.568 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.568 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.568 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.568 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T06:24:41.568 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.568 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.568 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.568 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.568 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.568 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.569 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.569 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crash", 2024-09-19T06:24:41.569 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.569 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.569 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.569 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.569 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.569 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.569 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.569 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.569 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.569 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.569 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.570 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.570 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.570 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.570 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.570 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.570 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.570 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.570 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.570 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.570 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.570 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.570 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.570 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.570 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.571 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.571 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.571 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.571 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.571 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.571 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.571 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.571 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.571 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.571 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.571 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.571 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.571 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.571 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.572 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.572 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.572 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.572 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.572 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.572 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.572 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.572 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.572 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.572 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.572 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.572 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.572 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.573 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.573 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.573 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.573 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.573 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.573 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.573 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.573 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.573 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.573 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.573 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.573 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.573 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.574 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.574 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.574 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.574 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.574 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.574 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.574 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.574 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.574 INFO:teuthology.orchestra.run.smithi003.stdout: "retain_interval": { 2024-09-19T06:24:41.574 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "retain_interval", 2024-09-19T06:24:41.574 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.574 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.574 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.575 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "31536000", 2024-09-19T06:24:41.575 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.575 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.575 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.575 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T06:24:41.575 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.575 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.575 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.575 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.575 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_recent_interval": { 2024-09-19T06:24:41.575 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_recent_interval", 2024-09-19T06:24:41.575 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.575 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.576 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.576 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "1209600", 2024-09-19T06:24:41.576 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.576 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.576 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.576 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T06:24:41.576 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.576 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.576 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.576 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.576 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.576 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.577 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.577 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "dashboard", 2024-09-19T06:24:41.577 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.577 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.577 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.577 INFO:teuthology.orchestra.run.smithi003.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T06:24:41.577 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T06:24:41.577 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.577 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.577 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.577 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-19T06:24:41.577 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.578 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.578 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.578 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.578 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.578 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.578 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.578 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.578 INFO:teuthology.orchestra.run.smithi003.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T06:24:41.578 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T06:24:41.578 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.578 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.578 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.578 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.578 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.579 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.579 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.579 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.579 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.579 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.579 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.579 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.579 INFO:teuthology.orchestra.run.smithi003.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T06:24:41.579 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T06:24:41.579 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.579 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.579 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.580 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.580 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.580 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.580 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.580 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.580 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.580 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.580 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.580 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.580 INFO:teuthology.orchestra.run.smithi003.stdout: "AUDIT_API_ENABLED": { 2024-09-19T06:24:41.580 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T06:24:41.580 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.580 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.581 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.581 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.581 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.581 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.581 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.581 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.581 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.581 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.581 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.581 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.581 INFO:teuthology.orchestra.run.smithi003.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T06:24:41.581 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T06:24:41.582 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.582 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.582 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.582 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.582 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.582 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.582 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.582 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.582 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.582 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.582 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.582 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.582 INFO:teuthology.orchestra.run.smithi003.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T06:24:41.583 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T06:24:41.583 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.583 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.583 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.583 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.583 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.583 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.583 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.583 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.583 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.583 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.583 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.583 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.584 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T06:24:41.584 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T06:24:41.584 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.584 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.584 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.584 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.584 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.584 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.584 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.584 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.584 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.584 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.584 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.585 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.585 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T06:24:41.585 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T06:24:41.585 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.585 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.585 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.585 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.585 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.585 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.585 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.585 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.585 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.585 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.585 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.586 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.586 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T06:24:41.586 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T06:24:41.586 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.586 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.586 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.586 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.586 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.586 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.586 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.586 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.586 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.586 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.586 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.587 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.587 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T06:24:41.587 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T06:24:41.587 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.587 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.587 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.587 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.587 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.587 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.587 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.587 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.587 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.587 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.588 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.588 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.588 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T06:24:41.588 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T06:24:41.588 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.588 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.588 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.588 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.588 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.588 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.588 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.588 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.588 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.589 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.589 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.589 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.589 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T06:24:41.589 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T06:24:41.589 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.589 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.589 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.589 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.589 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.589 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.589 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.589 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.590 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.590 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.590 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.590 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.590 INFO:teuthology.orchestra.run.smithi003.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T06:24:41.590 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T06:24:41.590 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.590 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.590 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.590 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.590 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.590 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.590 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.591 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.591 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.591 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.591 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.591 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.591 INFO:teuthology.orchestra.run.smithi003.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T06:24:41.591 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T06:24:41.591 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.591 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.591 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.591 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.591 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.591 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.591 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.592 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.592 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.592 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.592 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.592 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.592 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T06:24:41.592 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T06:24:41.592 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.592 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.592 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.592 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "admin", 2024-09-19T06:24:41.592 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.592 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.593 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.593 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.593 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.593 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.593 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.593 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.593 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T06:24:41.593 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T06:24:41.593 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.593 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.593 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.593 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.594 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.594 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.594 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.594 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.594 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.594 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.594 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.594 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.594 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_API_URL": { 2024-09-19T06:24:41.594 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_API_URL", 2024-09-19T06:24:41.594 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.594 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.594 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.595 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.595 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.595 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.595 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.595 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.595 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.595 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.595 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.595 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.595 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T06:24:41.595 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T06:24:41.595 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.595 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.596 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.596 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "admin", 2024-09-19T06:24:41.596 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.596 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.596 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.596 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.596 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.596 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.596 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.596 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.596 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T06:24:41.596 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T06:24:41.596 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.597 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.597 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.597 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.597 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.597 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.597 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.597 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.597 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.597 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.597 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.597 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.597 INFO:teuthology.orchestra.run.smithi003.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T06:24:41.597 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T06:24:41.598 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.598 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.598 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.598 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.598 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.598 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.598 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.598 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.598 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.598 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.598 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.598 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.598 INFO:teuthology.orchestra.run.smithi003.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T06:24:41.599 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T06:24:41.599 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.599 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.599 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.599 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.599 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.599 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.599 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.599 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.599 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.599 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.599 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.599 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.600 INFO:teuthology.orchestra.run.smithi003.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T06:24:41.600 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T06:24:41.600 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.600 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.600 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.600 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.600 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.600 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.600 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.600 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.600 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.600 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.601 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.601 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.601 INFO:teuthology.orchestra.run.smithi003.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T06:24:41.601 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T06:24:41.601 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.601 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.601 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.601 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.601 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.601 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.601 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.601 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.601 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.602 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.602 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.602 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.602 INFO:teuthology.orchestra.run.smithi003.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T06:24:41.602 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T06:24:41.602 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.602 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.602 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.602 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.602 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.602 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.602 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.602 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.603 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.603 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.603 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.603 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.603 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T06:24:41.603 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T06:24:41.603 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.603 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.603 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.603 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.603 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.603 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.604 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.604 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.604 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.604 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.604 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.604 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.604 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T06:24:41.604 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T06:24:41.604 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.604 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.604 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.604 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.604 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.605 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.605 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.605 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.605 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.605 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.605 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.605 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.605 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T06:24:41.605 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T06:24:41.605 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.605 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.605 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.605 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.605 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.606 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.606 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.606 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.606 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.606 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.606 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.606 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.606 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T06:24:41.606 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T06:24:41.606 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.606 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.606 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.606 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.607 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.607 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.607 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.607 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.607 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.607 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.607 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.607 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.607 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T06:24:41.607 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T06:24:41.607 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.607 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.607 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.607 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.608 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.608 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.608 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.608 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.608 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.608 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.608 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.608 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.608 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T06:24:41.608 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T06:24:41.608 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.608 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.608 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.609 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.609 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.609 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.609 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.609 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.609 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.609 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.609 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.609 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.609 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T06:24:41.609 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T06:24:41.609 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.609 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.610 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.610 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.610 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.610 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.610 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.610 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.610 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.610 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.610 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.610 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.610 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T06:24:41.610 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T06:24:41.610 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.611 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.611 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.611 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.611 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.611 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.611 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.611 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.611 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.611 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.611 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.611 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.611 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T06:24:41.611 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T06:24:41.611 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.612 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.612 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.612 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T06:24:41.612 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.612 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.612 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.612 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.612 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.612 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.612 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.612 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.612 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T06:24:41.612 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T06:24:41.612 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.612 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.613 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.613 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-19T06:24:41.613 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.613 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.613 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.613 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.613 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.613 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.613 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.613 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.613 INFO:teuthology.orchestra.run.smithi003.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T06:24:41.613 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T06:24:41.613 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.613 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.614 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.614 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8", 2024-09-19T06:24:41.614 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.614 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.614 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.614 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.614 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.614 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.614 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.614 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.614 INFO:teuthology.orchestra.run.smithi003.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T06:24:41.614 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T06:24:41.614 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.614 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.614 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.615 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "45", 2024-09-19T06:24:41.615 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.615 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.615 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.615 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.615 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.615 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.615 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.615 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.615 INFO:teuthology.orchestra.run.smithi003.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T06:24:41.615 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T06:24:41.615 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.615 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.615 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.616 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.616 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.616 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.616 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.616 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.616 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.616 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.616 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.616 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.616 INFO:teuthology.orchestra.run.smithi003.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T06:24:41.616 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T06:24:41.616 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.616 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.616 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.616 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "admin", 2024-09-19T06:24:41.617 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.617 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.617 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.617 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.617 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.617 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.617 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.617 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.617 INFO:teuthology.orchestra.run.smithi003.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T06:24:41.617 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T06:24:41.617 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.617 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.617 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.618 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.618 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.618 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.618 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.618 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.618 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.618 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.618 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.618 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.618 INFO:teuthology.orchestra.run.smithi003.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T06:24:41.618 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T06:24:41.618 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.618 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.619 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.619 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.619 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.619 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.619 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.619 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.619 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.619 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.619 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.619 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.619 INFO:teuthology.orchestra.run.smithi003.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T06:24:41.619 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T06:24:41.620 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.620 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.620 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.620 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-19T06:24:41.620 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.620 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.620 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.620 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.620 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.620 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.620 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.620 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.620 INFO:teuthology.orchestra.run.smithi003.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T06:24:41.621 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T06:24:41.621 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.621 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.621 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.621 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-19T06:24:41.621 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.621 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.621 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.621 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.621 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.621 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.621 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.621 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.622 INFO:teuthology.orchestra.run.smithi003.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T06:24:41.622 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T06:24:41.622 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.622 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.622 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.622 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-19T06:24:41.622 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.622 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.622 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.622 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.622 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.622 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.622 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.623 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.623 INFO:teuthology.orchestra.run.smithi003.stdout: "cross_origin_url": { 2024-09-19T06:24:41.623 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cross_origin_url", 2024-09-19T06:24:41.623 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.623 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.623 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.623 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.623 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.623 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.623 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.623 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.623 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.623 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.623 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.623 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.624 INFO:teuthology.orchestra.run.smithi003.stdout: "crt_file": { 2024-09-19T06:24:41.624 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "crt_file", 2024-09-19T06:24:41.624 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.624 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.624 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.624 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.624 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.624 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.624 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.624 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.624 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.624 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.624 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.625 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.625 INFO:teuthology.orchestra.run.smithi003.stdout: "debug": { 2024-09-19T06:24:41.625 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "debug", 2024-09-19T06:24:41.625 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.625 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.625 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.625 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.625 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.625 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.625 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.625 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Enable/disable debug options", 2024-09-19T06:24:41.625 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.625 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.626 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.626 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.626 INFO:teuthology.orchestra.run.smithi003.stdout: "jwt_token_ttl": { 2024-09-19T06:24:41.626 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "jwt_token_ttl", 2024-09-19T06:24:41.626 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.626 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.626 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.626 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "28800", 2024-09-19T06:24:41.626 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.626 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.626 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.626 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.626 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.626 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.626 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.627 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.627 INFO:teuthology.orchestra.run.smithi003.stdout: "key_file": { 2024-09-19T06:24:41.627 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "key_file", 2024-09-19T06:24:41.627 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.627 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.627 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.627 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.627 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.627 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.627 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.627 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.627 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.627 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.627 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.628 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.628 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.628 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.628 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.628 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.628 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.628 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.628 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.628 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.628 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.628 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.628 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.629 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.629 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.629 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.629 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.629 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.629 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.629 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.629 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.629 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.629 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.629 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.629 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.630 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.630 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.630 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.630 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.630 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.630 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.630 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.630 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.630 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.630 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.630 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.630 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.630 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.631 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.631 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.631 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.631 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.631 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.631 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.631 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.631 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.631 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.631 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.631 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.631 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.631 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.631 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.632 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.632 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.632 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.632 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.632 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.632 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.632 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.632 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.632 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.632 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.632 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.632 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.633 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.633 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.633 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.633 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.633 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.633 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.633 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.633 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.633 INFO:teuthology.orchestra.run.smithi003.stdout: "motd": { 2024-09-19T06:24:41.633 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "motd", 2024-09-19T06:24:41.633 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.634 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.634 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.634 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.634 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.634 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.634 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.634 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "The message of the day", 2024-09-19T06:24:41.634 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.634 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.634 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.634 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.634 INFO:teuthology.orchestra.run.smithi003.stdout: "redirect_resolve_ip_addr": { 2024-09-19T06:24:41.634 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T06:24:41.634 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.635 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.635 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.635 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.635 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.635 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.635 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.635 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.635 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.635 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.635 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.635 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.635 INFO:teuthology.orchestra.run.smithi003.stdout: "server_addr": { 2024-09-19T06:24:41.636 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_addr", 2024-09-19T06:24:41.636 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.636 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.636 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.636 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "::", 2024-09-19T06:24:41.636 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.636 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.636 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.636 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.636 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.636 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.636 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.636 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.636 INFO:teuthology.orchestra.run.smithi003.stdout: "server_port": { 2024-09-19T06:24:41.637 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_port", 2024-09-19T06:24:41.637 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.637 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.637 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.637 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8080", 2024-09-19T06:24:41.637 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.637 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.637 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.637 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.637 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.637 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.637 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.638 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.638 INFO:teuthology.orchestra.run.smithi003.stdout: "ssl": { 2024-09-19T06:24:41.638 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ssl", 2024-09-19T06:24:41.638 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.638 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.638 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.638 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.638 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.638 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.638 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.638 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.638 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.638 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.638 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.639 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.639 INFO:teuthology.orchestra.run.smithi003.stdout: "ssl_server_port": { 2024-09-19T06:24:41.639 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ssl_server_port", 2024-09-19T06:24:41.639 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.639 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.639 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.639 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8443", 2024-09-19T06:24:41.639 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.639 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.639 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.639 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.639 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.639 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.639 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.640 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.640 INFO:teuthology.orchestra.run.smithi003.stdout: "standby_behaviour": { 2024-09-19T06:24:41.640 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "standby_behaviour", 2024-09-19T06:24:41.640 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.640 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.640 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.640 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "redirect", 2024-09-19T06:24:41.640 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.640 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.640 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.640 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.640 INFO:teuthology.orchestra.run.smithi003.stdout: "redirect" 2024-09-19T06:24:41.641 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.641 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.641 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.641 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.641 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.641 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.641 INFO:teuthology.orchestra.run.smithi003.stdout: "standby_error_status_code": { 2024-09-19T06:24:41.641 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "standby_error_status_code", 2024-09-19T06:24:41.641 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.641 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.641 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.641 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "500", 2024-09-19T06:24:41.641 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "400", 2024-09-19T06:24:41.641 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "599", 2024-09-19T06:24:41.642 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.642 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.642 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.642 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.642 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.642 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.642 INFO:teuthology.orchestra.run.smithi003.stdout: "url_prefix": { 2024-09-19T06:24:41.642 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "url_prefix", 2024-09-19T06:24:41.642 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.642 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.642 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.642 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.642 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.642 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.643 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.643 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.643 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.643 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.643 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.643 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.643 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.643 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.643 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.643 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "devicehealth", 2024-09-19T06:24:41.643 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.643 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.644 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.644 INFO:teuthology.orchestra.run.smithi003.stdout: "enable_monitoring": { 2024-09-19T06:24:41.644 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "enable_monitoring", 2024-09-19T06:24:41.644 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.644 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.644 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.644 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.644 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.644 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.644 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.644 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "monitor device health metrics", 2024-09-19T06:24:41.644 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.644 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.645 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.645 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.645 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.645 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.645 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.645 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.645 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.645 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.645 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.645 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.645 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.645 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.645 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.646 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.646 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.646 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.646 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.646 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.646 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.646 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.646 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.646 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.646 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.646 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.646 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.646 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.647 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.647 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.647 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.647 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.647 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.647 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.647 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.647 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.647 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.647 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.647 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.647 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.647 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.647 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.648 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.648 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.648 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.648 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.648 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.648 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.648 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.648 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.648 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.648 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.648 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.648 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.648 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.649 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.649 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.649 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.649 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.649 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.649 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.649 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.649 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.649 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.649 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.649 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.649 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.649 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.650 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.650 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.650 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.650 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.650 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.650 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.650 INFO:teuthology.orchestra.run.smithi003.stdout: "mark_out_threshold": { 2024-09-19T06:24:41.650 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mark_out_threshold", 2024-09-19T06:24:41.650 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.650 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.650 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.650 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "2419200", 2024-09-19T06:24:41.650 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.650 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.651 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.651 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T06:24:41.651 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.651 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.651 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.651 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.651 INFO:teuthology.orchestra.run.smithi003.stdout: "pool_name": { 2024-09-19T06:24:41.651 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "pool_name", 2024-09-19T06:24:41.651 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.651 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.651 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.651 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "device_health_metrics", 2024-09-19T06:24:41.651 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.652 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.652 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.652 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T06:24:41.652 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.652 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.652 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.652 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.652 INFO:teuthology.orchestra.run.smithi003.stdout: "retention_period": { 2024-09-19T06:24:41.652 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "retention_period", 2024-09-19T06:24:41.652 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.652 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.652 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.652 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "15552000", 2024-09-19T06:24:41.653 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.653 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.653 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.653 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how long to retain device health metrics", 2024-09-19T06:24:41.653 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.653 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.653 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.653 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.653 INFO:teuthology.orchestra.run.smithi003.stdout: "scrape_frequency": { 2024-09-19T06:24:41.653 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "scrape_frequency", 2024-09-19T06:24:41.653 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.653 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.654 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.654 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "86400", 2024-09-19T06:24:41.654 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.654 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.654 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.654 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T06:24:41.654 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.654 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.654 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.654 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.654 INFO:teuthology.orchestra.run.smithi003.stdout: "self_heal": { 2024-09-19T06:24:41.654 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "self_heal", 2024-09-19T06:24:41.654 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.655 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.655 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.655 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.655 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.655 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.655 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.655 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T06:24:41.655 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.655 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.655 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.655 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.655 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-19T06:24:41.655 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-19T06:24:41.656 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.656 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.656 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.656 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-19T06:24:41.656 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.656 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.656 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.656 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T06:24:41.656 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.656 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.656 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.656 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.656 INFO:teuthology.orchestra.run.smithi003.stdout: "warn_threshold": { 2024-09-19T06:24:41.657 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "warn_threshold", 2024-09-19T06:24:41.657 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.657 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.657 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.657 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "7257600", 2024-09-19T06:24:41.657 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.657 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.657 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.657 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T06:24:41.657 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.657 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.657 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.657 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.658 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.658 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.658 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.658 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "diskprediction_local", 2024-09-19T06:24:41.658 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.658 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.658 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.658 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.658 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.658 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.658 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.658 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.658 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.659 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.659 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.659 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.659 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.659 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.659 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.659 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.659 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.659 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.659 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.659 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.659 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.659 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.659 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.660 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.660 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.660 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.660 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.660 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.660 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.660 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.660 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.660 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.660 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.660 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.660 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.660 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.660 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.660 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.661 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.661 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.661 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.661 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.661 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.661 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.661 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.661 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.662 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.662 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.662 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.662 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.662 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.662 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.662 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.662 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.662 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.662 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.662 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.662 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.662 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.662 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.663 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.663 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.663 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.663 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.663 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.663 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.663 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.663 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.663 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.663 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.663 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.663 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.663 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.664 INFO:teuthology.orchestra.run.smithi003.stdout: "predict_interval": { 2024-09-19T06:24:41.664 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "predict_interval", 2024-09-19T06:24:41.664 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.664 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.664 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.664 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "86400", 2024-09-19T06:24:41.664 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.664 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.664 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.664 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.664 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.664 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.665 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.665 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.665 INFO:teuthology.orchestra.run.smithi003.stdout: "predictor_model": { 2024-09-19T06:24:41.665 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "predictor_model", 2024-09-19T06:24:41.665 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.665 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.665 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.665 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "prophetstor", 2024-09-19T06:24:41.665 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.665 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.665 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.665 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.665 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.666 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.666 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.666 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.666 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-19T06:24:41.666 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-19T06:24:41.666 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.666 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.666 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.666 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "600", 2024-09-19T06:24:41.666 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.666 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.666 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.666 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.667 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.667 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.667 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.667 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.667 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.667 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.667 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.667 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "influx", 2024-09-19T06:24:41.667 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": false, 2024-09-19T06:24:41.667 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "influxdb python module not found", 2024-09-19T06:24:41.667 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.667 INFO:teuthology.orchestra.run.smithi003.stdout: "batch_size": { 2024-09-19T06:24:41.667 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "batch_size", 2024-09-19T06:24:41.668 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.668 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.668 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.668 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5000", 2024-09-19T06:24:41.668 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.668 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.668 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.668 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T06:24:41.668 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.668 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.668 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.668 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.668 INFO:teuthology.orchestra.run.smithi003.stdout: "database": { 2024-09-19T06:24:41.669 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "database", 2024-09-19T06:24:41.669 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.669 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.669 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.669 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "ceph", 2024-09-19T06:24:41.669 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.669 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.669 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.669 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T06:24:41.669 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.669 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.669 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.669 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.670 INFO:teuthology.orchestra.run.smithi003.stdout: "hostname": { 2024-09-19T06:24:41.670 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "hostname", 2024-09-19T06:24:41.670 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.670 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.670 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.670 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.670 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.670 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.670 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.670 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "InfluxDB server hostname", 2024-09-19T06:24:41.670 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.670 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.671 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.671 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.671 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-19T06:24:41.671 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-19T06:24:41.671 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.671 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.671 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.671 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "30", 2024-09-19T06:24:41.671 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "5", 2024-09-19T06:24:41.671 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.671 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.671 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T06:24:41.671 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.672 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.672 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.672 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.672 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.672 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.672 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.672 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.672 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.672 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.672 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.672 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.672 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.672 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.672 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.673 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.673 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.673 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.673 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.673 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.673 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.673 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.673 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.673 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.673 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.673 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.673 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.674 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.674 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.674 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.674 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.674 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.674 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.674 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.674 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.674 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.674 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.674 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.674 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.674 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.675 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.675 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.675 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.675 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.675 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.675 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.675 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.675 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.675 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.675 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.675 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.675 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.675 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.676 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.676 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.676 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.676 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.676 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.676 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.676 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.676 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.676 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.676 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.676 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.676 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.676 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.677 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.677 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.677 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.677 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.677 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.677 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.677 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.677 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.677 INFO:teuthology.orchestra.run.smithi003.stdout: "password": { 2024-09-19T06:24:41.677 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "password", 2024-09-19T06:24:41.677 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.677 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.677 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.678 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.678 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.678 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.678 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.678 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "password of InfluxDB server user", 2024-09-19T06:24:41.678 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.678 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.678 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.678 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.678 INFO:teuthology.orchestra.run.smithi003.stdout: "port": { 2024-09-19T06:24:41.678 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "port", 2024-09-19T06:24:41.678 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.678 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.678 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.679 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "8086", 2024-09-19T06:24:41.679 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.679 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.679 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.679 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "InfluxDB server port", 2024-09-19T06:24:41.679 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.679 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.679 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.679 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.679 INFO:teuthology.orchestra.run.smithi003.stdout: "ssl": { 2024-09-19T06:24:41.679 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ssl", 2024-09-19T06:24:41.679 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.679 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.680 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.680 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "false", 2024-09-19T06:24:41.680 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.680 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.680 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.680 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:24:41.680 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.680 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.680 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.680 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.680 INFO:teuthology.orchestra.run.smithi003.stdout: "threads": { 2024-09-19T06:24:41.680 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "threads", 2024-09-19T06:24:41.681 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.681 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.681 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.681 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-19T06:24:41.681 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1", 2024-09-19T06:24:41.681 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "32", 2024-09-19T06:24:41.681 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.681 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T06:24:41.681 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.681 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.681 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.681 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.682 INFO:teuthology.orchestra.run.smithi003.stdout: "username": { 2024-09-19T06:24:41.682 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "username", 2024-09-19T06:24:41.682 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.682 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.682 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.682 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.682 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.682 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.682 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.682 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "username of InfluxDB server user", 2024-09-19T06:24:41.682 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.682 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.682 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.683 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.683 INFO:teuthology.orchestra.run.smithi003.stdout: "verify_ssl": { 2024-09-19T06:24:41.683 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "verify_ssl", 2024-09-19T06:24:41.683 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.683 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.683 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.683 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "true", 2024-09-19T06:24:41.683 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.683 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.683 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.683 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T06:24:41.683 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.683 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.683 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.684 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.684 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.684 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.684 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.684 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "insights", 2024-09-19T06:24:41.684 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.684 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.684 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.684 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.684 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.684 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.684 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.684 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.685 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.685 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.685 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.685 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.685 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.685 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.685 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.685 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.685 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.685 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.685 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.685 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.685 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.686 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.686 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.686 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.686 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.686 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.686 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.686 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.686 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.686 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.686 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.686 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.686 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.687 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.687 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.687 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.687 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.687 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.687 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.687 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.687 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.687 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.687 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.687 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.687 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.687 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.688 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.688 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.688 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.688 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.688 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.688 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.688 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.688 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.688 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.688 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.688 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.688 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.688 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.689 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.689 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.689 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.689 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.689 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.689 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.689 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.689 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.689 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.689 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.689 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.689 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.689 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.690 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.690 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.690 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.690 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.690 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "iostat", 2024-09-19T06:24:41.690 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.690 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.690 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.690 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.690 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.690 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.690 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.690 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.691 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.691 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.691 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.691 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.691 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.691 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.691 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.691 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.691 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.691 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.691 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.691 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.691 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.691 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.692 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.692 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.692 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.692 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.692 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.692 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.692 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.692 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.692 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.692 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.692 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.692 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.692 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.692 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.692 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.693 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.693 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.693 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.693 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.693 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.693 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.693 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.693 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.693 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.693 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.693 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.693 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.694 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.694 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.694 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.694 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.694 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.694 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.694 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.694 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.694 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.694 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.694 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.694 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.694 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.694 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.695 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.695 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.695 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.695 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.695 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.695 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.695 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.695 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.695 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.695 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.695 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.695 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.695 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.695 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "k8sevents", 2024-09-19T06:24:41.696 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.696 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.696 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.696 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_event_retention_days": { 2024-09-19T06:24:41.696 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "ceph_event_retention_days", 2024-09-19T06:24:41.696 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.696 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.696 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.696 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "7", 2024-09-19T06:24:41.696 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.696 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.696 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.696 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T06:24:41.697 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.697 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.697 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.697 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.697 INFO:teuthology.orchestra.run.smithi003.stdout: "config_check_secs": { 2024-09-19T06:24:41.697 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "config_check_secs", 2024-09-19T06:24:41.697 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.697 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.697 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.697 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-19T06:24:41.697 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "10", 2024-09-19T06:24:41.697 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.698 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.698 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T06:24:41.698 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.698 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.698 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.698 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.698 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.698 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.698 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.698 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.698 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.698 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.698 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.698 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.699 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.699 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.699 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.699 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.699 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.699 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.699 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.699 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.699 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.699 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.699 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.699 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.699 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.700 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.700 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.700 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.700 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.700 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.700 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.700 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.700 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.700 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.700 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.700 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.700 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.700 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.701 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.701 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.701 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.701 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.701 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.701 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.701 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.701 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.701 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.701 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.701 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.701 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.701 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.702 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.702 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.702 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.702 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.702 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.702 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.702 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.702 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.702 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.702 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.702 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.702 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.703 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.703 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.703 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.703 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.703 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.703 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.703 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.703 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.703 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.703 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.703 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.703 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.703 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.704 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.704 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "localpool", 2024-09-19T06:24:41.704 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.704 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.704 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.704 INFO:teuthology.orchestra.run.smithi003.stdout: "failure_domain": { 2024-09-19T06:24:41.704 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "failure_domain", 2024-09-19T06:24:41.704 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.704 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.704 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.704 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "host", 2024-09-19T06:24:41.704 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.704 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.704 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.705 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "failure domain for any created local pool", 2024-09-19T06:24:41.705 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T06:24:41.705 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.705 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.705 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.705 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.705 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.705 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.705 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.705 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.705 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.705 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.705 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.706 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.706 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.706 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.706 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.706 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.706 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.706 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.706 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.706 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.706 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.706 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.706 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.706 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.707 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.707 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.707 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.707 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.707 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.707 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.707 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.707 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.707 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.707 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.707 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.707 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.707 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.708 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.708 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.708 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.708 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.708 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.708 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.708 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.708 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.708 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.708 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.708 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.708 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.708 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.709 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.709 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.709 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.709 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.709 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.709 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.709 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.709 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.709 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.709 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.709 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.709 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.709 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.710 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.710 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.710 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.710 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.710 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.710 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.710 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.710 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.710 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.710 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.710 INFO:teuthology.orchestra.run.smithi003.stdout: "min_size": { 2024-09-19T06:24:41.710 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "min_size", 2024-09-19T06:24:41.710 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.710 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.711 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.711 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.711 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.711 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.711 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.711 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "default min_size for any created local pool", 2024-09-19T06:24:41.711 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T06:24:41.711 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.711 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.711 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.711 INFO:teuthology.orchestra.run.smithi003.stdout: "num_rep": { 2024-09-19T06:24:41.711 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "num_rep", 2024-09-19T06:24:41.711 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.712 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.712 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.712 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "3", 2024-09-19T06:24:41.712 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.712 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.712 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.712 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "default replica count for any created local pool", 2024-09-19T06:24:41.712 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.712 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.712 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.712 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.712 INFO:teuthology.orchestra.run.smithi003.stdout: "pg_num": { 2024-09-19T06:24:41.712 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "pg_num", 2024-09-19T06:24:41.712 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.713 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.713 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.713 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "128", 2024-09-19T06:24:41.713 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.713 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.713 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.713 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T06:24:41.713 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.713 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.713 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.713 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.713 INFO:teuthology.orchestra.run.smithi003.stdout: "prefix": { 2024-09-19T06:24:41.714 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "prefix", 2024-09-19T06:24:41.714 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.714 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.714 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.714 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.714 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.714 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.714 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.714 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "name prefix for any created local pool", 2024-09-19T06:24:41.714 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.714 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.714 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.714 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.715 INFO:teuthology.orchestra.run.smithi003.stdout: "subtree": { 2024-09-19T06:24:41.715 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "subtree", 2024-09-19T06:24:41.715 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.715 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.715 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.715 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "rack", 2024-09-19T06:24:41.715 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.715 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.715 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.715 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T06:24:41.715 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T06:24:41.715 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.715 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.716 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.716 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.716 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.716 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.716 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mds_autoscaler", 2024-09-19T06:24:41.716 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.716 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.716 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.716 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.716 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.716 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.716 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.717 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.717 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.717 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.717 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.717 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.717 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.717 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.717 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.717 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.717 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.717 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.717 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.717 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.718 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.718 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.718 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.718 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.718 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.718 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.718 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.718 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.718 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.718 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.718 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.718 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.718 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.719 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.719 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.719 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.719 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.719 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.719 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.719 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.719 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.719 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.719 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.719 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.719 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.719 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.719 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.720 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.720 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.720 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.720 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.720 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.720 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.720 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.720 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.720 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.720 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.720 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.720 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.720 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.721 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.721 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.721 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.721 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.721 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.721 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.721 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.721 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.721 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.721 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.721 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.721 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.721 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.722 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.722 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.722 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.722 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mirroring", 2024-09-19T06:24:41.722 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.722 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.722 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.722 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.722 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.722 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.722 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.722 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.722 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.723 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.723 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.723 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.723 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.723 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.723 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.723 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.723 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.723 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.723 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.723 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.723 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.723 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.723 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.724 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.724 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.724 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.724 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.724 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.724 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.724 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.724 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.724 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.724 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.724 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.724 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.724 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.725 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.725 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.725 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.725 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.725 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.725 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.725 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.725 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.725 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.725 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.725 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.725 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.725 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.725 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.726 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.726 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.726 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.726 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.726 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.726 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.726 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.726 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.726 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.726 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.726 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.726 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.726 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.727 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.727 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.727 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.727 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.727 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.727 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.727 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.727 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.727 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.727 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.727 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.727 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.727 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.728 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "nfs", 2024-09-19T06:24:41.728 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.728 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.728 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.728 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.728 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.728 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.728 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.728 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.728 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.728 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.728 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.728 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.729 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.729 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.729 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.729 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.729 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.729 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.729 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.729 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.729 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.729 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.729 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.729 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.729 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.730 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.730 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.730 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.730 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.730 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.730 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.730 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.730 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.730 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.730 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.730 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.730 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.730 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.731 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.731 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.731 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.731 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.731 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.731 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.731 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.731 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.731 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.731 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.731 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.731 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.731 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.731 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.732 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.732 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.732 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.732 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.732 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.732 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.732 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.732 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.732 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.732 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.732 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.732 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.732 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.733 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.733 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.733 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.733 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.733 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.733 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.733 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.733 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.733 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.733 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.733 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.733 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "orchestrator", 2024-09-19T06:24:41.734 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.734 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.734 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.734 INFO:teuthology.orchestra.run.smithi003.stdout: "fail_fs": { 2024-09-19T06:24:41.734 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "fail_fs", 2024-09-19T06:24:41.734 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.734 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.734 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.734 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.734 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.734 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.734 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.734 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T06:24:41.735 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.735 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.735 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.735 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.735 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.735 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.735 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.735 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.735 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.735 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.735 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.735 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.736 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.736 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.736 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.736 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.736 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.736 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.736 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.736 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.736 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.736 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.736 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.736 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.737 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.737 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.737 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.737 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.737 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.737 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.737 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.737 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.737 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.737 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.737 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.737 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.737 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.737 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.738 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.738 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.738 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.738 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.738 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.738 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.738 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.738 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.738 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.738 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.738 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.738 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.738 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.739 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.739 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.739 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.739 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.739 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.739 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.739 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.739 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.739 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.739 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.739 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.739 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.739 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.740 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.740 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.740 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.740 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.740 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.740 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.740 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.740 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.740 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.740 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.740 INFO:teuthology.orchestra.run.smithi003.stdout: "orchestrator": { 2024-09-19T06:24:41.740 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "orchestrator", 2024-09-19T06:24:41.740 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.741 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.741 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.741 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.741 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.741 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.741 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.741 INFO:teuthology.orchestra.run.smithi003.stdout: "cephadm", 2024-09-19T06:24:41.741 INFO:teuthology.orchestra.run.smithi003.stdout: "rook", 2024-09-19T06:24:41.741 INFO:teuthology.orchestra.run.smithi003.stdout: "test_orchestrator" 2024-09-19T06:24:41.741 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.741 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Orchestrator backend", 2024-09-19T06:24:41.741 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.741 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.741 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.742 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.742 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.742 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.742 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.742 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "osd_perf_query", 2024-09-19T06:24:41.742 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.742 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.742 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.742 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.742 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.742 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.742 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.742 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.743 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.743 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.743 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.743 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.743 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.743 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.743 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.743 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.743 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.743 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.743 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.743 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.743 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.743 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.744 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.744 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.744 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.744 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.744 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.744 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.744 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.744 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.744 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.744 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.744 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.744 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.744 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.745 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.745 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.745 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.745 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.745 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.745 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.745 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.745 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.745 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.745 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.745 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.745 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.745 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.746 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.746 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.746 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.746 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.746 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.746 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.746 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.746 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.746 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.746 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.746 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.746 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.746 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.747 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.747 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.747 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.747 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.747 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.747 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.747 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.747 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.747 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.747 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.747 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.747 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.747 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.747 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.748 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.748 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "osd_support", 2024-09-19T06:24:41.748 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.748 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.748 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.748 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.748 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.748 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.748 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.748 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.748 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.748 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.748 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.749 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.749 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.749 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.749 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.749 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.749 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.749 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.749 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.749 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.749 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.749 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.749 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.749 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.750 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.750 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.750 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.750 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.750 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.750 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.750 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.750 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.750 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.750 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.750 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.750 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.750 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.750 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.751 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.751 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.751 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.751 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.751 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.751 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.751 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.751 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.751 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.751 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.751 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.751 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.752 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.752 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.752 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.752 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.752 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.752 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.752 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.752 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.752 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.752 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.752 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.752 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.752 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.753 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.753 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.753 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.753 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.753 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.753 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.753 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.753 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.753 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.753 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.753 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.753 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.753 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.754 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "pg_autoscaler", 2024-09-19T06:24:41.754 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.754 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.754 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.754 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.754 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.754 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.754 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.754 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.754 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.754 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.754 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.754 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.754 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.755 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.755 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.755 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.755 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.755 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.755 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.755 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.755 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.755 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.755 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.755 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.755 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.755 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.756 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.756 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.756 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.756 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.756 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.756 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.756 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.756 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.756 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.756 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.756 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.756 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.756 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.757 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.757 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.757 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.757 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.757 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.757 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.757 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.757 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.757 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.757 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.757 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.757 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.757 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.758 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.758 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.758 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.758 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.758 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.758 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.758 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.758 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.758 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.758 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.758 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.758 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.758 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.759 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.759 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.759 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.759 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.759 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.759 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.759 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.759 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.759 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-19T06:24:41.759 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-19T06:24:41.759 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.759 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.760 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.760 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-19T06:24:41.760 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.760 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.760 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.760 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.760 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.760 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.760 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.760 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.760 INFO:teuthology.orchestra.run.smithi003.stdout: "threshold": { 2024-09-19T06:24:41.760 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "threshold", 2024-09-19T06:24:41.760 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-19T06:24:41.760 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.761 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.761 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "3.0", 2024-09-19T06:24:41.761 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1.0", 2024-09-19T06:24:41.761 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.761 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.761 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "scaling threshold", 2024-09-19T06:24:41.761 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T06:24:41.761 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.761 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.761 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.761 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.761 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.761 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.762 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "progress", 2024-09-19T06:24:41.762 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.762 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.762 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.762 INFO:teuthology.orchestra.run.smithi003.stdout: "allow_pg_recovery_event": { 2024-09-19T06:24:41.762 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "allow_pg_recovery_event", 2024-09-19T06:24:41.762 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.762 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.762 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.762 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.762 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.762 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.762 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.763 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T06:24:41.763 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.763 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.763 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.763 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.763 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": { 2024-09-19T06:24:41.763 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "enabled", 2024-09-19T06:24:41.763 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.763 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.763 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.763 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.763 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.763 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.763 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.763 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.764 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.764 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.764 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.764 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.764 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.764 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.764 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.764 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.764 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.764 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.764 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.764 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.764 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.765 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.765 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.765 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.765 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.765 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.765 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.765 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.765 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.765 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.765 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.765 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.765 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.765 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.765 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.766 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.766 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.766 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.766 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.766 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.766 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.766 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.766 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.766 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.766 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.766 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.766 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.766 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.766 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.767 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.767 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.767 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.767 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.767 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.767 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.767 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.767 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.767 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.767 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.767 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.767 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.767 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.767 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.768 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.768 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.768 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.768 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.768 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.768 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.768 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.768 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.768 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.768 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.768 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.768 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.769 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.769 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.769 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.769 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.769 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.769 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.769 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.769 INFO:teuthology.orchestra.run.smithi003.stdout: "max_completed_events": { 2024-09-19T06:24:41.769 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_completed_events", 2024-09-19T06:24:41.769 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.769 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.769 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.770 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "50", 2024-09-19T06:24:41.770 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.770 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.770 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.770 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "number of past completed events to remember", 2024-09-19T06:24:41.770 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.770 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.770 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.770 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.770 INFO:teuthology.orchestra.run.smithi003.stdout: "sleep_interval": { 2024-09-19T06:24:41.770 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "sleep_interval", 2024-09-19T06:24:41.770 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.770 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.771 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.771 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-19T06:24:41.771 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.771 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.771 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.771 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "how long the module is going to sleep", 2024-09-19T06:24:41.771 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.771 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.771 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.771 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.771 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.771 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.771 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.772 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "prometheus", 2024-09-19T06:24:41.772 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.772 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.772 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.772 INFO:teuthology.orchestra.run.smithi003.stdout: "cache": { 2024-09-19T06:24:41.772 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "cache", 2024-09-19T06:24:41.772 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.772 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.772 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.772 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.772 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.772 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.772 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.773 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.773 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.773 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.773 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.773 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.773 INFO:teuthology.orchestra.run.smithi003.stdout: "exclude_perf_counters": { 2024-09-19T06:24:41.773 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "exclude_perf_counters", 2024-09-19T06:24:41.773 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.773 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.773 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.773 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.773 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.773 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.774 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.774 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T06:24:41.774 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T06:24:41.774 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.774 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.774 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.774 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.774 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.774 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.774 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.774 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.774 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.774 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.775 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.775 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.775 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.775 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.775 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.775 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.775 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.775 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.775 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.775 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.775 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.775 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.775 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.776 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.776 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.776 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.776 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.776 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.776 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.776 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.776 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.776 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.776 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.776 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.776 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.776 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.777 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.777 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.777 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.777 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.777 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.777 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.777 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.777 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.777 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.777 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.777 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.777 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.777 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.778 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.778 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.778 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.778 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.778 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.778 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.778 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.778 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.778 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.778 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.778 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.778 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.778 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.779 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.779 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.779 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.779 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.779 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.779 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.779 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.779 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.779 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.779 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.779 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.779 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_stats_pools": { 2024-09-19T06:24:41.779 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rbd_stats_pools", 2024-09-19T06:24:41.779 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.780 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.780 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.780 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.780 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.780 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.780 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.780 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.780 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.780 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.780 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.780 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.780 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T06:24:41.780 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T06:24:41.781 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.781 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.781 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.781 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "300", 2024-09-19T06:24:41.781 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.781 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.781 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.781 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.781 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.781 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.781 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.781 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.782 INFO:teuthology.orchestra.run.smithi003.stdout: "scrape_interval": { 2024-09-19T06:24:41.782 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "scrape_interval", 2024-09-19T06:24:41.782 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-19T06:24:41.782 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.782 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.782 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "15.0", 2024-09-19T06:24:41.782 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.782 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.782 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.782 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.782 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.782 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.782 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.782 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.783 INFO:teuthology.orchestra.run.smithi003.stdout: "server_addr": { 2024-09-19T06:24:41.783 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_addr", 2024-09-19T06:24:41.783 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.783 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.783 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.783 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "::", 2024-09-19T06:24:41.783 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.783 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.783 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.783 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T06:24:41.783 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.783 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.783 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.783 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.784 INFO:teuthology.orchestra.run.smithi003.stdout: "server_port": { 2024-09-19T06:24:41.784 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_port", 2024-09-19T06:24:41.784 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.784 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.784 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.784 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "9283", 2024-09-19T06:24:41.784 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.784 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.784 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.784 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T06:24:41.784 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.784 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.784 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.785 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.785 INFO:teuthology.orchestra.run.smithi003.stdout: "stale_cache_strategy": { 2024-09-19T06:24:41.785 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "stale_cache_strategy", 2024-09-19T06:24:41.785 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.785 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.785 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.785 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "log", 2024-09-19T06:24:41.785 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.785 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.785 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.785 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.785 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.785 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.786 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.786 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.786 INFO:teuthology.orchestra.run.smithi003.stdout: "standby_behaviour": { 2024-09-19T06:24:41.786 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "standby_behaviour", 2024-09-19T06:24:41.786 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.786 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.786 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.786 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "default", 2024-09-19T06:24:41.786 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.786 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.786 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.786 INFO:teuthology.orchestra.run.smithi003.stdout: "default", 2024-09-19T06:24:41.786 INFO:teuthology.orchestra.run.smithi003.stdout: "error" 2024-09-19T06:24:41.787 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.787 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.787 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.787 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.787 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.787 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.787 INFO:teuthology.orchestra.run.smithi003.stdout: "standby_error_status_code": { 2024-09-19T06:24:41.787 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "standby_error_status_code", 2024-09-19T06:24:41.787 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.787 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.787 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.787 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "500", 2024-09-19T06:24:41.787 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "400", 2024-09-19T06:24:41.788 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "599", 2024-09-19T06:24:41.788 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.788 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.788 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.788 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.788 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.788 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.788 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.788 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.788 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.788 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rbd_support", 2024-09-19T06:24:41.788 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.788 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.789 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.789 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.789 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.789 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.789 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.789 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.789 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.789 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.789 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.789 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.789 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.789 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.789 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.789 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.790 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.790 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.790 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.790 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.790 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.790 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.790 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.790 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.790 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.790 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.790 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.790 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.790 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.791 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.791 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.791 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.791 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.791 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.791 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.791 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.791 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.791 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.791 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.791 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.791 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.791 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.792 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.792 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.792 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.792 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.792 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.792 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.792 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.792 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.792 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.792 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.792 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.792 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.792 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.793 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.793 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.793 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.793 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.793 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.793 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.793 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.793 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.793 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.793 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.793 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.793 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.793 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.793 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.794 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.794 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.794 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.794 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.794 INFO:teuthology.orchestra.run.smithi003.stdout: "max_concurrent_snap_create": { 2024-09-19T06:24:41.794 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_concurrent_snap_create", 2024-09-19T06:24:41.794 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.794 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.794 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.794 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10", 2024-09-19T06:24:41.794 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.794 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.794 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.795 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.795 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.795 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.795 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.795 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.795 INFO:teuthology.orchestra.run.smithi003.stdout: "mirror_snapshot_schedule": { 2024-09-19T06:24:41.795 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T06:24:41.795 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.795 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.795 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.795 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.795 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.795 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.796 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.796 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.796 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.796 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.796 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.796 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.796 INFO:teuthology.orchestra.run.smithi003.stdout: "trash_purge_schedule": { 2024-09-19T06:24:41.796 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "trash_purge_schedule", 2024-09-19T06:24:41.796 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.796 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.796 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.796 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.796 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.797 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.797 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.797 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.797 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.797 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.797 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.797 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.797 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.797 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.797 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.797 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "restful", 2024-09-19T06:24:41.797 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.797 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.798 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.798 INFO:teuthology.orchestra.run.smithi003.stdout: "enable_auth": { 2024-09-19T06:24:41.798 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "enable_auth", 2024-09-19T06:24:41.798 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.798 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.798 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.798 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.798 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.798 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.798 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.798 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.798 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.799 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.799 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.799 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.799 INFO:teuthology.orchestra.run.smithi003.stdout: "key_file": { 2024-09-19T06:24:41.799 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "key_file", 2024-09-19T06:24:41.799 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.799 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.799 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.799 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.799 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.799 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.799 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.799 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.800 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.800 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.800 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.800 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.800 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.800 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.800 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.800 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.800 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.800 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.800 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.800 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.800 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.801 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.801 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.801 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.801 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.801 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.801 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.801 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.801 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.801 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.801 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.801 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.801 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.801 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.802 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.802 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.802 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.802 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.802 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.802 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.802 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.802 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.802 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.802 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.802 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.802 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.802 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.803 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.803 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.803 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.803 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.803 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.803 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.803 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.803 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.803 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.803 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.803 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.803 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.803 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.803 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.804 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.804 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.804 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.804 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.804 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.804 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.804 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.804 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.804 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.804 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.804 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.804 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.805 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.805 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.805 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.805 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.805 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.805 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.805 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.805 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.805 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.805 INFO:teuthology.orchestra.run.smithi003.stdout: "server_addr": { 2024-09-19T06:24:41.805 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_addr", 2024-09-19T06:24:41.805 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.805 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.806 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.806 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.806 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.806 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.806 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.806 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.806 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.806 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.806 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.806 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.806 INFO:teuthology.orchestra.run.smithi003.stdout: "server_port": { 2024-09-19T06:24:41.806 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "server_port", 2024-09-19T06:24:41.806 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.807 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.807 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.807 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.807 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.807 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.807 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.807 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.807 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.807 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.807 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.807 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.807 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.807 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.808 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.808 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rgw", 2024-09-19T06:24:41.808 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.808 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.808 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.808 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.808 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.808 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.808 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.808 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.808 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.808 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.808 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.809 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.809 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.809 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.809 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.809 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.809 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.809 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.809 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.809 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.809 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.809 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.809 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.809 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.810 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.810 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.810 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.810 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.810 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.810 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.810 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.810 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.810 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.810 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.810 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.810 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.810 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.811 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.811 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.811 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.811 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.811 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.811 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.811 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.811 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.811 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.811 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.811 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.811 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.812 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.812 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.812 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.812 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.812 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.812 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.812 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.812 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.812 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.812 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.812 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.812 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.812 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.813 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.813 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.813 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.813 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.813 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.813 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.813 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.813 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.813 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.813 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.813 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.813 INFO:teuthology.orchestra.run.smithi003.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T06:24:41.814 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T06:24:41.814 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.814 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.814 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.814 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "5", 2024-09-19T06:24:41.814 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.814 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.814 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.814 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T06:24:41.814 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.814 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.814 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.814 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.815 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.815 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.815 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.815 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rook", 2024-09-19T06:24:41.815 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.815 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.815 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.815 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.815 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.815 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.815 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.815 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.815 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.816 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.816 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.816 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.816 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.816 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.816 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.816 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.816 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.816 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.816 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.816 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.816 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.816 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.816 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.817 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.817 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.817 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.817 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.817 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.817 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.817 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.817 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.817 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.817 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.817 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.818 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.818 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.818 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.818 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.818 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.818 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.818 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.818 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.818 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.818 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.818 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.818 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.818 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.819 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.819 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.819 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.819 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.819 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.819 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.819 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.819 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.819 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.819 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.819 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.819 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.819 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.820 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.820 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.820 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.820 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.820 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.820 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.820 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.820 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.820 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.820 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.820 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.820 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.820 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.820 INFO:teuthology.orchestra.run.smithi003.stdout: "storage_class": { 2024-09-19T06:24:41.821 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "storage_class", 2024-09-19T06:24:41.821 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.821 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.821 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.821 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "local", 2024-09-19T06:24:41.821 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.821 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.821 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.821 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T06:24:41.821 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.821 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.821 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.821 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.822 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.822 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.822 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.822 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "selftest", 2024-09-19T06:24:41.822 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.822 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.822 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.822 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.822 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.822 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.822 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.822 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.823 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.823 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.823 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.823 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.823 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.823 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.823 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.823 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.823 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.823 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.823 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.823 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.823 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.824 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.824 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.824 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.824 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.824 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.824 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.824 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.824 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.824 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.824 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.824 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.824 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.825 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.825 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.825 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.825 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.825 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.825 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.825 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.825 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.825 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.825 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.825 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.825 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.825 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.826 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.826 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.826 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.826 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.826 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.826 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.826 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.826 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.826 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.826 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.826 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.826 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.826 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.827 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.827 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.827 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.827 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.827 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.827 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.827 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.827 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.827 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.827 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.827 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.827 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.827 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.828 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.828 INFO:teuthology.orchestra.run.smithi003.stdout: "roption1": { 2024-09-19T06:24:41.828 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "roption1", 2024-09-19T06:24:41.828 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.828 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.828 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.828 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.828 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.828 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.828 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.828 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.828 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.829 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.829 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.829 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.829 INFO:teuthology.orchestra.run.smithi003.stdout: "roption2": { 2024-09-19T06:24:41.829 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "roption2", 2024-09-19T06:24:41.829 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.829 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.829 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.829 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "xyz", 2024-09-19T06:24:41.829 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.829 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.829 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.829 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.830 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.830 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.830 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.830 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.830 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption1": { 2024-09-19T06:24:41.830 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption1", 2024-09-19T06:24:41.830 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.830 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.830 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.830 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.830 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.830 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.830 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.831 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.831 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.831 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.831 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.831 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.831 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption2": { 2024-09-19T06:24:41.831 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption2", 2024-09-19T06:24:41.831 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.831 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.831 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.831 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.831 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.831 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.832 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.832 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.832 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.832 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.832 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.832 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.832 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption3": { 2024-09-19T06:24:41.832 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption3", 2024-09-19T06:24:41.832 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "float", 2024-09-19T06:24:41.832 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.832 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.832 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.832 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.833 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.833 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.833 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.833 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.833 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.833 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.833 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.833 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption4": { 2024-09-19T06:24:41.833 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption4", 2024-09-19T06:24:41.833 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.833 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.833 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.833 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.834 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.834 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.834 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.834 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.834 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.834 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.834 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.834 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.834 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption5": { 2024-09-19T06:24:41.834 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption5", 2024-09-19T06:24:41.834 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.834 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.834 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.835 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.835 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.835 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.835 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.835 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.835 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.835 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.835 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.835 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.835 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption6": { 2024-09-19T06:24:41.835 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption6", 2024-09-19T06:24:41.835 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.835 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.836 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.836 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.836 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.836 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.836 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.836 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.836 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.836 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.836 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.836 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.836 INFO:teuthology.orchestra.run.smithi003.stdout: "rwoption7": { 2024-09-19T06:24:41.836 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rwoption7", 2024-09-19T06:24:41.836 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.837 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.837 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.837 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.837 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "1", 2024-09-19T06:24:41.837 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "42", 2024-09-19T06:24:41.837 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.837 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.837 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.837 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.837 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.837 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.837 INFO:teuthology.orchestra.run.smithi003.stdout: "testkey": { 2024-09-19T06:24:41.837 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "testkey", 2024-09-19T06:24:41.837 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.838 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.838 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.838 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.838 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.838 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.838 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.838 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.838 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.838 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.838 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.838 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.838 INFO:teuthology.orchestra.run.smithi003.stdout: "testlkey": { 2024-09-19T06:24:41.838 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "testlkey", 2024-09-19T06:24:41.839 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.839 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.839 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.839 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.839 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.839 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.839 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.839 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.839 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.839 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.839 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.839 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.839 INFO:teuthology.orchestra.run.smithi003.stdout: "testnewline": { 2024-09-19T06:24:41.840 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "testnewline", 2024-09-19T06:24:41.840 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.840 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.840 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.840 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.840 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.840 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.840 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.840 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.840 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.840 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.840 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.840 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.841 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.841 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.841 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.841 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "snap_schedule", 2024-09-19T06:24:41.841 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.841 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.841 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.841 INFO:teuthology.orchestra.run.smithi003.stdout: "allow_m_granularity": { 2024-09-19T06:24:41.841 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "allow_m_granularity", 2024-09-19T06:24:41.841 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.841 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.841 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.841 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.841 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.842 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.842 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.842 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T06:24:41.842 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.842 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.842 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.842 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.842 INFO:teuthology.orchestra.run.smithi003.stdout: "dump_on_update": { 2024-09-19T06:24:41.842 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "dump_on_update", 2024-09-19T06:24:41.842 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.842 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.842 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.843 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.843 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.843 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.843 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.843 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "dump database to debug log on update", 2024-09-19T06:24:41.843 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.843 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.843 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.843 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.843 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.843 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.843 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.843 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.843 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.844 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.844 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.844 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.844 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.844 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.844 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.844 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.844 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.844 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.844 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.844 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.844 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.845 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.845 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.845 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.845 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.845 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.845 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.845 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.845 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.845 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.845 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.845 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.845 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.845 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.845 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.846 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.846 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.846 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.846 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.846 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.846 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.846 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.846 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.846 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.846 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.846 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.846 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.846 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.847 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.847 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.847 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.847 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.847 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.847 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.847 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.847 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.847 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.847 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.847 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.847 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.847 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.847 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.848 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.848 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.848 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.848 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.848 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.848 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.848 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.848 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.848 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.848 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.848 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.848 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.848 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.848 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.849 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.849 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "stats", 2024-09-19T06:24:41.849 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.849 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.849 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.849 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.849 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.849 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.849 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.849 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.849 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.849 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.850 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.850 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.850 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.850 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.850 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.850 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.850 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.850 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.850 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.850 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.850 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.850 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.850 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.851 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.851 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.851 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.851 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.851 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.851 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.851 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.851 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.851 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.851 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.851 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.851 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.851 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.852 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.852 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.852 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.852 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.852 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.852 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.852 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.852 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.852 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.852 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.852 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.852 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.852 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.853 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.853 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.853 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.853 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.853 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.853 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.853 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.853 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.853 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.853 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.853 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.853 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.853 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.853 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.854 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.854 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.854 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.854 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.854 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.854 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.854 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.854 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.854 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.854 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.854 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.854 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.854 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.854 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "status", 2024-09-19T06:24:41.855 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.855 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.855 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.855 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.855 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.855 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.855 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.855 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.855 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.855 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.855 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.855 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.855 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.855 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.856 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.856 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.856 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.856 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.856 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.856 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.856 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.856 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.856 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.856 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.856 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.856 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.856 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.857 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.857 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.857 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.857 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.857 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.857 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.857 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.857 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.857 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.857 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.857 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.857 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.857 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.857 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.858 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.858 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.858 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.858 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.858 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.858 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.858 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.858 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.858 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.858 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.858 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.858 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.858 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.859 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.859 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.859 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.859 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.859 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.859 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.859 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.859 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.859 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.859 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.859 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.859 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.859 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.859 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.860 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.860 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.860 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.860 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.860 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.860 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.860 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.860 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.860 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "telegraf", 2024-09-19T06:24:41.860 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.860 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.860 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.860 INFO:teuthology.orchestra.run.smithi003.stdout: "address": { 2024-09-19T06:24:41.861 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "address", 2024-09-19T06:24:41.861 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.861 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.861 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.861 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T06:24:41.861 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.861 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.861 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.861 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.861 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.861 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.861 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.861 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.862 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-19T06:24:41.862 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-19T06:24:41.862 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.862 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.862 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.862 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "15", 2024-09-19T06:24:41.862 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.862 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.862 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.862 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.862 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.862 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.863 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.863 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.863 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.863 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.863 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.863 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.863 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.863 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.863 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.863 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.863 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.863 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.863 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.863 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.864 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.864 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.864 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.864 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.864 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.864 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.864 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.864 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.864 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.864 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.864 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.864 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.865 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.865 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.865 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.865 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.865 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.865 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.865 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.865 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.865 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.865 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.865 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.865 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.865 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.865 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.866 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.866 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.866 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.866 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.866 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.866 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.866 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.866 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.866 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.866 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.866 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.866 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.866 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.867 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.867 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.867 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.867 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.867 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.867 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.867 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.867 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.867 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.867 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.867 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.867 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.867 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.867 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.868 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.868 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.868 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.868 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.868 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.868 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.868 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.868 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.868 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "telemetry", 2024-09-19T06:24:41.868 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.868 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.868 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.868 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_basic": { 2024-09-19T06:24:41.869 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_basic", 2024-09-19T06:24:41.869 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.869 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.869 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.869 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.869 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.869 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.869 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.869 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T06:24:41.869 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.869 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.869 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.870 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.870 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_crash": { 2024-09-19T06:24:41.870 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_crash", 2024-09-19T06:24:41.870 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.870 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.870 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.870 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.870 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.870 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.870 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.870 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T06:24:41.870 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.870 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.870 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.871 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.871 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_device": { 2024-09-19T06:24:41.871 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_device", 2024-09-19T06:24:41.871 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.871 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.871 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.871 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.871 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.871 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.871 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.871 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T06:24:41.871 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.871 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.872 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.872 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.872 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_ident": { 2024-09-19T06:24:41.872 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_ident", 2024-09-19T06:24:41.872 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.872 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.872 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.872 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.872 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.872 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.872 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.872 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T06:24:41.872 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.873 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.873 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.873 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.873 INFO:teuthology.orchestra.run.smithi003.stdout: "channel_perf": { 2024-09-19T06:24:41.873 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "channel_perf", 2024-09-19T06:24:41.873 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.873 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.873 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.873 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.873 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.873 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.873 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.873 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T06:24:41.874 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.874 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.874 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.874 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.874 INFO:teuthology.orchestra.run.smithi003.stdout: "contact": { 2024-09-19T06:24:41.874 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "contact", 2024-09-19T06:24:41.874 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.874 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.874 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.874 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.874 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.874 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.874 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.875 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.875 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.875 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.875 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.875 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.875 INFO:teuthology.orchestra.run.smithi003.stdout: "description": { 2024-09-19T06:24:41.875 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "description", 2024-09-19T06:24:41.875 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.875 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.875 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.875 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.875 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.875 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.875 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.876 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.876 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.876 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.876 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.876 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.876 INFO:teuthology.orchestra.run.smithi003.stdout: "device_url": { 2024-09-19T06:24:41.876 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "device_url", 2024-09-19T06:24:41.876 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.876 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.876 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.876 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T06:24:41.876 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.876 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.877 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.877 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.877 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.877 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.877 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.877 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.877 INFO:teuthology.orchestra.run.smithi003.stdout: "enabled": { 2024-09-19T06:24:41.877 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "enabled", 2024-09-19T06:24:41.877 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.877 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.877 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.877 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.877 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.878 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.878 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.878 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.878 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.878 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.878 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.878 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.878 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-19T06:24:41.878 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-19T06:24:41.878 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.878 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.878 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.878 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "24", 2024-09-19T06:24:41.879 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "8", 2024-09-19T06:24:41.879 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.879 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.879 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.879 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.879 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.879 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.879 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.879 INFO:teuthology.orchestra.run.smithi003.stdout: "last_opt_revision": { 2024-09-19T06:24:41.879 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "last_opt_revision", 2024-09-19T06:24:41.879 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.879 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.879 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.880 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "1", 2024-09-19T06:24:41.880 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.880 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.880 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.880 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.880 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.880 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.880 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.880 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.880 INFO:teuthology.orchestra.run.smithi003.stdout: "leaderboard": { 2024-09-19T06:24:41.880 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "leaderboard", 2024-09-19T06:24:41.880 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.880 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.881 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.881 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.881 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.881 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.881 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.881 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.881 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.881 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.881 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.881 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.881 INFO:teuthology.orchestra.run.smithi003.stdout: "leaderboard_description": { 2024-09-19T06:24:41.881 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "leaderboard_description", 2024-09-19T06:24:41.882 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.882 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.882 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.882 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.882 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.882 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.882 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.882 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.882 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.882 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.882 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.882 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.882 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.883 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.883 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.883 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.883 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.883 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.883 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.883 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.883 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.883 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.883 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.883 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.883 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.883 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.884 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.884 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.884 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.884 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.884 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.884 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.884 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.884 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.884 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.884 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.884 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.884 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.885 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.885 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.885 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.885 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.885 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.885 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.885 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.885 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.885 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.885 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.885 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.885 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.885 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.886 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.886 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.886 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.886 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.886 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.886 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.886 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.886 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.886 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.886 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.886 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.886 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.886 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.886 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.887 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.887 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.887 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.887 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.887 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.887 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.887 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.887 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.887 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.887 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.887 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.887 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.887 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.888 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.888 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.888 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.888 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.888 INFO:teuthology.orchestra.run.smithi003.stdout: "organization": { 2024-09-19T06:24:41.888 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "organization", 2024-09-19T06:24:41.888 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.888 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.888 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.888 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.888 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.888 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.888 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.888 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.889 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.889 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.889 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.889 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.889 INFO:teuthology.orchestra.run.smithi003.stdout: "proxy": { 2024-09-19T06:24:41.889 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "proxy", 2024-09-19T06:24:41.889 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.889 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.889 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.889 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.889 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.889 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.889 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.890 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.890 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.890 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.890 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.890 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.890 INFO:teuthology.orchestra.run.smithi003.stdout: "url": { 2024-09-19T06:24:41.890 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "url", 2024-09-19T06:24:41.890 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.890 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.890 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.890 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T06:24:41.890 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.890 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.891 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.891 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.891 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.891 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.891 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.891 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.891 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.891 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.891 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.891 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "test_orchestrator", 2024-09-19T06:24:41.891 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.891 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.891 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.892 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.892 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.892 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.892 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.892 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.892 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.892 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.892 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.892 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.892 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.892 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.892 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.892 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.893 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.893 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.893 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.893 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.893 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.893 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.893 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.893 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.893 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.893 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.893 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.893 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.894 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.894 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.894 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.894 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.894 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.894 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.894 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.894 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.894 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.894 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.894 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.894 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.894 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.895 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.895 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.895 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.895 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.895 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.895 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.895 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.895 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.895 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.895 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.895 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.895 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.895 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.896 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.896 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.896 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.896 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.896 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.896 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.896 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.896 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.896 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.896 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.896 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.896 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.897 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.897 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.897 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.897 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.897 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.897 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.897 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.897 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.897 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.897 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.897 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "volumes", 2024-09-19T06:24:41.897 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.897 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.898 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.898 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.898 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.898 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.898 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.898 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.898 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.898 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.898 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.898 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.898 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.898 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.898 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.899 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.899 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.899 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.899 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.899 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.899 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.899 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.899 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.899 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.899 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.899 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.899 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.899 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.900 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.900 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.900 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.900 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.900 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.900 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.900 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.900 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.900 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.900 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.900 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.900 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.900 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.901 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.901 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.901 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.901 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.901 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.901 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.901 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.901 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.901 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.901 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.901 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.901 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.902 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.902 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.902 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.902 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.902 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.902 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.902 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.902 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.902 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.902 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.902 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.902 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.902 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.903 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.903 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.903 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.903 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.903 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.903 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.903 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.903 INFO:teuthology.orchestra.run.smithi003.stdout: "max_concurrent_clones": { 2024-09-19T06:24:41.903 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "max_concurrent_clones", 2024-09-19T06:24:41.903 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.903 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.903 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.903 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "4", 2024-09-19T06:24:41.904 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.904 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.904 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.904 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T06:24:41.904 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.904 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.904 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.904 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.904 INFO:teuthology.orchestra.run.smithi003.stdout: "periodic_async_work": { 2024-09-19T06:24:41.904 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "periodic_async_work", 2024-09-19T06:24:41.904 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.904 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.905 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.905 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.905 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.905 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.905 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.905 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Periodically check for async work", 2024-09-19T06:24:41.905 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.905 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.905 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.905 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.905 INFO:teuthology.orchestra.run.smithi003.stdout: "snapshot_clone_delay": { 2024-09-19T06:24:41.905 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "snapshot_clone_delay", 2024-09-19T06:24:41.905 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.906 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.906 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.906 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "0", 2024-09-19T06:24:41.906 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.906 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.906 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.906 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T06:24:41.906 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.906 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.906 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.906 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.906 INFO:teuthology.orchestra.run.smithi003.stdout: "snapshot_clone_no_wait": { 2024-09-19T06:24:41.906 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T06:24:41.907 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.907 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.907 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.907 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "True", 2024-09-19T06:24:41.907 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.907 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.907 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.907 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T06:24:41.907 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.907 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.907 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.907 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.908 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.908 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.908 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.908 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "zabbix", 2024-09-19T06:24:41.908 INFO:teuthology.orchestra.run.smithi003.stdout: "can_run": true, 2024-09-19T06:24:41.908 INFO:teuthology.orchestra.run.smithi003.stdout: "error_string": "", 2024-09-19T06:24:41.908 INFO:teuthology.orchestra.run.smithi003.stdout: "module_options": { 2024-09-19T06:24:41.908 INFO:teuthology.orchestra.run.smithi003.stdout: "discovery_interval": { 2024-09-19T06:24:41.908 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "discovery_interval", 2024-09-19T06:24:41.908 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "uint", 2024-09-19T06:24:41.908 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.908 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.908 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "100", 2024-09-19T06:24:41.908 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.909 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.909 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.909 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.909 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.909 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.909 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.909 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.909 INFO:teuthology.orchestra.run.smithi003.stdout: "identifier": { 2024-09-19T06:24:41.909 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "identifier", 2024-09-19T06:24:41.909 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.909 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.909 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.909 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.910 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.910 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.910 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.910 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.910 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.910 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.910 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.910 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.910 INFO:teuthology.orchestra.run.smithi003.stdout: "interval": { 2024-09-19T06:24:41.910 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "interval", 2024-09-19T06:24:41.910 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "secs", 2024-09-19T06:24:41.910 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.910 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.910 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "60", 2024-09-19T06:24:41.911 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.911 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.911 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.911 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.911 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.911 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.911 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.911 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.911 INFO:teuthology.orchestra.run.smithi003.stdout: "log_level": { 2024-09-19T06:24:41.911 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_level", 2024-09-19T06:24:41.911 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.911 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.911 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.911 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.912 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.912 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.912 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.912 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.912 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.912 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.912 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.912 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.912 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.912 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.912 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.912 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.912 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.913 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.913 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.913 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster": { 2024-09-19T06:24:41.913 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster", 2024-09-19T06:24:41.913 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.913 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.913 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.913 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.913 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.913 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.913 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.913 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.914 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.914 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.914 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.914 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.914 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_cluster_level": { 2024-09-19T06:24:41.914 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_cluster_level", 2024-09-19T06:24:41.914 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.914 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.914 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.914 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "info", 2024-09-19T06:24:41.914 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.914 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.914 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [ 2024-09-19T06:24:41.914 INFO:teuthology.orchestra.run.smithi003.stdout: "", 2024-09-19T06:24:41.915 INFO:teuthology.orchestra.run.smithi003.stdout: "critical", 2024-09-19T06:24:41.915 INFO:teuthology.orchestra.run.smithi003.stdout: "debug", 2024-09-19T06:24:41.915 INFO:teuthology.orchestra.run.smithi003.stdout: "error", 2024-09-19T06:24:41.915 INFO:teuthology.orchestra.run.smithi003.stdout: "info", 2024-09-19T06:24:41.915 INFO:teuthology.orchestra.run.smithi003.stdout: "warning" 2024-09-19T06:24:41.915 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.915 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.915 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.915 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.915 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.915 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.915 INFO:teuthology.orchestra.run.smithi003.stdout: "log_to_file": { 2024-09-19T06:24:41.915 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "log_to_file", 2024-09-19T06:24:41.916 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "bool", 2024-09-19T06:24:41.916 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.916 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 1, 2024-09-19T06:24:41.916 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "False", 2024-09-19T06:24:41.916 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.916 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.916 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.916 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.916 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.916 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.916 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.916 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.916 INFO:teuthology.orchestra.run.smithi003.stdout: "zabbix_host": { 2024-09-19T06:24:41.916 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "zabbix_host", 2024-09-19T06:24:41.917 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.917 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.917 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.917 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "", 2024-09-19T06:24:41.917 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.917 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.917 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.917 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.917 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.917 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.917 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.917 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.917 INFO:teuthology.orchestra.run.smithi003.stdout: "zabbix_port": { 2024-09-19T06:24:41.918 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "zabbix_port", 2024-09-19T06:24:41.918 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "int", 2024-09-19T06:24:41.918 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.918 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.918 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "10051", 2024-09-19T06:24:41.918 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.918 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.918 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.918 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.918 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.918 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.918 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.918 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.918 INFO:teuthology.orchestra.run.smithi003.stdout: "zabbix_sender": { 2024-09-19T06:24:41.919 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "zabbix_sender", 2024-09-19T06:24:41.919 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "str", 2024-09-19T06:24:41.919 INFO:teuthology.orchestra.run.smithi003.stdout: "level": "advanced", 2024-09-19T06:24:41.919 INFO:teuthology.orchestra.run.smithi003.stdout: "flags": 0, 2024-09-19T06:24:41.919 INFO:teuthology.orchestra.run.smithi003.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T06:24:41.919 INFO:teuthology.orchestra.run.smithi003.stdout: "min": "", 2024-09-19T06:24:41.919 INFO:teuthology.orchestra.run.smithi003.stdout: "max": "", 2024-09-19T06:24:41.919 INFO:teuthology.orchestra.run.smithi003.stdout: "enum_allowed": [], 2024-09-19T06:24:41.919 INFO:teuthology.orchestra.run.smithi003.stdout: "desc": "", 2024-09-19T06:24:41.919 INFO:teuthology.orchestra.run.smithi003.stdout: "long_desc": "", 2024-09-19T06:24:41.919 INFO:teuthology.orchestra.run.smithi003.stdout: "tags": [], 2024-09-19T06:24:41.919 INFO:teuthology.orchestra.run.smithi003.stdout: "see_also": [] 2024-09-19T06:24:41.920 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.920 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.920 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.920 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.920 INFO:teuthology.orchestra.run.smithi003.stdout: "services": { 2024-09-19T06:24:41.920 INFO:teuthology.orchestra.run.smithi003.stdout: "dashboard": "https://172.21.15.3:8443/" 2024-09-19T06:24:41.920 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.920 INFO:teuthology.orchestra.run.smithi003.stdout: "always_on_modules": { 2024-09-19T06:24:41.920 INFO:teuthology.orchestra.run.smithi003.stdout: "octopus": [ 2024-09-19T06:24:41.920 INFO:teuthology.orchestra.run.smithi003.stdout: "balancer", 2024-09-19T06:24:41.920 INFO:teuthology.orchestra.run.smithi003.stdout: "crash", 2024-09-19T06:24:41.920 INFO:teuthology.orchestra.run.smithi003.stdout: "devicehealth", 2024-09-19T06:24:41.920 INFO:teuthology.orchestra.run.smithi003.stdout: "orchestrator", 2024-09-19T06:24:41.920 INFO:teuthology.orchestra.run.smithi003.stdout: "pg_autoscaler", 2024-09-19T06:24:41.921 INFO:teuthology.orchestra.run.smithi003.stdout: "progress", 2024-09-19T06:24:41.921 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_support", 2024-09-19T06:24:41.921 INFO:teuthology.orchestra.run.smithi003.stdout: "status", 2024-09-19T06:24:41.921 INFO:teuthology.orchestra.run.smithi003.stdout: "telemetry", 2024-09-19T06:24:41.921 INFO:teuthology.orchestra.run.smithi003.stdout: "volumes" 2024-09-19T06:24:41.921 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.921 INFO:teuthology.orchestra.run.smithi003.stdout: "pacific": [ 2024-09-19T06:24:41.921 INFO:teuthology.orchestra.run.smithi003.stdout: "balancer", 2024-09-19T06:24:41.921 INFO:teuthology.orchestra.run.smithi003.stdout: "crash", 2024-09-19T06:24:41.921 INFO:teuthology.orchestra.run.smithi003.stdout: "devicehealth", 2024-09-19T06:24:41.921 INFO:teuthology.orchestra.run.smithi003.stdout: "orchestrator", 2024-09-19T06:24:41.921 INFO:teuthology.orchestra.run.smithi003.stdout: "pg_autoscaler", 2024-09-19T06:24:41.921 INFO:teuthology.orchestra.run.smithi003.stdout: "progress", 2024-09-19T06:24:41.922 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_support", 2024-09-19T06:24:41.922 INFO:teuthology.orchestra.run.smithi003.stdout: "status", 2024-09-19T06:24:41.922 INFO:teuthology.orchestra.run.smithi003.stdout: "telemetry", 2024-09-19T06:24:41.922 INFO:teuthology.orchestra.run.smithi003.stdout: "volumes" 2024-09-19T06:24:41.922 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.922 INFO:teuthology.orchestra.run.smithi003.stdout: "quincy": [ 2024-09-19T06:24:41.922 INFO:teuthology.orchestra.run.smithi003.stdout: "balancer", 2024-09-19T06:24:41.922 INFO:teuthology.orchestra.run.smithi003.stdout: "crash", 2024-09-19T06:24:41.922 INFO:teuthology.orchestra.run.smithi003.stdout: "devicehealth", 2024-09-19T06:24:41.922 INFO:teuthology.orchestra.run.smithi003.stdout: "orchestrator", 2024-09-19T06:24:41.922 INFO:teuthology.orchestra.run.smithi003.stdout: "pg_autoscaler", 2024-09-19T06:24:41.922 INFO:teuthology.orchestra.run.smithi003.stdout: "progress", 2024-09-19T06:24:41.922 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_support", 2024-09-19T06:24:41.922 INFO:teuthology.orchestra.run.smithi003.stdout: "status", 2024-09-19T06:24:41.923 INFO:teuthology.orchestra.run.smithi003.stdout: "telemetry", 2024-09-19T06:24:41.923 INFO:teuthology.orchestra.run.smithi003.stdout: "volumes" 2024-09-19T06:24:41.923 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.923 INFO:teuthology.orchestra.run.smithi003.stdout: "reef": [ 2024-09-19T06:24:41.923 INFO:teuthology.orchestra.run.smithi003.stdout: "balancer", 2024-09-19T06:24:41.923 INFO:teuthology.orchestra.run.smithi003.stdout: "crash", 2024-09-19T06:24:41.923 INFO:teuthology.orchestra.run.smithi003.stdout: "devicehealth", 2024-09-19T06:24:41.923 INFO:teuthology.orchestra.run.smithi003.stdout: "orchestrator", 2024-09-19T06:24:41.923 INFO:teuthology.orchestra.run.smithi003.stdout: "pg_autoscaler", 2024-09-19T06:24:41.923 INFO:teuthology.orchestra.run.smithi003.stdout: "progress", 2024-09-19T06:24:41.923 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_support", 2024-09-19T06:24:41.923 INFO:teuthology.orchestra.run.smithi003.stdout: "status", 2024-09-19T06:24:41.923 INFO:teuthology.orchestra.run.smithi003.stdout: "telemetry", 2024-09-19T06:24:41.924 INFO:teuthology.orchestra.run.smithi003.stdout: "volumes" 2024-09-19T06:24:41.924 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-19T06:24:41.924 INFO:teuthology.orchestra.run.smithi003.stdout: "squid": [ 2024-09-19T06:24:41.924 INFO:teuthology.orchestra.run.smithi003.stdout: "balancer", 2024-09-19T06:24:41.924 INFO:teuthology.orchestra.run.smithi003.stdout: "crash", 2024-09-19T06:24:41.924 INFO:teuthology.orchestra.run.smithi003.stdout: "devicehealth", 2024-09-19T06:24:41.924 INFO:teuthology.orchestra.run.smithi003.stdout: "orchestrator", 2024-09-19T06:24:41.924 INFO:teuthology.orchestra.run.smithi003.stdout: "pg_autoscaler", 2024-09-19T06:24:41.924 INFO:teuthology.orchestra.run.smithi003.stdout: "progress", 2024-09-19T06:24:41.924 INFO:teuthology.orchestra.run.smithi003.stdout: "rbd_support", 2024-09-19T06:24:41.924 INFO:teuthology.orchestra.run.smithi003.stdout: "status", 2024-09-19T06:24:41.924 INFO:teuthology.orchestra.run.smithi003.stdout: "telemetry", 2024-09-19T06:24:41.924 INFO:teuthology.orchestra.run.smithi003.stdout: "volumes" 2024-09-19T06:24:41.925 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-19T06:24:41.925 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.925 INFO:teuthology.orchestra.run.smithi003.stdout: "last_failure_osd_epoch": 89, 2024-09-19T06:24:41.925 INFO:teuthology.orchestra.run.smithi003.stdout: "active_clients": [ 2024-09-19T06:24:41.925 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.925 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "devicehealth", 2024-09-19T06:24:41.925 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2024-09-19T06:24:41.925 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.925 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v2", 2024-09-19T06:24:41.925 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:0", 2024-09-19T06:24:41.925 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 1954865956 2024-09-19T06:24:41.925 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.926 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-19T06:24:41.926 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.926 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.926 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "libcephsqlite", 2024-09-19T06:24:41.926 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2024-09-19T06:24:41.926 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.926 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v2", 2024-09-19T06:24:41.926 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:0", 2024-09-19T06:24:41.926 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 715316784 2024-09-19T06:24:41.926 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.926 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-19T06:24:41.926 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.926 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.926 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "rbd_support", 2024-09-19T06:24:41.926 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2024-09-19T06:24:41.927 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.927 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v2", 2024-09-19T06:24:41.927 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:0", 2024-09-19T06:24:41.927 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 3336218893 2024-09-19T06:24:41.927 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.927 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-19T06:24:41.927 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.927 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.927 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "snap_schedule", 2024-09-19T06:24:41.927 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2024-09-19T06:24:41.927 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.927 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v2", 2024-09-19T06:24:41.927 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:0", 2024-09-19T06:24:41.928 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 3834898870 2024-09-19T06:24:41.928 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.928 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-19T06:24:41.928 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.928 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.928 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "snap_schedule", 2024-09-19T06:24:41.928 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2024-09-19T06:24:41.928 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.928 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v2", 2024-09-19T06:24:41.928 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:0", 2024-09-19T06:24:41.928 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 3836945694 2024-09-19T06:24:41.928 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.928 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-19T06:24:41.929 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:41.929 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.929 INFO:teuthology.orchestra.run.smithi003.stdout: "name": "volumes", 2024-09-19T06:24:41.929 INFO:teuthology.orchestra.run.smithi003.stdout: "addrvec": [ 2024-09-19T06:24:41.929 INFO:teuthology.orchestra.run.smithi003.stdout: { 2024-09-19T06:24:41.929 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v2", 2024-09-19T06:24:41.929 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "172.21.15.3:0", 2024-09-19T06:24:41.929 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 3839260014 2024-09-19T06:24:41.929 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.929 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-19T06:24:41.929 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:41.929 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-19T06:24:41.929 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:24:41.931 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:41 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/3705857348' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:24:41.931 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:41 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1472025544' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T06:24:41.931 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:41 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/3705857348' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:24:41.931 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:41 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1472025544' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T06:24:41.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.546+0000 7fb169200640 1 -- 172.21.15.3:0/1472025544 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb1480a3440 msgr2=0x7fb1480a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:41.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.546+0000 7fb169200640 1 --2- 172.21.15.3:0/1472025544 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb1480a3440 0x7fb1480a5900 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb154009cd0 tx=0x7fb154005f90 comp rx=0 tx=0).stop 2024-09-19T06:24:41.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.546+0000 7fb169200640 1 -- 172.21.15.3:0/1472025544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb16419eeb0 msgr2=0x7fb16419f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:24:41.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.546+0000 7fb169200640 1 --2- 172.21.15.3:0/1472025544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb16419eeb0 0x7fb16419f360 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb15c009fd0 tx=0x7fb15c00ef10 comp rx=0 tx=0).stop 2024-09-19T06:24:41.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.546+0000 7fb169200640 1 -- 172.21.15.3:0/1472025544 shutdown_connections 2024-09-19T06:24:41.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.546+0000 7fb169200640 1 --2- 172.21.15.3:0/1472025544 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fb1480a3440 0x7fb1480a5900 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:41.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.546+0000 7fb169200640 1 --2- 172.21.15.3:0/1472025544 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb16419eeb0 0x7fb16419f360 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:41.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.546+0000 7fb169200640 1 --2- 172.21.15.3:0/1472025544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb164109070 0x7fb16419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:41.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.546+0000 7fb169200640 1 --2- 172.21.15.3:0/1472025544 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fb164103f20 0x7fb16419a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:24:41.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.546+0000 7fb169200640 1 -- 172.21.15.3:0/1472025544 >> 172.21.15.3:0/1472025544 conn(0x7fb1640ff950 msgr2=0x7fb164100cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:24:41.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.547+0000 7fb169200640 1 -- 172.21.15.3:0/1472025544 shutdown_connections 2024-09-19T06:24:41.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:24:40.547+0000 7fb169200640 1 -- 172.21.15.3:0/1472025544 wait complete. 2024-09-19T06:24:41.987 DEBUG:tasks.check_counter:Getting stats from a 2024-09-19T06:24:41.988 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-19T06:24:41.988 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:41 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3705857348' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T06:24:41.988 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:41 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1472025544' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T06:24:42.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:42 smithi059 ceph-mon[35138]: pgmap v384: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:24:42.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:42 smithi003 ceph-mon[30893]: pgmap v384: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:24:42.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:42 smithi071 ceph-mon[35662]: pgmap v384: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:24:42.378 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:43.024 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:24:43.024 INFO:teuthology.orchestra.run.smithi003.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:24:43.024 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_messages": 1418, 2024-09-19T06:24:43.024 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages": 992, 2024-09-19T06:24:43.024 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_bytes": 399672, 2024-09-19T06:24:43.025 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_bytes": 382673, 2024-09-19T06:24:43.025 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_created_connections": 12, 2024-09-19T06:24:43.025 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_active_connections": 4, 2024-09-19T06:24:43.025 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_total_time": 0.150957539, 2024-09-19T06:24:43.025 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_send_time": 0.061286961, 2024-09-19T06:24:43.025 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_recv_time": 0.091319055, 2024-09-19T06:24:43.025 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_fast_dispatch_time": 0.005598576, 2024-09-19T06:24:43.025 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:43.025 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 991, 2024-09-19T06:24:43.025 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.068543789, 2024-09-19T06:24:43.025 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000069166 2024-09-19T06:24:43.025 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.025 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:43.026 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 2278, 2024-09-19T06:24:43.026 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000552664, 2024-09-19T06:24:43.026 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000242 2024-09-19T06:24:43.026 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.026 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-19T06:24:43.026 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T06:24:43.026 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.026 INFO:teuthology.orchestra.run.smithi003.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:24:43.026 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_messages": 112, 2024-09-19T06:24:43.026 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages": 294, 2024-09-19T06:24:43.026 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_bytes": 32699, 2024-09-19T06:24:43.026 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_bytes": 959250, 2024-09-19T06:24:43.026 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_created_connections": 49, 2024-09-19T06:24:43.026 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_active_connections": 8, 2024-09-19T06:24:43.027 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_total_time": 0.057569649, 2024-09-19T06:24:43.027 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_send_time": 0.021521665, 2024-09-19T06:24:43.027 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_recv_time": 0.029825578, 2024-09-19T06:24:43.027 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_fast_dispatch_time": 0.000220990, 2024-09-19T06:24:43.027 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:43.027 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 291, 2024-09-19T06:24:43.027 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.045098886, 2024-09-19T06:24:43.027 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000154978 2024-09-19T06:24:43.027 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.027 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:43.027 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 164, 2024-09-19T06:24:43.027 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000032267, 2024-09-19T06:24:43.027 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000196 2024-09-19T06:24:43.028 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.028 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_encrypted_bytes": 2176, 2024-09-19T06:24:43.028 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_encrypted_bytes": 487664 2024-09-19T06:24:43.028 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.028 INFO:teuthology.orchestra.run.smithi003.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:24:43.028 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_messages": 385, 2024-09-19T06:24:43.028 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages": 387, 2024-09-19T06:24:43.028 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_bytes": 1816846, 2024-09-19T06:24:43.028 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_bytes": 216842, 2024-09-19T06:24:43.028 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_created_connections": 10, 2024-09-19T06:24:43.028 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_active_connections": 6, 2024-09-19T06:24:43.028 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_total_time": 0.080800087, 2024-09-19T06:24:43.028 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_send_time": 0.033288991, 2024-09-19T06:24:43.028 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_recv_time": 0.066669017, 2024-09-19T06:24:43.029 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_fast_dispatch_time": 0.000661579, 2024-09-19T06:24:43.029 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:43.029 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 386, 2024-09-19T06:24:43.029 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.047810538, 2024-09-19T06:24:43.029 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000123861 2024-09-19T06:24:43.029 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.029 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:43.029 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 147, 2024-09-19T06:24:43.029 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000031041, 2024-09-19T06:24:43.029 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000211 2024-09-19T06:24:43.029 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.029 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_encrypted_bytes": 1789664, 2024-09-19T06:24:43.029 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_encrypted_bytes": 161968 2024-09-19T06:24:43.030 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.030 INFO:teuthology.orchestra.run.smithi003.stdout: "cct": { 2024-09-19T06:24:43.030 INFO:teuthology.orchestra.run.smithi003.stdout: "total_workers": 1, 2024-09-19T06:24:43.030 INFO:teuthology.orchestra.run.smithi003.stdout: "unhealthy_workers": 0 2024-09-19T06:24:43.030 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.030 INFO:teuthology.orchestra.run.smithi003.stdout: "finisher-MDSRank": { 2024-09-19T06:24:43.030 INFO:teuthology.orchestra.run.smithi003.stdout: "queue_len": 0, 2024-09-19T06:24:43.030 INFO:teuthology.orchestra.run.smithi003.stdout: "complete_latency": { 2024-09-19T06:24:43.030 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 53, 2024-09-19T06:24:43.030 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.001595011, 2024-09-19T06:24:43.030 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000030094 2024-09-19T06:24:43.030 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:43.030 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.031 INFO:teuthology.orchestra.run.smithi003.stdout: "finisher-PurgeQueue": { 2024-09-19T06:24:43.031 INFO:teuthology.orchestra.run.smithi003.stdout: "queue_len": 0, 2024-09-19T06:24:43.031 INFO:teuthology.orchestra.run.smithi003.stdout: "complete_latency": { 2024-09-19T06:24:43.031 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 2, 2024-09-19T06:24:43.031 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000027796, 2024-09-19T06:24:43.031 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000013898 2024-09-19T06:24:43.031 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:43.031 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.031 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-19T06:24:43.031 INFO:teuthology.orchestra.run.smithi003.stdout: "request": 0, 2024-09-19T06:24:43.031 INFO:teuthology.orchestra.run.smithi003.stdout: "reply": 0, 2024-09-19T06:24:43.031 INFO:teuthology.orchestra.run.smithi003.stdout: "reply_latency": { 2024-09-19T06:24:43.031 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.031 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.032 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.032 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.032 INFO:teuthology.orchestra.run.smithi003.stdout: "slow_reply": 0, 2024-09-19T06:24:43.032 INFO:teuthology.orchestra.run.smithi003.stdout: "forward": 0, 2024-09-19T06:24:43.032 INFO:teuthology.orchestra.run.smithi003.stdout: "dir_fetch_complete": 0, 2024-09-19T06:24:43.032 INFO:teuthology.orchestra.run.smithi003.stdout: "dir_fetch_keys": 0, 2024-09-19T06:24:43.032 INFO:teuthology.orchestra.run.smithi003.stdout: "dir_commit": 11, 2024-09-19T06:24:43.032 INFO:teuthology.orchestra.run.smithi003.stdout: "dir_split": 0, 2024-09-19T06:24:43.032 INFO:teuthology.orchestra.run.smithi003.stdout: "dir_merge": 0, 2024-09-19T06:24:43.032 INFO:teuthology.orchestra.run.smithi003.stdout: "inodes": 16, 2024-09-19T06:24:43.032 INFO:teuthology.orchestra.run.smithi003.stdout: "inodes_top": 0, 2024-09-19T06:24:43.032 INFO:teuthology.orchestra.run.smithi003.stdout: "inodes_bottom": 16, 2024-09-19T06:24:43.032 INFO:teuthology.orchestra.run.smithi003.stdout: "inodes_pin_tail": 0, 2024-09-19T06:24:43.033 INFO:teuthology.orchestra.run.smithi003.stdout: "inodes_pinned": 13, 2024-09-19T06:24:43.033 INFO:teuthology.orchestra.run.smithi003.stdout: "inodes_expired": 4, 2024-09-19T06:24:43.033 INFO:teuthology.orchestra.run.smithi003.stdout: "inodes_with_caps": 0, 2024-09-19T06:24:43.033 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": 0, 2024-09-19T06:24:43.033 INFO:teuthology.orchestra.run.smithi003.stdout: "subtrees": 3, 2024-09-19T06:24:43.033 INFO:teuthology.orchestra.run.smithi003.stdout: "traverse": 7, 2024-09-19T06:24:43.033 INFO:teuthology.orchestra.run.smithi003.stdout: "traverse_hit": 4, 2024-09-19T06:24:43.033 INFO:teuthology.orchestra.run.smithi003.stdout: "traverse_forward": 0, 2024-09-19T06:24:43.033 INFO:teuthology.orchestra.run.smithi003.stdout: "traverse_discover": 3, 2024-09-19T06:24:43.033 INFO:teuthology.orchestra.run.smithi003.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:24:43.033 INFO:teuthology.orchestra.run.smithi003.stdout: "traverse_remote_ino": 0, 2024-09-19T06:24:43.033 INFO:teuthology.orchestra.run.smithi003.stdout: "traverse_lock": 0, 2024-09-19T06:24:43.033 INFO:teuthology.orchestra.run.smithi003.stdout: "load_cent": 0, 2024-09-19T06:24:43.033 INFO:teuthology.orchestra.run.smithi003.stdout: "q": 0, 2024-09-19T06:24:43.034 INFO:teuthology.orchestra.run.smithi003.stdout: "exported": 0, 2024-09-19T06:24:43.034 INFO:teuthology.orchestra.run.smithi003.stdout: "exported_inodes": 0, 2024-09-19T06:24:43.034 INFO:teuthology.orchestra.run.smithi003.stdout: "imported": 0, 2024-09-19T06:24:43.034 INFO:teuthology.orchestra.run.smithi003.stdout: "imported_inodes": 0, 2024-09-19T06:24:43.034 INFO:teuthology.orchestra.run.smithi003.stdout: "openino_dir_fetch": 0, 2024-09-19T06:24:43.034 INFO:teuthology.orchestra.run.smithi003.stdout: "openino_backtrace_fetch": 0, 2024-09-19T06:24:43.034 INFO:teuthology.orchestra.run.smithi003.stdout: "openino_peer_discover": 0, 2024-09-19T06:24:43.034 INFO:teuthology.orchestra.run.smithi003.stdout: "root_rfiles": 5, 2024-09-19T06:24:43.034 INFO:teuthology.orchestra.run.smithi003.stdout: "root_rbytes": 298, 2024-09-19T06:24:43.034 INFO:teuthology.orchestra.run.smithi003.stdout: "root_rsnaps": 6, 2024-09-19T06:24:43.034 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T06:24:43.034 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_set_tag": 0, 2024-09-19T06:24:43.034 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:24:43.034 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:24:43.035 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:24:43.035 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:24:43.035 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:24:43.035 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_file_inodes": 0, 2024-09-19T06:24:43.035 INFO:teuthology.orchestra.run.smithi003.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:24:43.035 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T06:24:43.035 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_cap_op_grant": 0, 2024-09-19T06:24:43.035 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:24:43.035 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:24:43.035 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:24:43.035 INFO:teuthology.orchestra.run.smithi003.stdout: "handle_client_caps": 0, 2024-09-19T06:24:43.035 INFO:teuthology.orchestra.run.smithi003.stdout: "handle_client_caps_dirty": 0, 2024-09-19T06:24:43.035 INFO:teuthology.orchestra.run.smithi003.stdout: "handle_client_cap_release": 0, 2024-09-19T06:24:43.035 INFO:teuthology.orchestra.run.smithi003.stdout: "process_request_cap_release": 0 2024-09-19T06:24:43.036 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.036 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_cache": { 2024-09-19T06:24:43.036 INFO:teuthology.orchestra.run.smithi003.stdout: "dir_update": 0, 2024-09-19T06:24:43.036 INFO:teuthology.orchestra.run.smithi003.stdout: "dir_update_receipt": 11, 2024-09-19T06:24:43.036 INFO:teuthology.orchestra.run.smithi003.stdout: "dir_try_discover": 7, 2024-09-19T06:24:43.036 INFO:teuthology.orchestra.run.smithi003.stdout: "dir_send_discover": 8, 2024-09-19T06:24:43.036 INFO:teuthology.orchestra.run.smithi003.stdout: "dir_handle_discover": 0, 2024-09-19T06:24:43.036 INFO:teuthology.orchestra.run.smithi003.stdout: "num_strays": 0, 2024-09-19T06:24:43.036 INFO:teuthology.orchestra.run.smithi003.stdout: "num_strays_delayed": 0, 2024-09-19T06:24:43.036 INFO:teuthology.orchestra.run.smithi003.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:24:43.036 INFO:teuthology.orchestra.run.smithi003.stdout: "strays_created": 0, 2024-09-19T06:24:43.036 INFO:teuthology.orchestra.run.smithi003.stdout: "strays_enqueued": 0, 2024-09-19T06:24:43.036 INFO:teuthology.orchestra.run.smithi003.stdout: "strays_reintegrated": 0, 2024-09-19T06:24:43.036 INFO:teuthology.orchestra.run.smithi003.stdout: "strays_migrated": 0, 2024-09-19T06:24:43.037 INFO:teuthology.orchestra.run.smithi003.stdout: "num_recovering_processing": 0, 2024-09-19T06:24:43.037 INFO:teuthology.orchestra.run.smithi003.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:24:43.037 INFO:teuthology.orchestra.run.smithi003.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:24:43.037 INFO:teuthology.orchestra.run.smithi003.stdout: "recovery_started": 0, 2024-09-19T06:24:43.037 INFO:teuthology.orchestra.run.smithi003.stdout: "recovery_completed": 0, 2024-09-19T06:24:43.037 INFO:teuthology.orchestra.run.smithi003.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:24:43.037 INFO:teuthology.orchestra.run.smithi003.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:24:43.037 INFO:teuthology.orchestra.run.smithi003.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:24:43.037 INFO:teuthology.orchestra.run.smithi003.stdout: "ireq_exportdir": 0, 2024-09-19T06:24:43.037 INFO:teuthology.orchestra.run.smithi003.stdout: "ireq_flush": 0, 2024-09-19T06:24:43.037 INFO:teuthology.orchestra.run.smithi003.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:24:43.037 INFO:teuthology.orchestra.run.smithi003.stdout: "ireq_fragstats": 0, 2024-09-19T06:24:43.037 INFO:teuthology.orchestra.run.smithi003.stdout: "ireq_inodestats": 0 2024-09-19T06:24:43.037 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.038 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_log": { 2024-09-19T06:24:43.038 INFO:teuthology.orchestra.run.smithi003.stdout: "evlrg": 0, 2024-09-19T06:24:43.038 INFO:teuthology.orchestra.run.smithi003.stdout: "evadd": 7, 2024-09-19T06:24:43.038 INFO:teuthology.orchestra.run.smithi003.stdout: "evex": 0, 2024-09-19T06:24:43.038 INFO:teuthology.orchestra.run.smithi003.stdout: "evtrm": 0, 2024-09-19T06:24:43.038 INFO:teuthology.orchestra.run.smithi003.stdout: "ev": 7, 2024-09-19T06:24:43.038 INFO:teuthology.orchestra.run.smithi003.stdout: "evexg": 0, 2024-09-19T06:24:43.038 INFO:teuthology.orchestra.run.smithi003.stdout: "evexd": 0, 2024-09-19T06:24:43.038 INFO:teuthology.orchestra.run.smithi003.stdout: "segadd": 2, 2024-09-19T06:24:43.038 INFO:teuthology.orchestra.run.smithi003.stdout: "segex": 0, 2024-09-19T06:24:43.038 INFO:teuthology.orchestra.run.smithi003.stdout: "segtrm": 0, 2024-09-19T06:24:43.038 INFO:teuthology.orchestra.run.smithi003.stdout: "seg": 2, 2024-09-19T06:24:43.038 INFO:teuthology.orchestra.run.smithi003.stdout: "segmjr": 2, 2024-09-19T06:24:43.039 INFO:teuthology.orchestra.run.smithi003.stdout: "segexg": 0, 2024-09-19T06:24:43.039 INFO:teuthology.orchestra.run.smithi003.stdout: "segexd": 0, 2024-09-19T06:24:43.039 INFO:teuthology.orchestra.run.smithi003.stdout: "expos": 4194304, 2024-09-19T06:24:43.039 INFO:teuthology.orchestra.run.smithi003.stdout: "wrpos": 4196353, 2024-09-19T06:24:43.039 INFO:teuthology.orchestra.run.smithi003.stdout: "rdpos": 0, 2024-09-19T06:24:43.039 INFO:teuthology.orchestra.run.smithi003.stdout: "jlat": { 2024-09-19T06:24:43.039 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 6, 2024-09-19T06:24:43.039 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.013346967, 2024-09-19T06:24:43.039 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.002224494 2024-09-19T06:24:43.039 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.039 INFO:teuthology.orchestra.run.smithi003.stdout: "replayed": 0 2024-09-19T06:24:43.039 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.039 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_mem": { 2024-09-19T06:24:43.039 INFO:teuthology.orchestra.run.smithi003.stdout: "ino": 20, 2024-09-19T06:24:43.039 INFO:teuthology.orchestra.run.smithi003.stdout: "ino+": 22, 2024-09-19T06:24:43.040 INFO:teuthology.orchestra.run.smithi003.stdout: "ino-": 2, 2024-09-19T06:24:43.040 INFO:teuthology.orchestra.run.smithi003.stdout: "dir": 19, 2024-09-19T06:24:43.040 INFO:teuthology.orchestra.run.smithi003.stdout: "dir+": 23, 2024-09-19T06:24:43.040 INFO:teuthology.orchestra.run.smithi003.stdout: "dir-": 4, 2024-09-19T06:24:43.040 INFO:teuthology.orchestra.run.smithi003.stdout: "dn": 16, 2024-09-19T06:24:43.040 INFO:teuthology.orchestra.run.smithi003.stdout: "dn+": 20, 2024-09-19T06:24:43.040 INFO:teuthology.orchestra.run.smithi003.stdout: "dn-": 4, 2024-09-19T06:24:43.040 INFO:teuthology.orchestra.run.smithi003.stdout: "cap": 0, 2024-09-19T06:24:43.040 INFO:teuthology.orchestra.run.smithi003.stdout: "cap+": 0, 2024-09-19T06:24:43.040 INFO:teuthology.orchestra.run.smithi003.stdout: "cap-": 0, 2024-09-19T06:24:43.040 INFO:teuthology.orchestra.run.smithi003.stdout: "rss": 49688, 2024-09-19T06:24:43.040 INFO:teuthology.orchestra.run.smithi003.stdout: "heap": 223520 2024-09-19T06:24:43.040 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.041 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_server": { 2024-09-19T06:24:43.041 INFO:teuthology.orchestra.run.smithi003.stdout: "dispatch_client_request": 0, 2024-09-19T06:24:43.041 INFO:teuthology.orchestra.run.smithi003.stdout: "dispatch_server_request": 0, 2024-09-19T06:24:43.041 INFO:teuthology.orchestra.run.smithi003.stdout: "handle_client_request": 0, 2024-09-19T06:24:43.041 INFO:teuthology.orchestra.run.smithi003.stdout: "handle_client_session": 18, 2024-09-19T06:24:43.041 INFO:teuthology.orchestra.run.smithi003.stdout: "handle_peer_request": 0, 2024-09-19T06:24:43.041 INFO:teuthology.orchestra.run.smithi003.stdout: "req_create_latency": { 2024-09-19T06:24:43.041 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.041 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.041 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.041 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.041 INFO:teuthology.orchestra.run.smithi003.stdout: "req_getattr_latency": { 2024-09-19T06:24:43.041 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.042 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.042 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.042 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.042 INFO:teuthology.orchestra.run.smithi003.stdout: "req_getfilelock_latency": { 2024-09-19T06:24:43.042 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.042 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.042 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.042 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.042 INFO:teuthology.orchestra.run.smithi003.stdout: "req_link_latency": { 2024-09-19T06:24:43.042 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.042 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.042 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.042 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.042 INFO:teuthology.orchestra.run.smithi003.stdout: "req_lookup_latency": { 2024-09-19T06:24:43.043 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.043 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.043 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.043 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.043 INFO:teuthology.orchestra.run.smithi003.stdout: "req_lookuphash_latency": { 2024-09-19T06:24:43.043 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.043 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.043 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.043 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.043 INFO:teuthology.orchestra.run.smithi003.stdout: "req_lookupino_latency": { 2024-09-19T06:24:43.043 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.043 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.043 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.043 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.044 INFO:teuthology.orchestra.run.smithi003.stdout: "req_lookupname_latency": { 2024-09-19T06:24:43.044 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.044 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.044 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.044 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.044 INFO:teuthology.orchestra.run.smithi003.stdout: "req_lookupparent_latency": { 2024-09-19T06:24:43.044 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.044 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.044 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.044 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.044 INFO:teuthology.orchestra.run.smithi003.stdout: "req_lookupsnap_latency": { 2024-09-19T06:24:43.044 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.044 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.045 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.045 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.045 INFO:teuthology.orchestra.run.smithi003.stdout: "req_lssnap_latency": { 2024-09-19T06:24:43.045 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.045 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.045 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.045 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.045 INFO:teuthology.orchestra.run.smithi003.stdout: "req_mkdir_latency": { 2024-09-19T06:24:43.045 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.046 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.046 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.046 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.046 INFO:teuthology.orchestra.run.smithi003.stdout: "req_mknod_latency": { 2024-09-19T06:24:43.047 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.047 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.047 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.047 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.047 INFO:teuthology.orchestra.run.smithi003.stdout: "req_mksnap_latency": { 2024-09-19T06:24:43.047 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.047 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.047 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.047 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.047 INFO:teuthology.orchestra.run.smithi003.stdout: "req_open_latency": { 2024-09-19T06:24:43.047 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.047 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.048 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.048 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.048 INFO:teuthology.orchestra.run.smithi003.stdout: "req_readdir_latency": { 2024-09-19T06:24:43.048 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.048 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.048 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.048 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.048 INFO:teuthology.orchestra.run.smithi003.stdout: "req_rename_latency": { 2024-09-19T06:24:43.048 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.048 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.048 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.048 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.048 INFO:teuthology.orchestra.run.smithi003.stdout: "req_renamesnap_latency": { 2024-09-19T06:24:43.049 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.049 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.049 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.049 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.049 INFO:teuthology.orchestra.run.smithi003.stdout: "req_snapdiff_latency": { 2024-09-19T06:24:43.049 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.049 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.049 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.049 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.049 INFO:teuthology.orchestra.run.smithi003.stdout: "req_rmdir_latency": { 2024-09-19T06:24:43.049 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.049 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.049 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.049 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.050 INFO:teuthology.orchestra.run.smithi003.stdout: "req_rmsnap_latency": { 2024-09-19T06:24:43.050 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.050 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.050 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.050 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.050 INFO:teuthology.orchestra.run.smithi003.stdout: "req_rmxattr_latency": { 2024-09-19T06:24:43.050 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.050 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.050 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.050 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.050 INFO:teuthology.orchestra.run.smithi003.stdout: "req_setattr_latency": { 2024-09-19T06:24:43.050 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.050 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.050 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.051 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.051 INFO:teuthology.orchestra.run.smithi003.stdout: "req_setdirlayout_latency": { 2024-09-19T06:24:43.051 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.051 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.051 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.051 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.051 INFO:teuthology.orchestra.run.smithi003.stdout: "req_setfilelock_latency": { 2024-09-19T06:24:43.051 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.051 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.051 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.051 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.051 INFO:teuthology.orchestra.run.smithi003.stdout: "req_setlayout_latency": { 2024-09-19T06:24:43.051 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.051 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.052 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.052 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.052 INFO:teuthology.orchestra.run.smithi003.stdout: "req_setxattr_latency": { 2024-09-19T06:24:43.052 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.052 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.052 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.052 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.052 INFO:teuthology.orchestra.run.smithi003.stdout: "req_symlink_latency": { 2024-09-19T06:24:43.052 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.052 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.052 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.052 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.052 INFO:teuthology.orchestra.run.smithi003.stdout: "req_unlink_latency": { 2024-09-19T06:24:43.053 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.053 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.053 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.053 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.053 INFO:teuthology.orchestra.run.smithi003.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:24:43.053 INFO:teuthology.orchestra.run.smithi003.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:24:43.053 INFO:teuthology.orchestra.run.smithi003.stdout: "req_getvxattr_latency": { 2024-09-19T06:24:43.053 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.053 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.053 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.053 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:43.053 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.053 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_sessions": { 2024-09-19T06:24:43.053 INFO:teuthology.orchestra.run.smithi003.stdout: "session_count": 1, 2024-09-19T06:24:43.054 INFO:teuthology.orchestra.run.smithi003.stdout: "session_add": 3, 2024-09-19T06:24:43.054 INFO:teuthology.orchestra.run.smithi003.stdout: "session_remove": 2, 2024-09-19T06:24:43.054 INFO:teuthology.orchestra.run.smithi003.stdout: "sessions_open": 1, 2024-09-19T06:24:43.054 INFO:teuthology.orchestra.run.smithi003.stdout: "sessions_stale": 0, 2024-09-19T06:24:43.054 INFO:teuthology.orchestra.run.smithi003.stdout: "total_load": 0, 2024-09-19T06:24:43.054 INFO:teuthology.orchestra.run.smithi003.stdout: "average_load": 0, 2024-09-19T06:24:43.054 INFO:teuthology.orchestra.run.smithi003.stdout: "avg_session_uptime": 701, 2024-09-19T06:24:43.054 INFO:teuthology.orchestra.run.smithi003.stdout: "mdthresh_evicted": 0 2024-09-19T06:24:43.054 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.054 INFO:teuthology.orchestra.run.smithi003.stdout: "mempool": { 2024-09-19T06:24:43.054 INFO:teuthology.orchestra.run.smithi003.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:24:43.054 INFO:teuthology.orchestra.run.smithi003.stdout: "bloom_filter_items": 0, 2024-09-19T06:24:43.054 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:24:43.054 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:24:43.055 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:24:43.055 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:24:43.055 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:24:43.055 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:24:43.055 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:24:43.055 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:24:43.055 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:24:43.055 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:24:43.055 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:24:43.055 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:24:43.055 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:24:43.055 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_extent_items": 0, 2024-09-19T06:24:43.055 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:24:43.056 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_blob_items": 0, 2024-09-19T06:24:43.056 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:24:43.056 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:24:43.056 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:24:43.056 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:24:43.056 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:24:43.056 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:24:43.056 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:24:43.056 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_txc_items": 0, 2024-09-19T06:24:43.056 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:24:43.056 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:24:43.056 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:24:43.056 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_items": 0, 2024-09-19T06:24:43.057 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_bytes": 0, 2024-09-19T06:24:43.057 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_items": 0, 2024-09-19T06:24:43.057 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:24:43.057 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:24:43.057 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:24:43.057 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:24:43.057 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_anon_bytes": 246663, 2024-09-19T06:24:43.057 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_anon_items": 87, 2024-09-19T06:24:43.057 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:24:43.057 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_meta_items": 0, 2024-09-19T06:24:43.057 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_bytes": 0, 2024-09-19T06:24:43.057 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_items": 0, 2024-09-19T06:24:43.057 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:24:43.057 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mapbl_items": 0, 2024-09-19T06:24:43.058 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:24:43.058 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pglog_items": 0, 2024-09-19T06:24:43.058 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_bytes": 8320, 2024-09-19T06:24:43.058 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_items": 183, 2024-09-19T06:24:43.058 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:24:43.058 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:24:43.058 INFO:teuthology.orchestra.run.smithi003.stdout: "pgmap_bytes": 0, 2024-09-19T06:24:43.058 INFO:teuthology.orchestra.run.smithi003.stdout: "pgmap_items": 0, 2024-09-19T06:24:43.058 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_co_bytes": 86309, 2024-09-19T06:24:43.058 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_co_items": 329, 2024-09-19T06:24:43.058 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_1_bytes": 0, 2024-09-19T06:24:43.058 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_1_items": 0, 2024-09-19T06:24:43.058 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_2_bytes": 0, 2024-09-19T06:24:43.058 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_2_items": 0 2024-09-19T06:24:43.059 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.059 INFO:teuthology.orchestra.run.smithi003.stdout: "objecter": { 2024-09-19T06:24:43.059 INFO:teuthology.orchestra.run.smithi003.stdout: "op_active": 0, 2024-09-19T06:24:43.059 INFO:teuthology.orchestra.run.smithi003.stdout: "op_laggy": 0, 2024-09-19T06:24:43.059 INFO:teuthology.orchestra.run.smithi003.stdout: "op_send": 44, 2024-09-19T06:24:43.059 INFO:teuthology.orchestra.run.smithi003.stdout: "op_send_bytes": 12531, 2024-09-19T06:24:43.059 INFO:teuthology.orchestra.run.smithi003.stdout: "op_resend": 29, 2024-09-19T06:24:43.059 INFO:teuthology.orchestra.run.smithi003.stdout: "op_reply": 44, 2024-09-19T06:24:43.059 INFO:teuthology.orchestra.run.smithi003.stdout: "op_latency": { 2024-09-19T06:24:43.059 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 44, 2024-09-19T06:24:43.059 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.252996710, 2024-09-19T06:24:43.059 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.005749925 2024-09-19T06:24:43.059 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.060 INFO:teuthology.orchestra.run.smithi003.stdout: "op_inflight": 0, 2024-09-19T06:24:43.060 INFO:teuthology.orchestra.run.smithi003.stdout: "oplen_avg": { 2024-09-19T06:24:43.060 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 44, 2024-09-19T06:24:43.060 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 66 2024-09-19T06:24:43.060 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.060 INFO:teuthology.orchestra.run.smithi003.stdout: "op": 44, 2024-09-19T06:24:43.060 INFO:teuthology.orchestra.run.smithi003.stdout: "op_r": 0, 2024-09-19T06:24:43.060 INFO:teuthology.orchestra.run.smithi003.stdout: "op_w": 44, 2024-09-19T06:24:43.060 INFO:teuthology.orchestra.run.smithi003.stdout: "op_rmw": 0, 2024-09-19T06:24:43.060 INFO:teuthology.orchestra.run.smithi003.stdout: "op_pg": 0, 2024-09-19T06:24:43.060 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_stat": 0, 2024-09-19T06:24:43.060 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_create": 10, 2024-09-19T06:24:43.060 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_read": 0, 2024-09-19T06:24:43.060 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_write": 6, 2024-09-19T06:24:43.061 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_writefull": 9, 2024-09-19T06:24:43.061 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_writesame": 0, 2024-09-19T06:24:43.061 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_append": 0, 2024-09-19T06:24:43.061 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_zero": 0, 2024-09-19T06:24:43.061 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_truncate": 0, 2024-09-19T06:24:43.061 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_delete": 6, 2024-09-19T06:24:43.061 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_mapext": 0, 2024-09-19T06:24:43.061 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_sparse_read": 0, 2024-09-19T06:24:43.061 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_clonerange": 0, 2024-09-19T06:24:43.061 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_getxattr": 0, 2024-09-19T06:24:43.061 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_setxattr": 20, 2024-09-19T06:24:43.061 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:24:43.061 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_rmxattr": 0, 2024-09-19T06:24:43.061 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:24:43.062 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_call": 0, 2024-09-19T06:24:43.062 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_watch": 0, 2024-09-19T06:24:43.062 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_notify": 0, 2024-09-19T06:24:43.062 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:24:43.062 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_pgls": 0, 2024-09-19T06:24:43.062 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:24:43.062 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_other": 0, 2024-09-19T06:24:43.062 INFO:teuthology.orchestra.run.smithi003.stdout: "linger_active": 0, 2024-09-19T06:24:43.062 INFO:teuthology.orchestra.run.smithi003.stdout: "linger_send": 0, 2024-09-19T06:24:43.062 INFO:teuthology.orchestra.run.smithi003.stdout: "linger_resend": 0, 2024-09-19T06:24:43.062 INFO:teuthology.orchestra.run.smithi003.stdout: "linger_ping": 0, 2024-09-19T06:24:43.062 INFO:teuthology.orchestra.run.smithi003.stdout: "poolop_active": 0, 2024-09-19T06:24:43.062 INFO:teuthology.orchestra.run.smithi003.stdout: "poolop_send": 0, 2024-09-19T06:24:43.062 INFO:teuthology.orchestra.run.smithi003.stdout: "poolop_resend": 0, 2024-09-19T06:24:43.063 INFO:teuthology.orchestra.run.smithi003.stdout: "poolstat_active": 0, 2024-09-19T06:24:43.063 INFO:teuthology.orchestra.run.smithi003.stdout: "poolstat_send": 0, 2024-09-19T06:24:43.063 INFO:teuthology.orchestra.run.smithi003.stdout: "poolstat_resend": 0, 2024-09-19T06:24:43.063 INFO:teuthology.orchestra.run.smithi003.stdout: "statfs_active": 0, 2024-09-19T06:24:43.063 INFO:teuthology.orchestra.run.smithi003.stdout: "statfs_send": 0, 2024-09-19T06:24:43.063 INFO:teuthology.orchestra.run.smithi003.stdout: "statfs_resend": 0, 2024-09-19T06:24:43.063 INFO:teuthology.orchestra.run.smithi003.stdout: "command_active": 0, 2024-09-19T06:24:43.063 INFO:teuthology.orchestra.run.smithi003.stdout: "command_send": 0, 2024-09-19T06:24:43.063 INFO:teuthology.orchestra.run.smithi003.stdout: "command_resend": 0, 2024-09-19T06:24:43.063 INFO:teuthology.orchestra.run.smithi003.stdout: "map_epoch": 101, 2024-09-19T06:24:43.063 INFO:teuthology.orchestra.run.smithi003.stdout: "map_full": 0, 2024-09-19T06:24:43.063 INFO:teuthology.orchestra.run.smithi003.stdout: "map_inc": 15, 2024-09-19T06:24:43.063 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_sessions": 9, 2024-09-19T06:24:43.063 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_session_open": 9, 2024-09-19T06:24:43.064 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_session_close": 0, 2024-09-19T06:24:43.064 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_laggy": 0, 2024-09-19T06:24:43.064 INFO:teuthology.orchestra.run.smithi003.stdout: "omap_wr": 14, 2024-09-19T06:24:43.064 INFO:teuthology.orchestra.run.smithi003.stdout: "omap_rd": 0, 2024-09-19T06:24:43.064 INFO:teuthology.orchestra.run.smithi003.stdout: "omap_del": 1 2024-09-19T06:24:43.064 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.064 INFO:teuthology.orchestra.run.smithi003.stdout: "oft": { 2024-09-19T06:24:43.064 INFO:teuthology.orchestra.run.smithi003.stdout: "omap_total_objs": 1, 2024-09-19T06:24:43.064 INFO:teuthology.orchestra.run.smithi003.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:24:43.064 INFO:teuthology.orchestra.run.smithi003.stdout: "omap_total_updates": 0, 2024-09-19T06:24:43.064 INFO:teuthology.orchestra.run.smithi003.stdout: "omap_total_removes": 0 2024-09-19T06:24:43.064 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.064 INFO:teuthology.orchestra.run.smithi003.stdout: "osd-slow-ops": { 2024-09-19T06:24:43.065 INFO:teuthology.orchestra.run.smithi003.stdout: "slow_ops_count": 0 2024-09-19T06:24:43.065 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.065 INFO:teuthology.orchestra.run.smithi003.stdout: "purge_queue": { 2024-09-19T06:24:43.065 INFO:teuthology.orchestra.run.smithi003.stdout: "pq_executing_ops": 0, 2024-09-19T06:24:43.065 INFO:teuthology.orchestra.run.smithi003.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T06:24:43.065 INFO:teuthology.orchestra.run.smithi003.stdout: "pq_executing": 0, 2024-09-19T06:24:43.065 INFO:teuthology.orchestra.run.smithi003.stdout: "pq_executing_high_water": 0, 2024-09-19T06:24:43.065 INFO:teuthology.orchestra.run.smithi003.stdout: "pq_executed_ops": 0, 2024-09-19T06:24:43.065 INFO:teuthology.orchestra.run.smithi003.stdout: "pq_executed": 0, 2024-09-19T06:24:43.065 INFO:teuthology.orchestra.run.smithi003.stdout: "pq_item_in_journal": 0 2024-09-19T06:24:43.065 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.065 INFO:teuthology.orchestra.run.smithi003.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:24:43.065 INFO:teuthology.orchestra.run.smithi003.stdout: "val": 0, 2024-09-19T06:24:43.065 INFO:teuthology.orchestra.run.smithi003.stdout: "max": 104857600, 2024-09-19T06:24:43.066 INFO:teuthology.orchestra.run.smithi003.stdout: "get_started": 0, 2024-09-19T06:24:43.066 INFO:teuthology.orchestra.run.smithi003.stdout: "get": 1911, 2024-09-19T06:24:43.066 INFO:teuthology.orchestra.run.smithi003.stdout: "get_sum": 2058138, 2024-09-19T06:24:43.066 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:43.066 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_success": 1911, 2024-09-19T06:24:43.066 INFO:teuthology.orchestra.run.smithi003.stdout: "take": 0, 2024-09-19T06:24:43.066 INFO:teuthology.orchestra.run.smithi003.stdout: "take_sum": 0, 2024-09-19T06:24:43.066 INFO:teuthology.orchestra.run.smithi003.stdout: "put": 1911, 2024-09-19T06:24:43.066 INFO:teuthology.orchestra.run.smithi003.stdout: "put_sum": 2058138, 2024-09-19T06:24:43.066 INFO:teuthology.orchestra.run.smithi003.stdout: "wait": { 2024-09-19T06:24:43.066 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.066 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.066 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.067 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:43.067 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.067 INFO:teuthology.orchestra.run.smithi003.stdout: "throttle-objecter_bytes": { 2024-09-19T06:24:43.067 INFO:teuthology.orchestra.run.smithi003.stdout: "val": 0, 2024-09-19T06:24:43.067 INFO:teuthology.orchestra.run.smithi003.stdout: "max": 104857600, 2024-09-19T06:24:43.067 INFO:teuthology.orchestra.run.smithi003.stdout: "get_started": 0, 2024-09-19T06:24:43.067 INFO:teuthology.orchestra.run.smithi003.stdout: "get": 0, 2024-09-19T06:24:43.067 INFO:teuthology.orchestra.run.smithi003.stdout: "get_sum": 0, 2024-09-19T06:24:43.067 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:43.067 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:43.067 INFO:teuthology.orchestra.run.smithi003.stdout: "take": 44, 2024-09-19T06:24:43.067 INFO:teuthology.orchestra.run.smithi003.stdout: "take_sum": 12531, 2024-09-19T06:24:43.067 INFO:teuthology.orchestra.run.smithi003.stdout: "put": 44, 2024-09-19T06:24:43.067 INFO:teuthology.orchestra.run.smithi003.stdout: "put_sum": 12531, 2024-09-19T06:24:43.067 INFO:teuthology.orchestra.run.smithi003.stdout: "wait": { 2024-09-19T06:24:43.068 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.068 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.068 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.068 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:43.068 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.068 INFO:teuthology.orchestra.run.smithi003.stdout: "throttle-objecter_ops": { 2024-09-19T06:24:43.068 INFO:teuthology.orchestra.run.smithi003.stdout: "val": 0, 2024-09-19T06:24:43.068 INFO:teuthology.orchestra.run.smithi003.stdout: "max": 1024, 2024-09-19T06:24:43.068 INFO:teuthology.orchestra.run.smithi003.stdout: "get_started": 0, 2024-09-19T06:24:43.068 INFO:teuthology.orchestra.run.smithi003.stdout: "get": 0, 2024-09-19T06:24:43.068 INFO:teuthology.orchestra.run.smithi003.stdout: "get_sum": 0, 2024-09-19T06:24:43.068 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:43.069 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:43.069 INFO:teuthology.orchestra.run.smithi003.stdout: "take": 44, 2024-09-19T06:24:43.069 INFO:teuthology.orchestra.run.smithi003.stdout: "take_sum": 44, 2024-09-19T06:24:43.069 INFO:teuthology.orchestra.run.smithi003.stdout: "put": 44, 2024-09-19T06:24:43.069 INFO:teuthology.orchestra.run.smithi003.stdout: "put_sum": 44, 2024-09-19T06:24:43.069 INFO:teuthology.orchestra.run.smithi003.stdout: "wait": { 2024-09-19T06:24:43.069 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.069 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.069 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.069 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:43.069 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.069 INFO:teuthology.orchestra.run.smithi003.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:24:43.069 INFO:teuthology.orchestra.run.smithi003.stdout: "val": 0, 2024-09-19T06:24:43.069 INFO:teuthology.orchestra.run.smithi003.stdout: "max": 3758096384, 2024-09-19T06:24:43.070 INFO:teuthology.orchestra.run.smithi003.stdout: "get_started": 0, 2024-09-19T06:24:43.070 INFO:teuthology.orchestra.run.smithi003.stdout: "get": 0, 2024-09-19T06:24:43.070 INFO:teuthology.orchestra.run.smithi003.stdout: "get_sum": 0, 2024-09-19T06:24:43.070 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:43.070 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:43.070 INFO:teuthology.orchestra.run.smithi003.stdout: "take": 0, 2024-09-19T06:24:43.070 INFO:teuthology.orchestra.run.smithi003.stdout: "take_sum": 0, 2024-09-19T06:24:43.070 INFO:teuthology.orchestra.run.smithi003.stdout: "put": 0, 2024-09-19T06:24:43.070 INFO:teuthology.orchestra.run.smithi003.stdout: "put_sum": 0, 2024-09-19T06:24:43.070 INFO:teuthology.orchestra.run.smithi003.stdout: "wait": { 2024-09-19T06:24:43.070 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.070 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.070 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.070 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:43.071 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:43.071 INFO:teuthology.orchestra.run.smithi003.stdout: "throttle-write_buf_throttle-0x55ae1af88500": { 2024-09-19T06:24:43.071 INFO:teuthology.orchestra.run.smithi003.stdout: "val": 0, 2024-09-19T06:24:43.071 INFO:teuthology.orchestra.run.smithi003.stdout: "max": 3758096384, 2024-09-19T06:24:43.071 INFO:teuthology.orchestra.run.smithi003.stdout: "get_started": 0, 2024-09-19T06:24:43.071 INFO:teuthology.orchestra.run.smithi003.stdout: "get": 7, 2024-09-19T06:24:43.071 INFO:teuthology.orchestra.run.smithi003.stdout: "get_sum": 2049, 2024-09-19T06:24:43.071 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:43.071 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_success": 7, 2024-09-19T06:24:43.071 INFO:teuthology.orchestra.run.smithi003.stdout: "take": 0, 2024-09-19T06:24:43.071 INFO:teuthology.orchestra.run.smithi003.stdout: "take_sum": 0, 2024-09-19T06:24:43.071 INFO:teuthology.orchestra.run.smithi003.stdout: "put": 6, 2024-09-19T06:24:43.071 INFO:teuthology.orchestra.run.smithi003.stdout: "put_sum": 2049, 2024-09-19T06:24:43.071 INFO:teuthology.orchestra.run.smithi003.stdout: "wait": { 2024-09-19T06:24:43.072 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:43.072 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:43.072 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:43.072 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:43.072 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:43.072 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:24:44.018 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-19T06:24:44.019 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-19T06:24:44.019 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-09-19T06:24:44.019 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=11 2024-09-19T06:24:44.019 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=6 2024-09-19T06:24:44.019 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:24:44.019 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:24:44.019 DEBUG:tasks.check_counter:Getting stats from d 2024-09-19T06:24:44.019 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-19T06:24:44.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:44 smithi059 ceph-mon[35138]: pgmap v385: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:24:44.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:44 smithi003 ceph-mon[30893]: pgmap v385: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:24:44.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:44 smithi071 ceph-mon[35662]: pgmap v385: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:24:44.397 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:45.055 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:24:45.056 INFO:teuthology.orchestra.run.smithi003.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:24:45.056 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_messages": 0, 2024-09-19T06:24:45.056 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages": 2, 2024-09-19T06:24:45.056 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_bytes": 0, 2024-09-19T06:24:45.056 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_bytes": 0, 2024-09-19T06:24:45.056 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_created_connections": 4, 2024-09-19T06:24:45.056 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_active_connections": 0, 2024-09-19T06:24:45.056 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_total_time": 0.003552564, 2024-09-19T06:24:45.056 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T06:24:45.056 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_recv_time": 0.000613237, 2024-09-19T06:24:45.056 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:24:45.056 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:45.057 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:45.057 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:45.057 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:45.057 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:45.057 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:45.057 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:45.057 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:45.057 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:45.057 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:45.057 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:24:45.057 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:24:45.057 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:45.058 INFO:teuthology.orchestra.run.smithi003.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:24:45.058 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_messages": 263, 2024-09-19T06:24:45.058 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages": 249, 2024-09-19T06:24:45.058 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_bytes": 1738576, 2024-09-19T06:24:45.058 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_bytes": 152528, 2024-09-19T06:24:45.058 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_created_connections": 2, 2024-09-19T06:24:45.058 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_active_connections": 1, 2024-09-19T06:24:45.058 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_total_time": 0.063192020, 2024-09-19T06:24:45.058 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_send_time": 0.024416058, 2024-09-19T06:24:45.058 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_recv_time": 0.056842891, 2024-09-19T06:24:45.058 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:24:45.058 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:45.058 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 249, 2024-09-19T06:24:45.059 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.023794644, 2024-09-19T06:24:45.059 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000095560 2024-09-19T06:24:45.059 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:45.059 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:45.059 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:45.059 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:45.059 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:45.059 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:45.059 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_encrypted_bytes": 1738576, 2024-09-19T06:24:45.059 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_encrypted_bytes": 152528 2024-09-19T06:24:45.059 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:45.059 INFO:teuthology.orchestra.run.smithi003.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:24:45.059 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_messages": 2, 2024-09-19T06:24:45.059 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages": 189, 2024-09-19T06:24:45.060 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_bytes": 320, 2024-09-19T06:24:45.060 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_bytes": 190496, 2024-09-19T06:24:45.060 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_created_connections": 5, 2024-09-19T06:24:45.060 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_active_connections": 3, 2024-09-19T06:24:45.060 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_total_time": 0.024389276, 2024-09-19T06:24:45.060 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_send_time": 0.018020417, 2024-09-19T06:24:45.060 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_recv_time": 0.002732165, 2024-09-19T06:24:45.060 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:24:45.060 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:45.060 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 186, 2024-09-19T06:24:45.060 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.025631371, 2024-09-19T06:24:45.060 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000137803 2024-09-19T06:24:45.060 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:45.061 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:45.061 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:45.061 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:45.061 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:45.061 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:45.061 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:24:45.061 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_encrypted_bytes": 190496 2024-09-19T06:24:45.061 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:45.061 INFO:teuthology.orchestra.run.smithi003.stdout: "cct": { 2024-09-19T06:24:45.061 INFO:teuthology.orchestra.run.smithi003.stdout: "total_workers": 0, 2024-09-19T06:24:45.061 INFO:teuthology.orchestra.run.smithi003.stdout: "unhealthy_workers": 0 2024-09-19T06:24:45.061 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:45.061 INFO:teuthology.orchestra.run.smithi003.stdout: "mempool": { 2024-09-19T06:24:45.062 INFO:teuthology.orchestra.run.smithi003.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:24:45.062 INFO:teuthology.orchestra.run.smithi003.stdout: "bloom_filter_items": 0, 2024-09-19T06:24:45.062 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:24:45.062 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:24:45.062 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:24:45.062 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:24:45.062 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:24:45.062 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:24:45.062 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:24:45.062 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:24:45.062 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:24:45.062 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:24:45.062 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:24:45.063 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:24:45.063 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:24:45.063 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_extent_items": 0, 2024-09-19T06:24:45.063 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:24:45.063 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_blob_items": 0, 2024-09-19T06:24:45.063 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:24:45.063 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:24:45.063 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:24:45.063 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:24:45.063 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:24:45.064 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:24:45.064 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:24:45.064 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_txc_items": 0, 2024-09-19T06:24:45.064 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:24:45.064 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:24:45.064 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:24:45.064 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_items": 0, 2024-09-19T06:24:45.064 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_bytes": 0, 2024-09-19T06:24:45.064 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_items": 0, 2024-09-19T06:24:45.064 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:24:45.064 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:24:45.064 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:24:45.064 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:24:45.065 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_anon_bytes": 148977, 2024-09-19T06:24:45.065 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_anon_items": 30, 2024-09-19T06:24:45.065 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:24:45.065 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_meta_items": 0, 2024-09-19T06:24:45.065 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_bytes": 0, 2024-09-19T06:24:45.065 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_items": 0, 2024-09-19T06:24:45.065 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:24:45.065 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mapbl_items": 0, 2024-09-19T06:24:45.065 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:24:45.065 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pglog_items": 0, 2024-09-19T06:24:45.065 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_bytes": 0, 2024-09-19T06:24:45.065 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_items": 0, 2024-09-19T06:24:45.065 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:24:45.066 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:24:45.066 INFO:teuthology.orchestra.run.smithi003.stdout: "pgmap_bytes": 0, 2024-09-19T06:24:45.066 INFO:teuthology.orchestra.run.smithi003.stdout: "pgmap_items": 0, 2024-09-19T06:24:45.066 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_co_bytes": 928, 2024-09-19T06:24:45.066 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_co_items": 2, 2024-09-19T06:24:45.066 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_1_bytes": 0, 2024-09-19T06:24:45.066 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_1_items": 0, 2024-09-19T06:24:45.066 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_2_bytes": 0, 2024-09-19T06:24:45.066 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_2_items": 0 2024-09-19T06:24:45.066 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:45.066 INFO:teuthology.orchestra.run.smithi003.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:24:45.067 INFO:teuthology.orchestra.run.smithi003.stdout: "val": 0, 2024-09-19T06:24:45.067 INFO:teuthology.orchestra.run.smithi003.stdout: "max": 104857600, 2024-09-19T06:24:45.067 INFO:teuthology.orchestra.run.smithi003.stdout: "get_started": 0, 2024-09-19T06:24:45.067 INFO:teuthology.orchestra.run.smithi003.stdout: "get": 261, 2024-09-19T06:24:45.067 INFO:teuthology.orchestra.run.smithi003.stdout: "get_sum": 1698984, 2024-09-19T06:24:45.067 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:45.067 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_success": 261, 2024-09-19T06:24:45.067 INFO:teuthology.orchestra.run.smithi003.stdout: "take": 0, 2024-09-19T06:24:45.067 INFO:teuthology.orchestra.run.smithi003.stdout: "take_sum": 0, 2024-09-19T06:24:45.067 INFO:teuthology.orchestra.run.smithi003.stdout: "put": 261, 2024-09-19T06:24:45.067 INFO:teuthology.orchestra.run.smithi003.stdout: "put_sum": 1698984, 2024-09-19T06:24:45.067 INFO:teuthology.orchestra.run.smithi003.stdout: "wait": { 2024-09-19T06:24:45.067 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:45.068 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:45.068 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:45.068 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:45.068 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:45.068 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:24:45.885 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-19T06:24:45.885 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-19T06:24:45.885 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-19T06:24:45.885 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-19T06:24:45.885 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-19T06:24:45.886 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-19T06:24:45.886 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-19T06:24:45.886 DEBUG:tasks.check_counter:Getting stats from g 2024-09-19T06:24:45.886 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-19T06:24:46.267 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:46.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:46 smithi059 ceph-mon[35138]: pgmap v386: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T06:24:46.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:46 smithi003 ceph-mon[30893]: pgmap v386: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T06:24:46.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:46 smithi071 ceph-mon[35662]: pgmap v386: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T06:24:46.848 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:24:46.848 INFO:teuthology.orchestra.run.smithi003.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:24:46.849 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_messages": 1144, 2024-09-19T06:24:46.849 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages": 1129, 2024-09-19T06:24:46.849 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_bytes": 2064570, 2024-09-19T06:24:46.849 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_bytes": 428216, 2024-09-19T06:24:46.849 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_created_connections": 5, 2024-09-19T06:24:46.849 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_active_connections": 1, 2024-09-19T06:24:46.849 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_total_time": 0.189814106, 2024-09-19T06:24:46.849 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_send_time": 0.088442543, 2024-09-19T06:24:46.849 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_recv_time": 0.079456102, 2024-09-19T06:24:46.849 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_fast_dispatch_time": 0.025606836, 2024-09-19T06:24:46.849 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:46.849 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 1128, 2024-09-19T06:24:46.850 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.078786359, 2024-09-19T06:24:46.850 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000069846 2024-09-19T06:24:46.850 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.850 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:46.850 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.850 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.850 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.850 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.850 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_encrypted_bytes": 1772496, 2024-09-19T06:24:46.850 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_encrypted_bytes": 152192 2024-09-19T06:24:46.850 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.850 INFO:teuthology.orchestra.run.smithi003.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:24:46.850 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_messages": 1642, 2024-09-19T06:24:46.851 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages": 1825, 2024-09-19T06:24:46.851 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_bytes": 419761, 2024-09-19T06:24:46.851 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_bytes": 1009497, 2024-09-19T06:24:46.851 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_created_connections": 7, 2024-09-19T06:24:46.851 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_active_connections": 5, 2024-09-19T06:24:46.851 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_total_time": 0.164606549, 2024-09-19T06:24:46.851 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_send_time": 0.057763310, 2024-09-19T06:24:46.851 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_recv_time": 0.044230597, 2024-09-19T06:24:46.851 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_fast_dispatch_time": 0.049276583, 2024-09-19T06:24:46.851 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:46.851 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 1822, 2024-09-19T06:24:46.851 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.090150775, 2024-09-19T06:24:46.851 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000049479 2024-09-19T06:24:46.852 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.852 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:46.852 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.852 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.852 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.852 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.852 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:24:46.852 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_encrypted_bytes": 487920 2024-09-19T06:24:46.852 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.852 INFO:teuthology.orchestra.run.smithi003.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:24:46.852 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_messages": 8, 2024-09-19T06:24:46.852 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages": 8, 2024-09-19T06:24:46.853 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_bytes": 4653, 2024-09-19T06:24:46.853 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_bytes": 1732, 2024-09-19T06:24:46.853 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_created_connections": 5, 2024-09-19T06:24:46.853 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_active_connections": 4, 2024-09-19T06:24:46.853 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_total_time": 0.005159148, 2024-09-19T06:24:46.853 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_send_time": 0.000163881, 2024-09-19T06:24:46.853 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_recv_time": 0.004856509, 2024-09-19T06:24:46.853 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_fast_dispatch_time": 0.000060331, 2024-09-19T06:24:46.853 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:46.853 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 7, 2024-09-19T06:24:46.853 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.009783946, 2024-09-19T06:24:46.853 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.001397706 2024-09-19T06:24:46.854 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.854 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:46.854 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.854 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.854 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.854 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.854 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-19T06:24:46.854 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T06:24:46.854 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.854 INFO:teuthology.orchestra.run.smithi003.stdout: "cct": { 2024-09-19T06:24:46.854 INFO:teuthology.orchestra.run.smithi003.stdout: "total_workers": 1, 2024-09-19T06:24:46.854 INFO:teuthology.orchestra.run.smithi003.stdout: "unhealthy_workers": 0 2024-09-19T06:24:46.854 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.855 INFO:teuthology.orchestra.run.smithi003.stdout: "finisher-MDSRank": { 2024-09-19T06:24:46.855 INFO:teuthology.orchestra.run.smithi003.stdout: "queue_len": 0, 2024-09-19T06:24:46.855 INFO:teuthology.orchestra.run.smithi003.stdout: "complete_latency": { 2024-09-19T06:24:46.855 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 4208, 2024-09-19T06:24:46.855 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.111490648, 2024-09-19T06:24:46.855 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000026494 2024-09-19T06:24:46.855 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:46.855 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.855 INFO:teuthology.orchestra.run.smithi003.stdout: "finisher-PurgeQueue": { 2024-09-19T06:24:46.855 INFO:teuthology.orchestra.run.smithi003.stdout: "queue_len": 0, 2024-09-19T06:24:46.855 INFO:teuthology.orchestra.run.smithi003.stdout: "complete_latency": { 2024-09-19T06:24:46.855 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.855 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.856 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.856 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:46.856 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.856 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-19T06:24:46.856 INFO:teuthology.orchestra.run.smithi003.stdout: "request": 0, 2024-09-19T06:24:46.856 INFO:teuthology.orchestra.run.smithi003.stdout: "reply": 0, 2024-09-19T06:24:46.856 INFO:teuthology.orchestra.run.smithi003.stdout: "reply_latency": { 2024-09-19T06:24:46.856 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.856 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.856 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.856 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.856 INFO:teuthology.orchestra.run.smithi003.stdout: "slow_reply": 0, 2024-09-19T06:24:46.857 INFO:teuthology.orchestra.run.smithi003.stdout: "forward": 0, 2024-09-19T06:24:46.857 INFO:teuthology.orchestra.run.smithi003.stdout: "dir_fetch_complete": 0, 2024-09-19T06:24:46.857 INFO:teuthology.orchestra.run.smithi003.stdout: "dir_fetch_keys": 0, 2024-09-19T06:24:46.857 INFO:teuthology.orchestra.run.smithi003.stdout: "dir_commit": 0, 2024-09-19T06:24:46.857 INFO:teuthology.orchestra.run.smithi003.stdout: "dir_split": 0, 2024-09-19T06:24:46.857 INFO:teuthology.orchestra.run.smithi003.stdout: "dir_merge": 0, 2024-09-19T06:24:46.857 INFO:teuthology.orchestra.run.smithi003.stdout: "inodes": 0, 2024-09-19T06:24:46.857 INFO:teuthology.orchestra.run.smithi003.stdout: "inodes_top": 0, 2024-09-19T06:24:46.857 INFO:teuthology.orchestra.run.smithi003.stdout: "inodes_bottom": 0, 2024-09-19T06:24:46.857 INFO:teuthology.orchestra.run.smithi003.stdout: "inodes_pin_tail": 0, 2024-09-19T06:24:46.857 INFO:teuthology.orchestra.run.smithi003.stdout: "inodes_pinned": 0, 2024-09-19T06:24:46.857 INFO:teuthology.orchestra.run.smithi003.stdout: "inodes_expired": 0, 2024-09-19T06:24:46.857 INFO:teuthology.orchestra.run.smithi003.stdout: "inodes_with_caps": 0, 2024-09-19T06:24:46.858 INFO:teuthology.orchestra.run.smithi003.stdout: "caps": 0, 2024-09-19T06:24:46.858 INFO:teuthology.orchestra.run.smithi003.stdout: "subtrees": 1, 2024-09-19T06:24:46.858 INFO:teuthology.orchestra.run.smithi003.stdout: "traverse": 0, 2024-09-19T06:24:46.858 INFO:teuthology.orchestra.run.smithi003.stdout: "traverse_hit": 0, 2024-09-19T06:24:46.858 INFO:teuthology.orchestra.run.smithi003.stdout: "traverse_forward": 0, 2024-09-19T06:24:46.858 INFO:teuthology.orchestra.run.smithi003.stdout: "traverse_discover": 0, 2024-09-19T06:24:46.858 INFO:teuthology.orchestra.run.smithi003.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:24:46.858 INFO:teuthology.orchestra.run.smithi003.stdout: "traverse_remote_ino": 0, 2024-09-19T06:24:46.858 INFO:teuthology.orchestra.run.smithi003.stdout: "traverse_lock": 0, 2024-09-19T06:24:46.858 INFO:teuthology.orchestra.run.smithi003.stdout: "load_cent": 0, 2024-09-19T06:24:46.858 INFO:teuthology.orchestra.run.smithi003.stdout: "q": 0, 2024-09-19T06:24:46.858 INFO:teuthology.orchestra.run.smithi003.stdout: "exported": 0, 2024-09-19T06:24:46.858 INFO:teuthology.orchestra.run.smithi003.stdout: "exported_inodes": 0, 2024-09-19T06:24:46.858 INFO:teuthology.orchestra.run.smithi003.stdout: "imported": 0, 2024-09-19T06:24:46.859 INFO:teuthology.orchestra.run.smithi003.stdout: "imported_inodes": 0, 2024-09-19T06:24:46.859 INFO:teuthology.orchestra.run.smithi003.stdout: "openino_dir_fetch": 0, 2024-09-19T06:24:46.859 INFO:teuthology.orchestra.run.smithi003.stdout: "openino_backtrace_fetch": 0, 2024-09-19T06:24:46.859 INFO:teuthology.orchestra.run.smithi003.stdout: "openino_peer_discover": 0, 2024-09-19T06:24:46.859 INFO:teuthology.orchestra.run.smithi003.stdout: "root_rfiles": 0, 2024-09-19T06:24:46.859 INFO:teuthology.orchestra.run.smithi003.stdout: "root_rbytes": 0, 2024-09-19T06:24:46.859 INFO:teuthology.orchestra.run.smithi003.stdout: "root_rsnaps": 0, 2024-09-19T06:24:46.859 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T06:24:46.859 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_set_tag": 0, 2024-09-19T06:24:46.859 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:24:46.859 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:24:46.859 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:24:46.859 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:24:46.860 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:24:46.860 INFO:teuthology.orchestra.run.smithi003.stdout: "scrub_file_inodes": 0, 2024-09-19T06:24:46.860 INFO:teuthology.orchestra.run.smithi003.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:24:46.860 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T06:24:46.860 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_cap_op_grant": 0, 2024-09-19T06:24:46.860 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:24:46.860 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:24:46.860 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:24:46.860 INFO:teuthology.orchestra.run.smithi003.stdout: "handle_client_caps": 0, 2024-09-19T06:24:46.860 INFO:teuthology.orchestra.run.smithi003.stdout: "handle_client_caps_dirty": 0, 2024-09-19T06:24:46.860 INFO:teuthology.orchestra.run.smithi003.stdout: "handle_client_cap_release": 0, 2024-09-19T06:24:46.860 INFO:teuthology.orchestra.run.smithi003.stdout: "process_request_cap_release": 0 2024-09-19T06:24:46.860 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.861 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_cache": { 2024-09-19T06:24:46.861 INFO:teuthology.orchestra.run.smithi003.stdout: "dir_update": 0, 2024-09-19T06:24:46.861 INFO:teuthology.orchestra.run.smithi003.stdout: "dir_update_receipt": 0, 2024-09-19T06:24:46.861 INFO:teuthology.orchestra.run.smithi003.stdout: "dir_try_discover": 0, 2024-09-19T06:24:46.861 INFO:teuthology.orchestra.run.smithi003.stdout: "dir_send_discover": 0, 2024-09-19T06:24:46.861 INFO:teuthology.orchestra.run.smithi003.stdout: "dir_handle_discover": 0, 2024-09-19T06:24:46.861 INFO:teuthology.orchestra.run.smithi003.stdout: "num_strays": 0, 2024-09-19T06:24:46.861 INFO:teuthology.orchestra.run.smithi003.stdout: "num_strays_delayed": 0, 2024-09-19T06:24:46.861 INFO:teuthology.orchestra.run.smithi003.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:24:46.861 INFO:teuthology.orchestra.run.smithi003.stdout: "strays_created": 0, 2024-09-19T06:24:46.861 INFO:teuthology.orchestra.run.smithi003.stdout: "strays_enqueued": 0, 2024-09-19T06:24:46.861 INFO:teuthology.orchestra.run.smithi003.stdout: "strays_reintegrated": 0, 2024-09-19T06:24:46.862 INFO:teuthology.orchestra.run.smithi003.stdout: "strays_migrated": 0, 2024-09-19T06:24:46.862 INFO:teuthology.orchestra.run.smithi003.stdout: "num_recovering_processing": 0, 2024-09-19T06:24:46.862 INFO:teuthology.orchestra.run.smithi003.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:24:46.862 INFO:teuthology.orchestra.run.smithi003.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:24:46.862 INFO:teuthology.orchestra.run.smithi003.stdout: "recovery_started": 0, 2024-09-19T06:24:46.862 INFO:teuthology.orchestra.run.smithi003.stdout: "recovery_completed": 0, 2024-09-19T06:24:46.862 INFO:teuthology.orchestra.run.smithi003.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:24:46.862 INFO:teuthology.orchestra.run.smithi003.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:24:46.862 INFO:teuthology.orchestra.run.smithi003.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:24:46.862 INFO:teuthology.orchestra.run.smithi003.stdout: "ireq_exportdir": 0, 2024-09-19T06:24:46.862 INFO:teuthology.orchestra.run.smithi003.stdout: "ireq_flush": 0, 2024-09-19T06:24:46.862 INFO:teuthology.orchestra.run.smithi003.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:24:46.862 INFO:teuthology.orchestra.run.smithi003.stdout: "ireq_fragstats": 0, 2024-09-19T06:24:46.862 INFO:teuthology.orchestra.run.smithi003.stdout: "ireq_inodestats": 0 2024-09-19T06:24:46.863 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.863 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_log": { 2024-09-19T06:24:46.863 INFO:teuthology.orchestra.run.smithi003.stdout: "evlrg": 0, 2024-09-19T06:24:46.863 INFO:teuthology.orchestra.run.smithi003.stdout: "evadd": 0, 2024-09-19T06:24:46.863 INFO:teuthology.orchestra.run.smithi003.stdout: "evex": 0, 2024-09-19T06:24:46.863 INFO:teuthology.orchestra.run.smithi003.stdout: "evtrm": 0, 2024-09-19T06:24:46.863 INFO:teuthology.orchestra.run.smithi003.stdout: "ev": 7, 2024-09-19T06:24:46.863 INFO:teuthology.orchestra.run.smithi003.stdout: "evexg": 0, 2024-09-19T06:24:46.863 INFO:teuthology.orchestra.run.smithi003.stdout: "evexd": 0, 2024-09-19T06:24:46.863 INFO:teuthology.orchestra.run.smithi003.stdout: "segadd": 0, 2024-09-19T06:24:46.863 INFO:teuthology.orchestra.run.smithi003.stdout: "segex": 0, 2024-09-19T06:24:46.863 INFO:teuthology.orchestra.run.smithi003.stdout: "segtrm": 0, 2024-09-19T06:24:46.863 INFO:teuthology.orchestra.run.smithi003.stdout: "seg": 2, 2024-09-19T06:24:46.863 INFO:teuthology.orchestra.run.smithi003.stdout: "segmjr": 2, 2024-09-19T06:24:46.864 INFO:teuthology.orchestra.run.smithi003.stdout: "segexg": 0, 2024-09-19T06:24:46.864 INFO:teuthology.orchestra.run.smithi003.stdout: "segexd": 0, 2024-09-19T06:24:46.864 INFO:teuthology.orchestra.run.smithi003.stdout: "expos": 4194304, 2024-09-19T06:24:46.864 INFO:teuthology.orchestra.run.smithi003.stdout: "wrpos": 4196353, 2024-09-19T06:24:46.864 INFO:teuthology.orchestra.run.smithi003.stdout: "rdpos": 4196212, 2024-09-19T06:24:46.864 INFO:teuthology.orchestra.run.smithi003.stdout: "jlat": { 2024-09-19T06:24:46.864 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.864 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.864 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.864 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.864 INFO:teuthology.orchestra.run.smithi003.stdout: "replayed": 7 2024-09-19T06:24:46.864 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.865 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_mem": { 2024-09-19T06:24:46.865 INFO:teuthology.orchestra.run.smithi003.stdout: "ino": 3, 2024-09-19T06:24:46.865 INFO:teuthology.orchestra.run.smithi003.stdout: "ino+": 3, 2024-09-19T06:24:46.865 INFO:teuthology.orchestra.run.smithi003.stdout: "ino-": 0, 2024-09-19T06:24:46.865 INFO:teuthology.orchestra.run.smithi003.stdout: "dir": 1, 2024-09-19T06:24:46.865 INFO:teuthology.orchestra.run.smithi003.stdout: "dir+": 1, 2024-09-19T06:24:46.865 INFO:teuthology.orchestra.run.smithi003.stdout: "dir-": 0, 2024-09-19T06:24:46.865 INFO:teuthology.orchestra.run.smithi003.stdout: "dn": 0, 2024-09-19T06:24:46.865 INFO:teuthology.orchestra.run.smithi003.stdout: "dn+": 0, 2024-09-19T06:24:46.865 INFO:teuthology.orchestra.run.smithi003.stdout: "dn-": 0, 2024-09-19T06:24:46.865 INFO:teuthology.orchestra.run.smithi003.stdout: "cap": 0, 2024-09-19T06:24:46.865 INFO:teuthology.orchestra.run.smithi003.stdout: "cap+": 0, 2024-09-19T06:24:46.865 INFO:teuthology.orchestra.run.smithi003.stdout: "cap-": 0, 2024-09-19T06:24:46.866 INFO:teuthology.orchestra.run.smithi003.stdout: "rss": 47228, 2024-09-19T06:24:46.866 INFO:teuthology.orchestra.run.smithi003.stdout: "heap": 215328 2024-09-19T06:24:46.866 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.866 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_server": { 2024-09-19T06:24:46.866 INFO:teuthology.orchestra.run.smithi003.stdout: "dispatch_client_request": 0, 2024-09-19T06:24:46.866 INFO:teuthology.orchestra.run.smithi003.stdout: "dispatch_server_request": 0, 2024-09-19T06:24:46.866 INFO:teuthology.orchestra.run.smithi003.stdout: "handle_client_request": 0, 2024-09-19T06:24:46.866 INFO:teuthology.orchestra.run.smithi003.stdout: "handle_client_session": 0, 2024-09-19T06:24:46.866 INFO:teuthology.orchestra.run.smithi003.stdout: "handle_peer_request": 0, 2024-09-19T06:24:46.866 INFO:teuthology.orchestra.run.smithi003.stdout: "req_create_latency": { 2024-09-19T06:24:46.866 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.866 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.866 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.867 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.867 INFO:teuthology.orchestra.run.smithi003.stdout: "req_getattr_latency": { 2024-09-19T06:24:46.867 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.867 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.867 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.867 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.867 INFO:teuthology.orchestra.run.smithi003.stdout: "req_getfilelock_latency": { 2024-09-19T06:24:46.867 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.867 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.867 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.867 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.867 INFO:teuthology.orchestra.run.smithi003.stdout: "req_link_latency": { 2024-09-19T06:24:46.867 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.868 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.868 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.868 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.868 INFO:teuthology.orchestra.run.smithi003.stdout: "req_lookup_latency": { 2024-09-19T06:24:46.868 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.868 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.868 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.868 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.868 INFO:teuthology.orchestra.run.smithi003.stdout: "req_lookuphash_latency": { 2024-09-19T06:24:46.868 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.868 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.868 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.868 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.869 INFO:teuthology.orchestra.run.smithi003.stdout: "req_lookupino_latency": { 2024-09-19T06:24:46.869 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.869 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.869 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.869 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.869 INFO:teuthology.orchestra.run.smithi003.stdout: "req_lookupname_latency": { 2024-09-19T06:24:46.869 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.869 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.869 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.869 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.869 INFO:teuthology.orchestra.run.smithi003.stdout: "req_lookupparent_latency": { 2024-09-19T06:24:46.869 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.869 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.869 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.870 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.870 INFO:teuthology.orchestra.run.smithi003.stdout: "req_lookupsnap_latency": { 2024-09-19T06:24:46.870 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.870 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.870 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.870 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.870 INFO:teuthology.orchestra.run.smithi003.stdout: "req_lssnap_latency": { 2024-09-19T06:24:46.870 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.870 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.870 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.870 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.870 INFO:teuthology.orchestra.run.smithi003.stdout: "req_mkdir_latency": { 2024-09-19T06:24:46.870 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.871 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.871 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.871 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.871 INFO:teuthology.orchestra.run.smithi003.stdout: "req_mknod_latency": { 2024-09-19T06:24:46.871 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.872 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.872 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.872 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.872 INFO:teuthology.orchestra.run.smithi003.stdout: "req_mksnap_latency": { 2024-09-19T06:24:46.872 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.872 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.872 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.872 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.872 INFO:teuthology.orchestra.run.smithi003.stdout: "req_open_latency": { 2024-09-19T06:24:46.872 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.872 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.872 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.872 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.873 INFO:teuthology.orchestra.run.smithi003.stdout: "req_readdir_latency": { 2024-09-19T06:24:46.873 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.873 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.873 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.873 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.873 INFO:teuthology.orchestra.run.smithi003.stdout: "req_rename_latency": { 2024-09-19T06:24:46.873 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.873 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.873 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.873 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.873 INFO:teuthology.orchestra.run.smithi003.stdout: "req_renamesnap_latency": { 2024-09-19T06:24:46.873 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.873 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.874 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.874 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.874 INFO:teuthology.orchestra.run.smithi003.stdout: "req_snapdiff_latency": { 2024-09-19T06:24:46.874 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.874 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.874 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.874 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.874 INFO:teuthology.orchestra.run.smithi003.stdout: "req_rmdir_latency": { 2024-09-19T06:24:46.874 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.874 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.874 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.874 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.874 INFO:teuthology.orchestra.run.smithi003.stdout: "req_rmsnap_latency": { 2024-09-19T06:24:46.875 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.875 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.875 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.875 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.875 INFO:teuthology.orchestra.run.smithi003.stdout: "req_rmxattr_latency": { 2024-09-19T06:24:46.875 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.875 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.875 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.875 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.875 INFO:teuthology.orchestra.run.smithi003.stdout: "req_setattr_latency": { 2024-09-19T06:24:46.875 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.875 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.875 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.875 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.875 INFO:teuthology.orchestra.run.smithi003.stdout: "req_setdirlayout_latency": { 2024-09-19T06:24:46.876 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.876 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.876 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.876 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.876 INFO:teuthology.orchestra.run.smithi003.stdout: "req_setfilelock_latency": { 2024-09-19T06:24:46.876 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.876 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.876 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.876 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.876 INFO:teuthology.orchestra.run.smithi003.stdout: "req_setlayout_latency": { 2024-09-19T06:24:46.876 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.876 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.877 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.877 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.877 INFO:teuthology.orchestra.run.smithi003.stdout: "req_setxattr_latency": { 2024-09-19T06:24:46.877 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.877 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.877 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.877 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.877 INFO:teuthology.orchestra.run.smithi003.stdout: "req_symlink_latency": { 2024-09-19T06:24:46.877 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.877 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.877 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.877 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.877 INFO:teuthology.orchestra.run.smithi003.stdout: "req_unlink_latency": { 2024-09-19T06:24:46.878 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.878 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.878 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.878 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.878 INFO:teuthology.orchestra.run.smithi003.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:24:46.878 INFO:teuthology.orchestra.run.smithi003.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:24:46.878 INFO:teuthology.orchestra.run.smithi003.stdout: "req_getvxattr_latency": { 2024-09-19T06:24:46.878 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.878 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.878 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.878 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:46.878 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.878 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_sessions": { 2024-09-19T06:24:46.878 INFO:teuthology.orchestra.run.smithi003.stdout: "session_count": 1, 2024-09-19T06:24:46.879 INFO:teuthology.orchestra.run.smithi003.stdout: "session_add": 3, 2024-09-19T06:24:46.879 INFO:teuthology.orchestra.run.smithi003.stdout: "session_remove": 2, 2024-09-19T06:24:46.879 INFO:teuthology.orchestra.run.smithi003.stdout: "sessions_open": 2, 2024-09-19T06:24:46.879 INFO:teuthology.orchestra.run.smithi003.stdout: "sessions_stale": 0, 2024-09-19T06:24:46.879 INFO:teuthology.orchestra.run.smithi003.stdout: "total_load": 0, 2024-09-19T06:24:46.879 INFO:teuthology.orchestra.run.smithi003.stdout: "average_load": 0, 2024-09-19T06:24:46.879 INFO:teuthology.orchestra.run.smithi003.stdout: "avg_session_uptime": 3064, 2024-09-19T06:24:46.879 INFO:teuthology.orchestra.run.smithi003.stdout: "mdthresh_evicted": 0 2024-09-19T06:24:46.879 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.879 INFO:teuthology.orchestra.run.smithi003.stdout: "mempool": { 2024-09-19T06:24:46.879 INFO:teuthology.orchestra.run.smithi003.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:24:46.879 INFO:teuthology.orchestra.run.smithi003.stdout: "bloom_filter_items": 0, 2024-09-19T06:24:46.879 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:24:46.880 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:24:46.880 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:24:46.880 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:24:46.880 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:24:46.880 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:24:46.880 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:24:46.880 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:24:46.880 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:24:46.880 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:24:46.880 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:24:46.880 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:24:46.880 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:24:46.880 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_extent_items": 0, 2024-09-19T06:24:46.881 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:24:46.881 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_blob_items": 0, 2024-09-19T06:24:46.881 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:24:46.881 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:24:46.881 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:24:46.881 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:24:46.881 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:24:46.881 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:24:46.881 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:24:46.881 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_txc_items": 0, 2024-09-19T06:24:46.881 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:24:46.881 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:24:46.881 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:24:46.882 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_items": 0, 2024-09-19T06:24:46.882 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_bytes": 0, 2024-09-19T06:24:46.882 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_items": 0, 2024-09-19T06:24:46.882 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:24:46.882 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:24:46.882 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:24:46.882 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:24:46.882 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_anon_bytes": 197507, 2024-09-19T06:24:46.882 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_anon_items": 57, 2024-09-19T06:24:46.882 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:24:46.882 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_meta_items": 0, 2024-09-19T06:24:46.882 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_bytes": 0, 2024-09-19T06:24:46.882 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_items": 0, 2024-09-19T06:24:46.883 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:24:46.883 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mapbl_items": 0, 2024-09-19T06:24:46.883 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:24:46.883 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pglog_items": 0, 2024-09-19T06:24:46.883 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_bytes": 8320, 2024-09-19T06:24:46.883 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_items": 183, 2024-09-19T06:24:46.883 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:24:46.883 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:24:46.883 INFO:teuthology.orchestra.run.smithi003.stdout: "pgmap_bytes": 0, 2024-09-19T06:24:46.883 INFO:teuthology.orchestra.run.smithi003.stdout: "pgmap_items": 0, 2024-09-19T06:24:46.883 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_co_bytes": 8512, 2024-09-19T06:24:46.883 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_co_items": 13, 2024-09-19T06:24:46.883 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_1_bytes": 0, 2024-09-19T06:24:46.883 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_1_items": 0, 2024-09-19T06:24:46.883 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_2_bytes": 0, 2024-09-19T06:24:46.884 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_2_items": 0 2024-09-19T06:24:46.884 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.884 INFO:teuthology.orchestra.run.smithi003.stdout: "objecter": { 2024-09-19T06:24:46.884 INFO:teuthology.orchestra.run.smithi003.stdout: "op_active": 0, 2024-09-19T06:24:46.884 INFO:teuthology.orchestra.run.smithi003.stdout: "op_laggy": 0, 2024-09-19T06:24:46.884 INFO:teuthology.orchestra.run.smithi003.stdout: "op_send": 2512, 2024-09-19T06:24:46.884 INFO:teuthology.orchestra.run.smithi003.stdout: "op_send_bytes": 21, 2024-09-19T06:24:46.884 INFO:teuthology.orchestra.run.smithi003.stdout: "op_resend": 3, 2024-09-19T06:24:46.884 INFO:teuthology.orchestra.run.smithi003.stdout: "op_reply": 2512, 2024-09-19T06:24:46.884 INFO:teuthology.orchestra.run.smithi003.stdout: "op_latency": { 2024-09-19T06:24:46.884 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 2512, 2024-09-19T06:24:46.884 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 1.679978213, 2024-09-19T06:24:46.884 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000668781 2024-09-19T06:24:46.885 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.885 INFO:teuthology.orchestra.run.smithi003.stdout: "op_inflight": 0, 2024-09-19T06:24:46.885 INFO:teuthology.orchestra.run.smithi003.stdout: "oplen_avg": { 2024-09-19T06:24:46.885 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 2512, 2024-09-19T06:24:46.885 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 2513 2024-09-19T06:24:46.885 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.885 INFO:teuthology.orchestra.run.smithi003.stdout: "op": 2512, 2024-09-19T06:24:46.885 INFO:teuthology.orchestra.run.smithi003.stdout: "op_r": 2512, 2024-09-19T06:24:46.885 INFO:teuthology.orchestra.run.smithi003.stdout: "op_w": 0, 2024-09-19T06:24:46.885 INFO:teuthology.orchestra.run.smithi003.stdout: "op_rmw": 0, 2024-09-19T06:24:46.885 INFO:teuthology.orchestra.run.smithi003.stdout: "op_pg": 0, 2024-09-19T06:24:46.885 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_stat": 1633, 2024-09-19T06:24:46.885 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_create": 0, 2024-09-19T06:24:46.885 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_read": 877, 2024-09-19T06:24:46.886 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_write": 0, 2024-09-19T06:24:46.886 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_writefull": 0, 2024-09-19T06:24:46.886 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_writesame": 0, 2024-09-19T06:24:46.886 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_append": 0, 2024-09-19T06:24:46.886 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_zero": 0, 2024-09-19T06:24:46.886 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_truncate": 0, 2024-09-19T06:24:46.886 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_delete": 0, 2024-09-19T06:24:46.886 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_mapext": 0, 2024-09-19T06:24:46.886 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_sparse_read": 0, 2024-09-19T06:24:46.886 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_clonerange": 0, 2024-09-19T06:24:46.886 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_getxattr": 1, 2024-09-19T06:24:46.886 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_setxattr": 0, 2024-09-19T06:24:46.887 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:24:46.887 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_rmxattr": 0, 2024-09-19T06:24:46.887 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:24:46.887 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_call": 0, 2024-09-19T06:24:46.887 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_watch": 0, 2024-09-19T06:24:46.887 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_notify": 0, 2024-09-19T06:24:46.887 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:24:46.887 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_pgls": 0, 2024-09-19T06:24:46.887 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:24:46.887 INFO:teuthology.orchestra.run.smithi003.stdout: "osdop_other": 0, 2024-09-19T06:24:46.887 INFO:teuthology.orchestra.run.smithi003.stdout: "linger_active": 0, 2024-09-19T06:24:46.887 INFO:teuthology.orchestra.run.smithi003.stdout: "linger_send": 0, 2024-09-19T06:24:46.887 INFO:teuthology.orchestra.run.smithi003.stdout: "linger_resend": 0, 2024-09-19T06:24:46.887 INFO:teuthology.orchestra.run.smithi003.stdout: "linger_ping": 0, 2024-09-19T06:24:46.888 INFO:teuthology.orchestra.run.smithi003.stdout: "poolop_active": 0, 2024-09-19T06:24:46.888 INFO:teuthology.orchestra.run.smithi003.stdout: "poolop_send": 0, 2024-09-19T06:24:46.888 INFO:teuthology.orchestra.run.smithi003.stdout: "poolop_resend": 0, 2024-09-19T06:24:46.888 INFO:teuthology.orchestra.run.smithi003.stdout: "poolstat_active": 0, 2024-09-19T06:24:46.888 INFO:teuthology.orchestra.run.smithi003.stdout: "poolstat_send": 0, 2024-09-19T06:24:46.888 INFO:teuthology.orchestra.run.smithi003.stdout: "poolstat_resend": 0, 2024-09-19T06:24:46.888 INFO:teuthology.orchestra.run.smithi003.stdout: "statfs_active": 0, 2024-09-19T06:24:46.888 INFO:teuthology.orchestra.run.smithi003.stdout: "statfs_send": 0, 2024-09-19T06:24:46.888 INFO:teuthology.orchestra.run.smithi003.stdout: "statfs_resend": 0, 2024-09-19T06:24:46.888 INFO:teuthology.orchestra.run.smithi003.stdout: "command_active": 0, 2024-09-19T06:24:46.888 INFO:teuthology.orchestra.run.smithi003.stdout: "command_send": 0, 2024-09-19T06:24:46.888 INFO:teuthology.orchestra.run.smithi003.stdout: "command_resend": 0, 2024-09-19T06:24:46.888 INFO:teuthology.orchestra.run.smithi003.stdout: "map_epoch": 101, 2024-09-19T06:24:46.889 INFO:teuthology.orchestra.run.smithi003.stdout: "map_full": 0, 2024-09-19T06:24:46.889 INFO:teuthology.orchestra.run.smithi003.stdout: "map_inc": 15, 2024-09-19T06:24:46.889 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_sessions": 6, 2024-09-19T06:24:46.889 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_session_open": 6, 2024-09-19T06:24:46.889 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_session_close": 0, 2024-09-19T06:24:46.889 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_laggy": 0, 2024-09-19T06:24:46.889 INFO:teuthology.orchestra.run.smithi003.stdout: "omap_wr": 0, 2024-09-19T06:24:46.889 INFO:teuthology.orchestra.run.smithi003.stdout: "omap_rd": 2, 2024-09-19T06:24:46.889 INFO:teuthology.orchestra.run.smithi003.stdout: "omap_del": 0 2024-09-19T06:24:46.889 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.889 INFO:teuthology.orchestra.run.smithi003.stdout: "oft": { 2024-09-19T06:24:46.889 INFO:teuthology.orchestra.run.smithi003.stdout: "omap_total_objs": 0, 2024-09-19T06:24:46.889 INFO:teuthology.orchestra.run.smithi003.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:24:46.889 INFO:teuthology.orchestra.run.smithi003.stdout: "omap_total_updates": 0, 2024-09-19T06:24:46.890 INFO:teuthology.orchestra.run.smithi003.stdout: "omap_total_removes": 0 2024-09-19T06:24:46.890 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.890 INFO:teuthology.orchestra.run.smithi003.stdout: "osd-slow-ops": { 2024-09-19T06:24:46.890 INFO:teuthology.orchestra.run.smithi003.stdout: "slow_ops_count": 0 2024-09-19T06:24:46.890 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.890 INFO:teuthology.orchestra.run.smithi003.stdout: "purge_queue": { 2024-09-19T06:24:46.890 INFO:teuthology.orchestra.run.smithi003.stdout: "pq_executing_ops": 0, 2024-09-19T06:24:46.890 INFO:teuthology.orchestra.run.smithi003.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T06:24:46.890 INFO:teuthology.orchestra.run.smithi003.stdout: "pq_executing": 0, 2024-09-19T06:24:46.890 INFO:teuthology.orchestra.run.smithi003.stdout: "pq_executing_high_water": 0, 2024-09-19T06:24:46.890 INFO:teuthology.orchestra.run.smithi003.stdout: "pq_executed_ops": 0, 2024-09-19T06:24:46.890 INFO:teuthology.orchestra.run.smithi003.stdout: "pq_executed": 0, 2024-09-19T06:24:46.890 INFO:teuthology.orchestra.run.smithi003.stdout: "pq_item_in_journal": 0 2024-09-19T06:24:46.891 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.891 INFO:teuthology.orchestra.run.smithi003.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:24:46.891 INFO:teuthology.orchestra.run.smithi003.stdout: "val": 0, 2024-09-19T06:24:46.891 INFO:teuthology.orchestra.run.smithi003.stdout: "max": 104857600, 2024-09-19T06:24:46.891 INFO:teuthology.orchestra.run.smithi003.stdout: "get_started": 0, 2024-09-19T06:24:46.891 INFO:teuthology.orchestra.run.smithi003.stdout: "get": 2790, 2024-09-19T06:24:46.891 INFO:teuthology.orchestra.run.smithi003.stdout: "get_sum": 2220746, 2024-09-19T06:24:46.891 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:46.891 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_success": 2790, 2024-09-19T06:24:46.891 INFO:teuthology.orchestra.run.smithi003.stdout: "take": 0, 2024-09-19T06:24:46.891 INFO:teuthology.orchestra.run.smithi003.stdout: "take_sum": 0, 2024-09-19T06:24:46.891 INFO:teuthology.orchestra.run.smithi003.stdout: "put": 2790, 2024-09-19T06:24:46.891 INFO:teuthology.orchestra.run.smithi003.stdout: "put_sum": 2220746, 2024-09-19T06:24:46.891 INFO:teuthology.orchestra.run.smithi003.stdout: "wait": { 2024-09-19T06:24:46.892 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.892 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.892 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.892 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:46.892 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.892 INFO:teuthology.orchestra.run.smithi003.stdout: "throttle-objecter_bytes": { 2024-09-19T06:24:46.892 INFO:teuthology.orchestra.run.smithi003.stdout: "val": 0, 2024-09-19T06:24:46.892 INFO:teuthology.orchestra.run.smithi003.stdout: "max": 104857600, 2024-09-19T06:24:46.892 INFO:teuthology.orchestra.run.smithi003.stdout: "get_started": 0, 2024-09-19T06:24:46.892 INFO:teuthology.orchestra.run.smithi003.stdout: "get": 0, 2024-09-19T06:24:46.892 INFO:teuthology.orchestra.run.smithi003.stdout: "get_sum": 0, 2024-09-19T06:24:46.892 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:46.892 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:46.893 INFO:teuthology.orchestra.run.smithi003.stdout: "take": 2512, 2024-09-19T06:24:46.893 INFO:teuthology.orchestra.run.smithi003.stdout: "take_sum": 2054, 2024-09-19T06:24:46.893 INFO:teuthology.orchestra.run.smithi003.stdout: "put": 2512, 2024-09-19T06:24:46.893 INFO:teuthology.orchestra.run.smithi003.stdout: "put_sum": 2054, 2024-09-19T06:24:46.893 INFO:teuthology.orchestra.run.smithi003.stdout: "wait": { 2024-09-19T06:24:46.893 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.893 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.893 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.893 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:46.893 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.894 INFO:teuthology.orchestra.run.smithi003.stdout: "throttle-objecter_ops": { 2024-09-19T06:24:46.894 INFO:teuthology.orchestra.run.smithi003.stdout: "val": 0, 2024-09-19T06:24:46.894 INFO:teuthology.orchestra.run.smithi003.stdout: "max": 1024, 2024-09-19T06:24:46.894 INFO:teuthology.orchestra.run.smithi003.stdout: "get_started": 0, 2024-09-19T06:24:46.894 INFO:teuthology.orchestra.run.smithi003.stdout: "get": 0, 2024-09-19T06:24:46.894 INFO:teuthology.orchestra.run.smithi003.stdout: "get_sum": 0, 2024-09-19T06:24:46.894 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:46.894 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:46.894 INFO:teuthology.orchestra.run.smithi003.stdout: "take": 2512, 2024-09-19T06:24:46.894 INFO:teuthology.orchestra.run.smithi003.stdout: "take_sum": 2512, 2024-09-19T06:24:46.894 INFO:teuthology.orchestra.run.smithi003.stdout: "put": 2512, 2024-09-19T06:24:46.894 INFO:teuthology.orchestra.run.smithi003.stdout: "put_sum": 2512, 2024-09-19T06:24:46.894 INFO:teuthology.orchestra.run.smithi003.stdout: "wait": { 2024-09-19T06:24:46.895 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.895 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.895 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.895 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:46.895 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.895 INFO:teuthology.orchestra.run.smithi003.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:24:46.895 INFO:teuthology.orchestra.run.smithi003.stdout: "val": 0, 2024-09-19T06:24:46.895 INFO:teuthology.orchestra.run.smithi003.stdout: "max": 3758096384, 2024-09-19T06:24:46.895 INFO:teuthology.orchestra.run.smithi003.stdout: "get_started": 0, 2024-09-19T06:24:46.895 INFO:teuthology.orchestra.run.smithi003.stdout: "get": 0, 2024-09-19T06:24:46.895 INFO:teuthology.orchestra.run.smithi003.stdout: "get_sum": 0, 2024-09-19T06:24:46.895 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:46.895 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:46.895 INFO:teuthology.orchestra.run.smithi003.stdout: "take": 0, 2024-09-19T06:24:46.896 INFO:teuthology.orchestra.run.smithi003.stdout: "take_sum": 0, 2024-09-19T06:24:46.896 INFO:teuthology.orchestra.run.smithi003.stdout: "put": 0, 2024-09-19T06:24:46.896 INFO:teuthology.orchestra.run.smithi003.stdout: "put_sum": 0, 2024-09-19T06:24:46.896 INFO:teuthology.orchestra.run.smithi003.stdout: "wait": { 2024-09-19T06:24:46.896 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.896 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.896 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.896 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:46.896 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:46.896 INFO:teuthology.orchestra.run.smithi003.stdout: "throttle-write_buf_throttle-0x561582d90780": { 2024-09-19T06:24:46.896 INFO:teuthology.orchestra.run.smithi003.stdout: "val": 0, 2024-09-19T06:24:46.896 INFO:teuthology.orchestra.run.smithi003.stdout: "max": 3758096384, 2024-09-19T06:24:46.896 INFO:teuthology.orchestra.run.smithi003.stdout: "get_started": 0, 2024-09-19T06:24:46.897 INFO:teuthology.orchestra.run.smithi003.stdout: "get": 0, 2024-09-19T06:24:46.897 INFO:teuthology.orchestra.run.smithi003.stdout: "get_sum": 0, 2024-09-19T06:24:46.897 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:46.897 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:46.897 INFO:teuthology.orchestra.run.smithi003.stdout: "take": 0, 2024-09-19T06:24:46.897 INFO:teuthology.orchestra.run.smithi003.stdout: "take_sum": 0, 2024-09-19T06:24:46.897 INFO:teuthology.orchestra.run.smithi003.stdout: "put": 0, 2024-09-19T06:24:46.897 INFO:teuthology.orchestra.run.smithi003.stdout: "put_sum": 0, 2024-09-19T06:24:46.897 INFO:teuthology.orchestra.run.smithi003.stdout: "wait": { 2024-09-19T06:24:46.897 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:46.898 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:46.898 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:46.898 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:46.898 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:46.898 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:24:47.883 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-19T06:24:47.883 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-19T06:24:47.883 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-09-19T06:24:47.883 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-09-19T06:24:47.884 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-09-19T06:24:47.884 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:24:47.884 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:24:47.884 DEBUG:tasks.check_counter:Getting stats from j 2024-09-19T06:24:47.884 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-19T06:24:48.265 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:24:48.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:48 smithi059 ceph-mon[35138]: pgmap v387: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:24:48.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:48 smithi003 ceph-mon[30893]: pgmap v387: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:24:48.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:48 smithi071 ceph-mon[35662]: pgmap v387: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:24:48.848 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-19T06:24:48.849 INFO:teuthology.orchestra.run.smithi003.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:24:48.849 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_messages": 0, 2024-09-19T06:24:48.849 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages": 2, 2024-09-19T06:24:48.849 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_bytes": 0, 2024-09-19T06:24:48.849 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_bytes": 0, 2024-09-19T06:24:48.849 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_created_connections": 4, 2024-09-19T06:24:48.849 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_active_connections": 0, 2024-09-19T06:24:48.849 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_total_time": 0.003578291, 2024-09-19T06:24:48.849 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T06:24:48.849 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_recv_time": 0.000664819, 2024-09-19T06:24:48.850 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:24:48.850 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:48.850 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:48.850 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:48.850 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:48.850 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:48.850 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:48.850 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:48.850 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:48.850 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:48.850 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:48.850 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:24:48.850 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:24:48.850 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:48.851 INFO:teuthology.orchestra.run.smithi003.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:24:48.851 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_messages": 2, 2024-09-19T06:24:48.851 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages": 191, 2024-09-19T06:24:48.851 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_bytes": 320, 2024-09-19T06:24:48.851 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_bytes": 190848, 2024-09-19T06:24:48.851 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_created_connections": 5, 2024-09-19T06:24:48.851 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_active_connections": 3, 2024-09-19T06:24:48.851 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_total_time": 0.024093125, 2024-09-19T06:24:48.851 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_send_time": 0.016342658, 2024-09-19T06:24:48.851 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_recv_time": 0.003852342, 2024-09-19T06:24:48.851 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:24:48.851 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:48.852 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 188, 2024-09-19T06:24:48.852 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.028711822, 2024-09-19T06:24:48.852 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000152722 2024-09-19T06:24:48.852 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:48.852 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:48.852 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:48.852 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:48.852 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:48.852 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:48.852 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:24:48.852 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_encrypted_bytes": 190848 2024-09-19T06:24:48.852 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:48.852 INFO:teuthology.orchestra.run.smithi003.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:24:48.853 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_messages": 264, 2024-09-19T06:24:48.853 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages": 250, 2024-09-19T06:24:48.853 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_bytes": 1738848, 2024-09-19T06:24:48.853 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_bytes": 153168, 2024-09-19T06:24:48.853 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_created_connections": 2, 2024-09-19T06:24:48.853 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_active_connections": 1, 2024-09-19T06:24:48.853 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_total_time": 0.063649901, 2024-09-19T06:24:48.853 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_send_time": 0.024926762, 2024-09-19T06:24:48.853 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_recv_time": 0.054971159, 2024-09-19T06:24:48.853 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T06:24:48.853 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:48.853 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 250, 2024-09-19T06:24:48.853 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.024815707, 2024-09-19T06:24:48.854 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000099262 2024-09-19T06:24:48.854 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:48.854 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:48.854 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:48.854 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:48.854 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:48.854 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:48.854 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_recv_encrypted_bytes": 1738848, 2024-09-19T06:24:48.854 INFO:teuthology.orchestra.run.smithi003.stdout: "msgr_send_encrypted_bytes": 153168 2024-09-19T06:24:48.854 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:48.854 INFO:teuthology.orchestra.run.smithi003.stdout: "cct": { 2024-09-19T06:24:48.854 INFO:teuthology.orchestra.run.smithi003.stdout: "total_workers": 0, 2024-09-19T06:24:48.854 INFO:teuthology.orchestra.run.smithi003.stdout: "unhealthy_workers": 0 2024-09-19T06:24:48.855 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:48.855 INFO:teuthology.orchestra.run.smithi003.stdout: "mempool": { 2024-09-19T06:24:48.855 INFO:teuthology.orchestra.run.smithi003.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:24:48.855 INFO:teuthology.orchestra.run.smithi003.stdout: "bloom_filter_items": 0, 2024-09-19T06:24:48.855 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:24:48.855 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:24:48.855 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:24:48.855 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:24:48.855 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:24:48.855 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:24:48.855 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:24:48.855 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:24:48.856 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:24:48.856 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:24:48.856 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:24:48.856 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:24:48.856 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:24:48.856 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_extent_items": 0, 2024-09-19T06:24:48.856 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:24:48.856 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_blob_items": 0, 2024-09-19T06:24:48.856 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:24:48.856 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:24:48.856 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:24:48.856 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:24:48.856 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:24:48.857 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:24:48.857 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:24:48.857 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_txc_items": 0, 2024-09-19T06:24:48.857 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:24:48.857 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:24:48.857 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:24:48.857 INFO:teuthology.orchestra.run.smithi003.stdout: "bluestore_writing_items": 0, 2024-09-19T06:24:48.857 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_bytes": 0, 2024-09-19T06:24:48.857 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_items": 0, 2024-09-19T06:24:48.858 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:24:48.858 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:24:48.858 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:24:48.859 INFO:teuthology.orchestra.run.smithi003.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:24:48.859 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_anon_bytes": 149745, 2024-09-19T06:24:48.859 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_anon_items": 31, 2024-09-19T06:24:48.859 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:24:48.859 INFO:teuthology.orchestra.run.smithi003.stdout: "buffer_meta_items": 0, 2024-09-19T06:24:48.859 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_bytes": 0, 2024-09-19T06:24:48.859 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_items": 0, 2024-09-19T06:24:48.860 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:24:48.860 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_mapbl_items": 0, 2024-09-19T06:24:48.860 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:24:48.860 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_pglog_items": 0, 2024-09-19T06:24:48.860 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_bytes": 0, 2024-09-19T06:24:48.860 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_items": 0, 2024-09-19T06:24:48.860 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:24:48.861 INFO:teuthology.orchestra.run.smithi003.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:24:48.861 INFO:teuthology.orchestra.run.smithi003.stdout: "pgmap_bytes": 0, 2024-09-19T06:24:48.861 INFO:teuthology.orchestra.run.smithi003.stdout: "pgmap_items": 0, 2024-09-19T06:24:48.861 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_co_bytes": 928, 2024-09-19T06:24:48.861 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_co_items": 2, 2024-09-19T06:24:48.861 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_1_bytes": 0, 2024-09-19T06:24:48.861 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_1_items": 0, 2024-09-19T06:24:48.861 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_2_bytes": 0, 2024-09-19T06:24:48.862 INFO:teuthology.orchestra.run.smithi003.stdout: "unittest_2_items": 0 2024-09-19T06:24:48.862 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-19T06:24:48.862 INFO:teuthology.orchestra.run.smithi003.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:24:48.862 INFO:teuthology.orchestra.run.smithi003.stdout: "val": 0, 2024-09-19T06:24:48.862 INFO:teuthology.orchestra.run.smithi003.stdout: "max": 104857600, 2024-09-19T06:24:48.862 INFO:teuthology.orchestra.run.smithi003.stdout: "get_started": 0, 2024-09-19T06:24:48.862 INFO:teuthology.orchestra.run.smithi003.stdout: "get": 262, 2024-09-19T06:24:48.862 INFO:teuthology.orchestra.run.smithi003.stdout: "get_sum": 1699114, 2024-09-19T06:24:48.862 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:48.863 INFO:teuthology.orchestra.run.smithi003.stdout: "get_or_fail_success": 262, 2024-09-19T06:24:48.863 INFO:teuthology.orchestra.run.smithi003.stdout: "take": 0, 2024-09-19T06:24:48.863 INFO:teuthology.orchestra.run.smithi003.stdout: "take_sum": 0, 2024-09-19T06:24:48.863 INFO:teuthology.orchestra.run.smithi003.stdout: "put": 262, 2024-09-19T06:24:48.863 INFO:teuthology.orchestra.run.smithi003.stdout: "put_sum": 1699114, 2024-09-19T06:24:48.863 INFO:teuthology.orchestra.run.smithi003.stdout: "wait": { 2024-09-19T06:24:48.863 INFO:teuthology.orchestra.run.smithi003.stdout: "avgcount": 0, 2024-09-19T06:24:48.863 INFO:teuthology.orchestra.run.smithi003.stdout: "sum": 0.000000000, 2024-09-19T06:24:48.864 INFO:teuthology.orchestra.run.smithi003.stdout: "avgtime": 0.000000000 2024-09-19T06:24:48.864 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:48.864 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-19T06:24:48.864 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-19T06:24:49.749 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-19T06:24:49.749 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-19T06:24:49.749 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-19T06:24:49.749 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-19T06:24:49.749 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-19T06:24:49.749 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-19T06:24:49.749 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-19T06:24:49.749 DEBUG:tasks.check_counter:Getting stats from b 2024-09-19T06:24:49.749 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-19T06:24:50.012 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:24:50.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:50 smithi059 ceph-mon[35138]: pgmap v388: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T06:24:50.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:50 smithi003 ceph-mon[30893]: pgmap v388: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T06:24:50.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:50 smithi071 ceph-mon[35662]: pgmap v388: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T06:24:50.649 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-19T06:24:50.649 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:24:50.649 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 2404, 2024-09-19T06:24:50.649 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 2788, 2024-09-19T06:24:50.649 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 2626383, 2024-09-19T06:24:50.650 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 1456408, 2024-09-19T06:24:50.650 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 15, 2024-09-19T06:24:50.650 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 5, 2024-09-19T06:24:50.650 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.276099647, 2024-09-19T06:24:50.650 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.095122597, 2024-09-19T06:24:50.650 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.151846932, 2024-09-19T06:24:50.650 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.032835422, 2024-09-19T06:24:50.650 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:50.650 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2786, 2024-09-19T06:24:50.650 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 1.759573723, 2024-09-19T06:24:50.650 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000631577 2024-09-19T06:24:50.650 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.650 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:50.651 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2466, 2024-09-19T06:24:50.651 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000733857, 2024-09-19T06:24:50.651 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000297 2024-09-19T06:24:50.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.651 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 1923088, 2024-09-19T06:24:50.651 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 570192 2024-09-19T06:24:50.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.651 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:24:50.651 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 5439, 2024-09-19T06:24:50.651 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 6910, 2024-09-19T06:24:50.651 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 1850005, 2024-09-19T06:24:50.651 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 13631560, 2024-09-19T06:24:50.651 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 19, 2024-09-19T06:24:50.652 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 7, 2024-09-19T06:24:50.652 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.615896820, 2024-09-19T06:24:50.652 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.231986316, 2024-09-19T06:24:50.652 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.266456601, 2024-09-19T06:24:50.652 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.128544958, 2024-09-19T06:24:50.652 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:50.652 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 6912, 2024-09-19T06:24:50.652 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.617957255, 2024-09-19T06:24:50.652 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000089403 2024-09-19T06:24:50.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.652 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:50.652 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 6232, 2024-09-19T06:24:50.652 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.001895330, 2024-09-19T06:24:50.653 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000304 2024-09-19T06:24:50.653 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.653 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 376880, 2024-09-19T06:24:50.653 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 247104 2024-09-19T06:24:50.653 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.653 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:24:50.653 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 4310, 2024-09-19T06:24:50.653 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 5074, 2024-09-19T06:24:50.653 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 1342103, 2024-09-19T06:24:50.653 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 17457525, 2024-09-19T06:24:50.653 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 242, 2024-09-19T06:24:50.654 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 7, 2024-09-19T06:24:50.654 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.460382136, 2024-09-19T06:24:50.654 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.155032236, 2024-09-19T06:24:50.654 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.242850359, 2024-09-19T06:24:50.654 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.065843029, 2024-09-19T06:24:50.654 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:50.654 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 5069, 2024-09-19T06:24:50.654 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.382544292, 2024-09-19T06:24:50.654 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000075467 2024-09-19T06:24:50.654 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.654 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:50.654 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 4604, 2024-09-19T06:24:50.655 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.001003466, 2024-09-19T06:24:50.655 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000217 2024-09-19T06:24:50.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.655 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 42544, 2024-09-19T06:24:50.655 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 1136 2024-09-19T06:24:50.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.655 INFO:teuthology.orchestra.run.smithi059.stdout: "cct": { 2024-09-19T06:24:50.655 INFO:teuthology.orchestra.run.smithi059.stdout: "total_workers": 1, 2024-09-19T06:24:50.655 INFO:teuthology.orchestra.run.smithi059.stdout: "unhealthy_workers": 0 2024-09-19T06:24:50.655 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.655 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-MDSRank": { 2024-09-19T06:24:50.655 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-09-19T06:24:50.656 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-09-19T06:24:50.656 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 6392, 2024-09-19T06:24:50.656 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 1.683111295, 2024-09-19T06:24:50.656 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000263315 2024-09-19T06:24:50.656 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:50.656 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.656 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-PurgeQueue": { 2024-09-19T06:24:50.656 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-09-19T06:24:50.656 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-09-19T06:24:50.656 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 16, 2024-09-19T06:24:50.656 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000344649, 2024-09-19T06:24:50.656 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000021540 2024-09-19T06:24:50.656 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:50.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.657 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2024-09-19T06:24:50.657 INFO:teuthology.orchestra.run.smithi059.stdout: "request": 779, 2024-09-19T06:24:50.657 INFO:teuthology.orchestra.run.smithi059.stdout: "reply": 779, 2024-09-19T06:24:50.657 INFO:teuthology.orchestra.run.smithi059.stdout: "reply_latency": { 2024-09-19T06:24:50.657 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 779, 2024-09-19T06:24:50.657 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 3.272940600, 2024-09-19T06:24:50.657 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.004201464 2024-09-19T06:24:50.657 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.657 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_reply": 0, 2024-09-19T06:24:50.657 INFO:teuthology.orchestra.run.smithi059.stdout: "forward": 0, 2024-09-19T06:24:50.658 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_complete": 0, 2024-09-19T06:24:50.658 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_keys": 0, 2024-09-19T06:24:50.658 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_commit": 352, 2024-09-19T06:24:50.658 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_split": 0, 2024-09-19T06:24:50.658 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_merge": 0, 2024-09-19T06:24:50.658 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes": 42, 2024-09-19T06:24:50.658 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_top": 14, 2024-09-19T06:24:50.658 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_bottom": 28, 2024-09-19T06:24:50.658 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pin_tail": 0, 2024-09-19T06:24:50.659 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pinned": 22, 2024-09-19T06:24:50.659 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_expired": 0, 2024-09-19T06:24:50.659 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_with_caps": 2, 2024-09-19T06:24:50.659 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": 2, 2024-09-19T06:24:50.659 INFO:teuthology.orchestra.run.smithi059.stdout: "subtrees": 2, 2024-09-19T06:24:50.659 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse": 839, 2024-09-19T06:24:50.660 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_hit": 826, 2024-09-19T06:24:50.660 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_forward": 0, 2024-09-19T06:24:50.660 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_discover": 0, 2024-09-19T06:24:50.660 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:24:50.660 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_remote_ino": 0, 2024-09-19T06:24:50.660 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_lock": 0, 2024-09-19T06:24:50.661 INFO:teuthology.orchestra.run.smithi059.stdout: "load_cent": 0, 2024-09-19T06:24:50.661 INFO:teuthology.orchestra.run.smithi059.stdout: "q": 0, 2024-09-19T06:24:50.661 INFO:teuthology.orchestra.run.smithi059.stdout: "exported": 0, 2024-09-19T06:24:50.661 INFO:teuthology.orchestra.run.smithi059.stdout: "exported_inodes": 0, 2024-09-19T06:24:50.661 INFO:teuthology.orchestra.run.smithi059.stdout: "imported": 0, 2024-09-19T06:24:50.661 INFO:teuthology.orchestra.run.smithi059.stdout: "imported_inodes": 0, 2024-09-19T06:24:50.661 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_dir_fetch": 0, 2024-09-19T06:24:50.661 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_backtrace_fetch": 247, 2024-09-19T06:24:50.662 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_peer_discover": 0, 2024-09-19T06:24:50.662 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rfiles": 4, 2024-09-19T06:24:50.662 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rbytes": 234, 2024-09-19T06:24:50.662 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rsnaps": 6, 2024-09-19T06:24:50.662 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_fetch": 247, 2024-09-19T06:24:50.662 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_set_tag": 0, 2024-09-19T06:24:50.662 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:24:50.663 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:24:50.663 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_inodes": 159, 2024-09-19T06:24:50.663 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_base_inodes": 18, 2024-09-19T06:24:50.663 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dirfrag_rstats": 141, 2024-09-19T06:24:50.663 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_file_inodes": 88, 2024-09-19T06:24:50.663 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:24:50.663 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_revoke": 615, 2024-09-19T06:24:50.663 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_grant": 612, 2024-09-19T06:24:50.664 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_trunc": 599, 2024-09-19T06:24:50.664 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:24:50.664 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:24:50.664 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps": 734, 2024-09-19T06:24:50.664 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps_dirty": 712, 2024-09-19T06:24:50.664 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_cap_release": 1, 2024-09-19T06:24:50.665 INFO:teuthology.orchestra.run.smithi059.stdout: "process_request_cap_release": 621 2024-09-19T06:24:50.665 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.665 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache": { 2024-09-19T06:24:50.665 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update": 15, 2024-09-19T06:24:50.665 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update_receipt": 0, 2024-09-19T06:24:50.665 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_try_discover": 0, 2024-09-19T06:24:50.665 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_send_discover": 0, 2024-09-19T06:24:50.666 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_handle_discover": 32, 2024-09-19T06:24:50.666 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays": 2, 2024-09-19T06:24:50.666 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_delayed": 0, 2024-09-19T06:24:50.666 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:24:50.666 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_created": 3, 2024-09-19T06:24:50.666 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_enqueued": 1, 2024-09-19T06:24:50.666 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_reintegrated": 0, 2024-09-19T06:24:50.667 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_migrated": 0, 2024-09-19T06:24:50.667 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_processing": 0, 2024-09-19T06:24:50.667 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:24:50.667 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:24:50.667 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_started": 0, 2024-09-19T06:24:50.667 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_completed": 0, 2024-09-19T06:24:50.667 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:24:50.667 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:24:50.667 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_enqueue_scrub": 18, 2024-09-19T06:24:50.667 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_exportdir": 0, 2024-09-19T06:24:50.667 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_flush": 0, 2024-09-19T06:24:50.667 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:24:50.667 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragstats": 0, 2024-09-19T06:24:50.667 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_inodestats": 0 2024-09-19T06:24:50.668 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.668 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log": { 2024-09-19T06:24:50.668 INFO:teuthology.orchestra.run.smithi059.stdout: "evlrg": 0, 2024-09-19T06:24:50.668 INFO:teuthology.orchestra.run.smithi059.stdout: "evadd": 2582, 2024-09-19T06:24:50.668 INFO:teuthology.orchestra.run.smithi059.stdout: "evex": 2548, 2024-09-19T06:24:50.668 INFO:teuthology.orchestra.run.smithi059.stdout: "evtrm": 2548, 2024-09-19T06:24:50.668 INFO:teuthology.orchestra.run.smithi059.stdout: "ev": 34, 2024-09-19T06:24:50.668 INFO:teuthology.orchestra.run.smithi059.stdout: "evexg": 0, 2024-09-19T06:24:50.668 INFO:teuthology.orchestra.run.smithi059.stdout: "evexd": 52, 2024-09-19T06:24:50.668 INFO:teuthology.orchestra.run.smithi059.stdout: "segadd": 58, 2024-09-19T06:24:50.668 INFO:teuthology.orchestra.run.smithi059.stdout: "segex": 57, 2024-09-19T06:24:50.668 INFO:teuthology.orchestra.run.smithi059.stdout: "segtrm": 57, 2024-09-19T06:24:50.668 INFO:teuthology.orchestra.run.smithi059.stdout: "seg": 1, 2024-09-19T06:24:50.669 INFO:teuthology.orchestra.run.smithi059.stdout: "segmjr": 1, 2024-09-19T06:24:50.669 INFO:teuthology.orchestra.run.smithi059.stdout: "segexg": 0, 2024-09-19T06:24:50.669 INFO:teuthology.orchestra.run.smithi059.stdout: "segexd": 1, 2024-09-19T06:24:50.669 INFO:teuthology.orchestra.run.smithi059.stdout: "expos": 27287083, 2024-09-19T06:24:50.669 INFO:teuthology.orchestra.run.smithi059.stdout: "wrpos": 27530944, 2024-09-19T06:24:50.669 INFO:teuthology.orchestra.run.smithi059.stdout: "rdpos": 0, 2024-09-19T06:24:50.669 INFO:teuthology.orchestra.run.smithi059.stdout: "jlat": { 2024-09-19T06:24:50.669 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2515, 2024-09-19T06:24:50.669 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 5.599176234, 2024-09-19T06:24:50.669 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.002226312 2024-09-19T06:24:50.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.669 INFO:teuthology.orchestra.run.smithi059.stdout: "replayed": 0 2024-09-19T06:24:50.669 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.670 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_mem": { 2024-09-19T06:24:50.670 INFO:teuthology.orchestra.run.smithi059.stdout: "ino": 35, 2024-09-19T06:24:50.670 INFO:teuthology.orchestra.run.smithi059.stdout: "ino+": 54, 2024-09-19T06:24:50.670 INFO:teuthology.orchestra.run.smithi059.stdout: "ino-": 19, 2024-09-19T06:24:50.670 INFO:teuthology.orchestra.run.smithi059.stdout: "dir": 20, 2024-09-19T06:24:50.670 INFO:teuthology.orchestra.run.smithi059.stdout: "dir+": 20, 2024-09-19T06:24:50.670 INFO:teuthology.orchestra.run.smithi059.stdout: "dir-": 0, 2024-09-19T06:24:50.670 INFO:teuthology.orchestra.run.smithi059.stdout: "dn": 42, 2024-09-19T06:24:50.670 INFO:teuthology.orchestra.run.smithi059.stdout: "dn+": 43, 2024-09-19T06:24:50.670 INFO:teuthology.orchestra.run.smithi059.stdout: "dn-": 1, 2024-09-19T06:24:50.670 INFO:teuthology.orchestra.run.smithi059.stdout: "cap": 2, 2024-09-19T06:24:50.670 INFO:teuthology.orchestra.run.smithi059.stdout: "cap+": 16, 2024-09-19T06:24:50.670 INFO:teuthology.orchestra.run.smithi059.stdout: "cap-": 14, 2024-09-19T06:24:50.671 INFO:teuthology.orchestra.run.smithi059.stdout: "rss": 57096, 2024-09-19T06:24:50.671 INFO:teuthology.orchestra.run.smithi059.stdout: "heap": 231712 2024-09-19T06:24:50.671 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.671 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_server": { 2024-09-19T06:24:50.671 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_client_request": 2036, 2024-09-19T06:24:50.671 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_server_request": 1, 2024-09-19T06:24:50.671 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_request": 779, 2024-09-19T06:24:50.671 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_session": 34, 2024-09-19T06:24:50.671 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_peer_request": 2, 2024-09-19T06:24:50.671 INFO:teuthology.orchestra.run.smithi059.stdout: "req_create_latency": { 2024-09-19T06:24:50.671 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 5, 2024-09-19T06:24:50.672 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.003876956, 2024-09-19T06:24:50.672 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000775391 2024-09-19T06:24:50.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.672 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getattr_latency": { 2024-09-19T06:24:50.672 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 119, 2024-09-19T06:24:50.672 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.021473976, 2024-09-19T06:24:50.672 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000180453 2024-09-19T06:24:50.672 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.672 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getfilelock_latency": { 2024-09-19T06:24:50.672 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:50.672 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:50.672 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:50.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.673 INFO:teuthology.orchestra.run.smithi059.stdout: "req_link_latency": { 2024-09-19T06:24:50.673 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:50.673 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:50.673 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:50.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.673 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookup_latency": { 2024-09-19T06:24:50.673 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2, 2024-09-19T06:24:50.673 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000320197, 2024-09-19T06:24:50.673 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000160098 2024-09-19T06:24:50.673 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.673 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookuphash_latency": { 2024-09-19T06:24:50.673 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:50.674 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:50.674 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:50.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.674 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupino_latency": { 2024-09-19T06:24:50.674 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:50.674 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:50.674 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:50.674 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.675 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupname_latency": { 2024-09-19T06:24:50.675 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:50.675 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:50.675 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:50.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.675 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupparent_latency": { 2024-09-19T06:24:50.675 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:50.675 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:50.675 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:50.675 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.675 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupsnap_latency": { 2024-09-19T06:24:50.675 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:50.675 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:50.676 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:50.676 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.676 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lssnap_latency": { 2024-09-19T06:24:50.676 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 12, 2024-09-19T06:24:50.676 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.001886722, 2024-09-19T06:24:50.677 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000157226 2024-09-19T06:24:50.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.677 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mkdir_latency": { 2024-09-19T06:24:50.677 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 8, 2024-09-19T06:24:50.677 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.012416219, 2024-09-19T06:24:50.677 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.001552027 2024-09-19T06:24:50.677 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.677 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mknod_latency": { 2024-09-19T06:24:50.677 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:50.678 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:50.678 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:50.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.678 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mksnap_latency": { 2024-09-19T06:24:50.678 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 12, 2024-09-19T06:24:50.678 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.060092729, 2024-09-19T06:24:50.678 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.005007727 2024-09-19T06:24:50.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.678 INFO:teuthology.orchestra.run.smithi059.stdout: "req_open_latency": { 2024-09-19T06:24:50.678 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1, 2024-09-19T06:24:50.678 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000172301, 2024-09-19T06:24:50.678 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000172301 2024-09-19T06:24:50.678 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.678 INFO:teuthology.orchestra.run.smithi059.stdout: "req_readdir_latency": { 2024-09-19T06:24:50.679 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2, 2024-09-19T06:24:50.679 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.004711122, 2024-09-19T06:24:50.679 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.002355561 2024-09-19T06:24:50.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.679 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rename_latency": { 2024-09-19T06:24:50.679 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2, 2024-09-19T06:24:50.679 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.002869549, 2024-09-19T06:24:50.679 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.001434774 2024-09-19T06:24:50.679 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.679 INFO:teuthology.orchestra.run.smithi059.stdout: "req_renamesnap_latency": { 2024-09-19T06:24:50.679 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:50.679 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:50.679 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:50.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.680 INFO:teuthology.orchestra.run.smithi059.stdout: "req_snapdiff_latency": { 2024-09-19T06:24:50.680 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:50.680 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:50.680 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:50.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.680 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmdir_latency": { 2024-09-19T06:24:50.680 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2, 2024-09-19T06:24:50.680 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.014423982, 2024-09-19T06:24:50.680 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.007211991 2024-09-19T06:24:50.680 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.680 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmsnap_latency": { 2024-09-19T06:24:50.681 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 6, 2024-09-19T06:24:50.681 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.028517140, 2024-09-19T06:24:50.681 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.004752856 2024-09-19T06:24:50.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.681 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmxattr_latency": { 2024-09-19T06:24:50.681 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:50.681 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:50.681 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:50.681 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.681 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setattr_latency": { 2024-09-19T06:24:50.681 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 600, 2024-09-19T06:24:50.681 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 3.102490298, 2024-09-19T06:24:50.681 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.005170817 2024-09-19T06:24:50.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.682 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setdirlayout_latency": { 2024-09-19T06:24:50.682 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:50.682 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:50.682 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:50.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.682 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setfilelock_latency": { 2024-09-19T06:24:50.682 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:50.682 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:50.682 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:50.682 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.683 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setlayout_latency": { 2024-09-19T06:24:50.683 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:50.683 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:50.683 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:50.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.683 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setxattr_latency": { 2024-09-19T06:24:50.683 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 7, 2024-09-19T06:24:50.683 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.017940080, 2024-09-19T06:24:50.683 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.002562868 2024-09-19T06:24:50.683 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.683 INFO:teuthology.orchestra.run.smithi059.stdout: "req_symlink_latency": { 2024-09-19T06:24:50.683 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:50.684 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:50.684 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:50.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.684 INFO:teuthology.orchestra.run.smithi059.stdout: "req_unlink_latency": { 2024-09-19T06:24:50.684 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1, 2024-09-19T06:24:50.684 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.001749329, 2024-09-19T06:24:50.684 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.001749329 2024-09-19T06:24:50.684 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.684 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:24:50.684 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:24:50.684 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getvxattr_latency": { 2024-09-19T06:24:50.684 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:50.684 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:50.685 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:50.685 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:50.685 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.685 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_sessions": { 2024-09-19T06:24:50.685 INFO:teuthology.orchestra.run.smithi059.stdout: "session_count": 2, 2024-09-19T06:24:50.685 INFO:teuthology.orchestra.run.smithi059.stdout: "session_add": 5, 2024-09-19T06:24:50.685 INFO:teuthology.orchestra.run.smithi059.stdout: "session_remove": 3, 2024-09-19T06:24:50.685 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_open": 2, 2024-09-19T06:24:50.685 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_stale": 0, 2024-09-19T06:24:50.686 INFO:teuthology.orchestra.run.smithi059.stdout: "total_load": 110, 2024-09-19T06:24:50.686 INFO:teuthology.orchestra.run.smithi059.stdout: "average_load": 55, 2024-09-19T06:24:50.686 INFO:teuthology.orchestra.run.smithi059.stdout: "avg_session_uptime": 729, 2024-09-19T06:24:50.686 INFO:teuthology.orchestra.run.smithi059.stdout: "mdthresh_evicted": 0 2024-09-19T06:24:50.686 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.686 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool": { 2024-09-19T06:24:50.686 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:24:50.686 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_items": 0, 2024-09-19T06:24:50.686 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:24:50.686 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:24:50.686 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:24:50.686 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:24:50.687 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:24:50.687 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:24:50.687 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:24:50.687 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:24:50.687 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:24:50.687 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:24:50.687 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:24:50.687 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:24:50.687 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:24:50.687 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_items": 0, 2024-09-19T06:24:50.687 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:24:50.687 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_items": 0, 2024-09-19T06:24:50.687 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:24:50.688 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:24:50.688 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:24:50.688 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:24:50.688 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:24:50.688 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:24:50.688 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:24:50.688 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_items": 0, 2024-09-19T06:24:50.688 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:24:50.688 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:24:50.688 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:24:50.688 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_items": 0, 2024-09-19T06:24:50.688 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_bytes": 0, 2024-09-19T06:24:50.688 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_items": 0, 2024-09-19T06:24:50.689 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:24:50.689 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:24:50.689 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:24:50.689 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:24:50.689 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_bytes": 315631, 2024-09-19T06:24:50.689 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_items": 126, 2024-09-19T06:24:50.689 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:24:50.689 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_items": 0, 2024-09-19T06:24:50.689 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bytes": 0, 2024-09-19T06:24:50.689 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_items": 0, 2024-09-19T06:24:50.689 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:24:50.689 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_items": 0, 2024-09-19T06:24:50.689 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:24:50.690 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_items": 0, 2024-09-19T06:24:50.690 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_bytes": 8320, 2024-09-19T06:24:50.690 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_items": 183, 2024-09-19T06:24:50.690 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:24:50.690 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:24:50.690 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_bytes": 0, 2024-09-19T06:24:50.690 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_items": 0, 2024-09-19T06:24:50.690 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_bytes": 177139, 2024-09-19T06:24:50.690 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_items": 1384, 2024-09-19T06:24:50.690 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_bytes": 0, 2024-09-19T06:24:50.690 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_items": 0, 2024-09-19T06:24:50.690 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_bytes": 0, 2024-09-19T06:24:50.690 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_items": 0 2024-09-19T06:24:50.690 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.691 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter": { 2024-09-19T06:24:50.691 INFO:teuthology.orchestra.run.smithi059.stdout: "op_active": 0, 2024-09-19T06:24:50.691 INFO:teuthology.orchestra.run.smithi059.stdout: "op_laggy": 0, 2024-09-19T06:24:50.691 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send": 4608, 2024-09-19T06:24:50.691 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send_bytes": 24509319, 2024-09-19T06:24:50.691 INFO:teuthology.orchestra.run.smithi059.stdout: "op_resend": 32, 2024-09-19T06:24:50.691 INFO:teuthology.orchestra.run.smithi059.stdout: "op_reply": 4608, 2024-09-19T06:24:50.691 INFO:teuthology.orchestra.run.smithi059.stdout: "op_latency": { 2024-09-19T06:24:50.691 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 4608, 2024-09-19T06:24:50.691 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 29.889602677, 2024-09-19T06:24:50.691 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.006486458 2024-09-19T06:24:50.691 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.691 INFO:teuthology.orchestra.run.smithi059.stdout: "op_inflight": 0, 2024-09-19T06:24:50.692 INFO:teuthology.orchestra.run.smithi059.stdout: "oplen_avg": { 2024-09-19T06:24:50.692 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 4608, 2024-09-19T06:24:50.692 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 5358 2024-09-19T06:24:50.692 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.692 INFO:teuthology.orchestra.run.smithi059.stdout: "op": 4608, 2024-09-19T06:24:50.692 INFO:teuthology.orchestra.run.smithi059.stdout: "op_r": 284, 2024-09-19T06:24:50.692 INFO:teuthology.orchestra.run.smithi059.stdout: "op_w": 4324, 2024-09-19T06:24:50.692 INFO:teuthology.orchestra.run.smithi059.stdout: "op_rmw": 0, 2024-09-19T06:24:50.692 INFO:teuthology.orchestra.run.smithi059.stdout: "op_pg": 0, 2024-09-19T06:24:50.692 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_stat": 332, 2024-09-19T06:24:50.692 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_create": 25, 2024-09-19T06:24:50.692 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_read": 19, 2024-09-19T06:24:50.692 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_write": 2516, 2024-09-19T06:24:50.693 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writefull": 181, 2024-09-19T06:24:50.693 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writesame": 0, 2024-09-19T06:24:50.693 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_append": 0, 2024-09-19T06:24:50.693 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_zero": 0, 2024-09-19T06:24:50.693 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_truncate": 0, 2024-09-19T06:24:50.693 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_delete": 523, 2024-09-19T06:24:50.693 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_mapext": 0, 2024-09-19T06:24:50.693 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_sparse_read": 0, 2024-09-19T06:24:50.693 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_clonerange": 0, 2024-09-19T06:24:50.693 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_getxattr": 265, 2024-09-19T06:24:50.693 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_setxattr": 50, 2024-09-19T06:24:50.694 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:24:50.694 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_rmxattr": 0, 2024-09-19T06:24:50.694 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:24:50.694 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_call": 0, 2024-09-19T06:24:50.694 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_watch": 0, 2024-09-19T06:24:50.694 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_notify": 0, 2024-09-19T06:24:50.694 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:24:50.694 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls": 0, 2024-09-19T06:24:50.694 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:24:50.694 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_other": 599, 2024-09-19T06:24:50.694 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_active": 0, 2024-09-19T06:24:50.694 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_send": 0, 2024-09-19T06:24:50.694 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_resend": 0, 2024-09-19T06:24:50.695 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_ping": 0, 2024-09-19T06:24:50.695 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_active": 0, 2024-09-19T06:24:50.695 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_send": 0, 2024-09-19T06:24:50.695 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_resend": 0, 2024-09-19T06:24:50.695 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_active": 0, 2024-09-19T06:24:50.695 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_send": 0, 2024-09-19T06:24:50.695 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_resend": 0, 2024-09-19T06:24:50.695 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_active": 0, 2024-09-19T06:24:50.695 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_send": 0, 2024-09-19T06:24:50.695 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_resend": 0, 2024-09-19T06:24:50.695 INFO:teuthology.orchestra.run.smithi059.stdout: "command_active": 0, 2024-09-19T06:24:50.695 INFO:teuthology.orchestra.run.smithi059.stdout: "command_send": 0, 2024-09-19T06:24:50.695 INFO:teuthology.orchestra.run.smithi059.stdout: "command_resend": 0, 2024-09-19T06:24:50.696 INFO:teuthology.orchestra.run.smithi059.stdout: "map_epoch": 101, 2024-09-19T06:24:50.696 INFO:teuthology.orchestra.run.smithi059.stdout: "map_full": 0, 2024-09-19T06:24:50.696 INFO:teuthology.orchestra.run.smithi059.stdout: "map_inc": 15, 2024-09-19T06:24:50.696 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_sessions": 12, 2024-09-19T06:24:50.696 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_open": 12, 2024-09-19T06:24:50.696 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_close": 0, 2024-09-19T06:24:50.696 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_laggy": 0, 2024-09-19T06:24:50.696 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_wr": 836, 2024-09-19T06:24:50.696 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_rd": 0, 2024-09-19T06:24:50.696 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_del": 12 2024-09-19T06:24:50.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.696 INFO:teuthology.orchestra.run.smithi059.stdout: "oft": { 2024-09-19T06:24:50.696 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_objs": 1, 2024-09-19T06:24:50.697 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:24:50.697 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_updates": 0, 2024-09-19T06:24:50.697 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_removes": 0 2024-09-19T06:24:50.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.697 INFO:teuthology.orchestra.run.smithi059.stdout: "osd-slow-ops": { 2024-09-19T06:24:50.697 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_ops_count": 0 2024-09-19T06:24:50.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.697 INFO:teuthology.orchestra.run.smithi059.stdout: "purge_queue": { 2024-09-19T06:24:50.697 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops": 0, 2024-09-19T06:24:50.697 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops_high_water": 1, 2024-09-19T06:24:50.697 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing": 0, 2024-09-19T06:24:50.697 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_high_water": 1, 2024-09-19T06:24:50.697 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed_ops": 1, 2024-09-19T06:24:50.698 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed": 1, 2024-09-19T06:24:50.698 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_item_in_journal": 0 2024-09-19T06:24:50.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.698 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:24:50.698 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-19T06:24:50.698 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-09-19T06:24:50.698 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-19T06:24:50.698 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 12149, 2024-09-19T06:24:50.698 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 4683554, 2024-09-19T06:24:50.698 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:50.699 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 12149, 2024-09-19T06:24:50.699 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-09-19T06:24:50.699 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-09-19T06:24:50.699 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 12149, 2024-09-19T06:24:50.699 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 4683554, 2024-09-19T06:24:50.699 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-19T06:24:50.699 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:50.699 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:50.700 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:50.700 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:50.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.700 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_bytes": { 2024-09-19T06:24:50.700 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-19T06:24:50.700 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-09-19T06:24:50.700 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-19T06:24:50.700 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-09-19T06:24:50.700 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-09-19T06:24:50.700 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:50.700 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:50.701 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 4608, 2024-09-19T06:24:50.701 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 24509468, 2024-09-19T06:24:50.701 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 4608, 2024-09-19T06:24:50.701 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 24509468, 2024-09-19T06:24:50.701 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-19T06:24:50.701 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:50.701 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:50.701 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:50.701 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:50.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.701 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_ops": { 2024-09-19T06:24:50.701 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-19T06:24:50.701 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1024, 2024-09-19T06:24:50.702 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-19T06:24:50.702 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-09-19T06:24:50.702 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-09-19T06:24:50.702 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:50.702 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:50.702 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 4608, 2024-09-19T06:24:50.702 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 4608, 2024-09-19T06:24:50.702 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 4608, 2024-09-19T06:24:50.702 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 4608, 2024-09-19T06:24:50.702 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-19T06:24:50.702 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:50.703 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:50.703 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:50.703 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:50.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.703 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:24:50.703 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-19T06:24:50.703 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-09-19T06:24:50.703 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-19T06:24:50.703 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 1, 2024-09-19T06:24:50.703 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 149, 2024-09-19T06:24:50.703 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:50.703 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 1, 2024-09-19T06:24:50.703 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-09-19T06:24:50.704 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-09-19T06:24:50.704 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 1, 2024-09-19T06:24:50.704 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 149, 2024-09-19T06:24:50.704 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-19T06:24:50.704 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:50.704 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:50.704 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:50.704 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:50.704 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:50.704 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle-0x55d1524fc500": { 2024-09-19T06:24:50.704 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-19T06:24:50.704 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-09-19T06:24:50.704 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-19T06:24:50.704 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 2582, 2024-09-19T06:24:50.705 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 23336640, 2024-09-19T06:24:50.705 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:50.705 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 2582, 2024-09-19T06:24:50.705 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-09-19T06:24:50.705 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-09-19T06:24:50.705 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 2515, 2024-09-19T06:24:50.705 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 23336640, 2024-09-19T06:24:50.705 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-19T06:24:50.705 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:50.705 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:50.705 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:50.705 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:50.705 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:50.705 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-19T06:24:51.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:51 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:24:51.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:51 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:24:51.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:51 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:24:51.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:51 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:24:51.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:51 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:24:51.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:51 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:24:51.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:51 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:24:51.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:51 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:24:51.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:51 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:24:51.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:51 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:24:51.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:51 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:24:51.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:51 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' 2024-09-19T06:24:51.692 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-19T06:24:51.692 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-19T06:24:51.692 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=15 2024-09-19T06:24:51.692 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-09-19T06:24:51.692 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-19T06:24:51.692 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=12 2024-09-19T06:24:51.692 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=6 2024-09-19T06:24:51.692 DEBUG:tasks.check_counter:Getting stats from e 2024-09-19T06:24:51.693 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-19T06:24:51.942 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:24:52.327 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:52 smithi059 ceph-mon[35138]: pgmap v389: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:24:52.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:52 smithi003 ceph-mon[30893]: pgmap v389: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:24:52.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:52 smithi071 ceph-mon[35662]: pgmap v389: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:24:52.436 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-19T06:24:52.437 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:24:52.437 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 894, 2024-09-19T06:24:52.437 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 896, 2024-09-19T06:24:52.437 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 300518, 2024-09-19T06:24:52.437 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 284299, 2024-09-19T06:24:52.437 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 6, 2024-09-19T06:24:52.437 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 2, 2024-09-19T06:24:52.437 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.101183646, 2024-09-19T06:24:52.437 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.041945871, 2024-09-19T06:24:52.437 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.022545638, 2024-09-19T06:24:52.437 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.025688856, 2024-09-19T06:24:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 894, 2024-09-19T06:24:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.046703788, 2024-09-19T06:24:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000052241 2024-09-19T06:24:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:24:52.438 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:24:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:24:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 1928, 2024-09-19T06:24:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 1908, 2024-09-19T06:24:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 2214423, 2024-09-19T06:24:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 677586, 2024-09-19T06:24:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 4, 2024-09-19T06:24:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 3, 2024-09-19T06:24:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.158730730, 2024-09-19T06:24:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.046029033, 2024-09-19T06:24:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.081103566, 2024-09-19T06:24:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.041573369, 2024-09-19T06:24:52.439 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1908, 2024-09-19T06:24:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.064690328, 2024-09-19T06:24:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000033904 2024-09-19T06:24:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 1795312, 2024-09-19T06:24:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 156640 2024-09-19T06:24:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.440 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:24:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 3, 2024-09-19T06:24:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 190, 2024-09-19T06:24:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 588, 2024-09-19T06:24:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 490558, 2024-09-19T06:24:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 6, 2024-09-19T06:24:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 4, 2024-09-19T06:24:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.011858644, 2024-09-19T06:24:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.007712500, 2024-09-19T06:24:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.001953361, 2024-09-19T06:24:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000028882, 2024-09-19T06:24:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:52.441 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 187, 2024-09-19T06:24:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.019958784, 2024-09-19T06:24:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000106731 2024-09-19T06:24:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:24:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 490240 2024-09-19T06:24:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: "cct": { 2024-09-19T06:24:52.442 INFO:teuthology.orchestra.run.smithi059.stdout: "total_workers": 1, 2024-09-19T06:24:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: "unhealthy_workers": 0 2024-09-19T06:24:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-MDSRank": { 2024-09-19T06:24:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-09-19T06:24:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-09-19T06:24:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 4287, 2024-09-19T06:24:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.106081182, 2024-09-19T06:24:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000024744 2024-09-19T06:24:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-PurgeQueue": { 2024-09-19T06:24:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-09-19T06:24:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-09-19T06:24:52.443 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2024-09-19T06:24:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: "request": 0, 2024-09-19T06:24:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: "reply": 0, 2024-09-19T06:24:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: "reply_latency": { 2024-09-19T06:24:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.444 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_reply": 0, 2024-09-19T06:24:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "forward": 0, 2024-09-19T06:24:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_complete": 0, 2024-09-19T06:24:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_keys": 0, 2024-09-19T06:24:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_commit": 0, 2024-09-19T06:24:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_split": 0, 2024-09-19T06:24:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_merge": 0, 2024-09-19T06:24:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes": 0, 2024-09-19T06:24:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_top": 0, 2024-09-19T06:24:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_bottom": 0, 2024-09-19T06:24:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pin_tail": 0, 2024-09-19T06:24:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pinned": 0, 2024-09-19T06:24:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_expired": 0, 2024-09-19T06:24:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_with_caps": 0, 2024-09-19T06:24:52.445 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": 0, 2024-09-19T06:24:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "subtrees": 1, 2024-09-19T06:24:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse": 0, 2024-09-19T06:24:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_hit": 0, 2024-09-19T06:24:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_forward": 0, 2024-09-19T06:24:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_discover": 0, 2024-09-19T06:24:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:24:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_remote_ino": 0, 2024-09-19T06:24:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_lock": 0, 2024-09-19T06:24:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "load_cent": 0, 2024-09-19T06:24:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "q": 0, 2024-09-19T06:24:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "exported": 0, 2024-09-19T06:24:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "exported_inodes": 0, 2024-09-19T06:24:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "imported": 0, 2024-09-19T06:24:52.446 INFO:teuthology.orchestra.run.smithi059.stdout: "imported_inodes": 0, 2024-09-19T06:24:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_dir_fetch": 0, 2024-09-19T06:24:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_backtrace_fetch": 0, 2024-09-19T06:24:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_peer_discover": 0, 2024-09-19T06:24:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rfiles": 0, 2024-09-19T06:24:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rbytes": 0, 2024-09-19T06:24:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rsnaps": 0, 2024-09-19T06:24:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T06:24:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_set_tag": 0, 2024-09-19T06:24:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:24:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:24:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:24:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:24:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:24:52.447 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_file_inodes": 0, 2024-09-19T06:24:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:24:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T06:24:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_grant": 0, 2024-09-19T06:24:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:24:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:24:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:24:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps": 0, 2024-09-19T06:24:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps_dirty": 0, 2024-09-19T06:24:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_cap_release": 0, 2024-09-19T06:24:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: "process_request_cap_release": 0 2024-09-19T06:24:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.448 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache": { 2024-09-19T06:24:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update": 0, 2024-09-19T06:24:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update_receipt": 0, 2024-09-19T06:24:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_try_discover": 0, 2024-09-19T06:24:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_send_discover": 0, 2024-09-19T06:24:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_handle_discover": 0, 2024-09-19T06:24:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays": 0, 2024-09-19T06:24:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_delayed": 0, 2024-09-19T06:24:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:24:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_created": 0, 2024-09-19T06:24:52.449 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_enqueued": 0, 2024-09-19T06:24:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_reintegrated": 0, 2024-09-19T06:24:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_migrated": 0, 2024-09-19T06:24:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_processing": 0, 2024-09-19T06:24:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:24:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:24:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_started": 0, 2024-09-19T06:24:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_completed": 0, 2024-09-19T06:24:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:24:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:24:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:24:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_exportdir": 0, 2024-09-19T06:24:52.450 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_flush": 0, 2024-09-19T06:24:52.451 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:24:52.451 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragstats": 0, 2024-09-19T06:24:52.451 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_inodestats": 0 2024-09-19T06:24:52.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.451 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log": { 2024-09-19T06:24:52.451 INFO:teuthology.orchestra.run.smithi059.stdout: "evlrg": 0, 2024-09-19T06:24:52.451 INFO:teuthology.orchestra.run.smithi059.stdout: "evadd": 0, 2024-09-19T06:24:52.451 INFO:teuthology.orchestra.run.smithi059.stdout: "evex": 0, 2024-09-19T06:24:52.451 INFO:teuthology.orchestra.run.smithi059.stdout: "evtrm": 0, 2024-09-19T06:24:52.451 INFO:teuthology.orchestra.run.smithi059.stdout: "ev": 10, 2024-09-19T06:24:52.451 INFO:teuthology.orchestra.run.smithi059.stdout: "evexg": 0, 2024-09-19T06:24:52.451 INFO:teuthology.orchestra.run.smithi059.stdout: "evexd": 0, 2024-09-19T06:24:52.451 INFO:teuthology.orchestra.run.smithi059.stdout: "segadd": 0, 2024-09-19T06:24:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: "segex": 0, 2024-09-19T06:24:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: "segtrm": 0, 2024-09-19T06:24:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: "seg": 2, 2024-09-19T06:24:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: "segmjr": 2, 2024-09-19T06:24:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: "segexg": 0, 2024-09-19T06:24:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: "segexd": 0, 2024-09-19T06:24:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: "expos": 4194304, 2024-09-19T06:24:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: "wrpos": 4197198, 2024-09-19T06:24:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: "rdpos": 4197057, 2024-09-19T06:24:52.452 INFO:teuthology.orchestra.run.smithi059.stdout: "jlat": { 2024-09-19T06:24:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "replayed": 10 2024-09-19T06:24:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_mem": { 2024-09-19T06:24:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "ino": 3, 2024-09-19T06:24:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "ino+": 3, 2024-09-19T06:24:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "ino-": 0, 2024-09-19T06:24:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "dir": 1, 2024-09-19T06:24:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "dir+": 1, 2024-09-19T06:24:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "dir-": 0, 2024-09-19T06:24:52.453 INFO:teuthology.orchestra.run.smithi059.stdout: "dn": 0, 2024-09-19T06:24:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: "dn+": 0, 2024-09-19T06:24:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: "dn-": 0, 2024-09-19T06:24:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: "cap": 0, 2024-09-19T06:24:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: "cap+": 0, 2024-09-19T06:24:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: "cap-": 0, 2024-09-19T06:24:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: "rss": 48332, 2024-09-19T06:24:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: "heap": 215328 2024-09-19T06:24:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_server": { 2024-09-19T06:24:52.454 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_client_request": 0, 2024-09-19T06:24:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_server_request": 0, 2024-09-19T06:24:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_request": 0, 2024-09-19T06:24:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_session": 0, 2024-09-19T06:24:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_peer_request": 0, 2024-09-19T06:24:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "req_create_latency": { 2024-09-19T06:24:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getattr_latency": { 2024-09-19T06:24:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getfilelock_latency": { 2024-09-19T06:24:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: "req_link_latency": { 2024-09-19T06:24:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookup_latency": { 2024-09-19T06:24:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.456 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookuphash_latency": { 2024-09-19T06:24:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupino_latency": { 2024-09-19T06:24:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.458 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupname_latency": { 2024-09-19T06:24:52.458 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.458 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.458 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.458 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupparent_latency": { 2024-09-19T06:24:52.458 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.458 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.458 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupsnap_latency": { 2024-09-19T06:24:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lssnap_latency": { 2024-09-19T06:24:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.459 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mkdir_latency": { 2024-09-19T06:24:52.460 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.460 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.460 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.460 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mknod_latency": { 2024-09-19T06:24:52.460 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.460 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.460 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.460 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mksnap_latency": { 2024-09-19T06:24:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: "req_open_latency": { 2024-09-19T06:24:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: "req_readdir_latency": { 2024-09-19T06:24:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.461 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.462 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.462 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rename_latency": { 2024-09-19T06:24:52.462 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.462 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.462 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.462 INFO:teuthology.orchestra.run.smithi059.stdout: "req_renamesnap_latency": { 2024-09-19T06:24:52.462 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.462 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: "req_snapdiff_latency": { 2024-09-19T06:24:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmdir_latency": { 2024-09-19T06:24:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmsnap_latency": { 2024-09-19T06:24:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmxattr_latency": { 2024-09-19T06:24:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setattr_latency": { 2024-09-19T06:24:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.464 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setdirlayout_latency": { 2024-09-19T06:24:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setfilelock_latency": { 2024-09-19T06:24:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setlayout_latency": { 2024-09-19T06:24:52.465 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setxattr_latency": { 2024-09-19T06:24:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: "req_symlink_latency": { 2024-09-19T06:24:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: "req_unlink_latency": { 2024-09-19T06:24:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:24:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:24:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getvxattr_latency": { 2024-09-19T06:24:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_sessions": { 2024-09-19T06:24:52.467 INFO:teuthology.orchestra.run.smithi059.stdout: "session_count": 2, 2024-09-19T06:24:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: "session_add": 5, 2024-09-19T06:24:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: "session_remove": 3, 2024-09-19T06:24:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_open": 4, 2024-09-19T06:24:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_stale": 0, 2024-09-19T06:24:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: "total_load": 0, 2024-09-19T06:24:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: "average_load": 0, 2024-09-19T06:24:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: "avg_session_uptime": 3586, 2024-09-19T06:24:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: "mdthresh_evicted": 0 2024-09-19T06:24:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool": { 2024-09-19T06:24:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:24:52.468 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_items": 0, 2024-09-19T06:24:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:24:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:24:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:24:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:24:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:24:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:24:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:24:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:24:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:24:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:24:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:24:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:24:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:24:52.469 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_items": 0, 2024-09-19T06:24:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:24:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_items": 0, 2024-09-19T06:24:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:24:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:24:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:24:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:24:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:24:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:24:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:24:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_items": 0, 2024-09-19T06:24:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:24:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:24:52.470 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:24:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_items": 0, 2024-09-19T06:24:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_bytes": 0, 2024-09-19T06:24:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_items": 0, 2024-09-19T06:24:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:24:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:24:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:24:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:24:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_bytes": 189410, 2024-09-19T06:24:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_items": 52, 2024-09-19T06:24:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:24:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_items": 0, 2024-09-19T06:24:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bytes": 0, 2024-09-19T06:24:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_items": 0, 2024-09-19T06:24:52.471 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:24:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_items": 0, 2024-09-19T06:24:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:24:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_items": 0, 2024-09-19T06:24:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_bytes": 8320, 2024-09-19T06:24:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_items": 183, 2024-09-19T06:24:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:24:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:24:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_bytes": 0, 2024-09-19T06:24:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_items": 0, 2024-09-19T06:24:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_bytes": 8512, 2024-09-19T06:24:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_items": 13, 2024-09-19T06:24:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_bytes": 0, 2024-09-19T06:24:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_items": 0, 2024-09-19T06:24:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_bytes": 0, 2024-09-19T06:24:52.472 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_items": 0 2024-09-19T06:24:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter": { 2024-09-19T06:24:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "op_active": 0, 2024-09-19T06:24:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "op_laggy": 0, 2024-09-19T06:24:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send": 2533, 2024-09-19T06:24:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send_bytes": 21, 2024-09-19T06:24:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "op_resend": 3, 2024-09-19T06:24:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "op_reply": 2533, 2024-09-19T06:24:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "op_latency": { 2024-09-19T06:24:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2533, 2024-09-19T06:24:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 1.386981423, 2024-09-19T06:24:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000547564 2024-09-19T06:24:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.473 INFO:teuthology.orchestra.run.smithi059.stdout: "op_inflight": 0, 2024-09-19T06:24:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "oplen_avg": { 2024-09-19T06:24:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2533, 2024-09-19T06:24:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 2534 2024-09-19T06:24:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "op": 2533, 2024-09-19T06:24:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "op_r": 2533, 2024-09-19T06:24:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "op_w": 0, 2024-09-19T06:24:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "op_rmw": 0, 2024-09-19T06:24:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "op_pg": 0, 2024-09-19T06:24:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_stat": 1646, 2024-09-19T06:24:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_create": 0, 2024-09-19T06:24:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_read": 885, 2024-09-19T06:24:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_write": 0, 2024-09-19T06:24:52.474 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writefull": 0, 2024-09-19T06:24:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writesame": 0, 2024-09-19T06:24:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_append": 0, 2024-09-19T06:24:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_zero": 0, 2024-09-19T06:24:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_truncate": 0, 2024-09-19T06:24:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_delete": 0, 2024-09-19T06:24:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_mapext": 0, 2024-09-19T06:24:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_sparse_read": 0, 2024-09-19T06:24:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_clonerange": 0, 2024-09-19T06:24:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_getxattr": 1, 2024-09-19T06:24:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_setxattr": 0, 2024-09-19T06:24:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:24:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_rmxattr": 0, 2024-09-19T06:24:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:24:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_call": 0, 2024-09-19T06:24:52.475 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_watch": 0, 2024-09-19T06:24:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_notify": 0, 2024-09-19T06:24:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:24:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls": 0, 2024-09-19T06:24:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:24:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_other": 0, 2024-09-19T06:24:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_active": 0, 2024-09-19T06:24:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_send": 0, 2024-09-19T06:24:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_resend": 0, 2024-09-19T06:24:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_ping": 0, 2024-09-19T06:24:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_active": 0, 2024-09-19T06:24:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_send": 0, 2024-09-19T06:24:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_resend": 0, 2024-09-19T06:24:52.476 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_active": 0, 2024-09-19T06:24:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_send": 0, 2024-09-19T06:24:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_resend": 0, 2024-09-19T06:24:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_active": 0, 2024-09-19T06:24:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_send": 0, 2024-09-19T06:24:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_resend": 0, 2024-09-19T06:24:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: "command_active": 0, 2024-09-19T06:24:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: "command_send": 0, 2024-09-19T06:24:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: "command_resend": 0, 2024-09-19T06:24:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: "map_epoch": 101, 2024-09-19T06:24:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: "map_full": 0, 2024-09-19T06:24:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: "map_inc": 15, 2024-09-19T06:24:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_sessions": 5, 2024-09-19T06:24:52.477 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_open": 5, 2024-09-19T06:24:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_close": 0, 2024-09-19T06:24:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_laggy": 0, 2024-09-19T06:24:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_wr": 0, 2024-09-19T06:24:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_rd": 2, 2024-09-19T06:24:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_del": 0 2024-09-19T06:24:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: "oft": { 2024-09-19T06:24:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_objs": 0, 2024-09-19T06:24:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:24:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_updates": 0, 2024-09-19T06:24:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_removes": 0 2024-09-19T06:24:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: "osd-slow-ops": { 2024-09-19T06:24:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_ops_count": 0 2024-09-19T06:24:52.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "purge_queue": { 2024-09-19T06:24:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops": 0, 2024-09-19T06:24:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T06:24:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing": 0, 2024-09-19T06:24:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_high_water": 0, 2024-09-19T06:24:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed_ops": 0, 2024-09-19T06:24:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed": 0, 2024-09-19T06:24:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_item_in_journal": 0 2024-09-19T06:24:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:24:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-19T06:24:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-09-19T06:24:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-19T06:24:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 2821, 2024-09-19T06:24:52.479 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 2244010, 2024-09-19T06:24:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 2821, 2024-09-19T06:24:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-09-19T06:24:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-09-19T06:24:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 2821, 2024-09-19T06:24:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 2244010, 2024-09-19T06:24:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-19T06:24:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_bytes": { 2024-09-19T06:24:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-19T06:24:52.480 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-09-19T06:24:52.481 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-19T06:24:52.481 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-09-19T06:24:52.481 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-09-19T06:24:52.481 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:52.481 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:52.481 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 2533, 2024-09-19T06:24:52.481 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 2899, 2024-09-19T06:24:52.481 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 2533, 2024-09-19T06:24:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 2899, 2024-09-19T06:24:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-19T06:24:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_ops": { 2024-09-19T06:24:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-19T06:24:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1024, 2024-09-19T06:24:52.482 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-19T06:24:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-09-19T06:24:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-09-19T06:24:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 2533, 2024-09-19T06:24:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 2533, 2024-09-19T06:24:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 2533, 2024-09-19T06:24:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 2533, 2024-09-19T06:24:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-19T06:24:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:52.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:24:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-19T06:24:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-09-19T06:24:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-19T06:24:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-09-19T06:24:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-09-19T06:24:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-09-19T06:24:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-09-19T06:24:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 0, 2024-09-19T06:24:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 0, 2024-09-19T06:24:52.484 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-19T06:24:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle-0x56267d5f86e0": { 2024-09-19T06:24:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-19T06:24:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-09-19T06:24:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-19T06:24:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-09-19T06:24:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-09-19T06:24:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:52.485 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-09-19T06:24:52.486 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-09-19T06:24:52.486 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 0, 2024-09-19T06:24:52.486 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 0, 2024-09-19T06:24:52.486 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-19T06:24:52.486 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:52.486 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:52.486 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:52.486 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:52.486 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:52.486 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-19T06:24:53.177 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-19T06:24:53.177 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-19T06:24:53.177 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-19T06:24:53.177 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-19T06:24:53.177 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-09-19T06:24:53.177 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:24:53.177 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:24:53.178 DEBUG:tasks.check_counter:Getting stats from h 2024-09-19T06:24:53.178 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-19T06:24:53.428 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:24:53.950 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-19T06:24:53.950 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:24:53.950 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 87, 2024-09-19T06:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 238, 2024-09-19T06:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 32161, 2024-09-19T06:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 442277, 2024-09-19T06:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 15, 2024-09-19T06:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 2, 2024-09-19T06:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.023838060, 2024-09-19T06:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.009092419, 2024-09-19T06:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.009130462, 2024-09-19T06:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000490543, 2024-09-19T06:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:53.952 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 237, 2024-09-19T06:24:53.952 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.046998726, 2024-09-19T06:24:53.952 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000198306 2024-09-19T06:24:53.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.952 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:53.952 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 112, 2024-09-19T06:24:53.952 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000024374, 2024-09-19T06:24:53.952 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000217 2024-09-19T06:24:53.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.952 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-19T06:24:53.952 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 359376 2024-09-19T06:24:53.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.953 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:24:53.953 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 126, 2024-09-19T06:24:53.953 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 199, 2024-09-19T06:24:53.953 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 37428, 2024-09-19T06:24:53.953 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 594165, 2024-09-19T06:24:53.953 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 46, 2024-09-19T06:24:53.953 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 6, 2024-09-19T06:24:53.953 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.033479788, 2024-09-19T06:24:53.953 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.008858194, 2024-09-19T06:24:53.954 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.022486394, 2024-09-19T06:24:53.954 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000366289, 2024-09-19T06:24:53.954 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:53.954 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 196, 2024-09-19T06:24:53.954 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.024311344, 2024-09-19T06:24:53.954 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000124037 2024-09-19T06:24:53.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.954 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:53.954 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 186, 2024-09-19T06:24:53.954 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000070288, 2024-09-19T06:24:53.954 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000377 2024-09-19T06:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 2016, 2024-09-19T06:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 135616 2024-09-19T06:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 1718, 2024-09-19T06:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 1277, 2024-09-19T06:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 2194584, 2024-09-19T06:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 526631, 2024-09-19T06:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 8, 2024-09-19T06:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 5, 2024-09-19T06:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.180491222, 2024-09-19T06:24:53.956 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.078349139, 2024-09-19T06:24:53.956 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.126995575, 2024-09-19T06:24:53.956 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.004903107, 2024-09-19T06:24:53.956 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:53.956 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1276, 2024-09-19T06:24:53.956 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.066464247, 2024-09-19T06:24:53.956 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000052087 2024-09-19T06:24:53.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.956 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:53.956 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2273, 2024-09-19T06:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000556801, 2024-09-19T06:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000244 2024-09-19T06:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 1804784, 2024-09-19T06:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 159552 2024-09-19T06:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: "cct": { 2024-09-19T06:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: "total_workers": 1, 2024-09-19T06:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: "unhealthy_workers": 0 2024-09-19T06:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-MDSRank": { 2024-09-19T06:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-09-19T06:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-09-19T06:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 56, 2024-09-19T06:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.001594226, 2024-09-19T06:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000028468 2024-09-19T06:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-PurgeQueue": { 2024-09-19T06:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-09-19T06:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-09-19T06:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2, 2024-09-19T06:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000014816, 2024-09-19T06:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000007408 2024-09-19T06:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2024-09-19T06:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: "request": 4, 2024-09-19T06:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: "reply": 3, 2024-09-19T06:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: "reply_latency": { 2024-09-19T06:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 3, 2024-09-19T06:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000518043, 2024-09-19T06:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000172681 2024-09-19T06:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_reply": 0, 2024-09-19T06:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: "forward": 1, 2024-09-19T06:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_complete": 0, 2024-09-19T06:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_keys": 0, 2024-09-19T06:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_commit": 11, 2024-09-19T06:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_split": 0, 2024-09-19T06:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_merge": 0, 2024-09-19T06:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes": 16, 2024-09-19T06:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_top": 0, 2024-09-19T06:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_bottom": 16, 2024-09-19T06:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pin_tail": 0, 2024-09-19T06:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pinned": 13, 2024-09-19T06:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_expired": 4, 2024-09-19T06:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_with_caps": 1, 2024-09-19T06:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": 1, 2024-09-19T06:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: "subtrees": 3, 2024-09-19T06:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse": 12, 2024-09-19T06:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_hit": 8, 2024-09-19T06:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_forward": 1, 2024-09-19T06:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_discover": 3, 2024-09-19T06:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_remote_ino": 0, 2024-09-19T06:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_lock": 0, 2024-09-19T06:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: "load_cent": 0, 2024-09-19T06:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: "q": 0, 2024-09-19T06:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: "exported": 0, 2024-09-19T06:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: "exported_inodes": 0, 2024-09-19T06:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: "imported": 0, 2024-09-19T06:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: "imported_inodes": 0, 2024-09-19T06:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_dir_fetch": 0, 2024-09-19T06:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_backtrace_fetch": 0, 2024-09-19T06:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_peer_discover": 0, 2024-09-19T06:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rfiles": 5, 2024-09-19T06:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rbytes": 298, 2024-09-19T06:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rsnaps": 6, 2024-09-19T06:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T06:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_set_tag": 0, 2024-09-19T06:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_file_inodes": 0, 2024-09-19T06:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T06:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_grant": 0, 2024-09-19T06:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps": 0, 2024-09-19T06:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps_dirty": 0, 2024-09-19T06:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_cap_release": 0, 2024-09-19T06:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: "process_request_cap_release": 0 2024-09-19T06:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache": { 2024-09-19T06:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update": 0, 2024-09-19T06:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update_receipt": 11, 2024-09-19T06:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_try_discover": 7, 2024-09-19T06:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_send_discover": 8, 2024-09-19T06:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_handle_discover": 0, 2024-09-19T06:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays": 0, 2024-09-19T06:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_delayed": 0, 2024-09-19T06:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_created": 0, 2024-09-19T06:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_enqueued": 0, 2024-09-19T06:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_reintegrated": 0, 2024-09-19T06:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_migrated": 0, 2024-09-19T06:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_processing": 0, 2024-09-19T06:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_started": 0, 2024-09-19T06:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_completed": 0, 2024-09-19T06:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_exportdir": 0, 2024-09-19T06:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_flush": 0, 2024-09-19T06:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragstats": 0, 2024-09-19T06:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_inodestats": 0 2024-09-19T06:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log": { 2024-09-19T06:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: "evlrg": 0, 2024-09-19T06:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: "evadd": 5, 2024-09-19T06:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: "evex": 0, 2024-09-19T06:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: "evtrm": 0, 2024-09-19T06:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: "ev": 5, 2024-09-19T06:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: "evexg": 0, 2024-09-19T06:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: "evexd": 0, 2024-09-19T06:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: "segadd": 2, 2024-09-19T06:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: "segex": 0, 2024-09-19T06:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: "segtrm": 0, 2024-09-19T06:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: "seg": 2, 2024-09-19T06:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: "segmjr": 2, 2024-09-19T06:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: "segexg": 0, 2024-09-19T06:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: "segexd": 0, 2024-09-19T06:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: "expos": 4194304, 2024-09-19T06:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: "wrpos": 4195737, 2024-09-19T06:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: "rdpos": 0, 2024-09-19T06:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: "jlat": { 2024-09-19T06:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 4, 2024-09-19T06:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.009897622, 2024-09-19T06:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.002474405 2024-09-19T06:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: "replayed": 0 2024-09-19T06:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_mem": { 2024-09-19T06:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: "ino": 20, 2024-09-19T06:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: "ino+": 22, 2024-09-19T06:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: "ino-": 2, 2024-09-19T06:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: "dir": 19, 2024-09-19T06:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: "dir+": 23, 2024-09-19T06:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: "dir-": 4, 2024-09-19T06:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: "dn": 16, 2024-09-19T06:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: "dn+": 20, 2024-09-19T06:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: "dn-": 4, 2024-09-19T06:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: "cap": 1, 2024-09-19T06:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: "cap+": 3, 2024-09-19T06:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: "cap-": 2, 2024-09-19T06:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: "rss": 50336, 2024-09-19T06:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: "heap": 223520 2024-09-19T06:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_server": { 2024-09-19T06:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_client_request": 4, 2024-09-19T06:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_server_request": 0, 2024-09-19T06:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_request": 4, 2024-09-19T06:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_session": 14, 2024-09-19T06:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_peer_request": 0, 2024-09-19T06:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: "req_create_latency": { 2024-09-19T06:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getattr_latency": { 2024-09-19T06:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1, 2024-09-19T06:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000186291, 2024-09-19T06:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000186291 2024-09-19T06:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getfilelock_latency": { 2024-09-19T06:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: "req_link_latency": { 2024-09-19T06:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.973 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookup_latency": { 2024-09-19T06:24:53.973 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1, 2024-09-19T06:24:53.973 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000211374, 2024-09-19T06:24:53.973 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000211374 2024-09-19T06:24:53.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.973 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookuphash_latency": { 2024-09-19T06:24:53.973 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.973 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.973 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.973 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupino_latency": { 2024-09-19T06:24:53.973 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1, 2024-09-19T06:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000120378, 2024-09-19T06:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000120378 2024-09-19T06:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupname_latency": { 2024-09-19T06:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupparent_latency": { 2024-09-19T06:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.975 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupsnap_latency": { 2024-09-19T06:24:53.975 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.975 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.975 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.975 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lssnap_latency": { 2024-09-19T06:24:53.975 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.975 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.975 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.975 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mkdir_latency": { 2024-09-19T06:24:53.976 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.976 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.976 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.976 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mknod_latency": { 2024-09-19T06:24:53.976 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.976 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.977 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.977 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mksnap_latency": { 2024-09-19T06:24:53.977 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.977 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.977 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.977 INFO:teuthology.orchestra.run.smithi059.stdout: "req_open_latency": { 2024-09-19T06:24:53.977 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.977 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.977 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.978 INFO:teuthology.orchestra.run.smithi059.stdout: "req_readdir_latency": { 2024-09-19T06:24:53.978 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.978 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.978 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.978 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rename_latency": { 2024-09-19T06:24:53.978 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.978 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.978 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.978 INFO:teuthology.orchestra.run.smithi059.stdout: "req_renamesnap_latency": { 2024-09-19T06:24:53.978 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: "req_snapdiff_latency": { 2024-09-19T06:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmdir_latency": { 2024-09-19T06:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmsnap_latency": { 2024-09-19T06:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmxattr_latency": { 2024-09-19T06:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setattr_latency": { 2024-09-19T06:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setdirlayout_latency": { 2024-09-19T06:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setfilelock_latency": { 2024-09-19T06:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setlayout_latency": { 2024-09-19T06:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setxattr_latency": { 2024-09-19T06:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: "req_symlink_latency": { 2024-09-19T06:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: "req_unlink_latency": { 2024-09-19T06:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getvxattr_latency": { 2024-09-19T06:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_sessions": { 2024-09-19T06:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: "session_count": 1, 2024-09-19T06:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: "session_add": 2, 2024-09-19T06:24:53.985 INFO:teuthology.orchestra.run.smithi059.stdout: "session_remove": 1, 2024-09-19T06:24:53.985 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_open": 1, 2024-09-19T06:24:53.985 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_stale": 0, 2024-09-19T06:24:53.985 INFO:teuthology.orchestra.run.smithi059.stdout: "total_load": 2, 2024-09-19T06:24:53.985 INFO:teuthology.orchestra.run.smithi059.stdout: "average_load": 1, 2024-09-19T06:24:53.985 INFO:teuthology.orchestra.run.smithi059.stdout: "avg_session_uptime": 734, 2024-09-19T06:24:53.985 INFO:teuthology.orchestra.run.smithi059.stdout: "mdthresh_evicted": 0 2024-09-19T06:24:53.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.985 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool": { 2024-09-19T06:24:53.985 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:24:53.985 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_items": 0, 2024-09-19T06:24:53.986 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:24:53.986 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:24:53.986 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:24:53.986 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:24:53.986 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:24:53.986 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:24:53.986 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:24:53.986 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:24:53.986 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:24:53.986 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:24:53.986 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:24:53.986 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:24:53.987 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:24:53.987 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_items": 0, 2024-09-19T06:24:53.987 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:24:53.987 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_items": 0, 2024-09-19T06:24:53.987 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:24:53.987 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:24:53.987 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:24:53.987 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:24:53.987 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:24:53.987 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:24:53.987 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:24:53.988 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_items": 0, 2024-09-19T06:24:53.988 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:24:53.988 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:24:53.988 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:24:53.988 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_items": 0, 2024-09-19T06:24:53.988 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_bytes": 0, 2024-09-19T06:24:53.988 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_items": 0, 2024-09-19T06:24:53.988 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:24:53.988 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:24:53.988 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:24:53.988 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:24:53.988 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_bytes": 271605, 2024-09-19T06:24:53.989 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_items": 98, 2024-09-19T06:24:53.989 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:24:53.989 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_items": 0, 2024-09-19T06:24:53.989 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bytes": 0, 2024-09-19T06:24:53.989 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_items": 0, 2024-09-19T06:24:53.989 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:24:53.989 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_items": 0, 2024-09-19T06:24:53.989 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:24:53.989 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_items": 0, 2024-09-19T06:24:53.989 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_bytes": 8320, 2024-09-19T06:24:53.989 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_items": 183, 2024-09-19T06:24:53.989 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:24:53.990 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:24:53.990 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_bytes": 0, 2024-09-19T06:24:53.990 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_items": 0, 2024-09-19T06:24:53.990 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_bytes": 86717, 2024-09-19T06:24:53.990 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_items": 336, 2024-09-19T06:24:53.990 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_bytes": 0, 2024-09-19T06:24:53.990 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_items": 0, 2024-09-19T06:24:53.990 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_bytes": 0, 2024-09-19T06:24:53.990 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_items": 0 2024-09-19T06:24:53.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.990 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter": { 2024-09-19T06:24:53.990 INFO:teuthology.orchestra.run.smithi059.stdout: "op_active": 0, 2024-09-19T06:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: "op_laggy": 0, 2024-09-19T06:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send": 42, 2024-09-19T06:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send_bytes": 11880, 2024-09-19T06:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: "op_resend": 32, 2024-09-19T06:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: "op_reply": 42, 2024-09-19T06:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: "op_latency": { 2024-09-19T06:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 42, 2024-09-19T06:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.244996758, 2024-09-19T06:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.005833256 2024-09-19T06:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: "op_inflight": 0, 2024-09-19T06:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: "oplen_avg": { 2024-09-19T06:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 42, 2024-09-19T06:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 66 2024-09-19T06:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: "op": 42, 2024-09-19T06:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: "op_r": 0, 2024-09-19T06:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: "op_w": 42, 2024-09-19T06:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: "op_rmw": 0, 2024-09-19T06:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: "op_pg": 0, 2024-09-19T06:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_stat": 0, 2024-09-19T06:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_create": 10, 2024-09-19T06:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_read": 0, 2024-09-19T06:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_write": 4, 2024-09-19T06:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writefull": 7, 2024-09-19T06:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writesame": 0, 2024-09-19T06:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_append": 0, 2024-09-19T06:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_zero": 0, 2024-09-19T06:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_truncate": 0, 2024-09-19T06:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_delete": 6, 2024-09-19T06:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_mapext": 0, 2024-09-19T06:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_sparse_read": 0, 2024-09-19T06:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_clonerange": 0, 2024-09-19T06:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_getxattr": 0, 2024-09-19T06:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_setxattr": 20, 2024-09-19T06:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_rmxattr": 0, 2024-09-19T06:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_call": 0, 2024-09-19T06:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_watch": 0, 2024-09-19T06:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_notify": 0, 2024-09-19T06:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls": 0, 2024-09-19T06:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_other": 0, 2024-09-19T06:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_active": 0, 2024-09-19T06:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_send": 0, 2024-09-19T06:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_resend": 0, 2024-09-19T06:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_ping": 0, 2024-09-19T06:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_active": 0, 2024-09-19T06:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_send": 0, 2024-09-19T06:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_resend": 0, 2024-09-19T06:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_active": 0, 2024-09-19T06:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_send": 0, 2024-09-19T06:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_resend": 0, 2024-09-19T06:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_active": 0, 2024-09-19T06:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_send": 0, 2024-09-19T06:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_resend": 0, 2024-09-19T06:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: "command_active": 0, 2024-09-19T06:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: "command_send": 0, 2024-09-19T06:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: "command_resend": 0, 2024-09-19T06:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: "map_epoch": 101, 2024-09-19T06:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: "map_full": 0, 2024-09-19T06:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: "map_inc": 15, 2024-09-19T06:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_sessions": 8, 2024-09-19T06:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_open": 8, 2024-09-19T06:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_close": 0, 2024-09-19T06:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_laggy": 0, 2024-09-19T06:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_wr": 17, 2024-09-19T06:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_rd": 0, 2024-09-19T06:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_del": 2 2024-09-19T06:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: "oft": { 2024-09-19T06:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_objs": 1, 2024-09-19T06:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_updates": 0, 2024-09-19T06:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_removes": 0 2024-09-19T06:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: "osd-slow-ops": { 2024-09-19T06:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_ops_count": 0 2024-09-19T06:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: "purge_queue": { 2024-09-19T06:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops": 0, 2024-09-19T06:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T06:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing": 0, 2024-09-19T06:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_high_water": 0, 2024-09-19T06:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed_ops": 0, 2024-09-19T06:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed": 0, 2024-09-19T06:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_item_in_journal": 0 2024-09-19T06:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-19T06:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-09-19T06:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-19T06:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 1927, 2024-09-19T06:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 2071617, 2024-09-19T06:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 1927, 2024-09-19T06:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-09-19T06:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-09-19T06:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 1927, 2024-09-19T06:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 2071617, 2024-09-19T06:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-19T06:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_bytes": { 2024-09-19T06:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-19T06:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-09-19T06:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-19T06:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-09-19T06:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-09-19T06:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 42, 2024-09-19T06:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 11880, 2024-09-19T06:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 42, 2024-09-19T06:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 11880, 2024-09-19T06:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-19T06:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_ops": { 2024-09-19T06:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-19T06:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1024, 2024-09-19T06:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-19T06:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-09-19T06:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-09-19T06:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 42, 2024-09-19T06:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 42, 2024-09-19T06:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 42, 2024-09-19T06:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 42, 2024-09-19T06:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-19T06:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-19T06:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-09-19T06:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-19T06:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-09-19T06:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-09-19T06:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-09-19T06:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-09-19T06:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 0, 2024-09-19T06:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 0, 2024-09-19T06:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-19T06:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle-0x563c820ca500": { 2024-09-19T06:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-19T06:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-09-19T06:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-19T06:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 5, 2024-09-19T06:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 1433, 2024-09-19T06:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 5, 2024-09-19T06:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-09-19T06:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-09-19T06:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 4, 2024-09-19T06:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 1433, 2024-09-19T06:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-19T06:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:54.006 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:54.006 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:54.006 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:54.006 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-19T06:24:54.276 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:54 smithi059 ceph-mon[35138]: pgmap v390: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:24:54.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:54 smithi003 ceph-mon[30893]: pgmap v390: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:24:54.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:54 smithi071 ceph-mon[35662]: pgmap v390: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:24:54.779 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-19T06:24:54.779 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-19T06:24:54.779 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-19T06:24:54.779 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=11 2024-09-19T06:24:54.779 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-09-19T06:24:54.779 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:24:54.779 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:24:54.779 DEBUG:tasks.check_counter:Getting stats from k 2024-09-19T06:24:54.780 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-19T06:24:55.030 INFO:teuthology.orchestra.run.smithi059.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T06:24:55.542 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-09-19T06:24:55.542 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:24:55.542 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 293, 2024-09-19T06:24:55.542 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 274, 2024-09-19T06:24:55.542 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 1796962, 2024-09-19T06:24:55.542 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 158884, 2024-09-19T06:24:55.542 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 5, 2024-09-19T06:24:55.542 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 1, 2024-09-19T06:24:55.542 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.054524385, 2024-09-19T06:24:55.543 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.018122715, 2024-09-19T06:24:55.543 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.052287856, 2024-09-19T06:24:55.543 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.000019905, 2024-09-19T06:24:55.543 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:55.543 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 274, 2024-09-19T06:24:55.543 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.019503626, 2024-09-19T06:24:55.543 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000071181 2024-09-19T06:24:55.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.543 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:55.543 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.543 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.543 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.543 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 1796128, 2024-09-19T06:24:55.544 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 158560 2024-09-19T06:24:55.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.544 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:24:55.544 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 756, 2024-09-19T06:24:55.544 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 946, 2024-09-19T06:24:55.544 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 185826, 2024-09-19T06:24:55.544 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 732161, 2024-09-19T06:24:55.544 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 7, 2024-09-19T06:24:55.544 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 5, 2024-09-19T06:24:55.544 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.081465979, 2024-09-19T06:24:55.544 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.029153026, 2024-09-19T06:24:55.544 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.017784569, 2024-09-19T06:24:55.545 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.025911616, 2024-09-19T06:24:55.545 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:55.545 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 943, 2024-09-19T06:24:55.545 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.044946273, 2024-09-19T06:24:55.545 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000047663 2024-09-19T06:24:55.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.545 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:55.545 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.545 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.545 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.545 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:24:55.546 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 492384 2024-09-19T06:24:55.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.546 INFO:teuthology.orchestra.run.smithi059.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:24:55.546 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_messages": 1762, 2024-09-19T06:24:55.546 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages": 1764, 2024-09-19T06:24:55.546 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_bytes": 528052, 2024-09-19T06:24:55.546 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_bytes": 560374, 2024-09-19T06:24:55.546 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_created_connections": 4, 2024-09-19T06:24:55.546 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_active_connections": 3, 2024-09-19T06:24:55.546 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_total_time": 0.177496290, 2024-09-19T06:24:55.546 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_send_time": 0.064389409, 2024-09-19T06:24:55.546 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_recv_time": 0.044601160, 2024-09-19T06:24:55.546 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_running_fast_dispatch_time": 0.051726595, 2024-09-19T06:24:55.547 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:55.547 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 1762, 2024-09-19T06:24:55.547 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.070717553, 2024-09-19T06:24:55.547 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000040134 2024-09-19T06:24:55.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.547 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:55.547 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.547 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.547 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.547 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:24:55.547 INFO:teuthology.orchestra.run.smithi059.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:24:55.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.548 INFO:teuthology.orchestra.run.smithi059.stdout: "cct": { 2024-09-19T06:24:55.548 INFO:teuthology.orchestra.run.smithi059.stdout: "total_workers": 1, 2024-09-19T06:24:55.548 INFO:teuthology.orchestra.run.smithi059.stdout: "unhealthy_workers": 0 2024-09-19T06:24:55.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.548 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-MDSRank": { 2024-09-19T06:24:55.548 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-09-19T06:24:55.548 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-09-19T06:24:55.548 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 4223, 2024-09-19T06:24:55.548 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.119287181, 2024-09-19T06:24:55.548 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000028247 2024-09-19T06:24:55.548 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:55.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.549 INFO:teuthology.orchestra.run.smithi059.stdout: "finisher-PurgeQueue": { 2024-09-19T06:24:55.549 INFO:teuthology.orchestra.run.smithi059.stdout: "queue_len": 0, 2024-09-19T06:24:55.549 INFO:teuthology.orchestra.run.smithi059.stdout: "complete_latency": { 2024-09-19T06:24:55.549 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.549 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.549 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.549 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:55.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.549 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": { 2024-09-19T06:24:55.549 INFO:teuthology.orchestra.run.smithi059.stdout: "request": 0, 2024-09-19T06:24:55.549 INFO:teuthology.orchestra.run.smithi059.stdout: "reply": 0, 2024-09-19T06:24:55.549 INFO:teuthology.orchestra.run.smithi059.stdout: "reply_latency": { 2024-09-19T06:24:55.550 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.550 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.550 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.550 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_reply": 0, 2024-09-19T06:24:55.550 INFO:teuthology.orchestra.run.smithi059.stdout: "forward": 0, 2024-09-19T06:24:55.550 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_complete": 0, 2024-09-19T06:24:55.550 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_fetch_keys": 0, 2024-09-19T06:24:55.550 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_commit": 0, 2024-09-19T06:24:55.550 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_split": 0, 2024-09-19T06:24:55.550 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_merge": 0, 2024-09-19T06:24:55.550 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes": 0, 2024-09-19T06:24:55.550 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_top": 0, 2024-09-19T06:24:55.551 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_bottom": 0, 2024-09-19T06:24:55.551 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pin_tail": 0, 2024-09-19T06:24:55.551 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_pinned": 0, 2024-09-19T06:24:55.551 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_expired": 0, 2024-09-19T06:24:55.551 INFO:teuthology.orchestra.run.smithi059.stdout: "inodes_with_caps": 0, 2024-09-19T06:24:55.551 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": 0, 2024-09-19T06:24:55.551 INFO:teuthology.orchestra.run.smithi059.stdout: "subtrees": 1, 2024-09-19T06:24:55.551 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse": 0, 2024-09-19T06:24:55.551 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_hit": 0, 2024-09-19T06:24:55.551 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_forward": 0, 2024-09-19T06:24:55.551 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_discover": 0, 2024-09-19T06:24:55.551 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:24:55.551 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_remote_ino": 0, 2024-09-19T06:24:55.552 INFO:teuthology.orchestra.run.smithi059.stdout: "traverse_lock": 0, 2024-09-19T06:24:55.552 INFO:teuthology.orchestra.run.smithi059.stdout: "load_cent": 0, 2024-09-19T06:24:55.552 INFO:teuthology.orchestra.run.smithi059.stdout: "q": 0, 2024-09-19T06:24:55.552 INFO:teuthology.orchestra.run.smithi059.stdout: "exported": 0, 2024-09-19T06:24:55.552 INFO:teuthology.orchestra.run.smithi059.stdout: "exported_inodes": 0, 2024-09-19T06:24:55.552 INFO:teuthology.orchestra.run.smithi059.stdout: "imported": 0, 2024-09-19T06:24:55.552 INFO:teuthology.orchestra.run.smithi059.stdout: "imported_inodes": 0, 2024-09-19T06:24:55.552 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_dir_fetch": 0, 2024-09-19T06:24:55.552 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_backtrace_fetch": 0, 2024-09-19T06:24:55.552 INFO:teuthology.orchestra.run.smithi059.stdout: "openino_peer_discover": 0, 2024-09-19T06:24:55.552 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rfiles": 0, 2024-09-19T06:24:55.552 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rbytes": 0, 2024-09-19T06:24:55.552 INFO:teuthology.orchestra.run.smithi059.stdout: "root_rsnaps": 0, 2024-09-19T06:24:55.553 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T06:24:55.553 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_set_tag": 0, 2024-09-19T06:24:55.553 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:24:55.553 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:24:55.553 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:24:55.553 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:24:55.553 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:24:55.553 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_file_inodes": 0, 2024-09-19T06:24:55.553 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:24:55.553 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T06:24:55.553 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_grant": 0, 2024-09-19T06:24:55.553 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:24:55.553 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:24:55.553 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:24:55.554 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps": 0, 2024-09-19T06:24:55.554 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_caps_dirty": 0, 2024-09-19T06:24:55.554 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_cap_release": 0, 2024-09-19T06:24:55.554 INFO:teuthology.orchestra.run.smithi059.stdout: "process_request_cap_release": 0 2024-09-19T06:24:55.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.554 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache": { 2024-09-19T06:24:55.554 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update": 0, 2024-09-19T06:24:55.554 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_update_receipt": 0, 2024-09-19T06:24:55.554 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_try_discover": 0, 2024-09-19T06:24:55.554 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_send_discover": 0, 2024-09-19T06:24:55.554 INFO:teuthology.orchestra.run.smithi059.stdout: "dir_handle_discover": 0, 2024-09-19T06:24:55.554 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays": 0, 2024-09-19T06:24:55.554 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_delayed": 0, 2024-09-19T06:24:55.555 INFO:teuthology.orchestra.run.smithi059.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:24:55.555 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_created": 0, 2024-09-19T06:24:55.555 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_enqueued": 0, 2024-09-19T06:24:55.555 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_reintegrated": 0, 2024-09-19T06:24:55.555 INFO:teuthology.orchestra.run.smithi059.stdout: "strays_migrated": 0, 2024-09-19T06:24:55.555 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_processing": 0, 2024-09-19T06:24:55.555 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:24:55.555 INFO:teuthology.orchestra.run.smithi059.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:24:55.555 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_started": 0, 2024-09-19T06:24:55.555 INFO:teuthology.orchestra.run.smithi059.stdout: "recovery_completed": 0, 2024-09-19T06:24:55.555 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:24:55.555 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:24:55.555 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:24:55.556 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_exportdir": 0, 2024-09-19T06:24:55.556 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_flush": 0, 2024-09-19T06:24:55.556 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:24:55.556 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_fragstats": 0, 2024-09-19T06:24:55.556 INFO:teuthology.orchestra.run.smithi059.stdout: "ireq_inodestats": 0 2024-09-19T06:24:55.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.556 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log": { 2024-09-19T06:24:55.556 INFO:teuthology.orchestra.run.smithi059.stdout: "evlrg": 0, 2024-09-19T06:24:55.556 INFO:teuthology.orchestra.run.smithi059.stdout: "evadd": 0, 2024-09-19T06:24:55.556 INFO:teuthology.orchestra.run.smithi059.stdout: "evex": 0, 2024-09-19T06:24:55.556 INFO:teuthology.orchestra.run.smithi059.stdout: "evtrm": 0, 2024-09-19T06:24:55.556 INFO:teuthology.orchestra.run.smithi059.stdout: "ev": 5, 2024-09-19T06:24:55.556 INFO:teuthology.orchestra.run.smithi059.stdout: "evexg": 0, 2024-09-19T06:24:55.557 INFO:teuthology.orchestra.run.smithi059.stdout: "evexd": 0, 2024-09-19T06:24:55.557 INFO:teuthology.orchestra.run.smithi059.stdout: "segadd": 0, 2024-09-19T06:24:55.557 INFO:teuthology.orchestra.run.smithi059.stdout: "segex": 0, 2024-09-19T06:24:55.557 INFO:teuthology.orchestra.run.smithi059.stdout: "segtrm": 0, 2024-09-19T06:24:55.557 INFO:teuthology.orchestra.run.smithi059.stdout: "seg": 2, 2024-09-19T06:24:55.557 INFO:teuthology.orchestra.run.smithi059.stdout: "segmjr": 2, 2024-09-19T06:24:55.557 INFO:teuthology.orchestra.run.smithi059.stdout: "segexg": 0, 2024-09-19T06:24:55.557 INFO:teuthology.orchestra.run.smithi059.stdout: "segexd": 0, 2024-09-19T06:24:55.557 INFO:teuthology.orchestra.run.smithi059.stdout: "expos": 4194304, 2024-09-19T06:24:55.557 INFO:teuthology.orchestra.run.smithi059.stdout: "wrpos": 4195737, 2024-09-19T06:24:55.557 INFO:teuthology.orchestra.run.smithi059.stdout: "rdpos": 4195596, 2024-09-19T06:24:55.557 INFO:teuthology.orchestra.run.smithi059.stdout: "jlat": { 2024-09-19T06:24:55.557 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.558 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.558 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.558 INFO:teuthology.orchestra.run.smithi059.stdout: "replayed": 5 2024-09-19T06:24:55.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.558 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_mem": { 2024-09-19T06:24:55.558 INFO:teuthology.orchestra.run.smithi059.stdout: "ino": 3, 2024-09-19T06:24:55.558 INFO:teuthology.orchestra.run.smithi059.stdout: "ino+": 3, 2024-09-19T06:24:55.558 INFO:teuthology.orchestra.run.smithi059.stdout: "ino-": 0, 2024-09-19T06:24:55.558 INFO:teuthology.orchestra.run.smithi059.stdout: "dir": 1, 2024-09-19T06:24:55.558 INFO:teuthology.orchestra.run.smithi059.stdout: "dir+": 1, 2024-09-19T06:24:55.558 INFO:teuthology.orchestra.run.smithi059.stdout: "dir-": 0, 2024-09-19T06:24:55.559 INFO:teuthology.orchestra.run.smithi059.stdout: "dn": 0, 2024-09-19T06:24:55.559 INFO:teuthology.orchestra.run.smithi059.stdout: "dn+": 0, 2024-09-19T06:24:55.559 INFO:teuthology.orchestra.run.smithi059.stdout: "dn-": 0, 2024-09-19T06:24:55.559 INFO:teuthology.orchestra.run.smithi059.stdout: "cap": 0, 2024-09-19T06:24:55.559 INFO:teuthology.orchestra.run.smithi059.stdout: "cap+": 0, 2024-09-19T06:24:55.559 INFO:teuthology.orchestra.run.smithi059.stdout: "cap-": 0, 2024-09-19T06:24:55.559 INFO:teuthology.orchestra.run.smithi059.stdout: "rss": 48260, 2024-09-19T06:24:55.559 INFO:teuthology.orchestra.run.smithi059.stdout: "heap": 215328 2024-09-19T06:24:55.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.559 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_server": { 2024-09-19T06:24:55.559 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_client_request": 0, 2024-09-19T06:24:55.560 INFO:teuthology.orchestra.run.smithi059.stdout: "dispatch_server_request": 0, 2024-09-19T06:24:55.560 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_request": 0, 2024-09-19T06:24:55.560 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_client_session": 0, 2024-09-19T06:24:55.560 INFO:teuthology.orchestra.run.smithi059.stdout: "handle_peer_request": 0, 2024-09-19T06:24:55.560 INFO:teuthology.orchestra.run.smithi059.stdout: "req_create_latency": { 2024-09-19T06:24:55.560 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.560 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.560 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.560 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getattr_latency": { 2024-09-19T06:24:55.560 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.560 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.561 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.561 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getfilelock_latency": { 2024-09-19T06:24:55.561 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.561 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.561 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.561 INFO:teuthology.orchestra.run.smithi059.stdout: "req_link_latency": { 2024-09-19T06:24:55.561 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.561 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.561 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.561 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookup_latency": { 2024-09-19T06:24:55.562 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.562 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.562 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.562 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookuphash_latency": { 2024-09-19T06:24:55.562 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.562 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.562 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.562 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupino_latency": { 2024-09-19T06:24:55.562 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.562 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.562 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.563 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupname_latency": { 2024-09-19T06:24:55.563 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.563 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.563 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.563 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupparent_latency": { 2024-09-19T06:24:55.563 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.563 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.563 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.563 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lookupsnap_latency": { 2024-09-19T06:24:55.563 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.563 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.563 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.564 INFO:teuthology.orchestra.run.smithi059.stdout: "req_lssnap_latency": { 2024-09-19T06:24:55.564 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.564 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.564 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.564 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mkdir_latency": { 2024-09-19T06:24:55.564 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.564 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.564 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.564 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mknod_latency": { 2024-09-19T06:24:55.564 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.565 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.565 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.565 INFO:teuthology.orchestra.run.smithi059.stdout: "req_mksnap_latency": { 2024-09-19T06:24:55.565 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.565 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.565 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.565 INFO:teuthology.orchestra.run.smithi059.stdout: "req_open_latency": { 2024-09-19T06:24:55.565 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.565 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.565 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.566 INFO:teuthology.orchestra.run.smithi059.stdout: "req_readdir_latency": { 2024-09-19T06:24:55.566 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.566 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.566 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.566 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rename_latency": { 2024-09-19T06:24:55.566 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.566 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.566 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.566 INFO:teuthology.orchestra.run.smithi059.stdout: "req_renamesnap_latency": { 2024-09-19T06:24:55.566 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.566 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.567 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.567 INFO:teuthology.orchestra.run.smithi059.stdout: "req_snapdiff_latency": { 2024-09-19T06:24:55.567 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.567 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.567 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.567 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmdir_latency": { 2024-09-19T06:24:55.567 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.567 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.567 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.567 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmsnap_latency": { 2024-09-19T06:24:55.567 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.568 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.568 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.568 INFO:teuthology.orchestra.run.smithi059.stdout: "req_rmxattr_latency": { 2024-09-19T06:24:55.568 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.568 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.568 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.568 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setattr_latency": { 2024-09-19T06:24:55.568 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.568 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.568 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.569 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setdirlayout_latency": { 2024-09-19T06:24:55.569 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.569 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.569 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.569 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setfilelock_latency": { 2024-09-19T06:24:55.569 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.569 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.569 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.569 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setlayout_latency": { 2024-09-19T06:24:55.569 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.569 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.570 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.570 INFO:teuthology.orchestra.run.smithi059.stdout: "req_setxattr_latency": { 2024-09-19T06:24:55.570 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.570 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.570 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.570 INFO:teuthology.orchestra.run.smithi059.stdout: "req_symlink_latency": { 2024-09-19T06:24:55.570 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.570 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.570 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.570 INFO:teuthology.orchestra.run.smithi059.stdout: "req_unlink_latency": { 2024-09-19T06:24:55.571 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.571 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.571 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.571 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:24:55.571 INFO:teuthology.orchestra.run.smithi059.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:24:55.571 INFO:teuthology.orchestra.run.smithi059.stdout: "req_getvxattr_latency": { 2024-09-19T06:24:55.571 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.571 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.571 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.571 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:55.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.571 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_sessions": { 2024-09-19T06:24:55.572 INFO:teuthology.orchestra.run.smithi059.stdout: "session_count": 1, 2024-09-19T06:24:55.572 INFO:teuthology.orchestra.run.smithi059.stdout: "session_add": 2, 2024-09-19T06:24:55.572 INFO:teuthology.orchestra.run.smithi059.stdout: "session_remove": 1, 2024-09-19T06:24:55.572 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_open": 2, 2024-09-19T06:24:55.572 INFO:teuthology.orchestra.run.smithi059.stdout: "sessions_stale": 0, 2024-09-19T06:24:55.572 INFO:teuthology.orchestra.run.smithi059.stdout: "total_load": 0, 2024-09-19T06:24:55.572 INFO:teuthology.orchestra.run.smithi059.stdout: "average_load": 0, 2024-09-19T06:24:55.572 INFO:teuthology.orchestra.run.smithi059.stdout: "avg_session_uptime": 3590, 2024-09-19T06:24:55.572 INFO:teuthology.orchestra.run.smithi059.stdout: "mdthresh_evicted": 0 2024-09-19T06:24:55.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.572 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool": { 2024-09-19T06:24:55.572 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:24:55.572 INFO:teuthology.orchestra.run.smithi059.stdout: "bloom_filter_items": 0, 2024-09-19T06:24:55.573 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:24:55.573 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:24:55.573 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:24:55.573 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:24:55.573 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:24:55.573 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:24:55.573 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:24:55.573 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:24:55.573 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:24:55.573 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:24:55.573 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:24:55.573 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:24:55.573 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:24:55.574 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_items": 0, 2024-09-19T06:24:55.574 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:24:55.574 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blob_items": 0, 2024-09-19T06:24:55.574 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:24:55.574 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:24:55.574 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:24:55.574 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:24:55.574 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:24:55.574 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:24:55.574 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:24:55.574 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_txc_items": 0, 2024-09-19T06:24:55.574 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:24:55.574 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:24:55.575 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:24:55.575 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_writing_items": 0, 2024-09-19T06:24:55.575 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_bytes": 0, 2024-09-19T06:24:55.575 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_items": 0, 2024-09-19T06:24:55.575 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:24:55.575 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:24:55.575 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:24:55.575 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:24:55.575 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_bytes": 190211, 2024-09-19T06:24:55.575 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_anon_items": 55, 2024-09-19T06:24:55.575 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:24:55.575 INFO:teuthology.orchestra.run.smithi059.stdout: "buffer_meta_items": 0, 2024-09-19T06:24:55.575 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bytes": 0, 2024-09-19T06:24:55.576 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_items": 0, 2024-09-19T06:24:55.576 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:24:55.576 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mapbl_items": 0, 2024-09-19T06:24:55.576 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:24:55.576 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pglog_items": 0, 2024-09-19T06:24:55.576 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_bytes": 8320, 2024-09-19T06:24:55.576 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_items": 183, 2024-09-19T06:24:55.576 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:24:55.577 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:24:55.577 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_bytes": 0, 2024-09-19T06:24:55.577 INFO:teuthology.orchestra.run.smithi059.stdout: "pgmap_items": 0, 2024-09-19T06:24:55.577 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_bytes": 8512, 2024-09-19T06:24:55.577 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_co_items": 13, 2024-09-19T06:24:55.577 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_bytes": 0, 2024-09-19T06:24:55.577 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_1_items": 0, 2024-09-19T06:24:55.577 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_bytes": 0, 2024-09-19T06:24:55.577 INFO:teuthology.orchestra.run.smithi059.stdout: "unittest_2_items": 0 2024-09-19T06:24:55.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.577 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter": { 2024-09-19T06:24:55.577 INFO:teuthology.orchestra.run.smithi059.stdout: "op_active": 0, 2024-09-19T06:24:55.577 INFO:teuthology.orchestra.run.smithi059.stdout: "op_laggy": 0, 2024-09-19T06:24:55.578 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send": 2517, 2024-09-19T06:24:55.578 INFO:teuthology.orchestra.run.smithi059.stdout: "op_send_bytes": 21, 2024-09-19T06:24:55.578 INFO:teuthology.orchestra.run.smithi059.stdout: "op_resend": 3, 2024-09-19T06:24:55.578 INFO:teuthology.orchestra.run.smithi059.stdout: "op_reply": 2517, 2024-09-19T06:24:55.578 INFO:teuthology.orchestra.run.smithi059.stdout: "op_latency": { 2024-09-19T06:24:55.578 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2517, 2024-09-19T06:24:55.578 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 1.261983080, 2024-09-19T06:24:55.578 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000501383 2024-09-19T06:24:55.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.578 INFO:teuthology.orchestra.run.smithi059.stdout: "op_inflight": 0, 2024-09-19T06:24:55.578 INFO:teuthology.orchestra.run.smithi059.stdout: "oplen_avg": { 2024-09-19T06:24:55.578 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 2517, 2024-09-19T06:24:55.578 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 2518 2024-09-19T06:24:55.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.579 INFO:teuthology.orchestra.run.smithi059.stdout: "op": 2517, 2024-09-19T06:24:55.579 INFO:teuthology.orchestra.run.smithi059.stdout: "op_r": 2517, 2024-09-19T06:24:55.579 INFO:teuthology.orchestra.run.smithi059.stdout: "op_w": 0, 2024-09-19T06:24:55.579 INFO:teuthology.orchestra.run.smithi059.stdout: "op_rmw": 0, 2024-09-19T06:24:55.579 INFO:teuthology.orchestra.run.smithi059.stdout: "op_pg": 0, 2024-09-19T06:24:55.579 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_stat": 1630, 2024-09-19T06:24:55.579 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_create": 0, 2024-09-19T06:24:55.579 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_read": 885, 2024-09-19T06:24:55.579 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_write": 0, 2024-09-19T06:24:55.579 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writefull": 0, 2024-09-19T06:24:55.579 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_writesame": 0, 2024-09-19T06:24:55.579 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_append": 0, 2024-09-19T06:24:55.579 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_zero": 0, 2024-09-19T06:24:55.580 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_truncate": 0, 2024-09-19T06:24:55.580 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_delete": 0, 2024-09-19T06:24:55.580 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_mapext": 0, 2024-09-19T06:24:55.580 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_sparse_read": 0, 2024-09-19T06:24:55.580 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_clonerange": 0, 2024-09-19T06:24:55.580 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_getxattr": 1, 2024-09-19T06:24:55.580 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_setxattr": 0, 2024-09-19T06:24:55.580 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:24:55.580 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_rmxattr": 0, 2024-09-19T06:24:55.580 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:24:55.580 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_call": 0, 2024-09-19T06:24:55.580 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_watch": 0, 2024-09-19T06:24:55.580 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_notify": 0, 2024-09-19T06:24:55.581 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:24:55.581 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls": 0, 2024-09-19T06:24:55.581 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:24:55.581 INFO:teuthology.orchestra.run.smithi059.stdout: "osdop_other": 0, 2024-09-19T06:24:55.581 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_active": 0, 2024-09-19T06:24:55.581 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_send": 0, 2024-09-19T06:24:55.581 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_resend": 0, 2024-09-19T06:24:55.581 INFO:teuthology.orchestra.run.smithi059.stdout: "linger_ping": 0, 2024-09-19T06:24:55.581 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_active": 0, 2024-09-19T06:24:55.581 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_send": 0, 2024-09-19T06:24:55.581 INFO:teuthology.orchestra.run.smithi059.stdout: "poolop_resend": 0, 2024-09-19T06:24:55.581 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_active": 0, 2024-09-19T06:24:55.581 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_send": 0, 2024-09-19T06:24:55.582 INFO:teuthology.orchestra.run.smithi059.stdout: "poolstat_resend": 0, 2024-09-19T06:24:55.582 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_active": 0, 2024-09-19T06:24:55.582 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_send": 0, 2024-09-19T06:24:55.582 INFO:teuthology.orchestra.run.smithi059.stdout: "statfs_resend": 0, 2024-09-19T06:24:55.582 INFO:teuthology.orchestra.run.smithi059.stdout: "command_active": 0, 2024-09-19T06:24:55.582 INFO:teuthology.orchestra.run.smithi059.stdout: "command_send": 0, 2024-09-19T06:24:55.582 INFO:teuthology.orchestra.run.smithi059.stdout: "command_resend": 0, 2024-09-19T06:24:55.582 INFO:teuthology.orchestra.run.smithi059.stdout: "map_epoch": 101, 2024-09-19T06:24:55.582 INFO:teuthology.orchestra.run.smithi059.stdout: "map_full": 0, 2024-09-19T06:24:55.582 INFO:teuthology.orchestra.run.smithi059.stdout: "map_inc": 15, 2024-09-19T06:24:55.582 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_sessions": 5, 2024-09-19T06:24:55.582 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_open": 5, 2024-09-19T06:24:55.583 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_session_close": 0, 2024-09-19T06:24:55.583 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_laggy": 0, 2024-09-19T06:24:55.583 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_wr": 0, 2024-09-19T06:24:55.583 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_rd": 2, 2024-09-19T06:24:55.583 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_del": 0 2024-09-19T06:24:55.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.583 INFO:teuthology.orchestra.run.smithi059.stdout: "oft": { 2024-09-19T06:24:55.583 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_objs": 0, 2024-09-19T06:24:55.583 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:24:55.583 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_updates": 0, 2024-09-19T06:24:55.583 INFO:teuthology.orchestra.run.smithi059.stdout: "omap_total_removes": 0 2024-09-19T06:24:55.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.583 INFO:teuthology.orchestra.run.smithi059.stdout: "osd-slow-ops": { 2024-09-19T06:24:55.584 INFO:teuthology.orchestra.run.smithi059.stdout: "slow_ops_count": 0 2024-09-19T06:24:55.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.584 INFO:teuthology.orchestra.run.smithi059.stdout: "purge_queue": { 2024-09-19T06:24:55.584 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops": 0, 2024-09-19T06:24:55.584 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T06:24:55.584 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing": 0, 2024-09-19T06:24:55.584 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executing_high_water": 0, 2024-09-19T06:24:55.584 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed_ops": 0, 2024-09-19T06:24:55.584 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_executed": 0, 2024-09-19T06:24:55.584 INFO:teuthology.orchestra.run.smithi059.stdout: "pq_item_in_journal": 0 2024-09-19T06:24:55.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.584 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:24:55.584 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-19T06:24:55.585 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-09-19T06:24:55.585 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-19T06:24:55.585 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 2807, 2024-09-19T06:24:55.585 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 2240425, 2024-09-19T06:24:55.585 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:55.585 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 2807, 2024-09-19T06:24:55.585 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-09-19T06:24:55.585 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-09-19T06:24:55.585 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 2807, 2024-09-19T06:24:55.585 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 2240425, 2024-09-19T06:24:55.585 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-19T06:24:55.585 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.586 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.586 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.586 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:55.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.586 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_bytes": { 2024-09-19T06:24:55.586 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-19T06:24:55.586 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 104857600, 2024-09-19T06:24:55.586 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-19T06:24:55.586 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-09-19T06:24:55.586 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-09-19T06:24:55.586 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:55.586 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:55.586 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 2517, 2024-09-19T06:24:55.586 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 1438, 2024-09-19T06:24:55.587 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 2517, 2024-09-19T06:24:55.587 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 1438, 2024-09-19T06:24:55.587 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-19T06:24:55.587 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.587 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.587 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.587 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:55.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.587 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-objecter_ops": { 2024-09-19T06:24:55.587 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-19T06:24:55.587 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 1024, 2024-09-19T06:24:55.587 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-19T06:24:55.588 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-09-19T06:24:55.588 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-09-19T06:24:55.588 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:55.588 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:55.588 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 2517, 2024-09-19T06:24:55.588 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 2517, 2024-09-19T06:24:55.588 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 2517, 2024-09-19T06:24:55.588 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 2517, 2024-09-19T06:24:55.588 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-19T06:24:55.588 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.588 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.588 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.588 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:55.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.589 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:24:55.589 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-19T06:24:55.589 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-09-19T06:24:55.589 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-19T06:24:55.589 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-09-19T06:24:55.589 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-09-19T06:24:55.589 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:55.589 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:55.589 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-09-19T06:24:55.589 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-09-19T06:24:55.589 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 0, 2024-09-19T06:24:55.589 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 0, 2024-09-19T06:24:55.590 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-19T06:24:55.590 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.590 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.590 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.590 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:55.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-09-19T06:24:55.590 INFO:teuthology.orchestra.run.smithi059.stdout: "throttle-write_buf_throttle-0x56004e28e6e0": { 2024-09-19T06:24:55.590 INFO:teuthology.orchestra.run.smithi059.stdout: "val": 0, 2024-09-19T06:24:55.590 INFO:teuthology.orchestra.run.smithi059.stdout: "max": 3758096384, 2024-09-19T06:24:55.590 INFO:teuthology.orchestra.run.smithi059.stdout: "get_started": 0, 2024-09-19T06:24:55.590 INFO:teuthology.orchestra.run.smithi059.stdout: "get": 0, 2024-09-19T06:24:55.590 INFO:teuthology.orchestra.run.smithi059.stdout: "get_sum": 0, 2024-09-19T06:24:55.590 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:55.591 INFO:teuthology.orchestra.run.smithi059.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:55.591 INFO:teuthology.orchestra.run.smithi059.stdout: "take": 0, 2024-09-19T06:24:55.591 INFO:teuthology.orchestra.run.smithi059.stdout: "take_sum": 0, 2024-09-19T06:24:55.591 INFO:teuthology.orchestra.run.smithi059.stdout: "put": 0, 2024-09-19T06:24:55.591 INFO:teuthology.orchestra.run.smithi059.stdout: "put_sum": 0, 2024-09-19T06:24:55.591 INFO:teuthology.orchestra.run.smithi059.stdout: "wait": { 2024-09-19T06:24:55.591 INFO:teuthology.orchestra.run.smithi059.stdout: "avgcount": 0, 2024-09-19T06:24:55.591 INFO:teuthology.orchestra.run.smithi059.stdout: "sum": 0.000000000, 2024-09-19T06:24:55.591 INFO:teuthology.orchestra.run.smithi059.stdout: "avgtime": 0.000000000 2024-09-19T06:24:55.591 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:55.591 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-09-19T06:24:55.591 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-09-19T06:24:56.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:56 smithi059 ceph-mon[35138]: pgmap v391: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T06:24:56.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:56 smithi003 ceph-mon[30893]: pgmap v391: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T06:24:56.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:56 smithi071 ceph-mon[35662]: pgmap v391: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T06:24:56.371 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-19T06:24:56.371 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-19T06:24:56.371 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-09-19T06:24:56.372 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-09-19T06:24:56.372 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-09-19T06:24:56.372 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:24:56.372 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:24:56.372 DEBUG:tasks.check_counter:Getting stats from c 2024-09-19T06:24:56.372 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-19T06:24:56.630 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:24:57.138 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-19T06:24:57.138 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:24:57.138 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 92, 2024-09-19T06:24:57.138 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 112, 2024-09-19T06:24:57.138 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 32178, 2024-09-19T06:24:57.138 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 86422, 2024-09-19T06:24:57.139 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 15, 2024-09-19T06:24:57.139 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 3, 2024-09-19T06:24:57.139 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.021355512, 2024-09-19T06:24:57.139 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.005516645, 2024-09-19T06:24:57.139 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.011500120, 2024-09-19T06:24:57.139 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.000442770, 2024-09-19T06:24:57.139 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:57.139 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 110, 2024-09-19T06:24:57.139 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.018005909, 2024-09-19T06:24:57.139 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000163690 2024-09-19T06:24:57.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.139 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:57.139 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 144, 2024-09-19T06:24:57.140 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000063464, 2024-09-19T06:24:57.140 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000440 2024-09-19T06:24:57.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.140 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:24:57.140 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:24:57.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.140 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:24:57.140 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 113, 2024-09-19T06:24:57.140 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 301, 2024-09-19T06:24:57.140 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 33293, 2024-09-19T06:24:57.140 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 937695, 2024-09-19T06:24:57.140 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 44, 2024-09-19T06:24:57.141 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 8, 2024-09-19T06:24:57.141 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.030929328, 2024-09-19T06:24:57.141 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.010792645, 2024-09-19T06:24:57.141 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.016775906, 2024-09-19T06:24:57.141 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.000415720, 2024-09-19T06:24:57.141 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:57.141 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 298, 2024-09-19T06:24:57.141 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.041049737, 2024-09-19T06:24:57.141 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000137750 2024-09-19T06:24:57.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.141 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:57.141 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 144, 2024-09-19T06:24:57.141 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000025010, 2024-09-19T06:24:57.142 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000173 2024-09-19T06:24:57.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.142 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 1248, 2024-09-19T06:24:57.142 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 492832 2024-09-19T06:24:57.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.142 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:24:57.142 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 1726, 2024-09-19T06:24:57.142 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 1286, 2024-09-19T06:24:57.142 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 2196793, 2024-09-19T06:24:57.142 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 541143, 2024-09-19T06:24:57.142 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 10, 2024-09-19T06:24:57.142 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 4, 2024-09-19T06:24:57.142 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.157892687, 2024-09-19T06:24:57.143 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.059331612, 2024-09-19T06:24:57.143 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.120613771, 2024-09-19T06:24:57.143 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.005415743, 2024-09-19T06:24:57.143 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:57.143 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1286, 2024-09-19T06:24:57.143 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.060942832, 2024-09-19T06:24:57.143 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000047389 2024-09-19T06:24:57.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.143 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:57.143 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2297, 2024-09-19T06:24:57.143 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000449886, 2024-09-19T06:24:57.143 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000195 2024-09-19T06:24:57.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.144 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 1803312, 2024-09-19T06:24:57.144 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 161440 2024-09-19T06:24:57.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.144 INFO:teuthology.orchestra.run.smithi071.stdout: "cct": { 2024-09-19T06:24:57.144 INFO:teuthology.orchestra.run.smithi071.stdout: "total_workers": 1, 2024-09-19T06:24:57.144 INFO:teuthology.orchestra.run.smithi071.stdout: "unhealthy_workers": 0 2024-09-19T06:24:57.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.144 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-MDSRank": { 2024-09-19T06:24:57.144 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-19T06:24:57.144 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-19T06:24:57.144 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 46, 2024-09-19T06:24:57.144 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.001314031, 2024-09-19T06:24:57.145 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000028565 2024-09-19T06:24:57.145 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:24:57.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.145 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-PurgeQueue": { 2024-09-19T06:24:57.145 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-19T06:24:57.145 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-19T06:24:57.145 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2, 2024-09-19T06:24:57.145 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000011276, 2024-09-19T06:24:57.145 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000005638 2024-09-19T06:24:57.145 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:24:57.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.145 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-19T06:24:57.145 INFO:teuthology.orchestra.run.smithi071.stdout: "request": 1, 2024-09-19T06:24:57.145 INFO:teuthology.orchestra.run.smithi071.stdout: "reply": 0, 2024-09-19T06:24:57.146 INFO:teuthology.orchestra.run.smithi071.stdout: "reply_latency": { 2024-09-19T06:24:57.146 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.146 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.146 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.146 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_reply": 0, 2024-09-19T06:24:57.146 INFO:teuthology.orchestra.run.smithi071.stdout: "forward": 1, 2024-09-19T06:24:57.146 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_complete": 0, 2024-09-19T06:24:57.146 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_keys": 0, 2024-09-19T06:24:57.146 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_commit": 11, 2024-09-19T06:24:57.146 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_split": 0, 2024-09-19T06:24:57.146 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_merge": 0, 2024-09-19T06:24:57.146 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes": 16, 2024-09-19T06:24:57.147 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_top": 0, 2024-09-19T06:24:57.147 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_bottom": 16, 2024-09-19T06:24:57.147 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pin_tail": 0, 2024-09-19T06:24:57.147 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pinned": 13, 2024-09-19T06:24:57.147 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_expired": 4, 2024-09-19T06:24:57.147 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_with_caps": 0, 2024-09-19T06:24:57.147 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": 0, 2024-09-19T06:24:57.147 INFO:teuthology.orchestra.run.smithi071.stdout: "subtrees": 3, 2024-09-19T06:24:57.147 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse": 8, 2024-09-19T06:24:57.147 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_hit": 4, 2024-09-19T06:24:57.148 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_forward": 1, 2024-09-19T06:24:57.148 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_discover": 3, 2024-09-19T06:24:57.148 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:24:57.148 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_remote_ino": 0, 2024-09-19T06:24:57.148 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_lock": 0, 2024-09-19T06:24:57.148 INFO:teuthology.orchestra.run.smithi071.stdout: "load_cent": 1000, 2024-09-19T06:24:57.148 INFO:teuthology.orchestra.run.smithi071.stdout: "q": 1, 2024-09-19T06:24:57.148 INFO:teuthology.orchestra.run.smithi071.stdout: "exported": 0, 2024-09-19T06:24:57.148 INFO:teuthology.orchestra.run.smithi071.stdout: "exported_inodes": 0, 2024-09-19T06:24:57.148 INFO:teuthology.orchestra.run.smithi071.stdout: "imported": 0, 2024-09-19T06:24:57.148 INFO:teuthology.orchestra.run.smithi071.stdout: "imported_inodes": 0, 2024-09-19T06:24:57.148 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_dir_fetch": 0, 2024-09-19T06:24:57.149 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_backtrace_fetch": 0, 2024-09-19T06:24:57.149 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_peer_discover": 0, 2024-09-19T06:24:57.149 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rfiles": 5, 2024-09-19T06:24:57.149 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rbytes": 298, 2024-09-19T06:24:57.149 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rsnaps": 6, 2024-09-19T06:24:57.149 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T06:24:57.149 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_set_tag": 0, 2024-09-19T06:24:57.149 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:24:57.149 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:24:57.149 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:24:57.149 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:24:57.149 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:24:57.149 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_file_inodes": 0, 2024-09-19T06:24:57.150 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:24:57.150 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T06:24:57.150 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_grant": 0, 2024-09-19T06:24:57.150 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:24:57.150 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:24:57.150 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:24:57.150 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps": 0, 2024-09-19T06:24:57.150 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps_dirty": 0, 2024-09-19T06:24:57.150 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_cap_release": 0, 2024-09-19T06:24:57.150 INFO:teuthology.orchestra.run.smithi071.stdout: "process_request_cap_release": 0 2024-09-19T06:24:57.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.150 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache": { 2024-09-19T06:24:57.150 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update": 0, 2024-09-19T06:24:57.151 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update_receipt": 11, 2024-09-19T06:24:57.151 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_try_discover": 7, 2024-09-19T06:24:57.151 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_send_discover": 8, 2024-09-19T06:24:57.151 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_handle_discover": 0, 2024-09-19T06:24:57.151 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays": 0, 2024-09-19T06:24:57.151 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_delayed": 0, 2024-09-19T06:24:57.151 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:24:57.151 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_created": 0, 2024-09-19T06:24:57.151 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_enqueued": 0, 2024-09-19T06:24:57.151 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_reintegrated": 0, 2024-09-19T06:24:57.151 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_migrated": 0, 2024-09-19T06:24:57.151 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_processing": 0, 2024-09-19T06:24:57.151 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:24:57.151 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:24:57.152 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_started": 0, 2024-09-19T06:24:57.152 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_completed": 0, 2024-09-19T06:24:57.152 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:24:57.152 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:24:57.152 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:24:57.152 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_exportdir": 0, 2024-09-19T06:24:57.152 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_flush": 0, 2024-09-19T06:24:57.152 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:24:57.152 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragstats": 0, 2024-09-19T06:24:57.152 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_inodestats": 0 2024-09-19T06:24:57.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.152 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log": { 2024-09-19T06:24:57.152 INFO:teuthology.orchestra.run.smithi071.stdout: "evlrg": 0, 2024-09-19T06:24:57.153 INFO:teuthology.orchestra.run.smithi071.stdout: "evadd": 5, 2024-09-19T06:24:57.153 INFO:teuthology.orchestra.run.smithi071.stdout: "evex": 0, 2024-09-19T06:24:57.153 INFO:teuthology.orchestra.run.smithi071.stdout: "evtrm": 0, 2024-09-19T06:24:57.153 INFO:teuthology.orchestra.run.smithi071.stdout: "ev": 5, 2024-09-19T06:24:57.153 INFO:teuthology.orchestra.run.smithi071.stdout: "evexg": 0, 2024-09-19T06:24:57.153 INFO:teuthology.orchestra.run.smithi071.stdout: "evexd": 0, 2024-09-19T06:24:57.153 INFO:teuthology.orchestra.run.smithi071.stdout: "segadd": 2, 2024-09-19T06:24:57.153 INFO:teuthology.orchestra.run.smithi071.stdout: "segex": 0, 2024-09-19T06:24:57.153 INFO:teuthology.orchestra.run.smithi071.stdout: "segtrm": 0, 2024-09-19T06:24:57.153 INFO:teuthology.orchestra.run.smithi071.stdout: "seg": 2, 2024-09-19T06:24:57.153 INFO:teuthology.orchestra.run.smithi071.stdout: "segmjr": 2, 2024-09-19T06:24:57.153 INFO:teuthology.orchestra.run.smithi071.stdout: "segexg": 0, 2024-09-19T06:24:57.153 INFO:teuthology.orchestra.run.smithi071.stdout: "segexd": 0, 2024-09-19T06:24:57.154 INFO:teuthology.orchestra.run.smithi071.stdout: "expos": 4194304, 2024-09-19T06:24:57.154 INFO:teuthology.orchestra.run.smithi071.stdout: "wrpos": 4195737, 2024-09-19T06:24:57.154 INFO:teuthology.orchestra.run.smithi071.stdout: "rdpos": 0, 2024-09-19T06:24:57.154 INFO:teuthology.orchestra.run.smithi071.stdout: "jlat": { 2024-09-19T06:24:57.154 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 4, 2024-09-19T06:24:57.154 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.008577795, 2024-09-19T06:24:57.154 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.002144448 2024-09-19T06:24:57.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.154 INFO:teuthology.orchestra.run.smithi071.stdout: "replayed": 0 2024-09-19T06:24:57.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.154 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_mem": { 2024-09-19T06:24:57.155 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 20, 2024-09-19T06:24:57.155 INFO:teuthology.orchestra.run.smithi071.stdout: "ino+": 22, 2024-09-19T06:24:57.155 INFO:teuthology.orchestra.run.smithi071.stdout: "ino-": 2, 2024-09-19T06:24:57.155 INFO:teuthology.orchestra.run.smithi071.stdout: "dir": 19, 2024-09-19T06:24:57.155 INFO:teuthology.orchestra.run.smithi071.stdout: "dir+": 23, 2024-09-19T06:24:57.155 INFO:teuthology.orchestra.run.smithi071.stdout: "dir-": 4, 2024-09-19T06:24:57.155 INFO:teuthology.orchestra.run.smithi071.stdout: "dn": 16, 2024-09-19T06:24:57.155 INFO:teuthology.orchestra.run.smithi071.stdout: "dn+": 20, 2024-09-19T06:24:57.155 INFO:teuthology.orchestra.run.smithi071.stdout: "dn-": 4, 2024-09-19T06:24:57.155 INFO:teuthology.orchestra.run.smithi071.stdout: "cap": 0, 2024-09-19T06:24:57.155 INFO:teuthology.orchestra.run.smithi071.stdout: "cap+": 0, 2024-09-19T06:24:57.155 INFO:teuthology.orchestra.run.smithi071.stdout: "cap-": 0, 2024-09-19T06:24:57.155 INFO:teuthology.orchestra.run.smithi071.stdout: "rss": 50412, 2024-09-19T06:24:57.156 INFO:teuthology.orchestra.run.smithi071.stdout: "heap": 223520 2024-09-19T06:24:57.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.156 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_server": { 2024-09-19T06:24:57.156 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_client_request": 1, 2024-09-19T06:24:57.156 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_server_request": 0, 2024-09-19T06:24:57.156 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_request": 1, 2024-09-19T06:24:57.156 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_session": 14, 2024-09-19T06:24:57.156 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_peer_request": 0, 2024-09-19T06:24:57.156 INFO:teuthology.orchestra.run.smithi071.stdout: "req_create_latency": { 2024-09-19T06:24:57.156 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.156 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.156 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.157 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getattr_latency": { 2024-09-19T06:24:57.157 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.157 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.157 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.157 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getfilelock_latency": { 2024-09-19T06:24:57.157 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.157 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.157 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.157 INFO:teuthology.orchestra.run.smithi071.stdout: "req_link_latency": { 2024-09-19T06:24:57.157 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.157 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.158 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.158 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookup_latency": { 2024-09-19T06:24:57.158 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.158 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.158 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.158 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookuphash_latency": { 2024-09-19T06:24:57.158 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.158 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.158 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.158 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupino_latency": { 2024-09-19T06:24:57.159 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.159 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.159 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.159 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupname_latency": { 2024-09-19T06:24:57.159 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.159 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.159 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.159 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupparent_latency": { 2024-09-19T06:24:57.159 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.159 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.159 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.160 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupsnap_latency": { 2024-09-19T06:24:57.160 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.160 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.160 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.160 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lssnap_latency": { 2024-09-19T06:24:57.160 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.160 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.160 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.160 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mkdir_latency": { 2024-09-19T06:24:57.160 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.160 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.161 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.161 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mknod_latency": { 2024-09-19T06:24:57.161 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.161 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.161 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.161 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mksnap_latency": { 2024-09-19T06:24:57.161 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.161 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.162 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.162 INFO:teuthology.orchestra.run.smithi071.stdout: "req_open_latency": { 2024-09-19T06:24:57.162 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.162 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.162 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.162 INFO:teuthology.orchestra.run.smithi071.stdout: "req_readdir_latency": { 2024-09-19T06:24:57.162 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.162 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.162 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.162 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rename_latency": { 2024-09-19T06:24:57.162 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.163 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.163 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.163 INFO:teuthology.orchestra.run.smithi071.stdout: "req_renamesnap_latency": { 2024-09-19T06:24:57.163 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.163 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.163 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.163 INFO:teuthology.orchestra.run.smithi071.stdout: "req_snapdiff_latency": { 2024-09-19T06:24:57.163 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.163 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.163 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.163 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmdir_latency": { 2024-09-19T06:24:57.164 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.164 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.164 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.164 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmsnap_latency": { 2024-09-19T06:24:57.164 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.164 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.164 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.164 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmxattr_latency": { 2024-09-19T06:24:57.164 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.164 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.164 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.165 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setattr_latency": { 2024-09-19T06:24:57.165 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.165 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.165 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.165 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setdirlayout_latency": { 2024-09-19T06:24:57.165 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.165 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.165 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.165 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setfilelock_latency": { 2024-09-19T06:24:57.165 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.165 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.166 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.166 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setlayout_latency": { 2024-09-19T06:24:57.166 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.166 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.166 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.166 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setxattr_latency": { 2024-09-19T06:24:57.166 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.166 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.166 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.166 INFO:teuthology.orchestra.run.smithi071.stdout: "req_symlink_latency": { 2024-09-19T06:24:57.167 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.167 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.167 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.167 INFO:teuthology.orchestra.run.smithi071.stdout: "req_unlink_latency": { 2024-09-19T06:24:57.167 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.167 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.167 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.167 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:24:57.167 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:24:57.167 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getvxattr_latency": { 2024-09-19T06:24:57.167 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.167 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.168 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.168 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:24:57.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.168 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sessions": { 2024-09-19T06:24:57.168 INFO:teuthology.orchestra.run.smithi071.stdout: "session_count": 1, 2024-09-19T06:24:57.168 INFO:teuthology.orchestra.run.smithi071.stdout: "session_add": 2, 2024-09-19T06:24:57.168 INFO:teuthology.orchestra.run.smithi071.stdout: "session_remove": 1, 2024-09-19T06:24:57.168 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_open": 1, 2024-09-19T06:24:57.168 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_stale": 0, 2024-09-19T06:24:57.168 INFO:teuthology.orchestra.run.smithi071.stdout: "total_load": 0, 2024-09-19T06:24:57.168 INFO:teuthology.orchestra.run.smithi071.stdout: "average_load": 0, 2024-09-19T06:24:57.168 INFO:teuthology.orchestra.run.smithi071.stdout: "avg_session_uptime": 751, 2024-09-19T06:24:57.168 INFO:teuthology.orchestra.run.smithi071.stdout: "mdthresh_evicted": 0 2024-09-19T06:24:57.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.169 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool": { 2024-09-19T06:24:57.169 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:24:57.169 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_items": 0, 2024-09-19T06:24:57.169 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:24:57.169 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:24:57.169 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:24:57.169 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:24:57.169 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:24:57.169 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:24:57.169 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:24:57.169 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:24:57.169 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:24:57.169 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:24:57.170 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:24:57.170 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:24:57.170 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:24:57.170 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_items": 0, 2024-09-19T06:24:57.170 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:24:57.170 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_items": 0, 2024-09-19T06:24:57.170 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:24:57.170 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:24:57.170 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:24:57.170 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:24:57.170 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:24:57.170 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:24:57.170 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:24:57.170 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_items": 0, 2024-09-19T06:24:57.171 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:24:57.171 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:24:57.171 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:24:57.171 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_items": 0, 2024-09-19T06:24:57.171 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_bytes": 0, 2024-09-19T06:24:57.171 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_items": 0, 2024-09-19T06:24:57.171 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:24:57.171 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:24:57.171 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:24:57.171 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:24:57.171 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_bytes": 246825, 2024-09-19T06:24:57.171 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_items": 87, 2024-09-19T06:24:57.171 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:24:57.172 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_items": 0, 2024-09-19T06:24:57.172 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bytes": 0, 2024-09-19T06:24:57.172 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_items": 0, 2024-09-19T06:24:57.172 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:24:57.172 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_items": 0, 2024-09-19T06:24:57.172 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:24:57.172 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_items": 0, 2024-09-19T06:24:57.172 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_bytes": 8320, 2024-09-19T06:24:57.172 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_items": 183, 2024-09-19T06:24:57.172 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:24:57.172 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:24:57.172 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_bytes": 0, 2024-09-19T06:24:57.172 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_items": 0, 2024-09-19T06:24:57.172 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_bytes": 86333, 2024-09-19T06:24:57.173 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_items": 332, 2024-09-19T06:24:57.173 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_bytes": 0, 2024-09-19T06:24:57.173 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_items": 0, 2024-09-19T06:24:57.173 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_bytes": 0, 2024-09-19T06:24:57.173 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_items": 0 2024-09-19T06:24:57.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.173 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter": { 2024-09-19T06:24:57.173 INFO:teuthology.orchestra.run.smithi071.stdout: "op_active": 0, 2024-09-19T06:24:57.173 INFO:teuthology.orchestra.run.smithi071.stdout: "op_laggy": 0, 2024-09-19T06:24:57.173 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send": 40, 2024-09-19T06:24:57.173 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send_bytes": 11735, 2024-09-19T06:24:57.173 INFO:teuthology.orchestra.run.smithi071.stdout: "op_resend": 33, 2024-09-19T06:24:57.173 INFO:teuthology.orchestra.run.smithi071.stdout: "op_reply": 40, 2024-09-19T06:24:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: "op_latency": { 2024-09-19T06:24:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 40, 2024-09-19T06:24:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.242000063, 2024-09-19T06:24:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.006050001 2024-09-19T06:24:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: "op_inflight": 0, 2024-09-19T06:24:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: "oplen_avg": { 2024-09-19T06:24:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 40, 2024-09-19T06:24:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 62 2024-09-19T06:24:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: "op": 40, 2024-09-19T06:24:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: "op_r": 0, 2024-09-19T06:24:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: "op_w": 40, 2024-09-19T06:24:57.174 INFO:teuthology.orchestra.run.smithi071.stdout: "op_rmw": 0, 2024-09-19T06:24:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: "op_pg": 0, 2024-09-19T06:24:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_stat": 0, 2024-09-19T06:24:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_create": 10, 2024-09-19T06:24:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_read": 0, 2024-09-19T06:24:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_write": 4, 2024-09-19T06:24:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writefull": 7, 2024-09-19T06:24:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writesame": 0, 2024-09-19T06:24:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_append": 0, 2024-09-19T06:24:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_zero": 0, 2024-09-19T06:24:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_truncate": 0, 2024-09-19T06:24:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_delete": 6, 2024-09-19T06:24:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_mapext": 0, 2024-09-19T06:24:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_sparse_read": 0, 2024-09-19T06:24:57.175 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_clonerange": 0, 2024-09-19T06:24:57.176 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_getxattr": 0, 2024-09-19T06:24:57.176 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_setxattr": 20, 2024-09-19T06:24:57.176 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:24:57.176 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_rmxattr": 0, 2024-09-19T06:24:57.176 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:24:57.176 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_call": 0, 2024-09-19T06:24:57.176 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_watch": 0, 2024-09-19T06:24:57.176 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_notify": 0, 2024-09-19T06:24:57.176 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:24:57.176 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls": 0, 2024-09-19T06:24:57.176 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:24:57.176 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_other": 0, 2024-09-19T06:24:57.176 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_active": 0, 2024-09-19T06:24:57.177 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_send": 0, 2024-09-19T06:24:57.177 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_resend": 0, 2024-09-19T06:24:57.177 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_ping": 0, 2024-09-19T06:24:57.177 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_active": 0, 2024-09-19T06:24:57.177 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_send": 0, 2024-09-19T06:24:57.177 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_resend": 0, 2024-09-19T06:24:57.177 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_active": 0, 2024-09-19T06:24:57.177 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_send": 0, 2024-09-19T06:24:57.177 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_resend": 0, 2024-09-19T06:24:57.177 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_active": 0, 2024-09-19T06:24:57.177 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_send": 0, 2024-09-19T06:24:57.177 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_resend": 0, 2024-09-19T06:24:57.177 INFO:teuthology.orchestra.run.smithi071.stdout: "command_active": 0, 2024-09-19T06:24:57.177 INFO:teuthology.orchestra.run.smithi071.stdout: "command_send": 0, 2024-09-19T06:24:57.178 INFO:teuthology.orchestra.run.smithi071.stdout: "command_resend": 0, 2024-09-19T06:24:57.178 INFO:teuthology.orchestra.run.smithi071.stdout: "map_epoch": 101, 2024-09-19T06:24:57.178 INFO:teuthology.orchestra.run.smithi071.stdout: "map_full": 0, 2024-09-19T06:24:57.178 INFO:teuthology.orchestra.run.smithi071.stdout: "map_inc": 15, 2024-09-19T06:24:57.178 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_sessions": 8, 2024-09-19T06:24:57.178 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_open": 8, 2024-09-19T06:24:57.178 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_close": 0, 2024-09-19T06:24:57.178 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_laggy": 0, 2024-09-19T06:24:57.178 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_wr": 14, 2024-09-19T06:24:57.178 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_rd": 0, 2024-09-19T06:24:57.178 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_del": 1 2024-09-19T06:24:57.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.178 INFO:teuthology.orchestra.run.smithi071.stdout: "oft": { 2024-09-19T06:24:57.179 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_objs": 1, 2024-09-19T06:24:57.179 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:24:57.179 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_updates": 0, 2024-09-19T06:24:57.179 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_removes": 0 2024-09-19T06:24:57.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.179 INFO:teuthology.orchestra.run.smithi071.stdout: "osd-slow-ops": { 2024-09-19T06:24:57.179 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_ops_count": 0 2024-09-19T06:24:57.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.179 INFO:teuthology.orchestra.run.smithi071.stdout: "purge_queue": { 2024-09-19T06:24:57.179 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops": 0, 2024-09-19T06:24:57.179 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T06:24:57.179 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing": 0, 2024-09-19T06:24:57.179 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_high_water": 0, 2024-09-19T06:24:57.179 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed_ops": 0, 2024-09-19T06:24:57.180 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed": 0, 2024-09-19T06:24:57.180 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_item_in_journal": 0 2024-09-19T06:24:57.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.180 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:24:57.180 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-19T06:24:57.180 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-19T06:24:57.180 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-19T06:24:57.180 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 1927, 2024-09-19T06:24:57.180 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 2069792, 2024-09-19T06:24:57.180 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:57.180 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 1927, 2024-09-19T06:24:57.180 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-19T06:24:57.180 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-19T06:24:57.180 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 1927, 2024-09-19T06:24:57.181 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 2069792, 2024-09-19T06:24:57.181 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-19T06:24:57.181 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.181 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.181 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.181 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:24:57.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.181 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_bytes": { 2024-09-19T06:24:57.181 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-19T06:24:57.181 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-19T06:24:57.181 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-19T06:24:57.181 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-19T06:24:57.181 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-19T06:24:57.182 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:57.182 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:57.182 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 40, 2024-09-19T06:24:57.182 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 11735, 2024-09-19T06:24:57.182 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 40, 2024-09-19T06:24:57.182 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 11735, 2024-09-19T06:24:57.182 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-19T06:24:57.182 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.183 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.183 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.183 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:24:57.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.183 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_ops": { 2024-09-19T06:24:57.183 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-19T06:24:57.183 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 1024, 2024-09-19T06:24:57.183 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-19T06:24:57.183 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-19T06:24:57.183 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-19T06:24:57.183 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:57.184 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:57.184 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 40, 2024-09-19T06:24:57.184 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 40, 2024-09-19T06:24:57.184 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 40, 2024-09-19T06:24:57.184 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 40, 2024-09-19T06:24:57.184 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-19T06:24:57.184 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.184 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.184 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.184 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:24:57.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.184 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:24:57.184 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-19T06:24:57.184 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-19T06:24:57.185 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-19T06:24:57.185 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-19T06:24:57.185 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-19T06:24:57.185 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:57.185 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:57.185 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-19T06:24:57.185 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-19T06:24:57.185 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 0, 2024-09-19T06:24:57.185 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 0, 2024-09-19T06:24:57.185 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-19T06:24:57.185 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.185 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.185 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.186 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:24:57.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:57.186 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle-0x556c45fca500": { 2024-09-19T06:24:57.186 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-19T06:24:57.186 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-19T06:24:57.186 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-19T06:24:57.186 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 5, 2024-09-19T06:24:57.186 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 1433, 2024-09-19T06:24:57.186 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:57.186 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 5, 2024-09-19T06:24:57.186 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-19T06:24:57.186 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-19T06:24:57.186 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 4, 2024-09-19T06:24:57.186 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 1433, 2024-09-19T06:24:57.187 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-19T06:24:57.187 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:57.187 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:57.187 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:57.187 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:24:57.187 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:24:57.187 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-19T06:24:57.929 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-19T06:24:57.929 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-19T06:24:57.929 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-19T06:24:57.929 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=11 2024-09-19T06:24:57.929 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-19T06:24:57.929 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:24:57.929 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:24:57.929 DEBUG:tasks.check_counter:Getting stats from f 2024-09-19T06:24:57.930 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-19T06:24:58.188 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:24:58.309 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:24:58 smithi071 ceph-mon[35662]: pgmap v392: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:24:58.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:24:58 smithi003 ceph-mon[30893]: pgmap v392: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:24:58.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:24:58 smithi059 ceph-mon[35138]: pgmap v392: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:24:58.693 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-19T06:24:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:24:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 2265, 2024-09-19T06:24:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 2248, 2024-09-19T06:24:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 13122390, 2024-09-19T06:24:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 786000, 2024-09-19T06:24:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 6, 2024-09-19T06:24:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 2, 2024-09-19T06:24:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.258673976, 2024-09-19T06:24:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.076704044, 2024-09-19T06:24:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.113998095, 2024-09-19T06:24:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.065832778, 2024-09-19T06:24:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2247, 2024-09-19T06:24:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.093056234, 2024-09-19T06:24:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000041413 2024-09-19T06:24:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 1792720, 2024-09-19T06:24:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 156992 2024-09-19T06:24:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:24:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 694, 2024-09-19T06:24:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 883, 2024-09-19T06:24:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 8563128, 2024-09-19T06:24:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 713946, 2024-09-19T06:24:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 7, 2024-09-19T06:24:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 5, 2024-09-19T06:24:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.080760224, 2024-09-19T06:24:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.028250665, 2024-09-19T06:24:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.025300852, 2024-09-19T06:24:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.019902067, 2024-09-19T06:24:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 880, 2024-09-19T06:24:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.050949979, 2024-09-19T06:24:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000057897 2024-09-19T06:24:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T06:24:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 493824 2024-09-19T06:24:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:24:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 612, 2024-09-19T06:24:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 611, 2024-09-19T06:24:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 4349166, 2024-09-19T06:24:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 193481, 2024-09-19T06:24:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 5, 2024-09-19T06:24:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 4, 2024-09-19T06:24:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.061778568, 2024-09-19T06:24:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.021230491, 2024-09-19T06:24:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.017949987, 2024-09-19T06:24:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.017404364, 2024-09-19T06:24:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:24:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 610, 2024-09-19T06:24:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.027763698, 2024-09-19T06:24:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000045514 2024-09-19T06:24:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:24:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-09-19T06:24:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T06:24:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "cct": { 2024-09-19T06:24:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "total_workers": 1, 2024-09-19T06:24:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "unhealthy_workers": 0 2024-09-19T06:24:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-MDSRank": { 2024-09-19T06:24:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-19T06:24:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-19T06:24:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 5579, 2024-09-19T06:24:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.154460536, 2024-09-19T06:24:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000027686 2024-09-19T06:24:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:24:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-PurgeQueue": { 2024-09-19T06:24:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-19T06:24:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-19T06:24:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:24:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-19T06:24:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "request": 0, 2024-09-19T06:24:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "reply": 0, 2024-09-19T06:24:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "reply_latency": { 2024-09-19T06:24:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_reply": 0, 2024-09-19T06:24:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "forward": 0, 2024-09-19T06:24:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_complete": 0, 2024-09-19T06:24:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_keys": 0, 2024-09-19T06:24:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_commit": 0, 2024-09-19T06:24:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_split": 0, 2024-09-19T06:24:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_merge": 0, 2024-09-19T06:24:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes": 31, 2024-09-19T06:24:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_top": 12, 2024-09-19T06:24:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_bottom": 19, 2024-09-19T06:24:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pin_tail": 0, 2024-09-19T06:24:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pinned": 14, 2024-09-19T06:24:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_expired": 0, 2024-09-19T06:24:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_with_caps": 0, 2024-09-19T06:24:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": 0, 2024-09-19T06:24:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "subtrees": 2, 2024-09-19T06:24:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse": 0, 2024-09-19T06:24:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_hit": 0, 2024-09-19T06:24:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_forward": 0, 2024-09-19T06:24:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_discover": 0, 2024-09-19T06:24:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:24:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_remote_ino": 0, 2024-09-19T06:24:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_lock": 0, 2024-09-19T06:24:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "load_cent": 0, 2024-09-19T06:24:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "q": 0, 2024-09-19T06:24:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "exported": 0, 2024-09-19T06:24:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "exported_inodes": 0, 2024-09-19T06:24:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "imported": 0, 2024-09-19T06:24:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "imported_inodes": 0, 2024-09-19T06:24:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_dir_fetch": 0, 2024-09-19T06:24:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_backtrace_fetch": 0, 2024-09-19T06:24:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_peer_discover": 0, 2024-09-19T06:24:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rfiles": 4, 2024-09-19T06:24:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rbytes": 234, 2024-09-19T06:24:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rsnaps": 6, 2024-09-19T06:24:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T06:24:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_set_tag": 0, 2024-09-19T06:24:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:24:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:24:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:24:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:24:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:24:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_file_inodes": 0, 2024-09-19T06:24:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:24:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T06:24:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_grant": 0, 2024-09-19T06:24:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:24:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:24:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:24:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps": 0, 2024-09-19T06:24:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps_dirty": 0, 2024-09-19T06:24:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_cap_release": 0, 2024-09-19T06:24:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "process_request_cap_release": 0 2024-09-19T06:24:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache": { 2024-09-19T06:24:58.705 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update": 0, 2024-09-19T06:24:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update_receipt": 0, 2024-09-19T06:24:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_try_discover": 0, 2024-09-19T06:24:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_send_discover": 0, 2024-09-19T06:24:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_handle_discover": 0, 2024-09-19T06:24:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays": 0, 2024-09-19T06:24:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_delayed": 0, 2024-09-19T06:24:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:24:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_created": 0, 2024-09-19T06:24:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_enqueued": 0, 2024-09-19T06:24:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_reintegrated": 0, 2024-09-19T06:24:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_migrated": 0, 2024-09-19T06:24:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_processing": 0, 2024-09-19T06:24:58.706 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:24:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:24:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_started": 0, 2024-09-19T06:24:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_completed": 0, 2024-09-19T06:24:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:24:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:24:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:24:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_exportdir": 0, 2024-09-19T06:24:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_flush": 0, 2024-09-19T06:24:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:24:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragstats": 0, 2024-09-19T06:24:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_inodestats": 0 2024-09-19T06:24:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.707 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log": { 2024-09-19T06:24:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "evlrg": 0, 2024-09-19T06:24:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "evadd": 0, 2024-09-19T06:24:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "evex": 0, 2024-09-19T06:24:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "evtrm": 0, 2024-09-19T06:24:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "ev": 2582, 2024-09-19T06:24:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "evexg": 0, 2024-09-19T06:24:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "evexd": 0, 2024-09-19T06:24:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "segadd": 0, 2024-09-19T06:24:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "segex": 0, 2024-09-19T06:24:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "segtrm": 0, 2024-09-19T06:24:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "seg": 2, 2024-09-19T06:24:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "segmjr": 53, 2024-09-19T06:24:58.708 INFO:teuthology.orchestra.run.smithi071.stdout: "segexg": 0, 2024-09-19T06:24:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "segexd": 0, 2024-09-19T06:24:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "expos": 27287083, 2024-09-19T06:24:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "wrpos": 27530944, 2024-09-19T06:24:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "rdpos": 27518477, 2024-09-19T06:24:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "jlat": { 2024-09-19T06:24:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "replayed": 2582 2024-09-19T06:24:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_mem": { 2024-09-19T06:24:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 26, 2024-09-19T06:24:58.709 INFO:teuthology.orchestra.run.smithi071.stdout: "ino+": 27, 2024-09-19T06:24:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "ino-": 1, 2024-09-19T06:24:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "dir": 11, 2024-09-19T06:24:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "dir+": 11, 2024-09-19T06:24:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "dir-": 0, 2024-09-19T06:24:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "dn": 31, 2024-09-19T06:24:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "dn+": 31, 2024-09-19T06:24:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "dn-": 0, 2024-09-19T06:24:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "cap": 0, 2024-09-19T06:24:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "cap+": 0, 2024-09-19T06:24:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "cap-": 0, 2024-09-19T06:24:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "rss": 49416, 2024-09-19T06:24:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: "heap": 215328 2024-09-19T06:24:58.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_server": { 2024-09-19T06:24:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_client_request": 0, 2024-09-19T06:24:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_server_request": 0, 2024-09-19T06:24:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_request": 0, 2024-09-19T06:24:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_session": 0, 2024-09-19T06:24:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_peer_request": 0, 2024-09-19T06:24:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "req_create_latency": { 2024-09-19T06:24:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getattr_latency": { 2024-09-19T06:24:58.711 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getfilelock_latency": { 2024-09-19T06:24:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "req_link_latency": { 2024-09-19T06:24:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookup_latency": { 2024-09-19T06:24:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookuphash_latency": { 2024-09-19T06:24:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupino_latency": { 2024-09-19T06:24:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupname_latency": { 2024-09-19T06:24:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.714 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupparent_latency": { 2024-09-19T06:24:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupsnap_latency": { 2024-09-19T06:24:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lssnap_latency": { 2024-09-19T06:24:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.716 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mkdir_latency": { 2024-09-19T06:24:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mknod_latency": { 2024-09-19T06:24:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mksnap_latency": { 2024-09-19T06:24:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "req_open_latency": { 2024-09-19T06:24:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.718 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "req_readdir_latency": { 2024-09-19T06:24:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rename_latency": { 2024-09-19T06:24:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.719 INFO:teuthology.orchestra.run.smithi071.stdout: "req_renamesnap_latency": { 2024-09-19T06:24:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "req_snapdiff_latency": { 2024-09-19T06:24:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmdir_latency": { 2024-09-19T06:24:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.720 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmsnap_latency": { 2024-09-19T06:24:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmxattr_latency": { 2024-09-19T06:24:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setattr_latency": { 2024-09-19T06:24:58.721 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.722 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.722 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.722 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setdirlayout_latency": { 2024-09-19T06:24:58.722 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.722 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.722 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.722 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setfilelock_latency": { 2024-09-19T06:24:58.722 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.722 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.722 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.723 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setlayout_latency": { 2024-09-19T06:24:58.723 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.723 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.723 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.723 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setxattr_latency": { 2024-09-19T06:24:58.723 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.723 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.723 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: "req_symlink_latency": { 2024-09-19T06:24:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: "req_unlink_latency": { 2024-09-19T06:24:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.724 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:24:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:24:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getvxattr_latency": { 2024-09-19T06:24:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:24:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sessions": { 2024-09-19T06:24:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: "session_count": 2, 2024-09-19T06:24:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: "session_add": 5, 2024-09-19T06:24:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: "session_remove": 3, 2024-09-19T06:24:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_open": 4, 2024-09-19T06:24:58.725 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_stale": 0, 2024-09-19T06:24:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: "total_load": 0, 2024-09-19T06:24:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: "average_load": 0, 2024-09-19T06:24:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: "avg_session_uptime": 3579, 2024-09-19T06:24:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: "mdthresh_evicted": 0 2024-09-19T06:24:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool": { 2024-09-19T06:24:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:24:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_items": 0, 2024-09-19T06:24:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:24:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:24:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:24:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:24:58.726 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:24:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:24:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:24:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:24:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:24:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:24:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:24:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:24:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:24:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_items": 0, 2024-09-19T06:24:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:24:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_items": 0, 2024-09-19T06:24:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:24:58.727 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:24:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:24:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:24:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:24:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:24:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:24:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_items": 0, 2024-09-19T06:24:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:24:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:24:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:24:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_items": 0, 2024-09-19T06:24:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_bytes": 0, 2024-09-19T06:24:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_items": 0, 2024-09-19T06:24:58.728 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:24:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:24:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:24:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:24:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_bytes": 207282, 2024-09-19T06:24:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_items": 87, 2024-09-19T06:24:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:24:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_items": 0, 2024-09-19T06:24:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bytes": 0, 2024-09-19T06:24:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_items": 0, 2024-09-19T06:24:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:24:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_items": 0, 2024-09-19T06:24:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:24:58.729 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_items": 0, 2024-09-19T06:24:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_bytes": 8320, 2024-09-19T06:24:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_items": 183, 2024-09-19T06:24:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:24:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:24:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_bytes": 0, 2024-09-19T06:24:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_items": 0, 2024-09-19T06:24:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_bytes": 132380, 2024-09-19T06:24:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_items": 996, 2024-09-19T06:24:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_bytes": 0, 2024-09-19T06:24:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_items": 0, 2024-09-19T06:24:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_bytes": 0, 2024-09-19T06:24:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_items": 0 2024-09-19T06:24:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.730 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter": { 2024-09-19T06:24:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: "op_active": 0, 2024-09-19T06:24:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: "op_laggy": 0, 2024-09-19T06:24:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send": 3277, 2024-09-19T06:24:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send_bytes": 26, 2024-09-19T06:24:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: "op_resend": 4, 2024-09-19T06:24:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: "op_reply": 3277, 2024-09-19T06:24:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: "op_latency": { 2024-09-19T06:24:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 3277, 2024-09-19T06:24:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 1.604999994, 2024-09-19T06:24:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000489777 2024-09-19T06:24:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: "op_inflight": 0, 2024-09-19T06:24:58.731 INFO:teuthology.orchestra.run.smithi071.stdout: "oplen_avg": { 2024-09-19T06:24:58.732 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 3277, 2024-09-19T06:24:58.732 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 3278 2024-09-19T06:24:58.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.732 INFO:teuthology.orchestra.run.smithi071.stdout: "op": 3277, 2024-09-19T06:24:58.732 INFO:teuthology.orchestra.run.smithi071.stdout: "op_r": 3277, 2024-09-19T06:24:58.732 INFO:teuthology.orchestra.run.smithi071.stdout: "op_w": 0, 2024-09-19T06:24:58.732 INFO:teuthology.orchestra.run.smithi071.stdout: "op_rmw": 0, 2024-09-19T06:24:58.732 INFO:teuthology.orchestra.run.smithi071.stdout: "op_pg": 0, 2024-09-19T06:24:58.732 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_stat": 1754, 2024-09-19T06:24:58.732 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_create": 0, 2024-09-19T06:24:58.732 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_read": 1520, 2024-09-19T06:24:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_write": 0, 2024-09-19T06:24:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writefull": 0, 2024-09-19T06:24:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writesame": 0, 2024-09-19T06:24:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_append": 0, 2024-09-19T06:24:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_zero": 0, 2024-09-19T06:24:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_truncate": 0, 2024-09-19T06:24:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_delete": 0, 2024-09-19T06:24:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_mapext": 0, 2024-09-19T06:24:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_sparse_read": 0, 2024-09-19T06:24:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_clonerange": 0, 2024-09-19T06:24:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_getxattr": 2, 2024-09-19T06:24:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_setxattr": 0, 2024-09-19T06:24:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:24:58.733 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_rmxattr": 0, 2024-09-19T06:24:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:24:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_call": 0, 2024-09-19T06:24:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_watch": 0, 2024-09-19T06:24:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_notify": 0, 2024-09-19T06:24:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:24:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls": 0, 2024-09-19T06:24:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:24:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_other": 0, 2024-09-19T06:24:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_active": 0, 2024-09-19T06:24:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_send": 0, 2024-09-19T06:24:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_resend": 0, 2024-09-19T06:24:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_ping": 0, 2024-09-19T06:24:58.734 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_active": 0, 2024-09-19T06:24:58.735 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_send": 0, 2024-09-19T06:24:58.735 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_resend": 0, 2024-09-19T06:24:58.735 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_active": 0, 2024-09-19T06:24:58.735 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_send": 0, 2024-09-19T06:24:58.735 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_resend": 0, 2024-09-19T06:24:58.735 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_active": 0, 2024-09-19T06:24:58.735 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_send": 0, 2024-09-19T06:24:58.735 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_resend": 0, 2024-09-19T06:24:58.735 INFO:teuthology.orchestra.run.smithi071.stdout: "command_active": 0, 2024-09-19T06:24:58.735 INFO:teuthology.orchestra.run.smithi071.stdout: "command_send": 0, 2024-09-19T06:24:58.735 INFO:teuthology.orchestra.run.smithi071.stdout: "command_resend": 0, 2024-09-19T06:24:58.735 INFO:teuthology.orchestra.run.smithi071.stdout: "map_epoch": 101, 2024-09-19T06:24:58.735 INFO:teuthology.orchestra.run.smithi071.stdout: "map_full": 0, 2024-09-19T06:24:58.735 INFO:teuthology.orchestra.run.smithi071.stdout: "map_inc": 15, 2024-09-19T06:24:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_sessions": 7, 2024-09-19T06:24:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_open": 7, 2024-09-19T06:24:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_close": 0, 2024-09-19T06:24:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_laggy": 0, 2024-09-19T06:24:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_wr": 0, 2024-09-19T06:24:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_rd": 2, 2024-09-19T06:24:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_del": 0 2024-09-19T06:24:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: "oft": { 2024-09-19T06:24:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_objs": 0, 2024-09-19T06:24:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:24:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_updates": 0, 2024-09-19T06:24:58.736 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_removes": 0 2024-09-19T06:24:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: "osd-slow-ops": { 2024-09-19T06:24:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_ops_count": 0 2024-09-19T06:24:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: "purge_queue": { 2024-09-19T06:24:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops": 0, 2024-09-19T06:24:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T06:24:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing": 0, 2024-09-19T06:24:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_high_water": 0, 2024-09-19T06:24:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed_ops": 0, 2024-09-19T06:24:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed": 0, 2024-09-19T06:24:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_item_in_journal": 0 2024-09-19T06:24:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.737 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:24:58.738 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-19T06:24:58.738 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-19T06:24:58.738 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-19T06:24:58.738 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 3567, 2024-09-19T06:24:58.738 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 25695927, 2024-09-19T06:24:58.738 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:58.738 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 3567, 2024-09-19T06:24:58.738 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-19T06:24:58.738 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-19T06:24:58.738 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 3567, 2024-09-19T06:24:58.738 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 25695927, 2024-09-19T06:24:58.738 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-19T06:24:58.738 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:24:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_bytes": { 2024-09-19T06:24:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-19T06:24:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-19T06:24:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-19T06:24:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-19T06:24:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-19T06:24:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 3277, 2024-09-19T06:24:58.739 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 23336650, 2024-09-19T06:24:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 3277, 2024-09-19T06:24:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 23336650, 2024-09-19T06:24:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-19T06:24:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:24:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_ops": { 2024-09-19T06:24:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-19T06:24:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 1024, 2024-09-19T06:24:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-19T06:24:58.740 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-19T06:24:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-19T06:24:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 3277, 2024-09-19T06:24:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 3277, 2024-09-19T06:24:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 3277, 2024-09-19T06:24:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 3277, 2024-09-19T06:24:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-19T06:24:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:24:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.741 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:24:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-19T06:24:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-19T06:24:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-19T06:24:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-19T06:24:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-19T06:24:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-19T06:24:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-19T06:24:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 0, 2024-09-19T06:24:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 0, 2024-09-19T06:24:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-19T06:24:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.742 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.743 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.743 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:24:58.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:24:58.743 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle-0x564d77c4c6e0": { 2024-09-19T06:24:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-19T06:24:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-19T06:24:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-19T06:24:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-19T06:24:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-19T06:24:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-19T06:24:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-19T06:24:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-19T06:24:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-19T06:24:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 0, 2024-09-19T06:24:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 0, 2024-09-19T06:24:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-19T06:24:58.745 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:24:58.746 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:24:58.746 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:24:58.746 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:24:58.746 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:24:58.746 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-19T06:24:59.564 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-19T06:24:59.564 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-19T06:24:59.564 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-19T06:24:59.564 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-19T06:24:59.564 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-09-19T06:24:59.564 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:24:59.565 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:24:59.565 DEBUG:tasks.check_counter:Getting stats from i 2024-09-19T06:24:59.568 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-19T06:24:59.813 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:25:00.233 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:00 smithi071 ceph-mon[35662]: pgmap v393: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T06:25:00.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:00 smithi003 ceph-mon[30893]: pgmap v393: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T06:25:00.341 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-19T06:25:00.341 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:25:00.341 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 1389, 2024-09-19T06:25:00.342 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 1155, 2024-09-19T06:25:00.342 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 379021, 2024-09-19T06:25:00.342 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 869660, 2024-09-19T06:25:00.342 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 14, 2024-09-19T06:25:00.342 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 3, 2024-09-19T06:25:00.342 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.128417047, 2024-09-19T06:25:00.342 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.049894033, 2024-09-19T06:25:00.342 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.076870138, 2024-09-19T06:25:00.342 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.006061329, 2024-09-19T06:25:00.342 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:00.342 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1154, 2024-09-19T06:25:00.342 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.081447666, 2024-09-19T06:25:00.342 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000070578 2024-09-19T06:25:00.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.343 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:00.343 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2249, 2024-09-19T06:25:00.343 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000572362, 2024-09-19T06:25:00.343 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000254 2024-09-19T06:25:00.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.343 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 3184, 2024-09-19T06:25:00.343 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 361168 2024-09-19T06:25:00.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.343 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:25:00.343 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 446, 2024-09-19T06:25:00.343 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 465, 2024-09-19T06:25:00.343 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 1846186, 2024-09-19T06:25:00.344 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 644433, 2024-09-19T06:25:00.344 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 48, 2024-09-19T06:25:00.344 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 6, 2024-09-19T06:25:00.344 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.076842582, 2024-09-19T06:25:00.344 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.023008638, 2024-09-19T06:25:00.344 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.070124240, 2024-09-19T06:25:00.344 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.000245720, 2024-09-19T06:25:00.344 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:00.344 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 461, 2024-09-19T06:25:00.344 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.034786073, 2024-09-19T06:25:00.344 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000075457 2024-09-19T06:25:00.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.344 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:00.345 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 228, 2024-09-19T06:25:00.345 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000040252, 2024-09-19T06:25:00.345 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000176 2024-09-19T06:25:00.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.345 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 1815088, 2024-09-19T06:25:00.345 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 177328 2024-09-19T06:25:00.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.345 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:25:00.345 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 141, 2024-09-19T06:25:00.345 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 174, 2024-09-19T06:25:00.345 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 52405, 2024-09-19T06:25:00.345 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 219256, 2024-09-19T06:25:00.346 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 12, 2024-09-19T06:25:00.346 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 5, 2024-09-19T06:25:00.346 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.019484583, 2024-09-19T06:25:00.346 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.006494409, 2024-09-19T06:25:00.346 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.013147082, 2024-09-19T06:25:00.346 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.000541170, 2024-09-19T06:25:00.346 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:00.346 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 174, 2024-09-19T06:25:00.346 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.021598673, 2024-09-19T06:25:00.346 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000124130 2024-09-19T06:25:00.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.346 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:00.346 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 227, 2024-09-19T06:25:00.346 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000065655, 2024-09-19T06:25:00.346 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000289 2024-09-19T06:25:00.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.347 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 1088, 2024-09-19T06:25:00.347 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 133728 2024-09-19T06:25:00.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.347 INFO:teuthology.orchestra.run.smithi071.stdout: "cct": { 2024-09-19T06:25:00.347 INFO:teuthology.orchestra.run.smithi071.stdout: "total_workers": 1, 2024-09-19T06:25:00.347 INFO:teuthology.orchestra.run.smithi071.stdout: "unhealthy_workers": 0 2024-09-19T06:25:00.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.347 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-MDSRank": { 2024-09-19T06:25:00.347 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-19T06:25:00.347 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-19T06:25:00.347 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 62, 2024-09-19T06:25:00.347 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.002072704, 2024-09-19T06:25:00.347 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000033430 2024-09-19T06:25:00.348 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:25:00.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.348 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-PurgeQueue": { 2024-09-19T06:25:00.348 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-19T06:25:00.348 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-19T06:25:00.348 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2, 2024-09-19T06:25:00.348 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000008178, 2024-09-19T06:25:00.348 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000004089 2024-09-19T06:25:00.348 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:25:00.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.348 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-19T06:25:00.348 INFO:teuthology.orchestra.run.smithi071.stdout: "request": 11, 2024-09-19T06:25:00.348 INFO:teuthology.orchestra.run.smithi071.stdout: "reply": 7, 2024-09-19T06:25:00.348 INFO:teuthology.orchestra.run.smithi071.stdout: "reply_latency": { 2024-09-19T06:25:00.349 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 7, 2024-09-19T06:25:00.349 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.002416762, 2024-09-19T06:25:00.349 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000345251 2024-09-19T06:25:00.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.349 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_reply": 0, 2024-09-19T06:25:00.349 INFO:teuthology.orchestra.run.smithi071.stdout: "forward": 4, 2024-09-19T06:25:00.349 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_complete": 0, 2024-09-19T06:25:00.349 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_keys": 0, 2024-09-19T06:25:00.349 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_commit": 11, 2024-09-19T06:25:00.349 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_split": 0, 2024-09-19T06:25:00.349 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_merge": 0, 2024-09-19T06:25:00.349 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes": 16, 2024-09-19T06:25:00.349 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_top": 0, 2024-09-19T06:25:00.350 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_bottom": 16, 2024-09-19T06:25:00.350 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pin_tail": 0, 2024-09-19T06:25:00.350 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pinned": 13, 2024-09-19T06:25:00.350 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_expired": 4, 2024-09-19T06:25:00.350 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_with_caps": 2, 2024-09-19T06:25:00.350 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": 2, 2024-09-19T06:25:00.350 INFO:teuthology.orchestra.run.smithi071.stdout: "subtrees": 3, 2024-09-19T06:25:00.350 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse": 22, 2024-09-19T06:25:00.350 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_hit": 15, 2024-09-19T06:25:00.350 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_forward": 1, 2024-09-19T06:25:00.350 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_discover": 4, 2024-09-19T06:25:00.350 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:25:00.350 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_remote_ino": 0, 2024-09-19T06:25:00.351 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_lock": 0, 2024-09-19T06:25:00.351 INFO:teuthology.orchestra.run.smithi071.stdout: "load_cent": 1000, 2024-09-19T06:25:00.351 INFO:teuthology.orchestra.run.smithi071.stdout: "q": 1, 2024-09-19T06:25:00.351 INFO:teuthology.orchestra.run.smithi071.stdout: "exported": 0, 2024-09-19T06:25:00.351 INFO:teuthology.orchestra.run.smithi071.stdout: "exported_inodes": 0, 2024-09-19T06:25:00.351 INFO:teuthology.orchestra.run.smithi071.stdout: "imported": 0, 2024-09-19T06:25:00.351 INFO:teuthology.orchestra.run.smithi071.stdout: "imported_inodes": 0, 2024-09-19T06:25:00.351 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_dir_fetch": 0, 2024-09-19T06:25:00.351 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_backtrace_fetch": 0, 2024-09-19T06:25:00.351 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_peer_discover": 0, 2024-09-19T06:25:00.351 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rfiles": 5, 2024-09-19T06:25:00.351 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rbytes": 298, 2024-09-19T06:25:00.351 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rsnaps": 6, 2024-09-19T06:25:00.351 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T06:25:00.352 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_set_tag": 0, 2024-09-19T06:25:00.352 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:25:00.352 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:25:00.352 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:25:00.352 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:25:00.352 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:25:00.352 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_file_inodes": 0, 2024-09-19T06:25:00.352 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:25:00.352 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T06:25:00.352 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_grant": 0, 2024-09-19T06:25:00.352 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:25:00.352 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:25:00.352 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:25:00.352 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps": 0, 2024-09-19T06:25:00.353 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps_dirty": 0, 2024-09-19T06:25:00.353 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_cap_release": 0, 2024-09-19T06:25:00.353 INFO:teuthology.orchestra.run.smithi071.stdout: "process_request_cap_release": 1 2024-09-19T06:25:00.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.353 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache": { 2024-09-19T06:25:00.353 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update": 0, 2024-09-19T06:25:00.353 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update_receipt": 9, 2024-09-19T06:25:00.353 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_try_discover": 6, 2024-09-19T06:25:00.353 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_send_discover": 8, 2024-09-19T06:25:00.353 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_handle_discover": 0, 2024-09-19T06:25:00.353 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays": 0, 2024-09-19T06:25:00.353 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_delayed": 0, 2024-09-19T06:25:00.354 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:25:00.354 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_created": 0, 2024-09-19T06:25:00.354 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_enqueued": 0, 2024-09-19T06:25:00.354 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_reintegrated": 0, 2024-09-19T06:25:00.354 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_migrated": 0, 2024-09-19T06:25:00.354 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_processing": 0, 2024-09-19T06:25:00.354 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:25:00.354 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:25:00.354 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_started": 0, 2024-09-19T06:25:00.354 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_completed": 0, 2024-09-19T06:25:00.354 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:25:00.354 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:25:00.354 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:25:00.355 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_exportdir": 0, 2024-09-19T06:25:00.355 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_flush": 0, 2024-09-19T06:25:00.355 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:25:00.355 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragstats": 0, 2024-09-19T06:25:00.355 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_inodestats": 0 2024-09-19T06:25:00.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.355 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log": { 2024-09-19T06:25:00.355 INFO:teuthology.orchestra.run.smithi071.stdout: "evlrg": 0, 2024-09-19T06:25:00.355 INFO:teuthology.orchestra.run.smithi071.stdout: "evadd": 10, 2024-09-19T06:25:00.355 INFO:teuthology.orchestra.run.smithi071.stdout: "evex": 0, 2024-09-19T06:25:00.355 INFO:teuthology.orchestra.run.smithi071.stdout: "evtrm": 0, 2024-09-19T06:25:00.355 INFO:teuthology.orchestra.run.smithi071.stdout: "ev": 10, 2024-09-19T06:25:00.355 INFO:teuthology.orchestra.run.smithi071.stdout: "evexg": 0, 2024-09-19T06:25:00.355 INFO:teuthology.orchestra.run.smithi071.stdout: "evexd": 0, 2024-09-19T06:25:00.355 INFO:teuthology.orchestra.run.smithi071.stdout: "segadd": 2, 2024-09-19T06:25:00.356 INFO:teuthology.orchestra.run.smithi071.stdout: "segex": 0, 2024-09-19T06:25:00.356 INFO:teuthology.orchestra.run.smithi071.stdout: "segtrm": 0, 2024-09-19T06:25:00.356 INFO:teuthology.orchestra.run.smithi071.stdout: "seg": 2, 2024-09-19T06:25:00.356 INFO:teuthology.orchestra.run.smithi071.stdout: "segmjr": 2, 2024-09-19T06:25:00.356 INFO:teuthology.orchestra.run.smithi071.stdout: "segexg": 0, 2024-09-19T06:25:00.356 INFO:teuthology.orchestra.run.smithi071.stdout: "segexd": 0, 2024-09-19T06:25:00.356 INFO:teuthology.orchestra.run.smithi071.stdout: "expos": 4194304, 2024-09-19T06:25:00.356 INFO:teuthology.orchestra.run.smithi071.stdout: "wrpos": 4197198, 2024-09-19T06:25:00.356 INFO:teuthology.orchestra.run.smithi071.stdout: "rdpos": 0, 2024-09-19T06:25:00.356 INFO:teuthology.orchestra.run.smithi071.stdout: "jlat": { 2024-09-19T06:25:00.356 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 9, 2024-09-19T06:25:00.356 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.015978303, 2024-09-19T06:25:00.356 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.001775367 2024-09-19T06:25:00.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.357 INFO:teuthology.orchestra.run.smithi071.stdout: "replayed": 0 2024-09-19T06:25:00.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.357 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_mem": { 2024-09-19T06:25:00.357 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 20, 2024-09-19T06:25:00.357 INFO:teuthology.orchestra.run.smithi071.stdout: "ino+": 22, 2024-09-19T06:25:00.357 INFO:teuthology.orchestra.run.smithi071.stdout: "ino-": 2, 2024-09-19T06:25:00.357 INFO:teuthology.orchestra.run.smithi071.stdout: "dir": 19, 2024-09-19T06:25:00.357 INFO:teuthology.orchestra.run.smithi071.stdout: "dir+": 22, 2024-09-19T06:25:00.357 INFO:teuthology.orchestra.run.smithi071.stdout: "dir-": 3, 2024-09-19T06:25:00.357 INFO:teuthology.orchestra.run.smithi071.stdout: "dn": 16, 2024-09-19T06:25:00.357 INFO:teuthology.orchestra.run.smithi071.stdout: "dn+": 20, 2024-09-19T06:25:00.357 INFO:teuthology.orchestra.run.smithi071.stdout: "dn-": 4, 2024-09-19T06:25:00.357 INFO:teuthology.orchestra.run.smithi071.stdout: "cap": 2, 2024-09-19T06:25:00.357 INFO:teuthology.orchestra.run.smithi071.stdout: "cap+": 5, 2024-09-19T06:25:00.358 INFO:teuthology.orchestra.run.smithi071.stdout: "cap-": 3, 2024-09-19T06:25:00.358 INFO:teuthology.orchestra.run.smithi071.stdout: "rss": 51396, 2024-09-19T06:25:00.358 INFO:teuthology.orchestra.run.smithi071.stdout: "heap": 223520 2024-09-19T06:25:00.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.358 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_server": { 2024-09-19T06:25:00.358 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_client_request": 15, 2024-09-19T06:25:00.358 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_server_request": 0, 2024-09-19T06:25:00.358 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_request": 11, 2024-09-19T06:25:00.358 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_session": 32, 2024-09-19T06:25:00.358 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_peer_request": 1, 2024-09-19T06:25:00.358 INFO:teuthology.orchestra.run.smithi071.stdout: "req_create_latency": { 2024-09-19T06:25:00.358 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.358 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.358 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.359 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getattr_latency": { 2024-09-19T06:25:00.359 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 5, 2024-09-19T06:25:00.359 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.002141038, 2024-09-19T06:25:00.359 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000428207 2024-09-19T06:25:00.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.359 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getfilelock_latency": { 2024-09-19T06:25:00.359 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.359 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.359 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.359 INFO:teuthology.orchestra.run.smithi071.stdout: "req_link_latency": { 2024-09-19T06:25:00.360 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.360 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.360 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.360 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookup_latency": { 2024-09-19T06:25:00.360 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1, 2024-09-19T06:25:00.360 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000136986, 2024-09-19T06:25:00.360 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000136986 2024-09-19T06:25:00.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.360 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookuphash_latency": { 2024-09-19T06:25:00.361 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.361 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.361 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.361 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupino_latency": { 2024-09-19T06:25:00.361 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1, 2024-09-19T06:25:00.361 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000138738, 2024-09-19T06:25:00.361 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000138738 2024-09-19T06:25:00.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.361 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupname_latency": { 2024-09-19T06:25:00.361 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.361 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.361 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.362 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupparent_latency": { 2024-09-19T06:25:00.362 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.362 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.362 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.362 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupsnap_latency": { 2024-09-19T06:25:00.362 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.362 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.362 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.362 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lssnap_latency": { 2024-09-19T06:25:00.362 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.362 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.363 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.363 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mkdir_latency": { 2024-09-19T06:25:00.363 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.363 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.363 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.363 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mknod_latency": { 2024-09-19T06:25:00.363 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.363 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.363 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.363 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mksnap_latency": { 2024-09-19T06:25:00.364 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.364 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.364 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.364 INFO:teuthology.orchestra.run.smithi071.stdout: "req_open_latency": { 2024-09-19T06:25:00.364 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.364 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.364 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.364 INFO:teuthology.orchestra.run.smithi071.stdout: "req_readdir_latency": { 2024-09-19T06:25:00.364 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.364 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.364 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.365 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rename_latency": { 2024-09-19T06:25:00.365 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.365 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.365 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.365 INFO:teuthology.orchestra.run.smithi071.stdout: "req_renamesnap_latency": { 2024-09-19T06:25:00.365 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.365 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.365 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.365 INFO:teuthology.orchestra.run.smithi071.stdout: "req_snapdiff_latency": { 2024-09-19T06:25:00.365 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.366 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.366 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.366 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmdir_latency": { 2024-09-19T06:25:00.366 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.366 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.366 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.366 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmsnap_latency": { 2024-09-19T06:25:00.366 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.366 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.366 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.367 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmxattr_latency": { 2024-09-19T06:25:00.367 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.367 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.367 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.367 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setattr_latency": { 2024-09-19T06:25:00.367 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.367 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.367 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.367 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setdirlayout_latency": { 2024-09-19T06:25:00.367 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.367 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.368 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.368 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setfilelock_latency": { 2024-09-19T06:25:00.368 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.368 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.368 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.368 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setlayout_latency": { 2024-09-19T06:25:00.368 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.368 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.368 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.368 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setxattr_latency": { 2024-09-19T06:25:00.369 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.369 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.369 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.369 INFO:teuthology.orchestra.run.smithi071.stdout: "req_symlink_latency": { 2024-09-19T06:25:00.369 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.369 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.369 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.369 INFO:teuthology.orchestra.run.smithi071.stdout: "req_unlink_latency": { 2024-09-19T06:25:00.369 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.369 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.369 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.370 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:25:00.370 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:25:00.370 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getvxattr_latency": { 2024-09-19T06:25:00.370 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.370 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.370 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.370 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:25:00.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.370 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sessions": { 2024-09-19T06:25:00.370 INFO:teuthology.orchestra.run.smithi071.stdout: "session_count": 2, 2024-09-19T06:25:00.370 INFO:teuthology.orchestra.run.smithi071.stdout: "session_add": 5, 2024-09-19T06:25:00.370 INFO:teuthology.orchestra.run.smithi071.stdout: "session_remove": 3, 2024-09-19T06:25:00.370 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_open": 2, 2024-09-19T06:25:00.371 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_stale": 0, 2024-09-19T06:25:00.371 INFO:teuthology.orchestra.run.smithi071.stdout: "total_load": 5, 2024-09-19T06:25:00.371 INFO:teuthology.orchestra.run.smithi071.stdout: "average_load": 1, 2024-09-19T06:25:00.371 INFO:teuthology.orchestra.run.smithi071.stdout: "avg_session_uptime": 730, 2024-09-19T06:25:00.371 INFO:teuthology.orchestra.run.smithi071.stdout: "mdthresh_evicted": 0 2024-09-19T06:25:00.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.371 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool": { 2024-09-19T06:25:00.371 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:25:00.371 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_items": 0, 2024-09-19T06:25:00.371 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:25:00.371 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:25:00.371 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:25:00.371 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:25:00.371 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:25:00.372 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:25:00.372 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:25:00.372 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:25:00.372 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:25:00.372 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:25:00.372 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:25:00.372 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:25:00.372 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:25:00.372 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_items": 0, 2024-09-19T06:25:00.372 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:25:00.372 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_items": 0, 2024-09-19T06:25:00.372 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:25:00.372 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:25:00.372 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:25:00.373 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:25:00.373 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:25:00.373 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:25:00.373 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:25:00.373 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_items": 0, 2024-09-19T06:25:00.373 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:25:00.373 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:25:00.373 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:25:00.373 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_items": 0, 2024-09-19T06:25:00.373 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_bytes": 0, 2024-09-19T06:25:00.373 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_items": 0, 2024-09-19T06:25:00.373 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:25:00.373 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:25:00.374 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:25:00.374 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:25:00.374 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_bytes": 297061, 2024-09-19T06:25:00.374 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_items": 114, 2024-09-19T06:25:00.374 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_bytes": 88, 2024-09-19T06:25:00.374 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_items": 1, 2024-09-19T06:25:00.374 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bytes": 0, 2024-09-19T06:25:00.374 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_items": 0, 2024-09-19T06:25:00.374 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:25:00.374 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_items": 0, 2024-09-19T06:25:00.374 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:25:00.374 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_items": 0, 2024-09-19T06:25:00.374 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_bytes": 8320, 2024-09-19T06:25:00.375 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_items": 183, 2024-09-19T06:25:00.375 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:25:00.375 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:25:00.375 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_bytes": 0, 2024-09-19T06:25:00.375 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_items": 0, 2024-09-19T06:25:00.375 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_bytes": 87133, 2024-09-19T06:25:00.375 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_items": 344, 2024-09-19T06:25:00.375 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_bytes": 0, 2024-09-19T06:25:00.375 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_items": 0, 2024-09-19T06:25:00.375 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_bytes": 0, 2024-09-19T06:25:00.375 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_items": 0 2024-09-19T06:25:00.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.375 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter": { 2024-09-19T06:25:00.375 INFO:teuthology.orchestra.run.smithi071.stdout: "op_active": 0, 2024-09-19T06:25:00.376 INFO:teuthology.orchestra.run.smithi071.stdout: "op_laggy": 0, 2024-09-19T06:25:00.376 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send": 50, 2024-09-19T06:25:00.376 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send_bytes": 13727, 2024-09-19T06:25:00.376 INFO:teuthology.orchestra.run.smithi071.stdout: "op_resend": 29, 2024-09-19T06:25:00.376 INFO:teuthology.orchestra.run.smithi071.stdout: "op_reply": 50, 2024-09-19T06:25:00.376 INFO:teuthology.orchestra.run.smithi071.stdout: "op_latency": { 2024-09-19T06:25:00.376 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 50, 2024-09-19T06:25:00.376 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.255000075, 2024-09-19T06:25:00.376 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.005100001 2024-09-19T06:25:00.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.376 INFO:teuthology.orchestra.run.smithi071.stdout: "op_inflight": 0, 2024-09-19T06:25:00.376 INFO:teuthology.orchestra.run.smithi071.stdout: "oplen_avg": { 2024-09-19T06:25:00.376 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 50, 2024-09-19T06:25:00.377 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 75 2024-09-19T06:25:00.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.377 INFO:teuthology.orchestra.run.smithi071.stdout: "op": 50, 2024-09-19T06:25:00.377 INFO:teuthology.orchestra.run.smithi071.stdout: "op_r": 0, 2024-09-19T06:25:00.377 INFO:teuthology.orchestra.run.smithi071.stdout: "op_w": 50, 2024-09-19T06:25:00.377 INFO:teuthology.orchestra.run.smithi071.stdout: "op_rmw": 0, 2024-09-19T06:25:00.377 INFO:teuthology.orchestra.run.smithi071.stdout: "op_pg": 0, 2024-09-19T06:25:00.377 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_stat": 0, 2024-09-19T06:25:00.377 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_create": 10, 2024-09-19T06:25:00.377 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_read": 0, 2024-09-19T06:25:00.377 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_write": 9, 2024-09-19T06:25:00.377 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writefull": 9, 2024-09-19T06:25:00.377 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writesame": 0, 2024-09-19T06:25:00.378 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_append": 0, 2024-09-19T06:25:00.378 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_zero": 0, 2024-09-19T06:25:00.378 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_truncate": 0, 2024-09-19T06:25:00.378 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_delete": 6, 2024-09-19T06:25:00.378 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_mapext": 0, 2024-09-19T06:25:00.378 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_sparse_read": 0, 2024-09-19T06:25:00.378 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_clonerange": 0, 2024-09-19T06:25:00.378 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_getxattr": 0, 2024-09-19T06:25:00.378 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_setxattr": 20, 2024-09-19T06:25:00.378 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:25:00.378 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_rmxattr": 0, 2024-09-19T06:25:00.378 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:25:00.378 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_call": 0, 2024-09-19T06:25:00.379 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_watch": 0, 2024-09-19T06:25:00.379 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_notify": 0, 2024-09-19T06:25:00.379 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:25:00.379 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls": 0, 2024-09-19T06:25:00.379 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:25:00.379 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_other": 0, 2024-09-19T06:25:00.379 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_active": 0, 2024-09-19T06:25:00.379 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_send": 0, 2024-09-19T06:25:00.379 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_resend": 0, 2024-09-19T06:25:00.379 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_ping": 0, 2024-09-19T06:25:00.379 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_active": 0, 2024-09-19T06:25:00.379 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_send": 0, 2024-09-19T06:25:00.379 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_resend": 0, 2024-09-19T06:25:00.379 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_active": 0, 2024-09-19T06:25:00.380 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_send": 0, 2024-09-19T06:25:00.380 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_resend": 0, 2024-09-19T06:25:00.380 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_active": 0, 2024-09-19T06:25:00.380 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_send": 0, 2024-09-19T06:25:00.380 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_resend": 0, 2024-09-19T06:25:00.380 INFO:teuthology.orchestra.run.smithi071.stdout: "command_active": 0, 2024-09-19T06:25:00.380 INFO:teuthology.orchestra.run.smithi071.stdout: "command_send": 0, 2024-09-19T06:25:00.380 INFO:teuthology.orchestra.run.smithi071.stdout: "command_resend": 0, 2024-09-19T06:25:00.380 INFO:teuthology.orchestra.run.smithi071.stdout: "map_epoch": 101, 2024-09-19T06:25:00.380 INFO:teuthology.orchestra.run.smithi071.stdout: "map_full": 0, 2024-09-19T06:25:00.380 INFO:teuthology.orchestra.run.smithi071.stdout: "map_inc": 15, 2024-09-19T06:25:00.380 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_sessions": 10, 2024-09-19T06:25:00.380 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_open": 10, 2024-09-19T06:25:00.381 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_close": 0, 2024-09-19T06:25:00.381 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_laggy": 0, 2024-09-19T06:25:00.381 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_wr": 20, 2024-09-19T06:25:00.381 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_rd": 0, 2024-09-19T06:25:00.381 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_del": 1 2024-09-19T06:25:00.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.381 INFO:teuthology.orchestra.run.smithi071.stdout: "oft": { 2024-09-19T06:25:00.381 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_objs": 1, 2024-09-19T06:25:00.381 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:25:00.381 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_updates": 0, 2024-09-19T06:25:00.381 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_removes": 0 2024-09-19T06:25:00.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.381 INFO:teuthology.orchestra.run.smithi071.stdout: "osd-slow-ops": { 2024-09-19T06:25:00.382 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_ops_count": 0 2024-09-19T06:25:00.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.382 INFO:teuthology.orchestra.run.smithi071.stdout: "purge_queue": { 2024-09-19T06:25:00.382 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops": 0, 2024-09-19T06:25:00.382 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T06:25:00.382 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing": 0, 2024-09-19T06:25:00.382 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_high_water": 0, 2024-09-19T06:25:00.382 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed_ops": 0, 2024-09-19T06:25:00.382 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed": 0, 2024-09-19T06:25:00.382 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_item_in_journal": 0 2024-09-19T06:25:00.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.382 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:25:00.384 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-19T06:25:00.384 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-19T06:25:00.384 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-19T06:25:00.384 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 1972, 2024-09-19T06:25:00.384 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 2079982, 2024-09-19T06:25:00.384 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:00.384 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 1972, 2024-09-19T06:25:00.384 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-19T06:25:00.385 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-19T06:25:00.385 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 1972, 2024-09-19T06:25:00.385 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 2079982, 2024-09-19T06:25:00.385 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-19T06:25:00.385 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.385 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.385 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.385 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:25:00.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.385 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_bytes": { 2024-09-19T06:25:00.385 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-19T06:25:00.385 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-19T06:25:00.385 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-19T06:25:00.385 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-19T06:25:00.386 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-19T06:25:00.386 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:00.386 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:00.386 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 50, 2024-09-19T06:25:00.386 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 13727, 2024-09-19T06:25:00.386 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 50, 2024-09-19T06:25:00.386 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 13727, 2024-09-19T06:25:00.386 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-19T06:25:00.386 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.386 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.386 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.386 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:25:00.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.386 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_ops": { 2024-09-19T06:25:00.387 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-19T06:25:00.387 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 1024, 2024-09-19T06:25:00.387 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-19T06:25:00.387 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-19T06:25:00.387 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-19T06:25:00.387 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:00.387 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:00.387 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 50, 2024-09-19T06:25:00.387 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 50, 2024-09-19T06:25:00.387 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 50, 2024-09-19T06:25:00.387 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 50, 2024-09-19T06:25:00.387 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-19T06:25:00.387 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.387 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.388 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:25:00.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.388 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:25:00.388 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-19T06:25:00.388 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-19T06:25:00.388 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-19T06:25:00.388 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-19T06:25:00.388 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-19T06:25:00.388 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:00.388 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:00.388 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-19T06:25:00.388 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-19T06:25:00.389 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 0, 2024-09-19T06:25:00.389 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 0, 2024-09-19T06:25:00.389 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-19T06:25:00.389 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.389 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.389 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.389 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:25:00.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:00.389 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle-0x5632145b8500": { 2024-09-19T06:25:00.389 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-19T06:25:00.389 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-19T06:25:00.389 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-19T06:25:00.389 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 10, 2024-09-19T06:25:00.389 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 2894, 2024-09-19T06:25:00.390 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:00.390 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 10, 2024-09-19T06:25:00.390 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-19T06:25:00.390 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-19T06:25:00.390 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 9, 2024-09-19T06:25:00.390 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 2894, 2024-09-19T06:25:00.390 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-19T06:25:00.390 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:00.390 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:00.390 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:00.390 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:25:00.390 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:25:00.390 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-19T06:25:00.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:00 smithi059 ceph-mon[35138]: pgmap v393: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-19T06:25:01.135 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-19T06:25:01.135 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-19T06:25:01.135 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-09-19T06:25:01.135 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=9 2024-09-19T06:25:01.135 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-19T06:25:01.135 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:25:01.135 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:25:01.136 DEBUG:tasks.check_counter:Getting stats from l 2024-09-19T06:25:01.136 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-19T06:25:01.381 INFO:teuthology.orchestra.run.smithi071.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T06:25:01.914 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-09-19T06:25:01.914 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T06:25:01.914 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 901, 2024-09-19T06:25:01.914 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 903, 2024-09-19T06:25:01.915 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 302069, 2024-09-19T06:25:01.915 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 286519, 2024-09-19T06:25:01.915 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 6, 2024-09-19T06:25:01.915 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 2, 2024-09-19T06:25:01.915 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.112990349, 2024-09-19T06:25:01.915 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.034745004, 2024-09-19T06:25:01.915 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.029953638, 2024-09-19T06:25:01.915 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.036105005, 2024-09-19T06:25:01.915 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:01.915 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 901, 2024-09-19T06:25:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.057290584, 2024-09-19T06:25:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000063585 2024-09-19T06:25:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T06:25:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T06:25:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T06:25:01.916 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 768, 2024-09-19T06:25:01.917 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 958, 2024-09-19T06:25:01.917 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 191448, 2024-09-19T06:25:01.917 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 737184, 2024-09-19T06:25:01.917 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 7, 2024-09-19T06:25:01.917 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 5, 2024-09-19T06:25:01.917 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.092065405, 2024-09-19T06:25:01.917 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.035885175, 2024-09-19T06:25:01.917 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.020502667, 2024-09-19T06:25:01.917 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.026933157, 2024-09-19T06:25:01.918 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:01.918 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 956, 2024-09-19T06:25:01.918 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.053524328, 2024-09-19T06:25:01.918 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000055987 2024-09-19T06:25:01.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.918 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:01.918 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.918 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.918 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.919 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-09-19T06:25:01.919 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 494800 2024-09-19T06:25:01.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.919 INFO:teuthology.orchestra.run.smithi071.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T06:25:01.919 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_messages": 1164, 2024-09-19T06:25:01.919 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages": 1146, 2024-09-19T06:25:01.919 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_bytes": 2023603, 2024-09-19T06:25:01.919 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_bytes": 437006, 2024-09-19T06:25:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_created_connections": 3, 2024-09-19T06:25:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_active_connections": 2, 2024-09-19T06:25:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_total_time": 0.128367135, 2024-09-19T06:25:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_send_time": 0.045723864, 2024-09-19T06:25:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_recv_time": 0.070423825, 2024-09-19T06:25:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_running_fast_dispatch_time": 0.021506927, 2024-09-19T06:25:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T06:25:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 1145, 2024-09-19T06:25:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.051187372, 2024-09-19T06:25:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000044705 2024-09-19T06:25:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_handle_ack_lat": { 2024-09-19T06:25:01.920 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_recv_encrypted_bytes": 1793648, 2024-09-19T06:25:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: "msgr_send_encrypted_bytes": 159392 2024-09-19T06:25:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: "cct": { 2024-09-19T06:25:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: "total_workers": 1, 2024-09-19T06:25:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: "unhealthy_workers": 0 2024-09-19T06:25:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.921 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-MDSRank": { 2024-09-19T06:25:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-19T06:25:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-19T06:25:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 4218, 2024-09-19T06:25:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.130536568, 2024-09-19T06:25:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000030947 2024-09-19T06:25:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:25:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: "finisher-PurgeQueue": { 2024-09-19T06:25:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: "queue_len": 0, 2024-09-19T06:25:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: "complete_latency": { 2024-09-19T06:25:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.922 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.923 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.923 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:25:01.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.923 INFO:teuthology.orchestra.run.smithi071.stdout: "mds": { 2024-09-19T06:25:01.923 INFO:teuthology.orchestra.run.smithi071.stdout: "request": 0, 2024-09-19T06:25:01.923 INFO:teuthology.orchestra.run.smithi071.stdout: "reply": 0, 2024-09-19T06:25:01.923 INFO:teuthology.orchestra.run.smithi071.stdout: "reply_latency": { 2024-09-19T06:25:01.923 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.923 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.923 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_reply": 0, 2024-09-19T06:25:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: "forward": 0, 2024-09-19T06:25:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_complete": 0, 2024-09-19T06:25:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_fetch_keys": 0, 2024-09-19T06:25:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_commit": 0, 2024-09-19T06:25:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_split": 0, 2024-09-19T06:25:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_merge": 0, 2024-09-19T06:25:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes": 0, 2024-09-19T06:25:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_top": 0, 2024-09-19T06:25:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_bottom": 0, 2024-09-19T06:25:01.924 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pin_tail": 0, 2024-09-19T06:25:01.925 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_pinned": 0, 2024-09-19T06:25:01.925 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_expired": 0, 2024-09-19T06:25:01.925 INFO:teuthology.orchestra.run.smithi071.stdout: "inodes_with_caps": 0, 2024-09-19T06:25:01.925 INFO:teuthology.orchestra.run.smithi071.stdout: "caps": 0, 2024-09-19T06:25:01.925 INFO:teuthology.orchestra.run.smithi071.stdout: "subtrees": 1, 2024-09-19T06:25:01.925 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse": 0, 2024-09-19T06:25:01.925 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_hit": 0, 2024-09-19T06:25:01.925 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_forward": 0, 2024-09-19T06:25:01.925 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_discover": 0, 2024-09-19T06:25:01.925 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_dir_fetch": 0, 2024-09-19T06:25:01.925 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_remote_ino": 0, 2024-09-19T06:25:01.926 INFO:teuthology.orchestra.run.smithi071.stdout: "traverse_lock": 0, 2024-09-19T06:25:01.926 INFO:teuthology.orchestra.run.smithi071.stdout: "load_cent": 0, 2024-09-19T06:25:01.926 INFO:teuthology.orchestra.run.smithi071.stdout: "q": 0, 2024-09-19T06:25:01.926 INFO:teuthology.orchestra.run.smithi071.stdout: "exported": 0, 2024-09-19T06:25:01.926 INFO:teuthology.orchestra.run.smithi071.stdout: "exported_inodes": 0, 2024-09-19T06:25:01.926 INFO:teuthology.orchestra.run.smithi071.stdout: "imported": 0, 2024-09-19T06:25:01.926 INFO:teuthology.orchestra.run.smithi071.stdout: "imported_inodes": 0, 2024-09-19T06:25:01.926 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_dir_fetch": 0, 2024-09-19T06:25:01.926 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_backtrace_fetch": 0, 2024-09-19T06:25:01.926 INFO:teuthology.orchestra.run.smithi071.stdout: "openino_peer_discover": 0, 2024-09-19T06:25:01.926 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rfiles": 0, 2024-09-19T06:25:01.926 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rbytes": 0, 2024-09-19T06:25:01.927 INFO:teuthology.orchestra.run.smithi071.stdout: "root_rsnaps": 0, 2024-09-19T06:25:01.927 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T06:25:01.927 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_set_tag": 0, 2024-09-19T06:25:01.927 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T06:25:01.927 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_inotable_repaired": 0, 2024-09-19T06:25:01.927 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_inodes": 0, 2024-09-19T06:25:01.927 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T06:25:01.927 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T06:25:01.927 INFO:teuthology.orchestra.run.smithi071.stdout: "scrub_file_inodes": 0, 2024-09-19T06:25:01.927 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_inode_file_caps": 0, 2024-09-19T06:25:01.927 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T06:25:01.927 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_grant": 0, 2024-09-19T06:25:01.928 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T06:25:01.928 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T06:25:01.928 INFO:teuthology.orchestra.run.smithi071.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T06:25:01.928 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps": 0, 2024-09-19T06:25:01.928 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_caps_dirty": 0, 2024-09-19T06:25:01.928 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_cap_release": 0, 2024-09-19T06:25:01.928 INFO:teuthology.orchestra.run.smithi071.stdout: "process_request_cap_release": 0 2024-09-19T06:25:01.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.928 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache": { 2024-09-19T06:25:01.928 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update": 0, 2024-09-19T06:25:01.929 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_update_receipt": 0, 2024-09-19T06:25:01.929 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_try_discover": 0, 2024-09-19T06:25:01.929 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_send_discover": 0, 2024-09-19T06:25:01.929 INFO:teuthology.orchestra.run.smithi071.stdout: "dir_handle_discover": 0, 2024-09-19T06:25:01.929 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays": 0, 2024-09-19T06:25:01.929 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_delayed": 0, 2024-09-19T06:25:01.929 INFO:teuthology.orchestra.run.smithi071.stdout: "num_strays_enqueuing": 0, 2024-09-19T06:25:01.929 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_created": 0, 2024-09-19T06:25:01.929 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_enqueued": 0, 2024-09-19T06:25:01.930 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_reintegrated": 0, 2024-09-19T06:25:01.930 INFO:teuthology.orchestra.run.smithi071.stdout: "strays_migrated": 0, 2024-09-19T06:25:01.930 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_processing": 0, 2024-09-19T06:25:01.930 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_enqueued": 0, 2024-09-19T06:25:01.930 INFO:teuthology.orchestra.run.smithi071.stdout: "num_recovering_prioritized": 0, 2024-09-19T06:25:01.930 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_started": 0, 2024-09-19T06:25:01.930 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_completed": 0, 2024-09-19T06:25:01.930 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_path": 0, 2024-09-19T06:25:01.930 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_quiesce_inode": 0, 2024-09-19T06:25:01.930 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T06:25:01.930 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_exportdir": 0, 2024-09-19T06:25:01.931 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_flush": 0, 2024-09-19T06:25:01.931 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragmentdir": 0, 2024-09-19T06:25:01.931 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_fragstats": 0, 2024-09-19T06:25:01.931 INFO:teuthology.orchestra.run.smithi071.stdout: "ireq_inodestats": 0 2024-09-19T06:25:01.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.931 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log": { 2024-09-19T06:25:01.931 INFO:teuthology.orchestra.run.smithi071.stdout: "evlrg": 0, 2024-09-19T06:25:01.931 INFO:teuthology.orchestra.run.smithi071.stdout: "evadd": 0, 2024-09-19T06:25:01.931 INFO:teuthology.orchestra.run.smithi071.stdout: "evex": 0, 2024-09-19T06:25:01.931 INFO:teuthology.orchestra.run.smithi071.stdout: "evtrm": 0, 2024-09-19T06:25:01.931 INFO:teuthology.orchestra.run.smithi071.stdout: "ev": 5, 2024-09-19T06:25:01.931 INFO:teuthology.orchestra.run.smithi071.stdout: "evexg": 0, 2024-09-19T06:25:01.932 INFO:teuthology.orchestra.run.smithi071.stdout: "evexd": 0, 2024-09-19T06:25:01.932 INFO:teuthology.orchestra.run.smithi071.stdout: "segadd": 0, 2024-09-19T06:25:01.932 INFO:teuthology.orchestra.run.smithi071.stdout: "segex": 0, 2024-09-19T06:25:01.932 INFO:teuthology.orchestra.run.smithi071.stdout: "segtrm": 0, 2024-09-19T06:25:01.932 INFO:teuthology.orchestra.run.smithi071.stdout: "seg": 2, 2024-09-19T06:25:01.932 INFO:teuthology.orchestra.run.smithi071.stdout: "segmjr": 2, 2024-09-19T06:25:01.932 INFO:teuthology.orchestra.run.smithi071.stdout: "segexg": 0, 2024-09-19T06:25:01.932 INFO:teuthology.orchestra.run.smithi071.stdout: "segexd": 0, 2024-09-19T06:25:01.932 INFO:teuthology.orchestra.run.smithi071.stdout: "expos": 4194304, 2024-09-19T06:25:01.932 INFO:teuthology.orchestra.run.smithi071.stdout: "wrpos": 4195737, 2024-09-19T06:25:01.932 INFO:teuthology.orchestra.run.smithi071.stdout: "rdpos": 4195596, 2024-09-19T06:25:01.932 INFO:teuthology.orchestra.run.smithi071.stdout: "jlat": { 2024-09-19T06:25:01.932 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.933 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.933 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.933 INFO:teuthology.orchestra.run.smithi071.stdout: "replayed": 5 2024-09-19T06:25:01.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.933 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_mem": { 2024-09-19T06:25:01.933 INFO:teuthology.orchestra.run.smithi071.stdout: "ino": 3, 2024-09-19T06:25:01.933 INFO:teuthology.orchestra.run.smithi071.stdout: "ino+": 3, 2024-09-19T06:25:01.933 INFO:teuthology.orchestra.run.smithi071.stdout: "ino-": 0, 2024-09-19T06:25:01.933 INFO:teuthology.orchestra.run.smithi071.stdout: "dir": 1, 2024-09-19T06:25:01.933 INFO:teuthology.orchestra.run.smithi071.stdout: "dir+": 1, 2024-09-19T06:25:01.933 INFO:teuthology.orchestra.run.smithi071.stdout: "dir-": 0, 2024-09-19T06:25:01.933 INFO:teuthology.orchestra.run.smithi071.stdout: "dn": 0, 2024-09-19T06:25:01.934 INFO:teuthology.orchestra.run.smithi071.stdout: "dn+": 0, 2024-09-19T06:25:01.934 INFO:teuthology.orchestra.run.smithi071.stdout: "dn-": 0, 2024-09-19T06:25:01.934 INFO:teuthology.orchestra.run.smithi071.stdout: "cap": 0, 2024-09-19T06:25:01.934 INFO:teuthology.orchestra.run.smithi071.stdout: "cap+": 0, 2024-09-19T06:25:01.934 INFO:teuthology.orchestra.run.smithi071.stdout: "cap-": 0, 2024-09-19T06:25:01.934 INFO:teuthology.orchestra.run.smithi071.stdout: "rss": 51024, 2024-09-19T06:25:01.934 INFO:teuthology.orchestra.run.smithi071.stdout: "heap": 215328 2024-09-19T06:25:01.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.934 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_server": { 2024-09-19T06:25:01.934 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_client_request": 0, 2024-09-19T06:25:01.935 INFO:teuthology.orchestra.run.smithi071.stdout: "dispatch_server_request": 0, 2024-09-19T06:25:01.935 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_request": 0, 2024-09-19T06:25:01.935 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_client_session": 0, 2024-09-19T06:25:01.935 INFO:teuthology.orchestra.run.smithi071.stdout: "handle_peer_request": 0, 2024-09-19T06:25:01.935 INFO:teuthology.orchestra.run.smithi071.stdout: "req_create_latency": { 2024-09-19T06:25:01.935 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.935 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.935 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.935 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getattr_latency": { 2024-09-19T06:25:01.935 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.935 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.936 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.936 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getfilelock_latency": { 2024-09-19T06:25:01.936 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.936 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.936 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.936 INFO:teuthology.orchestra.run.smithi071.stdout: "req_link_latency": { 2024-09-19T06:25:01.936 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.936 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.936 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.936 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookup_latency": { 2024-09-19T06:25:01.937 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.937 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.937 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.937 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookuphash_latency": { 2024-09-19T06:25:01.937 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.937 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.937 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.937 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupino_latency": { 2024-09-19T06:25:01.937 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.937 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.938 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.938 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupname_latency": { 2024-09-19T06:25:01.938 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.938 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.938 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.938 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupparent_latency": { 2024-09-19T06:25:01.938 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.938 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.938 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.938 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lookupsnap_latency": { 2024-09-19T06:25:01.938 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.939 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.939 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.939 INFO:teuthology.orchestra.run.smithi071.stdout: "req_lssnap_latency": { 2024-09-19T06:25:01.939 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.939 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.939 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.939 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mkdir_latency": { 2024-09-19T06:25:01.939 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.940 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.940 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.940 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mknod_latency": { 2024-09-19T06:25:01.940 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.941 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.941 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.941 INFO:teuthology.orchestra.run.smithi071.stdout: "req_mksnap_latency": { 2024-09-19T06:25:01.941 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.941 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.941 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.941 INFO:teuthology.orchestra.run.smithi071.stdout: "req_open_latency": { 2024-09-19T06:25:01.941 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.941 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.941 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.942 INFO:teuthology.orchestra.run.smithi071.stdout: "req_readdir_latency": { 2024-09-19T06:25:01.942 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.942 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.942 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.942 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rename_latency": { 2024-09-19T06:25:01.942 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.942 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.942 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.943 INFO:teuthology.orchestra.run.smithi071.stdout: "req_renamesnap_latency": { 2024-09-19T06:25:01.943 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.943 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.943 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.943 INFO:teuthology.orchestra.run.smithi071.stdout: "req_snapdiff_latency": { 2024-09-19T06:25:01.943 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.943 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.943 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.943 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmdir_latency": { 2024-09-19T06:25:01.943 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.944 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.944 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.944 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmsnap_latency": { 2024-09-19T06:25:01.944 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.944 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.944 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.944 INFO:teuthology.orchestra.run.smithi071.stdout: "req_rmxattr_latency": { 2024-09-19T06:25:01.944 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.944 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.944 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.945 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setattr_latency": { 2024-09-19T06:25:01.945 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.945 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.945 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.945 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setdirlayout_latency": { 2024-09-19T06:25:01.945 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.945 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.945 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.945 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setfilelock_latency": { 2024-09-19T06:25:01.945 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.945 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.946 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.946 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setlayout_latency": { 2024-09-19T06:25:01.946 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.946 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.946 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.946 INFO:teuthology.orchestra.run.smithi071.stdout: "req_setxattr_latency": { 2024-09-19T06:25:01.946 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.946 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.946 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.946 INFO:teuthology.orchestra.run.smithi071.stdout: "req_symlink_latency": { 2024-09-19T06:25:01.947 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.947 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.947 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.947 INFO:teuthology.orchestra.run.smithi071.stdout: "req_unlink_latency": { 2024-09-19T06:25:01.947 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.947 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.947 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.947 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_revoke_eviction": 0, 2024-09-19T06:25:01.947 INFO:teuthology.orchestra.run.smithi071.stdout: "cap_acquisition_throttle": 0, 2024-09-19T06:25:01.947 INFO:teuthology.orchestra.run.smithi071.stdout: "req_getvxattr_latency": { 2024-09-19T06:25:01.947 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.948 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.948 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.948 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:25:01.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.948 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sessions": { 2024-09-19T06:25:01.948 INFO:teuthology.orchestra.run.smithi071.stdout: "session_count": 1, 2024-09-19T06:25:01.948 INFO:teuthology.orchestra.run.smithi071.stdout: "session_add": 2, 2024-09-19T06:25:01.948 INFO:teuthology.orchestra.run.smithi071.stdout: "session_remove": 1, 2024-09-19T06:25:01.948 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_open": 2, 2024-09-19T06:25:01.949 INFO:teuthology.orchestra.run.smithi071.stdout: "sessions_stale": 0, 2024-09-19T06:25:01.949 INFO:teuthology.orchestra.run.smithi071.stdout: "total_load": 0, 2024-09-19T06:25:01.949 INFO:teuthology.orchestra.run.smithi071.stdout: "average_load": 0, 2024-09-19T06:25:01.949 INFO:teuthology.orchestra.run.smithi071.stdout: "avg_session_uptime": 3582, 2024-09-19T06:25:01.949 INFO:teuthology.orchestra.run.smithi071.stdout: "mdthresh_evicted": 0 2024-09-19T06:25:01.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.949 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool": { 2024-09-19T06:25:01.949 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_bytes": 0, 2024-09-19T06:25:01.949 INFO:teuthology.orchestra.run.smithi071.stdout: "bloom_filter_items": 0, 2024-09-19T06:25:01.950 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T06:25:01.950 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_items": 0, 2024-09-19T06:25:01.950 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T06:25:01.950 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_data_items": 0, 2024-09-19T06:25:01.950 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T06:25:01.950 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T06:25:01.950 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T06:25:01.950 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T06:25:01.950 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T06:25:01.950 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_other_items": 0, 2024-09-19T06:25:01.950 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T06:25:01.950 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T06:25:01.950 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_bytes": 0, 2024-09-19T06:25:01.951 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_items": 0, 2024-09-19T06:25:01.951 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_bytes": 0, 2024-09-19T06:25:01.951 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blob_items": 0, 2024-09-19T06:25:01.951 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T06:25:01.951 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T06:25:01.951 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T06:25:01.951 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T06:25:01.951 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T06:25:01.951 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_items": 0, 2024-09-19T06:25:01.951 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_bytes": 0, 2024-09-19T06:25:01.951 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_txc_items": 0, 2024-09-19T06:25:01.951 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T06:25:01.952 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T06:25:01.952 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_bytes": 0, 2024-09-19T06:25:01.952 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_writing_items": 0, 2024-09-19T06:25:01.952 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_bytes": 0, 2024-09-19T06:25:01.952 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_items": 0, 2024-09-19T06:25:01.952 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T06:25:01.952 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_reader_items": 0, 2024-09-19T06:25:01.952 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T06:25:01.952 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_file_writer_items": 0, 2024-09-19T06:25:01.952 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_bytes": 190178, 2024-09-19T06:25:01.952 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_anon_items": 53, 2024-09-19T06:25:01.952 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_bytes": 0, 2024-09-19T06:25:01.952 INFO:teuthology.orchestra.run.smithi071.stdout: "buffer_meta_items": 0, 2024-09-19T06:25:01.952 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bytes": 0, 2024-09-19T06:25:01.953 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_items": 0, 2024-09-19T06:25:01.953 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_bytes": 0, 2024-09-19T06:25:01.953 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mapbl_items": 0, 2024-09-19T06:25:01.953 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_bytes": 0, 2024-09-19T06:25:01.953 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pglog_items": 0, 2024-09-19T06:25:01.953 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_bytes": 8320, 2024-09-19T06:25:01.953 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_items": 183, 2024-09-19T06:25:01.953 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T06:25:01.953 INFO:teuthology.orchestra.run.smithi071.stdout: "osdmap_mapping_items": 0, 2024-09-19T06:25:01.953 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_bytes": 0, 2024-09-19T06:25:01.954 INFO:teuthology.orchestra.run.smithi071.stdout: "pgmap_items": 0, 2024-09-19T06:25:01.954 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_bytes": 8512, 2024-09-19T06:25:01.954 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_co_items": 13, 2024-09-19T06:25:01.954 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_bytes": 0, 2024-09-19T06:25:01.954 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_1_items": 0, 2024-09-19T06:25:01.954 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_bytes": 0, 2024-09-19T06:25:01.954 INFO:teuthology.orchestra.run.smithi071.stdout: "unittest_2_items": 0 2024-09-19T06:25:01.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.954 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter": { 2024-09-19T06:25:01.954 INFO:teuthology.orchestra.run.smithi071.stdout: "op_active": 0, 2024-09-19T06:25:01.954 INFO:teuthology.orchestra.run.smithi071.stdout: "op_laggy": 0, 2024-09-19T06:25:01.954 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send": 2536, 2024-09-19T06:25:01.954 INFO:teuthology.orchestra.run.smithi071.stdout: "op_send_bytes": 21, 2024-09-19T06:25:01.955 INFO:teuthology.orchestra.run.smithi071.stdout: "op_resend": 3, 2024-09-19T06:25:01.955 INFO:teuthology.orchestra.run.smithi071.stdout: "op_reply": 2536, 2024-09-19T06:25:01.955 INFO:teuthology.orchestra.run.smithi071.stdout: "op_latency": { 2024-09-19T06:25:01.955 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2536, 2024-09-19T06:25:01.955 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 1.063000002, 2024-09-19T06:25:01.955 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000419164 2024-09-19T06:25:01.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.955 INFO:teuthology.orchestra.run.smithi071.stdout: "op_inflight": 0, 2024-09-19T06:25:01.955 INFO:teuthology.orchestra.run.smithi071.stdout: "oplen_avg": { 2024-09-19T06:25:01.955 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 2536, 2024-09-19T06:25:01.955 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 2537 2024-09-19T06:25:01.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.955 INFO:teuthology.orchestra.run.smithi071.stdout: "op": 2536, 2024-09-19T06:25:01.955 INFO:teuthology.orchestra.run.smithi071.stdout: "op_r": 2536, 2024-09-19T06:25:01.956 INFO:teuthology.orchestra.run.smithi071.stdout: "op_w": 0, 2024-09-19T06:25:01.956 INFO:teuthology.orchestra.run.smithi071.stdout: "op_rmw": 0, 2024-09-19T06:25:01.956 INFO:teuthology.orchestra.run.smithi071.stdout: "op_pg": 0, 2024-09-19T06:25:01.956 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_stat": 1643, 2024-09-19T06:25:01.956 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_create": 0, 2024-09-19T06:25:01.956 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_read": 891, 2024-09-19T06:25:01.956 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_write": 0, 2024-09-19T06:25:01.956 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writefull": 0, 2024-09-19T06:25:01.956 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_writesame": 0, 2024-09-19T06:25:01.956 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_append": 0, 2024-09-19T06:25:01.956 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_zero": 0, 2024-09-19T06:25:01.957 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_truncate": 0, 2024-09-19T06:25:01.957 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_delete": 0, 2024-09-19T06:25:01.957 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_mapext": 0, 2024-09-19T06:25:01.957 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_sparse_read": 0, 2024-09-19T06:25:01.957 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_clonerange": 0, 2024-09-19T06:25:01.957 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_getxattr": 1, 2024-09-19T06:25:01.957 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_setxattr": 0, 2024-09-19T06:25:01.957 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_cmpxattr": 0, 2024-09-19T06:25:01.957 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_rmxattr": 0, 2024-09-19T06:25:01.957 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_resetxattrs": 0, 2024-09-19T06:25:01.957 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_call": 0, 2024-09-19T06:25:01.957 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_watch": 0, 2024-09-19T06:25:01.958 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_notify": 0, 2024-09-19T06:25:01.958 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T06:25:01.958 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls": 0, 2024-09-19T06:25:01.958 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_pgls_filter": 0, 2024-09-19T06:25:01.958 INFO:teuthology.orchestra.run.smithi071.stdout: "osdop_other": 0, 2024-09-19T06:25:01.958 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_active": 0, 2024-09-19T06:25:01.958 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_send": 0, 2024-09-19T06:25:01.959 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_resend": 0, 2024-09-19T06:25:01.959 INFO:teuthology.orchestra.run.smithi071.stdout: "linger_ping": 0, 2024-09-19T06:25:01.959 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_active": 0, 2024-09-19T06:25:01.959 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_send": 0, 2024-09-19T06:25:01.959 INFO:teuthology.orchestra.run.smithi071.stdout: "poolop_resend": 0, 2024-09-19T06:25:01.959 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_active": 0, 2024-09-19T06:25:01.959 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_send": 0, 2024-09-19T06:25:01.959 INFO:teuthology.orchestra.run.smithi071.stdout: "poolstat_resend": 0, 2024-09-19T06:25:01.959 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_active": 0, 2024-09-19T06:25:01.959 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_send": 0, 2024-09-19T06:25:01.959 INFO:teuthology.orchestra.run.smithi071.stdout: "statfs_resend": 0, 2024-09-19T06:25:01.960 INFO:teuthology.orchestra.run.smithi071.stdout: "command_active": 0, 2024-09-19T06:25:01.960 INFO:teuthology.orchestra.run.smithi071.stdout: "command_send": 0, 2024-09-19T06:25:01.960 INFO:teuthology.orchestra.run.smithi071.stdout: "command_resend": 0, 2024-09-19T06:25:01.960 INFO:teuthology.orchestra.run.smithi071.stdout: "map_epoch": 101, 2024-09-19T06:25:01.960 INFO:teuthology.orchestra.run.smithi071.stdout: "map_full": 0, 2024-09-19T06:25:01.960 INFO:teuthology.orchestra.run.smithi071.stdout: "map_inc": 15, 2024-09-19T06:25:01.960 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_sessions": 5, 2024-09-19T06:25:01.960 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_open": 5, 2024-09-19T06:25:01.960 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_session_close": 0, 2024-09-19T06:25:01.961 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_laggy": 0, 2024-09-19T06:25:01.961 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_wr": 0, 2024-09-19T06:25:01.961 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_rd": 2, 2024-09-19T06:25:01.961 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_del": 0 2024-09-19T06:25:01.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.961 INFO:teuthology.orchestra.run.smithi071.stdout: "oft": { 2024-09-19T06:25:01.961 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_objs": 0, 2024-09-19T06:25:01.961 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_kv_pairs": 0, 2024-09-19T06:25:01.961 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_updates": 0, 2024-09-19T06:25:01.961 INFO:teuthology.orchestra.run.smithi071.stdout: "omap_total_removes": 0 2024-09-19T06:25:01.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.961 INFO:teuthology.orchestra.run.smithi071.stdout: "osd-slow-ops": { 2024-09-19T06:25:01.961 INFO:teuthology.orchestra.run.smithi071.stdout: "slow_ops_count": 0 2024-09-19T06:25:01.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.962 INFO:teuthology.orchestra.run.smithi071.stdout: "purge_queue": { 2024-09-19T06:25:01.962 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops": 0, 2024-09-19T06:25:01.962 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T06:25:01.962 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing": 0, 2024-09-19T06:25:01.962 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executing_high_water": 0, 2024-09-19T06:25:01.962 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed_ops": 0, 2024-09-19T06:25:01.962 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_executed": 0, 2024-09-19T06:25:01.962 INFO:teuthology.orchestra.run.smithi071.stdout: "pq_item_in_journal": 0 2024-09-19T06:25:01.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.962 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T06:25:01.962 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-19T06:25:01.962 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-19T06:25:01.963 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-19T06:25:01.963 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 2829, 2024-09-19T06:25:01.963 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 2244621, 2024-09-19T06:25:01.963 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:01.963 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 2829, 2024-09-19T06:25:01.963 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-19T06:25:01.963 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-19T06:25:01.963 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 2829, 2024-09-19T06:25:01.963 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 2244621, 2024-09-19T06:25:01.963 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-19T06:25:01.963 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.963 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.963 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.964 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:25:01.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.964 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_bytes": { 2024-09-19T06:25:01.964 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-19T06:25:01.964 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 104857600, 2024-09-19T06:25:01.964 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-19T06:25:01.964 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-19T06:25:01.964 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-19T06:25:01.964 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:01.964 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:01.964 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 2536, 2024-09-19T06:25:01.964 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 1438, 2024-09-19T06:25:01.964 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 2536, 2024-09-19T06:25:01.964 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 1438, 2024-09-19T06:25:01.965 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-19T06:25:01.965 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.965 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.965 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.965 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:25:01.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.965 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-objecter_ops": { 2024-09-19T06:25:01.965 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-19T06:25:01.965 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 1024, 2024-09-19T06:25:01.966 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-19T06:25:01.966 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-19T06:25:01.966 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-19T06:25:01.966 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:01.966 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:01.966 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 2536, 2024-09-19T06:25:01.966 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 2536, 2024-09-19T06:25:01.966 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 2536, 2024-09-19T06:25:01.966 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 2536, 2024-09-19T06:25:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-19T06:25:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:25:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle": { 2024-09-19T06:25:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-19T06:25:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-19T06:25:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-19T06:25:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-19T06:25:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-19T06:25:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:01.967 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:01.968 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-19T06:25:01.968 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-19T06:25:01.968 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 0, 2024-09-19T06:25:01.968 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 0, 2024-09-19T06:25:01.968 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-19T06:25:01.968 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.968 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.968 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.968 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:25:01.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-09-19T06:25:01.968 INFO:teuthology.orchestra.run.smithi071.stdout: "throttle-write_buf_throttle-0x5631e4f7c6e0": { 2024-09-19T06:25:01.968 INFO:teuthology.orchestra.run.smithi071.stdout: "val": 0, 2024-09-19T06:25:01.969 INFO:teuthology.orchestra.run.smithi071.stdout: "max": 3758096384, 2024-09-19T06:25:01.969 INFO:teuthology.orchestra.run.smithi071.stdout: "get_started": 0, 2024-09-19T06:25:01.969 INFO:teuthology.orchestra.run.smithi071.stdout: "get": 0, 2024-09-19T06:25:01.969 INFO:teuthology.orchestra.run.smithi071.stdout: "get_sum": 0, 2024-09-19T06:25:01.969 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_fail": 0, 2024-09-19T06:25:01.969 INFO:teuthology.orchestra.run.smithi071.stdout: "get_or_fail_success": 0, 2024-09-19T06:25:01.969 INFO:teuthology.orchestra.run.smithi071.stdout: "take": 0, 2024-09-19T06:25:01.969 INFO:teuthology.orchestra.run.smithi071.stdout: "take_sum": 0, 2024-09-19T06:25:01.969 INFO:teuthology.orchestra.run.smithi071.stdout: "put": 0, 2024-09-19T06:25:01.969 INFO:teuthology.orchestra.run.smithi071.stdout: "put_sum": 0, 2024-09-19T06:25:01.969 INFO:teuthology.orchestra.run.smithi071.stdout: "wait": { 2024-09-19T06:25:01.969 INFO:teuthology.orchestra.run.smithi071.stdout: "avgcount": 0, 2024-09-19T06:25:01.969 INFO:teuthology.orchestra.run.smithi071.stdout: "sum": 0.000000000, 2024-09-19T06:25:01.970 INFO:teuthology.orchestra.run.smithi071.stdout: "avgtime": 0.000000000 2024-09-19T06:25:01.970 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:25:01.970 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-09-19T06:25:01.970 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-09-19T06:25:02.085 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:02 smithi071 ceph-mon[35662]: pgmap v394: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:25:02.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:02 smithi003 ceph-mon[30893]: pgmap v394: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:25:02.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:02 smithi059 ceph-mon[35138]: pgmap v394: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:25:02.852 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-19T06:25:02.852 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-19T06:25:02.852 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-09-19T06:25:02.852 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-09-19T06:25:02.852 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-09-19T06:25:02.852 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-09-19T06:25:02.852 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T06:25:02.853 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-19T06:25:02.865 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T06:25:02.865 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-19T06:25:02.865 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:25:02.909 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-19T06:25:02.909 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T06:25:02.989 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T06:25:03.414 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:04.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.010+0000 7f06ef200640 1 -- 172.21.15.3:0/3017734381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06f01079c0 msgr2=0x7f06f0107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:04.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.010+0000 7f06ef200640 1 --2- 172.21.15.3:0/3017734381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06f01079c0 0x7f06f0107da0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009930 tx=0x7f06e002a420 comp rx=0 tx=0).stop 2024-09-19T06:25:04.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.010+0000 7f06ef200640 1 -- 172.21.15.3:0/3017734381 shutdown_connections 2024-09-19T06:25:04.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.010+0000 7f06ef200640 1 --2- 172.21.15.3:0/3017734381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06f0102360 0x7f06f010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.010+0000 7f06ef200640 1 --2- 172.21.15.3:0/3017734381 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06f01019c0 0x7f06f0101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.010+0000 7f06ef200640 1 --2- 172.21.15.3:0/3017734381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06f01079c0 0x7f06f0107da0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.010+0000 7f06ef200640 1 -- 172.21.15.3:0/3017734381 >> 172.21.15.3:0/3017734381 conn(0x7f06f00fd740 msgr2=0x7f06f00ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:04.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.010+0000 7f06ef200640 1 -- 172.21.15.3:0/3017734381 shutdown_connections 2024-09-19T06:25:04.014 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.011+0000 7f06ef200640 1 -- 172.21.15.3:0/3017734381 wait complete. 2024-09-19T06:25:04.015 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.012+0000 7f06ef200640 1 Processor -- start 2024-09-19T06:25:04.015 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.012+0000 7f06ef200640 1 -- start start 2024-09-19T06:25:04.015 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.012+0000 7f06ef200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06f01019c0 0x7f06f019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:04.015 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.012+0000 7f06ef200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06f0102360 0x7f06f019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:04.015 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.012+0000 7f06ef200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06f01079c0 0x7f06f019edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:04.015 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.012+0000 7f06ef200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f06f0111d90 con 0x7f06f0102360 2024-09-19T06:25:04.015 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.012+0000 7f06ef200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f06f0111c10 con 0x7f06f01079c0 2024-09-19T06:25:04.015 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.012+0000 7f06ef200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f06f0111f10 con 0x7f06f01019c0 2024-09-19T06:25:04.015 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.012+0000 7f06ede00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06f01019c0 0x7f06f019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:04.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.012+0000 7f06ede00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06f01019c0 0x7f06f019a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:49848/0 (socket says 172.21.15.3:49848) 2024-09-19T06:25:04.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.012+0000 7f06ede00640 1 -- 172.21.15.3:0/2331599472 learned_addr learned my addr 172.21.15.3:0/2331599472 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:25:04.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.012+0000 7f06ed400640 1 --2- 172.21.15.3:0/2331599472 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06f0102360 0x7f06f019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:04.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.013+0000 7f06ee800640 1 --2- 172.21.15.3:0/2331599472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06f01079c0 0x7f06f019edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:04.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.013+0000 7f06ede00640 1 -- 172.21.15.3:0/2331599472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06f01079c0 msgr2=0x7f06f019edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:04.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.013+0000 7f06ede00640 1 --2- 172.21.15.3:0/2331599472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06f01079c0 0x7f06f019edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.013+0000 7f06ede00640 1 -- 172.21.15.3:0/2331599472 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06f0102360 msgr2=0x7f06f019aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:04.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.013+0000 7f06ede00640 1 --2- 172.21.15.3:0/2331599472 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06f0102360 0x7f06f019aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.013+0000 7f06ede00640 1 -- 172.21.15.3:0/2331599472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f019f490 con 0x7f06f01019c0 2024-09-19T06:25:04.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.013+0000 7f06ed400640 1 --2- 172.21.15.3:0/2331599472 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06f0102360 0x7f06f019aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:25:04.016 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.013+0000 7f06ede00640 1 --2- 172.21.15.3:0/2331599472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06f01019c0 0x7f06f019a4e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009230 tx=0x7f06e0004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:04.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.014+0000 7f06e6a00640 1 -- 172.21.15.3:0/2331599472 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e003f030 con 0x7f06f01019c0 2024-09-19T06:25:04.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.014+0000 7f06ef200640 1 -- 172.21.15.3:0/2331599472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f019f720 con 0x7f06f01019c0 2024-09-19T06:25:04.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.014+0000 7f06e6a00640 1 -- 172.21.15.3:0/2331599472 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06e0004440 con 0x7f06f01019c0 2024-09-19T06:25:04.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.014+0000 7f06e6a00640 1 -- 172.21.15.3:0/2331599472 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0035070 con 0x7f06f01019c0 2024-09-19T06:25:04.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.014+0000 7f06ef200640 1 -- 172.21.15.3:0/2331599472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f01a7060 con 0x7f06f01019c0 2024-09-19T06:25:04.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.015+0000 7f06ef200640 1 -- 172.21.15.3:0/2331599472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f0103100 con 0x7f06f01019c0 2024-09-19T06:25:04.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.017+0000 7f06e6a00640 1 -- 172.21.15.3:0/2331599472 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f06e0042030 con 0x7f06f01019c0 2024-09-19T06:25:04.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.018+0000 7f06e6a00640 1 --2- 172.21.15.3:0/2331599472 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f06d40a33b0 0x7f06d40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:04.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.018+0000 7f06e6a00640 1 -- 172.21.15.3:0/2331599472 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7f06e00f04c0 con 0x7f06f01019c0 2024-09-19T06:25:04.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.018+0000 7f06ed400640 1 --2- 172.21.15.3:0/2331599472 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f06d40a33b0 0x7f06d40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:04.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.019+0000 7f06ed400640 1 --2- 172.21.15.3:0/2331599472 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f06d40a33b0 0x7f06d40a5870 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f06f010ea70 tx=0x7f06dc005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:04.022 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.020+0000 7f06e6a00640 1 -- 172.21.15.3:0/2331599472 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f06e00bc7c0 con 0x7f06f01019c0 2024-09-19T06:25:04.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.220+0000 7f06ef200640 1 -- 172.21.15.3:0/2331599472 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f06f0101e20 con 0x7f06f01019c0 2024-09-19T06:25:04.223 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:04 smithi003 ceph-mon[30893]: pgmap v395: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:25:04.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.221+0000 7f06e6a00640 1 -- 172.21.15.3:0/2331599472 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v101) ==== 81+0+927 (secure 0 0 0) 0x7f06e00c0ac0 con 0x7f06f01019c0 2024-09-19T06:25:04.223 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/3104337397 2024-09-20T06:12:22.409669+0000 2024-09-19T06:25:04.223 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/4101082351 2024-09-20T06:12:22.409669+0000 2024-09-19T06:25:04.223 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/3358701720 2024-09-20T06:12:22.409669+0000 2024-09-19T06:25:04.224 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/1616091100 2024-09-20T06:02:30.039686+0000 2024-09-19T06:25:04.224 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/3155841850 2024-09-20T06:12:22.409669+0000 2024-09-19T06:25:04.224 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6800/2386230415 2024-09-20T06:02:01.122348+0000 2024-09-19T06:25:04.224 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/2122482494 2024-09-20T06:02:01.122348+0000 2024-09-19T06:25:04.224 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6801/2386230415 2024-09-20T06:02:01.122348+0000 2024-09-19T06:25:04.224 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6800/1278931596 2024-09-20T06:12:22.409669+0000 2024-09-19T06:25:04.224 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/1658697906 2024-09-20T06:02:01.122348+0000 2024-09-19T06:25:04.224 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6801/518259590 2024-09-20T06:02:30.039686+0000 2024-09-19T06:25:04.224 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/953348594 2024-09-20T06:02:01.122348+0000 2024-09-19T06:25:04.224 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/2065281908 2024-09-20T06:02:30.039686+0000 2024-09-19T06:25:04.224 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/1458736313 2024-09-20T06:02:30.039686+0000 2024-09-19T06:25:04.224 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6800/518259590 2024-09-20T06:02:30.039686+0000 2024-09-19T06:25:04.224 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6801/1278931596 2024-09-20T06:12:22.409669+0000 2024-09-19T06:25:04.225 INFO:teuthology.orchestra.run.smithi003.stderr:listed 16 entries 2024-09-19T06:25:04.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.224+0000 7f06ef200640 1 -- 172.21.15.3:0/2331599472 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f06d40a33b0 msgr2=0x7f06d40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:04.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.224+0000 7f06ef200640 1 --2- 172.21.15.3:0/2331599472 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f06d40a33b0 0x7f06d40a5870 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f06f010ea70 tx=0x7f06dc005f90 comp rx=0 tx=0).stop 2024-09-19T06:25:04.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.224+0000 7f06ef200640 1 -- 172.21.15.3:0/2331599472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06f01019c0 msgr2=0x7f06f019a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:04.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.224+0000 7f06ef200640 1 --2- 172.21.15.3:0/2331599472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06f01019c0 0x7f06f019a4e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009230 tx=0x7f06e0004040 comp rx=0 tx=0).stop 2024-09-19T06:25:04.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.224+0000 7f06ef200640 1 -- 172.21.15.3:0/2331599472 shutdown_connections 2024-09-19T06:25:04.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.224+0000 7f06ef200640 1 --2- 172.21.15.3:0/2331599472 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f06d40a33b0 0x7f06d40a5870 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.224+0000 7f06ef200640 1 --2- 172.21.15.3:0/2331599472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06f01079c0 0x7f06f019edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.224+0000 7f06ef200640 1 --2- 172.21.15.3:0/2331599472 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06f0102360 0x7f06f019aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.224+0000 7f06ef200640 1 --2- 172.21.15.3:0/2331599472 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f06f01019c0 0x7f06f019a4e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:04.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.224+0000 7f06ef200640 1 -- 172.21.15.3:0/2331599472 >> 172.21.15.3:0/2331599472 conn(0x7f06f00fd740 msgr2=0x7f06f010cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:04.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.225+0000 7f06ef200640 1 -- 172.21.15.3:0/2331599472 shutdown_connections 2024-09-19T06:25:04.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:04.225+0000 7f06ef200640 1 -- 172.21.15.3:0/2331599472 wait complete. 2024-09-19T06:25:04.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:04 smithi071 ceph-mon[35662]: pgmap v395: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:25:04.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:04 smithi059 ceph-mon[35138]: pgmap v395: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T06:25:05.184 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T06:25:05.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:25:05.184 DEBUG:teuthology.orchestra.run.smithi003:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T06:25:05.269 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi003.front.sepia.ceph.com 2024-09-19T06:25:05.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:25:05.269 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T06:25:05.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:25:05.329 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list 2024-09-19T06:25:05.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:05 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2331599472' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:25:05.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:05 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2331599472' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:25:05.366 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T06:25:05.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:25:05.366 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:25:05.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:25:05.465 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link delete ceph-brx 2024-09-19T06:25:05.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:05 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2331599472' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T06:25:05.789 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T06:25:05.809 INFO:tasks.cephadm:Teardown begin 2024-09-19T06:25:05.809 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T06:25:05.809 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:25:06.192 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:06.332 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:06 smithi003 ceph-mon[30893]: pgmap v396: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-19T06:25:06.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:06 smithi071 ceph-mon[35662]: pgmap v396: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-19T06:25:06.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:06 smithi059 ceph-mon[35138]: pgmap v396: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-19T06:25:06.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.763+0000 7fe9c3a00640 1 -- 172.21.15.3:0/1789341836 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9bc109120 msgr2=0x7fe9bc110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:06.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.763+0000 7fe9c3a00640 1 --2- 172.21.15.3:0/1789341836 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9bc109120 0x7fe9bc110ca0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4009ca0 tx=0x7fe9b402a8c0 comp rx=0 tx=0).stop 2024-09-19T06:25:06.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.763+0000 7fe9c3a00640 1 -- 172.21.15.3:0/1789341836 shutdown_connections 2024-09-19T06:25:06.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.763+0000 7fe9c3a00640 1 --2- 172.21.15.3:0/1789341836 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9bc109120 0x7fe9bc110ca0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:06.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.763+0000 7fe9c3a00640 1 --2- 172.21.15.3:0/1789341836 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9bc1049a0 0x7fe9bc1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:06.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.763+0000 7fe9c3a00640 1 --2- 172.21.15.3:0/1789341836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9bc103ff0 0x7fe9bc1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:06.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.763+0000 7fe9c3a00640 1 -- 172.21.15.3:0/1789341836 >> 172.21.15.3:0/1789341836 conn(0x7fe9bc0ffa90 msgr2=0x7fe9bc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:06.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.763+0000 7fe9c3a00640 1 -- 172.21.15.3:0/1789341836 shutdown_connections 2024-09-19T06:25:06.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.763+0000 7fe9c3a00640 1 -- 172.21.15.3:0/1789341836 wait complete. 2024-09-19T06:25:06.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.764+0000 7fe9c3a00640 1 Processor -- start 2024-09-19T06:25:06.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.764+0000 7fe9c3a00640 1 -- start start 2024-09-19T06:25:06.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.765+0000 7fe9c3a00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9bc103ff0 0x7fe9bc19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:06.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.765+0000 7fe9c3a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9bc1049a0 0x7fe9bc19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:06.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.765+0000 7fe9c3a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9bc109120 0x7fe9bc19eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:06.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.765+0000 7fe9c3a00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc1141a0 con 0x7fe9bc103ff0 2024-09-19T06:25:06.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.765+0000 7fe9c3a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc114020 con 0x7fe9bc1049a0 2024-09-19T06:25:06.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.765+0000 7fe9c3a00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc114320 con 0x7fe9bc109120 2024-09-19T06:25:06.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.765+0000 7fe9c1000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9bc103ff0 0x7fe9bc19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:06.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.765+0000 7fe9c1000640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9bc103ff0 0x7fe9bc19a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43914/0 (socket says 172.21.15.3:43914) 2024-09-19T06:25:06.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.765+0000 7fe9c1000640 1 -- 172.21.15.3:0/517578651 learned_addr learned my addr 172.21.15.3:0/517578651 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:25:06.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.765+0000 7fe9c1a00640 1 --2- 172.21.15.3:0/517578651 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9bc109120 0x7fe9bc19eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:06.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.765+0000 7fe9bbe00640 1 --2- 172.21.15.3:0/517578651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9bc1049a0 0x7fe9bc19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:06.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.766+0000 7fe9c1000640 1 -- 172.21.15.3:0/517578651 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9bc109120 msgr2=0x7fe9bc19eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:06.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.766+0000 7fe9c1000640 1 --2- 172.21.15.3:0/517578651 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9bc109120 0x7fe9bc19eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:06.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.766+0000 7fe9c1000640 1 -- 172.21.15.3:0/517578651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9bc1049a0 msgr2=0x7fe9bc19ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:06.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.766+0000 7fe9c1000640 1 --2- 172.21.15.3:0/517578651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9bc1049a0 0x7fe9bc19ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:06.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.766+0000 7fe9c1000640 1 -- 172.21.15.3:0/517578651 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9bc19f590 con 0x7fe9bc103ff0 2024-09-19T06:25:06.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.766+0000 7fe9c1000640 1 --2- 172.21.15.3:0/517578651 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9bc103ff0 0x7fe9bc19a5e0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fe9b000d950 tx=0x7fe9b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:06.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.766+0000 7fe9b9600640 1 -- 172.21.15.3:0/517578651 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0017030 con 0x7fe9bc103ff0 2024-09-19T06:25:06.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.766+0000 7fe9c3a00640 1 -- 172.21.15.3:0/517578651 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9bc19f880 con 0x7fe9bc103ff0 2024-09-19T06:25:06.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.766+0000 7fe9b9600640 1 -- 172.21.15.3:0/517578651 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9b0004020 con 0x7fe9bc103ff0 2024-09-19T06:25:06.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.766+0000 7fe9b9600640 1 -- 172.21.15.3:0/517578651 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b00047a0 con 0x7fe9bc103ff0 2024-09-19T06:25:06.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.766+0000 7fe9c3a00640 1 -- 172.21.15.3:0/517578651 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9bc1a7160 con 0x7fe9bc103ff0 2024-09-19T06:25:06.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.767+0000 7fe9c3a00640 1 -- 172.21.15.3:0/517578651 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9bc1043d0 con 0x7fe9bc103ff0 2024-09-19T06:25:06.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.769+0000 7fe9b9600640 1 -- 172.21.15.3:0/517578651 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fe9b00041d0 con 0x7fe9bc103ff0 2024-09-19T06:25:06.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.771+0000 7fe9b9600640 1 --2- 172.21.15.3:0/517578651 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe9a40a33b0 0x7fe9a40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:06.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.771+0000 7fe9b9600640 1 -- 172.21.15.3:0/517578651 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7fe9b00cf6e0 con 0x7fe9bc103ff0 2024-09-19T06:25:06.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.771+0000 7fe9bbe00640 1 --2- 172.21.15.3:0/517578651 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe9a40a33b0 0x7fe9a40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:06.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.772+0000 7fe9bbe00640 1 --2- 172.21.15.3:0/517578651 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe9a40a33b0 0x7fe9a40a5870 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc10ab00 tx=0x7fe9a8005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:06.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:06.775+0000 7fe9b9600640 1 -- 172.21.15.3:0/517578651 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe9b009c030 con 0x7fe9bc103ff0 2024-09-19T06:25:07.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:07.001+0000 7fe9c3a00640 1 -- 172.21.15.3:0/517578651 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9bc19b940 con 0x7fe9bc103ff0 2024-09-19T06:25:07.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:07.001+0000 7fe9b9600640 1 -- 172.21.15.3:0/517578651 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7fe9b009b930 con 0x7fe9bc103ff0 2024-09-19T06:25:07.004 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:25:07.004 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"btime":"2024-09-19T06:12:22:958217+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:12:22.060987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24532,24515,24514,14517]},"id":1}]} 2024-09-19T06:25:07.004 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2024-09-19T06:25:07.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:07.004+0000 7fe9c3a00640 1 -- 172.21.15.3:0/517578651 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe9a40a33b0 msgr2=0x7fe9a40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:07.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:07.004+0000 7fe9c3a00640 1 --2- 172.21.15.3:0/517578651 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe9a40a33b0 0x7fe9a40a5870 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc10ab00 tx=0x7fe9a8005f90 comp rx=0 tx=0).stop 2024-09-19T06:25:07.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:07.004+0000 7fe9c3a00640 1 -- 172.21.15.3:0/517578651 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9bc103ff0 msgr2=0x7fe9bc19a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:07.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:07.004+0000 7fe9c3a00640 1 --2- 172.21.15.3:0/517578651 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9bc103ff0 0x7fe9bc19a5e0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fe9b000d950 tx=0x7fe9b000de10 comp rx=0 tx=0).stop 2024-09-19T06:25:07.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:07.004+0000 7fe9c3a00640 1 -- 172.21.15.3:0/517578651 shutdown_connections 2024-09-19T06:25:07.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:07.004+0000 7fe9c3a00640 1 --2- 172.21.15.3:0/517578651 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe9a40a33b0 0x7fe9a40a5870 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:07.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:07.004+0000 7fe9c3a00640 1 --2- 172.21.15.3:0/517578651 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe9bc109120 0x7fe9bc19eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:07.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:07.004+0000 7fe9c3a00640 1 --2- 172.21.15.3:0/517578651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9bc1049a0 0x7fe9bc19ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:07.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:07.004+0000 7fe9c3a00640 1 --2- 172.21.15.3:0/517578651 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe9bc103ff0 0x7fe9bc19a5e0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:07.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:07.004+0000 7fe9c3a00640 1 -- 172.21.15.3:0/517578651 >> 172.21.15.3:0/517578651 conn(0x7fe9bc0ffa90 msgr2=0x7fe9bc1005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:07.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:07.004+0000 7fe9c3a00640 1 -- 172.21.15.3:0/517578651 shutdown_connections 2024-09-19T06:25:07.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:07.004+0000 7fe9c3a00640 1 -- 172.21.15.3:0/517578651 wait complete. 2024-09-19T06:25:07.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:07 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/517578651' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:25:07.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:07 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/517578651' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:25:07.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:07 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/517578651' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:25:07.786 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:25:08.168 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:08.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:08 smithi003 ceph-mon[30893]: pgmap v397: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-19T06:25:08.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:08 smithi071 ceph-mon[35662]: pgmap v397: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-19T06:25:08.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:08 smithi059 ceph-mon[35138]: pgmap v397: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-19T06:25:08.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.819+0000 7fedc9800640 1 -- 172.21.15.3:0/3782249574 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedc410e3c0 msgr2=0x7fedc4110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:08.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.819+0000 7fedc9800640 1 --2- 172.21.15.3:0/3782249574 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedc410e3c0 0x7fedc4110810 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fedbc009ca0 tx=0x7fedbc02a940 comp rx=0 tx=0).stop 2024-09-19T06:25:08.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.820+0000 7fedc9800640 1 -- 172.21.15.3:0/3782249574 shutdown_connections 2024-09-19T06:25:08.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.820+0000 7fedc9800640 1 --2- 172.21.15.3:0/3782249574 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedc410e3c0 0x7fedc4110810 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.820+0000 7fedc9800640 1 --2- 172.21.15.3:0/3782249574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedc4074f40 0x7fedc410de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.820+0000 7fedc9800640 1 --2- 172.21.15.3:0/3782249574 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedc4074620 0x7fedc4074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.820+0000 7fedc9800640 1 -- 172.21.15.3:0/3782249574 >> 172.21.15.3:0/3782249574 conn(0x7fedc40fd8c0 msgr2=0x7fedc40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:08.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.820+0000 7fedc9800640 1 -- 172.21.15.3:0/3782249574 shutdown_connections 2024-09-19T06:25:08.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.820+0000 7fedc9800640 1 -- 172.21.15.3:0/3782249574 wait complete. 2024-09-19T06:25:08.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.821+0000 7fedc9800640 1 Processor -- start 2024-09-19T06:25:08.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.821+0000 7fedc9800640 1 -- start start 2024-09-19T06:25:08.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.821+0000 7fedc9800640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedc4074620 0x7fedc419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:08.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.821+0000 7fedc9800640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedc4074f40 0x7fedc419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:08.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.821+0000 7fedc9800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedc410e3c0 0x7fedc419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:08.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.821+0000 7fedc9800640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fedc4114150 con 0x7fedc4074f40 2024-09-19T06:25:08.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.821+0000 7fedc9800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fedc4113fd0 con 0x7fedc410e3c0 2024-09-19T06:25:08.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.821+0000 7fedc9800640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fedc41142d0 con 0x7fedc4074620 2024-09-19T06:25:08.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.821+0000 7fedc2a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedc4074620 0x7fedc419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:08.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.821+0000 7fedc2a00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedc4074620 0x7fedc419a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:49894/0 (socket says 172.21.15.3:49894) 2024-09-19T06:25:08.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.821+0000 7fedc2a00640 1 -- 172.21.15.3:0/3591964100 learned_addr learned my addr 172.21.15.3:0/3591964100 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:25:08.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.822+0000 7fedbbe00640 1 --2- 172.21.15.3:0/3591964100 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedc4074f40 0x7fedc419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:08.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.822+0000 7fedc3400640 1 --2- 172.21.15.3:0/3591964100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedc410e3c0 0x7fedc419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:08.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.822+0000 7fedc2a00640 1 -- 172.21.15.3:0/3591964100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedc410e3c0 msgr2=0x7fedc419eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:08.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.822+0000 7fedc2a00640 1 --2- 172.21.15.3:0/3591964100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedc410e3c0 0x7fedc419eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.822+0000 7fedc2a00640 1 -- 172.21.15.3:0/3591964100 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedc4074f40 msgr2=0x7fedc419ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:08.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.822+0000 7fedc2a00640 1 --2- 172.21.15.3:0/3591964100 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedc4074f40 0x7fedc419ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:08.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.822+0000 7fedc2a00640 1 -- 172.21.15.3:0/3591964100 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc419f5c0 con 0x7fedc4074620 2024-09-19T06:25:08.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.822+0000 7fedbbe00640 1 --2- 172.21.15.3:0/3591964100 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedc4074f40 0x7fedc419ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:25:08.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.822+0000 7fedc2a00640 1 --2- 172.21.15.3:0/3591964100 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedc4074620 0x7fedc419a610 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fedb400ea60 tx=0x7fedb400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:08.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.823+0000 7fedbb400640 1 -- 172.21.15.3:0/3591964100 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb400cde0 con 0x7fedc4074620 2024-09-19T06:25:08.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.823+0000 7fedc9800640 1 -- 172.21.15.3:0/3591964100 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedc419f8b0 con 0x7fedc4074620 2024-09-19T06:25:08.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.823+0000 7fedbb400640 1 -- 172.21.15.3:0/3591964100 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedb40035f0 con 0x7fedc4074620 2024-09-19T06:25:08.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.823+0000 7fedbb400640 1 -- 172.21.15.3:0/3591964100 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb4010670 con 0x7fedc4074620 2024-09-19T06:25:08.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.823+0000 7fedc9800640 1 -- 172.21.15.3:0/3591964100 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedc41a7190 con 0x7fedc4074620 2024-09-19T06:25:08.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.824+0000 7fedc9800640 1 -- 172.21.15.3:0/3591964100 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedc4074a00 con 0x7fedc4074620 2024-09-19T06:25:08.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.826+0000 7fedbb400640 1 -- 172.21.15.3:0/3591964100 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fedb40037a0 con 0x7fedc4074620 2024-09-19T06:25:08.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.827+0000 7fedbb400640 1 --2- 172.21.15.3:0/3591964100 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7feda80a33b0 0x7feda80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:08.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.827+0000 7fedbb400640 1 -- 172.21.15.3:0/3591964100 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8571+0+0 (secure 0 0 0) 0x7fedb40d01d0 con 0x7fedc4074620 2024-09-19T06:25:08.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.828+0000 7fedbbe00640 1 --2- 172.21.15.3:0/3591964100 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7feda80a33b0 0x7feda80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:08.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.828+0000 7fedbbe00640 1 --2- 172.21.15.3:0/3591964100 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7feda80a33b0 0x7feda80a5870 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fedc410f750 tx=0x7fedac005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:08.831 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:08.829+0000 7fedbb400640 1 -- 172.21.15.3:0/3591964100 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fedb409cbb0 con 0x7fedc4074620 2024-09-19T06:25:09.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:09.052+0000 7fedc9800640 1 -- 172.21.15.3:0/3591964100 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fedc402d7c0 con 0x7fedc4074620 2024-09-19T06:25:09.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:09.053+0000 7fedbb400640 1 -- 172.21.15.3:0/3591964100 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11941 (secure 0 0 0) 0x7fedb409c4b0 con 0x7fedc4074620 2024-09-19T06:25:09.056 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:25:09.056 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"btime":"2024-09-19T06:12:22:958217+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6835/469648602","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6834","nonce":469648602},{"type":"v1","addr":"172.21.15.3:6835","nonce":469648602}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6837/832907982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6836","nonce":832907982},{"type":"v1","addr":"172.21.15.3:6837","nonce":832907982}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T06:10:03.693253+0000","modified":"2024-09-19T06:12:22.060987+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24557,"mds_1":24532,"mds_2":24515,"mds_3":24514,"mds_4":14517},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.3:6839/2272422067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6838","nonce":2272422067},{"type":"v1","addr":"172.21.15.3:6839","nonce":2272422067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14517":{"gid":14517,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.3:6841/4189406134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6840","nonce":4189406134},{"type":"v1","addr":"172.21.15.3:6841","nonce":4189406134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6833/2883963583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6832","nonce":2883963583},{"type":"v1","addr":"172.21.15.71:6833","nonce":2883963583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24458":{"gid":24458,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6833/927949058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":927949058},{"type":"v1","addr":"172.21.15.59:6833","nonce":927949058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24494":{"gid":24494,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.59:6835/3846556695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3846556695},{"type":"v1","addr":"172.21.15.59:6835","nonce":3846556695}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.71:6835/3322076004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6834","nonce":3322076004},{"type":"v1","addr":"172.21.15.71:6835","nonce":3322076004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24514":{"gid":24514,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":12,"addr":"172.21.15.71:6837/886513714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6836","nonce":886513714},{"type":"v1","addr":"172.21.15.71:6837","nonce":886513714}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24515":{"gid":24515,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.59:6837/4286779405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6836","nonce":4286779405},{"type":"v1","addr":"172.21.15.59:6837","nonce":4286779405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24532":{"gid":24532,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":10,"addr":"172.21.15.71:6839/3577136418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6838","nonce":3577136418},{"type":"v1","addr":"172.21.15.71:6839","nonce":3577136418}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24557":{"gid":24557,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.59:6839/3162585306","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6838","nonce":3162585306},{"type":"v1","addr":"172.21.15.59:6839","nonce":3162585306}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24557,"qdb_cluster":[24557,24532,24515,24514,14517]},"id":1}]} 2024-09-19T06:25:09.056 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2024-09-19T06:25:09.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:09.057+0000 7fedc9800640 1 -- 172.21.15.3:0/3591964100 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7feda80a33b0 msgr2=0x7feda80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:09.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:09.057+0000 7fedc9800640 1 --2- 172.21.15.3:0/3591964100 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7feda80a33b0 0x7feda80a5870 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fedc410f750 tx=0x7fedac005f90 comp rx=0 tx=0).stop 2024-09-19T06:25:09.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:09.057+0000 7fedc9800640 1 -- 172.21.15.3:0/3591964100 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedc4074620 msgr2=0x7fedc419a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:09.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:09.057+0000 7fedc9800640 1 --2- 172.21.15.3:0/3591964100 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedc4074620 0x7fedc419a610 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fedb400ea60 tx=0x7fedb400ef20 comp rx=0 tx=0).stop 2024-09-19T06:25:09.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:09.057+0000 7fedc9800640 1 -- 172.21.15.3:0/3591964100 shutdown_connections 2024-09-19T06:25:09.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:09.057+0000 7fedc9800640 1 --2- 172.21.15.3:0/3591964100 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7feda80a33b0 0x7feda80a5870 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:09.057+0000 7fedc9800640 1 --2- 172.21.15.3:0/3591964100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedc410e3c0 0x7fedc419eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:09.057+0000 7fedc9800640 1 --2- 172.21.15.3:0/3591964100 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedc4074f40 0x7fedc419ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:09.057+0000 7fedc9800640 1 --2- 172.21.15.3:0/3591964100 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fedc4074620 0x7fedc419a610 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:09.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:09.057+0000 7fedc9800640 1 -- 172.21.15.3:0/3591964100 >> 172.21.15.3:0/3591964100 conn(0x7fedc40fd8c0 msgr2=0x7fedc40fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:09.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:09.057+0000 7fedc9800640 1 -- 172.21.15.3:0/3591964100 shutdown_connections 2024-09-19T06:25:09.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:09.057+0000 7fedc9800640 1 -- 172.21.15.3:0/3591964100 wait complete. 2024-09-19T06:25:09.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:09 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3591964100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:25:09.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:09 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/3591964100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:25:09.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:09 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/3591964100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:25:09.802 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:25:10.188 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:10.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:10 smithi003 ceph-mon[30893]: pgmap v398: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 46 KiB/s wr, 31 op/s 2024-09-19T06:25:10.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:10 smithi071 ceph-mon[35662]: pgmap v398: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 46 KiB/s wr, 31 op/s 2024-09-19T06:25:10.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:10 smithi059 ceph-mon[35138]: pgmap v398: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 46 KiB/s wr, 31 op/s 2024-09-19T06:25:10.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.771+0000 7ff587e00640 1 -- 172.21.15.3:0/3431652600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff588103e30 msgr2=0x7ff588104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:10.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.771+0000 7ff587e00640 1 --2- 172.21.15.3:0/3431652600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff588103e30 0x7ff588104210 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff578009900 tx=0x7ff57802a400 comp rx=0 tx=0).stop 2024-09-19T06:25:10.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.771+0000 7ff587e00640 1 -- 172.21.15.3:0/3431652600 shutdown_connections 2024-09-19T06:25:10.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.771+0000 7ff587e00640 1 --2- 172.21.15.3:0/3431652600 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff588108f60 0x7ff588110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:10.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.771+0000 7ff587e00640 1 --2- 172.21.15.3:0/3431652600 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff5881047e0 0x7ff588108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:10.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.771+0000 7ff587e00640 1 --2- 172.21.15.3:0/3431652600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff588103e30 0x7ff588104210 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:10.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.771+0000 7ff587e00640 1 -- 172.21.15.3:0/3431652600 >> 172.21.15.3:0/3431652600 conn(0x7ff5880ff8d0 msgr2=0x7ff588101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:10.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.771+0000 7ff587e00640 1 -- 172.21.15.3:0/3431652600 shutdown_connections 2024-09-19T06:25:10.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.771+0000 7ff587e00640 1 -- 172.21.15.3:0/3431652600 wait complete. 2024-09-19T06:25:10.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.772+0000 7ff587e00640 1 Processor -- start 2024-09-19T06:25:10.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.772+0000 7ff587e00640 1 -- start start 2024-09-19T06:25:10.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.772+0000 7ff587e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff588103e30 0x7ff58819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:10.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.772+0000 7ff587e00640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5881047e0 0x7ff58819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:10.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.772+0000 7ff587e00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff588108f60 0x7ff58819ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:10.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.772+0000 7ff587e00640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff588113fd0 con 0x7ff588108f60 2024-09-19T06:25:10.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.772+0000 7ff587e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7ff588113e50 con 0x7ff588103e30 2024-09-19T06:25:10.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.772+0000 7ff587e00640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7ff588114150 con 0x7ff5881047e0 2024-09-19T06:25:10.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.773+0000 7ff586a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff588103e30 0x7ff58819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:10.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.773+0000 7ff586a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff588103e30 0x7ff58819a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:43610/0 (socket says 172.21.15.3:43610) 2024-09-19T06:25:10.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.773+0000 7ff586a00640 1 -- 172.21.15.3:0/3139625815 learned_addr learned my addr 172.21.15.3:0/3139625815 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:25:10.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.773+0000 7ff587400640 1 --2- 172.21.15.3:0/3139625815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff588108f60 0x7ff58819ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:10.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.773+0000 7ff586000640 1 --2- 172.21.15.3:0/3139625815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5881047e0 0x7ff58819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:10.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.773+0000 7ff586a00640 1 -- 172.21.15.3:0/3139625815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5881047e0 msgr2=0x7ff58819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:10.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.773+0000 7ff586a00640 1 --2- 172.21.15.3:0/3139625815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5881047e0 0x7ff58819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:10.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.773+0000 7ff586a00640 1 -- 172.21.15.3:0/3139625815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff588108f60 msgr2=0x7ff58819ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:10.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.773+0000 7ff586a00640 1 --2- 172.21.15.3:0/3139625815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff588108f60 0x7ff58819ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:10.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.773+0000 7ff586a00640 1 -- 172.21.15.3:0/3139625815 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff58819f440 con 0x7ff588103e30 2024-09-19T06:25:10.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.773+0000 7ff586a00640 1 --2- 172.21.15.3:0/3139625815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff588103e30 0x7ff58819a490 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff578004770 tx=0x7ff578003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:10.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.774+0000 7ff57f400640 1 -- 172.21.15.3:0/3139625815 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57803f070 con 0x7ff588103e30 2024-09-19T06:25:10.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.774+0000 7ff57f400640 1 -- 172.21.15.3:0/3139625815 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff578031ca0 con 0x7ff588103e30 2024-09-19T06:25:10.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.774+0000 7ff587e00640 1 -- 172.21.15.3:0/3139625815 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff58819f6d0 con 0x7ff588103e30 2024-09-19T06:25:10.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.774+0000 7ff57f400640 1 -- 172.21.15.3:0/3139625815 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff578035030 con 0x7ff588103e30 2024-09-19T06:25:10.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.774+0000 7ff587e00640 1 -- 172.21.15.3:0/3139625815 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5881a7010 con 0x7ff588103e30 2024-09-19T06:25:10.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.775+0000 7ff587e00640 1 -- 172.21.15.3:0/3139625815 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff588105310 con 0x7ff588103e30 2024-09-19T06:25:10.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.777+0000 7ff57f400640 1 -- 172.21.15.3:0/3139625815 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7ff578042070 con 0x7ff588103e30 2024-09-19T06:25:10.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.778+0000 7ff57f400640 1 --2- 172.21.15.3:0/3139625815 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff56c0a33b0 0x7ff56c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:10.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.779+0000 7ff57f400640 1 -- 172.21.15.3:0/3139625815 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8615+0+0 (secure 0 0 0) 0x7ff5780f0a10 con 0x7ff588103e30 2024-09-19T06:25:10.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.779+0000 7ff586000640 1 --2- 172.21.15.3:0/3139625815 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff56c0a33b0 0x7ff56c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:10.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.779+0000 7ff586000640 1 --2- 172.21.15.3:0/3139625815 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff56c0a33b0 0x7ff56c0a5870 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff5740095f0 tx=0x7ff574005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:10.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.780+0000 7ff57f400640 1 -- 172.21.15.3:0/3139625815 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff5780bd3f0 con 0x7ff588103e30 2024-09-19T06:25:10.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.967+0000 7ff587e00640 1 -- 172.21.15.3:0/3139625815 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff58810c140 con 0x7ff588103e30 2024-09-19T06:25:10.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.969+0000 7ff57f400640 1 -- 172.21.15.3:0/3139625815 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+23115 (secure 0 0 0) 0x7ff5780bccf0 con 0x7ff588103e30 2024-09-19T06:25:10.971 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-19T06:25:10.971 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":102,"fsid":"782a5144-764c-11ef-bceb-c7b262605968","created":"2024-09-19T06:01:35.224753+0000","modified":"2024-09-19T06:25:10.078228+0000","last_up_change":"2024-09-19T06:09:02.478979+0000","last_in_change":"2024-09-19T06:08:38.865280+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:04:56.654478+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T06:09:58.426008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T06:10:01.215704+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":21,"snap_epoch":102,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fd89ea4b-a24e-4946-80fc-1776b6d05e24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6803","nonce":2061486638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6805","nonce":2061486638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6809","nonce":2061486638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":2061486638},{"type":"v1","addr":"172.21.15.3:6807","nonce":2061486638}]},"public_addr":"172.21.15.3:6803/2061486638","cluster_addr":"172.21.15.3:6805/2061486638","heartbeat_back_addr":"172.21.15.3:6809/2061486638","heartbeat_front_addr":"172.21.15.3:6807/2061486638","state":["exists","up"]},{"osd":1,"uuid":"e03ca275-8da5-402f-9cd2-654ca422b9b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6801","nonce":129318538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6803","nonce":129318538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6807","nonce":129318538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":129318538},{"type":"v1","addr":"172.21.15.59:6805","nonce":129318538}]},"public_addr":"172.21.15.59:6801/129318538","cluster_addr":"172.21.15.59:6803/129318538","heartbeat_back_addr":"172.21.15.59:6807/129318538","heartbeat_front_addr":"172.21.15.59:6805/129318538","state":["exists","up"]},{"osd":2,"uuid":"62b7d36d-6078-4027-93b2-009be70a6d80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6801","nonce":2436210695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6803","nonce":2436210695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6806","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6807","nonce":2436210695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":2436210695},{"type":"v1","addr":"172.21.15.71:6805","nonce":2436210695}]},"public_addr":"172.21.15.71:6801/2436210695","cluster_addr":"172.21.15.71:6803/2436210695","heartbeat_back_addr":"172.21.15.71:6807/2436210695","heartbeat_front_addr":"172.21.15.71:6805/2436210695","state":["exists","up"]},{"osd":3,"uuid":"ba33cc45-0103-443d-b262-622a505d9806","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6811","nonce":3577306700}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6813","nonce":3577306700}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6817","nonce":3577306700}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":3577306700},{"type":"v1","addr":"172.21.15.3:6815","nonce":3577306700}]},"public_addr":"172.21.15.3:6811/3577306700","cluster_addr":"172.21.15.3:6813/3577306700","heartbeat_back_addr":"172.21.15.3:6817/3577306700","heartbeat_front_addr":"172.21.15.3:6815/3577306700","state":["exists","up"]},{"osd":4,"uuid":"40564c0c-6335-4207-a8e0-8078c9bfd015","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6809","nonce":4002980986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6811","nonce":4002980986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6815","nonce":4002980986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":4002980986},{"type":"v1","addr":"172.21.15.59:6813","nonce":4002980986}]},"public_addr":"172.21.15.59:6809/4002980986","cluster_addr":"172.21.15.59:6811/4002980986","heartbeat_back_addr":"172.21.15.59:6815/4002980986","heartbeat_front_addr":"172.21.15.59:6813/4002980986","state":["exists","up"]},{"osd":5,"uuid":"4db04b82-3403-4fd5-9eb7-7b81ed6b1d26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6808","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6809","nonce":2455500497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6810","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6811","nonce":2455500497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6815","nonce":2455500497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6812","nonce":2455500497},{"type":"v1","addr":"172.21.15.71:6813","nonce":2455500497}]},"public_addr":"172.21.15.71:6809/2455500497","cluster_addr":"172.21.15.71:6811/2455500497","heartbeat_back_addr":"172.21.15.71:6815/2455500497","heartbeat_front_addr":"172.21.15.71:6813/2455500497","state":["exists","up"]},{"osd":6,"uuid":"42a74f01-c5d0-4fc6-a8ee-a8bd84d4ab4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6819","nonce":823411903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6821","nonce":823411903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6825","nonce":823411903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":823411903},{"type":"v1","addr":"172.21.15.3:6823","nonce":823411903}]},"public_addr":"172.21.15.3:6819/823411903","cluster_addr":"172.21.15.3:6821/823411903","heartbeat_back_addr":"172.21.15.3:6825/823411903","heartbeat_front_addr":"172.21.15.3:6823/823411903","state":["exists","up"]},{"osd":7,"uuid":"8a9bc2ec-4292-465d-8a0d-dda78521a319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6817","nonce":2133603853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6819","nonce":2133603853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6823","nonce":2133603853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":2133603853},{"type":"v1","addr":"172.21.15.59:6821","nonce":2133603853}]},"public_addr":"172.21.15.59:6817/2133603853","cluster_addr":"172.21.15.59:6819/2133603853","heartbeat_back_addr":"172.21.15.59:6823/2133603853","heartbeat_front_addr":"172.21.15.59:6821/2133603853","state":["exists","up"]},{"osd":8,"uuid":"6099a5c4-3504-43ca-8c58-d23f9096cd7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6817","nonce":905333117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6818","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6819","nonce":905333117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6823","nonce":905333117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":905333117},{"type":"v1","addr":"172.21.15.71:6821","nonce":905333117}]},"public_addr":"172.21.15.71:6817/905333117","cluster_addr":"172.21.15.71:6819/905333117","heartbeat_back_addr":"172.21.15.71:6823/905333117","heartbeat_front_addr":"172.21.15.71:6821/905333117","state":["exists","up"]},{"osd":9,"uuid":"b5a8aac6-bb10-4db8-a056-25228fbe754c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6827","nonce":124909267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6829","nonce":124909267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6832","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6833","nonce":124909267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6830","nonce":124909267},{"type":"v1","addr":"172.21.15.3:6831","nonce":124909267}]},"public_addr":"172.21.15.3:6827/124909267","cluster_addr":"172.21.15.3:6829/124909267","heartbeat_back_addr":"172.21.15.3:6833/124909267","heartbeat_front_addr":"172.21.15.3:6831/124909267","state":["exists","up"]},{"osd":10,"uuid":"e49f3aab-0804-4aea-ae3f-38f022ab5239","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6825","nonce":784134238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6827","nonce":784134238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6831","nonce":784134238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":784134238},{"type":"v1","addr":"172.21.15.59:6829","nonce":784134238}]},"public_addr":"172.21.15.59:6825/784134238","cluster_addr":"172.21.15.59:6827/784134238","heartbeat_back_addr":"172.21.15.59:6831/784134238","heartbeat_front_addr":"172.21.15.59:6829/784134238","state":["exists","up"]},{"osd":11,"uuid":"6c6d6c23-bcf7-43e7-94d1-5f2ebaa15441","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6825","nonce":3502550915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6827","nonce":3502550915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6831","nonce":3502550915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":3502550915},{"type":"v1","addr":"172.21.15.71:6829","nonce":3502550915}]},"public_addr":"172.21.15.71:6825/3502550915","cluster_addr":"172.21.15.71:6827/3502550915","heartbeat_back_addr":"172.21.15.71:6831/3502550915","heartbeat_front_addr":"172.21.15.71:6829/3502550915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:01.683342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:28.058683+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:04:53.250819+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:05:23.267377+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:05:49.756289+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:06:15.766613+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:06:46.054328+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:12.579180+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:07:37.976863+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:08.683966+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:08:35.120765+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:09:00.624411+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":5,"to":11}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/3104337397":"2024-09-20T06:12:22.409669+0000","172.21.15.3:0/4101082351":"2024-09-20T06:12:22.409669+0000","172.21.15.3:0/3358701720":"2024-09-20T06:12:22.409669+0000","172.21.15.3:0/1616091100":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/3155841850":"2024-09-20T06:12:22.409669+0000","172.21.15.3:6800/2386230415":"2024-09-20T06:02:01.122348+0000","172.21.15.3:0/2122482494":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6801/2386230415":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6800/1278931596":"2024-09-20T06:12:22.409669+0000","172.21.15.3:0/1658697906":"2024-09-20T06:02:01.122348+0000","172.21.15.3:6801/518259590":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/953348594":"2024-09-20T06:02:01.122348+0000","172.21.15.3:0/2065281908":"2024-09-20T06:02:30.039686+0000","172.21.15.3:0/1458736313":"2024-09-20T06:02:30.039686+0000","172.21.15.3:6800/518259590":"2024-09-20T06:02:30.039686+0000","172.21.15.3:6801/1278931596":"2024-09-20T06:12:22.409669+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":8,"length":1},{"begin":21,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":8,"length":1},{"begin":21,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:25:10.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.971+0000 7ff587e00640 1 -- 172.21.15.3:0/3139625815 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff56c0a33b0 msgr2=0x7ff56c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:10.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.971+0000 7ff587e00640 1 --2- 172.21.15.3:0/3139625815 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff56c0a33b0 0x7ff56c0a5870 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff5740095f0 tx=0x7ff574005f90 comp rx=0 tx=0).stop 2024-09-19T06:25:10.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.971+0000 7ff587e00640 1 -- 172.21.15.3:0/3139625815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff588103e30 msgr2=0x7ff58819a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:10.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.971+0000 7ff587e00640 1 --2- 172.21.15.3:0/3139625815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff588103e30 0x7ff58819a490 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff578004770 tx=0x7ff578003c10 comp rx=0 tx=0).stop 2024-09-19T06:25:10.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.971+0000 7ff587e00640 1 -- 172.21.15.3:0/3139625815 shutdown_connections 2024-09-19T06:25:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.971+0000 7ff587e00640 1 --2- 172.21.15.3:0/3139625815 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7ff56c0a33b0 0x7ff56c0a5870 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.971+0000 7ff587e00640 1 --2- 172.21.15.3:0/3139625815 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff588108f60 0x7ff58819ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.971+0000 7ff587e00640 1 --2- 172.21.15.3:0/3139625815 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7ff5881047e0 0x7ff58819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.971+0000 7ff587e00640 1 --2- 172.21.15.3:0/3139625815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff588103e30 0x7ff58819a490 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.971+0000 7ff587e00640 1 -- 172.21.15.3:0/3139625815 >> 172.21.15.3:0/3139625815 conn(0x7ff5880ff8d0 msgr2=0x7ff588100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.972+0000 7ff587e00640 1 -- 172.21.15.3:0/3139625815 shutdown_connections 2024-09-19T06:25:10.974 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:10.972+0000 7ff587e00640 1 -- 172.21.15.3:0/3139625815 wait complete. 2024-09-19T06:25:11.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:11 smithi003 ceph-mon[30893]: osdmap e102: 12 total, 12 up, 12 in 2024-09-19T06:25:11.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:11 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/3139625815' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:25:11.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:11 smithi059 ceph-mon[35138]: osdmap e102: 12 total, 12 up, 12 in 2024-09-19T06:25:11.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:11 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/3139625815' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:25:11.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:11 smithi071 ceph-mon[35662]: osdmap e102: 12 total, 12 up, 12 in 2024-09-19T06:25:11.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:11 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/3139625815' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:25:11.753 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T06:25:12.134 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:12.419 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:12 smithi003 ceph-mon[30893]: pgmap v400: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 55 KiB/s wr, 32 op/s 2024-09-19T06:25:12.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:12 smithi059 ceph-mon[35138]: pgmap v400: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 55 KiB/s wr, 32 op/s 2024-09-19T06:25:12.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:12 smithi071 ceph-mon[35662]: pgmap v400: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 55 KiB/s wr, 32 op/s 2024-09-19T06:25:12.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.704+0000 7f014b600640 1 -- 172.21.15.3:0/2389147290 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0144074620 msgr2=0x7f0144074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:12.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.704+0000 7f014b600640 1 --2- 172.21.15.3:0/2389147290 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0144074620 0x7f0144074a00 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f0138009900 tx=0x7f013802a480 comp rx=0 tx=0).stop 2024-09-19T06:25:12.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.704+0000 7f014b600640 1 -- 172.21.15.3:0/2389147290 shutdown_connections 2024-09-19T06:25:12.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.704+0000 7f014b600640 1 --2- 172.21.15.3:0/2389147290 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f014410e3c0 0x7f0144110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.704+0000 7f014b600640 1 --2- 172.21.15.3:0/2389147290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0144074f40 0x7f014410de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.704+0000 7f014b600640 1 --2- 172.21.15.3:0/2389147290 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0144074620 0x7f0144074a00 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.704+0000 7f014b600640 1 -- 172.21.15.3:0/2389147290 >> 172.21.15.3:0/2389147290 conn(0x7f01440fd8c0 msgr2=0x7f01440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:12.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.704+0000 7f014b600640 1 -- 172.21.15.3:0/2389147290 shutdown_connections 2024-09-19T06:25:12.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.704+0000 7f014b600640 1 -- 172.21.15.3:0/2389147290 wait complete. 2024-09-19T06:25:12.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.705+0000 7f014b600640 1 Processor -- start 2024-09-19T06:25:12.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.705+0000 7f014b600640 1 -- start start 2024-09-19T06:25:12.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.706+0000 7f014b600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0144074620 0x7f014419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:12.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.706+0000 7f014b600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0144074f40 0x7f014419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:12.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.706+0000 7f014b600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f014410e3c0 0x7f014419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:12.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.706+0000 7f014b600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f01441141c0 con 0x7f014410e3c0 2024-09-19T06:25:12.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.706+0000 7f014b600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f0144114040 con 0x7f0144074f40 2024-09-19T06:25:12.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.706+0000 7f014b600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f0144114340 con 0x7f0144074620 2024-09-19T06:25:12.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.706+0000 7f0143e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0144074f40 0x7f014419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:12.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.706+0000 7f0143e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0144074f40 0x7f014419abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.3:43624/0 (socket says 172.21.15.3:43624) 2024-09-19T06:25:12.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.706+0000 7f0143e00640 1 -- 172.21.15.3:0/640397998 learned_addr learned my addr 172.21.15.3:0/640397998 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:25:12.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.706+0000 7f0148c00640 1 --2- 172.21.15.3:0/640397998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0144074620 0x7f014419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:12.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.706+0000 7f0149600640 1 --2- 172.21.15.3:0/640397998 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f014410e3c0 0x7f014419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:12.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.707+0000 7f0143e00640 1 -- 172.21.15.3:0/640397998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0144074620 msgr2=0x7f014419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:12.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.707+0000 7f0143e00640 1 --2- 172.21.15.3:0/640397998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0144074620 0x7f014419a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.707+0000 7f0143e00640 1 -- 172.21.15.3:0/640397998 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f014410e3c0 msgr2=0x7f014419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:12.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.707+0000 7f0143e00640 1 --2- 172.21.15.3:0/640397998 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f014410e3c0 0x7f014419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.707+0000 7f0143e00640 1 -- 172.21.15.3:0/640397998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f014419f640 con 0x7f0144074f40 2024-09-19T06:25:12.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.707+0000 7f0143e00640 1 --2- 172.21.15.3:0/640397998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0144074f40 0x7f014419abd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f013000e9f0 tx=0x7f013000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:12.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.707+0000 7f0141600640 1 -- 172.21.15.3:0/640397998 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f013000cd80 con 0x7f0144074f40 2024-09-19T06:25:12.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.707+0000 7f014b600640 1 -- 172.21.15.3:0/640397998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f014419f930 con 0x7f0144074f40 2024-09-19T06:25:12.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.707+0000 7f0141600640 1 -- 172.21.15.3:0/640397998 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0130010910 con 0x7f0144074f40 2024-09-19T06:25:12.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.707+0000 7f0141600640 1 -- 172.21.15.3:0/640397998 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01300188f0 con 0x7f0144074f40 2024-09-19T06:25:12.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.707+0000 7f014b600640 1 -- 172.21.15.3:0/640397998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01441a7210 con 0x7f0144074f40 2024-09-19T06:25:12.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.708+0000 7f014b600640 1 -- 172.21.15.3:0/640397998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0124005290 con 0x7f0144074f40 2024-09-19T06:25:12.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.711+0000 7f0141600640 1 -- 172.21.15.3:0/640397998 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f0130010430 con 0x7f0144074f40 2024-09-19T06:25:12.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.712+0000 7f0141600640 1 --2- 172.21.15.3:0/640397998 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f012c0a33b0 0x7f012c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:12.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.713+0000 7f0141600640 1 -- 172.21.15.3:0/640397998 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8615+0+0 (secure 0 0 0) 0x7f01300d0230 con 0x7f0144074f40 2024-09-19T06:25:12.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.713+0000 7f0148c00640 1 --2- 172.21.15.3:0/640397998 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f012c0a33b0 0x7f012c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:12.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.713+0000 7f0148c00640 1 --2- 172.21.15.3:0/640397998 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f012c0a33b0 0x7f012c0a5870 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0138000c00 tx=0x7f0138005b50 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:12.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.714+0000 7f0141600640 1 -- 172.21.15.3:0/640397998 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f013009c500 con 0x7f0144074f40 2024-09-19T06:25:12.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.938+0000 7f014b600640 1 -- 172.21.15.3:0/640397998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0124005850 con 0x7f0144074f40 2024-09-19T06:25:12.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.952+0000 7f0141600640 1 -- 172.21.15.3:0/640397998 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) ==== 161+0+0 (secure 0 0 0) 0x7f01300a0800 con 0x7f0144074f40 2024-09-19T06:25:12.954 INFO:teuthology.orchestra.run.smithi003.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T06:25:12.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.954+0000 7f014b600640 1 -- 172.21.15.3:0/640397998 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f012c0a33b0 msgr2=0x7f012c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:12.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.954+0000 7f014b600640 1 --2- 172.21.15.3:0/640397998 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f012c0a33b0 0x7f012c0a5870 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0138000c00 tx=0x7f0138005b50 comp rx=0 tx=0).stop 2024-09-19T06:25:12.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.954+0000 7f014b600640 1 -- 172.21.15.3:0/640397998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0144074f40 msgr2=0x7f014419abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:12.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.954+0000 7f014b600640 1 --2- 172.21.15.3:0/640397998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0144074f40 0x7f014419abd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f013000e9f0 tx=0x7f013000eeb0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.954+0000 7f014b600640 1 -- 172.21.15.3:0/640397998 shutdown_connections 2024-09-19T06:25:12.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.954+0000 7f014b600640 1 --2- 172.21.15.3:0/640397998 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f012c0a33b0 0x7f012c0a5870 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.954+0000 7f014b600640 1 --2- 172.21.15.3:0/640397998 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f014410e3c0 0x7f014419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.954+0000 7f014b600640 1 --2- 172.21.15.3:0/640397998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0144074f40 0x7f014419abd0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.954+0000 7f014b600640 1 --2- 172.21.15.3:0/640397998 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f0144074620 0x7f014419a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:12.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.954+0000 7f014b600640 1 -- 172.21.15.3:0/640397998 >> 172.21.15.3:0/640397998 conn(0x7f01440fd8c0 msgr2=0x7f01440fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:12.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.955+0000 7f014b600640 1 -- 172.21.15.3:0/640397998 shutdown_connections 2024-09-19T06:25:12.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:12.955+0000 7f014b600640 1 -- 172.21.15.3:0/640397998 wait complete. 2024-09-19T06:25:13.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:13 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/640397998' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T06:25:13.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:13 smithi059 ceph-mon[35138]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T06:25:13.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:13 smithi059 ceph-mon[35138]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T06:25:13.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:13 smithi059 ceph-mon[35138]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:25:13.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:13 smithi059 ceph-mon[35138]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T06:25:13.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:13 smithi059 ceph-mon[35138]: osdmap e103: 12 total, 12 up, 12 in 2024-09-19T06:25:13.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:13 smithi059 ceph-mon[35138]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-19T06:25:13.289 INFO:journalctl@ceph.mds.h.smithi059.stdout:Sep 19 06:25:12 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-h[65020]: ignoring --setuser ceph since I am not root 2024-09-19T06:25:13.289 INFO:journalctl@ceph.mds.h.smithi059.stdout:Sep 19 06:25:12 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-h[65020]: ignoring --setgroup ceph since I am not root 2024-09-19T06:25:13.289 INFO:journalctl@ceph.mds.h.smithi059.stdout:Sep 19 06:25:13 smithi059 ceph-mds[65024]: -- 172.21.15.59:0/1476512461 <== mon.1 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f965c71c20 con 0x55f965c4f400 2024-09-19T06:25:13.289 INFO:journalctl@ceph.mds.h.smithi059.stdout:Sep 19 06:25:13 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-h[65020]: starting mds.h at 2024-09-19T06:25:13.290 INFO:journalctl@ceph.mds.k.smithi059.stdout:Sep 19 06:25:12 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-k[64408]: ignoring --setuser ceph since I am not root 2024-09-19T06:25:13.290 INFO:journalctl@ceph.mds.k.smithi059.stdout:Sep 19 06:25:12 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-k[64408]: ignoring --setgroup ceph since I am not root 2024-09-19T06:25:13.290 INFO:journalctl@ceph.mds.k.smithi059.stdout:Sep 19 06:25:13 smithi059 ceph-mds[64412]: -- 172.21.15.59:0/347577004 <== mon.0 v2:172.21.15.3:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562c55edf860 con 0x562c55ebc800 2024-09-19T06:25:13.290 INFO:journalctl@ceph.mds.k.smithi059.stdout:Sep 19 06:25:13 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-k[64408]: starting mds.k at 2024-09-19T06:25:13.290 INFO:journalctl@ceph.mds.e.smithi059.stdout:Sep 19 06:25:12 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-e[64720]: ignoring --setuser ceph since I am not root 2024-09-19T06:25:13.290 INFO:journalctl@ceph.mds.e.smithi059.stdout:Sep 19 06:25:12 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-e[64720]: ignoring --setgroup ceph since I am not root 2024-09-19T06:25:13.290 INFO:journalctl@ceph.mds.e.smithi059.stdout:Sep 19 06:25:13 smithi059 ceph-mds[64724]: -- 172.21.15.59:0/4157031211 <== mon.2 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c3993abc20 con 0x55c399388800 2024-09-19T06:25:13.290 INFO:journalctl@ceph.mds.e.smithi059.stdout:Sep 19 06:25:13 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-e[64720]: starting mds.e at 2024-09-19T06:25:13.291 INFO:journalctl@ceph.mds.b.smithi059.stdout:Sep 19 06:25:12 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-b[65335]: ignoring --setuser ceph since I am not root 2024-09-19T06:25:13.291 INFO:journalctl@ceph.mds.b.smithi059.stdout:Sep 19 06:25:12 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-b[65335]: ignoring --setgroup ceph since I am not root 2024-09-19T06:25:13.291 INFO:journalctl@ceph.mds.b.smithi059.stdout:Sep 19 06:25:13 smithi059 ceph-mds[65339]: -- 172.21.15.59:0/2966911465 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e2a5f96680 con 0x55e2a5f6a800 2024-09-19T06:25:13.291 INFO:journalctl@ceph.mds.b.smithi059.stdout:Sep 19 06:25:13 smithi059 ceph-mds[65339]: -- 172.21.15.59:0/2966911465 <== mon.2 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e2a5f8d860 con 0x55e2a5f6a800 2024-09-19T06:25:13.291 INFO:journalctl@ceph.mds.b.smithi059.stdout:Sep 19 06:25:13 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-b[65335]: starting mds.b at 2024-09-19T06:25:13.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:12 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-a[30889]: 2024-09-19T06:25:12.940+0000 7f06dca00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:25:13.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:13 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/640397998' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T06:25:13.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:13 smithi003 ceph-mon[30893]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T06:25:13.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:13 smithi003 ceph-mon[30893]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T06:25:13.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:13 smithi003 ceph-mon[30893]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:25:13.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:13 smithi003 ceph-mon[30893]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T06:25:13.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:13 smithi003 ceph-mon[30893]: osdmap e103: 12 total, 12 up, 12 in 2024-09-19T06:25:13.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:13 smithi003 ceph-mon[30893]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-19T06:25:13.335 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 19 06:25:13 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-g[72436]: ignoring --setuser ceph since I am not root 2024-09-19T06:25:13.335 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 19 06:25:13 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-g[72436]: ignoring --setgroup ceph since I am not root 2024-09-19T06:25:13.335 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 19 06:25:13 smithi003 ceph-mds[72453]: -- 172.21.15.3:0/1641135366 <== mon.2 v2:172.21.15.59:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5628c9e15860 con 0x5628c9df3400 2024-09-19T06:25:13.335 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 19 06:25:13 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-g[72436]: starting mds.g at 2024-09-19T06:25:13.336 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 19 06:25:13 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-a[72851]: ignoring --setuser ceph since I am not root 2024-09-19T06:25:13.336 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 19 06:25:13 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-a[72851]: ignoring --setgroup ceph since I am not root 2024-09-19T06:25:13.336 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 19 06:25:13 smithi003 ceph-mds[72868]: -- 172.21.15.3:0/2599749494 <== mon.1 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55eb967c1860 con 0x55eb9679e800 2024-09-19T06:25:13.336 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 19 06:25:13 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-a[72851]: starting mds.a at 2024-09-19T06:25:13.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:13 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/640397998' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T06:25:13.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:13 smithi071 ceph-mon[35662]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T06:25:13.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:13 smithi071 ceph-mon[35662]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T06:25:13.336 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:13 smithi071 ceph-mon[35662]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:25:13.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:13 smithi071 ceph-mon[35662]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T06:25:13.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:13 smithi071 ceph-mon[35662]: osdmap e103: 12 total, 12 up, 12 in 2024-09-19T06:25:13.337 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:13 smithi071 ceph-mon[35662]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-19T06:25:13.337 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 19 06:25:12 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-c[66049]: ignoring --setuser ceph since I am not root 2024-09-19T06:25:13.337 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 19 06:25:12 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-c[66049]: ignoring --setgroup ceph since I am not root 2024-09-19T06:25:13.337 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 19 06:25:13 smithi071 ceph-mds[66053]: -- 172.21.15.71:0/3137971793 <== mon.1 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d0493fd860 con 0x55d0493db400 2024-09-19T06:25:13.337 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 19 06:25:13 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-c[66049]: starting mds.c at 2024-09-19T06:25:13.337 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 19 06:25:12 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-f[65747]: ignoring --setuser ceph since I am not root 2024-09-19T06:25:13.338 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 19 06:25:12 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-f[65747]: ignoring --setgroup ceph since I am not root 2024-09-19T06:25:13.338 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 19 06:25:12 smithi071 ceph-mds[65751]: -- 172.21.15.71:0/3375001065 <== mon.1 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cc7461b860 con 0x55cc745f9400 2024-09-19T06:25:13.338 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 19 06:25:12 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-f[65747]: starting mds.f at 2024-09-19T06:25:13.338 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 19 06:25:13 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-i[66346]: ignoring --setuser ceph since I am not root 2024-09-19T06:25:13.338 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 19 06:25:13 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-i[66346]: ignoring --setgroup ceph since I am not root 2024-09-19T06:25:13.338 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 19 06:25:13 smithi071 ceph-mds[66350]: -- 172.21.15.71:0/904126581 <== mon.1 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d56a4b9860 con 0x55d56a497400 2024-09-19T06:25:13.338 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 19 06:25:13 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-i[66346]: starting mds.i at 2024-09-19T06:25:13.338 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 19 06:25:12 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-l[65446]: ignoring --setuser ceph since I am not root 2024-09-19T06:25:13.339 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 19 06:25:12 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-l[65446]: ignoring --setgroup ceph since I am not root 2024-09-19T06:25:13.339 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 19 06:25:12 smithi071 ceph-mds[65450]: -- 172.21.15.71:0/128850212 <== mon.1 v2:172.21.15.71:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e048607860 con 0x55e0485e5400 2024-09-19T06:25:13.339 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 19 06:25:12 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-l[65446]: starting mds.l at 2024-09-19T06:25:13.818 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T06:25:14.201 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:14.374 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:14 smithi003 ceph-mon[30893]: pgmap v401: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 55 KiB/s wr, 32 op/s 2024-09-19T06:25:14.374 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:14 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.71:6832/1801025869,v1:172.21.15.71:6834/1801025869] up:boot 2024-09-19T06:25:14.374 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:14 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.71:6833/3000260401,v1:172.21.15.71:6835/3000260401] up:boot 2024-09-19T06:25:14.374 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:14 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.59:6832/265868153,v1:172.21.15.59:6835/265868153] up:boot 2024-09-19T06:25:14.374 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:14 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.59:6834/516280675,v1:172.21.15.59:6837/516280675] up:boot 2024-09-19T06:25:14.374 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:14 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.71:6836/905969990,v1:172.21.15.71:6837/905969990] up:boot 2024-09-19T06:25:14.374 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:14 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.59:6833/840232316,v1:172.21.15.59:6836/840232316] up:boot 2024-09-19T06:25:14.374 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:14 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.59:6838/2780038828,v1:172.21.15.59:6839/2780038828] up:boot 2024-09-19T06:25:14.375 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:14 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.71:6838/2593127261,v1:172.21.15.71:6839/2593127261] up:boot 2024-09-19T06:25:14.375 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:14 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.3:6838/3132022966,v1:172.21.15.3:6839/3132022966] up:boot 2024-09-19T06:25:14.375 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:14 smithi003 ceph-mon[30893]: mds.? [v2:172.21.15.3:6840/3712110303,v1:172.21.15.3:6841/3712110303] up:boot 2024-09-19T06:25:14.375 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:14 smithi003 ceph-mon[30893]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-19T06:25:14.375 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:14 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:25:14.375 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:14 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:25:14.375 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:14 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:25:14.375 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:14 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:25:14.375 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:14 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:25:14.375 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:14 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:25:14.375 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:14 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:25:14.375 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:14 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:25:14.375 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:14 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:25:14.375 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:14 smithi003 ceph-mon[30893]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:25:14.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:14 smithi059 ceph-mon[35138]: pgmap v401: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 55 KiB/s wr, 32 op/s 2024-09-19T06:25:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:14 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.71:6832/1801025869,v1:172.21.15.71:6834/1801025869] up:boot 2024-09-19T06:25:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:14 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.71:6833/3000260401,v1:172.21.15.71:6835/3000260401] up:boot 2024-09-19T06:25:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:14 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.59:6832/265868153,v1:172.21.15.59:6835/265868153] up:boot 2024-09-19T06:25:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:14 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.59:6834/516280675,v1:172.21.15.59:6837/516280675] up:boot 2024-09-19T06:25:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:14 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.71:6836/905969990,v1:172.21.15.71:6837/905969990] up:boot 2024-09-19T06:25:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:14 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.59:6833/840232316,v1:172.21.15.59:6836/840232316] up:boot 2024-09-19T06:25:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:14 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.59:6838/2780038828,v1:172.21.15.59:6839/2780038828] up:boot 2024-09-19T06:25:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:14 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.71:6838/2593127261,v1:172.21.15.71:6839/2593127261] up:boot 2024-09-19T06:25:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:14 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.3:6838/3132022966,v1:172.21.15.3:6839/3132022966] up:boot 2024-09-19T06:25:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:14 smithi059 ceph-mon[35138]: mds.? [v2:172.21.15.3:6840/3712110303,v1:172.21.15.3:6841/3712110303] up:boot 2024-09-19T06:25:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:14 smithi059 ceph-mon[35138]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-19T06:25:14.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:14 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:25:14.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:14 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:25:14.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:14 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:25:14.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:14 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:25:14.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:14 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:25:14.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:14 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:25:14.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:14 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:25:14.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:14 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:25:14.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:14 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:25:14.540 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:14 smithi059 ceph-mon[35138]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:25:14.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:14 smithi071 ceph-mon[35662]: pgmap v401: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 55 KiB/s wr, 32 op/s 2024-09-19T06:25:14.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:14 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.71:6832/1801025869,v1:172.21.15.71:6834/1801025869] up:boot 2024-09-19T06:25:14.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:14 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.71:6833/3000260401,v1:172.21.15.71:6835/3000260401] up:boot 2024-09-19T06:25:14.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:14 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.59:6832/265868153,v1:172.21.15.59:6835/265868153] up:boot 2024-09-19T06:25:14.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:14 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.59:6834/516280675,v1:172.21.15.59:6837/516280675] up:boot 2024-09-19T06:25:14.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:14 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.71:6836/905969990,v1:172.21.15.71:6837/905969990] up:boot 2024-09-19T06:25:14.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:14 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.59:6833/840232316,v1:172.21.15.59:6836/840232316] up:boot 2024-09-19T06:25:14.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:14 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.59:6838/2780038828,v1:172.21.15.59:6839/2780038828] up:boot 2024-09-19T06:25:14.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:14 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.71:6838/2593127261,v1:172.21.15.71:6839/2593127261] up:boot 2024-09-19T06:25:14.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:14 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.3:6838/3132022966,v1:172.21.15.3:6839/3132022966] up:boot 2024-09-19T06:25:14.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:14 smithi071 ceph-mon[35662]: mds.? [v2:172.21.15.3:6840/3712110303,v1:172.21.15.3:6841/3712110303] up:boot 2024-09-19T06:25:14.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:14 smithi071 ceph-mon[35662]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-19T06:25:14.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:14 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T06:25:14.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:14 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T06:25:14.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:14 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T06:25:14.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:14 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T06:25:14.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:14 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T06:25:14.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:14 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T06:25:14.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:14 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T06:25:14.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:14 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T06:25:14.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:14 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T06:25:14.587 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:14 smithi071 ceph-mon[35662]: from='mgr.15126 172.21.15.3:0/4057614465' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T06:25:14.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.791+0000 7f3a77600640 1 -- 172.21.15.3:0/3440124421 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a70100eb0 msgr2=0x7f3a70106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:14.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.791+0000 7f3a77600640 1 --2- 172.21.15.3:0/3440124421 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a70100eb0 0x7f3a70106840 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009900 tx=0x7f3a5c02a3f0 comp rx=0 tx=0).stop 2024-09-19T06:25:14.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.791+0000 7f3a77600640 1 -- 172.21.15.3:0/3440124421 shutdown_connections 2024-09-19T06:25:14.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.791+0000 7f3a77600640 1 --2- 172.21.15.3:0/3440124421 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a70106f70 0x7f3a7010eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:14.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.791+0000 7f3a77600640 1 --2- 172.21.15.3:0/3440124421 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a70100eb0 0x7f3a70106840 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:14.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.791+0000 7f3a77600640 1 --2- 172.21.15.3:0/3440124421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a70100500 0x7f3a701008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:14.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.791+0000 7f3a77600640 1 -- 172.21.15.3:0/3440124421 >> 172.21.15.3:0/3440124421 conn(0x7f3a700fc5c0 msgr2=0x7f3a700fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.792+0000 7f3a77600640 1 -- 172.21.15.3:0/3440124421 shutdown_connections 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.792+0000 7f3a77600640 1 -- 172.21.15.3:0/3440124421 wait complete. 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.792+0000 7f3a77600640 1 Processor -- start 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.793+0000 7f3a77600640 1 -- start start 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.793+0000 7f3a77600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a70100500 0x7f3a7019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.793+0000 7f3a77600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a70100eb0 0x7f3a7019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.793+0000 7f3a77600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a70106f70 0x7f3a7019ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.793+0000 7f3a77600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3a70111fe0 con 0x7f3a70100500 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.793+0000 7f3a77600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f3a70111e60 con 0x7f3a70100eb0 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.793+0000 7f3a77600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f3a70112160 con 0x7f3a70106f70 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.793+0000 7f3a74c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a70100500 0x7f3a7019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.793+0000 7f3a74c00640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a70100500 0x7f3a7019a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45204/0 (socket says 172.21.15.3:45204) 2024-09-19T06:25:14.836 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.793+0000 7f3a74c00640 1 -- 172.21.15.3:0/2644561432 learned_addr learned my addr 172.21.15.3:0/2644561432 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.793+0000 7f3a6fe00640 1 --2- 172.21.15.3:0/2644561432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a70100eb0 0x7f3a7019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.793+0000 7f3a75600640 1 --2- 172.21.15.3:0/2644561432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a70106f70 0x7f3a7019ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.794+0000 7f3a74c00640 1 -- 172.21.15.3:0/2644561432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a70106f70 msgr2=0x7f3a7019ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.794+0000 7f3a74c00640 1 --2- 172.21.15.3:0/2644561432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a70106f70 0x7f3a7019ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.794+0000 7f3a74c00640 1 -- 172.21.15.3:0/2644561432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a70100eb0 msgr2=0x7f3a7019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.794+0000 7f3a74c00640 1 --2- 172.21.15.3:0/2644561432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a70100eb0 0x7f3a7019abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.794+0000 7f3a74c00640 1 -- 172.21.15.3:0/2644561432 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a7019f630 con 0x7f3a70100500 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.794+0000 7f3a74c00640 1 --2- 172.21.15.3:0/2644561432 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a70100500 0x7f3a7019a680 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400e9c0 tx=0x7f3a6400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.794+0000 7f3a6d600640 1 -- 172.21.15.3:0/2644561432 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6400cde0 con 0x7f3a70100500 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.794+0000 7f3a6d600640 1 -- 172.21.15.3:0/2644561432 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a64010910 con 0x7f3a70100500 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.794+0000 7f3a77600640 1 -- 172.21.15.3:0/2644561432 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a7019f920 con 0x7f3a70100500 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.794+0000 7f3a6d600640 1 -- 172.21.15.3:0/2644561432 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64018a00 con 0x7f3a70100500 2024-09-19T06:25:14.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.795+0000 7f3a77600640 1 -- 172.21.15.3:0/2644561432 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a701a7200 con 0x7f3a70100500 2024-09-19T06:25:14.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.796+0000 7f3a77600640 1 -- 172.21.15.3:0/2644561432 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a701008e0 con 0x7f3a70100500 2024-09-19T06:25:14.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.797+0000 7f3a6d600640 1 -- 172.21.15.3:0/2644561432 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f3a6401f020 con 0x7f3a70100500 2024-09-19T06:25:14.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.799+0000 7f3a6d600640 1 --2- 172.21.15.3:0/2644561432 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3a580a33b0 0x7f3a580a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:14.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.799+0000 7f3a6d600640 1 -- 172.21.15.3:0/2644561432 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9001+0+0 (secure 0 0 0) 0x7f3a640d0150 con 0x7f3a70100500 2024-09-19T06:25:14.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.799+0000 7f3a6fe00640 1 --2- 172.21.15.3:0/2644561432 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3a580a33b0 0x7f3a580a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:14.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.800+0000 7f3a6fe00640 1 --2- 172.21.15.3:0/2644561432 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3a580a33b0 0x7f3a580a5870 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c02a9e0 tx=0x7f3a5c000bc0 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:14.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:14.803+0000 7f3a6d600640 1 -- 172.21.15.3:0/2644561432 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3a6409c8f0 con 0x7f3a70100500 2024-09-19T06:25:15.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:15.026+0000 7f3a77600640 1 -- 172.21.15.3:0/2644561432 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3a701a74a0 con 0x7f3a70100500 2024-09-19T06:25:15.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:15.112+0000 7f3a6d600640 1 -- 172.21.15.3:0/2644561432 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7f3a6409c1f0 con 0x7f3a70100500 2024-09-19T06:25:15.116 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:15.114+0000 7f3a77600640 1 -- 172.21.15.3:0/2644561432 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3a580a33b0 msgr2=0x7f3a580a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:15.116 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:15.114+0000 7f3a77600640 1 --2- 172.21.15.3:0/2644561432 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3a580a33b0 0x7f3a580a5870 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c02a9e0 tx=0x7f3a5c000bc0 comp rx=0 tx=0).stop 2024-09-19T06:25:15.116 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:15.114+0000 7f3a77600640 1 -- 172.21.15.3:0/2644561432 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a70100500 msgr2=0x7f3a7019a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:15.117 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:15.114+0000 7f3a77600640 1 --2- 172.21.15.3:0/2644561432 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a70100500 0x7f3a7019a680 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400e9c0 tx=0x7f3a6400ee80 comp rx=0 tx=0).stop 2024-09-19T06:25:15.117 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:15.114+0000 7f3a77600640 1 -- 172.21.15.3:0/2644561432 shutdown_connections 2024-09-19T06:25:15.117 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:15.114+0000 7f3a77600640 1 --2- 172.21.15.3:0/2644561432 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f3a580a33b0 0x7f3a580a5870 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:15.117 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:15.114+0000 7f3a77600640 1 --2- 172.21.15.3:0/2644561432 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f3a70106f70 0x7f3a7019ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:15.117 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:15.114+0000 7f3a77600640 1 --2- 172.21.15.3:0/2644561432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a70100eb0 0x7f3a7019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:15.117 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:15.114+0000 7f3a77600640 1 --2- 172.21.15.3:0/2644561432 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3a70100500 0x7f3a7019a680 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:15.117 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:15.114+0000 7f3a77600640 1 -- 172.21.15.3:0/2644561432 >> 172.21.15.3:0/2644561432 conn(0x7f3a700fc5c0 msgr2=0x7f3a701054f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:15.117 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:15.114+0000 7f3a77600640 1 -- 172.21.15.3:0/2644561432 shutdown_connections 2024-09-19T06:25:15.117 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:15.115+0000 7f3a77600640 1 -- 172.21.15.3:0/2644561432 wait complete. 2024-09-19T06:25:15.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:15 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2644561432' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:25:15.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:15 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2644561432' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:25:15.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:15 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2644561432' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:25:15.911 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T06:25:16.292 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:16.431 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:16 smithi003 ceph-mon[30893]: pgmap v403: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-19T06:25:16.432 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:16 smithi003 ceph-mon[30893]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T06:25:16.432 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:16 smithi003 ceph-mon[30893]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T06:25:16.432 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:16 smithi003 ceph-mon[30893]: Cluster is now healthy 2024-09-19T06:25:16.432 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:16 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2644561432' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:25:16.432 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:16 smithi003 ceph-mon[30893]: fsmap 12 up:standby 2024-09-19T06:25:16.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:16 smithi059 ceph-mon[35138]: pgmap v403: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-19T06:25:16.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:16 smithi059 ceph-mon[35138]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T06:25:16.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:16 smithi059 ceph-mon[35138]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T06:25:16.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:16 smithi059 ceph-mon[35138]: Cluster is now healthy 2024-09-19T06:25:16.538 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:16 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2644561432' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:25:16.539 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:16 smithi059 ceph-mon[35138]: fsmap 12 up:standby 2024-09-19T06:25:16.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:16 smithi071 ceph-mon[35662]: pgmap v403: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-19T06:25:16.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:16 smithi071 ceph-mon[35662]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T06:25:16.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:16 smithi071 ceph-mon[35662]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T06:25:16.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:16 smithi071 ceph-mon[35662]: Cluster is now healthy 2024-09-19T06:25:16.585 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:16 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2644561432' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:25:16.586 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:16 smithi071 ceph-mon[35662]: fsmap 12 up:standby 2024-09-19T06:25:16.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.899+0000 7fe86e200640 1 -- 172.21.15.3:0/3880030176 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe868076720 msgr2=0x7fe868076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:16.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.899+0000 7fe86e200640 1 --2- 172.21.15.3:0/3880030176 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe868076720 0x7fe868076b00 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fe858009900 tx=0x7fe85802a3f0 comp rx=0 tx=0).stop 2024-09-19T06:25:16.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.900+0000 7fe86e200640 1 -- 172.21.15.3:0/3880030176 shutdown_connections 2024-09-19T06:25:16.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.900+0000 7fe86e200640 1 --2- 172.21.15.3:0/3880030176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe868112a30 0x7fe868114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:16.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.900+0000 7fe86e200640 1 --2- 172.21.15.3:0/3880030176 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe868077040 0x7fe8681124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:16.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.900+0000 7fe86e200640 1 --2- 172.21.15.3:0/3880030176 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe868076720 0x7fe868076b00 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:16.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.900+0000 7fe86e200640 1 -- 172.21.15.3:0/3880030176 >> 172.21.15.3:0/3880030176 conn(0x7fe8680ffa90 msgr2=0x7fe868101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:16.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.900+0000 7fe86e200640 1 -- 172.21.15.3:0/3880030176 shutdown_connections 2024-09-19T06:25:16.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.900+0000 7fe86e200640 1 -- 172.21.15.3:0/3880030176 wait complete. 2024-09-19T06:25:16.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.901+0000 7fe86e200640 1 Processor -- start 2024-09-19T06:25:16.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.901+0000 7fe86e200640 1 -- start start 2024-09-19T06:25:16.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.902+0000 7fe86e200640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe868076720 0x7fe8681a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:16.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.902+0000 7fe86e200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe868077040 0x7fe8681a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:16.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.902+0000 7fe86e200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe868112a30 0x7fe86819e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:16.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.902+0000 7fe86e200640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe8681185a0 con 0x7fe868112a30 2024-09-19T06:25:16.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.902+0000 7fe86e200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7fe868118420 con 0x7fe868077040 2024-09-19T06:25:16.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.902+0000 7fe86e200640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7fe868118720 con 0x7fe868076720 2024-09-19T06:25:16.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.902+0000 7fe867400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe868076720 0x7fe8681a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:16.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.902+0000 7fe867400640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe868076720 0x7fe8681a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.71:3300/0 says I am v2:172.21.15.3:34276/0 (socket says 172.21.15.3:34276) 2024-09-19T06:25:16.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.902+0000 7fe867400640 1 -- 172.21.15.3:0/2663975354 learned_addr learned my addr 172.21.15.3:0/2663975354 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:25:16.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.902+0000 7fe85fe00640 1 --2- 172.21.15.3:0/2663975354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe868077040 0x7fe8681a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:16.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.902+0000 7fe867e00640 1 --2- 172.21.15.3:0/2663975354 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe868112a30 0x7fe86819e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:16.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.903+0000 7fe867400640 1 -- 172.21.15.3:0/2663975354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe868077040 msgr2=0x7fe8681a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:16.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.903+0000 7fe867400640 1 --2- 172.21.15.3:0/2663975354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe868077040 0x7fe8681a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:16.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.903+0000 7fe867400640 1 -- 172.21.15.3:0/2663975354 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe868112a30 msgr2=0x7fe86819e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:16.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.903+0000 7fe867400640 1 --2- 172.21.15.3:0/2663975354 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe868112a30 0x7fe86819e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:16.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.903+0000 7fe867400640 1 -- 172.21.15.3:0/2663975354 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86819f000 con 0x7fe868076720 2024-09-19T06:25:16.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.903+0000 7fe867400640 1 --2- 172.21.15.3:0/2663975354 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe868076720 0x7fe8681a4710 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe858006010 tx=0x7fe8580042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:16.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.903+0000 7fe864c00640 1 -- 172.21.15.3:0/2663975354 <== mon.1 v2:172.21.15.71:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85803f030 con 0x7fe868076720 2024-09-19T06:25:16.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.903+0000 7fe86e200640 1 -- 172.21.15.3:0/2663975354 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe86819f290 con 0x7fe868076720 2024-09-19T06:25:16.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.903+0000 7fe864c00640 1 -- 172.21.15.3:0/2663975354 <== mon.1 v2:172.21.15.71:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe858003ce0 con 0x7fe868076720 2024-09-19T06:25:16.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.903+0000 7fe864c00640 1 -- 172.21.15.3:0/2663975354 <== mon.1 v2:172.21.15.71:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe858035070 con 0x7fe868076720 2024-09-19T06:25:16.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.903+0000 7fe86e200640 1 -- 172.21.15.3:0/2663975354 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8681ab5e0 con 0x7fe868076720 2024-09-19T06:25:16.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.904+0000 7fe86e200640 1 -- 172.21.15.3:0/2663975354 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe868076b00 con 0x7fe868076720 2024-09-19T06:25:16.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.906+0000 7fe864c00640 1 -- 172.21.15.3:0/2663975354 <== mon.1 v2:172.21.15.71:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7fe858042030 con 0x7fe868076720 2024-09-19T06:25:16.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.908+0000 7fe864c00640 1 --2- 172.21.15.3:0/2663975354 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe84c0a33b0 0x7fe84c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:16.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.908+0000 7fe864c00640 1 -- 172.21.15.3:0/2663975354 <== mon.1 v2:172.21.15.71:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9001+0+0 (secure 0 0 0) 0x7fe8580f06d0 con 0x7fe868076720 2024-09-19T06:25:16.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.908+0000 7fe85fe00640 1 --2- 172.21.15.3:0/2663975354 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe84c0a33b0 0x7fe84c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:16.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.908+0000 7fe85fe00640 1 --2- 172.21.15.3:0/2663975354 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe84c0a33b0 0x7fe84c0a5870 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe868079300 tx=0x7fe850005f90 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:16.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:16.910+0000 7fe864c00640 1 -- 172.21.15.3:0/2663975354 <== mon.1 v2:172.21.15.71:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe8580bc8e0 con 0x7fe868076720 2024-09-19T06:25:17.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:17.098+0000 7fe86e200640 1 -- 172.21.15.3:0/2663975354 --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe86810dbc0 con 0x7fe868076720 2024-09-19T06:25:18.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:18.002+0000 7fe864c00640 1 -- 172.21.15.3:0/2663975354 <== mon.1 v2:172.21.15.71:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v105) ==== 181+0+0 (secure 0 0 0) 0x7fe8580c0be0 con 0x7fe868076720 2024-09-19T06:25:18.005 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_metadata' removed 2024-09-19T06:25:18.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:18.005+0000 7fe86e200640 1 -- 172.21.15.3:0/2663975354 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe84c0a33b0 msgr2=0x7fe84c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:18.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:18.005+0000 7fe86e200640 1 --2- 172.21.15.3:0/2663975354 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe84c0a33b0 0x7fe84c0a5870 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe868079300 tx=0x7fe850005f90 comp rx=0 tx=0).stop 2024-09-19T06:25:18.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:18.005+0000 7fe86e200640 1 -- 172.21.15.3:0/2663975354 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe868076720 msgr2=0x7fe8681a4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:18.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:18.005+0000 7fe86e200640 1 --2- 172.21.15.3:0/2663975354 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe868076720 0x7fe8681a4710 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe858006010 tx=0x7fe8580042f0 comp rx=0 tx=0).stop 2024-09-19T06:25:18.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:18.005+0000 7fe86e200640 1 -- 172.21.15.3:0/2663975354 shutdown_connections 2024-09-19T06:25:18.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:18.006+0000 7fe86e200640 1 --2- 172.21.15.3:0/2663975354 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7fe84c0a33b0 0x7fe84c0a5870 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:18.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:18.006+0000 7fe86e200640 1 --2- 172.21.15.3:0/2663975354 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe868112a30 0x7fe86819e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:18.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:18.006+0000 7fe86e200640 1 --2- 172.21.15.3:0/2663975354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe868077040 0x7fe8681a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:18.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:18.006+0000 7fe86e200640 1 --2- 172.21.15.3:0/2663975354 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7fe868076720 0x7fe8681a4710 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:18.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:18.006+0000 7fe86e200640 1 -- 172.21.15.3:0/2663975354 >> 172.21.15.3:0/2663975354 conn(0x7fe8680ffa90 msgr2=0x7fe868101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:18.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:18.006+0000 7fe86e200640 1 -- 172.21.15.3:0/2663975354 shutdown_connections 2024-09-19T06:25:18.008 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:18.006+0000 7fe86e200640 1 -- 172.21.15.3:0/2663975354 wait complete. 2024-09-19T06:25:18.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:17 smithi059 ceph-mon[35138]: pgmap v404: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:25:18.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:17 smithi059 ceph-mon[35138]: osdmap e104: 12 total, 12 up, 12 in 2024-09-19T06:25:18.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:17 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/2663975354' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:25:18.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:17 smithi059 ceph-mon[35138]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:25:18.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:17 smithi003 ceph-mon[30893]: pgmap v404: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:25:18.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:17 smithi003 ceph-mon[30893]: osdmap e104: 12 total, 12 up, 12 in 2024-09-19T06:25:18.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:17 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/2663975354' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:25:18.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:17 smithi003 ceph-mon[30893]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:25:18.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:17 smithi071 ceph-mon[35662]: pgmap v404: 97 pgs: 97 active+clean; 3.5 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T06:25:18.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:17 smithi071 ceph-mon[35662]: osdmap e104: 12 total, 12 up, 12 in 2024-09-19T06:25:18.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:17 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/2663975354' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:25:18.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:17 smithi071 ceph-mon[35662]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:25:18.867 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 782a5144-764c-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T06:25:19.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:19 smithi003 ceph-mon[30893]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:25:19.084 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:19 smithi003 ceph-mon[30893]: osdmap e105: 12 total, 12 up, 12 in 2024-09-19T06:25:19.254 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T06:25:19.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:19 smithi059 ceph-mon[35138]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:25:19.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:19 smithi059 ceph-mon[35138]: osdmap e105: 12 total, 12 up, 12 in 2024-09-19T06:25:19.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:19 smithi071 ceph-mon[35662]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:25:19.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:19 smithi071 ceph-mon[35662]: osdmap e105: 12 total, 12 up, 12 in 2024-09-19T06:25:19.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.800+0000 7f9a44600640 1 -- 172.21.15.3:0/1692764594 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a3c1049c0 msgr2=0x7f9a3c108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:19.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.800+0000 7f9a44600640 1 --2- 172.21.15.3:0/1692764594 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a3c1049c0 0x7f9a3c108a10 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009900 tx=0x7f9a2802a410 comp rx=0 tx=0).stop 2024-09-19T06:25:19.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.800+0000 7f9a44600640 1 -- 172.21.15.3:0/1692764594 shutdown_connections 2024-09-19T06:25:19.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.800+0000 7f9a44600640 1 --2- 172.21.15.3:0/1692764594 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a3c109140 0x7f9a3c110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:19.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.800+0000 7f9a44600640 1 --2- 172.21.15.3:0/1692764594 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a3c1049c0 0x7f9a3c108a10 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:19.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.800+0000 7f9a44600640 1 --2- 172.21.15.3:0/1692764594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a3c104010 0x7f9a3c1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:19.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.800+0000 7f9a44600640 1 -- 172.21.15.3:0/1692764594 >> 172.21.15.3:0/1692764594 conn(0x7f9a3c0ffa50 msgr2=0x7f9a3c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:19.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.800+0000 7f9a44600640 1 -- 172.21.15.3:0/1692764594 shutdown_connections 2024-09-19T06:25:19.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.800+0000 7f9a44600640 1 -- 172.21.15.3:0/1692764594 wait complete. 2024-09-19T06:25:19.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.801+0000 7f9a44600640 1 Processor -- start 2024-09-19T06:25:19.804 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.801+0000 7f9a44600640 1 -- start start 2024-09-19T06:25:19.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.802+0000 7f9a44600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a3c104010 0x7f9a3c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:19.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.802+0000 7f9a44600640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a3c1049c0 0x7f9a3c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:19.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.802+0000 7f9a44600640 1 --2- >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a3c109140 0x7f9a3c19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:19.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.802+0000 7f9a44600640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3c114160 con 0x7f9a3c1049c0 2024-09-19T06:25:19.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.802+0000 7f9a44600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3c113fe0 con 0x7f9a3c104010 2024-09-19T06:25:19.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.802+0000 7f9a44600640 1 -- --> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3c1142e0 con 0x7f9a3c109140 2024-09-19T06:25:19.806 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.802+0000 7f9a41200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a3c1049c0 0x7f9a3c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:19.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.802+0000 7f9a41c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a3c104010 0x7f9a3c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:19.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.802+0000 7f9a41200640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a3c1049c0 0x7f9a3c19ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45228/0 (socket says 172.21.15.3:45228) 2024-09-19T06:25:19.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.802+0000 7f9a41200640 1 -- 172.21.15.3:0/1967272570 learned_addr learned my addr 172.21.15.3:0/1967272570 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-19T06:25:19.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.802+0000 7f9a42600640 1 --2- 172.21.15.3:0/1967272570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a3c109140 0x7f9a3c19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:19.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.803+0000 7f9a41c00640 1 -- 172.21.15.3:0/1967272570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a3c109140 msgr2=0x7f9a3c19ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:19.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.803+0000 7f9a41c00640 1 --2- 172.21.15.3:0/1967272570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a3c109140 0x7f9a3c19ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:19.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.803+0000 7f9a41c00640 1 -- 172.21.15.3:0/1967272570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a3c1049c0 msgr2=0x7f9a3c19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:19.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.803+0000 7f9a41c00640 1 --2- 172.21.15.3:0/1967272570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a3c1049c0 0x7f9a3c19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:19.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.803+0000 7f9a41c00640 1 -- 172.21.15.3:0/1967272570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a3c19f5f0 con 0x7f9a3c104010 2024-09-19T06:25:19.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.803+0000 7f9a41c00640 1 --2- 172.21.15.3:0/1967272570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a3c104010 0x7f9a3c19a640 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000eb00 tx=0x7f9a3000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:19.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.803+0000 7f9a3a000640 1 -- 172.21.15.3:0/1967272570 <== mon.2 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a30010430 con 0x7f9a3c104010 2024-09-19T06:25:19.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.803+0000 7f9a44600640 1 -- 172.21.15.3:0/1967272570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a3c19f8e0 con 0x7f9a3c104010 2024-09-19T06:25:19.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.803+0000 7f9a3a000640 1 -- 172.21.15.3:0/1967272570 <== mon.2 v2:172.21.15.59:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a30010ab0 con 0x7f9a3c104010 2024-09-19T06:25:19.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.803+0000 7f9a3a000640 1 -- 172.21.15.3:0/1967272570 <== mon.2 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a30017bb0 con 0x7f9a3c104010 2024-09-19T06:25:19.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.804+0000 7f9a44600640 1 -- 172.21.15.3:0/1967272570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a3c1a71c0 con 0x7f9a3c104010 2024-09-19T06:25:19.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.805+0000 7f9a44600640 1 -- 172.21.15.3:0/1967272570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a3c1043f0 con 0x7f9a3c104010 2024-09-19T06:25:19.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.807+0000 7f9a3a000640 1 -- 172.21.15.3:0/1967272570 <== mon.2 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 27) ==== 138485+0+0 (secure 0 0 0) 0x7f9a30010c60 con 0x7f9a3c104010 2024-09-19T06:25:19.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.808+0000 7f9a3a000640 1 --2- 172.21.15.3:0/1967272570 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9a240a33b0 0x7f9a240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:25:19.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.808+0000 7f9a3a000640 1 -- 172.21.15.3:0/1967272570 <== mon.2 v2:172.21.15.59:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8374+0+0 (secure 0 0 0) 0x7f9a300d08f0 con 0x7f9a3c104010 2024-09-19T06:25:19.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.808+0000 7f9a41200640 1 --2- 172.21.15.3:0/1967272570 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9a240a33b0 0x7f9a240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:25:19.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.809+0000 7f9a41200640 1 --2- 172.21.15.3:0/1967272570 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9a240a33b0 0x7f9a240a5870 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9a28031550 tx=0x7f9a28005a20 comp rx=0 tx=0).ready entity=mgr.15126 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:25:19.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.810+0000 7f9a3a000640 1 -- 172.21.15.3:0/1967272570 <== mon.2 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9a3009d300 con 0x7f9a3c104010 2024-09-19T06:25:20.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:19.998+0000 7f9a44600640 1 -- 172.21.15.3:0/1967272570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9a3c10c3b0 con 0x7f9a3c104010 2024-09-19T06:25:20.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:20.012+0000 7f9a3a000640 1 -- 172.21.15.3:0/1967272570 <== mon.2 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v106) ==== 169+0+0 (secure 0 0 0) 0x7f9a3009cc00 con 0x7f9a3c104010 2024-09-19T06:25:20.014 INFO:teuthology.orchestra.run.smithi003.stderr:pool 'cephfs_data' removed 2024-09-19T06:25:20.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:20.015+0000 7f9a44600640 1 -- 172.21.15.3:0/1967272570 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9a240a33b0 msgr2=0x7f9a240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:20.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:20.015+0000 7f9a44600640 1 --2- 172.21.15.3:0/1967272570 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9a240a33b0 0x7f9a240a5870 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9a28031550 tx=0x7f9a28005a20 comp rx=0 tx=0).stop 2024-09-19T06:25:20.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:20.015+0000 7f9a44600640 1 -- 172.21.15.3:0/1967272570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a3c104010 msgr2=0x7f9a3c19a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:25:20.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:20.015+0000 7f9a44600640 1 --2- 172.21.15.3:0/1967272570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a3c104010 0x7f9a3c19a640 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000eb00 tx=0x7f9a3000c2d0 comp rx=0 tx=0).stop 2024-09-19T06:25:20.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:20.015+0000 7f9a44600640 1 -- 172.21.15.3:0/1967272570 shutdown_connections 2024-09-19T06:25:20.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:20.015+0000 7f9a44600640 1 --2- 172.21.15.3:0/1967272570 >> [v2:172.21.15.3:6800/3015970538,v1:172.21.15.3:6801/3015970538] conn(0x7f9a240a33b0 0x7f9a240a5870 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:20.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:20.015+0000 7f9a44600640 1 --2- 172.21.15.3:0/1967272570 >> [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] conn(0x7f9a3c109140 0x7f9a3c19ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:20.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:20.015+0000 7f9a44600640 1 --2- 172.21.15.3:0/1967272570 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a3c1049c0 0x7f9a3c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:20.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:20.015+0000 7f9a44600640 1 --2- 172.21.15.3:0/1967272570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a3c104010 0x7f9a3c19a640 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:25:20.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:20.015+0000 7f9a44600640 1 -- 172.21.15.3:0/1967272570 >> 172.21.15.3:0/1967272570 conn(0x7f9a3c0ffa50 msgr2=0x7f9a3c100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:25:20.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:20.015+0000 7f9a44600640 1 -- 172.21.15.3:0/1967272570 shutdown_connections 2024-09-19T06:25:20.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-19T06:25:20.016+0000 7f9a44600640 1 -- 172.21.15.3:0/1967272570 wait complete. 2024-09-19T06:25:20.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:20 smithi059 ceph-mon[35138]: pgmap v407: 65 pgs: 65 active+clean; 577 KiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:25:20.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:20 smithi059 ceph-mon[35138]: from='client.? 172.21.15.3:0/1967272570' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:25:20.289 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:20 smithi059 ceph-mon[35138]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:25:20.334 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:20 smithi003 ceph-mon[30893]: pgmap v407: 65 pgs: 65 active+clean; 577 KiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:25:20.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:20 smithi003 ceph-mon[30893]: from='client.? 172.21.15.3:0/1967272570' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:25:20.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:20 smithi003 ceph-mon[30893]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:25:20.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:20 smithi071 ceph-mon[35662]: pgmap v407: 65 pgs: 65 active+clean; 577 KiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T06:25:20.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:20 smithi071 ceph-mon[35662]: from='client.? 172.21.15.3:0/1967272570' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:25:20.335 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:20 smithi071 ceph-mon[35662]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T06:25:20.805 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:25:20.863 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:25:20.894 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:25:20.928 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T06:25:20.929 DEBUG:teuthology.orchestra.run.smithi003:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T06:25:20.964 DEBUG:teuthology.orchestra.run.smithi059:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T06:25:20.980 DEBUG:teuthology.orchestra.run.smithi071:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T06:25:20.996 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T06:25:20.996 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T06:25:20.996 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@mon.a 2024-09-19T06:25:21.053 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:21 smithi003 ceph-mon[30893]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:25:21.054 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:21 smithi003 ceph-mon[30893]: osdmap e106: 12 total, 12 up, 12 in 2024-09-19T06:25:21.146 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:21 smithi059 ceph-mon[35138]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:25:21.146 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:21 smithi059 ceph-mon[35138]: osdmap e106: 12 total, 12 up, 12 in 2024-09-19T06:25:21.175 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:21 smithi071 ceph-mon[35662]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T06:25:21.175 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:21 smithi071 ceph-mon[35662]: osdmap e106: 12 total, 12 up, 12 in 2024-09-19T06:25:21.335 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:21 smithi003 systemd[1]: Stopping Ceph mon.a for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:25:21.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:21 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-a[30889]: 2024-09-19T06:25:21.413+0000 7f06e3800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:25:21.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:21 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-a[30889]: 2024-09-19T06:25:21.413+0000 7f06e3800640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T06:25:21.835 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:21 smithi003 podman[114188]: 2024-09-19 06:25:21.516746127 +0000 UTC m=+0.228864717 container died c484d090f876bf3243c8a5eb47ac5d61b40cd72bbed66eb09d7b03ab273bfef4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T06:25:22.247 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:22 smithi003 podman[114188]: 2024-09-19 06:25:22.019230301 +0000 UTC m=+0.731348901 container cleanup c484d090f876bf3243c8a5eb47ac5d61b40cd72bbed66eb09d7b03ab273bfef4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True) 2024-09-19T06:25:22.247 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:22 smithi003 bash[114188]: ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-a 2024-09-19T06:25:22.505 INFO:journalctl@ceph.mon.a.smithi003.stdout:Sep 19 06:25:22 smithi003 podman[114200]: 2024-09-19 06:25:22.245992743 +0000 UTC m=+0.715112944 container remove c484d090f876bf3243c8a5eb47ac5d61b40cd72bbed66eb09d7b03ab273bfef4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T06:25:22.531 DEBUG:teuthology.orchestra.run.smithi003:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T06:25:22.632 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:25:22.632 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T06:25:22.632 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T06:25:22.633 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@mon.b 2024-09-19T06:25:22.985 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:22 smithi059 systemd[1]: Stopping Ceph mon.b for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:25:23.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:22 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-b[35134]: 2024-09-19T06:25:22.983+0000 7f4716dbf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:25:23.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:22 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-b[35134]: 2024-09-19T06:25:22.983+0000 7f4716dbf640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T06:25:23.288 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:23 smithi059 podman[70880]: 2024-09-19 06:25:23.188113725 +0000 UTC m=+0.357608811 container died db4bd5ba039d6bc67cdb6ca556975ff54e42251d9e972ebd417d5e570d0dbffe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-b, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T06:25:23.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:23 smithi059 podman[70880]: 2024-09-19 06:25:23.600523854 +0000 UTC m=+0.770018928 container cleanup db4bd5ba039d6bc67cdb6ca556975ff54e42251d9e972ebd417d5e570d0dbffe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T06:25:23.788 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:23 smithi059 bash[70880]: ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-b 2024-09-19T06:25:24.080 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T06:25:24.102 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:23 smithi059 podman[70892]: 2024-09-19 06:25:23.835649767 +0000 UTC m=+0.648133933 container remove db4bd5ba039d6bc67cdb6ca556975ff54e42251d9e972ebd417d5e570d0dbffe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T06:25:24.102 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:24 smithi059 systemd[1]: ceph-782a5144-764c-11ef-bceb-c7b262605968@mon.b.service: Deactivated successfully. 2024-09-19T06:25:24.102 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:24 smithi059 systemd[1]: Stopped Ceph mon.b for 782a5144-764c-11ef-bceb-c7b262605968. 2024-09-19T06:25:24.102 INFO:journalctl@ceph.mon.b.smithi059.stdout:Sep 19 06:25:24 smithi059 systemd[1]: ceph-782a5144-764c-11ef-bceb-c7b262605968@mon.b.service: Consumed 14.758s CPU time. 2024-09-19T06:25:24.126 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:25:24.126 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T06:25:24.126 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T06:25:24.126 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@mon.c 2024-09-19T06:25:24.468 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:24 smithi071 systemd[1]: Stopping Ceph mon.c for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:25:24.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:24 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-c[35658]: 2024-09-19T06:25:24.467+0000 7f7b934d5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:25:24.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:24 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-c[35658]: 2024-09-19T06:25:24.467+0000 7f7b934d5640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T06:25:24.835 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:24 smithi071 podman[72502]: 2024-09-19 06:25:24.661150594 +0000 UTC m=+0.334035508 container died f634a5a1238bdb84e646e2892e8860ffc793b022a567add691cca11f1a4984ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-c, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-19T06:25:25.320 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:25 smithi071 podman[72502]: 2024-09-19 06:25:25.059272757 +0000 UTC m=+0.732157670 container cleanup f634a5a1238bdb84e646e2892e8860ffc793b022a567add691cca11f1a4984ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-c, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T06:25:25.320 INFO:journalctl@ceph.mon.c.smithi071.stdout:Sep 19 06:25:25 smithi071 bash[72502]: ceph-782a5144-764c-11ef-bceb-c7b262605968-mon-c 2024-09-19T06:25:25.484 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T06:25:25.580 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:25:25.580 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T06:25:25.580 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T06:25:25.581 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@mgr.x 2024-09-19T06:25:26.013 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:25:25 smithi003 systemd[1]: Stopping Ceph mgr.x for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:25:26.013 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:25:26 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:25:26.009+0000 7ff79b400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:25:26.013 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:25:26 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x[31119]: 2024-09-19T06:25:26.009+0000 7ff79b400640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-19T06:25:26.335 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:25:26 smithi003 podman[114312]: 2024-09-19 06:25:26.092647809 +0000 UTC m=+0.211586910 container died 0f74198e9686a8bed7eb9acadd741dde754cad3fdc08b0479d9154539045864a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T06:25:26.827 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:25:26 smithi003 podman[114312]: 2024-09-19 06:25:26.5999387 +0000 UTC m=+0.718877798 container cleanup 0f74198e9686a8bed7eb9acadd741dde754cad3fdc08b0479d9154539045864a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T06:25:26.827 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:25:26 smithi003 bash[114312]: ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x 2024-09-19T06:25:27.080 INFO:journalctl@ceph.mgr.x.smithi003.stdout:Sep 19 06:25:26 smithi003 podman[114323]: 2024-09-19 06:25:26.826427885 +0000 UTC m=+0.721663653 container remove 0f74198e9686a8bed7eb9acadd741dde754cad3fdc08b0479d9154539045864a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:25:27.106 DEBUG:teuthology.orchestra.run.smithi003:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T06:25:27.180 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:25:27.180 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T06:25:27.181 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T06:25:27.181 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@mgr.y 2024-09-19T06:25:27.535 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:25:27 smithi059 systemd[1]: Stopping Ceph mgr.y for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:25:27.788 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:25:27 smithi059 podman[71005]: 2024-09-19 06:25:27.534753279 +0000 UTC m=+0.159012963 container died 98ccaf64235e62b4d34cb1472c5e39d50ef4be0270d3ddfd0261fa3f6d954f84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T06:25:28.200 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:25:27 smithi059 podman[71005]: 2024-09-19 06:25:27.931296233 +0000 UTC m=+0.555555907 container cleanup 98ccaf64235e62b4d34cb1472c5e39d50ef4be0270d3ddfd0261fa3f6d954f84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:25:28.201 INFO:journalctl@ceph.mgr.y.smithi059.stdout:Sep 19 06:25:27 smithi059 bash[71005]: ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-y 2024-09-19T06:25:28.370 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T06:25:28.404 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:25:28.405 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T06:25:28.405 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T06:25:28.405 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@mgr.z 2024-09-19T06:25:28.736 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:25:28 smithi071 systemd[1]: Stopping Ceph mgr.z for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:25:29.024 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:25:28 smithi071 podman[72622]: 2024-09-19 06:25:28.735316167 +0000 UTC m=+0.132313151 container died c9c913e309fb94b138b61b8fcc26258caf4f27c77039e0604c51850a800c8a2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T06:25:29.335 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:25:29 smithi071 podman[72622]: 2024-09-19 06:25:29.123323915 +0000 UTC m=+0.520320896 container cleanup c9c913e309fb94b138b61b8fcc26258caf4f27c77039e0604c51850a800c8a2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T06:25:29.335 INFO:journalctl@ceph.mgr.z.smithi071.stdout:Sep 19 06:25:29 smithi071 bash[72622]: ceph-782a5144-764c-11ef-bceb-c7b262605968-mgr-z 2024-09-19T06:25:29.499 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T06:25:29.533 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:25:29.533 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T06:25:29.533 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T06:25:29.533 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.0 2024-09-19T06:25:29.967 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:25:29 smithi003 systemd[1]: Stopping Ceph osd.0 for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:25:30.299 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:25:29 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-0[45244]: 2024-09-19T06:25:29.964+0000 7f28d3600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:25:30.299 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:25:29 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-0[45244]: 2024-09-19T06:25:29.964+0000 7f28d3600640 -1 osd.0 106 *** Got signal Terminated *** 2024-09-19T06:25:30.299 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:25:29 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-0[45244]: 2024-09-19T06:25:29.964+0000 7f28d3600640 -1 osd.0 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:25:35.835 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:25:35 smithi003 podman[114431]: 2024-09-19 06:25:35.516691131 +0000 UTC m=+5.688448809 container died 239c7b5837fc72380cf383c9c549479345486adfab5edd5f020b450ab3f82a81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:25:36.120 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:25:36 smithi003 podman[114431]: 2024-09-19 06:25:36.114453915 +0000 UTC m=+6.286211591 container cleanup 239c7b5837fc72380cf383c9c549479345486adfab5edd5f020b450ab3f82a81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:25:36.120 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:25:36 smithi003 bash[114431]: ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-0 2024-09-19T06:25:36.834 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:25:36 smithi003 podman[114463]: 2024-09-19 06:25:36.468014745 +0000 UTC m=+0.935017270 container remove 239c7b5837fc72380cf383c9c549479345486adfab5edd5f020b450ab3f82a81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T06:25:37.334 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:25:37 smithi003 podman[114550]: 2024-09-19 06:25:36.956444517 +0000 UTC m=+0.027506208 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:25:37.334 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:25:37 smithi003 podman[114550]: 2024-09-19 06:25:37.100205236 +0000 UTC m=+0.171266925 container create c1db0ea9d69b2387438e00fded47043389ea0cdf26e5ee6ed0f77029d1237dc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T06:25:37.643 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:25:37 smithi003 podman[114550]: 2024-09-19 06:25:37.375456798 +0000 UTC m=+0.446518489 container init c1db0ea9d69b2387438e00fded47043389ea0cdf26e5ee6ed0f77029d1237dc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:25:37.643 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:25:37 smithi003 podman[114550]: 2024-09-19 06:25:37.382515647 +0000 UTC m=+0.453577348 container start c1db0ea9d69b2387438e00fded47043389ea0cdf26e5ee6ed0f77029d1237dc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T06:25:37.643 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:25:37 smithi003 podman[114550]: 2024-09-19 06:25:37.49047676 +0000 UTC m=+0.561538460 container attach c1db0ea9d69b2387438e00fded47043389ea0cdf26e5ee6ed0f77029d1237dc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:25:38.048 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 19 06:25:37 smithi003 podman[114550]: 2024-09-19 06:25:37.642348341 +0000 UTC m=+0.713410031 container died c1db0ea9d69b2387438e00fded47043389ea0cdf26e5ee6ed0f77029d1237dc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:25:38.533 DEBUG:teuthology.orchestra.run.smithi003:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T06:25:38.612 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:25:38.613 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T06:25:38.613 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T06:25:38.613 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.1 2024-09-19T06:25:38.937 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:25:38 smithi059 systemd[1]: Stopping Ceph osd.1 for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:25:39.288 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:25:38 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-1[39588]: 2024-09-19T06:25:38.935+0000 7ff8cb4a8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:25:39.288 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:25:38 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-1[39588]: 2024-09-19T06:25:38.935+0000 7ff8cb4a8640 -1 osd.1 106 *** Got signal Terminated *** 2024-09-19T06:25:39.288 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:25:38 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-1[39588]: 2024-09-19T06:25:38.935+0000 7ff8cb4a8640 -1 osd.1 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:25:44.771 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:25:44 smithi059 podman[71132]: 2024-09-19 06:25:44.478011648 +0000 UTC m=+5.669825525 container died 7e462337ccb1a8e208c2da374b95df4afc1dad854d4bd7a4761bd96cfe9e4bd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T06:25:45.038 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:25:44 smithi059 podman[71132]: 2024-09-19 06:25:44.994622586 +0000 UTC m=+6.186436462 container cleanup 7e462337ccb1a8e208c2da374b95df4afc1dad854d4bd7a4761bd96cfe9e4bd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T06:25:45.038 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:25:44 smithi059 bash[71132]: ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-1 2024-09-19T06:25:45.538 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:25:45 smithi059 podman[71148]: 2024-09-19 06:25:45.212834427 +0000 UTC m=+0.732607796 container remove 7e462337ccb1a8e208c2da374b95df4afc1dad854d4bd7a4761bd96cfe9e4bd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-19T06:25:45.909 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:25:45 smithi059 podman[71237]: 2024-09-19 06:25:45.525073446 +0000 UTC m=+0.015606865 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:25:45.909 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:25:45 smithi059 podman[71237]: 2024-09-19 06:25:45.655408388 +0000 UTC m=+0.145941847 container create d0a8eaa10e00c72d4b93b0ccaf1d537e796a350e6213c6641f02ae02b83abcb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T06:25:46.289 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:25:45 smithi059 podman[71237]: 2024-09-19 06:25:45.908409373 +0000 UTC m=+0.398942797 container init d0a8eaa10e00c72d4b93b0ccaf1d537e796a350e6213c6641f02ae02b83abcb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T06:25:46.289 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:25:45 smithi059 podman[71237]: 2024-09-19 06:25:45.911791502 +0000 UTC m=+0.402324923 container start d0a8eaa10e00c72d4b93b0ccaf1d537e796a350e6213c6641f02ae02b83abcb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:25:46.289 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:25:46 smithi059 podman[71237]: 2024-09-19 06:25:46.033403071 +0000 UTC m=+0.523936494 container attach d0a8eaa10e00c72d4b93b0ccaf1d537e796a350e6213c6641f02ae02b83abcb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T06:25:46.289 INFO:journalctl@ceph.osd.1.smithi059.stdout:Sep 19 06:25:46 smithi059 podman[71237]: 2024-09-19 06:25:46.100648222 +0000 UTC m=+0.591181639 container died d0a8eaa10e00c72d4b93b0ccaf1d537e796a350e6213c6641f02ae02b83abcb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:25:46.906 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T06:25:46.945 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:25:46.945 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T06:25:46.945 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T06:25:46.945 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.2 2024-09-19T06:25:47.260 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:25:46 smithi071 systemd[1]: Stopping Ceph osd.2 for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:25:47.585 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:25:47 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-2[40617]: 2024-09-19T06:25:47.259+0000 7f5dac31c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:25:47.585 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:25:47 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-2[40617]: 2024-09-19T06:25:47.259+0000 7f5dac31c640 -1 osd.2 106 *** Got signal Terminated *** 2024-09-19T06:25:47.585 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:25:47 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-2[40617]: 2024-09-19T06:25:47.259+0000 7f5dac31c640 -1 osd.2 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:25:53.045 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:25:52 smithi071 podman[72748]: 2024-09-19 06:25:52.758715686 +0000 UTC m=+5.614905011 container died 59320f4f769744c9179fcfd62c1245c9bdc56943f5b3794ad088bbee9aa33c66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T06:25:53.335 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:25:53 smithi071 podman[72748]: 2024-09-19 06:25:53.142715588 +0000 UTC m=+5.998904920 container cleanup 59320f4f769744c9179fcfd62c1245c9bdc56943f5b3794ad088bbee9aa33c66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T06:25:53.335 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:25:53 smithi071 bash[72748]: ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-2 2024-09-19T06:25:53.704 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:25:53 smithi071 podman[72764]: 2024-09-19 06:25:53.386214006 +0000 UTC m=+0.625363546 container remove 59320f4f769744c9179fcfd62c1245c9bdc56943f5b3794ad088bbee9aa33c66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T06:25:53.965 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:25:53 smithi071 podman[72853]: 2024-09-19 06:25:53.703735707 +0000 UTC m=+0.108851613 container create 08771c921e886654af178b92dcd05e9be69780a61b5b59273255f548514f8085 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:25:53.966 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:25:53 smithi071 podman[72853]: 2024-09-19 06:25:53.611086612 +0000 UTC m=+0.016202526 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:25:54.336 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:25:53 smithi071 podman[72853]: 2024-09-19 06:25:53.965273928 +0000 UTC m=+0.370389834 container init 08771c921e886654af178b92dcd05e9be69780a61b5b59273255f548514f8085 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T06:25:54.336 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:25:53 smithi071 podman[72853]: 2024-09-19 06:25:53.968827265 +0000 UTC m=+0.373943169 container start 08771c921e886654af178b92dcd05e9be69780a61b5b59273255f548514f8085 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T06:25:54.336 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:25:54 smithi071 podman[72853]: 2024-09-19 06:25:54.057008502 +0000 UTC m=+0.462124433 container attach 08771c921e886654af178b92dcd05e9be69780a61b5b59273255f548514f8085 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:25:54.336 INFO:journalctl@ceph.osd.2.smithi071.stdout:Sep 19 06:25:54 smithi071 podman[72853]: 2024-09-19 06:25:54.156273926 +0000 UTC m=+0.561389839 container died 08771c921e886654af178b92dcd05e9be69780a61b5b59273255f548514f8085 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T06:25:54.812 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T06:25:54.851 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:25:54.852 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T06:25:54.852 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T06:25:54.852 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.3 2024-09-19T06:25:55.289 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 19 06:25:54 smithi003 systemd[1]: Stopping Ceph osd.3 for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:25:55.585 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 19 06:25:55 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-3[52155]: 2024-09-19T06:25:55.286+0000 7f1a05a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:25:55.585 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 19 06:25:55 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-3[52155]: 2024-09-19T06:25:55.286+0000 7f1a05a00640 -1 osd.3 106 *** Got signal Terminated *** 2024-09-19T06:25:55.585 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 19 06:25:55 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-3[52155]: 2024-09-19T06:25:55.286+0000 7f1a05a00640 -1 osd.3 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:25:56.538 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:25:56 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4[46165]: 2024-09-19T06:25:56.189+0000 7f149079f640 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.790475+0000 front 2024-09-19T06:25:32.790298+0000 (oldest deadline 2024-09-19T06:25:55.690228+0000) 2024-09-19T06:25:56.835 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:25:56 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:25:56.401+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:25:56.835 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:25:56 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:25:56.581+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:33.423479+0000 front 2024-09-19T06:25:33.423506+0000 (oldest deadline 2024-09-19T06:25:56.323485+0000) 2024-09-19T06:25:57.538 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:25:57 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4[46165]: 2024-09-19T06:25:57.170+0000 7f149079f640 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.790475+0000 front 2024-09-19T06:25:32.790298+0000 (oldest deadline 2024-09-19T06:25:55.690228+0000) 2024-09-19T06:25:57.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:25:57 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:25:57.119+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:25:57.834 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:25:57 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:25:57.356+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:25:57.835 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:25:57 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:25:57.560+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:33.423479+0000 front 2024-09-19T06:25:33.423506+0000 (oldest deadline 2024-09-19T06:25:56.323485+0000) 2024-09-19T06:25:58.299 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:25:57 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:25:57.939+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:25:58.538 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:25:58 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4[46165]: 2024-09-19T06:25:58.208+0000 7f149079f640 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.790475+0000 front 2024-09-19T06:25:32.790298+0000 (oldest deadline 2024-09-19T06:25:55.690228+0000) 2024-09-19T06:25:58.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:25:58 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:25:58.137+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:25:58.585 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 19 06:25:58 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-3[52155]: 2024-09-19T06:25:58.298+0000 7f19fc400640 -1 osd.3 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:33.552830+0000 front 2024-09-19T06:25:33.552885+0000 (oldest deadline 2024-09-19T06:25:58.252962+0000) 2024-09-19T06:25:58.586 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:25:58 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:25:58.349+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:25:58.835 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:25:58 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:25:58.553+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:33.423479+0000 front 2024-09-19T06:25:33.423506+0000 (oldest deadline 2024-09-19T06:25:56.323485+0000) 2024-09-19T06:25:59.254 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:25:58 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:25:58.980+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:25:59.538 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:25:59 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4[46165]: 2024-09-19T06:25:59.221+0000 7f149079f640 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.790475+0000 front 2024-09-19T06:25:32.790298+0000 (oldest deadline 2024-09-19T06:25:55.690228+0000) 2024-09-19T06:25:59.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:25:59 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:25:59.136+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:25:59.584 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 19 06:25:59 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-3[52155]: 2024-09-19T06:25:59.253+0000 7f19fc400640 -1 osd.3 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:33.552830+0000 front 2024-09-19T06:25:33.552885+0000 (oldest deadline 2024-09-19T06:25:58.252962+0000) 2024-09-19T06:25:59.584 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:25:59 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:25:59.369+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:25:59.835 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:25:59 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:25:59.530+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:33.423479+0000 front 2024-09-19T06:25:33.423506+0000 (oldest deadline 2024-09-19T06:25:56.323485+0000) 2024-09-19T06:26:00.286 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:00 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:25:59.999+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:00.538 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:26:00 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4[46165]: 2024-09-19T06:26:00.262+0000 7f149079f640 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.790475+0000 front 2024-09-19T06:25:32.790298+0000 (oldest deadline 2024-09-19T06:25:55.690228+0000) 2024-09-19T06:26:00.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:00 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:00.132+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:00.584 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 19 06:26:00 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-3[52155]: 2024-09-19T06:26:00.285+0000 7f19fc400640 -1 osd.3 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:33.552830+0000 front 2024-09-19T06:25:33.552885+0000 (oldest deadline 2024-09-19T06:25:58.252962+0000) 2024-09-19T06:26:00.584 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:00 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:00.339+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:00.835 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:00 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:00.513+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:33.423479+0000 front 2024-09-19T06:25:33.423506+0000 (oldest deadline 2024-09-19T06:25:56.323485+0000) 2024-09-19T06:26:00.984 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 19 06:26:00 smithi003 podman[114650]: 2024-09-19 06:26:00.657822344 +0000 UTC m=+5.507163540 container died be8e2ea0992ad181b8ef2e71c88d222b30708da8250134a13e06f115a10254bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T06:26:01.260 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:00 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:00.982+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:01.538 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:26:01 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4[46165]: 2024-09-19T06:26:01.297+0000 7f149079f640 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.790475+0000 front 2024-09-19T06:25:32.790298+0000 (oldest deadline 2024-09-19T06:25:55.690228+0000) 2024-09-19T06:26:01.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:01 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:01.164+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:01.584 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:01 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:01.334+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:01.585 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 19 06:26:01 smithi003 podman[114650]: 2024-09-19 06:26:01.259506757 +0000 UTC m=+6.108847951 container cleanup be8e2ea0992ad181b8ef2e71c88d222b30708da8250134a13e06f115a10254bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T06:26:01.585 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 19 06:26:01 smithi003 bash[114650]: ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-3 2024-09-19T06:26:01.585 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 19 06:26:01 smithi003 podman[114677]: 2024-09-19 06:26:01.486497587 +0000 UTC m=+0.822148621 container remove be8e2ea0992ad181b8ef2e71c88d222b30708da8250134a13e06f115a10254bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:26:01.835 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:01 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:01.492+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:33.423479+0000 front 2024-09-19T06:25:33.423506+0000 (oldest deadline 2024-09-19T06:25:56.323485+0000) 2024-09-19T06:26:01.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:01 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:01.491+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:02.251 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:01 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:01.975+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:02.251 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 19 06:26:02 smithi003 podman[114766]: 2024-09-19 06:26:01.953003192 +0000 UTC m=+0.027368313 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:26:02.251 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 19 06:26:02 smithi003 podman[114766]: 2024-09-19 06:26:02.11241626 +0000 UTC m=+0.186781381 container create 7743d4ff0834a9dd5a46d42ea2b6f965dc0dd625788d3e929cba26ae4713a7e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T06:26:02.538 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:26:02 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4[46165]: 2024-09-19T06:26:02.309+0000 7f149079f640 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.790475+0000 front 2024-09-19T06:25:32.790298+0000 (oldest deadline 2024-09-19T06:25:55.690228+0000) 2024-09-19T06:26:02.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:02 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:02.126+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:02.585 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:02 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:02.290+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:02.586 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 19 06:26:02 smithi003 podman[114766]: 2024-09-19 06:26:02.373678797 +0000 UTC m=+0.448043918 container init 7743d4ff0834a9dd5a46d42ea2b6f965dc0dd625788d3e929cba26ae4713a7e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T06:26:02.586 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 19 06:26:02 smithi003 podman[114766]: 2024-09-19 06:26:02.380429285 +0000 UTC m=+0.454794415 container start 7743d4ff0834a9dd5a46d42ea2b6f965dc0dd625788d3e929cba26ae4713a7e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:26:02.586 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 19 06:26:02 smithi003 podman[114766]: 2024-09-19 06:26:02.464861388 +0000 UTC m=+0.539226530 container attach 7743d4ff0834a9dd5a46d42ea2b6f965dc0dd625788d3e929cba26ae4713a7e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-19T06:26:02.835 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:02 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:02.460+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:02.836 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:02 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:02.491+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:33.423479+0000 front 2024-09-19T06:25:33.423506+0000 (oldest deadline 2024-09-19T06:25:56.323485+0000) 2024-09-19T06:26:02.970 INFO:journalctl@ceph.osd.3.smithi003.stdout:Sep 19 06:26:02 smithi003 podman[114766]: 2024-09-19 06:26:02.642122996 +0000 UTC m=+0.716488117 container died 7743d4ff0834a9dd5a46d42ea2b6f965dc0dd625788d3e929cba26ae4713a7e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T06:26:03.242 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:02 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:02.968+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:03.495 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:03 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:03.241+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:03.526 DEBUG:teuthology.orchestra.run.smithi003:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T06:26:03.538 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:26:03 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4[46165]: 2024-09-19T06:26:03.263+0000 7f149079f640 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.790475+0000 front 2024-09-19T06:25:32.790298+0000 (oldest deadline 2024-09-19T06:25:55.690228+0000) 2024-09-19T06:26:03.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:03 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:03.120+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:03.604 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:26:03.605 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T06:26:03.605 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T06:26:03.605 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.4 2024-09-19T06:26:03.835 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:03 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:03.493+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:03.836 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:03 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:03.502+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:33.423479+0000 front 2024-09-19T06:25:33.423506+0000 (oldest deadline 2024-09-19T06:25:56.323485+0000) 2024-09-19T06:26:03.958 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:26:03 smithi059 systemd[1]: Stopping Ceph osd.4 for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:26:04.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:04 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:04.115+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:04.288 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:26:03 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4[46165]: 2024-09-19T06:26:03.957+0000 7f1498191640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:26:04.288 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:26:03 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4[46165]: 2024-09-19T06:26:03.957+0000 7f1498191640 -1 osd.4 106 *** Got signal Terminated *** 2024-09-19T06:26:04.289 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:26:03 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4[46165]: 2024-09-19T06:26:03.957+0000 7f1498191640 -1 osd.4 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:26:04.334 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:03 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:03.996+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:04.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:04 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:04.242+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:04.788 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:26:04 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4[46165]: 2024-09-19T06:26:04.309+0000 7f149079f640 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.790475+0000 front 2024-09-19T06:25:32.790298+0000 (oldest deadline 2024-09-19T06:25:55.690228+0000) 2024-09-19T06:26:04.835 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:04 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:04.496+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:04.835 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:04 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:04.506+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:33.423479+0000 front 2024-09-19T06:25:33.423506+0000 (oldest deadline 2024-09-19T06:25:56.323485+0000) 2024-09-19T06:26:05.334 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:05 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:05.019+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:05.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:05 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:05.212+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:05.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:05 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:05.212+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:05.538 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:26:05 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4[46165]: 2024-09-19T06:26:05.262+0000 7f149079f640 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.790475+0000 front 2024-09-19T06:25:32.790298+0000 (oldest deadline 2024-09-19T06:25:55.690228+0000) 2024-09-19T06:26:05.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:05 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:05.110+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:05.835 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:05 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:05.513+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:33.423479+0000 front 2024-09-19T06:25:33.423506+0000 (oldest deadline 2024-09-19T06:25:56.323485+0000) 2024-09-19T06:26:05.836 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:05 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:05.513+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:41.624875+0000 front 2024-09-19T06:25:41.624767+0000 (oldest deadline 2024-09-19T06:26:04.524836+0000) 2024-09-19T06:26:05.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:05 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:05.515+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:05.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:05 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:05.516+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:06.038 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:05 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:05.652+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:06.334 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:05 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:05.990+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:06.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:06 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:06.179+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:06.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:06 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:06.179+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:06.538 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:26:06 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4[46165]: 2024-09-19T06:26:06.265+0000 7f149079f640 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.790475+0000 front 2024-09-19T06:25:32.790298+0000 (oldest deadline 2024-09-19T06:25:55.690228+0000) 2024-09-19T06:26:06.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:06 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:06.143+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:06.835 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:06 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:06.469+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:06.835 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:06 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:06.469+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:06.836 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:06 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:06.513+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:33.423479+0000 front 2024-09-19T06:25:33.423506+0000 (oldest deadline 2024-09-19T06:25:56.323485+0000) 2024-09-19T06:26:06.836 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:06 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:06.513+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:41.624875+0000 front 2024-09-19T06:25:41.624767+0000 (oldest deadline 2024-09-19T06:26:04.524836+0000) 2024-09-19T06:26:07.038 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:06 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:06.697+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:07.218 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:06 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:06.965+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:07.538 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:26:07 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4[46165]: 2024-09-19T06:26:07.235+0000 7f149079f640 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.790475+0000 front 2024-09-19T06:25:32.790298+0000 (oldest deadline 2024-09-19T06:25:55.690228+0000) 2024-09-19T06:26:07.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:07 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:07.123+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:07.584 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:07 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:07.217+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:07.584 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:07 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:07.217+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:07.835 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:07 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:07.525+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:33.423479+0000 front 2024-09-19T06:25:33.423506+0000 (oldest deadline 2024-09-19T06:25:56.323485+0000) 2024-09-19T06:26:07.835 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:07 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:07.525+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:41.624875+0000 front 2024-09-19T06:25:41.624767+0000 (oldest deadline 2024-09-19T06:26:04.524836+0000) 2024-09-19T06:26:07.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:07 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:07.444+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:07.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:07 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:07.444+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:08.038 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:07 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:07.688+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:08.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:08 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:08.218+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:08.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:08 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:08.218+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:08.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:08 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:08.002+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:08.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:08 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:08.002+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.296621+0000 front 2024-09-19T06:25:43.296727+0000 (oldest deadline 2024-09-19T06:26:07.396902+0000) 2024-09-19T06:26:08.538 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:26:08 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4[46165]: 2024-09-19T06:26:08.227+0000 7f149079f640 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.790475+0000 front 2024-09-19T06:25:32.790298+0000 (oldest deadline 2024-09-19T06:25:55.690228+0000) 2024-09-19T06:26:08.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:08 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:08.104+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:08.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:08 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:08.104+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:08.835 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:08 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:08.559+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:33.423479+0000 front 2024-09-19T06:25:33.423506+0000 (oldest deadline 2024-09-19T06:25:56.323485+0000) 2024-09-19T06:26:08.836 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:08 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:08.559+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:41.624875+0000 front 2024-09-19T06:25:41.624767+0000 (oldest deadline 2024-09-19T06:26:04.524836+0000) 2024-09-19T06:26:08.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:08 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:08.471+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:08.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:08 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:08.471+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:08.836 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:08 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:08.558+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:09.038 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:08 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:08.733+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:09.334 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:09 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:09.003+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:09.334 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:09 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:09.003+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.296621+0000 front 2024-09-19T06:25:43.296727+0000 (oldest deadline 2024-09-19T06:26:07.396902+0000) 2024-09-19T06:26:09.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:09 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:09.195+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:09.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:09 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:09.195+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:09.455 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:09 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:09.136+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:09.456 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:09 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:09.136+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:09.759 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:26:09 smithi059 podman[71355]: 2024-09-19 06:26:09.455025253 +0000 UTC m=+5.646055021 container died a9d942a0c72fce0125dbcdc8bd9c7126b45f5f7b68ab363b01b2a92bc6248095 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T06:26:09.835 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:09 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:09.596+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:09.836 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:09 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:09.554+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:33.423479+0000 front 2024-09-19T06:25:33.423506+0000 (oldest deadline 2024-09-19T06:25:56.323485+0000) 2024-09-19T06:26:09.836 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:09 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:09.554+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:41.624875+0000 front 2024-09-19T06:25:41.624767+0000 (oldest deadline 2024-09-19T06:26:04.524836+0000) 2024-09-19T06:26:09.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:09 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:09.433+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:09.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:09 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:09.433+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:10.038 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:09 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:09.781+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:10.039 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:26:09 smithi059 podman[71355]: 2024-09-19 06:26:09.858188308 +0000 UTC m=+6.049218070 container cleanup a9d942a0c72fce0125dbcdc8bd9c7126b45f5f7b68ab363b01b2a92bc6248095 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T06:26:10.039 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:26:09 smithi059 bash[71355]: ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4 2024-09-19T06:26:10.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:10 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:10.160+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:10.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:10 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:10.160+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:10.337 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:10 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:10.024+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:10.337 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:10 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:10.024+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.296621+0000 front 2024-09-19T06:25:43.296727+0000 (oldest deadline 2024-09-19T06:26:07.396902+0000) 2024-09-19T06:26:10.477 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:26:10 smithi059 podman[71371]: 2024-09-19 06:26:10.126326971 +0000 UTC m=+0.667448908 container remove a9d942a0c72fce0125dbcdc8bd9c7126b45f5f7b68ab363b01b2a92bc6248095 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T06:26:10.477 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:10 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:10.132+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:10.478 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:10 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:10.133+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:10.764 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:26:10 smithi059 podman[71459]: 2024-09-19 06:26:10.379408657 +0000 UTC m=+0.015891734 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:26:10.764 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:26:10 smithi059 podman[71459]: 2024-09-19 06:26:10.502134925 +0000 UTC m=+0.138618043 container create a8af9d8bf2819409f01135a973e67f26d95836591c50cc24d203dddb03e4c11c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T06:26:10.835 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:10 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:10.619+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:10.836 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:10 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:10.604+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:33.423479+0000 front 2024-09-19T06:25:33.423506+0000 (oldest deadline 2024-09-19T06:25:56.323485+0000) 2024-09-19T06:26:10.836 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:10 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:10.604+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:41.624875+0000 front 2024-09-19T06:25:41.624767+0000 (oldest deadline 2024-09-19T06:26:04.524836+0000) 2024-09-19T06:26:10.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:10 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:10.392+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:10.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:10 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:10.392+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:11.038 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:10 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:10.762+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:11.039 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:26:10 smithi059 podman[71459]: 2024-09-19 06:26:10.763488334 +0000 UTC m=+0.399971419 container init a8af9d8bf2819409f01135a973e67f26d95836591c50cc24d203dddb03e4c11c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T06:26:11.039 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:26:10 smithi059 podman[71459]: 2024-09-19 06:26:10.76700955 +0000 UTC m=+0.403492629 container start a8af9d8bf2819409f01135a973e67f26d95836591c50cc24d203dddb03e4c11c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:26:11.039 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:26:10 smithi059 podman[71459]: 2024-09-19 06:26:10.871595587 +0000 UTC m=+0.508078669 container attach a8af9d8bf2819409f01135a973e67f26d95836591c50cc24d203dddb03e4c11c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True) 2024-09-19T06:26:11.039 INFO:journalctl@ceph.osd.4.smithi059.stdout:Sep 19 06:26:10 smithi059 podman[71459]: 2024-09-19 06:26:10.956024978 +0000 UTC m=+0.592508057 container died a8af9d8bf2819409f01135a973e67f26d95836591c50cc24d203dddb03e4c11c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T06:26:11.179 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:11 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:11.002+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:11.180 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:11 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:11.002+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.296621+0000 front 2024-09-19T06:25:43.296727+0000 (oldest deadline 2024-09-19T06:26:07.396902+0000) 2024-09-19T06:26:11.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:11 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:11.182+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:11.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:11 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:11.182+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:11.584 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:11 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:11.177+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:11.584 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:11 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:11.177+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:11.656 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T06:26:11.659 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:11 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:11.386+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:11.659 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:11 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:11.386+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:11.659 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:11 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:11.593+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:33.423479+0000 front 2024-09-19T06:25:33.423506+0000 (oldest deadline 2024-09-19T06:25:56.323485+0000) 2024-09-19T06:26:11.659 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:11 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:11.593+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:41.624875+0000 front 2024-09-19T06:25:41.624767+0000 (oldest deadline 2024-09-19T06:26:04.524836+0000) 2024-09-19T06:26:11.698 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:26:11.698 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T06:26:11.698 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T06:26:11.698 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.5 2024-09-19T06:26:12.030 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:11 smithi071 systemd[1]: Stopping Ceph osd.5 for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:26:12.030 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:11 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:11.658+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:12.038 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:11 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:11.770+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:12.334 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:11 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:11.962+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:12.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:11 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:11.962+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.296621+0000 front 2024-09-19T06:25:43.296727+0000 (oldest deadline 2024-09-19T06:26:07.396902+0000) 2024-09-19T06:26:12.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:12 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:12.156+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:12.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:12 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:12.156+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:12.335 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:12 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:12.028+0000 7fdfae0e6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:26:12.335 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:12 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:12.029+0000 7fdfae0e6640 -1 osd.5 106 *** Got signal Terminated *** 2024-09-19T06:26:12.335 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:12 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:12.029+0000 7fdfae0e6640 -1 osd.5 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:26:12.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:12 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:12.139+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:12.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:12 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:12.139+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:12.643 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:12 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:12.376+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:12.644 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:12 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:12.376+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:13.038 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:12 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:12.734+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:13.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:12 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:12.687+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:13.086 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:12 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:12.642+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:33.423479+0000 front 2024-09-19T06:25:33.423506+0000 (oldest deadline 2024-09-19T06:25:56.323485+0000) 2024-09-19T06:26:13.086 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:12 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:12.642+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:41.624875+0000 front 2024-09-19T06:25:41.624767+0000 (oldest deadline 2024-09-19T06:26:04.524836+0000) 2024-09-19T06:26:13.334 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:12 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:12.956+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:13.334 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:12 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:12.956+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.296621+0000 front 2024-09-19T06:25:43.296727+0000 (oldest deadline 2024-09-19T06:26:07.396902+0000) 2024-09-19T06:26:13.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:13 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:13.145+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:13.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:13 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:13.145+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:13.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:13 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:13.097+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:13.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:13 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:13.097+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:13.638 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:13 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:13.385+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:13.638 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:13 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:13.385+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:14.038 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:13 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:13.727+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:14.038 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:13 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:13.727+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:48.877827+0000 front 2024-09-19T06:25:48.877711+0000 (oldest deadline 2024-09-19T06:26:13.577665+0000) 2024-09-19T06:26:14.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:13 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:13.721+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:14.085 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:13 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:13.637+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:33.423479+0000 front 2024-09-19T06:25:33.423506+0000 (oldest deadline 2024-09-19T06:25:56.323485+0000) 2024-09-19T06:26:14.086 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:13 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:13.637+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:41.624875+0000 front 2024-09-19T06:25:41.624767+0000 (oldest deadline 2024-09-19T06:26:04.524836+0000) 2024-09-19T06:26:14.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:14 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:14.145+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:14.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:14 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:14.145+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:14.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:14 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:14.145+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:14.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:13 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:13.968+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:14.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:13 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:13.968+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.296621+0000 front 2024-09-19T06:25:43.296727+0000 (oldest deadline 2024-09-19T06:26:07.396902+0000) 2024-09-19T06:26:14.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:13 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:13.968+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:52.098332+0000 front 2024-09-19T06:25:52.098308+0000 (oldest deadline 2024-09-19T06:26:13.198415+0000) 2024-09-19T06:26:14.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:14 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:14.058+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:14.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:14 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:14.058+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:14.723 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:14 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:14.637+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:33.423479+0000 front 2024-09-19T06:25:33.423506+0000 (oldest deadline 2024-09-19T06:25:56.323485+0000) 2024-09-19T06:26:14.724 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:14 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:14.637+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:41.624875+0000 front 2024-09-19T06:25:41.624767+0000 (oldest deadline 2024-09-19T06:26:04.524836+0000) 2024-09-19T06:26:14.724 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:14 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:14.423+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:14.724 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:14 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:14.423+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:15.038 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:14 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:14.769+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:15.038 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:14 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:14.769+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:48.877827+0000 front 2024-09-19T06:25:48.877711+0000 (oldest deadline 2024-09-19T06:26:13.577665+0000) 2024-09-19T06:26:15.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:14 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:14.723+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:15.334 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:14 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:14.998+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:15.334 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:14 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:14.998+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.296621+0000 front 2024-09-19T06:25:43.296727+0000 (oldest deadline 2024-09-19T06:26:07.396902+0000) 2024-09-19T06:26:15.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:14 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:14.998+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:52.098332+0000 front 2024-09-19T06:25:52.098308+0000 (oldest deadline 2024-09-19T06:26:13.198415+0000) 2024-09-19T06:26:15.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:15 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:15.148+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:15.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:15 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:15.148+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:15.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:15 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:15.148+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:15.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:15 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:15.078+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:15.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:15 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:15.078+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:15.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:15 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:15.078+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:15.696 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:15 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:15.400+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:15.697 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:15 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:15.400+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:15.697 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:15 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:15.641+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:33.423479+0000 front 2024-09-19T06:25:33.423506+0000 (oldest deadline 2024-09-19T06:25:56.323485+0000) 2024-09-19T06:26:15.697 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:15 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:15.641+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:41.624875+0000 front 2024-09-19T06:25:41.624767+0000 (oldest deadline 2024-09-19T06:26:04.524836+0000) 2024-09-19T06:26:15.697 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:15 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:15.641+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:50.326088+0000 front 2024-09-19T06:25:50.326118+0000 (oldest deadline 2024-09-19T06:26:15.026238+0000) 2024-09-19T06:26:16.038 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:15 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:15.747+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:16.038 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:15 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:15.747+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:48.877827+0000 front 2024-09-19T06:25:48.877711+0000 (oldest deadline 2024-09-19T06:26:13.577665+0000) 2024-09-19T06:26:16.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:15 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:15.696+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:16.086 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:15 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:15.696+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:16.334 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:16 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:16.020+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:16.334 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:16 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:16.020+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.296621+0000 front 2024-09-19T06:25:43.296727+0000 (oldest deadline 2024-09-19T06:26:07.396902+0000) 2024-09-19T06:26:16.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:16 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:16.020+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:52.098332+0000 front 2024-09-19T06:25:52.098308+0000 (oldest deadline 2024-09-19T06:26:13.198415+0000) 2024-09-19T06:26:16.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:16 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:16.126+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:16.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:16 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:16.126+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:16.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:16 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:16.126+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:16.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:16 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:16.089+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:16.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:16 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:16.089+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:16.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:16 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:16.089+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:16.700 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:16 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:16.644+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:33.423479+0000 front 2024-09-19T06:25:33.423506+0000 (oldest deadline 2024-09-19T06:25:56.323485+0000) 2024-09-19T06:26:16.701 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:16 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:16.644+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:41.624875+0000 front 2024-09-19T06:25:41.624767+0000 (oldest deadline 2024-09-19T06:26:04.524836+0000) 2024-09-19T06:26:16.701 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:16 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5[47348]: 2024-09-19T06:26:16.644+0000 7fdfaa6fc640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:50.326088+0000 front 2024-09-19T06:25:50.326118+0000 (oldest deadline 2024-09-19T06:26:15.026238+0000) 2024-09-19T06:26:16.701 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:16 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:16.433+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:16.701 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:16 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:16.433+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:16.701 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:16 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:16.433+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:17.038 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:16 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:16.710+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:17.038 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:16 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:16.710+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:48.877827+0000 front 2024-09-19T06:25:48.877711+0000 (oldest deadline 2024-09-19T06:26:13.577665+0000) 2024-09-19T06:26:17.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:16 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:16.699+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:17.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:16 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:16.699+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:17.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:17 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:17.085+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:17.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:17 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:17.085+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:17.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:17 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:17.085+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:17.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:16 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:16.977+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:17.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:16 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:16.977+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.296621+0000 front 2024-09-19T06:25:43.296727+0000 (oldest deadline 2024-09-19T06:26:07.396902+0000) 2024-09-19T06:26:17.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:16 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:16.977+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:52.098332+0000 front 2024-09-19T06:25:52.098308+0000 (oldest deadline 2024-09-19T06:26:13.198415+0000) 2024-09-19T06:26:17.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:17 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:17.051+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:17.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:17 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:17.051+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:17.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:17 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:17.051+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:17.661 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:17 smithi071 podman[72969]: 2024-09-19 06:26:17.486380076 +0000 UTC m=+5.588852028 container died a60fc85becd7339ca13f989ea3f976429dfa8f1def5bcb0ec2c6a57062738fed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:26:17.661 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:17 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:17.391+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:17.661 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:17 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:17.391+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:17.661 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:17 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:17.391+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:18.038 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:17 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:17.702+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:18.038 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:17 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:17.702+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:48.877827+0000 front 2024-09-19T06:25:48.877711+0000 (oldest deadline 2024-09-19T06:26:13.577665+0000) 2024-09-19T06:26:18.086 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:17 smithi071 podman[72969]: 2024-09-19 06:26:17.878967591 +0000 UTC m=+5.981439528 container cleanup a60fc85becd7339ca13f989ea3f976429dfa8f1def5bcb0ec2c6a57062738fed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:26:18.086 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:17 smithi071 bash[72969]: ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5 2024-09-19T06:26:18.086 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:17 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:17.660+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:18.086 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:17 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:17.660+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:18.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:18 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:18.038+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:18.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:18 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:18.038+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:18.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:18 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:18.038+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:18.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:17 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:17.953+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:18.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:17 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:17.953+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.296621+0000 front 2024-09-19T06:25:43.296727+0000 (oldest deadline 2024-09-19T06:26:07.396902+0000) 2024-09-19T06:26:18.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:17 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:17.953+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:52.098332+0000 front 2024-09-19T06:25:52.098308+0000 (oldest deadline 2024-09-19T06:26:13.198415+0000) 2024-09-19T06:26:18.444 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:18 smithi071 podman[72985]: 2024-09-19 06:26:18.130306747 +0000 UTC m=+0.641703071 container remove a60fc85becd7339ca13f989ea3f976429dfa8f1def5bcb0ec2c6a57062738fed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T06:26:18.444 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:18 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:18.375+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:18.444 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:18 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:18.375+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:18.444 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:18 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:18.375+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:18.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:18 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:18.047+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:18.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:18 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:18.047+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:18.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:18 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:18.047+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:18.696 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:18 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:18.657+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:18.696 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:18 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:18.657+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:18.696 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:18 smithi071 podman[73073]: 2024-09-19 06:26:18.345357904 +0000 UTC m=+0.015581968 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:26:18.696 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:18 smithi071 podman[73073]: 2024-09-19 06:26:18.464482569 +0000 UTC m=+0.134706660 container create 2e04b56ca64f0dc721a8b2f55c8b94ee085139e7ac92814acf3f1d3c0de03dd7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:26:18.696 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:18 smithi071 podman[73073]: 2024-09-19 06:26:18.692241266 +0000 UTC m=+0.362465319 container init 2e04b56ca64f0dc721a8b2f55c8b94ee085139e7ac92814acf3f1d3c0de03dd7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-19T06:26:18.697 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:18 smithi071 podman[73073]: 2024-09-19 06:26:18.695492468 +0000 UTC m=+0.365716526 container start 2e04b56ca64f0dc721a8b2f55c8b94ee085139e7ac92814acf3f1d3c0de03dd7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:26:19.038 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:18 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:18.659+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:19.038 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:18 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:18.659+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:48.877827+0000 front 2024-09-19T06:25:48.877711+0000 (oldest deadline 2024-09-19T06:26:13.577665+0000) 2024-09-19T06:26:19.085 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:18 smithi071 podman[73073]: 2024-09-19 06:26:18.792156166 +0000 UTC m=+0.462380223 container attach 2e04b56ca64f0dc721a8b2f55c8b94ee085139e7ac92814acf3f1d3c0de03dd7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:26:19.086 INFO:journalctl@ceph.osd.5.smithi071.stdout:Sep 19 06:26:18 smithi071 podman[73073]: 2024-09-19 06:26:18.880036355 +0000 UTC m=+0.550260407 container died 2e04b56ca64f0dc721a8b2f55c8b94ee085139e7ac92814acf3f1d3c0de03dd7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T06:26:19.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:19 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:19.043+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:19.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:19 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:19.043+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:19.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:19 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:19.043+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:19.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:18 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:18.990+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:19.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:18 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:18.990+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.296621+0000 front 2024-09-19T06:25:43.296727+0000 (oldest deadline 2024-09-19T06:26:07.396902+0000) 2024-09-19T06:26:19.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:18 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:18.990+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:52.098332+0000 front 2024-09-19T06:25:52.098308+0000 (oldest deadline 2024-09-19T06:26:13.198415+0000) 2024-09-19T06:26:19.488 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:19 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:19.422+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:19.489 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:19 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:19.422+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:19.489 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:19 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:19.422+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:19.511 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T06:26:19.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:19 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:19.064+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:19.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:19 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:19.064+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:19.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:19 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:19.064+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:19.550 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:26:19.550 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T06:26:19.551 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T06:26:19.551 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.6 2024-09-19T06:26:19.835 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:19 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:19.660+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:19.835 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:19 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:19.660+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:19.944 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:19 smithi003 systemd[1]: Stopping Ceph osd.6 for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:26:20.038 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:19 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:19.696+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:20.038 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:19 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:19.696+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:48.877827+0000 front 2024-09-19T06:25:48.877711+0000 (oldest deadline 2024-09-19T06:26:13.577665+0000) 2024-09-19T06:26:20.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:20 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:20.063+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:20.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:20 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:20.063+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:20.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:20 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:20.063+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:20.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:19 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:19.942+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:20.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:19 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:19.942+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.296621+0000 front 2024-09-19T06:25:43.296727+0000 (oldest deadline 2024-09-19T06:26:07.396902+0000) 2024-09-19T06:26:20.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:19 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:19.942+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:52.098332+0000 front 2024-09-19T06:25:52.098308+0000 (oldest deadline 2024-09-19T06:26:13.198415+0000) 2024-09-19T06:26:20.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:20 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:19.999+0000 7f4dd5000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:26:20.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:20 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:19.999+0000 7f4dd5000640 -1 osd.6 106 *** Got signal Terminated *** 2024-09-19T06:26:20.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:20 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:19.999+0000 7f4dd5000640 -1 osd.6 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:26:20.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:20 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:20.058+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:20.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:20 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:20.058+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:20.538 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:20 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:20.058+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:20.699 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:20 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:20.406+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:20.699 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:20 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:20.406+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:20.699 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:20 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:20.406+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:21.019 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:20 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:20.677+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:21.020 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:20 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:20.677+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:48.877827+0000 front 2024-09-19T06:25:48.877711+0000 (oldest deadline 2024-09-19T06:26:13.577665+0000) 2024-09-19T06:26:21.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:20 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:20.698+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:21.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:20 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:20.698+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:21.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:21 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:21.018+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:21.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:21 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:21.018+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:21.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:21 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:21.018+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:21.334 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:20 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:20.971+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:21.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:20 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:20.971+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.296621+0000 front 2024-09-19T06:25:43.296727+0000 (oldest deadline 2024-09-19T06:26:07.396902+0000) 2024-09-19T06:26:21.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:20 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:20.971+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:52.098332+0000 front 2024-09-19T06:25:52.098308+0000 (oldest deadline 2024-09-19T06:26:13.198415+0000) 2024-09-19T06:26:21.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:21 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:21.022+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:21.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:21 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:21.022+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:21.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:21 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:21.022+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:21.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:21 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:21.022+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:21.835 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:21 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:21.655+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:21.835 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:21 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:21.655+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:21.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:21 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:21.417+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:21.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:21 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:21.417+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:21.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:21 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:21.417+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:21.973 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:21 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:21.652+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:21.974 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:21 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:21.652+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:48.877827+0000 front 2024-09-19T06:25:48.877711+0000 (oldest deadline 2024-09-19T06:26:13.577665+0000) 2024-09-19T06:26:22.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:21 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:21.972+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:22.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:21 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:21.972+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:22.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:21 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:21.972+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:22.334 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:22.000+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:22.334 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:22.000+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.296621+0000 front 2024-09-19T06:25:43.296727+0000 (oldest deadline 2024-09-19T06:26:07.396902+0000) 2024-09-19T06:26:22.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:22.000+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:52.098332+0000 front 2024-09-19T06:25:52.098308+0000 (oldest deadline 2024-09-19T06:26:13.198415+0000) 2024-09-19T06:26:22.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:22.030+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:22.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:22.030+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:22.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:22.030+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:22.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:22.030+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:22.656 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:22 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:22.371+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:22.656 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:22 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:22.371+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:22.656 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:22 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:22.371+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:22.954 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:22 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:22.700+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:22.954 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:22 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:22.700+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:48.877827+0000 front 2024-09-19T06:25:48.877711+0000 (oldest deadline 2024-09-19T06:26:13.577665+0000) 2024-09-19T06:26:23.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:22 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:22.655+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:23.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:22 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:22.655+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:23.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:22 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:22.952+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:23.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:22 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:22.952+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:23.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:22 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:22.952+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:23.334 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:22.990+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:23.334 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:22.990+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.296621+0000 front 2024-09-19T06:25:43.296727+0000 (oldest deadline 2024-09-19T06:26:07.396902+0000) 2024-09-19T06:26:23.334 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:22.990+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:52.098332+0000 front 2024-09-19T06:25:52.098308+0000 (oldest deadline 2024-09-19T06:26:13.198415+0000) 2024-09-19T06:26:23.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:23 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:22.999+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:23.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:23 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:22.999+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:23.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:23 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:22.999+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:23.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:23 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:22.999+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:23.655 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:23 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:23.391+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:23.655 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:23 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:23.391+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:23.655 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:23 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:23.391+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:23.933 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:23 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:23.654+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:23.934 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:23 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:23.654+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:23.934 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:23 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:23.654+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.823200+0000 front 2024-09-19T06:25:59.823317+0000 (oldest deadline 2024-09-19T06:26:23.323339+0000) 2024-09-19T06:26:24.001 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:23 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:23.670+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:24.001 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:23 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:23.670+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:48.877827+0000 front 2024-09-19T06:25:48.877711+0000 (oldest deadline 2024-09-19T06:26:13.577665+0000) 2024-09-19T06:26:24.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:24 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:24.000+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:24.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:24 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:24.000+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:24.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:24 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:24.000+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:24.334 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:24.026+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:32.993498+0000 front 2024-09-19T06:25:32.993151+0000 (oldest deadline 2024-09-19T06:25:56.994021+0000) 2024-09-19T06:26:24.334 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:24.026+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.296621+0000 front 2024-09-19T06:25:43.296727+0000 (oldest deadline 2024-09-19T06:26:07.396902+0000) 2024-09-19T06:26:24.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6[59108]: 2024-09-19T06:26:24.026+0000 7f4dcba00640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:52.098332+0000 front 2024-09-19T06:25:52.098308+0000 (oldest deadline 2024-09-19T06:26:13.198415+0000) 2024-09-19T06:26:24.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:23 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:23.960+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:24.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:23 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:23.960+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:24.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:23 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:23.960+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:24.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:23 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:23.960+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:24.628 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:24 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:24.363+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:24.629 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:24 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:24.363+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:24.629 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:24 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:24.363+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:24.884 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:24 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:24.627+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:24.884 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:24 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:24.627+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:24.884 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:24 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:24.627+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.823200+0000 front 2024-09-19T06:25:59.823317+0000 (oldest deadline 2024-09-19T06:26:23.323339+0000) 2024-09-19T06:26:24.960 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:24 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:24.705+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:24.960 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:24 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:24.705+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:48.877827+0000 front 2024-09-19T06:25:48.877711+0000 (oldest deadline 2024-09-19T06:26:13.577665+0000) 2024-09-19T06:26:25.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:24 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:24.958+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:25.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:24 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:24.958+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:25.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:24 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:24.958+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:25.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:24.943+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:25.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:24.943+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:25.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:24.943+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:25.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:24 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:24.943+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:25.630 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:25 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:25.345+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:25.630 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:25 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:25.345+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:25.630 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:25 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:25.345+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:25.834 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:25 smithi003 podman[114867]: 2024-09-19 06:26:25.417372233 +0000 UTC m=+5.569231445 container died 7f4b7c8eb30b40a2347ee4eb10b692cce0ba3c639ddb3961a99753001f0fe256 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T06:26:26.038 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:25 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:25.701+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:26.038 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:25 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:25.701+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:48.877827+0000 front 2024-09-19T06:25:48.877711+0000 (oldest deadline 2024-09-19T06:26:13.577665+0000) 2024-09-19T06:26:26.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:25 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:25.936+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:26.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:25 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:25.936+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:26.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:25 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:25.936+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:26.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:25 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:25.936+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:26.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:25 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:25.629+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:26.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:25 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:25.629+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:26.086 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:25 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:25.629+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.823200+0000 front 2024-09-19T06:25:59.823317+0000 (oldest deadline 2024-09-19T06:26:23.323339+0000) 2024-09-19T06:26:26.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:26 smithi003 podman[114867]: 2024-09-19 06:26:26.13785697 +0000 UTC m=+6.289716180 container cleanup 7f4b7c8eb30b40a2347ee4eb10b692cce0ba3c639ddb3961a99753001f0fe256 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T06:26:26.335 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:26 smithi003 bash[114867]: ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6 2024-09-19T06:26:26.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:25 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:25.940+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:26.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:25 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:25.940+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:26.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:25 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:25.940+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:26.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:25 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:25.940+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:26.622 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:26 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:26.360+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:26.622 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:26 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:26.360+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:26.622 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:26 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:26.360+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:26.834 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:26 smithi003 podman[114885]: 2024-09-19 06:26:26.447960439 +0000 UTC m=+1.015892045 container remove 7f4b7c8eb30b40a2347ee4eb10b692cce0ba3c639ddb3961a99753001f0fe256 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T06:26:26.955 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:26 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:26.682+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:26.955 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:26 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:26.682+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:48.877827+0000 front 2024-09-19T06:25:48.877711+0000 (oldest deadline 2024-09-19T06:26:13.577665+0000) 2024-09-19T06:26:26.955 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:26 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:26.682+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.379488+0000 front 2024-09-19T06:25:59.379411+0000 (oldest deadline 2024-09-19T06:26:25.779654+0000) 2024-09-19T06:26:27.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:26 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:26.621+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:27.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:26 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:26.621+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:27.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:26 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:26.621+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.823200+0000 front 2024-09-19T06:25:59.823317+0000 (oldest deadline 2024-09-19T06:26:23.323339+0000) 2024-09-19T06:26:27.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:26 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:26.953+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:27.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:26 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:26.953+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:27.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:26 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:26.953+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:27.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:26 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:26.953+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:27.332 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:27 smithi003 podman[114970]: 2024-09-19 06:26:26.972936459 +0000 UTC m=+0.027544998 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:26:27.332 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:27 smithi003 podman[114970]: 2024-09-19 06:26:27.198790682 +0000 UTC m=+0.253399258 container create 44a8bb12ffdcdba2e268793c37f5fdc6bf0086efe6e06475ef7e935b472da9c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T06:26:27.332 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:26 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:26.961+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:27.333 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:26 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:26.961+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:27.333 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:26 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:26.961+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:27.333 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:26 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:26.961+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:27.584 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:27 smithi003 podman[114970]: 2024-09-19 06:26:27.493262445 +0000 UTC m=+0.547870982 container init 44a8bb12ffdcdba2e268793c37f5fdc6bf0086efe6e06475ef7e935b472da9c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6-deactivate, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:26:27.584 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:27 smithi003 podman[114970]: 2024-09-19 06:26:27.500145159 +0000 UTC m=+0.554753698 container start 44a8bb12ffdcdba2e268793c37f5fdc6bf0086efe6e06475ef7e935b472da9c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6-deactivate, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T06:26:27.646 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:27 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:27.386+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:27.646 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:27 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:27.386+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:27.646 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:27 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:27.386+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:27.976 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:27 smithi003 podman[114970]: 2024-09-19 06:26:27.609659005 +0000 UTC m=+0.664267557 container attach 44a8bb12ffdcdba2e268793c37f5fdc6bf0086efe6e06475ef7e935b472da9c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T06:26:27.976 INFO:journalctl@ceph.osd.6.smithi003.stdout:Sep 19 06:26:27 smithi003 podman[114993]: 2024-09-19 06:26:27.826679646 +0000 UTC m=+0.031304345 container died 44a8bb12ffdcdba2e268793c37f5fdc6bf0086efe6e06475ef7e935b472da9c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T06:26:27.978 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:27 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:27.700+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:27.978 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:27 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:27.700+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:48.877827+0000 front 2024-09-19T06:25:48.877711+0000 (oldest deadline 2024-09-19T06:26:13.577665+0000) 2024-09-19T06:26:27.978 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:27 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:27.700+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.379488+0000 front 2024-09-19T06:25:59.379411+0000 (oldest deadline 2024-09-19T06:26:25.779654+0000) 2024-09-19T06:26:28.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:27 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:27.645+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:28.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:27 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:27.645+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:28.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:27 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:27.645+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.823200+0000 front 2024-09-19T06:25:59.823317+0000 (oldest deadline 2024-09-19T06:26:23.323339+0000) 2024-09-19T06:26:28.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:27 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:27.977+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:28.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:27 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:27.977+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:28.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:27 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:27.977+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:28.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:27 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:27.977+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:28.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:27 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:27.973+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:28.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:27 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:27.973+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:28.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:27 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:27.973+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:28.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:27 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:27.973+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:28.589 DEBUG:teuthology.orchestra.run.smithi003:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T06:26:28.616 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:28 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:28.354+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:28.616 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:28 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:28.354+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:28.616 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:28 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:28.354+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:28.665 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:26:28.665 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T06:26:28.665 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T06:26:28.666 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.7 2024-09-19T06:26:28.943 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:28 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:28.698+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:28.943 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:28 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:28.698+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:48.877827+0000 front 2024-09-19T06:25:48.877711+0000 (oldest deadline 2024-09-19T06:26:13.577665+0000) 2024-09-19T06:26:28.943 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:28 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:28.698+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.379488+0000 front 2024-09-19T06:25:59.379411+0000 (oldest deadline 2024-09-19T06:26:25.779654+0000) 2024-09-19T06:26:28.943 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:28 smithi059 systemd[1]: Stopping Ceph osd.7 for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:26:29.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:28 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:28.615+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:29.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:28 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:28.615+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:29.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:28 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:28.615+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.823200+0000 front 2024-09-19T06:25:59.823317+0000 (oldest deadline 2024-09-19T06:26:23.323339+0000) 2024-09-19T06:26:29.288 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:29 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:29.003+0000 7fa80f82e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:26:29.288 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:29 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:29.003+0000 7fa80f82e640 -1 osd.7 106 *** Got signal Terminated *** 2024-09-19T06:26:29.288 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:29 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:29.003+0000 7fa80f82e640 -1 osd.7 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:26:29.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:28 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:28.941+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:29.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:28 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:28.941+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:29.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:28 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:28.941+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:29.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:28 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:28.941+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:29.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:28 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:28.950+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:29.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:28 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:28.950+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:29.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:28 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:28.950+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:29.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:28 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:28.950+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:29.835 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:29 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:29.590+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:29.835 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:29 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:29.590+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:29.836 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:29 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:29.590+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.823200+0000 front 2024-09-19T06:25:59.823317+0000 (oldest deadline 2024-09-19T06:26:23.323339+0000) 2024-09-19T06:26:29.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:29 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:29.355+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:29.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:29 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:29.355+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:29.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:29 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:29.355+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:29.959 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:29 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:29.690+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:29.959 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:29 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:29.690+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:48.877827+0000 front 2024-09-19T06:25:48.877711+0000 (oldest deadline 2024-09-19T06:26:13.577665+0000) 2024-09-19T06:26:29.959 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:29 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:29.690+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.379488+0000 front 2024-09-19T06:25:59.379411+0000 (oldest deadline 2024-09-19T06:26:25.779654+0000) 2024-09-19T06:26:30.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:29 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:29.957+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:30.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:29 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:29.957+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:30.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:29 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:29.957+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:30.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:29 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:29.957+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:30.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:29 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:29.957+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:30.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:29 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:29.904+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:30.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:29 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:29.904+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:30.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:29 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:29.904+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:30.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:29 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:29.904+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:30.581 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:30 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:30.316+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:30.581 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:30 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:30.316+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:30.581 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:30 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:30.316+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:30.835 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:30 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:30.579+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:30.836 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:30 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:30.579+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:30.836 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:30 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:30.579+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.823200+0000 front 2024-09-19T06:25:59.823317+0000 (oldest deadline 2024-09-19T06:26:23.323339+0000) 2024-09-19T06:26:30.960 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:30 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:30.658+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:30.961 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:30 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:30.658+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:48.877827+0000 front 2024-09-19T06:25:48.877711+0000 (oldest deadline 2024-09-19T06:26:13.577665+0000) 2024-09-19T06:26:30.961 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:30 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:30.658+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.379488+0000 front 2024-09-19T06:25:59.379411+0000 (oldest deadline 2024-09-19T06:26:25.779654+0000) 2024-09-19T06:26:31.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:30 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:30.957+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:31.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:30 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:30.957+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:31.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:30 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:30.957+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:31.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:30 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:30.957+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:31.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:30 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:30.957+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:31.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:30 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:30.934+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:31.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:30 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:30.934+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:31.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:30 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:30.935+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:31.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:30 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:30.935+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:31.835 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:31 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:31.589+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:31.835 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:31 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:31.589+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:31.836 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:31 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:31.589+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.823200+0000 front 2024-09-19T06:25:59.823317+0000 (oldest deadline 2024-09-19T06:26:23.323339+0000) 2024-09-19T06:26:31.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:31 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:31.364+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:31.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:31 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:31.364+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:31.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:31 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:31.364+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:31.914 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:31 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:31.627+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:31.914 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:31 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:31.627+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:48.877827+0000 front 2024-09-19T06:25:48.877711+0000 (oldest deadline 2024-09-19T06:26:13.577665+0000) 2024-09-19T06:26:31.914 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:31 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:31.627+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.379488+0000 front 2024-09-19T06:25:59.379411+0000 (oldest deadline 2024-09-19T06:26:25.779654+0000) 2024-09-19T06:26:31.914 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:31 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:31.627+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.780038+0000 front 2024-09-19T06:26:05.780016+0000 (oldest deadline 2024-09-19T06:26:31.080139+0000) 2024-09-19T06:26:32.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:31 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:31.912+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:32.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:31 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:31.912+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:32.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:31 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:31.912+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:32.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:31 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:31.912+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:32.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:31 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:31.912+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:32.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:31 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:31.959+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:32.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:31 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:31.959+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:32.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:31 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:31.959+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:32.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:31 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:31.959+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:32.625 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:32 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:32.371+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:32.625 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:32 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:32.371+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:32.625 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:32 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:32.371+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:32.944 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:32 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:32.631+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:32.944 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:32 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:32.631+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:48.877827+0000 front 2024-09-19T06:25:48.877711+0000 (oldest deadline 2024-09-19T06:26:13.577665+0000) 2024-09-19T06:26:32.944 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:32 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:32.631+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.379488+0000 front 2024-09-19T06:25:59.379411+0000 (oldest deadline 2024-09-19T06:26:25.779654+0000) 2024-09-19T06:26:32.944 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:32 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:32.631+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.780038+0000 front 2024-09-19T06:26:05.780016+0000 (oldest deadline 2024-09-19T06:26:31.080139+0000) 2024-09-19T06:26:33.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:32 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:32.623+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:33.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:32 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:32.623+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:33.086 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:32 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:32.623+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.823200+0000 front 2024-09-19T06:25:59.823317+0000 (oldest deadline 2024-09-19T06:26:23.323339+0000) 2024-09-19T06:26:33.086 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:32 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:32.623+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:07.424336+0000 front 2024-09-19T06:26:07.424462+0000 (oldest deadline 2024-09-19T06:26:32.024770+0000) 2024-09-19T06:26:33.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:32 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:32.942+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:33.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:32 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:32.942+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:33.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:32 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:32.942+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:33.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:32 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:32.942+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:33.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:32 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:32.942+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:33.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:33 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:33.008+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:33.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:33 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:33.008+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:33.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:33 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:33.008+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:33.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:33 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:33.008+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:33.835 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:33 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:33.377+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:33.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:33 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:33.377+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:33.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:33 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:33.377+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:33.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:33 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:33.377+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:33.836 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:33 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:33.603+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:33.836 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:33 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:33.603+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:33.836 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:33 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:33.603+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.823200+0000 front 2024-09-19T06:25:59.823317+0000 (oldest deadline 2024-09-19T06:26:23.323339+0000) 2024-09-19T06:26:33.836 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:33 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:33.603+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:07.424336+0000 front 2024-09-19T06:26:07.424462+0000 (oldest deadline 2024-09-19T06:26:32.024770+0000) 2024-09-19T06:26:33.990 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:33 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:33.624+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:43.776096+0000 front 2024-09-19T06:25:43.776147+0000 (oldest deadline 2024-09-19T06:26:05.476239+0000) 2024-09-19T06:26:33.991 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:33 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:33.624+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:48.877827+0000 front 2024-09-19T06:25:48.877711+0000 (oldest deadline 2024-09-19T06:26:13.577665+0000) 2024-09-19T06:26:33.991 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:33 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:33.624+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.379488+0000 front 2024-09-19T06:25:59.379411+0000 (oldest deadline 2024-09-19T06:26:25.779654+0000) 2024-09-19T06:26:33.991 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:33 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7[52700]: 2024-09-19T06:26:33.624+0000 7fa807e3c640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.780038+0000 front 2024-09-19T06:26:05.780016+0000 (oldest deadline 2024-09-19T06:26:31.080139+0000) 2024-09-19T06:26:34.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:33 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:33.989+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:34.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:33 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:33.989+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:34.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:33 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:33.989+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:34.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:33 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:33.989+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:34.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:33 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:33.989+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:34.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:33 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:33.993+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:34.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:33 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:33.993+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:34.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:33 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:33.993+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:34.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:33 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:33.993+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:34.630 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:34 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:34.375+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:34.631 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:34 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:34.375+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:34.631 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:34 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:34.375+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:34.631 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:34 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:34.375+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:34.788 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:34 smithi059 podman[71574]: 2024-09-19 06:26:34.51954884 +0000 UTC m=+5.662381271 container died 9ad009e6fe8b79647937f2dc66b0ff24b5f1a430e10611e1b1f6698661fa4fec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:26:34.963 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:34 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:34.629+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:34.963 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:34 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:34.629+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:34.964 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:34 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:34.629+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.823200+0000 front 2024-09-19T06:25:59.823317+0000 (oldest deadline 2024-09-19T06:26:23.323339+0000) 2024-09-19T06:26:34.964 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:34 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:34.629+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:07.424336+0000 front 2024-09-19T06:26:07.424462+0000 (oldest deadline 2024-09-19T06:26:32.024770+0000) 2024-09-19T06:26:35.288 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:35 smithi059 podman[71574]: 2024-09-19 06:26:35.05333026 +0000 UTC m=+6.196162730 container cleanup 9ad009e6fe8b79647937f2dc66b0ff24b5f1a430e10611e1b1f6698661fa4fec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T06:26:35.288 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:35 smithi059 bash[71574]: ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7 2024-09-19T06:26:35.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:34 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:34.940+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:35.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:34 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:34.940+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:35.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:34 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:34.940+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:35.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:34 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:34.940+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:35.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:34 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:34.940+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:35.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:35 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:35.004+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:35.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:35 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:35.004+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:35.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:35 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:35.004+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:35.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:35 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:35.004+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:35.724 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:35 smithi059 podman[71590]: 2024-09-19 06:26:35.30457817 +0000 UTC m=+0.778438705 container remove 9ad009e6fe8b79647937f2dc66b0ff24b5f1a430e10611e1b1f6698661fa4fec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T06:26:35.835 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:35 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:35.599+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:35.835 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:35 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:35.599+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:35.836 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:35 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:35.599+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.823200+0000 front 2024-09-19T06:25:59.823317+0000 (oldest deadline 2024-09-19T06:26:23.323339+0000) 2024-09-19T06:26:35.836 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:35 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:35.599+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:07.424336+0000 front 2024-09-19T06:26:07.424462+0000 (oldest deadline 2024-09-19T06:26:32.024770+0000) 2024-09-19T06:26:35.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:35 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:35.370+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:35.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:35 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:35.370+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:35.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:35 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:35.370+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:35.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:35 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:35.370+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:36.008 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:35 smithi059 podman[71679]: 2024-09-19 06:26:35.625808773 +0000 UTC m=+0.015726376 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:26:36.009 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:35 smithi059 podman[71679]: 2024-09-19 06:26:35.74709978 +0000 UTC m=+0.137017411 container create 8ce30dd3e5c0c3f7c4034f0aaf6710f6043efa66886612d289095d1bfcc75bc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T06:26:36.009 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:36 smithi059 podman[71679]: 2024-09-19 06:26:36.007932655 +0000 UTC m=+0.397850244 container init 8ce30dd3e5c0c3f7c4034f0aaf6710f6043efa66886612d289095d1bfcc75bc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:26:36.009 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:35 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:35.906+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:36.009 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:35 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:35.906+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:36.009 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:35 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:35.907+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:36.009 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:35 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:35.907+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:36.009 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:35 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:35.907+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:36.288 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:36 smithi059 podman[71679]: 2024-09-19 06:26:36.011845454 +0000 UTC m=+0.401763050 container start 8ce30dd3e5c0c3f7c4034f0aaf6710f6043efa66886612d289095d1bfcc75bc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T06:26:36.289 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:36 smithi059 podman[71679]: 2024-09-19 06:26:36.115373228 +0000 UTC m=+0.505290840 container attach 8ce30dd3e5c0c3f7c4034f0aaf6710f6043efa66886612d289095d1bfcc75bc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T06:26:36.289 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:36 smithi059 podman[71679]: 2024-09-19 06:26:36.19882864 +0000 UTC m=+0.588746240 container died 8ce30dd3e5c0c3f7c4034f0aaf6710f6043efa66886612d289095d1bfcc75bc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T06:26:36.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:35 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:35.963+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:36.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:35 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:35.963+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:36.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:35 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:35.963+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:36.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:35 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:35.963+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:36.620 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:36 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:36.344+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:36.620 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:36 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:36.344+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:36.620 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:36 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:36.344+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:36.620 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:36 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:36.344+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:36.978 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T06:26:37.006 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:36 smithi059 podman[71702]: 2024-09-19 06:26:36.953395629 +0000 UTC m=+0.748486884 container remove 8ce30dd3e5c0c3f7c4034f0aaf6710f6043efa66886612d289095d1bfcc75bc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T06:26:37.006 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:36 smithi059 systemd[1]: ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.7.service: Deactivated successfully. 2024-09-19T06:26:37.006 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:36 smithi059 systemd[1]: Stopped Ceph osd.7 for 782a5144-764c-11ef-bceb-c7b262605968. 2024-09-19T06:26:37.006 INFO:journalctl@ceph.osd.7.smithi059.stdout:Sep 19 06:26:36 smithi059 systemd[1]: ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.7.service: Consumed 12.879s CPU time. 2024-09-19T06:26:37.006 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:36 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:36.890+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:37.006 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:36 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:36.890+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:37.006 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:36 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:36.890+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:37.007 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:36 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:36.890+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:37.007 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:36 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:36.890+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:37.025 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:26:37.025 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T06:26:37.025 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T06:26:37.026 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.8 2024-09-19T06:26:37.055 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:36 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:36.619+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:37.055 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:36 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:36.619+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:37.055 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:36 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:36.619+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.823200+0000 front 2024-09-19T06:25:59.823317+0000 (oldest deadline 2024-09-19T06:26:23.323339+0000) 2024-09-19T06:26:37.055 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:36 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:36.619+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:07.424336+0000 front 2024-09-19T06:26:07.424462+0000 (oldest deadline 2024-09-19T06:26:32.024770+0000) 2024-09-19T06:26:37.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:36 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:36.923+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:37.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:36 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:36.923+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:37.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:36 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:36.923+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:37.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:36 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:36.923+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:37.335 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:37 smithi071 systemd[1]: Stopping Ceph osd.8 for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:26:37.634 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:37 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:37.338+0000 7f7d97a81640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:26:37.635 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:37 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:37.338+0000 7f7d97a81640 -1 osd.8 106 *** Got signal Terminated *** 2024-09-19T06:26:37.635 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:37 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:37.338+0000 7f7d97a81640 -1 osd.8 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:26:37.635 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:37 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:37.347+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:37.635 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:37 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:37.347+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:37.635 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:37 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:37.347+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:37.635 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:37 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:37.347+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:38.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:37 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:37.633+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:38.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:37 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:37.633+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:38.086 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:37 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:37.633+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.823200+0000 front 2024-09-19T06:25:59.823317+0000 (oldest deadline 2024-09-19T06:26:23.323339+0000) 2024-09-19T06:26:38.086 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:37 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:37.633+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:07.424336+0000 front 2024-09-19T06:26:07.424462+0000 (oldest deadline 2024-09-19T06:26:32.024770+0000) 2024-09-19T06:26:38.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:37 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:37.853+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:38.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:37 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:37.853+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:38.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:37 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:37.853+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:38.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:37 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:37.853+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:38.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:37 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:37.853+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:38.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:37 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:37.886+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:38.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:37 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:37.886+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:38.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:37 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:37.886+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:38.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:37 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:37.886+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:38.660 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:38 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:38.368+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:38.661 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:38 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:38.368+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:38.661 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:38 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:38.368+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:38.661 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:38 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:38.368+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:39.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:38 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:38.659+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:39.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:38 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:38.659+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:39.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:38 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:38.659+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.823200+0000 front 2024-09-19T06:25:59.823317+0000 (oldest deadline 2024-09-19T06:26:23.323339+0000) 2024-09-19T06:26:39.086 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:38 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:38.659+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:07.424336+0000 front 2024-09-19T06:26:07.424462+0000 (oldest deadline 2024-09-19T06:26:32.024770+0000) 2024-09-19T06:26:39.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:38 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:38.811+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:39.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:38 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:38.811+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:39.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:38 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:38.811+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:39.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:38 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:38.811+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:39.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:38 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:38.811+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:39.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:38 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:38.811+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:14.156635+0000 front 2024-09-19T06:26:14.156620+0000 (oldest deadline 2024-09-19T06:26:38.256335+0000) 2024-09-19T06:26:39.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:38 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:38.866+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:39.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:38 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:38.866+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:39.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:38 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:38.866+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:39.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:38 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:38.866+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:39.625 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:39 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:39.351+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:39.625 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:39 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:39.351+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:39.625 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:39 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:39.351+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:39.625 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:39 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:39.351+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:40.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:39 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:39.624+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:40.086 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:39 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:39.624+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:40.086 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:39 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:39.624+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.823200+0000 front 2024-09-19T06:25:59.823317+0000 (oldest deadline 2024-09-19T06:26:23.323339+0000) 2024-09-19T06:26:40.086 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:39 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:39.624+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:07.424336+0000 front 2024-09-19T06:26:07.424462+0000 (oldest deadline 2024-09-19T06:26:32.024770+0000) 2024-09-19T06:26:40.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:39 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:39.791+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:40.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:39 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:39.791+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:40.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:39 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:39.791+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:40.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:39 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:39.791+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:40.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:39 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:39.791+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:40.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:39 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:39.791+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:14.156635+0000 front 2024-09-19T06:26:14.156620+0000 (oldest deadline 2024-09-19T06:26:38.256335+0000) 2024-09-19T06:26:40.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:39 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:39.856+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:40.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:39 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:39.856+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:40.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:39 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:39.856+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:40.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:39 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:39.856+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:40.654 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:40 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:40.398+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:40.654 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:40 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:40.398+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:40.654 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:40 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:40.398+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:40.655 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:40 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:40.398+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:41.084 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:40 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:40.817+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:41.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:40 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:40.817+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:41.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:40 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:40.817+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:41.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:40 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:40.817+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:41.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:40 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:40.653+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:41.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:40 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:40.653+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:41.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:40 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:40.653+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.823200+0000 front 2024-09-19T06:25:59.823317+0000 (oldest deadline 2024-09-19T06:26:23.323339+0000) 2024-09-19T06:26:41.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:40 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:40.653+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:07.424336+0000 front 2024-09-19T06:26:07.424462+0000 (oldest deadline 2024-09-19T06:26:32.024770+0000) 2024-09-19T06:26:41.086 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:40 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:40.653+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:14.325904+0000 front 2024-09-19T06:26:14.325883+0000 (oldest deadline 2024-09-19T06:26:40.126527+0000) 2024-09-19T06:26:41.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:40 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:40.788+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:41.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:40 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:40.788+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:41.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:40 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:40.788+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:41.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:40 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:40.788+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:41.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:40 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:40.788+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:41.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:40 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:40.788+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:14.156635+0000 front 2024-09-19T06:26:14.156620+0000 (oldest deadline 2024-09-19T06:26:38.256335+0000) 2024-09-19T06:26:41.625 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:41 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:41.365+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:41.626 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:41 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:41.365+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:41.626 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:41 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:41.365+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:41.626 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:41 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:41.365+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:42.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:41 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:41.624+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:42.320621+0000 front 2024-09-19T06:25:42.320636+0000 (oldest deadline 2024-09-19T06:26:08.220694+0000) 2024-09-19T06:26:42.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:41 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:41.624+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.121582+0000 front 2024-09-19T06:25:51.121558+0000 (oldest deadline 2024-09-19T06:26:15.221683+0000) 2024-09-19T06:26:42.085 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:41 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:41.624+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.823200+0000 front 2024-09-19T06:25:59.823317+0000 (oldest deadline 2024-09-19T06:26:23.323339+0000) 2024-09-19T06:26:42.086 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:41 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:41.624+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:07.424336+0000 front 2024-09-19T06:26:07.424462+0000 (oldest deadline 2024-09-19T06:26:32.024770+0000) 2024-09-19T06:26:42.086 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:41 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8[54315]: 2024-09-19T06:26:41.624+0000 7f7d9008f640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:14.325904+0000 front 2024-09-19T06:26:14.325883+0000 (oldest deadline 2024-09-19T06:26:40.126527+0000) 2024-09-19T06:26:42.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:41 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:41.790+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:42.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:41 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:41.790+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:42.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:41 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:41.790+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:42.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:41 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:41.790+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:42.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:41 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:41.790+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:42.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:41 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:41.790+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:14.156635+0000 front 2024-09-19T06:26:14.156620+0000 (oldest deadline 2024-09-19T06:26:38.256335+0000) 2024-09-19T06:26:42.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:41 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:41.845+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:42.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:41 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:41.845+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:42.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:41 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:41.845+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:42.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:41 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:41.845+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:42.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:41 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:41.845+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:15.322120+0000 front 2024-09-19T06:26:15.322036+0000 (oldest deadline 2024-09-19T06:26:41.221965+0000) 2024-09-19T06:26:42.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:42 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:42.326+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:42.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:42 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:42.326+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:42.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:42 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:42.326+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:42.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:42 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:42.326+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:42.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:42 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:42.326+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:26:43.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:42 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:42.746+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:43.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:42 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:42.746+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:43.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:42 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:42.746+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:43.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:42 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:42.746+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:43.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:42 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:42.746+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:43.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:42 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:42.746+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:14.156635+0000 front 2024-09-19T06:26:14.156620+0000 (oldest deadline 2024-09-19T06:26:38.256335+0000) 2024-09-19T06:26:43.082 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:42 smithi071 podman[73187]: 2024-09-19 06:26:42.793203268 +0000 UTC m=+5.571161900 container died bbac22e30d40dab8af874b89453e11b9935f4849aa0f0c9186b768cb97745223 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-19T06:26:43.084 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:42 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:42.816+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:43.084 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:42 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:42.816+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:43.084 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:42 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:42.816+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:43.084 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:42 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:42.816+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:43.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:42 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:42.816+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:15.322120+0000 front 2024-09-19T06:26:15.322036+0000 (oldest deadline 2024-09-19T06:26:41.221965+0000) 2024-09-19T06:26:43.335 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:43 smithi071 podman[73187]: 2024-09-19 06:26:43.171692909 +0000 UTC m=+5.949651541 container cleanup bbac22e30d40dab8af874b89453e11b9935f4849aa0f0c9186b768cb97745223 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:26:43.336 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:43 smithi071 bash[73187]: ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8 2024-09-19T06:26:43.336 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:43 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:43.305+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:43.336 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:43 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:43.305+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:43.336 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:43 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:43.306+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:43.336 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:43 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:43.306+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:43.336 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:43 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:43.306+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:26:43.790 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:43 smithi071 podman[73202]: 2024-09-19 06:26:43.447864847 +0000 UTC m=+0.648782690 container remove bbac22e30d40dab8af874b89453e11b9935f4849aa0f0c9186b768cb97745223 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:26:44.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:43 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:43.706+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:44.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:43 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:43.706+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:44.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:43 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:43.706+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:44.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:43 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:43.706+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:44.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:43 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:43.706+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:44.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:43 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:43.706+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:14.156635+0000 front 2024-09-19T06:26:14.156620+0000 (oldest deadline 2024-09-19T06:26:38.256335+0000) 2024-09-19T06:26:44.068 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:43 smithi071 podman[73293]: 2024-09-19 06:26:43.692510839 +0000 UTC m=+0.015468020 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:26:44.068 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:43 smithi071 podman[73293]: 2024-09-19 06:26:43.79879326 +0000 UTC m=+0.121750483 container create 9603c45b3c2c5ab5e73b3731a1648058730e68d8b60d0fa5ca50102caebf20ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T06:26:44.068 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:44 smithi071 podman[73293]: 2024-09-19 06:26:44.067817137 +0000 UTC m=+0.390774325 container init 9603c45b3c2c5ab5e73b3731a1648058730e68d8b60d0fa5ca50102caebf20ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T06:26:44.084 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:43 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:43.788+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:44.084 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:43 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:43.788+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:44.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:43 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:43.788+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:44.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:43 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:43.788+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:44.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:43 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:43.788+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:15.322120+0000 front 2024-09-19T06:26:15.322036+0000 (oldest deadline 2024-09-19T06:26:41.221965+0000) 2024-09-19T06:26:44.336 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:44 smithi071 podman[73293]: 2024-09-19 06:26:44.071140734 +0000 UTC m=+0.394097918 container start 9603c45b3c2c5ab5e73b3731a1648058730e68d8b60d0fa5ca50102caebf20ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T06:26:44.336 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:44 smithi071 podman[73293]: 2024-09-19 06:26:44.151153032 +0000 UTC m=+0.474110214 container attach 9603c45b3c2c5ab5e73b3731a1648058730e68d8b60d0fa5ca50102caebf20ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T06:26:44.336 INFO:journalctl@ceph.osd.8.smithi071.stdout:Sep 19 06:26:44 smithi071 podman[73293]: 2024-09-19 06:26:44.256983023 +0000 UTC m=+0.579940212 container died 9603c45b3c2c5ab5e73b3731a1648058730e68d8b60d0fa5ca50102caebf20ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:26:44.336 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:44 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:44.290+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:44.336 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:44 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:44.290+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:44.336 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:44 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:44.290+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:44.336 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:44 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:44.290+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:44.336 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:44 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:44.290+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:26:44.843 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T06:26:44.925 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:26:44.925 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T06:26:44.925 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T06:26:44.925 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.9 2024-09-19T06:26:45.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:44 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:44.735+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:45.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:44 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:44.735+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:45.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:44 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:44.735+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:45.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:44 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:44.735+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:45.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:44 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:44.735+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:45.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:44 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:44.735+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:14.156635+0000 front 2024-09-19T06:26:14.156620+0000 (oldest deadline 2024-09-19T06:26:38.256335+0000) 2024-09-19T06:26:45.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:44 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:44.798+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:45.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:44 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:44.798+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:45.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:44 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:44.798+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:45.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:44 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:44.798+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:45.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:44 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:44.798+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:15.322120+0000 front 2024-09-19T06:26:15.322036+0000 (oldest deadline 2024-09-19T06:26:41.221965+0000) 2024-09-19T06:26:45.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:45 smithi003 systemd[1]: Stopping Ceph osd.9 for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:26:45.754 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:45 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:45.401+0000 7f059f800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:26:45.754 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:45 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:45.401+0000 7f059f800640 -1 osd.9 106 *** Got signal Terminated *** 2024-09-19T06:26:45.754 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:45 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:45.401+0000 7f059f800640 -1 osd.9 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:26:45.754 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:45 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:45.752+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:45.754 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:45 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:45.752+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:45.755 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:45 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:45.752+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:45.755 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:45 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:45.752+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:45.835 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:45 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:45.340+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:45.835 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:45 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:45.340+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:45.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:45 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:45.340+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:45.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:45 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:45.340+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:45.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:45 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:45.340+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:26:46.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:45 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:45.772+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:46.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:45 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:45.772+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:46.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:45 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:45.772+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:46.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:45 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:45.772+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:46.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:45 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:45.772+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:46.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:45 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:45.772+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:14.156635+0000 front 2024-09-19T06:26:14.156620+0000 (oldest deadline 2024-09-19T06:26:38.256335+0000) 2024-09-19T06:26:46.084 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:45 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:45.752+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:15.322120+0000 front 2024-09-19T06:26:15.322036+0000 (oldest deadline 2024-09-19T06:26:41.221965+0000) 2024-09-19T06:26:46.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:46 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:46.331+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:46.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:46 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:46.331+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:46.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:46 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:46.331+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:46.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:46 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:46.331+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:46.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:46 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:46.331+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:26:46.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:46 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:46.331+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.292093+0000 front 2024-09-19T06:26:22.292110+0000 (oldest deadline 2024-09-19T06:26:45.791851+0000) 2024-09-19T06:26:47.084 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:46 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:46.720+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:47.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:46 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:46.720+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:47.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:46 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:46.720+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:47.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:46 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:46.720+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:47.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:46 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:46.720+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:15.322120+0000 front 2024-09-19T06:26:15.322036+0000 (oldest deadline 2024-09-19T06:26:41.221965+0000) 2024-09-19T06:26:47.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:46 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:46.720+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.322786+0000 front 2024-09-19T06:26:22.322773+0000 (oldest deadline 2024-09-19T06:26:45.822873+0000) 2024-09-19T06:26:47.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:46 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:46.799+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:47.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:46 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:46.799+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:47.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:46 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:46.799+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:47.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:46 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:46.799+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:47.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:46 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:46.799+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:47.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:46 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:46.799+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:14.156635+0000 front 2024-09-19T06:26:14.156620+0000 (oldest deadline 2024-09-19T06:26:38.256335+0000) 2024-09-19T06:26:47.585 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:47 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:47.298+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:47.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:47 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:47.298+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:47.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:47 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:47.298+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:47.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:47 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:47.298+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:47.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:47 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:47.298+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:26:47.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:47 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:47.298+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.292093+0000 front 2024-09-19T06:26:22.292110+0000 (oldest deadline 2024-09-19T06:26:45.791851+0000) 2024-09-19T06:26:48.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:47 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:47.783+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:48.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:47 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:47.783+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:48.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:47 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:47.783+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:48.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:47 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:47.783+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:48.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:47 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:47.783+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:48.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:47 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:47.783+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:14.156635+0000 front 2024-09-19T06:26:14.156620+0000 (oldest deadline 2024-09-19T06:26:38.256335+0000) 2024-09-19T06:26:48.084 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:47 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:47.766+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:48.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:47 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:47.766+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:48.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:47 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:47.766+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:48.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:47 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:47.766+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:48.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:47 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:47.766+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:15.322120+0000 front 2024-09-19T06:26:15.322036+0000 (oldest deadline 2024-09-19T06:26:41.221965+0000) 2024-09-19T06:26:48.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:47 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:47.766+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.322786+0000 front 2024-09-19T06:26:22.322773+0000 (oldest deadline 2024-09-19T06:26:45.822873+0000) 2024-09-19T06:26:48.585 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:48 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:48.310+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:48.585 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:48 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:48.310+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:48.585 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:48 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:48.310+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:48.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:48 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:48.310+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:48.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:48 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:48.310+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:26:48.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:48 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:48.310+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.292093+0000 front 2024-09-19T06:26:22.292110+0000 (oldest deadline 2024-09-19T06:26:45.791851+0000) 2024-09-19T06:26:49.084 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:48 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:48.814+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:49.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:48 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:48.814+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:49.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:48 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:48.814+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:49.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:48 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:48.814+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:49.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:48 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:48.814+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:15.322120+0000 front 2024-09-19T06:26:15.322036+0000 (oldest deadline 2024-09-19T06:26:41.221965+0000) 2024-09-19T06:26:49.085 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:48 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:48.814+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.322786+0000 front 2024-09-19T06:26:22.322773+0000 (oldest deadline 2024-09-19T06:26:45.822873+0000) 2024-09-19T06:26:49.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:48 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:48.801+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:49.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:48 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:48.801+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:49.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:48 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:48.801+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:49.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:48 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:48.801+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:49.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:48 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:48.801+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:49.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:48 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:48.801+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:14.156635+0000 front 2024-09-19T06:26:14.156620+0000 (oldest deadline 2024-09-19T06:26:38.256335+0000) 2024-09-19T06:26:49.835 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:49 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:49.340+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:49.835 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:49 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:49.340+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:49.835 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:49 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:49.340+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:49.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:49 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:49.340+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:49.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:49 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:49.340+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:26:49.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:49 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:49.340+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.292093+0000 front 2024-09-19T06:26:22.292110+0000 (oldest deadline 2024-09-19T06:26:45.791851+0000) 2024-09-19T06:26:50.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:49 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:49.773+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:50.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:49 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:49.773+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:50.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:49 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:49.773+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:50.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:49 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:49.773+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:50.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:49 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:49.773+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:50.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:49 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:49.773+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:14.156635+0000 front 2024-09-19T06:26:14.156620+0000 (oldest deadline 2024-09-19T06:26:38.256335+0000) 2024-09-19T06:26:50.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:49 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:49.773+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:24.157440+0000 front 2024-09-19T06:26:24.157552+0000 (oldest deadline 2024-09-19T06:26:48.857247+0000) 2024-09-19T06:26:50.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:49 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:49.857+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.014342+0000 front 2024-09-19T06:25:34.014687+0000 (oldest deadline 2024-09-19T06:25:56.314483+0000) 2024-09-19T06:26:50.334 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:49 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:49.857+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:38.615694+0000 front 2024-09-19T06:25:38.615748+0000 (oldest deadline 2024-09-19T06:26:04.515891+0000) 2024-09-19T06:26:50.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:49 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:49.857+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.517476+0000 front 2024-09-19T06:25:51.517576+0000 (oldest deadline 2024-09-19T06:26:13.817628+0000) 2024-09-19T06:26:50.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:49 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:49.857+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:57.918515+0000 front 2024-09-19T06:25:57.918558+0000 (oldest deadline 2024-09-19T06:26:20.818511+0000) 2024-09-19T06:26:50.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:49 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:49.857+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:15.322120+0000 front 2024-09-19T06:26:15.322036+0000 (oldest deadline 2024-09-19T06:26:41.221965+0000) 2024-09-19T06:26:50.335 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:49 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9[65674]: 2024-09-19T06:26:49.857+0000 7f0596200640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.322786+0000 front 2024-09-19T06:26:22.322773+0000 (oldest deadline 2024-09-19T06:26:45.822873+0000) 2024-09-19T06:26:50.585 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:50 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:50.309+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:50.585 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:50 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:50.309+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:50.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:50 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:50.309+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:50.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:50 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:50.309+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:50.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:50 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:50.309+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:26:50.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:50 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:50.309+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.292093+0000 front 2024-09-19T06:26:22.292110+0000 (oldest deadline 2024-09-19T06:26:45.791851+0000) 2024-09-19T06:26:51.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:50 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:50.781+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:51.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:50 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:50.781+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:51.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:50 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:50.781+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:51.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:50 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:50.781+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:51.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:50 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:50.781+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:51.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:50 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:50.781+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:14.156635+0000 front 2024-09-19T06:26:14.156620+0000 (oldest deadline 2024-09-19T06:26:38.256335+0000) 2024-09-19T06:26:51.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:50 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:50.781+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:24.157440+0000 front 2024-09-19T06:26:24.157552+0000 (oldest deadline 2024-09-19T06:26:48.857247+0000) 2024-09-19T06:26:51.084 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:50 smithi003 podman[115082]: 2024-09-19 06:26:50.826716468 +0000 UTC m=+5.604142644 container died 8fcd2e30972fab7616ff23c984c8d1adb7d6943520bb84bc07787476541f7888 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:26:51.402 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:51 smithi003 podman[115082]: 2024-09-19 06:26:51.373888403 +0000 UTC m=+6.151314566 container cleanup 8fcd2e30972fab7616ff23c984c8d1adb7d6943520bb84bc07787476541f7888 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T06:26:51.402 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:51 smithi003 bash[115082]: ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9 2024-09-19T06:26:51.585 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:51 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:51.265+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:51.585 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:51 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:51.265+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:51.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:51 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:51.265+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:51.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:51 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:51.265+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:51.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:51 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:51.265+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:26:51.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:51 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:51.265+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.292093+0000 front 2024-09-19T06:26:22.292110+0000 (oldest deadline 2024-09-19T06:26:45.791851+0000) 2024-09-19T06:26:52.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:51 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:51.754+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:52.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:51 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:51.754+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:52.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:51 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:51.754+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:52.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:51 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:51.754+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:52.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:51 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:51.754+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:52.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:51 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:51.754+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:14.156635+0000 front 2024-09-19T06:26:14.156620+0000 (oldest deadline 2024-09-19T06:26:38.256335+0000) 2024-09-19T06:26:52.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:51 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:51.754+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:24.157440+0000 front 2024-09-19T06:26:24.157552+0000 (oldest deadline 2024-09-19T06:26:48.857247+0000) 2024-09-19T06:26:52.084 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:51 smithi003 podman[115098]: 2024-09-19 06:26:51.651461129 +0000 UTC m=+0.813167404 container remove 8fcd2e30972fab7616ff23c984c8d1adb7d6943520bb84bc07787476541f7888 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:26:52.488 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:52 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:52.223+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:52.488 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:52 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:52.223+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:52.488 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:52 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:52.223+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:52.488 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:52 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:52.223+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:52.488 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:52 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:52.223+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:26:52.488 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:52 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:52.223+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.292093+0000 front 2024-09-19T06:26:22.292110+0000 (oldest deadline 2024-09-19T06:26:45.791851+0000) 2024-09-19T06:26:52.489 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:52 smithi003 podman[115184]: 2024-09-19 06:26:52.110886707 +0000 UTC m=+0.027542597 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:26:52.489 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:52 smithi003 podman[115184]: 2024-09-19 06:26:52.251026085 +0000 UTC m=+0.167681964 container create 28d4cdd485ca7965435553629372db2bef7e7386d6ad6d31b2916a916ace5dc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T06:26:52.489 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:52 smithi003 podman[115184]: 2024-09-19 06:26:52.487007338 +0000 UTC m=+0.403663218 container init 28d4cdd485ca7965435553629372db2bef7e7386d6ad6d31b2916a916ace5dc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:26:52.762 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:52 smithi003 podman[115184]: 2024-09-19 06:26:52.493866667 +0000 UTC m=+0.410522547 container start 28d4cdd485ca7965435553629372db2bef7e7386d6ad6d31b2916a916ace5dc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T06:26:52.762 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:52 smithi003 podman[115184]: 2024-09-19 06:26:52.578194923 +0000 UTC m=+0.494850804 container attach 28d4cdd485ca7965435553629372db2bef7e7386d6ad6d31b2916a916ace5dc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T06:26:53.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:52 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:52.782+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:53.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:52 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:52.782+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:53.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:52 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:52.782+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:53.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:52 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:52.782+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:53.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:52 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:52.782+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:53.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:52 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:52.782+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:14.156635+0000 front 2024-09-19T06:26:14.156620+0000 (oldest deadline 2024-09-19T06:26:38.256335+0000) 2024-09-19T06:26:53.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:52 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:52.782+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:24.157440+0000 front 2024-09-19T06:26:24.157552+0000 (oldest deadline 2024-09-19T06:26:48.857247+0000) 2024-09-19T06:26:53.084 INFO:journalctl@ceph.osd.9.smithi003.stdout:Sep 19 06:26:52 smithi003 podman[115184]: 2024-09-19 06:26:52.761787203 +0000 UTC m=+0.678443092 container died 28d4cdd485ca7965435553629372db2bef7e7386d6ad6d31b2916a916ace5dc7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T06:26:53.498 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:53 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:53.227+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:53.498 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:53 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:53.227+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:53.498 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:53 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:53.227+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:53.498 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:53 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:53.227+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:53.498 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:53 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:53.227+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:26:53.499 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:53 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:53.227+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.292093+0000 front 2024-09-19T06:26:22.292110+0000 (oldest deadline 2024-09-19T06:26:45.791851+0000) 2024-09-19T06:26:53.592 DEBUG:teuthology.orchestra.run.smithi003:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T06:26:53.666 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:26:53.666 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T06:26:53.667 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T06:26:53.667 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.10 2024-09-19T06:26:53.973 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:53 smithi059 systemd[1]: Stopping Ceph osd.10 for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:26:53.974 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:53 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:53.767+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:53.974 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:53 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:53.767+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:53.974 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:53 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:53.767+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:53.974 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:53 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:53.767+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:53.974 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:53 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:53.767+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:53.974 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:53 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:53.767+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:14.156635+0000 front 2024-09-19T06:26:14.156620+0000 (oldest deadline 2024-09-19T06:26:38.256335+0000) 2024-09-19T06:26:53.974 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:53 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:53.767+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:24.157440+0000 front 2024-09-19T06:26:24.157552+0000 (oldest deadline 2024-09-19T06:26:48.857247+0000) 2024-09-19T06:26:53.974 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:53 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:53.972+0000 7fc9b85fe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:26:53.974 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:53 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:53.972+0000 7fc9b85fe640 -1 osd.10 106 *** Got signal Terminated *** 2024-09-19T06:26:53.974 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:53 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:53.972+0000 7fc9b85fe640 -1 osd.10 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:26:54.585 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:54 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:54.254+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:54.585 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:54 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:54.254+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:54.585 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:54 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:54.254+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:54.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:54 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:54.254+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:54.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:54 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:54.254+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:26:54.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:54 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:54.254+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.292093+0000 front 2024-09-19T06:26:22.292110+0000 (oldest deadline 2024-09-19T06:26:45.791851+0000) 2024-09-19T06:26:55.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:54 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:54.812+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:55.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:54 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:54.812+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:55.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:54 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:54.812+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:55.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:54 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:54.812+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:55.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:54 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:54.812+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:55.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:54 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:54.812+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:14.156635+0000 front 2024-09-19T06:26:14.156620+0000 (oldest deadline 2024-09-19T06:26:38.256335+0000) 2024-09-19T06:26:55.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:54 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:54.812+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:24.157440+0000 front 2024-09-19T06:26:24.157552+0000 (oldest deadline 2024-09-19T06:26:48.857247+0000) 2024-09-19T06:26:55.585 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:55 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:55.278+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:55.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:55 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:55.278+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:55.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:55 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:55.278+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:55.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:55 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:55.278+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:55.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:55 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:55.278+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:26:55.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:55 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:55.278+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.292093+0000 front 2024-09-19T06:26:22.292110+0000 (oldest deadline 2024-09-19T06:26:45.791851+0000) 2024-09-19T06:26:55.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:55 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:55.278+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6820 osd.7 since back 2024-09-19T06:26:33.294150+0000 front 2024-09-19T06:26:33.294217+0000 (oldest deadline 2024-09-19T06:26:54.994204+0000) 2024-09-19T06:26:56.188 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:55 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:55.843+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:56.188 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:55 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:55.843+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:56.189 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:55 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:55.843+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:56.189 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:55 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:55.843+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:56.189 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:55 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:55.843+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:56.189 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:55 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:55.843+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:14.156635+0000 front 2024-09-19T06:26:14.156620+0000 (oldest deadline 2024-09-19T06:26:38.256335+0000) 2024-09-19T06:26:56.189 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:55 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:55.843+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:24.157440+0000 front 2024-09-19T06:26:24.157552+0000 (oldest deadline 2024-09-19T06:26:48.857247+0000) 2024-09-19T06:26:56.585 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:56 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:56.319+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:56.585 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:56 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:56.319+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:56.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:56 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:56.319+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:56.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:56 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:56.319+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:56.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:56 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:56.319+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:26:56.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:56 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:56.319+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.292093+0000 front 2024-09-19T06:26:22.292110+0000 (oldest deadline 2024-09-19T06:26:45.791851+0000) 2024-09-19T06:26:56.586 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:56 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:56.319+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6820 osd.7 since back 2024-09-19T06:26:33.294150+0000 front 2024-09-19T06:26:33.294217+0000 (oldest deadline 2024-09-19T06:26:54.994204+0000) 2024-09-19T06:26:57.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:56 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:56.825+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:57.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:56 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:56.825+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:57.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:56 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:56.825+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:57.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:56 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:56.825+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:57.288 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:56 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:56.825+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:57.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:56 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:56.825+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:14.156635+0000 front 2024-09-19T06:26:14.156620+0000 (oldest deadline 2024-09-19T06:26:38.256335+0000) 2024-09-19T06:26:57.289 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:56 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:56.825+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:24.157440+0000 front 2024-09-19T06:26:24.157552+0000 (oldest deadline 2024-09-19T06:26:48.857247+0000) 2024-09-19T06:26:57.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:57 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:57.344+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:57.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:57 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:57.344+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:57.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:57 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:57.344+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:57.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:57 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:57.344+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:57.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:57 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:57.344+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:26:57.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:57 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:57.344+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.292093+0000 front 2024-09-19T06:26:22.292110+0000 (oldest deadline 2024-09-19T06:26:45.791851+0000) 2024-09-19T06:26:57.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:57 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:57.344+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6820 osd.7 since back 2024-09-19T06:26:33.294150+0000 front 2024-09-19T06:26:33.294217+0000 (oldest deadline 2024-09-19T06:26:54.994204+0000) 2024-09-19T06:26:58.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:57 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:57.777+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:58.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:57 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:57.777+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:58.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:57 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:57.777+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:58.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:57 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:57.777+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:58.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:57 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:57.777+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:58.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:57 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:57.777+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:14.156635+0000 front 2024-09-19T06:26:14.156620+0000 (oldest deadline 2024-09-19T06:26:38.256335+0000) 2024-09-19T06:26:58.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:57 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:57.777+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:24.157440+0000 front 2024-09-19T06:26:24.157552+0000 (oldest deadline 2024-09-19T06:26:48.857247+0000) 2024-09-19T06:26:58.835 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:58 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:58.395+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:58.835 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:58 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:58.395+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:58.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:58 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:58.395+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:58.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:58 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:58.395+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:58.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:58 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:58.395+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:26:58.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:58 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:58.395+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.292093+0000 front 2024-09-19T06:26:22.292110+0000 (oldest deadline 2024-09-19T06:26:45.791851+0000) 2024-09-19T06:26:58.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:58 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:58.395+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6820 osd.7 since back 2024-09-19T06:26:33.294150+0000 front 2024-09-19T06:26:33.294217+0000 (oldest deadline 2024-09-19T06:26:54.994204+0000) 2024-09-19T06:26:59.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:58 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:58.749+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:30.850870+0000 front 2024-09-19T06:25:30.850760+0000 (oldest deadline 2024-09-19T06:25:56.750767+0000) 2024-09-19T06:26:59.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:58 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:58.749+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.852118+0000 front 2024-09-19T06:25:40.852180+0000 (oldest deadline 2024-09-19T06:26:07.852630+0000) 2024-09-19T06:26:59.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:58 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:58.749+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.353657+0000 front 2024-09-19T06:25:51.353969+0000 (oldest deadline 2024-09-19T06:26:14.853516+0000) 2024-09-19T06:26:59.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:58 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:58.749+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6814 osd.3 since back 2024-09-19T06:25:59.554568+0000 front 2024-09-19T06:25:59.554357+0000 (oldest deadline 2024-09-19T06:26:25.454373+0000) 2024-09-19T06:26:59.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:58 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:58.749+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:05.454906+0000 front 2024-09-19T06:26:05.454863+0000 (oldest deadline 2024-09-19T06:26:29.554970+0000) 2024-09-19T06:26:59.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:58 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:58.749+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:14.156635+0000 front 2024-09-19T06:26:14.156620+0000 (oldest deadline 2024-09-19T06:26:38.256335+0000) 2024-09-19T06:26:59.039 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:58 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10[59685]: 2024-09-19T06:26:58.749+0000 7fc9b4c14640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:24.157440+0000 front 2024-09-19T06:26:24.157552+0000 (oldest deadline 2024-09-19T06:26:48.857247+0000) 2024-09-19T06:26:59.574 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:59 smithi059 podman[71783]: 2024-09-19 06:26:59.31040584 +0000 UTC m=+5.445497740 container died ee0e330b8a54f5d793535557b1d1de9cf94b3b320e30304de9fdd6c8d28d3d1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T06:26:59.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:59 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:59.345+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:26:59.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:59 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:59.345+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:26:59.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:59 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:59.345+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:26:59.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:59 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:59.345+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:26:59.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:59 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:59.345+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:26:59.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:59 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:59.345+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.292093+0000 front 2024-09-19T06:26:22.292110+0000 (oldest deadline 2024-09-19T06:26:45.791851+0000) 2024-09-19T06:26:59.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:26:59 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:26:59.345+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6820 osd.7 since back 2024-09-19T06:26:33.294150+0000 front 2024-09-19T06:26:33.294217+0000 (oldest deadline 2024-09-19T06:26:54.994204+0000) 2024-09-19T06:27:00.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:59 smithi059 podman[71783]: 2024-09-19 06:26:59.680272522 +0000 UTC m=+5.815364430 container cleanup ee0e330b8a54f5d793535557b1d1de9cf94b3b320e30304de9fdd6c8d28d3d1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:27:00.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:26:59 smithi059 bash[71783]: ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10 2024-09-19T06:27:00.432 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:27:00 smithi059 podman[71798]: 2024-09-19 06:27:00.039933845 +0000 UTC m=+0.731970541 container remove ee0e330b8a54f5d793535557b1d1de9cf94b3b320e30304de9fdd6c8d28d3d1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T06:27:00.751 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:27:00 smithi059 podman[71886]: 2024-09-19 06:27:00.432134873 +0000 UTC m=+0.100475328 container create ca89521c52c7c0993222e8eefaeff8577c9c96d546fb9bf4bac1c65672740924 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T06:27:00.752 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:27:00 smithi059 podman[71886]: 2024-09-19 06:27:00.347416631 +0000 UTC m=+0.015757101 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:27:00.752 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:27:00 smithi059 podman[71886]: 2024-09-19 06:27:00.668618202 +0000 UTC m=+0.336958659 container init ca89521c52c7c0993222e8eefaeff8577c9c96d546fb9bf4bac1c65672740924 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T06:27:00.752 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:27:00 smithi059 podman[71886]: 2024-09-19 06:27:00.671854612 +0000 UTC m=+0.340195068 container start ca89521c52c7c0993222e8eefaeff8577c9c96d546fb9bf4bac1c65672740924 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T06:27:00.752 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:27:00 smithi059 podman[71886]: 2024-09-19 06:27:00.751025923 +0000 UTC m=+0.419366393 container attach ca89521c52c7c0993222e8eefaeff8577c9c96d546fb9bf4bac1c65672740924 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T06:27:00.835 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:00 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:00.354+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:27:00.835 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:00 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:00.354+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:27:00.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:00 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:00.354+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:27:00.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:00 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:00.354+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:27:00.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:00 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:00.354+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:27:00.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:00 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:00.354+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.292093+0000 front 2024-09-19T06:26:22.292110+0000 (oldest deadline 2024-09-19T06:26:45.791851+0000) 2024-09-19T06:27:00.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:00 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:00.354+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6820 osd.7 since back 2024-09-19T06:26:33.294150+0000 front 2024-09-19T06:26:33.294217+0000 (oldest deadline 2024-09-19T06:26:54.994204+0000) 2024-09-19T06:27:01.038 INFO:journalctl@ceph.osd.10.smithi059.stdout:Sep 19 06:27:00 smithi059 podman[71886]: 2024-09-19 06:27:00.872453384 +0000 UTC m=+0.540793852 container died ca89521c52c7c0993222e8eefaeff8577c9c96d546fb9bf4bac1c65672740924 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-19T06:27:01.515 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T06:27:01.557 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:27:01.558 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T06:27:01.558 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T06:27:01.558 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.11 2024-09-19T06:27:01.835 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:01 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:01.399+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:27:01.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:01 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:01.399+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:27:01.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:01 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:01.399+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:27:01.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:01 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:01.399+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:27:01.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:01 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:01.399+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:27:01.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:01 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:01.399+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.292093+0000 front 2024-09-19T06:26:22.292110+0000 (oldest deadline 2024-09-19T06:26:45.791851+0000) 2024-09-19T06:27:01.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:01 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:01.399+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6820 osd.7 since back 2024-09-19T06:26:33.294150+0000 front 2024-09-19T06:26:33.294217+0000 (oldest deadline 2024-09-19T06:26:54.994204+0000) 2024-09-19T06:27:01.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:01 smithi071 systemd[1]: Stopping Ceph osd.11 for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:27:02.335 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:01 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:01.838+0000 7f3490f15640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:27:02.336 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:01 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:01.838+0000 7f3490f15640 -1 osd.11 106 *** Got signal Terminated *** 2024-09-19T06:27:02.336 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:01 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:01.838+0000 7f3490f15640 -1 osd.11 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:27:02.835 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:02 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:02.359+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:27:02.835 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:02 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:02.359+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:27:02.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:02 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:02.359+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:27:02.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:02 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:02.359+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:27:02.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:02 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:02.359+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:27:02.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:02 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:02.359+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.292093+0000 front 2024-09-19T06:26:22.292110+0000 (oldest deadline 2024-09-19T06:26:45.791851+0000) 2024-09-19T06:27:02.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:02 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:02.359+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6820 osd.7 since back 2024-09-19T06:26:33.294150+0000 front 2024-09-19T06:26:33.294217+0000 (oldest deadline 2024-09-19T06:26:54.994204+0000) 2024-09-19T06:27:03.835 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:03 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:03.343+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:27:03.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:03 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:03.343+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:27:03.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:03 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:03.343+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:27:03.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:03 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:03.343+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:27:03.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:03 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:03.343+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:27:03.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:03 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:03.343+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.292093+0000 front 2024-09-19T06:26:22.292110+0000 (oldest deadline 2024-09-19T06:26:45.791851+0000) 2024-09-19T06:27:03.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:03 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:03.343+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6820 osd.7 since back 2024-09-19T06:26:33.294150+0000 front 2024-09-19T06:26:33.294217+0000 (oldest deadline 2024-09-19T06:26:54.994204+0000) 2024-09-19T06:27:04.835 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:04 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:04.390+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:27:04.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:04 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:04.390+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:27:04.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:04 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:04.390+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:27:04.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:04 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:04.390+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:27:04.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:04 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:04.390+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:27:04.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:04 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:04.390+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.292093+0000 front 2024-09-19T06:26:22.292110+0000 (oldest deadline 2024-09-19T06:26:45.791851+0000) 2024-09-19T06:27:04.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:04 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:04.390+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6820 osd.7 since back 2024-09-19T06:26:33.294150+0000 front 2024-09-19T06:26:33.294217+0000 (oldest deadline 2024-09-19T06:26:54.994204+0000) 2024-09-19T06:27:05.835 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:05 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:05.395+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:27:05.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:05 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:05.395+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:27:05.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:05 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:05.395+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:27:05.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:05 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:05.395+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:27:05.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:05 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:05.395+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:27:05.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:05 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:05.395+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.292093+0000 front 2024-09-19T06:26:22.292110+0000 (oldest deadline 2024-09-19T06:26:45.791851+0000) 2024-09-19T06:27:05.837 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:05 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:05.395+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6820 osd.7 since back 2024-09-19T06:26:33.294150+0000 front 2024-09-19T06:26:33.294217+0000 (oldest deadline 2024-09-19T06:26:54.994204+0000) 2024-09-19T06:27:06.835 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:06 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:06.374+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-19T06:25:34.484536+0000 front 2024-09-19T06:25:34.484425+0000 (oldest deadline 2024-09-19T06:26:00.885195+0000) 2024-09-19T06:27:06.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:06 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:06.374+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6804 osd.1 since back 2024-09-19T06:25:40.885799+0000 front 2024-09-19T06:25:40.885698+0000 (oldest deadline 2024-09-19T06:26:04.985774+0000) 2024-09-19T06:27:06.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:06 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:06.374+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6804 osd.2 since back 2024-09-19T06:25:51.888120+0000 front 2024-09-19T06:25:51.888135+0000 (oldest deadline 2024-09-19T06:26:15.988140+0000) 2024-09-19T06:27:06.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:06 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:06.374+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6812 osd.4 since back 2024-09-19T06:26:08.290293+0000 front 2024-09-19T06:26:08.290476+0000 (oldest deadline 2024-09-19T06:26:32.990105+0000) 2024-09-19T06:27:06.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:06 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:06.374+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.71:6812 osd.5 since back 2024-09-19T06:26:16.991299+0000 front 2024-09-19T06:26:16.991335+0000 (oldest deadline 2024-09-19T06:26:42.291413+0000) 2024-09-19T06:27:06.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:06 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:06.374+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.3:6822 osd.6 since back 2024-09-19T06:26:22.292093+0000 front 2024-09-19T06:26:22.292110+0000 (oldest deadline 2024-09-19T06:26:45.791851+0000) 2024-09-19T06:27:06.836 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:06 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11[60850]: 2024-09-19T06:27:06.374+0000 7f348d52b640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.59:6820 osd.7 since back 2024-09-19T06:26:33.294150+0000 front 2024-09-19T06:26:33.294217+0000 (oldest deadline 2024-09-19T06:26:54.994204+0000) 2024-09-19T06:27:07.431 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:07 smithi071 podman[73406]: 2024-09-19 06:27:07.159741099 +0000 UTC m=+5.411242052 container died 7f0808a68d960d9838f48f2b38bebfd927d4ba9388a6f4357a420f15ed10cdc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-19T06:27:07.773 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:07 smithi071 podman[73406]: 2024-09-19 06:27:07.52972369 +0000 UTC m=+5.781224642 container cleanup 7f0808a68d960d9838f48f2b38bebfd927d4ba9388a6f4357a420f15ed10cdc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:27:07.773 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:07 smithi071 bash[73406]: ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11 2024-09-19T06:27:08.085 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:07 smithi071 podman[73423]: 2024-09-19 06:27:07.772689341 +0000 UTC m=+0.611872733 container remove 7f0808a68d960d9838f48f2b38bebfd927d4ba9388a6f4357a420f15ed10cdc4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:27:08.401 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:08 smithi071 podman[73510]: 2024-09-19 06:27:07.997047651 +0000 UTC m=+0.016094288 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:27:08.401 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:08 smithi071 podman[73510]: 2024-09-19 06:27:08.098601675 +0000 UTC m=+0.117648337 container create 29e0b38fa5ee4e3797da1db0ee27090f54d647a735c307f4d35e9eb814b0286e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2) 2024-09-19T06:27:08.401 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:08 smithi071 podman[73510]: 2024-09-19 06:27:08.325839326 +0000 UTC m=+0.344885954 container init 29e0b38fa5ee4e3797da1db0ee27090f54d647a735c307f4d35e9eb814b0286e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:27:08.402 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:08 smithi071 podman[73510]: 2024-09-19 06:27:08.329186328 +0000 UTC m=+0.348232948 container start 29e0b38fa5ee4e3797da1db0ee27090f54d647a735c307f4d35e9eb814b0286e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T06:27:08.402 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:08 smithi071 podman[73510]: 2024-09-19 06:27:08.400711571 +0000 UTC m=+0.419758211 container attach 29e0b38fa5ee4e3797da1db0ee27090f54d647a735c307f4d35e9eb814b0286e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T06:27:08.795 INFO:journalctl@ceph.osd.11.smithi071.stdout:Sep 19 06:27:08 smithi071 podman[73510]: 2024-09-19 06:27:08.517224375 +0000 UTC m=+0.536270996 container died 29e0b38fa5ee4e3797da1db0ee27090f54d647a735c307f4d35e9eb814b0286e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T06:27:09.071 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T06:27:09.109 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:27:09.109 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T06:27:09.109 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T06:27:09.109 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.a 2024-09-19T06:27:09.584 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 19 06:27:09 smithi003 systemd[1]: Stopping Ceph mds.a for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:27:10.085 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 19 06:27:09 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-a[72851]: 2024-09-19T06:27:09.686+0000 7f3397a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:27:10.085 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 19 06:27:09 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-a[72851]: 2024-09-19T06:27:09.686+0000 7f3397a00640 -1 mds.a *** got signal Terminated *** 2024-09-19T06:27:13.335 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 19 06:27:13 smithi003 podman[115286]: 2024-09-19 06:27:13.063027356 +0000 UTC m=+3.669756152 container died 4d6e68aabb924384ad4cca9063e28e12bc11f3304fa5fae4de32961e69440faa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T06:27:13.613 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 19 06:27:13 smithi003 podman[115286]: 2024-09-19 06:27:13.607733696 +0000 UTC m=+4.214462492 container cleanup 4d6e68aabb924384ad4cca9063e28e12bc11f3304fa5fae4de32961e69440faa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-a, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:27:13.613 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 19 06:27:13 smithi003 bash[115286]: ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-a 2024-09-19T06:27:14.067 INFO:journalctl@ceph.mds.a.smithi003.stdout:Sep 19 06:27:13 smithi003 podman[115310]: 2024-09-19 06:27:13.825568878 +0000 UTC m=+0.755594804 container remove 4d6e68aabb924384ad4cca9063e28e12bc11f3304fa5fae4de32961e69440faa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-a, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T06:27:14.089 DEBUG:teuthology.orchestra.run.smithi003:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T06:27:14.162 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:27:14.162 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T06:27:14.162 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T06:27:14.162 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.d 2024-09-19T06:27:14.334 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 19 06:27:14 smithi003 systemd[1]: Stopping Ceph mds.d for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:27:14.834 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 19 06:27:14 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-d[71662]: 2024-09-19T06:27:14.556+0000 7f27f1e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:27:14.834 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 19 06:27:14 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-d[71662]: 2024-09-19T06:27:14.556+0000 7f27f1e00640 -1 mds.d *** got signal Terminated *** 2024-09-19T06:27:17.239 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 19 06:27:16 smithi003 podman[115416]: 2024-09-19 06:27:16.923158512 +0000 UTC m=+2.473118528 container died 8fac3f5192b423dbd801641114011fb12236e53d122cda9a29c5b9bd1118e133 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T06:27:17.584 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 19 06:27:17 smithi003 podman[115416]: 2024-09-19 06:27:17.361769221 +0000 UTC m=+2.911729230 container cleanup 8fac3f5192b423dbd801641114011fb12236e53d122cda9a29c5b9bd1118e133 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-d, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T06:27:17.585 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 19 06:27:17 smithi003 bash[115416]: ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-d 2024-09-19T06:27:17.899 INFO:journalctl@ceph.mds.d.smithi003.stdout:Sep 19 06:27:17 smithi003 podman[115429]: 2024-09-19 06:27:17.638086763 +0000 UTC m=+0.699063485 container remove 8fac3f5192b423dbd801641114011fb12236e53d122cda9a29c5b9bd1118e133 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-d, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-19T06:27:17.915 DEBUG:teuthology.orchestra.run.smithi003:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T06:27:17.986 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:27:17.986 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T06:27:17.987 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T06:27:17.987 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.g 2024-09-19T06:27:18.334 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 19 06:27:18 smithi003 systemd[1]: Stopping Ceph mds.g for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:27:18.834 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 19 06:27:18 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-g[72436]: 2024-09-19T06:27:18.377+0000 7f62e9800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:27:18.834 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 19 06:27:18 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-g[72436]: 2024-09-19T06:27:18.377+0000 7f62e9800640 -1 mds.g *** got signal Terminated *** 2024-09-19T06:27:21.334 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 19 06:27:21 smithi003 podman[115534]: 2024-09-19 06:27:21.037968827 +0000 UTC m=+2.778592842 container died 1f73e7768b6c11c9f9e0b6dd1a4089d8cd97b3379eaa0f740eea9ecba06e5e90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-g, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:27:21.759 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 19 06:27:21 smithi003 podman[115534]: 2024-09-19 06:27:21.448910594 +0000 UTC m=+3.189534617 container cleanup 1f73e7768b6c11c9f9e0b6dd1a4089d8cd97b3379eaa0f740eea9ecba06e5e90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-g, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:27:21.760 INFO:journalctl@ceph.mds.g.smithi003.stdout:Sep 19 06:27:21 smithi003 bash[115534]: ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-g 2024-09-19T06:27:21.953 DEBUG:teuthology.orchestra.run.smithi003:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T06:27:22.022 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:27:22.022 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T06:27:22.022 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T06:27:22.022 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.j 2024-09-19T06:27:22.334 INFO:journalctl@ceph.mds.j.smithi003.stdout:Sep 19 06:27:22 smithi003 systemd[1]: Stopping Ceph mds.j for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:27:22.834 INFO:journalctl@ceph.mds.j.smithi003.stdout:Sep 19 06:27:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-j[71282]: 2024-09-19T06:27:22.431+0000 7f09bee00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:27:22.834 INFO:journalctl@ceph.mds.j.smithi003.stdout:Sep 19 06:27:22 smithi003 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-j[71282]: 2024-09-19T06:27:22.431+0000 7f09bee00640 -1 mds.j *** got signal Terminated *** 2024-09-19T06:27:25.246 INFO:journalctl@ceph.mds.j.smithi003.stdout:Sep 19 06:27:24 smithi003 podman[115654]: 2024-09-19 06:27:24.940940684 +0000 UTC m=+2.635222642 container died ec843aefa2aad11fa288cc04869824f1aa562cc56d20b454cfdea5e963ec0afc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T06:27:25.529 INFO:journalctl@ceph.mds.j.smithi003.stdout:Sep 19 06:27:25 smithi003 podman[115654]: 2024-09-19 06:27:25.352595696 +0000 UTC m=+3.046877650 container cleanup ec843aefa2aad11fa288cc04869824f1aa562cc56d20b454cfdea5e963ec0afc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-j, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:27:25.529 INFO:journalctl@ceph.mds.j.smithi003.stdout:Sep 19 06:27:25 smithi003 bash[115654]: ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-j 2024-09-19T06:27:25.789 INFO:journalctl@ceph.mds.j.smithi003.stdout:Sep 19 06:27:25 smithi003 podman[115668]: 2024-09-19 06:27:25.528276683 +0000 UTC m=+0.581666300 container remove ec843aefa2aad11fa288cc04869824f1aa562cc56d20b454cfdea5e963ec0afc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-j, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T06:27:25.796 DEBUG:teuthology.orchestra.run.smithi003:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T06:27:25.865 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:27:25.865 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T06:27:25.865 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T06:27:25.865 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.b 2024-09-19T06:27:26.288 INFO:journalctl@ceph.mds.b.smithi059.stdout:Sep 19 06:27:25 smithi059 systemd[1]: Stopping Ceph mds.b for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:27:26.788 INFO:journalctl@ceph.mds.b.smithi059.stdout:Sep 19 06:27:26 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-b[65335]: 2024-09-19T06:27:26.327+0000 7f7264fe8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:27:26.788 INFO:journalctl@ceph.mds.b.smithi059.stdout:Sep 19 06:27:26 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-b[65335]: 2024-09-19T06:27:26.327+0000 7f7264fe8640 -1 mds.b *** got signal Terminated *** 2024-09-19T06:27:29.288 INFO:journalctl@ceph.mds.b.smithi059.stdout:Sep 19 06:27:29 smithi059 podman[71989]: 2024-09-19 06:27:29.016855504 +0000 UTC m=+2.947287867 container died ffa8ccde8f871601b27064038719dce3e75796c9efb460be8d84adea50607de5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T06:27:29.781 INFO:journalctl@ceph.mds.b.smithi059.stdout:Sep 19 06:27:29 smithi059 podman[71989]: 2024-09-19 06:27:29.405006531 +0000 UTC m=+3.335438900 container cleanup ffa8ccde8f871601b27064038719dce3e75796c9efb460be8d84adea50607de5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-b, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T06:27:29.782 INFO:journalctl@ceph.mds.b.smithi059.stdout:Sep 19 06:27:29 smithi059 bash[71989]: ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-b 2024-09-19T06:27:29.999 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T06:27:30.035 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:27:30.035 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T06:27:30.035 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T06:27:30.036 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.e 2024-09-19T06:27:30.288 INFO:journalctl@ceph.mds.e.smithi059.stdout:Sep 19 06:27:30 smithi059 systemd[1]: Stopping Ceph mds.e for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:27:30.788 INFO:journalctl@ceph.mds.e.smithi059.stdout:Sep 19 06:27:30 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-e[64720]: 2024-09-19T06:27:30.474+0000 7f32a6665640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:27:30.788 INFO:journalctl@ceph.mds.e.smithi059.stdout:Sep 19 06:27:30 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-e[64720]: 2024-09-19T06:27:30.474+0000 7f32a6665640 -1 mds.e *** got signal Terminated *** 2024-09-19T06:27:33.288 INFO:journalctl@ceph.mds.e.smithi059.stdout:Sep 19 06:27:33 smithi059 podman[72122]: 2024-09-19 06:27:33.025474587 +0000 UTC m=+2.763779850 container died c0017ef5992fb49caa670e11f1751a1e89536f50978c869e97da99d0e5a2a8fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-e, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T06:27:33.677 INFO:journalctl@ceph.mds.e.smithi059.stdout:Sep 19 06:27:33 smithi059 podman[72122]: 2024-09-19 06:27:33.400411961 +0000 UTC m=+3.138717257 container cleanup c0017ef5992fb49caa670e11f1751a1e89536f50978c869e97da99d0e5a2a8fb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:27:33.677 INFO:journalctl@ceph.mds.e.smithi059.stdout:Sep 19 06:27:33 smithi059 bash[72122]: ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-e 2024-09-19T06:27:33.835 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T06:27:33.868 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:27:33.868 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T06:27:33.869 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T06:27:33.869 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.h 2024-09-19T06:27:34.197 INFO:journalctl@ceph.mds.h.smithi059.stdout:Sep 19 06:27:33 smithi059 systemd[1]: Stopping Ceph mds.h for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:27:34.538 INFO:journalctl@ceph.mds.h.smithi059.stdout:Sep 19 06:27:34 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-h[65020]: 2024-09-19T06:27:34.194+0000 7f14a1eb4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:27:34.538 INFO:journalctl@ceph.mds.h.smithi059.stdout:Sep 19 06:27:34 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-h[65020]: 2024-09-19T06:27:34.194+0000 7f14a1eb4640 -1 mds.h *** got signal Terminated *** 2024-09-19T06:27:37.288 INFO:journalctl@ceph.mds.h.smithi059.stdout:Sep 19 06:27:37 smithi059 podman[72246]: 2024-09-19 06:27:37.025076323 +0000 UTC m=+2.937230147 container died 531d5cd8bc40aa04bcd9a118f8e7cdecb4b789d51944f88586fadc0097a604b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-h, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T06:27:37.647 INFO:journalctl@ceph.mds.h.smithi059.stdout:Sep 19 06:27:37 smithi059 podman[72246]: 2024-09-19 06:27:37.387181854 +0000 UTC m=+3.299335661 container cleanup 531d5cd8bc40aa04bcd9a118f8e7cdecb4b789d51944f88586fadc0097a604b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-h, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T06:27:37.647 INFO:journalctl@ceph.mds.h.smithi059.stdout:Sep 19 06:27:37 smithi059 bash[72246]: ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-h 2024-09-19T06:27:37.784 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T06:27:37.816 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:27:37.816 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T06:27:37.817 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T06:27:37.817 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.k 2024-09-19T06:27:38.288 INFO:journalctl@ceph.mds.k.smithi059.stdout:Sep 19 06:27:37 smithi059 systemd[1]: Stopping Ceph mds.k for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:27:38.288 INFO:journalctl@ceph.mds.k.smithi059.stdout:Sep 19 06:27:38 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-k[64408]: 2024-09-19T06:27:38.148+0000 7f2d03cdd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:27:38.288 INFO:journalctl@ceph.mds.k.smithi059.stdout:Sep 19 06:27:38 smithi059 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-k[64408]: 2024-09-19T06:27:38.148+0000 7f2d03cdd640 -1 mds.k *** got signal Terminated *** 2024-09-19T06:27:41.283 INFO:journalctl@ceph.mds.k.smithi059.stdout:Sep 19 06:27:41 smithi059 podman[72364]: 2024-09-19 06:27:41.026816127 +0000 UTC m=+2.984083822 container died 59be01e6c86601f4dc1d8eb07d9a6c23ecc8e94f993d4190a9a918eced04dd0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-k, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:27:41.538 INFO:journalctl@ceph.mds.k.smithi059.stdout:Sep 19 06:27:41 smithi059 podman[72364]: 2024-09-19 06:27:41.382400156 +0000 UTC m=+3.339667893 container cleanup 59be01e6c86601f4dc1d8eb07d9a6c23ecc8e94f993d4190a9a918eced04dd0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-k, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:27:41.538 INFO:journalctl@ceph.mds.k.smithi059.stdout:Sep 19 06:27:41 smithi059 bash[72364]: ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-k 2024-09-19T06:27:41.769 DEBUG:teuthology.orchestra.run.smithi059:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T06:27:41.800 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:27:41.801 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T06:27:41.801 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T06:27:41.801 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.c 2024-09-19T06:27:42.085 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 19 06:27:41 smithi071 systemd[1]: Stopping Ceph mds.c for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:27:42.585 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 19 06:27:42 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-c[66049]: 2024-09-19T06:27:42.084+0000 7fcb594c0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:27:42.586 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 19 06:27:42 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-c[66049]: 2024-09-19T06:27:42.084+0000 7fcb594c0640 -1 mds.c *** got signal Terminated *** 2024-09-19T06:27:45.335 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 19 06:27:45 smithi071 podman[73611]: 2024-09-19 06:27:45.022847688 +0000 UTC m=+3.022436079 container died 1f1909f6bdaa6229370fb34934c7ca0293fc9dbdc035c628fd04b58bb15cafa9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-19T06:27:45.644 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 19 06:27:45 smithi071 podman[73611]: 2024-09-19 06:27:45.450852731 +0000 UTC m=+3.450441116 container cleanup 1f1909f6bdaa6229370fb34934c7ca0293fc9dbdc035c628fd04b58bb15cafa9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-c, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T06:27:45.644 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 19 06:27:45 smithi071 bash[73611]: ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-c 2024-09-19T06:27:45.874 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T06:27:45.897 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 19 06:27:45 smithi071 podman[73636]: 2024-09-19 06:27:45.64372941 +0000 UTC m=+0.613635881 container remove 1f1909f6bdaa6229370fb34934c7ca0293fc9dbdc035c628fd04b58bb15cafa9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T06:27:45.897 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 19 06:27:45 smithi071 systemd[1]: ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.c.service: Deactivated successfully. 2024-09-19T06:27:45.897 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 19 06:27:45 smithi071 systemd[1]: Stopped Ceph mds.c for 782a5144-764c-11ef-bceb-c7b262605968. 2024-09-19T06:27:45.897 INFO:journalctl@ceph.mds.c.smithi071.stdout:Sep 19 06:27:45 smithi071 systemd[1]: ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.c.service: Consumed 2.227s CPU time. 2024-09-19T06:27:45.910 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:27:45.911 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T06:27:45.911 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T06:27:45.911 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.f 2024-09-19T06:27:46.231 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 19 06:27:45 smithi071 systemd[1]: Stopping Ceph mds.f for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:27:46.585 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 19 06:27:46 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-f[65747]: 2024-09-19T06:27:46.229+0000 7fab1261b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:27:46.585 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 19 06:27:46 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-f[65747]: 2024-09-19T06:27:46.229+0000 7fab1261b640 -1 mds.f *** got signal Terminated *** 2024-09-19T06:27:49.335 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 19 06:27:49 smithi071 podman[73744]: 2024-09-19 06:27:49.0168671 +0000 UTC m=+2.892032914 container died 1753bbb0dc9fcc87fb75a0e9dd000b1b7d3134df40c4de5b3ed66cae7a02189b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-f, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T06:27:49.822 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 19 06:27:49 smithi071 podman[73744]: 2024-09-19 06:27:49.570910289 +0000 UTC m=+3.446076099 container cleanup 1753bbb0dc9fcc87fb75a0e9dd000b1b7d3134df40c4de5b3ed66cae7a02189b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T06:27:49.823 INFO:journalctl@ceph.mds.f.smithi071.stdout:Sep 19 06:27:49 smithi071 bash[73744]: ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-f 2024-09-19T06:27:50.000 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T06:27:50.034 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:27:50.034 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T06:27:50.034 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T06:27:50.034 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.i 2024-09-19T06:27:50.351 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 19 06:27:50 smithi071 systemd[1]: Stopping Ceph mds.i for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:27:50.835 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 19 06:27:50 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-i[66346]: 2024-09-19T06:27:50.349+0000 7f35dbf8d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:27:50.836 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 19 06:27:50 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-i[66346]: 2024-09-19T06:27:50.349+0000 7f35dbf8d640 -1 mds.i *** got signal Terminated *** 2024-09-19T06:27:53.334 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 19 06:27:53 smithi071 podman[73861]: 2024-09-19 06:27:53.024050113 +0000 UTC m=+2.776788640 container died 027efa936dc3293098c7493612ad80a3319d33b7150a8309e504a8215a3541a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-i, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T06:27:53.585 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 19 06:27:53 smithi071 podman[73861]: 2024-09-19 06:27:53.424236294 +0000 UTC m=+3.176974822 container cleanup 027efa936dc3293098c7493612ad80a3319d33b7150a8309e504a8215a3541a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-i, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T06:27:53.586 INFO:journalctl@ceph.mds.i.smithi071.stdout:Sep 19 06:27:53 smithi071 bash[73861]: ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-i 2024-09-19T06:27:53.918 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T06:27:53.950 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:27:53.950 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T06:27:53.950 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T06:27:53.950 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.l 2024-09-19T06:27:54.335 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 19 06:27:54 smithi071 systemd[1]: Stopping Ceph mds.l for 782a5144-764c-11ef-bceb-c7b262605968... 2024-09-19T06:27:54.335 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 19 06:27:54 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-l[65446]: 2024-09-19T06:27:54.269+0000 7f9dd6ba1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:27:54.336 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 19 06:27:54 smithi071 ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-l[65446]: 2024-09-19T06:27:54.269+0000 7f9dd6ba1640 -1 mds.l *** got signal Terminated *** 2024-09-19T06:27:57.304 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 19 06:27:57 smithi071 podman[73980]: 2024-09-19 06:27:57.013911924 +0000 UTC m=+2.849867840 container died bf30b1269f5fd06ee4c9b2e0ce14980d523ed06f4b83d6db7296ebf9b50a2dd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-l, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T06:27:57.586 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 19 06:27:57 smithi071 podman[73980]: 2024-09-19 06:27:57.394136999 +0000 UTC m=+3.230092914 container cleanup bf30b1269f5fd06ee4c9b2e0ce14980d523ed06f4b83d6db7296ebf9b50a2dd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-l, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T06:27:57.586 INFO:journalctl@ceph.mds.l.smithi071.stdout:Sep 19 06:27:57 smithi071 bash[73980]: ceph-782a5144-764c-11ef-bceb-c7b262605968-mds-l 2024-09-19T06:27:57.810 DEBUG:teuthology.orchestra.run.smithi071:> sudo pkill -f 'journalctl -f -n 0 -u ceph-782a5144-764c-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T06:27:57.842 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T06:27:57.842 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T06:27:57.843 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 782a5144-764c-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T06:27:58.125 INFO:teuthology.orchestra.run.smithi003.stdout:Deleting cluster with fsid: 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:28:02.145 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 782a5144-764c-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T06:28:02.354 INFO:teuthology.orchestra.run.smithi059.stdout:Deleting cluster with fsid: 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:28:04.760 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 782a5144-764c-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T06:28:04.962 INFO:teuthology.orchestra.run.smithi071.stdout:Deleting cluster with fsid: 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:28:07.401 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:28:07.467 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:28:07.500 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:28:07.527 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T06:28:07.529 DEBUG:teuthology.misc:Transferring archived files from smithi003:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911710/remote/smithi003/crash 2024-09-19T06:28:07.530 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar c -f - -C /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/crash -- . 2024-09-19T06:28:07.599 INFO:teuthology.orchestra.run.smithi003.stderr:tar: /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T06:28:07.599 INFO:teuthology.orchestra.run.smithi003.stderr:tar: Error is not recoverable: exiting now 2024-09-19T06:28:07.602 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911710/remote/smithi059/crash 2024-09-19T06:28:07.603 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/crash -- . 2024-09-19T06:28:07.644 INFO:teuthology.orchestra.run.smithi059.stderr:tar: /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T06:28:07.644 INFO:teuthology.orchestra.run.smithi059.stderr:tar: Error is not recoverable: exiting now 2024-09-19T06:28:07.646 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911710/remote/smithi071/crash 2024-09-19T06:28:07.647 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/crash -- . 2024-09-19T06:28:07.687 INFO:teuthology.orchestra.run.smithi071.stderr:tar: /var/lib/ceph/782a5144-764c-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T06:28:07.688 INFO:teuthology.orchestra.run.smithi071.stderr:tar: Error is not recoverable: exiting now 2024-09-19T06:28:07.688 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T06:28:07.688 DEBUG:teuthology.orchestra.run.smithi003:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T06:28:07.771 INFO:tasks.cephadm:Compressing logs... 2024-09-19T06:28:07.771 DEBUG:teuthology.orchestra.run.smithi003:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T06:28:07.775 DEBUG:teuthology.orchestra.run.smithi059:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T06:28:07.778 DEBUG:teuthology.orchestra.run.smithi071:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T06:28:07.803 INFO:teuthology.orchestra.run.smithi071.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T06:28:07.804 INFO:teuthology.orchestra.run.smithi071.stderr:: No such file or directory 2024-09-19T06:28:07.804 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T06:28:07.804 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T06:28:07.804 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T06:28:07.804 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T06:28:07.807 INFO:teuthology.orchestra.run.smithi059.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T06:28:07.807 INFO:teuthology.orchestra.run.smithi059.stderr:: No such file or directory 2024-09-19T06:28:07.808 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T06:28:07.808 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T06:28:07.808 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.10.log: /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T06:28:07.808 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T06:28:07.808 INFO:teuthology.orchestra.run.smithi059.stderr:gzip/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-volume.log: -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T06:28:07.808 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T06:28:07.808 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.b.log: /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T06:28:07.811 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T06:28:07.811 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T06:28:07.811 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.11.log: 82.0% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T06:28:07.811 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T06:28:07.812 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.log 2024-09-19T06:28:07.812 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T06:28:07.812 INFO:teuthology.orchestra.run.smithi071.stderr: 90.5% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T06:28:07.812 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T06:28:07.812 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.l.log: 87.3% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T06:28:07.812 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T06:28:07.813 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.4.log: /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.audit.log: 90.4% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T06:28:07.813 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T06:28:07.813 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T06:28:07.813 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.cephadm.log: 82.0% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T06:28:07.813 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.log 2024-09-19T06:28:07.816 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T06:28:07.817 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.8.log: 90.9% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T06:28:07.820 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.log: 87.3% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T06:28:07.820 INFO:teuthology.orchestra.run.smithi059.stderr: 91.0% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T06:28:07.824 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T06:28:07.824 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T06:28:07.825 INFO:teuthology.orchestra.run.smithi003.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T06:28:07.825 INFO:teuthology.orchestra.run.smithi003.stderr:: No such file or directory 2024-09-19T06:28:07.825 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T06:28:07.826 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T06:28:07.827 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T06:28:07.828 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.h.log: 92.0% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T06:28:07.828 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T06:28:07.829 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T06:28:07.830 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T06:28:07.832 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T06:28:07.833 INFO:teuthology.orchestra.run.smithi003.stderr: 84.4% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T06:28:07.833 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mon.a.log: 90.3% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T06:28:07.833 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T06:28:07.834 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mgr.z.log: 92.1% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T06:28:07.834 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.log 2024-09-19T06:28:07.836 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T06:28:07.837 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T06:28:07.838 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.6.log: /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T06:28:07.839 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T06:28:07.843 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.d.log: 91.0% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T06:28:07.846 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T06:28:07.847 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mgr.x.log: 87.3% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T06:28:07.847 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T06:28:07.848 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T06:28:07.848 INFO:teuthology.orchestra.run.smithi003.stderr: 94.4% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T06:28:07.849 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T06:28:07.850 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T06:28:07.861 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T06:28:07.861 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.5% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T06:28:07.864 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T06:28:07.879 INFO:teuthology.orchestra.run.smithi003.stderr: 94.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T06:28:07.881 INFO:teuthology.orchestra.run.smithi071.stderr: 94.5% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T06:28:07.883 INFO:teuthology.orchestra.run.smithi059.stderr: 94.4% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T06:28:07.904 INFO:teuthology.orchestra.run.smithi071.stderr: 92.4% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T06:28:07.914 INFO:teuthology.orchestra.run.smithi003.stderr: 94.5% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T06:28:07.931 INFO:teuthology.orchestra.run.smithi003.stderr: 92.6% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T06:28:07.932 INFO:teuthology.orchestra.run.smithi071.stderr: 92.6% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T06:28:07.945 INFO:teuthology.orchestra.run.smithi059.stderr: 92.5% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T06:28:07.946 INFO:teuthology.orchestra.run.smithi059.stderr: 94.7% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T06:28:08.160 INFO:teuthology.orchestra.run.smithi003.stderr: 90.2% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T06:28:08.164 INFO:teuthology.orchestra.run.smithi071.stderr: 93.9% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T06:28:08.202 INFO:teuthology.orchestra.run.smithi071.stderr: 91.5% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T06:28:08.403 INFO:teuthology.orchestra.run.smithi059.stderr: 91.6% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T06:28:08.922 INFO:teuthology.orchestra.run.smithi003.stderr: 90.3% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T06:28:08.964 INFO:teuthology.orchestra.run.smithi071.stderr: 92.0% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T06:28:08.966 INFO:teuthology.orchestra.run.smithi071.stderr: 91.9% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T06:28:09.088 INFO:teuthology.orchestra.run.smithi059.stderr: 91.6% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T06:28:09.176 INFO:teuthology.orchestra.run.smithi071.stderr: 91.5% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T06:28:09.204 INFO:teuthology.orchestra.run.smithi003.stderr: 93.0% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T06:28:09.209 INFO:teuthology.orchestra.run.smithi003.stderr: 92.7% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T06:28:09.498 INFO:teuthology.orchestra.run.smithi059.stderr: 92.9% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T06:28:09.554 INFO:teuthology.orchestra.run.smithi071.stderr: 92.1% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T06:28:09.555 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-09-19T06:28:09.555 INFO:teuthology.orchestra.run.smithi071.stderr:real 0m1.763s 2024-09-19T06:28:09.555 INFO:teuthology.orchestra.run.smithi071.stderr:user 0m6.192s 2024-09-19T06:28:09.556 INFO:teuthology.orchestra.run.smithi071.stderr:sys 0m0.239s 2024-09-19T06:28:09.577 INFO:teuthology.orchestra.run.smithi059.stderr: 92.6% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T06:28:09.730 INFO:teuthology.orchestra.run.smithi059.stderr: 92.9% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T06:28:09.764 INFO:teuthology.orchestra.run.smithi003.stderr: 92.7% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T06:28:09.892 INFO:teuthology.orchestra.run.smithi059.stderr: 91.7% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T06:28:09.894 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-09-19T06:28:09.894 INFO:teuthology.orchestra.run.smithi059.stderr:real 0m2.101s 2024-09-19T06:28:09.894 INFO:teuthology.orchestra.run.smithi059.stderr:user 0m9.310s 2024-09-19T06:28:09.894 INFO:teuthology.orchestra.run.smithi059.stderr:sys 0m0.321s 2024-09-19T06:28:09.946 INFO:teuthology.orchestra.run.smithi003.stderr: 92.4% -- replaced with /var/log/ceph/782a5144-764c-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T06:28:09.950 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-19T06:28:09.950 INFO:teuthology.orchestra.run.smithi003.stderr:real 0m2.146s 2024-09-19T06:28:09.950 INFO:teuthology.orchestra.run.smithi003.stderr:user 0m7.743s 2024-09-19T06:28:09.950 INFO:teuthology.orchestra.run.smithi003.stderr:sys 0m0.726s 2024-09-19T06:28:09.951 INFO:tasks.cephadm:Archiving logs... 2024-09-19T06:28:09.952 DEBUG:teuthology.misc:Transferring archived files from smithi003:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911710/remote/smithi003/log 2024-09-19T06:28:09.952 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T06:28:11.089 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911710/remote/smithi059/log 2024-09-19T06:28:11.090 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T06:28:12.414 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911710/remote/smithi071/log 2024-09-19T06:28:12.415 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T06:28:13.407 INFO:tasks.cephadm:Removing cluster... 2024-09-19T06:28:13.408 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 782a5144-764c-11ef-bceb-c7b262605968 --force 2024-09-19T06:28:13.693 INFO:teuthology.orchestra.run.smithi003.stdout:Deleting cluster with fsid: 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:28:14.162 DEBUG:teuthology.orchestra.run.smithi059:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 782a5144-764c-11ef-bceb-c7b262605968 --force 2024-09-19T06:28:14.359 INFO:teuthology.orchestra.run.smithi059.stdout:Deleting cluster with fsid: 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:28:14.619 DEBUG:teuthology.orchestra.run.smithi071:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 782a5144-764c-11ef-bceb-c7b262605968 --force 2024-09-19T06:28:14.823 INFO:teuthology.orchestra.run.smithi071.stdout:Deleting cluster with fsid: 782a5144-764c-11ef-bceb-c7b262605968 2024-09-19T06:28:15.087 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T06:28:15.087 DEBUG:teuthology.orchestra.run.smithi003:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T06:28:15.126 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T06:28:15.144 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T06:28:15.160 INFO:tasks.cephadm:Teardown complete 2024-09-19T06:28:15.160 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T06:28:15.172 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T06:28:15.172 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T06:28:15.177 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T06:28:15.187 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T06:28:15.298 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T06:28:15.308 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T06:28:15.308 DEBUG:teuthology.orchestra.run.smithi003:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:28:15.313 DEBUG:teuthology.orchestra.run.smithi059:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:28:15.316 DEBUG:teuthology.orchestra.run.smithi071:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:28:15.329 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:28:15.330 INFO:teuthology.orchestra.run.smithi071.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:28:15.335 INFO:teuthology.orchestra.run.smithi071.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:28:15.335 INFO:teuthology.orchestra.run.smithi071.stdout:=============================================================================== 2024-09-19T06:28:15.335 INFO:teuthology.orchestra.run.smithi071.stdout:^* hv01.front.sepia.ceph.com 3 6 377 30 -7270ns[-3751ns] +/- 46ms 2024-09-19T06:28:15.335 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 30 +261us[ +265us] +/- 76ms 2024-09-19T06:28:15.335 INFO:teuthology.orchestra.run.smithi071.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 -201us[ -201us] +/- 69ms 2024-09-19T06:28:15.335 INFO:teuthology.orchestra.run.smithi071.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:28:15.335 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:28:15.335 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2024-09-19T06:28:15.335 INFO:teuthology.orchestra.run.smithi059.stdout:^* hv01.front.sepia.ceph.com 3 6 377 29 -33us[ -29us] +/- 46ms 2024-09-19T06:28:15.335 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 32 +257us[ +261us] +/- 76ms 2024-09-19T06:28:15.336 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 29 -212us[ -207us] +/- 69ms 2024-09-19T06:28:15.336 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:28:15.343 INFO:teuthology.orchestra.run.smithi003.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:28:15.350 INFO:teuthology.orchestra.run.smithi003.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:28:15.350 INFO:teuthology.orchestra.run.smithi003.stdout:=============================================================================== 2024-09-19T06:28:15.351 INFO:teuthology.orchestra.run.smithi003.stdout:^* hv01.front.sepia.ceph.com 3 7 377 28 -20us[ -28us] +/- 46ms 2024-09-19T06:28:15.351 INFO:teuthology.orchestra.run.smithi003.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 29 +254us[ +246us] +/- 76ms 2024-09-19T06:28:15.351 INFO:teuthology.orchestra.run.smithi003.stdout:^+ hv03.front.sepia.ceph.com 3 8 377 159 -229us[ -243us] +/- 68ms 2024-09-19T06:28:15.351 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:28:15.352 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T06:28:15.362 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T06:28:15.363 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T06:28:15.372 DEBUG:teuthology.orchestra.run.smithi003:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T06:28:15.529 DEBUG:teuthology.orchestra.run.smithi059:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T06:28:15.605 DEBUG:teuthology.orchestra.run.smithi071:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T06:28:15.673 DEBUG:teuthology.orchestra.run.smithi003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:28:15.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:28:15.735 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:28:15.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:28:15.766 DEBUG:teuthology.orchestra.run.smithi071:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:28:15.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:28:15.793 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T06:28:15.805 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T06:28:15.853 INFO:teuthology.task.internal:Duration was 2061.196135 seconds 2024-09-19T06:28:15.854 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T06:28:15.864 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T06:28:15.865 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T06:28:15.869 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T06:28:15.874 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T06:28:15.913 INFO:teuthology.orchestra.run.smithi071.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:28:15.914 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:28:15.952 INFO:teuthology.orchestra.run.smithi003.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:28:16.375 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T06:28:16.375 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi003.front.sepia.ceph.com 2024-09-19T06:28:16.375 DEBUG:teuthology.orchestra.run.smithi003:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T06:28:16.426 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi059.front.sepia.ceph.com 2024-09-19T06:28:16.426 DEBUG:teuthology.orchestra.run.smithi059:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T06:28:16.455 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi071.front.sepia.ceph.com 2024-09-19T06:28:16.455 DEBUG:teuthology.orchestra.run.smithi071:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T06:28:16.485 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T06:28:16.485 DEBUG:teuthology.orchestra.run.smithi003:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T06:28:16.490 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T06:28:16.498 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T06:28:16.552 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T06:28:16.552 DEBUG:teuthology.orchestra.run.smithi003:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T06:28:16.556 DEBUG:teuthology.orchestra.run.smithi059:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T06:28:16.570 DEBUG:teuthology.orchestra.run.smithi071:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T06:28:17.897 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T06:28:17.909 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T06:28:17.909 DEBUG:teuthology.orchestra.run.smithi003:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T06:28:17.966 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T06:28:17.995 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T06:28:18.026 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T06:28:18.039 DEBUG:teuthology.orchestra.run.smithi003:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:28:18.043 DEBUG:teuthology.orchestra.run.smithi059:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:28:18.046 DEBUG:teuthology.orchestra.run.smithi071:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:28:18.071 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = core 2024-09-19T06:28:18.094 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = core 2024-09-19T06:28:18.110 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern = core 2024-09-19T06:28:18.140 DEBUG:teuthology.orchestra.run.smithi003:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:28:18.173 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:28:18.174 DEBUG:teuthology.orchestra.run.smithi059:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:28:18.190 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:28:18.191 DEBUG:teuthology.orchestra.run.smithi071:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T06:28:18.207 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:28:18.207 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T06:28:18.219 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T06:28:18.220 DEBUG:teuthology.misc:Transferring archived files from smithi003:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911710/remote/smithi003 2024-09-19T06:28:18.220 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T06:28:18.313 DEBUG:teuthology.misc:Transferring archived files from smithi059:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911710/remote/smithi059 2024-09-19T06:28:18.313 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T06:28:18.354 DEBUG:teuthology.misc:Transferring archived files from smithi071:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911710/remote/smithi071 2024-09-19T06:28:18.354 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T06:28:18.394 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T06:28:18.394 DEBUG:teuthology.orchestra.run.smithi003:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T06:28:18.398 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T06:28:18.401 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T06:28:18.446 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T06:28:18.461 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T06:28:18.461 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T06:28:18.473 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T06:28:18.473 DEBUG:teuthology.orchestra.run.smithi003:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T06:28:18.477 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T06:28:18.480 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T06:28:18.495 INFO:teuthology.orchestra.run.smithi059.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 06:28 /home/ubuntu/cephtest 2024-09-19T06:28:18.502 INFO:teuthology.orchestra.run.smithi071.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 06:28 /home/ubuntu/cephtest 2024-09-19T06:28:18.508 INFO:teuthology.orchestra.run.smithi003.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 06:28 /home/ubuntu/cephtest 2024-09-19T06:28:18.510 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T06:28:18.522 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T06:28:18.551 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/fs/test_o_trunc}} duration: 2061.196135044098 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T06:28:18.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T06:28:18.632 INFO:teuthology.run:pass